Big Data Engineer (Spark / Python / Scala)

Madrid 35,000 - 40,000 EUR / Year

Company Social & Media:

AD4 Octógono

About the Company

AD4 Octógono is a technology company that combines people and technical expertise to support large-scale projects. The company provides a collaborative environment focused on knowledge sharing, teamwork, continuous learning, and professional growth.

About the Role

AD4 Octógono is seeking a Big Data Engineer with 3 to 4 years of experience to join a large international project.

The engineer will develop and maintain Big Data solutions, create data-processing pipelines, contribute to scalable data architectures, and collaborate with technical and functional teams in an international environment.

The position follows a hybrid working model, with 50% on-site attendance at the client’s offices in Madrid Río.

Responsibilities

  • Develop and maintain Big Data solutions.
  • Design and implement data-processing workflows.
  • Build data pipelines using Apache Spark and Apache Airflow.
  • Deploy and maintain solutions on Kubernetes.
  • Contribute to the design of scalable data architectures.
  • Work with Python and Scala.
  • Use IBM Data Platform and IBM Cloud Object Storage.
  • Work with COS, S3, and Bash.
  • Collaborate with technical and functional teams in an international environment.
  • Support several projects and teams simultaneously.
  • Optimize data platform performance.
  • Identify and implement continuous improvements.
  • Share technical knowledge with colleagues.
  • Work independently while contributing to cross-functional teams.

Requirements

  • Between 3 and 4 years of experience in Big Data environments.
  • Professional experience with Apache Spark.
  • Experience with Python.
  • Experience with Scala.
  • Experience with Apache Airflow.
  • Experience with Kubernetes.
  • Experience with IBM Data Platform.
  • Experience with IBM Cloud Object Storage, COS, or S3.
  • Experience using Bash.
  • Knowledge of data architecture and distributed platforms.
  • Ability to work across several projects and teams simultaneously.
  • C1 English proficiency.
  • Strong teamwork and collaboration skills.
  • Clear and open communication.
  • Strong analytical skills.
  • Proactive and independent working style.
  • Flexibility to work in multidisciplinary environments.
  • Results-oriented approach.
  • Commitment to continuous improvement.

Preferred Qualifications

  • B2 French proficiency may be considered as an alternative in certain cases.

Working Conditions and Benefits

  • Immediate start.
  • Participation in a large international project.
  • Hybrid working model with 50% attendance at the client’s Madrid Río offices.
  • A 42-hour working week from September to June.
  • A 30-hour working week during the summer months.
  • Continuous training.
  • Professional growth opportunities.
  • Collaborative environment focused on teamwork and knowledge sharing.

Please refer to the official website below for a comprehensive job description: