About the Company
Scalian is an international consulting company with over 6,000 employees and offices across Europe and North America. The company specializes in delivering services in Data, Cloud, and Artificial Intelligence for a wide range of clients, supporting large-scale technology transformation projects.
About the Role
A Senior Big Data Developer is sought to join a stable, high-impact technology project within Scalian Spain. The role focuses on designing and building scalable data solutions in cloud environments, working across the full data lifecycle within modern data architectures.
Responsibilities
- Design and implement ETL processes for scalable data solutions.
- Develop and maintain data pipelines within distributed and cloud-based environments.
- Work with big data processing frameworks and data modeling approaches.
- Ensure data quality through validation, testing, and monitoring processes.
- Participate in the design and development of modern data architectures.
- Contribute to CI/CD pipelines and deployment processes.
- Work with relational and distributed data storage systems.
- Collaborate in building BI and analytics solutions.
Requirements
- More than 3 years of experience in ETL development and implementation.
- More than 3 years of experience working with SQL.
- At least 2 years of experience with Apache Spark.
- At least 2 years of experience with Scala.
- Experience with BI and analytics platforms such as Databricks, Power BI, and Starburst.
- Experience in data modeling and data design.
- Experience working with data lakes including Apache Hive, AWS S3, and AWS environments.
- Knowledge of data validation and data quality processes.
- Experience with relational databases.
- Experience with unit testing and code quality tools such as SonarQube and/or Fortify.
- Experience working with CI/CD pipelines.