About the Company
The company operates in the technology sector, focusing on cloud-based data solutions and modern data engineering practices. It supports large-scale data processing and analytics initiatives by leveraging advanced cloud infrastructure and distributed systems.
The organization promotes collaboration, technical excellence, and continuous improvement while working with modern tools and scalable architectures.
About the Role
The Scala Spark Developer role focuses on building and maintaining data pipelines within AWS cloud infrastructure. The position involves working with multiple data sources, designing ETL transformations, and supporting scalable data processing systems.
The role requires strong analytical skills and the ability to work with complex datasets while contributing to cloud-based data architecture and infrastructure.
Key Responsibilities
- Build ETL transformations using Scala and Spark
- Work with AWS services including EMR, S3, and Step Functions
- Develop and execute Spark jobs within EMR environments
- Create and manage Lambda functions
- Analyze and integrate data from multiple sources
- Support and maintain cloud-based data infrastructure
- Collaborate with teams to ensure data processing efficiency and reliability
Requirements
- Strong experience with Scala and Spark
- Experience working with AWS services including EMR, S3, and Step Functions
- Knowledge of SQL Server and Oracle databases
- Experience using GitHub for version control
- Experience with Terraform for infrastructure management
- Strong analytical and problem-solving skills
- Ability to work with complex data systems
Nice to Have
- Experience with JIRA and Confluence
- Strong troubleshooting and technical support skills
- Ability to present complex technical concepts clearly
- Strong communication and teamwork skills
- Experience in IT development and support environments
Qualifications
- University degree in technology or computer science
Benefits
- Opportunity to work with modern cloud and big data technologies
- Exposure to large-scale data processing systems
- Collaborative team environment
- Involvement in end-to-end data engineering projects
- Professional development and learning opportunities