About the Role
The company is seeking a Senior Big Data Developer to design, build, and support large-scale data processing applications on AWS.
The role focuses on distributed data platforms, high-volume batch processing, API-driven services, and cloud-native Big Data solutions. The developer will work with Apache Spark, Hadoop, Scala, PySpark, Java, Python, and AWS services.
This is a long-term, full-time contract position based in Hyderabad, India. The working model is hybrid, with on-site attendance required on Wednesdays and Thursdays.
Responsibilities
- Design, develop, and maintain scalable Big Data applications.
- Build distributed data processing pipelines.
- Develop high-performance batch processing solutions using Apache Spark, Hadoop, and AWS.
- Build REST APIs and microservices for enterprise data platforms.
- Develop cloud-native applications using AWS services.
- Work with AWS EMR, EC2, ECS, S3, API Gateway, Step Functions, and Airflow.
- Develop applications using Scala, PySpark, Java, Kotlin, and Python.
- Optimize Spark, Hadoop, and distributed workloads for performance and scalability.
- Develop Linux shell scripts.
- Build Python-based automation.
- Collaborate with Data Engineering, Architecture, DevOps, and Product teams.
- Build and maintain CI/CD pipelines.
- Work with Jenkins and AWS DevOps tooling.
- Troubleshoot production issues.
- Participate in code reviews.
- Support reliable delivery and operation of large-scale enterprise data solutions.
Requirements
- At least 7 years of professional experience developing Big Data applications.
- Strong experience building scalable distributed data processing platforms.
- Hands-on experience with Apache Spark.
- Hands-on experience with Hadoop.
- Experience with HDFS.
- Experience with MapReduce.
- Experience with Cassandra.
- Strong Scala programming skills.
- Strong PySpark experience.
- Strong Java programming skills.
- Experience with Kotlin.
- Strong Python programming skills.
- Experience developing REST APIs.
- Experience developing microservices.
- Strong experience with AWS.
- Experience with EMR, EC2, ECS, S3, API Gateway, and Step Functions.
- Experience with Airflow.
- Experience working with Linux.
- Experience with shell scripting.
- Experience developing Python automation.
- Experience building CI/CD pipelines.
- Experience with Jenkins.
- Experience with Maven and Gradle.
- Experience with Artifactory.
- Experience with AWS CodeCommit.
- Experience with CloudFormation.
- Strong analytical and troubleshooting skills.
- Strong communication skills.
Contract Details
- Contract type: Full-time contract.
- Duration: Long term.
- Working hours: 40 hours per week.
- Schedule: Monday to Friday, 8 hours per day.
- Location: Hyderabad, India.
- Working model: Hybrid.
- On-site requirement: Wednesday and Thursday.