Locations: Charlotte NC & New Jersey
Must Have Technical/Functional Skills
Primary Skill: Hadoop, Scala, Shell scripting
Secondary: Java, Spring Boot
Roles & Responsibilities
– Design, develop, and maintain large-scale Big Data solutions using Hadoop ecosystem technologies. Develop data ingestion, transformation, and processing frameworks using Scala, Spark, and Hadoop.
– Create and maintain Shell scripts for automation, monitoring, deployment, and operational support.
– Build reusable and scalable backend services using Java and Spring Boot.
– Develop and optimize Spark applications for batch and real-time data processing.
– Design and implement RESTful APIs and microservices using Spring Boot.
– Work with HDFS, Hive, Sqoop, Kafka, Oozie, and other Hadoop ecosystem components.
– Perform performance tuning and optimization of Hadoop and Spark jobs.
– Troubleshoot production issues and provide L2/L3 support for critical applications.
– Collaborate with business analysts, architects, DevOps teams, and other stakeholders.
– Participate in code reviews, unit testing, CI/CD implementation, and release activities.
– Ensure compliance with enterprise security, governance, and data quality standards.