Senior Data Engineer (Python/Scala)

United States

Company Social & Media:

ICF

About the Company

The company is a global advisory and technology services provider that combines industry expertise with advanced technology to help organizations solve complex challenges. It operates in a collaborative environment focused on innovation, data-driven decision-making, and long-term impact.

About the Role

The organization is seeking a Data Engineer to support data management and data analysis initiatives in a consulting environment. The role involves building scalable data pipelines, developing dashboards, and ensuring high data quality and governance standards across platforms.

Key responsibilities

  • Create dashboards using AWS QuickSight with visuals and tables for data analysis
  • Design and maintain scalable Spark-based data ingestion pipelines
  • Lead orchestration for batch and event-driven workflows
  • Develop reusable templates and self-service data solutions
  • Optimize distributed compute resources for performance and cost efficiency
  • Define and enforce data contracts and manage schema versioning
  • Automate metadata processes to ensure strong data governance
  • Collaborate on compliance requirements including PII handling and data retention
  • Implement and enforce data quality checks across datasets
  • Embed data quality validation within pipelines
  • Log and monitor quality metrics for continuous improvement
  • Work with architects to define engineering standards and best practices
  • Translate business requirements into scalable data products
  • Lead incident triage, root cause analysis, and system improvements
  • Define and track KPIs for data quality, stability, and cost
  • Present and demonstrate dashboards to stakeholders and clients
  • Work within a SAFe agile framework to deliver high-quality solutions

Requirements

  • Bachelor’s degree
  • 1+ years of experience with tools such as JIRA, GitHub, and Confluence
  • 2+ years of experience working with AWS cloud platforms
  • 2+ years of experience with relational databases and data warehousing concepts
  • 1+ years of experience with Python, Scala, and Spark technologies
  • 1+ years of experience with data orchestration tools such as NiFi, Airflow, or Step Functions
  • 1+ years of experience with serverless or cloud-native analytics platforms
  • Ability to obtain and maintain a Federal Public Trust
  • Must reside in and be authorized to work in the United States
  • Must have lived in the United States for at least three of the past five years

Nice to Have

  • Familiarity with data profiling, data catalogs, lineage tools, or observability platforms
  • Experience with federated data governance practices
  • Strong problem-solving skills and quantitative thinking
  • Ability to manage multiple projects in fast-paced environments
  • Experience in consulting or healthcare environments

Professional Skills

  • Strong leadership and teamwork abilities
  • Effective analytical, problem-solving, and decision-making skills
  • Excellent communication and interpersonal skills
  • High level of organization and attention to detail
  • Ability to prioritize and manage multiple tasks

Benefits

  • Competitive compensation based on experience, skills, and location
  • Inclusive and collaborative work environment
  • Opportunities for professional growth and development
  • Support for workplace accommodations where applicable

Complete details about this role can be found on the official website below: