Data Engineer

1. About Our Client:

This organization is a partner supporting federal health agencies, focusing on programs within the Department of Veterans Affairs. It addresses challenges related to managing and optimizing large-scale healthcare data across on-premises and cloud environments to enhance analytics, reporting, and operational decision-making for veterans' programs.

2. About the Opportunity:

The Data Engineer role is responsible for designing, optimizing, and maintaining scalable data pipelines and databases to support analytics and operational needs. This position ensures reliable, high-performance data delivery and improves data accessibility and quality, directly contributing to the effectiveness of veterans' health programs.

3. Responsibilities:

• Design, build, deploy, and maintain scalable ETL/ELT pipelines using SQL, Spark, Databricks, and Azure-native tools

• Implement workflow orchestration, scheduling, and monitoring for automated data delivery

• Develop data quality monitoring and observability tools to manage data integrity

• Optimize data ingestion, transformation, and storage for performance and cost efficiency

• Administer and optimize relational databases including performance tuning and query optimization

• Implement and maintain database security, access controls, and auditing per security requirements

• Support backup, restore, disaster recovery, and high-availability configurations

• Monitor database health and troubleshoot issues to ensure data integrity

• Automate data quality checks, validation rules, and anomaly detection

• Develop dashboards and alerting systems for proactive data issue identification

• Support data profiling, lineage, and metadata management to enhance data transparency

• Collaborate with stakeholders to define data quality standards and implement scalable solutions

4. Requirements:

• Bachelor’s degree

• Minimum 5 years in data engineering, ETL/ELT development, or database administration

• Strong skills in SQL, Python, PySpark, Spark, and Databricks, including performance tuning

• Experience administering and optimizing production relational databases

• Familiarity with VA platforms and enterprise data assets

• Experience with automated data pipelines and data quality frameworks

• Proficient with Azure analytics services: Data Factory, Synapse, Data Lake Storage, Azure SQL

• Experience using GitHub, GitLab, and GitHub Actions

• Authorized to work indefinitely in the U.S. without sponsorship

• Ability to obtain a public trust clearance

Preferred qualifications include experience with large-scale unstructured data pipelines, cloud migrations, medallion architecture development, data governance, and relevant cloud certifications.

5. Pay Range and Compensation Package:

• Salary range: $130,000 to $155,000

• The compensation package and benefits are determined by factors including location, education, skills, experience, and organizational requirements

6. Benefits & Perks:

• Health, dental, and vision insurance coverage

• Flexible spending accounts

• Disability and life insurance

• Retirement plan

• Paid time off

Equal Opportunity Statement:

Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.

Note:

TalentHop is not the Employer of Record (EOR) for this role. Our purpose in this opportunity is to connect exceptional candidates with leading employers. We help job seekers worldwide discover roles that match their goals and guide them to complete their full application directly through the hiring company’s career page or ATS.