E

Databricks Data Engineer

Elevate Government Solutions

RemoteseniorPosted 1h ago

Visa & sponsorship

  • The posting says it will not sponsor a visa for this role.
  • A US security clearance is required, which effectively means citizens only.

Job description

This position requires an ACTIVE SECRET security clearance. Your application will not be reviewed if you do not have an ACTIVE security clearance at SECRET or above.

Elevate Government Solutions is a high growth Technology Services company focused on driving technological change in the government space. Our teams engage with various government agencies to develop and deploy emerging technology solutions using a tailored Agile methodology.

We are seeking a highly motivated and intellectually curious Databricks Platform Engineer/Admin to join our team working with a Federal client. The position will be a remote role open to US citizens residing in the United States with a Secret security clearance.

Responsibilities and Duties

  • Design, build, and maintain batch and streaming pipelines using PySpark, SQL, Databricks Workflows/DLT

  • Implement Medallion architecture (bronze/silver/gold) for data curation and quality

  • Build ingestion frameworks for structured/semi-structured/unstructured data from files, databases, APIs, and streaming sources (Kafka, Kinesis, Auto Loader)

  • Design data models (dimensional or domain-specific) supporting downstream analytics

  • Build and consume APIs for data integration with downstream systems

  • Optimize Spark jobs for performance and cost (partitioning, caching, cluster sizing)

  • Implement data quality checks and pipeline monitoring

  • Document data flows and lineage for maintainability

Required Experience, Skills and Qualifications

  • 5+ years data engineering experience, 2+ years on Databricks

  • Strong PySpark and SQL for production-grade transformations

  • Experience with both batch and streaming data processing

  • Solid grounding in data modeling and data architecture principles

  • Python proficiency and Git-based CI/CD workflow experience

  • Familiarity with Unity Catalog (catalogs, schemas, grants) from a consumer perspective

  • Experience with DLT or Workflows orchestration a plus

Education Requirement

  • 4 year Bachelor's Degree in Computer Science/Eng or related (highly preferred)

Benefits

  • Health Insurance

  • 401k match

  • Unlimited Vacation

  • 11 Federal Holidays

  • Remote work

  • Training

  • Mentoring/Coaching