
Data Engineer with OCI
Liberty IT Technologies & Solutions
Job description
We are seeking a
Senior Data Engineer
with 10+ years of experience. This hybrid role combines technical product ownership, data architecture, and hands-on data engineering.
You will bridge the gap between business stakeholders and engineering teams. Responsibilities include gathering requirements, creating technical documentation, and building scalable healthcare data pipelines on cloud platforms.
Key Responsibilities
-
Requirement Gathering:
Lead discovery sessions with business stakeholders to translate needs into technical specifications.
-
Technical Documentation:
Create and maintain Product Design Documents (PDD) and Source-to-Target Mapping (STM).
-
Pipeline Engineering:
Build and optimize metadata-driven data ingestion pipelines using Python, PySpark, and Spark SQL.
-
Healthcare Interoperability:
Parse and process healthcare data formats including EDI (837/835), HL7, and FHIR bundles.
-
Cloud & Architecture:
Manage data structures across Oracle Cloud Infrastructure (OCI) and Snowflake using Delta Lake and Parquet.
-
Data Governance:
Ensure strict data lineage, auditability, and regulatory compliance (HIPAA).
-
Team Collaboration:
Act as a Technical Product Owner in Agile environments, coordinating with onshore and offshore teams.
-
DataOps Integration:
Support UAT activities and automate deployments using Git, CI/CD pipelines, and Terraform.
Required Qualifications & Skills
-
Experience:
10+ years in Data Engineering, Business Systems Analysis, or Technical Product Ownership.
-
Education:
Bachelor’s or Master's degree in Computer Science, Engineering, or a related field.
-
Core Technical Skills:
Advanced Python, PySpark, Spark SQL, JSON, XML, and complex SQL.
-
Healthcare Expertise:
Hands-on experience with EDI 837/835, HL7, or FHIR standards.
-
Cloud & Data Platforms:
Strong experience with OCI, Oracle, Snowflake, or Greenplum.
-
Data Warehousing:
Deep understanding of DWH concepts, Star/Snowflake schemas, and Fact/Dimension tables.
-
DevOps & Automation:
Practical experience with Terraform, Git, CI/CD, and pipeline orchestrators.
-
Soft Skills:
Excellent stakeholder management, problem-solving, and communication skills.
Preferred Skills
-
Experience in the
Pharmacy Domain
.
-
Proficiency with
Alteryx
workflow development.
-
Relevant cloud or technical certifications.