Senior Data Engineer

Deep DSG has been engaged by a global pharmaceutical client to deliver a transformative Global AI-Driven Alarm Analytics Program. This initiative will convert manufacturing alarm data into a structured enterprise asset supporting operational excellence, compliance, advanced analytics, and future AI-enabled manufacturing capabilities.

We are seeking an experienced Senior Data Engineer to design and implement the data platforms, pipelines, and integration frameworks that underpin this global program.

The Role

Working with architects, data scientists, manufacturing SMEs, and client stakeholders, you will build scalable data solutions that integrate manufacturing and operational technology (OT) data, contextualize alarm information, and deliver trusted datasets for analytics and AI at enterprise scale.

Key Responsibilities

• Design and develop scalable Lakehouse and data warehouse solutions using Databricks, Delta Lake, PySpark, Snowflake, and Azure.

• Build and maintain data ingestion and transformation pipelines from manufacturing systems including DCS, SCADA, Historians (e.g. AVEVA PI), MES, and SQL databases.

• Develop contextualized manufacturing datasets by integrating equipment, process, and operational metadata.

• Configure, optimize, and govern Snowflake environments, including security, performance, and data access controls.

• Enable advanced alarm analytics and AI use cases through high-quality, structured manufacturing data.

• Establish data governance, lineage, documentation, and compliance standards within a regulated GxP environment.

• Support multi-site deployments and scalable enterprise data architecture.

Required Experience & Skills

• 7+ years' experience in Data Engineering, Data Platforms, or related disciplines.

• Strong hands-on experience with Snowflake, Databricks, PySpark, SQL, Python, and cloud-based data engineering.

• Experience designing ETL/ELT pipelines and modern Lakehouse architectures.

• Experience integrating manufacturing and industrial systems, including DCS, SCADA, MES, and Historian platforms.

• Knowledge of OPC UA, MQTT, Kafka, Kepware, HighByte, Ignition, or similar industrial integration technologies.

• Experience working with time-series, event-driven, and operational manufacturing data.

• Familiarity with manufacturing standards such as ISA-88, ISA-95, ISA-18.2, and IEC 62682.

• Experience with Git-based version control and CI/CD practices.

Qualifications

• Degree in Computer Science, Data Engineering, Software Engineering, Information Systems, or a related field.

• Snowflake SnowPro Core Certification and Databricks Data Engineer Associate Certification.

• Additional Snowflake, Databricks, Azure, AWS, or GCP certifications are advantageous.