Senior Data Engineer

Role Overview

We are seeking a highly skilled

senior data platform engineer

to drive the end-to-end lifecycle of our enterprise data infrastructure. In this role, you will bridge the gap between business needs and technical execution. You will be responsible for

user interaction, technical design, core development, and production support

of high-throughput data platforms.

The ideal candidate is deeply proficient in

distributed computing, data pipeline orchestration, and relational database systems

. You should possess a strong analytical mindset to evaluate complex data flows and processes from ingestion to consumption.

🛠️ Core Responsibilities

Requirements & Design

• Interface directly with business users

  and product owners to capture, refine, and document functional data requirements.

• Translate business logic into technical design specifications

  , including data models, architectural blueprints, and data flow diagrams.

• Analyze legacy workflows, system dependencies, and data structures

  to optimize processing efficiency and structural design.

Development & Engineering

• Build and optimize robust batch and streaming data pipelines

  using Python, PySpark, and Scala.

• Write, tune, and maintain complex SQL queries

  and stored procedures within relational databases (DB2 and PostgreSQL).

• Perform rigorous code reviews

  to enforce code quality, architectural standards, performance benchmarks, and security compliance.

Support & Maintenance

• Provide comprehensive user support

  and tier-3 technical troubleshooting for data platform issues, performance bottlenecks, and data discrepancies.

• Implement continuous integration and deployment (CI/CD) pipelines

  alongside automated data validation and monitoring systems.

📋 Role Requirements

Technical Skills

Required

• Programming & Distributed Computing:

  Mastery of

  Python

  and

  Spark

  (both

  PySpark

  and native

  Scala

  variations).

• Database Technologies:

  Expert-level

  SQL

  skills with deep hands-on experience managing and query-tuning relational databases (

  RDBMS

  ), specifically

  IBM DB2

  and

  PostgreSQL

  .

• Data Architecture:

  Strong competency in designing relational models, dimensional schemas (Star/Snowflake), and data lakehouse architectures.

• Process Mapping:

  Proven ability to analyze and document data flows, lineage, and complex system integrations.

Preferred (Good to Have)

• Cloud Data Platforms:

  Modern cloud data warehouse knowledge, specifically

  Snowflake

  (architecture, snowpipes, tasks, and performance optimization).

Experience & Qualifications

• Education:

  Bachelor’s degree in computer science, data engineering, information systems, or a related quantitative field.

• Experience:

  5+ years

  of dedicated experience in data engineering, data platform development, or data architecture roles.

• Communication:

  Exceptional verbal and written communication skills, with a proven track record of translating complex technical concepts for non-technical business users.