Senior Data Engineer

Job Role: Data Engineer

Job location: Remote

Job Summary

We are looking for a Senior Data Engineer with strong experience building and supporting real-time data pipelines and streaming architectures. The ideal candidate will have hands-on experience with Apache Kafka, AWS MSK, Amazon Kinesis, and AWS data services.

Key Responsibilities

Design, build, and maintain scalable real-time data pipelines using Apache Kafka, AWS MSK, and Kinesis.

Design Kafka topics, partitions, replication, schemas, and consumer groups.

Develop streaming applications and ETL pipelines using Kafka Streams, Spark Streaming, or AWS Lambda.

Integrate streaming data with S3, Redshift, data lakes, warehouses, and downstream analytics platforms.

Monitor and optimize streaming systems for performance, throughput, latency, and reliability.

Implement data quality, error handling, security, and recovery processes.

Manage Kafka/MSK environments, including scaling, retention, replication, and troubleshooting.

Work with data architects, application teams, data scientists, and analysts to deliver reliable data solutions.

Mentor junior engineers and provide technical guidance on data engineering projects.

Required Qualifications

7+ years of experience in Data Engineering, with strong experience in real-time/streaming data.

Strong hands-on experience with Apache Kafka and AWS MSK.

Production experience with Amazon Kinesis.

Strong knowledge of real-time and event-driven data architectures.

Strong programming skills in Python, Java, or Scala.

Experience with SQL and distributed data processing.

Experience with AWS services such as S3, Redshift, Lambda, Glue, or EMR.

Experience with monitoring and troubleshooting streaming systems.

Bachelor’s degree in Computer Science, Engineering, or a related field.

Nice to Have

Experience with Apache Flink or Apache Spark Streaming.

Experience with Terraform, Docker, or Kubernetes.

Experience with Apache Airflow.

AWS Certified Data Engineer – Associate.