C

Data Engineer

COZMALABS

On-site๐Ÿ‡ถ๐Ÿ‡ฆDoha, DA, QatarseniorPosted 10h ago

Visa & sponsorship

  • Employers in Qatar sponsor the residence visa by default, and nothing in the posting says otherwise.

Job description

We are looking for an experienced Data Engineer with 5+ years of experience to join our team full-time. The ideal candidate will have a strong background in building and optimizing data pipelines, with a focus on supporting AI-driven solutions. The role involves collaborating closely with software engineers and AI teams to ensure reliable data flows for AI models and contributing to cloud-based data integration using Microsoft Azure.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL processes to support AI-driven projects.

  • Build and optimize data infrastructure for efficient data management, processing, and storage in Microsoft Azure cloud environments.

  • Collaborate with AI engineers to prepare and manage data for machine learning models and AI solutions.

  • Ensure data pipelines are secure, reliable, and meet performance standards.

  • Monitor and troubleshoot pipeline performance to ensure timely and accurate data delivery.

  • Implement data governance policies and ensure compliance with data security standards.

Required Qualifications

  • 5+ years of professional experience as a Data Engineer, preferably working on complex data pipelines for AI or machine learning projects.

  • Strong proficiency in SQL and experience with relational databases such as PostgreSQL and SQL Server, as well as NoSQL databases such as MongoDB.

  • Hands-on experience with Microsoft Azure data services, including Azure Data Factory, Azure Synapse Analytics, and Azure Databricks.

  • Experience with data integration tools and ETL frameworks such as Apache Airflow.

  • Proficiency in Python or another programming language used for data manipulation.

  • Strong understanding of data warehousing concepts and best practices.

  • Experience developing and maintaining data pipelines for AI or machine learning workflows.

  • Excellent problem-solving and analytical skills.

  • Bachelor's degree in Computer Science, Engineering, or a related field.

  • Good written and spoken English communication skills.

Desirable Qualifications

  • Familiarity with machine learning models and data preprocessing techniques for AI solutions.

  • Knowledge of containerization tools such as Docker and Kubernetes for data pipeline deployment.

How to Apply

Interested candidates who meet the above requirements are requested to complete the application form using the link below:

Application Form: https://forms.gle/DmMYgUdxBwXhZGut5

Work Location: In person