Data Engineer

Advanced Data Engineer

Canada (Remote)

Full-time

Must-Have Skills:

• Strong proficiency in Python, PySpark, and PyTest with solid software engineering best practices.

• Strong understanding of OOP concepts

  .

• Hands-on experience with Azure Databricks and Delta Live Tables (DLT)

  .

• Experience designing, developing, and maintaining scalable batch and streaming data pipelines using Databricks Workflows.

• Strong knowledge of data architecture, data modeling, and ETL/ELT processes

  .

• Experience with Azure cloud services

  , including storage, compute, and security.

• Hands-on experience with Databricks Unity Catalog

  .

• Knowledge of workflow orchestration, pipeline monitoring, alerting, and troubleshooting.

• Experience implementing data quality checks, validation, and performance optimization.

• Strong understanding of Agile methodologies and collaborative development practices.

Good to Have:

• GitHub Actions, CI/CD, and Datadog exposure.