DataOps/Cloud Data Engineer - Senior

DataOps/Cloud Data Engineer - Senior

Onsite - Toronto ON

Mandatory Skills and Experience (8+ years experience):

• Design, build, automate and optimize complex data ETL/ELT processes using Databricks, Delta Live Tables (DLT) and equivalent.

• Development of unified data platforms using Databricks and Unity catalog or its equivalent.

• Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration.

• Advanced SQL skills (PL/SQL, TSQL).

• Big Data processing Frameworks (PySpark).

• Proficient in creating Azure Data Factory pipelines for copy activity and custom data pipelines in Databricks with CI CD (Azure DevOPS Git Integration) .

• Data migration and data integration across different platforms Oracle to Azure Data Lake, Oracle to Databricks, Oracle to Microsoft Fabric.

Desirable Skills and Experience:

• Data lake design and development with focus on extracting, transforming data coming from various data sources and loading into Lakehouse in medallion architecture.

• Advanced skills and hands-on experience with Oracle databases, Azure SQL Server and Azure Data Factory.

• Cloud technologies (Azure, Google, AWS).

• PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery.

• Scripting languages (Python, Unix shell, Scala).