Data Platform Engineer

Requirements:

• 5+ years of experience in

  DevOps

  ,

  platform engineering

  , or site reliability engineering roles

• 3+ years of hands-on experience with

  Microsoft Azure

  cloud services and Azure DevOps

• Strong experience with

  Microsoft Fabric

  or related Microsoft data platforms (

  PowerBI, Azure Synapse Analytics, Azure Data Factory)

• Expertise in Infrastructure as Code tools(T

  erraform, Ansible, ARM templates, Cloud Formation

  )

• Proficiency in scripting and programming languages including

  Python, PowerShell, Bash, and

  SQL

• Deep understanding of CI/CD principles and tools (AzureDevOps, GitHub Actions)

• Experience with containerization and orchestration technologies

  (Docker, Kubernetes

  ) and cloud services (AKS, EKS, GKE)

• Experience with cloud blob data services (Azure Storage, AWS S3, GCP Cloud Storage) and cloud managed relational databases (Azure SQL, Amazon RDS, GCP Cloud SQL)

• Strong knowledge of data warehousing, data lakes, lake house architectures, and

  ETL/ELT

  processes

• Hands-on experience with monitoring and observability tools(Azure Monitor, Prometheus, Grafana, ELK Stack, Datadog)

• Understanding of storage ACLs, network security, encryption, identity management, and cloud security best practices

• Experience deploying and managing Microsoft Fabric workspaces, capacities, and items

• Knowledge of One Lake architecture, shortcuts, mirroring, maintenance, and security

• Familiarity with Fabric REST APIs and SDK for automation and integration

• Experience with Fabric Git integration and deployment pipelines

• Knowledge of Power BI administration and deployment best practices

• Proficiency in designing scalable ETL/ELT architectures and data pipeline orchestration strategies

• Knowledge of Delta Lake, Parquet for optimization techniques such as partitioning/clustering

• Deep understanding of data lakehouse architecture, medallion patterns, and data mesh organizational frameworks

Responsibilities:

Platform Engineering & Architecture

• Design, build, and maintain the Microsoft Fabric data platform infrastructure, including OneLake, Data Warehouse, Lakehouse, Data Factory pipelines, Real-Time Intelligence, and Power BI environments

• Implement and manage platform architecture supporting data engineering, data science, analytics, and business intelligence workloads across the organization

• Develop and maintain Infrastructure as Code (IaC) solutions using Terraform, Azure Resource Manager templates, or similar tools for consistent, repeatable deployments

• Architect multi-region, scalable solutions within Microsoft Fabric to support global humanitarian operations

• Design and implement OneLake storage structure, shortcuts, mirroring configurations, and data lake optimization strategies

CI/CD & Deployment Automation

• Build and maintain comprehensive CI/CD pipelines for Microsoft Fabric workspaces using Azure DevOps

• Implement automated deployment strategies utilizing Fabric REST APIs, Git integration, Fabric deployment pipelines, and fabric-cicd tools

• Manage source control integration with Microsoft Fabric workspaces, establishing branching strategies and deployment workflows across development, test, and production environments

• Automate infrastructure provisioning, configuration management, and deployment processes for all Fabric components

• Develop and maintain deployment rules, parameterization strategies, and environment-specific configurations

Platform Maintenance & Operations

• Perform ongoing maintenance of Microsoft Fabric platform components including capacity management, workspace administration, and item lifecycle management

• Monitor platform health, performance metrics, and resource utilization using Azure Monitor, Prometheus, Grafana, or integrated Fabric monitoring capabilities

• Implement comprehensive observability and alerting framework covering logs, metrics, and traces across the entire data platform

• Conduct regular platform updates, patches, and upgrades while minimizing disruption to users and maintaining system stability

• Manage disaster recovery procedures, backup strategies, and business continuity planning for critical data assets

• Optimize platform performance through capacity planning, resource allocation, and cost management strategies

Security, Governance & Compliance

• Implement and enforce security controls using Microsoft Purview for data governance, classification, and protection across the Fabric ecosystem

• Configure and maintain role-based access controls (RBAC), row-level security, column-level security, and OneLake folder/table-level permissions

• Establish and enforce data sensitivity labeling, information protection policies, and data loss prevention (DLP) measures

• Integrate Microsoft Entra authentication, manage service principals, and implement managed identities for secure platform access

• Ensure compliance with global regulatory frameworks including GDPR, HIPAA, and ISO standards through automated controls and auditing

• Implement network security measures including conditional access, private endpoints, customer-managed encryption keys, and secure data sharing protocols

• Monitor and respond to security incidents, conducting regular security assessments and vulnerability management

Automation & Scripting

• Develop automation scripts using Python, PowerShell, Bash, and Azure CLI for routine operational tasks and platform management

• Create custom tooling and utilities to enhance platform capabilities and improve developer experience

• Automate data pipeline orchestration, monitoring, alerting, and incident response workflows