MLOps Engineer

About AI71

AI71 builds secure, enterprise-ready AI applications for developers, businesses, governments, knowledge workers, and sector-specific users.

The company focuses on responsible research and applying advanced AI to real-world challenges.

The Role

Own ML infrastructure and reliability strategy across AI71's platform.

Define how LLMs and other deep learning models are deployed, fine-tuned, and served at scale.

Own architecture decisions across SaaS and on-premises operating models.

Mentor engineers across teams and drive multi-quarter ML infrastructure strategy.

What You'll Do

• Define ML infrastructure architecture covering model deployment with vLLM, Triton, or TGI; pipelines with MLflow or Kubeflow; and cloud-native infrastructure.

• Set reliability direction through monitoring, latency, throughput, availability targets, and incident response across research and production.

• Mentor senior MLOps engineers and improve operational standards across multiple teams.

• Drive initiatives that improve inference performance and cost efficiency, including distributed training frameworks.

• Partner with research, product, and engineering leadership on multi-quarter ML infrastructure strategy.

• Scale ML infrastructure across managed SaaS and fully air-gapped on-premises deployments.

What You'll Bring

• 10+ years of MLOps, ML infrastructure, or machine learning engineering experience with architectural ownership.

• Experience architecting large-scale LLM and ML infrastructure deployments.

• Deep AWS, Azure, or GCP expertise and strong Python proficiency.

• Mentorship experience developing engineers into independent higher-level contributors.

• Experience with managed SaaS and disconnected air-gapped ML systems.

• Architectural-depth Kubernetes expertise covering GPU scheduling, multi-tenancy, operators, and distributed workload failure modes.

• Strong communication, stakeholder management, and decision-making skills.

Strong Preference

• Platform-level production reliability ownership, including SLOs, incident command, postmortems, and reliability improvement.

• Architecture-level distributed training and fine-tuning experience, including cluster design, checkpointing, and failure recovery.

• Deep GPU systems knowledge, including CUDA, NCCL, NVLink, and InfiniBand or RoCE.

• Portfolio-level model optimization experience with quantization or speculative decoding and measurable outcomes.

• Experience in regulated or security-constrained environments involving governance, lineage, audit, and secrets management.

• Experience maturing MLOps practices through standards, platform abstractions, and paved paths.

• Bare-metal GPU cluster architecture and scheduling with Slurm or Kubernetes.

Nice to Have

• Conference speaking, technical writing, or industry thought leadership.

• Open-source contributions to inference, serving, or ML infrastructure projects.

• C/C++ or CUDA kernel experience for performance-critical paths.

• Arabic language skills.

Why AI71

• Mission-driven work on AI applications for critical sectors.

• Opportunity to work with advanced models and resources on real-world challenges.

• Competitive compensation, benefits, and career growth opportunities.

• Flexible working environment with current tools and technologies.