MLOps Engineer

About the role

We’re looking for a mid-to-senior MLOps engineer to help build the intelligence layer of our AI platform. This is not a traditional MLOps role focused only on maintaining pipelines and deployments. You will help create the underlying infrastructure that makes sophisticated AI workflows accessible through a simple, self-service product experience: model deployment, training, notebooks, functions, UI-driven agent creation, and RAG pipelines.

You’ll work at the intersection of platform engineering, machine learning infrastructure, distributed systems, and developer experience.

What you’ll do

• Design and build the infrastructure powering our Intelligence layer.

• Enable reliable, automated workflows for model training, deployment, lifecycle management, and inference.

• Build scalable foundations for users to create, configure, and operate AI agents and RAG pipelines through the platform UI.

• Develop the platform capabilities behind managed notebooks, functions, experiments, training jobs, model registries, and serving endpoints.

• Improve model serving, observability, versioning, evaluation, promotion, and rollback capabilities.

• Optimize GPU inference and training deployments for performance, reliability, and cost efficiency.

• Explore efficient approaches for deploying models across centralized GPU infrastructure and edge devices.

• Automate workflows that otherwise require manual MLOps effort, with a focus on safe, self-service capabilities for platform users.

• Partner with backend, product, and AI teams to turn complex infrastructure into intuitive platform features.

• Help define standards for security, multi-tenancy, resource isolation, model governance, and operational reliability.

Our current stack

You’ll work with technologies including:

• Kubernetes and Knative

• KServe and vLLM

• MLflow

• LangFuse

• GPU infrastructure and model-serving workloads

• RAG architectures, vector retrieval, agent workflows, and LLM applications

Our intelligence backend is built in Rust, so Rust experience is a strong advantage.

What we’re looking for

• Strong experience in MLOps, AI platform engineering, machine learning infrastructure, or distributed systems.

• Hands-on Kubernetes experience, including deploying and operating stateful, training, notebook, serverless, or GPU-intensive workloads.

• Experience building ML platforms that support some combination of training, experimentation, notebooks, feature/data workflows, model registries, and production serving.

• Experience with model serving frameworks such as KServe, vLLM, Triton, Ray Serve, or similar.

• Familiarity with ML lifecycle tooling such as MLflow, experiment tracking, model registries, and CI/CD or GitOps for ML systems.

• Practical experience optimizing training and inference workloads for latency, throughput, availability, and cost.

• Understanding of GPU scheduling, resource allocation, model quantization, batching, autoscaling, and multi-model serving.

• Experience with RAG systems, LLM applications, AI agents, or their supporting infrastructure.

• Strong software engineering fundamentals and a product-minded approach to platform design.

• Ability to make complex operational workflows reliable and approachable for users.

Nice to have

• Rust experience or interest in working with Rust-based backend systems.

• Experience running notebook environments such as JupyterHub, Kubeflow Notebooks, VS Code Server, or equivalent.

• Experience creating secure, scalable execution environments for user-defined functions or jobs.

• Experience deploying AI workloads on edge devices.

• Familiarity with model optimization techniques, including quantization, compilation, pruning, and hardware-aware serving.

• Experience with multi-tenant AI platforms, security controls, and model governance.

• Familiarity with observability and evaluation tooling for ML and LLM systems.

What success looks like

You will help us evolve from manually operated AI infrastructure to a platform where users can train, evaluate, deploy, and operate models; work in managed notebooks; run functions; create agents; and configure RAG workflows - with the platform handling as much of the operational complexity as possible.

By submitting this application, I agree that my personal data will be collected, processed, and retained by the company solely for the purposes of managing and assessing my candidacy.