Senior Software Engineer (AI Automation)

• We’re looking for a hands-on, systems-oriented Senior Software Engineer in Test (Sr. SDET) to join our Browse and Discovery Team

• You’ll own quality for the APIs and data pipelines — the automated test frameworks, containerized quality checks, CI/CD workflows, and infrastructure as code that let the rest of the organization ship with confidence

• You’ll do that work with agentic AI as your default mode of working: driving agents to write and maintain integration tests, keep suites healthy, triage failures, and debug production issues, and building the tools, harnesses, and evaluations that make those workflows trustworthy

• This is a role for someone who treats agent design as an engineering discipline — grounding agents in the right context, integrating them with the systems they act on, proving them reliable through rigorous automation and evaluation, and turning what works into the reusable components and paved paths other teams at Roku build on

• Design and develop automated test frameworks for APIs and data pipelines, and containerize automated quality checks for complex orchestrated services

• Use agentic AI workflows day to day — authoring and maintaining integration tests, keeping test suites healthy, triaging failures, and debugging production issues

• Build the context and retrieval pipelines that ground these agents in the right code, schemas, telemetry, and business logic, and keep them aligned as those sources evolve

• Implement tool-calling and MCP-style integrations so agents can safely act on the systems around them — test runners, CI, ticketing, logs, and data services

• Build and maintain CI/CD workflows and infrastructure as code using Terraform or CloudFormation, so deployments and test execution are repeatable and auditable

• Establish evaluation, observability, and monitoring for the signals that matter here: test reliability and flake rate, mean time to triage, agent task success rate, latency, and cost

• Build safeguards that improve production readiness and reliability — controlled rollouts, drift detection, and mechanisms that prevent error amplification in multi-step agent workflows

• Create reusable templates, modular components, and paved-path patterns that accelerate adoption across teams, and partner with development, data engineering, and product teams to improve end-to-end testing and release processes

Benefits

• Medical, wellness and financial benefits

• Free snacks and access to the company fitness center

• Unlimited paid time off policy

• Work from home opportunities- At Roku, we don’t just use AI; we work with it. AI agents and smart tools help power drafts, analysis, and repetitive workflows, while our people bring direction, judgment, and accountability. We’re looking for curious, adaptable builders who can show how they’ve used AI for automation to move faster, raise the bar, and scale their impact

• We value your AI skills if you have built fluency across the agentic engineering toolchain — coding harnesses like Claude Code or Cursor, MCP servers, custom skills, or agent frameworks. And you can describe projects where you shipped real work with these tools. You know how to drive an agent, verify its output, and ramp on an unfamiliar codebase with an agent helping you

• Experience with CI/CD tooling such as GitLab runners, GitHub Actions, Jenkins, or Travis CI

• Ability to work independently, manage ambiguity, move quickly, and deliver incrementally in a fast-paced environment

• Experience with observability, evaluation, experimentation, and feedback loops for AI systems in production, including monitoring tools such as DataDog, Prometheus, or Grafana

• Hands-on experience with LLM-based systems, including prompt design, retrieval, tool use, memory handling, and agent orchestration patterns

• Expertise in Python or Java with familiarity in the other; experience with C/C++ or another systems language is a plus

• Experience with infrastructure as code: Terraform or CloudFormation

• Experience with cloud platforms — AWS (preferred), GCP, or Azure — REST APIs, and containerization and orchestration tools such as Docker and Kubernetes

• Working knowledge of Linux and Bash scripting

• Strong analytical and problem-solving skills, excellent communication and collaboration skills, and sound engineering judgment

• Bachelor’s or master’s degree in Computer Science, Computer Engineering, Electrical Engineering, Data Science, or a related technical field — or equivalent engineering experience

• 5+ years of experience in software testing and automation, software engineering, or adjacent domains, with strong software engineering fundamentals and the ability to build production-grade systems

• Experience designing test plans, test cases, and automated test frameworks for APIs, services, and data pipelines

• Experience building and maintaining retrieval and context pipelines, agent frameworks, and MCP servers or equivalent function-calling architectures