Senior Staff Machine Learning Engineer (Perception)

• Our Perception team is responsible for using our sensor data to understand the complex and dynamic environments where we drive

• In this role, you will have access to the best sensor data in the world and an incredible infrastructure for testing and validating your algorithms

• We are creating new algorithms for segmentation, tracking, classification, and high-level scene understanding, and you could work on any (or all!) of these components

• As a Principal ML Engineer, you will lead the development of machine learning algorithms that can range in influence from onboard autonomy to offboard autonomy and validation

• You will collaborate closely with other teams specializing in Prediction, Planning, Simulation, and Safety Validation, influencing our overall technical stack

• Your role will look at problems in a way that crosses team boundaries to prototype new approaches that influence the long term technical direction of multiple organizations within the company

• The impact of the role can be in the form of impacting immediate company milestones to leading forward-looking exploratory projects

• Develop new algorithms to understand the scene around the robot, and how that scene would evolve through time

• Build multi-modal foundation models for on-vehicle and offline applications

• Develop new algorithms to apply generative AI to simulation to improve the realism of our offline validation systems

• Leverage our large-scale machine learning infrastructure to discover new solutions and push the boundaries of the field

• Provide technical mentorship to the broader group of ML developers at Zoox

• Collaborate with engineers on Prediction, Planning, and Simulation to solve the overall Autonomous Driving problem in complex urban environments

Benefits

• Paid parental leave

• Affinity groups and sports clubs

• Work from home opportunities

• Health insurance

• Our crew’s health and happiness is our first priority. We offer comprehensive health and mental health support, a wellbeing program, and unlimited and flexible paid time away

• We invest in our crew—and their families—for the long term. That includes generous family planning support, caregiver support, and strong cash compensation with great equity upside

• We look after our crew when they’re in the office too. Our famous food program is a great example, featuring a daily changing menu of local and sustainable dishes

• There’s a busy calendar of social events at Zoox, with more sports teams than you can count. And, of course, playing with robots is an important part of the job description- BS, MS, or PhD degree in computer science or related field

• Fluency in C++ or Fluency in Python with a basic understanding of C++

• Experience with modern computer vision techniques

• Strong mathematical skills and understanding of probabilistic techniques

• Extensive experience with programming and algorithm design-Strong mathematics skills

• Experience with training and deploying Deep Learning models on sensor data-Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines

• Publications in your field (CVPR, ICCV, RSS, ICRA preferred)

• Experience with realtime sensor fusion (e.g. LiDAR, camera, radar)

• Experience with autonomous robots

• Experience with 3D data and representations (pointclouds, meshes, etc.)

• Experience with novel pipelines and architectures for convolutional neural nets