Machine Learning Engineer - Prediction and Planning

1 Month ago • 5 Years + • Research Development • $204,000 PA - $245,000 PA

Job Summary

Job Description

The Offline Driving Intelligence team develops Foundation Models for prediction and planning, applying them both off-vehicle for ML capabilities in simulation and validation, and on-vehicle to influence driving models. This role involves developing novel machine learning pipelines and models to predict the behavior of other agents and plan the ego vehicle's course of action. Responsibilities include developing deep learning models using imitation learning and reinforcement learning for driving plans, contributing to large-scale ML infrastructure, developing metrics and tools for error analysis, and collaborating with Perception, Planning, and Simulation engineers.
Must have:
  • MS, or PhD degree in computer science or related field
  • Experience with transformer-based model architectures
  • Experience with reinforcement learning techniques
  • Experience with production Machine Learning pipelines
  • Fluency in C++ or Python with basic C++ understanding
  • Extensive experience with programming and algorithm design
Good to have:
  • Strong mathematics skills
  • Prior experience with Prediction/Planning for autonomous vehicles/robotics
  • Conference or Journal publications in ML or Robotics venues
Perks:
  • Amazon Restricted Stock Units (RSUs)
  • Zoox Stock Appreciation Rights
  • Sign-on bonus
  • Paid time off (sick leave, vacation, bereavement)
  • Unpaid time off
  • Health insurance
  • Long-term care insurance
  • Long-term and short-term disability insurance
  • Life insurance

Job Details

The Offline Driving Intelligence team is responsible for developing Foundation Models for prediction and planning, applying them both off-vehicle to provide ML capabilities to simulation and validation and on-vehicle to influence driving models. Our team collaborates closely with the Planner team to advance overall vehicle behavior. We also work closely with our Perception, Simulation, and Systems Engineering teams to accelerate our ability to validate our driving performance.

As a Prediction and Planning Machine Learning Engineer you will work on the bleeding edge of the industry, developing novel machine learning pipelines and models to predict the behavior of other agents in the world and planning the best course of action for the ego vehicle.

In this role, you will:

    • Develop new deep learning models that use imitation learning and reinforcement learning to generate driving plans for our autonomous vehicle. You will also work on novel techniques to estimate the quality of those driving plans along the dimensions of safety, progress, comfort, compliance.
    • Contribute to our large-scale machine learning infrastructure to discover new solutions and push the boundaries of the field
    • Develop metrics and tools to analyze errors and understand improvements of our systems
    • Collaborate with engineers on Perception, Planning, and Simulation to solve the overall Autonomous Driving problem in complex urban environments

Qualifications:

    • MS, or PhD degree in computer science or related field with 5 or more years of industry experience
    • Experience with training and deploying transformer-based model architectures and reinforcement learning techniques
    • Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines
    • Fluency in C++ or Fluency in Python with a basic understanding of C++
    • Extensive experience with programming and algorithm design

Bonus Qualifications:

    • Strong mathematics skills
    • Prior experience with Prediction and/or Planning for autonomous vehicles or robotics
    • Conference or Journal publications in Machine Learning or Robotics related venues

$204,000 - $245,000 a year
Base Salary Range

There are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. A sign-on bonus may be offered as part of the compensation package. The listed range applies only to the base salary. Compensation will vary based on geographic location and level. Leveling, as well as positioning within a level, is determined by a range of factors, including, but not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. The salary range listed in this posting is representative of the range of levels Zoox is considering for this position.

Zoox also offers a comprehensive package of benefits, including paid time off (e.g. sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.

Similar Jobs

Epic Games - Lead Rendering Programmer

Epic Games

(On-Site)
4 Months ago
Thatgamecompany - Senior Engine Programmer

Thatgamecompany

United States (Remote)
4 Months ago
Amber - Senior Unity Game Engineer (Project Based)

Amber

Brazil (On-Site)
1 Year ago
Match Group - Staff Software Engineer, Backend

Match Group

New York, United States (Hybrid)
1 Month ago
Rebellion - Senior Gameplay Programmer

Rebellion

England, United Kingdom (Hybrid)
4 Months ago
Ceragon Networks - Software R&D Manager

Ceragon Networks

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Unity - Senior Machine Learning Engineer

Unity

San Francisco, California, United States (On-Site)
1 Week ago
Welltech - Senior Machine Learning Engineer

Welltech

Poland (Remote)
2 Months ago
Bosch Group - Head of Autonomous Driving Technology & AI Development

Bosch Group

Sunnyvale, California, United States (On-Site)
1 Month ago
NVIDIA - Deep Learning Performance Architect

NVIDIA

Bengaluru, Karnataka, India (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

CyberArk - Senior Site Reliability Engineer

CyberArk

United States (On-Site)
2 Weeks ago
Rockstar Games - Senior Software Engineer (C#)

Rockstar Games

Carlsbad, California, United States (On-Site)
11 Months ago
Mozilla - Staff Software Engineer - Mobile Android

Mozilla

United Kingdom (Remote)
2 Months ago
Ion - Software/Artificial Intelligence Engineer - Graduate Development Program

Ion

Pisa, Tuscany, Italy (Hybrid)
6 Months ago
Open Systems Technologies - Senior Software Engineer - Backend

Open Systems Technologies

State Of São Paulo, Brazil (On-Site)
2 Weeks ago
HCL Tech - C++ Technical Lead

HCL Tech

California, United States (On-Site)
3 Months ago
rivos - SOC Design Verification - Full-time

rivos

Bengaluru, Karnataka, India (Hybrid)
9 Months ago
Adtran - Software Design Engineer

Adtran

Stockholm, Stockholm County, Sweden (On-Site)
2 Months ago
Wind River - Senior Engineer - Technical Support

Wind River

Galați, Județul Galați, Romania (On-Site)
3 Weeks ago
Sima AI - Staff Software Developer

Sima AI

San Jose, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Foster City, California, United States

CityBlock - AMH+ RN Care Manager

CityBlock

Charlotte, North Carolina, United States (Hybrid)
3 Weeks ago
The New York Times - Supreme Court Investigative Correspondent

The New York Times

Washington, District Of Columbia, United States (Hybrid)
3 Months ago
Scout - Feature Owner - Parking Systems

Scout

Novi, Michigan, United States (On-Site)
1 Month ago
Adyen - Strategic Growth Manager

Adyen

San Francisco, California, United States (Hybrid)
3 Weeks ago
Trend Micro - Senior Sales Engineer

Trend Micro

California, United States (On-Site)
2 Months ago
Canva - Strategic Account Executive

Canva

Austin, Texas, United States (Hybrid)
2 Weeks ago
rivos - Accelerator Verification Intern

rivos

Santa Clara, California, United States (Hybrid)
9 Months ago
Kavalirio - IT Program Manager

Kavalirio

McLean, Virginia, United States (On-Site)
3 Months ago
Notion - Software Engineer, Native macOS Development

Notion

San Francisco, California, United States (On-Site)
2 Months ago
UPF Industries  - Maintenance Technician

UPF Industries

Robertsdale, Alabama, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Apple - Machine Learning Engineer, Maps

Apple

Cupertino, California, United States (On-Site)
2 Months ago
ElevenLabs - Machine Learning Researcher

ElevenLabs

Germany (Remote)
4 Months ago
Postman - Senior Backend Engineer - AI / LLM Code

Postman

San Francisco, California, United States (Hybrid)
3 Months ago
version 1 - Pre Sales AI Architect

version 1

London, England, United Kingdom (On-Site)
3 Weeks ago
IION - AI Engineer

IION

India (Remote)
3 Weeks ago
bytedance - Student Researcher (Doubao (Seed) - Foundation Model - Speech Understanding) - 2025 Start (PhD)

bytedance

San Jose, California, United States (On-Site)
9 Months ago
C3 IoT - Pre-Sales AI Director – Generative AI

C3 IoT

Atlanta, Georgia, United States (On-Site)
4 Weeks ago
Capgemini - Kore.AI Lead/Architect

Capgemini

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
Reddit - Staff Machine Learning Engineer, ML Understanding

Reddit

United States (Remote)
1 Month ago
Mistral AI - Applied AI Engineer

Mistral AI

Marseille, Provence-Alpes-Côte D'Azur, France (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Zoox is transforming mobility-as-a-service by developing a fully autonomous, purpose-built fleet designed for AI to drive and humans to enjoy.

Foster City, California, United States (On-Site)

Foster City, California, United States (On-Site)

Foster City, California, United States (Hybrid)

Foster City, California, United States (Hybrid)

Foster City, California, United States (Hybrid)

Foster City, California, United States (Hybrid)

Foster City, California, United States (Hybrid)

Foster City, California, United States (Hybrid)

Foster City, California, United States (Hybrid)

Foster City, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by zoox

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug