Senior/Staff Machine Learning Engineer - Perception Offline Driving Intelligence

2 Months ago • All levels • Research Development • $230,000 PA - $332,000 PA

Job Summary

Job Description

The Offline Driving Intelligence (ODIN) team at Zoox is seeking a Senior/Staff Machine Learning Engineer to develop advanced multimodal large language models for environmental understanding in self-driving robotaxis. The role involves crafting algorithms that understand the world, devising paths of impact for autonomous navigation, and fine-tuning models for off-vehicle analysis. Responsibilities include leading LLM development, designing model architectures and training techniques using sensor data and large-scale datasets, driving end-to-end ML solutions from research to production, collaborating with cross-functional teams, and validating solutions with real-world driving scenarios. This position directly impacts the safety, productivity, and capability of Zoox's autonomous system.
Must have:
  • MS or PhD in Computer Science, Machine Learning, or related technical field
  • Demonstrated experience training and deploying large language models (LLMs)
  • Experience building and maintaining ML training pipelines
  • Proficiency in Python and ML libraries (PyTorch, NumPy)
  • Experience training with large scale datasets
Good to have:
  • Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)
  • Experience with autonomous robotics systems

Job Details

The Offline Driving Intelligence (ODIN) team at Zoox is leveraging the latest in AI to craft algorithms that understand the world. We leverage large models first offline and we devise a path of impact into our self-driving robot, enabling safe and efficient navigation in complex environments.

As an engineer in the ODIN team, you will develop advanced multimodal large language models that enhance environmental understanding. You'll develop and fine-tune these models for off-vehicle analysis while working with the onboard team to deliver impact in our robotaxi platform, ensuring they can efficiently identify hazards and interpret driving restrictions with minimal latency. Working alongside world-class engineers and researchers, you'll leverage premium sensor data and cutting-edge infrastructure to validate your algorithms in real-world conditions, directly impacting productivity, safety and the capability of Zoox's autonomous system.

In this role, you will:

    • Lead the development of multimodal large language models that enhance our robotaxis' understanding of complex urban environments
    • Design effective model architectures and sophisticated training techniques, leveraging all the inputs from our sensor stack and the overall large scale data we have at Zoox.
    • Drive end-to-end ML solutions from research to production, utilizing Zoox's extensive data pipelines and infrastructure to improve autonomous driving capabilities
    • Collaborate with perception, planning, safety, and systems teams to integrate your models into the vehicle's decision-making pipeline
    • Validate and optimize your solutions using real-world driving scenarios, directly contributing to the safety and reliability of Zoox's autonomous system

Qualifications:

    • MS or PhD in Computer Science, Machine Learning, or related technical field
    • Demonstrated experience training and deploying large language models (LLMs)
    • Experience building and maintaining ML training pipelines, including data preprocessing, model training, and evaluation
    • Proficiency in Python and ML libraries (PyTorch, NumPy) demonstrated through professional or research projects
    • Experience training with large scale datasets (e.g. tens of millions of videos)

Bonus Qualifications:

    • Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)
    • Experience with autonomous robotics systems

$230,000 - $332,000 a year

Similar Jobs

LeoVegas - CRM Manager

LeoVegas

Leeds, England, United Kingdom (Hybrid)
2 Months ago
Coda - Senior Technical Support

Coda

Bangkok, Thailand (Hybrid)
2 Months ago
Banyan Software - AI/ML Engineer

Banyan Software

Chennai, Tamil Nadu, India (On-Site)
1 Month ago
Iron Mountain - Strategic Planning Collector / Híbrido/ Bilingue

Iron Mountain

Bogotá, Bogota, Colombia (Hybrid)
1 Month ago
Marsh McLennan - Senior DB Pension Administrator - Client Servicing Team

Marsh McLennan

Cork, County Cork, Ireland (Hybrid)
1 Month ago
DraftKings - Lead Machine Learning Engineer, Sportsbook

DraftKings

Boston, Massachusetts, United States (On-Site)
1 Year ago
DevRev - Applied AI Engineer - Internship

DevRev

Buenos Aires, Buenos Aires, Argentina (On-Site)
1 Month ago
Apple - AIML - Staff Machine Learning Engineer, Information Intelligence

Apple

Santa Clara, California, United States (On-Site)
2 Months ago
Ansys - R&D Engineer - Python, C++

Ansys

Pune, Maharashtra, India (On-Site)
1 Month ago
Match Group - Machine Learning Engineer

Match Group

Seoul, South Korea (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Interactive Brokers - Senior Java Developer

Interactive Brokers

Tallinn, Harju County, Estonia (On-Site)
10 Months ago
The Globel Talent Co - Marketing Generalist

The Globel Talent Co

South Africa (Remote)
5 Months ago
HCL Tech - Automation test lead embedded

HCL Tech

London, England, United Kingdom (On-Site)
3 Months ago
Flow - Junior Interior Designer

Flow

Riyadh, Riyadh Province, Saudi Arabia (On-Site)
5 Months ago
Growe - CRM Manager

Growe

(Remote)
1 Month ago
Rackspace Technology - Site Reliability Engineer / Observability Engineer

Rackspace Technology

Giza, Giza Governorate, Egypt (Remote)
8 Months ago
Corsair gaming - Embedded Hardware Engineer

Corsair gaming

Landshut, Bavaria, Germany (On-Site)
2 Months ago
Keywords Studios - Senior Executive - People & Culture

Keywords Studios

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Survay Monkey - Vice President of Product, Growth & Monetization

Survay Monkey

San Mateo, California, United States (Hybrid)
1 Month ago
Tesla - Sales Advisor

Tesla

Central Bohemian Region, Czechia (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Foster City, California, United States

Snap Mobile INC - Account Executive

Snap Mobile INC

Atlanta, Georgia, United States (On-Site)
3 Months ago
Reddit - Staff Machine Learning Engineer, Ads Ranking

Reddit

United States (Remote)
1 Month ago
Shield AI - Director, Direct Commercial Sales (DCS) Program Management (R3625)

Shield AI

Dallas, Texas, United States (On-Site)
1 Month ago
Shield AI - Staff Autonomy Engineer, Planning (R2879)

Shield AI

San Diego, California, United States (Remote)
1 Month ago
Plug power - Field Service Technician

Plug power

Gordonsville, Virginia, United States (On-Site)
1 Month ago
Unity - Senior Developer Support Engineer

Unity

Bellevue, Washington, United States (Hybrid)
2 Months ago
Mixpanel - Account Manager, Small and Medium-sized Businesses

Mixpanel

San Francisco, California, United States (Hybrid)
1 Month ago
bytedance - Cloud Network Engineer

bytedance

Seattle, Washington, United States (On-Site)
4 Months ago
Glean - Software Engineer, Security

Glean

Palo Alto, California, United States (Hybrid)
3 Months ago
Zenoti - Project Manager, Customer Onboarding (SaaS)

Zenoti

Seattle, Washington, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Moonbug Entertainment - AI Enablement Specialist/Consultant

Moonbug Entertainment

London, England, United Kingdom (On-Site)
1 Month ago
Apple - AIML - Project/Program Manager, Data Operations

Apple

Austin, Texas, United States (On-Site)
3 Months ago
upwork - AI Solutions Builder

upwork

United States (Remote)
1 Month ago
bytedance - Research Scientist Graduate (Foundation Model - Vision and Language)

bytedance

Seattle, Washington, United States (On-Site)
4 Months ago
Sword Health - Staff ML Engineer

Sword Health

Porto, Porto District, Portugal (Hybrid)
1 Year ago
Philips - Senior Manager; Development Engineering - Transducer R&D

Philips

Reedsville, Pennsylvania, United States (On-Site)
2 Months ago
Brillio - Enterprise Architect - AI, Healthcare

Brillio

Jersey City, New Jersey, United States (Hybrid)
1 Month ago
Tennr - AI Engineer

Tennr

New York, New York, United States (On-Site)
4 Months ago
Tencent - Researcher- Agent

Tencent

Bellevue, Washington, United States (On-Site)
1 Month ago
Toast - Director of Software Engineering - AI and Data

Toast

Bengaluru, Karnataka, India (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Zoox is transforming mobility-as-a-service by developing a fully autonomous, purpose-built fleet designed for AI to drive and humans to enjoy.

Foster City, California, United States (On-Site)

Foster City, California, United States (Hybrid)

Foster City, California, United States (On-Site)

Foster City, California, United States (Hybrid)

Foster City, California, United States (On-Site)

Foster City, California, United States (On-Site)

Foster City, California, United States (On-Site)

Foster City, California, United States (On-Site)

Foster City, California, United States (Hybrid)

Foster City, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by zoox

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug