2. Produce more outputs: upgrade the model architecture to predict more outputs, including 3D object detection (3D bounding box with velocity), 3D panoptic segmentation (3D contour), occlusion, occupancy, scene flow and object attributes

3. Consume multi-frame temporal information: upgrade the model architecture to consume multi-frame sensor data (multi-view images, and multi-frame Lidar and Radar point cloud)

4. Add language and audio as additional modalities: upgrade the model architecture to take language and audio as input in addition to Vision, Lidar and Radar inputs

5. Utilize sensor data sparsity to reduce training and inference latency in order to consume higher resolution images, increase detection range, and deploy the model to more camera views

Technical Qualifications & Language Requirements

Experience with applying Transformer to solve Perception problems in Autonomous Driving, or solve CV/ML problems
Experience with the design, implementation, training and evaluation of Large Multimodal Model (LMM), or Large Vision-Language Model (LVLM), or Large Language Model (LLM)
Proficient in PyTorch model design, implementation, training and evaluation
Proficient in Python programming
Computer Science or Electrical Engineering background with PhD degree

Bonus Qualifications

Experience writing C++ software
GPU/CUDA programming experience
Experience with model deployment with TensorRT
Experience working with LiDAR, Camera and Radar data
Experience in algorithm development for Autonomous Driving software

Compensation

The monthly salary range for this position is $6,500 to $9,500. Compensation will vary based on role, degree level and type, and benefits will be offered based on eligibility. Additional benefits may include medical insurance, 401k, and a housing stipend.

About Zoox

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.

Accommodations

If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.

A Final Note:

You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.

7 skills required for this role

Boost these skills to join the top 1% applicants for this job

About The Company

Zoox

259 Active Jobs

Zoox is transforming mobility-as-a-service by developing a fully autonomous, purpose-built fleet designed for AI to drive and humans to enjoy.

Similar Skill Jobs

Jobs in Foster City, California, United States

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

A global community of game builders. Helping people upskill and land jobs in the best gaming studios.

Company

Key Links

hello@outscal.com

Made in INDIA 💛💙

Sensor Fusion Internship/Co-op