Sensor Fusion Internship/Co-op
Job Summary
Job Description
7 skills required
Job Details
The Zoox Sensor Fusion Detection team is developing the next-generation Perception model to achieve the following goals:
1. Unify the existing PixelSpace Range View representation with the VoxelSpace Voxel representation into one architecture
2. Produce more outputs: upgrade the model architecture to predict more outputs, including 3D object detection (3D bounding box with velocity), 3D panoptic segmentation (3D contour), occlusion, occupancy, scene flow and object attributes
3. Consume multi-frame temporal information: upgrade the model architecture to consume multi-frame sensor data (multi-view images, and multi-frame Lidar and Radar point cloud)
4. Add language and audio as additional modalities: upgrade the model architecture to take language and audio as input in addition to Vision, Lidar and Radar inputs
5. Utilize sensor data sparsity to reduce training and inference latency in order to consume higher resolution images, increase detection range, and deploy the model to more camera views
Technical Qualifications & Language Requirements
- Experience with applying Transformer to solve Perception problems in Autonomous Driving, or solve CV/ML problems
- Experience with the design, implementation, training and evaluation of Large Multimodal Model (LMM), or Large Vision-Language Model (LVLM), or Large Language Model (LLM)
- Proficient in PyTorch model design, implementation, training and evaluation
- Proficient in Python programming
- Computer Science or Electrical Engineering background with PhD degree
Bonus Qualifications
- Experience writing C++ software
- GPU/CUDA programming experience
- Experience with model deployment with TensorRT
- Experience working with LiDAR, Camera and Radar data
- Experience in algorithm development for Autonomous Driving software
Compensation
The monthly salary range for this position is $6,500 to $9,500. Compensation will vary based on role, degree level and type, and benefits will be offered based on eligibility. Additional benefits may include medical insurance, 401k, and a housing stipend.
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.
A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
Similar Jobs
ION
Collecchio, Emilia-Romagna, Italy (On-Site)
• 3 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Ubisoft
Montreal, Quebec, Canada (On-Site)
• 1 Month ago
Meta
Menlo Park, California, United States (On-Site)
• 3 Months ago
Blizzard Entertainment
Irvine, California, United States (Hybrid)
• 3 Months ago
Brightline
Ashburn, Virginia, United States (On-Site)
• 2 Weeks ago
The Walt Disney Company
San Francisco, California, United States (On-Site)
• 18 Hours ago
Probably Monsters
Washington, District Of Columbia, United States (On-Site)
• 2 Months ago
Get notifed when new similar jobs are uploaded
Jobs in Foster City, California, United States
Microsoft
Redmond, Washington, United States (On-Site)
• 3 Weeks ago
ByteDance
San Jose, California, United States (On-Site)
• 3 Months ago
CD PROJEKT RED
Boston, Massachusetts, United States (On-Site)
• 6 Days ago
The Pokemon Company International
Bellevue, Washington, United States (Hybrid)
• 2 Months ago
Warner Bros Games
San Francisco, California, United States (On-Site)
• 1 Week ago
Netflix
New York, New York, United States (On-Site)
• 2 Weeks ago
Get notifed when new similar jobs are uploaded
Similar Category Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
About The Company
Zoox is transforming mobility-as-a-service by developing a fully autonomous, purpose-built fleet designed for AI to drive and humans to enjoy.
Get notified when new jobs are added by Zoox
