Sensor Fusion Internship/Co-op
7 skills required
Job Details
The Zoox Sensor Fusion Detection team is developing the next-generation Perception model to achieve the following goals:
1. Unify the existing PixelSpace Range View representation with the VoxelSpace Voxel representation into one architecture
2. Produce more outputs: upgrade the model architecture to predict more outputs, including 3D object detection (3D bounding box with velocity), 3D panoptic segmentation (3D contour), occlusion, occupancy, scene flow and object attributes
3. Consume multi-frame temporal information: upgrade the model architecture to consume multi-frame sensor data (multi-view images, and multi-frame Lidar and Radar point cloud)
4. Add language and audio as additional modalities: upgrade the model architecture to take language and audio as input in addition to Vision, Lidar and Radar inputs
5. Utilize sensor data sparsity to reduce training and inference latency in order to consume higher resolution images, increase detection range, and deploy the model to more camera views
Technical Qualifications & Language Requirements
- Experience with applying Transformer to solve Perception problems in Autonomous Driving, or solve CV/ML problems
- Experience with the design, implementation, training and evaluation of Large Multimodal Model (LMM), or Large Vision-Language Model (LVLM), or Large Language Model (LLM)
- Proficient in PyTorch model design, implementation, training and evaluation
- Proficient in Python programming
- Computer Science or Electrical Engineering background with PhD degree
Bonus Qualifications
- Experience writing C++ software
- GPU/CUDA programming experience
- Experience with model deployment with TensorRT
- Experience working with LiDAR, Camera and Radar data
- Experience in algorithm development for Autonomous Driving software
Compensation
The monthly salary range for this position is $6,500 to $9,500. Compensation will vary based on role, degree level and type, and benefits will be offered based on eligibility. Additional benefits may include medical insurance, 401k, and a housing stipend.
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.
A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
Similar Jobs
Netflix
Los Gatos, California, United States (On-Site)
• 6 Months ago
Tencent
Shenzhen, Guangdong Province, China (On-Site)
• 4 Months ago
NVIDIA
Santa Clara, California, United States (Hybrid)
• 1 Month ago
Paradox Interactive
Stockholm, Stockholm County, Sweden (On-Site)
• 3 Weeks ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
PlayStation Global
Los Angeles, California, United States (Remote)
• 1 Month ago
The Walt Disney Company
Emeryville, California, United States (On-Site)
• 1 Month ago
NVIDIA
Santa Clara, California, United States (On-Site)
• 3 Months ago
Epic Games
Porto Alegre, State Of Rio Grande Do Sul, Brazil (On-Site)
• 2 Months ago
Get notifed when new similar jobs are uploaded
Jobs in Foster City, California, United States
ByteDance
San Jose, California, United States (On-Site)
• 6 Months ago
ByteDance
Seattle, Washington, United States (On-Site)
• 2 Months ago
Sphere Entertainment Co
Burbank, California, United States (On-Site)
• 1 Month ago
NVIDIA
Santa Clara, California, United States (On-Site)
• 3 Months ago
SKYDANCE
Los Angeles, California, United States (Hybrid)
• 3 Months ago
Interactive Brokers
Fort Lauderdale, Florida, United States (Hybrid)
• 6 Months ago
Get notifed when new similar jobs are uploaded
Similar Category Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
About The Company
Zoox is transforming mobility-as-a-service by developing a fully autonomous, purpose-built fleet designed for AI to drive and humans to enjoy.
Get notified when new jobs are added by Zoox
