The Perception team at Zoox is crucial for their autonomous vehicle technology, responsible for creating the understanding of the world for self-driving robots. They enable safe and efficient navigation in complex environments through sophisticated detection, classification, and tracking systems. As an engineer in the Semantics and Foundation Model team, you will develop advanced multimodal large language models to enhance the vehicles' environmental understanding. You will develop and fine-tune these models for off-vehicle analysis and optimize them for real-time performance on the robotaxi platform, ensuring efficient identification of hazards and interpretation of driving restrictions with minimal latency. Working with world-class engineers and researchers, you will leverage premium sensor data and cutting-edge infrastructure to validate algorithms in real-world conditions, directly impacting the safety and capability of Zoox's autonomous system.