Senior Software Developer - LLM

This Senior Software Developer - LLM role at Cerence involves system integration development, focusing on integrating LLM SDKs into in-vehicle systems. Responsibilities include developing voice interaction middleware for ASR, NLU, and TTS pipelines, designing hybrid cloud/edge LLM solutions, and optimizing performance for latency, CPU/memory, and cold-start acceleration. The role requires at least 3 years of experience.

Must Have

• Proficient in C++11/14 embedded development
• Hands-on project experience with Linux/Android Automotive OS
• Understanding of LLM, Agent, RAG and corresponding inference framework/runtime
• Familiar with Inter-Thread Communication and Inter-Process Communication

Job description:

• System Integration Development
• Interface with LLM development teams to integrate SDKs into in-vehicle systems
• Develop voice interaction middleware for coordinating ASR (Automatic Speech Recognition), NLU (Natural Language Understanding), and TTS (Text-to-Speech) pipelines
• Design hybrid solution to integrate cloud LLM and edge LLM, take care of the arbitration between cloud and edge
• Performance Optimization
• Optimize end-to-end response latency
• CPU and memory footprint control and cold-start acceleration

Requirement:

• Working experience: 3 years and above
• Proficient in C++11/14 embedded development
• Hands-on project experience with Linux/Android Automotive OS
• Understanding of LLM, Agent, RAG and corresponding inference framework/runtime
• Familiar with Inter-Thread Communication and Inter-Process Communication