Job Description
This Senior Software Developer - LLM role at Cerence involves system integration development, focusing on integrating LLM SDKs into in-vehicle systems. Responsibilities include developing voice interaction middleware for ASR, NLU, and TTS pipelines, designing hybrid cloud/edge LLM solutions, and optimizing performance for latency, CPU/memory, and cold-start acceleration. The role requires at least 3 years of experience.
Must Have:
- Proficient in C++11/14 embedded development
- Hands-on project experience with Linux/Android Automotive OS
- Understanding of LLM, Agent, RAG and corresponding inference framework/runtime
- Familiar with Inter-Thread Communication and Inter-Process Communication
Job description:
- System Integration Development
- Interface with LLM development teams to integrate SDKs into in-vehicle systems
- Develop voice interaction middleware for coordinating ASR (Automatic Speech Recognition), NLU (Natural Language Understanding), and TTS (Text-to-Speech) pipelines
- Design hybrid solution to integrate cloud LLM and edge LLM, take care of the arbitration between cloud and edge
- Performance Optimization
- Optimize end-to-end response latency
- CPU and memory footprint control and cold-start acceleration
Requirement:
- Working experience: 3 years and above
- Proficient in C++11/14 embedded development
- Hands-on project experience with Linux/Android Automotive OS
- Understanding of LLM, Agent, RAG and corresponding inference framework/runtime
- Familiar with Inter-Thread Communication and Inter-Process Communication
Set alerts for more jobs like Senior Software Developer - LLM
Set alerts for new jobs by Cerence
Set alerts for new Programming jobs in Canada
Set alerts for new jobs in Canada
Set alerts for Programming (Remote) jobs
