Senior Software Engineer - Conversational AI

2 Months ago • 10 Years + • Artificial Intelligence

Job Summary

Job Description

NVIDIA seeks a Senior Software Engineer to design, implement, and optimize low-latency conversational AI systems. Responsibilities include building speech-to-speech models, designing multi-modal agents, analyzing AI accuracy, collaborating on product features, and integrating with NVIDIA products. The role requires expertise in speech technologies (ASR, TTS), LLMs, RAG, and microservices. Experience with various protocols (gRPC, WebSockets) and deployment using Docker and Kubernetes is essential. The ideal candidate will have a strong background in software design, optimization, and experience with open-source frameworks like LangChain.
Must have:
  • 10+ years experience in building conversational AI solutions
  • Proficiency in Python/C++ for complex asynchronous systems
  • Deep understanding of speech technologies (ASR, TTS)
  • Experience with LLMs, RAG, and agents
  • Microservices and client-server application building
  • Familiarity with Docker, Kubernetes, and CI/CD
Good to have:
  • Experience with LangChain, LlamaIndex
  • Knowledge of ML/DL techniques
  • Familiarity with CUDA, CuDNN, TensorRT
  • Experience deploying models on various systems

Job Details

Widely considered to be one of the technology world’s most desirable employers, NVIDIA is an industry leader with groundbreaking developments in High-Performance Computing, Artificial Intelligence and Visualization. NVIDIA's technology is at the heart of the AI revolution, touching people across the planet by powering everything from self-driving cars, robotics, and intelligent assistants. Come join the team and see how you can make a lasting impact on the world! We're looking to grow our company, and build our teams with the smartest people in the world. Join us at the forefront of technological advancement.

NVIDIA is looking for a highly experienced Senior Software Engineer, to build the next generation Multimodal Conversational AI systems, driven by world class high performance Speech and LLM models, orchestrated by Multimodal AI Agents, creating seamless experiences for our Digital Human solutions.If you're creative and passionate about solving real world Conversational AI problems, come join us. You can check https://build.nvidia.com/nvidia/digital-humans-for-customer-service for a glimpse of what you could be working on.

What you’ll be doing:

  • Architect, implement and optimize reliable low latency full duplex conversation pipelines and dialog systems, that excel across various application areas and challenging environments.

  • Build and benchmark cascaded and unified speech-to-speech models and systems that reflect real human conversations.

  • Designing, implementing and testing domain specific agents and workflows and a framework which can support multi-turn, multi-modal, multi-user conversations with LLM driven agents.

  • Analyze RAG and conversational AI agent end to end accuracy and limitations and recommend the next course of action & Improvements.

  • Characterize performance and quality metrics across platforms for various AI and system components

  • Collaborate with various teams on new product features and improvements of existing products. Customize and integrate the conversational AI framework with other NVIDIA products

  • Participate in developing and reviewing code, design documents, use case reviews, and test plan reviews and help innovate, identify problems, recommend solutions and perform triage in a collaborative team environment.

What we need to see:

  • Bachelor's degree or Master’s degree (or equivalent experience) in Computer Science, Electrical Engineering, Artificial Intelligence, or Applied Math

  • 10+ years of experience, with a very good hands-on exposure to building solutions that touch various technology areas that cover Speech, LLM, RAG and Agents.

  • Excellent programming skills in Python and/or C++, with ability to debug complex asynchronous systems

  • Deep understanding of various Speech technologies like VAD, ASR, TTS, Translation, End-to-End Speech Models, etc. to build conversation systems.

  • Experience working with RAG and LLM based applications as a key part of building Dialog and Q & A systems. Additional exposure to LLM function calling, Information Retrieval, Vector Databases, Embedding and Rerank models, autonomous agents etc.is welcome.

  • Understanding of scalable deployment of multiple microservices involving Speech components, LLM driven RAG and Agent applications in production environment

  • Experience working with protocol and transports like HTTP REST, gRPC, Websockets, WebRTC, etc.

  • Hands on experience with building microservices and client-server applications.

  • Familiarity with Docker, helm, kubernetes etc.

  • Experience of working on end to end Software lifecycle, release packaging & CI/CD pipeline

  • General background around version control and code review tools like Git, Gerrit, Gitlab.

Ways to stand out from the crowd:

  • Strong fundamentals in Programming, Optimizations and Software design

  • Experience of working with open source frameworks like LangChain, LlamaIndex for building LLM driven applications

  • Strong knowledge of ML/DL techniques, algorithms and tools with exposure to Speech and Language Models

  • Familiarity with GPU based technologies like CUDA, CuDNN and TensorRT

  • Background with deploying machine learning models on data center, cloud, and embedded systems

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Balbix - Sr Staff Engineer - Connector

Balbix

Bengaluru, Karnataka, India (On-Site)
6 Months ago
PwC - IN- Senior Associate_ DevOps_Advisory Corporate_Advisory _Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Dream Sports - Software Development Engineer 2 - Backend

Dream Sports

Mumbai, Maharashtra, India (On-Site)
4 Weeks ago
Truecaller - Senior Fullstack Engineer

Truecaller

Stockholm, Stockholm County, Sweden (On-Site)
5 Months ago
The Walt Disney Company - Lead Software Engineer, Ad Platforms

The Walt Disney Company

San Francisco, California, United States (On-Site)
1 Month ago
Genies - Machine Learning Engineer, Character Animation & Motion AI

Genies

San Mateo, California, United States (On-Site)
1 Month ago
Sony Interactive Entertainment - Learning & Development Specialist (AI Talent Development & Training Program Lead)

Sony Interactive Entertainment

Tokyo, Japan (On-Site)
1 Month ago
ByteDance - Research Scientist, Foundation Model, Vision

ByteDance

Singapore (On-Site)
6 Months ago
Tencent - Artificial General Intelligence Research Internship

Tencent

Washington, United States (On-Site)
2 Months ago
Zoox - Software Engineer - 3D World Generation Pipelines

Zoox

Seattle, Washington, United States (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Nagarro - Senior Staff Engineer, .Net Fullstack

Nagarro

Gurugram, Haryana, India (On-Site)
6 Months ago
LeoVegas - Senior Backend Engineer - Retention/Sports/iGaming

LeoVegas

Málaga, Andalusia, Spain (Hybrid)
6 Months ago
Immutable - Software Engineer

Immutable

Australia (Hybrid)
1 Month ago
Rockstar Games - Technical Artist: DevOps

Rockstar Games

London, England, United Kingdom (On-Site)
3 Weeks ago
Sporty Group - Backend Engineer

Sporty Group

(Remote)
9 Months ago
Balbix - Sr Staff Engineer - Connector

Balbix

Bengaluru, Karnataka, India (On-Site)
6 Months ago
ION - Senior Security Architect

ION

Milan, Lombardy, Italy (On-Site)
6 Months ago
Nagarro - Staff Engineer, Java

Nagarro

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Alphasense - Technical Program Manager

Alphasense

Pune, Maharashtra, India (On-Site)
4 Months ago
Go Fund Me - Senior DevEx Engineer

Go Fund Me

Buenos Aires, Buenos Aires, Argentina (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Pune, Maharashtra, India

Sportskeeda - MMA Anchor

Sportskeeda

India (Remote)
2 Months ago
GEA Group - HMI Software Engineer

GEA Group

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Locad - Product Designer

Locad

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Expedia Group - User Experience Designer III (Visual Design)

Expedia Group

Gurugram, Haryana, India (On-Site)
7 Months ago
CloudHire - Backend Developer

CloudHire

Maharashtra, India (Remote)
1 Month ago
Assystems - Draughts person – Substation (Civil & Structural)

Assystems

Gurugram, Haryana, India (On-Site)
6 Months ago
Nagarro - Staff Consultant, Business Analyst

Nagarro

India (Remote)
6 Months ago
Brillio - Senior Lead Engineer - R01535121

Brillio

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Nagarro - Senior Staff Engineer, DevOps

Nagarro

Hyderabad, Telangana, India (On-Site)
6 Months ago
E-Hireo - Cloud Engineer

E-Hireo

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Meta - Research Scientist, Computer Vision for Generative AI (PhD)

Meta

Menlo Park, California, United States (On-Site)
5 Months ago
Hedra - Applied Research Scientist

Hedra

New York, New York, United States (On-Site)
1 Month ago
NVIDIA - Senior Software Engineer - Distributed Inference

NVIDIA

California, United States (Remote)
1 Month ago
NVIDIA - Director, Regional Developer Relations - ROAP

NVIDIA

Singapore (Remote)
2 Months ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
2 Months ago
Netflix - Product Manager, ML Platform: Training

Netflix

Los Gatos, California, United States (Hybrid)
6 Months ago
Google - Software Engineer III, Core Machine Learning, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
5 Months ago
Canva - Senior Machine Learning Engineer - Canva UK

Canva

London, England, United Kingdom (Remote)
5 Months ago
Eleven Labs - Machine Learning Researcher

Eleven Labs

Poland (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Austin, Texas, United States (Remote)

Santa Clara, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug