Senior Deep Learning Software Engineer, Inference

1 Month ago • 5 Years + • Research & Development • $148,000 PA - $287,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior Deep Learning Software Engineer specializing in inference optimization. Responsibilities include performance analysis and tuning of DL models (LLM, Recommender, GNN, Generative AI) across diverse NVIDIA accelerators. This role requires contributing to inference benchmarking frameworks (TensorRT, Triton), developing optimized solutions, and collaborating with cross-functional teams. Ideal candidates possess strong C/C++ skills, experience with DL model deployment, and a background in performance optimization techniques.
Must have:
  • 5+ years software development experience
  • Excellent C/C++ programming skills
  • DL model inference optimization experience
  • Performance analysis and tuning expertise
  • Collaboration with cross-functional teams
Good to have:
  • Python experience
  • SW Agile skills
  • GPU programming (CUDA or OpenCL)
  • Performance modeling and profiling
  • Experience with TensorRT, Triton, Polygraphy
Perks:
  • Equity
  • Benefits

Job Details

We are now looking for a Senior Deep Learning Software Engineer, Inference! NVIDIA is seeking an experienced Deep Learning Engineer focused on analyzing and improving performance of DL inference! NVIDIA is rapidly growing our research and development for Deep Learning Inference and is seeking excellent Software Engineers at all levels of expertise to join our team. Companies around the world are using NVIDIA GPUs to power a revolution in deep learning, enabling breakthroughs in areas like LLM, Generative AI, Recommenders and Vision that has put DL into every software solution. Join the team that builds the software to enable the performance optimization, deployment and serving of these DL solutions. We specialize in developing GPU-accelerated Deep learning software like TensorRT, DL benchmarking software and performant solutions to deploy and serve these models.

Collaborate with the deep learning community to implement the latest algorithms for public release in TensorRT and DL benchmarks. Identify performance opportunities and optimize SoTA DL models across the spectrum of NVIDIA accelerators, from datacenter GPUs to edge SoCs. Implement optimizations using TensorRT, its open source tools like Polygraphy, TensorRT plugins, Triton and CUDA kernels. Work and collaborate with a diverse set of teams involving performance modeling, performance analysis, kernel development and inference software development.

What you'll be doing:

  • Performance optimization, analysis, and tuning of DL models in various domains like LLM, Recommender, GNN, Generative AI.

  • Scale performance of DL models across different architectures and types of NVIDIA accelerators.

  • Contribute features and code to NVIDIA’s inference benchmarking frameworks, TensorRT, Triton and LLM software solutions.

  • Work with cross-collaborative teams across generative AI, automotive, image understanding, and speech understanding to develop innovative solutions.

What we need to see:

  • Masters or PhD or equivalent experience in relevant field (Computer Engineering, Computer Science, EECS, AI).

  • At least 5 years of relevant software development experience.

  • You'll need excellent C/C++ programming and software design skills. SW Agile skills are helpful and Python experience is a plus.

  • Prior experience with training, deploying or optimizing the inference of DL models in production is a plus.

  • Prior background with performance modelling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus.

  • GPU programming experience (CUDA or OpenCL) is a plus.

GPU deep learning has provided the foundation for machines to learn, perceive, reason and solve problems posed using human language. The GPU started out as the engine for simulating human imagination, conjuring up the amazing virtual worlds of video games and Hollywood films. Now, NVIDIA's GPU runs deep learning algorithms, simulating human intelligence, and acts as the brain of computers, robots and self-driving cars that can perceive and understand the world. Just as human imagination and intelligence are linked, computer graphics and artificial intelligence come together in our architecture. Two modes of the human brain, two modes of the GPU. This may explain why NVIDIA GPUs are used broadly for deep learning, and NVIDIA is increasingly known as “the AI computing company.” Come, join our DL Architecture team, where you can help build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.

#LI-Hybrid 

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

PlayStation Global - Machine Learning Engineer for Game Technology

PlayStation Global

Aliso Viejo, California, United States (On-Site)
10 Months ago
Google - Senior Software Engineer, Security and Privacy, Pixel Phone

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
Argus Labs - Senior Software Engineer (Infrastructure/Backend)

Argus Labs

(Remote)
1 Month ago
Netflix - Machine Learning Engineer 5 - Content & Studio

Netflix

United States (Remote)
1 Month ago
Applike Group - Senior Data Scientist (Recommendation Systems Expert) (f/m/d)

Applike Group

Hamburg, Hamburg, Germany (Hybrid)
7 Months ago
GEA Group - HMI Software Engineer

GEA Group

Bengaluru, Karnataka, India (On-Site)
7 Months ago
NVIDIA - Senior Physical Design Backend Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Tesla - Lead/Manager (Power) Electronic/Electrical Design Engineer

Tesla

Brandenburg, Germany (On-Site)
3 Months ago
NVIDIA - Senior Tool and Methodology Development Software Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
2 Months ago
Dassault Systèmes - Software Engineer (Geometry)

Dassault Systèmes

Mumbai, Maharashtra, India (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Machine Learning Intern - 2025

NVIDIA

(On-Site)
4 Months ago
Sleeper - Performance Creative Associate (TikTok Ads)

Sleeper

Las Vegas, Nevada, United States (On-Site)
1 Month ago
ByteDance - Senior Research Scientist- Foundation Model, Vision and Language

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Google - Senior Software Engineer, Machine Learning (Recommendations, Rankings, and Predictions)

Google

Mountain View, California, United States (On-Site)
1 Month ago
ByteDance - Research Scientist - Multimedia Lab

ByteDance

San Diego, California, United States (On-Site)
2 Months ago
Google - Software Engineer, Research, Computational Imaging

Google

Mountain View, California, United States (On-Site)
1 Month ago
Tencent - Video Standards & Encoding Optimization Intern 103557

Tencent

Palo Alto, California, United States (On-Site)
5 Months ago
Google - Senior Software Engineer, Embedded Systems/Firmware, Platforms Infrastructure Engineering

Google

Sunnyvale, California, United States (On-Site)
6 Months ago
Techland - Junior Programmer

Techland

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Google - Cloud Engineer II, AI/ML, Professional Services

Google

Mexico City, Mexico City, Mexico (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

ByteDance - AI/LLM Network Software Engineer (High Speed Network)

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
Riot Games - Senior Animation Artist - VALORANT

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago
Netflix - Counsel/Manager, Original Stand-Up, Sketch & Comedy Formats

Netflix

Los Angeles, California, United States (On-Site)
1 Month ago
Eleven Labs - Growth Associate

Eleven Labs

United States (Remote)
1 Month ago
ByteDance - Senior Software Engineer(Financing Product), Global Payments

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
OKX - Senior Listing Manager

OKX

New York, New York, United States (On-Site)
7 Months ago
Google - Security Consultant Developer

Google

Atlanta, Georgia, United States (On-Site)
1 Month ago
Hitachi - Senior Modern Applications Solution Architect

Hitachi

Chicago, Illinois, United States (Remote)
7 Months ago
ByteDance - Software Engineer - Compute Infrastructure (Orchestration & Scheduling)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Netflix - ML Software Engineer (L4/L5) - Media Algorithms

Netflix

Los Angeles, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Rivos - Platform FPGA Design

Rivos

Santa Clara, California, United States (On-Site)
7 Months ago
Riot Games - Staff Software Engineer - League of Legends, Champions

Riot Games

Los Angeles, California, United States (On-Site)
3 Months ago
NVIDIA - System Memory Validation Software Engineer

NVIDIA

Shenzhen, Guangdong Province, China (On-Site)
4 Months ago
Riot Games - Staff Software Engineer, Unreal Tools - MMO

Riot Games

Dublin, County Dublin, Ireland (On-Site)
6 Months ago
NVIDIA - Performance Engineer Intern, Deep Learning and HPC

NVIDIA

Shanghai, Shanghai, China (On-Site)
4 Months ago
NXP - <2025 Internship Program> Application Engineer

NXP

Taipei City, Taiwan (On-Site)
6 Months ago
Netflix - Engineering Manager, Delivery Engineering

Netflix

United States (On-Site)
6 Months ago
NVIDIA - Senior Analog Mixed Signal Design Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
3 Months ago
NVIDIA - Manager, Developer Technology, Data Compression

NVIDIA

California, United States (Hybrid)
4 Months ago
Ethernovia - GUI Tools Software Development

Ethernovia

Pune, Maharashtra, India (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug