Senior Software Engineer, Deep Learning Inference, TensorRT

2 Weeks ago • 3 Years + • Research & Development • $148,000 PA - $287,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference using TensorRT. Responsibilities include developing TensorRT components using C++ and Python, building graph parsers and optimizers, and collaborating with deep learning experts and GPU architects. The role involves optimizing deep learning models, particularly Large Language Models, for NVIDIA GPUs. Success requires strong C++ and machine learning expertise, proficiency in data structures and algorithms, and excellent communication skills.
Must have:
  • C++11/14/17 expertise
  • Strong ML concepts understanding
  • Computer Architecture knowledge
  • Data Structures & Algorithms
  • 3+ years software development experience
Good to have:
  • System Software development
  • Python proficiency
  • CUDA/OpenCL GPU kernel programming
  • Software performance optimization
  • Compiler development experience
  • TensorRT/PyTorch/TensorFlow experience
Perks:
  • Equity
  • Benefits

Job Details

We are now looking for a Senior Software Engineer for Deep Learning Inference! Would you like to make a big impact in Deep Learning by helping build a state-of-the-art inference framework for accelerating Deep Learning models, especially Large Language Models, on NVIDIA GPUs? We are now welcoming exceptional software engineers to apply to Senior Engineering positions in the Deep Learning Inference TensorRT software team.

What you’ll be doing:

  • Develop components of TensorRT, NVIDIA’s SDK for high-performance deep learning inference.

  • Use C++ and Python to build graph parsers, optimizers, and tools for effective deployment of trained deep learning models.

  • Collaborate with teams of deep learning experts, GPU architects and DevOps engineers across diverse teams.

What we need to see:

  • A Bachelor's, Master's, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering or related field.

  • 3+ years of software development experience.

  • Strong experience with C++11/C++14/C++17.

  • Strong grasp of Machine Learning concepts.

  • Experience and knowledge in Computer Architecture, Data Structures, Algorithms.

  • Excellent communication skills, and an aptitude for collaboration and teamwork.

Ways to stand out from the crowd:

  • Experience developing System Software.

  • Proficiency in Python as well as Background in GPU kernel programming using CUDA or OpenCL.

  • Experience in software performance benchmarking, profiling, and optimizations.

  • Background in compiler development

  • Experience in working with TensorRT, PyTorch, TensorFlow, ONNX Runtime or other ML frameworks.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative, autonomous and love a challenge, we want to hear from you. Come, join our TensorRT Workflows team and help build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.

#LI-Hybrid

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

NVIDIA - Research Scientist, Design Automation

NVIDIA

Austin, Texas, United States (On-Site)
2 Months ago
Google - Software Engineer III, Machine Learning, Search

Google

Seattle, Washington, United States (On-Site)
4 Months ago
Tencent - Senior Staff Researcher

Tencent

Palo Alto, California, United States (On-Site)
4 Months ago
Meta - Software Engineer, Machine Learning

Meta

Los Angeles, California, United States (On-Site)
4 Months ago
NVIDIA - SOC Clock Distribution Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Weeks ago
Rivos - CPU Design Verification - Full-time

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
5 Months ago
NVIDIA - Senior System Software Engineer, NCCL - Partner Enablement

NVIDIA

Santa Clara, California, United States (Remote)
1 Month ago
Krafton  - PUBG Mobile Marketing Manager (8+ years experience)

Krafton

Seoul, South Korea (On-Site)
2 Weeks ago
NVIDIA - Senior Software Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Senior DevOps Engineer, Deep Learning Frameworks

NVIDIA

Canada (On-Site)
1 Month ago
Ubisoft - Scientifique en données ML Senior _ Groupe Technologique Content Creation

Ubisoft

Montreal, Quebec, Canada (On-Site)
2 Months ago
NVIDIA - Research Scientist, Design Automation - New College Grad 2025

NVIDIA

Austin, Texas, United States (On-Site)
1 Month ago
NVIDIA - Senior Solution Engineer, Mission Control

NVIDIA

Santa Clara, California, United States (On-Site)
2 Days ago
ByteDance - Tech Lead Machine Learning Engineer

ByteDance

Seattle, Washington, United States (On-Site)
3 Days ago
Google - Software Engineer III, Machine Learning, Search

Google

Seattle, Washington, United States (On-Site)
4 Months ago
Solvative - Full Stack Developer (Python)

Solvative

Ahmedabad, Gujarat, India (Remote)
2 Days ago
ByteDance - Senior Machine Learning Engineer

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Netflix - Software Engineer (L5), N-Tech Software Engineering

Netflix

United States (Remote)
5 Months ago
Samsung Semiconductor - Senior Engineer, AI

Samsung Semiconductor

San Jose, California, United States (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Canada

Company3 Method Studios - HR Generalist

Company3 Method Studios

British Columbia, Canada (Hybrid)
1 Week ago
Ubisoft - Team Lead - Animation

Ubisoft

Toronto, Ontario, Canada (Hybrid)
2 Days ago
NVIDIA - Senior Physical Design Methodology Engineer

NVIDIA

Canada (On-Site)
1 Month ago
NVIDIA - Senior System Software Engineer, Robotics Simulation

NVIDIA

Toronto, Ontario, Canada (Hybrid)
3 Weeks ago
NVIDIA - Silicon System Level Test Development Engineer

NVIDIA

Canada (Hybrid)
1 Month ago
Mixmob - Lead Game Designer

Mixmob

Vancouver, British Columbia, Canada (Remote)
8 Months ago
Super - Business Development Intern

Super

Canada (Remote)
2 Months ago
NVIDIA - Senior Director, PR Enterprise

NVIDIA

Canada (On-Site)
1 Month ago
Digital Extremes - UI Programmer

Digital Extremes

Ontario, Canada (Remote)
2 Weeks ago
NVIDIA - Senior Manager, Internal Audit and SOX

NVIDIA

Canada (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Google - Student Researcher, PhD, Winter/Summer 2025

Google

Mountain View, California, United States (On-Site)
4 Months ago
Netflix - Machine Learning Intern, Summer 2025

Netflix

Los Gatos, California, United States (On-Site)
2 Months ago
NVIDIA - VLSI Physical Design Engineer

NVIDIA

Westford, Massachusetts, United States (On-Site)
3 Weeks ago
Fluence - Lead Engineer - Advanced Battery Modules

Fluence

Houston, Texas, United States (Hybrid)
5 Months ago
Krafton  - PUBG IP Franchise Project ARC Community Manager

Krafton

Seoul, South Korea (On-Site)
2 Months ago
Regent Craft - Performance Engineering Intern

Regent Craft

North Kingstown, Rhode Island, United States (On-Site)
5 Months ago
Tesla - Electrical Engineer

Tesla

Rhineland-Palatinate, Germany (On-Site)
1 Month ago
Nagarro - Trainee

Nagarro

(On-Site)
4 Months ago
Krafton  - Senior Internal Auditor

Krafton

Seoul, South Korea (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Yokne'am Illit, North District, Israel (On-Site)

Hyderabad, Telangana, India (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug