Senior Software Engineer, Deep Learning Inference, TensorRT

2 Months ago • 3 Years + • Research & Development • $148,000 PA - $287,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference using TensorRT. Responsibilities include developing TensorRT components using C++ and Python, building graph parsers and optimizers, and collaborating with deep learning experts and GPU architects. The role involves optimizing deep learning models, particularly Large Language Models, for NVIDIA GPUs. Success requires strong C++ and machine learning expertise, proficiency in data structures and algorithms, and excellent communication skills.
Must have:
  • C++11/14/17 expertise
  • Strong ML concepts understanding
  • Computer Architecture knowledge
  • Data Structures & Algorithms
  • 3+ years software development experience
Good to have:
  • System Software development
  • Python proficiency
  • CUDA/OpenCL GPU kernel programming
  • Software performance optimization
  • Compiler development experience
  • TensorRT/PyTorch/TensorFlow experience
Perks:
  • Equity
  • Benefits

Job Details

We are now looking for a Senior Software Engineer for Deep Learning Inference! Would you like to make a big impact in Deep Learning by helping build a state-of-the-art inference framework for accelerating Deep Learning models, especially Large Language Models, on NVIDIA GPUs? We are now welcoming exceptional software engineers to apply to Senior Engineering positions in the Deep Learning Inference TensorRT software team.

What you’ll be doing:

  • Develop components of TensorRT, NVIDIA’s SDK for high-performance deep learning inference.

  • Use C++ and Python to build graph parsers, optimizers, and tools for effective deployment of trained deep learning models.

  • Collaborate with teams of deep learning experts, GPU architects and DevOps engineers across diverse teams.

What we need to see:

  • A Bachelor's, Master's, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering or related field.

  • 3+ years of software development experience.

  • Strong experience with C++11/C++14/C++17.

  • Strong grasp of Machine Learning concepts.

  • Experience and knowledge in Computer Architecture, Data Structures, Algorithms.

  • Excellent communication skills, and an aptitude for collaboration and teamwork.

Ways to stand out from the crowd:

  • Experience developing System Software.

  • Proficiency in Python as well as Background in GPU kernel programming using CUDA or OpenCL.

  • Experience in software performance benchmarking, profiling, and optimizations.

  • Background in compiler development

  • Experience in working with TensorRT, PyTorch, TensorFlow, ONNX Runtime or other ML frameworks.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative, autonomous and love a challenge, we want to hear from you. Come, join our TensorRT Workflows team and help build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.

#LI-Hybrid

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

NVIDIA - Senior Software Engineer - Triton Tools

NVIDIA

California, United States (Remote)
4 Months ago
Google - Customer Engineer, Cloud AI, Google Cloud

Google

New York, New York, United States (On-Site)
1 Month ago
Canva - Senior Machine Learning Engineer - Specialist Platform and Experience

Canva

Surry Hills, New South Wales, Australia (Remote)
2 Months ago
NVIDIA - Deep Learning Intern - Fall 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Month ago
ByteDance - Algorithm Engineer - Enterprise Solution RD

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
NVIDIA - Senior Mixed Signal Designer Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago
Riot Games - Staff Software Engineer, MGS - 2XKO

Riot Games

Dublin, County Dublin, Ireland (On-Site)
6 Months ago
NVIDIA - Director of Mechanical Engineering

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Google - ASIC Power Management Architect, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
Nagarro - Team Lead SAP SuccessFactors

Nagarro

Germany (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Research Scientist- Applied Machine learning Graduates (AML) - 2024 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Dream Sports - Lead ML Scientist

Dream Sports

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Riot Games - Staff Research Scientist - Tech Research

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago
NVIDIA - Software Engineering Intern, AI Engineering - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
4 Months ago
ByteDance - Machine Learning Engineer - AML Algorithm

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Meta - Research Scientist, Machine Learning (PhD)

Meta

Sunnyvale, California, United States (On-Site)
6 Months ago
Google - Customer Engineer, AI Infrastructure

Google

Seattle, Washington, United States (On-Site)
1 Month ago
ByteDance - Research Scientist, Code Generation

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Google - Data and Analytics Consultant, Google Cloud

Google

Hyderabad, Telangana, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Canada

Ubisoft - Camera Specialist (Gameplay)

Ubisoft

Montreal, Quebec, Canada (On-Site)
3 Months ago
Epic Games - Outsourcing VFX Artist

Epic Games

Montreal, Quebec, Canada (On-Site)
1 Month ago
Snowed In Studios - Senior Generalist Programmer

Snowed In Studios

Quebec, Canada (Remote)
1 Month ago
People Can Fly - Live Operations Technician

People Can Fly

Montreal, Quebec, Canada (Remote)
2 Months ago
TRACK VFX - Senior Matchmove Artist

TRACK VFX

Vancouver, British Columbia, Canada (On-Site)
2 Months ago
ICON Creative Studio - Intermediate Asset Finaler

ICON Creative Studio

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
Guru Studio - Unreal 3D Layout Artist

Guru Studio

Ontario, Canada (Hybrid)
1 Month ago
Ubisoft - Level Artist

Ubisoft

Toronto, Ontario, Canada (On-Site)
1 Month ago
Snowed In Studios - Senior Generalist Programmer

Snowed In Studios

Quebec, Canada (Remote)
2 Months ago
Scanline VFX - Release DevOps Engineer

Scanline VFX

Montreal, Quebec, Canada (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Google - Software Engineering Manager, GPay Merchant Platform

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Google - Senior Software Engineer, Sensor Algorithms, Device and Services

Google

Mountain View, California, United States (On-Site)
1 Month ago
Riot Games - Staff Software Engineer, Machine Learning - AI Foundations

Riot Games

United States (On-Site)
1 Month ago
ByteDance - Tech Lead Software Engineer- Programming Language (San Jose, CA)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Krafton  - Data Entry Planner

Krafton

(On-Site)
1 Month ago
NVIDIA - Senior ASIC Design Engineer

NVIDIA

Washington, District Of Columbia, United States (Remote)
2 Months ago
NVIDIA - Clock Design Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Months ago
NXP - Software Internship – Automotive Security Firmware

NXP

Bucharest, Bucharest, Romania (On-Site)
8 Months ago
Google - SoC and IP Design Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Riot Games - Senior User Researcher

Riot Games

Dublin, County Dublin, Ireland (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug