Senior Deep Learning Engineer

2 Months ago • 5 Years + • Artificial Intelligence • Research & Development • $148,000 PA - $287,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior Deep Learning Engineer to contribute to next-generation inference optimizations and deliver top performance in AI. Responsibilities include analyzing and exploring techniques to scale test-time compute, optimizing low-latency inference, leveraging cross-stack optimizations, and collaborating with diverse teams. The role requires keeping abreast of generative AI research, prototyping emergent techniques (output refinement, speculation, retrieval), identifying optimization opportunities, and pioneering innovative solutions for high-quality inferencing on NVIDIA GPUs. Successful candidates will collaborate with production teams to integrate advancements into software frameworks.
Must have:
  • Master's degree in relevant field
  • Strong deep learning foundation (generative models, inferencing)
  • 5+ years experience in modern deep learning frameworks (PyTorch)
  • Growth mindset and pragmatic attitude
Good to have:
  • Published research in deep learning (inference-time compute)
  • Experience with prototyping/deploying test-time compute techniques
  • Cross-team collaboration experience
  • Familiarity with computer architecture and AI algorithms
Perks:
  • Equity
  • Benefits

Job Details

We are now looking for a Senior Deep Learning Engineer! At NVIDIA, we are at the forefront of advancing the capabilities of artificial intelligence. We are seeking an ambitious and forward-thinking senior deep learning engineer to contribute to the development of next-generation inference optimizations and deliver industry-leading performance without compromising model quality. In this role, you will analyze and explore techniques to scale test-time compute and optimize low-latency inference. Your work will leverage cross-stack optimizations at the algorithmic and system level.

As NVIDIA makes significant strides in AI datacenters, our team holds a central role in maximizing the efficiency of our exponentially growing inference deployment needs and establishing a data-driven approach to algorithmic improvements, hardware design and system software development. We collaborate extensively with diverse teams at NVIDIA, spanning deep learning research and framework development teams, to silicon architecture. Thriving in such a high-impact, interdisciplinary environment necessitates not only technical proficiency but also a growth mindset and a pragmatic attitude — qualities that fuel our collective success in shaping the future of datacenter technology.

What You'll Be Doing:

  • Keeping abreast of the latest advancements in generative AI research.

  • Prototyping and analyzing emergent techniques in the test-time compute space such as output refinement,  speculation, and retrieval. Identifying opportunities for algorithmic as well as system optimizations.

  • Pioneering the development of innovative optimizations to enable high quality inferencing on NVIDIA GPUs. 

  • Collaborating closely with production teams to incorporate the latest advancements into cutting-edge software frameworks.

What We Need to See:

  • Master's degree (or equivalent experience) in Computer Science, Artificial Intelligence, Applied Mathematics, or related fields.

  • A strong foundation in deep learning, with a particular emphasis on generative models and inferencing.

  • A track record of at least 5 years of relevant software development experience in modern deep learning frameworks such as PyTorch.

  • Growth mindset and pragmatic attitude.

Ways to Stand Out From the Crowd:

  • Published research or noteworthy contributions to the field of deep learning, particularly in areas such as inference-time compute, conditional compute, speculative decoding, etc. 

  • Experience with prototyping and/or deployment of emergent test time compute techniques. 

  • Experience with collaborating across algorithms, software and performance teams to deliver high quality solutions.

  • Familiarity with computer architecture and how it relates to AI algorithms development.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative and autonomous, we want to hear from you!

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Google - Software Engineer III, Infrastructure, Google Cloud Data Management

Google

New York, New York, United States (On-Site)
6 Months ago
Scale AI - Machine Learning Research Scientist/ Engineer, Agents

Scale AI

San Francisco, California, United States (On-Site)
1 Month ago
Slay - Senior Marketing Data Engineer

Slay

Berlin, Berlin, Germany (On-Site)
2 Months ago
Ansys - Senior Backend R&D Engineer

Ansys

Montigny-le-Bretonneux, Île-de-France, France (Remote)
3 Days ago
Outbrain - Machine Learning Engineer

Outbrain

Ljubljana, Ljubljana, Slovenia (Hybrid)
1 Month ago
Google - Software Engineer III, Artificial Intelligence/Machine Learning

Google

Hyderabad, Telangana, India (On-Site)
1 Month ago
bytedance - Software Engineer / Researcher, AI-Native Database Systems

bytedance

Seattle, Washington, United States (On-Site)
1 Month ago
Google - Senior Software Engineer, AI/ML GenAI, Google Cloud

Google

Seattle, Washington, United States (On-Site)
1 Month ago
Google - Software Engineer III, Generative AI

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Meta - Software Engineer, Machine Learning

Meta

Fremont, California, United States (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Wargaming - Gameplay Developer (World of Tanks)

Wargaming

Nicosia, Nicosia, Cyprus (Hybrid)
1 Month ago
bytedance - Research Engineer Graduate (Vision AI Platform)

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago
Yahoo - Sr Production Engineer

Yahoo

Bengaluru, Karnataka, India (Hybrid)
3 Days ago
Inworld AI - Senior C++ Developer - USA

Inworld AI

Mountain View, California, United States (On-Site)
7 Months ago
Google - Software Engineer III, Infrastructure, Google Cloud Storage

Google

New York, New York, United States (On-Site)
1 Month ago
Cognite - Backend Engineer

Cognite

Phoenix, Arizona, United States (Hybrid)
1 Month ago
Google - Staff Software Engineer, Infrastructure, Google Cloud AI

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
bytedance - Backend Software Engineer - Privacy & Security - Singapore

bytedance

Singapore (On-Site)
7 Months ago
Reddit - Senior Data Scientist, Ads

Reddit

United States (Remote)
2 Weeks ago
Trendyol - Data Analyst (Data Science)

Trendyol

Istanbul, İstanbul, Türkiye (Hybrid)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

Philips - Sales, Inside Sales Associate

Philips

Nashville, Tennessee, United States (On-Site)
3 Days ago
WebTech Corporation - Electronics Assembler

WebTech Corporation

Kansas City, Missouri, United States (On-Site)
1 Week ago
bytedance - AI Product Manager

bytedance

San Jose, California, United States (On-Site)
1 Month ago
Varonis  - Human Resources Business Partner

Varonis

United States (On-Site)
7 Months ago
On Location - Design Director

On Location

Los Angeles, California, United States (Hybrid)
1 Month ago
The Walt Disney Company - Lead Software Engineer - Applied AI & Machine Learning

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Month ago
Kavalirio - CAD Technician

Kavalirio

Orlando, Florida, United States (On-Site)
1 Month ago
Google - Staff Software Engineer, Mobile (Android), YouTube

Google

San Bruno, California, United States (On-Site)
1 Month ago
fluence - Controls Software Engineer II

fluence

Houston, Texas, United States (Hybrid)
7 Months ago
Optiv - Sr. Consultant

Optiv

Overland Park, Kansas, United States (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Keywords Studios - Junior AI Tester

Keywords Studios

Silesian Voivodeship, Poland (On-Site)
2 Months ago
Krafton - [Global Strategy & BD Div.] Strategy Manager(AI Ethics) (4년 ~ 7년)

Krafton

Seoul, South Korea (On-Site)
5 Months ago
Scale AI - Senior Software Engineer, GenAI Model Evaluation

Scale AI

San Francisco, California, United States (On-Site)
7 Months ago
Talentica Software - Data Scientist

Talentica Software

India (Remote)
7 Months ago
NVIDIA - AI Algorithms Software Engineer (RDSS Intern)

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
4 Months ago
Social Discovery Group - Senior NLP Engineer

Social Discovery Group

Georgia (Remote)
7 Months ago
Scanline VFX - Research Intern (Summer 2025)

Scanline VFX

Los Angeles, California, United States (Hybrid)
6 Months ago
Rackspace Technology - Practice Manager, Data Science, AI and ML

Rackspace Technology

(Remote)
5 Months ago
SiftHub - Senior NLP Engineer

SiftHub

Maharashtra, India (On-Site)
9 Months ago
bytedance - LLM Software Engineer/Researcher (Applied Machine Learning)

bytedance

Seattle, Washington, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

Taipei City, Taiwan (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug