Senior Deep Learning Engineer

3 Months ago • 5 Years + • Research Development • $148,000 PA - $287,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior Deep Learning Engineer to contribute to next-generation inference optimizations and deliver top performance in AI. Responsibilities include analyzing and exploring techniques to scale test-time compute, optimizing low-latency inference, leveraging cross-stack optimizations, and collaborating with diverse teams. The role requires keeping abreast of generative AI research, prototyping emergent techniques (output refinement, speculation, retrieval), identifying optimization opportunities, and pioneering innovative solutions for high-quality inferencing on NVIDIA GPUs. Successful candidates will collaborate with production teams to integrate advancements into software frameworks.
Must have:
  • Master's degree in relevant field
  • Strong deep learning foundation (generative models, inferencing)
  • 5+ years experience in modern deep learning frameworks (PyTorch)
  • Growth mindset and pragmatic attitude
Good to have:
  • Published research in deep learning (inference-time compute)
  • Experience with prototyping/deploying test-time compute techniques
  • Cross-team collaboration experience
  • Familiarity with computer architecture and AI algorithms
Perks:
  • Equity
  • Benefits

Job Details

We are now looking for a Senior Deep Learning Engineer! At NVIDIA, we are at the forefront of advancing the capabilities of artificial intelligence. We are seeking an ambitious and forward-thinking senior deep learning engineer to contribute to the development of next-generation inference optimizations and deliver industry-leading performance without compromising model quality. In this role, you will analyze and explore techniques to scale test-time compute and optimize low-latency inference. Your work will leverage cross-stack optimizations at the algorithmic and system level.

As NVIDIA makes significant strides in AI datacenters, our team holds a central role in maximizing the efficiency of our exponentially growing inference deployment needs and establishing a data-driven approach to algorithmic improvements, hardware design and system software development. We collaborate extensively with diverse teams at NVIDIA, spanning deep learning research and framework development teams, to silicon architecture. Thriving in such a high-impact, interdisciplinary environment necessitates not only technical proficiency but also a growth mindset and a pragmatic attitude — qualities that fuel our collective success in shaping the future of datacenter technology.

What You'll Be Doing:

  • Keeping abreast of the latest advancements in generative AI research.

  • Prototyping and analyzing emergent techniques in the test-time compute space such as output refinement,  speculation, and retrieval. Identifying opportunities for algorithmic as well as system optimizations.

  • Pioneering the development of innovative optimizations to enable high quality inferencing on NVIDIA GPUs. 

  • Collaborating closely with production teams to incorporate the latest advancements into cutting-edge software frameworks.

What We Need to See:

  • Master's degree (or equivalent experience) in Computer Science, Artificial Intelligence, Applied Mathematics, or related fields.

  • A strong foundation in deep learning, with a particular emphasis on generative models and inferencing.

  • A track record of at least 5 years of relevant software development experience in modern deep learning frameworks such as PyTorch.

  • Growth mindset and pragmatic attitude.

Ways to Stand Out From the Crowd:

  • Published research or noteworthy contributions to the field of deep learning, particularly in areas such as inference-time compute, conditional compute, speculative decoding, etc. 

  • Experience with prototyping and/or deployment of emergent test time compute techniques. 

  • Experience with collaborating across algorithms, software and performance teams to deliver high quality solutions.

  • Familiarity with computer architecture and how it relates to AI algorithms development.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative and autonomous, we want to hear from you!

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

NVIDIA - Senior Application Software Engineer, Performance

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Months ago
Meta - Research Scientist Intern, Language and Multimodal Research for MetaAI (PhD)

Meta

Seattle, Washington, United States (On-Site)
7 Months ago
AppLovin - Backend Infrastructure Engineer, New Grad

AppLovin

Palo Alto, California, United States (On-Site)
2 Months ago
fairmatic - Senior Data Scientist

fairmatic

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
8 Months ago
Workato - Senior Infrastructure Engineer (OpenSearch)

Workato

Sofia, Sofia City Province, Bulgaria (On-Site)
1 Month ago
Zazz - Machine Learning Engineer

Zazz

(Remote)
4 Months ago
AI Fund - Head of AI @ Olakai

AI Fund

California, United States (Remote)
8 Months ago
zoox - Senior/Staff Software Engineer - Prediction Integration

zoox

Foster City, California, United States (Hybrid)
8 Months ago
bytedance - Student Researcher (Doubao (Seed) - Foundation Model - Vision Generative AI)

bytedance

San Jose, California, United States (On-Site)
3 Months ago
Token Metrics - Crypto Data Scientist / Machine Learning Engineer  (Remote)

Token Metrics

Tiranë, Tirana County, Albania (Remote)
8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - PhD Software Engineer

Google

Sunnyvale, California, United States (On-Site)
2 Months ago
Snyk - Senior Software Engineer

Snyk

London, England, United Kingdom (On-Site)
1 Month ago
Dream Games - Senior Graphic Designer

Dream Games

İstanbul, Türkiye (On-Site)
10 Months ago
bytedance - Senior Algorithm Engineer, Trust and Safety

bytedance

Singapore (On-Site)
8 Months ago
Hasura - Senior/Staff Software Engineer - Go Backend (Bengaluru/Hybrid)

Hasura

Bengaluru, Karnataka, India (Hybrid)
9 Months ago
Crowd Strick - Sr. Software Engineer, Backend - Detections Platform

Crowd Strick

United Kingdom (Remote)
1 Month ago
Slay - Senior Marketing Data Engineer

Slay

Berlin, Berlin, Germany (On-Site)
3 Months ago
NCR Voyix - Senior Software Engineering Manager – Data Engineering & Full stack

NCR Voyix

Hyderabad, Telangana, India (Hybrid)
1 Month ago
Workato - Staff Software Engineer

Workato

Yerevan, Yerevan, Armenia (On-Site)
1 Month ago
nekki game - Middle/Senior Core Game Designer

nekki game

(Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

bounteous - Data Engineer

bounteous

United States (Hybrid)
1 Month ago
FlyQuest - Facilities Coordinator

FlyQuest

Culver City, California, United States (On-Site)
2 Months ago
Blind Squirrel Games - Systems Designer

Blind Squirrel Games

Austin, Texas, United States (Hybrid)
5 Months ago
Giant Sparrow - Gameplay Designer

Giant Sparrow

Los Angeles, California, United States (Remote)
4 Months ago
CRB workforce  - Software Engineer

CRB workforce

Littleton, Colorado, United States (On-Site)
1 Month ago
Kavalirio - Material Handler

Kavalirio

Loudon, Tennessee, United States (On-Site)
4 Weeks ago
PayPal - Account Manager, SMB Growth

PayPal

Pennsylvania, United States (Hybrid)
1 Month ago
Gupta - Creative Director

Gupta

Boston, Massachusetts, United States (On-Site)
3 Months ago
Nielsen Holdings - Vice President, Commercial, Gracenote Automotive (Revenue)

Nielsen Holdings

United States (Remote)
2 Months ago
bytedance - Cloud Network Engineer

bytedance

Seattle, Washington, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Passive Logic - AI Control Theory & Optimization Scientist

Passive Logic

Salt Lake City, Utah, United States (On-Site)
6 Months ago
Meta - Research Engineer - Conversational AI - Reality Labs

Meta

Menlo Park, California, United States (On-Site)
2 Months ago
Playtika - LMS & Learning Ops Manager

Playtika

Israel (On-Site)
3 Months ago
Hedra - Applied Research Scientist

Hedra

New York, New York, United States (On-Site)
3 Months ago
bytedance - Machine Learning Engineer - Pico Perception

bytedance

San Jose, California, United States (On-Site)
3 Months ago
NVIDIA - Senior AI-HPC Storage Engineer

NVIDIA

Westford, Massachusetts, United States (On-Site)
4 Months ago
Tencent - IaaS Product Solution Architect

Tencent

(On-Site)
2 Months ago
bytedance - Senior Software Engineer / Researcher, AI-Native Database Systems

bytedance

San Jose, California, United States (On-Site)
2 Months ago
zoox - Staff/Senior Staff Software Engineer, ML Performance Optimization

zoox

Foster City, California, United States (On-Site)
8 Months ago
Inworld AI - Staff C++ Engineer

Inworld AI

Mountain View, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

Taipei City, Taiwan (On-Site)

Beijing, Beijing, China (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug