Senior Research Engineer, Foundation Model Training Infrastructure

3 Months ago • 10 Years + • Artificial Intelligence • Research & Development • $224,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA's GEAR group seeks a Senior Research Engineer to design and maintain large-scale distributed training systems for multi-modal foundation models in robotics. This role involves optimizing GPU and cluster utilization, implementing scalable data loaders, developing monitoring tools, and collaborating with researchers. The successful candidate will have 10+ years of experience in large-scale MLOps and AI infrastructure, expertise in PyTorch/JAX/TensorFlow, CUDA programming, and cluster management tools like Kubernetes. The work contributes directly to NVIDIA's Project GR00T, a moonshot initiative in humanoid robot technology.
Must have:
  • 10+ years MLOps/AI infrastructure experience
  • Distributed training system design (PyTorch/JAX/TensorFlow)
  • GPU acceleration, CUDA, Kubernetes expertise
  • Python & C++ programming skills
  • Large-scale GPU cluster experience
Good to have:
  • Master's/PhD in CS/Robotics/Engineering
  • Tech Lead experience
  • LLM/multimodal LLM infrastructure experience
  • Open-source contributions or publications
Perks:
  • Equity
  • Benefits

Job Details

NVIDIA is searching for a senior or principal engineer who specializes in building cutting-edge infrastructure for large-scale foundation model training in the Generalist Embodied Agent Research (GEAR) group. Our team is leading Project GR00T, NVIDIA’s moonshot initiative at building foundation models and full-stack technology for humanoid robots.

You will work with an amazing and collaborative research team that consistently produces influential works on multimodal foundation models, large-scale robot learning, embodied AI, and physics simulation. Our past projects include Eureka, VIMA, Voyager, MineDojo, MimicPlay, Prismer, and more. Your contributions will have a significant impact on our research projects and product roadmaps.

What you will be doing:

  • Design and maintain large-scale distributed training systems to support multi-modal foundation models for robotics.

  • Optimize GPU and cluster utilization for efficient model training and fine-tuning on massive datasets.

  • Implement scalable data loaders and preprocessors tailored for multimodal datasets, including videos, text, and sensor data.

  • Develop robust monitoring and debugging tools to ensure the reliability and performance of training workflows on large GPU clusters.

  • Collaborate with researchers to integrate cutting-edge model architectures into scalable training pipelines.

What we need to see:

  • Bachelor's degree in Computer Science, Robotics, Engineering, or a related field;

  • 10+ years of full-time industry experience in large-scale MLOps and AI infrastructure;

  • Proven experience designing and optimizing distributed training systems with frameworks like PyTorch, JAX, or TensorFlow.

  • Deep understanding of GPU acceleration, CUDA programming, and cluster management tools like Kubernetes.

  • Strong programming skills in Python and a high-performance language such as C++ for efficient system development.

  • Strong experience with large-scale GPU clusters, HPC environments, and job scheduling/orchestration tools (e.g., SLURM, Kubernetes).

Ways to stand out from the crowd:

  • Master’s or PhD’s degree in Computer Science, Robotics, Engineering, or a related field;

  • Demonstrated Tech Lead experience, coordinating a team of engineers and driving projects from conception to deployment;

  • Strong experience at building large-scale LLM and multimodal LLM training infrastructure;

  • Contributions to popular open-source AI frameworks or research publications in top-tier AI conferences, such as NeurIPS, ICRA, ICLR, CoRL.

NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and productive people in the world. Please join us and be part of the forefront of developing general-purpose robots and large-scale foundation models!

The base salary range is 224,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Ruby game studio - Senior Game Developer (on-site)

Ruby game studio

İzmir, İzmir, Türkiye (On-Site)
11 Months ago
Playrix - Senior C++ Software Engineer (Gameplay)

Playrix

Montenegro (Remote)
6 Months ago
Meta - Production Engineering

Meta

Cambridge, Massachusetts, United States (Hybrid)
5 Months ago
Bohemia Interactive - Lead Programmer

Bohemia Interactive

Prague, Prague, Czechia (On-Site)
5 Months ago
Playrix - Director of Engineering

Playrix

Serbia (Remote)
6 Months ago
ION - Senior AI Engineer, Italy

ION

Pisa, Tuscany, Italy (On-Site)
6 Months ago
Microsoft - Member of Technical Staff - Post-Training

Microsoft

Redmond, Washington, United States (On-Site)
1 Week ago
Tesla - Senior Machine Learning, AI Engineer

Tesla

Brandenburg, Germany (On-Site)
2 Months ago
NVIDIA - Director, Regional Developer Relations - ROAP

NVIDIA

Singapore (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Inworld AI - Staff Platform Engineer - USA

Inworld AI

Mountain View, California, United States (On-Site)
4 Months ago
Playrix - Lead Location Designer

Playrix

Portugal (Remote)
6 Months ago
Playrix - Lead Unity Software Engineer (Gameplay)

Playrix

Serbia (Remote)
6 Months ago
Playground Games - Character Artist (All Levels)

Playground Games

England, United Kingdom (Hybrid)
2 Months ago
Jam City - Senior Software Engineer

Jam City

Montevideo, Montevideo Department, Uruguay (Hybrid)
4 Weeks ago
SuperPlay - Technical Artist - Disney Solitaire

SuperPlay

Bucharest, Bucharest, Romania (On-Site)
1 Week ago
PwC - Information Protection Senior Manager

PwC

Amsterdam, North Holland, Netherlands (Hybrid)
4 Months ago
NVIDIA - Test Engineer, Electrical

NVIDIA

Roskilde, Denmark (Hybrid)
2 Weeks ago
Magic Media - Graphics Programmer (C++)

Magic Media

Vojvodina, Serbia (Remote)
5 Days ago
AGS - American Gaming Systems - Graduate Game Designer

AGS - American Gaming Systems

Australia (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

The Walt Disney Company - Senior Software Engineer - Front End

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Day ago
Google - Staff Software Engineer, XR

Google

Mountain View, California, United States (On-Site)
1 Week ago
WebFX - Jr. Paid Ads and Analytics Specialist

WebFX

Harrisburg, Pennsylvania, United States (On-Site)
6 Months ago
Google - Software Engineer III, Front End, Labs

Google

New York, New York, United States (On-Site)
6 Days ago
Global Step - Senior Games Tester

Global Step

Dallas, Texas, United States (On-Site)
1 Month ago
Google - Senior Software Engineer, Machine Learning, Applied AI

Google

Sunnyvale, California, United States (On-Site)
1 Week ago
Google - Finance Optimization Analyst

Google

Austin, Texas, United States (On-Site)
1 Week ago
Google - Senior Digital Strategy Lead, Accelerated Growth

Google

Mountain View, California, United States (On-Site)
6 Days ago
Oculus VR - Technical Artist

Oculus VR

Washington, United States (Remote)
3 Weeks ago
Dun & Bradstreet - Early Talent Network

Dun & Bradstreet

Jacksonville, Florida, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

ByteDance - Research Scientist Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Google - Software Engineer III, Machine Learning, Google Ads

Google

Los Angeles, California, United States (On-Site)
5 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
NVIDIA - Senior AI-HPC Cluster Engineer

NVIDIA

Santa Clara, California, United States (Hybrid)
4 Weeks ago
Krafton  - Deep Learning Engineer - Model Optimization

Krafton

Seoul, South Korea (On-Site)
1 Week ago
Google - Student Researcher, PhD, Winter/Summer 2025

Google

Mountain View, California, United States (On-Site)
5 Months ago
Granicus - Data Scientist 4

Granicus

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
1 Week ago
Interface AI - Staff Software Engineer, Backend

Interface AI

United States (Remote)
2 Months ago
PlayStation Global - Machine Learning Engineer

PlayStation Global

London, England, United Kingdom (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug