Senior Research Scientist, Multimodal Foundation Models and Robotics

2 Months ago • 5 Years + • Research Development • $184,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior Research Scientist to contribute to the development of humanoid robot foundation models and systems within their Generalist Embodied Agent Research (GEAR) group. Responsibilities include designing and implementing AI algorithms and models for general-purpose robots and embodied agents; developing large-scale AI training and inference methods for foundation models; optimizing and deploying AI models in simulation and on robot hardware; and collaborating with research and engineering teams. The ideal candidate will possess a Ph.D. in a relevant field and extensive experience in multimodal foundation models and robotics, including hands-on experience with robot learning, reinforcement learning, and various programming languages and frameworks.
Must have:
  • Ph.D. in relevant field
  • 5+ years experience
  • Multimodal Foundation Models expertise
  • Robotics experience (RL, imitation learning)
  • Programming skills (Python, C++, ROS)
  • Large-scale AI system experience
Good to have:
  • C++ and CUDA proficiency
  • Experience with MuJoCo and Isaac Sim
  • Robot hardware design experience
Perks:
  • Equity
  • Benefits

Job Details

We are now looking for a Senior Research Scientist focused on Multimodal Foundation Models and Robotics! NVIDIA is searching for an outstanding research scientist to build humanoid robot foundation models and systems in the Generalist Embodied Agent Research (GEAR) group. Everything that moves will eventually be autonomous. Our mission is to build general-purpose embodied agents that learn to explore and master complex skills across the virtual and the physical world.

You will work with an amazing and collaborative research team that consistently produces influential works on multimodal foundation models, large-scale robot learning, game AI, and physical simulation. Our past projects include Eureka, VIMA, Voyager, MineDojo, MimicPlay, Prismer, and more. One of our team’s most recent milestones includes Project GR00T, a foundation model for humanoid robots. Your contributions will have a significant impact on our moonshot research projects and product roadmaps.

What you will be doing:

  • Design and implement novel AI algorithms and models for general-purpose humanoid robots and embodied agents;

  • Develop large-scale AI training and inference methods for foundation models;

  • Optimize and deploy AI models in physical simulation and on robot hardware;

  • Collaborate with research and engineering teams across all of NVIDIA to transfer research to products and services.

What we need to see:

  • A Ph.D. in Computer Science/Engineering, Electrical Engineering, etc., or equivalent research experience.

  • 5 years of relevant work/research experience across one or both of these fields:

    • Multimodal Foundation Models

      • Hands-on training experience and publications in at least one of the following topics: LLMs; Large vision-language models; Video generative models and diffusion algorithms; or Action-based transformers.

      • Outstanding engineering skills in rapid prototyping and model training frameworks (PyTorch, Jax, Tensorflow, etc.). Python is required; C++ and CUDA proficiencies are a big plus;

      • Excellent skills in working with large-scale machine learning/AI systems and compute infrastructure.

    • Robotics:

      • Hands-on training experience and publications in robot learning, such as reinforcement learning, imitation learning, classical control methods, etc. 

      • Strong programming skills in Python, C++,  ROS, and machine learning frameworks like PyTorch.

      • Deep understanding of robot kinematics, dynamics, and sensors;

      • Ability to safely operate robot hardware, lab equipment, and tools;

      • Knowledge of control methods, including PID, model predictive control, and whole-body control;

      • Familiarity with physics simulation frameworks such as MuJoCo and Isaac Sim;

      • Robot hardware design and hands-on building experience.

NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and productive people in the world. Please join us and be part of the forefront of developing general-purpose robots and embodied agents!

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Magna International - Full-Stack Developer

Magna International

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Ion - Principal Software Engineer, Italy

Ion

Turin, Piedmont, Italy (On-Site)
9 Months ago
Illumina - Staff Test Engineer

Illumina

Singapore (On-Site)
1 Month ago
Capgemini - Playwright/Cypress

Capgemini

Chennai, Tamil Nadu, India (On-Site)
2 Months ago
seedify - Technical Artist

seedify

Hanoi, Hanoi, Vietnam (Remote)
2 Months ago
Super.com - AI Lead

Super.com

(Remote)
1 Month ago
bytedance - Research Scientist- Foundation Model, Generative AI

bytedance

Seattle, Washington, United States (On-Site)
8 Months ago
Apple - Machine Learning Engineer, Siri

Apple

Cupertino, California, United States (On-Site)
1 Month ago
USE Insider - Senior Machine Learning Engineer (Search)

USE Insider

Istanbul, İstanbul, Türkiye (Remote)
2 Weeks ago
GoTo Group - Food and Mart Researcher

GoTo Group

Jakarta, Indonesia (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Pushka Studios - Technical Artist (Unreal Engine)

Pushka Studios

Dnipro, Dnipropetrovsk Oblast, Ukraine (On-Site)
2 Months ago
DraftKings - Senior Software Engineer, Sportsbook

DraftKings

Plovdiv, Plovdiv Province, Bulgaria (Remote)
2 Months ago
Capgemini - Senior Software Engineer - C

Capgemini

Pune, Maharashtra, India (On-Site)
2 Months ago
Progress - IT QA Engineer, Senior

Progress

Hyderabad, Telangana, India (Hybrid)
1 Month ago
Capgemini - PaPM

Capgemini

Chennai, Tamil Nadu, India (On-Site)
2 Months ago
Novomatic - QA Engineer with C#

Novomatic

Zabierzów, Lesser Poland Voivodeship, Poland (Remote)
2 Weeks ago
WebMD - Software Engineer

WebMD

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Dentsu - Developer/Engineer

Dentsu

Pune, Maharashtra, India (On-Site)
3 Weeks ago
FunPlus - Development Tester (Gaming)

FunPlus

Lisbon, Lisbon, Portugal (Hybrid)
2 Months ago
Lead Venture - Full-Stack Software Engineer

Lead Venture

Cheltenham, England, United Kingdom (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

ZeniMax Media - Senior Application Security Engineer

ZeniMax Media

Rockville, Maryland, United States (On-Site)
2 Months ago
Adyen - Corporate Governance Counsel

Adyen

New York, United States (On-Site)
1 Month ago
Rippling - Manager, Sales Development

Rippling

New York, United States (Hybrid)
3 Weeks ago
Crunchyroll - Business and Legal Affairs, Senior Manager

Crunchyroll

New York, New York, United States (On-Site)
6 Months ago
NVIDIA - Senior Digital Circuit Design Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
5 Months ago
Rockstar Games - Director of Security Operations

Rockstar Games

New York, United States (On-Site)
1 Month ago
Qualcomm - MSIP Program Manager

Qualcomm

San Diego, California, United States (On-Site)
1 Month ago
bytedance - Research Scientist, Data Management and Security

bytedance

San Jose, California, United States (On-Site)
3 Months ago
Penumbrainc - EH&S Specialist II T

Penumbrainc

Alameda, California, United States (On-Site)
2 Months ago
Unity - Full-Stack Engineer - Comet

Unity

New York, New York, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Putnam - Analyst, Advisory Research Consulting

Putnam

Gurugram, India (On-Site)
1 Month ago
bytedance - Research Scientist Graduate (Foundation Model - Vision and Language)

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago
Match Group - Senior Machine Learning Engineer, Dating Outcomes

Match Group

New York, New York, United States (Hybrid)
2 Months ago
Kaedim - Machine Learning Engineer

Kaedim

London, England, United Kingdom (On-Site)
11 Months ago
Egnyte - Software Engineer - AI/ML

Egnyte

Mountain View, California, United States (Hybrid)
5 Months ago
bytedance - Research Scientist Graduate (Foundation Model - Generative AI) - 2025 Start (PhD)

bytedance

Seattle, Washington, United States (On-Site)
6 Months ago
PayPal - Senior Staff Machine Learning Scientist

PayPal

San Jose, California, United States (Hybrid)
3 Weeks ago
Sonar Source - ML Ops Engineer

Sonar Source

Bochum, North Rhine-Westphalia, Germany (On-Site)
3 Months ago
Capgemini - Kore.Ai Developer/Consultant/Lead/Architect

Capgemini

India (On-Site)
1 Month ago
DevRev - Applied AI Engineer

DevRev

Buenos Aires, Buenos Aires, Argentina (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

Taipei City, Taiwan (On-Site)

Beijing, Beijing, China (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug