Director of Product - AI Training Platform Software

2 Months ago • 10-8 Years • Artificial Intelligence • $272,000 PA - $425,500 PA

Job Summary

Job Description

As Director of Product - AI Training Platform Software at NVIDIA, you'll define the product strategy and roadmap for AI training software, including LLM pre-training and post-training frameworks. This involves collaborating with leading AI researchers and developers, partnering with external framework developers (PyTorch, JAX), and working with product marketing to drive go-to-market plans. You'll lead a team of product managers and ensure optimized performance on GPUs. The role demands deep expertise in AI training frameworks, LLMs, and strong communication skills. You will be responsible for developing and executing the product vision, working closely with customers to shape the future of AI.
Must have:
  • Develop product strategy and roadmap
  • Collaborate with AI researchers and developers
  • Partner with external framework developers
  • Lead a team of product managers
  • Deep expertise in AI training frameworks and LLMs
  • Strong communication skills
  • BS/MS in Computer Science or related field
  • 10+ years of technical product management experience
Good to have:
  • Experience building LLM foundational models
  • Familiarity with LLM training frameworks (Megatron Core, NeMo)
  • Deep expertise with PyTorch/Inductor, JAX/XLA, OpenAI Triton
  • Understanding of deep learning model algorithms
  • Knowledge of GPU architecture and performance profiling
Perks:
  • Equity
  • Benefits

Job Details

To bring AI to life, neural networks need to be trained at scale. Some of the popular AI models trained using NVIDIA platform are LLMs, Generative AI, Recommenders, Conversational virtual assistants. NVIDIA is at the forefront helping advance the latest research and product improvements for everybody! 

As a Director of Product - AI Training Platform Software, you will define product strategy and roadmap for NVIDIA's AI training softwares, including LLM pre-training and post-training frameworks. You will be partnering with the external framework developers such as PyTorch, JAX and related compilers and libraries to enable great user experience with optimized performance on GPUs. The Product Management organization is a strong, and sought after group both inside and outside of NVIDIA as our team is passionate about deep learning use cases to drive the company's strategy. We need a strong leader to continue to grow this area and work with customers, who are helping define the future of AI. We're looking for the rare blend of both technical and product skills and passion about groundbreaking technology. If this fits, we would love to learn more about you!

What You'll be Doing:

  • Develop product strategy and roadmap 

  • Work with the industry's leading AI researchers and developers to envision and develop the next generation of AI training framework

  • Partner with product marketing and campaign teams to drive go to market plan

  • Lead a strong team of product managers working in cross-functional areas to coordinate the overall product vision

What We Need to See:

  • BS or MS degree in Computer Science, Computer Engineering, or similar field or equivalent experience

  • 10+ overall nyears of technical product management, or similar, experience at a technology company

  • 5+ years of management experience

  • Deep expertise and work experience in AI training frameworks and LLMs

  • Strong communication and interpersonal skills

  • Ability to work physically at NVIDIA's Santa Clara headquarters and travel on occasion for partner meetings and events

Ways to Stand Out from the Crowd:

  • Experience building LLM foundational model and applying post-training techniques such as reinforcement learning.

  • Familiarity with LLM training framework such as Megatron Core, NeMo, PAXML, MaxText 

  • Deep expertise and work experience with PyTorch/Inductor, JAX/XLA and OpenAI Triton

  • Understanding of the state of the art deep learning model algorithms

  • Knowledge of GPU architecture, HW/SW co-design and performance profiling

The base salary range is 272,000 USD - 425,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Canva - Senior Computer Vision Engineer - Photo AI

Canva

Vienna, Vienna, Austria (Remote)
2 Months ago
NVIDIA - Software Configuration Management Engineer – Hardware

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Sabre India - OPERATIONS RESEARCH SCIENTIST – Revenue Management

Sabre India

(Remote)
1 Month ago
Qualcomm - Staff Engineer - AI Orchestration

Qualcomm

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
Qualcomm - Engineer - AI Orchestration

Qualcomm

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
Google - Software Engineer III, Machine Learning, Search

Google

Seattle, Washington, United States (On-Site)
6 Months ago
Google - Senior Software Engineer, Machine Learning, Cloud AI

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Google - Product Manager, Activity and Sleep Coaching

Google

Mountain View, California, United States (On-Site)
1 Month ago
ByteDance - Machine Learning Scientist Graduate (Scaling AI for Biology (AI-for-Science))

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
ByteDance - Research Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

San Jose, California, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Playrix - Game Director

Playrix

Serbia (Remote)
7 Months ago
Match Group - Sr. Software Engineer, Generative AI

Match Group

Palo Alto, California, United States (Hybrid)
7 Months ago
Google - Research Manager, Neural Rendering, Project Starline

Google

Seattle, Washington, United States (On-Site)
1 Month ago
NVIDIA - Deep Learning Intern - Fall 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Month ago
Excel Hr solutions - Senior Data Scientist

Excel Hr solutions

(Remote)
1 Year ago
Belka Games - Lead Artist (RnD)

Belka Games

(Remote)
1 Month ago
Grab - Senior Data Scientist (Integrity)

Grab

Bengaluru, Karnataka, India (On-Site)
1 Month ago
NVIDIA - Design Engineer, Coherent High Speed Interconnect

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
ByteDance - Software Engineer, Inference

ByteDance

San Jose, California, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Canada

Boomi - Business Intelligence Advisor

Boomi

Vancouver, British Columbia, Canada (Hybrid)
1 Month ago
ICON Creative Studio - Lead Modeling/Texturing Artist

ICON Creative Studio

Vancouver, British Columbia, Canada (On-Site)
4 Months ago
Track vfx - Vancouver | Matchmove | Lead

Track vfx

Vancouver, British Columbia, Canada (On-Site)
8 Months ago
Larian Studios - Technical QA Tester Internship

Larian Studios

Quebec, Canada (On-Site)
1 Month ago
Epic Games - QA Programming Specialist

Epic Games

Montreal, Quebec, Canada (On-Site)
3 Months ago
Unity - Senior Graphics Manager, SRP

Unity

Montreal, Quebec, Canada (On-Site)
1 Month ago
Epic Games - Senior Technical Product Manager, Identity

Epic Games

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
Critical mass - Freelance UX Copywriter

Critical mass

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
ION - Technical Support Analyst, Toronto - 4363

ION

Toronto, Ontario, Canada (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Canva - GenAI Research Engineering Manager - Image Generation (m/f/x) - Canva Austria

Canva

Vienna, Vienna, Austria (Remote)
6 Months ago
NVIDIA - Research Scientist, Deep Learning and Computer Vision

NVIDIA

Taipei City, Taiwan (On-Site)
4 Months ago
Google - Senior ML Systems Engineer, AICore

Google

Taipei City, Taiwan (On-Site)
1 Month ago
ByteDance - Researcher - Large Language Models, Applied Machine Learning

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
Google - Software Engineer, Compiler, Scheduling and Optimization, Silicon

Google

Bellevue, Washington, United States (On-Site)
1 Month ago
Henkel - Data Scientist-Intern

Henkel

Pune, Maharashtra, India (On-Site)
8 Months ago
Inworld AI - Product Manager (Technical)

Inworld AI

Mountain View, California, United States (On-Site)
2 Months ago
Google - Senior Software Engineer, Distributed Machine Learning

Google

Mountain View, California, United States (On-Site)
1 Month ago
SmileGate - AI Reinforcement Learning and Prediction Model Development

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
1 Month ago
Microsoft - Senior Data Scientist

Microsoft

(On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

Taipei City, Taiwan (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug