Senior Software Product Manager, Nemo LLM Microservices

1 Month ago • 12 Years + • Product Management • $208,000 PA - $379,500 PA

Job Summary

Job Description

As a Senior Software Product Manager for Nemo LLM Microservices at NVIDIA, you'll lead the development and market launch of key software components enabling state-of-the-art accuracy and performance for neural networks. This includes defining product roadmaps, conducting market analysis, collaborating with engineering teams, and engaging directly with customers. You'll be responsible for creating microservices extending the reach of Nemo software to enterprises, researchers, and developers, focusing on data curation, model customization, and safety guardrails for Large Language Models (LLMs). The role involves building a strong value proposition, crafting marketing materials, and leading go-to-market strategies. Experience with LLMs, data curation, model fine-tuning, and safety mechanisms is highly valued.
Must have:
  • 12+ years technical product management experience
  • Passion for delivering software, libraries, and SDKs
  • Proven teamwork across teams, customers, and partners
  • Excellent communication skills (technical and non-technical audiences)
  • Define product roadmap and market strategy
  • Collaborate with engineering and marketing teams
Good to have:
  • MBA
  • Experience with Large Language Models (LLMs)
  • Data curation, training, or fine-tuning expertise
  • Experience with safety guardrails for LLM content generation

Job Details

Deep Learning is an exciting new area of machine learning. To bring AI to life, neural networks need to be trained and deployed with domain specific knowledge. Training and inference runs inside applications in the datacenter or at the edge, such as in automobiles, drones, medical devices, and more. Some of the common applications using NVIDIA deep learning software are image classification, object detection, recommendations, conversational virtual assistants, and reinforcement learning. NVIDIA is at the forefront helping advance the latest research and product improvements for everybody!

As the Nemo Microservices Software Product Manager for Large Language Models, you will lead key pieces of NVIDIA's portfolio of software that are enabling state of the art accuracy and performance for neural networks across data curation, model customization, and guard rails. Creating microservices will extend the reach of popular Nemo software used by Enterprises, researchers, and developers. You will engage with customers, define products and roadmaps, develop business strategy, devise market positioning, and take your products to market. The Product Management organization is a small, strong, and sought after group both inside and outside of NVIDIA as our team is passionate about deep learning use cases to drive the company's strategy. We need a self-starter to continue to grow this area and work with customers, who are helping define the future of AI.

What you'll be doing:

  • Define and Prove: Collect insights and build market analysis that provides the data to enter or change new markets through a clear value proposition for the product

  • Market intelligence: Understand the developers, partners, and competitors

  • Build and Deliver: Collaborate with engineering to promote the customer's needs through setting feature priorities across roadmaps

  • Sense and Respond: Work closely with customers, build surveys, present at conferences, understand product quality and supervise critical bugs

  • Marketing content creation: Work with marketing to define positioning that enables the creation of technical content, including blog posts, webinars, developer tutorials, and more to communicate the product value proposition

  • Product launches: Define the go-to-market strategy and provide guidance to the cross-functional implementation of the plan across marketing, public relations, and sales.

What we need to see:

  • BS or MS in Computer Science, Engineering, or other technical field (or equivalent experience). MBA is a plus.

  • 12+ years of technical product management, or similar, experience at a technology company

  • Passion for delivering software, libraries and SDKs

  • Proven track record of teamwork across teams, customers, and partners

  • Outstanding interpersonal and public communication skills with a shown ability to articulate a value proposition to technical and non-technical audiences

Ways to stand out from the crowd:

  • Experience working with Large Language Models, specifically with curating data, training or fine-tuning, and using guard rails for topical content generation, eliminating insecure generation requests, and helping guide safety content

N​VIDIA is widely considered one of the technology world’s most desirable employers. We have some of the world's most forward-thinking and hardworking people on our team. If you're creative and autonomous, we want to hear from you!

#LI-Hybrid

The base salary range is 208,000 USD - 379,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

ByteDance - Engineering Manager - Applied Machine Learning Algorithm

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Microsoft - Research Intern - Applied Sciences Group (Computer Vision)

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Playrix - Game Designer

Playrix

(Remote)
4 Months ago
Tencent - Research Intern

Tencent

Palo Alto, California, United States (On-Site)
2 Days ago
Intel Corporation - AI Frameworks Engineer

Intel Corporation

Ireland (Hybrid)
2 Months ago
Funko - Manager, Category Merchandising

Funko

Everett, Washington, United States (On-Site)
1 Month ago
Dream Games - Customer Support Specialist

Dream Games

İstanbul, Türkiye (On-Site)
6 Months ago
Unity - Auctioneer Product Manager

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Months ago
Warner Bros Discovery - Staff Technical Program Manager

Warner Bros Discovery

Ottawa, Ontario, Canada (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

G5 Games - 2D HOG Grind Artist (Hidden Objects Project)

G5 Games

Astana, Astana, Kazakhstan (Remote)
2 Weeks ago
Playrix - Game Designer

Playrix

Georgia (Remote)
4 Months ago
NVIDIA - Senior Compiler Engineer, Software - Deep Learning Accelerator

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Playrix - Feature Owner (LiveOps)

Playrix

Almaty, Almaty Region, Kazakhstan (Remote)
4 Months ago
Luxoft - Senior/Lead Machine Learning and Image Processing Specialist

Luxoft

Poland, Ohio, United States (Remote)
3 Months ago
Madison Logic - Sr. Data Scientist

Madison Logic

Pune, Maharashtra, India (On-Site)
3 Months ago
ByteDance - Machine Learning Engineer Intern (Global E-commerce Risk Control) - 2025 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
ZiMAD - Graphic Designer

ZiMAD

(Remote)
1 Day ago
NVIDIA - Senior AI Training Performance Engineer

NVIDIA

Shanghai, Shanghai, China (Hybrid)
1 Month ago
NXP - Test infrastructure developer intern

NXP

Roznov, Neamț County, Romania (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in California, United States

WebFX - Jr. Paid Social Media Marketing Specialist

WebFX

Harrisburg, Pennsylvania, United States (On-Site)
4 Months ago
The Walt Disney Company - Manager, Software Engineering(Scala)

The Walt Disney Company

New York, New York, United States (On-Site)
3 Months ago
VGW - Senior Animator

VGW

Colorado, United States (Remote)
3 Weeks ago
ION - FX Implementation Specialists

ION

Boston, Massachusetts, United States (On-Site)
4 Months ago
Next Level Business Services - .NET Developer (Full Time)

Next Level Business Services

Sammamish, Washington, United States (On-Site)
4 Months ago
Epic Games - Senior SDET, Gameplay

Epic Games

Bellevue, Washington, United States (On-Site)
3 Weeks ago
Microsoft - End-to-End Senior Scheduling Program Manager

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Nagarro - Senior Staff Consultant, Support

Nagarro

New York, New York, United States (On-Site)
4 Months ago
PlayStation Global - Gameplay Animator (Contract)

PlayStation Global

Los Angeles, California, United States (On-Site)
2 Months ago
ByteDance - Software Development Engineer - Large Language Models, AML

ByteDance

San Jose, California, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Product Management Jobs

Zynga - Director of Product - NaturalMotion Games

Zynga

London, England, United Kingdom (Hybrid)
2 Months ago
Saviynt - Sr. Director (Application Access Governance) -  Governance Risk & Compliance

Saviynt

El Segundo, California, United States (Hybrid)
4 Months ago
Logitech - Education Team Technical Project Manager

Logitech

Hsinchu City, Taiwan (Hybrid)
2 Months ago
Epic Games - Director, Product Management (Subscription + Pass Products)

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
ION - Senior Business Consultant - Endur

ION

Berlin, Berlin, Germany (On-Site)
4 Months ago
Luxoft - IT Business Analyst

Luxoft

New Delhi, Delhi, India (Remote)
2 Months ago
BigID - Senior Product Manager

BigID

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Fortis Games - Sr. Product Manager, Social and Multiplayer

Fortis Games

Canada (Remote)
3 Months ago
ComeOn Group - App Product Owner

ComeOn Group

England, United Kingdom (Hybrid)
1 Month ago
Meta - Product Manager, Machine Learning

Meta

Bellevue, Washington, United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Shenzhen, Guangdong Province, China (On-Site)

Bengaluru, Karnataka, India (On-Site)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Shanghai, Shanghai, China (On-Site)

Shanghai, Shanghai, China (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug