Senior System Software Engineer - AI Performance and Efficiency Tools

1 Month ago • 5 Years + • Research & Development • $184,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior System Software Engineer to develop and maintain profiling, analysis, and debugging tools for AI workloads on GPU clusters. Responsibilities include building tools for large-scale AI workloads, addressing memory/networking issues, creating benchmarking and simulation technologies, and collaborating with hardware architects. The ideal candidate possesses strong software development skills (C++, Python), deep learning framework knowledge (PyTorch, TensorFlow), expertise in GPU cluster scheduling (Slurm/Kubernetes), and experience with NVIDIA GPUs, CUDA, and NCCL. The role requires excellent problem-solving and communication skills and involves working with multiple global teams.
Must have:
  • 5+ years software development experience
  • Strong C++ and Python skills
  • Deep Learning framework knowledge
  • GPU cluster scheduling experience
  • NVIDIA GPU, CUDA, and NCCL expertise
Good to have:
  • Experience with continuous profiling tools
  • Knowledge of Linux device drivers
  • GPU/CPU architecture knowledge
Perks:
  • Equity
  • Benefits

Job Details

A key part of NVIDIA's strength is our sophisticated analysis / debugging tools that empower NVIDIA engineers to improve perf and power efficiency of our products and the running applications. We are looking for forward-thinking, hard-working, and creative people to join a multifaceted software team with high standards! This software engineering role involves developing tools for AI researchers and SW/HW teams running AI workload in GPU cluster.

As a member of the software development team, we will work with users from different departments like Architecture teams, Software teams. Our work brings the users intuitive, rich and accurate insight in the workload and the system, and empower them to find opportunities in software and hardware, build high level models to propose and deliver the best hardware and software to our customers, or debugging tricky failures and issues to help improve the performance and efficiency of the system.

What you’ll be doing:

  • Build internal profiling and analysis tools for AI workloads at large scale

  • Build debugging tools for common encountered problems like memory or networking

  • Create benchmarking and simulation technologies for AI system or GPU cluster

  • Partner with HW architects to propose new features or improve existing features with real world use cases

What we need to see:

  • BS+ in Computer Science or related (or equivalent experience) and 5+ years of software development

  • Strong software skills in design, coding (C++ and Python), analytical, and debugging

  • Good understanding of Deep Learning frameworks like PyTorch and TensorFlow, distributed training and inference.

  • Knowledge of GPU cluster job scheduling (Slurm or Kubernetes), storage and networking

  • Experience with NVIDIA GPUs, CUDA Programming and NCCL

  • Motivated self-starter with strong problem-solving skills and customer-facing communication skills

  • Passion for continuous learning. Ability to work concurrently with multiple global groups

Ways to stand out from the crowd:

  • Proven experience in GPU cluster scale continuous profiling & analysis tools/platforms

  • Solid experience in large AI job performance analysis for training/inference workload

  • Knowledge of Linux device drivers and/or compiler implementation

  • Knowledge of GPU and/or CPU architecture and general computer architecture principles

#LI-Hybrid

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Every matrix - Experienced CRM Data Scientist

Every matrix

London, England, United Kingdom (Hybrid)
1 Month ago
Bohemia Interactive - Python Programmer

Bohemia Interactive

Brno, South Moravian Region, Czechia (On-Site)
1 Week ago
Google - Machine Learning Algorithm Engineer, Silicon

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
NVIDIA - Principal Engineer

NVIDIA

(Remote)
2 Months ago
The Walt Disney Company - Sr Machine Learning Engineer

The Walt Disney Company

Santa Monica, California, United States (On-Site)
5 Months ago
Google - CPU Design for Test Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Days ago
NXP - Senior Principal Software Architect - Platform and RF Software

NXP

Bucharest, Bucharest, Romania (On-Site)
7 Months ago
NVIDIA - Software Engineering Intern, Autonomous Vehicles (RDSS)

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
NVIDIA - Senior Chip Design Engineer, Formal Verification

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
NVIDIA - Senior Firmware Bringup Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Customer Engineer II, AI/ML, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Google - Cloud Engineer II, AI/ML, Professional Services

Google

Mexico City, Mexico City, Mexico (On-Site)
2 Weeks ago
Krafton  - Deep Learning Engineer - Model Optimization

Krafton

Seoul, South Korea (On-Site)
2 Weeks ago
PwC - IN-Senior Associate_ML Engineer_Data &Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Google - Senior Software Engineer, Machine Learning, YouTube

Google

Mountain View, California, United States (On-Site)
5 Months ago
Netflix - ML Software Engineer (L4/L5) - Media Algorithms

Netflix

Los Angeles, California, United States (On-Site)
2 Weeks ago
ByteDance - Senior Research Scientist, Foundation Model, Speech Understanding

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Netflix - Machine Learning Software Engineer L4/L5

Netflix

United States (Remote)
3 Months ago
Alphasense - Join AlphaSense India Talent Community

Alphasense

Delhi, India (On-Site)
6 Hours ago
NVIDIA - Senior Compiler Engineer – Deep Learning

NVIDIA

Redmond, Washington, United States (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Canada

Inworld AI - Senior Software Development Engineer in Test (SDET) – Game Engine SDKs - Canada

Inworld AI

Vancouver, British Columbia, Canada (On-Site)
6 Months ago
Google - Senior Data Scientist, Research, Chrome

Google

Waterloo, Ontario, Canada (On-Site)
2 Weeks ago
Epic Games - Gameplay Systems Programmer, Fortnite

Epic Games

Canada (On-Site)
2 Weeks ago
Electronic Arts - Technical Artist - User Interface

Electronic Arts

Vancouver, British Columbia, Canada (On-Site)
3 Months ago
Evolution - Customer Service - Korean Speaking Online Game Show Host

Evolution

Burnaby, British Columbia, Canada (On-Site)
1 Month ago
Epic Games - UI Programming Director

Epic Games

Montreal, Quebec, Canada (On-Site)
2 Months ago
Kabam - Technical Director

Kabam

Vancouver, British Columbia, Canada (Hybrid)
1 Month ago
Frima - Finance and Administration Director

Frima

Québec City, Quebec, Canada (On-Site)
1 Week ago
Resolver - Director, Customer Service

Resolver

Toronto, Ontario, Canada (Hybrid)
1 Month ago
Epic Games - Senior QA Engineer

Epic Games

Vancouver, British Columbia, Canada (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - CSP Hardware Application Engineer

NVIDIA

Shenzhen, Guangdong Province, China (On-Site)
2 Months ago
Google - Staff CPU RTL Design Engineer

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Days ago
Equivalent Jobs - SENIOR С++ SOFTWARE ENGINEER

Equivalent Jobs

(Remote)
5 Months ago
Niantic - 2025 R&D Software Engineering Intern (PhD, Publishing)

Niantic

London, England, United Kingdom (Hybrid)
5 Months ago
Corsair - Senior Hardware Development Engineer

Corsair

Taipei City, Taiwan (On-Site)
2 Weeks ago
Google - Senior Staff Software Engineer, Google Cloud

Google

Pune, Maharashtra, India (On-Site)
2 Weeks ago
Google - Software Developer, Ads Bidding Optimization

Google

New York, New York, United States (On-Site)
2 Days ago
Assystems - Design Engineer – Substation (Civil & Structural)

Assystems

Gurugram, Haryana, India (On-Site)
6 Months ago
ByteDance - Software Engineer, Model Inference

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug