Senior System Software Engineer - AI Performance and Efficiency Tools

2 Months ago • 5 Years + • Research & Development • $184,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior System Software Engineer to develop and enhance performance analysis and debugging tools for AI workloads within GPU clusters. Responsibilities include building profiling and analysis tools for large-scale AI applications, creating debugging tools for memory and networking issues, developing benchmarking and simulation technologies for AI systems and GPU clusters, and collaborating with hardware architects to improve existing features. This role requires strong software development skills (C++ and Python), deep learning framework knowledge (PyTorch and TensorFlow), and experience with GPU cluster job scheduling (Slurm or Kubernetes). The ideal candidate will possess strong problem-solving skills, excellent communication abilities, and a passion for continuous learning.
Must have:
  • 5+ years software development experience
  • Strong C++ and Python skills
  • Deep learning framework knowledge (PyTorch, TensorFlow)
  • GPU cluster scheduling experience (Slurm or Kubernetes)
  • NVIDIA GPU, CUDA, and NCCL experience
Good to have:
  • Experience with continuous profiling tools
  • AI job performance analysis expertise
  • Linux device driver or compiler knowledge
  • GPU/CPU architecture understanding
Perks:
  • Equity
  • Benefits

Job Details

A key part of NVIDIA's strength is our sophisticated analysis / debugging tools that empower NVIDIA engineers to improve perf and power efficiency of our products and the running applications. We are looking for forward-thinking, hard-working, and creative people to join a multifaceted software team with high standards! This software engineering role involves developing tools for AI researchers and SW/HW teams running AI workload in GPU cluster.

As a member of the software development team, we will work with users from different departments like Architecture teams, Software teams. Our work brings the users intuitive, rich and accurate insight in the workload and the system, and empower them to find opportunities in software and hardware, build high level models to propose and deliver the best hardware and software to our customers, or debugging tricky failures and issues to help improve the performance and efficiency of the system.

What you’ll be doing:

  • Build internal profiling and analysis tools for AI workloads at large scale

  • Build debugging tools for common encountered problems like memory or networking

  • Create benchmarking and simulation technologies for AI system or GPU cluster

  • Partner with HW architects to propose new features or improve existing features with real world use cases

What we need to see:

  • BS+ in Computer Science or related (or equivalent experience) and 5+ years of software development

  • Strong software skills in design, coding (C++ and Python), analytical, and debugging

  • Good understanding of Deep Learning frameworks like PyTorch and TensorFlow, distributed training and inference.

  • Knowledge of GPU cluster job scheduling (Slurm or Kubernetes), storage and networking

  • Experience with NVIDIA GPUs, CUDA Programming and NCCL

  • Motivated self-starter with strong problem-solving skills and customer-facing communication skills

  • Passion for continuous learning. Ability to work concurrently with multiple global groups

Ways to stand out from the crowd:

  • Proven experience in GPU cluster scale continuous profiling & analysis tools/platforms

  • Solid experience in large AI job performance analysis for training/inference workload

  • Knowledge of Linux device drivers and/or compiler implementation

  • Knowledge of GPU and/or CPU architecture and general computer architecture principles

#LI-Hybrid

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

ByteDance - Machine Learning Engineer Graduate (AML Algorithm) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
7 Months ago
Paypay - Data Scientist (Financial Business Area)

Paypay

(Remote)
1 Month ago
Google - Customer Engineer II, Cloud AI, Google Cloud

Google

San Francisco, California, United States (On-Site)
1 Month ago
Vigaet - Internship -AI Agents

Vigaet

(Remote)
7 Months ago
NVIDIA - Senior DFT Verification Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Months ago
NVIDIA - Physical Design Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Google - Compiler Engineering Manager, Silicon

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Ubisoft - Lead R&D Scientist

Ubisoft

Shanghai, Shanghai, China (On-Site)
2 Months ago
Krafton  - PUBG IP Franchise China Business PM/Marketing (3 years or less / Contract)

Krafton

Seoul, South Korea (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Scale AI - SEAL Research Scientist, Agent Robustness

Scale AI

San Francisco, California, United States (On-Site)
1 Month ago
NVIDIA - Senior Software QA Test Development Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Demandbase - Data Science / Machine Learning Engineer Intern

Demandbase

(Remote)
1 Month ago
Canva - Senior Computer Vision Engineer - Photo AI

Canva

Vienna, Vienna, Austria (Remote)
2 Months ago
ByteDance - Research Engineer - Multimodal Model

ByteDance

Singapore (On-Site)
7 Months ago
ByteDance - Lead Research Scientist, Foundation Model, Music Intelligence

ByteDance

San Jose, California, United States (On-Site)
7 Months ago
sony global (Games) - Software Design Engineer

sony global (Games)

Wuxi, Jiangsu, China (On-Site)
1 Month ago
Canva - Senior Machine Learning Engineer - Specialist Platform and Experience

Canva

Melbourne, Victoria, Australia (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

Polygon Labs - Governance Program Manager

Polygon Labs

United States (Remote)
2 Months ago
INTEL - Facilities Mechanical Engineer (HVAC)

INTEL

Santa Clara, California, United States (Hybrid)
1 Month ago
Exploding Kittens,  Inc  - Senior Paid Social Manager

Exploding Kittens, Inc

Los Angeles, California, United States (Hybrid)
5 Months ago
Apple - Specialist

Apple

United States (On-Site)
1 Month ago
On Location - Senior Accountant - Olympics

On Location

Atlanta, Georgia, United States (On-Site)
4 Months ago
Santa Monica Studio - Sr Concept Artist (Characters)

Santa Monica Studio

California, United States (On-Site)
10 Months ago
Valve corporation - Economist

Valve corporation

Bellevue, Washington, United States (On-Site)
6 Months ago
Dun & Bradstreet - 2025 Summer Internship Program - Technology

Dun & Bradstreet

Jacksonville, Florida, United States (On-Site)
7 Months ago
ByteDance - Software Engineer Graduate (RDMA Network - High Speed Network)

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
ByteDance - Senior Software Engineer - Development Infrastructure Team

ByteDance

Mountain View, California, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Google - Software Engineer, Android and Chrome OS

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Month ago
ByteDance - NLP Engineer Intern - 2025 Start

ByteDance

Singapore (On-Site)
7 Months ago
Riot Games - Manager, Data Science - League Studio, League Data Central

Riot Games

Los Angeles, California, United States (On-Site)
6 Months ago
NVIDIA - Senior DFT Verification Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Microsoft - Critical Environment Energy Marshall

Microsoft

Busan, Busan, South Korea (On-Site)
1 Month ago
Corsair - Senior Software Embedded Architect

Corsair

Landshut, Bavaria, Germany (On-Site)
2 Months ago
Google - Research Scientist, Paradigms of Intelligence

Google

Zürich, Zurich, Switzerland (On-Site)
1 Month ago
Google - CPU System Software Engineer, Performance Architect

Google

Austin, Texas, United States (On-Site)
1 Month ago
Virtuos - Junior Software Engineer

Virtuos

Malaysia (On-Site)
1 Month ago
Google - Senior ASIC Design Verification Engineer, TPU Compute

Google

Sunnyvale, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

Taipei City, Taiwan (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug