Senior System Software Engineer - AI Performance and Efficiency Tools

1 Month ago • 5 Years + • Research & Development • $184,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior System Software Engineer to develop and enhance performance analysis and debugging tools for AI workloads within GPU clusters. Responsibilities include building profiling and analysis tools for large-scale AI applications, creating debugging tools for memory and networking issues, developing benchmarking and simulation technologies for AI systems and GPU clusters, and collaborating with hardware architects to improve existing features. This role requires strong software development skills (C++ and Python), deep learning framework knowledge (PyTorch and TensorFlow), and experience with GPU cluster job scheduling (Slurm or Kubernetes). The ideal candidate will possess strong problem-solving skills, excellent communication abilities, and a passion for continuous learning.
Must have:
  • 5+ years software development experience
  • Strong C++ and Python skills
  • Deep learning framework knowledge (PyTorch, TensorFlow)
  • GPU cluster scheduling experience (Slurm or Kubernetes)
  • NVIDIA GPU, CUDA, and NCCL experience
Good to have:
  • Experience with continuous profiling tools
  • AI job performance analysis expertise
  • Linux device driver or compiler knowledge
  • GPU/CPU architecture understanding
Perks:
  • Equity
  • Benefits

Job Details

A key part of NVIDIA's strength is our sophisticated analysis / debugging tools that empower NVIDIA engineers to improve perf and power efficiency of our products and the running applications. We are looking for forward-thinking, hard-working, and creative people to join a multifaceted software team with high standards! This software engineering role involves developing tools for AI researchers and SW/HW teams running AI workload in GPU cluster.

As a member of the software development team, we will work with users from different departments like Architecture teams, Software teams. Our work brings the users intuitive, rich and accurate insight in the workload and the system, and empower them to find opportunities in software and hardware, build high level models to propose and deliver the best hardware and software to our customers, or debugging tricky failures and issues to help improve the performance and efficiency of the system.

What you’ll be doing:

  • Build internal profiling and analysis tools for AI workloads at large scale

  • Build debugging tools for common encountered problems like memory or networking

  • Create benchmarking and simulation technologies for AI system or GPU cluster

  • Partner with HW architects to propose new features or improve existing features with real world use cases

What we need to see:

  • BS+ in Computer Science or related (or equivalent experience) and 5+ years of software development

  • Strong software skills in design, coding (C++ and Python), analytical, and debugging

  • Good understanding of Deep Learning frameworks like PyTorch and TensorFlow, distributed training and inference.

  • Knowledge of GPU cluster job scheduling (Slurm or Kubernetes), storage and networking

  • Experience with NVIDIA GPUs, CUDA Programming and NCCL

  • Motivated self-starter with strong problem-solving skills and customer-facing communication skills

  • Passion for continuous learning. Ability to work concurrently with multiple global groups

Ways to stand out from the crowd:

  • Proven experience in GPU cluster scale continuous profiling & analysis tools/platforms

  • Solid experience in large AI job performance analysis for training/inference workload

  • Knowledge of Linux device drivers and/or compiler implementation

  • Knowledge of GPU and/or CPU architecture and general computer architecture principles

#LI-Hybrid

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

PwC - Senior Data Scientist

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
6 Months ago
Resemble AI - Deep Learning Speech Researcher

Resemble AI

Mountain View, California, United States (On-Site)
8 Months ago
Orion Innovation - Data Engineer-AI,ML

Orion Innovation

Chennai, Tamil Nadu, India (On-Site)
5 Months ago
Vigaet - Machine Learning Engineer-Internship

Vigaet

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Granicus - Data Scientist 4

Granicus

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Fluence - Sr. Software Architect (m/f/d)

Fluence

Berlin, Berlin, Germany (On-Site)
5 Months ago
NVIDIA - DFT Engineer

NVIDIA

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
NVIDIA - Mixed Signal Design Engineer

NVIDIA

Canada (On-Site)
1 Month ago
NVIDIA - Senior Chip Design Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
ByteDance - PLL (Phase-Locked Loop) Analog/Mixed Signal Designer

ByteDance

San Diego, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Software Engineer in ML Engineering Platform

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
ByteDance - Engineering Manager Machine Learning Infrastructure

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
CloudHire - Software Engineer, Backend

CloudHire

India (Remote)
3 Weeks ago
ByteDance - Research Scientist, Foundation Model, Music Intelligence

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
PwC - ETIC, Business Intelligence Engineer, Manager

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
5 Months ago
Ubisoft - Scientifique principal en données ML _ Groupe Technologique Content Creation

Ubisoft

Montreal, Quebec, Canada (On-Site)
3 Months ago
Netflix - Research Scientist (L6) - Identity Algorithms

Netflix

Los Gatos, California, United States (On-Site)
5 Months ago
Eightfold - Lead Engineer- Backend

Eightfold

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
NVIDIA - Senior Solutions Architect, Generative AI

NVIDIA

Mumbai, Maharashtra, India (On-Site)
2 Weeks ago
Linden Lab - Senior Software Engineer, Mobile

Linden Lab

San Francisco, California, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

Sports radar - Synergy Sports Showcase Softball/Baseball Video Scouts

Sports radar

Florida, New York, United States (On-Site)
5 Months ago
Genies - Lead Machine Learning Engineer, 3D Gen AI & Graphics

Genies

San Mateo, California, United States (On-Site)
2 Weeks ago
PlayStation Global - Lead Tech Artist

PlayStation Global

United States (Remote)
2 Months ago
GoMotive - Account Executive, Enterprise - Mid-Atlantic

GoMotive

United States (Remote)
3 Weeks ago
ION - Senior Technical Consultant - Endur

ION

Jersey City, New Jersey, United States (On-Site)
6 Months ago
Kokotree - Character and Background Designers

Kokotree

Wilmington, North Carolina, United States (On-Site)
5 Months ago
Ripple Effect  - Live Operations Lead

Ripple Effect

Los Angeles, California, United States (Hybrid)
1 Week ago
Varonis  - Senior Legal Counsel

Varonis

Morrisville, North Carolina, United States (On-Site)
4 Months ago
PENN Interactive - Technical Project Manager

PENN Interactive

Philadelphia, Pennsylvania, United States (Hybrid)
4 Months ago
IGN - Lead Product Manager

IGN

New York, New York, United States (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

ByteDance - Backend Engineer, Ark Large Model Platform - 2025 Start

ByteDance

Singapore (On-Site)
5 Months ago
NVIDIA - Senior Chip Design Verification Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
NVIDIA - Hardware Application Engineer, Ethernet Switch

NVIDIA

Shanghai, Shanghai, China (Hybrid)
2 Months ago
Hashlist - ADAS Feature Architect

Hashlist

Pune, Maharashtra, India (Hybrid)
6 Months ago
Tesla - Senior Mechanical Design Engineer - Motors

Tesla

Athens, Greece (On-Site)
2 Months ago
ByteDance - Senior Technical Lead - Edge Cloud Infrastructure - San Jose / Seattle / Boston

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Google - Student Researcher, BS/MS, Winter/Summer 2025

Google

Mountain View, California, United States (On-Site)
5 Months ago
NVIDIA - Senior Signal and Power Integrity Engineer

NVIDIA

Toronto, Ontario, Canada (On-Site)
2 Months ago
Tesla - Mechanical Design Engineer - Seating

Tesla

Berlin, Berlin, Germany (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Santa Clara, California, United States (On-Site)

Texas, United States (Remote)

Santa Clara, California, United States (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

United Kingdom (Remote)

Yokne'am Illit, North District, Israel (On-Site)

Bengaluru, Karnataka, India (Hybrid)

Toronto, Ontario, Canada (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug