Senior System Software Engineer - AI Performance and Efficiency Tools

1 Month ago • 5 Years + • Research & Development • $184,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior System Software Engineer to develop and maintain profiling, analysis, and debugging tools for AI workloads on GPU clusters. Responsibilities include building tools for large-scale AI workloads, addressing memory/networking issues, creating benchmarking and simulation technologies, and collaborating with hardware architects. The ideal candidate possesses strong software development skills (C++, Python), deep learning framework knowledge (PyTorch, TensorFlow), expertise in GPU cluster scheduling (Slurm/Kubernetes), and experience with NVIDIA GPUs, CUDA, and NCCL. The role requires excellent problem-solving and communication skills and involves working with multiple global teams.
Must have:
  • 5+ years software development experience
  • Strong C++ and Python skills
  • Deep Learning framework knowledge
  • GPU cluster scheduling experience
  • NVIDIA GPU, CUDA, and NCCL expertise
Good to have:
  • Experience with continuous profiling tools
  • Knowledge of Linux device drivers
  • GPU/CPU architecture knowledge
Perks:
  • Equity
  • Benefits

Job Details

A key part of NVIDIA's strength is our sophisticated analysis / debugging tools that empower NVIDIA engineers to improve perf and power efficiency of our products and the running applications. We are looking for forward-thinking, hard-working, and creative people to join a multifaceted software team with high standards! This software engineering role involves developing tools for AI researchers and SW/HW teams running AI workload in GPU cluster.

As a member of the software development team, we will work with users from different departments like Architecture teams, Software teams. Our work brings the users intuitive, rich and accurate insight in the workload and the system, and empower them to find opportunities in software and hardware, build high level models to propose and deliver the best hardware and software to our customers, or debugging tricky failures and issues to help improve the performance and efficiency of the system.

What you’ll be doing:

  • Build internal profiling and analysis tools for AI workloads at large scale

  • Build debugging tools for common encountered problems like memory or networking

  • Create benchmarking and simulation technologies for AI system or GPU cluster

  • Partner with HW architects to propose new features or improve existing features with real world use cases

What we need to see:

  • BS+ in Computer Science or related (or equivalent experience) and 5+ years of software development

  • Strong software skills in design, coding (C++ and Python), analytical, and debugging

  • Good understanding of Deep Learning frameworks like PyTorch and TensorFlow, distributed training and inference.

  • Knowledge of GPU cluster job scheduling (Slurm or Kubernetes), storage and networking

  • Experience with NVIDIA GPUs, CUDA Programming and NCCL

  • Motivated self-starter with strong problem-solving skills and customer-facing communication skills

  • Passion for continuous learning. Ability to work concurrently with multiple global groups

Ways to stand out from the crowd:

  • Proven experience in GPU cluster scale continuous profiling & analysis tools/platforms

  • Solid experience in large AI job performance analysis for training/inference workload

  • Knowledge of Linux device drivers and/or compiler implementation

  • Knowledge of GPU and/or CPU architecture and general computer architecture principles

#LI-Hybrid

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

ByteDance - Senior Machine Learning Engineer

ByteDance

San Jose, California, United States (On-Site)
4 Weeks ago
Corsair - Senior Manager, AI & Data

Corsair

Munich, Bavaria, Germany (On-Site)
1 Month ago
Seedify - AI Product Manager

Seedify

London, England, United Kingdom (Remote)
3 Months ago
Vigaet - Internship -AI Agents

Vigaet

(Remote)
5 Months ago
ByteDance - Research Scientist, Reinforcement Learning

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
NVIDIA - Software Engineering Intern, Autonomous Vehicles (RDSS)

NVIDIA

Taipei City, Taiwan (On-Site)
3 Months ago
Krafton  - Yeoksam Office Help Desk Representative

Krafton

Seoul, South Korea (On-Site)
4 Weeks ago
Google - Product Design Engineer, High-Speed Cable

Google

Sunnyvale, California, United States (On-Site)
6 Days ago
NVIDIA - Senior Software Architect, Accelerated Computing SDN

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Google - Signal and Power Integrity Engineer

Google

Mountain View, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Tech Lead Machine Learning Engineer

ByteDance

Seattle, Washington, United States (On-Site)
4 Weeks ago
Netflix - Full Stack Engineer (L5)

Netflix

United States (Remote)
1 Week ago
ByteDance - Research Scientist, Foundation Model, Speech & Audio

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Research Engineer Graduate (Machine Learning Sys-US) - 2024 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Research Scientist in Machine Learning for Science (AML - AI-for-Science) - 2024 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
N-iX - Senior Data Scientist (#2665)

N-iX

Ukraine (Remote)
3 Months ago
Google - Customer Engineer, AI Infrastructure

Google

Seattle, Washington, United States (On-Site)
1 Week ago
Google - Software Engineer III, Machine Learning, Search

Google

Mountain View, California, United States (On-Site)
5 Months ago
NVIDIA - Senior Solutions Architect, Generative AI

NVIDIA

Mumbai, Maharashtra, India (On-Site)
1 Month ago
ByteDance - AI Security Researcher - Security - San Jose

ByteDance

San Jose, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Canada

NVIDIA - Senior Cost Analyst

NVIDIA

Canada (On-Site)
1 Week ago
Keywords Studios - LQA Senior Tester

Keywords Studios

Montréal, Québec, Canada (On-Site)
1 Week ago
Ubisoft - Senior Rigger

Ubisoft

Montreal, Quebec, Canada (Hybrid)
4 Weeks ago
DNEG - Storyboard Supervisor

DNEG

Quebec, Canada (On-Site)
1 Week ago
NVIDIA - Hardware Validation Engineer

NVIDIA

Canada (On-Site)
1 Month ago
Scanline VFX - Digital Matte Painter

Scanline VFX

Montreal, Quebec, Canada (Hybrid)
3 Months ago
Rockstar Games - Technical Artist: Shotgrid Development Support

Rockstar Games

Oakville, Ontario, Canada (On-Site)
3 Weeks ago
Bally's Interactive - Accountant - Indirect Costs

Bally's Interactive

Toronto, Ontario, Canada (On-Site)
1 Week ago
Ubisoft - Machine Learning Programmer (Character & Animation)

Ubisoft

Montreal, Quebec, Canada (On-Site)
1 Month ago
Amber - Localization Quality Assurance with Danish

Amber

Montreal, Quebec, Canada (Hybrid)
9 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Google - Senior Software Engineer, Performance Modeling

Google

Raleigh, North Carolina, United States (On-Site)
1 Week ago
Tesla - Bachelor/Master Thesis: Research and Development in Laser Technology

Tesla

Prüm, Rhineland-Palatinate, Germany (On-Site)
2 Months ago
Google - CPU Hardware Emulation Engineer

Google

Haifa, Haifa District, Israel (On-Site)
6 Days ago
Tesla - Algorithms Engineer, Autobidder (Electricity Markets/Energy Trading)

Tesla

London, England, United Kingdom (On-Site)
2 Months ago
Google - Senior SoC Power Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Days ago
Krafton  - Creative Lead of Creative Project Management Team

Krafton

Seoul, South Korea (On-Site)
3 Weeks ago
Google - Staff Software Engineer, AI/ML GenAI, Google Ads

Google

Mountain View, California, United States (On-Site)
1 Week ago
Google - Audio Research Scientist

Google

Mountain View, California, United States (On-Site)
1 Week ago
Tencent - Research Intern

Tencent

Tokyo, Japan (On-Site)
1 Week ago
ByteDance - Machine Learning Engineer - Machine Learning Infrastructure

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug