Senior AI Cluster Tools Developer

3 Months ago • 5 Years + • Research & Development • $148,000 PA - $287,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior AI Cluster Tools Developer to build and maintain internal performance/power profiling and analysis tools for AI workloads at a cluster scale. This role involves developing debugging tools for common GPU cluster problems, collaborating with users to build performance/power models for next-generation hardware, and partnering with architects to propose new hardware features. Responsibilities include working with various departments, creating intuitive tools for workload and system insight, and improving system stability. The ideal candidate possesses strong software design skills in Python/Go/C++, understands deep learning frameworks (PyTorch, TensorFlow), and has knowledge of AI cluster management (scheduling, storage, networking). Experience with Linux kernel and excellent problem-solving abilities are essential.
Must have:
  • 5+ years software development experience
  • Strong Python/Go/C++ skills
  • Deep Learning framework knowledge
  • AI cluster management knowledge
  • Linux kernel knowledge
  • Excellent problem-solving skills
Good to have:
  • GPU cluster profiling experience
  • Large AI job troubleshooting experience
  • Deep Learning application optimization
  • GPU/CPU architecture knowledge
Perks:
  • Competitive salary
  • Comprehensive benefits package
  • Equity

Job Details

A key part of NVIDIA's strength is our sophisticated analysis / debugging tools that empower NVIDIA engineers to improve perf and power efficiency of our products and the running applications. We are looking for forward-thinking, hard-working, and creative people to join a multifaceted software team with high standards! This software engineering role involves developing tools for GPU Cluster users and admins.

As a member of the software development team, we will work with users from different departments like Architecture teams, Software teams. Our work brings the users intuitive, rich and accurate insight in the workload and the system, and empower them to find opportunities in software and hardware, build high level models to propose and deliver the best hardware and software to our customers, or debugging tricky failures and issues to help improve the stability of the system.

What you’ll be doing:

  • Build internal perf/power profiling and analysis tools and platform for AI workloads at cluster scale

  • Build debugging tools for common encountered problems in GPU cluster

  • Work with our users to build / calibrate perf/power models for next generation HW or system

  • Partner with architects to propose new HW features or improve existing features with real world use cases

What we need to see:

  • BS+ in Computer Science or related (or equivalent experience) and 5+ years of software development

  • Strong software design and implementation ability with Python/Go/C++

  • Good understanding of Deep Learning and AI frameworks like Pytorch, TensorFlow and etc

  • Knowledge of AI cluster job scheduling, storage management and networking management

  • Knowledge of Linux kernel

  • Excellent problem solving skills and project management skills

  • Flexibility for working in an evolving environment with changing requirements

Ways to stand out from the crowd:

  • Proven experience in GPU cluster scale continuous profiling & analysis tools/platforms

  • Solid experience in large AI job troubleshooting and failure detection/recovery

  • Skillful in Deep Learning application performance analysis and optimization

  • Knowledgeable in GPU / CPU architecture and application performance or power efficiency analysis

NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most brilliant and talented people in the world working for us and, due to unprecedented growth, our world-class engineering teams are growing fast. If you're a creative and autonomous engineer with real passion for technology, we want to hear from you.

#LI-Hybrid
 

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Flying Bark Productions - Rigging & Animation Software Developer

Flying Bark Productions

Sydney, New South Wales, Australia (Hybrid)
3 Weeks ago
Every matrix - Experienced CRM Data Scientist

Every matrix

United Kingdom (Hybrid)
6 Months ago
NVIDIA - Senior Technical Marketing Engineer - AI Infrastructure

NVIDIA

Canada (On-Site)
1 Month ago
Arrise Solutions (India)   - Senior Data Scientist (Remote)

Arrise Solutions (India)

Hyderabad, Telangana, India (Remote)
6 Months ago
ByteDance - Senior Research Scientist, Foundation Model, Speech Understanding

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Riot Games - Staff Software Engineer (Build Platforms) - VALORANT, Foundations

Riot Games

Dublin, County Dublin, Ireland (On-Site)
5 Months ago
NVIDIA - Senior System Software Engineer, GPU Server

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Rivos - CPU Physical Design - Full time

Rivos

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Hello Games - Machine Learning Engineer

Hello Games

United Kingdom (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Machine Learning Engineer - Machine Learning Infrastructure

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
ByteDance - Research Scientist in Machine Learning for Science (AML - AI-for-Science) - 2024 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
ByteDance - Software Engineer, Model Inference

ByteDance

Seattle, Washington, United States (On-Site)
4 Weeks ago
Madison Logic - Sr. Data Scientist

Madison Logic

Pune, Maharashtra, India (On-Site)
6 Months ago
Tencent - Game Research & Development Intern, Engine Research

Tencent

Palo Alto, California, United States (On-Site)
4 Months ago
ByteDance - Research Scientist in Foundation Model, Speech Understanding - 2024 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Senior Machine Learning Engineer - AML Algorithm

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

ByteDance - AI/LLM Network Software Engineer (High Speed Network)

ByteDance

Seattle, Washington, United States (On-Site)
4 Weeks ago
Fliff  Inc  - Payments and Fraud Analyst

Fliff Inc

Philadelphia, Pennsylvania, United States (On-Site)
9 Months ago
Trek - Service Technician/Advisor

Trek

Dayton, Ohio, United States (On-Site)
2 Months ago
Fluence - Sales Engineer/Senior Sales Engineer - Battery Energy Storage

Fluence

Alpharetta, Georgia, United States (Hybrid)
6 Months ago
The Walt Disney Company - Lifeguard - Part Time/Full Time

The Walt Disney Company

Florida, United States (On-Site)
4 Weeks ago
The Walt Disney Company - Norway Disney Cultural Representative Program

The Walt Disney Company

Orlando, Florida, United States (On-Site)
4 Weeks ago
ByteDance - Research Scientist Intern (Doubao (Seed) - Music Foundation Model) - 2024 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Bounteous - Product Manager, B2B

Bounteous

Bernards, New Jersey, United States (Hybrid)
6 Months ago
Onward Search - Social Media Specialist

Onward Search

Addison, Texas, United States (Hybrid)
2 Months ago
Netflix - Technical Program Manager 5 - Growth Commerce Platform Engineering

Netflix

Los Gatos, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Zoox - Senior/Staff Software Engineer - Simulation C++ Framework

Zoox

Seattle, Washington, United States (Hybrid)
6 Months ago
NVIDIA - SOC Clock Distribution Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Tesla - PLC Programmer

Tesla

Rhineland-Palatinate, Germany (On-Site)
2 Months ago
NVIDIA - Senior Circuit Characterization Engineer

NVIDIA

Canada (Hybrid)
1 Month ago
Riot Games - Staff Software Engineer (Graphics)

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
Riot Games - Associate Art Director (Characters) - Unpublished R&D Product

Riot Games

Los Angeles, California, United States (On-Site)
6 Months ago
NVIDIA - SOC Verification Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Weeks ago
NVIDIA - Senior Silicon Circuits System Design Engineer

NVIDIA

Canada (Hybrid)
1 Month ago
NVIDIA - Senior Manager, Hardware Engineering

NVIDIA

Santa Clara, California, United States (Hybrid)
3 Months ago
Rivos - Logic Equivalence Check (LEC) Engineer

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Seoul, South Korea (Hybrid)

Yokne'am Illit, North District, Israel (Hybrid)

Yokne'am Illit, North District, Israel (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (On-Site)

California, United States (Hybrid)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug