Senior HPC Performance Engineer

1 Month ago • 3 Years + • Research & Development • $148,000 PA - $287,500 PA

Job Summary

Job Description

NVIDIA's GPU Communications Libraries and Networking team seeks a Senior HPC Performance Engineer to contribute to the development of innovative communication libraries. Responsibilities include in-depth performance analysis on large multi-GPU/multi-node clusters, evaluating proof-of-concepts, troubleshooting performance issues, building data visualization tools, and collaborating with a global team. The ideal candidate possesses strong HPC and parallel programming experience, expertise in performance benchmarking, and a solid understanding of computer architecture and systems software. Experience with high-speed interconnects and networking technologies is highly desirable.
Must have:
  • M.S./Ph.D. in CS or related field
  • 3+ years HPC experience
  • Parallel programming expertise
  • Performance benchmarking experience
  • Strong system architecture understanding
  • C/C++ micro-benchmarking
  • Debugging across HW/SW stack
  • Python scripting proficiency
Good to have:
  • Infiniband/Ethernet network experience
  • Experience debugging network issues
  • CUDA programming experience
  • Deep Learning framework familiarity (PyTorch, TensorFlow)
  • Experience with Kubernetes, SLURM, Ansible, Docker
Perks:
  • Equity
  • Benefits

Job Details

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars.

We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver libraries like NCCL, NVSHMEM, UCX for Deep Learning and HPC. We are looking for a motivated Performance engineer to influence the roadmap of our communication libraries. The DL and HPC applications of today have a huge compute demand and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) within a node and with high-speed networking (eg. Infiniband, Ethernet) across the nodes. Communication performance between the GPUs has a direct impact on the end-to-end application performance; and the stakes are even higher at huge scales! This is an outstanding opportunity for someone with HPC and performance background to advance the state of the art in this space. Are you ready for to contribute to the development of innovative technologies and help realize NVIDIA's vision?

What you will be doing:

  • Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.

  • Study the interaction of our libraries with all HW (GPU, CPU, Networking) and SW components in the stack

  • Evaluate proof-of-concepts, conduct trade-off analysis when multiple solutions are available

  • Triage and root-cause performance issues reported by our customers

  • Collect a lot of performance data; build tools and infrastructure to visualize and analyze the information

  • Collaborate with a very dynamic team across multiple time zones

What we need to see:

  • M.S. (or equivalent experience) or PHD in Computer Science, or related field with relevant performance engineering and HPC experience

  • 3+ yrs of experience with parallel programming and at least one communication runtime (MPI, NCCL, UCX, NVSHMEM)

  • Experience conducting performance benchmarking and triage on large scale HPC clusters

  • Good understanding of computer system architecture, HW-SW interactions and operating systems principles (aka systems software fundamentals)

  • Implement micro-benchmarks in C/C++, read and modify the code base when required

  • Ability to debug performance issues across the entire HW/SW stack. Proficient in a scripting language, preferably Python

  • Familiar with containers, cloud provisioning and scheduling tools (Kubernetes, SLURM, Ansible, Docker)

  • Adaptability and passion to learn new areas and tools. Flexibility to work and communicate effectively across different teams and timezones

Ways to stand out from the crowd:

  • Practical experience with Infiniband/Ethernet networks in areas like RDMA, topologies, congestion control

  • Experience debugging network issues in large scale deployments

  • Familiarity with CUDA programming and/or GPUs

  • Experience with Deep Learning Frameworks such PyTorch, TensorFlow

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Meta - Research Scientist, Machine Learning (PhD)

Meta

Bellevue, Washington, United States (On-Site)
1 Month ago
Google - Software Engineer III, Generative AI

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
ByteDance - Research Scientist, Multimodal Foundation Model

ByteDance

Singapore (On-Site)
7 Months ago
The Walt Disney Company - Lead Software Engineer, Machine Learning - Ad Platforms

The Walt Disney Company

Santa Monica, California, United States (On-Site)
6 Months ago
Google - Field Solutions Architect, GenAI, Google Cloud

Google

Tokyo, Japan (On-Site)
1 Month ago
NVIDIA - Senior Silicon Product Definition Engineer

NVIDIA

Santa Clara, California, United States (Hybrid)
3 Months ago
NVIDIA - Senior ASIC Design Engineer

NVIDIA

Remote, Oregon, United States (Remote)
2 Months ago
Google - Software Engineering Manager, System Acceleration, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
Netflix - ML Software Engineer (L4/L5) - Media Algorithms

Netflix

Los Angeles, California, United States (On-Site)
1 Month ago
Riot Games - Manager, Insights - Central User Research

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Machine Learning Engineer Intern (E-commerce-Supply Chain & Logistics)

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
Trend Micro - NLP / Prompt Engineer (VicOne_Automotive Security)

Trend Micro

Taipei City, Taiwan (On-Site)
8 Months ago
Flip Fit - Machine Learning Engineer

Flip Fit

(Remote)
4 Months ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Speech & Audio) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
ByteDance - Machine Learning Engineer - MLDev

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
Zazz - Machine Learning Engineer

Zazz

(Remote)
3 Months ago
Snail Games - Software Engineer - AI/Machine Translation

Snail Games

Beverly Hills, California, United States (Remote)
3 Months ago
NVIDIA - Senior Software Engineer - Automated Parallel Programming

NVIDIA

Santa Clara, California, United States (Remote)
4 Months ago
Scale AI - Machine Learning Engineer, International Public Sector

Scale AI

United Kingdom (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

Scout - Specialist, Collision Operations

Scout

Columbia, South Carolina, United States (On-Site)
4 Weeks ago
Nintendo - Internal Auditor

Nintendo

Redmond, Washington, United States (Hybrid)
10 Months ago
The Walt Disney Company - Lead Software Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
2 Months ago
ByteDance - LLM Software Engineer/Researcher (Applied Machine Learning)

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
Next Level Business Services - Service Desk Support

Next Level Business Services

Phoenix, Arizona, United States (On-Site)
7 Months ago
Next Level Business Services - ServiceNow Architect

Next Level Business Services

Cupertino, California, United States (On-Site)
7 Months ago
Lionsgate Games - Director, Salesforce Architect

Lionsgate Games

Santa Monica, California, United States (On-Site)
1 Month ago
Sphere Entertainment Co - Senior Manager Data Science

Sphere Entertainment Co

Las Vegas, Nevada, United States (On-Site)
2 Months ago
Skillz - Senior Software Engineer (React Native - Mobile SDK)

Skillz

Las Vegas, Nevada, United States (On-Site)
2 Months ago
Riot Games - Architect User Experience Designer - League of Legends

Riot Games

Los Angeles, California, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Nagarro - Trainee SAP Associate Consultant FI/CO

Nagarro

Germany (Remote)
2 Months ago
NVIDIA - Senior CPU Implementation Methodology Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
ByteDance - Senior Algorithm Engineer, Trust and Safety

ByteDance

Singapore (On-Site)
7 Months ago
NVIDIA - Senior Math Libraries Engineer - Sparse Linear Algebra

NVIDIA

California, United States (Hybrid)
4 Months ago
Google - Software Engineer III, Education and Activation, Core

Google

Mexico City, Mexico City, Mexico (On-Site)
1 Month ago
Tesla - Electrical Engineering - Motor Design, Tesla Bot Internship

Tesla

Athens, Greece (On-Site)
3 Months ago
Krafton  - Strategic Planning Manager (India Div.)

Krafton

Seoul, South Korea (On-Site)
1 Month ago
NVIDIA - Technical Product Management Intern, CUDA - Fall 2025

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Google - Software Engineer III, Machine Learning (Recommendations, Rankings, and Predictions)

Google

San Bruno, California, United States (On-Site)
1 Month ago
Tencent - Speech Synthesis Intern

Tencent

London, England, United Kingdom (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug