Outscal Logooutscal logo

Senior HPC Performance Engineer

1 Week ago • 3 Years + • Research & Development • $148,000 PA - $287,500 PA

Job Summary

Job Description

NVIDIA's GPU Communications Libraries and Networking team seeks a Senior HPC Performance Engineer to contribute to the development and optimization of communication libraries like NCCL, NVSHMEM, and UCX. The role involves in-depth performance analysis on large-scale multi-GPU and multi-node clusters, investigating interactions between libraries and hardware/software components, and triaging performance issues reported by customers. Responsibilities include performance benchmarking, developing tools for data visualization and analysis, and collaborating with a global team. The ideal candidate possesses strong HPC and performance engineering expertise, proficiency in parallel programming and C/C++, and experience with debugging across the HW/SW stack.
Must have:
  • M.S./Ph.D. in CS or related field
  • 3+ years parallel programming experience
  • Experience with communication runtimes (MPI, NCCL, etc.)
  • Performance benchmarking on large HPC clusters
  • Understanding of computer system architecture
  • C/C++ programming, debugging skills
  • Proficiency in Python scripting
  • Familiarity with containers and scheduling tools
Good to have:
  • Infiniband/Ethernet network experience
  • Experience debugging network issues
  • CUDA programming and/or GPU experience
  • Experience with Deep Learning Frameworks
Perks:
  • Equity
  • Benefits

Job Details

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars.

We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver libraries like NCCL, NVSHMEM, UCX for Deep Learning and HPC. We are looking for a motivated Performance engineer to influence the roadmap of our communication libraries. The DL and HPC applications of today have a huge compute demand and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) within a node and with high-speed networking (eg. Infiniband, Ethernet) across the nodes. Communication performance between the GPUs has a direct impact on the end-to-end application performance; and the stakes are even higher at huge scales! This is an outstanding opportunity for someone with HPC and performance background to advance the state of the art in this space. Are you ready for to contribute to the development of innovative technologies and help realize NVIDIA's vision?

What you will be doing:

  • Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.

  • Study the interaction of our libraries with all HW (GPU, CPU, Networking) and SW components in the stack

  • Evaluate proof-of-concepts, conduct trade-off analysis when multiple solutions are available

  • Triage and root-cause performance issues reported by our customers

  • Collect a lot of performance data; build tools and infrastructure to visualize and analyze the information

  • Collaborate with a very dynamic team across multiple time zones

What we need to see:

  • M.S. (or equivalent experience) or PHD in Computer Science, or related field with relevant performance engineering and HPC experience

  • 3+ yrs of experience with parallel programming and at least one communication runtime (MPI, NCCL, UCX, NVSHMEM)

  • Experience conducting performance benchmarking and triage on large scale HPC clusters

  • Good understanding of computer system architecture, HW-SW interactions and operating systems principles (aka systems software fundamentals)

  • Implement micro-benchmarks in C/C++, read and modify the code base when required

  • Ability to debug performance issues across the entire HW/SW stack. Proficient in a scripting language, preferably Python

  • Familiar with containers, cloud provisioning and scheduling tools (Kubernetes, SLURM, Ansible, Docker)

  • Adaptability and passion to learn new areas and tools. Flexibility to work and communicate effectively across different teams and timezones

Ways to stand out from the crowd:

  • Practical experience with Infiniband/Ethernet networks in areas like RDMA, topologies, congestion control

  • Experience debugging network issues in large scale deployments

  • Familiarity with CUDA programming and/or GPUs

  • Experience with Deep Learning Frameworks such PyTorch, TensorFlow

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

ByteDance - Machine Learning Engineer-Model Serving Infrastructure (AML-Engine)

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
Smarsh - Lead Machine Learning Engineer

Smarsh

India (Hybrid)
5 Months ago
Resemble AI - Deep Learning Speech Researcher

Resemble AI

Mountain View, California, United States (On-Site)
7 Months ago
PAPAYA - Data Scientist

PAPAYA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
ION - Data Engineer, Italy

ION

Italy (Hybrid)
5 Months ago
Meta - Software Engineer (Leadership) - Machine Learning

Meta

Menlo Park, California, United States (Remote)
4 Months ago
NVIDIA - Senior Packaging Technical Engineer - Hardware

NVIDIA

United States (Remote)
2 Weeks ago
NVIDIA - Mixed Signal Design Engineer (RDSS Intern)

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
2 Months ago
Krafton  - [KRAFTON Communications] Corporate PR S Team Leader (15년 이상)

Krafton

Seoul, South Korea (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Rackspace Technology - Machine Learning Architect (AWS)

Rackspace Technology

(Remote)
2 Months ago
Genies - ML Engineering Intern

Genies

Los Angeles, California, United States (Hybrid)
10 Hours ago
ByteDance - Senior Research Scientist, Foundation Model, Speech Understanding

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
ASSIST Software - Other Positions

ASSIST Software

Suceava, Suceava County, Romania (Remote)
4 Months ago
ByteDance - Machine Learning Engineer - MLDev

ByteDance

San Jose, California, United States (On-Site)
21 Hours ago
Welevel - Senior AI Engineer (LLM & Training Focus)

Welevel

Munich, Bavaria, Germany (On-Site)
3 Weeks ago
VGW - Machine Learning Engineer

VGW

Perth, Western Australia, Australia (On-Site)
3 Weeks ago
ByteDance - Software Engineer, ML System Scheduling

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
Meta - Research Scientist, Computer Vision for Generative AI (PhD)

Meta

Menlo Park, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Canada

ZeniMax Media - Concepteur.trice de niveau / Level Designer

ZeniMax Media

Montreal, Quebec, Canada (On-Site)
5 Months ago
PwC - PwC Private, Cross Border Tax, Senior Manager (Bilingual FR/EN)

PwC

Montreal, Quebec, Canada (On-Site)
5 Months ago
IGG - 2D Art Generalist

IGG

Vancouver, British Columbia, Canada (On-Site)
1 Day ago
Epic Games - Full-Stack Web Programmer, Trust & Safety

Epic Games

Montreal, Quebec, Canada (On-Site)
2 Months ago
NVIDIA - Senior Hardware Validation Engineer

NVIDIA

Canada (On-Site)
2 Weeks ago
Mistplay - Senior Data Analyst I, Growth Analytics

Mistplay

Montreal, Quebec, Canada (Hybrid)
1 Week ago
Larian Studios - VFX DIRECTOR

Larian Studios

Quebec, Canada (On-Site)
3 Months ago
NVIDIA - Senior Product Architect

NVIDIA

Canada (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

ByteDance - Research Engineer in Large Model System

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
Valve corporation - Electrical Engineer

Valve corporation

Bellevue, Washington, United States (On-Site)
4 Months ago
Rivos - Silicon Logic Formal Verification - Full Time

Rivos

Austin, Texas, United States (Hybrid)
5 Months ago
Samsung Semiconductor - Staff Engineer, Performance Modeling Architect

Samsung Semiconductor

San Jose, California, United States (Hybrid)
12 Hours ago
Google - Student Researcher, BS/MS, Winter/Summer 2025

Google

Waterloo, Ontario, Canada (On-Site)
4 Months ago
Redhorse Corp - CNO Developer

Redhorse Corp

Chantilly, Virginia, United States (On-Site)
3 Months ago
SambaNova Systems - Principal Software Engineer, Runtime

SambaNova Systems

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Evolution - C++ Developer (Video)

Evolution

Riga, Latvia (On-Site)
2 Months ago
Riot Games - Staff Software Engineer - UnEco

Riot Games

Los Angeles, California, United States (On-Site)
1 Day ago
Tesla - Jr. SPS Programmer

Tesla

Rhineland-Palatinate, Germany (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Hsinchu, Hsinchu City, Taiwan (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Seoul, South Korea (Hybrid)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Ra'anana, Center District, Israel (On-Site)

Shanghai, Shanghai, China (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Be'er Sheva, South District, Israel (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug