Senior System Software Engineer, NCCL - Partner Enablement

2 Months ago • 5 Years + • DevOps • Research & Development • $148,000 PA - $287,500 PA

Job Summary

Job Description

NVIDIA's GPU Communications Libraries and Networking team seeks a Senior System Software Engineer to focus on NCCL (NVIDIA Collective Communications Library) partner enablement. Responsibilities include troubleshooting functional and performance issues with NCCL, conducting performance analysis on GPU clusters, developing diagnostic tools and automation, providing HPC expertise to customers and support teams, creating training materials and webinars, and collaborating with internal teams across different time zones. The role requires deep expertise in parallel programming, high-performance networking (Infiniband, RoCE, Ethernet), Linux, and scripting languages (Python).
Must have:
  • 5+ years relevant experience
  • Parallel programming & communication runtime experience
  • Excellent C/C++ programming skills
  • HPC or AI community support experience
  • High-performance networking expertise (Infiniband/RoCE/Ethernet)
  • Linux fundamentals & Python scripting
Good to have:
  • HPC cluster infrastructure experience
  • System administration experience (large clusters)
  • Network configuration debugging in large deployments
  • CUDA programming and/or GPU familiarity
  • Deep Learning framework experience (PyTorch, TensorFlow)
Perks:
  • Equity
  • Benefits

Job Details

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars.

We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver communication runtimes like NCCL and NVSHMEM for Deep Learning and HPC applications. We are looking for a motivated Partner Enablement Engineer to guide our key partners and customers with NCCL. Most DL/HPC applications run on large clusters with high-speed networking (Infiniband, RoCE, Ethernet). This is an outstanding opportunity to get an end to end understanding of the AI networking stack. Are you ready for to contribute to the development of innovative technologies and help realize NVIDIA's vision?

What you will be doing:

  • Engage with our partners and customers to root cause functional and performance issues reported with NCCL

  • Conduct performance characterization and analysis of NCCL and DL applications on groundbreaking GPU clusters

  • Develop tools and automation to isolate issues on new systems and platforms, including cloud platforms (Azure, AWS, GCP, etc.)

  • Guide our customers and support teams on HPC knowledge and standard methodologies for running applications on multi-node clusters

  • Document and conduct trainings/webinars for NCCL

  • Engage with internal teams in different time zones on networking, GPUs, storage, infrastructure and support.

What we need to see:

  • B.S./M.S. degree in CS/CE or equivalent experience with 5+ years of relevant experience. Experience with parallel programming and at least one communication runtime (MPI, NCCL, UCX, NVSHMEM)

  • Excellent C/C++ programming skills, including debugging, profiling, code optimization, performance analysis, and test design

  • Experience working with engineering or academic research community supporting HPC or AI

  • Practical experience with high performance networking: Infiniband/RoCE/Ethernet networks, RDMA, topologies, congestion control

  • Expert in Linux fundamentals and a scripting language, preferably Python

  • Familiar with containers, cloud provisioning and scheduling tools (Docker, Docker Swarm, Kubernetes, SLURM, Ansible)

  • Adaptability and passion to learn new areas and tools

  • Flexibility to work and communicate effectively across different teams and timezones

Ways to stand out from the crowd:

  • Experience conducting performance benchmarking and developing infrastructure on HPC clusters. Prior system administration experience, esp for large clusters. Experience debugging network configuration issues in large scale deployments

  • Familiarity with CUDA programming and/or GPUs. Good understanding of Machine Learning concepts and experience with Deep Learning Frameworks such PyTorch, TensorFlow

  • Deep understanding of technology and passionate about what you do

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

ByteDance - Cloud Network Engineer

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Google - Software Engineer III, Google Cloud Platforms

Google

(On-Site)
4 Months ago
PwC - ETIC, Azure Technical Support Engineer - Manager

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
6 Months ago
NVIDIA - Senior VLSI Integration Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
2 Months ago
PlayStation Global - Staff Linux Network Software Engineer

PlayStation Global

Adelaide, South Australia, Australia (On-Site)
5 Months ago
Flexera - Member Technical Staff - Site Reliability Engineer

Flexera

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
ByteDance - Senior Site Reliability Engineer - Data Infrastructure (Seattle)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
UXBERT Labs - Senior DevOps Engineer

UXBERT Labs

Riyadh, Riyadh Province, Saudi Arabia (Hybrid)
3 Months ago
Fractal - DevOps - Lead

Fractal

Mumbai, Maharashtra, India (On-Site)
6 Months ago
NVIDIA - Software Engineer Intern, Autonomous Vehicle - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Senior Solutions Architect, CSP System

NVIDIA

Beijing, Beijing, China (On-Site)
3 Months ago
Modio - Cloud Systems Engineer

Modio

Prahran, Victoria, Australia (On-Site)
1 Month ago
undefined - Software Engineer, Edge

Canada, Kentucky, United States (Remote)
6 Months ago
NVIDIA - Senior HPC Technical Support Engineer - Ethernet

NVIDIA

Durham, North Carolina, United States (On-Site)
3 Months ago
Nagarro - Senior Staff Consultant, Business Analyst

Nagarro

(On-Site)
6 Months ago
Framestore - LAUNCHPAD INSIGHTS | UNPAID WORK EXPERIENCE

Framestore

London, England, United Kingdom (On-Site)
11 Months ago
NVIDIA - Senior Technical Marketing Engineer - AI Infrastructure

NVIDIA

Canada (On-Site)
2 Months ago
Google - Software Engineer III, Infrastructure, Google Cloud Security and Privacy

Google

Kirkland, Washington, United States (On-Site)
4 Months ago
ByteDance - Senior Software Engineer - Network Security

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Zeta - Sr. Site Reliability Engineer

Zeta

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

Next Level Business Services - API Developer

Next Level Business Services

New York, New York, United States (On-Site)
6 Months ago
undefined - Enterprise Account Executive, West

United States (Remote)
6 Months ago
Patel greene - Senior PD&E Planner

Patel greene

Bartow, Florida, United States (On-Site)
6 Months ago
The Walt Disney Company - Senior Security Specialist, Information Security - Security Solution Architect

The Walt Disney Company

Orlando, Florida, United States (On-Site)
2 Months ago
Google - Software Engineer III, Infrastructure, Google Cloud Compute Infrastructure

Google

Kirkland, Washington, United States (On-Site)
4 Months ago
Meetelise - Mid-Market Account Executive - Housing

Meetelise

New York, New York, United States (On-Site)
6 Months ago
Mattel  Inc  - American Girl Server

Mattel Inc

Texas, United States (On-Site)
4 Months ago
Netflix - Travel Manager, Corporate Travel UCAN

Netflix

Los Angeles, California, United States (On-Site)
2 Months ago
Proof of Play - Senior Fullstack Engineer

Proof of Play

United States (Remote)
1 Month ago
Next Level Business Services - Sr. Developer – Native Mobile Apps

Next Level Business Services

Philadelphia, Pennsylvania, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Ajmera Infotech - Senior ASP.NET Developer with Azure Expertise

Ajmera Infotech

Austin, Texas, United States (On-Site)
2 Months ago
Scopely - Senior Security IAM Engineer

Scopely

Barcelona, Catalonia, Spain (Hybrid)
1 Month ago
Flexera - Member Technical Staff - Site Reliability Engineer

Flexera

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
NVIDIA - Senior DevOps Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
Nagarro - Principal Engineer -- PHP Developer

Nagarro

New Jersey, United States (Remote)
6 Months ago
Ubisoft - DevOps Linux System Administrator

Ubisoft

Montreal, Quebec, Canada (On-Site)
2 Months ago
Gaming Innovation Group  - DevOps Engineer

Gaming Innovation Group

Catalonia, Spain (Hybrid)
1 Month ago
VGW - Staff Site Reliability Engineer

VGW

Perth, Western Australia, Australia (On-Site)
2 Months ago
CloudHire - Sr. Java Application Architect

CloudHire

Bengaluru, Karnataka, India (Remote)
1 Month ago
Inworld AI - Staff Cloud DevOps/Site Reliability Engineer (SRE) - USA

Inworld AI

Mountain View, California, United States (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Austin, Texas, United States (Remote)

Santa Clara, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug