Outscal Logooutscal logo

Senior Software Engineer, GPU Communications and Networking

5 Days ago • 5 Years + • Research & Development • Artificial Intelligence • $148,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior Software Engineer to design, implement, and maintain highly optimized communication runtimes for Deep Learning frameworks (like NCCL for TensorFlow/PyTorch) and HPC programming interfaces (like UCX for MPI/OpenSHMEM) on GPU clusters. Responsibilities include contributing to parallel programming interface specifications, developing system software for GPU interactions, and creating proof-of-concepts for new runtime designs and hardware features. This role involves working within a fast-paced team developing software for complex heterogeneous computing systems used in HPC and Deep Learning.
Must have:
  • M.S./Ph.D. in CS/CE or equivalent
  • 5+ years relevant experience
  • Excellent C/C++ programming
  • Strong Linux experience
  • Parallel programming expertise
Good to have:
  • CUDA programming
  • InfiniBand network knowledge
  • HPC application experience
  • PyTorch/TensorFlow experience
  • Strong collaboration skills
Perks:
  • Highly competitive salary
  • Comprehensive benefits package
  • Equity

Job Details

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for phenomenal people like you to help us accelerate the next wave of artificial intelligence.

We are looking for a highly motivated senior software engineer for an exciting role in our communication libraries and network software team. The position will be part of a fast-paced crew that develops and maintains software for complex heterogeneous computing systems that power disruptive products in High Performance Computing and Deep Learning.

What you will be doing:

  • Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g. NCCL for TensorFlow/Pytorch) and HPC programming interfaces (e.g. UCX for MPI/OpenSHMEM) on GPU clusters.

  • Participating in and contributing to parallel programming interface specifications like MPI/OpenSHMEM.

  • Design, implement and maintain system software that enables interactions among GPUs and interactions between GPUs and other system components.

  • Creating proof-of-concepts to evaluate and motivate extensions in programming models, new designs in runtimes and new features in hardware.

What we need to see:

  • M.S./Ph.D. degree in CS/CE or equivalent experience.

  • 5+ years of relevant experience.

  • Excellent C/C++ programming and debugging skills.

  • Strong experience with Linux.

  • Expert understanding of computer system architecture and operating systems.

  • Experience with parallel programming interfaces and communication runtimes.

  • Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment.

Ways to stand out from the crowd:

  • Deep understanding of technology and passionate about what you do.

  • Experience with CUDA programming and NVIDIA GPUs.

  • Knowledge of high-performance networks like InfiniBand, iWARP etc.

  • Experience with HPC applications.
  • Experience with Deep Learning Frameworks such PyTorch, TensorFlow, etc.
  • Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic matrix environment.

NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most forward-thinking and talented people in the world working for us and, due to unprecedented growth, our world-class engineering teams are growing fast. If you're a creative and autonomous engineer with real passion for technology, we want to hear from you.

The base salary range is 148,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

ByteDance - Machine Learning Engineer, Tech Lead - Code AI

ByteDance

San Jose, California, United States (On-Site)
20 Hours ago
NVIDIA - Senior Solutions Architect, Generative AI

NVIDIA

Mumbai, Maharashtra, India (On-Site)
1 Day ago
ByteDance - Senior Machine Learning Engineer - AML Algorithm

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
CloudHire - Backend Software Engineer

CloudHire

India (Remote)
1 Week ago
ByteDance - Researcher Graduate (Applied Machine Learning - Enterprise) -2025 Start (BS/MS)

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
ByteDance - Senior Technical Lead - Edge Cloud Infrastructure - San Jose / Seattle / Boston

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
CLO Virtual Fashion  Inc  - C++ Developer

CLO Virtual Fashion Inc

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Tesla - Mechanical Design Engineer - DFM and Design

Tesla

Athens, Greece (On-Site)
1 Month ago
Regent Craft - Performance Engineering Intern

Regent Craft

North Kingstown, Rhode Island, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Trustana - Senior Data Engineer

Trustana

Gurugram, Haryana, India (Hybrid)
5 Months ago
ByteDance - Machine Learning Engineer Intern - Global Payment - 2025 Start

ByteDance

Singapore (On-Site)
1 Month ago
Anavation - AI Specialist

Anavation

Chantilly, Virginia, United States (On-Site)
3 Months ago
ByteDance - Research Scientist in Foundation Model, Speech Understanding - 2024 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
NVIDIA - Senior Software Engineer - Distributed Inference

NVIDIA

California, United States (Remote)
1 Week ago
ByteDance - Video Analysis and Quality Algorithm Intern 2023 Summer/Fall (PHD)

ByteDance

San Diego, California, United States (On-Site)
4 Months ago
ByteDance - Video Analysis and Quality Algorithm Engineer

ByteDance

Seattle, Washington, United States (On-Site)
20 Hours ago
N-iX - AI Engineer

N-iX

Poland (Remote)
1 Day ago
The Walt Disney Company - Lead Software Engineer, Machine Learning - Ad Platforms

The Walt Disney Company

Seattle, Washington, United States (On-Site)
4 Months ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Pittsburgh, Pennsylvania, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Canada

Ripple Effect  - Character Artist - ExDev

Ripple Effect

Vancouver, British Columbia, Canada (Hybrid)
2 Weeks ago
Ubisoft - Producer

Ubisoft

Montreal, Quebec, Canada (On-Site)
11 Hours ago
NVIDIA - Senior Power and Thermal Engineer

NVIDIA

Canada (Hybrid)
1 Month ago
Epic Games - Concepteur de systèmes de narration

Epic Games

Montreal, Quebec, Canada (On-Site)
2 Months ago
Electronic Arts - Lead Experience Designer

Electronic Arts

Vancouver, British Columbia, Canada (Hybrid)
1 Month ago
Larian Studios - GRAPHICS PROGRAMMER

Larian Studios

Quebec, Canada (On-Site)
3 Months ago
Epic Games - Senior DevOps Programmer

Epic Games

Montreal, Quebec, Canada (On-Site)
1 Day ago
Behaviour Interactive - Principal UI/UX Designer

Behaviour Interactive

Montreal, Quebec, Canada (Hybrid)
4 Weeks ago
Skybox Labs - Senior Environment Artist - Levels

Skybox Labs

Canada (Remote)
2 Weeks ago
Amber - Localization Quality Assurance (Czech)

Amber

Quebec, Canada (Hybrid)
5 Days ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Hashlist - Zone Control Unit Architect

Hashlist

Pune, Maharashtra, India (Hybrid)
6 Months ago
Meta - Software Engineer (Technical Leadership) - Machine Learning

Meta

Menlo Park, California, United States (On-Site)
4 Months ago
NVIDIA - Senior Software Engineer - Ethernet Switch

NVIDIA

Ra'anana, Center District, Israel (Hybrid)
2 Months ago
Ubisoft - Principal R&D Scientist on Bots & Behaviors

Ubisoft

Bordeaux, Nouvelle-Aquitaine, France (Hybrid)
2 Months ago
ByteDance - High-Performance Computing Research Scientist (Algorithm Acceleration)

ByteDance

Seattle, Washington, United States (On-Site)
19 Hours ago
Rivos - SOC Physical Design Verification Engineer - Full Time

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
5 Months ago
NVIDIA - Senior Electronics Failure Analysis Hardware Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
Riot Games - Staff Research Scientist - Tech Research

Riot Games

Los Angeles, California, United States (On-Site)
1 Day ago
NVIDIA - Senior GPU Cluster Software Engineer

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Hsinchu, Hsinchu City, Taiwan (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Seoul, South Korea (Hybrid)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Ra'anana, Center District, Israel (On-Site)

Shanghai, Shanghai, China (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Be'er Sheva, South District, Israel (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug