Distinguished Software Architect - Deep Learning and HPC Communications

2 Months ago • 15 Years + • Research & Development • $308,000 PA - $471,500 PA

Job Summary

Job Description

NVIDIA's GPU Communications Libraries and Networking team seeks a Distinguished Software Architect to co-design next-generation data center platforms. Responsibilities include researching new communication technologies (expanding the GPUDirect portfolio), proposing innovative HW/SW solutions, driving adoption of new technologies, and collaborating with diverse internal and external teams. The role requires expertise in HPC, parallel programming, communication runtimes, computer architecture, GPU architecture, CUDA, high-performance networking, and ideally, ML/DL fundamentals. The selected candidate will push the limits of state-of-the-art communication technologies for deep learning and high-performance computing applications at massive scales.
Must have:
  • PhD in CS/related field or equiv. exp.
  • 15+ years relevant experience
  • HPC, parallel programming expertise
  • Communication runtime experience (MPI, NCCL, etc.)
  • Computer & system architecture knowledge
  • GPU architecture and CUDA expertise
  • High-performance networking understanding
  • C/C++ programming fluency
Good to have:
  • ML/DL fundamentals
  • Parallel algorithms expertise
  • Fault tolerance and resiliency
  • Competitive assessments
  • Performance analysis & optimization
  • DL framework experience (PyTorch, TensorFlow)
  • Industry leadership with patents/publications

Job Details

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars.

We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver communication libraries like NCCL, NVSHMEM, UCX for Deep Learning and HPC. We are looking for a Distinguished Software Architect to help co-design our next generation data center platforms. DL and HPC applications have a huge compute demand already and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) within a node and with high-speed networking (eg. Infiniband, Ethernet) across the nodes. Communication performance between the GPUs has a direct impact on the end-to-end application performance; and the stakes are even higher at huge scales! This is an outstanding opportunity to push the limits on the state-of-the-art and deliver platforms the world has never seen before. Are you ready to contribute to the development of innovative technologies and help realize NVIDIA's vision?

What you will be doing:

  • Research new communication technologies (e.g. expand the GPUDirect technology portfolio) and design new features for our communication libraries

  • Propose innovative solutions in HW and SW for our next-gen platforms. You will co-design these solutions with the GPU, Networking, and SW architects and ensure seamless integration with the software stacks

  • Inspire changes based on quantitative data coming from proof-of-concepts or detailed technical analysis/modeling

  • Drive the adoption of new communication technologies across application verticals

  • Keep up with the latest DL research and collaborate with diverse teams (internal and external), including DL researchers, and customers

What we need to see:

  • PHD in Computer Science, Computer Engineering or related field or strong equivalent experience; 15+ years of relevant experience in academia or the industry

  • Expert in following areas: HPC, parallel programming models (MPI, SHMEM), at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC), computer and system architecture, GPU architecture and CUDA

  • Deep understanding of various aspects of high performance networking from prior work experience: network technologies (Infiniband, Ethernet), network design, network topologies, network debug and performance analysis

  • Strong in at least a few of these areas: ML/DL fundamentals and how they tie to communications, parallel algorithms, fault tolerance and resiliency, competitive assessments, performance analysis and optimizations for parallel applications on large clusters, developing applications using DL Frameworks (PyTorch, TensorFlow)

  • Programming fluency with C or C++ for systems software development

  • Flexibility to work and communicate effectively across different HW/SW teams and timezones

Ways to stand out from the crowd:

  • Industry recognized leader in HPC/DL communications with history of patents, publications and conference talks and keynotes in areas relevant to this role

  • Influential role in industry standards (e.g. MPI, OpenSHMEM) and open source software (e.g. PyTorch, UCX, Open MPI)

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative and autonomous, we want to hear from you!

The base salary range is 308,000 USD - 471,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

ByteDance - Research Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
ByteDance - Research Scientist, Foundation Model, Speech & Audio

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
ByteDance - Applied Scientist Intern (Computational Modeling & Optimization-System Technologies and Engineering)

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Google - Senior Software Engineer, Generative AI, Google Cloud AI

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
NVIDIA - Deep Learning Software Engineer, Performance Optimization

NVIDIA

Tokyo, Japan (On-Site)
4 Months ago
NVIDIA - Senior Circuit Design Engineer

NVIDIA

Austin, Texas, United States (Hybrid)
1 Month ago
Actian - C Engineer - Bangalore/Pune

Actian

Bengaluru, Karnataka, India (On-Site)
7 Months ago
ByteDance - CPU Optimization Architect

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
NVIDIA - Senior Chip-Design Verification Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Canva - Senior Machine Learning Engineer - Photo AI

Canva

Prague, Czechia (Remote)
4 Months ago
Hedra - Research Scientist

Hedra

San Francisco, California, United States (On-Site)
2 Months ago
Meta - Research Scientist, Computer Vision for Generative AI (PhD)

Meta

Seattle, Washington, United States (On-Site)
6 Months ago
Google - ML Accelerator Architect and Performance Engineer, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
Hedra - Machine Learning Engineer (CUDA)

Hedra

San Francisco, California, United States (On-Site)
2 Months ago
NVIDIA - AI Computing Software Development Engineer, TensorRT

NVIDIA

Shanghai, Shanghai, China (On-Site)
4 Months ago
Krafton  - Deep Learning Engineer - RL

Krafton

Seoul, South Korea (On-Site)
4 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
ASSIST Software - Other Positions

ASSIST Software

Suceava, Suceava County, Romania (Remote)
6 Months ago
ByteDance - Research Engineer (Machine Learning Training System) - 2025 Start

ByteDance

Singapore (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Canada

TRACK VFX - Senior Matchmove Artist

TRACK VFX

Vancouver, British Columbia, Canada (On-Site)
2 Months ago
Super - VP, Engineering

Super

Canada (Remote)
1 Month ago
Snowed In Studios - Lead Software Developer

Snowed In Studios

Quebec, Canada (Remote)
2 Months ago
Skybox Labs - Senior Environment Artist - Levels

Skybox Labs

Canada (Remote)
2 Months ago
Behaviour Interactive - Principal Generalist Programmer - Dead by Daylight

Behaviour Interactive

Quebec, Canada (Hybrid)
2 Months ago
Amber - Localization Quality Assurance (Traditional Chinese TW)

Amber

Quebec, Canada (Hybrid)
3 Months ago
Scanline VFX - Matte Painter

Scanline VFX

Vancouver, British Columbia, Canada (Hybrid)
4 Months ago
Behaviour Interactive - Game Designer - Dead by Daylight

Behaviour Interactive

Montreal, Quebec, Canada (Hybrid)
2 Months ago
Epic Games - Senior BCP/DR Specialist

Epic Games

Canada (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Senior Mask Designer

NVIDIA

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
NVIDIA - Senior ASIC Verification Engineer - Networking Chip Design

NVIDIA

Shanghai, Shanghai, China (On-Site)
3 Months ago
Meta - Software Engineer (Technical Leadership) - Machine Learning

Meta

New York, New York, United States (On-Site)
6 Months ago
ByteDance - Site Reliability Engineer, ML System

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
NVIDIA - System Software Engineer Intern, Autonomous Vehicles - 2025

NVIDIA

Shenzhen, Guangdong Province, China (On-Site)
3 Months ago
Google - Student Researcher, 2025

Google

Sydney, New South Wales, Australia (On-Site)
1 Month ago
Google - Chip Infrastructure Engineer

Google

Haifa, Haifa District, Israel (On-Site)
1 Month ago
Google - SoC and IP Design Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
NVIDIA - Senior Safety Architect for Linux

NVIDIA

(Remote)
2 Months ago
Google - Full Chip Physical Integration and CAD Engineer, Silicon

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug