Senior Software Architect, AI and HPC

1 Month ago • 8 Years + • Research & Development • $184,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior Software Architect with 8+ years of experience in parallel programming and/or network architecture to design and implement features for AI and HPC communication middleware (NCCL, Open MPI, UCX, UCC, NVSHMEM), deep learning frameworks, and compilers. Responsibilities include creating proofs-of-concept, researching new runtime designs and hardware features, and enhancing compiler features to support NVIDIA's networking ecosystem. The ideal candidate will have a strong background in algorithm design, system programming, and computer architecture, along with experience in high-performance computing systems and CUDA programming.
Must have:
  • 8+ years parallel programming/network architecture experience
  • Strong programming & software development skills
  • Algorithm design, system programming, computer architecture knowledge
  • Experience with AI frameworks (PyTorch/NEMO) and HPC programming models (MPI, OpenSHMEM, PGAS)
Good to have:
  • Experience designing communication middleware for HPC
  • Experience developing compiler features/optimizations (Clang/LLVM)
  • Experience implementing communication libraries (MPI, OpenSHMEM, NCCL, etc.)
  • CUDA programming and NVIDIA GPU experience
  • Experience with emerging architectures (hierarchical heterogeneous memory systems and accelerators)
Perks:
  • Competitive salary
  • Generous benefits package

Job Details

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people.

Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. The software architecture group at NVIDIA has openings for software architects in the field of AI and high-performance networking and system software. We research, develop, and deploy solutions in networking hardware, programming environments, and system software to make current and future high-end computer systems more performant, scalable, and usable. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

What you will be doing

  • Creating proofs-of-concept to evaluate and motivate extensions in AI Frameworks (PyTorch/NEMO), HPC programming models (MPI, OpenSHMEM, PGAS), new runtime designs, and new network hardware features.

  • Research, design and implement features for AI and HPC communication middleware (NCCL, Open MPI, UCX, UCC, NVSHMEM), and Deep Learning frameworks such as TensorFlow/Pytorch.

  • Review , design, and implement features to enhance compiler features to support the NVIDIA networking ecosystem.

  • Research, design and develop hardware features relevant to scientific, Deep learning, and data-intensive workloads.

What we need to see

  • Ph.D, Masters, or Bachelors in , in computer science, computer engineering, or a closely related field or equivalent experience.

  • 8+ years of experience in parallel programming models, and/or network architecture.

  • Background in algorithm design, system programming, and computer architecture

  • Strong programming and software development skills

  • Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment

Ways to stand out from the crowd:

  • Deep understanding of technology and passion for what you do

  • Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic matrix environment

  • Background with designing communication middleware for high-performance computing systems, including InfiniBand, DPUs, Ethernet, and Shared Memory

  • Experience developing and implementing features for compilers, optimizations for compilers, particularly Clang/LLVM, and NVIDIA compilers and experience implementing communications libraries, particularly MPI, OpenSHMEM, NCCL, NVSHMEM, UCX, UCC, or PGAS

  • Background with CUDA programming and NVIDIA GPUs and programming models for emerging architectures including hierarchical heterogeneous memory systems and accelerators.

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

NVIDIA - Senior Developer Relations Manager - Robotics

NVIDIA

Tokyo, Japan (On-Site)
2 Months ago
The Walt Disney Company - Lead Data Scientist

The Walt Disney Company

Glendale, California, United States (On-Site)
5 Months ago
Epic Games - Chercheur scientifique principal

Epic Games

Montreal, Quebec, Canada (On-Site)
3 Months ago
ByteDance - Engineering Manager Machine Learning Infrastructure

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Zoox - Collision Avoidance System, Machine Learning Internship/Co-op

Zoox

Foster City, California, United States (On-Site)
5 Months ago
Krafton  - Compensation Specialist

Krafton

Seoul, South Korea (On-Site)
2 Months ago
ByteDance - Senior Site Reliability Engineer, ML System

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Anavation - Lead Software Engineer

Anavation

Quantico, Virginia, United States (On-Site)
5 Months ago
Booming games - Prototyping Engineer

Booming games

(Remote)
3 Months ago
NVIDIA - Senior DSP Communication Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Ubisoft - Lead R&D Scientist

Ubisoft

Shanghai, Shanghai, China (On-Site)
2 Months ago
NVIDIA - Senior System Software Engineer - Triton Inference Server

NVIDIA

California, United States (Remote)
2 Months ago
Epic Games - Research Team - Targeted Large Language Models and Fine-tuning

Epic Games

Montreal, Quebec, Canada (On-Site)
2 Months ago
Digitap AI - Senior Data Scientist

Digitap AI

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Microsoft - Research Intern - AI-driven Hardware Design

Microsoft

Vancouver, British Columbia, Canada (On-Site)
3 Months ago
Google - Software Engineer III, Machine Learning, Google Cloud Compute Infrastructure

Google

Kirkland, Washington, United States (On-Site)
5 Months ago
Twitch - Applied Scientist - Safety ML

Twitch

San Francisco, California, United States (On-Site)
4 Months ago
Microsoft - Research Intern - Microsoft Research and Outlook

Microsoft

Redmond, Washington, United States (On-Site)
3 Months ago
Microsoft - Senior Machine Learning Engineer

Microsoft

Bengaluru, Karnataka, India (On-Site)
3 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Louisiana, United States

Bungie - Contract Marathon Associate Marketing Manager

Bungie

United States (Hybrid)
1 Month ago
DraftKings - Operations Associate

DraftKings

North Andover, Massachusetts, United States (On-Site)
3 Months ago
Samsung Semiconductor - Staff Engineer, SOC Design

Samsung Semiconductor

Folsom, California, United States (Hybrid)
2 Months ago
ByteDance - Research Scientist- Foundation Model, Video Generation

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Scale AI - Executive Researcher

Scale AI

San Francisco, California, United States (Hybrid)
6 Months ago
Activate Games - Store Leader (Store Manager)

Activate Games

Sterling, Virginia, United States (On-Site)
1 Month ago
Meta - Global Sales Analytics Lead

Meta

Menlo Park, California, United States (Remote)
5 Months ago
Granicus - SLED Enterprise Account Executive - Northeast (Local)

Granicus

United States (Remote)
6 Months ago
The Walt Disney Company - DLR Operations Coordinator

The Walt Disney Company

Anaheim, California, United States (On-Site)
1 Month ago
Jam City - UI/UX Artist

Jam City

Burbank, California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Google - Software Engineer (For Women in Tech Candidates)

Google

São Paulo, State Of São Paulo, Brazil (On-Site)
5 Months ago
Krafton  - CEO's Office Staff

Krafton

Seoul, South Korea (On-Site)
2 Months ago
Krafton  - [Publishing] Member of Global Strategic Initiatives (2~5년)

Krafton

Seoul, South Korea (On-Site)
3 Months ago
Cadence - Lead Support Application Engineer - GCS

Cadence

Bengaluru, Karnataka, India (On-Site)
6 Months ago
NVIDIA - Senior System Level Testability Lead

NVIDIA

Santa Clara, California, United States (Hybrid)
2 Months ago
Keywords Studios (Player Support) - Software Engineer- Lead

Keywords Studios (Player Support)

Maharashtra, India (Hybrid)
3 Months ago
NVIDIA - System Software Engineer - USB (RDSS Intern)

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
Fluence - Controls Software Engineer II

Fluence

Houston, Texas, United States (Hybrid)
5 Months ago
Cadence - Lead Design Engineer ( Layout Design )

Cadence

Bengaluru, Karnataka, India (On-Site)
6 Months ago
ASSIST Software - C/C++ Embedded Engineer

ASSIST Software

Suceava, Suceava County, Romania (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Texas, United States (Remote)

Santa Clara, California, United States (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

United Kingdom (Remote)

Yokne'am Illit, North District, Israel (On-Site)

Bengaluru, Karnataka, India (Hybrid)

Toronto, Ontario, Canada (On-Site)

Santa Clara, California, United States (Hybrid)

Taipei City, Taiwan (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug