Senior Software Architect, AI and HPC

2 Months ago • 8 Years + • Research & Development • $184,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior Software Architect, AI and HPC to contribute to the research, development, and deployment of solutions in networking hardware, programming environments, and system software. Responsibilities include creating proofs-of-concept for AI frameworks (PyTorch/NEMO), HPC programming models (MPI, OpenSHMEM, PGAS), and new runtime/hardware features. The role also involves designing and implementing features for AI and HPC communication middleware (NCCL, Open MPI, UCX, UCC, NVSHMEM) and Deep Learning frameworks (TensorFlow/PyTorch), as well as enhancing compiler features to support the NVIDIA networking ecosystem. The ideal candidate possesses extensive experience in parallel programming, network architecture, algorithm design, and system programming, along with strong software development skills.
Must have:
  • Ph.D., Masters, or Bachelors in CS/related field
  • 8+ years parallel programming/network architecture experience
  • Algorithm design, system programming, computer architecture skills
  • Strong programming & software development skills
Good to have:
  • Experience with communication middleware for HPC systems
  • Compiler feature development/optimization experience (Clang/LLVM)
  • Experience implementing communications libraries (MPI, OpenSHMEM, etc.)
  • CUDA programming and NVIDIA GPU experience
Perks:
  • Competitive salary
  • Generous benefits package

Job Details

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people.

Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. The software architecture group at NVIDIA has openings for software architects in the field of AI and high-performance networking and system software. We research, develop, and deploy solutions in networking hardware, programming environments, and system software to make current and future high-end computer systems more performant, scalable, and usable. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

What you will be doing

  • Creating proofs-of-concept to evaluate and motivate extensions in AI Frameworks (PyTorch/NEMO), HPC programming models (MPI, OpenSHMEM, PGAS), new runtime designs, and new network hardware features.

  • Research, design and implement features for AI and HPC communication middleware (NCCL, Open MPI, UCX, UCC, NVSHMEM), and Deep Learning frameworks such as TensorFlow/Pytorch.

  • Review , design, and implement features to enhance compiler features to support the NVIDIA networking ecosystem.

  • Research, design and develop hardware features relevant to scientific, Deep learning, and data-intensive workloads.

What we need to see

  • Ph.D, Masters, or Bachelors in , in computer science, computer engineering, or a closely related field or equivalent experience.

  • 8+ years of experience in parallel programming models, and/or network architecture.

  • Background in algorithm design, system programming, and computer architecture

  • Strong programming and software development skills

  • Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment

Ways to stand out from the crowd:

  • Deep understanding of technology and passion for what you do

  • Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic matrix environment

  • Background with designing communication middleware for high-performance computing systems, including InfiniBand, DPUs, Ethernet, and Shared Memory

  • Experience developing and implementing features for compilers, optimizations for compilers, particularly Clang/LLVM, and NVIDIA compilers and experience implementing communications libraries, particularly MPI, OpenSHMEM, NCCL, NVSHMEM, UCX, UCC, or PGAS

  • Background with CUDA programming and NVIDIA GPUs and programming models for emerging architectures including hierarchical heterogeneous memory systems and accelerators.

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

ByteDance - Research Scientist in Multimodal Graduate (Applied Machine Learning) - 2024 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Anavation - AI Specialist

Anavation

Chantilly, Virginia, United States (On-Site)
4 Months ago
NVIDIA - AI Computing Architect Intern - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
3 Months ago
Homa games - Senior Machine Learning Engineer

Homa games

Paris, Île-de-France, France (On-Site)
9 Months ago
ByteDance - Research Scientist in ML Systems

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Riot Games - Senior Technical Product Manager - Global Player Support

Riot Games

Los Angeles, California, United States (On-Site)
3 Months ago
ByteDance - Senior Research Scientist- Foundation Model, Vision and Language

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Riot Games - Principal Software Engineer, Product Tech-Lead - Unpublished R&D Product

Riot Games

Dublin, County Dublin, Ireland (On-Site)
5 Months ago
Meta - Software Engineer (Leadership) - Machine Learning

Meta

Redmond, Washington, United States (Remote)
5 Months ago
Synaptics  Inc orporated - Sr. Systems Engineer, Wireless Modem

Synaptics Inc orporated

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Flying Bark Productions - Rigging & Animation Software Developer

Flying Bark Productions

New South Wales, Australia (Hybrid)
2 Months ago
ByteDance - Video Analysis and Quality Algorithm Engineer - 2023 Start (MS)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
NVIDIA - Senior AI-HPC Storage Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Google - Staff Software Engineer, Core Machine Learning, Google Cloud

Google

Kirkland, Washington, United States (On-Site)
5 Months ago
Seedify - AI Product Manager

Seedify

London, England, United Kingdom (Remote)
3 Months ago
VGW - Machine Learning Engineer

VGW

Perth, Western Australia, Australia (On-Site)
1 Month ago
Impact Analytics - R&D Architect/Sr. Architect - Artificial Intelligence

Impact Analytics

Bengaluru, Karnataka, India (On-Site)
7 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Google - Staff Software Engineer, Core Machine Learning, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

Luxoft - Calypso Techno-Functional Consultant

Luxoft

New York, New York, United States (On-Site)
5 Months ago
Next Level Business Services - SAP PI/PO LEAD

Next Level Business Services

Scottsdale, Arizona, United States (On-Site)
5 Months ago
ByteDance - Student Researcher (Foundation Models - Reasoning, Planning & Agent) - Doubao (Seed) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Level AI - Enterprise Account Executive  (Remote, US)

Level AI

United States (Remote)
6 Months ago
Niantic - Software Engineer, Mobile Native AR Mapping

Niantic

San Francisco, California, United States (Hybrid)
5 Months ago
Ello - Tech Lead, Machine Learning

Ello

San Francisco, California, United States (On-Site)
5 Months ago
Netflix - Data Scientist (L5) - Product Promotion & Algorithm Performance

Netflix

Los Gatos, California, United States (On-Site)
2 Months ago
Epic Games - Senior Data Analyst, Game Platform

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago
Luxoft - Senior GPU Compiler Software Development Engineer

Luxoft

Italy, New York, United States (Remote)
4 Months ago
The Walt Disney Company - Sports Data Engineer

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Senior ASIC Verification Engineer - GPU

NVIDIA

Santa Clara, California, United States (Hybrid)
2 Months ago
Scanline VFX - Pipeline Supervisor

Scanline VFX

Mumbai, Maharashtra, India (Hybrid)
3 Months ago
NVIDIA - Senior Signal and Power Integrity Engineer - Hardware

NVIDIA

Canada (Hybrid)
3 Months ago
Nielsen Holdings - Backend Developer - Java (P3)

Nielsen Holdings

Gurugram, Haryana, India (Hybrid)
4 Months ago
Fluence - Chief Battery Energy Storage System (BESS) Engineer

Fluence

Arlington, Virginia, United States (Hybrid)
6 Months ago
NVIDIA - Backend Engineer, Full Chip Layout

NVIDIA

(Remote)
1 Month ago
ByteDance - GPU/AI Application Platform Engineer Intern (Server Platform)

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
NVIDIA - ASIC Design Efficiency Engineer - New College Grad 2025

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Riot Games - Senior Manager, Technical Product Management - VALORANT, Foundations

Riot Games

Los Angeles, California, United States (On-Site)
3 Months ago
NVIDIA - Architect - GPU Performance Analysis

NVIDIA

Bengaluru, Karnataka, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Shanghai, Shanghai, China (On-Site)

India (Remote)

Santa Clara, California, United States (Remote)

Santa Clara, California, United States (Remote)

Santa Clara, California, United States (Remote)

California, United States (Remote)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug