AI Network System Architect

4 Days ago • 2 Years + • Artificial Intelligence

Job Summary

Job Description

NVIDIA seeks a Senior AI Network System Architect to design and develop next-generation networking products for high-performance and ML/AI computing. Responsibilities include investigating emerging technologies in ML/AI, executing workloads, profiling and analyzing bottlenecks, optimizing communication libraries (NCCL, UCX), conceptualizing next-generation networking products, developing simulation models, and collaborating with multi-functional teams. The role requires expertise in ML/AI workloads, distributed training, large-scale network behavior, and simulation environments. Experience with communication libraries, network protocols (InfiniBand, IP, TCP, RoCE), and programming languages (Python, C++) is highly desirable.
Must have:
  • M.Sc./Ph.D. in CS/CE/EE
  • 2+ years experience in computer networks
  • Expertise in ML/AI workloads
  • Understanding of large-scale network behavior
  • Simulation environment development
  • Problem-solving and critical thinking
Good to have:
  • Knowledge of NCCL, UCX, UCC
  • Knowledge of InfiniBand, IP, TCP, RoCE
  • Experience with Python, C++, Docker
  • System engineering expertise
  • Experience with DLRM, LLM, or generative AI

Job Details

Our technology has no boundaries! NVIDIA is building the world’s most groundbreaking and state-of-the-art accelerated computing platforms. Because of our work, scientists, researchers, and engineers can advance their ideas. We pioneered a supercharged form of computing loved by the fastest-paced computer users in the world - scientists, designers, artists, and gamers.

We seek a highly motivated Senior AI Network System Architect to join our team of experts and help shape the future of high-performance and ML / AI computing. Our next-generation Infiniband, NVLink, and Ethernet systems will be at the forefront of connecting and powering the world's most advanced AI clusters. As an AI system architect at NVIDIA, you will have the opportunity to work on some of the most cutting-edge technology and help drive the innovation of our next-generation networks that top researchers and engineers worldwide will use.

What You’ll Be Doing:

  • Investigating emerging technologies and methodologies in ML and AI to discern their interactions with network infrastructure.

  • Executing workloads on AI systems, conducting profiling, and analyzing bottlenecks and possible enhancements.

  • Conducting research and implementing optimizations for communication libraries like NCCL and UCX.

  • Spearheading the conceptualization of next-generation networking products tailored to support and accelerate state-of-the-art ML workloads.

  • Develop models for simulations, analyze simulation results, and develop optimization algorithms.

  • Collaborate with multi-functional teams, including other architecture teams, logic design, system software, firmware, and ML research teams, to ensure the successful execution of the project.

What We Need To See:

  • M.Sc, or Ph. D degree in Computer Science, Computer Engineering, or Electrical Engineering.

  • At least 2+ years of industry or research experience in computer networks.

  • Extensive expertise in ML/AI workloads, particularly in distributed training.

  • Excellent understanding of large-scale network behavior and the effect of distributed computing workloads on the network.

  • Experience in the development of simulation environments.

  • Great problem-solving and critical-thinking skills.

  • Ability to thrive in a fast-paced and dynamic environment is necessary.

  • Work concurrently with multiple groups in the organization.

Ways To Stand Out Of The Crowd:

  • Knowledge of communication libraries such as NCCL, UCX, and UCC.

  • Good knowledge of network protocols - such as InfiniBand, IP, TCP, RoCE, and network topologies.

  • Experience with Python, C++, and dockers.

  • Expertise in system engineering, operations research, and intricate hardware-software integrated systems.

  • Demonstrated experience in DLRM, LLM or other generative AI.

NVIDIA has some of the most forward-thinking and hardworking people in the world working for us, and due to unprecedented growth, our world-class engineering teams are growing fast. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.

We are committed to fostering a diverse work environment and are proud to be an equal-opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform essential job functions, and receive other benefits and privileges of employment. Please contact us to request accommodation.

Similar Jobs

NVIDIA - Payroll Specialist

NVIDIA

Shanghai, Shanghai, China (On-Site)
24 Minutes ago
Social Discovery Group - Senior NLP Engineer

Social Discovery Group

Poland (Remote)
5 Months ago
Epic Games - Animation Tools Programmer

Epic Games

Canada (On-Site)
16 Hours ago
Netflix - Full-Stack Engineer (L5)

Netflix

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
Vigaet - Machine Learning Engineer-Internship

Vigaet

Bengaluru, Karnataka, India (On-Site)
1 Year ago
The Walt Disney Company - Principal Machine Learning Engineer

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Months ago
Canva - Senior Computer Vision Engineer - Photo AI

Canva

Vienna, Vienna, Austria (Remote)
1 Week ago
Pika - Research Scientist

Pika

Palo Alto, California, United States (On-Site)
4 Months ago
AI Fund - Head of Engineering

AI Fund

United States (Remote)
4 Days ago
NVIDIA - Solutions Architect, AI and ML

NVIDIA

Redmond, Washington, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Riot Games - Staff Software Engineer (Services) - League of Legends, Motivations

Riot Games

Los Angeles, California, United States (On-Site)
6 Months ago
Altagram Group - Data Science Internship/Workstudent

Altagram Group

Germany (On-Site)
2 Weeks ago
Epic Games - Senior Machine Learning Rendering Programmer

Epic Games

Vancouver, British Columbia, Canada (On-Site)
3 Weeks ago
Nextbrain - Computer Vision Engineer

Nextbrain

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Streamline Media Group  Inc  - Lead Game Programmer

Streamline Media Group Inc

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
8 Months ago
Wargaming - Game Data Analyst (World of Tanks)

Wargaming

Prague, Prague, Czechia (On-Site)
1 Month ago
Google - Staff Software Engineer, Google Cloud Platforms

Google

Kirkland, Washington, United States (On-Site)
3 Months ago
ByteDance - Software Engineer, Video-On-Demand

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Starkflow - Full Stack Architect

Starkflow

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Yokne'am Illit, North District, Israel

Playtika - Game Economy Manager

Playtika

Israel (On-Site)
3 Weeks ago
Plarium - Data Architect

Plarium

Herzliya, Tel Aviv District, Israel (On-Site)
2 Months ago
NVIDIA - Senior Board Design Hardware Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
1 Month ago
NVIDIA - Senior Chip Design Verification Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Weeks ago
NVIDIA - Senior Physical Design Backend Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
2 Months ago
Playtika - Growth Ventures-Director of Marketing

Playtika

Israel (On-Site)
4 Months ago
NVIDIA - Senior Board Design Hardware Engineer

NVIDIA

Ra'anana, Center District, Israel (On-Site)
2 Weeks ago
NVIDIA - Software Manager, Golang Kubernetes

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
SciPlay - Marketing BI Developer

SciPlay

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Weeks ago
NVIDIA - Firmware Manager

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Genies - Backend Engineer Intern (LLM)

Genies

San Mateo, California, United States (Hybrid)
2 Weeks ago
King - Senior AI/ML Engineer

King

Stockholm, Stockholm County, Sweden (On-Site)
17 Hours ago
ByteDance - Solutions Architect

ByteDance

Gurugram, Haryana, India (On-Site)
3 Weeks ago
Interface AI - Staff Software Engineer - Mobile

Interface AI

United States (Remote)
2 Months ago
Spellbrush - AI Infrastructure Engineer

Spellbrush

San Francisco, California, United States (On-Site)
3 Weeks ago
Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

Menlo Park, California, United States (On-Site)
5 Months ago
NVIDIA - Deep Learning Intern - Fall 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
25 Minutes ago
Microsoft - Member of Technical Staff, AI - Pre-Training

Microsoft

Redmond, Washington, United States (On-Site)
3 Weeks ago
ByteDance - Research Scientist- Foundation Model, Generative AI

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
RoofStack - AI/ML Engineer

RoofStack

İstanbul, İstanbul, Türkiye (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Hanoi, Hanoi, Vietnam (On-Site)

Shenzhen, Guangdong Province, China (On-Site)

Bengaluru, Karnataka, India (On-Site)

Shanghai, Shanghai, China (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Shanghai, Shanghai, China (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug