Senior Solution Architect, HPC and AI

2 Months ago • 8 Years + • Artificial Intelligence

Job Summary

Job Description

NVIDIA seeks a Senior HPC/AI Solutions Architect to build robust AI/HPC infrastructure for new and existing customers. Responsibilities include supporting operational and reliability aspects of large-scale AI clusters, focusing on performance, training stability, and monitoring. This role involves the entire service lifecycle, from design and deployment to operation and refinement. The architect will understand AI workloads and their interaction with system components like networking and storage. They'll maintain live services, measure progress, and design solutions for robust training. Collaboration with internal teams, including bug reporting and improvement suggestions, is crucial. Significant worldwide travel is required for on-site customer visits.
Must have:
  • 8+ years exp. in CS/related field
  • AI training experience (NLP/LLM/VLA)
  • Production software deployment experience
  • Strong communication and presentation skills
  • NVIDIA technology understanding
  • Python/C++ software development
Good to have:
  • Experience with large transformer-based architectures
  • Large-scale distributed DL training
  • HPC systems understanding (InfiniBand, storage)
  • Cloud experience (AWS, Azure, GCP)
  • Parallel filesystems expertise (Lustre, GPFS)
  • Experience with Slurm, Docker/Kubernetes, etc.

Job Details

NVIDIA is the world leader in computer graphics, artificial intelligence, and accelerated computing. For over 25 years, we have been at the forefront of research and engineering around the greatest advances in technology. Our history of innovation drives us to solve the worlds hardest problems.

NVIDIA is looking for Senior HPC/AI Solutions Architect to join its NVIDIA Infrastructure Specialists Team. Academic and commercial groups around the world are using NVIDIA products to revolutionize deep learning and data analytics, and to power data centers. Join the team building many of the largest and fastest AI/HPC systems in the world! We are looking for someone with the ability to work on a dynamic customer focused team that requires excellent interpersonal skills. This role will be interacting with customers, partners and internal teams, to analyze, define and implement large scale AI/HPC projects. The scope of these efforts includes a combination of Networking, System Design and Automation and being the face to the customer!

What You’ll Be Doing:

  • Primary responsibilities will include building robust AI/HPC infrastructure for new and existing customers.

  • Support operational and reliability aspects of large-scale AI clusters, focusing on performance at scale, training stability, real-time monitoring, logging, and alerting.

  • Engage in and improve the whole lifecycle of services from inception and design through deployment, operation, and refinement.

  • Your primary focus would be on understanding the AI workload and how it interacts with other parts of the system like networking, storage, deep learning frameworks, data cleaning tools, etc.

  • Help maintain services once they are live by measuring and monitoring progress of AI jobs and helping engineering design solutions for more robust training at scale.

  • Provide feedback to internal teams such as opening bugs, documenting workarounds, and suggesting improvements.

  • Worldwide travel is required for on-site visits with customers.

What We Need to See:

  • BS/MS/PhD or equivalent experience in Computer Science, Data Science, Electrical/Computer Engineering, Physics, Mathematics, other Engineering fields with at least 8 years work or research experience with Python/ C++ / other software development.

  • Track record of medium to large scale AI training and understanding of key libraries used for NLP/LLM/VLA training (NeMo Framework, DeepSpeed etc.)

  • Experience with integration and deployment of software products in production enterprise environments, and microservices software architecture.

  • You are excited to work with multiple levels and teams across organisations (Engineering, Product, Sales and Marketing team) Capable of working in a constantly evolving environment without losing focus. Ability to multitask in a fast-paced environment.

  • Driven with strong analytical and problem-solving skills. Strong time-management and organization skills for coordinating multiple initiatives, priorities and implementations of new technology and products into very sophisticated projects.

  • You are a self-starter with demeanour for growth, passion for continuous learning and sharing findings across the team.

  • Technical leadership and strong understanding of NVIDIA technologies, and success in working with customers.

  • Excellent verbal, written communication, and technical presentation skills in English.

Ways to Stand Out from The Crowd:

  • Experience working with large transformer-based architectures for NLP, CV, ASR or other. Experience running large scale distributed DL training.

  • Understanding of HPC systems: data center design, high speed interconnect InfiniBand, Cluster Storage and Scheduling related design and/or management experience.

  • Proven experience with one or more Tier-1 Clouds (AWS, Azure, GCP or OCI) and cloud-native architectures and software.

  • Expertise with parallel filesystems (e.g. Lustre, GPFS, BeeGFS, WekaIO) and high-speed interconnects (InfiniBand, Omni Path, and Gig-E).

  • Strong coding and debugging skills, and demonstrated expertise in one or more of the following areas: Machine Learning, Deep Learning, Slurm, Docker/Kubernetes, Kubernetes, Singularity, MPI, MLOps, LLMOps, Ansible, Terraform, and other high-performance AI cluster solutions.

  • Technical leadership and strong understanding of NVIDIA technologies including GX Cloud, NVIDIA AI Enterprise AI Software, Base Command Manager, NEMO and NVIDIA Inference Microservices. Success in working with customers using NVIDIA technologies.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking individuals in the world working for us. If you're creative and autonomous, we want to hear from you.

#LI-Hybrid

Similar Jobs

Rackspace Technology - Machine Learning Architect (AWS)

Rackspace Technology

(Remote)
3 Months ago
Netflix - Software Engineer L4/L5, Training Platform, Machine Learning Platform

Netflix

California, United States (Remote)
3 Months ago
ByteDance - Research Scientist Graduate (Foundation Model - Generative AI) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
NVIDIA - Senior Packaging Technical Engineer - Hardware

NVIDIA

United States (Remote)
3 Weeks ago
NVIDIA - Senior Physical Design Methodology Engineer, PPA Fusion Compiler

NVIDIA

Hillsboro, Oregon, United States (On-Site)
1 Month ago
Inworld AI - AI Trainer (Contractor) - Writing & Gaming

Inworld AI

Vancouver, British Columbia, Canada (Remote)
1 Month ago
NVIDIA - Full Stack Developer, AI and LLM

NVIDIA

California, United States (Hybrid)
4 Weeks ago
Zoox - Senior Software Engineer: Secure Embedded Operating Systems

Zoox

Foster City, California, United States (On-Site)
6 Months ago
ByteDance - Software Development Engineer - Large Language Models, AML

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
ByteDance - Research Scientist Graduate (Foundation Model - Generative AI) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Tencent - Senior Staff Researcher

Tencent

California, United States (On-Site)
1 Month ago
Hedra - Machine Learning Engineer (CUDA)

Hedra

New York, New York, United States (On-Site)
1 Month ago
Meta - Software Engineer (Technical Leadership)

Meta

Burlingame, California, United States (On-Site)
5 Months ago
ByteDance - Software Engineer in Machine Learning Systems

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
NVIDIA - Senior Digital Design Verification Engineer - Hardware

NVIDIA

Canada (On-Site)
2 Months ago
ByteDance - Principal Product Manager - IaaS AI Infra

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model AI Platform) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

Menlo Park, California, United States (On-Site)
5 Months ago
NVIDIA - Senior Math Libraries Engineer – AI and HPC

NVIDIA

Santa Clara, California, United States (Remote)
2 Months ago
ByteDance - Research Scientist, Foundation Model, Speech Understanding

ByteDance

San Jose, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Tel Aviv-Yafo, Tel Aviv District, Israel

Overwolf - Marketing Designer

Overwolf

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
NVIDIA - Senior Software Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
SuperPlay - User Acquisition Manager

SuperPlay

Tel Aviv District, Israel (On-Site)
3 Weeks ago
Aristocrat Gaming - Data Owner & Analyst - ERP D365

Aristocrat Gaming

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
2 Weeks ago
NVIDIA - Manager, Software Engineering

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
NVIDIA - Senior Chip Design Engineer

NVIDIA

Be'er Sheva, South District, Israel (On-Site)
2 Months ago
SciPlay - Assistant Controller

SciPlay

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
NVIDIA - System Linux Administrator

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
3 Months ago
NVIDIA - Manager, Software Verification

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
NVIDIA - Senior Firmware Verification Engineer, PCIe

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Inworld AI - Senior Product Manager, AI Engine - USA

Inworld AI

Mountain View, California, United States (On-Site)
6 Months ago
NVIDIA - Senior Computer Architect - Deep Learning

NVIDIA

Canada (On-Site)
2 Months ago
Airlab Inc  - Artificial Intelligence Researcher

Airlab Inc

Quebec, Canada (On-Site)
1 Month ago
Pika - Research Scientist

Pika

Palo Alto, California, United States (On-Site)
4 Months ago
N-iX - Senior/Middle Python Developer in AI Services

N-iX

Poland (Remote)
1 Week ago
Spell Brush - AI Infrastructure Engineer

Spell Brush

San Francisco, California, United States (On-Site)
1 Month ago
NVIDIA - Global Developer Relations Account Manager – Ansys

NVIDIA

Canada (On-Site)
2 Months ago
Electronic Arts - Senior Machine Learning Engineer

Electronic Arts

Hyderabad, Telangana, India (On-Site)
1 Month ago
HP - AI Lab – ML Engineer, Model Optimization

HP

Sant Cugat Del Vallès, Catalonia, Spain (On-Site)
7 Months ago
NVIDIA - Senior Solution Engineer, Mission Control

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug