AI and ML Infra Software Engineer, GPU Clusters

3 Months ago • 5 Years + • Artificial Intelligence • $148,000 PA - $287,500 PA

Job Summary

Job Description

NVIDIA seeks an AI/ML Infrastructure Software Engineer to enhance researcher productivity by improving GPU cluster infrastructure. Responsibilities include collaborating with research teams to identify and resolve infrastructure gaps, optimizing performance for high availability and scalability, defining metrics for researcher efficiency, collaborating with diverse teams (researchers, data engineers, DevOps), staying updated on AI/ML advancements, and implementing them within the company. The role requires hands-on experience with HPC infrastructure, accelerated computing, storage, scheduling, networking, and container technologies, expertise in large-scale distributed training, and proficiency in programming languages like Python and Go.
Must have:
  • 5+ years experience in AI/ML and HPC
  • HPC infrastructure expertise
  • Experience with GPU, storage, scheduling
  • Large-scale distributed training expertise (PyTorch, etc.)
  • Proficiency in Python, Go, Bash
Good to have:
  • Experience with cloud platforms (AWS, GCP, Azure)
  • Familiarity with parallel computing frameworks
Perks:
  • Competitive salary
  • Comprehensive benefits package
  • Equity

Job Details

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

We are currently hiring an AI/ML Infrastructure Software Engineer at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you will play a crucial role in boosting productivity for our researchers through implementing advancements across the entire stack. Your primary responsibility will involve working closely with customers to identify and resolve infrastructure gaps, enabling innovative AI and ML research on GPU Clusters. Together, we can create powerful, efficient, and scalable solutions as we shape the future of AI/ML technology!

What you will be doing:

  • Collaborate closely with our AI and ML research teams to understand their infrastructure needs and obstacles, translating those observations into actionable improvements.

  • Monitor and optimize the performance of our infrastructure ensuring high availability, scalability, and efficient resource utilization.

  • Help define and improve important measures of AI researcher efficiency, ensuring that our actions are in line with measurable results.

  • Collaborate with diverse teams, including researchers, data engineers, and DevOps professionals, to build a seamless and coordinated AI/ML infrastructure ecosystem.

  • Stay on top of the latest advancements in AI/ML technologies, frameworks, and effective strategies, and promote their implementation within the company.

What we need to see:

  • BS or equivalent experience in Computer Science or related field, with 5+ years of proven experience in AI/ML and HPC workloads and infrastructure.

  • Hands-on experience in using or operating High Performance Computing (HPC) grade infrastructure as well as in-depth knowledge of accelerated computing (e.g., GPU, custom silicon), storage (e.g., Lustre, GPFS, BeeGFS), scheduling & orchestration (e.g., Slurm, Kubernetes, LSF), high-speed networking (e.g., Infiniband, RoCE, Amazon EFA), and containers technologies (Docker, Enroot).

  • Expertise in running and optimizing large-scale distributed training workloads using PyTorch (DDP, FSDP), NeMo, or JAX. Also, possess a deep understanding of AI/ML workflows, encompassing data processing, model training, and inference pipelines.

  • Proficiency in programming & scripting languages such as Python, Go, Bash, as well as familiarity with cloud computing platforms (e.g., AWS, GCP, Azure) in addition to experience with parallel computing frameworks and paradigms.

  • Passion for continual learning and keeping abreast of new technologies and effective approaches in the AI/ML infrastructure field.

  • Excellent communication and collaboration skills, with the ability to work effectively with teams and individuals of different backgrounds.

NVIDIA provides competitive salaries and a comprehensive benefits package. Our engineering teams are expanding rapidly due to exceptional growth. If you're a passionate and independent engineer with a love for technology, we want to hear from you.

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Interactive Brokers - Senior Systems Engineer- Microsoft M365/Active Directory

Interactive Brokers

Chicago, Illinois, United States (Hybrid)
6 Months ago
Kaedim - DevOps Engineer

Kaedim

London, England, United Kingdom (On-Site)
7 Months ago
Dream Sports - Director Systems IT

Dream Sports

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Rackspace Technology - AWS Support Engineer L2

Rackspace Technology

Gurugram, Haryana, India (Remote)
1 Month ago
Ajmera Infotech - Kubernetes Experts

Ajmera Infotech

Bengaluru, Karnataka, India (On-Site)
9 Months ago
ByteDance - Research Engineer- Foundation Model AI Platform- San Jose

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Generative AI)

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
Meta - Research Scientist, Computer Vision for Generative AI (PhD)

Meta

Seattle, Washington, United States (On-Site)
5 Months ago
ByteDance - Research Scientist in Foundation Model (Speech & Audio Generation) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Axon - Senior Technical Program Manager, AI

Axon

Seattle, Washington, United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Gearbox Software - Senior Site Reliability Engineer

Gearbox Software

Frisco, Texas, United States (On-Site)
4 Months ago
N-iX - Senior DevOps Engineer

N-iX

Argentina (Remote)
1 Month ago
NVIDIA - Senior HPC Technical Support Engineer - Ethernet

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
ION - Cloud Engineer Kubernetes

ION

Collecchio, Emilia-Romagna, Italy (Hybrid)
6 Months ago
Ajmera Infotech - Senior Azure DevOps Engineer (IaaS)

Ajmera Infotech

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Auros Global - Senior Site Reliability Engineer

Auros Global

United Kingdom (Remote)
1 Month ago
Argus Labs - Site Reliability Engineer (LATAM)

Argus Labs

(Remote)
1 Month ago
Cirrus Logic - Full Stack Developer

Cirrus Logic

Edinburgh, Scotland, United Kingdom (Hybrid)
6 Months ago
ION - Backup System Engineer, Italy

ION

Italy (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

The Walt Disney Company - Principal Ride Control Hardware Engineer

The Walt Disney Company

Glendale, California, United States (On-Site)
4 Months ago
IGN - Lead Product Manager

IGN

Los Angeles, California, United States (Remote)
1 Month ago
Nintendo - Associate Account Administrator

Nintendo

Redmond, Washington, United States (Hybrid)
9 Months ago
The Mill - Technical Artist

The Mill

New York, New York, United States (On-Site)
9 Months ago
CD PROJEKT RED - Senior Engine Programmer

CD PROJEKT RED

Boston, Massachusetts, United States (Hybrid)
6 Months ago
ByteDance - Software Engineer - Data Tech Infrastructure- San Jose

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Trek - Sales Associate

Trek

Arlington, Virginia, United States (On-Site)
2 Months ago
Meta - Data Engineer Intern

Meta

Menlo Park, California, United States (On-Site)
5 Months ago
Barracuda Networks  Inc  - Account Manager (Pennsylvania)

Barracuda Networks Inc

Pennsylvania, United States (Remote)
1 Month ago
Oculus VR - Full Stack Engineer - BigBox

Oculus VR

Washington, United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Inworld AI - Senior Product Manager, AI Engine - USA

Inworld AI

Mountain View, California, United States (On-Site)
6 Months ago
Hudl - Staff Engineer - Machine Learning

Hudl

London, England, United Kingdom (Hybrid)
4 Months ago
ByteDance - LLM Software Engineer/Researcher (Applied Machine Learning)

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
Zoox - Manager, Simulation Traffic & Behavior Modeling

Zoox

Foster City, California, United States (Hybrid)
6 Months ago
Meta - Software Engineer, Systems ML - SW/HW Co-design

Meta

New York, New York, United States (Remote)
5 Months ago
ByteDance - Machine Learning Engineer - Pico Perception

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
NVIDIA - Deep Learning Performance Architect

NVIDIA

Hyderabad, Telangana, India (Hybrid)
2 Months ago
Granicus - Data Scientist 4

Granicus

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Spellbrush - AI Infrastructure Engineer

Spellbrush

San Francisco, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug