Outscal Logooutscal logo

Senior Site Reliability Engineer - GPU Clusters

1 Month ago • 7-10 Years • DevOps • $184,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior Site Reliability Engineer to lead the design, deployment, and management of large-scale GPU clusters for AI workloads. Responsibilities include improving infrastructure provisioning, ensuring high uptime and QoS, supporting a multi-cloud environment (AWS, GCP, Azure, OCI, on-prem), defining SLOs/SLIs, conducting RCA, and participating in on-call rotations. The ideal candidate has 7+ years of software engineering experience, including 3+ years managing GPU clusters, expertise in cloud services, Kubernetes/Docker, and proficiency in programming languages (Python, Go, Ruby). The role involves collaborating with researchers and engineers to optimize cluster performance and scalability.
Must have:
  • 7+ years software engineering experience
  • 3+ years managing GPU clusters
  • Expertise in cloud services
  • Kubernetes/Docker proficiency
  • Python/Go/Ruby programming skills
  • Strong Linux and TCP/IP knowledge
Good to have:
  • Slurm/BCM experience
  • Container networking/storage expertise
  • Operational excellence in high-performance environments
Perks:
  • Equity
  • Benefits

Job Details

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for phenomenal people like you to help us accelerate the next wave of artificial intelligence. We are seeking a highly skilled and experienced Staff Software Engineer to lead the design, deployment, and management of our large-scale GPU clusters. These clusters will power AI workloads across multiple teams and projects, making a significant impact on the future of machine learning and artificial intelligence at NVIDIA. Join our engineering team and collaborate with researchers, AI engineers, and infrastructure teams to ensure our GPU clusters perform efficiently, scale well, and remain reliable.

The ideal candidate has a passion for operational excellence, automation, and working in a multi-cloud environment. You will collaborate with a diverse and experienced team, constantly improving infrastructure provisioning and resiliency to ensure a high level of service availability.

What you will be doing:

  • Design, deploy and support large-scale, distributed GPU clusters to run high-performance AI and machine learning workloads.

  • Continuously improve infrastructure provisioning, management, and monitoring through automation.

  • Ensure the highest level of uptime and quality of service (QoS) through operational excellence, proactive monitoring, and incident resolution.

  • Support a globally distributed, cloud environment like AWS, GCP, Azure or OCI as well as on prem.

  • Define and implement service level objectives (SLOs) and service level indicators (SLIs) to measure and ensure infrastructure quality.

  • Write high-quality Root Cause Analysis (RCA) reports for production-level incidents and work towards preventing future occurrences.

  • Participate in the team's on-call rotation to support critical infrastructure.

  • Drive the evaluation and integration of new GPU - like GB200 - and cloud technologies to improve system performance.

What we need to see:

  • Minimum BS degree in Computer Science (or equivalent experience), with 7+ years of software engineering experience, including at least 3+ years managing GPU clusters or similar high-performance computing environments.

  • Expertise in designing, deploying, and running production-level cloud services.

  • Proficiency with orchestration and containerization tools like Kubernetes, Docker, or similar.

  • Experience coding/scripting in at least two high-level programming languages (e.g., Python, Go, Ruby).

  • Strong proficiency with Linux operating systems and TCP/IP fundamentals.

  • Proficient in modern CI/CD techniques, GitOps, and Infrastructure as Code (IaC) using tools such as Terraform or Ansible.

  • Diligent with strong communication and documentation skills.

Ways to stand out from the crowd:

  • Experience managing large-scale Slurm and/or BCM deployments in production environments.

  • Expertise in modern container networking and storage architectures.

  • Proven track record to define and drive operational excellence in highly distributed, high-performance environments.

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Nielsen Holdings - Senior /Lead/ DOE-Full stack ( Java, Go lang, Ruby, Javascript, Reactjs, AWS, DBMS, Postgres)

Nielsen Holdings

Mumbai, Maharashtra, India (Hybrid)
5 Months ago
Dubit - Full Stack Developer

Dubit

Leeds, England, United Kingdom (On-Site)
7 Months ago
seeking alpha - Senior Backend Data Developer

seeking alpha

Portugal (Remote)
3 Months ago
Velotio Technologies - Senior DevOps Engineer (GCP)

Velotio Technologies

Maharashtra, India (Remote)
1 Week ago
Lingo Kids LLC - Talent Sourcer

Lingo Kids LLC

Madrid, Community Of Madrid, Spain (Hybrid)
2 Weeks ago
Mistplay - Senior DevOps Engineer II

Mistplay

Toronto, Ontario, Canada (Hybrid)
5 Days ago
PwC - AWS DataOps Engineer

PwC

Bengaluru, Karnataka, India (On-Site)
5 Months ago
CData Software - Platform Engineer

CData Software

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Nielsen Holdings - Senior Software Engineer (Java/Scala, Spark, Kubernetes, AWS)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
NVIDIA - Senior DevOps Engineer

NVIDIA

Ra'anana, Center District, Israel (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Meta - Product Security Engineer

Meta

New York, New York, United States (On-Site)
4 Months ago
2K - Senior Server Engineer

2K

Novato, California, United States (On-Site)
6 Months ago
Tesla - Senior Software QA Engineer

Tesla

Brandenburg, Germany (On-Site)
1 Month ago
The Walt Disney Company - Sr Streaming Media Engineer

The Walt Disney Company

New York, New York, United States (On-Site)
1 Month ago
seeking alpha - Senior Ruby on Rails Developer

seeking alpha

Ukraine (Remote)
1 Month ago
seeking alpha - Senior Backend Data Developer

seeking alpha

Poland (Remote)
3 Months ago
Ruby game studio - 3D Game Artist

Ruby game studio

İzmir, İzmir, Türkiye (On-Site)
3 Weeks ago
Match Group - 機械学習エンジニア(Machine Learning Engineer)

Match Group

Tokyo, Japan (Hybrid)
5 Months ago
Ruby game studio - Game Designer (on-site)

Ruby game studio

İzmir, İzmir, Türkiye (On-Site)
5 Months ago
Appirits - Web Engineer

Appirits

Shibuya, Tokyo, Japan (Hybrid)
20 Hours ago

Get notifed when new similar jobs are uploaded

Jobs in Westford, Massachusetts, United States

Canva - Revenue Operations Lead

Canva

Seattle, Washington, United States (Remote)
1 Month ago
Daybreak Game Company LLC - Environment Artist

Daybreak Game Company LLC

Austin, Texas, United States (Remote)
1 Month ago
Whatnot - Platform Engineer

Whatnot

San Francisco, California, United States (Remote)
5 Months ago
AI Fund - Content Marketing Manager

AI Fund

United States (On-Site)
5 Months ago
Haptic - Lead Gameplay Software Engineer

Haptic

Dallas, Texas, United States (Remote)
2 Months ago
Meta - Software Engineer, Product

Meta

New York, New York, United States (Remote)
4 Months ago
Fliff  Inc  - Human Resources Director

Fliff Inc

Austin, Texas, United States (On-Site)
8 Months ago
The Walt Disney Company - Software Engineer

The Walt Disney Company

Orlando, Florida, United States (On-Site)
1 Month ago
The Walt Disney Company - Sr Software Engineer (Roku/BrightScript/SceneGraph)

The Walt Disney Company

New York, New York, United States (On-Site)
4 Months ago
Next Level Business Services - Web Development

Next Level Business Services

Moline, Illinois, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Wargaming - DevOps Engineer

Wargaming

Belgrade, Serbia (On-Site)
3 Months ago
Trend Micro - (Sr.) Cloud Developer (Vision One)

Trend Micro

Taipei City, Taiwan (On-Site)
5 Months ago
The Walt Disney Company - Lead Software Engineer (Identity)

The Walt Disney Company

Seattle, Washington, United States (On-Site)
4 Months ago
Nagarro - Associate Principal Engineer

Nagarro

Sri Lanka (Remote)
5 Months ago
NVIDIA - Senior Production Engineer - Storage

NVIDIA

Australia (Remote)
8 Hours ago
ARHS - Application Engineer/Administrator

ARHS

The Hague, South Holland, Netherlands (On-Site)
5 Months ago
Luxoft - Senior Java Developer

Luxoft

Pune, Maharashtra, India (On-Site)
4 Months ago
Hashlist - Senior Data Engineer

Hashlist

Pune, Maharashtra, India (Hybrid)
4 Months ago
Next Level Business Services - Pivotal cloud Architect

Next Level Business Services

Dearborn, Michigan, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Hsinchu, Hsinchu City, Taiwan (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Seoul, South Korea (Hybrid)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Ra'anana, Center District, Israel (On-Site)

Shanghai, Shanghai, China (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Be'er Sheva, South District, Israel (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug