Senior Site Reliability Engineer - GPU Clusters

3 Months ago • 7-10 Years • DevOps • $184,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior Site Reliability Engineer to lead the design, deployment, and management of large-scale GPU clusters for AI workloads. Responsibilities include improving infrastructure provisioning, ensuring high uptime and QoS, supporting a multi-cloud environment (AWS, GCP, Azure, OCI, on-prem), defining SLOs/SLIs, conducting RCA, and participating in on-call rotations. The ideal candidate has 7+ years of software engineering experience, including 3+ years managing GPU clusters, expertise in cloud services, Kubernetes/Docker, and proficiency in programming languages (Python, Go, Ruby). The role involves collaborating with researchers and engineers to optimize cluster performance and scalability.
Must have:
  • 7+ years software engineering experience
  • 3+ years managing GPU clusters
  • Expertise in cloud services
  • Kubernetes/Docker proficiency
  • Python/Go/Ruby programming skills
  • Strong Linux and TCP/IP knowledge
Good to have:
  • Slurm/BCM experience
  • Container networking/storage expertise
  • Operational excellence in high-performance environments
Perks:
  • Equity
  • Benefits

Job Details

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for phenomenal people like you to help us accelerate the next wave of artificial intelligence. We are seeking a highly skilled and experienced Staff Software Engineer to lead the design, deployment, and management of our large-scale GPU clusters. These clusters will power AI workloads across multiple teams and projects, making a significant impact on the future of machine learning and artificial intelligence at NVIDIA. Join our engineering team and collaborate with researchers, AI engineers, and infrastructure teams to ensure our GPU clusters perform efficiently, scale well, and remain reliable.

The ideal candidate has a passion for operational excellence, automation, and working in a multi-cloud environment. You will collaborate with a diverse and experienced team, constantly improving infrastructure provisioning and resiliency to ensure a high level of service availability.

What you will be doing:

  • Design, deploy and support large-scale, distributed GPU clusters to run high-performance AI and machine learning workloads.

  • Continuously improve infrastructure provisioning, management, and monitoring through automation.

  • Ensure the highest level of uptime and quality of service (QoS) through operational excellence, proactive monitoring, and incident resolution.

  • Support a globally distributed, cloud environment like AWS, GCP, Azure or OCI as well as on prem.

  • Define and implement service level objectives (SLOs) and service level indicators (SLIs) to measure and ensure infrastructure quality.

  • Write high-quality Root Cause Analysis (RCA) reports for production-level incidents and work towards preventing future occurrences.

  • Participate in the team's on-call rotation to support critical infrastructure.

  • Drive the evaluation and integration of new GPU - like GB200 - and cloud technologies to improve system performance.

What we need to see:

  • Minimum BS degree in Computer Science (or equivalent experience), with 7+ years of software engineering experience, including at least 3+ years managing GPU clusters or similar high-performance computing environments.

  • Expertise in designing, deploying, and running production-level cloud services.

  • Proficiency with orchestration and containerization tools like Kubernetes, Docker, or similar.

  • Experience coding/scripting in at least two high-level programming languages (e.g., Python, Go, Ruby).

  • Strong proficiency with Linux operating systems and TCP/IP fundamentals.

  • Proficient in modern CI/CD techniques, GitOps, and Infrastructure as Code (IaC) using tools such as Terraform or Ansible.

  • Diligent with strong communication and documentation skills.

Ways to stand out from the crowd:

  • Experience managing large-scale Slurm and/or BCM deployments in production environments.

  • Expertise in modern container networking and storage architectures.

  • Proven track record to define and drive operational excellence in highly distributed, high-performance environments.

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Iksha Labs - Software Test Engineer

Iksha Labs

Gurugram, Haryana, India (On-Site)
8 Months ago
Enphase Energy - Sr. Staff Engineer Cloud

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Playtika - Application Security Researcher

Playtika

Israel (On-Site)
6 Months ago
ByteDance - Backend Software Engineer

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
GoTo Group - Associate Software Engineer - Marketplace

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
4 Months ago
Nagarro - Cloud Pricing Architect

Nagarro

Germany (Remote)
2 Months ago
Zazz - Data Engineer

Zazz

(Remote)
4 Months ago
Luxoft - Senior Software Support Engineer

Luxoft

(Remote)
6 Months ago
Microsoft - Technical Support Engineer - MySQL or PostgreSQL

Microsoft

Selangor, Malaysia (Hybrid)
1 Month ago
Google - Customer Engineer, Infrastructure Modernization, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Senior Site Reliability Engineer - DGX Cloud

NVIDIA

Santa Clara, California, United States (Remote)
1 Month ago
Dubit - Full Stack Developer

Dubit

Leeds, England, United Kingdom (On-Site)
9 Months ago
Simple Viral Games - Lead Software Developer

Simple Viral Games

Bengaluru, Karnataka, India (On-Site)
10 Months ago
Granicus - Software Engineer 3 - ROR

Granicus

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Velotio Technologies - Software Architect (Data Engineering)

Velotio Technologies

Pune, Maharashtra, India (Remote)
2 Months ago
GoTo Group - Software Engineer - Identity Platform

GoTo Group

Gurugram, Haryana, India (On-Site)
6 Months ago
Rackspace Technology - Site Reliability Engineer / Observability Engineer

Rackspace Technology

Giza, Giza Governorate, Egypt (Remote)
5 Months ago
Highspot - Sr. Backend Engineer, Coaching

Highspot

Hyderabad, Telangana, India (Hybrid)
8 Months ago
Patterned Learning Career - Senior Software Engineer (Rails)

Patterned Learning Career

(Remote)
3 Months ago
Highspot - Sr. Software Development Engineer

Highspot

Hyderabad, Telangana, India (Hybrid)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Westford, Massachusetts, United States

Inkittt - Senior Product Manager, Retention & Renewals

Inkittt

San Francisco, California, United States (On-Site)
9 Months ago
Twitch - Software Engineer II - iOS

Twitch

San Francisco, California, United States (On-Site)
6 Months ago
Netflix - Technical Services Manager, Netflix House - Dallas

Netflix

Texas, United States (On-Site)
1 Month ago
Zoox - Senior/Staff Software Engineer - Simulator

Zoox

Foster City, California, United States (Hybrid)
7 Months ago
PlayStation Global - Senior Director, Live Service Marketing

PlayStation Global

Seattle, Washington, United States (On-Site)
2 Months ago
Nintendo - Sr. Engineer, ML (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
3 Months ago
ByteDance - Software Engineer Graduate (XR Web Platform-PICO)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Netflix - Software Engineer (L5) - Security Platforms Engineering

Netflix

United States (Remote)
1 Month ago
Universal Music - Coordinator, NA Royalty

Universal Music

Franklin, Tennessee, United States (On-Site)
2 Months ago
Nintendo - Forecast & Strategic Planning Analyst

Nintendo

Redmond, Washington, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Nielsen Holdings - Software Engineer - Bigdata (Java/Scala and SQL)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Google - Senior Software Engineer, Site Reliability Engineering, Google Cloud

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
6 Months ago
Microsoft - Principal Software Engineering Manager

Microsoft

(Remote)
1 Month ago
Visa - Staff Data Engineer

Visa

Warsaw, Masovian Voivodeship, Poland (Hybrid)
7 Months ago
CrazyLabs - DevOps Engineer

CrazyLabs

Skopje, Greater Skopje, North Macedonia (On-Site)
1 Month ago
CloudLinux - Senior Python Developer

CloudLinux

Tbilisi, Tbilisi, Georgia (Remote)
2 Months ago
ByteDance - Linux System Engineer

ByteDance

London, England, United Kingdom (On-Site)
2 Months ago
Google - Technical Solutions Engineer, Infrastructure Compute

Google

Pune, Maharashtra, India (On-Site)
1 Month ago
Saviynt - Sr. Principal Software Engineer - Privileged Access Management (PAM)

Saviynt

El Segundo, California, United States (Hybrid)
7 Months ago
The Walt Disney Company - Manager, Software Engineering

The Walt Disney Company

Washington, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug