Outscal Logooutscal logo

Senior Manager, Internal GPU and HPC Computing Clusters

7 Hours ago • 12 Years + • Artificial Intelligence • $272,000 PA - $425,500 PA

Job Summary

Job Description

As a Senior Manager of Internal GPU and HPC Computing Clusters at NVIDIA, you will lead and operate large-scale AI GPU clusters. Responsibilities include building and improving the GPU-accelerated computing ecosystem, supporting researchers with cluster usage and performance optimization, architecting strategies for cluster utilization, pioneering solutions for streamlined support processes, building a future-proof AI computing infrastructure, and collaborating with multi-functional teams for optimization. This role requires strong leadership, problem-solving, and communication skills, along with experience in AI/ML and software development team management. You will be responsible for managing 10,000+ GPUs per support personnel and building a high-performing team focused on operational excellence.
Must have:
  • 12+ years relevant experience
  • 6+ years leading AI/ML teams
  • Exceptional problem-solving skills
  • Strong leadership & communication
  • Experience with large-scale automation
  • Deep learning workflow optimization
Good to have:
  • Machine Learning & Deep Learning knowledge
  • InfiniBand, IBOP, RDMA experience
  • Lustre/GPFS familiarity
  • PyTorch/TensorFlow familiarity
Perks:
  • Highly competitive salaries
  • Comprehensive benefits package
  • Equity

Job Details

At NVIDIA, we constantly innovate to amplify human intelligence. Our invention of the GPU sparked revolutions in gaming, computer graphics, and parallel computing. Now, GPU deep learning is driving modern AI forward. Join our GPU AI/HPC Infrastructure team and lead the design of groundbreaking GPU compute clusters for demanding AI, HPC, and compute-intensive workloads.

In this role, you'll lead and operate substantial AI GPU Clusters at unprecedented scale. You'll build an extraordinary team to optimize datacenter resource usage, drive operational excellence through automation, and create a cost-effective global computing infrastructure. Help us solve strategic challenges and implement methodologies, tools, and metrics for effective resource utilization in a heterogeneous compute environment. Make the choice to join NVIDIA today and shape the future of AI computing!

What you'll be doing:

  • Building and improving our ecosystem around GPU-accelerated computing including developing large scale automation solutions.

  • Supporting our researchers to run their flows on our clusters including performance analysis and optimizations of deep learning workflows. Improving reliability and overall Researcher Productivity.

  • Architect and implement brand new strategies to optimize the utilization of our AI computing clusters, driving operational efficiency and resource maximization.

  • Pioneer innovative solutions to streamline support processes, enabling our team to manage an unprecedented scale of GPU resources (10,000+ GPUs per support personnel).

  • Lead the charge in building a future-proof AI computing infrastructure, ensuring seamless scalability and resilience to power groundbreaking AI models and applications.

  • Collaborate with multi-functional teams to identify bottlenecks and opportunities for optimization, continuously improving the performance and cost-effectiveness of our AI computing operations.

  • Empower your team with the tools, processes, and standard methodologies necessary to thrive in a dynamic, high-intensity environment, fostering a culture of operational excellence and continuous improvement

What we need to see:

  • Bachelor’s degree or equivalent experience in Computer Science, Electrical Engineering or related field or similar experience.

  • Minimum 6 years of experience leading AI/ML and software development teams as a people manager with 12+ overall years of relevant experience.

  • Consistent track record of leading high-performance teams in delivering innovative solutions to complex computational challenges, with a demonstrated ability to drive operational excellence and continuous improvement.

  • Exceptional problem-solving skills, with the ability to analyze complex systems, identify bottlenecks, and implement scalable solutions that can accommodate the ever-increasing demands of AI computing.

  • Shown leadership capabilities, with the ability to inspire and motivate multi-functional teams, fostering a culture of collaboration, innovation, and steadfast pursuit of operational excellence.

  • Strong communication and collaborator management skills, enabling you to effectively articulate technical concepts to diverse audiences and align priorities across the organization.

  • A passion for pushing the boundaries of what's possible in AI computing, with an aim to continuously explore and implement emerging technologies and standard processes to maintain our competitive edge.

  • Strong people management and team-building skills. Can coach and grow talent, cultivate healthy engineering culture, and attract/retain talent. Ability to build a diverse, broad, and impactful team.

Ways to stand out from the crowd:

  • Experience with Machine Learning and Deep Learning concepts, algorithms and models

  • Familiarity with InfiniBand with IBOP and RDMA

  • Understanding of fast, distributed storage systems like Lustre and GPFS for AI/HPC workloads

  • Familiarity with deep learning frameworks like PyTorch and TensorFlow

NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most experienced and versatile people in the world working for us and, due to unprecedented growth, our extraordinary engineering teams are growing fast. If you're a creative and autonomous engineer with real passion for technology, we want to hear from you.

The base salary range is 272,000 USD - 425,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Genies - ML Engineering Intern

Genies

Los Angeles, California, United States (Hybrid)
10 Hours ago
The Walt Disney Company - Senior Machine Learning Engineer - Ad Platforms

The Walt Disney Company

San Francisco, California, United States (On-Site)
1 Month ago
Ubisoft - Research Student - Ubisoft La Forge

Ubisoft

Shanghai, Shanghai, China (On-Site)
4 Months ago
Snail Games - Software Engineer - AI/Machine Translation

Snail Games

Beverly Hills, California, United States (Remote)
4 Weeks ago
ION - Software/Artificial Intelligence Engineer - Graduate Development Program

ION

Pisa, Tuscany, Italy (Hybrid)
2 Months ago
Hitachi - Senior AI Data Scientist

Hitachi

Chennai, Tamil Nadu, India (On-Site)
5 Months ago
Magic Media - Senior Automation Engineer

Magic Media

İstanbul, İstanbul, Türkiye (Remote)
11 Hours ago
PlayStation Global - Sr. ML Software Engineer

PlayStation Global

United States (Remote)
11 Hours ago
Meta - Research Scientist Intern, Language and Multimodal Research for MetaAI (PhD)

Meta

Bellevue, Washington, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PlayStation Global - Machine Learning Engineer for Game Technology

PlayStation Global

London, England, United Kingdom (On-Site)
8 Months ago
Samsung Semiconductor - Senior Principal Engineer, AI/ML Software Compiler

Samsung Semiconductor

San Jose, California, United States (Hybrid)
6 Months ago
Ubisoft - Senior ML Ops - Content Creation Technology Group

Ubisoft

Montreal, Quebec, Canada (On-Site)
2 Months ago
CloudHire - Machine Learning Engineer

CloudHire

India (Remote)
1 Week ago
Ubisoft - Research Student - Ubisoft La Forge

Ubisoft

Shanghai, Shanghai, China (On-Site)
4 Months ago
NVIDIA - PhD Research Intern, Digital Human AI Research

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Months ago
ByteDance - Machine Learning Engineer - Inference

ByteDance

San Jose, California, United States (On-Site)
1 Day ago
PAPAYA - Data Scientist

PAPAYA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
Virtuos - R&D Machine Learning Engineer

Virtuos

China (On-Site)
1 Day ago

Get notifed when new similar jobs are uploaded

Jobs in Washington, United States

The Walt Disney Company - Data Governance Engineer

The Walt Disney Company

New York, New York, United States (On-Site)
1 Month ago
The Walt Disney Company - Associate Product Design Manager – Licensed Hardlines Toys - Preschool

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Day ago
Light Speed Studios - Senior Technical Artist

Light Speed Studios

California, United States (On-Site)
1 Month ago
NVIDIA - Senior Field Application Engineer

NVIDIA

California, United States (Remote)
1 Month ago
Zoox - Senior Software Engineer - High Performance Computing

Zoox

Seattle, Washington, United States (Hybrid)
5 Months ago
GameChanger  - Senior Full Stack Software Engineer, Video Platform

GameChanger

New York, New York, United States (Remote)
5 Days ago
Framestore - FREELANCE: MOTION GRAPHICS & DESIGN - USA

Framestore

Chicago, Illinois, United States (On-Site)
10 Months ago
Bragg - Head of Marketing, US & Canada

Bragg

Las Vegas, Nevada, United States (On-Site)
11 Hours ago
Floor 84 Studio - Intern - Summer Term

Floor 84 Studio

Los Angeles, California, United States (On-Site)
3 Months ago
Schell Games - Senior Game Engineering Manager

Schell Games

Pennsylvania, United States (Hybrid)
11 Hours ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Meta - Software Engineer, Systems ML - SW/HW Co-design

Meta

Fremont, California, United States (Remote)
4 Months ago
ByteDance - Research Scientist Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
Zoox - Senior/Staff Software Engineer - 3D World Generation Pipelines

Zoox

Seattle, Washington, United States (Hybrid)
5 Months ago
Inworld AI - Forward Deployed Engineer - USA

Inworld AI

Mountain View, California, United States (On-Site)
5 Months ago
Saama Technologies,  Inc  - NLP Engineer

Saama Technologies, Inc

(Remote)
4 Weeks ago
Windranger Labs - Technical AI Researcher

Windranger Labs

Singapore (On-Site)
11 Hours ago
Chiselon Technologies   - Data Scientist( ML AI )

Chiselon Technologies

Gurugram, Haryana, India (Hybrid)
4 Months ago
Microsoft - Member of Technical Staff - Full Stack Software Engineer

Microsoft

Redmond, Washington, United States (On-Site)
23 Hours ago
Ubisoft - Senior ML Programmer

Ubisoft

Montreal, Quebec, Canada (On-Site)
1 Week ago
ION - AI Engineer - Graduate Development Program

ION

Pisa, Tuscany, Italy (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Hsinchu, Hsinchu City, Taiwan (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Seoul, South Korea (Hybrid)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Ra'anana, Center District, Israel (On-Site)

Shanghai, Shanghai, China (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Be'er Sheva, South District, Israel (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug