Outscal Logooutscal logo

Senior Manager, Internal GPU and HPC Computing Clusters

20 Hours ago • 12 Years + • Artificial Intelligence • $272,000 PA - $425,500 PA

Job Summary

Job Description

Lead and operate large-scale AI GPU clusters at NVIDIA. This role involves building and improving the GPU-accelerated computing ecosystem, supporting researchers with performance analysis and optimization of deep learning workflows, and enhancing reliability and researcher productivity. Responsibilities include architecting and implementing strategies for optimizing cluster utilization, pioneering innovative support solutions, building a future-proof AI computing infrastructure, and collaborating with multi-functional teams for optimization. The ideal candidate will have strong leadership, problem-solving, and communication skills, along with experience in AI/ML and software development team management.
Must have:
  • Lead AI/ML & software development teams
  • Deliver innovative solutions to complex challenges
  • Drive operational excellence and continuous improvement
  • Exceptional problem-solving skills
  • Strong communication and collaboration skills
Good to have:
  • Experience with Machine Learning and Deep Learning
  • Familiarity with InfiniBand, IBOP, and RDMA
  • Understanding of fast, distributed storage systems
  • Familiarity with deep learning frameworks
Perks:
  • Highly competitive salaries
  • Comprehensive benefits package
  • Equity

Job Details

At NVIDIA, we constantly innovate to amplify human intelligence. Our invention of the GPU sparked revolutions in gaming, computer graphics, and parallel computing. Now, GPU deep learning is driving modern AI forward. Join our GPU AI/HPC Infrastructure team and lead the design of groundbreaking GPU compute clusters for demanding AI, HPC, and compute-intensive workloads.

In this role, you'll lead and operate substantial AI GPU Clusters at unprecedented scale. You'll build an extraordinary team to optimize datacenter resource usage, drive operational excellence through automation, and create a cost-effective global computing infrastructure. Help us solve strategic challenges and implement methodologies, tools, and metrics for effective resource utilization in a heterogeneous compute environment. Make the choice to join NVIDIA today and shape the future of AI computing!

What you'll be doing:

  • Building and improving our ecosystem around GPU-accelerated computing including developing large scale automation solutions.

  • Supporting our researchers to run their flows on our clusters including performance analysis and optimizations of deep learning workflows. Improving reliability and overall Researcher Productivity.

  • Architect and implement brand new strategies to optimize the utilization of our AI computing clusters, driving operational efficiency and resource maximization.

  • Pioneer innovative solutions to streamline support processes, enabling our team to manage an unprecedented scale of GPU resources (10,000+ GPUs per support personnel).

  • Lead the charge in building a future-proof AI computing infrastructure, ensuring seamless scalability and resilience to power groundbreaking AI models and applications.

  • Collaborate with multi-functional teams to identify bottlenecks and opportunities for optimization, continuously improving the performance and cost-effectiveness of our AI computing operations.

  • Empower your team with the tools, processes, and standard methodologies necessary to thrive in a dynamic, high-intensity environment, fostering a culture of operational excellence and continuous improvement

What we need to see:

  • Bachelor’s degree or equivalent experience in Computer Science, Electrical Engineering or related field or similar experience.

  • Minimum 6 years of experience leading AI/ML and software development teams as a people manager with 12+ overall years of relevant experience.

  • Consistent track record of leading high-performance teams in delivering innovative solutions to complex computational challenges, with a demonstrated ability to drive operational excellence and continuous improvement.

  • Exceptional problem-solving skills, with the ability to analyze complex systems, identify bottlenecks, and implement scalable solutions that can accommodate the ever-increasing demands of AI computing.

  • Shown leadership capabilities, with the ability to inspire and motivate multi-functional teams, fostering a culture of collaboration, innovation, and steadfast pursuit of operational excellence.

  • Strong communication and collaborator management skills, enabling you to effectively articulate technical concepts to diverse audiences and align priorities across the organization.

  • A passion for pushing the boundaries of what's possible in AI computing, with an aim to continuously explore and implement emerging technologies and standard processes to maintain our competitive edge.

  • Strong people management and team-building skills. Can coach and grow talent, cultivate healthy engineering culture, and attract/retain talent. Ability to build a diverse, broad, and impactful team.

Ways to stand out from the crowd:

  • Experience with Machine Learning and Deep Learning concepts, algorithms and models

  • Familiarity with InfiniBand with IBOP and RDMA

  • Understanding of fast, distributed storage systems like Lustre and GPFS for AI/HPC workloads

  • Familiarity with deep learning frameworks like PyTorch and TensorFlow

NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most experienced and versatile people in the world working for us and, due to unprecedented growth, our extraordinary engineering teams are growing fast. If you're a creative and autonomous engineer with real passion for technology, we want to hear from you.

The base salary range is 272,000 USD - 425,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Balbix - AI/ML Architect

Balbix

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Ubisoft - Lead R&D Scientist

Ubisoft

Shanghai, Shanghai, China (On-Site)
2 Months ago
Reality Games - Machine Learning Engineer - Monopoly World

Reality Games

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
4 Weeks ago
Canva - Senior Computer Vision Engineer - Photo AI

Canva

Vienna, Vienna, Austria (Remote)
1 Month ago
Samsung Semiconductor - Principal Engineer, NPU Architect

Samsung Semiconductor

San Jose, California, United States (Hybrid)
2 Months ago
Codeway - AI Product Engineer

Codeway

İstanbul, Türkiye (On-Site)
1 Month ago
Match Group - Sr. Software Engineer, Generative AI

Match Group

Palo Alto, California, United States (Hybrid)
5 Months ago
Canva - Machine Learning Engineering Manager (m/f/x) - Canva Austria

Canva

Vienna, Vienna, Austria (Remote)
4 Months ago
ByteDance - Research Scientist, Vision Foundation Model

ByteDance

San Jose, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
ByteDance - Research Scientist, Code Generation

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
Meta - Software Engineer, Machine Learning

Meta

Burlingame, California, United States (On-Site)
4 Months ago
Altagram Group - Data Science Internship/Workstudent

Altagram Group

Germany (On-Site)
1 Month ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Sausalito, California, United States (On-Site)
4 Months ago
NVIDIA - Senior System Software Engineer - Triton Inference Server

NVIDIA

Washington, United States (Remote)
1 Month ago
SiftHub - Senior Software Engineer (Backend)

SiftHub

Mumbai, Maharashtra, India (On-Site)
5 Months ago
Ubisoft - ML OPS Senior _ Groupe Technologique Création de contenu

Ubisoft

Montreal, Quebec, Canada (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Seattle, Washington, United States

The Walt Disney Company - KFSN Promotion Producer

The Walt Disney Company

California, United States (On-Site)
2 Months ago
Electronic Arts - Manager, Marketing Production

Electronic Arts

Redwood City, California, United States (On-Site)
2 Months ago
Onward Search - Sales Development Representative

Onward Search

Dallas, Texas, United States (On-Site)
2 Months ago
Next Level Business Services - Apigee API Developer

Next Level Business Services

San Francisco, California, United States (On-Site)
4 Months ago
Gamesight - Creator Program Operations Manager

Gamesight

United States (Remote)
1 Month ago
The Walt Disney Company - Sr. Manager, Content Programming (Live Sports & News)

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Day ago
Interactive Brokers - Senior Cloud Security Engineer

Interactive Brokers

Fort Lauderdale, Florida, United States (Hybrid)
5 Months ago
Next Level Business Services - Project Manager - Mobility

Next Level Business Services

Collegeville, Pennsylvania, United States (On-Site)
5 Months ago
Nintendo - Sr Technical Localization Specialist

Nintendo

Redmond, Washington, United States (Hybrid)
2 Days ago
ByteDance - Video Pipeline Engineer/Architect- Pico- San Jose

ByteDance

San Jose, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Interface AI - Technical Support Engineer L2

Interface AI

India (Remote)
1 Month ago
Vahanai - Ai Engineer

Vahanai

Bengaluru, Karnataka, India (On-Site)
4 Months ago
NVIDIA - Solutions Architect, Generative AI

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
RoofStack - Senior Data Scientist

RoofStack

İstanbul, İstanbul, Türkiye (Hybrid)
2 Months ago
Electronic Arts - Senior Manager, Generative AI Software Engineering

Electronic Arts

Austin, Texas, United States (On-Site)
2 Weeks ago
DNEG - Head of Machine Learning

DNEG

London, England, United Kingdom (Remote)
16 Hours ago
Arrise Solutions (India)   - Senior ML Engineer

Arrise Solutions (India)

Hyderabad, Telangana, India (On-Site)
6 Months ago
NVIDIA - AI Computing Software Development Engineer, TensorRT

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Westford, Massachusetts, United States (Hybrid)

Westford, Massachusetts, United States (On-Site)

Canada (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Durham, North Carolina, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug