Senior HPC AI Cluster Engineer

3 Months ago • 5 Years + • DevOps

Job Summary

Job Description

NVIDIA seeks a Senior HPC AI Cluster Engineer to design, implement, and maintain large-scale HPC/AI clusters. Responsibilities include managing Linux job scheduling, developing CI/CD pipelines, automating infrastructure deployment, deploying monitoring solutions, troubleshooting across multiple layers (hardware to applications), defining standard methodologies, supporting R&D, and engaging in POCs. The role involves working with cutting-edge technologies like accelerated computing, deep learning platforms, and high-speed interconnects. Collaboration with researchers, developers, and customers is crucial to crafting improved workflows and developing differentiated solutions.
Must have:
  • 5+ years HPC/AI experience
  • HPC cluster design & maintenance
  • Linux, networking, security expertise
  • Job scheduling (Slurm, K8s)
  • CI/CD pipeline development
  • Automation & configuration management
  • Storage solutions (Lustre, GPFS, etc.)
  • Python/Bash scripting
Good to have:
  • Cloud computing (AWS, Azure, GCP)
  • CPU/GPU architecture knowledge
  • Kubernetes, container technologies
  • GPU hardware/software (DGX, CUDA)
  • RDMA (InfiniBand or RoCE)

Job Details

NVIDIA is looking for an experienced HPC Engineer to join the E2E software verification HPC/AI Infrastructure team. we are focused on building supercomputers and HPC clusters based on groundbreaking technologies. We are looking for an outstanding architect for a senior HPC, be a key player to the most exciting computing hardware and software to contribute to the latest breakthroughs in artificial intelligence and GPU computing. Provide insights on at-scale system design and tuning mechanisms for large-scale compute runs. You will work with the latest Accelerated computing and Deep Learning software and hardware platforms, and with many scientific researchers, developers, and customers to craft improved workflows and develop new, leading differentiated solutions. You will interact with HPC, OS, GPU compute, and systems specialist to architect, develop and bring up large scale performance platforms.

What you will be doing:

  • Design, implement and maintain large scale HPC/AI clusters with monitoring, logging and alerting

  • Manage Linux job/workload schedules and orchestration tools

  • Develop and maintain continuous integration and delivery pipelines

  • Develop tooling to automate deployment and management of large-scale infrastructure environments, to automate operational monitoring and alerting, and to enable self-service consumption of resources

  • Deploy monitoring solutions for the servers, network and storage

  • Perform troubleshooting bottom up from bare metal, operating system, software stack and application level

  • Being a technical resource, develop, re-define and document standard methodologies to share with internal teams

  • Support Research & Development activities and engage in POCs/POVs for future improvements

What we need to see:

  • A degree in Computer Science, Engineering, or a related field

  • 5+ years of experience

  • Knowledge of HPC and AI solution technologies from CPU’s and GPU’s to high speed interconnects and supporting software

  • Experience with job scheduling workloads and orchestration tools such as Slurm, K8s

  • Excellent knowledge of Windows and Linux (Redhat/CentOS and Ubuntu) networking (sockets, firewalld, iptables, wireshark, etc.) and internals, ACLs and OS level security protection and common protocols e.g. TCP, DHCP, DNS, etc.

  • Experience with multiple storage solutions such as Lustre, GPFS, zfs and xfs. Familiarity with newer and emerging storage technologies.

  • Python programming and bash scripting experience.

  • Comfortable with automation and configuration management tools such as Jenkins, Ansible, Puppet/chef

  • Deep knowledge of Networking Protocols like InfiniBand, Ethernet

  • Deep understanding and experience with virtual systems (for example VMware, Hyper-V, KVM, or Citrix)

Ways to stand out from the crowd:

  • Familiarity with cloud computing platforms (e.g. AWS, Azure, Google Cloud)

  • Knowledge of CPU and/or GPU architecture

  • Knowledge of Kubernetes, container related microservice technologies

  • Experience with GPU-focused hardware/software (DGX, Cuda)

  • Background with RDMA (InfiniBand or RoCE) fabrics

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Similar Jobs

CloudLinux - Python Developer

CloudLinux

Tbilisi, Tbilisi, Georgia (Remote)
1 Week ago
Playdead - Systems Administrator

Playdead

Copenhagen, Denmark (On-Site)
1 Month ago
NVIDIA - Senior Systems Software Engineer, Data Center - CUDA

NVIDIA

Austin, Texas, United States (On-Site)
2 Months ago
Zoox - Senior/Staff Software Engineer, Robot Link Platform

Zoox

Foster City, California, United States (Hybrid)
6 Months ago
Knack Studios - Jr. System Administrator

Knack Studios

Chennai, Tamil Nadu, India (On-Site)
10 Months ago
Google - Technical Solutions Engineer, Infrastructure, Serverless

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Week ago
PwC - IN- Senior Associate_ DevOps_Advisory Corporate_Advisory _Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Microsoft - Senior Software Engineering Manager

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Week ago
Google - Staff Software Engineer, Site Reliability Engineering, Google Cloud

Google

Seattle, Washington, United States (On-Site)
1 Day ago
Rackspace Technology - Database Reliability Engineer

Rackspace Technology

(Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Staff Software Engineer, Performance, Pixel

Google

Mountain View, California, United States (On-Site)
1 Week ago
NVIDIA - Senior System Test Design Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
3 Months ago
DNEG - Pipeline Supervisor (Australia Shift)

DNEG

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Rivos - Member of Technical Staff (91839)

Rivos

Santa Clara, California, United States (Hybrid)
6 Months ago
Google - Cryogenic Systems Engineer, Quantum AI

Google

Goleta, California, United States (On-Site)
1 Week ago
Google - Staff Software Engineer, Host Networking

Google

Sunnyvale, California, United States (On-Site)
1 Day ago
Framestore - FREELANCE: FLAME - LOS ANGELES

Framestore

Los Angeles, California, United States (On-Site)
11 Months ago
Actian - Zen Sustaining Engineer - Bangalore/Pune

Actian

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Google - Senior Software Engineer, Diagnostics, Tools, Google Cloud

Google

Taipei City, Taiwan (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Yokne'am Illit, North District, Israel

Playtika - MIS Applications Team Leader

Playtika

Israel (On-Site)
3 Months ago
Google - Verification Lead, Google Cloud

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago
Google - Network Register Transfer Level Design Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Week ago
Google - Quality and Reliability Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago
Playtika - LMS Operation & Learning Partner

Playtika

Israel (On-Site)
2 Weeks ago
Google - CPU Design Verification Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago
NVIDIA - Physical Design Manager

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
NVIDIA - Continuous Bring Up Solution Architect

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Week ago
NVIDIA - Senior Hardware Security Architect

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Google - Software Engineer II, Cloud Networking

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Google - Customer Engineer, Oracle, Google Cloud

Google

Austin, Texas, United States (On-Site)
1 Day ago
Google - Software Engineer III, Site Reliability Engineering

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Week ago
Tesla - Site Reliability Engineer, Energy Software

Tesla

North Holland, Netherlands (On-Site)
2 Months ago
Google - Software Engineer III, Big Data, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Google - Technical Account Manager, Google Cloud Consulting

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Week ago
VGW - Staff Site Reliability Engineer

VGW

Perth, Western Australia, Australia (On-Site)
2 Months ago
Gunzilla - DevOps/Build Engineer

Gunzilla

Kyiv, Kyiv City, Ukraine (On-Site)
1 Month ago
Axon - Manager, Site Reliability Engineering

Axon

Seattle, Washington, United States (Remote)
2 Months ago
PlayStation Global - IT Support Engineer II

PlayStation Global

United Kingdom (Remote)
1 Month ago
Gaming Innovation Group  - Senior Platform DevOps Engineer

Gaming Innovation Group

St. Julian's, Malta (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug