Senior GPU Kernel Performance Lead

6 Months ago • 8 Years + • $224,000 PA - $425,500 PA

Job Summary

Job Description

NVIDIA seeks a Senior GPU Kernel Performance Lead to oversee performance validation of GPU math kernels for cuDNN, cuBLAS, and TensorRT libraries. Responsibilities include specifying test cases from deep learning workloads, developing analytical performance models, tracking kernel performance throughout the development lifecycle, and providing feedback to developers on performance optimization. The role requires strong C++ programming skills, experience leading performance teams, and a PhD in a related field or equivalent experience. The ideal candidate will have experience with analytical models, cycle-accurate HW simulators, and performance tools like Nsight or VTune. This position involves leading a team, analyzing and improving the performance of AI kernels impacting critical applications in image classification, speech recognition, and large language models.
Must have:
  • PhD in CS/related field or equiv. exp.
  • 8+ years relevant industry experience
  • Strong C++ programming & software design
  • Experience leading performance teams
  • Performance analysis & test design expertise
Good to have:
  • Analytical models & cycle-accurate HW simulators
  • Nsight/VTune experience
  • Assembly, MLIR/LLVM, Python, CUDA/OpenCL experience
Perks:
  • Equity
  • Benefits

Job Details

We're now looking for a Senior GPU Kernel Performance Lead. Do you enjoy analyzing and reporting on GPU kernel performance? If so, consider applying for the role of Senior GPU Kernel Performance Analysis Lead! Our team delivers high-performance GPU math kernels to NVIDIA’s cuDNN, cuBLAS, and TensorRT libraries to accelerate deep learning models. The team is proud to play an integral part in enabling breakthroughs in domains such as image classification, speech recognition, natural language processing,and large language models. We’re always striving for peak performance and energy efficiency on current and future-generation GPUs.

As a kernel performance analysis lead, you will oversee all efforts pertaining to the performance of our kernels. Join the team that is building the underlying software used across the world to power the revolution in artificial intelligence! To get a sense of the code we write, check out our CUTLASS open-source project showcasing performant matrix multiply on NVIDIA’s Tensor Cores with CUDA. While there will be the opportunity for hands-on development, this position specifically is to lead a team for validating the performance of the kernels.

What you’ll be doing:

  • Specify test cases, derived from Deep Learning workloads, to provide adequate directed and use-case coverage across all kernels on both simulation and silicon targets

  • Determine performance theory through the development and use of analytical models

  • Track and report on kernel performance throughout the development lifecycle by using and expanding upon current infrastructure

  • Provide feedback to the kernel developers by identifying performance regressions and opportunities to reach the achievable peak performance

What we need to see:

  • PhD degree in Computer Science, Computer Engineering, Applied Math, or related field (or equivalent experience) with 8+ years of relevant industry experience.

  • Demonstrated strong C++ programming and software design skills, including debugging, performance analysis, and test design

  • Experience leading or managing a team relating to the performance of CPUs, GPUs, or other DL accelerators

Ways to stand out from the crowd:

  • Experience with analytical models and cycle-accurate HW simulators

  • Knowledgeable about performance tools like Nsight or VTune

  • Programming experience beyond C++ including assembly, MLIR/LLVM, Python, and CUDA/OpenCL

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you a creative and collaborative software leader seeking new challenges? If so, we want to hear from you! Come, join our DL Architecture team and help build the real-time, cost-effective AI computing platform driving our success in this exciting and quickly growing field.

The base salary range is 224,000 USD - 425,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

cirrus logic - Senior Human Resources Business Partner

cirrus logic

Austin, Texas, United States (Hybrid)
2 Months ago
Larian Studios - VFX Director

Larian Studios

Dublin, County Dublin, Ireland (On-Site)
9 Months ago
Hitachi - D365 F&O Finance/ SCM Functional Consultant

Hitachi

Pune, Maharashtra, India (On-Site)
9 Months ago
PayPal - MTS 1, Machine Learning Scientist

PayPal

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Techland - UE5 AI Game Programmer

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Shed mtl - Coordinator

Shed mtl

Canada (Hybrid)
1 Month ago
Alpha Sense - Technical Support Engineer

Alpha Sense

United States (Remote)
2 Months ago
Cadence - Lead Software Engineer (Agentic AI)

Cadence

Cork, County Cork, Ireland (Hybrid)
1 Month ago
Qualcomm - Sensor hub SW engineering for Customer engineering: Senior or Staff

Qualcomm

Suwon-si, Gyeonggi-do, South Korea (On-Site)
2 Months ago
undefined - Senior DevOps Engineer

Paris, Île-de-France, France (Remote)
7 Months ago
Cloud Software Group - Lead Product Security Engineer

Cloud Software Group

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Nordson Corporation - Senior Engineer, Electrical

Nordson Corporation

Amherst, Ohio, United States (On-Site)
2 Months ago
HCL Tech - Senior Embedded OS Developer

HCL Tech

New York, United States (On-Site)
2 Months ago
Kano studios - Game Designer

Kano studios

Austin, Texas, United States (On-Site)
1 Month ago
attentive - Senior Business Systems Analyst, Netsuite

attentive

United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

Greenworks Sunrise Global Marketing - Retail Field Sales & Event Marketing Specialist

Greenworks Sunrise Global Marketing

Grand Rapids, Michigan, United States (On-Site)
2 Months ago
Interface AI - Lead Product Manager, Integrations

Interface AI

San Francisco, California, United States (On-Site)
1 Month ago
Jane Street - Power Trader/Analyst

Jane Street

New York, United States (On-Site)
2 Months ago
Intel  - Senior Infrastructure Engineer

Intel

Phoenix, Arizona, United States (On-Site)
1 Month ago
zoox - Senior / Staff Program Manager, City Launch Strategy & Operations

zoox

Foster City, California, United States (Hybrid)
3 Months ago
Apple - Carbon Program Manager

Apple

Cupertino, California, United States (On-Site)
2 Months ago
Sandbox VR - Retail Associate Miracle Mile

Sandbox VR

Las Vegas, Nevada, United States (On-Site)
9 Months ago
Toast - Staff Software Engineer, Toast Tables

Toast

Boston, Massachusetts, United States (Remote)
1 Month ago
big red button - Senior Visual Effects Technical Artist

big red button

California, United States (On-Site)
1 Month ago
Gearbox - Layout Lead

Gearbox

Frisco, Texas, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Taipei City, Taiwan (On-Site)

Beijing, Beijing, China (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Dubai, Dubai, United Arab Emirates (On-Site)

Beijing, Beijing, China (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug