Senior Math Libraries Engineer – AI and HPC

2 Months ago • 5 Years + • Research & Development • $184,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA's Math Libraries team seeks a Senior Math Libraries Engineer to design, develop, and optimize high-performance numerical linear algebra software for GPUs. This role involves leading projects, mentoring engineers, collaborating with product management and customers, and improving library performance through re-architecting. Responsibilities include scoping, designing, implementing, and testing software; providing technical leadership; and working with teams to meet goals. The ideal candidate possesses expertise in kernel generation, JITing, and composable library design for linear algebra, and experience with parallel programming using CUDA, MPI, OpenMP, OpenACC, or pthreads is highly valued.
Must have:
  • PhD or Master's in CS/Applied Math
  • 5+ years HPC software development (C++)
  • Kernel generation & composable library design
  • Leadership in software development projects
  • Strong collaboration & communication skills
Good to have:
  • CUDA, MPI, OpenMP, OpenACC, pthreads experience
  • Machine Learning/Deep Learning knowledge
  • GPU/CPU architecture understanding
  • Assembly programming for optimization
  • Agile development & JIRA experience
  • Python scripting
Perks:
  • Competitive salary
  • Generous benefits package
  • Equity

Job Details

NVIDIA Math Libraries team is looking for an expert engineer to join our development efforts in the area of kernel generation for AI and HPC, specifically targeting matrix operations, JITing and fusions. Around the world, leading commercial and academic organizations are revolutionizing AI, scientific and engineering simulations, and data analytics, using data centers powered by GPUs. Applications of these technologies are in healthcare, NLP, VR, deep learning, autonomous vehicles and countless others. Did you know our team develops the GPU accelerated mathematical libraries that makes all of this possible?

What you will be doing:

  • Scoping, designing, and implementing high quality and performance numerical dense linear algebra software on GPUs.

  • Owning the execution of projects involving multiple engineers and sometimes teams.

  • Providing technical leadership and feedback to library engineers working with you on projects and sometimes mentor interns.

  • Working closely with product management and other internal and external customers to understand feature and performance requirements and contribute to the technical roadmaps of libraries.

  • Finding opportunities to improve library performance and reduce code maintenance overhead through re-architecting.

  • To be successful in your responsibilities which are by nature sophisticated, you will need to find and explain complex solutions, exercise leadership, and coordinate with multiple teams to work towards your goals.

What we need to see:

  • PhD or Master’s degree in Computer Science, Applied Math, or related science or engineering field of study (or equivalent experience).

  • 5+ years of experience in designing, developing, testing, maintenance, and performance optimization of HPC software using C++.

  • Strong fundamentals in kernel generation and composable library design for linear algebra.

  • Leadership skills in driving software development projects.

  • Strong collaboration, communication, and documentation habits.

  • Kernel generation. JIT focus/experience desired

Ways to stand out from the crowd:

  • Experience with parallel programming, ideally using CUDA, MPI, OpenMP, OpenACC, pthreads.

  • Good understanding of Machine Learning and Deep Learning technologies.

  • Good knowledge of GPU (preferred) or CPU hardware architecture.

  • Experience with low level programming using assembly for performance optimization and operator fusion is a huge plus.

  • Experience with agile software development practices using project management tools such as JIRA.

  • A scripting language, preferably Python.

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#deeplearning

Similar Jobs

Keywords Studios - Lead Research Associate - AI

Keywords Studios

Haryana, India (On-Site)
3 Days ago
Fatshark AB - Development Director

Fatshark AB

Stockholm, Stockholm County, Sweden (On-Site)
6 Months ago
PlayStation Global - Technical Program Manager - Contract

PlayStation Global

Aliso Viejo, California, United States (On-Site)
3 Weeks ago
Larian Studios - Technical QA Tester Internship

Larian Studios

Quebec, Canada (On-Site)
1 Week ago
Ubisoft - Regional Project Intelligence Director (Nordics & Romania)

Ubisoft

Malmö, Skåne County, Sweden (Hybrid)
4 Weeks ago
Bright Machines - Perception Research Engineer

Bright Machines

San Francisco, California, United States (On-Site)
6 Months ago
Google - Senior Software Engineer, Machine Learning (Recommendations, Rankings, and Predictions)

Google

Mountain View, California, United States (On-Site)
1 Day ago
Tesla - Lead/Manager (Power) Electronic/Electrical Design Engineer

Tesla

Brandenburg, Germany (On-Site)
2 Months ago
Rivos - SOC Static Timing Analysis Engineer - Full Time

Rivos

Hsinchu, Hsinchu City, Taiwan (On-Site)
6 Months ago
NVIDIA - Senior Mixed Signal Design Engineer

NVIDIA

Canada (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Power Integrations - Software Developer (Web)

Power Integrations

Pasig, Metro Manila, Philippines (On-Site)
6 Months ago
Ubisoft - Senior C++ Programmer

Ubisoft

Malmö, Skåne County, Sweden (Hybrid)
3 Weeks ago
Larian Studios - Technical QA Tester Internship

Larian Studios

Quebec, Canada (On-Site)
2 Months ago
Virtuos - PMO Producer

Virtuos

Prague, Prague, Czechia (On-Site)
1 Week ago
Keywords Studios - Lead Research Associate - AI

Keywords Studios

Gurugram, Haryana, India (On-Site)
5 Days ago
Easygo - Junior VIP Host - Mandarin Speaking

Easygo

Melbourne, Victoria, Australia (Hybrid)
2 Weeks ago
ARHS - Data Manager

ARHS

Stockholm, Stockholm County, Sweden (On-Site)
6 Months ago
Evolution - Purchasing Specialist

Evolution

Medellín, Antioquia, Colombia (On-Site)
4 Months ago
Lakshya Digital - Dot Net Developer

Lakshya Digital

Gurugram, Haryana, India (On-Site)
3 Weeks ago
PlayStation Global - Lighting Lead

PlayStation Global

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

Google - Software Developer III, Front End, Google Cloud AI

Google

Sunnyvale, California, United States (On-Site)
3 Days ago
Dentsu - Senior Analyst, Social - Temporary Worker - Remote

Dentsu

Chicago, Illinois, United States (Remote)
5 Days ago
ByteDance - Research Scientist Graduate (High-Performance Computing (Algorithm Acceleration)- Vision AI Platform)

ByteDance

San Jose, California, United States (On-Site)
3 Weeks ago
NVIDIA - Senior Technical Program Manager - Supply Chain Planning

NVIDIA

Santa Clara, California, United States (On-Site)
6 Days ago
The Walt Disney Company - Lead Software Engineer, Machine Learning - Ad Platforms

The Walt Disney Company

California, United States (On-Site)
1 Week ago
PlayStation Global - Character Artist (Contract)

PlayStation Global

Los Angeles, California, United States (On-Site)
9 Months ago
Google - Product Manager I, Search

Google

Mountain View, California, United States (On-Site)
1 Day ago
ByteDance - Talent Acquisition Partner - Data

ByteDance

Seattle, Washington, United States (On-Site)
1 Week ago
Google - Technical Delivery Infrastructure Engineer, Public Sector

Google

Reston, Virginia, United States (On-Site)
4 Days ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Google - Silicon RTL Design Engineer, TPU

Google

Bengaluru, Karnataka, India (On-Site)
4 Days ago
ByteDance - Applied Scientist Intern (Computational Modeling & Optimization)

ByteDance

San Jose, California, United States (On-Site)
3 Weeks ago
RoofStack - Software Architect

RoofStack

İstanbul, İstanbul, Türkiye (Remote)
3 Months ago
NVIDIA - Senior Physical Design Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago
Google - Chip Infrastructure Engineer

Google

Haifa, Haifa District, Israel (On-Site)
3 Days ago
GreenWave™ Radios - Tech Lead, Design Verification

GreenWave™ Radios

Bengaluru, Karnataka, India (On-Site)
6 Months ago
NVIDIA - Physical Design Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Google - Senior CPU Design Verification Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Vision and Language) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Google - Hardware Engineer, PhD, Cloud Platforms

Google

Taipei City, Taiwan (On-Site)
3 Days ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Hyderabad, Telangana, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Shenzhen, Guangdong Province, China (On-Site)

Taipei City, Taiwan (On-Site)

California, United States (Remote)

Yokne'am Illit, North District, Israel (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug