Senior Math Libraries Engineer – AI and HPC

2 Months ago • 5 Years + • Research & Development • $184,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA's Math Libraries team seeks a Senior Engineer to design, develop, and optimize high-performance numerical linear algebra software for GPUs. Responsibilities include scoping and executing projects, mentoring engineers, collaborating with product management and customers to define requirements, and improving library performance through re-architecting. The role requires expertise in kernel generation, JIT compilation, and linear algebra, and experience leading software development projects. The engineer will work on GPU-accelerated mathematical libraries crucial for AI and HPC applications.
Must have:
  • PhD/Master's in CS/Math
  • 5+ years HPC software exp.(C++)
  • Kernel generation & library design
  • Leadership in software projects
  • Strong collaboration & communication
Good to have:
  • CUDA, MPI, OpenMP, OpenACC
  • Machine Learning/Deep Learning
  • GPU/CPU architecture knowledge
  • Assembly programming
  • Agile development & JIRA
Perks:
  • Competitive salary
  • Generous benefits package
  • Equity

Job Details

NVIDIA Math Libraries team is looking for an expert engineer to join our development efforts in the area of kernel generation for AI and HPC, specifically targeting matrix operations, JITing and fusions. Around the world, leading commercial and academic organizations are revolutionizing AI, scientific and engineering simulations, and data analytics, using data centers powered by GPUs. Applications of these technologies are in healthcare, NLP, VR, deep learning, autonomous vehicles and countless others. Did you know our team develops the GPU accelerated mathematical libraries that makes all of this possible?

What you will be doing:

  • Scoping, designing, and implementing high quality and performance numerical dense linear algebra software on GPUs.

  • Owning the execution of projects involving multiple engineers and sometimes teams.

  • Providing technical leadership and feedback to library engineers working with you on projects and sometimes mentor interns.

  • Working closely with product management and other internal and external customers to understand feature and performance requirements and contribute to the technical roadmaps of libraries.

  • Finding opportunities to improve library performance and reduce code maintenance overhead through re-architecting.

  • To be successful in your responsibilities which are by nature sophisticated, you will need to find and explain complex solutions, exercise leadership, and coordinate with multiple teams to work towards your goals.

What we need to see:

  • PhD or Master’s degree in Computer Science, Applied Math, or related science or engineering field of study (or equivalent experience).

  • 5+ years of experience in designing, developing, testing, maintenance, and performance optimization of HPC software using C++.

  • Strong fundamentals in kernel generation and composable library design for linear algebra.

  • Leadership skills in driving software development projects.

  • Strong collaboration, communication, and documentation habits.

  • Kernel generation. JIT focus/experience desired

Ways to stand out from the crowd:

  • Experience with parallel programming, ideally using CUDA, MPI, OpenMP, OpenACC, pthreads.

  • Good understanding of Machine Learning and Deep Learning technologies.

  • Good knowledge of GPU (preferred) or CPU hardware architecture.

  • Experience with low level programming using assembly for performance optimization and operator fusion is a huge plus.

  • Experience with agile software development practices using project management tools such as JIRA.

  • A scripting language, preferably Python.

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.

The base salary range is 184,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#deeplearning

Similar Jobs

Xsolla - Product Owner

Xsolla

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
9 Months ago
Scopely - QA Director - Unannounced Project

Scopely

Lisbon, Lisbon, Portugal (Hybrid)
4 Months ago
Critical mass - Project Manager

Critical mass

Vancouver, British Columbia, Canada (On-Site)
7 Hours ago
Amanotes - Senior Level Designer (New Games - Hybrid Casual Games)

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
1 Month ago
Casumo - Quality Assurance Specialist

Casumo

Zagreb, Croatia (Hybrid)
4 Months ago
Vigaet - Internship - Mechanical Engineer

Vigaet

(On-Site)
6 Months ago
Samsung Semiconductor - Staff Software Engineer – Storage Systems & Protocols

Samsung Semiconductor

San Jose, California, United States (Hybrid)
3 Months ago
ByteDance - Research Scientist (Computational Biology - AI-for-Science)

ByteDance

Seattle, Washington, United States (On-Site)
2 Weeks ago
ByteDance - Researcher - Large Language Models, Applied Machine Learning

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

MURKA - Monetization Manager

MURKA

(Remote)
3 Months ago
Rocket Science - Producer (Technical Account Manager)

Rocket Science

Cardiff, Wales, United Kingdom (Hybrid)
1 Month ago
N-iX - Middle QA (C#) Engineer

N-iX

Poland (Hybrid)
2 Weeks ago
Brave Group (Language barrier) - Front-end Engineer

Brave Group (Language barrier)

(Remote)
1 Day ago
Epic Games - Senior Technical Producer

Epic Games

Montreal, Quebec, Canada (On-Site)
1 Month ago
Warner Bros Games - Senior Gameplay Programmer

Warner Bros Games

London, England, United Kingdom (Hybrid)
1 Month ago
Critical mass - Senior Project Manager

Critical mass

Cupertino, California, United States (On-Site)
7 Hours ago
Light Speed Studios - Senior Content Designer

Light Speed Studios

California, United States (On-Site)
2 Weeks ago
Social Discovery Group - Head of Product (Premium products)

Social Discovery Group

Almaty, Almaty Region, Kazakhstan (Remote)
5 Months ago
digital eclipse entertainment  - Video Game Producer

digital eclipse entertainment

Emeryville, California, United States (On-Site)
23 Hours ago

Get notifed when new similar jobs are uploaded

Jobs in Hillsboro, Oregon, United States

Epic Games - Senior Platform Account Lead (Console)

Epic Games

Cary, North Carolina, United States (On-Site)
2 Weeks ago
Riot Games - Principal Game Producer

Riot Games

Los Angeles, California, United States (On-Site)
1 Day ago
WebFX - Jr. Content Marketer

WebFX

Harrisburg, Pennsylvania, United States (On-Site)
6 Months ago
NVIDIA - Senior ASIC Full Chip Verification Engineer

NVIDIA

Texas, United States (On-Site)
6 Days ago
Expedia - Partner Success Associate - Spanish and English fluency required

Expedia

Chicago, Illinois, United States (Hybrid)
6 Months ago
Google - Display Module Mechanical Expert

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
ByteDance - Brand Partnership Manager

ByteDance

Austin, Texas, United States (On-Site)
1 Month ago
CharacterAI - Software Engineer, Machine Learning Infrastructure

CharacterAI

San Francisco, California, United States (On-Site)
2 Weeks ago
Google - Engineering Manager, Looker Modeling and Storage Lifecycle

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Cadence - Principal Software Engineer

Cadence

San Jose, California, United States (On-Site)
1 Day ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Senior High-Performance ASIC Timing Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Google - Software Engineering Manager (For Women in Tech Candidates)

Google

Belo Horizonte, State Of Minas Gerais, Brazil (On-Site)
5 Months ago
Google - Physical Verification and Convergence Engineer

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
NVIDIA - Power Architecture and Optimization Engineer – New College Grad 2025

NVIDIA

Santa Clara, California, United States (On-Site)
1 Week ago
Google - Software Engineering Manager, People with Disabilities

Google

São Paulo, State Of São Paulo, Brazil (On-Site)
5 Months ago
NVIDIA - Senior Firmware Engineer - Memory Subsystem

NVIDIA

Canada (On-Site)
2 Months ago
Google - EDA/CAD Custom Tool Development Engineer

Google

Bengaluru, Karnataka, India (On-Site)
2 Days ago
ByteDance - Research Scientist, Reinforcement Learning

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Google - Senior Software Engineering Manager, Wear OS Platform

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
Google - PCB Design Engineer, Cloud Platforms

Google

Taipei City, Taiwan (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug