Software Engineering Manager, Sparse Linear Algebra Libraries

3 Months ago • 8-11 Years • Research & Development • $224,000 PA - $425,500 PA

Job Summary

Job Description

Lead a team developing high-performance sparse linear algebra libraries for AI and scientific computing. Responsibilities include team management, project planning and execution, collaboration with NVIDIA research and product teams, and interaction with external partners. The ideal candidate will have strong experience in numerical methods, high-performance computing (HPC) software development (C++, Python), parallel programming (CUDA, MPI, etc.), and leading engineering teams. The role involves designing, developing, optimizing, and maintaining GPU-accelerated libraries and SDKs used in various applications, from LLMs to autonomous vehicles.
Must have:
  • Lead and mentor engineering teams
  • High-performance numerical software expertise
  • Strong fundamentals in sparse/dense linear algebra
  • C++ and Python programming proficiency
  • Parallel programming experience (CUDA, MPI)
  • API design, software architecture, testing
Good to have:
  • Experience with globally distributed organizations
  • Knowledge of CPU/GPU hardware architecture
  • Machine learning/deep learning experience
  • Large-scale computing technologies (PDE solvers)
  • Mentoring in dynamic HW/SW development environments
Perks:
  • Equity
  • Benefits

Job Details

We are looking for a software engineering manager to lead our development efforts for high-performance sparse linear algebra libraries in the AI and scientific computing domains. Around the world, leading commercial and academic organizations are revolutionizing AI, data analytics, and scientific and engineering simulations, using data centers powered by GPUs. Applications of these technologies include LLMs, computer vision, encryption, computer aided engineering (CAE), electronic design automation (EDA), autonomous vehicles and countless others. Did you know our team develops the GPU accelerated libraries and SDKs that help make these possible?

In this role, you will lead an engineering team designing, developing, and optimizing software to accelerate various elements of the software stack. Ideal candidates will not only have experience leading software product engineering teams, but also be motivated to advance the state-of-the-art in a variety of accelerated computing domains. If this sounds exciting, we would love to meet you!

What you will be doing:

  • Lead, mentor, and grow your library engineering team.

  • Be responsible for the quality and performance of your libraries and the planning and execution of projects.

  • Work closely with NVIDIA Research, Developer Technology, and Product Management teams in the areas of scientific computing, programming systems, and AI to help collect requirements for your products as well as contribute to the development of technology roadmaps.

  • Interact with external partners and researchers to understand their use cases and requirements.

What we need to see:

  • PhD or MSc degree in Computational Science and Engineering, Computer Science, Applied Mathematics, or related science or engineering field (or equivalent experience).

  • 8+ years of overall experience in developing high-performance numerical software.

  • 3+ years of experience recruiting, training and leading software engineering teams.

  • Strong fundamentals in numerical methods such as computational sparse/dense linear algebra and direct and iterative solvers for linear systems.

  • Hands-on experience with user facing API design, object-oriented programming, large system software architecture development, testing, maintenance, and performance optimization of HPC software using C++ and Python.

  • Experience with parallel programming, ideally using CUDA, MPI, OpenMP, OpenACC, pthreads.

  • Strong collaboration, communication, and documentation habits.

  • Experience with, and motivation to adopt and advance, software development practices such as CI/CD systems and project management tools such as JIRA.

Ways to stand out from the crowd:

  • Experience with working in a globally distributed organization.

  • Good knowledge of CPU and/or GPU hardware architecture.

  • Good understanding of Machine Learning and Deep Learning technologies and experience using one or more deep learning frameworks (e.g., PyTorch, JAX, TensorFlow...).

  • Strong background of large-scale computing technologies such as PDE solvers, eigenvalue solvers and time-domain simulation methods (e.g., CFD, FEA).

  • Experience with leading and mentoring teams in dynamic environments such as concurrent HW and SW development.

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing for science and engineering. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company and build our teams with the smartest people in the world! Join us at the forefront of technological advancement. NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and talented people in the world working for us. If you're creative, autonomous and love a challenge, we want to hear from you!

#LI-Hybrid

The base salary range is 224,000 USD - 425,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Rackspace Technology - Senior Machine Learning Engineer

Rackspace Technology

Vietnam (Remote)
1 Month ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Speech & Audio) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
ByteDance - Research Scientist (Machine Learning for Science (AI-for-Science))

ByteDance

Seattle, Washington, United States (On-Site)
2 Weeks ago
Google - Senior Software Engineer, SDLC, Gemini Code Assist

Google

Kirkland, Washington, United States (On-Site)
1 Week ago
Xsolla - Machine Learning Engineer

Xsolla

Montreal, Quebec, Canada (Remote)
1 Week ago
ByteDance - Applied Scientist Intern (Computational Modeling & Optimization)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Buckman - Digital Innovation Director

Buckman

Chennai, Tamil Nadu, India (On-Site)
4 Months ago
ByteDance - Software Engineer, Inference

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Rivos - Software Compiler - Full Time

Rivos

United States (Hybrid)
6 Months ago
ByteDance - NPU FW Engineer/Architect- Pico - San Jose

ByteDance

San Jose, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

DNEG - Head of Machine Learning

DNEG

London, England, United Kingdom (Remote)
2 Months ago
Google - Customer Engineer, AI Infrastructure, Google Cloud

Google

Singapore (On-Site)
1 Week ago
NVIDIA - Senior Math Libraries Engineers - Python APIs

NVIDIA

Louisiana, United States (Remote)
2 Months ago
NVIDIA - Senior Software Engineer - Automated Parallel Programming

NVIDIA

North Carolina, United States (Remote)
1 Month ago
ByteDance - Research Scientist Graduate (Foundation Model Speech & Audio Generation)

ByteDance

Seattle, Washington, United States (On-Site)
1 Day ago
ByteDance - Machine Learning Engineer - Inference

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Hedra - Applied Research Scientist

Hedra

New York, New York, United States (On-Site)
1 Month ago
Meta - Software Engineer, Machine Learning

Meta

Washington, District Of Columbia, United States (On-Site)
1 Week ago
Amazon Games - Senior Software Engineer, Amazon Games AI Research

Amazon Games

San Diego, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in California, United States

Penumbra - Sr Developer SFDC/CRM

Penumbra

Alameda, California, United States (On-Site)
6 Months ago
ByteDance - Creator Operations Manager - CapCut

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
NVIDIA - Senior Hardware Validation Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Patel greene - PD&E Project Manager

Patel greene

Temple Terrace, Florida, United States (On-Site)
6 Months ago
Evolution - iGaming Floor Operations Supervisor

Evolution

Atlantic City, New Jersey, United States (On-Site)
2 Months ago
Adobe - Enterprise Sales Account Manager, Digital Media

Adobe

New York, New York, United States (Remote)
1 Month ago
Netflix - Software Engineer (L4) - Cloud Network Engineering

Netflix

United States (Remote)
1 Week ago
Universal Music - Coordinator, Culture & Community Engagement

Universal Music

Miami Beach, Florida, United States (On-Site)
2 Weeks ago
Google - Staff Software Engineer, Google Ads

Google

Mountain View, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

ByteDance - Machine Learning Engineer Intern (Search-TikTok Recommendation)

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
Riot Games - Senior Manager, Software Engineering - Unpublished R&D Product

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
NVIDIA - Senior RTL Analysis Methodology Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
4 Weeks ago
NVIDIA - VLSI Physical Design Engineer - New College Grad 2025

NVIDIA

Massachusetts, United States (On-Site)
4 Days ago
NVIDIA - Senior Power Architecture and Optimization Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Krafton  - Jr. Privacy Manager

Krafton

Seoul, South Korea (On-Site)
1 Month ago
NVIDIA - Technical Program Manager - Compute Developer Tools

NVIDIA

Austin, Texas, United States (On-Site)
1 Month ago
NVIDIA - Hardware Application Engineer, Ethernet Switch

NVIDIA

Beijing, Beijing, China (Hybrid)
2 Months ago
Google - Senior System Power and Performance Architect, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Day ago
Krafton  - 3D Character Modeler

Krafton

(On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug