Software Engineering Manager, Sparse Linear Algebra Libraries

4 Months ago • 8-11 Years • Research & Development • $224,000 PA - $425,500 PA

Job Summary

Job Description

Lead a team developing high-performance sparse linear algebra libraries for AI and scientific computing. Responsibilities include team management, project planning and execution, collaboration with NVIDIA research and product teams, and interaction with external partners. The ideal candidate will have strong experience in numerical methods, high-performance computing (HPC) software development (C++, Python), parallel programming (CUDA, MPI, etc.), and leading engineering teams. The role involves designing, developing, optimizing, and maintaining GPU-accelerated libraries and SDKs used in various applications, from LLMs to autonomous vehicles.
Must have:
  • Lead and mentor engineering teams
  • High-performance numerical software expertise
  • Strong fundamentals in sparse/dense linear algebra
  • C++ and Python programming proficiency
  • Parallel programming experience (CUDA, MPI)
  • API design, software architecture, testing
Good to have:
  • Experience with globally distributed organizations
  • Knowledge of CPU/GPU hardware architecture
  • Machine learning/deep learning experience
  • Large-scale computing technologies (PDE solvers)
  • Mentoring in dynamic HW/SW development environments
Perks:
  • Equity
  • Benefits

Job Details

We are looking for a software engineering manager to lead our development efforts for high-performance sparse linear algebra libraries in the AI and scientific computing domains. Around the world, leading commercial and academic organizations are revolutionizing AI, data analytics, and scientific and engineering simulations, using data centers powered by GPUs. Applications of these technologies include LLMs, computer vision, encryption, computer aided engineering (CAE), electronic design automation (EDA), autonomous vehicles and countless others. Did you know our team develops the GPU accelerated libraries and SDKs that help make these possible?

In this role, you will lead an engineering team designing, developing, and optimizing software to accelerate various elements of the software stack. Ideal candidates will not only have experience leading software product engineering teams, but also be motivated to advance the state-of-the-art in a variety of accelerated computing domains. If this sounds exciting, we would love to meet you!

What you will be doing:

  • Lead, mentor, and grow your library engineering team.

  • Be responsible for the quality and performance of your libraries and the planning and execution of projects.

  • Work closely with NVIDIA Research, Developer Technology, and Product Management teams in the areas of scientific computing, programming systems, and AI to help collect requirements for your products as well as contribute to the development of technology roadmaps.

  • Interact with external partners and researchers to understand their use cases and requirements.

What we need to see:

  • PhD or MSc degree in Computational Science and Engineering, Computer Science, Applied Mathematics, or related science or engineering field (or equivalent experience).

  • 8+ years of overall experience in developing high-performance numerical software.

  • 3+ years of experience recruiting, training and leading software engineering teams.

  • Strong fundamentals in numerical methods such as computational sparse/dense linear algebra and direct and iterative solvers for linear systems.

  • Hands-on experience with user facing API design, object-oriented programming, large system software architecture development, testing, maintenance, and performance optimization of HPC software using C++ and Python.

  • Experience with parallel programming, ideally using CUDA, MPI, OpenMP, OpenACC, pthreads.

  • Strong collaboration, communication, and documentation habits.

  • Experience with, and motivation to adopt and advance, software development practices such as CI/CD systems and project management tools such as JIRA.

Ways to stand out from the crowd:

  • Experience with working in a globally distributed organization.

  • Good knowledge of CPU and/or GPU hardware architecture.

  • Good understanding of Machine Learning and Deep Learning technologies and experience using one or more deep learning frameworks (e.g., PyTorch, JAX, TensorFlow...).

  • Strong background of large-scale computing technologies such as PDE solvers, eigenvalue solvers and time-domain simulation methods (e.g., CFD, FEA).

  • Experience with leading and mentoring teams in dynamic environments such as concurrent HW and SW development.

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing for science and engineering. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company and build our teams with the smartest people in the world! Join us at the forefront of technological advancement. NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and talented people in the world working for us. If you're creative, autonomous and love a challenge, we want to hear from you!

#LI-Hybrid

The base salary range is 224,000 USD - 425,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

mighty bear games - Intermediate/Senior AI Engineer

mighty bear games

Singapore, Singapore (Hybrid)
7 Months ago
Socure - Head of Data, Machine Learning, and Application Platform

Socure

United States (Remote)
1 Month ago
bytedance - Research Scientist- Applied Machine learning Graduates (AML) - 2024 Start (PhD)

bytedance

San Jose, California, United States (On-Site)
7 Months ago
The Walt Disney Company - Sr Machine Learning Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
6 Months ago
Scale AI - Software Engineer, Public Sector

Scale AI

San Francisco, California, United States (On-Site)
2 Weeks ago
NVIDIA - Senior Observability Architect, AI and HPC

NVIDIA

Canada (On-Site)
3 Months ago
NVIDIA - Principal Software Program Manager

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
bytedance - Imaging Systems Lead - Smart Wearable

bytedance

San Jose, California, United States (On-Site)
4 Months ago
bytedance - Software Engineer, ML System Scheduling

bytedance

San Jose, California, United States (On-Site)
7 Months ago
Google - Senior CPU Subsystem RTL Design Engineer, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Hedra - Research Engineer

Hedra

San Francisco, California, United States (On-Site)
2 Months ago
Unity - Senior Machine Learning/MLOps Engineer

Unity

San Francisco, California, United States (On-Site)
1 Month ago
Arrise Solutions (India)   - Senior Data Scientist (Remote)

Arrise Solutions (India)

Hyderabad, Telangana, India (Remote)
7 Months ago
PlayStation Global - Senior Machine Learning Engineer

PlayStation Global

London, England, United Kingdom (On-Site)
1 Month ago
Reddit - Senior Staff Machine Learning Engineer, Ads Marketplace Quality

Reddit

United States (Remote)
2 Weeks ago
Google - ML System Engineer, AICore, Platforms and Devices

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Accenture - AI / ML Engineer

Accenture

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Google - Software Engineer, Computer Vision and Machine Learning

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
bytedance - Research Scientist in Foundation Model (Music) - 2025 Start (PhD)

bytedance

San Jose, California, United States (On-Site)
7 Months ago
welevel  - Senior AI Engineer (LLM & Training Focus)

welevel

Munich, Bavaria, Germany (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in California, United States

Daxko - Account Executive

Daxko

Birmingham, Alabama, United States (Remote)
1 Month ago
Zinnia - Senior Manager, RevOps

Zinnia

Bridgewater, New Jersey, United States (Hybrid)
1 Month ago
Nintendo - Supply Chain Training Specialist

Nintendo

North Bend, Washington, United States (On-Site)
9 Months ago
Power Integrations - Finance Operations Manager

Power Integrations

San Jose, California, United States (On-Site)
1 Week ago
Imagine.io - Head - Customer Success

Imagine.io

Austin, Texas, United States (Hybrid)
2 Months ago
The New York Times - Senior Operations Manager

The New York Times

New York, United States (Hybrid)
3 Weeks ago
HCL Tech - Sr design lead emi/emc design, ams verif

HCL Tech

California, United States (On-Site)
1 Week ago
Iron Mountain - Critical Facility Technician I

Iron Mountain

Phoenix, Arizona, United States (On-Site)
1 Month ago
Milestone - Sr. Embedded Linux Application Engineer

Milestone

United States (Remote)
2 Weeks ago
NVIDIA - Senior SAP SD Business Analyst

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Samsung Semiconductor - Staff Engineer, Embedded Firmware

Samsung Semiconductor

San Jose, California, United States (On-Site)
2 Months ago
NVIDIA - Senior Mixed Signal and Analog Circuit Designer

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
bytedance - Research Scientist in Multimodal Graduate (Applied Machine Learning) - 2024 Start (PhD)

bytedance

San Jose, California, United States (On-Site)
7 Months ago
bytedance - Software Engineer Intern (Machine Learning Platform) - 2024 Summer (PhD)

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago
Riot Games - Sr. Manager, Software Engineering - Unpublished R&D Product

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
Netflix - Software Engineer L4, Machine Learning Platform (Metaflow)

Netflix

Los Gatos, California, United States (On-Site)
3 Months ago
bytedance - Senior Technical Lead - Edge Cloud Infrastructure - San Jose / Seattle / Boston

bytedance

San Jose, California, United States (On-Site)
7 Months ago
bytedance - Senior Research Scientist, Data Management and Security - Infrastructure System Lab

bytedance

San Jose, California, United States (On-Site)
2 Months ago
rivos - Silicon DFT - Full time

rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
7 Months ago
NVIDIA - Senior ASIC Verification Engineer

NVIDIA

Texas, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

Taipei City, Taiwan (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug