Senior System Software Engineer

21 Minutes ago • 3 Years + • DevOps • $148,000 PA - $287,500 PA

Job Summary

Job Description

NVIDIA is seeking a Senior System Software Engineer to contribute to the development and improvement of its Triton Inference Server. This role involves building infrastructure solutions, defining CI/CD processes, ensuring cross-platform compatibility, and collaborating with cross-functional teams. Responsibilities include designing and architecting systems, optimizing software for cloud environments, and troubleshooting complex technical issues. The ideal candidate will possess strong programming skills (Bash, Python), experience with cloud platforms (GitHub), and knowledge of distributed systems. Experience with Docker and Kubernetes is a plus.
Must have:
  • Masters degree or equivalent experience
  • 3+ years experience in relevant field
  • Excellent Bash, CI/CD, Python skills
  • Experience with GitHub and cloud platforms
  • Knowledge of distributed systems programming
Good to have:
  • Experience designing/architecting systems
  • Experience with Docker and Kubernetes
  • Experience with large open-source projects
  • Excellent problem-solving abilities
Perks:
  • Equity
  • Benefits

Job Details

We are now looking for a Senior System Software Engineer to work on Triton Inference Server! NVIDIA is hiring software engineers for its GPU-accelerated deep learning software team. Academic and commercial groups around the world are using GPUs to power a revolution in deep learning, enabling breakthroughs in problems from image classification to speech recognition to natural language processing. We are a fast-paced team building tools and software to make design and deployment of new deep learning models easier and accessible to more data scientists.

What you'll be doing:

In this role, you will build infrastructure solutions from first principles needed to deliver Triton Inference Server. You will apply software design skills to define the processes and best practices for performing continuous integration, testing, and releasing builds, while ensuring the cross-platform compatibility of Triton Inference Server across a wide range of operating systems and architecture systems. Using your expertise, you will influence how we design our customer facing technology and tools to enable an optimized pipeline for building and deploying our product. Extensive collaboration with cross-functional teams to integrate pipelines from deep learning frameworks and components is essential to ensuring seamless deployment and inference of deep learning models across Triton Inference Server.

What we need to see:

  • Masters degree or equivalent experience

  • 3+ years of experience in Computer Science, computer architecture, or related field

  • Ability to work in a fast-paced, agile team environment

  • Excellent Bash, CI/CD, Python programming and software design skills, including debugging, performance analysis, and test design. 

  • Experience in administering, monitoring, and deploying systems and services on GitHub and cloud platforms. Support other technical teams in monitoring operating efficiencies of the platform, and responding as needs arise.

  • Knowledge of distributed systems programming.

Ways to stand out from the crowd:

  • Experience designing or architecting (design patterns, reliability and scaling) of new and existing systems experience.

  • Experience driving efficiencies in software architecture, creating metrics, implementing infrastructure as code and other automation improvements.

  • Background deploying cloud-native services using modern technologies such as Docker, and Kubernetes, optimizing software for scalable and efficient deployment in cloud environments.

  • Experience contributing to a large open-source deep learning community - use of GitHub, bug tracking, branching and merging code, OSS licensing issues handling patches, etc.

  • Excellent problem solving abilities spanning multiple software (storage systems, kernels and containers) as well as collaborating within an agile team environment to prioritize deep learning-specific features and capabilities within Triton Inference Server, employing advanced troubleshooting and debugging techniques to resolve complex technical issues.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most experienced and hard-working people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. Come help us build the real-time, efficient computing platform driving our success in the dynamic and quickly growing field Deep Learning and Artificial Intelligence.

#LI-Hybrid 

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

NVIDIA - Senior Software Engineer - Web Expert

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
• 2 Days ago
ByteDance - Large Language Model Algorithm Engineer - Volcano Ark

ByteDance

Singapore (On-Site)
• 3 Months ago
Dream Sports - Senior ML Scientist

Dream Sports

Mumbai, Maharashtra, India (On-Site)
• 3 Months ago
DNEG - Head of Machine Learning

DNEG

London, England, United Kingdom (Remote)
• 1 Week ago
The Walt Disney Company - Sr Machine Learning Engineer

The Walt Disney Company

Los Angeles, California, United States (On-Site)
• 2 Months ago
Scanline VFX - Senior DevOps Engineer

Scanline VFX

Vancouver, British Columbia, Canada (Hybrid)
• 2 Weeks ago
Rackspace Technology - Azure Engineer II

Rackspace Technology

Gurugram, Haryana, India (Remote)
• 2 Months ago
ByteDance - Senior Site Reliability Engineer - Data Infrastructure (San Jose)

ByteDance

San Jose, California, United States (On-Site)
• 3 Months ago
Warner Bros Games - Senior Software Engineer - Cloud Support and Operations

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
• 1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Microsoft - Research Intern - AI, Machine Learning, Statistics

Microsoft

Cambridge, Massachusetts, United States (On-Site)
• 1 Month ago
NVIDIA - Senior Solutions Architect, CSP System

NVIDIA

Beijing, Beijing, China (On-Site)
• 1 Month ago
Autodesk - Intern, Software Engineer - Geometric Reasoning

Autodesk

London, England, United Kingdom (On-Site)
• 4 Months ago
NVIDIA - Senior Solution Architect, HPC and AI

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
• 1 Month ago
GoTo Group - Senior Data Scientist - Payment

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
• 2 Months ago
NVIDIA - Formal Verification Engineer

NVIDIA

Bengaluru, Karnataka, India (On-Site)
• 1 Month ago
NVIDIA - Senior Engineering Build Manager

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
• 3 Days ago
NVIDIA - Developer Relations Manager - GenAI for Automotive

NVIDIA

Santa Clara, California, United States (On-Site)
• 3 Weeks ago
NVIDIA - Senior Ballout Designer

NVIDIA

Santa Clara, California, United States (On-Site)
• 1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in California, United States

Twitch - Senior Product Manager - Ads

Twitch

Seattle, Washington, United States (Remote)
• 5 Months ago
Netflix - Product Manager, Content Operations Data

Netflix

Los Angeles, California, United States (Remote)
• 3 Months ago
DraftKings - Operations Associate

DraftKings

Reynoldsburg, Ohio, United States (On-Site)
• 1 Month ago
The Walt Disney Company - Disney Consumer Products Merchandising Intern

The Walt Disney Company

Kissimmee, Florida, United States (On-Site)
• 6 Days ago
ByteDance - Software Engineer Intern (Data-Technical Infrastructures-IaaS-US) - 2025 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
• 3 Months ago
The Walt Disney Company - Senior Manager, Technology Enablement & Adoption

The Walt Disney Company

Burbank, California, United States (On-Site)
• 2 Days ago
Ludeo - Marketing Director

Ludeo

Los Angeles, California, United States (On-Site)
• 1 Month ago
Pipeworks - Senior Lighting Artist (Remote or In-Office)

Pipeworks

Eugene, Oregon, United States (Remote)
• 1 Month ago
Kaedim - Customer Success Engineer

Kaedim

San Francisco, California, United States (On-Site)
• 9 Months ago
Mattel  Inc  - Sr Packaging Engineer

Mattel Inc

California, United States (On-Site)
• 2 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Evolution - Systems Engineer / SRE

Evolution

Warsaw, Masovian Voivodeship, Poland (On-Site)
• 3 Months ago
Ness Digital - Site Reliability Engineer

Ness Digital

Timișoara, Timiș, Romania (Hybrid)
• 1 Month ago
Egnyte - Staff Engineer - AI

Egnyte

India (Remote)
• 2 Months ago
Trend Micro - Sr. Engineer

Trend Micro

Taipei City, Taiwan (On-Site)
• 4 Months ago
Zeta - Data Reliability Engineer II

Zeta

Hyderabad, Telangana, India (On-Site)
• 4 Months ago
Equivalent Jobs - HEAD OF TRADING INFRASTRUCTURE

Equivalent Jobs

(Remote)
• 3 Months ago
Hitachi - Azure Developer

Hitachi

Hyderabad, Telangana, India (Remote)
• 4 Months ago
PearlAbyss - Junior System Engineer

PearlAbyss

(On-Site)
• 1 Month ago
PwC - Manager_ Cloud Architecture _ Advisory corporate _ Advisory _Hyderabad

PwC

Hyderabad, Telangana, India (On-Site)
• 3 Months ago
Rackspace Technology - Sr Big Data Engineer Airflow and Oozie (GCP)

Rackspace Technology

United States (Remote)
• 1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Shanghai, Shanghai, China (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Bengaluru, Karnataka, India (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Massachusetts, United States (On-Site)

Bengaluru, Karnataka, India (Hybrid)

California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug