Senior Infrastructure Engineer

1 Day ago • 6 Years + • Artificial Intelligence • Research & Development • $168,000 PA - $310,500 PA

Job Summary

Job Description

NVIDIA's CPU SOC Infrastructure team seeks a Senior Infrastructure Engineer to leverage AI and ML in chip design, debug, and testing. Responsibilities include defining and deploying AI/ML applications, collaborating with hardware teams to integrate AI/LLM solutions, architecting novel tools and UIs, staying current on AI/ML advancements, troubleshooting, and resolving technical obstacles. The role involves working on projects spanning consumer graphics, self-driving cars, and AI, contributing to the future of computing. The ideal candidate will possess strong software architecture, development, and testing experience, along with expertise in AI/ML technologies and relevant programming languages.
Must have:
  • BS/MS in CS/CE/EE or equivalent
  • 6+ years relevant experience
  • Strong software architecture & development
  • Proficient in Python/Shell scripting
  • Experience with RAGs and LangGraph
  • Excellent problem-solving & communication skills
Good to have:
  • RTL design/verification tool experience
  • Experience creating scalable AI/LLM applications
  • Experience with PyTorch, REST APIs, or webservers
  • CI system administration (Jenkins, k8s, LSF)
  • Experience with containers (Docker)
Perks:
  • Competitive salary
  • Comprehensive benefits package
  • Equity

Job Details

We are now looking for a Senior Infrastructure Engineer! NVIDIA is looking to tap onto AI to define next generation of chip design ! NVIDIA is seeking a passionate, highly motivated, and creative senior software engineer to be part of its CPU SOC Infrastructure team. We develop methodologies and craft tools to streamline the design/verification of NVIDIA's CPU, memory and SOC designs.

This position offers the opportunity to have real impact in a dynamic, technology-focused company impacting product lines ranging from consumer graphics to self-driving cars and the growing field of artificial intelligence. We are creating a team of outstanding people stretching around the globe, whose mission is to push the frontiers of what is possible today and define the platform for the future of computing. Come, join us today!

What you’ll be doing:

  • Define and deploy AI and ML applications to aid chip design, debug & testing stages.

  • Collaborate closely with our hardware chip design teams to understand their infrastructure needs and map them onto AI/LLM solutions.

  • Architect and develop novel tools, user interfaces, and creative applications.

  • Stay on top of latest advancements in AI/ML technologies and frameworks (transformers, RL, RAG, GenAI) and advocate for their integration within the company.

  • Troubleshoot and resolve critical technical or productivity obstacles that impact team’s performance.

What we need to see:

  • BS/MS in Computer Science or Computer Engineering or Electrical Engineering or equivalent experience

  • 6+ years of relevant work experience

  • Strong software architecture, development, & testing experience

  • Solid understanding of Linux and proficient in programming & scripting skills (ex. Python/Shell)

  • Prior exposure to RAGs (Retrieval-Augmented Generation) and LangGraph based workflows for AI agent integration

  • Strong problem-solving abilities and a passion for debugging

  • Excellent communication and interpersonal skills

Ways to stand out from the crowd:

  • Exposure to RTL design/verification tools (VCS or equivalent simulation tools, debug tools like Verdi) and computer architecture.

  • Experience in creating scalable AI/LLM based applications for a wide user base.

  • Experience with running workloads using PyTorch, interfacing with REST APIs or webservers.

  • A strong passion for continual learning and keeping abreast of new technologies and approaches in AI/ML infrastructure.

  • Experience administering CI systems (ex. Jenkins, k8s, LSF) and containers (Docker).

With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and dedicated people in the world working for us. If you are creative, autonomous and love a challenge, we want to hear from you.

The base salary range is 168,000 USD - 310,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Nielsen Holdings - Software Engineer (Java/Scala, SQL, AWS, Spark on Kubernetes)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
The Workshop - Data Software Engineer

The Workshop

Málaga, Andalusia, Spain (Hybrid)
5 Months ago
Tencent - Senior Network Infrastructure Specialist

Tencent

Seoul, South Korea (On-Site)
1 Week ago
Intel Corporation - Info Security DevSecOps Engineer

Intel Corporation

Penang, Malaysia (Hybrid)
2 Months ago
NVIDIA - Product Test Engineer (RDSS Intern) - 2025

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
1 Month ago
NVIDIA - AI Computing Software Development Engineer, TensorRT

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
Intel Corporation - Technical AI Evangelist - Intel Xeon and Intel Gaudi AI Accelerators

Intel Corporation

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
NVIDIA - Developer Relations Manager

NVIDIA

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Zoox - Software Engineer - Perception & Sensing

Zoox

Foster City, California, United States (Hybrid)
4 Months ago
Salesforce - Principal Data Scientist

Salesforce

Palo Alto, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Rackspace Technology - DEVOP Engineer (AWS Terraform)-PSDE III

Rackspace Technology

India (Remote)
3 Months ago
Assystems - Security Analyst / Incident Responder L2/L3

Assystems

Gurugram, Haryana, India (On-Site)
3 Months ago
ION - Principal Technical Consultant - Endur

ION

London, England, United Kingdom (On-Site)
4 Months ago
Info Stretch - Java/Batch Job Scheduler

Info Stretch

United States (Remote)
2 Months ago
SmileGate - Build Manager [LOST ARK Mobile]

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
1 Month ago
Rackspace Technology - Senior Site Reliability Engineer

Rackspace Technology

United States (Remote)
3 Months ago
Epic Games - Machine Learning Ops Engineer

Epic Games

London, England, United Kingdom (On-Site)
1 Month ago
Google - Technical Solutions Engineer, Google Distributed Cloud (Airgapped)

Google

Frankfurt, Hessen, Germany (On-Site)
3 Months ago
ByteDance - Design Verification Engineer - Multimedia Lab

ByteDance

San Jose, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

Evolution - In Studio Game Presenter

Evolution

Atlantic City, New Jersey, United States (On-Site)
1 Week ago
Funko - Sr. Manager, Compensation

Funko

Washington, District Of Columbia, United States (On-Site)
3 Months ago
Onward Search - Java Developer III

Onward Search

New York, New York, United States (Hybrid)
1 Week ago
Rockstar Games - Senior Animation R&D Programmer

Rockstar Games

Carlsbad, California, United States (On-Site)
3 Months ago
Duolingo - Head of Licensing

Duolingo

New York, New York, United States (On-Site)
4 Months ago
Nintendo - Product Tester (Retro Studios)

Nintendo

Austin, Texas, United States (On-Site)
6 Months ago
Nintendo - Accountant

Nintendo

Redmond, Washington, United States (On-Site)
1 Month ago
Fliff  Inc  - User Acquisition Manager

Fliff Inc

Austin, Texas, United States (On-Site)
7 Months ago
Blitz app - Staff Data Scientist II

Blitz app

Los Angeles, California, United States (Hybrid)
7 Months ago
Next Level Business Services - SAP Hybris

Next Level Business Services

Parsippany-Troy Hills, New Jersey, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Microsoft - Post Doc Researcher

Microsoft

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
Warner Bros Discovery - Senior Machine Learning Engineer

Warner Bros Discovery

Bellevue, Washington, United States (On-Site)
2 Months ago
Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

New York, New York, United States (On-Site)
3 Months ago
Scale AI - Software Engineer, GenAI Model Evaluation

Scale AI

San Francisco, California, United States (Hybrid)
4 Months ago
Microsoft - Post Doc Researcher – AI (Agentic Systems & Interaction)

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Microsoft - Member of Technical Staff, Infrastructure Engineer

Microsoft

Mountain View, California, United States (Hybrid)
1 Month ago
Meetelise - Junior Research Scientist

Meetelise

(On-Site)
3 Months ago
Cornerstone OnDemand - Principal Data Scientist

Cornerstone OnDemand

Pune, Maharashtra, India (Hybrid)
5 Months ago
DraftKings - Lead Machine Learning Engineer, Platform

DraftKings

Boston, Massachusetts, United States (On-Site)
6 Days ago
Trend Micro - NLP / Prompt Engineer (VicOne_Automotive Security)

Trend Micro

Taipei City, Taiwan (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Shenzhen, Guangdong Province, China (On-Site)

Bengaluru, Karnataka, India (On-Site)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Shanghai, Shanghai, China (On-Site)

Shanghai, Shanghai, China (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug