Senior Infrastructure Engineer

1 Month ago • 6 Years + • Artificial Intelligence • Research & Development • $168,000 PA - $310,500 PA

Job Summary

Job Description

NVIDIA's CPU SOC Infrastructure team seeks a Senior Infrastructure Engineer to leverage AI and ML in chip design, debug, and testing. Responsibilities include defining and deploying AI/ML applications, collaborating with hardware teams to integrate AI/LLM solutions, architecting novel tools and UIs, staying current on AI/ML advancements, troubleshooting, and resolving technical obstacles. The role involves working on projects spanning consumer graphics, self-driving cars, and AI, contributing to the future of computing. The ideal candidate will possess strong software architecture, development, and testing experience, along with expertise in AI/ML technologies and relevant programming languages.
Must have:
  • BS/MS in CS/CE/EE or equivalent
  • 6+ years relevant experience
  • Strong software architecture & development
  • Proficient in Python/Shell scripting
  • Experience with RAGs and LangGraph
  • Excellent problem-solving & communication skills
Good to have:
  • RTL design/verification tool experience
  • Experience creating scalable AI/LLM applications
  • Experience with PyTorch, REST APIs, or webservers
  • CI system administration (Jenkins, k8s, LSF)
  • Experience with containers (Docker)
Perks:
  • Competitive salary
  • Comprehensive benefits package
  • Equity

Job Details

We are now looking for a Senior Infrastructure Engineer! NVIDIA is looking to tap onto AI to define next generation of chip design ! NVIDIA is seeking a passionate, highly motivated, and creative senior software engineer to be part of its CPU SOC Infrastructure team. We develop methodologies and craft tools to streamline the design/verification of NVIDIA's CPU, memory and SOC designs.

This position offers the opportunity to have real impact in a dynamic, technology-focused company impacting product lines ranging from consumer graphics to self-driving cars and the growing field of artificial intelligence. We are creating a team of outstanding people stretching around the globe, whose mission is to push the frontiers of what is possible today and define the platform for the future of computing. Come, join us today!

What you’ll be doing:

  • Define and deploy AI and ML applications to aid chip design, debug & testing stages.

  • Collaborate closely with our hardware chip design teams to understand their infrastructure needs and map them onto AI/LLM solutions.

  • Architect and develop novel tools, user interfaces, and creative applications.

  • Stay on top of latest advancements in AI/ML technologies and frameworks (transformers, RL, RAG, GenAI) and advocate for their integration within the company.

  • Troubleshoot and resolve critical technical or productivity obstacles that impact team’s performance.

What we need to see:

  • BS/MS in Computer Science or Computer Engineering or Electrical Engineering or equivalent experience

  • 6+ years of relevant work experience

  • Strong software architecture, development, & testing experience

  • Solid understanding of Linux and proficient in programming & scripting skills (ex. Python/Shell)

  • Prior exposure to RAGs (Retrieval-Augmented Generation) and LangGraph based workflows for AI agent integration

  • Strong problem-solving abilities and a passion for debugging

  • Excellent communication and interpersonal skills

Ways to stand out from the crowd:

  • Exposure to RTL design/verification tools (VCS or equivalent simulation tools, debug tools like Verdi) and computer architecture.

  • Experience in creating scalable AI/LLM based applications for a wide user base.

  • Experience with running workloads using PyTorch, interfacing with REST APIs or webservers.

  • A strong passion for continual learning and keeping abreast of new technologies and approaches in AI/ML infrastructure.

  • Experience administering CI systems (ex. Jenkins, k8s, LSF) and containers (Docker).

With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and dedicated people in the world working for us. If you are creative, autonomous and love a challenge, we want to hear from you.

The base salary range is 168,000 USD - 310,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

ByteDance - Site Reliability Engineer, Edge Services

ByteDance

Boston, Massachusetts, United States (On-Site)
1 Month ago
CloudHire - Wordpress Full Stack Developer

CloudHire

Gurugram, Haryana, India (Remote)
2 Weeks ago
Nielsen Holdings - Software Engineer - Bigdata ( Java or Scala or  Python, Spark, SQL, AWS )

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
ByteDance - Site Reliability Engineer, Edge Services

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Trend Micro - NLP / Prompt Engineer (VicOne_Automotive Security)

Trend Micro

Taipei City, Taiwan (On-Site)
6 Months ago
NVIDIA - AI Algorithms Software Engineer (RDSS Intern)

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
NVIDIA - Solutions Architect - Cloud Providers and Hyperscale

NVIDIA

Washington, United States (On-Site)
2 Weeks ago
Meta - Software Engineer, Machine Learning

Meta

Seattle, Washington, United States (On-Site)
5 Months ago
Hitachi - Senior AI Data Scientist

Hitachi

Chennai, Tamil Nadu, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Payactiv - Database Developer

Payactiv

Milpitas, California, United States (On-Site)
6 Months ago
Nielsen Holdings - Senior Software Engineer - Back-end (Java, Scala, Big Data)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Luxoft - Regular Data Engineer

Luxoft

(Remote)
4 Months ago
Samsung Semiconductor - Staff Software Engineer – Platform

Samsung Semiconductor

San Jose, California, United States (Hybrid)
3 Weeks ago
Patreon - Site Reliability Engineer

Patreon

United States (Remote)
2 Weeks ago
ByteDance - Network Reliability Engineer - Physical Network Infrastructure

ByteDance

Singapore (On-Site)
2 Months ago
ByteDance - Principal Site Reliability Engineer, CDN

ByteDance

Singapore (On-Site)
5 Months ago
CloudHire - Wordpress Full Stack Developer

CloudHire

Karnataka, India (Remote)
3 Weeks ago
ByteDance - Research Scientist, Foundation Model, Speech & Audio

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
NVIDIA - Design Verification Engineer (RDSS Intern)

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

Netflix - Distributed Systems Engineer (L4) - Data Platform

Netflix

United States (Remote)
5 Months ago
The Walt Disney Company - Lead Data Engineer

The Walt Disney Company

San Francisco, California, United States (On-Site)
4 Months ago
Turtle Rock Studios - Senior Tools Engineer

Turtle Rock Studios

California, United States (Remote)
2 Weeks ago
On Location - Art Director - Production & Hospitality

On Location

Los Angeles, California, United States (Hybrid)
1 Month ago
Tencent - Business Development Manager

Tencent

California, United States (On-Site)
1 Month ago
Discord - Staff Product Designer, Platform Ecosystem

Discord

United States (Remote)
3 Months ago
Rockstar Games - Director of Security Operations

Rockstar Games

New York, New York, United States (On-Site)
2 Weeks ago
Nintendo - Experiential Marketing Specialist (Event Planning/Strategy)

Nintendo

Redmond, Washington, United States (Hybrid)
6 Months ago
ByteDance - Research Scientist Graduate (High-Performance Computing (Inference Optimization) - Vision AI Platform)

ByteDance

Seattle, Washington, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

ByteDance - AI Security Researcher - Security - San Jose

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
FTF Studios - FTF Mid-Level Programmer

FTF Studios

(Remote)
1 Year ago
Scanline VFX - Research Intern (Summer 2025)

Scanline VFX

Los Angeles, California, United States (Hybrid)
5 Months ago
SmileGate - AI Developer ([LOST ARK Mobile])

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
2 Months ago
Portcast - Senior Machine Learning Engineer

Portcast

Bengaluru, Karnataka, India (Remote)
5 Months ago
AI Fund - Head of AI @ Olakai

AI Fund

California, United States (Remote)
5 Months ago
Airlab Inc  - C++ & Python Programmer

Airlab Inc

Montreal, Quebec, Canada (On-Site)
9 Months ago
NVIDIA - Solution Architect, Generative AI - Digital Human

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
AI Fund - Artificial Intelligence Engineer

AI Fund

California, United States (Remote)
5 Months ago
Tencent - Senior Researcher, Natural Language Processing

Tencent

(On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Texas, United States (Remote)

Santa Clara, California, United States (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

United Kingdom (Remote)

Yokne'am Illit, North District, Israel (On-Site)

Bengaluru, Karnataka, India (Hybrid)

Toronto, Ontario, Canada (On-Site)

Santa Clara, California, United States (Hybrid)

Taipei City, Taiwan (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug