Senior AI Infrastructure Engineer

We are now looking for a Senior AI Infrastructure Engineer! NVIDIA is looking to tap onto AI to define next generation of chip design ! NVIDIA is seeking a passionate, highly motivated, and creative senior software engineer to be part of its CPU SOC Infrastructure team. We develop methodologies and craft tools to streamline the design/verification of NVIDIA's CPU, memory and SOC designs.

This position offers the opportunity to have real impact in a dynamic, technology-focused company impacting product lines ranging from consumer graphics to self-driving cars and the growing field of artificial intelligence. We are creating a team of outstanding people stretching around the globe, whose mission is to push the frontiers of what is possible today and define the platform for the future of computing. Come, join us today!

What you’ll be doing:

• Define and deploy AI and ML applications to aid chip design, debug & testing stages.

• Collaborate closely with our hardware chip design teams to understand their infrastructure needs and map them onto AI/LLM solutions.

• Architect and develop novel tools, user interfaces, and creative applications.

• Stay on top of latest advancements in AI/ML technologies and frameworks (transformers, RL, RAG, GenAI) and advocate for their integration within the company.

• Troubleshoot and resolve critical technical or productivity obstacles that impact team’s performance.

What we need to see:

• BS/MS in Computer Science or Computer Engineering or Electrical Engineering or equivalent experience

• 6+ years of relevant work experience

• Strong software architecture, development, & testing experience

• Solid understanding of Linux and proficient in programming & scripting skills (ex. Python/Shell)

• Prior exposure to RAGs (Retrieval-Augmented Generation) and LangGraph based workflows for AI agent integration

• Strong problem-solving abilities and a passion for debugging

• Excellent communication and interpersonal skills

Ways to stand out from the crowd:

• Exposure to RTL design/verification tools (VCS or equivalent simulation tools, debug tools like Verdi) and computer architecture.

• Experience in creating scalable AI/LLM based applications for a wide user base.

• Experience with running workloads using PyTorch, interfacing with REST APIs or webservers.

• A strong passion for continual learning and keeping abreast of new technologies and approaches in AI/ML infrastructure.

• Experience administering CI systems (ex. Jenkins, k8s, LSF) and containers (Docker).

With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and dedicated people in the world working for us. If you are creative, autonomous and love a challenge, we want to hear from you.