Principal Engineer, Agentic System Architecture

3 Months ago • 15 Years + • Research & Development • $272,000 PA - $425,500 PA

Job Summary

Job Description

NVIDIA seeks a Principal Engineer to design and develop the architecture of systems employing agents, agentic frameworks, and LLMs. This role involves designing scalable, high-performance systems integrating autonomous agents, using existing and future frameworks. Responsibilities include architecting multi-agent workflows for an AI query engine, ensuring system scalability, security, and performance optimization. The ideal candidate will have extensive experience in system architecture and distributed computing, with a proven ability to build robust platforms for both research and production needs. Mentorship and leadership within the team are key aspects of this position, focusing on innovation in the agentic systems space to unlock PB+ scale data for enterprise applications.
Must have:
  • 15+ years software engineering/system architecture experience
  • Strong Python or C++ development skills
  • Experience with distributed computing
  • Proven track record of architecting production-level systems
  • Excellent collaboration and leadership skills
Good to have:
  • PhD in Computer Science or related field
  • Deep understanding of high-performance parallel computing
  • Familiarity with AI frameworks (PyTorch, TensorFlow), NVIDIA technologies (CUDA, TensorRT, Triton)
  • Proficiency in profiling Python code for performance optimization
  • Experience with open-source software projects at PB+ scale
Perks:
  • Highly competitive salary
  • Comprehensive benefits package
  • Equity

Job Details

NVIDIA has been redefining computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and outstanding people! Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world!

NVIDIA is seeking a principal engineer to craft the architecture of systems that apply agents, agentic frameworks, and LLMs. This role focuses on designing, developing, and deploying scalable, high-performance systems that integrate autonomous agents built using existing and future frameworks. The ideal candidate will have a strong background in architecting frameworks and a shown ability to build robust platforms that address both production and research needs. As a Principal Engineer, you will lead the architectural design of end-to-end systems that incorporate multi-agent workflows, with the overarching goal of creating frameworks and reference architectures that allow enterprises to unlock PB+ scale of data. This AI query engine will quickly allow any developer and enterprise to implement applications that improve the efficiency and lives of employees. You'll work closely with teams from different functions to ensure the scalability, security, and performance optimization of this reference architecture while offering mentorship to engineers and encouraging innovation in the agentic systems space.

What you'll be doing:

  • Architect and design large-scale systems of agentic frameworks (e.g., LangGraph, Llama Deploy, AutoGen, CrewAI) that form the base of an AI query engine.

  • Develop system-level solutions that use autonomous agents with existing infrastructure, ensuring scalability, reliability, and composability.

  • Evaluate and select appropriate foundational technologies for various use cases, ensuring optimal extensibility.

  • Ensure system robustness by implementing security standard processes, including those for LLM safety and reliability and remain at the forefront of advancements in LLMs, agentic frameworks, and distributed system design.

  • Provide technical leadership across projects and internal groups while mentoring engineers in system architecture design.

What we need to see:

  • BS or MS in Computer Engineering, Computer Science, or a closely related quantitative field (or equivalent experience).

  • 15+ years of experience in software engineering or system architecture with a strong focus on Python or C++ development.

  • Proven track record of architecting production-level systems that use distributed computing

  • Self-starter with excellent collaboration skills and a history of working with cross-discipline teams including research and production.

  • Strong desire to work on the cutting edge of technology in a rapidly evolving environment while quickly learning and applying new technologies and libraries.

Ways to stand out from the crowd:

  • PhD (or equivalent) in Computer Engineering, Computer Science, or a closely related field.

  • Deep understanding of high-performance parallel computing, with experience in multi-threaded or multi-process environments.

  • Familiarity with AI frameworks (e.g., PyTorch, TensorFlow) and NVIDIA technologies (e.g., CUDA, TensorRT, Triton) and experience developing for GPU platforms and understanding of GPU architectures.

  • Proficiency in profiling Python code to optimize performance (e.g., asyncio vs threading vs multiprocessing).

  • Demonstrated history of contributing and building open-source software projects that address real enterprise challenges at PB+ scale.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family - www.nvidiabenefits.com.

The base salary range is 272,000 USD - 425,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

Hitachi - Senior AI Data Scientist

Hitachi

Chennai, Tamil Nadu, India (On-Site)
6 Months ago
ByteDance - Senior Machine Learning Engineer - AML Algorithm

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
NVIDIA - Software Engineering Manager, Sparse Linear Algebra Libraries

NVIDIA

California, United States (Hybrid)
3 Months ago
Microsoft - Data and Applied Scientist II

Microsoft

Hyderabad, Telangana, India (On-Site)
3 Months ago
Fabric - Applied Cryptographer, ZKP Research

Fabric

Belgium (Remote)
6 Months ago
NVIDIA - Verification Engineer, SOC-V

NVIDIA

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Zoox - Software Engineer, Robot Software Infrastructure Internship/Co-op

Zoox

Foster City, California, United States (On-Site)
6 Months ago
Zuru - SRE: Structural R&D Engineer

Zuru

Kolkata, West Bengal, India (On-Site)
3 Months ago
ByteDance - Student Researcher (Foundation Models - LLM Post-Training)

ByteDance

San Jose, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Aera Technology - Senior Data Scientist

Aera Technology

Pune, Maharashtra, India (On-Site)
6 Months ago
ByteDance - Research Scientist, Foundation Model, Vision

ByteDance

Singapore (On-Site)
5 Months ago
Microsoft - Senior Software Engineer - AI/ML

Microsoft

Dublin, County Dublin, Ireland (On-Site)
3 Months ago
Epic Games - Chercheur scientifique principal

Epic Games

Montreal, Quebec, Canada (On-Site)
3 Months ago
Tencent - Principal Researcher: Artificial General Intelligence (Natural Language Processing)

Tencent

Bellevue, Washington, United States (On-Site)
7 Months ago
NVIDIA - Software Engineer Intern - Mapping and Generative AI

NVIDIA

Shanghai, Shanghai, China (On-Site)
3 Months ago
Meta - Research Scientist, Machine Learning (PhD)

Meta

Sunnyvale, California, United States (On-Site)
5 Months ago
Alpha Sense - Join AlphaSense India Talent Community

Alpha Sense

Pune, Maharashtra, India (On-Site)
5 Months ago
DraftKings - Director of Data Science

DraftKings

Boston, Massachusetts, United States (On-Site)
1 Month ago
Stylumia - Senior Machine Learning Engineer - Time Series & Computer Vision

Stylumia

Bengaluru, Karnataka, India (Hybrid)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Clara, California, United States

Next Level Business Services - Java Script Developer (Sr UI Developer with very Strong Exp in Java Script )

Next Level Business Services

Dallas, Texas, United States (On-Site)
6 Months ago
Samsung Semiconductor - Intern, DRAM Process Integration Engineer

Samsung Semiconductor

San Jose, California, United States (On-Site)
4 Months ago
Next Level Business Services - Teradata Developer

Next Level Business Services

St. Louis, Missouri, United States (On-Site)
5 Months ago
Globalization Partners - Front End Developer

Globalization Partners

United States (Remote)
2 Months ago
ByteDance - Research Scientist Intern (Doubao (Seed) - Music Foundation Model) - 2024 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Illumination - Director, Partnerships Marketing

Illumination

Santa Monica, California, United States (On-Site)
5 Months ago
Fluence - Chief Battery Energy Storage System (BESS) Engineer

Fluence

Arlington, Virginia, United States (Hybrid)
6 Months ago
Tencent - Video Standards & Encoding Optimization Intern

Tencent

Palo Alto, California, United States (On-Site)
5 Months ago
ByteDance - Senior Software Engineer, Multi Cloud CDN - San Jose / Seattle / Boston

ByteDance

Boston, Massachusetts, United States (On-Site)
4 Months ago
Google - Software Engineer III, Machine Learning, Google Ads

Google

Mountain View, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Hardware Board Design Manager, IC Product

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
3 Months ago
NVIDIA - Senior ASIC Design Verification Engineer

NVIDIA

Canada (Hybrid)
1 Month ago
Actian - Core Java Developer - Pune

Actian

Pune, Maharashtra, India (On-Site)
6 Months ago
Microsoft - Research Intern - Economics and Computation

Microsoft

Cambridge, Massachusetts, United States (On-Site)
3 Months ago
Microsoft - Research Intern - Undergraduate

Microsoft

Redmond, Washington, United States (On-Site)
3 Months ago
ByteDance - Senior Software Development Engineer - Database NoSQL Redis

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Cadence - Design Engineer Intern

Cadence

San Jose, California, United States (On-Site)
6 Months ago
ByteDance - Experienced Technical Lead - Edge Cloud Infrastructure - San Jose / Seattle / Boston

ByteDance

Boston, Massachusetts, United States (On-Site)
6 Months ago
Samsung Semiconductor - Intern, Gen AI Engineer

Samsung Semiconductor

San Jose, California, United States (On-Site)
3 Months ago
ByteDance - Software Engineer Intern (Applied Machine Learning-Enterprise) - 2025 Summer/Fall (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (Remote)

California, United States (Remote)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (On-Site)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug