Silicon AI/ML Architect, TPU

2 Weeks ago • 10 Years + • Research & Development • Artificial Intelligence

Job Summary

Job Description

This role involves architecting AI/ML SoCs and supporting implementation and validation phases (pre-silicon and post-silicon). You will collaborate with internal and external teams to understand SoC function requirements, considering hardware, software, and economic factors. Responsibilities include developing SoC architecture and specifications, evaluating silicon solutions (off-the-shelf, co-developments, custom designs, chiplets), creating high-performance hardware/software interfaces, and collaborating with design, verification, and validation stakeholders. You will also evaluate power, performance, and area tradeoffs, driving improvements across generations. The work contributes to Google's direct-to-consumer products and the next generation of hardware experiences.
Must have:
  • 10+ years in ML/graphics SoC architecture
  • 8+ years in multi-chiplet SoC tradeoff analysis
  • ASIC design flow experience (spec to production)
  • SoC architecture and specification development
  • Collaboration with system and software teams
Good to have:
  • SoC design, RTL coding, integration flows
  • Hardware/software interface optimization
  • Performance estimation, test plan definition
  • Procedural programming (C++, Python, Go)
  • High-performance/low-power design techniques

Job Details

Minimum qualifications:

  • Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, a related field, or equivalent practical experience.
  • 10 years of experience in architecture of machine learning or graphics SoCs.
  • 8 years of experience with performance, power, area, cost tradeoff analysis for multi chiplet SoC architectures.
  • Experience with ASIC design flows, from specification to production.

Preferred qualifications:

  • Experience in SoC designs, RTL coding and integration flows.
  • Experience working with software teams optimizing the hardware/software interface.
  • Experience in estimating performance by analysis and modeling, and experience in defining and driving performance test plans.
  • Experience in a procedural programming language (e.g., C++, Python, Go).
  • Knowledge of high performance and low power design techniques.
  • Knowledge of arithmetic units, bus architectures, accelerators, or memory hierarchies.

About the job

Be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's direct-to-consumer products. You'll contribute to the innovation behind products loved by millions worldwide. Your expertise will shape the next generation of hardware experiences, delivering unparalleled performance, efficiency, and integration.

As a Silicon AI/ML Architect, you will drive the Architecture of an AI/ML SoC and will support the engineering teams during the implementation and validation phases, pre-silicon, and post-silicon. You will work with internal system teams and external partners to develop an understanding of the required SoC functions given its surrounding hardware, software, and the economic environments. You will also collaborate with the Engineering teams to drive the optimal balance between performance, features, power, schedule, and cost.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

Responsibilities

  • Develop SoC architecture and Architecture specifications that meet current and future computing requirements for AI/ML roadmap.
  • Evaluate different silicon solutions for executing Google’s data center AI accelerator roadmap: off-the-shelf components, vendor co-developments, custom designs, and chiplets.
  • Collaborate with Systems and Software teams to create high performance hardware/software interfaces.
  • Collaborate with design, verification, emulation, physical design, packaging, and silicon validation stakeholders to ensure that designs are complete, correct, and performant.
  • Evaluate power, performance, area tradeoffs and drive improvements across generations.

Similar Jobs

ByteDance - Software Engineer

ByteDance

San Jose, California, United States (On-Site)
2 Weeks ago
ByteDance - Software Engineer

ByteDance

San Jose, California, United States (On-Site)
1 Week ago
Tellius - Devops Engineer

Tellius

Bengaluru, Karnataka, India (On-Site)
8 Hours ago
N-iX - Senior Performance Test Engineer

N-iX

Ukraine (Remote)
2 Weeks ago
Google - Lead Software Engineer, Engineering Productivity

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Days ago
NVIDIA - Senior Chip Design Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
Google - Software Engineering Manager II, Google Compute Infrastructure

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Days ago
Google - Student Researcher, PhD, Winter/Summer 2025

Google

Montreal, Quebec, Canada (On-Site)
5 Months ago
NVIDIA - Manager, Developer Technology, Data Compression

NVIDIA

California, United States (Hybrid)
3 Months ago
Krafton  - Corporate Social Responsibility (CSR) Specialist

Krafton

Seoul, South Korea (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Marketing Data Analyst, Global Partnerships

Google

New York, New York, United States (On-Site)
2 Weeks ago
Playrix - Lead Unity Software Engineer (Gameplay)

Playrix

Portugal (Remote)
6 Months ago
Google - Software Engineer, Compiler Frontend, Silicon

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
PwC - Backend Developer/Consultant with German (freelance)

PwC

Warsaw, Masovian Voivodeship, Poland (Hybrid)
7 Months ago
Scale AI - Robotics Field Engineer

Scale AI

San Francisco, California, United States (On-Site)
1 Day ago
ByteDance - Edge Network Engineer - EDGE Network

ByteDance

London, England, United Kingdom (On-Site)
5 Months ago
Jane Street - MacOS Engineer

Jane Street

London, England, United Kingdom (On-Site)
6 Hours ago
Wildlife Studios - Business Intelligence Analyst

Wildlife Studios

São Paulo, State Of São Paulo, Brazil (On-Site)
6 Months ago
Marsh McLennan - Manager - Actuarial

Marsh McLennan

Mumbai, Maharashtra, India (Hybrid)
5 Hours ago
Qualcomm - Physical Design Engineer, Staff

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Nagarro - Staff Consultant ,SAP Analytics Data Manageme

Nagarro

Gurugram, Haryana, India (On-Site)
6 Months ago
Assystems - Senior Urban Planner

Assystems

Gurugram, Haryana, India (On-Site)
6 Months ago
Nextgen-Clearing - DevOps Engineer

Nextgen-Clearing

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Hitachi - D365 F&O Functional Finance Consultant

Hitachi

Pune, Maharashtra, India (On-Site)
6 Months ago
PluginLive - Recruitment Associate

PluginLive

Mumbai, Maharashtra, India (On-Site)
7 Months ago
Google - ASIC Design Verification Engineer

Google

Bengaluru, Karnataka, India (On-Site)
2 Days ago
Synechron - Senior Developer (Python, Java, and IBM DataStage)

Synechron

Pune, Maharashtra, India (On-Site)
1 Day ago
Tide - Staff - Backend Engineer

Tide

Hyderabad, Telangana, India (Hybrid)
1 Day ago
Dream Sports - MISE Sales Manager - Meetings, Incentives & Sporting Experiences

Dream Sports

Bengaluru, Karnataka, India (On-Site)
1 Month ago
WRI - Intern – Just Transition, Electric Mobility

WRI

India (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Rivos - Silicon Microarchitecture & Logic Design - Intern

Rivos

Santa Clara, California, United States (On-Site)
6 Months ago
NVIDIA - Senior Research Engineer, Foundation Model Training Infrastructure

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Riot Games - Senior Researcher, China Studio

Riot Games

Shanghai, Shanghai, China (On-Site)
2 Weeks ago
Google - CPU Design Verification Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Days ago
NVIDIA - STA Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
Cadence - Principal Design Engineer

Cadence

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Netflix - Software Engineer 5 - Streaming Algorithms

Netflix

United States (Remote)
6 Months ago
Nagarro - SAP FI/CO Senior Consultant

Nagarro

Germany (Remote)
1 Month ago
ByteDance - Student Researcher (Foundation Models - Reasoning, Planning & Agent) - Doubao (Seed) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Google - Multimedia/Graphics ASIC IP Hardware Architect

Google

Mountain View, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug