Hardware Architecture Modeling Engineer, Accelerators

1 Month ago • 3 Years + • Artificial Intelligence • $156,000 PA - $229,000 PA

Job Summary

Job Description

This role focuses on shaping the future of AI/ML hardware acceleration at Google, specifically contributing to TPU (Tensor Processing Unit) technology. Responsibilities include ML workload characterization and benchmarking, performance and power analysis, developing architectural and microarchitectural models, collaborating with hardware and software teams for co-design, and proposing optimizations for next-generation TPUs. The engineer will work with hardware and software architects to model, analyze, and define next-generation TPUs. The position requires experience in computer architecture performance analysis, software development (C++ preferred), and ideally experience with Python, processor/accelerator design, and RTL design using Verilog.
Must have:
  • Bachelor's degree in relevant field or equivalent experience
  • 3+ years experience in computer architecture performance analysis
  • C++ software development experience
  • Workload performance analysis and benchmarking
  • Collaboration with hardware and software teams
Good to have:
  • Experience in applying computer architecture principles
  • Hardware and software co-design experience
  • Python development experience
  • Knowledge of processor/accelerator design and ML model mapping
  • RTL design using Verilog

Job Details

Minimum qualifications:

  • Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, a related field, or equivalent practical experience.
  • 3 years of experience in computer architecture performance analysis and optimization, or a PhD degree.
  • Experience in developing software systems in C++.

Preferred qualifications:

  • Experience in applying computer architecture principles to solve open-ended problems.
  • Experience in analyzing workload performance and creating benchmarks.
  • Experience in hardware and software co-design.
  • Experience with developing in Python.
  • Knowledge of processor design or accelerator designs and mapping ML models to hardware architectures.
  • Knowledge of design of digital reasoning at the Register Transfer Level (RTL) using Verilog.

About the job

In this role, you’ll work to shape the future of AI/ML hardware acceleration. You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You’ll be part of a diverse team that pushes boundaries, developing custom silicon solutions that power the future of Google's TPU. You'll contribute to the innovation behind products loved by millions worldwide, and leverage your design and verification expertise to verify complex digital designs, with a specific focus on TPU architecture and its integration within AI/ML-driven systems.

In this role, you will work with hardware and software architects to model, analyze, and define next-generation Tensor Processing Unit (TPUs).

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $156,000-$229,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Work on Machine Learning (ML) workload characterization and benchmarking.
  • Conduct performance and power analysis and evaluate proposals.
  • Develop architectural and microarchitectural models to enable quantitative analysis.
  • Collaborate with partners in hardware design, software, compiler, Machine Learning (ML) model and research teams for hardware/software co-design.
  • Propose capabilities and optimizations for next-generation TPUs and chip roadmap.

Similar Jobs

Nintendo - Senior Systems Engineer, Linux

Nintendo

Redmond, Washington, United States (On-Site)
1 Month ago
Google - Pixel Hardware Reliability Engineer

Google

Mountain View, California, United States (On-Site)
1 Month ago
Microsoft - Software Engineer 2

Microsoft

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
1 Month ago
ByteDance - Relational Database Intern

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Google - Virtual Machine Manager, Software Engineer II, Full Stack

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Google - Staff Software Engineer, AI/ML, Google Workspace

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Microsoft - Technical Program Manager, AI Multimodal

Microsoft

London, England, United Kingdom (On-Site)
2 Months ago
Microsoft - Member of Technical Staff, AI - Reinforcement Systems

Microsoft

London, England, United Kingdom (On-Site)
2 Months ago
Saama Technologies,  Inc  - NLP Engineer

Saama Technologies, Inc

(Remote)
3 Months ago
Google - Software Engineer, PhD

Google

Sunnyvale, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Product Engineer, Cloud Compute and Storage

Google

Atlanta, Georgia, United States (On-Site)
1 Month ago
Rackspace Technology - Senior Systems Engineer HPC

Rackspace Technology

United States (Remote)
1 Month ago
Urbint - Senior Full Stack Developer

Urbint

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Rivos - Platform FPGA Design

Rivos

Santa Clara, California, United States (On-Site)
7 Months ago
NVIDIA - Silicon Power Performance Engineer

NVIDIA

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Microsoft - Security Software Engineer II

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Microsoft - Software Development Engineer 2

Microsoft

Redmond, Washington, United States (On-Site)
4 Weeks ago
ByteDance - Network Operations Engineer, EDGE Networking

ByteDance

Singapore (On-Site)
6 Months ago
Meta - Software Engineer, Machine Learning

Meta

Burlingame, California, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

The Walt Disney Company - Editor - Disney Publishing

The Walt Disney Company

New York, New York, United States (On-Site)
1 Month ago
Passive Logic - Weather Simulation Engineer

Passive Logic

Salt Lake City, Utah, United States (On-Site)
5 Months ago
Google - Senior Technical Program Manager I, Security, Google Cloud Platforms

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
ION - Principal Business Consultant - Endur

ION

Houston, Texas, United States (On-Site)
7 Months ago
Epic Games - Director, Creative Marketing

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
ByteDance - Partnership Development Specialist - LLM Data Acquisition and Production

ByteDance

San Francisco, California, United States (On-Site)
4 Months ago
Nintendo - Inventory & Receiving Coordinator - Nintendo San Francisco Store

Nintendo

San Francisco, California, United States (On-Site)
6 Months ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Speech Understanding) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Playtech - IT Tech Support (Onsite)

Playtech

Michigan, United States (On-Site)
1 Month ago
Microsoft - Principal Software Engineer - RDMA

Microsoft

Santa Clara, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Airlab Inc  - Jr Programmer Artificial Intelligence

Airlab Inc

Montreal, Quebec, Canada (On-Site)
1 Year ago
NVIDIA - Applied Physics ML Research Intern - Fall 2025

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
3 Months ago
Google - Software Engineer III, AI/ML, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Google - Software Engineer III, Distributed Machine Learning, YouTube

Google

Mountain View, California, United States (On-Site)
1 Month ago
Inworld AI - AI Trainer (Contractor) - Writing & Gaming

Inworld AI

Vancouver, British Columbia, Canada (Remote)
2 Months ago
Google - Senior Technical Program Manager I, Infrastructure, Google Cloud

Google

Durham, North Carolina, United States (On-Site)
1 Month ago
ION - Senior AI Engineer, Italy

ION

Pisa, Tuscany, Italy (On-Site)
7 Months ago
NVIDIA - Director, AI Software

NVIDIA

Taipei City, Taiwan (On-Site)
4 Months ago
Netflix - Machine Learning Engineer (L5) - Content and Studio

Netflix

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

New York, New York, United States (On-Site)

Waterloo, Ontario, Canada (On-Site)

Taipei City, Taiwan (On-Site)

Austin, Texas, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug