Machine Learning Hardware Architect

1 Month ago • 3-7 Years • Artificial Intelligence • $156,000 PA - $229,000 PA

Job Summary

Job Description

This role involves shaping the future of AI/ML hardware acceleration by developing cutting-edge TPU (Tensor Processing Unit) technology. You'll work with hardware and software architects to model, analyze, and define next-generation TPUs. Responsibilities include ML workload characterization and benchmarking, performance and power analysis, developing architectural models, collaborating on hardware/software co-design, and proposing optimizations for next-generation TPUs. You'll contribute to the innovation behind Google products and leverage your design and verification expertise to verify complex digital designs, focusing on TPU architecture and its integration within AI/ML systems.
Must have:
  • Bachelor's degree in relevant field or equivalent experience
  • 3+ years experience in computer architecture performance analysis and optimization
  • Experience developing software systems in C++
  • Work on ML workload characterization and benchmarking
  • Conduct performance and power analysis
Good to have:
  • 7+ years experience in computer architecture performance analysis and optimization
  • Experience in applying computer architecture principles to solve open-ended problems
  • Experience in analyzing workload performance and creating benchmarks
  • Experience in hardware and software co-design
  • Knowledge of processor or accelerator designs and mapping ML models to hardware architectures
  • Knowledge of RTL design using Verilog
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, a related field, or equivalent practical experience.
  • 3 years of experience in computer architecture performance analysis and optimization, or a PhD degree.
  • Experience in developing software systems in C++.

Preferred qualifications:

  • 7 years of experience in computer architecture performance analysis and optimization.
  • Experience in applying computer architecture principles to solve open-ended problems.
  • Experience in analyzing workload performance and creating benchmarks.
  • Experience in hardware and software co-design.
  • Knowledge of processor design or accelerator designs and mapping ML models to hardware architectures.
  • Knowledge of design of digital reasoning at the Register Transfer Level (RTL) using Verilog.

About the job

In this role, you’ll work to shape the future of AI/ML hardware acceleration. You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You’ll be part of a diverse team that pushes boundaries, developing custom silicon solutions that power the future of Google's TPU. You'll contribute to the innovation behind products loved by millions worldwide, and leverage your design and verification expertise to verify complex digital designs, with a specific focus on TPU architecture and its integration within AI/ML-driven systems.

In this role, you will work with hardware and software architects to model, analyze, and define next-generation Tensor Processing Unit (TPUs).

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $156,000-$229,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Work on Machine Learning (ML) workload characterization and benchmarking.
  • Conduct performance and power analysis and evaluate proposals.
  • Develop architectural and microarchitectural models to enable quantitative analysis.
  • Collaborate with partners in hardware design, software, compiler, Machine Learning (ML) model and research teams for hardware/software co-design.
  • Propose capabilities and optimizations for next-generation TPUs and chip roadmap.

Similar Jobs

Amanotes - Senior Level Designer (New Games - Hybrid Casual Games)

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
2 Months ago
PlayStation Global - Lead Environment Artist

PlayStation Global

Helsinki, Uusimaa, Finland (On-Site)
3 Months ago
Xsolla - Project Manager

Xsolla

Montreal, Quebec, Canada (Hybrid)
1 Month ago
GOALS - Principal Concept Artist

GOALS

Stockholm, Stockholm County, Sweden (Hybrid)
1 Month ago
Globalization Partners - Benefits Specialist

Globalization Partners

(Remote)
3 Months ago
Google - Software Engineer, Generative AI Blackbelt, Google Cloud Platform

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Genies - Lead Machine Learning Engineer, 3D Gen AI & Graphics

Genies

San Mateo, California, United States (On-Site)
2 Months ago
AI Fund - Artificial Intelligence Engineer

AI Fund

California, United States (Remote)
7 Months ago
Microsoft - Senior Researcher

Microsoft

Hong Kong Island, Hong Kong (On-Site)
1 Month ago
Google - Software Engineer III, AI/ML, Platforms and Devices

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Socialpoint - Principal UX/UI Designer

Socialpoint

Barcelona, Catalonia, Spain (Hybrid)
5 Months ago
NVIDIA - Clock Design Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Months ago
PwC - IN_Manager_ Scrum Master_Advisory Corporate_Advisory_ Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Gallagher - SPA - Content Developer and Visual Designer

Gallagher

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Altagram Group - QA Test Lead (Gaming) - Video Game Localization

Altagram Group

Germany (On-Site)
7 Months ago
PwC - Associate, Energy Regulatory, Utility Transformation Advisory

PwC

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Bounteous - Product Manager, B2B

Bounteous

Bernards, New Jersey, United States (Hybrid)
7 Months ago
PlayStation Global - Senior Program Manager, Account & Identity

PlayStation Global

California, United States (On-Site)
2 Months ago
Seedify - AI Product Manager

Seedify

(Remote)
4 Months ago
ION - Data Associate - KYC6

ION

Budapest, Hungary (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

The Walt Disney Company - Principal Software Engineer

The Walt Disney Company

New York, New York, United States (On-Site)
6 Months ago
The Walt Disney Company - Security Officer (Part-Time)

The Walt Disney Company

Burbank, California, United States (On-Site)
1 Month ago
Next Level Business Services - SAS Data Scientist

Next Level Business Services

Houston, Texas, United States (On-Site)
7 Months ago
Nintendo - Senior Income Tax Accountant

Nintendo

Redmond, Washington, United States (Hybrid)
9 Months ago
NVIDIA - System Architect

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
ByteDance - Relational Database Intern (Data Tech Infra)

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Google - Systems Development Engineer, Google Distributed Cloud

Google

Kirkland, Washington, United States (On-Site)
1 Month ago
Zoox - Senior/Staff Software Engineer - Machine Learning

Zoox

Boston, Massachusetts, United States (Hybrid)
7 Months ago
Google - CPU System Software Engineer, Performance Architect

Google

Mountain View, California, United States (On-Site)
1 Month ago
Trek - Service Technician

Trek

Raleigh, North Carolina, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

PwC - AI/ML Azure Engineer (m/f/d)

PwC

Luxembourg (On-Site)
7 Months ago
Alpha Sense - Lead AI Platform Engineer

Alpha Sense

New York, New York, United States (On-Site)
5 Months ago
NVIDIA - Senior Compiler Engineer – Deep Learning

NVIDIA

Redmond, Washington, United States (Remote)
1 Month ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Generative AI) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
NVIDIA - Applied Research Intern - 2025

NVIDIA

Yerevan, Yerevan, Armenia (On-Site)
3 Months ago
NVIDIA - Senior AI-HPC Storage Engineer

NVIDIA

Westford, Massachusetts, United States (On-Site)
3 Months ago
Google - Senior Software Engineer, Cloud AI

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Google - Machine Learning Algorithm Engineer, Silicon

Google

Mountain View, California, United States (On-Site)
1 Month ago
Salesforce - 2025 PhD Intern - AI Research, Singapore

Salesforce

Singapore, Singapore (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

New York, New York, United States (On-Site)

Waterloo, Ontario, Canada (On-Site)

Taipei City, Taiwan (On-Site)

Austin, Texas, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug