Accelerator Architect and Performance Engineer, Generative AI

1 Month ago • 8 Years + • Artificial Intelligence • $183,000 PA - $271,000 PA

Job Summary

Job Description

This role involves driving forward-looking Generative AI (GenAI) Machine Learning architecture exploration for Tensor mobile SoCs. Collaboration with research, system architecture, and compiler engineering teams is crucial to optimize future workloads across the entire tech stack (hardware, software, use cases, network, and external components). Responsibilities include working with researchers and program management to define system architecture requirements for future GenAI use cases, applying advanced research to achieve breakthrough power and performance improvements on GenAI workloads, and optimizing GenAI performance by defining optimal model scheduling on TPU compute engines. The ideal candidate possesses expertise in computer architecture, performance, and compilers, with experience in GenAI model architectures (LLMs, Vision Transformers, etc.) and programming languages (C/C++, Python) and deep learning frameworks (TensorFlow/Jax/PyTorch).
Must have:
  • Bachelor's degree in relevant field
  • 8+ years experience in computer architecture, performance, or compiler
  • Generative AI model architecture experience
  • Proficiency in C/C++, Python, TensorFlow/Jax/PyTorch
  • Drive GenAI architecture exploration for Tensor mobile SoCs
  • Collaborate with research and engineering teams
  • Define system architecture requirements for GenAI
Good to have:
  • Master's or PhD in relevant field
  • Experience with domain-specific accelerators
  • Distributed/parallel programming experience
  • Hardware/software co-design for machine learning
  • Simulator development and micro-architecture experience
  • Excellent communication skills

Job Details


Minimum qualifications:

  • Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, a related field, or equivalent practical experience.
  • 8 years of work or academic research experience in computer or chip architecture, performance, or compiler.
  • Experience with Generative AI model architectures (e.g., Large Language Models, Vision Transformers, Image Diffusion Models, etc.).
  • Experience with one or more general purpose programming languages including (but not limited to) C/C++ or Python and deep learning frameworks like TensorFlow/Jax/Pytorch.

Preferred qualifications:

  • Master's degree or PhD in Electrical Engineering, Computer Engineering or Computer Science, with an emphasis on computer architecture.
  • Experience with domain-specific accelerators.
  • Experience with distributed/parallel programming.
  • Experience with hardware/software co-design for machine learning.
  • Experience with simulator development and micro-architecture.
  • Excellent communication skills.

About the job

Be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's direct-to-consumer products. You'll contribute to the innovation behind products loved by millions worldwide. Your expertise will shape the next generation of hardware experiences, delivering unparalleled performance, efficiency, and integration. Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

The US base salary range for this full-time position is $183,000-$271,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Drive forward-looking GenAI Machine Learning architecture exploration for Tensor mobile SoCs while collaborating with research teams, system architecture teams, and compiler engineers to optimize future workloads from both all perspectives across the tech stack including hardware, software, use case, network, and external components.
  • Work with researchers and Program Management teams to define system architecture requirements for future Generative AI use cases.
  • Apply advanced research in architecture and process technology to get breakthrough power and performance improvements on Generative AI workloads.
  • Optimize performance of GenAI use cases by defining an optimal model scheduling on the TPU compute engines.

Similar Jobs

WebTech Corporation - Machine Vision Engineer

WebTech Corporation

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Scale AI - ML Research Operations Lead

Scale AI

San Francisco, California, United States (On-Site)
2 Weeks ago
CyberArk - Senior Data Scientist

CyberArk

Israel (Hybrid)
4 Weeks ago
Scale AI - Head of Experiments, Generative AI

Scale AI

San Francisco, California, United States (On-Site)
1 Month ago
Keywords Studios - Senior Research Associate - AI

Keywords Studios

California, United States (Remote)
2 Months ago
Microsoft - Senior Researcher – Generative AI

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Google - ML System Engineer, AICore, Platforms and Devices

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Microsoft - Language Engineer

Microsoft

Mountain View, California, United States (Hybrid)
1 Month ago
Spell Brush - AI Anime Researcher

Spell Brush

Tokyo, Japan (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

bytedance - Software Engineer Intern

bytedance

San Jose, California, United States (On-Site)
1 Week ago
Reddit - Senior Data Scientist, Ads

Reddit

United States (Remote)
2 Weeks ago
The Walt Disney Company - Senior Data Scientist - NLP/LLM

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Month ago
NVIDIA - Senior Site Reliability Engineer - AI Research Clusters

NVIDIA

Westford, Massachusetts, United States (Hybrid)
3 Months ago
Match Group - Sr. Software Engineer, Generative AI

Match Group

Palo Alto, California, United States (Hybrid)
7 Months ago
Linden lab - Senior Software Engineer, Mobile

Linden lab

San Francisco, California, United States (On-Site)
7 Months ago
bytedance - Research Scientist in Foundation Model, Speech Understanding - 2025 Start (PhD)

bytedance

San Jose, California, United States (On-Site)
7 Months ago
bytedance - Research Scientist, Code Generation

bytedance

San Jose, California, United States (On-Site)
7 Months ago
NVIDIA - Senior Developer Relations Manager - Robotics

NVIDIA

Tokyo, Japan (On-Site)
4 Months ago
playrix  - Generative AI Engineer

playrix

Ireland (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Diego, California, United States

Jane Street - Front End Software Engineer

Jane Street

New York, United States (On-Site)
2 Weeks ago
Evolution  - iGaming Live Performer (Guest Service Agent Alternative)

Evolution

Atlantic City, New Jersey, United States (On-Site)
1 Year ago
Sailpoint - Director and Deal Architect

Sailpoint

United States (On-Site)
3 Weeks ago
Ion - Lead Python Engineer, New York

Ion

New York, New York, United States (Hybrid)
7 Months ago
Notion - Software Engineer, Native macOS Development

Notion

San Francisco, California, United States (On-Site)
2 Weeks ago
Postman - Senior Product Analyst

Postman

San Francisco, California, United States (Hybrid)
1 Month ago
Fox Factory - Human Resources Generalist

Fox Factory

Gainesville, Georgia, United States (On-Site)
5 Days ago
Google - Lead CPU Performance Architect, Silicon

Google

Mountain View, California, United States (On-Site)
1 Month ago
NVIDIA - Senior Computer Architect - Deep Learning

NVIDIA

Santa Clara, California, United States (On-Site)
4 Months ago
Activision - Producer, Call of Duty

Activision

Santa Monica, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Ion - AI Engineer - Graduate Development Program

Ion

Pisa, Tuscany, Italy (On-Site)
7 Months ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
1 Month ago
Universal Music - Universal Music Group 2025 Summer Internship Program: Prompt Engineer

Universal Music

Los Angeles, California, United States (On-Site)
1 Month ago
Nextbrain - Computer Vision Engineer

Nextbrain

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Google - Software Engineer III, AI/ML GenAI

Google

New York, New York, United States (On-Site)
1 Month ago
Meta - Software Engineer, Systems ML - SW/HW Co-design

Meta

Austin, Texas, United States (On-Site)
6 Months ago
zoox - Technical Program Manager - Artificial Intelligence

zoox

Foster City, California, United States (Hybrid)
7 Months ago
Match Group - Sr. Software Engineer, Generative AI

Match Group

Palo Alto, California, United States (Hybrid)
7 Months ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
1 Month ago
bytedance - Research Scientist in Foundation Model (Speech & Audio Generation) - 2025 Start (PhD)

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Taipei City, Taiwan (On-Site)

Zürich, Zurich, Switzerland (On-Site)

Kirkland, Washington, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug