Accelerator Architect and Performance Engineer, Generative AI

2 Months ago • 8 Years + • $183,000 PA - $271,000 PA

Job Summary

Job Description

This role involves driving forward-looking Generative AI (GenAI) Machine Learning architecture exploration for Tensor mobile SoCs. Collaboration with research, system architecture, and compiler engineering teams is crucial to optimize future workloads across the entire tech stack (hardware, software, use cases, network, and external components). Responsibilities include working with researchers and program management to define system architecture requirements for future GenAI use cases, applying advanced research to achieve breakthrough power and performance improvements on GenAI workloads, and optimizing GenAI performance by defining optimal model scheduling on TPU compute engines. The ideal candidate possesses expertise in computer architecture, performance, and compilers, with experience in GenAI model architectures (LLMs, Vision Transformers, etc.) and programming languages (C/C++, Python) and deep learning frameworks (TensorFlow/Jax/PyTorch).
Must have:
  • Bachelor's degree in relevant field
  • 8+ years experience in computer architecture, performance, or compiler
  • Generative AI model architecture experience
  • Proficiency in C/C++, Python, TensorFlow/Jax/PyTorch
  • Drive GenAI architecture exploration for Tensor mobile SoCs
  • Collaborate with research and engineering teams
  • Define system architecture requirements for GenAI
Good to have:
  • Master's or PhD in relevant field
  • Experience with domain-specific accelerators
  • Distributed/parallel programming experience
  • Hardware/software co-design for machine learning
  • Simulator development and micro-architecture experience
  • Excellent communication skills

Job Details


Minimum qualifications:

  • Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, a related field, or equivalent practical experience.
  • 8 years of work or academic research experience in computer or chip architecture, performance, or compiler.
  • Experience with Generative AI model architectures (e.g., Large Language Models, Vision Transformers, Image Diffusion Models, etc.).
  • Experience with one or more general purpose programming languages including (but not limited to) C/C++ or Python and deep learning frameworks like TensorFlow/Jax/Pytorch.

Preferred qualifications:

  • Master's degree or PhD in Electrical Engineering, Computer Engineering or Computer Science, with an emphasis on computer architecture.
  • Experience with domain-specific accelerators.
  • Experience with distributed/parallel programming.
  • Experience with hardware/software co-design for machine learning.
  • Experience with simulator development and micro-architecture.
  • Excellent communication skills.

About the job

Be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's direct-to-consumer products. You'll contribute to the innovation behind products loved by millions worldwide. Your expertise will shape the next generation of hardware experiences, delivering unparalleled performance, efficiency, and integration. Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

The US base salary range for this full-time position is $183,000-$271,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Drive forward-looking GenAI Machine Learning architecture exploration for Tensor mobile SoCs while collaborating with research teams, system architecture teams, and compiler engineers to optimize future workloads from both all perspectives across the tech stack including hardware, software, use case, network, and external components.
  • Work with researchers and Program Management teams to define system architecture requirements for future Generative AI use cases.
  • Apply advanced research in architecture and process technology to get breakthrough power and performance improvements on Generative AI workloads.
  • Optimize performance of GenAI use cases by defining an optimal model scheduling on the TPU compute engines.

Similar Jobs

bytedance - Research Scientist in ML Systems

bytedance

San Jose, California, United States (On-Site)
8 Months ago
Riot Games - Senior Data Scientist - Singapore Efficiency Team

Riot Games

Singapore (On-Site)
5 Months ago
bytedance - Research Scientist, Multimodal Foundation Model

bytedance

Singapore (On-Site)
8 Months ago
PlayStation Global - Senior Machine Learning Graphics Engineer

PlayStation Global

London, England, United Kingdom (Hybrid)
3 Months ago
Qualcomm - Senior ML Compiler Engineer

Qualcomm

Hyderabad, Telangana, India (On-Site)
1 Month ago
Google - Staff Software Engineer, Applied AI

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
2 Months ago
Zazz - Artificial Intelligence Engineer

Zazz

(Remote)
4 Months ago
Tencent - Game AI Product Management Intern

Tencent

Auckland, Auckland, New Zealand (On-Site)
3 Months ago
bytedance - Research Scientist/Engineer - Multimodal Interaction & World Model

bytedance

Singapore (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

AI Dash - Staff AI QA Engineer

AI Dash

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Netflix - Software Engineer L4, Machine Learning Platform (Metaflow)

Netflix

Los Gatos, California, United States (On-Site)
4 Months ago
Google - Software Engineer III, Generative AI

Google

Sunnyvale, California, United States (On-Site)
2 Months ago
Rackspace Technology - Data Scientist

Rackspace Technology

Alexandria, Alexandria Governorate, Egypt (Remote)
5 Months ago
Google - Senior ML Systems Engineer, AICore

Google

Taipei City, Taiwan (On-Site)
2 Months ago
Capgemini - Machine Learning Developer

Capgemini

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Reality Games - Machine Learning Engineer - Monopoly World

Reality Games

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
4 Months ago
truecaller - ML Engineer

truecaller

Bengaluru, Karnataka, India (On-Site)
1 Month ago
bytedance - Software Engineer Intern

bytedance

San Jose, California, United States (On-Site)
1 Month ago
Qualcomm - Senior ML Compiler Engineer

Qualcomm

Hyderabad, Telangana, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Diego, California, United States

Mercury - Strategic Operations Lead

Mercury

San Francisco, California, United States (On-Site)
1 Month ago
Granicus - Manager, Product Management

Granicus

United States (Remote)
1 Month ago
The Walt Disney Company - Lead Software Engineer - Full-Stack

The Walt Disney Company

Santa Monica, California, United States (On-Site)
3 Months ago
Experian - Senior Insurance Sales Agent

Experian

United States (Remote)
1 Month ago
Nintendo - Email Marketing Coordinator

Nintendo

Redmond, Washington, United States (Hybrid)
8 Months ago
hogarth - Executive Assistant

hogarth

New York, United States (Hybrid)
1 Month ago
Riot Games - Principal UX Designer

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
Mindtickle - Director, Customer Success

Mindtickle

United States (Remote)
1 Month ago
bytedance - Experienced Technical Lead - Edge Cloud Infrastructure - San Jose / Seattle / Boston

bytedance

Boston, Massachusetts, United States (On-Site)
8 Months ago
Epic Games - Automation Engineer

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Google - Software Engineer III, Generative AI

Google

Sunnyvale, California, United States (On-Site)
2 Months ago
bytedance - Researcher - Large Language Models, Applied Machine Learning

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago
bytedance - Research Scientist Graduate (Foundation Model - Vision and Language)

bytedance

Seattle, Washington, United States (On-Site)
5 Months ago
bytedance - Student Researcher Intern (Edge Research Project for General Intelligence)

bytedance

San Jose, California, United States (On-Site)
2 Months ago
Hedra - Research Engineer

Hedra

San Francisco, California, United States (On-Site)
3 Months ago
Hedra - Machine Learning Engineer (CUDA)

Hedra

New York, New York, United States (On-Site)
3 Months ago
bytedance - Student Researcher (Doubao (Seed) - Foundation Model - Video Generative Model)

bytedance

San Jose, California, United States (On-Site)
3 Months ago
NVIDIA - AI Computing Software Development Engineer, TensorRT

NVIDIA

Taipei City, Taiwan (On-Site)
5 Months ago
Penn Interactive - Engineering Manager, ML Platform

Penn Interactive

Philadelphia, Pennsylvania, United States (Hybrid)
4 Months ago
The Walt Disney Company - Lead Software Engineer - Applied AI & Machine Learning

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Atlanta, Georgia, United States (On-Site)

London, England, United Kingdom (On-Site)

Taipei City, Taiwan (On-Site)

Kirkland, Washington, United States (On-Site)

Sunnyvale, California, United States (On-Site)

Sunnyvale, California, United States (On-Site)

Sunnyvale, California, United States (On-Site)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug