Accelerator Architect and Performance Engineer, Generative AI

1 Week ago • 8 Years + • Artificial Intelligence • $183,000 PA - $271,000 PA

Job Summary

Job Description

This role involves driving forward-looking Generative AI (GenAI) Machine Learning architecture exploration for Tensor mobile SoCs. Collaboration with research, system architecture, and compiler engineering teams is crucial to optimize future workloads across the entire tech stack (hardware, software, use cases, network, and external components). Responsibilities include working with researchers and program management to define system architecture requirements for future GenAI use cases, applying advanced research to achieve breakthrough power and performance improvements on GenAI workloads, and optimizing GenAI performance by defining optimal model scheduling on TPU compute engines. The ideal candidate possesses expertise in computer architecture, performance, and compilers, with experience in GenAI model architectures (LLMs, Vision Transformers, etc.) and programming languages (C/C++, Python) and deep learning frameworks (TensorFlow/Jax/PyTorch).
Must have:
  • Bachelor's degree in relevant field
  • 8+ years experience in computer architecture, performance, or compiler
  • Generative AI model architecture experience
  • Proficiency in C/C++, Python, TensorFlow/Jax/PyTorch
  • Drive GenAI architecture exploration for Tensor mobile SoCs
  • Collaborate with research and engineering teams
  • Define system architecture requirements for GenAI
Good to have:
  • Master's or PhD in relevant field
  • Experience with domain-specific accelerators
  • Distributed/parallel programming experience
  • Hardware/software co-design for machine learning
  • Simulator development and micro-architecture experience
  • Excellent communication skills

Job Details


Minimum qualifications:

  • Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, a related field, or equivalent practical experience.
  • 8 years of work or academic research experience in computer or chip architecture, performance, or compiler.
  • Experience with Generative AI model architectures (e.g., Large Language Models, Vision Transformers, Image Diffusion Models, etc.).
  • Experience with one or more general purpose programming languages including (but not limited to) C/C++ or Python and deep learning frameworks like TensorFlow/Jax/Pytorch.

Preferred qualifications:

  • Master's degree or PhD in Electrical Engineering, Computer Engineering or Computer Science, with an emphasis on computer architecture.
  • Experience with domain-specific accelerators.
  • Experience with distributed/parallel programming.
  • Experience with hardware/software co-design for machine learning.
  • Experience with simulator development and micro-architecture.
  • Excellent communication skills.

About the job

Be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's direct-to-consumer products. You'll contribute to the innovation behind products loved by millions worldwide. Your expertise will shape the next generation of hardware experiences, delivering unparalleled performance, efficiency, and integration. Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

The US base salary range for this full-time position is $183,000-$271,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Drive forward-looking GenAI Machine Learning architecture exploration for Tensor mobile SoCs while collaborating with research teams, system architecture teams, and compiler engineers to optimize future workloads from both all perspectives across the tech stack including hardware, software, use case, network, and external components.
  • Work with researchers and Program Management teams to define system architecture requirements for future Generative AI use cases.
  • Apply advanced research in architecture and process technology to get breakthrough power and performance improvements on Generative AI workloads.
  • Optimize performance of GenAI use cases by defining an optimal model scheduling on the TPU compute engines.

Similar Jobs

Rackspace Technology - Principal MLOps Engineer

Rackspace Technology

Toronto, Ontario, Canada (Remote)
1 Month ago
IMC - Machine Learning Engineer

IMC

Amsterdam, North Holland, Netherlands (On-Site)
23 Hours ago
Moloco - Staff Machine Learning Engineer

Moloco

Seoul, South Korea (On-Site)
7 Hours ago
Arkose Labs - Senior Machine Learning Researcher

Arkose Labs

Pune, Maharashtra, India (Hybrid)
7 Months ago
Google - Data and Analytics Consultant, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
ByteDance - Researcher Graduate (Applied Machine Learning - Enterprise)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
NVIDIA - Senior Application Software Engineer, Performance

NVIDIA

Shanghai, Shanghai, China (On-Site)
4 Weeks ago
NetEase Games - Game AI Research Leader

NetEase Games

Singapore (On-Site)
1 Month ago
Google - Senior Imaging and On-Device Machine Learning Software Engineer, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Weeks ago
ByteDance - Research Scientist, Multimodal Interaction & World Model

ByteDance

Singapore (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Balbix - AI/ML Architect

Balbix

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Google - Technical Solutions Engineer, Data, Google Cloud

Google

Seoul, South Korea (On-Site)
2 Days ago
Nintendo - Intern – Machine Learning Software Engineer (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
5 Months ago
Ubisoft - Research Student - Ubisoft La Forge

Ubisoft

Shanghai, Shanghai, China (On-Site)
5 Months ago
Krafton  - Deep Learning Engineer - Model Optimization

Krafton

Seoul, South Korea (On-Site)
2 Weeks ago
Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

Menlo Park, California, United States (On-Site)
5 Months ago
Resemble AI - Deep Learning Speech Researcher

Resemble AI

Mountain View, California, United States (On-Site)
8 Months ago
Moloco - Staff Machine Learning Engineer

Moloco

Seoul, South Korea (On-Site)
7 Hours ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Pittsburgh, Pennsylvania, United States (On-Site)
5 Months ago
Outbrain - Data Science Summer School

Outbrain

Paris, Île-de-France, France (On-Site)
23 Hours ago

Get notifed when new similar jobs are uploaded

Jobs in San Diego, California, United States

Google - Business Operations and Planning Lead, Trust and Safety

Google

Washington, District Of Columbia, United States (On-Site)
1 Week ago
PlayStation Global - Director, People Technology Services

PlayStation Global

Aliso Viejo, California, United States (On-Site)
1 Week ago
PlayStation Global - Studio IT Manager

PlayStation Global

Los Angeles, California, United States (On-Site)
4 Months ago
1000heads - Community Manager

1000heads

New York, New York, United States (Hybrid)
1 Week ago
Blizzard Entertainment - Senior Technical Artist, Performance - Unannounced Game

Blizzard Entertainment

Irvine, California, United States (Hybrid)
2 Months ago
Google - Account Strategist, Engage, Google Customer Solutions

Google

Ann Arbor, Michigan, United States (On-Site)
2 Weeks ago
Netflix - Software Engineer (L5) - Security Platforms Engineering

Netflix

United States (Remote)
2 Weeks ago
ByteDance - Research Scientist, Multimodality

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Google - Software Engineer III, Google Cloud Platforms

Google

Sunnyvale, California, United States (On-Site)
5 Months ago
Epic Games - Audio Designer

Epic Games

Cary, North Carolina, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Alpha Sense - Lead AI Platform Engineer

Alpha Sense

New York, New York, United States (On-Site)
5 Months ago
Soul AI - Subject Matter Expert (AI Trainer)

Soul AI

Hyderabad, Telangana, India (On-Site)
7 Months ago
Airlab Inc  - C++ & Python Programmer

Airlab Inc

Montreal, Quebec, Canada (On-Site)
9 Months ago
N-iX - Senior AI/GenAI Solution Engineer

N-iX

(Remote)
2 Weeks ago
NVIDIA - Solutions Architect, Financial Services

NVIDIA

New Jersey, United States (Remote)
2 Weeks ago
NVIDIA - Senior Deep Learning Research Engineer, Advanced AI Systems

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Google - Software Engineer III, AI/ML, Core

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Google - Software Engineer III, Generative AI, Google Workspace

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Google - Senior Technical Program Manager, AI Risk Reporting Lead

Google

Seattle, Washington, United States (On-Site)
2 Days ago
Meta - Research Engineer - Conversational AI - Reality Labs

Meta

Menlo Park, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug