Senior AI/ML Optimizing Engineer, Silicon

4 Days ago • 5-8 Years • Artificial Intelligence

Job Summary

Job Description

This Senior AI/ML Optimizing Engineer role at Google focuses on optimizing ML models for edge computing, ensuring compatibility and performance through techniques like PTQ and QAT. Responsibilities include developing toolchains for GenAI model optimization, collaborating with hardware accelerator teams (TPU/GPU) to verify inference quality, and assisting the AI/ML algorithm team in integrating models and aligning them with hardware capabilities. The ideal candidate possesses a strong background in software development (C++, Python), AI/ML algorithms (LLMs, deep learning, NLP), and experience with ML frameworks (JAX, TensorFlow, PyTorch). Optimization experience and familiarity with compiler optimization are highly valued.
Must have:
  • Bachelor's degree in relevant field
  • 5+ years software development experience
  • 3+ years AI/ML experience (LLMs, deep learning, NLP)
  • C++, Python programming proficiency
  • Model optimization for edge computing (PTQ, QAT)
  • Collaboration with hardware teams
Good to have:
  • Master's/Ph.D. in Machine Learning
  • Experience with ML algorithms (diffusion models)
  • Experience with JAX, TensorFlow, or PyTorch
  • Experience deploying ML models on devices
  • Experience optimizing compilers

Job Details


Minimum qualifications:

  • Bachelor's degree in Electrical Engineering, Computer Science, Image Processing, or equivalent practical experience.
  • 5 years of experience in software development.
  • 3 years of experience with AI/ML algorithms and tools, LLMs, deep learning, or natural language processing.
  • Experience in programming with C++, Python and algorithms.

Preferred qualifications:

  • Master's or Ph.D. with an emphasis on the Machine Learning domain.
  • Experience writing Machine Learning (ML) algorithms (e.g. an understanding of diffusion model, NLP, image and goals).
  • Experience in modern ML frameworks, e.g. JAX, Tensorflow or Pytorch.
  • Experience in deploying ML models on a device.
  • Experience optimizing compilers.

About the job

Our computational challenges are so big, complex and unique we can't just purchase off-the-shelf hardware, we've got to make it ourselves. Your team designs and builds the hardware, software and networking technologies that power all of Google's services. As a Hardware Engineer, you design and build the systems that are the heart of the world's largest and most powerful computing infrastructure. You develop from the lowest levels of circuit design to large system design and see those systems all the way through to high volume manufacturing. Your work has the potential to shape the machinery that goes into our cutting-edge data centers affecting millions of Google users.

Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

Responsibilities

  • Optimize ML model for edge computing to ensure compatibility and performance, including post-training quantization (PTQ) and quantization-aware training (QAT).
  • Develop tool chains to drive the Generative Artificial Intelligence (GenAI) model optimization.
  • Collaborate with the hardware accelerator teams for example TPU or GPU to verify the inference quality.
  • Assist the AI/ML algorithm team in integrating models into computing and ensure alignment with hardware capabilities.

Similar Jobs

Riot Games - Staff Research Scientist - Tech Research

Riot Games

Los Angeles, California, United States (On-Site)
4 Weeks ago
Zazz - Artificial Intelligence Engineer

Zazz

(Remote)
2 Months ago
NVIDIA - Deep Learning Software Engineering Intern, Test Development

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Weeks ago
Google - Customer Engineer, AI Infrastructure

Google

Seattle, Washington, United States (On-Site)
5 Days ago
Altagram Group - Data Science Internship/Workstudent

Altagram Group

Germany (On-Site)
1 Month ago
The Walt Disney Company - Lead Machine Learning Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
4 Weeks ago
NVIDIA - Applied Physics ML Research Intern - Fall 2025

NVIDIA

Santa Clara, California, United States (On-Site)
2 Days ago
Google - Software Engineer III, AI/ML, Cloud AI

Google

Sunnyvale, California, United States (On-Site)
4 Days ago
Google - Software Engineer III, Education AI Platform

Google

Mexico City, Mexico City, Mexico (On-Site)
4 Days ago
Zoox - Senior/Staff Software Engineer - Operational Tools

Zoox

Foster City, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Canva - Senior Machine Learning Engineer - Specialist Platform and Experience

Canva

Melbourne, Victoria, Australia (Remote)
3 Weeks ago
NVIDIA - Senior Software Engineer - Automated Parallel Programming

NVIDIA

North Carolina, United States (Remote)
1 Month ago
Lucid Reality Labs - Machine Learning Engineer

Lucid Reality Labs

Poland (Remote)
2 Months ago
Tencent - Research Intern (NLP)

Tencent

Palo Alto, California, United States (On-Site)
2 Months ago
Meta - Research Scientist, Computer Vision for Generative AI (PhD)

Meta

New York, New York, United States (On-Site)
5 Months ago
Google - Field Solutions Architect, Generative AI, Google Cloud

Google

Stockholm, Stockholm County, Sweden (On-Site)
4 Days ago
Hedra - Applied Research Scientist

Hedra

New York, New York, United States (On-Site)
3 Weeks ago
ByteDance - Senior Machine Learning Engineer

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Google - Senior Research Engineer, AI/ML

Google

London, England, United Kingdom (On-Site)
1 Day ago
Microsoft - Senior and Principal Applied Scientists (Multiple Positions)

Microsoft

Redmond, Washington, United States (On-Site)
1 Day ago

Get notifed when new similar jobs are uploaded

Jobs in New Taipei, New Taipei City, Taiwan

Google - Global Commodity Manager, Power, Google Cloud

Google

Taipei City, Taiwan (On-Site)
4 Days ago
Garena - Garena - Database Administrator

Garena

Taipei City, Taiwan (On-Site)
1 Week ago
Corsair - Firmware Software Engineer

Corsair

Taiwan (On-Site)
4 Weeks ago
Corsair - Manager, Pricing & Analytics

Corsair

Taiwan (On-Site)
3 Weeks ago
NVIDIA - Senior Mixed Signal Design Verification Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
1 Week ago
Google - ASIC Power Architect, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
4 Days ago
Google - Cloud Technical Solutions Engineer, Platform

Google

Taipei City, Taiwan (On-Site)
4 Days ago
Google - Field Sales Representative, Google Cloud

Google

Taipei City, Taiwan (On-Site)
1 Day ago
Rivos - SOC Physical Design Verification Engineer - Full Time

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
6 Months ago
Garena - Data Engineer (Warehouse)

Garena

Taipei City, Taiwan (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

NVIDIA - Principal Engineer - DL and AI Software

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Google - Product Strategy and Operations Principal, Machine Learning

Google

Sunnyvale, California, United States (On-Site)
4 Days ago
Google - Cloud AI Engineer, Global Services Delivery

Google

Mexico City, Mexico City, Mexico (On-Site)
4 Days ago
Dolby Laboratories - Senior Computer Vision Researcher

Dolby Laboratories

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
3 Weeks ago
Google - Technical Program Manager, Cross Cutting AI/ML

Google

Mountain View, California, United States (On-Site)
4 Days ago
Zoox - Senior Software Engineer - Perception

Zoox

Foster City, California, United States (Hybrid)
6 Months ago
Pika - Research Engineer (Applied Research)

Pika

Palo Alto, California, United States (On-Site)
3 Weeks ago
Keywords Studios - AI Prompt & Language Specialist (Italian)

Keywords Studios

Quebec, Canada (Remote)
3 Weeks ago
Inworld AI - Staff / Principal Machine Learning Engineer - USA

Inworld AI

Mountain View, California, United States (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Fremont, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Atlanta, Georgia, United States (On-Site)

San Francisco, California, United States (On-Site)

Fremont, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug