Senior AI/ML Optimizing Engineer, Silicon

1 Month ago • 5-8 Years • Artificial Intelligence

Job Summary

Job Description

This Senior AI/ML Optimizing Engineer role at Google focuses on optimizing ML models for edge computing, ensuring compatibility and performance through techniques like PTQ and QAT. Responsibilities include developing toolchains for GenAI model optimization, collaborating with hardware accelerator teams (TPU/GPU) to verify inference quality, and assisting the AI/ML algorithm team in integrating models and aligning them with hardware capabilities. The ideal candidate possesses a strong background in software development (C++, Python), AI/ML algorithms (LLMs, deep learning, NLP), and experience with ML frameworks (JAX, TensorFlow, PyTorch). Optimization experience and familiarity with compiler optimization are highly valued.
Must have:
  • Bachelor's degree in relevant field
  • 5+ years software development experience
  • 3+ years AI/ML experience (LLMs, deep learning, NLP)
  • C++, Python programming proficiency
  • Model optimization for edge computing (PTQ, QAT)
  • Collaboration with hardware teams
Good to have:
  • Master's/Ph.D. in Machine Learning
  • Experience with ML algorithms (diffusion models)
  • Experience with JAX, TensorFlow, or PyTorch
  • Experience deploying ML models on devices
  • Experience optimizing compilers

Job Details


Minimum qualifications:

  • Bachelor's degree in Electrical Engineering, Computer Science, Image Processing, or equivalent practical experience.
  • 5 years of experience in software development.
  • 3 years of experience with AI/ML algorithms and tools, LLMs, deep learning, or natural language processing.
  • Experience in programming with C++, Python and algorithms.

Preferred qualifications:

  • Master's or Ph.D. with an emphasis on the Machine Learning domain.
  • Experience writing Machine Learning (ML) algorithms (e.g. an understanding of diffusion model, NLP, image and goals).
  • Experience in modern ML frameworks, e.g. JAX, Tensorflow or Pytorch.
  • Experience in deploying ML models on a device.
  • Experience optimizing compilers.

About the job

Our computational challenges are so big, complex and unique we can't just purchase off-the-shelf hardware, we've got to make it ourselves. Your team designs and builds the hardware, software and networking technologies that power all of Google's services. As a Hardware Engineer, you design and build the systems that are the heart of the world's largest and most powerful computing infrastructure. You develop from the lowest levels of circuit design to large system design and see those systems all the way through to high volume manufacturing. Your work has the potential to shape the machinery that goes into our cutting-edge data centers affecting millions of Google users.

Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

Responsibilities

  • Optimize ML model for edge computing to ensure compatibility and performance, including post-training quantization (PTQ) and quantization-aware training (QAT).
  • Develop tool chains to drive the Generative Artificial Intelligence (GenAI) model optimization.
  • Collaborate with the hardware accelerator teams for example TPU or GPU to verify the inference quality.
  • Assist the AI/ML algorithm team in integrating models into computing and ensure alignment with hardware capabilities.

Similar Jobs

Vigaet - Machine Learning Engineer-Internship

Vigaet

Bengaluru, Karnataka, India (On-Site)
1 Year ago
ByteDance - Applied Scientist Intern (Computational Modeling & Optimization)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
WebFX - Entry Level Software Engineer

WebFX

Harrisburg, Pennsylvania, United States (On-Site)
7 Months ago
PwC - IN-Senior Associate_ML Engineer_Data &Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Google - EDA/CAD Custom Tool Development Engineer

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
SiftHub - Senior NLP Engineer

SiftHub

Maharashtra, India (On-Site)
8 Months ago
GT - AI/ML Engineer

GT

(Remote)
1 Month ago
Genies - Machine Learning Infrastructure Engineer, 3D Model Inference & Deployment

Genies

San Mateo, California, United States (On-Site)
1 Month ago
Keywords Studios - Research Associate - AI

Keywords Studios

(Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Samsung Semiconductor - Senior Engineer, AI

Samsung Semiconductor

San Jose, California, United States (Hybrid)
7 Months ago
ByteDance - Machine Learning Engineer - Inference

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
Rackspace Technology - Machine Learning Architect (AWS)

Rackspace Technology

(Remote)
1 Month ago
ByteDance - Software Engineer in Machine Learning Systems

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
ByteDance - Video Analysis and Quality Algorithm Engineer

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
NVIDIA - Software Engineering Intern, Deep Learning Accelerator - Fall 2025

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
ByteDance - Tech Lead Machine Learning Engineer

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
Scale AI - Machine Learning Engineer, International Public Sector

Scale AI

United Kingdom (On-Site)
7 Months ago
ByteDance - Engineering Manager Machine Learning Infrastructure

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
NVIDIA - Senior Software Engineer, Deep Learning Inference, TensorRT

NVIDIA

Santa Clara, California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New Taipei, New Taipei City, Taiwan

NVIDIA - Software Program Manager

NVIDIA

Taipei City, Taiwan (On-Site)
4 Months ago
Google - Field Sales Representative, Google Cloud

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Corsair - Delivery Execution Specialist

Corsair

Taoyuan City, Taiwan (On-Site)
1 Month ago
NVIDIA - Vice President, Sales - Taiwan

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
Google - Silicon Engineering Lead

Google

Taipei City, Taiwan (On-Site)
1 Month ago
NVIDIA - Signal and Power Integrity Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
Google - Software Engineering Manager II, Pixel Performance

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
Google - Senior Bluetooth Firmware Engineer

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
NVIDIA - Tegra Software Engineer (RDSS Intern)

NVIDIA

Taipei City, Taiwan (On-Site)
4 Months ago
Quizizz - Customer Success Manager, Taiwan

Quizizz

Taiwan (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Speech & Audio) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Google - Staff Cloud Solutions Architect, Rapid Innovation

Google

Reston, Virginia, United States (On-Site)
1 Month ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Redmond, Washington, United States (On-Site)
6 Months ago
Rackspace Technology - AI/ML Architect

Rackspace Technology

Vietnam (Remote)
1 Month ago
Google - PhD Software Engineer

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
NVIDIA - Principal Engineer

NVIDIA

(Remote)
2 Months ago
Google - Group Product Manager, Machine Learning Frameworks Applied Ecosystem

Google

Kirkland, Washington, United States (On-Site)
1 Month ago
Zoox - Machine Learning Engineer - Collision Avoidance System

Zoox

Foster City, California, United States (Hybrid)
7 Months ago
Google - Senior Software Engineer, Android ML Services

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

London, England, United Kingdom (On-Site)

Fremont, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Reston, Virginia, United States (On-Site)

Sunnyvale, California, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Reston, Virginia, United States (On-Site)

Hyderabad, Telangana, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug