Senior AI/ML Optimizing Engineer, Silicon

7 Hours ago • 5-8 Years • Artificial Intelligence

Job Summary

Job Description

This Senior AI/ML Optimizing Engineer role at Google focuses on optimizing ML models for edge computing, ensuring compatibility and performance through techniques like PTQ and QAT. Responsibilities include developing toolchains for GenAI model optimization, collaborating with hardware accelerator teams (TPU/GPU) to verify inference quality, and assisting the AI/ML algorithm team in integrating models and aligning them with hardware capabilities. The ideal candidate possesses a strong background in software development (C++, Python), AI/ML algorithms (LLMs, deep learning, NLP), and experience with ML frameworks (JAX, TensorFlow, PyTorch). Optimization experience and familiarity with compiler optimization are highly valued.
Must have:
  • Bachelor's degree in relevant field
  • 5+ years software development experience
  • 3+ years AI/ML experience (LLMs, deep learning, NLP)
  • C++, Python programming proficiency
  • Model optimization for edge computing (PTQ, QAT)
  • Collaboration with hardware teams
Good to have:
  • Master's/Ph.D. in Machine Learning
  • Experience with ML algorithms (diffusion models)
  • Experience with JAX, TensorFlow, or PyTorch
  • Experience deploying ML models on devices
  • Experience optimizing compilers

Job Details


Minimum qualifications:

  • Bachelor's degree in Electrical Engineering, Computer Science, Image Processing, or equivalent practical experience.
  • 5 years of experience in software development.
  • 3 years of experience with AI/ML algorithms and tools, LLMs, deep learning, or natural language processing.
  • Experience in programming with C++, Python and algorithms.

Preferred qualifications:

  • Master's or Ph.D. with an emphasis on the Machine Learning domain.
  • Experience writing Machine Learning (ML) algorithms (e.g. an understanding of diffusion model, NLP, image and goals).
  • Experience in modern ML frameworks, e.g. JAX, Tensorflow or Pytorch.
  • Experience in deploying ML models on a device.
  • Experience optimizing compilers.

About the job

Our computational challenges are so big, complex and unique we can't just purchase off-the-shelf hardware, we've got to make it ourselves. Your team designs and builds the hardware, software and networking technologies that power all of Google's services. As a Hardware Engineer, you design and build the systems that are the heart of the world's largest and most powerful computing infrastructure. You develop from the lowest levels of circuit design to large system design and see those systems all the way through to high volume manufacturing. Your work has the potential to shape the machinery that goes into our cutting-edge data centers affecting millions of Google users.

Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

Responsibilities

  • Optimize ML model for edge computing to ensure compatibility and performance, including post-training quantization (PTQ) and quantization-aware training (QAT).
  • Develop tool chains to drive the Generative Artificial Intelligence (GenAI) model optimization.
  • Collaborate with the hardware accelerator teams for example TPU or GPU to verify the inference quality.
  • Assist the AI/ML algorithm team in integrating models into computing and ensure alignment with hardware capabilities.

Similar Jobs

Google - Staff Software Engineer, Machine Learning Runtime Engines

Google

Sunnyvale, California, United States (On-Site)
11 Hours ago
Zazz - Machine Learning Engineer

Zazz

(Remote)
2 Months ago
Vigaet - Machine Learning Engineer-Internship

Vigaet

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Rackspace Technology - Senior Machine Learning Engineer

Rackspace Technology

Vietnam (Remote)
3 Weeks ago
King - AI/ML Engineer

King

Stockholm, Stockholm County, Sweden (On-Site)
12 Hours ago
Stonewall Collision & Auto Painting - Senior Data Scientist

Stonewall Collision & Auto Painting

Vijayawada, Andhra Pradesh, India (On-Site)
7 Months ago
Google - Engineering Manager II

Google

Sunnyvale, California, United States (On-Site)
11 Hours ago
Google - Senior Staff Software Engineer, GPU Performance, Google Scale

Google

Sunnyvale, California, United States (On-Site)
8 Hours ago
NVIDIA - Senior Solutions Architect, Retail

NVIDIA

Arkansas, United States (Remote)
1 Day ago
Sony Interactive Entertainment - Learning & Development Specialist (AI Talent Development & Training Program Lead)

Sony Interactive Entertainment

Tokyo, Japan (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Software Engineer, Model Inference

ByteDance

Seattle, Washington, United States (On-Site)
3 Weeks ago
NVIDIA - LLM Application Intern, AV Infrastructure - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Months ago
Avathon - Data Scientist

Avathon

Bengaluru, Karnataka, India (On-Site)
6 Months ago
CloudHire - Software Engineer, Backend

CloudHire

India (Remote)
4 Weeks ago
Dolby Laboratories - Senior Foundational AI Researcher

Dolby Laboratories

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Trendyol - Data Science Professionals (Dolap)

Trendyol

İstanbul, İstanbul, Türkiye (Hybrid)
4 Months ago
NVIDIA - Software Engineering Intern, AI Engineering - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Months ago
ByteDance - Engineering Manager - Applied Machine Learning Algorithm

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
NVIDIA - Deep Learning Software Engineering Intern, Test Development

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Weeks ago
ByteDance - Research Scientist, Multimodal Foundation Model

ByteDance

Singapore (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New Taipei, New Taipei City, Taiwan

Google - Software Engineer, Android Camera and Media

Google

New Taipei, New Taipei City, Taiwan (On-Site)
8 Hours ago
NVIDIA - Senior Generalist Software Engineer -- Omniverse

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
Google - Software Engineer, Engineering Productivity, Google Cast

Google

Taipei City, Taiwan (On-Site)
9 Hours ago
Google - Software Engineer II, ChromeOS

Google

Taipei City, Taiwan (On-Site)
8 Hours ago
Google - Software Engineer III, Pixel Connectivity

Google

New Taipei, New Taipei City, Taiwan (On-Site)
7 Hours ago
Google - AICore Software Engineer

Google

Taipei City, Taiwan (On-Site)
8 Hours ago
Google - Test Engineer, Pixel Software

Google

New Taipei, New Taipei City, Taiwan (On-Site)
9 Hours ago
Google - Lead Software Engineer, Quick Share, Android

Google

New Taipei City, Taiwan (On-Site)
10 Hours ago
NVIDIA - Silicon Validation Engineer (RDSS Intern)

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
Google - Senior Software Engineer, Embedded Systems/Firmware, Google TV

Google

Taipei City, Taiwan (On-Site)
9 Hours ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Meta - AI Research Scientist, Language - Generative AI

Meta

Menlo Park, California, United States (On-Site)
5 Months ago
GT - AI/ML Engineer

GT

(Remote)
2 Weeks ago
Google - Physical Verification and Convergence Engineer

Google

Sunnyvale, California, United States (On-Site)
10 Hours ago
Google - Software Engineer III, AI/ML Recommendations, Rankings, Predictions, Core

Google

Mountain View, California, United States (On-Site)
8 Hours ago
NVIDIA - Senior System Networking Engineer, InfiniBand

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
PwC - Senior AI Developer - Roma [DIG]

PwC

Rome, Lazio, Italy (On-Site)
6 Months ago
NVIDIA - Engineering Manager, AI Developer Technology

NVIDIA

Austin, Texas, United States (On-Site)
1 Month ago
ByteDance - Solutions Architect

ByteDance

Gurugram, Haryana, India (On-Site)
3 Weeks ago
Google - Staff Software Engineer, Google Compute Engine, Telemetry Insights

Google

Seattle, Washington, United States (On-Site)
9 Hours ago
Krafton  - Applied Research Scientist/Engineer - LLM Game Agent

Krafton

Seoul, South Korea (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Bucharest, Bucharest, Romania (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Bengaluru, Karnataka, India (On-Site)

Sunnyvale, California, United States (On-Site)

Sunnyvale, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug