Technical Program Manager III, Machine Learning Infrastructure, Cloud AI Systems

1 Month ago • 5-5 Years • Artificial Intelligence • $156,000 PA - $229,000 PA

Job Summary

Job Description

This Technical Program Manager III role focuses on Machine Learning Infrastructure within Google's Cloud AI Systems. You'll lead complex projects related to Gemini Serving, a critical infrastructure for various GenAI products (Workspace, Duet AI, Vertex AI, etc.). Responsibilities include enabling production of Gemini and Agentic AI innovations, partnering with Google DeepMind, collaborating on Responsible AI, and prioritizing large-scale adoption. You'll scope and define engineering work across multiple product areas, working with internal teams to ensure the success of Gemini Serving as the canonical serving entry point for GenAI workflows. The role requires strong technical expertise, excellent communication, and a data-driven approach to problem-solving.
Must have:
  • 5+ years program management experience
  • Experience leading machine learning programs
  • Experience building distributed systems
  • Excellent communication skills
Good to have:
  • 5+ years managing cross-functional projects
  • Experience launching products to production
  • Machine Learning lifecycle management expertise
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor's degree in a relevant field, or equivalent practical experience.
  • 5 years of experience in program management.
  • Experience in leading machine learning programs.
  • Experience in building, automating and developing distributed systems.

Preferred qualifications:

  • 5 years of experience managing cross-functional or cross-team projects.
  • Experience in launching products into production.
  • Experience in Machine Learning life-cycle management.
  • Excellent communication skills, with a data driven problem solving approach towards challenges.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Technical Program Manager at Google, you’ll use your technical expertise to lead complex, multi-disciplinary projects from start to finish. You’ll work with stakeholders to plan requirements, identify risks, manage project schedules, and communicate clearly with cross-functional partners across the company. You're equally comfortable explaining your team's analyses and recommendations to executives as you are discussing the technical tradeoffs in product development with engineers.

Gemini Serving is on the central and critical path for several GenAI application products that are underway. Gemini Serving supports in the production of following - Workspace, Duet AI, Vertex AI, APIs, Google Labs, AI Studio, YouTube, Shopping, and others.

Gemini Serving's innovation is to become the canonical serving entry-point and backend for GenAI serving workflows across the company.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $156,000-$229,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Enable the production of the latest Gemini and Agentic AI Innovations.
  • Partner with Google Deep mind to understand the latest innovations and implications in Google Serving.
  • Collaborate with internal Google teams to evaluate Responsible Artificial Intelligence, Serving, Recitation and other needs to enable them to onboard Gemini Serving infrastructure.
  • Understand technical challenges from our users and work with the teams to prioritize and enable large scale adoption.
  • Scope and define all work streams and engineering work, including long term initiatives across multiple product areas.

Similar Jobs

Sabre India - Principal Account Manager, Airline Travel Solutions

Sabre India

Tokyo, Tokyo, Japan (On-Site)
1 Month ago
Netflix - Coordinator, Talent Experiences & Gifting - APAC (ex-India)

Netflix

Seoul, South Korea (On-Site)
3 Months ago
ByteDance - Software Developer Graduate (Routing Verification & Emulation)

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
MyFitnessPal - Software Engineer III, Android - Partnerships

MyFitnessPal

(Remote)
1 Month ago
Team Liquid - Senior Creative Director, Liquid Media, EU

Team Liquid

Utrecht, Utrecht, Netherlands (Hybrid)
2 Months ago
Google - Group Product Manager, Generative AI, Google Cloud AI

Google

Kirkland, Washington, United States (On-Site)
1 Month ago
Google - Customer Engineer III, Applied AI, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
NVIDIA - Continuous Bring Up Solution Architect

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Keywords Studios - Research Associate - AI

Keywords Studios

(Remote)
2 Months ago
Zoox - Senior/ Staff Software Engineer - Simulation Workload Orchestration

Zoox

Foster City, California, United States (Hybrid)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Eventbrite - Market Research Director

Eventbrite

(Remote)
1 Month ago
CRED - VKYC ops

CRED

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Milk Visual Effects - Executive Assistant / Studio Manager

Milk Visual Effects

(On-Site)
5 Months ago
MyGames - Lead Game Designer

MyGames

(Remote)
2 Months ago
isg - German/French - Consulting - Consultant / Senior Consultant / Consulting Manager

isg

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
lifechruh - Partnerships Manager

lifechruh

Edmond, Oklahoma, United States (On-Site)
2 Months ago
Whalar - Associate Director, Client Service

Whalar

London, England, United Kingdom (Hybrid)
1 Month ago
Ramboll3 - Principal Engineer, Roads

Ramboll3

Gurugram, Haryana, India (On-Site)
3 Months ago
Pentair - Engineering Technician III

Pentair

Sanford, North Carolina, United States (On-Site)
1 Month ago
ByteDance - Global Emergency Response Team Specialist - Japan

ByteDance

Tokyo, Japan (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

The Orchard - Coordinator, Content Integrity (Content Review)

The Orchard

New York, New York, United States (On-Site)
1 Month ago
Scale AI - Field Manager

Scale AI

San Francisco, California, United States (On-Site)
1 Month ago
Google - Senior Account Strategist, Mid-Market Sales

Google

New York, New York, United States (On-Site)
1 Month ago
The Walt Disney Company - Lead Software Engineer - Applied AI

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Month ago
Microsoft - Member of Technical Staff - Full Stack Software Engineer

Microsoft

Redmond, Washington, United States (Hybrid)
1 Month ago
Rivos - Silicon Logic Formal Verification - Full Time

Rivos

Santa Clara, California, United States (Hybrid)
7 Months ago
Moloco - People Analytics Manager

Moloco

Redwood City, California, United States (On-Site)
1 Month ago
Christ Fellowship - CFStudents Coordinator (Development)

Christ Fellowship

Palm Beach Gardens, Florida, United States (On-Site)
1 Month ago
Team Liquid - Freelance Marketing Manager

Team Liquid

Los Angeles, California, United States (Remote)
8 Months ago
Scale AI - Strategic Finance Manager, Engineering/G&A

Scale AI

San Francisco, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Google - Software Engineer III, XBorg, Google Cloud

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Meta - Research Scientist Intern, Language and Multimodal Research for MetaAI (PhD)

Meta

New York, New York, United States (On-Site)
6 Months ago
Google - AI/ML Engineer, National Security, Public Sector

Google

Reston, Virginia, United States (On-Site)
1 Month ago
Google - Software Engineer III, AI/ML Recommendations, Rankings, Predictions, YouTube

Google

Mountain View, California, United States (On-Site)
1 Month ago
Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

Washington, District Of Columbia, United States (On-Site)
6 Months ago
NVIDIA - Senior Applied LLM Engineer, AI – Chip Design

NVIDIA

Santa Clara, California, United States (On-Site)
4 Months ago
Razer - Solutions Architect

Razer

Singapore (On-Site)
8 Months ago
SmileGate - AI Voice Model Developer

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
2 Months ago
AI Fund - Machine Learning Engineer

AI Fund

(Remote)
7 Months ago
Google - ML System Engineer, AICore

Google

Taipei City, Taiwan (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded