Technical Program Manager III, Machine Learning Infrastructure, Cloud AI Systems

2 Weeks ago • 5-5 Years • Artificial Intelligence • $156,000 PA - $229,000 PA

Job Summary

Job Description

This Technical Program Manager III role focuses on Machine Learning Infrastructure within Google's Cloud AI Systems. You'll lead complex projects related to Gemini Serving, a critical infrastructure for various GenAI products (Workspace, Duet AI, Vertex AI, etc.). Responsibilities include enabling production of Gemini and Agentic AI innovations, partnering with Google DeepMind, collaborating on Responsible AI, and prioritizing large-scale adoption. You'll scope and define engineering work across multiple product areas, working with internal teams to ensure the success of Gemini Serving as the canonical serving entry point for GenAI workflows. The role requires strong technical expertise, excellent communication, and a data-driven approach to problem-solving.
Must have:
  • 5+ years program management experience
  • Experience leading machine learning programs
  • Experience building distributed systems
  • Excellent communication skills
Good to have:
  • 5+ years managing cross-functional projects
  • Experience launching products to production
  • Machine Learning lifecycle management expertise
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor's degree in a relevant field, or equivalent practical experience.
  • 5 years of experience in program management.
  • Experience in leading machine learning programs.
  • Experience in building, automating and developing distributed systems.

Preferred qualifications:

  • 5 years of experience managing cross-functional or cross-team projects.
  • Experience in launching products into production.
  • Experience in Machine Learning life-cycle management.
  • Excellent communication skills, with a data driven problem solving approach towards challenges.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Technical Program Manager at Google, you’ll use your technical expertise to lead complex, multi-disciplinary projects from start to finish. You’ll work with stakeholders to plan requirements, identify risks, manage project schedules, and communicate clearly with cross-functional partners across the company. You're equally comfortable explaining your team's analyses and recommendations to executives as you are discussing the technical tradeoffs in product development with engineers.

Gemini Serving is on the central and critical path for several GenAI application products that are underway. Gemini Serving supports in the production of following - Workspace, Duet AI, Vertex AI, APIs, Google Labs, AI Studio, YouTube, Shopping, and others.

Gemini Serving's innovation is to become the canonical serving entry-point and backend for GenAI serving workflows across the company.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $156,000-$229,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Enable the production of the latest Gemini and Agentic AI Innovations.
  • Partner with Google Deep mind to understand the latest innovations and implications in Google Serving.
  • Collaborate with internal Google teams to evaluate Responsible Artificial Intelligence, Serving, Recitation and other needs to enable them to onboard Gemini Serving infrastructure.
  • Understand technical challenges from our users and work with the teams to prioritize and enable large scale adoption.
  • Scope and define all work streams and engineering work, including long term initiatives across multiple product areas.

Similar Jobs

Google - GTM Sales Specialist, Databases, Google Cloud

Google

Seattle, Washington, United States (On-Site)
2 Days ago
Behaviour Interactive - Principal UI/UX Designer

Behaviour Interactive

Montreal, Quebec, Canada (Hybrid)
2 Months ago
AGS - American Gaming Systems - Full Stack Software Engineer II

AGS - American Gaming Systems

Arizona, United States (On-Site)
1 Week ago
Ubisoft - Player Journey Mapper

Ubisoft

Newcastle Upon Tyne, England, United Kingdom (On-Site)
2 Weeks ago
Ethos Life - Software Engineer, Test

Ethos Life

Bengaluru, Karnataka, India (On-Site)
11 Months ago
Google - Staff Cloud Solutions Architect, Rapid Innovation

Google

Reston, Virginia, United States (On-Site)
2 Days ago
Microsoft - Member of Technical Staff, AI Pretraining

Microsoft

London, England, United Kingdom (On-Site)
1 Month ago
Google - Senior Software Engineer, AI/ML GenAI, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
2 Days ago
Google - Staff Software Engineer, Platforms

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Meta - AI Research Scientist, Language - Generative AI

Meta

Menlo Park, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Techland - Lead Level Designer

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
4 Months ago
Google - Program Manager, Trust and Safety

Google

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
Powerintegration - Database Administrator, Oracle EBS

Powerintegration

Pasig, Metro Manila, Philippines (On-Site)
7 Months ago
Every matrix - Mid/Senior Data Analyst

Every matrix

Yerevan, Yerevan, Armenia (On-Site)
3 Weeks ago
Google - Strategic Partnerships Development Manager, Global Partnerships

Google

Dublin, County Dublin, Ireland (On-Site)
2 Days ago
Lightcast - Account Executive

Lightcast

(Remote)
4 Months ago
DraftKings - Senior Data Engineer, Platform

DraftKings

Boston, Massachusetts, United States (On-Site)
2 Weeks ago
PwC - SAP Lead Solution/ Enterprise Architect - NCR region

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Voodoo - Publishing Manager - Publishing Team

Voodoo

Paris, Île-de-France, France (On-Site)
5 Months ago
Wrike - Mid-Senior Backend Engineer

Wrike

Estonia (Hybrid)
1 Day ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

ByteDance - Software Developer (Routing Verification & Emulation)

ByteDance

Seattle, Washington, United States (On-Site)
2 Weeks ago
Glean - Designated Technical Support Engineer

Glean

Palo Alto, California, United States (On-Site)
7 Hours ago
Google - Technical Program Manager III, Software Engineering, Google Ads

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
Epic Games - Gameplay Systems Programmer, Fortnite

Epic Games

United States (On-Site)
2 Months ago
VX Media - Public Relations Specialist

VX Media

New York, New York, United States (On-Site)
6 Months ago
Epic Games - Character Concept Outsource Lead (IP)

Epic Games

Cary, North Carolina, United States (On-Site)
2 Weeks ago
Canva - B2B SEO Lead

Canva

Los Angeles, California, United States (Remote)
1 Month ago
Epic Games - AI Designer

Epic Games

Cary, North Carolina, United States (On-Site)
23 Hours ago
PlayStation Global - Principal Multiplayer Systems Designer

PlayStation Global

United States (Remote)
3 Weeks ago
Naughty Dog - Senior Character Artist

Naughty Dog

Los Angeles, California, United States (Hybrid)
3 Days ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Video Generation) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Google - Software Engineer, On-Device Machine Learning

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Google - Applied Machine Learning Engineer

Google

Taipei City, Taiwan (On-Site)
1 Week ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
3 Months ago
NVIDIA - Solutions Architect - Generative AI

NVIDIA

Seoul, South Korea (Hybrid)
1 Month ago
Genies - Machine Learning Engineer, Character Animation & Motion AI

Genies

Los Angeles, California, United States (On-Site)
2 Months ago
ByteDance - Research Scientist, AI Foundation

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Electronic Arts - Data Science Engineer

Electronic Arts

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Video Generative Model)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Google - Staff Software Engineer, AI/ML

Google

Hyderabad, Telangana, India (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug