Technical Program Manager III, Machine Learning Infrastructure, Cloud AI Systems

9 Hours ago • 5-5 Years • Artificial Intelligence • $156,000 PA - $229,000 PA

Job Summary

Job Description

This Technical Program Manager III role focuses on Machine Learning Infrastructure within Google's Cloud AI Systems. You'll lead complex projects related to Gemini Serving, a critical infrastructure for various GenAI products (Workspace, Duet AI, Vertex AI, etc.). Responsibilities include enabling production of Gemini and Agentic AI innovations, partnering with Google DeepMind, collaborating on Responsible AI, and prioritizing large-scale adoption. You'll scope and define engineering work across multiple product areas, working with internal teams to ensure the success of Gemini Serving as the canonical serving entry point for GenAI workflows. The role requires strong technical expertise, excellent communication, and a data-driven approach to problem-solving.
Must have:
  • 5+ years program management experience
  • Experience leading machine learning programs
  • Experience building distributed systems
  • Excellent communication skills
Good to have:
  • 5+ years managing cross-functional projects
  • Experience launching products to production
  • Machine Learning lifecycle management expertise
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor's degree in a relevant field, or equivalent practical experience.
  • 5 years of experience in program management.
  • Experience in leading machine learning programs.
  • Experience in building, automating and developing distributed systems.

Preferred qualifications:

  • 5 years of experience managing cross-functional or cross-team projects.
  • Experience in launching products into production.
  • Experience in Machine Learning life-cycle management.
  • Excellent communication skills, with a data driven problem solving approach towards challenges.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Technical Program Manager at Google, you’ll use your technical expertise to lead complex, multi-disciplinary projects from start to finish. You’ll work with stakeholders to plan requirements, identify risks, manage project schedules, and communicate clearly with cross-functional partners across the company. You're equally comfortable explaining your team's analyses and recommendations to executives as you are discussing the technical tradeoffs in product development with engineers.

Gemini Serving is on the central and critical path for several GenAI application products that are underway. Gemini Serving supports in the production of following - Workspace, Duet AI, Vertex AI, APIs, Google Labs, AI Studio, YouTube, Shopping, and others.

Gemini Serving's innovation is to become the canonical serving entry-point and backend for GenAI serving workflows across the company.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $156,000-$229,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Enable the production of the latest Gemini and Agentic AI Innovations.
  • Partner with Google Deep mind to understand the latest innovations and implications in Google Serving.
  • Collaborate with internal Google teams to evaluate Responsible Artificial Intelligence, Serving, Recitation and other needs to enable them to onboard Gemini Serving infrastructure.
  • Understand technical challenges from our users and work with the teams to prioritize and enable large scale adoption.
  • Scope and define all work streams and engineering work, including long term initiatives across multiple product areas.

Similar Jobs

Google - Data Center Facilities Engineer, Electrical (English, Japanese)

Google

Inzai, Chiba, Japan (On-Site)
3 Months ago
Token Metrics - DevOps/Site Reliability Engineer (Remote)

Token Metrics

Bengaluru, Karnataka, India (Remote)
6 Months ago
Extreme Network - SR PROGRAMMER 9489- EBS Applications/Oracle PL/SQL, SQL/Oracle Forms, Reports

Extreme Network

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Ubisoft - Level Artist

Ubisoft

Chengdu, Sichuan, China (On-Site)
2 Weeks ago
SmileGate - AI Developer ([LOST ARK Mobile])

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
3 Months ago
Microsoft - Language Engineer

Microsoft

Mountain View, California, United States (Hybrid)
1 Day ago
NVIDIA - Senior Application Software Engineer, Performance

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Weeks ago
Soul AI - Subject Matter Expert (AI Trainer)

Soul AI

Hyderabad, Telangana, India (On-Site)
7 Months ago
Google - Senior Software Developer, AI/Machine Learning, Applied AI

Google

Waterloo, Ontario, Canada (On-Site)
10 Hours ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Mixed-Signal Circuit Design Engineer - New College Graduate

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
Hangar 13 - Senior Director, Game Development

Hangar 13

Brighton And Hove, England, United Kingdom (On-Site)
1 Month ago
Haptic - Production Director

Haptic

Sweden (On-Site)
3 Months ago
Tencent - Global Talent Sourcing Intern

Tencent

(On-Site)
5 Months ago
Google - Nordic Agency and Partner Manager

Google

Oslo, Oslo, Norway (On-Site)
11 Hours ago
ByteDance - Innovation Tech Solution Sales - BytePlus - Ho Chi Minh

ByteDance

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
5 Months ago
Gearbox Software - Senior UI Programmer

Gearbox Software

Frisco, Texas, United States (On-Site)
4 Months ago
ION - Trading Systems Engineer - 9320

ION

London, England, United Kingdom (On-Site)
6 Months ago
DEVOTEAM - Tech Lead Java

DEVOTEAM

Casablanca, Casablanca-Settat, Morocco (Remote)
6 Months ago
Niantic - Technical Artist, Pokémon GO

Niantic

San Francisco, California, United States (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

Netflix - Senior Tax Analyst, Production Tax (Global Studio)

Netflix

Los Angeles, California, United States (On-Site)
16 Hours ago
Google - Software Engineer III, AI/ML GenAI, Search

Google

Mountain View, California, United States (On-Site)
8 Hours ago
31st Union - Senior Anti-Cheat Engineer

31st Union

San Mateo, California, United States (On-Site)
2 Weeks ago
ByteDance - Senior/Tech Lead Network Software Development Engineer, Switch - Seattle

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
The Walt Disney Company - Senior Manager, Business Operations

The Walt Disney Company

New York, New York, United States (On-Site)
2 Days ago
Whoop - Head of Creative

Whoop

New York, New York, United States (Hybrid)
5 Months ago
Google - Software Engineer III, Full Stack, Google Ads

Google

New York, New York, United States (On-Site)
9 Hours ago
Canva - Revenue Operations Manager, NPI

Canva

San Francisco, California, United States (Remote)
1 Week ago
The Walt Disney Company - Senior Software Engineer, iOS

The Walt Disney Company

Glendale, California, United States (On-Site)
2 Days ago
Ember Lab - Technical Artist

Ember Lab

California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Google - Senior Research Scientist, Google Cloud AI

Google

Sunnyvale, California, United States (On-Site)
7 Hours ago
ByteDance - Research Engineer Graduate (Vision AI Platform)

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
Tencent - NLP Research Intern 104493

Tencent

London, England, United Kingdom (On-Site)
3 Months ago
Zoox - Senior/Staff Software Engineer - Machine Learning

Zoox

Boston, Massachusetts, United States (Hybrid)
6 Months ago
Google - Senior Hardware Qualification Engineer, Machine Learning, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
9 Hours ago
Interface AI - Vice President of Engineering

Interface AI

United States (Remote)
2 Months ago
Google - Kaggle Staff Software Engineer, AI/ML

Google

Sunnyvale, California, United States (On-Site)
2 Days ago
Google - Staff Software Engineer, Network Interface Card Firmware, SmartNIC

Google

Sunnyvale, California, United States (On-Site)
9 Hours ago
GT - AI/ML Engineer

GT

(Remote)
3 Weeks ago
C3 AI - Solution Engineer

C3 AI

Bengaluru, Karnataka, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Bucharest, Bucharest, Romania (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Bengaluru, Karnataka, India (On-Site)

Sunnyvale, California, United States (On-Site)

Sunnyvale, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug