Principal Engineer, Platform and Scale, Vertex AI

5 Months ago • 15 Years + • Artificial Intelligence

Job Summary

Job Description

Lead the design, development, and operation of the Vertex Generative AI Serving platform, delivering cutting-edge AI experiences across Google Cloud. This role involves setting the strategic roadmap, resource allocation, and execution, defining operational excellence standards, and leading strategic partnerships. Responsibilities include leading a growing engineering organization, ensuring the performance, reliability, and efficiency of Generative AI models in production, and collaborating with broader Vertex platform teams and Google research. The Principal Engineer will evolve the strategic direction of the organization, provide executive leadership, and influence key stakeholders.
Must have:
  • 15+ years software engineering leadership
  • Generative AI experience (LLMs, diffusion models)
  • Technical leadership and global project experience
  • Bachelor's degree in Computer Science or equivalent
Good to have:
  • Experience driving engineering excellence
  • Strong understanding of Agile methodologies
  • Understanding of developer needs
  • Proven leadership, vision setting

Job Details

Minimum qualifications:

  • Bachelor's degree in Computer Science, similar technical field of study, or equivalent practical experience.
  • 15 years of experience in software engineering leadership roles and building developer-facing products or platforms.
  • Experience with generative AI (LLMs, diffusion models, etc.), development workflows, and use cases.
  • Experience in technical leadership, leading global projects and setting technical direction for teams.

Preferred qualifications:

  • Experience driving engineering excellence through testing, monitoring, and continuous improvement.
  • Strong understanding of Agile methodologies and software development lifecycle.
  • Understanding of developer needs, with the ability to translate them into exceptional software tools and experiences.
  • Proven and dynamic leader with the ability to set a vision and inspire those around them.

About the job

In this role, you will lead the design, development, and operation of our Vertex Generative AI Serving platform. This platform will be instrumental in delivering cutting-edge AI experiences across Google Cloud, impacting users globally.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

Responsibilities

  • Own and set the strategic roadmap, resource allocation, execution and delivery through critical technology choices, defining operational excellence standards, and leading strategic partnerships within Google to drive platform adoption and evolution.
  • Lead a growing engineering organization across multiple sites, responsible for determining the performance, reliability, and efficiency of our Generative AI models in production, influencing user satisfaction and adoption of AI-powered features. 
  • Lead, collaborate, and influence across the broader Vertex platform teams, Google research and CoreML teams to build up the LM serving platform. 
  • Evolve the strategic direction for the organization as the set of challenges and opportunities for Google rapidly changes and provide executive leadership to define the product vision, roadmap, and execution strategy. Influence key stakeholders across the company, advocating for resources and driving adoption of the platform.

Similar Jobs

Meta - Product Manager, Machine Learning

Meta

New York, New York, United States (Remote)
5 Months ago
Reversing Labs - Director, Product Management, Integrations

Reversing Labs

United States (Remote)
1 Month ago
Dream Sports - Product Manager (Verifications)

Dream Sports

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Yodo1 - Head of Platform Product Management

Yodo1

(Remote)
1 Month ago
CharacterAI - Product Designer

CharacterAI

Menlo Park, California, United States (On-Site)
1 Month ago
NVIDIA - Principal DGX Cloud Machine Learning Architect

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
PwC - AI/ML Azure Engineer (m/f/d)

PwC

Luxembourg (On-Site)
6 Months ago
NVIDIA - Senior System Software Engineer - Dynamo and Triton Inference Server

NVIDIA

California, United States (Remote)
1 Month ago
Krafton  - Deep Learning Strategy & Operations Associate

Krafton

Seoul, South Korea (On-Site)
2 Months ago
Krafton  - Applied Research Scientist/Engineer - LLM Game Agent

Krafton

Seoul, South Korea (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Meta - Product Manager

Meta

Burlingame, California, United States (On-Site)
5 Months ago
VGW - Senior Product Manager

VGW

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Canva - Senior Engineering Manager (BE) - Visual Suite Platform - Remote across ANZ

Canva

Sydney, New South Wales, Australia (Remote)
5 Months ago
Meta - Product Manager, Machine Learning

Meta

Menlo Park, California, United States (Remote)
5 Months ago
Nielsen Holdings - Lead Frontend Developer (ReactJS/Typescript/Test Automation)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
The Walt Disney Company - Principal Product Designer

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Month ago
Playrix - Art Director

Playrix

Armenia (Remote)
6 Months ago
Meta - Product Manager, Machine Learning

Meta

San Francisco, California, United States (Remote)
5 Months ago
Glean - Product Manager, Glean for Engineering

Glean

Palo Alto, California, United States (On-Site)
5 Months ago
My Fitness Pal - Senior Product Manager

My Fitness Pal

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Worldwide

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Artificial Intelligence Jobs

NVIDIA - DGX Cloud Platform Software Engineer Intern - Fall 2025

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
CloudHire - ML Engineer

CloudHire

Hyderabad, Telangana, India (Remote)
1 Month ago
Zazz - Artificial Intelligence Engineer

Zazz

(Remote)
2 Months ago
Rackspace Technology - AI/ML Architect

Rackspace Technology

Vietnam (Remote)
2 Months ago
Omnissa - Staff Data Scientist

Omnissa

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
ByteDance - Machine Learning Engineer, Tech Lead - Engineering Efficiency and AI Code Assistant

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
Virtuos - R&D Machine Learning Engineer

Virtuos

China (On-Site)
1 Month ago
NVIDIA - AI Computing Software Development Engineer, TensorRT

NVIDIA

Taipei City, Taiwan (On-Site)
3 Months ago
Netflix - Software Engineer L4/L5, Training Platform, Machine Learning Platform

Netflix

California, United States (Remote)
3 Months ago
NVIDIA - Research Scientist, Deep Learning and Computer Vision

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug