Principal Engineer, Machine Learning, Vertex AI

1 Month ago • 15 Years + • Artificial Intelligence • $294,000 PA - $414,000 PA

Job Summary

Job Description

As a Principal Engineer, you will drive the technical roadmap for Google Cloud AI's large model platform. You'll partner with Vertex platform engineering and product teams, guiding technical direction and collaborating with internal and external teams (including Google DeepMind). Responsibilities include defining the roadmap for productionizing large models, partnering with Google DeepMind to bring cutting-edge technologies to the platform, consulting on OKRs, reviewing designs, resolving technical discussions, and driving high-quality engineering investments. You'll also provide leadership in critical situations, acting as a technical lead for complex projects. A significant focus involves optimizing and scaling DeepMind's advanced models for seamless integration into Google Cloud AI products, impacting how research translates into customer solutions.
Must have:
  • PhD in CS or equivalent
  • 15 years software engineering experience
  • 10 years AI/ML experience
  • Large Language Model tuning
  • Technical roadmap definition
  • Cross-functional leadership
Good to have:
  • Large Model research experience
  • Deep learning expertise
  • Experience with inter-team/cross-functional leadership
  • Vigilant about technical trends

Job Details

Minimum qualifications:

  • PhD in Computer Science, similar field, or equivalent practical experience.
  • 15 years of software engineering experience, building and working with systems in the technology organization.
  • 10 years of experience in applying AI solutions and ML-related technologies to solve real-world AI/ML problems in consumer or enterprise applications.
  • Experience with tuning Large Language Models and ML modeling.

Preferred qualifications:

  • Experience in Large Model research and technologies.
  • Technical expertise in deep learning.
  • Experience with inter-team/cross-functional leadership.
  • Vigilant about technical trends, adapting quickly to new AI/ML technologies, and applying consumer or enterprise applications.

About the job

Within Cloud AI, we focus on building highly differentiated, highly scalable, and easy-to-use machine learning products and services that enable our customers to transform their business with AI. Products such as Vertex, AutoML, TPU, and TensorFlow Enterprise comprise a portfolio that spans the needs of Data Scientists, Developers, and overall Infrastructure. We provide customers with state-of-the-art ML models and full ML model building/serving toolsets and management workflows.

As a Principal Engineer, you will be responsible for driving, deciding, and landing the technical roadmap for our Cloud AI large model platform. You will partner with Vertex platform engineering and product teams, and work with engineering managers to guide technical direction. You'll partner closely with various partner teams both within the product (e.g., Cloud DA, Cloud GKE) and cross-product partner teams (e.g., CoreML, RMI) on collaborations. In addition, you will work with customers, solutions architects, sales leads, and GTM colleagues to understand customers' use cases, and translate them into technical designs and implementations.

A significant aspect of this Principal Engineer role involves a close partnership with Google DeepMind, specifically focusing on the critical phases of post-training and large model productization within our Cloud AI offerings. You will be at the forefront of collaborating on strategies and implementations to optimize and scale DeepMind's advanced models for seamless integration into our products. This includes working on techniques for efficient deployment, inference optimization, and ensuring the reliability and performance of these large models in a production environment. Your contributions will directly impact how research translates into tangible and impactful AI solutions for our customers.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $294,000-$414,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Define the technical roadmap for productionizing large models to Vertex and providing developer tuning tools to support Google Cloud Platform (GCP) customers tailoring large models to their business use cases.  
  • Partner with the Google Deepmind team to drive large model innovations, and bring SOTA large model technologies to the platform. 
  • Consult on OKRs across platform teams, review designs, participate in and help to resolve technical discussions, and drive high quality extensible engineering investments for large models.
  • Develop a structure of other technical leads in the area, both by defining technical goals and orienting teams around technical decisions they can make, and by providing development support to engineers in the area. 
  • Provide leadership in a firefighting, Code Yellow, or high priority situation. Act as a technical lead or execution supervisor for high-priority, complex, or cross-functional projects. 

Similar Jobs

NVIDIA - Software Engineering Intern, Deep Learning Accelerator - Fall 2025

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
ByteDance - Research Scientist in Foundation Model, Speech Understanding - 2024 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
1 Month ago
Orion Innovation - Data Engineer-AI,ML

Orion Innovation

Chennai, Tamil Nadu, India (On-Site)
7 Months ago
Google - Software Engineer III, Machine Learning, Search

Google

Mountain View, California, United States (On-Site)
6 Months ago
RoofStack - AI/ML Engineer

RoofStack

İstanbul, İstanbul, Türkiye (On-Site)
3 Months ago
NVIDIA - Senior Software Engineer, TensorRT-LLM

NVIDIA

California, United States (Hybrid)
1 Month ago
Google - Photonic Engineer, Machine Learning Systems, Platforms

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Meta - Research Scientist, Computer Vision for Generative AI (PhD)

Meta

Seattle, Washington, United States (On-Site)
6 Months ago
NVIDIA - Deep Learning Engineer, Generative AI and 3D Reconstruction

NVIDIA

Tokyo, Japan (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Algorithm Intern (Video Codec - Realtime Codec Optimizations - Multimedia Streaming) - 2025 Summer (PhD)

ByteDance

San Diego, California, United States (On-Site)
5 Months ago
Microsoft - Research Intern - Microsoft Teams CMD Labs

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
1 Month ago
Google - Senior Research Engineer, AI/ML

Google

London, England, United Kingdom (On-Site)
1 Month ago
PlayStation Global - Senior Machine Learning Graphics Engineer

PlayStation Global

London, England, United Kingdom (Hybrid)
1 Month ago
Virtuos - Senior Machine Learning Engineer (Game)

Virtuos

Malaysia (On-Site)
1 Month ago
Google - Staff Software Engineer, Large Language Model and GenAI

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
Meta - Software Engineer, Machine Learning

Meta

Seattle, Washington, United States (On-Site)
6 Months ago
ION - Data Engineer, Italy

ION

Italy (Hybrid)
7 Months ago
NVIDIA - Deep Learning Intern - Fall 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

Fliff  Inc  - Senior Financial Controller

Fliff Inc

Philadelphia, Pennsylvania, United States (On-Site)
10 Months ago
Aristocrat Gaming - Senior Software Engineer

Aristocrat Gaming

Franklin, Tennessee, United States (Hybrid)
4 Months ago
Google - Senior Product Manager, Systems, and Cloud AI

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Velan Studios - Content Marketing Specialist

Velan Studios

New York, New York, United States (On-Site)
1 Month ago
Google - Greenfield Artificial Intelligence Sales Specialist III

Google

San Francisco, California, United States (On-Site)
1 Month ago
The Walt Disney Company - KGO Newswriter/Producer

The Walt Disney Company

San Francisco, California, United States (On-Site)
3 Months ago
AGS - American Gaming Systems - Field Service Technician II - RI

AGS - American Gaming Systems

Pawtucket, Rhode Island, United States (On-Site)
2 Months ago
NVIDIA - Senior ASIC Front End Infrastructure Engineer

NVIDIA

Louisiana, United States (Hybrid)
1 Month ago
Google - Software Engineer III, Google Cloud Networking

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
InMobiInMobi - Sales Manager

InMobiInMobi

New York, New York, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

NVIDIA - Director of Product - AI Training Platform Software

NVIDIA

Canada (On-Site)
2 Months ago
Epic Games - Machine Learning Engineer

Epic Games

London, England, United Kingdom (On-Site)
1 Month ago
Google - Staff Software Engineer, AI, Containers, and Kubernetes

Google

Seattle, Washington, United States (On-Site)
1 Month ago
NVIDIA - Senior AI Training Performance Engineer

NVIDIA

Shanghai, Shanghai, China (Hybrid)
4 Months ago
ByteDance - Research Scientist Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Google - Senior Technical Program Manager I, Machine Learning, Google Cloud Platforms

Google

Kirkland, Washington, United States (On-Site)
1 Month ago
Google - Software Engineer III, Distributed Machine Learning, YouTube

Google

Mountain View, California, United States (On-Site)
1 Month ago
Google - Partner Engineer, AI Code Assistant and App Innovation

Google

Maharashtra, India (On-Site)
1 Month ago
Inworld AI - AI Trainer (Contractor) - Writing & Gaming

Inworld AI

Vancouver, British Columbia, Canada (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

London, England, United Kingdom (On-Site)

Fremont, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Reston, Virginia, United States (On-Site)

Sunnyvale, California, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Dublin, County Dublin, Ireland (On-Site)

San Jose, California, United States (On-Site)

Mexico City, Mexico City, Mexico (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug