Principal Staff Software Engineer, AI and Data Infrastructure

2 Days ago • 8-13 Years • Artificial Intelligence

Job Summary

Job Description

This Principal Staff Software Engineer role at Google focuses on AI and data infrastructure, specifically improving Gemini models. Responsibilities include collaborating with Google Cloud and DeepMind teams, navigating technical ambiguity across organizations, balancing architectural design with coding, implementing system solutions, driving ML infrastructure optimization, and overseeing solution implementation across various ML areas. The ideal candidate will have extensive experience in software development, ML design, and infrastructure optimization, particularly in speech/audio, reinforcement learning, or related fields. The role requires strong leadership skills and a proven ability to deliver results in a fast-paced environment.
Must have:
  • 8+ years software development experience
  • 7+ years leading technical projects & ML design
  • 5+ years experience with speech/audio or reinforcement learning
  • 5+ years in design, architecture, testing & launching software
  • Proficiency in Python, data structures & algorithms
Good to have:
  • Master's/PhD in related field
  • 5+ years technical leadership
  • Generative AI (GenAI) model experience
  • Knowledge of ML systems for production
  • Ability to define data use-cases and balance trade-offs

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development and with data structures/algorithms in Python.
  • 7 years of experience in leading technical project strategy, Machine Learning (ML) design, and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 5 years of experience with speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making) or ML infrastructure, or related ML field.
  • 5 years of experience with design and architecture; and testing/launching software products.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 5 years of experience in a technical leadership role leading project teams and setting technical direction.
  • Knowledge of Generative AI (GenAI) model development fine-tuning and model adaptation.
  • Knowledge of ML systems and infrastructure for production with customers and engineers.
  • Ability to develop a use-case specific definition for the data and pragmatically balance trade offs for research, privacy, and product usage.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

Responsibilities

  • Collaborate with Google Cloud and Google DeepMind teams to ensure the Gemini models are improved rapidly based on customer feedback.
  • Work across teams and organizations to navigate technical ambiguity and bring clarity to the engineering work. This requires active scoping and driving progress with detailed attention to technical details while aligning it with a big picture strategy.
  • Balance architectural and design responsibilities with active participation in coding to provide technical leadership and accelerate development cycles, ensuring seamless integration and rapid iteration across teams.
  • Develop and implement systems-based solutions to problems, balancing planning with rapid iteration to achieve timely results.
  • Drive technical project strategy, lead Machine Learning (ML) infrastructure optimization, and oversee the design and implementation of solutions across multiple specialized ML areas.

Similar Jobs

Scale AI - Machine Learning Research Scientist / Engineer

Scale AI

San Francisco, California, United States (On-Site)
1 Day ago
Google - Software Engineer II, Contact Center AI Platform

Google

Zürich, Zurich, Switzerland (On-Site)
1 Week ago
ByteDance - Research Engineer Graduate (Vision AI Platform)

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
matchgroup - Sr. Product Manager (Recommendations)

matchgroup

San Francisco, California, United States (Hybrid)
6 Months ago
WinZO - Android Developer

WinZO

New Delhi, Delhi, India (On-Site)
1 Day ago
Lionbridge Games - Language AI Specialist (Test & Tech)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
1 Month ago
Google - Greenfield Artificial Intelligence Sales Specialist III

Google

San Francisco, California, United States (On-Site)
2 Weeks ago
NVIDIA - AI Computing Software Development Engineer, TensorRT

NVIDIA

Shanghai, Shanghai, China (On-Site)
3 Months ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
1 Month ago
ByteDance - Senior Research Engineer / Scientist - AI for Databases

ByteDance

Seattle, Washington, United States (On-Site)
3 Days ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Senior Generalist Software Engineer -- Omniverse

NVIDIA

Taipei City, Taiwan (On-Site)
3 Months ago
Eqvilent - C++ Software Engineer (Market Data)

Eqvilent

(Remote)
9 Hours ago
Rackner - Principal Data Scientist

Rackner

(Remote)
7 Hours ago
Mistplay - Principal Product Manager - Growth Product

Mistplay

Toronto, Ontario, Canada (Hybrid)
1 Week ago
ByteDance - Research Scientist in Foundation Model (Speech & Audio Generation) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Google - Software Engineer, Cloud Console Platform, Full Stack

Google

Kirkland, Washington, United States (On-Site)
2 Weeks ago
SLAY - Senior Marketing Data Engineer

SLAY

Berlin, Berlin, Germany (On-Site)
1 Month ago
Virtuos - Senior Software Engineer

Virtuos

Malaysia (On-Site)
2 Weeks ago
ByteDance - Research Scientist Graduate (Foundation Model, Video Generation) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Trendyol - Data Science Professionals - Trendyol GO

Trendyol

Ankara, Ankara, Türkiye (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in London, England, United Kingdom

WongDoody - Design Lead

WongDoody

London, England, United Kingdom (Hybrid)
1 Day ago
SingleStore - Principal Solutions Engineer

SingleStore

United Kingdom (On-Site)
1 Day ago
Humanitarian Operations - Handyman

Humanitarian Operations

Edinburgh, Scotland, United Kingdom (On-Site)
2 Months ago
Addepar - Data Projects Analyst

Addepar

Edinburgh, Scotland, United Kingdom (On-Site)
1 Day ago
Epic Games - International Controller (Fixed-Term)

Epic Games

London, England, United Kingdom (On-Site)
3 Months ago
Cirrus Logic - IT Operations Asset Manager

Cirrus Logic

Edinburgh, Scotland, United Kingdom (On-Site)
1 Day ago
McDonald's Corporation - Legal Director - Global Labor Relations

McDonald's Corporation

London, England, United Kingdom (On-Site)
2 Days ago
ComeOn Group - Brand Executive - Denmark

ComeOn Group

London, England, United Kingdom (Hybrid)
3 Weeks ago
Hawk Eye Innovations - Match Operations Assistant - Belfast

Hawk Eye Innovations

Belfast, Northern Ireland, United Kingdom (On-Site)
1 Week ago
Tide - Senior Invoice Finance Specialist

Tide

United Kingdom (On-Site)
1 Day ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Netflix - Product Manager, ML Platform: Training

Netflix

Los Gatos, California, United States (Hybrid)
6 Months ago
NVIDIA - Senior System Software Engineer - Dynamo and Triton Inference Server

NVIDIA

California, United States (Remote)
1 Month ago
Google - Senior Software Developer, AI/Machine Learning, Applied AI

Google

Waterloo, Ontario, Canada (On-Site)
2 Weeks ago
Google - Software Engineer III, Education Scaled Deployments

Google

Mexico City, Mexico City, Mexico (On-Site)
2 Days ago
Google - Technical Program Manager, AI Data Operations

Google

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
NVIDIA - Deep Learning Performance Architect

NVIDIA

Pune, Maharashtra, India (Hybrid)
2 Months ago
NVIDIA - Senior Deep Learning Engineer

NVIDIA

Redmond, Washington, United States (On-Site)
1 Month ago
Tencent - Large Language Model Algorithm Engineer

Tencent

California, United States (On-Site)
1 Month ago
Google - Senior Software Engineer, AI/ML GenAI, Google Cloud AI

Google

Sunnyvale, California, United States (On-Site)
5 Months ago
Meta - Research Scientist, Machine Learning (PhD)

Meta

Bellevue, Washington, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug