Principal Staff Software Engineer, AI and Data Infrastructure

4 Days ago • 8-12 Years • Artificial Intelligence

Job Summary

Job Description

This Principal Staff Software Engineer role at Google focuses on AI and data infrastructure, specifically collaborating with Google Cloud and Google DeepMind teams to improve Gemini models. Responsibilities include navigating technical ambiguity, driving project strategy, optimizing ML infrastructure, and leading the design and implementation of solutions across multiple ML areas. The role requires strong technical leadership, coding skills, and experience with speech/audio, reinforcement learning, or related ML fields. The ideal candidate will balance architectural design with active coding, ensuring seamless integration and rapid iteration across teams. They will also develop systems-based solutions, prioritizing timely results and working closely with various teams to achieve strategic objectives.
Must have:
  • 8+ years software development experience
  • Expertise in Python, data structures, algorithms
  • 7+ years leading ML design & infrastructure optimization
  • 5+ years experience with speech/audio or reinforcement learning
  • 5+ years design, architecture, testing, and launching software products
Good to have:
  • Master's or PhD in a related field
  • 5+ years technical leadership experience
  • GenAI model development and adaptation knowledge
  • Experience with ML systems in production environments
  • Ability to define data use-cases and balance research, privacy, and product usage

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development and with data structures/algorithms in Python.
  • 7 years of experience in leading technical project strategy, Machine Learning (ML) design, and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 5 years of experience with speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making) or ML infrastructure, or related ML field.
  • 5 years of experience with design and architecture; and testing/launching software products.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 5 years of experience in a technical leadership role leading project teams and setting technical direction.
  • Knowledge of Generative AI (GenAI) model development fine-tuning and model adaptation.
  • Knowledge of ML systems and infrastructure for production with customers and engineers.
  • Ability to develop a use-case specific definition for the data and pragmatically balance trade offs for research, privacy, and product usage.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

Responsibilities

  • Collaborate with Google Cloud and Google DeepMind teams to ensure the Gemini models are improved rapidly based on customer feedback.
  • Work across teams and organizations to navigate technical ambiguity and bring clarity to the engineering work. This requires active scoping and driving progress with detailed attention to technical details while aligning it with a big picture strategy.
  • Balance architectural and design responsibilities with active participation in coding to provide technical leadership and accelerate development cycles, ensuring seamless integration and rapid iteration across teams.
  • Develop and implement systems-based solutions to problems, balancing planning with rapid iteration to achieve timely results.
  • Drive technical project strategy, lead Machine Learning (ML) infrastructure optimization, and oversee the design and implementation of solutions across multiple specialized ML areas.

Similar Jobs

NVIDIA - Principal DGX Cloud Machine Learning Architect

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
GoTo Group - Lead Software Engineer - Cartography

GoTo Group

Singapore (On-Site)
5 Months ago
Google - Software Engineer, Speed

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Days ago
ByteDance - Video Coding/Transcoding Algorithm Engineer

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Google - Senior Software Engineer, Turn-up Site Reliability Engineering

Google

Dublin, County Dublin, Ireland (On-Site)
4 Days ago
Google - Senior Software Engineer, Machine Learning, Google Cloud AI

Google

Kirkland, Washington, United States (On-Site)
4 Days ago
The Walt Disney Company - Lead Software Engineer - Applied AI & Machine Learning

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Week ago
Google - Mobile Device Software Engineer, Machine Learning Runtime, Silicon

Google

Mountain View, California, United States (On-Site)
4 Days ago
NVIDIA - Senior Computer Architect - Deep Learning

NVIDIA

Canada (On-Site)
1 Month ago
Enterprise Bot - Data Scientist

Enterprise Bot

Bengaluru, Karnataka, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Voodoo - Lead Multiplayer Game Developer - Paper.io 2

Voodoo

Amsterdam, North Holland, Netherlands (Remote)
3 Weeks ago
Head Digital Works - Data Scientist

Head Digital Works

Hyderabad, Telangana, India (On-Site)
10 Months ago
RoofStack - Senior iOS Developer

RoofStack

İstanbul, İstanbul, Türkiye (Hybrid)
3 Months ago
Google - Senior Software Engineer, Front End, Google Cloud Business Platforms

Google

San Francisco, California, United States (On-Site)
3 Days ago
ByteDance - Research Scientist Intern (Traffic Infrastructure Global Engineering)

ByteDance

San Jose, California, United States (On-Site)
4 Weeks ago
NVIDIA - Senior Deep Learning Performance Architect

NVIDIA

Canada (On-Site)
1 Month ago
Google - Software Engineer II, BigQuery, Catalog

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
4 Days ago
NXP - Test infrastructure developer intern

NXP

Roznov, Neamț County, Romania (On-Site)
7 Months ago
Google - Staff Software Engineer, AI/ML Computer Vision

Google

Mountain View, California, United States (On-Site)
3 Days ago
Rocket Werkz - MATHEMATICIAN PROGRAMMER

Rocket Werkz

Auckland, Auckland, New Zealand (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Jobs in London, England, United Kingdom

ByteDance - Global Partnership & Ecosystem Manager - Byteplus

ByteDance

London, England, United Kingdom (On-Site)
5 Months ago
Dubit - Full Stack Developer

Dubit

Leeds, England, United Kingdom (On-Site)
8 Months ago
Trailmix Games - Senior DevOps Engineer

Trailmix Games

London, England, United Kingdom (Hybrid)
1 Month ago
PlayStation Global - Internal Auditor

PlayStation Global

London, England, United Kingdom (Hybrid)
1 Week ago
Fennec Labs - Mid/Senior Unity Engineer

Fennec Labs

Stafford, England, United Kingdom (On-Site)
8 Months ago
Playtech - Associate Product Manager

Playtech

Manchester, England, United Kingdom (On-Site)
2 Weeks ago
Google - Customer Engineer, Public Sector, Google Cloud Platform

Google

Manchester, England, United Kingdom (On-Site)
3 Days ago
ByteDance - Strategic Account Executive - Innovative Technical Sales (iGaming/Media)

ByteDance

London, England, United Kingdom (On-Site)
3 Weeks ago
DraftKings - Senior Software Engineer

DraftKings

London, England, United Kingdom (On-Site)
4 Days ago
Tesla - Customer Experience Specialist, Sales - London (Part Time)

Tesla

London, England, United Kingdom (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Google - AI Sales Specialist, Google Cloud

Google

Seoul, South Korea (On-Site)
4 Days ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Generative AI)

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Truecaller - Senior MLOps Engineer

Truecaller

Stockholm, Stockholm County, Sweden (On-Site)
5 Months ago
Zazz - Artificial Intelligence Engineer

Zazz

(Remote)
2 Months ago
Keywords Studios - AI Prompt & Language Specialist (Italian)

Keywords Studios

Quebec, Canada (Remote)
3 Weeks ago
NVIDIA - Principal Technical Program Manager, AI and Enterprise Apps

NVIDIA

Santa Clara, California, United States (On-Site)
4 Days ago
Google - Senior Software Engineer, LLM Code Agents

Google

Boulder, Colorado, United States (On-Site)
3 Days ago
ByteDance - Machine Learning Engineer, Tech Lead - Engineering Efficiency and AI Code Assistant

ByteDance

San Jose, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Fremont, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Atlanta, Georgia, United States (On-Site)

San Francisco, California, United States (On-Site)

Fremont, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug