Staff Software Engineer, AI/ML Compute

2 Months ago • 8-11 Years • $197,000 PA - $291,000 PA

Job Summary

Job Description

Google seeks a Staff Software Engineer for AI/ML Compute. Responsibilities include partnering with customers to benchmark AI/ML model performance on Google Cloud, collaborating with internal infrastructure teams, conducting performance profiling and debugging, and designing specialized ML solutions. The role requires 8+ years of software development experience, 5+ years in product testing and launch, and 3+ years in ML infrastructure experience. Up to 10% travel may be required. The position involves working with demanding AI workloads and leveraging advanced ML infrastructure to enhance support for Google's services and Cloud customers.
Must have:
  • 8+ years software development
  • 5+ years product testing & launch
  • 3+ years ML infrastructure experience
  • Expertise in model deployment, evaluation, optimization
  • Proficient in cloud services (GCP preferred)
Good to have:
  • Master's/PhD in related field
  • Technical leadership experience
  • Experience in complex organizations
  • Direct customer collaboration
  • Data structures/algorithms expertise
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details


Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing, and launching software products.
  • 3 years of experience with software design and architecture.
  • 3 years of experience with ML infrastructure, including model deployment, evaluation, optimization, data processing, and debugging.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 8 years of experience with data structures/algorithms.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.
  • Proven track record of collaborating directly with customers and field teams
  • Proficient in cloud services such as Compute, Storage, and Networking, preferably on GCP.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $197,000-$291,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Partner with customers to benchmark AI/ML model performance on Google Cloud compute and overall infrastructure.
  • Collaborate with internal infrastructure teams like Storage, Networking to enhance support for demanding AI workloads.
  • Conduct in-depth performance profiling, debugging, and troubleshooting of training and inference workloads.
  • Design and implement specialized ML solutions, effectively leveraging advanced ML infrastructure.
  • Role may include up to 10% business-related travel to the customers and partners within the US.

Similar Jobs

Tesla - Electrical Engineer - Motor Design and Multi-Physics Optimization

Tesla

Athens, Greece (On-Site)
4 Months ago
Niantic - Software Engineer, Map Location Services

Niantic

San Francisco, California, United States (Hybrid)
7 Months ago
Flexera - Member Technical Staff - Site Reliability Engineer

Flexera

Bengaluru, Karnataka, India (Hybrid)
9 Months ago
NVIDIA - Developer Technology Engineer - HPC and AI

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
Nintendo - Senior Engineer, CPU Debugger (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
7 Months ago
Google - Sensitive Content Analyst, Emerging AI Strategy

Google

Austin, Texas, United States (On-Site)
2 Months ago
Level AI - Backend Engineer - Customer Engineering

Level AI

Noida, Uttar Pradesh, India (Hybrid)
8 Months ago
Google - Software Engineer, PhD, Early Career, Campus, Machine Learning, Systems and Cloud AI, 2025 start

Google

Sunnyvale, California, United States (On-Site)
6 Months ago
Genies - Machine Learning Infrastructure Engineer, 3D Model Inference & Deployment

Genies

Los Angeles, California, United States (On-Site)
3 Months ago
NVIDIA - Solutions Architect - Cloud Providers and Hyperscale

NVIDIA

California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

N-iX - Senior C++ Engineer (High Performance Computing)

N-iX

United Kingdom (Flexible)
4 Months ago
N-iX - Senior C++ Engineer (High Performance Computing)

N-iX

United Kingdom (Remote)
4 Months ago
Stake Logic - Java Back-end Developer

Stake Logic

(Remote)
4 Months ago
NVIDIA - Senior System Software Engineer, Signing Services

NVIDIA

California, United States (Remote)
2 Months ago
Voodoo - Senior Product Manager - Advertising Solutions

Voodoo

Paris, Île-de-France, France (Hybrid)
2 Months ago
Evolution - Data Scientist

Evolution

Warsaw, Masovian Voivodeship, Poland (Hybrid)
10 Months ago
Passive Logic - AI Control Theory & Optimization Scientist

Passive Logic

Salt Lake City, Utah, United States (On-Site)
6 Months ago
Google - Senior Software Engineer, Privacy Sandbox

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
2 Months ago
Google - Senior SoC Power Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
Krafton  - Lead of Physical AI Agent, Research Scientist

Krafton

Seoul, South Korea (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Kirkland, Washington, United States

Nissan - Warehouse Operator -Lebanon

Nissan

Lebanon, Tennessee, United States (On-Site)
8 Months ago
Google - Systems Engineer III, Site Reliability Engineering, Google Cloud

Google

Kirkland, Washington, United States (On-Site)
2 Months ago
Rockstar Games - Animation R&D Programmer: Retargeting

Rockstar Games

Carlsbad, California, United States (On-Site)
2 Months ago
Netflix - International Tax Analyst, Tax Operations

Netflix

Los Gatos, California, United States (Hybrid)
2 Months ago
ByteDance - Senior Software Engineer, Distributed Storage System

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Niantic - Software Engineer, Mobile Native AR Mapping

Niantic

San Francisco, California, United States (Hybrid)
7 Months ago
Rush Street Interactive - Director of Data Product Management

Rush Street Interactive

United States (Remote)
4 Months ago
Everyday Health Group - Senior Software Engineer, Backend - Lose It!

Everyday Health Group

United States (On-Site)
7 Months ago
ByteDance - Tech Lead Backend Software Engineer

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Google - Data Center Facilities Technician II, Electrical

Google

New Albany, Ohio, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Canva - Senior Computer Vision Engineer - Photo AI

Canva

London, England, United Kingdom (Remote)
4 Months ago
Google - Software Engineer III, AI/ML GenAI, Google Cloud Data Management

Google

Sunnyvale, California, United States (On-Site)
2 Months ago
NVIDIA - Senior Field Application Engineer

NVIDIA

Durham, North Carolina, United States (On-Site)
5 Months ago
Google - Group Product Manager, Google Cloud Storage

Google

Sunnyvale, California, United States (On-Site)
2 Months ago
NVIDIA - Applied Physics ML Research Intern - Fall 2025

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
ByteDance - Machine Learning Scientist Graduate (Scaling AI for Biology (AI-for-Science))

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
ByteDance - Senior Machine Learning Engineer

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
4 Months ago
Airlab Inc  - Junior Programmer Artificial Intelligence

Airlab Inc

Quebec, Canada (On-Site)
2 Months ago
NVIDIA - Solutions Architect - Cloud Providers and Hyperscale

NVIDIA

California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

San Diego, California, United States (On-Site)

Los Angeles, California, United States (On-Site)

Massachusetts, United States (Remote)

United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Chicago, Illinois, United States (Hybrid)

Bengaluru, Karnataka, India (On-Site)

Regensburg, Bavaria, Germany (Remote)

Lanham, Maryland, United States (On-Site)

Toronto, Ontario, Canada (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug