Staff Software Engineer, AI/ML Compute

1 Month ago • 8-11 Years • Artificial Intelligence • $197,000 PA - $291,000 PA

Job Summary

Job Description

As a Staff Software Engineer, AI/ML Compute at Google, you'll partner with customers to benchmark AI/ML model performance on Google Cloud. Collaborate with internal teams to enhance support for AI workloads. Conduct performance profiling, debugging, and troubleshooting of training and inference workloads. Design and implement specialized ML solutions leveraging advanced infrastructure. This role involves up to 10% travel within the US. You'll work on critical projects, with opportunities to switch teams. Google needs versatile, leadership-oriented engineers enthusiastic about full-stack problem-solving.
Must have:
  • 8+ years software development experience
  • 5+ years testing and launching software
  • 3+ years ML infrastructure experience
  • Experience with model deployment, evaluation, optimization
  • Data processing and debugging expertise
Good to have:
  • Master's/PhD in relevant field
  • Experience with data structures/algorithms
  • Technical leadership experience
  • Experience in complex, matrixed organizations
  • Proficiency in GCP cloud services
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details


Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing, and launching software products.
  • 3 years of experience with software design and architecture.
  • 3 years of experience with ML infrastructure, including model deployment, evaluation, optimization, data processing, and debugging.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 8 years of experience with data structures/algorithms.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.
  • Proven track record of collaborating directly with customers and field teams
  • Proficient in cloud services such as Compute, Storage, and Networking, preferably on GCP.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $197,000-$291,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Partner with customers to benchmark AI/ML model performance on Google Cloud compute and overall infrastructure.
  • Collaborate with internal infrastructure teams like Storage, Networking to enhance support for demanding AI workloads.
  • Conduct in-depth performance profiling, debugging, and troubleshooting of training and inference workloads.
  • Design and implement specialized ML solutions, effectively leveraging advanced ML infrastructure.
  • Role may include up to 10% business-related travel to the customers and partners within the US.

Similar Jobs

Microsoft - Principal Data Science Manager

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Month ago
Head Digital Works - Data Scientist

Head Digital Works

Hyderabad, Telangana, India (On-Site)
11 Months ago
Salesforce - Software Engineer MTS

Salesforce

San Francisco, California, United States (Remote)
1 Month ago
Google - Senior Software Engineer, OSS

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
CleverTap - Senior Backend Engineer (Java & Mongo DB)

CleverTap

Mumbai, Maharashtra, India (Hybrid)
7 Months ago
Outlier - Software Engineer (Python)

Outlier

Faridabad, Haryana, India (Hybrid)
7 Months ago
Roofstacks - AI/ML Engineer

Roofstacks

İstanbul, İstanbul, Türkiye (Hybrid)
1 Month ago
ByteDance - Research Scientist in Foundation Model (Music) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
NVIDIA - Deep Learning Performance Architect

NVIDIA

Hyderabad, Telangana, India (Hybrid)
2 Months ago
Microsoft - Product Management Lead

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Senior Software Engineer, Code Coverage Tools

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Netflix - Product Manager, ML Platform: Training

Netflix

Los Gatos, California, United States (Hybrid)
6 Months ago
Google - Software Engineer III, AI/ML, YouTube Ads

Google

Mountain View, California, United States (On-Site)
1 Month ago
Google - Software Engineer

Google

Sydney, New South Wales, Australia (On-Site)
1 Month ago
Netflix - Machine Learning Software Engineer L4/L5

Netflix

United States (Remote)
4 Months ago
Google - Senior Software Engineer, Silicon System Machine Learning Acceleration

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
Google - Software Engineer (For Women in Tech Candidates)

Google

State Of Minas Gerais, Brazil (On-Site)
4 Months ago
Google - Staff Software Engineer, Network Interface Card Firmware, SmartNIC

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Google - Senior Software Engineer, AI/ML GenAI, Google Cloud AI

Google

Kirkland, Washington, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

Bonfire Studios - Senior Gameplay Animator

Bonfire Studios

California, United States (Hybrid)
1 Month ago
ByteDance - Senior Research Scientist- Foundation Model, Generative AI

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Universal Music - Senior Internal Auditor

Universal Music

Santa Monica, California, United States (On-Site)
1 Month ago
Google - Program Manager II, NPI, Cloud Supply Chain

Google

Atlanta, Georgia, United States (On-Site)
1 Month ago
Salesforce - Technical Support Engineer

Salesforce

Burlington, Massachusetts, United States (Remote)
1 Month ago
Google - Senior Data Scientist, Research, Storage Analytics

Google

New York, New York, United States (On-Site)
1 Month ago
Google - Industrial Designer, Devices and Services

Google

Mountain View, California, United States (On-Site)
1 Month ago
Epic Games - QA Engineer

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
Rivos - Silicon Logic Formal Verification - Full Time

Rivos

Santa Clara, California, United States (Hybrid)
7 Months ago
Rush Street Interactive - Executive Assistant

Rush Street Interactive

Chicago, Illinois, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Razer - Solutions Architect

Razer

Singapore (On-Site)
7 Months ago
NVIDIA - Continuous Bring Up Solution Architect

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Google - AI Sales Specialist III, Google Cloud

Google

Mexico City, Mexico City, Mexico (On-Site)
1 Month ago
Pika - Research Scientist

Pika

Palo Alto, California, United States (On-Site)
5 Months ago
Balbix - Staff AI Engineer

Balbix

Bengaluru, Karnataka, India (On-Site)
7 Months ago
NVIDIA - Senior Software Architect, AI Networking

NVIDIA

Austin, Texas, United States (Remote)
2 Months ago
Google - Head of Generative AI Specialist, Blackbelt

Google

Hyderabad, Telangana, India (On-Site)
1 Month ago
Google - Software Engineer III, Core Machine Learning, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
6 Months ago
Alphasense - Lead AI Platform Engineer

Alphasense

New York, New York, United States (On-Site)
5 Months ago
Razer - Solutions Architect

Razer

Singapore (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

London, England, United Kingdom (On-Site)

Fremont, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Reston, Virginia, United States (On-Site)

Sunnyvale, California, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Dublin, County Dublin, Ireland (On-Site)

San Jose, California, United States (On-Site)

Mexico City, Mexico City, Mexico (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug