Staff Software Engineer, AI/ML Compute

4 Days ago • 8-11 Years • Artificial Intelligence • $197,000 PA - $291,000 PA

Job Summary

Job Description

Google seeks a Staff Software Engineer for AI/ML Compute. Responsibilities include partnering with customers to benchmark AI/ML model performance on Google Cloud, collaborating with internal infrastructure teams, conducting performance profiling and debugging, and designing specialized ML solutions. The role requires 8+ years of software development experience, 5+ years in product testing and launch, and 3+ years in ML infrastructure experience. Up to 10% travel may be required. The position involves working with demanding AI workloads and leveraging advanced ML infrastructure to enhance support for Google's services and Cloud customers.
Must have:
  • 8+ years software development
  • 5+ years product testing & launch
  • 3+ years ML infrastructure experience
  • Expertise in model deployment, evaluation, optimization
  • Proficient in cloud services (GCP preferred)
Good to have:
  • Master's/PhD in related field
  • Technical leadership experience
  • Experience in complex organizations
  • Direct customer collaboration
  • Data structures/algorithms expertise
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details


Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing, and launching software products.
  • 3 years of experience with software design and architecture.
  • 3 years of experience with ML infrastructure, including model deployment, evaluation, optimization, data processing, and debugging.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 8 years of experience with data structures/algorithms.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.
  • Proven track record of collaborating directly with customers and field teams
  • Proficient in cloud services such as Compute, Storage, and Networking, preferably on GCP.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $197,000-$291,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Partner with customers to benchmark AI/ML model performance on Google Cloud compute and overall infrastructure.
  • Collaborate with internal infrastructure teams like Storage, Networking to enhance support for demanding AI workloads.
  • Conduct in-depth performance profiling, debugging, and troubleshooting of training and inference workloads.
  • Design and implement specialized ML solutions, effectively leveraging advanced ML infrastructure.
  • Role may include up to 10% business-related travel to the customers and partners within the US.

Similar Jobs

Zazz - Machine Learning Engineer

Zazz

(Remote)
2 Months ago
Meta - Research Scientist, Machine Learning (PhD)

Meta

Sunnyvale, California, United States (On-Site)
5 Months ago
QUANTIC DREAM - Data Analyst (F/M/NB)

QUANTIC DREAM

Paris, Île-de-France, France (Hybrid)
5 Months ago
Google - Software Engineer, Cloud Console Platform, Front End

Google

New York, New York, United States (On-Site)
3 Days ago
Haptic - Senior AI/ML Engineer

Haptic

Paris, Île-de-France, France (Remote)
3 Months ago
Glean - Software Engineer, Machine Learning

Glean

Palo Alto, California, United States (On-Site)
5 Months ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Seattle, Washington, United States (On-Site)
5 Months ago
Google - Software Engineer, Machine Learning Compilers

Google

Bengaluru, Karnataka, India (On-Site)
4 Days ago
bito - Backend Developer

bito

Pune, Maharashtra, India (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Software Engineer, Runtime, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
4 Days ago
NVIDIA - Senior Circuit Methodology Engineer

NVIDIA

California, United States (Hybrid)
1 Month ago
ByteDance - Applied Scientist Intern (Computational Modeling & Optimization)

ByteDance

San Jose, California, United States (On-Site)
4 Weeks ago
Google - Software Engineer III, AI/ML GenAI, Google Cloud Platforms

Google

Sunnyvale, California, United States (On-Site)
5 Days ago
Google - Senior Software Engineer, AI/ML, Google Cloud AI

Google

Kirkland, Washington, United States (On-Site)
3 Months ago
Google - Software Developer III, Site Reliability Development

Google

Waterloo, Ontario, Canada (On-Site)
4 Days ago
Virtuos - Senior Technical Artist

Virtuos

Poland (Hybrid)
4 Weeks ago
Google - Staff Software Engineer, Technical Infrastructure

Google

Hyderabad, Telangana, India (On-Site)
4 Days ago
Google - Software Engineer III, Security Endpoint Agents, Core

Google

Dublin, County Dublin, Ireland (On-Site)
4 Days ago
ByteDance - Software Development Engineer (SDN Traffic Intelligence & Control)

ByteDance

Seattle, Washington, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Kirkland, Washington, United States

ByteDance - Research Scientist in Foundation Model (Speech & Audio Generation) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Google - Senior Software Engineer, Infrastructure, Google Cloud Networking

Google

Sunnyvale, California, United States (On-Site)
3 Months ago
SKYDANCE - Assistant to Producer and Director

SKYDANCE

Santa Monica, California, United States (Hybrid)
2 Weeks ago
Google - Product Engineer, ARM Servers and Storage Systems

Google

Sunnyvale, California, United States (On-Site)
5 Days ago
DraftKings - VIP Host

DraftKings

United States (Remote)
2 Weeks ago
Google - Security Manager, Google Data Centers

Google

Council Bluffs, Iowa, United States (On-Site)
1 Day ago
ByteDance - Senior/Tech Lead AI/LLM Network Software Development Engineer

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
2K - PC Compatibility Technician

2K

Las Vegas, Nevada, United States (On-Site)
1 Month ago
Super - Senior Full-Stack Software Engineer ( Remote! )

Super

Chicago, Illinois, United States (Remote)
5 Months ago
Google - Senior Software Engineer, Google Ads

Google

Mountain View, California, United States (On-Site)
4 Days ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Google - Staff Software Engineer

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
4 Days ago
Match Group - Senior ML Platform Engineer

Match Group

New York, New York, United States (Hybrid)
6 Months ago
PlayStation Global - Machine Learning Engineer

PlayStation Global

London, England, United Kingdom (On-Site)
4 Days ago
Google - Silicon Design Verification Engineer, TPU, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
3 Days ago
Meta - Software Engineer, Machine Learning

Meta

Fremont, California, United States (Remote)
5 Months ago
Bragg - AI/ML Engineer

Bragg

Ljubljana, Ljubljana, Slovenia (Hybrid)
1 Week ago
Microsoft - Member of Technical Staff, AI - Pre-Training

Microsoft

Redmond, Washington, United States (On-Site)
4 Weeks ago
ByteDance - Research Scientist Graduate (Foundation Model, Video Generation) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Level AI - Backend Engineer - Customer Engineering

Level AI

Noida, Uttar Pradesh, India (Hybrid)
6 Months ago
Eleven Labs - Machine Learning Researcher

Eleven Labs

Germany (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Fremont, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Atlanta, Georgia, United States (On-Site)

San Francisco, California, United States (On-Site)

Fremont, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug