Senior Staff Software Engineer, GPU Performance, Google Scale

1 Month ago • 8-8 Years • Artificial Intelligence • $248,000 PA - $349,000 PA

Job Summary

Job Description

This Senior Staff Software Engineer role focuses on GPU performance at Google scale. Responsibilities include architecting accelerated computing, building optimizations for critical products and services, shaping the GPU software stack (OpenXLA, JAX, Triton), managing performance bottlenecks, and collaborating cross-functionally. The role requires expertise in GPU programming, compiler optimization, and ML model optimization for GPU architectures. The engineer will impact users and drive significant cloud business by improving benchmarks and bridging the gap between model developers and hardware for optimal co-design and performance.
Must have:
  • 8+ years software development experience
  • 7+ years leading technical projects, ML design, and working with industry-scale ML infrastructure
  • 5+ years testing and launching software products
  • GPU programming experience
  • Compiler optimization experience
Good to have:
  • Experience with OpenXLA, MLIR, Triton
  • Knowledge of CUDA, OpenCL
  • Understanding of modern GPU architectures
  • Ability to develop performance models and benchmarks
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details


Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 7 years of experience leading technical project strategy, ML design, and working with industry-scale ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
  • Experience working with GPUs.

Preferred qualifications:

  • Experience with compiler optimization, code generation, and runtime systems for GPU architectures (e.g., OpenXLA, MLIR, Triton, etc.).
  • Knowledge of low-level GPU programming (e.g., CUDA, OpenCL, etc.) and performance tuning techniques.
  • Understanding of modern GPU architectures (e.g., NVIDIA, AMD, etc.), memory hierarchies, and performance bottlenecks.
  • Ability to tailor algorithms and ML models to utilize GPU strengths.
  • Ability to develop and utilize performance models and benchmarks to guide optimization efforts and hardware roadmap decisions.

About the job

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Graphics Processing Unit (GPUs) are indispensable to Google’s ever-evolving landscape for strategic, pragmatic, and performance-driven reasons, ensuring top performance for our Machine Learning models, adapting to machine learning workloads, achieving results, and influencing next-generation GPU architectures via strategic partnerships. While known for pioneering work with the Tensor Processing Unit (TPUs), GPUs are an important and rapidly expanding frontier within Google's machine learning infrastructure.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $248,000-$349,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Help architect the future of accelerated computing.
  • Build optimizations that improve benchmarks, and power Google's most critical products and services, impacting users and driving significant cloud business.
  • Shape the entire GPU software stack through influencing model design, optimizing low-level kernels and compilers (OpenXLA, JAX, Triton), and bridging the gap between model developers and hardware for optimal co-design and performance.
  • Manage challenging performance bottlenecks and explore optimization techniques through Google’s access to the latest generation of GPUs, tooling, and experience building AI accelerators.
  • Collaborate cross-functionally with machine learning, compiler design, and systems architecture through internal and external partnerships, as well as open-source projects.

Similar Jobs

Google - Software Engineer III, Google Cloud Global Networking

Google

Atlanta, Georgia, United States (On-Site)
5 Months ago
Hike - Sr. SDE Backend

Hike

(Remote)
3 Weeks ago
Whoop - Data Scientist I (Women's Health)

Whoop

Boston, Massachusetts, United States (On-Site)
3 Months ago
Google - Software Engineer II, Composer UI

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Saama Technologies,  Inc  - NLP Engineer

Saama Technologies, Inc

(Remote)
3 Months ago
Twitch - Sr. Applied Scientist

Twitch

San Francisco, California, United States (On-Site)
2 Months ago
Electronic Arts - Senior Manager, Generative AI Software Engineering

Electronic Arts

Orlando, Florida, United States (On-Site)
1 Month ago
Google - Software Engineer III, AI/ML, Platforms and Devices

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Google - AI Sales Specialist III, Google Cloud

Google

Mexico City, Mexico City, Mexico (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Adyen - Senior Machine Learning Scientist

Adyen

Amsterdam, North Holland, Netherlands (On-Site)
1 Month ago
Google - AICore Software Engineer

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Veeam Software - Junior/Middle Application Security Engineer

Veeam Software

Lisbon, Lisbon, Portugal (On-Site)
4 Weeks ago
Blitz app - Senior Data Scientist

Blitz app

(Remote)
3 Months ago
Aesir Interactive - Unreal Engine Programmer Games (Regular/ Senior) (f/m/d)

Aesir Interactive

Munich, Bavaria, Germany (Hybrid)
9 Months ago
Velotio Technologies - Senior Engineer (ROR)

Velotio Technologies

Pune, Maharashtra, India (Remote)
2 Months ago
ByteDance - Product Operations, Search Ads AI Data Service - Trust & Safety

ByteDance

Pasig, Metro Manila, Philippines (On-Site)
1 Month ago
Fictiv - Manufacturing Engineer

Fictiv

Guangzhou, Guangdong Province, China (On-Site)
1 Month ago
Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

Washington, District Of Columbia, United States (On-Site)
6 Months ago
Xogar Games - Unreal Game Developer

Xogar Games

Bengaluru, Karnataka, India (On-Site)
1 Year ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

Nintendo - Intern - Corporate Social Responsibility

Nintendo

Redmond, Washington, United States (On-Site)
7 Months ago
1000heads - Senior Producer

1000heads

New York, United States (Hybrid)
2 Weeks ago
ByteDance - Software Development Engineer, Network Automation

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Mattel  Inc  - American Girl Restaurant Host (Seasonal)

Mattel Inc

Chicago, Illinois, United States (On-Site)
1 Month ago
Rocket Science - Bookkeeper (Part-Time)

Rocket Science

Albany, New York, United States (Hybrid)
2 Months ago
Google - Software Engineer, Android Graphics

Google

Mountain View, California, United States (On-Site)
1 Month ago
On Location - Customer Service Representative

On Location

Dallas, Texas, United States (Hybrid)
2 Months ago
VVater - Electrical Engineer

VVater

Austin, Texas, United States (On-Site)
1 Month ago
Sbm management - Custodial Lead

Sbm management

Salt Lake City, Utah, United States (On-Site)
1 Month ago
Thatgamecompany - General Art

Thatgamecompany

United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

ByteDance - Solutions Architect

ByteDance

Gurugram, Haryana, India (On-Site)
2 Months ago
Google - Kaggle Staff Software Engineer, AI/ML

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Ubisoft - Senior Software Engineer - AI Applications

Ubisoft

Saint-Mandé, Île-de-France, France (Hybrid)
2 Months ago
Spell Brush - AI Anime Researcher

Spell Brush

Tokyo, Japan (On-Site)
2 Months ago
Meta - Software Engineer, Systems ML - SW/HW Co-design

Meta

Menlo Park, California, United States (Remote)
6 Months ago
Meta - Software Engineer, Systems ML - SW/HW Co-design

Meta

Austin, Texas, United States (On-Site)
6 Months ago
Canva - Senior Computer Vision Engineer - Photo AI

Canva

Prague, Czechia (Remote)
4 Months ago
NVIDIA - Engineering Manager, AI Developer Technology

NVIDIA

Austin, Texas, United States (On-Site)
2 Months ago
Google - Senior ML Systems Engineer, AICore

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Google - Senior Software Engineer, AI/ML GenAI, Google Cloud

Google

Seattle, Washington, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Taipei City, Taiwan (On-Site)

Zürich, Zurich, Switzerland (On-Site)

Kirkland, Washington, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug