Staff Software Engineer, GPU Performance, Google Scale

1 Month ago • 8-13 Years • Artificial Intelligence • $197,000 PA - $291,000 PA

Job Summary

Job Description

This Staff Software Engineer role at Google focuses on GPU performance optimization for Google's products and services. Responsibilities include building optimizations impacting billions of users, shaping the GPU software stack (influencing model design, optimizing kernels and compilers), managing performance bottlenecks, and collaborating with various teams. The ideal candidate possesses extensive experience in software development, ML infrastructure, GPU programming, and performance tuning techniques. They will leverage Google's resources (GPUs, tools) to optimize AI accelerators and contribute to cloud business growth.
Must have:
  • 8+ years software development experience
  • 5+ years testing & launching software products
  • 5+ years ML design & infrastructure experience
  • GPU programming experience (CUDA, OpenCL)
  • Experience with compiler optimization
Good to have:
  • Experience with OpenXLA, MLIR, Triton
  • Knowledge of modern GPU architectures
  • Ability to develop performance models
  • Experience in algorithms and ML models
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details


Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
  • 5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • Experience working with GPUs.

Preferred qualifications:

  • Experience in low-level GPU programming (e.g., CUDA, OpenCL, etc.) and performance tuning techniques.
  • Experience with compiler optimization, code generation, and runtime systems for GPU architectures (e.g., OpenXLA, MLIR, Triton, etc.).
  • Experience in algorithms and ML models to leverage GPUs.
  • Knowledge of modern GPU architectures (e.g., NVIDIA, AMD, etc.), memory hierarchies, and performance bottlenecks.
  • Ability to develop and utilize performance models and benchmarks to guide optimization efforts and hardware roadmap decisions.

About the job

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

In this role, you will support the future of AI and accelerate computing for Google.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $197,000-$291,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Build optimizations that improve benchmarks, but also power Google's most critical products and services, impacting billions of users worldwide and driving cloud business growth.
  • Shape the entire GPU software stack through influencing model design, optimizing low-level kernels and compilers (e.g., OpenXLA, JAX, Triton, etc.), and bridging the gap between model developers and hardware for optimal co-design and performance.
  • Manage performance bottlenecks in tests and explore optimization techniques through Google’s unparalleled access to the latest generation of GPUs, tools, and build AI accelerators.
  • Collaborate with ML, compiler design, and systems architecture teams through internal and external partnerships, as well as open-source projects.

Similar Jobs

Virtuos - Game Programming Internship

Virtuos

Malaysia (On-Site)
1 Month ago
ByteDance - Video Analysis and Quality Algorithm Intern 2023 Summer/Fall (PHD)

ByteDance

San Jose, California, United States (On-Site)
7 Months ago
Wirewheel - Data Engineer

Wirewheel

United States (Remote)
2 Weeks ago
ByteDance - DevOps Engineer - Applied Machine Learning, Engine

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Google - Software Engineer III, Infrastructure, Google Cloud

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Month ago
Inworld AI - AI Trainer (Contractor) - Writing & Gaming

Inworld AI

Mountain View, California, United States (Remote)
2 Months ago
Google - Customer Engineer III, Applied AI, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Inworld AI - AI Trainer (Contractor) - Writing & Gaming

Inworld AI

Vancouver, British Columbia, Canada (Remote)
2 Months ago
Hedra - Applied Research Scientist

Hedra

New York, New York, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Guardian - Lead Data Scientist - Insurance

Guardian

New York, United States (Hybrid)
1 Month ago
Play Perfect - Senior Data Scientist

Play Perfect

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Weeks ago
PassiveLogic - Computational Physics Engineer

PassiveLogic

Holladay, Utah, United States (On-Site)
2 Weeks ago
Thousand Eyes - Senior Software Engineer II (Java), Alerts Platform

Thousand Eyes

San Francisco, California, United States (On-Site)
3 Weeks ago
AI Fund - Frontend Engineer

AI Fund

Taipei City, Taiwan (Hybrid)
7 Months ago
Google - Software Engineer II, Full Stack, Core

Google

Zürich, Zurich, Switzerland (On-Site)
1 Month ago
Loyalty Juggernaut - Mobile Application Developer (Android/iOS)

Loyalty Juggernaut

Hyderabad, Telangana, India (On-Site)
1 Month ago
G5 Games - C++ Gameplay Programmer

G5 Games

Yerevan, Yerevan, Armenia (Remote)
7 Months ago
ByteDance - Research Engineer Graduate (Vision AI Platform)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
N-iX - Senior C++ Engineer (High Performance Computing)

N-iX

Colombia (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

Nintendo - Senior Director, HR Business Partners

Nintendo

Redmond, Washington, United States (Hybrid)
1 Month ago
Adtran - Hand Load Assembler I

Adtran

Huntsville, Alabama, United States (On-Site)
1 Month ago
Glean - Sales Development Representative

Glean

Nashville, Tennessee, United States (Hybrid)
2 Weeks ago
Take-Two Interactive - Senior Product Designer

Take-Two Interactive

San Francisco, California, United States (Hybrid)
1 Month ago
ByteDance - Site Reliability Engineer Intern

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
ByteDance - Software Engineer Graduate (Multi Cloud CDN) - 2025 Start (BS/MS)

ByteDance

San Jose, California, United States (On-Site)
7 Months ago
Pentair - Mechanical Assembly Operator

Pentair

New Brighton, Minnesota, United States (On-Site)
2 Weeks ago
Iron Mountain - Imaging Specialist

Iron Mountain

Burlington, Massachusetts, United States (On-Site)
1 Month ago
Vercel - Software Engineer, Monetization

Vercel

San Francisco, California, United States (Hybrid)
2 Weeks ago
Zoox - Staff/Senior Staff Software Platform Engineer

Zoox

Foster City, California, United States (Hybrid)
7 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Scale AI - AI Product Manager, Generative AI

Scale AI

San Francisco, California, United States (On-Site)
7 Months ago
NVIDIA - Director, Regional Developer Relations - ROAP

NVIDIA

(Remote)
2 Months ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
4 Months ago
SparkCognition - Data Scientist

SparkCognition

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Tencent - NLP Research Intern 104493

Tencent

London, England, United Kingdom (On-Site)
5 Months ago
Meta - Software Engineer, Machine Learning

Meta

Burlingame, California, United States (On-Site)
7 Months ago
Social Discovery Group - Senior NLP Engineer

Social Discovery Group

Georgia (Remote)
7 Months ago
Meta - Visiting Senior Research Scientist

Meta

Paris, Île-de-France, France (On-Site)
7 Months ago
NVIDIA - Solutions Architect, Financial Services

NVIDIA

New Jersey, United States (Remote)
1 Month ago
Zazz - Machine Learning Engineer

Zazz

(Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

London, England, United Kingdom (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Taipei City, Taiwan (On-Site)

Zürich, Zurich, Switzerland (On-Site)

Kirkland, Washington, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Seattle, Washington, United States (On-Site)

Haryana, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug