Senior Software Engineer, GPU Performance, Google Scale

1 Day ago • 5-8 Years • Artificial Intelligence • $166,000 PA - $244,000 PA

Job Summary

Job Description

As a Senior Software Engineer, GPU Performance at Google, you'll build optimizations for critical products and services, impacting billions of users. You'll shape the GPU software stack, optimizing low-level kernels and compilers (OpenXLA, JAX, Triton, etc.). Responsibilities include managing performance bottlenecks, exploring optimization techniques, and collaborating with experts in ML, compiler design, and systems architecture. You'll leverage Google's access to the latest GPUs and tools to drive significant cloud business growth and influence next-generation GPU architectures.
Must have:
  • 5+ years software development experience
  • 3+ years ML infrastructure experience
  • GPU experience
  • Software design & architecture experience
  • Experience testing and launching software products
Good to have:
  • Low-level GPU programming (CUDA, OpenCL)
  • Compiler optimization experience
  • Experience with performance modeling and benchmarking
  • Knowledge of modern GPU architectures
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details


Minimum qualifications:

  • Bachelor’s degree or equivalent practice experience.
  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
  • Experience working with GPUs.

Preferred qualifications:

  • Experience in algorithms and ML models to leverage GPUs effectively.
  • Experience in low-level GPU programming (e.g., CUDA, OpenCL, etc.) and performance tuning techniques.
  • Experience with compiler optimization, code generation, and runtime systems for GPU architectures (e.g., OpenXLA, MLIR, Triton, etc).
  • Ability to develop and utilize sophisticated performance models and benchmarks to guide optimization efforts and hardware roadmap decisions.
  • Knowledge of modern GPU architectures (e.g., NVIDIA, AMD, etc.), memory hierarchies, and performance bottlenecks.

About the job

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Google is known for its pioneering work with TPUs, GPUs are equally vital and rapidly expanding within its machine learning infrastructure. GPUs are indispensable to Google’s ever-evolving landscape for strategic, pragmatic, and performance-driven reasons ensuring performance for ML models, adapting to ML workloads, achieving results, and influencing next-generation GPU architectures through strategic partnerships. In recognition of hardware as a strength, Google’s Core ML organization is heavily invested in growing a powerhouse team of GPU experts.

In this role, you will shape the future of AI and accelerate computing for Google.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $166,000-$244,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Build optimizations that improve benchmarks, but also power Google's most critical products and services, impacting billions of users worldwide and driving significant cloud business growth.
  • Shape the entire GPU software stack through influencing model design, optimizing low-level kernels and compilers (e.g., OpenXLA, JAX, Triton, etc.), and bridging the gap between model developers and hardware for optimal co-design and performance.
  • Manage performance bottlenecks in tests and explore groundbreaking optimization techniques through Google’s unparalleled access to the latest generation of GPUs, tools, and over a decade of experience in building AI accelerators.
  • Collaborate with some of the resourceful minds in ML, compiler design, and systems architecture through internal and external partnerships, as well as open-source projects.

Similar Jobs

NVIDIA - Silicon Performance, Power, and Binning Tools Engineer

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Month ago
Google - Senior Software Engineer, AI/ML, Google Cloud Technical Infrastructure

Google

Kirkland, Washington, United States (On-Site)
1 Week ago
Google - Senior Software Engineer, Titan Agent Framework

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Week ago
Tencent - Research Intern

Tencent

Tokyo, Japan (On-Site)
1 Week ago
Virtuos - Game Programming Internship

Virtuos

Malaysia (On-Site)
1 Month ago
Netomi - Implementation Consultant

Netomi

United States (Remote)
6 Months ago
Cricketpedia - AI Engineer

Cricketpedia

Gurugram, Haryana, India (Remote)
2 Years ago
Google - Software Engineer III, AI/ML

Google

Hyderabad, Telangana, India (On-Site)
1 Week ago
NetEase Games - Game AI Research Leader

NetEase Games

Singapore (On-Site)
2 Months ago
Google - Customer Engineer IV, AI/ML, HCLS, Google Cloud

Google

Kirkland, Washington, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

DNEG - Software Developer – 2D Imaging and Nuke Tools

DNEG

Chennai, Tamil Nadu, India (On-Site)
1 Month ago
Google - Software Engineer III, Google TV, Experience, Monetization

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Hedra - Machine Learning Engineer (CUDA)

Hedra

New York, New York, United States (On-Site)
1 Month ago
Blind Squirrel Games - Sr. Generalist Engineer, Austin

Blind Squirrel Games

Austin, Texas, United States (Hybrid)
1 Month ago
NVIDIA - Senior Digital Circuit Design Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Google - Staff Software Engineer

Google

Pune, Maharashtra, India (On-Site)
1 Week ago
Regent Craft - Flight Controls Engineering Intern

Regent Craft

North Kingstown, Rhode Island, United States (On-Site)
6 Months ago
Google - Software Engineer III, Infrastructure, Google Cloud

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Week ago
ByteDance - Research Scientist Graduate (Foundation Model - Vision and Language)

ByteDance

Seattle, Washington, United States (On-Site)
2 Weeks ago
Inkittt - Improv Comedian/Host

Inkittt

San Francisco, California, United States (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

ByteDance - Research Scientist Graduate (Multimodal Interaction and World Model - Pre-Training)

ByteDance

San Jose, California, United States (On-Site)
2 Weeks ago
Google - Strategy and Operations Senior Associate

Google

San Francisco, California, United States (On-Site)
1 Week ago
ByteDance - Senior Technical Lead - Edge Cloud Infrastructure - San Jose / Seattle / Boston

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Network Engineer, Optical Long-Haul and Submarine

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
Google - Staff Software Engineer, AI/ML Computer Vision

Google

Mountain View, California, United States (On-Site)
1 Week ago
Google - ASIC Engineer, IP Design, Silicon

Google

Mountain View, California, United States (On-Site)
1 Week ago
Samsung Semiconductor - Principal Engineer, Device Modeling

Samsung Semiconductor

San Jose, California, United States (On-Site)
3 Weeks ago
Google - Vice President, Product Management and Engagement, Core Developer

Google

Kirkland, Washington, United States (On-Site)
1 Week ago
Trackman - Range Sales Manager - Atlantic Region

Trackman

Connecticut, United States (Hybrid)
1 Month ago
Studio Wildcard - Technical Artist

Studio Wildcard

Redmond, Washington, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

ByteDance - Software Development Engineer - Large Language Models, AML

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Google - Cloud Product Strategy and Operations Lead

Google

Kirkland, Washington, United States (On-Site)
1 Week ago
Microsoft - Member of Technical Staff, AI - Multimodal

Microsoft

(On-Site)
2 Weeks ago
NVIDIA - Senior Technical Program Manager, AI Software and Model Development

NVIDIA

Santa Clara, California, United States (Hybrid)
3 Weeks ago
NetEase Games - Game AI Research Leader

NetEase Games

Singapore (On-Site)
2 Months ago
Google - Customer Engineer II, Cloud AI, Google Cloud

Google

San Francisco, California, United States (On-Site)
1 Week ago
Netflix - Machine Learning Engineer (L5) - Content and Studio

Netflix

United States (Remote)
1 Week ago
Google - Product Manager, Assurance Evaluations, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
1 Week ago
Zoox - Senior/Staff Software Engineer - Simulator

Zoox

Seattle, Washington, United States (Hybrid)
6 Months ago
Zoox - Senior Software Engineer - High Performance Computing

Zoox

Seattle, Washington, United States (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Dublin, County Dublin, Ireland (On-Site)

New York, New York, United States (On-Site)

Waterloo, Ontario, Canada (On-Site)

Taipei City, Taiwan (On-Site)

San Francisco, California, United States (On-Site)

Saint-Ghislain, Wallonia, Belgium (On-Site)

Bengaluru, Karnataka, India (On-Site)

Austin, Texas, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug