Senior Software Engineer, Google Cloud AI

1 Month ago • 5 Years + • Full Stack Development • $166,000 PA - $244,000 PA

Job Summary

Job Description

This Senior Software Engineer role at Google Cloud AI focuses on developing and maintaining the compiler for TPUs (Tensor Processing Units). Responsibilities include writing and testing code, participating in design reviews, working with TPU users to improve performance, collaborating with hardware designers, debugging issues, and contributing to compiler improvements for machine learning workloads. The team directly impacts Google's internal and external customers, including Gemini, Ads, Search, YouTube, and Cloud customers. The role requires strong software development skills, experience with compilers, and a deep understanding of data structures and algorithms. The successful candidate will have experience optimizing heterogeneous programs at scale and be comfortable working in a fast-paced environment.
Must have:
  • 5+ years software development experience
  • Experience with compilers
  • Data structures/algorithms expertise
  • Software design and architecture experience
  • Testing and launching software products
Good to have:
  • Master's/PhD in CS or related field
  • Experience with accelerators (GPUs, DSPs)
  • Debugging at all stack levels
  • Optimizing distributed heterogeneous programs
  • C++ experience

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • Experience with compilers.

Preferred qualifications:

  • Master's degree or PhD in Computer Science, or a related technical field.
  • Experience working with accelerators such as VLIW and Vector Machines, GPUs, or DSPs.
  • Experience debugging correctness and performance issues at all levels of the stack.
  • Experience optimizing heterogeneous programs at distributed scale.
  • Experience in C++.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Our team builds the compiler which enables TPUs, Google's in-house custom designed processor, to accelerate machine learning and other scientific computing workloads for both internal Google customers and external Cloud customers. All users of TPUs use our compiler.

Team members are able to have direct impact on our production customers (Gemini, Ads, Search and YouTube, Cloud 2P/3P customers, to name a few) by improving the compiler along important dimensions such as performance and usability.

Our team is also an important part of designing the next generation of TPU hardware. Our position in the technology stack makes us well positioned to take insights from real workloads and scenarios and provide feedback to the Hardware team.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $166,000-$244,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Write and test product or system development code.
  • Participate in, or lead design reviews with peers and stakeholders to decide amongst available technologies. Work closely with users of TPUs to improve performance/efficiency and hardware designers to co-design future processors and investigating high-level representations to effectively program large-scale, distributed, and heterogeneous systems.
  • Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
  • Contribute to a compiler for a novel processor designed to accelerate machine learning workloads. Compile high-performance implementations of operations at a distributed scale.
  • Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.

Similar Jobs

Google - Student Researcher, PhD, Winter/Summer 2025

Google

(On-Site)
6 Months ago
THE GAME - Social Media Creative (Lifestyle)

THE GAME

London, England, United Kingdom (Hybrid)
2 Months ago
Google - Senior Software Engineer, Titan Platform

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
ByteDance - Software Development Engineer Graduate (Distributed NoSQL Database Systems)

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
NVIDIA - Senior Networking Architect

NVIDIA

Beijing, Beijing, China (On-Site)
1 Month ago
Daybreak Game Company LLC - Senior Software Engineer, Platform

Daybreak Game Company LLC

San Diego, California, United States (Remote)
6 Months ago
Nagarro - Associate Principal Engineer, Cloud

Nagarro

India (Remote)
7 Months ago
Microsoft - Technical Support Engineer (Microsoft Dynamics 365 CE / Power Platform)

Microsoft

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (Hybrid)
1 Month ago
Niantic - Software Engineer, Server

Niantic

Tokyo, Japan (Hybrid)
1 Month ago
Google - Engineering Manager, WAN Core

Google

Dublin, County Dublin, Ireland (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Technical Lead, Networking, Design and Automation

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
ByteDance - Algorithm Engineer - Audio Understanding

ByteDance

Singapore (On-Site)
6 Months ago
Google - Senior Staff Software Engineer, Hybrid Connectivity

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Google - Software Engineer III, Mobile (iOS)

Google

Mountain View, California, United States (On-Site)
1 Month ago
Google - Software Engineer III, Keystore, Google Cloud

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Google - Senior Software Engineer, Location and Context, Android

Google

New Taipei, New Taipei City, Taiwan (On-Site)
4 Weeks ago
Google - Software Engineer III, BigQuery Router

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Google - Software Engineer III, Full Stack, Corporate Engineering

Google

Hyderabad, Telangana, India (On-Site)
4 Weeks ago
Google - Software Engineer III, Mobile (Android), YouTube

Google

San Bruno, California, United States (On-Site)
1 Month ago
Google - Software Engineer II, Health Platform Nova

Google

Bucharest, Bucharest, Romania (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

Polygon Labs - Chief Technology Officer

Polygon Labs

United States (Remote)
2 Months ago
Next Level Business Services - Micro strategy Admin

Next Level Business Services

Plano, Texas, United States (On-Site)
7 Months ago
Google - Senior Test Engineer, Silicon Wafer

Google

Fremont, California, United States (On-Site)
1 Month ago
Nintendo - Animator (Retro Studios)

Nintendo

Austin, Texas, United States (On-Site)
6 Months ago
The Walt Disney Company - Executive Producer, Digital

The Walt Disney Company

Durham, North Carolina, United States (On-Site)
1 Month ago
Trek - Seasonal Sales Associate

Trek

Summit, New Jersey, United States (On-Site)
2 Months ago
SciPlay - Art Director

SciPlay

Cedar Falls, Iowa, United States (Hybrid)
5 Months ago
Notion - Account Executive, Commercial

Notion

San Francisco, California, United States (On-Site)
7 Months ago
Activision - Expert Software Engineer, Graphics

Activision

Santa Monica, California, United States (Remote)
1 Month ago
Immutable - Head of Customer Growth, Americas

Immutable

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Netflix - Distributed Systems Engineer (L5) - Delivery

Netflix

United States (Remote)
1 Month ago
GoMotive - Staff System Software Engineer (Superbuilder) - Embedded

GoMotive

United States (Remote)
2 Months ago
The Walt Disney Company - Senior Software Engineer - Salesforce

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Month ago
Ajmera Infotech - React Developer

Ajmera Infotech

Hyderabad, Telangana, India (On-Site)
7 Months ago
N-iX - Senior .NET Engineer

N-iX

Poland (Remote)
3 Months ago
Google - Staff Software Engineer, Infrastructure, Google Cloud

Google

Kirkland, Washington, United States (On-Site)
5 Months ago
Thatgamecompany - Full Stack Engineer

Thatgamecompany

United States (Remote)
1 Month ago
GoTo Group - Software Engineer - Foundation Security

GoTo Group

Bengaluru, Karnataka, India (On-Site)
6 Months ago
ByteDance - Service Framework Software Engineer Intern

ByteDance

Singapore (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

New York, New York, United States (On-Site)

Waterloo, Ontario, Canada (On-Site)

Taipei City, Taiwan (On-Site)

Austin, Texas, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug