Senior Software Engineer, Google Cloud AI

8 Hours ago • 5 Years + • Full Stack Development • $166,000 PA - $244,000 PA

Job Summary

Job Description

This Senior Software Engineer role at Google Cloud AI focuses on developing and maintaining the compiler for TPUs (Tensor Processing Units). Responsibilities include writing and testing code, participating in design reviews, working with TPU users to improve performance, collaborating with hardware designers, debugging issues, and contributing to compiler improvements for machine learning workloads. The team directly impacts Google's internal and external customers, including Gemini, Ads, Search, YouTube, and Cloud customers. The role requires strong software development skills, experience with compilers, and a deep understanding of data structures and algorithms. The successful candidate will have experience optimizing heterogeneous programs at scale and be comfortable working in a fast-paced environment.
Must have:
  • 5+ years software development experience
  • Experience with compilers
  • Data structures/algorithms expertise
  • Software design and architecture experience
  • Testing and launching software products
Good to have:
  • Master's/PhD in CS or related field
  • Experience with accelerators (GPUs, DSPs)
  • Debugging at all stack levels
  • Optimizing distributed heterogeneous programs
  • C++ experience

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • Experience with compilers.

Preferred qualifications:

  • Master's degree or PhD in Computer Science, or a related technical field.
  • Experience working with accelerators such as VLIW and Vector Machines, GPUs, or DSPs.
  • Experience debugging correctness and performance issues at all levels of the stack.
  • Experience optimizing heterogeneous programs at distributed scale.
  • Experience in C++.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Our team builds the compiler which enables TPUs, Google's in-house custom designed processor, to accelerate machine learning and other scientific computing workloads for both internal Google customers and external Cloud customers. All users of TPUs use our compiler.

Team members are able to have direct impact on our production customers (Gemini, Ads, Search and YouTube, Cloud 2P/3P customers, to name a few) by improving the compiler along important dimensions such as performance and usability.

Our team is also an important part of designing the next generation of TPU hardware. Our position in the technology stack makes us well positioned to take insights from real workloads and scenarios and provide feedback to the Hardware team.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $166,000-$244,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Write and test product or system development code.
  • Participate in, or lead design reviews with peers and stakeholders to decide amongst available technologies. Work closely with users of TPUs to improve performance/efficiency and hardware designers to co-design future processors and investigating high-level representations to effectively program large-scale, distributed, and heterogeneous systems.
  • Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
  • Contribute to a compiler for a novel processor designed to accelerate machine learning workloads. Compile high-performance implementations of operations at a distributed scale.
  • Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.

Similar Jobs

ByteDance - Software Engineer Intern (On-Device AI - Intelligent Creation-AI Platform)

ByteDance

San Jose, California, United States (On-Site)
2 Days ago
THE GAME - Social Creative Lifestyle

THE GAME

London, England, United Kingdom (Hybrid)
3 Weeks ago
Google - Software Engineer, Vertex GenAI, Infrastructure and Features

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
10 Hours ago
ByteDance - Algorithm Optimization Specialist / Machine Learning Engineer- Pico- San Jose

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
MyGames - Data Warehouse Engineer

MyGames

(Remote)
3 Weeks ago
Vigaet - Internship-Full stack Developer

Vigaet

Bengaluru, Karnataka, India (On-Site)
1 Year ago
USE Insider - Front-end Developer (Javascript)

USE Insider

İstanbul, İstanbul, Türkiye (On-Site)
5 Months ago
Google - Senior Software Engineer, Java and Kotlin Ecosystem, Core

Google

Mexico City, Mexico City, Mexico (On-Site)
8 Hours ago
ByteDance - Software Engineer Intern, Information System - 2025 Start

ByteDance

Dubai, Dubai, United Arab Emirates (On-Site)
3 Weeks ago
The Walt Disney Company - Lead Software Engineer (Roku Engineer)

The Walt Disney Company

Charlotte, North Carolina, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

New York, New York, United States (On-Site)
5 Months ago
Virtuos - Junior Software Engineer

Virtuos

Malaysia (On-Site)
2 Days ago
Wargaming - Game Data Analyst (World of Tanks)

Wargaming

Belgrade, Serbia (On-Site)
1 Month ago
Avathon - Software Engineering Manager

Avathon

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Google - Software Engineer, Pixel Mobile Wireless

Google

New Taipei, New Taipei City, Taiwan (On-Site)
11 Hours ago
DraftKings - Lead Data Science Engineer, Personalization and Search

DraftKings

Boston, Massachusetts, United States (On-Site)
7 Months ago
ByteDance - Video Codec Firmware Engineer - Multimedia Lab

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Rackspace Technology - Principal MLOps Engineer

Rackspace Technology

San Antonio, Texas, United States (Remote)
3 Weeks ago
Google - Software Engineer III, Infrastructure, Google Cloud Data Management

Google

New York, New York, United States (On-Site)
5 Months ago
ByteDance - Video Analysis and Quality Algorithm Intern 2023 Summer/Fall (MS)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

CharacterAI - Software Engineer, Backend

CharacterAI

Menlo Park, California, United States (On-Site)
3 Weeks ago
ByteDance - Research Scientist Graduate (Foundation Model - Generative AI) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
Patel greene - Senior Roadway Engineer

Patel greene

Orlando, Florida, United States (On-Site)
5 Months ago
Turtle Rock Studios - Senior Tools Engineer

Turtle Rock Studios

Irvine, California, United States (Remote)
1 Month ago
The Walt Disney Company - KABC Freelance Newswriters

The Walt Disney Company

Glendale, California, United States (On-Site)
5 Months ago
Next Level Business Services - Salesforce Veeva Developer

Next Level Business Services

North Chicago, Illinois, United States (On-Site)
6 Months ago
Netflix - Engineering Manager, Compute Controlplane and Capacity

Netflix

United States (Remote)
16 Hours ago
Nintendo - Senior Consumer Insights Analyst

Nintendo

Redmond, Washington, United States (Hybrid)
1 Month ago
Blitz app - Director of Product Design

Blitz app

Los Angeles, California, United States (Hybrid)
6 Months ago
NVIDIA - Senior Developer Technology Engineer, Public Sector

NVIDIA

Santa Clara, California, United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

GoTo Group - Lead Software Engineer - Engineering Platform

GoTo Group

Bengaluru, Karnataka, India (On-Site)
5 Months ago
GameChanger  - Staff Backend Engineer, Video Enablement

GameChanger

United States (Remote)
3 Weeks ago
NVIDIA - Senior Systems Software Engineer, Containers and Kubernetes

NVIDIA

California, United States (Remote)
2 Weeks ago
Nagarro - Staff Engineer, Java Fullstack

Nagarro

Colombia (Remote)
6 Months ago
Nagarro - Principal Engineer, Java Fullstack

Nagarro

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Google - Senior Software Engineer, Chrome Identity

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Days ago
ByteDance - Software Engineer

ByteDance

San Jose, California, United States (On-Site)
2 Days ago
Meta - Software Engineer, Infrastructure

Meta

Burlingame, California, United States (Remote)
5 Months ago
Google - Senior Software Engineer, Full Stack, Google Ads User Objectives

Google

Mountain View, California, United States (On-Site)
9 Hours ago
Meta - Software Engineer, Infrastructure

Meta

London, England, United Kingdom (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Bucharest, Bucharest, Romania (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Bengaluru, Karnataka, India (On-Site)

Sunnyvale, California, United States (On-Site)

Sunnyvale, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug