Senior Software Engineer, Google Cloud AI

1 Week ago • 5 Years + • Full Stack Development • $166,000 PA - $244,000 PA

Job Summary

Job Description

This Senior Software Engineer role at Google Cloud AI focuses on developing and maintaining the compiler for TPUs (Tensor Processing Units). Responsibilities include writing and testing code, participating in design reviews, working with TPU users to improve performance, collaborating with hardware designers, debugging issues, and contributing to compiler improvements for machine learning workloads. The team directly impacts Google's internal and external customers, including Gemini, Ads, Search, YouTube, and Cloud customers. The role requires strong software development skills, experience with compilers, and a deep understanding of data structures and algorithms. The successful candidate will have experience optimizing heterogeneous programs at scale and be comfortable working in a fast-paced environment.
Must have:
  • 5+ years software development experience
  • Experience with compilers
  • Data structures/algorithms expertise
  • Software design and architecture experience
  • Testing and launching software products
Good to have:
  • Master's/PhD in CS or related field
  • Experience with accelerators (GPUs, DSPs)
  • Debugging at all stack levels
  • Optimizing distributed heterogeneous programs
  • C++ experience

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • Experience with compilers.

Preferred qualifications:

  • Master's degree or PhD in Computer Science, or a related technical field.
  • Experience working with accelerators such as VLIW and Vector Machines, GPUs, or DSPs.
  • Experience debugging correctness and performance issues at all levels of the stack.
  • Experience optimizing heterogeneous programs at distributed scale.
  • Experience in C++.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Our team builds the compiler which enables TPUs, Google's in-house custom designed processor, to accelerate machine learning and other scientific computing workloads for both internal Google customers and external Cloud customers. All users of TPUs use our compiler.

Team members are able to have direct impact on our production customers (Gemini, Ads, Search and YouTube, Cloud 2P/3P customers, to name a few) by improving the compiler along important dimensions such as performance and usability.

Our team is also an important part of designing the next generation of TPU hardware. Our position in the technology stack makes us well positioned to take insights from real workloads and scenarios and provide feedback to the Hardware team.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $166,000-$244,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Write and test product or system development code.
  • Participate in, or lead design reviews with peers and stakeholders to decide amongst available technologies. Work closely with users of TPUs to improve performance/efficiency and hardware designers to co-design future processors and investigating high-level representations to effectively program large-scale, distributed, and heterogeneous systems.
  • Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
  • Contribute to a compiler for a novel processor designed to accelerate machine learning workloads. Compile high-performance implementations of operations at a distributed scale.
  • Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.

Similar Jobs

NVIDIA - Senior Network Algorithms Architect

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Zoox - Software Engineering  - Returnship

Zoox

Foster City, California, United States (Hybrid)
6 Months ago
Google - Staff Software Engineer, GPU Performance, Google Scale

Google

Kirkland, Washington, United States (On-Site)
6 Days ago
Activision - Senior Expert Graphics Engineer (VFX)

Activision

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Month ago
PlayStation Global - Senior Machine Learning Graphics Engineer

PlayStation Global

London, England, United Kingdom (Hybrid)
2 Weeks ago
Cequence Security - Data plane Engineer

Cequence Security

Pune, Maharashtra, India (On-Site)
6 Months ago
Google - Software Engineer III, Control Plane, Google Cloud

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Week ago
Corsair - Senior Front-End Engineer

Corsair

Munich, Bavaria, Germany (Hybrid)
1 Week ago
Google - Staff Software Engineer, Infrastructure, Google Cloud Platforms

Google

Sunnyvale, California, United States (On-Site)
1 Week ago
Every matrix - Senior Software Engineer (Node.js + Vue.js)

Every matrix

Zagreb, Croatia (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Research Scientist Graduate (Foundation Models for Science - ByteDance Research) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Security Software Engineer

ByteDance

Singapore (On-Site)
5 Months ago
NVIDIA - Senior Circuit Design Engineer

NVIDIA

California, United States (Hybrid)
2 Months ago
ByteDance - Technical Expert, Large Language Model

ByteDance

Singapore (On-Site)
5 Months ago
Netflix - Data Scientist (L5) - Product Promotion & Algorithm Performance

Netflix

Los Gatos, California, United States (On-Site)
2 Months ago
Google - Software Engineer II, Incident Response Management, Cloud

Google

London, England, United Kingdom (On-Site)
1 Week ago
NVIDIA - Senior Developer Technology Engineer, Public Sector

NVIDIA

Santa Clara, California, United States (Remote)
1 Month ago
Argus Labs - Software Engineer (Infrastructure/Backend)

Argus Labs

Indonesia (Remote)
1 Month ago
Salesforce - Associate Data Analytics - Business Intelligence

Salesforce

Dallas, Texas, United States (On-Site)
2 Weeks ago
Google - Quantum Algorithms Numerics Specialist

Google

San Francisco, California, United States (On-Site)
6 Days ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

Microsoft - Member of Technical Staff, Infrastructure Engineer

Microsoft

Mountain View, California, United States (Hybrid)
1 Month ago
Nagarro - Associate Engineer

Nagarro

Atlanta, Georgia, United States (On-Site)
6 Months ago
Glean - Data Science, Product

Glean

Palo Alto, California, United States (On-Site)
5 Months ago
Tencent - Workday Business Analyst -  HCM

Tencent

Palo Alto, California, United States (On-Site)
5 Months ago
The Walt Disney Company - Lead Media Systems Engineer

The Walt Disney Company

Los Angeles, California, United States (On-Site)
2 Months ago
Google - Lead Group Product Manager, Tensor SoC TPU

Google

Mountain View, California, United States (On-Site)
4 Days ago
ByteDance - Facilities Lead, AMS

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Next Level Business Services - web developer

Next Level Business Services

Boston, Massachusetts, United States (On-Site)
6 Months ago
Interactive Brokers - Entry Level Career Opportunities in Finance & Operation

Interactive Brokers

Greenwich, Connecticut, United States (On-Site)
6 Months ago
AI Fund - Head of Engineering

AI Fund

United States (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Google - Senior Software Engineer, YouTube

Google

San Bruno, California, United States (On-Site)
1 Week ago
Rockstar Games - Software Engineer (GO), FiveM (Mid/Senior)

Rockstar Games

London, England, United Kingdom (On-Site)
1 Week ago
Google - Software Engineer III, Quantum

Google

Mountain View, California, United States (On-Site)
1 Week ago
Google - Staff Software Engineer, Java and Kotlin Ecosystem

Google

Mexico City, Mexico City, Mexico (On-Site)
1 Week ago
Google - Product Manager, Serverless

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
WebFX - Web Designer

WebFX

Philippines (Remote)
3 Weeks ago
PwC - Associate – Power Platform -Ms Dynamics– Advisory  -Chennai

PwC

Chennai, Tamil Nadu, India (On-Site)
6 Months ago
Google - Software Engineer II, Android Wear Google Messages

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Week ago
Google - Senior Software Engineer, Full Stack, Core

Google

Hyderabad, Telangana, India (On-Site)
1 Week ago
Google - Software Engineering Manager, Security Intelligence Platform

Google

San Francisco, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Fremont, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Atlanta, Georgia, United States (On-Site)

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug