Software Engineer, Tensor Processing Units Compiler

3 Months ago • 3-7 Years • Full Stack Development • Research & Development

Job Summary

Job Description

As a Software Engineer on the TPU Compiler team, you'll be working on the MLIR/LLVM based TPU compiler for TPUs. You will support new workloads, optimize for new models and new characteristics, as well as support new TPU hardware across multiple generations. You'll be contributing to a compiler for a novel processor designed to accelerate machine learning workloads. You'll also be compiling high-performance implementations of operations at a distributed scale, working closely with users of TPUs to improve performance/efficiency, and hardware designers to co-design future processors. You'll be investigating high-level representations to effectively program large-scale, distributed, and heterogeneous systems.
Must have:
  • Bachelor's degree or equivalent practical experience
  • 3 years of experience testing, maintaining, or launching software products
  • 1 year of experience with software design and architecture
  • 2 years of experience working with CUDA C++ application development
  • 1 year of experience with Native Code, Just-In-Time (JIT), Cross, Source-to-Source or any other type of compilers
  • 2 years of experience with data structures or algorithms
  • Experience with machine learning algorithms and tools (e.g. TensorFlow), artificial intelligence, deep learning, or natural language processing
Good to have:
  • Master's degree or PhD in Computer Science or related technical fields
  • Experience with performance, large-scale systems data analysis, visualization tools, or debugging
  • Experience with debugging correctness and performance issues at all levels of the stack
  • Experience with optimizations in mid-level and low-level architecture
  • Experience with hardware/software co-design
  • Experience in GPU integrating low-level CUDA work into higher-level frameworks (e.g., TF, JAX, PyTorch)

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • 2 years of experience working with CUDA C++ application development and 1 year of experience with Native Code, Just-In-Time (JIT), Cross, Source-to-Source or any other type of compilers.
  • 2 years of experience with data structures or algorithms, with experience with machine learning algorithms and tools (e.g. TensorFlow), artificial intelligence, deep learning, or natural language processing.

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical fields.
  • Experience with performance, large-scale systems data analysis, visualization tools, or debugging.
  • Experience with debugging correctness and performance issues at all levels of the stack.
  • Experience with optimizations in mid-level and low-level architecture.
  • Experience with hardware/software co-design.
  • Experience in GPU integrating low-level CUDA work into higher-level frameworks (e.g., TF, JAX, PyTorch).

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Our team builds the compiler which enables Tensor Processing Units (TPUs), Google's in-house custom designed processor, to accelerate machine learning and other scientific computing workloads for both internal Google customers and external Cloud customers. The team offers opportunities up and down the compiler stack, working on Low Level Virtual Machine (LLVM) as well as the Multi-Level Intermediate Representation (MLIR) middle-end.

In this role, you'll be working on the MLIR/LLVM based TPU compiler for TPUs. You will support new workloads, optimize for new models and new characteristics, as well as support new TPU hardware across multiple generations.

Google Cloud accelerates organizations’ ability to digitally transform their business with the best infrastructure, platform, industry solutions and expertise. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology – all on the cleanest cloud in the industry. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

Responsibilities

  • Contribute to a compiler for a novel processor designed to accelerate machine learning workloads. Compile high-performance implementations of operations at a distributed scale.
  • Work closely with users of TPUs to improve performance/efficiency and hardware designers to co-design future processors.
  • Investigate high-level representations to effectively program large-scale, distributed, and hetereogeneous systems.

Similar Jobs

ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Speech & Audio) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
MatchGroup - 機械学習エンジニア(Machine Learning Engineer)

MatchGroup

Tokyo, Japan (Hybrid)
4 Months ago
Rackspace - Senior MLOPs Engineer

Rackspace

United States (Remote)
4 Months ago
canva - Staff Machine Learning Engineer - User Voice

canva

Perth, Western Australia, Australia (Remote)
4 Months ago
ByteDance - Lead Research Scientist, Foundation Model, Music Intelligence

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Google - Fullstack Senior Software Engineer, Search Content Platform

Google

São Paulo, State Of São Paulo, Brazil (On-Site)
3 Months ago
Nagarro - Staff Engineer, Java

Nagarro

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Bazaar Voice - Staff Software Engineer - Full Stack, R6542

Bazaar Voice

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
paypal - Lead Software Engineer - Full stack

paypal

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Warner Bros. Discovery - Staff Software Engineer - Web (ATVE Team),Bangalore

Warner Bros. Discovery

Bengaluru, Karnataka, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Rackspace - Senior MLOPs Engineer (Canada)

Rackspace

Toronto, Ontario, Canada (Remote)
4 Months ago
ByteDance - Software Engineer in Machine Learning Systems

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
canva - Staff Machine Learning Engineer - User Voice (Remote across Australia & New Zealand)

canva

Austin, Texas, United States (Remote)
3 Months ago
ByteDance - Research Scientist, Foundation Model, Vision

ByteDance

Singapore (On-Site)
3 Months ago
Tencent - Game Research & Development Intern, Engine Research 102577

Tencent

Bellevue, Washington, United States (On-Site)
4 Months ago
Google - Software Engineer III, AI/Machine Learning, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Unity - Senior ML Engineer

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
MatchGroup - Sr. Software Engineer, Generative AI

MatchGroup

Palo Alto, California, United States (Hybrid)
4 Months ago
ByteDance - Machine Learning Engineer-Model Training Infrastructure (AML-Engine)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
TVH - Data Scientist

TVH

Pune, Maharashtra, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in London, England, United Kingdom

Foster + Partners - Motion Designer

Foster + Partners

London, England, United Kingdom (On-Site)
6 Months ago
FitXR - VR Product Manager

FitXR

United Kingdom (Remote)
6 Months ago
Trellix - Technical Account Manager

Trellix

Aylesbury, England, United Kingdom (Hybrid)
4 Months ago
Assystems - Senior ECoW / Ecologist

Assystems

Amersham, England, United Kingdom (On-Site)
4 Months ago
Social Discovery Group - Head of Brand

Social Discovery Group

United Kingdom (Remote)
4 Months ago
Rocket - Manager, Sales

Rocket

United Kingdom (Remote)
5 Years ago
The Walt Disney Company - Senior Licensing Sales Manager

The Walt Disney Company

London, England, United Kingdom (Hybrid)
3 Months ago
Morning Star - Financial Data Content Architect

Morning Star

London, England, United Kingdom (Hybrid)
5 Months ago
Kwalee - Senior Producer

Kwalee

Royal Leamington Spa, England, United Kingdom (Hybrid)
5 Months ago
Media Molecule - Senior Audio Programmer - 12 month contract

Media Molecule

London, England, United Kingdom (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Appier - IT Software Engineer

Appier

Taipei City, Taiwan (On-Site)
3 Months ago
Google - Senior Software Engineer, Labs

Google

Mountain View, California, United States (On-Site)
3 Months ago
Google - Technical Lead, Security, Google Cloud

Google

(On-Site)
3 Months ago
Next Level Business Services - Integration Lead (Full Time)

Next Level Business Services

Greensboro, North Carolina, United States (On-Site)
4 Months ago
Appier - Software Engineer, System Integration

Appier

Taipei City, Taiwan (On-Site)
3 Months ago
Yahoo - Sr Manager of Engineering, Content Management

Yahoo

United States (Remote)
3 Months ago
Visa - Sr. SW Engineer - AIOPS Developer - IRE

Visa

Singapore, Singapore (On-Site)
4 Months ago
Granicus - Software Engineer 3 - ROR

Granicus

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Playrix - Tech Lead Full Stack (Web Services)

Playrix

Portugal (Remote)
3 Months ago
Myntra - Senior Manager - Engineering

Myntra

Bengaluru, Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug