Staff Software Engineer, ML Compilers

2 Days ago • 8 Years + • Research & Development

Job Summary

Job Description

This Staff Software Engineer role focuses on ML compilers for Google's EdgeTPU. Responsibilities include analyzing and improving compiler quality and performance, developing parallelization and scheduling algorithms, collaborating with architects on future accelerator designs, efficiently mapping generative AI models to EdgeTPU instructions, and working with product managers and researchers to identify key ML trends. The ideal candidate will have extensive experience in software development, testing, and launching software products, along with expertise in compilers, ML model development, and C++. Experience with MLIR or LLVM is highly preferred. The role involves close collaboration with ML model developers, researchers, and hardware/software teams to accelerate the transition of research to user experiences on the EdgeTPU.
Must have:
  • 8+ years software development experience
  • 5+ years testing & launching software
  • Compiler experience (parallelization)
  • C++ programming
  • ML model development expertise
Good to have:
  • PhD in CS or related field
  • MLIR/LLVM experience
  • Accelerator-based compiler development
  • Optimizing ML models for inference
  • Hardware-software codesign

Job Details


Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing, and launching software products.
  • 3 years of experience with software design and architecture.
  • Experience with compilers (parallelization, etc.) or ML model development and C++ programming language.

Preferred qualifications:

  • PhD in Computer Science, or a related field.
  • Experience in Multi-Level Intermediate Representation (MLIR) or Low Level Virtual Machines (LLVM).
  • Experience with compiler development in the context of accelerator-based architectures.
  • Experience with optimizing ML models for inference.
  • Experience with hardware-software codesign.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

Responsibilities

  • Work as part of the EdgeTPU compiler team, including analyzing and improving the compiler quality and performance on optimization decisions, correctness and compilation time.
  • Develop parallelization and scheduling algorithms to optimize compute and data movement costs to execute ML workloads on the EdgeTPU.
  • Work with EdgeTPU architects to design future accelerators, the hardware/software interface, and co-optimizations of the next generation EdgeTPU architectures.
  • Work on efficient mapping of generative AI models and other key workloads into EdgeTPU instructions through the compiler.
  • Work with Product Managers, Researchers in identifying key ML trends, future use cases, etc. Closely collaborate with ML model developers, researchers, and EdgeTPU hardware/software teams to accelerate the transition from research ideas to user experiences running on the EdgeTPU.

Similar Jobs

Google - Senior Hardware Validation Engineer, Servers and Compute, Platforms

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
ByteDance - Machine Learning Engineer Graduate (AML Algorithm) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Google - Software Engineer III, Engineering Productivity, Health

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
Converse.AI - Senior Software Engineer

Converse.AI

Bengaluru, Karnataka, India (On-Site)
2 Years ago
NVIDIA - Senior Chip Design Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
Fluence - Sr. Software Architect (m/f/d)

Fluence

Erlangen, Bavaria, Germany (On-Site)
6 Months ago
ByteDance - SoC System Software Architect

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Google - Staff Software Engineer, AI/ML Computer Vision

Google

Mountain View, California, United States (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Wargaming - Game Developer

Wargaming

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Month ago
Jane Street - Computer Science Instructor

Jane Street

New York, New York, United States (On-Site)
7 Hours ago
Google - Software Engineer III, Engineering Productivity, Google Cloud Platforms

Google

Seattle, Washington, United States (On-Site)
2 Days ago
Brainhunter - Duck Creek Developer

Brainhunter

Jersey City, New Jersey, United States (On-Site)
7 Years ago
Google - Senior Software Engineer, ChromeOS, Security

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
2 Days ago
ByteDance - Senior Algorithm Engineer, Trust and Safety

ByteDance

Singapore (On-Site)
6 Months ago
ByteDance - Product Operations - Search Ads Team

ByteDance

Tokyo, Japan (On-Site)
2 Weeks ago
ByteDance - Software Engineer - Machine Learning Training

ByteDance

Singapore (On-Site)
2 Weeks ago
Converse.AI - Senior Software Engineer

Converse.AI

Bengaluru, Karnataka, India (On-Site)
2 Years ago
Google - Staff Software Engineer, Infrastructure, Google Cloud Compute

Google

Seattle, Washington, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New Taipei, New Taipei City, Taiwan

NVIDIA - Senior Mechanical Application Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
1 Week ago
Crypto - Senior Designer (2D/3D Motion)

Crypto

Taipei City, Taiwan (Remote)
9 Months ago
Google - ASIC Power Architect, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Weeks ago
Keywords Studios - Subtitling Project Coordinator - Asia

Keywords Studios

Taipei City, Taiwan (Hybrid)
2 Weeks ago
Google - Customer Engineer, Google Cloud

Google

Taipei City, Taiwan (On-Site)
2 Weeks ago
Trend Micro - Sr. Data Scientist (AI Lab)

Trend Micro

Taipei City, Taiwan (On-Site)
7 Months ago
Rivos - SOC Static Timing Analysis Engineer - Full Time

Rivos

Hsinchu, Hsinchu City, Taiwan (On-Site)
6 Months ago
Cadence - Lead Product Engineer

Cadence

Hsinchu, Hsinchu City, Taiwan (On-Site)
7 Months ago
Google - Software Engineering Manager, AICore, Applied ML

Google

Taipei City, Taiwan (On-Site)
2 Weeks ago
Google - Staff Software Engineer, Pixel Performance

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Google - Senior Staff Software Engineer, Google Cloud

Google

Hyderabad, Telangana, India (On-Site)
5 Months ago
Google - Staff Software Engineer, AI/ML Recommendations, Rankings, Predictions, YouTube

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
NVIDIA - Senior Malware Research Architect

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Riot Games - Principal Software Engineer, Product Tech-Lead - Unpublished R&D Product

Riot Games

Dublin, County Dublin, Ireland (On-Site)
5 Months ago
Netflix - Engineering Manager, Delivery Engineering

Netflix

United States (On-Site)
6 Months ago
NVIDIA - Digital Circuit Design Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
Microsoft - Technical Support Engineer

Microsoft

Hyderabad, Telangana, India (Hybrid)
3 Days ago
N-iX - Senior Project Manager with Embedded Background

N-iX

Ukraine (Hybrid)
2 Weeks ago
Easygo - Software Engineering Manager - Kick

Easygo

Melbourne, Victoria, Australia (On-Site)
5 Months ago
ByteDance - PLL (Phase-Locked Loop) Analog/Mixed Signal Designer

ByteDance

San Diego, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug