Staff Software Engineer, ML Compilers

23 Hours ago • 8 Years + • Research & Development

Job Summary

Job Description

This Staff Software Engineer role focuses on ML compilers for Google's EdgeTPU. Responsibilities include analyzing and improving compiler quality and performance, developing parallelization and scheduling algorithms, collaborating with architects on future accelerator designs, efficiently mapping generative AI models to EdgeTPU instructions, and working with product managers and researchers to identify key ML trends. The ideal candidate will have extensive experience in software development, testing, and launching software products, along with expertise in compilers, ML model development, and C++. Experience with MLIR or LLVM is highly preferred. The role involves close collaboration with ML model developers, researchers, and hardware/software teams to accelerate the transition of research to user experiences on the EdgeTPU.
Must have:
  • 8+ years software development experience
  • 5+ years testing & launching software
  • Compiler experience (parallelization)
  • C++ programming
  • ML model development expertise
Good to have:
  • PhD in CS or related field
  • MLIR/LLVM experience
  • Accelerator-based compiler development
  • Optimizing ML models for inference
  • Hardware-software codesign

Job Details


Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing, and launching software products.
  • 3 years of experience with software design and architecture.
  • Experience with compilers (parallelization, etc.) or ML model development and C++ programming language.

Preferred qualifications:

  • PhD in Computer Science, or a related field.
  • Experience in Multi-Level Intermediate Representation (MLIR) or Low Level Virtual Machines (LLVM).
  • Experience with compiler development in the context of accelerator-based architectures.
  • Experience with optimizing ML models for inference.
  • Experience with hardware-software codesign.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

Responsibilities

  • Work as part of the EdgeTPU compiler team, including analyzing and improving the compiler quality and performance on optimization decisions, correctness and compilation time.
  • Develop parallelization and scheduling algorithms to optimize compute and data movement costs to execute ML workloads on the EdgeTPU.
  • Work with EdgeTPU architects to design future accelerators, the hardware/software interface, and co-optimizations of the next generation EdgeTPU architectures.
  • Work on efficient mapping of generative AI models and other key workloads into EdgeTPU instructions through the compiler.
  • Work with Product Managers, Researchers in identifying key ML trends, future use cases, etc. Closely collaborate with ML model developers, researchers, and EdgeTPU hardware/software teams to accelerate the transition from research ideas to user experiences running on the EdgeTPU.

Similar Jobs

Google - Senior Software Engineer, Google Messages Wear, Android

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Day ago
Google - Senior Machine Learning Physical Design Engineer

Google

Bengaluru, Karnataka, India (On-Site)
1 Day ago
Google - Staff Software Engineer, Generative AI, Google Workspace

Google

Kirkland, Washington, United States (On-Site)
1 Week ago
Google - Software Engineer III, Infrastructure, Google Cloud Data Management

Google

Kirkland, Washington, United States (On-Site)
1 Day ago
Sleeper - Senior Frontend Engineer (Mobile)

Sleeper

Las Vegas, Nevada, United States (On-Site)
1 Month ago
NVIDIA - High-Speed IO Engineer

NVIDIA

Santa Clara, California, United States (Hybrid)
3 Weeks ago
Google - Staff Software Engineer, Core Data Serving

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
NVIDIA - Senior Math Libraries Engineer – AI and HPC

NVIDIA

Santa Clara, California, United States (Remote)
2 Months ago
NVIDIA - Senior Manager, High-Speed Optical Transceiver Design

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
NVIDIA - Staff Systems Software Engineer - Server

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Regent Craft - Flight Controls Engineering Intern

Regent Craft

North Kingstown, Rhode Island, United States (On-Site)
6 Months ago
Epic Games - Software Engineer, Developer Relations

Epic Games

Seoul, South Korea (On-Site)
2 Months ago
Snowed In Studios - Advanced Software Developer

Snowed In Studios

Ottawa, Ontario, Canada (Remote)
1 Month ago
ByteDance - Research Scientist, Multimodality

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Google - Software Engineer II, iOS Developer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago
Google - Business Data Scientist

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Day ago
Trendyol - Senior Data Analyst ( Data Science - Site Management)

Trendyol

İstanbul, İstanbul, Türkiye (Hybrid)
6 Months ago
NVIDIA - Senior Math Libraries Engineer - Sparse Linear Algebra

NVIDIA

California, United States (Hybrid)
3 Months ago
Voodoo - Lead Multiplayer Game Developer - Paper.io 2

Voodoo

Barcelona, Catalonia, Spain (Remote)
1 Month ago
Meta - Software Engineering Manager, Machine Learning

Meta

Bellevue, Washington, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in New Taipei, New Taipei City, Taiwan

Google - Hardware Design Engineer, Google Cloud

Google

Taipei City, Taiwan (On-Site)
1 Week ago
Google - Software Engineer, Pixel Sensor, Platforms and Devices

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Week ago
Rivos - Silicon ATE Test Engineer

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
6 Months ago
Trend Micro - (Sr.) Threat Researcher

Trend Micro

Taipei City, Taiwan (On-Site)
6 Months ago
NVIDIA - Mixed-Signal Circuit Design Engineer - New College Graduate

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago
Google - CPU Technical Program Manager

Google

New Taipei, New Taipei City, Taiwan (On-Site)
23 Hours ago
NVIDIA - Senior Firmware Application Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
6 Days ago
Google - Applied Machine Learning Engineer

Google

Taipei City, Taiwan (On-Site)
1 Week ago
Google - Foundry Process Control and Yield Engineer, Custom Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Day ago
Rivos - SOC Physical Design - Full time

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Riot Games - Senior Principal Technical Artist

Riot Games

Los Angeles, California, United States (On-Site)
6 Months ago
NVIDIA - STA Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Tesla - Mechanical Design Engineer - Seating

Tesla

Berlin, Berlin, Germany (On-Site)
2 Months ago
NVIDIA - Senior Mixed Signal Design Verification Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
2 Weeks ago
Fluence - Lead Engineer - Advanced Battery Modules

Fluence

Houston, Texas, United States (Hybrid)
6 Months ago
NVIDIA - Senior System Software Engineer, Performance - CUDA Driver

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
NVIDIA - Developer Technology Engineer - HPC and AI

NVIDIA

Taipei City, Taiwan (On-Site)
3 Weeks ago
Google - Senior Hardware Emulation Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Week ago
Google - Senior Software Engineer, Embedded Systems/Firmware, Google Cloud

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
23 Hours ago
Regent Craft - Embedded Software Engineering Intern

Regent Craft

North Kingstown, Rhode Island, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Dublin, County Dublin, Ireland (On-Site)

New York, New York, United States (On-Site)

Waterloo, Ontario, Canada (On-Site)

Taipei City, Taiwan (On-Site)

San Francisco, California, United States (On-Site)

Saint-Ghislain, Wallonia, Belgium (On-Site)

Bengaluru, Karnataka, India (On-Site)

Austin, Texas, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug