Senior Software Engineer, ML Compilers, Google Silicon

8 Hours ago • 5 Years + • Research & Development

Job Summary

Job Description

This role involves working as part of the EdgeTPU compiler team, focusing on improving compiler quality and performance. Responsibilities include developing parallelization and scheduling algorithms to optimize ML workloads on the EdgeTPU, collaborating with architects to design future accelerators and hardware/software interfaces, efficiently mapping generative AI models onto EdgeTPU instructions, and working with product managers and researchers to identify key ML trends and future use cases. The ideal candidate will have experience with compilers (parallelization, etc.), ML model development, and C++. Experience with MLIR or LLVM, optimizing ML models for inference, hardware-software codesign, and compiler development for accelerator-based architectures are preferred.
Must have:
  • 5+ years software development experience
  • Experience with compilers or ML model development
  • Experience with C++
  • Data structures/algorithms expertise
  • Software testing, maintenance, and launch experience
Good to have:
  • Master's/PhD in CS or related field
  • MLIR or LLVM experience
  • ML model optimization for inference
  • Hardware-software codesign experience
  • Compiler development for accelerator-based architectures

Job Details


Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 5 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • Experience with compilers (e.g., parallelization, etc.) or ML model development.
  • Experience with C++.

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical field.
  • Experience in Multi-Level Intermediate Representation (MLIR) or Low Level Virtual Machines (LLVM).
  • Experience in optimizing ML models for inference.
  • Experience with hardware-software codesigns.
  • Experience with compiler development in the context of accelerator-based architectures.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

In this role, you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

Responsibilities

  • Work as part of the EdgeTPU compiler team, including analyzing and improving the compiler quality and performance on optimization decisions, correctness, and compilation time.
  • Develop parallelization and scheduling algorithms to optimize compute and data movement costs to execute ML workloads on the EdgeTPU.
  • Work with EdgeTPU architects to design future accelerators, the hardware/software interface, and co-optimizations of the next generation EdgeTPU architectures.
  • Work on efficient mapping of generative AI models and other key workloads into EdgeTPU instructions through the compiler.
  • Work with product managers, researchers in identifying key ML trends, future use cases, and collaborate with ML model developers, researchers, and EdgeTPU hardware/software teams to accelerate the transition from research ideas to user experiences running on the EdgeTPU.

Similar Jobs

Google - Student Researcher, PhD, Winter/Summer 2025

Google

(On-Site)
4 Months ago
The Walt Disney Company - Sr Software Engineer (JavaScript)

The Walt Disney Company

Washington, United States (On-Site)
3 Months ago
NVIDIA - Senior Network Algorithms Architect

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Samsung Semiconductor - Machine Learning Engineer Intern - PEFT

Samsung Semiconductor

San Jose, California, United States (On-Site)
3 Months ago
Google - Embedded Senior Software Engineer, Pixel Power Software

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
9 Hours ago
ByteDance - Machine Learning Engineer - Machine Learning Infrastructure

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
CLO Virtual Fashion  Inc  - C++ Developer

CLO Virtual Fashion Inc

Bengaluru, Karnataka, India (On-Site)
7 Months ago
NVIDIA - Senior Post Silicon Hardware Engineer

NVIDIA

Canada (Hybrid)
1 Month ago
Krafton  - [Production Management Office] Studio Supporter (10년 이상)

Krafton

Seoul, South Korea (On-Site)
4 Months ago
ByteDance - Research Scientist, Vision Foundation Model

ByteDance

San Jose, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Senior Software Engineer, Infrastructure, Google Cloud AI

Google

Kirkland, Washington, United States (On-Site)
7 Hours ago
Evolution - Data Scientist

Evolution

Warsaw, Masovian Voivodeship, Poland (Hybrid)
8 Months ago
Google - Software Engineer III, Mobile, Android

Google

New York, New York, United States (On-Site)
11 Hours ago
Google - Software Engineer, Android

Google

Bucharest, Bucharest, Romania (On-Site)
8 Hours ago
Google - Software Engineer III, Infrastructure, Chrome OS

Google

Boulder, Colorado, United States (On-Site)
8 Hours ago
Netflix - Data Scientist (L5) - Product Promotion & Algorithm Performance

Netflix

Los Gatos, California, United States (On-Site)
2 Months ago
Blind Squirrel Games - Sr. Generalist Engineer, Austin

Blind Squirrel Games

Austin, Texas, United States (Hybrid)
3 Weeks ago
Playrix - Senior Data Analyst (Attribution)

Playrix

Portugal (Remote)
5 Months ago
Google - Senior Software Engineer, Infrastructure, Google Cloud Business Platforms

Google

Sunnyvale, California, United States (On-Site)
8 Hours ago

Get notifed when new similar jobs are uploaded

Jobs in New Taipei, New Taipei City, Taiwan

NVIDIA - Design Verification Engineer - PCIE

NVIDIA

Taipei City, Taiwan (On-Site)
4 Weeks ago
NVIDIA - Senior ASIC Verification Engineer, Coherent High Speed Interconnect

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
4 Weeks ago
Corsair - IE Engineer

Corsair

Taoyuan City, Taiwan (On-Site)
3 Weeks ago
Google - Silicon Validation Software Engineer

Google

New Taipei, New Taipei City, Taiwan (On-Site)
9 Hours ago
Google - Software Engineer, Computer Vision and Machine Learning

Google

New Taipei, New Taipei City, Taiwan (On-Site)
9 Hours ago
NVIDIA - Senior Generalist Software Engineer -- Omniverse

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
1 Month ago
Appier - Software Engineer, Backend Development (Graduate)

Appier

Taipei City, Taiwan (On-Site)
2 Months ago
NVIDIA - Mixed Signal Design Engineer (RDSS Intern)

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
Google - Senior Software Engineer, Embedded Systems/Firmware, Google TV

Google

Taipei City, Taiwan (On-Site)
9 Hours ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Riot Games - Senior Software Engineer - Data Foundation

Riot Games

Los Angeles, California, United States (On-Site)
3 Weeks ago
ByteDance - Machine Learning Engineer Intern (Search-TikTok Recommendation)

ByteDance

San Jose, California, United States (On-Site)
3 Weeks ago
NVIDIA - Senior Silicon Circuits System Design Engineer

NVIDIA

Canada (Hybrid)
1 Month ago
Remedy Entertainment Plc - Performance Capture Artist

Remedy Entertainment Plc

Helsinki, Uusimaa, Finland (On-Site)
1 Month ago
GoMotive - Embedded Engineer

GoMotive

India (Remote)
2 Months ago
NVIDIA - Senior Packaging Technical Engineer - Hardware

NVIDIA

United States (Remote)
1 Week ago
Google - Software Developer, XR Camera Systems/Perception Systems

Google

Waterloo, Ontario, Canada (On-Site)
10 Hours ago
NVIDIA - Senior Resiliency and Safety Architect

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Samsung Semiconductor - Senior Staff Engineer, Process Integration

Samsung Semiconductor

San Jose, California, United States (Hybrid)
2 Days ago
Riot Games - Senior Technical Producer, League Studios - Build Test Ship

Riot Games

Los Angeles, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Bucharest, Bucharest, Romania (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Bengaluru, Karnataka, India (On-Site)

Sunnyvale, California, United States (On-Site)

Sunnyvale, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug