Software Engineer, Edge TPU Developer Tools

3 Months ago • 5-8 Years • Research & Development

Job Summary

Job Description

As a Software Engineer, you'll develop tooling for the Tensor TPU SoC SDK to accelerate complex machine learning models on custom hardware accelerators. You'll build tools complementing the compiler to efficiently map ML models to the hardware ISA, focusing on always-on computing. Responsibilities include designing and implementing methods to gather performance metrics, correlating performance data at the ML graph or hardware level, building performance analysis tools for simulators or new hardware, and creating user-facing materials (codelabs, documentation, tutorials) to guide users in analyzing and improving latency, accuracy, and power. This role sits at the intersection of ML accelerators, optimization, embedded systems, and is critical for customers deploying models on consumer hardware.
Must have:
  • 5+ years software development experience
  • 3+ years building developer tools
  • 3+ years software product development
  • Experience with data structures/algorithms
  • Build tools for efficient ML model mapping
  • Design & implement performance metric gathering
Good to have:
  • Master's/PhD in CS (compiler/ML focus)
  • Experience with domain-specific ML compilers
  • C++ programming experience
  • Developer tools for APU, NPU, GPU, DSP
  • Power/performance optimization experience
  • Low-level tooling (profiling, tracing)

Job Details


Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 3 years of experience building developer tools (e.g., compilers, automated releases, code design and testing, test automation frameworks).
  • 3 years of experience in developing software products, and 1 year of experience with software design and architecture.

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical field with an emphasis on compiler or ML performance.
  • Experience with domain-specific compilers for machine learning and experience with using C++ as programming language.
  • Experience in building developer tools for computing accelerators such as APU, NPU, GPU and DSP.
  • Experience in power and performance optimizations.
  • Experience with low-level and low intrusiveness developer tooling concepts such as profiling, instrumentation, API tracing, hardware tracing.
  • Understanding of hardware, especially hardware that provides a degree of parallelism.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

As a Software Engineer you will work on developing toolings as part of SoC Software Development Kit (SDK) for the Tensor TPU to accelerate complex machine learning models running on custom hardware accelerators. Along with your technical expertise, you will manage project priorities, deadlines and deliverables.

This opportunity sits at the intersection of Machine Learning (ML) accelerators, optimization and deployment of ML models, embedded systems, and will be on the critical path of customers looking to productionize their models on consumer hardware.

Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

Responsibilities

  • Build tools that compliments compiler to efficiently map ML models (with a particular focus on always-on computing use cases) to the hardware ISA.
  • Design and implement new ways to gather useful performance metrics from hardware or software stack.
  • Design and implement tools that can correlate performance data at a ML graph level or logical hardware level.
  • Build performance analysis tools for simulators or new hardware.
  • Show users how to use our tools to analyze, debug and improve latency, accuracy, and power through codelabs, documentation, and tutorials.

Similar Jobs

Meta - ML Silicon Performance Architect

Meta

Austin, Texas, United States (On-Site)
• 3 Months ago
Wind River Systems - Senior Cloud Solutions Architect

Wind River Systems

Singapore (On-Site)
• 3 Months ago
Intel Corporation - AI Frameworks Engineer

Intel Corporation

Ireland (Hybrid)
• 2 Months ago
Nintendo - Embedded Engineer, Display (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
• 8 Months ago
Intel Corporation - Validation Automation Architect

Intel Corporation

Penang, Malaysia (Hybrid)
• 2 Months ago
Anavation - Software Developer 4

Anavation

Chantilly, Virginia, United States (On-Site)
• 4 Months ago
Meta - ASIC Engineer, Design Verification

Meta

Sunnyvale, California, United States (Remote)
• 3 Months ago
Logitech - Mechatronics Intern

Logitech

Hsinchu, Hsinchu City, Taiwan (On-Site)
• 3 Months ago
Google - ASIC Design Lead, Machine Learning, Silicon

Google

Bengaluru, Karnataka, India (On-Site)
• 2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NXP - Embedded Security SW

NXP

Brno, South Moravian Region, Czechia (On-Site)
• 5 Months ago
Blizzard Entertainment - Senior Data Scientist, Computer Graphics

Blizzard Entertainment

Irvine, California, United States (On-Site)
• 2 Months ago
Amazon Games - Senior Game Tools Engineer, Amazon Games

Amazon Games

Irvine, California, United States (On-Site)
• 9 Months ago
PwC - Ingenieros y Programadores - PwC

PwC

Granada, Andalusia, Spain (On-Site)
• 4 Months ago
Google - Web Solutions Engineer, gTech

Google

Hyderabad, Telangana, India (On-Site)
• 3 Months ago
Playrix - Senior C++ Software Engineer (Tools)

Playrix

Portugal (Remote)
• 4 Months ago
Microsoft - Principal Software Engineer – OneDrive Photos Web

Microsoft

Redmond, Washington, United States (On-Site)
• 1 Month ago
ByteDance - Senior Backend Engineer - CRM for Global E-commerce Commercial Platform

ByteDance

Seattle, Washington, United States (On-Site)
• 3 Months ago
Zuru - Unreal Engine C++ Software Engineer

Zuru

Modena, Emilia-Romagna, Italy (Hybrid)
• 4 Months ago
ION - Equities Service Desk - Trader Support - 7464

ION

Woking, England, United Kingdom (On-Site)
• 4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Worldwide

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Research & Development Jobs

Google - Senior Software Engineer, Maps

Google

Seoul, South Korea (On-Site)
• 3 Months ago
Microsoft - STCA Chief Scientist

Microsoft

Beijing, Beijing, China (On-Site)
• 1 Month ago
Meta - Embedded Software Engineer, Firmware - Reality Labs

Meta

Austin, Texas, United States (On-Site)
• 3 Months ago
Microsoft - Research Intern - Microsoft Research and Outlook

Microsoft

Redmond, Washington, United States (On-Site)
• 1 Month ago
Nintendo - Senior Engineer, CPU Debugger (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
• 3 Months ago
Regent Craft - Modeling and Simulation Engineer

Regent Craft

North Kingstown, Rhode Island, United States (On-Site)
• 4 Months ago
Passive Logic - Weather Simulation Engineer

Passive Logic

Salt Lake City, Utah, United States (On-Site)
• 2 Months ago
Google - TPU Silicon Validation Engineer

Google

(On-Site)
• 2 Months ago
Microsoft - Senior Applied Scientist

Microsoft

Cairo, Cairo Governorate, Egypt (On-Site)
• 1 Month ago
Luxoft - Senior C++ Software Developer with AUTOSAR Adaptive

Luxoft

Italy, New York, United States (Remote)
• 2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug