Software Engineer III, Machine Learning Deployment, Silicon

7 Hours ago • 2 Years + • Research & Development

Job Summary

Job Description

This role involves deploying and optimizing Machine Learning models for high performance on Google Tensor SoCs. Responsibilities include investigating performance issues, leveraging knowledge of Tensor SoC architecture, ML frameworks (TensorFlow Lite), compiler technologies, and kernel optimizations. The position requires developing optimization solutions (model architecture modifications, custom kernels, framework improvements), building tools and libraries for efficient ML deployment, and collaborating with partners and internal teams. A Bachelor's degree in Computer Science or related field, 2 years of C++ and Python experience, and 2 years of experience in machine learning, compilers, or related areas are required. Preferred qualifications include a Master's or PhD, experience with ML frameworks (TensorFlow, PyTorch), and performance analysis tools.
Must have:
  • Bachelor's degree in CS or related field
  • 2 years C++ and Python experience
  • 2 years ML, compiler, or related experience
  • Deploy and optimize ML models
  • Investigate performance issues
  • Develop optimization solutions
Good to have:
  • Master's/PhD in CS
  • Experience with ML frameworks (TensorFlow, PyTorch)
  • Performance analysis tools experience
  • Hardware accelerator optimization experience
  • Collaboration skills
  • Problem-solving and debugging skills

Job Details


Minimum qualifications:

  • Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
  • 2 years of working experience in C++ and Python.
  • 2 years of experience in one or more of the following areas: machine learning, compilers, performance optimization, computer architecture, embedded systems, or systems programming.

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical fields.
  • Experience with ML frameworks (e.g., TensorFlow, PyTorch) and ML model architectures.
  • Experience with performance analysis tools for mobile or embedded systems.
  • Experience optimizing software for specific hardware accelerators (e.g., GPUs, DSPs, TPUs).
  • Proven ability to collaborate effectively across team boundaries.
  • Strong problem-solving and debugging skills.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

Responsibilities

  • Deploy and optimize Machine Learning models from third-party developers for high performance on Google Tensor SoCs.
  • Investigate root causes of performance issues, leveraging knowledge of Tensor SoC architecture, Machine Learning frameworks (e.g., TensorFlow Lite), compiler technologies, and kernel optimizations.
  • Develop and implement optimization solutions, potentially including model architecture modifications (in collaboration), custom compute kernels, or framework-level improvements.
  • Design, build, and maintain tools, libraries, and benchmarks to improve the efficiency of ML deployment, profiling, and analysis.
  • Collaborate effectively with external partners and internal cross-functional teams to understand requirements and deliver solutions.

Similar Jobs

ByteDance - Machine Learning Engineer - Inference

ByteDance

San Jose, California, United States (On-Site)
3 Weeks ago
Scale AI - Machine Learning Engineer, International Public Sector

Scale AI

United Kingdom (On-Site)
6 Months ago
Krafton  - Deep Learning Engineer - RL

Krafton

Seoul, South Korea (On-Site)
3 Months ago
CloudHire - ML Engineer

CloudHire

Hyderabad, Telangana, India (Remote)
3 Weeks ago
PlayStation Global - Staff Machine Learning Engineer, Enterprise Enablement

PlayStation Global

California, United States (On-Site)
3 Months ago
GoMotive - Engineering Manager, Full Stack (MarTech)

GoMotive

Pakistan (Remote)
4 Weeks ago
NVIDIA - Senior Chip Design Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
2 Weeks ago
Krafton  - Applied Research Engineer - Reinforcement Learning

Krafton

Seoul, South Korea (On-Site)
3 Weeks ago
NVIDIA - Diagnostic Software Manager - Server

NVIDIA

Taipei City, Taiwan (On-Site)
3 Weeks ago
Krafton  - PUBG IP Franchise China Business PM (Entry-Level ~ 3 years)

Krafton

Seoul, South Korea (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

The Walt Disney Company - Principal Machine Learning Engineer

The Walt Disney Company

San Francisco, California, United States (On-Site)
2 Days ago
Arkose Labs - Senior Machine Learning Researcher

Arkose Labs

Pune, Maharashtra, India (Hybrid)
6 Months ago
NVIDIA - Senior Software Engineer - Distributed Inference

NVIDIA

Texas, United States (Remote)
1 Month ago
Google - Customer Engineer II, Cloud AI

Google

San Francisco, California, United States (On-Site)
8 Hours ago
Match Group - Sr. Software Engineer, Generative AI

Match Group

Palo Alto, California, United States (Hybrid)
6 Months ago
ByteDance - Machine Learning Engineer, Tech Lead - Code AI

ByteDance

San Jose, California, United States (On-Site)
3 Weeks ago
Flying Bark Productions - Rigging & Animation Software Developer

Flying Bark Productions

New South Wales, Australia (Hybrid)
2 Months ago
Netflix - Software Engineer L4, Machine Learning Platform (Metaflow)

Netflix

Los Gatos, California, United States (On-Site)
1 Month ago
CloudHire - ML Engineer

CloudHire

Telangana, India (Remote)
4 Weeks ago
Meta - Research Scientist, Machine Learning (PhD)

Meta

Sunnyvale, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New Taipei, New Taipei City, Taiwan

Google - Software Engineer, Quick Share, Windows, Better Together

Google

New Taipei City, Taiwan (On-Site)
8 Hours ago
NVIDIA - Senior Tool and Methodology Development Software Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
Rivos - CPU Design Verification - Full-time

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
6 Months ago
Corsair - Technical Marketing Manager – Gaming Marketing

Corsair

Taipei City, Taiwan (On-Site)
2 Days ago
AI Fund - Frontend Engineer

AI Fund

Taipei City, Taiwan (Hybrid)
6 Months ago
NVIDIA - Design Verification Engineer - PCIE

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
4 Weeks ago
Garena - Garena - Database Administrator

Garena

Taipei City, Taiwan (On-Site)
2 Days ago
NVIDIA - Senior Technical Program Manager - Deep Learning Enterprise Server Software

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
Rivos - Data Parallel Accelerator Performance Intern

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
6 Months ago
Trend Micro - Staff/Sr. Cloud Service Engineer (VicOne_ Automotive Security)

Trend Micro

Taipei City, Taiwan (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Cadence - Sr Principal Product Validation Engineer

Cadence

Noida, Uttar Pradesh, India (On-Site)
6 Months ago
Epic Games - Principal Research Engineer

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago
Meta - Software Engineer, Machine Learning

Meta

Singapore (On-Site)
5 Months ago
Wind River Systems - Senior Member of Technical Staff - Services

Wind River Systems

Seoul, South Korea (On-Site)
6 Months ago
NVIDIA - Senior Software Verification Engineer - Switch Simulation

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
Meta - Software Engineer (Leadership) - Machine Learning

Meta

Burlingame, California, United States (Remote)
5 Months ago
Ubisoft - Technical Architect

Ubisoft

Pune, Maharashtra, India (On-Site)
2 Months ago
NVIDIA - Senior Physical Design Verification Layout Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
ByteDance - Research Scientist - Multimedia Lab

ByteDance

San Diego, California, United States (On-Site)
3 Weeks ago
Corsair - Embedded Software Engineer

Corsair

Ljubljana, Ljubljana, Slovenia (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Dublin, County Dublin, Ireland (On-Site)

Sunnyvale, California, United States (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Hyderabad, Telangana, India (On-Site)

Sunnyvale, California, United States (On-Site)

Sydney, New South Wales, Australia (On-Site)

Waterloo, Ontario, Canada (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug