Senior ML Systems Engineer, AICore

3 Months ago • 5-8 Years • System Design

Job Summary

Job Description

This Senior ML Systems Engineer role at Google's AICore in Taipei, Taiwan focuses on bringing Gemini to the Android ecosystem. Responsibilities include designing privacy-preserving, on-device ML systems; collaborating with Android partners to optimize Gemini models for various NPUs; developing algorithms and models to boost on-device Generative AI performance; and ensuring exceptional performance, reliability, and user delight through model optimization and quality assurance. The role requires strong software development skills, experience with ML models, and a deep understanding of software design and architecture. The successful candidate will partner with CoreML experts and contribute to shaping the future of mobile AI.
Must have:
  • 5+ years software development experience
  • 3+ years software product experience
  • Experience with ML models (DNN, LLM)
  • Familiarity with ML frameworks (PyTorch, TensorFlow)
  • Software design and architecture experience
Good to have:
  • Master's/PhD in CS
  • Technical leadership experience
  • Model optimization techniques (quantization, sparsity)

Job Details


Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical field.
  • 1 year of experience in a technical leadership role.
  • Experience with Machine Learning models (e.g., DNN, LLM, etc.) training, data processing, and evaluation.
  • Familiarity with at one popular ML framework (e.g., PyTorch, Jax, TensorFlow).

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

In this role, you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

Google's mission is to organize the world's information and make it universally accessible and useful. Our Devices and Services team combines the best of Google AI, Software, and Hardware to create radically helpful experiences for users. We research, design, and develop new technologies and hardware to make our user's interaction with computing faster, seamless, and more powerful. Whether finding new ways to capture and sense the world around us, advancing form factors, or improving interaction methods, the Devices and Services team is making people's lives better through technology.

Responsibilities

  • Partner with CoreML experts to bring Gemini to the Android ecosystem to shape the future of mobile AI for billions.
  • Design privacy-preserving, on-device ML systems that fundamentally change mobile interaction and enhance core functionalities at massive scale.
  • Collaborate with Android partners to optimize and compress Gemini models (e.g., using techniques like quantization and sparsity) for peak performance on a wide array of Neural Processing Units (NPUs), achieving cross-ecosystem optimization.
  • Develop next-generation algorithms and models to dramatically boost the performance and efficiency of on-device Generative AI, and develop and enhance model fine-tuning pipelines to facilitate efficient and easy downstream feature development.
  • Deliver exceptional performance, reliability, and user delight through model optimization and quality assurance.

Similar Jobs

EMA - Backend Engineer

EMA

Bengaluru, Karnataka, India (Hybrid)
1 Year ago
Adtran - Software Design Engineer

Adtran

Stockholm, Stockholm County, Sweden (On-Site)
2 Months ago
Apple - Machine Learning Engineer – Ads Signals Intelligence & Information Retrieval

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Build Staff - Full Stack Developer

Build Staff

Irvine, California, United States (On-Site)
7 Years ago
Nice - Senior Specialist Software Engineer (C++, Domain)

Nice

Pune, Maharashtra, India (Hybrid)
4 Weeks ago
NVIDIA - System Architect

NVIDIA

Santa Clara, California, United States (On-Site)
4 Months ago
ARHS - Systems Engineer (Citrix)

ARHS

Luxembourg, Luxembourg, Luxembourg (On-Site)
3 Months ago
Apple - Distinguished Software Engineer, ML Systems Evaluation Engineering

Apple

Cupertino, California, United States (On-Site)
1 Month ago
CloudLinux - Senior Systems Engineer

CloudLinux

Tbilisi, Tbilisi, Georgia (Remote)
2 Months ago
dbt Labs - Salesforce & Business Systems Engineer

dbt Labs

Costa Rica (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Spotnana - Senior Software Engineer, Backend

Spotnana

Bengaluru, Karnataka, India (Hybrid)
9 Months ago
Dream Games - VFX Artist

Dream Games

İstanbul, Türkiye (On-Site)
5 Months ago
bytedance - Software Development Engineer - Distributed NoSQL Database Systems

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago
Spatial Studio - Unity Gameplay Engineer

Spatial Studio

(Remote)
7 Months ago
DraftKings - Senior Software Engineer, Sportsbook

DraftKings

Plovdiv, Plovdiv Province, Bulgaria (Remote)
3 Months ago
White board games - Technical Artist (SR)

White board games

Argentina (Remote)
3 Months ago
Global Business Travel - Software Development Engineer II (SRE)

Global Business Travel

Gurugram, Haryana, India (On-Site)
1 Year ago
Flexra Software - Manager Site Reliability Engineering

Flexra Software

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Datahub - Software Engineer, Customer Success

Datahub

Palo Alto, California, United States (Hybrid)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

Marvell - Staff Test Engineer

Marvell

Hsinchu City, Taiwan (On-Site)
2 Weeks ago
winking Entertainment - Student Intern - Game Planning Assistant

winking Entertainment

Taipei City, Taiwan (On-Site)
2 Months ago
Canonical - Silicon Alliances Ecosystem Development Manager - APAC

Canonical

Taipei City, Taiwan (Hybrid)
2 Months ago
Toast - Director, Hardware Quality

Toast

Taipei City, Taiwan (Hybrid)
1 Month ago
GoMotive - Camera Embedded Firmware Engineer

GoMotive

Taipei City, Taiwan (Remote)
2 Months ago
rivos - Analog Mixed Signal Design

rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
9 Months ago
dun bradstreet - Human Resources Manager

dun bradstreet

Taipei City, Taiwan (On-Site)
3 Months ago
Canonical - Linux Enablement - Software Engineering Manager

Canonical

Taipei City, Taiwan (On-Site)
2 Months ago
binance - Java Engineer - Trading Tech

binance

Taipei City, Taiwan (Remote)
5 Months ago
Google - Software Engineer, Home Camera Device

Google

New Taipei, New Taipei City, Taiwan (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

System Design Jobs

Apple - Sensing System HW Engineer

Apple

San Diego, California, United States (On-Site)
2 Months ago
bytedance - Senior Machine Learning Ops Engineer, ML System

bytedance

Seattle, Washington, United States (On-Site)
9 Months ago
bytedance - Senior Machine Learning Ops Engineer, ML System

bytedance

San Jose, California, United States (On-Site)
9 Months ago
2K - Systems Engineer

2K

Novato, California, United States (On-Site)
2 Months ago
PlayStation Global - Information Systems Engineer

PlayStation Global

San Mateo, California, United States (Hybrid)
3 Months ago
Kavalirio - Expert Cyber Systems Engineer

Kavalirio

Chantilly, Virginia, United States (On-Site)
2 Weeks ago
extreme network - SR SW SYSTEMS ENGINEER

extreme network

Chennai, Tamil Nadu, India (Hybrid)
4 Months ago
extreme network - SR SW SYSTEMS ENGINEER - Layer2/Layer3 Protocol Development

extreme network

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Thales - Systems Engineer with EW experience

Thales

Crawley, England, United Kingdom (On-Site)
2 Months ago
Ion - Trading Systems Engineer - 9320

Ion

London, England, United Kingdom (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Durham, North Carolina, United States (On-Site)

Kirkland, Washington, United States (On-Site)

Sunnyvale, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Sunnyvale, California, United States (On-Site)

Mexico City, Mexico City, Mexico (On-Site)

Belo Horizonte, State Of Minas Gerais, Brazil (On-Site)

Mexico City, Mexico City, Mexico (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug