Senior Mobile Device Software Engineer, Machine Learning Runtime

8 Hours ago • 5-8 Years • Artificial Intelligence • $166,000 PA - $244,000 PA

Job Summary

Job Description

As a Senior Mobile Device Software Engineer, you will work on the mobile software stack for the Tensor SoC, focusing on deploying on-device Machine Learning (ML) frameworks for various user experiences (Camera, Speech, Generative AI). Responsibilities include leading the development of on-device runtime software, optimizing performance and power, supporting customers deploying ML models to Tensor TPU, prototyping new use cases with application teams, and resolving product/system issues. You'll manage project priorities, deadlines, and deliverables. This role requires expertise in C/C++, mobile ML frameworks (TFLite, Core ML, etc.), and software design/architecture. Experience with hardware and machine learning accelerators is highly valued.
Must have:
  • 5+ years software development (C/C++)
  • 3+ years mobile ML framework experience
  • 3+ years software testing/launch experience
  • Lead on-device ML runtime development
  • Performance and power optimization
  • Support customer model deployment
Good to have:
  • Master's/PhD in CS
  • Technical leadership experience
  • Hardware/ML accelerator experience
  • On-device ML, NLP, image, Generative AI knowledge

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in C or C++ programming languages, and with data structures/algorithms.
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • 3 years of experience with software frameworks for mobile Machine Learning (ML) or graphics (e.g., TFLite, Core ML, PyTorch/ExecuTorch, Vulkan, OpenCL, CUDA, etc.).

Preferred qualifications:

  • Master's degree or PhD in Computer Science or a related technical field.
  • 1 year of experience in a technical leadership role.
  • Experience working with hardware and machine learning accelerators.
  • Experience with on-device machine learning, and knowledge of NLP, image, and on-device Generative AI.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

As a Software Engineer, you will work on the mobile software stack for the Tensor SoC, with a focus on deployment of on-device Machine Learning (ML) framework for a range of user experiences including Camera, Speech, Generative AI, and more. You will be responsible for managing project priorities, deadlines, and deliverables.

Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

The US base salary range for this full-time position is $166,000-$244,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Help lead development of on device Runtime software stack to deploy Machine Learning (ML) models on mobile devices.
  • Track and drive performance and power optimizations to enable on device models.
  • Support customers with deploying their Machine Learning (ML) models to the Tensor TPU.
  • Work with application software teams to prototype and enable new use cases on Tensor SoCs.
  • Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on software, hardware, and quality.

Similar Jobs

NVIDIA - Software Engineering Intern, AI Engineering - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Months ago
NVIDIA - Principal Graphics Hardware Architect

NVIDIA

Westford, Massachusetts, United States (On-Site)
1 Month ago
ByteDance - Tech Lead, Large Language Models & Generative AI

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Rackspace Technology - Sr Big Data Engineer - Oozie and Pig (GCP)

Rackspace Technology

United States (Remote)
1 Week ago
ByteDance - Software Engineer, Model Inference

ByteDance

Seattle, Washington, United States (On-Site)
3 Weeks ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Meta - Research Scientist, Machine Learning (PhD)

Meta

Bellevue, Washington, United States (On-Site)
11 Hours ago
Google - Cloud Product Strategy and Operations Lead

Google

Kirkland, Washington, United States (On-Site)
9 Hours ago
Google - Group Product Manager, Generative AI, Google Cloud AI

Google

Sunnyvale, California, United States (On-Site)
11 Hours ago
NVIDIA - Senior Deep Learning Performance Architect

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Appier - Senior Software Engineer, Data Backend(CrossX)

Appier

Taipei City, Taiwan (On-Site)
5 Months ago
ByteDance - Software Engineer, Video-On-Demand

ByteDance

Singapore (On-Site)
5 Months ago
Blitz app - Senior Software Engineer (C++)

Blitz app

India (Remote)
1 Month ago
Google - Data Scientist

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
8 Hours ago
Zoox - Principal Machine Learning Engineer

Zoox

Foster City, California, United States (On-Site)
5 Months ago
Playrix - Senior Data Analyst (Attribution)

Playrix

Montenegro (Remote)
5 Months ago
Google - Software Engineer III, Google Cloud Business Platforms

Google

Bengaluru, Karnataka, India (On-Site)
10 Hours ago
NVIDIA - Senior System Software Engineer, GPU Server

NVIDIA

Hillsboro, Oregon, United States (On-Site)
1 Month ago
Google - Software Engineer, Early Career, Cloud AI

Google

(On-Site)
4 Months ago
Playrix - UA Marketing Producer

Playrix

Serbia (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Mountain View, California, United States

Samsung Semiconductor - Staff DevOps Engineer

Samsung Semiconductor

San Jose, California, United States (Hybrid)
2 Months ago
Glean - Software Engineer, Backend

Glean

Palo Alto, California, United States (On-Site)
5 Months ago
The Walt Disney Company - Executive Assistant

The Walt Disney Company

San Francisco, California, United States (Hybrid)
3 Weeks ago
Rockstar Games - Senior Full Stack Engineer (C#/React)

Rockstar Games

New York, New York, United States (On-Site)
10 Months ago
Next Level Business Services - IIB, DP, ODM Admin

Next Level Business Services

Burbank, California, United States (On-Site)
6 Months ago
Next Level Business Services - API Developer

Next Level Business Services

New York, New York, United States (On-Site)
6 Months ago
Meta - Software Engineer, Machine Learning

Meta

Los Angeles, California, United States (On-Site)
5 Months ago
Electronic Arts - Senior Software Engineer

Electronic Arts

Orlando, Florida, United States (On-Site)
2 Weeks ago
ION - Senior Full-Stack Developer, New York

ION

New York, New York, United States (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Egnyte - Principal Machine Learning Engineer - AI

Egnyte

India (Remote)
3 Weeks ago
ByteDance - AI Security Researcher - Security - San Jose

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
NVIDIA - Solution Architect - AI and ML

NVIDIA

(Remote)
2 Months ago
AI Fund - Artificial Intelligence Engineer

AI Fund

California, United States (Remote)
6 Months ago
NVIDIA - Senior Deep Learning Engineer

NVIDIA

Redmond, Washington, United States (On-Site)
2 Weeks ago
Riot Games - Senior Data Scientist - Singapore Efficiency Team

Riot Games

Singapore (On-Site)
2 Months ago
ByteDance - Research Scientist - AI Security

ByteDance

San Jose, California, United States (On-Site)
2 Days ago
ByteDance - Senior Machine Learning Engineer

ByteDance

San Jose, California, United States (On-Site)
2 Days ago
The Walt Disney Company - Senior Machine Learning Engineer - Ad Platforms

The Walt Disney Company

San Francisco, California, United States (On-Site)
1 Month ago
Inworld AI - Forward Deployed Engineer - USA

Inworld AI

Mountain View, California, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Bucharest, Bucharest, Romania (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Bengaluru, Karnataka, India (On-Site)

Sunnyvale, California, United States (On-Site)

Sunnyvale, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug