Staff Software Engineer, Scaling On-Device ML Frameworks

3 Months ago • 8-13 Years • Artificial Intelligence

Job Summary

Job Description

Google Cloud is seeking a Staff Software Engineer to join our team and help scale on-device ML frameworks. This role will focus on driving the next-generation of ML functionality and improving overall usability. Responsibilities include ramping up our frameworks with E2E integrations, developing sample apps demonstrating best practices, onboarding SOTA models, scaling partnerships with Android Apps and Google Cloud customers, defining and implementing automated processes and infrastructure, and advocating for product excellence.
Must have:
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in mobile application development or Android framework development
  • 5 years of coding experience in C, C++, Java, or Python
  • Experience with frameworks like JAX and PyTorch
Good to have:
  • Full-stack Android, iOS, and Web development experience
  • OSS development experience
  • Experience in on-device machine learning deployment
  • Experience with Machine Learning infrastructure, Mobile App Development, and Integration Testing
  • Experience with iOS Development, Android Development, C++, and Python

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in mobile application development or Android framework development.
  • 5 years of coding experience in one or more of the following languages: C, C++, Java, or Python.

Preferred qualifications:

  • Experience with frameworks such as JAX, and PyTorch
  • Full-stack Android, iOS, and Web development experience
  • OSS development experience
  • Experience in on-device machine learning deployment in any domain - vision, speech, text etc.
  • Experience with Machine Learning infrastructure, Mobile App Development, and Integration Testing
  • Experience with iOS Development, Android Development, C++, and Python

About the job

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

On-Device Machine Learning (ML), especially with the rise of Generative AI, is central to Google's product portfolio. Unique experiences on Pixel and Android are powered by on-device Machine Learning (e.g., Speech Recognition, Camera, and Assistant/Translation). As we embark on a future with Generative AI experiences personalized on your device, our team is building the core capabilities powering it. Google offers low-level ODML frameworks like TensorFlow Lite and MediaPipe to run machine learning on Android, iOS, Web, and other mobile/embedded devices. To continue growth and drive the next-generation of ML functionality, we're investing heavily in improving overall usability

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

Responsibilities

  • Ramp to our frameworks in the form of E2E integrations between popular Hugging Face/JAX/PyTorch libraries and AI Edge Torch, MP LLM Inference API, etc.
  • Sample apps demonstrating best practices including hardware accelerations, quantization, debugging and optimizing performance and quality.
  • Onboard SOTA models to provide excellent self-serve out-of-the-box experience for users.
  • Scale partnerships with Android Apps and Google Cloud Customers and drive improvements in the overall stack based on real customer needs.
  • Define and implement automated processes and infrastructure to test APIs and user-journeys across diverse platforms and advocate for product excellence.

Similar Jobs

Myntra - Associate Architect

Myntra

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Meta - Software Engineering Manager, Product

Meta

Los Angeles, California, United States (Remote)
3 Months ago
ByteDance - Tech Lead - Global E-Commerce Logistics

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Playrix - Technical Director (Game Project)

Playrix

Portugal (Remote)
4 Months ago
canva - Senior Backend Engineer (Java) - AI Media

canva

Sydney, New South Wales, Australia (Remote)
4 Months ago
ElevenLabs - Technical Investigator / Data Scientist - AI Safety

ElevenLabs

Wrocław, Lower Silesian Voivodeship, Poland (Remote)
4 Months ago
PlayStation Global - Video Machine Learning Intern - Masters

PlayStation Global

Aliso Viejo, California, United States (On-Site)
4 Months ago
Google - Open Career Opportunities, Autonomous (Self-Driving) Vehicle Jobs, Waymo

Google

Phoenix, Arizona, United States (On-Site)
3 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
AirlabInc - Artificial Intelligence Researcher

AirlabInc

Montreal, Quebec, Canada (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Senior Site Reliability Engineer, AI Applications

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
PublicisGroupe - Senior Associate L1 DE-Big Data Azure

PublicisGroupe

Gurugram, Haryana, India (On-Site)
4 Months ago
DAZN - Software Architect - BackEnd

DAZN

Hyderabad, Telangana, India (On-Site)
4 Months ago
eBay - Staff Security Software Engineer

eBay

San Jose, California, United States (Hybrid)
3 Months ago
Google - Software Engineer II, Google Cloud

Google

Hyderabad, Telangana, India (On-Site)
3 Months ago
Trendyol - Developer in Test

Trendyol

Ankara, Ankara, Türkiye (Hybrid)
4 Months ago
Adyen - Engineering Manager (Team Lead) - Cards

Adyen

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Interactive Brokers - Sanctions System Analyst

Interactive Brokers

Chicago, Illinois, United States (Hybrid)
4 Months ago
Next Level Business Services - Java Tech Lead -

Next Level Business Services

Scottsdale, Arizona, United States (On-Site)
3 Months ago
GoTo Group - Software Engineer (Backend) - Transport

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Cloudhire - Sr. Angular NestJS Developer

Cloudhire

Bengaluru, Karnataka, India (Remote)
4 Months ago
DailyRounds / Marrow - SDE II - iOS Developer

DailyRounds / Marrow

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Jellyfish Pictures - Compositor (VFX)

Jellyfish Pictures

Maharashtra, India (Hybrid)
6 Months ago
Zeta - Senior Associate- Marketing Operations

Zeta

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Level AI - Senior SDET - Screen Recording (Noida, India)

Level AI

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
PwC - IN_Associate-_JAVA Backend_Advisory Corporate_Advisory_  Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Equivalent Jobs - FINANCE MANAGER (INDIA)

Equivalent Jobs

Mumbai, Maharashtra, India (Remote)
3 Months ago
PhonePe - Software Engineer (Backend, 3-5 Yrs)- Financial Services

PhonePe

Bengaluru, Karnataka, India (On-Site)
3 Months ago
PlaySimple - Associate Technical Artist(Non Unity)

PlaySimple

Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Google - Generative AI Technical Solutions Consultant

Google

Gurugram, Haryana, India (On-Site)
3 Months ago
Barbaricum - Senior Systems Engineer

Barbaricum

Falls Church, Virginia, United States (On-Site)
4 Months ago
PwC - AI/ML Azure Engineer (m/f/d)

PwC

Luxembourg (On-Site)
4 Months ago
Google - Senior Software Engineer, Core Machine Learning, Google Cloud

Google

New York, New York, United States (On-Site)
3 Months ago
Extreme Network - Staff Software Systems Engineer-Machine Learning

Extreme Network

India (Remote)
4 Months ago
Bazaar Voice - Senior Machine Learning Engineer

Bazaar Voice

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Scanline VFX - Research Intern (Summer 2025)

Scanline VFX

Los Angeles, California, United States (Hybrid)
3 Months ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Google - Customer Engineer, AI/ML, Google Cloud

Google

Irvine, California, United States (On-Site)
3 Months ago
Netomi - Data Scientist - II

Netomi

Gurugram, Haryana, India (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug