Embedded Software Engineer, Machine Learning Runtime, Silicon

1 Hour ago • 2-4 Years • Artificial Intelligence

About the job

Job Description

As a Software Engineer at Google, you'll work on the mobile software stack for the Tensor SoC, focusing on deploying on-device Machine Learning (ML) frameworks for various user experiences (Camera, Speech, Generative AI, etc.). Responsibilities include developing on-device runtime software, optimizing performance and power, supporting customers deploying ML models to the Tensor TPU, collaborating with application teams, and troubleshooting system issues. You'll manage project priorities and deadlines. This role requires expertise in embedded operating systems, software development (C++), ML/graphics frameworks (TFLite, Vulkan, OpenCL, CUDA), and ideally experience with machine learning algorithms and hardware accelerators.
Must have:
  • Embedded OS experience
  • C++ software development
  • ML/graphics framework experience (e.g., TFLite)
  • On-device ML model deployment
  • Performance and power optimization
Good to have:
  • Master's/PhD in CS
  • Experience with ML algorithms
  • Hardware/ML accelerator experience
  • On-device Generative AI knowledge
  • NLP and image processing expertise
Perks:
  • Bonus
  • Equity
  • Benefits
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 2 years of experience working with embedded operating systems.
  • 2 years of experience with software development in one or more programming languages (e.g., C++), or 1 year of experience with an advanced degree.
  • 1 year of experience with software frameworks for mobile Machine Learning (ML) or graphics (e.g., TFLite, Vulkan, OpenCL, CUDA, etc.).

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical fields.
  • Experience with machine learning algorithms and computer architecture.
  • Experience working with hardware and machine learning accelerators.
  • Experience with on-device machine learning, and knowledge of NLP, image, and on-device Generative AI.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

As a Software Engineer you will work on the mobile software stack for the Tensor SoC, with a focus on deployment of on-device Machine Learning (ML) framework for a range of user experiences including Camera, Speech, Generative AI, and more. You will be responsible for managing project priorities, deadlines, and deliverables.

Google's mission is to organize the world's information and make it universally accessible and useful. Our team combines the best of Google AI, Software, and Hardware to create radically helpful experiences. We research, design, and develop new technologies and hardware to make computing faster, seamless, and more powerful. We aim to make people's lives better through technology.

The US base salary range for this full-time position is $136,000-$200,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Develop on device Runtime software stack to deploy Machine Learning (ML) models on mobile devices.
  • Track and drive performance and power optimizations to enable on device models.
  • Support customers with deploying their Machine Learning (ML) models to the Tensor TPU.
  • Work with application software teams to prototype and enable new use cases on Tensor SoCs.
  • Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on software, hardware, and quality.
View Full Job Description
$136.0K - $200.0K/yr (Outscal est.)
$168.0K/yr avg.
Worldwide

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

View All Jobs

Get notified when new jobs are added by Google

Similar Jobs

Intel Corporation - Software Research Engineer/Scientist

Intel Corporation, India (On-Site)

Larian Studios - Tools Programmer | Programmeur d'outils

Larian Studios, Canada (On-Site)

FISHLABS GmbH - (All Levels) Programmer (m/f/d)

FISHLABS GmbH, Germany (On-Site)

Regent Craft - Senior Flight Controls Engineer

Regent Craft, United States (Hybrid)

ByteDance - Research Scientist- Foundation Model, Generative AI

ByteDance, United States (On-Site)

The Walt Disney Company - Generative AI Solutions Architect

The Walt Disney Company, United States (On-Site)

Scale AI - Technical Recruiter

Scale AI, United States (Hybrid)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Radical Forge - Senior Audio Engineer

Radical Forge, United Kingdom (Remote)

Keywords Studios (Player Support) - Technical Artists - 2025 Opportunities

Keywords Studios (Player Support), (Hybrid)

Wargaming - Render Engineer (Unannounced project)

Wargaming, Czechia (On-Site)

Regent Craft - Embedded Software Engineering Intern

Regent Craft, United States (On-Site)

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Wargaming - Director of AI Engineering

Wargaming, Czechia (On-Site)

Scale AI - Principal Architect, Public Sector

Scale AI, United States (On-Site)

Eleven Labs - Technical Investigator / Data Scientist - AI Safety

Eleven Labs, United States (Remote)

KPIT - CTO_ML/DL Data scientist

KPIT, India (On-Site)

Trend Micro - Sr. AI Engineer

Trend Micro, Taiwan (On-Site)

Airlab Inc  - Artificial Intelligence Researcher

Airlab Inc , Canada (On-Site)

Get notifed when new similar jobs are uploaded