Staff Software Engineer, Machine Learning Runtime, Google Cloud

2 Months ago • 8-13 Years • Artificial Intelligence • $189,000 PA - $284,000 PA

Job Summary

Job Description

Google Cloud seeks a Staff Software Engineer for its Machine Learning Runtime team. This role requires 8+ years of software development experience, expertise in data structures/algorithms, testing and launching software, and software design/architecture. 5+ years of experience with ML infrastructure, speech/audio, reinforcement learning, or a related field is essential, along with 5+ years in ML design and infrastructure optimization. Responsibilities include technical leadership on high-impact projects, managing project priorities, facilitating alignment across teams, leading solution design and implementation in specialized ML areas, migrating runtimes (TensorFlow, JAX, PyTorch) from TPU to GPU, and supporting Google's diverse ML ecosystem. The ideal candidate will have experience in technical leadership, cross-functional projects, and working with frameworks like TensorFlow, JAX, and PyTorch.
Must have:
  • 8+ years software development experience
  • Expertise in data structures/algorithms
  • Experience testing and launching software
  • 5+ years experience with ML infrastructure
  • 5+ years in ML design and optimization
Good to have:
  • Master's/PhD in a related field
  • Technical leadership experience
  • Cross-functional project experience
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development, and with data structures/algorithms.
  • 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
  • 5 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.
  • 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in an organization involving cross-functional or cross-business projects.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

The Core team builds the technical foundation behind Google’s flagship products. We are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for our users and drive the pace of innovation for every developer. We look across Google’s products to build central solutions, break down technical barriers and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.

The US base salary range for this full-time position is $189,000-$284,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Provide technical leadership on high-impact projects. Manage project priorities, deadlines, and deliverables.
  • Facilitate alignment and clarity across teams on goals, outcomes, and timelines, influence and coach a distributed team of engineers.
  • Lead the design and implementation of solutions in specialized ML areas, optimize ML infrastructure, and guide the development of model optimization and data processing strategies.
  • Migrate existing frameworks (e.g., TensorFlow, JAX, PyTorch) runtimes (e.g., TFExecutor, TFRT, PJRT) and product area custom workflows from TPU to GPU and minimizing any user disruption.
  • Support Google’s diverse ML ecosystem needs.

Similar Jobs

Ciklum - Senior Data Scientist

Ciklum

Chennai, Tamil Nadu, India (Hybrid)
4 Months ago
Riot Games - Research Scientist Intern - Generative AI - Summer 2025 (Remote)

Riot Games

Dublin, County Dublin, Ireland (Remote)
3 Months ago
Krafton  - [Deep Learning Div.] Deep Learning Engineer - ML (1년 ~ 3년)

Krafton

Seoul, South Korea (On-Site)
2 Months ago
Alphasense - Join AlphaSense India Talent Community

Alphasense

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Codvoai - Senior Data Scientist

Codvoai

Pune, Maharashtra, India (Remote)
1 Year ago
Barbaricum - Scrum Master

Barbaricum

Falls Church, Virginia, United States (Hybrid)
4 Months ago
Netomi - Data Scientist - I

Netomi

Gurugram, Haryana, India (Hybrid)
4 Months ago
Meta - Research Scientist Intern, PhD, PyTorch Edge

Meta

Menlo Park, California, United States (On-Site)
3 Months ago
Meta - Software Engineer, Systems ML - SW/HW Co-design

Meta

Austin, Texas, United States (On-Site)
3 Months ago
PwC - AI Model Validation Expert

PwC

Sofia, Sofia City Province, Bulgaria (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Student Researcher (Doubao (Seed) - Foundation Model, Speech & Audio) - 2024 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Luxoft - Data & AI SME

Luxoft

Gurugram, Haryana, India (On-Site)
3 Months ago
Tencent - Game Research & Development Intern, Engine Research 102577

Tencent

Bellevue, Washington, United States (On-Site)
4 Months ago
Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

New York, New York, United States (On-Site)
3 Months ago
Alpha Sense - Join AlphaSense India Talent Community

Alpha Sense

Delhi, India (On-Site)
3 Months ago
Digitap AI - Senior Data Scientist

Digitap AI

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Samsung Semiconductor - Senior Principal Engineer, AI/ML Software Compiler

Samsung Semiconductor

San Jose, California, United States (Hybrid)
5 Months ago
Google - Staff Software Engineer, Core Machine Learning, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
3 Months ago
Intel Corporation - College Graduates

Intel Corporation

(On-Site)
2 Months ago
ByteDance - Software Engineer Graduate (Applied Machine Learning - Engine) - 2025 Start (BS/MS)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Worldwide

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Artificial Intelligence Jobs

Scale AI - QA Engineer, Generative AI

Scale AI

Argentina (On-Site)
4 Months ago
Microsoft - Applied Sciences Student Worker Opportunities

Microsoft

Belgrade, Serbia (On-Site)
1 Month ago
Microsoft - Member of Technical Staff, Platform Engineer

Microsoft

Mountain View, California, United States (Hybrid)
1 Month ago
Salesforce - 2025 PhD Intern - AI Research, Singapore

Salesforce

Singapore, Singapore (On-Site)
4 Months ago
Krafton  - [Global Strategy & BD Div.] Strategy Manager(AI Ethics) (4년 ~ 7년)

Krafton

Seoul, South Korea (On-Site)
2 Months ago
NeST Digital - 1730 - Data Scientist

NeST Digital

Bengaluru, Karnataka, India (On-Site)
3 Months ago
ByteDance - Sr. Software Engineer - Generative AI

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
PwC - Risk Services AI Trust Manager

PwC

Toronto, Ontario, Canada (On-Site)
4 Months ago
Unity - Senior Data Scientist

Unity

San Francisco, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug