Staff Software Engineer, Machine Learning, JAX Third Party

1 Hour ago • 8-11 Years • Full Stack Development • $197,000 PA - $291,000 PA

Job Summary

Job Description

This Staff Software Engineer role focuses on developing and leading the open-source JAX AI Inference Stack for GCP's third-party customers. Responsibilities include optimizing inference performance across diverse hardware (GPU, TPU), designing stable APIs, ensuring support for massive scale, and building multi-cloud migration support. The ideal candidate will have extensive experience in software development, ML design and infrastructure, and software architecture, along with strong leadership and cross-functional collaboration skills. The role involves a cross-stack, co-design approach to meet GCP's diverse ML ecosystem needs for JAX.
Must have:
  • 8+ years software development experience
  • 5+ years ML design & infrastructure experience
  • 3+ years software design & architecture experience
  • Develop and lead OSS JAX AI Inference Stack
  • Optimize inference performance (GPU/TPU)
  • Build multi-cloud migration support
Good to have:
  • Master's/PhD in related field
  • 8+ years data structures/algorithms experience
  • Technical leadership experience
  • Experience in complex, matrixed organizations
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing, and launching software products.
  • 5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 3 years of experience with software design and architecture.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 8 years of experience with data structures/algorithms.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

Our team's mission is end-to-end training and inference success for Google and the world, with cost-effective and performant software stacks across hardware, frameworks, and model types.

In this role, you will join internal and cloud developers innovating model and ML-supported products with effortless and transparent use of performant, efficient, effective, high-functioning ML infrastructure. You will help us build the ML infrastructure between the top-level frameworks and target hardware as a platform, an operating system for ML programs.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $197,000-$291,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Develop and help lead the OSS JAX AI Inference Stack for third-party customers in GCP, for GPU and TPU.
  • Strategize and implement optimal inference performance, including selection and integration of framework, runtime, compiler.
  • Use a cross-stack, co-design approach to support GCP's diverse ML ecosystem needs for JAX and diverse hardware.
  • Develop stable, standardized APIs and modular offerings of each important layer of the inference stack. Ensure support for massive inference scale.
  • Build multi-cloud migration support for third-party.

Similar Jobs

ByteDance - Growth Strategy Product Manager - Global Payment

ByteDance

Singapore (On-Site)
3 Months ago
Epic Games - Senior Rendering Engineer

Epic Games

London, England, United Kingdom (On-Site)
2 Days ago
ByteDance - Backend Software Engineer Intern (PDI-CSP-FE-i18n) - 2025 Project Intern (BS/MS)

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Blind Squirrel Games - Senior Graphics Engineer

Blind Squirrel Games

California, United States (Remote)
3 Weeks ago
ByteDance - Software Engineer in Machine Learning Systems

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
ION - Senior Java Developer - Italy

ION

Milan, Lombardy, Italy (On-Site)
6 Months ago
MURKA - PHP Developer

MURKA

Poland (On-Site)
2 Months ago
Tencent - Cross-Border Payment Software Engineering Intern

Tencent

(On-Site)
1 Month ago
Eightfold - Lead Engineer- Backend

Eightfold

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Info Stretch - Senior Engineer

Info Stretch

Mumbai, Maharashtra, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Software Engineer, People with Disabilities

Google

(On-Site)
4 Months ago
Epic Games - Rendering Programmer

Epic Games

(On-Site)
3 Months ago
ByteDance - Senior Software Development Engineer - Distributed KV System

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
PlaySimple - Software Engineer (Unity)

PlaySimple

(On-Site)
3 Months ago
Warner Bros Games - Senior Software Engineer - Global Media Engine - Player

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
3 Weeks ago
SYBO - Mobile Platform and Tools Intern

SYBO

Copenhagen, Denmark (On-Site)
2 Months ago
DNEG - Software Developer – 2D Imaging and Nuke Tools

DNEG

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Altagram Group - Data Science Internship/Work Student

Altagram Group

Germany (On-Site)
2 Months ago
Wargaming - Game Data Analyst (World of Tanks)

Wargaming

Nicosia, Nicosia, Cyprus (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

AGS - American Gaming Systems - Field Service Technician I

AGS - American Gaming Systems

New Hampshire, United States (On-Site)
2 Months ago
Universal Music - Project Manager, Marketing

Universal Music

Nashville, Tennessee, United States (On-Site)
1 Day ago
NVIDIA - Senior ASIC Timing Engineer

NVIDIA

Austin, Texas, United States (On-Site)
1 Month ago
Sony Pictures Animation - Character Designer

Sony Pictures Animation

Los Angeles, California, United States (On-Site)
3 Weeks ago
ByteDance - Research Scientist for Generative AI, Multimodal and LLM

ByteDance

San Jose, California, United States (On-Site)
3 Hours ago
ByteDance - Senior Software Engineer, Cloud Infrastructure

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
Sandbox VR - Shift Lead (Key Holder)

Sandbox VR

Austin, Texas, United States (On-Site)
5 Months ago
100 Thieves - Esports Content Intern

100 Thieves

Culver City, California, United States (On-Site)
10 Months ago
Casumo - Customer Service Ambassador - English

Casumo

Macedonia, Ohio, United States (Hybrid)
2 Weeks ago
ByteDance - Cash Management - AMS

ByteDance

Los Angeles, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Next Level Business Services - Tealium Consultant

Next Level Business Services

San Antonio, Texas, United States (On-Site)
6 Months ago
Meta - Software Engineering Manager, Product Infrastructure

Meta

Menlo Park, California, United States (Remote)
5 Months ago
SKYDANCE - Senior Software Engineer

SKYDANCE

Santa Monica, California, United States (Hybrid)
2 Weeks ago
SmileGate - Group IT System Development and Operation

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
3 Months ago
Google - Staff Software Engineer, Google Cloud

Google

Ramat Gan, Tel Aviv District, Israel (On-Site)
1 Hour ago
Meta - Production Engineering

Meta

New York, New York, United States (On-Site)
5 Months ago
Meta - Software Engineer, Infrastructure

Meta

Sunnyvale, California, United States (Remote)
5 Months ago
Google - Senior Software Engineer, Multiplatform, Core

Google

Mexico City, Mexico City, Mexico (On-Site)
5 Months ago
ION - Senior Software Engineer - Full-Stack

ION

Budapest, Hungary (On-Site)
6 Months ago
Next Level Business Services - .NET Developer

Next Level Business Services

Minneapolis, Minnesota, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Portland, Oregon, United States (On-Site)

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Taipei City, Taiwan (On-Site)

Atlanta, Georgia, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug