Staff Software Engineer, Machine Learning, JAX Third Party

2 Weeks ago • 8-11 Years • Full Stack Development • $197,000 PA - $291,000 PA

Job Summary

Job Description

This Staff Software Engineer role focuses on developing and leading the open-source JAX AI Inference Stack for GCP's third-party customers. Responsibilities include optimizing inference performance across diverse hardware (GPU, TPU), designing stable APIs, ensuring support for massive scale, and building multi-cloud migration support. The ideal candidate will have extensive experience in software development, ML design and infrastructure, and software architecture, along with strong leadership and cross-functional collaboration skills. The role involves a cross-stack, co-design approach to meet GCP's diverse ML ecosystem needs for JAX.
Must have:
  • 8+ years software development experience
  • 5+ years ML design & infrastructure experience
  • 3+ years software design & architecture experience
  • Develop and lead OSS JAX AI Inference Stack
  • Optimize inference performance (GPU/TPU)
  • Build multi-cloud migration support
Good to have:
  • Master's/PhD in related field
  • 8+ years data structures/algorithms experience
  • Technical leadership experience
  • Experience in complex, matrixed organizations
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing, and launching software products.
  • 5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 3 years of experience with software design and architecture.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 8 years of experience with data structures/algorithms.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

Our team's mission is end-to-end training and inference success for Google and the world, with cost-effective and performant software stacks across hardware, frameworks, and model types.

In this role, you will join internal and cloud developers innovating model and ML-supported products with effortless and transparent use of performant, efficient, effective, high-functioning ML infrastructure. You will help us build the ML infrastructure between the top-level frameworks and target hardware as a platform, an operating system for ML programs.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $197,000-$291,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Develop and help lead the OSS JAX AI Inference Stack for third-party customers in GCP, for GPU and TPU.
  • Strategize and implement optimal inference performance, including selection and integration of framework, runtime, compiler.
  • Use a cross-stack, co-design approach to support GCP's diverse ML ecosystem needs for JAX and diverse hardware.
  • Develop stable, standardized APIs and modular offerings of each important layer of the inference stack. Ensure support for massive inference scale.
  • Build multi-cloud migration support for third-party.

Similar Jobs

Sports radar - Front End Developer (React)

Sports radar

Athens, Greece (On-Site)
1 Month ago
Playrix - UA Marketing Producer

Playrix

Serbia (Remote)
6 Months ago
ByteDance - Research Scientist, Foundation Model, Music Intelligence

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Google - Software Engineer II, Fitbit Wear OS

Google

Bucharest, Bucharest, Romania (On-Site)
1 Week ago
ByteDance - Algorithm Engineer - Audio Understanding

ByteDance

Singapore (On-Site)
6 Months ago
The Walt Disney Company - Senior Software Engineer (Swift)

The Walt Disney Company

Seattle, Washington, United States (On-Site)
2 Weeks ago
Google - Software Engineer III, Infrastructure, Google Cloud NetInfra

Google

Sunnyvale, California, United States (On-Site)
5 Months ago
The Walt Disney Company - Lead Software Engineer, Ad Platforms

The Walt Disney Company

San Francisco, California, United States (On-Site)
1 Month ago
N-iX - Senior .NET Engineer (with ETL Experience)

N-iX

Poland (Remote)
2 Weeks ago
Tap Nation - Senior Fullstack Developer

Tap Nation

New York, New York, United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

AI Fund - AI Lead

AI Fund

(Remote)
9 Months ago
Wargaming - Senior Gameplay Programmer (World of Warships)

Wargaming

Belgrade, Serbia (Hybrid)
1 Week ago
Microsoft - Member of Technical Staff, Machine Learning Engineer

Microsoft

Mountain View, California, United States (Hybrid)
3 Days ago
Hitachi - Data Science

Hitachi

Pune, Maharashtra, India (On-Site)
6 Months ago
Google - Software Engineer III, AI/ML, Geo

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
Google - Senior Software Engineer, Applied AI

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
2 Weeks ago
NVIDIA - Research Scientist - Design Automation

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
2 Months ago
Google - Software Engineer III, Infrastructure, Google Cloud Data Management

Google

Kirkland, Washington, United States (On-Site)
2 Days ago
PlayStation Global - Senior Software Engineer (Back End / Machine Learning)

PlayStation Global

San Mateo, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

Rapt Studio - Designer (Interior Design/Architecture)

Rapt Studio

San Francisco, California, United States (Hybrid)
6 Months ago
Airbyte - Enterprise Business Development Representative

Airbyte

San Francisco, California, United States (On-Site)
1 Day ago
Patel greene - Senior Drainage Engineer

Patel greene

Orlando, Florida, United States (On-Site)
7 Hours ago
ByteDance - Staff Frontend Software Engineer - Customer Service Platform - Seattle

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Hudl - Senior Product Manager - North American Sports

Hudl

Lexington, Kentucky, United States (Hybrid)
1 Day ago
The Walt Disney Company - Senior Graphic Designer (Project Hire)

The Walt Disney Company

Lake Buena Vista, Florida, United States (On-Site)
2 Weeks ago
Epic Games - Test Lead

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago
Trek - Service Advisor

Trek

Boulder, Colorado, United States (On-Site)
2 Months ago
ByteDance - Backend Software Engineer - Security Engineering

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Lionsgate Games - Executive Assistant, Office of the CEO

Lionsgate Games

Santa Monica, California, United States (On-Site)
3 Days ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Rockstar Games - Software Engineer, Java (Mid/Senior)

Rockstar Games

Dundee, Scotland, United Kingdom (On-Site)
1 Week ago
Google - Software Engineer II, Chrome Enterprise Core

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Days ago
USE Insider - Senior Shopify Developer

USE Insider

İstanbul, İstanbul, Türkiye (Remote)
6 Months ago
GoMotive - Staff System Software Engineer (Superbuilder) - Embedded

GoMotive

United States (Remote)
1 Month ago
Luxoft - Software Engineer (Node.js)

Luxoft

Sydney, New South Wales, Australia (On-Site)
4 Months ago
Google - Customer Solutions Engineer

Google

Seattle, Washington, United States (On-Site)
2 Weeks ago
PhonePe - Software Engineer - Test (4-6yrs) - (Pune)

PhonePe

Pune, Maharashtra, India (On-Site)
5 Months ago
Brillio - For testing purpose - R01539561

Brillio

London, England, United Kingdom (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug