Staff Software Engineer, Machine Learning, JAX Third Party

1 Month ago • 8-11 Years • Full Stack Development • $197,000 PA - $291,000 PA

Job Summary

Job Description

This Staff Software Engineer role focuses on developing and leading the open-source JAX AI Inference Stack for GCP's third-party customers. Responsibilities include optimizing inference performance across diverse hardware (GPU, TPU), designing stable APIs, ensuring support for massive scale, and building multi-cloud migration support. The ideal candidate will have extensive experience in software development, ML design and infrastructure, and software architecture, along with strong leadership and cross-functional collaboration skills. The role involves a cross-stack, co-design approach to meet GCP's diverse ML ecosystem needs for JAX.
Must have:
  • 8+ years software development experience
  • 5+ years ML design & infrastructure experience
  • 3+ years software design & architecture experience
  • Develop and lead OSS JAX AI Inference Stack
  • Optimize inference performance (GPU/TPU)
  • Build multi-cloud migration support
Good to have:
  • Master's/PhD in related field
  • 8+ years data structures/algorithms experience
  • Technical leadership experience
  • Experience in complex, matrixed organizations
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing, and launching software products.
  • 5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 3 years of experience with software design and architecture.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 8 years of experience with data structures/algorithms.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

Our team's mission is end-to-end training and inference success for Google and the world, with cost-effective and performant software stacks across hardware, frameworks, and model types.

In this role, you will join internal and cloud developers innovating model and ML-supported products with effortless and transparent use of performant, efficient, effective, high-functioning ML infrastructure. You will help us build the ML infrastructure between the top-level frameworks and target hardware as a platform, an operating system for ML programs.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $197,000-$291,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Develop and help lead the OSS JAX AI Inference Stack for third-party customers in GCP, for GPU and TPU.
  • Strategize and implement optimal inference performance, including selection and integration of framework, runtime, compiler.
  • Use a cross-stack, co-design approach to support GCP's diverse ML ecosystem needs for JAX and diverse hardware.
  • Develop stable, standardized APIs and modular offerings of each important layer of the inference stack. Ensure support for massive inference scale.
  • Build multi-cloud migration support for third-party.

Similar Jobs

IMC - C++ Software Engineer

IMC

Sydney, New South Wales, Australia (On-Site)
1 Month ago
Google - Software Engineer III, Platforms

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Powerintegration - Senior Product Marketing Manager

Powerintegration

San Jose, California, United States (On-Site)
2 Months ago
Google - Senior Software Engineer, Pixel Camera

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Video Generative Model)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Polygon Labs - Senior Software Engineer

Polygon Labs

(Remote)
2 Months ago
PwC - Senior .NET Developer

PwC

Athens, Greece (Remote)
4 Months ago
Google - Senior Staff Software Engineer, Common Expression Language

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
N-iX - Senior .NET Engineer (with ETL Experience)

N-iX

Poland (Remote)
1 Month ago
Google - Staff Engineer Tech Lead, Opinion Rewards, Google Ads

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

CharacterAI - Research Engineer, Post-Training

CharacterAI

New York, New York, United States (On-Site)
2 Months ago
ByteDance - Video Pipeline Engineer/Architect- Pico- San Jose

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Google - Software Engineer III, Research

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
ByteDance - Machine Learning Engineer, E-commerce Governance Algorithms

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
Epic Games - Physics Programmer

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
Balbix - Staff /Sr Staff/ Principal Engineer - Lakehouse

Balbix

Gurugram, Haryana, India (On-Site)
7 Months ago
Cerence - Senior Software Engineer

Cerence

Pune, Maharashtra, India (On-Site)
1 Month ago
ByteDance - Content Insights Analyst, Lifestyle

ByteDance

Los Angeles, California, United States (On-Site)
2 Months ago
Google - Staff Software Engineer, Storage

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Granicus - Data Scientist 4

Granicus

(Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

Netflix - Distributed Systems Engineer (L5), Content Engineering

Netflix

California, United States (Remote)
5 Months ago
Zinnia - CRM Marketing Manager

Zinnia

New York, New York, United States (Hybrid)
1 Month ago
Microsoft - Member of Technical Staff, Machine Learning Engineer

Microsoft

Mountain View, California, United States (Hybrid)
1 Month ago
Global Step - Senior Games Tester (Flight Sim Specialization)

Global Step

Dallas, Texas, United States (On-Site)
2 Months ago
Cognite - (Senior) Frontend Engineer

Cognite

Austin, Texas, United States (Hybrid)
2 Months ago
ByteDance - Security System Engineer

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Coherent Corp - Lab Technician

Coherent Corp

Hillsborough Township, New Jersey, United States (On-Site)
3 Weeks ago
NBC universal - Multi-Platform Producer

NBC universal

Centennial, Colorado, United States (On-Site)
1 Month ago
Trek - MHI Guest Services Associate

Trek

Madison, Wisconsin, United States (On-Site)
3 Months ago
Nfocus solution - Test Engineer

Nfocus solution

Orlando, Florida, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

ARHS - Full-stack .NET Developer

ARHS

The Hague, South Holland, Netherlands (Remote)
7 Months ago
Google - Software Engineer III, Full Stack, Google Cloud Business Platforms

Google

Kirkland, Washington, United States (On-Site)
1 Month ago
Google - Senior Software Engineer, iOS

Google

Raleigh, North Carolina, United States (On-Site)
1 Month ago
Canva - Staff Backend Engineer - Product Insights Enablement - Java

Canva

Sydney, New South Wales, Australia (Remote)
3 Months ago
Google - Software Engineer III, Infrastructure, Platforms Infrastructure Engineering

Google

Sunnyvale, California, United States (On-Site)
5 Months ago
Google - Engineering Manager, Google Play Store

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
PwC - Consultor Salesforce

PwC

Santa Cruz De Tenerife, Canary Islands, Spain (On-Site)
8 Months ago
Warner Bros Games - Software Engineer II - C++

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Google - Senior Software Engineer, Google Cloud Compute Infrastructure

Google

Kirkland, Washington, United States (On-Site)
6 Months ago
Aristocrat Gaming - Software Development Engineer I

Aristocrat Gaming

North Ryde, New South Wales, Australia (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Taipei City, Taiwan (On-Site)

Zürich, Zurich, Switzerland (On-Site)

Kirkland, Washington, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug