Software Engineer II, AI/ML, Cloud AI Infrastructure

3 Days ago • 1 Years + • Artificial Intelligence

Job Summary

Job Description

This Software Engineer II role at Google focuses on AI/ML infrastructure within the MSCA organization. Responsibilities include measuring and optimizing AI/ML model performance on Google Cloud, resolving performance issues, collaborating with infrastructure teams, developing training and demos, contributing to product improvement through bug identification and code enhancements, and conducting performance profiling and debugging. The ideal candidate will have experience with software development (Python, C++, Java, etc.), ML infrastructure, cloud services (Compute, Storage, Networking), and a strong understanding of AI/ML model performance optimization.
Must have:
  • 1+ years software development experience
  • Experience with ML infrastructure or performance
  • Cloud services experience (Compute, Storage, Networking)
  • Performance optimization and debugging skills
  • High-quality code development and testing
Good to have:
  • Master's or PhD in Computer Science
  • Experience with specific AI/ML models

Job Details


Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 1 year of experience with software development in one or more programming languages (e.g., Python, C, C++, Java, JavaScript).

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical field.
  • 1 year of experience with ML infrastructure or performance.
  • Experience in cloud services such as Compute, Storage, and Networking.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

Responsibilities

  • Measure and optimize AI/ML model performance on Google Cloud infrastructure.
  • Identify and resolve performance issues and collaborate with internal infrastructure teams to enhance support for demanding AI workloads as needed.
  • Develop and deliver high-quality training and demos for both customers and internal teams.
  • Contribute to ongoing product improvement by identifying bugs, recommending enhancements, and writing and testing production-quality code.
  • Conduct performance profiling, debugging, and troubleshooting of training and inference workloads, ensuring adherence to best practices through design and code reviews.

Similar Jobs

Niantic - Software Engineer, Server

Niantic

Tokyo, Japan (Hybrid)
2 Weeks ago
Progres - Manager, Software Engineering

Progres

Burlington, Massachusetts, United States (Hybrid)
4 Weeks ago
Epic Games - Backend Security Programmer (Asset Integrity)

Epic Games

Montreal, Quebec, Canada (On-Site)
2 Weeks ago
Knuddels - Initiativbewerbung Werkstudent*in Softwareentwicklung (m/w/d) - Karlsruhe

Knuddels

Karlsruhe, Baden-Württemberg, Germany (On-Site)
6 Months ago
Netflix - Android UI Engineer (L5) - Games Player Experiences

Netflix

United States (Remote)
2 Weeks ago
The Walt Disney Company - Lead Applied AI Engineer

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Month ago
Google - Software Engineer III, Core Machine Learning, Google Cloud

Google

Mountain View, California, United States (On-Site)
5 Months ago
Google - AI Transformation Manager, Professional Services, Google Cloud

Google

Toronto, Ontario, Canada (On-Site)
2 Days ago
The Walt Disney Company - Lead Machine Learning Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
1 Month ago
NVIDIA - Principal Software Engineer - Enterprise AI Platform

NVIDIA

Santa Clara, California, United States (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Software Engineer, PhD

Google

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Temporal Technologies - Senior Developer Success Engineer

Temporal Technologies

(Remote)
8 Hours ago
Riot Games - Manager, Software Engineering - Teamfight Tactics, Core Tech

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago
Google - Senior Software Engineer, Full Stack

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

New York, New York, United States (On-Site)
5 Months ago
PwC - Associate, Data and Analytics Advisory

PwC

Kolkata, West Bengal, India (On-Site)
1 Month ago
Fluxon - Senior Software Engineer

Fluxon

Bengaluru, Karnataka, India (Remote)
6 Months ago
The Walt Disney Company - Software Engineer II - Databases

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
1 Month ago
Sporty Group - Software Engineering Team Lead- LatAm

Sporty Group

(Remote)
5 Months ago
Google - Early Career Software Engineer, People with Disabilities

Google

Belo Horizonte, State Of Minas Gerais, Brazil (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

Google - Software Engineer III, BIOS, Google Cloud Platform

Google

Taipei City, Taiwan (On-Site)
1 Week ago
Google - Software Engineer, PhD, Cloud Platforms

Google

Taipei City, Taiwan (On-Site)
2 Weeks ago
Google - Senior Software Engineer, Pixel Sensor

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Weeks ago
Cadence - Software Engineer II

Cadence

Hsinchu, Hsinchu City, Taiwan (On-Site)
1 Day ago
Ansys - Team Lead Field Marketing

Ansys

Taipei City, Taiwan (On-Site)
1 Day ago
Corsair - Global Sourcing Manager

Corsair

Taipei City, Taiwan (On-Site)
1 Month ago
PwC - T.稅務類-企業併購 (Mergers & Acquisitions) 稅務顧問

PwC

Taipei City, Taiwan (On-Site)
3 Months ago
Google - Test Engineer, Pixel Software

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Weeks ago
NVIDIA - Mixed Signal Analog Circuit Designer (RDSS Intern)

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago
NVIDIA - Test Floor Product Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Google - Staff Software Engineer, Generative AI, Google Workspace

Google

Kirkland, Washington, United States (On-Site)
2 Weeks ago
Krafton  - Technical Project Manager, Deep Learning Division

Krafton

Seoul, South Korea (On-Site)
3 Months ago
Google - Photonic Engineer, Machine Learning Systems, Platforms

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
DOTSOFT SA - AI Engineer | NLP & Large Language Models Specialist

DOTSOFT SA

Greece (Remote)
1 Week ago
Plarium - Director of Gen-AI

Plarium

Herzliya, Tel Aviv District, Israel (On-Site)
2 Months ago
Eleven Labs - Forward Deployed Engineer - Strategist

Eleven Labs

Poland (Remote)
1 Month ago
Scale AI - Senior Software Engineer, GenAI Model Evaluation

Scale AI

San Francisco, California, United States (On-Site)
6 Months ago
Google - Software Engineer III, Machine Learning, Google Ads

Google

Los Angeles, California, United States (On-Site)
5 Months ago
Google - Student Researcher, PhD, Winter/Summer 2025

Google

Ann Arbor, Michigan, United States (On-Site)
5 Months ago
The Walt Disney Company - Lead Software Engineer - Applied AI & Machine Learning

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug