Software Engineer III, AI/ML, Cloud AI Infrastructure

1 Month ago • 2-4 Years • Artificial Intelligence

Job Summary

Job Description

Google is seeking a Software Engineer III to focus on AI/ML and Cloud AI infrastructure. Responsibilities include measuring and optimizing AI/ML model performance on Google Cloud, identifying and resolving performance bottlenecks, developing training and demos, contributing to product improvement through bug fixes and code enhancements, and conducting performance profiling and troubleshooting. The role requires collaboration with internal teams and adherence to best practices. The ideal candidate will have experience with software development, data structures and algorithms, ML infrastructure, and cloud services (particularly GCP).
Must have:
  • 2+ years software development experience
  • Experience with data structures/algorithms
  • Measure and optimize AI/ML model performance
  • Identify and resolve performance bottlenecks
  • Develop high-quality training and demos
Good to have:
  • Master's/PhD in CS or related field
  • 4+ years software development experience
  • 1 year experience with ML infrastructure
  • Proficient in GCP cloud services

Job Details


Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
  • 2 years of experience with data structures or algorithms.

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical fields.
  • 4 years of experience in software development using one or more programming languages, with expertise in data structures and algorithms.
  • 1 year of experience with ML infrastructure or performance.
  • Proficient in cloud services such as Compute, Storage, and Networking, particularly on Google Cloud Platform.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

Responsibilities

  • Measure and optimize AI/ML model performance on Google Cloud infrastructure.
  • Identify and resolve performance bottlenecks, collaborating with internal infrastructure teams to enhance support for demanding AI workloads as needed.
  • Develop and deliver high-quality training and demos for both customers and internal teams.
  • Contribute to ongoing product improvement by identifying bugs, recommending enhancements, and writing and testing production-quality code.
  • Conduct in-depth performance profiling, debugging, and troubleshooting of training and inference workloads, ensuring adherence to best practices through design and code reviews.

Similar Jobs

ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Generative AI) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
7 Months ago
Google - Senior Software Engineer, Applied AI

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Month ago
Microsoft - Responsible Content Specialist

Microsoft

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Playrix - Senior Data Analyst (Attribution)

Playrix

Armenia (Remote)
7 Months ago
GoMotive - Associate SQA Engineer

GoMotive

(Remote)
1 Month ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
1 Month ago
Light Speed Studios - Senior Researcher, Natural Language Processing

Light Speed Studios

Tokyo, Japan (On-Site)
2 Months ago
Trend Micro - Sr. Data Scientist (AI Lab)

Trend Micro

Taipei City, Taiwan (On-Site)
8 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

San Jose, California, United States (On-Site)
7 Months ago
Meta - AI Research Scientist - Generative AI Red Teaming (London or Paris)

Meta

Paris, Île-de-France, France (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Axon - DSP Engineer

Axon

Kassel, Hessen, Germany (On-Site)
1 Month ago
Warner Bros Games - Senior Analytics Engineer

Warner Bros Games

(Hybrid)
3 Months ago
Evolution - C++ Developer (Video)

Evolution

Riga, Latvia (On-Site)
5 Months ago
ByteDance - Data Analyst - Corporate Information System

ByteDance

Singapore (On-Site)
1 Month ago
Google - Senior Software Engineer, Embedded Systems and Firmware

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Interface AI - Vice President of Engineering

Interface AI

(Remote)
1 Month ago
GoMotive - Technical Lead Manager, Embedded Safety

GoMotive

United States (Remote)
2 Months ago
Google - Software Engineering Manager II, SRE, Cloud Logs

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Wargaming - Game Developer

Wargaming

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Months ago
Google - Technical Program Manager, Pixel Watch Test Engineering

Google

Bucharest, Bucharest, Romania (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in New Taipei, New Taipei City, Taiwan

Ansys - Team Lead Field Marketing

Ansys

Taipei City, Taiwan (On-Site)
1 Month ago
Google - CPU Design Verification Engineer

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
Ansys - R&D Engineer II

Ansys

Hsinchu County, Taiwan (On-Site)
1 Month ago
WildBrain - Senior Licensing Manager

WildBrain

Taipei City, Taiwan (Hybrid)
1 Month ago
Google - ML System Engineer, AICore, Platforms and Devices

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Nahc io - Senior Marketing Manager (Kid's Toy)

Nahc io

Taipei City, Taiwan (On-Site)
2 Months ago
Google - Customer Engineer, Google Cloud Security

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Google - Technical Solutions Manager, Customer Experience, gTech Ads Sellside

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Rivos - Analog Mixed Signal Design

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
7 Months ago
NVIDIA - Senior Mixed Signal Designer Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Google - ML System Engineer, AICore

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Zoox - Senior Machine Learning Engineer - Collision Avoidance System

Zoox

Foster City, California, United States (Hybrid)
7 Months ago
Google - Customer Engineer III, Applied AI, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Zoox - Senior/Staff Software Engineer - Prediction Integration

Zoox

Foster City, California, United States (Hybrid)
7 Months ago
Google - Software Engineer III, AI/ML Recommendations, Rankings, Predictions, Core

Google

Mountain View, California, United States (On-Site)
1 Month ago
Google - Software Engineering Manager, AICore, Applied ML

Google

Taipei City, Taiwan (On-Site)
1 Month ago
ByteDance - Research Scientist for Generative AI, Multimodal and LLM

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Google - Senior Software Engineer, SDLC, Gemini Code Assist

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Krafton  - Deep Learning Strategy & Operations Associate

Krafton

Seoul, South Korea (On-Site)
3 Months ago
Balbix - Staff AI Engineer

Balbix

Bengaluru, Karnataka, India (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Taipei City, Taiwan (On-Site)

Zürich, Zurich, Switzerland (On-Site)

Kirkland, Washington, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug