Software Engineer II, AI/ML, Cloud AI Infrastructure

1 Day ago • 1 Years + • Artificial Intelligence

Job Summary

Job Description

This Software Engineer II role at Google focuses on AI/ML infrastructure within the MSCA organization. Responsibilities include measuring and optimizing AI/ML model performance on Google Cloud, resolving performance issues, collaborating with infrastructure teams, developing training and demos, contributing to product improvement through bug identification and code enhancements, and conducting performance profiling and debugging. The ideal candidate will have experience with software development (Python, C++, Java, etc.), ML infrastructure, cloud services (Compute, Storage, Networking), and a strong understanding of AI/ML model performance optimization.
Must have:
  • 1+ years software development experience
  • Experience with ML infrastructure or performance
  • Cloud services experience (Compute, Storage, Networking)
  • Performance optimization and debugging skills
  • High-quality code development and testing
Good to have:
  • Master's or PhD in Computer Science
  • Experience with specific AI/ML models

Job Details


Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 1 year of experience with software development in one or more programming languages (e.g., Python, C, C++, Java, JavaScript).

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical field.
  • 1 year of experience with ML infrastructure or performance.
  • Experience in cloud services such as Compute, Storage, and Networking.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

Responsibilities

  • Measure and optimize AI/ML model performance on Google Cloud infrastructure.
  • Identify and resolve performance issues and collaborate with internal infrastructure teams to enhance support for demanding AI workloads as needed.
  • Develop and deliver high-quality training and demos for both customers and internal teams.
  • Contribute to ongoing product improvement by identifying bugs, recommending enhancements, and writing and testing production-quality code.
  • Conduct performance profiling, debugging, and troubleshooting of training and inference workloads, ensuring adherence to best practices through design and code reviews.

Similar Jobs

Microsoft - Member of Technical Staff, AI Reinforcement Systems

Microsoft

Zürich, Zurich, Switzerland (On-Site)
1 Week ago
Relax Gaming  - Poker Backend Software Engineer

Relax Gaming

Helsinki, Uusimaa, Finland (Hybrid)
2 Months ago
Trend Micro - Cloud Engineer (Golang/Python, Backend Focus) 雲端開發工程師

Trend Micro

Taipei City, Taiwan (On-Site)
6 Months ago
Google - Software Engineer II, Test Fleet Management

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Week ago
Epic Games - Senior DevOps Programmer

Epic Games

Vancouver, British Columbia, Canada (On-Site)
2 Weeks ago
Google - Software Engineer III, AI/ML, Geo

Google

Mountain View, California, United States (On-Site)
1 Week ago
Razer - Solutions Architect

Razer

Singapore (On-Site)
7 Months ago
Airlab Inc  - C++ & Python Programmer

Airlab Inc

Montreal, Quebec, Canada (On-Site)
9 Months ago
Meta - Research Intern, Computer Vision for Egocentric Representation Learning (PhD)

Meta

Redmond, Washington, United States (On-Site)
5 Months ago
Google - Group Product Manager, Machine Learning Frameworks Applied Ecosystem

Google

Mountain View, California, United States (On-Site)
1 Day ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Reliance Industries  - Manual Do QA

Reliance Industries

Bengaluru, Karnataka, India (On-Site)
5 Months ago
ByteDance - Site Reliability Engineer, Edge Services

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
GEA Group - HMI Software Engineer

GEA Group

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Netflix - Distributed Systems Engineer (L5), Content Engineering

Netflix

California, United States (Remote)
4 Months ago
Google - Senior Solutions Acceleration Architect, Applications

Google

Bengaluru, Karnataka, India (On-Site)
23 Hours ago
ByteDance - Research Engineer / Scientist - AI for Databases

ByteDance

San Jose, California, United States (On-Site)
1 Day ago
4ThePlayer - REMOTE Backend TypeScript Developer

4ThePlayer

(Remote)
2 Weeks ago
ByteDance - Software Engineer - Serverless Compute Infrastructure

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
ARHS - Java Developer

ARHS

Leuven, Flanders, Belgium (On-Site)
6 Months ago
Interactive Brokers - Senior Software Engineer

Interactive Brokers

Greenwich, Connecticut, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

Microsoft - Senior Technical Support Engineer

Microsoft

Taipei City, Taiwan (Hybrid)
1 Week ago
Trend Micro - Staff/Sr. Cloud Service Engineer (VicOne_ Automotive Security)

Trend Micro

Taipei City, Taiwan (On-Site)
7 Months ago
Google - Senior System Software Engineer, Embedded Systems, Firmware, Pixel

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Week ago
Google - Software Engineering Manager, Pixel Core System Software

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Day ago
NVIDIA - System Software Engineer, GPU - New College Graduate

NVIDIA

Taipei City, Taiwan (On-Site)
2 Weeks ago
NVIDIA - Senior Mixed Signal Design Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
3 Months ago
USE Insider - Marketing Manager - Taiwan

USE Insider

Taipei City, Taiwan (Hybrid)
6 Months ago
Google - Thermal Engineering Manager, Google Cloud

Google

Taipei City, Taiwan (On-Site)
1 Week ago
Google - Software Engineer, Partner Engineering, Google Home

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Week ago
The Walt Disney Company - Marketing Intern

The Walt Disney Company

Taipei City, Taiwan (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Google - Customer Solutions Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago
Google - Software Engineer, Performance Modeling

Google

Durham, North Carolina, United States (On-Site)
1 Week ago
Google - Staff Software Engineer, GPU Performance, Google Scale

Google

Kirkland, Washington, United States (On-Site)
1 Week ago
Xsolla - Machine Learning Engineer

Xsolla

Montreal, Quebec, Canada (Remote)
1 Week ago
Keywords Studios - Research Associate - Fresher

Keywords Studios

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
ION - Software/Artificial Intelligence Engineer - Graduate Development Program

ION

Pisa, Tuscany, Italy (Hybrid)
3 Months ago
Google - Cloud AI Engineer, Global Services Delivery

Google

Mexico City, Mexico City, Mexico (On-Site)
1 Day ago
Scale AI - Machine Learning Engineer, International Public Sector

Scale AI

United Kingdom (On-Site)
6 Months ago
Google - Applied AI Engineering Lead, Core Enterprise, Core

Google

Hyderabad, Telangana, India (On-Site)
1 Week ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Dublin, County Dublin, Ireland (On-Site)

New York, New York, United States (On-Site)

Waterloo, Ontario, Canada (On-Site)

Taipei City, Taiwan (On-Site)

San Francisco, California, United States (On-Site)

Saint-Ghislain, Wallonia, Belgium (On-Site)

Bengaluru, Karnataka, India (On-Site)

Austin, Texas, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug