Software Engineer, Vertex GenAI, Infrastructure and Features

7 Hours ago • 2 Years + • Artificial Intelligence

Job Summary

Job Description

Google is seeking a Software Engineer to design, develop, and maintain the infrastructure behind Vertex AI's GenAI APIs. Responsibilities include ensuring scalability, reliability, and performance; building and enhancing API features with Gemini, Imagen, and Embedding models; and collaborating with cross-functional teams (DeepMind, CoreML, Google Labs, etc.). The role requires experience in software development (C++, Python), backend development, and data structures/algorithms. The engineer will contribute to delivering generative AI solutions across industries, enabling enterprises and developers to integrate AI at scale.
Must have:
  • 2+ years software development (C++, Python)
  • 2+ years backend software development experience
  • Experience with data structures/algorithms
  • Design, develop, maintain Vertex AI infrastructure
  • Build and enhance GenAI API features
Good to have:
  • Master's/PhD in Computer Science
  • Experience with large-scale system design

Job Details

Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 2 years of experience in software development (e.g., C++, Python), and with data structures/algorithms.
  • 2 years of experience with backend software development.

Preferred qualifications:

  • Master's degree or PhD in Computer Science, or a related technical field.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

We build cutting-edge API infrastructure and deliver essential features to provide seamless access to Google’s state-of-the-art Generative AI (GenAI) models (e.g., Gemini, Imagen, and embedding models), through efficient, scalable, and reliable APIs.

We support both online and batch access to these models, offering advanced features like code execution, function calling, and more. Our team is foundational to delivering generative AI solutions across industries, empowering enterprises and developers to integrate AI into their products and services at scale.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

Responsibilities

  • Design, develop, and maintain the infrastructure behind Vertex AI’s GenAI APIs, ensuring scalability, reliability, and performance.
  • Build and enhance Application programming interface (API) features with generations of Gemini, Imagen and Embedding models.
  • Collaborate with cross-functional teams, including Deepmind, CoreML, Google Labs, Search and cloud infrastructure engineers, to deliver high-quality, production-grade solutions.

Similar Jobs

NVIDIA - Senior Application Software Engineer, Performance

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Weeks ago
Voodoo - Lead Multiplayer Game Developer - Paper.io 2

Voodoo

Barcelona, Catalonia, Spain (Remote)
1 Month ago
MURKA - Data Scientist

MURKA

Poland (On-Site)
2 Months ago
ByteDance - Product Operations - Search Ads Team

ByteDance

Tokyo, Japan (On-Site)
2 Days ago
Inworld AI - Staff / Principal AI Researcher - USA

Inworld AI

Mountain View, California, United States (Remote)
4 Months ago
ByteDance - Machine Learning Engineer - Pico Perception

ByteDance

San Jose, California, United States (On-Site)
3 Weeks ago
ByteDance - LLM Software Engineer/Researcher (Applied Machine Learning)

ByteDance

Seattle, Washington, United States (On-Site)
3 Weeks ago
Netomi - Implementation Consultant

Netomi

United States (Remote)
6 Months ago
NVIDIA - Senior Software Engineer - Automated Parallel Programming

NVIDIA

Santa Clara, California, United States (Remote)
2 Months ago
Discord - Director of Machine Learning, Safety

Discord

San Francisco, California, United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Microsoft - Senior Data Scientist - Microsoft Threat Protection

Microsoft

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
16 Hours ago
Google - Senior Software Developer, Site Reliability Engineering, Google Cloud

Google

Raleigh, North Carolina, United States (On-Site)
5 Months ago
Vigaet - Machine Learning Engineer-Internship

Vigaet

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Genies - Senior Engineer, Core Systems

Genies

Los Angeles, California, United States (On-Site)
4 Weeks ago
ByteDance - Backend Engineer Intern, Video-On-Demand

ByteDance

Singapore (On-Site)
3 Weeks ago
Digital Extremes - Senior Graphics Programmer

Digital Extremes

(Remote)
3 Weeks ago
Microsoft - Member of Technical Staff, AI - Reinforcement Learning Systems

Microsoft

Mountain View, California, United States (Hybrid)
2 Days ago
ByteDance - Software Development Engineer Graduate (Distributed NoSQL Database Systems)

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Google - Software Engineer III, Full Stack, Google Cloud

Google

Hyderabad, Telangana, India (On-Site)
5 Months ago
Google - Senior Data Scientist, gTech Ads GCS Partner Engineering

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
8 Hours ago

Get notifed when new similar jobs are uploaded

Jobs in Warsaw, Masovian Voivodeship, Poland

People Can Fly - Sound Designer

People Can Fly

Katowice, Silesian Voivodeship, Poland (On-Site)
2 Months ago
Activision - Senior Expert Engine Programmer

Activision

Warsaw, Masovian Voivodeship, Poland (On-Site)
4 Months ago
Google - Software Engineer III, Google Kubernetes Engine

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Months ago
CloudLinux - Senior Go Developer for Imunify360

CloudLinux

Masovian Voivodeship, Poland (Remote)
2 Weeks ago
Testronic - LQA Game Tester with Czech

Testronic

Masovian Voivodeship, Poland (Hybrid)
2 Weeks ago
Larian Studios - QA Engineer (Game Engine)

Larian Studios

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
Larian Studios - DevOps Full-Stack Engineer

Larian Studios

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
Untold Tales - Graphic Designer

Untold Tales

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
2 Weeks ago
Techland - Junior Rendering Programmer

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
1 Week ago
Microsoft - Principal Software Engineer

Microsoft

Warsaw, Masovian Voivodeship, Poland (On-Site)
16 Hours ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

PwC - AI/ML Azure Engineer (m/f/d)

PwC

Luxembourg (On-Site)
6 Months ago
NVIDIA - Senior System Networking Engineer, InfiniBand

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
ByteDance - Solutions Architect

ByteDance

Gurugram, Haryana, India (On-Site)
3 Weeks ago
Meta - AI Research Scientist - Generative AI Red Teaming (London or Paris)

Meta

Zürich, Zurich, Switzerland (On-Site)
5 Months ago
Tencent - Senior Researcher, Natural Language Processing

Tencent

(On-Site)
1 Month ago
Google - Software Engineer III, Machine Learning, Google Ads

Google

Mountain View, California, United States (On-Site)
5 Months ago
CloudHire - Machine Learning Engineer

CloudHire

India (Remote)
4 Weeks ago
NVIDIA - Technical Marketing Engineer - AI Platform Software

NVIDIA

Santa Clara, California, United States (Hybrid)
1 Month ago
ByteDance - Senior Software Engineer - Generative AI

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Google - Customer Engineer, Cloud AI, Google Cloud

Google

New York, New York, United States (On-Site)
7 Hours ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Dublin, County Dublin, Ireland (On-Site)

Sunnyvale, California, United States (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Hyderabad, Telangana, India (On-Site)

Sunnyvale, California, United States (On-Site)

Sydney, New South Wales, Australia (On-Site)

Waterloo, Ontario, Canada (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug