Senior Software Engineer, LLM Code Agents

1 Month ago • 5-8 Years • Artificial Intelligence • $166,000 PA - $244,000 PA

Job Summary

Job Description

Google is seeking a Senior Software Engineer to contribute to the development of next-generation technologies involving Large Language Models (LLMs) and code agents. This role requires strong software engineering skills, experience with ML infrastructure (model deployment, evaluation, optimization), and expertise in at least one specialized ML area (speech/audio, reinforcement learning, etc.). Responsibilities include writing and testing code, collaborating on design and code reviews, contributing to documentation, debugging and resolving system issues, and designing and implementing solutions leveraging ML infrastructure. The ideal candidate will have experience with LLMs, Generative AI, and AI Agents. The position offers opportunities to work on critical projects and contribute to cutting-edge technologies within Google Labs.
Must have:
  • 5+ years software development experience
  • 3+ years ML infrastructure experience
  • 3+ years experience with speech/audio, RL, or other ML field
  • Experience with LLM, Generative AI, AI agents
  • Strong software design and architecture skills
Good to have:
  • Master's/PhD in CS or related field
  • Experience in technical leadership
  • Experience with performance analysis and visualization
  • Experience developing accessible technologies

Job Details


Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • 3 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.
  • 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).

Preferred qualifications:

  • Master's degree or PhD in Computer Science or related technical field.
  • 3 years of experience with performance, systems data analysis, visualization tools, or debugging.
  • 1 year of experience in a technical leadership role.
  • Experience with Large Language Models, Generative AI, and AI Agents.
  • Experience in code and system health, diagnosis and resolution, and software test engineering.
  • Experience developing accessible technologies.

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Labs is a group focused on incubating early-stage efforts in support of Google’s mission to organize the world’s information and make it universally accessible and useful. Our team exists to help discover and create new ways to advance our core products through exploration and the application of new technologies. We work to build new solutions that have the potential to transform how users interact with Google. Our goal is to drive innovation by developing new Google products and capabilities that deliver significant impact over longer timeframes.

The US base salary range for this full-time position is $166,000-$244,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Write and test product or system development code. 
  • Collaborate with peers and stakeholders through design and code reviews to ensure best practices amongst available technologies (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
  • Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback.
  • Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
  • Design and implement solutions in one or more specialized ML areas, leverage ML infrastructure, and demonstrate expertise in a chosen field.

Similar Jobs

The Walt Disney Company - Lead Software Engineer

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Month ago
Snyk - Staff Software Engineer

Snyk

London, England, United Kingdom (On-Site)
1 Month ago
ByteDance - Software Development Engineer - Network Observation

ByteDance

Singapore (On-Site)
7 Months ago
Google - Uber Technical Lead, Spaces Engineering

Google

Hyderabad, Telangana, India (On-Site)
1 Month ago
Google - ASIC Power Architect, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
Google - Group Product Manager, AI Security

Google

New York, New York, United States (On-Site)
1 Month ago
Google - Software Engineer III, AI/ML Recommendations, Rankings, Predictions, YouTube

Google

Mountain View, California, United States (On-Site)
1 Month ago
NVIDIA - AI Digital Human Development Intern - 2025

NVIDIA

Hong Kong, Hong Kong (On-Site)
4 Months ago
Google - Software Engineer III, AI/ML, Cloud AI Infrastructure

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
Meta - Research Intern, Computer Vision for Egocentric Representation Learning (PhD)

Meta

Redmond, Washington, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Software Engineer, On-Device Machine Learning

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Exient - Senior Programmer

Exient

Floriana, Malta (On-Site)
10 Months ago
GoMotive - Technical Lead Manager, Embedded Safety

GoMotive

United States (Remote)
2 Months ago
ByteDance - DevOps Engineer - Applied Machine Learning, Engine

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
ByteDance - Research Scientist Graduate (Foundation Model - Vision and Language)

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
ByteDance - Research Scientist, Foundation Model, Speech Understanding

ByteDance

Seattle, Washington, United States (On-Site)
7 Months ago
Google - Senior Staff Software Engineer, Google Cloud Global Networking

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Google - Senior Software Engineer, Pixel Camera

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
ByteDance - FPGA Firmware Engineer

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
SingleStore - Senior Software Engineer, Security (C++, RBAC, OpenSSL)

SingleStore

Hyderabad, Telangana, India (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Mountain View, California, United States

Likewise - Compliance Lead

Likewise

Southlake, Texas, United States (On-Site)
1 Month ago
GameChanger  - Senior Full Stack Software Engineer, Video Platform

GameChanger

New York, New York, United States (Remote)
2 Months ago
Games For Love - Volunteer GFL Outreach Manager

Games For Love

Washington, United States (Remote)
2 Months ago
Flow - Senior/Staff Web Engineer

Flow

New York, New York, United States (Hybrid)
7 Months ago
Patreon - Senior Frontend Engineer, Insights

Patreon

New York, New York, United States (Hybrid)
1 Month ago
Toppan Merrril - Implementation Specialist - SQL and Adobe

Toppan Merrril

Saint Paul, Minnesota, United States (On-Site)
1 Month ago
Google - Solutions Consultant III, Pixel Enterprise, Platforms and Devices

Google

Mountain View, California, United States (On-Site)
1 Month ago
WebFX - Junior Earned Media Specialist

WebFX

Harrisburg, Pennsylvania, United States (On-Site)
3 Months ago
NVIDIA - Senior Intellectual Property Security Engineer

NVIDIA

Santa Clara, California, United States (Hybrid)
1 Month ago
Whoop - Senior Business Analyst (Product)

Whoop

Boston, Massachusetts, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
2 Months ago
Google - Software Engineer, Performance Modeling

Google

Durham, North Carolina, United States (On-Site)
1 Month ago
Google - PhD Software Engineer

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
NVIDIA - Senior System Software Engineer - Triton Inference Server

NVIDIA

Washington, United States (Remote)
3 Months ago
Google - Technical Program Manager III, Infrastructure Resource Analytics, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Krafton  - Technical Project Manager

Krafton

Seoul, South Korea (On-Site)
2 Months ago
Zoox - Senior/Staff Software Engineer - Operational Tools

Zoox

Foster City, California, United States (On-Site)
7 Months ago
Genies - Backend Engineer Intern (LLM)

Genies

San Mateo, California, United States (Hybrid)
2 Months ago
Google - Software Engineer III, Embedded Systems/Firmware, Platforms Infrastructure Engineering

Google

Sunnyvale, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded