Staff Software Engineer, GenAI, Data Quality

2 Weeks ago • 8-11 Years • Artificial Intelligence • Data Analyst • $197,000 PA - $291,000 PA

Job Summary

Job Description

This Staff Software Engineer role focuses on improving data quality for Google's GenAI/LLM initiatives. Responsibilities include providing technical leadership to the Crowd and Data Platform team, improving data collection quality through quantitative studies and implementing best practices, productionizing data scientist methods, ensuring data quality visibility, and collaborating with cross-functional teams (Data Science, Product, UX, Infra, Operations). The role involves working on Google-wide tooling for onboarding large rater workforces to meet human data needs for Gemini use cases, building platforms and infrastructure services for human computation, and managing large-scale datasets used in GenAI model evaluations and fine-tuning.
Must have:
  • 8+ years software development experience
  • 5+ years testing and launching software
  • 3+ years software design and architecture
  • Experience with Python or C++
  • Cross-functional collaboration skills
  • Data structures and algorithms expertise
Good to have:
  • Bachelor's degree in CS, Statistics, or related field
  • Familiarity with ML production tools and lifecycle
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development, and with data structures/algorithms.
  • 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
  • Experience in cross-functional collaboration and working across boundaries.
  • Experience working with Python or C++.

Preferred qualifications:

  • Bachelor's degree in Computer Science, Statistics, Mathematics, or a related field.
  • Familiarity with ML production tools and lifecycle.

About the job

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Power the next Large Language Model (LLM) advancements with data.

We are building Google-wide 1P tooling for onboarding very large rater workforces to meet the human data needs for all Gemini use cases. Our team builds and maintains platforms, scalable infrastructure services and applications in support of human computation, enabling the collection, storage and management of large-scale human-generated or human-augmented datasets used by teams in Google and Alphabet working on GenAI products and services. Our team has been instrumental in performing LLM/GenAI model evaluations and model fine-tuning (e.g., using SFT and RLHF techniques).

Our team has long experience enabling ML products via human data. We're the preferred human data solution for the ML platforms at Google.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud’s Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.

The US base salary range for this full-time position is $197,000-$291,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Provide technical leadership to the Crowd and Data Platform team as it executes on company priorities to improve tooling around 1P Machine Learning (ML) data needs for GenAI/LLM use cases.
  • Improve the quality of data collections used for GenAI models training by identifying best practices through quantitative pilot studies and implementing the adoption of these practices by human data collection systems.
  • Productionize and standardize methods developed by data scientists for high-quality data and ensure that these metrics are visible to the right stakeholders, meaningful, and actionable.
  • Collaborate with horizontal infrastructure teams to monitor and report data quality at every stage of the data collection lifecycle, from collection design through training and model release.
  • Work cross-functionally with Data Science, Product, UX/UX Researcher, Infra and Operations teams.

Similar Jobs

Google - Software Engineer II, Chrome Web Store

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Weeks ago
Google - Software Engineer II, Migration and Replication, Google Cloud

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Weeks ago
Google - Research Engineer, Vision Language Models

Google

Zürich, Zurich, Switzerland (On-Site)
2 Weeks ago
Microsoft - Responsible Content Specialist

Microsoft

Bengaluru, Karnataka, India (On-Site)
1 Week ago
matchgroup - Sr. Product Manager (Recommendations)

matchgroup

San Francisco, California, United States (Hybrid)
6 Months ago
NVIDIA - Senior Research Engineer, Foundation Model Training Infrastructure

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
ByteDance - LLM Software Engineer/Researcher (Applied Machine Learning)

ByteDance

Seattle, Washington, United States (On-Site)
2 Weeks ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
2 Weeks ago
Google - Software Engineer III, Full Stack, Applied AI

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Week ago
Google - Technical Program Manager III, Infrastructure Resource Analytics, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

The Walt Disney Company - Lead Software Engineer - Front End

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Weeks ago
Google - Software Engineer III, Android

Google

Bucharest, Bucharest, Romania (On-Site)
1 Week ago
Google - Senior Software Engineer, Distributed Machine Learning

Google

Mountain View, California, United States (On-Site)
2 Days ago
Google - Chip Infrastructure Engineer, SoC CAD

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Days ago
Google - Senior Software Engineer, CPU Performance Modeling Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Week ago
Google - Senior Staff Software Engineer, Infrastructure, Google Cloud Security and Privacy

Google

Cambridge, Massachusetts, United States (On-Site)
4 Months ago
The Walt Disney Company - Sr Machine Learning Engineer

The Walt Disney Company

San Francisco, California, United States (On-Site)
5 Months ago
Google - Software Engineer III, Transformative Compute SRE

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Week ago
Google - Site Reliability Engineer, Ads Quality Infrastructure

Google

Dublin, County Dublin, Ireland (On-Site)
2 Weeks ago
Xsolla - Software Engineer (Monetization)

Xsolla

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Mountain View, California, United States

Epic Games - Lead External Development Manager

Epic Games

United States (On-Site)
1 Week ago
IManage - Lead AI Software Engineer

IManage

Chicago, Illinois, United States (Hybrid)
1 Day ago
ByteDance - Senior Security Tech Lead Manager - Security Engineering

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Dmg - Sr. Manager of National Accounts

Dmg

Cincinnati, Ohio, United States (On-Site)
2 Weeks ago
Microsoft - Software Engineer - Fullstack

Microsoft

Redmond, Washington, United States (On-Site)
2 Weeks ago
Powerintegration - Sr. Staff IC CAD Engineer

Powerintegration

San Jose, California, United States (On-Site)
3 Weeks ago
ByteDance - Senior Software Quality Assurance Engineer

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
PlayStation Global - Environment Artist (Contract)

PlayStation Global

Los Angeles, California, United States (On-Site)
1 Month ago
ByteDance - Senior Network Engineer- IAAS- San Jose

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Schell Games - Associate Benefits Coordinator

Schell Games

Pennsylvania, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Zoox - Senior Software Engineer - Simulaton Scenario Automation

Zoox

Seattle, Washington, United States (Hybrid)
6 Months ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - MultiModal Generative Model)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Hitachi - Artificial Intelligence - JBU

Hitachi

Chennai, Tamil Nadu, India (On-Site)
6 Months ago
Google - Staff Software Engineer, Network Management

Google

Sunnyvale, California, United States (On-Site)
2 Days ago
Inworld AI - AI Trainer (Contractor) - Writing & Gaming

Inworld AI

Vancouver, British Columbia, Canada (Remote)
1 Month ago
Google - Cloud AI Engineer, Global Services Delivery

Google

Mexico City, Mexico City, Mexico (On-Site)
2 Days ago
Google - Customer Engineer III, Applied AI, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
2 Days ago
NVIDIA - Senior System Software Engineer - Dynamo and Triton Inference Server

NVIDIA

California, United States (Remote)
1 Month ago
Google - Field Solutions Architect, GenAI, Google Cloud

Google

Tokyo, Japan (On-Site)
2 Weeks ago
Ubisoft - Programmeur senior ML _ Groupe Technologique Création de Contenu

Ubisoft

Montreal, Quebec, Canada (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug