Generative AI Labeling and Quality Lead

4 Hours ago • 10-10 Years • Operations

Job Summary

Job Description

As the Generative AI Labeling and Quality Lead at YouTube, you will collaborate with cross-functional stakeholders to enhance GenAI capabilities for internal and external tools. You'll work closely with Product and Engineering teams to define requirements for efficient tooling and automation in labeling and QA. Responsibilities include overseeing the global vendor labeling operations team, ensuring high-quality label delivery, managing vendor relationships, utilizing data analysis for process improvement, and partnering with tech teams to develop frameworks for collecting high-quality labels for training and testing GenAI models. The role involves developing GenAI capabilities and processes within YouTube's Global vendor operations team and requires strong data analysis, operational management, and team leadership skills.
Must have:
  • Bachelor's degree or equivalent experience
  • 10+ years experience in operational process solutions and cross-functional teamwork
  • 10+ years experience in data analysis and generating business insights
  • Oversee global vendor labeling operations
  • Ensure high-volume, high-quality label delivery
  • Develop GenAI capabilities and processes
Good to have:
  • Experience in operations management or management consulting
  • Experience leading data annotation teams
  • Managing globally distributed workforce vendors
  • Experience building and reporting on business metrics
  • Understanding of ML training of Perception models

Job Details


Minimum qualifications:

  • Bachelor's degree in Business or related field, or equivalent practical experience.
  • 10 years of experience developing operational process solutions, and working with cross-functional teams.
  • 10 years of experience analyzing data and generating business insights.

Preferred qualifications:

  • 10 years of experience in operations management, management consulting or related fields.
  • Experience leading teams responsible for data annotation or related functions.
  • Experience managing globally distributed workforce vendors, and ability to define and implement complex operational workflows that are data driven.
  • Experience building and reporting on meaningful business metrics, with excellent data analysis and influencing skills.
  • Understanding of ML training of Perception models and associated inputs (e.g., calibration), data infrastructure, and visualization tooling.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you’ll lead complex, multi-disciplinary projects from start to finish — working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company. Your projects will often span offices, time zones, and hemispheres. It's your job to coordinate the players and keep them up to date on progress and deadlines.

As the GenAI Labeling and Quality Lead, you will partner with cross-functional stakeholders to help build up the GenAI based capabilities for the various internal and externally facing tools. You will partner closely with Product and Engineering teams to identify and define requirements for efficient tooling and automation to streamline labeling and Quality Assurance processes. You will develop GenAI capabilities and processes within YouTube's Global vendor operations team.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

  • Partner closely with Tech teams to develop frameworks for collecting high quality labels for training and testing GenAI models for various use cases within the creator, consumer organizations.
  • Oversee extended workforce for labeling operations team in the global vendor organization.
  • Ensure efficient workflows and policies are in place that result in the delivery of a high volume of quality labels meeting customer needs on a continuous basis.
  • Oversee all aspects of vendor relationships and partner organizations responsible for ground truth labeling including training, and policy.
  • Utilize data and analysis to identify opportunities for improvement in operational workflows and processes.

Similar Jobs

Newzoo - Senior Full Stack Engineer

Newzoo

North Holland, Netherlands (Hybrid)
2 Weeks ago
Meta - Data Engineer, Product Analytics

Meta

Menlo Park, California, United States (On-Site)
5 Months ago
The Walt Disney Company - Media Systems Engineer II

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
2 Months ago
NVIDIA - Senior Manager, Internal Audit and SOX

NVIDIA

Canada (On-Site)
1 Month ago
Google - Senior Technical Program Manager, Memory Quality Engineering

Google

Austin, Texas, United States (On-Site)
1 Day ago
Tesla - Parts Advisor

Tesla

Dublin, County Dublin, Ireland (On-Site)
2 Months ago
On Location - Venue Cluster Director, Venue Management (Central Region) – FIFA World Cup 26™

On Location

Dallas, Texas, United States (On-Site)
1 Month ago
Sphere Entertainment Co - Food & Merchandise Supervisor - Premium Suites

Sphere Entertainment Co

Las Vegas, Nevada, United States (On-Site)
3 Days ago
Scale AI - Operations Associate

Scale AI

Mexico City, Mexico City, Mexico (On-Site)
6 Months ago
Immutable - Senior Manager, Customer Operations

Immutable

Sydney, New South Wales, Australia (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

The Walt Disney Company - Manager, Software Engineering – Media and Playback Data Processing

The Walt Disney Company

Seattle, Washington, United States (On-Site)
3 Weeks ago
Tesla - Process Engineer Electrode, Battery Cell

Tesla

Grünheide (Mark), Brandenburg, Germany (On-Site)
2 Months ago
PwC - Senior Kwantitatief Consultant Pensioen

PwC

Amsterdam, North Holland, Netherlands (On-Site)
6 Months ago
Google - Development Manager, Infrastructure, Data and Support

Google

Bengaluru, Karnataka, India (On-Site)
1 Day ago
Google - Product Manager, YouTube Commerce Platform

Google

Bengaluru, Karnataka, India (On-Site)
5 Hours ago
RoofStack - Senior Data Analyst

RoofStack

İstanbul, İstanbul, Türkiye (On-Site)
1 Month ago
DraftKings - Senior Analyst, Digital Marketing

DraftKings

Boston, Massachusetts, United States (On-Site)
2 Weeks ago
Zinrelo - QA Engineer

Zinrelo

Pune, Maharashtra, India (Hybrid)
6 Months ago
Google - Partner Engineer, YouTube Ancillary Rights

Google

Madrid, Community Of Madrid, Spain (On-Site)
4 Hours ago
Inkittt - Product Analyst

Inkittt

San Francisco, California, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Google - Software Engineer III, Full Stack, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Google - UX Designer, Google Store

Google

Bengaluru, Karnataka, India (On-Site)
1 Day ago
Assystems - Site Mechanical Engineer

Assystems

Bagalkote, Karnataka, India (On-Site)
6 Months ago
PwC - IN_Manager_ Scrum Master_Advisory Corporate_Advisory_ Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Britive - SENIOR SOFTWARE ENGINEER (CLOUD)

Britive

Bengaluru, Karnataka, India (Remote)
4 Months ago
Google - Executive Business Partner, gTech Ads

Google

Hyderabad, Telangana, India (On-Site)
1 Day ago
Nagarro - Senior Staff Engineer, QA Manual

Nagarro

India (Remote)
6 Months ago
Nagarro - Associate Staff Consultant, Business Analyst

Nagarro

Bengaluru, Karnataka, India (On-Site)
6 Months ago
ByteDance - Human Resources Apprenticeship Program, ByteDance – Trust & Safety India - 2025 Start

ByteDance

Gurugram, Haryana, India (On-Site)
3 Weeks ago
OAO INFO INDIA - Production Lead

OAO INFO INDIA

Pune, Maharashtra, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Operations Jobs

NVIDIA - Director of Business Continuity

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Sandbox VR - Assistant Store Manager

Sandbox VR

Hong Kong (On-Site)
6 Months ago
ION - Technical Operations Engineer

ION

Woking, England, United Kingdom (On-Site)
6 Months ago
Microsoft - Partner Technical Advisor - Networking

Microsoft

San José, San José Province, Costa Rica (Hybrid)
1 Day ago
ByteDance - Search Operations Team Lead - Philippines

ByteDance

Pasig, Metro Manila, Philippines (On-Site)
5 Months ago
Inspired Entertainment - Assistant Resort Amusements Manager

Inspired Entertainment

Filey, England, United Kingdom (On-Site)
3 Weeks ago
Bally's Interactive - Treasury Operations and Systems Manager

Bally's Interactive

Manchester, England, United Kingdom (On-Site)
9 Hours ago
Google - Strategy and Operations Senior Associate, Agency and Partner Go-to-Market

Google

Chicago, Illinois, United States (On-Site)
1 Hour ago
Paytm - Area Sales Manager- Deputy Manager - Bellary

Paytm

Ballari, Karnataka, India (On-Site)
4 Months ago
Epic Games - Senior Development Manager

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Seoul, South Korea (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Hyderabad, Telangana, India (On-Site)

Atlanta, Georgia, United States (On-Site)

Fremont, California, United States (On-Site)

Milan, Lombardy, Italy (On-Site)

Eemshaven, Groningen, Netherlands (On-Site)

Bengaluru, Karnataka, India (On-Site)

Sunnyvale, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug