Generative AI Labeling and Quality Lead

2 Days ago • 10-10 Years • Operations

Job Summary

Job Description

The Generative AI Labeling and Quality Lead at YouTube will partner with cross-functional stakeholders to develop GenAI capabilities for internal and external tools. This role requires close collaboration with Product and Engineering teams to define requirements for efficient tooling and automation to streamline labeling and Quality Assurance (QA) processes. Responsibilities include overseeing a global vendor workforce for labeling operations, ensuring efficient workflows, maintaining high-quality labels, managing vendor relationships, utilizing data analysis to identify process improvements, and developing frameworks for collecting high-quality labels for training and testing GenAI models. The ideal candidate will have extensive experience in operations management, data analysis, and leading teams responsible for data annotation. A strong understanding of ML training and data infrastructure is essential.
Must have:
  • 10+ years experience in operational process solutions and cross-functional teamwork
  • 10+ years experience in data analysis and generating business insights
  • Oversee global vendor workforce for labeling operations
  • Ensure high-volume delivery of quality labels meeting customer needs
  • Develop frameworks for collecting high-quality labels for GenAI models
Good to have:
  • Experience in operations management or management consulting
  • Experience managing globally distributed workforce vendors
  • Understanding of ML training of Perception models
  • Experience building and reporting on meaningful business metrics

Job Details


Minimum qualifications:

  • Bachelor's degree in Business or related field, or equivalent practical experience.
  • 10 years of experience developing operational process solutions, and working with cross-functional teams.
  • 10 years of experience analyzing data and generating business insights.

Preferred qualifications:

  • 10 years of experience in operations management, management consulting or related fields.
  • Experience leading teams responsible for data annotation or related functions.
  • Experience managing globally distributed workforce vendors, and ability to define and implement complex operational workflows that are data driven.
  • Experience building and reporting on meaningful business metrics, with excellent data analysis and influencing skills.
  • Understanding of ML training of Perception models and associated inputs (e.g., calibration), data infrastructure, and visualization tooling.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you’ll lead complex, multi-disciplinary projects from start to finish — working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company. Your projects will often span offices, time zones, and hemispheres. It's your job to coordinate the players and keep them up to date on progress and deadlines.

As the GenAI Labeling and Quality Lead, you will partner with cross-functional stakeholders to help build up the GenAI based capabilities for the various internal and externally facing tools. You will partner closely with Product and Engineering teams to identify and define requirements for efficient tooling and automation to streamline labeling and Quality Assurance processes. You will develop GenAI capabilities and processes within YouTube's Global vendor operations team.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

  • Partner closely with Tech teams to develop frameworks for collecting high quality labels for training and testing GenAI models for various use cases within the creator, consumer organizations.
  • Oversee extended workforce for labeling operations team in the global vendor organization.
  • Ensure efficient workflows and policies are in place that result in the delivery of a high volume of quality labels meeting customer needs on a continuous basis.
  • Oversee all aspects of vendor relationships and partner organizations responsible for ground truth labeling including training, and policy.
  • Utilize data and analysis to identify opportunities for improvement in operational workflows and processes.

Similar Jobs

Uken - Product Manager II

Uken

(Remote)
4 Months ago
Eneba Games - Data Analyst, Payments

Eneba Games

Lithuania (Remote)
3 Weeks ago
Super - Payments Processing Intern

Super

(Remote)
1 Week ago
Google - Sales Manager, Accelerate Growth, SPLA

Google

Mexico City, Mexico City, Mexico (On-Site)
2 Days ago
Microsoft - Senior Human Resources Consultant

Microsoft

Mexico City, Mexico City, Mexico (On-Site)
3 Days ago
The Walt Disney Company - Merchandise Seller - Hercules and Lion King

The Walt Disney Company

London, England, United Kingdom (On-Site)
1 Month ago
Google - Training Lead, Global Vendor Operations

Google

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Zengame Technology - Operations Assistant

Zengame Technology

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
Evolution - Equipment Support Specialist (Game Integrity)

Evolution

Medellín, Antioquia, Colombia (On-Site)
1 Month ago
Twitch - Strategy & Operations Manager

Twitch

San Francisco, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PENN Interactive - Regional Director of Player Development - Northeast

PENN Interactive

Philadelphia, Pennsylvania, United States (Hybrid)
2 Months ago
ByteDance - Internal Auditor - Global Payments

ByteDance

Singapore (Hybrid)
1 Month ago
Google - Software Engineer III, Mobile, iOS

Google

Bucharest, Bucharest, Romania (On-Site)
1 Week ago
Rackspace Technology - Sr Cloud Architect

Rackspace Technology

India (Remote)
4 Months ago
Demandbase - Software Engineer 1 (Frontend)

Demandbase

Hyderabad, Telangana, India (On-Site)
8 Hours ago
ByteDance - Senior Data Scientist

ByteDance

New York, New York, United States (On-Site)
1 Month ago
Trendyol - Pricing Data Analyst

Trendyol

İstanbul, Türkiye (Hybrid)
6 Months ago
Nintendo - Principal Content Operations Strategist

Nintendo

Redmond, Washington, United States (Hybrid)
2 Weeks ago
Lockwood - Designer, Live Ops

Lockwood

Nottingham, England, United Kingdom (On-Site)
1 Day ago
Playtika - Game Economy Manager

Playtika

Israel (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Google - Data Scientist, Research, App Safety Engineering

Google

Bengaluru, Karnataka, India (On-Site)
3 Days ago
Google - Software Engineer II, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Saviynt - Senior Product Manager - Integrations

Saviynt

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Saama Technologies,  Inc  - Senior Product Analyst

Saama Technologies, Inc

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Bluevine India - Data Architecture Lead

Bluevine India

Bengaluru, Karnataka, India (Hybrid)
1 Day ago
Granicus - Data Scientist 4

Granicus

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
PwC - Senior Associate - Bengaluru Millenia - Technology Consulting

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Hitachi - Share Point Developer

Hitachi

Pune, Maharashtra, India (Remote)
6 Months ago
Circles - Senior Product Analyst

Circles

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Anthology - Director, Application Security

Anthology

Bengaluru, Karnataka, India (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Operations Jobs

Keywords Studios - Player Engagement - Senior Operations Manager (Manila and Bacolod)

Keywords Studios

Pasig, Metro Manila, Philippines (Hybrid)
2 Weeks ago
DraftKings - Lottery Fulfillment Supervisor

DraftKings

Tempe, Arizona, United States (On-Site)
1 Month ago
Token Metrics - Crypto Operations Manager

Token Metrics

Manila, Metro Manila, Philippines (Remote)
6 Months ago
Google - Partner Operations Manager, YouTube

Google

Singapore (On-Site)
1 Week ago
Hawk Eye Innovations - Match Operations Assistant - Porto

Hawk Eye Innovations

Porto, Porto District, Portugal (On-Site)
1 Week ago
ByteDance - BNPL Operation Manager - Global Payment

ByteDance

Singapore (On-Site)
2 Weeks ago
Tesla - Store Manager

Tesla

Stockholm, Stockholm County, Sweden (On-Site)
2 Months ago
Tesla - Training Coordinator - Parts Operations

Tesla

Barcelona, Catalonia, Spain (On-Site)
2 Months ago
Tesla - Mobile Service Technician

Tesla

Huddinge, Stockholm County, Sweden (On-Site)
2 Months ago
Tesla - Shift Supervisor, Body Shop - Gigafactory Berlin Brandenburg

Tesla

Brandenburg, Germany (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug