Generative AI Labeling and Quality Lead

1 Week ago • 10-10 Years • Operations

Job Summary

Job Description

As the Generative AI Labeling and Quality Lead at YouTube, you will collaborate with cross-functional stakeholders to enhance GenAI capabilities for internal and external tools. You'll work closely with Product and Engineering teams to define requirements for efficient tooling and automation in labeling and QA. Responsibilities include overseeing the global vendor labeling operations team, ensuring high-quality label delivery, managing vendor relationships, utilizing data analysis for process improvement, and partnering with tech teams to develop frameworks for collecting high-quality labels for training and testing GenAI models. The role involves developing GenAI capabilities and processes within YouTube's Global vendor operations team and requires strong data analysis, operational management, and team leadership skills.
Must have:
  • Bachelor's degree or equivalent experience
  • 10+ years experience in operational process solutions and cross-functional teamwork
  • 10+ years experience in data analysis and generating business insights
  • Oversee global vendor labeling operations
  • Ensure high-volume, high-quality label delivery
  • Develop GenAI capabilities and processes
Good to have:
  • Experience in operations management or management consulting
  • Experience leading data annotation teams
  • Managing globally distributed workforce vendors
  • Experience building and reporting on business metrics
  • Understanding of ML training of Perception models

Job Details


Minimum qualifications:

  • Bachelor's degree in Business or related field, or equivalent practical experience.
  • 10 years of experience developing operational process solutions, and working with cross-functional teams.
  • 10 years of experience analyzing data and generating business insights.

Preferred qualifications:

  • 10 years of experience in operations management, management consulting or related fields.
  • Experience leading teams responsible for data annotation or related functions.
  • Experience managing globally distributed workforce vendors, and ability to define and implement complex operational workflows that are data driven.
  • Experience building and reporting on meaningful business metrics, with excellent data analysis and influencing skills.
  • Understanding of ML training of Perception models and associated inputs (e.g., calibration), data infrastructure, and visualization tooling.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you’ll lead complex, multi-disciplinary projects from start to finish — working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company. Your projects will often span offices, time zones, and hemispheres. It's your job to coordinate the players and keep them up to date on progress and deadlines.

As the GenAI Labeling and Quality Lead, you will partner with cross-functional stakeholders to help build up the GenAI based capabilities for the various internal and externally facing tools. You will partner closely with Product and Engineering teams to identify and define requirements for efficient tooling and automation to streamline labeling and Quality Assurance processes. You will develop GenAI capabilities and processes within YouTube's Global vendor operations team.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

  • Partner closely with Tech teams to develop frameworks for collecting high quality labels for training and testing GenAI models for various use cases within the creator, consumer organizations.
  • Oversee extended workforce for labeling operations team in the global vendor organization.
  • Ensure efficient workflows and policies are in place that result in the delivery of a high volume of quality labels meeting customer needs on a continuous basis.
  • Oversee all aspects of vendor relationships and partner organizations responsible for ground truth labeling including training, and policy.
  • Utilize data and analysis to identify opportunities for improvement in operational workflows and processes.

Similar Jobs

Frima - Finance and Administration Director

Frima

Québec City, Quebec, Canada (On-Site)
1 Week ago
Google - Business Intelligence Sales Specialist III

Google

São Paulo, State Of São Paulo, Brazil (On-Site)
1 Week ago
Shyft Labs - Manager Data Engineer

Shyft Labs

Noida, Uttar Pradesh, India (Hybrid)
1 Month ago
Lytx - Partner Development Manager

Lytx

(Remote)
19 Hours ago
Instawork - Senior Investigations Manager

Instawork

San Francisco, California, United States (Hybrid)
23 Hours ago
Google - Workforce Management Program Manager

Google

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
ByteDance - Destination Service Manager - EMEA

ByteDance

Dubai, Dubai, United Arab Emirates (On-Site)
1 Week ago
Samsung Semiconductor - Technical Program Manager, FIPS 140

Samsung Semiconductor

San Jose, California, United States (Hybrid)
1 Month ago
Google - Policy Enforcement Manager, Cross Product Safety

Google

San Bruno, California, United States (On-Site)
2 Days ago
CRED - VKYC ops

CRED

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Fliff  Inc  - Business Analyst

Fliff Inc

Philadelphia, Pennsylvania, United States (On-Site)
9 Months ago
Microsoft - Senior Product Manager - Copilot Measurement & Evaluation

Microsoft

Mountain View, California, United States (Hybrid)
3 Days ago
Fictiv - Manufacturing Data Analysis Intern

Fictiv

Monterrey, Nuevo Leon, Mexico (On-Site)
8 Hours ago
AppLovin - Data Platform Engineer

AppLovin

Palo Alto, California, United States (On-Site)
7 Hours ago
SingleStore - Financial Analyst - GTM

SingleStore

Pune, Maharashtra, India (On-Site)
1 Day ago
sagecor - System Administrator 2

sagecor

Annapolis Junction, Maryland, United States (On-Site)
2 Weeks ago
Playrix - Senior Data Analyst (Attribution)

Playrix

Montenegro (Remote)
6 Months ago
Diligent - Product Manager

Diligent

Budapest, Hungary (Hybrid)
1 Day ago
PwC - AI Model Validation Expert

PwC

Sofia, Sofia City Province, Bulgaria (On-Site)
6 Months ago
Beyond Sports  - Sports Visualization Specialist

Beyond Sports

Alkmaar, North Holland, Netherlands (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

PwC - IN-Associate–ERP Controls- ITRA– Advisory – Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
6 Months ago
BOT VFX - Freelance Opportunities - Prep Artists - As Needed Projects

BOT VFX

Chennai, Tamil Nadu, India (On-Site)
1 Week ago
E2open - Trade Specialist

E2open

Bengaluru, Karnataka, India (On-Site)
8 Hours ago
CLO Virtual Fashion  Inc  - C++ Developer

CLO Virtual Fashion Inc

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Google - Privacy Engineer

Google

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Paytm - Paytm Ads ops (Monetization)

Paytm

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Truecaller - Senior Customer Success Manager

Truecaller

Mumbai, Maharashtra, India (On-Site)
8 Hours ago
Postman - Engineering Manager-Messaging

Postman

Hyderabad, Telangana, India (Hybrid)
1 Day ago
ByteDance - Quality Analyst - ADSEO (Safety)

ByteDance

Gurugram, Haryana, India (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Operations Jobs

Google - Risk and Compliance Program Manager

Google

Singapore (On-Site)
2 Days ago
Cyara - Sales Operations Analyst – Data

Cyara

Hyderabad, Telangana, India (Hybrid)
5 Months ago
Milestone - Director, Regional Business & People Support, Bulgaria

Milestone

Sofia, Sofia City Province, Bulgaria (Hybrid)
2 Weeks ago
Life church - Support Operations Specialist

Life church

Edmond, Oklahoma, United States (On-Site)
6 Months ago
Tesla - Area Parts Supervisor

Tesla

Mérignac, Nouvelle-Aquitaine, France (On-Site)
2 Months ago
The Workshop - Technical Operations Centre Manager

The Workshop

Tocancipá, Cundinamarca, Colombia (On-Site)
1 Month ago
Bally's Interactive - Transformation Project Manager - Enterprise Effectiveness

Bally's Interactive

London, England, United Kingdom (On-Site)
2 Weeks ago
Evolution - Part-time Game Presenter - Weekend/Weeknights Shifts, $20-25/hr. (Customer Service Alternative)

Evolution

Atlantic City, New Jersey, United States (On-Site)
6 Months ago
Keywords Studios - IT Senior Support Manager

Keywords Studios

County Dublin, Ireland (Hybrid)
1 Week ago
Microsoft - Responsible Content Specialist (Italian)

Microsoft

Dublin, County Dublin, Ireland (On-Site)
3 Days ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug