Generative AI Labeling and Quality Lead

2 Weeks ago • 10-10 Years • Operations

Job Summary

Job Description

The Generative AI Labeling and Quality Lead at YouTube will partner with cross-functional stakeholders to build GenAI capabilities for internal and external tools. This role involves defining requirements for efficient tooling and automation to streamline labeling and QA processes, developing GenAI capabilities within YouTube's Global vendor operations team, and overseeing the extended workforce for labeling operations. Responsibilities include developing frameworks for collecting high-quality labels for training and testing GenAI models, ensuring efficient workflows and policies for delivering high-volume quality labels, overseeing vendor relationships and ground truth labeling, and utilizing data analysis to identify opportunities for process improvement. The ideal candidate will have extensive experience in operational process solutions, data analysis, and managing globally distributed workforces.
Must have:
  • 10+ years experience in operational process solutions and cross-functional team work
  • 10+ years experience in data analysis and generating business insights
  • Oversee extended workforce for labeling operations
  • Develop frameworks for collecting high-quality labels for GenAI models
  • Ensure efficient workflows for high-volume quality label delivery
Good to have:
  • Experience in operations management or management consulting
  • Experience leading data annotation teams
  • Experience managing globally distributed workforce vendors
  • Understanding of ML training of Perception models
  • Excellent data analysis and influencing skills

Job Details


Minimum qualifications:

  • Bachelor's degree in Business or related field, or equivalent practical experience.
  • 10 years of experience developing operational process solutions, and working with cross-functional teams.
  • 10 years of experience analyzing data and generating business insights.

Preferred qualifications:

  • 10 years of experience in operations management, management consulting or related fields.
  • Experience leading teams responsible for data annotation or related functions.
  • Experience managing globally distributed workforce vendors, and ability to define and implement complex operational workflows that are data driven.
  • Experience building and reporting on meaningful business metrics, with excellent data analysis and influencing skills.
  • Understanding of ML training of Perception models and associated inputs (e.g., calibration), data infrastructure, and visualization tooling.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you’ll lead complex, multi-disciplinary projects from start to finish — working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company. Your projects will often span offices, time zones, and hemispheres. It's your job to coordinate the players and keep them up to date on progress and deadlines.

As the GenAI Labeling and Quality Lead, you will partner with cross-functional stakeholders to help build up the GenAI based capabilities for the various internal and externally facing tools. You will partner closely with Product and Engineering teams to identify and define requirements for efficient tooling and automation to streamline labeling and Quality Assurance processes. You will develop GenAI capabilities and processes within YouTube's Global vendor operations team.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

  • Partner closely with Tech teams to develop frameworks for collecting high quality labels for training and testing GenAI models for various use cases within the creator, consumer organizations.
  • Oversee extended workforce for labeling operations team in the global vendor organization.
  • Ensure efficient workflows and policies are in place that result in the delivery of a high volume of quality labels meeting customer needs on a continuous basis.
  • Oversee all aspects of vendor relationships and partner organizations responsible for ground truth labeling including training, and policy.
  • Utilize data and analysis to identify opportunities for improvement in operational workflows and processes.

Similar Jobs

Google - Senior Finance Analyst, GTM Cloud Infrastructure AI

Google

Austin, Texas, United States (On-Site)
2 Weeks ago
HP - US Payroll Customer support

HP

Tlaquepaque, Jalisco, Mexico (On-Site)
7 Months ago
PwC - IN-Manager_SAP MDG_SAP_Advisory_ Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Alten Technology USA - Associate Engineer (Interiors/Instrument Panels)

Alten Technology USA

Newark, California, United States (On-Site)
7 Hours ago
Amazon Games - Producer - Player Safety

Amazon Games

Montreal, Quebec, Canada (On-Site)
1 Week ago
Tesla - Service Manager

Tesla

Vienna, Vienna, Austria (On-Site)
2 Months ago
SmileGate - Service Development PM

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
2 Weeks ago
Google - Service Delivery Manager, Ads Content Operations

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Voodoo - Operations Manager

Voodoo

Paris, Île-de-France, France (On-Site)
1 Month ago
ByteDance - Search Operation Group Lead - JP/KR

ByteDance

Seoul, South Korea (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Electrical Manufacturing Engineer, PCBA Manufacturing, Advanced Operation Engineering

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
ByteDance - Brand Development Manager, Team Lead

ByteDance

Austin, Texas, United States (On-Site)
2 Weeks ago
Google - Data Products Lead, GenAI, YouTube

Google

New York, New York, United States (On-Site)
1 Week ago
Nintendo - ServiceNow Software Engineer

Nintendo

Redmond, Washington, United States (Hybrid)
2 Weeks ago
Rush Street Interactive - Business Development Director

Rush Street Interactive

Dominican Republic (On-Site)
3 Months ago
PwC - Senior Manager_Data Engineering_D&A_Advisory _Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
7 Months ago
Saama Technologies,  Inc  - Senior Product Analyst

Saama Technologies, Inc

Chennai, Tamil Nadu, India (On-Site)
1 Month ago
ByteDance - Software Engineer Intern

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Beghou Consulting - Consultant

Beghou Consulting

Pune, Maharashtra, India (Hybrid)
5 Months ago
Riot Games - Principal Researcher - Central User Research

Riot Games

Los Angeles, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Ramboll3 - Principal Designer – BIM, Water

Ramboll3

Noida, Uttar Pradesh, India (On-Site)
2 Weeks ago
Alp Consulting  - Art Director-Adobe After Effects

Alp Consulting

Chennai, Tamil Nadu, India (On-Site)
1 Year ago
Google - Scaled Delivery Manager, gTech Ads Solutions

Google

Gurugram, Haryana, India (On-Site)
2 Days ago
Crunchyroll - Staff Software Engineer

Crunchyroll

Hyderabad, Telangana, India (On-Site)
7 Months ago
Gallagher - Sr. QA Analyst

Gallagher

Chandigarh, Chandigarh, India (On-Site)
6 Months ago
Fictiv - Wordpress Developer

Fictiv

Pune, Maharashtra, India (On-Site)
8 Hours ago
NVIDIA - Senior System Software Engineer - Automotive Platform

NVIDIA

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Google - Silicon Senior Physical Design Engineer, TPU

Google

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Hudl - Senior Software Engineer

Hudl

Mumbai, Maharashtra, India (On-Site)
1 Day ago
IMC - HR Operations Associate

IMC

Mumbai, Maharashtra, India (On-Site)
22 Hours ago

Get notifed when new similar jobs are uploaded

Operations Jobs

GoMotive - Technical Support Engineer - Fleet and Mobile Pod

GoMotive

Pakistan (Remote)
1 Month ago
Tesla - Senior Compliance Officer

Tesla

Brandenburg, Germany (On-Site)
2 Months ago
Corsair - Store Manager

Corsair

Milpitas, California, United States (On-Site)
2 Weeks ago
Google - Data Center Technician, Global Server Operations

Google

Mumbai, Maharashtra, India (On-Site)
2 Weeks ago
Nordcurrent - Pricing Manager

Nordcurrent

Vilnius, Vilnius County, Lithuania (On-Site)
2 Weeks ago
Keywords Studios - Player Support Agent - Spanish/English

Keywords Studios

Silesian Voivodeship, Poland (Hybrid)
1 Month ago
Tesla - Mobile Service Technician

Tesla

Roermond, Limburg, Netherlands (On-Site)
2 Months ago
Zeta - Lead - Training

Zeta

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Easygo - Customer Operations Manager

Easygo

Melbourne, Victoria, Australia (On-Site)
3 Weeks ago
GoTo Group - Area Operations Associate (Depok)

GoTo Group

West Java, Indonesia (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug