Generative AI Labeling and Quality Lead

19 Hours ago • 10-10 Years • Operations

Job Summary

Job Description

The Generative AI Labeling and Quality Lead at YouTube will partner with cross-functional stakeholders to develop GenAI capabilities for internal and external tools. This role requires close collaboration with Product and Engineering teams to define requirements for efficient tooling and automation to streamline labeling and Quality Assurance (QA) processes. Responsibilities include overseeing a global vendor workforce for labeling operations, ensuring efficient workflows, maintaining high-quality labels, managing vendor relationships, utilizing data analysis to identify process improvements, and developing frameworks for collecting high-quality labels for training and testing GenAI models. The ideal candidate will have extensive experience in operations management, data analysis, and leading teams responsible for data annotation. A strong understanding of ML training and data infrastructure is essential.
Must have:
  • 10+ years experience in operational process solutions and cross-functional teamwork
  • 10+ years experience in data analysis and generating business insights
  • Oversee global vendor workforce for labeling operations
  • Ensure high-volume delivery of quality labels meeting customer needs
  • Develop frameworks for collecting high-quality labels for GenAI models
Good to have:
  • Experience in operations management or management consulting
  • Experience managing globally distributed workforce vendors
  • Understanding of ML training of Perception models
  • Experience building and reporting on meaningful business metrics

Job Details


Minimum qualifications:

  • Bachelor's degree in Business or related field, or equivalent practical experience.
  • 10 years of experience developing operational process solutions, and working with cross-functional teams.
  • 10 years of experience analyzing data and generating business insights.

Preferred qualifications:

  • 10 years of experience in operations management, management consulting or related fields.
  • Experience leading teams responsible for data annotation or related functions.
  • Experience managing globally distributed workforce vendors, and ability to define and implement complex operational workflows that are data driven.
  • Experience building and reporting on meaningful business metrics, with excellent data analysis and influencing skills.
  • Understanding of ML training of Perception models and associated inputs (e.g., calibration), data infrastructure, and visualization tooling.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you’ll lead complex, multi-disciplinary projects from start to finish — working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company. Your projects will often span offices, time zones, and hemispheres. It's your job to coordinate the players and keep them up to date on progress and deadlines.

As the GenAI Labeling and Quality Lead, you will partner with cross-functional stakeholders to help build up the GenAI based capabilities for the various internal and externally facing tools. You will partner closely with Product and Engineering teams to identify and define requirements for efficient tooling and automation to streamline labeling and Quality Assurance processes. You will develop GenAI capabilities and processes within YouTube's Global vendor operations team.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

  • Partner closely with Tech teams to develop frameworks for collecting high quality labels for training and testing GenAI models for various use cases within the creator, consumer organizations.
  • Oversee extended workforce for labeling operations team in the global vendor organization.
  • Ensure efficient workflows and policies are in place that result in the delivery of a high volume of quality labels meeting customer needs on a continuous basis.
  • Oversee all aspects of vendor relationships and partner organizations responsible for ground truth labeling including training, and policy.
  • Utilize data and analysis to identify opportunities for improvement in operational workflows and processes.

Similar Jobs

ByteDance - Product Operations Manager

ByteDance

(On-Site)
2 Weeks ago
Britive - SOFTWARE ENGINEER

Britive

San Francisco, California, United States (Remote)
5 Months ago
Google - Senior Analytical Lead, Large Customer Sales

Google

Toronto, Ontario, Canada (On-Site)
17 Hours ago
InMobiInMobi - Lead - Account Management - Microsoft Advertising

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Google - Senior Account Representative, Search Ads 360

Google

New York, New York, United States (On-Site)
1 Week ago
Tesla - Area Parts Supervisor

Tesla

Berlin, Berlin, Germany (On-Site)
2 Months ago
Nintendo - Senior Ambassador - Nintendo San Francisco

Nintendo

San Francisco, California, United States (On-Site)
6 Months ago
ByteDance - Procurement Manager - Japan

ByteDance

Tokyo, Japan (On-Site)
2 Weeks ago
Canva - Senior Manager, Revenue Operations

Canva

Los Angeles, California, United States (Remote)
1 Month ago
The Walt Disney Company - Costume Distribution Lead

The Walt Disney Company

Hong Kong (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Polygon Labs - Director of Product Management - Protocol

Polygon Labs

United Kingdom (Remote)
1 Month ago
PwC - Senior Associate - Credit Control

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
6 Months ago
Google - Customer Engineer, Data Analytics, Google Cloud

Google

Viby, Denmark (On-Site)
1 Week ago
FanCode - Associate Vice President - Product Design

FanCode

Mumbai, Maharashtra, India (On-Site)
7 Months ago
Social Discovery Ventures - VP of Finance

Social Discovery Ventures

Cyprus (Remote)
7 Months ago
Microsoft - Senior Human Resources Consultant

Microsoft

Mexico City, Mexico City, Mexico (On-Site)
23 Hours ago
ByteDance - Senior Software Engineer, Multi Cloud CDN - San Jose / Seattle / Boston

ByteDance

Boston, Massachusetts, United States (On-Site)
4 Months ago
Warner Bros Games - Director, Market Intelligence

Warner Bros Games

Burbank, California, United States (Hybrid)
2 Months ago
Easygo - Data Engineer

Easygo

Melbourne, Victoria, Australia (On-Site)
2 Months ago
PwC - IN- Senior Associate_ DevOps_Advisory Corporate_Advisory _Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Paytm - Product Management - Director Product - Risk Product

Paytm

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Nagarro - Staff Consultant ,Sap Development BTP

Nagarro

India (Remote)
6 Months ago
Braves Technologies - Associate Talent Sourcer (@Rent-A-Sourcer)

Braves Technologies

Pune, Maharashtra, India (On-Site)
1 Year ago
Google - Content Strategist, gTech Ad Customer Support

Google

Gurugram, Haryana, India (On-Site)
1 Week ago
Trek - Technical Product Support

Trek

Haryana, India (On-Site)
2 Months ago
Assystems - Draughts Person / Designer - Solar (Civil & Structural)

Assystems

Gurugram, Haryana, India (On-Site)
6 Months ago
Simple Viral Games - Quality Analyst/ QA Engineer

Simple Viral Games

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Omnissa - Senior Member of Technical Staff (C++ Windows)

Omnissa

Chennai, Tamil Nadu, India (On-Site)
6 Months ago
Paytm - Sales Team Lead- Bangalore

Paytm

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Scopely - General Manager, Looney Tunes World of Mayhem

Scopely

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Operations Jobs

Google - Program Manager II, Digital Content, Google Data Centers

Google

Austell, Georgia, United States (On-Site)
1 Week ago
Microsoft - Senior Support Escalation Manager

Microsoft

Sydney, New South Wales, Australia (Hybrid)
1 Week ago
The Walt Disney Company - Complex Lifting and Handling Technician - Night Shift

The Walt Disney Company

Île-de-France, France (On-Site)
2 Weeks ago
Bally's Interactive - Count Room Representative

Bally's Interactive

(On-Site)
1 Week ago
Google - Vendor Operations Manager, YouTube Global Vendor Operations

Google

San Bruno, California, United States (On-Site)
19 Hours ago
Tesla - Operations Coordinator, Fleet - West

Tesla

North Holland, Netherlands (On-Site)
2 Months ago
Keywords Studios - Customer Support Team Lead - Remote

Keywords Studios

Okinawa, Japan (Remote)
1 Month ago
Google - Training Program Manager, Design and Delivery

Google

Bengaluru, Karnataka, India (On-Site)
18 Hours ago
Nagarro - Associate Director, Operations

Nagarro

Mexico (Remote)
6 Months ago
Luxoft - Murex BAU Consultant - Mexico

Luxoft

Mexico City, Mexico City, Mexico (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Dublin, County Dublin, Ireland (On-Site)

New York, New York, United States (On-Site)

Waterloo, Ontario, Canada (On-Site)

Taipei City, Taiwan (On-Site)

San Francisco, California, United States (On-Site)

Saint-Ghislain, Wallonia, Belgium (On-Site)

Bengaluru, Karnataka, India (On-Site)

Austin, Texas, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug