Generative AI Labeling and Quality Lead

1 Month ago • 10-10 Years • Operations

Job Summary

Job Description

The Generative AI Labeling and Quality Lead at YouTube will partner with cross-functional stakeholders to build GenAI capabilities for internal and external tools. This role involves defining requirements for efficient tooling and automation to streamline labeling and QA processes, developing GenAI capabilities within YouTube's Global vendor operations team, and overseeing the extended workforce for labeling operations. Responsibilities include developing frameworks for collecting high-quality labels for training and testing GenAI models, ensuring efficient workflows and policies for delivering high-volume quality labels, overseeing vendor relationships and ground truth labeling, and utilizing data analysis to identify opportunities for process improvement. The ideal candidate will have extensive experience in operational process solutions, data analysis, and managing globally distributed workforces.
Must have:
  • 10+ years experience in operational process solutions and cross-functional team work
  • 10+ years experience in data analysis and generating business insights
  • Oversee extended workforce for labeling operations
  • Develop frameworks for collecting high-quality labels for GenAI models
  • Ensure efficient workflows for high-volume quality label delivery
Good to have:
  • Experience in operations management or management consulting
  • Experience leading data annotation teams
  • Experience managing globally distributed workforce vendors
  • Understanding of ML training of Perception models
  • Excellent data analysis and influencing skills

Job Details


Minimum qualifications:

  • Bachelor's degree in Business or related field, or equivalent practical experience.
  • 10 years of experience developing operational process solutions, and working with cross-functional teams.
  • 10 years of experience analyzing data and generating business insights.

Preferred qualifications:

  • 10 years of experience in operations management, management consulting or related fields.
  • Experience leading teams responsible for data annotation or related functions.
  • Experience managing globally distributed workforce vendors, and ability to define and implement complex operational workflows that are data driven.
  • Experience building and reporting on meaningful business metrics, with excellent data analysis and influencing skills.
  • Understanding of ML training of Perception models and associated inputs (e.g., calibration), data infrastructure, and visualization tooling.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you’ll lead complex, multi-disciplinary projects from start to finish — working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company. Your projects will often span offices, time zones, and hemispheres. It's your job to coordinate the players and keep them up to date on progress and deadlines.

As the GenAI Labeling and Quality Lead, you will partner with cross-functional stakeholders to help build up the GenAI based capabilities for the various internal and externally facing tools. You will partner closely with Product and Engineering teams to identify and define requirements for efficient tooling and automation to streamline labeling and Quality Assurance processes. You will develop GenAI capabilities and processes within YouTube's Global vendor operations team.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

  • Partner closely with Tech teams to develop frameworks for collecting high quality labels for training and testing GenAI models for various use cases within the creator, consumer organizations.
  • Oversee extended workforce for labeling operations team in the global vendor organization.
  • Ensure efficient workflows and policies are in place that result in the delivery of a high volume of quality labels meeting customer needs on a continuous basis.
  • Oversee all aspects of vendor relationships and partner organizations responsible for ground truth labeling including training, and policy.
  • Utilize data and analysis to identify opportunities for improvement in operational workflows and processes.

Similar Jobs

Thales - Project Accountant

Thales

Belfast, Northern Ireland, United Kingdom (Hybrid)
2 Weeks ago
Entrata - API Specialist

Entrata

Pune, Maharashtra, India (Hybrid)
1 Month ago
Barracuda Networks  Inc  - Software Engineer

Barracuda Networks Inc

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
WebTech Corporation - PD Supervisor

WebTech Corporation

Suzhou, Jiangsu, China (On-Site)
1 Month ago
Clear Watery Analytics - Staff Data Engineer

Clear Watery Analytics

Noida, Uttar Pradesh, India (On-Site)
3 Weeks ago
Samsung Semiconductor - Senior Business Architect

Samsung Semiconductor

San Jose, California, United States (On-Site)
1 Month ago
Outscal - Product Operations (Gaming)

Outscal

Delhi, India (On-Site)
5 Months ago
LeoVegas - GDPR & Complaints Specialist Dutch Market

LeoVegas

Sliema, Malta (On-Site)
7 Months ago
ByteDance - Appeal Program Manager - UK Market

ByteDance

Taguig, Metro Manila, Philippines (On-Site)
1 Month ago
Hawk Eye Innovations - Match Operations Assistant - Hamburg

Hawk Eye Innovations

Hamburg, Hamburg, Germany (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Hawk Eye Innovations - Delivery Manager

Hawk Eye Innovations

Basingstoke, England, United Kingdom (On-Site)
2 Months ago
FICO - Analytic Science — Pre-Sales Lead Scientist

FICO

San Diego, California, United States (On-Site)
2 Weeks ago
Accurate - Data Architect

Accurate

Hyderabad, Telangana, India (Hybrid)
1 Month ago
PwC - IT Audit Senior Associate (ITGC) - Amman

PwC

Amman, Amman Governorate, Jordan (On-Site)
8 Months ago
Gupta - Data Analyst

Gupta

Boston, Massachusetts, United States (On-Site)
1 Month ago
Seedify - Backend Engineer

Seedify

India (Remote)
7 Months ago
NVIDIA - Silicon Power Performance Engineer

NVIDIA

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Juego Studios - Senior QA Engineer

Juego Studios

Bengaluru, Karnataka, India (On-Site)
4 Months ago
JustPlay - Senior Product Manager - Activation

JustPlay

Berlin, Berlin, Germany (Hybrid)
2 Months ago
Enterra Solutions - Deployment Manager

Enterra Solutions

(Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Accenture - Responsible AI Engineer

Accenture

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Nielsen Holdings - Software Engineer - Platform

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Workato - Senior Infrastructure Engineer

Workato

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Western Digital - Social Media Copywriter/Content Creator

Western Digital

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Alphasense - Compensation Analyst

Alphasense

Mumbai, Maharashtra, India (On-Site)
1 Week ago
Coda - Senior Software Engineering Manager

Coda

Bengaluru, Karnataka, India (Hybrid)
8 Months ago
Xogar Games - Senior Character Artist

Xogar Games

Bengaluru, Karnataka, India (On-Site)
8 Months ago
NCR Voyix - Oracle Fusion Technical/Techno Functional

NCR Voyix

Gurugram, Haryana, India (On-Site)
1 Month ago
Lakshya Digital - Comic Illustrator

Lakshya Digital

Gurugram, Haryana, India (On-Site)
3 Weeks ago
Capgemini - CAN UDS-Component Verification

Capgemini

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Operations Jobs

The Walt Disney Company - Associate Location Planner

The Walt Disney Company

Hong Kong (On-Site)
1 Month ago
Google - Technical Program Manager, Subsea Capacity Delivery, Global Submarine Networks

Google

Sydney, New South Wales, Australia (On-Site)
1 Month ago
Tencent - Purchasing Intern

Tencent

London, England, United Kingdom (On-Site)
1 Month ago
Netflix - Senior Manager, Protective Services

Netflix

Los Angeles, California, United States (On-Site)
1 Month ago
OUTFIT7 - Game Operations Manager

OUTFIT7

Shanghai, Shanghai, China (On-Site)
2 Months ago
Netflix - Manager, Studio Safety - Albuquerque

Netflix

New Mexico, United States (On-Site)
1 Month ago
Tesla - Senior Field Operations Specialist, Commercial Energy and Charging

Tesla

North Holland, Netherlands (On-Site)
3 Months ago
ION - Technical Operations Engineer

ION

Woking, England, United Kingdom (On-Site)
7 Months ago
Tesla - Service Manager

Tesla

Holzwickede, North Rhine-Westphalia, Germany (On-Site)
3 Months ago
Google - Associate, Business Operations and Strategy

Google

Mountain View, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Taipei City, Taiwan (On-Site)

Zürich, Zurich, Switzerland (On-Site)

Kirkland, Washington, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug