Generative AI Labeling and Quality Lead

7 Hours ago • 10-10 Years • Operations

Job Summary

Job Description

The Generative AI Labeling and Quality Lead at YouTube will partner with cross-functional stakeholders to build GenAI capabilities for internal and external tools. This role involves defining requirements for efficient tooling and automation to streamline labeling and QA processes, developing GenAI capabilities within YouTube's Global vendor operations team, and overseeing the extended workforce for labeling operations. Responsibilities include developing frameworks for collecting high-quality labels for training and testing GenAI models, ensuring efficient workflows and policies for delivering high-volume quality labels, overseeing vendor relationships and ground truth labeling, and utilizing data analysis to identify opportunities for process improvement. The ideal candidate will have extensive experience in operational process solutions, data analysis, and managing globally distributed workforces.
Must have:
  • 10+ years experience in operational process solutions and cross-functional team work
  • 10+ years experience in data analysis and generating business insights
  • Oversee extended workforce for labeling operations
  • Develop frameworks for collecting high-quality labels for GenAI models
  • Ensure efficient workflows for high-volume quality label delivery
Good to have:
  • Experience in operations management or management consulting
  • Experience leading data annotation teams
  • Experience managing globally distributed workforce vendors
  • Understanding of ML training of Perception models
  • Excellent data analysis and influencing skills

Job Details


Minimum qualifications:

  • Bachelor's degree in Business or related field, or equivalent practical experience.
  • 10 years of experience developing operational process solutions, and working with cross-functional teams.
  • 10 years of experience analyzing data and generating business insights.

Preferred qualifications:

  • 10 years of experience in operations management, management consulting or related fields.
  • Experience leading teams responsible for data annotation or related functions.
  • Experience managing globally distributed workforce vendors, and ability to define and implement complex operational workflows that are data driven.
  • Experience building and reporting on meaningful business metrics, with excellent data analysis and influencing skills.
  • Understanding of ML training of Perception models and associated inputs (e.g., calibration), data infrastructure, and visualization tooling.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you’ll lead complex, multi-disciplinary projects from start to finish — working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company. Your projects will often span offices, time zones, and hemispheres. It's your job to coordinate the players and keep them up to date on progress and deadlines.

As the GenAI Labeling and Quality Lead, you will partner with cross-functional stakeholders to help build up the GenAI based capabilities for the various internal and externally facing tools. You will partner closely with Product and Engineering teams to identify and define requirements for efficient tooling and automation to streamline labeling and Quality Assurance processes. You will develop GenAI capabilities and processes within YouTube's Global vendor operations team.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

  • Partner closely with Tech teams to develop frameworks for collecting high quality labels for training and testing GenAI models for various use cases within the creator, consumer organizations.
  • Oversee extended workforce for labeling operations team in the global vendor organization.
  • Ensure efficient workflows and policies are in place that result in the delivery of a high volume of quality labels meeting customer needs on a continuous basis.
  • Oversee all aspects of vendor relationships and partner organizations responsible for ground truth labeling including training, and policy.
  • Utilize data and analysis to identify opportunities for improvement in operational workflows and processes.

Similar Jobs

Microsoft - Software Engineer, Data Engineering

Microsoft

Redmond, Washington, United States (On-Site)
16 Hours ago
Onward Search - IT Service Delivery Manager

Onward Search

Newtown, Pennsylvania, United States (Remote)
3 Weeks ago
Starkflow - Product Analyst

Starkflow

(On-Site)
2 Months ago
AVER LLC - Latent Print Examiner

AVER LLC

United States (Hybrid)
4 Months ago
NVIDIA - Software Program Manager, New Product Introduction

NVIDIA

Santa Clara, California, United States (On-Site)
6 Days ago
Tencent - Purchasing Intern

Tencent

California, United States (On-Site)
1 Week ago
Tesla - Mobile Service Technician

Tesla

Netanya, Center District, Israel (On-Site)
2 Months ago
Sandbox VR - Assistant Store Manager

Sandbox VR

Singapore (On-Site)
6 Months ago
ByteDance - Senior Payroll Analyst

ByteDance

Bangkok, Bangkok, Thailand (On-Site)
3 Weeks ago
The Walt Disney Company - Technology Procurement Analyst I

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

EXUSIA - Salesforce Conga Specialist

EXUSIA

Hyderabad, Telangana, India (Remote)
1 Week ago
ByteDance - Research Scientist- Applied Machine learning Graduates (AML) - 2024 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Ziff Davis - Backend Software Engineer II

Ziff Davis

Malaga, Western Australia, Australia (Remote)
3 Months ago
Epic Games - Senior Engine Programmer, Fortnite Tech

Epic Games

(On-Site)
3 Weeks ago
PwC - IN-Senior Associate_ML Engineer_Data and Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
PwC - Consultant expérimenté Contrôle Permanent - Banque | CDI | H/F

PwC

Neuilly-sur-Seine, Île-de-France, France (On-Site)
6 Months ago
Flow - Senior/Staff Web Engineer

Flow

New York, New York, United States (Hybrid)
6 Months ago
ByteDance - Cloud Solution Architect (Automotive Industry) - Singapore

ByteDance

Singapore (On-Site)
5 Months ago
Google - Software Engineer, PhD

Google

Sunnyvale, California, United States (On-Site)
8 Hours ago
Hitachi - Data Scientist

Hitachi

Pune, Maharashtra, India (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

CleverTap - Senior Backend Engineer

CleverTap

Mumbai, Maharashtra, India (Hybrid)
6 Months ago
PwC - IN_Senior Associate _ERP_Utility Transformation_Advisory_Jaipur

PwC

Jaipur, Rajasthan, India (On-Site)
4 Months ago
SoCheers - Creative Supervisor - Design - Mumbai

SoCheers

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Keywords Studios - Executive - Transport Administration

Keywords Studios

Haryana, India (On-Site)
4 Weeks ago
Warner Bros Games - Staff Software Engineer - Java Fullstack - MSC Deals Team

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
2 Weeks ago
NVIDIA - EDA System Software Engineer

NVIDIA

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
SSK Interanational School - Art & craft

SSK Interanational School

Ernakulam, Kerala, India (On-Site)
5 Months ago
CloudHire - Client Success Associate

CloudHire

Karnataka, India (Remote)
3 Weeks ago
Rackspace Technology - DevOps Engineer (AWS Terraform)

Rackspace Technology

India (Remote)
5 Days ago

Get notifed when new similar jobs are uploaded

Operations Jobs

Tesla - Service Manager

Tesla

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Google - Googler Experience Operations, People Experience

Google

Mexico City, Mexico City, Mexico (On-Site)
8 Hours ago
CloudLinux - Billing Operations Specialist

CloudLinux

Buenos Aires, Buenos Aires, Argentina (Remote)
2 Weeks ago
Tesla - Business Planning Analyst

Tesla

Berlin, Berlin, Germany (On-Site)
1 Month ago
ByteDance - Operation Specialist Intern - Global Payment

ByteDance

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
3 Weeks ago
Sporty Group - IN Lead - Customer Success

Sporty Group

Delhi, India (On-Site)
3 Weeks ago
Welevel - Founders Associate

Welevel

Munich, Bavaria, Germany (On-Site)
1 Month ago
Trackman - Simulator Operations Coordinator

Trackman

Phoenix, Arizona, United States (On-Site)
1 Day ago
Tesla - Service Advisor

Tesla

Groningen, Groningen, Netherlands (On-Site)
2 Months ago
GoTo Group - Senior IT Operation Engineer

GoTo Group

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Dublin, County Dublin, Ireland (On-Site)

Sunnyvale, California, United States (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Hyderabad, Telangana, India (On-Site)

Sunnyvale, California, United States (On-Site)

Sydney, New South Wales, Australia (On-Site)

Waterloo, Ontario, Canada (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug