Generative AI Labeling and Quality Lead

1 Month ago • 10-10 Years • Operations

Job Summary

Job Description

As the Generative AI Labeling and Quality Lead at YouTube, you will collaborate with cross-functional stakeholders to enhance GenAI capabilities for internal and external tools. You'll work closely with Product and Engineering teams to define requirements for efficient tooling and automation in labeling and QA. Responsibilities include overseeing the global vendor labeling operations team, ensuring high-quality label delivery, managing vendor relationships, utilizing data analysis for process improvement, and partnering with tech teams to develop frameworks for collecting high-quality labels for training and testing GenAI models. The role involves developing GenAI capabilities and processes within YouTube's Global vendor operations team and requires strong data analysis, operational management, and team leadership skills.
Must have:
  • Bachelor's degree or equivalent experience
  • 10+ years experience in operational process solutions and cross-functional teamwork
  • 10+ years experience in data analysis and generating business insights
  • Oversee global vendor labeling operations
  • Ensure high-volume, high-quality label delivery
  • Develop GenAI capabilities and processes
Good to have:
  • Experience in operations management or management consulting
  • Experience leading data annotation teams
  • Managing globally distributed workforce vendors
  • Experience building and reporting on business metrics
  • Understanding of ML training of Perception models

Job Details


Minimum qualifications:

  • Bachelor's degree in Business or related field, or equivalent practical experience.
  • 10 years of experience developing operational process solutions, and working with cross-functional teams.
  • 10 years of experience analyzing data and generating business insights.

Preferred qualifications:

  • 10 years of experience in operations management, management consulting or related fields.
  • Experience leading teams responsible for data annotation or related functions.
  • Experience managing globally distributed workforce vendors, and ability to define and implement complex operational workflows that are data driven.
  • Experience building and reporting on meaningful business metrics, with excellent data analysis and influencing skills.
  • Understanding of ML training of Perception models and associated inputs (e.g., calibration), data infrastructure, and visualization tooling.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you’ll lead complex, multi-disciplinary projects from start to finish — working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company. Your projects will often span offices, time zones, and hemispheres. It's your job to coordinate the players and keep them up to date on progress and deadlines.

As the GenAI Labeling and Quality Lead, you will partner with cross-functional stakeholders to help build up the GenAI based capabilities for the various internal and externally facing tools. You will partner closely with Product and Engineering teams to identify and define requirements for efficient tooling and automation to streamline labeling and Quality Assurance processes. You will develop GenAI capabilities and processes within YouTube's Global vendor operations team.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

  • Partner closely with Tech teams to develop frameworks for collecting high quality labels for training and testing GenAI models for various use cases within the creator, consumer organizations.
  • Oversee extended workforce for labeling operations team in the global vendor organization.
  • Ensure efficient workflows and policies are in place that result in the delivery of a high volume of quality labels meeting customer needs on a continuous basis.
  • Oversee all aspects of vendor relationships and partner organizations responsible for ground truth labeling including training, and policy.
  • Utilize data and analysis to identify opportunities for improvement in operational workflows and processes.

Similar Jobs

Whoop - Clinical Research Scientist

Whoop

Boston, Massachusetts, United States (On-Site)
1 Month ago
Embark Studios - Product Manager - Games

Embark Studios

Stockholm, Stockholm County, Sweden (On-Site)
6 Months ago
Synechron - VisionPLUS Developer - APAC

Synechron

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
Marsh McLennan - Sales Analyst

Marsh McLennan

New York, United States (Hybrid)
3 Weeks ago
Playrix - Senior Data Analyst (Game)

Playrix

Cyprus (Remote)
7 Months ago
Tesla - Senior Field Operations Specialist, Commercial Energy and Charging

Tesla

North Holland, Netherlands (On-Site)
3 Months ago
Tesla - Parts Operations Lead - West & South Europe

Tesla

North Holland, Netherlands (On-Site)
3 Months ago
Rank group - Poker Dealer - Zero Hour

Rank group

Newcastle Upon Tyne, England, United Kingdom (On-Site)
6 Months ago
Netflix - HR Service Delivery Transition Analyst

Netflix

Manila, Metro Manila, Philippines (Hybrid)
1 Month ago
Accenture in India - Analyst

Accenture in India

Navi Mumbai, Maharashtra, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

FICO - Customer Success - Sr. Manager

FICO

(Remote)
2 Weeks ago
Wooga - Senior Product Manager - LiveOps

Wooga

Berlin, Berlin, Germany (Hybrid)
1 Month ago
PwC - Senior Associate - ESG - Roma

PwC

Rome, Lazio, Italy (On-Site)
4 Months ago
Version1 - Databricks Engineer

Version1

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Rush Street Interactive - Senior Analytics Engineer

Rush Street Interactive

(Remote)
3 Weeks ago
Discord - Sales Operations Manager

Discord

San Francisco, California, United States (On-Site)
1 Month ago
Moloco - Senior Data Scientist, Growth Analytics (Japanese-Speaking)

Moloco

Seoul, South Korea (On-Site)
1 Month ago
Google - Customer Solutions Engineer, gTech Ads

Google

Beijing, Beijing, China (On-Site)
1 Month ago
Moloco - Senior New Business Manager

Moloco

Tokyo, Japan (On-Site)
1 Month ago
ByteDance - AI Product Manager

ByteDance

San Jose, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Synechron - Full Stack Python Developer (Cloud, IoT, Blockchain & Agile Expertise)

Synechron

Pune, Maharashtra, India (On-Site)
2 Weeks ago
FICO - Java Customer Support-Engineer II (Java, AWS)

FICO

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Dream Sports - Software Development Engineer 3 - Backend (Platform)

Dream Sports

Mumbai, Maharashtra, India (On-Site)
2 Months ago
10times - Data Scientist

10times

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Assystems - Team Leader Structural Design - (Buildings)

Assystems

Pune, Maharashtra, India (On-Site)
7 Months ago
Fictiv - Technical Architect

Fictiv

Pune, Maharashtra, India (On-Site)
1 Month ago
Enphase Energy - Sr Engineer Firmware

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Eccentric - Key Account Manager (Technical)

Eccentric

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Enphase Energy - Solargraf Sr. QA Engineer

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Keywords International - Junior Localization Project Manager

Keywords International

Gurugram, Haryana, India (Hybrid)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Operations Jobs

Tencent - Purchasing Intern

Tencent

London, England, United Kingdom (On-Site)
1 Month ago
People Can Fly - Live Operations Technician

People Can Fly

Montreal, Quebec, Canada (Remote)
1 Month ago
The Walt Disney Company - Assistant Store Manager

The Walt Disney Company

Minato City, Tokyo, Japan (On-Site)
4 Months ago
Tesla - Delivery Operations Manager

Tesla

Vienna, Vienna, Austria (On-Site)
3 Months ago
Google - Strategy and Operations Lead, GTM

Google

Chicago, Illinois, United States (On-Site)
1 Month ago
Keywords Studios - Customer Support Team Lead - Remote

Keywords Studios

Okinawa, Japan (Remote)
2 Months ago
ByteDance - Destination Service Manager - EMEA

ByteDance

Dubai, Dubai, United Arab Emirates (On-Site)
1 Month ago
The Walt Disney Company - Ship Investigation Manager

The Walt Disney Company

(On-Site)
1 Month ago
Tesla - Delivery Advisor

Tesla

Lisbon, Lisbon, Portugal (On-Site)
3 Months ago
Google - Service Delivery Manager

Google

Haryana, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Taipei City, Taiwan (On-Site)

Zürich, Zurich, Switzerland (On-Site)

Kirkland, Washington, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug