Generative AI Labeling and Quality Lead

1 Month ago • 10-10 Years • Operations

Job Summary

Job Description

The Generative AI Labeling and Quality Lead at YouTube will partner with cross-functional stakeholders to develop GenAI capabilities for internal and external tools. This role requires close collaboration with Product and Engineering teams to define requirements for efficient tooling and automation to streamline labeling and Quality Assurance (QA) processes. Responsibilities include overseeing a global vendor workforce for labeling operations, ensuring efficient workflows, maintaining high-quality labels, managing vendor relationships, utilizing data analysis to identify process improvements, and developing frameworks for collecting high-quality labels for training and testing GenAI models. The ideal candidate will have extensive experience in operations management, data analysis, and leading teams responsible for data annotation. A strong understanding of ML training and data infrastructure is essential.
Must have:
  • 10+ years experience in operational process solutions and cross-functional teamwork
  • 10+ years experience in data analysis and generating business insights
  • Oversee global vendor workforce for labeling operations
  • Ensure high-volume delivery of quality labels meeting customer needs
  • Develop frameworks for collecting high-quality labels for GenAI models
Good to have:
  • Experience in operations management or management consulting
  • Experience managing globally distributed workforce vendors
  • Understanding of ML training of Perception models
  • Experience building and reporting on meaningful business metrics

Job Details


Minimum qualifications:

  • Bachelor's degree in Business or related field, or equivalent practical experience.
  • 10 years of experience developing operational process solutions, and working with cross-functional teams.
  • 10 years of experience analyzing data and generating business insights.

Preferred qualifications:

  • 10 years of experience in operations management, management consulting or related fields.
  • Experience leading teams responsible for data annotation or related functions.
  • Experience managing globally distributed workforce vendors, and ability to define and implement complex operational workflows that are data driven.
  • Experience building and reporting on meaningful business metrics, with excellent data analysis and influencing skills.
  • Understanding of ML training of Perception models and associated inputs (e.g., calibration), data infrastructure, and visualization tooling.

About the job

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you’ll lead complex, multi-disciplinary projects from start to finish — working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company. Your projects will often span offices, time zones, and hemispheres. It's your job to coordinate the players and keep them up to date on progress and deadlines.

As the GenAI Labeling and Quality Lead, you will partner with cross-functional stakeholders to help build up the GenAI based capabilities for the various internal and externally facing tools. You will partner closely with Product and Engineering teams to identify and define requirements for efficient tooling and automation to streamline labeling and Quality Assurance processes. You will develop GenAI capabilities and processes within YouTube's Global vendor operations team.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

  • Partner closely with Tech teams to develop frameworks for collecting high quality labels for training and testing GenAI models for various use cases within the creator, consumer organizations.
  • Oversee extended workforce for labeling operations team in the global vendor organization.
  • Ensure efficient workflows and policies are in place that result in the delivery of a high volume of quality labels meeting customer needs on a continuous basis.
  • Oversee all aspects of vendor relationships and partner organizations responsible for ground truth labeling including training, and policy.
  • Utilize data and analysis to identify opportunities for improvement in operational workflows and processes.

Similar Jobs

Avathon - Senior Full Stack Engineer

Avathon

Bengaluru, Karnataka, India (On-Site)
7 Months ago
survious - Senior Technology Engineer - Automation, Analytics and Live Ops (Unreal Engine 5)

survious

Marina Del Rey, California, United States (On-Site)
1 Month ago
SuperPlay - Business Data Analyst

SuperPlay

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Weeks ago
Head Digital Works - Business Intelligence Analyst

Head Digital Works

Hyderabad, Telangana, India (On-Site)
7 Months ago
Interactive Brokers - Analyst - Financial Advisor Compliance (Temp)

Interactive Brokers

Greenwich, Connecticut, United States (Hybrid)
2 Weeks ago
Google - Strategy and Operations Lead, GTM

Google

Chicago, Illinois, United States (On-Site)
1 Month ago
Voodoo - Growth Operations Intern

Voodoo

Paris, Île-de-France, France (On-Site)
1 Month ago
Google - Process Excellence Consultant

Google

Gurugram, Haryana, India (On-Site)
1 Month ago
Trek - District Manager

Trek

United States (Remote)
3 Months ago
Tesla - Megapack Sales Operations Project Manager, Energy EMEA

Tesla

North Holland, Netherlands (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

JoinZoe - Lead Machine Learning Engineer

JoinZoe

(Remote)
4 Weeks ago
onwards Search - Data Engineer II

onwards Search

Los Angeles, California, United States (Remote)
2 Weeks ago
Capgemini - Data Scientist

Capgemini

Mumbai, Maharashtra, India (On-Site)
3 Weeks ago
NVIDIA - Senior Computer Architect - Deep Learning

NVIDIA

Canada (On-Site)
3 Months ago
ByteDance - Solutions Architect

ByteDance

Taguig, Metro Manila, Philippines (On-Site)
1 Month ago
Scout - Senior Specialist, Aftersales Project Management

Scout

Columbia, South Carolina, United States (On-Site)
2 Weeks ago
World Resource Institute - Intern- Climate Economics Finance

World Resource Institute

New Delhi, Delhi, India (On-Site)
1 Month ago
ByteDance - Destination Service Manager - EMEA

ByteDance

Dubai, Dubai, United Arab Emirates (On-Site)
1 Month ago
Codeway studios - Product Intern

Codeway studios

Istanbul, İstanbul, Türkiye (On-Site)
1 Week ago
Truecaller - Senior Staff Data Engineer II

Truecaller

Stockholm, Stockholm County, Sweden (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Zinnia - Senior Auditor - IT, cybersecurity & infrastructure

Zinnia

Gurugram, Haryana, India (On-Site)
1 Month ago
Sporty Group - IN Associate - Customer Success

Sporty Group

Mumbai, Maharashtra, India (On-Site)
2 Months ago
FalconX - Senior Institutional Coverage

FalconX

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Assystems - Lead Electrical Engineer (LV/HT/ELV)

Assystems

Gurugram, Haryana, India (On-Site)
7 Months ago
Ramboll - ServiceNow Operational Support Specialist

Ramboll

Gurugram, Haryana, India (On-Site)
2 Weeks ago
Google - Staff Software Engineer, Core Data Serving

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Hitachi - MSD365 F&O Technical-Feb 2024

Hitachi

Pune, Maharashtra, India (Remote)
7 Months ago
Nagarro - Senior Engineer, Mainframe

Nagarro

India (Remote)
7 Months ago
Ansys - Principal Application Engineer - Energy Vertical Lead

Ansys

Pune, Maharashtra, India (On-Site)
2 Weeks ago
Netomi - SDE II/III Backend

Netomi

India (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Operations Jobs

Google - Technical Program Manager, Third Party Data Center Operations

Google

Frankfurt Am Main, Hessen, Germany (On-Site)
1 Month ago
Token Metrics - Crypto Operations Manager

Token Metrics

Manila, Metro Manila, Philippines (Remote)
7 Months ago
The Walt Disney Company - Costume Manager

The Walt Disney Company

Hong Kong (On-Site)
1 Month ago
TaskUs - Team Lead

TaskUs

Navi Mumbai, Maharashtra, India (On-Site)
7 Months ago
Tesla - Store Supervisor

Tesla

Oulu, North Ostrobothnia, Finland (On-Site)
3 Months ago
Tesla - Service Advisor

Tesla

Utrecht, Utrecht, Netherlands (On-Site)
3 Months ago
The Walt Disney Company - Complex Lifting and Handling Technician - Night Shift

The Walt Disney Company

Île-de-France, France (On-Site)
1 Month ago
Tesla - Service Advisor

Tesla

Flanders, Belgium (On-Site)
3 Months ago
Keywords Studios - IT Senior Support Manager

Keywords Studios

Madrid, Community Of Madrid, Spain (Hybrid)
1 Month ago
Google - Program Manager II, NPI Operations, Platforms and Devices

Google

Mountain View, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

London, England, United Kingdom (On-Site)

Bengaluru, Karnataka, India (On-Site)

Mountain View, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Taipei City, Taiwan (On-Site)

Zürich, Zurich, Switzerland (On-Site)

Kirkland, Washington, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug