Scaled Abuse Analyst, YouTube Trust and Safety

5 Months ago • 2 Years + • Editorial

Job Summary

Job Description

The Scaled Abuse Analyst at YouTube's Trust & Safety team works globally to prevent harmful content. Responsibilities include researching abuse trends, analyzing data (using SQL and potentially machine learning models like LLMs and BERT) to identify detection gaps and develop solutions, improving enforcement quality, contributing to new workflows, and responding rapidly to abuse incidents. The role requires collaboration with cross-functional teams and a proactive approach to addressing evolving threats like influence operations and financially motivated abuse. The analyst will contribute to strategies that reduce harmful content and protect the YouTube platform and user base.
Must have:
  • Bachelor's degree or equivalent experience
  • 2+ years in data analytics, Trust & Safety, or related fields
  • Experience with SQL and spreadsheets
  • Excellent problem-solving skills
  • Content policy & abuse review experience
Good to have:
  • Experience with identifying abuse trends
  • Experience with machine learning models
  • Experience in news or policy
  • Ability to build cross-functional relationships

Job Details

Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 2 years of experience in data analytics, Trust and Safety, policy, cybersecurity, or related fields.

Preferred qualifications:

  • Experience in content policy, anti-abuse, and reviewing online content.
  • Experience with identifying abuse trends or working in news or policy.
  • Experience with SQL and spreadsheets.
  • Ability to build relationships with cross-functional partners across geographies.
  • Excellent problem-solving skills, with the ability to use data to drive strategy and business action.

About the job

Fast-paced, dynamic, and proactive, YouTube’s Trust & Safety team is dedicated to making YouTube a safe place for users, viewers, and content creators around the world to belong, create, and express themselves. Whether understanding and solving their online content concerns, navigating within global legal frameworks, or writing and enforcing worldwide policy, the Trust & Safety team is on the frontlines of enhancing the YouTube experience, building internet safety, and protecting free speech in our ever-evolving digital world.

As a Scaled Abuse Analyst, you will be responsible for working with a global team from policy, enforcement, product, engineering, tooling, and legal to prevent violative content from appearing on the platform. You will evaluate abuse trends and develop creative solutions to address detection gaps, quality workflows, and processes. You will also review decisions about the appropriateness of different content. You will grow in a paced, dynamic, and demanding environment where the threat actor landscape is constantly evolving.

In this role, you will be a contributor to the efforts to reduce harmful content on YouTube. You will be part of a team that oversees emerging threats to the YouTube platform and user base. These threats include, influence operations, financially motivated abuse, sensationalist news, with a focus on deceptive practices.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

  • Research and stay up-to-date on trends and suspicious patterns of abuse across the team’s policy areas. Oversee enforcement quality across team policy areas, including calibrations with vendor teams.
  • Utilize methods to analyze data sets to gain insights into the impact of abuse on the YouTube ecosystem with knowledge of SQL and dashboarding.
  • Leverage SQL and programming skills to provide rapid incident response for abuse problems, operating with minimal guidance. Analyze and draw conclusions on root-causes and define and implement mitigation steps.
  • Contribute to the strategy and development of new workflows to address additional known and emerging vectors of abuse. Apply and develop machine learning models (e.g., using LLMs, BERT) to detect, prevent various types of abuse on YouTube.
  • Develop Machine Learning (ML) based detection systems for different adversarial and large scale coordinated abuse vectors.

Similar Jobs

BlinkRx - Quality Assurance Engineer

BlinkRx

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Intel Corporation - Software Engineer - Development Tools

Intel Corporation

San José, San José Province, Costa Rica (Hybrid)
5 Months ago
LSEG (London Stock Exchange Group) - Software Engineering QA Engineer

LSEG (London Stock Exchange Group)

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Luxoft - Experienced Technical BI/DWH Business Investigator (Main Hub)

Luxoft

Bucharest, Bucharest, Romania (On-Site)
6 Months ago
N-iX - Senior .Net Full Stack Engineer (#2387)

N-iX

Poland (On-Site)
6 Months ago
The Walt Disney Company - KFSN News Photographer

The Walt Disney Company

Fresno, California, United States (On-Site)
6 Months ago
Blazesoft - Part-Time Copywriter

Blazesoft

(Remote)
9 Months ago
PhonePe - Senior Lead Copywriter

PhonePe

Bengaluru, Karnataka, India (On-Site)
10 Months ago
Ziff Davis - Creative Strategy Lead

Ziff Davis

California, United States (Hybrid)
5 Months ago
Nielsen Holdings - Schedule Editor  freshers only (Mumbai )

Nielsen Holdings

Mumbai, Maharashtra, India (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PwC - IN-Senior Associate_Big Data Engineer_Data & Analytics_Advisory_PAN India

PwC

Gurugram, Haryana, India (On-Site)
7 Months ago
Canva - Senior Software Engineer (Python) - Data Platform (Open to remote across ANZ)

Canva

Auckland, Auckland, New Zealand (Remote)
6 Months ago
ComeOn Group - Software Developer - Backend Services

ComeOn Group

Graz, Styria, Austria (Hybrid)
7 Months ago
Luxoft - Senior Java Developer

Luxoft

New Delhi, Delhi, India (Remote)
5 Months ago
GoTo Group - Strategic Insight Analyst

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
5 Months ago
Razer - Manager, Fraud & Payment

Razer

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
8 Months ago
Next Level Business Services - JAVA DEVELOPER

Next Level Business Services

Cincinnati, Ohio, United States (On-Site)
7 Months ago
Canva - Data Lead - Print

Canva

Melbourne, Victoria, Australia (Hybrid)
5 Months ago
Egnyte - Sr Software Engineer - Java

Egnyte

Poznań, Greater Poland Voivodeship, Poland (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Worldwide

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Editorial Jobs

Vimeo - Sr. Content Designer

Vimeo

New York, New York, United States (Remote)
7 Months ago
JioSaavn - Associate/Senior Associate – Music Research (English & Bengali)

JioSaavn

Mumbai, Maharashtra, India (On-Site)
8 Months ago
FUEL - Head of Content

FUEL

Dublin, County Dublin, Ireland (Hybrid)
10 Months ago
Twitch - Creator Acquisitions Intern (Dec 2025/Spring 2026)

Twitch

San Francisco, California, United States (On-Site)
5 Months ago
Alphasense - Business & Finance Writer/Editor

Alphasense

Remote, Oregon, United States (Remote)
5 Months ago
Juego Studios - SEO Specialist - North America Region

Juego Studios

Bengaluru, Karnataka, India (On-Site)
6 Months ago
WebFX - Remote Copywriter

WebFX

Philadelphia, Pennsylvania, United States (Remote)
6 Months ago
Easy Brain - Game Content Manager

Easy Brain

Limassol, Limassol, Cyprus (Hybrid)
5 Months ago
Warner Bros Discovery - Editor (Book Development)

Warner Bros Discovery

New York, New York, United States (On-Site)
6 Months ago
Voodoo - Influence Manager - US

Voodoo

New York, New York, United States (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded