Community

Home >

Jobs >

Scaled Abuse Analyst, YouTube Trust and Safety

Telangana, India (On-site)

Scaled Abuse Analyst, YouTube Trust and Safety

3 Days ago • 2 Years + • Editorial

About the job

4 skills required for this role

Add these skills to join the top 1% applicants for this job

sql

incident-response

data-analytics

cross-functional

Job Description

As a Scaled Abuse Analyst at YouTube's Trust & Safety team, you'll work with a global team to prevent harmful content. You'll analyze abuse trends, develop solutions for detection gaps, review content appropriateness, and contribute to strategies for addressing emerging threats. Responsibilities include researching abuse patterns, overseeing enforcement quality, using data analysis (SQL) to understand abuse impact, providing rapid incident response, defining mitigation steps, and developing new workflows. You will also contribute to the development of machine learning models to detect and prevent abuse, working in a fast-paced environment where the threat landscape constantly evolves. The role involves collaborating with various teams, including policy, enforcement, product, engineering, and legal.

Must have:

Bachelor's degree or equivalent experience
2+ years experience in relevant field
Experience with SQL and data analysis
Excellent problem-solving skills
Content policy and abuse detection experience

Good to have:

Experience with machine learning models (LLMs, BERT)
Experience in news or policy
Ability to build cross-functional relationships

Minimum qualifications:

Bachelor's degree or equivalent practical experience.
2 years of experience in data analytics, Trust and Safety, policy, cybersecurity, or related fields.

Preferred qualifications:

Experience in content policy, anti-abuse, and reviewing online content.
Experience with identifying abuse trends or working in news or policy.
Experience with SQL and spreadsheets.
Ability to build relationships with cross-functional partners across geographies.
Excellent problem-solving skills, with the ability to use data to drive strategy and business action.

About the job

Fast-paced, dynamic, and proactive, YouTube’s Trust & Safety team is dedicated to making YouTube a safe place for users, viewers, and content creators around the world to belong, create, and express themselves. Whether understanding and solving their online content concerns, navigating within global legal frameworks, or writing and enforcing worldwide policy, the Trust & Safety team is on the frontlines of enhancing the YouTube experience, building internet safety, and protecting free speech in our ever-evolving digital world.

As a Scaled Abuse Analyst, you will be responsible for working with a global team from policy, enforcement, product, engineering, tooling, and legal to prevent violative content from appearing on the platform. You will evaluate abuse trends and develop creative solutions to address detection gaps, quality workflows, and processes. You will also review decisions about the appropriateness of different content. You will grow in a paced, dynamic, and demanding environment where the threat actor landscape is constantly evolving.

In this role, you will be a contributor to the efforts to reduce harmful content on YouTube. You will be part of a team that oversees emerging threats to the YouTube platform and user base. These threats include, influence operations, financially motivated abuse, sensationalist news, with a focus on deceptive practices.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

Research and stay up-to-date on trends and suspicious patterns of abuse across the team’s policy areas. Oversee enforcement quality across team policy areas, including calibrations with vendor teams.
Utilize methods to analyze data sets to gain insights into the impact of abuse on the YouTube ecosystem with knowledge of SQL and dashboarding.
Leverage SQL and programming skills to provide rapid incident response for abuse problems, operating with minimal guidance. Analyze and draw conclusions on root-causes and define and implement mitigation steps.
Contribute to the strategy and development of new workflows to address additional known and emerging vectors of abuse. Apply and develop machine learning models (e.g., using LLMs, BERT) to detect, prevent various types of abuse on YouTube.
Develop Machine Learning (ML) based detection systems for different adversarial and large scale coordinated abuse vectors.

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%

About The Company

Google

3103 Active Jobs

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.