Content Adversarial Red Team Analyst

3 Months ago • 4 Years + • Editorial

Job Summary

Job Description

The Content Adversarial Red Team Analyst at Google leads red teaming projects for Generative AI products, identifying unknown content safety risks. This role involves developing and executing red teaming strategies, collaborating with various stakeholders (product managers, engineers, researchers), analyzing testing results, and providing actionable insights. Responsibilities include identifying vulnerabilities, developing solutions, improving AI safety and security, and implementing strategic programs. The analyst will work with sensitive content, requiring the ability to handle graphic or upsetting material. The ideal candidate possesses strong problem-solving skills, attention to detail, and experience in data analytics, Trust and Safety, policy, or cybersecurity.
Must have:
  • Bachelor's degree or equivalent experience
  • 4+ years experience in related field
  • Lead red teaming projects for Google's AI products
  • Identify and execute red teaming strategies
  • Collaborate with stakeholders to develop solutions
  • Analyze testing results and provide actionable insights
Good to have:
  • Master's degree in related field
  • Experience with Google products and Generative AI
  • Understanding of content moderation policies

Job Details

Minimum qualifications:

  • Bachelor's degree or equivalent practical experience.
  • 4 years of experience in data analytics, Trust and Safety, policy, cyber security, or related fields.

Preferred qualifications:

  • Master's degree in a related field (e.g., Computer Science, Information Security, Artificial Intelligence).
  • Experience working with Google's products and services, particularly Generative Artificial Intelligence(AI) products.
  • Understanding of content moderation policies and best practices.
  • Ability to work independently and as part of a team.
  • Excellent problem-solving skills with attention to detail in a fluid environment.

About the job

Trust and Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. They use technical know-how, excellent problem-solving skills, user insights, and proactive communication to protect users and our partners from abuse across Google products like Search, Maps, Gmail, and Google Ads. On this team, you're a big-picture thinker and strategic team-player with a passion for doing what’s right. You work globally and cross-functionally with Google engineers and product managers to identify and fight abuse and fraud cases at Google speed - with urgency. And you take pride in knowing that every day you are working hard to promote trust in Google and ensuring the highest levels of user safety.

Please note that, in this role you will be required to work with sensitive content or situations which include exposure to graphic, controversial, or upsetting topics or content.

At Google we work hard to earn our users trust every day. Trust and Safety is Google’s team of abuse fighting and user trust experts working daily to make the internet a safer place. We partner with teams across Google to deliver bold solutions in abuse areas such as malware, spam and account hijacking. A diverse team of Analysts, Policy Specialists, Engineers, and Program Managers, we work to reduce risk and fight abuse across all of Google’s products, protecting our users, advertisers, and publishers across the globe in over 40 languages.

Responsibilities

  • Lead the red teaming projects for Google’s Generative Artificial Intelligence(AI) products, using novel strategies to identify unknown content safety risks.
  • Identify and execute appropriate red teaming strategy and testing approaches, including instructing vendor teams, for each project and product.
  • Partner with product managers, engineers, researchers, and other stakeholders to understand product functionality, potential vulnerabilities, and develop actionable solutions.
  • Identify interesting and unique issue areas or trends through the review of raw testing results.
  • Conduct analysis of issues, providing actionable insights to inform decision-making. Develop and implement strategic programs to improve AI safety and security. Identify key areas for process and impact improvements and develop comprehensive program plans collaborating with team members and stakeholders.

Similar Jobs

Visa - Data & Analytics Manager

Visa

Austin, Texas, United States (On-Site)
3 Months ago
PwC - (Senior) Manager Regie en Sourcing - Technology Consulting Publieke Sector

PwC

Amsterdam, North Holland, Netherlands (On-Site)
4 Months ago
Mimacom - Senior Data Engineer (m/f/d)

Mimacom

Stuttgart, Baden-Württemberg, Germany (On-Site)
4 Months ago
Salesforce - Data Cloud Account Executive

Salesforce

Munich, Bavaria, Germany (On-Site)
4 Months ago
Prime Video & Amazon MGM Studios - Head of Programming, Amazon Prime Video

Prime Video & Amazon MGM Studios

Maharashtra, India (On-Site)
5 Months ago
Warner Bros Discovery - Writer, Streaming (Temporary)

Warner Bros Discovery

Atlanta, Georgia, United States (On-Site)
3 Months ago
WebMD - Medical Writer (m/w/d)

WebMD

Konstanz, Baden-Württemberg, Germany (Hybrid)
3 Months ago
WebMD - Manager, Grants, Content & Accreditation

WebMD

Newark, New Jersey, United States (On-Site)
3 Months ago
Next Level Business Services - IBM Content Manager

Next Level Business Services

Columbus, Ohio, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PwC - Senior Manager-Cybersecurity-CD&E-Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Paytm - Product Management - Product Manager - CST Product

Paytm

Noida, Uttar Pradesh, India (On-Site)
4 Months ago
IGT - Senior Internal Auditor, IT

IGT

Providence, Rhode Island, United States (On-Site)
3 Months ago
Google - Trust and Safety Product Specialist

Google

(On-Site)
3 Months ago
Trendyol - Trendyol GO - Growth Analytics Professionals

Trendyol

İstanbul, İstanbul, Türkiye (Hybrid)
4 Months ago
HP - Customer Success Manager

HP

Tlaquepaque, Jalisco, Mexico (On-Site)
4 Months ago
PwC - Cybersecurity-IAM - Sailpoint Developer -Senior Associate

PwC

Hyderabad, Telangana, India (On-Site)
4 Months ago
PwC - Financial Due Diligence Senior Manager - Insurance, Deals

PwC

Riyadh, Riyadh Province, Saudi Arabia (On-Site)
4 Months ago
Intel Corporation - Business HR Partner (NM DMO)

Intel Corporation

Albuquerque, New Mexico, United States (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Worldwide

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Editorial Jobs

Kokotree - Script Writers

Kokotree

Wilmington, North Carolina, United States (On-Site)
3 Months ago
Remote - Specialist, Benefits Solutions

Remote

United States (Remote)
4 Months ago
Warner Bros Discovery - Editor (Book Development)

Warner Bros Discovery

New York, New York, United States (On-Site)
3 Months ago
WebMD - Senior Editor

WebMD

Newark, New Jersey, United States (On-Site)
3 Months ago
Luxoft - IT Technical Writer

Luxoft

Bucharest, Bucharest, Romania (On-Site)
3 Months ago
PivotRoots - Assistant Manager - Earned Media

PivotRoots

Maharashtra, India (On-Site)
4 Months ago
Ubisoft - Executive Communications Manager (W/M/NB)

Ubisoft

Paris, Île-de-France, France (Hybrid)
5 Months ago
STAGE - Content Accountant

STAGE

Noida, Uttar Pradesh, India (On-Site)
5 Months ago
Remote - International Tax Analyst - HRIS & Digital Tax

Remote

(Remote)
4 Months ago
Virtuos - Content Writer

Virtuos

Singapore (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug