LLM Global Data - LLM Performance Operation - Safety Specialist

3 Months ago • Upto 3 Years • Monetization

Job Summary

Job Description

As a Safety Specialist in ByteDance's LLM Global Data team, you'll evaluate the safety of Large Language Model (LLM) responses across various domains. Responsibilities include delivering high-quality safety evaluations, contributing to the development of safety question banks and best practices, participating in cross-functional meetings, developing safety-testing prompts, and occasionally analyzing results and drafting reports. You'll work in a fast-paced environment, requiring excellent English writing skills, critical thinking, and the ability to meet tight deadlines. A strong understanding of LLMs and human behavior is essential.
Must have:
  • Evaluate LLM response safety
  • High-quality work under pressure
  • Contribute to safety question banks
  • Excellent English writing skills
  • Bachelor's degree in relevant field
Good to have:
  • 0-3 years experience in content safety
  • RLHF annotator experience
  • Deep interest in LLMs and user experience

Job Details

Responsibilities
About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact-for ourselves, our company, and the users we serve. Join us. As a core member of our LLM Global Data Team, you'll be at the heart of our operations. Gain first-hand experience in understanding how to measure and analyze performance of LLM on various dimensions. Responsibilities: - Evaluate the safety of Large Language Model (LLM)-generated responses to a large number of prompts across safety domains. - Deliver high-quality safety evaluation tasks to tight deadlines and with limited supervision. - Contribute to the development of safety evaluation question banks and best practices. - Participate in cross-functional meetings to critically discuss safety cases and response strategies. - Develop prompts that effectively test the model's safety capabilities. - Occasionally analyze evaluation results and draft reports on findings.
Qualifications
Minimum Qualifications: - Bachelor's or higher degree, preferably in political science, public policy, journalism, international relations, law, regional studies, or a related field. - Excellent proficiency in English with outstanding writing skills and critical thinking. - Comfortable working in a project-based fast-paced environment, where quality standards iterate quickly with research and experiment progress. Preferred Qualifications: - 0-3 years of work experience in content safety, writing, and text editing is highly valued. Experience as an RLHF annotator for leading AI/LLM companies is strongly preferred. - Candidates should be self-driven, intelligent, diligent, and collaborative. - A deep interest in LLMs, human behavior, and user experience is essential. The ideal candidate is an enthusiastic learner who finds engagement with diverse case studies stimulating. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

Lionbridge Games - Technical Test Associate

Lionbridge Games

Mexico City, Mexico City, Mexico (On-Site)
2 Months ago
Google - Director, Program Management, Finance Engineering

Google

Sunnyvale, California, United States (On-Site)
1 Day ago
Cloud Chamber - Senior Narrative Designer

Cloud Chamber

Montréal, Québec, Canada (Hybrid)
1 Month ago
Google - Senior Developer Relations Engineer

Google

London, England, United Kingdom (On-Site)
1 Week ago
Skytex Unmanned Aerial Solutions - Unity (C#) Developer

Skytex Unmanned Aerial Solutions

Bengaluru, Karnataka, India (On-Site)
10 Months ago
ByteDance - FX Product Manager - Global Payment

ByteDance

Singapore (On-Site)
5 Months ago
Netflix - Product Manager, Programmatic

Netflix

New York, New York, United States (On-Site)
1 Week ago
ByteDance - Category Management, Lifestyle (Philippines E-Commerce)

ByteDance

Taguig, Metro Manila, Philippines (On-Site)
1 Day ago
ByteDance - Global Monetization Product Counsel, Ads

ByteDance

Singapore (On-Site)
1 Month ago
ByteDance - Creator Management Intern, Womenswear (Philippines)

ByteDance

Taguig, Metro Manila, Philippines (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Corsair - BI Developer

Corsair

Vietnam (On-Site)
1 Month ago
Epic Games - Partner Operations Release Manager

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
Hedra - Lead Product Engineer

Hedra

San Francisco, California, United States (On-Site)
1 Month ago
ByteDance - User Research Intern

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Epic Games - Senior QA Analyst

Epic Games

(On-Site)
2 Months ago
GT - Senior Frontend Engineer

GT

(Remote)
2 Weeks ago
Argus Labs - Product Design Lead

Argus Labs

Indonesia (Remote)
1 Week ago
WebFX - Web Designer

WebFX

Philippines (Remote)
1 Month ago
Plummy games - Full Stack Engineer

Plummy games

Tallinn, Harju County, Estonia (Remote)
3 Weeks ago
The Walt Disney Company - Specialist, Merchandise E-commerce

The Walt Disney Company

Hong Kong (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

ByteDance - Cloud Technical Support Engineer

ByteDance

Singapore (On-Site)
2 Weeks ago
ByteDance - Executive Protection Specialist

ByteDance

Singapore (On-Site)
2 Weeks ago
Virtuos - Senior Machine Learning Engineer (Game)

Virtuos

Singapore (On-Site)
1 Month ago
ByteDance - Backend Software Engineer - Foundational Technology

ByteDance

Singapore (On-Site)
1 Month ago
ByteDance - Product Manager - LLM Training

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Software Engineer (Payment Network) Intern

ByteDance

Singapore (On-Site)
2 Weeks ago
ByteDance - Research Scientist - Multimodal Foundation Model - 2025 Start

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Software Engineer (Distributed Storage), Cloud Infrastructure

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Traffic Access Architectural Engineer - Traffic Infrastructure

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Payment Product Management Intern - Global Payment

ByteDance

Singapore (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Monetization Jobs

ByteDance - Machine Learning Engineer Intern (Global E-commerce Risk Control) - 2025 Summer (MS)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Livestream Agency Manager - Philippines

ByteDance

Taguig, Metro Manila, Philippines (On-Site)
4 Months ago
ByteDance - Data center Technical Project Manager, Data Center Development

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Account Management, Electronics (Philippines E-commerce)

ByteDance

Taguig, Metro Manila, Philippines (On-Site)
1 Month ago
MURKA - Monetization Manager

MURKA

(Remote)
3 Months ago
Anzuio - Sales Account Manager

Anzuio

England, United Kingdom (Hybrid)
1 Month ago
ByteDance - Senior Software Engineer - XR Open Standard, PICO

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
ByteDance - ByteDance Back-end Engineer Graduate Program (Dubai 2025)

ByteDance

Dubai, Dubai, United Arab Emirates (On-Site)
2 Weeks ago
ByteDance - Product Manager - LLM Training

ByteDance

Singapore (On-Site)
5 Months ago
Voodoo - Monetization Manager - Blitz

Voodoo

Paris, Île-de-France, France (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

San Diego, California, United States (On-Site)

San Jose, California, United States (On-Site)

Dubai, Dubai, United Arab Emirates (On-Site)

New York, New York, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug