LLM Global Data - LLM Performance Operation - Safety Specialist

3 Months ago • Upto 3 Years • Monetization

Job Summary

Job Description

As a Safety Specialist in ByteDance's LLM Global Data team, you'll evaluate the safety of Large Language Model (LLM) responses across various domains. Responsibilities include delivering high-quality safety evaluations, contributing to the development of safety question banks and best practices, participating in cross-functional meetings, developing safety-testing prompts, and occasionally analyzing results and drafting reports. You'll work in a fast-paced environment, requiring excellent English writing skills, critical thinking, and the ability to meet tight deadlines. A strong understanding of LLMs and human behavior is essential.
Must have:
  • Evaluate LLM response safety
  • High-quality work under pressure
  • Contribute to safety question banks
  • Excellent English writing skills
  • Bachelor's degree in relevant field
Good to have:
  • 0-3 years experience in content safety
  • RLHF annotator experience
  • Deep interest in LLMs and user experience

Job Details

Responsibilities
About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact-for ourselves, our company, and the users we serve. Join us. As a core member of our LLM Global Data Team, you'll be at the heart of our operations. Gain first-hand experience in understanding how to measure and analyze performance of LLM on various dimensions. Responsibilities: - Evaluate the safety of Large Language Model (LLM)-generated responses to a large number of prompts across safety domains. - Deliver high-quality safety evaluation tasks to tight deadlines and with limited supervision. - Contribute to the development of safety evaluation question banks and best practices. - Participate in cross-functional meetings to critically discuss safety cases and response strategies. - Develop prompts that effectively test the model's safety capabilities. - Occasionally analyze evaluation results and draft reports on findings.
Qualifications
Minimum Qualifications: - Bachelor's or higher degree, preferably in political science, public policy, journalism, international relations, law, regional studies, or a related field. - Excellent proficiency in English with outstanding writing skills and critical thinking. - Comfortable working in a project-based fast-paced environment, where quality standards iterate quickly with research and experiment progress. Preferred Qualifications: - 0-3 years of work experience in content safety, writing, and text editing is highly valued. Experience as an RLHF annotator for leading AI/LLM companies is strongly preferred. - Candidates should be self-driven, intelligent, diligent, and collaborative. - A deep interest in LLMs, human behavior, and user experience is essential. The ideal candidate is an enthusiastic learner who finds engagement with diverse case studies stimulating. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

Epic Games - QA Engineer

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
Team Liquid - Product Designer, BR

Team Liquid

São Paulo, State Of São Paulo, Brazil (On-Site)
4 Weeks ago
Dream Sports - Software Development Engineer 1 - Frontend

Dream Sports

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Tripledot Studios - Playable Ad Developer

Tripledot Studios

Minsk, Minsk Region, Belarus (Hybrid)
1 Month ago
Whatnot - Customer Experience Agent (German or Dutch Speaking)

Whatnot

Dublin, County Dublin, Ireland (Remote)
5 Months ago
Anzuio - Sales Account Manager

Anzuio

London, England, United Kingdom (Hybrid)
4 Weeks ago
ByteDance - Datacenter Operations Engineer (DCO) Intern - 2025 Start

ByteDance

Kulai, Johor, Malaysia (On-Site)
4 Months ago
ByteDance - ByteDance Back-end Engineer Graduate Program (Dubai 2025)

ByteDance

Dubai, Dubai, United Arab Emirates (On-Site)
1 Week ago
ByteDance - Marketing Intern, BytePlus - 2025 Start

ByteDance

Singapore (On-Site)
1 Week ago
Focus Entertainment - Live Revenue Specialist

Focus Entertainment

Île-de-France, France (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Eleven Labs - Landing Page Designer

Eleven Labs

United States (Remote)
4 Weeks ago
Super - Product Design Manager, Fintech & Earnings

Super

(Remote)
2 Months ago
Netflix - Software Engineer (L4/L5) - Enablement Apps

Netflix

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
ByteDance - Backend Software Engineer

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Netflix - Data Scientist (L5) - Cloud Games Quality of Experience

Netflix

United States (Remote)
1 Week ago
Wargaming - UI Artist

Wargaming

Belgrade, Serbia (Hybrid)
1 Month ago
Aristocrat Gaming - CRM Implementation Specialist

Aristocrat Gaming

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
3 Days ago
Niantic - Senior UX Designer

Niantic

Bellevue, Washington, United States (Hybrid)
1 Month ago
Epic Games - Senior Tools Programmer, Applied Usability

Epic Games

Montreal, Quebec, Canada (On-Site)
2 Months ago
Scorewarrior - VIP Support Agent - Polish Speaking

Scorewarrior

Limassol, Limassol, Cyprus (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

Eleven Labs - Customer Success Manager - APAC

Eleven Labs

Singapore (Remote)
4 Weeks ago
ByteDance - Sales Operations Specialist

ByteDance

Singapore (On-Site)
4 Weeks ago
ByteDance - Motion Graphic Designer Intern

ByteDance

Singapore (On-Site)
1 Week ago
ByteDance - Backend Software Engineer - Foundational Technology

ByteDance

Singapore (On-Site)
1 Week ago
ByteDance - TikTok Tax Business Partner - Singapore

ByteDance

Singapore (On-Site)
1 Month ago
ByteDance - Software Engineer (User Product) Intern - Global Payment

ByteDance

Singapore (On-Site)
1 Month ago
NinjaVan - Station Assistant (Night Shift)

NinjaVan

Singapore, Singapore (On-Site)
6 Months ago
Rolls Royce - Project Manager

Rolls Royce

Singapore (On-Site)
6 Months ago
Ubisoft - Data Director

Ubisoft

Singapore, Singapore (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Monetization Jobs

ByteDance - Solutions Architect

ByteDance

Taguig, Metro Manila, Philippines (On-Site)
1 Week ago
ByteDance - Tech Lead Machine Learning Engineer

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
ByteDance - Product Operations - Search Evaluation and Investigation - Manila

ByteDance

Pasig, Metro Manila, Philippines (On-Site)
5 Months ago
Amanotes - Product Monetization Lead

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
3 Months ago
ByteDance - Client Solutions Manager

ByteDance

Los Angeles, California, United States (On-Site)
1 Week ago
ByteDance - Senior Channel Operation Expert - Global Payment

ByteDance

Singapore (On-Site)
3 Months ago
InMobiInMobi - Senior Product Manager - InMobi DSP

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
2 Months ago
ByteDance - Financial Risk Strategy Expert - Global Payment

ByteDance

Singapore (On-Site)
5 Months ago
Anzuio - Sales Account Manager

Anzuio

London, England, United Kingdom (Hybrid)
4 Weeks ago
ZiMAD - Product Manager (Web Games)

ZiMAD

(Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

Dublin, County Dublin, Ireland (On-Site)

London, England, United Kingdom (On-Site)

Bangkok, Bangkok, Thailand (On-Site)

San Jose, California, United States (On-Site)

State Of São Paulo, Brazil (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug