Product Manager, LLM Data Acquisition and Production

6 Months ago • 3 Years + • Monetization • Data Analyst

Job Summary

Job Description

ByteDance is looking for a Product Manager, LLM Data Acquisition and Production to collaborate with technical teams to define the data requirements for aligning Large Language Models (LLMs) across global markets. This role involves developing methodologies for data acquisition and production, monitoring costs, and ensuring high data quality. You will also evaluate the impact of data production tools, work on enhancing their quality and effectiveness, and proactively address biases and vulnerabilities in the data production process.
Must have:
  • Solid understanding of alignment and related approaches.
  • Minimum of three years experience as a product manager.
  • Proficiency in English (spoken and written).
Good to have:
  • Candidates with global education or work experience are preferred.
  • A strong interest in both LLMs and human behavior/experience/wellbeing.
  • Collaborative team player who knows how to assertively advocate for their ideas without being overbearing.

Job Details

Responsibilities
About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the team Responsible for requirement analysis and strategy optimization of Big Language Model, responsible for data quality and model effect, and working with multiple teams such as evaluation and R & D to improve model effect Responsibilities: 1. Collaborate with technical teams to precisely define the data requirements necessary for aligning Large Language Models (LLMs) across global markets. 2. Develop methodologies for data acquisition and production, while also monitoring costs and assessing the effectiveness and efficiency of these processes. Ensure data quality is maintained at high standards and continually enhance processes based on both quantitative and qualitative feedback. 3. Evaluate the impact of data production tools on the effectiveness and quality of data production. Work closely with technical teams to enhance both the quality and effectiveness of these tools. 4. Proactively identify and mitigate potential biases and vulnerabilities in the data production process. This includes, but is not limited to, addressing human and system biases through the implementation of technical, product, and operational solutions.
Qualifications
Minimum Qualifications: 1. Solid understanding of alignment and related approaches, such as Supervised Fine-Tuning (SFT), Reinforcement Learning from Human Feedback (RLHF), and others. Or solid experience in moderation, labeling, search quality, or data synthesis. 2. Minimum of three years experience as a product manager or product strategist, including process design experience. 3. Proficiency in English (spoken and written). Preferred Qualifications: 1. Candidates with global education or work experience are preferred. 2. A strong interest in both LLMs and human behavior/experience/wellbeing. Must be an enthusiastic learner. This position is not suitable for individuals who find reading papers and books to be tedious. 3. Collaborative team player who knows how to assertively advocate for their ideas without being overbearing. Skilled in maintaining attention to detail while staying focused on prioritized goals and the bigger picture. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

Krafton  - Applied Research Scientist/Engineer - LM/Agent

Krafton

Seoul, South Korea (On-Site)
1 Month ago
Google - Software Engineer III, AI/ML, Platforms and Devices

Google

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Google - Software Engineer III, Research

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Week ago
Tencent - Game AI Product Management Intern

Tencent

Auckland, Auckland, New Zealand (On-Site)
1 Month ago
Inworld AI - Staff / Principal AI Researcher - USA

Inworld AI

Mountain View, California, United States (Remote)
4 Months ago
ByteDance - Research Scientist, Vision Foundation Model

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
ByteDance - LLM Global Data - LLM Performance Operation Analyst

ByteDance

Singapore (On-Site)
1 Month ago
ByteDance - Shipping Insurance Business Solution and Operations - Global Payment

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Product Operations - Search Ads Team

ByteDance

Tokyo, Japan (On-Site)
2 Weeks ago
ByteDance - Machine Learning Engineer, SMB

ByteDance

San Jose, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Scale AI - Engineering Manager, Agent Data

Scale AI

San Francisco, California, United States (Hybrid)
1 Day ago
ByteDance - Research Scientist, Reinforcement Learning

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Riot Games - Staff Software Engineer, Machine Learning - AI Foundations

Riot Games

United States (On-Site)
2 Weeks ago
CharacterAI - Research Engineer, ML Systems

CharacterAI

New York, New York, United States (On-Site)
1 Month ago
Scale AI - Senior Software Engineer, GenAI Tasking Experience

Scale AI

San Francisco, California, United States (Hybrid)
1 Day ago
Scale AI - Software Engineer, GenAI Model Quality

Scale AI

San Francisco, California, United States (Hybrid)
1 Day ago
Microsoft - Senior Machine Learning Engineer

Microsoft

Vancouver, British Columbia, Canada (On-Site)
2 Weeks ago
Zazz - Artificial Intelligence Engineer

Zazz

(Remote)
2 Months ago
Balbix - Staff AI Engineer

Balbix

Bengaluru, Karnataka, India (On-Site)
6 Months ago
ByteDance - Senior Site Reliability Engineer, ML System

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

Powerintegration - Senior Accountant - Cost / Revenue

Powerintegration

Singapore, Singapore (On-Site)
2 Months ago
HoYoverse - Intellectual Property Counsel

HoYoverse

Singapore (On-Site)
5 Months ago
Veeam Software - Solution Engineer

Veeam Software

Singapore, Singapore (On-Site)
1 Day ago
ByteDance - Legal Counsel, Content Moderation

ByteDance

Singapore (On-Site)
2 Weeks ago
ByteDance - iOS Software Engineer - Global Payment - Singapore

ByteDance

Singapore (On-Site)
6 Months ago
ByteDance - Product Design Intern - Global Payment

ByteDance

Singapore (On-Site)
1 Month ago
Riot Games - Video Editor (Contract)

Riot Games

Singapore (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Monetization Jobs

Voodoo - Playables Associate Intern

Voodoo

Paris, Île-de-France, France (On-Site)
1 Month ago
ByteDance - Creator Partnership (Lemon8) Intern

ByteDance

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
2 Weeks ago
ByteDance - Software Development Engineer - Database NoSQL Graph - Seattle

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
ByteDance - Solutions Architect

ByteDance

Taguig, Metro Manila, Philippines (On-Site)
2 Months ago
Amanotes - Ads Monetization Specialist

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
1 Month ago
ByteDance - SoC System Software Architect

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Riot Games - Game Producer, Monetization (Cosmetics)

Riot Games

Shanghai, Shanghai, China (On-Site)
2 Months ago
Ourpalm - Commercialization Operation

Ourpalm

Guangzhou, Guangdong Province, China (On-Site)
2 Weeks ago
Netflix - Technical Program Manager (L6), Ads Measurement

Netflix

Los Gatos, California, United States (On-Site)
1 Week ago
InMobiInMobi - Lead - Growth - 1Weather

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

San Diego, California, United States (On-Site)

San Jose, California, United States (On-Site)

Dubai, Dubai, United Arab Emirates (On-Site)

New York, New York, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug