Sr. Manager/Manager, Technical Program Management - AI Data Operations

The mission of the Foundation AI group is to enable Roblox Creators to accelerate their workflows and to put AI in the hands of millions of users through their creations. We envision a future in which experiences on Roblox leverage generative text and speech capabilities to enable new forms of interactions in their experiences and generative 3D capabilities to allow new ways to create on the platform. 

Roblox is uniquely positioned with a vast amount of data on the platform that ranges from 3D and 4D creations, to player interactions within those creations. Roblox operates over 300 AI models all powered by this data, as we advance our AI efforts, we will be building scalable tooling, infrastructure and workflows to deepen our understanding of what is happening on that platform and then use that data to power creation, safety and discovery models.

The AI Data Operations team, provides data and insights that power machine learning and AI at the core of all Roblox products. As the leader for the team, you will define and drive the vision and strategy for data labeling and annotation programs end-to-end, work cross functionally to improve existing workflows, proactively surfacing insights and providing recommendations for product improvement, and actively engage with colleagues and partners to enhance the operational process across the organization. This Will report to the head of product for the AI groups at Roblox.

You will:

• Manage a team of data labelling project managers across all Roblox verticals.
• Manage multiple data labelling projects end-to-end including collaborating with research, product, engineering and data science teams to build training and test datasets.
• Coordinate with vendors, contractors and team members to ensure projects are accurate and complete
• Can take an abstract idea for a dataset and create a labeling workflow
• Help establish goals and work with multiple stakeholders on strategies for executing, measuring progress and reporting results. 
• Responsible for writing/reviewing a set of guidelines with examples. Can identify gray areas on the dataset and provide examples on how to address them
• Identify opportunities to improve operations and tooling and implement scalable solutions 
• Assess the quality of sourced and annotated data; Implement QA process. Review results, analyze quality, and runs audits
• Forecast timelines, track project process, communicate with partners, and delivers data along with quality report

You Have:

• 8+ years of experience in project/program management focused on building data pipelines and working within data labeling for machine learning
• Deep understanding of how ground-truth data can enhance machine learning models and In-depth understanding of data labeling workflow management
• Experience building project structure and timeline forecasting
• Experience managing vendor relationships or contractor workforces with great leadership
• Creativity: You take a creative and strategic approach to solving hard problems
• Able to get hands on when needed by diving into the data. 
• Bachelor's degree in technical or business discipline or equivalent experience
• Native/Fluent in Japanese, Korean, French, Portuguese, and/or Spanish (Bonus)

#LI-FO1
#LI-Onsite