Model Evaluation Product Manager, Generative AI

Scale is at the forefront of enabling Machine Learning across multiple industries by improving the world’s leading Generative AI and Large Language Models. 

We are building the Generative AI Data Engine to push the boundaries of model development. We do this via human-powered datasets, world-class Reinforcement Learning with Human Feedback (RLHF), model evaluation and more. We build products for AI research teams training models and the world’s largest marketplace of human intelligence.

We’re looking for an Model Evaluation Product Manager to build intuitive ML-assisted tooling for generating human data, data quality measurement platforms, and delightful AI researcher-facing product.

You will:

• Build the products that will allow the world’s leading AI labs to build their training datasets
• Work with top researchers across the industry to help them improve the performance of their models
• Work with exec leaders to determine and execute the product strategy of the business

• Own end-to-end product development by understanding customer painpoints, defining product requirements, managing development and testing, and launches
• Lead cross-functional teams including engineering, product design, operations, marketing, go-to-market and finance

Must be able to commute to the San Francisco Office 2x weekly. 

Ideally, you’d have:

• Technical degree in computer science, engineering, or related field
• 4+ years of experience in building ML-powered products
• Experience operating in a fast-paced environment with ambiguity
• Working knowledge of SQL and some coding skills (Python)
• Excellent communication and presentation skills