Senior Data Scientist, Generative AI

1 Month ago • 5 Years + • Data Analyst

About the job

Job Description

Scale is seeking a Senior Data Scientist specializing in Generative AI. You'll build evaluation frameworks for LLMs, develop statistical models for economic problems, and collaborate with stakeholders to drive product development.
Must have:
  • Python proficiency
  • Marketplace experimentation
  • SQL expertise
  • Metrics design
Good to have:
  • Data inconsistency diagnosis
  • LLM evaluation
  • Statistical modeling
  • Product roadmap
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

Scale is looking for a data scientist to join our team to help advance the development of AI. As a member of the data science team, you will lead the charge of building our data science infrastructure for Gen AI products and driving insights that lead to step-function improvements in how we operate. The ideal candidate is detail-oriented, rigorous about validating results, talented at distilling down complexity, and loves tackling and solving hard problems.

You will:

  • Build evaluation frameworks to measure LLMs efficacy, ground truth dataset quality, and guide product development roadmap
  • Adapt statistical models to solve specific hard problems in fields of economics, price theory, and marketplace experimentation
  • Be a proactive partner to your business stakeholders and provide insights and conclusions rather than just data outputs/models
  • Tackle business-critical questions by developing and testing hypotheses, and aiding evidence-based decision making
  • Partner with Product Managers, Data Engineers, Data Scientists, and Business Stakeholders to drive business decisions and product roadmaps

Ideally, You'd Have:

  • 5+ years of industry experience in a highly analytical role
  • Degree in a quantitative field (e.g., Maths, Engineering)
  • Strong proficiency in Python
  • Experience with marketplace experimentation
  • Expert-level proficiency in writing complex SQL queries across large datasets
  • Expertise in designing metrics and diagnosing data inconsistencies

Please note that in order to maintain integrity to our Scale titling philosophy, we do not internally use titles such as “senior,” but have levels to reflect seniority. Our Talent Acquisition team works closely with our employees to provide them the opportunity to grow their careers and demonstrate the scope of work in other ways aside from job titles. If you have further questions, please direct them to your recruiter and/or hiring manager, who can provide more insight.

View Full Job Description

About The Company

California, United States (Hybrid)

California, United States (On-Site)

California, United States (On-Site)

District Of Columbia, United States (On-Site)

California, United States (On-Site)

Mexico City, Mexico (On-Site)

California, United States (On-Site)

District Of Columbia, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

View All Jobs

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug