Senior Data Scientist, Generative AI

3 Weeks ago • 5 Years +

About the job

SummaryBy Outscal

About the job:
Scale is seeking a Senior Data Scientist specializing in Generative AI. You'll build evaluation frameworks for LLMs, develop statistical models for economic problems, and collaborate with stakeholders to drive product development.
Must have:
  • Python proficiency
  • Marketplace experimentation
  • SQL expertise
  • Metrics design
Good to have:
  • Data inconsistency diagnosis
  • LLM evaluation
  • Statistical modeling
  • Product roadmap

Scale is looking for a data scientist to join our team to help advance the development of AI. As a member of the data science team, you will lead the charge of building our data science infrastructure for Gen AI products and driving insights that lead to step-function improvements in how we operate. The ideal candidate is detail-oriented, rigorous about validating results, talented at distilling down complexity, and loves tackling and solving hard problems.

You will:

  • Build evaluation frameworks to measure LLMs efficacy, ground truth dataset quality, and guide product development roadmap
  • Adapt statistical models to solve specific hard problems in fields of economics, price theory, and marketplace experimentation
  • Be a proactive partner to your business stakeholders and provide insights and conclusions rather than just data outputs/models
  • Tackle business-critical questions by developing and testing hypotheses, and aiding evidence-based decision making
  • Partner with Product Managers, Data Engineers, Data Scientists, and Business Stakeholders to drive business decisions and product roadmaps

Ideally, You'd Have:

  • 5+ years of industry experience in a highly analytical role
  • Degree in a quantitative field (e.g., Maths, Engineering)
  • Strong proficiency in Python
  • Experience with marketplace experimentation
  • Expert-level proficiency in writing complex SQL queries across large datasets
  • Expertise in designing metrics and diagnosing data inconsistencies

Please note that in order to maintain integrity to our Scale titling philosophy, we do not internally use titles such as “senior,” but have levels to reflect seniority. Our Talent Acquisition team works closely with our employees to provide them the opportunity to grow their careers and demonstrate the scope of work in other ways aside from job titles. If you have further questions, please direct them to your recruiter and/or hiring manager, who can provide more insight.

View Full Job Description

About The Company

California, United States (Hybrid)

California, United States (Hybrid)

California, United States (Hybrid)

California, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

District Of Columbia, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

View All Jobs

Similar Skill Jobs

PlayStation Global - Senior Machine Learning Engineer

England, United Kingdom (Hybrid)

PlayStation Global - Machine Learning Engineer

England, United Kingdom (Hybrid)

Patreon - Staff Data Engineer, Analytics

California, United States (Hybrid)

Patreon - Staff Data Engineer, Analytics

New York, United States (Hybrid)

Xsolla - Junior Data Scientist

Lisbon, Portugal (On-Site)

Xsolla - Junior Data Scientist

Belarus (On-Site)

Xsolla - Junior Data Scientist

Georgia (On-Site)

Xsolla - Junior Data Scientist

Armenia (On-Site)

Xsolla - Junior Data Scientist

Berlin, Germany (On-Site)

Jobs in San Francisco, California, United States

CatFace - Production Assistant, Roblox

Texas, United States (On-Site)

CatFace - Assistant Director of Production

Texas, United States (On-Site)

CatFace - Senior Video Script Writer

Texas, United States (On-Site)

PlayStation Global - Director, Information Technology

Washington, United States (On-Site)

The Pokemon Company International - Accounting Associate

Washington, United States (Hybrid)

Blizzard Entertainment - Senior Manager, Mobile Growth Strategy | Irvine, CA

California, United States (Hybrid)

Aristocrat Gaming - Field Service Technician

California, United States (On-Site)

Artificial Intelligence (AI) Jobs

PlayStation Global - Senior Machine Learning Engineer

England, United Kingdom (Hybrid)

PlayStation Global - Machine Learning Engineer

England, United Kingdom (Hybrid)

Xsolla - Junior Data Scientist

Lisbon, Portugal (On-Site)

Xsolla - Junior Data Scientist

Belarus (On-Site)

Xsolla - Junior Data Scientist

Georgia (On-Site)

Xsolla - Junior Data Scientist

Armenia (On-Site)

Xsolla - Junior Data Scientist

Berlin, Germany (On-Site)

Genies - Machine Learning Engineer: 3D Generative AI

California, United States (Remote)

Salesforce - Lead ML Engineer

Karnataka, India (On-Site)

ByteDance - Senior Machine Learning Engineer - AML Algorithm

Washington, United States (On-Site)

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug