Senior Data Scientist, Generative AI

4 Months ago • 5 Years + • Data Analyst

Job Summary

Job Description

Scale is seeking a Senior Data Scientist specializing in Generative AI. You'll build evaluation frameworks for LLMs, develop statistical models for economic problems, and collaborate with stakeholders to drive product development.
Must have:
  • Python proficiency
  • Marketplace experimentation
  • SQL expertise
  • Metrics design
Good to have:
  • Data inconsistency diagnosis
  • LLM evaluation
  • Statistical modeling
  • Product roadmap

Job Details

Scale is looking for a data scientist to join our team to help advance the development of AI. As a member of the data science team, you will lead the charge of building our data science infrastructure for Gen AI products and driving insights that lead to step-function improvements in how we operate. The ideal candidate is detail-oriented, rigorous about validating results, talented at distilling down complexity, and loves tackling and solving hard problems.

You will:

  • Build evaluation frameworks to measure LLMs efficacy, ground truth dataset quality, and guide product development roadmap
  • Adapt statistical models to solve specific hard problems in fields of economics, price theory, and marketplace experimentation
  • Be a proactive partner to your business stakeholders and provide insights and conclusions rather than just data outputs/models
  • Tackle business-critical questions by developing and testing hypotheses, and aiding evidence-based decision making
  • Partner with Product Managers, Data Engineers, Data Scientists, and Business Stakeholders to drive business decisions and product roadmaps

Ideally, You'd Have:

  • 5+ years of industry experience in a highly analytical role
  • Degree in a quantitative field (e.g., Maths, Engineering)
  • Strong proficiency in Python
  • Experience with marketplace experimentation
  • Expert-level proficiency in writing complex SQL queries across large datasets
  • Expertise in designing metrics and diagnosing data inconsistencies

Please note that in order to maintain integrity to our Scale titling philosophy, we do not internally use titles such as “senior,” but have levels to reflect seniority. Our Talent Acquisition team works closely with our employees to provide them the opportunity to grow their careers and demonstrate the scope of work in other ways aside from job titles. If you have further questions, please direct them to your recruiter and/or hiring manager, who can provide more insight.

Similar Jobs

JetSynthesys - Python Developer

JetSynthesys

Pune, Maharashtra, India (On-Site)
5 Months ago
Epic Games - Data Specialist

Epic Games

London, England, United Kingdom (On-Site)
1 Month ago
ByteDance - Network Engineer Graduate (Tech Infra - IaaS) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Meta - Research Scientist Intern, Language and Multimodal Research for MetaAI (PhD)

Meta

Bellevue, Washington, United States (On-Site)
3 Months ago
Luxoft - QA Test Engineer with BDD Experience

Luxoft

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Balbix - Senior/Staff Data Engineer

Balbix

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Luxoft - Data Engineer

Luxoft

Pune, Maharashtra, India (On-Site)
2 Months ago
Nielsen Holdings - Ad Intel Analyst ( Research Analyst) - Freshers/2years experience

Nielsen Holdings

Mumbai, Maharashtra, India (Hybrid)
2 Months ago
PhonePe - Business Intelligence Lead

PhonePe

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Keywords Studios (Player Support) - Associate Data Scientist

Keywords Studios (Player Support)

Nottingham, England, United Kingdom (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Next Level Business Services - Sr. Tableau Admin

Next Level Business Services

Cupertino, California, United States (On-Site)
4 Months ago
Google - Backend Software Engineer, Insights, Benchmarks, and Narratives

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Warner Bros Discovery - Staff Software Engineer, Data Platforms

Warner Bros Discovery

Atlanta, Georgia, United States (On-Site)
3 Months ago
LesJeudis - Technical Animator (W/M/NB) [Assassin's Creed Franchise]

LesJeudis

Annecy, Auvergne-Rhône-Alpes, France (On-Site)
6 Months ago
Kenvue - Senior Software Engineer

Kenvue

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Meta - Software Engineer, Infrastructure

Meta

Washington, District Of Columbia, United States (On-Site)
3 Months ago
Larian Studios - SENIOR 3D RIGGER

Larian Studios

Quebec, Canada (On-Site)
2 Months ago
Enphase Energy - Staff Engineer, Oracle APEX Development

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Hedra - Machine Learning Engineer

Hedra

San Francisco, California, United States (On-Site)
5 Months ago
Coursera - Learning Analytics Lead

Coursera

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

PlayStation Global - Manager, Software Engineering

PlayStation Global

Madison, Wisconsin, United States (On-Site)
3 Months ago
Fanatics - Operations Team Lead

Fanatics

Louisville, Kentucky, United States (On-Site)
4 Months ago
Paypal - Sr. UX Designer

Paypal

Austin, Texas, United States (Hybrid)
4 Months ago
Google - Data Center Electrical Protection and Controls Engineer

Google

Reston, Virginia, United States (On-Site)
1 Month ago
Info Stretch - Business Analyst 5

Info Stretch

Lansing, Michigan, United States (On-Site)
1 Month ago
Sonar Source - Solutions Engineer - Strategic Accounts

Sonar Source

Austin, Texas, United States (Hybrid)
4 Months ago
AGS - American Gaming Systems - Software Engineer II- Interactive

AGS - American Gaming Systems

Arizona, United States (On-Site)
1 Month ago
Flow - Facilities Coordinator

Flow

Miami, Florida, United States (On-Site)
4 Months ago
Saviynt - Sr. Engineer, Solutions Engineering

Saviynt

United States (Remote)
4 Months ago
Nintendo - Manufacturing Engineer (Bilingual Japanese)

Nintendo

Redmond, Washington, United States (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Animoca Brands - Digital Assets Research Analyst

Animoca Brands

Hong Kong (On-Site)
1 Month ago
Paypal - Senior Data Scientist

Paypal

San Jose, California, United States (Hybrid)
4 Months ago
IGT - Power Platform Administrator

IGT

Providence, Rhode Island, United States (On-Site)
3 Months ago
Luxoft - Data Engineer

Luxoft

Mexico City, Mexico City, Mexico (Remote)
3 Months ago
ByteDance - LLM Coding Trainer - Specialist

ByteDance

Singapore (On-Site)
3 Months ago
Unity - Software Engineer, Data Engineering

Unity

Copenhagen, Denmark (On-Site)
4 Months ago
Balbix - Senior/Staff Data Engineer

Balbix

Bengaluru, Karnataka, India (On-Site)
4 Months ago
GoTo Group - Senior Data Scientist  (Singapore)

GoTo Group

Singapore (On-Site)
4 Months ago
Equivalent Jobs - HEAD OF ANALYTICS

Equivalent Jobs

(Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

Mexico City, Mexico City, Mexico (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

St. Louis, Missouri, United States (Remote)

San Francisco, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug