Senior Data Scientist, Generative AI

3 Months ago • 5 Years + • Data Analyst • Undisclosed

About the job

Job Description

Scale is seeking a Senior Data Scientist specializing in Generative AI. You'll build evaluation frameworks for LLMs, develop statistical models for economic problems, and collaborate with stakeholders to drive product development.
Must have:
  • Python proficiency
  • Marketplace experimentation
  • SQL expertise
  • Metrics design
Good to have:
  • Data inconsistency diagnosis
  • LLM evaluation
  • Statistical modeling
  • Product roadmap

Scale is looking for a data scientist to join our team to help advance the development of AI. As a member of the data science team, you will lead the charge of building our data science infrastructure for Gen AI products and driving insights that lead to step-function improvements in how we operate. The ideal candidate is detail-oriented, rigorous about validating results, talented at distilling down complexity, and loves tackling and solving hard problems.

You will:

  • Build evaluation frameworks to measure LLMs efficacy, ground truth dataset quality, and guide product development roadmap
  • Adapt statistical models to solve specific hard problems in fields of economics, price theory, and marketplace experimentation
  • Be a proactive partner to your business stakeholders and provide insights and conclusions rather than just data outputs/models
  • Tackle business-critical questions by developing and testing hypotheses, and aiding evidence-based decision making
  • Partner with Product Managers, Data Engineers, Data Scientists, and Business Stakeholders to drive business decisions and product roadmaps

Ideally, You'd Have:

  • 5+ years of industry experience in a highly analytical role
  • Degree in a quantitative field (e.g., Maths, Engineering)
  • Strong proficiency in Python
  • Experience with marketplace experimentation
  • Expert-level proficiency in writing complex SQL queries across large datasets
  • Expertise in designing metrics and diagnosing data inconsistencies

Please note that in order to maintain integrity to our Scale titling philosophy, we do not internally use titles such as “senior,” but have levels to reflect seniority. Our Talent Acquisition team works closely with our employees to provide them the opportunity to grow their careers and demonstrate the scope of work in other ways aside from job titles. If you have further questions, please direct them to your recruiter and/or hiring manager, who can provide more insight.

View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

Mexico City, Mexico City, Mexico (On-Site)

San Francisco, California, United States (On-Site)

Washington, District Of Columbia, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

St. Louis, Missouri, United States (Remote)

View All Jobs

Get notified when new jobs are added by Scale AI

Similar Jobs

JetSynthesys - Python Developer

JetSynthesys, India (On-Site)

Epic Games - Data Specialist

Epic Games, United Kingdom (On-Site)

Balbix - Senior/Staff Data Engineer

Balbix, India (On-Site)

Luxoft - Data Engineer

Luxoft, India (On-Site)

PhonePe - Business Intelligence Lead

PhonePe, India (On-Site)

Keywords Studios (Player Support) - Associate Data Scientist

Keywords Studios (Player Support), United Kingdom (Hybrid)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Next Level Business Services - Sr. Tableau Admin

Next Level Business Services, United States (On-Site)

Warner Bros Discovery - Staff Software Engineer, Data Platforms

Warner Bros Discovery, United States (On-Site)

Kenvue - Senior Software Engineer

Kenvue, India (On-Site)

Meta - Software Engineer, Infrastructure

Meta, United States (On-Site)

Larian Studios - SENIOR 3D RIGGER

Larian Studios, Canada (On-Site)

Enphase Energy - Staff Engineer, Oracle APEX Development

Enphase Energy, India (On-Site)

Hedra - Machine Learning Engineer

Hedra, United States (On-Site)

Coursera - Learning Analytics Lead

Coursera, United States (Remote)

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

PlayStation Global - Manager, Software Engineering

PlayStation Global, United States (On-Site)

Fanatics - Operations Team Lead

Fanatics, United States (On-Site)

Paypal - Sr. UX Designer

Paypal, United States (Hybrid)

Info Stretch - Business Analyst 5

Info Stretch, United States (On-Site)

Sonar Source - Solutions Engineer - Strategic Accounts

Sonar Source, United States (Hybrid)

AGS - American Gaming Systems - Software Engineer II- Interactive

AGS - American Gaming Systems, United States (On-Site)

Flow - Facilities Coordinator

Flow, United States (On-Site)

Saviynt - Sr. Engineer, Solutions Engineering

Saviynt, United States (Remote)

Nintendo - Manufacturing Engineer (Bilingual Japanese)

Nintendo, United States (Hybrid)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Animoca Brands - Digital Assets Research Analyst

Animoca Brands, Hong Kong (On-Site)

Paypal - Senior Data Scientist

Paypal, United States (Hybrid)

IGT - Power Platform Administrator

IGT, United States (On-Site)

Luxoft - Data Engineer

Luxoft, Mexico (Remote)

ByteDance - LLM Coding Trainer - Specialist

ByteDance, Singapore (On-Site)

Unity - Software Engineer, Data Engineering

Unity, Denmark (On-Site)

Balbix - Senior/Staff Data Engineer

Balbix, India (On-Site)

GoTo Group - Senior Data Scientist  (Singapore)

GoTo Group, Singapore (On-Site)

Equivalent Jobs - HEAD OF ANALYTICS

Equivalent Jobs, (Remote)

Get notifed when new similar jobs are uploaded