SEAL Research Scientist, Scalable Oversight

3 Months ago • 3 Years + • Research Development • $176,000 PA - $300,000 PA

Job Summary

Job Description

As a Research Scientist working on Scalable Oversight, you will develop and evaluate methods for evaluation and supervision of advanced AI systems. You will design experiments to exemplify failure modes of current supervision protocols for language models, simulate expertise and capability gaps between supervisor and model for scalable oversight experiments, develop new supervision protocols and gather human annotations using these protocols, and train language models using reinforcement learning, analyzing their behavior and comparing between models. You will be working on the cutting edge of AI safety and helping shape the future of the AI industry.
Must have:
  • Experience in conducting technical research collaboratively.
  • Proficiency in frameworks like Pytorch, Jax, or Tensorflow.
  • A track record of published research in machine learning, particularly in generative AI.
  • At least three years of experience addressing sophisticated ML problems.
  • Strong written and verbal communication skills.
Good to have:
  • Hands-on experience with open source LLM fine-tuning.
  • Experience in crafting evaluations or a background in data science roles related to LLM technologies.
  • Experience working with cloud technology stack (eg. AWS or GCP).

Job Details

As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding large language models (LLMs). Safety, Evaluations and Alignment Lab (SEAL) is Scale’s frontier research effort dedicated to tackling the challenging research problems in evaluation, red teaming, and alignment of advanced AI systems.

We are actively seeking talented researchers to join us in shaping the landscape for safety and transparency for the entire AI industry. We support collaborations across the industry and academia and the publication of our research findings. 

As a Research Scientist working on Scalable Oversight, you will develop and evaluate methods for evaluation and supervision of advanced AI systems. For example, you might do any or all of the following: 

  • Design experiments to exemplify failure modes of current supervision protocols for language models 
  • Design experiments to simulate expertise and capability gaps between supervisor and model for scalable oversight experiments
  • Develop new supervision protocols and gather human annotations using these protocols 
  • Train language models using reinforcement learning, analyzing their behavior and comparing between models 

Ideally you’d have:

  • Commitment to our mission of promoting safe, secure, and trustworthy AI deployments in the industry as frontier AI capabilities continue to advance.
  • Practical experience conducting technical research collaboratively, with proficiency in frameworks like Pytorch, Jax, or Tensorflow. You should also be adept at interpreting research literature and quickly turning new ideas into prototypes.
  • A track record of published research in machine learning, particularly in generative AI.
  • At least three years of experience addressing sophisticated ML problems, whether in a research setting or in product development.
  • Strong written and verbal communication skills to operate in a cross functional team.

Nice to have:

  • Hands-on experience with open source LLM fine-tuning or involvement in bespoke LLM fine-tuning projects using Pytorch/Jax.
  • Experience in crafting evaluations or a background in data science roles related to LLM technologies.
  • Experience working with cloud technology stack (eg. AWS or GCP) and developing machine learning models in a cloud environment.

Our research interviews are crafted to assess candidates' skills in practical ML prototyping and debugging, their grasp of research concepts, and their alignment with our organizational culture. We will not ask any LeetCode-style questions.

Similar Jobs

bytedance - Music Product Counsel - Global Legal

bytedance

New York, New York, United States (On-Site)
9 Months ago
Trend Micro - (Sr.) Cloud Backend Engineer

Trend Micro

Taipei City, Taiwan (On-Site)
10 Months ago
Thousand Eyes - Senior Software Engineer I, Machine Learning

Thousand Eyes

San Francisco, California, United States (On-Site)
3 Weeks ago
Nintendo - Product Tester (Retro Studios)

Nintendo

Austin, Texas, United States (On-Site)
11 Months ago
lifechruh - Senior Product Designer

lifechruh

Edmond, Oklahoma, United States (On-Site)
7 Months ago
C3 IoT - Pre-Sales AI Director – Generative AI

C3 IoT

Atlanta, Georgia, United States (On-Site)
3 Weeks ago
Valeo - Junior Engineer in the Research and Development Department (R&D) - Multidisciplinary Development Program

Valeo

Czechowice-Dziedzice, Silesian Voivodeship, Poland (On-Site)
6 Months ago
Ello - Tech Lead, GenAI & Machine Learning

Ello

San Francisco, California, United States (On-Site)
3 Months ago
Autodesk - Principal Software Developer, Data Pipelines - Generative AI

Autodesk

Toronto, Ontario, Canada (Hybrid)
1 Year ago
Apple - ML Engineering Manager, Siri

Apple

Cupertino, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PwC - PwC Private, Tax, Manager

PwC

Calgary, Alberta, Canada (On-Site)
10 Months ago
Putnam - Director, RWE & Biostatistics

Putnam

Kraków, Lesser Poland Voivodeship, Poland (Hybrid)
1 Month ago
Ghost Ship Games - Colleague for the Games Publishing and Marketing Team

Ghost Ship Games

Copenhagen, Denmark (On-Site)
3 Weeks ago
Evolution  - In Studio Game Presenter

Evolution

Atlantic City, New Jersey, United States (On-Site)
2 Months ago
z-software - Technical Artist

z-software

Dortmund, North Rhine-Westphalia, Germany (On-Site)
1 Month ago
IMC - HR Operations Associate

IMC

Mumbai, Maharashtra, India (On-Site)
3 Months ago
gitlab - Named Account Executive - West Coast

gitlab

United States (Remote)
1 Month ago
WRI - Program Manager, Climate, Economics & Finance Program

WRI

Guwahati, Assam, India (On-Site)
1 Month ago
Notion - Software Engineer, Deploy Observability Infra

Notion

San Francisco, California, United States (On-Site)
2 Months ago
belka games - Senior Analytics Engineer

belka games

(Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Universal Music Group - Manager, Production

Universal Music Group

New York, United States (On-Site)
2 Months ago
Cognite - Field Marketing Manager

Cognite

Phoenix, Arizona, United States (Hybrid)
1 Month ago
GoDaddy - Freelance Photographer

GoDaddy

Hood River, Oregon, United States (On-Site)
2 Months ago
Match Group - Sr. Anti Abuse Analyst

Match Group

Los Angeles, California, United States (Hybrid)
5 Months ago
CyberArk - Staff Site Reliability Engineer

CyberArk

United States (On-Site)
2 Months ago
Daxko - Customer Success Manager

Daxko

Birmingham, Alabama, United States (Remote)
1 Month ago
zoox - Senior UX/UI Mobile Designer

zoox

Foster City, California, United States (Hybrid)
9 Months ago
Zeeco, Inc. - Controls Engineer

Zeeco, Inc.

Tulsa, Oklahoma, United States (On-Site)
6 Months ago
Hudl - Senior Quality Assurance Manager

Hudl

Chicago, Illinois, United States (Remote)
1 Month ago
bytedance - Software Engineer, Backend and Infrastructure

bytedance

San Jose, California, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Deepgram - Voice AI Evaluation Lead

Deepgram

California, United States (Remote)
2 Months ago
Super.com - Machine Learning Engineer

Super.com

Bogotá, Bogota, Colombia (Hybrid)
2 Months ago
Valeo - Junior Engineer in the R&D Department

Valeo

Czechowice-Dziedzice, Silesian Voivodeship, Poland (On-Site)
2 Months ago
Adobe - Engineering Manager - ML Applied Research

Adobe

Bucharest, Bucharest, Romania (On-Site)
2 Months ago
Spellbrush - AI Anime Researcher

Spellbrush

Tokyo, Japan (On-Site)
4 Months ago
Vercel - Security Researcher

Vercel

San Francisco, California, United States (Remote)
2 Months ago
zoox - Senior Staff Machine Learning Engineer - Perception

zoox

Foster City, California, United States (Hybrid)
9 Months ago
Intel  - Security Researcher

Intel

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Aera Technology - Client Partner | Enterprise Platform Sales | AI /ML Decision Intelligence | Texas

Aera Technology

Texas, United States (Hybrid)
9 Months ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug