SEAL Research Scientist, Frontier Risk Evaluations

1 Day ago • 3 Years + • $176,000 PA - $300,000 PA

Job Summary

Job Description

As a Research Scientist focused on Frontier Risk Evaluations, you will design and create evaluation measures, harnesses and datasets for measuring the risks posed by frontier AI systems. This role involves designing and building harnesses to test AI agents for dangerous capabilities, developing and running human-in-the-loop tests of AI capabilities, and collaborating with government agencies or other labs to scope and design evaluations to mitigate risks. The ideal candidate has a commitment to safe AI deployments, practical experience in technical research with frameworks like Pytorch, Jax, or Tensorflow, a track record of published research in machine learning, and strong communication skills. The role requires at least three years of experience addressing sophisticated ML problems.
Must have:
  • Commitment to safe, secure, and trustworthy AI deployments.
  • Practical experience in technical research with frameworks like Pytorch, Jax, or Tensorflow.
  • Published research in machine learning, particularly in generative AI.
  • At least three years of experience addressing sophisticated ML problems.
  • Strong written and verbal communication skills.
Good to have:
  • Hands-on experience with open source LLM fine-tuning.
  • Experience in crafting evaluations or a background in data science related to LLM technologies.
  • Experience working with cloud technology stack (eg. AWS or GCP).

Job Details

As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding large language models (LLMs). Safety, Evaluations and Alignment Lab (SEAL) is Scale’s frontier research effort dedicated to tackling the challenging research problems in evaluation, red teaming, and alignment of advanced AI systems.

We are actively seeking talented researchers to join us in shaping the landscape for safety and transparency for the entire AI industry. We support collaborations across the industry and academia and the publication of our research findings. 

As a Research Scientist focused on Frontier Risk Evaluations, you will design and create evaluation measures, harnesses and datasets for measuring the risks posed by frontier AI systems. For example, you might do any or all of the following: 

  • Design and build harnesses to test AI agents for dangerous capabilities such as hacking or exploiting security vulnerabilities;
  • Develop and run human-in-the-loop tests of AI capabilities to deceive, manipulate, blackmail, or otherwise engage in social engineering;
  • Work with government agencies or other labs to collectively scope and design evaluations to measure and mitigate risks posed by advanced AI systems.

Ideally you’d have:

  • Commitment to our mission of promoting safe, secure, and trustworthy AI deployments in the industry as frontier AI capabilities continue to advance.
  • Practical experience conducting technical research collaboratively, with proficiency in frameworks like Pytorch, Jax, or Tensorflow. You should also be adept at interpreting research literature and quickly turning new ideas into prototypes.
  • A track record of published research in machine learning, particularly in generative AI.
  • At least three years of experience addressing sophisticated ML problems, whether in a research setting or in product development.
  • Strong written and verbal communication skills to operate in a cross functional team.

Nice to have:

  • Hands-on experience with open source LLM fine-tuning or involvement in bespoke LLM fine-tuning projects using Pytorch/Jax.
  • Experience in crafting evaluations or a background in data science roles related to LLM technologies.
  • Experience working with cloud technology stack (eg. AWS or GCP) and developing machine learning models in a cloud environment.

Our research interviews are crafted to assess candidates' skills in practical ML prototyping and debugging, their grasp of research concepts, and their alignment with our organizational culture. We will not ask any LeetCode-style questions.

Similar Jobs

Epic Games - Senior Machine Learning Rendering Programmer

Epic Games

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
Google - Software Engineering Manager, Google Kubernetes AI Infrastructure

Google

Kirkland, Washington, United States (On-Site)
2 Weeks ago
Canva - Senior Machine Learning Engineer - Specialist Platform and Experience

Canva

Surry Hills, New South Wales, Australia (Remote)
1 Month ago
Rackspace Technology - Data Scientist

Rackspace Technology

Alexandria, Alexandria Governorate, Egypt (Remote)
3 Months ago
Google - Cloud Consultant II, AI/ML, Professional Services

Google

Chicago, Illinois, United States (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Customer Engineer, AI Infrastructure, Google Cloud

Google

Singapore (On-Site)
2 Weeks ago
Luxoft - Senior ML Engineer

Luxoft

Poland, Ohio, United States (Remote)
4 Months ago
Google - Technical Program Manager III, AI/ML, Cloud AI Systems

Google

Austin, Texas, United States (On-Site)
2 Weeks ago
Inkittt - Senior Machine Learning Engineer, Recommendations

Inkittt

San Francisco, California, United States (Hybrid)
3 Months ago
Google - Customer Engineer, Applied and Generative AI, Google Cloud

Google

Singapore, Singapore (On-Site)
1 Week ago
GoMotive - Computer Vision Engineer

GoMotive

(Remote)
1 Day ago
Attentive - Senior Software Engineer, Search Optimization

Attentive

(Remote)
2 Months ago
Microsoft - Applied Scientist: Microsoft AI – PhD – Redmond

Microsoft

Redmond, Washington, United States (On-Site)
2 Weeks ago
NVIDIA - Senior System Software Engineer, NCCL - Partner Enablement

NVIDIA

Austin, Texas, United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

GHX - Inventory Specialist

GHX

Tacoma, Washington, United States (On-Site)
6 Hours ago
Rockstar Games - Senior Software Engineer (C#)

Rockstar Games

Carlsbad, California, United States (On-Site)
7 Months ago
ByteDance - Machine Learning Engineer Intern (Knowledge Graph) - 2024 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Bitwise Alchemy - General

Bitwise Alchemy

Texas, United States (Remote)
6 Months ago
ION - Senior Product Manager - Post Trade (Cleared Derivatives)

ION

Chicago, Illinois, United States (On-Site)
6 Months ago
Drake Cooper - Social First Art Director

Drake Cooper

Boise, Idaho, United States (Hybrid)
1 Week ago
The Walt Disney Company - Cogen Operator

The Walt Disney Company

Lake Buena Vista, Florida, United States (On-Site)
2 Weeks ago
Google - Solutions Consultant III, Pixel Enterprise, Platforms and Devices

Google

Mountain View, California, United States (On-Site)
2 Days ago
Eleven Labs - Production Manager - Italian

Eleven Labs

United States (Remote)
3 Weeks ago
PlayStation Global - Creator Platform Planning Manager

PlayStation Global

United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

Doha, Doha Municipality, Qatar (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug