SEAL Research Scientist/ Research Engineer

1 Day ago • 3 Years + • $176,000 PA - $300,000 PA

Job Summary

Job Description

The Safety, Evaluations and Alignment Lab (SEAL) at Scale is seeking talented researchers to shape the landscape for safety and transparency in the AI industry. The role involves designing and implementing robust evaluation benchmarks, researching and implementing cutting-edge model-assisted red teaming methods, developing state-of-the-art LLM-based automated rating systems, and developing rater assist techniques. The ideal candidate will have experience conducting technical research, proficiency in frameworks like Pytorch, Jax, or Tensorflow, and a track record of published research in machine learning, particularly in generative AI. The role involves a collaborative environment and the publication of research findings.
Must have:
  • Commitment to promoting safe, secure, and trustworthy AI deployments.
  • Practical experience conducting technical research collaboratively.
  • Proficiency in frameworks like Pytorch, Jax, or Tensorflow.
  • A track record of published research in machine learning.
Good to have:
  • Hands-on experience with open source LLM fine-tuning.
  • Experience in crafting evaluations or a background in data science roles.
  • Experience working with cloud technology stack (eg. AWS or GCP).

Job Details

As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding large language models (LLMs). Safety, Evaluations and Alignment Lab (SEAL) is Scale’s new frontier research effort dedicated to building robust evaluation products and tackling the challenging research problems in evaluation and red teaming.

We are actively seeking talented researchers to join us in shaping the landscape for safety and transparency for the entire AI industry. We support collaborations across the industry and the publication of our research findings. Below is a list of SEAL’s representative projects:

  • Design and implement robust evaluation benchmarks. Measure and improve eval reproducibility and reliability.
  • Research and implement cutting-edge model assisted red teaming methods.
  • Develop state of the art LLM based automated rating systems leveraging the Scale ecosystem for customized training data.
  • Develop rater assist techniques such as critique modeling for improving rating quality.

Ideally you’d have:

  • Commitment to our mission of promoting safe, secure, and trustworthy AI deployments in the industry.
  • Practical experience conducting technical research collaboratively, with proficiency in frameworks like Pytorch, Jax, or Tensorflow. You should also be adept at interpreting research literature and quickly turning new ideas into prototypes.
  • A track record of published research in machine learning, particularly in generative AI.
  • At least three years of experience addressing sophisticated ML problems, whether in a research setting or in product development.
  • Strong written and verbal communication skills to operate in a cross functional team.

Nice to have:

  • Hands-on experience with open source LLM fine-tuning or involvement in bespoke LLM fine-tuning projects using Pytorch/Jax.
  • Experience in crafting evaluations or a background in data science roles related to LLM technologies.
  • Experience working with cloud technology stack (eg. AWS or GCP) and developing machine learning models in a cloud environment.

Our research interviews are crafted to assess candidates' skills in practical ML prototyping and debugging, their grasp of research concepts, and their alignment with our organizational culture. We will not ask any LeetCode-style questions.

Similar Jobs

ByteDance - Algorithm Engineer - Enterprise Solution RD

ByteDance

San Jose, California, United States (On-Site)
2 Weeks ago
Salesforce - Salesforce AI Research Intern - Summer 2025

Salesforce

Palo Alto, California, United States (On-Site)
6 Months ago
Netflix - Software Engineer (L5), N-Tech Software Engineering

Netflix

United States (Remote)
6 Months ago
ByteDance - AI Security Researcher - Security - San Jose

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Google - Software Engineer III, Generative AI

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Canva - Senior Machine Learning Engineer - Specialist Platform and Experience

Canva

Melbourne, Victoria, Australia (Remote)
1 Month ago
Bohemia Interactive - Python Programmer

Bohemia Interactive

Brno, South Moravian Region, Czechia (On-Site)
1 Week ago
Pluto7 - Data Scientist

Pluto7

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Redmond, Washington, United States (On-Site)
5 Months ago
Canva - Staff Machine Learning Engineer - User Voice

Canva

Sydney, New South Wales, Australia (Remote)
3 Weeks ago
Razer - Solutions Architect

Razer

Singapore (On-Site)
7 Months ago
Ubisoft - Lead R&D Scientist

Ubisoft

Shanghai, Shanghai, China (On-Site)
3 Months ago
NVIDIA - Senior System Software Engineer, NCCL - Partner Enablement

NVIDIA

Austin, Texas, United States (Remote)
1 Month ago
Arrise Solutions (India)   - Data Scientist - Recommender S/m's

Arrise Solutions (India)

Hyderabad, Telangana, India (On-Site)
7 Months ago
ByteDance - AI Security Researcher - Security - San Jose

ByteDance

San Jose, California, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Kokotree - Social Media Content Producers

Kokotree

Wilmington, North Carolina, United States (On-Site)
5 Months ago
Nintendo - Senior Engineer, Cloud (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
9 Months ago
Google - Business Continuity and Resilience Manager

Google

Chicago, Illinois, United States (On-Site)
1 Week ago
The Walt Disney Company - SIP Content Security Senior Analyst

The Walt Disney Company

Glendale, California, United States (On-Site)
3 Days ago
Google - Senior Software Engineer, Google Cloud Global Networking

Google

Austin, Texas, United States (On-Site)
1 Week ago
Aisera Jobs - Senior Webmaster / Web Development Manager

Aisera Jobs

Palo Alto, California, United States (On-Site)
1 Day ago
Aptive - Resident Engineer

Aptive

Cupertino, California, United States (On-Site)
6 Hours ago
Sonar Source - Staff Software Engineer (Java)

Sonar Source

Austin, Texas, United States (Hybrid)
6 Months ago
Postman - Senior Security Engineer, Application Security

Postman

San Francisco, California, United States (Hybrid)
1 Day ago
Thatgamecompany - General Design

Thatgamecompany

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

Doha, Doha Municipality, Qatar (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug