SEAL Research Scientist/ Research Engineer

3 Months ago • 3 Years + • Research Development • $176,000 PA - $300,000 PA

Job Summary

Job Description

The Safety, Evaluations and Alignment Lab (SEAL) at Scale is seeking talented researchers to shape the landscape for safety and transparency in the AI industry. The role involves designing and implementing robust evaluation benchmarks, researching and implementing cutting-edge model-assisted red teaming methods, developing state-of-the-art LLM-based automated rating systems, and developing rater assist techniques. The ideal candidate will have experience conducting technical research, proficiency in frameworks like Pytorch, Jax, or Tensorflow, and a track record of published research in machine learning, particularly in generative AI. The role involves a collaborative environment and the publication of research findings.
Must have:
  • Commitment to promoting safe, secure, and trustworthy AI deployments.
  • Practical experience conducting technical research collaboratively.
  • Proficiency in frameworks like Pytorch, Jax, or Tensorflow.
  • A track record of published research in machine learning.
Good to have:
  • Hands-on experience with open source LLM fine-tuning.
  • Experience in crafting evaluations or a background in data science roles.
  • Experience working with cloud technology stack (eg. AWS or GCP).

Job Details

As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding large language models (LLMs). Safety, Evaluations and Alignment Lab (SEAL) is Scale’s new frontier research effort dedicated to building robust evaluation products and tackling the challenging research problems in evaluation and red teaming.

We are actively seeking talented researchers to join us in shaping the landscape for safety and transparency for the entire AI industry. We support collaborations across the industry and the publication of our research findings. Below is a list of SEAL’s representative projects:

  • Design and implement robust evaluation benchmarks. Measure and improve eval reproducibility and reliability.
  • Research and implement cutting-edge model assisted red teaming methods.
  • Develop state of the art LLM based automated rating systems leveraging the Scale ecosystem for customized training data.
  • Develop rater assist techniques such as critique modeling for improving rating quality.

Ideally you’d have:

  • Commitment to our mission of promoting safe, secure, and trustworthy AI deployments in the industry.
  • Practical experience conducting technical research collaboratively, with proficiency in frameworks like Pytorch, Jax, or Tensorflow. You should also be adept at interpreting research literature and quickly turning new ideas into prototypes.
  • A track record of published research in machine learning, particularly in generative AI.
  • At least three years of experience addressing sophisticated ML problems, whether in a research setting or in product development.
  • Strong written and verbal communication skills to operate in a cross functional team.

Nice to have:

  • Hands-on experience with open source LLM fine-tuning or involvement in bespoke LLM fine-tuning projects using Pytorch/Jax.
  • Experience in crafting evaluations or a background in data science roles related to LLM technologies.
  • Experience working with cloud technology stack (eg. AWS or GCP) and developing machine learning models in a cloud environment.

Our research interviews are crafted to assess candidates' skills in practical ML prototyping and debugging, their grasp of research concepts, and their alignment with our organizational culture. We will not ask any LeetCode-style questions.

Similar Jobs

Thatgamecompany - Senior Engine Programmer

Thatgamecompany

United States (Remote)
4 Months ago
MiQ - Marketing Manager

MiQ

Mexico City, Mexico (Hybrid)
3 Months ago
USE Insider - Solution Architect - Germany

USE Insider

Berlin, Berlin, Germany (Hybrid)
9 Months ago
Paytm - Product Manager (AI)

Paytm

Bengaluru, Karnataka, India (On-Site)
10 Months ago
Tesla - Service Technician

Tesla

Utrecht, Utrecht, Netherlands (On-Site)
5 Months ago
Zazz - Artificial Intelligence Engineer

Zazz

(Remote)
5 Months ago
Apple - Senior Machine Learning Applied Researcher

Apple

San Francisco, California, United States (On-Site)
3 Months ago
Epic Games - Senior AI Programmer, Fortnite

Epic Games

Montreal, Quebec, Canada (On-Site)
3 Months ago
Samsung Semiconductor - Staff Engineer, Machine Learning

Samsung Semiconductor

San Jose, California, United States (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

GoMotive - Manager, Revenue Accounting

GoMotive

United States (Remote)
3 Months ago
Evolution  - In- Studio LIVE Game Presenter - Full Benefits, $20 - $25/hr- NO EXPERIENCE NECESSARY

Evolution

Atlantic City, New Jersey, United States (On-Site)
1 Year ago
Reach games studios - Programmer - Gameplay

Reach games studios

Sydney, New South Wales, Australia (Remote)
3 Months ago
Game pack studio - 2D Animator | Spine

Game pack studio

(On-Site)
4 Weeks ago
Tesla - Customer Experience Specialist, Sales

Tesla

London, England, United Kingdom (On-Site)
5 Months ago
Yodlee - Sales Pricing Director - YOD

Yodlee

Raleigh, North Carolina, United States (Hybrid)
2 Months ago
Univision - Paid Social Media Analyst

Univision

Bogota, Colombia (On-Site)
3 Months ago
WongDoody - User Experience Designer, Snr.

WongDoody

Sydney, New South Wales, Australia (On-Site)
3 Months ago
RocketWerkz - MATHEMATICIAN PROGRAMMER

RocketWerkz

Auckland, Auckland, New Zealand (On-Site)
1 Year ago
oni - Business Development Associate

oni

Boston, Massachusetts, United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Airbyte - Support Engineering Manager

Airbyte

San Francisco, California, United States (Hybrid)
4 Weeks ago
skillz - VIP Account Manager

skillz

Las Vegas, Nevada, United States (On-Site)
3 Months ago
Evolution  - Casino Game Presenter (Bartender Alternative) - up to $25/hr.

Evolution

Atlantic City, New Jersey, United States (On-Site)
9 Months ago
Apple - GGML Bringup and Triage Engineer

Apple

Cupertino, California, United States (On-Site)
2 Months ago
Notion - Software Engineer, Android

Notion

San Francisco, California, United States (On-Site)
9 Months ago
Virtusa - Manual Tester

Virtusa

Austin, Texas, United States (On-Site)
12 Months ago
Matte projects - Senior Post Producer - Freelance Fixed-Term Contract

Matte projects

New York, United States (On-Site)
3 Weeks ago
Postman - Technical Enterprise Customer Success Manager

Postman

Boston, Massachusetts, United States (Hybrid)
4 Weeks ago
Evolution  - In-Studio Game Presenter (Customer Service Alternative)

Evolution

Atlantic City, New Jersey, United States (On-Site)
4 Weeks ago
Kavalirio - Business - Subject Matter Expert

Kavalirio

Golden, Colorado, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Sonar Source - AI Research Associate

Sonar Source

Singapore (On-Site)
3 Months ago
Scale AI - Machine Learning Research Scientist/ Engineer, Agents

Scale AI

San Francisco, California, United States (On-Site)
3 Months ago
Vercel - DX Engineer, AI SDK

Vercel

San Francisco, California, United States (Hybrid)
2 Months ago
Sword Health - Staff ML Engineer

Sword Health

Porto, Porto District, Portugal (Hybrid)
1 Year ago
Capgemini - Machine Learning Engineer

Capgemini

Chennai, Tamil Nadu, India (On-Site)
2 Months ago
Globalization Partners - Senior AI Engineer

Globalization Partners

(Remote)
5 Months ago
Keywords Studios - Research Associate - AI

Keywords Studios

(Remote)
4 Months ago
Egnyte - Software Engineer - AI/ML

Egnyte

Mountain View, California, United States (Hybrid)
6 Months ago
Apple - AIML - Sr. Machine Learning Engineer, World Knowledge

Apple

Cupertino, California, United States (On-Site)
3 Weeks ago
Social Discovery Ventures - ML Engineer / NLP Engineer

Social Discovery Ventures

(Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug