ML Research Engineer, ML Systems

1 Month ago • All levels • $200,800 PA - $251,000 PA

Job Summary

Job Description

The ML platform (RLXF) team at Scale builds an internal distributed framework for large language model training and inference. This platform supports MLEs, researchers, data scientists, and operators in efficiently training and evaluating LLMs, as well as assessing data quality. As an ML Research Engineer, you will collaborate with Scale's ML teams and researchers, contributing to the platform that supports ML research and development. Your role involves optimizing the platform to enable the next generation of LLM training, inference, and data curation.
Must have:
  • Experience with multi-node LLM training and inference
  • Experience with developing large-scale distributed ML systems
  • Strong software engineering skills, proficient in CUDA, Pytorch, transformers, etc.
  • Strong written and verbal communication skills
Good to have:
  • Demonstrated expertise in post-training methods
  • Experience with next generation use cases for large language models

Job Details

Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering MLEs, researchers, data scientists and operators for fast and automatic training and evaluation of LLM's, as well as evaluation of data quality.

Scale is uniquely positioned at the heart of the field of AI as an indispensable provider of training and evaluation data and end-to-end solutions for the ML lifecycle. You will work closely across Scale’s ML teams and researchers to build the foundation platform that supports all our ML research and development. You will be building and optimizing the platform to enable our next generation of LLM training, inference and data curation.

If you are excited about shaping the future AI via fundamental innovations, we would love to hear from you!

You will:

  • Build, profile and optimize our training and inference framework
  • Collaborate with ML teams to accelerate their research and development and enable them to develop the next generation of models and data curation
  • Research and integrate state-of-the-art technologies to optimize our ML system

Ideally you’d have:

  • Strong excitement about system optimization
  • Experience with multi-node LLM training and inference
  • Experience with developing large-scale distributed ML systems
  • Strong software engineering skills, proficient in frameworks and tools such as CUDA, Pytorch, transformers, flash attention, etc. 
  • Strong written and verbal communication skills and the ability to operate in a cross functional team environment

Nice to haves:

  • Demonstrated expertise in post-training methods &/or next generation use cases for large language models including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal, etc.



Similar Jobs

NVIDIA - Senior Math Libraries Engineers - Python APIs

NVIDIA

Louisiana, United States (Remote)
3 Months ago
Yahoo - Senior Principal Machine Learning Engineer

Yahoo

United States (Hybrid)
5 Days ago
diligent coorperation - AI Solution Architect

diligent coorperation

Vancouver, British Columbia, Canada (On-Site)
1 Week ago
bytedance - Research Scientist Graduate (High-Performance Computing (Inference Optimization) - Vision AI Platform)

bytedance

San Jose, California, United States (On-Site)
3 Months ago
bytedance - Video Analysis and Quality Algorithm Intern 2023 Summer/Fall (MS)

bytedance

San Jose, California, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Snorkel AI - Senior AI Solutions Engineer (Pre-Sales)

Snorkel AI

New York, United States (On-Site)
2 Weeks ago
The Walt Disney Company - Lead Software Engineer - Applied AI & Machine Learning

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Month ago
bytedance - Student Researcher (Doubao (Seed) - Machine Learning System) - 2025 Start (PhD)

bytedance

San Jose, California, United States (On-Site)
7 Months ago
Meta - Software Engineer, Machine Learning

Meta

San Francisco, California, United States (On-Site)
6 Months ago
Philips - AI Engineer - I/II

Philips

Bengaluru, Karnataka, India (Hybrid)
1 Week ago
hello games - Machine Learning Engineer

hello games

United Kingdom (On-Site)
3 Months ago
Adobe - Machine Learning Engineer

Adobe

San Jose, California, United States (On-Site)
6 Days ago
bytedance - Research Scientist in Foundation Model, Speech Understanding - 2024 Start (PhD)

bytedance

San Jose, California, United States (On-Site)
7 Months ago
bytedance - Software Engineer - Applied Machine Learning, Engine

bytedance

San Jose, California, United States (On-Site)
1 Month ago
PayPal - Principal AI/ML Platform Architect

PayPal

San Jose, California, United States (Hybrid)
4 Days ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Qualcomm - GPU Design Engineer

Qualcomm

Santa Clara, California, United States (On-Site)
3 Weeks ago
Motorola solutions - CAD (Computer Aided Dispatch) System Manager

Motorola solutions

Florida, United States (On-Site)
1 Week ago
Flow - Senior/Staff Backend Software Engineer

Flow

Palo Alto, California, United States (Hybrid)
7 Months ago
Light Speed Studios - Senior VFX Artist

Light Speed Studios

Irvine, California, United States (On-Site)
3 Months ago
Zscaler - Principal SWE (TCP/IP, C coding, Public Cloud)

Zscaler

San Jose, California, United States (Hybrid)
2 Weeks ago
Cadence - Cloud Engineer / Full Stack Developer

Cadence

San Jose, California, United States (On-Site)
6 Days ago
Apple - SWE - Triage Engineer, Siri

Apple

Seattle, Washington, United States (On-Site)
1 Week ago
Actian - Senior Product Manager, Cloud

Actian

United States (Remote)
1 Week ago
GoMotive - Director of Product Management, AI

GoMotive

United States (Remote)
3 Months ago
UPF Industries  - Facility Janitor

UPF Industries

Livermore Falls, Maine, United States (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

Seattle, Washington, United States (Remote)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug