ML Research Engineer, ML Systems

3 Months ago • All levels • System Design • $200,800 PA - $251,000 PA

Job Summary

Job Description

The ML platform (RLXF) team at Scale builds an internal distributed framework for large language model training and inference. This platform supports MLEs, researchers, data scientists, and operators in efficiently training and evaluating LLMs, as well as assessing data quality. As an ML Research Engineer, you will collaborate with Scale's ML teams and researchers, contributing to the platform that supports ML research and development. Your role involves optimizing the platform to enable the next generation of LLM training, inference, and data curation.
Must have:
  • Experience with multi-node LLM training and inference
  • Experience with developing large-scale distributed ML systems
  • Strong software engineering skills, proficient in CUDA, Pytorch, transformers, etc.
  • Strong written and verbal communication skills
Good to have:
  • Demonstrated expertise in post-training methods
  • Experience with next generation use cases for large language models

Job Details

Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering MLEs, researchers, data scientists and operators for fast and automatic training and evaluation of LLM's, as well as evaluation of data quality.

Scale is uniquely positioned at the heart of the field of AI as an indispensable provider of training and evaluation data and end-to-end solutions for the ML lifecycle. You will work closely across Scale’s ML teams and researchers to build the foundation platform that supports all our ML research and development. You will be building and optimizing the platform to enable our next generation of LLM training, inference and data curation.

If you are excited about shaping the future AI via fundamental innovations, we would love to hear from you!

You will:

  • Build, profile and optimize our training and inference framework
  • Collaborate with ML teams to accelerate their research and development and enable them to develop the next generation of models and data curation
  • Research and integrate state-of-the-art technologies to optimize our ML system

Ideally you’d have:

  • Strong excitement about system optimization
  • Experience with multi-node LLM training and inference
  • Experience with developing large-scale distributed ML systems
  • Strong software engineering skills, proficient in frameworks and tools such as CUDA, Pytorch, transformers, flash attention, etc. 
  • Strong written and verbal communication skills and the ability to operate in a cross functional team environment

Nice to haves:

  • Demonstrated expertise in post-training methods &/or next generation use cases for large language models including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal, etc.



Similar Jobs

Paytm - Technical Program Manager - Senior TPM

Paytm

Noida, Uttar Pradesh, India (On-Site)
8 Months ago
Saronic Technologies - Marine Roboticist

Saronic Technologies

Austin, Texas, United States (On-Site)
1 Week ago
e2 open - Contract Specialist

e2 open

(Remote)
2 Weeks ago
InMobiInMobi - Sr. Sales Manager

InMobiInMobi

New York, New York, United States (On-Site)
3 Months ago
Motorola solutions - Systems Engineer

Motorola solutions

Somerville, Massachusetts, United States (Remote)
1 Week ago
Qualcomm - AI Model System Software Performance Optimization Lead Engineer, Senior

Qualcomm

Hyderabad, Telangana, India (On-Site)
1 Month ago
BioFire - National Field System Engineer

BioFire

United States (On-Site)
2 Months ago
Morning Star - Senior Application Security Architect

Morning Star

Chicago, Illinois, United States (Hybrid)
10 Months ago
Survay Monkey - Information Systems Engineer III

Survay Monkey

Ottawa, Ontario, Canada (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Nice - Solution Architect

Nice

Hoboken, New Jersey, United States (Hybrid)
4 Weeks ago
Glean - Stock Administrator

Glean

Bengaluru, Karnataka, India (Hybrid)
4 Weeks ago
Harvey - Enterprise Customer Success Manager, EMEA

Harvey

London, England, United Kingdom (On-Site)
1 Week ago
bohemia interactive - Technical Designer

bohemia interactive

Prague, Prague, Czechia (On-Site)
2 Months ago
WebTech Corporation - Director, Tax Accounting

WebTech Corporation

Pittsburgh, Pennsylvania, United States (On-Site)
3 Months ago
Triple dot studios - Lead Product Designer

Triple dot studios

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Month ago
Roblox - Senior Product Manager, Roblox Operating System (India)

Roblox

Gurugram, Haryana, India (On-Site)
1 Week ago
Marvell - Senior Engineer, Analog Layout

Marvell

Santa Clara, California, United States (On-Site)
1 Month ago
Ion - Z/OS Senior System Programmer, Italy

Ion

Italy (Hybrid)
9 Months ago
PlaySimple - Senior Product Manager

PlaySimple

Karnataka, India (On-Site)
10 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Trek - Sales Associate - Part Time

Trek

Palm Desert, California, United States (On-Site)
6 Months ago
Bonfire Studios - Lead Environment Artist

Bonfire Studios

California, United States (Hybrid)
5 Months ago
Game vision studios  - Game Designer

Game vision studios

Naperville, Illinois, United States (On-Site)
1 Month ago
Notion - Software Engineer, AI Product

Notion

San Francisco, California, United States (On-Site)
2 Months ago
Figma - Security Engineer

Figma

San Francisco, California, United States (Remote)
1 Week ago
Naughty Dog - IT Help Desk Technician

Naughty Dog

Santa Monica, California, United States (On-Site)
2 Months ago
Whatnot - Software Engineer, Buyer Growth

Whatnot

San Francisco, California, United States (On-Site)
2 Months ago
Apple - Speech & Audio ML Algorithm Engineer

Apple

Culver City, California, United States (On-Site)
2 Months ago
Gupta Media - Account Director, Paid Media

Gupta Media

Boston, Massachusetts, United States (On-Site)
3 Months ago
Naughty Dog - Senior Game Designer (Combat)

Naughty Dog

Santa Monica, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

System Design Jobs

Passive Logic - Embedded Database Systems Engineer

Passive Logic

Salt Lake City, Utah, United States (On-Site)
2 Months ago
Next Level Business Services - Systems Engineer

Next Level Business Services

Redmond, Washington, United States (On-Site)
9 Months ago
zoox - Senior Electrical System Architect

zoox

Foster City, California, United States (On-Site)
1 Month ago
bytedance - Software Engineer, ML System Scheduling

bytedance

San Jose, California, United States (On-Site)
9 Months ago
WebTech Corporation - Sr Engineer- Systems

WebTech Corporation

Bengaluru, Karnataka, India (On-Site)
1 Month ago
ARHS - Senior System Engineer

ARHS

Leuven, Flanders, Belgium (On-Site)
9 Months ago
Apple - Touch Sensing HW-Algorithm Systems Engineer

Apple

Cupertino, California, United States (On-Site)
2 Months ago
fluence - Lead Systems Engineer (Sustaining)

fluence

Houston, Texas, United States (Hybrid)
3 Months ago
Capgemini - Systems Engineer (PROGRESS DBA)

Capgemini

Mumbai, Maharashtra, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug