Fullstack Software Engineer, GenAI Model Quality

1 Day ago • 3 Years + • $160,000 PA - $192,000 PA

Job Summary

Job Description

As a Fullstack Software Engineer on the Quality team, you will build web-based applications to measure the quality of data contributors. You will focus on systems that monitor and flag quality issues with large-scale data collections and will be involved in benchmark testing, ML models, and heuristics. The role involves owning large areas within the product, building features end-to-end, delivering experiments at a high velocity, and collaborating with cross-functional teams. This position offers the chance to influence the culture, values, and processes of a growing engineering team and mentor less experienced engineers. The work is crucial for the development of AI applications, particularly in generative AI and model evaluation.
Must have:
  • Shipping high-quality products and features at scale.
  • Ability to turn business and product ideas into engineering solutions.
  • Excellent problem-solving skills and ability to work independently or as part of a team.

Job Details

About Scale

At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we’re accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our capabilities and offerings for both public and private evaluations.

About Data Engine

Our Generative AI Data Engine powers the world’s most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we are producing is some of the most important work for how humanity will interact with AI.

About our Quality team

Generating high-quality data is the core problem our business solves. Our Quality team focuses on building web-based applications that help measure our contributors' quality. As a Software Engineer on the team, you’ll focus on building systems that monitor and flag quality issues with large-scale data collections. You will invest in Benchmark testing, ML models, heuristics, and other evaluation strategies to measure contributors' quality on a variety of Gen AI tasks. 

Responsibilities:

  • Own large areas within our product
  • Build features end-to-end: front-end, back-end, system design, debugging and testing
  • Deliver experiments at a high velocity and level of quality to engage our customers
  • Work across the entire product lifecycle from conceptualization through production
  • Influence the culture, values, and processes of a growing engineering team
  • Inspire and mentor less experienced engineers
  • Collaborating with cross-functional teams to define, design, and ship new product features and experiences.

Requirements:

  • At least 3 years of relevant experience is preferred
  • Track record of shipping high-quality products and features at scale
  • Desire to work in a very fast-paced environment
  • Ability to turn business and product ideas into engineering solutions
  • Excellent problem-solving skills, and be able to work independently or as part of a team.
  • Excited to join a dynamic, hybrid team in either San Francisco or New York City



Similar Jobs

ION - Cloud Engineer Kubernetes

ION

Castellazzo Bormida, Piedmont, Italy (Hybrid)
6 Months ago
Definitive HC India - Analyst - Data Science

Definitive HC India

Bengaluru, Karnataka, India (On-Site)
9 Hours ago
Google - Staff Application Engineer, Spaces Engineering

Google

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
ByteDance - Senior R&D Engineer - Overseas

ByteDance

Seattle, Washington, United States (On-Site)
3 Days ago
sound cloud - Senior Data Engineer

sound cloud

Berlin, Berlin, Germany (Hybrid)
1 Day ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Software Engineer, gReach Program for People with Disabilities

Google

Seoul, South Korea (On-Site)
2 Weeks ago
Meetelise - Senior Software Engineer (Full Stack)

Meetelise

New York, New York, United States (On-Site)
6 Months ago
Palo Alto Networks - Senior Staff DevOps Engineer (Prisma SaaS) - NetSec

Palo Alto Networks

Gurugram, Haryana, India (On-Site)
1 Month ago
Crunchyroll - Staff Partner Services Engineer

Crunchyroll

Mexico City, Mexico City, Mexico (On-Site)
5 Months ago
N-iX - Lead Full Stack Engineer (.NET+React) (#2638)

N-iX

Colombia (Remote)
4 Months ago
Aerospike - Senior Software Engineer, Cloud

Aerospike

(Remote)
23 Hours ago
Remote.com - Senior Site Reliability Engineer

Remote.com

(Remote)
8 Hours ago
CleverTap - Senior Backend Engineer (Java & Mongo DB)

CleverTap

Mumbai, Maharashtra, India (Hybrid)
6 Months ago
Google - Software Engineer III, Full Stack, Google Ads

Google

(On-Site)
5 Months ago
N-iX - Senior Fullstack .NET + Angular Engineer

N-iX

Medellín, Antioquia, Colombia (Hybrid)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

GoMotive - Account Executive, Enterprise - Northeast

GoMotive

United States (Remote)
1 Month ago
Novo - Want to work with us, but don't see the right job listed?

Novo

New York, New York, United States (On-Site)
1 Day ago
Activision - Tier 3 Service Operations Specialist

Activision

El Segundo, California, United States (On-Site)
1 Month ago
samaa technologies - Digital Product Owner (Commercial Insurance)

samaa technologies

United States (On-Site)
4 Weeks ago
Lionsgate Games - Manager, Worldwide Publicity

Lionsgate Games

Santa Monica, California, United States (On-Site)
2 Weeks ago
Synechron - Senior Business Analyst

Synechron

New York, New York, United States (On-Site)
7 Hours ago
Valve corporation - Audio Software Engineer

Valve corporation

Bellevue, Washington, United States (On-Site)
6 Months ago
Spell Brush - AI Infrastructure Engineer

Spell Brush

San Francisco, California, United States (On-Site)
1 Month ago
Anavation - Senior IT Administrator

Anavation

Chantilly, Virginia, United States (Hybrid)
4 Months ago
Thatgamecompany - Product Data Scientist

Thatgamecompany

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

Doha, Doha Municipality, Qatar (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug