Senior Software Engineer, GenAI Model Quality

1 Day ago • 5 Years + • $188,000 PA - $225,600 PA

Job Summary

Job Description

As a Senior Software Engineer on the Quality team at Scale AI, you will be responsible for building web-based applications that monitor and flag quality issues within large-scale data collections for generative AI models. Your role involves developing systems for benchmark testing, utilizing ML models, and implementing heuristics to evaluate contributors' quality across various Gen AI tasks. This position requires owning significant areas within the product, building features end-to-end, and delivering experiments quickly. You'll collaborate with cross-functional teams, mentor other engineers, and influence the engineering culture.
Must have:
  • 5+ years relevant experience in software engineering.
  • Proven track record of shipping high-quality products.

Job Details

About Scale

At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we’re accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our capabilities and offerings for both public and private evaluations.

About Data Engine

Our Generative AI Data Engine powers the world’s most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we are producing is some of the most important work for how humanity will interact with AI.

About our Quality team

Generating high-quality data is the core problem our business solves. Our Quality team focuses on building web-based applications that help measure our contributors' quality. As a Software Engineer on the team, you’ll focus on building systems that monitor and flag quality issues with large-scale data collections. You will invest in Benchmark testing, ML models, heuristics, and other evaluation strategies to measure contributors' quality on a variety of Gen AI tasks. 

Responsibilities:

  • Own large areas within our product
  • Build features end-to-end: front-end, back-end, system design, debugging and testing
  • Deliver experiments at a high velocity and level of quality to engage our customers
  • Work across the entire product lifecycle from conceptualization through production
  • Influence the culture, values, and processes of a growing engineering team
  • Inspire and mentor less experienced engineers
  • Collaborating with cross-functional teams to define, design, and ship new product features and experiences.

Requirements:

  • At least 5 years of relevant experience is preferred
  • Track record of shipping high-quality products and features at scale
  • Desire to work in a very fast-paced environment
  • Ability to turn business and product ideas into engineering solutions
  • Excellent problem-solving skills, and be able to work independently or as part of a team.
  • Excited to join a dynamic, hybrid team in either San Francisco or New York City



Similar Jobs

anydesk - Fullstack Developer

anydesk

Tbilisi, Tbilisi, Georgia (On-Site)
8 Hours ago
Infosys - .NET Fullstack Developer

Infosys

Guadalajara, Jalisco, Mexico (On-Site)
4 Hours ago
Vimeo - Software Engineer, AI

Vimeo

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago
Arcadia - Senior Engineering Manager - Python (RUDE squad)

Arcadia

Chennai, Tamil Nadu, India (Hybrid)
8 Hours ago
Varonis  - Backend Engineer

Varonis

Herzliya, Tel Aviv District, Israel (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Senior Software Engineer, Chrome Browser Infrastructure

Google

Mexico City, Mexico City, Mexico (On-Site)
2 Weeks ago
Hitachi - .Net full stack developer

Hitachi

Pune, Maharashtra, India (On-Site)
6 Months ago
Rocket Science - Producer (Technical Account Manager)

Rocket Science

Cardiff, Wales, United Kingdom (Hybrid)
1 Month ago
Velotio Technologies - Senior Engineer (ROR)

Velotio Technologies

Pune, Maharashtra, India (Remote)
1 Month ago
Vimeo - Software Engineer, AI

Vimeo

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Day ago
Axi - Full Stack Technical Lead

Axi

Bengaluru, Karnataka, India (On-Site)
23 Hours ago
Diligent - Senior Software Engineer - IOS

Diligent

Bengaluru, Karnataka, India (On-Site)
1 Day ago
Zones - Azure Backend Developer

Zones

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Workato - Senior Frontend Engineer

Workato

Barcelona, Catalonia, Spain (On-Site)
8 Hours ago
Google - Senior Software Engineer, Full Stack, Chrome Web Store

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

prizepicks - Head of Product Design

prizepicks

Atlanta, Georgia, United States (On-Site)
9 Hours ago
Niantic - Visual & Motion Designer (Short-term)

Niantic

Bellevue, Washington, United States (Hybrid)
2 Months ago
tic toe games - HR Specialist

tic toe games

Burbank, California, United States (On-Site)
1 Day ago
Meta - Data Engineer, Product Analytics

Meta

Los Angeles, California, United States (On-Site)
5 Months ago
Google - Senior Product Manager, GCP Identity and Infrastructure

Google

Kirkland, Washington, United States (On-Site)
2 Weeks ago
The Walt Disney Company - Principal Software Engineer - iOS

The Walt Disney Company

San Francisco, California, United States (Hybrid)
2 Weeks ago
Vercel - Privacy Program Manager

Vercel

San Francisco, California, United States (Hybrid)
9 Hours ago
Corsair - Influencer Manager

Corsair

Duluth, Georgia, United States (On-Site)
2 Weeks ago
Nagarro - Senior Staff Engineer - SAP FICO S/4Hana Solution Advisor

Nagarro

United States (Remote)
6 Months ago
Evolution - Card Inspector

Evolution

Atlantic City, New Jersey, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

Doha, Doha Municipality, Qatar (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug