Fullstack Software Engineer, GenAI Model Quality

3 Months ago • 3 Years + • Quality Assurance • $160,000 PA - $192,000 PA

Job Summary

Job Description

As a Fullstack Software Engineer on the Quality team, you will build web-based applications to measure the quality of data contributors. You will focus on systems that monitor and flag quality issues with large-scale data collections and will be involved in benchmark testing, ML models, and heuristics. The role involves owning large areas within the product, building features end-to-end, delivering experiments at a high velocity, and collaborating with cross-functional teams. This position offers the chance to influence the culture, values, and processes of a growing engineering team and mentor less experienced engineers. The work is crucial for the development of AI applications, particularly in generative AI and model evaluation.
Must have:
  • Shipping high-quality products and features at scale.
  • Ability to turn business and product ideas into engineering solutions.
  • Excellent problem-solving skills and ability to work independently or as part of a team.

Job Details

About Scale

At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we’re accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our capabilities and offerings for both public and private evaluations.

About Data Engine

Our Generative AI Data Engine powers the world’s most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we are producing is some of the most important work for how humanity will interact with AI.

About our Quality team

Generating high-quality data is the core problem our business solves. Our Quality team focuses on building web-based applications that help measure our contributors' quality. As a Software Engineer on the team, you’ll focus on building systems that monitor and flag quality issues with large-scale data collections. You will invest in Benchmark testing, ML models, heuristics, and other evaluation strategies to measure contributors' quality on a variety of Gen AI tasks. 

Responsibilities:

  • Own large areas within our product
  • Build features end-to-end: front-end, back-end, system design, debugging and testing
  • Deliver experiments at a high velocity and level of quality to engage our customers
  • Work across the entire product lifecycle from conceptualization through production
  • Influence the culture, values, and processes of a growing engineering team
  • Inspire and mentor less experienced engineers
  • Collaborating with cross-functional teams to define, design, and ship new product features and experiences.

Requirements:

  • At least 3 years of relevant experience is preferred
  • Track record of shipping high-quality products and features at scale
  • Desire to work in a very fast-paced environment
  • Ability to turn business and product ideas into engineering solutions
  • Excellent problem-solving skills, and be able to work independently or as part of a team.
  • Excited to join a dynamic, hybrid team in either San Francisco or New York City



Similar Jobs

Ubisoft - IT Production Manager

Ubisoft

Saint-Mandé, Île-de-France, France (Hybrid)
2 Months ago
Saviynt - Principal Engineer – SRE

Saviynt

Bengaluru, Karnataka, India (Hybrid)
1 Year ago
DevRev - Account Executive - APJ Partners & Alliance Leader

DevRev

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
Blazesoft - SEO Editor

Blazesoft

Vaughan, Ontario, Canada (On-Site)
3 Months ago
Globalization Partners - Senior Product Operations Manager

Globalization Partners

United States (Remote)
3 Months ago
NXP - 2024-2025 Intern Quality Engineer

NXP

Bangkok, Bangkok, Thailand (On-Site)
10 Months ago
Converse.AI - Sr QA Engineer

Converse.AI

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Spyke Games - QA Specialist (Disabled)

Spyke Games

İstanbul, Türkiye (On-Site)
9 Months ago
Amber - Localization Quality Assurance (German)

Amber

Montreal, Quebec, Canada (On-Site)
2 Months ago
Amber - Localization Quality Assurance (Brazilian Portuguese)

Amber

Quebec, Canada (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

CGS Carrers - Senior Java Software Engineer

CGS Carrers

Indonesia (Remote)
2 Months ago
miniclip - Senior Analytics Engineer

miniclip

Lisbon, Lisbon, Portugal (On-Site)
1 Month ago
LeoVegas - QA Engineer

LeoVegas

Newcastle Upon Tyne, England, United Kingdom (On-Site)
1 Month ago
Cadence - Senior DFT Engineer

Cadence

Bengaluru, Karnataka, India (On-Site)
10 Months ago
P99 soft - Data Engineer

P99 soft

Hyderabad, Telangana, India (On-Site)
3 Months ago
Glocomms - Security Software Engineer - Generative AI

Glocomms

New York, United States (Hybrid)
4 Weeks ago
ISG - Program Manager HCM

ISG

United States (Remote)
1 Month ago
Polygon Labs - APAC Growth Manager

Polygon Labs

Victoria, Australia (Remote)
4 Months ago
JMA - IT Help Desk Engineer

JMA

Bologna, Emilia-Romagna, Italy (On-Site)
2 Months ago
Progress - IT QA Engineer, Senior

Progress

Hyderabad, Telangana, India (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Axon - Order Management Analyst

Axon

Atlanta, Georgia, United States (On-Site)
4 Weeks ago
Pocket Worlds - Staff Full-Stack Engineer (Backend Leaning)

Pocket Worlds

United States (Remote)
4 Months ago
Rippling - Senior Staff Software Engineer

Rippling

San Francisco, California, United States (On-Site)
6 Months ago
Coherent corp. - Manufacturing Operator

Coherent corp.

Starkville, Mississippi, United States (On-Site)
1 Month ago
Roblox - Senior Avatar Animation Engineer

Roblox

San Mateo, California, United States (On-Site)
1 Month ago
Spruce Systems - Sr Software Engineer, Cross-Platform Rust

Spruce Systems

United States (Remote)
3 Months ago
Snap Mobile INC - Account Executive

Snap Mobile INC

Cincinnati, Ohio, United States (On-Site)
3 Months ago
Daybreak - Senior Publishing Producer

Daybreak

San Diego, California, United States (Remote)
3 Months ago
Next Level Business Services - Hadoop MapR Sr. Developer/ Technical Architect

Next Level Business Services

Groton, Connecticut, United States (On-Site)
9 Months ago
Coherent corp. - Global Strategic Account Manager

Coherent corp.

Santa Clara, California, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Quality Assurance Jobs

Winjit Technologies - Quality Assurance Engineer

Winjit Technologies

Nashik, Maharashtra, India (On-Site)
3 Months ago
Contentstack - Engineer II - QA

Contentstack

Pune, Maharashtra, India (On-Site)
2 Months ago
CME Group - Senior QA Analyst

CME Group

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
bounteous - QA Architect

bounteous

India (Hybrid)
4 Weeks ago
Spyke Games - QA Specialist (Disabled)

Spyke Games

İstanbul, Türkiye (On-Site)
9 Months ago
Nagarro - Senior QA Automation

Nagarro

(Remote)
3 Months ago
Feld Entertainment - QA/Compliance Administrator

Feld Entertainment

Jessup, Maryland, United States (On-Site)
5 Months ago
NVIDIA - Senior Hardware Validation Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
4 Months ago
Apple - Software Quality Engineer - Applied Networking

Apple

Cupertino, California, United States (On-Site)
3 Weeks ago
Fanatee - Quality Assurance Intern

Fanatee

São Paulo, State Of São Paulo, Brazil (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug