Senior Fullstack Software Engineer, GenAI Model Quality

3 Months ago • 5 Years + • Quality Assurance • $188,000 PA - $225,600 PA

Job Summary

Job Description

As a Senior Fullstack Software Engineer, you will be responsible for building systems that monitor and flag quality issues with large-scale data collections. You will focus on web-based applications that measure our contributors' quality. The role involves building features end-to-end, designing systems, debugging, testing, and delivering experiments at high velocity. You will also be involved in the entire product lifecycle, collaborating with cross-functional teams, and mentoring less experienced engineers. This is a great opportunity to contribute to the development of AI applications and work with a team focused on generating high-quality data for the advancement of AI.
Must have:
  • At least 5 years of relevant experience
  • Track record of shipping high-quality products
  • Ability to turn business ideas into engineering solutions
  • Excellent problem-solving skills, ability to work independently or in a team

Job Details

About Scale

At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we’re accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our capabilities and offerings for both public and private evaluations.

About Data Engine

Our Generative AI Data Engine powers the world’s most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we are producing is some of the most important work for how humanity will interact with AI.

About our Quality team

Generating high-quality data is the core problem our business solves. Our Quality team focuses on building web-based applications that help measure our contributors' quality. As a Software Engineer on the team, you’ll focus on building systems that monitor and flag quality issues with large-scale data collections. You will invest in Benchmark testing, ML models, heuristics, and other evaluation strategies to measure contributors' quality on a variety of Gen AI tasks. 

Responsibilities:

  • Own large areas within our product
  • Build features end-to-end: front-end, back-end, system design, debugging and testing
  • Deliver experiments at a high velocity and level of quality to engage our customers
  • Work across the entire product lifecycle from conceptualization through production
  • Influence the culture, values, and processes of a growing engineering team
  • Inspire and mentor less experienced engineers
  • Collaborating with cross-functional teams to define, design, and ship new product features and experiences.

Requirements:

  • At least 5 years of relevant experience is preferred
  • Track record of shipping high-quality products and features at scale
  • Desire to work in a very fast-paced environment
  • Ability to turn business and product ideas into engineering solutions
  • Excellent problem-solving skills, and be able to work independently or as part of a team.
  • Excited to join a dynamic, hybrid team in either San Francisco or New York City



Similar Jobs

affinidi - Engineering Manager, Application Development

affinidi

Dublin, County Dublin, Ireland (On-Site)
1 Month ago
In The Pocket - BUSINESS DEVELOPER PUBLIC SECTOR

In The Pocket

Belgium (On-Site)
8 Months ago
extreme network - Staff Engineer – DevSecOps

extreme network

Ontario, Canada (Hybrid)
1 Month ago
rivos - Data Parallel Accelerator Post-Silicon Performance Lead

rivos

Santa Clara, California, United States (Hybrid)
1 Month ago
Accenture - Senior Manager

Accenture

Gurugram, Haryana, India (On-Site)
2 Months ago
Lionbridge Games - Test Lead

Lionbridge Games

Mexico City, Mexico City, Mexico (On-Site)
3 Months ago
Univision - Sr. QA Engineer

Univision

Bogota, Colombia (On-Site)
2 Months ago
Axon - QA Analyst

Axon

San Francisco, California, United States (On-Site)
4 Weeks ago
Amber - QA Project Manager

Amber

Manila, Metro Manila, Philippines (On-Site)
5 Months ago
Apple - Software Image Quality Engineer - Creativity Apps

Apple

Cupertino, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Toast - Principal Data Scientist - Credit Risk/Lending

Toast

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Qualcomm - GPU Formal Verification Engineer

Qualcomm

San Diego, California, United States (On-Site)
2 Months ago
JMA - IT Help Desk Engineer

JMA

Bologna, Emilia-Romagna, Italy (On-Site)
2 Months ago
Springer Group - Enterprise Architect

Springer Group

Berlin, Berlin, Germany (Remote)
2 Months ago
Alpha Sense - Senior Product Manager, AI Workflows

Alpha Sense

New York, United States (On-Site)
2 Months ago
Games 24x7 - Product Manager

Games 24x7

Bengaluru, Karnataka, India (On-Site)
1 Month ago
HYCU - Business Systems Operations Manager (Sales Operations)

HYCU

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Click Therapeutics - Business Development Director

Click Therapeutics

New York, United States (Hybrid)
2 Months ago
Zscaler - Principal Software Engineer

Zscaler

San Jose, California, United States (Hybrid)
4 Weeks ago
Fictiv - NetSuite Technical Lead

Fictiv

Pune, Maharashtra, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

dun bradstreet - Early Talent Network

dun bradstreet

Jacksonville, Florida, United States (On-Site)
9 Months ago
Rackspace Technology - Senior Data Architect - Big Data (AWS)

Rackspace Technology

Reston, Virginia, United States (Remote)
4 Months ago
lifechruh - Associate Operations Pastor

lifechruh

United States (On-Site)
9 Months ago
PayPal - Engineering Manager – Mobile

PayPal

San Jose, California, United States (Hybrid)
1 Month ago
UPF Industries  - General Labor

UPF Industries

Gilmer, Texas, United States (On-Site)
2 Months ago
Toast - Sales District Manager, Toast Retail

Toast

Richmond, Virginia, United States (Remote)
1 Month ago
Canva - Senior Sales Enablement Manager

Canva

Austin, Texas, United States (Remote)
1 Month ago
luxsoft - Big Data Engineer

luxsoft

Stamford, Connecticut, United States (On-Site)
3 Months ago
OKX - Product Compliance Lead

OKX

New York, United States (On-Site)
1 Month ago
Axon - Senior Manager, Revenue Accounting and Commercial Controllership

Axon

Denver, Colorado, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Quality Assurance Jobs

Bosch Group - Purchasing Quality Assurance Intern

Bosch Group

Maklár, Hungary (On-Site)
1 Month ago
Brillio - Salesforce QA Automation Lead (Tosca)

Brillio

St. Louis, Missouri, United States (Remote)
1 Month ago
BioFire - Validation Engineer

BioFire

Hazelwood, Missouri, United States (On-Site)
6 Months ago
Apple - Silicon Validation Engineer

Apple

Irvine, California, United States (On-Site)
2 Months ago
luxsoft - Regular QA Engineer

luxsoft

Ukrainka, Kyiv Oblast, Ukraine (Remote)
1 Month ago
Simcorp - Software Engineer - Reliability Engineer (Release Quality)

Simcorp

Noida, Uttar Pradesh, India (Hybrid)
2 Months ago
Playstation - QA Automation Engineer II

Playstation

Madison, Wisconsin, United States (On-Site)
2 Months ago
Thales - Automation Test Team Lead

Thales

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
cirrus logic - Supplier Quality Engineer

cirrus logic

Edinburgh, Scotland, United Kingdom (Hybrid)
4 Months ago
zoox - Feature Validation Engineer

zoox

Foster City, California, United States (On-Site)
1 Year ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug