Lead Spreadsheet Quality Analyst

We’re looking for a sharp, experienced Lead Spreadsheet Quality Analyst to oversee the accuracy and consistency of our spreadsheet evaluation data for AI training. You’ll act as the quality gatekeeper for Excel-based annotation tasks, reviewing the work of Level 1 annotators, providing feedback, and maintaining strict programmatic verification (PV) standards that ensure our models learn from clean, unambiguous data. This role blends technical precision with people leadership. You’ll mentor reviewers, refine QC processes, and audit datasets that shape how AI agents reason through complex spreadsheet tasks. Note: This is a contract role with hours aligning to 10am-5pm PST.

Must Have

• Review, approve, or reject annotated spreadsheet tasks for programmatic verification (PV) compliance
• Provide detailed, actionable feedback to Level 1 annotators and help them improve their accuracy and speed
• Define, refine, and document quality control guidelines and edge-case examples
• Audit datasets for internal consistency and escalate structural or tooling issues to the product and research teams
• Maintain weekly throughput and quality targets while ensuring annotation teams meet benchmark standards
• 3+ years in QA, data operations, analytics, or data labeling
• Expert Excel user with formula auditing and debugging experience
• Familiar with quality frameworks or annotation pipelines
• Comfortable writing clear feedback and coaching others

Good to Have

• Familiarity with evaluation datasets or ML training data
• Experience in demanding, analytical environments (e.g., top consulting, finance, or accounting firms)
• Experience working in a startup environment

Perks & Benefits

• Bonuses based on high quality task completion
• Small, elite team of ex-founders, researchers from top AI Labs, top CS grads, and engineers from top companies
• True ownership: You will not be blocked by bureaucracy, shipping meaningful work within weeks rather than months
• Serious momentum: We're well-funded by top investors, moving fast, and focused on execution

About the Role

We’re looking for a sharp, experienced Lead Spreadsheet Quality Analyst to oversee the accuracy and consistency of our spreadsheet evaluation data for AI training.

You’ll act as the quality gatekeeper for Excel-based annotation tasks, reviewing the work of Level 1 annotators, providing feedback, and maintaining strict programmatic verification (PV) standards that ensure our models learn from clean, unambiguous data.

This role blends technical precision with people leadership. You’ll mentor reviewers, refine QC processes, and audit datasets that shape how AI agents reason through complex spreadsheet tasks.

Note: This is a contract role with hours aligning to 10am-5pm PST.

Responsibilities

• Review, approve, or reject annotated spreadsheet tasks for programmatic verification (PV) compliance
• Provide detailed, actionable feedback to Level 1 annotators and help them improve their accuracy and speed
• Define, refine, and document quality control guidelines and edge-case examples
• Audit datasets for internal consistency and escalate structural or tooling issues to the product and research teams
• Maintain weekly throughput and quality targets while ensuring annotation teams meet benchmark standards

Qualifications

• 3+ years in QA, data operations, analytics, or data labeling
• Expert Excel user with formula auditing and debugging experience
• Familiar with quality frameworks or annotation pipelines
• Comfortable writing clear feedback and coaching others

Bonus

• Familiarity with evaluation datasets or ML training data
• Experience in demanding, analytical environments (e.g., top consulting, finance, or accounting firms)
• Experience working in a startup environment

The Details

• Location: Remote!
• Compensation: $50 per hour + bonuses based on high quality task completion. Total expected compensation of $75 per hour
• Hours: 10am-5pm PST. Additional hours may be requested if needed

What makes us interesting

• Small, elite team of ex-founders, researchers from top AI Labs, top CS grads, and engineers from top companies
• True ownership You will not be blocked by bureaucracy, shipping meaningful work within weeks rather than months
• Serious momentum We're well-funded by top investors, moving fast, and focused on execution

What we do

• Ship consumer products powered by cutting-edge AI research, and
• Build infrastructure that facilitates research and product, and
• Innovate cutting-edge research that will open up new consumer product forms