Engineering Manager, AI Quality

5 Minutes ago • All levels • $297,000 PA - $390,000 PA
Research Development

Job Description

At Harvey, we're transforming legal and professional services with frontier agentic AI. This role drives overall AI & results quality across all Harvey's products, including establishing evaluation processes, building reusable AI blocks, and collaborating with product teams to continuously improve AI outputs. You will build tools, processes, and foster a culture of scientific experimentation and iterative improvements to ensure accurate, specific, verifiable, and personalized results for our 700+ customers.
Must Have:
  • Establish an AI & Results Quality Program at Harvey
  • Build out core AI quality building blocks
  • Own search & retrieval quality for AI applications and other use cases
  • Work closely with product engineering to continuously improve AI & search products
  • Work closely with platform engineering to scale capabilities
  • Significant industry experience leading AI or related quality efforts
  • Excellent software engineering skills
  • Excellent communication skills
  • Ability to build team, processes, and technology from the ground up
  • Strong academic or professional background in Machine Learning, Generative AI, or Information Retrieval
Perks:
  • Offers Equity
  • Offers Bonus
  • Comprehensive health, dental and vision coverage
  • Retirement benefits (401k match up to 4%)
  • Flexible PTO

Add these skills to join the top 1% applicants for this job

communication
game-texts
machine-learning

Engineering Manager, AI Quality

Location

San Francisco, New York

Employment Type

Full time

Location Type

Hybrid

Department

Engineering

Compensation

  • $297K – $390K • Offers Equity • Offers Bonus

Additionally, this role is eligible to participate in our equity plan and benefits program. Benefits include, but not limited to: Comprehensive health, dental and vision coverage, retirement benefits (401k match up to 4%), and flexible PTO.

Why Harvey

At Harvey, we’re transforming how legal and professional services operate — not incrementally, but end-to-end. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.

This is a rare chance to help build a generational company at a true inflection point. With 700+ customers in 58+ countries, strong product-market fit, and world-class investor support, we’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.

Our team is sharp, motivated, and deeply committed to the mission. We move fast, operate with intensity, and take real ownership of the problems we tackle — from early thinking to long-term outcomes. We stay close to our customers — from leadership to engineers — and work together to solve real problems with urgency and care. If you thrive in ambiguity, push for excellence, and want to help shape the future of work alongside others who raise the bar, we invite you to build with us.

At Harvey, the future of professional services is being written today — and we’re just getting started.

Role Overview

The quality of Harvey’s AI & Search systems is of critical importance. Our customers expect us to produce accurate, specific, verifiable and personalized results across all of our product surfaces. They also expect the quality of our answers to continuously get benchmarked and improved.

In this role, you will drive overall AI & results quality across all of Harvey’s products (Assistant, Harvey Word, Vault, Workflows & Agents, and net new products). This includes establishing the right evaluation processes and tools, creating and evangelizing reusable AI building blocks, and working closely with all product teams to continuously improve the quality of Harvey’s AI outputs. You will be responsible for building out tools and processes and for establishing a strong culture of scientific experimentation, rigorous evaluation, and iterative improvements.

What You'll Do

  • Establish an AI & Results Quality Program at Harvey: Establish offline and online eval processes and tools, and a culture of continuous iteration and experimentation.
  • Build out core AI quality building blocks that can be reused across different teams and surface areas.
  • Own search & retrieval quality, both for AI applications as well as other use cases.
  • Work closely with product engineering to continuously improve the quality and capabilities of our AI & search products.
  • Work closely with platform engineering to scale our capabilities.

What You Have

  • Significant industry experience leading AI or other related quality efforts (search or ads ranking systems, recommender systems, etc) at industry-leading companies.
  • Excellent software engineering skills; experience working in teams that built and operated production systems
  • Excellent communication skills, both written and verbal.
  • Ability to roll up your sleeves and build team, processes, and technology from the ground up.
  • A strong academic or professional background in Machine Learning, Generative AI, Information Retrieval or other related fields.

Compensation Range

$297,000 - $390,000 USD

Please find our CA applicant privacy notice here

**.

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing accommodations@harvey.ai

Compensation Range: $297K - $390K

Set alerts for more jobs like Engineering Manager, AI Quality
Set alerts for new jobs by Harvey
Set alerts for new Research Development jobs in United States
Set alerts for new jobs in United States
Set alerts for Research Development (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙