Engineering Manager, Agent Data

3 Months ago • 5 Years + • Software Development & Engineering • $212,000 PA - $254,400 PA

Job Summary

Job Description

As an Engineering Manager, you will lead the team of engineers and collaborate with customers, internal ML researchers, and operators to define, build, and support data products for Agent Data. Your responsibilities include managing the engineering team, driving technical delivery, and ensuring high-quality product delivery, from conceptualization to production. You will build features end-to-end, influence team culture, and mentor less experienced engineers. The role involves working in a fast-paced environment, turning business ideas into engineering solutions, and demonstrating excellent problem-solving skills. The Agent Data team focuses on the entire lifecycle of human data input for agents, including data architecture, tooling development, operational scaling, performance evaluation, and testing environments.
Must have:
  • 5+ years of relevant experience; 2+ years of managing engineers preferred
  • Experience in Agent-related products or research
  • Proven track record of shipping high-quality products at scale
  • Ability to translate business and product ideas into engineering solutions
  • Excellent problem-solving skills and ability to work independently/as a team

Job Details

About Scale

At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we’re accelerating the development of AI modalities to pave the road to Artificial General Intelligence (AGI).

Our Generative AI Data Engine powers the world’s most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we are producing is some of the most important work for how humanity will interact with AI.

 

About the role:

You will work as part of our Frontier Data team to build data to enhance LLM agent capabilities. The team partners closely with leading-edge research and development efforts from AI labs to scale up human data in new agent environments.  Data products we currently support include agents focused on software engineering, computer use, and multiple-faceted tool use.

 

The Agent Data team supports the entire lifecycle of human data input for agents:

  • Initial data architecture, prototyping, and definition
  • Development of collection tooling, quality control, and management
  • Operational scaling across thousands of expert human data collectors
  • Performance evaluation frameworks to prove data efficacy
  • Testing environments and benchmarking

 

As  Engineering Manager, you will manage the team of engineers and work closely with our customers, internal ML researchers, and operators to define, build, and support these data products.

 

Responsibilities:

  • Manage the engineering team and drive technical delivery for Agents Data
  • Deliver experiments at a high velocity and level of quality to engage our customers
  • Work across the entire product lifecycle from conceptualization through production
  • Build features end-to-end: front-end, back-end, system design, debugging and testing
  • Influence the culture, values, and processes of a growing engineering team
  • Inspire and mentor less experienced engineers

Requirements:

  • At least 5 years of relevant experience and at least 2 years of experience managing engineers is preferred
  • Experience working on Agent-related products or research
  • Track record of shipping high-quality products and features at scale
  • Desire to work in a very fast-paced environment
  • Ability to turn business and product ideas into engineering solutions
  • Excellent problem-solving skills, and be able to work independently or as part of a team.
  • Excited to join a dynamic, hybrid team in either San Francisco or New York City



Similar Jobs

PwC - Senior Associate - Risk Performance, Governance and Controls (RPGC)

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
10 Months ago
Interactive Brokers - Platform Operations Engineer - Linux

Interactive Brokers

Zug, Zug, Switzerland (On-Site)
2 Months ago
Rocket - Associate Technical Support Engineer - NextGen

Rocket

Newbury, England, United Kingdom (Hybrid)
1 Month ago
GoTo Group - Area Operations Staff

GoTo Group

Palembang, South Sumatra, Indonesia (On-Site)
1 Month ago
Interactive Brokers - Senior Platform Engineer

Interactive Brokers

Fort Lauderdale, Florida, United States (Hybrid)
1 Month ago
Apple - Manufacturing Design Engineer (MDE) - Hardware Enclosures

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Capgemini - Lead Software Engineer SAP ABAP EWM

Capgemini

Pune, Maharashtra, India (On-Site)
1 Month ago
NVIDIA - Power Integrity Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
5 Months ago
PayPal - Sr Software Engineer

PayPal

Chicago, Illinois, United States (Hybrid)
1 Month ago
Apple - 5G/4G Cellular Layer1 Control Firmware Engineer

Apple

Sunnyvale, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Ion - Technical Consultant - Endur

Ion

Dallas, Texas, United States (On-Site)
9 Months ago
Toptracer - Embedded Software Engineer

Toptracer

Danderyd, Stockholm County, Sweden (Hybrid)
1 Month ago
Cadence - Software Engineer II

Cadence

Taipei City, Taiwan (On-Site)
1 Month ago
Capgemini - HYPERION ESSBASE PLANNING

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Yahoo - Senior Software Engineer

Yahoo

United States (Hybrid)
1 Month ago
Triple dot studios - Senior Product Manager

Triple dot studios

Australia (Hybrid)
6 Months ago
HEAL Software  Inc  - Engineer – QA (Manual)

HEAL Software Inc

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Nice - Senior Solution Architect

Nice

Southampton, England, United Kingdom (On-Site)
1 Month ago
Apple - Cellular 4G/5G Firmware Data & Automation Engineer

Apple

San Diego, California, United States (On-Site)
2 Months ago
Granicus - Commissions Analyst

Granicus

Costa Rica (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Epic Games - Senior Gameplay Systems Developer, Developer Relations

Epic Games

Cary, North Carolina, United States (On-Site)
7 Months ago
Ziff Davis - Strategic Account Manager

Ziff Davis

United States (Remote)
1 Month ago
Roblox - Principal Engineer, User Safety

Roblox

San Mateo, California, United States (On-Site)
1 Month ago
warner bros games - Lead Environment Artist

warner bros games

Chicago, Illinois, United States (Hybrid)
3 Months ago
Illumina - Staff Automation Engineer

Illumina

Foster City, California, United States (On-Site)
1 Month ago
Toast - Retail Account Executive

Toast

Elizabeth, New Jersey, United States (Hybrid)
1 Month ago
Apple - Machine Learning Engineer -- Backend/Data Engineer: Agentic Workflows

Apple

Sunnyvale, California, United States (On-Site)
3 Months ago
Google - Senior Analytical Lead, Large Customer Sales

Google

New York, New York, United States (On-Site)
3 Months ago
Apple - Software Development Engineer

Apple

New York, New York, United States (On-Site)
1 Month ago
Philips - Senior/Staff Digital Electrical Engineer – FPGA for Medical Devices

Philips

San Diego, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Software Development & Engineering Jobs

ALTEN - Stage Innovation: Logistics Engineer

ALTEN

Toulouse, Occitanie, France (On-Site)
1 Month ago
Nordson Corporation - Supervisor, Electrical Engineering (Electric & Controls)

Nordson Corporation

Amherst, Ohio, United States (On-Site)
3 Months ago
Notion - Head of Solutions Engineering, EMEA

Notion

Dublin, County Dublin, Ireland (On-Site)
1 Month ago
Riot Games - Senior Software Engineer, TechOps - League of Legends

Riot Games

Los Angeles, California, United States (Hybrid)
2 Months ago
Single Store - Lead Value Engineering

Single Store

San Francisco, California, United States (Remote)
3 Months ago
Apple - Software Development Engineer - Applications

Apple

San Diego, California, United States (On-Site)
2 Months ago
Qualcomm - Sr Staff or Principal Thermal Engineer, Server Packaging

Qualcomm

San Diego, California, United States (On-Site)
2 Months ago
Google - Software Engineer (For Women in Tech Candidates)

Google

State Of Minas Gerais, Brazil (On-Site)
7 Months ago
Power Integrations - Equipment Engineer

Power Integrations

Penang, Malaysia (On-Site)
3 Months ago
ALTEN - Composite Calculation Engineer

ALTEN

Toulouse, Occitanie, France (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Scale AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug