Member of Technical Staff, Training Data Infrastructure

4 Months ago • 3 Years + • Software Development & Engineering • $175,000 PA - $275,000 PA

Job Summary

Job Description

Captions, a leading AI video company, is seeking an exceptional Research Engineer (MOTS) to join their NYC-based team. The role focuses on driving innovation in training data infrastructure by researching and developing sophisticated distributed training workflows and optimized data processing systems for massive video and multimodal datasets. Responsibilities include building performant pipelines, designing scalable distributed systems, creating efficient data loading systems, and implementing telemetry. The engineer will also develop core systems for data processing, validation, versioning, and storage, alongside optimizing training pipelines and enabling rapid research iteration. This position offers the opportunity to build foundational systems directly impacting the company's ability to train models for video and multimodal creation, with a culture that highly values infrastructure and data work.
Must have:
  • Bachelor's or Master's degree in Computer Science or related field
  • 3+ years experience in ML infrastructure or data engineering
  • Strong Python and distributed computing skills
  • Expertise in high-throughput data pipelines
  • Experience with video/image data pre-processing
  • Knowledge of ML workflows and data loading systems
Good to have:
  • Track record in performance optimization and system scaling
  • Experience with cluster management
  • Background in MLOps and infrastructure monitoring
  • Ability to build reliable, large-scale data processing systems
  • Passion for tackling hard technical problems
  • Ownership and collaboration skills
  • Enthusiasm for improving system performance
  • Desire to work with passionate researchers and engineers
Perks:
  • Comprehensive medical, dental, and vision plans
  • 401K with employer match
  • Commuter Benefits
  • Catered lunch multiple days per week
  • Dinner stipend for working late
  • Doordash DashPass subscription
  • Health & Wellness Perks (Talkspace, Kindbody, One Medical, HealthAdvocate, Teladoc)
  • Multiple team offsites and monthly team events
  • Generous PTO policy

Job Details

Captions is the leading AI video company—our mission is to empower anyone, anywhere to tell their stories through video. Over 10 million creators and businesses have used Captions to simplify video creation with truly novel and groundbreaking AI capabilities.

We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. As an early member of our team, you’ll have an opportunity to have an outsized impact on our products and our company's culture.

Our Technology

Mirage Announcement our proprietary omni-modal foundation model

Seeing Voices (technical paper) generating A-roll video from audio with Mirage

Mirage Studio for generating expressive videos at scale

"Captions: For Talking Videos” available in the iOS app store

Press Coverage

Lenny’s Podcast: Interview with Gaurav Misra (CEO)

Latest Fundraise: Series C Announcement

The Information: 50 Most Promising Startups

Fast Company: Next Big Things in Tech

Business Insider: 34 most promising AI startups

TIME: The Best Inventions of 2024

Our Investors

We’re very fortunate to have some the best investors and entrepreneurs backing us, including Index Ventures, Kleiner Perkins, Sequoia Capital, Andreessen Horowitz, Uncommon Projects, Kevin Systrom, Mike Krieger, Lenny Rachitsky, Antoine Martin, Julie Zhuo, Ben Rubin, Jaren Glover, SVAngel, 20VC, Ludlow Ventures, Chapter One, and more.

** Please note that all of our roles will require you to be in-person at our NYC HQ (located in Union Square)

We do not work with third-party recruiting agencies, please do not contact us**

About the Role and Team:

Captions seeks an exceptional Research Engineer (MOTS) to drive innovation in training data infrastructure. You'll conduct research on and develop sophisticated distributed training workflows and optimized data processing systems for massive video and multimodal datasets. Beyond pure performance, you'll develop deep insight into our data to maximize training effectiveness. As an early member of our ML Research team, you'll build foundational systems that directly impact our ability to train models powering video and multimodal creation for millions of users.

You'll work directly alongside our research and engineering teams in our NYC office. We've intentionally built a culture where infrastructure and data work is highly valued - your success will be measured by the reliability and performance of our systems, not by your ability to navigate politics. We're a team that loves diving deep into technical problems and emerging with practical solutions.

Our team values:

  • Quick iteration and practical solutions.

  • Open discussion of technical approaches.

  • Direct access to decision makers.

  • Regular sharing of learnings, results, and iterative work.

Key Responsibilities:

Infrastructure Development:

  • Build performant pipelines for processing video and multimodal training data at scale.

  • Design distributed systems that scale seamlessly with our rapidly growing video and multimodal datasets.

  • Create efficient data loading systems optimized for GPU training throughput.

  • Implement comprehensive telemetry for video processing and training pipelines.

Core Systems Development:

  • Create foundation data processing systems that intelligently cache and reuse expensive computations across the training pipeline.

  • Build robust data validation and quality measurement systems for video and multimodal content.

  • Design systems for data versioning and reproducing complex multimodal training runs.

  • Develop efficient storage and compute patterns for high-dimensional data and learned representations.

System Optimization:

  • Own and improve end-to-end training pipeline performance.

  • Build systems for efficient storage and retrieval of video training data.

  • Build frameworks for systematic data and model quality improvement.

  • Develop infrastructure supporting fast research iteration cycles.

  • Build tools and systems for deep understanding of our training data characteristics.

Research & Product Impact:

  • Build infrastructure enabling rapid testing of research hypotheses.

  • Create systems for incorporating user feedback into training workflows.

  • Design measurement frameworks that connect model improvements to user outcomes.

  • Enable systematic experimentation with direct user feedback loops.

Requirements:

Technical Background:

  • Bachelor's or Master's degree in Computer Science, Machine Learning, or related field.

  • 3+ years experience in ML infrastructure development or large-scale data engineering.

  • Strong programming skills, particularly in Python and distributed computing frameworks.

  • Expertise in building and optimizing high-throughput data pipelines.

  • Proven experience with video/image data pre-processing and feature engineering.

  • Deep knowledge of machine learning workflows, including model training and data loading systems.

System Development:

  • Track record in performance optimization and system scaling.

  • Experience with cluster management and distributed computing.

  • Background in MLOps and infrastructure monitoring.

  • Demonstrated ability to build reliable, large-scale data processing systems.

Engineering Approach:

  • Love tackling hard technical problems head-on.

  • Take ownership while knowing when to loop in teammates.

  • Get excited about improving system performance.

  • Want to work directly with researchers and engineers who are equally passionate about building great systems.

Benefits:

  • Comprehensive medical, dental, and vision plans

  • 401K with employer match

  • Commuter Benefits

  • Catered lunch multiple days per week

  • Dinner stipend every night if you're working late and want a bite!

  • Doordash DashPass subscription

  • Health & Wellness Perks (Talkspace, Kindbody, One Medical subscription, HealthAdvocate, Teladoc)

  • Multiple team offsites per year with team events every month

  • Generous PTO policy

Captions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Please note benefits apply to full time employees only.

Similar Jobs

Sporty - AI Video Specialist

Sporty

Madrid, Community Of Madrid, Spain (Hybrid)
1 Month ago
Captions - Engineering Manager, Machine Learning

Captions

New York, United States (On-Site)
1 Month ago
Exient - Marketing Artist

Exient

Floriana, Malta (Hybrid)
1 Month ago
Synthesia - Digital Customer Success Manager

Synthesia

London, England, United Kingdom (On-Site)
2 Weeks ago
Tamatem - 6 Months Internship - Motion Designer

Tamatem

Abu Dhabi, Abu Dhabi, United Arab Emirates (Hybrid)
3 Months ago
Philips - Field Service Engineer - Graduate (Al Khobar)

Philips

Al Khobar, Eastern Province, Saudi Arabia (On-Site)
1 Week ago
Silicon Labs - DFT Engineer

Silicon Labs

Austin, Texas, United States (On-Site)
1 Year ago
Guardian - Senior Lead Engineer

Guardian

Gurugram, Haryana, India (On-Site)
2 Months ago
Clearwater Analytics - Software Engineering Director - Fintech

Clearwater Analytics

New York, United States (On-Site)
1 Week ago
Adyen - Engineering Manager (Team Lead) - Cards

Adyen

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Synthesia - Technical Associate to the CTO

Synthesia

London, England, United Kingdom (On-Site)
2 Weeks ago
Electronic Arts - Age Ratings Associate Manager

Electronic Arts

Bucharest, Bucharest, Romania (Hybrid)
2 Months ago
bytedance - Research Scientist, Applied GAI-Vision

bytedance

San Jose, California, United States (On-Site)
9 Months ago
Snyk - Manager, Social Media

Snyk

Boston, Massachusetts, United States (On-Site)
3 Weeks ago
Canva - AI Research Lead - Video & Audio Generation

Canva

Adelaide, South Australia, Australia (Remote)
1 Month ago
Vigaet - Unreal Engine Cinematic Artist

Vigaet

(On-Site)
1 Year ago
bytedance - Site Reliability Engineer - CapCut - San Jose/Seattle

bytedance

San Jose, California, United States (On-Site)
9 Months ago
[x]cube LABS - Marketing Strategist

[x]cube LABS

Hyderabad, Telangana, India (On-Site)
1 Month ago
On Location - Art Director, Environmental - FIFA World Cup 26™

On Location

New York, New York, United States (On-Site)
3 Months ago
Captions - Principal Software Engineer

Captions

New York, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in New York, United States

Philips - Cardiac Wireless Monitoring Technician II

Philips

Hamilton, New Jersey, United States (On-Site)
1 Month ago
Qualcomm - GPU Formal Verification Engineer

Qualcomm

San Diego, California, United States (On-Site)
2 Months ago
Plug power - Field Service Technician

Plug power

McCook, Illinois, United States (On-Site)
3 Months ago
Nintendo - Systems Engineer (Cloud/Linux)

Nintendo

Redmond, Washington, United States (Hybrid)
8 Months ago
2K - Product Manager

2K

Austin, Texas, United States (On-Site)
3 Months ago
Epic Games - Senior Technical Product Manager, UE Rendering

Epic Games

Cary, North Carolina, United States (On-Site)
4 Months ago
Redhorse Corp - Mid-Level Data Engineer

Redhorse Corp

Falls Church, Virginia, United States (On-Site)
1 Month ago
Alten Technology - Commissioning Manager

Alten Technology

Richmond, Virginia, United States (On-Site)
3 Weeks ago
Temporal Technologies - Staff Software Engineer, Cloud Identity

Temporal Technologies

United States (Remote)
1 Month ago
Epic Games - UX Designer

Epic Games

Cary, North Carolina, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Software Development & Engineering Jobs

Qualcomm - CPU Physical Design Engineer, Senior/Staff/Sr Staff

Qualcomm

Cork, County Cork, Ireland (On-Site)
1 Month ago
The Walt Disney Company - Senior Software Engineer - Activation

The Walt Disney Company

Santa Monica, California, United States (On-Site)
3 Months ago
Alten Technology - Senior Electrical Engineer

Alten Technology

Houston, Texas, United States (On-Site)
1 Month ago
InnoPhase IoT - Principal Engineer, RFIC Design

InnoPhase IoT

San Diego, California, United States (Hybrid)
3 Months ago
Qualcomm - CPU Server Physical Design Engineer

Qualcomm

Santa Clara, California, United States (On-Site)
2 Months ago
PwC - SAP Consultant

PwC

Makati City, Metro Manila, Philippines (On-Site)
7 Months ago
Stord - Continuous Improvement Engineer I

Stord

Las Vegas, Nevada, United States (On-Site)
2 Weeks ago
The E.W. Scripps Company - Microsoft 365 Engineer

The E.W. Scripps Company

Cincinnati, Ohio, United States (Hybrid)
2 Weeks ago
Qualcomm - WIFI PHY - Design Verification -Sr Lead Engineer

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Optiv - Principal Engineer-Splunk and SIEM

Optiv

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Captions is the leading video AI company, building the future of video creation. Over 10 million creators and businesses have used Captions to create videos for social media, marketing, sales, and more. We're on a mission to serve the next billion. We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. You'll join an early team and have an outsized impact on the product and the company's culture.

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Captions

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug