Member of Technical Staff, ML Engineer

1 Month ago • All levels • Research Development

Job Summary

Job Description

Captions is seeking a Machine Learning Engineer to deploy large-scale multimodal video diffusion models into production. Responsibilities include optimizing and deploying state-of-the-art generative models for low-latency, high-throughput inference at scale. This involves developing GPU-based inference pipelines, building and optimizing serving infrastructure, and collaborating with DevOps. The role also includes model optimization using techniques like quantization and distillation, implementing fine-tuning workflows, and designing CI/CD pipelines for model deployment, versioning, and monitoring. Experience with GPU acceleration frameworks, containerization, and MLOps is essential for this cutting-edge AI role.
Must have:
  • Deploy deep learning models on GPU infrastructure
  • Containerization (Docker, Kubernetes)
  • Proficiency in Python and PyTorch/TensorFlow
  • Model compression techniques (quantization, pruning)
  • CI/CD for ML and monitoring tools
Good to have:
  • Exposure to diffusion models
  • Experience with distributed training frameworks
  • Large-scale generative architectures
Perks:
  • Comprehensive medical, dental, and vision plans
  • 401K with employer match
  • Commuter Benefits
  • Catered lunch
  • Dinner stipend
  • Doordash DashPass subscription
  • Health & Wellness Perks
  • Team offsites and events
  • Generous PTO policy

Job Details

Captions is the leading AI video company—our mission is to empower anyone, anywhere to tell their stories through video. Over 10 million creators and businesses have used Captions to simplify video creation with truly novel and groundbreaking AI capabilities.

We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. As an early member of our team, you’ll have an opportunity to have an outsized impact on our products and our company's culture.

Our Technology

Mirage Announcement our proprietary omni-modal foundation model

Seeing Voices (technical paper) generating A-roll video from audio with Mirage

Mirage Studio for generating expressive videos at scale

"Captions: For Talking Videos” available in the iOS app store

Press Coverage

Lenny’s Podcast: Interview with Gaurav Misra (CEO)

Latest Fundraise: Series C Announcement

The Information: 50 Most Promising Startups

Fast Company: Next Big Things in Tech

Business Insider: 34 most promising AI startups

TIME: The Best Inventions of 2024

Our Investors

We’re very fortunate to have some the best investors and entrepreneurs backing us, including Index Ventures, Kleiner Perkins, Sequoia Capital, Andreessen Horowitz, Uncommon Projects, Kevin Systrom, Mike Krieger, Lenny Rachitsky, Antoine Martin, Julie Zhuo, Ben Rubin, Jaren Glover, SVAngel, 20VC, Ludlow Ventures, Chapter One, and more.

** Please note that all of our roles will require you to be in-person at our NYC HQ (located in Union Square)

We do not work with third-party recruiting agencies, please do not contact us**

About the role:
Captions is seeking a Machine Learning Engineer to partner closely with our Researchers and bring large-scale multimodal video diffusion models into production. You’ll be responsible for optimizing and deploying state-of-the-art generative models (tens to hundreds of billions of parameters) to deliver low-latency, high-throughput inference at scale. This is a unique opportunity to work on cutting-edge AI—spanning audio-video generation, diffusion architectures, and temporal modeling—and ensure these innovations reach millions of creators worldwide.

Responsibilities:

  • Inference & Deployment

    • Develop high-performance GPU-based inference pipelines for large multimodal diffusion models.

    • Build, optimize, and maintain serving infrastructure to deliver low-latency predictions at large scale.

    • Collaborate with DevOps teams to containerize models, manage autoscaling, and ensure uptime SLAs.

  • Model Optimization & Fine-Tuning

    • Leverage techniques like quantization, pruning, and distillation to reduce latency and memory footprint without compromising quality.

    • Implement continuous fine-tuning workflows to adapt models based on real-world data and feedback.

  • Production MLOps

    • Design and maintain automated CI/CD pipelines for model deployment, versioning, and rollback.

    • Implement robust monitoring (latency, throughput, concept drift) and alerting for critical production systems.

  • Performance & Scaling

    • Explore cutting-edge GPU acceleration frameworks (e.g., TensorRT, Triton, TorchServe) to continuously improve throughput and reduce costs.

Requirements:

  • Technical Expertise

    • Proven experience deploying deep learning models on GPU-based infrastructure (NVIDIA GPUs, CUDA, TensorRT, etc.).

    • Strong knowledge of containerization (Docker, Kubernetes) and microservice architectures for ML model serving.

    • Proficiency with Python and at least one deep learning framework (PyTorch, TensorFlow).

  • Model Optimization

    • Familiarity with compression techniques (quantization, pruning, distillation) for large-scale models.

    • Experience profiling and optimizing model inference (batching, concurrency, hardware utilization).

  • Infrastructure

    • Hands-on experience with ML pipeline orchestration (Airflow, Kubeflow, Argo) and automated CI/CD for ML.

    • Strong grasp of logging, monitoring, and alerting tools (Prometheus, Grafana, etc.) in distributed systems.

  • Domain Experience

    • Exposure to diffusion models, multimodal video generation, or large-scale generative architectures.

    • Experience with distributed training frameworks (FSDP, DeepSpeed, Megatron-LM) or HPC environments.

Benefits:

  • Comprehensive medical, dental, and vision plans

  • 401K with employer match

  • Commuter Benefits

  • Catered lunch multiple days per week

  • Dinner stipend every night if you're working late and want a bite!

  • Doordash DashPass subscription

  • Health & Wellness Perks (Talkspace, Kindbody, One Medical subscription, HealthAdvocate, Teladoc)

  • Multiple team offsites per year with team events every month

  • Generous PTO policy

Captions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Please note benefits apply to full time employees only.

Similar Jobs

Eqvilent - Quant Developer

Eqvilent

(Remote)
2 Months ago
krea.ai - AI/ML Inference Engineer

krea.ai

San Francisco, California, United States (On-Site)
3 Months ago
Runway - Member of Technical Staff, Applied Research

Runway

United States (Remote)
3 Weeks ago
NVIDIA - Developer Technology Engineer - HPC and AI

NVIDIA

Taipei City, Taiwan (On-Site)
3 Months ago
NVIDIA - Senior DevOps Engineer, Deep Learning Frameworks

NVIDIA

Warsaw, Masovian Voivodeship, Poland (On-Site)
6 Months ago
Ansys - Senior R&D Engineer (C++, Qt)

Ansys

Athens, Greece (Hybrid)
2 Months ago
Doola - AI Engineering Manager

Doola

Bengaluru, Karnataka, India (Remote)
1 Month ago
CyberArk - Dev AI Transformation Lead

CyberArk

Israel (Hybrid)
2 Months ago
Apple - Machine Learning Engineer, Large Visual Generative Model Optimization

Apple

Seattle, Washington, United States (On-Site)
2 Months ago
Rocket studio - AI (Intern)

Rocket studio

Hanoi, Hanoi, Vietnam (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Abridge - AI Infrastructure Engineer

Abridge

San Francisco, California, United States (Hybrid)
1 Week ago
Captions - Member of Technical Staff, Large Generative Models

Captions

New York, United States (On-Site)
1 Month ago
Open Systems Technologies - Principal Engineer, System Architect

Open Systems Technologies

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Perplexity - AI Inference Engineer

Perplexity

London, England, United Kingdom (On-Site)
2 Months ago
Captions - Engineering Manager, Machine Learning

Captions

New York, United States (On-Site)
1 Month ago
Hawkeye Innovations - Senior Computer Vision Engineer

Hawkeye Innovations

Budapest, Hungary (Hybrid)
4 Months ago
Runway - Member of Technical Staff, Machine Learning Optimization

Runway

United States (Remote)
3 Weeks ago
Blitz app - Senior Software Engineer (C++)

Blitz app

India (Remote)
4 Months ago
bytedance - Tech Lead, Research Scientist, Cloud & AI computing - DPU/GPU/CPU

bytedance

San Jose, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New York, United States

Blinkhealth - Principal Product Manager

Blinkhealth

Pittsburgh, Pennsylvania, United States (On-Site)
2 Months ago
bytedance - Multimodal AI Algorithm Expert-EMG / Interaction Perception

bytedance

San Jose, California, United States (On-Site)
2 Months ago
Exploding Kittens - Senior Staff Accountant

Exploding Kittens

Los Angeles, California, United States (On-Site)
1 Month ago
AeroSpike - Sales Engineer

AeroSpike

United States (Remote)
1 Month ago
rivos - Memory Subsystem Architecture and Performance Modeling

rivos

Santa Clara, California, United States (Hybrid)
5 Months ago
Penumbrainc - Facilities HVAC Tech I

Penumbrainc

Alameda, California, United States (On-Site)
9 Months ago
Zinnia - Solution Architect

Zinnia

Bridgewater, New Jersey, United States (Hybrid)
1 Month ago
rivos - Silicon Logic Formal Verification

rivos

Fort Collins, Colorado, United States (Hybrid)
1 Year ago
midoki - Principal Sound Designer

midoki

Rockville, Maryland, United States (On-Site)
2 Months ago
Rippling - Senior Software Engineer, Identity Platform

Rippling

San Francisco, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Game freak - R&D Programmer: System

Game freak

Chiyoda City, Tokyo, Japan (On-Site)
2 Months ago
QuinStreet - Applied Machine Learning Engineer

QuinStreet

Monterrey, Nuevo Leon, Mexico (Remote)
3 Months ago
Single Store - AI & Automation Analyst

Single Store

Pune, Maharashtra, India (On-Site)
3 Weeks ago
Ion - Software/Artificial Intelligence Engineer - Graduate Development Program

Ion

Pisa, Tuscany, Italy (Hybrid)
6 Months ago
ElevenLabs - AI Safety Operations

ElevenLabs

United Kingdom (Remote)
4 Months ago
Apple - AIML - Senior Engineering Program Manager, ML Compute Infrastructure

Apple

Seattle, Washington, United States (On-Site)
2 Weeks ago
Mashgin - Senior Software Engineer, Machine Learning and Artificial Intelligence

Mashgin

Palo Alto, California, United States (Hybrid)
9 Months ago
Keywords International - Senior Research Associate - AI

Keywords International

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Apple - ML Lead | Acoustics

Apple

Cupertino, California, United States (On-Site)
2 Months ago
Ubisoft - Lead R&D Scientist

Ubisoft

Shanghai, Shanghai, China (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Captions is the leading video AI company, building the future of video creation. Over 10 million creators and businesses have used Captions to create videos for social media, marketing, sales, and more. We're on a mission to serve the next billion. We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. You'll join an early team and have an outsized impact on the product and the company's culture.

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Captions

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug