Engineering Manager, Machine Learning

3 Months ago • All levels • $200,000 PA - $300,000 PA
Research Development

Job Description

Captions, a leading AI video company, is seeking an ML Engineering Lead to head a small, impactful team focused on deploying large-scale multimodal video diffusion models. Responsibilities include driving the technical vision for production deployment, overseeing ML pipelines for GPU-based inference and model optimization, adapting state-of-the-art generative models, and building/maintaining serving infrastructure for low-latency, high-throughput inference. The role also involves model optimization through techniques like quantization and pruning, implementing fine-tuning workflows, and managing production MLOps, performance, and scaling using CI/CD pipelines and monitoring tools. Experience with cutting-edge AI in audio-video generation and diffusion architectures is key to ensuring these innovations reach millions of creators.
Good To Have:
  • Experience with distributed training frameworks (FSDP, DeepSpeed, Megatron-LM) or HPC environments
Must Have:
  • Deploy deep learning models on GPU infrastructure (NVIDIA GPUs, CUDA, TensorRT)
  • Containerization (Docker, Kubernetes) and microservice architectures for ML serving
  • Proficiency in Python and PyTorch/TensorFlow
  • Experience with compression techniques for large models (quantization, pruning)
  • Profiling and optimizing model inference (batching, concurrency, hardware utilization)
  • ML pipeline orchestration (Airflow, Kubeflow, Argo) and CI/CD for ML
  • Logging, monitoring, and alerting tools (Prometheus, Grafana)
  • Familiarity with diffusion models or large-scale generative architectures
Perks:
  • Comprehensive medical, dental, and vision plans
  • 401K with employer match
  • Commuter Benefits
  • Catered lunch multiple days per week
  • Dinner stipend every night if working late
  • Doordash DashPass subscription
  • Health & Wellness Perks (Talkspace, Kindbody, One Medical subscription, HealthAdvocate, Teladoc)
  • Multiple team offsites per year with monthly team events
  • Generous PTO policy

Add these skills to join the top 1% applicants for this job

cuda
video-editing
model-serving
prometheus
grafana
model-deployment
pytorch
deep-learning
ci-cd
docker
kubernetes
python
tensorflow
machine-learning

Captions is the leading AI video company—our mission is to empower anyone, anywhere to tell their stories through video. Over 10 million creators and businesses have used Captions to simplify video creation with truly novel and groundbreaking AI capabilities.

We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. As an early member of our team, you’ll have an opportunity to have an outsized impact on our products and our company's culture.

Our Technology

Mirage Announcement our proprietary omni-modal foundation model

Seeing Voices (technical paper) generating A-roll video from audio with Mirage

Mirage Studio for generating expressive videos at scale

"Captions: For Talking Videos” available in the iOS app store

Press Coverage

Lenny’s Podcast: Interview with Gaurav Misra (CEO)

Latest Fundraise: Series C Announcement

The Information: 50 Most Promising Startups

Fast Company: Next Big Things in Tech

Business Insider: 34 most promising AI startups

TIME: The Best Inventions of 2024

Our Investors

We’re very fortunate to have some the best investors and entrepreneurs backing us, including Index Ventures, Kleiner Perkins, Sequoia Capital, Andreessen Horowitz, Uncommon Projects, Kevin Systrom, Mike Krieger, Lenny Rachitsky, Antoine Martin, Julie Zhuo, Ben Rubin, Jaren Glover, SVAngel, 20VC, Ludlow Ventures, Chapter One, and more.

** Please note that all of our roles will require you to be in-person at our NYC HQ (located in Union Square)

We do not work with third-party recruiting agencies, please do not contact us**

About the Role:
Captions is seeking an ML Engineering Lead to lead a small, high-impact team of ML engineers that bring large-scale multimodal video diffusion models into production. ML engineering is responsible for optimizing and deploying state-of-the-art generative models (tens to hundreds of billions of parameters) to deliver low-latency, high-throughput inference at scale. This is a unique opportunity to work on cutting-edge AI—spanning audio-video generation, diffusion architectures, and temporal modeling—and ensure these innovations reach millions of creators worldwide.

Responsibilities:

  • Technical Leadership

    • Drive the technical vision for deploying large-scale multimodal diffusion models (tens to hundreds of billions of parameters) in production.

    • Oversee and contribute to core ML pipelines—from GPU-based inference to model optimization.

      Collaborate with researchers to adapt state-of-the-art generative models for real-world performance and reliability.

  • Inference & Deployment

    • Develop high-performance GPU-based inference pipelines for large multimodal diffusion models.

    • Build, optimize, and maintain serving infrastructure to deliver low-latency predictions at large scale.

    • Collaborate with software engineering teams to containerize models, manage autoscaling, and ensure uptime SLAs.

  • Model Optimization & Fine-Tuning

    • Leverage techniques like quantization, pruning, and distillation to reduce latency and memory footprint without compromising quality.

    • Implement continuous fine-tuning workflows to adapt models based on real-world data and feedback.

  • Production MLOps, Performance, Scaling

    • Design and maintain automated CI/CD pipelines for model deployment, versioning, and rollback.

    • Implement robust monitoring (latency, throughput, concept drift) and alerting for critical production systems.

    • Explore cutting-edge GPU acceleration frameworks (e.g., TensorRT, Triton, TorchServe) to continuously improve throughput and reduce costs.

Requirements:

  • Technical Expertise

    • Proven experience deploying deep learning models on GPU-based infrastructure (NVIDIA GPUs, CUDA, TensorRT, etc.).

    • Strong knowledge of containerization (Docker, Kubernetes) and microservice architectures for ML model serving.

    • Proficiency with Python and at least one deep learning framework (PyTorch, TensorFlow).

  • Model Optimization

    • Familiarity with compression techniques (quantization, pruning, distillation) for large-scale models.

    • Experience profiling and optimizing model inference (batching, concurrency, hardware utilization).

  • Infrastructure

    • Hands-on experience with ML pipeline orchestration (Airflow, Kubeflow, Argo) and automated CI/CD for ML.

    • Strong grasp of logging, monitoring, and alerting tools (Prometheus, Grafana, etc.) in distributed systems.

  • Domain Experience

    • Exposure to diffusion models, multimodal video generation, or large-scale generative architectures.

    • Experience with distributed training frameworks (FSDP, DeepSpeed, Megatron-LM) or HPC environments.

Benefits:

  • Comprehensive medical, dental, and vision plans

  • 401K with employer match

  • Commuter Benefits

  • Catered lunch multiple days per week

  • Dinner stipend every night if you're working late and want a bite!

  • Doordash DashPass subscription

  • Health & Wellness Perks (Talkspace, Kindbody, One Medical subscription, HealthAdvocate, Teladoc)

  • Multiple team offsites per year with team events every month

  • Generous PTO policy

Captions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Please note benefits apply to full time employees only.

Set alerts for more jobs like Engineering Manager, Machine Learning
Set alerts for new jobs by Captions
Set alerts for new Research Development jobs in United States
Set alerts for new jobs in United States
Set alerts for Research Development (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙