Member of Technical Staff, GPU Optimization

1 Month ago • 3 Years + • Software Development & Engineering • $175,000 PA - $275,000 PA

Job Summary

Job Description

Captions is seeking a Member of Technical Staff specializing in GPU Optimization. This role involves optimizing AI model training and inference pipelines for speed and efficiency on NVIDIA GPUs. Responsibilities include designing and implementing CUDA/Triton kernels, integrating low-level optimizations into PyTorch, profiling and debugging performance issues, and collaborating with research teams to ensure hardware-friendly model architectures. The ideal candidate will have a deep understanding of GPU architecture and strong Python skills, with experience in performance optimization of large-scale machine learning workloads. This is an opportunity to significantly impact the company's cutting-edge AI video technology.
Must have:
  • 3+ years of experience writing and optimizing CUDA kernels
  • Deep understanding of GPU architecture
  • Strong Python skills and PyTorch familiarity
  • Proven track record profiling and accelerating ML jobs
  • Comfortable working in Linux environments
Good to have:
  • Advanced degree (MS/PhD)
  • Experience with multi-modal AI systems
  • Familiarity with distributed training frameworks
  • Knowledge of compiler optimization techniques
  • Experience with cloud infrastructure
Perks:
  • Comprehensive medical, dental, and vision plans
  • 401K with employer match
  • Commuter Benefits
  • Catered lunch
  • Dinner stipend
  • Doordash DashPass subscription
  • Health & Wellness Perks
  • Team offsites and events
  • Generous PTO policy

Job Details

Captions is the leading AI video company—our mission is to empower anyone, anywhere to tell their stories through video. Over 10 million creators and businesses have used Captions to simplify video creation with truly novel and groundbreaking AI capabilities.

We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. As an early member of our team, you’ll have an opportunity to have an outsized impact on our products and our company's culture.

Our Technology

Mirage Announcement our proprietary omni-modal foundation model

Seeing Voices (technical paper) generating A-roll video from audio with Mirage

Mirage Studio for generating expressive videos at scale

"Captions: For Talking Videos” available in the iOS app store

Press Coverage

Lenny’s Podcast: Interview with Gaurav Misra (CEO)

Latest Fundraise: Series C Announcement

The Information: 50 Most Promising Startups

Fast Company: Next Big Things in Tech

Business Insider: 34 most promising AI startups

TIME: The Best Inventions of 2024

Our Investors

We’re very fortunate to have some the best investors and entrepreneurs backing us, including Index Ventures, Kleiner Perkins, Sequoia Capital, Andreessen Horowitz, Uncommon Projects, Kevin Systrom, Mike Krieger, Lenny Rachitsky, Antoine Martin, Julie Zhuo, Ben Rubin, Jaren Glover, SVAngel, 20VC, Ludlow Ventures, Chapter One, and more.

** Please note that all of our roles will require you to be in-person at our NYC HQ (located in Union Square)

We do not work with third-party recruiting agencies, please do not contact us**

About the Role

As an expert in making AI models run fast—really fast—you live at the intersection of CUDA, PyTorch, and generative models, and get excited by the idea of squeezing every last bit of performance out of modern GPUs. You will have the opportunity to turn our cutting-edge video generation research into scalable, production-grade systems. From designing custom CUDA or Triton kernels to profiling distributed inference pipelines, you'll work across the full stack to make sure our models train and serve at peak performance.

Key Responsibilities

  • Optimize model training and inference pipelines, including data loading, preprocessing, checkpointing, and deployment, for throughput, latency, and memory efficiency on NVIDIA GPUs

  • Design, implement, and benchmark custom CUDA and Triton kernels for performance-critical operations

  • Integrate low-level optimizations into PyTorch-based codebases, including custom ops, low-precision formats, and TorchInductor passes

  • Profile and debug the entire stack—from kernel launches to multi-GPU I/O paths—using Nsight, nvprof, PyTorch Profiler, and custom tools

  • Work closely with colleagues to co-design model architectures and data pipelines that are hardware-friendly and maintain state-of-the-art quality

  • Stay on the cutting edge of GPU and compiler tech (e.g., Hopper features, CUDA Graphs, Triton, FlashAttention, and more) and evaluate their impact

  • Collaborate with infrastructure and backend experts to improve cluster orchestration, scaling strategies, and observability for large experiments

  • Provide clear, data-driven insights and trade-offs between performance, quality, and cost

  • Contribute to a culture of fast iteration, thoughtful profiling, and performance-centric design

Required Qualifications

  • Bachelor's degree in Computer Science, Electrical/Computer Engineering, or equivalent practical experience

  • 3+ years of hands-on experience writing and optimizing CUDA kernels for production ML workloads

  • Deep understanding of GPU architecture: memory hierarchies, warp scheduling, tensor cores, register pressure, and occupancy tuning

  • Strong Python skills and familiarity with PyTorch internals, TorchScript, and distributed data-parallel training

  • Proven track record profiling and accelerating large-scale training and inference jobs (e.g., mixed precision, kernel fusion, custom collectives)

  • Comfort working in Linux environments with modern CI/CD, containerization, and cluster managers such as Kubernetes

Preferred Qualifications

  • Advanced degree (MS/PhD) in Computer Science, Electrical/Computer Engineering, or related field

  • Experience with multi-modal AI systems, particularly video generation or computer vision models

  • Familiarity with distributed training frameworks (DeepSpeed, FairScale, Megatron) and model parallelism techniques

  • Knowledge of compiler optimization techniques and experience with MLIR, XLA, or similar frameworks

  • Experience with cloud infrastructure (AWS, GCP, Azure) and GPU cluster management

  • Ability to translate research goals into performant code, balancing numerical fidelity with hardware constraints

  • Strong communication skills and experience mentoring junior engineers

Benefits:

  • Comprehensive medical, dental, and vision plans

  • 401K with employer match

  • Commuter Benefits

  • Catered lunch multiple days per week

  • Dinner stipend every night if you're working late and want a bite!

  • Doordash DashPass subscription

  • Health & Wellness Perks (Talkspace, Kindbody, One Medical subscription, HealthAdvocate, Teladoc)

  • Multiple team offsites per year with team events every month

  • Generous PTO policy

Captions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Please note benefits apply to full time employees only.

Similar Jobs

Philips - Senior Software Development Engineer

Philips

Paris, Île-de-France, France (On-Site)
2 Months ago
Trek - Service Technician

Trek

Hurst, Texas, United States (On-Site)
2 Months ago
Aptive - ME Engineer

Aptive

Yantai, Shandong, China (On-Site)
1 Week ago
Nium - Director - Compliance Operations

Nium

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Insight Software - Manager, Engineering

Insight Software

Hyderabad, Telangana, India (On-Site)
2 Months ago
Cadence - Leader software engineer

Cadence

Shanghai, China (On-Site)
1 Month ago
Ion - Principal Software Engineer, Italy

Ion

Rome, Lazio, Italy (On-Site)
10 Months ago
Qualcomm - BSP Engineer, CE

Qualcomm

Hyderabad, Telangana, India (On-Site)
3 Months ago
Cadence - Lead Application Engineer

Cadence

Tampere, Pirkanmaa, Finland (On-Site)
3 Weeks ago
Assystems - Site Engineer- Civil

Assystems

Bagalkote, Karnataka, India (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Penumbrainc - Territory Manager Neurovascular/Peripheral

Penumbrainc

Oslo, Oslo, Norway (On-Site)
4 Months ago
Mercury - Associate General Counsel, Product and Privacy

Mercury

San Francisco, California, United States (On-Site)
3 Months ago
blacksnow - UI/UX Designer

blacksnow

(Remote)
1 Month ago
Ubisoft - Project Manager Assistant – Online Services

Ubisoft

Paris, Île-de-France, France (On-Site)
3 Months ago
Ubisoft - Gen AI Programmer

Ubisoft

Pune, Maharashtra, India (On-Site)
3 Months ago
Playstation - Studio IT Manager

Playstation

Los Angeles, California, United States (On-Site)
2 Months ago
Pinterest - Sr. iOS Engineer, Ad Formats

Pinterest

San Francisco, California, United States (Remote)
1 Week ago
Assystems - Senior Project Manager - Wet Utilities

Assystems

AlUla, Al Madinah Province, Saudi Arabia (On-Site)
1 Month ago
Barracuda - Senior Software Engineer (Java, Microservices, React JS)

Barracuda

Bengaluru, Karnataka, India (On-Site)
3 Months ago
laika games - VFX Visual Development Artist

laika games

Hillsboro, Oregon, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in New York, United States

Plaid  - Experienced Growth Product Manager - Web

Plaid

San Francisco, California, United States (On-Site)
3 Months ago
Riot Games - Senior Game Producer, League of Legends - Cosmetics

Riot Games

Los Angeles, California, United States (On-Site)
4 Months ago
Hedra - Research Engineer

Hedra

San Francisco, California, United States (On-Site)
4 Months ago
gaming realms - Account Executive (North America)

gaming realms

United States (On-Site)
1 Month ago
FlockSafety - Sales Engineer, Majors

FlockSafety

United States (Remote)
1 Week ago
Trek - Sales Associate - Part Time

Trek

Gig Harbor, Washington, United States (On-Site)
1 Week ago
Go Fund Me - Risk Analyst

Go Fund Me

Chicago, Illinois, United States (Hybrid)
1 Month ago
bytedance - Senior Software Engineer(Financing Product), Global Payments

bytedance

San Jose, California, United States (On-Site)
9 Months ago
Kavalirio - SME Application Developer

Kavalirio

Herndon, Virginia, United States (On-Site)
2 Months ago
Notion - Software Engineer, Public API

Notion

San Francisco, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Software Development & Engineering Jobs

Rackspace Technology - Senior Manager, Data Engineering

Rackspace Technology

Vietnam (On-Site)
1 Year ago
Cognite - Field Engineer/Technical Sales - Operations & Maintenance (Oil & Gas)

Cognite

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (Remote)
2 Months ago
Ion - Principal Software Engineer, Italy

Ion

Collecchio, Emilia-Romagna, Italy (On-Site)
10 Months ago
Mark43 - Engineering Manager

Mark43

New York, United States (Remote)
3 Weeks ago
Canonical - Embedded Linux Field Engineering Manager

Canonical

(Remote)
2 Months ago
Riot Games - Software Engineer III, Core Services - VALORANT

Riot Games

Los Angeles, California, United States (On-Site)
3 Months ago
Apple - Sr Engineering Program Manager, Siri Feature Quality

Apple

Seattle, Washington, United States (On-Site)
1 Month ago
Google - Software Engineer, People with Disabilities

Google

Belo Horizonte, State Of Minas Gerais, Brazil (On-Site)
9 Months ago
rivos - SOC Physical Design Verification Engineer - Full Time

rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
9 Months ago
Zuora - Pre-Sales Engineer II

Zuora

Chennai, Tamil Nadu, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Captions is the leading video AI company, building the future of video creation. Over 10 million creators and businesses have used Captions to create videos for social media, marketing, sales, and more. We're on a mission to serve the next billion. We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. You'll join an early team and have an outsized impact on the product and the company's culture.

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Captions

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug