Member of Technical Staff, GPU Optimization

2 Days ago • 3 Years + • Software Development & Engineering • $175,000 PA - $275,000 PA

Job Summary

Job Description

Captions is seeking a Member of Technical Staff specializing in GPU Optimization. This role involves optimizing AI model training and inference pipelines for speed and efficiency on NVIDIA GPUs. Responsibilities include designing and implementing CUDA/Triton kernels, integrating low-level optimizations into PyTorch, profiling and debugging performance issues, and collaborating with research teams to ensure hardware-friendly model architectures. The ideal candidate will have a deep understanding of GPU architecture and strong Python skills, with experience in performance optimization of large-scale machine learning workloads. This is an opportunity to significantly impact the company's cutting-edge AI video technology.
Must have:
  • 3+ years of experience writing and optimizing CUDA kernels
  • Deep understanding of GPU architecture
  • Strong Python skills and PyTorch familiarity
  • Proven track record profiling and accelerating ML jobs
  • Comfortable working in Linux environments
Good to have:
  • Advanced degree (MS/PhD)
  • Experience with multi-modal AI systems
  • Familiarity with distributed training frameworks
  • Knowledge of compiler optimization techniques
  • Experience with cloud infrastructure
Perks:
  • Comprehensive medical, dental, and vision plans
  • 401K with employer match
  • Commuter Benefits
  • Catered lunch
  • Dinner stipend
  • Doordash DashPass subscription
  • Health & Wellness Perks
  • Team offsites and events
  • Generous PTO policy

Job Details

Captions is the leading AI video company—our mission is to empower anyone, anywhere to tell their stories through video. Over 10 million creators and businesses have used Captions to simplify video creation with truly novel and groundbreaking AI capabilities.

We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. As an early member of our team, you’ll have an opportunity to have an outsized impact on our products and our company's culture.

Our Technology

Mirage Announcement our proprietary omni-modal foundation model

Seeing Voices (technical paper) generating A-roll video from audio with Mirage

Mirage Studio for generating expressive videos at scale

"Captions: For Talking Videos” available in the iOS app store

Press Coverage

Lenny’s Podcast: Interview with Gaurav Misra (CEO)

Latest Fundraise: Series C Announcement

The Information: 50 Most Promising Startups

Fast Company: Next Big Things in Tech

Business Insider: 34 most promising AI startups

TIME: The Best Inventions of 2024

Our Investors

We’re very fortunate to have some the best investors and entrepreneurs backing us, including Index Ventures, Kleiner Perkins, Sequoia Capital, Andreessen Horowitz, Uncommon Projects, Kevin Systrom, Mike Krieger, Lenny Rachitsky, Antoine Martin, Julie Zhuo, Ben Rubin, Jaren Glover, SVAngel, 20VC, Ludlow Ventures, Chapter One, and more.

** Please note that all of our roles will require you to be in-person at our NYC HQ (located in Union Square)

We do not work with third-party recruiting agencies, please do not contact us**

About the Role

As an expert in making AI models run fast—really fast—you live at the intersection of CUDA, PyTorch, and generative models, and get excited by the idea of squeezing every last bit of performance out of modern GPUs. You will have the opportunity to turn our cutting-edge video generation research into scalable, production-grade systems. From designing custom CUDA or Triton kernels to profiling distributed inference pipelines, you'll work across the full stack to make sure our models train and serve at peak performance.

Key Responsibilities

  • Optimize model training and inference pipelines, including data loading, preprocessing, checkpointing, and deployment, for throughput, latency, and memory efficiency on NVIDIA GPUs

  • Design, implement, and benchmark custom CUDA and Triton kernels for performance-critical operations

  • Integrate low-level optimizations into PyTorch-based codebases, including custom ops, low-precision formats, and TorchInductor passes

  • Profile and debug the entire stack—from kernel launches to multi-GPU I/O paths—using Nsight, nvprof, PyTorch Profiler, and custom tools

  • Work closely with colleagues to co-design model architectures and data pipelines that are hardware-friendly and maintain state-of-the-art quality

  • Stay on the cutting edge of GPU and compiler tech (e.g., Hopper features, CUDA Graphs, Triton, FlashAttention, and more) and evaluate their impact

  • Collaborate with infrastructure and backend experts to improve cluster orchestration, scaling strategies, and observability for large experiments

  • Provide clear, data-driven insights and trade-offs between performance, quality, and cost

  • Contribute to a culture of fast iteration, thoughtful profiling, and performance-centric design

Required Qualifications

  • Bachelor's degree in Computer Science, Electrical/Computer Engineering, or equivalent practical experience

  • 3+ years of hands-on experience writing and optimizing CUDA kernels for production ML workloads

  • Deep understanding of GPU architecture: memory hierarchies, warp scheduling, tensor cores, register pressure, and occupancy tuning

  • Strong Python skills and familiarity with PyTorch internals, TorchScript, and distributed data-parallel training

  • Proven track record profiling and accelerating large-scale training and inference jobs (e.g., mixed precision, kernel fusion, custom collectives)

  • Comfort working in Linux environments with modern CI/CD, containerization, and cluster managers such as Kubernetes

Preferred Qualifications

  • Advanced degree (MS/PhD) in Computer Science, Electrical/Computer Engineering, or related field

  • Experience with multi-modal AI systems, particularly video generation or computer vision models

  • Familiarity with distributed training frameworks (DeepSpeed, FairScale, Megatron) and model parallelism techniques

  • Knowledge of compiler optimization techniques and experience with MLIR, XLA, or similar frameworks

  • Experience with cloud infrastructure (AWS, GCP, Azure) and GPU cluster management

  • Ability to translate research goals into performant code, balancing numerical fidelity with hardware constraints

  • Strong communication skills and experience mentoring junior engineers

Benefits:

  • Comprehensive medical, dental, and vision plans

  • 401K with employer match

  • Commuter Benefits

  • Catered lunch multiple days per week

  • Dinner stipend every night if you're working late and want a bite!

  • Doordash DashPass subscription

  • Health & Wellness Perks (Talkspace, Kindbody, One Medical subscription, HealthAdvocate, Teladoc)

  • Multiple team offsites per year with team events every month

  • Generous PTO policy

Captions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Please note benefits apply to full time employees only.

Similar Jobs

PwC - Tax Compliance Officer

PwC

Riyadh, Riyadh Province, Saudi Arabia (On-Site)
7 Months ago
Capgemini - Order Management

Capgemini

Salem, Tamil Nadu, India (On-Site)
2 Months ago
Canonical - Systems & Controls Accountant

Canonical

(Remote)
1 Month ago
PwC - Corporate Tax Compliance - Part Time roles

PwC

Kilkenny, County Kilkenny, Ireland (On-Site)
9 Months ago
GHX - Senior Accountant

GHX

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
Tesla - Electrical Engineer

Tesla

Rhineland-Palatinate, Germany (On-Site)
5 Months ago
Optiv - Sr. Engineer - SIEM

Optiv

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Foster and partners  - Senior Fire Engineer

Foster and partners

London, England, United Kingdom (On-Site)
3 Days ago
Capgemini - Associate Software Engineer

Capgemini

Chennai, Tamil Nadu, India (On-Site)
2 Months ago
zoox - Senior Staff Software Engineer, Autonomy Evaluation

zoox

Foster City, California, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Zeeco, Inc. - Applications and Support Engineer - Process Burners

Zeeco, Inc.

Stamford, England, United Kingdom (On-Site)
9 Months ago
NBC Universal - Product Analyst

NBC Universal

Centennial, Colorado, United States (Hybrid)
1 Month ago
NVIDIA - Mixed-Signal Circuit Design Engineer - New College Graduate

NVIDIA

Taipei City, Taiwan (On-Site)
4 Months ago
Bethesda - Quest Designer

Bethesda

Rockville, Maryland, United States (On-Site)
1 Month ago
beghou consulting - Software Engineer

beghou consulting

Boston, Massachusetts, United States (Hybrid)
2 Months ago
Aryaka - UI/UX Engineer

Aryaka

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Cadence - Principal Software Engineer: Jasper R&D

Cadence

Brazil (On-Site)
1 Month ago
PwC - ETIC, OutSystems Architect-Senior Associate

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
9 Months ago
ARVORE Immersive Experiences - Game Producer

ARVORE Immersive Experiences

São Paulo, State Of São Paulo, Brazil (Remote)
2 Months ago
Autodesk - Principal Data Analyst

Autodesk

Toronto, Ontario, Canada (Hybrid)
1 Year ago

Get notifed when new similar jobs are uploaded

Jobs in New York, United States

Clearwater Analytics - Procurement Specialist

Clearwater Analytics

Chicago, Illinois, United States (On-Site)
1 Week ago
Gigamon - Regional Sales Director - Desert Region

Gigamon

United States (On-Site)
6 Days ago
UPF Industries  - Automotive Packaging Engineer - Metal

UPF Industries

Newnan, Georgia, United States (On-Site)
1 Month ago
Suki - Contract Clinical Evaluator – Cardiology

Suki

Redwood City, California, United States (On-Site)
1 Month ago
Inkittt - Senior Frontend Engineer

Inkittt

San Francisco, California, United States (On-Site)
11 Months ago
Lionsgate - Manager, FP&A, Business Strategy & Planning

Lionsgate

Santa Monica, California, United States (On-Site)
1 Month ago
Riot Games - Principal 3D Environment Artist

Riot Games

Los Angeles, California, United States (On-Site)
1 Week ago
Qualcomm - Memory Subsystem Performance Architect

Qualcomm

San Diego, California, United States (On-Site)
1 Month ago
Tencent - Senior AI Strategy Researcher

Tencent

California, United States (On-Site)
2 Months ago
Flying Bark - Storyboard Artist

Flying Bark

Glendale, California, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Software Development & Engineering Jobs

Zamp - Account Executive (GTM Engineer)

Zamp

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Apple - Core OS Accessories Software Engineer

Apple

Cupertino, California, United States (On-Site)
3 Weeks ago
Rippling - Senior Software Engineer - Travel

Rippling

New York, United States (On-Site)
2 Months ago
Qualcomm - Hardware Baseband Engineer

Qualcomm

Taipei City, Taiwan (On-Site)
1 Month ago
Qualcomm - Engineer - Debugging

Qualcomm

Hyderabad, Telangana, India (On-Site)
1 Month ago
Marvell - Mixed-Signal Modeling/Verification Engineer, Staff Engineer

Marvell

Chandler, Arizona, United States (On-Site)
1 Month ago
Optiv - Principal Engineer - Splunk

Optiv

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Axon - Technical Support Engineer

Axon

Kassel, Hessen, Germany (On-Site)
3 Days ago
Apple - Senior Controls Engineer

Apple

Cupertino, California, United States (On-Site)
1 Month ago
reversing labs  - Senior Software Engineer

reversing labs

Zagreb, Grad Zagreb, Croatia (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Captions is the leading video AI company, building the future of video creation. Over 10 million creators and businesses have used Captions to create videos for social media, marketing, sales, and more. We're on a mission to serve the next billion. We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. You'll join an early team and have an outsized impact on the product and the company's culture.

New York, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Captions

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug