Research Engineer, Multimodal

1 Month ago • All levels • Artificial Intelligence

Job Summary

Job Description

As a Research Engineer on the Multimodal team at Character.AI, you'll be a full-stack machine learning expert responsible for end-to-end development of new multimodal capabilities. This involves data collection and pipeline creation, developing cutting-edge model architectures, creating evaluations for generative outputs, writing efficient inference algorithms, and integrating user feedback. You'll work with large-scale image/audio datasets and need experience in diffusion modeling, large-scale image/video processing, and transformer model training. Success requires expertise in PyTorch and a proven track record of project ownership from design to deployment, particularly with large language models.
Must have:
  • PhD or equivalent research experience
  • Full-stack ML expertise
  • Diffusion modeling experience
  • Large-scale image/video data processing
  • Transformer model training
  • PyTorch proficiency
  • Project ownership from start to finish

Job Details

About the role and team

As a Research Engineer on our Multimodal team, you’ll be a self-motivated, resourceful contributor with full-stack machine learning expertise—from data collection and training state-of-the-art models to building evaluations, optimizing inference algorithms, and refining systems based on user feedback.

In this role, you'll take end-to-end ownership of developing new multimodal capabilities, requiring you to think holistically about every stage of the ML pipeline. You'll need to be comfortable working across the full stack, tackling challenges at any level—from designing data pipelines to fine-tuning models and deploying real-time inference. If you thrive in an environment where you can wear multiple hats and solve complex problems with a hands-on approach, we’d love to hear from you.

What you'll do

  • Determine the type of training data we need, finding where we can collect it, and writing distributed data gathering pipelines to ingest data.

  • Develop new model architectures that push the state-of-the-art in terms of quality, scale, and inference speed.

  • Create new evaluations that capture different aspects of generative outputs

  • Write fast inference algorithms to serve these models at scale.

  • Work with product teams to integrate feedback mechanisms into the product, which we use to improve the model.

  • Work with large scale image/audio datasets.

Who you are

  • "All Industry Levels": at least PhD (or equivalent) research experience.

  • Experiences in diffusion modeling, large scale image/video data processing, and transformer model training.

  • Strong engineering skills in deep learning frameworks of PyTorch.

  • Track record of releases, publications, and/or open source projects relating to image / video generation, diffusion modeling, transformers, and so on.

  • Have a deep understanding of the “whole stack” and track record of successfully owning projects from start to finish when it comes to designing, training, evaluating and deploying machine learning models, especially large language models.

About Character.AI

Character.AI empowers people to connect, learn and tell stories through interactive entertainment. Over 20 million people visit Character.AI every month, using our technology to supercharge their creativity and imagination. Our platform lets users engage with tens of millions of characters, enjoy unlimited conversations, and embark on infinite adventures.


In just two years, we achieved unicorn status and were honored as Google Play's AI App of the Year—a testament to our innovative technology and visionary approach.


Join us and be a part of establishing this new entertainment paradigm while shaping the future of Consumer AI!

At Character, we value diversity and welcome applicants from all backgrounds. As an equal opportunity employer, we firmly uphold a non-discrimination policy based on race, religion, national origin, gender, sexual orientation, age, veteran status, or disability. Your unique perspectives are vital to our success.

Compensation Range: $225K - $400K

Similar Jobs

Riot Games - Staff Software Engineer (Services) - League of Legends, Motivations

Riot Games

Los Angeles, California, United States (On-Site)
6 Months ago
Epic Games - Director of UI Programming

Epic Games

Montreal, Quebec, Canada (On-Site)
2 Months ago
PwC - IN_Senior Associate_ Golang _Advisory Corporate_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Dolby Laboratories - AIOps Research Scientist

Dolby Laboratories

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
GoMotive - Software Engineer, Backend (AI Infrastructure)

GoMotive

Pakistan (Remote)
1 Month ago
Canva - GenAI Research Engineering Manager - Image Generation (m/f/x) - Canva Austria

Canva

Vienna, Vienna, Austria (Remote)
4 Months ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Sausalito, California, United States (On-Site)
5 Months ago
AI Fund - Curriculum Developer

AI Fund

(Remote)
6 Months ago
Canva - Head of AI Research

Canva

Sydney, New South Wales, Australia (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Passion Gaming - Back End Engineer PHP

Passion Gaming

Gurugram, Haryana, India (On-Site)
7 Months ago
ByteDance - Research Scientist, Reinforcement Learning

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Warner Bros Games - Senior Analytics Engineer

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
2 Months ago
NVIDIA - Web Software Development Intern - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
3 Months ago
Power Integrations - Senior Applications Firmware Engineer

Power Integrations

Pasig, Metro Manila, Philippines (On-Site)
6 Months ago
The Walt Disney Company - Sr Software Engineer (webOS/Tizen)

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
5 Months ago
Warner Bros Games - Staff Software Engineer - Backend (Adtech Team)

Warner Bros Games

Pune, Maharashtra, India (Hybrid)
2 Months ago
ByteDance - Engineering Manager - Applied Machine Learning Algorithm

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
NVIDIA - Senior Technical Program Manager, AI Datacenter

NVIDIA

Beijing, Beijing, China (On-Site)
3 Months ago
STAGE - Analytics Engineer

STAGE

Noida, Uttar Pradesh, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New York, New York, United States

Anthology  Inc  - Interim Recruiter

Anthology Inc

United States (Remote)
1 Month ago
Skillz - Manager of Tax & Treasury

Skillz

Las Vegas, Nevada, United States (On-Site)
4 Months ago
Glean - Software Engineer, Fullstack

Glean

Palo Alto, California, United States (On-Site)
5 Months ago
Zoox - Systems Engineer: Operational Safety

Zoox

Foster City, California, United States (Hybrid)
6 Months ago
Next Level Business Services - SAP HANA Developer

Next Level Business Services

Charlotte, North Carolina, United States (On-Site)
6 Months ago
Intrepid Studios,  Inc  - Human Resources Manager

Intrepid Studios, Inc

San Diego, California, United States (On-Site)
6 Months ago
Varonis  - Senior Legal Counsel

Varonis

United States (On-Site)
5 Months ago
Fluence - Sales Engineer/Senior Sales Engineer - Battery Energy Storage

Fluence

Mountain View, California, United States (Hybrid)
6 Months ago
DraftKings - Director, Product Delivery Organization

DraftKings

Boston, Massachusetts, United States (On-Site)
2 Months ago
Varonis  - Financial Systems Project Manager

Varonis

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

NVIDIA - Senior Computer Architect - Deep Learning

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Granicus - Data Scientist 4

Granicus

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Zoox - Sensor Software Developer

Zoox

Foster City, California, United States (On-Site)
6 Months ago
Luxoft - Regular Data Engineer

Luxoft

(Remote)
4 Months ago
Hitachi - Artificial Intelligence - JBU

Hitachi

Chennai, Tamil Nadu, India (On-Site)
6 Months ago
Krafton  - Deep Learning Strategy & Operations Associate

Krafton

Seoul, South Korea (On-Site)
2 Months ago
ByteDance - Research Scientist in Foundation Model, Speech Understanding - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
PwC - Senior AI Developer - Roma [DIG]

PwC

Rome, Lazio, Italy (On-Site)
6 Months ago
NVIDIA - Senior AI-HPC Storage Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Canva - Senior Computer Vision Engineer - Photo AI

Canva

Vienna, Vienna, Austria (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Character is one of the world's leading personal AI platforms. Founded in 2021 by AI pioneers Noam Shazeer and Daniel De Freitas, Character is a full-stack AI company with a globally scaled direct-to-consumer platform. 

New York, New York, United States (On-Site)

San Francisco, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

Menlo Park, California, United States (Remote)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Character.AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug