Research Engineer, Multimodal Audio

1 Month ago • All levels • Audio Engineering • $225,000 PA - $400,000 PA

Job Summary

Job Description

As a Research Engineer on the Multimodal team, you will be a self-motivated, resourceful contributor with full-stack machine learning expertise. You will own the end-to-end development of new multimodal audio capabilities, covering data collection, training state-of-the-art models, building evaluations, optimizing inference algorithms, and refining systems based on user feedback. Responsibilities include determining training data needs, collecting data, writing distributed data gathering pipelines, developing new model architectures, creating new evaluations, writing fast inference algorithms, integrating feedback mechanisms, and working with large-scale multimodal datasets.
Must have:
  • PhD or equivalent research experience
  • Experience with large-scale audio data processing
  • Experience with transformer model training
  • Strong engineering skills in PyTorch
  • Track record of releases, publications, or open-source projects related to transformer model training
  • Deep understanding of the ML whole stack
  • Proven ability to own ML projects from start to finish
Perks:
  • Offers Equity

Job Details

About the role and team

As a Research Engineer on our Multimodal team, you’ll be a self-motivated, resourceful contributor with full-stack machine learning expertise—from data collection and training state-of-the-art models to building evaluations, optimizing inference algorithms, and refining systems based on user feedback.

In this role, you'll take end-to-end ownership of developing new multimodal Audio capabilities, requiring you to think holistically about every stage of the ML pipeline. You'll need to be comfortable working across the full stack, tackling challenges at any level—from designing data pipelines to fine-tuning models and deploying real-time inference. If you thrive in an environment where you can wear multiple hats and solve complex problems with a hands-on approach, we’d love to hear from you.

What you'll do

  • Determine the type of training data we need, finding where we can collect it, and writing distributed data gathering pipelines to ingest data.

  • Develop new model architectures that push the state-of-the-art in terms of quality, scale, and inference speed.

  • Create new evaluations that capture different aspects of generative outputs

  • Write fast inference algorithms to serve these models at scale.

  • Work with product teams to integrate feedback mechanisms into the product, which we use to improve the model.

  • Work with large scale multimodal datasets.

Who you are

  • "All Industry Levels": at least PhD (or equivalent) research experience.

  • Experiences in large scale audio data processing, and transformer model training.

  • Strong engineering skills in deep learning frameworks of PyTorch.

  • Track record of releases, publications, and/or open source projects related to transformer model training.

  • Have a deep understanding of the “whole stack” and track record of successfully owning projects from start to finish when it comes to designing, training, evaluating and deploying machine learning models, especially large language models.

About Character.AI

Character.AI empowers people to connect, learn and tell stories through interactive entertainment. Over 20 million people visit Character.AI every month, using our technology to supercharge their creativity and imagination. Our platform lets users engage with tens of millions of characters, enjoy unlimited conversations, and embark on infinite adventures.


In just two years, we achieved unicorn status and were honored as Google Play's AI App of the Year—a testament to our innovative technology and visionary approach.


Join us and be a part of establishing this new entertainment paradigm while shaping the future of Consumer AI!

At Character, we value diversity and welcome applicants from all backgrounds. As an equal opportunity employer, we firmly uphold a non-discrimination policy based on race, religion, national origin, gender, sexual orientation, age, veteran status, or disability. Your unique perspectives are vital to our success.

Similar Jobs

bytedance - Research Scientist Intern (Doubao (Seed) - Foundation Model, Speech Understanding) - 2024 Summer (PhD)

bytedance

San Jose, California, United States (On-Site)
9 Months ago
Rackspace Technology - Senior Artificial Intelligence Engineer

Rackspace Technology

United States (Remote)
2 Months ago
Scopely - Lead ML/Analytics Engineer

Scopely

Barcelona, Catalonia, Spain (Hybrid)
1 Month ago
Cognite - Senior Product Manager – Generative AI and AI/ML

Cognite

Oslo, Oslo, Norway (Hybrid)
1 Month ago
Salesforce - Software Engineering PMTS/Architect

Salesforce

Bengaluru, Karnataka, India (Remote)
1 Year ago
Apple - Audio SQA Engineer

Apple

Los Angeles, California, United States (On-Site)
2 Months ago
WebMD - Audio Visual Technician (m/w/d)

WebMD

United Kingdom (On-Site)
9 Months ago
SEGA - Senior Audio QA Technician

SEGA

Horsham, England, United Kingdom (On-Site)
1 Month ago
sofar sounds - Audio Engineer

sofar sounds

California, United States (On-Site)
3 Weeks ago
creative assembly - Audio Programmer - CA Sofia

creative assembly

Sofia, Sofia City Province, Bulgaria (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Brillio - Data Scientist - R01551326

Brillio

Chennai, Tamil Nadu, India (Hybrid)
1 Month ago
PayPal - Senior Machine Learning Engineer

PayPal

San Jose, California, United States (Hybrid)
1 Year ago
Match Group - Senior ML Software Engineering Team Leader

Match Group

Seoul, South Korea (Hybrid)
9 Months ago
DNEG - Senior Machine Learning Engineer

DNEG

London, England, United Kingdom (On-Site)
1 Month ago
Lambda - Storage Protocols Engineering Manager

Lambda

San Francisco, California, United States (Hybrid)
1 Week ago
Accenture - AI / ML Engineer

Accenture

Chennai, Tamil Nadu, India (On-Site)
2 Weeks ago
bytedance - Research Scientist Graduate (High-Performance Computing (Inference Optimization) - Vision AI Platform)

bytedance

San Jose, California, United States (On-Site)
3 Months ago
rivos - Deep Learning Libraries Engineer

rivos

Santa Clara, California, United States (Hybrid)
1 Year ago
PwC - Associate

PwC

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Qualcomm - AI ML Engineer

Qualcomm

Hyderabad, Telangana, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Redwood City, California, United States

Sierra - Business Development Lead

Sierra

San Francisco, California, United States (On-Site)
5 Months ago
Visa - Director, Issuing Solutions Sales Executive

Visa

Atlanta, Georgia, United States (Hybrid)
2 Weeks ago
Postman - Senior Applied AI Engineer

Postman

San Francisco, California, United States (Hybrid)
3 Months ago
Snap Mobile INC - Account Executive

Snap Mobile INC

Corpus Christi, Texas, United States (On-Site)
3 Months ago
Plug power - Field Service Technician

Plug power

Spanaway, Washington, United States (On-Site)
2 Months ago
Carda Health - ECG Technician

Carda Health

United States (Remote)
2 Weeks ago
Zeeco, Inc. - Global Retrofit and Aftermarket Manager

Zeeco, Inc.

Tulsa, Oklahoma, United States (On-Site)
1 Week ago
Aptive - Sales Account Manager

Aptive

Denver, Colorado, United States (On-Site)
3 Months ago
UPF Industries  - Account Manager

UPF Industries

Union City, Georgia, United States (Remote)
2 Weeks ago
bytedance - Senior Software Engineer - Network Security

bytedance

San Jose, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Audio Engineering Jobs

Valve corporation - Audio Software Engineer

Valve corporation

Bellevue, Washington, United States (On-Site)
9 Months ago
Kojima - Sound Programmer

Kojima

Minato City, Tokyo, Japan (On-Site)
3 Months ago
bytedance - Student Researcher (Doubao (Seed) - Foundation Model - Speech & Audio) - 2025 Start (PhD)

bytedance

Seattle, Washington, United States (On-Site)
9 Months ago
sofar sounds - Audio Engineer

sofar sounds

New York, United States (On-Site)
1 Year ago
Granicus - Audio/Video Installation Technician

Granicus

Dallas, Texas, United States (On-Site)
2 Months ago
creative assembly - Senior Audio QA Technician

creative assembly

Sofia, Sofia City Province, Bulgaria (On-Site)
2 Months ago
Razer - Senior Audio Video (AV) Engineer

Razer

Chengdu, Sichuan, China (On-Site)
2 Months ago
lifechruh - Audio Support Engineer

lifechruh

Edmond, Oklahoma, United States (On-Site)
3 Months ago
Sega (UK) - Audio Programmer

Sega (UK)

Horsham, England, United Kingdom (Hybrid)
2 Months ago
Sega (UK) - Audio Programmer

Sega (UK)

Sofia, Sofia City Province, Bulgaria (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Character is one of the world's leading personal AI platforms. Founded in 2021 by AI pioneers Noam Shazeer and Daniel De Freitas, Character is a full-stack AI company with a globally scaled direct-to-consumer platform. 

Redwood City, California, United States (Hybrid)

Redwood City, California, United States (On-Site)

Redwood City, California, United States (On-Site)

Redwood City, California, United States (Hybrid)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

United States (On-Site)

View All Jobs

Get notified when new jobs are added by Character.AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug