Research Scientist / Engineer – Data
Job Summary
Job Description
This role focuses on leveraging data to enhance Luma's foundation models, exploring how various modalities can be combined to unlock new AI capabilities. The Research Scientist / Engineer will address fundamental data challenges to create powerful and versatile multimodal AI systems.
Must have:
- Identify capability gaps and research solutions
- Design datasets and data-mixture ablations to systematically improve model capabilities across vision, audio, and language
- Develop evaluation frameworks and benchmarking approaches for multimodal AI capabilities
- Create prototypes and demonstrations that showcase new multimodal capabilities
Good to have:
- Expertise working with interleaved multimodal data
- Hands-on experience with Vision Language Models, Audio Language Models, or generative video models
Perks:
- Offers Equity
5 skills required
Job Details
About the Role
Data is a fundamental layer in Luma that unlocks advanced capabilities in our foundation models. We tackle the fundamental data questions around how different modalities can be combined to enable new behaviors and capabilities, working on the open-ended challenges of what makes multimodal AI systems truly powerful and versatile.
Responsibilities
- Identify capability gaps and research solutions
- Design datasets and data-mixture ablations to systematically improve model capabilities across vision, audio, and language
- Develop evaluation frameworks and benchmarking approaches for multimodal AI capabilities
- Create prototypes and demonstrations that showcase new multimodal capabilities
Experience
- Strong programming skills in Python and PyTorch
- Experience with large-scale dataset
- Experience with multimodal data processing pipeline
- Understanding of computer vision, audio processing, and / or natural language processing techniques
- (Preferred) Expertise working with interleaved multimodal data
- (Preferred) Hands-on experience with Vision Language Models, Audio Language Models, or generative video models
Similar Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Skill Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Jobs in United States
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Data Analysis Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
