AI Research Scientist, VLLM (Vision Large Language Models) - Generative AI

1 Month ago • 3 Years + • Artificial Intelligence • $147,000 PA - $208,000 PA

Job Summary

Job Description

Meta's Llama LLM Research team seeks a Research Scientist specializing in Vision Large Language Models (VLLMs). Responsibilities include leading and collaborating on cutting-edge research in multimodal reasoning and generation, contributing to experiments (design, coding, evaluation, result organization), working with a large team, publishing research, mentoring colleagues, and fostering cross-functional collaboration. The ideal candidate possesses expertise in vision encoders, data filtering/curation, RLHF, responsible AI, and model controllability, with a focus on applying research to Meta's product development. The role requires experience in generative AI, LLMs, and a strong publication record.
Must have:
  • PhD in CS/AI or related field
  • 3+ years AI experience
  • Publications in ML/CV/NLP/audio
  • Experience with large AI models and datasets
  • Software proficiency (Python, PyTorch)
  • Lead research on VLLMs
Good to have:
  • Generative AI and LLM research experience
  • First-author publications at top AI conferences
  • Experience with RLHF and responsible AI
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Meta is seeking a Research Scientist to join our Llama Large Language Model (LLM) Research team. We are looking for recognized experts in VLLMs; with experience in areas like vision encoders, data filtering/curation for pre and post-training, RLHF, responsible AI and model controllability. The ideal candidate will have an interest in producing and applying new science to help us develop and responsibly release vision large language models.
AI Research Scientist, VLLM (Vision Large Language Models) - Generative AI Responsibilities
  • Lead, collaborate, and execute on research that pushes forward the state of the art in multimodal reasoning and generation research.
  • Work towards long-term ambitious research goals, while identifying intermediate milestones.
  • Directly contribute to experiments, including designing experimental details, writing reusable code, running evaluations, and organizing results.
  • Work with a large team.
  • Contribute to publications and open-sourcing efforts.
  • Mentor other team members. Play a significant role in healthy cross-functional collaboration.
  • Prioritize research that can be applied to Meta's product development.
Minimum Qualifications
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
  • PhD in the field of Computer Science, Artificial Intelligence, or a related field.
  • 3+ year experience in AI
  • Publications in areas of machine learning, computer vision, NLP, or audio
  • Experience writing software and executing complex experiments involving large AI models and datasets.
  • Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment.
Preferred Qualifications
  • Direct experience in generative AI and LLM research.
  • First author publications experience at peer-reviewed AI conferences (e.g., NeurIPS, CVPR, ICML, ICLR, ICCV, and ACL).
  • Fluent in Python and PyTorch.
For those who live in or expect to work from California if hired for this position, please click for additional information.
About Meta
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

$147,000/year to $208,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about at Meta.


Equal Employment Opportunity
Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice .

Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the .

Similar Jobs

Amber - Senior Unreal Game Engineer (Project Based)

Amber

Bogota, Colombia (On-Site)
11 Months ago
Outscal - SME - C++/Unity/Multiplayer/Unreal

Outscal

(Remote)
5 Months ago
Next Level Games - Technical Designer

Next Level Games

British Columbia, Canada (Hybrid)
1 Month ago
Meta - Software Engineer, Infrastructure

Meta

San Francisco, California, United States (Remote)
6 Months ago
game tamin - UA Marketing

game tamin

Da Nang, Vietnam (On-Site)
1 Month ago
Ello - Tech Lead, Machine Learning

Ello

San Francisco, California, United States (On-Site)
2 Months ago
CharacterAI - Research Engineer, ML Systems

CharacterAI

New York, New York, United States (On-Site)
2 Months ago
Rackspace Technology - Principal MLOps Engineer

Rackspace Technology

Toronto, Ontario, Canada (Remote)
2 Months ago
bytedance - Student Researcher (Doubao (Seed) - Foundation Model - Vision Generative AI)

bytedance

San Jose, California, United States (On-Site)
1 Month ago
Google - Customer Engineer II, Cloud AI

Google

San Francisco, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Power Integrations - Senior Product Marketing Manager

Power Integrations

San Jose, California, United States (On-Site)
1 Month ago
Wizcorp - Unreal Engine Programmer

Wizcorp

Tokyo, Japan (Remote)
2 Months ago
No brake games - Unity Technical VFX Artist

No brake games

Vilnius, Vilnius County, Lithuania (On-Site)
1 Month ago
Lockwood - QA Engineer

Lockwood

Nottingham, England, United Kingdom (On-Site)
1 Month ago
Rocket Science - UI/UX Designer

Rocket Science

Cardiff, Wales, United Kingdom (Hybrid)
2 Months ago
Ubisoft - Lead Technical Artist

Ubisoft

Annecy, Auvergne-Rhône-Alpes, France (On-Site)
2 Months ago
Jam City - Manager, 3D Art

Jam City

Burbank, California, United States (Hybrid)
1 Month ago
Unity - Senior Account Executive, Industry Verticals

Unity

Germany (Remote)
2 Months ago
lifechruh - Project Manager

lifechruh

Edmond, Oklahoma, United States (On-Site)
2 Months ago
zimad - 2D Artist Generalist

zimad

(Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

Sprinkler - Vice President, Global Learning & Organizational Development

Sprinkler

New York, New York, United States (On-Site)
1 Week ago
Imagine.io - Web Designer

Imagine.io

Austin, Texas, United States (On-Site)
1 Month ago
Zinnia - Director, Product Management

Zinnia

Greenwich, Connecticut, United States (Hybrid)
2 Weeks ago
warner bros games - VP, Brand Management and Product Marketing

warner bros games

Burbank, California, United States (Hybrid)
3 Months ago
Philips - Technical Consultant - Patient Monitoring

Philips

Montana, United States (On-Site)
4 Days ago
Visa Jobs - Sr. Manager, Data Science

Visa Jobs

Atlanta, Georgia, United States (Hybrid)
3 Weeks ago
Jane Street - AV Engineer

Jane Street

New York, United States (On-Site)
2 Weeks ago
Adyen - Head of Developer Advocacy

Adyen

New York, United States (Hybrid)
2 Weeks ago
The Walt Disney Company - Senior Software Engineer - Identity

The Walt Disney Company

New York, New York, United States (On-Site)
1 Month ago
hogarth - Packaging Manager

hogarth

Sunnyvale, California, United States (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

bytedance - Research Scientist in Foundation Model, Speech & Audio Graduates - 2024 Start (PhD)

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago
Google - Staff Software Engineer, Machine Learning

Google

Los Angeles, California, United States (On-Site)
1 Month ago
Meta - Research Engineer - Conversational AI - Reality Labs

Meta

Menlo Park, California, United States (On-Site)
1 Month ago
Cricketpedia - AI Engineer

Cricketpedia

Gurugram, Haryana, India (Remote)
2 Years ago
Meta - AI Research Scientist, Language - Generative AI

Meta

Menlo Park, California, United States (On-Site)
6 Months ago
Universal Music - Universal Music Group 2025 Summer Internship Program: Prompt Engineer

Universal Music

Los Angeles, California, United States (On-Site)
1 Month ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
3 Months ago
Meta - Research Scientist Intern, Language and Multimodal Research for MetaAI (PhD)

Meta

Seattle, Washington, United States (On-Site)
6 Months ago
Ubisoft - Gen AI Programmer

Ubisoft

Pune, Maharashtra, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology.


We want to give people the power to build community and bring the world closer together. To do that, we ask that you help create a safe and respectful online space. These community values encourage constructive conversations on this page:


• Start with an open mind. Whether you agree or disagree, engage with empathy.

• Comments violating our Community Standards will be removed or hidden. So please treat everybody with respect.

• Keep it constructive. Use your interactions here to learn about and grow your understanding of others.

• Our moderators are here to uphold these guidelines for the benefit of everyone, every day.

• If you are seeking support for issues related to your Facebook account, please reference our Help Center (https://www.facebook.com/help) or Help Community (https://www.facebook.com/help/community).


For a full listing of our jobs, visit https://www.metacareers.com

Seattle, Washington, United States (On-Site)

Menlo Park, California, United States (On-Site)

Burlingame, California, United States (On-Site)

San Diego, California, United States (Remote)

Burlingame, California, United States (Remote)

United States (Remote)

Washington, District Of Columbia, United States (On-Site)

Los Angeles, California, United States (Remote)

View All Jobs

Get notified when new jobs are added by Meta

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug