Research Scientist Intern - Multimodal Interaction & World Model - 2025 Start

4 Months ago • Upto 1 Years • Artificial Intelligence • Research & Development

Job Summary

Job Description

The Research Scientist Intern will join the Multimodal Interaction & World Model team, researching cutting-edge AI technologies. Responsibilities include exploring multimodal understanding and generation, optimizing large-scale models, building evaluation systems, and developing multimodal agents for virtual worlds. The intern will leverage pre-training and simulation technologies to model real-world environments. The ideal candidate possesses in-depth knowledge of computer vision, AIGC, machine learning, and strong analytical and problem-solving skills. Experience with top AI conferences/journals and proficiency in C/C++ or Python are preferred.
Must have:
  • Bachelor's degree in relevant field
  • Deep research in CV, Multimodal, AIGC, or ML
  • Excellent analytical and problem-solving skills
  • Strong communication and collaboration skills
Good to have:
  • Publications in top AI conferences/journals
  • Proficient in C/C++ or Python
  • Experience leading influential projects

Job Details

Responsibilities
Established in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress. With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas including natural language processing (NLP), computer vision (CV), and speech recognition and generation. It has labs and researcher roles in China, Singapore, and the US. Leveraging substantial data and computing resources and through continued investment in these domains, our team has built a proprietary general-purpose model with multimodal capabilities. In the market, Doubao models power over 50 ByteDance apps and business lines, including Doubao, Coze, and Dreamina, and was launched to external enterprise clients through Volcano Engine. The Doubao app is the most used AIGC app in China. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the team Welcome to the Multimodal Interaction & World Model team. Our mission is to solve the challenge of multimodal intelligence、virtual reality world interaction in AI. We conduct cutting-edge research on areas such as Foundations and applications of multimodal understanding models, Multimodal agent and inference, Unified models for generation and understanding, World Model. Our team is comprising experienced research scientists and engineers who are dedicated to developing models that boast human-level multimodal understanding and interaction capabilities. The team also aspires to advance the exploration and development of multimodal assistant products. We foster a feedback-driven environment to continuously enhance our foundation technologies. Come join us in shaping the future of AI and transforming the product experience for users worldwide. Responsibilities - Explore and research multi-modal understanding, generative, machine learning, reinforcement learning, AIGC, computer vision, artificial intelligence and other cutting-edge technologies. - Explore the basic model of large-scale/ultra-large-scale multi-modal understanding and generation interweaving, and carry out extreme system optimization; Data construction, instruction fine-tuning, preference alignment, model optimization; Improve the ability of data synthesis, scalable oversight, model reasoning and planning, build a comprehensive, objective and accurate evaluation system, and explore and improve the ability of large models. - Explore and break through the advanced capabilities of multi-modal models and world models, including but not limited to multi-modal RAG, visual COT and Agent, and build a universal multi-modal Agent for GUI/ games and other virtual worlds. - Use pre-training, simulation and other technologies to model various environments in the virtual/real world, provide the basic ability of multi-modal interactive exploration, promote application landing, and develop new technologies and new products with artificial intelligence technology as the core.
Qualifications
Minimum Qualifications: - Bachelor degree or above, computer, electronics, mathematics and other related majors. - Have in-depth research in one or more fields such as computer vision, multimodal, AIGC, machine learning, rendering generation, etc.. - Excellent analytical and problem solving skills; Ability to solve large model training and application problems; Ability to explore solutions independently. - With good communication and collaboration skills, proactive work, able to harmoniously cooperate with the team to explore new technologies and promote technological progress. Preferred Qualifications: - With excellent basic algorithms, solid foundation of machine learning, familiar with CV, AIGC, NLP, RL, ML and other fields of technology, CVPR, ECCV, ICCV, NeurIPS, ICLR, SIGGRAPH or SIGGRAPH Asia and other top conferences/journals published papers are preferred. - With excellent coding ability, proficient in C/C++ or Python programming language, ACM/ICPC, NOI/IOl, Top Coder, Kaggle and other competition winners preferred. - In the fields of multimodal, large model, basic model, world model, RL, rendering generation, leading projects with too much influence is preferred. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. By submitting an application for this role, you accept and agree to our global applicant privacy policy, which may be accessed here: https://jobs.bytedance.com/en/legal/privacy. If you have any questions, please reach out to us at apac-earlycareers@bytedance.com

Similar Jobs

Moon Active - Game Development Team Lead

Moon Active

Warsaw, Masovian Voivodeship, Poland (On-Site)
5 Months ago
Rockstar Games - Senior Technical Artist: Animation

Rockstar Games

London, England, United Kingdom (On-Site)
6 Months ago
Creative Assembly - Senior Engine Programmer

Creative Assembly

Sofia, Sofia City Province, Bulgaria (On-Site)
6 Days ago
NVIDIA - Senior System Software Engineer - Autonomous Driving

NVIDIA

Beijing, Beijing, China (On-Site)
1 Month ago
Genies - 2025 Summer Backend Engineer Intern

Genies

San Mateo, California, United States (On-Site)
3 Weeks ago
Inworld AI - Forward Deployed Engineer (AI Gameplay Engineer)

Inworld AI

Mountain View, California, United States (On-Site)
6 Days ago
Netflix - Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

Netflix

Los Gatos, California, United States (Remote)
2 Months ago
GoTo Group - Senior Data Scientist - Computer Vision - KYC

GoTo Group

Singapore (On-Site)
5 Months ago
Samsung Semiconductor - Intern, Machine Learning Engineer - VLMs

Samsung Semiconductor

San Jose, California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Senior Software Engineer - Switch Simulation

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
Netflix - Senior Server/Backend Software Engineer

Netflix

United States (Remote)
1 Month ago
N-iX - Senior C++ Engineer (High Performance Computing)

N-iX

United Kingdom (Flexible)
1 Month ago
ION - Internship - Software Engineers/Developers - Italy

ION

Pisa, Tuscany, Italy (On-Site)
5 Months ago
NVIDIA - Senior Solutions Architect, HPC

NVIDIA

Michigan, United States (Remote)
1 Month ago
CD PROJEKT RED - Senior Technical Artist

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
PhonePe - Software Engineer (Backend, 5-8 Years) - Financial Services

PhonePe

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Playrix - Senior QA Automation Engineer (Mobile)

Playrix

Almaty, Almaty Region, Kazakhstan (Remote)
5 Months ago
NVIDIA - Senior Tool and Methodology Development Software Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
6 Days ago
Rockstar Games - Graphics Programmer

Rockstar Games

Carlsbad, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

ByteDance - Senior Product Manager - Cloud Security

ByteDance

Singapore (On-Site)
4 Months ago
ByteDance - Product Manager - Workplace Solutions Hardware

ByteDance

Singapore (On-Site)
1 Month ago
The Walt Disney Company - APAC Publicity Intern, Studios & Disney+

The Walt Disney Company

Singapore, Singapore (On-Site)
6 Days ago
Argus Labs - Technical Artist (APAC)

Argus Labs

Singapore (Remote)
5 Days ago
PwC - Risk Services - AI Support Specialist

PwC

Singapore (On-Site)
6 Months ago
The Walt Disney Company - Intern, Corporate Communications, Southeast Asia

The Walt Disney Company

Singapore, Singapore (On-Site)
1 Month ago
ByteDance - Android Software Engineer - Global Payment

ByteDance

Singapore (On-Site)
6 Days ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

NVIDIA - Senior Solution Architect, HPC and AI

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
2 Months ago
Trend Micro - Sr. Data Scientist (AI Lab)

Trend Micro

Taipei City, Taiwan (On-Site)
6 Months ago
Tripledot Studios - Machine Learning Engineer

Tripledot Studios

London, England, United Kingdom (Hybrid)
1 Month ago
Granicus - Data Scientist 4

Granicus

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Thumbtack - Staff Software Engineer,  Machine Learning Infrastructure

Thumbtack

Ontario, Canada (Remote)
4 Months ago
Scale AI - AI Product Manager, Generative AI

Scale AI

San Francisco, California, United States (On-Site)
5 Months ago
Google - Student Researcher, BS/MS, Winter/Summer 2025

Google

Ann Arbor, Michigan, United States (On-Site)
4 Months ago
Inkittt - Senior Machine Learning Engineer, Recommendations

Inkittt

San Francisco, California, United States (Hybrid)
2 Months ago
ByteDance - Machine Learning Scientist Graduate (Scaling AI for Biology (AI-for-Science))

ByteDance

Seattle, Washington, United States (On-Site)
6 Days ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

New York, New York, United States (On-Site)

Jakarta, Jakarta, Indonesia (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Singapore (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug