Research Scientist/Engineer, Multimodal Interaction & World Model - 2025 Start

5 Months ago • Upto 2 Years • Artificial Intelligence • Research & Development

Job Summary

Job Description

ByteDance's Multimodal Interaction & World Model team seeks a Research Scientist/Engineer. Responsibilities involve researching multimodal understanding, generative models, reinforcement learning, AIGC, and computer vision. This includes exploring large-scale multimodal models, optimizing systems, improving data synthesis, and building evaluation systems. The role also involves developing multimodal agents for virtual worlds and using pre-training to model real-world environments. Candidates should have a PhD in a relevant field and deep research experience in one or more areas like computer vision or AIGC. Preference given to candidates with publications in top conferences/journals and strong coding abilities. The position is based in Singapore and requires a current right to work there.
Must have:
  • PhD in Computer Science or related field
  • Deep research in CV, multimodal, AIGC, or ML
  • Excellent analytical and problem-solving skills
  • Strong communication and collaboration skills
Good to have:
  • Publications in top conferences (CVPR, NeurIPS, etc.)
  • Excellent coding skills (C/C++ or Python)
  • Experience with large models, world models, or RL
  • ACM/ICPC or similar competition wins

Job Details

Responsibilities
ByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance sponsorship of a visa. Established in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress. With a long-term vision and a strong commitment to the AI field, the team conducts research in a range of areas including natural language processing (NLP), computer vision (CV), and speech recognition and generation. It has labs and researcher roles in China, Singapore, and the US. Leveraging substantial data and computing resources and through continued investment in these domains, our team has built a proprietary general-purpose model with multimodal capabilities. In the Chinese market, Doubao models power over 50 ByteDance apps and business lines, including Doubao, Coze, and Dreamina, and was launched to external enterprise clients through Volcano Engine. The Doubao app is the most used AIGC app in China. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the team Welcome to the Multimodal Interaction & World Model team. Our mission is to solve the challenge of multimodal intelligence、virtual reality world interaction in AI. We conduct cutting-edge research on areas such as Foundations and applications of multimodal understanding models, Multimodal agent and inference, Unified models for generation and understanding, World Model. Our team is comprising experienced research scientists and engineers who are dedicated to developing models that boast human-level multimodal understanding and interaction capabilities. The team also aspires to advance the exploration and development of multimodal assistant products. We foster a feedback-driven environment to continuously enhance our foundation technologies. Come join us in shaping the future of AI and transforming the product experience for users worldwide. We are looking for talented individuals to join us in 2025. As a graduate, you will get unparalleled opportunities for you to kickstart your career, pursue bold ideas and explore limitless growth opportunities. Co-create a future driven by your inspiration with ByteDance. Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to ByteDance and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early. Responsibilities - Explore and research multi-modal understanding, generative, machine learning, reinforcement learning, AIGC, computer vision, artificial intelligence and other cutting-edge technologies. - Explore the basic model of large-scale/ultra-large-scale multi-modal understanding and generation interweaving, and carry out extreme system optimization; Data construction, instruction fine-tuning, preference alignment, model optimization; Improve the ability of data synthesis, scalable oversight, model reasoning and planning, build a comprehensive, objective and accurate evaluation system, and explore and improve the ability of large models. - Explore and break through the advanced capabilities of multi-modal models and world models, including but not limited to multi-modal RAG, visual COT and Agent, and build a universal multi-modal Agent for GUI/ games and other virtual worlds. - Use pre-training, simulation and other technologies to model various environments in the virtual/real world, provide the basic ability of multi-modal interactive exploration, promote application landing, and develop new technologies and new products with artificial intelligence technology as the core.
Qualifications
Minimum Qualifications: - Final year Ph.D or recent Ph.D graduates in Computer Science, engineering or quantitative field. Computer, Electronics, Mathematics and other related majors. - Have in-depth research in one or more fields such as computer vision, multimodal, AIGC, machine learning, rendering generation, etc.. - Excellent analytical and problem solving skills; Ability to solve large model training and application problems; Ability to explore solutions independently. - With good communication and collaboration skills, proactive work, able to harmoniously cooperate with the team to explore new technologies and promote technological progress. Preferred Qualifications: - With excellent basic algorithms, solid foundation of machine learning, familiar with CV, AIGC, NLP, RL, ML and other fields of technology, CVPR, ECCV, ICCV, NeurIPS, ICLR, SIGGRAPH or SIGGRAPH Asia and other top conferences/journals published papers are preferred. - With excellent coding ability, proficient in C/C++ or Python programming language, ACM/ICPC, NOI/IOl, Top Coder, Kaggle and other competition winners preferred. - In the fields of multimodal, large model, basic model, world model, RL, rendering generation, leading projects with too much influence is preferred. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. By submitting an application for this role, you accept and agree to our global applicant privacy policy, which may be accessed here: https://jobs.bytedance.com/en/legal/privacy. If you have any questions, please reach out to us at apac-earlycareers@bytedance.com

Similar Jobs

ByteDance - Research Scientist Intern (Traffic Infrastructure Global Engineering)

ByteDance

San Jose, California, United States (On-Site)
1 Week ago
Google - Staff Software Engineer, GPU Performance, Google Scale

Google

Sunnyvale, California, United States (On-Site)
4 Days ago
ByteDance - Research Scientist in Computational Biology

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
ByteDance - Backend Engineer Intern, Video-On-Demand

ByteDance

Singapore (On-Site)
3 Weeks ago
Zoox - Senior/Staff Machine Learning Engineer - Prediction & Behavior ML

Zoox

Boston, Massachusetts, United States (Hybrid)
6 Months ago
Microsoft - Member of Technical Staff, AI Platform Engineer

Microsoft

Mountain View, California, United States (Hybrid)
5 Days ago
Canva - Senior Machine Learning Engineer - Canva UK

Canva

London, England, United Kingdom (Remote)
4 Months ago
Google - Senior Staff Software Engineer, On-Device Machine Learning

Google

Sunnyvale, California, United States (On-Site)
4 Days ago
Google - Software Engineer III, Core Machine Learning, Google Cloud

Google

Mountain View, California, United States (On-Site)
5 Months ago
Krafton  - Head of Deep Learning PM & Ops

Krafton

Seoul, South Korea (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Senior Software Engineer, Chrome Browser Infrastructure

Google

Mexico City, Mexico City, Mexico (On-Site)
4 Days ago
Google - Software Engineer, Cloud AI, Early Career

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
4 Days ago
Google - Senior Software Engineer, Google Cloud Compute Infrastructure

Google

Sunnyvale, California, United States (On-Site)
4 Days ago
ByteDance - NLP Engineer Intern - 2025 Start

ByteDance

Singapore (On-Site)
5 Months ago
Head Digital Works - Business Intelligence Analyst

Head Digital Works

Hyderabad, Telangana, India (On-Site)
6 Months ago
PwC - Senior Data Scientist

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
6 Months ago
ByteDance - Research Engineer Graduate (Vision AI Platform)

ByteDance

San Jose, California, United States (On-Site)
1 Week ago
ByteDance - Machine Learning Engineer - Pico Perception

ByteDance

San Jose, California, United States (On-Site)
1 Week ago
Google - Quantum Algorithms Numerics Specialist

Google

San Francisco, California, United States (On-Site)
4 Days ago
Google - Senior Software Engineer, Google Cloud Networking

Google

Bengaluru, Karnataka, India (On-Site)
4 Days ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

ByteDance - LLM Global Data - LLM Performance Operation - Safety Specialist

ByteDance

Singapore (On-Site)
3 Months ago
Razer - Associate Director, Software Product Marketing

Razer

Singapore (On-Site)
6 Months ago
ByteDance - Strategy Intern, BytePlus

ByteDance

Singapore (On-Site)
2 Months ago
ByteDance - Software Engineer (Payment Network) Intern

ByteDance

Singapore (On-Site)
3 Weeks ago
ByteDance - Threat Intelligence Engineer, Security Assurance - 2025 Start

ByteDance

Singapore (On-Site)
5 Months ago
Garena - Data Analyst

Garena

Singapore (On-Site)
1 Week ago
HP - College Intern - Category Management

HP

Singapore, Singapore (On-Site)
7 Months ago
Coursera - Account Director - Singapore

Coursera

Singapore (Hybrid)
1 Month ago
Google - Field Sales Representative, Public Sector, Google Cloud

Google

Singapore (On-Site)
4 Days ago
ByteDance - Legal Counsel, Content Moderation

ByteDance

Singapore (On-Site)
5 Days ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Meta - Research Scientist, Machine Learning (PhD)

Meta

Sunnyvale, California, United States (On-Site)
5 Months ago
Google - Machine Learning Hardware Architect

Google

Sunnyvale, California, United States (On-Site)
3 Days ago
Google - Customer Engineer III, Applied AI, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
4 Days ago
El Ranchito - Machine Learning Artist Intern

El Ranchito

Madrid, Community Of Madrid, Spain (On-Site)
2 Weeks ago
Google - AICore Software Engineer

Google

Taipei City, Taiwan (On-Site)
4 Days ago
Google - Senior Software Engineer, AI/ML GenAI, Google Cloud AI

Google

Kirkland, Washington, United States (On-Site)
1 Week ago
Google - Product Manager, Activity and Sleep Coaching

Google

Mountain View, California, United States (On-Site)
3 Days ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Vision Generative AI)

ByteDance

San Jose, California, United States (On-Site)
1 Week ago
Rackspace Technology - Practice Manager, Data Science, AI and ML

Rackspace Technology

(Remote)
4 Months ago
ByteDance - Machine Learning Scientist Graduate (Scaling AI for Biology (AI-for-Science))

ByteDance

Seattle, Washington, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

San Jose, California, United States (On-Site)

San Jose, California, United States (Hybrid)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Taguig, Metro Manila, Philippines (Hybrid)

Los Angeles, California, United States (On-Site)

New York, New York, United States (On-Site)

Pasig, Metro Manila, Philippines (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug