Research Scientist - Multimodal Foundation Model - 2025 Start

4 Months ago • All levels • Artificial Intelligence

Job Summary

Job Description

ByteDance's Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. They are seeking a Research Scientist to join their GAI-Vision team, where they will conduct research on computer vision, deep learning and AI. Responsibilities include exploring applications of large-scale/super-large-scale visual foundation models, contributing to the development of new technologies and products leveraging artificial intelligence, and addressing a wide range of challenges in deep learning, computer vision, AIGC, graphics, large multi-modality models, diffusion models, video generation, 3D generation, video understanding, self-supervised learning, and autoregressive models.
Must have:
  • Ph.D. in computer science, electrical engineering, statistics, applied mathematics, data science or related disciplines.
  • Research & practical experience in computer vision, multimodal generation, diffusion models, GANs, transformers, vision-language models, large-scale training, RLHF.
  • Proven track record of high-impact research.
  • Effective collaboration with team members.
  • Ability to work independently.
Good to have:
  • Impactful publications in leading AI conferences (e.g., CVPR, ECCV, ICCV, NeurIPS, ICLR, SIGGRAPH, SIGGRAPH Asia) and journals (e.g., TPAMI, JMLR).
  • Achievement as a winner in international academic competitions.
  • Proficiency in one of the differentiable programming frameworks such as PyTorch, TensorFlow, JAX, etc.
  • Coding skills in C/C++ and Python.

Job Details

Responsibilities
ByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance sponsorship of a visa. Established in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress. With a long-term vision and a strong commitment to the AI field, the team conducts research in a range of areas including natural language processing (NLP), computer vision (CV), and speech recognition and generation. It has labs and researcher roles in China, Singapore, and the US. Leveraging substantial data and computing resources and through continued investment in these domains, our team has built a proprietary general-purpose model with multimodal capabilities. In the Chinese market, Doubao models power over 50 ByteDance apps and business lines, including Doubao, Coze, and Dreamina, and was launched to external enterprise clients through Volcano Engine. The Doubao app is the most used AIGC app in China. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the team Welcome to the GAI-Vision team, where we lead the way in developing foundational models for multi-modal visual understanding and generation. Our mission is to solve the challenge of visual intelligence in AI. We conduct cutting-edge research on areas such as vision and language, large-scale vision models, and generative foundation models. Comprising experienced research scientists and engineers, our team is dedicated to pushing the boundaries of foundation model research and implementing our innovations across diverse application scenarios. We foster a feedback-driven environment to continuously enhance our foundation technologies. Come join us in shaping the future of AI and transforming the product experience for users worldwide. We are looking for talented individuals to join us in 2025. As a graduate, you will get unparalleled opportunities for you to kickstart your career, pursue bold ideas and explore limitless growth opportunities. Co-create a future driven by your inspiration with ByteDance. Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to ByteDance and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early. Responsibilities - Conduct research on computer vision, deep learning and AI, addressing a wide range of challenges in deep learning, computer vision, AIGC, graphics, large multi-modality models, diffusion models, video generation, 3D generation, video understanding, self-supervised learning, and autoregressive models. - Explore the application of large-scale/super-large-scale visual foundation models, and contribute to the development of new technologies and products leveraging artificial intelligence.
Qualifications
Minimum Qualifications - Hold a Ph.D. degree in computer science, electrical engineering, statistics, applied mathematics, data science or related disciplines. - Possess research and practical experience in one or more areas of computer vision, encompassing multimodal generation (e.g., text-to-image, image, video, 3D generation and editing), diffusion models, GANs, transformers for generation tasks, vision-language models, large-scale training and RLHF. - Proven track record of high-impact research. - Collaborate effectively with team members. - Ability to work independently. Preferred Qualifications - Demonstrate impactful publications in leading AI conferences (e.g., CVPR, ECCV, ICCV, NeurIPS, ICLR, SIGGRAPH, SIGGRAPH Asia) and journals (e.g., TPAMI, JMLR). - Achievement as a winner in international academic competitions. - Proficiency in one of the differentiable programming frameworks such as PyTorch, TensorFlow, JAX, etc. - Possess coding skills in C/C++ and Python. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. By submitting an application for this role, you accept and agree to our global applicant privacy policy, which may be accessed here: https://jobs.bytedance.com/en/legal/privacy. If you have any questions, please reach out to us at apac-earlycareers@bytedance.com

Similar Jobs

Twitch - Software Development Engineer - Safety ML

Twitch

San Francisco, California, United States (On-Site)
5 Days ago
bosh group india - Asst Manager / Sr. Engineer - Data Scientist Prognostics

bosh group india

Karnataka, India (On-Site)
3 Months ago
Smarsh - Lead Machine Learning Engineer

Smarsh

India (Hybrid)
5 Months ago
Krafton  - Applied Research Engineer - Reinforcement Learning

Krafton

Seoul, South Korea (On-Site)
6 Days ago
ByteDance - Research Scientist, Foundation Model, Speech Understanding

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Keywords Studios (Player Support) - Technical Research Associate - AI

Keywords Studios (Player Support)

(Remote)
6 Days ago
PAPAYA - Data Scientist

PAPAYA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Inworld AI - Forward Deployed Engineer - USA

Inworld AI

Mountain View, California, United States (On-Site)
5 Months ago
Keywords Studios (Player Support) - AI - Research Associate (Prompts)

Keywords Studios (Player Support)

Silesian Voivodeship, Poland (On-Site)
2 Weeks ago
AI Fund - Curriculum Product Manager

AI Fund

United States (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Match Group - Machine Learning Engineer (MG AI)

Match Group

Seoul, South Korea (On-Site)
5 Months ago
NVIDIA - Director, AI Software

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
Rackspace Technology - Machine Learning Architect (AWS)

Rackspace Technology

San Diego, California, United States (Remote)
6 Days ago
Hedra - Applied Research Scientist

Hedra

New York, New York, United States (On-Site)
5 Days ago
Dream11 - Lead ML Scientist

Dream11

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Meta - Research Scientist, Computer Vision for Generative AI (PhD)

Meta

Menlo Park, California, United States (On-Site)
4 Months ago
NVIDIA - Full Stack Developer, AI and LLM

NVIDIA

California, United States (Hybrid)
3 Days ago
Warner Bros Games - Senior Machine Learning Engineer

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
NVIDIA - Senior System Software Engineer - Triton Inference Server

NVIDIA

California, United States (Remote)
2 Months ago
NVIDIA - Senior Solution Engineer, Mission Control

NVIDIA

Santa Clara, California, United States (On-Site)
6 Days ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

ByteDance - Research Scientist, Foundation Model, Vision

ByteDance

Singapore (On-Site)
5 Months ago
Windranger Labs - Product Design Lead

Windranger Labs

Singapore, Singapore (Remote)
6 Days ago
Razer - Solutions Architect

Razer

Singapore (On-Site)
6 Months ago
ByteDance - Site Reliability Engineer, Traffic Platform

ByteDance

Singapore (On-Site)
2 Months ago
ByteDance - Datacenter Operations Engineer (DCO), Infrastructure Engineering

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Backend Engineer Lead - ARK Large Model Platform (Singapore)

ByteDance

Singapore (On-Site)
4 Months ago
ByteDance - Security Software Engineer

ByteDance

Singapore (On-Site)
5 Months ago
Garena - Legal Assistant/Associate

Garena

Singapore (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

ByteDance - Large Language Model Algorithm Engineer - Volcano Ark

ByteDance

Singapore (On-Site)
5 Months ago
Microsoft - Member of Technical Staff - Full Stack Software Engineer

Microsoft

Redmond, Washington, United States (On-Site)
1 Week ago
ByteDance - LLM Software Engineer/Researcher (Applied Machine Learning)

ByteDance

Seattle, Washington, United States (On-Site)
6 Days ago
Canva - Senior Machine Learning Researcher (GenAI) - Canva Austria (f/m/x)

Canva

Vienna, Vienna, Austria (Remote)
4 Months ago
Meta - Software Engineer, Machine Learning

Meta

San Francisco, California, United States (On-Site)
4 Months ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Burlingame, California, United States (On-Site)
4 Months ago
Zoox - Senior/Staff Software Engineer - Simulator

Zoox

Seattle, Washington, United States (Hybrid)
5 Months ago
ByteDance - Research Scientist Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
SmileGate - AI Developer ([LOST ARK Mobile])

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

New York, New York, United States (On-Site)

Jakarta, Jakarta, Indonesia (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Singapore (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug