Research Scientist, Multimodal Foundation Model

8 Months ago • All levels • Research Development

Job Summary

Job Description

Research Scientist specializing in computer vision, deep learning, and AI. Develop multimodal foundation models for image, video, and 3D generation. Expertise in diffusion models, GANs, transformers, and large-scale training. PhD in related field and strong publication record required.
Must have:
  • PhD in CS
  • Computer Vision
  • Deep Learning
  • Multimodal Generation
Good to have:
  • Diffusion Models
  • GANs
  • Transformers
  • Large-scale Training
Perks:
  • Strong Research Team
  • Impactful Contributions

Job Details

Responsibilities
Established in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress. With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas including natural language processing (NLP), computer vision (CV), and speech recognition and generation. It has labs and researcher roles in China, Singapore, and the US. Leveraging substantial data and computing resources and through continued investment in these domains, our team has built a proprietary general-purpose model with multimodal capabilities. In the market, Doubao models power over 50 ByteDance apps and business lines, including Doubao, Coze, and Dreamina, and was launched to external enterprise clients through Volcano Engine. The Doubao app is the most used AIGC app in China. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the team Welcome to the GAI-Vision team, where we lead the way in developing foundational models for multi-modal visual understanding and generation. Our mission is to solve the challenge of visual intelligence in AI. We conduct cutting-edge research on areas such as vision and language, large-scale vision models, and generative foundation models. Comprising experienced research scientists and engineers, our team is dedicated to pushing the boundaries of foundation model research and implementing our innovations across diverse application scenarios. We foster a feedback-driven environment to continuously enhance our foundation technologies. Come join us in shaping the future of AI and transforming the product experience for users worldwide. Responsibilities - Conduct research on computer vision, deep learning and AI, addressing a wide range of challenges in deep learning, computer vision, AIGC, graphics, large multi-modality models, diffusion models, video generation, 3D generation, video understanding, self-supervised learning, and autoregressive models. - Explore the application of large-scale/super-large-scale visual foundation models, and contribute to the development of new technologies and products leveraging artificial intelligence.
Qualifications
Minimum Qualifications - Hold a Ph.D. degree in computer science, electrical engineering, statistics, applied mathematics, data science or related disciplines. - Possess research and practical experience in one or more areas of computer vision, encompassing multimodal generation (e.g., text-to-image, image, video, 3D generation and editing), diffusion models, GANs, transformers for generation tasks, vision-language models, large-scale training and RLHF. - Proven track record of high-impact research. - Collaborate effectively with team members. - Ability to work independently. Preferred Qualifications - Demonstrate impactful publications in leading AI conferences (e.g., CVPR, ECCV, ICCV, NeurIPS, ICLR, SIGGRAPH, SIGGRAPH Asia) and journals (e.g., TPAMI, JMLR). - Achievement as a winner in international academic competitions. - Proficiency in one of the differentiable programming frameworks such as PyTorch, TensorFlow, JAX, etc. - Possess coding skills in C/C++ and Python. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

NVIDIA - System Performance and Power Profiling Engineer

NVIDIA

Santa Clara, California, United States (Remote)
3 Months ago
bytedance - Senior Software Engineer(Financing Product), Global Payments

bytedance

San Jose, California, United States (On-Site)
8 Months ago
bytedance - Senior Backend Software Engineer

bytedance

San Jose, California, United States (On-Site)
2 Months ago
Playdead - Systems Programmer

Playdead

Copenhagen, Denmark (On-Site)
10 Months ago
Oxide Interactive - 3D Graphics Engineer

Oxide Interactive

Timonium, Maryland, United States (On-Site)
1 Month ago
Well - Senior Machine Learning Engineer

Well

New York, United States (On-Site)
3 Weeks ago
bytedance - Research Scientist - Multimedia Lab

bytedance

San Diego, California, United States (On-Site)
3 Months ago
Sprinkler - Senior Research Scientist

Sprinkler

Gurugram, Haryana, India (On-Site)
1 Month ago
Lilith games - Algorithm Engineer (Multimodal AI)

Lilith games

Shanghai, Shanghai, China (On-Site)
17 Hours ago
bytedance - Research Scientist Graduate (Foundation Model - Vision and Language)

bytedance

Seattle, Washington, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Suki - Staff Machine Learning Engineer (NLP)

Suki

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Alpha Sense - Payroll Specialist

Alpha Sense

United States (Remote)
2 Weeks ago
playrix  - Senior C++ Software Engineer (Tools)

playrix

Serbia (Remote)
8 Months ago
Bosch Group - PreMaster Program | Embedded Systems for Innovative Products

Bosch Group

Kusterdingen, Baden-Württemberg, Germany (On-Site)
1 Week ago
appier - Senior Software Engineer, Backend Development (BotBonnie)

appier

Taipei City, Taiwan (On-Site)
1 Month ago
Behaviour Interactive - Principal Gameplay Programmer - Dead by Daylight | Programmeur·se jouabilité Principal·e - Dead by Daylight

Behaviour Interactive

Middlesbrough, England, United Kingdom (Hybrid)
9 Months ago
Veeam Software - Middle/Senior C++ Developer (macOS&Linux)

Veeam Software

Poland (Remote)
1 Month ago
rivos - DPA Performance Modeling - Intern

rivos

Santa Clara, California, United States (On-Site)
8 Months ago
Scout - Engineer, Thermal Controls and Calibration

Scout

Novi, Michigan, United States (Hybrid)
1 Month ago
Qualcomm - Auto Systems Staff Engineer

Qualcomm

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

bytedance - Product Manager CDN, Infrastructure Engineering

bytedance

Singapore (On-Site)
8 Months ago
Razer - Data Analyst

Razer

Singapore (On-Site)
2 Weeks ago
CME Group - APAC Commercials Manager

CME Group

Singapore (On-Site)
1 Week ago
bytedance - Software Engineer - Low-code Platform

bytedance

Singapore (On-Site)
2 Months ago
OKX - Senior Business Development Manager, Earn DeFi

OKX

Singapore (On-Site)
1 Month ago
Dentsu - Sales Enablement Executive

Dentsu

Singapore (On-Site)
1 Month ago
Mcdonalds - Director of Global Supply Chain Field Service

Mcdonalds

Singapore (On-Site)
2 Weeks ago
PwC - Risk Services – RPA Development Specialist

PwC

Singapore (On-Site)
9 Months ago
OKX - Data Engineer

OKX

Singapore, Singapore (On-Site)
8 Months ago
Autodesk - Software Development Engineer- C++

Autodesk

Singapore (Hybrid)
1 Year ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Google - Student Researcher, PhD, Winter/Summer 2025

Google

(On-Site)
7 Months ago
Salesforce - 2025 PhD Intern - AI Research, Singapore

Salesforce

Singapore, Singapore (On-Site)
8 Months ago
Haleon - Consumer Scientist

Haleon

Gurugram, Haryana, India (On-Site)
3 Weeks ago
Apple - Machine Learning Manager - Strategic Data Solutions

Apple

Austin, Texas, United States (On-Site)
1 Month ago
Instawork - Senior / Staff ML Engineer

Instawork

San Francisco, California, United States (Hybrid)
1 Month ago
Thumbtack - Staff Experience Researcher

Thumbtack

United States (Remote)
1 Month ago
Mozilla - Staff Machine Learning Engineer, Gen AI

Mozilla

United Kingdom (Remote)
8 Months ago
Apple - Computational Support for Machine Learning and Transformers

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Qualcomm - Staff Embedded Software Engineer (C/C++), Machine Learning

Qualcomm

Markham, Ontario, Canada (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

Seattle, Washington, United States (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by bytedance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug