Research Engineer - Multimodal Model

7 Months ago • 3 Years + • Artificial Intelligence

Job Summary

Job Description

The ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models, conducting research in NLP, CV, and speech recognition. The team has built a proprietary general-purpose model with multimodal capabilities powering over 50 ByteDance apps and business lines. As a Research Engineer, you'll explore large-scale visual models, perform system optimization, conduct research in computer vision, NLP, machine learning, and AI, publish research results, and contribute to the development of new technologies and products. You'll work with large-scale datasets, and have impactful publications in leading AI conferences and journals.
Must have:
  • Research and practical experience in computer vision areas
  • Experience with vision-language models
  • Coding skills in C/C++ and Python
  • Collaboration and independent work skills
Good to have:
  • Work with large-scale datasets and build large-scale datasets
  • Impactful publications in leading AI conferences and journals
  • Winning international academic competitions
  • Proficiency in differentiable programming frameworks like PyTorch, TensorFlow, JAX

Job Details

Responsibilities
Established in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress. With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas including natural language processing (NLP), computer vision (CV), and speech recognition and generation. It has labs and researcher roles in China, Singapore, and the US. Leveraging substantial data and computing resources and through continued investment in these domains, our team has built a proprietary general-purpose model with multimodal capabilities. In the market, Doubao models power over 50 ByteDance apps and business lines, including Doubao, Coze, and Dreamina, and was launched to external enterprise clients through Volcano Engine. The Doubao app is the most used AIGC app in China. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the team Welcome to the GAI-Vision team, where we lead the way in developing foundational models for multi-modal visual understanding and generation. Our mission is to solve the challenge of visual intelligence in AI. We conduct cutting-edge research on areas such as vision and language, large-scale vision models, and generative foundation models. Comprising experienced research scientists and engineers, our team is dedicated to pushing the boundaries of foundation model research and implementing our innovations across diverse application scenarios. We foster a feedback-driven environment to continuously enhance our foundation technologies. Come join us in shaping the future of AI and transforming the product experience for users worldwide. Responsibilities - Explore large-scale/ultra-large-scale visual models and perform system optimization. Data construction, instruction fine-tuning, preference alignment, model optimization. - Conduct cutting-edge research and development in computer vision, natural language processing, machine learning and general artificial intelligence, especially in the areas of multi-modality, vision and language, etc. - Publish our latest research results, and help to build our brand in the research community. - Explore vision/multi-modality application models, and contribute to the development of new technologies and products leveraging artificial intelligence.
Qualifications
Minimum Qualifications - Possess research and practical experience in one or more areas of computer vision, encompassing multi-modal understanding, vision-language models (e.g., video captioning, VQA, Text-to-video retrieval, and other related topics), large-scale training, RLHF, multimodal generation (e.g., text-to-image, image, video, 3D generation and editing), diffusion models, GANs, transformers for generation tasks. - At least 3 years of working experience in research or with relevant working experiences; - Experience with vision-language models and apply them in various downstream tasks. - Possess coding skills in C/C++ and Python. - Collaborate effectively with team members. - Ability to work independently. Preferred Qualifications - Work with large-scale datasets, and build large-scale datasets to scale up foundation models. - Demonstrate impactful publications in leading AI conferences (e.g., CVPR, ECCV, ICCV, NeurIPS, ICLR, SIGGRAPH, SIGGRAPH Asia) and journals (e.g., TPAMI, JMLR). - Achievement as a winner in international academic competitions. - Proficiency in one of the differentiable programming frameworks such as PyTorch, TensorFlow, JAX, etc. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

Siemens  - Gen AI engineer

Siemens

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
bytedance - Research Scientist (Machine Learning for Science (AI-for-Science))

bytedance

Seattle, Washington, United States (On-Site)
2 Months ago
Hedra - Research Scientist

Hedra

San Francisco, California, United States (On-Site)
2 Months ago
Synechron - Senior Data Scientist

Synechron

Pune, Maharashtra, India (On-Site)
1 Week ago
GoTo Group - Lead Data Scientist - KYC

GoTo Group

Singapore (On-Site)
5 Months ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
3 Months ago
zoox - Senior Software Engineer - High Performance Computing

zoox

Foster City, California, United States (Hybrid)
7 Months ago
Meta - AI Research Scientist, VLLM (Vision Large Language Models) - Generative AI

Meta

Redmond, Washington, United States (On-Site)
1 Month ago
ElevenLabs - Machine Learning Researcher

ElevenLabs

Poland (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Netflix - Machine Learning Intern - Spring or Summer 2025

Netflix

Los Gatos, California, United States (On-Site)
7 Months ago
Microsoft - Member of Technical Staff, AI Data

Microsoft

Zürich, Zurich, Switzerland (On-Site)
1 Month ago
bytedance - Software Engineer Graduate (Applied Machine Learning - Engine) - 2025 Start (BS/MS)

bytedance

San Jose, California, United States (On-Site)
7 Months ago
CharacterAI - Software Engineer, Machine Learning Infrastructure

CharacterAI

New York, New York, United States (On-Site)
2 Months ago
bytedance - Algorithm Engineer - Enterprise Solution RD

bytedance

San Jose, California, United States (On-Site)
1 Month ago
nubank - Staff/Senior Staff Machine Learning Scientist

nubank

Durham, North Carolina, United States (Remote)
1 Week ago
bytedance - Research Engineer Graduate (Machine Learning Sys-US) - 2024 Start (PhD)

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago
Tencent - Senior Researcher: Artificial General Intelligence (Natural Language Processing)

Tencent

Bellevue, Washington, United States (On-Site)
9 Months ago
Electronic Arts - ML Engineer

Electronic Arts

Madrid, Community Of Madrid, Spain (Hybrid)
2 Weeks ago
bytedance - Research Scientist in Foundation Model, Music Core Machine Learning Graduates - 2024 Start (PhD)

bytedance

San Jose, California, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

bytedance - Resource Operation Manager, Volcano Engine

bytedance

Singapore (On-Site)
1 Month ago
Illuminia - Senior Software Design Quality Engineer

Illuminia

Singapore (On-Site)
1 Month ago
Thales - Head of Compensation and Benefits

Thales

Singapore (On-Site)
2 Weeks ago
Synechron - Junior Tech Support Engineer

Synechron

Singapore (On-Site)
1 Week ago
bytedance - RD Lead

bytedance

Singapore (On-Site)
7 Months ago
bytedance - Innovation Tech Solution Sales (Enterprise), SEA - BytePlus

bytedance

Singapore (On-Site)
7 Months ago
bytedance - Software Engineer Intern, Authorization

bytedance

Singapore (On-Site)
2 Months ago
Illuminia - ML/Software Engineer 1 - MLOps

Illuminia

Singapore, Singapore (On-Site)
3 Weeks ago
Spaulding Ridge - ASEAN Sales Leader

Spaulding Ridge

Singapore (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Hedra - Applied Research Scientist

Hedra

San Francisco, California, United States (On-Site)
2 Months ago
bytedance - Student Researcher (Doubao (Seed) - Foundation Model AI Platform) - 2025 Start (PhD)

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago
Meta - Visiting Senior Research Scientist

Meta

Paris, Île-de-France, France (On-Site)
7 Months ago
Meta - Research Scientist Intern, Language and Multimodal Research for MetaAI (PhD)

Meta

Seattle, Washington, United States (On-Site)
6 Months ago
bytedance - Research Scientist for Generative AI, Multimodal and LLM

bytedance

San Jose, California, United States (On-Site)
1 Month ago
bytedance - Senior Software Engineer / Researcher, AI-Native Database Systems

bytedance

San Jose, California, United States (On-Site)
1 Month ago
Scale AI - Machine Learning Engineer, International Public Sector

Scale AI

United Kingdom (On-Site)
7 Months ago
Keywords Studios - Technical Research Associate - AI

Keywords Studios

(Remote)
2 Months ago
Blockville Digital Assets - AI Technology Specialist for Game Development

Blockville Digital Assets

İstanbul, Türkiye (On-Site)
10 Months ago
Google - CPU AI Workloads and Performance Architect

Google

Mountain View, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Tokyo, Japan (On-Site)

View All Jobs

Get notified when new jobs are added by bytedance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug