Research Engineer - Multimodal Model

9 Months ago • 3 Years + • Research Development

Job Summary

Job Description

The ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models, conducting research in NLP, CV, and speech recognition. The team has built a proprietary general-purpose model with multimodal capabilities powering over 50 ByteDance apps and business lines. As a Research Engineer, you'll explore large-scale visual models, perform system optimization, conduct research in computer vision, NLP, machine learning, and AI, publish research results, and contribute to the development of new technologies and products. You'll work with large-scale datasets, and have impactful publications in leading AI conferences and journals.
Must have:
  • Research and practical experience in computer vision areas
  • Experience with vision-language models
  • Coding skills in C/C++ and Python
  • Collaboration and independent work skills
Good to have:
  • Work with large-scale datasets and build large-scale datasets
  • Impactful publications in leading AI conferences and journals
  • Winning international academic competitions
  • Proficiency in differentiable programming frameworks like PyTorch, TensorFlow, JAX

Job Details

Responsibilities
Established in 2023, the ByteDance Doubao (Seed) Team is dedicated to building industry-leading AI foundation models. We aim to do world-leading research and foster both technological and social progress. With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas including natural language processing (NLP), computer vision (CV), and speech recognition and generation. It has labs and researcher roles in China, Singapore, and the US. Leveraging substantial data and computing resources and through continued investment in these domains, our team has built a proprietary general-purpose model with multimodal capabilities. In the market, Doubao models power over 50 ByteDance apps and business lines, including Doubao, Coze, and Dreamina, and was launched to external enterprise clients through Volcano Engine. The Doubao app is the most used AIGC app in China. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the team Welcome to the GAI-Vision team, where we lead the way in developing foundational models for multi-modal visual understanding and generation. Our mission is to solve the challenge of visual intelligence in AI. We conduct cutting-edge research on areas such as vision and language, large-scale vision models, and generative foundation models. Comprising experienced research scientists and engineers, our team is dedicated to pushing the boundaries of foundation model research and implementing our innovations across diverse application scenarios. We foster a feedback-driven environment to continuously enhance our foundation technologies. Come join us in shaping the future of AI and transforming the product experience for users worldwide. Responsibilities - Explore large-scale/ultra-large-scale visual models and perform system optimization. Data construction, instruction fine-tuning, preference alignment, model optimization. - Conduct cutting-edge research and development in computer vision, natural language processing, machine learning and general artificial intelligence, especially in the areas of multi-modality, vision and language, etc. - Publish our latest research results, and help to build our brand in the research community. - Explore vision/multi-modality application models, and contribute to the development of new technologies and products leveraging artificial intelligence.
Qualifications
Minimum Qualifications - Possess research and practical experience in one or more areas of computer vision, encompassing multi-modal understanding, vision-language models (e.g., video captioning, VQA, Text-to-video retrieval, and other related topics), large-scale training, RLHF, multimodal generation (e.g., text-to-image, image, video, 3D generation and editing), diffusion models, GANs, transformers for generation tasks. - At least 3 years of working experience in research or with relevant working experiences; - Experience with vision-language models and apply them in various downstream tasks. - Possess coding skills in C/C++ and Python. - Collaborate effectively with team members. - Ability to work independently. Preferred Qualifications - Work with large-scale datasets, and build large-scale datasets to scale up foundation models. - Demonstrate impactful publications in leading AI conferences (e.g., CVPR, ECCV, ICCV, NeurIPS, ICLR, SIGGRAPH, SIGGRAPH Asia) and journals (e.g., TPAMI, JMLR). - Achievement as a winner in international academic competitions. - Proficiency in one of the differentiable programming frameworks such as PyTorch, TensorFlow, JAX, etc. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

Aptive - Test Engineer

Aptive

Braga, Braga, Portugal (On-Site)
2 Months ago
Black Bery - QNX- Field Application Engineer/Sales Engineer

Black Bery

Tokyo, Japan (On-Site)
2 Months ago
Zscaler - Principal Software Engineer - Windows OS

Zscaler

San Jose, California, United States (Hybrid)
1 Month ago
NVIDIA - Research Scientist - Design Automation

NVIDIA

Taipei City, Taiwan (On-Site)
6 Months ago
Apple - GNSS RF System Engineer

Apple

San Diego, California, United States (On-Site)
1 Week ago
Match Group - Senior ML Software Engineering Team Leader

Match Group

Seoul, South Korea (Hybrid)
9 Months ago
Coupa - Senior Software Engineer, Applied AI

Coupa

Pune, Maharashtra, India (Hybrid)
1 Month ago
HP - Junior Machine Learning Engineer

HP

Sant Cugat Del Vallès, Catalonia, Spain (On-Site)
2 Months ago
CrowdStrike - Principal Backend Engineer, Agentic AI

CrowdStrike

United States (Remote)
2 Months ago
Snappr - AI Engineer

Snappr

Antioquia, Colombia (Remote)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

bytedance - Student Researcher (Doubao (Seed) - Machine Learning System) - 2025 Start (PhD)

bytedance

Seattle, Washington, United States (On-Site)
9 Months ago
Ubisoft - Tools Programmer

Ubisoft

Lyon, Auvergne-Rhône-Alpes, France (On-Site)
5 Months ago
Nintendo - Senior Engineer - SDSG (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
1 Year ago
Figma - Software Engineer, Mobile Platform

Figma

San Francisco, California, United States (Remote)
1 Week ago
Epic Games - Senior Technical Designer

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago
bytedance - Research Scientist Graduates, Large Language Model (Doubao) - 2025 Start

bytedance

San Jose, California, United States (On-Site)
9 Months ago
Veeam Software - Middle/Senior C# Developer for Azure Backup

Veeam Software

Prague, Czechia (Remote)
2 Months ago
JMA - Senior Embedded Systems Security Engineer

JMA

New Providence, New Jersey, United States (On-Site)
8 Months ago
Qualcomm - AI SDK Software Engineer

Qualcomm

Chengdu, Sichuan, China (On-Site)
2 Months ago
Deep dive studios - Game Programmer

Deep dive studios

Singapore (Remote)
3 Years ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

Aptive - Engineering Assistant - Production

Aptive

Singapore, Singapore (On-Site)
1 Week ago
Thales - Project Manager

Thales

Singapore (On-Site)
2 Months ago
Mistral AI - Applied AI Engineer

Mistral AI

Singapore (On-Site)
2 Weeks ago
bytedance - Credit Asset Management, Treasury - Global Payment

bytedance

Singapore (On-Site)
3 Months ago
Mistral AI - Applied Scientist / Research Engineer

Mistral AI

Singapore (On-Site)
2 Months ago
Bushiroad - Sales Executive

Bushiroad

Singapore (On-Site)
12 Months ago
Saxo Bank - Head of Marketing

Saxo Bank

Singapore (On-Site)
1 Year ago
Silicon Labs - Senior Staff Design Engineer

Silicon Labs

Singapore (Hybrid)
1 Week ago
bytedance - Production System Engineer, Infrastructure Engineering

bytedance

Singapore (On-Site)
2 Months ago
bytedance - iOS Software Engineer - Global Payment - Singapore

bytedance

Singapore (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

bytedance - Student Researcher Intern (Edge Research Project for General Intelligence)

bytedance

San Jose, California, United States (On-Site)
3 Months ago
dun bradstreet - Credit Research (Intern)

dun bradstreet

Navi Mumbai, Maharashtra, India (On-Site)
1 Month ago
zoox - Senior Staff Machine Learning Engineer - Perception

zoox

Foster City, California, United States (Hybrid)
9 Months ago
Postman - Senior Applied AI Engineer

Postman

San Francisco, California, United States (Hybrid)
3 Months ago
Autodesk - Distinguished Research Scientist, Physics Informed AI

Autodesk

Toronto, Ontario, Canada (On-Site)
1 Month ago
NVIDIA - Deep Learning Performance Architect

NVIDIA

Pune, Maharashtra, India (Hybrid)
5 Months ago
bytedance - Research Scientist in LLM Foundation Models (reasoning, planning & agent)

bytedance

San Jose, California, United States (On-Site)
9 Months ago
Reddit - Senior Machine Learning Engineer, LS Embeddings

Reddit

United States (Remote)
1 Month ago
Fireworks AI - Applied Machine Learning Engineer

Fireworks AI

United States (Hybrid)
2 Weeks ago
HappyRobot - Machine Learning Engineer

HappyRobot

San Francisco, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

San Jose, California, United States (On-Site)

Pasig, Metro Manila, Philippines (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by bytedance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug