Research Scientist for Generative AI, Multimodal and LLM

3 Months ago • 1-3 Years • Research Development

Job Summary

Job Description

ByteDance's Doubao (Seed) Team seeks a Research Scientist for Generative AI, Multimodal and LLMs. The team develops core technology and business, covering deep learning, computer vision, speech, music, and language for content understanding, creation, and interactive experiences. Responsibilities include cutting-edge R&D in computer vision, speech, audio, music, or language; transferring advanced technologies to ByteDance products; and exploring new AI-core products. Required qualifications include practical experience in areas like large language models, speech/music generation, multimodal generation, diffusion models, GANs, transformers, large-scale training, RLHF, and generative AI; strong coding skills in C/C++ and Python; and algorithm competency. Preferred qualifications include 1-3 years of relevant research, publications in top-tier venues, and strong teamwork and independent work abilities.
Must have:
  • Experience in large language models, speech/music generation, multimodal generation
  • Strong coding skills in C/C++ and Python
  • Competency in algorithms
  • Conduct cutting-edge research and development
Good to have:
  • Publications in top-tier venues (ICLR, ICML, etc.)
  • Excellent teamwork and independent work abilities

Job Details

Responsibilities
About the team We are the team that is responsible for the core technology and business development. It covers a variety of technical fields, including deep learning, computer vision, speech, music, language, and provides cutting-edge content understanding, content creation, interactive experience, and consumption capabilities and industry solutions to other business lines within the company and external partners in various forms. Responsibilities - Conduct cutting-edge research and development in computer vision, speech, audio, music or language - Transfer advanced technologies to ByteDance products; - Explore new products with artificial intelligence technology at its core.
Qualifications
Minimum Qualifications - Practical experience in one or more areas of computer vision, including but not limited to large language model, speech/music understanding and generation, multimodal generation, diffusion model, GAN, transformer for generation tasks, large-scale training, RLHF, and generative AI. - Highly competent in algorithms and programming - Strong coding skills in C/C++ and Python. Preferred Qualifications: - 1-3 years of research in the related area mentioned above - Publications in top-tier venues such as ICLR, ICML, ICASSP, CVPR, ECCV, ICCV, NeurIPS and etc. - Work and collaborate well with team members. - Ability to work independently.
Job Information
About Doubao (Seed)

Founded in 2023, the ByteDance Doubao (Seed) Team, is dedicated to pioneering advanced AI foundation models. Our goal is to lead in cutting-edge research and drive technological and societal advancements.

With a strong commitment to AI, our research areas span deep learning, reinforcement learning, Language, Vision, Audio, AI Infra and AI Safety. Our team has labs and research positions across China, Singapore, and the US.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at

Similar Jobs

NCR Atleos - Software Engineer II - C++ Developer

NCR Atleos

Hyderabad, Telangana, India (On-Site)
3 Weeks ago
Bungie - Associate UI Engineer

Bungie

Bellevue, Washington, United States (Hybrid)
3 Weeks ago
Ubisoft - Senior Gameplay Programmer 3C

Ubisoft

Montpellier, Occitanie, France (On-Site)
4 Months ago
Unity - Principal SDK Engineer

Unity

San Francisco, California, United States (On-Site)
4 Weeks ago
bytedance - Research Engineer Intern

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago
PayPal - Sr Dir, AI Technology - Feature Engrg Lead

PayPal

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
EMA - Senior AI Applications Engineer

EMA

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Dynamis Inc - Principle Investigator/Senior Scientist

Dynamis Inc

Huntsville, Alabama, United States (On-Site)
3 Months ago
gameforge  - Software Developer AI

gameforge

Karlsruhe, Baden-Württemberg, Germany (Hybrid)
1 Month ago
Yahoo - ML Engineer

Yahoo

United States (Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PhonePe - Product Solution Engineer

PhonePe

Pune, Maharashtra, India (On-Site)
4 Weeks ago
Aristocrat - Sr Engineer II - C++ Developer

Aristocrat

Noida, Uttar Pradesh, India (Hybrid)
1 Month ago
Google - Software Engineer, Android, Photos

Google

Sydney, New South Wales, Australia (On-Site)
3 Months ago
Visual Concepts - Technical Artist

Visual Concepts

California, United States (Remote)
4 Weeks ago
bytedance - Algorithm Engineer Intern (Multimedia Lab - Video Processing and Enhancement)

bytedance

San Jose, California, United States (On-Site)
3 Months ago
creative assembly - Lead AI Programmer

creative assembly

Horsham, England, United Kingdom (Hybrid)
2 Months ago
Ethernovia - Senior ASIC Design Verification Engineer

Ethernovia

Canada (Remote)
2 Months ago
Techland - Junior Programmer

Techland

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
Aristocrat - Software Engineer - Tools

Aristocrat

North Ryde, New South Wales, Australia (Hybrid)
4 Months ago
Valve corporation - Steam Partner Technical Account Manager

Valve corporation

Bellevue, Washington, United States (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

Evolution  - In- Studio LIVE Game Presenter - Full Benefits, $20 - $25/hr- NO EXPERIENCE NECESSARY

Evolution

Atlantic City, New Jersey, United States (On-Site)
1 Year ago
Apple - Cloud Network Observability Architect

Apple

Sunnyvale, California, United States (On-Site)
1 Month ago
Coherent corp. - Site Leader

Coherent corp.

Starkville, Mississippi, United States (On-Site)
2 Months ago
Pulse Point - Senior Data Engineer, DP Team

Pulse Point

United States (Remote)
9 Months ago
HCL Tech - Administrator

HCL Tech

Ohio, United States (On-Site)
2 Months ago
Axel springer - Senior Research Analyst - Pharmaceutical and Biotech Regulation

Axel springer

Arlington, Virginia, United States (Hybrid)
3 Weeks ago
Apple - Graphics, Games, and Machine Learning - Gaming Experience Test Engineer

Apple

Austin, Texas, United States (On-Site)
2 Months ago
Autodesk - Principal Software Engineer, Data Streaming

Autodesk

San Francisco, California, United States (On-Site)
1 Year ago
The New York Times - Newsletter Editor, NYT Cooking/Food

The New York Times

New York, United States (Hybrid)
1 Month ago
fluence - Lead Systems Engineer (Sustaining)

fluence

Houston, Texas, United States (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Postman - Software Engineer - Applied AI Engineer

Postman

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Philips - R&D Transducers Leader

Philips

Reedsville, Pennsylvania, United States (On-Site)
1 Month ago
bytedance - Machine Learning Engineer Intern (Search-TikTok Recommendation)

bytedance

San Jose, California, United States (On-Site)
4 Months ago
Backbone - Senior Consumer Insights Marketing Researcher

Backbone

Atherton, California, United States (Hybrid)
1 Year ago
Agara labs - Lead / Staff ML Scientist - Speech

Agara labs

Bengaluru, Karnataka, India (Remote)
3 Months ago
appier - Senior Software Engineer, Machine Learning

appier

Taipei City, Taiwan (On-Site)
1 Month ago
BioFire - Associate Staff Scientist

BioFire

Hazelwood, Missouri, United States (On-Site)
2 Months ago
Nintendo - Sr. Engineer, ML (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
6 Months ago
Roblox - Senior Engineering Manager - AI Enablement

Roblox

San Mateo, California, United States (On-Site)
1 Month ago
WongDoody - Digital Creative - AI Workflow Specialist

WongDoody

Stuttgart, Baden-Württemberg, Germany (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

San Jose, California, United States (On-Site)

Pasig, Metro Manila, Philippines (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by bytedance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug