Algorithm Engineer - Audio Understanding

1 Month ago • All levels • Research & Development

About the job

Job Description

ByteDance is seeking an Algorithm Engineer - Audio Understanding to join its speech team. The ideal candidate will be a highly skilled individual with experience in machine learning and deep learning, particularly in areas like speech recognition, speech translation, and multimodal understanding. The role involves conducting cutting-edge research and development in speech/audio foundation models, contributing to the advancement of audio understanding, and driving the practical application of these technologies in various ByteDance products, including TikTok. Responsibilities include developing and implementing speech/audio models for closed-captions, voice dubbing, and video understanding.
Must have:
  • Master's or PhD in CS, Math, Engineering or related field
  • Experience in ML/DL, including speech recognition, translation, and self-supervised learning
  • Strong coding skills in C/C++ and Python
  • Ability to work collaboratively in a fast-paced environment
Good to have:
  • Publications in top-tier ML/DL venues
  • Deep understanding of Large Language models
  • Familiar with distributed computing and large-scale model training
  • Familiar with deep learning frameworks like TensorFlow and PyTorch
  • Familiar with engineering principles and best practices
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.
Responsibilities
ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the Team The speech team's mission is to empower content understanding, interaction and creation across TikTok and other products using speech & audio related technologies. We focus on cutting-edge R&D in areas like speech & audio, music processing, natural language understanding and multimodal deep learning. We are looking for top talents to work on these exciting technologies, integrate them into various TikTok and other products and ultimately bring joy to our global user base! Responsibilities • Conduct cutting-edge research and development in speech/audio foundation models • Contribute to the advancement of audio understanding, including multilingual speech recognition, speech translation, multimodal understanding and etc. • Focus on and drive the practical application of relevant technologies in business scenarios, including but not limited to closed-captions, voice dubbing, video understanding.
Qualifications
Qualifications • Master's or PhD in computer science, mathematics, engineering or related field • Experience in one or more areas of machine learning and deep learning, including but not limited to: - Automatic Speech Recognition - Automatic Speech Translation - Speech/audio self-supervised learning and foundation models - Speaker recognition and verification - Speech emotion recognition - Multimodal foundation models - Large Language Model pretraining and finetuning Preferred Qualifications • Publications in top-tier ML/DL venues such as NeurIPS, ICLR, ICML, AAAI and speech venues such as ICASSP, ASRU, Interspeech • Deep understanding of Large Language models • Familiar with distributed computing and large scale model training • Familiar with deep learning frameworks such as Tensorflow and Pytorch. • Familiar with engineering principles and best practices. • Highly competent in algorithms and programming; Strong coding skills in C/C++ and Python. • Ability to work collaboratively in a fast-paced, multi-functional environments ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

View All Jobs

Get notified when new jobs are added by ByteDance

Similar Jobs

Captions - Research Engineer, Machine Learning

Captions, United States (On-Site)

PwC - Gen AI - Senior Associate

PwC, India (On-Site)

Anavation - Lead Software Engineer

Anavation, United States (On-Site)

Riot Games - Manager, Software Engineering - Player Platform SDK

Riot Games, United States (On-Site)

Nasdaq - Software Developer - AxiomSL

Nasdaq, India (On-Site)

ByteDance - NLP Researcher - AI Lab Research

ByteDance, Singapore (On-Site)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Virtuos - Machine Learning Engineer

Virtuos, Singapore (On-Site)

Genies - Machine Learning Engineer: 3D Generative AI

Genies, United States (Remote)

Trendyol - Data Science Professionals - Trendyol GO

Trendyol, Türkiye (Hybrid)

SKF Group - Data Scientist

SKF Group, India (On-Site)

Paypal - Lead Principal ML Engineer, AI Solutions

Paypal, United States (On-Site)

Netflix - Product Manager, ML Platform: Training

Netflix, United States (Hybrid)

Hitachi - Senior AI Data Scientist

Hitachi, India (On-Site)

Meta - Software Engineer, Machine Learning

Meta, United States (On-Site)

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Anavation - Senior iOS Software Engineer

Anavation, United States (On-Site)

Spydra - Senior Rust Developer

Spydra, India (On-Site)

Nintendo - Senior Engineer, CPU Debugger (NTD)

Nintendo, United States (On-Site)

NI (National Instruments) - Senior Software Engineer - Labview

NI (National Instruments), India (On-Site)

ByteDance - Video Codec Firmware Engineer - Multimedia Lab

ByteDance, United States (On-Site)

Rockstar Games - C++ Software Engineer (Anti-Cheat), FiveM

Rockstar Games, United Kingdom (On-Site)

Zoox - Embedded Software Engineer - Platforms

Zoox, United States (Hybrid)

The Walt Disney Company - Production Engineering Intern (Summer 2025)

The Walt Disney Company, Canada (On-Site)

Get notifed when new similar jobs are uploaded