Algorithm Engineer - Audio Understanding

5 Months ago • All levels • Research & Development

Job Summary

Job Description

ByteDance is seeking an Algorithm Engineer - Audio Understanding to join its speech team. The ideal candidate will be a highly skilled individual with experience in machine learning and deep learning, particularly in areas like speech recognition, speech translation, and multimodal understanding. The role involves conducting cutting-edge research and development in speech/audio foundation models, contributing to the advancement of audio understanding, and driving the practical application of these technologies in various ByteDance products, including TikTok. Responsibilities include developing and implementing speech/audio models for closed-captions, voice dubbing, and video understanding.
Must have:
  • Master's or PhD in CS, Math, Engineering or related field
  • Experience in ML/DL, including speech recognition, translation, and self-supervised learning
  • Strong coding skills in C/C++ and Python
  • Ability to work collaboratively in a fast-paced environment
Good to have:
  • Publications in top-tier ML/DL venues
  • Deep understanding of Large Language models
  • Familiar with distributed computing and large-scale model training
  • Familiar with deep learning frameworks like TensorFlow and PyTorch
  • Familiar with engineering principles and best practices

Job Details

Responsibilities
ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the Team The speech team's mission is to empower content understanding, interaction and creation across TikTok and other products using speech & audio related technologies. We focus on cutting-edge R&D in areas like speech & audio, music processing, natural language understanding and multimodal deep learning. We are looking for top talents to work on these exciting technologies, integrate them into various TikTok and other products and ultimately bring joy to our global user base! Responsibilities • Conduct cutting-edge research and development in speech/audio foundation models • Contribute to the advancement of audio understanding, including multilingual speech recognition, speech translation, multimodal understanding and etc. • Focus on and drive the practical application of relevant technologies in business scenarios, including but not limited to closed-captions, voice dubbing, video understanding.
Qualifications
Qualifications • Master's or PhD in computer science, mathematics, engineering or related field • Experience in one or more areas of machine learning and deep learning, including but not limited to: - Automatic Speech Recognition - Automatic Speech Translation - Speech/audio self-supervised learning and foundation models - Speaker recognition and verification - Speech emotion recognition - Multimodal foundation models - Large Language Model pretraining and finetuning Preferred Qualifications • Publications in top-tier ML/DL venues such as NeurIPS, ICLR, ICML, AAAI and speech venues such as ICASSP, ASRU, Interspeech • Deep understanding of Large Language models • Familiar with distributed computing and large scale model training • Familiar with deep learning frameworks such as Tensorflow and Pytorch. • Familiar with engineering principles and best practices. • Highly competent in algorithms and programming; Strong coding skills in C/C++ and Python. • Ability to work collaboratively in a fast-paced, multi-functional environments ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

ByteDance - Software Engineer, Model Inference

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
Balbix - Staff AI Engineer

Balbix

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Altagram Group - Data Science Internship/Workstudent

Altagram Group

Germany (On-Site)
6 Days ago
PwC - IN-Senior Associate_ML Engineer_Data and Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Altagram Group - Data Science Internship/Workstudent

Altagram Group

Germany (On-Site)
1 Week ago
NVIDIA - Senior SRAM Engineer, Circuit Design

NVIDIA

Canada (Hybrid)
1 Month ago
NVIDIA - Senior Technical Program Manager, Compute Software Platform- NPI

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
NVIDIA - Senior ASIC Verification Engineer, Coherent High Speed Interconnect

NVIDIA

Taipei City, Taiwan (On-Site)
1 Week ago
NVIDIA - Senior Chip Design Engineer

NVIDIA

Be'er Sheva, South District, Israel (On-Site)
1 Month ago
NVIDIA - VLSI Design Automation Software Engineer

NVIDIA

Massachusetts, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Senior Research Engineer, Foundation Model Training Infrastructure

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
Hedra - Research Scientist

Hedra

New York, New York, United States (On-Site)
5 Days ago
NVIDIA - Senior Solutions Architect, HPC and AI

NVIDIA

Santa Clara, California, United States (Hybrid)
2 Hours ago
ByteDance - DevOps Engineer, Applied Machine Learning Engine - 2025 Start

ByteDance

Singapore (On-Site)
5 Months ago
Blizzard Entertainment - AI/MT Specialist

Blizzard Entertainment

Seoul, South Korea (On-Site)
4 Months ago
The Walt Disney Company - Principal Software Engineer, AI Architecture - Ad Platforms

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Week ago
ByteDance - AI Security Researcher - Security - San Jose

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Meta - Software Engineer, Machine Learning

Meta

Burlingame, California, United States (On-Site)
4 Months ago
NVIDIA - Senior System Profiling Software Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Speech Understanding) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

ByteDance - Cloud Security Solution Architect, APAC

ByteDance

Singapore (On-Site)
5 Months ago
OKX - Senior Product Manager, Trading Bot

OKX

Singapore, Singapore (On-Site)
5 Months ago
ByteDance - Product Expert - Video Cloud

ByteDance

Singapore (On-Site)
1 Week ago
NetEase Games - Game AI Research Leader

NetEase Games

Singapore (On-Site)
1 Month ago
PwC - Workforce Transformation Consulting - Senior Associate

PwC

Singapore (On-Site)
6 Months ago
ByteDance - Product Manager - Edge Computing Platform

ByteDance

Singapore (On-Site)
5 Months ago
PwC - International Growth Practice -Senior Associate

PwC

Singapore (On-Site)
6 Months ago
Kaedim - Software Engineer

Kaedim

Singapore (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Senior ASIC Physical Design Engineer - High Performance Designs

NVIDIA

Austin, Texas, United States (On-Site)
3 Weeks ago
NVIDIA - Senior System Software Engineer, Robotics Simulation

NVIDIA

Canada (Hybrid)
4 Weeks ago
Krafton  - HR Planning Specialist (5+ years experience)

Krafton

Seoul, South Korea (On-Site)
6 Days ago
Rivos - SOC Electrical Analysis Engineer - Full Time

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
5 Months ago
Riot Games - Buyer

Riot Games

Singapore (On-Site)
7 Months ago
Google - Lead CPU RTL Engineer, Silicon

Google

(On-Site)
4 Months ago
Wind River Systems - Cloud Solutions Architect

Wind River Systems

Tokyo, Japan (On-Site)
5 Months ago
NVIDIA - Senior Manager, Device and Modeling

NVIDIA

Canada (Hybrid)
2 Weeks ago
NVIDIA - Senior VLSI Physical Design Integration Engineer

NVIDIA

Massachusetts, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

New York, New York, United States (On-Site)

Jakarta, Jakarta, Indonesia (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Singapore (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug