Large Model Speech Algorithm Principal Engineer

This role involves researching and developing speech/audio large models for applications like speech dialogue, audio understanding (ASR/audio captioning), and audio generation (TTS/video dubbing). Responsibilities include data and algorithm work for pre-training, post-training, and reinforcement learning of these models, covering both text and audio. The principal engineer will also oversee the open-sourcing and productization of these models, focusing on end-to-end optimization for speech dialogue products, enhancing audio understanding in challenging scenarios, and improving speech synthesis for various applications.

Must Have

• Strong coding skills
• Solid foundation in data structures and algorithms
• Proficiency in Python or C/C++
• Familiarity with model training frameworks like PyTorch, Megatron, or DeepSpeed
• Solid background in mathematics and signal processing
• Good reading ability for English technical literature

Good to Have

• Prior experience in speech dialogue, speech synthesis, speech recognition, audio-video multimodality, or large language models (pre-training, fine-tuning, reinforcement learning)
• Prior awards in competitions such as ACM/ICPC, NOI/IOI, Top Coder, or Kaggle
• Publications in top-tier conferences or journals such as NeurIPS, ICLR, ICML, ACL, CVPR, ICASSP, or INTERSPEECH

Business Unit

Technology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers, TEG provides users with a full range of customer services. As the operator of the largest networking, devices, and data center in Asia, TEG also leads the Tencent Technology Committee in strengthening infrastructure R&D through internal and distributed open source collaboration, constructing new platforms and supporting business innovation.

What the Role Entails

• Research and develop speech/audio large models, including but not limited to models for speech dialogue (speech interaction/audio-video dialogue), audio understanding (ASR/audio captioning), and audio generation (TTS/video dubbing) .
• Be responsible for data and algorithm work related to the pre-training, post-training, and reinforcement learning (for both text and audio) of speech/audio large models
• Oversee the open-sourcing of speech dialogue/audio understanding/audio generation models and their productization. This includes end-to-end optimization of the full pipeline for speech dialogue products, optimizing audio understanding in scenarios involving noise/accent/far-field/sound effects/music, and enhancing speech synthesis for applications like broadcasting, casual conversation, gaming, and social interaction

Who We Look For

• Prior experience in speech dialogue, speech synthesis, speech recognition, audio-video multimodality, or large language models (pre-training, fine-tuning, reinforcement learning) is preferred
• Strong coding skills and a solid foundation in data structures and algorithms. Proficiency in Python or C/C++ is required, along with familiarity with model training frameworks like PyTorch, Megatron, or DeepSpeed. Prior awards in competitions such as ACM/ICPC, NOI/IOI, Top Coder, or Kaggle are advantageous
• Having publications in top-tier conferences or journals such as NeurIPS, ICLR, ICML, ACL, CVPR, ICASSP, or INTERSPEECH is preferred
• A solid background in mathematics and signal processing, good reading ability for English technical literature, strong motivation/curiosity/teamwork spirit, excellent problem-solving skills, and a passion for pursuing technological innovation

Who we are

Tencent is a world-leading internet and technology company that develops innovative products and services to improve the quality of life for people around the world.

Equal Employment Opportunity at Tencent

As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.