Research Scientist - Speech & Audio Understanding (Speech Generation)

Tencent

Job Summary

This Research Scientist role focuses on advancing speech and audio understanding, specifically in speech generation. Responsibilities include tracking the latest research, exploring next-generation paradigms for speech/audio generation, and investigating cutting-edge multimodal voice foundation model technologies. The scientist will lead technical R&D to enhance voice interaction experiences by integrating text, speech, and vision, driving model performance improvements and innovative applications. A Master’s or Ph.D. in Computer Science or related fields is required, along with experience in voice foundation models, speech synthesis, recognition, or audio generation, and proficiency in deep learning frameworks like PyTorch.

Must Have

  • Master’s or Ph.D. in Computer Science, Artificial Intelligence, Electronic Engineering, Signal Processing, or related fields.
  • Research or development experience in one or more areas: voice foundation models, speech synthesis, speech recognition, audio generation, voice conversion, or speech codec.
  • Familiarity with mainstream voice-enabled large models (e.g., GPT4o, GLM-4-Voice, Qwen2.5-Omni, Voila).
  • Proficient in deep learning frameworks (e.g., PyTorch).
  • Solid understanding of large model architectures and principles.

Good to Have

  • Prior project experience with mainstream voice-enabled large models.
  • Experience with large-scale model training frameworks (Megatron/Deepspeed).
  • Experience in large-scale pretraining or post-training.

Perks & Benefits

  • Sign on payment (evaluated on a case-by-case basis)
  • Relocation package (evaluated on a case-by-case basis)
  • Restricted stock units (evaluated on a case-by-case basis)
  • Medical benefits
  • Dental benefits
  • Vision benefits
  • Life and disability benefits
  • Participation in the Company’s 401(k) plan
  • Up to 15 to 25 days of vacation per year
  • Up to 13 days of holidays throughout the calendar year
  • Up to 10 days of paid sick leave per year

Job Description

Business Unit

What the Role Entails

Job Responsibilities:

1. Track the latest research in speech generation algorithms, explore next-generation paradigms for speech/audio generation, and push the boundaries of speech generation capabilities.

2. Investigate cutting-edge multimodal voice foundation model technologies to enhance voice interaction experiences by integrating text, speech, and vision.

3. Lead the technical R&D of voice foundation models, driving model performance improvements and innovative applications.

Who We Look For

Job Requirements:

1. Master’s or Ph.D. in Computer Science, Artificial Intelligence, Electronic Engineering, Signal Processing, or related fields.

2. Research or development experience in one or more areas: voice foundation models, speech synthesis, speech recognition, audio generation, voice conversion, or speech codec.

3. Familiarity with mainstream voice-enabled large models (e.g., GPT4o, GLM-4-Voice, Qwen2.5-Omni, Voila). Prior project experience is preferred.

4. Proficient in deep learning frameworks (e.g., PyTorch). Experience with large-scale model training frameworks (Megatron/Deepspeed) is a plus.

5. Solid understanding of large model architectures and principles. Experience in large-scale pretraining or post-training is preferred.

The expected base pay range for this position in the location(s) listed above is $122,500.00 to $229,700.00 per year. Actual pay may vary depending on job-related knowledge, skills, and experience. Employees hired for this position may be eligible for a sign on payment, relocation package, and restricted stock units, which will be evaluated on a case-by-case basis. Subject to the terms and conditions of the plans in effect, hired applicants are also eligible for medical, dental, vision, life and disability benefits, and participation in the Company’s 401(k) plan. The Employee is also eligible for up to 15 to 25 days of vacation per year (depending on the employee’s tenure), up to 13 days of holidays throughout the calendar year, and up to 10 days of paid sick leave per year. Your benefits may be adjusted to reflect your location, employment status, duration of employment with the company, and position level. Benefits may also be pro-rated for those who start working during the calendar year.

Equal Employment Opportunity at Tencent

As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.

Who we are

Tencent is a world-leading internet and technology company that develops innovative products and services to improve the quality of life for people around the world.

Read More

Equal Employment Opportunity at Tencent

As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.

Read More

5 Skills Required For This Role

Game Texts Pytorch Deep Learning Algorithms Glm