ConferencingSpeech 2022

Non-Intrusive Speech Quality Assessment in Online Conferencing Applications

mdpi/ConferencingSpeech 2022 ConferencingSpeech 2022
ConferencingSpeech
2022
Introduction
With the advances in speech communication systems such as online conferencing applications, we can seamlessly work with people regardless where they are. However, during the meeting, the speech quality is significantly affected by background noise, reverberation, packet loss, network jitter and many other factors. Therefore, an effective objective assessment approach is needed to evaluate or monitor the speech quality of the ongoing call. If severely degraded speech quality is detected, then the statistical information could be shared with the service provider in time. This enables the service provider to find out the root cause and improve the speech quality to guarantee better user experience in the future. Although the performance of objective speech quality assessment methods has been improved dramatically over the past few decades, there are still a set of open research problems that should be further addressed for the real-time speech communication systems, especially the challenge of non-intrusive speech assessment. ConferencingSpeech 2022 challenge is proposed to stimulate research in the areas mentioned above. This challenge will provide comprehensive training datasets, a comprehensive test dataset and a baseline system. The final ranking of this challenge will be decided by the predicted accuracy of the MOS scores from the submitted model or algorithm on the test dataset.
The challenge has only one task:
Non-intrusive speech quality assessment in online conferencing applications
Each registered team could participate in the above task. Top two winning teams from the task will be awarded the prizes provided by Tencent Ethereal Audio Lab. The First Prize is 1500 USD. The Second Prize is 800 USD. The internship opportunities at Tencent Ethereal Audio Lab will be provided to the students with excellent performance. More details about the data and ConferencingSpeech 2022 challenge will be released in the following.
Evaluation Plan
TimelinePacific Time:
19 Jan 2022
mdpi/时间轴 / dot-未进行
Beginning of challenge registration
27 Jan 2022
mdpi/时间轴 / dot-未进行
Release of evaluation plan, the list of training data and development test set
17 Feb 2022
mdpi/时间轴 / dot-未进行
Release of baseline system
12 Mar 2022
mdpi/时间轴 / dot-未进行
Deadline of challenge registration
14 Mar 2022
mdpi/时间轴 / dot-未进行
Release of evaluation test set
17 Mar 2022
mdpi/时间轴 / dot-未进行
Deadline of submitting the results
20 Mar 2022
mdpi/时间轴 / dot-未进行
Notification of the results of participants
21 Mar 2022
mdpi/时间轴 / dot-未进行
Interspeech paper submission deadline
Registration & Submission
Registration
Please register by the following entrance. Once the registration is completed, you will receive our confirmation email.
Registration
Submission
Please submit your predicted score of the evaluation test sets and system description by the following link.
Submission
Download
Participants will receive the download link when their registrations are confirmed.
Contest Rules
More >
List of training set and development test set
More >
Baseline systems
More >
Organizers
Gaoxiong Yi
Principal Researcher
Tencent Ethereal Audio Lab
China
Wei Xiao
Principal Researcher
Tencent Ethereal Audio Lab
China
Yiming Xiao
Researcher
Tencent Ethereal Audio Lab
China
Babak Naderi
Senior Researcher
Technical University of Berlin
Germany
Sebastian Möller
Professor
Technical University of Berlin
Germany
Ross Cutler
Partner Applied Scientist Manager
Microsoft
USA
Gabriel Mittag
Machine Learning Scientist
Microsoft
USA
Zhuohuang Zhang
Ph.D
Indiana University Bloomington
USA
Donald S. Williamson
Assistant Professor
Indiana University Bloomington
USA
Fei Chen
Professor
Southern University of Science and Technology
China
Fuzheng Yang
Professor
XiDian University
China
Shidong Shang
Senior Director
Tencent Ethereal Audio Lab
China
Rankings
Rankings
Contact Us
If you have questions about this challenge, please email us at ConferencingSpeech@tencent.com. If you haven’t received the reply in three days, please send email to ConferencingSpeech@gmail.com.