Results

Leaderboards

The leaderboards present the results obtained by the participants on each track of the consolidating 2020 challenge.

2019 Task

The results listed with a * were submitted after the deadline.

The columns are sortable by clicking on the |sortable| picture of each column header. A detailed view of the results is available by clicking on the |details| picture of each row, it includes audio samples of speech synthesis.

The score columns are interpreted as follow (see Evaluation metrics for more details):

  • MOS:
    • mean opinion score on speech synthesis

    • scale is \([1, 5]\), bigger is better

  • CER:
    • character error rate after human transcription of speech synthesis

    • scale is \([0, 1]\), lower is better

  • Similarity:
    • similarity to the target voice of speech synthesis

    • scale is \([1, 5]\), bigger is better

  • ABX:
    • ABX error rate on embeddings

    • scale is \([0, 100]\), lower is better

  • Bitrate:
    • bitrate of the embeddings

    • scale is \(]0, +\infty[\), lower is better

# Authors Surprise language Training language (English)
MOS CER Similarity ABX Bitrate MOS CER Similarity ABX Bitrate
# Authors MOS CER Similarity ABX Bitrate MOS CER Similarity ABX Bitrate
Surprise language Training language (English)

2017 Track 2 Task

Results of the submission to the 2017 track 2

Authors English French mandarin LANG1 LANG2
NED cov words NED cov words NED cov words NED cov words NED cov words