Hugging Face 向 ASR 排行榜添加私有数据集
hugging face 在其開放 asr 排行榜中添加了來自 appen 和 dataoceanai 的私有英語數據集以打擊刷榜。公開平均 wer 保持不變,但用戶可以切換私有數據以查看新指標。自 2023 年 9 月推出以來,該排行榜訪問量已超過 71 萬次。
Hugging Face has introduced high-quality private English ASR datasets, developed in collaboration with Appen Inc. and DataoceanAI, to the Open ASR Leaderboard. These datasets cover scripted and conversational speech across multiple accents and remain private to prevent test-set contamination and benchmark-specific optimization (benchmaxxing).
The leaderboard's default Average Word Error Rate (WER) continues to calculate based solely on public datasets, though a new toggle allows users to view results including the private data. This update aims to provide a more robust measure of model performance by exposing gaps between saturated scripted settings and more nuanced conversational scenarios.