前沿 ASR 模型在語碼轉換上失敗,危及企業自動化
hugging face 發布了一項基準測試,顯示語音代理在處理語碼轉換語音時表現不佳,在人力資源和 it 支援場景中發現重大錯誤。
hugging face published a new dataset and benchmark evaluating seven frontier and open-source asr systems on code-switched speech for hr and it service management contexts. the study utilized three metrics—word error rate, semantic wer, and answer error rate—to assess transcription accuracy and downstream preservation of meaning. elevenlabs scribe v2, gemini 3 flash, and assembly ai universal 3-pro emerged as top performers, though error rates vary by language-pair, revealing a reliability gap in current voice agent infrastructure.