rotative
the decoder · 2026년 6월 6일

0.4초마다 듣고 말하는 오픈소스 모델

연구진이 0.4초 단위로 음성을 처리해 언제 말할지 판단하는 3B 오픈소스 모델 Audio-Interaction을 공개했으며, 노이즈 감지에서 Gemini 3 Flash를 앞섰습니다.

read in English · 简体中文 · 繁體中文 · 日本語

researchers released audio-interaction, an open-source 3b model designed to unify speech recognition, translation, and dialog by processing audio streams in real-time. unlike turn-based models like gpt-4o, it segments audio into 0.4-second chunks and outputs a <silent> or <response> token after each, enabling natural turn-taking and simultaneous listening. trained on the synthetic streamaudio-2m dataset of 302,000 hours, the system beats gemini 3 flash in proactive noise detection and matches 7b models on the mmau benchmark. this approach addresses the limitations of current streaming models that cannot handle multiple tasks or react proactively to environmental sounds, signaling a shift toward more capable, multimodal voice agents.

read at source ↗

← rotative