0.4초마다 듣고 말하는 오픈소스 모델
연구진이 0.4초 단위로 음성을 처리해 언제 말할지 판단하는 3B 오픈소스 모델 Audio-Interaction을 공개했으며, 노이즈 감지에서 Gemini 3 Flash를 앞섰습니다.
researchers released audio-interaction, an open-source 3b model designed to unify speech recognition, translation, and dialog by processing audio streams in real-time. unlike turn-based models like gpt-4o, it segments audio into 0.4-second chunks and outputs a <silent> or <response> token after each, enabling natural turn-taking and simultaneous listening. trained on the synthetic streamaudio-2m dataset of 302,000 hours, the system beats gemini 3 flash in proactive noise detection and matches 7b models on the mmau benchmark. this approach addresses the limitations of current streaming models that cannot handle multiple tasks or react proactively to environmental sounds, signaling a shift toward more capable, multimodal voice agents.