開源模型每0.4秒處理語音實現即時對話

researchers released audio-interaction, an open-source 3b model designed to unify speech recognition, translation, and dialog by processing audio streams in real-time. unlike turn-based models like gpt-4o, it segments audio into 0.4-second chunks and outputs a <silent> or <response> token after each, enabling natural turn-taking and simultaneous listening. trained on the synthetic streamaudio-2m dataset of 302,000 hours, the system beats gemini 3 flash in proactive noise detection and matches 7b models on the mmau benchmark. this approach addresses the limitations of current streaming models that cannot handle multiple tasks or react proactively to environmental sounds, signaling a shift toward more capable, multimodal voice agents.