rotative
the decoder · 2026年7月5日

頂級 AI 智能體 DiscoBench 掛科:為何提問優於搜索

騰訊新的 discobench 揭示,頂級模型如 gemini 3.1 pro 和 claude opus 4.7 未能通過追問測試,這是可靠智能體的關鍵短板。

read in English · 简体中文 · 日本語 · 한국어

tencent's hunyuan team and tsinghua university introduced discobench to expose a critical weakness in ai search agents: they fail to ask clarifying questions when queries are ambiguous. the benchmark tests 11 models across 211 tasks with 463 ambiguous points, finding that top performers like gemini 3.1 pro and claude opus 4.7 still score below 50% accuracy. the research shows that while agents are good at searching syntax, they lack the 'uncertainty recognition' to pause and ask, causing error cascades in multi-hop reasoning. however, when models successfully ask targeted follow-up questions, success rates jump to over 93%. this signals that future ai systems must prioritize proactive dialogue over autonomous action to handle real-world complexity.

read at source ↗

← rotative