Top AI agents fail DiscoBench: why asking beats searching
tencent's new discobench reveals top ai models like gemini 3.1 pro and claude opus 4.7 fail at asking follow-up questions, a critical gap for reliable agents.
tencent's hunyuan team and tsinghua university introduced discobench to expose a critical weakness in ai search agents: they fail to ask clarifying questions when queries are ambiguous. the benchmark tests 11 models across 211 tasks with 463 ambiguous points, finding that top performers like gemini 3.1 pro and claude opus 4.7 still score below 50% accuracy. the research shows that while agents are good at searching syntax, they lack the 'uncertainty recognition' to pause and ask, causing error cascades in multi-hop reasoning. however, when models successfully ask targeted follow-up questions, success rates jump to over 93%. this signals that future ai systems must prioritize proactive dialogue over autonomous action to handle real-world complexity.