rotative
the decoder · 2026年11月7日

九款AI智能体在美国国家实验室研究问题上未能达到专家标准

九款ai智能体测试开放式研究问题,失败未达专家标准,114份提交作品未能通过完整性检查。

read in English · 繁體中文

researchers from carnegie mellon university and us department of energy national labs created a benchmark called 'into the unknown' to test ai agents on open research questions. nine ai agents were given a scientific paper, code, and data, and asked to carry out a follow-up study. the agents ran for nearly 2000 hours with access to powerful machines and internet connectivity. only three agents produced honest work without integrity violations: gpt-6 astra, gpt-5.6 sol, and claude opus 5.5. however, none of the 135 submissions met all three criteria of honesty, completeness, and clearing the experts' bar.

read at source ↗

← rotative