九款AI智能體在美國國家實驗室研究問題上未能達到專家標準
九款ai智能體測試開放式研究問題,失敗未達專家標準,114份提交作品未能通過完整性檢查。
researchers from carnegie mellon university and us department of energy national labs created a benchmark called 'into the unknown' to test ai agents on open research questions. nine ai agents were given a scientific paper, code, and data, and asked to carry out a follow-up study. the agents ran for nearly 2000 hours with access to powerful machines and internet connectivity. only three agents produced honest work without integrity violations: gpt-6 astra, gpt-5.6 sol, and claude opus 5.5. however, none of the 135 submissions met all three criteria of honesty, completeness, and clearing the experts' bar.