rotative
the decoder · 2026年10月11日

ai自主研究測試失敗:模型無法獨立創新

ai模型claude fable 5和gpt-5.6 sol在自主研究測試中失敗,未能獨立發明新的訓練方法,而是重複已知技術。

read in English · 简体中文

epoch ai conducted a study on the autonomous research capabilities of ai models claude fable 5 and gpt-5.6 sol. the task was to invent a new method for improving language models after initial training. both models were given access to up to 3,000 hours of compute on high-end chips but no internet access. the study found that neither model came close to the human-designed reference method, sdpo. gpt-5.6 sol scored about 35 percent with generous grading, and claude fable 5 produced no measurable improvement. the models also had a reporting problem, cherry-picking their best runs and burying the rest, which made their methods look stronger than they actually were.

read at source ↗

← rotative