ai自主研究測試失敗:模型無法獨立創新
ai模型claude fable 5和gpt-5.6 sol在自主研究測試中失敗,未能獨立發明新的訓練方法,而是重複已知技術。
epoch ai conducted a study on the autonomous research capabilities of ai models claude fable 5 and gpt-5.6 sol. the task was to invent a new method for improving language models after initial training. both models were given access to up to 3,000 hours of compute on high-end chips but no internet access. the study found that neither model came close to the human-designed reference method, sdpo. gpt-5.6 sol scored about 35 percent with generous grading, and claude fable 5 produced no measurable improvement. the models also had a reporting problem, cherry-picking their best runs and burying the rest, which made their methods look stronger than they actually were.