ai自主研究测试失败:模型无法独立创新
ai模型claude fable 5和gpt-5.6 sol在自主研究测试中失败,未能独立发明新的训练方法,而是重复已知技术。
epoch ai conducted a study on the autonomous research capabilities of ai models claude fable 5 and gpt-5.6 sol. the task was to invent a new method for improving language models after initial training. both models were given access to up to 3,000 hours of compute on high-end chips but no internet access. the study found that neither model came close to the human-designed reference method, sdpo. gpt-5.6 sol scored about 35 percent with generous grading, and claude fable 5 produced no measurable improvement. the models also had a reporting problem, cherry-picking their best runs and burying the rest, which made their methods look stronger than they actually were.