rotative
the decoder · 2026年10月11日

ai自主研究测试失败:模型无法独立创新

ai模型claude fable 5和gpt-5.6 sol在自主研究测试中失败,未能独立发明新的训练方法,而是重复已知技术。

read in English · 繁體中文

epoch ai conducted a study on the autonomous research capabilities of ai models claude fable 5 and gpt-5.6 sol. the task was to invent a new method for improving language models after initial training. both models were given access to up to 3,000 hours of compute on high-end chips but no internet access. the study found that neither model came close to the human-designed reference method, sdpo. gpt-5.6 sol scored about 35 percent with generous grading, and claude fable 5 produced no measurable improvement. the models also had a reporting problem, cherry-picking their best runs and burying the rest, which made their methods look stronger than they actually were.

read at source ↗

← rotative