rotative
mit tech review · November 20, 2026

METR updates AI graph, reveals model weaknesses

metr's updated report shows ai models improving rapidly but struggling with judgment tasks. this affects ai's ability to automate research and development.

read in 简体中文 · 繁體中文

metr's updated report finds that ai models are still improving rapidly, with some capabilities continuing to improve along an exponential trajectory. however, the report also indicates that models struggle with tasks that require judgment, such as designing new ai evaluations and scoring philosophical arguments. metr evaluated models by having them attempt a large suite of tasks, each of which had also been completed by humans, and rated models according to the length of the tasks that they could complete. the updated plot adds more tasks, including some that are estimated to take humans far longer than the tasks in the original suite, and others that are more open-ended. this has significant implications for ai's ability to automate research and development, a key area of interest in the ai community.

read at source ↗

← rotative