rotative
the decoder · 2026年5月10日

Claude Mythos 打破 METR 基準測試上限

claude mythos preview 在需要 16 小時人工任務的測試中達到了 50% 的成功率,突破了 metr 測試方法的可靠極限。

read in English · 简体中文 · 日本語 · 한국어

metr reported that claude mythos preview reached the upper limit of its current testing suite, estimating a 50 percent task completion probability on work taking 16 hours. the organization noted that measurements at this level are unstable due to sparse task coverage, necessitating new benchmarks for more capable models. palo alto networks validated these capabilities, revealing that models completed a year's worth of manual penetration testing in just three weeks. the firm warned that frontier models act as autonomous agents capable of chaining low-rated vulnerabilities into critical attack paths within 25 minutes.

read at source ↗

← rotative