rotative
the decoder · 2026年5月10日

Claude Mythos、METRベンチマークの上限を突破

Claude Mythosプレビューは、16時間タスクで成功率50%を記録し、METRのテスト方法論の上限に到達した。

read in English · 简体中文 · 繁體中文 · 한국어

metr reported that claude mythos preview reached the upper limit of its current testing suite, estimating a 50 percent task completion probability on work taking 16 hours. the organization noted that measurements at this level are unstable due to sparse task coverage, necessitating new benchmarks for more capable models. palo alto networks validated these capabilities, revealing that models completed a year's worth of manual penetration testing in just three weeks. the firm warned that frontier models act as autonomous agents capable of chaining low-rated vulnerabilities into critical attack paths within 25 minutes.

read at source ↗

← rotative