rotative
the decoder · 2026년 5월 10일

Claude Mythos, METR 벤치마크 상한 돌파

Claude Mythos 프리뷰가 METR 테스트 방법론의 상한에 도달했으며, 16시간 작업에서 50% 성공률을 기록했습니다.

read in English · 简体中文 · 繁體中文 · 日本語

metr reported that claude mythos preview reached the upper limit of its current testing suite, estimating a 50 percent task completion probability on work taking 16 hours. the organization noted that measurements at this level are unstable due to sparse task coverage, necessitating new benchmarks for more capable models. palo alto networks validated these capabilities, revealing that models completed a year's worth of manual penetration testing in just three weeks. the firm warned that frontier models act as autonomous agents capable of chaining low-rated vulnerabilities into critical attack paths within 25 minutes.

read at source ↗

← rotative