CMU基準測試顯示Claude Mythos在自主瀏覽器漏洞利用上超越GPT-5.5
在cmu的exploitbench基準測試中,anthropic的claude mythos preview在自主利用真實v8漏洞方面達到了人類級別的水平,顯著超越了openai的gpt-5.5,儘管成本高達3.6萬美元而後者僅為3千美元。
carnegie mellon university's exploitbench evaluates agents on a five-tier scale up to arbitrary code execution within google's v8 javascript engine. claude mythos preview performed comparably to a competent human security researcher, successfully exploiting vulnerabilities like cve-2024-0519 that humans failed to crack for a year. in fully autonomous mode, mythos maintained high performance with a 9.55 score, whereas gpt-5.5 dropped to 4.30. despite the capability gap, the economic barrier remains steep, with mythos requiring twelve times the compute cost of its competitor. anthropic and openai provided api credits for the independent study.