ai基准测试:无模型得分超过12%
semianalysis发布gdpx基准测试,在现实工作环境中测试ai模型,claude opus 5.5得分12%,凸显实际应用中的挑战。
semianalysis has released its gdpx benchmark, which tests ai agents in simulated work environments with 206 tasks across eleven domains, including chip design, biology, and cybersecurity. claude opus 5.5 leads the field with 12 percent, closely followed by gemini 4 carbon at 10.9 percent and gpt-6 astra at 9.6 percent. the benchmark's results are impacted by safety filters, which affect rankings, and the secrecy surrounding test tasks has drawn scrutiny. the benchmark aims to assess ai agents' performance in realistic work environments, highlighting challenges in practical applications.