rotative
the decoder · 2026年5月16日

新基准WorldReasonBench揭露顶尖AI视频生成器逻辑能力薄弱

清华大学的基准测试显示,尽管字节跳动的Seedance 2.0等商业模型表现优于开源对手,但所有模型在逻辑和物理推理任务上均表现不佳。

read in English · 繁體中文 · 日本語 · 한국어

worldreasonbench evaluates models like sora 2 and veo 3.1 on their ability to continue starting scenes with physical, social, and logical plausibility, finding that high visual fidelity often masks fundamental errors in cause and effect. commercial systems scored double the open-source models on reasoning metrics, with seedance 2.0 taking the top spot, though logical reasoning remained the weakest category for everyone. open-source models showed greater dependence on detailed prompts to compensate for their lack of built-in reasoning capabilities compared to commercial rivals. the benchmark uses a two-stage scoring system, validated against 6,000 human annotations, to prove that current models have not yet become reliable world models.

read at source ↗

← rotative