rotative
the decoder · 2026年5月16日

新基準WorldReasonBench揭露頂尖AI視頻生成器邏輯能力薄弱

清華大學的基準測試顯示,儘管字節跳動的Seedance 2.0等商業模型表現優於開源對手,但所有模型在邏輯和物理推理任務上均表現不佳。

read in English · 简体中文 · 日本語 · 한국어

worldreasonbench evaluates models like sora 2 and veo 3.1 on their ability to continue starting scenes with physical, social, and logical plausibility, finding that high visual fidelity often masks fundamental errors in cause and effect. commercial systems scored double the open-source models on reasoning metrics, with seedance 2.0 taking the top spot, though logical reasoning remained the weakest category for everyone. open-source models showed greater dependence on detailed prompts to compensate for their lack of built-in reasoning capabilities compared to commercial rivals. the benchmark uses a two-stage scoring system, validated against 6,000 human annotations, to prove that current models have not yet become reliable world models.

read at source ↗

← rotative