WorldReasonBench、主要AI動画生成モデルの論理力の低さを暴露
清華大学のベンチマークによると、Seedance 2.0などの商用AI動画モデルはオープンソースの競合を上回るものの、論理的・物理的推論タスクではいずれも失敗するという。
worldreasonbench evaluates models like sora 2 and veo 3.1 on their ability to continue starting scenes with physical, social, and logical plausibility, finding that high visual fidelity often masks fundamental errors in cause and effect. commercial systems scored double the open-source models on reasoning metrics, with seedance 2.0 taking the top spot, though logical reasoning remained the weakest category for everyone. open-source models showed greater dependence on detailed prompts to compensate for their lack of built-in reasoning capabilities compared to commercial rivals. the benchmark uses a two-stage scoring system, validated against 6,000 human annotations, to prove that current models have not yet become reliable world models.