WorldReasonBench, 최상위 AI 비디오 생성기의 부족한 논리력 폭로
칭화대학교의 벤치마크에 따르면 Seedance 2.0 같은 상용 AI 비디오 모델이 오픈소스 경쟁 모델보다 뛰어나지만, 모든 모델이 논리적·물리적 추론 과제에서 실패했습니다.
worldreasonbench evaluates models like sora 2 and veo 3.1 on their ability to continue starting scenes with physical, social, and logical plausibility, finding that high visual fidelity often masks fundamental errors in cause and effect. commercial systems scored double the open-source models on reasoning metrics, with seedance 2.0 taking the top spot, though logical reasoning remained the weakest category for everyone. open-source models showed greater dependence on detailed prompts to compensate for their lack of built-in reasoning capabilities compared to commercial rivals. the benchmark uses a two-stage scoring system, validated against 6,000 human annotations, to prove that current models have not yet become reliable world models.