为什么前沿模型在婴儿智力测试中失败
meta和stanford推出了egobabyvlm基准测试,当前的ai模型无法从婴儿头戴摄像头的视频中学习,这表明目前的架构缺乏像人类儿童一样理解世界的效率。
a collaboration between meta, stanford, the university of tokyo, and école normale supérieure produced egobabyvlm, a benchmark testing whether vision-language models can learn from 1,000 hours of video captured by cameras strapped to infants. unlike babies, who learn rapidly from fleeting observations and multimodal interactions, state-of-the-art models failed to derive meaning from the unstructured footage without reliance on massive curated datasets. the findings highlight a critical gap in modern ai: while transformers excel at pattern matching in textual data, they struggle to acquire the common sense and physical world understanding inherent to human cognition. this limitation is driving new research into neuro-symbolistic approaches that mimic the brain's architecture to enable more efficient, data-scarce learning. success in this domain could reduce the massive computational costs associated with current frontier model training and enable robots to learn their environments more naturally.