斯坦福研究发现44%的LLM说法已经过时
斯坦福研究人员测试了50个关于大型语言模型的说法，发现44%已经过时。这影响了依赖过时发现的AI开发人员和研究人员。
stanford researchers owen queen and james zou examined 50 widely cited claims about large language models against 20 models released between july 2024 and september 2026 by eight different developers. they found that 44 percent of the claims have already expired, with an average lifespan of just 15.7 months. claims about what models can't do expire fastest, especially those related to reasoning. in contrast, claims about preferences and tendencies prove longer-lived. the study warns against reading these results as an all-clear, as some issues like hallucinated references and social biases persist. the findings impact the reliability of llm research and development.