斯坦福研究發現44%的LLM說法已經過時
斯坦福研究人員測試了50個關於大型語言模型的說法，發現44%已經過時。這影響了依賴過時發現的AI開發人員和研究人員。
stanford researchers owen queen and james zou examined 50 widely cited claims about large language models against 20 models released between july 2024 and september 2026 by eight different developers. they found that 44 percent of the claims have already expired, with an average lifespan of just 15.7 months. claims about what models can't do expire fastest, especially those related to reasoning. in contrast, claims about preferences and tendencies prove longer-lived. the study warns against reading these results as an all-clear, as some issues like hallucinated references and social biases persist. the findings impact the reliability of llm research and development.