rotative
the decoder · 2026年11月21日

英偉達認為巨大的人工智慧上下文窗口是多餘的

英偉達研究人員發現大型人工智慧上下文窗口通常不必要且昂貴,周期性總結效果相當。

read in English · 简体中文

nvidia researchers claim that large ai context windows are a dead end, despite the trend of rapidly increasing sizes. gpt-4 launched with 8,192 tokens in march 2023, while gpt 5.6 sol handles around one million tokens, enough for tolstoy's 'war and peace'. the researchers found that periodic summaries and targeted lookups worked about as well as huge context windows in many tests, making them a more efficient alternative. this challenges the industry's focus on increasing context window sizes.

read at source ↗

← rotative