英偉達認為巨大的人工智慧上下文窗口是多餘的
英偉達研究人員發現大型人工智慧上下文窗口通常不必要且昂貴,周期性總結效果相當。
nvidia researchers claim that large ai context windows are a dead end, despite the trend of rapidly increasing sizes. gpt-4 launched with 8,192 tokens in march 2023, while gpt 5.6 sol handles around one million tokens, enough for tolstoy's 'war and peace'. the researchers found that periodic summaries and targeted lookups worked about as well as huge context windows in many tests, making them a more efficient alternative. this challenges the industry's focus on increasing context window sizes.