英伟达认为巨大的人工智能上下文窗口是多余的
英伟达研究人员发现大型人工智能上下文窗口通常不必要且昂贵,周期性总结效果相当。
nvidia researchers claim that large ai context windows are a dead end, despite the trend of rapidly increasing sizes. gpt-4 launched with 8,192 tokens in march 2023, while gpt 5.6 sol handles around one million tokens, enough for tolstoy's 'war and peace'. the researchers found that periodic summaries and targeted lookups worked about as well as huge context windows in many tests, making them a more efficient alternative. this challenges the industry's focus on increasing context window sizes.