rotative
the decoder · November 21, 2026

Nvidia says huge AI context windows are overkill

nvidia researchers find large ai context windows often unnecessary and expensive, with periodic summaries working just as well.

read in 简体中文 · 繁體中文

nvidia researchers claim that large ai context windows are a dead end, despite the trend of rapidly increasing sizes. gpt-4 launched with 8,192 tokens in march 2023, while gpt 5.6 sol handles around one million tokens, enough for tolstoy's 'war and peace'. the researchers found that periodic summaries and targeted lookups worked about as well as huge context windows in many tests, making them a more efficient alternative. this challenges the industry's focus on increasing context window sizes.

read at source ↗

← rotative