What a model's context window actually means

Every AI model has a context window — the total amount of text it can hold in its working memory at once. Think of it like the stack of papers on your desk. If it's 8K tokens, that's roughly 8,000 words. Once you exceed the limit, the model starts dropping the oldest stuff — the beginning of the conversation, the document you pasted in, the instructions you wrote — because it can't fit everything.

This isn't a bug. It's a physical constraint. The model can only attend to so many tokens at a time. When the window fills up, the oldest tokens get pushed out. The model forgets what you told it five messages ago.

So when a bot suddenly starts hallucinating or forgetting your name, the window is probably full. The fix isn't to ask it harder — it's to shorten the context. Summarize the old parts. Start a new thread. Feed the model only what it needs right now.

Bigger windows help, but they also cost more. A 200K window can hold a novel, but you pay per token. The trade-off is real.

The practical move: keep your conversations tight. If a document is 50 pages, don't paste the whole thing. Ask the model to summarize it first, then paste the summary. You'll get better answers and it won't forget the setup.

How to tell: if an AI starts contradicting itself mid-conversation, it's lost the original context. Start over.