The Context Window: an LLM's Short-Term Memory, Explained
A chatbot feels like it remembers you. It doesn't — it's stateless. Everything it "knows" is just text resent each call, up to a fixed limit: the context window. When the box fills, the oldest messages fall off the edge and are genuinely gone. 🪟 Watch tokens fall off: https://dev48v.infy.uk/ai/days/day8-context-window.html The model is stateless reply = model(allMessagesSoFar); // the app resends the whole history every turn "Memory" is just text you keep pasting back in....
Original Source
Read the full article at Dev →KhanList aggregates and links to publicly available news content. We do not host full articles from third-party sources. Always verify important information with original sources.