Sometimes, when you are using an AI tool like ChatGPT, you get a message that you have reached the context window limit and cannot continue unless you upgrade your plan to a paid version. Another option is to start a new chat window, but you lose all your current conversations. In this blog post, I explain what the context window is.
Image
The context window is the maximum amount of text (or data) that an AI model can "see" and remember in one go when generating a response. It is the AI's working memory. Here is a breakdown of what that means in practice:1. It includes everything in the current "chat"
The context window doesn't just include your latest question. It includes:The system prompt (the hidden instructions given to the AI behind the scenes).The entire conversation history (previous questions and answers).The current question you just asked.Any uploaded files (like PDFs or Word docs) that have been converted into text.If all of this combined text is smaller than the context window, the AI remembers everything. If it is larger, the AI will start to "forget" the oldest parts of the conversation to make room for the new parts. 2. It is measured in "Tokens"
The context window is not measured in words or characters; It is measured in tokens. A token is a small chunk of text.Roughly 1 token = 4 characters in English (or about ¾ of a word).For example, a 100,000-token window equals about 75,000 English words. 3. Why does it matter?
The size of the context window drastically changes what you can do with the AI:Small windows (4k - 8k tokens): Good for quick Q&A, but the AI will forget the start of a long conversation. It cannot analyze entire books or long research papers.Medium windows (32k - 128k tokens): Can digest short novels, long financial reports, or an entire codebase of a software project.Large windows (200k - 2M+ tokens): Can digest a large book series (like all of The Lord of the Rings) at once. You can upload massive datasets and ask questions about them without losing context. Examples of AI Context Windows for some AI Models:GPT-4o (OpenAI): 128,000 tokens (about 300 pages of a book).Claude 3.5 Sonnet (Anthropic): 200,000 tokens (about 500 pages).Gemini 1.5 Pro (Google): 2,000,000 tokens (about 1,500 pages).The simplest way to think about it: The context window is like a water glass. You can pour just a limited amount of water into it based on the capacity of the glass. For example, you can pour just 250 cc of water into a typical water glass. If you pour more, you simply lose that water because the glass is full and cannot hold it. If you want to have more water in the glass, you need to buy a larger glass (500 cc or 1000 cc). ------------------------------------------------------------------------------Are you an action taker?If you are a Product Owner and want to migrate from a classic to an AI-aware Product Owner, attend my upcoming PSPO-AI Essentials (Professional Scrum Product Owner - AI Essentials) class. Click here for the class information. If you are a Scrum Master and want to migrate from a classic to an AI-aware Scrum Master, attend my upcoming PSM-AI Essentials (Professional Scrum Master - AI Essentials) class. Click here for the class information.
| # | Наименование новости | Тональность | Информативность | Дата публикации |
|---|---|---|---|---|
| 1 | How Frontier AI Companies Build AI Models | 0 | 5 | 01-07-2026 |
| 2 | How to Use Prompt Engineering and Context Engineering for AI Agents | 0 | 5.63 | 24-07-2026 |
| 3 | 🚀 Вышла Kimi K3 — и это касается каждого, кто ... | 0 | 9.5 | 22-07-2026 |
| 4 | The AI Hype Reckoning Is Upon Us | -3 | 6 | 09-07-2026 |
| 5 | ❌ 10 ошибок новичков при работе с ChatGPT Если у ... | 0 | 7 | 16-07-2026 |
| 6 | Привет, всем талантливым людям! 👋 Сегодня у меня для вас ... | 0 | 8.18 | 24-07-2026 |
| 7 | Top developers are shifting from chatbots to physical AI. Here’s why | 0 | 5 | 25-06-2026 |
| 8 | Painters, nursing assistants, and more: Microsoft's top 10 most AI-safe careers | 0 | 7 | 31-07-2025 |
| 9 | Painters, nursing assistants, and more: Microsoft's top 10 most AI-safe careers | 0 | 7 | 31-07-2025 |
| 10 | The big ideas behind retrieval augmented generation | 0 | 8.98 | 18-09-2024 |