Skip to content
Mastering Claude

Home / What a language model is, without the jargon

What a language model is, without the jargon7 minFoundation

The token and the window, what the model actually sees

The model sees tokens stacked inside a window with a fixed ceiling, not whole words taken one by one, and a conversation approaching that ceiling changes content before it even reaches its maximum cost, since Claude then summarises the oldest exchanges.

Claude does not read words: it reads tokens, small chunks of text, sometimes a whole word, sometimes part of a word or a punctuation mark. Everything it can see at a given moment is measured in tokens, the question asked, the previous exchanges in the same conversation, and the documents pasted or attached. This whole set fits inside a window whose size is fixed, not inside a memory that would expand as the exchange goes on.

What the window actually contains

On paid plans, this window reaches one million tokens for the Claude Fable 5, Claude Opus 5 and Claude Sonnet 5 models, and two hundred thousand tokens outside these three models, according to the official help centre consulted on 2 September 2026, a figure that this lesson's figure cites along with its source. A share of this window is always reserved for Claude's answer, according to the same help centre, so the longest possible conversation is a little shorter than the whole window. The conversation interface does not display this figure while you are writing.

What happens when the window nears its ceiling

The practical consequence is stated in a rule published by Claude's help centre: when a conversation nears the limit of its context window, Claude summarises the oldest messages to make room, and this summary does not count against the account's usage limit. The conversation therefore changes content before it even reaches its ceiling: the very first exchanges stop being read word for word, they get replaced by a condensed version. An instruction given very early in a long conversation can thus end up summarised rather than read as written.

Estimating without a displayed counter

In the absence of a counter built into the conversation screen, a rule of thumb published by Anthropic makes it possible to estimate a token count from a text's number of characters. This lesson's figure gives this figure along with the two window sizes.

Pasted text: about 800 characters, measured with the word processor's counting tool
Estimate: 800 divided by the figure given in the diagram, so about 200 tokens

Keep this estimate in mind before pasting a long document at the start of a conversation. That is the exercise this lesson proposes, and it sets up the lesson on the order of information in a long prompt, where the position of a sentence matters as much as its length.

Figure 1

The stack that fills up the context window

Share reserved for the answer
This share of the window is used for the answer Claude is in the process of writing.
Current message
The question or instruction you have just written, ahead of everything already read.
Conversation history
Every previous exchange stays in the window until it is summarised or the window fills up.
Attached documents
Files pasted or uploaded take up tokens in the same way as text typed by hand.
The stack shows the elements that share the same bounded window: the current message, the conversation history, attached documents and the share reserved for the answer.
Figure 2

Two window sizes, and the rule for estimating a text

1 000 000tokens
context window of the most recent models, Fable 5.1, Opus 5 and Sonnet 5, on paid plans
support.claude.com, 2026-09-02
500 000tokens
context window of the previous generation, Opus 4.8, 4.7, 4.6 and Sonnet 4.6, in conversation
support.claude.com, 2026-09-02
200 000tokens
context window of the other models, including Haiku 4.5
support.claude.com, 2026-09-02
4characters per token
approximate estimate published by Anthropic, varying by language
platform.claude.com/docs/pricing, 2026-09-02
Three window tiers depending on the model, recorded on the date given in the lesson. Address given at the end of the lesson. The last figure approximately converts a number of characters into tokens.
Calibrate it yourself

An association pastes a twelve page report into the same conversation, then the exchanges from the three previous weeks, before asking its question. Claude answers by first summarising the oldest messages in the conversation before dealing with the question asked.

Write in one sentence what this situation establishes, and in one sentence what it does not establish.

What to remember
  • Claude does not read whole words but tokens, fragments that can split a word into several pieces.
  • The size of the context window depends on the model chosen, it is not the same for every Claude model available on a paid plan.
  • When a conversation nears the ceiling of its window, Claude summarises the oldest messages, which then stop being read word for word.
  • Estimating a text's token count is done from its number of characters, a rule of thumb used in the absence of a direct display while writing the message.
Do this now

Take a long text you have already sent to Claude, count or estimate its number of characters with your word processor's counting tool, and divide this total by the figure given in this lesson's diagram to estimate how many tokens it takes up.

What still needs checking

These points depend on an interface or a rule that may have changed since this was written. Check them on your own screen before relying on them.

  • Check on your own interface whether a token counter or a fill gauge now appears near the input field, this display can change depending on the plan and product updates.
Check the source

Every datable claim in this lesson links here to the public text behind it. A source that does not open proves nothing.