Instrument
The window
A context window is quoted as one number and behaves as two. You are billed for every token you put in. The model reaches the ends of the prompt reliably and the middle much less so, and the wider the window, the deeper that sag goes. Everything on this site sits downstream of that gap: retrieval exists to keep the window small, caching to make it cheap, memory to decide what earns a place in it.
Drag the diamonds to repartition the prompt. The top bar is what you pay for, the bar under it is what the model gets to. Arrow keys work, and shift moves in fives.
Window
recall by position — 100% to 30%worst 64%
paid above, reached below
| segment | paid | reached | retained |
|---|---|---|---|
| 13k | 12k | ||
| 67k | 48k | ||
| 41k | 33k | ||
| 7.7k | 7.6k |
- billed
- 128k
- reached
- 102k
- paid per token read
- 1.26×