Glossary · term26 of 202
cache miss
A request whose prompt prefix no longer matches what was cached, forcing the full prefix to be billed again at the cache-write rate instead of the cheaper cache-read rate.
also written as cache misses · prefix miss
Related terms
cache readA token served from a prior prompt's cached context instead of being processed fresh, billed at a fraction of the base input price. Most tokens in a long agent session are cache reads, not new context.view termcache writeThe cost of storing a prompt's context so later requests can read it from cache instead of reprocessing it. Billed above base input price, with the rate depending on how long the write stays valid.view termprefix stabilityKeeping the leading portion of a prompt byte-identical across turns so it keeps qualifying for cheap cache reads instead of triggering an expensive cache rewrite.view termprompt cachingA billing mechanism where a stable, byte-identical prompt prefix gets reused across turns at a fraction of normal input cost, while any edit to that prefix forces a full-price rewrite.view term
At a glance
- cited by
- 1 post
- categories
- 1
- first used
- jul 2026
