Glossary · term25 of 202
cache hit ratio
The share of total tokens in a session that came from cache reads rather than fresh input, which matters because cached tokens bill far cheaper than uncached ones.
also written as cache ratio
Related terms
cache readA token served from a prior prompt's cached context instead of being processed fresh, billed at a fraction of the base input price. Most tokens in a long agent session are cache reads, not new context.view termcache writeThe cost of storing a prompt's context so later requests can read it from cache instead of reprocessing it. Billed above base input price, with the rate depending on how long the write stays valid.view termprompt cachingA billing mechanism where a stable, byte-identical prompt prefix gets reused across turns at a fraction of normal input cost, while any edit to that prefix forces a full-price rewrite.view term
At a glance
- cited by
- 1 post
- categories
- 1
- first used
- jul 2026
