Glossary · term188 of 202

token budget

A fixed cap on how many tokens a prompt may use, the objective a compression algorithm optimizes toward without regard for which tokens an action actually depends on.

At a glance
cited by
4 posts
categories
3
first used
apr 2026
Appears in
previoustitan chipnexttoken routing