Glossary · term94 of 202
inference cost collapse
The rapid, repeated year-over-year drop in the price of running a given level of AI model capability, driven by hardware and software efficiency gains.
also written as inference price collapse
Related terms
compute thresholdA fixed amount of training compute, measured in floating-point operations, that regulation uses as a trigger line above which stricter obligations apply.view termfrontier modelOne of the most capable AI models available at a given time, used as the reference point against which smaller or older models get compared.view term
At a glance
- cited by
- 1 post
- categories
- 1
- first used
- jul 2026