rizz.dev
homeaboutblogcontactGitHub
  1. Home
  2. /
  3. Glossary
  4. /
  5. inference cost collapse
Glossary · term94 of 202

inference cost collapse

The rapid, repeated year-over-year drop in the price of running a given level of AI model capability, driven by hardware and software efficiency gains.

also written as inference price collapse

Related terms
compute thresholdA fixed amount of training compute, measured in floating-point operations, that regulation uses as a trigger line above which stricter obligations apply.view term->frontier modelOne of the most capable AI models available at a given time, used as the reference point against which smaller or older models get compared.view term->
At a glance
cited by
1 post
categories
1
first used
jul 2026
Appears in
  • Apple AI Strategy Traded The Frontier For DistributionApple AI strategy now rents a frontier model from Google. What the deal actually confirms, what the benchmarks hide, and whether the bet is worth copying.opinion1 min
previousHumanEvalnextinitialize handshake