Glossary · term61 of 202
distractor sensitivity
A model's tendency to lose accuracy as irrelevant or off-task tokens accumulate in its context, even when the genuinely relevant information is still present.
Related terms
attention budgetThe fixed total of attention weight a model has to spend across a window, forced by softmax to sum to 1, so every added token draws share away from the others.view termcontext rotMeasured accuracy decline as a model's input grows longer, even when the extra tokens are irrelevant, showing up well before the advertised context limit is reached.view term
At a glance
- cited by
- 1 post
- categories
- 1
- first used
- jul 2026
