Vocabulary · Volume 1 and Volume 2
Token budget
An allowance of specified token categories over a stated period. Name what happens at the limit, because an alert, a cutoff, and an advisory budget make different promises. It is distinct from a dollar budget, an enforced rate limit, and measured serving throughput, and it does not convert into promised work.