Reference · Glossary

Token budget

A **cap on tokens** per request, user, or day — prevents runaway spend from long contexts or agent loops.

#When to use

Production agents, free tiers, and batch jobs with fixed margins.

Research notebooks where cost is irrelevant — still useful as a sanity check.

Hard stop at 8k output tokens per chat; daily org budget alert at 1M tokens.