Reference · Glossary
Model router
Logic that **picks which model** handles each request — fast/cheap for drafts, capable/expensive for hard tasks.
When to use
Mixed workloads where one model size does not fit all.
When not to
Tiny apps with uniform queries and one SLA.
Example
Route “summarize this paragraph” to a small model; route “multi-step SQL” to a reasoning model.