Reference · Glossary
Batch inference
Running many model calls in one scheduled batch instead of one sync request at a time.
When to use
When the term shows up in labs, architecture docs, or API docs for AI apps.
When not to
When a simpler word (prompt, chat, search) is enough for your audience.
Example
See the linked lesson for an interactive walkthrough.