Reference · Glossary

Batch inference

Running many model calls in one scheduled batch instead of one sync request at a time.

#When to use

When the term shows up in labs, architecture docs, or API docs for AI apps.

When a simpler word (prompt, chat, search) is enough for your audience.

See the linked lesson for an interactive walkthrough.