Reference · Glossary
Local inference
Serving a model on your machine or VPC instead of a public cloud API.
When to use
When the term shows up in labs, architecture docs, or API docs for AI apps.
When not to
When a simpler word (prompt, chat, search) is enough for your audience.
Example
See the linked lesson for an interactive walkthrough.