Reference · Glossary

Local inference

Serving a model on your machine or VPC instead of a public cloud API.

#When to use

When the term shows up in labs, architecture docs, or API docs for AI apps.

When a simpler word (prompt, chat, search) is enough for your audience.

See the linked lesson for an interactive walkthrough.