Reference · Glossary

Inference endpoint

HTTP (or gRPC) URL where a deployed model accepts inputs and returns predictions.

When to use

When the term shows up in labs, architecture docs, or API docs for AI apps.

When not to

When a simpler word (prompt, chat, search) is enough for your audience.

Example

See the linked lesson for an interactive walkthrough.