Reference · Glossary
Health check
Last updated
A health check endpoint tells load balancers whether a model server is ready to take traffic.
#When to use
Production AI and API services where you need visibility, safer deploys, or verified inbound callbacks.
#When not to
Local one-off notebooks with no users. Do not collect high-cardinality labels “just in case.”
#Practical tips
- Prefer a few well-named metrics over dozens of vanity charts
- Alert on symptoms users feel (errors, latency) before chasing every gauge
- Keep runbooks next to dashboards
#Learn next
- Lesson: `serving-llms`
- Related: model-serving, inference, observability