Reference · Glossary
Prometheus
Last updated
Prometheus scrapes and stores time-series metrics — request rates, latencies, and custom counters you export from model servers.
#When to use
Production AI and API services where you need visibility, safer deploys, or verified inbound callbacks.
#When not to
Local one-off notebooks with no users. Do not collect high-cardinality labels “just in case.”
#Practical tips
- Prefer a few well-named metrics over dozens of vanity charts
- Alert on symptoms users feel (errors, latency) before chasing every gauge
- Keep runbooks next to dashboards
#Learn next
- Lesson: `ai-monitoring`
- Related: grafana, observability, ai-monitoring