Reference · Glossary

Eval gate

Last updated

A **CI or deploy checkpoint** that blocks release when golden tasks score below threshold.

When to use

Any production LLM feature that regresses silently (agents, RAG, classifiers).

When not to

Local prototypes with no deploy pipeline yet.

Example

PR fails CI when 7/10 support tickets are misclassified vs baseline 9/10.