Reference · Glossary
Semantic cache
Returning a **stored answer** when a new question is semantically near a past query — skip LLM call on cache hit.
When to use
FAQ bots and support with many near-duplicate questions.
When not to
When answers must always reflect live data with zero staleness.
Example
“How do I reset password?” matches cached entry for “password reset steps” above similarity threshold.