Reference · Glossary

Semantic cache

Returning a **stored answer** when a new question is semantically near a past query — skip LLM call on cache hit.

#When to use

FAQ bots and support with many near-duplicate questions.

When answers must always reflect live data with zero staleness.

“How do I reset password?” matches cached entry for “password reset steps” above similarity threshold.