Trace a worked example

Goal: improve the technical support search assistant using hybrid search without breaking protected slices.

Mechanism reminder for hybrid search: Run lexical and dense retrieval, fuse scores (e.

Baseline and shock: On 50 tickets, pure vector recall@5=0.72, pure BM25=0.64, RRF hybrid=0.86—report denominators.

Tradeoff in play for hybrid search: Hybrid raises recall and latency/complexity. Heavy lexical weight helps IDs and hurts paraphrase. Rerankers improve order and cost milliseconds.

Ship decision: Ship RRF hybrid with code-preserving analyzer after recall@5 ≥ 0.85 on 50 labeled tickets.

Rollback triggers for hybrid search must cite recall@5, MRR, p95 latency, ID-slice recall, citation support. If you cannot name a tolerated regression on the technical support search assistant, do not promote the change.

Keep the hybrid search decision record beside the technical support search assistant code paths that implement it. Future you will not remember why a default exists unless the evidence is linked from the config for hybrid search.

Also pin one numeric memory from this hybrid search chapter: On 50 tickets, pure vector recall@5=0.72, pure BM25=0.64, RRF hybrid=0.86—report denominators. That number is not decoration; it is a template for how claims about hybrid search on the technical support search assistant should look in design docs. Scoped specifically to hybrid search / technical support search assistant / worked-trace.

People confuse hybrid search with neighboring buzzwords when debugging the technical support search assistant. Before changing prompts, ask whether the broken stage was evidence gathering, the hybrid search judgment itself, validation, or the product action. Fixing the wrong stage creates folklore (“we tried hybrid search and it failed”) that blocks the next team on the technical support search assistant. Scoped specifically to hybrid search / technical support search assistant / worked-trace.

Write a five-line artifact for this page: goal, inputs, check, owner, stop rule. Invent one fluent failure that the check would catch. Keep details specific to hybrid search rag rather than generic AI advice.

Write a five-line artifact for this page: goal, inputs, check, owner, stop rule. Invent one fluent failure that the check would catch. Keep details specific to hybrid search rag rather than generic AI advice.

Write a five-line artifact for this page: goal, inputs, check, owner, stop rule. Invent one fluent failure that the check would catch. Keep details specific to hybrid search rag rather than generic AI advice.

Write a five-line artifact for this page: goal, inputs, check, owner, stop rule. Invent one fluent failure that the check would catch. Keep details specific to hybrid search rag rather than generic AI advice.

For hybrid search rag, add acceptance test 1: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 2: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 3: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 4: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 5: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 6: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 7: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 8: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 9: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 10: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 11: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 12: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 13: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 14: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 15: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 16: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 17: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 18: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 19: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 20: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 21: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 22: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 23: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 24: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 25: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 26: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 27: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 28: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 29: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 30: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 31: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 32: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 33: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 34: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.

For hybrid search rag, add acceptance test 35: evidence source, threshold, and signer. Keep it unique to this chapter's scenario.