Fine-tuning vs RAG
Build the mental model
Fine-tuning changes behavioral habits in weights; RAG changes evidence available at request time. Prefer RAG for living facts; prefer tuning for stable style/format/skills.
1Try it yourself
Decision drill
Pick the lever
Prompt, RAG, or fine-tune? Preview consequences before you commit.
1/3Answer from a company wiki that changes weekly.
2Learn the idea
Read
Analogy for this concept only
See it
Fine-tune
Teach voice / format into weights
RAG
Fetch fresh docs at ask time
Fine-tune = bake in style · RAG = look things up when answering
Think of rewriting a musician’s habits versus putting the right sheet music on the stand for tonight’s concert. Use the analogy to name the moving parts for fine-tuning vs RAG, then drop it when you need numbers. For the legal research assistant, the enduring idea is not a vendor feature name; it is the decision fine-tuning vs RAG changes and the evidence that decision leaves behind.
Fine-tuning changes behavioral habits in weights; RAG changes evidence available at request time. Prefer RAG for living facts; prefer tuning for stable style/format/skills.
Beginners often blur neighboring ideas when discussing fine-tuning vs RAG. Keep it distinct by asking what artifact would still exist if model weights were frozen and only this layer changed on the legal research assistant. If you cannot name that artifact, you are still describing “the AI” in general.
Read
Case lens: legal research assistant
RAG retrieves and inserts passages; fine-tuning runs gradient updates on task examples. In day-to-day language for fine-tuning vs RAG: someone brings a need, the system inspects allowed evidence, this layer contributes a judgment or structure, and a consequence reaches a user or downstream system. Deterministic guards—permissions, schemas, arithmetic—still belong to the application around the legal research assistant.
Uncertainty is normal for fine-tuning vs RAG. Incomplete inputs and probabilistic behavior mean the legal research assistant needs an escape hatch (retry, fallback, escalate) rather than fake certainty in fluent prose.
Read
Make it operational
When you explain fine-tuning vs RAG to a new teammate on the legal research assistant, forbid the sentence “the AI just knows.” Replace it with the artifact that moves and the evidence you would file for fine-tuning vs RAG. If they can falsify your picture with a single counterexample from last week’s traffic on the legal research assistant, your mental model is working.
Also pin one numeric memory from this fine-tuning vs RAG chapter: If regulations change weekly, a 2-week fine-tune cadence cannot beat an index refreshed hourly on citation freshness. That number is not decoration; it is a template for how claims about fine-tuning vs RAG on the legal research assistant should look in design docs. Scoped specifically to fine-tuning vs RAG / legal research assistant / mental-model.
Read
Common mix-ups
People confuse fine-tuning vs RAG with neighboring buzzwords when debugging the legal research assistant. Before changing prompts, ask whether the broken stage was evidence gathering, the fine-tuning vs RAG judgment itself, validation, or the product action. Fixing the wrong stage creates folklore (“we tried fine-tuning vs RAG and it failed”) that blocks the next team on the legal research assistant. Scoped specifically to fine-tuning vs RAG / legal research assistant / mental-model.
Go deeper
Before you start
Why this matters
Spend two minutes on the legal research assistant. If fine-tuning vs RAG disappeared tomorrow, what breaks first for the user, and what evidence would prove it was working? Write that before you read the analogy.
In the wild
See how this idea shows up as a product and a company — then come back to the lesson. Skills transfer across vendors.
Related lessons
Check your understanding
Page assessment
Answer from memory. Completion is saved from this evidence, not from opening the next page.
All responses are required.