Chapter C · 8 pages · ~96 min

Local LLMs & Ollama

A practical, evidence-led chapter on local LLMs: mechanism, controls, tradeoffs, failure analysis, evaluation, and deployment decisions.

What you will be able to do

  • Explain local LLMs with an accurate system boundary
  • Trace evidence and decisions through a realistic an offline clinical note assistant
  • Choose controls by quality, resource, and risk effects
  • Evaluate alternatives with segmented metrics, hard gates, and a reversible response

Lessons in this topic

  1. 01Build the mental model12m
  2. 02Understand the mechanism12m
  3. 03Learn the controls and knobs12m
  4. 04Weigh the tradeoffs12m
  5. 05Anticipate failure modes12m
  6. 06Evaluate with evidence12m
  7. 07Trace a worked example12m
  8. 08Mastery: connect the pieces12m