Page 1 of 8~144 min topic

Capstone ops lab

Define the service boundary and ship target

Ship a falsifiable slice of **Personal Knowledge Assistant API with flags, probes, secrets, on-call owner** — success is ship v1.2.0: smoke+readyz pass; kill switch drill < 60s; on-call roster non-empty, not a polished screenshot.

~18 min this pageOutcome contract

1Try it yourself

Decision drill

Capstone ops gate

Before demo day — metrics, flags, and recovery must be real.

Ship readiness50%

1/3Before demo day: latency + groundedness must page someone.

2Learn the idea

Read

Name the operable slice

This lab builds Personal Knowledge Assistant API with flags, probes, secrets, on-call owner. The human in the loop is solo builder operating pka.example for 50 beta users. Scope is intentionally narrower than “make AI reliable”: you will prove one oracle — ship v1.2.0: smoke+readyz pass; kill switch drill < 60s; on-call roster non-empty — and one invariant — versioned release with readyz, flag kill switch, rotated secret, named on-call. Record non-goals in your notes so a later change cannot silently expand authority. The incident mnemonic for the chapter is CAP-OPS-PKA-12; design as if that ticket is already written and you are filling evidence.

Read

Write the acceptance contract

Turn the oracle into a table: input fixture, expected observable, prohibited side effect, owner, latency/cost ceiling. Separate model taste from software correctness — transport, auth, parsing, and termination must be deterministic even when generated text varies. Primary metric family: readyz_ok, kill_switch_seconds, secret_age_days ≤ 30. Averages without a denominator or revision label do not gate release. Fake external dependencies in unit tests; live calls wait until fakes pass.

Read

Implementation artifact

service: personal-knowledge-assistant
version: 1.2.0
on_call: you@example.com

Read

Freeze the first red test

Before implementation, encode a failing check that would have caught app runs on laptop only — no probes, no owner, secret in .env committed. That failure is the pedagogical north star for later pages: contracts reject it, happy path never performs it, validation asserts it, failure-handling contains it, observability detects it, security-ops prevents privilege tricks around it, and mastery replays it in a drill. Endpoint under study: https://pka.example/v1/ask.

Read

Stage depth

Capacity note for planners: estimate peak demand on https://pka.example/v1/ask and the cost ceiling for a failed retry storm. Write the abort conditions — unbounded spend, cross-tenant leakage, or inability to roll back — before you enjoy the first green test. Prefer synthetic fixtures shaped like production over anonymized production dumps you cannot share in class. When you are tempted to widen scope, re-read the oracle (ship v1.2.0: smoke+readyz pass; kill switch drill < 60s; on-call roster non-empty) and cut features that do not serve it. The teaching outcome is judgment under constraints: solo builder operating pka.example for 50 beta users gets a trustworthy control, not a kitchen-sink framework. Keep the language of release decisions: promote, hold, or roll back — never “see if it gets better.”

Read

Field notes for `capstone-ops-lab` / `lab-goal`

Decide what will live in version control on day one: fixtures, contract markdown, and a failing test name. Write the cost ceiling as a hard number with currency and period. If the lab involves clusters, name the non-prod context you will use and forbid prod kubecontexts in scripts. Capture the baseline metric once before changing code so later gains are comparative. Refuse tools that hide the request path behind magic macros until the oracle is green on fakes. Your README section for this page should be five lines or fewer and still falsifiable. In this chapter the product is Personal Knowledge Assistant API with flags, probes, secrets, on-call owner, the human stakeholder is solo builder operating pka.example for 50 beta users, and the incident id you design against is CAP-OPS-PKA-12. Re-state the oracle in your notes — ship v1.2.0: smoke+readyz pass; kill switch drill < 60s; on-call roster non-empty — and keep the invariant visible: versioned release with readyz, flag kill switch, rotated secret, named on-call. Track readyz_ok, kill_switch_seconds, secret_age_days ≤ 30 as the scoreboard. Surface under change control: https://pka.example/v1/ask.

Go deeper

Before you start

Why this matters

Write the single done-definition a reviewer would accept for Capstone ops lab (CAP-OPS-PKA-12). Include the numeric gate hidden in this oracle: ship v1.2.0: smoke+readyz pass; kill switch drill < 60s; on-call roster non-empty. Then name the fake success you refuse: a demo that ignores app runs on laptop only — no probes, no owner, secret in .env committed. Keep the sentence beside your editor; every later page should make this sentence easier to prove.

Across this capstone you will evolve one product narrative — Personal Knowledge Assistant API with flags, probes, secrets, on-call owner — rather than eight disconnected exercises.

In the wild

See how this idea shows up as a product and a company — then come back to the lesson. Skills transfer across vendors.

Check your understanding

Page assessment

Answer from memory. Completion is saved from this evidence, not from opening the next page.

1. Is the oracle (ship v1.2.0: smoke+readyz pass; kill switch drill < 60s; on-call roster non-empty) falsifiable from a fixture?
2. Is the invariant (versioned release with readyz, flag kill switch, rotated secret, named on-call) stated without hand-waving?
3. Does the contract name CAP-OPS-PKA-12 as a risk you design against?

All responses are required.