Page 7 of 8~112 min topic

Talk to an LLM from code

Set release boundaries for the CLI LLM summarizer

Page 7 defines what the command-line LLM summarizer must refuse before release—security here is not a pasted happy path.

~14 min this pageSafety and operations

1Learn the idea

Read

Threats for this artifact only

Operational risks for the command-line LLM summarizer center on printing API_KEY or full prompts into logs, plus the earlier failure mode (missing choices array treated as empty success, or retries on 400). Safety lives in executable gates, allowlists, redaction, and a named owner—not in a warning paragraph under an unsafe function.

Read

Run the release gate

if(process.env.API_KEY) console.log('key loaded; value not printed'); else console.log('offline test mode');
const safeLog={prompt_sha256:'example',input_chars:20}; console.log(safeLog);

Expected evidence: stage evidence for security ops. A failed assertion means stop, investigate, and do not publish the CLI LLM summarizer.

Read

Owner, retention, rollback

Name who can disable the feature, what data is retained, and how to roll back to the last known good artifact. Pin the reviewed configuration (versions, thresholds, allowlists) so “what shipped” is reconstructable for llm-api-hello.

Read

Lab notebook: release blocker

Write the release blocker as a predicate, not a feeling: “Do not ship the CLI LLM summarizer if printing API_KEY or full prompts into logs.” Pair it with a passing control that shows the reviewed configuration still works for system+user job object for an embeddings definition sentence. Name an owner and a rollback handle (git tag, docs_version, previous image).

Security pages must not paste the happy-path demo. If your gate code looks like the implementation page, replace it with a deny/allow check aimed at printing API_KEY or full prompts into logs.

Read

Worked judgment

State the data retention rule in one line (what is stored, for how long, who can read it). Then state the kill switch (env flag, config pin, or feature owner). The CLI LLM summarizer is not shippable without both, even when contract-test pass rate, latency, retry count, output length looks healthy.

Read

Why this stage matters for the CLI LLM summarizer

At the safety and operations stage for llm-api-hello, the job is narrower than finishing a product demo. You are creating one progressive evidence piece about system+user job object for an embeddings definition sentence that later pages inherit without redefining success. Keep that fixture small enough to inspect by hand, keep outputs copy-pasteable as text, and refuse to narrate this baseline as if it were a production SLA: offline fake transport producing a fixed summary.

For this page specifically, success looks like an executable deny gate for the lab-specific threat while still centering the user decision to turn one user passage into a bounded one-sentence summary via an HTTP-shaped client. If you cannot point to a file, command, or assertion that proves that for the CLI LLM summarizer, stay on this page instead of advancing.

API: chat completions · Glossary: API key

Previous · Next

Go deeper

Before you start

Why this matters

Write an attack or unsafe misuse specific to this lab: printing API_KEY or full prompts into logs. Predict whether your current code blocks it. Then run the gate below and compare.

In the wild

See how this idea shows up as a product and a company — then come back to the lesson. Skills transfer across vendors.

Check your understanding

Page assessment

Answer from memory. Completion is saved from this evidence, not from opening the next page.

1. Is there a concrete release blocker for: printing API_KEY or full prompts into logs?
2. Are retention and rollback rules explicit?
3. Can the reviewed version be identified after release?
4. Did this page use a security-specific check—not the happy-path demo?

All responses are required.