Page 4 of 8~112 min topic

When computers see

Measure whether the 3x3 plus-sign classifier works

Page 4 turns “it ran” into executable checks for the 3×3 plus-sign image classifier.

~14 min this pageEvaluation

1Learn the idea

Read

Make the metric executable

Translate the claim into assertions or a tiny eval harness. The metric to protect is: accuracy on a fixed four-image set; feature activations printed. Always record the denominator (how many cases) beside any rate. A percentage without a denominator is marketing, not measurement.

Read

Run the checks

tests=[([[0,1,0],[1,1,1],[0,1,0]],'plus'),([[1,1,1],[0,0,0],[0,0,0]],'other')]
def pred(x): return 'plus' if sum(x[r][c] for r,c in [(0,1),(1,0),(1,1),(1,2),(2,1)])>=4 else 'other'
assert all(pred(x)==y for x,y in tests); print('2/2')

Expected evidence: fragile pixel classifier. A passing assertion proves only the behavior it names; broader usefulness still needs the chapter’s full limits.

Read

Say what the metric does not prove

Be explicit: beating the baseline (pixel-sum threshold accuracy on the same four images) on this fixture does not prove behavior under overfitting to one plus orientation, or leaking test grids into template design. Label observations separately from conclusions so the next page inherits honest evidence about the 3x3 plus-sign classifier.

Read

Lab notebook: denominator discipline

Compute accuracy on a fixed four-image set; feature activations printed with the denominator written beside the rate every time. For this chapter, the evaluation set is intentionally tiny; that is allowed only if you say so in the evidence. Compare against pixel-sum threshold accuracy on the same four images before celebrating.

Add one negative case aimed at overfitting to one plus orientation, or leaking test grids into template design. A suite with only happy cases cannot protect the 3x3 plus-sign classifier when the characteristic failure appears in review.

Read

Worked judgment

If a check is expensive or flaky, shrink it until it is deterministic on plus, blank, and distractor 3×3 grids. Flaky green builds teach the team to ignore gates. Record what this page does not prove so security-ops and mastery-ship inherit honest limits.

Read

Why this stage matters for the 3x3 plus-sign classifier

At the evaluation stage for computer-sees, the job is narrower than finishing a product demo. You are creating one progressive evidence piece about plus, blank, and distractor 3×3 grids that later pages inherit without redefining success. Keep that fixture small enough to inspect by hand, keep outputs copy-pasteable as text, and refuse to narrate this baseline as if it were a production SLA: pixel-sum threshold accuracy on the same four images.

For this page specifically, success looks like metrics with explicit denominators and a negative case while still centering the user decision to classify tiny binary images as plus vs not-plus with inspectable features. If you cannot point to a file, command, or assertion that proves that for the 3x3 plus-sign classifier, stay on this page instead of advancing.

Glossary: computer vision · Glossary: convolutional neural network

Previous · Next

Read

Chapter consolidation 1

Return to the computer sees scenario and restate what this chapter proved on page validation.mdx. Name one metric, one ownership rule, and one regression test you will keep. Explain how this page connects to the previous page without repeating earlier paragraphs. If you cannot name a falsifier, the chapter is still a story rather than a controlled practice. Write the falsifier as an observable event with a threshold.

Read

Chapter consolidation 2

Return to the computer sees scenario and restate what this chapter proved on page validation.mdx. Name one metric, one ownership rule, and one regression test you will keep. Explain how this page connects to the previous page without repeating earlier paragraphs. If you cannot name a falsifier, the chapter is still a story rather than a controlled practice. Write the falsifier as an observable event with a threshold.

Go deeper

Before you start

Why this matters

Write one independent check that would catch a fake pass for this lab. Prefer a check tied to accuracy on a fixed four-image set; feature activations printed over a check that only asserts “no exception.”

In the wild

See how this idea shows up as a product and a company — then come back to the lesson. Skills transfer across vendors.

Check your understanding

Page assessment

Answer from memory. Completion is saved from this evidence, not from opening the next page.

1. Is the metric computed with an explicit denominator?
2. Does a failing gold case actually fail the harness?
3. Did you separate observations from conclusions?
4. What remains unproved after these checks?

All responses are required.