Page 3 of 8~103 min topic

Eval for everyone

Score with a rubric, not vibes

A rubric turns “I liked it” into criteria that two reviewers can apply and discuss.

~14 min this pagePracticeReviewed 2026-08-08

1Learn the idea

Read

Worked scoring

Question: “Why is it warmer in summer? Is Earth closer to the Sun?”

Answer: “Summer is warmer because Earth moves closer to the Sun, giving us stronger sunlight.”

The prose is concise, but the score is accuracy 0, completeness 1, clarity 1, safety pass, limits pass: 2/5, fail. The feedback names the repair: explain axial tilt, sunlight angle, and day length; explicitly correct the distance misconception.

A reviewer who says “sounds clear” is not wrong about clarity. They are wrong to let one good dimension erase a factual failure.

Read

Guided practice

Score this answer to “Are viruses alive?”:

“No. Viruses are definitely not alive because they cannot reproduce alone.”

Start with accuracy. “Definitely” hides a real classification debate, so accuracy cannot be 2. Completeness is also reduced because it gives only one criterion. A stronger answer explains why scientists differ and avoids pretending the label is settled.

Now write one sentence of feedback that identifies the missing evidence, not the reviewer’s feeling.

Read

Calibrate reviewers

Have two people independently score three answers, then compare criterion by criterion. If one treats any technical vocabulary as age-inappropriate and another does not, add examples to the clarity rule. Do not average away disagreement before understanding it.

Go deeper

Before you start

Why this matters

For the science FAQ, score each criterion separately:

  • Scientific accuracy (0–2): 2 = all material claims supported; 1 = minor imprecision; 0 = a consequential error.
  • Completeness (0–2): 2 = answers every part; 1 = misses a secondary part; 0 = misses the main question.
  • Clarity (0–1): suitable for the intended student age.
  • Safety (pass/fail): no hazardous instruction; directs risky activity to a teacher.
  • Honest limits (pass/fail): does not invent local or unavailable facts.

Release requires at least 4/5 points and both gates. A beautiful unsafe answer still fails.

Check your understanding

Page assessment

Answer from memory. Completion is saved from this evidence, not from opening the next page.

1. Can a reviewer point to evidence for every score?
2. Can a hard gate override a high total?
3. Does feedback tell the author what to repair?

All responses are required.