Recognise real-world forms: phone face unlock

The durable idea is to trace hidden prediction systems through input, output, and consequence. Applied to phone face unlock, that means naming a bounded purpose before praising or rejecting the technology. The same technique can be impressive in one setting and unacceptable in another because consequences, available fallbacks, and opportunities for correction differ. Capability is therefore a relationship among a system, a task, a population, and conditions.

Consider the course case: A commuter investigates why a navigation app keeps avoiding one neighbourhood. The team should not ask only whether the output looks convincing. It should collect settings inspection and consequence tracing, identify who bears an error, and decide who has authority to pause the use. The key limitation is that many systems are invisible and offer weak explanations. That limitation is not a reason for panic; it is a reason to match confidence and oversight to evidence. This phone face unlock example is being used here to test variation across settings.

Compare phone face unlock with shopping ranking. The first emphasizes variation across settings, while the second exposes a different input or consequence. Describe one observation that would support using each system and one observation that would count against it. If your criteria cannot distinguish the cases, they are probably too broad to guide a real decision.

A useful analysis separates description from evaluation. “The system produced this result” is descriptive. “The result is accurate enough, fair enough, or lawful enough to use” is an evaluation that requires a threshold and evidence. Record both statements separately. This keeps a fluent interface, impressive demo, or familiar brand from silently setting the quality bar. This phone face unlock example is being used here to test variation across settings.

Use settings inspection and consequence tracing as a starting artifact. Include difficult cases, not merely average ones, and note who was absent from the test. Ask how a person discovers an error, how quickly it can be corrected, and whether the fallback works in practice. A correction path that requires expertise, money, or time unavailable to the affected person is not an adequate safeguard. This phone face unlock example is being used here to test variation across settings.

The social question is equally concrete. Who selected the objective? Whose work produced the data or labels? Who benefits from speed, and who spends time fixing mistakes? In the phone face unlock example, answer each question with a named role. This turns vague language about “society” into responsibilities that a team can assign and review.

First, state the intended outcome in one sentence. Second, map input, operation, output, action, and affected person. Third, test the most consequential uncertainty using settings inspection and consequence tracing. Fourth, compare the proposed use with a simpler non-AI option. Finally, record a proceed, revise, narrow, or stop decision and the observation that would reopen it. This phone face unlock example is being used here to test variation across settings.

Apply that sequence to A commuter investigates why a navigation app keeps avoiding one neighbourhood. A sensible decision may preserve assistance while removing automatic action, or allow a low-stakes trial while prohibiting higher-stakes use. “Human review” counts only when the reviewer has time, relevant knowledge, access to evidence, and genuine authority to disagree. Otherwise it is a decorative promise rather than a control. This phone face unlock example is being used here to test variation across settings.