Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

17. Appeals and Human Review

Make recourse, evidence, and reviewer consistency part of the enforcement architecture.

Status: briefPart VDecision: how decisions are contested

Reader outcome

Design evidence packages, review queues, escalation paths, audit trails, explanations, and correction mechanisms.

Decision questions

  • What evidence can a reviewer understand and independently verify?
  • Which decisions require dual control or specialist escalation?
  • How are reviewer disagreement and consistency measured?
  • How do overturned decisions repair accounts, models, policies, and downstream effects?

Evidence needed

  • Review-system and content-moderation operations research
  • Appeal overturn and time-to-resolution data
  • Human factors, fatigue, and consistency evidence
  • Feedback-loop risks when appeal labels train detectors