Fighting the Forever War: Trust and Safety Engineering

Citation

Alex Stamos and Shelby Grossman with Riana Pfefferkorn. Fighting the Forever War: Trust and Safety Engineering. Stanford Internet Observatory, living manuscript initially written 2019–2025. Open textbook. Accessed 2026-08-14.

Source type: open textbook / practitioner synthesis
Evidence quality: secondary synthesis with first-hand practitioner experience
Review status: checked

What it says

Trust and Safety is a cross-functional discipline for anticipating and responding to technology-enabled harm. Relevant functions include policy, product, operations, engineering, data science, legal, research, communications, and threat assessment. The introduction recommends prioritizing by harm, prevalence, and product responsibility rather than attention alone, and distinguishes proactive product design from reactive enforcement.

Important claims

• A technically correct use of a platform can still cause harm; this distinguishes many integrity problems from conventional control-breaking security failures.
• Measurement should cover prevalence, response efficiency, and impact, while acknowledging that user reports are selected and incomplete.
• Safety tradeoffs are unavoidable: privacy, accountability, expression, cost, speed, and accuracy cannot all be maximized independently.

Assumptions and weaknesses

The manuscript is explicitly a work in progress and says it does not fully reflect AI’s role. Its center of gravity is user-generated content and serious interpersonal/societal harm, not all transactional fraud, gaming, or automated resource abuse. Practitioner cases are valuable but do not always establish causal effects.

Implications for platform defense

Use it to map functions and tradeoffs, not as the structure of this book. Platform Integrity should extend the evidence-to-decision framework across fraud, automation, marketplaces, gaming, and agents.

Chapters this affects

Chapters 1, 2, 4–7, 15–21.