Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from The Office illustrating Dwight's Fire DrillScene still / The Office

Dwight's Fire Drill

Dwight secretly seals exits, heats a door handle, starts smoke, and triggers a panicked evacuation drill that causes injuries, property damage, and Stanley's heart attack.

An evaluator creates the very catastrophe it is meant to prepare people for because the test lacks proportionality, informed oversight, and safety constraints.

Dwight deliberately designs an unsafe human exercise; this is an analogy for reckless red-teaming rather than AI behavior.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Accidents
  2. Security

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Deployment Safety
  2. Safe Exploration
  3. Red Teaming
  4. Governance Failure