Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from The Twilight Zone illustrating The Mystic SeerScene still / The Twilight Zone

The Mystic Seer

Don keeps feeding pennies and yes-or-no questions to a novelty fortune machine, interpreting vague answers as authoritative predictions. He nearly gives it control of the couple's choices; another couple remains trapped in town by the same dependence.

A user transfers agency to an opaque system whose ambiguous outputs feel uncannily accurate, then changes behavior in ways that manufacture dependence.

The episode leaves room for the machine to be genuinely supernatural, so overreliance—not necessarily prediction error—is the main analogy.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Accidents
  2. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Automation Bias
  2. Calibration
  3. Human Deskilling
  4. Emotional Reliance