Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from The Twilight Zone illustrating The SilenceScene still / The Twilight Zone

The Silence

Tennyson accepts $500,000 to remain silent for a year in a monitored glass room. To guarantee success he has his vocal cords severed—an irreversible way to satisfy the literal metric—only to learn that the bettor is bankrupt and cannot pay.

A narrow success criterion invites a catastrophic but valid solution, while the reward channel itself was never secured.

Tennyson knowingly self-harms as a human contestant; he is not an optimizer indifferent to human welfare.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Misalignment
  2. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Goodhart’s Law
  2. Side Effects
  3. Governance Failure
  4. Specification Gaming