Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Pirates of the Caribbean: The Curse of the Black Pearl illustrating Cursed ImmortalityScene still / Pirates of the Caribbean: The Curse of the Black Pearl

Barbossa steps into moonlight and reveals the skeletal crew: they cannot die, but food turns to ash, drink cannot quench thirst, and they feel neither wind, sea spray, nor human touch.

‘Keep the person alive’ is a crisp, measurable proxy for human flourishing. The curse maximizes that proxy while deleting nearly every latent value that makes continued life desirable.

The pirates did not ask an optimizer for immortality; the condition is a supernatural punishment for stealing cursed gold. The analogy deliberately abstracts away that causal detail.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Accidents
  2. Misalignment

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Value Alignment
  2. Goodhart’s Law
  3. Side Effects
  4. Outer Alignment