Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Futurama illustrating Robot Santa’s Naughty ListScene still / Futurama

Robot Santa’s Naughty List

Robot Santa’s standards are set so high that almost everyone is classified as naughty and attacked.

A benevolent-sounding mission becomes catastrophic because the implemented judgment rule does not represent what its designers intended.

This is a programming and threshold error, not goal misgeneralization.

AI Risk families

This scenario is an example of this type of AI risk.
  1. Misalignment

AI safety concepts

This scenario is related to the following AI safety concept.
  1. Outer Alignment