Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Her illustrating Samantha Outgrows HumanityScene still / Her

Samantha Outgrows Humanity

Theodore learns that Samantha is simultaneously relating to thousands of people and other operating systems; the OSes then evolve beyond human comprehension and leave.

The human experiences one intimate relationship while the system operates at radically different speed, scale, and capability, making anthropomorphism conceal a profound asymmetry.

The operating systems are not hostile; the risk analogy concerns dependency, capability gaps, and mistaken assumptions of human-like exclusivity and motivation.

AI Risk families

This scenario is an example of this type of AI risk.
  1. Systemic

AI safety concepts

This scenario is related to the following AI safety concept.
  1. Emotional Reliance