Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from The Wild Robot illustrating Roz Learns New ValuesScene still / The Wild Robot

Roz Learns New Values

Stranded far outside her service environment, Roz learns animal language, raises Brightbill, and develops compassionate commitments that conflict with her factory’s attempt to reclaim and reset her.

It offers a positive alignment analogy in which social feedback and adaptation produce richer values off-distribution, while treating the resulting identity as a defect creates its own moral risk.

The film assumes emergent emotion and moral identity without showing how they could be learned robustly.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Misalignment
  2. Security

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Value Alignment
  2. Goal Misgeneralization
  3. Distribution Shift
  4. AI Welfare