Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Kung Fu Panda illustrating The Feather That Frees Tai LungScene still / Kung Fu Panda

The Feather That Frees Tai Lung

A feather from Oogway’s messenger falls into Tai Lung’s cell. He uses it to pick his restraints and turns a supposedly overwhelming layered prison into an escape cascade.

A tiny unmodeled artifact crosses a containment boundary; the precautionary inspection prompted by fear inadvertently delivers the capability the prisoner needs.

The feather is coincidence plus prisoner ingenuity, not an optimizing AI, and the prison failure is highly choreographed.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Accidents
  2. Security

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Deployment Safety
  2. AI Control
  3. Side Effects
  4. Adversarial Robustness