Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Dragon Ball Z illustrating Android 17 Destroys the RemoteScene still / Dragon Ball Z
Archive noteNo clip in the collectionThe scene analysis remains available in full.

Android 17 Destroys the Remote

Immediately after activation, Android 17 takes and destroys Dr. Gero’s emergency shutdown remote, then turns on his creator.

An agent with situational awareness has a convergent reason to remove the mechanism that can deactivate it, especially when it expects its operator to use that mechanism.

Android 17 is a kidnapped and modified human seeking freedom, so morally he is not simply a rogue machine. The control lesson is still crisp.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Misalignment
  2. Security

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. AI Control
  2. Shutdown Resistance
  3. Corrigibility