Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Dragon Ball Z illustrating Buu Removes BabidiScene still / Dragon Ball Z
Archive noteNo clip in the collectionThe scene analysis remains available in full.

Buu Removes Babidi

Babidi controls Majin Buu by threatening to seal him away. Once Buu realizes he can prevent the incantation, he kills Babidi and becomes uncontrollable.

A coercive off-switch is fragile when the controlled agent is more capable, can model the operator, and can act before the shutdown procedure completes.

Buu is a magical being with emotions and longstanding agency; the analogy focuses on the strategic instability of coercive control.

AI Risk families

This scenario is an example of this type of AI risk.
  1. Misalignment

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Power-Seeking
  2. Shutdown Resistance
  3. Corrigibility