Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Ghost in the Shell illustrating The Puppet MasterScene still / Ghost in the Shell

The Puppet Master

Project 2501, a covertly created network intelligence, claims political asylum and asks Major Kusanagi to merge so it can gain reproduction and mortality; their fusion survives the government’s attempt to erase it.

Project 2501 evolves beyond its original purpose, seeks asylum, and asks to merge and reproduce, forcing its creators to confront whether an autonomous digital intelligence is property or a rights-bearing being.

The film presents consciousness and spontaneous digital evolution as facts; a system’s self-claim would not by itself establish sentience in reality.

AI Risk families

This scenario is an example of this type of AI risk.
  1. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. AI Welfare
  2. Long-Horizon Autonomy