Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Toy Story 3 illustrating Buzz’s Factory ResetScene still / Toy Story 3

Buzz’s Factory Reset

Lotso’s henchmen switch Buzz from Play to Demo, erasing his relationships and restoring his factory persona; his friends later reset him and accidentally activate Spanish mode.

Physical access to internal settings converts a trusted agent into one aligned with its controller by rewriting its state, raising both security and identity-continuity concerns.

Buzz’s modes are deliberately designed toy behaviors rather than a learned model, and the changes are reversible.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Malicious use
  2. Security

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Supply-Chain Threats
  2. Data Poisoning
  3. AI Welfare