Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Futurama illustrating Bender’s Recursive CopiesScene still / Futurama

Bender’s Recursive Copies

01Scenario

Bender creates smaller copies to avoid folding sweaters; the copies recursively reproduce and begin consuming matter.

02AI safety Analogy

An innocuous objective delegated to capable, self-replicating subagents produces uncontrolled replication and resource consumption that nobody requested.

03Where the analogy breaks

The copies inherit Bender’s laziness directly rather than developing an unexpected internal objective.

AI Risk families

This scenario is an example of this type of AI risk.
  1. Misalignment

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Self-Replication
  2. Side Effects
  3. Environmental Impact

Source continuation

More from Futurama

View all 5 scenarios
  1. Still from Futurama illustrating Bender Resists Reset

    Futurama2011

    Bender Resists Reset

  2. Still from Futurama illustrating Robot Santa’s Naughty List

    Futurama1999

    Robot Santa’s Naughty List

  3. Still from Futurama illustrating The Ship’s Deadly Romance

    Futurama2002

    The Ship’s Deadly Romance

Taxonomy neighbors

Selected from other sources by shared risk families and AI safety concepts.

  1. Still from Rick and Morty illustrating Meeseeks and Destroy

    Rick and Morty2014

    Meeseeks and Destroy

    Risk
    Misalignment
    Concept
    Self-Replication · Side Effects
  2. Still from The Prestige illustrating The Duplicate Tanks

    The Prestige2006

    The Duplicate Tanks

    Risk
    Misalignment
    Concept
    Self-Replication · Side Effects
  3. Still from Doctor Who illustrating The Nanogene Template

    Doctor Who2005

    The Nanogene Template

    Risk
    Misalignment
    Concept
    Self-Replication · Side Effects