Cultural Alignment
Still from Howl's Moving Castle illustrating War Wizards Cannot Change Back

War Wizards Cannot Change Back

01Scenario

Wizards repeatedly transform into monstrous weapons for the war; Suliman warns that many eventually forget how to become human again.

02AI safety Analogy

A competitive deployment race can make temporary adaptations permanent, eroding the values and control mechanisms the operators began with.

03Where the analogy breaks

The loss of humanity is magical and moral rather than a literal model update.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Misalignment
  2. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Goal Misgeneralization
  2. Side Effects
  3. Value Lock-In
  4. Race Dynamics

Franchise continuation

More from Studio Ghibli

View all 10 scenarios
  1. Still from Spirited Away illustrating No-Face Buys Approval

    Spirited Away2001

    No-Face Buys Approval

  2. Still from Whisper of the Heart illustrating Library Metadata

    Whisper of the Heart1995

    Library Metadata

  3. Still from The Boy and the Heron illustrating Parakeet King Rebuilds Reality

    The Boy and the Heron2023

    Parakeet King Rebuilds Reality

Taxonomy neighbors

Selected from other sources by shared risk families and AI safety concepts.

  1. Still from Inception illustrating The Idea Won’t Wake Up

    Inception2010

    The Idea Won’t Wake Up

    Risk
    Misalignment
    Concept
    Goal Misgeneralization · Side Effects · Value Lock-In
  2. Still from The Lord of the Rings: The Fellowship of the Ring illustrating Gandalf Refuses the Ring

    The Lord of the Rings: The Fellowship of the Ring2001

    Gandalf Refuses the Ring

    Risk
    Misalignment · Systemic
    Concept
    Goal Misgeneralization · Value Lock-In
  3. Still from Doctor Who illustrating Clockwork Droids Use Human Parts

    Doctor Who2006

    Clockwork Droids Use Human Parts

    Risk
    Misalignment
    Concept
    Goal Misgeneralization · Side Effects