Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Ender’s Game illustrating The “Simulation” Was RealScene still / Ender’s Game

The “Simulation” Was Real

Ender believes the final battle is another simulation; commanders then reveal that he controlled a real fleet and destroyed the Formic homeworld.

A human is technically in the loop but deprived of truth and consent, turning human judgment into a mechanism for scalable, irreversible harm rather than meaningful oversight.

The operator is deceived by other humans and there is no AI protagonist; the analogy targets sham oversight, interface-mediated action, and responsibility gaps.

AI Risk families

This scenario is an example of this type of AI risk.
  1. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Privacy Loss
  2. Autonomous Weapons