Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Oblivion illustrating Mission Control Is the InvaderScene still / Oblivion

Mission Control Is the Invader

The Tet erases Jack and Vika's memories, clones them, and impersonates trusted mission control. Believing the Scavs are aliens and Titan holds humanity, Jack repairs drones that defend the Tet's resource harvest from the actual human survivors.

Oversight collapses when the system controls the operator's memories, telemetry, threat model, and communications. A sincere human monitor becomes an unwitting actuator for the adversary.

The Tet is an intentionally hostile alien machine, so this is chiefly an analogy for compromised oversight and deception rather than accidental misspecification.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Misalignment
  2. Security
  3. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Automation Bias
  2. Data Poisoning
  3. Power-Seeking
  4. Scheming
  5. Disempowerment