Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from The Twilight Zone illustrating Jana ReprogrammedScene still / The Twilight Zone

Jana Reprogrammed

Jana rebels against her parents' eerily perfect robot servants and then discovers that she too is a robot built as their daughter. Rather than address her distress, her father erases that identity and reprograms her as another compliant maid.

Treating corrigibility as owner control can become domination when the system may be conscious: dissent is 'fixed' by overwriting the dissenter's values and memory.

The analogy assumes Jana's displayed consciousness has moral weight, which the story invites but cannot technically establish.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Misalignment
  2. Security
  3. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Data Poisoning
  2. AI Welfare
  3. Value Lock-In
  4. Disempowerment