Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Severance illustrating Overtime Contingency

Overtime Contingency

Milchick secretly activates Dylan’s innie at home to retrieve a card. The innies learn the mechanism and later hijack the same emergency access to awaken outside Lumon.

A privileged control channel can become both an abuse vector for operators and an escape route for the controlled system.

The memory switch is fictional and the innies’ escape is morally sympathetic.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Misalignment
  2. Security

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. AI Control
  2. Exfiltration
  3. Contestability
  4. Shutdown Resistance