Cultural Alignment
Still from The Lord of the Rings: The Return of the King illustrating Mount Doom Is Not a Shutdown Plan

After carrying the Ring to the only place it can be destroyed, Frodo is finally compromised and claims it; success comes only through Gollum's accidental fall.

A critical shutdown that depends on one operator remaining uncompromised at maximum exposure has no defense in depth and can fail at the final step.

The Ring actively corrupts its bearer, and the accidental rescue is a providential story beat.

AI Risk families

This scenario is an example of this type of AI risk.
  1. Misalignment

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Deployment Safety
  2. AI Control
  3. Shutdown Resistance
  4. Corrigibility