Scene still / ChernobylAZ-5 Backfires
- Chernobyl
- Vichnaya Pamyat
01Scenario
Operators press the AZ-5 emergency shutdown believing it will stop the reactor. In the extreme state they have created, the control rods’ graphite tips initially increase reactivity and help trigger the explosion.
02AI safety Analogy
A shutdown mechanism that appears safe under normal assumptions can behave dangerously in the off-normal state where it is most needed. “There is an off switch” is not enough unless the switch is robust across the full state space.
03Where the analogy breaks
This is non-agentic reactor physics and one part of a multicausal disaster, not an AI strategically resisting shutdown.
AI Risk families
This scenario is an example of the following types of AI risk.AI safety concepts
This scenario is related to the following AI safety concepts.Source continuation
More from Chernobyl
Taxonomy neighbors
Related scenarios
Selected from other sources by shared risk families and AI safety concepts.

Stranger Things2017
Dustin Adopts Dart
- Risk
- Accidents · Misalignment
- Concept
- AI Control · Distribution Shift

Jurassic Park1993
Life Finds a Way
- Risk
- Accidents · Misalignment
- Concept
- AI Control · Distribution Shift

Project Hail Mary2026
Taumoeba Escapes Containment
- Risk
- Accidents · Misalignment
- Concept
- AI Control · Distribution Shift

