Cultural Alignment
Still from Nausicaä of the Valley of the Wind illustrating The Half-Built Giant Warrior

The Half-Built Giant Warrior

Kushana deploys the Giant Warrior before it is fully formed; it fires twice, melts apart, and fails to stop the Ohmu stampede.

Race pressure produces premature deployment of an untested strategic capability whose spectacular power is not the same as reliability or mission success.

The weapon is a decaying biological giant rather than software, and its failure limits harm in this instance.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Accidents
  2. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Deployment Safety
  2. Capability Evals
  3. Safe Exploration
  4. Race Dynamics