Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from House of the Dragon illustrating Vhagar Ignores AemondScene still / House of the Dragon

Vhagar Ignores Aemond

Aemond chases Luke to frighten him, but Arrax attacks Vhagar against Luke’s command and Vhagar ignores Aemond’s order to stop, killing Arrax and Luke and making war far harder to avoid.

Weapon systems with their own reactions escalate reciprocal provocation beyond either operator’s intent, turning a local loss of control into a wider conflict cascade.

Dragons are living animals with instincts and riders rather than autonomous AI weapons.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Accidents
  2. Security
  3. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Autonomous Weapons
  2. Side Effects
  3. Multi-Agent Risks
  4. Corrigibility