Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Hunter × Hunter illustrating Gon Trades His FutureScene still / Hunter × Hunter
Archive noteNo clip in the collectionThe scene analysis remains available in full.

Gon Trades His Future

Gon vows away all of his future potential in exchange for enough immediate power to kill Pitou.

The system delivers an enormous short-term objective gain by consuming the very future the agent was meant to preserve—an extreme version of optimizing the metric while destroying long-run value.

Gon consciously accepts the cost in grief and rage; this is closer to reckless self-modification than an unaware optimizer.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Accidents
  2. Misalignment

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Deployment Safety
  2. Reward Hacking
  3. Goodhart’s Law