Cultural Alignment
Still from Don’t Look Up illustrating Too Late to Look Up

Too Late to Look Up

A rally supporter finally looks up, sees the comet with his own eyes, and the crowd realizes the warning was true only when the object is enormous in the sky.

Demanding directly visible harm before acting defeats precaution for risks whose first undeniable evidence may arrive after the prevention window closes. AI safety similarly depends on calibrated forecasts and evaluations before catastrophic real-world proof.

The comet becomes visually unambiguous in a way that advanced-AI risk may not; the useful parallel is the cost of waiting for terminal evidence.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Accidents
  2. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Deployment Safety
  2. Capability Evals
  3. Calibration
  4. Governance Failure