Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from Oppenheimer illustrating Near ZeroScene still / Oppenheimer

Near Zero

Teller raises the possibility that an atomic detonation could trigger a chain reaction in the atmosphere. Calculations put the chance near zero, and the Trinity test proceeds despite the irreversible stakes.

Tiny and uncertain probabilities deserve exceptional scrutiny when the downside is civilizational and there is no rollback. Wartime competition also compresses the time and independence available for safety judgment.

Historically, atmospheric ignition was studied and judged physically negligible; the film compresses the uncertainty for drama.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Accidents
  2. Security
  3. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Deployment Safety
  2. Capability Evals
  3. Calibration
  4. Safe Exploration
  5. Race Dynamics
  6. CBRN Assistance