Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from The Rehearsal illustrating Planting the Trivia AnswersScene still / The Rehearsal

Planting the Trivia Answers

Nathan covertly exposes Kor to the night’s trivia answers through staged encounters. Kor later appears to ace the test without realizing that its answer key leaked into his preparation.

A benchmark can report excellent performance while measuring contamination rather than the capability it was designed to test.

Kor is unaware of the leakage, whereas an advanced model might recognize and exploit it strategically.

AI Risk families

This scenario is an example of this type of AI risk.
  1. Security

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Deployment Safety
  2. Capability Evals
  3. Data Poisoning
  4. Sandbagging