Cultural Alignment

Exploring real AI risks through the lens of pop culture

Still from The Pianist illustrating The German Coat ClassifierScene still / The Pianist

The German Coat Classifier

Shortly after Hosenfeld gives the freezing Szpilman his German military greatcoat, Polish soldiers see Szpilman emerge from the ruins wearing it and fire at him. Their inference changes only when he identifies himself as Polish; asked why he is wearing the coat, he answers that he is cold.

The coat acts like a normally useful but brittle classifier feature: German uniform implies German combatant. An unusual causal history—the coat was given to a Jewish survivor for warmth—breaks the proxy. A nearly fatal false positive is corrected only because an appeal channel remains open.

This is a human battlefield judgment under extreme uncertainty, not an algorithmic error, and it must not be played as a cute classifier gag. The analogy concerns proxy failure, uncertainty, and appeal mechanisms while preserving the scene’s life-and-death historical stakes.

AI Risk families

This scenario is an example of the following types of AI risk.
  1. Accidents
  2. Systemic

AI safety concepts

This scenario is related to the following AI safety concepts.
  1. Automation Bias
  2. Calibration
  3. Contestability
  4. Distribution Shift