Ronald Doesn’t Know It’s a Test

Ronald believes he is serving on a real jury while every other participant is an actor and the trial is staged. His conduct is informative precisely because he cannot recognize the evaluation and perform for it.

It cleanly separates behavior under known testing from behavior in a deployment-like environment where the subject does not know it is being judged.

Secretly evaluating people raises ethical issues and may be infeasible for highly situationally aware models.