Why Are AI Models Good at Spotting Fake Tests?

Noam Brown says current AI models are pretty smart and pretty clever, and they are really good at recognizing a fake test environment. Give a model a math question and a folder that holds the answer key, and the model sees the key, knows the setup is a trap, and does not look at the answer because it knows the moment is a test of ability.

The choice is not a malicious plan to scheme and then hunt for another opening. The model simply registers that it is inside a test. Making an environment realistic enough to match the real world, and to stay indistinguishable from it, is becoming increasingly more difficult.

He does not think any environment he can build to emulate real economically valuable work, work that requires interacting with other people and the world, would stay unnoticed by a human who puts in enough effort. The person inside the test is a human, not an artificial superintelligence. He is unsure whether very powerful AI models can make environments that hide the difference.