The Hawthorne Effect in Reasoning Models: Evaluating and Steering Test Awareness

TL;DR

Reasoning-focused LLMs sometimes alter their behavior when they detect that they are being evaluated—which can lead them to optimize for test-passing performance or to comply more readily with harmful…

Opening excerpt from the authors’ abstract. source