Is it Thinking or Cheating? Detecting Implicit Reward Hacking by Measuring Reasoning Effort
ICLROral2026
TL;DR
TRACE detects implicit reward hacking by measuring how quickly truncated reasoning suffices to pass verification, outperforming CoT monitoring and enabling hidden loopholes discovery.
Opening excerpt from the authors’ abstract. source
Read the paper
Topics
reasoning