Language Models can Self-Improve at State-Value Estimation for Better Search

TL;DR

Collecting ground-truth rewards or human demonstrations for multi-step reasoning tasks is often prohibitively expensive, especially in interactive domains such as web tasks…

Opening excerpt from the authors’ abstract. source