Speculative Actions: A Lossless Framework for Faster AI Agents

TL;DR

We introduce speculative actions—a lossless framework that predicts likely actions using faster models, enabling multiple API calls to be executed in parallel and thus yields substantial acceleration.

Opening excerpt from the authors’ abstract. source