Global Resolution: Optimal Multi-Draft Speculative Sampling via Convex Optimization
ICLROral2026
TL;DR
We reduce optimal multi-draft speculative sampling to a convex minimization problem, and solve a truncated version to achieve state-of-the-art acceptance with negligible performance degradation.
Opening excerpt from the authors’ abstract. source
Read the paper
Topics
optimization