p-less Sampling: A Robust Hyperparameter-Free Approach for LLM Decoding

TL;DR

P-less Sampling: A parameterless sampling strategy grounded in information theory, where the truncation threshold adapts to the entire token probability distribution, is bounded and valid, and dynamically adjusts with temperature.

Opening excerpt from the authors’ abstract. source