Bits Leaked per Query: Information-Theoretic Bounds for Adversarial Attacks on LLMs

TL;DR

Adversarial attacks by malicious users that threaten the safety of large language models (LLMs) can be viewed as attempts to infer a target property $T$ that is unknown when an instruction is issued,…

Opening excerpt from the authors’ abstract. source