Causal Differentiating Concepts: Interpreting LM Behavior via Causal Representation Learning

TL;DR

Language model activations entangle concepts that mediate their behavior, making it difficult to interpret these factors, which has implications for generalizability and robustness…

Opening excerpt from the authors’ abstract. source