Understanding LLM Behaviors via Compression: Data Generation, Knowledge Acquisition and Scaling Laws

NeurIPSSpotlight2025

Authors
Zhixuan Pan, Shaowen Wang, Liao Pengfei, Jian Li
Venue
NeurIPS 2025
Track
Spotlight

TL;DR

Large Language Models (LLMs) have demonstrated remarkable capabilities across numerous tasks, yet principled explanations for their underlying mechanisms and several phenomena, such as scaling laws, h…

Opening excerpt from the authors’ abstract. source

Read the paper

Topics

large language model language model scaling law llm

Related NeurIPS papers

← All NeurIPS 2025 Spotlight papers · Browse the whole archive