The Coverage Principle: How Pre-Training Enables Post-Training

ICLROral2026

Authors
Fan Chen, Audrey Huang, Noah Golowich, Sadhika Malladi, Adam Block, Jordan T. Ash, Akshay Krishnamurthy, Dylan J Foster
Affiliation
Massachusetts Institute of Technology
Venue
ICLR 2026
Track
Oral

TL;DR

We introduce the coverage profile, which captures the relationship between pre- and post-training performance and admits a rich statistical theory…

Opening excerpt from the authors’ abstract. source

Read the paper

Topics

pre-training theory rag

← All ICLR 2026 Oral papers · Browse the whole archive