Aggregation Hides Out-of-Distribution Generalization Failures from Spurious Correlations

TL;DR

Benchmarks for out-of-distribution (OOD) generalization often reveal a strong positive correlation between in-distribution (ID) and OOD accuracy across models, a phenomenon known as “accuracy-on-the-l…

Opening excerpt from the authors’ abstract. source