Dynamical Decoupling of Generalization and Overfitting in Large Two-Layer Networks
NeurIPSOral2025
TL;DR
Large neural networks first learn low dimensional feature representation then overfit the data and revert to a kernel regime.
Opening excerpt from the authors’ abstract. source
Read the paper
Topics
generalization kernel