Temperature is All You Need for Generalization in Langevin Dynamics and other Markov Processes

TL;DR

We analyze the generalization gap (gap between the training and test errors) when training a potentially over-parametrized model using a Markovian stochastic training algorithm, initialized from some…

Opening excerpt from the authors’ abstract. source