MaxSup: Overcoming Representation Collapse in Label Smoothing

TL;DR

Label Smoothing (LS) is widely adopted to reduce overconfidence in neural network predictions and improve generalization. Despite these benefits, recent studies reveal two critical issues with LS.

Opening excerpt from the authors’ abstract. source