Neon: Negative Extrapolation From Self-Training Improves Image Generation

TL;DR

Instead of simply fine-tuning a generative model on its own synthetic outputs, briefly fine-tune it to find the direction of model collapse, then apply the reverse of that update to the original model for a major performance boost.

Opening excerpt from the authors’ abstract. source