The Spacetime of Diffusion Models: An Information Geometry Perspective

TL;DR

We present a novel geometric perspective on the latent space of diffusion models. We first show that the standard pullback approach, utilizing the deterministic probability flow ODE decoder, is fundamentally flawed.

Opening excerpt from the authors’ abstract. source