Purifying Shampoo: Investigating Shampoo's Heuristics by Decomposing its Preconditioner

NeurIPSSpotlight2025

Authors: Runa Eschenhagen, Aaron Defazio, Tsung-Hsien Lee, Richard E. Turner, Hao-Jun Michael Shi
Venue: NeurIPS 2025
Track: Spotlight

TL;DR

The recent success of Shampoo in the AlgoPerf contest has sparked renewed interest in Kronecker-factorization-based optimization algorithms for training neural networks…

Opening excerpt from the authors’ abstract. source

Read the paper

OpenReview

Topics

optimization

← All NeurIPS 2025 Spotlight papers · Browse the whole archive