Quantum Doubly Stochastic Transformers

NeurIPSSpotlight2025

Authors
Jannis Born, Filip Skogh, Kahn Rhrissorrakrai, Filippo Utro, Nico Wagner, Aleksandros Sobczyk
Venue
NeurIPS 2025
Track
Spotlight

TL;DR

At the core of the Transformer, the softmax normalizes the attention matrix to be right stochastic…

Opening excerpt from the authors’ abstract. source

Read the paper

Topics

transformer attention

← All NeurIPS 2025 Spotlight papers · Browse the whole archive