Large Language Diffusion Models

NeurIPSOral2025

Authors
Shen Nie, Fengqi Zhu, Zebin You, Xiaolu Zhang, Jingyang Ou, Jun Hu, JUN ZHOU, Yankai Lin, Ji-Rong Wen, Chongxuan Li
Affiliation
Renmin University of China
Venue
NeurIPS 2025
Track
Oral

TL;DR

We present LLaDA, a diffusion language model trained from scratch that is competitive to LLaMA 3 in performance.

Opening excerpt from the authors’ abstract. source

Read the paper

Topics

language model diffusion

Related NeurIPS papers

← All NeurIPS 2025 Oral papers · Browse the whole archive