MoESD: Unveil Speculative Decoding's Potential for Accelerating Sparse MoE

NeurIPSSpotlight2025

Authors
Zongle Huang, Lei Zhu, ZongYuan Zhan, Ting Hu, Weikai Mao, Xianzhi Yu, Yongpan Liu, Tianyu Zhang
Venue
NeurIPS 2025
Track
Spotlight

TL;DR

Large Language Models (LLMs) have achieved remarkable success across many applications, with Mixture of Experts (MoE) models demonstrating great potential…

Opening excerpt from the authors’ abstract. source

Read the paper

Topics

large language model mixture of experts language model llm

Related NeurIPS papers

← All NeurIPS 2025 Spotlight papers · Browse the whole archive