How do Transformers Learn Implicit Reasoning?

NeurIPSSpotlight2025

Authors
Jiaran Ye, Zijun Yao, Zhidian Huang, Liangming Pan, Jinxin Liu, Yushi Bai, Amy Xin, Liu Weichuan, Xiaoyin Che, Lei Hou, Juanzi Li
Venue
NeurIPS 2025
Track
Spotlight

TL;DR

Recent work suggests that large language models (LLMs) can perform multi-hop reasoning implicitly---producing correct answers without explicitly verbalizing intermediate steps---but the underlying mec…

Opening excerpt from the authors’ abstract. source

Read the paper

Topics

large language model language model transformer reasoning llm

Related NeurIPS papers

← All NeurIPS 2025 Spotlight papers · Browse the whole archive