Distilling LLM Agent into Small Models with Retrieval and Code Tools

NeurIPSSpotlight2025

Authors: Minki Kang, Jongwon Jeong, Seanie Lee, Jaewoong Cho, Sung Ju Hwang
Venue: NeurIPS 2025
Track: Spotlight

TL;DR

Large language models (LLMs) excel at complex reasoning tasks but remain computationally expensive, limiting their practical deployment…

Opening excerpt from the authors’ abstract. source

Read the paper

OpenReview

Topics

large language model language model reasoning retrieval agent llm

← All NeurIPS 2025 Spotlight papers · Browse the whole archive