Hogwild! Inference: Parallel LLM Generation via Concurrent Attention

NeurIPSSpotlight2025

Authors: Gleb Rodionov, Roman Garipov, Alina Shutova, George Yakushev, Erik Schultheis, Vage Egiazarian, Anton Sinitsin, Denis Kuznedelev, Dan Alistarh
Venue: NeurIPS 2025
Track: Spotlight

TL;DR

Large Language Models (LLMs) have demonstrated the ability to tackle increasingly complex tasks through advanced reasoning, long-form content generation, and tool use…

Opening excerpt from the authors’ abstract. source

Read the paper

OpenReview

Topics

large language model language model attention reasoning llm

← All NeurIPS 2025 Spotlight papers · Browse the whole archive