Q-RAG: Long Context Multi‑Step Retrieval via Value‑Based Embedder Training
ICLROral2026
TL;DR
Retrieval-Augmented Generation (RAG) methods enhance LLM performance by efficiently filtering relevant context for LLMs, reducing hallucinations and inference cost. However, most existing RAG methods focus on single-step retrieval, which is often insufficient for answering complex questions that require multi-step search.
Opening excerpt from the authors’ abstract. source
Read the paper
Topics
hallucination long context efficient retrieval llm rag