InfiFPO: Implicit Model Fusion via Preference Optimization in Large Language Models

NeurIPSSpotlight2025

Authors
Yanggan Gu, Yuanyi Wang, Zhaoyi Yan, Yiming Zhang, Qi Zhou, Fei Wu, Hongxia Yang
Venue
NeurIPS 2025
Track
Spotlight

TL;DR

Model fusion combines multiple Large Language Models (LLMs) with different strengths into a more powerful, integrated model through lightweight training methods…

Opening excerpt from the authors’ abstract. source

Read the paper

Topics

preference optimization large language model language model optimization llm

Related NeurIPS papers

← All NeurIPS 2025 Spotlight papers · Browse the whole archive