FlexOLMo: Open Language Models for Flexible Data Use

NeurIPSSpotlight2025

Authors: Weijia Shi, Akshita Bhagia, Kevin Farhat, Niklas Muennighoff, Jacob Morrison, Evan Pete Walsh, Dustin Schwenk, Shayne Longpre, Jake Poznanski, Allyson Ettinger, Daogao Liu, Margaret Li, Mike Lewis, Wen-tau Yih, Dirk Groeneveld, Luca Soldaini, Kyle Lo, Noah A. Smith, Luke Zettlemoyer, Pang Wei Koh, Hannaneh Hajishirzi, Ali Farhadi, Sewon Min
Venue: NeurIPS 2025
Track: Spotlight

TL;DR

We introduce FlexOLMo, a new class of language models (LMs) that supports (1) distributed training without data sharing, where different model parameters are independently trained on private datasets,…

Opening excerpt from the authors’ abstract. source

Read the paper

OpenReview

Topics

language model dataset

← All NeurIPS 2025 Spotlight papers · Browse the whole archive