What's In My Human Feedback? Learning Interpretable Descriptions of Preference Data

TL;DR

We present WIMHF, a method to describe the preferences encoded by human feedback; produce insights from seven widely-used datasets; and show that the method enables new approaches to data curation and personalization.

Opening excerpt from the authors’ abstract. source