VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don't Mean Preferences
VIBE-Bench is introduced, a benchmark with two psychology-grounded tasks, 3,504 personas and 12,239 dialogues, including a manually verified gold test set, and requires cross-concept preference reasoning beyond surface semantic overlap, establishing PRCM as a distinct failure regime in PLLMs and position VIBE-Bench as...
Yi-Wen Jiang, Yang Deng, Stephanie Fong et al.
· 0 citations