Experiments on the LongLaMP dataset show that PrefReward outperforms non-personalized and retrieval-based baselines in both generation quality and personalization interpretability.
Abstract
Large Language Models (LLMs) have demonstrated remarkable ability in generating personalized content by leveraging user histories and contextual cues. However, most existing personalization approaches rely on implicit representations within model parameters, making it difficult to interpret user-specific preferences or effectively handle long-context dependencies. To address these challenges, we propose PrefReward, a novel preference-aware generative framework that explicitly models user styles through a structured preference matrix and integrates it into the decoding process as a reward signal. PrefReward consists of two stages: (1) extracting a user-specific preference matrix that summarizes individual stylistic tendencies, and (2) using the matrix to guide generation via a KL-divergence-based reward function. Experiments on the LongLaMP dataset show that PrefReward outperforms non-personalized and retrieval-based baselines in both generation quality and personalization interpretability.
PersMem is proposed, a user profile memory framework for LLM personalization that addresses three key questions: what user information to store, how to organize it, and how to use it effectively during generation that consistently improves personalization effectiveness while reducing prompt length.
Yang-Xu Liao, Yong-Heng Deng, Tianyuan Jiang et al.· Proceedings of the 32nd ACM...· 0 citations
Experiments on PRISM and PersonaMem-v2 show that HyperTrace improves response alignment, preference prediction, and profile consistency over strong online baselines, demonstrating the effectiveness of tracing latent user preferences for robust personalization.
Jian-Zhi Shen, Ke-Yu Mao, Ming-Hao Shao et al.· 0 citations
These results show that RecoReward trains the MLLM to produce item features that benefit downstream recommendation while retaining content-only serving, and shows that RecoReward-9B outperforms its Qwen3.5-9B baseline and all other evaluated models across seven recall metrics.
Guohong Mu, Yue-Yang Liu, Jiangxia Cao et al.· arXiv.org· 0 citations
An extended faithfulness analysis shows that the refined profiles remain largely grounded in the source preferences while preserving task-relevant personalization signals, suggesting that profile-side adaptation serves as a practical complement to universal memory construction for lifelong personalized agents.
Yuting Liu, Wei Wu, Jianzhe Zhao et al.· 0 citations
This work proposes Snap2Review, a novel framework that harmonizes cross-modal retrieval with fine-grained preference learning, and introduces Tri-DPO, which employs a stratified negative sampling strategy with varying difficulty levels to force the model to discern fine-grained user preferences.
Honggyan Xu, Lei Zou, De-Xiang Zhao et al.· Proceedings of the Thirty-Fi...· 0 citations
Cautious Context Steering (CCS), which adds a lightweight adapter to a frozen backbone LM to decide at each token whether and how strongly user context should affect generation, demonstrating robust generalization to new users and domains.
Gihoon Kim, Jeyoung Lee, S. Woo et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
