What Gets Hacked in a Collaborative Reward for LLM Recommenders: The Part That Does Not Depend on the User
Collaborative-filtering (CF) scores provide graded, personalized rewards for training large language model (LLM) recommenders through reinforcement learning. However, these rewards can cause exposure collapse: even though the CF model itself produces diverse top recommendations across users, an LLM optimized with its r...