AI & ML
More Than a Score: Reinforcement Learning with Verbalized Feedback for Generative Recommendation
arXiv cs.IR0 views
arXiv:2611.22410v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for generative recommendation, where recommended items are generated directly from users' interaction histories. To further improve recommendation quality, reinforcement learning (RL) has been applied to align these models with recommendation objectives. However, existing RL methods rely on scalar rewards to implicitly guide exploration. These rewards do not specify which aspects of a candidate conflict with the user's preferences or how the next candidate should differ. To address this gap, we propose VerRec, a verbalized feedback-guided RL framework for generative recommendation. Specifically, a user simulator generates personalized verbalized feedback based on the user's historical preferences and the candidate item profile. The policy uses this feedback to produce refined recommendations. Original and refined candidates form an expanded group and are jointly optimized with group relative policy optimization. The user simulator is only required during training and is removed at inference time. Experiments on three Amazon review datasets with two generative recommendation backbones demonstrate that VerRec improves recommendation accuracy and ranking quality. Further analyses show that verbalized guidance encourages exploration of more diverse candidates and helps the policy discover more rewarding recommendations during training.
Source:https://arxiv.org/abs/2611.22410PreviousDeal With It: On Better Schedules for Listwise RerankingNextFrom Relevance to Utility: Rubric Alignment in Yuanbao Search
Related posts

MacPaw's Moonlock Cybersecurity App Launches for iPhone
0MacRumors
Grand theft auto VI is an astonishing by American epic
0Hacker News New
Show HN: Globebug – A calm, conflict-safe travel OS for multi-city itineraries
0Hacker News New
Ask HN: Are you sick of buying domains
0Hacker News New
One missing, 11 injured after ADNOC vessel attacked in Strait of Hormuz
0Hacker News New
Show HN: Sidekick AI – A local-first VS Code extension with hybrid vector search
0Hacker News Show