AI & ML
More Than a Score: Reinforcement Learning with Verbalized Feedback for Generative Recommendation
arXiv cs.IR0 views
arXiv:2611.22410v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for generative recommendation, where recommended items are generated directly from users' interaction histories. To further improve recommendation quality, reinforcement learning (RL) has been applied to align these models with recommendation objectives. However, existing RL methods rely on scalar rewards to implicitly guide exploration. These rewards do not specify which aspects of a candidate conflict with the user's preferences or how the next candidate should differ. To address this gap, we propose VerRec, a verbalized feedback-guided RL framework for generative recommendation. Specifically, a user simulator generates personalized verbalized feedback based on the user's historical preferences and the candidate item profile. The policy uses this feedback to produce refined recommendations. Original and refined candidates form an expanded group and are jointly optimized with group relative policy optimization. The user simulator is only required during training and is removed at inference time. Experiments on three Amazon review datasets with two generative recommendation backbones demonstrate that VerRec improves recommendation accuracy and ranking quality. Further analyses show that verbalized guidance encourages exploration of more diverse candidates and helps the policy discover more rewarding recommendations during training.
Source:https://arxiv.org/abs/2611.22410PreviousDeal With It: On Better Schedules for Listwise RerankingNextFrom Relevance to Utility: Rubric Alignment in Yuanbao Search
Related posts

Nvidia isn’t selling any more AI chips to China
0The Verge
Nvidia clarifies when it will — and won’t —keep financing neoclouds
0TechCrunch

Google Home speakers get a major Gemini upgrade ‘soon,’ but only for paid subscribers
09to5Google

NVIDIA's CEO Shake-Up Exposes a Costly Prediction Market Deadline
0HackerNoon
Lumi-4B AI Model: Everything You Need to Know
0HackerNoon
The End of the Mouse: How AI Could Change the Way We Use Computers
0HackerNoon