AI & ML
Beyond Retrieval: Learning Compact User Representations for Scalable LLM Personalization
arXiv cs.IR0 views
arXiv:2606.04547v4 Announce Type: replace Abstract: Personalizing large language models requires adapting model behavior to individual users while preserving robustness and deployment-scale efficiency. Existing approaches typically personalize LLMs either at the input level, by retrieving user histories or constructing profile prompts, or at the parameter level, by maintaining user-specific parameter-efficient modules. The former makes personalization sensitive to retrieval quality and prompt design, whereas the latter incurs storage and maintenance costs that grow with the user population. To address these limitations, we propose TAP-PER (Temporal Attentive Prefix for PERsonalization), a prefix-based framework that encodes user preferences as learnable representations, avoiding the serialization of user histories into prompts and replacing heavy per-user adapters with lightweight user-state prefix embeddings. Inspired by personalized recommendation systems, TAP-PER decomposes user modeling into user-state and query-conditioned components, and incorporates temporal signals to capture the evolving nature of user interests. Experiments on six LaMP tasks show that TAP-PER consistently outperforms prompt-based and model-based baselines across classification, rating, and generation settings. Moreover, TAP-PER uses 130x fewer per-user parameters than OPPU and roughly half the total parameter footprint of PER-PCS at the 1,000-user scale, demonstrating scalable personalization without prompt-serialized histories or heavy per-user adapters.
Source:https://arxiv.org/abs/2606.04547PreviousEfficient Generative Retrieval for E-commerce Search with Semantic Cluster IDs and Expert-Guided RLNextRecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems
Related posts
Who owns your AI agent when something goes wrong?
0dev.to
A regra dos três modelos: por que um agente não audita a si mesmo
0dev.to
Disney Imagineers Have Built AI-Powered ‘Star Wars’ Alien Audio-Animatronics With AWS
0CNET News
Which Laptops Last the Longest? Check Out the Laptops I’ve Tested With the Best Battery Life
0CNET News

'This is not about short-term playtests’ — Disney's AI-powered Star Wars Anzellans offer a glimpse at the future of its parks
0TechRadar

Best Amazon early Black Friday deals — Fire Sticks, AirPods, LEGO, Ring Doorbells and more
0TechRadar