AI & ML
Rethinking Latent Reasoning for Generative Recommendation: Beyond Teacher-Generated CoT and Recurrent Hidden-State Feedback
arXiv cs.IR0 views
arXiv:2611.09006v1 Announce Type: new Abstract: Latent reasoning in generative recommendation faces two practical barriers: constructing teacher-generated chain-of-thought (CoT) supervision is costly, and recurrent hidden-state feedback requires a specialized execution loop. We revisit both the supervision source and the computation interface. A step-level diagnosis measures how recommendation CoT supports next-item prediction and trace coherence. In the analyzed traces, history analysis is the only step with positive mean contributions on both dimensions, while later preference and intent steps have negative mean answer contributions. Guided by this finding, we propose PHiT (Prefilled, History-Informed Thought Tokens), which learns intermediate states from semantic targets extracted directly from observed item histories. PHiT aggregates cached sparse item encodings to construct these targets and supervises the contextual states of distinct vocabulary thought tokens. All thought tokens are supplied together as ordinary input IDs during a single causal prefill, removing the need for recurrent final-state feedback. With supervised fine-tuning alone, PHiT outperforms the compared baselines across four recommendation benchmarks. Controlled ablations support the value of input-matched semantic supervision, while cost measurements show fast target construction with training time comparable to the recommendation-only thought-token baseline.
Source:https://arxiv.org/abs/2611.09006PreviousSkinMind: Equipping Agentic RAG with Human-Inspired Graph Probing for Reliable Dermatology AINextMV-IVF: Multi-Vector Retrieval via Multi-Vector Clustering
Related posts
Show HN: AI boom or bust, US war footing or not (four scenarios to 2029)
0Hacker News Show
Show HN: Deepreed – preserve your writing style when using LLMs
0Hacker News Show
New Linux Patches Bring-Up The Samsung Galaxy XR Headset, Qualcomm Halliday SoC
0Phoronix

Some United Airlines flights now let you sign into Spotify on your flight — and its' totally free
0TechRadar

Straight Talk just dropped an unlimited data plan to $20/mo ahead of Black Friday — a brand new record
0TechRadar

Who Gives A Crap: Data breach at ethical toilet paper company exposes customer information across UK, US and Australia
0TechRadar