AI & ML
LUMIR: Decoupled Multimodal Representation Learning from Heterogeneous Data for Next-POI Recommendation
arXiv cs.IR0 views
arXiv:2611.14004v1 Announce Type: new Abstract: As multimodal tourism-related information collected from heterogeneous data sources has become increasingly available, learning effective representations has attracted attention for improving recommendation performance. Existing approaches often tightly couple multimodal fusion with the architecture and optimization objective of a specific downstream model, which limits the generality and reusability of the learned representations. To address these limitations, we propose LUMIR, a decoupled multimodal representation learning framework based on contrastive learning. Multimodal information collected from heterogeneous data sources is first semantically unified into a shared textual representation space using large language models (LLMs). An interaction-aware fusion mechanism is then designed to model cross-modal interactions, while sequential signals are incorporated as a structural constraint to guide representation learning. To evaluate the learned representations, experiments are conducted on a multimodal point-of-interest (POI) dataset under the next-POI recommendation setting across multiple sequential recommendation backbones. The results show that LUMIR consistently outperforms existing multimodal fusion baselines in both accuracy-oriented and beyond-accuracy metrics, demonstrating that decoupling representation learning from downstream optimization provides an effective paradigm for learning reusable multimodal representations. The code is publicly available at https://github.com/wzehui/LUMIR.
Source:https://arxiv.org/abs/2611.14004PreviousData Quality Challenges in Multimodal Tourism Recommender SystemsNextFrom Show Programs to Linked Data
Related posts

The Interface Questions That Matter in a Disposable-Inbox Workflow
0dev.to UX
Zwei Berechtigungen, die jede App kennt – und viele Onboarding-Flows packen sie
0dev.to UX

375 reviews sits between a $14.99 Reacher novel and a 7-review LitRPG
0dev.to Data
Arkansas Layoffs November 2026: WARN Numbers Explained
0dev.to Data
District of Columbia Layoffs November 2026: WARN Numbers Explained
0dev.to Data
1M Emails/Month at 15 Providers: The Real Price Breakdown
0dev.to Data