AI & ML
MIPR: A Benchmark for Reasoning-Intensive Multimodal Intent-to-Product Retrieval with Multi-Category Solutions
arXiv cs.IR0 views
arXiv:2611.22509v1 Announce Type: new Abstract: Real-world e-commerce queries often express user intent without naming a target product, and a single intent may be fulfilled by products from multiple categories. However, existing multimodal retrieval benchmarks typically assume a relatively well-defined target, leaving retrieval for intents with multi-category solutions less explored. To fill this gap, we introduce MIPR, a benchmark for Multimodal Intent-to-Product Retrieval comprising 3,522 multimodal queries and a shared corpus of 30,731 products. MIPR features reasoning-intensive retrieval, multi-category solutions, and fine-grained relevance labels. Experiments show that the best embedding-based retriever achieves 49.23% nDCG@10 on the full query set, and 55.86% solution-category recall@10 on queries with multiple solution categories. Reranking improves these scores to 60.11% and 67.00%, respectively, yet substantial gaps to the candidate-pool oracle remain. These results establish MIPR as a challenging and diagnostic benchmark for evaluating multimodal intent-to-product retrieval. The data and code are publicly available at https://huggingface.co/datasets/leequeue/MIPR.
Source:https://arxiv.org/abs/2611.22509PreviousFrom Relevance to Utility: Rubric Alignment in Yuanbao SearchNextUrban Representation Learning for Identifying Potential Disparities in Crime Reporting
Related posts
DexFormer 2.0: Towards a Cross-Embodiment Foundation Policy for Dexterous Grasping
0arXiv cs.RO
RoboKit: Accelerating Parallel Differentiable Optimization for Robot Learning
0arXiv cs.RO
Cleanly-DINO: Efficiently Learning Visual Task Spaces for Robotics
0arXiv cs.RO
SAFER: Navigating the Exploration-Exploitation Dilemma in World-Model-Based Planning for Autonomous Driving
0arXiv cs.RO
PlanDiv: Test-Time Scaling with Latent Plans for Vision-Language-Action Models
0arXiv cs.RO
MoViC: Real-Time Humanoid Whole-Body Control from Monocular Video Streams
0arXiv cs.RO