AI & ML
ReferClaw: Disambiguating User Intent for Egocentric Assistance
arXiv cs.MA0 views
arXiv:2611.07683v1 Announce Type: cross Abstract: Users of egocentric AI assistants often ask short, ambiguous questions whose intended referents cannot be uniquely resolved from video and dialogue history. For example, "Where did I leave it?" may refer to several previously handled objects. Existing VideoQA systems typically commit to a single interpretation, risking plausible but intention-misaligned answers. We introduce ReferClaw, an agentic framework that formulates egocentric streaming QA as an interactive process: the assistant asks clarifying questions to resolve user intent before answering. Three cooperating agents identify candidate interpretations, request clarification, and generate answers grounded in the resolved intent and visual evidence. A bounded, cost-aware policy balances expected information gain against user effort while limiting clarification turns and question complexity. Referclaw learns from interaction through intent-specific skill updates and process-reward-guided policy optimization with agent-level credit assignment. Evaluations on augmented egocentric QA benchmarks demonstrate improved answer accuracy and joint answer-and-grounding performance over existing baselines, alongside zero-shot transfer across datasets. These findings support interactive clarification as a practical approach to resolving online user intent in egocentric streaming assistance.
Source:https://arxiv.org/abs/2611.07683PreviousA Bilevel Neurodynamic Approach for Distributed SCAD-Regularized Sparse Least SquaresNextRadio-to-Pose Information for Gauge-Drift Correction in Cooperative Localization
Related posts

My n8n Trigger Wasn’t Firing. The Problem Was Embarrassingly Simple (my pick)
0dev.to

osFoundry 這套桌面 AI 工作空間是什麼,又分成哪些區域?
0dev.to
UpCodes (YC S17) is hiring SDR's to sell AI compliance software
0Hacker News
AI coding goes from generation to verification
0dev.to AI
Stop Paying AWS to Talk to Itself: When to Use VPC Endpoints Instead of a NAT Gateway
0dev.to AWS
We Checked 20 Big US Retailers Before the AI Shopping Holiday. Half Turned Our Checker Away.
0dev.to WebDev