Frontend
GTI: Grounding Task Intent Throughout Long-Horizon VLA Manipulation
arXiv cs.RO0 views
arXiv:2611.23926v1 Announce Type: new Abstract: Vision-language-action (VLA) models generate local actions from visual observations, language, and robot state, but long-horizon manipulation requires the global task intent to remain grounded in the currently executable context. We propose GTI (Grounding Task Intent), which uses the current observation and execution history to localize the active subtask and its execution phase. For the same local subtask, GTI generates two phase-dependent visual targets: an interaction/contact state and a local completion state. The local language instruction and the corresponding phase-specific visual target jointly condition the VLA, specifying both what to do now and what state should be reached at the current phase. During execution, anomaly monitoring and local recovery re-establish an intent-consistent execution context through rollback, re-observation, and phase re-evaluation after persistent deviation. We evaluate GTI on RoboCasa365, VLA-Arena Horizon-Long, and real-world PiPER tasks. Relative to matched Global-FT baselines, GR00T success on seen composite RoboCasa365 tasks increases from 14.6%/12.1% to 31.8%/20.4% under ID/OOD evaluation. On VLA-Arena, GTI+$\pi_{0.5}$ reaches 47.6% overall success versus 45.2% for an adapted ForeAct baseline, with gains of 5.2/6.0 percentage points on the harder L1/L2 tasks. In the three real-robot task experiments, mean full-task success increases from 21.7% to 59.2%. The results indicate that persistent semantic intent localization and phase-conditioned visual grounding improve multi-stage execution, while failure-triggered local recovery provides additional deployment-time support.
Source:https://arxiv.org/abs/2611.23926PreviousReLoco: Unified Humanoid Locomotion and Fall Recovery via Behavior-Conditioned Motion PriorsNextA Hierarchical Onboard Vision-Language-Navigation Framework for Aerial Robots in Complex Environments
Related posts

How to Delete or Update Millions of Rows in SQL Server Safely (Batching)
0dev.to Database
Encapsulating Reactive Behaviour in Goal-based Plans for Programming BDI Agents
0arXiv cs.MA
DOA Estimation in Antenna Arrays: Super-Resolution Methods in a Common Space
0arXiv math.IT
Electric combined-field-only P1 Galerkin BEM for PEC scattering with scalar Helmholtz operators
0arXiv cs.NA
Split-and-Learn: Decoupled Learning for Reactive Transport in Heterogeneous Marine Sediments
0arXiv cs.NA
General formulation of an analytic, Lipschitz continuous control allocation for thrust-vectored controlled rigid bodies
0arXiv eess.SY