AI & ML
Back to the Familiar Future: Failure Recovery for VLA Policies via Pre-Imagined Milestone Selection
arXiv cs.RO0 views
arXiv:2606.09258v2 Announce Type: replace Abstract: Vision-language-action (VLA) policies can deviate from nominal trajectories during manipulation, even when tasks remain physically feasible. Recovering from these deviations is challenging, as they push the policy into unfamiliar state spaces where direct re-planning frequently destabilizes action sequences. We propose Back to the Familiar Future (B2FF), a recovery framework for foresight-driven VLAs that leverages future visual conditioning as a recovery interface. Before execution, the VLA generates a milestone bank of familiar future states conditioned on the clean initial observation. At recovery time, a recoverability-aware selector selects a recovery milestone from this bank and enforces it as a fixed visual goal. This enables the VLA to robustly map off-trajectory observations back to a familiar future. On failure-injected LIBERO, under controlled recovery timing aligned with the injected failure, B2FF increases the average success rate of a baseline VLA from 56.3% to 74.0%, demonstrating that pre-imagined milestones can guide recovery without fine-tuning the low-level action generator.
Source:https://arxiv.org/abs/2606.09258PreviousAcroRL: Learning Aggressive Quadrotor Inversion using Bidirectional ThrustNextBridging the Morphology Gap: Adapting VLA Models to Dexterous Manipulation via Intent-Conditioned Fine-Tuning
Related posts
RegimeVGGT: Layer-Wise Spatially Preserving Redundancy Removal for Visual Geometry Grounded Transformer
0arXiv cs.RO
RoboTryOn: Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On
0arXiv cs.RO
Future Representation Distillation for Imagination-free World Action Models
0arXiv cs.RO
When Robots Outweigh Objects: How Inertia Mismatch Shapes Robot Policy Learning
0arXiv cs.RO
Learning to Live: A Step Toward Lifelong Embodied Intelligence
0arXiv cs.RO
Tactus: Tactile & Pose Sensing Glove for Natural Dexterity Data Collection
0arXiv cs.RO