AI & ML
Improve How You Improve: Recursive Policy Self-Improvement for Zero-Shot Open-Vocabulary Multi-Object Navigation
arXiv cs.RO0 views
arXiv:2611.23774v1 Announce Type: new Abstract: To advance the development of embodied general navigation, zero-shot open-vocabulary multi-object navigation has attracted increasing attention, aiming to enable robots to efficiently search multiple objects in unseen environments without training. For this task, the key lies in improving navigation policies from earlier searches to locate subsequent goals more efficiently. Recent methods automate this process through trajectory reflection and rule revision, enabling policy self-improvement. However, the mechanisms for diagnosing problems and generating revisions are typically designed by humans and remain fixed across iterations. Consequently, the system's capacity for continued self-improvement remains constrained, even as its navigation policy evolves. To this end, we propose RPSI-Nav, a Recursive Policy Self-Improvement framework for zero-shot multi-object navigation that revises both the navigation program and its revision mechanism. RPSI-Nav diagnoses search behavior, requests diagnostic views when existing observations cannot distinguish competing causes, and generates targeted navigation revisions. Feedback from subsequent goal searches is linked to the rules that produced these revisions, guiding changes to diagnosis, observation acquisition, and revision planning. The updated improver governs subsequent navigation improvements, forming a recursive loop in which RPSI-Nav revises its own improvement process. Across goals, the robot conditionally inherits accepted program updates and spatial memory, enabling search experience to improve both future navigation and adaptation. Benchmark experiments and qualitative real-robot evaluations validate RPSI-Nav's effectiveness.
Source:https://arxiv.org/abs/2611.23774PreviousZERITH V2.5: From Predictive Power to Policy LearnabilityNextCoT-WAM: Collaborative Training of Vision-Language Models and World-Action Models via Plan Latents
Related posts
ASDL: A Fast Vector Approximation Algorithm for Multiplierless Designs of Convolutional Neural Networks
0arXiv eess.SP
Multi-Modal Environment-Aware Beam Management for Massive MIMO: A Geometry-Driven Virtual Base Station Framework
0arXiv eess.SP
TinyMyo: a Tiny Foundation Model for Flexible EMG Signal Processing at the Edge
0arXiv eess.SP
Chirp-Permuted AFDM: A Versatile and Multifunctional Waveform for 6G
0arXiv eess.SP
Synthesizing hyperspectral Data using generative Models to train spectral Unmixing Methods for low-cost Crop Residue Cover Mapping
0arXiv eess.SP
From Points to Trajectories: Rethinking Multimodal Alignment for Physical Events
0arXiv eess.SP