AI & ML
Improve How You Improve: Recursive Policy Self-Improvement for Zero-Shot Open-Vocabulary Multi-Object Navigation
arXiv cs.RO0 views
arXiv:2611.23774v1 Announce Type: new Abstract: To advance the development of embodied general navigation, zero-shot open-vocabulary multi-object navigation has attracted increasing attention, aiming to enable robots to efficiently search multiple objects in unseen environments without training. For this task, the key lies in improving navigation policies from earlier searches to locate subsequent goals more efficiently. Recent methods automate this process through trajectory reflection and rule revision, enabling policy self-improvement. However, the mechanisms for diagnosing problems and generating revisions are typically designed by humans and remain fixed across iterations. Consequently, the system's capacity for continued self-improvement remains constrained, even as its navigation policy evolves. To this end, we propose RPSI-Nav, a Recursive Policy Self-Improvement framework for zero-shot multi-object navigation that revises both the navigation program and its revision mechanism. RPSI-Nav diagnoses search behavior, requests diagnostic views when existing observations cannot distinguish competing causes, and generates targeted navigation revisions. Feedback from subsequent goal searches is linked to the rules that produced these revisions, guiding changes to diagnosis, observation acquisition, and revision planning. The updated improver governs subsequent navigation improvements, forming a recursive loop in which RPSI-Nav revises its own improvement process. Across goals, the robot conditionally inherits accepted program updates and spatial memory, enabling search experience to improve both future navigation and adaptation. Benchmark experiments and qualitative real-robot evaluations validate RPSI-Nav's effectiveness.
Source:https://arxiv.org/abs/2611.23774PreviousZERITH V2.5: From Predictive Power to Policy LearnabilityNextCoT-WAM: Collaborative Training of Vision-Language Models and World-Action Models via Plan Latents
Related posts
![Physical AI Engineering — Ch.10: Medical and Human Centric Physical AI [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fvy8fkq2vnw6ud8c0kvic.png)
Physical AI Engineering — Ch.10: Medical and Human Centric Physical AI [EN]
0dev.to
![Physical AI Engineering — Ch.09: Industrial Physical AI [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F2ulspenbbtgxps8mti74.png)
Physical AI Engineering — Ch.09: Industrial Physical AI [EN]
0dev.to
![Physical AI Engineering — Ch.08: Autonomous Vehicles and Mobility [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fudcokq8k14p8ppu1mdnf.png)
Physical AI Engineering — Ch.08: Autonomous Vehicles and Mobility [EN]
0dev.to
![Physical AI Engineering — Ch.06: Control and Actuation [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fgqtcsihzvvie5v9x4dzo.png)
Physical AI Engineering — Ch.06: Control and Actuation [EN]
0dev.to
![Physical AI Engineering — Ch.05: Decision Making and Reasoning [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fanmj7rqd1d7j07dzk4yv.png)
Physical AI Engineering — Ch.05: Decision Making and Reasoning [EN]
0dev.to
Google turns to Blue Origin for a rocket, but its long-term problem remains
0Ars Technica