AI & ML
Can Astra Solve RoboMME without Breaking the Bank?
arXiv cs.RO0 views
arXiv:2611.06184v1 Announce Type: new Abstract: Robotic manipulation often requires remembering information that is no longer visible, such as an object's location before occlusion or the order of a demonstrated action sequence. A large vision-language planner can read this history, but calling it before every action chunk is slow and costly. We present a three-tier system for the RoboMME benchmark. GPT-6 Astra (System 2) selects a grounded subtask from stored visual history, a $\pi_{0.5}$ vision-language-action policy (System 1) executes it, and a fine-tuned Qwen3-VL-4B monitor (System 1.5) checks after each action chunk whether the subtask is finished. The instruction is kept until the monitor reports completion or a task-specific event occurs, while the policy keeps acting on new observations. On RoboMME, the system succeeds in 79.13% of episodes with an average of 3.63 Astra calls and 80.84 seconds per episode. This is 34.62 points above the best published non-oracle baseline and 4.95 points below GroundSG+Oracle, which gives the low-level policy ground-truth subgoals.
Source:https://arxiv.org/abs/2611.06184PreviousA Layered View of LLM Support in Underwater RoboticsNextBeyond Terminal Constraints: Reliable Robot Control with Learned Safe Sets
Related posts
Efficient Stable Word-RAM Simulation by Population Protocols
0arXiv cs.DC
CARE-FL: Federated Fine-Tuning of Multimodal LLMs in Resource-Constrained Edge Networks
0arXiv cs.DC
Ab Initio Accuracy Beyond the Cutoff: Distributed Message-Passing Equivariant Attention at Tens-of-Millions-of-Atom Scale
0arXiv cs.DC
A Controlled Experimental Evaluation of Configuration and Cache Architecture in LLM Serving Engines
0arXiv cs.DC
Energy-Efficient Reinforcement Learning for Large Language Models
0arXiv cs.DC
Runway Characters: Serving a 57B Video Diffusion Transformer for Real-Time Conversation
0arXiv cs.DC