Backend
Prompt Re-Specification and Target-Mask Availability in Mask-Conditioned Visual Reinforcement Learning for Moving-Platform Landing
arXiv cs.RO0 views
arXiv:2611.20075v1 Announce Type: new Abstract: Visual reinforcement learning (RL) policies that land a drone on a moving platform can fail when the landing pad looks different from the one used in training. Using binary target masks as the visual input removes most pixel-level appearance information while preserving the spatial representation of the target, and lets a text prompt specify the target. In simulation, we test whether a frozen (fixed-weight) mask-based DrQ-v2 policy can handle a new pad when only the prompt of its fine-tuned SAM 3 detector changes. A banana-themed pad lowered landing success from 75.6% to 12.0%, and SAM 3 rarely detected it under the original prompt. A revised prompt, chosen after testing several candidates, restored success to 68.4% with no weight updates. In a separate experiment with a policy trained on ground-truth masks, filling in masks that were missing while the pad was visible helped landing far more than the tested mask-centroid and area corrections. Tracking the pad over time supplied masks more often and also kept producing them after the pad was confirmed absent from the rendered image, but it did not establish a reliable improvement in landing success. Whether a usable mask reaches the policy at all thus appears to be an important limiting factor for this approach.
Source:https://arxiv.org/abs/2611.20075PreviousPlanDiv: Test-Time Scaling with Latent Plans for Vision-Language-Action ModelsNextEgoSwarm: Learning Decentralized Robot Swarm Intelligence from Human Swarm Demonstrations
Related posts
Direct Numerical Simulation of Thermoacoustically Unstable Flames Via Non-Drifting Acoustic Delay Characteristic Boundary Conditions
0arXiv cs.NA
On the sharp linear convergence rate of the circumcentered--reflection method on subspaces
0arXiv cs.NA
Quantum Gibbs sampling through the detectability lemma
0arXiv cs.NA
RustMC: Automated Verification of Real-World Concurrent Rust
0arXiv cs.CR
CyBiasBench: Benchmarking Bias in LLM Agents for Cyber-Attack Scenarios
0arXiv cs.CR
HE-LRM: Encrypted Deep Learning Recommendation Models using Fully Homomorphic Encryption
0arXiv cs.CR