Open Source
DobotTrack: Target-Grounded Vision-Language-Action Learning for Embodied Person Tracking
arXiv cs.RO0 views
arXiv:2611.09041v1 Announce Type: new Abstract: Language-guided embodied person tracking requires a mobile agent to identify a target from a referring description and consistently follow the target under egocentric observations. We present DobotTrack, a target-grounded vision-language-action (VLA) framework that integrates auxiliary grounding supervision with efficient temporal modeling. We systematically investigate five auxiliary tasks---person segmentation, bounding-box grounding, visual-spatial classification (VSC), future DINO feature prediction, and future-frame prediction---and adopt complementary mask and bounding-box supervision to enhance target delineation and localization. We introduce Q-identity, a target-conditioned historical visual compression module that leverages target-grounding predictions to selectively preserve identity-discriminative appearance features and spatial cues in compact historical tokens. On EVT-Bench, our 0.8B-parameter model achieves an average success rate of 77.9%, exceeding OmTrackVLA by 16.9 percentage points across the three tasks. We further construct a real-world person-tracking dataset collected using a quadruped robot, comprising 126 episodes and 596,323 mask-annotated frames. The target masks enable automatic derivation of bounding boxes and visual-spatial labels encoding horizontal position and apparent image scale, providing additional grounding supervision without separate manual annotation of these labels. Together, our framework and annotation pipeline support learning target-grounded tracking policies from simulated and real-world data. Code is available at https://github.com/Dobot-Team/dobot_track.
Source:https://arxiv.org/abs/2611.09041PreviousToolDex: An Ego-Exo Human Demonstration Dataset for Creative Physical Tool UseNextWhen to Trust the BIM: Identifiability-Aware LiDAR-Inertial--BIM Fusion under As-Built Deviations
Related posts
Claude Code Leaked 2,539 Secrets Onto GitHub. I Checked My Own Repos the Same Morning
0dev.to GitHub
Built Drago, an open-source GitHub profile companion that evolves through 13 dragon stages based on your coding activity. Features animations, XP, streaks and custom palettes. Runs on GitHub Actions.
0dev.to GitHub
5G-NetBotSim: A Synchronized Co-Simulation Framework for Connected Robots over ROS and srsRAN-based 5G Network
0arXiv cs.NI
Quantum-Enhanced Classical Communications for DPMZM-based NG-PON2 Systems
0arXiv eess.SP
Classification Aggregation with Multiple Memberships
0arXiv cs.MA
Generalized Intention Modeling in Multi-Agent Reinforcement Learning
0arXiv cs.MA