Open Source
DexTeleop-0: Force-Aware Bimanual Dexterous Teleoperation with Ego-Centric Perception towards Shared Autonomy
arXiv cs.RO0 views
arXiv:2606.23431v2 Announce Type: replace Abstract: Fine-grained, bimanual dexterous manipulation remains a foundational challenge in robotics. Embodiment gaps hinder accurate kinematic mapping, and visual tracking alone does not regulate contact forces. To address these limitations, we propose a tactile-driven adaptation strategy designed to enable fine-grained manipulation on top of teleoperation pipelines. Instantiated within our bimanual dexterous framework, DexTeleop-0, this strategy introduces a real-time optimization loop that adds robot-side contact corrections to human tracking commands using fingertip feedback. By estimating contact positions and forces, the system dynamically computes localized corrections using a contact-stiffness approximation and the kinematic Jacobian, with per-contact vector force tracking, soft predicted-contact-moment regularization, and bounded hand-joint residuals. We evaluate this tactile-driven adaptation strategy across both simulated environments and real-world hardware. Controlled simulation replay yields final-stage success rates of 91% for Ball Assembly and 62% for Stir in Cup, versus 88% and 49% for force tracking alone. Fixed-input replay on two hand types, seven-operator teleoperation, and external-force traces further assess contact assistance. The open-sourced project page can be found at https://henryhcliu.github.io/dexteleop-0.
Source:https://arxiv.org/abs/2606.23431PreviousSGM-SLAM: Scene Graph Matching for Data-Efficient Distributed SLAMNextNoContactNoWorries: Estimating Contact through Vision and Proprioception for In-Hand Dexterous Manipulation
Related posts
Accuracy potential of visual localization exploiting high-end street-level imagery
0arXiv cs.RO
BLaFA: Bridging Language to 3D Functional Affordances for Dexterous Robotic Grasping in Tool Use
0arXiv cs.RO
DexHOT: Learning Hand-Object Configuration Transfer for Dexterous Manipulation
0arXiv cs.RO
CompVLA: A Variable Compliance Vision-Language-Action Model for Contact-rich Manipulation
0arXiv cs.RO
ObjView-Bench: Rethinking Difficulty and Deployment for Object-Centric View Planning
0arXiv cs.RO
ManiTaskGen: A Comprehensive Task Generator for Benchmarking and Improving Vision-Language Agents on Embodied Decision-Making
0arXiv cs.RO