AI & ML
Tactus: Tactile & Pose Sensing Glove for Natural Dexterity Data Collection
arXiv cs.RO0 views
arXiv:2610.39076v3 Announce Type: replace Abstract: Collecting naturalistic human manipulation demonstrations with accurate contact force and hand pose is essential for robot dexterous manipulation policy and foundational world model learning - yet no existing wearable platform provides both calibrated fingertip force sensing and occlusion-resilient hand tracking in a form factor that preserves natural manipulation behavior. We present Tactus, a textile-integrated sensing glove that co-optimizes three design pillars: (1) a thin, conformal 3D-knit form factor (1.5 mm fingertip stackup) designed to minimize interference with natural manipulation, (2) strategically placed capacitive tactile sensors at manipulation-relevant regions informed by empirical contact studies, and (3) IMU-fused pose tracking that maintains accuracy through the hand-object occlusions where manipulation data is most valuable. Tactus includes a documented calibration pipeline for cross-glove consistency and per-session calibration for subject-dependent correction. To enable objective comparison, we introduce standardized benchmarking protocols for tactile force regression and hand pose estimation, and apply them to Tactus and two commercially available tactile gloves - to our knowledge the first quantitative cross-platform evaluation of this kind. Tactus resolves a minimum detectable force of 0.59 N at 95% confidence, 1.6 - 2.7x lower than the commercial baselines, and with 0.87 cross-participant consistency, while our pose tracking sustains 11.0 mm fingertip keypoint relative error during manipulation, when occlusion is heaviest. We show that these combined signals support object property estimation, slip detection, and representative recording of hand-object interaction - yielding demonstration data with the fidelity required for contact-aware manipulation policies and world models.
Source:https://arxiv.org/abs/2610.39076PreviousSimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World ModelsNextLearning to Live: A Step Toward Lifelong Embodied Intelligence
Related posts
RegimeVGGT: Layer-Wise Spatially Preserving Redundancy Removal for Visual Geometry Grounded Transformer
0arXiv cs.RO
RoboTryOn: Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On
0arXiv cs.RO
Future Representation Distillation for Imagination-free World Action Models
0arXiv cs.RO
When Robots Outweigh Objects: How Inertia Mismatch Shapes Robot Policy Learning
0arXiv cs.RO
Learning to Live: A Step Toward Lifelong Embodied Intelligence
0arXiv cs.RO
Vision-Guided Reorientation and Color Sorting of Writing Utensils Using a Low-Cost 4-DoF Arm
0arXiv cs.RO