AI & ML
TacPilot: Does Touch Need to Be Everywhere?
arXiv cs.RO0 views
arXiv:2611.23804v1 Announce Type: new Abstract: Tactile feedback helps visual manipulation policies respond to local contact, but changes in tactile observations do not always require corrective motion, and sustained corrections do not always require new tactile features. We introduce TacPilot, a tactile residual framework that separates representation updates from action intervention around a frozen visual policy. TacPilot uses a perception gate to determine when tactile features need refreshing and updates only affected regions while reusing unchanged features. A separate intervention gate determines whether bounded Cartesian and gripper residuals modify the nominal visual action. This separation allows tactile perception and action correction to follow different spatial and temporal demands during manipulation. In offline expert-trajectory replay, local feature reuse reduces encoded regions by 56.4% relative to periodic full encoding, with essentially unchanged action predictions. In an exploratory simulation evaluation spanning two cylinder sizes, TacPilot succeeds in 26 of 30 trials (86.7%). We further validate TacPilot on OpenArm v2 equipped with Paxini tactile sensors across four contact-rich manipulation tasks.
Source:https://arxiv.org/abs/2611.23804PreviousCoT-WAM: Collaborative Training of Vision-Language Models and World-Action Models via Plan LatentsNextRoboDx: Repair and Diagnosis of Faults in Robot Software
Related posts
ASDL: A Fast Vector Approximation Algorithm for Multiplierless Designs of Convolutional Neural Networks
0arXiv eess.SP
Multi-Modal Environment-Aware Beam Management for Massive MIMO: A Geometry-Driven Virtual Base Station Framework
0arXiv eess.SP
TinyMyo: a Tiny Foundation Model for Flexible EMG Signal Processing at the Edge
0arXiv eess.SP
Chirp-Permuted AFDM: A Versatile and Multifunctional Waveform for 6G
0arXiv eess.SP
Synthesizing hyperspectral Data using generative Models to train spectral Unmixing Methods for low-cost Crop Residue Cover Mapping
0arXiv eess.SP
From Points to Trajectories: Rethinking Multimodal Alignment for Physical Events
0arXiv eess.SP