AI & ML
TacPilot: Does Touch Need to Be Everywhere?
arXiv cs.RO0 views
arXiv:2611.23804v1 Announce Type: new Abstract: Tactile feedback helps visual manipulation policies respond to local contact, but changes in tactile observations do not always require corrective motion, and sustained corrections do not always require new tactile features. We introduce TacPilot, a tactile residual framework that separates representation updates from action intervention around a frozen visual policy. TacPilot uses a perception gate to determine when tactile features need refreshing and updates only affected regions while reusing unchanged features. A separate intervention gate determines whether bounded Cartesian and gripper residuals modify the nominal visual action. This separation allows tactile perception and action correction to follow different spatial and temporal demands during manipulation. In offline expert-trajectory replay, local feature reuse reduces encoded regions by 56.4% relative to periodic full encoding, with essentially unchanged action predictions. In an exploratory simulation evaluation spanning two cylinder sizes, TacPilot succeeds in 26 of 30 trials (86.7%). We further validate TacPilot on OpenArm v2 equipped with Paxini tactile sensors across four contact-rich manipulation tasks.
Source:https://arxiv.org/abs/2611.23804PreviousCoT-WAM: Collaborative Training of Vision-Language Models and World-Action Models via Plan LatentsNextRoboDx: Repair and Diagnosis of Faults in Robot Software
Related posts
![Physical AI Foundations and Definitions — Ch.00: Introduction [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fzz2y7pn0xi5qj511e402.png)
Physical AI Foundations and Definitions — Ch.00: Introduction [KR]
0dev.to
![Physical AI Foundations and Definitions — Ch.09: Standards and Definitions [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fw4mzb4ntt5lhj7vgf333.png)
Physical AI Foundations and Definitions — Ch.09: Standards and Definitions [EN]
0dev.to
![Physical AI Foundations and Definitions — Ch.06: Relation to Embodied AI and Robotics [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fshqcmgwjgqqejta2saya.png)
Physical AI Foundations and Definitions — Ch.06: Relation to Embodied AI and Robotics [EN]
0dev.to
![Physical AI Foundations and Definitions — Ch.03: History and Origins [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Frrm68fq83d8whnovwor0.png)
Physical AI Foundations and Definitions — Ch.03: History and Origins [EN]
0dev.to
![Physical AI Foundations and Definitions — Ch.02: Physical AI vs Digital AI [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fsgutmwrbqzyn5a22lilm.png)
Physical AI Foundations and Definitions — Ch.02: Physical AI vs Digital AI [EN]
0dev.to
![Physical AI Foundations and Definitions — Ch.00: Introduction [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fzz2y7pn0xi5qj511e402.png)
Physical AI Foundations and Definitions — Ch.00: Introduction [EN]
0dev.to