AI & ML
DexFormer 2.0: Towards a Cross-Embodiment Foundation Policy for Dexterous Grasping
arXiv cs.RO0 views
arXiv:2611.20273v2 Announce Type: new Abstract: Dexterous grasping policies are usually trained for one arm paired with one hand. Every new pairing then needs its own policy, and the number of policies grows with every arm and hand added. We ask whether a single policy can control many arm-hand combinations and transfer to pairings and hands it has never seen. This is hard because robots differ in the number, layout, and dynamics of their joints, so their observations and actions share no common interface. We present DexFormer 2.0, a single reinforcement learning policy for cross-embodiment dexterous grasping. It maps every robot to a canonical joint interface with validity masks, encodes each joint's morphology with attention biased by the kinematic tree, and uses a Transformer-XL memory to infer embodiment-dependent dynamics from recent interaction. Trained on 18 combinations of four arms and six hands, it reaches 89% stable success on seen combinations and 51% on six held-out arm-hand pairs, outperforming GRU and DexFormer 1.0 baselines. Without fine-tuning, it also grasps with four new hand types and, through retargeting, with parallel grippers. Ablations show that memory, the kinematic-tree bias, and broader pairing coverage each matter for transfer. On a physical Flexiv arm, distilled students transfer zero-shot from simulation with two hands, including a held-out pair. Project website: https://davidlxu.github.io/dexformer2-web/.
Source:https://arxiv.org/abs/2611.20273PreviousRight Goal, Wrong Body: Re-grounding Frozen VLAs under Actuation ShiftNextPropose with the Gradient, Accept with the Loss: One Hedged Attack for Pixel-Sparse Robustness
Related posts
Discontinuity-Aware Solvers for Vapor-Compression Cycles
0arXiv cs.NA
Memorization capacity of deep ReLU neural networks characterized by width and depth
0arXiv cs.NA
Time-Delayed Transformers for Data-Driven Modeling of Low-Dimensional Dynamics
0arXiv cs.NA
First-order methods for stochastic and finite-sum convex optimization with deterministic constraints
0arXiv cs.NA
Smooth Surfaces via Nets of Geodesics
0arXiv cs.NA
A Large Gap between Galerkin Errors with and without Mesh-Uniform Regularity for the KdV Equation with Boundary Dissipation
0arXiv cs.NA