AI & ML
RoboMorpher: Scaling Robot Morphology Representations for Cross-Embodiment Action Prediction
arXiv cs.RO0 views
arXiv:2611.24816v1 Announce Type: new Abstract: Learning shared action representations is central to cross-embodiment manipulation. However, identical joint values can produce different spatial configurations across robots, limiting representations learned from joint values alone. We introduce RoboMorpher, a morphology-conditioned action tokenizer that jointly reconstructs joint angles and link poses to associate control coordinates with their kinematic effects. MorphGen supplies scalable kinematic supervision by generating serial-arm descriptions from survey-derived geometric priors. We pretrain RoboMorpher on 40 million morphology-state pairs and integrate the frozen tokenizer into a vision-language-action policy for discrete prediction and continuous refinement. We also introduce EmbodiBench, a ten-task benchmark with 30 generated URDFs per task. With downstream URDFs excluded from tokenizer pretraining, the policy achieves 56.40% success on RoboTwin 2.0 and 23.27% on EmbodiBench, exceeding continuous joint-space control by 9.73 and 15.34 percentage points. Removing link-pose supervision reduces EmbodiBench success by 17.94 percentage points, supporting morphology-aware geometric supervision for joint-action representation learning.
Source:https://arxiv.org/abs/2611.24816PreviousPlanner-Controller Interaction for Ackermann Navigation: A Matched Simulation and Hardware BenchmarkNextDiWALI: Diffusion Policy Learning in World Models via Latent Action Inference from Human and Robot Play
Related posts
How do you perform AI code review?
0dev.to Git
gpt-5 and o3 shut down December 11: a find-and-replace would rewrite 274 table rows
0dev.to TypeScript
Exporting App Store reviews from every country in Node.js: 6 things the RSS feed doesn't tell you
0dev.to JavaScript
What Does a Harness Buy? Tokens, Mostly
0arXiv cs.SE
Prior Knowledge or Search? A Study of LLM Agents in Hardware-Aware Code Optimization
0arXiv cs.SE
Live Noise Fingerprints for Quantum Program Analysis
0arXiv cs.SE