AI & ML
LaST1.0: A Unified Latent World-Action Model with Control-Centric SpatioTemporal Reasoning
arXiv cs.RO0 views
arXiv:2611.23974v1 Announce Type: new Abstract: World-Action Models couple action learning with future prediction, enabling robotic policies to capture environmental dynamics for robust control. However, prevailing methods take a reconstruction-oriented approach to model future videos, allocating substantial capacity to appearance details that are incidental to control. In this work, we reformulate world modeling for manipulation as control-centric future prediction in latent space, and present LaST1.0, a unified latent World-Action Model. Rather than modeling an observation-complete video future, LaST1.0 predicts compact, geometry-aware latent targets derived from future wrist views, focusing the supervision on the evolving robot-object interactions required for fine-grained manipulation. To better support this control-centric paradigm, LaST1.0 revisits the visual input interface and attention mechanism of its unified architecture. It adopts a vision-encoder-free design with a lightweight patch embedder, exposing fine-grained visual cues directly to the backbone, and introduces LaST-Attention for structured spatiotemporal interactions across modalities. Evaluations across two robot embodiments, five challenging manipulation tasks, and three simulation benchmarks---RLBench, LIBERO, and LIBERO-Plus---demonstrate that LaST1.0 achieves state-of-the-art success rates and generalizes to novel scenarios. These results demonstrate the effectiveness of control-centric latent world modeling for robust manipulation.
Source:https://arxiv.org/abs/2611.23974PreviousCoRA-VTLA: Contact-Guided Attention and Queryable Response Memory for Tactile Post-TrainingNextModelling the human-exoskeleton interaction interface - Benchmarking MuJoCo's deformable model
Related posts
Designing a useful preview for an AI-generated comic
0dev.to
AI Agents: What They Are and Why They Matter
0dev.to
GPT-6.2 Astra Was Easier to Jailbreak, UK Testing Found
0dev.to
iFixit Says Apple’s HomeView Breaks Easily. Here’s Why I’m Not Worried
0CNET News
Scout Motors Is Using AI Earpieces to Train Factory Workers
0CNET News
'Grand Theft Auto VI' is here. What to know about the characters, music and all the hype
0Phys.org Tech