AI & ML
Orbis 2: A Hierarchical World Model for Driving
arXiv cs.RO0 views
arXiv:2607.15898v2 Announce Type: replace-cross Abstract: Current world models operate at a single level of abstraction, with most prioritizing perceptual fidelity while lacking the spatial reasoning and semantic understanding required for real-world downstream tasks. We present a hierarchical driving world model that factorizes future prediction across two levels operating at distinct temporal and abstraction scales: a high-level predictor that forecasts coarse scene structure over extended temporal horizons, and a low-level generator that produces detailed predictions conditioned on the high-level output. This decomposition yields high perceptual fidelity while also capturing strong spatial and semantic representations. We further show that pretraining with a diffusion forcing objective yields substantially richer internal representations than the standard teacher forcing objective, while teacher forcing -- predicting only the next frame from clean context -- produces more stable autoregressive rollouts. We therefore introduce a generic two-stage training paradigm that pretrains the model with diffusion forcing and fine-tunes with teacher forcing, combining the representational benefits of the former with the rollout stability of the latter. Our approach achieves state-of-the-art results across the standard suite of driving world model evaluations on established benchmarks, including long-horizon generation fidelity, steering responsiveness evaluated on counterfactual scenarios, and internal representation quality. Project page with code, demo, checkpoints and qualitative results: https://lmb-freiburg.github.io/orbis2.github.io/
Source:https://arxiv.org/abs/2607.15898PreviousGrounding Driving VLA via Inverse KinematicsNextObserver-Assisted Relative-Velocity Compensation with LPV-$H_\infty$ Robust Correction for 3D Trajectory Tracking of Underactuated Non-Minimum-Phase AUVs under Ocean Currents
Related posts

Nearly all software teams admit to shipping AI-generated code as study finds verification 'has not kept pace with that shift'
0TechRadar
LightningMoBA: 71% Faster 50k‑Token Story Generation in Seconds!
0dev.to

llm-gemini 0.38.1
0Simon Willison

Days after Nvidia CEO Jensen Huang resigned, journalists unearth covert influence operation using right-wing outlets to promote Nvidia AI chip export to...China
0TechRadar

Save $78 on Corsair's triple-chamber AIR 5400 RS-R midtower PC case at new all-time low price
0Tom's Hardware
How to Choose an AI Subscription by Task, Budget, and Region
0dev.to