Open Source
VoxSAOR: Semantic-Aware Occupancy Robustification via Aleatoric Uncertainty Modeling
arXiv cs.RO0 views
arXiv:2611.20507v1 Announce Type: cross Abstract: Vision-based 3D occupancy prediction provides a dense semantic representation of scenes for autonomous driving and embodied perception, yet remains vulnerable to occlusion, depth ambiguity, and projection errors that induce spatially varying reliability in voxel features. Existing methods typically map voxel representations to semantic predictions without explicitly modeling such observation-induced feature variations. To address this limitation, we propose VoxSAOR, a semantic-aware occupancy robustification framework that models aleatoric uncertainty through feature-space proxies. It first quantifies Local Semantic Consistency (LSC) to derive a voxel-wise structural stability prior and uses cross-view semantic consensus to filter unreliable semantic correspondences. Within each semantic category, spatially matched stable and ambiguous voxels form stable-to-ambiguous feature transitions, which are modeled by a class-conditional diagonal Gaussian distribution, capturing both feature displacement and dispersion. Guided by these proxy distributions, Aleatoric Regime Ensemble Learning (AREL) trains independently parameterized prediction heads using feature perturbations at progressively increasing scales, with perturbation strength modulated by structural reliability. At inference, proxy modeling and sampling are disabled, and all heads process the same observed features; their output probabilities are then averaged to produce a deterministic consensus prediction without requiring sampling. Experiments across multiple datasets and occupancy backbones demonstrate the effectiveness of VoxSAOR in improving semantic occupancy prediction, long-tail recognition, and predictive calibration. The source code will be made publicly available at https://github.com/MengfeiD/VoxSAOR.
Source:https://arxiv.org/abs/2611.20507PreviousCourse-Referenced Lateral Control of Trail-Following Convoys: String Stability and Adaptive Feedforward under Load UncertaintyNextInstructions Before Actions: Prospective and Retrospective Language Supervision for Driving Vision-Language-Action Data
Related posts
How to Deploy an AI Agent Fleet with One CLI
0dev.to
GetDevEd - open source system design platform
0dev.to Beginners
Latent Projection for Latent Planning
0arXiv cs.RO
ActionUNet: Improving Robustness of VLA Models with Efficient Multi-scale Fine-tuning
0arXiv cs.RO
ODEWorld: A Continuous Predictive Architecture via Physical-Time Flow
0arXiv cs.RO
Spatial Calibration of Diffuse LiDARs
0arXiv cs.RO