Open Source
Quasipolynomial-Time Planning for Decodable POMDPs
arXiv stat.ML0 views
arXiv:2611.09778v1 Announce Type: cross Abstract: We study planning for finite-horizon partially observable Markov decision processes (POMDPs) with finite state, action, and observation spaces. Both exact and approximate planning are known to be computationally hard in this setting, so prior work has explored natural assumptions that make planning easier. Recent work [Golowich et al., 2022] gave quasipolynomial-time approximate planning algorithms for observable POMDPs. These are POMDPs whose observation channels satisfy an $\ell_1$-observability condition, but notably, no assumptions are required on the transition dynamics. In a similar vein, for every fixed $\rho>0$, we give quasipolynomial-time approximate planning algorithms for $\rho$-decodable POMDPs. We show that decodability is implied by both $\ell_1$- and $\ell_2$-observability and is strictly weaker than observability. Moreover, we show that the optimal decodability constant can be computed in polynomial time, whereas computing the optimal $\ell_1$-observability constant is NP-hard in the worst case. We also show that the fast filter-forgetting guarantee underlying the approach of [Golowich et al., 2022] does not extend directly from $\ell_1$-observability to constant $\ell_2$-observability. Thus, decodability is an easy-to-check, unifying assumption under which quasipolynomial-time approximate planning for POMDPs is possible.
Source:https://arxiv.org/abs/2611.09778PreviousOnline Causal Configuration for Networked Systems via Doubly Robust Steady-State LearningNextIdentifying Drift, Diffusion, and Causal Structure from Temporal Snapshots
Related posts
BIOME: Evolving Google's Elephant-Goldfish Architecture for Production Multi-Agent Engineering
0dev.to OpenSource
Locally Uncensored AI Desktop App: Run DeepSeek v4.1 Flash Locally
0dev.to OpenSource
One Request, One Deadline: Inside RocketMQ-Rust's Timeout Handling
0dev.to Rust
2026 LLM API Token & Pricing Benchmark: How to Cut Your AI SaaS Inference Bill by 85%
0dev.to AI
AI Receptionist Business: What Vendors Charge and Where You Fit
0dev.to WebDev
EmuFive: running a PS5 emulator on a PS4
0dev.to Linux