Backend
Trajectory Density Ratios under Weak Support: A Survey across the Sciences
arXiv stat.ML0 views
arXiv:2611.11985v2 Announce Type: replace Abstract: Many problems across the sciences compare two stochastic processes through the sequences they generate. Reinforcement learning asks what a new policy would return from the trajectories of an old one; molecular simulation asks how much more a ligand binds from samples of the unbound state; climate attribution asks how a heat wave shifted under warming; and language-model post-training asks what a deployed agent will do from logged interactions. In every case, one quantity would answer all these questions at once: the ratio of the two probability laws over their generated sequences, the trajectory density ratio. This ratio exists only under strong conditions. When one process reaches states the other cannot, the ratio does not exist; when their overlap is thin, its variance grows without control with the sequence length; and when they concentrate on different lower-dimensional sets, the ratio is undefined altogether. Weak support of this kind is the norm for sequence data, not a sampling accident, and its price is paid in identifiability rather than in noise alone. This survey organizes the field around a three-level diagnosis of weak support and a map of the nine retreats that methods take when the full ratio is out of reach, from direct estimation and reweighting through staged decomposition, stationarization, and partial-identification bounds to smoothing, transport couplings, operator spectra, and direct estimation of a single functional. Each retreat keeps part of what the ratio offers and pays for the rest, and each application domain has standardized the retreat its data force. The survey closes with open problems: testable diagnostics at every level, partial identification at the trajectory level, a rate theory of time-amplified error, and benchmarks with ground truth.
Source:https://arxiv.org/abs/2611.11985PreviousGenerative sequence modeling for infinite memory processes via predictive statesNextAdmissibility-Preserving Control for Block Strict-Feedback Systems Under Time-Varying Asymmetric Actuator and State Constraints
Related posts
Your Model Is Fine. Your Data Isn't: The Quiet Bottleneck in Every AI System
0dev.to Machine Learning
Influence Functions: Why One Training Point Can Move a Prediction
0dev.to Machine Learning
Your user's question is a bad search query: rewrite it before RAG retrieval (HyDE, multi-query)
0dev.to Machine Learning
My email client runs my first ML classifier. It trains itself from my own keystrokes.
0dev.to Machine Learning

WhatsApp Business Labels Are Now Lists: The 20-Label Limit, the Sale Pipeline, and the Auto-Lists Trade-Off
0dev.to Tutorial
Run Multiple AI Coding Agents on One Repo Without Collisions (git worktree)
0dev.to Tutorial