Backend
Transport along Local Annealing Paths: Wasserstein Geometry and Multimodal Sampling
arXiv stat.ML0 views
arXiv:2611.05605v1 Announce Type: cross Abstract: Variational approaches to learning transport maps for multimodal sampling can suffer from mode collapse. One way to mitigate this problem is to learn transport along a prescribed path of intermediate distributions defined by geometric annealing. We show that annealing can take a substantial detour in Wasserstein space: when mass moves between modes, the path can be much longer than the distance between its endpoints. We further link path geometry to transport learning, showing that long annealing paths can slow population optimization, while sufficiently regular paths permit rapid convergence. Motivated by these findings, we propose componentwise annealed transport (CAT) to reduce the need for mass transfer between modes. Starting from a mode-informed mixture reference, CAT constructs an exact mixture decomposition of the target and learns separate transport maps along componentwise annealing paths. We estimate the component weights separately and show that these estimates remain consistent even when the learned flows are inexact. We also develop adaptive annealing schedules guided by transport effort. Experiments on multimodal synthetic distributions and Bayesian inference problems demonstrate improvements in transport learning and sampling efficiency.
Source:https://arxiv.org/abs/2611.05605PreviousSupport Vector Machines Directly Minimise KL DivergenceNextExact signal recovery from generative priors with sigmoid output activation
Related posts
Shallow Encoding Emits Deep Memories
0arXiv cs.DC
Easy Multi-Precision Acceleration via Vectorization
0arXiv cs.DC
Unlocking Turing Tensor Cores: A Measured Throughput Account of From-Scratch Pre-training on a Single 22G RTX 2080 Ti
0arXiv cs.DC
AtomicFaaS: Offloading Side-Effect Compensation to the Serverless Platform
0arXiv cs.DC
Performance Portability of Out-of-Kernel Optimizations on GPUs: A Molecular Docking Case Study
0arXiv cs.DC
vExpert: Virtualizing Expert Storage for Adaptive Load Balancing in Distributed MoE Inference
0arXiv cs.DC