Backend
Optimal Control of RKHS Diffeomorphic Flows for Classification and Generative Modeling
arXiv cs.NA0 views
arXiv:2611.23497v1 Announce Type: new Abstract: We develop a unified optimal-control framework that solves supervised classification and likelihood-based density estimation with a single diffeomorphic flow whose velocity lives in a reproducing kernel Hilbert space (RKHS); the two tasks share all structure except the objective. Variable projection eliminates the terminal model (a classifier, or a Gaussian-mixture (GMM) reference), leaving a reduced control problem whose gradient comes from an analytic discrete adjoint. The RKHS parameterization makes the flow's divergence exact and deterministic at the cost of one kernel matrix-vector product, avoiding the stochastic trace estimators and potential-flow restrictions of existing continuous normalizing flows. Because the objective and gradient are deterministic, matrix-free reduced Gauss-Newton (GN) and related second-order solvers are practical for both tasks, which we benchmark against a range of first- and second-order optimizers; the learned map is a diffeomorphism with explicitly controlled regularity. In experiments from dimension 2 to 256, the reduced GN solvers use the fewest iterations of any optimizer tested and, together with joint L-BFGS, the least work; a multiscale kernel improves the density fit, and a trainable GMM reference reduces the deformation needed for multimodal transport at comparable likelihood while lowering the likelihood on real data. The full-model solve is quadratic in the particle count and sub-linear in dimension; a control-point reduction makes the particle-count scaling linear at near-lossless accuracy.
Source:https://arxiv.org/abs/2611.23497PreviousA Study of Fixed versus Adaptive Step Sizes for Phasor Dynamics SimulationsNextAn explicit domain-preserving projection scheme for scalar stochastic differential equations
Related posts
Shipping an LLM feature to production: a 6-step checklist from real client projects
0dev.to
Why I Built an Ad-Free, 4K Video Downloader in Next.js 14 & Python (And Killed Popups Forever)
0dev.to
Three Hundred of Our Trade Accounts Belonged to Companies That No Longer Existed
0dev.to
Title40-AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
0dev.to
Title50-AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
0dev.to

Practical: a webcam physiology lab that grades itself against a wrist count
0dev.to