AI & ML
Infinity-Wasserstein Distributionally Robust Principal Component Analysis: Exact Reformulation, Finite-Sample Guarantee, and Efficient Algorithm
arXiv stat.ML0 views
arXiv:2611.23877v1 Announce Type: cross Abstract: Principal component analysis (PCA) is a fundamental and ubiquitous technique for dimension reduction and representation learning, yet its empirical formulation remains vulnerable to distributional uncertainty. While distributionally robust optimization (DRO) offers a natural remedy, existing order-2 Wasserstein models of PCA either preserve the nominal PCA subspace or lack an exact reformulation. This paper demonstrates how the infinity-Wasserstein distance can reconcile these two desirable properties. For the resulting DRO model of PCA, we derive an exact finite-dimensional reformulation and explicitly identify a worst-case distribution attaining the inner maximum. Crucially, the reformulated objective retains samplewise residual information beyond the empirical covariance matrix, revealing a mechanism through which distributional robustness can reshape the learned principal subspace. Under the mild assumption that the true distribution has a finite fourth moment, we further establish a uniform finite-sample performance guarantee for the proposed model. An iteratively reweighted majorization-minimization algorithm is also developed to solve the resulting nonconvex and nonsmooth optimization problem, with a rigorous analysis of its convergence properties. Numerical experiments substantiate the computational efficiency of the proposed algorithm and the practical effectiveness of the infinity-Wasserstein model in downstream applications.
Source:https://arxiv.org/abs/2611.23877PreviousDefining equations for two-block shallow ReLU pattern varietiesNextRisk-Controlled Correction for Frozen Multimodal Models under Missing Modalities
Related posts
How to Keep Chinese Model Inference In-Region: A Worked Cost Example
0dev.to

Ping64|The Visitor QR Code Someone Screenshotted and Forwarded to the Whole Group Chat
0dev.to
Building a Local Cyber Attack Simulation (Web UI Prototype)
0dev.to
AI Agents vs Python Scripts: What Should Beginner Developers Build First?
0dev.to
Your AI Coding Limits Ran Out Early? Find What Is Burning Them
0dev.to
Frontier Models Are Smarter Than Ever — So Why Do You Still Need a Swarm Harness Like VibesPlug?
0dev.to