AI & ML
Geometry, Local Minimax Risk, and the Limits of Sample Average Approximation in Linear Stochastic Optimization
arXiv stat.TH0 views
arXiv:2611.25007v1 Announce Type: new Abstract: We study how the local geometry of a linear stochastic optimization problem determines its statistical difficulty, measured by expected decision regret. The optimal local rate is governed by how fast the support function of the feasible set grows away from its linearization at the true mean; depending on the instance, it can be $n^{-1/2}$, $n^{-1}$, $n^{-2}$, or a non-power rate, and sample average approximation (SAA) attains these rates in a Gaussian mean model. At smooth instances, SAA also attains the classical sharp local minimax constant. We then allow the data distribution to vary in a Kullback--Leibler (KL) ball of radius proportional to $1/n$ around a reference distribution $P$. The exact local minimax limit of this benchmark, which may depend on $P$, coincides with that of a Gaussian model whose local parameter set is the covariance ellipsoid of $P$. A simple coordinatewise truncated SAA rule, which does not use $P$, attains the minimax rate, and at smooth instances its constant matches the minimax constant as the neighborhood radius grows. Ordinary SAA, in contrast, can have strictly suboptimal worst-case expected regret when the local rate is fast relative to the tails of $P$, because rare tail events then dominate the expectation. The results delineate when SAA is sharply optimal, rate-optimal, or statistically suboptimal, and quantify the local price of distributional robustness.
Source:https://arxiv.org/abs/2611.25007PreviousStop Removing Stopwords: How an Inherited Preprocessing Default Distorts Legal Text-as-DataNextFunctional Estimation under Local Differential Privacy: General Lower Bounds and Applications to Entropy and Power Sums
Related posts
Hydra · Coeziune OM–IA — the complete DOI registry (2026-11-20): 8 published works
0dev.to OpenSource
Stop Renting Cloud GPUs & VPS: 4 Legitimate Free Compute Tiers in 2026 (Plus Billing Pitfalls)
0dev.to OpenSource
How to Decode a Wall of Wingdings Without a Key
0dev.to Programming
Beyond the Hype: How Modern Businesses Can Actually Benefit from AI Today
0dev.to Programming
How to Free Up Space on Android Without Deleting Anything
0dev.to Programming

All my git repos in one file: manage them day to day, rebuild them on a new machine
0dev.to Git