Open Source
The low-degree sample complexity of clustering Gaussian mixtures with more groups than dimensions
arXiv stat.ML0 views
arXiv:2611.25163v1 Announce Type: cross Abstract: We study the computational limits of clustering $n$ observations drawn from a mixture of $K$ isotropic Gaussian distributions in $\mathbb R^d$, when the number $K$ of groups is much larger than the dimension $d$. In this regime, distance-based and spectral procedures require a squared separation $\Delta^2$ of order $\sqrt d$. In contrast, tensor-based procedures cluster at a polylogarithmic separation but need a sample size that is a large polynomial of $dK$, and the low-degree lower bounds known for random centers only show that $n$ must exceed $dK^2$. Focusing on normally distributed centers, we characterize the minimal separation for clustering with low-degree polynomials in the regime $K>d$, through a low-degree lower bound and a matching upper bound, up to subpolynomial factors. In particular, for $K=d^{p/2}$ with $p> 2$ a real number, we show that a sample size of the order of $K^3 d^{(\lceil p\rceil-p)/2}$ is required to recover the clustering with subpolynomial separation, and that it suffices when $p$ is not an integer.
Source:https://arxiv.org/abs/2611.25163PreviousHapBO: Harnessed $\alpha$-$\pi$ Bayesian Optimization via Expert Natural Language PriorsNextVariance Reduction for Matrix Computations with Applications to Gaussian Processes
Related posts
In 2022 I learned to build Android apps in a country where I could not publish one
0dev.to
Are You Buying a Company or a model_id?
0dev.to Discuss
How to Test a Resistor, Diode, LED and Capacitor with a Multimeter (Before You Blame Your Code)
0dev.to Beginners
Omni-modal decomposition autoencoders learn full-stack wearable disentangled representations
0arXiv eess.SP
Spectral Vision Transformer for Efficient Tokenization with Limited Data
0arXiv eess.SP
Gaussian Quasi-Likelihood Estimation for Nonsynchronously Observed L\'evy processes
0arXiv stat.TH