AI & ML
A Rigorous, Tractable Measure of Model Complexity
arXiv stat.ML0 views
arXiv:2605.21167v2 Announce Type: replace Abstract: An accurate assessment of a model's complexity is crucial for topics such as interpretation, generalization, and model selection. However, existing complexity measures either rely on heuristic assumptions or are computationally prohibitive. In this paper, we present a mathematically rigorous yet easy-to-compute measure of model complexity that is based on the similarities between feature vectors for different inputs. It is thus well-defined for any parametric model (via NTK feature generalization) and for kernel-based non-parametric models (via the induced kernel). We prove that our measure of complexity generalizes model-specific complexity measures, including polynomial degree (for polynomial regression), kernel length scale (for Mat\'ern kernels), number of neighbors (for k-nearest neighbors), number of splits (for decision trees), and number of trees (for random forests). We also use our measure to obtain new insights into the double descent phenomenon for random Fourier features, random forests, neural networks, and gradient boosting.
Source:https://arxiv.org/abs/2605.21167PreviousPrediction-Intervention Games and Invariant SetsNextConservative neural posterior estimation via distributionally robust training
Related posts
메타 Quest 2 OS 업데이트 종료, 약시 훈련 루틴에는 무슨 일이 생기나
0dev.to News
How to Put a Logo in a QR Code (and Make Sure It Still Scans)
0dev.to Design
Why Luxury Fine Jewelry Brands Are Ditching Physical Video Shoots for 3D CAD Commercials in 2026
0dev.to Design

How AI Is Changing Healthcare in 2026 - And Why Developers Should Pay Attention
0dev.to Productivity

When Should Singapore Healthcare Enterprises Hire AI Developers?
0dev.to Productivity

How to Ask AI Questions About Your PDFs Without Uploading Them in 2026 (Page Citations, On Your Own Device)
0dev.to Productivity