AI & ML
The Double Entropy Fit Index (DEFI): An Information-Theoretic Approach to Dimensionality Reduction and Clustering
arXiv math.IT0 views
arXiv:2611.23523v1 Announce Type: new Abstract: We introduce the Double-Entropy Fit Index (DEFI), a regularized information-theoretic criterion for selecting among candidate graph partitions and reduced representations. DEFI couples entropy-based compression with relevance preservation and penalizes model dimensionality, cluster imbalance, and partition fragmentation. An exact R\'enyi-2 entropy identity shows that partitioning alters both spectral concentration and graph-volume normalization, explaining why unregularized entropy minimization can favor degenerate solutions. Across a 243-condition population-analytic factor recovery benchmark, DEFI achieved an overall exact recovery rate of 97.2\% (versus 75.0\% for EGA-TMFG, 45.8\% for TEFI on von Neumann entropy). In controlled local candidate batteries (distinguishing the true model from adjacent $K \pm 1$ and factor-split alternatives), DEFI identified the correct partition in 99.2\% of replications. Across ten clustering benchmarks, DEFI-guided Gaussian mixtures achieved a mean ARI of 0.929, exceeding HDBSCAN (0.809), Ward clustering (0.700), and conventional GMM criteria (0.501-0.580), with gains concentrating where standard criteria over-extract components.
Source:https://arxiv.org/abs/2611.23523PreviousMovement Information from a Robotic Effector Influences Human Performance During Object HandoversNextDrift-Aware Adaptive Semantic Codec Update Strategy for Dynamic Semantic Communications
Related posts
What’s With All These Outages?
0Wired

A brief history of Nvidia’s recent stock fluctuations
0The Verge

Apple is hiring engineers to build its own AI agent
0The Verge
These tech outages are giving Y2K, AI agent style
0TechCrunch
Meta’s new Muse Charm device may cost $300
0TechCrunch
Want to see your live AI usage on your Mac’s icons? This clever new app lets you
0TechCrunch