AI & ML
Characterizing M-estimators using canonical divergences from information geometry
arXiv stat.TH0 views
arXiv:2611.18141v1 Announce Type: new Abstract: On Euclidean space, the losses that produce consistent M-estimators of a functional are its strictly consistent scoring functions (Dimitriadis, Fissler and Ziegel, 2024), and Osband's principle characterizes these through identification functions, which define method-of-moments estimators. We extend this characterization to the probability simplex. We define the residual, which on Euclidean space is a subtraction, as the inverse exponential map of an affine connection. It identifies the exponential barycenter of the connection: the arithmetic, normalized geometric and Fr\'echet means for the mixture, exponential and Levi-Civita connections. Its integral along geodesics is the canonical divergence of Ay and Amari (2015). A geometric form of Osband's principle decides which losses each connection admits. For the flat connections every strictly convex generator yields a consistent Bregman loss. For the curved $\alpha$-connections, half the squared Fisher-Rao distance is (up to scale) the only consistent loss for the Fr\'echet mean, and for $\alpha \notin \{-1, 0, 1\}$ no such loss exists and only the method of moments remains. The residual is integrable only at $\alpha = 0$, sharpening the integrability claim of Ay and Amari. The characterization yields the estimating equations of regression on the simplex and the calibration decomposition of compositional forecasts.
Source:https://arxiv.org/abs/2611.18141PreviousStatistical guarantees for signature kernel ridge regressionNextCausal and conditional tail coefficients: asymptotics, inference and graph recovery
Related posts
Your Manager's Manager Has Booked a Skip Level Meeting With You
0dev.to

How to Make a Character Reference Sheet with AI (Prompts Included)
0dev.to Design
How Virtual Assistants Help Businesses Manage Their Work More Efficiently
0dev.to Productivity
DiffusionSSD: Achieving Extreme Visual Compression with Dual-stage Diffusion and Cross-level Near-Data Processing
0arXiv eess.IV
D2ToF: One-Step Diffusion for Depth Super-Resolution from Lightweight Single-Photon LiDAR Waveforms
0arXiv eess.IV
Few-Shot Open-Set Hyperspectral Pixel-Wise Classification with Spatial Aware Label Propagation
0arXiv eess.IV