AI & ML
Beyond Maximum Likelihood: Variational Inequality Estimation for Generalized Linear Models
arXiv stat.TH0 views
arXiv:2511.03087v3 Announce Type: replace-cross Abstract: Generalized linear models (GLMs) are fundamental tools for statistical modeling, with maximum likelihood estimation (MLE) serving as the classical approach for parameter inference. While MLE performs well for canonical GLMs, it can become computationally challenging in more general settings with non-canonical, non-smooth, or saturating link functions, where the resulting optimization landscape may be ill-conditioned, non-convex, or non-differentiable. In this paper, we study an alternative estimation framework based on variational inequalities (VIs), which formulates GLM estimation through an operator-based equilibrium condition rather than likelihood minimization. We analyze the VI estimator from a statistical perspective and establish finite-sample error bounds and asymptotic normality, together with convergence guarantees for fixed-point and stochastic approximation algorithms. The framework accommodates a broad class of link functions, including non-canonical, non-smooth, and non-monotone cases satisfying a strong Minty-type condition, and extends naturally to generalized additive models (GAMs) via basis expansion. Numerical experiments demonstrate that under a fixed iteration budget, the VI approach achieves competitive estimation accuracy and faster, more stable convergence than MLE, particularly in GLMs and GAMs with non-canonical or non-smooth link functions.
Source:https://arxiv.org/abs/2511.03087PreviousU-centering as subset ANOVA: edge regression and higher-order theoryNextHyper Input Convex Neural Networks for Shape Constrained Learning and Optimal Transport
Related posts
Layer Rename & Cleanup: batch rename and delete empty layers in Aseprite (free Lite)
0dev.to

Open-Weight LLM vs Hosted API: What Self-Hosting Gives You That an API Can’t
0dev.to
Aizawl to Guwahati Flight Prices: Key Takeaways From a Booking-Window Analysis
0dev.to Data

Thinking Machines Ships Inkling 2 Small While Raising a 5B Round at 40B Valuation
0dev.to News

Ant Group Launches Ling-3.2-flash, a Native Multimodal Model
0dev.to News
OpenAI's $1.25 Trillion Funding Round Falls Short of Its $1.4 Trillion Target
0dev.to News