AI & ML
Sparse Network Inference under Imperfect Detection and its Application to Ecological Networks
arXiv stat.ML0 views
arXiv:2604.18820v3 Announce Type: replace Abstract: Recovering latent structure from count data has received considerable attention in network inference, particularly when one seeks both cross-group interactions and within-group similarity patterns in bipartite networks, which are widely used in ecology research. Such networks are often sparse and prone to imperfect detection. Existing models mainly focus on interaction recovery, while the induced similarity graphs are much less studied. Moreover, existing models for under-counted data place sparsity, if at all, on the detection model rather than on these graphs. To address these issues, we propose a nonnegative low-rank factorization framework that jointly estimates detection probabilities and promotes sparse within- and cross-group graphs through $\ell_{1/2}$ regularization. For the resulting nonconvex, nonsmooth problem, we develop an ADMM-based algorithm with adaptive penalization, and establish asymptotic feasibility and KKT stationarity of cluster points under stated assumptions. We also give sufficient conditions for exact recovery of within- and cross-group graphs. On synthetic data with up to 20% missing entries, the method recovers the graphs and detection probabilities with competitive accuracy. Across three ecological datasets, it matches the baseline held-out predictions while estimating detection probabilities and within- and cross-group graphs.
Source:https://arxiv.org/abs/2604.18820PreviousOutlier-Robust Multi-Output Gaussian ProcessesNextSpectrum-Adaptive Generalization Bounds for Trained Deep Transformers
Related posts
chmod 755 Is Not 'Read, Write, Execute': 5 Permission Traps
0dev.to DevOps
Building a Production-Oriented MLOps Prototype with Python and FastAPI
0dev.to Docker

A profile of Alice Huang, a suspected Chinese spy who founded Megaspeed in 2023 and spent years in Jensen Huang's orbit; Megaspeed's Nvidia imports top $4.6B (Mark Anderson/Bloomberg)
0Techmeme

Meta says it is globally expanding Instagram's AI age estimation tech to apply Teen Account protections to teens aged 13 to 17 who misrepresented their age (Jess Weatherbed/The Verge)
0Techmeme

Alphabet's Wing plans to invest up to $125M over two years to build a 15,000-square-foot facility in Fort Worth, Texas, to produce tens of thousands of drones (Mark R. Long/Wall Street Journal)
0Techmeme

Jensen Huang's affair raises questions about Alice Huang's access to his devices and Trump conversations, and represents "another successful op" for China's MSS (Bill Bishop/@niubi)
0Techmeme