AI & ML
Exact signal recovery from generative priors with sigmoid output activation
arXiv stat.ML0 views
arXiv:2611.05626v1 Announce Type: cross Abstract: We show exact signal recovery in generative compressed sensing for feedforward neural networks with piecewise-linear activations and a final sigmoid activation, with no assumption of expansivity. Consider a ReLU network of depth $d$ with a sigmoid final activation, whose input layer, of dimension $k$, is the narrowest, and let $K$ be the geometric mean of the widths of its layers. We show that, with high probability, all signals of the range whose entries lie in $[\delta, 1 - \delta]$ are uniformly recovered from $m \gtrsim k(d \log(K/k) + \log(1+\log(1/\delta)))$ measurements.
Source:https://arxiv.org/abs/2611.05626PreviousTransport along Local Annealing Paths: Wasserstein Geometry and Multimodal SamplingNextFrom Type to Token: Petri Nets, Individual Token Philosophy, and Individualized Causal Effects
Related posts
Curvature-Calibrated Quasi-Bayesian Updating for Moment-Restricted Models
0arXiv stat.TH
Ordinal Credit Assignment: Multi-Step Reinforcement Learning from Comparisons Alone
0arXiv stat.TH
Optimal estimation of generalized causal effects in cluster-randomized trials with multiple outcomes
0arXiv stat.TH
Bayesian Nonparametric Global-local Clustering of High-dimensional Functions
0arXiv stat.TH
Sigmoid-FTRL: Design-Based Adaptive Neyman Allocation for AIPW Estimators
0arXiv stat.TH
Polynomial-Time Differentially Private Synthetic Graph Release with Nearly-Linear Additive Error
0arXiv stat.TH