AI & ML
Exact signal recovery from generative priors with sigmoid output activation
arXiv stat.ML0 views
arXiv:2611.05626v1 Announce Type: cross Abstract: We show exact signal recovery in generative compressed sensing for feedforward neural networks with piecewise-linear activations and a final sigmoid activation, with no assumption of expansivity. Consider a ReLU network of depth $d$ with a sigmoid final activation, whose input layer, of dimension $k$, is the narrowest, and let $K$ be the geometric mean of the widths of its layers. We show that, with high probability, all signals of the range whose entries lie in $[\delta, 1 - \delta]$ are uniformly recovered from $m \gtrsim k(d \log(K/k) + \log(1+\log(1/\delta)))$ measurements.
Source:https://arxiv.org/abs/2611.05626PreviousTransport along Local Annealing Paths: Wasserstein Geometry and Multimodal SamplingNextFrom Type to Token: Petri Nets, Individual Token Philosophy, and Individualized Causal Effects
Related posts
A Comparative Study of Importance Attribution to Columns in Deep Learning over Relational Databases
0arXiv cs.DB
Community Search under Member-Specific Tolerances
0arXiv cs.DB
Autonomous ETL Pipelines for Salesforce M&A Consolidation: A Reference Framework, Jitterbit Mapping, and Reproducible Simulation Study
0arXiv cs.DB
Rate-Fidelity Control for Wide-Area Quantum Links
0arXiv cs.NI
Who Needs DRAM? We Have Fiber
0arXiv cs.NI
The Multipath Reliable Connection (MRC) Transport
0arXiv cs.NI