Open Source
Fano's Inequality and Channel Capacity in the Individual-Sequence Regime
arXiv math.IT0 views
arXiv:2611.06182v1 Announce Type: new Abstract: We derive an individual-sequence analogue of Fano's inequality, replacing entropy by Lempel--Ziv (LZ) complexity and probability of error by empirical error frequency. In the setting considered, an arbitrary encoder maps a message to a channel input sequence $\{x_t\}$, the channel maps the input to an output $\{y_t\}$ in a completely arbitrary manner, and a block finite-state decoder produces an estimate of the channel input from the output. The individual-sequence Fano inequality lower-bounds the empirical symbol-error frequency in terms of the LZ complexity of the channel input conditioned on the channel output. This leads to a channel coding converse: reliable communication at a given rate is possible only if that rate does not exceed the individual-sequence LZ channel capacity, defined as the LZ mutual information maximized over channel inputs and minimized (worst-case) over a noise set. We also prove a matching achievability theorem for the class of \emph{symbol-wise invertible} channels, in which the channel output at each time $t$ is $y_t = f(x_t, v_t)$, $v_t$ being a `noise' variable, and $f(\cdot,v)$ is a bijection for every fixed $v$. This class includes group-additive channels $y_t = x_t \oplus v_t$ studied by Feder and coworkers. For such a channel, any rate below the LZ capacity is achievable with vanishing per-message error frequency, simultaneously for every $v^n$ in a given noise set $\mathcal{N}$, provided $\mathcal{N}$ is closed under block permutations; this condition is satisfied by any noise set that depends on $v^n$ only via its type class with respect to such blocks. The achievability uses a universal decoder that requires no knowledge of the channel and no feedback.
Source:https://arxiv.org/abs/2611.06182PreviousExact Transport-Information Correspondence for Distribution-Adaptive DiscretizationNextCross-Modal Semantic Successive Refinement for Generative Image Communication over Underwater Acoustic Channels
Related posts
Quantum communication: a discrimination approach
0arXiv math.IT
Impact of metric characteristics of the matrix graph on the convergence of the conjugate gradient method
0arXiv cs.NA
Symplectic Hamiltonian Direct Discontinuous Galerkin Method for Wave Propagation
0arXiv cs.NA
Quadratic Extractors
0arXiv cs.CR
Show HN: Document parsing 5B tokens on a single CPU thread
0Hacker News Show
Show HN: In-material physical solver for stiff 64-spin Ising problems (0.27ms)
0Hacker News Show