Information Rates over DMCs with Many Independent Views

Rameshwar, VA and Weinberger, N (2024) Information Rates over DMCs with Many Independent Views. In: International Symposium on Information Theory, ISIT 2024, 7 July 2024through 12 July 2024, Athens, pp. 717-722.

PDF IEEE_Int_Sym_Inf_The_Pro_2024.pdf - Published Version Restricted to Registered users only Download (327kB) | Request a copy

Abstract

In this paper, we investigate the fundamental limits of reliable communication over a discrete memoryless channel (DMC) when there are a large number of noisy views of a transmitted symbol, i.e., when several copies of a single symbol are sent independently through the DMC. We argue that the channel capacity and dispersion of such a multi-view DMC converge exponentially quickly in the number of views to to the entropy and varentropy of the input distribution, respectively, and identify the exact rate of convergence. This rate equals the smallest Chernoff information between two conditional distributions of the output given unequal inputs. Our results hence help us characterize the largest finite-blocklength rates achievable for any fixed error probability. We also present a new channel model that we call the Poisson approximation channel-of possible independent interest-whose capacity closely approximates the capacity of the multi-view binary symmetric channel (BSC). © 2024 IEEE.

Item Type:	Conference Paper
Publication:	IEEE International Symposium on Information Theory - Proceedings
Publisher:	Institute of Electrical and Electronics Engineers Inc.
Additional Information:	The copyright for this article belongs to Institute of Electrical and Electronics Engineers Inc.
Keywords:	Channel dispersion; Channel's capacity; Chernoff information; Discrete memoryless channels; Information rates; Input distributions; Multi-views; Number of views; Rate of convergence; Reliable communication, Channel capacity
Department/Centre:	Division of Electrical Sciences > Electrical Communication Engineering
Date Deposited:	25 Sep 2024 10:29
Last Modified:	25 Sep 2024 10:29
URI:	http://eprints.iisc.ac.in/id/eprint/86292

Actions (login required)

View Item