ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Relative alpha-Entropy Minimizers Subject to Linear Statistical Constraints

Kumar, Ashok M and Sundaresan, Rajesh (2015) Relative alpha-Entropy Minimizers Subject to Linear Statistical Constraints. In: 21st National Conference on Communications (NCC), FEB 27-MAR 01, 2015, Indian Inst Technol, Bombay, INDIA.

[img] PDF
Twe_Fir_Nat_Con_Com_2015.pdf - Published Version
Restricted to Registered users only

Download (275kB) | Request a copy
Official URL: http://dx.doi.org/10.1109/NCC.2015.7084835


We study minimization of a parametric family of relative entropies, termed relative alpha-entropies (denoted I-alpha(P; Q)). These arise as redundancies under mismatched compression when cumulants of compressed lengths are considered instead of expected compressed lengths. These parametric relative entropies are a generalization of the usual relative entropy (Kullback-Leibler divergence). Just like relative entropy, these relative alpha-entropies behave like squared Euclidean distance and satisfy the Pythagorean property. Minimization of I-alpha(P, Q) over the first argument on a set of probability distributions that constitutes a linear family is studied. Such a minimization generalizes the maximum Renyi or Tsallis entropy principle. The minimizing probability distribution (termed I-alpha-projection) for a linear family is shown to have a power-law.

Item Type: Conference Proceedings
Series.: National Conference on Communications NCC
Additional Information: Copy right for this article belongs to the IEEE, 345 E 47TH ST, NEW YORK, NY 10017 USA
Department/Centre: Division of Electrical Sciences > Electrical Communication Engineering
Date Deposited: 24 Aug 2016 10:10
Last Modified: 24 Aug 2016 10:10
URI: http://eprints.iisc.ac.in/id/eprint/54563

Actions (login required)

View Item View Item