On measure-theoretic aspects of nonextensive entropy functionals and corresponding maximum entropy prescriptions

Dukkipati, Ambedkar and Bhatnagar, Shalabh and Murty, Narasimha M (2007) On measure-theoretic aspects of nonextensive entropy functionals and corresponding maximum entropy prescriptions. In: Physica A: Statistical Mechanics and its Applications, 384 (2). pp. 758-774.

PDF On_measure-theoretic_aspects.pdf Restricted to Registered users only Download (246kB) | Request a copy

Abstract

Shannon entropy of a probability measure P, defined as $- \int_X(dp/d \mu) \hspace{2} ln (dp/d \mu)d \mu $ on a measure space $ (X, m,\mu )$ source, is not a natural extension from the discrete case. However, maximum entropy (ME) prescriptions of Shannon entropy functional in the measure-theoretic case are consistent with those for the discrete case. Also it is well known that Kullback–Leibler relative entropy can be extended naturally to measure-theoretic case. In this paper, we study the measure-theoretic aspects of nonextensive (Tsallis) entropy functionals and discuss the ME prescriptions. We present two results in this regard: (i) we prove that, as in the case of classical relative-entropy, the measure-theoretic definition of Tsallis relative-entropy is a natural extension of its discrete case, and (ii) we show that ME-prescriptions of measure-theoretic Tsallis entropy are consistent with the discrete case with respect to a particular instance of ME.

Item Type:	Journal Article
Publication:	Physica A: Statistical Mechanics and its Applications
Publisher:	Elsevier
Additional Information:	Copyright of this article belongs to Elsevier.
Keywords:	Measure space;Tsallis entropy;Maximum entropy distribution;
Department/Centre:	Division of Electrical Sciences > Computer Science & Automation
Date Deposited:	19 Nov 2007
Last Modified:	19 Sep 2010 04:41
URI:	http://eprints.iisc.ac.in/id/eprint/12530

Actions (login required)

View Item