ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

On maximum entropy and minimum KL-divergence optimization by Grobner basis methods

Dukkipati, Ambedkar (2012) On maximum entropy and minimum KL-divergence optimization by Grobner basis methods. In: APPLIED MATHEMATICS AND COMPUTATION, 218 (23). pp. 11674-11687.

[img] PDF
App_mat_com_218-23_11674-11687_2012.pdf - Published Version
Restricted to Registered users only

Download (273kB) | Request a copy
Official URL: http://dx.doi.org/10.1016/j.amc.2012.05.052

Abstract

In this paper we study constrained maximum entropy and minimum divergence optimization problems, in the cases where integer valued sufficient statistics exists, using tools from computational commutative algebra. We show that the estimation of parametric statistical models in this case can be transformed to solving a system of polynomial equations. We give an implicit description of maximum entropy models by embedding them in algebraic varieties for which we give a Grobner basis method to compute it. In the cases of minimum KL-divergence models we show that implicitization preserves specialization of prior distribution. This result leads us to a Grobner basis method to embed minimum KL-divergence models in algebraic varieties. (C) 2012 Elsevier Inc. All rights reserved.

Item Type: Journal Article
Publication: APPLIED MATHEMATICS AND COMPUTATION
Publisher: ELSEVIER SCIENCE INC
Additional Information: Copy right for this article belongs to Elsevier Inc.
Keywords: Shannon entropy;Zariski closure;Implicitization
Department/Centre: Division of Electrical Sciences > Computer Science & Automation
Date Deposited: 09 Aug 2012 11:22
Last Modified: 09 Aug 2012 11:22
URI: http://eprints.iisc.ac.in/id/eprint/44911

Actions (login required)

View Item View Item