On Guo and Nixon's Criterion for Feature Subset Selection: Assumptions, Implications,and Alternative Options

Balagani, Kiran S and Phoha, Vir V and Iyengar, SS and Balakrishnan, N (2010) On Guo and Nixon's Criterion for Feature Subset Selection: Assumptions, Implications,and Alternative Options. In: IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 40 (3). pp. 651-655.

PDF iee.pdf - Published Version Restricted to Registered users only Download (144kB) | Request a copy

Abstract

Guo and Nixon proposed a feature selection method based on maximizing I(x; Y),the multidimensional mutual information between feature vector x and class variable Y. Because computing I(x; Y) can be difficult in practice, Guo and Nixon proposed an approximation of I(x; Y) as the criterion for feature selection. We show that Guo and Nixon's criterion originates from approximating the joint probability distributions in I(x; Y) by second-order product distributions. We remark on the limitations of the approximation and discuss computationally attractive alternatives to compute I(x; Y).

Item Type:	Journal Article
Publication:	IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans
Publisher:	IEEE
Additional Information:	Copyright 2010 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Keywords:	Entropic spanning graphs; feature selection; mutual information; Parzen window
Department/Centre:	Division of Mechanical Sciences > Aerospace Engineering(Formerly Aeronautical Engineering)
Date Deposited:	07 Jun 2010 10:04
Last Modified:	15 Dec 2018 05:34
URI:	http://eprints.iisc.ac.in/id/eprint/27453

Actions (login required)

View Item