Priority-based Soft Vector Quantization Feature Maps

Gowgi, P and Machireddy, A and Garani, SS (2018) Priority-based Soft Vector Quantization Feature Maps. In: International Joint Conference on Neural Networks, IJCNN 2018, 8 - 13 July 2018, Rio de Janeiro.

PDF IEEE_IJCNN_2018.pdf - Published Version Restricted to Registered users only Download (1MB) | Request a copy

Abstract

Vector quantization techniques using self-organizing maps (SOM) and its variants are popularly used for applications in contextual data clustering, data visualization and high-dimensional data exploration. The update rule in a SOM is based on competitive learning using a neighborhood function that measures the Euclidean distance between an input vector and a non-linear processing element without any consideration of selective priority for a specific feature in the input data. Certain applications may require unsupervised learning of high-dimensional data with a priori knowledge on the priority of certain features, leading to resolution dependent contextual maps. With this in mind, we propose a vector quantization technique called priority based soft vector quantization feature maps (PSVQFM) for creating contextual feature maps by learning priorities. In this paper, we formulate the cost function based on the priorities over the feature coordinates and derive a learning rule from first principles. We present an analysis on the misclassification error and prove that the proposed algorithm is asymptotically optimal. Simulation results over a synthetic data set and a high-dimensional banking corpus data set show that the PSVQFM algorithm is able to learn the input data based on priority of features very well.

Item Type:	Conference Paper
Publication:	Proceedings of the International Joint Conference on Neural Networks
Publisher:	Institute of Electrical and Electronics Engineers Inc.
Additional Information:	The copyright for this article belongs to the IEEE.
Keywords:	Clustering algorithms; Conformal mapping; Cost functions; Data visualization; Input output programs; Self organizing maps; Vectors, Asymptotically optimal; Competitive learning; Contextual feature; Feature map; High dimensional data; Misclassification error; Neighborhood function; Nonlinear processing, Vector quantization
Department/Centre:	Division of Electrical Sciences > Electronic Systems Engineering (Formerly Centre for Electronic Design & Technology)
Date Deposited:	03 Aug 2022 08:38
Last Modified:	03 Aug 2022 08:38
URI:	https://eprints.iisc.ac.in/id/eprint/75205

Actions (login required)

View Item