Speeding up AdaBoost Classifier with Random Projection

Athithan, Biswajit Paul G and Murty, MN (2009) Speeding up AdaBoost Classifier with Random Projection. In: 7th International Conference on Advances in Pattern Recognition, FEB 04-06, 2009, Indian Statist Inst, Kolkata, INDIA,.

PDF computer.pdf - Published Version Restricted to Registered users only Download (165kB) | Request a copy

Abstract

The development of techniques for scaling up classifiers so that they can be applied to problems with large datasets of training examples is one of the objectives of data mining. Recently, AdaBoost has become popular among machine learning community thanks to its promising results across a variety of applications. However, training AdaBoost on large datasets is a major problem, especially when the dimensionality of the data is very high. This paper discusses the effect of high dimensionality on the training process of AdaBoost. Two preprocessing options to reduce dimensionality, namely the principal component analysis and random projection are briefly examined. Random projection subject to a probabilistic length preserving transformation is explored further as a computationally light preprocessing step. The experimental results obtained demonstrate the effectiveness of the proposed training process for handling high dimensional large datasets.

Item Type:	Conference Paper
Publisher:	IEEE computer soc
Additional Information:	©2008 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Keywords:
Department/Centre:	Division of Electrical Sciences > Computer Science & Automation
Date Deposited:	09 Feb 2010 09:43
Last Modified:	19 Sep 2010 05:30
URI:	http://eprints.iisc.ac.in/id/eprint/19981

Actions (login required)

View Item