ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

An Online Sample-Based Method for Mode Estimation Using ODE Analysis of Stochastic Approximation Algorithms

Kamanchi, C and Diddigi, RB and Prabuchandran, KJ and Bhatnagar, S (2019) An Online Sample-Based Method for Mode Estimation Using ODE Analysis of Stochastic Approximation Algorithms. In: IEEE Control Systems Letters, 3 (3). pp. 697-702.

[img]
Preview
PDF
IEEE_con_sys_let_3-3_697-702_2019.pdf - Published Version

Download (708kB) | Preview
Official URL: https://doi.org/10.1109/LCSYS.2019.2916467

Abstract

One of the popular measures of central tendency that provides better representation and interesting insights of the data compared to the other measures like mean and median is the metric mode. If the analytical form of the density function is known, mode is an argument of the maximum value of the density function and one can apply optimization techniques to find the mode. In many of the practical applications, the analytical form of the density is not known and only the samples from the distribution are available. Most of the techniques proposed in the literature for estimating the mode from the samples assume that all the samples are available beforehand. Moreover, some of the techniques employ computationally expensive operations like sorting. In this letter, we provide a computationally effective, online iterative algorithm that estimates the mode of a unimodal smooth density given only the samples generated from the density. Asymptotic convergence of the proposed algorithm using an ordinary differential equation (ODE)-based analysis is provided. We also prove the stability of estimates by utilizing the concept of regularization. Experimental results further demonstrate the effectiveness of the proposed algorithm.

Item Type: Journal Article
Publication: IEEE Control Systems Letters
Publisher: Institute of Electrical and Electronics Engineers Inc.
Additional Information: The copyright for this article belongs to the Authors.
Keywords: Approximation algorithms; Density functional theory; Estimation; Iterative methods; Learning algorithms; Learning systems; Manganese; Optimization; Ordinary differential equations; Stochastic systems, Asymptotic convergence; Convergence; Iterative algorithm; Optimization algorithms; Optimization techniques; Ordinary differential equation (ODE); Statistical learning; Stochastic approximation algorithms, Machine learning
Department/Centre: Division of Electrical Sciences > Computer Science & Automation
Division of Interdisciplinary Sciences > Robert Bosch Centre for Cyber Physical Systems
Date Deposited: 23 Oct 2022 07:08
Last Modified: 23 Oct 2022 07:08
URI: https://eprints.iisc.ac.in/id/eprint/77511

Actions (login required)

View Item View Item