Human action recognition in H.264/AVC compressed domain using meta-cognitive radial basis function network

Babu, Venkatesh R and Rangarajan, Badrinarayanan and Sundaram, Suresh and Tom, Manu (2015) Human action recognition in H.264/AVC compressed domain using meta-cognitive radial basis function network. In: APPLIED SOFT COMPUTING, 36 . pp. 218-227.

PDF App_Sof_Com_36-218_2015.pdf - Published Version Restricted to Registered users only Download (1MB) | Request a copy

Abstract

In this paper, we propose a H.264/AVC compressed domain human action recognition system with projection based metacognitive learning classifier (PBL-McRBFN). The features are extracted from the quantization parameters and the motion vectors of the compressed video stream for a time window and used as input to the classifier. Since compressed domain analysis is done with noisy, sparse compression parameters, it is a huge challenge to achieve performance comparable to pixel domain analysis. On the positive side, compressed domain allows rapid analysis of videos compared to pixel level analysis. The classification results are analyzed for different values of Group of Pictures (GOP) parameter, time window including full videos. The functional relationship between the features and action labels are established using PBL-McRBFN with a cognitive and meta-cognitive component. The cognitive component is a radial basis function, while the meta-cognitive component employs self-regulation to achieve better performance in subject independent action recognition task. The proposed approach is faster and shows comparable performance with respect to the state-of-the-art pixel domain counterparts. It employs partial decoding, which rules out the complexity of full decoding, and minimizes computational load and memory usage. This results in reduced hardware utilization and increased speed of classification. The results are compared with two benchmark datasets and show more than 90% accuracy using the PBL-McRBFN. The performance for various GOP parameters and group of frames are obtained with twenty random trials and compared with other well-known classifiers in machine learning literature. (C) 2015 Elsevier B.V. All rights reserved.

Item Type:	Journal Article
Publication:	APPLIED SOFT COMPUTING
Publisher:	ELSEVIER SCIENCE BV
Additional Information:	Copy right for this article belongs to the ELSEVIER SCIENCE BV, PO BOX 211, 1000 AE AMSTERDAM, NETHERLANDS
Keywords:	Human action recognition; Compressed domain; Motion vectors; Quantization parameters; PBL-McRBFN; Meta cognitive learning
Department/Centre:	Division of Interdisciplinary Sciences > Supercomputer Education & Research Centre
Date Deposited:	30 Sep 2015 06:55
Last Modified:	30 Sep 2015 06:55
URI:	http://eprints.iisc.ac.in/id/eprint/52496

Actions (login required)

View Item