Improving facial emotion recognition systems with crucial feature extractors

Pandey, RK and Karmakar, S and Ramakrishnan, AG and Saha, N (2019) Improving facial emotion recognition systems with crucial feature extractors. In: 20th International Conference on Image Analysis and Processing, ICIAP 2019, 9 September 2019through 13 September 2019, Trento, pp. 268-279.

PDF ICIAP_2019.pdf - Published Version Restricted to Registered users only Download (950kB) | Request a copy

Abstract

In this work, we have proposed enhancements that improve the performance of state-of-the-art facial emotion recognition (FER) systems. We believe that the changes in the positions of the fiducial points and the intensities capture the crucial information regarding the emotion of a face image. We propose the inputting of the gradient and the Laplacian of the input image together with the original into a convolutional neural network (CNN). These modifications help the network learn additional information from the gradient and Laplacian of the images. However, as shown by our results, the CNN in the existing state-of-the-art models is not able to extract this information from the raw images. In addition, we employ spatial transformer network to add robustness to the system against rotation and scaling. We have performed a number of experiments on two well known datasets, namely KDEF and FERplus. Our approach enhances the already high performance of the state-of-the-art FER systems by 3 to 5. In another contribution, we have proposed an efficient architecture that performs better than the state-of-the-art system on FERplus dataset, with the number of parameters reduced by a factor of about 24. Here also, the fusion of gradient or Laplacian image with the original image improves the recognition performance of the proposed model.

Item Type:	Conference Paper
Publication:	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Publisher:	Springer Verlag
Additional Information:	The copyright for this article belongs to Springer Verlag.
Keywords:	Convolution; Face recognition; Gradient methods; Image analysis; Laplace transforms; Neural networks; Speech recognition, Convolutional neural network; Efficient architecture; Facial emotions; Feature extractor; Laplacians; Original images; State of the art; State-of-the-art system, Image enhancement
Department/Centre:	Division of Electrical Sciences > Electrical Engineering
Date Deposited:	06 Dec 2022 07:02
Last Modified:	06 Dec 2022 07:02
URI:	https://eprints.iisc.ac.in/id/eprint/78272

Actions (login required)

View Item