PerSeg : segmenting salient objects from bag of single image perturbations

Majumder, A and Babu, RV and Chakraborty, A (2020) PerSeg : segmenting salient objects from bag of single image perturbations. In: Multimedia Tools and Applications, 79 (3-4). pp. 2473-2493.

PDF mul_too_app_79-3-4_2473-2493_2020.pdf - Published Version Restricted to Registered users only Download (4MB) | Request a copy

Abstract

Salient object segmentation is an important computer vision problem having applications in numerous areas such as video surveillance, scene parsing, autonomous navigation etc. For images, this task is quite challenging due to clutter/texture present in the background, low resolution and/or low contrast of the object(s) of interest etc. In case of videos, additional issues such as object deformation, camera motion and presence of multiple moving objects make the foreground object segmentation a significantly difficult and open problem. However, motion pattern can also act as an important cue to identify the foreground objects against the background. This is exploited by the recent approaches via aggregation of temporally perturbed information from a series of consecutive frames. Unfortunately for images, this additional cue is not available. In this paper, we propose to emulate the effect of such perturbations by constructing a bag of multiple augmentations applied on a single input image. Saliency features are estimated independently from each perturbed image in this bag, which are further combined using a novel aggregation strategy based on a convolutional gated recurrent encoder-decoder unit. Through extensive experiments on the benchmark datasets, we show better or very competitive performance when compared with the state-of-the-art methods. We further observe that even with a bag constructed using simple affine transformations, we achieve impressive performances, proving the robustness of the proposed framework. © 2019, Springer Science+Business Media, LLC, part of Springer Nature.

Item Type:	Journal Article
Publication:	Multimedia Tools and Applications
Publisher:	Springer
Additional Information:	The copyright for this article belongs to Springer.
Keywords:	Benchmarking; Convolution; Formal languages; Motion analysis; Recurrent neural networks; Security systems, Convolutional neural network; Feature aggregation; Gated recurrent units; Salient object detection; Video segmentation, Image segmentation
Department/Centre:	Division of Interdisciplinary Sciences > Computational and Data Sciences
Date Deposited:	08 Feb 2023 08:50
Last Modified:	08 Feb 2023 08:50
URI:	https://eprints.iisc.ac.in/id/eprint/80066

Actions (login required)

View Item