ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Robust image retrieval by cascading a deep quality assessment network

Somasundaran, Biju Venkadath and Soundararajan, Rajiv and Biswas, Soma (2020) Robust image retrieval by cascading a deep quality assessment network. In: SIGNAL PROCESSING-IMAGE COMMUNICATION, 80 .

[img]
Preview
PDF
sig_pro_ima_com_80_2020.pdf - Published Version

Download (1MB) | Preview
Official URL: http://dx.doi.org/10.1016/j.image.2019.115652

Abstract

The performance of computer vision algorithms can severely degrade in the presence of a variety of distortions. While image enhancement algorithms have evolved to optimize image quality as measured according to human visual perception, their relevance in maximizing the success of computer vision algorithms operating on the enhanced image has been much less investigated. We consider the problem of image enhancement to combat Gaussian noise and low resolution with respect to the specific application of image retrieval from a dataset. We define the notion of image quality as determined by the success of image retrieval and design a deep convolutional neural network (CNN) to predict this quality. This network is then cascaded with a deep CNN designed for image denoising or super resolution, allowing for optimization of the enhancement CNN to maximize retrieval performance. This framework allows us to couple enhancement to the retrieval problem. We also consider the problem of adapting image features for robust retrieval performance in the presence of distortions. We show through experiments on distorted images of the Oxford and Paris buildings datasets that our algorithms yield improved mean average precision when compared to using enhancement methods that are oblivious to the task of image retrieval.

Item Type: Journal Article
Publication: SIGNAL PROCESSING-IMAGE COMMUNICATION
Publisher: ELSEVIER
Additional Information: The Copyright of this article belongs to the Authors.
Keywords: Image enhancement; Image quality assessment; Deep convolutional neural network; Denoising; Super resolution; Image retrieval
Department/Centre: Division of Electrical Sciences > Electrical Communication Engineering
Division of Electrical Sciences > Electrical Engineering
Date Deposited: 22 Jan 2020 11:18
Last Modified: 01 Jun 2022 11:02
URI: https://eprints.iisc.ac.in/id/eprint/64238

Actions (login required)

View Item View Item