Deep Image Inpainting with Region Prediction at Hierarchical Scales

Chakraborty, Souradeep and Kundu, Jogendra Nath and Babu, Venkatesh R (2016) Deep Image Inpainting with Region Prediction at Hierarchical Scales. In: 10th Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP), DEC 18-22, 2016, Tamkang Univ, Taipei, TAIWAN.

PDF 2016_Ind_Con_Com_Vis_Gra_Ima_Pro.pdf - Published Version Restricted to Registered users only Download (658kB) | Request a copy

Abstract

In this paper, we propose a CNN based method for image inpainting, which utilizes the inpaintings generated at different hierarchical resolutions. Firstly, we begin with the prediction of the missing image region with larger contextual information at the lowest resolution using deconv layers. Next, we refine the predicted region at greater hierarchical scales by imposing gradually reduced contextual information surrounding the predicted region by training different CNNs. Thus, our method not only utilizes information from different hierarchical resolutions but also intelligently leverages the context information at different hierarchy to produce better inpainted image. The individual models are trained jointly, using loss functions placed at intermediate layers. Finally, the CNN generated image region is sharpened using the unsharp masking operation, followed by intensity matching with the contextual region, to produce visually consistent and appealing inpaintings with more prominent edges. Comparison of our method with well-known inpainting methods, on the Caltech 101 objects dataset, demonstrates the quantitative and qualitative strengths of our method over the others.

Item Type:	Conference Proceedings
Additional Information:	Copy right for this article belongs to the ASSOC COMPUTING MACHINERY, 1515 BROADWAY, NEW YORK, NY 10036-9998 USA
Department/Centre:	Division of Interdisciplinary Sciences > Supercomputer Education & Research Centre
Date Deposited:	15 Jul 2017 07:34
Last Modified:	15 Jul 2017 07:34
URI:	http://eprints.iisc.ac.in/id/eprint/57424

Actions (login required)

View Item