ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs

Prabhakar, K Ram and Srikar, V Sai and Babu, R Venkatesh (2017) DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs. In: 16th IEEE International Conference on Computer Vision, ICCV 2017, 22 - 29 October 2017, Venice, pp. 4724-4732.

[img]
Preview
PDF
ICCV_2017_4724-4732_2017.pdf - Published Version

Download (1MB) | Preview
Official URL: https://doi.org/10.1109/ICCV.2017.505

Abstract

We present a novel deep learning architecture for fusing static multi-exposure images. Current multi-exposure fusion (MEF) approaches use hand-crafted features to fuse input sequence. However, the weak hand-crafted representations are not robust to varying input conditions. Moreover, they perform poorly for extreme exposure image pairs. Thus, it is highly desirable to have a method that is robust to varying input conditions and capable of handling extreme exposure without artifacts. Deep representations have known to be robust to input conditions and have shown phenomenal performance in a supervised setting. However, the stumbling block in using deep learning for MEF was the lack of sufficient training data and an oracle to provide the ground-truth for supervision. To address the above issues, we have gathered a large dataset of multi-exposure image stacks for training and to circumvent the need for ground truth images, we propose an unsupervised deep learning framework for MEF utilizing a no-reference quality metric as loss function. The proposed approach uses a novel CNN architecture trained to learn the fusion operation without reference ground truth image. The model fuses a set of common low level features extracted from each image to generate artifact-free perceptually pleasing results. We perform extensive quantitative and qualitative evaluation and show that the proposed technique outperforms existing state-of-the-art approaches for a variety of natural images.

Item Type: Conference Paper
Publisher: Institute of Electrical and Electronics Engineers Inc.
Additional Information: The copyright for this article belongs to the Authors.
Department/Centre: Division of Interdisciplinary Sciences > Computational and Data Sciences
Date Deposited: 07 Jun 2022 05:31
Last Modified: 07 Jun 2022 05:31
URI: https://eprints.iisc.ac.in/id/eprint/73216

Actions (login required)

View Item View Item