Case study on: Scalability of preprocessing procedure of remote sensing in Hadoop

Roy, Sukanta and Gupta, Sanchit and Omkar, S N (2017) Case study on: Scalability of preprocessing procedure of remote sensing in Hadoop. In: International Conference on Computational Science (ICCS), JUN 12-14, 2017, Zurich, SWITZERLAND, pp. 1672-1681.

PDF Int_Con_Com_Sci_108_1672_2017.pdf - Published Version Restricted to Registered users only Download (1MB) | Request a copy

Abstract

In the field of remote sensing, the recent increase in image sizes has drawn a significant attention on processing these files in a fault tolerant distributed architecture In this regard, Apache Hadoop architecture becomes an efficient MapReduce model. In the satellite image processing, large scale images put the limitation on the single computer analysis. Whereas, Hadoop Distributed File System (HDFS) gives a remarkable solution to handle these files through its inherent data parallelism technique. This architecture is well suited for structured data, as the structured data can be equally distributed easily and access the relevant data. Images are considered as unstructured matrix data in Hadoop and the whole part of the data is relevant for any processing. It leads to a challenge to maintain the data locality with the equal data distribution. In this paper, we introduce a novel technique, which decrypts the standard format of raw satellite data and localizes the distributed preprocessing step on the equal split of datasets in Hadoop. For this purpose, a suitable modification on the Hadoop interface is proposed. For the case study on the scalability of preprocessing steps, Synthetic Aperture Radar (SAR) and Multispectral (MS), are used in a distributed environment. (C) 2017 The Authors. Published by Elsevier B.V.

Item Type:	Conference Proceedings
Series.:	Procedia Computer Science
Additional Information:	Copy right for this article belongs to the ELSEVIER SCIENCE BV, SARA BURGERHARTSTRAAT 25, PO BOX 211, 1000 AE AMSTERDAM, NETHERLANDS
Department/Centre:	Division of Mechanical Sciences > Aerospace Engineering(Formerly Aeronautical Engineering)
Date Deposited:	12 Aug 2017 06:55
Last Modified:	12 Aug 2017 06:55
URI:	http://eprints.iisc.ac.in/id/eprint/57630

Actions (login required)

View Item