Monga, SK and Ramachandra, SK and Simmhan, Y (2019) ElfStore: A resilient data storage service for federated edge and fog resources. In: 26th IEEE International Conference on Web Services, ICWS 2019, 8 - 13 July 2019, Milan, pp. 336-345.
|
PDF
ICWAS_2019.pdf - Published Version Download (1MB) | Preview |
Abstract
Edge and fog computing have grown popular as IoT deployments become wide-spread. While application composition and scheduling on such resources are being explored, there exists a gap in a distributed data storage service on the edge and fog layer, instead depending solely on the cloud for data persistence. Such a service should reliably store and manage data on fog and edge devices, even in the presence of failures, and offer transparent discovery and access to data for use by edge computing applications. Here, we present ElfStore, a first-of-its-kind edge-local federated store for streams of data blocks. It uses reliable fog devices as a super-peer overlay to monitor the edge resources, offers federated metadata indexing using Bloom filters, locates data within 2-hops, and maintains approximate global statistics about the reliability and storage capacity of edges. Edges host the actual data blocks, and we use a unique differential replication scheme to select edges on which to replicate blocks, to guarantee a minimum reliability and to balance storage utilization. Our experiments on two IoT virtual deployments with 20 and 272 devices show that ElfStore has low overheads, is bound only by the network bandwidth, has scalable performance, and offers tunable resilience.
| Item Type: | Conference Paper |
|---|---|
| Publication: | Proceedings - 2019 IEEE International Conference on Web Services, ICWS 2019 - Part of the 2019 IEEE World Congress on Services |
| Publisher: | Institute of Electrical and Electronics Engineers Inc. |
| Additional Information: | The copyright for this article belongs to the Authors. |
| Keywords: | Digital storage; Distributed database systems; Edge computing; File organization; Fog; Fog computing; Peer to peer networks; Web services; Websites, Application composition; Computing applications; Distributed data storages; Distributed file systems; Peer to peer; Persistent streams; Scalable performance; Storage utilization, Internet of things |
| Department/Centre: | Division of Interdisciplinary Sciences > Computational and Data Sciences |
| Date Deposited: | 23 Oct 2022 06:44 |
| Last Modified: | 23 Oct 2022 06:44 |
| URI: | https://eprints.iisc.ac.in/id/eprint/77503 |
Actions (login required)
 |
View Item |
