Julunga: A new Large-Scale Distributed Read-Write File Storage System for Cloud Computing Environments

Dewan, Hrishikesh and Hansdah, RC (2018) Julunga: A new Large-Scale Distributed Read-Write File Storage System for Cloud Computing Environments. In: 32nd IEEE International Conference on Advanced Information Networking and Applications (AINA), MAY 16-18, 2018, Krakow, POLAND, pp. 942-951.

PDF Pro_Iee_Int_Con_Adv_Inf_Net_App_311_2018.pdf - Published Version Restricted to Registered users only Download (344kB) | Request a copy

Abstract

We present in this paper the design of a large distributed file storage system called Julunga for cloud computing environments. Julunga is designed for federated data center environments where multiple numbers of data centers across the globe interconnect to each other and present a coherent single system view to end-users. In Julunga, the metadata, the namespace and the data blocks of the files are completely distributed with no hard limits on the number of files that can be accommodated in a single directory. Also, there is no physical limit on the size of a file. Julunga supports file of exabytes size with ease along with the number of concurrent users updating, reading and writing to the same file or a directory. The location of the data blocks of a file is determined by using functions, thus expunging the need for file allocation tables. Many new data structures and algorithms were designed earlier where locality and preferences of users are considered to provide optimal storage locations for files and metadata. We elaborate, in this paper, the design of fundamental building blocks of the distributed storage system and compare it with the designs of the earlier file storage systems.

Item Type:	Conference Paper
Series.:	International Conference on Advanced Information Networking and Applications
Publisher:	IEEE
Additional Information:	32nd IEEE International Conference on Advanced Information Networking and Applications (AINA), Krakow, POLAND, MAY 16-18, 2018
Keywords:	distributed file storage system; distributed metadata; cloud computing; fault-tolerance; load balancing; distributed consensus; agreement
Department/Centre:	Division of Electrical Sciences > Computer Science & Automation
Date Deposited:	29 Jan 2019 09:22
Last Modified:	29 Jan 2019 09:22
URI:	http://eprints.iisc.ac.in/id/eprint/61553

Actions (login required)

View Item