Bristrita: Namespace and metadata distribution in large-scale distributed cloud storage systems

Dewan, H and Hansdah, R (2018) Bristrita: Namespace and metadata distribution in large-scale distributed cloud storage systems. In: 3rd IEEE International Conference on Smart Cloud, SmartCloud 2018, 21 - 23 September 2018, New York, pp. 116-124.

PDF IEEE_SmartCloud_116-124_2018.pdf - Published Version Restricted to Registered users only Download (326kB) | Request a copy

Abstract

The volume of data being processed today in various applications is phenomenally enormous. While the computational speed of the processors to process these data has increased many folds since the last few decades, the storage systems designs to handle the processing of these data do not have adequate features. A crucial entity to support processing of such enormous volume of data is a file system. Until, a few years back, most of the file system designs relied on a single metadata and namespace server and the emergence of distributed metadata and namespace designs is seen only recently. However, most of these distributed namespace designs are based on cluster-based systems where the underlying environment is predictive and can be controlled. In this paper, we present Bristrita, a distributed file system metadata and namespace design layered on top of a peer-to-peer network. Bristrita allows varieties of file system operations, supports files with unlimited size with no limit on the depth of the namespace tree, the number of files in each directory and is resilient to failures. The paper includes the design decisions, the algorithms, and their analysis and shows that it can be used to support users across multiple different geographical regions encompassing a wide area network of computing nodes, storage clusters with support for ad-hoc nodes joining and leaving the network.

Item Type:	Conference Paper
Publication:	Proceedings - 3rd IEEE International Conference on Smart Cloud, SmartCloud 2018
Publisher:	Institute of Electrical and Electronics Engineers Inc.
Additional Information:	The copyright for this article belongs to the IEEE.
Keywords:	Cloud computing; Data handling; Digital storage; Fault tolerance; File organization; Geographical regions; Metadata; Peer to peer networks; Resource allocation; Systems analysis; Wide area networks, Cluster-based systems; Computational speed; Design decisions; Distributed clouds; Distributed file systems; Distributed metadata; File storage; Storage systems, Distributed computer systems
Department/Centre:	Division of Electrical Sciences > Computer Science & Automation
Date Deposited:	03 Aug 2022 06:08
Last Modified:	03 Aug 2022 06:08
URI:	https://eprints.iisc.ac.in/id/eprint/75190

Actions (login required)

View Item