Latency Analysis for Distributed Coded Storage Systems

Badita, Ajay and Parag, Parimal and Chamberland, Jean-Francois (2019) Latency Analysis for Distributed Coded Storage Systems. In: IEEE TRANSACTIONS ON INFORMATION THEORY, 65 (8). pp. 4683-4698.

PDF IEEE_TRA_INF_THE_65-8_4683-4698_2019.pdf - Published Version Restricted to Registered users only Download (1MB) | Request a copy

Abstract

Modern communication and computation systems often consist of large networks of unreliable nodes. Still, it is well known that such systems can provide aggregate reliability via redundancy. While duplication may increase the load on a system, it can lead to significant performance improvement when combined with the judicious management of extra system resources. Prime examples of this abstract paradigm include multi-path routing across communication networks, content access from multiple caches in delivery networks, and master/slave computations on compute clusters. Several recent contributions in the area establish bounds on the performance of redundant systems, characterizing the latency-redundancy tradeoff under specific load profiles. Following a similar line of research, this paper introduces new analytical bounds and approximation techniques for the latency-redundancy tradeoff for a range of system loads and a class of symmetric redundancy schemes, under the assumption of Poisson arrivals, exponential service-rates, and fork-join scheduling policy. The proposed approach can be employed to efficiently approximate the latency distribution of a queueing system at equilibrium. Various metrics can subsequently be derived for this system, including the mean and variance of the sojourn time, and the tail decay rate of the stationary distribution. This paper also establishes the stability region in terms of arrival rates for redundant systems with certain symmetries. Finally, it offers selection guidelines for design parameters to provide latency guarantees based on the proposed approximations. Findings are substantiated by numerical results.

Item Type:	Journal Article
Publication:	IEEE TRANSACTIONS ON INFORMATION THEORY
Publisher:	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Additional Information:	Copyright of this article belongs to IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Keywords:	Data storage systems; forward error correction; content distribution networks; distributed information systems; Markov processes; equilibrium distribution; queueing analysis
Department/Centre:	Division of Electrical Sciences > Electrical Communication Engineering
Date Deposited:	10 Nov 2019 08:20
Last Modified:	10 Nov 2019 08:20
URI:	http://eprints.iisc.ac.in/id/eprint/63398

Actions (login required)

View Item