Sequential addition of coded sub-tasks for straggler mitigation

Badita, A and Parag, P and Aggarwal, V (2020) Sequential addition of coded sub-tasks for straggler mitigation. In: 38th IEEE Conference on Computer Communications, INFOCOM 2020, 6-9 July 2020, Toronto; Canada, pp. 746-755.

PDF pro_iee_inf_2020_746-755_2020.pdf - Published Version Restricted to Registered users only Download (403kB) | Request a copy

Abstract

Straggler mitigation can be achieved by redundant computation. In MDS redundancy method, a task is divided into k sub-tasks which are encoded to n coded sub-tasks, such that a task is completed if any k coded sub-tasks are completed. Two important metrics of interest are task completion time, and server utilization cost which is the aggregate completed work by all servers in this duration. We consider a proactive straggler mitigation strategy where n0 out of n coded sub-tasks are started at time 0 while the remaining n - n0 coded sub-tasks are launched when �0 � min(n0, k) of the initial ones finish. The coded sub-tasks are halted when k of them finish. For this flexible forking strategy with multiple parameters, we analyze the mean of two performance metrics for the proposed forking strategy when the random service completion time at each server is independent and distributed identically to a shifted exponential. Our analysis demonstrates that the regime of n0 < k leads to higher mean service completion time and no change in mean server utilization cost as compared to no forking (n0 = n), and is thus not a regime of interest. For n0 � k, we find that there is a tradeoff between the two performance metrics and leads to decrease in mean server utilization cost at the expense of mean service completion time and an efficient choice of the parameters is helpful. © 2020 IEEE.

Item Type:	Conference Paper
Publication:	Proceedings - IEEE INFOCOM
Publisher:	Institute of Electrical and Electronics Engineers Inc.
Additional Information:	The copyright of this article belongs to Institute of Electrical and Electronics Engineers Inc.
Keywords:	Electrical engineering, Completion time; Mitigation strategy; Multiple parameters; Performance metrics; Random services; Redundant computation; Sequential addition; Task completion time, Cost benefit analysis
Department/Centre:	Division of Electrical Sciences > Electrical Communication Engineering
Date Deposited:	21 Oct 2020 10:31
Last Modified:	21 Oct 2020 10:31
URI:	http://eprints.iisc.ac.in/id/eprint/66609

Actions (login required)

View Item