Optimal Server Selection for Straggler Mitigation

Badita, A and Parag, P and Aggarwal, V (2020) Optimal Server Selection for Straggler Mitigation. In: IEEE/ACM Transactions on Networking, 28 (2). pp. 709-721.

PDF iee_acm_tra_net_28-02_709-721_2020.pdf - Published Version Restricted to Registered users only Download (1MB) | Request a copy

Abstract

The performance of large-scale distributed compute systems is adversely impacted by stragglers when the execution time of a job is uncertain. To manage stragglers, we consider a multi-fork approach for job scheduling, where additional parallel servers are added at forking instants. In terms of the forking instants and the number of additional servers, we compute the job completion time and the cost of server utilization when the task processing times are assumed to have a shifted exponential distribution. We use this study to provide insights into the scheduling design of the forking instants and the associated number of additional servers to be started. Numerical results demonstrate orders of magnitude improvement in cost in the regime of low completion times as compared to the prior works.

Item Type:	Journal Article
Publication:	IEEE/ACM Transactions on Networking
Publisher:	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Additional Information:	The copyright of this article belongs to IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Keywords:	Electrical engineering; Software engineering, Completion time; Job completion; Numerical results; Orders of magnitude; Parallel servers; Server selection; Shifted exponential distributions; Task-processing, Scheduling
Department/Centre:	Division of Electrical Sciences > Electrical Communication Engineering
Date Deposited:	19 Jun 2020 09:47
Last Modified:	19 Jun 2020 09:47
URI:	http://eprints.iisc.ac.in/id/eprint/65290

Actions (login required)

View Item