Auto-scaling Resources for Cloud Applications using Reinforcement learning

John, I and Sreekantan, A and Bhatnagar, S (2019) Auto-scaling Resources for Cloud Applications using Reinforcement learning. In: 2019 Grace Hopper Celebration India (GHCI), 6-8 Nov. 2019, Bangalore, India.

PDF GRA_HOP_CEL_2019.pdf - Published Version Restricted to Registered users only Download (705kB) | Request a copy

Abstract

Elasticity is an attractive feature of cloud computing, that enables increasing or decreasing the resources allocated to an application in order to adapt to changes in the workload. To efficiently utilize elasticity of clouds, the decisions on resource allocation need to be made algorithmically, adaptively and in real-Time. The resource provisioning algorithm must also consider the performance requirements of the application as specified in the Service Level Agreement between the cloud provider and the client. In this paper, we present a reinforcement learning based algorithm that addresses the issues of slow convergence and lack of scalability in classical approaches such as Q-learning. We use the technique of adaptive tile coding and workload forecasting to ensure efficient utilization of resources. The effectiveness of the proposed method as compared to static, threshold-based and other reinforcement learning based allocation schemes is established with experiments on the Cloudsim platform. © 2019 IEEE.

Item Type:	Conference Paper
Publication:	2019 Grace Hopper Celebration India, GHCI 2019
Publisher:	Institute of Electrical and Electronics Engineers Inc.
Additional Information:	cited By 0; Conference of 2019 Grace Hopper Celebration India, GHCI 2019 ; Conference Date: 6 November 2019 Through 8 November 2019; Conference Code:159444
Keywords:	Elasticity; Hoppers, Classical approach; Cloud applications; Cloud providers; Performance requirements; Service Level Agreements; Slow convergences; Tile coding; Utilization of resources, Reinforcement learning
Department/Centre:	Division of Electrical Sciences > Computer Science & Automation
Date Deposited:	28 Oct 2020 07:42
Last Modified:	28 Oct 2020 07:42
URI:	http://eprints.iisc.ac.in/id/eprint/65661

Actions (login required)

View Item