ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Large improvements in application throughput of long-running multi-component applications using batch grids

Sundari, Sivagama M. and Vadhiyar, Sathish S. and Nanjundiah, Ravi S. (2012) Large improvements in application throughput of long-running multi-component applications using batch grids. In: CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 24 (15). pp. 1775-1791.

[img]
Preview
PDF
con_com_pra_exp_24_1775_2012.pdf - Published Version

Download (2MB) | Preview
Official URL: http://dx.doi.org/10.1002/cpe.1878

Abstract

Computational grids with multiple batch systems (batch grids) can be powerful infrastructures for executing long-running multi-component parallel applications. In this paper, we evaluate the potential improvements in throughput of long-running multi-component applications when the different components of the applications are executed on multiple batch systems of batch grids. We compare the multiple batch executions with executions of the components on a single batch system without increasing the number of processors used for executions. We perform our analysis with a foremost long-running multi-component application for climate modeling, the Community Climate System Model (CCSM). We have built a robust simulator that models the characteristics of both the multi-component application and the batch systems. By conducting large number of simulations with different workload characteristics and queuing policies of the systems, processor allocations to components of the application, distributions of the components to the batch systems and inter-cluster bandwidths, we show that multiple batch executions lead to 55% average increase in throughput over single batch executions for long-running CCSM. We also conducted real experiments with a practical middleware infrastructure and showed that multi-site executions lead to effective utilization of batch systems for executions of CCSM and give higher simulation throughput than single-site executions. Copyright (c) 2011 John Wiley & Sons, Ltd.

Item Type: Journal Article
Publication: CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE
Publisher: WILEY-BLACKWELL
Additional Information: Copyright for this article belongs to WILEY-BLACKWELL
Keywords: grids; co-allocation; long-running applications; multi-component applications; climate modeling; CCSM; throughput; batch systems; queue waiting times
Department/Centre: Division of Interdisciplinary Sciences > Supercomputer Education & Research Centre
Division of Mechanical Sciences > Centre for Atmospheric & Oceanic Sciences
Date Deposited: 10 Dec 2012 09:19
Last Modified: 10 Dec 2012 09:21
URI: http://eprints.iisc.ac.in/id/eprint/45227

Actions (login required)

View Item View Item