Sundari, Sivagama M. and Vadhiyar, Sathish S. and Nanjundiah, Ravi S. (2012) Large improvements in application throughput of long-running multi-component applications using batch grids. In: CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 24 (15). pp. 1775-1791.
|
PDF
con_com_pra_exp_24_1775_2012.pdf - Published Version Download (2MB) | Preview |
Abstract
Computational grids with multiple batch systems (batch grids) can be powerful infrastructures for executing long-running multi-component parallel applications. In this paper, we evaluate the potential improvements in throughput of long-running multi-component applications when the different components of the applications are executed on multiple batch systems of batch grids. We compare the multiple batch executions with executions of the components on a single batch system without increasing the number of processors used for executions. We perform our analysis with a foremost long-running multi-component application for climate modeling, the Community Climate System Model (CCSM). We have built a robust simulator that models the characteristics of both the multi-component application and the batch systems. By conducting large number of simulations with different workload characteristics and queuing policies of the systems, processor allocations to components of the application, distributions of the components to the batch systems and inter-cluster bandwidths, we show that multiple batch executions lead to 55% average increase in throughput over single batch executions for long-running CCSM. We also conducted real experiments with a practical middleware infrastructure and showed that multi-site executions lead to effective utilization of batch systems for executions of CCSM and give higher simulation throughput than single-site executions. Copyright (c) 2011 John Wiley & Sons, Ltd.
| Item Type: | Journal Article |
|---|---|
| Publication: | CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE |
| Publisher: | WILEY-BLACKWELL |
| Additional Information: | Copyright for this article belongs to WILEY-BLACKWELL |
| Keywords: | grids; co-allocation; long-running applications; multi-component applications; climate modeling; CCSM; throughput; batch systems; queue waiting times |
| Department/Centre: | Division of Interdisciplinary Sciences > Supercomputer Education & Research Centre Division of Mechanical Sciences > Centre for Atmospheric & Oceanic Sciences |
| Date Deposited: | 10 Dec 2012 09:19 |
| Last Modified: | 10 Dec 2012 09:21 |
| URI: | http://eprints.iisc.ac.in/id/eprint/45227 |
Actions (login required)
 |
View Item |
