Computing BLAS Level-2 Operations on Workstation Clusters Using the Divisible Load Paradigm

Ghose, D and Kim, Hyoung Joong (2005) Computing BLAS Level-2 Operations on Workstation Clusters Using the Divisible Load Paradigm. In: Mathematical and Computer Modelling, 41 (1). pp. 49-70.

PDF Computing_BLAS_Level-2_Operations.pdf Restricted to Registered users only Download (1MB) | Request a copy

Abstract

The problem of executing large BLAS (basic linear algebra subprograms) Level-2 operations, such as matrix-vector products, in a network-based distributed computing environment composed of a bus-oriented workstation cluster is considered. Unlike previous contributions, we take into account the fact that workstations, as against mainframe computers, are not equipped with communication coprocessors or front-ends, precluding any possibility of communication off-loading. Communication delays, which are significant in workstation clusters due to limited bandwidth availability, are specifically accounted for. This aspect is generally ignored in most performance analysis of parallel computing systems. The important contribution of this study is to show that the optimal load partitioning, and the subsequent performance of the network, depends critically on network bandwidth, computing capacity, and load characteristics. We design load distribution strategies for three cases (no communication, broadcast communication, and multicast communication) based on closed-form solutions of the optimal load partitioning problem and also present extensive and complete asymptotic analysis with respect to several parameters of the load and the system. Necessary and sufficient conditions for feasible and optimal load sharing are also derived. A trade-off study between the optimal number of workstations and the bandwidth of the bus is also presented.

Item Type:	Journal Article
Publication:	Mathematical and Computer Modelling
Publisher:	Elsevier
Additional Information:	Copyright of this article belongs to Elsevier.
Keywords:	Divisible loads;BLAS Level-2 operations;Matrix-vector products;Optimal load distribution;Load partitioning
Department/Centre:	Division of Mechanical Sciences > Aerospace Engineering(Formerly Aeronautical Engineering)
Date Deposited:	22 Feb 2007
Last Modified:	19 Sep 2010 04:34
URI:	http://eprints.iisc.ac.in/id/eprint/9448

Actions (login required)

View Item