Scalability of Parallel Algorithms for Matrix Multiplication (1991)
| Venue: | in Proc. of Int. Conf. on Parallel Processing |
| Citations: | 19 - 0 self |
BibTeX
@INPROCEEDINGS{Gupta91scalabilityof,
author = {Anshul Gupta and Vipin Kumar},
title = {Scalability of Parallel Algorithms for Matrix Multiplication},
booktitle = {in Proc. of Int. Conf. on Parallel Processing},
year = {1991},
pages = {115--123}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
A number of parallel formulations of dense matrix multiplication algorithm have been developed. For arbitrarily large number of processors, any of these algorithms or their variants can provide near linear speedup for sufficiently large matrix sizes and none of the algorithms can be clearly claimed to be superior than the others. In this paper we analyze the performance and scalability of a number of parallel formulations of the matrix multiplication algorithm and predict the conditions under which each formulation is better than the others. We present a parallel formulation for hypercube and related architectures that performs better than any of the schemes described in the literature so far for a wide range of matrix sizes and number of processors. The superior performance and the analytical scalability expressions for this algorithm are verified through experiments on the Thinking Machines Corporation's CM-5 TM y parallel computer for up to 512 processors. We show that special har...
