Multiprocessor Runtime Support for Fine-Grained Irregular DAGs (1995) [20 citations — 1 self]
Popular Tags
No tags have been applied to this document.
BibTeX | Add To MetaCart
@INPROCEEDINGS{Chong95multiprocessorruntime,author = {Frederic T. Chong and Shamik D. Sharma Y and Eric A. Brewer Z and Joel Saltz X},
title = {Multiprocessor Runtime Support for Fine-Grained Irregular DAGs},
booktitle = {In Rajiv K. Kalia and Priya Vashishta, editors, Toward Teraflop Computing and New Grand Challenge Applications},
year = {1995},
publisher = {Nova Science Publishers}
}
Years of Citing Articles
Abstract:
We examine multiprocessor runtime support for ne-grained, irregular directed acyclic graphs (DAGs) such as those that arise from sparse-matrix triangular solves. We conduct our experiments on the CM-5, whose lower latencies and active-message support allow us to achieve unprecedented speedups for a general multiprocessor. Where as previous implementations have maximum speedups of less than 4 on even simple banded matrices, we are able to obtain scalable performance on extremely small and irregular problems. On a matrix with only 5300 rows, we are able to achieve scalable performance with a speedup of 34 for 128 processors, resulting in an absolute performance of over 33 million double-precision oating point operations per second. We achieve these speedups with non-matrix-speci c methods which are applicable to any DAG. We compare a range of run-time preprocessed and dynamic approaches on matrices from the Harwell-Boeing benchmark set. Although precomputed data distributions and execution schedules produce the best performance, we nd that it is challenging to keep their cost low enough to make them worthwhile on small, ne-grained problems. Additionally, we nd that a policy of frequent network polling can reduce communication overhead by a factor of three over the standard CM-5 policies. We present a detailed study of runtime overheads and demonstrate that send and receive processor overhead still dominate these applications on the CM-5. We conclude that these applications would highly bene t from architectural support for low-overhead communication.
