DMCA
MPI's reduction operations in clustered wide area systems (1999)
Cached
Download Links
| Venue: | In Proc. MPIDC'99, Message Passing Interface Developer's and User's Conference |
| Citations: | 16 - 3 self |
BibTeX
@INPROCEEDINGS{Kielmann99mpi'sreduction,
author = {Thilo Kielmann and Rutger F. H. Hofman and Henri E. Bal and Aske Plaat and Raoul A. F. Bhoedjang},
title = {MPI's reduction operations in clustered wide area systems},
booktitle = {In Proc. MPIDC'99, Message Passing Interface Developer's and User's Conference},
year = {1999},
pages = {43--52}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Abstract — The emergence of meta computers and computational grids makes it feasible to run parallel programs on large-scale, geographically distributed computer systems. Writing parallel applications for such systems is a challenging task which may require changes to the communication structure of the applications. MPI’s collective operations (such as broadcast and reduce) allow for some of these changes to be hidden from the applications programmer. We have developed MAGPIE, a library of collective communication operations optimized for wide area systems. MAGPIE’s algorithms are designed to send the minimal amount of data over the slow wide area links, and to only incur a single wide area latency. This paper discusses MPI’s collective reduction operations. Compared to systems that do not take the topology into account, such as MPICH, large performance improvements are possible. For larger messages, best performance is achieved when the reduction function is associative. On moderate cluster sizes, using a wide area latency of 10 millisecond and a bandwidth of 1 MByte/s, operations execute up to 8 times faster than MPICH; application kernels improve by up to a factor of 3. Due to the structure of our algorithms, the advantage increases for higher wide area latencies. I.
Keyphrases
reduction operation clustered wide area system wide area latency minimal amount magpie algorithm application kernel slow wide area link meta computer single wide area latency large performance improvement moderate cluster size computational grid parallel program reduction function communication structure computer system mpi collective reduction operation wide area system parallel application collective communication operation mpi collective operation
