Low-Latency Communication on the IBM RISC System/6000 SP y
|
Abstract:
The IBM SP is one of the most powerful commercial MPPs, yet, in spite of its fast processors and high network bandwidth, the SP's communication latency is inferior to older machines such as the TMC CM-5 or Meiko CS-2. This paper investigates the use of Active Messages (AM) communication primitives as an alternative to the standard message passing in order to reduce communication overheads and to offer a good building block for higher layers of software. The first part of this paper describes an implementation of Active Messages (SP AM) which is layered directly on top of the SP's network adapter (TB2). With comparable bandwidth, SP AM's low overhead yields a round-trip latency that is 40% lower than IBM MPL's. The second part of the paper demonstrates the power of AM as a communication substrate by layering Split-C as well as MPI over it. Split-C benchmarks are used to compare the SP to other MPPs and show that low message overhead and high throughput compensate for SP's high network latency. The MPI implementation is based on the freely available MPICH version and achieves performance equivalent to IBM's MPI-F on the NAS benchmarks. 1
Citations
| 961 | Active messages: a mechanism for integrated communication and computation – Eicken, Culler, et al. - 1992 |
| 553 | U-Net: A User-level Network Interface for Parallel and Distributed Computing – Eicken, Basu, et al. - 1995 |
| 48 | Experience with Active Messages on the Meiko CS-2 – Schauser, Scheiman - 1995 |
| 39 | Generic Active Message Interface Specification – Culler, Keeton, et al. - 1994 |
| 17 | HPAM: An Active Message Layer for a Network of Workstations – Martin - 1994 |
| 15 | MPI programming environment for IBM SP1/SP2 – Franke, Wu, et al. - 1995 |
| 3 | Stunkel et al., The SP2 Communication Subsystem – B - 1994 |
| 2 | der Wijngaart, The NAS Parallel Benchmarks – Bailey, Harris, et al. - 1995 |
| 1 | Active Messages: A Mechanism for Integrated Communication andComputation – Eicken, Culler, et al. - 1992 |
