The Message Passing Interface (MPI) can be used as a portable, high-performance programming model for wide-area computing systems. The wide-area environment introduces challenging problems for the MPI implementor, due to the heterogeneity of both the underlying physical infrastructure and the software environment at different sites. In this article, we describe an MPI implementation that incorporates solutions to these problems. This implementation has been constructed by extending the Argonne MPICH implementation of MPI to use communication services provided by the Nexus communication library and authentication, resource allocation, process creation/management, and information services provided by the I-Soft system (initially) and the Globus metacomputing toolkit (work in progress). Nexus provides multimethod communication mechanisms that allow multiple communication methods to be used in a single computation with a uniform interface; I-Soft and Globus provided standard authentication, resource management, and process management mechanisms. We describe how these various mechanisms are supported in the Nexus implementation of MPI and present performance results for this implementation on multicomputers and networked systems. We also discuss how more advanced services provided by the Globus metacomputing toolkit are being used to construct a second-generation wide-area MPI. 1
|
1187
|
Globus: A Metacomputing Infrastructure Toolkit
– Foster, Kesselman
- 1997
|
|
739
|
Using MPI: Portable Parallel Programming with the Message Passing Interface, 2nd edition
– Gropp, Lusk, et al.
- 1999
|
|
499
|
A highperformance, portable implementation of the MPI Message-Passing Interface standard
– Gropp, Lusk, et al.
- 1996
|
|
294
|
A Resource Management Architecture for Metacomputing Systems
– Czajkowski
- 1998
|
|
291
|
High Performance Messaging on Workstations: Illinois Fast Messages (FM) for Myrinet
– Pakin, Lauria, et al.
- 1995
|
|
207
|
The Nexus approach to integrating multithreading and communication
– Foster, Kesselman, et al.
- 1996
|
|
201
|
A directory service for configuring high-performance distributed computations
– Fitzgerald, Foster, et al.
|
|
200
|
Dynamically forecasting network performance using the network weather service
– Wolski
- 1998
|
|
125
|
J.C.: The CAVE: Audio Visual Experience Automatic Virtual Environment
– Cruz-Neira, Sandin, et al.
- 1992
|
|
110
|
Monitors, Message, and Clusters: The p4 Parallel Programming System
– Butler, Lusk
- 1994
|
|
74
|
Culler Active Message Applications Programming Interface and Communication Subsystem Organization
– Mainwaring, E
- 1996
|
|
73
|
Managing Multiple Communication Methods in Highperformance Networked Computing Systems
– Foster, Geisler, et al.
- 1997
|
|
64
|
Metasystems: An approach combining parallel processing and heterogeneous distributed computing systems
– Grimshaw, West, et al.
- 1994
|
|
55
|
PVM: Parallel virtual machine--A user's guide and tutorial for networked parallel computing
– Geist, Beguelin, et al.
- 1994
|
|
45
|
Overview of the I-WAY: Wide area visual supercomputing
– DeFanti, Foster, et al.
- 1996
|
|
45
|
ECO: Efficient collective operations for communication on heterogeneous networks
– Lowekamp, Beguelin
- 1999
|
|
29
|
An abstract device definition to support the implementation of a high-level message-passing interface
– Gropp, Lusk
- 1993
|
|
26
|
A high-performance MPI implementation on a sharedmemory vector supercomputer
– Gropp, Lusk
- 1997
|
|
26
|
Near-Real-Time Satellite Image Processing: Metacomputing in CC
– Lee, Kesselman, et al.
- 1996
|
|
22
|
Mpich working note: Creating a new mpich device using the channel interface
– Gropp, Lusk
|
|
20
|
The Nexus Approach toIntegrating Multithreading and Communication
– Foster, Kesselman, et al.
- 1996
|
|
17
|
MPI on the I-WAY: A wide-area, multimethod implementation of the Message Passing Interface
– Foster, Geisler, et al.
- 1996
|
|
15
|
Software infrastructure for the I-WAY metacomputing experiment. Concurrency: Practice & Experience
– Foster, Geisler, et al.
|
|
15
|
Shared Memory NUMA Programming on I-WAY
– Nieplocha, Harrison
- 1996
|
|
14
|
eds.). Computational Grids: The Future of High Performance Distributed Computing
– Foster, Kesselman
- 1998
|
|
14
|
The Globus Project: A Progress Report
– Foster, Kesselman
- 1998
|
|
14
|
Galaxies collide on the I-WAY: An example of heterogeneous wide-area collaborative supercomputing
– Norman, Beckman, et al.
- 1996
|
|
11
|
A Directory Service for Con guring High-Performance Distributed Computations
– Fitzgerald, Foster, et al.
- 1997
|
|
11
|
he LDAP Application Program Interface
– Howes, Smith
- 1995
|
|
4
|
An abstract device de nition to support the implementation of a high-level point-to-point message-passing interface
– Gropp, Lusk
- 1994
|
|
3
|
PVMPI provides interoperability between MPI implementations
– Fagg, Dongarra, et al.
- 1997
|
|
1
|
ECO: E cient collective operations for communication on heterogeneous networks
– Lowekamp, Beguelin
- 1997
|
|
