DMCA
Communication Across Fault-Containment Firewalls on the SGI Origin
| Citations: | 1 - 0 self |
BibTeX
@MISC{Ghosh_communicationacross,
author = {Kaushik Ghosh and et al.},
title = { Communication Across Fault-Containment Firewalls on the SGI Origin},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Scalability and reliability are inseparable in high-performance computing. Fault-isolation through hardware is a popular means of providing reliability. Unfortunately, such isolation also increases communication latencies: typically, one has to drop into and out of the kernel to communicate between failure domains. On the other hand, relaxing fault isolation domains allows e cient communication, but at the risk of failure propagation, and thus reduced reliability. We are concerned with nding a middle ground between these extremes. We rst review a few salient aspects of the SGI Origin-2000 architecture, mentioning the hardware features germane to e cient communication, and building protection- rewalls. Then, we describe amechanism for risk-free, point-to-point communication between processes on distinct failure domains. Quoting performance numbers, we show that the overheads of crossing domains render this mechanism unattractive for small messages. To address this issue, we describe amechanism for controlled opening of the rewalls, thereby achieving explicit inter-partition shared-memory for communication. We describe the kernel software that addresses the resulting reliability issues, and discuss how familiar IPC mechanisms such as MPI and SysV shared-memory can use the explicit sharedmemory to advantage. Finally, based on the lessons learnt, we discuss some future directions, and draw concluding remarks.
Keyphrases
fault-containment firewall sgi origin cient communication high-performance computing failure propagation small message sysv shared-memory middle ground communication latency failure domain point-to-point communication explicit inter-partition shared-memory explicit sharedmemory familiar ipc mechanism performance number fault isolation controlled opening kernel software building protection rewalls popular mean future direction sgi origin-2000 architecture salient aspect resulting reliability issue distinct failure domain
