MetaCartSign in to MyCiteSeer

Include Citations | Advanced Search | Help

Include Citations | Advanced Search | Help

  Submitted to Euro-Par 2000. Design and Evaluation of a Compiler-directed Collective I/O Technique

Download:
pdf | ps
by Gokhan Memik, Mahmut T. K, Alok Choudhary
http://www.ee.ucla.edu/~memik/papers/selcio.ps
Add To MetaCart

Abstract:

Current approaches to parallel I/O demand extensive user effort to obtain acceptable performance. This is in part due to difficulties in understanding the characteristics of a wide variety of I/O devices and in part due to inherent complexity of I/O software. While parallel I/O systems provide users with environments where large datasets can be shared between parallel processors, the ultimate performance of I/Ointensive codes depends largely on the relation between data access patterns and storage patterns of data in files and on disks. In cases where access patterns and storage patterns match, we can exploit parallel I/O hardware by allowing each processor to perform independent parallel I/O. To handle the cases in which data access patterns and storage patterns do not match, several I/O optimization techniques have been developed in recent years. Collective I/O is such an optimization technique that enables each processor to do I/O on behalf of

Citations

222 Disk-directed I/O for MIMD Multiprocessors – Kotz - 1994
151 Demonstration of Automatic Data Partitioning Techniques for Parallelizing Compilers on Multicomputers – Gupta, Banerjee - 1992
142 Branch prediction for free – Ball, Larus - 1993
119 The Galley Parallel File System – Nieuwejaar, Kotz - 1996
85 A linear algebra framework for static hpf code distribution – Ancourt, Coelho, et al. - 1993
79 PASSION: Parallel and scalable software for input-output – Choudhary, Bordawekar, et al. - 1994
71 The Omega Library Interface Guide – Kelly, Maslov, et al. - 1996
70 Parallel access to files in the Vesta file system – Corbett, Feitelson, et al. - 1993
69 High performance I/O for parallel computers: Problems and prospects – DelRasario, Choudhary - 1994
54 Procedure Placement Using Temporal Ordering Information – GLOY, BLACKWELL, et al. - 1997
35 Interprocedural Analysis for Parallelization – Hall, Murphy, et al. - 1995
16 Automatic computation and data decomposition for multiprocessors – Anderson - 1997
16 Paragon parallel file system – Rullman
11 Data-distribution support on distributed-shared memory multiprocessors – Chandra, Chen, et al. - 1997
9 Collective Parallel I/O – Nitzberg - 1995
4 A case for using MPI's derived data types to improve I/O performance – Thakur, Gropp, et al. - 1998
2 et al. Overview of the MPI-IO parallel I/O interface – Corbett - 1995