M. Harry, J. Rosario, and A. Choudhary. VIP-FS: A Virtual, Parallel File System for High Performance Parallel and Distributed Computing. In Proceedings of the Ninth International Parallel Processing Symposium, April 1995.  Home/Search   Document Not in Database   Summary   Related Articles   Check

....interface; coordinated access to a file is guaranteed using transactions. 16] discusses PIOUS performance on a DEC Alpha Supercluster using a simulation environment called PioSim. Our approach to selection and placement of I O servers could be added to PIOUS for heterogeneous environments. VIP FS [10] and VIPIOS [3] consider network congestions or data locality, as does our work in [6] Our heuristic selection and placement of I O servers could be used with VIP FS and VIPIOS in distributed environments. 1] describes river, a new data flow programming environment and I O substrate for cluster ....

M. Harry, J. Rosario, and A. Choudhary. VIP-FS: A Virtual, Parallel File System for High Performance Parallel and Distributed Computing. In Proceedings of the Ninth International Parallel Processing Symposium, April 1995.

....12.5 MB sec using MPICH 1.0.11 [MPICH] 1 . As the number of senders and receivers increases, bandwidth per node degrades although the aggregate bandwidth increases. Thus interconnect speed, not disk speed, will often be the limiting factor for parallel I O performance. PIOUS [Moyer94] VIP FS [Harry95] and VIPIOS [Brezany96] provide parallel I O on workstation clusters. However, each of these lacks one or more of the features desired for parallel scientific applications running on a network of workstations: collective I O, special considerations for low message passing bandwidth, better ....

....is a pioneer work in parallel I O on a workstation cluster. PIOUS is a parallel file system with a Unix style file interface; coordinated access to a file is guaranteed using transactions. Our strategies for collective I O and for slow shared media networks could be built on top of PIOUS. VIP FS [Harry95] provides a collective I O interface for scientific applications running in parallel and distributed environments. Their assumed request strategy is designed for distributed systems where the network is a potentially congested shared medium. It reduces the number of I O requests made by all the ....

M. Harry, J. Rosario and A. Choudhary, VIPFS: A Virtual, Parallel File System for High Performance Parallel and Distributed Computing, Proceedings of the Ninth International Parallel Processing Symposium, April 1995.

....ALPHA tmp node10 node11 farm4 giga.lifl.fr ALPHA tmp node11 node20 farm5 giga.lifl.fr ALPHA tmp node20 node21 farm6 giga.lifl.fr ALPHA tmp node21 DISTRIBUTION CYCLIC 1 BLOCK Fig. 3. DPdevice specification distributed memories. Most of the parallel I O libraries like VIPS FS [8] or PANDA [5, 6] associate the distribution to the file and not to the device. They do not provide a virtual parallel device. The program has to manage the file distribution explicitly. With the Unix file system, files are stored on a device according to their directory location. To keep the same ....

Michael Harry and Juan Miguel del Rosario and Alok Choudhary, VIP-FS : A VIrtual, Parallel File System for High Performance Parallel and Distributed Computing, Ninth International Parallel Processing Symposium, April 1995.

....here that our penchant for high level interfaces has led us to stripe data at the chunk level rather than at a disk block level. This from others work, where the arrays were striped across i o nodes in traditional (row major or column major) order according to disk block size [Kotz94b, Kotz95b, del Rosario94] Once a server has made its plan, it assembles its first assigned chunk by sending a request for a logical sub chunk to all the clients that hold a part of its first assigned chunk. Depending on the memory schema and disk schema, a client can receive a request for a sub chunk of array data that ....

....as one can form large orderly contiguous disk i o requests rather than servicing disk i o requests as they arrive in random order. Several parallel file systems and multidimensional array libraries have provided a collective i o interface [Bennett94, Brezany95, Corbett94b, 6 Corbett95, del Rosario94, Karpovich94, Seamons94b, Seligman94] some of them have shown that collective i o provides high performance given appropriate language, compiler and run time system support. Three approaches to i o optimization are discussed in [Kotz94b] traditional caching, two phase i o, and disk directed ....

J. M. del Rosario, M. Harry, A. Choudhary, The Design of VIP-FS: A Virtual, Parallel File System for High Performance Parallel and Distributed Computing, Technical Report SCCS-628, NPAC, Syracuse, NY, May 1994. 8

....Section 3 describes some simulations and their results and Section 4 describes some measurements on a real system. We summarize our conclusions in Section 5. 2 Background There are many different parallel file systems [Kri94, Pie89, FPD93, Roy93, LIN 93, DdR92, CF94, Dib90, DSE88, MS94, HdC95, HER 95] Most, though not all, are designed for machines that have dedicated I O nodes. Most are based on a fairly traditional Unix like interface, in which individual processes make a request to the file system for each piece of the file they read or write. Increasingly common, however, ....

Michael Harry, Juan Miguel del Rosario, and Alok Choudhary. VIP-FS: A virtual, parallel file system for high performance parallel and distributed computing. In Proceedings of the Ninth International Parallel Processing Symposium, April 1995. To appear.

....3) data dependent filtering (Section 4) and working with irregular subsets (Section 5) We present conclusions and a look toward the future in Section 6. 2 Background There are many different parallel file systems [DSE88, Pie89, Dib90, DdR92, Mas92, FPD93, LIN 93, Roy93, CF94, Kri94, MS94, HdC95, HER 95] Most are based on a fairly traditional Unix like interface, in which individual processes make a request to the file system for each piece of the file they read or write. Increasingly common, however, are specialized interfaces to support multidimensional matrices [GL91, Mas92, ....

Michael Harry, Juan Miguel del Rosario, and Alok Choudhary. VIP-FS: A virtual, parallel file system for high performance parallel and distributed computing. In Proceedings of the Ninth International Parallel Processing Symposium, April 1995. To appear.

....If files are automatically striped across all servers, performance can suffer if some servers are slower than others. If the file system allows dynamic allocation of files to servers, our approaches to placing data to minimize contention for network, I O bus, and disk may be helpful. VIP FS [4] provides a collective I O interface for scientific applications running in parallel and distributed environments. Their assumed request strategy is designed for distributed systems where the network is a potentially congested shared medium. It reduces the number of I O requests made by all the ....

M. Harry, J. Rosario, and A. Choudhary. VIP-FS: A Virtual, Parallel File System for High Performance Parallel and Distributed Computing. In Proceedings of the Ninth International Parallel Processing Symposium, April 1995.

....to these libraries. In this paper, we propose a solution to these problems. We provide an outline of the conceptual design of a parallel and distributed I O runtime system, the Virtual Parallel File System (VIP FS) and describe its implementation. For a more detailed discussion of the system, see [11]. Interface Layer PVF Layer Application Process IDD Layer Process Application Layer Network Interface Message Passing Library Daemon P V F S Local File System Figure 1: VIP FS Functional Organization In the next section, we discuss the conceptual design and implementation of VIP FS. In section ....

J. M. del Rosario and M. Harry and A. Choudhary. The Design of VIP-FS: A Virtual, Parallel File System for High Performance Parallel and Distributed Computing. Technical Report SCCS-628, Northeast Parallel Architectures Center (NPAC), May 1994.

....RAMA [84] file system distributes file blocks across disks randomly using a hash function, instead of the usual striped layout. Runtime libraries for parallel I O, such as the Panda Library [104, 105] and the Jovian Library [4] are being developed. Portable parallel file systems such as VIP FS [55], PIOUS [85] and PPFS [60] have been developed recently. Techniques for improving I O performance using collective I O have also been proposed. Two phase I O is a technique for performing collective I O using a runtime library [37, 12] Disk directed I O is a technique for performing collective ....

M. Harry, J. del Rosario, and A. Choudhary. VIP-FS: A Virtual, Parallel File System for High Performance Parallel and Distributed Computing. In Proceedings of the Ninth International Parallel Processing Symposium, April 1995.

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC