David Kotz and Nils Nieuwejaar. Flexibility and performance of parallel file systems. ACM Operating Systems Review, 30(2):63-73, April 1996.  Home/Search   Document Details and Download   Summary   Related Articles   Check

....the programmer to provide hints . Finally, it may be possible for the file system or compiler to detect commonly used patterns of file accesses and prefetch based on this detection. Data in the applications studied often consists of very large arrays with one more more dimensions. File systems [8, 20, 26, 30, 41, 40, 42] attempt to chose the best data layout for particular applications. They use the information gathered by the studies of applications and sometimes hints provided by the programmers. Di#erent layout options include striped versus independent disks, and many possibilities for how the arrays are ....

David Kotz and Nils Nieuwejaar. Flexibility and performance of parallel file systems. In Proceedings of the Third International Conference of the Austrian Center for Parallel Computation (ACPC), volume 1127 of Lecture Notes in Computer Science, pages 1--11. Springer-Verlag, September 1996.

....gives the most significant conclusions that can be extracted from this work. 2 Related Work In the last years many parallel distributed file systems have been developed and most of them have placed special interest in developing cache strategies and prefetching algorithms (ParfiSys [4] Galley [16], Scotch [11] Zebra [12] PIOUS [24] Vesta [5] and sfs [22] among others) Besides all the above mentioned projects, we would like to place special interest on two other research projects as they have interesting similarities to the work presented here. The first one is the xFS file system [1, ....

D. Kotz and, N. Nieuwejaar "Flexibility and Performance of Parallel File Systems," ACM Operating Systems Review, Vol. 30, No. 2, April 1996, pp.63-73

....BPFS attempts to avoid these complexities. It also avoids the cooperative caching designed into xFS, taking instead the same view as SPSS that such synchronization and process cooperation properly belong in higher level layers above the basic file system. The work of Kotz on the Galley file system [12] [13] maintains that a single strategy for various aspects of parallel file systems, such as caching, cannot suit all applications. He stresses the idea of building a simple, general purpose core storage system, and then layering a set of high level libraries on top of it to provide many different ....

David Kotz and Nils Nieuwejaar. Flexibility and performance of parallel file systems. ACM Operating Systems Review, 30(2):63--73, April 1996.

....that can be extracted from this work. 2 Related Work In the last years many parallel distributed file systems have been developed and most of them have placed special interest on developing cache strategies and prefetching algorithms (ParfiSys [3] Vesta [4] Scotch [11] Zebra [12] Galley [15], sfs [21] and PIOUS [23] among others) Besides all the above mentioned projects, we would like to place special interest on two other research projects as they have interesting similarities to the work presented here. The first one is the xFS file system [1, 2, 8] xFS is a server less file ....

D. Kotz and, N. Nieuwejaar "Flexibility and Performance of Parallel File Systems," ACM Operating Systems Review, Vol. 30, No. 2, April 1996, pp.63-73

....and environments. Our model of collaborative computing is inherently distributed; hence, the underlying data management is also distributed. Existing parallel file systems provide parallel applications with access to storage in distributed heterogeneous environments. Kotz and Nieuwejaar [1] give an overview of recent parallel file systems. Most existing parallel file systems, for example PIOUS [2, 3] or Galley Galley2 [1] are developed with parallel scientific and high performance applications in mind. For example, the PIOUS file system provides parallel PVM applications with ....

....also distributed. Existing parallel file systems provide parallel applications with access to storage in distributed heterogeneous environments. Kotz and Nieuwejaar [1] give an overview of recent parallel file systems. Most existing parallel file systems, for example PIOUS [2, 3] or Galley Galley2 [1], are developed with parallel scientific and high performance applications in mind. For example, the PIOUS file system provides parallel PVM applications with access to a segmented parallel file object as well as consistency and fault tolerance, implemented on top of existing filesystems. The ....

[Article contains additional citation context not shown here]

Kotz, D., Nieuwejaar N.: Flexibility and Performance of Parallel File Systems. ACM Operating Systems Review. 2 (1996) 63--73

....about the application programmer s interface (API) One intriguing interface is that of the Vesta parallel file system [CBF93, CF94, CFP 95, CF96] which seems to support regular, non overlapping matrix distributions well. The interface for the Galley parallel file system [NK96a, NK96b, KN96, NK97] attempts to be a low level interface that can be a base for other APIs, so it was natural to consider implementing Vesta s API on Galley. We have also implemented the Panda API [Tho96] and a linear file model similar to many older parallel file systems [Nie96] We implemented the Vesta ....

David Kotz and Nils Nieuwejaar. Flexibility and performance of parallel file systems. In Proceedings of the Third International Conference of the Austrian Center for Parallel 12 Computation (ACPC), volume 1127 of Lecture Notes in Computer Science, pages 1--11. Springer-Verlag, September 1996.

....provides only a low level interface with highly flexible primitives. Other interfaces and abstractions, such as MPI 2, Vesta, Panda, or HFS, can be built on top of these lower level interfaces. Some believe that even more flexibility should provide still more control to the library programmer [KN96] Underneath the interface, much of the research in parallel file systems involves techniques for high performance implementations. Techniques like disk directed I O [Kot97] caching and prefetching [ACR95, KTP 96, KE93, MDK96] and access pattern classification [MR97] These techniques can ....

David Kotz and Nils Nieuwejaar. Flexibility and performance of parallel file systems. ACM Operating Systems Review, 30(2):63--73, April 1996.

.... Future work There are many directions for future work in this area: ffl design an appropriate collective I O interface, ffl integrate with I O optimizing compilers [CC94, TCB 96] ffl optimize concurrent disk directed activities, and ffl explore the possibility of programmable IOPs [KN96] Acknowledgements Thanks to Song Bac Toh and Sriram Radhakrishnan for implementing and validating the disk model; to Chris Ruemmler, John Wilkes, and Hewlett Packard Corporation for allowing us to use their disk traces to validate our disk model, and for their help in understanding the details ....

David Kotz and Nils Nieuwejaar. Flexibility and performance of parallel file systems. In Proceedings of the Third International Conference of the Austrian Center for Parallel Computation (ACPC), volume 1127 of Lecture Notes in Computer Science, pages 1--11. Springer-Verlag, September 1996.

.... can provide to the file system to increase performance further How should applications provide this information One of the more radical methods of addressing this issue is to allow applications to download code to the IOP, where it would run in the same address space as the I O server [KN96] This approach is similar in spirit to the techniques suggested by the SPIN [BSP 95] and Exokernel [EKO95] projects, which involve uniprocessor operating systems. The ability to run application code at the IOPs could be used to allow applications to perform data dependent filtering or ....

David Kotz and Nils Nieuwejaar. Flexibility and performance of parallel file systems. ACM Operating Systems Review, 30(2):63--73, April 1996.

No context found.

David Kotz and Nils Nieuwejaar. Flexibility and performance of parallel file systems. ACM Operating Systems Review, 30(2):63-73, April 1996.

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC