David Kotz. Interfaces for disk-directed I/O. Technical Report PCSTR95 -270, Dept. of Computer Science, Dartmouth College, September 1995. 36  Home/Search   Document Details and Download   Summary   Related Articles   Check

....regular and irregular problems should be provided. disk directed I O Disk directed I O can dramatically improve the performance of reading and writing large, regular data structures between distributed memory and distributed files [21] and is primarily intended for the use in multiprocessors [22]. In a traditional UNIX like interface, individual processors make requests to the file system, even if the required amount of data is small. In contrast, a collective I O interface supports single joint requests from many processes. Disk directed I O can be applied for such an environment. In ....

David Kotz. Interfaces for disk-directed I/O. Technical Report PCSTR95 -270, Dept. of Computer Science, Dartmouth College, September 1995. 36

....deduce the necessary qualifications which are important to use one of the existing software products. A major issue is the operating system, hence, a detailed knowledge of operating systems (especially UNIX) is most important. Many of the existing systems have either interfaces to C C or Fortran [3]. Most of the ideas are expressed in these languages. Since parallel I O is based on the execution of several processes in parallel, a certain form of interprocess communication is required. As for parallel I O this communication is mostly obtained via message passing, i.e.processes exchange ....

David Kotz. Interfaces for disk-directed I/O. Technical Report PCS-TR95-270, Dept. of Computer Science, Dartmouth College, September 1995.

....paper extends these results from computational templates to I O templates and provides experimental validation. Parallel libraries are an improvement over implementing the desired functionality using low level functions offered by operating systems. Even if a parallel I O library or system is used [4 9, 14, 17, 19 22, 24, 26 28, 33, 36], the user specifies the parallel I O by using a 2 package of specially designed parallel I O library calls (typically highly tuned to one or a few architectures) The user differentiates between sequential and parallel I O streams and specifies how the data is to be subdivided, synchronized, ....

D. Kotz, "Interfaces for Disk-Directed I/O," Department of Computer Science, Dartmouth College, Hanover, NH 03755-3510, Technical Report PCS-TR95-270, September 1995.

....these results to include parallel I O templates and provides some experimental validation. Parallel I O libraries are an improvement over implementing the desired functionality using low level functions offered by operating systems. Even if a parallel I O library or system is used (for example, [4 9, 14, 17, 19 22, 25, 27 29, 34, 37]) the application de 2 veloper specifies the parallel I O by using a package of specially designed parallel I O library calls (typically highly tuned to one or a few architectures) The developer differentiates between sequential and parallel I O streams and specifies how the data is to be ....

D. Kotz, "Interfaces for Disk-Directed I/O," Department of Computer Science, Dartmouth College, Hanover, NH 03755-3510, Technical Report PCS-TR95-270, September 1995.

....capture complex but regular requests in a compact form, but can also capture completely irregular requests as a list. These compact requests can be easily converted into a list of blocks, for I O, and later used for mapping each block into the in memory location (CP number, CP offset) of the data [Kot95b] The combination of the compact parameterized descriptions for common matrix distributions, and the fully general nested batched interface [NK96b] are sufficient to efficiently support diskdirected I O. 8 Expanding the potential of Disk Directed I O The idea of disk directed I O can be ....

David Kotz. Interfaces for disk-directed I/O. Technical Report PCS-TR95-270, Dept. of Computer Science, Dartmouth College, September 1995.

....gather scatter block transfer. We also present results of the experiments driving the tuning effort. 1 Introduction STARFISH is a parallel file system simulator, based on the Proteus simulator [BDCW91] It was originally developed by the author for research into the concept of disk directed I O [Kot94a, Kot94b, PEK96, Kot95b, KC95, Kot95c, Kot95a]. In the course of preparing a more complete paper about disk directed I O [Kot96] we made several modifications to both of the parallel file systems supported by STARFISH ( traditional caching, which we now call the traditional parallel file system, and disk directed I O ) This report ....

David Kotz. Interfaces for disk-directed I/O. Technical Report PCS-TR95-270, Dept. of Computer Science, Dartmouth College, September 1995.

....[Kot94] and can support out of core computations, data dependent distribution patterns, and both regular and irregular requests [Kot95a, Kot95b] DDIO is a powerful technique that can be used for more than collective requests. Kotz explores ways to adapt many of the existing interfaces to DDIO [Kot95c] As proposed so far, however, DDIO enhances performance over one collective request from one job on one file. Moreover, to accommodate a set of generic patterns, the IOP has to maintain a sizeable library of those pattern mappings. Researchers in the parallel I O field are far from an agreement ....

David Kotz. Interfaces for disk-directed I/O. Technical Report PCS-TR95-270, Dept. of Computer Science, Dartmouth College, September 1995.

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC