O. Krieger, M. Stumm, and R. C. Unrau. The alloc stream facility: A redesign of application-level stream i/o. IEEE Computer, 27(3):75--82, March 1994.  Home/Search   Document Details and Download   Summary   Related Articles   Check

....On the other hand, some features of parallel computer operating systems may not be well suited to support high data rate applications such as multimedia information systems. One such feature is the large amount of data copying that takes place to perform data transfers [FP93, PAM94, Ste94, KSU94] Thus it is not unusual for a single transfer from an I O device to an application process to involve a copy from the device to the device I O bu#er, another copy from the device bu#er to a kernel bu#er, and a third copy to a user process bu#er; the sequence of copies may be repeated in reverse ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. IEEE Computer, 27(3):75--82, March 1994.

....of the operating system kernel using standard I O system calls. Currently, only the indirect access method has been implemented. Additional details of the HFS architecture can be found in [34] 3.1. 1 HFS User Level Library The HFS user level library, also known as the Alloc Stream Facility (ASF) [36], is an application level interface to general I O, which includes HFS, NFS, and other le systems. It is in the form of a user level library, much like stdio.h in the standard C library. The HFS library has not been ported to K42, but its functionality has been partially ful lled by the standard ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. IEEE Computer, 27(3):75-83, March 1994.

....per application and to chose message buffers on an application basis. Application device channels [36] is a technique that gives the application restricted but direct access to the network adapter hardware. Several others have also worked on data movement, both in the context of operating systems [42, 51, 77] and network adapters [69] Desk area networks [45] is a way to completely bypass the memory bandwidth bottleneck for some applications. Steenkiste [70] compares different network adapter designs regarding data transfers over the system bus. An application interface using shared memory 31 32 ....

Orran Krieger, Michael Stumm, and Ron Unrau. The alloc stream facility -- a redesign of application-level stream I/O. IEEE Computer, 27(3):75--82, March 1994.

....data parallel virtual memory that is independent of any operating system support for virtual memory. There may be performance gains from integrating the two systems, via prefetching hints [MDK96] or an interface beyond mmap( that supports memory mapped zero copy I O and asynchronous transfers [KSU94, KS96] As noted in the thesis, there are areas where the ViC implementation is incomplete. The compiler does not support global parallel variables, which are missing only an interface to some system dependent linker support. The compiler does not allow parallel right indexing, which might need ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream facility: A redesign of application-level stream I/O. IEEE Computer, 27(3):75--82, March 1994.

....machines and are more fault tolerant. Alloc Stream Facility (ASF) Alloc Stream Facility (ASF) is an application level I O facility in the Hurricane File System (HFS) It can be used for all types of I O, including disk files, terminals, pipes, networking interfaces and other low level devices [26]. An outstanding difference to UNIX I O is that the application is allowed direct access to the internal buffers of the I O library instead of having the application to specify a buffer into or from which the I O data is copied. The consequence is another reduction in copying. ANL (Argonne ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. Technical Report CSRI-275, Computer Systems Research Institute, University of Toronto, Toronto, Canada, M5S 1A1, October 1992.

....to it. Section 7.3 introduces some remaining theoretical problems we plan to explore. Finally, Section 8 contains some concluding remarks. 2 Existing Systems and System Proposals In recent years a number of parallel file systems for high performance computer systems have been built or proposed [CFP, Corb, DiS, Kotb, KSU, PGK, Pie]. At the same time, a number of I O optimal computation paradigms have been proposed [Cora, CoW, GTV, NoV, ViS] Unfortunately, existing I O systems tend not to adequately support the functionality required in order to implement I O optimal algorithms. In particular, many file systems do not ....

O. Krieger, M. Stumm, and R. Unrau, "The Alloc Stream Facility: A Redesign of Application-Level Stream I/O," IEEE Computer 27 (March 1994), 75--82.

.... mechanisms and abstractions: I O intensive applications are supported via direct device to device data movement in the container shipping mechanism [19] and in the Scout operating system [17] Further techniques to minimize the number of copy operations are presented in the Alloc stream facility [24], the Tenex system [2] Accent [25] DASH [31] and Fbufs [9] The Server Operating System project [23] at MIT combines these approaches with ILP. From the above mentioned projects, the Server Operating System project at MIT is most similar to INSTANCE, because it reduces the number of necessary ....

Krieger, O., Stumm, M. Unrau, R.: "The Alloc Stream Facility - A Redesign of Application Level Stream I/O", IEEE Computer, Vol. 27, No. 3, March 1994, pp. 75-82

....primitives ) The author recognizes that the interface will be an extra burden on the application, because the application will receive one application level message in several non contiguous buffers. Several others have also worked on data movement, both in the context of operating systems [19, 13, 11] and network adapters [14, 15] During the last few years several high performance host network adapters have been designed. Some of them use DMA to transfer data to host memory [7, 18] and others utilize a large on board shared buffer memory [6, 2] 6 Conclusions and future work We have ....

Orran Krieger, Michael Stumm, and Ron Unrau. The alloc stream facility -- a redesign of application-level stream I/O. IEEE Computer, 27(3):75--82, March 1994.

....an appropriate combination of sub objects. To achieve this flexibility, each sub object must fit exacting specifications to fulfill the assumptions of other sub objects. Most applications interact with the file system through a user level application library such as the Alloc Stream Facility [KSU94] Note that the ideas underlying HFS could be used to build class libraries on top of Galley. 8.2.7 Whiptail Whiptail is a file system developed for the Intel Paragon, and was built on top of Intel s PFS. It was designed to support libraries for out of core applications [SW95b, SWC 95] and ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. IEEE Computer, 27(3):75--82, March 1994.

....files, because of its simpler interface, its natural support for parallel operation, and the reduced amount of copying and address space crossings required. But to provide high performance I O, it is necessary to supplement the system level servers with application level support. In previous work [5], we have been able to improve I O performance of uniprocessor applications by moving much of the I O functionality into the application space to reduce the number of address space crossings and the amount of data copying. We feel that application level support is even more important in the case ....

O. Krieger, M. Stumm, and R. Unrau, "The Alloc Stream Facility: A redesign of application-level Stream I/O," IEEE Computer, 27(3) March, 1994, pp. 75--82.

....space and access the file by referencing memory in the mapped regions. This has a number of advantages. For example, it allows all of main memory to be used as a cache of the file system. Also, mapped file I O results in less overhead for accessing data in the file cache than for example Unix I O[17]. However, mapped file I O presents a challenge to the file system, since it must handle demands that are implicit due to accesses to memory rather than explicit due to calls to the file system. Moreover, since the memory manager and not the file system controls the file cache, the two must ....

....to which disk an operation is destined, and directing the operation to the corresponding device driver. Dirty Harry (DH) is the only kernel level file system server. It collects dirty pages from the memory manager and makes requests to the BFS to write the pages to disk. The Alloc Stream Facility [16, 17] (ASF) is a user level library that maps files into the application s address space and translates read and write operations into accesses to the mapped regions. It supports a variety of I O interfaces including Unix I O (i.e. read write) Stdio, and the Alloc Stream Interface [17] The file ....

[Article contains additional citation context not shown here]

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A Redesign of Application-level Stream I/O. Technical Report CSRI-275, Computer Systems Research Institute, University of Toronto, Toronto, Canada, M5S 1A1, October 1992.

....operating system. Techniques used for flexibility We adopt techniques from several areas to incorporate flexibility into our operating system: object oriented systems design [1, 4] run time code generation [13] and the relocation of kernel and system functionality into userlevel libraries [8, 6, 12]. Objects represent virtual and physical resources provided by our operating system, such as files, memory regions, and processes. Encapsulating these abstractions allows us to easily experiment with policies and implementations to suit particular application requirements. In order to achieve ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. IEEE Computer, 27(3):75--82, March 1994.

....I O. Other parallel I O interfaces are provided as extensions to Unix I O, and only the I O intensive portions of an applications need to be rewritten to exploit the advantages of the parallel interface. We have developed an application level I O library, called the Alloc Stream Facility (ASF) [18], which addresses these problems. ASF provides an interface, called the Alloc Stream Interface (ASI) which preserves the advantages of mapped file I O while still allowing uniform access for all types of I O (e.g. terminals, pipes, and network connections) In the case of file I O, ASF typically ....

....that we employ in the Tornado operating system [23] While allowing matrix based interfaces to be implemented in a layer above it, building block composition allows the expert user much greater control over operating system policy. Also, application level libraries, such as ELFS [13] and ASF [18], can exploit the power of building block composition, while hiding the low level details from the application programmer. Building block composition can be considered both a technique for structuring flexible system software (that can support many policies) and a technique for giving applications ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. IEEE Computer, 27(3):75--83, March 1994.

....mappedfile I O is used may be offset by an increase in the number of soft page faults. However, some systems (e.g. AIX) do not incur any page faults when pages in the file cache are accessed. Also, the cost of a page fault is substantially less than the cost of a read system call on many systems [17]. Finally, mapped file I O places a lower storage demand on main memory. When an application uses a read write interface, file data is buffered both in the cache of the memory manager and in application buffers. If mappedfile I O is used, no extra copies of the data are made, so the system ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. Technical Report CSRI-275, Computer Systems Research Institute, University of Toronto, Toronto, Canada, M5S 1A1, October 1992.

....are not replicated, but instead are accessed remotely. 4.4. The File System File I O in Hurricane is provided largely outside of the kernel; only the device drivers are in the kernel. The Hurricane File System (HFS) implementation makes use of three user level system servers [Krieger 1993; Krieger 1994a] The Name Server manages the Hurricane name space. The Open File Server (OFS) maintains the file system state for each open file, and is (largely) responsible for authenticating application requests to lower level servers. The Block File Server (BFS) controls the disks, determines the target ....

....the disks, determines the target for each I O request, and directs the request to a corresponding device driver. The Alloc Stream Facility (ASF) is a file system library in the application address space that translates application file read and write requests into accesses to a mapped file region [Krieger 1994a; Krieger 1994b] On the first access to a page in the region, the process will page fault. If the data is not available in the file cache, then the fault is translated by the memory manager into a read page request to the BFS. There is a separate instance of all file system servers on each ....

[Article contains additional citation context not shown here]

Krieger, O., Stumm, M., and Unrau, R. 1994. The Alloc Stream Facility: A redesign of application-level stream I/O. IEEE Computer, 27, 3 (Mar.), 75--83.

....application requests to lower level servers. The Block File Server (BFS) controls the disks, determines the target for each I O request, and directs the request to a corresponding device driver. The Alloc Stream Facility (ASF) is a file system library in the application address space [24, 27, 25] that translates application file read and write requests into accesses to a mapped file region. On the first access to a page in the region, the process will page fault. If the data is not available in the file cache, then the fault is translated by the memory manager into a read page request to ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. IEEE Computer, 27(3):75--83, March 1994.

....Our file system makes extensive use of mapped files to reduce this overhead and in doing so improves I O performance. Second, a large portion of HFS is implemented within the address space of the applications that use it. This application level facility, called the Alloc Stream Facility (ASF) [73, 74, 75], has several key advantages: 1. The structure of ASF makes it easy to adapt the facility to any operating system and hardware platform; taking advantage of features specific to each platform to improve performance. 2. ASF is designed for multi threaded applications running on multiprocessors and ....

....Facility (ASF) In addition to being the application level library for the HFS file system, it is the library for all other I O services provided on HURRICANE. Also, ASF has been ported (independent of the rest of the file system) to other operating systems, including SunOS, IRIX, AIX, and HP UX [73, 74, 75]. The common interface provided by all Application levelStorage Objects (ASOs) is called the Alloc Stream Interface (ASI) While having the characteristics described in Section 3.2, ASI differs from the other storage object interfaces (provided by PSOs and LSOs) in that it is a uniform interface. ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. IEEE Computer, 27(3):75--83, March 1994.

....Our file system makes extensive use of mapped files to reduce this overhead and in doing so improves I O performance. Second, a large portion of HFS is implemented within the address space of the applications that use it. This application level facility, called the Alloc Stream Facility (ASF) [73, 74, 75], has several key advantages: 1. The structure of ASF makes it easy to adapt the facility to any operating system and hardware platform; taking advantage of features specific to each platform to improve performance. 2. ASF is designed for multi threaded applications running on multiprocessors and ....

....Facility (ASF) In addition to being the application level library for the HFS file system, it is the library for all other I O services provided on HURRICANE. Also, ASF has been ported (independent of the rest of the file system) to other operating systems, including SunOS, IRIX, AIX, and HP UX [73, 74, 75]. The common interface provided by all Application levelStorage Objects (ASOs) is called the Alloc Stream Interface (ASI) While having the characteristics described in Section 3.2, ASI differs from the other storage object interfaces (provided by PSOs and LSOs) in that it is a uniform interface. ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. Technical Report CSRI-275, Computer Systems Research Institute, University of Toronto, Toronto, Canada, M5S 1A1, October 1992.

....File System (HFS) implements files using building block compositions. HFS is logically divided into three layers: the application layer, the physical layer, and a logical layer between the two (Figure 2) The Alloc Stream Facility (ASF) is an I O library that makes up the application layer of HFS [Krieger et al. 1994]. We provide as much functionality as possible in this layer in order to minimize communication with servers in other address spaces. The HFS physical layer, which implements files and controls the system disks, and the HFS logical layer, which provides file system authentication services, are ....

....library, which we developed using our building block approach. It handles all I O on Hurricane (e.g. terminal, socket, disk, and pipe I O) is suitable for multiprocessor operation, and exports a number of different I O interfaces (such as the Unix read write and stdio interfaces) to applications [Krieger et al. 1994]. AFS has been ported to a number of uniprocessor and multiprocessor systems, including SunOS, IRIX, AIX, and HP UX. The ASF I O package is an example where we have clearly found it advantageous to define a large number of simple building blocks, instead of a smaller number of more general ones. ....

[Article contains additional citation context not shown here]

Krieger, O., Stumm, M., and Unrau, R. 1994. The Alloc Stream Facility: A redesign of application-level stream I/O. IEEE Computer 27, 3 (March), 75--82.

....classes. Non concurrent requests: The only important goal for this workload is to minimize latency. With our hybrid locking strategy, many kernel requests require only a single atomic operation. Hence, HURRICANE is able to achieve uncontended response times comparable to uniprocessor systems [14]. Concurrent independent requests: The important goal for this workload is to maximize concurrency, so an optimal strategy would be to use fine grain locks for these requests. With our hybrid locking strategy, the reserve bits serve as fine grain locks to maximize concurrency and minimize the ....

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. Technical Report CSRI275, Computer Systems Research Institute, University of Toronto, Toronto, Canada, M5S 1A1, October 1992.

No context found.

O. Krieger, M. Stumm, and R. C. Unrau. The alloc stream facility: A redesign of application-level stream i/o. IEEE Computer, 27(3):75--82, March 1994.

No context found.

O. Krieger, M. Stumm, and R. C. Unrau. The alloc stream facility: A redesign of application-level stream i/o. IEEE Computer, 27(3):75--82, March 1994.

No context found.

Orran Krieger, Michael Stumm, and Ronald Unrau. The Alloc Stream Facility: A redesign of application-level stream I/O. IEEE Computer, 27(3):75--83, March 1994.

No context found.

O. Krieger, M. Stumm, and R. Unrau. The Alloc Stream Facility: A Redesign of Application-Level Stream I/O. IEEE Computer, 27(3), March 1994.

No context found.

REFERENCES 134 Krieger, O., Stumm, M., & Unrau, R. 1994. The Alloc Stream Facility -- A Redesign of Application Level Stream I/O. IEEE Computer, 27(3).

No context found.

O. Krieger et al., "The Alloc Stream Facility: A Redesign of Application-Level Stream I/O," IEEE Computer, Vol. 27, No. 3, March 1994, pp. 75-83.

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC