• Documents
  • Authors
  • Tables
  • Log in
  • Sign up
  • MetaCart
  • DMCA
  • Donate

CiteSeerX logo

Advanced Search Include Citations
Advanced Search Include Citations

DMCA

Serverless Network File Systems (1995)

Cached

  • Download as a PDF

Download Links

  • [cs.unomaha.edu]
  • [www.cse.nd.edu]
  • [www.nd.edu]
  • [www3.nd.edu]
  • [www.eecs.harvard.edu]
  • [www.cs.princeton.edu]
  • [www-db.stanford.edu]
  • [www.cs.fsu.edu]
  • [www.cs.fsu.edu]
  • [www.cs.rice.edu]
  • [www.cs.rice.edu]
  • [fmg-www.cs.ucla.edu]
  • [http.cs.berkeley.edu]
  • [www.ittc.ukans.edu]
  • [ficus-www.cs.ucla.edu]
  • [cs-www.bu.edu]
  • [lazowska.cs.washington.edu]
  • [cs.ucsb.edu]
  • [www.cs.cornell.edu]
  • [www.cs.iastate.edu]
  • [www.cse.buffalo.edu]
  • [www.cse.buffalo.edu]
  • [www.cs.columbia.edu]
  • [www.cs.toronto.edu]
  • [web.cs.wpi.edu]
  • [www1.cs.columbia.edu]
  • [www.cs.utexas.edu]
  • [www.cs.utexas.edu]
  • [www.cs.berkeley.edu]
  • [www.cs.rice.edu]
  • [www.cs.rice.edu]

  • Other Repositories/Bibliography

  • DBLP
  • Save to List
  • Add to Collection
  • Correct Errors
  • Monitor Changes
by Thomas E. Anderson , Michael D. Dahlin , Jeanna M. Neefe , David A. Patterson , Drew S. Roselli , Randolph Y. Wang
Venue:ACM TRANSACTIONS ON COMPUTER SYSTEMS
Citations:473 - 28 self
  • Summary
  • Citations
  • Active Bibliography
  • Co-citation
  • Clustered Documents
  • Version History

Citations

1092 The Design and Implementation of a Log-Structured File System - Rosenblum, Ousterhout - 1992 (Show Context)

Citation Context

...ies on previous work in areas such as scalable cache consistency (DASH [Leno90] and Alewife [Chai91]), cooperative caching, disk striping (RAID and Zebra), and log structured file systems (Sprite LFS =-=[Rose92]-=- and BSD LFS [Selt93]). Second, in addition to borrowing techniques developed in other projects, we have refined them to work well in our serverless system. For instance, we have transformed DASH’s sc...

1054 Active messages: a mechanism for integrating communication and computation - Eicken, Culler, et al. - 1992 (Show Context)

Citation Context

...ng to move xFS into the kernel. (Note that AFS shares this handicap.) 2.RPC and TCP/IP overheads severely limit xFS’s network performance. We are porting xFS’s communications layer to Active Messages =-=[vE92]-=- to address this issue. 3.We have done little profiling and tuning. As we do so, we expect to find and fix inefficiencies. As a result, the absolute performance is much less than we expect for the wel...

1014 Disconnected operation in the coda file system,” - Kistler, Satyanarayanan - 1992
1011 Myrinet: A Gigabit-per-second Local Area Network - Boden, Cohen, et al. - 1995 (Show Context)

Citation Context

...ovided by fast switched LANs, the expanding demands of users, and the fundamental limitations of central server systems. The recent introduction of switched local area networks such as ATM or Myrinet =-=[Bode95]-=- enables serverlessness by providing aggregate bandwidth that scales with the number of machines on the network. In contrast, shared media networks such as Ethernet or FDDI allow only one client or se...

933 Scale and Performance in a Distributed File System. - Howard, Kazar, et al. - 1988 (Show Context)

Citation Context

...verless network file system distributes storage, cache, and control over cooperating workstations. This approach contrasts with traditional file systems such as Netware [Majo94], NFS [Sand85], Andrew =-=[Howa88]-=-, and Sprite [Nels88] where a central server machine stores all data and satisfies all client cache misses. Such a central server is both a performance and reliability bottleneck. A serverless system,...

852 A case for redundant arrays of inexpensive disks (RAID - Patterson, Gibson, et al. - 1988 (Show Context)

Citation Context

... scalable and highly available file system interface to augment their simpler disk block interfaces. In contrast with the log-based striping approach taken by Zebra and xFS, TickerTAIP’s RAID level 5 =-=[Patt88]-=- architecture makes calculating parity for small writes expensive when disks are distributed over the network. SNS combats this problem by using a RAID level 1 (mirrored) architecture, but this approa...

597 U-Net: A User-Level Network Interface For Parallel And Distributed Computing - Eicken, Basu, et al. - 1995
565 A fast file system for unix,” - McKusick, Joy, et al. - 1984 (Show Context)

Citation Context

... when it was written. LFS’s solution to this problem provides a general mechanism to handle location-independent data storage. LFS uses per-file inodes, similar to those of the Fast File System (FFS) =-=[McKu84]-=-, to store pointers to the system’s data blocks. However, where FFS’s inodes reside in fixed locations, LFS’s inodes move to the end of the log each time they are modified. When LFS writes a file’s da...

501 Design and Implementation of the Sun Network Filesystem. - Sandberg, Goldberg, et al. - 1985 (Show Context)

Citation Context

...ntroduction A serverless network file system distributes storage, cache, and control over cooperating workstations. This approach contrasts with traditional file systems such as Netware [Majo94], NFS =-=[Sand85]-=-, Andrew [Howa88], and Sprite [Nels88] where a central server machine stores all data and satisfies all client cache misses. Such a central server is both a performance and reliability bottleneck. A s...

449 Measurements of a distributed file system. - BAKER, AL - 1991
369 The Directory-Based Cache Coherence Protocol for the DASH Multiprocessor. - Lenoski, Laudon, et al. - 1990 (Show Context)

Citation Context

..., xFS synthesizes a number of recent innovations that, taken together, provide a basis for serverless file system design. xFS relies on previous work in areas such as scalable cache consistency (DASH =-=[Leno90]-=- and Alewife [Chai91]), cooperative caching, disk striping (RAID and Zebra), and log structured file systems (Sprite LFS [Rose92] and BSD LFS [Selt93]). Second, in addition to borrowing techniques dev...

349 The Stanford FLASH Multiprocessor. - Kuskin, Ofelt, et al. - 1994
327 Cooperative caching: Using remote client memory to improve file system performance. - Dahlin, Wang, et al. - 1994 (Show Context)

Citation Context

...tributed metadata manager to provide better scalability, locality, and availability. We have also previously examined cooperative caching — using client memory as a global file cache — via simulation =-=[Dahl94b]-=- and therefore focus only on the issues raised by integrating cooperative caching with the rest of the serverless system. 3. Serverless File Service The RAID, LFS, Zebra, and multiprocessor cache cons...

302 The zebra striped network file system. - Hartman, Ousterhout - 1995 (Show Context)

Citation Context

...serverless management scheme. Second, xFS distributes its data storage across storage server disks by implementing a software RAID [Patt88, Chen94] using log-based network striping similar to Zebra’s =-=[Hart95]-=-. Finally, xFS eliminates central server 2caching by taking advantage of cooperative caching [Leff91, Dahl94b] to harvest portions of client memory as a large, global file cache. This paper makes two...

296 Caching in the sprite network file system. - Nelson, Welch, et al. - 1988 (Show Context)

Citation Context

...system distributes storage, cache, and control over cooperating workstations. This approach contrasts with traditional file systems such as Netware [Majo94], NFS [Sand85], Andrew [Howa88], and Sprite =-=[Nels88]-=- where a central server machine stores all data and satisfies all client cache misses. Such a central server is both a performance and reliability bottleneck. A serverless system, on the other hand, d...

286 Transparent process migration: Design alternatives and the sprite implementation. - Douglis, Ousterhout - 1991
263 The HP AutoRAID hierarchical storage system. - Wilkes, Golding, et al. - 1995 (Show Context)

Citation Context

..., Swift [Cabr91] and SFS [LoVe93] provide redundant distributed data storage for parallel environments, and Tiger [Rash94] services multimedia workloads. TickerTAIP [Cao93], SNS [Lee95], and AutoRAID =-=[Wilk95]-=- implement RAID-derived storage systems. These systems could provide services similar to xFS’s storage servers, but they would require serverless management to provide a scalable and highly available ...

224 Limitless directories: A scalable cache coherence scheme. - Chaiken, Kubiatowicz, et al. - 1991 (Show Context)

Citation Context

...umber of recent innovations that, taken together, provide a basis for serverless file system design. xFS relies on previous work in areas such as scalable cache consistency (DASH [Leno90] and Alewife =-=[Chai91]-=-), cooperative caching, disk striping (RAID and Zebra), and log structured file systems (Sprite LFS [Rose92] and BSD LFS [Selt93]). Second, in addition to borrowing techniques developed in other proje...

217 The LOCUS distributed operating system. - Walker, Popek, et al. - 1983
192 An implementation of a log-structured file system for UNIX - Seltzer, Bostic, et al. - 1993 (Show Context)

Citation Context

...in areas such as scalable cache consistency (DASH [Leno90] and Alewife [Chai91]), cooperative caching, disk striping (RAID and Zebra), and log structured file systems (Sprite LFS [Rose92] and BSD LFS =-=[Selt93]-=-). Second, in addition to borrowing techniques developed in other projects, we have refined them to work well in our serverless system. For instance, we have transformed DASH’s scalable cache consiste...

182 Autonet: A high-speed, selfconfiguring local area network using point-to-point links,” in - Schroeder - 1990
181 Non-volatile memory for fast, reliable file systems. - Baker, Asami, et al. - 1992 (Show Context)

Citation Context

...hichever is sooner; this assumption allows the simulated system to avoid communication more often than a real system since it does not account for segments that are written to disk early due to syncs =-=[Bake92]-=-. (Unfortunately, syncs are not visible in our Auspex traces.) Finally, under the Distributed policy, each client tracks the status of blocks that it writes so that it needs no network messages when m...

177 Replication in the Harp file system. - Liskov, Ghemawat, et al. - 1991
173 Using process groups to implement failure detection in asynchronous environments - Ricciardi, Birman
167 The Vesta parallel file system. - Corbett, Feitelson - 1996 (Show Context)

Citation Context

...veral other efforts to build decentralized file systems and then discusses the dynamic management hierarchies used in some MPPs. Several file systems, such as CFS [Pier89], Bridge [Dibb89], and Vesta =-=[Corb93]-=-, distribute data over multiple storage servers to support parallel workloads; however, they lack mechanisms to provide availability across component failures. Other parallel systems have implemented ...

146 Supporting checkpointing and process migration outside the UNIX kernel - Litzkow, Solomon - 1992
141 and the NOW Team. A Case for NOW (Networks of Workstations). - Anderson, Culler, et al. - 1995
124 File system logging versus clustering: a performance comparison. - SELTZER, SMITH, et al. - 1995 (Show Context)

Citation Context

...needed to evaluate the impact of distributed cleaning under a wide range workloads; other researchers have measured sequential cleaning overheads from a few percent [Rose92, Blac95] to as much as 40% =-=[Selt95]-=-, depending on the workload. Also, the current prototype implementation suffers from three inefficiencies, all of which we will attack in the future. 1.xFS is currently implemented as a set of user-le...

95 The echo distributed file system. - BIRRELL, HISGEN, et al.
95 A concurrent file system for a highly parallel mass storage subsystem - Pierce - 1989 (Show Context)

Citation Context

...is for xFS. This section describes several other efforts to build decentralized file systems and then discusses the dynamic management hierarchies used in some MPPs. Several file systems, such as CFS =-=[Pier89]-=-, Bridge [Dibb89], and Vesta [Corb93], distribute data over multiple storage servers to support parallel workloads; however, they lack mechanisms to provide availability across component failures. Oth...

90 The TickerTAIP parallel RAID architecture - Cao, Lim, et al. - 1994 (Show Context)

Citation Context

...manager architectures. For instance, Swift [Cabr91] and SFS [LoVe93] provide redundant distributed data storage for parallel environments, and Tiger [Rash94] services multimedia workloads. TickerTAIP =-=[Cao93]-=-, SNS [Lee95], and AutoRAID [Wilk95] implement RAID-derived storage systems. These systems could provide services similar to xFS’s storage servers, but they would require serverless management to prov...

90 Architectural requirements of parallel scienti c applications with explicit communication,” - Cypher, Ho, et al. - 1993 (Show Context)

Citation Context

...achines and also permit networked workstations to run parallel jobs [Doug91, Litz92, Ande95]. By increasing the peak processing power available to users, NOWs increase peak demands on the file system =-=[Cyph93]-=-. Unfortunately, current centralized file system designs fundamentally limit performance and availability since all read misses and all disk writes go through the central server. To address such perfo...

81 EVENODD: An optimal scheme for tolerating double disk failures - Blaum, Brady, et al. - 1994 (Show Context)

Citation Context

...a blocks and the parity block. xFS uses single parity disk striping to achieve the same benefits; in the future we plan to cope with multiple workstation or disk failures using multiple parity blocks =-=[Blau94]-=-. RAIDs suffer from two limitations. First, the overhead of parity management can hurt performance for small writes; if the system does not simultaneously overwrite all N-1 blocks of a stripe, it must...

80 Heuristic cleaning algorithms in log-structured file systems. - Blackwell, Harris, et al. - 1995
78 A Quantitative Analysis of Cache Policies for Scalable Network File Systems,” - Dahlin, Mather, et al. - 1994 (Show Context)

Citation Context

...ny of the clients. We examined management policies by simulating xFS’s behavior under a seven day trace of 236 clients’ NFS accesses to an Auspex file server in the Berkeley Computer Science Division =-=[Dahl94a]-=-. We warmed the simulated caches through the first day of the trace and gathered statistics through the rest. Since we would expect other workloads to yield different results, evaluating a wider range...

70 Anatomy of a Message in the Alewife Multiprocessor. - Kubiatowicz, Agarwal - 1993
63 LogP Quantified: The Case for Low-Overhead Local Area Networks - Keeton, Patterson, et al. - 1995 (Show Context)

Citation Context

...de95] connects the machines. Although each link of the physical network has a peak bandwidth of 80 MB/s, RPC and TCP/IP protocol overheads place a much lower limit on the throughput actually achieved =-=[Keet95]-=-. The throughput for fast networks such as the Myrinet depends heavily on the version and patch level of the Solaris operating system used. For our xFS measurements, we used a kernel that we compiled ...

52 DDM—a Cache-Only Memory Architecture - Hagersten, Landin, et al. - 1992
51 sfs: A parallel file system for the CM-5 - LoVerso, Isman, et al. - 1993 (Show Context)

Citation Context

...consisting entirely of large files, where per-file striping is appropriate and where large file accesses reduce stress on their centralized manager architectures. For instance, Swift [Cabr91] and SFS =-=[LoVe93]-=- provide redundant distributed data storage for parallel environments, and Tiger [Rash94] services multimedia workloads. TickerTAIP [Cao93], SNS [Lee95], and AutoRAID [Wilk95] implement RAID-derived s...

50 Caching in large-scale distributed file systems. - BLAZE - 1993
48 xFS: A Wide Area Mass Storage File System - Wang, Anderson - 1993 (Show Context)

Citation Context

...buted across a network. To distribute control across the network, xFS draws inspiration from several multiprocessor cache consistency designs. Finally, since xFS has evolved from our initial proposal =-=[Wang93]-=-, we describe the relationship of the design presented here to previous versions of the xFS design. 2.1. RAID xFS exploits RAID-style disk striping to provide high performance and highly available dis...

41 Replication in Ficus distributed file systems - Popek, Guy, et al. - 1990
38 The KSR1: Experimentation and Modeling of Poststore. - Rosti, Smirni, et al. - 1993 (Show Context)

Citation Context

...ent with three groups of eight storage servers and 31 clients. 30Several MPP designs have used dynamic hierarchies to avoid the fixed-home approach used in traditional directory-based MPPs. The KSR1 =-=[Rost93]-=- machine, based on the DDM proposal [Hage92], avoids associating data with fixed home nodes. Instead, data may be stored in any cache, and a hierarchy of directories allows any node to locate any data...

38 Two Methods for the Efficient Analysis of Memory Address Trace Data - Smith - 1977 (Show Context)

Citation Context

...er of network hops needed to satisfy a read request. Because we simulate larger caches than those of the traced system, this factor does not alter the total number of network requests for each policy =-=[Smit77]-=-, which is the relative metric we use for comparing policies. The second limitation of the trace is that its finite length does not allow us to determine a file’s “First Writer” with certainty for ref...

37 Fast Crash Recovery in Distributed File Systems - Baker - 1994 (Show Context)

Citation Context

...ontact N storage server groups, and all of the managers and clients can proceed in parallel, provided that they take steps to avoid having many machines simultaneously contact the same storage server =-=[Bake94]-=-; we plan use randomization to accomplish this goal. Similar considerations apply to the phases where managers read their checkpoints, clients roll forward, and managers query clients for their cache ...

27 Reaching Agreement on - Cristian - 1991
23 An overview of the NetWare operating system - Major, Minshali, et al. - 1994 (Show Context)

Citation Context

...e client. 1. Introduction A serverless network file system distributes storage, cache, and control over cooperating workstations. This approach contrasts with traditional file systems such as Netware =-=[Majo94]-=-, NFS [Sand85], Andrew [Howa88], and Sprite [Nels88] where a central server machine stores all data and satisfies all client cache misses. Such a central server is both a performance and reliability b...

17 Policies for efficient memory utilization in a remote caching architecture - Leff, Yu, et al. - 1991
14 Beyond striping: The bridge multiprocessor file system - Dibble, Scott - 1989 (Show Context)

Citation Context

...section describes several other efforts to build decentralized file systems and then discusses the dynamic management hierarchies used in some MPPs. Several file systems, such as CFS [Pier89], Bridge =-=[Dibb89]-=-, and Vesta [Corb93], distribute data over multiple storage servers to support parallel workloads; however, they lack mechanisms to provide availability across component failures. Other parallel syste...

14 The Placement Optimization Problem: A Practical Solution to the Disk File Assignment Problem - Wolf - 1989 (Show Context)

Citation Context

...This approach only moderately improves scalability because its coarse distribution often results in hot spots when the partitioning allocates heavily used files and directory trees to a single server =-=[Wolf89]-=-. It is also expensive, since it requires the (human) system manager to effectively become part of the file system — moving users, volumes, and disks among servers to balance load. Finally, Andrew [Ho...

12 Swift: A Storage Architecture for Large Objects - Cabrera, Long - 1991 (Show Context)

Citation Context

...ricted workloads consisting entirely of large files, where per-file striping is appropriate and where large file accesses reduce stress on their centralized manager architectures. For instance, Swift =-=[Cabr91]-=- and SFS [LoVe93] provide redundant distributed data storage for parallel environments, and Tiger [Rash94] services multimedia workloads. TickerTAIP [Cao93], SNS [Lee95], and AutoRAID [Wilk95] impleme...

9 Microsoft’s Tiger Media Server - Rashid - 1994
8 Ubik: Replicated Servers Made Easy - Kazar - 1989
5 Scalable Network Storage - Highly-Available - 1995 (Show Context)

Citation Context

...tectures. For instance, Swift [Cabr91] and SFS [LoVe93] provide redundant distributed data storage for parallel environments, and Tiger [Rash94] services multimedia workloads. TickerTAIP [Cao93], SNS =-=[Lee95]-=-, and AutoRAID [Wilk95] implement RAID-derived storage systems. These systems could provide services similar to xFS’s storage servers, but they would require serverless management to provide a scalabl...

1 Autonet: A High-Speed, Self-Configuring Lo Area Network Using Point-to-Point Links - Schroeder, Birrell, et al. - 1991
Powered by: Apache Solr
  • About CiteSeerX
  • Submit and Index Documents
  • Privacy Policy
  • Help
  • Data
  • Source
  • Contact Us

Developed at and hosted by The College of Information Sciences and Technology

© 2007-2019 The Pennsylvania State University