| Alternate document: Details Integrating Parallel File I/O and Database Support for High-Performance Scientific Data Management (00) Jaechun No, Rajeev Thakur, |
Jaechun No, Rajeev Thakur, Alok Choudhary  Home/Search
Context Related
Links: ACM DBLP | anl.gov/~thakur/papers/sdm.ps.gz sc2000.org/techpapr/pa...pap.pap179.pdf northwestern.edu/~wkliao/M...sc2000.pdf Cached: PS.gz PS PDF This document uses CoBlitz to cache paper downloads. If your firewall is blocking outgoing connections to port 3125, you can use these links to download local copies.
Image Update HelpPS.gz PS PDF From: anl.gov/~thakur/papers (more) (Enter author homepages) |
Rate this article:      (best)Comment on this article |
Abstract: Many scientific applications have large I/O requirements, in terms of both the size of data and the number of files or data sets. Management, storage, efficient access, and analysis of this data present an extremely challenging task. Traditionally, two different solutions are used for this problem: file I/O or databases. File I/O can provide high performance but is tedious to use with large numbers of files and large and complex data sets. Databases can be convenient, flexible, and powerful ... (Update)
Context of citations to this paper: More
...carefully. Prefetching and caching technologies are widely studied in the database community but also recently in the field of parallel I O [14]. The main idea is, in the first case, to prepare the data for further computation which is predicted to be needed in the...
Cited by: More
Agent-Based Query Optimisation in a Grid Environment - Serafini, Stockinger.. (2001) (Correct)
Similar documents (at the sentence level):
7.7%: A Scientific Data Management System for Irregular.. - No, Thakur, Kaushik.. (Correct)
Active bibliography (related documents): More All
0.8: Achieving High Performance with MPI-IO - Thakur, Gropp, Lusk (Correct)
0.6: On Implementing MPI-IO Portably and with High Performance - Thakur, Gropp, Lusk (1999) (Correct)
0.6: I/O in Parallel Applications: The Weakest Link - Thakur, Lusk, Gropp (Correct)
Similar documents based on text: More All
0.4: Improving the Performance of MPI Derived Datatypes by.. - Byna, Gropp, Sun, Thakur (2003) (Correct)
0.3: Parallel netCDF: A Scientific High-Performance I/O.. - Li, Liao, Choudhary.. (2003) (Correct)
0.3: Accessing Sections of Out-of-Core Arrays Using an Extended.. - Thakur, Choudhary (1995) (Correct)
BibTeX entry: (Update)
J. No, R. Thakur, A. Choudhary, Integrating Parallel File I/O and Database Support for High-Performance Scientific Data Management, Supercomputing Conference, Dallas, Texas, November 2000. http://citeseer.ist.psu.edu/no00integrating.html More
@inproceedings{ no00integrating,
author = "Jaechun No and Rajeev Thakur and Alok Choudhary",
title = "Integrating Parallel File {I/O} and Database Support for High-Performance Scientific Data Management",
booktitle = "Proceedings of SC2000: High Performance Networking and Computing",
publisher = "IEEE Computer Society Press",
address = "Dallas, TX",
year = "2000",
url = "citeseer.ist.psu.edu/no00integrating.html" }
Citations (may not include all citations):142 MPI-2: Extensions to the Message-Passing Interface - Interface - 1997
96 The SDSC Storage Resource Broker - Baru, Moore et al. - 1998 ACM
89 The Data Grid: Towards an Architecture for the Distributed M.. - Chervenak, Foster et al. - 1999
76 The Galley Parallel File System - Nieuwejaar, Kotz - 1997 ACM DBLP
73 PPFS: A High Performance Portable Parallel File System - Huber, Elford et al. - 1995 DBLP
67 ACM Transactions on Computer Systems (context) - Corbett, Feitelson et al. - 1996
63 Server-Directed Collective I/O in Panda - Seamons, Chen et al. - 1995 ACM DBLP
58 Design and Evaluation of Primitives for Parallel I/O (context) - Bordawekar, del et al. - 1993 ACM DBLP
56 Scalability in the XFS File System - Sweeney, Doucette et al. - 1996 DBLP
52 Jovian: A Framework for Optimizing Parallel I/O - Bennett, Bryant et al. - 1994 ACM
49 On Implementing MPI-IO Portably and with High Performance - Thakur, Gropp et al. - 1999 ACM DBLP
39 An Extended Two-Phase Method for Accessing Sections of Out-o.. - Thakur, Choudhary - 1996 ACM
37 ACM Transactions on Computer Systems (context) - Kotz, MIMD - 1997
29 Adaptive File System Policy Selection (context) - Madhyastha, Reed - 1996
26 Using MPI-2: Advanced Features of the Message-Passing Interf.. (context) - Gropp, Lusk et al. - 1999
25 for Parallel Computers: Problems and Prospects (context) - del, Alok et al. - 1994
24 Multidimensional Indexing and Query Coordination for Tertiar.. - Shoshani, Bernardo et al. - 1999 ACM DBLP
18 Users Guide for ROMIO: A High-Performance (context) - Thakur, Lusk et al. - 1999
17 Globalized Newton-Krylov-Schwarz Algorithms and Software for.. - Gropp, Keyes et al. - 1998 ACM
17 A Network-Aware Distributed Storage Cache for Data Intensive.. - Tierney, Lee et al. - 1999 ACM DBLP
15 Querying Very Large Multidimensional Datasets in ADR - Kurc, Chang et al. - 1999
12 An MPI-IO Interface to HPSS - Jones, Mark et al. - 1996
11 PMPIO---A Portable Implementation of MPI-IO (context) - Fineberg, Wong et al. - 1996
11 XFS: A Next Generation Journalled 64-Bit Filesystem With Gua.. (context) - Holton, Das - 1994
9 Implementation and Performance of MPI-IO File Access Using M.. (context) - Sanders, Park et al. - 1996
8 Data Management for Large-Scale Scientific Computations in H.. - Choudhary, Kandemir et al. - 1999 ACM DBLP
7 A Case for Using MPI's Derived Datatypes to Improve I/O Perf.. (context) - Thakur, Gropp et al. - 1998 ACM
6 Storage Management for High Energy Physics Applications - Shoshani, Bernardo et al. - 1998
5 IBM AIX Parallel I/O File System: Installation (context) - Corp - 1995
5 World-Wide Web page at http://www (context) - Prost, PIOFS - 1996
4 A Data Intensive Distributed Computing Architecture for Grid.. - Tierney, Johnston et al. - 2000
1 Preliminary Survey of I/O Intensive Applications (context) - Group, Scalable et al. - 1994
1 PostgreSQL User's Guide (context) - Development - 1996
Documents on the same site (http://www-unix.mcs.anl.gov/~thakur/papers.html): More
Users Guide for ROMIO: A High-Performance, Portable MPI-IO.. - Rajeev Thakur (2002) (Correct)
An Evaluation of Java's I/O Capabilities for High-Performance .. - Dickens, Thakur (2000) (Correct)
PVFS: A Parallel File System for Linux Clusters - Carns, Ligon, III, Ross, Thakur (Correct)
Online articles have much greater impact More about CiteSeer.IST Add search form to your site Submit documents Feedback
CiteSeer.IST - Copyright Penn State and NEC