Using Wide-Area File Systems Within the World-Wide Web

Mirjana Spasojevic, C. Mic Bowman, and Alfred Spector.

September 15, 1994


Abstract

This paper proposes the use of a wide-area file system for storing and retrieving documents. We demonstrate that most of the functionality of the World-Wide Web (WWW) information service can be provided by storing documents in AFS. The approach addresses several performance problems experienced by WWW servers and clients, such as increased server and network load, network latency and inadequate security. In addition, the mechanism demonstrates the value of a global, general purpose file sharing system and the advantage of layering existing technologies.


Outline

  • 1. Introduction
  • 2. Wide-Area File Systems
  • 2.1 The AFS File System
  • 2.2 File Migration and Replication
  • 2.3 File Caching
  • 2.4 Security
  • 2.5 Performance
  • 3. File System Document Access
  • 3.1 File System Access with WWW
  • 3.2 URL Translation
  • 4. Document Repository
  • 4.1 Building a Repository
  • 4.2 Performance Impact
  • 5. Conclusions
  • References
  • Biography
  • We would like to thank Bob Sidebotham and Bill Camargo for contributing ideas and code. We are grateful to John Ockerbloom of Carnegie Mellon University for providing data from their World-Wide Web server.

    This research was funded by the Advanced Research Project Agency, under contract number F19628-93-C-1076. The views and conclusions expressed in this paper are those of the authors and do not represent the official position of ARPA or Transarc Corporation.

    Source code is available for the URL translation library and repository server code.


    Transarc Corporation, The Gulf Tower, 707 Grant Street, Pittsburgh, PA 15219