HICSS-30 Task Force on Network Storage Architecture

    Garth Gibson, Task Force Chair

    In conjunction with the 1997 Hawaii International Conference on System Sciences, HICSS-30, there was a series of task forces on systems architecture. One such task force focused on storage systems architecture by addressing the critical issue of how storage should be networked in increasingly high-performance local area networks. The short, introduction paper describing this task force is included at the bottom of this page.

    Task Force Position Papers

    The following short (one-page) summaries and position statements were the starting point for the task force's discussion. Those that significantly extended the following positions were invited for presentation at the task force meetings.

  • Task force agenda abstract and one-page summary (postscript) by Garth Gibson from Carnegie Mellon University. Text included below.
  • Position: "Network attached storage is inevitable" abstract and one-page summary (postscript) by Dave Anderson from Seagate Technology Incorporated.
  • Position: "Internet-attached storage devices" abstract and one-page summary (postscript) by Rodney Van Meter, Steve Hotz, and Gregory Finn from the University of Southern California Information Sciences Institute.
  • Position: "Management of future storage" abstract and one-page summary (postscript) by John Wilkes from Hewlett-Packard Laboratories.
  • Position: "Abstracting the storage interface" abstract and one-page summary (postscript) by Garth Gibson from Carnegie Mellon University.
  • Add'l Position: "Storage for ASCI" abstract and one-page summary (postscript) by Kim Minuzzo and Dave Wiltzius from Lawrence Livermore National Lab (LLNL).
  • Add'l Position: "Empowering the clients" abstract and one-page summary (postscript) by John H. Hartman from the University of Arizona.
  • Add'l Position: "Information security" abstract and one-page summary (postscript) by James P. Hughes and Aloke Guha.
  • Add'l Position: "Coupling advanced data movement to advanced storage" abstract and one-page summary (postscript) by David S. Greenberg.

  • Task Force on Network Storage Architecture: Task Force Agenda


    School of Computer Science, Carnegie Mellon University,
    Pittsburgh, PA 15213-3890

    Task Force Abstract

    Storage systems represent a vital market that is growing faster than the personal computer market. Its primary constituents are magnetic and optical disk drives, magnetic tapes, and large-capacity (robotic) assemblies of drives and cartridges. Storage hardware sales in 1995 topped $40 billion, including more than 60,000 terabytes of hard disk storage. In recent years, the amount of storage sold has been almost doubling each year; in the near future it is expected to sustain an annual growth of about 60 percent. This enormous growth rate has been accompanied by a 35-50 percent per year decrease in the cost per byte of storage. Consequentially, insuring the continued vitality of storage's architecture in future computing systems is essential.

    While many of these storage products are being directly attached to personal and home computers, enabling local copies of substantial code and information bases to improve privacy, speed and availability, 65% of the disk array products are already being used in LAN file servers and this fraction is expected to rise to 75% over the next few years. With today's distributed file system technology, all storage bytes are copied through file server machines, introducing a potentially serious bottleneck for high-bandwidth, low-latency, and scalability. Moreover, the sustained bandwidth of storage devices is rapidly outstripping current interconnection technologies and rendering inexpensive store-and-forward server solutions impractical. For example, the rapid technological improvements in linear bit density and magnetic disk rotation rate is driving data rate up at 40% per year, insuring 25-40 MB/s sustained disk bandwidth by the end of the decade. Consequentially, the quality of storage service is increasingly interdependent with local area networking.

    The goal of this task force is to chart out this interaction between local area network and storage architecture. Our primary tasks will be to:

  • document the trends and forces that are driving this convergence;
  • define networked storage and distinguish its flavors;
  • identify critical technologies and major technological obstacles;
  • plot avenues for community-wide adoption and deployment; and
  • identify viable alternatives and chart litmus tests between alternatives.

    Seeding this task force discussion are the positions of four communities concentrating on networked storage architectures. Dave Anderson reports that Seagate's customers are driving network-attached devices because of the improved scalability, uniform fault-tolerance model, conformance to an increasingly open systems architecture, and especially demanding applications such as video. Rod Van Meter, Steve Hotz and Greg Finn, of USC/ISI, up the ante by calling for network-attached storage to speak internet protocols, especially IP, because of its advantages in wide-area connectivity, physical media independence, mature and rich development community, and the recent techniques for eliminating bottlenecks in per-byte costs. John Wilkes, Hewlett-Packard Labs, sees an evolution of processor-centric computing to storage-centric computing in no small part because of the cost of storage management (capacity planning, fault-tolerance, heterogeneity, load balancing, backup). In this storage-centric architecture, Wilkes offers a quality of service abstraction called attribute-managed storage, to allow storage subsystems to better manage themselves. Finally, Carnegie Mellon's network-attached secure disks project argues that raising the level of abstraction of the storage interface enabled SCSI to hide the rapid changes in storage technology over the last decade and it is time to raise it again. At this higher level of abstraction storage would "understand" data groupings that correspond to client files, enabling the much deeper prefetching, dynamic allocation, compression/search, efficient security enforcement and aggressive self-management.

    This work was supported in part by Advanced Research Projects Agency contract N00174-96-0002, in part by National Science Foundation grant ECD-8907068, and in part by donations and scholarships from Data General, Symbios Logic, Hewlett-Packard, and Compaq. The United States government has certain rights in this material. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of any of the funding agencies.

    © 1996 IEEE. Published in the Proceedings of the Hawaii Int. Conf. on System Sciences, January 8-10, 1997, Maui, USA.

    Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the IEEE. Contact: Manager, Copyrights and Permissions/IEEE Service Center/445 Hoes Lane/P.O. Box 1331/Piscataway, NJ 08855-1331, USA. Telephone: + Intl. 908-562-3966.



  • © 2009.
    Last updated 11 November, 2004