On Application-level Approaches to Avoiding TCP Throughput Collapse in Cluster-based Storage Systems
Proceedings of the 2nd international Petascale Data Storage Workshop (PDSW '07) held in conjunction with Supercomputing '07. November 11, 2007, Reno, NV.
Elie Krevat, Vijay Vasudevan, Amar Phanishayee,
David G. Andersen, Gregory R. Ganger,
Garth A. Gibson, Srinivasan Seshan
Petascale Data Storage Institute
Carnegie Mellon University
Pittsburgh, PA 15213
TCP Incast plagues scalable cluster-based storage built atop standard TCP/IP-over-Ethernet, often resulting in much lower client read bandwidth than can be provided by the available network links. This paper reviews the Incast problem and discusses potential application-level approaches to avoiding it.
FULL PAPER: pdf