Date: April 22, 1999
Time: Noon
Place: Hammerschlag Hall 1112
Speaker: Vivek Pai, Rice University
Cache Management in Scalable Network Servers
Abstract:
For many users, the perceived speed of computing is increasingly dependent on the performance of network server systems, underscoring the need for high performance servers. Cost-effective scalable network servers can be built on clusters of commodity components (PCs and LANs) instead of using expensive multiprocessor systems. However, network servers cache files to reduce disk access, and the cluster's physically disjoint memories complicate sharing cached file data. Additionally, the physically disjoint CPUs complicate the problem of load balancing. In this talk, I examine the issue of cache management in scalable network servers at two levels - cluster-wide (global) and per-node (local).
The cluster-wide solution uses a technique called Locality-Aware Request Distribution (LARD) that examines the content of incoming requests to determine which node in a cluster should handle the request. LARD uses the request content to dynamically partition the incoming request stream. This partitioning increases the file cache hit rates on the individual nodes, and it maintains load balance in the cluster.
I will also discuss the IO-Lite unified buffering and caching system that addresses cache management at the per-node level. Applications and various parts of the operating system currently use incompatible buffering schemes, resulting in unnecessary data copying. For network servers, overall throughput drops for two reasons - copying wastes CPU cycles, and multiple copies of data compete with the filesystem cache for memory. IO-Lite allows applications, the operating system, file system, and network code to safely and securely share a single copy of data.
Bio:
Vivek Pai received his BS in Electrical and Computer Engineering from Rice University in 1991 while juggling responsibilities as a co-founder of an entertainment software company. He later worked for a large oil company in developing/optimizing technical applications and migrating software from mainframes to desktops. He returned to Rice University in 1993 and received his MS in Electrical and Computer Engineering in 1996. His work focuses on various aspects of network server performance, including applications, operating systems, and cluster issues. In his dwindling spare time, he attempts to go jogging and watch indie/foreign films.
SDI / LCS Seminar Questions?
Karen Lindenfelser, 86716, or visit www.pdl.cmu.edu/SDI/