• Academia's premiere storage systems research center.
    Leading research in storage systems, databases, ML systems, cloud computing, data lakes, etc.

    PARALLEL DATA LAB

Recent PDL Publications


The PDL Packet - Summer 2020 Newsletter

 

 

Challenges and Solutions for Fast Remote Persistent Memory Access
BEST PAPER AWARD AT SoCC'20!
Anuj Kalia, David Andersen, Michael Kaminsky
SoCC ’20, October 19–21, 2020, Virtual Event, USA.

Non-volatile main memory DIMMs (NVMMs), such as Intel’s Optane DC Persistent Memory modules, provide data durability with orders of magnitude higher performance than prior durable technologies. This paper explores the unique challenges that arise when building high-performance networked systems [...more]

Unearthing Inter-job Dependencies for Better Cluster Scheduling
Andrew Chung, Subru Krishnan, Konstantinos Karanasos, Carlo Curino,
Gregory R. Ganger
14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20), Virtual Event, Nov. 4–6, 2020

Inter-job dependencies pervade shared data analytics infrastructures (so-called “data lakes”), as jobs read output files written by previous jobs, yet are often invisible to current cluster schedulers. Jobs are submitted one-by-one, without indicating dependencies, and the scheduler considers them independently based on priority, fairness, etc. [...more]

PACEMAKER: Avoiding HeART Attacks in Storage Clusters with
Disk-adaptive Redundancy
Saurabh Kadekodi, Francisco Maturana, Suhas Jayaram Subramanya, Juncheng Yang,
K. V. Rashmi, Gregory R. Ganger
14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20), Virtual Event, Nov. 4–6, 2020

Data redundancy provides resilience in large-scale storage clusters, but imposes significant cost overhead. Substantial space-savings can be realized by tuning redundancy schemes to observed disk failure rates. However, prior design proposals for such tuning are unusable in real-world clusters, because the IO load of transitions between schemes overwhelms the storage infrastructure (termed transition overload). [...more]

Recent PDL News