CSE 710 – Seminar on “Wide Area Distributed File Systems”

Spring 2012 – Papers to be discussed

Early Distributed File Systems:

1. The Sun Network File System: Design, Implementation and Experience (NFS), R. Sandberg, USENIX 1986.

2. Scale and Performance in a Distributed File System (AFS), J. Howard et al., ACM ToCS 1988.

3. Disconnected Operation in the Coda File System, J. Kistler et al., SOSP 1991.

4. Serverless Network File Systems (xFS), T. Anderson et al., SOSP 1995.

Parallel Cluster File Systems:

5. PVFS: A Parallel File System for Linux Clusters, P. Carns et al., Linux Conference 2000.

6. Lustre: A Scalable, High-Performance File System, Cluster File Systems, Whitepaper 2002.

7. GPFS: A Shared-Disk File System for Large Computing Clusters, F. Schmuck et al., FAST 2002.

8. Scalable Performance of the Panasas Parallel File System, B. Welch et al., FAST 2008.

9. Nache: Design and Implementation of a Caching Proxy for NFSv4, A. Gulati et al., FAST 2007.

10. Panache: A Parallel File System Cache for Global File Access, M. Eshel et al., FAST 2010.

Wide Area File Systems:

11. OceanStore: An Architecture for Global-Scale Persistent Storage, J. Kubiatowicz et al., ASPLOS 2000.

12. Shark: Scaling File Servers via Cooperative Caching, S. Annapureddy et al., NSDI 2005.

13. Pangaea: a symbiotic wide-area file system, Y. Saito et al., SIGOPSEW 2002.

14. zFS – A Scalable Distributed File System Using Object Disks, O. Rodeh et al., MSST 2003.

15. A Distributed File System for a Wide-Area High Performance Computing Infrastructure, E. Walker, WORLDS 2006.

16. The Google File System, S. Ghemewat., SOSP 2003.

17. The Hadoop Distributed File System, K. Shvachko et al., MSST 2010.

18. Ceph: A Scalable, High-Performance Distributed File System, S. Weil et al., OSDI 2006.

19. Flexible, Wide-Area Storage for Distributed Systems with WheelFS, J. Stribling et al., NSDI 2009.

Distributed Storage Management:

20. Bigtable: A Distributed Storage System for Structured Data, F. Chang et al., OSDI 2006.

21. Dynamo: Amazon’s Highly Available Key-value Store, G. DeCandia et al., SOSP 2007.

22. PNUTS: Yahoo’s Hosted Data Serving Platform, B. Cooper et al., VLDB 2008.

23. Cassandra – A Decentralized Structured Storage System, A. Lakshman et al., LADIS 2009.

24. Spyglass: Fast, Scalable Metadata Search for Large-Scale Storage Systems, A. Leung et al., FAST 2009.

25. Megastore: Providing Scalable, Highly Available Storage for Interactive Services, J. Baker et al., CIDR 2011.

File systems for Mobile/portable computing:

26. Safety, Visibility, and Performance in a Wide-Area File System, M. Kim et al., FAST 2002.

27. Integrating Portable and Distributed Storage, N. Tolia et al., FAST 2004.

28. Energy-Efficiency and Storage Flexibility in the Blue File System, E. Nightingale et al., OSDI 2004.