AMP: An Affinity-Based Metadata Prefetching Scheme in Large-Scale Distributed Storage Systems, in 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID), pp. 459-466, May 19-22, 2008, Lyon, France
Abstract
Prefetching is an effective technique for improving file access performance, which can significantly reduce access latency for I/O systems. In distributed storage systems, prefetching for metadata files is critical for the overall system performance. In this paper, an Affinity-based Metadata Prefetching (AMP) scheme is proposed for metadata servers in large-scale distributed storage systems to provide aggressive metadata prefetching. Through mining useful information about metadata accesses from past history, AMP can discover metadata file affinities accurately and intelligently for prefetching. Compared with LRU and some of the latest file prefetching algorithms such as Nexus and C-Miner, our trace-driven simulations show that AMP can improve buffer cache hit rates by up to 12%, 4.5% and 4% respectively, while reduce the average response time by up to 60%, 12% and 8%, respectively.
BibTeX Entry
	@inproceedings{zhu_ccgrid08, author = {Lin Lin and Xueming Li and Hong Jiang and Yifeng Zhu and Lei Tian}, title = {{AMP}: An Affinity-Based Metadata Prefetching Scheme in Large-Scale Distributed Storage Systems }, booktitle = {Proceedings of 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid ({CCGRID'08})}, year = {2008}, pages = {459--466}, address = {Lyon, France}, }
Full Paper
pdf
Last modified on October 16, 2007