A Study of Practical Deduplication

被引：309

作者：

Meyer, Dutch T. ^{[1
]}

Bolosky, William J. ^{[1
]}

机构：

[1] Univ British Columbia, Microsoft Res, Vancouver, BC V5Z 1M9, Canada

来源：

ACM TRANSACTIONS ON STORAGE | 2012年 / 7卷 / 04期

关键词：

Measurement; Performance; Deduplication; Windows; filesystem; data; study;

D O I：

10.1145/2078861.2078864

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

080201 [机械制造及其自动化];

摘要：

We collected file system content data from 857 desktop computers at Microsoft over a span of 4 weeks. We analyzed the data to determine the relative efficacy of data deduplication, particularly considering whole-file versus block-level elimination of redundancy. We found that whole-file deduplication achieves about three quarters of the space savings of the most aggressive block-level deduplication for storage of live file systems, and 87% of the savings for backup images. We also studied file fragmentation, finding that it is not prevalent, and updated prior file system metadata studies, finding that the distribution of file sizes continues to skew toward very large unstructured files.

引用

页数：20