The Globus Replica Location Service: Design and Experience

被引:29
作者
Chervenak, Ann L. [1 ]
Schuler, Robert [1 ]
Ripeanu, Matei [2 ]
Amer, Muhammad Ali [1 ]
Bharathi, Shishir [1 ]
Foster, Ian [3 ]
Iamnitchi, Adriana [4 ]
Kesselman, Carl [1 ]
机构
[1] Univ So Calif, Inst Informat Sci, Viterbi Sch Engn, Marina Del Rey, CA 90292 USA
[2] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V6T 1Z4, Canada
[3] Univ Chicago, Computat Inst, Chicago, IL 60637 USA
[4] Univ S Florida, Dept Comp Sci & Engn, Tampa, FL 33620 USA
基金
美国国家科学基金会;
关键词
Replica Location Service; replica management; grids; data management; PERFORMANCE;
D O I
10.1109/TPDS.2008.151
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Distributed computing systems employ replication to improve overall system robustness, scalability, and performance. A Replica Location Service (RLS) offers a mechanism to maintain and provide information about physical locations of replicas. This paper defines a design framework for RLSs that supports a variety of deployment options. We describe the RLS implementation that is distributed with the Globus Toolkit and is in production use in several Grid deployments. Features of our modular implementation include the use of soft-state protocols to populate a distributed index and Bloom filter compression to reduce overheads for distribution of index information. Our performance evaluation demonstrates that the RLS implementation scales well for individual servers with millions of entries and up to 100 clients. We describe the characteristics of existing RLS deployments and discuss how RLS has been integrated with higher-level data management services.
引用
收藏
页码:1260 / 1272
页数:13
相关论文
共 55 条
[1]   LIGO - THE LASER-INTERFEROMETER-GRAVITATIONAL-WAVE-OBSERVATORY [J].
ABRAMOVICI, A ;
ALTHOUSE, WE ;
DREVER, RWP ;
GURSEL, Y ;
KAWAMURA, S ;
RAAB, FJ ;
SHOEMAKER, D ;
SIEVERS, L ;
SPERO, RE ;
THORNE, KS ;
VOGT, RE ;
WEISS, R ;
WHITCOMB, SE ;
ZUCKER, ME .
SCIENCE, 1992, 256 (5055) :325-333
[2]  
ALLCOCK W, 2005, P SUP C SC 05
[3]  
[Anonymous], 2003, Journal of Grid Computing, DOI [10.1023/a:1024000426962, 10.1023/A:1024000426962, DOI 10.1023/A:1024000426962]
[4]  
[Anonymous], P 4 USENIX S INT TEC
[5]  
[Anonymous], 2007, P 21 ACM SIGOPS S OP
[6]  
BAUD JP, 2005, P 14 IEEE INT S HIGH
[7]   The Earth System Grid: Supporting the next generation of climate modeling research [J].
Bernholdt, D ;
Bharathi, S ;
Brown, D ;
Chanchio, K ;
Chen, ML ;
Chervenak, A ;
Cinquini, L ;
Drach, B ;
Foster, I ;
Fox, P ;
Garcia, J ;
Kesselman, C ;
Markel, R ;
Middleton, D ;
Nefedova, V ;
Pouchard, L ;
Shoshani, A ;
Sim, A ;
Strand, G ;
Williams, D .
PROCEEDINGS OF THE IEEE, 2005, 93 (03) :485-495
[8]  
BERRIMAN GB, 2003, P ASTR DAT AN SOFTW
[9]   Distributed processing of very large datasets with DataCutter [J].
Beynon, MD ;
Kurc, T ;
Catalyurek, U ;
Chang, CL ;
Sussman, A ;
Saltz, J .
PARALLEL COMPUTING, 2001, 27 (11) :1457-1478
[10]  
Bindel D., 2000, P 9 INT C ARCH SUPP