Towards building a multi-datacenter infrastructure for massive remote sensing image processing

被引:31
作者
Zhang, Wanfeng [1 ,3 ]
Wang, Lizhe [1 ,2 ]
Liu, Dingsheng [1 ]
Song, Weijing [1 ]
Ma, Yan [1 ]
Liu, Peng [1 ]
Chen, Dan [2 ]
机构
[1] Chinese Acad Sci, Ctr Earth Observat & Digital Earth, Beijing, Peoples R China
[2] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
[3] Chinese Acad Sci, Grad Univ, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
data intensive computing; remote sensing image processing; multi-datacenter infrastructure; cloud computing; CLOUD;
D O I
10.1002/cpe.2966
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Earth observation applications are now facing the challenges of managing and processing massive data sets from multiple sources from large-scale distributed data centers (DCs). To solve this research problem, this paper presents an infrastructure of multiple data centers (MDC) for managing and processing massive remote sensing images. The proposed system is built on both groups of distributed DCs/clusters, which are equipped with DC or cluster resource manager. Access security and information service are introduced to support this architecture of MDC. We collaboratively organized the algorithm, and data belonged to the MDC in the manner of workflow. In practice, we succeeded in working out the concrete problems regarding procedures in processing applications collaboratively and transfer the massive remote sensing dataset fast and with stable cross-MDC. On the basis of the previously mentioned research work, we will investigate the platform integration of MDC. Copyright (c) 2012 John Wiley & Sons, Ltd.
引用
收藏
页码:1798 / 1812
页数:15
相关论文
共 25 条
  • [1] Berman F, 2003, GRID COMPUTING MAKIN, V2, P809
  • [2] Hybrid modelling and simulation of huge crowd over a hierarchical Grid architecture
    Chen, Dan
    Wang, Lizhe
    Wu, Xiaomin
    Chen, Jingying
    Khan, Samee U.
    Kolodziej, Joanna
    Tian, Mingwei
    Huang, Fang
    Liu, Wangyang
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2013, 29 (05): : 1309 - 1317
  • [3] The Globus Replica Location Service: Design and Experience
    Chervenak, Ann L.
    Schuler, Robert
    Ripeanu, Matei
    Amer, Muhammad Ali
    Bharathi, Shishir
    Foster, Ian
    Iamnitchi, Adriana
    Kesselman, Carl
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2009, 20 (09) : 1260 - 1272
  • [4] Chu KD, 2006, LECT NOTES COMPUT SC, V3947, P289
  • [5] Collins JP, 2010, SCIENCE, V327, P1
  • [6] Foster I, 2002, CHIMERA VIRTUAL DATA
  • [7] Condor-G: A Computation Management Agent for Multi-Institutional Grids
    James Frey
    Todd Tannenbaum
    Miron Livny
    Ian Foster
    Steven Tuecke
    [J]. Cluster Computing, 2002, 5 (3) : 237 - 246
  • [8] Garzoglio G, 2009, GLOBALLY DISTRIBUTED
  • [9] Goward SN, 1997, PHOTOGRAMM ENG REM S, V63, P887
  • [10] Gray J., 2007, eScience-A transformed scientific method