The Earth System Grid: Supporting the next generation of climate modeling research

被引:94
作者
Bernholdt, D [1 ]
Bharathi, S
Brown, D
Chanchio, K
Chen, ML
Chervenak, A
Cinquini, L
Drach, B
Foster, I
Fox, P
Garcia, J
Kesselman, C
Markel, R
Middleton, D
Nefedova, V
Pouchard, L
Shoshani, A
Sim, A
Strand, G
Williams, D
机构
[1] Oak Ridge Natl Lab, Oak Ridge, TN 37831 USA
[2] Univ So Calif, Inst Informat Sci, Marina Del Rey, CA 90292 USA
[3] Natl Ctr Atmospher Res, Boulder, CO 80305 USA
[4] Lawrence Livermore Natl Lab, Livermore, CA 94550 USA
[5] Argonne Natl Lab, Argonne, IL 60439 USA
[6] Univ Calif Berkeley, Lawrence Berkeley Lab, Berkeley, CA 94720 USA
关键词
climate modeling; data management; Earth System Grid (ESG); grid computing;
D O I
10.1109/JPROC.2004.842745
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Understanding the earth's climate system and how it might be changing is a preeminent scientific challenge. Global climate models are used to simulate past, present, and future climates, and experiments are executed continuously on ail array of distributed supercomputers. The resulting data archive, spread over several sites, currently contains upwards of 100 TB of simulation data and is growing rapidly Looking toward mid-decade and beyond, we must anticipate and prepare for distributed climate research data holdings of many petabytes. The Earth S stein Grid (ESG) is a collaborative interdisciplinary project aimed at addressing the challenge of enabling management, discovery, access, and analysis of these critically important datasets in a distributed and heterogeneous computational environment. The problem is fundamentally a Grid problem. Building upon the Globus toolkit and a variety of other technologies, ESG is developing an environment that addresses authentication, authorizationfor data access, large-scale data transport and management, services and abstractions for high-performance remote data access, mechanisinsfor scalable data replication, cataloging with rich semantic and syntactic information, data discovery, distributed monitoring, and Web-based portals,for using the system.
引用
收藏
页码:485 / 495
页数:11
相关论文
共 30 条
  • [1] Data management and transfer in high-performance computational grid environments
    Allcock, B
    Bester, J
    Bresnahan, J
    Chervenak, AL
    Foster, I
    Kesselman, C
    Meder, S
    Nefedova, V
    Quesnel, D
    Tuecke, S
    [J]. PARALLEL COMPUTING, 2002, 28 (05) : 749 - 771
  • [2] Allcock W., 2001, GRIDFTP PROTOCOL EXT
  • [3] ATKINSON M, 2004, GRID BLUEPRINT NEW C
  • [4] AVERY P, 2001, GRIPHYN PROJECT PETA
  • [5] BARU C, 1998, 8 ANN IBM CTR ADV SU
  • [6] Blackmon M, 2001, B AM METEOROL SOC, V82, P2357, DOI 10.1175/1520-0477(2001)082<2357:TCCSM>2.3.CO
  • [7] 2
  • [8] A national-scale authentication infrastructure
    Butler, R
    Welch, V
    Engert, D
    Foster, I
    Tuecke, S
    Volmer, J
    Kesselman, C
    [J]. COMPUTER, 2000, 33 (12) : 60 - +
  • [9] CARON J, 2003, NETCDF MARKUP LANGUA
  • [10] High-performance remote access to climate simulation data: a challenge problem for data grid technologies
    Chervenak, A
    Deelman, E
    Kesselman, C
    Allcock, B
    Foster, I
    Nefedova, V
    Lee, J
    Sim, A
    Shoshahi, A
    Drach, B
    Williams, D
    Middleton, D
    [J]. PARALLEL COMPUTING, 2003, 29 (10) : 1335 - 1356