Real-time Grid monitoring based on complex event processing

被引:29
作者
Balis, Bartosz [1 ]
Kowalewski, Bartosz [2 ]
Bubak, Marian [1 ,2 ]
机构
[1] AGH Univ Sci & Technol, Dept Comp Sci, PL-30059 Krakow, Poland
[2] Acad Comp Ctr CYFRONET AGH, PL-30950 Krakow, Poland
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2011年 / 27卷 / 08期
关键词
Grid computing; Real-time monitoring; Event-driven architecture; Complex event processing; Event correlation; SYSTEM;
D O I
10.1016/j.future.2011.04.005
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Monitoring systems in Grid infrastructures typically collect and aggregate data originating in distributed agents and store it in global, periodically refreshed repositories. However, in some scenarios access to real-time streams of monitoring information, rather than persistent data sets, would be beneficial. In this paper, we evaluate the Complex Event Processing (CEP) approach applied to real-time Grid monitoring and argue that CEP enables us to achieve two goals, otherwise difficult to combine: real-time access to monitoring data and advanced query capabilities. Monitoring for the purpose of dynamic allocation of Grid resources serves as a case study to demonstrate powerful real-time query capabilities provided by CEP. In addition, we show how to employ CEP for data reduction. For practical verification of our solution, a CEP-based Grid monitoring infrastructure, GEMINI2, has been developed. We have measured the overhead due to CEP-based monitoring and conclude that real-time Grid monitoring is possible without excessive intrusiveness for resources and network. (C) 2011 Elsevier B.V. All rights reserved.
引用
收藏
页码:1103 / 1112
页数:10
相关论文
共 19 条
[11]  
Funika W, 2010, LECT NOTES COMPUT SC, V6068, P115
[12]   Environmental Sensor Networks: A revolution in the earth system science? [J].
Hart, Jane K. ;
Martinez, Kirk .
EARTH-SCIENCE REVIEWS, 2006, 78 (3-4) :177-191
[13]  
Kowalewski B, 2008, LECT NOTES COMPUT SC, V5103, P358, DOI 10.1007/978-3-540-69389-5_41
[14]  
LEGRAND IC, 2004, CHEP 2004
[15]  
Prodan R., 2005, P 2005 ACM S APPL CO, P687, DOI DOI 10.1145/1066677.1066835
[16]  
SMALLEN S., 2007, GMW 07, P29, DOI DOI 10.1145/1272680.1272687
[17]   A Streaming Intrusion Detection System for Grid Computing Environments [J].
Smith, Matthew ;
Schwarzer, Fabian ;
Harbach, Marian ;
Noll, Thomas ;
Freisleben, Bernd .
HPCC: 2009 11TH IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2009, :44-51
[18]  
Truong H., 2004, SCI PROGRAMMING-NETH, V12, P225
[19]   Steering and visualization: Enabling technologies for computational science [J].
Wright, H. ;
Crompton, R. H. ;
Kharche, S. ;
Wenisch, P. .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2010, 26 (03) :506-513