A Hybrid Multiagent Framework With Q-Learning for Power Grid Systems Restoration

被引:70
作者
Ye, Dayong [1 ]
Zhang, Minjie [1 ]
Sutanto, Danny [2 ]
机构
[1] Univ Wollongong, Sch Comp Sci & Software Engn, Wollongong, NSW 2522, Australia
[2] Univ Wollongong, Sch Elect Comp & Telecommun Engn, Wollongong, NSW 2522, Australia
基金
澳大利亚研究理事会;
关键词
Hybrid solution; multiagent systems; Q-learning;
D O I
10.1109/TPWRS.2011.2157180
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
080906 [电磁信息功能材料与结构]; 082806 [农业信息与电气工程];
摘要
This paper presents a hybrid multiagent framework with a Q-learning algorithm to support rapid restoration of power grid systems following catastrophic disturbances involving loss of generators. This framework integrates the advantages of both centralized and decentralized architectures to achieve accurate decision making and quick responses when potential cascading failures are detected in power systems. By using this hybrid framework, which does not rely on a centralized controller, the single point of failure in power grid systems can be avoided. Further, the use of the Q-learning algorithm developed in conjunction with the restorative framework can help the agents to make accurate decisions to protect against cascading failures in a timely manner without requiring a global reward signal. Simulation results demonstrate the effectiveness of the proposed approach in comparison with the typical centralized and decentralized approaches based on several evaluation attributes.
引用
收藏
页码:2434 / 2441
页数:8
相关论文
共 21 条
[1]
Buse D. P., 2003, IEEE Power & Energy Magazine, V1, P50, DOI 10.1109/MPAE.2003.1192026
[2]
CHIARIGLIONE L, FIPA 98 SPECIFICATIO
[3]
Coury DV, 2000, 2000 IEEE POWER ENGINEERING SOCIETY SUMMER MEETING, CONFERENCE PROCEEDINGS, VOLS 1-4, P1196, DOI 10.1109/PESS.2000.867549
[4]
Eder C., 2008, Q LEARNING
[5]
Even-Dar E., 2002, Computational Learning Theory. 15th Annual Conference on Computational Learning Theory, COLT 2002. Proceedings (Lecture Notes in Artificial Intelligence Vol.2375), P255
[6]
Gomes E.R., 2009, P ICML 09 MONTR QC C
[7]
Huang K., 2007, INT C INTELLIGENT SY, P1
[8]
Jung J, 2001, 2001 POWER ENGINEERING SOCIETY SUMMER MEETING, VOLS 1-3, CONFERENCE PROCEEDINGS, P1287, DOI 10.1109/PESS.2001.970258
[9]
Adaptation in load shedding under vulnerable operating conditions [J].
Jung, JW ;
Liu, CC ;
Tanimoto, SL ;
Vittal, V .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2002, 17 (04) :1199-1205
[10]
Reinforcement learning: A survey [J].
Kaelbling, LP ;
Littman, ML ;
Moore, AW .
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 1996, 4 :237-285