A Multi-Agent Deep Reinforcement Learning Based Voltage Regulation Using Coordinated PV Inverters

被引:157
作者
Cao, Di [1 ]
Hu, Weihao [1 ]
Zhao, Junbo [2 ]
Huang, Qi [1 ]
Chen, Zhe [3 ]
Blaabjerg, Frede [3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China
[2] Mississippi State Univ, Dept Elect & Comp Engn, Starkville, MS 39762 USA
[3] Aalborg Univ, Dept Energy Technol, DK-9220 Aalborg, Denmark
关键词
Voltage control; Training; Inverters; Markov processes; Games; Artificial neural networks; Real-time systems; Voltage regulation; multi-agent deep reinforcem-ent learning; coordinated control; distribution system; CONTROL STRATEGIES; NETWORK;
D O I
10.1109/TPWRS.2020.3000652
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
080906 [电磁信息功能材料与结构]; 082806 [农业信息与电气工程];
摘要
This paper proposes a multi-agent deep reinforcement learning-based approach for distribution system voltage regulation with high penetration of photovoltaics (PVs). The designed agents can learn the coordinated control strategies from historical data through the counter-training of local policy networks and centric critic networks. The learned strategies allow us to perform online coordinated control. Comparative results with other methods show the enhanced control capability of the proposed method under various conditions.
引用
收藏
页码:4120 / 4123
页数:4
相关论文
共 12 条
[1]
Network-Cognizant Voltage Droop Control for Distribution Grids [J].
Baker, Kyri ;
Bernstein, Andrey ;
Dall'Anese, Emiliano ;
Zhao, Changhong .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2018, 33 (02) :2098-2108
[2]
Iqbal S, 2019, PR MACH LEARN RES, V97
[3]
A centralized-based method to determine the local voltage control strategies of distributed generator operation in active distribution networks [J].
Ji, Haoran ;
Wang, Chengshan ;
Li, Peng ;
Zhao, Jinli ;
Song, Guanyu ;
Ding, Fei ;
Wu, Jianzhong .
APPLIED ENERGY, 2018, 228 :2024-2036
[4]
Distributed Voltage Control in Distribution Networks: Online and Robust Implementations [J].
Liu, Hao Jan ;
Shi, Wei ;
Zhu, Hao .
IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (06) :6106-6117
[5]
Lowe R, 2017, ADV NEUR IN, V30
[6]
Review of control strategies for voltage regulation of the smart distribution network with high penetration of renewable distributed generation [J].
Mahmud, Nasif ;
Zahedi, A. .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2016, 64 :582-595
[7]
Improved Low Voltage Grid-Integration of Photovoltaic Systems in Germany [J].
Stetz, Thomas ;
Marten, Frank ;
Braun, Martin .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2013, 4 (02) :534-542
[8]
Coordinated Active Power Curtailment of Grid Connected PV Inverters for Overvoltage Prevention [J].
Tonkoski, Reinaldo ;
Lopes, Luiz A. C. ;
El-Fouly, Tarek H. M. .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2011, 2 (02) :139-147
[9]
A Data-Driven Multi-Agent Autonomous Voltage Control Framework Using Deep Reinforcement Learning [J].
Wang, Shengyi ;
Duan, Jiajun ;
Shi, Di ;
Xu, Chunlei ;
Li, Haifeng ;
Diao, Ruisheng ;
Wang, Zhiwei .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2020, 35 (06) :4644-4654
[10]
Optimal Local Reactive Power Control by PV Inverters [J].
Weckx, Sam ;
Driesen, Johan .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2016, 7 (04) :1624-1633