The Library
Composite experience replay based deep reinforcement learning with application in wind farm control
Tools
Tools
Tools
Dong, Hongyang and Zhao, Xiaowei (2021) Composite experience replay based deep reinforcement learning with application in wind farm control. IEEE Transactions on Control Systems Technology . doi:10.1109/TCST.2021.3102476 (In Press)
|
PDF
WRAP-Composite-experience-replay-based-deep-wind-farm-control-2021.pdf - Accepted Version - Requires a PDF viewer. Download (9Mb) | Preview |
Official URL: https://doi.org/10.1109/TCST.2021.3102476
Abstract
In this article, a deep reinforcement learning (RL)-based control approach with enhanced learning efficiency and effectiveness is proposed to address the wind farm control problem. Specifically, a novel composite experience replay (CER) strategy is designed and embedded in the deep deterministic policy gradient (DDPG) algorithm. CER provides a new sampling scheme that can mine the information of stored transitions in-depth by making a tradeoff between rewards and temporal difference (TD) errors. Modified importance-sampling weights are introduced to the training process of neural networks (NNs) to deal with the distribution mismatching problem induced by CER. Then, our CER-DDPG approach is applied to optimizing the total power production of wind farms. The main challenge of this control problem comes from the strong wake effects among wind turbines and the stochastic features of environments, rendering it intractable for conventional control approaches. A reward regularization process is designed along with the CER-DDPG, which employs an additional NN to handle the bias of rewards caused by the stochastic wind speeds. Tests with a dynamic wind farm simulator (WFSim) show that our method achieves higher rewards with less training costs than conventional deep RL-based control approaches, and it has the ability to increase the total power generation of wind farms with different specifications.
| Item Type: | Journal Article | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Subjects: | Q Science > Q Science (General) Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software T Technology > TJ Mechanical engineering and machinery |
||||||||
| Divisions: | Faculty of Science > Engineering | ||||||||
| Library of Congress Subject Headings (LCSH): | Intelligent control systems , Wind power plants , Reinforcement learning , Neural networks (Computer science) | ||||||||
| Journal or Publication Title: | IEEE Transactions on Control Systems Technology | ||||||||
| Publisher: | IEEE | ||||||||
| ISSN: | 1063-6536 | ||||||||
| Official Date: | 2021 | ||||||||
| Dates: |
|
||||||||
| DOI: | 10.1109/TCST.2021.3102476 | ||||||||
| Status: | Peer Reviewed | ||||||||
| Publication Status: | In Press | ||||||||
| Publisher Statement: | © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. | ||||||||
| Access rights to Published version: | Restricted or Subscription Access | ||||||||
| RIOXX Funder/Project Grant: |
|
Request changes or add full text files to a record
Repository staff actions (login required)
 |
View Item |
Downloads
Downloads per month over past year
