Metropolis Criterion Based Fuzzy Q-Learning Energy Management for Smart Grids

Xin Li, Chuanzhi Zang, Wenwei Liu, Peng Zeng, Haibin Yu

Abstract


For the energy management problems for demand response in electricity grid, a Metropolis Criterion based fuzzy Q-learning consumer energy management controller (CEMC) is proposed. Because of the uncertainties and highly time-varying, it is not easy to accurately obtain the complete information for the consumer behavior in electricity grid. In this case, the Q-learning, which is independent of mathematic model, and prior-knowledge, has good performance. The fuzzy inference and Metropolis Criterion are introduced in order to facilitate generalization in large state space and balance exploration and exploitation in action selection in Q-learning individually. Simulation results show that the proposed controller can learn to take the best action to regulate consumer behavior with the features of low average end-user financial costs and high consumer satisfaction.

 

DOI: http://dx.doi.org/10.11591/telkomnika.v10i8.1626


Full Text:

PDF
Total views : 51 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

shopify stats IJEECS visitor statistics