Attention Based Multi-Agent Reinforcement Learning for Demand Response in Grid-Responsive Buildings

Abstract

Integrating renewable energy resources and deploying energy management devices offer great opportunities to develop autonomous energy management systems in grid-responsive buildings. Demand response can promote enhancing demand flexibility and energy efficiency while reducing consumer costs. In this work, we propose a novel multi-agent deep reinforcement learning (MADRL) based approach to utilize real-time system information to facilitate demand response programs for minimizing electricity costs and efficient load shaping. Achieving real-time autonomous demand response in networks of buildings is challenging due to uncertain system parameters, the dynamic market price, and complex coupled operational constraints. To develop a scalable approach for automated demand response in networks of interconnected buildings, coordination between buildings is necessary to ensure demand flexibility and the grid's stability. We propose a MADRL technique that utilizes an actor-critic algorithm incorporating shared attention mechanism to enable effective real-time coordinated demand response in grid-responsive buildings. The presented case studies demonstrate the ability of the proposed MADRL approach to obtain decentralized cooperative policies without knowledge of building energy systems. The viability of the proposed control approach is also demonstrated by a reduction of over 6% net load demand compared to state-of-the-art reinforcement learning approaches.