Deep reinforcement learning-based joint real-time energy scheduling for green buildings with heterogeneous battery energy storage devices
By: Chi Liu , Zhezhuang Xu , Jiawei Zhou and more
Potential Business Impact:
Saves money by smartly charging electric cars.
Green buildings (GBs) with renewable energy and building energy management systems (BEMS) enable efficient energy use and support sustainable development. Electric vehicles (EVs), as flexible storage resources, enhance system flexibility when integrated with stationary energy storage systems (ESS) for real-time scheduling. However, differing degradation and operational characteristics of ESS and EVs complicate scheduling strategies. This paper proposes a model-free deep reinforcement learning (DRL) method for joint real-time scheduling based on a combined battery system (CBS) integrating ESS and EVs. We develop accurate degradation models and cost estimates, prioritize EV travel demands, and enable collaborative ESS-EV operation under varying conditions. A prediction model optimizes energy interaction between CBS and BEMS. To address heterogeneous states, action coupling, and learning efficiency, the DRL algorithm incorporates double networks, a dueling mechanism, and prioritized experience replay. Experiments show a 37.94 percent to 40.01 percent reduction in operating costs compared to a mixed-integer linear programming (MILP) approach.
Similar Papers
Electric Bus Charging Schedules Relying on Real Data-Driven Targets Based on Hierarchical Deep Reinforcement Learning
Machine Learning (CS)
Makes electric buses charge smarter and cheaper.
Data-Driven Policy Mapping for Safe RL-based Energy Management Systems
Machine Learning (CS)
Saves money by making buildings use less energy.
Optimizing Electric Bus Charging Scheduling with Uncertainties Using Hierarchical Deep Reinforcement Learning
Machine Learning (CS)
Smarter electric buses charge faster and cheaper.