Introducing reinforcement learning to the energy system design process
Journal article, 2020

Design optimization of distributed energy systems has become an interest of a wider group of researchers due the capability of these systems to integrate non-dispatchable renewable energy technologies such as solar PV and wind. White box models, using linear and mixed integer linear programing techniques, are often used in their design. However, the increased complexity of energy flow (especially due to cyber-physical interactions) and uncertainties challenge the application of white box models. This is where data driven methodologies become effective, as they demonstrate higher flexibility to adapt to different environments, which enables their use for energy planning at regional and national scale. This study introduces a data driven approach based on reinforcement learning to design distributed energy systems. Two different neural network architectures are used in this work, i.e. a fully connected neural network and a convolutional neural network (CNN). The novel approach introduced is benchmarked using a grey box model based on fuzzy logic. The grey box model showed a better performance when optimizing simplified energy systems, however it fails to handle complex energy flows within the energy system. Reinforcement learning based on fully connected architecture outperformed the grey box model by improving the objective function values by 60%. Reinforcement learning based on CNN improved the objective function values further (by up to 20% when compared to a fully connected architecture). The results reveal that data-driven models are capable to conduct design optimization of complex energy systems. This opens a new pathway in designing distributed energy systems.

Machine learning

Distributed energy systems

Reinforcement learning

Energy hubs


Data driven models


Amarasinghage Tharindu Dasun Perera

Ecole Polytechnique Federale De Lausanne

Forschungsinstitution fur Materialwissenschaften Und Technologie Eth-Bereichs

P. U. Wickramasinghe

Ecole Polytechnique Federale De Lausanne

Vahid Nik

Chalmers, Architecture and Civil Engineering, Building Technology

Queensland University of Technology (QUT)

Lund University

J. L. Scartezzini

Ecole Polytechnique Federale De Lausanne

Applied Energy

0306-2619 (ISSN)

Vol. 262 114580

Subject Categories

Embedded Systems

Energy Systems

Computer Systems



More information

Latest update