Jointly dampening traffic oscillations and improving energy consumption with electric, connected and automated vehicles: A reinforcement learning based approach
Journal article, 2020

It has been well recognized that human driver's limits, heterogeneity, and selfishness substantially compromise the performance of our urban transport systems. In recent years, in order to deal with these deficiencies, our urban transport systems have been transforming with the blossom of key vehicle technology innovations, most notably, connected and automated vehicles. In this paper, we develop a car following model for electric, connected and automated vehicles based on reinforcement learning with the aim to dampen traffic oscillations (stop-and-go traffic waves) caused by human drivers and improve electric energy consumption. Compared to classical modelling approaches, the proposed reinforcement learning based model significantly reduces the modelling constraints and has the capability of self-learning and self-correction. Experiment results demonstrate that the proposed model is able to improve travel efficiency by reducing the negative impact of traffic oscillations, and it can also reduce the average electric energy consumption.

Connected and automated vehicles

Reinforcement learning

Car following

Traffic oscillations

Deep Deterministic Policy Gradient

Energy consumption

Machine learning

Electric vehicles

Author

Xiaobo Qu

Chalmers, Architecture and Civil Engineering, GeoEngineering

Yang Yu

Chalmers, Architecture and Civil Engineering, GeoEngineering

University of Technology Sydney

M. F. Zhou

Tencent

Chin Teng Lin

University of Technology Sydney

Xiangyu Wang

Curtin University

Kyung Hee University

East China Jiaotong University

Applied Energy

0306-2619 (ISSN)

Vol. 257 January 114030

Subject Categories

Transport Systems and Logistics

Other Engineering and Technologies not elsewhere specified

Vehicle Engineering

DOI

10.1016/j.apenergy.2019.114030

More information

Latest update

11/11/2019