Learning Negotiating Behavior Between Cars in Intersections using Deep Q-Learning
Paper in proceedings, 2018

This paper concerns automated vehicles negotiating with other vehicles, typically human driven, in crossings with the goal to find a decision algorithm by learning typical behaviors of other vehicles. The vehicle observes distance and speed of vehicles on the intersecting road and use a policy that adapts its speed along its pre-defined trajectory to pass the crossing efficiently. Deep Q-learning is used on simulated traffic with different predefined driver behaviors and intentions. The results show a policy that is able to cross the intersection avoiding collision with other vehicles 98% of the time, while at the same time not being too passive. Moreover, inferring information over time is important to distinguish between different intentions and is shown by comparing the collision rate between a Deep Recurrent Q-Network at 0.85% and a Deep Q-learning at 1.75%.

Author

Tommy Tram

Zenuity

Chalmers, Electrical Engineering, Systems and control, Mechatronics

Anton Jansson

Zenuity

Robin Grönberg

Zenuity

Mohammad Ali

Zenuity

Jonas Sjöberg

Chalmers, Electrical Engineering, Systems and control, Mechatronics

IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC

Vol. 2018-November 3169-3174 8569316

IEEE International Conference on Intelligent Transportation Systems
Maui, USA,

Areas of Advance

Transport

Subject Categories

Robotics

Control Engineering

DOI

10.1109/ITSC.2018.8569316

More information

Latest update

3/12/2019