Decision Making for Autonomous Vehicles at Signalized Intersection under Uncertain Traffic Signal Phase and Timing Information

Author(s)

Rodrigues da Silva, Junior Anderson ; Grassi Jr, Valdir ; Wolf, Denis Fernando ; IEEE

• Document type: Journal article
• Source: 2021 20TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR); v. N/A, p. 6-pg., 2021-01-01.

Abstract

In real environments, autonomous vehicles must be able to deal with uncertainties related to the measurements provided by their perception system. Not taking such perception uncertainties into account can lead the vehicle to take erroneous decisions and cause accidents. Excessive speed rate change variations and red light crossing at signalized intersections are special cases of this problem. This paper presents a decision making for autonomous vehicles that considers uncertainty in timing information, but also in traffic light color (signal phase) measurement at signalized intersections. A Partially Observable Markov Decision Problem (POMDP) model is proposed in order to deal with the problem of partially observability of both signal phase and timing. By incorporating the perception system uncertainty, the POMDP model can reliably predict signal phase transitions, avoiding reacting in a too reactive manner and running red lights. Results show that the proposed POMDP model is able to estimate the true values of the signal phase and timing as more observations are gathered, which allows better decisions when compared to deterministic approaches. (AU)

• FAPESP's process: 18/19732-5 - Decision making and trajectory planning for intelligent vehicles using partially observable Markov decision processes and inverse reinforcement learning
• Grantee: Júnior Anderson Rodrigues da Silva
• Support Opportunities: Scholarships in Brazil - Doctorate
• FAPESP's process: 14/50851-0 - INCT 2014: National Institute of Science and Technology for Cooperative Autonomous Systems Applied in Security and Environment
• Grantee: Marco Henrique Terra
• Support Opportunities: Research Projects - Thematic Grants