A novel deep deterministic policy gradient model applied to intelligent transportation system security problems in 5G and 6G network scenarios

Author(s)

Ribeiro, David Augusto ; Melgarejo, Dick Carrillo ; Saadi, Muhammad ; Rosa, Renata Lopes ; Rodriguez, Demostenes Zegarra

• Document type: Journal article
• Source: PHYSICAL COMMUNICATION; v. 56, p. 10-pg., 2023-02-01.

Abstract

Traffic congestion has been an actual problem in large cities, causing personal inconvenience and environmental pollution. To solve this problem, new applications for Intelligent Transportation System (ITS) have been created, to monitor actual traffic conditions. Therefore, fast, reliable and safe systems are desirable for creating a real intelligent transportation environment. Deep learning algorithms have been proposed for a better understanding of traffic behavior from a security-related perspective. Thus, we aim to maximize the safety problems using a deep learning algorithm, where a novel policy gradient model is presented for detecting vehicular misuse. The proposed model uses a triple network replay algorithm, maximizing the network convergence speed. Three networks are selected to optimize the policy network variables. Finally, the replay algorithm is partitioned with the aim of obtaining a faster model. Simulations on a real urban map are performed in a scenario with the integration of 5G or 6G networks. An architectural model for the integration of a Vehicular Ad-hoc Network (VANET) and cellular networks is determined in software-defined networking (SDN). The results show that the accuracy prediction of the proposed system presents better performance compared to related studies, where the proposed model increases its convergence speed and cumulative reward. Thus, the ITS improvement by the proposed deep learning algorithm increases the prediction accuracy, and reduces the transmission delay, treating the traffic path according to the congestion. (c) 2022 Elsevier B.V. All rights reserved. (AU)

• FAPESP's process: 18/26455-8 - Audio-Visual Speech Processing by Machine Learning
• Grantee: Miguel Arjona Ramírez
• Support Opportunities: Regular Research Grants