5G and edge: A reinforcement learning approach for Virtual Network Embedding with cost optimization and improved acceptance rate

Autor(es)

Moreira, Cristiano L. ; Kamienski, Carlos A. ; Bianchi, Reinaldo A. C.

• Tipo de documento: Artigo Científico
• Fonte: Computer Networks; v. 247, p. 15-pg., 2024-05-02.

Resumo

5G technologies are fueling a revolution across numerous industries, including manufacturing, healthcare, and entertainment, by enabling the development and deployment of novel applications at the network's edge. To meet the demanding service level agreements of these industries, a dynamic and adaptable infrastructure strategy that combines cloud and edge computing models is needed. This hybrid approach offers the benefits of both centralized cloud processing and decentralized edge computing, optimized for responsiveness and efficiency. A key element for success is an orchestration mechanism that dynamically allocates resources to ensure the infrastructure can adapt to fluctuating demands in real time, optimizing resource utilization and meeting SLA requirements. Among these mechanisms, virtual network embedding (VNE) and dynamic resource management (DRM) have emerged as tools for defining where and how edge technology should be used. However, current VNE approaches struggle to adapt to real-time fluctuations in demand across geographically distributed edge resources. This work introduces a novel resource allocation algorithm, the VNECRS, which uses an Artificial Intelligence technique called Reinforcement Learning to orchestrate resources across multiple domains. This approach benefits from the strength of Reinforcement Learning: its ability to consider the entire problem from beginning to end while incorporating various aspects of 5G Quality of Service Indicators for optimal decision-making. Experiments were conducted to evaluate the performance of VNE-CRS against state-of-the-art algorithms for multi-domain edge environments. Results have shown that employing Reinforcement Learning techniques for VNE resource allocation yields performance gains of 12.32 percentage points in comparison with the GRC algorithm and 28.80 percentage points in comparison with the base edge environment, presenting an acceptability rate closer to the Public Cloud environment with all benefits of edge environment. In conclusion, VNE-CRS offers an efficient solution for resource allocation in 5G environments, achieving superior performance and transforming the VNE architecture into a comprehensive orchestration system that optimizes infrastructure utilization for strategic long-term benefits. (AU)

• Processo FAPESP: 19/07665-4 - Centro de Inteligência Artificial
• Beneficiário: Fabio Gagliardi Cozman
• Modalidade de apoio: Auxílio à Pesquisa - Programa eScience e Data Science - Centros de Pesquisa em Engenharia
• Processo FAPESP: 18/25225-9 - Centro de Pesquisa e Análise de São Paulo
• Beneficiário: Sergio Ferraz Novaes
• Modalidade de apoio: Auxílio à Pesquisa - Projetos Especiais