5G and edge: A reinforcement learning approach for Virtual Network Embedding with cost optimization and improved acceptance rate

Author(s)

Moreira, Cristiano L. ; Kamienski, Carlos A. ; Bianchi, Reinaldo A. C.

• Document type: Journal article
• Source: Computer Networks; v. 247, p. 15-pg., 2024-05-02.

Abstract

5G technologies are fueling a revolution across numerous industries, including manufacturing, healthcare, and entertainment, by enabling the development and deployment of novel applications at the network's edge. To meet the demanding service level agreements of these industries, a dynamic and adaptable infrastructure strategy that combines cloud and edge computing models is needed. This hybrid approach offers the benefits of both centralized cloud processing and decentralized edge computing, optimized for responsiveness and efficiency. A key element for success is an orchestration mechanism that dynamically allocates resources to ensure the infrastructure can adapt to fluctuating demands in real time, optimizing resource utilization and meeting SLA requirements. Among these mechanisms, virtual network embedding (VNE) and dynamic resource management (DRM) have emerged as tools for defining where and how edge technology should be used. However, current VNE approaches struggle to adapt to real-time fluctuations in demand across geographically distributed edge resources. This work introduces a novel resource allocation algorithm, the VNECRS, which uses an Artificial Intelligence technique called Reinforcement Learning to orchestrate resources across multiple domains. This approach benefits from the strength of Reinforcement Learning: its ability to consider the entire problem from beginning to end while incorporating various aspects of 5G Quality of Service Indicators for optimal decision-making. Experiments were conducted to evaluate the performance of VNE-CRS against state-of-the-art algorithms for multi-domain edge environments. Results have shown that employing Reinforcement Learning techniques for VNE resource allocation yields performance gains of 12.32 percentage points in comparison with the GRC algorithm and 28.80 percentage points in comparison with the base edge environment, presenting an acceptability rate closer to the Public Cloud environment with all benefits of edge environment. In conclusion, VNE-CRS offers an efficient solution for resource allocation in 5G environments, achieving superior performance and transforming the VNE architecture into a comprehensive orchestration system that optimizes infrastructure utilization for strategic long-term benefits. (AU)

• FAPESP's process: 19/07665-4 - Center for Artificial Intelligence
• Grantee: Fabio Gagliardi Cozman
• Support Opportunities: Research Grants - Research Program in eScience and Data Science - Research Centers in Engineering Program
• FAPESP's process: 18/25225-9 - São Paulo Research and Analysis Center
• Grantee: Sergio Ferraz Novaes
• Support Opportunities: Special Projects