Distributed Deep Reinforcement Learning Assisted Resource Allocation Algorithm for Space-Air-Ground Integrated Networks

To realize the Interconnection of Everything (IoE) in the 6G vision, the space-based, air-based, and ground-based networks have shown a trend of integration. Compared with the traditional communications system, Space-Air-Ground Integrated Networks (SAGINs) can provide a seamless global network connection, while making full use of different network characteristics for synergy and complementarity. However, the increasing global coverage of the Internet, the growing number and variety of smart terminals, and the emergence of various high-bandwidth services have led to an explosion in communication data transmission. Despite the continuous development of communication technologies such as airborne processing and forwarding and high-throughput satellites, the quality of service (QoS) and quality of experience (QoE) for different users still cannot be guaranteed due to the power limitations of satellites and the scarcity of spectrum resources. In this work, drawing on wireless edge caching, considering that the relay of SAGIN has edge caching capability, the hot task is cached in the network nodes in advance. More, this process is optimized using distributed Deep Reinforcement Learning (DRL), thereby reducing transmission delay and relieving the pressure of task offloading on space-based networks. Compared with advanced related works, the long-term node utilization, link utilization, long-term average revenue-to-cost ratio and acceptance ratio of the proposed algorithm are increased by about 4.22%, 31.36%;, 11.75% and 7.14%, respectively.