Dynamic task scheduling method for relay satellite networks based on hierarchical reinforcement learning

Autor: Runzi LIU, Tianci MA, Weihua WU, Chenhong YAO, Qinghai YANG
Jazyk: čínština
Rok vydání: 2023
Předmět:
Zdroj: Tongxin xuebao, Vol 44, Pp 207-217 (2023)
Druh dokumentu: article
ISSN: 1000-436X
DOI: 10.11959/j.issn.1000-436x.2023130
Popis: In recent years, with the increasing number of various emergency tasks, how to control the impact on common tasks while ensuring system revenue has become a huge challenge for the dynamic scheduling of relay satellite networks.Aiming at this problem, with the goal of maximizing the total revenue of emergency tasks and minimizing the damage to common tasks, a dynamic task scheduling method for relay satellite networks based on hierarchical reinforcement learning was proposed.Specifically, in order to take into account the long-term and short-term performance of the system at the same time, a two-layer scheduling framework implemented by upper-level and lower-level DQN was designed.The upper-level DQN was responsible for determining the temporary optimization goal based on long-term performance, and the lower-level DQN determined the scheduling strategy for current task according to the optimization goal.Simulation results show that compared with traditional deep learning methods and the heuristic methods dealing with dynamic scheduling problems, the proposed method can improve the total revenue of urgent tasks while reducing the damage to common tasks.
Databáze: Directory of Open Access Journals