Reliable Cybertwin-Driven Concurrent Multipath Transfer With Deep Reinforcement Learning
| Autor: | Deyun Gao, Yuming Zhang, Xuemin Shen, Kang Liu, Chengxiao Yu, Hongke Zhang, Wei Quan, Wen Wu |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Artificial neural network
Computer Networks and Communications Computer science Wireless network Network packet Quality of service Distributed computing Reliability (computer networking) Throughput Computer Science Applications Scheduling (computing) Hardware and Architecture Signal Processing Reinforcement learning Information Systems |
| Zdroj: | IEEE Internet of Things Journal. 8:16207-16218 |
| ISSN: | 2372-2541 |
| Popis: | It is well known that concurrent multipath transfer (CMT) can improve the transmission rate. However, due to multiple heterogeneous paths from users to the access network, a large number of out-of-order packets significantly degrade the overall transmission reliability. Cybertwin provides a potential solution to alleviate the packet out-of-order problem by accurately detecting and perceiving the path state. In this article, we investigate the data scheduling problem and propose a learning-based cybertwin-driven CMT algorithm to obtain the optimal data scheduling policy. In particular, we first formulate the data scheduling problem as an integer linear programming by taking the QoS metrics into account. To cope with the packet out-of-order problem in CMT, we propose a reliable cybertwin-CMT with deep reinforcement learning (CMT-DRL) algorithm to determine the data scheduling decisions. The proposed algorithm takes multipath throughput, end-to-end delay, and packet loss rate into account. Besides, CMT-DRL adopts an asynchronous learning framework to efficiently execute data collection, packet scheduling, and neural network training in sequence by decoupling model training and execution. We conduct extensive experiments in a P4-based programmable network platform. Experimental results indicate that the CMT-DRL outperforms the existing benchmarks in terms of the number of out-of-order packets, round-trip time, and throughput. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|