QTCP: Adaptive Congestion Control with Reinforcement Learning
| Autor: | Fan Zhou, Wei Li, Waleed Meleis, Kaushik R. Chowdhury |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Network architecture
Computer Networks and Communications business.industry Computer science Distributed computing 05 social sciences 050801 communication & media studies 020206 networking & telecommunications 02 engineering and technology Computer Science Applications Network congestion 0508 media and communications Function approximation Control and Systems Engineering Next-generation network 0202 electrical engineering electronic engineering information engineering Reinforcement learning The Internet Quality of experience business Coding (social sciences) |
| Zdroj: | IEEE Transactions on Network Science and Engineering. 6:445-458 |
| ISSN: | 2334-329X |
| DOI: | 10.1109/tnse.2018.2835758 |
| Popis: | Next generation network access technologies and Internet applications have increased the challenge of providing satisfactory quality of experience for users with traditional congestion control protocols. Efforts on optimizing the performance of TCP by modifying the core congestion control method depending on specific network architectures or apps do not generalize well under a wide range of network scenarios. This limitation arises from the rule-based design principle, where the performance is linked to a pre-decided mapping between the observed state of the network to the corresponding actions. Therefore, these protocols are unable to adapt their behavior in new environments or learn from experience for better performance. We address this problem by integrating a reinforcement-based Q-learning framework with TCP design in our approach called QTCP. QTCP enables senders to gradually learn the optimal congestion control policy in an on-line manner. QTCP does not need hard-coded rules, and can therefore generalize to a variety of different networking scenarios. Moreover, we develop a generalized Kanerva coding function approximation algorithm, which reduces the computation complexity of value functions and the searchable size of the state space. We show that QTCP outperforms the traditional rule-based TCP by providing 59.5 percent higher throughput while maintaining low transmission latency. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|