Intelligent Resource Allocations for IRS-Assisted OFDM Communications: A Hybrid MDQN-DDPG Approach

Autor:	Wu, Wei, Yang, Fengchun, Zhou, Fuhui, Hu, Han, Wu, Qihui, Hu, Rose Qingyang
Rok vydání:	2022
Předmět:	Computer Science - Networking and Internet Architecture Electrical Engineering and Systems Science - Signal Processing
Druh dokumentu:	Working Paper
Popis:	In this paper, we study the resource allocation problem for an intelligent reflecting surface (IRS)-assisted OFDM system. The system sum rate maximization framework is formulated by jointly optimizing subcarrier allocation, base station transmit beamforming and IRS phase shift. Considering the continuous and discrete hybrid action space characteristics of the optimization variables, we propose an efficient resource allocation algorithm combining multiple deep Q networks (MDQN) and deep deterministic policy-gradient (DDPG) to deal with this issue. In our algorithm, MDQN are employed to solve the problem of large discrete action space, while DDPG is introduced to tackle the continuous action allocation. Compared with the traditional approaches, our proposed MDQN-DDPG based algorithm has the advantage of continuous behavior improvement through learning from the environment. Simulation results demonstrate superior performance of our design in terms of system sum rate compared with the benchmark schemes. Comment: 6 pages, 6 figures, accept by ICC 2022
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2202.05017 Zobrazit plný text záznamu View this record from Arxiv