Skip to search boxSkip to navigationSkip to main content

Deep reinforcement learning for dynamic power allocation in cell-free mmwave massive MIMO

Output:
Chapter in Book/Report/Conference proceeding
Conference contribution
Academic
Peer-review

Open access

Information

Output type

Output:
Chapter in Book/Report/Conference proceeding
Conference contribution
Academic
Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 33-45 (13 pages)

Publication milestones

  • Published - 2021

Publication status

Published - 2021

Publisher

SciTePress Digital Library

ISBN (Electronic)

978-989-758-529-6

Host publication title

Proceedings of the 18th International Conference on Wireless Networks and Mobile Systems, WINSYS 2021

Host publication editors

  • Joel Rodrigues
  • Jaime Lloret Mauri

Related Event

Title

18th International Conference on Wireless Networks and Mobile Systems, WINSYS 2021

Event type

Conference

Date

07/07/2021 - 09/07/2021

Location

Virtual, Online

Abstract

Numerical optimization has been investigated for decades to solve complex problems in wireless communication systems. This has resulted in many effective methods, e.g., the weighted minimum mean square error (WMMSE) algorithm. However, these methods often incur a high computational cost, making their application to time-constrained problems difficult. Recently data-driven methods have attracted a lot of attention due to their near-optimal performance with affordable computational cost. Deep reinforcement learning (DRL) is one of the most promising optimization methods for future wireless communication systems. In this paper, we investigate the DRL method, using a deep Q-network (DQN), to allocate the downlink transmission power in cell-free (CF) mmWave massive multiple-input multiple-output (MIMO) systems. We consider the sum spectral efficiency (SE) optimization for systems with mobile user equipment (UEs). The DQN is trained by the rewards of trial-and-error interactions with the environment over time. It takes as input the long-term fading information and it outputs the downlink transmission power values. The numerical results, obtained for a particular 3GPP scenario, show that DQN outperforms WMMSE in terms of sum-SE and has a much lower computational complexity.

Bibliographical Note

Publisher Copyright: Copyright © 2021 by SCITEPRESS - Science and Technology Publications, Lda. All rights reserved

Metrics

Metrics

Scopus
citations
1
SciVal
citations
1
SciVal
FWCI
0.16
SciVal
Author count
3
SciVal
Paper percentile
30

PlumX, opens in new tab

Captures
5
Citation count
1