Deep Reinforcement Learning for Load-Balancing Aware Network Control in IoT Edge Systems

Qingzhi Liu, Tiancong Xia, Long Cheng (Corresponding author), Merijn van Eijk, Tanir Ozcelebi, Ying Mao

Research output: Contribution to journalArticleAcademicpeer-review

7 Citations (Scopus)


Load balancing is directly associated with the overall performance of a parallel and distributed computing system. Although the relevant problems in communication and computation have been well studied in data center environments, few works have considered the issues in an Internet of Things (IoT) edge scenario. In fact, processing data in a load balancing way for the latter case is more challenging. The main reason is that, unlike a data center, both the data sources and the network infrastructure in an IoT edge system can be dynamic. Moreover, with different performance requirements from IoT networks and edge servers, it will be hard to characterize the performance model and to perform runtime optimization for the whole system. To tackle this problem, in this work, we propose a load-balancing aware networking approach for efficient data processing in IoT edge systems. Specifically, we introduce an IoT network dynamic clustering solution using the emerging deep reinforcement learning (DRL), which can both fulfill the communication balancing requirements from IoT networks and the computation balancing requirements from edge servers. Moreover, we implement our system with a long short term memory (LSTM) based Dueling Double Deep Q-Learning Network (D3QN) model, and our experiments with real-world datasets collected from an autopilot vehicle demonstrate that our proposed method can achieve significant performance improvement compared to benchmark solutions.

Original languageEnglish
Pages (from-to)1491-1502
Number of pages12
JournalIEEE Transactions on Parallel and Distributed Systems
Issue number6
Publication statusPublished - 1 Jun 2022

Bibliographical note

Publisher Copyright:


  • Computational modeling
  • Data models
  • distributed systems
  • DRL
  • edge computing
  • Image edge detection
  • Internet of Things
  • IoT
  • Load balancing
  • Long short term memory
  • LSTM
  • networking
  • Sensors
  • Servers
  • network
  • deep reinforcement learning


Dive into the research topics of 'Deep Reinforcement Learning for Load-Balancing Aware Network Control in IoT Edge Systems'. Together they form a unique fingerprint.

Cite this