DQN based user association control in hierarchical mobile edge computing systems for mobile IoT services

  • Lee, Yunseong; 
  • Masood, Arooj.; 
  • Noh, Wonjong.; 
  • Cho, Sungrae
Citations

WEB OF SCIENCE

11
Citations

SCOPUS

12

초록

This paper proposes a new user association control method to maximize system utility in terms of system throughput, edge throughput, and handover cost in mmWave-based HMEC (mm-HMEC) systems. We first formulated a non-convex mathematical programming model and then proposed centralized and distributed deep Q-network (DQN)-based range expansion bias control algorithms. We discovered that the proposed schemes provided polynomial communication overhead and computation complexity. Through simulations, we evaluated the proposed centralized and distributed schemes under various user equipment (UE) mobility models: random waypoint mobility model (RWM), random direction mobility model (RDM), and Manhattan mobility model (MAN). We first confirmed that the proposed distributed control achieves almost the same performance as the proposed centralized control. Second, with 10 slave-MEC servers, the proposed distributed control provides 212.17%, 62.07%, 46.36%, and 48.63% enhanced utility; 33.68%, 18.19%, 9.28%, and 12.66% enhanced average cell throughput; 14.32%, 38.32%, 63.87%, and 24.57% enhanced edge throughput; and 39.09%, 25.42%, 29.32%, and 25.95% reduced handover cost compared to random cell range expansion (CRE), standard CRE, dynamic CRE, and Q-learning-based CRE, respectively. © 2022 Elsevier B.V.

키워드

Edge computing; Heterogeneous computing system; Machine learning; Mobile networks; Mobility based services; Resource allocation; HETEROGENEOUS NETWORKS; BACKHAUL; MANAGEMENT
제목
DQN based user association control in hierarchical mobile edge computing systems for mobile IoT services
저자
Lee, Yunseong; Masood, Arooj.; Noh, Wonjong.; Cho, Sungrae
DOI
10.1016/j.future.2022.07.004
발행일
2022-12
유형
Article
저널명
Future Generation Computer Systems
권
137
페이지
53 ~ 69