FlyReflect: Joint Flying IRS Trajectory and Phase Shift Design using Deep Reinforcement Learning

Citations

WEB OF SCIENCE

0
Citations

SCOPUS

56

초록

Aerial access infrastructures have been considered a compulsory component of the sixth-generation (6G) networks, where airborne vehicles play the role of mobile access points to service ground users from the sky. In this scenario, intelligent reflecting surface (IRS) is one of the promising technologies associated with airborne vehicles for coverage extensions and throughput improvements, a.k.a., flying IRS. This study considers a multi-user multiple-input single-output (MISO) flying IRS system, where the flying IRS reflects downlink signals from ground base stations to users located at underserved areas where direct communications are unavailable. To achieve the system sum-rate maximization, we proposed a deep reinforcement learning (DRL) algorithm named FlyReflect to jointly optimize the flying trajectory and IRS phase shift matrix. First, end-to-end communications from a base station to its ground users via the flying IRS are analyzed to identify environmental and operational factors that impact achievable system sum-rate. Subsequently, the system is transformed into a DRL model, which is resolvable by the deep deterministic policy gradient (DDPG) algorithm. To improve the action decision accuracy of the DDPG algorithm, we proposed a mapping function to guarantee that all constraints are satisfied regardless of noise additions in the exploration process. Simulation results showed that our proposed algorithm outperforms state-of-the-art algorithms in multiple scenarios. IEEE

키워드

Array signal processing; Autonomous aerial vehicles; deep reinforcement learning; Downlink; Flying reflection; intelligent reflecting surface; Internet of Things; MISO communication; Optimization; Trajectory; unmanned aerial vehicle; INTELLIGENT REFLECTING SURFACE; PASSIVE BEAMFORMING DESIGN; RELAY SELECTION; NETWORKS; ROBUST; BEAM
제목
FlyReflect: Joint Flying IRS Trajectory and Phase Shift Design using Deep Reinforcement Learning
저자
Truong, T.P.; Tuong, V.D.; Dao, N.; Cho, Sungrae
DOI
10.1109/JIOT.2022.3218740
발행일
2023-03
유형
Article
저널명
IEEE Internet of Things Journal
권
10
호
5
페이지
4605 ~ 4620