Joint Quantum Reinforcement Learning and Stabilized Control for Spatio-Temporal Coordination in Metaverse

  • Park, Soohyun; 
  • Chung, Jaehyun; 
  • Park, Chanyoung; 
  • Jung, Soyi; 
  • Choi, Minseok; 
  • ... Cho, Sungrae; 
  • 외 1명
Citations

WEB OF SCIENCE

26
Citations

SCOPUS

36

초록

In order to build realistic metaverse systems, enabling high synchronization between physical-space and virtual meta-space is essentially required. For this purpose, this paper proposes a novel system-wide coordination algorithm for high synchronization under characteristics (i.e., highly realistic meta-space construction under the constraints of physical-space). The proposed algorithm consists of the following three stages. The first stage is quantum multi-agent reinforcement learning (QMARL)-based scheduling for low-delay temporal-synchronization using differentiated age-of-information (AoI) during data gathering in physical-space by observers for meta-space construction. This is beneficial for scalability according to action dimension reduction in reinforcement learning computation. The second stage is for creating virtual contents under delay constraints in meta-space based on the gathered data. When rendering regions that have received more user attention, avatar-popularity is considered for spatio-synchronization. Thus, a stabilized control mechanism is designed for time-average reality quality maximization for each region. The last stage is for caching based on avatar-popularity and AoI which can be helpful in constructing low-delay realistic meta-space. Furthermore, the concept of AoI is divided into two separate sub-concepts of physical AoI and virtual AoI such that the AoI in virtual meta-space can be thoroughly implemented. IEEE

키워드

Age-of-Information; Avatars; Metaverse; Metaverse; Observers; Quantum computing; Quantum Reinforcement Learning; Reinforcement learning; Servers; Synchronization; Synchronization; SERVICES; NETWORK; AWARE
제목
Joint Quantum Reinforcement Learning and Stabilized Control for Spatio-Temporal Coordination in Metaverse
저자
Park, Soohyun; Chung, Jaehyun; Park, Chanyoung; Jung, Soyi; Choi, Minseok; Cho, Sungrae; Kim, Joongheon
DOI
10.1109/TMC.2024.3407883
발행일
2024-12
유형
Article
저널명
IEEE Transactions on Mobile Computing
권
23
호
12
페이지
12410 ~ 12427