Reinforcement-Learning-Based Spatial Resource Identification for IoT D2D Communications

Citations

WEB OF SCIENCE

3
Citations

SCOPUS

4

초록

The exponential growth of the Internet of Things (IoTs) has led to an increasing demand for intelligent IoT devices (IoTDs), requiring innovative network capacity expansion. Recently, several research has been conducted on the identification of hidden network resources for network capacity expansion. However, the spatial resource identification scheme through the omnidirectional antenna has limitations in terms of frequency efficiency compared to the scheme with the directional antenna. In this article, we propose a directional spatial-resource identification technique for device-to-device (D2D) communication. To find the optimal identification parameters, we design the objective function and apply a reinforcement learning. The training data used for reinforcement learning are collected in each report phase, and <formula><tex></tex></formula>-learning is applied to find the optimal beam set. Furthermore, based on the obtained frequency information, we propose a contention-based D2D communication scheme. The proposed contention-based D2D communication scheme can efficiently solve the deafness problem occurring in a directional D2D communication. Finally, we perform a simulation using optimum network performance (OPNET) to measure the performance and evaluate the effectiveness of the proposed technique. The simulation results show that the proposed schemes realize a better performance than the existing schemes proposed in previous works in terms of energy efficiency, frequency efficiency, aggregate network throughput, and deafness duration. IEEE

키워드

Deafness; Device-to-device (D2D) communication; Device-to-device communication; directional identification; Directive antennas; Internet of Things; Internet of Things (IoTs) networks; radio resource harvesting edge (RRHE); Sensors; Switches; Transmitting antennas; Directive antennas; Energy efficiency; Expansion; Internet of things; Omnidirectional antennas; Deviceto-device (D2D) communication; Directional Antenna; Frequency information; Identification parameters; Identification scheme; Identification techniques; Internet of thing (IoTs); Optimum network performance; Reinforcement learning
제목
Reinforcement-Learning-Based Spatial Resource Identification for IoT D2D Communications
저자
Na, Woongsoo; Dao, Nhu-Ngoc.; Cho, Sungrae
DOI
10.1109/JSYST.2021.3087167
발행일
2022-03
유형
Article
저널명
IEEE Systems Journal
권
16
호
1
페이지
1068 ~ 1079