Reinforcement learning based routing for time-aware shaper scheduling in time-sensitive networks

Citations

WEB OF SCIENCE

16
Citations

SCOPUS

22

초록

To guarantee real-time performance and quality-of-service (QoS) of time-critical industrial systems, time-aware shaper (TAS) in time-sensitive networking (TSN) controls frame transmission times in a bridged network using a scheduled gate control mechanism. However, most TAS scheduling methods generate schedules based on pre-configured routes without exploring alternatives for better schedulability, and methods that jointly consider routing and scheduling require enormous runtime and computing resources. To address this problem, we propose a TSN Scheduler with Reinforcement Learning-based Routing (TSLR) that identifies improved load balanced routes for higher schedulability with acceptable complexity using distributional reinforcement learning. We evaluate TSLR through TSN simulations and compare it against state-of-the-art algorithms to demonstrate that TSLR effectively improves TAS schedulability and link utilization in TSN with lower complexity. Specifically, TSLR shows a more than 66% increase in schedulability compared to the other algorithms, and TSLR's scheduling time is reduced by more than 1 h. It also shows flows’ transmission latency is less than 25% of their latency deadline requirement and reduces maximum link utilization by approximately 50%. © 2023 The Author(s)

키워드

Network performance evaluation; Network simulation; Reinforcement learning; Routing; Scheduling; Time-Aware Shaper; TAS; Time-Sensitive Network; TSN
제목
Reinforcement learning based routing for time-aware shaper scheduling in time-sensitive networks
저자
Min, Junhong; Kim, Yongjun; Kim, Moonbeom; Paek, Jeongyeup; Govindan, Ramesh
DOI
10.1016/j.comnet.2023.109983
발행일
2023-11
유형
Article
저널명
Computer Networks
권
235

파일 다운로드

Thumbnail