LSTM with spatiotemporal attention for IoT-based wireless sensor collected hydrological time-series forecasting
Citations

WEB OF SCIENCE

10
Citations

SCOPUS

14

초록

It is necessary to accurately assess the inflow and infiltration conditions in sewer systems if sewer overflows are to be avoided. In this regard, Long Short-Term Memory (LSTM) is widely utilized for hydrological time-series forecasting. However, hydrological time-series have been found to be highly nonlinear and dynamic, such that the original LSTM model cannot simultaneously consider the spatiotemporal correlations of the input sequences for water flow rate forecasting. To address this problem, we propose using an LSTM with spatiotemporal attention (LSTM-STA) model, one based on encoder-decoder architecture, as this will allow accurate forecasting of the water flow rate. The encoder incorporates a spatial attention mechanism module allowing it to adaptively capture the key spatial attributes from all related spatial attributes at each time step. The decoder also incorporates a temporal attention mechanism module for dynamically discovering the key encoder hidden states from all time steps in the window. Using the spatiotemporal attention mechanism, the LSTM-STA model comprehensively considers all the important factors influencing the water flow rate forecasting, in both temporal and spatial dimensions. We performed extensive experiments; applying the LSTM-STA model to real-world hydrological time-series datasets, each one containing 52,704 sampled data points while leveraging state-of-the-art SVR-rbf, MLP, CNN1D, GRU, LSTM, Encoder-Decoder, LSTM-SA, and LSTM-TA as baselines. The experimental results demonstrated that the LSTM-STA model outperforms the state-of-the-art baseline models. Specifically, the LSTM-STA model yields the lowest RMSE, MAE, MAPE, and the highest R2 in the test process, said values being 73.19, 33.37, 1.09, and 0.99858, respectively. We also verified the stability and hyperparameter sensitivity of the LSTM-STA model. Furthermore, we visualized the spatial attention weights and benefitted from spatial interpretability. © 2023, The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.

키워드

Attention mechanismLong short-term memory (LSTM)Rainfall derived infiltration and inflow (RDII)Sewer overflows (SOs)Spatiotemporal attentionWater flow rate forecastingNEURAL-NETWORKINFLOWINFILTRATIONPREDICTIONMECHANISMMODELS
제목
LSTM with spatiotemporal attention for IoT-based wireless sensor collected hydrological time-series forecasting
저자
Huang, JianyingLi, JinhuiOh, JeillKang, Hoon
DOI
10.1007/s13042-023-01836-3
발행일
2023-10
유형
Article; Early Access
저널명
International Journal of Machine Learning and Cybernetics
14
10
페이지
3337 ~ 3352