Attention-Enhanced Reservoir Computing

arXiv:2312.16503v2 Announce Type: replace-cross
Abstract: Photonic reservoir computing has been successfully utilized in time-series prediction as the need for hardware implementations has increased. Prediction of chaotic time series remains a significant challenge, an area where the conventional reservoir computing framework encounters limitations of prediction accuracy. We introduce an attention mechanism to the reservoir computing model in the output stage. This attention layer is designed to prioritize distinct features and temporal sequences, thereby substantially enhancing the prediction accuracy. Our results show …

abstract accuracy arxiv attention challenge computing cs.et cs.lg framework hardware limitations prediction series time series type