The final, formatted version of the article will be published soon.
ORIGINAL RESEARCH article
Front. Hum. Neurosci.
Sec. Brain-Computer Interfaces
Volume 18 - 2024 |
doi: 10.3389/fnhum.2024.1442398
This article is part of the Research Topic Hippocampal Function and Reinforcement Learning View all 4 articles
An EEG signal attention model based on reinforcement learning
Provisionally accepted- 1 Department of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
- 2 Chongqing College of Traditional Chinese Medicine, Chongqing University of Posts and Telecommunications, Chongqing, China
Applying convolutional neural networks to a large number of EEG signal samples is computationally expensive because the computational complexity is linearly proportional to the number of dimensions of the EEG signal. We propose a new Gated Recurrent Unit (GRU) network model based on reinforcement learning, which considers the implementation of attention mechanisms in Electroencephalogram (EEG) signal processing scenarios as a reinforcement learning problem. The model can adaptively select target regions or position sequences from inputs and effectively extract information from EEG signals of different resolutions at multiple scales. Just as convolutional neural networks benefit from translation invariance, our proposed network also has a certain degree of translat ion invariance, making its computational complexity independent of the EEG signal dimension, thus maintaining a lower learning cost. Although the introduction of reinforcement learning makes the model non differentiable, we use policy gradient methods to achieve end-to-end learning of the model. We evaluated our proposed model on publicly available EEG dataset (BCI Competition IV-2a). The proposed model outperforms the current state-of-theart techniques in the BCI Competition IV-2a dataset with an accuracy of 86.78% and 71.54% for the subjectdependent and subject-independent modes, respectively.
Keywords: reinforcement learning, Strategy gradient, Gradient descent optimization algorithm, Gated recurrent units, EEG
Received: 17 Jun 2024; Accepted: 01 Nov 2024.
Copyright: © 2024 Zhang, Tang and Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
* Correspondence:
Xianlun Tang, Department of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
Mengzhou Wang, Chongqing College of Traditional Chinese Medicine, Chongqing University of Posts and Telecommunications, Chongqing, China
Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.