Effect of Natural and Synthetic Noise Data Augmentation on Physical Action Classification by Brain-Computer Interface and Deep Learning

Yuri Gordienko ^1* Nikita Gordienko ^1* Vladyslav Taran ^1* Anis Rojbi ² Sergii Telenyk ^3* Sergii Stirenko ^1*

• ¹ National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”, Kyiv, Ukraine
• ² Université Paris 8, Saint-Denis, France
• ³ Cracow University of Technology, Kraków, Lesser Poland, Poland

Analysis of electroencephalography (EEG) signals gathered by brain-computer interface (BCI) recently demonstrated that deep neural networks (DNNs) can be effectively used for investigation of time sequences for physical actions (PA) classification. In this work the relatively simple DNN with fully-connected network (FCN) components and convolutional neural network (CNN) components was considered to classify finger-palm-hand manipulations each from the graspand-lift (GAL) dataset. The main aim of this work was to imitate and investigate environmental influence by the proposed noise data augmentation (NDA) of two kinds: (i) natural NDA by inclusion of noise EEG data from neighboring regions by increasing the sampling size N and the different offset values for sample labeling, (ii) synthetic NDA by adding the generated Gaussian noise. The natural NDA by increasing N leads to the higher micro and macro area under the curve (AUC) for receiver operating curve values for the bigger N values than usage of synthetic NDA.The detrended fluctuation analysis (DFA) was applied to investigate the fluctuation properties and calculate the correspondent Hurst exponents H for the quantitative characterization of the fluctuation variability. H values for the low time window scales (< 2 seconds) are higher in comparison to ones for the bigger time window scales. For example, H more than 2-3 times higher for some PAs, i.e. it means that the shorter EEG fragments (< 2 seconds) demonstrate the scaling behavior of the higher complexity than the longer fragments. As far as these results were obtained by the relatively small DNN with the low resource requirements, this approach can be promising for porting such models to Edge Computing infrastructures on devices with the very limited computational resources.