Skip to main content

ORIGINAL RESEARCH article

Front. Hum. Neurosci., 15 December 2022
Sec. Motor Neuroscience
This article is part of the Research Topic The Relationship Between Neural Circuitry and Biomechanical Action, Volume II View all 6 articles

Predicting postural control adaptation measuring EEG, EMG, and center of pressure changes: BioVRSea paradigm

\r\nSimon A. Stehle&#x;Simon A. Stehle1†Romain Aubonnet&#x;Romain Aubonnet1†Mahmoud Hassan,Mahmoud Hassan1,2Marco RecentiMarco Recenti1Deborah JacobDeborah Jacob1Hannes Petersen,Hannes Petersen3,4Paolo Gargiulo,*Paolo Gargiulo1,5*
  • 1Institute of Biomedical and Neural Engineering, Reykjavik University, Reykjavik, Iceland
  • 2MINDig, Rennes, France
  • 3Department of Anatomy, Faculty of Medicine, School of Health Sciences, University of Iceland, Reykjavik, Iceland
  • 4Akureyri Hospital, Akureyri, Iceland
  • 5Department of Science, Landspitali, National University Hospital of Iceland, Reykjavik, Iceland

Introduction: Postural control is a sensorimotor mechanism that can reveal neurophysiological disorder. The present work studies the quantitative response to a complex postural control task.

Methods: We measure electroencephalography (EEG), electromyography (EMG), and center of pressure (CoP) signals during a virtual reality (VR) experience called BioVRSea with the aim of classifying different postural control responses. The BioVRSea paradigm is based on six different phases where motion and visual stimulation are modulated throughout the experiment, inducing subjects to a different adaptive postural control strategy. The goal of the study is to assess the predictability of those responses. During the experiment, brain activity was recorded from a 64-channel EEG, muscle activity was determined with six wireless EMG sensors placed on lower leg muscles, and individual movement measured by the CoP. One-hundred and seventy-two healthy individuals underwent the BioVRSea paradigm and 318 features were extracted from each phase of the experiment. Machine learning techniques were employed to: (1) classify the phases of the experiment; (2) assess the most notable features; and (3) identify a quantitative pattern for healthy responses.

Results: The results show that the EEG features are not sufficient to predict the distinct phases of the experiment, but they can distinguish visual and motion onset stimulation. EMG features and CoP features, when used jointly, can predict five out of six phases with a mean accuracy of 74.4% (±8%) and an AUC of 0.92. The most important feature to identify the different adaptive strategies is the Squared Root Mean Distance of points on Medio-Lateral axis (RDIST_ML).

Discussion: This work shows the importance and the feasibility of a quantitative evaluation in a complex postural control task and demonstrates the potential of EEG, CoP, and EMG for assessing pathological conditions. These predictive systems pave the way for developing an objective assessment of pathological behavior PC responses. This will be a first step in identifying individual disorders and treatment options.

Introduction

An upright posture is not only important when standing or walking, it is also crucial for successfully accomplishing everyday life tasks and therefore has a major impact on the quality of life. Falls are the worst consequences of postural control (PC) disorders (Alexander, 1994), and for this reason, fall injuries are one of the most serious healthcare problems and one of the biggest threats to the independence of older adults. They are associated with an increased functional impairment, disability, and decreased ability to independently manage activities of daily living (Hageman et al., 1995; Marks et al., 2003; Figueiro et al., 2008).

PC can be defined as the ability to maintain the body’s center of gravity within certain limits of stability during quiet stance or movement. The limits of stability are shaped like a cone and can be specified as the range in which the body’s center of gravity can be shifted without requiring a change in the base of support (Alexander, 1994; Hageman et al., 1995, p. 961; Horak, 2006). PC involves two general skills of the human body: first, postural orientation, which describes the ability to maintain the body position in relation to the environment and ultimately provide an appropriate response to external perturbations; second, postural stability, which is the ability to maintain body position in equilibrium (Hageman et al., 1995, p. 961; Horak, 2006, 2; Figueiro et al., 2008, p. 111).

PC is a complex and dynamic central sensorimotor system that integrates information from the vestibular, visual, and proprioceptive sensory systems. In daily activities, it relies on a multifaceted interplay of physiological mechanisms (Melzer et al., 2001, p. 189; Peterka, 2002, p. 1,097; Horak, 2006; Ivanenko and Gurfinkel, 2018, p. 175).

External perturbations induce and trigger different adaptive PC strategies in the human body. Previous studies investigated these strategies, focusing on the task-dependent changes of strategies throughout the lifespan (Haddad et al., 2013), the adaptive behavior of PC due to perturbations in the upright standing (He and Tian, 1997; Fransson et al., 2000), or the adaptive responses to virtual environments (Reed-Jones et al., 2008).

A person’s CoP and its movement are indicators of stability and are considered particularly useful to study postural response. The CoP can be calculated using a force plate under the feet that determines the center of the vertical reaction force (Alexander, 1994; Hageman et al., 1995, p. 961). In addition, an increasing number of studies are using brain electrical signals (EEG) as a viable measurement setup to investigate cortical activity and the neurophysiological behavior during PC tasks (Slobounov et al., 2005, p. 316; Edwards et al., 2018, p. 36). Likewise, EMG has been used in several studies to investigate balance control as well as posture correction by lower leg muscles like tibialis anterior and gastrocnemius (Slobounov et al., 2005, p. 316).

Due to the rising size and complexity of data sets the use of predictive analyses using machine learning analysis became common in biomedical engineering studies (Poldrack et al., 2020). This results in the advantage of being able to use machine learning to examine large high-dimensional datasets for patterns in a brief period and derive quick and relevant conclusions. Regarding the classification models for machine learning, the goal is always to get generalizable models that can also predict other data sets that are not from the same data collection or environment (Scheinost et al., 2019, p. 37).

The recent measurement setup BioVRSea has been used for various research purposes, including the prediction of motion sickness or the evaluation of biomarkers for concussions (Recenti et al., 2021; Jacob et al., 2022). For this study, BioVRSea was used to explore brain activity, muscle activity, and center of mass to investigate changes in PC responses. With these biosignal recordings, features can be extracted and then used to classify the several segments of the experiment. In total, BioVRsea consists of six distinct phases with individual settings that have a unique influence on the subjects’ responses in terms of PC. Firstly, from baseline to PRE, we have a visual onset with the beginning of the sea simulation. From PRE to 25%, we have a motion onset synchronized with the sea simulation. This movement progressively increases at 50% and 75%. Finally, the induced postural control response is measured while abruptly switching off the movement while the sea simulation remains on. Therefore, feature extraction and analysis were performed for each phase with the aim to estimate and quantify these different physiological conditions and responses. Machine learning is of great impact as it helps to determine which biosignals are suitable to predict the different phases of the BioVRSea acquisition and which patterns can be found in the large amount of data collected.

Materials and Methods

Experimental protocol

BioVRSea is an innovative measurement setup for studying the physiology of PC. It mimics the sensation and gives the impression of being in a small boat on a rough sea. The goal of the experimental setup is to trigger a PC response and analyze the various biosignals during the acquisition.

The setup consists of a virtual reality (VR) environment and a moving platform synchronized with the simulated environment. Subjects stand on the platform and wear VR goggles and various measurement devices to record the different biosignals. The participants were prepared for measurement with the placement of a wet 64-electrode EEG cap, six wireless EMG sensors on the tibialis anterior, gastrocnemius lateral, and soleus muscles of each leg, and the heart sensor strapped around the chest. The EEG amplifier was connected to the cap and placed in a backpack with a tablet used for EEG signal acquisition. The backpack is worn by the participant during the experiment. Finally, the participant enters the VR environment by climbing on a platform and donning VR goggles. The platform is equipped with a force plate to measure the sway movements of the participants during the experiment. The schematic experimental setup can be seen in Figure 1.

FIGURE 1
www.frontiersin.org

Figure 1. BioVRSea measurement setup.

For the experiment and the following classification, six phases are considered, as depicted in Figure 2. These segments will be the different classes to be predicted with the machine learning process. The first phase is the baseline segment, where the participant only sees a static mountain panorama through the VR goggles. During this time, the platform does not move, and the participant stands with their hands by their side while viewing the mountain view for a total of 2 min. For the signal processing part, only the last 60 s were used. After the Baseline phase, the VR scene changes to the sea environment and the subject sees him/herself on a small boat at sea. The second phase lasts 40 s and is called the PRE phase. During this phase, the platform does not move, and the participant remains still with their hands by their side. In the third phase, the participant holds on to the safety bars and the platform moves in a synchronized manner with the waves seen in the VR scene. During these 40 s, the platform moves at 25% of the maximum amplitude. In the fourth and fifth phases, the platform increases the intensity to 50% and 75%, respectively for 40 s each. In the last phase, the POST phase, the movement of the platform stops while the VR simulation continues. The participant takes their hands off the safety bar and stands quietly trying to maintain equilibrium watching the VR sea scene. After 40 s, this phase is over and so is the entire acquisition.

FIGURE 2
www.frontiersin.org

Figure 2. Different phases of the experiment.

The different materials used for the study include the VR software (Sampling frequency: 90 Hz, Virtualis VR, Clapiers, France), the moving platform (Virtualis VR, Clapiers, France), the force platform (Virtualis VR, Clapiers, France), six wireless EMG sensors, attached to the soleus, tibialis anterioris, and gastrocnemius lateral on both the left and right legs (Sampling frequency: 1,600 Hz, Kiso ehf, Reykjavik, Iceland), and the 64-channel wet electrode cap (Sampling frequency: 4,096 Hz ANTNeuro, Hengelo, The Netherlands). The three integrated biosignals were recorded and synchronized using a software called MacroRecorder. This software enables to automatize all the consecutive computer tasks and to launch simultaneously the recording.

The data processing and analysis procedure are described in the following sections.

Population

The study is based on 191 subjects (age: 34.1 ± 14.8), 79 male and 112 female subjects (ethics approval by the Icelandic Bioethics Commission—Number: VSN-20-101—May 2020).

Due to missing or inferior quality recordings, the CoP analysis was performed on only 172 subjects (age: 33.7 ± 14.7), 64 male and 108 female.

EEG

Brainstorm (Tadel et al., 2011) and MATLAB 2022a (MATLAB, 2022; MathWorks, Inc., Natick, 158 Massachusetts, USA) with the Automagic Toolbox developed by Pedroni et al. (2019) was used for preprocessing and analysis of the EEG data. To ensure data quality and to avoid artifacts, we removed the five first and five last seconds for each phase of the experiment. Afterwards, the data were resampled to 1,024 Hz.

Automagic was used for automatic preprocessing for each data set, with a manual check at the end. The ICA MARA algorithm was used with a variance of 20%. A high-pass and low-pass filter were set to 1 Hz and 45 Hz, respectively. The data were notch filtered at 50 Hz. Finally, the bad electrodes were interpolated. According to the five anatomic lobes of the cortex consisting of frontal, parietal, occipital, and the two temporal lobes that are widely accepted in the scientific community (Woolsey et al., 2017; Casillo et al., 2020) we further used these lobes as regions of interest. The power spectral density (PSD) was computed for each phase and each electrode using Welch’s method, with the following frequency bands: delta (1–4 Hz), theta (4–8 Hz), alpha (8–13 Hz), beta (13–30 Hz), low gamma (30–45 Hz). The relative power of each region of the cerebral cortex was then calculated by taking the mean of the electrodes located in that region to obtain a total of five EEG-related features per region and per experimental phase. All this preprocessing was performed in a manner analogous to the study of Jacob et al. (2022).

EMG

For the EMG features, preprocessing and feature extraction are required which were performed with MATLAB 2022a, using the built-in Signal Processing Toolbox. The muscle signal was analyzed for each segment. After the removal of the transition from one phase to another, each phase segment for 20 s. For further processing, we use a 4th order Butterworth bandpass, a cutoff frequency of 15 Hz and 500 Hz, and a sampling frequency of 1,600 Hz. Time and frequency metrics were extracted from this final signal. The full table with the used features can be found in Supplementary Figure S1.

Centre of Pressure (CoP)

To calculate the anterior–posterior (AP) and medio-lateral (ML) displacement (in centimeters) of the CoP, the following formula was used:

DisplacementAP=Y×0.5×StaticVR_AP and
DisplacementML=X×0.5×StaticVR_ML

The StaticVR_AP (respectively StaticVR_ML) is the percentage of the vertical size (respectively horizontal size) of the platform sensors, with a value comprised between −1 and 1. In addition, X represents the dimension of the force platform in the ML direction and Y represents the dimension of the force platform in the AP direction.

The processing of the CoP data was performed using MATLAB 2022a, and is the same as previously described in Jacob et al. (2022). During the experiment, the force platform records the movement of the CoP, a projection of the center of mass of the subject on the plane of the machine, also called a stabilogram. To filter the CoP data, we used a Savitsky-Golay filter with window size 7. Afterwards we used the stabilogram for feature extraction. The full list of the used features can be found in Supplementary Figure S1.

Machine learning

For the classification analysis, the interactive Classification Learner App was used: it is included in the Statistics and Machine Learning Toolbox (2022) in MATLAB 2022a. The data can be imported as a spreadsheet, which contains the different predictor and response variables. We used a training dataset containing 80% of the data and a test dataset with the remaining 20%. As is known from machine learning theory and literature, it is crucial that the model has never seen the test data set until finally the test accuracy gets computed to avoid overfitting and biased results (Scheinost et al., 2019, p. 37; Poldrack et al., 2020).

For validation accuracy, we performed a 10-fold cross-validation and the validation error gets calculated by averaging over the 10 folds. Then, the model is trained using the entire training dataset (70% of the total data). Subsequently, we used the remaining 30% of the data to obtain test accuracy without bias.

As predictors, we used the features extracted from the different bio-signals (Table 1). To obtain information about which biosignal is more suitable for predicting the phase of the experiment, we trained and tested prediction models separately for the EEG, EMG, and CoP data. Finally, we also trained classification models using both EMG and CoP features together.

TABLE 1
www.frontiersin.org

Table 1. Total number of features.

Different configurations have been used for the classification. The first one was the prediction of the six different phases. For the CoP data, the recording starts only after the BL, so the second configuration was the prediction of five phases (PRE, 25%, 50%, 75%, and POST). A third consideration was averaging the three movement phases (25%, 50%, 75%) in one unique phase, as the similarity of these phases made the classification more difficult. This leads to three (PRE, movement, POST) or four (BL, PRE, movement, POST) phases to classify. Finally, for the EEG signals, due to the low accuracy in the previous configurations, a binary classification was defined, to differentiate BL from the rest. The five phases that were not BL were averaged together in one single phase. This approach of merging was only possible because we had the same amount of data for each phase. This is also necessary for the classification to correctly assess and interpret the average overall accuracy (Poldrack et al., 2020).

The details of the classification configuration and results are listed in Table 2.

TABLE 2
www.frontiersin.org

Table 2. Overview classification results and performance parameter.

For calculating the feature selection, the ANOVA—analysis of variance—method was used. ANOVA provides the opportunity to determine the most relevant feature for classification. As a statistical test, it is suitable to compare the differences between two or more means of the samples based on mean and variance. The ones with the lowest values show that they are independent of the target variable. The ones with a high value show a high relevance for the classification model. ANOVA is suitable for non-stationary data such as EEG for example and is used in various other studies in the field of biomedical engineering and neuroscience (Chowdhury et al., 2017, p. 537; Majid Mehmood et al., 2017, p. 674; Harpale and Bairagi, 2021, p. 14,797).

Afterwards, the effect size has been computed, calculating η2 for a confidence level of 95%.

Results

Table 2 sums up the classification results. The first column shows the biosignal used for the prediction. The second column shows the phases considered in the analyses. The “X” overlapping several cells, as on the first row of EEG, considers the merged phases. The next two columns represent the validation and test accuracy, followed by the area under curve (AUC) for the validation and test. The seventh column shows which model has been used to obtain those results, and the last three columns show the top three features for the classification.

Phases classification

The confusion matrices in Figure 3 visualize and summarize the performances of the models detailed in Table 2, for each biosignal: EEG, EMG, COP, and EMG+COP. The table layout shows two dimensions, the true class in each row and the predicted class in each column, and gives insights into the occurrence frequency in the corresponding field. Furthermore, the True Positive Rates (TPR) and the False Negative Rates (FNR) are shown next to that.

FIGURE 3
www.frontiersin.org

Figure 3. Confusion matrices. (A) EEG features. (B) EMG features. (C) CoP features. (D) EMG and CoP features. EEG, electroencephalography; EMG, electromyography; CoP, center of pressure.

With the EEG features, it is not possible to classify all the different phases of the experiment. But with a test accuracy of 74.6% it is possible to classify if the data is from Baseline or not. Regarding the use of EMG features with our test data, we could predict with an accuracy of 68.4% of the Baseline. As can be seen in Figure 3B, it is difficult for the models to classify the phases in between, resulting in high false negative rates for these phases.

Using the CoP features we can classify five phases with a test accuracy of 71.7%. Striking is the True Positive Rate of 82.4% for predicting the PRE-Phase and 84.6% for the 25% phase as can be seen in Figure 3C. Due to the False Negative Rate of 36.5% for the Post phase, it becomes clear that the model has more issues to predict the POST phase by only using the CoP data. Most of the mistakes in predicting the phase result in the fact that in 15.7% of the cases the predicted class is the PRE phase instead of the POST phase. Respectively this correlation can also be seen if the model tries to predict the PRE-Phase.

By using both EMG and CoP features we get the best result for predicting the five different phases. For the trained model we achieved a test accuracy of 74.4% and an AUC value of 0.92. The single True Positive and the respective False Negative Rates can be seen in Figure 3D.

The use of EEG, EMG, and CoP features jointly did not bring an increase in the overall accuracy for predicting five phases of the experiment compared of the use of EMG and CoP features together.

Features ranking

The three most relevant EEG features to classify the BL from the experiment are the power spectral density values for the low-gamma phase in the occipital region, the alpha phase in the frontal region, and in the parietal region, represented in Figure 4.

FIGURE 4
www.frontiersin.org

Figure 4. Top 3 EEG features to classify BL from the experiment.

If only the EMG data is used, the most useful feature is the logarithmic Teager-Kaiser energy operator (LTKEO) of the Tibialis Anterioris Right, followed by LTKEO of the Tibialis Anterioris Left and the logarithmic difference absolute standard deviation value (LDASDV) of the Tibialis Anterioris Right.

The LTKEO feature plotted for the Tibialis Anterior and for Baseline, PRE and POST can be seen in Figure 5. An increase is recognizable in the LTKEO feature with the ongoing experiment. Strikingly is also the concentrated clustering for Baseline and more widely distributed data dots for the PRE and POST phases.

FIGURE 5
www.frontiersin.org

Figure 5. LTKEO feature for tibialis anterioris. LTKEO, Logarithmic Teager-Kaiser energy operator.

Regarding CoP, the three most relevant features for the classification algorithms are the squared root mean distance of the ML direction (RDIST_ML) as well as the standard deviation of points on the ML axis (SD ML), and the direction entropy. In general, it can be noticed that the ML features are more relevant to predict the phases than the AP features.

The different phases of the experiment can be seen in Figure 6, plotting the total CoP movement in AP Direction and ML Direction. The PRE-Phase strikes out with the lowest values for the total movement regarding both directions. Furthermore, the data dots for the PRE-Phase are limited and concentrated in a small area. With the experiment’s further progress, a stepwise increase is noticeable in the Medio-Lateral direction and a slight increase in the Anterior-Posterior direction. The finishing POST-phase characterizes itself with increased values in the Anterior-Posterior direction and a widely distributed area.

FIGURE 6
www.frontiersin.org

Figure 6. Total CoP movement in anterior-posterior and medio-lateral direction.

Table 3 describes the effect size for the top three features of each biosignal. EEG features have an effect size of around 0.05, highlighting a medium effect. However, EMG features have an effect size of 0.4, and COP features have an effect size of 0.5, showing a high effect associated with those features.

TABLE 3
www.frontiersin.org

Table 3. Effect size description.

Discussion

Postural control is a sensorimotor mechanism that can reveal neurophysiological disorder. The main goal of using the classification is to gain more insight into the dynamic changes in posture control and the different phases of the experiment. This is the reason behind the classification of the different phases of BioVRSea.

EEG features

With the EEG feature solely, we can only classify Baseline and not Baseline with an accuracy of 74.6%. This shows that there is a change in brain activity and a difference between those two stages is recognizable for the model. This difference can be deduced from the changing VR scene that also triggers the occipital region of the brain. This conclusion may fit together with the PSD value for the low gamma phase in the occipital region that is the most important feature for binary classification.

The attempt to classify all six phases was not successful. Considering the experimental setup this also seems reasonable as the phases of the moving platform (25%, 50%, and 75%) will trigger the same regions (such as the frontal and parietal regions) as they are needed for coordination and motion control (Faw, 2003; Fogassi and Luppino, 2005; Aubonnet et al., 2022). This makes it challenging for a classification model to predict a class. Another possible reason is the individual adaptive PC strategy to the sensory input regarding the neural activity (Ivanenko and Gurfinkel, 2018).

Other causes for the difficulties in predicting all the phases could be that in the study we took the average PSD value for the entire phase. An improvement could be to take epochs, so that averaging the different spikes on a per-wave basis could give a more appropriate feature extraction method. Including features derived from a dynamic analysis (not static as reported here) may also improve performance.

EMG interpretation

Regarding the EMG features, the high FNR for the phases 25%, 50%, and 75% is expectable as they differ only in their intensity of the sensory input. As the Baseline is the most different phase compared to the others (no sea simulation, no platform movements), it makes sense that it is also for the model one of the easiest phases to predict.

The logarithmic Teager-Kaiser energy operator (LTKEO) of the Tibialis Anterioris is the most important feature for the classification with solely EMG features. It leads to a good classification result, especially between Baseline and the other phases. Li et al. (2007) discovered an improved detection of EMG onset using TKEO, especially at a low signal-to-noise ratio. Other studies confirmed this, reasoning that the calculated energy is derived from the instantaneous amplitude and frequency of the signal (Solnik et al., 2010; Liu et al., 2015). Laksono et al. (2021) also performed EMG classification using the Matlab classification learning application and found an important role of TKEO for EMG classification and high accuracy.

The overlapping clusters for the PRE and the POST phase in Figure 5 show that the LTKEO values are on average higher in the POST phase but it also shows that this feature on its own is not sufficient to distinguish these two Phases without mistakes. The reason the LTKEO values are so low in the Baseline could be that it is the easiest phase to maintain PC as the VR environment with the static mountain view combined with the platform not moving is not a challenging task for subjects without PC disorders. In that phase, the muscles are relaxed all the time, and the subjects rarely contract their muscles to keep balance. This leads to low instantaneous energy changes and therefore a low LTKEO value.

A hypothesis for the widely distributed dots in PRE and POST visible in Figure 5 is that some of the people are using more balancing movements in those two segments, compared to others that just need less muscle activity to maintain PC. This quantitively underlines the fact that people are using individual adaptive PC strategies as identified in the literature (van Emmerik and van Wegen, 2002).

CoP interpretation

A similar interpretation can be reached with the CoP data. Figure 6 shows how severe and individual the impact is on the subjects’ PC. The increase in deviation from the neutral position indicates the substantial influence that the experiment had on most of the subjects. While observing the scattered plot, the post phase is more widely distributed, because the severeness of the impact on the subjects is quite different. This result also must be seen with the background that anatomical prerequisites also affect the adaptive strategies and are why some people show a higher deviation from the neutral position than others (Hunter and Hoffman, 2001).

The fact that more ML features are relevant for the classification leads to the conclusion that, for these features, the experiment results in patterns that differ among each phase, and help the classification model to predict. A clinical hypothesis for it could be that sways in the AP direction are more individual and natural than sways in the ML direction that are triggered by our acquisition (Hunter and Hoffman, 2001). In addition to that, the VR environment is mainly an AP visual oscillation that is active in all the phases besides Baseline. This could make it more difficult to predict the phase as th differences between the phases are less significant. This result also matches with other findings from previous studies (Lott et al., 2003; Donker et al., 2007; Luo et al., 2018).

EMG and CoP interpretation

By combining EMG and CoP measurements we obtain good classification results, with 73.3% of accuracy for five phases. The reason could be that with the EMG data it is difficult for the model to distinguish the phases of 25%, 50%, and 75%. For these phases, the model can use the CoP data to classify them. This leads to high overall accuracy.

Comparing the different biosignal features it becomes clear that EEG is not able to predict all the phases for the BioVRSea experiment. With EMG as well, the results are not sufficient. With CoP superior results can be achieved but really satisfying results for the classification of the distinct phases can only be achieved by using EMG and CoP features jointly. This leads to the result that those biosignals are needed to describe the dynamic behavior BioVRSea has on the subjects and to quantitatively assess the adaptive PC strategies.

Limitations

The first limitation to mention could be the amount of data. This is relatively large for a typical biomedical study with neurophysiological examinations, but the results, especially the learned classification models, could be even more reliable if the amount of data were larger. This is especially critical when subgroups are studied, as the number of subjects is then greatly reduced. In addition, the diversity of the subjects investigated should be increased in further studies. Also, relative to the average population, more women than men participated in the study.

Another limitation was the subjects’ behavior during the experiment. Even though we instructed them to stand still and look in front of them, some participants performed spontaneous movements that were not in reaction to the experiment. This could lead to artifacts or noise in the data collection. Also, it cannot be fully ensured that subjects remain fully focused on the experiment and do not pursue other conscious thoughts.

Conclusion

This work aimed to study the neurophysiological dynamics of PC, and how neurophysiological measures could help to quantify and predict PC adaptation, from a consequent healthy cohort. We demonstrated that for our paradigm, EEG could differentiate baseline from acquisition phases. Moreover, the combination of EMG and CoP parameters presented satisfactory results to characterize the five phases of the experiment involving the sea simulation. From those results, the best features of each signal were identified to classify the phases: alpha frontal and parietal PSD, lowgamma occipital PSD for the EEG, LTKEO for tibialis anterioris for the EMG, and RDIST and SD ML for the CoP.

This work is a first step towards the definition of a global healthy pattern, and will lead in the future to the development of tools to understand and quantify PC-related pathological conditions.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by Icelandic Bioethics Commission Number: VSN-20-101. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

SS and RA wrote the manuscript. SS performed the machine learning pipeline and EMG and COP analysis. RA performed the EEG analysis. DJ helped with EMG and COP analysis and reviewed the manuscript. MR and MH helped with the machine learning pipeline and reviewed the manuscript. HP helped with the results discussion and reviewed the manuscript. PG supervised the work and reviewed the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This work has been funded by Landspitali Research Fund (Grant number: 935836; Landspítali Háskólasjúkrahús).

Conflict of Interest

MH was employed by the company MINDig.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Abbreviations

A, alpha; AP, antero-posterior; AUC, area under curve; B, beta; CoP, center of pressure; FNR, false negative rate; LDASDV, logarithmic difference absolute standard deviation value; LG, low gamma; LTKEO, logarithmic Teager-Kaiser energy operator; ML, medio-lateral; PC, postural control; RDIST_ML, Squared Root Mean Distance of points on ML axis; TPR, true positive rate.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnhum.2022.1038976/full#supplementary-material.

References

Alexander, N. B. (1994). Postural control in older adults. J. Am. Geriatr. Soc. 42, 93–108. doi: 10.1111/j.1532-5415.1994.tb06081.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Aubonnet, R., Shoykhet, A., Jacob, D., Di Lorenzo, G., Petersen, H., and Gargiulo, P. (2022). Postural control paradigm (BioVRSea): towards a neurophysiological signature. Physiol. Meas. 43:115002. doi: 10.1088/1361-6579/ac9c43

PubMed Abstract | CrossRef Full Text | Google Scholar

Casillo, S. M., Luy, D. D., and Goldschmidt, E. (2020). A history of the lobes of the brain. World Neurosurg. 134, 353–360. doi: 10.1016/j.wneu.2019.10.155

PubMed Abstract | CrossRef Full Text | Google Scholar

Chowdhury, T. T., Fattah, S. A., and Shahnaz, C. (2017). “Classification of seizure and non-seizure activity in seizure patients using time-frequency domain processing of gamma band EEG signals,” in 2017 4th International Conference on Advances in Electrical Engineering (ICAEE) (Dhaka: IEEE), 537–540. doi: 10.1109/ICAEE.2017.8255414

CrossRef Full Text | Google Scholar

Donker, S. F., Roerdink, M., Greven, A. J., and Beek, P. J. (2007). Regularity of center-of-pressure trajectories depends on the amount of attention invested in postural control. Exp. Brain Res. 181, 1–11. doi: 10.1007/s00221-007-0905-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Edwards, A. E., Guven, O., Furman, M. D., Arshad, Q., and Bronstein, A. M. (2018). Electroencephalographic correlates of continuous postural tasks of increasing difficulty. Neuroscience 395, 35–48. doi: 10.1016/j.neuroscience.2018.10.040

PubMed Abstract | CrossRef Full Text | Google Scholar

Faw, B. (2003). Pre-frontal executive committee for perception, working memory, attention, long-term memory, motor control and thinking: a tutorial review. Conscious. Cogn. 12, 83–139. doi: 10.1016/s1053-8100(02)00030-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Figueiro, M. G., Gras, L., Qi, R., Rizzo, P., Rea, M., and Rea, M. S. (2008). A novel night lighting system for postural control and stability in seniors. Light. Res. Technol. 40, 111–126. doi: 10.1177/1477153507084198

CrossRef Full Text | Google Scholar

Fogassi, L., and Luppino, G. (2005). Motor functions of the parietal lobe. Curr. Opin. Neurobiol. 15, 626–631. doi: 10.1016/j.conb.2005.10.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Fransson, P.-A., Johansson, R., Hafström, A., and Magnusson, M. (2000). Methods for evaluation of postural control adaptation. Gait Posture 12, 14–24. doi: 10.1016/s0966-6362(00)00052-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Haddad, J. M., Rietdyk, S., Claxton, L. J., and Huber, J. E. (2013). Task-dependent postural control throughout the lifespan. Exerc. Sport Sci. Rev. 41, 123–132. doi: 10.1097/JES.0b013e3182877cc8

PubMed Abstract | CrossRef Full Text | Google Scholar

Hageman, P. A., Leibowitz, J. M., and Blanke, D. (1995). Age and gender effects on postural control measures. Arch. Phys. Med. Rehabil. 76, 961–965. doi: 10.1016/s0003-9993(95)80075-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Harpale, V., and Bairagi, V. (2021). An adaptive method for feature selection and extraction for classification of epileptic EEG signal in significant states. J. King Saud Univ. Comput. Info. Sci. 33, 668–676. doi: 10.1016/j.jksuci.2018.04.014

CrossRef Full Text | Google Scholar

He, J., and Tian, C.-X. (1997). “Adaptive postural control for a repeated perturbation,” in Proceedings of the 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, eds G. Harris, Y. Kim, and P. C. Pedersen (Amsterdam, Netherlands: IEEE), 2215–2216. doi: 10.1109/IEMBS.1996.646503

CrossRef Full Text | Google Scholar

Horak, F. B. (2006). Postural orientation and equilibrium: what do we need to know about neural control of balance to prevent falls? Age Ageing 35, ii7–ii11. doi: 10.1093/ageing/afl077

PubMed Abstract | CrossRef Full Text | Google Scholar

Hunter, M., and Hoffman, M. (2001). Postural control: visual and cognitive manipulations. Gait Posture 13, 41–48. doi: 10.1016/s0966-6362(00)00089-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Ivanenko, Y., and Gurfinkel, V. S. (2018). Human postural control. Front. Neurosci. 12:171. doi: 10.3389/fnins.2018.00171

PubMed Abstract | CrossRef Full Text | Google Scholar

Jacob, D., Unnsteinsdóttir, K., Ingunn, S., Aubonnet, R., Recenti, M., Donisi, L., et al. (2022). Towards defining biomarkers to evaluate concussions using virtual reality and a moving platform (BioVRSea). Sci. Rep. 12:8996. doi: 10.1038/s41598-022-12822-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Laksono, P. W., Kitamura, T., Muguro, J., Matsushita, K., Sasaki, M., Amri bin Suhaimi, M. S., et al. (2021). Minimum mapping from EMG signals at human elbow and shoulder movements into two DoF upper-limb robot with machine learning. Machines 9:56. doi: 10.3390/machines9030056

CrossRef Full Text | Google Scholar

Li, X., Zhou, P., and Aruin, A. S. (2007). Teager-Kaiser energy operation of surface EMG improves muscle activity onset detection. Ann. Biomed. Eng. 35, 1532–1538. doi: 10.1007/s10439-007-9320-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, J., Ying, D., Rymer, W. Z., and Zhou, P. (2015). Robust muscle activity onset detection using an unsupervised electromyogram learning framework. PLoS One 10:e0127990. doi: 10.1371/journal.pone.0127990

PubMed Abstract | CrossRef Full Text | Google Scholar

Lott, A., Bisson, E., Lajoie, Y., McComas, J., and Sveistrup, H. (2003). The effect of two types of virtual reality on voluntary center of pressure displacement. CyberPsychol. Behav. 6, 477–485. doi: 10.1089/109493103769710505

PubMed Abstract | CrossRef Full Text | Google Scholar

Luo, H., Wang, X., Fan, M., Deng, L., Jian, C., Wei, M., et al. (2018). The effect of visual stimuli on stability and complexity of postural control. Front. Neurol. 9:48. doi: 10.3389/fneur.2018.00048

PubMed Abstract | CrossRef Full Text | Google Scholar

Majid Mehmood, R., Du, R., and Lee, H. J. (2017). Optimal feature selection and deep learning ensembles method for emotion recognition from human brain eeg sensors. IEEE Access 5, 14797–14806. doi: 10.1109/ACCESS.2017.2724555

CrossRef Full Text | Google Scholar

Marks, R., Allegrante, J. P., Ronald, M. C., and Lane, J. M. (2003). Hip fractures among the elderly: causes, consequences and control (2). doi: 10.1016/S1568-1637(02)00045-4

CrossRef Full Text | Google Scholar

MATLAB (2022). MATLAB Version R2022a. Natick, MA: The MathWorks Inc.

Google Scholar

Melzer, I., Benjuya, N., and Kaplanski, J. (2001). Age-related changes of postural control: effect of cognitive tasks. Gerontology 47, 189–194. doi: 10.1159/000052797

PubMed Abstract | CrossRef Full Text | Google Scholar

Pedroni, A., Bahreini, A., and Langer, N. (2019). Automagic: standardized preprocessing of big EEG data. Neuroimage 200, 460–473. doi: 10.1016/j.neuroimage.2019.06.046

PubMed Abstract | CrossRef Full Text | Google Scholar

Peterka, R. J. (2002). Sensorimotor integration in human postural control. J. Neurophysiol. 88, 1097–1118. doi: 10.1152/jn.2002.88.3.1097

PubMed Abstract | CrossRef Full Text | Google Scholar

Poldrack, R. A., Huckins, G., and Varoquaux, G. (2020). Establishment of best practices for evidence for prediction: a review. JAMA Psychiatry 77, 534–540. doi: 10.1001/jamapsychiatry.2019.3671

PubMed Abstract | CrossRef Full Text | Google Scholar

Recenti, M., Ricciardi, C., Aubonnet, R., Picone, I., Jacob, D., Svansson, H. Á. R., et al. (2021). Toward predicting motion sickness using virtual reality and a moving platform assessing brain, muscles and heart signals. Front. Bioeng. Biotechnol. 9:635661. doi: 10.3389/fbioe.2021.635661

PubMed Abstract | CrossRef Full Text | Google Scholar

Reed-Jones, R. J., Vallis, L. A., Reed-Jones, J. G., and Trick, L. M. (2008). The relationship between postural stability and virtual environment adaptation. Neurosci. Lett. 435, 204–209. doi: 10.1016/j.neulet.2008.02.047

PubMed Abstract | CrossRef Full Text | Google Scholar

Scheinost, D., Noble, S., Horien, C., Greene, A. S., Lake, E., Salehi, M., et al. (2019). Ten simple rules for predictive modeling of individual differences in neuroimaging. Neuroimage 193, 35–45. doi: 10.1016/j.neuroimage.2019.02.057

PubMed Abstract | CrossRef Full Text | Google Scholar

Slobounov, S., Hallett, M., Stanhope, S., and Shibasaki, H. (2005). Role of cerebral cortex in human postural control: an EEG study. Clin. Neurophysiol. 116, 315–323. doi: 10.1016/j.clinph.2004.09.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Solnik, S., Rider, P., Steinweg, K., DeVita, P., and Hortobágyi, T. (2010). Teager-Kaiser energy operator signal conditioning improves EMG onset detection. Eur. J. Appl. Physiol. 110, 489–498. doi: 10.1007/s00421-010-1521-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Statistics and Machine Learning Toolbox (2022). Natick, Massachusetts: The MathWorks Inc. Available online at: https://de.mathworks.com/products/statistics.html.

Google Scholar

Tadel, F., Baillet, S., Mosher, J. C., Pantazis, D., and Leahy, R. M. (2011). Brainstorm: a user-friendly application for MEG/EEG analysis. Comput. Intell. Neurosci. 2011:879716. doi: 10.1155/2011/879716

PubMed Abstract | CrossRef Full Text | Google Scholar

van Emmerik, R. E. A., and van Wegen, E. E. H. (2002). On the functional aspects of variability in postural control. Exerc. Sport Sci. Rev. 30, 177–183. doi: 10.1097/00003677-200210000-00007

PubMed Abstract | CrossRef Full Text | Google Scholar

Woolsey, T. A., Hanaway, J., and Gado, M. H. (2017). The Brain Atlas. A Visual Guide to the Human Central Nervous System, 4th Edn. (Chichester, West Sussex, UK: Wiley), Available online at: https://search.ebscohost.com/login.aspx?direct=true&scope=site&db=nlebk&db=nlabk&AN=1456610.

Google Scholar

Keywords: postural control, machine learning, virtual reality, EEG, EMG, center of pressure

Citation: Stehle SA, Aubonnet R, Hassan M, Recenti M, Jacob D, Petersen H and Gargiulo P (2022) Predicting postural control adaptation measuring EEG, EMG, and center of pressure changes: BioVRSea paradigm. Front. Hum. Neurosci. 16:1038976. doi: 10.3389/fnhum.2022.1038976

Received: 07 September 2022; Accepted: 23 November 2022;
Published: 15 December 2022

Edited by:

Borja Sañudo, Sevilla University, Spain

Reviewed by:

Yun-Ju Lee, National Tsing Hua University, Taiwan
Sunghoon Shin, Yeungnam University, South Korea

Copyright © 2022 Stehle, Aubonnet, Hassan, Recenti, Jacob, Petersen and Gargiulo. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Paolo Gargiulo, cGFvbG9AcnUuaXM=

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.