Yanhong Zhou
Dong Wen
Huibin Lu
Wang Yao
Yijun Liu
Wenbo Qian1,4- 1School of Information Science and Engineering, Yanshan University, Qinhuangdao, China
- 2School of Mathematics and Information Science and Technology, Hebei Normal University of Science and Technology, Qinhuangdao, China
- 3The Key Laboratory for Computer Virtual Technology and System Integration of Hebei Province, Yanshan University, Qinhuangdao, China
- 4The Key Laboratory of Information Transmission and Signal Processing of Hebei Province, Yanshan University, Qinhuangdao, China
- 5School of Science, Yanshan University, Qinhuangdao, China
Introduction
Spatial cognitive evaluation and training (SCET) is a rapidly growing research field (Chunyin et al., 2011) in cognitive study. SCET is also greatly significant in the diagnosis and rehabilitation of mild cognitive impairment (MCI), mainly because patients with MCI show symptoms of spatial cognitive impairment at an early stage (Allison et al., 2016; Laczó et al., 2016). For SCET, real-time and accurate quantification is the ultimate goal in evaluation (Lin et al., 2015); it is expected to have a strong sense of participation for the subjects in training, and the training content is closely related to their daily life (Bormans et al., 2016).
Virtual reality (VR) (Tu et al., 2017) and brain–computer interface (BCI) (Xu et al., 2013) are popular technologies in SCET. Training with VR meets experience and social needs of subjects and can be used as the main way of spatial cognitive training (SCT) (Serino et al., 2015; Bormans et al., 2016; Davis and Ohman, 2016; Migo et al., 2016; Tu et al., 2017; Zygouris et al., 2017). However, in these studies, it is difficult to understand the training effect in real time to the subjects and trainers, although they are very eager to observe the training effect timely so as to adjust the training state or program. BCI based on electroencephalogram (EEG) signals (Xu et al., 2018) is often used for real-time SCET and can be applied to real-time monitoring of brain activity on the premise of high temporal resolution (Lin et al., 2015; Han et al., 2017; Chen et al., 2018; Guevara et al., 2018; Pergher et al., 2018). Therefore, it is a good choice to combine BCI and VR (Lechner et al., 2014; Koo et al., 2015; De Tommaso et al., 2016; Donati et al., 2016; Vourvopoulos and I Badia, 2016) for SCET, and there are preliminarily applied studies (Bischof and Boulanger, 2003; Jaiswal et al., 2010; Kober and Neuper, 2011; Tarnanas et al., 2015), which suggested that BCI-VR was a recommendable method of SCET. However, this combination is still in its infancy, and more work needs to be done before conclusions can be confidently drawn.
This study will review the literature related to SCET with VR, BCI, and BCI-VR; discuss the potential advantages of BCI-VR in SCET and future problems to be solved; and put forward our opinions. It is expected that this analysis may provide valuable suggestions for the field of information technology in SCET.
This study used the Web of Science–Science Citation Index/Social Sciences Citation Index (WOS–SCI/SSCI) database, focused on the studies of BCI, VR, and BCI-VR in SCET. The following search keywords were used: “spatial cognitive evaluation (SCE)” or “spatial cognitive training (SCT)” in combination with “brain–computer interface (BCI)” or “virtual reality (VR).” The most recent search was conducted on March 21, 2019.
Research Status of SCET With VR
It is a relatively independent cognitive factor for spatial cognitive ability (SCA), which can be improved by reasonable training (Chunyin et al., 2011). The water maze with VR, which has become the most classical experimental method in the field of SCET, was used to measure the SCA of rats (Morris, 1984). This method can be used to train the SCA of rats (Chunyin et al., 2011) and distinguish male and female participants (Astur et al., 1998). Currently, VR opens up a new way for the research of SCET and had been applied to some researches of SCET (Bormans et al., 2016; Tu et al., 2017), in which VR could help subjects to experience a strong sense of participation in training process, and the training environment with VR was not limited by the area.
In terms of SCE, VR is widely used in the evaluation of AD and MCI (Weniger et al., 2011). For AD patients, virtual hospital (Jiang and Li, 2007), virtual auditorium (Lange et al., 2007), virtual city (Zakzanis et al., 2009), virtual building (Cushman et al., 2008), and virtual environment of apartment (Davis and Ohman, 2016) can be used to evaluate the path finding and navigation ability. When implementing a virtual path learning task, preclinical AD showed disorder (Allison et al., 2016), and there are correlations between regional neurodegeneration of AD and ability of spatial terrain memory (Pengas et al., 2012). In addition, relocation tasks with VR can be used to assess the spatial memory of early AD (Shamsuddin et al., 2011, 2012; Caffo et al., 2012). For MCI patients, the missing ability to orientation in virtual space (Morganti et al., 2013) and virtual supermarket (Tu et al., 2015; Zygouris et al., 2017) can help us to screen them from all subjects (Zygouris et al., 2017). In addition, the virtual path navigation can be used to evaluate their visual spatial memory (Lesk et al., 2014), and virtual room location search can be used to detect their obstacles in spatial navigation (Serino et al., 2015).
In terms of SCT, there existed several VR games widely used by cognitive impairment patients. Virtual memory palaces game can be used to improve the quality of life and memory of AD (Bormans et al., 2016), virtual buildings navigation game can be applied to improve the driving skills and daily cognitive ability of AD patients (White and Moussavi, 2016), and the large virtual outdoor parks game can be used to train the navigation ability of patients with dementia (Flynn et al., 2003). In addition, other VR games can also be used to improve the spatial attention of cognitive impairment patients (Manera et al., 2016).
Research State of SCET With the Change of BCI Signals
Previous studies have shown that spatial memory, spatial orientation, and navigation dominated by the hippocampus were important components of spatial cognition (Olton et al., 1979). They also have shown that the dynamic characteristics of EEG signals from the parietal lobe were directly related to the ability of spatial memory and navigation (Chiu et al., 2012). Therefore, it is feasible to explore the changes of SCA from the perspective of EEG signal analysis.
From the perspective of SCE, BCI signals are widely used in the evaluation of spatial navigation and memory. For spatial navigation, dynamic features of the EEG signal can respond to the change of spatial navigation (Lin et al., 2009, 2015). The navigation performance was related to the power modulation in theta or gamma frequency band (Bell, 2002; White et al., 2012; Chen et al., 2018), Especially, the phase reset of theta rhythm during spatial navigation caused the NT170 latency effect (Baker and Holroyd, 2013). Interestingly, female participants showed stronger theta oscillations during spatial navigation (Nishiyama et al., 2002). For spatial memory, the perception and action in the memory task are different by EEG network analysis (Protopapa et al., 2011). The power of EEG signals from AD patients on alpha and theta frequency bands was significantly higher relative to normal control when performing object-location memory tasks (Han et al., 2017). In addition, when the delay, peak amplitude, and root mean square of P300 act as the features in visual spatial memory paradigm, the classification accuracy could achieve up to 91.76% (Li et al., 2013).
From the perspective of SCT, almost all of the studies focused on the training of spatial memory, which can enhance the connection between nervous activity and the brain network in frontal, parietal, and occipital lobes of MCI patients (Hampstead et al., 2011). In addition, the Pearson correlation coefficient between the right prefrontal lobe regions decreased after spatial memory task, which indicated that the region had a higher participation in memory task (Plank et al., 2010; Guevara et al., 2018), Surprisingly, old people showed higher amplitude of P300 in the parietal lobe than the young on spatial memory training (Pergher et al., 2018),
Based on the above researches, BCI can provide support for objective data analysis in SCET and can effectively improve the scientific quantification performance of this research field, as well as the operability and repeatability of experiments.
Research Status of SCET With BCI-VR
Research Value of BCI-VR
In recent years, the combination of BCI and VR has provided practical benefits for training and evaluation (Achanccaray et al., 2017). In VR training, BCI can be used to analyze brain activity synchronously in real time (Martišius and Damaševičius, 2016). Meanwhile, VR can provide a situation similar to the daily life, in which the brain activity could be evaluated by EEG analysis (Alchalcabi et al., 2017). Therefore, the fusion of VR and BCI can solve the subjective and nonreal-time evaluation of training effect in the training process. Recently, BCI-VR has been successfully used in some application fields, including steady-state visual evoked potential (Lechner et al., 2014) and motor imagery (I Badia et al., 2012; Vourvopoulos and I Badia, 2016) for stroke rehabilitation, which can overcome the limitation of traditional monitor refresh frequency (Calore et al., 2014; Koo et al., 2015) and increase the engagement of subjects (Koo and Choi, 2015). In addition, it has other applications, such as motion imaging for paraplegic rehabilitation (Donati et al., 2016), P300 for cognitive training of normal control (De Tommaso et al., 2016), autism training (Amaral et al., 2017), and hyperactivity training (Rohani and Puthusserypady, 2015).
Research Analysis of SCET With BCI-VR
At present, there are several studies that combine BCI and VR to exert their respective advantages in the field of SCET. For the spatial navigation, Bischof and Boulanger (2003) found that theta oscillation of EEG signals was related to the encoding and retrieval of spatial information when performing VR maze navigation tasks, and Silvia et al. compared the differences of EEG signals from male and female adults on theta frequency band with VR spatial navigation tasks (Kober and Neuper, 2011). For the spatial memory, Jaiswal et al. (2010) combined BCI with VR to observe differences in EEG activity during the coding and retrieval stages of spatial memory tasks. For other spatial task, Tarnanas et al. (2014a,b); Tarnanas et al. (2015) used VR day-out task to evaluate its predictive value of MCI. All of these studies have verified the rationality of the combination of BCI and VR in SCET research. Figure 1 showed the schematic diagram for the system description of the SCET with BCI-VR.
Figure 1. The schematic diagram for the system description of the SCET with BCI-VR.
Discussion
Many studies suggested that VR can be used to the SCET (Bormans et al., 2016; Manera et al., 2016; Tu et al., 2017; Zygouris et al., 2017) and changed the old way of SCE with neuropsychological scales, subjective judgments, qualitative description, and so on (Manera et al., 2016). VR technology has obvious advantages in immersive space experience and internal space visualization in the field of architectural design. However, VR is still unable to evaluate the effects of SCT in real time like BCI. Many studies also suggested that the change of BCI signals can be used to the SCET (Han et al., 2017; Chen et al., 2018; Guevara et al., 2018; Pergher et al., 2018). BCI can be used to analyze EEG signals in SCET effectively and improve the operability and repeatability of evaluation and training. However, BCI cannot supply an abundant environment for SCET compared to VR. Several studies in the field of SCET combined BCI and VR to exert their respective advantages (Jaiswal et al., 2010; Kober and Neuper, 2011; Tarnanas et al., 2015). Compared with BCI and VR used in SCET, BCI-VR not only can improve the effect of spatial cognition training but also can overcome the limitation of spatial cognition evaluation.
However, various challenges to be broken through currently exist in BCI-VR used in SCET. Firstly, effective interaction remains to be achieved in VR, so a new interaction model, which combines natural interaction in VR with BCI, needs to be studied. Secondly, wearing the wet electrode in BCI increases the experimental preparation time compared with the dry electrode in BCI. Currently, there is a lack of the dry electrode with high signal quality and good comfort. Therefore, the design and development of electrode in the future need to be strengthened. Thirdly, the SCT in the real environment requires a large space, but the range of activity scenes covered by existing VR equipment cannot meet this demand. Hence, the algorithm that can scale up or down the VR game scenes at will is very important.
Conclusions
In conclusion, this study reviewed the recent literature of VR, BCI, and BCI-VR used in SCET. Although these studies obtained promising results, more work needs to be done before conclusions can be confidently drawn. It is suggested that BCI and VR should be deeply integrated in order to give full play to their respective technical advantages. The current technical bottlenecks of BCI and VR should be broken through to provide personalized, comfortable, and real-time technical support for creating an effective environment for SCET. Therefore, in the future, for the SCET, it will be necessary to not only solve the technical problems of BCI-VR but also to take patients as important subjects, design personalized and adaptive BCI-VR games, and train the patients. In addition, the training effect had better be evaluated and fed back in real time in order to meet the individual needs of patients.
Author Contributions
HL, YZ, WY, and YL designed the work. YZ, DW, and HL wrote this manuscript. YZ, DW, WY, YL, WQ, and JY collected and analyzed the literatures. DW, WQ, and JY revised the manuscript before firstly submitted. HL, WY, and YL revised important intellectual content, added one figure, approved the final version to be published, and revised English grammar and sentences.
Funding
This research was funded by the National Natural Science Foundation of China (61876165, 61503326), Natural Science Foundation of Hebei Province in China (F2016203343), China Postdoctoral Science Foundation (2015M581317), and the Research and Development Plan of Qinhuangdao Science and Technology of China (201602A038, 201703A072).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Achanccaray, D., Acuna, K., Carranza, E., and Andreu-Perez, J. (2017). “A virtual reality and brain computer interface system for upper limb rehabilitation of post stroke patients,” in 2017 IEEE International Conference on Fuzzy Systems (Naples), 1–5. doi: 10.1109/FUZZ-IEEE.2017.8015726
Alchalcabi, A. E., Eddin, A. N., and Shirmohammadi, S. (2017). “More attention, less deficit: wearable EEG-based serious game for focus improvement,” in 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH) (Perth: IEEE), 1–8. doi: 10.1109/SeGAH.2017.7939288
Allison, S. L., Fagan, A. M., Morris, J. C., and Head, D. (2016). Spatial navigation in preclinical Alzheimer's disease. J. Alzheimer's Dis. 52, 77–90. doi: 10.3233/JAD-150855
Amaral, C. P., Simões, M. A., Mouga, S., Andrade, J., and Castelo-Branco, M. (2017). A novel Brain Computer Interface for classification of social joint attention in autism and comparison of 3 experimental setups: a feasibility study. J. Neurosci. Methods 290, 105–115. doi: 10.1016/j.jneumeth.2017.07.029
Astur, R. S., Ortiz, M. L., and Sutherland, R. J. (1998). A characterization of performance by men and women in a virtual Morris water task: a large and reliable sex difference. Behav. Brain Res. 93, 185–190. doi: 10.1016/S0166-4328(98)00019-9
Baker, T. E., and Holroyd, C. B. (2013). The topographical N170: electrophysiological evidence of a neural mechanism for human spatial navigation. Biol. Psychol. 94, 90–105. doi: 10.1016/j.biopsycho.2013.05.004
Bell, M. A. (2002). Power changes in infant EEG frequency bands during a spatial working memory task. Psychophysiology 39, 450–458. doi: 10.1111/1469-8986.3940450
Bischof, W. F., and Boulanger, P. (2003). Spatial navigation in virtual reality environments: an EEG analysis. CyberPsychol. Behav. 6, 487–495. doi: 10.1089/109493103769710514
Bormans, K., Roe, K., and De Wachter, D. (2016). Virtual memory palaces to improve quality of life in Alzheimer's disease. Annu. Rev. CyberTher. Telemed. 14, 227–232.
Caffo, A. O., De Caro, M. F., Picucci, L., Notarnicola, A., Settanni, A., Livrea, P., et al. (2012). Reorientation deficits are associated with amnestic mild cognitive impairment. Am. J. Alzheimer's Dis. Other Dement. 27, 321–330. doi: 10.1177/1533317512452035
Calore, E., Gadia, D., and Marini, D. (2014). “Eliciting steady-state visual evoked potentials by means of stereoscopic displays,” in Stereoscopic Displays and Applications XXV: International Society for Optics and Photonics (San Francisco, CA), 901126. doi: 10.1117/12.2036936
Chen, D., Kunz, L., Wang, W., Zhang, H., Wang, W.-X., Schulze-Bonhage, A., et al. (2018). Hexadirectional modulation of theta power in human entorhinal cortex during spatial navigation. Curr. Biol. 28, 3310–3315.e3314. doi: 10.1016/j.cub.2018.08.029
Chiu, T. C., Gramann, K., Ko, L. W., Duann, J. R., Jung, T. P., and Lin, C. T. (2012). Alpha modulation in parietal and retrosplenial cortex correlates with navigation performance. Psychophysiology 49, 43–55. doi: 10.1111/j.1469-8986.2011.01270.x
Chunyin, S., Zhihong, H., Kaifeng, L., Xiaomin, L., and Wenjing, L. (2011). The effect of training style to spatial learning and memory of rat. J. Shanxi Med. Univ. 42, 539–541.
Cushman, L. A., Stein, K., and Duffy, C. J. (2008). Detecting navigational deficits in cognitive aging and Alzheimer disease using virtual reality. Neurology 71, 888–895. doi: 10.1212/01.wnl.0000326262.67613.fe
Davis, R., and Ohman, J. (2016). Wayfinding in ageing and Alzheimer's disease within a virtual senior residence: study protocol. J. Adv. Nurs. 72, 1677–1688. doi: 10.1111/jan.12945
De Tommaso, M., Ricci, K., Delussi, M., Montemurno, A., Vecchio, E., Brunetti, A., et al. (2016). Testing a novel method for improving wayfinding by means of a P3b Virtual Reality Visual Paradigm in normal aging. SpringerPlus 5:1297. doi: 10.1186/s40064-016-2978-7
Donati, A. R., Shokur, S., Morya, E., Campos, D. S., Moioli, R. C., Gitti, C. M., et al. (2016). Long-term training with a brain-machine interface-based gait protocol induces partial neurological recovery in paraplegic patients. Sci. Rep. 6:30383. doi: 10.1038/srep30383
Flynn, D., Van Schaik, P., Blackman, T., Femcott, C., Hobbs, B., and Calderon, C. (2003). Developing a virtual reality–based methodology for people with dementia: a feasibility study. CyberPsychol. Behav. 6, 591–611. doi: 10.1089/109493103322725379
Guevara, M. A., Paniagua, E. I. C., González, M. H., Carrillo, I. K. S., Sepúlveda, M. L. A., Orozco, J. C. H., et al. (2018). EEG activity during the spatial span task in young men: differences between short-term and working memory. Brain Res. 1683, 86–94. doi: 10.1016/j.brainres.2018.02.004
Hampstead, B. M., Stringer, A. Y., Stilla, R. F., Deshpande, G., Hu, X., Moore, A. B., et al. (2011). Activation and effective connectivity changes following explicit-memory training for face–name pairs in patients with mild cognitive impairment: a pilot study. Neurorehabil. Neural Repair 25, 210–222. doi: 10.1177/1545968310382424
Han, Y., Wang, K., Jia, J., and Wu, W. (2017). Changes of EEG spectra and functional connectivity during an object-location memory task in Alzheimer's disease. Front. Behav. Neurosci. 11:107. doi: 10.3389/fnbeh.2017.00107
I Badia, S. B., Morgade, A. G., Samaha, H., and Verschure, P. (2012). Using a hybrid brain computer interface and virtual reality system to monitor and promote cortical reorganization through motor activity and motor imagery training. IEEE Trans. Neural Syst. Rehabil. Eng. 21, 174–181. doi: 10.1109/TNSRE.2012.2229295
Jaiswal, N., Ray, W., and Slobounov, S. (2010). Encoding of visual–spatial information in working memory requires more cerebral efforts than retrieval: evidence from an EEG and virtual reality study. Brain Res. 1347, 80–89. doi: 10.1016/j.brainres.2010.05.086
Jiang, C.-F., and Li, Y.-S. (2007). “Virtual hospital-a computer-aided platform to evaluate the sense of direction,” in 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Lyon: IEEE), 2361–2364. doi: 10.1109/IEMBS.2007.4352801
Kober, S. E., and Neuper, C. (2011). Sex differences in human EEG theta oscillations during spatial navigation in virtual reality. Int. J. Psychophysiol. 79, 347–355. doi: 10.1016/j.ijpsycho.2010.12.002
Koo, B., and Choi, S. (2015). “SSVEP response on oculus rift in brain-computer interface (BCI),” in The 3rd International Winter Conference on Brain-Computer Interface (Sabuk: IEEE), 1–4. doi: 10.1109/IWW-BCI.2015.7073028
Koo, B., Lee, H.-G., Nam, Y., and Choi, S. (2015). “Immersive BCI with SSVEP in VR head-mounted display,” in 2015 37th Annual International Conference of the IEEE Engineering in Medicine And Biology Society (EMBC) (Milan: IEEE), 1103–1106. doi: 10.1109/EMBC.2015.7318558
Laczó, J., Parizkova, M., Moffat, S. D., Vyhnalek, M., Andel, R., and Hort, J. (2016). The effect of early-stage Alzheimer's disease on spatial navigation strategies: a pilot study. Alzheimer's Dement. 12, 565–566. doi: 10.1016/j.jalz.2016.06.1106
Lange, B. S., Rizzo, A., Astur, R., and Parsons, T. (2007). Virtual reality visuospatial and wayfinding assessment for mild dementia of the Alzheimer's type. Alzheimer's Dement. 3:S135. doi: 10.1016/j.jalz.2007.04.178
Lechner, A., Ortner, R., and Guger, C. (2014). “Feedback strategies for BCI based stroke rehabilitation: evaluation of different approaches,” in 2nd International Conference on NeuroRehabilitation (Aalborg: Springer), 507–512. doi: 10.1007/978-3-319-08072-7_75
Lesk, V. E., Shamsuddin, S. N. W., Walters, E. R., and Ugail, H. (2014). Using a virtual environment to assess cognition in the elderly. Virtual Real. 18, 271–279. doi: 10.1007/s10055-014-0252-2
Li, X., Yan, Y., and Wei, W. (2013). Identifying patients with poststroke mild cognitive impairment by pattern recognition of working memory load-related ERP. Comput. Math. Methods Med. 2013:658501. doi: 10.1155/2013/658501
Lin, C.-T., Chiu, T.-C., and Gramann, K. (2015). EEG correlates of spatial orientation in the human retrosplenial complex. Neuroimage 120, 123–132. doi: 10.1016/j.neuroimage.2015.07.009
Lin, C.-T., Yang, F.-S., Chiou, T.-C., Ko, L.-W., Duann, J.-R., and Gramann, K. (2009). “EEG-based spatial navigation estimation in a virtual reality driving environment,” in 2009 Ninth IEEE International Conference on Bioinformatics and BioEngineering (Taichung: IEEE), 435–438. doi: 10.1109/BIBE.2009.65
Manera, V., Chapoulie, E., Bourgeois, J., Guerchouche, R., David, R., Ondrej, J., et al. (2016). A feasibility study with image-based rendered virtual reality in patients with mild cognitive impairment and dementia. PLoS ONE 11:e0151487. doi: 10.1371/journal.pone.0151487
Martišius, I., and Damaševičius, R. (2016). A prototype SSVEP based real time BCI gaming system. Comput. Intell. Neurosci. 2016:3861425. doi: 10.1155/2016/3861425
Migo, E., O'daly, O., Mitterschiffthaler, M., Antonova, E., Dawson, G., Dourish, C., et al. (2016). Investigating virtual reality navigation in amnestic mild cognitive impairment using fMRI. Aging Neuropsychol. Cogn. 23, 196–217. doi: 10.1080/13825585.2015.1073218
Morganti, F., Stefanini, S., and Riva, G. (2013). From allo-to egocentric spatial ability in early Alzheimer's disease: a study with virtual reality spatial tasks. Cogn. Neurosci. 4, 171–180. doi: 10.1080/17588928.2013.854762
Morris, R. (1984). Developments of a water-maze procedure for studying spatial learning in the rat. J. Neurosci. Methods 11, 47–60. doi: 10.1016/0165-0270(84)90007-4
Nishiyama, N., Mizuhara, H., Miwakeichi, F., and Yamaguchi, Y. (2002). “Theta episodes observed in human scalp EEG during virtual navigation-spatial distribution and task dependence,” in Proceedings of the 9th International Conference on Neural Information Processing, ICONIP'02 (Singapore: IEEE), 428–432.
Olton, D. S., Becker, J. T., and Handelmann, G. E. (1979). Hippocampus, space, and memory. Behav. Brain Sci. 2, 313–322. doi: 10.1017/S0140525X00062713
Pengas, G., Williams, G., Acosta-Cabronero, J., Ash, T., Hong, Y., Izquierdo-Garcia, D., et al. (2012). The relationship of topographical memory performance to regional neurodegeneration in Alzheimer's disease. Front. Aging Neurosci. 4:17. doi: 10.3389/fnagi.2012.00017
Pergher, V., Wittevrongel, B., Tournoy, J., Schoenmakers, B., and Van Hulle, M. M. (2018). N-back training and transfer effects revealed by behavioral responses and EEG. Brain Behav. 8:e01136. doi: 10.1002/brb3.1136
Plank, M., Müller, H. J., Onton, J., Makeig, S., and Gramann, K. (2010). “Human EEG correlates of spatial navigation within egocentric and allocentric reference frames,” in International Conference on Spatial Cognition (Portland, OR: Springer), 191–206. doi: 10.1007/978-3-642-14749-4_18
Protopapa, F., Mylonas, D., Spiliotis, K., Siettos, C., Smyrnis, N., and Evdokimidis, I. (2011). “Dynamic analysis of EEG signals during spatial working memory used for either perception discrimination or planning of action,” in 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Boston, MA: IEEE), 5896–5899. doi: 10.1109/IEMBS.2011.6091458
Rohani, D. A., and Puthusserypady, S. (2015). BCI inside a virtual reality classroom: a potential training tool for attention. EPJ Nonlin. Biomed. Phys. 3:12. doi: 10.1140/epjnbp/s40366-015-0027-z
Serino, S., Morganti, F., Di Stefano, F., and Riva, G. (2015). Detecting early egocentric and allocentric impairments deficits in Alzheimer's disease: an experimental study with virtual reality. Front. Aging Neurosci. 7:88. doi: 10.3389/fnagi.2015.00088
Shamsuddin, S. N. W., Ugail, H., Lesk, V., and Walters, E. (2012). “VREAD: a virtual simulation to investigate cognitive function in the elderly,” in 2012 International Conference on Cyberworlds (Darmstadt: IEEE), 215–220. doi: 10.1109/CW.2012.37
Shamsuddin, S. W., Lesk, V., and Ugail, H. (2011). “Virtual environment design guidelines for elderly people in early detection of dementia,” in Proceedings of International Conference on Computer and Information Science (Sanya: Citeseer), 751–755.
Tarnanas, I., Laskaris, N., Tsolaki, M., Muri, R., Nef, T., and Mosimann, U. P. (2015). On the comparison of a novel serious game and electroencephalography biomarkers for early dementia screening. Adv. Exp. Med. Biol. 821, 63–77. doi: 10.1007/978-3-319-08939-3_11
Tarnanas, I., Tsolaki, M., Nef, T., Müri, R. M., and Mosimann, U. P. (2014a). Can a novel computerized cognitive screening test provide additional information for early detection of Alzheimer's disease? Alzheimer's Dement. 10, 790–798. doi: 10.1016/j.jalz.2014.01.002
Tarnanas, I., Tsolakis, A., and Tsolaki, M. (2014b). “Assessing virtual reality environments as cognitive stimulation method for patients with MCI,” in Technologies of Inclusive Well-Being, eds A. L. Brooks, S. Brahnam, and L. C. Jain (Berlin; Heidelberg: Springer), 39–74. doi: 10.1007/978-3-642-45432-5_4
Tu, S., Spiers, H. J., Hodges, J. R., Piguet, O., and Hornberger, M. (2017). Egocentric versus allocentric spatial memory in behavioral variant frontotemporal dementia and Alzheimer's disease. J. Alzheimer's Dis. 59, 883–892. doi: 10.3233/JAD-160592
Tu, S., Wong, S., Hodges, J. R., Irish, M., Piguet, O., and Hornberger, M. (2015). Lost in spatial translation–A novel tool to objectively assess spatial disorientation in Alzheimer's disease and frontotemporal dementia. Cortex 67, 83–94. doi: 10.1016/j.cortex.2015.03.016
Vourvopoulos, A., and I Badia, S. B. (2016). Motor priming in virtual reality can augment motor-imagery training efficacy in restorative brain-computer interaction: a within-subject analysis. J. Neuroeng. Rehabil. 13:69. doi: 10.1186/s12984-016-0173-2
Weniger, G., Ruhleder, M., Lange, C., Wolf, S., and Irle, E. (2011). Egocentric and allocentric memory as assessed by virtual reality in individuals with amnestic mild cognitive impairment. Neuropsychologia 49, 518–527. doi: 10.1016/j.neuropsychologia.2010.12.031
White, D. J., Congedo, M., Ciorciari, J., and Silberstein, R. B. (2012). Brain oscillatory activity during spatial navigation: theta and gamma activity link medial temporal and parietal regions. J. Cogn. Neurosci. 24, 686–697. doi: 10.1162/jocn_a_00098
White, P. J., and Moussavi, Z. (2016). Neurocognitive treatment for a patient with Alzheimer's disease using a virtual reality navigational environment. J. Exp. Neurosci. 10, 129–135. doi: 10.4137/JEN.S40827
Xu, M., Qi, H., Wan, B., Yin, T., Liu, Z., and Ming, D. (2013). A hybrid BCI speller paradigm combining P300 potential and the SSVEP blocking feature. J. Neural Eng. 10:026001. doi: 10.1088/1741-2560/10/2/026001
Xu, M., Xiao, X., Wang, Y., Qi, H., Jung, T.-P., and Ming, D. (2018). A brain computer interface based on miniature event-related potentials induced by very small lateral visual stimuli. IEEE Trans. Biomed. Eng. 65, 1166–1175. doi: 10.1109/TBME.2018.2799661
Zakzanis, K. K., Quintin, G., Graham, S. J., and Mraz, R. (2009). Age and dementia related differences in spatial navigation within an immersive virtual environment. Med. Sci. Monit. 15, CR140–CR150.
Zygouris, S., Ntovas, K., Giakoumis, D., Votis, K., Doumpoulakis, S., Segkouli, S., et al. (2017). A preliminary study on the feasibility of using a virtual reality cognitive training application for remote detection of mild cognitive impairment. J. Alzheimer's Dis. 56, 619–627. doi: 10.3233/JAD-160518
Keywords: spatial cognition, training, evaluation, brain–computer interface, virtual reality
Citation: Zhou Y, Wen D, Lu H, Yao W, Liu Y, Qian W and Yuan J (2020) The Current Research of Spatial Cognitive Evaluation and Training With Brain–Computer Interface and Virtual Reality. Front. Neurosci. 13:1439. doi: 10.3389/fnins.2019.01439
Received: 13 August 2019; Accepted: 20 December 2019;
Published: 07 February 2020.
Edited by:
Jaroslaw Jerzy Barski, Medical University of Silesia, PolandReviewed by:
Minpeng Xu, Tianjin University, ChinaXiaogang Chen, Institute of Biomedical Engineering (CAMS), China
Yu Sun, Zhejiang University, China
Copyright © 2020 Zhou, Wen, Lu, Yao, Liu, Qian and Yuan. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Huibin Lu, aGJsdTE2OCYjeDAwMDQwOzE2My5jb20=
†These authors have contributed equally to this work