Dong Wen
Xifa Lan3
Yanhong Zhou- 1Department of Software Engineering, School of Information Science and Engineering, Yanshan University, Qinhuangdao, China
- 2The Key Laboratory for Computer Virtual Technology and System Integration of Hebei Province, Yanshan University, Qinhuangdao, China
- 3Department of Neurology, First Hospital of Qinhuangdao, Qinhuangdao, China
- 4Department of Computer Science and Technology, School of Mathematics and Information Science and Technology, Hebei Normal University of Science and Technology, Qinhuangdao, China
- 5Swartz Center for Computational Neuroscience, University of California, San Diego, San Diego, CA, United States
Introduction
The evaluation and rehabilitation (EAR) of patients with different cognitive impairment phases (PDCIP), including subjective cognitive decline (SCD) (Jessen et al., 2014; Innes et al., 2016a,b, 2017), mild cognitive impairment (MCI) (Weniger et al., 2011) and Alzheimer's disease (AD) (Serino et al., 2015), become a rapidly growing research field. Virtual reality (VR) has been reported to re-activate and/or improve multiple cortical functions (Baumann et al., 2003; Lin et al., 2008; Schedlbauer et al., 2014; Carrieri et al., 2016) and help optimize the coding efficiency of the sensory cortex (Ansuini et al., 2006; Keller et al., 2012; Ravassard et al., 2013; Schindler and Bartels, 2013; Sofroniew et al., 2015). Therefore, many researchers have started applying the VR technology to the EAR of PDCIP (Buss, 2009), including spatial memory (Allison et al., 2016), episodic memory (Valladares-Rodriguez et al., 2017), activities of daily living (Seo et al., 2017), language (Montenegro and Argyriou, 2017), executive function (Tost et al., 2014), short-term and working memory (Burdea et al., 2013), attention (Kalová et al., 2005), movement and balance (McEwen et al., 2014), and outdoor activities (Van Schaik et al., 2008). For EAR of PDCIP, the advantages of using VR over conventional approaches, such as electroencephalogram (EEG), functional magnetic resonance imaging (fMRI), and neuropsychological tasks, have been reported (Tarnanas et al., 2014a,b, 2015a). However, these studies did not record EEG during the course of evaluation and training within a VR environment, nor took full advantages of the EEG recordings to objectively explore the brain states of PDCIP in (near) real time, despite the combination of VR and EEG has been used in the EAR of other diseases, including stroke (I Badia et al., 2013; Lechner et al., 2014; Vourvopoulos and I Badia, 2016), paraplegic (Donati et al., 2016), autism (Amaral et al., 2017), attention deficit hyperactivity disorder (Rohani and Puthusserypady, 2015) and so on. The neuroimaging research for the EAR of PDCIP within a VR environment is still in its infancy, and more works need to be done before conclusions can be confidently drawn.
This study will review the literature related to the EAR of PDCIP from the perspectives of VR and EEG, and discuss the potential advantages of the combined use of VR and EEG. It is expected that the analysis may provide useful suggestions to the field of the EAR of PDCIP.
The EAR of PDCIP Based on VR
Spatial Memory Impairments
Spatial memory impairment is a common symptom in PDCIP (Nedelska et al., 2012; Vlček and Laczó, 2014), and many studies have explored the EAR for the spatial memory of PDCIP using VR (Bormans et al., 2016; Tu et al., 2017). For example, Virtual Reality for Early Detection of Dementia (VReDD) including VR Practice, VR Park and VR Games was developed to assess spatial memory of early dementia patients (Shamsuddin et al., 2011, 2012). Caffò and colleagues also showed that the spatial memory impairments of amnestic MCI (aMCI) patients could be identified by a reorientation task in VR (Caffò et al., 2012).
In a virtual maze, many studies showed that the spatial orientation ability of AD patients was poorer compared to normal control (NC) (Morganti et al., 2013). The aMCI patients also performed poorly in two VR tasks (Weniger et al., 2011) and a virtual radial arm maze (Lee et al., 2014; Migo et al., 2016). Furthermore, preclinical AD patients were defective in a VR path-finding and route-learning task (Allison et al., 2016).
Recently, Zygouris et al. (2017), proposed a virtual supermarket for screening MCI from the elderly (Zygouris et al., 2017), and could be used to objectively evaluate the spatial-orientation ability of AD patients based on the integrity of the retrosplenial cortex (Tu et al., 2015). There were also different levels of impairments in judgments of allocentric and egocentric heading direction between patients with the behavioral variant fronto-temporal dementia and AD (Tu et al., 2017).
Applications of virtual buildings and rooms in VR can both evaluate and rehabilitate the spatial memory in PDCIP. In evaluation, the wayfinding and navigation ability of AD patients can be assessed based on a virtual hospital (Jiang and Li, 2007), virtual auditorium (Lange et al., 2007), virtual city (Zakzanis et al., 2009), virtual buildings (Cushman et al., 2008), and virtual environments of senior residential buildings (Davis and Ohman, 2016). In addition, Pengas et al. found the relationship between topographic memory capacity and regional neurodegeneration in AD patients using a virtual route-learning test (Pengas et al., 2012). For MCI patients, a virtual road-navigation task was used to evaluate visual-spatial memory (Lesk et al., 2014), and a virtual room-location-searching task was used to detect the impairments of egocentric and allocentric spatial-navigation (Serino et al., 2015). In rehabilitation, virtual memory palaces could improve the living quality and memory of AD patients (Bormans et al., 2016), and a VR building-navigation game could enhance their driving skills and daily cognitive abilities (White and Moussavi, 2016).
Episodic Memory Impairment
An episodic memory impairment, which often co-exists with the spatial memory impairment in aMCI and AD patients, is an important indicator of PDCIP (Bellassen et al., 2012). VR has been used to evaluate the episodic memory of PDCIP (Valladares-Rodriguez et al., 2017). For AD patients, the virtual alleys could be utilized to evaluate and predict their the temporal order memory in the episodic memory (Bellassen et al., 2012), and the virtual living scene could be used to evaluate their episodic memory and executive function (Sauzéon et al., 2016). The impairments of episodic and spatial memory often co-exist in patients with aMCI and AD. Plancher et al. showed that active and passive encoding in a virtual driving task could help distinguish the patients from NC (Plancher et al., 2012). Serino and Riva also reported that unconsciousness anosognosia, which might be caused by episodic and spatial memory disorders, could be a biomarker of AD patients (Serino and Riva, 2017).
Other Cognitive Impairments
Daily Living Tasks
Virtual-reality kitchen (VRK) is a popular research tool for the EAR of PDCIP. For evaluation, the impairments of instrumental activities of AD patients could be assessed by the coffee-making task (Allain et al., 2014) and the cooking task (Vallejo et al., 2017), in which the patients required more time to complete compared with NC. In addition, aMCI patients could be evaluated by a virtual apartment fire-evacuation drill (Tarnanas et al., 2015b) and kinematic measures in some virtual tasks including withdrawing cash and taking a bus (Seo et al., 2017). Virtual supermarket is another commonly used tool, which meets the standard of the neuropsychological examination utilized in the diagnosis of MCI (Tsolaki et al., 2015), and can be used to remotely evaluate MCI (Zygouris et al., 2017). For rehabilitation, studies have shown that AD patients could improve their good performance by receiving training with daily cooking activities in a Dual-Modal VRK (Yamaguchi et al., 2012) and a kitchen and cooking virtual game (Manera et al., 2015). The daily living ability of AD patients could also be improved by practicing some virtual tasks (Hofmann et al., 2003).
Language Memory and Expression
AD patients could be diagnosed based on their memory of verbal material and spatial scenery within VR (Widmann et al., 2012). Screening tests within virtual-room game include language expression and understanding (Montenegro and Argyriou, 2015, 2017). In addition, interviews with patients in VR environments could be used to evaluate frontotemporal dementia (Mendez et al., 2015).
Executive Function, Memory and Attention
The VR tools, including a virtual action-planning supermarket (Werner et al., 2009), virtual store (Yeh et al., 2012), virtual reality day-out task (Tarnanas et al., 2013, 2014a) and 3D family virtual environment and task (Tost et al., 2014), are often used in the assessment of executive functions, memory and attention capabilities of PDCIP. In addition, VR could be utilized to evaluate the attention of AD patients (Kalová et al., 2005), rehabilitate the short-term and working memory of patients with advanced dementia (Burdea et al., 2013), enhance the objective memory of old people with questionable dementia (Man et al., 2012), and improve the attention of MCI and dementia patients (Manera et al., 2016).
Movement and Balance
Studies suggested that VR training might improve the balance and mobility of dementia patients (McEwen et al., 2014) and recover the motor and postural abilities of the MCI patients (Bourrelier et al., 2016).
Outdoor Activities
Outdoor activities within VR can help evaluate and train patients with dementia. VR could be used to simulate the environment of outdoor activities and thereby improve the frequency of their outdoor activities (Blackman et al., 2007), to enable the patients to plan and test outdoor design (Blackman et al., 2003), and to detect and improve their ability of functioning outdoors (Van Schaik et al., 2008). In addition, the virtual environment of a large outdoor park could be utilized to evaluate the navigation and control ability of the patients (Flynn et al., 2003).
Current Challenges
Although the EAR of PDCIP based on VR has shown preliminary achievements, current methods used to test the effectiveness of the EAR are mainly confined to the assessments of neuropsychological scales, subjective judgments of experimenters and researchers, and qualitative descriptions and feedback from patients and their dependents. These examination methods might not lead to accurate and timely evaluations, nor provide the scientific evidence for the effectiveness of VR during and after training. Hence, there is a need for objective and quantitative evaluation methods, ideally in near real-time, for the diagnosis and rehabilitation within VR.
The Status of Combining VR and EEG Technology and Its Application in the EAR of PDCIP
The Research Value and Status of VR and EEG
EEG is often used in clinical evaluation and detection of neurological diseases. Compared to other noninvasive neuroimaging technologies such as fMRI, EEG provides a direct, real-time measurement of brain activity with high temporal resolution. In addition, EEG recording devices can be portable and relatively low cost, enabling real-world applications. The combined use of the EEG within VR (VR-EEG) may provide substantial benefits to EAR. On one hand, EEG can simultaneously record a person's brain activity and brain state in near real-time during VR training. On the other hand, VR can be used to provide a scenario close to person's life, in which the brain state can be evaluated based on EEG. Hence, VR-EEG might resolve the issues of subjective and unpunctual evaluation in the EAR and can quantitatively evaluate the effectiveness of VR training in near real-time.
Recently, studies of VR-EEG technology have begun to take shape. For example, some studies employed brain-computer interface (BCI) technologies within VR, including the steady-state visual evoked potential BCI for rehabilitating stroke (Lechner et al., 2014), overcoming the limitations of refresh frequency of a regular monitor (Calore et al., 2014), and improving the user engagement (Koo et al., 2015), the motor-imagery BCI for stroke rehabilitation (I Badia et al., 2013; Vourvopoulos and I Badia, 2016) and paraplegic patients (Donati et al., 2016), and the P300 BCI for training normal aging subjects (de Tommaso et al., 2016) and patients with autism disorder (Amaral et al., 2017) and attention deficit hyperactivity disorder (Rohani and Puthusserypady, 2015).
The VR and EEG for the EAR of PDCIP
Recently, several studies added the measurements of EEG into VR training and evaluation of PDCIP, and compared the performance of VR and EEG (Tarnanas et al., 2014a,b, 2015a). For example, VR day-out task (VR-DOT) was used to train MCI patients, whose brain states were evaluated by EEG, fMRI and neuropsychological scales before and after the training, and the result suggested that the performance of VR-DOT correlated strongly with event-related potentials of cortical thickness (Tarnanas et al., 2014a). In addition, the virtual action-planning museum and EEG were also used in assessing spatial navigation, prospective memory and executive function of the MCI patients, the results also suggested using VR over EEG (Tarnanas et al., 2014b, 2015a). However, these studies did not measure the EEG activities of the patients during their training or rehabilitation sessions to assess the effectiveness of training and provide feedback to the patients. In other words, they still used an open-loop therapeutic method, and the true value of the combined use of VR and EEG has not been implemented or explored for the EAR of PDCIP.
Future Direction of EAR for PDCIP Based on VR and EEG
While achievements have been made in the EAR for the MCI and AD patients based on VR, the VR-based EAR for patients with SCD, a preclinical state of MCI and AD, has not yet started. The evaluation of SCD patients is mainly limited to Cerebrospinal fluid, fMRI and EEG methods (Sun et al., 2015; Zhou et al., 2016). The rehabilitation of the SCD is confined to meditation, music therapy (Innes et al., 2016b, 2017), and mindfulness training (Smart et al., 2016). The studies have achieved promising results, however some subjects in these studies were unable to complete the experiments, the sample size of these studies was fairly small, and their follow-up period was short. In the future, for the EAR of SCD, MCI, and AD patients, meditation, music and mindfulness training will can be incorporated into immersive VR environments to engage the patients and thereby improve the effectiveness of training. In addition, brain activities of the patients can be measured during training to objectively and quantitatively evaluate the progress of the rehabilitation, which could motivate the patients to continue the rehabilitation process. As mentioned in the literature (Anguera et al., 2013; de Tommaso et al., 2016), one can use VR for the EAR of PDCIP and simultaneously collect EEG signals of patients to assess the effectiveness of rehabilitation. Alternatively, EEG signals of PDCIP can be used to control/interact with virtual characters in VR to make the training more interactive and even entertaining to improve the effects of the EAR. In addition, fMRI, near infrared spectroscopy, and cerebral oxygen metabolism markers can also be used to evaluate the PDCIP before and after the training based on VR and EEG.
Conclusion
In conclusion, this study reviewed the recent literature of the EAR of PDCIP based on VR. Although these studies obtained promising results, more work needs to be done before conclusions can be confidently drawn. We also suggest collecting EEG activities of the patients before, during, and after the training to assess the bio-markers of neuroplasticity and monitor the progress of the rehabilitation. The ultimate goal is to create and evaluate a closed-loop EAR system for PDCIP. As we all know, without any intervention, the patients with cognitive impairments would have a poor prognosis such as rapid cognitive decline as they age. However, the neuroplasticity provides a possibility for intervention. Therefore, some new approaches, such as TMS and effective cognitive training including VR, could be developed to intervene the decline of metabolic efficiency and neuroplasticity with age. In particular, many studies have shown that the cognitive training in VR could enhance the neuroplasticity of the brain (Johnson et al., 1998; Anopas and Wongsawat, 2014; Robles-García et al., 2016; Teo et al., 2016), and help repair damaged brain circuits (Subramanian and Prasanna, 2017; Yang et al., 2017). In consequence, we postulate that the cognitive training using VR and EEG can intervene effectively and help improve the cognitive functions of the patients in this paper.
Author Contributions
DW designed the study and wrote this paper, DW, XL, and YZ analyzed literature, GL and S-HH revised this paper, T-PJ designed the study and revised this paper.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This research was funded by National Natural Science Foundation of China (61503326), Natural Science Foundation of Hebei Province in China (F2016203343), China Postdoctoral Science Foundation (2015M581317) and Doctorial Foundation of Yanshan University in China (B900).
References
Allain, P., Foloppe, D. A., Besnard, J., Yamaguchi, T., Etcharry-Bouyx, F., Le Gall, D., et al. (2014). Detecting everyday action deficits in Alzheimer's disease using a nonimmersive virtual reality kitchen. J. Int. Neuropsychol. Soc. 20, 468–477. doi: 10.1017/S1355617714000344
Allison, S. L., Fagan, A. M., Morris, J. C., and Head, D. (2016). Spatial navigation in preclinical Alzheimer's disease. J. Alzheimers Dis. 52, 77–90. doi: 10.3233/JAD-150855
Amaral, C. P., Simões, M. A., Mouga, S., Andrade, J., and Castelo-Branco, M. (2017). A novel Brain Computer Interface for classification of social joint attention in autism and comparison of 3 experimental setups: a feasibility study. J. Neurosci. Methods 290, 105–115. doi: 10.1016/j.jneumeth.2017.07.029
Anguera, J. A., Boccanfuso, J., Rintoul, J. L., Al-Hashimi, O., Faraji, F., Janowich, J., et al. (2013). Video game training enhances cognitive control in older adults. Nature 501, 97–101. doi: 10.1038/nature12486
Anopas, D., and Wongsawat, Y. (2014). “Virtual reality game for memory skills enhancement based on QEEG,” in 2014 7th IEEE Biomedical Engineering International Conference (BMEiCON) (Fukuoka), 1–5.
Ansuini, C., Pierno, A. C., Lusher, D., and Castiello, U. (2006). Virtual reality applications for the remapping of space in neglect patients. Restor. Neurol. Neurosci. 24, 431–441.
Baumann, S., Neff, C., Fetzick, S., Stangl, G., Basler, L., Vereneck, R., et al. (2003). A virtual reality system for neurobehavioral and functional MRI studies. CyberPsychol. Behav. 6, 259–266. doi: 10.1089/109493103322011542
Bellassen, V., Iglói, K., de Souza, L. C., Dubois, B., and Rondi-Reig, L. (2012). Temporal order memory assessed during spatiotemporal navigation as a behavioral cognitive marker for differential Alzheimer's disease diagnosis. J. Neurosci. 32, 1942–1952. doi: 10.1523/JNEUROSCI.4556-11.2012
Blackman, T., Mitchell, L., Burton, E., Jenks, M., Parsons, M., Raman, S., et al. (2003). The accessibility of public spaces for people with dementia: a new priority for the “open city.” Disabil. Soc. 18, 357–371. doi: 10.1080/0968759032000052914
Blackman, T., Van Schaik, P., and Martyr, A. (2007). Outdoor environments for people with dementia: an exploratory study using virtual reality. Ageing Soc. 27, 811–825. doi: 10.1017/S0144686X07006253
Bormans, K., Roe, K., and De Wachter, D. (2016). Virtual memory palaces to improve quality of life in Alzheimer's disease. Annu. Rev. CyberTher. Telemed. 14, 227–232.
Bourrelier, J., Ryard, J., Dion, M., Merienne, F., Manckoundia, P., and Mourey, F. (2016). Use of a virtual environment to engage motor and postural abilities in elderly subjects with and without mild cognitive impairment (MAAMI project). IRBM 37, 75–80. doi: 10.1016/j.irbm.2016.02.007
Burdea, G., Rabin, B., Rethage, D., Damiani, F., Hundal, J., and Fitzpatrick, C. (2013). “BrightArm™ therapy for patients with advanced dementia: a feasibility study,” in 2013 International Conference on Virtual Rehabilitation (ICVR) (Philadelphia, PA: IEEE), 208–209.
Buss, B. (2009). Virtual Reality Training System for Patients with Dementia. Zürich: ETH, Swiss Federal Institute of Technology; Institute of Neuroinformatics.
Caffò, A. O., De Caro, M. F., Picucci, L., Notarnicola, A., Settanni, A., Livrea, P., et al. (2012). Reorientation deficits are associated with amnestic mild cognitive impairment. Am. J. Alzheimers Dis. Other Demen. 27, 321–330. doi: 10.1177/1533317512452035
Calore, E., Gadia, D., and Marini, D. (2014). “Eliciting steady-state visual evoked potentials by means of stereoscopic displays,” in Stereoscopic Displays and Applications Conference (SD&A) (San Francisco, CA: SPIE), 901126.
Carrieri, M., Petracca, A., Lancia, S., Basso Moro, S., Brigadoi, S., Spezialetti, M., et al. (2016). Prefrontal cortex activation upon a demanding virtual hand-controlled task: a new frontier for neuroergonomics. Front. Hum. Neurosci. 10:53. doi: 10.3389/fnhum.2016.00053
Cushman, L. A., Stein, K., and Duffy, C. J. (2008). Detecting navigational deficits in cognitive aging and Alzheimer disease using virtual reality. Neurology 71, 888–895. doi: 10.1212/01.wnl.0000326262.67613.fe
Davis, R., and Ohman, J. (2016). Wayfinding in ageing and Alzheimer's disease within a virtual senior residence: study protocol. J. Adv. Nurs. 72, 1677–1688. doi: 10.1111/jan.12945
de Tommaso, M., Ricci, K., Delussi, M., Montemurno, A., Vecchio, E., Brunetti, A., et al. (2016). Testing a novel method for improving wayfinding by means of a P3b virtual reality visual paradigm in normal aging. Springerplus 5:1297. doi: 10.1186/s40064-016-2978-7
Donati, A. R., Shokur, S., Morya, E., Campos, D. S., Moioli, R. C., Gitti, C. M., et al. (2016). Long-term training with a brain-machine interface-based gait protocol induces partial neurological recovery in paraplegic patients. Sci. Rep. 6:30383. doi: 10.1038/srep30383
Flynn, D., Van Schaik, P., Blackman, T., Femcott, C., Hobbs, B., and Calderon, C. (2003). Developing a virtual reality-based methodology for people with dementia: a feasibility study. CyberPsychol. Behav. 6, 591–611. doi: 10.1089/109493103322725379
Hofmann, M., Rösler, A., Schwarz, W., Müller-Spahn, F., Kräuchi, K., Hock, C., et al. (2003). Interactive computer-training as a therapeutic tool in Alzheimer's disease. Compr. Psychiatry 44, 213–219. doi: 10.1016/S0010-440X(03)00006-3
I Badia, S. B., Morgade, A. G., Samaha, H., and Verschure, P. F. (2013). Using a hybrid brain computer interface and virtual reality system to monitor and promote cortical reorganization through motor activity and motor imagery training. IEEE Trans. Neural Syst. Rehabil. Eng. 21, 174–181. doi: 10.1109/TNSRE.2012.2229295
Innes, K. E., Selfe, T. K., Khalsa, D. S., and Kandati, S. (2016a). Effects of meditation versus music listening on perceived stress, mood, sleep, and quality of life in adults with early memory loss: a pilot randomized controlled trial. J. Alzheimers Dis. 52, 1277–1298. doi: 10.3233/JAD-151106
Innes, K. E., Selfe, T. K., Khalsa, D. S., and Kandati, S. (2016b). A randomized controlled trial of two simple mind-body programs, Kirtan Kriya meditation and music listening, for adults with subjective cognitive decline: feasibility and acceptability. Complement. Ther. Med. 26, 98–107. doi: 10.1016/j.ctim.2016.03.002
Innes, K. E., Selfe, T. K., Khalsa, D. S., and Kandati, S. (2017). Meditation and music improve memory and cognitive function in adults with subjective cognitive decline: a pilot randomized controlled trial. J. Alzheimers Dis. 56, 899–916. doi: 10.3233/JAD-160867
Jessen, F., Amariglio, R. E., Van Boxtel, M., Breteler, M., Ceccaldi, M., Chételat, G., et al. (2014). A conceptual framework for research on subjective cognitive decline in preclinical Alzheimer's disease. Alzheimers Demen. 10, 844–852. doi: 10.1016/j.jalz.2014.01.001
Jiang, C. F., and Li, Y. S. (2007). “Virtual hospital-a computer-aided platform to evaluate the sense of direction,” in 29th Annual International Conference of the IEEE, Engineering in Medicine and Biology Society, EMBS 2007 (Lyon), 2361–2364.
Johnson, D. A., Rose, F. D., Rushton, S., Pentland, B., and Attree, E. A. (1998). Virtual reality: a new prosthesis for brain injury rehabilitation. Scott. Med. J. 43, 81–83. doi: 10.1177/003693309804300307
Kalová, E., Vlcek, K., Jarolímov,á, E., and Bures, J. (2005). Allothetic orientation and sequential ordering of places is impaired in early stages of Alzheimer's disease: corresponding results in real space tests and computer tests. Behav. Brain Res. 159, 175–186. doi: 10.1016/j.bbr.2004.10.016
Keller, G. B., Bonhoeffer, T., and Hübener, M. (2012). Sensorimotor mismatch signals in primary visual cortex of the behaving mouse. Neuron 74, 809–815. doi: 10.1016/j.neuron.2012.03.040
Koo, B., Lee, H.-G., Nam, Y., and Choi, S. (2015). “Immersive BCI with SSVEP in VR head-mounted display,” in 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (Milan), 1103–1106.
Lange, B., Rizzo, A., Astur, R., and Parsons, T. D. (2007). Virtual reality visuospatial and wayfinding assessment for mild dementia of the Alzheimer's type. Alzheim. Dement. 3:S135. doi: 10.1016/j.jalz.2007.04.178
Lechner, A., Ortner, R., and Guger, C. (2014). “Feedback strategies for BCI based stroke rehabilitation: evaluation of different approaches,” in 2nd International Conference on NeuroRehabilitation (ICNR), eds W. Jensen, O. K. Andersen, and M. Akay (Aalborg).
Lee, J. Y., Kho, S., Yoo, H. B., Park, S., Choi, J. S., Kwon, J. S., et al. (2014). Spatial memory impairments in amnestic mild cognitive impairment in a virtual radial arm maze. Neuropsychiatr. Dis. Treat. 10, 653–660. doi: 10.2147/NDT.S58185
Lesk, V. E., Shamsuddin, S. N. W., Walters, E. R., and Ugail, H. (2014). Using a virtual environment to assess cognition in the elderly. Virtual Real. 18, 271–279. doi: 10.1007/s10055-014-0252-2
Lin, C.-T., Lin, H.-Z., Chiu, T.-W., Chao, C.-F., Chen, Y.-C., Liang, S.-F., et al. (2008). “Distraction-related EEG dynamics in virtual reality driving simulation,” in IEEE International Symposium on Circuits and Systems, (2008) ISCAS 2008. (Seattle, WA: IEEE), 1088–1091.
Man, D. W., Chung, J. C., and Lee, G. Y. (2012). Evaluation of a virtual reality-based memory training programme for Hong Kong Chinese older adults with questionable dementia: a pilot study. Int. J. Geriatr. Psychiatry 27, 513–520. doi: 10.1002/gps.2746
Manera, V., Chapoulie, E., Bourgeois, J., Guerchouche, R., David, R., Ondrej, J., et al. (2016). A feasibility study with image-based rendered virtual reality in patients with mild cognitive impairment and dementia. PLoS ONE 11:e0151487. doi: 10.1371/journal.pone.0151487
Manera, V., Petit, P. D., Derreumaux, A., Orvieto, I., Romagnoli, M., Lyttle, G., et al. (2015). “Kitchen and cooking,” a serious game for mild cognitive impairment and Alzheimer's disease: a pilot study. Front. Aging Neurosci. 7:4. doi: 10.3389/fnagi.2015.00024
McEwen, D., Taillon-Hobson, A., Bilodeau, M., Sveistrup, H., and Finestone, H. (2014). Two-week virtual reality training for dementia: single-case feasibility study. J. Rehabil. Res. Dev. 51, 1069–1076. doi: 10.1682/JRRD.2013.10.0231
Mendez, M. F., Joshi, A., and Jimenez, E. (2015). Virtual reality for the assessment of frontotemporal dementia, a feasibility study. Disabil. Rehabil. Assist. Technol. 10, 160–164. doi: 10.3109/17483107.2014.889230
Migo, E. M., O'daly, O., Mitterschiffthaler, M., Antonova, E., Dawson, G. R., Dourish, C. T., et al. (2016). Investigating virtual reality navigation in amnestic mild cognitive impairment using fMRI. Aging Neuropsychol. Cogn. 23, 196–217. doi: 10.1080/13825585.2015.1073218
Montenegro, J. M. F., and Argyriou, V. (2015). “Diagnosis of Alzheimer's disease based on virtual environments,” in 2015 6th International Conference on Information, Intelligence, Systems and Applications (IISA) (Corfu: IEEE), 1–6.
Montenegro, J. M. F., and Argyriou, V. (2017). Cognitive evaluation for the diagnosis of Alzheimer's disease based on turing test and virtual environments. Physiol. Behav. 173, 42–51. doi: 10.1016/j.physbeh.2017.01.034
Morganti, F., Stefanini, S., and Riva, G. (2013). From allo-to egocentric spatial ability in early Alzheimer's disease: a study with virtual reality spatial tasks. Cogn. Neurosci. 4, 171–180. doi: 10.1080/17588928.2013.854762
Nedelska, Z., Andel, R., Lacz,ó, J., Vlcek, K., Horinek, D., Lisy, J., et al. (2012). Spatial navigation impairment is proportional to right hippocampal volume. Proc. Nat. Acad. Sci. U.S.A. 109, 2590–2594. doi: 10.1073/pnas.1121588109
Pengas, G., Williams, G. B., Acosta-Cabronero, J., Ash, T. W., Hong, Y. T., Izquierdo-Garcia, D., et al. (2012). The relationship of topographical memory performance to regional neurodegeneration in Alzheimer's disease. Front. Aging Neurosci. 4, 1–10. doi: 10.3389/fnagi.2012.00017
Plancher, G., Tirard, A., Gyselinck, V., Nicolas, S., and Piolino, P. (2012). Using virtual reality to characterize episodic memory profiles in amnestic mild cognitive impairment and Alzheimer's disease: influence of active and passive encoding. Neuropsychologia 50, 592–602. doi: 10.1016/j.neuropsychologia.2011.12.013
Ravassard, P., Kees, A., Willers, B., Ho, D., Aharoni, D. A., Cushman, J., et al. (2013). Multisensory control of hippocampal spatiotemporal selectivity. Science 340, 1342–1346. doi: 10.1126/science.1232655
Robles-García, V., Corral-Bergantiños, Y., Espinosa, N., García-Sancho, C., Sanmartín, G., Flores, J., et al. (2016). Effects of movement imitation training in Parkinson's disease: a virtual reality pilot study. Parkinsonism Relat. Disord. 26, 17–23. doi: 10.1016/j.parkreldis.2016.02.022
Rohani, D. A., and Puthusserypady, S. (2015). BCI inside a virtual reality classroom: a potential training tool for attention. EPJ Nonlinear Biomed. Phys. 3:12. doi: 10.1140/epjnbp/s40366-015-0027-z
Sauzéon, H., N'kaoua, B., Pala, P. A., Taillade, M., Auriacombe, S., and Guitton, P. (2016). Everyday-like memory for objects in ageing and Alzheimer's disease assessed in a visually complex environment: the role of executive functioning and episodic memory. J. Neuropsychol. 10, 33–58. doi: 10.1111/jnp.12055
Schedlbauer, A. M., Copara, M. S., Watrous, A. J., and Ekstrom, A. D. (2014). Multiple interacting brain areas underlie successful spatiotemporal memory retrieval in humans. Sci. Rep. 4:6431. doi: 10.1038/srep06431
Schindler, A., and Bartels, A. (2013). Parietal cortex codes for egocentric space beyond the field of view. Curr. Biol. 23, 177–182. doi: 10.1016/j.cub.2012.11.060
Seo, K., Kim, J. K., Oh, D. H., Ryu, H., and Choi, H. (2017). Virtual daily living test to screen for mild cognitive impairment using kinematic movement analysis. PLoS ONE 12:e0181883. doi: 10.1371/journal.pone.0181883
Serino, S., Morganti, F., Di Stefano, F., and Riva, G. (2015). Detecting early egocentric and allocentric impairments deficits in Alzheimer's disease: an experimental study with virtual reality. Front. Aging Neurosci. 7:88. doi: 10.3389/fnagi.2015.00088
Serino, S., and Riva, G. (2017). The proactive self in space: how egocentric and allocentric spatial impairments contribute to anosognosia in Alzheimer's Disease. J. Alzheimers Dis. 55, 881–892. doi: 10.3233/JAD-160676
Shamsuddin, S. N. W., Ugail, H., Lesk, V., and Walters, E. (2012). VREAD: a virtual simulation to investigate cognitive function in the elderly, in 2012 International Conference on Cyberworlds (CW) (Darmstadt: IEEE), 215–220.
Shamsuddin, S. W., Lesk, V., and Ugail, H. (2011). Virtual environment design guidelines for elderly people in early detection of dementia. Int. J. Biomed. Biol. Eng. 5, 603–607.
Smart, C. M., Segalowitz, S. J., Mulligan, B. P., Koudys, J., and Gawryluk, J. R. (2016). Mindfulness training for older adults with subjective cognitive decline: results from a pilot randomized controlled trial. J. Alzheimers Dis. 52, 757–774. doi: 10.3233/JAD-150992
Sofroniew, N. J., Vlasov, Y. A., Hires, S. A., Freeman, J., and Svoboda, K. (2015). Neural coding in barrel cortex during whisker-guided locomotion. Elife 4:e12559. doi: 10.7554/eLife.12559
Subramanian, S., and Prasanna, S. (2017). “Virtual reality and non-invasive brain stimulation in stroke: how effective is their combination for upper limb motor improvement?,” in 2017 International Conference on Virtual Rehabilitation (ICVR) (Montreal, QC: IEEE), 1–8.
Sun, Y., Yang, F. C., Lin, C. P., and Han, Y. (2015). Biochemical and neuroimaging studies in subjective cognitive decline: progress and perspectives. CNS Neurosci. Ther. 21, 768–775. doi: 10.1111/cns.12395
Tarnanas, I., Laskaris, N., and Tsolaki, M. (2015a). “On the comparison of a novel serious game and electroencephalography biomarkers for early dementia screening,” in 1st World Congress on Geriatrics and Neurodegenerative Disease Research (GeNeDis), eds P. Vlamos and A. Alexiou (Corfu).
Tarnanas, I., Papagiannopoulos, S., Kazis, D., Wiederhold, M., Widerhold, B., and Tsolaki, M. (2015b). Reliability of a novel serious game using dual-task gait profiles to early characterize aMCI. Front. Aging Neurosci. 7:50. doi: 10.3389/fnagi.2015.00050
Tarnanas, I., Schlee, W., Tsolaki, M., Müri, R., Mosimann, U., and Nef, T. (2013). Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study. JMIR Serious Games 1:e1. doi: 10.2196/games.2778
Tarnanas, I., Tsolaki, M., Nef, T., M Müri, R., and Mosimann, U. P. (2014a). Can a novel computerized cognitive screening test provide additional information for early detection of Alzheimer's disease? Alzheimers Demen. 10, 790–798. doi: 10.1016/j.jalz.2014.01.002
Tarnanas, I., Tsolakis, A., and Tsolaki, M. (2014b). “Assessing virtual reality environments as cognitive stimulation method for patients with MCI,” in Technologies of Inclusive Well-Being (Berlin; Heidelberg: Springer), 38–73, doi: 10.1007/978-3-642-45432-5_4
Teo, W. P., Muthalib, M., Yamin, S., Hendy, A. M., Bramstedt, K., Kotsopoulos, E., et al. (2016). Does a combination of virtual reality, neuromodulation and neuroimaging provide a comprehensive platform for neurorehabilitation?–A narrative review of the literature. Front. Hum. Neurosci. 10:284. doi: 10.3389/fnhum.2016.00284
Tost, D., Von Barnekow, A., Felix, E., Pazzi, S., Puricelli, S., and Bottiroli, S. (2014). “Early detection of cognitive impairments with the smart ageing serious game,” in International Workshop on ICTs for Improving Patients Rehabilitation Research Techniques (Berlin; Heidelberg: Springer), 183–195, doi: 10.1007/978-3-662-48645-0_16
Tsolaki, M., Zygouris, S., Lazarou, I., Kompatsiaris, I., Chatzileontiadis, L., Votis, C., et al. (2015). Our experience with informative and communication technologies (ICT) in dementia. Hell. J. Nucl. Med. 18, 131–139.
Tu, S., Spiers, H. J., Hodges, J. R., Piguet, O., and Hornberger, M. (2017). Egocentric versus allocentric spatial memory in behavioral variant frontotemporal dementia and Alzheimer's disease. J. Alzheimers Dis. 59, 883–892. doi: 10.3233/JAD-160592
Tu, S., Wong, S., Hodges, J. R., Irish, M., Piguet, O., and Hornberger, M. (2015). Lost in spatial translation-A novel tool to objectively assess spatial disorientation in Alzheimer's disease and frontotemporal dementia. Cortex 67, 83–94. doi: 10.1016/j.cortex.2015.03.016
Valladares-Rodriguez, S., Perez-Rodriguez, R., Facal, D., Fernandez-Iglesias, M. J., Anido-Rifon, L., and Mouriño-Garcia, M. (2017). Design process and preliminary psychometric study of a video game to detect cognitive impairment in senior adults. PeerJ 5:e3508. doi: 10.7717/peerj.3508
Vallejo, V., Wyss, P., Rampa, L., Mitache, A. V., Müri, R. M., Mosimann, U. P., et al. (2017). Evaluation of a novel serious game based assessment tool for patients with Alzheimer's disease. PLoS ONE 12:e0175999. doi: 10.1371/journal.pone.0175999
Van Schaik, P., Martyr, A., Blackman, T., and Robinson, J. (2008). Involving persons with dementia in the evaluation of outdoor environments. CyberPsychol. Behav. 11, 415–424. doi: 10.1089/cpb.2007.0105
Vlcek, K., and Laczó, J. (2014). Neural correlates of spatial navigation changes in mild cognitive impairment and Alzheimer's disease. Front. Behav. Neurosci. 8:89. doi: 10.3389/fnbeh.2014.00089
Vourvopoulos, A., and I Badia, S. B. (2016). Motor priming in virtual reality can augment motor-imagery training efficacy in restorative brain-computer interaction: a within-subject analysis. J. Neuroeng. Rehabil. 13:69. doi: 10.1186/s12984-016-0173-2
Weniger, G., Ruhleder, M., Lange, C., Wolf, S., and Irle, E. (2011). Egocentric and allocentric memory as assessed by virtual reality in individuals with amnestic mild cognitive impairment. Neuropsychologia 49, 518–527. doi: 10.1016/j.neuropsychologia.2010.12.031
Werner, P., Rabinowitz, S., Klinger, E., Korczyn, A. D., and Josman, N. (2009). Use of the virtual action planning supermarket for the diagnosis of mild cognitive impairment. Dement. Geriatr. Cogn. Disord. 27, 301–309. doi: 10.1159/000204915
White, P. J., and Moussavi, Z. (2016). Neurocognitive treatment for a patient with Alzheimer's disease using a virtual reality navigational environment. J. Exp. Neurosci. 10, 129–135. doi: 10.4137/JEN.S40827
Widmann, C. N., Beinhoff, U., and Riepe, M. W. (2012). Everyday memory deficits in very mild Alzheimer's disease. Neurobiol. Aging 33, 297–303. doi: 10.1016/j.neurobiolaging.2010.03.012
Yamaguchi, T., Foloppe, D. A., Richard, P., Richard, E., and Allain, P. (2012). A dual-modal virtual reality kitchen for (re) learning of everyday cooking activities in alzheimer's disease. Pres. Teleoper. Virt. Environ. 21, 43–57. doi: 10.1162/PRES_a_00080
Yang, Y. J. D., Allen, T., Abdullahi, S. M., Pelphrey, K. A., Volkmar, F. R., and Chapman, S. B. (2017). Brain responses to biological motion predict treatment outcome in young adults with autism receiving virtual reality social cognition training: preliminary findings. Behav. Res. Ther. 93, 55–66. doi: 10.1016/j.brat.2017.03.014
Yeh, S.-C., Chen, Y.-C., Tsai, C.-F., and Rizzo, A. (2012). “An innovative virtual reality system for mild cognitive impairment: diagnosis and evaluation,” in 2012 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES) (Langkawi: IEEE), 23–27.
Zakzanis, K. K., Quintin, G., Graham, S. J., and Mraz, R. (2009). Age and dementia related differences in spatial navigation within an immersive virtual environment. Med. Sci. Monit. 15, CR140–CR150.
Zhou, Y., Tan, C., Wen, D., Sun, H., Han, W., and Xu, Y. (2016). The biomarkers for identifying preclinical Alzheimer's Disease via structural and functional magnetic resonance imaging. Front. Aging Neurosci. 8:92. doi: 10.3389/fnagi.2016.00092
Zygouris, S., Ntovas, K., Giakoumis, D., Votis, K., Doumpoulakis, S., Segkouli, S., et al. (2017). A preliminary study on the feasibility of using a virtual reality cognitive training application for remote detection of mild cognitive impairment. J. Alzheimers Dis. 56, 619–627. doi: 10.3233/JAD-160518
Keywords: evaluation, rehabilitation, patients with different cognitive impairment phases, virtual reality, EEG
Citation: Wen D, Lan X, Zhou Y, Li G, Hsu S-H and Jung T-P (2018) The Study of Evaluation and Rehabilitation of Patients With Different Cognitive Impairment Phases Based on Virtual Reality and EEG. Front. Aging Neurosci. 10:88. doi: 10.3389/fnagi.2018.00088
Received: 25 January 2018; Accepted: 15 March 2018;
Published: 03 April 2018.
Edited by:
Yu-Guo Yu, Fudan University, ChinaReviewed by:
Yunfa Fu, Kunming University of Science and Technology, ChinaJiahong Sun, Sun Yat-sen University, China
Copyright © 2018 Wen, Lan, Zhou, Li, Hsu and Jung. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Dong Wen, xjwd@ysu.edu.cn
Tzyy-Ping Jung, jungtp2013@gmail.com