Does a Combination of Virtual Reality, Neuromodulation and Neuroimaging Provide a Comprehensive Platform for Neurorehabilitation? – A Narrative Review of the Literature

In the last decade, virtual reality (VR) training has been used extensively in video games and military training to provide a sense of realism and environmental interaction to its users. More recently, VR training has been explored as a possible adjunct therapy for people with motor and mental health dysfunctions. The concept underlying VR therapy as a treatment for motor and cognitive dysfunction is to improve neuroplasticity of the brain by engaging users in multisensory training. In this review, we discuss the theoretical framework underlying the use of VR as a therapeutic intervention for neurorehabilitation and provide evidence for its use in treating motor and mental disorders such as cerebral palsy, Parkinson’s disease, stroke, schizophrenia, anxiety disorders, and other related clinical areas. While this review provides some insights into the efficacy of VR in clinical rehabilitation and its complimentary use with neuroimaging (e.g., fNIRS and EEG) and neuromodulation (e.g., tDCS and rTMS), more research is needed to understand how different clinical conditions are affected by VR therapies (e.g., stimulus presentation, interactivity, control and types of VR). Future studies should consider large, longitudinal randomized controlled trials to determine the true potential of VR therapies in various clinical populations.

Introduction

In the last two decades, the application of VR training has become increasingly popular, not only as a means to enhance gaming experiences, but also in the education and healthcare settings to improve learning and rehabilitation outcomes. Particularly in the area of neurorehabilitation, the use of VR technology has shown great promise by providing a sense of realism during training, thereby promoting skill acquisition and retention, and inducing functional recovery (Figure 1; for review, see Adamovich et al., 2009).

FIGURE 1

FIGURE 1. A VR environment induces multisensory feedback that contributes toward greater memory consolidation and retention.

In the context of neurorehabilitation, VR therapy can be described as a method of brain–computer interaction that involves real-time simulation of an environment, scenario or activity that allows for user interaction and targets multiple senses. In particular, the combination of VR and recent technological advances in robotic and haptic interfaces allow users a seemingly life-like interactional experience in a VE (Jung et al., 2012; Yeh et al., 2014). For example, VR has been used in clinical settings as a training tool for surgeons to learn intricate fine motor skills associated with precision surgery (Wang, 2012; Fang et al., 2014), and as a tool to deliver cognitive-based therapies (Kim et al., 2011; Kandalaft et al., 2013). More complex forms of VR presentation such as augmented VR (whereby VR is superimposed on the actual environment) and immersive VR (first-person interaction in a VR environment) brings the immersive experience to another level with technology such as head-mounted displays (i.e., Oculus^® Rift and Microsoft^® Hololens) or screens. It is through this naturalistic environment, and allowing for interactive behaviors while being monitored and recorded, that is the primary advantage of implementing VR technology. This means that VR technology can be used to deliver meaningful and relevant stimulation to an individual’s nervous system and thereby capitalize on neuroplasticity to promote both cognitive and motor rehabilitation.

In this review, we will discuss the theoretical framework for the use of VR in the context of neurorehabilitation. We will provide evidence for the use of VR in motor rehabilitation for neurological disorders such as PD, CP and stroke and in mood and mental health disorders such as anxiety, PTSD and schizophrenia. We will also review the concurrent use of non-invasive brain stimulation and neuroimaging techniques during VR, discussing how these combined techniques may augment the benefits and complement current VR training protocols.

Theoretical Framework For VR and Learning

Experiential Learning

The most important aspect of using VR is to provide new experiences by allowing users to interact physically and emotionally within a VE that is almost identical to the real world. The combination of physical, mental and emotional interaction encourages active participation and involvement of the user. In this sense, users of VR assimilate knowledge more effectively when they have the freedom to engage in self-directed activities within their learning context. By finding solutions and learning new skills autonomously, users of VR invest mental effort by constructing conceptual models that are both consistent with what they already understand and with the new content that is presented (Garrison and Garrison, 1997). Another key feature of VR training is that it offers users the opportunity to acquire skills in the context where they need to be applied. This results in more meaningful and effective learning, as compared with learning out of context (Nieuwenhuijsen et al., 2006). In physical rehabilitation for example, rehabilitation of fine motor control of the hands and wrists can be “re-trained” by simulating a VE where a stroke patient needs to pour him or herself a glass of water in the kitchen. In this way, patients practice and refine fine motor control of muscles controlling the hands and wrists through manipulating a virtual object that allows the same kind of natural interaction with objects that patients would engage in the real world.

Augmented Feedback: Knowledge of Results and Performance

Another important aspect of VR therapy is the ability to provide augmented feedback to its users. Augmented feedback is additional information provided through any means (e.g., visual, auditory or kinesthetic) that is complimentary to the inherent feedback received via the sensory systems. There is no hard and fast rule as to how or what kinds of information augmented feedback should provide, however, VR therapy offers two vital pieces of information that is essential for learning (Winstein, 1991; Lauber and Keller, 2014); (1) knowledge of performance – information on how the participant performs during movement (i.e., movement sequences, joint angles, force outputs at each phase of movement etc.); (2) knowledge of results – information on the outcome of the performance (i.e., overall quality and quantity of movement). Currently, most commercially available VR games would incorporate visual, auditory and even kinesthetic feedback that can be provided either during or after the game. Very often, these VR games are designed in a manner that users have to maintain or achieve a pre-determined score or level in order for the game to progress. For example, VR applications can provide knowledge of performance throughout gameplay in the form of movement kinematics (i.e., joint angles, velocity, and speed), kinetics (i.e., ground reaction forces and torque) or even the level of activation in specific brain regions during a particular task. In order for users to progress to the next level, users must maintain or exceed a threshold that has been set based on previous trials or specific performance outcomes. Upon task completion, knowledge of results and performance can be provided, allowing both clinicians and users to understand deficiencies in movement patterns that are associated with specific dysfunctional movement outcomes, apply progressions appropriately, and address those deficiencies with a targeted rehabilitation approach.

Observational Learning

Apart from providing feedback that is necessary for learning, another aspect of VR training is the enhancement of observational learning. The basis for learning, or at least its intended outcome, is to mimic or replicate an ideal response that brings about a desired result and induce a lasting change in behavior. In terms of neurorehabilitation, observation of goal-oriented movements or processes provides sensory feedback about the movement, behavior or emotional state, which contributes to learning (Oouchida et al., 2013; Williams and Carnahan, 2014). These observations preferentially activate parts of the brain that are involved with the physical performance itself allowing a motor program to be developed based upon the observed movements (Burke et al., 2010). Training in a VE may facilitate observational learning in four different ways; (1) VR applications can provide an accurate visual representation of the user’s body and limb position using motion capture technology; (2) VR applications commonly use an avatar to mimic the movement of users, or conversely, the user could mimic the movements of the avatar; (3) accurate guides or a correct movement pattern can be produced for which users can follow; (4) VR applications can facilitate mental imagery by inducing optimal mood states and instructions for mental imagery.

Motivation

Importantly, the goal-oriented nature of VR tasks may support the maintenance and adherence of neurorehabilitation programs. Unlike traditional therapist-led sessions, where improvements in physical or cognitive function may be subjective or difficult for patients to identify (Van den Broek, 2005), VR programs can provide an objective, quantitative measure of session outcomes and objectives. Furthermore, VR applications can provide both users and clinicians the ability to individualize training programs or alter the progression of a training session based upon the user’s personal performance. The capacity to individualize therapy intensity may enhance motivation by allowing users to select practice sessions that are catered to their individual time and need, and more importantly, to manipulate treatment parameters to create optimal learning conditions. Another important consideration for VR to improve motivation is by incorporating competition or co-operation between other players during therapy sessions. Engaging users in a group environment either competing against each other or working in teams promotes an element of enjoyment through increased social interaction, particularly amongst people suffering with similar conditions (Van den Broek, 2005).

Evidence of VR Therapy in Movement Neurorehabilitation

Stroke

The use of motion-controlled VR game consoles, including the Nintendo^® Wii and Xbox^® Kinect, have been explored as adjuncts to conventional physical therapy (see Table 1), specifically for improving upper limb function (Thomson et al., 2014; Laver et al., 2015). VR programs for stroke neurorehabilitation are based on the potential for brain neuroplasticity after neurological injury to support acquisition and retention of new motor skills to recover motor function. The goal of VR therapy in stroke is to apply these motor learning principles for stroke neurorehabilitation, such as providing repetitive, graded intensity, and motivating task-specific training with real time multimodal feedback of movements and performance (Saposnik et al., 2011). Thus, VR systems are designed to enhance conventional therapy by providing a tool to deliver more specific, intensive and enjoyable therapy with real time feedback of performance (Levin et al., 2015).

TABLE 1

TABLE 1. Examples of recent systematic reviews and meta-analyses demonstrating the effects of VR in neurorehabilitation of stroke, PD and CP.

Despite the potential utility of commercial VR game consoles for stroke neurorehabilitation, a number of limitations have been highlighted (Bower et al., 2015): (1) VR games designed for the general population can be too challenging for stroke patients with physical and cognitive deficits; (2) the difficulty levels and control of VR games are often not readily adjustable to rehabilitation targets, and the tasks may lack functional relevance; (3) feedback and scoring provided can be negative and frustrating for the user; (4) current VR games do not include neurological assessment; (5) VR does not integrate multiple environmental factors that connect to motor performance. In response to some of these limitations, there has been an emergence of research and development of modified VR programs specifically designed for stroke neurorehabilitation using adaptable software and hardware components of commercial VR systems (e.g., Kinect system) and guidance from clinicians in their development (Laffont et al., 2014; Bower et al., 2015). These adapted VR systems are progressively optimized with new functions including: (1) allowing automatic adaptation/intensity grading of the activity to the patient’s own achievements; (2) allowing the therapist to adapt online the task’s characteristics to the patient’s needs; (3) allowing multiplayer VR systems via a web-service platform to enhance interactivity; (4) automatic recording of the patient’s movements to provide therapists with data describing the quality and quantity of motor function recovery/progression, including the level of compensatory movements (Laffont et al., 2014).

While there is some evidence to suggest that VR may be highly applicable for stroke rehabilitation, the evidence from recent systematic reviews and meta-analyses indicate that current studies are limited by sample size issues and study designs (see Table 1). Early VR interventions used commercial applications such as the Nintendo Wii that controls an avatar, however, more recently customized systems have focused on interactive platforms to target activities of everyday living (i.e., reaching and grasping tasks). However, a major challenge with stroke is that no one stroke patient will present with the same motor deficit and therefore an individualized approach to therapy, including VR therapy, is needed. In this sense, future systems must be adaptive and customizable to manage the heterogenous nature of stroke for patients to gain greater benefits.

Parkinson’s Disease

Emerging VR therapies presents as an attractive option for delivering neurorehabilitation therapies to manage the cognitive-motor symptoms in people with PD, as it can be employed at any stage as an adjunct to standard pharmacological (Levodopa therapy) and/or surgical (ablation, deep brain stimulation) treatment (see Table 1). This new possibility in the field of neurorehabilitation aims to provide PD patients with a motivating way to perform multiple motor neurorehabilitation exercises with the rationale that the VR system might promote balance training, and cognitive-motor practice. Some commercial VR systems, such as the Nintendo^® Wii system using a balance board, has drawn considerable attention from both the research and clinical communities as effective and feasible neurorehabilitation interventions to enhance gait and balance for people with PD (Barry et al., 2014; Harris et al., 2015). More recent studies have implemented custom programming and hardware to their VR systems to specifically improve balance and gait in PD (Mirelman et al., 2011).

It has been demonstrated that a VR neurorehabilitation program of 6–8 weeks involving 40–60 min a day, three times per week appears to be a viable option for significantly improving balance in a clinical population of individuals with PD (Esculier et al., 2012). The intensity/difficulty load of interventions used across existing studies appears a key contributing factor for the discordant findings reported in the literature (Esculier et al., 2012). In addition, activity selection could have contributed to some differential findings among studies. Some studies targeted static slow controlled movements in a closed environment such as the Wii Fit with balance board (dos Santos Mendes et al., 2012; Esculier et al., 2012), while others involve dynamic movements in an open environment such as Wii Sports (Herz et al., 2013).

Despite some evidence for performance improvement in balance, there are still limitations inherent in commercial VR systems that may not directly apply to realistic everyday settings for PD neurorehabilitation. Additionally, the programs are not very scalable, or modifiable, to each individual’s needs or progress for all stages of disease. Mirelman et al. (2011, 2013) utilized a custom-made VR system to incorporate virtual obstacles presented on a screen during treadmill walking (18 sessions over 6 weeks). During the gait training they used a novel method (V-TIME) for tracking foot position based on the X-box Kinect technology. Interestingly, Mirelman et al. (2011) observed significant elevated gait speed with and without a cognitive dual-task upon completion of training and 4 weeks post-training. However, this VR gait training protocol confines participants to straight-walking, a gait pattern that is relatively uncommon in real-life environments. Perhaps a more viable approach may be the development of a VR system that may be used in conjunction with activities of daily living. People with PD are known to use visual and/or auditory cues to improve physical performance (Lee et al., 2012), and perhaps the use of augmented VR, via goggles or smart glasses, may be used to provide sensory cues as a feedforward or feedback mechanism to improve physical performance.

Cerebral Palsy

Cerebral Palsy (CP) is the most common pediatric physical disability, thought to affect three to four individuals per 1000 of the population (Aisen et al., 2011; Oskoui et al., 2013) characterized as a spectrum of disorders of motor and postural development that cause limited functionality or dysfunction (Monge Pereira et al., 2015). Studies investigating exercise-based treatments for children with CP has provided growing evidence in the last decades for effectiveness in improving postural control (see Table 1). Although effective, traditional physical exercise in the clinical settings consists of repetitive tasks that limits the enthusiasm over regular periodic application.

While the study of VR in children with CP is still at its infancy, Denise Reid at the University of Toronto’s Virtual Reality Laboratory (Reid, 2002a,b, 2004) has provided preliminary evidence to support its use. In these studies, children with CP were engaged with VR based exercises for upper extremity and postural control. The self-reported effect of VR on perceived self-efficacy to perform given tasks was tested in an uncontrolled study, before and after intervention (Reid, 2002a). Based on the self-efficacy theory, Reid (2002b) attempted to identify if use of VR could increase the motivation for exercise in children with CP. The pilot study yielded encouraging results for VR use with improvement in perceived performance abilities and satisfaction with performance. In a follow up study on upper-extremity efficiency, improvement was also reported with VR use (Reid, 2002b). Similarly, Reid (2004) later investigated the effect of VR intervention on playfulness and found that VR environments stimulated playfulness in children, specifically the VR tasks that allowed creativity, expression, and choice of activity. You et al. (2005) used fMRI in a case report to investigate cortical reorganization and associated motor function improvement after a VR therapy. Neuroplastic changes were observed in the primary sensorimotor cortex and supplementary motor area following VR therapy, together with enhanced functional motor skills. A later study by Bryanton et al. (2006) compared the VR therapy with conventional exercises in children and found that although children completed more repetitions of the conventional exercises, the range of motion and hold time in stretched position was greater during VR tasks.

While the current research for VR in children is still in the early stages, VR therapies represent a viable option to increase exercise adherence and physical activity as they are both engaging and rewarding particularly in an adolescent population. The process of gamification, one that entails an interactive dynamic storyline and an overall goal, is likely to better capture and retain the attention of children over traditional physical training (Lister et al., 2014). The challenge, particularly in children with CP, will be to incorporate a diversity of activities performed during the game to train a repertoire of fundamental skills so as to further develop their motor and cognitive skills.

Evidence For VR Therapy in Cognitive Rehabilitation and Mental Health

Anxiety, Phobias and Post-traumatic Stress Disorder

Anxiety can be generalized in nature [i.e., generalized anxiety disorder (GAD)], characterized by long-lasting anxiety that is not focused on a specific object, or may be more focal (i.e., phobias) occurring in the presence of, or in anticipation of, a specific object or situation. Preliminary evidence on the use of VR in GAD indicate that a combination of relaxation, controlled exposure and stress inoculation may help patients to cope with various stressors and sources of worry (Gorini et al., 2010; Repetto and Riva, 2011). Additionally, the combination of biofeedback (e.g., heart rate and electro-dermal skin response) may potentially help to identify particular sources of worry and emotion that can be used to modify specific features of the VR environment (Gorini et al., 2010; Repetto and Riva, 2011).

Despite the limited evidence for the use of VR therapy in GAD, there is some support for the use of VR in a range of other anxiety disorders (see Table 2) including specific phobias (Cote and Bouchard, 2005; Maskey et al., 2014), panic disorder (Vincelli et al., 2002) and social phobia (Klinger et al., 2004, 2005). Current VR therapies, particularly for phobias, use controlled exposure therapy that allows the patient to experience a sense of presence in an immersive, interactive VE that minimizes avoidance behavior and facilitates emotional involvement. This VE also allows controlled delivery of sensory stimulation via the therapist, for which the patient confronts the feared stimuli in a progressive manner. Another advantage of VR therapy is being able to recreate situations that cannot be re-experienced in vivo (i.e., combat situation or terrorist attack). VR therapy may be used as an alternative to imaginal exposure, meaning that patients with PTSD need not rely on internal imagery to visualize an event. A potential limitation in imaginal exposure therapy is that the therapist has no control over, or even knowledge of, what imagery the patient actually evokes (Strosahl and Ascough, 1981). Whereas in the VE, the stimuli presented can be carefully controlled and monitored. As with phobic patients, VR-based exposure therapy may be particularly useful for patients with PTSD for whom avoidance and failure to engage with therapy may hinder the therapeutic process. The efficacy of VR therapy for the treatment of PTSD has predominantly been examined in military populations (Cukor et al., 2009; Goncalves et al., 2012). A systematic review found that VR therapy was just as efficacious as traditional exposure treatment for PTSD (Goncalves et al., 2012). Seven of the 10 studies included in Goncalves’s review found that VR environments significantly reduced PTSD symptoms in comparison to control, however, no significant differences in symptoms were observed between VR therapy and traditional exposure treatment.

TABLE 2

TABLE 2. Examples of systematic reviews and meta-analyses demonstrated the use of VR in treating PTSD and anxiety disorders.

Whilst the existing literature on the use of VR therapy for phobias, panic disorder, and PTSD were promising, several limitations must be considered (Powers and Emmelkamp, 2008; Meyerbroker and Emmelkamp, 2010; Opris et al., 2012). Meyerbroker and Emmelkamp (2010) noted that VR as a therapeutic tool is difficult to assess as it is often combined with other techniques. This potentially masks any underlying benefits of VR therapy on the patient. Furthermore, most studies do not include behavioral avoidance tasks, which would help to determine how transferable the results are to the real world.

Schizophrenia

As an assessment tool, VR offers the possibility of creating unique environments allowing researchers to better identify and understand specific areas of the brain commonly effected in schizophrenia. It is proposed that binding errors during the memory encoding process are responsible for the episodic memory impairments reported in schizophrenia (Waters et al., 2004). In this sense, VR is able to tease out areas of the brain responsible for binding impairments by providing specific situations or tasks for which patients have to perform. For example, a study by Ledoux et al. (2013) examined contextual binding in schizophrenia using fMRI during a navigation task in a virtual town (i.e., find the grocery store from the school). Their results showed significantly less activation among patients relative to controls in the left middle frontal gyrus, and right and left hippocampi. Ledoux et al. (2013) further suggested that the reduced activation was indicative of context and content not being appropriately linked, therefore affecting the formation of a cognitive map representation in the patient group and eliciting a contextual binding deficit.

As a rehabilitation tool, VR offers a unique potential to expose individuals to controlled rehabilitation environments and allow for interaction within a VE. Indeed, VEs may be perceived as less intimidating for patients as it allows for more gradual increase in task difficulty and may therefore enhance participation with rehabilitation (Rizzo et al., 1998). In particular, VR therapy has been explored as an alternative option to improve cognitive function (Marques et al., 2008) and vocational skills (Tsang and Man, 2013) in schizophrenic patients with some success. However, perhaps one of the most important roles of VR therapy may be to attenuate the deficit in social skills associated with schizophrenia. Traditionally, social skills training using role-play has been effective in remediating these deficits (Benton and Schroeder, 1990), however, role-playing of social skills training are limited in that they require appropriately matched groups, and may produce social anxiety, negative symptoms and poor insight. VR-based techniques offer an alternative to traditional role playing techniques by providing a computer-generated but realistic three-dimensional world and human-like avatars that can provide emotional stimuli. These VR-based techniques may be highly beneficial to re-train conversational skills (i.e., beginning a conversation, breaking silences, and differentiating facial expressions; Ku et al., 2007; Park et al., 2011).

While there is great potential for the role of VR in the treatment of schizophrenia, the evidence for its use remains contentious. Questions still remain if the effects of VR directly affects the condition itself, or perhaps the effects of VR may attenuate other psychiatric comorbidities such as anxiety or depression that may trigger visual or auditory hallucinations in sufferers of schizophrenia. As these are still early days for VR therapy in general, there is a need to determine the precise role of VR in treatment therapies for schizophrenia and its limitations.

Future Outlook to the Most Promising Research Avenues - Complementing VR Therapy Using Non-Invasive Neuromodulation and Neuroimaging Technologies

This review so far has provided evidence for the use of VR therapy in various clinical populations as a standalone or adjunctive tool with mainstream neurorehabilitation treatment modalities. However, the question remains as to whether the beneficial effects of VR can be augmented via neuromodulation techniques such as tDCS, or if it is possible for a more targeted approach to monitor the effects of VR via non-invasive and portable neuroimaging methods such as fNIRS and EEG.

Augmenting VR Therapy with tDCS

Transcranial direct current stimulation is an emerging non-invasive brain stimulation technique that uses low-intensity constant direct electrical currents to modulate the excitability of cortical neurons and related networks (Nitsche and Paulus, 2000; Lang et al., 2005). By placing either a positive anode or negative cathode electrode over the scalp of the head, tDCS is able to facilitate (anodal tDCS) or inhibit (cathodal tDCS) excitability of the underlying cortical neurons in a polarity-specific manner. Due to this robust neuromodulatory effect, tDCS has often been used in conjunction either before (offline) or during (online) rehabilitation therapy to improve motor and cognitive performance in healthy and clinical populations (for a recent reviews, see Coffman et al., 2014 and Floel, 2014).

In theory, the application of tDCS with VR therapy to augment neurorehabilitation appear complimentary. A study by Lee and Chun (2014) showed an improvement in stroke-specific clinical measures, manual muscle test and the Korean-modified Barthel Index in subacute stroke patients after 15 sessions of VR therapy with online cathodal tDCS to the unaffected motor cortex compared to sham. Kim et al. (2014) further demonstrated that the addition of online anodal tDCS to the affected motor cortex with VR therapy not only improved upper arm function, but also increased corticospinal excitability in subacute stroke patients.

In contrast to the aforementioned findings, mixed results were reported by Viana et al. (2014) that compared the effects of combining VR with offline anodal tDCS over the affected motor cortex of stroke patients, across 15 1-h VR therapy sessions. While the results showed no statistical differences in stroke-specific clinical measures (i.e., Fugl-Meyer assessment, Wolf motor assessment, and modified Ashworth scale) of upper arm function between patients receiving real tDCS compared to sham, it is important to note that more than 50% of participants receiving anodal tDCS and VR therapy had clinically significant improvements in wrist spasticity following treatment. Based on these limited combined VR and tDCS findings, it can be seen that performing tDCS during the VR therapy is a significant factor for enhancing the effects of VR therapy alone, which is also the case for combining tDCS with neurorehabilitation (Rothwell, 2012). Although combined VR and neuromodulation (tDCS) has been primarily applied in movement disorders, to the best of our knowledge, there are currently no known studies that have investigated this combination in cognitive and mood disorders. Thus therapists that are currently adopting the use of VR therapy in mental and mood disorders can potentially exploit the concurrent use of both VR and tDCS to augment therapy benefits above and beyond VR therapy alone.

It is likely that the combined effects of VR and tDCS is influenced by a combination of several factors, namely (1) general patient characteristics (e.g., brain region affected, and structural/functional reserve) and (2) tDCS parameters including electrode placement (affected or unaffected brain region), polarity (anodal or cathodal) and timing of tDCS application (online or offline). In such circumstances, where the efficacy of combined VR and tDCS interventions are both timing and location dependent (i.e., when and where to stimulate), a method of detecting and monitoring changes to neurophysiological function as patients receive treatment is crucial for optimizing intervention effects. In this regard, neuroimaging methods could be applied to monitor treatment VR progression, which will be discussed in the subsequent section.

Monitoring VR Therapy with Neuroimaging

Neurophysiological changes associated with VR neurorehabilitation can be measured by non-invasive and portable neuroimaging techniques including fNIRS and/or EEG, to ascertain changes in cerebral hemodynamic responses or oscillatory brainwaves, respectively. In particular, the use of fNIRS as a tool to measure online cerebral hemodynamic responses during neurorehabilitation has received attention (for review see Irani et al., 2007; Ferrari and Quaresima, 2012). The use of fNIRS as a neuroimaging method relies on the principle of neurovascular coupling that measures the increase in regional cerebral blood flow (i.e., increase in oxygenated and decrease in deoxygenated hemoglobin) induced by neuronal activation, which is analogous to the blood-oxygenation-level-dependent responses measured by fMRI (Ferrari et al., 2004). Cortical activation measurements by fMRI and fNIRS techniques show highly correlated results in both motor and cognitive tasks (Huppert et al., 2006; Cui et al., 2011; Muthalib et al., 2013). While the application of fNIRS techniques is gaining popularity, EEG has long been used to measure online brain activity during a cognitive or motor task, and in various clinical populations (Bonanni et al., 2008; Gosselin et al., 2011). Of particular importance, EEG is used to detect changes in various brainwaves (i.e., Gamma, Alpha, Beta, Theta, and Delta) which are differentially affected by changes in mood (Huang and Lo, 2009), wakefulness (De Gennaro et al., 2001), neurological diseases (Bonanni et al., 2008), and brain injury (Gosselin et al., 2011). Both fNIRS and EEG have several advantages over fMRI, as they are portable, relatively inexpensive to use, and easy to operate with high temporal resolution. Furthermore, new generation systems are battery operated, wireless and further miniaturized to the size of a smartphone, ideal for ambulatory and untethered measurements consistent with a neuroergonomics approach (Ayaz et al., 2013; de Lissa et al., 2015).

As the use of fNIRS and EEG techniques in VR therapy is still relatively new, most studies to date have focused on healthy individuals (Bayliss and Ballard, 2000; Mingyu et al., 2005; Holper et al., 2010; Seraglia et al., 2011; Basso Moro et al., 2014), with the potential for more studies in clinical populations emerging as the popularity of these portable neuroimaging technologies increases. The current use of fNIRS and EEG in VR therapy has two proposed roles; (1) to monitor and provide augmented feedback regarding regions of cortical activation during therapy and (2) to use fNIRS or EEG as part of a BCI paradigm for therapy. In support of the first role, several studies have investigated the efficacy of fNIRS and EEG to record cortical hemodynamic and oscillatory changes during actual motor tasks and motor imagery in a VR environment. These studies demonstrated the efficacy of fNIRS and EEG to detect task-specific changes in cortical hemodynamics (Holper et al., 2010; Seraglia et al., 2011; Basso Moro et al., 2014) and oscillatory patterns (Bayliss and Ballard, 2000; Mingyu et al., 2005).

The ability of fNIRS and EEG to detect changes in these neurophysiological measures can provide both feedback on location and level of activation, for which clinicians and users can use to set intensity and progression of therapy. Furthermore, feedback on cortical activation can also be used to identify areas of hypo- or hyperactivity, which can be modulated using neuromodulatory techniques such as tDCS (see Prospective Integration of Neuromodulation-Neuroimaging with VR Therapy). In support of the second role, identifying cortical areas of activation, patterns and timing of cortical activation associated with various movements or mood states may also be recorded as classifiers for BCI training. Indeed, most BCI studies to date have employed the use of EEG as a measure for cortical activation for which to control a robotic limb or avatar in a VR environment (Lin et al., 2007; Formaggio et al., 2013, 2015). Although relatively new, there are also fNIRS-based BCI approaches demonstrating feasibility for future integration with VR and neurorehabilitation (Sitaram et al., 2007; Hong et al., 2015). Moreover, joint use of fNIRS- and EEG-based BCI approaches have also been demonstrated (Koo et al., 2015; Xuxian et al., 2015). This shows the potential to adopt fNIRS in a similar manner, whereby appropriate cortical hemodynamic responses can be classified to control a robotic or computer interface.

Prospective Integration of Neuromodulation-Neuroimaging with VR Therapy

In the last 5 years, new research suggests that the combination of VR therapy with neuromodulation and neuroimaging techniques may help to improve the effects and delivery of VR therapies. Neuromodulation techniques such as tDCS (Figure 2) and neuroimaging methods such as fNIRS (Figure 3) and EEG have already been combined and have shown some success (Ang et al., 2015; Dutta et al., 2015; Muthalib et al., 2016). While the use of these techniques in combination with VR is still in its infancy, the available evidence suggests highly complementary effects when combining neuromodulation and neuroimaging with VR therapy.

FIGURE 2

FIGURE 2. Stroke participants engaged in VR therapy using an X-Box Kinect motion capture system while receiving tDCS.

FIGURE 3

FIGURE 3. The use of a semi-immersive VR environment and fNIRS system.

As both neuroimaging (fNIRS/EEG) and neuromodulation (tDCS) techniques have complimentary capabilities, and they both can be built as wearable and wireless systems, integration of the two presents as a natural avenue for applications in natural environments and real world settings (McKendrick et al., 2015). One potential use is enhancing BCI applications. In its most general form, BCI provides a route for neural output that does not involve the neuromuscular system (Wolpaw et al., 2002). Almost all current non-invasive BCI systems are read-only, that is, brain signals are read directly to the system (via neuroimaging) and the system can provide an output or feedback that relies on sensory input mechanisms and peripheral nervous system to reach back to the brain. A more direct BCI could eliminate the need for sensory input with the use of neuromodulation, and hence provide feedback directly to the brain for a read-write BCI.

Integration of VR therapy for such a read/write BCI hold potential for enhanced or accelerated therapeutical processes in neurorehabilitation. A study by Ang et al. (2015) was one of the first studies that combined VR with both tDCS and EEG to investigate the additive effect of offline anodal tDCS on BCI haptic training with chronic stroke patients. Although this study reported no difference in the Fugl-Meyer assessment and block-and-box test between groups that received real tDCS prior to BCI training, compared to sham, the study did demonstrate an increased state of EEG mu rhythm suppression in the real tDCS group. Thus indicating improved neurophysiological responses in motor preparation. Future studies are necessary to determine the significance of these neurophysiological improvements to clinical outcomes.

Neuroimaging guided tDCS and VR therapy can be applied to neurorehabilitation in general. The optimal location for applying tDCS electrodes to modulate a target cortical region and connected networks is a debated point in the field. Modeling studies of current flow between the tDCS electrodes have provided some guidance to the placement of electrodes to stimulate a specific brain region; however, whether these models predict the actual current flow and polarization of the targeted brain networks is not known. Simultaneous tDCS-neuroimaging could provide a solution to confirming the modeling predictions and/or to guide the direction of current flow between multi-electrode tDCS montages (Ruffini et al., 2014). For example, a motor task could be used to activate a broad network of cortical regions of interest that can be measured using fNIRS/EEG neuroimaging. Once the locations of the tDCS electrodes have been determined using neuroimaging guidance, neuroimaging and tDCS could be simultaneously or independently used to guide and modulate VR therapy. In this scenario, neuroimaging during VR tasks can be used to adapt the intensity based on the level of activation, such as the attentional hub of the dorsolateral prefrontal cortex (DLPFC). The level of DLPFC activation during the initial task would be expected to be high due to the novelty of the activity, however, as the activity progresses the learning of task requirements become automatic and performance improves, less attentional resources would be required, and the level of DLPFC would be expected to decrease (Ayaz et al., 2012; McKendrick et al., 2014). In such a scenario, the VR task can be adapted online to modulate the intensity level and maintain optimal DLPFC activation. Also, if the levels of DLPFC activation remain at high levels and/or performance is stagnant, then tDCS could potentially be applied online to upregulate neuronal networks required to perform the task. Preliminary evidence using a modeling approach to locate tDCS electrodes was provided by McKendrick et al. (2015) using a spatial memory task with concurrent fNIRS and tDCS. They showed that when task performance declined rapidly following baseline, the application of tDCS almost immediately eliminated the performance decrement. Furthermore, they showed that tDCS can modulate the neural activity of specific brain regions near the site of stimulation. However, they cautioned that current models and protocols for determining tDCS montages are lacking, due to complex interactions between stimulation montage, task performance and underlying hemodynamics that are not fully understood. Therefore, additional joint tDCS and fNIRS/EEG studies are required to further unravel these complexities and to better define the pattern of cortical excitation induced by tDCS during the performance of cognitive and motor tasks.

Current Limitations of VR Therapy

While using a VE offers many unique advantages to traditional treatment and neurorehabilitation approaches, limitations to their efficacy and practicality must be acknowledged. Firstly, larger clinical studies are required to establish the efficacy of using VR in physical and cognitive rehabilitation in different clinical populations. Much of the existing literature report mixed findings from small sample sizes, and often lack appropriate control comparisons (see Tables 1 and 2). Secondly, there is little information on the transfer of the training effects of VR into the corresponding physical environment in general, and the VR training parameters associated with optimal transfer to real-world functional improvements are yet to be elucidated. Thirdly, in many clinical populations it is unclear whether advantages of VR over real-world training exist, and if so, precisely what these advantages are (see Tables 1 and 2 for study limitations). Furthermore, because this literature is extremely vulnerable to selective reporting and Type-I statistical error, there is an inherent bias of publishing results that show correlation between rehabilitation improvements and the application of VR. Therefore to potentially limit any bias in future studies, it may be useful for future studies to adopt a double-blinded protocol for the evaluation of the effectiveness of the use of VR. Lastly, it is important to investigate any unique rehabilitative effects of VR that may be exploited, or whether the benefits of VR can be attributed to the enjoyment of gaming platforms associated with VR themselves (i.e., VR therapies may only present as more effective because they engage and motivate participants throughout their training session, providing increased adherence). While limitations in VR technology exist, the potential for favorable neuroplasticity afforded by such technology undoubtedly warrants further investigation.

Conclusion

In summary, this review has discussed the strengths and limitations for the use of VR therapies in motor and mental health neurorehabilitation. The current evidence suggest that a combination of VR and conventional therapies are safe and likely to be more efficacious compared to just traditional or VR therapy alone. However, it is not known if the use of VR therapies can lead to cost-saving benefits (i.e., reduced financial and manpower cost) or even if current commercial or customized systems will be applicable by patients that are living within the community. More importantly, there is a need to elucidate the aspects of VR that are most effective for rehabilitation. While this is not apparent in the current review, future studies should attempt to systematically determine the role of self-projection, sensory feedback or motivation on rehabilitation in relation to specific diseases or impairments. Furthermore, we have discussed the potential for VR therapy to be complemented by other forms of technologies such as neuromodulation (tDCS) and neuroimaging (fNIRS/EEG) in order to augment training benefits of VR, and provide a more targeted approach to neurorehabilitation. Large-scale longitudinal studies will also be required to determine the effects of VR therapy (in combination with tDCS/fNIRS/EEG) and the translation of VR therapy in a non-clinical environment (i.e., home setting).

Author Contributions

All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

W-PT is supported by an Alfred Deakin Postdoctoral Research Fellowship. MM is supported by a Postdoctoral Research Fellowship of the University of Montpellier.

Abbreviations

BCI, brain computer interface; CP, cerebral palsy; EEG, electroencephalography; fMRI, functional magnetic resonance imaging; fNIRS, functional near-infrared spectroscopy; PD, Parkinson’s disease; PTSD, post-traumatic stress disorder; tDCS, transcranial direct current stimulation; VE, virtual environment; VR, virtual reality.

References

Adamovich, S. V., Fluet, G. G., Tunik, E., and Merians, A. S. (2009). Sensorimotor training in virtual reality: a review. NeuroRehabilitation 25, 29–44. doi: 10.3233/NRE-2009-0497

PubMed Abstract | CrossRef Full Text | Google Scholar

Aisen, M. L., Kerkovich, D., Mast, J., Mulroy, S., Wren, T. A., Kay, R. M., et al. (2011). Cerebral palsy: clinical care and neurological rehabilitation. Lancet Neurol. 10, 844–852. doi: 10.1016/S1474-4422(11)70176-4

CrossRef Full Text | Google Scholar

Ang, K. K., Guan, C., Phua, K. S., Wang, C., Zhao, L., Teo, W. P., et al. (2015). Facilitating effects of transcranial direct current stimulation on motor imagery brain-computer interface with robotic feedback for stroke rehabilitation. Arch. Phys. Med. Rehabil. 96, S79–S87. doi: 10.1016/j.apmr.2014.08.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Ayaz, H., Onaral, B., Izzetoglu, K., Shewokis, P. A., Mckendrick, R., and Parasuraman, R. (2013). Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development. Front. Hum. Neurosci. 7:871. doi: 10.3389/fnhum.2013.00871

PubMed Abstract | CrossRef Full Text | Google Scholar

Ayaz, H., Shewokis, P. A., Bunce, S., Izzetoglu, K., Willems, B., and Onaral, B. (2012). Optical brain monitoring for operator training and mental workload assessment. Neuroimage 59, 36–47. doi: 10.1016/j.neuroimage.2011.06.023

PubMed Abstract | CrossRef Full Text | Google Scholar

Barry, G., Galna, B., and Rochester, L. (2014). The role of exergaming in Parkinson’s disease rehabilitation: a systematic review of the evidence. J. Neuroeng. Rehabil. 11:33. doi: 10.1186/1743-0003-11-33

PubMed Abstract | CrossRef Full Text | Google Scholar

Basso Moro, S., Bisconti, S., Muthalib, M., Spezialetti, M., Cutini, S., Ferrari, M., et al. (2014). A semi-immersive virtual reality incremental swing balance task activates prefrontal cortex: a functional near-infrared spectroscopy study. Neuroimage 85, 451–460. doi: 10.1016/j.neuroimage.2013.05.031

PubMed Abstract | CrossRef Full Text | Google Scholar

Bayliss, J. D., and Ballard, D. H. (2000). A virtual reality testbed for brain-computer interface research. IEEE Trans. Rehabil. Eng. 8, 188–190. doi: 10.1109/86.847811

PubMed Abstract | CrossRef Full Text | Google Scholar

Benton, M. K., and Schroeder, H. E. (1990). Social skills training with schizophrenics: a meta-analytic evaluation. J. Consult. Clin. Psychol. 58, 741–747. doi: 10.1037/0022-006X.58.6.741

PubMed Abstract | CrossRef Full Text | Google Scholar

Bonanni, L., Thomas, A., Tiraboschi, P., Perfetti, B., Varanese, S., and Onofrj, M. (2008). EEG comparisons in early Alzheimer’s disease, dementia with Lewy bodies and Parkinson’s disease with dementia patients with a 2-year follow-up. Brain 131, 690–705. doi: 10.1093/brain/awm322

PubMed Abstract | CrossRef Full Text | Google Scholar

Bower, K. J., Louie, J., Landesrocha, Y., Seedy, P., Gorelik, A., and Bernhardt, J. (2015). Clinical feasibility of interactive motion-controlled games for stroke rehabilitation. J. Neuroeng. Rehabil. 12:63. doi: 10.1186/s12984-015-0057-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Bryanton, C., Bosse, J., Brien, M., Mclean, J., Mccormick, A., and Sveistrup, H. (2006). Feasibility, motivation, and selective motor control: virtual reality compared to conventional home exercise in children with cerebral palsy. Cyberpsychol. Behav. 9, 123–128. doi: 10.1089/cpb.2006.9.123

PubMed Abstract | CrossRef Full Text | Google Scholar

Burke, C. J., Tobler, P. N., Baddeley, M., and Schultz, W. (2010). Neural mechanisms of observational learning. Proc. Natl. Acad. Sci. U.S.A. 107, 14431–14436. doi: 10.1073/pnas.1003111107

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, Y. P., Lee, S. Y., and Howard, A. M. (2014). Effect of virtual reality on upper extremity function in children with cerebral palsy: a meta-analysis. Pediatr. Phys. Ther. 26, 289–300. doi: 10.1097/PEP.0000000000000046

PubMed Abstract | CrossRef Full Text | Google Scholar

Coffman, B. A., Clark, V. P., and Parasuraman, R. (2014). Battery powered thought: enhancement of attention, learning, and memory in healthy adults using transcranial direct current stimulation. Neuroimage 85, 895–908. doi: 10.1016/j.neuroimage.2013.07.083

PubMed Abstract | CrossRef Full Text | Google Scholar

Corbetta, D., Imeri, F., and Gatti, R. (2015). Rehabilitation that incorporates virtual reality is more effective that standard rehabilitation for improving walking speed, balance and mobility after stroke: a systematic review. J. Physiother. 61, 117–124. doi: 10.1016/j.jphys.2015.05.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Cote, S., and Bouchard, S. (2005). Documenting the efficacy of virtual reality exposure with psychophysiological and information processing measures. Appl. Psychophysiol. Biofeedback 30, 217–232. doi: 10.1007/s10484-005-6379-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Cui, X., Bray, S., Bryant, D. M., Glover, G. H., and Reiss, A. L. (2011). A quantitative comparison of NIRS and fMRI across multiple cognitive tasks. Neuroimage 54, 2808–2821. doi: 10.1016/j.neuroimage.2010.10.069

PubMed Abstract | CrossRef Full Text | Google Scholar

Cukor, J., Spitalnick, J., Difede, J., Rizzo, A., and Rothbaum, B. O. (2009). Emerging treatments for PTSD. Clin. Psychol. Rev. 29, 715–726. doi: 10.1016/j.cpr.2009.09.001

PubMed Abstract | CrossRef Full Text | Google Scholar

De Gennaro, L., Ferrara, M., Curcio, G., and Cristiani, R. (2001). Antero-posterior EEG changes during the wakefulness-sleep transition. Clin. Neurophysiol. 112, 1901–1911. doi: 10.1016/S1388-2457(01)00649-6

PubMed Abstract | CrossRef Full Text | Google Scholar

de Lissa, P., Sorensen, S., Badcock, N., Thie, J., and Mcarthur, G. (2015). Measuring the face-sensitive N170 with a gaming EEG system: a validation study. J. Neurosci. Methods 253, 47–54. doi: 10.1016/j.jneumeth.2015.05.025

PubMed Abstract | CrossRef Full Text | Google Scholar

Dewar, R., Love, S., and Johnston, L. M. (2015). Exercise interventions improve postural control in children with cerebral palsy: a systematic review. Dev. Med. Child Neurol. 57, 504–520. doi: 10.1111/dmcn.12660

PubMed Abstract | CrossRef Full Text | Google Scholar

dos Santos Mendes, F. A., Pompeu, J. E., Modenesi Lobo, A., Guedes da Silva, K., Oliveira Tde, P., Peterson Zomignani, A., et al. (2012). Motor learning, retention and transfer after virtual-reality-based training in Parkinson’s disease–effect of motor and cognitive demands of games: a longitudinal, controlled clinical study. Physiotherapy 98, 217–223. doi: 10.1016/j.physio.2012.06.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Dutta, A., Jacob, A., Chowdhury, S. R., Das, A., and Nitsche, M. A. (2015). EEG-NIRS based assessment of neurovascular coupling during anodal transcranial direct current stimulation–a stroke case series. J. Med. Syst. 39:205. doi: 10.1007/s10916-015-0205-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Esculier, J. F., Vaudrin, J., Bériault, P., Gagnon, K., and Tremblay, L. E. (2012). Home-based balance training programme using Wii Fit with balance board for Parkinsons’s disease: a pilot study. J. Rehabil. Med. 44, 144–150. doi: 10.2340/16501977-0922

PubMed Abstract | CrossRef Full Text | Google Scholar

Fang, T. Y., Wang, P. C., Liu, C. H., Su, M. C., and Yeh, S. C. (2014). Evaluation of a haptics-based virtual reality temporal bone simulator for anatomy and surgery training. Comput. Methods Programs 113, 674–681. doi: 10.1016/j.cmpb.2013.11.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Ferrari, M., Mottola, L., and Quaresima, V. (2004). Principles, techniques, and limitations of near infrared spectroscopy. Can. J. Appl. Physiol. 29, 463–487. doi: 10.1139/h04-031

CrossRef Full Text | Google Scholar

Ferrari, M., and Quaresima, V. (2012). A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application. Neuroimage 63, 921–935. doi: 10.1016/j.neuroimage.2012.03.049

PubMed Abstract | CrossRef Full Text | Google Scholar

Floel, A. (2014). tDCS-enhanced motor and cognitive function in neurological diseases. Neuroimage 85, 934–947. doi: 10.1016/j.neuroimage.2013.05.098

PubMed Abstract | CrossRef Full Text | Google Scholar

Formaggio, E., Storti, S. F., Boscolo Galazzo, I., Gandolfi, M., Geroin, C., Smania, N., et al. (2013). Modulation of event-related desynchronization in robot-assisted hand performance: brain oscillatory changes in active, passive and imagined movements. J. Neuroeng. Rehabil. 10:24. doi: 10.1186/1743-0003-10-24

PubMed Abstract | CrossRef Full Text | Google Scholar

Formaggio, E., Storti, S. F., Boscolo Galazzo, I., Gandolfi, M., Geroin, C., Smania, N., et al. (2015). Time-frequency modulation of ERD and EEG coherence in robot-assisted hand performance. Brain Topogr. 28, 352–363. doi: 10.1007/s10548-014-0372-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Garrison, D. R., and Garrison, D. R. (1997). Self-directed learning: toward a comprehensive model. Adult Educ. Q. 48, 18–33. doi: 10.1177/074171369704800103

CrossRef Full Text | Google Scholar

Goncalves, R., Pedrozo, A. L., Coutinho, E. S., Figueira, I., and Ventura, P. (2012). Efficacy of virtual reality exposure therapy in the treatment of PTSD: a systematic review. PLoS ONE 7:e48469. doi: 10.1371/journal.pone.0048469

PubMed Abstract | CrossRef Full Text | Google Scholar

Gorini, A., Pallavicini, F., Algeri, D., Repetto, C., Gaggioli, A., and Riva, G. (2010). Virtual reality in the treatment of generalized anxiety disorders. Stud. Health Technol. Inform. 154, 39–43.

Google Scholar

Gosselin, N., Bottari, C., Chen, J. K., Petrides, M., Tinawi, S., De Guise, E., et al. (2011). Electrophysiology and functional MRI in post-acute mild traumatic brain injury. J. Neurotrauma 28, 329–341. doi: 10.1089/neu.2010.1493

PubMed Abstract | CrossRef Full Text | Google Scholar

Harris, D. M., Rantalainen, T., Muthalib, M., Johnson, L., and Teo, W. P. (2015). Exergaming as a viable therapeutic tool to improve static and dynamic balance among older adults and people with idiopathic Parkinson’s disease: a systematic review and meta-analysis. Front. Aging Neurosci. 7:167. doi: 10.3389/fnagi.2015.00167

CrossRef Full Text | Google Scholar

Herz, N. B., Herz, N. B., Mehta, S. H., Sethi, K. D., Jackson, P., Hall, P., et al. (2013). Nintendo Wii rehabilitation (‘Wii-hab’) provides benefits in Parkinson’s disease. Parkinsonism. Relat. Disord. 19, 1039–1042. doi: 10.1016/j.parkreldis.2013.07.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Holper, L., Muehlemann, T., Scholkmann, F., Eng, K., Kiper, D., and Wolf, M. (2010). Testing the potential of a virtual reality neurorehabilitation system during performance of observation, imagery and imitation of motor actions recorded by wireless functional near-infrared spectroscopy (fNIRS). J. Neuroeng. Rehabil. 7:57. doi: 10.1186/1743-0003-7-57

PubMed Abstract | CrossRef Full Text | Google Scholar

Hong, K. S., Naseer, N., and Kim, Y. H. (2015). Classification of prefrontal and motor cortex signals for three-class fNIRS–BCI. Neurosci. Lett. 587, 87–92. doi: 10.1016/j.neulet.2014.12.029

PubMed Abstract | CrossRef Full Text | Google Scholar

Huang, H. Y., and Lo, P. C. (2009). EEG dynamics of experienced Zen meditation practitioners probed by complexity index and spectral measure. J. Med. Eng. Technol. 33, 314–321. doi: 10.1080/03091900802602677

PubMed Abstract | CrossRef Full Text | Google Scholar

Huppert, T. J., Hoge, R. D., Diamond, S. G., Franceschini, M. A., and Boas, D. A. (2006). A temporal comparison of BOLD, ASL, and NIRS hemodynamic responses to motor stimuli in adult humans. Neuroimage 29, 368–382. doi: 10.1016/j.neuroimage.2005.08.065

PubMed Abstract | CrossRef Full Text | Google Scholar

Irani, F., Platek, S. M., Bunce, S., Ruocco, A. C., and Chute, D. (2007). Functional near infrared spectroscopy (fNIRS): an emerging neuroimaging technology with important applications for the study of brain disorders. Clin. Neuropsychol. 21, 9–37. doi: 10.1080/13854040600910018

PubMed Abstract | CrossRef Full Text | Google Scholar

Jung, E. Y., Park, D. K., Lee, Y. H., Jo, H. S., Lim, Y. S., and Park, R. W. (2012). Evaluation of practical exercises using an intravenous simulator incorporating virtual reality and haptics device technologies. Nurse Educ. Today 32, 458–463. doi: 10.1016/j.nedt.2011.05.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Kandalaft, M. R., Didehbani, N., Krawczyk, D. C., Allen, T. T., and Chapman, S. B. (2013). Virtual reality social cognition training for young adults with high-functioning autism. J. Autism. Dev. Disord. 43, 34–44. doi: 10.1007/s10803-012-1544-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, B. R., Chun, M. H., Kim, L. S., and Park, J. Y. (2011). Effect of virtual reality on cognition in stroke patients. Ann. Rehabil. Med. 35, 450–459. doi: 10.5535/arm.2011.35.4.450

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, Y. J., Ku, J., Cho, S., Kim, H. J., Cho, Y. K., Lim, T., et al. (2014). Facilitation of corticospinal excitability by virtual reality exercise following anodal transcranial direct current stimulation in healthy volunteers and subacute stroke subjects. J. Neuroeng. Rehabil. 11:124. doi: 10.1186/1743-0003-11-124

PubMed Abstract | CrossRef Full Text | Google Scholar

Klinger, E., Bouchard, S., Legeron, P., Roy, S., Lauer, F., Chemin, I., et al. (2005). Virtual reality therapy versus cognitive behavior therapy for social phobia: a preliminary controlled study. Cyberpsychol. Behav. 8, 76–88. doi: 10.1089/cpb.2005.8.76

PubMed Abstract | CrossRef Full Text | Google Scholar

Klinger, E., Legeron, P., Roy, S., Chemin, I., Lauer, F., and Nugues, P. (2004). Virtual reality exposure in the treatment of social phobia. Stud. Health Technol. Inform. 99, 91–119.

Google Scholar

Koo, B., Lee, H. G., Nam, Y., Kang, H., Koh, C. S., Shin, H. C., et al. (2015). A hybrid NIRS-EEG system for self-paced brain computer interface with online motor imagery. J. Neurosci. Methods 244, 26–32. doi: 10.1016/j.jneumeth.2014.04.016

PubMed Abstract | CrossRef Full Text | Google Scholar

Ku, J., Han, K., Lee, H. R., Jang, H. J., Kim, K. U., Park, S. H., et al. (2007). VR-based conversation training program for patients with schizophrenia: a preliminary clinical trial. Cyberpsychol. Behav. 10, 567–574. doi: 10.1089/cpb.2007.9989

PubMed Abstract | CrossRef Full Text | Google Scholar

Kuester, A., Niemeyer, H., and Knaevelsrud, C. (2016). Internet-based interventions for posttramatic stress: a meta-analysis of randomized controlled trials. Clin. Psychol. Rev. 43, 1–16. doi: 10.1016/j.cpr.2015.11.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Laffont, I., Bakhti, K., Coroian, F., Van Dokkum, L., Mottet, D., Schweighofer, N., et al. (2014). Innovative technologies applied to sensorimotor rehabilitation after stroke. Ann. Phys. Rehabil. Med. 57, 543–551. doi: 10.1016/j.rehab.2014.08.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Lang, N., Siebner, H. R., Ward, N. S., Lee, L., Nitsche, M. A., Paulus, W., et al. (2005). How does transcranial DC stimulation of the primary motor cortex alter regional neuronal activity in the human brain? Eur. J. Neurosci. 22, 495–504. doi: 10.1111/j.1460-9568.2005.04233.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Lauber, B., and Keller, M. (2014). Improving motor performance: selected aspects of augmented feedback in exercise and health. Eur. J. Sport Sci. 14, 36–43. doi: 10.1080/17461391.2012.725104

PubMed Abstract | CrossRef Full Text | Google Scholar

Laver, K., George, S., Thomas, S., Deutsch, J. E., and Crotty, M. (2015). Virtual reality for stroke rehabilitation: an abridged version of a Cochrane review. Eur. J. Phys. Rehabil. Med. 51, 497–506.

PubMed Abstract | Google Scholar

Ledoux, A. A., Phillips, J. L., Labelle, A., Smith, A., Bohbot, V. D., and Boyer, P. (2013). Decreased fMRI activity in the hippocampus of patients with schizophrenia compared to healthy control participants, tested on a wayfinding task in a virtual town. Psychiatry Res. 211, 47–56. doi: 10.1016/j.pscychresns.2012.10.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, S. J., and Chun, M. H. (2014). Combination transcranial direct current stimulation and virtual reality therapy for upper extremity training in patients with subacute stroke. Arch. Phys. Med. Rehabil. 95, 431–438. doi: 10.1016/j.apmr.2013.10.027

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, S. J., Yoo, J. Y., Ryu, J. S., Park, H. K., and Chung, S. J. (2012). The effects of visual and auditory cues on freezing of gait in patients with Parkinson’s disease. Am. J. Phys. Med. Rehabil. 91, 2–11. doi: 10.1097/PHM.0b013e31823c7507

PubMed Abstract | CrossRef Full Text | Google Scholar

Levin, M., Magdalon, E. C., Michaelsen, S. M., and Quevedo, A. (2015). Quality of grasping and the role of haptics in a 3D immersive virtual reality environment in individuals with stroke. IEEE Trans. Neural Syst. Rehabil. Eng. 23, 1047–1055. doi: 10.1109/TNSRE.2014.2387412

PubMed Abstract | CrossRef Full Text | Google Scholar

Lin, C. T., Chung, I. F., Ko, L. W., Chen, Y. C., Liang, S. F., and Duann, J. R. (2007). EEG-based assessment of driver cognitive responses in a dynamic virtual-reality driving environment. IEEE Trans. Biomed. Eng. 54, 1349–1352. doi: 10.1109/TBME.2007.891164

PubMed Abstract | CrossRef Full Text | Google Scholar

Lister, C., West, J. H., Cannon, B., Sax, T., and Brodegard, D. (2014). Just a fad. Gamification in health and fitness apps. JIMR Serious Games 2:e9. doi: 10.2196/games.3413

PubMed Abstract | CrossRef Full Text | Google Scholar

Lohse, K. R., Hilderman, C. G., Cheung, K. L., Tatla, S., and Van Der Loos, H. F. (2014). Virtual reality therapy for adults post-stroke: a systematic review and meta-analysis exploring virtual environments and commercial games in therapy. PLoS ONE 9:e93318. doi: 10.1371/journal.pone.0093318

PubMed Abstract | CrossRef Full Text | Google Scholar

Luque-Moreno, C., Ferragut-Garcías, A., Rodríguez-Blanco, C., Heredia-Rizo, A. M., Oliva-Pascual-Vaca, J., Kiper, P., et al. (2015). A decade of progress using virtual reality for poststroke lower extremity rehabilitation: systematic review of the intervention methods. Biomed. Res. Int. 2015:7. doi: 10.1155/2015/342529

PubMed Abstract | CrossRef Full Text | Google Scholar

Marques, A., Queirós, C., and Rocha, N. (2008). “Virtual reality and neuropsychology: a cognitive rehabilitation approach for people with psychiatric disabilities,” in ICDVRAT–Proceedings of 7th International Conference on Disability Virtual Reality and Associated Technologies (Sep 8-11 2008) (Maia: Citeseer), 39–46.

Google Scholar

Maskey, M., Lowry, J., Rodgers, J., Mcconachie, H., and Parr, J. R. (2014). Reducing specific phobia/fear in young people with autism spectrum disorders (ASDs) through a virtual reality environment intervention. PLoS ONE 2:e100374. doi: 10.1371/journal.pone.0100374

PubMed Abstract | CrossRef Full Text | Google Scholar

McKendrick, R., Ayaz, H., Olmstead, R., and Parasuraman, R. (2014). Enhancing dual-task performance with verbal and spatial working memory training: continuous monitoring of cerebral hemodynamics with NIRS. Neuroimage 85, 1014–1026. doi: 10.1016/j.neuroimage.2013.05.103

PubMed Abstract | CrossRef Full Text | Google Scholar

McKendrick, R., Parasuraman, R., and Ayaz, H. (2015). Wearable functional near infrared spectroscopy (fNIRS) and transcranial direct current stimulation (tDCS): expanding vistas for neurocognitive augmentation. Front. Syst. Neurosci. 9:27. doi: 10.3389/fnsys.2015.00027

PubMed Abstract | CrossRef Full Text | Google Scholar

Meyerbroker, K., and Emmelkamp, P. M. (2010). Virtual reality exposure therapy in anxiety disorders: a systematic review of process-and-outcome studies. Depress. Anxiety 27, 933–944. doi: 10.1002/da.20734

PubMed Abstract | CrossRef Full Text | Google Scholar

Mingyu, L., Jue, W., Nan, Y., and Qin, Y. (2005). “Development of EEG biofeedback system based on virtual reality environment,” in Proceedings of the 27th Annual Conference on IEEE Engineering in Medicine and Biology, Shanghai (Rome: IEEE), 5362–5364. doi: 10.1109/IEMBS.2005.1615693

PubMed Abstract | CrossRef Full Text | Google Scholar

Mirelman, A., Maidan, I., Herman, T., Deutsch, J. E., Giladi, N., and Hausdorff, J. M. (2011). Virtual reality for gait training: can it induce motor learning to enhance complex walking and reduce fall risk in patients with Parkinson’s disease? J. Gerontol. A Biol. Sci. Med. Sci. 66, 234–240. doi: 10.1093/gerona/glq201

PubMed Abstract | CrossRef Full Text | Google Scholar

Mirelman, A., Rochester, L., Reelick, M., Nieuwhof, F., Pelosin, E., Abbruzzese, G., et al. (2013). V-TIME: a treadmill training program augmented by virtual reality to decrease fall risk in older adults: study design of a randomized controlled trial. BMC Neurol. 13:15. doi: 10.1186/1471-2377-13-15

PubMed Abstract | CrossRef Full Text | Google Scholar

Monge Pereira, E., Molina Rueda, F., Alguacil Diego, I. M., Cano de la Cuerda, R., De Mauro, A., and Miangolarra Page, J. C. (2015). Use of virtual reality systems as proprioception method in cerebral palsy: clinical practice guideline. Neurologia 30, 550–559. doi: 10.1016/j.nrl.2011.12.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Muthalib, M., Anwar, A. R., Perrey, S., Dat, M., Galka, A., Wolff, S., et al. (2013). Multimodal integration of fNIRS, fMRI and EEG neuroimaging. Clin. Neurophysiol. 124, 2060–2062. doi: 10.1016/j.clinph.2013.03.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Muthalib, M., Besson, P., Rothwell, J. C., Ward, T. E., and Perrey, A. (2016). Effects of anodal high-definition transcranial direct current stimulation on bilateral sensorimotor cortex activation during sequential finger movements: an fNIRS study. Adv. Exp. Med. Biol. 876, 351–359. doi: 10.1007/978-1-4939-3023-4_44

PubMed Abstract | CrossRef Full Text | Google Scholar

Nieuwenhuijsen, E. R., Zemper, E., Miner, K. R., and Epstein, M. (2006). Health behavior change models and theories: contributions to rehabilitation. Disabil. Rehabil. 28, 245–256. doi: 10.1080/09638280500197743

PubMed Abstract | CrossRef Full Text | Google Scholar

Nitsche, M. A., and Paulus, W. (2000). Excitability changes induced in the human motor cortex by weak transcranial direct current stimulation. J. Physiol. 527(Pt 3), 633–639. doi: 10.1111/j.1469-7793.2000.t01-1-00633.x

CrossRef Full Text | Google Scholar

Oouchida, Y., Suzuki, E., Aizu, N., Takeuchi, N., and Izumi, S. (2013). Application of observational learning in neurorehabilitation. Int. J. Phys. Med. Rehabil. 1:5.

Google Scholar

Opris, D., Pintea, S., Garcia-Palacios, A., Botella, C., Szamoskozi, S., and David, D. (2012). Virtual reality exposure therapy in anxiety disorders: a quantitative meta-analysis. Depress. Anxiety 29, 85–93. doi: 10.1002/da.20910

PubMed Abstract | CrossRef Full Text | Google Scholar

Oskoui, M., Coutinho, F., Dykeman, J., Jette, N., and Pringsheim, T. (2013). An update on the prevalence of cerebral palsy: a systematic review and meta-analysis. Dev. Med. Child Neurol. 55, 509–519. doi: 10.1111/dmcn.12080

PubMed Abstract | CrossRef Full Text | Google Scholar

Park, K. M., Ku, J., Choi, S. H., Jang, H. J., Park, J. Y., Kim, S. I., et al. (2011). A virtual reality application in role-plays of social skills training for schizophrenia: a randomized, controlled trial. Psychiatry Res. 189, 166–172. doi: 10.1016/j.psychres.2011.04.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Powers, M. B., and Emmelkamp, P. M. (2008). Virtual reality exposure therapy for anxiety disorders: a meta-analysis. J. Anxiety Disord. 22, 561–569. doi: 10.1016/j.janxdis.2007.04.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Reid, D. (2004). The influence of virtual reality on playfulness in children with cerebral palsy: a pilot study. Occup. Ther. Int. 11, 131–144. doi: 10.1002/oti.202

PubMed Abstract | CrossRef Full Text | Google Scholar

Reid, D. T. (2002a). Benefits of a virtual play rehabilitation environment for children with cerebral palsy on perceptions of self-efficacy: a pilot study. Pediatr. Rehabil. 5, 141–148. doi: 10.1080/1363849021000039344

PubMed Abstract | CrossRef Full Text | Google Scholar

Reid, D. T. (2002b). The use of virtual reality to improve upper-extremity efficiency skills in children with cerebral palsy: a pilot study. Technol. Disabil. 14, 53–62.

Google Scholar

Repetto, C., and Riva, G. (2011). From virtual reality to interreality in the treatment of anxiety disorders. Neuropsychiatry 1, 31–43. doi: 10.2196/jmir.3235

PubMed Abstract | CrossRef Full Text | Google Scholar

Rizzo, A., Buckwalter, G., Neumann, U., Kesselman, C., and Thiebaux, M. (1998). Basic issues in the application of virtual reality for the assessment and rehabilitation of cognitive impairments and functional disabilities. Cyberpsychol. Behav. 1, 59–78. doi: 10.1089/cpb.1998.1.59

CrossRef Full Text | Google Scholar

Rothwell, J. C. (2012). Clinical applications of noninvasive electrical stimulation: problems and potentials. Clin. EEG Neurosci. 43, 209–214. doi: 10.1177/1550059412444973

PubMed Abstract | CrossRef Full Text | Google Scholar

Ruffini, G., Fox, M. D., Ripolles, O., Miranda, P. C., and Pascual-Leone, A. (2014). Optimization of multifocal transcranial current stimulation for weighted cortical pattern targeting from realistic modeling of electric fields. Neuroimage 89, 216–225. doi: 10.1016/j.neuroimage.2013.12.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Saposnik, G., Levin, M., and Outcome Research Canada (SORCan) Working Group (2011). Virtual reality in stroke rehabilitation: a meta-analysis and implications for clinicians. Stroke 42, 1380–1386. doi: 10.1161/STROKEAHA.110.605451

PubMed Abstract | CrossRef Full Text | Google Scholar

Seraglia, B., Gamberini, L., Priftis, K., Scatturin, P., Martinelli, M., and Cutini, S. (2011). An exploratory fNIRS study with immersive virtual reality: a new method for technical implementation. Front. Hum. Neurosci. 5:176. doi: 10.3389/fnhum.2011.00176

PubMed Abstract | CrossRef Full Text | Google Scholar

Sitaram, R., Zhang, H., Guan, C., Thulasidas, M., Hoshi, Y., Ishikawa, A., et al. (2007). Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain-computer interface. Neuroimage 34, 1416–1427. doi: 10.1016/j.neuroimage.2006.11.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Strosahl, K. D., and Ascough, J. C. (1981). Clinical uses of mental imagery: experimental foundations, theoretical misconceptions, and research issues. Psychol. Bull. 89, 422–438. doi: 10.1037/0033-2909.89.3.422

PubMed Abstract | CrossRef Full Text | Google Scholar

Thomson, K., Pollock, A., Bugge, C., and Brady, M. (2014). Commercial gaming devices for stroke upper limb rehabilitation: a systematic review. Int. J. Stroke 9, 479–488. doi: 10.1111/ijs.12263

PubMed Abstract | CrossRef Full Text | Google Scholar

Tsang, M. M., and Man, D. W. (2013). A virtual reality-based vocational training system (VRVTS) for people with schizophrenia in vocational rehabilitation. Schizophr. Res. 144, 51–62. doi: 10.1016/j.schres.2012.12.024

PubMed Abstract | CrossRef Full Text | Google Scholar

Van den Broek, M. D. (2005). Why does neurorehabilitation fail? J. Head Trauma Rehabil. 20, 464–473. doi: 10.1097/00001199-200509000-00007

CrossRef Full Text | Google Scholar

Viana, R. T., Viana, R. T., Laurentino, G. E. C., Souza, R. J. P., Fonseca, J. B., Silva Filho, E. M., et al. (2014). Effects of the addition of transcranial direct current stimulation to virtual reality therapy after stroke: a pilot randomized controlled trial. NeuroRehabilitation 34, 437–446. doi: 10.3233/NRE-141065

PubMed Abstract | CrossRef Full Text | Google Scholar

Vincelli, F., Choi, H., Molinari, E., Wiederhold, B. K., Bouchard, S., and Riva, G. (2002). Virtual reality assisted cognitive behavioral therapy for the treatment of panic disorders with Agoraphobia. Stud. Health Technol. Inform. 85, 552–559.

Google Scholar

Wang, C. T. (2012). [Research and application of a haptics-based virtual-reality training system for craniomaxillofacial surgery]. Zhonghua Kou Qiang Yi Xue Za Zhi 47, 458–462. doi: 10.3760/cma.j.issn.1002-0098.2012.08.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Waters, F. A., Maybery, M. T., Badcock, J. C., and Michie, P. T. (2004). Context memory and binding in schizophrenia. Schizophr. Res. 68, 119–125. doi: 10.1016/S0920-9964(03)00221-4

CrossRef Full Text | Google Scholar

Williams, C. K., and Carnahan, H. (2014). Motor learning perspectives on haptic training for the upper extremities. IEEE Trans. Haptics 7, 240–250. doi: 10.1109/TOH.2013.2297102

PubMed Abstract | CrossRef Full Text | Google Scholar

Winstein, C. J. (1991). Knowledge of results and motor learning–implications for physical therapy. Phys. Ther. 71, 140–149.

Google Scholar

Wolpaw, J. R., Birbaumer, N., Mcfarland, D. J., Pfurtscheller, G., and Vaughan, T. M. (2002). Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113, 767–791. doi: 10.1016/S1388-2457(02)00057-3

CrossRef Full Text | Google Scholar

Xuxian, Y., Baolei, X., Changhao, J., Yunfa, F., Zhidong, W., Hongyi, L., et al. (2015). A hybrid BCI based on EEG and fNIRS signals improves the performance of decoding motor imagery of both force and speed of hand clenching. J. Neural. Eng. 12, 036004. doi: 10.1088/1741-2560/12/3/036004

PubMed Abstract | CrossRef Full Text | Google Scholar

Yeh, S. C., Lee, S. H., Chan, R. C., Chen, S., and Rizzo, A. (2014). A virtual reality system integrated with robot-assisted haptics to simulate pinch-grip task: motor ingredients for the assessment in chronic stroke. NeuroRehabilitation 35, 435–449. doi: 10.3233/NRE-141134

PubMed Abstract | CrossRef Full Text | Google Scholar

You, S. H., Jang, S. H., Kim, Y. H., Kwon, Y. H., Barrow, I., and Hallett, M. (2005). Cortical reorganization induced by virtual reality therapy in a child with hemiparetic cerebral palsy. Dev. Med. Child Neurol. 47, 628–635. doi: 10.1017/S0012162205001234

PubMed Abstract | CrossRef Full Text | Google Scholar