- 1Gleb Wataghin Institute of Physics, University of Campinas – UNICAMP, Campinas, Brazil
- 2Brazilian Institute of Neuroscience and Neurotechnology – BRAINN, Campinas, Brazil
- 3Neuroimaging Laboratory, Department of Neurology, University of Campinas – UNICAMP, Campinas, Brazil
Introduction: Stroke is the leading cause of functional disability worldwide. With the increase of the global population, motor rehabilitation of stroke survivors is of ever-increasing importance. In the last decade, virtual reality (VR) technologies for rehabilitation have been extensively studied, to be used instead of or together with conventional treatments such as physiotherapy or occupational therapy. The aim of this work was to evaluate the GestureCollection VR-based rehabilitation tool in terms of the brain changes and clinical outcomes of the patients.
Methods: Two groups of chronic patients underwent a rehabilitation treatment with (experimental) or without (control) complementation with GestureCollection. Functional magnetic resonance imaging exams and clinical assessments were performed before and after the treatment. A functional connectivity graph-based analysis was used to assess differences between the connections and in the network parameters strength and clustering coefficient.
Results: Patients in both groups showed improvement in clinical scales, but there were more increases in functional connectivity in the experimental group than in the control group.
Discussion: The experimental group presented changes in the connections between the frontoparietal and the somatomotor networks, associative cerebellum and basal ganglia, which are regions associated with reward-based motor learning. On the other hand, the control group also had results in the somatomotor network, in its ipsilateral connections with the thalamus and with the motor cerebellum, which are regions more related to a purely mechanical activity. Thus, the use of the GestureCollection system was successfully shown to promote neuroplasticity in several motor-related areas.
1. Introduction
According to the World Stroke Organization, “stroke has already reached epidemic proportions,” with 25% of adults over 25 years old estimated to have a stroke in their lifetime (1). Although the proportion of survivors is larger than that of deceased (around 6:4) (1), many of the first remain with physical disabilities. Advances in virtual reality (VR) technologies for motor rehabilitation in the last few years have created new therapy possibilities for stroke victims. With the demand for rehabilitation constantly growing (2), VR systems represent an option that helps to alleviate the scarcity of clinics and physiotherapists, particularly in low-income countries. VR technologies have allowed physical therapy experts to explore new paths to stimulate brain plasticity (3) and improve rehabilitation. Besides, the use of these systems has been related to a higher rate of adherence among patients due to their ludic character (4).
As stated by Weiss and colleagues, VR is the ‘use of interactive simulations created with computer hardware and software to present users with opportunities to engage in environments that appear and feel similar to real-world objects and events’ (5). VR allows the creation of a safe environment where it is possible to perform the daily activities and exercises needed for a motor rehabilitation therapy, while having close supervision of a therapist, be it presential or remote. Several VR systems, both off the shelf and explicitly developed for research, have been used for rehabilitation of upper and/or lower limbs of stroke patients [(e.g., 6–9)] and other conditions, such as cerebral palsy (10) and Parkinson’s disease (11, 12). These systems range from non-immersive, where the virtual environment is typically presented on a video display, to fully immersive, where the user usually wears glasses or similar devices that give the impression of being in a different environment (the virtual one) altogether. The first type is more abundant in the literature, possibly because the latter can cause cyber-sickness symptoms (13). Another important aspect in VR systems is the user interface, which can make use of controllers (e.g., joysticks) or be based on gestural control, which can rely on wearable sensors or optical devices. Gesture-controlled VR allows users to perform closer-to-real-life movements, compared to controller-based VR systems. Indeed, gesture-controlled VR systems are known as natural interfaces (14). Although nowadays these systems are equivalent in terms of complexity issues, prices for VR systems with wearable sensors are usually more expensive, and the controllability of a gesture-based VR system is still slightly more difficult than that of a conventional VR system, considering gesture recognition concerns (15).
The GestureCollection system (14) is a low-cost, easy and intuitive setup, non-immersive rehabilitation solution developed within our group, based on the gestural control of the computer. It comprises three VR games: GesturePuzzle, in which users must use the upper limbs to put the pieces of a puzzle together; GestureChess, in which users play a chess game using the upper limbs to move the pieces; and GestureMaps, in which subjects can navigate through the virtual map of Google Street View controlling the virtual movements with real stationary gait and trunk rotation. Here, we investigate brain changes associated with clinical outcomes in stroke patients performing motor rehabilitation with and without the inclusion of GestureCollection-based activities in the therapeutic protocol.
Indeed, a way to investigate the effects of rehabilitation in the brain that has been widely used is resting state (rs) functional magnetic resonance imaging (fMRI) associated with graph theory to measure the topological changes in brain networks (16). fMRI (based on the blood oxygenation level dependent – BOLD – signal) measures a mixture of oxygenation, volume and flow changes in the brain’s blood supply, secondary to its electrophysiological response (17). rs-fMRI has been used to probe concurrent fluctuations in the BOLD signal occurring at distinct brain regions (18), from which have emerged the functional brain networks (19). Brain networks are known to have a small-world topology (20), i.e., they present a high clustering coefficient (CC) and a small average shortest path length. In practice, this implies an optimized balance between the ability to process specialized information (segregation) and to ensure an efficient information flow through the brain (integration). In an injured brain, this balance gets compromised, and it is expected to change as a neuroplasticity effect.
Other papers have reported using fMRI to investigate brain changes resulting from the use of VR solutions for rehabilitation of stroke patients (21–36) (for a more complete review on this topic, (see 3)). However, most works used task-based fMRI (22, 24, 26, 29–36), while only a few used rs-fMRI (21, 23, 25, 27, 28). From the latter, only the work by Feitosa et al. actually investigated brain network topology changes using graph theory (23). Therefore, there is room for more research in the topic of network topology changes resulting from VR rehabilitation in stroke patients.
The aim of this work was to investigate changes in functional connectivity and network parameters in stroke victims as a result of motor rehabilitation, performed with or without complementation with GestureCollection. We hypothesize that patients who undergo therapy along with this VR approach are going to show larger increased connectivity with motor-related areas than patients who undergo conventional therapy.
2. Materials and methods
2.1. Subjects
Fifteen patients with ischemic stroke diagnosis were recruited through the Neurovascular Outpatient Clinic in the Clinics Hospital of University of Campinas and by spontaneous search of volunteers. The patients were assessed for eligibility by a blinded assistant and allocated into groups through alternation. One patient was lost to follow-up and four others had their data discarded during the preprocessing of the MRI data, resulting in a sample of 10 individuals (Table 1).
Inclusion criteria were: (1) patients with ischemic stroke between 6 and 24 months after onset; (2) age 45–70 years; (3) both genders; (4) motor and functional impairment measured by modified Rankin Scale (mRS 1–4); and (5) signed Informed Consent Form. Exclusion criteria were: (1) contraindications to the MRI exam (such as the presence of metallic implants, claustrophobia or other conditions); (2) lack of capacity to understand or follow verbal commands; and (3) serious visual impairments. All research was performed in accordance with the ethical standards of the Declaration of Helsinki and its later amendments. The study was approved by the Ethics Committee of University of Campinas (protocol 60860616.0.0000.5404) and all subjects signed an informed consent form prior to entering the study.
2.2. Rehabilitation protocols
Participants were alternated into two groups: the control group received 1 h of “conventional physiotherapy” (CPT) (therapeutic exercises and functional exercises for upper limb and gait), plus 30 min of visual stimulation (video showing movements of lower and upper limbs); and the experimental group received 1 h of CPT followed by the application of VR for 30 min. Rehabilitation sessions were conducted twice a week, for six consecutive weeks (total of 12 sessions). CPT included: joint mobilization, stretching for upper and lower limb and trunk, proprioceptive neuromuscular facilitation exercises, training of postural transfers (sitting, lying and standing) and gait training in a proprioceptive circuit. Clinical data such as heart and respiratory rate, blood pressure and effort reported by the patient were considered for the conduction of the treatment.
2.3. VR system
The GestureCollection VR set (14) was used in the therapy sessions. GestureCollection requires a computer, a monitor and the Kinect 360 gesture recognition sensor (Microsoft, Redmond, Washington). Two games (Figures 1, 2) were selected: (1) Gesture Puzzle, a 9-piece virtual puzzle that must be put together through the shoulder movements of abduction, adduction and flexion, elbow extension, and wrist extension (when possible), with the patient sitting on a chair with no movement restriction of the trunk and upper limbs (Figure 2); and (2) GestureMaps, which consists of navigating through different scenarios of a virtual map, based on gestures of stationary gait – mainly hip and knee flexion, with trunk rotation toward the side the user wants to explore in the map –performed between parallel bars for patient safety.
Figure 1. GestureCollection games: Gesture puzzle (top) and Gesture maps (bottom). Figure reprinted with permission from Brandao et al. (14).
Figure 2. Experimental setup: the patient plays GesturePuzzle seated in front to the screen which reproduces the game. Below the screen, a Kinect captures the user movements.
2.4. Clinical evaluations
To verify functional outcomes, we used the Fugl-Meyer Assessment (FMA), the Berg Balance Scale (BBS), the Timed Up and Go (TUG) test and the Montreal Cognitive Assessment (MoCA). Evaluations were conducted at the beginning and the end of the study period by a physiotherapist blind to group assignment.
FMA is considered one of the most complete measures for post-stroke functions (37), consisting of five domains: motor function, sensory function, balance, passive range of motion and joint pain, for the upper and lower limbs. The maximum score is 226 points, 126 points for upper limbs, 86 points for lower limbs and 14 points for balance. The higher the score, the better the functions of the patient.
BBS was used to assess balance (38), consisting of 14 activities, such as sitting or standing up without support, with a total score of 56 points. The higher the score, the better the balance function – with scores below 40 suggesting a risk of falling.
TUG (39) is a test of mobility, gait and balance performed by the following steps while being timed: stand up from a chair, walk forward 3 meters, walk back to the chair, and sit down. The test is conducted three times, and the average time is used.
MoCA (40) is a fast, practical and effective method for cognitive assessment and screening, which evaluates attention, concentration, executive function, memory, language and other functions related to cognition, adding up to 30 points (1 point is mandatory if the patient has 12 years or less of education). A score of 26 or above is considered normal.
2.5. Data acquisition and preprocessing
Two MRI acquisitions were performed in a 3.0 Tesla scanner (Achieva, Philips, The Netherlands), one before the first therapy session, and one after the last therapy session. These consisted of a T1-weighted anatomical image (isotropic voxel of 1 mm3, field of view (FOV) = 240 × 240 × 180 mm3 repetition time (TR) = 6.9 ms, echo time (TE) = 3.2 ms) and T2*-weighted functional images (voxel size = 3 × 3 × 3 mm3, no gap, FOV = 240 × 240 × 117 mm3, TR = 2 s TE = 30 ms, flip angle = 90, 180 volumes).
Data were preprocessed in Matlab (MathWorks, version R2017b). First, the reorientation of the images to the anterior commissure was manually performed in the SPM12 toolbox. Further steps of the preprocessing were performed in the software UF2C (41), which runs in Matlab: (i) functional images were motion corrected by a six-degree-of-freedom rigid body transformation (x, y and z translations and pitch, yaw and roll rotations); (ii) functional images were coregistered to the structural image; (iii) the structural image was segmented into gray matter (GM), white matter (WM) and cerebrospinal fluid (CSF); (iv) functional and structural images were normalized to the MNI template; (v) functional images were spatially smoothed; (vi) the mean WM and CSF signals were regressed out from the functional images; (vii) functional images were temporally filtered to frequencies between 0.08 and 0.1; and (viii) motion parameters estimated in (i) were used as an image quality estimator. Subjects that had exceeded a 0.5 mm (of motion) threshold in more than 70 volumes were excluded.
The original dataset was composed of two groups of seven subjects. Four subjects (two from each group) were excluded due to excessive movement during fMRI, resulting in five subjects per group (Table 1). To perform the group analyses, images from subjects who had lesions in the left hemisphere were flipped so that all lesions would be on the same side (right hemisphere).
2.5.1. Parcellation of the brain
Regions of interest (ROIs) were derived from the MIST functional atlas (42) containing 122 brain divisions already categorized into networks. We split ROIs into left and right hemispheres and created larger ROIs (by combining smaller ones) to have a more general representation of each network. We ended up with a total of 16 ROIs divided into the following five networks: somatomotor, frontoparietal, cerebellum, and basal ganglia & thalamus. These ROIs are summarized in Supplementary Table S2, while the original ROIs and their combination to give rise to these 16 are shown in Supplementary Table S1.
Time series extraction was conducted as follows: each ROI had its mask applied to the functional image. Null time series, relative to borders or voids, and time series whose correlation coefficient to the mean were smaller than two standard deviations were excluded. Finally, the mean was computed again with the remaining time series.
A 16 × 16 adjacency matrix was built for each subject using the Pearson correlation values of each pair of ROIs.
2.6. MRI data analysis
2.6.1. Functional connectivity analysis
2.6.1.1. Weighted difference matrices
In this analysis, we sought the pairs of regions with the highest connectivity difference between the pre- and post-MRI. To this end, the negative correlations were excluded from the weighted adjacency matrix (wAM) of every subject and, for each subject, the difference matrix (wdM) of the positive correlations between the timepoints was computed, through the subtraction of pre from post wAM:
A t-test was applied to each wdM, generating t-value difference matrices (t_wdM). The t-values were calculated as follows:
where was the value of the correlation difference in each connection.
The resultant group weighted difference matrix (gwdM) was obtained through the median of the t_wdM matrices from the group’s subjects:
where is the number of subjects.
The p-values were calculated for the gwdM matrix and filtered for significance ( ). The Holm-Bonferroni correction for multiple comparisons was applied to the uncorrected significant data leading to no significant results. Therefore, we present here for discussion the uncorrected results with a confidence interval of 99%. The gwdM of each group was plotted as a heatmap. For the matrices’ elements above the diagonal, only significant values were plotted.
2.6.1.2. Changes in network topology
Out of all the established graph metrics, we used the strength (S) and the clustering coefficient (CC) to measure changes on the network topology (43).
To mathematically describe the measures, we must consider some definitions. In a weighted network formed by the set of nodes, the indices and represent different nodes contained in ; assumes the value 1 (one) if the nodes and are connected or 0 (zero) otherwise; is the weight of this connection, it is a value in the interval ; and is the number of connections the node has.
S is the most basic measure in a weighted network. It represents the sum of the weights from the connections that a node has:
CC measures how much the neighborhood of a node is connected to itself. It is quantified by the number of triangles formed by the nodes directly connected to the node of interest. A densely connected network region is associated with specialized local information processing. The expression for CC is:
Relative differences in network parameters, from the first to the last scans, were computed for S and CC. For these computations, only the positive correlations in the wAM were considered. The group result for each study was obtained through the median of the subjects’ relative differences. Considering the generic parameter P, the relative difference (or relative mean variation, RMV) was computed as follows:
3. Results
3.1. Clinical evaluations
The results of the clinical evaluations performed with FMA, BBS, TUG and MoCA for both groups are shown in Table 2. This table shows the individual scores as well as the mean and standard deviation for before and after the intervention, and the RMV [Eq. (6), in percentage].
3.2. Weighted difference matrices
Connectivity difference matrices (gwdM) for the experimental and control groups are shown in Figures 3, 4, respectively. Supplementary Table S3 lists the connections that presented significant differences.
Figure 3. Weighted difference matrix for the experimental group. The lower triangular matrix shows the median t-values of the differences between each pair of ROIs after rehabilitation with GestureCollection. The symmetric upper triangle shows only the significant differences (p < 0.01). The t-values are encoded in the range (−4, 4) in the colorbar.
Figure 4. Weighted difference matrix for the control group. The lower triangular matrix shows the median t-values of the differences between each pair of ROIs after rehabilitation with GestureCollection. The symmetric upper triangle shows only the significant differences (p < 0.01). The t-values are encoded in the range (−4, 4) in the colorbar.
3.2.1. Experimental group
In the experimental group, there were seven significant connections with positive differences and four with negative differences (Figure 3; Supplementary Table S3). Two of the increased connections were in the left (contralesional) hemisphere, three were interhemispheric and two were in the right (ipsilesional) hemisphere; the four decreased connections were two in the right hemisphere, one in the left hemisphere and one was interhemispheric.
3.2.1.1. Frontoparietal network
All positive differences involved the frontoparietal network. In the left (contralesional) hemisphere, the correlations between the left frontoparietal executive (LFPe) region and the left nucleus accumbens (LNAC) and between the left frontoparietal task control (LFPtc) and the left associative cerebellum (LaCER) increased from the beginning to the end of the treatment. On the right side, the positive differences occurred in the connections between the right frontoparietal task control region (RFPtc) and the right frontoparietal executive region (RFPe) with the right somatomotor network (RMN). Finally, the increased interhemispheric connections were between the RFPe and the left somatomotor network (LMN) and between the LFPtc and the right associative cerebellum (RaCER) and right striatum (RSTR).
3.2.1.2. Basal Ganglia & Thalamus
Both ipsilesional decreased connections involved the right dorsal striatum (RSTR), in one case with the right thalamus (RTHA) and in another with the right motor cerebellum (RmCER). The interhemispheric decreased connection involved the RTHA and the left dorsal striatum (LSTR). In the contralesional hemisphere, the decreased connection was between the LMN and the left thalamus (LTHA).
3.2.2. Control group
Four increased and five decreased connections were found in the control group difference matrix (Figure 4; Supplementary Table S3). Two positive and one negative differences occurred in the ipsilesional hemisphere, one positive difference was in the contralesional hemisphere, and one positive and four negative differences were interhemispheric.
3.2.2.1. Frontoparietal network
One connection presented a positive difference and three showed negative differences in the frontoparietal network. The positive difference was in the interhemispheric connection LFPe-RmCER. The negative differences were between the right and left frontoparietal network, RFPtc-LFPe and RFPtc-LFPtc, and in the ipsilesional intra-network connection RFPtc-RFPe.
3.2.2.2. Somatomotor network
Three positive differences occurred in the somatomotor network, two in the ipsilesional and one in the contralesional hemisphere. On the right side, the RMN had positive differences with the RTHA and the RmCER; while on the left side, the LMN had an increase in its connection with the LTHA.
3.2.2.3. Basal Ganglia & Thalamus
As mentioned, the thalamus had increased connections with the somatomotor networks at both hemispheres (RTHA-RMN and LTHA-LMN). However, a negative difference occurred in the interhemispheric connection between both thalami, RTHA-LTHA.
3.2.2.4. Cerebellum
The RmCER had two (already cited) positive differences: in the ipsilesional connection RmCER-RMN and in the interhemispheric connection RmCER-LFPe. A negative difference occurred in the interhemispheric connection between the right and left motor cerebellum (LmCER), RmCER-LmCER.
3.3. Changes in network topology
Relative changes (RMV) in CC and S [according to Eq. (6) in Section 2.6.1] can be seen as heatmaps plotted on a brain surface (in Figure 5 for the experimental group and in Figure 6 for the control group) and as tabular data (Table 3), where the results were grouped, according to their value, in the ranges: (−0.75, −0.5], (−0.5, −0.25], [0.25, 0.5), [0.5, 0.75) and [0.75, +∞).
Figure 5. Relative changes [RMV, Eq. (6)] in graph parameters for the experimental group. The intensity of the changes can be seen encoded in the colorbar in the range (−1.5, 1.5). From top to bottom: CC and S. Left to right: left lateral view, left medial view, right lateral view and right medial view.
Figure 6. Relative changes [RMV, Eq. (6)] in graph parameters for the control group. The intensity of the changes can be seen encoded in the colorbar in the range (−1.5, 1.5). From top to bottom: CC and S. Left to right: left lateral view, left medial view, right lateral view and right medial view.
Table 3. Relative changes [RMV, Eq. (6)] in graph parameters for the experimental and control groups.
3.3.1. Experimental group
The experimental group had more increases than decreases in all metrics, with the greatest increases being in the strength parameter. The following regions had increases in the range (50, 75%): RFPtc, in CC; and LFPtc, LNAC and the right nucleus accumbens (RNAC), in S. Smaller increases, in the range (25, 50%), were found in LFPe, LMN, RFPe, RMN and RmCER, in CC; and LFPe, RFPe, RFPtc and RMN, in S. Decreases in the range (−25, −50%) can be seen in: LTHA and RaCER, in CC; LmCER and RmCER, in S.
3.3.2. Control group
The control group had more decreases than increases in the graph metrics, with only two regions where the parameters increased (within the analyzed ranges). Regions with increases in the range (25, 50%) were: RmCER, in CC; and RMN, in S. Regions with decreases in the range (−25, −50%) were: LMN, LTHA, LaCER, RMN, RSTR and RTHA, in CC. Besides, LTHA had a decrease in the range (−50, −75%) in S.
4. Discussion
Clinical scales were used to assess physical and cognitive improvements in the subjects submitted to rehabilitation: FMA, BBS, TUG and MoCA. The improvement in FMA, BBS and MoCA is associated with an increase in these scales, while for TUG improvement is related to a decrease in the corresponding value. The RMV [Eq. (6)] of FMA, BBS and MoCA were larger in the experimental group than in the control group, while the RMV of TUG was smaller for the former group than for the latter (Table 2). However, if we look at the individual subjects, we see that, in general, the control group had more homogeneous values for the scales than the experimental group. Particularly for the TUG scale, we see that S6 in the experimental group dominated the RMV, since he/she had a huge decrease in time, but most other subjects in this group increased their times while only one subject (S9) had a very small decrease. Conversely, in the control group most subjects decreased their time, although in a very discreet fashion, while only one subject (S2) remained with the same time. Nevertheless, most subjects in both groups (with exception of S10 in the control group), improved their total FMA punctuation. Regarding BBS and TUG, 3/5 subjects in both groups increased their punctuation. Therefore, considering all the clinical scales together, subjects showed improvement in their clinical conditions in both groups.
The analysis of group connection changes resulted in more connection increases than decreases for the experimental group (7 vs. 4 for the experimental group), while for the control group, there were fewer connection increases than decreases (4 vs. 5).
Looking more closely at the increased connections (Figures 3, 4; Supplementary Table S3), we see that the experimental group had increases mainly in connections involving the frontoparietal network, the basal ganglia and the cerebellum. Meanwhile, the control group had one increased connection among frontoparietal and cerebellar regions and presented increased connections in the motor network and thalamus. The frontoparietal network is mainly responsible for executive function and attention control (44). Therefore, in this case, we can conjecture that, for stroke subjects, VR training increases attention demand for control of the VR applications. The basal ganglia regulate voluntary movements (45); they are responsible for the inhibition of some motor systems to allow the selection of a given motor action (46, 47). This may imply that VR training calls for more specific actions than conventional training. The cerebellum is responsible for movement coordination and finetuning, motor learning (48) and cognitive functions (49). Thus, increasing connections involving these regions might be associated with improving motor coordination in both VR and conventional training patients. Finally, the thalamus relays signals coming from the basal ganglia and cerebellum to the motor cortex (50). The thalamus is essential in the triggering/initiation of planned movements, where it is activated by a go-cue (51, 52). The increases in thalamus connectivity with the motor cortex, in the control group, can be related to this fact, since in conventional physiotherapy the movement is usually initiated after the command of a second person (the physiotherapist).
Regarding the topology of the networks, both groups presented changes in all analyzed parameters (CC and S) (Table 3). The experimental group had several changes greater than 50%. Conversely, the control group presented one parameter decrease of more than 50%. These changes were for both CC and S in the bilateral nucleus accumbens and frontoparietal task control network for the experimental group and in S in the contralesional thalamus for the control group. Strength (S) measures the sum of the connection weights that reach a given node, and CC measures the amount of local connections around a given node (43). Therefore, we can conjecture that the GestureCollection VR tool had a major influence in increasing and making more efficient the connections related to goal-directed cognition (53, 54) and to reward and reinforcement learning (55). Finally, the control group did not present large increases in any parameter; conversely, it was also the only one to present a large (above 50%) decrease in one graph parameter, namely S in the thalamus. We found no previous results in literature to help justify the decreased connectivity in the thalamus in stroke rehabilitation. Although in Wang et al. (56) the authors also reported decreased connectivity in the thalamus and basal ganglia, they argue that this result can be justified by the subcortical nature of the lesions (common between the subjects in the study).
It is important to highlight that there is a lack of literature on resting state functional connectivity and network changes after motor rehabilitation with VR systems for a direct comparison. Nevertheless, some studies have presented brain activation results in similar areas to the ones found in the present work. Activations in the prefrontal/frontoparietal cortex were found in Orihuela-Espina et al. (26) after VR therapy with stroke patients; in Ossmy et al. (12) after VR therapy in a subject with hemiparkinsonism; and in Ekman et al. (22) after VR training in stroke patients with spatial neglect. Cerebellum recruitment was reported in Orihuela-Espina et al. (26) with stroke patients; and in Maidan et al. (11), with Parkinson’s patients. In more general studies (57), discussed the importance of the correlation between motor-frontoparietal connectivity and motor increased outcomes; and Hordacre et al. (58) showed that improvements in motor performance of stroke patients with corticospinal tract damage are correlated to increased connectivity in the ipsilesional frontoparietal network.
Nevertheless, comparing both treatments underwent by the groups in this study, one main differential of VR rehabilitation is that it is more engaging than conventional treatments. Also, VR allows for the use of several mechanisms to stimulate the user’s brain. The GesturePuzzle application uses false positive feedback, i.e., it amplifies the user movements (in case of need) to aid the user to complete the task, which stimulates reward-based learning mechanisms. In GestureMaps, the user’s body and movements are reproduced in the screen, which can give a sensation of immersiveness and allow action observation, which activates the brain in regions related to motor function. GestureCollection games also stimulated cognition of the participants.
Notwithstanding, the experimental group was composed of younger subjects than those of the control group (mean ages were 56.2 ± 5.6 and 62.4 ± 8.0, respectively). Yoo et al. (59) found that patients with less than 70 years recovered differently from stroke compared to patients over 70 years old - the former group had good functional recovery while the latter had functional decline between 6 to 30 months after stroke. Since our control group had ages closer to this 70-years-old boundary, this might also have influenced the results.
Finally, it is necessary to add that, since we were not able to collect longitudinal data, i.e., to evaluate subjects a few weeks or months after the end of the intervention, we cannot assert that “learning” has effectively occurred, because we do not know if the neuroplasticity changes had a lasting effect. In future studies we intend to perform such a follow up.
The main limitation of this work was the small sample size. This is a recurrent difficulty in this kind of work. More than 50% of the stroke-related studies revised in Feitosa et al. (3) had up to 10 subjects. Besides, some subjects’ data were excluded in the preprocessing step due to excessive movement. Their own health conditions can make it harder for the subjects to stay still during the MRI acquisition.
Another major difficulty was the data’s heterogeneity. With such a small sample, it was not possible to select subjects with more similar lesion locations and clinical conditions, which would be the perfect scenario. Also, the groups were very dissimilar at baseline, with the control group presenting scores close to the maximum on the FMA and BBS scales, and low values at the TUG test, while the experimental group was much more heterogeneous and had worse scores on those scales. This made it difficult to compare the clinical improvement between the two groups. Besides, the subjects with lesions in the left hemisphere had their data flipped with respect to the x-axis, in order to homogenize the lesion side, which can also be an issue, since the brain’s hemispheres are not completely functionally symmetric (60). Other limitations were the size of the screen in which the VR applications were displayed, which was smaller than in laboratory setups (see Figure 1 – laboratory setup – and Figure 2 – experimental setup), the internet connection that wasn’t very good, which in some cases resulted in interruptions in the running of the GestureMaps application. For future studies we are acquiring a larger screen and moving the experimental setup to another location (with better internet).
Finally, in this study only ischemic stroke patients were enrolled, due to this type of stroke being more common and homogeneous. Future studies should also include hemorrhagic stroke patients.
In summary, patients in both experimental (with GestureCollection complementation) and control (without GestureCollection complementation) groups showed improvement in clinical scales after therapy. Despite the difficulty in comparing those clinical outcomes due to the groups’ disparity, in terms of brain changes, we can say that the differences between the groups were unequivocal. VR treatment induced changes in regions that are related to learning, planning and motor execution, while conventional treatment had limited effects in terms of neuroplasticity. There were more increases in functional connectivity in the experimental group than in the control group. The use of the VR system promoted changes mainly in the frontoparietal networks, strengthening the connections between the frontoparietal and motor cortex in the ipsilesional side and interhemisphericaly. The increase in strength in the nucleus accumbens, in both sides, shows how these regions became more important in the network, promoting reward-related motor learning in the subjects that used GestureCollection. Therefore, the use of the GestureCollection system in addition to conventional treatment was successfully shown to promote neuroplasticity in motor-related areas. Nevertheless, the evaluated patient sample was small, and further studies should be conducted to confirm these results. This is the first work of such type performed with stroke patients and the GestureCollection system, and its results may direct the adoption of this low-cost solution in clinics and hospitals across the country.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by Comitê de Ética em Pesquisa da Universidade Estadual de Campinas (Research Ethics Committee of University of Campinas). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
GC, AC, AB, and LL: conceptualization. JF, RC, GC, AC, and LL: methodology. AB: software. JF, RC, and GC: validation and formal analysis. JF, RC, GC, and AC: investigation. GC and LL: resources, project administration, and funding acquisition. AC and AB: data curation. JF: writing – original draft preparation. RC, AB, LL, and GC: writing – review and editing. GC, RC, and LL: supervision. All authors have read and agreed to the published version of the manuscript.
Funding
This research was supported by Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brazil (CAPES) – Finance Code 001, São Paulo Research Foundation – Brazil (FAPESP) – Grant #2013/07559-3 and 2015/03695-5, and Brazilian National Council for Scientific and Technological Development (CNPq) – Grant #304008/2021-4.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fneur.2023.1241639/full#supplementary-material
References
1. World Stroke Organization Annual Report. (2022). Available at: https://www.world-stroke.org/assets/downloads/WSO_Annual_Report_2022_-_online.pdf (Accessed September 27, 2023).
2. Cieza, A, Causey, K, Kamenov, K, and Hanson, SW. Chatterji S and Vos T 2020 global estimates of the need for rehabilitation based on the global burden of disease study 2019: a systematic analysis for the global burden of disease study. Lancet. (2019) 396:2006–17. doi: 10.1016/S0140-6736(20)32340-0
3. Feitosa, JA, Fernandes, CA, Casseb, RF, and Castellano, G. Effects of virtual reality-based motor rehabilitation: a systematic review of fMRI studies. J Neural Eng. (2022) 19:11002. doi: 10.1088/1741-2552/ac456e
4. Asadzadeh, A, Samad-Soltani, T, Salahzadeh, Z, and Rezaei-Hachesu, P. Effectiveness of virtual reality-based exercise therapy in rehabilitation: a scoping review. Informat Med Unlocked. (2021) 24:100562. doi: 10.1016/j.imu.2021.100562
5. Weiss, PL, Kizony, R, Feintuch, U, and Katz, N. Virtual reality in neurorehabilitation In: M Selzer, S Clarke, L Cohen, P Duncan, and F Gage, editors. Textbook of neural repair and rehabilitation. Cambridge: Cambridge University Press (2010). 182–97.
6. Cameirão, MS, Badia, SBI, Duarte, E, Frisoli, A, and Verschure, PFMJ. The combined impact of virtual reality neurorehabilitation and its interfaces on upper extremity functional recovery in patients with chronic stroke. Stroke. (2012) 43:2720–8. doi: 10.1161/STROKEAHA.112.653196
7. Malekshahi, R, Seth, A, Papanikolaou, A, Mathews, Z, Birbaumer, N, Verschure, PFMJ, et al. Differential neural mechanisms for early and late prediction error detection. Sci Rep. (2016) 6:24350. doi: 10.1038/srep24350
8. Kiper, P, Szczudlik, A, Agostini, M, Opara, J, Nowobilski, R, Ventura, L, et al. Virtual reality for upper limb rehabilitation in subacute and chronic stroke: a randomized controlled trial. Arch Phys Med Rehabil. (2018) 99:834–842.e4. doi: 10.1016/j.apmr.2018.01.023
9. Silva de Sousa, JC, Torriani-Pasin, C, Tosi, AB, Fecchio, RY, and Costa, LAR. Aerobic stimulus induced by virtual reality games in stroke survivors. Arch Phys Med Rehabil. (2018) 99:927–33. doi: 10.1016/j.apmr.2018.01.014 Forjaz C L De M
10. Ravi, DK, Kumar, N, and Singhi, P. Effectiveness of virtual reality rehabilitation for children and adolescents with cerebral palsy: an updated evidence-based systematic review. Physiotherapy. (2017) 103:245–58. doi: 10.1016/j.physio.2016.08.004
11. Maidan, I, Rosenberg-Katz, K, Jacob, Y, Giladi, N, Hausdorff, JM, and Mirelman, A. Disparate effects of training on brain activation in Parkinson disease. Neurology. (2017) 89:1804–10. doi: 10.1212/WNL.0000000000004576
12. Ossmy, O, Mansano, L, Frenkel-Toledo, S, Kagan, E, Koren, S, Gilron, R, et al. Motor learning in hemi-Parkinson using VR-manipulated sensory feedback. Disabil Rehabil Assist Technol. (2020) 17:349–61. doi: 10.1080/17483107.2020.1785561
13. Høeg, ER, Povlsen, TM, Bruun-Pedersen, JR, Lange, B, Nilsson, NC, Haugaard, KB, et al. System immersion in virtual reality-based rehabilitation of motor function in older adults: a systematic review and meta-analysis. Front Virtual Real. (2021) 2:647993. doi: 10.3389/frvir.2021.647993
14. Brandão, AF, Roberto, D, Dias, C, Guimarães, MP, Trevelin, C, Parizotto, NA, et al. GestureCollection for motor and cognitive stimuli: virtual reality and e- health prospects. J Health Informat. (2018) 10:9–16.
15. Li, Y, Huang, J, Tian, F, Wang, H, and Dai, G. Gesture interaction in virtual reality. Virt Real Intellig Hardw. (2019) 1:84–112. doi: 10.3724/SP.J.2096-5796.2018.0006
16. Farahani, FV, Karwowski, W, and Lighthall, NR. Application of graph theory for identifying connectivity patterns in human brain networks: a systematic review. Front Neurosci. (2019) 13:585. doi: 10.3389/fnins.2019.00585
17. Bandettini, PA, Wong, EC, Hinks, RS, Tikofsky, RS, and Hyde, JS. Time course EPI of human brain function during task activation. Magn Reson Med. (1992) 25:390–7. doi: 10.1002/mrm.1910250220
18. Biswal, BB. Resting state fMRI: a personal history. NeuroImage. (2012) 62:938–44. doi: 10.1016/j.neuroimage.2012.01.090
19. Petersen, SE, and Sporns, O. Brain networks and cognitive architectures. Neuron. (2015) 88:207–19. doi: 10.1016/j.neuron.2015.09.027
20. Yu, S, Huang, D, Singer, W, and Nikolić, D. A small world of neuronal synchrony. Cereb Cortex. (2008) 18:2891–901. doi: 10.1093/cercor/bhn047
21. de Assis, GA, Brandao, AF, Grasielle, ACD, and Castellano, G. Evaluation of a protocol for fMRI assessment associated with augmented reality rehabilitation of stroke subjects. J Interact Sys. (2019) 10:35–42. doi: 10.5753/jis.2019.717
22. Ekman, U, Fordell, H, Eriksson, J, Lenfeldt, N, Wåhlin, A, Eklund, A, et al. Increase of frontal neuronal activity in chronic neglect after training in virtual reality. Acta Neurol Scand. (2018) 138:284–92. doi: 10.1111/ane.12955
23. Feitosa, J A, Stefano Filho, C A, Casseb, R F, Camargo, A, Martins, B S G, Ballester, B R, et al. Complex network changes during a virtual reality rehabilitation protocol following stroke: a case study. 2019 9th international IEEE/EMBS conference on neural engineering (NER). San Francisco, CA, USA: IEEE. (2019) 891–894.
24. Jang, SH, You, SH, Hallett, M, Yun, WC, Park, C-MM, Cho, S-HH, et al. Cortical reorganization and associated functional motor recovery after virtual reality in patients with chronic stroke: an experimenter-blind. Arch Phys Med Rehabil. (2005) 86:2218–23. doi: 10.1016/j.apmr.2005.04.015
25. Mekbib, DB, Debeli, DK, Zhang, L, Fang, S, Shao, Y, Yang, W, et al. A novel fully immersive virtual reality environment for upper extremity rehabilitation in patients with stroke. Ann N Y Acad Sci. (2021) 1493:75–89. doi: 10.1111/nyas.14554
26. Orihuela-Espina, F, Fernández del Castillo, I, Palafox, L, Pasaye, E, Sánchez-Villavicencio, I, Leder, R, et al. Neural reorganization accompanying upper limb motor rehabilitation from stroke with virtual reality-based gesture therapy. Top Stroke Rehabil. (2013) 20:197–209. doi: 10.1310/tsr2003-197
27. Saleh, S, Adamovich, SV, and Tunik, E. Resting state functional connectivity and task-related effective connectivity changes after upper extremity rehabilitation: a pilot study. Annu Int Conf IEEE Eng Med Biol Soc. (2012) 2012:4559–62. doi: 10.1109/EMBC.2012.6346981
28. Saleh, S, Fluet, G, Qiu, Q, Merians, A, Adamovich, SV, and Tunik, E. Neural patterns of reorganization after intensive robot-assisted virtual reality therapy and repetitive task practice in patients with chronic stroke. Front Neurol. (2017) 8:1–10. doi: 10.3389/fneur.2017.00452
29. Schuster-Amft, C, Henneke, A, Hartog-Keisker, B, Holper, L, Siekierka, E, Chevrier, E, et al. Intensive virtual reality-based training for upper limb motor function in chronic stroke: a feasibility study using a single case experimental design and fMRI. Disabil Rehabil Assist Technol. (2015) 10:385–92. doi: 10.3109/17483107.2014.908963
30. Takahashi, CD, Der-Yeghiaian, L, Le, V, Motiwala, RR, and Cramer, SC. Robot-based hand motor therapy after stroke. Brain. (2008) 131:425–37. doi: 10.1093/brain/awm311
31. Turolla, A, Daud Albasini, OA, Oboe, R, Agostini, M, Tonin, P, Paolucci, S, et al. Haptic-based neurorehabilitation in poststroke patients: a feasibility prospective multicentre trial for robotics hand rehabilitation. Comput Math. Methods Med. (2013) 2013:1–12. doi: 10.1155/2013/895492
32. Vourvopoulos, A, Jorge, C, Abreu, R, Figueiredo, P, Fernandes, JC, and Badia, SBI. Efficacy and brain imaging correlates of an immersive motor imagery BCI-driven VR system for upper limb motor rehabilitation: a clinical case report. Front Hum Neurosci. (2019) 13:244. doi: 10.3389/fnhum.2019.00244
33. Wang, Z, Wang, P, Xing, L, Mei, L, Zhao, J, and Zhang, T. Leap motion-based virtual reality training for improving motor functional recovery of upper limbs and neural reorganization in subacute stroke patients. Neural Regen Res. (2017) 12:1823. doi: 10.4103/1673-5374.219043
34. Xiao, X, Lin, Q, Lo, WL, Mao, YR, Shi, XC, Cates, RS, et al. Cerebral reorganization in subacute stroke survivors after virtual reality-based training: a preliminary study. Behav Neurol. (2017) 2017:1–8. doi: 10.1155/2017/6261479
35. You, SH, Jang, SH, Kim, YH, Hallett, M, Ahn, SH, Kwon, YH, et al. Virtual reality-induced cortical reorganization and associated locomotor recovery in chronic stroke: an experimenter-blind randomized study. Stroke. (2005) 36:1166–71. doi: 10.1161/01.STR.0000162715.43417.91
36. Johnson, NN, Carey, J, Edelman, BJ, Doud, A, Grande, A, Lakshminarayan, K, et al. Combined rTMS and virtual reality brain-computer interface training for motor recovery after stroke. J Neural Eng. (2018) 15:016009–24. doi: 10.1088/1741-2552/aa8ce3
37. Gladstone, DJ, Danells, CJ, and Black, SE. The Fugl-Meyer assessment of motor recovery after stroke: a critical review of its measurement properties. Neurorehabil Neural Repair. (2002) 16:232–40. doi: 10.1177/154596802401105171
38. Blum, L, and Korner-Bitensky, N. Usefulness of the Berg Balance Scale in stroke rehabilitation: a systematic review. Phys Ther. (2008) 88:559–66. doi: 10.2522/ptj.20070205
39. Persson, CU, Danielsson, A, Sunnerhagen, KS, Grimby-Ekman, A, and Hansson, PO. Timed Up & Go as a measure for longitudinal change in mobility after stroke – Postural Stroke Study in Gothenburg (POSTGOT). J Neuroeng Rehabil. (2014) 11:83–7. doi: 10.1186/1743-0003-11-83
40. Gierus, J, Mosiołek, A, Koweszko, T, Wnukiewicz, P, Kozyra, O, and Szulc, A. The Montreal Cognitive Assessment as a preliminary assessment tool in general psychiatry. Validity of MoCA in psychiatric patients. Gen Hosp Psychiatry. (2015) 37:476–80. doi: 10.1016/j.genhosppsych.2015.05.011
41. de Campos, BM, Casseb, RF, and Cendes, F. UF2C — user-friendly functional connectivity: a neuroimaging toolbox for fMRI processing and analyses. SoftwareX. (2020) 11:100434. doi: 10.1016/j.softx.2020.100434
42. Urchs, S, Armoza, J, Moreau, C, Benhajali, Y, St-Aubin, J, Orban, P, et al. MIST: a multi-resolution parcellation of functional brain networks. MNI Open Res. (2019) 1:3. doi: 10.12688/mniopenres.12767.2
43. Rubinov, M, and Sporns, O. Complex network measures of brain connectivity: uses and interpretations. NeuroImage. (2010) 52:1059–69. doi: 10.1016/j.neuroimage.2009.10.003
44. Yao, ZF, Yang, MH, Hwang, K, and Hsieh, S. Frontoparietal structural properties mediate adult life span differences in executive function. Sci Rep. (2020) 10:1–14. doi: 10.1038/s41598-020-66083-w
45. Lanciego, JL, Luquin, N, and Obeso, JA. Functional neuroanatomy of the basal ganglia. Cold Spring Harb Perspect Med. (2012) 2:1–20. doi: 10.1101/cshperspect.a009621
46. Redgrave, P, Prescott, TJ, and Gurney, K. The basal ganglia: a vertebrate solution to the selection problem? Neuroscience. (1999) 89:1009–23. doi: 10.1016/S0306-4522(98)00319-4
47. Turner, RS, and Desmurget, M. Basal ganglia contributions to motor control: a vigorous tutor. Curr Opin Neurobiol. (2010) 20:704–16. doi: 10.1016/j.conb.2010.08.022
48. Manto, M, Bower, JM, Conforto, AB, Delgado-García, JM, da Guarda, SNF, Gerwig, M, et al. Cerebellar function and cognition. PMC. (2015) 11:457–87. doi: 10.1007/s12311-011-0331-9
49. Koziol, LF, Budding, D, Andreasen, N, D’Arrigo, S, Bulgheroni, S, Imamizu, H, et al. Consensus paper: the cerebellum’s role in movement and cognition. Cerebellum. (2014) 13:151–77. doi: 10.1007/s12311-013-0511-x
50. Kosif, R. The thalamus: a review of its functional anatomy. Med Res Arch. (2016) 4:1–9. doi: 10.18103/mra.v4i8.740
51. Inagaki, HK, Chen, S, Ridder, MC, Sah, P, Li, N, Yang, Z, et al. A midbrain-thalamus-cortex circuit reorganizes cortical dynamics to initiate movement. Cells. (2022) 185:1065–1081.e23. doi: 10.1016/j.cell.2022.02.006
52. Nashef, A, Mitelman, R, Harel, R, Joshua, M, and Prut, Y. Area-specific thalamocortical synchronization underlies the transition from motor planning to execution. Proc Natl. Acad. Sci. U. S. A. (2021) 118:118. doi: 10.1073/pnas.2012658118
53. Waskom, ML, Kumaran, D, Gordon, AM, Rissman, J, and Wagner, AD. Frontoparietal representations of task context support the flexible control of goal-directed cognition. J Neurosci. (2014) 34:10743–55. doi: 10.1523/JNEUROSCI.5282-13.2014
54. Hausman, HK, Hardcastle, C, Albizu, A, Kraft, JN, Evangelista, ND, Boutzoukas, EM, et al. Cingulo-opercular and frontoparietal control network connectivity and executive functioning in older adults. GeroScience. (2022) 44:847–66. doi: 10.1007/s11357-021-00503-1
55. Olsen, CM. Natural rewards, neuroplasticity, and non-drug addictions. Neuropharmacology. (2011) 61:1109–22. doi: 10.1016/j.neuropharm.2011.03.010
56. Wang, L, Yu, C, Chen, H, Qin, W, He, Y, Fan, F, et al. Dynamic functional reorganization of the motor execution network after stroke. Brain. (2010) 133:1224–38. doi: 10.1093/brain/awq043
57. Lam, TK, Dawson, DR, Honjo, K, Ross, B, Binns, MA, Stuss, DT, et al. Neural coupling between contralesional motor and frontoparietal networks correlates with motor ability in individuals with chronic stroke. J Neurol Sci. (2018) 384:21–9. doi: 10.1016/j.jns.2017.11.007
58. Hordacre, B, Lotze, M, Jenkinson, M, Lazari, A, Barras, CD, Boyd, L, et al. Fronto-parietal involvement in chronic stroke motor performance when corticospinal tract integrity is compromised. NeuroImage Clin. (2021) 29:102558. doi: 10.1016/j.nicl.2021.102558
59. Yoo, JW, Hong, BY, Jo, L, Kim, J-S, Park, JG, Shin, BK, et al. Effects of age on long-term functional recovery in patients with stroke. Medicina. (2020) 56:451. doi: 10.3390/medicina56090451
Keywords: stroke, functional connectivity, graph theory, virtual reality, neuroplasticity
Citation: Feitosa JA, Casseb RF, Camargo A, Brandao AF, Li LM and Castellano G (2023) Graph analysis of cortical reorganization after virtual reality-based rehabilitation following stroke: a pilot randomized study. Front. Neurol. 14:1241639. doi: 10.3389/fneur.2023.1241639
Edited by:
Wen-Jun Tu, Chinese Academy of Medical Sciences and Peking Union Medical College, ChinaReviewed by:
Debasish Nath, Indian Institute of Technology Delhi, IndiaBirgitta Langhammer, Oslo Metropolitan University, Norway
Copyright © 2023 Feitosa, Casseb, Camargo, Brandao, Li and Castellano. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Gabriela Castellano, gabriela@ifi.unicamp.br