Olive Lennon1*
Michele Tonellato2
Alessandra Del Felice3,4
Roberto Di Marco3
Caitriona Fingleton5
Attila Korik6
Eleonora Guanziroli7Franco Molteni7
Christoph Guger8
Rupert Otner8
Damien Coyle6- 1School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
- 2Department of Neuroscience, Rehabilitation Unit, University of Padova, Padova, Italy
- 3Department of Neuroscience, NEUROMOVE-Rehab Laboratory, University of Padova, Padova, Italy
- 4Padova Neuroscience Center, University of Padova, Padova, Italy
- 5Department of Physiotherapy, Mater Misericordiae University Hospital, Dublin, Ireland
- 6Intelligent Systems Research Centre, School of Computing, Engineering and Intelligent Systems, Ulster University, Derry, United Kingdom
- 7Villa Beretta Rehabilitation Center, Valduce Hospital, Costa Masnaga, Italy
- 8g.tec Medical Engineering GmbH, Schiedlberg, Austria
Background: Stroke is a disease with a high associated disability burden. Robotic-assisted gait training offers an opportunity for the practice intensity levels associated with good functional walking outcomes in this population. Neural interfacing technology, electroencephalography (EEG), or electromyography (EMG) can offer new strategies for robotic gait re-education after a stroke by promoting more active engagement in movement intent and/or neurophysiological feedback.
Objectives: This study identifies the current state-of-the-art and the limitations in direct neural interfacing with robotic gait devices in stroke rehabilitation.
Methods: A pre-registered systematic review was conducted using standardized search operators that included the presence of stroke and robotic gait training and neural biosignals (EMG and/or EEG) and was not limited by study type.
Results: From a total of 8,899 papers identified, 13 articles were considered for the final selection. Only five of the 13 studies received a strong or moderate quality rating as a clinical study. Three studies recorded EEG activity during robotic gait, two of which used EEG for BCI purposes. While demonstrating utility for decoding kinematic and EMG-related gait data, no EEG study has been identified to close the loop between robot and human. Twelve of the studies recorded EMG activity during or after robotic walking, primarily as an outcome measure. One study used multisource information fusion from EMG, joint angle, and force to modify robotic commands in real time, with higher error rates observed during active movement. A novel study identified used EMG data during robotic gait to derive the optimal, individualized robot-driven step trajectory.
Conclusions: Wide heterogeneity in the reporting and the purpose of neurobiosignal use during robotic gait training after a stroke exists. Neural interfacing with robotic gait after a stroke demonstrates promise as a future field of study. However, as a nascent area, direct neural interfacing with robotic gait after a stroke would benefit from a more standardized protocol for biosignal collection and processing and for robotic deployment. Appropriate reporting for clinical studies of this nature is also required with respect to the study type and the participants' characteristics.
Introduction
Stroke, a disease with substantial personal and societal consequences, remains the leading cause of acquired disability worldwide. With 13.7 million new cases each year, the associated economic costs of treatment and post-stroke care are significant (Wilkins et al., 2017; Johnson et al., 2019). At 3 months after a stroke, 20% of people remain wheelchair dependent and ~70% walk with a reduced capacity (Mehrholz et al., 2017). Task-specific training is critical for recovery, and the intensity of practice is strongly associated with improved functional gait outcomes (Kwakkel et al., 2004; Veerbeek et al., 2014).
Providing high intensity restorative exercises for a larger share of the stroke population is part of the Action Plan for Stroke in Europe 2018–2030 (Norrving et al., 2018), yet the delivery of an adequate dosage of gait training for physically dependent patients is challenging in the rehabilitation sector, from manual handling and human resource perspectives. Robotic gait devices, which enable people to walk with electromechanical assistance to achieve a healthy gait trajectory, can potentially overcome some of these practical difficulties (Mehrholz et al., 2017; Cervera et al., 2018) and allow an intensive, high repetition of the gait cycle with reduced therapist involvement (as they no longer need to set the paretic limbs or assist trunk movements) (Sarasola-Sanz et al., 2017). The addition of robotic-assisted gait training (RAGT) to usual rehabilitation has been shown by a systematic review to improve the likelihood of regaining independent walking after a stroke [odds ratio 1.94, 95% confidence interval (CI), 1.39 to 2.71], with a subgroup analysis suggesting that people in the acute phase and non-ambulatory individuals benefit most from the intervention (Mehrholz et al., 2017). Of note is that the improvements in walking velocity and walking capacity did not match the observed improvements in independence in gait.
At present, RAGT alone has not been shown to be superior to equally dosed routine rehabilitation despite the increased intensity of stepping in RAGT (Taveggia et al., 2016; Bruni et al., 2018). When motor function is considered specifically as an outcome, the upper limb robotic devices have proven efficacy in contrast to the lower limb robotic training, where no treatment effect for motor function has been demonstrated (Lin et al., 2019). Current RAGT therapies have focused on providing high-intensity training and repetition but not on patient engagement, motivation, and reward, which are important factors for inducing cortical plasticity (Hogan et al., 2006; Goodman et al., 2014). Limitations in randomized controlled trials (RCTs) in this area to date have been identified (Molteni et al., 2018) and many RAGT protocols were criticized for allowing the trainee to be too passive, with lower metabolic costs, muscle activations, and subject effort reported in comparison to therapist-assisted treadmill training (Cai et al., 2006; Israel et al., 2006; Krishnan et al., 2013). However, rehabilitative robotics, when deployed correctly, have the ability to generate bottom up and top down complex and controlled multisensory stimulation to modify the plasticity of neural connections through the experience of movement (Molteni et al., 2018).
Direct human machine interfaces (HMIs) can translate electrical, magnetic, or metabolic activity at the brain or the muscle level into control signals for external devices (e.g., computers or neuroprosthetic and robotic devices) to replace, restore, or enhance the natural neural output (Wolpaw, 2012; Soekadar et al., 2015). Brain interfacing technology, primarily electroencephalography (EEG)-based brain computer interfaces (BCI,) can offer new strategies for robotic gait re-education after a stroke that can promote more active engagement in movement intent and/or by neurophysiological feedback. In stroke, BCI exploitation has mainly used motor imagery to drive brain activity levels (with no overt motor output) in combination with visual, auditory, or haptic feedback or to control an external device which executes the movement and provides proprioceptive feedback (Prasad et al., 2010; Van Dokkum et al., 2015). Of the nine upper limb studies identified in a recent systematic review of BCI for motor rehabilitation after a stroke, only three used BCI to control a robotic or orthotic device with large to moderate effect sizes noted for improved motor impairment (Cervera et al., 2018) and emerging evidence in upper limb rehabilitation now points to the superiority of BCI robotic training after a stroke to robotic training alone in motor recovery (Varkuti et al., 2013; Ang et al., 2014). No lower limb robotic RCT studies using BCI were reported in this review (Cervera et al., 2018).
Motor intent can also be determined non-invasively by electromyography (EMG) activity and responded to in triggered motion (Hussein et al., 2009) and thus has potential to enhance RAGT. EMG-based robotic movement has emerged as a well-developed field in upper limb rehabilitation in stroke (Ho et al., 2011; Vaca Benitez et al., 2013; Hu et al., 2015), and when used in robot-assisted rehabilitation has achieved a significantly higher completion rate compared to torque control for the participants with severe to moderate impairment in the upper limb (Paredes et al., 2015). EMG has also been combined with EEG in human–machine interactive force to improve the recognition of movement intent (Mrachacz-Kersting et al., 2012; Jiang et al., 2014; Bhagat et al., 2016).
As reported in a 2018 review of human intent-based control in motor rehabilitation after a stroke, most studies are in the laboratory stage (Li et al., 2018), and a systematic review of RCTs of BCI interfaces after a stroke identified no RAGT studies (Cervera et al., 2018). Therefore, the aim of this systematic review was to establish the current state-of-the-art in EMG and/or EEG neural biosignal deployment during robotic gait training post-stroke as described in the literature (with no limitation by study design applied). Contributing to this review is a panel of relevant stakeholders from the fields of rehabilitation, neurology, biomedical engineering, and BCI engineering who, in providing a summary of available data, comment and make important recommendations to standardize reporting and advance this important and emerging area in robotic-assisted gait rehabilitation in stroke.
The primary question that this review asks is:
what is the current state-of-the-art in neural–exoskeleton interface (non-invasive EEG and/or EMG) during robotic gait training after a stroke?
The secondary review questions asked are the following:
1. What is the profile of the stroke patients in the included studies?
2. What robotic gait devices are deployed?
3. What biosignals are measured in conjunction with the robotic gait devices and what devices (hardware and/or software) are used to capture these biosignals?
4. What protocols are used for recording and processing these biosignals?
5. For what purpose is the acquired biosignal data collected?
As a nascent area, the inclusive approach to study type was taken in this review to allow a true reflection of bioengineering translational research in gait rehabilitation robotics in a clinical population. A compendium of current data collection and signal processing procedures will be developed to allow recommendations for the standardization of future research in this field.
The systematic review was pre-registered with PROSPERO (PROSPERO 2018 CRD42018112252) (Heilinger et al., 2018).
Methods
Definitions
Prior to conducting the review, several operational definitions were defined by the research team which included an experienced information science researcher and experts in rehabilitation, BCI, and medical engineering. The methodology was based on the Cochrane handbook for systematic reviews of interventions and the PRISMA statement (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) (Higgins and Green, 2011) and used the PICOS acronym to guide the search strategy development. In line with best practice, screening for inclusion at the abstract and the manuscript stages and during data extraction of the included studies was conducted independently by two researchers. Where disagreements arose, they were discussed among the reviewers first and then with an independent third party until a consensus was achieved.
The inclusion criteria for the review population were adults (>18 years) with confirmed diagnosis of stroke and at any stage of stroke recovery. No limitation by stroke etiology, first or recurrent event, or symptom presentation were applied. Adults with other known neurological diseases (e.g., spinal cord injury and multiple sclerosis) were excluded.
The interventions included in the review, broadly termed as “robotic gait training,” must comprise exoskeleton or other electromechanically assisted gait devices and be implemented in conjunction with biosignal (EEG and/or EMG) data capture as part of the study. For the purpose of this review, robotic devices could be either end-effector (electromechanically driven footplates simulating the phases of gait) or exoskeleton (robot-driven orthosis) gait devices.
Comparator populations were not a mandatory inclusion criterion, but studies that include a control group or a matched comparator group were considered eligible for inclusion. RCTs, cross-over, or quasi-randomized control studies, case–control studies, cohort studies, cross-sectional studies, case series, and case reports were all eligible for inclusion. Reviews, opinion pieces, editorials, and conference abstracts were excluded. This review was not designed to specifically examine the efficacy of the robotic gait interventions on stroke outcomes; rather, we were interested in the neural biosignals of EEG and or EMG themselves when recorded during robotic gait training after a stroke and how these signals interface with the robotic device.
Information Sources
A systematic search and review of the literature was completed, which was compliant with the PRISMA guidelines (Moher et al., 2010). The following databases were searched from inception up to the 30th of November 2018: PubMed (1949–2018), EMBASE (1947–2018), Web of Science (1945–2018), COMPENDEX (1967–2018), CINAHL (1982–2018), SPORTDiscus (1985–2018), ScienceDirect (1997–2018), and Cochrane Library (1974–2018). No language, publication year, or publication status limits were applied to the database searches. Each database was searched using a comprehensive search strategy which was devised in conjunction with a librarian, including controlled vocabulary terms specific to each database and employing Boolean operators AND and OR. Gray literature was searched for in the following websites: http://bnci-horizon-2020.eu/database/data-sets and OpenGrey. A sample search strategy is provided as part of Figure 1.
Figure 1. PRISMA flow chart with sample search strategy.
Study Identification and Selection
The citations identified were subjected to the following review process. Duplicate records were removed. The remaining studies were then reviewed independently by two reviewers against the established eligibility criteria in three stages: screening by title, screening by abstract, and screening by full text. An inclusive approach was taken, whereby if it was not clear whether a study fulfilled the necessary criteria for inclusion, it progressed to the next more in-depth review stage.
Methodological Quality of the Included Studies
The reviewers independently documented the methodological quality of the included studies using the Effective Public Health Practice Public tool (EPHPP) in conjunction with the EPHPP dictionary for standardization. The EPHPP tool has been established as a reliable and valid tool in health research and is suitable to use across a range of differing study methodologies (Thomas et al., 2004, 2008). The disparity in ratings was discussed until a final decision was agreed.
Eight different sections of study quality to be applied as appropriate to the study type were addressed: selection bias, study design, confounders, blinding, data collection methods, withdrawals and dropouts, intervention integrity, and analysis. The tool provides an overall rating of either strong, moderate, or weak quality for each study.
Data Extraction, Synthesis, and Analysis
Data were extracted from the included studies using a pre-agreed, standardized data collection form. The data extracted included (1) the characteristics of stroke study participants (including number, age, stroke type, stroke severity, and ambulatory ability), (2) type of robotic gait devices employed, (3) neural biosignal/s captured, (4) protocol reported for signal capture and processing, and (5) purpose and use of biosignal capture. Discrepancies in extraction, mainly related to the criteria for reporting biosignal processing, were resolved through a group discussion until a consensus was reached.
Narrative and tabular syntheses of data were proposed due to the heterogeneity of the study methodologies included. An overview of the studies meeting the inclusion criteria is initially provided, summarizing across the studies the stroke patient profiles, robotic devices, neural biosignal/s captured during robotic gait training after a stroke, and the purpose of the signal capture.
A summary of current integration of EEG and/or EMG data during robotic walking is presented next, with the current state of the art in closing the BCI/HMI loop in robotic gait training after a stroke being delineated.
The protocols for EEG and EMG signal collection are reported in a tabular format, with a narrative summary identifying the hardware and the software utilized where reported, the number of channels/leads used, and the sites chosen for signal capture.
EEG and EMG signal processing, as employed in the included studies, are again reported in a tabular format, with a summary identifying the frequency of signal capture, filtering processes, and software and algorithms used.
Results
Overall Summary of Studies Identified
The database searches were completed by end of November 2018. Figure 1 provides the PRISMA flow chart of the studies identified through database searching and through each stage of the review process. From 8,899 articles identified by the search strategy, 13 full papers fitting the inclusion criteria were included.
Tables 1, 2, which report the EEG and the EMG studies, respectively, detail the characteristics of the stroke participants, the robotic gait devices deployed, and the purpose of the neural bio-signal recording.
Table 1. Electroencephalography (EEG)-based robotic studies (participants and purpose).
Table 2. Electromyography (EMG)-based robotic studies (participants and purpose).
A total of 96 out of the 122 individuals with stroke who were recruited in the studies received robot-assisted gait training on at least one occasion. Calabrò et al. recruited the largest cohort (40 stroke subjects, 20 of whom underwent robotic training) (Calabrò et al., 2018), whereas others reported a case study (Ping et al., 2013). The stroke participants differed widely across studies in terms of age profile, stroke type, stroke lateralization, and disability levels. Where reported, the ages ranged from 29 to 81 years of age. The laterality of the stroke event was described for 99 of the 122 stroke participants, 46 of whom had a right-sided stroke (with left hemiplegia). Two studies did not report stroke laterality (Chisari et al., 2015; Sloot et al., 2018). Stroke etiology was reported in 92 cases: 72 of which were ischemic in origin, 18 were hemorrhagic, and two were ischemic/hemorrhagic. Six studies did not provide information related to stroke type (Ping et al., 2013; He et al., 2014; Androwis et al., 2018; Sloot et al., 2018). The time from stroke to study participation was reported for 98 patients, with the majority (N = 57) recruited in the chronic phase of stroke. Three studies, comprising 13 subjects in total, selected stroke participants during the acute/subacute phase (Hesse et al., 2010; Gandolfi et al., 2017; Androwis et al., 2018). Three studies involved the collection of data from both chronic and acute/subacute phases of stroke (N = 10 in acute phase; N = 15 in chronic phase) (Fan and Yin, 2013; Srivastava et al., 2016; Gandolla et al., 2018). The stage of stroke recovery was not specified for the remaining 24 participants.
As noted in Tables 1, 2, a variety of methods were employed to describe the walking ability of the participants and, where comparable, the disability levels of the stroke study participants varied. Three authors adopted the Functional Ambulation Classification (FAC) as a standardized scale to describe the dependence levels in walking. Coenen et al. included fully independent walkers (FAC 5) (Coenen et al., 2012), Gandolfi et al. selected people who were unable to walk (FAC 0), (Gandolfi et al., 2017) and Calabrò et al. focused on stroke patients with gait impairment (FAC ≤ 4) (Calabrò et al., 2018). Three studies identified the participants as “walkers” but did not specify the level of assistance required, if any (Chisari et al., 2015; Srivastava et al., 2016; Sloot et al., 2018). Other studies described the participants' mean motor subscale score of the Functional Independence Measure (Androwis et al., 2018) [26 ± 4; where 13–38 indicate low scores for motor independence as guided by Itaya et al. (2017)], the Fugl–Meyer Lower Limb Scale (He et al., 2014) [12/34; where a cutoff score of <21 indicates lower mobility levels, as guided by Kwong and Ng (2019)], or strength of the lower limb tibialis anterior muscles of <4 on the MRC scale (Gandolla et al., 2018) or specified the level of assistance required to walk (Hesse et al., 2010; Ping et al., 2013). Two studies did not address the participants' walking status (Fan and Yin, 2013; Contreras-Vidal et al., 2018); however, one of these studies used the 6 MWT as a baseline score.
Exoskeleton devices were the most frequent robotic gait devices deployed in the studies included (n = 10 studies). The Lokomat (Lokomat® Hocoma, Switzerland) was used in two studies, EKSO (Ekso bionics®, USA) was used in three studies (two EKSO GT and one non-specified EKSO); the X1 (NASA, USA), the H2 (Technaid, Spain), the ALEX II (ROAR Laboratory, USA), and NaTUre-gaits (Nanyang Technological University, Singapore) devices were used in one study each. Fan and Yin combined a non-commercial lower extremity exoskeleton robot with a standing bed frame (Fan and Yin, 2013). Three end-effector devices were reported in the included studies [First Mover (Reha Technology AG, Switzerland), G-EO-Systems (Reha Technology AG, Switzerland), and Exosuit (Wyss Institute for Biologically Inspired Engineering, Harvard University, USA)].
Closing the Loop Between Human and Robotic Device
No studies included in this review closed the loop in real time using EEG biosignals during robotic walking after a stroke, indicating that this field has not sufficiently evolved in a patient population such as stroke. One study described a multisensor, real-time movement prediction model that included sEMG of knee flexor and extensor muscles, joint angle, and force to determine the rehabilitation mode and the parameter settings in a bespoke exoskeleton (Fan and Yin, 2013). Errors in movement prediction were evident however during active training, when flexion and extension altered rapidly.
EEG-Based Studies
Three of the thirteen studies included in this review recorded and analyzed EEG activity. As summarized in Table 1, two studies used EEG during robotic gait to decode gait kinematics (He et al., 2014; Contreras-Vidal et al., 2018) and muscle activity during walking (He et al., 2014). One study used EEG to determine frontoparietal connectivity as an outcome measure of neuroplasticity following a robotic gait training intervention (Calabrò et al., 2018).
Table 3 summarizes the EEG signal processing methods employed by the researchers. Contreras-Vidal et al. identified neural representation at the brain level for robotic gait using a powered H2 exoskeleton. A wireless, 64-channel, active electrode EEG-based system (BrainAmpDC, Brain Products, Inc., Munich), with continuous-time Kalman decoder operating on delta band, was utilized in five chronic stroke patients to demonstrate the feasibility of an EEG-based BCI-controlled rehabilitative robotic exoskeleton. The classification accuracy for predicting joint angles during gait was noted to improve with multiple training sessions and gait speed (Contreras-Vidal et al., 2018). The pilot study conducted by He et al., using a 10th-order unscented Kalman filter, demonstrated similar moderately high online decoding accuracies for joint kinematics during robotic gait but not for muscle activity patterns during robotic gait training in two healthy participants and one stroke survivor (He et al., 2014) using a multimodal interface comprising EEG [64-channel EEG (actiCap system, Brain Products GmbH, Munich, Germany)], EMG, and motion (goniometers), instrumented in conjunction with the X1 exoskeleton employed during 5-min overground walking sessions of three conditions: no robot, robot off (X1 in passive mode), and robot on (X1 in active mode). The final EEG-based study, an RCT by Calabrò et al. (N = 40 sub-acute and chronic stroke patients), employed 21-channel EEG as a measure of neuroplasticity using frontoparietal effective connectivity (FPEC) but did not interface with the robotic device directly. EEG was recorded using a high-input impedance amplifier (referential input noise <0.5 μVrms at 1÷20,000 Hz) of Brain Quick SystemPLUS (Micromed; Mogliano Veneto, Italy), wired to an EEG cap equipped with 21 Ag tin disk electrodes positioned according to the international 10–20 system. An electrooculogram (EOG) was also recorded for blinking artifact detection. EEG and EOG were sampled at 512 Hz, filtered at 0.3–70 Hz, and referenced to linked earlobes. The cortical activations induced by gait training from the EEG recordings were identified by using low-resolution brain electromagnetic tomography (LORETAKEY alpha-software). Structural equation modeling technique (or path analysis) was employed to measure the effective connectivity among the cortical activations induced by gait training. Improved FPEC was observed when robot-assisted gait training was included in the rehabilitation in comparison to conventional rehabilitation alone (r = 0.601, p < 0.001).
Table 3. Electroencephalography (EEG) signal processing in included studies.
EMG-Based Studies
Table 4 summarizes the EMG measurements from 12 studies included in this review. Only eight of the 12 studies defined the EMG device used: two studies used a Noraxon, two a BTS, one a DataLog, one a Motion Lab, and one a Porti system; one study used a self-made signal acquisition processor. Among these, five were wireless EMG devices.
Table 4. Electromyography (EMG) signal processing in included studies.
The majority of the studies collected EMG data to assess neuromuscular adaptations during robotic gait in stroke (Coenen et al., 2012; Ping et al., 2013; Chisari et al., 2015; Srivastava et al., 2016; Androwis et al., 2018; Calabrò et al., 2018; Sloot et al., 2018) or as an outcome measure following robotic training (Hesse et al., 2010; Chisari et al., 2015; Gandolfi et al., 2017). One study employed EMG activity as a calibration tool to identify individualized, optimal robotic parameters based on the gait index score derived from a normalized dataset (Gandolla et al., 2018). Every study used a symmetrical scheme for electrode placement, collecting EMG signals from both stroke-affected and contralateral sides, with the exception of one study (Srivastava et al., 2016) that collected EMG data from the paretic leg only. The number of muscle groups for EMG signal capture varied from only one muscle site (Quadriceps) (Chisari et al., 2015) to up to seven different muscle groups per limb (Hesse et al., 2010; Coenen et al., 2012), with no clear rationale for the muscle groups provided. Three studies referenced the guidelines used to identify optimal electrode placement (SENIAM guidelines) (Chisari et al., 2015; Gandolfi et al., 2017; Gandolla et al., 2018). Eleven out of the 13 studies tested the dorsi-flexors and the plantar-flexors of the ankle joint. Knee joint muscles were assessed by 12 studies. One of these studies recorded rectus femoris only (Chisari et al., 2015), whereas the others registered both flexor and extensor muscle groups. The hip musculature was addressed in three studies (Hesse et al., 2010; Coenen et al., 2012; Srivastava et al., 2016).
Muscle activity and timing of onset were registered and interpreted in relation to the gait cycle in 10 studies (Hesse et al., 2010; Coenen et al., 2012; Ping et al., 2013; Srivastava et al., 2016; Gandolfi et al., 2017; Androwis et al., 2018; Calabrò et al., 2018; Gandolla et al., 2018; Sloot et al., 2018). A variety of methods were employed, including instrumented gait analysis systems (Androwis et al., 2018), synchronized video analysis (Coenen et al., 2012; Ping et al., 2013), accelerometry (Calabrò et al., 2018), shoe-mounted sensors (Hesse et al., 2010; Gandolfi et al., 2017), or through the monophasic soleus muscle EMG activity and deactivation during gait, where the signal portion between two soleus muscle deactivations corresponds to a step cycle (Gandolla et al., 2018). The detailed protocols, where provided by the authors, are summarized in Table 5. Where explicitly reported, all studies set the EMG sampling frequency at or over 1,000 Hz in accordance with the Nyquist sampling principle. This was not specified in four studies (Fan and Yin, 2013; Ping et al., 2013; Gandolla et al., 2018; Sloot et al., 2018). Impedance was checked and kept below 5 kΩ by two studies (Hesse et al., 2010; Gandolfi et al., 2017), while the other studies did not specify impedance checking. The studies applied different signal filtering methods (Butterworth, high/low/band-pass filtering, keeping signals usually between 5/20–300/400/500 Hz). The signals were full-wave-rectified, and root mean square was applied to calculate the EMG amplitude and to provide a global overview of the muscle activity.
Table 5. Quality rating of included studies.
Co-registered EMG and EEG Data Collection
Only two papers (He et al., 2014; Calabrò et al., 2018) captured both EEG and EMG data. One study decoded the muscle activation patterns by scalp EEG signals during robotic walking, demonstrating reasonable success at decoding the hip and knee EMG activity in the affected leg of a stroke survivor (He et al., 2014). The authors cited difficulty with the EMG data collection, however, as the exoskeleton device and its attachments, in many cases, were located at the same anatomical sites as the EMG electrodes. The second study reported EMG and EEG as separate measures and was therefore not considered a co-registration of neural signals (Calabrò et al., 2018).
Quality Review
As identified in Table 5, many studies were rated as “weak,” using the EPHPP guidance tool, primarily due to a potential selection bias during participant recruitment, thereby limiting their representation of the stroke population. Here the majority of studies failed to identify their recruitment strategy. Similarly, the studies received a lower quality rating where the reliability and the validity of the data collection methods were not explicitly reported.
Discussion
This systematic review compiled the current state of the art in the use of neural biosignals during robotic gait training after a stroke. No studies that used EEG signals to close the loop between human and robotic gait device were identified. Two BCI studies that show promise (with adequate training) were identified for the classification of gait in an exoskeleton after a stroke with a view toward a future BCI application (He et al., 2014; Contreras-Vidal et al., 2018). The work presented by Contreras-Vidal (Contreras-Vidal et al., 2018) builds on a previously published framework proposed by this study group (Contreras-Vidal and Grossman, 2013). Otherwise, as with the majority of the EMG studies identified, the EEG signals were used as an outcome measure to evaluate RGT devices in stroke rehabilitation, for example, as an index of fronto-parietal connectivity to quantify neuroplastic changes (Calabrò et al., 2018). A recent systematic review of BCI rehabilitation in stroke supports this finding, where EEG was used to trigger neuromuscular electrical stimulation in the lower limb but not robotic gait devices to date (Cervera et al., 2018).
Specifying a search strategy that must include individuals with stroke in this systematic review yielded very limited EEG data. While this is informative with respect to the current state of the art in this area in stroke rehabilitation, it does not reflect the broader field of EEG-based control for robotic gait devices well. A recent systematic review by Al-Quraishi et al. (2018) comprehensively reported on EEG-based control for upper and lower limb exoskeletons and prostheses. In this review, 14 studies that used EEG-based control for lower limb movement, primarily in healthy subjects and individuals with spinal cord injury, were identified. Among those, nine studies targeted robotic gait-assistive devices (alone or in conjunction with an avatar), three used motor-imagery-only protocols with event-related desynchronization/resynchronization (ERD) (Do et al., 2013; Gordleeva et al., 2017; Lee et al., 2017), four used a movement-based protocol—with the EEG signal analysis undocumented in one (He et al., 2018b), and in the remaining three as ERD (Garcia-Cossio et al., 2015), combined ERD and movement-related cortical potential (MRCP) (López-Larraz et al., 2016), and exogenous steady-state visually evoked potentials with the visual stimuli representing robotic commands (Kwak et al., 2015). Two studies identified used a combination of motor imagery and movement using sensorimotor rhythms and MRCP (Liu et al., 2017) and event-related spectral pertubations (Donati et al., 2016). Notably, in one patient with a spinal cord injury, EEG signals were used to detect gait initiation to trigger the exoskeleton movement (López-Larraz et al., 2016). In another study with healthy individuals, online control of an overground exoskeleton using ERD in sensorimotor networks to train a classifier to identify two different mental states of walking forward intention or turning were demonstrated. In one body-weight-supported exoskeleton system, the user's intention was classified into active and passive walking phases using 62-channel EEG and power spectrum analysis in 8–30 Hz, normalized to the baseline condition to calculate ERD (Garcia-Cossio et al., 2015). The classification accuracies for active and passive walking with baseline were 94 and 93%, respectively, demonstrating the capability of BCI-assisted robotic training. The majority of EEG-based control in lower limb studies (N = 11; 79%) included in this cited review (Al-Quraishi et al., 2018) were markedly published from 2015 onwards, indicating a relatively new research area and, in part, explaining the poor penetration in the stroke population identified in this current systematic review. Another review of brain–machine interfaces for controlling lower limb powered robotic systems (He et al., 2018a) identifies that the most common studies in this area are classification-based studies of walk vs. stand tasks in healthy subjects and system performance is not clearly presented in these studies. Several challenges were summarized in this review, including EEG denoising, safety, and responsiveness. Furthermore, it concluded that suitable performance metrics and more clinical trials were required to advance research and development in the field.
One study that investigated closed-loop control between human and robotic gait device involving three stroke survivors was identified in this systematic review (Fan and Yin, 2013). EMG activity levels from knee flexor and extensor muscle groups were measured and a multisystem decoding paradigm, which included EMG in addition to joint angle and force production data, allowed the robotic command to be altered. High error rates in the commands generated during active movement were observed when flexion and extension activity alternated rapidly, limiting application in the clinical setting (Fan and Yin, 2013). EMG methods for motor intent identification have previously been noted to have significant limitations in stroke in that they are only appropriate for patients who can produce some voluntary movement or high-enough levels of muscle activity and are not suitable for individuals with severe motor impairment, profound muscle fatigue, or abnormally coactivated muscles (Li et al., 2018). Concerns have also been raised that continuous EMG control may indeed reinforce pathological movement rather than encouraging the recovery of normal motion patterns (Krebs et al., 2003).
EMG has been combined with EEG to improve the recognition of movement intent in the upper limb (Bhagat et al., 2016) in the BCI literature. The current review identified two studies that recorded EEG and EMG. However, the two neural biosignals were not used in conjunction in either study to decode movement. One study reported these measures separately (Calabrò et al., 2018), while the other decoded EMG activity in the lower limbs using EEG during robotic walking in one stroke subject (He et al., 2014).
One example was identified in the literature where the best power transfer between subject and robot was achieved through a fine-tuning procedure for robotic parameters based on optimized EMG activity during the gait cycle (Gandolla et al., 2018); in this context, sEMG could prove to be a useful tool to optimize the patient–robot interaction in the clinical setting. However, the current lack of personalization of robotic gait command derived from neural biosignals and the limited ability to tailor robotic training to participant effort and to rehabilitative goals aligned with motor (re)learning principles limit their capacity as truly restorative devices in stroke rehabilitation. Robotic gait devices and the technological advancements enabling their continued development have been the preserve of the field of engineering (Pons, 2010). Translational research that examines deployment of devices in a clinical population must now also draw from expertise in rehabilitation and clinical research. This paper includes input from experts in the field of neurology, rehabilitation, bioengineering, and BCI engineering, discusses shortcomings in the papers identified, and makes recommendations to advance this field of research. A quick reference guide DESIRED (Table 6) has been developed by the group to identify a minimum reporting data set as a standard for future studies and the rationale and evidence base guiding these recommendations are described in detail next.
Table 6. The DESIRED checklist: minimal reporting dataset for neural biosignals during robotic gait after a stroke.
The majority of papers identified reported methodologies related to the devices, biosignals, and/or model development as appropriate to the domain of engineering. As a consequence, when considered as clinical studies in a stroke population and assessed using a broadly applicable quality rating tool (Thomas et al., 2004), the majority of studies were deemed to have a weak methodology. Consistent problems identified across studies related to the selection of stroke subjects and to the reporting of the validity and the reliability of the outcome measures employed. Guidelines with quality control checklists are available across a range of clinical study methodologies, for example, RCTs (Campbell et al., 2012), observational studies (Von Elm et al., 2014), and qualitative methodologies (Booth et al., 2014). When introducing participants with stroke or other neurological pathologies to robotic and/or neural signal-based studies, it is recommended that the authors familiarize themselves with the criteria expected based on the study type to be reported in the paper.
It is interesting to note that none of the papers reviewed provided a rationale for their selection of the stroke participants, and limited details on stroke pathology, stroke laterality, and stroke severity levels were documented. The time from stroke, for example, is something that further warrants attention. After focal damage, there is a brief, approximately 3 months, window of heightened plasticity, the so-called opportunity window which, in combination with training protocols, leads to large gains in motor function (Zeiler and Krakauer, 2013). Emerging evidence now supports smaller, plastic, and non-compensatory recovery in the chronic stages after a stroke also (Mrachacz-Kersting et al., 2015; Carvalho et al., 2018). To compare the neural biosignals and their utility in robotic gait training after a stroke across studies and to allow the results to be interpreted correctly, it is imperative to report this information. No consensus was observed across studies with respect to the gait impairment level of those included in the studies and ranged from those fully and independently mobile to those who are wheelchair dependent, again limiting the conclusions that can be drawn across studies. To stratify the findings from future studies, a minimum data set for participants with stroke is recommended and summarized as: stroke type, laterality, time from stroke to inclusion in the study, and functional ambulatory category (Mehrholz et al., 2007). The impairment of sensation also needs to be taken into account, given that accurate motor control can only be exerted with correct sensory and proprioceptive input. An index of stroke severity would also be a useful addition, for example, the National Institutes of Health Stroke Scale score (Ortiz and Sacco, 2014), as well as the level of cognitive function of the participants, if this is not a stated inclusion/exclusion criterion. To best replicate clinical application, it is advised that only the participants with gait impairment are included in the research.
A review of the brain–machine interface for lower limb systems after a stroke, published in 2015, concluded that additional research and development were required to advance this field (Soekadar et al., 2015). This systematic review now identifies that EEG data use during robotic gait after a stroke remains sub-optimal to closing the loop between person and robot. It is acknowledged that EEG activity during walking is not well-understood in general and discordance exists in the literature on the temporal and the spectral patterns of cortical dynamics during walking (Wagner et al., 2012, 2014; Seeber et al., 2014, 2015; Bradford et al., 2015; Bruijn et al., 2015; Bulea et al., 2015; Storzer et al., 2016; Winslow et al., 2016; Artoni et al., 2017; Luu et al., 2017; Oliveira et al., 2017). A number of research groups (Bradford et al., 2015; Bruijn et al., 2015; Bulea et al., 2015; Winslow et al., 2016; Artoni et al., 2017; Luu et al., 2017; Oliveira et al., 2017) report event-related (de)synchronization (ERD/S) (i.e., an event-related power change) in 8–12 Hz (alpha/mu) and 12–28 Hz (beta) oscillations after the onset of stepping/walking task (Bradford et al., 2015; Bruijn et al., 2015; Bulea et al., 2015; Winslow et al., 2016; Artoni et al., 2017; Luu et al., 2017; Oliveira et al., 2017), while other research groups report ERS at 28–40 Hz (low gamma) during early and mid-swing and ERD toward the end of the swing phase and during double support (Wagner et al., 2012, 2014; Seeber et al., 2014, 2015; Storzer et al., 2016). The literature does call attention to the importance of the central pre-motor/motor/sensorimotor and posterior parietal cortical areas in neural signal generation during the walking tasks. Thus, for the separation of walking from rest periods, we recommend the above-described cortical areas and the frequency bands are represented in the data collected and processed.
Decoding the 3D motion trajectory of the lower limbs is a more challenging objective (Georgopoulos et al., 2005). In BCI, this method poses an ideal solution for controlling a robotic device as the applied signal processing algorithm reconstructs the track of the intended movement. To date, most joint trajectory decoding studies have focused on reconstructing the movement of the upper limbs (Bradberry et al., 2010) and fingers (Paek et al., 2014) using 0.5–2 Hz slow cortical potentials (SCP) or band-power time-series of mu and beta bands (Korik et al., 2015, 2016, 2018). Motion trajectory prediction has successfully been applied to lower limb kinematics during treadmill walking in healthy individuals by Presacco et al. (2011, 2012) using SCP time-series. Here topographical analysis did not identify a significant pattern of lower limb movement-related cortical areas. Two studies included in this current review identified the utility of the 0.1–3 Hz frequency band for decoding kinematic data (He et al., 2014; Contreras-Vidal et al., 2018) and EMG kinetics during robotic walking after a stroke (He et al., 2014). One of these studies primarily focused on the frontal, temporal, and parietal brain regions (He et al., 2014), while others removed the peripheral channels susceptible to facial/cranial movement-related noise (Contreras-Vidal et al., 2018). Thus, as decoding the motion of lower limbs during walking is a nascent area, we still recommend a global analysis to identify the most suitable features (potential or band-power time-series, low-delta, mu, or beta frequency band and all cortical areas). However, the SCP/mu and beta band-power time-series extracted from the central motor and posterior parietal areas most likely contain maximal information for decoding lower limb movement trajectories.
From the present review, the lack of a standardized EMG recording protocol when applied to people with stroke-related disability in interaction with exoskeletons is evident. This limitation hampers the constitution of shared database repositories and pooling of data. A protocol and reported methodology should include a minimum dataset of muscles, dimensions, and positioning criteria of the surface EMG electrodes, interelectrode distance, techniques to verify the system selectivity, and technical sampling requirements (e.g., amplifier characteristics, electrode diameter, and impedance limits). The guidelines also suggest the inclusion of additional details relating to signal analysis pipelines, such as filtering and signal quality checks (Blanc and Dimanico, 2010; Merletti and Farina, 2016; Benedetti et al., 2017).
Currently, no consensus exists on targeting specific muscle groups during gait analysis in stroke survivors. The surface EMG of agonist and antagonist lower limb muscle activity during gait is emerging as an effective way of defining motor control during spontaneous movement in stroke (Srivastava et al., 2019). A minimum set of agonist and antagonist muscles in the distal and the proximal compartment of the leg needs to be defined to provide comprehensive muscle recruitment patterns and muscle synergies during the gait cycle after a stroke, which could be helpful for future HMI. Additionally, for individuals after a stroke, sEMG data from both legs (stroke affected and non-affected sides) should be collected as motor deficits are not only associated with the stroke-affected side but also of the non-affected side during spontaneous walking (Parvataneni et al., 2007; Bagnato et al., 2009; Tseng and Morton, 2010; Raja et al., 2012). Recent reviews of muscle synergies in post-stroke gait and robotic gait devices support the need for better standardization of muscles chosen for EMG data capture (Molteni et al., 2018; Van Criekinge et al., 2019). Tibialis anterior, soleus, gastrocnemius, and rectus femoris were noted to be most commonly assessed in all muscle synergy studies after a stroke (Van Criekinge et al., 2019). Considering best clinical practice and the need to record agonist and antagonist muscles during gait, a minimum representative muscle set to be targeted in future studies is recommended as bilateral: tibialis anterior, soleus, rectus femoris, and vastus lateralis, where possible. Alternate muscle/s selection may need to be defined by the participant's stroke-related muscle impairment/s or the robotic gait device and its positioning at specific anatomical landmarks for sensor placement, leading to muscle group exclusion.
Only three studies included in this review referred to a guideline document used for the correct positioning of electrodes on muscles. Failure to do this limits the reliable recording of muscle signals and does not address the challenge of avoiding “crosstalk” (diffused signal components coming from co-active or inactive adjacent muscles) (Basmajian, 1983). Correct sensor positioning aims to minimize this phenomenon and allows the researchers to identify a real co-contraction of agonist and antagonist muscle groups, which is common after a stroke. Basmajian and Blummenstein provide instructions to identify the minimal crosstalk area (MCA) for electrode placement on superficial muscles during gait (Basmajian and Blumenstein, 1980; Basmajian, 1983; Campanini et al., 2007; Blanc and Dimanico, 2010). Although the Surface EMG for Non-invasive Assessment of Muscles (SENIAM) guidelines referenced in the included studies are readily available and easy to use (www.seniam.org; Merletti, 2000), the MCA locations defined by Basmajian and Blummenstein, subsequently updated by Blanc and Dimanico (Blanc and Dimanico, 2010), have been proven to be superior to the SENIAM guidelines (Campanini et al., 2007). MCA identification would now be a minimum standard recommendation to follow in this field when studying the EMG timing during gait (Campanini et al., 2007), with the axis of the electrodes directed parallel to the muscle fibers to increase selectivity (Blanc and Dimanico, 2010). Additional quality assurance measures during robotic gait after a stroke, where feasible with the constraints of the device itself, could include sensor placement checks—performed by eliciting contractions of a single muscle and checking for crosstalk on the other collected traces (Benedetti et al., 2017) and strongly recommended where spasticity or muscle shortening may alter placement accuracy—and data check to ascertain the shape of the power spectral density (PSD) of the signal to ensure meaningful content (Merlo and Campanini, 2010), free of movement artifacts. When recording surface EMG in sessions that include the use of exoskeletons, electrical interference on EMG signals coming from electrical actuators, battery packs, and cables is not unexpected, and the PSD computation could prove to be a powerful tool to unravel such unwanted events.
Limitations
The authors acknowledge that while no language limits were applied when searching across databases, no papers were returned in languages other than English. As such, it is possible that additional manuscripts exist that were not identified through this search strategy. The search also returned studies with heterogeneous use of neural bio-signals, including as an outcome measurement only. While these were included in the review, their purpose was not in line with the primary focus of this review. However, in unifying all studies in this area irrespective of their set purpose, biosignal collection and interpretation in this field could be generalized and commented on constructively.
Conclusion
Overall, while there are ever-growing technological advances in robotics, actuators, and sensors, advances in applications to entrain robotic commands with biosignals for gait training in clinical populations such as stroke have been considerably slower. EEG recording in stroke, where the pathology is at the brain level, has been problematic when compared to other neurological pathologies such as spinal cord injury (Castermans et al., 2014), and similarly EMG recording on the stroke-affected side can be problematic (Sarasola-Sanz et al., 2017; Li et al., 2018). Uncertainty still exists in the literature on the best choice of EEG metric (Goh et al., 2018) and in the ability of EMG to respond accurately in real time (Fan and Yin, 2013). This review, summarizing the current state of the art in neural interface during robotic-assisted gait training after a stroke, identifies a lack of standardization in data collection in this field and provides guidance for study design and reporting future studies. Promising findings for decoding movement during robotic gait after a stroke and potential for EMG, in conjunction with other measurement modes to close the loop, have been elucidated.
Data Availability Statement
All datasets generated for this study are included in the article/supplementary material.
Author Contributions
OL, AD, EG, FM, CG, and DC developed the concept for this systematic review. OL, MT, RO, and CF contributed to the development of the search strategy, review of papers, data extraction, and synthesis sections. All the authors had equal involvement in the drafting and the revising of the review article by unique contribution to the intellectual content and consensus among all the authors on the content.
Funding
This study has been supported by an EU-funded H2020 Research and Innovation Staff Exchange grant: PRO GAIT grant agreement number 778043. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Conflict of Interest
CG and RO are employed at g.tec Medical Engineering GmbH, Austria.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We would like to thank Alex Heilinger and Diarmuid Stokes for their assistance during the development and the execution of the search strategy.
References
Al-Quraishi, M. S., Elamvazuthi, I., Daud, S. A., Parasuraman, S., and Borboni, A. (2018). EEG-based control for upper and lower limb exoskeletons and prostheses: a systematic review. Sensors 18:3342. doi: 10.3390/s18103342
Androwis, G. J., Pilkar, R., Ramanujam, A., and Nolan, K. J. (2018). Electromyography assessment during gait in a robotic exoskeleton for acute stroke. Front. Neurol. 9:630. doi: 10.3389/fneur.2018.00630
Ang, K. K., Guan, C., Phua, K. S., Wang, C., Zhou, L., Tang, K. Y., et al. (2014). Brain-computer interface-based robotic end effector system for wrist and hand rehabilitation: results of a three-armed randomized controlled trial for chronic stroke. Front. Neuroeng. 7:30. doi: 10.3389/fneng.2014.00030
Artoni, F., Fanciullacci, C., Bertolucci, F., Panarese, A., Makeig, S., Micera, S., et al. (2017). Unidirectional brain to muscle connectivity reveals motor cortex control of leg muscles during stereotyped walking. Neuroimage 159, 403–416. doi: 10.1016/j.neuroimage.2017.07.013
Bagnato, S., Boccagni, C., Boniforti, F., Trinchera, A., Guercio, G., Letizia, G., et al. (2009). Motor dysfunction of the “non-affected” lower limb: a kinematic comparative study between hemiparetic stroke and total knee prosthesized patients. Neurol. Sci. 30, 107–113. doi: 10.1007/s10072-009-0031-0
Basmajian, J. V. (1983). “Electrode placement in electromyographic biofeedback,” in Biofeedback Principles and Practice for clinicians (Baltimore: Williams & Wilkins), 1–86.
Basmajian, J. V., and Blumenstein, R. (1980). Electrode Placement in EMG Biofeedback. Baltimore, MD: Williams and Wilkins.
Benedetti, M. G., Beghi, E., De Tanti, A., Cappozzo, A., Basaglia, N., Cutti, A. G., et al. (2017). SIAMOC position paper on gait analysis in clinical practice: general requirements, methods and appropriateness. Results of an Italian consensus conference. Gait Posture 58, 252–260. doi: 10.1016/j.gaitpost.2017.08.003
Bhagat, N. A., Venkatakrishnan, A., Abibullaev, B., Artz, E. J., Yozbatiran, N., Blank, A. A., et al. (2016). Design and optimization of an EEG-based brain machine interface (BMI) to an upper-limb exoskeleton for stroke survivors. Front. Neurosci. 10:122. doi: 10.3389/fnins.2016.00122
Blanc, Y., and Dimanico, U. (2010). Electrode placement in Surface electromyography (sEMG)” Minimal Crosstalk Area “(MCA). Open Rehabil. J. 3, 110–126. doi: 10.2174/1874943701003010110
Booth, A., Hannes, K., Harden, A., Noyes, J., Harris, J., and Tong, A. (2014). “COREQ (consolidated criteria for reporting qualitative studies),” in Guidelines for Reporting Health Research: A User's Manual, eds D. Moher, D. G. Altman, K. F. Schulz, I. Simera, E. Wager (Hoboken, NJ: John Wiley & Sons, Ltd), 214–226.
Bradberry, T. J., Gentili, R. J., and Contreras-Vidal, J. L. (2010). Reconstructing three-dimensional hand movements from noninvasive electroencephalographic signals. J. Neurosci. 30, 3432–3437. doi: 10.1523/JNEUROSCI.6107-09.2010
Bradford, J. C., Lukos, J. R., and Ferris, D. P. (2015). Electrocortical activity distinguishes between uphill and level walking in humans. J. Neurophysiol. 115, 958–966. doi: 10.1152/jn.00089.2015
Bruijn, S. M., Van Dieën, J. H., and Daffertshofer, A. (2015). Beta activity in the premotor cortex is increased during stabilized as compared to normal walking. Front. Hum. Neurosci. 9:593. doi: 10.3389/fnhum.2015.00593
Bruni, M. F., Melegari, C., De Cola, M. C., Bramanti, A., Bramanti, P., and Calabrò, R. S. (2018). What does best evidence tell us about robotic gait rehabilitation in stroke patients: a systematic review and meta-analysis. J. Clin. Neurosci. 48, 11–17. doi: 10.1016/j.jocn.2017.10.048
Bulea, T. C., Kim, J., Damiano, D. L., Stanley, C. J., and Park, H.-S. (2015). Prefrontal, posterior parietal and sensorimotor network activity underlying speed control during walking. Front. Hum. Neurosci. 9:247. doi: 10.3389/fnhum.2015.00247
Cai, L. L., Fong, A. J., Otoshi, C. K., Liang, Y., Burdick, J. W., Roy, R. R., et al. (2006). Implications of assist-as-needed robotic step training after a complete spinal cord injury on intrinsic strategies of motor learning. J. Neurosci. 26, 10564–10568. doi: 10.1523/JNEUROSCI.2266-06.2006
Calabrò, R. S, Naro, A., Russo, M., Bramanti, P., Carioti, L., Balletta, T., et al. (2018). Shaping neuroplasticity by using powered exoskeletons in patients with stroke: a randomized clinical trial. J. Neuroeng. Rehabil. 15:35. doi: 10.1186/s12984-018-0377-8
Campanini, I., Merlo, A., Degola, P., Merletti, R., Vezzosi, G., and Farina, D. (2007). Effect of electrode location on EMG signal envelope in leg muscles during gait. J. Electromyogr. Kinesiol. 17, 515–526. doi: 10.1016/j.jelekin.2006.06.001
Campbell, M. K., Piaggio, G., Elbourne, D. R., and Altman, D. G. (2012). Consort 2010 statement: extension to cluster randomised trials. BMJ 345:e5661. doi: 10.1136/bmj.e5661
Carvalho, R., Azevedo, E., Marques, P., Dias, N., and Cerqueira, J. J. (2018). Physiotherapy based on problem-solving in upper limb function and neuroplasticity in chronic stroke patients: a case series. J. Eval. Clin. Pract. 24, 552–560. doi: 10.1111/jep.12921
Castermans, T., Duvinage, M., Cheron, G., and Dutoit, T. (2014). Towards effective non-invasive brain-computer interfaces dedicated to gait rehabilitation systems. Brain Sci. 4, 1–48. doi: 10.3390/brainsci4010001
Cervera, M. A., Soekadar, S. R., Ushiba, J., Millán, J. D., Liu, M., Birbaumer, N., et al. (2018). Brain-computer interfaces for post-stroke motor rehabilitation: a meta-analysis. Ann. Clin. Transl. Neurol. 5, 651–663. doi: 10.1002/acn3.544
Chisari, C., Bertolucci, F., Monaco, V., Venturi, M., Simonella, C., Micera, S., et al. (2015). Robot-assisted gait training improves motor performances and modifies Motor Unit firing in poststroke patients. Eur. J. Phys. Rehabil. Med. 51, 59–69. Available online at: https://www.minervamedica.it/en/journals/europa-medicophysica/article.php?cod=R33Y2015N01A0059
Coenen, P., van Werven, G., van Nunen, M. P., Van Dieën, J. H., Gerrits, K. H., and Janssen, T. W. (2012). Robot-assisted walking vs overground walking in stroke patients: an evaluation of muscle activity. J. Rehabil. Med. 44, 331–337. doi: 10.2340/16501977-0954
Contreras-Vidal, J. L., Bortole, M., Zhu, F., Nathan, K., Venkatakrishnan, A., Francisco, G. E., et al. (2018). Neural decoding of robot-assisted gait during rehabilitation after stroke. Am. J. Phys. Med. Rehabil. 97, 541–550. doi: 10.1097/PHM.0000000000000914
Contreras-Vidal, J. L., and Grossman, R. G. (2013). “NeuroRex: a clinical neural interface roadmap for EEG-based brain machine interfaces to a lower body robotic exoskeleton,” in 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (Osaka. IEEE).
Do, A. H., Wang, P. T., King, C. E., Chun, S. N., and Nenadic, Z. (2013). Brain-computer interface controlled robotic gait orthosis. J. Neuroeng. Rehabil. 10:111. doi: 10.1186/1743-0003-10-111
Donati, A. R., Shokur, S., Morya, E., Campos, D. S., Moioli, R. C., Gitti, C. M., et al. (2016). Long-term training with a brain-machine interface-based gait protocol induces partial neurological recovery in paraplegic patients. Sci. Rep. 6:30383. doi: 10.1038/srep30383
Fan, Y., and Yin, Y. (2013). Active and progressive exoskeleton rehabilitation using multisource information fusion from emg and force-position epp. IEEE Transac. Biomed. Eng. 60, 3314–3321. doi: 10.1109/TBME.2013.2267741
Gandolfi, M., Geroin, C., Tomelleri, C., Maddalena, I., Kirilova, E. D., Picelli, A., et al. (2017). Feasibility and safety of early lower limb robot-assisted training in sub-acute stroke patients: a pilot study. Eur. J. Phys. Rehabil. Med. 53, 870–882. doi: 10.23736/S1973-9087.17.04468-9
Gandolla, M., Guanziroli, E., D'Angelo, A., Cannaviello, G., Molteni, F., and Pedrocchi, A. (2018). Automatic setting procedure for exoskeleton-assisted overground gait: proof of concept on stroke population. Front. Neurorobot. 12:10. doi: 10.3389/fnbot.2018.00010
Garcia-Cossio, E., Severens, M., Nienhuis, B., Duysens, J., Desain, P., Keijsers, N., et al. (2015). Decoding sensorimotor rhythms during robotic-assisted treadmill walking for brain computer interface (BCI) applications. PLoS ONE 10:137910. doi: 10.1371/journal.pone.0137910
Georgopoulos, A. P., Langheim, F. J., Leuthold, A. C., and Merkle, A. N. (2005). Magnetoencephalographic signals predict movement trajectory in space. Exp. Brain Res. 167, 132–135. doi: 10.1007/s00221-005-0028-8
Goh, S. K., Abbass, H. A., Tan, K. C., Al-Mamun, A., Thakor, N., Bezerianos, A., et al. (2018). Spatio–spectral representation learning for electroencephalographic gait-pattern classification. IEEE Transac. Neural Syst. Rehabil. Eng. 26, 1858–1867. doi: 10.1109/TNSRE.2018.2864119
Goodman, R. N., Rietschel, J. C., Roy, A., Jung, B. C., Diaz, J., Macko, R. F., et al. (2014). Increased reward in ankle robotics training enhances motor control and cortical efficiency in stroke. J. Rehabil. Res. Dev. 51, 213–227, doi: 10.1682/JRRD.2013.02.0050
Gordleeva, S. Y., Lukoyanov, M. V., Mineev, S. A., Khoruzhko, M. A., Mironov, V. I., Kaplan, A. Y., et al. (2017). Exoskeleton control system based on motor-imaginary brain–computer interface. 9, 31–38. doi: 10.17691/stm2017.9.3.04
He, Y., Eguren, D., Azorín, J. M., Grossman, R. G., Luu, T. P., and Contreras-Vidal, J. L. (2018a). Brain–machine interfaces for controlling lower-limb powered robotic systems. J. Neural Eng. 15:021004. doi: 10.1088/1741-2552/aaa8c0
He, Y., Luu, T. P., Nathan, K., Nakagome, S., and Contreras-Vidal, J. L. (2018b). A mobile brain-body imaging dataset recorded during treadmill walking with a brain-computer interface. Sci. Data 5:180074. doi: 10.1038/sdata.2018.74
He, Y., Nathan, K., Venkatakrishnan, A., Rovekamp, R., Beck, C., Ozdemir, R., et al. (2014). An integrated neuro-robotic interface for stroke rehabilitation using the NASA X1 powered lower limb exoskeleton. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2014, 3985–3988. doi: 10.1109/EMBC.2014.6944497
Heilinger, A., Lennon, O., and Ortner, R. (2018). PROSPERO. Available online at: http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42018112252
Hesse, S., Waldner, A., and Tomelleri, C. (2010). Innovative gait robot for the repetitive practice of floor walking and stair climbing up and down in stroke patients. J. Neuroeng. Rehabil. 7:30. doi: 10.1186/1743-0003-7-30
Higgins, J. P., and Green, S. (2011). Cochrane Handbook for Systematic Reviews of Interventions, Vol. 4 (Hoboken, NJ: John Wiley and Sons).
Ho, N. S., Tong, K. Y., Hu, X. L., Fung, K. L., Wei, X. J., Rong, W., et al. (2011). An EMG-driven exoskeleton hand robotic training device on chronic stroke subjects: task training system for stroke rehabilitation. IEEE Int. Conf. Rehabil. Robot. 2011:5975340. doi: 10.1109/ICORR.2011.5975340
Hogan, N., Krebs, H. I., Rohrer, B., Palazzolo, J. J., Dipietro, L., Fasoli, S. E., et al. (2006). Motions or muscles? Some behavioral factors underlying robotic assistance of motor recovery. J. Rehabil. Res. Dev. 43, 605–618. doi: 10.1682/JRRD.2005.06.0103
Hu, X. L., Tong, R. K., Ho, N. S., Xue, J. J., Rong, W., and Li, L. S. (2015). Wrist rehabilitation assisted by an electromyography-driven neuromuscular electrical stimulation robot after stroke. Neurorehabil. Neural Repair 29, 767–776. doi: 10.1177/1545968314565510
Hussein, S., Schmidt, H., and Kruger, J. (2009). Adaptive control of an end-effector based electromechanical gait rehabilitation device,” in 2009 IEEE International Conference on Rehabilitation Robotics (Kyoto: IEEE), 366–371.
Israel, J. F., Campbell, D. D., Kahn, J. H., and Hornby, T. G. (2006). Metabolic costs and muscle activity patterns during robotic-and therapist-assisted treadmill walking in individuals with incomplete spinal cord injury. Phys. Ther. 86, 1466–1478. doi: 10.2522/ptj.20050266
Itaya, T., Murakami, Y., Ota, A., Nomura, E., Fukushima, T., and Nishigaki, M. (2017). Assessment model to identify patients with stroke with a high possibility of discharge to home: a retrospective cohort study. Stroke 48, 2812–2818. doi: 10.1161/STROKEAHA.117.018075
Jiang, N., Mrachacz-Kersting, N., Xu, R., Dremstrup, K., and Farina, D. (2014). “An accurate, versatile, and robust brain switch for neurorehabilitation,” in Brain-Computer Interface Research (Cham: Springer), 47–61.
Johnson, C. O., Nguyen, M., Roth, G. A., Nichols, E., Alam, T., Abate, D., et al. (2019). Global, regional, and national burden of stroke, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet Neurol. 18, 439–458. doi: 10.1016/S1474-4422(19)30034-1
Korik, A., Siddique, N., Sosnik, R., and Coyle, D. (2015). “E3D hand movement velocity reconstruction using power spectral density of EEG signals and neural network,” in 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (Milan: IEEE), 8103–8106.
Korik, A., Sosnik, R., Siddique, N., and Coyle, D. (2016). “Imagined 3D hand movement trajectory decoding from sensorimotor EEG rhythms,” in 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (Budapest: IEEE), 4591–4596.
Korik, A., Sosnik, R., Siddique, N., and Coyle, D. (2018). Decoding imagined 3D hand movement trajectories from EEG: evidence to support the use of mu, beta, and low gamma oscillations. Front. Neurosci. 12:130. doi: 10.3389/fnins.2018.00130
Krebs, H. I., Palazzolo, J. J., Dipietro, L., Ferraro, M., Krol, J., Rannekleiv, K., et al. (2003). Rehabilitation robotics: performance-based progressive robot-assisted therapy. Auton. Robots 15, 7–20. doi: 10.1023/A:1024494031121
Krishnan, C., Kotsapouikis, D., Dhaher, Y. Y., and Rymer, W. Z. (2013). Reducing robotic guidance during robot-assisted gait training improves gait function: a case report on a stroke survivor. Arch. Phys. Med. Rehabil. 94, 1202–1206. doi: 10.1016/j.apmr.2012.11.016
Kwak, N.-S., Müller, K.-R., and Lee, S.-W. (2015). A lower limb exoskeleton control system based on steady state visual evoked potentials. J. Neural Eng. 12:056009. doi: 10.1088/1741-2560/12/5/056009
Kwakkel, G., van Peppen, R., Wagenaar, R. C., Wood Dauphinee, S., Richards, C., Ashburn, A., et al. (2004). Effects of augmented exercise therapy time after stroke: a meta-analysis. Stroke 35, 2529–2539. doi: 10.1161/01.STR.0000143153.76460.7d
Kwong, P. W., and Ng, S. S. (2019). Cutoff score of the lower-extremity motor subscale of fugl-meyer assessment in chronic stroke survivors: a cross-sectional study. Arch. Phys. Med. Rehabil. 100, 1782–1787. doi: 10.1016/j.apmr.2019.01.027
Lee, K., Liu, D., Perroud, L., Chavarriaga, R., and Millán, J. R. (2017). A brain-controlled exoskeleton with cascaded event-related desynchronization classifiers. Rob. Auton. Syst. 90, 15–23. doi: 10.1016/j.robot.2016.10.005
Li, M., Xu, G., Xie, J., and Chen, C. (2018). A review: motor rehabilitation after stroke with control based on human intent. Proc. Inst. Mech. Eng. H 232, 344–360. doi: 10.1177/0954411918755828
Lin, I. H., Tsai, H. T., Wang, C. Y., Hsu, C. Y., Liou, T. H., and Lin, Y. N. (2019). Effectiveness and superiority of rehabilitative treatments in enhancing motor recovery within 6 months poststroke: a systemic review. Arch. Phys. Med. Rehabil. 100, 366–378. doi: 10.1016/j.apmr.2018.09.123
Liu, D., Chen, W., Pei, Z., and Wang, J. (2017). A brain-controlled lower-limb exoskeleton for human gait training. Rev. Sci. Instruments 88:104302. doi: 10.1063/1.5006461
López-Larraz, E., Trincado-Alonso, F., Rajasekaran, V., Pérez-Nombela, S., Del-Ama, A. J., Aranda, J., et al. (2016). Control of an ambulatory exoskeleton with a brain–machine interface for spinal cord injury gait rehabilitation. Front. Neurosci. 10:359. doi: 10.3389/fnins.2016.00359
Luu, T. P., Brantley, J. A., Nakagome, S., Zhu, F., and Contreras-Vidal, J. L. (2017). Electrocortical correlates of human level-ground, slope, and stair walking. PLoS ONE 12:e0188500. doi: 10.1371/journal.pone.0188500
Mehrholz, J., Thomas, S., Werner, C., Kugler, J., Pohl, M., and Elsner, B. (2017). Electromechanical-assisted training for walking after stroke. Cochrane Database Syst. Rev. 5:CD006185. doi: 10.1002/14651858.CD006185.pub4
Mehrholz, J., Wagner, K., Rutte, K., Meiβner, D., and Pohl, M. (2007). Predictive validity and responsiveness of the functional ambulation category in hemiparetic patients after stroke. Arch. Phys. Med. Rehabil. 88, 1314–1319. doi: 10.1016/j.apmr.2007.06.764
Merletti, R. (2000). Surface electromyography: the SENIAM project. Eur. J. Phys. Rehabil. Med. 36:167.
Merletti, R., and Farina, D. (2016). Surface Electromyography: Physiology, Engineering, and Applications. Hoboken, NJ: John Wiley and Sons.
Merlo, A., and Campanini, I. (2010). Technical aspects of surface electromyography for clinicians. Open Rehabil. J. 3, 98–109. doi: 10.2174/1874943701003010098
Moher, D., Liberati, A., Tetzlaff, J., and Altman, D. G. (2010). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int. J. Surg. 8, 336–341. doi: 10.1016/j.ijsu.2010.02.007
Molteni, F., Gasperini, G., Cannaviello, G., and Guanziroli, E. (2018). Exoskeleton and end-effector robots for upper and lower limbs rehabilitation: narrative review. Phys. Med. Rehabil. 10, S174–S188. doi: 10.1016/j.pmrj.2018.06.005
Mrachacz-Kersting, N., Jiang, N., Stevenson, A. J., Niazi, I. K., Kostic, V., Pavlovic, A., et al. (2015). Efficient neuroplasticity induction in chronic stroke patients by an associative brain-computer interface. J. Neurophysiol. 115, 1410–1421. doi: 10.1152/jn.00918.2015
Mrachacz-Kersting, N., Kristensen, S. R., Niazi, I. K., and Farina, D. (2012). Precise temporal association between cortical potentials evoked by motor imagination and afference induces cortical plasticity. J. Physiol. 590, 1669–1682. doi: 10.1113/jphysiol.2011.222851
Norrving, B., Barrick, J., Davalos, A., Dichgans, M., Cordonnier, C., Guekht, A., et al. (2018). Action plan for stroke in Europe 2018–2030. Eur. Stroke J. 3, 309–336. doi: 10.1177/2396987318808719
Oliveira, A. S., Schlink, B. R., Hairston, W. D., König, P., and Ferris, D. P. (2017). Restricted vision increases sensorimotor cortex involvement in human walking. J. Neurophysiol. 118, 1943–1951. doi: 10.1152/jn.00926.2016
Ortiz, G. A., and Sacco, L. R. (2014). Wiley Stats Ref: Statistics Reference Online. National Institutes of Health Stroke Scale (NIHSS).
Paek, A. Y., Agashe, H., and Contreras-Vidal, J. L. (2014). Decoding repetitive finger movements with brain activity acquired via non-invasive electroencephalography. Front. Neuroeng. 7:3. doi: 10.3389/fneng.2014.00003
Paredes, L. P., Farina, D., Shin, Y.-I., and Turolla, A. (2015). “Efficacy of torque versus myocontrol for active, robotic-assisted rehabilitation of the shoulder after stroke: an experimental study,” in 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER) (Montpellier: IEEE), 627–630.
Parvataneni, K., Olney, S. J., and Brouwer, B. (2007). Changes in muscle group work associated with changes in gait speed of persons with stroke. Clin. Biomech. 22, 813–820. doi: 10.1016/j.clinbiomech.2007.03.006
Ping, W., Low, K., McLaren, J., and des Ouches, P. J. (2013). “Muscle activation of participants while walking on a robotic-assisted locomotion training,” 39th Annual Northeast Bioengineering Conference (IEEE), 19–20.
Pons, J. L. (2010). Rehabilitation exoskeletal robotics. IEEE Eng. Med. Biol. Mag. 29, 57–63. doi: 10.1109/MEMB.2010.936548
Prasad, G., Herman, P., Coyle, D., McDonough, S., and Crosbie, J. (2010). Applying a brain-computer interface to support motor imagery practice in people with stroke for upper limb recovery: a feasibility study. J Neuroeng Rehabil. 7:60. doi: 10.1186/1743-0003-7-60
Presacco, A., Forrester, L. W., and Contreras-Vidal, J. L. (2012). Decoding intra-limb and inter-limb kinematics during treadmill walking from scalp electroencephalographic (EEG) signals. IEEE Transac. Neural Syst. Rehabil. Eng. 20, 212–219. doi: 10.1109/TNSRE.2012.2188304
Presacco, A., Goodman, R., Forrester, L., and Contreras-Vidal, J. L. (2011). Neural decoding of treadmill walking from noninvasive electroencephalographic signals. J. Neurophysiol. 106, 1875–1887. doi: 10.1152/jn.00104.2011
Raja, B., Neptune, R. R., and Kautz, S. A. (2012). Coordination of the non-paretic leg during hemiparetic gait: expected and novel compensatory patterns. Clin. Biomech. 27, 1023–1030. doi: 10.1016/j.clinbiomech.2012.08.005
Sarasola-Sanz, A., Irastorza-Landa, N., Lopez-Larraz, E., Bibian, C., Helmhold, F., Broetz, D., et al. (2017). “A hybrid brain-machine interface based on EEG and EMG activity for the motor rehabilitation of stroke patients,” in IEEE International Conference on Rehabilitation Robotics, Vol. 2017 (London), 895–900.
Seeber, M., Scherer, R., Wagner, J., Solis-Escalante, T., and Müller-Putz, G. R. (2014). EEG beta suppression and low gamma modulation are different elements of human upright walking. Front. Hum. Neurosci. 8:485. doi: 10.3389/fnhum.2014.00485
Seeber, M., Scherer, R., Wagner, J., Solis-Escalante, T., and Müller-Putz, G. R. (2015). High and low gamma EEG oscillations in central sensorimotor areas are conversely modulated during the human gait cycle. Neuroimage 112, 318–326. doi: 10.1016/j.neuroimage.2015.03.045
Sloot, L., Bae, J., Baker, L., O'Donnell, K., Menard, N., Porciuncula, F., et al. (2018). “O 089-A soft robotic exosuit assisting the paretic ankle in patients post-stroke: effect on muscle activation during overground walking,” in Gait Posture. doi: 10.1016/j.gaitpost.2018.06.124
Soekadar, S. R., Birbaumer, N., Slutzky, M. W., and Cohen, L. G. (2015). Brain–machine interfaces in neurorehabilitation of stroke. Neurobiol. Dis. 83, 172–179. doi: 10.1016/j.nbd.2014.11.025
Srivastava, S., Kao, P. C., Reisman, D. S., Scholz, J. P., Agrawal, S. K., and Higginson, J. S. (2016). Robotic assist-as-needed as an alternative to therapist-assisted gait rehabilitation. Int. J. Phys. Med. Rehabil. 4:370. doi: 10.4172/2329-9096.1000370
Srivastava, S., Patten, C., and Kautz, S. A. (2019). Altered muscle activation patterns (AMAP): an analytical tool to compare muscle activity patterns of hemiparetic gait with a normative profile. J. Neuroeng. Rehabil. 16:21. doi: 10.1186/s12984-019-0487-y
Storzer, L., Butz, M., Hirschmann, J., Abbasi, O., Gratkowski, M., Saupe, D., et al. (2016). Bicycling and walking are associated with different cortical oscillatory dynamics. Front. Hum. Neurosci. 10:61. doi: 10.3389/fnhum.2016.00061
Taveggia, G., Borboni, A., Mulé, C., Villafañe, J. H., and Negrini, S. (2016). Conflicting results of robot-assisted versus usual gait training during postacute rehabilitation of stroke patients: a randomized clinical trial. Int. J. Rehabil. Res. 39:29. doi: 10.1097/MRR.0000000000000137
Thomas, B., Ciliska, D., Dobbins, M., and Micucci, S. (2004). A process for systematically reviewing the literature: providing the research evidence for public health nursing interventions. Worldviews Evid. Based Nurs. 1, 176–184. doi: 10.1111/j.1524-475X.2004.04006.x
Thomas, B., Ciliska, D., Dobbins, M., and Micucci, S. (2008). Quality Assessment Tool for Quantitative Studies Dictionary: The Effective Public Health Practice Project (EPHPP). McMaster University.
Tseng, S. C., and Morton, S. M. (2010). Impaired interlimb coordination of voluntary leg movements in poststroke hemiparesis. J. Neurophysiol. 104, 248–257. doi: 10.1152/jn.00906.2009
Vaca Benitez, L. M., Tabie, M., Will, N., Schmidt, S., Jordan, M., and Kirchner, E. A. (2013). Exoskeleton technology in rehabilitation: towards an EMG-based orthosis system for upper limb neuromotor rehabilitation. J. Robotics 2013:610589. doi: 10.1155/2013/610589
Van Criekinge, T., Vermeulen, J., Wagemans, K., Schröder, J., Embrechts, E., Truijen, S., et al. (2019). Lower limb muscle synergies during walking after stroke: a systematic review. Disabil. Rehabil. 1–10. doi: 10.1080/09638288.2019.1578421
Van Dokkum, L., Ward, T., and Laffont, I. (2015). Brain computer interfaces for neurorehabilitation–its current status as a rehabilitation strategy post-stroke. Ann. Phys. Rehabil. Med. 58, 3–8. doi: 10.1016/j.rehab.2014.09.016
Varkuti, B., Guan, C., Pan, Y., Phua, K. S., Ang, K. K., Kuah, C. W., et al. (2013). Resting state changes in functional connectivity correlate with movement recovery for BCI and robot-assisted upper-extremity training after stroke. Neurorehabil. Neural Repair 27, 53–62. doi: 10.1177/1545968312445910
Veerbeek, J. M., van Wegen, E., van Peppen, R., van der Wees, P. J., Hendriks, E., Rietberg, M., et al. (2014). What is the evidence for physical therapy poststroke? A systematic review and meta-analysis. PloS ONE 9:e87987. doi: 10.1371/journal.pone.0087987
Von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., et al. (2014). The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Int. J. Surg. 12, 1495–1499. doi: 10.1016/j.ijsu.2014.07.013
Wagner, J., Solis-Escalante, T., Grieshofer, P., Neuper, C., Müller-Putz, G., and Scherer, R. (2012). Level of participation in robotic-assisted treadmill walking modulates midline sensorimotor EEG rhythms in able-bodied subjects. Neuroimage 63, 1203–1211. doi: 10.1016/j.neuroimage.2012.08.019
Wagner, J., Solis-Escalante, T., Scherer, R., Neuper, C., and Müller-Putz, G. (2014). It's how you get there: walking down a virtual alley activates premotor and parietal areas. Front. Hum. Neurosci. 8:93. doi: 10.3389/fnhum.2014.00093
Wilkins, E., Wilson, L., Wickramasinghe, K., Bhatnagar, P., Leal, J., Luengo-Fernandez, R., et al. (2017). European Cardiovascular Disease Statistics 2017. University of BATH.
Winslow, A. T., Brantley, J., Zhu, F., Vidal, J. L., and Huang, H. (2016). Corticomuscular coherence variation throughout the gait cycle during overground walking and ramp ascent: a preliminary investigation. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2016, 4634–37. doi: 10.1109/EMBC.2016.7591760
Wolpaw., J. R. (2012). “Something new under the sun,” in Brain-Computer Interfaces: Principles and Practice, eds J. R. Wolpaw, and E. W. Wolpaw (Oxford University Press), 3–14. doi: 10.1093/acprof:oso/9780195388855.003.0001
Keywords: stroke rehabilitation, robot-assisted gait trainer, electromyography, electroencephalography, human–machine interface, brain–computer interface
Citation: Lennon O, Tonellato M, Del Felice A, Di Marco R, Fingleton C, Korik A, Guanziroli E, Molteni F, Guger C, Otner R and Coyle D (2020) A Systematic Review Establishing the Current State-of-the-Art, the Limitations, and the DESIRED Checklist in Studies of Direct Neural Interfacing With Robotic Gait Devices in Stroke Rehabilitation. Front. Neurosci. 14:578. doi: 10.3389/fnins.2020.00578
Received: 05 December 2019; Accepted: 12 May 2020;
Published: 30 June 2020.
Edited by:
Michela Chiappalone, Italian Institute of Technology (IIT), ItalyReviewed by:
Seong-Whan Lee, Korea University, South KoreaTrieu Phat Luu, University of Houston, United States
Copyright © 2020 Lennon, Tonellato, Del Felice, Di Marco, Fingleton, Korik, Guanziroli, Molteni, Guger, Otner and Coyle. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Olive Lennon, b2xpdmUubGVubm9uJiN4MDAwNDA7dWNkLmll