Sonification of Arm Movements in Stroke Rehabilitation – A Novel Approach in Neurologic Music Therapy

Gross motor impairments are common after stroke, but efficient and motivating therapies for these impairments are scarce. We present an innovative musical sonification therapy, especially designed to retrain patients’ gross motor functions. Sonification should motivate patients and provide additional sensory input informing about relative limb position. Twenty-five stroke patients were included in a clinical pre–post study and took part in the sonification training. The patients’ upper extremity functions, their psychological states, and their arm movement smoothness were assessed pre and post training. Patients were randomly assigned to either of two groups. Both groups received an average of 10 days (M = 9.88; SD = 2.03; 30 min/day) of musical sonification therapy [music group (MG)] or a sham sonification movement training [control group (CG)], respectively. The only difference between the two protocols was that in the CG no sound was played back during training. In the beginning, patients explored the acoustic effects of their arm movements in space. At the end of the training, the patients played simple melodies by coordinated arm movements. The 15 patients in the MG showed significantly reduced joint pain (F = 19.96, p < 0.001) in the Fugl–Meyer assessment after training. They also reported a trend to have improved hand function in the stroke impact scale as compared to the CG. Movement smoothness at day 1, day 5, and the last day of the intervention was compared in MG patients and found to be significantly better after the therapy. Taken together, musical sonification may be a promising therapy for motor impairments after stroke, but further research is required since estimated effect sizes point to moderate treatment outcomes.

Introduction

Stroke is a major cause of mortality and morbidity in both the developed and developing world (1). In Germany, stroke is one of the most common disorders with an estimated 200,000 first events and 66,000 recurrent events in 2008 (2). The World Health Organization stresses the need to collect high quality longitudinal data on rehabilitation and to improve the comparability between studies (3).

The rehabilitation of stroke patients remains a challenge, although there are currently several new training programs under development that aim at improved efficiency and sustainability of stroke rehabilitation (4). Some of the traditional rehabilitation programs lack general acceptance by patients, due to the required endurance and high demands on the patients’ cooperation, which sometimes is perceived as a frustrating experience (5). Yet, even the well-established standard physiotherapies do not unambiguously provide evidence of efficacy when it comes to improvement of skilled motor behavior (6–8). Therefore, there is an urgent need for innovative, motivating, and goal-directed training protocols in stroke rehabilitation.

In this article, we present an innovative approach to rehabilitation by retraining the gross motor functions of the affected upper limbs using musical sonification. In an earlier clinical feasibility study (9), we showed how a musical sonification therapy could be applied. The data presented herein were obtained with this method from a larger number of patients. Sonification stands for the usage of non-speech sound representing otherwise not audible information (10). One of the first sonification devices was the Geiger–Müller counter, which detects electromagnetic radiation and communicates a decay by a click sound. In the present study, arm movements were translated into sound. In two earlier studies, we demonstrated the efficacy of a music-supported stroke rehabilitation training utilizing a MIDI drumset and a MIDI piano (11, 12). Stroke patients with some residual abilities to move the arm and the fingers were instructed to play simple tunes (nursery rhymes or folk songs) on either instrument. We could show that auditory sensorimotor circuits established via this form of music-supported therapy (MST) promotes beneficial neuroplasticity in stroke patients (13, 14). One of the few constraints of MST was that it was mainly designed to retrain fine-motor skills on MIDI instruments. And it did not provide continuous real-time feedback for the gross motor functions of the arm, which are more frequently impaired in early rehabilitation stages. A real-time movement feedback may be beneficial since it informs the patients about the way they move, not only whether they hit the target or not. With the musical sonification therapy presented here, patients repeatedly train movements with their affected arm in a predefined space. They form associations of their relative armposition in space and the corresponding sound at this specific position. At the end, they play familiar melodies by moving their arm. This musical sonification therapy, therefore, broadens the scope to train stroke patients from an earlier stage on, when still suffering from gross motor dysfunction. Musical sonification will not only contribute to the motivation of the patients due to its playful and positive emotional character, but may also improve motor control, since auditory real-time feedback of the patient’s arm movements can be substituted for potentially lost proprioception. There are several preliminary studies with healthy participants that apply non-musical sonification in motor control and the perception of movements (15–17). Schmitz et al. found that sonifying breast stroke movements led to more precise perceptual judgments of movement velocity. They showed that sonification of movements amplifies the human action observation system as indicated by more pronounced fMRI connectivity patterns between the activation peaks of the left superior and medial posterior temporal regions with the basal ganglia, the thalamus, and frontal regions for movement congruent sonification stimuli. Thus, sonification may be an important method to enhance training and therapy effects in neurological rehabilitation. Chen et al. developed a real-time, multimodal feedback system for stroke rehabilitation (18). This sonification system was tested with stroke patients and showed promising results (19). However, in their design, music was only a passive byproduct of arm movements. That means participants did not play with the sonification sound intentionally. They moved their arms and harmonic music progressions were played back to them. In contrast to that, we developed a musical sonification therapy to train stroke patients to explicitly and consciously play music through intended movements of their affected upper extremity. Thus, we hoped to be able to use the beneficial effects of music on neuroplasticity to facilitate the recovery after stroke (13). Since in other studies repetitive exercise has been shown to be effective (8, 20), our training is of a repetitive nature too. We hypothesize that the auditory cues provided by the sonification may make multimodal associative learning possible where otherwise mere visual and motor learning would have taken place. We assume that patients will benefit in their rehabilitation process from guided attention, necessary concentration, and long-term motivation to play music. Rohrer et al. (21) (see also references therein) describe an increase of several movement smoothness indices in both acute and chronic stroke patients during movement therapy. Hence, the present study additionally investigated changes in movement smoothness over the course of the therapy. After having evaluated an optimal two-dimensional sonification mapping (22), we now present a more detailed analysis of our three-dimensional musical sonification therapy with a larger sample (9).

Materials and Methods

Patients

Twenty-five inpatients (11 women, see Table 1 for details) at the BDH Neurological Rehabilitation Hospital in Hessisch Oldendorf, Germany, participated after giving informed consent. They suffered from a moderate impairment of motor function of the upper extremity after stroke. Inclusion criteria were (a) patients had to have residual function of the affected extremity (i.e., the ability to move the affected arm and the index finger without help from the healthy side), furthermore, (b) an overall Barthel index higher than 50 was required, and (c) patients had to be right-handed. Patients with other neurological or psychiatric disorders were excluded.

TABLE 1

Table 1. Demographic details of the 25 patients.

Patients were pseudorandomly assigned to the experimental or to the control group (CG) by the supervisor of the study who was not the experimenter. The experimental group received conventional physiotherapy plus an average of 10 days of a musical sonification training [music group (MG), henceforth].

The CG also received conventional physiotherapy plus a sham sonification movement training with exactly the same movements required as in the sonification study, but with no sound being played back. All patients were native German speakers. The study was approved by the Ethics Review Board of the Hannover Medical School (MHH).

Evaluation of Motor Functions, Stroke Impact, and Movement Smoothness

Procedure

Patients were tested pre and post training with a battery of clinical motor function tests and a psychological questionnaire. The test battery consisted of (a) the upper extremity part of the Fugl–Meyer assessment (FMA), still considered the gold standard in evaluating motor recovery after stroke (23, 24). The FMA consists of four bigger subsections. FM.A–D assesses the motor function of the affected arm by checking reflexes, volitional movements, wrist and hand function, and the coordination of the upper extremity. In FM.H, the tactile sensation compared to the non-affected other extremity is assessed. In FM.I, passive joint motion is assessed and FM.J passively measures joint pain. (b) The action research arm test (ARAT) rates upper limb functioning by using observational methods and collecting behavioral data (25, 26). (c) The box and block test (BBT) assesses unilateral gross manual dexterity (27, 28). (d) The nine-hole pegboard test (NHPT) measures finger dexterity (29) and (e) the stroke impact scale (SIS) evaluates the health status following a stroke, including subscales for emotional well-being, memory, thinking, and social participation. The subscales are SIS.1 that asks for physical problems, which may have occurred as a result of the stroke; SIS.2 investigates memory and thinking of the patient; SIS.3 assesses mood and emotions; SIS.4 checks for the communication skills in speaking, reading, and writing; SIS.5 determines how impaired the patient is during daily activities; in SIS.6, the mobility of the patient is investigated; SIS.7 assesses the remaining function of the affected hand; in SIS.8, the patient is asked to which extent he or she is impaired in their social activities; SIS.9 is a self-rating of the patient on how far the stroke recovery has progressed (30, 31).

Movement data were recorded in the MG only using a custom made computer program and two inertial sensors (Xsens, X-MB-XB3), one attached to the fore arm close to the wrist and one attached to the upper arm of the patients. It took approximately 1 h to complete the test battery at the beginning and at the end of the study. Regular training sessions lasted approximately 30 min.

Sonification Training

Training

After the pretests the patients received either an average of 10 days (M = 9.88; SD = 2.03) of musical sonification training (MG), or 10 days of sham sonification training (CG), following the same protocol as MG but with loudspeakers switched off. The whole procedure followed a standardized protocol to train gross motor functions of the affected right upper extremity in a repetitive manner. Patients were seated as close as possible to the desk with the wooden 3D space frame atop so that the board nearly touched their stomach. Depending on whether in a wheelchair or not, the desk with the 3D space on was adjusted to the individual needs of the patients before starting the training. To get acquainted with the sonification system and the acoustic effects produced by their own arm movements, patients first had to freely move their arm in a three-dimensional sonification space, a wooden cubic frame of 51 cm side length, confined by four vertical beams in the corners of the bottom board (Figure 1). The beams were labeled with the note pitches; the board was subdivided into nine labeled fields for ease of instructions.

FIGURE 1

Figure 1. The 3D space defined by a wooden frame. Pitch was mapped onto the y-axis ranging from c′ at the bottom to a′ at the top. Brightness was mapped onto the x-axis from the left (dull) to the right (bright) and volume onto the z-axis with loudness increasing with increasing proximity. Positions in the x–z plane were labeled for ease of instruction.

Movement sonification was implemented so that upward movements resulted in an ascending C major scale from c′ (256 Hz, in Helmholtz pitch notation) to the sixth interval a′ (440 Hz). Vertical movements in this space resulted in a change in brightness of sound and, thus, mimicking real musical instrument timbres (modeled by varying the number and amplification of overtones in the sound synthesis; SynthesisToolKit – STK; Cook and Scavone (32); from a rather dull clarinet sound at the very left to saxophone in the middle and a bright sounding bowed instrument at the very right). Movements along the z-axis caused an increase in loudness from proximal to distal. After a first exploration phase to allow for implicitly learning the rules of the musical sonification, more complex exercises followed, demanding incremental degrees of difficulty: At the beginning of each training session patients had to play four upward and downward legato C major scales at position 1 (Figure 1). The same exercise was then repeated at positions 2, 3, 7, and 9. [You can listen to the legato scale playing of a patient at day 1 (Audio S1 in Supplementary Material), day 5 (Audio S2 in Supplementary Material), and the last training day (Audio S3 in Supplementary Material)]. These exercises were followed by playing musical intervals by moving the arm faster but as precisely as possible, from c′ to d′, from c′ to e′, from c′ to f′, from c′ to g′, and from c′ to a′. This exercise was repeated four times at position 1 and then likewise at positions 2, 3, 7, and 9. The final goal of the training was to teach patients to play several simple nursery rhymes or other familiar tunes only by moving their affected right arm in the three-dimensional sonification space.

The experimenter gave verbal instructions for the training procedure. Additionally, the experimenter pointed at the visual cues written at the positions on the wooden frame of the 3D space (Figure 1). When playing the melodies, patients could read the required “coordinates” from a sheet provided. All melodies were played vertically, i.e., along the y-axis, at position 1 (Figure 1). Tones could be repeated by dipping the hand horizontally in one direction while maintaining vertical position. Patients always moved their impaired arms by themselves. Arm movements were never guided nor physically supported by the experimenter.

Patients’ arm movements were sonified in real time using two small inertial sensors (Xsens, X-MB-XB3) placed at the wrist and the upper arm of the affected limb. The continuous data stream comprising acceleration, rotation, and gravity were transferred via Bluetooth to a laptop and stored for later evaluation in the MG only. The spatial information of the arm movements in 3D space were sonified in real time. The only difference in the training procedure for the sham sonification group (CG) was the muted playback system. Otherwise, exactly the same exercises were carried out during the training sessions.

Data Analysis

Statistical analysis was conducted using R¹ (version 3.2.1) in RStudio Server² (version 0.99.467) on data of the motor function tests and the SIS. Motor test and questionnaire data were preprocessed and tested whether they complied with ANCOVA assumptions. Pretest scores were then used as covariate either in separate ANCOVAs for each response variable, or in the Johnson–Neyman test when applicable: when comparing two groups with respect to their performance before and after treatment, and the assumption of homogenous regression slopes is violated, the Johnson–Neyman technique is used instead of ANCOVA. It allows for the two groups to have different slopes, and tests whether they differ. Additionally, it determines an “area of significance” (33) where the two groups show a statistically meaningful difference in their posttreatment score, after controlling for the differing slopes.

Arm movement data from the four trials at position 1 (Figure 1) from each MG patient were collected and transformed into Cartesian coordinates using a custom-made computer program. Three-dimensional movement trajectories from upward and downward legato C major scales were manually selected and Butterworth lowpass filtered (cut-off 8 Hz) to eliminate tremor movements. Movement smoothness was calculated as the curvature index κ:

${\kappa }^2=\frac{\left({\dot{x}}^2+{\dot{y}}^2+{\dot{z}}^2\right)\left({\ddot{x}}^2+{\ddot{y}}^2+{\ddot{z}}^2\right){\left(\dot{x}\ddot{x}+\dot{y}\ddot{y}+\dot{z}\ddot{z}\right)}^2}{{\left({\dot{x}}^2+{\dot{y}}^2+{\dot{z}}^2\right)}^3}$

Osu et al. (34) (see ibid. for advantages of curvature over other measures for smoothness, like jerk, or snap), representing the inverse of the movement radius for each trajectory point. To synchronize an increase in movement smoothness with an increase in κ and to account for positive skewness of κ, the median negative logarithm for each movement segment was taken.

These values were then compared between the MGs’ first, fifth, and last therapy sessions using Friedman’s test, followed by Wilcoxon’s signed rank test as post hoc test to determine an increase in smoothness during (day 5) or after the end of the sonification training. The kernel density estimation of the transformed κ (see Figure 2) was calculated with a data-driven kernel suggested by Sheather and Jones (35) [cited in Ref. (36)].

FIGURE 2

Figure 2. Movement smoothness at day 1, day 5, and the last day of the intervention was compared in the treatment group (MG) patients and found to be significantly better after the therapy. Shown here are the kernel density estimates of the MG smoothness measures at day 1 (red line), day 5 (green line), and the last day of the intervention (blue line; see Materials and Methods and Results for details) with the smoothness index shown on the x-axis and the density estimation on the y-axis. Medians of the corresponding distribution are depicted as dashed lines in corresponding color.

Results

Motor Tests

The main results of this study are depicted in Table 2. Although the ANCOVA group comparisons for ARAT, BBT, and NHPT were non-significant, MG patients showed a significantly higher improvement compared to the CG in the subscale FM.J of the FMA [F(1,21) = 21.23, p < 0.05], as shown by the Johnson–Neyman technique, suggesting that they perceived reduced joint pain after the training. The two groups’ corrected pre–post differences differed significantly for pretest scores below 20, suggesting an advantage for the sonification therapy over sham treatment for patients scoring low in the FM.J subscale (Figure 3).

TABLE 2

Table 2. ANCOVA group comparison results for the motor tests and the stroke impact scale.

FIGURE 3

Figure 3. Fugl–Meyer joint pain subscale results. Taking into account the unequal regression slopes of CG and MG, the Johnson–Neyman technique estimates the two groups’ post-test difference (triangles, dashed straight line) from the joint pretest values and determines upper and lower confidence intervals (CI; crosses, dotted lines). The triangles and crosses do not represent individual data points but estimated values. The CIs and the solid straight line at y = 0, confine the area where the two groups differed significantly in their post-test Fugl–Meyer Joint pain score. Compared to CG patients, MG patients with a pretest score below 20 seemed to benefit from the additional sonification therapy.

Stroke Impact Scale

The SIS total value was significantly higher for the MG as compared to the CG, after the training (F = 4.63, p = 0.0445). But, after correcting for the random group difference prior to the training, there was no more pretest: group interaction to be found [F(1,21) = 3.83, p > 0.05]. A pre test group difference for SIS.2 [two-sided paired t-test (t = 2.229, df = 19.92, p = 0.0375)] was detected. For that reason this specific subscale was not included into further evaluation. The subscale SIS.7 showed a trend (F = 4.278, p = 0.0552) toward better hand function of the MG patients after the training. All other ANCOVA group comparisons were non-significant.

Arm Movement Smoothness

Movement data from two MG patients could not be retrieved due to technical failure of the recording system. For the remaining 13 patients, trajectory smoothness was derived at day 1, day 5, and the last day of their training. A significant difference between training days was shown with Friedman’s test (χ² = 6.222, df = 2, p = 0.0445; see Figure 2), and Wilcoxon post hoc tests showed a significantly higher movement smoothness at the last day as compared to the first training day (V = 7, p = 0.037). But after applying the Bonferroni–Holms correction this effect was not significant anymore (p = 0.074). This could be due to a very subtle effect for which the Wilcoxon test is not powerful enough to detect. Also the small number of subjects should be taken into account.

Discussion

The results of this clinical sonification study show that a musical sonification therapy may be a promising new way of treating motor impairments after stroke. Musical sonification therapy may even improve psychological well-being after stroke. The 15 patients of the musical sonification group improved significantly compared to the movement training group in the Fugl–Meyer subscale assessing joint pain. Reduced pain after a motor training or a mechano-acoustic vibration therapy for stroke patients was also shown by Lee and Kim (37) and Constantino et al. (38). The MG patients of our study also showed a trend to regain a better hand function in the SIS after the training. In addition to the motor domain, the SIS assesses the emotional state of the patient, memory, and social participation. Movement smoothness pre and post intervention was found to be significantly better after the therapy in the MG. This is in line with the findings of Rohrer et al. (21) who showed an increased movement smoothness with a robotic therapy device in four of five measures in 31 patients recovering from stroke. In contrast, the patients of our CG, receiving only a “sham” movement training without musical feedback improved very little and non-significantly in some of the tests. Thus, we assume that the musical aspect plays an important role in the sonification therapy. However, in this study, we did not control whether it is the musical aspect of sonification or just any sound information provided by the sonification. Furthermore, different motor tests should be included in future research in order to prevent floor (NHPT) and ceiling effects (ARAT), which were found in some of the tests in this study. Of course, as we only present a small clinical trial with limited statistical power, results need to be verified with a larger group of patients.

The novel aspect of our approach is that we encourage the patients in the musical sonification group to actively play and create music by moving their arms. This way, music was not only a byproduct of, e.g., a grasping motion. Instead, movements resembled more a novel musical instrument patients were starting to play. This musical instrument was sometimes compared to a theremin by professional musicians. Hence, our sonification training was designed to resemble a music lesson rather than shaping a movement during sound playback. Furthermore, we used musical stimuli, such as a musical major scale with discrete intervals and timbre parameters derived from the sound characteristics of acoustical musical instruments, as opposed to the widely used sound mappings where tone pitch is scaled continuously and rather artificial sounds are applied (39). The main idea underlying our hypothesis was that participants could improve control of arm positions in space via associative learning, leading to associating a given relative arm position with a specific musical sound. This sound-location association may then substitute the frequently declined, or even lost, proprioception. Additionally, the arm movement trajectories from outset to the target position were audible as well. Thus, multimodal learning might have taken place because patients received sound as an additional parameter supplying information. One could speculate that this multimodal learning could help to close the sensorimotor loop, which may have been affected by the stroke.

In view of the clinical application, reduced gross motor functions of the arm and reduced proprioception are common disabilities in stroke patients (40). Hence, the advantages of continuous real-time musical feedback are obvious: the therapy, therefore, aims at retraining gross motor movements of the arm, which are the most disabling challenges in early rehabilitation of stroke. Second, real-time sonification may substitute deficits in proprioception of the arm, which frequently are a consequence of stroke.

Finally, this form of therapy is highly motivating and could thus enhance motor functions and the emotional well-being in some patients, maybe through the creative, playful character of this musical sonification device (41–44).

To summarize, we have developed and tested a novel musical sonification therapy in a group of patients, which supports learning effects in auditory sensory–motor integration. Now, multimodal learning of spatial, motor, auditory, and proprioceptive information in rehabilitation of arm motor control in stroke patients needs to be evaluated in a larger multicentered representative randomized controlled clinical trial.

Author Contributions

All authors listed have made substantial, direct, and intellectual contribution to the work and approved it for publication.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

This work was supported by the cortexplorer program of the Hertie Foundation for Neurosciences (http://www.ghst.de/en/neurosciences/cortexplorer/). This paper is part of a Ph.D. of DS at the Center for Systems Neurosciences (ZSN), Hanover, Germany. The authors wish to thank Prof. Alfred Effenberg, Dr. Gerd Schmitz (both at Leibniz University Hanover, Institute of Sport Science), and Prof. Holger Blume (Leibniz University Hanover, Institute of Microelectronic Systems) for important insights while collaborating in an earlier joint European Regional Development Fund project on movement sonification. We also wish to thank Benjamin Krüger and Dr. H-PB for implementing the real-time 3D sonification for the clinical study and Prof. Jörg Remy, Till Engert, and Steffen Rummel (SRH Hochschule der populären Künste GmbH, Berlin, Germany, University of Applied Sciences) for further development. Finally, we would like to thank the patients and the staff of the BDH Klinik Hessisch Oldendorf for their ongoing support and patience.

Supplementary Material

The Supplementary Material for this article can be found online at http://journal.frontiersin.org/article/10.3389/fneur.2016.00106

Footnotes

1. ^http://www.r-project.org
2. ^http://www.rstudio.com

References

1. Black M, Wang W, Wang W. Ischemic stroke: from next generation sequencing and GWAS to community genomics? OMICS (2015) 19:451–60. doi:10.1089/omi.2015.0083

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Wiedmann S, Heuschmann PU, Hillmann S, Busse O, Wiethölter H, Walter GM, et al. The quality of acute stroke care – an analysis of evidence – based indicators in 260 000 patients. Dtsch Arztebl Int (2014) 111:759–65. doi:10.3238/arztebl.2014.0759

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Sauzet O, Kleine M, Menzel-Begemann A, Exner A-K. Longitudinal randomised controlled trials in rehabilitation post-stroke: a systematic review on the quality of reporting and use of baseline outcome values. BMC Neurol (2015) 15:99. doi:10.1186/s12883-015-0344-y

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Lohse KR, Hilderman CGE, Cheung KL, Tatla S, der Loos HFMV. Virtual reality therapy for adults post-stroke: a systematic review and meta-analysis exploring virtual environments and commercial games in therapy. PLoS One (2014) 9:e93318. doi:10.1371/journal.pone.0093318

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Pulman J, Buckley E, Clark-Carter D. A meta-analysis evaluating the effectiveness of two different upper limb hemiparesis interventions on improving health-related quality of life following stroke. Top Stroke Rehabil (2013) 20:189–96. doi:10.1310/tsr2002-189

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Hakkennes S, Keating JL. Constraint-induced movement therapy following stroke: a systematic review of randomised controlled trials. Aust J Physiother (2005) 51:221–31. doi:10.1016/S0004-9514(05)70003-9

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Peurala SH, Kantanen MP, Sjögren T, Paltamaa J, Karhula M, Heinonen A. Effectiveness of constraint-induced movement therapy on activity and participation after stroke: a systematic review and meta-analysis of randomized controlled trials. Clin Rehabil (2012) 26:209–23. doi:10.1177/0269215511420306

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Stevenson T, Thalman L, Christie H, Poluha W. Constraint-induced movement therapy compared to dose-matched interventions for upper-limb dysfunction in adult survivors of stroke: a systematic review with meta-analysis. Physiother Can (2012) 64:397–413. doi:10.3138/ptc.2011-24

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Scholz DS, Rohde S, Großbach M, Rollnik J, Altenmüller E. Moving with music for stroke rehabilitation: a sonification feasibility study. Ann N Y Acad Sci (2015) 1337:69–76. doi:10.1111/nyas.12691

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Kramer G, Walker B, Bonebrighte T. Sonification Report: Status of the Field and Research Agenda. Santa Fe, NM: National Science Foundation, International Community for Auditory Display (ICAD) (1999).

Google Scholar

11. Schneider S, Schönle PW, Altenmüller E, Münte TF. Using musical instruments to improve motor skill recovery following a stroke. J Neurol (2007) 254:1339–46. doi:10.1007/s00415-006-0523-2

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Altenmüller E, Marco-Pallares J, Münte TF, Schneider S. Neural reorganization underlies improvement in stroke-induced motor dysfunction by music-supported therapy. Ann N Y Acad Sci (2009) 1169:395–405. doi:10.1111/j.1749-6632.2009.04580.x

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Rojo N, Amengual J, Juncadella M, Rubio F, Camara E, Marco-Pallares J, et al. Music-supported therapy induces plasticity in the sensorimotor cortex in chronic stroke: a single-case study using multimodal imaging (fMRI-TMS). Brain Inj (2011) 25:787–93. doi:10.3109/02699052.2011.576305

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Amengual JL, Rojo N, de Las Heras MV, Marco-Pallarés J, Grau-Sánchez J, Schneider S, et al. Sensorimotor plasticity after music-supported therapy in chronic stroke patients revealed by transcranial magnetic stimulation. PLoS One (2013) 8:e61883. doi:10.1371/journal.pone.0061883

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Scheef L, Boecker H, Daamen M, Fehse U, Landsberg MW, Granath D-O, et al. Multimodal motion processing in area V5/MT: evidence from an artificial class of audio-visual events. Brain Res (2009) 1252:94–104. doi:10.1016/j.brainres.2008.10.067

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Schmitz G, Mohammadi B, Hammer A, Heldmann M, Samii A, Münte TF, et al. Observation of sonified movements engages a basal ganglia frontocortical network. BMC Neurosci (2013) 14:32. doi:10.1186/1471-2202-14-32

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Schmitz G, Kroeger D, Effenberg AO. A mobile sonification system for stroke rehabilitation. Sonification as concurrent augmented feedback for motor skill learning and the importance of mapping design. The 20th International Conference on Auditory Display (ICAD-2014). New York (2014).

Google Scholar

18. Chen Y, Huang H, Xu W, Wallis R, Sundaram H, Rikakis T, et al. The design of a real-time, multimodal biofeedback system for stroke patient rehabilitation. Proceedings of the 14th ACM Multimedia Conference (MM ‘06). Santa Barbara, CA (2006).

Google Scholar

19. Wallis I, Ingalls T, Rikakis T, Olsen L, Chen Y, Xu W, et al. Real-time sonification of movement for an immersive stroke rehabilitation environment. Proceedings of the 13th International Conference on Auditory Display. Montréal, Canada (2007).

Google Scholar

20. Taub E, Uswatte G, Pidikiti R. Constraint-induced movement therapy: a new family of techniques with broad application to physical rehabilitation – a clinical review. J Rehabil Res Dev (1999) 36:237–51.

Google Scholar

21. Rohrer B, Fasoli S, Krebs HI, Hughes R, Volpe B, Frontera WR, et al. Movement smoothness changes during stroke recovery. J Neurosci (2002) 22:8297–304.

PubMed Abstract | Google Scholar

22. Scholz DS, Wu L, Schneider J, Pirzer J, Grossbach M, Rollnik JD, et al. Sonification as a possible stroke rehabilitation strategy. Front Neurosci (2014) 8:332. doi:10.3389/fnins.2014.00332

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Crow JL, van der Wel BCH. Hierarchical properties of the motor function sections of the Fugl-Meyer assessment scale for people after stroke: a retrospective study. Phys Ther (2008) 88:1554–67. doi:10.2522/ptj.20070186

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Woodbury ML, Velozo CA, Richards LG, Duncan PW, Studenski S, Lai S-M. Longitudinal stability of the Fugl-Meyer assessment of the upper extremity. Arch Phys Med Rehabil (2008) 89:1563–9. doi:10.1016/j.apmr.2007.12.041

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Platz T, Pinkowski C, van Wijck F, Kim I-H, di Bella P, Johnson G. Reliability and validity of arm function assessment with standardized guidelines for the Fugl-Meyer test, action research arm test and box and block test: a multicentre study. Clin Rehabil (2005) 19:404–11. doi:10.1191/0269215505cr832oa

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Nijland R, van Wegen E, Verbunt J, van Wijk R, van Kordelaar J, Kwakkel G. A comparison of two validated tests for upper limb function after stroke: the wolf motor function test and the action research arm test. J Rehabil Med (2010) 42:694–6. doi:10.2340/16501977-0560

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Canny ML, Thompson JM, Wheeler MJ. Reliability of the box and block test of manual dexterity for use with patients with fibromyalgia. Am J Occup Ther (2009) 63:506–10. doi:10.5014/ajot.63.4.506

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Chen H-M, Chen CC, Hsueh I-P, Huang S-L, Hsieh C-L. Test-retest reproducibility and smallest real difference of 5 hand function tests in patients with stroke. Neurorehabil Neural Repair (2009) 23:435–40. doi:10.1177/1545968308331146

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Grice KO, Vogel KA, Le V, Mitchell A, Muniz S, Vollmer MA. Adult norms for a commercially available nine hole peg test for finger dexterity. Am J Occup Ther (2003) 57:570–3. doi:10.5014/ajot.57.5.570

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Duncan PW, Bode RK, Lai SM, Perera S; Glycine Antagonist in Neuroprotection Americans Investigators. Rasch analysis of a new stroke-specific outcome scale: the stroke impact scale. Arch Phys Med Rehabil (2003) 84:950–63. doi:10.1016/S0003-9993(03)00035-2

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Lin K-C, Fu T, Wu C-Y, Hsieh Y-W, Chen C-L, Lee P-C. Psychometric comparisons of the stroke impact scale 3.0 and stroke-specific quality of life scale. Qual Life Res (2010) 19:435–43. doi:10.1007/s11136-010-9597-5

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Cook PR, Scavone G. The synthesis toolkit (stk). Proceedings of the International Computer Music Conference (1999). p. 164–6.

PubMed Abstract | Google Scholar

33. Kowalski CJ, Schneiderman ED, Willis SM. Assessing the effect of a treatment when subjects are growing at different rates. Int J Biomed Comput (1994) 37:151–9. doi:10.1016/0020-7101(94)90131-7

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Osu R, Ota K, Fujiwara T, Otaka Y, Kawato M, Liu M. Quantifying the quality of hand movement in stroke patients through three-dimensional curvature. J Neuroeng Rehabil (2011) 8:62. doi:10.1186/1743-0003-8-62

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Sheather SJ, Jones MC. A reliable data-based bandwidth selection method for kernel density estimation. J R Stat Soc Ser B Methodol (1991) 53:683–90. doi:10.2307/2345597

CrossRef Full Text | Google Scholar

36. Venables WN, Ripley BD. In: Chambers J, Eddy W, Härdle W, Sheather SJ, Tierney L, editors. Modern Applied Statistics with S. New York: Springer (2002).

Google Scholar

37. Lee HS, Kim JU. The effect of self-directed exercise using a task board on pain and function in the upper extremities of stroke patients. J Phys Ther Sci (2013) 25:963–7. doi:10.1589/jpts.25.963

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Constantino C, Galuppo L, Romiti D. Efficacy of mechano-acoustic vibration on strength, pain, and function in poststroke rehabilitation: a pilot study. Top Stroke Rehabil (2014) 21:391–9. doi:10.1310/tsr2105-391

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Dubus G, Bresin R. A systematic review of mapping strategies for the sonification of physical quantities. PLoS One (2013) 8:e82491. doi:10.1371/journal.pone.0082491

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Sacco RL, Bello JA, Traub R, Brust JC. Selective proprioceptive loss from a thalamic lacunar stroke. Stroke (1987) 18:1160–3. doi:10.1161/01.STR.18.6.1160

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Koelsch S. Investigating emotion with music: neuroscientific approaches. Ann N Y Acad Sci (2005) 1060:412–8. doi:10.1196/annals.1360.034

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Eschrich S, Münte TF, Altenmüller EO. Unforgettable film music: the role of emotion in episodic long-term memory for music. BMC Neurosci (2008) 9:48. doi:10.1186/1471-2202-9-48

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Koelsch S. A neuroscientific perspective on music therapy. Ann N Y Acad Sci (2009) 1169:374–84. doi:10.1111/j.1749-6632.2009.04592.x

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Bood RJ, Nijssen M, van der Kamp J, Roerdink M. The power of auditory-motor synchronization in sports: enhancing running performance by coupling cadence with the right beats. PLoS One (2013) 8:e70758. doi:10.1371/journal.pone.0070758

PubMed Abstract | CrossRef Full Text | Google Scholar