Skip to main content

ORIGINAL RESEARCH article

Front. Hum. Neurosci., 29 August 2023
Sec. Motor Neuroscience
This article is part of the Research Topic Recovery and Rehabilitation Translational Neuroscience: Advancing personalized medicine View all 6 articles

Relief of post-stroke spasticity with acute vibrotactile stimulation: controlled crossover study of muscle and skin stimulus methods

\r\nCaitlyn Seim
Caitlyn Seim1*Bingxian ChenBingxian Chen2Chuzhang Han
Chuzhang Han1*David Vacek
David Vacek1*Laura Song Wu
Laura Song Wu1*Maarten Lansberg
Maarten Lansberg3*Allison OkamuraAllison Okamura1
  • 1Stanford University Department of Mechanical Engineering, Stanford, CA, United States
  • 2Stanford University Department of Bioengineering, Stanford, CA, United States
  • 3Stanford University Department of Neurology and Neurological Sciences, Stanford, CA, United States

Background: Prior work suggests that vibratory stimulation can reduce spasticity and hypertonia. It is unknown which of three predominant approaches (stimulation of the spastic muscle, antagonist muscle, or cutaneous regions) most reduces these symptoms.

Objective: Determine which vibrotactile stimulation approach is most effective at reducing spastic hypertonia among post-stroke patients.

Methods: Sham-controlled crossover study with random assignment of condition order in fourteen patients with post-stroke hand spasticity. All patients were studied in four conditions over four visits: three stimulation conditions and a sham control. The primary outcome measure was the Modified Ashworth Scale, and the secondary outcome measure was the Modified Tardieu Scale measured manually and using 3D motion capture. For each condition, measures of spastic hypertonia were taken at four time points: baseline, during stimulation, after stimulation was removed, and after a gripping exercise.

Results: A clinically meaningful difference in spastic hypertonia was found during and after cutaneous stimulation of the hand. Modified Ashworth and Modified Tardieu scores were reduced by a median of 1.1 (SD = 0.84, p = 0.001) and 0.75 (SD = 0.65, p = 0.003), respectively, during cutaneous stimulation, and by 1.25 (SD = 0.94, p = 0.001) and 0.71 (SD = 0.67, p = 0.003), respectively, at 15 min after cutaneous stimulation. Symptom reductions with spastic muscle stimulation and antagonist muscle stimulation were non-zero but not significant. There was no change with sham stimulation.

Conclusions: Cutaneous vibrotactile stimulation of the hand provides significant reductions in spastic hypertonia, compared to muscle stimulation.

Clinical trial registration: www.ClinicalTrials.gov, identifier: NCT03814889.

1. Introduction

Spastic hypertonia is a common complication after central nervous system injury affecting 30–40% of people with impaired limb function after stroke (Watkins et al., 2002; Dajpratham et al., 2009). With the population living with chronic stroke in the US expected to double from 2010 to 2050, spastic hypertonia is also a growing problem (Ovbiagele et al., 2013; Mozaffarian et al., 2016).

Spastic hypertonia (hyperreflexia called “spasticity” and elevated involuntary muscle tone) can cause patient discomfort, impair sleep, and make activities like dressing the upper body difficult (Patel et al., 2019). Spastic hypertonia can increase when the limb is in use or when medication treatments, like Botulinum toxin, are wearing off (Sommerfeld et al., 2004). Over time, spastic hypertonia can impair cleaning the hand, cause skin breakdown, and lead to contractures that permanently limit joint mobility (Thompson et al., 2005).

For many patients, current treatment options are inadequate. The most common therapies for spastic hypertonia are intramuscular injection of botulinum neurotoxin type A (BTX-A) and oral antispasmotics like Baclofen. BTX-A injections are typically repeated every three months, with 83–88% of patients reporting relapse of symptoms of spastic hypertonia between injections (Jacinto et al., 2020; Comella et al., 2021). Moreover, treatment does not fully abolish symptoms, even at peak effect (Comella et al., 2021). Baclofen is associated with side effects such as drowsiness (Ertzgaard et al., 2017), and BTX-A is associated with side effects such as weakness (Yaraskavitch et al., 2008; Crowner et al., 2010). Splinting is used to immobilize and stretch the limb to prevent contractures, but does not relieve spastic hypertonia (Lannin and Herbert, 2003).

Research has provided promising preliminary evidence that vibratory or vibrotactile stimulation may help relieve spastic hypertonia symptoms (Ness and Field-Fote, 2009; Noma et al., 2009, 2012; Marconi et al., 2011; Murillo et al., 2011; Caliandro et al., 2012; Casale et al., 2014; Costantino et al., 2017). Vibration can provide strong afferent input through both muscle sensory receptors (Ia) (Roll et al., 1989) and cutaneous mechanoreceptors (Verrillo et al., 1969; Johansson and Vallbo, 1979). However, the dominant mechanism acting to provide spastic hypertonia relief is unknown. In this prior research, three approaches to afferent stimulation for spasticity relief have emerged, including, stimulation to (1) the spastic (agonist) muscle (Noma et al., 2009, 2012; Marconi et al., 2011; Caliandro et al., 2012; Costantino et al., 2017; Won and Park, 2018), (2) the antagonist to the spastic muscle (Hagbarth and Eklund, 1968; Ageranioti and Hayes, 1990; Binder et al., 2009; Cordo et al., 2009; Murillo et al., 2011; Casale et al., 2014), and (3) the skin (Levin and Hui-Chan, 1992; Dewald et al., 1996; Cho et al., 2013; Seim et al., 2021b). No prior work has tested these different approaches in the same participant group. To address this question, we performed a controlled experiment comparing all three approaches to vibration therapy and a sham in a group of patients with post-stroke spastic hypertonia. Spasticity symptoms were measured before, during, and after stimulation to provide data on the time course of symptom changes. We hypothesize that measures of spastic hypertonia will be reduced during stimulation (τ1−τ0) for all conditions. We expect there to be some reduction in spastic hypertonia in the control condition due to relaxation of the participant while sedentary.

2. Methods

We conducted a randomized sham-controlled crossover study of vibrotactile stimulation in patients with spasticity after stroke. This study was reviewed and approved by the Stanford University Institutional Review Board and was registered at ClinicalTrials.gov (Identifier: NCT03814889).

2.1. Participants

Fourteen individuals with post-stroke spastic hypertonia provided informed consent and participated in the study. Participants were recruited through local clinics and stroke support groups. The inclusion criteria were: history of stroke ≥ 6 months prior and spastic hypertonia measured at the proximal interphalangeal (PIP) and/or metacarpophalangeal (MCP) joints (score ≥ 1 on the Modified Ashworth Scale) when all fingers are moved simultaneously.

Participants who were taking antispasmodics were allowed to continue their medications. The exclusion criteria were: botulinum type A (BTX-A) injection within the last three months, contracture or injury limiting the PIP/MCP maximum passive range of motion, other conditions that affect movement (e.g., MS, ALS, Parkinson's).

2.2. Stimulation locations

In this work, we applied three methods of therapeutic vibratory stimulation and a sham stimulation:

Agonist muscle stimulation applied to an extrinsic finger flexor muscle [the flexor digitorum superficialis (FDS)] near its exposure on the middle forearm. Prior research applying stimulation to the spastic muscle suggests that this stimulation works by activating the Ia muscle spindles (Caliandro et al., 2012) which may cause decreased response to stretch (spasticity) from post-activation depression (Costantino et al., 2017), reduction of muscle tone via presynaptic or recurrent inhibition (Noma et al., 2012), or reduced muscle hyperexcitability through central Hebbian-based long-term potentiation of inhibitory tracts (Marconi et al., 2011; Caliandro et al., 2012).

Antagonist muscle stimulation applied to the extrinsic finger extensor muscle [the extensor digitorum (ED)]. Prior work applying stimulation to the spastic antagonist muscle suggests that this works through Ia muscle spindle activation, which induces reciprocal inhibition of the opposing (spastic) muscle (Ageranioti and Hayes, 1990).

Cutaneous stimulation applied to the fingertips. This zone was chosen for three reasons: (1) The fingertips are dense in cutaneous mechanoreceptors, including the Pacinian corpuscles which are the most responsive to vibratory input (Johansson and Vallbo, 1979). (2) The fingertips are one of the most isolated zones from nearby muscle on the upper limb. While the intrinsic hand muscles and tendons are present nearby, our stimulation was designed to be low amplitude to enhance localization at the fingertip skin. (3) Data from other work suggest that cutaneous input at the fingertips or volar hand not only can produce reflex inhibition in the forearm flexor muscles (Nielsen and Pierrot-Deseilligny, 1991), but may also facilitate co-activation in the extensor muscles (Kim et al., 2013).

Sham stimulation applied to the dorsal wrist.

2.3. Apparatus and stimulation settings

Vibration was delivered using vibration motors (Precision Microdrives, Model #310-103 and #C08-005) connected to a circuit board via ribbon cable. During muscle stimulation conditions, four motors (Model #310-103) were attached to the affected arm over the target muscle using a silicone adhesive pad (Outus brand) (Figure 1A). The gel pad helps to prevent the vibration from spreading. The motors vibrate one at a time (500 ms), in a sequence with no pauses in between.

FIGURE 1
www.frontiersin.org

Figure 1. (A) Muscle stimulation setup. (B) Validation of muscle stimulation frequency measured using accelerometer. Muscle stimulation was tuned to the muscle afferent receptors. (C) Finger stimulation setup. The mitten in the image is pictured on an open hand, but during the study, it is applied in the hand's neutral position without stretching it open. (D) Validation of cutaneous stimulation frequency—tuned to the cutaneous afferent receptors.

During fingertip stimulation, the motors (Model #C08-005) were attached to each finger of the affected hand using a small adhesive tape (Figure 1C). The motors vibrate in the same pattern described above. The fingers were then slipped into a foam mitten. The foam mitten slipped over the first two digits of the fingers while the hand remains curled, acting as a buffer to prevent the motors coming in contact with the palm. The hand is not stretched open while wearing or donning the mitten. The mitten is made from 1.25′′ thick foam on the dorsal side, 2.5′′ thick foam on the volar side, and enclosed with stretch cotton fabric.

2.3.1. Frequency

A small, battery-powered circuit board ran the motors. During the trials, the circuit board was usually tucked inside the participant's sleeve. Our target frequency for muscle stimulation was between 70–90 Hz. Prior work used frequencies between 70–90 Hz to stimulate the Ia muscle sensory fibers of agonist and antagonist muscles (Siggelkow et al., 1999; Rosenkranz and Rothwell, 2003; Steyvers et al., 2003; Forner-Cordero et al., 2008; Marconi et al., 2008; Binder et al., 2009; Cordo et al., 2009, 2013). These receptors respond in a synchronous 1:1 rate to vibration stimuli up to 100–150 Hz (Roll et al., 1989; Park and Martin, 1993; Martin and Park, 1997). Contraction of the stimulated muscle increases the Ia discharge Our target frequency for skin stimulation was 250 Hz. The tactile mechanoreceptors are most responsive to vibration at 150–250 Hz (Pacinian corpuscles preferentially respond around 250 Hz) (Verrillo et al., 1969; Johansson and Vallbo, 1979).

2.3.2. Amplitude

Because the aim of this work is to apply localized stimulation to a select muscle or skin region, amplitude settings were determined during system validation. We adjusted amplitude settings to provide localized stimulation and minimize transmission to other tissues. Increasing the amplitude of stimulation increases the transmission of vibration through tissue to reach more sensory receptors (Eklund and Hagbarth, 1966; O'Mara et al., 1988; Park and Martin, 1993; Kihlberg et al., 1995; Guang et al., 2018).

Vibration amplitude and frequency were measured for each apparatus using an accelerometer at 10 kHz (Kistler, Inc.). The amplitude and frequency were measured for one vibration motor within each apparatus while it lay on a table (Figures 1B, D). We also measured vibration at the target zone and adjacent regions when each apparatus was applied to the upper limb. Adjacent regions were measured to assess vibration transmission through the limb, and amplitude was adjusted to provide stimulation at the target zone while limiting stimulation elsewhere. For flexor (agonist) stimulation, the sites of interest were as follows: distal (1.5′′ from the motor along the FDS toward the hand), medial (at the boundary between FDP and extensor carpi ulnaris, 2.5′′ medial from stimulation site), lateral (at the brachioradialis, 2.5′′ medial from stimulation site), at the antagonist muscle [at the extensor digitorum (ED)]. For extensor stimulation, the sites of interest were as follows: distal (1.5′′ along the ED toward the hand), medial (at the boundary between FDP and extensor carpi ulnaris, 2.5′′ medial from stimulation site), lateral (at the brachioradialis, 2.5′′ medial from stimulation site), and antagonist (at the FDS). Frequencies of 67–70 Hz were achieved for muscle stimulation and 253–255 Hz for skin stimulation. Vibration amplitudes were low at non-target locations: ~0.18 mm at non-target muscle groups (vs. 0.61 mm at target muscles), and <0.08 mm at non-target areas during fingertip stimulation. Prior work applied vibrotactile stimulation of 0.5–2 mm (Marconi et al., 2011; Caliandro et al., 2012; Noma et al., 2012; Alashram et al., 2019), and amplitudes less than 0.3 mm have been reported to show nonsignificant effects on muscle spasticity vs. higher amplitudes (Seo et al., 2016).

2.4. Measures

The following measures were obtained to assess the response to vibratory stimulation.

The Modified Ashworth Scale (MAS) for the MCP and PIP joints was the primary outcome measure.

The Modified Tardieu scale (MTS) for the MCP and PIP joints served as a secondary measure of spastic hypertonia symptoms. MTS includes a rating and angle measure both indicating levels of spasticity. MTS focuses on the mechanical properties of the stretch reflex (spasticity): gain (rating) and catch angle (MTS angle). Stretch reflex properties are a “readily observable marker of spinal motoneuron excitability (McPherson et al., 2019).” We elected to use biomechanical measures like MTS (rather than electromyography, EMG) because they are functionally relevant, do not require calibration between subjects, and can be measured without signal disturbance during vibration. In addition, EMG and Hoffman waves are difficult to noninvasively capture in the forearm, especially of paretic patients (Rafiee et al., 2011). MTS angle is reported as the maximum passive range of motion (how far the joint can be extended at a very slow speed by an examiner) minus the catch angle (the angle a catch or clonus is found during a quick stretch by an examiner). A digital goniometer was used to measure joint angles.

The Isometric Force Pillow (IFP) (Seim et al., 2020) is an experimental tool used to measure involuntary grip force from the fingers. Flexor spastic hypertonia causes the fingers to squeeze and bend. This tool provides a holistic, quantitative value of this symptom by measuring the pressure exerted by the fingers when the person is relaxed.

Motion capture The MTS angle was also measured using 3D motion capture markers attached to each joint on the upper limb.

Circumstantial factors such as arousal, posture, and room temperature have a strong influence on both velocity-dependent spastic reflexes and hypertonia (Grillon and Zarifian, 1985). Factors that influence spastic hypertonia were controlled during the experiment to provide the most accurate data possible: Laboratory temperature was regulated at 72 degrees. Measures were recorded in a standardized position/posture for all participants. The measurement position is gravity-neutral—preventing any gravity assistance in voluntary motion or spastic hypertonia measures. If participants' wrists and arms did not rest in a gravity-neutral position with the wrist straight, the investigator or assistant held the arm in position. All participants were provided a 10-min rest period after arriving at the lab. Measures were administered in a predetermined order that recorded spastic hypertonia before voluntary range of motion tests (which could temporarily excite spastic hypertonia measures).

2.5. Experimental design

Each participant made four visits to the laboratory. At the first visit, participants were assigned a randomized order of the four conditions (flexor muscle stimulation, extensor muscle stimulation, fingertip stimulation, and control) using opaque envelopes. During each visit, the participant was administered one stimulation condition according to their assigned condition order.

During each session, measures were taken at four different time points: baseline (τ0), during the last 2 min of a 20-min stimulation period (τ1), 15 min after stimulation is removed (τ2), and after a final gripping exercise (τ3).

The visit procedures for each visit were as follows:

1. Rest and adjust (10 min). The visit begins with an adjustment period during which the participant reads or watches a video for 10 min.

2. Measures (τ0). All measures (time τ0) were performed on the affected limb in the following order: MAS, MTS, and IFP. These measures were performed in view of a motion capture system while the patient is seated and their arm is in the gravity-neutral position. Any discrepancy in arm position due to severe hypertonia was noted.

3. Stimulation condition while watching videos (20 min). The investigator helped the participant don the apparatus corresponding to the session's stimulation condition. The participant then was asked to rest (read or watch a video) during 20 min of wearing the apparatus. Participants were offered breaks as needed.

4. Measures (τ1). During the last 2 min of the stimulation period, the investigator recorded all measures again (time τ1). Measures at time τ1 represent the arm's state during stimulation, while receiving afferent input. Mechanisms such as postactivation depression and reciprocal inhibition are expected to be active only during stimulation. For the control condition, τ1 measures provide data on the arm's state after a period of relaxation with no (sham) stimulation.

5. Remove stimulation and watch videos (15 min). The investigator turned off and removed the stimulation apparatus. The participant then sat while watching a video.

6. Measures (τ2). After the 15-min period of rest, all measures (MAS, MTS, and IFP) were taken again (time τ2).

7. Gripping exercise. Following time τ2, participants were asked to make a tight fist and extend both arms for 10 s, three times, to increase excitatory drive to the hand.

8. Measures (τ3). Immediately after the gripping exercise, all measures were taken again (τ3) to determine the arm's response to excitatory drive after receiving stimulation.

2.6. Conditions

Participants were blinded to the different conditions and were not informed that there was a sham-control condition. Proctors were not involved in the development of the study protocol, conditions, or hypotheses. Proctors were taught to administer each condition, but were not informed of the rationale behind each condition.

The control condition (sham) was designed to be indistinguishable from the other conditions but provide no meaningful stimulation. In this condition, the silicone pad of motors was attached at the wrist of the affected arm. The circuit board was turned on, but the motors did not activate. There was no difference in sound to participants. A fan in the lab created a white noise at ~50 dB, which obscured the sound of the motors in all conditions. No participant reported not feeling the sham stimulation. For some participants, stimulation in the other conditions may be imperceptible

2.7. Data analysis

For each condition, participants' baseline values (τ0) were compared to values during stimulation (τ1). Wilcoxon Signed-Rank tests were performed on paired ordinal data (Modified Ashworth and Modified Tardieu scale ratings) and paired t-tests were performed on paired continuous variables (Modified Tardieu angle measures). Values after stimulation (τ2) were compared to baseline using the same tests. For a given condition, if a significant difference had been found during or after stimulation, values after the gripping exercises were also compared to baseline in order to examine if spastic hypertonia had returned to pre-stimulation levels. We also conducted a Friedman's test to assess whether baseline scores differed significantly between conditions. The alpha value was set at 0.05 and the Benjamini–Hochberg procedure was used to control for the false discovery rate. 3D motion capture values for catch angle and maximum passive range were the mean of two and three excursions, respectively.

2.8. Power analysis

We carried out power calculations using prior work which applied acute afferent/vibratory stimulation at the spastic agonist muscle (Noma et al., 2009), the antagonist muscle (Murillo et al., 2011), or the skin (Cho et al., 2013). Our sample size calculations were based on a two-sided paired t-test, which should have adequate power for the Wilcoxon Signed Rank test. For agonist stimulation, we expected the mean change on the Modified Ashworth scale to be −2.3 and the standard deviation to be 0.5 (Noma et al., 2009). We found that we can achieve 80% power with four samples. For antagonist stimulation, we expected the change to be −1.1 and the standard deviation to be 0.6 (Murillo et al., 2011). We found that we can achieve 80% power with six samples. For cutaneous stimulation, we expected the change to be −1.0 and the standard deviation to be 0.75 (Cho et al., 2013). We found that we can achieve 80% power with nine samples. We enrolled five additional participants to account for those who may become lost to follow-up, leading to the sample size of 14 participants. Use of the Modified Tardieu Scale is less common in the related literature, but we expected the test to be of the same sensitivity as Modified Ashworth Scale.

3. Results

The participant mean age was 60 years (33–75 years). The biological sex distribution was five females and nine males. The race and ethnicity distribution was: seven Asian, six Caucasian, and one Hispanic or Latino.

Table 1 shows Modified Ashworth Scale ratings and Modified Tardieu values for all time points and all conditions. Figure 2 shows the difference from baseline at each time point for all conditions. Trends over all time points are also plotted in Supplementary Figures S1, S2. Only cutaneous simulation resulted in significant reductions in Modified Ashworth ratings (Mean change −1.11 at τ1, p = 0.001; −1.25 at τ2, p = 0.001; and −0.75 at τ3, p = 0.011), Modified Tardieu ratings (Mean change −0.75 at τ1, p = 0.003; −0.71 at τ2, p = 0.003; and −0.21 at τ3, p = 0.1), and Modified Tardieu angle (Mean change −12.68° at τ1, p = 0.002; −9.54° at τ2, p = 0.007). MAS ratings are presented on a scale of 0–5.

TABLE 1
www.frontiersin.org

Table 1. Average Modified Ashworth Scale and Modified Tardieu values at each time point for all conditions. MAS ratings are presented on a scale of 0–5. SD is standard deviation. The score for each participant at a given time point was calculated by averaging their PIP and MCP values.

FIGURE 2
www.frontiersin.org

Figure 2. Average difference in Modified Ashworth Scale and Modified Tardieu Scale ratings from baseline at each time point for all conditions. Negative numbers represent a reduction in spastic hypertonia. Statistical significance is indicated by an asterisk. MAS ratings are presented on a scale of 0–5. Error bars show standard error.

We conducted a Friedman's test to assess whether baseline spasticity scores differed significantly between conditions. For the MAS baseline values, the test showed no significant difference between conditions (p = 0.051, Friedman's statistic = 7.7786, N = 14). Similarly, for the MTS baseline scores, there was no statistically significant difference between conditions (p = 0.126, Friedman's statistic = 5.7214, N = 14).

The MTS angle was also measured using 3D motion capture. 3D motion capture data showed that the catch angle was measured at a mean joint movement speed of 132 degrees per second, and the passive range of motion was measured at a mean of 22 degrees per second. The motion capture measures of MTS angle are graphed alongside the manual measurements in the Supplementary material. Values using 3D motion capture were similar to values taken by hand with a digital goniometer for all conditions. Precision of measures taken by hand was also similar to 3D motion capture measures (average SD difference = 5°). The Isometric Force Pillow data is reported in the Supplementary material.

4. Discussion

There are multiple approaches to vibratory stimulation in the context of spastic hypertonia, and the work here is the first to compare multiple approaches in the same population. This comparison is important to provide more data on both the underlying mechanisms and optimal approach.

Results indicate that 20 min of skin stimulation, here applied to the fingertips, was associated with a significant reduction in measures of spastic hypertonia. Measures were still significantly different from baseline after stimulation was removed. Peripheral effects, like inhibitory postsynaptic potentials triggered by a volley of sensory input, would be expected to last only during stimulation (Dideriksen et al., 2015). This data thus supports to the idea that cutaneous stimulation could interact with mechanisms with longer time scales. Dewald et al. (1996) discussed a similar finding when using cutaneous electrical stimulation: They found reductions in spastic reflex torque that lasted 15 min after removal of stimulation. They discuss that synaptic effects like reciprocal and recurrent inhibition, as well as presynaptic inhibition are known to last less than a second after the stimulation input. They suggest that long-term potentiation (LTP) or depression (LTD) mediated via primary afferents at the dorsal horn could be at work. “Given that we observe a reduction in stretch reflex responsiveness after cutaneous stimulation, LTP would presumably operate at a convergent inhibitory interneuron, while LTD would operate at a presynaptic excitatory neuron” (Dewald et al., 1996).

Mean difference in Modified Ashworth Scale ratings of 1.1-1.25 points during and after cutaneous finger stimulation also surpass a clinically meaningful difference. The minimal clinically important difference (MCID) in Modified Ashworth for the upper limb is between 0.45 and 0.73 points (Chen et al., 2019).

Though not statistically significant, non-zero changes were also found during both conditions of muscle stimulation. The reason that muscle stimulation was not associated with a significant change in spastic hypertonia could be due to several factors. In prior work, the limb was sometimes in a stretched position e.g., Noma et al. (2009)—which keeps muscles long for increased Ia receptor discharge and keeps the hand loose for measurement. Muscle vibration thus may be best combined with splinting to keep the muscles in a stretched position—a potential avenue for future work. Prior work in muscle stimulation (including both whole body vibration and focal muscle vibration targeted to a specific muscle group) also likely activated multiple agonist and antagonist pathways partly due to the apparatus used in prior work. For example, if our focal stimulation apparatus applies 0.6 mm vibration that transmits ~0.18 mm to non-targets, prior work that applied 1 mm vibration or greater (Casale et al., 2014; Alashram et al., 2019), even using a rounded probe, could experience significant transmission to non targets (e.g., antagonists) (Guang et al., 2018). More than 0.3 mm has been reported to show significant effects in spastic hypertonia (Seo et al., 2016). Of course, stimulation at any muscle group will produce some effect in both agonist and antagonist circuits. Perhaps a higher amplitude of vibration would improve muscle stimulation for spastic hypertonia. Though such stimulation could not be isolated to a particular muscle group, the increased spread of higher-amplitude vibration could increase afferent discharge or muscle fiber recruitment.

The gripping exercise, adapted from the Jendrassik maneuver (Zehr and Stein, 1999), was intended to increase excitatory drive to the impaired limb. Though activities such as walking may provide more drive, our exercise appears to be a useful and accessible procedure. The data at τ3 serve as an effective addition to our repeated measurements in a given visit. Our hypothesis that measures of spastic hypertonia increase after an excitatory activity in all conditions was confirmed. Change in Modified Ashworth measures for the skin stimulation condition increased after the gripping exercise, but did remain significantly below baseline. This finding provides more support that muscle tone inhibition in this condition is not solely supported by an inflow of inhibitory postsynaptic potentials.

Our hypothesis that measures of spastic hypertonia would decrease during the control condition was not confirmed. Measures during the control condition were more consistent that we expected—enabling a clear comparison between conditions. We understood that participants may exhibit some relaxation (leading to decreased spastic hypertonia) after sitting and watching videos during the visit. We provided an adjustment period after their arrival to the lab for the explicit purpose of allowing the participant to stabilize, which appears to have been effective.

The results here inform the development and future research into vibratory and vibrotactile stimulation for spastic hypertonia relief. If a wearable device is created, this stimulation could be applied at intervals throughout the day to help relieve elevated spastic hypertonia during therapy or activities, in the morning, or as-needed. It could be used to help relax the limb for splinting, or between pharmaceutical doses (e.g., Botox or Baclofen). Stimulation is also accessible to those with limited residual motor function who cannot perform exercises.

5. Limitations

No non-invasive apparatus can fully exclude activation of non-target muscles and overlying skin. The stimulation conditions used here were designed and validated to provide minimal stimulation of the non-target zones. In addition to amplitude choices, the stimulation's location and frequency support the difference in stimulation methods. The skin of the forearm contains significantly fewer cutaneous receptors than the fingertips. In fact, even individuals without stroke are unable to perceive vibrations at up to 1.5 g amplitude on the arm (Seim et al., 2021a). Some cutaneous activation will still occur during the muscle stimulation conditions; however, this is further mitigated by the use of a 70 Hz stimulation frequency, which is 1/4th the frequency at which Pacinian corpuscles preferentially respond to vibration [250 Hz (Johansson and Vallbo, 1979)]. In contrast, 70 Hz elicits near the peak response from Ia muscle spindles (Roll et al., 1989). Finally, this work focused on short term effects and patients in the chronic stage of stroke. Future work should further evaluate the potential clinical impacts of stimulation approaches long term.

6. Conclusions

Cutaneous vibrotactile stimulation of the hand provides significant reductions in spastic hypertonia, compared to muscle stimulation.

Data availability statement

The datasets presented in this article are not readily available because patient data cannot be shared publicly. Requests to access the datasets should be directed to cseim@stanford.edu.

Ethics statement

The studies involving humans were approved by Stanford University Institutional Review Board. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

BC and DV administered the study and supervised data entry. CS, CH, and LW engineered study devices. CS, AO, and ML designed the study protocol, analysis, and reporting. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by the Stanford Wu Tsai Neurosciences Institute Neuroscience: Translate Program, National Institutes of Health grant #1F32HD100104, and a Stanford Wu Tsai Neurosciences Institute Interdisciplinary Scholar Award. Zihuai He of the Stanford Quantitative Science Unit contributed counsel on our statistical analysis plan. Julius Dewald of Northwestern University provided input on study design.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnhum.2023.1206027/full#supplementary-material

References

Ageranioti, S., and Hayes, K. C. (1990). Effect of vibration on hypertonia and hyperreflexia in the wrist joint of patients with spastic hemiparesis. Physiother. Can. 42, 24–33.

Google Scholar

Alashram, A. R., Padua, E., Romagnoli, C., and Annino, G. (2019). Effectiveness of focal muscle vibration on hemiplegic upper extremity spasticity in individuals with stroke: a systematic review. NeuroRehabilitation 45, 471–481. doi: 10.3233/NRE-192863

PubMed Abstract | CrossRef Full Text | Google Scholar

Binder, C., Kaya, A. E., and Liepert, J. (2009). Vibration prolongs the cortical silent period in an antagonistic muscle. Muscle Nerve 39, 776–780. doi: 10.1002/mus.21240

PubMed Abstract | CrossRef Full Text | Google Scholar

Burke, D., Andrews, C. J., and Lance, J. W. (1972). Tonic vibration reflex in spasticity, parkinson's disease, and normal subjects. J. Neurol. Neurosurg. Psychiatry 35, 477–486. doi: 10.1136/jnnp.35.4.477

PubMed Abstract | CrossRef Full Text | Google Scholar

Caliandro, P., Celletti, C., Padua, L., Minciotti, I., Russo, G., Granata, G., et al. (2012). Focal muscle vibration in the treatment of upper limb spasticity: a pilot randomized controlled trial in patients with chronic stroke. Arch. Phys. Med. Rehabil. 93, 1656–1661. doi: 10.1016/j.apmr.2012.04.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Casale, R., Damiani, C., Maestri, R., Fundarò, C., Chimento, P., and Foti, C. (2014). Localized 100 Hz vibration improves function and reduces upper limb spasticity: a double-blind controlled study. Eur. J. Phys. Rehabil. Med. 50, 495–504.

PubMed Abstract | Google Scholar

Chen, C.-L., Chen, C.-Y., Chen, H.-C., Wu, C.-Y., Lin, K.-C., Hsieh, Y.-W., et al. (2019). Responsiveness and minimal clinically important difference of Modified Ashworth Scale in patients with stroke. Eur. J. Phys. Rehabil. Med. 55, 754–760. doi: 10.23736/S1973-9087.19.05545-X

PubMed Abstract | CrossRef Full Text | Google Scholar

Cho, H.-Y., In, T. S., Cho, K. H., and Song, C. H. (2013). A single trial of transcutaneous electrical nerve stimulation (TENS) improves spasticity and balance in patients with chronic stroke. J. Exp. Med. 229, 187–193. doi: 10.1620/tjem.229.187

PubMed Abstract | CrossRef Full Text | Google Scholar

Comella, C., Ferreira, J. J., Pain, E., Azoulai, M., and Om, S. (2021). Patient perspectives on the therapeutic profile of botulinum neurotoxin type a in cervical dystonia. J. Neurol. 268, 903–912. doi: 10.1007/s00415-020-10217-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Cordo, P., Lutsep, H., Cordo, L., Wright, W. G., Cacciatore, T., and Skoss, R. (2009). Assisted movement with enhanced sensation (AMES): coupling motor and sensory to remediate motor deficits in chronic stroke patients. Neurorehabil. Neural Repair 23, 67–77. doi: 10.1177/1545968308317437

PubMed Abstract | CrossRef Full Text | Google Scholar

Cordo, P., Wolf, S., Lou, J.-S., Bogey, R., Stevenson, M., Hayes, J., et al. (2013). Treatment of severe hand impairment following stroke by combining assisted movement, muscle vibration, and biofeedback. J. Neurol. Phys. Therapy 37, 194–203. doi: 10.1097/NPT.0000000000000023

PubMed Abstract | CrossRef Full Text | Google Scholar

Costantino, C., Galuppo, L., and Romiti, D. (2017). Short-term effect of local muscle vibration treatment versus sham therapy on upper limb in chronic post-stroke patients: a randomized controlled trial. Eur. J. Phys. Rehabil. Med. 53, 32–40. doi: 10.23736/S1973-9087.16.04211-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Crowner, B. E., Torres-Russotto, D., Carter, A. R., and Racette, B. A. (2010). Systemic weakness after therapeutic injections of botulinum toxin a: a case series and review of the literature. Clin. Neuropharmacol. 33, 243. doi: 10.1097/WNF.0b013e3181f5329e

PubMed Abstract | CrossRef Full Text | Google Scholar

Dajpratham, P., Kuptniratsaikul, V., Kovindha, A., Kuptniratsaikul, P. S.-A., and Dejnuntarat, K. (2009). Prevalence and management of poststroke spasticity in thai stroke patients: a multicenter study. Med. Assoc. Thailand 92, 1354.

PubMed Abstract | Google Scholar

Dewald, J. A., Given, J., and Rymer, W. (1996). Long-lasting reductions of spasticity induced by skin electrical stimulation. IEEE Transact. Rehabil. Eng. 4, 231–242. doi: 10.1109/86.547923

PubMed Abstract | CrossRef Full Text | Google Scholar

Dideriksen, J. L., Muceli, S., Dosen, S., Laine, C. M., and Farina, D. (2015). Physiological recruitment of motor units by high-frequency electrical stimulation of afferent pathways. J. Appl. Physiol. 118, 365–376. doi: 10.1152/japplphysiol.00327.2014

PubMed Abstract | CrossRef Full Text | Google Scholar

Eklund, G., and Hagbarth, K.-E. (1966). Normal variability of tonic vibration reflexes in man. Exp. Neurol. 16, 80–92. doi: 10.1016/0014-4886(66)90088-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Ertzgaard, P., Campo, C., and Calabrese, A. (2017). Efficacy and safety of oral Baclofen in the management of spasticity: a rationale for intrathecal Baclofen. J. Rehabil. Med. 49, 193–203. doi: 10.2340/16501977-2211

PubMed Abstract | CrossRef Full Text | Google Scholar

Forner-Cordero, A., Steyvers, M., Levin, O., Alaerts, K., and Swinnen, S. P. (2008). Changes in corticomotor excitability following prolonged muscle tendon vibration. Behav. Brain Res. 190, 41–49. doi: 10.1016/j.bbr.2008.02.019

PubMed Abstract | CrossRef Full Text | Google Scholar

Grillon, C., and Zarifian, E. (1985). Hoffmann reflex variations produced by task demand characteristics. Physiol. Behav. 34, 213–216. doi: 10.1016/0031-9384(85)90108-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Guang, H., Ji, L., and Shi, Y. (2018). Focal vibration stretches muscle fibers by producing muscle waves. IEEE Transact. Neural Syst. Rehabil. Eng. 26, 839–846. doi: 10.1109/TNSRE.2018.2816953

PubMed Abstract | CrossRef Full Text | Google Scholar

Hagbarth, K.-E., and Eklund, G. (1968). The effects of muscle vibration in spasticity, rigidity, and cerebellar disorders. J. Neurol. Neurosurg. Psychiatr. 31, 207. doi: 10.1136/jnnp.31.3.207

PubMed Abstract | CrossRef Full Text | Google Scholar

Jacinto, J., Varriale, P., Pain, E., Lysandropoulos, A., and Esquenazi, A. (2020). Patient perspectives on the therapeutic profile of botulinum neurotoxin type a in spasticity. Front. Neurol. 11, 388. doi: 10.3389/fneur.2020.00388

PubMed Abstract | CrossRef Full Text | Google Scholar

Johansson, R. S., and Vallbo, A. (1979). Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin. J. Physiol. 286, 283–300. doi: 10.1113/jphysiol.1979.sp012619

PubMed Abstract | CrossRef Full Text | Google Scholar

Kihlberg, S., Attebrant, M., Gemne, G., and Kjellberg, A. (1995). Acute effects of vibration from a chipping hammer and a grinder on the hand-arm system. Occup. Environ. Med. 52, 731–737. doi: 10.1136/oem.52.11.731

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, Y., Shim, J. K., Hong, Y.-K., Lee, S.-H., and Yoon, B. C. (2013). Cutaneous sensory feedback plays a critical role in agonist-antagonist co-activation. Exp. Brain Res. 229, 149–156. doi: 10.1007/s00221-013-3601-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Lannin, N. A., and Herbert, R. (2003). Is hand splinting effective for adults following stroke? A systematic review and methodological critique of published research. Clin. Rehabil. 17, 807–816. doi: 10.1191/0269215503cr682oa

PubMed Abstract | CrossRef Full Text | Google Scholar

Levin, M. F., and Hui-Chan, C. W. (1992). Relief of hemiparetic spasticity by TENS is associated with improvement in reflex and voluntary motor functions. Electroencephalogr. Clin. Neurophysiol. 85, 131–142. doi: 10.1016/0168-5597(92)90079-Q

PubMed Abstract | CrossRef Full Text | Google Scholar

Marconi, B., Filippi, G. M., Koch, G., Giacobbe, V., Pecchioli, C., Versace, V., et al. (2011). Long-term effects on cortical excitability and motor recovery induced by repeated muscle vibration in chronic stroke patients. Neurorehabil. Neural Repair 25, 48–60. doi: 10.1177/1545968310376757

PubMed Abstract | CrossRef Full Text | Google Scholar

Marconi, B., Filippi, G. M., Koch, G., Pecchioli, C., Salerno, S., Don, R., et al. (2008). Long-term effects on motor cortical excitability induced by repeated muscle vibration during contraction in healthy subjects. J. Neurol. Sci. 275, 51–59. doi: 10.1016/j.jns.2008.07.025

PubMed Abstract | CrossRef Full Text | Google Scholar

Martin, B. J., and Park, H.-S. (1997). Analysis of the tonic vibration reflex: influence of vibration variables on motor unit synchronization and fatigue. Eur. J. Appl. Physiol. Occup. Physiol. 75, 504–511. doi: 10.1007/s004210050196

PubMed Abstract | CrossRef Full Text | Google Scholar

McPherson, J. G., Stienen, A. H., Schmit, B. D., and Dewald, J. P. (2019). Biomechanical parameters of the elbow stretch reflex in chronic hemiparetic stroke. Exp. Brain Res. 237, 121–135. doi: 10.1007/s00221-018-5389-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Mozaffarian, D., Benjamin, E., Go, A., Arnett, D., Blaha, M., Cushman, M., et al. (2016). Heart disease and stroke statistics-2016 update: a report from the American Heart Association. Circulation 133, e38. doi: 10.1161/CIR.0000000000000350

PubMed Abstract | CrossRef Full Text | Google Scholar

Murillo, N., Kumru, H., Vidal-Samso, J., Benito, J., Medina, J., Navarro, X., et al. (2011). Decrease of spasticity with muscle vibration in patients with spinal cord injury. Clin. Neurophysiol. 122, 1183–1189. doi: 10.1016/j.clinph.2010.11.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Ness, L. L., and Field-Fote, E. C. (2009). Effect of whole-body vibration on quadriceps spasticity in individuals with spastic hypertonia due to spinal cord injury. Restor. Neurol. Neurosci. 27, 623–633. doi: 10.3233/RNN-2009-0487

PubMed Abstract | CrossRef Full Text | Google Scholar

Nielsen, J., and Pierrot-Deseilligny, E. (1991). Pattern of cutaneous inhibition of the propriospinal-like excitation to human upper limb motoneurones. J. Physiol. 434, 169–182. doi: 10.1113/jphysiol.1991.sp018464

PubMed Abstract | CrossRef Full Text | Google Scholar

Noma, T., Matsumoto, S., Etoh, S., Shimodozono, M., and Kawahira, K. (2009). Anti-spastic effects of the direct application of vibratory stimuli to the spastic muscles of hemiplegic limbs in post-stroke patients. Brain Inj. 23, 623–631. doi: 10.1080/02699050902997896

PubMed Abstract | CrossRef Full Text | Google Scholar

Noma, T., Matsumoto, S., Shimodozono, M., Etoh, S., and Kawahira, K. (2012). Anti-spastic effects of the direct application of vibratory stimuli to the spastic muscles of hemiplegic limbs in post-stroke patients: a proof-of-principle study. J. Rehabil. Med. 44, 325–330. doi: 10.2340/16501977-0946

PubMed Abstract | CrossRef Full Text | Google Scholar

O'Mara, S., Rowe, M. J., and Tarvin, R. (1988). Neural mechanisms in vibrotactile adaptation. J. Neurophysiol. 59, 607–622. doi: 10.1152/jn.1988.59.2.607

PubMed Abstract | CrossRef Full Text | Google Scholar

Ovbiagele, B., Goldstein, L. B., Higashida, R. T., Howard, V. J., Johnston, S. C., Khavjou, O. A., et al. (2013). Forecasting the future of stroke in the United States: a policy statement from the American Heart Association and American Stroke Association. Stroke 44, 2361–2375. doi: 10.1161/STR.0b013e31829734f2

PubMed Abstract | CrossRef Full Text | Google Scholar

Park, H.-S., and Martin, B. J. (1993). Contribution of the tonic vibration reflex to muscle stress and muscle fatigue. Scand. J. Work Environ. Health 19, 35–42. doi: 10.5271/sjweh.1506

PubMed Abstract | CrossRef Full Text | Google Scholar

Patel, A., Wein, T., Bahroo, L., Wilczynski, O., Rios, C., and Murie-Fernandez, M. (2019). “Burden of spasticity among patients and caregivers: results of a multinational survey,” in Proceedings of TOXINS Conference (Copenhagen), 1–8.

PubMed Abstract | Google Scholar

Rafiee, J., Rafiee, M., Yavari, F., and Schoen, M. (2011). Feature extraction of forearm EMG signals for prosthetics. Expert Syst. Appl. 38, 4058–4067. doi: 10.1016/j.eswa.2010.09.068

CrossRef Full Text | Google Scholar

Roll, J., Vedel, J., and Ribot, E. (1989). Alteration of proprioceptive messages induced by tendon vibration in man: a microneurographic study. Exp. Brain Res. 76, 213–222. doi: 10.1007/BF00253639

PubMed Abstract | CrossRef Full Text | Google Scholar

Rosenkranz, K., and Rothwell, J. C. (2003). Differential effect of muscle vibration on intracortical inhibitory circuits in humans. J. Physiol. 551, 649–660. doi: 10.1113/jphysiol.2003.043752

PubMed Abstract | CrossRef Full Text | Google Scholar

Seim, C. E., Han, C., Lowber, A. J., Brooks, C., Payne, M., Lansberg, M. G., et al. (2020). “Isometric force pillow: using air pressure to quantify involuntary finger flexion in the presence of hypertonia,” in International Conference on NeuroRehabilitation (Cham: Springer), 835–840.

Google Scholar

Seim, C. E., Ritter, B., Flavin, K. E., Lansberg, M. G., and Okamura, A. M. (2021a). “Affective ratings of vibrotactile signals in older adults with and without history of stroke,” in 2021 IEEE World Haptics Conference (WHC) (Montreal, QC: IEEE), 457–462.

Google Scholar

Seim, C. E., Wolf, S. L., and Starner, T. E. (2021b). Wearable vibrotactile stimulation for upper extremity rehabilitation in chronic stroke: clinical feasibility trial using the VTS Glove. J. Neuroeng. Rehabil. 18, 1–11. doi: 10.1186/s12984-021-00813-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Seo, H. G., Oh, B.-M., Leigh, J.-H., Chun, C., Park, C., and Kim, C. H. (2016). Effect of focal muscle vibration on calf muscle spasticity: a proof-of-concept study. Phys. Med. Rehabil. 8, 1083–1089. doi: 10.1016/j.pmrj.2016.03.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Siggelkow, S., Kossev, A., Schubert, M., Kappels, H.-H., Wolf, W., and Dengler, R. (1999). Modulation of motor evoked potentials by muscle vibration: the role of vibration frequency. Muscle Nerve 22, 1544–1548. doi: 10.1002/(SICI)1097-4598(199911)22:11<1544::AID-MUS9>3.0.CO;2-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Sommerfeld, D. K., Eek, E. U.-B., Svensson, A.-K., Holmqvist, L. W., and Von Arbin, M. H. (2004). Spasticity after stroke: its occurrence and association with motor impairments and activity limitations. Stroke 35, 134–139. doi: 10.1161/01.STR.0000105386.05173.5E

PubMed Abstract | CrossRef Full Text | Google Scholar

Steyvers, M., Levin, O., Van Baelen, M., and Swinnen, S. P. (2003). Corticospinal excitability changes following prolonged muscle tendon vibration. Neuroreport 14, 2001–2004. doi: 10.1097/00001756-200310270-00004

PubMed Abstract | CrossRef Full Text | Google Scholar

Thompson, A., Jarrett, L., Lockley, L., Marsden, J., and Stevenson, V. (2005). Clinical management of spasticity. J. Neurol. Neurosurg. Psychiatry 76, 459–463. doi: 10.1136/jnnp.2004.035972

PubMed Abstract | CrossRef Full Text | Google Scholar

Verrillo, R. T., Fraioli, A. J., and Smith, R. L. (1969). Sensation magnitude of vibrotactile stimuli. Percept. Psychophys. 6, 366–372. doi: 10.3758/BF03212793

CrossRef Full Text | Google Scholar

Watkins, C., Leathley, M., Gregson, J., Moore, A., Smith, T., and Sharma, A. (2002). Prevalence of spasticity post stroke. Clin. Rehabil. 16, 515–522. doi: 10.1191/0269215502cr512oa

PubMed Abstract | CrossRef Full Text | Google Scholar

Won, K.-A., and Park, J.-H. (2018). Effectiveness of focal muscle vibration on upper extremity spasticity and function for stroke patients: a systematic review. Ther. Sci. Rehabil. 7, 23–33.

PubMed Abstract | Google Scholar

Yaraskavitch, M., Leonard, T., and Herzog, W. (2008). Botox produces functional weakness in non-injected muscles adjacent to the target muscle. J. Biomech. 41, 897–902. doi: 10.1016/j.jbiomech.2007.11.016

PubMed Abstract | CrossRef Full Text | Google Scholar

Zehr, E. P., and Stein, R. B. (1999). Interaction of the Jendrassik maneuver with segmental presynaptic inhibition. Exp. Brain Res. 124, 474–480. doi: 10.1007/s002210050643

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: muscle spasticity, vibration, stimulation, stroke, stroke rehabilitation

Citation: Seim C, Chen B, Han C, Vacek D, Wu LS, Lansberg M and Okamura A (2023) Relief of post-stroke spasticity with acute vibrotactile stimulation: controlled crossover study of muscle and skin stimulus methods. Front. Hum. Neurosci. 17:1206027. doi: 10.3389/fnhum.2023.1206027

Received: 14 April 2023; Accepted: 02 August 2023;
Published: 29 August 2023.

Edited by:

Sheng Li, University of Texas Health Science Center at Houston, United States

Reviewed by:

Manuel F. Mas, University of Puerto Rico, Puerto Rico
Javier Gonzalez-Buonomo, Ponce Health Sciences University, Puerto Rico

Copyright © 2023 Seim, Chen, Han, Vacek, Wu, Lansberg and Okamura. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Caitlyn Seim, cseim@stanford.edu; Chuzhang Han, jackhan@stanford.edu; David Vacek, dvacek@stanford.edu; Laura Song Wu, lsongwu@stanford.edu; Maarten Lansberg, lansberg@stanford.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.