Skip to main content

BRIEF RESEARCH REPORT article

Front. Hum. Neurosci., 04 June 2020
Sec. Brain Imaging and Stimulation
This article is part of the Research Topic Deep Brain Stimulation Think Tank: Updates in Neurotechnology and Neuromodulation Research View all 26 articles

Neurophysiological Correlates of Gait in the Human Basal Ganglia and the PPN Region in Parkinson’s Disease

  • 1Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, United States
  • 2Norman Fixel Institute for Neurological Diseases and the Program for Movement Disorders and Neurorestoration, University of Florida, Gainesville, FL, United States
  • 3Department of Applied Physiology and Kinesiology, University of Florida, Gainesville, FL, United States
  • 4J. Crayton Pruitt Department of Biomedical Engineering, University of Florida, Gainesville, FL, United States
  • 5School of Kinesiology, Auburn University, Auburn, AL, United States
  • 6Tecnológico de Monterrey, Escuela de Medicina y Ciencias de la Salud, Monterrey, Mexico
  • 7Department of Neurology, University of Florida, Gainesville, FL, United States
  • 8Department of Neurosurgery, University of Florida, Gainesville, FL, United States

This study aimed to characterize the neurophysiological correlates of gait in the human pedunculopontine nucleus (PPN) region and the globus pallidus internus (GPi) in Parkinson’s disease (PD) cohort. Though much is known about the PPN region through animal studies, there are limited physiological recordings from ambulatory humans. The PPN has recently garnered interest as a potential deep brain stimulation (DBS) target for improving gait and freezing of gait (FoG) in PD. We used bidirectional neurostimulators to record from the human PPN region and GPi in a small cohort of severely affected PD subjects with FoG despite optimized dopaminergic medications. Five subjects, with confirmed on-dopaminergic medication FoG, were implanted with bilateral GPi and bilateral PPN region DBS electrodes. Electrophysiological recordings were obtained during various gait tasks for 5 months postoperatively in both the off- and on-medication conditions (obtained during the no stimulation condition). The results revealed suppression of low beta power in the GPi and a 1–8 Hz modulation in the PPN region which correlated with human gait. The PPN feature correlated with walking speed. GPi beta desynchronization and PPN low-frequency synchronization were observed as subjects progressed from rest to ambulatory tasks. Our findings add to our understanding of the neurophysiology underpinning gait and will likely contribute to the development of novel therapies for abnormal gait in PD.

Clinical Trial Registration: Clinicaltrials.gov identifier; NCT02318927.

Introduction

The pedunculopontine nucleus (PPN) region has recently generated much interest as a deep brain stimulation (DBS) target for the treatment of freezing of gait (FoG) in Parkinson’s disease (PD; Stefani et al., 2007, 2013; Moreau et al., 2009; Moro et al., 2010; Khan et al., 2012; Welter et al., 2015; Hamani et al., 2016). Surgically targeting the PPN region has proven challenging due to the lack of clear anatomical demarcations on traditional imaging. Outcomes from small clinical trials have shown mixed benefits (Zrinzo et al., 2008, 2011; Mestre et al., 2016). A better electrophysiological understanding of the PPN region will be critical to the development of future therapeutic strategies and especially to closed-loop neuromodulation which relies on the identification of a control signal. Several clues point to the PPN region as an important node in human gait-related activities. First, it has been shown that gait-related symptoms have been closely associated with diseases associated with prominent PPN degeneration (e.g., PD and progressive supranuclear palsy). Second, the PPN has been shown in animals to be a critical node in the gait cycle. Finally, altered gait has been reported in lesional studies of the PPN region, and gait deficits are improved by electrical stimulation in both rat and non-human primate PD models (Aziz et al., 1998; Breit et al., 2001, 2005; Jenkinson et al., 2006; Nandi et al., 2008; Karachi et al., 2010; Grabli et al., 2013).

The globus pallidus internus (GPi) and the subthalamic nucleus (STN) are common targets for DBS therapy and have been utilized to address dopamine responsive symptoms in PD (e.g., tremor, rigidity, bradykinesia), as well as medication-related motor fluctuations and dyskinesia. However, both targets have failed to adequately address gait-related issues (Heremans et al., 2013; Morita et al., 2014). One approach to address this important gap in treatment has been to augment GPi or STN DBS with PPN region DBS (Stefani et al., 2007; Moreau et al., 2009).

The current study aimed to record simultaneously from the human PPN region and the GPi to elucidate the electrophysiological correlates of human gait. The study was part of a Michael J. Fox Foundation challenge grant to improve neuromodulation approaches in patients with gait and freezing issues not responsive to dopamine replacement therapies. Also, patients included in the study were not required to possess a 30% improvement with dopaminergic medication. The data presented here is collected from electrodes implanted bilaterally in the PPN region and bilaterally in the posteroventral GPi from five ambulatory human participants with PD. Local field potentials (LFPs) were collected chronically during the no active stimulation condition through bidirectional DBS implants.

Materials and Methods

Subjects

University of Florida Institutional Review Board and FDA IDE (G140181) approvals were granted for the recruitment of five human PD subjects (two females; age range: 50–74 years). A confirmed medical history of on and off dopaminergic medication FoG was required, despite exhaustive dosage optimization by a movement-disorder trained neurologist. Additionally, participation required more than two FoG episodes per month, a score of more than 1 on item #3 on the Freezing of Gait Questionnaire (FOG-Q; Giladi et al., 2000), and also a minimum of five FoG episodes under a provocation gait protocol. Study candidates were screened and evaluated at the Norman Fixel Institute for Neurological Diseases at the University of Florida by an interdisciplinary clinical-research DBS team. The public listing with the full inclusion and exclusion criteria can be found on ClinicalTrials.gov (NCT02548897). Seven potential candidates were screened, from which five subjects (aged 50–75, two females) were recruited and provided written informed consent before any study interventions (Table 1). Subject 3 deteriorated very quickly after surgery and could only complete tasks by utilizing a walker.

TABLE 1
www.frontiersin.org

Table 1. Subject demographics.

Device and Implantation Surgery

The implantation procedure was divided into three stages. Two leads were unilaterally implanted in the first stage, and in the second stage of the operation 2 to 4 weeks later the other two leads were implanted contralaterally. In one subject the two PPN leads were placed in one stage and the two GPi leads in a second stage which was performed 2 to 4 weeks later. The final stage of the operation occurred approximately 4 weeks after stages one and two and in this stage, the four DBS leads were connected to the implantable neurostimulators (INS) and secured in a sub-clavicular pocket. Each of the three stages was separated by a month to resolve brain edema, minimize brain shift, and to avoid prolonged time in the operating room. Each subject received two quadripolar Medtronic model 3,387 leads targeting the GPi, bilaterally, and two model-3,389 leads targeting the PPN, also bilaterally. Both GPi leads were connected to a Medtronic Activa PC+S (Medtronic PLC, Minneapolis, MN, USA) in a sub-clavicular pocket on the left side, and both PPN leads were connected to another Activa PC+S in a different sub-clavicular pocket on the right. Pairing the leads by nuclei instead of laterality was performed to facilitate the preferred differences in therapeutic frequencies for each brain target. Traditionally, the PPN has been stimulated at lower frequencies than the GPi and a single IPG cannot drive two leads with differing frequencies. Nuclei targeting was achieved through high-resolution MRI imaging performed before surgery. A stereotactic head CT was coregistered to T1 and FGATIR MRI images. Additionally, these images were fused to a patient-specific, 3-D deformable brain atlas (Sudhyadhom et al., 2012). During the implantation surgery, the subjects remained awake for microelectrode recordings performed using an FHC 4000 LP+ system (FHC, Bowdoin, ME, USA). A movement-disorder neurologist evaluated changes in neural firing derived from the microelectrode recordings to refine the physiological mapping of the nuclei borders of each target. Since the PPN region has not been shown to exhibit clear demarcations on MRI images and has not been demonstrated to have widely accepted and reproducible physiological markers during MER mapping, the PPN region targeting relied more on interpolation from surrounding structures and measurements than from 4th ventricular landmarks (Hamani et al., 2007; Zrinzo et al., 2008; Shimamoto et al., 2010; Morita et al., 2014). Post-operative CT images co-registered with pre-operative MRI was used to confirm the post-operative position of the leads.

Postoperative Data

Monthly electrophysiological data collections commenced approximately 30 days after the last phase of the surgical procedures and were performed acutely in a gait laboratory equipped with a 10-camera motion capture system (Vicon Motion Systems, Oxford, UK) and three embedded force plates (Bertec, Newton, MA, USA). The Activa PC+S recorded from two electrodes in a symmetric bipolar configuration for common-mode rejection. The bipolar contacts were separated by a middle contact, which could be used for stimulation in a monopolar configuration (Afshar et al., 2012; Stanslaski et al., 2012; Bourget et al., 2015). Although the data presented here were collected in the absence of stimulation, we aimed to identify gait features that could guide in responsive stimulation. Neural data were sampled at 421.9 Hz. Concurrent EMG and inertial (accelerometer, gyroscope, and magnetometer) data were recorded with wireless sensors (Delsys, Inc., Natick, MA, USA) sampled at 1,925.93 Hz and 148.25 Hz, respectively. To synchronize the neural signals with the external sensor data, the PC+S delivered a low-frequency marker burst (~5 Hz in the GPi and ~8 Hz in the PPN). A nearby EMG sensor (on the neck or forehead) was able to detect the onset and termination of the low-frequency marker bursts. The data were also supplemented with 24 frames/s of video recordings. Short synchronization pulses were ported to the EMG amplifier that simultaneously flashed a LED captured by the video camera. Each modality was linked through marker bursts or EMG/LED pulses and the data were conjoined manually in MATLAB. The protocol was comprised of a battery of tasks, performed both on and off dopaminergic medication, to study gait and to elicit FoG, including stepping in place, changing cadence, narrow passages, dual-attention tasks, turning, and navigating obstacles (Snijders et al., 2008, 2010, 2012; Spildooren et al., 2010; Stegemõller et al., 2012). Subjects restricted dopaminergic medication for at least 12 h before the off medication data collections. Recurrent data collections over 5 months post-implant were conducted during the patients’ monthly check-up/programming visits.

Signal Processing and Statistics

Signal processing was performed within MATLAB 2018a (MathWorks, Natick, MA, USA) with custom scripts. Power spectral densities (PSD) were calculated using a 40-order autoregressive model (Schalk et al., 2004; Stoica and Moses, 2004). The data was windowed at 250 ms and with a 50% overlap. Each spectral bin within a condition was tested for significance via the Mann–Whitney test with Bonferroni correction. Mean power distributions between two conditions were tested for significance with the Kruskal–Wallis test with Dunn’s corrected test for multiple comparisons. Multiple linear regressions were done to compare the PPN feature band against gait measures for all subjects. Individual regressions were done for conditions and variables that reached significance at the group level. F-tests were used to test the regressions for significance. Spectral bins that were significant were labeled as “feature detection.” We picked the channels with the strongest feature during the “feature extraction” step. This approach is commonly used by our laboratory and other laboratories performing similar experiments. In choosing contacts for analysis, we chose a method to avoid picking a single combination a priori, not knowing where the difference in modulation would be found. Since multiple contact combinations and hemispheres showed a difference, for subsequent analysis, the combination that showed the largest difference was used.

Clinical Scores and Assessment

Each monthly visit included biomechanical gait measures (e.g., gait speed, cadence, stride length) collected via the Vicon motion capture system and processed by the Applied Neuromechanics Laboratory at the University of Florida. The subjects were administered the FoG-Q, the Gait and Falls Questionnaire (GFQ; Giladi et al., 2000), the Activities/Balance Confidence Scale (ABC; Powell and Myers, 1995), the PD Quality of Life Questionnaire (PDQ; Peto et al., 1998), and the Unified Parkinson’s Disease Rating Scale (UPDRS; Fahn and Elton, 1987). Assistive-walking-device information was also collected. These measures were assessed during screening and at baseline (before DBS implantation). Clinical scores and assessments were primarily used to evaluate the effectiveness of responsive PPN DBS and to track disease progression and the clinical outcomes (Molina et al., 2018). An independent movement disorders neurologist reviewed the videos recorded during data collections. The neurologist labeled freezing episodes, the type of freezing (such as during walking, start hesitation, or turning hesitation), the severity of the freeze, and the confidence in the label of a freezing event.

Results

Due to the variation in PPN localization, two methods were used to assess the location of the recorded electrophysiology. Figure 1A shows T1 inverted (left panels) and T2 (right panels) MRI images of the active contact (middle) from the symmetric bipolar recordings shown in Figures 2, 3. The rostral face of the PPN region resides in an area laterally and ventrally bound by the spinothalamic tract, the lateral lemniscus, and medial lemniscus, as well as dorsal-medially by the spinal cerebellar peduncle (SCP) decussation (Hamani et al., 2016). Visual inspection of imaging, shows that subjects 1–4 were generally within this area, while subject 5’s leads were dorsal to the region. Additionally, anatomically the rostral part of the PPN region is in the plane of the mid-inferior colliculus. T2 images confirmed the active DBS contact to be at or below this plane for all five subjects. Figure 1A reveals the active contacts in the PPN region. Figure 1B shows a second confirmatory method that was used to determine DBS lead placement, using Lead-DBS to normalize the individual images to the MNI brain space. Collectively by both methods, the leads are shown to be in an estimated PPN region (Snijders et al., 2016). The leads show a consistent cluster. The additional analysis did not reveal a relationship between the spatial location of the active contact and the corresponding clinical score. The locations marked as “active contact” in Figure 1A depict the contact from which stimulation was provided for therapy. These contacts were chosen for therapy as the bipolar recordings from their two adjacent electrodes yielded the highest PPN neural correlate for gait in the absence of stimulation.

FIGURE 1
www.frontiersin.org

Figure 1. Pedunculopontine nucleus (PPN) lead localization methods. (A) MRI-CT co-registered images of each subject. The “active contact” marks the center of the bipolar electrode configuration that yielded the feature most correlated with gait. The left panels show T1 inverted axial views of the active contact (orange) and the contralateral lead (blue). The right panels show T2 sagittal views of the active contact. (B) Leads normalized to MNI space using Lead-deep brain stimulation (DBS). All leads are shown with a red dot that roughly defines the location of the PPN.

FIGURE 2
www.frontiersin.org

Figure 2. Globus pallidus internus (GPi) response to medication. (A) Power spectral density of GPi signals from Subject 1, OFF, and ON levodopa medication during various baseline and gait tasks. (B) Bar plots of raw decrease in GPi beta power during sitting (8–20 Hz). (C) Bar plots of each subject’s percent improvement in UPDRS III score from OFF medication to ON medication during sitting. The red line marks a 30% improvement, a commonly employed clinical benchmark for medication responsiveness.

FIGURE 3
www.frontiersin.org

Figure 3. PPN and GPi response to gait tasks in the on medication condition. (A) Logarithmic power spectral density of PPN signal power in a single subject during various balance and gait-related tasks. (B,C) Single-subject (log normalized to standing) demonstrating PPN low frequency and GPi beta modulation with gait onset shown as boxplots. Significance bars indicate that tasks that statistically could be differentiated from gait every month (p < 0.001). Panel (D) Shows the temporal evolution of neural signatures with gait initiation and the spectrogram from the same subject as (A) averaged across gait initiation trials in one session. This subject exhibited a beta peak while at rest, and this beta peak decreased with gait initiation, while the PPN modulated in response to walking in the 1–8 Hz spectral band. The outlined bands show the dissipation of the beta rhythm in the GPi while the PPN feature bands modulated at the onset of gait.

Figure 2A shows the PSD of GPi signals in one of the subjects tested under two different medication conditions while performing different tasks. Each task was performed for 3 min and aggregated across five consecutive months. In all the conditions, a peak in the low beta range (8–22 Hz) in at least one bipolar combination and one hemisphere is prominent. This beta peak modulates in response to the task and the medication state, and specifically, the peak decreases with medication intake (red vs. blue lines in Figure 2A). Figure 2B shows the mean power in the low beta frequency range for each subject. A decrease in low beta was observed in response to dopaminergic medication intake across four of the five subjects, with Subject 3 lacking a decrease in low beta. Baseline pre-operative clinical improvement response to medication was measured as a percent reduction in UPDRS III PD motor score off and then on medication in this study cohort. Figure 2C shows the percent improvement in UPDRS III scores in response to the medication at the pre-operative baseline. Except for Subject 3, the cohort met the usual clinical benchmark of a 30% improvement off to on dopaminergic medications. Subject 3 did not exhibit either medication-induced beta suppression in GPi or minimal improvement (<30%) in clinical scores with medication. Figure 3 summarizes the spectral modulation in the GPi and the PPN during different walking tasks during the on medication condition. A full dataset of walking tasks during off medication per the protocol was not available and is therefore not shown. Each task was performed for 3 min and aggregated across five consecutive months. The power spectral density of a single subject is shown in Figure 3A. There was an increased PPN activity in the sub-8 Hz spectral range with axial and gait trials compared to sitting and standing. The data reveal differences in walking and rest for all subjects and differences between most other tasks. As subjects progressed through sitting, standing, stepping-in-place, and walking, the PPN 1–8 Hz feature modulated in response to the task, reaching maximum power during walking in four out of five patients. The significance bars denote tasks that were differentiable from gait across all recordings within 6 months with p < 0.01. The walking task was the most distinguishable from the other tasks in all subjects except for Subject 3, who had to perform the stepping-in-place and walking tasks using a walker due to rapid disease progression. The stimulation contact was chosen the be in the center of the two electrodes that yielded the most significant PPN 1–8 Hz feature. This feature was observed to be closer to the rostral part of the PPN region which was located near the level of the mid-inferior colliculus (see Figure 1A). Figure 3B (PPN) and Figure 3C (GPi) are boxplots of the features of interest. Figure 3B shows a decrease in the 1–8 Hz band with freezing of gait, albeit there were few episodes captured in the laboratory (3–12 episodes). Figure 3C summarizes the data from GPi and it reveals a decrease in beta power from rest to gait initiation. Figure 3D shows the temporal evolution of neural signatures with gait initiation and the spectrogram from the same subject as Figure 3A averaged across gait initiation trials in one session. This subject exhibited a beta peak while at rest, and this beta peak decreased with gait initiation, while the PPN modulated in response to walking in the 1–8 Hz spectral band. The outlined bands show the dissipation of the beta rhythm in the GPi while the PPN feature bands modulated at the onset of gait.

The 1–8 Hz feature band was tested against measured cadence, walking speed, and stride length in multiple linear regression, where power in the feature band was the dependent variable and cadence, walking speed, and stride length were the predictors. Four different multiple regressions were done, during off and on medications, and testing both the lead that yielded the most reliable modulation between conditions in Figure 3 and the contralateral lead. The regressions using power from the reported lead reached significance (p-value 0.00027 and 0.016, off and on medication, respectively), while the regressions for the contralateral lead did not (0.066 and 0.15, off and on medication, respectively). The only feature to produce significance in the regressions in the available subjects was the PPN 1–8 Hz feature against walking speed (0.0076 and 0.0019, off and on medication, respectively). The individual regressions are shown in Figure 4. Complete gait metrics were available for three subjects (subjects 1, 2, and 5). Recording conditions or missing alignment artifacts precluded the inclusion of data from the other two subjects. Additionally, the location of the correlated feature was not the same bipolar contact for Subject 2 as shown in Figure 1, but it was observed on the same (ipsilateral) lead. Finally, changes in medication state were observed. The OFF-medication state resulted in higher r2 values (0.591, 0.42, and 0.497, respectively) than the ON-mediation state (0.052, 0.058, and 0.26, respectively). The slopes were significant for all of the OFF-medication regressions, and only for the ON-medication data for subject 2.

FIGURE 4
www.frontiersin.org

Figure 4. PPN low-frequency feature compared against gait metrics. The mean walking speed of subjects 1, 2, and 5 are plotted against their averaged normalized power in the 1–8 Hz PPN feature band. Each regression is performed by subject and within the same medication condition, for a total of six regressions. Each point represents a trial. Error bars are shown as dotted parabolas following the trend line. *p < 0.1.

Discussion

Herein we report human electrophysiological recordings from the GPi and the PPN regions during various gait tasks in five subjects. Our findings showed suppression of low beta power in the GPi in response to medication, and a 1–8 Hz modulation in four subjects in the PPN region correlating with human gait in the on medication state. Significant decreases in the GPi beta band with medication corresponded to marked improvements in clinical scores, which increased our confidence in the signal quality captured with the bidirectional neurostimulators. GPi beta also decreased during gait tasks. Meanwhile, the 1–8 Hz power in the PPN region increased with walking and seemed to correlate with walking speed, which was not the case for GPi beta activity. GPi beta desynchronization and PPN activation in 1–8 Hz was shown as subjects progressed from rest to ambulatory tasks. Finally, postoperative imaging and normalization tools suggested that the PPN region was reasonably targeted and the DBS leads were well clustered, although the precise targets for DBS in this region remain unknown. Additionally, the small size of the cohort and the clustering of the active contact in the region may have prevented a clear delineation in the contact location by the subjects’ clinical response to the therapy (Goetz et al., 2019). The results from this study complement the current literature regarding low-frequency oscillations in the caudal region of the PPN and the relationship to human gait (Thevathasan et al., 2012).

The data further revealed a reproducible mean power change in the 1–8 Hz power band in response to gait initiation. Recent studies have reported a similar feature of low-frequency bands of interest in the PPN (Androulidakis et al., 2008; Thevathasan et al., 2012). However the data presented herein, collected over several months, did not reveal a distinct peak but rather changes in broad activity in the 1–8 Hz band. Variations in lead localization, the recording devices, and the experimental setup are a few of the many possible reasons for the difference between the feature reported herein and in other studies. Our group acknowledges that there is commonly uncertainty in the exact source of each LFP in human studies such as ours. This feature was observed to be closer to the rostral part of the PPN region which was located near the level of the mid-inferior colliculus. This 1–8 Hz power band will likely be important for guiding future studies and therapeutics.

An important observation from this study was the change in the correlation between walking speed and PPN activity in response to dopaminergic medication. Rodent and primate studies have suggested changes in neural activity in the on and off dopaminergic parkinsonian state (Mitchell et al., 1989; Futami et al., 1995; Breit et al., 2001, 2005; Matsumura and Kojima, 2002). It is reasonable that in the PD cases there is an important effect of medications and gait changes on efferent nuclei within the basal ganglia and brainstem. The current circuitry model broadly and nonspecifically suggests that gait is regulated by a large corticolimbic-ventral striatal-ventral pallidal-PPN-pontomedullary reticular nuclei-spinal cord network (Nutt et al., 2011). This network likely includes tonic inhibition of the mesencephalic locomotor region (MLR) through the GPi and the STN (Pahapill and Lozano, 2000; Hamani et al., 2007; Grillner et al., 2008; Alam et al., 2011). Figure 4 shows an example of GPi beta that is present during rest and dissipates at gait onset. Our data suggest the possibility that efferent brainstem nuclei are modulated with beta desynchronization in the GPi. It was interesting that the 1–8 Hz activity appeared during walking. The curious observation was the decrease in 1–8 Hz activity as the walking speed increased which conflicts with some of the published literature. Since this was only a five patient study and the study was of “on freezers” we would need to interpret this finding cautiously and we could not reliably conclude that 1–8 Hz power reflects an impairment of fast walking. The data also suggest that the PPN region has a role not limited to gait but is likely involved in tasks requiring balance and lower limb activation (i.e., standing and stepping-in-place).

Finally, we report GPi beta suppression with dopaminergic medication and a correlation to improvement in pre-operative clinical on-off medication scores. Data from Subject 3 was insightful and demonstrated that GPi beta suppression was not a direct consequence of levodopa intake but was more likely an indicator of symptomatic improvement as reflected in UPDRS scores. Beta power in multiple basal ganglia regions has been previously shown to correlate with symptom severity and its suppression, either through dopaminergic therapy or DBS and has been correlated with improvements in UPDRS scores (specifically bradykinesia, and rigidity; Brown et al., 2001; Levy et al., 2002; Kühn et al., 2006, 2009; Ray et al., 2008; Jenkinson and Brown, 2011). Excessive inhibitory (GABA-ergic) activity from the basal ganglia may dampen the activity of efferent nuclei such as in the brainstem PPN region. Furthermore, one may posit that a successful therapy may reestablish a healthier basal ganglia modulation, which in turn reduces rigidity and bradykinesia. A possible hypothesis for the lack of beta suppression in Subject 3 may be that under severe degeneration and lack of clinical response to dopamine, basal ganglia function cannot be restored, and beta power remains unchanged. This point will need further clarification as therapeutic strategies that target beta may be affected by disease progression.

Understanding the neural correlates of gait is crucial in defining future therapeutic strategies. The response to the beta band could dictate optimal dosage, administration times, or serve as a measure of disease progression. The roles GPi and the PPNregion each play in gait could also be harnessed to develop better therapies for walking disturbances.

We would also like to address potential artifacts in the dataset. The manufacturer, Medtronic, and their team of engineers recognize movements as a possible source of artifacts however these artifacts would produce large amplitude, broad bandwidth, narrow duration (concentrated) impulse responses in the spectrograms. Although Figure 3 does have broadband activity, this does not fit the narrow duration of movement artifact. Each subject had two devices, one for GPi leads and one for PPN region leads. If the PC+S was susceptible to movement artifacts presenting in the low-frequency band, then it would likely have shown up in at least one of the GPi recordings. None of the GPi recordings revealed a significant difference in the 1–8 Hz as was observed in the PPN data.

There were several important limitations of this study. This population suffered from debilitating gait and postural instability, from levodopa refractory FoG, from lower limb orthopedic issues, and other diseases, unrelated to PD or DBS. Obtaining high-quality recordings in different conditions was challenging in this population. Performing a large number of unassisted continuous walking trials was non-trivial. Subjects performed walking in short trials of ~8 m, followed by a spotter walking alongside the subject, and occasionally walking with an assistive device. Although recording conditions were not ideal, this study was able to collect neural data for the first time from ambulatory humans with a real-time recording from GPi and PPN regions. Furthermore, the few FoG episodes captured in only a few conditions and the required electrode configurations for recording also may have impacted the analysis. Second, we acknowledge the small sample size, although we would also argue that a small cohort facilitated greater depth of interaction with the subjects and also generated robust physiology datasets for analysis and interpretation. Moreover, this project was an early feasibility study of an invasive high-risk multi-lead procedure. We acknowledge that atypical parkinsonism could not be completely ruled out in these patients. However, without pathology or additional evidence of another disease, the clinical diagnosis for the cohort was idiopathic PD with “on” medication freezing. Finally, the localization of the human PPN region continues to be a formidable challenge. We presented individual data on localization using two methods and we purposely refer to this as a “region” rather than as a clearly demarcated target. However, the challenges presented in this study are not atypical and have been observed in the limited number of PPN DBS studies in the literature (Thevathasan et al., 2018).

To summarize, this study revealed the neural correlates of gait in human GPi and the PPN region in a population of patients with “on” dopaminergic gait and freezing issues. Real-time human electrophysiology revealed suppression of low beta power in the GPi in response to medication and gait tasks and a 1–8 Hz modulation in the PPN region that was correlated to ambulation.

Data Availability Statement

The datasets from this study may be available upon request from the corresponding author with appropriate regulatory agreements.

Ethics Statement

The studies involving human participants were reviewed and approved by US Food and Drug Administration (FDA) IDE G140181 and University of Florida (UF) IRB-01 201400951. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

RM collected data, analyzed data, and wrote the first draft of manuscript. CJH designed research, collected data, and edited manuscript. KS collected data, analyzed data, and edited the manuscript. AS, EO, and JR collected data and edited the manuscript. DM-R analyzed data and the manuscript. CWH edited the manuscript. KF performed surgeries. MO designed research and edited the manuscript. AG designed research, supervised research, and edited the manuscript.

Funding

This study was supported by the Michael J. Fox Foundation Grant 9558 and partly by the Parkinson Alliance. Patients were recruited from the Parkinson’s Foundation Center of Excellence and the Norman Fixel Institute for Neurological Diseases.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

Medtronic provided the devices as part of a partnership with the Michael J. Fox Foundation Innovative Neuromodulation Solutions grant program. Hyokeun Lee, Matt Terza, Tiphanie Raffegeau, and Amanda Stone contributed to the collection and processing of gait data.

References

Afshar, P., Khambhati, A., Stanslaski, S., Carlson, D., Jensen, R., Linde, D., et al. (2012). A translational platform for prototyping closed-loop neuromodulation systems. Front. Neural Circuits 6:117. doi: 10.3389/fncir.2012.00117

PubMed Abstract | CrossRef Full Text | Google Scholar

Alam, M., Schwabe, K., and Krauss, J. K. (2011). The pedunculopontine nucleus area: critical evaluation of interspecies differences relevant for its use as a target for deep brain stimulation. Brain 134, 11–23. doi: 10.1093/brain/awq322

PubMed Abstract | CrossRef Full Text | Google Scholar

Androulidakis, A. G., Mazzone, P., Litvak, V., Penny, W., Dileone, M., Gaynor, L. M. F., et al. (2008). Oscillatory activity in the pedunculopontine area of patients with Parkinson’s disease. Exp. Neurol. 211, 59–66. doi: 10.1016/j.expneurol.2008.01.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Aziz, T. Z., Davies, L., Stein, J., and France, S. (1998). The role of descending basal ganglia connections to the brain stem in Parkinsonian akinesia. Br. J. Neurosurg. 12, 245–249. doi: 10.1080/02688699845078

PubMed Abstract | CrossRef Full Text | Google Scholar

Bourget, D., Bink, H., Stanslaski, S., Linde, D., Arnett, C., Adamski, T., et al. (2015). “An implantable, rechargeable neuromodulation research tool using a distributed interface and algorithm architecture,” in 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER), (Montpellier, France: IEEE), 61–65.

Google Scholar

Breit, S., Bouali-Benazzouz, R., Benabid, A. L., and Benazzouz, A. (2001). Unilateral lesion of the nigrostriatal pathway induces an increase of neuronal activity of the pedunculopontine nucleus, which is reversed by the lesion of the subthalamic nucleus in the rat. Eur. J. Neurosci. 14, 1833–1842. doi: 10.1046/j.0953-816x.2001.01800.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Breit, S., Lessmann, L., Benazzouz, A., and Schulz, J. B. (2005). Unilateral lesion of the pedunculopontine nucleus induces hyperactivity in the subthalamic nucleus and substantia nigra in the rat. Eur. J. Neurosci. 22, 2283–2294. doi: 10.1111/j.1460-9568.2005.04402.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Brown, P., Oliviero, A., Mazzone, P., Insola, A., Tonali, P., and Di Lazzaro, V. (2001). Dopamine dependency of oscillations between subthalamic nucleus and pallidum in Parkinson’s disease. J. Neurosci. 21, 1033–1038. doi: 10.1523/JNEUROSCI.21-03-01033.2001

PubMed Abstract | CrossRef Full Text | Google Scholar

Fahn, S., and Elton, R. (1987). “Unified Parkinson’s disease rating scale,” in Recent Developments in Parkinson’s Disease, eds S. Fahn, C. D. Marsden, D. Calne and M. Goldstein (Florham Park: Macmillan Health Care Information), 153–163.

Google Scholar

Futami, T., Takakusaki, K., and Kitai, S. T. (1995). Glutamatergic and cholinergic inputs from the pedunculopontine tegmental nucleus to dopamine neurons in the substantia nigra pars compacta. Neurosci. Res. 21, 331–342. doi: 10.1016/0168-0102(94)00869-h

PubMed Abstract | CrossRef Full Text | Google Scholar

Giladi, N., Shabtai, H., Simon, E. S., Biran, S., Tal, J., and Korczyn, A. D. (2000). Construction of freezing of gait questionnaire for patients with Parkinsonism. Parkinsonism Relat. Disord. 6, 165–170. doi: 10.1016/s1353-8020(99)00062-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Goetz, L., Bhattacharjee, M., Ferraye, M. U., Fraix, V., Maineri, C., Nosko, D., et al. (2019). Deep brain stimulation of the pedunculopontine nucleus area in parkinson disease: MRI-based anatomoclinical correlations and optimal target. Neurosurgery 84, 506–518. doi: 10.1093/neuros/nyy151

PubMed Abstract | CrossRef Full Text | Google Scholar

Grabli, D., Karachi, C., Folgoas, E., Monfort, M., Tande, D., Clark, S., et al. (2013). Gait disorders in parkinsonian monkeys with pedunculopontine nucleus lesions: a tale of two systems. J. Neurosci. 33, 11986–11993. doi: 10.1523/JNEUROSCI.1568-13.2013

PubMed Abstract | CrossRef Full Text | Google Scholar

Grillner, S., Wallén, P., Saitoh, K., Kozlov, A., Robertson, B., Wallen, P., et al. (2008). Neural bases of goal-directed locomotion in vertebrates-an overview. Brain Res. Rev. 57, 2–12. doi: 10.1016/j.brainresrev.2007.06.027

PubMed Abstract | CrossRef Full Text | Google Scholar

Hamani, C., Lozano, A. M., Mazzone, P. A. M., Moro, E., Hutchison, W., Silburn, P. A., et al. (2016). Pedunculopontine nucleus region deep brain stimulation in parkinson disease: surgical techniques, side effects, and postoperative imaging. Stereotact. Funct. Neurosurg. 94, 307–319. doi: 10.1159/000449011

PubMed Abstract | CrossRef Full Text | Google Scholar

Hamani, C., Stone, S., Laxton, A., and Lozano, A. M. (2007). The pedunculopontine nucleus and movement disorders: anatomy and the role for deep brain stimulation. Parkinsonism Relat. Disord. 13, 276–280. doi: 10.1016/s1353-8020(08)70016-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Heremans, E., Nieuwboer, A., and Vercruysse, S. (2013). Freezing of gait in Parkinson’s disease: where are we now? Topical collection on movement disorders. Curr. Neurol. Neurosci. Rep. 13:350. doi: 10.1007/s11910-013-0350-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Jenkinson, N., and Brown, P. (2011). New insights into the relationship between dopamine, beta oscillations and motor function. Trends Neurosci. 34, 611–618. doi: 10.1016/j.tins.2011.09.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Jenkinson, N., Nandi, D., Oram, R., Stein, J. F., and Aziz, T. Z. (2006). Pedunculopontine nucleus electric stimulation alleviates akinesia independently of dopaminergic mechanisms. Neuroreport 17, 639–641. doi: 10.1097/00001756-200604240-00016

PubMed Abstract | CrossRef Full Text | Google Scholar

Kühn, A. A., Kupsch, A., Schneider, G.-H., and Brown, P. (2006). Reduction in subthalamic 8–35 Hz oscillatory activity correlates with clinical improvement in Parkinson’s disease. Eur. J. Neurosci. 23, 1956–1960. doi: 10.1111/j.1460-9568.2006.04717.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Kühn, A. A., Tsui, A., Aziz, T., Ray, N., Brücke, C., Kupsch, A., et al. (2009). Pathological synchronisation in the subthalamic nucleus of patients with Parkinson’s disease relates to both bradykinesia and rigidity. Exp. Neurol. 215, 380–387. doi: 10.1016/j.expneurol.2008.11.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Karachi, C., Grabli, D., Bernard, F. A., Tandé, D., Wattiez, N., Belaid, H., et al. (2010). Cholinergic mesencephalic neurons are involved in gait and postural disorders in Parkinson disease. J. Clin. Invest. 120, 2745–2754. doi: 10.1172/JCI42642

PubMed Abstract | CrossRef Full Text | Google Scholar

Khan, S., Gill, S. S., Mooney, L., White, P., Whone, A., Brooks, D. J., et al. (2012). Combined pedunculopontine-subthalamic stimulation in Parkinson disease. Neurology 78, 1090–1095. doi: 10.1212/WNL.0b013e31824e8e96

PubMed Abstract | CrossRef Full Text | Google Scholar

Levy, R., Hutchison, W. D., Lozano, A. M., and Dostrovsky, J. O. (2002). Synchronized neuronal discharge in the basal ganglia of parkinsonian patients is limited to oscillatory activity. J. Neurosci. 22, 2855–2861. doi: 10.1523/jneurosci.22-07-02855.2002

PubMed Abstract | CrossRef Full Text | Google Scholar

Matsumura, M., and Kojima, J. (2002). The role of the pedunculopontine tegmental nucleus in experimental parkinsonism in primates. Stereotact. Funct. Neurosurg. 77, 108–115. doi: 10.1159/000064614

PubMed Abstract | CrossRef Full Text | Google Scholar

Mestre, T. A., Sidiropoulos, C., Hamani, C., Poon, Y.-Y. Y., Lozano, A. M., Lang, A. E., et al. (2016). Long-term double-blinded unilateral pedunculopontine area stimulation in Parkinson’s disease. Mov. Disord. 31, 1570–1575. doi: 10.1002/mds.26710

PubMed Abstract | CrossRef Full Text | Google Scholar

Mitchell, I. J., Clarke, C. E., Boyce, S., Robertson, R. G., Peggs, D., Sambrook, M. A., et al. (1989). Neural mechanisms underlying parkinsonian symptoms based upon regional uptake of 2-deoxyglucose in monkeys exposed to 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine. Neuroscience 32, 213–226. doi: 10.1016/0306-4522(89)90120-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Molina, R., Hass, C. J., Sowalsky, K., Schmitt, A. C., Roper, J., Martinez-Ramirez, D., et al. (2018). Adaptive deep brain stimulation to treat freezing of gait in Parkinson’s disease. Submitt. Publ. doi: 10.31525/ct1-nct04197947

CrossRef Full Text | Google Scholar

Moreau, C., Defebvre, L., Devos, D., Marchetti, F., Destée, A., Stefani, A., et al. (2009). STN versus PPN-DBS for alleviating freezing of gait: toward a frequency modulation approach? Mov. Disord. 24, 2164–2166. doi: 10.1002/mds.22743

PubMed Abstract | CrossRef Full Text | Google Scholar

Morita, H., Hass, C. J., Moro, E., Sudhyadhom, A., Kumar, R., and Okun, M. S. (2014). Pedunculopontine nucleus stimulation: where are we now and what needs to be done to move the field forward? Front. Neurol. 5:243. doi: 10.3389/fneur.2014.00243

PubMed Abstract | CrossRef Full Text | Google Scholar

Moro, E., Hamani, C., Poon, Y. Y., Al-Khairallah, T., Dostrovsky, J. O., Hutchison, W. D., et al. (2010). Unilateral pedunculopontine stimulation improves falls in Parkinson’s disease. Brain 133, 215–224. doi: 10.1093/brain/awp261

PubMed Abstract | CrossRef Full Text | Google Scholar

Nandi, D., Jenkinson, N., Stein, J., and Aziz, T. (2008). The pedunculopontine nucleus in Parkinson’s disease: primate studies. Br. J. Neurosurg. 22, S4–S8. doi: 10.1080/02688690802448350

PubMed Abstract | CrossRef Full Text | Google Scholar

Nutt, J. G., Bloem, B. R., Giladi, N., Hallett, M., Horak, F. B., and Nieuwboer, A. (2011). Freezing of gait: moving forward on a mysterious clinical phenomenon. Lancet Neurol. 10, 734–744. doi: 10.1016/s1474-4422(11)70143-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Pahapill, P. A., and Lozano, A. M. (2000). The pedunculopontine nucleus and Parkinson’s disease. Brain 123, 1767–1783. doi: 10.1093/brain/123.9.1767

PubMed Abstract | CrossRef Full Text | Google Scholar

Peto, V., Jenkinson, C., and Fitzpatrick, R. (1998). PDQ-39: a review of the development, validation and application of a Parkinson’s disease quality of life questionnaire and its associated measures. J. Neurol. 245, S10–S14. doi: 10.1007/pl00007730

PubMed Abstract | CrossRef Full Text | Google Scholar

Powell, L. E., and Myers, A. M. (1995). The activities-specific balance confidence (ABC) Scale. J. Gerontol. A Biol. Sci. Med. Sci. 50A, M28–M34. doi: 10.1093/gerona/50a.1.m28

PubMed Abstract | CrossRef Full Text | Google Scholar

Ray, N. J., Jenkinson, N., Wang, S., Holland, P., Brittain, J. S., Joint, C., et al. (2008). Local field potential beta activity in the subthalamic nucleus of patients with Parkinson’s disease is associated with improvements in bradykinesia after dopamine and deep brain stimulation. Exp. Neurol. 213, 108–113. doi: 10.1016/j.expneurol.2008.05.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Schalk, G., McFarland, D. J., Hinterberger, T., Birbaumer, N., and Wolpaw, J. R. (2004). BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Trans. Biomed. Eng. 51, 1034–1043. doi: 10.1109/tbme.2004.827072

PubMed Abstract | CrossRef Full Text | Google Scholar

Shimamoto, S. A., Larson, P. S., Ostrem, J. L., Glass, G. A., Turner, R. S., and Starr, P. A. (2010). Physiological identification of the human pedunculopontine nucleus. J. Neurol. Neurosurg. Psychiatry 81, 80–86. doi: 10.1136/jnnp.2009.179069

PubMed Abstract | CrossRef Full Text | Google Scholar

Snijders, A. H., Haaxma, C. A., Hagen, Y. J., Munneke, M., and Bloem, B. R. (2012). Freezer or non-freezer: clinical assessment of freezing of gait. Parkinsonism Relat. Disord. 18, 149–154. doi: 10.1016/j.parkreldis.2011.09.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Snijders, A. H., Nijkrake, M. J., Bakker, M., Munneke, M., Wind, C., and Bloem, B. R. (2008). Clinimetrics of freezing of gait. Mov. Disord. 23, 468–474. doi: 10.1002/mds.22144

PubMed Abstract | CrossRef Full Text | Google Scholar

Snijders, A. H., Takakusaki, K., Debu, B., Lozano, A. M., Krishna, V., Fasano, A., et al. (2016). Physiology of freezing of gait. Ann. Neurol. 80, 644–659. doi: 10.1002/ana.24778

PubMed Abstract | CrossRef Full Text | Google Scholar

Snijders, A. H., Weerdesteyn, V., Hagen, Y. J., Duysens, J., Giladi, N., and Bloem, B. R. (2010). Obstacle avoidance to elicit freezing of gait during treadmill walking. Mov. Disord. 25, 57–63. doi: 10.1002/mds.22894

PubMed Abstract | CrossRef Full Text | Google Scholar

Spildooren, J., Vercruysse, S., Desloovere, K., Vandenberghe, W., Kerckhofs, E., and Nieuwboer, A. (2010). Freezing of gait in Parkinson’s disease: the impact of dual-tasking and turning. Mov. Disord. 25, 2563–2570. doi: 10.1002/mds.23327

PubMed Abstract | CrossRef Full Text | Google Scholar

Stanslaski, S., Afshar, P., Cong, P., Giftakis, J., Stypulkowski, P., Carlson, D., et al. (2012). Design and validation of a fully implantable, chronic, closed-loop neuromodulation device with concurrent sensing and stimulation. IEEE Trans. Neural Syst. Rehabil. Eng. 20, 410–421. doi: 10.1109/tnsre.2012.2183617

PubMed Abstract | CrossRef Full Text | Google Scholar

Stefani, A., Lozano, A. M., Peppe, A., Stanzione, P., Galati, S., Tropepi, D., et al. (2007). Bilateral deep brain stimulation of the pedunculopontine and subthalamic nuclei in severe Parkinson’s disease. Brain 130, 1596–1607. doi: 10.1093/brain/awl346

PubMed Abstract | CrossRef Full Text | Google Scholar

Stefani, A., Peppe, A., Galati, S., Bassi, M. S., D’Angelo, V., and Pierantozzi, M. (2013). The serendipity case of the pedunculopontine nucleus low-frequency brain stimulation: chasing a gait response, finding sleep and cognition improvement. Front. Neurol. 4:68. doi: 10.3389/fneur.2013.00068

PubMed Abstract | CrossRef Full Text | Google Scholar

Stegemõller, E. L., Buckley, T. A., Pitsikoulis, C., Barthelemy, E., Roemmich, R., and Hass, C. J. (2012). Postural instability and gait impairment during obstacle crossing in parkinson’s disease. Arch. Phys. Med. Rehabil. 93, 703–709. doi: 10.1016/j.apmr.2011.11.004

CrossRef Full Text | Google Scholar

Stoica, P., and Moses, R. (2004). Spectral Analysis of Signals. Prentice Hall: Upper Saddle Single Process.

Google Scholar

Sudhyadhom, A., Okun, M. S., Foote, K. D., Rahman, M., and Bova, F. J. (2012). A three-dimensional deformable brain atlas for DBS targeting. I. methodology for atlas creation and artifact reduction. Open Neuroimag. J. 6, 92–98. doi: 10.2174/1874440001206010092

PubMed Abstract | CrossRef Full Text | Google Scholar

Thevathasan, W., Debu, B., Aziz, T., Bloem, B. R., Blahak, C., Butson, C., et al. (2018). Pedunculopontine nucleus deep brain stimulation in Parkinson’s disease: a clinical review. Mov. Disord. 33, 10–20. doi: 10.1002/mds.27098

PubMed Abstract | CrossRef Full Text | Google Scholar

Thevathasan, W., Pogosyan, A., Hyam, J. A., Jenkinson, N., Foltynie, T., Limousin, P., et al. (2012). Alpha oscillations in the pedunculopontine nucleus correlate with gait performance in parkinsonism. Brain 135, 148–160. doi: 10.1093/brain/awr315

PubMed Abstract | CrossRef Full Text | Google Scholar

Welter, M.-L., Demain, A., Ewenczyk, C., Czernecki, V., Lau, B., El Helou, A., et al. (2015). PPNa-DBS for gait and balance disorders in Parkinson’s disease: a double-blind, randomised study. J. Neurol. 262, 1515–1525. doi: 10.1007/s00415-015-7744-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Zrinzo, L., Zrinzo, L. V., Tisch, S., Limousin, P. D., Yousry, T. A., Afshar, F., et al. (2008). Stereotactic localization of the human pedunculopontine nucleus: atlas-based coordinates and validation of a magnetic resonance imaging protocol for direct localization. Brain 131, 1588–1598. doi: 10.1093/brain/awn075

PubMed Abstract | CrossRef Full Text | Google Scholar

Zrinzo, L., Zrinzo, L. V., Massey, L. A., Thornton, J., Parkes, H. G., Revesz, T., et al. (2011). Targeting of the pedunculopontine nucleus by an MRI-guided approach: a cadaver study. J. Neural Transm. 118, 1487–1495. doi: 10.1007/s00702-011-0639-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: Parkinson’s disease (PD), brainstem, deep brain stimulation (DBS), gait, DBS, deep brain stimulation

Citation: Molina R, Hass CJ, Sowalsky K, Schmitt AC, Opri E, Roper JA, Martinez-Ramirez D, Hess CW, Foote KD, Okun MS and Gunduz A (2020) Neurophysiological Correlates of Gait in the Human Basal Ganglia and the PPN Region in Parkinson’s Disease. Front. Hum. Neurosci. 14:194. doi: 10.3389/fnhum.2020.00194

Received: 02 December 2019; Accepted: 29 April 2020;
Published: 04 June 2020.

Edited by:

Vladimir Litvak, University College London, United Kingdom

Reviewed by:

Chiung-Chu Chen, Linkou Chang Gung Memorial Hospital, Taiwan
Petra Fischer, University of Oxford, United Kingdom

Copyright © 2020 Molina, Hass, Sowalsky, Schmitt, Opri, Roper, Martinez-Ramirez, Hess, Foote, Okun and Gunduz. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Aysegul Gunduz, agunduz@ufl.edu

These authors share first authorship

These authors share senior authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.