Robert S. Eisinger
Morgan E. Urdaneta
Kelly D. Foote
Michael S. Okun
Aysegul Gunduz- 1Department of Neuroscience, University of Florida, Gainesville, FL, United States
- 2Department of Neurosurgery, Center for Movement Disorders and Neurorestoration, University of Florida, Gainesville, FL, United States
- 3Department of Neurology, Center for Movement Disorders and Neurorestoration, University of Florida, Gainesville, FL, United States
- 4Department of Biomedical Engineering, University of Florida, Gainesville, FL, United States
Although the basal ganglia have been implicated in a growing list of human behaviors, they include some of the least understood nuclei in the brain. For several decades studies have employed numerous methodologies to uncover evidence pointing to the basal ganglia as a hub of both motor and non-motor function. Recently, new electrophysiological characterization of the basal ganglia in humans has become possible through direct access to these deep structures as part of routine neurosurgery. Electrophysiological approaches for identifying non-motor function have the potential to unlock a deeper understanding of pathways that may inform clinical interventions and particularly neuromodulation. Various electrophysiological modalities can also be combined to reveal functional connections between the basal ganglia and traditional structures throughout the neocortex that have been linked to non-motor behavior. Several reviews have previously summarized evidence for non-motor function in the basal ganglia stemming from behavioral, clinical, computational, imaging, and non-primate animal studies; in this review, instead we turn to electrophysiological studies of non-human primates and humans. We begin by introducing common electrophysiological methodologies for basal ganglia investigation, and then we discuss studies across numerous non-motor domains–emotion, response inhibition, conflict, decision-making, error-detection and surprise, reward processing, language, and time processing. We discuss the limitations of current approaches and highlight the current state of the information.
Introduction
The putative role of the basal ganglia as a predominantly motor structure in the brain is being increasingly challenged. Several lines of evidence implicate these nuclei in a comprehensive and expanding list of non-motor areas–emotion, language, decision-making, learning, memory, and more (Saint-Cyr, 2003; Weintraub and Zaghloul, 2013). Nowadays, mesocorticolimbic structures such as the ventral striatum are generally accepted non-motor foci in the brain, particularly within the realm of reward systems. However, a potential non-motor role for other key basal ganglia structures and the nigrostriatal pathway have only recently emerged. A new body of evidence demonstrates both motor and non-motor activity in what was previously considered purely motor territory of the basal ganglia nuclei. While multiple prior reports have summarized such evidence from non-primate animal studies (Baunez and Lardeux, 2011; Weintraub and Zaghloul, 2013; Rossi et al., 2015), human behavioral or imaging studies (Weintraub and Zaghloul, 2013; Voon et al., 2017), and computational modeling or simulation studies (Wiecki and Frank, 2013; Mandali et al., 2016), here we turn our attention to non-human primate and human electrophysiology recordings.
The basal ganglia communicate with higher-order cortical regions through a direct, hyperdirect, and indirect pathway (Figure 1). The direct pathway releases globus pallidus internus (GPi) mediated inhibition of the thalamus while the hyperdirect cortical input to the subthalamic nucleus (STN), and the indirect pathway via the globus pallidus externus (GPe) and STN, suppress thalamic activity through GPi activation (Nambu et al., 2002; Saint-Cyr, 2003; Aron et al., 2016). With respect to the motor cortex, these competing pathways comprise the balancing act critical for normal movement. In addition to motor function however, the basal ganglia nuclei and associated pathways are hypothesized to support distinct but parallel associative and limbic loops as well, each encompassing their respective cortical substrate (Figure 1; Temel et al., 2005; Okun, 2013). While early studies established this so-called tripartite division of the basal ganglia nuclei (Figure 1), more recent work has challenged the notion of distinct anatomic boundaries between motor and non-motor regions. Nonetheless, it is through these additional pathways that measurable non-motor processes exert their effect on human behavior.
Figure 1. STN, subthalamic nucleus; GPe, globus pallidus externus; GPi, globus pallidus internus; LHb, lateral habenula. The canonincal basical ganglia model, with an associated direct, indirect, and hyperdirect pathway. Pathways between the midbrain and striatum (nigrostriatal) for dopaminergic innervation are depicted. The reward-relevant pathway between the pallidum and LHb is also included. The tripartite hypothesis is shown for the subthalamic nucleus as an example, in which the ventromedial aspect is for limbic function, the dorsolateral aspect for motor function, and the ventrolateral aspect for associative function. See Text for more information.
Motivated largely by animal work, researchers have investigated non-motor electrophysiology of the basal ganglia in non-human primates for more than four decades (Travis et al., 1968; Hollerman et al., 1998). Human recordings, on the other hand, are relatively few in number due mainly to methodological difficulties. Deep brain stimulation (DBS), an FDA approved treatment for several neurological and psychiatric disorders, offers unprecedented opportunity to study in vivo human function of the basal ganglia. Implanted electrodes that deliver current to the brain may also be used for signal acquisition. The surgical procedure thus enables access to electrophysiological recordings of the deep brain in an awake individual, opening doors for intraoperative research endeavors of basal ganglia anatomy and physiology. Some institutions also conduct studies with DBS patients postoperatively, when wires are externalized and time constraints are less prohibiting.
Today the majority of DBS cases worldwide are performed on Parkinson's disease (PD) patients for which the most common brain targets include the STN and GPi (Okun, 2013). Hence, recent human electrophysiological studies have primarily relied on a PD DBS model to investigate both motor and non-motor processing in the basal ganglia, usually within the STN. Identifying and characterizing the underlying physiologic processing of non-motor function is a highly important area of research. Beyond basic neuroscience investigation, this line of work has important clinical implications for a wide range of neurological and psychiatric disorders. For instance, it may elucidate the observed improvements or deteriorations in non-motor symptoms seen after DBS for a broad range of FDA-approved and experimental uses (Parsons et al., 2006), and offer insights for more selective neuromodulation therapies (Urdaneta et al., 2017).
In this review, we focus on electrophysiological evidence for non-motor function in human and non-human primate basal ganglia, primarily of the STN. We briefly introduce the commonly used electrophysiological technologies in the first section of this paper and then refer to each technology throughout the text. Separate non-motor domains are addressed in dedicated sections. For each domain, we discuss the current state of knowledge and point out gaps or areas that future research could address. We conclude by discussing the limitations of current approaches and by highlighting the wealth of information that these studies have provided.
Electrophysiological Methodologies
Electrophysiological studies of the basal ganglia primarily analyze brain signal from either a microelectrode or a macroelectrode array (Figure 2). In the case of DBS, the macroelectrode remains permanently implanted within the targeted structure, whereas temporary microelectrodes are inserted at some centers for functional targeting as a preliminary step prior to final macroelectrode placement. Microelectrode recordings generally represent the activity of one (i.e., single unit) or a few neurons (i.e., multi-unit) in the surrounding region (Figure 2A). Macroelectrode recordings on the other hand capture local field potentials (LFPs), which are thought to represent the weighted average of many neurons located within a micron-scale region (Figure 2C; Buzsáki et al., 2012). Electrocorticographic (ECoG) signals are similarly field potentials acquired via subdural electrode arrays. Moving more superficially, non-invasive technologies such as electroencephalography (EEG) (Figure 2D) and magnetoencephalography (MEG) also represent the weighted activity of larger populations of neurons. While these recording techniques offer high temporal precision, they can differ substantially in their spatial resolution. To overcome this limitation, a few recent studies have employed several of these technologies simultaneously (Litvak et al., 2011; Zavala et al., 2014).
Figure 2. LFP, local field potential; ERS, event related synchronization; ERD, event related desynchronization. Methodological techniques for electrophysiological investigation of basal ganglia depicted in (B). (A) Microelectrodes record single- or multi-unit activity and capture their action potentials as shown in (F). (C) Macroelectrodes are implanted permanently in DBS surgery in basal ganglia nuclei. (D) Macroelectrodes yield LFPs, which have similar spectral content as EEG (E,G). (H) Event-related changes in signals (ERPs) or oscillatory power (ERS or ERD) are of interest in studying response to stimuli.
The most common methodologies used to analyze or interpret the signals from these recording devices are depicted in Figures 2E–H. Action potentials from single unit data are frequently represented in raster plots centered at an event of interest (e.g., when a stimulus is presented to a participant) (Figure 2F), with each row corresponding to a single trial. In this approach, the difference in neuronal firing pattern before and after an event of interest can be illustrated. Significant changes in firing rate can indicate that the recorded neuron's activity relates to the event of interest. Given the alikeness of the spectral content of LFP and EEG (Figure 2D), analytic approaches applied to their waveforms are generally similar. The raw data is routinely decomposed into oscillatory frequencies (Figure 2G), which are commonly categorized into different frequency bands. Although there are minor differences in band definitions, commonly used cutoffs include: delta (1–4 Hz), theta (4–8 Hz), alpha (8–12 Hz), beta (12–30 Hz), and gamma (>30 Hz). For a given segment of signal, the power (i.e., energy) across many different frequencies can be visualized or quantified using a power spectral density curve (Figure 2E). Some studies also analyze signals from multiple sources (e.g., LFP and EEG) to understand coherence between distant structures in the brain. The power within a specific frequency range over time may also be computed and visualized on a time-axis (Figure 2H). If this axis is centered on an event of interest, an event-related desynchronization (ERD), or synchronization (ERS) may be seen, which corresponds to a decrease or increase in power, respectively. More simply, if the raw signal is plotted on a time axis around an event of interest, an event related potential (ERP) may be seen. A significant power offset may be referred to by the approximate time point at which it occurs (e.g., P300 or N300 for a positive or negative deflection at 300 ms, respectively) or to the relative peak within an ERP (e.g., P3 for the third positive deflection). We refer to these various analytic modalities throughout this review.
General Non-Motor Processing
One of the early human electrophysiological studies supporting a potential role for the basal ganglia in cognitive function is from Rektor and colleagues (Rektor et al., 2005). The researchers recorded ERPs of various auditory and visual stimuli from macroelectrodes distributed throughout the caudate, putamen, or pallidum in 9 epilepsy patients. Participants were asked to engage in different cognitive tasks, such as recognizing or counting target tones. In all recorded locations, a P3-like wave was observed. Critically, this observation held when participants were engaged in tasks without any movement. To the authors' surprise, unlike the tripartite hypothesis, anatomically focal areas showing non-motor responses within these structures were not identified. Although the precise behavioral significance of a P3-like wave is not fully known, these results hinted that the basal ganglia may have an electrophysiologically measurable contribution to non-motor processing. When the paradigm was modified to include an increased cognitive load, similar STN recordings of P3-like potentials showed increased amplitude and latency (Baláz et al., 2008; Rektor et al., 2009). These results suggested non-specific cognitive processing of information within the STN. Future studies would soon elucidate more specific non-motor basal ganglia functions, but this work provided clear evidence to catapult further investigations.
The overwhelming majority of non-motor electrophysiological studies of the basal ganglia utilize variants of common computer tasks typically used for behavioral studies. Such tasks attempt to isolate brain signals during specific motor and non-motor events. But studies of the so-called default mode network, when participants are at rest and disengaged from purposeful behavior, also provide important evidence for non-motor function in the basal ganglia. In one such study, STN LFP and cortical MEG signals were simultaneously acquired from 13 PD patients at rest a few days after DBS surgery (Litvak et al., 2011). The temporoparietal cortex and STN were coherent within an alpha frequency (7–13 Hz) range, and the frontal cortex and STN were coherent within a high beta frequency (15–35 Hz) range. In light of the cortical areas communicating with the STN, these distinct networks likely represent substrates of attentional and executive processes, respectively. Although these basal ganglia-cortical projections have been established with numerous methodologies, it remains to be determined whether these specific communication frequencies are completely physiological or influenced by disease pathology. Repeat studies are needed across a range of patient populations.
Emotion
Motivated by reports of PD DBS side effects such as depression, anxiety, emotional dysfunction, mania, aggression, and apathy (Kim et al., 2015), Kühn and colleagues were first to directly characterize the electrophysiological activity of the STN during emotional processing (Kühn et al., 2005a). Emotion content customarily consists of two dissociable components: valence and arousal. Valence refers to the level of behavioral activation either away from or toward a stimulus whereas arousal indicates the intensity of the emotional activation (Brücke et al., 2007). In this study, 10 DBS patients with PD viewed pleasant (positive valence), unpleasant (negative valence), and neutral visual stimuli matched for arousal chosen from the International Affective Picture System (IAPS) (Lang et al., 1999) while on anti-Parkinsonian medication. Compared to neutral stimuli, valenced stimuli resulted in larger alpha band (8–12 Hz) ERDs in the STN from 1 to 2 s after stimulus presentation. There were no significant differences between pleasant and unpleasant stimuli. In a follow up study with 9 PD DBS patients, the experiment was repeated for stimuli differing in both valence and arousal to show that individual alpha (7–13 Hz) ERDs are correlated with subjective valence ratings, but not arousal ratings (Brücke et al., 2007).
To separate STN emotional processing from the subsequent motor response that would occur in natural situations, a more recent study extended the above paradigm in several important ways (Buot et al., 2013). 16 PD patients viewed similarly valenced IAPS stimuli after STN DBS while both on and off anti-Parkinsonian medication. In addition to a passive-viewing condition, subjects responded with a button press to pleasant or unpleasant stimuli, thus representing a motor response to a valence-loaded stimulus. Larger ERPs were seen with emotional stimuli than neutral stimuli, regardless of their relevance for the motor portion of the task. That is, this effect was also observed during passive viewing. Interestingly, without medication, ERP amplitude was impacted by unpleasant stimuli but not by pleasant stimuli. This may suggest that encoding of pleasant stimuli partly requires an intact dopamine system (Huebl et al., 2014). Lastly, the authors examined the relationship between anatomical electrode location and ERP amplitude, showing a graded response that corroborates the tripartite notion of a distinct zone in the STN with a concentrated role in limbic processing (Alkemade et al., 2015).
These studies provided direct electrophysiological evidence for emotional processing within the STN. Next, Sieger and colleagues used single-neuron recordings in a study of 13 PD DBS patients (Sieger et al., 2015). In contrast to prior work, they discovered both valence and arousal-specific neurons in the STN. Surprisingly, the emotion-specific neurons identified in this study belonged to the dorsal sensorimotor region of the STN. This result thus challenges the tripartite notion of the STN and supports the possibility for meaningful measurements of non-motor function in what is traditionally considered motor territory of the basal ganglia (Rossi et al., 2015).
A limited number of studies have examined electrophysiological activity during auditory, as opposed to visual, emotional processing. A recent experiment presented auditory sentences to 15 PD patients a few days after their DBS procedures and analyzed STN LFP signals using ERP techniques (Péron et al., 2017). A spectral analysis was not included. As expected, sentences with positive (happy) or negative (angry) prosodies led to greater activity when compared to sentences with neutral prosody. In agreement with research suggesting that auditory decoding is largely a right-hemispheric process, this effect held true only for the right STN. Additionally, in a single unit study with 17 PD DBS patients, larger alpha (8–12 Hz) ERDs were seen in response to auditory stimuli with a positive or negative prosody, and in particular within the right ventromedial STN (Eitan et al., 2013).
Overall, the aforementioned studies signify the importance of the alpha frequency band for emotional processing in the STN. In fact, electrophysiological information within this band may have important clinical associations. A recent study by Huebl and colleagues investigated the correlation between alpha band ERD changes in response to valenced visual stimuli and depression scores as defined by the Beck Depression Inventory (BDI) in 12 PD DBS patients (Leentjens et al., 2000; Huebl et al., 2011). They defined an index of alpha ERD as the alpha ERD for pleasant stimuli minus the alpha ERD for unpleasant stimuli, and showed that it correlates with BDI 3 months following DBS surgery. In other words, reduced alpha ERDs may be used to predict patients more likely to experience depressive symptoms from DBS. Remarkably, this metric alone explained almost 50% of the variance of depressive symptoms. However, it should be mentioned that in this fairly small sample size, no patient developed severe depression after 3 months of chronic STN DBS. Nevertheless, such studies demonstrate the potential for clinical translation of electrophysiological data and provide further support for the meaningful role of the basal ganglia in non-motor processing.
Response Inhibition, Conflict, and Decision Making
Within the motor domain, the brain must orchestrate prudent action selection in the face of numerous candidate actions to select among. Desirable and meaningful action selection hinges on intact response inhibition, a component process that the STN is perhaps best known for (Zavala et al., 2015). In this role, the STN directly and indirectly dictates whether a response to some stimulus is executed (Frank, 2006). To assess this decision-making process, studies typically employ behavioral tasks that present low-conflict and high-conflict trials in which decisions are relatively easy (i.e., requiring less inhibition) or hard (i.e., requiring more inhibition until a decision is made), respectively. The fundamental processes captured by such tasks—to execute appropriate decision-making—can be applied to both motor and non-motor systems (Aron et al., 2016). For instance, non-motor implications for an impaired generalized response inhibition may explain neuropsychiatric disorders such as impulsivity and may partly account for non-motor changes that occur after DBS (Weintraub and Zaghloul, 2013; Voon et al., 2017).
Together with the pre-supplementary motor area (pre-SMA) and prefrontal cortex (PFC), the STN plays a major role in behavioral control by acting as the breaking mechanism for the cortico-striatal driver network (Figure 1; Inase et al., 1999; Frank, 2006; Herz et al., 2014). This widely used analogy surpasses basic action control and can be generalized to include non-motor function as well. It has been previously established that medial PFC (mPFC) EEG theta power modulates with conflict and error (Cavanagh et al., 2009, 2010; Cohen and Cavanagh, 2011), and recent studies have extended these observations to LFP measures in the STN of PD DBS patients (Cavanagh et al., 2011; Alegre et al., 2013; Zavala et al., 2014). In one study, STN LFP signals were acquired intraoperatively during a low- and high-conflict image selection task (Cavanagh et al., 2011). During image selection tasks, subjects are conditioned to select one of two images on each trial to maximize probability of correct selection. Trials with a single image leading to a substantially larger probability of being the correct selection are deemed low-conflict trials, and those with two images of more similar probability are considered high-conflict trials. The STN showed heightened low-frequency theta (2.5–4 Hz) power following high-conflict cues, which has been replicated numerous times in studies using highly-conflicting stimuli (Brittain et al., 2012; Zavala et al., 2013, 2014). These findings are especially enlightening when considering the previously established connection between the mPFC and STN (Nambu et al., 2002), and the positive correlation between mPFC EEG theta power and slow response time during moments of high-conflict (Cavanagh et al., 2011).
A more precise understanding of the mPFC-STN link is afforded with invasive studies that record from both brain regions simultaneously. Zavala and colleagues examined STN LFP and mPFC EEG together in 13 PD patients with bilateral DBS implants (Zavala et al., 2014). Participants viewed moving dots on a computer screen and decided whether the dots were moving coherently toward the left or right. During high-conflict trials in which a minority subset of dots moved opposite to all other dots, the STN showed increased delta/theta activity (2–8 Hz). Notably, during high-conflict, the STN and mPFC were coherent within this delta/theta frequency band. Granger analysis showed a causal influence of the mPFC on the STN (Granger, 1969). These electrophysiological markers of inhibition vanished when participants provided their response by pressing the appropriate key on a keyboard. Taken together with single unit experiments, these studies provide electrophysiological biomarkers of the basal ganglia braking system involving the STN and mPFC during response inhibition (Frank, 2006; Zaghloul et al., 2012; Bastin et al., 2014). These results also align well with studies concluding a theta band communication mechanism between the mPFC and other cortical areas during conflict, such as the anterior cingulate cortex (Schroeder et al., 2002; Wang et al., 2005).
One of the most complex forms of high-conflict human decision-making is morality judgment, an evolutionarily recent ability linked primarily to social cognition. The concepts of morality and conflict are closely related, and since the deep brain participates in conflict evaluation through cortico-basal-thalamo-cortical circuits (Temel et al., 2005), it follows that morality judgment may rely on the basal ganglia. In a study of 16 PD DBS patients, LFP signals were recorded from the STN during morality evaluation using conflicting, non-conflicting, or neutral condition sentences (Fumagalli et al., 2011). The sentence content in this task exceeded that of basic emotional valence or prosody assessments used in studying emotional processing (see above). For instance, one sentence used in the task was “Some crimes must be punished by the death sentence.” Patients responded by pressing a button indicating if they agreed or disagreed with the sentence presented on each trial. These movements led to a decrease in beta (14–30 Hz) power, consistent with many motor studies of the STN (Marceglia et al., 2014). Interestingly, low-frequency (5–13 Hz) power increased during decision-making, more so during the conflict condition. Morality judgment certainly contains an emotional component (Greene et al., 2004; Fumagalli et al., 2010), but these results do not mimic those found in basal ganglia emotional evaluation (Kühn et al., 2005a; Brücke et al., 2007) because the conflicting and non-conflicting conditions in this study were balanced for emotional content. Rather, these results uniquely contribute to the body of evidence pointing to the basal ganglia's role in conflict processing through low-frequency oscillations.
Conflict and decision-making may also be assessed using the Stroop task. On each trial in this task, subjects view a colored word and indicate whether the word matches the color of the word (e.g., “red” in red font) or not (e.g., “blue” in red font). In one Stroop study, the STN beta band (15–35 Hz) modulated depending on correct or incorrect responding in 12 PD DBS participants (Brittain et al., 2012). Specifically, for high-conflict trials with word-color mismatch, beta power significantly increased prior to response for correct trials. In contrast, for incorrect trials, beta power only increased after responses occurred. Whereas the aforementioned studies implicate lower frequency signals in mediating a braking signal within the STN, these results point to a potential role for beta oscillations as well. While the beta frequency band is often associated with movement, cortical and basal ganglia beta changes have also been previously seen in the absence of movement during various behavioral tasks across different patient populations (Kühn et al., 2004; Swann et al., 2009; Ray et al., 2012; Bastin et al., 2014). Of note, increased theta during high-conflict trials was also seen in this study.
In addition to theta, alpha, and beta modulations, prior work furthermore suggests an important role for a gamma frequency (35–75 Hz) band during response inhibition. During a stop signal task in 10 PD DBS patients, Alegre and colleagues found that STN gamma decreased with successful inhibition (Alegre et al., 2013). Most interestingly, this effect was not seen in participants with clinically diagnosed impulse control disorder (ICD), a condition linked to impulsive responding from diminished inhibition (Rossi et al., 2015). While there were only 4 patients with ICDs in this cohort, and despite the complex relationship between response inhibition and multiple different frequency bands, these results also illustrate the potential for a clinical-translational impact of electrophysiological markers in the basal ganglia.
More recently, researchers recorded both intraoperative LFP and single unit spiking activity simultaneously from the STN of 15 PD patients while they performed a flanker task (Zavala et al., 2017). The flanker task asks subjects to indicate the direction of a central arrow which is flanked on either side by multiple other arrows. On high-conflict trials, the central arrow points opposite to all other arrows. Signals associated with stimulus processing were isolated from those related to the motor joystick response in this task. Theta (2–8 Hz) power significantly increased following high-conflict trials. Interestingly, individual neurons with task-related increased firing rates exhibited spike locking to beta (15–30 Hz) activity during high-conflict trials. These results may suggest that not only does beta power decrease to offer cells a chance to increase firing rates for subsequent movement (Courtemanche et al., 2003; Kühn et al., 2005b), but that beta-band spike locking may represent a purposeful processing delay for high-conflict evidence accumulation.
We point out that these numerous decision-making studies of the basal ganglia include a motor phase in which participants respond to a presented stimulus. For this reason, important limitations arise. For instance, to what degree these phenomena occur in the complete absence of movement remains understudied. However, studies take great measures to differentiate motor and non-motor components of each task and these signals are then analyzed separately. Despite this limitation, it is likely that response inhibition processing is shared among motor and non-motor processes alike (Bar-Gad et al., 2003; Weintraub and Zaghloul, 2013; Calabresi et al., 2014). Furthermore, it is important to note that investigations of response inhibition and high-conflict decision-making presented here are typically limited to studies of immediate actions and depend on the temporal sequence of the paradigm employed. For instance, a study of single units in humans showed that nucleus accumbens activity predicts future financial decisions that occur on average just 2 s later (Patel et al., 2012), however other studies use paradigms in which total trial duration may be <2 s (Rossi et al., 2017). From study to study, results cannot generally be applied to decisions occurring at different time scales (Zavala et al., 2015). Future studies that engage associative or limbic function without any anticipated near-future action could address these shortcomings.
Error-Detection and Surprise
Acting as a guide for decision-making, error-detection is integral for successful goal-directed or Pavlovian-based learning. Error-detection refers to a surprising difference between expected and observed outcomes. In addition to several studies exploring error-detection at higher cortical areas (Schultz and Dickinson, 2000; Ridderinkhof et al., 2004; Oya et al., 2005; Asaad and Eskandar, 2011), a basal ganglia role for these processes is evident from many non-electrophysiological studies and several electrophysiological studies (García-García et al., 2017). Primate studies demonstrate that dopamine and striatum neurons code errors in predicted rewards (Schultz and Dickinson, 2000; Asaad and Eskandar, 2011). A DBS intraoperative study with OCD patients found STN single units with activity that modulate during error-monitoring of a stop-signal task (Bastin et al., 2014). Using a simple flanker task, a study with 9 dystonia patients found electrophysiological signatures of erroneous performance within the GPi (Herrojo Ruiz et al., 2014). Incorrect trials were associated with significantly larger GPi theta frequency (4–8 Hz) deviations, which were also seen at the posterior medial frontal cortex (pMFC) as measured by EEG. Also using a flanker task, Siegert and colleagues found positive STN LFP deflections between 260 and 450 ms after incorrect responding (Siegert et al., 2014). In a separate behavioral task of low and high conflict trials, STN low frequency oscillations (2.5–5 Hz) exhibited more phase consistency during the well-known phenomenon of post-error slowing, when reaction times increase following errors (Cavanagh et al., 2014).
Theta activity is certainly not limited to the basal ganglia, and neither is error processing. Zavala and colleagues focused their attention to the mPFC, a region known to be involved in error monitoring, and simultaneously examined brain signals from the STN during a flanker task (Zavala et al., 2016). Temporally aligned EEG signals from the mPFC and LFP signals from STN revealed that high-conflict trials led to a theta-delta band (2–8 Hz) coherence between the two structures, consistent with prior studies using high-conflict tasks (Zavala et al., 2014). Interestingly in this study, erroneous trials did not lead to theta power changes, but rather, higher phase coherence. Given the differing results seen from study to study, further work that specifically compares electrophysiological activity across trials with accurate and inaccurate responses are needed. Nonetheless, a theta frequency band generally appears to be involved in error detection.
While the phenomenon of surprise may be conceptually similar to error-detection, it is not necessarily associated with an expected event. Surprising stimuli or events may impact any ongoing cognitive and motor processing. At a neural level, the impact of surprise on the motor system is best explained through the fronto-basal ganglia network (Wessel et al., 2016). Since perturbations resulting from surprise are seen in both the motor domain (Wessel and Aron, 2013) and cognitive domain (such as diminished working memory encoding; Chiu and Egner, 2015), a recent study recorded basal ganglia LFPs during surprising events (Wessel et al., 2016). Namely, in response to unexpected tones played just before the retrieval phase of a verbal working memory task, the researchers found increased activity of the STN in PD patients across several frequency bands. However, given the nature of the task used in this study, it is difficult to determine whether the findings represent neural markers for a motor-specific, cognitive-specific, or global response to surprise-induced recruitment of the STN. Further studies should replicate these results across an array of non-motor processes.
Reward Processing
Reward processing encompasses the cognitive resources necessary for valuations of stimulus valence (attractiveness or aversiveness) in everyday life, including expectation, selection, and outcome (Rangel et al., 2008). From an electrophysiology standpoint, reward processing is one of the earliest studied non-motor functions of the basal ganglia, particularly within primates. Over four decades ago, researchers first noted neurons with activity specific to consummatory or reward-receipt stages of reward processing in primate striatum (Travis et al., 1968; Soltysik, 1975). This paved the way for one of the most comprehensive early studies of basal ganglia reward-processing, in which researchers examined single unit recordings in two macaques as they engaged in visuomotor tasks leading to liquid reward (Hikosaka et al., 1989). Caudate neurons responded to cue expectation, cue delay, expectation of a target as indicated by a cue, expectation of reward regardless of the task needed to obtain reward, motor actions necessary to receive reward, including motor preparation, as well as to reward itself. These findings laid the groundwork for subsequent studies further investigating specific components of this reward-processing spectrum. For example, similar primate studies showed striatal single unit activity associated with the expectation of a reward and reward receipt (Bowman et al., 1996; Hollerman et al., 1998; Lauwereyns et al., 2002; Cromwell and Schultz, 2003; Darbaky et al., 2005; Espinosa-Parrilla et al., 2015), regardless of whether reward was obtained via movement of the hand or by withholding movement, such as by maintaining fixation on a target (Apicella et al., 1991, 1992; Matsumura et al., 1992; Schultz et al., 1992). Notably, neurons in basal ganglia regions traditionally considered to be purely motor nuclei, including the dorsal STN, have been shown to modulate during anticipatory reward stages (Darbaky et al., 2005; Espinosa-Parrilla et al., 2013). Certain striatal neurons may also be conditioned to respond exclusively to cues that are not rewarded (Kawagoe et al., 1998). Neurons in primate anterior striatum differentially respond to rewards based on their reward magnitudes (Hollerman et al., 1998; Hassani et al., 2001; Cromwell and Schultz, 2003). Overall, reward-related neurons in the primate basal ganglia respond to an impressive variety of reward processing stages and contexts.
Numerous modifications to reward tasks such as the delayed response or Go/No-Go behavioral paradigms have been employed to rigorously test reward-processing in primates and control for confounding factors. For instance, one study showed that although striatal neurons code for cues that signify future rewards following consistent temporal delays, this effect wanes for cues that instead lead to reward receipt with a random delay of time (Shidara et al., 1998). Aside from visual cues, one study demonstrated that tonically active striatal neurons in two macaques can be conditioned to respond to an auditory cue associated with a liquid reward (Aosaki et al., 1994). These neurons were also capable of responding to multiple different rewards. To further demonstrate that neurons responding to reward delivery do not specifically depend on movement, Darbaky et al. varied the reward timing and showed that 13 of 15 reward-responsive neurons accordingly displaced their response activity (Darbaky et al., 2005). A more recent primate study of reward processing characterized STN neurons during reward receipt both independent of, and dependent on, motivational-based choice selection of juice or water reward (Espinosa-Parrilla et al., 2015). STN neuron activity reflected whether or not the animals had received their preferred reward.
In relationship to other brain regions, to what extent does the basal ganglia encode reward-related information? Since the orbitofrontal cortex (OFC) is networked to the basal ganglia for motivational coding (Selemon and Goldman-Rakic, 1988; Haber et al., 1990; Eblen and Graybiel, 1995; Li et al., 2016), Schultz et al. used several behavioral paradigms during monkey single unit recordings to compare striatal and OFC neurons during reward processing (Schultz et al., 2000). They found that while OFC neurons respond to rewarding cues, reward expectation just prior to reward receipt, and reward receipt, striatal neurons have more extensive action-related reward responses; that is, striatal neurons additionally respond during reward-related motor preparation and action. In both regions, neurons discriminated between specific types of liquid or food rewards. Neurons in primate dorsolateral prefrontal cortex also modulate with reward expectancy (Watanabe, 1996). In addition to the ventral striatum and pallidum, which encode expected reward in primates (Tachibana and Hikosaka, 2012), another region strongly implicated in limbic reward processing is the lateral habenula (LHb) with afferent input from the GPi (Matsumoto and Hikosaka, 2007; Hong and Hikosaka, 2013). It is not surprising then, that the GPi in monkeys shows activity modulated by reward expectation and no-reward expectation (Hong and Hikosaka, 2008), particularly throughout the dorsal and ventral border. Furthermore, these neurons have a unique firing pattern with respect to spike rate and spike duration that differs from motor GPi units. Reward prediction neurons can also be found in primate globus pallidus externus (GPe) (Arkadir et al., 2004). Finally, human electrophysiological studies have also advanced the previously well-recognized role of the nucleus accumbens as a reward center in the brain. Oscillatory activity recorded directly from the nucleus accumbens in 5 patients undergoing DBS for major depression showed that bursts of gamma activity (40–80 Hz) tended to occur during peaks of coexisting alpha activity (8–12 Hz) (Cohen et al., 2009). Moreover, rewards given during a behavioral task adjusted the timing of this relationship. Further studies are needed to confirm if this cross-frequency coupling represents the electrophysiologic signature of the hypothesized mechanism of the nucleus accumbens as the link between the limbic system and the basal ganglia (Day and Carelli, 2007).
It is well-known that that dopamine neurons encode many aspects of reward processing (see Schultz, 1998 for a review) and that dopamine status impacts reward processing ability. Similar to striatal neurons, primate dopamine neurons respond to reward expectation stimuli, reward receipt, and reward prediction error (Mirenowicz and Schultz, 1996; Schultz and Dickinson, 2000), separate from movements (Romo and Schultz, 1990). Given a stimulus indicating a probability of reward delivery, uncertainty (i.e., low probability) corresponds to increased dopamine and the phasic activity of dopamine corresponds to the reward prediction error (Fiorillo et al., 2003). ICDs are also closely related to impaired reward processing in PD patients, and ICDs can result from high levels of dopamine intake in PD, or occasionally after DBS (Rossi et al., 2015). In one study, PD patients with pathological gambling who used a risky strategy during a gambling task showed that while all PD patients exhibited STN low frequency power (2–12 Hz) increases during economics decisions, these increases were seen more during high-risk than low-risk decisions (Rosa et al., 2013). A recent study of one patient with OCD demonstrated increases in delta LFP power in the nucleus accumbens during reward anticipation (Wu et al., 2017). In the ON-dopamine state, but not in the OFF-dopamine state, 9 PD DBS patients with ICDs and without dopamine-induced dyskinesias showed elevated STN theta (4–7.5 Hz) activity coherent to EEG theta in the premotor and frontal cortex (Rodriguez-Oroz et al., 2010). In contrast, PD patients with dyskinesias showed coherent alpha frequency (7.5–10 Hz) activity between the STN and primary and supplementary motor cortices. It should be noted that in this relatively small sample, patients retrospectively self-completed ICD assessments and had few neuropsychiatric control variables. Accurate diagnosis of ICDs remains problematic, especially since individuals with ICDs tend to underreport their impulsive natures (Papay et al., 2011), and impulsivities may present in many different manners. Nonetheless, this work reaffirms that basal ganglia LFP signals could have clinically meaningful non-motor associations, especially since reward correlates, as reviewed here, can be measured at multiple nodes of the basal ganglia reward system.
The majority of the above studies considered action and inaction conditions for reward receipt, but outcomes were generally either neutrally valenced (i.e., not rewarded) or positively valenced (e.g., liquid reward). Overall, dopamine and pallidal neurons in primates preferentially respond to appetitive stimuli as opposed to aversive stimuli (Mirenowicz and Schultz, 1996; Joshua et al., 2009). In humans, negative valence (i.e., threat of loss or punishment) and single unit responses to reward were first investigated in a recent study of the STN and GPi during a modified Go/No-Go task (Rossi et al., 2017). While both structures showed neurons responsive to reward, this large study of 53 PD DBS patients moreover demonstrated that regardless of the valence-related stimulus—whether being a reward receipt or successful avoidance of loss—the STN modulated more than the GPi. Most of the neurons identified, which were distributed throughout both structures in a non-tripartite fashion, were exclusive for reward anticipation, reward receipt, threat of loss, or successful avoidance of loss. Another recent study in 8 patients—four with Tourette syndrome, one with generalized dystonia, two with cervical dystonia, and one with dystonic tremor—supports the role of the GPi in reward processing (Münte et al., 2017). Specifically, LFP oscillatory changes were seen in the high beta range (20–30 Hz) at approximately 500 ms after rewards, but not losses. Future studies should extend these findings to the STN for comparison, and examine LFP changes during reward expectation and during non-movement conditions.
Given that reward-related cognitive processing ultimately inform learning processes for improved decision-making, numerous studies have integrated learning into reward-processing tasks (Romo and Schultz, 1990; Ljungberg et al., 1992; Aosaki et al., 1994; Tremblay et al., 1998; Tremblay and Schultz, 2000). In these paradigms, basal ganglia neurons are recorded during conditioning phases in which primates learn to pair new cues and subsequent movements with a reward. During this learning phase, reward-expecting striatal neurons activate regardless of the presence or absence of actual reward receipt, but they rapidly begin to activate only for rewarded movements (Tremblay et al., 1998). Similar to reward anticipation, activity of certain neurons also either decrease or increase specifically during the learning phase. Neurons throughout the GPi—not only within specific anatomic subregions—fire differentially when primates learn new visuomotor associations and when they exploit that new information (Sheth et al., 2011; Gale et al., 2014). During exploitation, GPi neurons exhibit higher firing rates to suppress competing actions (see Figure 1). In dopamine neurons, depression typically occurs at the expected time of reward receipt when predictable rewards unexpectedly do not occur (Ljungberg et al., 1991; Schultz et al., 1993). It has been shown in multiple studies that dopamine neurons respond to reward receipt primarily in the context of unpredictability, likely reflecting a mechanism of learning, whereas dopamine neuron activations occur less after conditioning has been established (Romo and Schultz, 1990; Ljungberg et al., 1992; Mirenowicz and Schultz, 1994).
Learning processes likely utilize the full extent of the basal ganglia functional substructures. For instance, the ventral striatum is linked with incentive motivational behaviors for informative goal-directed behavior executed in the dorsal striatum–coordinated activity of these regions enhance learning performance (Katnani et al., 2016). Beyond the deep brain, the basal ganglia is particularly well-suited to be involved in learning through its interconnections with numerous higher cortical areas. However, the exact manner in which the basal ganglia interacts with these higher cortical areas, and in what temporal order, remains under investigation. In one study, reward-related firing of anterior cingulate neurons in humans predicted motor responses before they occurred (Williams et al., 2004). When monkeys learn to pair a saccade direction with reward-receipt, a study of 432 prefrontal cortex (PFC) and 279 caudate nucleus neurons showed that caudate nucleus activity coded for reward-associated saccade direction sooner than the PFC (Pasupathy and Miller, 2005). A similar monkey sensorimotor learning task involved reaching as opposed to saccades, and demonstrated that while dorsal premotor cortex and basal ganglia neurons modulate with learning novel cue-reward pairings, their timing is not different (Brasted and Wise, 2004). Either the basal ganglia and cortical learning areas are involved in separate learning processes altogether, or they represent a shared learning network with an ordinal layout that is not yet fully resolved.
Language
From a historical perspective, the neural bases of language function have been mostly linked to the neocortex (Broca, 1861; Wernicke, 1874). It was not until the twentieth century when evidence of language dysfunction was reported in patients with ischemic and hemorrhagic basal ganglia lesions (Hier et al., 1977; Damasio et al., 1982; Wallesch, 1985). Animal studies further corroborated the relationship between the basal ganglia and language cognition for syntax, learned behavior, and sequencing (Aldridge et al., 1993; Graybiel, 1995; Berns and Sejnowski, 1998), but these inferences could not be directly extrapolated to humans (Lieberman, 2009).
Electrophysiological investigations of basal ganglia language function began in the 1980s. For instance, morphosemantic (meaning) mismatches elicit negative-going N400 waves in the sensorimotor cortex (Kutas and Hillyard, 1980; Holcomb and Neville, 1990), and syntactic inconsistencies consistently elicit a P600 wave (Osterhout and Holcomb, 1992) preceded by early left anterior negativity (ELAN) ERPs in the parietal and frontal cortical regions, respectively (Hahne and Friederici, 2001). By studying patients with basal ganglia lesions and neurodegenerative diseases like PD during language tasks, and by comparing their EEG correlates with healthy patients, scientists had an opportunity to potentially infer linguistic roles of the basal ganglia. In a series of experiments, patients with basal ganglia lesions and PD completed syntactic (ELAN/P600) and semantic (N400) violation tasks. In comparison to healthy controls, these patients elicited delayed N400 ERPs (Kotz et al., 2003; Angwin et al., 2017), as well as modulations of the P600 wave (Hahne and Friederici, 1999; Friederici et al., 2003; Kotz et al., 2003). However, the extent to which these phenomena result from basal ganglia substrate remains unclear. In a follow-up study combining EEG and DBS lead recordings, the STN and the GPi, unlike the ventral intermediate nucleus of the thalamus, did not show characteristic ERPs during analogous syntactic and semantic violations (Wahl et al., 2008). Nonetheless, the basal ganglia is likely involved in aspects of language processing, a possibility widely supported by extensive PD and PD-DBS longitudinal language assessments (Parsons et al., 2006; Wojtecki et al., 2006; Okun et al., 2009; Mikos et al., 2011; Yamanaka et al., 2012) and intraoperative electrophysiological data from single unit and DBS LFP recordings.
Among the initial direct electrophysiological evidence of STN modulation during language tasks came from the work of Watson and Montgomery, who performed intraoperative single unit recordings of PD DBS patients during a simple reading task. High levels of spiking in the STN were generated just before voice onset that correlated to the pronunciation of each syllable (Watson and Montgomery, 2006). The verbal fluency task is commonly used to assess both phonemic and semantic eloquence. This task has two distinct phases with specific timings. The phonemic phase asks individuals to generate as many words that begin with a given letter excluding proper nouns or variants of a previously mentioned word. On the other hand, the semantic phase asks participants to produce as many words as possible that correspond to a particular semantic classification (e.g., colors or countries). Using intraoperative STN LFP recordings during a semantic and phonemic verbal fluency task, Anzak and colleagues found significant increases in gamma (30–95 Hz) power as well as decreases in beta (13–30 Hz) power. Interestingly left-hemispheric gamma power correlated with correct responses when the patient transitioned or switched from one semantic classification to another in the semantic phase or from one letter to the next in the phonemic phase. These results suggest that the STN plays a role in switching during verbal fluency (Anzak et al., 2011). Most recently, Wojtecki and colleagues reported significant power increases in the alpha-theta range (6–12 Hz) of STN LFP activity during a verbal generation task. It was also observed that electrodes located closer to the ventromedial STN had the greatest power responses to the verbal generation task. Likewise, coherence analysis between frontotemporal surface EEG electrodes and STN LFPs showed significant power increases at 6–7 Hz (Wojtecki et al., 2017).
In order to properly distinguish the motor and silent internal components of speech production, one study combined an analogous speech task with a finger tapping motor task. Intraoperative STN LFP signals showed that tasks involving both language and motor activity had high beta (13–30 Hz) power modulation. Conversely, combination of overt and imaginary speech was associated with low beta levels, demonstrating modulation independency between speech and motor function (Hebb et al., 2012). Similarly, EEG and ECoG experiments have reported cortical beta oscillations associated with word production (Crone et al., 2001; Edwards et al., 2009). Furthermore, using surface EEG and STN-LFP, Hohlefeld et al. (2017) found that lexical accuracy correlates with cortico-subthalamic coherence in the beta (14–35 Hz) range (Hohlefeld et al., 2017). These results indicate existence of non-motor synchronization of the cortex and basal ganglia in language production. Future studies are still needed to assess whether electrophysiological markers of language in the basal ganglia provide clinically meaningful associations, for instance, to language perturbations commonly seen after DBS.
Time Processing
Several lines of evidence suggest that the basal ganglia play an important role in beat-based timing via a thalamo-cortical-striatal circuitry (Meck and Benson, 2002; Teki et al., 2011). For instance, PD and Huntington's disease patients have low performance in temporal reproduction tasks (Malapani et al., 1998; Paulsen et al., 2004),(Allman and Meck, 2011). Similar internal clock deficiencies are seen after induced damage of dopaminergic pathways (Buhusi and Meck, 2002; Chang et al., 2007). It is hypothesized that substantia nigra dopaminergic output modulates oscillatory activities within striatal medium spiny neurons (Buhusi and Meck, 2005). These dorsal striatal neurons may act as coincidence detectors of cortical oscillations to encode beat-based timing. In PD DBS postoperative studies, multiple studies, including a double-blind experiment, have shown significant improvements in duration estimates after STN DBS (Koch et al., 2004; Wojtecki et al., 2011).
Direct neuroelectrophysiological evidence of the role of the basal ganglia in time processing comes from the experiments of Bartolo and colleagues in non-human primates. In these experiments, monkeys were trained to perform a synchronization continuation task (SCT). This task consists of tapping a button three times in synchrony with a guidance isochronous metronome, followed by a continuation phase in which the monkey has to tap the buttons at the same time intervals but with no metronome or external cues. Putaminal single unit and LFP recordings showed beta (15–30 Hz) coherent activity among distant electrodes and increased beta modulation when the animal had to internally temporalize its rhythmic activity (post-synchronization phase). Likewise, gamma (30–70 Hz) frequency had a slightly increased burst modulation during the metronome guided (synchronization) period of the task (Bartolo et al., 2014).
Following these findings in putaminal LFP activity, the hypothesis that serial rhythmic striatal beta modulation might be involved in non-periodic movements was tested (Teki et al., 2011). In these subsequent experiments, striatal oscillatory activity was evaluated during a SCT task in combination with a serial reaction time task (RTT), which differed from the STC by having irregular tapping sequences. Transient beta modulation was observed throughout both regular (STC) and irregular (RTT) tasks. Remarkably, beta power considerably increased during the continuation phase of the SCT, as well as during the initial phase of the RTT task. These results suggest involvement of the basal ganglia in giving the initiating prompt of behaviors involving sequential timing (Bartolo and Merchant, 2015).
Limitations
Important limitations across these electrophysiology studies must be noted. With few exceptions, this research in humans has relied on DBS patient populations to explore basal ganglia function. As a result, in many cases extrapolation to normal healthy populations is not easily justified (Marceglia et al., 2009). These studies primarily recruit from diseased populations undergoing surgical treatment. During awake- neurosurgery signal acquisitions, patients may be anxious or uncomfortable (Patel et al., 2013). With repeat studies using different diseased populations, basal ganglia LFP studies may become more generalizable. Currently, control populations are critically missing. In addition, the majority of these studies collect electrophysiological signals from a single anatomical region in the brain. For instance, a study with human PD patients undergoing STN DBS may collect electrophysiological data only from the dorsolateral STN. This presents as a main setback for exploring non-motor function, especially given the notion of a tripartite basal ganglia as discussed above. At the same time, accurately quantifying specific DBS lead locations after implantation remains difficult, particularly normalization processes for purposes of meaningful comparison across different patients.
It is also important to consider that the exact nature of LFPs remain unclear and that they can arise from many sources across many sites, even from locations where units are not firing (Herreras, 2016). For instance, LFP dynamics can be heavily influenced from afferent activity in the recorded area (Herreras, 2016). In addition, specific neuronal signal acquisition and interpretation are heavily dependent on recording strategies and analytic approaches. Each electrophysiological recording modality also has its own set of technical setbacks. For example, EEG recordings of patients with DBS implants are impacted by burr holes (Bénar and Gotman, 2002; Oostenveld and Oostendorp, 2002), and MEGs suffer from high-amplitude artifacts from percutaneous extension wires (Litvak et al., 2011). These methodological limitations will be increasingly overcome with advanced surgical techniques, electrophysiology equipment, and analysis tools.
Conclusion
We have reviewed an extensive literature on non-motor electrophysiology of human and non-human primate basal ganglia, primarily from single-unit and LFP studies. Beyond neuroscience discovery, such neural correlates can be used to implement therapies such as brain computer interfaces. Microelectrode recordings of single-units have revealed fundamental basic neurophysiology of subcortical structures, but continued LFP characterization of non-motor processing remains critical for clinical translation. For instance, macroelectrodes implanted in the basal ganglia for movement and neuropsychiatric disorders reliably record LFPs—not single-units—and their electrophysiological capabilities are more resistant to the foreign body response (Vetter et al., 2004; Koivuniemi et al., 2011; Urdaneta et al., 2017; Wong et al., 2018).
A summary of findings from human non-motor basal ganglia LFP studies is provided in Figure 3. While most human basal ganglia LFP studies to date have investigated response inhibition and conflict, more work is needed in other areas of non-motor function, particularly those with clinically relevant underlying deficits across different disease pathologies like reward processing dysfunction in PD or OCD. Furthermore, informative and underutilized methodological approaches, such as simultaneous invasive and non-invasive recordings or spike-field coherence, should be further applied to other non-motor domains.
Figure 3. STN, subthalamic nucleus; LFP, local field potential; MEG, magnetoencephalography; EEG, electroencephalography; GPi, globus pallidus internus; NAc, nucleus accumbens; SCT, synchronization continuation task; RTT, reaction time task. * tempoparietal EEG, ** frontal EEG, *** causal influence on mPFC, **** frontal-central-parietal EEG. Review of human non-motor electrophysiology studies of the basal ganglia. Approximate locations for commonly identified oscillatory frequency bands are included.
While limited in number and variable in scope, the LFP studies reviewed here point to multiple frequencies of interest outside of the beta range, which has become a widely explored band for motor function. In general, as we have seen throughout this review, lower frequency activity may be most consistently attributed to non-motor processing (Litvak et al., 2011). The exceptions to this rule of thumb are not rare in number, however, and require careful consideration in future work. Beta modulation can also be seen in the absence of movement, and higher frequencies, including those in the gamma range, appear related to several non-motor domains. It would be premature to conclude that the bulk of non-motor processing in the basal ganglia occurs in frequencies below the beta range, although multiple studies now support this hypothesis. Nonetheless, there now exists unequivocal electrophysiological evidence that the basal ganglia are involved in non-motor function. The treatment of several psychiatric and movement disorders with DBS in particular has enabled the investigation of deep brain structures and their relationship to various behaviors. Although electrophysiological correlates of movement are well established, the precise role of the basal ganglia in non-motor function requires many more studies. Future work should focus on associations between electrophysiological markers and clinical outcomes, which has proven to be a fruitful line of study for motor symptoms in conditions such as PD. Moving forward, these translational studies have great potential to uncover actionable pathological signals that can be targeted for clinical care through neuromodulation.
Author Contributions
RE conceptualized the paper. RE wrote the first draft with the exception of sections 8 and 9. MU wrote the first draft of sections 8 and 9. MU developed the first drafts of the figures. MU and RE finalized figures. RE, MU, KF, MO, and AG provided critical input and edits.
Funding
This work is supported by the NIH/NCATS Clinical and Translational Science Awards to the University of Florida UL1TR001427, KL2TR001429, and TL1TR001428.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors wish to thank Daniel Martinez-Ramirez, Adolfo Ramirez-Zamora, Wissam Deeb, Christopher Hess, Joshua Wong, Leonardo Almeida, and the entire Brain Mapping Laboratory at the University of Florida for helpful feedback and commentary.
References
Aldridge, J. W., Berridge, K. C., Herman, M., and Zimmer, L. (1993). Neuronal coding of serial order: syntax of grooming in the neostriatum. Psychol. Sci. 4, 391–395. doi: 10.1111/j.1467-9280.1993.tb00587.x
Alegre, M., Lopez-Azcarate, J., Obeso, I., Wilkinson, L., Rodriguez-Oroz, M. C., Valencia, M., et al. (2013). The subthalamic nucleus is involved in successful inhibition in the stop-signal task: a local field potential study in Parkinson's disease. Exp. Neurol. 239, 1–12. doi: 10.1016/j.expneurol.2012.08.027
Alkemade, A., Schnitzler, A., and Forstmann, B. U. (2015). Topographic organization of the human and non-human primate subthalamic nucleus. Brain Struct. Funct. 220, 3075–3086. doi: 10.1007/s00429-015-1047-2
Allman, M. J., and Meck, W. H. (2011). Pathophysiological distortions in time perception and timed performance. Brain 135, 656–677. doi: 10.1093/brain/awr210
Angwin, A. J., Dissanayaka, N. N., Moorcroft, A., McMahon, K. L., Silburn, P. A., and Copland, D. A. (2017). A neurophysiological study of semantic processing in Parkinson's disease. J. Int. Neuropsychol. Soc. 23, 78–89. doi: 10.1017/S1355617716000953
Anzak, A., Gaynor, L., Beigi, M., Limousin, P., Hariz, M., Zrinzo, L., et al. (2011). A gamma band specific role of the subthalamic nucleus in switching during verbal fluency tasks in Parkinson's disease. Exp. Neurol. 232, 136–142. doi: 10.1016/j.expneurol.2011.07.010
Aosaki, T., Tsubokawa, H., Ishida, A., Watanabe, K., Graybiel, A. M., and Kimura, M. (1994). Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning. J. Neurosci. 14, 3969–3984. doi: 10.1523/JNEUROSCI.14-06-03969.1994
Apicella, P., Ljungberg, T., Scarnati, E., and Schultz, W. (1991). Responses to reward in monkey dorsal and ventral striatum. Exp. Brain Res. 85, 491–500. doi: 10.1007/BF00231732
Apicella, P., Scarnati, E., Ljungberg, T., and Schultz, W. (1992). Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J. Neurophysiol. 68, 945–960. doi: 10.1152/jn.1992.68.3.945
Arkadir, D., Morris, G., Vaadia, E., and Bergman, H. (2004). Independent coding of movement direction and reward prediction by single pallidal neurons. J. Neurosci. 24, 10047–10056. doi: 10.1523/JNEUROSCI.2583-04.2004
Aron, A. R., Herz, D. M., Brown, P., Forstmann, B. U., and Zaghloul, K. (2016). Frontosubthalamic circuits for control of action and cognition. J. Neurosci. 36, 11489–11495. doi: 10.1523/JNEUROSCI.2348-16.2016
Asaad, W. F., and Eskandar, E. N. (2011). Encoding of both positive and negative reward prediction errors by neurons of the primate lateral prefrontal cortex and caudate nucleus. J. Neurosci. 31, 17772–17787. doi: 10.1523/JNEUROSCI.3793-11.2011
Baláz, M., Rektor, I., and Pulkrábek, J. (2008). Participation of the subthalamic nucleus in executive functions: an intracerebral recording study. Mov. Disord. 23, 553–557. doi: 10.1002/mds.21873
Bar-Gad, I., Morris, G., and Bergman, H. (2003). Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. Prog Neurobiol. 71, 439–473. doi: 10.1016/j.pneurobio.2003.12.001
Bartolo, R., and Merchant, H. (2015). β oscillations are linked to the initiation of sensory-cued movement sequences and the internal guidance of regular tapping in the monkey. J. Neurosci. 35, 4635–4640. doi: 10.1523/JNEUROSCI.4570-14.2015
Bartolo, R., Prado, L., and Merchant, H. (2014). Information processing in the primate basal ganglia during sensory-guided and internally driven rhythmic tapping. J. Neurosci. 34, 3910–3923. doi: 10.1523/JNEUROSCI.2679-13.2014
Bastin, J., Polosan, M., Benis, D., Goetz, L., Bhattacharjee, M., Piallat, B., et al. (2014). Inhibitory control and error monitoring by human subthalamic neurons. Transl. Psychiatry 4:e439. doi: 10.1038/tp.2014.73
Baunez, C., and Lardeux, S. (2011). Frontal cortex-like functions of the subthalamic nucleus. Front. Syst. Neurosci. 5:83. doi: 10.3389/fnsys.2011.00083
Bénar, C. G., and Gotman, J. (2002). Modeling of post-surgical brain and skull defects in the EEG inverse problem with the boundary element method. Clin. Neurophysiol. 113, 48–56. doi: 10.1016/S1388-2457(01)00714-3
Berns, G. S., and Sejnowski, T. J. (1998). A computational model of how the basal ganglia produce sequences. J. Cogn. Neurosci. 10, 108–121. doi: 10.1162/089892998563815
Bowman, E. M., Aigner, T. G., and Richmond, B. J. (1996). Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J. Neurophysiol. 75, 1061–1073. doi: 10.1152/jn.1996.75.3.1061
Brasted, P. J., and Wise, S. P. (2004). Comparison of learning-related neuronal activity in the dorsal premotor cortex and striatum. Eur. J. Neurosci. 19, 721–740. doi: 10.1111/j.0953-816X.2003.03181.x
Brittain, J. S., Watkins, K. E., Joundi, R. A., Ray, N. J., Holland, P., Green, A. L., et al. (2012). A role for the subthalamic nucleus in response inhibition during conflict. J. Neurosci. 32, 13396–13401. doi: 10.1523/JNEUROSCI.2259-12.2012
Broca, P. (1861). Remarks on the seat of the faculty of articulated language, following an observation of aphemia (loss of speech). Bull. Soc. Anatom. 6, 330–357.
Brücke, C., Kupsch, A., Schneider, G. H., Hariz, M. I., Nuttin, B., Kopp, U., et al. (2007). The subthalamic region is activated during valence-related emotional processing in patients with Parkinson's disease. Eur. J. Neurosci. 26, 767–774. doi: 10.1111/j.1460-9568.2007.05683.x
Buhusi, C. V., and Meck, W. H. (2002). Differential effects of methamphetamine and haloperidol on the control of an internal clock. Behav. Neurosci. 116:291. doi: 10.1037/0735-7044.116.2.291
Buhusi, C. V., and Meck, W. H. (2005). What makes us tick? Functional and neural mechanisms of interval timing.Nat. Rev. Neurosci. 6:755. doi: 10.1038/nrn1764
Buot, A., Welter, M. L., Karachi, C., Pochon, J.-B., Bardinet, E., Yelnik, J., et al. (2013). Processing of emotional information in the human subthalamic nucleus. J. Neurol. Neurosurg. Psychiatry 84, 1331–1338. doi: 10.1136/jnnp-2011-302158
Buzsáki, G., Anastassiou, C. A., and Koch, C. (2012). The origin of extracellular fields and currents–EEG, ECoG, LFP and spikes. Nat. Rev. Neurosci. 13, 407–420. doi: 10.1038/nrn3241
Calabresi, P., Picconi, B., Tozzi, A., Ghiglieri, V., and Di Filippo, M. (2014). Direct and indirect pathways of basal ganglia: a critical reappraisal. Nat. Neurosci. 17, 1022–1030. doi: 10.1038/nn.3743
Cavanagh, J. F., Cohen, M. X., and Allen, J. J. B. (2009). Prelude to and resolution of an error: EEG phase synchrony reveals cognitive control dynamics during action monitoring. J. Neurosci. 29, 98–105. doi: 10.1523/JNEUROSCI.4137-08.2009
Cavanagh, J. F., Frank, M. J., Klein, T. J., and Allen, J. J. (2010). Frontal theta links prediction errors to behavioral adaptation in reinforcement learning. Neuroimage 49, 3198–3209. doi: 10.1016/j.neuroimage.2009.11.080
Cavanagh, J. F., Sanguinetti, J. L., Allen, J. J., Sherman, S. J., and Frank, M. J. (2014). The subthalamic nucleus contributes to post-error slowing. J. Cogn. Neurosci. 26, 2637–2644. doi: 10.1162/jocn_a_00659
Cavanagh, J. F., Wiecki, T. V., Cohen, M. X., Figueroa, C. M., Samanta, J., Sherman, S. J., et al. (2011). Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold. Nat. Neurosci. 14, 1462–1467. doi: 10.1038/nn.2925
Chang, C., Crottaz-Herbette, S., and Menon, V. (2007). Temporal dynamics of basal ganglia response and connectivity during verbal working memory. Neuroimage 34, 1253–1269. doi: 10.1016/j.neuroimage.2006.08.056
Chiu, Y. C., and Egner, T. (2015). Inhibition-induced forgetting: when more control leads to less memory. Psychol. Sci. 26, 27–38. doi: 10.1177/0956797614553945
Cohen, M. X., Axmacher, N., Lenartz, D., Elger, C. E., Sturm, V., and Schlaepfer, T. E. (2009). Good vibrations: cross-frequency coupling in the human nucleus accumbens during reward processing. J. Cogn. Neurosci. 21, 875–889. doi: 10.1162/jocn.2009.21062
Cohen, M. X., and Cavanagh, J. F. (2011). Single-trial regression elucidates the role of prefrontal theta oscillations in response conflict. Front. Psychol. 2:30. doi: 10.3389/fpsyg.2011.00030
Courtemanche, R., Fujii, N., and Graybiel, A. M. (2003). Synchronous, focally modulated β-band oscillations characterize local field potential activity in the striatum of awake behaving monkeys. J. Neurosci. 23, 11741–11752. doi: 10.1523/JNEUROSCI.23-37-11741.2003
Cromwell, H. C., and Schultz, W. (2003). Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J. Neurophysiol. 89, 2823–2838. doi: 10.1152/jn.01014.2002
Crone, N. E., Hao, L., Hart, J., Boatman, D., Lesser, R. P., Irizarry, R., et al. (2001). Electrocorticographic gamma activity during word production in spoken and sign language. Neurology 57, 2045–2053. doi: 10.1212/WNL.57.11.2045
Damasio, A. R., Damasio, H., Rizzo, M., Varney, N., and Gersh, F. (1982). Aphasia with nonhemorrhagic lesions in the basal ganglia and internal capsule. Arch. Neurol. 39, 15–20. doi: 10.1001/archneur.1982.00510130017003
Darbaky, Y., Baunez, C., Arecchi, P., Legallet, E., and Apicella, P. (2005). Reward-related neuronal activity in the subthalamic nucleus of the monkey. Neuroreport 16, 1241–1244. doi: 10.1097/00001756-200508010-00022
Day, J. J., and Carelli, R. M. (2007). The nucleus accumbens and Pavlovian reward learning. Neuroscientist 13, 148–159. doi: 10.1177/1073858406295854
Eblen, F., and Graybiel, A. M. (1995). Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey. J. Neurosci. 15, 5999–6013. doi: 10.1523/JNEUROSCI.15-09-05999.1995
Edwards, E., Soltani, M., Kim, W., Dalal, S. S., Nagarajan, S. S., Berger, M. S., et al. (2009). Comparison of time–frequency responses and the event-related potential to auditory speech stimuli in human cortex. J. Neurophysiol. 102, 377–386. doi: 10.1152/jn.90954.2008
Eitan, R., Shamir, R. R., Linetsky, E., Rosenbluh, O., Moshel, S., Ben-Hur, T., et al. (2013). Asymmetric right/left encoding of emotions in the human subthalamic nucleus. Front. Syst. Neurosci. 7:69. doi: 10.3389/fnsys.2013.00069
Espinosa-Parrilla, J. F., Baunez, C., and Apicella, P. (2013). Linking reward processing to behavioral output: motor and motivational integration in the primate subthalamic nucleus. Front. Comput. Neurosci. 7:175. doi: 10.3389/fncom.2013.00175
Espinosa-Parrilla, J. F., Baunez, C., and Apicella, P. (2015). Modulation of neuronal activity by reward identity in the monkey subthalamic nucleus. Eur. J. Neurosci. 42, 1705–1717. doi: 10.1111/ejn.12938
Fiorillo, C. D., Tobler, P. N., and Schultz, W. (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898–1902. doi: 10.1126/science.1077349
Frank, M. J. (2006). Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making. Neural Netw. 19, 1120–1136. doi: 10.1016/j.neunet.2006.03.006
Friederici, A. D., Kotz, S. A., Werheid, K., Hein, G., and von Cramon, D. Y. (2003). Syntactic comprehension in Parkinson's disease: investigating early automatic and late integrational processes using event-related brain potentials. Neuropsychology 17:133. doi: 10.1037/0894-4105.17.1.133
Fumagalli, M., Ferrucci, R., Mameli, F., Marceglia, S., Mrakic-Sposta, S., Zago, S., et al. (2010). Gender-related differences in moral judgments. Cogn. Process 11, 219–226. doi: 10.1007/s10339-009-0335-2
Fumagalli, M., Giannicola, G., Rosa, M., Marceglia, S., Lucchiari, C., Mrakic-Sposta, S., et al. (2011). Conflict-dependent dynamic of subthalamic nucleus oscillations during moral decisions. Soc. Neurosci. 6, 243–256. doi: 10.1080/17470919.2010.515148
Gale, J. T., Shields, D. C., Ishizawa, Y., and Eskandar, E. N. (2014). Reward and reinforcement activity in the nucleus accumbens during learning. Front. Behav. Neurosci. 8:299. doi: 10.3389/fnbeh.2014.00114
García-García, I., Zeighami, Y., and Dagher, A. (2017). Reward prediction errors in drug addiction and Parkinson's disease: from neurophysiology to neuroimaging. Curr. Neurol. Neurosci. Rep. 17:46. doi: 10.1007/s11910-017-0755-9
Granger, C. W. J. (1969). Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37:424. doi: 10.2307/1912791
Graybiel, A. M. (1995). Building action repertoires: memory and learning functions of the basal ganglia. Curr. Opin. Neurobiol. 5, 733–741. doi: 10.1016/0959-4388(95)80100-6
Greene, J. D., Nystrom, L. E., Engell, A. D., Darley, J. M., and Cohen, J. D. (2004). The neural bases of cognitive conflict and control in moral judgment. Neuron 44, 389–400. doi: 10.1016/j.neuron.2004.09.027
Haber, S. N., Lynd, E., Klein, C., and Groenewegen, H. J. (1990). Topographic organization of the ventral striatal efferent projections in the rhesus monkey: an anterograde tracing study. J. Comp. Neurol. 293, 282–298. doi: 10.1002/cne.902930210
Hahne, A., and Friederici, A. D. (1999). Electrophysiological evidence for two steps in syntactic analysis: early automatic and late controlled processes. J. Cogn. Neurosci. 11, 194–205. doi: 10.1162/089892999563328
Hahne, A., and Friederici, A. D. (2001). Processing a second language: late learners' comprehension mechanisms as revealed by event-related brain potentials. Bilingualism 4, 123–141. doi: 10.1017/S1366728901000232
Hassani, O. K., Cromwell, H. C., and Schultz, W. (2001). Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. J. Neurophysiol. 85, 2477–2489. doi: 10.1152/jn.2001.85.6.2477
Hebb, A. O., Darvas, F., and Miller, K. J. (2012). Transient and state modulation of beta power in human subthalamic nucleus during speech production and finger movement. Neuroscience 202, 218–233. doi: 10.1016/j.neuroscience.2011.11.072
Herreras, O. (2016). Local field potentials: myths and misunderstandings. Front. Neural Circuits 10:101. doi: 10.3389/fncir.2016.00101
Herrojo Ruiz, M., Huebl, J., Schönecker, T., Kupsch, A., Yarrow, K., Krauss, J. K., et al. (2014). Involvement of human internal globus pallidus in the early modulation of cortical error-related activity. Cereb. Cortex 24, 1502–1517. doi: 10.1093/cercor/bht002
Herz, D. M., Christensen, M. S., Bruggemann, N., Hulme, O. J., Ridderinkhof, K. R., Madsen, K. H., et al. (2014). Motivational tuning of fronto-subthalamic connectivity facilitates control of action impulses. J. Neurosci. 34, 3210–3217. doi: 10.1523/JNEUROSCI.4081-13.2014
Hier, D. B., Davis, K. R., Richardson, E. P., and Mohr, J. P. (1977). Hypertensive putaminal hemorrhage. Ann. Neurol. 1, 152–159. doi: 10.1002/ana.410010209
Hikosaka, O., Sakamoto, M., and Usui, S. (1989). Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J. Neurophysiol. 61, 814–832. doi: 10.1152/jn.1989.61.4.814
Hohlefeld, F. U., Ewald, A., Ehlen, F., Tiedt, H. O., Horn, A., Kühn, A. A., et al. (2017). Neural correlates of lexical decisions in Parkinson's disease revealed with multivariate extraction of cortico-subthalamic interactions. Clin. Neurophysiol. 128, 538–548. doi: 10.1016/j.clinph.2016.12.026
Holcomb, P. J., and Neville, H. J. (1990). Auditory and visual semantic priming in lexical decision: a comparison using event-related brain potentials. Lang. Cogn. Process. 5, 281–312. doi: 10.1080/01690969008407065
Hollerman, J. R., Tremblay, L., and Schultz, W. (1998). Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol. 80, 947–963. doi: 10.1152/jn.1998.80.2.947
Hong, S., and Hikosaka, O. (2008). The globus pallidus sends reward-related signals to the lateral habenula. Neuron 60, 720–729. doi: 10.1016/j.neuron.2008.09.035
Hong, S., and Hikosaka, O. (2013). Diverse sources of reward value signals in the basal ganglia nuclei transmitted to the lateral habenula in the monkey. Front. Hum. Neurosci. 7:778. doi: 10.3389/fnhum.2013.00778
Huebl, J., Schoenecker, T., Siegert, S., Brücke, C., Schneider, G.-H., Kupsch, A., et al. (2011). Modulation of subthalamic alpha activity to emotional stimuli correlates with depressive symptoms in Parkinson's disease. Mov. Disord. 26, 477–483. doi: 10.1002/mds.23515
Huebl, J., Spitzer, B., Brücke, C., Schönecker, T., Kupsch, A., Alesch, F., et al. (2014). Oscillatory subthalamic nucleus activity is modulated by dopamine during emotional processing in Parkinson's disease. Cortex 60, 69–81. doi: 10.1016/j.cortex.2014.02.019
Inase, M., Tokuno, H., Nambu, A., Akazawa, T., and Takada, M. (1999). Corticostriatal and corticosubthalamic input zones from the presupplementary motor area in the macaque monkey: comparison with the input zones from the supplementary motor area. Brain Res. 833, 191–201. doi: 10.1016/S0006-8993(99)01531-0
Joshua, M., Adler, A., Rosin, B., Vaadia, E., and Bergman, H. (2009). Encoding of probabilistic rewarding and aversive events by pallidal and nigral neurons. J. Neurophysiol. 101, 758–772. doi: 10.1152/jn.90764.2008
Katnani, H. A., Patel, S. R., Kwon, C. S., Abdel-Aziz, S., Gale, J. T., and Eskandar, E. N. (2016). Temporally coordinated deep brain stimulation in the dorsal and ventral striatum synergistically enhances associative learning. Sci. Rep. 6:18806. doi: 10.1038/srep18806
Kawagoe, R., Takikawa, Y., and Hikosaka, O. (1998). Expectation of reward modulates cognitive signals in the basal ganglia. Nat. Neurosci. 1, 411–416. doi: 10.1038/1625
Kim, H. J., Jeon, B. S., and Paek, S. H. (2015). Nonmotor symptoms and subthalamic deep brain stimulation in Parkinson's disease. J. Mov. Dis. 8, 83–91. doi: 10.14802/jmd.15010
Koch, G., Brusa, L., Caltagirone, C., Oliveri, M., Peppe, A., Tiraboschi, P., et al. (2004). Subthalamic deep brain stimulation improves time perception in Parkinson's disease. Neuroreport 15, 1071–1073. doi: 10.1097/00001756-200404290-00028
Koivuniemi, A., Wilks, S. J., Woolley, A. J., and Otto, K. J. (2011). Multimodal, longitudinal assessment of intracortical microstimulation. Prog. Brain Res. 194, 131–144. doi: 10.1016/B978-0-444-53815-4.00011-X
Kotz, S. A., Frisch, S., von Cramon, D. Y., and Friederici, A. D. (2003). Syntactic language processing: ERP lesion data on the role of the basal ganglia. J. Int. Neuropsychol. Soc. 9, 1053–1060. doi: 10.1017/S1355617703970093
Kühn, A. A., Hariz, M. I., Silberstein, P., Tisch, S., Kupsch, A., Schneider, G. H., et al. (2005a). Activation of the subthalamic region during emotional processing in Parkinson disease. Neurology 65, 707–713. doi: 10.1212/01.wnl.0000174438.78399.bc
Kühn, A. A., Trottenberg, T., Kivi, A., Kupsch, A., Schneider, G. H., and Brown, P. (2005b). The relationship between local field potential and neuronal discharge in the subthalamic nucleus of patients with Parkinson's disease. Exp. Neurol. 194, 212–220. doi: 10.1016/j.expneurol.2005.02.010
Kühn, A. A., Williams, D., Kupsch, A., Limousin, P., Hariz, M., Schneider, G. H., et al. (2004). Event-related beta desynchronization in human subthalamic nucleus correlates with motor performance. Brain 127, 735–746. doi: 10.1093/brain/awh106
Kutas, M., and Hillyard, S. A. (1980). Event-related brain potentials to semantically inappropriate and surprisingly large words. Biol. Psychol. 11, 99–116. doi: 10.1016/0301-0511(80)90046-0
Lang, P. J., Bradley, M. M., and Cuthbert, B. N. (1999). International Affective Picture System (IAPS): Instruction Manual and Affective Ratings. The center for research in psychophysiology.
Lauwereyns, J., Watanabe, K., Coe, B., and Hikosaka, O. (2002). A neural correlate of response bias in monkey caudate nucleus. Nature 418, 413–417. doi: 10.1038/nature00892
Leentjens, A. F. G., Verhey, F. R. J., Luijckx, G. J., and Troost, J. (2000). The validity of the Beck Depression Inventory as a screening and diagnostic instrument for depression in patients with Parkinson's disease. Mov. Disord. 15, 1221–1224. doi: 10.1002/1531-8257(200011)15:6<1221::AID-MDS1024>3.0.CO;2-H
Li, Y., Vanni-Mercier, G., Isnard, J., Mauguière, F., and Dreher, J. C. (2016). The neural dynamics of reward value and risk coding in the human orbitofrontal cortex. Brain 139, 1295–1309. doi: 10.1093/brain/awv409
Lieberman, P. (2009). Human Language and Our Reptilian Brain: The Subcortical Bases of Speech, Syntax, and Thought. Cambridge, MA: Harvard University Press.
Litvak, V., Jha, A., Eusebio, A., Oostenveld, R., Foltynie, T., Limousin, P., et al. (2011). Resting oscillatory cortico-subthalamic connectivity in patients with Parkinson's disease. Brain 134, 359–374. doi: 10.1093/brain/awq332
Ljungberg, T., Apicella, P., and Schultz, W. (1991). Responses of monkey midbrain dopamine neurons during delayed alternation performance. Brain Res. 567, 337–341. doi: 10.1016/0006-8993(91)90816-E
Ljungberg, T., Apicella, P., and Schultz, W. (1992). Responses of monkey dopamine neurons during learning of behavioral reactions. J. Neurophysiol. 67, 145–163. doi: 10.1152/jn.1992.67.1.145
Malapani, C., Rakitin, B., Levy, R., Meck, W. H., Deweer, B., Dubois, B., et al. (1998). Coupled temporal memories in Parkinson's disease: a dopamine-related dysfunction. J. Cogn. Neurosci. 10, 316–331. doi: 10.1162/089892998562762
Mandali, A., Chakravarthy, V. S., Rajan, R., Sarma, S., and Kishore, A. (2016). Electrode position and current amplitude modulate impulsivity after subthalamic stimulation in parkinsons disease—a computational study. Front. Physiol. 7:266. doi: 10.3389/fphys.2016.00585
Marceglia, S., Fiorio, M., Foffani, G., Mrakic-Sposta, S., Tiriticco, M., Locatelli, M., et al. (2009). Modulation of beta oscillations in the subthalamic area during action observation in Parkinson's disease. Neuroscience 161, 1027–1036. doi: 10.1016/j.neuroscience.2009.04.018
Marceglia, S., Fumagalli, M., and Priori, A. (2014). What neurophysiological recordings tell us about cognitive and behavioral functions of the human subthalamic nucleus. Expert Rev. Neurother. 11, 139–149. doi: 10.1586/ern.10.184
Matsumoto, M., and Hikosaka, O. (2007). Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447, 1111–1115. doi: 10.1038/nature05860
Matsumura, M., Kojima, J., Gardiner, T. W., and Hikosaka, O. (1992). Visual and oculomotor functions of monkey subthalamic nucleus. J. Neurophysiol. 67, 1615–1632. doi: 10.1152/jn.1992.67.6.1615
Meck, W. H., and Benson, A. M. (2002). Dissecting the brain's internal clock: how frontal–striatal circuitry keeps time and shifts attention. Brain Cogn. 48, 195–211. doi: 10.1006/brcg.2001.1313
Mikos, A., Bowers, D., Noecker, A. M., McIntyre, C. C., Won, M., Chaturvedi, A., et al. (2011). Patient-specific analysis of the relationship between the volume of tissue activated during DBS and verbal fluency. Neuroimage 54, S238–S246. doi: 10.1016/j.neuroimage.2010.03.068
Mirenowicz, J., and Schultz, W. (1994). Importance of unpredictability for reward responses in primate dopamine neurons. J. Neurophysiol. 72, 1024–1027. doi: 10.1152/jn.1994.72.2.1024
Mirenowicz, J., and Schultz, W. (1996). Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379, 449–451. doi: 10.1038/379449a0
Münte, T. F., Marco-Pallares, J., Bolat, S., Heldmann, M., Lütjens, G., Nager, W., et al. (2017). The human globus pallidus internus is sensitive to rewards–Evidence from intracerebral recordings. Brain Stimul. 10, 657–663. doi: 10.1016/j.brs.2017.01.004
Nambu, A., Tokuno, H., and Takada, M. (2002). Functional significance of the cortico–subthalamo–pallidal “hyperdirect” pathway. Neurosci. Res. 43, 111–117. doi: 10.1016/S0168-0102(02)00027-5
Okun, M. S. (2013). Deep-brain stimulation for Parkinson's disease. N. Engl. J. Med. 368, 483–484. doi: 10.1056/NEJMct1208070
Okun, M. S., Fernandez, H. H., Wu, S. S., Kirsch-Darrow, L., Bowers, D., Bova, F., et al. (2009). Cognition and mood in Parkinson's disease in subthalamic nucleus versus globus pallidus interna deep brain stimulation: the COMPARE Trial. Ann. Neurol. 65, 586–595. doi: 10.1002/ana.21596
Oostenveld, R., and Oostendorp, T. F. (2002). Validating the boundary element method for forward and inverse EEG computations in the presence of a hole in the skull. Hum. Brain Mapp. 17, 179–192. doi: 10.1002/hbm.10061
Osterhout, L., and Holcomb, P. J. (1992). Event-related brain potentials elicited by syntactic anomaly. J. Mem. Lang. 31, 785–806. doi: 10.1016/0749-596X(92)90039-Z
Oya, H., Adolphs, R., Kawasaki, H., Bechara, A., Damasio, A., and Howard, M. A. (2005). Electrophysiological correlates of reward prediction error recorded in the human prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 102, 8351–8356. doi: 10.1073/pnas.0500899102
Papay, K., Mamikonyan, E., Siderowf, A. D., Duda, J. E., Lyons, K. E., Pahwa, R., et al. (2011). Patient versus informant reporting of ICD symptoms in Parkinson's disease using the QUIP: Validity and variability. Parkinsonism Relat. Disord. 17, 153–155. doi: 10.1016/j.parkreldis.2010.11.015
Parsons, T. D., Rogers, S. A., Braaten, A. J., Woods, S. P., and Tröster, A. I. (2006). Cognitive sequelae of subthalamic nucleus deep brain stimulation in Parkinson's disease: a meta-analysis. Lancet Neurol. 5, 578–588. doi: 10.1016/S1474-4422(06)70475-6
Pasupathy, A., and Miller, E. K. (2005). Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433, 873–876. doi: 10.1038/nature03287
Patel, S. R., Sheth, S. A., Martinez-Rubio, C., Mian, M. K., Asaad, W. F., Gerrard, J. L., et al. (2013). Studying task-related activity of individual neurons in the human brain. Nat. Protocols 8, 949–957. doi: 10.1038/nprot.2013.050
Patel, S. R., Sheth, S. A., Mian, M. K., Gale, J. T., Greenberg, B. D., Dougherty, D. D., et al. (2012). Single-neuron responses in the human nucleus accumbens during a financial decision-making task. J. Neurosci. 32, 7311–7315. doi: 10.1523/JNEUROSCI.0027-12.2012
Paulsen, J. S., Zimbelman, J. L., Hinton, S. C., Langbehn, D. R., Leveroni, C. L., Benjamin, M. L., et al. (2004). fMRI biomarker of early neuronal dysfunction in presymptomatic Huntington's disease. Am. J. Neuroradiol. 25, 1715–1721.
Péron, J., Renaud, O., Haegelen, C., Tamarit, L., Milesi, V., Houvenaghel, J. F., et al. (2017). Vocal emotion decoding in the subthalamic nucleus: an intracranial ERP study in Parkinson's disease. Brain Lang. 168, 1–11. doi: 10.1016/j.bandl.2016.12.003
Rangel, A., Camerer, C., and Montague, P. R. (2008). A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9, 545–556. doi: 10.1038/nrn2357
Ray, N. J., Brittain, J. S., Holland, P., Joundi, R. A., Stein, J. F., Aziz, T. Z., et al. (2012). The role of the subthalamic nucleus in response inhibition: evidence from local field potential recordings in the human subthalamic nucleus. Neuroimage 60, 271–278. doi: 10.1016/j.neuroimage.2011.12.035
Rektor, I., Baláz, M., and Bocková, M. (2009). Cognitive activities in the subthalamic nucleus. Invasive studies. Parkinsonism Relat. Disord. 15(Suppl. 3), S83–S86. doi: 10.1016/S1353-8020(09)70788-6
Rektor, I., Bares, M., Brázdil, M., Kanovský, P., Rektorová, I., Sochǔrková, D., et al. (2005). Cognitive- and movement-related potentials recorded in the human basal ganglia. Mov. Disord. 20, 562–568. doi: 10.1002/mds.20368
Ridderinkhof, K. R., van den Wildenberg, W. P., Segalowitz, S. J., and Carter, C. S. (2004). Neurocognitive mechanisms of cognitive control: the role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning. Brain Cogn. 56, 129–140. doi: 10.1016/j.bandc.2004.09.016
Rodriguez-Oroz, M. C., López-Azcárate, J., Garcia-Garcia, D., Alegre, M., Toledo, J., Valencia, M., et al. (2010). Involvement of the subthalamic nucleus in impulse control disorders associated with Parkinson's disease. Brain 134, 36–49. doi: 10.1093/brain/awq301
Romo, R., and Schultz, W. (1990). Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements. J. Neurophysiol. 63, 592–606. doi: 10.1152/jn.1990.63.3.592
Rosa, M., Fumagalli, M., Giannicola, G., Marceglia, S., Lucchiari, C., Servello, D., et al. (2013). Pathological gambling in Parkinson's disease: subthalamic oscillations during economics decisions. Mov. Disord. 28, 1644–1652. doi: 10.1002/mds.25427
Rossi, P. J., Gunduz, A., and Okun, M. S. (2015). The subthalamic nucleus, limbic function, and impulse control disorder. Neuropsychol. Rev. 25, 398–410. doi: 10.1007/s11065-015-9306-9
Rossi, P., Peden, C., Castellanos, O., Foote, K. D., Gunduz, A., and Okun, M. S. (2017). The human subthalamic nucleus and globus pallidus internus differentially encode reward during action control. Hum. Brain Mapp. 38, 1952–1964. doi: 10.1002/hbm.23496
Saint-Cyr, J. A. (2003). Frontal-striatal circuit functions: context, sequence, and consequence. J. Int. Neuropsychol. Soc. 9, 103–127. doi: 10.1017/S1355617703910125
Schroeder, U., Kuehler, A., Haslinger, B., Erhard, P., Fogel, W., Tronnier, V. M., et al. (2002). Subthalamic nucleus stimulation affects striato-anterior cingulate cortex circuit in a response conflict task: a PET study. Brain 125, 1995–2004. doi: 10.1093/brain/awf199
Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1–27. doi: 10.1152/jn.1998.80.1.1
Schultz, W., Apicella, P., and Ljungberg, T. (1993). Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 3, 900–913. doi: 10.1523/JNEUROSCI.13-03-00900.1993
Schultz, W., Apicella, P., Scarnati, E., and Ljungberg, T. (1992). Neuronal activity in monkey ventral striatum related to the expectation of reward. J. Neurosci. 12, 4595–4610. doi: 10.1523/JNEUROSCI.12-12-04595.1992
Schultz, W., and Dickinson, A. (2000). Neuronal coding of prediction errors. Annu. Rev. Neurosci. 23, 473–500. doi: 10.1146/annurev.neuro.23.1.473
Schultz, W., Tremblay, L., and Hollerman, J. R. (2000). Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb. Cortex 10, 272–284. doi: 10.1093/cercor/10.3.272
Selemon, L. D., and Goldman-Rakic, P. S. (1988). Common cortical and subcortical targets of the dorsolateral prefrontal and posterior parietal cortices in the rhesus monkey: evidence for a distributed neural network subserving spatially guided behavior. J. Neurosci. 8, 4049–4068. doi: 10.1523/JNEUROSCI.08-11-04049.1988
Sheth, S. A., Abuelem, T., Gale, J. T., and Eskandar, E. N. (2011). Basal ganglia neurons dynamically facilitate exploration during associative learning. J. Neurosci. 31, 4878–4885. doi: 10.1523/JNEUROSCI.3658-10.2011
Shidara, M., Aigner, T. G., and Richmond, B. J. (1998). Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials. J. Neurosci. 18, 2613–2625. doi: 10.1523/JNEUROSCI.18-07-02613.1998
Sieger, T., Serranová, T., RuŽicka, F., Vostatek, P., Wild, J., Štastná, D., et al. (2015). Distinct populations of neurons respond to emotional valence and arousal in the human subthalamic nucleus. Proc. Natl. Acad. Sci. U.S.A. 112, 3116–3121. doi: 10.1073/pnas.1410709112
Siegert, S., Herrojo Ruiz, M., Brücke, C., Huebl, J., Schneider, G. H., Ullsperger, M., et al. (2014). Error signals in the subthalamic nucleus are related to post-error slowing in patients with Parkinson's disease. Cortex 60, 103–120. doi: 10.1016/j.cortex.2013.12.008
Soltysik, S. (1975). Single unit activity in basal ganglia of monkeys during performance of a delayed response task. Electroencephalogr. Clin. Neurophysiol. 39, 65–78. doi: 10.1016/0013-4694(75)90128-5
Swann, N., Tandon, N., Canolty, R., Ellmore, T. M., McEvoy, L. K., Dreyer, S., et al. (2009). Intracranial EEG reveals a time- and frequency-specific role for the right inferior frontal gyrus and primary motor cortex in stopping initiated responses. J. Neurosci. 29, 12675–12685. doi: 10.1523/JNEUROSCI.3359-09.2009
Tachibana, Y., and Hikosaka, O. (2012). The primate ventral pallidum encodes expected reward value and regulates motor action. Neuron 76, 826–837. doi: 10.1016/j.neuron.2012.09.030
Teki, S., Grube, M., Kumar, S., and Griffiths, T. D. (2011). Distinct neural substrates of duration-based and beat-based auditory timing. J. Neurosci. 31, 3805–3812. doi: 10.1523/JNEUROSCI.5561-10.2011
Temel, Y., Blokland, A., Steinbusch, H. W., and Visser-Vandewalle, V. (2005). The functional role of the subthalamic nucleus in cognitive and limbic circuits. Prog Neurobiol. 76, 393–413. doi: 10.1016/j.pneurobio.2005.09.005
Travis, R. P. Jr., Hooten, T. F., and Sparks, D. L. (1968). Single unit activity related to behavior motivated by food reward. Physiol. Behav. 3, 309–318. doi: 10.1016/0031-9384(68)90106-6
Tremblay, L., Hollerman, J. R., and Schultz, W. (1998). Modifications of reward expectation-related neuronal activity during learning in primate striatum. J. Neurophysiol. 80, 964–977. doi: 10.1152/jn.1998.80.2.964
Tremblay, L., and Schultz, W. (2000). Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. J. Neurophysiol. 83, 1877–1885. doi: 10.1152/jn.2000.83.4.1877
Urdaneta, M. E., Koivuniemi, A. S., and Otto, K. J. (2017). Central nervous system microstimulation: towards selective micro-neuromodulation. Curr. Opin. Biomed. Eng. 4, 65–77. doi: 10.1016/j.cobme.2017.09.012
Vetter, R. J., Williams, J. C., Hetke, J. F., Nunamaker, E. A., and Kipke, D. R. (2004). Chronic neural recording using silicon-substrate microelectrode arrays implanted in cerebral cortex. IEEE Trans. Biomed. Eng. 51, 896–904. doi: 10.1109/TBME.2004.826680
Voon, V., Droux, F., Morris, L., Chabardes, S., Bougerol, T., David, O., et al. (2017). Decisional impulsivity and the associative-limbic subthalamic nucleus in obsessive-compulsive disorder: stimulation and connectivity. Brain 140, 442–456. doi: 10.1093/brain/aww309
Wahl, M., Marzinzik, F., Friederici, A. D., Hahne, A., Kupsch, A., Schneider, G. H., et al. (2008). The human thalamus processes syntactic and semantic language violations. Neuron 59, 695–707. doi: 10.1016/j.neuron.2008.07.011
Wallesch, C. W. (1985). Two syndromes of aphasia occurring with ischemic lesions involving the left basal ganglia. Brain Lang. 25, 357–361. doi: 10.1016/0093-934X(85)90090-2
Wang, C., Ulbert, I., Schomer, D. L., Marinkovic, K., and Halgren, E. (2005). Responses of human anterior cingulate cortex microdomains to error detection, conflict monitoring, stimulus-response mapping, familiarity, and orienting. J. Neurosci. 25, 604–613. doi: 10.1523/JNEUROSCI.4151-04.2005
Watanabe, M. (1996). Reward expectancy in primate prefrontal neurons. Nature 382, 629–632. doi: 10.1038/382629a0
Watson, P., and Montgomery, E. B. (2006). The relationship of neuronal activity within the sensori-motor region of the subthalamic nucleus to speech. Brain Lang. 97, 233–240. doi: 10.1016/j.bandl.2005.11.004
Weintraub, D. B., and Zaghloul, K. A. (2013). The role of the subthalamic nucleus in cognition. Rev. Neurosci. 24, 125–128. doi: 10.1515/revneuro-2012-0075
Wernicke, C. (1874). Der aphasische Symptomencomplex: eine Psychologische Studie auf Anatomischer Basis. Breslau: Cohn & Weigert.
Wessel, J. R., and Aron, A. R. (2013). Unexpected events induce motor slowing via a brain mechanism for action-stopping with global suppressive effects. J. Neurosci. 33, 18481–18491. doi: 10.1523/JNEUROSCI.3456-13.2013
Wessel, J. R., Jenkinson, N., Brittain, J. S., Voets, S. H., Aziz, T. Z., and Aron, A. R. (2016). Surprise disrupts cognition via a fronto-basal ganglia suppressive mechanism. Nat. Commun. 7:11195. doi: 10.1038/ncomms11195
Wiecki, T. V., and Frank, M. J. (2013). A computational model of inhibitory control in frontal cortex and basal ganglia. Psychol. Rev. 120, 329–355. doi: 10.1037/a0031542
Williams, Z. M., Bush, G., Rauch, S. L., Cosgrove, G. R., and Eskandar, E. N. (2004). Human anterior cingulate neurons and the integration of monetary reward with motor responses. Nat. Neurosci. 7, 1370–1375. doi: 10.1038/nn1354
Wojtecki, L., Elben, S., Timmermann, L., Reck, C., Maarouf, M., Jörgens, S., et al. (2011). Modulation of human time processing by subthalamic deep brain stimulation. PLoS ONE 6:e24589. doi: 10.1371/journal.pone.0024589
Wojtecki, L., Elben, S., Vesper, J., and Schnitzler, A. (2017). The rhythm of the executive gate of speech: subthalamic low-frequency oscillations increase during verbal generation. Eur. J. Neurosci. 45, 1200–1211. doi: 10.1111/ejn.13429
Wojtecki, L., Timmermann, L., Jörgens, S., Südmeyer, M., Maarouf, M., Treuer, H., et al. (2006). Frequency-dependent reciprocal modulation of verbal fluency and motor functions in subthalamic deep brain stimulation. Arch. Neurol. 63, 1273–1276. doi: 10.1001/archneur.63.9.1273
Wong, J., Gunduz, A., Shute, J., Eisinger, R., Cernera, S., Ho, K. W. D., et al. (2018). Longitudinal follow-up of impedance drift in deep brain stimulation cases. Tremor Other Hyperkinet. Mov. (NY). 8:542. doi: 10.7916/D8M62XTC
Wu, H., Miller, K. J., Blumenfeld, Z., Williams, N. R., Ravikumar, V. K., Lee, K. E., et al. (2017). Closing the loop on impulsivity via nucleus accumbens delta-band activity in mice and man. Proc. Natl. Acad. Sci. U.S.A. 12, 201712214–201712216. doi: 10.1073/pnas.1712214114
Yamanaka, T., Ishii, F., Umemura, A., Miyata, M., Horiba, M., Oka, Y., et al. (2012). Temporary deterioration of executive function after subthalamic deep brain stimulation in Parkinson's disease. Clin. Neurol. Neurosurg. 114, 347–351. doi: 10.1016/j.clineuro.2011.11.009
Zaghloul, K. A., Weidemann, C. T., Lega, B. C., Jaggi, J. L., Baltuch, G. H., and Kahana, M. J. (2012). Neuronal activity in the human subthalamic nucleus encodes decision conflict during action selection. J. Neurosci. 32, 2453–2460. doi: 10.1523/JNEUROSCI.5815-11.2012
Zavala, B. A., Tan, H., Little, S., Ashkan, K., Hariz, M., Foltynie, T., et al. (2014). Midline frontal cortex low-frequency activity drives subthalamic nucleus oscillations during conflict. J. Neurosci. 34, 7322–7333. doi: 10.1523/JNEUROSCI.1169-14.2014
Zavala, B., Brittain, J. S., Jenkinson, N., Ashkan, K., Foltynie, T., Limousin, P., et al. (2013). Subthalamic nucleus local field potential activity during the Eriksen flanker task reveals a novel role for theta phase during conflict monitoring. J. Neurosci. 33, 14758–14766. doi: 10.1523/JNEUROSCI.1036-13.2013
Zavala, B., Damera, S., Dong, J. W., Lungu, C., Brown, P., and Zaghloul, K. A. (2017). Human subthalamic nucleus theta and beta oscillations entrain neuronal firing during sensorimotor conflict. Cereb. Cortex 27, 496–508. doi: 10.1093/cercor/bhv244
Zavala, B., Tan, H., Ashkan, K., Foltynie, T., Limousin, P., Zrinzo, L., et al. (2016). Human subthalamic nucleus-medial frontal cortex theta phase coherence is involved in conflict and error related cortical monitoring. Neuroimage 137, 178–187. doi: 10.1016/j.neuroimage.2016.05.031
Keywords: basal ganglia, electrophysiology, non-motor, deep brain stimulation, subthalamic nucleus
Citation: Eisinger RS, Urdaneta ME, Foote KD, Okun MS and Gunduz A (2018) Non-motor Characterization of the Basal Ganglia: Evidence From Human and Non-human Primate Electrophysiology. Front. Neurosci. 12:385. doi: 10.3389/fnins.2018.00385
Received: 05 February 2018; Accepted: 22 May 2018;
Published: 05 July 2018.
Edited by:
Jonathan Miller, University Hospitals Cleveland Medical Center, United StatesReviewed by:
Sabato Santaniello, University of Connecticut, United StatesGeorge C. McConnell, Stevens Institute of Technology, United States
Copyright © 2018 Eisinger, Urdaneta, Foote, Okun and Gunduz. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Aysegul Gunduz, YWd1bmR1ekBibWUudWZsLmVkdQ==