- Department of Electrical and Electronic Engineering, Centre for Bio-Inspired Technology, Institute of Biomedical Engineering, Imperial College London, London, United Kingdom
Closed-loop or intelligent neuromodulation allows adjustable, personalized neuromodulation which usually incorporates the recording of a biomarker, followed by implementation of an algorithm which decides the timing (when?) and strength (how much?) of stimulation. Closed-loop neuromodulation has been shown to have greater benefits compared to open-loop neuromodulation, particularly for therapeutic applications such as pharmacoresistant epilepsy, movement disorders and potentially for psychological disorders such as depression or drug addiction. However, an important aspect of the technique is selection of an appropriate, preferably neural biomarker. Neurochemical sensing can provide high resolution biomarker monitoring for various neurological disorders as well as offer deeper insight into neurological mechanisms. The chemicals of interest being measured, could be ions such as potassium (K+), sodium (Na+), calcium (Ca2+), chloride (Cl−), hydrogen (H+) or neurotransmitters such as dopamine, serotonin and glutamate. This review focusses on the different building blocks necessary for a neurochemical, closed-loop neuromodulation system including biomarkers, sensors and data processing algorithms. Furthermore, it also highlights the merits and drawbacks of using this biomarker modality.
1. Introduction
The idea of treating intractable diseases with little or no known pharmacological interventions through the nervous system has led to a new area of therapeutic treatment, known as electroceuticals or bio-electronic medicine (Kristoffer et al., 2013). The therapeutic effects of electroceutical techniques are observed by modulating signals on the nervous system through external agents such as electrical stimulation. This process is known as neuromodulation. Current applications of electroceuticals target diseases such as Parkinson's disease (Tass, 2003; Benabid et al., 2009; Ebert et al., 2014), epilepsy (Amar et al., 2008), depression (Landau et al., 2015), diabetes (Shikora et al., 2013), inflammation (Borovikova et al., 2000; Tracey, 2002; Li et al., 2016), auto-immune diseases such as Crohn's disease (Bonaz et al., 2016), regulation of blood pressure (Hosokawa and Sunagawa, 2016) and obesity (Payne et al., 2018).
Closed-loop neuromodulation has been shown to be clinically more effective than open-loop neuromodulation (Sun and Morrell, 2014), under certain conditions. To implement a closed-loop neuromodulation paradigm, important aspects to consider are identifying the relevant neural biomarker, identifying the optimal location(s) for monitoring the biomarker and electrical stimulation, respectively, implementing the sensing methodology and instrumentation for the biomarker, followed by signal processing to differentiate the biomarker responses from background interferences, decision and dose tuning algorithms to determine when and how much to stimulate.
Traditional biomarkers for closed-loop neuromodulation include electrical neural signals such as action potentials (AP) or local field potentials (LFP), with many devices providing high channel count neural recording and processing (Zhou et al., 2019). There have also been recent efforts to incorporate high-resolution stimulation through optogenetic methods (Mickle et al., 2019). Non-neural biomarkers such as electrocardiography (ECG), electromyography (EMG) signals have also been used, particularly in epilepsy and movement disorders (Sun and Morrell, 2014), either as a direct or as an adjunctive biomarker.
For example, in Parkinson's disease, excessively synchronized neural activity is a crucial sign of Parkinson's. A technique, Coordinated Reset Stimulation (CRS) which seeks to desynchronize this abnormal synchronization by computationally modeling stimulation, is gaining traction. The unique advantage is that, the stimulus could be invasive electrical (Tass, 2003) or even non-invasive sensory stimulation such as somatosensory or vibrotactile stimulation. This review is primarily focussed on neurochemical biomarkers for closed-loop systems.
Neurochemical recording is an emerging form of neural recording, where ionic species or neurotransmitters, present inside neurological systems are monitored. Neurochemical monitoring has multiple advantages over traditional electrical neural recording including higher specificity in comparison to traditional electrical recording of neural activity, lesser interference from other signals such as EMG or heart rate (Cork et al., 2018) and possibility to detect inhibitory and excitatory neural activity by monitoring the concentration of specific neurotransmitters (Wightman et al., 1988).
In recent years, there has been significant traction in the pursuit of neurochemical closed-loop feedback in deep brain stimulation (DBS). A recent National Institute of Health (NIH) grant was aimed at exploring neurochemical recording for DBS applications (NIH, 2014). Another interdisciplinary seed grant was recently awarded by Stanford Bio-X, which is aimed at developing neurochemical closed-loop DBS system for treating psychiatric disorders (Stanford-Bio-X, 2018).
DBS is an invasive electrical stimulation therapy used to treat neurological disorders such as Parkinson's Disease (Krack et al., 2003; Bittar et al., 2005; Beuter et al., 2014), essential tremor (Koller et al., 1999; Rehncrona et al., 2003; Flora et al., 2010), chronic pain (Marchand et al., 2003; Owen et al., 2006; Boccard et al., 2015), and dystonia (Vidailhet et al., 2005, 2013). Although the therapeutic effects of DBS for symptomatic relief in Parkinson's is well appreciated, the inherent mechanisms are still not well understood.
The standard protocol in DBS is to follow a trial and error technique, whereby a given set of stimulation parameters are tested on-the-fly by the neurosurgeon during surgery (Volkmann et al., 2002). For instance, in the case of a patient with essential tremor, the feedback signal is to observe the amplitude of the tremor while the stimulation is on (Volkmann et al., 2002). Although numerous simulations have been performed in modeling the effect of stimulation on the surrounding neural tissue (Yousif et al., 2010, 2012; Golden et al., 2013), one cannot be sure of the nature of excitation or inhibition that is being introduced in the local neural network for a given therapeutic outcome in vivo. There are two potential feedback loops within DBS; electrical activity of the neural network, and neurochemical activity. In the former category, there are studies that are advancing the technology to a closed-loop system (Priori et al., 2013; Rosa et al., 2015), whereby the electrical activity of the surrounding population of neurons is used as a feedback signal. However, as this method relies on detecting electrical signals from surrounding neurons, it is highly susceptible to significant stimulation artifacts from the proximal stimulation electrode.
In comparison, a neurochemical feedback system measuring ions and neurotransmitters, has potential to gain a more nuanced picture of the effect of DBS, on the surrounding neural tissue. Indeed, efforts are being made in this endeavor, primarily in the development of the WINCS system (Chang et al., 2013; Grahn et al., 2014), a single channel, wireless, neurochemical feedback system for DBS. This technology has been advanced to a multichannel feedback loop in WINCS Harmoni (Lee et al., 2017), which has so far proven effective in rodents and swine.
Hence, this review is focused on describing the building blocks for a neurochemical closed-loop system. It describes briefly, the different neurochemical biomarkers that could be used in different neurological diseases and the sensing methodologies that have been used for these neurochemicals. It primarily focuses on processing algorithms for decision making and dose-tuning.
In this paper, section 2 describes various neurochemical biomarkers and respective optimal recording/stimulation loci for different neurological disorders. Section 3 describes different sensing methodologies that can be used to monitor various neurochemical biomarkers. The different steps required to implement an intelligent, implantable neuromodulation system are described in section 4. Discussion and Conclusions related to the above mentioned topics are presented in sections 5 and 6, respectively.
2. Neurochemical Biomarkers
Both ions, such as Na+, K+, Ca2+, Cl− and, neurotransmitters can be used as biomarkers for various neurological disorders (Figure 1). This section describes activity dependent ion and neurotransmitter dynamics under various neurological disorders, which can be used as potential disease biomarkers for use in intelligent neuromodulation systems. The biomarkers listed in Table 1 were selected based on the following criteria, (a) a direct correlation between the biomarker and the clinical symptoms of the neurological disease has been observed, (b) the biomarker also reflects the effect of stimulation and hence can indicate the state of neurological disease after neural stimulation.
Figure 1. (A) A typical neuron shows ionic and neurotransmitter transients induced due to neural activity. (B) The action potential propagation across the axon leads to ionic transients. The activation of the Na+/ATPase and Ca2+/ATPase leads to extracellular acidification and extracellular alkalinization, respectively. (C) Neurotransmitters are released into the synaptic cleft during propagation of neural response across neurons. (D) The two classes of neurochemicals i.e., neurotransmitters and ions can be detected using electrochemical methods such as voltammetry and potentiometry, respectively.
2.1. Ions
The brain is surrounded by extracellular fluid known as the cerebrospinal fluid (CSF), which nourishes the neural tissues with nutrients and performs waste removal. It is mainly composed of water, protein, glucose and ions such as Na+, K+ etc. A recent review has highlighted covered changes in ion dynamics during onset and duration of seizures (Raimondo et al., 2015). In addition to Na+/K+, changes in pH have also been detected in glial cells, astrocytes, the cerebellum and the retina in relation to neural activity and also due to electrical stimulation (Makani and Chesler, 2010).
Neurochemical studies in peripheral nerves are very rare, or are at a preliminary stage. They are primarily directed toward detection of ions only. This is because the PNS is composed primarily of axons with cell bodies elsewhere. The earliest known in vitro studies demonstrate the presence of extracellular pH change in unmylineated nerve fibers only (Bostock and Grafe, 1985; Bostock et al., 1998). The reported pH changes were in response to electrical stimulation. However, no such work was carried out in vivo and in response to physiological stimulation, such as the release of a specific hormone. Recently, we demonstrated in vivo, the presence of extracellular pH changes in response to intravenous injection of gut hormone cholecystokinin-8 (CCK) (Cork et al., 2018).
2.2. Neurotransmitters
Another viable class of neurochemical biomarkers are neurotransmitters. The following section will examine the neurotransmitters dopamine, serotonin, acetylcholine, and glutamate, each in brief, with respect to their links with neurological disorders.
2.2.1. Dopamine
Within the central nervous system (CNS), the dopaminergic system plays a key role in multiple functionalities including, working memory (Bubser and Schmidt, 1990; Sawaguchi et al., 1990; Sawaguchi and Goldman-Rakic, 1994; Zahrt et al., 1997, reward (Koob, 1992), and locomotion (Whishaw and Dunnett, 1985). The malfunction of this system is linked to a number of neurological disorders including Parkinson's Disease (Lotharius and Brundin, 2002), schizophrenia (Winterer and Weinberger, 2004; Brisch et al., 2014), and addiction (Koob, 1992; Volkow et al., 2006).
In Parkinsonian patients, the substantia pars compacta (SPc) experiences a substantial loss of dopaminergic neurons, which in turn, affects dopamine levels throughout brain regions that receive projections from this area (Lotharius and Brundin, 2002). Dopamine is also used as a reward signal in the brain (Ikemoto, 2007). This system is amplified in amphetamine and cocaine addiction. These substances block dopamine re-uptake and increase dopamine turnover. Furthermore, amphetamine has been shown to directly increase the release of dopamine (Groppetti et al., 1973). There has also been evidence for the role of the dopaminergic system in the stress response. During stress, there is a strong increase in dopaminergic activity (Pani et al., 2000; Lodge and Grace, 2011). Interestingly, a combination of evidence from the above neurological disorders shows a link between dopamine and gastric ulcers (Rasheed and Alghasham, 2012), possibly indicating a link between neurological conditions and the gut, through the gut brain axis. In incidences whereby dopaminergic activity is increased, such as schizophrenia, the incidence of gastric ulcers is significantly lower (Ozdemir et al., 2007).
2.2.2. Serotonin
Serotonin has a modulatory effect across numerous biophysical functions such as arousal (Trulson and Jacobs, 1979), stress (Carhart-Harris and Nutt, 2017), aggressiveness (Lucki, 1998). The malfunction of the serotonergic system has been linked to neurological disorders such as frontotemporal dementia (Huey et al., 2006), epilepsy (Theodore, 2003), multiple sclerosis (Davidson et al., 1977), amyotrophic lateral sclerosis (Sandyk, 2006), depression Manji et al., 2001), and migraines (Kowalska et al., 2016). These disorders are typically characterized by a decreased serotonin level. Interestingly, in cases of depression, the therapeutic effects of increasing the level of serotonin, through administration of serotonin re-uptake inhibitors (SRIs), are often only seen after chronic administration for weeks. This would indicate, that it is in fact, the downstream effects of increased serotonin that produce the therapeutic effect (Manji et al., 2001). There have also been links found between decreased serotonin levels and the pathogenesis of fronto-temporal dementia (Huey et al., 2006).
2.2.3. Glutamate
Glutamate is a key neurotransmitter in the basal ganglia motor circuit and as such, it has been linked with neurological disorders associated with the malfunction of elements of the basal ganglia, such as Parkinson's Disease. Indeed, the administration of glutamatergic receptor antagonists have shown promising results in the treatment of Parkinson's Disease in animal models (Breysse et al., 2002, 2003; Ossowska et al., 2005). The therapeutic effect is thought to be due to two mechanisms; (i) the improvement of adverse motor symptoms of Parkinson's Disease through the direct effect on glutamatergic receptors in the basal ganglia, and (ii) the inhibition of glutamatergic transmission is thought to have a protective effect against neurodegeneration, which may slow down the loss of dopaminergic neurons in the substantia pars compacta (Johnson et al., 2009).
2.2.4. Acetylcholine
The cholinergic system has a key role in the modulation of inflammation in the body. As such, neurological disorders that exhibit inflammation such as multiple sclerosis (Mahad et al., 2015) and Alzheimer's Disease (AD) (Eikelenboom et al., 2000), are thought to be linked to abnormalities in the function of the cholinergic system. In post-mortem analysis of patients with Alzheimer's Disease, there is a clear loss of cholinergic neurons (Mufson et al., 2007), and a significant reduction in cholinergic enzymes, choline acetyltransferase (ChAT) and acetyl-cholinesterase (AChE) (DeKosky et al., 1992). Moreover, much of the cognitive decline that is seen in patients with AD has been attributed to the loss of cholinergic function across the CNS (Mufson et al., 2008).
3. Neurochemical Sensors
Neurochemical sensing methods employ primarily bio-electrochemical sensors which are easy to miniaturize and provide label free detection. The underlying chemical reaction involves a redox reaction at the electrode-electrolyte interface (EEI) or through impedance spectroscopy. If a redox reaction is involved, the redox current absorbed by the electrode provides a transduction pathway for the detection and measurement of various analytes. In sensors involving impedance spectroscopy, it involves adhesion or encapsulation of the target biomarker to the surface is needed, resulting in a change in impedance at the EEI.
Traditional chemical detection methods such as microdialysis have more specificity but are less feasible to implant and offer less temporal and spatial resolution (Rodeberg et al., 2017). The Carbon Fiber Microelectrodes (CFM), invented by Gonon et al. (1980), have been widely used in in vivo electrochemical recording and are also twenty times smaller than microdialysis probes. This results in less damage to the nervous system when CFM electrodes are inserted (Peters et al., 2004). Due to smaller electrode size, electrochemical techniques are able to offer higher temporal and spatial resolution. Additionally, smaller electrode size also leads to reduced signal distortion due to diffusion when dynamic events are being recorded (Wightman et al., 1988). For instance, it has been demonstrated that it is possible to detect non-evoked dopamine activity associated with electrical neural activity of dopaminergic fibrs (Robinson and Wightman, 2004). This was previously impossible to detect using microdialysis due to diffusion related loss of temporal resolution across the dialysis membrane (Michael and Borland, 2006). Recently, for smaller dimension neural tissue such as nerves, small dimension Iridium-Iridium Oxide (Ir/IrOx) electrodes have been used to perform potentiometric measurements for pH (Cork et al., 2018).
Hence, electrochemical detection of neurochemicals has the advantages of being a microscale, implantable electrode with high spatial and temporal resolution. The trade-off is low biomarker specificity compared to microdialysis techniques. Also, continuous in vivo recording is generally accompanied by drift and background activity which needs to be separated in order to extract the signal of interest.
It is important to note that electrochemical techniques are only able to measure change with respect to an unknown baseline. This is a common drawback in all electrochemical methods, as in a static environment, it is difficult to differentiate the contribution due to charging and faradaic currents. Next generation techniques are aiming to measure the basal dopamine level as highlighted in a recent review (Bucher and Wightman, 2015).
In this section, we review different electrochemical methods employed in measuring neurochemicals, shown in Figure 2, i.e., amperometry, cyclic voltammetry (CV), electrical impedance spectroscopy (EIS) and potentiometry. Amperometry and CV require three electrodes, consisting of a working electrode (WE), reference electrode (RE) and counter electrode (CE). Potentiometry requires two electrodes consisting only of WE and RE. EIS can be performed using two or more electrodes. The analog front-end circuits required to acquire electrochemical signals have been described in a recent review (Li et al., 2017).
Figure 2. Different electrochemical methods (A) Amperometry: where a constant potential difference is applied between the working electrode (WE) and reference electrode (RE). The current between the WE and counter electrode (CE) is monitored as is an indication of the analyte concentration as the reaction progresses. (B) Cyclic Voltammetry: The potential difference between the WE, RE is changed periodically and the current between WE and CE is monitored. (C) Impedance Spectroscopy: Based on the modality, the impedance of an analyte is measured based on voltage applied between WE, RE and the current through CE. (D) Potentiometry: The potential difference between WE and RE is measured without applying any external potential difference.
3.1. Voltammetry
Voltammetric detection involves the measurement of redox current when a varying cyclic or periodic potential is applied between the WE and RE. The applied potential should be enough to trigger the redox reaction. The current between the RE and CE is proportional to the number of electrolysed molecules, which in turn is indicative of concentration.
3.1.1. Fast Scan Cyclic Voltammetry
In Fast Scan Cyclic Voltammetry (FSCV), a variable voltage, typically having a triangular waveform profile, is applied between the working and reference electrode. The voltage range and scan rate is dependant on the analyte of interest. For example, the parameters used for dopamine are −0.4V to +1.3V at a scan rate of 400 V/s, with a frequency of 10 Hz. The FSCV parameters used for detection of various neurochemicals are listed in Table 2.
Table 2. FSCV parameters for detecting various neurochemicals, performed usually at a frequency of 10 Hz.
The fast voltage scan leads to charging of the double layer capacitive-resistive interface at the electrode surface. This leads to large background current which needs to be subtracted in order to resolve the current generated due to the dopamine redox reaction. The cyclic voltammogram profile is unique to each neurotransmitter and the neurotransmitter concentration can be resolved based on current peaks and calibration factors obtained during the standardization process. Calibration could be done using a flow injection system for various analytes such as dompamine pre and post experiment (Venton et al., 2003), to calculate electrode sensitivity. In addition to peak current, other features/parameters that can be used to distinguish voltammograms from different analytes, are rise time and half decay time.
CFM can be pre-treated so that oxidation currents can be resolved at different points under the potential axis. The selectivity of these electrodes can be further improved with the help of a polymer coating called Nafion, which is a sulfonated derivative of teflon (Gerhardt et al., 1984). Fixed anionic sites present in the Nafion membrane help in preventing anionic substances such as urate, ascorbate and acidic metabolites of monoamine neurotransmitters, from reaching the electrode surface and producing interference. This feature also reduces biofouling of the electrode (Turner et al., 1991).
3.1.2. High Speed Chronoamperometry
In chronoamperometry, the WE is held at a constant potential where no reaction is happening and the potential is stepped up to a different potential. This results in the initiation of an electrochemical reaction, upon which the current due to the reaction is measured. There are a variety of pulsed voltage techniques to detect neurotransmitter activity, some of which have been used to study kinetics and clearance mechanisms of serotonin (Daws et al., 2005), and dopamine (Gerhardt and Hoffman, 2001).
3.1.3. Amperometry
In amperometry, the potential of the working electrode is held constant and the current due to the reaction is measured temporally. Amperometry is best suited for conditions where there is a high level of confidence regarding the identity of the analyte being detected (Michael and Borland, 2006). For this reason, it is also used with enzyme-modified electrodes to detect specific non-electroactive species such as glutamate (Kiyatkin et al., 2013), acetylcholine (Sarter et al., 2009) and choline. For nonelectroactive neurotransmitter detection, oxidase enzymes are immobilized on the electrode surface, which, in the presence of target neurochemical, eventually lead to production of an electroactive species. For example, detection of glutamate is performed with glutamate oxidase, where, glutamate is converted to α-ketoglutarate and hydrogen peroxide (H2O2) (Kiyatkin et al., 2013; Bucher and Wightman, 2015).
3.2. Potentiometry
Potentiometry is the measurement of the potential of a solution with the help of two different electrodes, the working electrode which detects the change in chemical reaction and a reference electrode whose potential is known in reference to a standard electrode, such as the Standard Hydrogen Electrode (SHE). In general, the measurement of pH or metal ions can be done using potentiometric methods. The standard, portable pH measurement electrode is the glass electrode.
Previous work in neurochemistry, involving the measurement of pH or ions, was performed using glass electrodes in vitro (Endres et al., 1986; Chesler and Kaila, 1992; Makani and Chesler, 2010). However, for in vivo measurements, especially in measuring ionic concentrations in PNS, characteristics such as invasiveness, robustness, small form factor, high sensitivity and resolution are needed. Metal-Metal oxide surfaces such as Iridium oxide (IrOx) can be used to measure pH (Ng and O'Hare, 2015). It can also be fashioned into microelectrodes or microwire electrode and can be used to measure extracellular ionic concentrations in vivo in the peripheral nervous system (PNS), such as the vagus nerve (Cork et al., 2018).
3.3. Impedance Spectroscopy
Recent work has also shown the potential of using Impedance spectroscopy as a means to detect ionic concentration in the CNS (Machado et al., 2016; De La Franier et al., 2017). A gold substrate is coated with anti-biofouling material to prevent the accumulation of blood or cells. On top of the anti-biofouling layer, 18-6-crown-ether and monoethyleneglycolthiol (MEG-SH) in a 1:10 ratio, respectively, is placed to capture potassium ions (Machado et al., 2016). Another methodology consists of using an oxide layer. This oxide layer is coated with a layer of anti-biofouling material, 3-(3-(trichlorosilyl)propoxy)propanoyl chloride (MEG- Cl). A common issue present in both works is interference from ionic species with similar size such as sodium (Na+).
4. Closed-Loop: Signal Preprocessing, Decision Making, and Stimulation Dose Selection
The goal of closed-loop neuromodulation is to determine when? and how much? to stimulate, on the basis of information received directly or indirectly from the neuromodulatory target. Closed-loop neuromodulation can be performed for prosthetic or therapeutic neurological conditions. This review primarily focusses on therapeutic applications, with a focus on using neurochemicals as target biomarkers.
In this Section, different steps involved in implementing a neurochemical based closed-loop neuromodulation system are presented. The first step described is signal pre-processing which is useful in removing baseline drift and identifying symptomatic neurochemical change. This is followed by steps to determine the relationship between symptoms and neurochemical change performed by training set construction and cross validation. It will help the system determine when to initiate stimulation. The final step is determining the relationship between electrical stimulation and neurochemical change i.e., stimulation model selection. This will help the system to determine how much to stimulate.
Based on functionality and type of control feedback, neuromodulation systems can broadly be divided into five types : continuous, scheduled intermittent, responsive, adaptive and complete closed-loop, as classified in a recent review by Hoang et al. (2017). Continuous neuromodulation is an open-loop neuromodulation system, where the stimulation dose is delivered continuously. Adjustments to stimulation dosage is performed by clinicians or care-providers. The feedback in this case are external physiological symptoms and stimulation decisions are made by clinicians. Scheduled Intermittent neuromodulation is also a type of open-loop where the stimulation is intermittent and no feedback symptom is monitored over time. The stimulations dosage frequency and other parameters such as amplitude, pulsewidth (PW), waveform and frequency are pre-set based on empirical evidence from clinical trials. Responsive neuromodulation is a form of partial closed-loop neuromodulation system where the stimulation is initiated automatically based on a physiological biomarker threshold. The stimulation dosage are still pre-set and not tuned in real time. Adaptive stimulation is also a form of closed-loop neuromodulation where a single biomarker is monitored. Thresholds and scales on the biomarker are used to determine when and how much to stimulate. Complete closed-loop system consists of monitoring multiple biomarkers answer when and how much to stimulate.
Both decision making and stimulation dose selection algorithms have to undergo a training phase to enable autonomous operation. The training phase can be conducted on in vivo data (Behrend et al., 2009; Trevathan et al., 2015; Bozorgzadeh et al., 2016; Mirza et al., 2019), by recording the neurochemical response to different stimulation parameters. This is followed by cross validation to judge the precision of decision making and stimulation model control algorithms. Prior to in vivo training, bench testing using a flow injection system and target analytes may be performed to test electronics and processing system used for data readout and processing (Bozorgzadeh et al., 2016).
An overview of the different elements in a neurochemical, closed-loop neuromodulation system is shown in Figure 3. As shown in Table 3, there are very limited number of implantable, neurochemical closed-loop systems, as the field is still at a nascent stage. Furthermore, most of the previous work are either responsive or adaptive closed-loop system with only one biomarker under consideration.
Figure 3. A functional block diagram of a typical closed-loop neurochemical neuromodulation system is shown.
4.1. Signal Pre-processing
The chemical signal acquired needs to be pre-processed. Different pre-processing techniques include low pass filtering, downsampling and the removal of drift due to faradaic or background activity. The specifications of different pre-processing elements vary according to the sensing modality and signal characteristics.
4.1.1. Filtering and Downsampling
Chemical signals are low pass filtered to remove high frequency noise. In FSCV recordings for dopamine, the low pass cut-off is typically set at approximately 100 Hz (Grahn et al., 2014), 1 kHz (Lee et al., 2017), 4 kHz (Bozorgzadeh et al., 2014). In our experiments, where we record pH changes in the sub-diaphragmatic vagus nerve, the pH change induced by CCK (potentiometric measurements) takes about 1–2 min to return to baseline (Figure 4). Hence, in this case, a low pass filter with a -3dB cut-off frequency of 0.1 Hz is enough to remove any high frequency interference including any line interference (50Hz/60Hz). In order to maintain high resolution, some solutions implement sigma-delta (ΣΔ) analog to digital converters (ADC) (Bozorgzadeh et al., 2016; Lee et al., 2017). This results in oversampling of data which is further sampled down using Cascaded Integrator-Comb (CIC) filter as in Bozorgzadeh et al. (2016), to reduce data throughput.
Figure 4. (Top) The potentiometric pH data recorded using IrOx electrodes, in vivo, in the subdiaphragmatic vagus nerve of male Wistar rats. The changes due to CCK are highlighted. (Middle) The recorded potentiometric waveform is pre-processed to remove drift using the technique described in Ahmed et al. (2018). (Bottom) The ΔpH is determined using the sensitivity of the IrOx pH electrodes, followed by simple linear regression to determine CCK-induced change in neural pH (Cork et al., 2018). This is a demonstration of responsive type of intelligent neuromodulation.
4.1.2. Background Subtraction and Drift Removal
The current recorded whilst recording FSCV to sense neurotransmitters, is a combination of faradaic and background current. Similarly, during potentiometric recording, there is interference from background potentiometric changes and also a consistent, sometimes unidirectional drift, due to changes in Open Circuit Potential (OCP) of the potentiometric electrode. Hence, it is essential to remove large changes in background signal, before performing dimensionality reduction or pattern recognition, to identify signatures related to the neural activity being monitored.
A common technique in FSCV drift reduction is the subtraction of recorded current with a short recorded window of the previous current. This is possible because it has been observed during in vivo recordings, that FSCV current signatures due to dopamine transients occur in the range of 2–3 ms. Secondly, it has been observed that background current is typically stable over few seconds (Bozorgzadeh et al., 2016). Hence, the background current can be recorded, averaged over few scans (two or four scans) and then subtracted to remove any background activity as described in Bozorgzadeh et al. (2014) and Bozorgzadeh et al. (2016). Other solutions such as the WINCS Harmoni platform also implement background subtraction (Lee et al., 2017). For pre-processing of CCK induced pH changes, a resource efficient architecture was recently described, where the recorded data is down-sampled and slow, non-linear drift was removed in real-time (Ahmed et al., 2018).
4.2. Dimensionality Reduction
Data collected during neurochemical recordings are highly complex with multiple variables affecting readings, hence a multivariate dimensionality reduction technique needs to be utilized in order to ensure accurate analysis of the data and for detection of target neurochemical signature. Principal Component Analysis (PCA) has been widely used as a preferred technique for dimensionality reduction in a number of neurochemical FSCV applications (Keithley et al., 2010). PCA combined with inverse-least squares regression, known as Principal Component Regression (PCR), is used to make predictions regarding the concentration of target neurochemical analyte (Heien et al., 2004, 2005; Keithley et al., 2005, 2010; Keithley and Wightman, 2011; Bucher et al., 2013; Bozorgzadeh et al., 2016). PCA is a mathematical technique which, from a dataset of possibly correlated variables, identifies a set of vectors which are linearly uncorrelated (mutually orthogonal), called “principal components” (PCs). The application of PCA to chemometrics involves a four step procedure: (a) signal identification (b) training set construction, (c) generation and selection of relevant PCs, (d) cross validation of PCs.
4.2.1. Signal Identification
Signal identification consists of determining the signal characteristics which are directly correlated to changes in the target neurochemical analyte. The steps involved in signal identification may consist of in vivo experiments, followed by signal processing and statistical steps such as ANOVA to ensure reproducibility (Keithley et al., 2005; Cork et al., 2018). After identification of the neurochemical response, it is crucial to model the relationship between (a) the neurochemical response and physiological symptom under study, (b) the relationship between the electrical stimulation and the neurochemical response to it. This is achieved through a combination of mathematical modeling and machine learning techniques described later in this section.
4.2.2. Training Set Construction
The training matrix is generated by combining the temporal signatures of changes in target analyte that were observed electrochemically. For multivariate classification, background changes due to electrode drift or changes in interferring neurochemicals are also considered (Bozorgzadeh et al., 2016).
In Figure 5, where the interferents are not known, the pre-injection and post injection waveforms could be used as two types of background signal, in addition to the response to generate a training matrix (Mirza et al., 2017).
Figure 5. The training matrix can be constructed for as shown, for CCK induced pH changes in the vagus nerve (Mirza et al., 2017).
4.2.3. Generation and Selection of Relevant PCs
The PCs are generated using Single Value Decomposition (SVD) (Equation 1). The commands listed in MATLAB are listed below.
A scree plot can be used to determine the variance captured by each PC. The PCs which capture maximum variance are relevant and hence, are retained.
where k is the number of relevant PCs. The decision to retain relevant PCs can be used to generate projections (Aproj) of the training matrix (A) onto the PCs:
where U is the PC matrix, composed of PCs generated from the training matrix. If PCR is used, then a regression matrix based on the dose response nature of the analyte is also generated as shown in Equation (11). After the PC matrix is calculated, the next step is cross validation.
4.2.4. Cross Validation of PCs
Cross validation involves determining the robustness and applicability of the training set. This is required to ensure the PCs are sufficient to perform dimensionality reduction in real time. There are a number of methodologies which can be utilized to cross-validate PCs (Keithley et al., 2005, 2010), one such method being residual analysis, which is described below. The residual of a data set is defined as the difference between actual data and data projected using the PCs. A parameter Qt is defined as the difference in the square value of the actual and projected sample values, ai and ãi, respectively.
where N is the total number of datapoints. ai and are actual and projected data values, respectively, for the ith sample. A significance threshold, Qα, is set so that the residual for each dataset, Qt, does not exceed Qα. For the training set to be considered robust, Qt must be less than Qα for all data in the validation set. When Qt is greater than Qα, for a specific dataset, it indicates that the variance in the input data is not appropriately captured in the training set. It can indicate the data is non-deterministic and can lead to false positives. Qα is calculated using the following formula (Keithley et al., 2010) :
where k + 1 to n is the number of discarded PCs, k is number of retained PCs and n is the total number of PCs generated.
where γ is the sum of the square of the projected datapoints from the training matrix and S is the singular value matrix generated from Equation (1).
where, Qα denotes an upper limit on the random error to be tolerated. In Equation (5), for cα = 1.645 or 2.326 Qt will be greater than Qα if 95% or 99%, respectively, of the dataset are due to random noise. More details are provided in Keithley et al. (2010).
4.3. Decision Making
This step involves determining when to stimulate. The decision when to stimulate could be based on a number of criteria. It could be (a) threshold based: stimulation is initiated when a specific neurochemical signature is detected and the response has reached a specific threshold (Bozorgzadeh et al., 2016) or (b) response based: where only the presence of a response is enough to trigger stimulation (Cork et al., 2018). In order to implement this, various statistical techniques could be utilized. Techniques such as Simple Linear Regression can be used in response based, univariate, decision making. Inverse least square regression in combination with PCA can be used to perform multivariate analyte concentration and a decision regarding when to stimulate can be made, based on the threshold of analyte concentration. In this section, we describe a multi-variate decision making model (Bozorgzadeh et al., 2016).
4.3.1. Simple Linear Regression
As shown in Figure 4, certain characteristics of the recorded neurochemical signal can be extracted and a simple linear regression model can be fitted on it to extract and identify a signature. This is a type of univariate detection method where only one variable is considered to affect the neurochemical signal. This technique was successfully demonstrated to implement a responsive closed-loop neuromodulation technique in an in vivo experimental setup. However, since this technique is a univariate approach, it is sometimes susceptible to false positives, hence it is best to limit this to stable in vivo experimental environment and not to extend it in an implant.
4.3.2. Inverse Least-Squares Regression
In this process, the regression matrix generated is used to estimate the concentration of the analyte. Different concentrations of analyte can result in different amplitude of neurochemical response peaks. Based on a preset threshold for analyte concentration, stimulation can be initiated. This process was first described in Keithley et al. (2005), followed by an implementation on a System-On-Chip (SoC) in Bozorgzadeh et al. (2016).
The regression matrix is based on the dose response to the analyte concentration (Bozorgzadeh et al., 2016). The regression matrix, in combination with the projected data set from PCA, can be used to predict the concentration of the analyte. This is described in the equation below :
where C is the concentration matrix i.e., a diagonal matrix with concentration values of each analyte considered in a multivariate model, Aproj is the projection matrix defined in Equation (3), Du is the real time data, Dproj is the projection of the real time data on the PCs, Uc is defined in Equation (2). F is the projection matrix and CA, CB1, CB2 are the projected concentrations based on inverse least-squares regression.
4.4. Model Selection
The primary goal of model selection is to determine optimal electrical stimulation parameters based on the relationship between stimulation parameters and the target neurochemical biomarker. It is a crucial step toward adaptive or complete closed-loop neuromodulation to determine the stimulation dose. The relationship between stimulation parameters and neurochemical biomarkers is established based on experimental data and mathematical modeling. Various linear (Behrend et al., 2009) and non linear (Grahn et al., 2014; Lee et al., 2017) modeling techniques have been utilized previously to develop stimulation models. The model selection could be different based on whether the neuromodulatory target is located in the CNS or PNS. In this section, we will describe briefly, one linear and two non-linear stimulation models.
4.4.1. CNS: Stimulation Evoked Release and Uptake of Neurotransmitters
DBS of specific areas in the brain is considered an effective therapy for the treatment of Parkinson's disease. For CNS disorders, the neurochemical biomarkers generally under consideration are dopamine, serotonin (Grahn et al., 2014; Lee et al., 2017) and glutamate (Behrend et al., 2009). In closed-loop DBS, the goal is to maintain a specific concentration of neurotransmitters (Lee et al., 2017). Several publications demonstrate possible techniques for choosing appropriate stimulation parameters (Wu et al., 2001; Behrend et al., 2009; Grahn et al., 2014; Walters et al., 2014; Lee et al., 2017). Behrend et al. (2009) use model equations, whereas Artificial Neural Network (ANN) is used in Lee et al. (2017) and Grahn et al. (2014). In this paper, we principally describe stimulation model selection based on linear or non-linear modeling techniques described in Behrend et al. (2009), Lee et al. (2017), and Grahn et al. (2014), respectively.
In Behrend et al. (2009), the concentration of glutamate recorded close to the sub-thalamic nucleus (StN) was modeled as a function of electrical stimulation. The parameters of electrical stimulation used in Behrend et al. (2009), were fixed (stimulation current ≈ 100 μA, a stimulation pulsewidth of 1 ms for 100 Hz stimulation frequency and 0.67 ms for 150 Hz stimulation frequency). A second order model equation, based on Auto Regressive eXogenous (ARX) fitting was developed, shown in Equation (12). This was validated using cross correlation between simulated and recorded concentrations of glutamate, for varying stimulation durations in a rat model.
where, y(t) represents the glutamate concentration, u(t) corresponds to the input stimulation parameters and ε(t) corresponds to the stochastic error. For each set of stimulation parameters (i.e., two different sets of stimulation pulsewidth and frequency), the stimulation was switched on randomly to accurately capture the dynamic response of the system (Behrend et al., 2009).
The limitations of the stimulation model included limited visibility into the effects of changing stimulation currents, which is a crucial parameter to consider in DBS. Also, the model will benefit by selecting a wider range of pulsewidths and frequency. Furthermore, in order to further develop the therapy, the effects of stimulation on concentrations of other neurotransmitters such as dopamine and GABA are not modeled. The model itself is univariate, hence it does not consider interference from other neurochemicals with similar oxidation potential. The model also does not take the non-linear nature of neurochemical responses, into consideration. The univariate and linear transfer function, described in this model, needs to be expanded to ensure the model is applicable in a long-term implant.
The stimulation model, described in Behrend et al. (2009), is based on normalized values of glutamate concentration across animals. This was due to large variance in absolute glutamate concentrations across animals and also partly due to the limitation of neurochemical measurement based on electrochemical methods, which are only able to measure the change in analyte concentration only. However, the range of control on a normalized analyte concentration, in this case glutamate, is crucial. In Behrend et al. (2009), results suggest a normalized concentration range between 0.4 and 1.0 were set as control thresholds.
In Lee et al. (2017), the stimulation model was adopted from Trevathan et al. (2015). It is based on modeling dopamine kinetics due to electrical stimulation, using two different frameworks, ANN and time-series approach using Volterra kernels. Volterra kernels are particularly useful to capture the short-term and long-term effect of stimulation parameters (input) on neurochemical responses (output), in non-linear systems. Hence, they are useful in capturing the hysteresis effect i.e., effect of previous electrical stimulation events on present neurochemical responses (Trevathan et al., 2015). On the contrary, ANNs are better suited for compartmental modeling of input/output relationship between stimulation parameters and stimulation-evoked neurochemical release (Walters et al., 2014, 2015). The experimental data was obtained by stimulating the medial forebrain bundle (MFB) in rats and recording neurochemical data (Trevathan et al., 2015). A similar method was also adopted in the striatal and ventrotegmental area / substantia nigra pars compacta (VTA/SNc) of swine and non-human primate (NHP) (Trevathan et al., 2015). The stimulation parameters under consideration were stimulation amplitude (current) and pulsewidth. The stimulation duration was randomly selected to be either 0.5 or 2.0 s, to capture the dynamics of dopamine, while attempting to avoid hysteresis.
In Grahn et al. (2014), a combination of non-linear regression, computational modeling and constrained optimization was used for linking stimulation parameters with stimulation evoked dopamine responses during the experimental phase. The target stimulation electrode was placed in the medial forebrain bundle (MFB), the FSCV recording electrode was placed in the striatum and a reference silver-silver chloride electrode was placed in the contralateral cortex, to record dopamine concentration. The stimulation parameters (current, pulsewidth, frequency) were varied to record evoked dopamine responses. This dataset consisting of the stimulation parameters and their corresponding evoked dopamine responses were modeled as a combination of a 7th degree polynomial and 2nd order exponential mathematical models. The parameters in the model i.e., 8 for polynomial, 4 for exponential, and corresponding stimulation parameters were presented to an ANN. The ANN was a double feedforward ANN with sigmoidal and linear transfer funtions (Lujan and Crago, 2009). Later, in order to demonstrate closed-loop neuromodulation, the stimulation parameters required for sustaining dopamine responses at desired levels were predicted using ANN. Hence, to summarize the build-up of ANN, the inputs consisted of three stimulation parameters (stimulation frequency, pulsewidth and stimulus amplitude/current) and system outputs consisted of 12 model parameters.
The ANN consisted of 150 hidden neurons, the initial weights and biases are based on 10 different initial conditions and 10 corresponding ANNs were trained on 80% of the data (Levenberg-Marquardt algorithm). The remaining 20% of the data were used to simulate ANNs and identify those with the lowest generalization error. Constrained optimization was added to the ANN model to minimize stimulation energy and to eliminate mathematical redundancies. In order to determine the accuracy of the model, the predicted stimulation parameters and the measured dopamine levels evoked due to predictive stimulation was compared with the desired simulation results. The root mean squared error between measured and desired dopamine levels was determined, followed by least-squares regression analysis to determine dependencies between actual and desired dopamine levels were theni used in order to identify sources of error such as drift. Results in Grahn et al. (2014), from four rats, suggest that the computational and predictive models of stimulation-evoked dopamine levels can be adjusted using predicted stimulation parameters (R2 = 0.8).
4.4.2. PNS: Neurochemical Recordings and Stimulation Evoked Compound Nerve Action Potentials (CNAPs)
The goal of stimulation model selection in PNS neuromodulatory therapeutic applications is to either inhibit or enhance nerve fiber activity. Peripheral nerve activity can be classified into (a) neural mass activity, (b) CNAPs and (c) Neurochemical ionic activity. Neurochemical recording can be utilized reliably to detect specific physiological events and initiate stimulation (Cork et al., 2018). However, stimulation dose tuning can be achieved through monitoring electrical activity alone. A method to estimate the properties of individual fibers is through interrogative stimulation and recording. A stimulation protocol and method for high resolution CNAP recording on vagus nerve is described in Mirza et al. (2018).
In Ward et al. (2015), an effort has been made to determine stimulation dosage based on CNAPs. This involves determining a nerve activation profile (NAP) for each fiber type. The nerve activation potential is based on an exponential relation between rheobase current and normalized CNAP amplitude. Stimulation dosage (stimulation current) can be chosen appropriately based on NAPs. The relationships are shown below (Ward et al., 2015) :
where, IRh is the rheobase current. λ = × 100, which represents the percent maximal activation of nerve fibers. The NAP for different fibers are shown in Figure 6.
Figure 6. NAP profiles for different fiber types : A, B, and C based on Ward et al. (2015), the rheobase current (IRh in A) is depicted vs. the percentage fiber activation(λ).
In existing solutions, such as Behrend et al. (2009), Grahn et al. (2014), and Lee et al. (2017), model selection was performed using ANN. Implementation of ANN on-chip or SoCs can be resource and power intensive. To enable on-chip implementation of model selection, it is important to consider simplification of the stimulation control model by balancing the trade-off between complexity of the model and stimulation goals.
Alternatively, a better approach to develop implantable solutions, especially for PNS applications, will be to determine a mathematical model as described in Ward and Irazoqui (2010) and Behrend et al. (2009). Linear or polynomial models can be implemented on-chip and optimized to be resource and power efficient. Another approach will be to design stimulators which can perform selective activation of fibers by modifying the traditional stimulation waveforms (Joseph and Butera, 2011; Patel and Butera, 2015).
5. Discussion
Closed-loop neuromodulation is likely to improve system performance and clinical outcomes. However, the challenges involved in implementing closed-loop neuromodulation consists of identification of appropriate biomarkers, identifying the recording and stimulation loci and the choice of neuromodulatory paradigm i.e., excitation/inhibition of neural activity or regulation of neurotransmitter concentration. A neurochemical monitoring modality for closed-loop neuromodulation is promising, as it provides higher resolution in terms of neural events, better Signal-to-Noise ratio and less interference in comparison to electrical recordings of neural signals.
This review highlights that, neurochemical closed-loop neuromodulation systems benefit from higher specificity and less interference for therapeutic neuromodulation applications. However, there is a clear lack of implantable, closed-loop neurochemical neuromodulation systems that are available commercially. The lack of neurochemical closed-loop neuromodulation is due to various reasons.
One of the limitations of neurochemical monitoring is ensuring direct contact between the neurochemical sensor and neurochemical molecules. For this reason, the sensors need to be inserted into neural tissue and hence have greater susceptibility to bio-fouling. It is a long standing challenge to produce neurochemical sensors whose sensitivity lasts longer in vivo. CFM has been widely used to perform neurochemical voltammetric measurements and has been shown to work reliably up to 4 months after chronic implantation (Clark et al., 2010). Carbon fiber microelectrodes can also be coated with CNTs (Swamy and Venton, 2007), which increases its resistance to the adhesion of common biofouling agents such as 5-HIAA. CNT-based microelectrodes are able to increase selectivity and sensitivity of FSCV measurements at high speeds (Bucher and Wightman, 2015). Especially, polyamide-coated fused silica CFM electrode have been shown to last in vivo for approximately 25 days without any loss in sensitivity, albeit a small loss in temporal resolution (Clark et al., 2010). Efforts to tackle this challenge further include developing anti-biofouling coatings on the sensor (Blaszykowski et al., 2015; Machado et al., 2016). However, the lifetime of in vivo ion-selective electrodes needs to be investigated further.
A very promising line of research has been pursued by Thompson's group at the University of Toronto, who are developing anti-biofouling coatings for in vivo sensor applications (Sheikh et al., 2012, 2015). Furthermore, the same group have developed an anti-biofouling coating for potassium sensors, which will include neuro-chemical recording (Thompson, 2017).
Another important effort in sensor fabrication is directed toward reducing the size of the array while increasing recording locations. This will increase spatial resolution leading to better recording of neurotransmitter concentrations within the extracellular/intracellular environment. In this direction, research is progressing to explore the development of carbon-nanotube (CNTs) or carbon-nanofiber (CNF) based microelectrode array (MEA) which are compatible to be used for neurochemical measurements (Bucher and Wightman, 2015). In order to capture neurotransmitter activity from extracellular or exocytotic neural environment in the brain, the microelectrode array (MEA) pitch needs to be between ~10−20μm to enable interfacing with individual neurons (Kishida et al., 2011). The latest neurochemical MEA consists of 36 microelectrodes within an area of 40 μm × 40 μm (Bucher and Wightman, 2015).
The majority of neurochemical recording in the CNS, reported earlier, is focussed on neurotransmitters. However, the relationship between stimulation parameters and stimulation-induced change in neurochemical concentration, may vary over time. This change could be due to neuro-plasticity or change in electrode-electrolyte interface, leading to re-adjustment of stimulation models on a regular basis, to adjust stimulation dosage accurately.
An important aspect of neurochemical recording is the interference from other neurochemicals. One of the common interferents is pH change, which produces similar profile of voltammograms to dopamine. Hence, it is important to subtract contribution due to pH in order to identify dopamine specific cyclic voltammogram. Another common interferent is ascorbate, which also has similar oxidation potential as dopamine but different voltammogram profile. A multivariate classification model can be used for distinguishing signal contribution due to target neurochemical signals and interferents. Furthermore, electrode design can also be utilized to reduce cross-talk between different neurochemical signals. It was shown that CNF performs better than glass carbon electrode in isolating signal contributions due to different neurotransmitters (Rand et al., 2013). Different neurotransmitters which show similar oxidation potentials using glass carbon electrodes, show different oxidation potentials when CNF is used.
Also, in diseases where there isn't a clear relationship between neurotransmitters and disease symptoms, there may exist a clear relationship between electrical neural signals and symptoms. In such cases, it is better to monitor neural ionic concentrations, such K+, Na+, or H+ which are also directly correlated with electrical neural signals (Makani and Chesler, 2010). This will ensure high specificity biomarker recording. Another fact to note is that the recent work in neurochemical monitoring mostly focusses on healthy animal models (Chang et al., 2012; Lee et al., 2017) and very limited work has been done in humans. Two human studies were performed by Kasasbeh et al. (2013) and Chang et al. (2012), in which no adverse effects to patient health were reported in the short-term. Also, no short-term reduction in DBS treatment efficiency was observed.
In existing neurochemical neuromodulation systems, the training step and in some cases, the entire decision making and model selection algorithm is implemented off-chip. Although, this works for research applications, it restricts patient mobility in a future implantable solution. In order to achieve local or on-chip machine learning capabilities, it is important to reduce complexity of the neuromodulation algorithm without sacrificing stimulation goals. Commercial solutions, such as those from ARM and Qualcomm, are also focussed on developing resource efficient, artificial intelligence on SoC (Desoli et al., 2017; Moons et al., 2017).
Another important aspect of achieving therapeutic efficiency is stimulating at the optimal location. When DBS is used for treating Parkinson's, the stimulation locus is generally the sub-thalamic nucleus/globus palliadus internus (StN/Gpi) (Hitti et al., 2019). For VNS, various locations have been used for different applications such as stimulation of left or right cervical vagus nerve for epilepsy (Boon et al., 2001), subdiaphragmatic vagus nerve for obesity (Ikramuddin et al., 2014), auricular branch of the vagus nerve (Clancy et al., 2014).
The WINCS platform has demonstrated that it is possible to develop an adaptive neuromodulation system based on a single neurochemical biomarker. However, the long term efficacy of a single biomarker based solution needs to be determined. A solution to better understand the success and, ultimately, improve closed-loop neuromodulation therapy is the addition of electrophysiological recording. Recently, an electrode was developed by Vajari et al. (2018), which incorporates the ability to record both neurochemical, neuro-electrical recording and electrical stimulation. This is a desirable addition for CNS based therapy, but is necessary for complete closed-loop in a PNS based closed-loop neuromodulation system (Mirza et al., 2017, 2019).
6. Conclusion
This review is focused on highlighting the benefits and challenges of using a neurochemical biomarker for intelligent neuromodulation. It has also outlined the different elements required to implement neurochemical closed-loop neuromdoulation as an implantable solution. The first step toward developing an intelligent neuromodulation system is identifying an appropriate biomarker, such as a neurochemical biomarker and a corresponding stimulation/recording site. The second step is to develop a reliable sensing methodology, sensor and data acquisition system. The third challenge is to implement the pre-processing and intelligent neuromodulation algorithms on-chip or locally in a single integrated SoC.
For CNS based applications, where neurotransmitters are the target biomarkers, FSCV is often chosen as a reliable detection technique and CFM is the preferred electrode for this application. Emerging techniques include impedimetery and potentiometry for detection of ionic concentrations, in both CNS and PNS. For potentiometric sensing, IrOx sensors can be used reliably for sensing pH. The sensitivity, selectivity and longevity of the sensors described in this paper can be improved through coatings such as, Nafion-CNT.
There are primarily two technical challenges that need to be addressed in order develop a neurochemical closed-loop system for long-term, chronic therapeutic efficacy studies. The first is development of an implantable chemical sensor, with a reliable sensitivity and resolution in the long term. The second challenge is implementing processing algorithms on-chip for stimulation decision making (when? to stimulate) and stimulation model selection (how much? to stimulate).
Author Contributions
KM and CG wrote the manuscript. KN and CT supervised and reviewed the manuscript.
Funding
This work was supported by the European Research Council (Synergy Grant No. 319818, i2MOVE), UK EPSRC grant EP/N002474/1, and EPSRC-Imperial Impact Acceleration Award (2018).
Conflict of Interest Statement
CT holds a patent on chemical monitoring of the vagus nerve (US9055875 B2).
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Ahmed, T., Mirza, K. B., and Nikolic, K. (2018). “Resource efficient pre-processor for drift removal in neurochemical signals,” in Circuits and Systems (ISCAS), 2018 IEEE International Symposium on (Florence: IEEE), 1–5.
Amar, A. P., Levy, M. L., Liu, C. Y., and Apuzzo, M. L. J. (2008). Vagus nerve stimulation. Proc. IEEE 96, 1142–1151.
Behrend, C. E., Cassim, S. M., Pallone, M. J., Daubenspeck, J. A., Hartov, A., Roberts, D. W., et al. (2009). Toward feedback controlled deep brain stimulation: dynamics of glutamate release in the subthalamic nucleus in rats. J. Neurosci. Methods 180, 278–289. doi: 10.1016/j.jneumeth.2009.04.001
Benabid, A. L., Chabardes, S., Mitrofanis, J., and Pollak, P. (2009). Deep brain stimulation of the subthalamic nucleus for the treatment of parkinson's disease. Lancet Neurol. 8, 67–81. doi: 10.1016/S1474-4422(08)70291-6
Beuter, A., Lefaucheur, J. P., and Modolo, J. (2014). Closed-loop cortical neuromodulation in Parkinson's disease: an alternative to deep brain stimulation? Clin. Neurophysiol. 125, 874–885. doi: 10.1016/j.clinph.2014.01.006
Bittar, R. G., Burn, S. C., Bain, P. G., Owen, S. L., Joint, C., Shlugman, D., et al. (2005). Deep brain stimulation for movement disorders and pain. J. Clin. Neurosci. 12, 457–463. doi: 10.1016/j.jocn.2004.10.005
Blaszykowski, C., Sheikh, S., and Thompson, M. (2015). A survey of state-of-the-art surface chemistries to minimize fouling from human and animal biofluids. Biomater. Sci. 3, 1335–1370. doi: 10.1039/c5bm00085h
Boccard, S. G., Pereira, E. A., and Aziz, T. Z. (2015). Deep brain stimulation for chronic pain. J. Clin. Neurosci. 22, 1537–1543. doi: 10.1016/j.jocn.2015.04.005
Bonaz, B., Sinniger, V., Hoffmann, D., Clarençon, D., Mathieu, N., Dantzer, C., et al. (2016). Chronic vagus nerve stimulation in crohn's disease: a 6-month follow-up pilot study. Neurogastroenterol. Motil. 28, 948–953. doi: 10.1111/nmo.12792
Boon, P., Vonck, K., Reuck, J. D., and Caemaert, J. (2001). Vagus nerve stimulation for refractory epilepsy. Seizure 10, 448–455. doi: 10.1053/seiz.2001.0626
Borovikova, L. V., Ivanova, S., Zhang, M., Yang, H., Botchkina, G. I., Watkins, L. R., et al. (2000). Vagus nerve stimulation attenuates the systemic inflammatory response to endotoxin. Nature 405, 458–462. doi: 10.1038/35013070
Bostock, H., Cikurel, K., and Burke, D. (1998). Threshold tracking techniques in the study of human peripheral nerve. Muscle Nerve 21, 137–158.
Bostock, H., and Grafe, P. (1985). Activity-dependent excitability changes in normal and demyelinated rat spinal root axons. J. Physiol. 365, 239–257.
Bozorgzadeh, B., Covey, D. P., Heidenreich, B. A., Garris, P. A., and Mohseni, P. (2014). “Real-time processing of fast-scan cyclic voltammetry (FSCV) data using a field-programmable gate array (FPGA),” in Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEEMBC) (Chicago, IL: IEEE Engineering in Medicine and Biology Society), 2036–2039.
Bozorgzadeh, B., Schuweiler, D. R., Bobak, M. J., Garris, P. A., and Mohseni, P. (2016). Neurochemostat: a neural interface SoC with integrated chemometrics for closed-loop regulation of brain dopamine. IEEE Trans. Biomed. Circuits Syst. 10, 654–667. doi: 10.1109/TBCAS.2015.2453791
Breysse, N., Amalric, M., and Salin, P. (2003). Metabotropic glutamate 5 receptor blockade alleviates akinesia by normalizing activity of selective basal-ganglia structures in parkinsonian rats. J. Neurosci. 23, 8302–8309. doi: 10.1523/JNEUROSCI.23-23-08302.2003
Breysse, N., Baunez, C., Spooren, W., Gasparini, F., and Amalric, M. (2002). Chronic but not acute treatment with a metabotropic glutamate 5 receptor antagonist reverses the akinetic deficits in a rat model of parkinsonism. J. Neurosci. 22, 5669–5678. doi: 10.1523/JNEUROSCI.22-13-05669.2002
Brisch, R., Saniotis, A., Wolf, R., Bielau, H., Bernstein, H.-G., Steiner, J., et al. (2014). Corrigendum: the role of dopamine in schizophrenia from a neurobiological and evolutionary perspective: old fashioned, but still in vogue. Front. Psychiatry 5:110. doi: 10.3389/fpsyt.2014.00110
Bubser, M., and Schmidt, W. J. (1990). 6-hydroxydopamine lesion of the rat prefrontal cortex increases locomotor activity, impairs acquisition of delayed alternation tasks, but does not affect uninterrupted tasks in the radial maze. Behav. Brain Res. 37, 157–168.
Bucher, E. S., Brooks, K., Verber, M. D., Keithley, R. B., Owesson-White, C., Carroll, S., et al. (2013). Flexible software platform for fast-scan cyclic voltammetry data acquisition and analysis. Anal. Chem. 85, 10344–10353. doi: 10.1021/ac402263x
Bucher, E. S., and Wightman, R. M. (2015). Electrochemical analysis of neurotransmitters. Annu. Rev. Anal. Chem. 8, 239–261. doi: 10.1146/annurev-anchem-071114-040426
Carhart-Harris, R. L., and Nutt, D. J. (2017). Serotonin and brain function: a tale of two receptors. J. Psychopharmacol. 31, 1091–1120. doi: 10.1177/0269881117725915
Chang, S.-Y., Kim, I., Marsh, M. P., Jang, D. P., Hwang, S.-C., Van Gompel, J. J., et al. (2012). Wireless fast-scan cyclic voltammetry to monitor adenosine in patients with essential tremor during deep brain stimulation. Mayo Clin. Proc. 87, 760–765. doi: 10.1016/j.mayocp.2012.05.006
Chang, S.-Y., Kimble, C. J., Kim, I., Paek, S. B., Kressin, K. R., Boesche, J. B., et al. (2013). Development of the mayo investigational neuromodulation control system: toward a closed-loop electrochemical feedback system for deep brain stimulation. J. Neurosurg. 119, 1556–1565. doi: 10.3171/2013.8.JNS122142
Chesler, M., and Kaila, K. (1992). Modulation of pH by neuronal activity. Trends Neurosci. 15, 396–402.
Clancy, J. A., Mary, D. A., Witte, K. K., Greenwood, J. P., Deuchars, S. A., and Deuchars, J. (2014). Non-invasive vagus nerve stimulation in healthy humans reduces sympathetic nerve activity. Brain Stimul. 7, 871–877. doi: 10.1016/j.brs.2014.07.031
Clark, J. J., Sandberg, S. G., Wanat, M. J., Gan, J. O., Horne, E. A., Hart, A. S., et al. (2010). Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals. Nat. Methods 7, 126–129. doi: 10.1038/nmeth.1412
Cork, S. C., Eftekhar, A., Mirza, K. B., Zuliani, C., Nikolic, K., Gardiner, J. V., et al. (2018). Extracellular pH monitoring for use in closed-loop vagus nerve stimulation. J. Neural Eng. 15:016001. doi: 10.1088/1741-2552/aa8239
Davidson, D., Pullar, I. A., Mawdsley, C., Kinloch, N., and Yates, C. M. (1977). Monoamine metabolites in cerebrospinal fluid in multiple sclerosis. J. Neurol. Neurosurg. Psychiatry 40, 741–745. doi: 10.1136/jnnp.40.8.741
Daws, L. C., Montañez, S., Owens, W. A., Gould, G. G., Frazer, A., Toney, G. M., et al. (2005). Transport mechanisms governing serotonin clearance in vivo revealed by high-speed chronoamperometry. J. Neurosci. Methods 143, 49–62. doi: 10.1016/j.jneumeth.2004.09.011
De La Franier, B., Jankowski, A., and Thompson, M. (2017). Functionalizable self-assembled trichlorosilyl-based monolayer for application in biosensor technology. Appl. Surf. Sci. 414, 435–441. doi: 10.1016/j.apsusc.2017.04.111
DeKosky, S. T., Harbaugh, R. E., Schmitt, F. A., Bakay, R. A., Chui, H. C., Knopman, D. S., et al. (1992). Cortical biopsy in alzheimer's disease: diagnostic accuracy and neurochemical, neuropathological, and cognitive correlations. Ann. Neurol. 32, 625–632. doi: 10.1002/ana.410320505
Desoli, G., Chawla, N., Boesch, T., Singh, S.-p., Guidetti, E., De Ambroggi, F., et al. (2017). “14.1 a 2.9 tops/w deep convolutional neural network soc in fd-soi 28nm for intelligent embedded systems,” in 2017 IEEE International Solid-State Circuits Conference (ISSCC) (San Francisco, CA: IEEE), 238–239.
Ebert, M., Hauptmann, C., and Tass, P. A. (2014). Coordinated reset stimulation in a large-scale model of the stn-gpe circuit. Front. Comput. Neurosci. 8:154. doi: 10.3389/fncom.2014.00154
Eikelenboom, P., Rozemuller, A. J., Hoozemans, J. J., Veerhuis, R., and van Gool, W. A. (2000). Neuroinflammation and alzheimer disease: clinical and therapeutic implications. Alzheimer Dis. Assoc. Disord. 14, S54–S61. doi: 10.1097/00002093-200000001-00009
Endres, W., Grafe, P., Bostock, H., and ten Bruggencate, G. (1986). Changes in extracellular pH during electrical stimulation of isolated rat vagus nerve. Neurosci. Lett. 64, 201–205. doi: 10.1016/0304-3940(86)90100-X
Flora, E. D., Perera, C. L., Cameron, A. L., and Maddern, G. J. (2010). Deep brain stimulation for essential tremor: a systematic review. Mov. Disord. 25, 1550–1559. doi: 10.1002/mds.23195
Gerhardt, G. A., and Hoffman, A. F. (2001). Effects of recording media composition on the responses of nafion-coated carbon fiber microelectrodes measured using high-speed chronoamperometry. J. Neurosci. Methods 109, 13–21. doi: 10.1016/S0165-0270(01)00396-X
Gerhardt, G. A., Oke, A. F., Nagy, G., Moghaddam, B., and Adams, R. N. (1984). Nafion-coated electrodes with high selectivity for cns electrochemistry. Brain Res. 290, 390–395. doi: 10.1016/0006-8993(84)90963-6
Golden, C. T., Nandi, D., Bain, P., and Yousif, N. (2013). Deep brain stimulation induced effects in a network of ventral intermediate neurons. BMC Neurosci. 14:P427. doi: 10.1186/1471-2202-14-S1-P427
Gonon, F., Buda, M., Cespuglio, R., Jouvet, M., and Pujol, J.-F. (1980). In vivo electrochemical detection of catechols in the neostriatum of anaesthetized rats: dopamine or dopac? Nature 286:902. doi: 10.1038/286902a0
Grahn, P. J., Mallory, G. W., Khurram, O. U., Berry, B. M., Hachmann, J. T., Bieber, A. J., et al. (2014). A neurochemical closed-loop controller for deep brain stimulation : toward individualized smart neuromodulation therapies. Front. Neurosci. 8:169. doi: 10.3389/fnins.2014.00169
Groppetti, A., Zambotti, F., Biazzi, A., and Mantegazza, P. (1973). “Amphetamine and cocaine on amine turnover,” in Frontiers in Catecholamine Research (Starsbourg: Elsevier), 917–925.
Heien, M. L. A. V., Johnson, M. A., and Wightman, R. M. (2004). Resolving neurotransmitters detected by fast-scan cyclic voltammetry. Anal. Chem. 76, 5697–5704. doi: 10.1021/ac0491509
Heien, M. L. A. V., Khan, A. S., Ariansen, J. L., Cheer, J. F., Phillips, P. E., Wassum, K. M., et al. (2005). Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats. Proc. Natl. Acad. Sci. U.S.A. 102, 10023–10028. doi: 10.1073/pnas.0504657102
Hesse, S., Moeller, F., Petroff, D., Lobsien, D., Luthardt, J., Regenthal, R. et al. (2014). Altered serotonin transporter availability in patients with multiple sclerosis. Eur. J. Nucl. Med. Mol. Imaging. 41, 827–835. doi: 10.1007/s00259-013-2636-z
Hitti, F. L., Ramayya, A. G., McShane, B. J., Yang, A. I., Vaughan, K. A., and Baltuch, G. H. (2019). Long-term outcomes following deep brain stimulation for parkinson's disease. J. Neurosurg. 1, 1–6. doi: 10.3171/2018.8.JNS182081
Hoang, K. B., Cassar, I. R., Grill, W. M., and Turner, D. A. (2017). Biomarkers and stimulation algorithms for adaptive brain stimulation. Front. Neurosci. 11:564. doi: 10.3389/fnins.2017.00564
Hosokawa, K., and Sunagawa, K. (2016). Closed-loop neuromodulation technology for baroreflex blood pressure control. Proc. IEEE 104, 432–443. doi: 10.1109/JPROC.2015.2496290
Huey, E. D., Putnam, K. T., and Grafman, J. (2006). A systematic review of neurotransmitter deficits and treatments in frontotemporal dementia. Neurology 66, 17–22. doi: 10.1212/01.wnl.0000191304.55196.4d
Ikemoto, S. (2007). Dopamine reward circuitry: two projection systems from the ventral midbrain to the nucleus accumbens–olfactory tubercle complex. Brain Res. Rev. 56, 27–78. doi: 10.1016/j.brainresrev.2007.05.004
Ikramuddin, S., Blackstone, R. P., Brancatisano, A., Toouli, J., Shah, S. N., Wolfe, B. M., et al. (2014). Effect of reversible intermittent intra-abdominal vagal nerve blockade on morbid obesity: the ReCharge randomized clinical trial. JAMA 312, 915–922. doi: 10.1001/jama.2014.10540
John, C. E., and Jones, S. R. (2006). “Fast scan cyclic voltammetry of dopamine and serotonin in mouse brain slices,” in Electrochemical Methods for Neuroscience, eds A. C. Michael and L. M. Borland (Boca Raton, FL: CRC Press/Taylor & Francis). doi: 10.1201/9781420005868
Johnson, K. A., Conn, P. J., and Niswender, C. M. (2009). Glutamate receptors as therapeutic targets for parkinson's disease. CNS Neurol. Disord. Drug Targets) 8, 475–491. doi: 10.2174/187152709789824606
Joseph, L., and Butera, R. J. (2011). High-frequency stimulation selectively blocks different types of fibers in frog sciatic nerve. IEEE Trans. Neural Syst. Rehabil. Eng. 19, 550–557. doi: 10.1109/TNSRE.2011.2163082
Kasasbeh, A., Lee, K., Bieber, A., Bennet, K., and Chang, S.-Y. (2013). Wireless neurochemical monitoring in humans. Stereotact. Funct. Neurosurg. 91, 141–147. doi: 10.1159/000345111
Keithley, R. B., Carrelli, R. M., and Wightman, R. M. (2005). Rank estimation and the multivariate analysis of in vivo fast-scan cyclic voltammetric data. Biophys. Chem. 257, 2432–2437. doi: 10.1016/j.immuni.2010.12.017
Keithley, R. B., Heien, M. L., and Wightman, R. M. (2010). Multivariate concentration determination using principal component regression with residual analysis. Trends Anal. Chem. 28, 1127–1136. doi: 10.1016/j.trac.2009.07.002
Keithley, R. B., and Wightman, R. M. (2011). Assessing principal component regression prediction of neurochemicals detected with fast-scan cyclic voltammetry. ACS Chem. Neurosci. 2, 514–525. doi: 10.1021/cn200035u
Kishida, K. T., Sandberg, S. G., Lohrenz, T., Comair, Y. G., Sáez, I., Phillips, P. E., et al. (2011). Sub-second dopamine detection in human striatum. PLoS ONE 6:e23291. doi: 10.1371/journal.pone.0023291
Kiyatkin, E. A., Wakabayashi, K. T., and Lenoir, M. (2013). Physiological fluctuations in brain temperature as a factor affecting electrochemical evaluations of extracellular glutamate and glucose in behavioral experiments. ACS Chem. Neurosci. 4, 652–665. doi: 10.1021/cn300232m
Koller, W. C., Lyons, K. E., Wilkinson, S. B., and Pahwa, R. (1999). Efficacy of unilateral deep brain stimulation of the vim nucleus of the thalamus for essential head tremor. Mov. Disord. 14, 847–850. doi: 10.1002/1531-8257(199909)14:5<847::AID-MDS1021>3.0.CO;2-G
Koob, G. F. (1992). Dopamine, addiction and reward. Semin. Neurosci. 4, 139–148. doi: 10.1016/1044-5765(92)90012-Q
Kowalska, M., Prendecki, M., Kozubski, W., Lianeri, M., and Dorszewska, J. (2016). Molecular factors in migraine. Oncotarget 7:50708. doi: 10.18632/oncotarget.9367
Krack, P., Batir, A., Van Blercom, N., Chabardes, S., Fraix, V., Ardouin, C., et al. (2003). Five-year follow-up of bilateral stimulation of the subthalamic nucleus in advanced parkinson's disease. N. Engl. J. Med. 349, 1925–1934. doi: 10.1056/NEJMoa035275
Kristoffer, F., Litt, B., Tracey, K. J., Boyden, E. S., and Slaoui, M. (2013). A jump-start for electroceuticals. Nature 496, 159–161. doi: 10.1038/496159a
Landau, A. M., Dyve, S., Jakobsen, S., Alstrup, A. K., Gjedde, A., and Doudet, D. J. (2015). Acute vagal nerve stimulation lowers α2 adrenoceptor availability: possible mechanism of therapeutic action. Brain Stimul. 8, 702–707. doi: 10.1016/j.brs.2015.02.003
Lee, K. H., Lujan, J. L., Trevathan, J. K., Ross, E. K., Bartoletta, J. J., Park, H. O., et al. (2017). WINCS Harmoni: closed-loop dynamic neurochemical control of therapeutic interventions. Sci. Rep. 7:46675. doi: 10.1038/srep46675
Li, H., Liu, X., Li, L., Mu, X., Genov, R., and Mason, A. J. (2017). CMOS electrochemical instrumentation for biosensor microsystems: a review. Sensors 17:E74. doi: 10.3390/s17010074
Li, P., Liu, H., Sun, P., Wang, X., Wang, C., Wang, L., et al. (2016). Chronic vagus nerve stimulation attenuates vascular endothelial impairments and reduces the inflammatory profile via inhibition of the nf-κb signaling pathway in ovariectomized rats. Exp. Gerontol. 74, 43–55. doi: 10.1016/j.exger.2015.12.005
Lodge, D. J., and Grace, A. A. (2011). Developmental pathology, dopamine, stress and schizophrenia. Int. J. Dev. Neurosci. 29, 207–213. doi: 10.1016/j.ijdevneu.2010.08.002
Lotharius, J., and Brundin, P. (2002). Pathogenesis of parkinson's disease: dopamine, vesicles and α-synuclein. Nat. Rev. Neurosci. 3:932. doi: 10.1038/nrn983
Lucki, I. (1998). The spectrum of behaviors influenced by serotonin. Biol. Psychiatry 44, 151–162. doi: 10.1016/S0006-3223(98)00139-5
Lujan, J. L., and Crago, P. E. (2009). Automated optimal coordination of multiple-dof neuromuscular actions in feedforward neuroprostheses. IEEE Trans. Biomed. Eng. 56, 179–187. doi: 10.1109/TBME.2008.2002159
Machado, R., Soltani, N., Dufour, S., Salam, M. T., Carlen, P. L., Genov, R., et al. (2016). Biofouling-resistant impedimetric sensor for array high-resolution extracellular potassium monitoring in the Brain. Biosensors 6, 1–12. doi: 10.3390/bios6040053
Mahad, D. H., Trapp, B. D., and Lassmann, H. (2015). Pathological mechanisms in progressive multiple sclerosis. Lancet Neurol. 14, 183–193. doi: 10.1016/S1474-4422(14)70256-X
Makani, S., and Chesler, M. (2010). Rapid rise of extracellular pH evoked by neural activity is generated by the plasma membrane calcium ATPase. J. Neurophysiol. 103, 667–676. doi: 10.1152/jn.00948.2009
Malinova, T. S., Dijkstra, C. D., de Vries, H. E. (2018). Serotonin: a mediator of the gut-brain axis in multiple sclerosis. Mult. Scler. 24, 1144–1150. doi: 10.1177/1352458517739975
Manji, H. K., Drevets, W. C., and Charney, D. S. (2001). The cellular neurobiology of depression. Nat. Med. 7:541. doi: 10.1038/87865
Marchand, S., Kupers, R. C., Bushnell, M. C., and Duncan, G. H. (2003). Analgesic and placebo effects of thalamic stimulation. Pain 105, 481–488. doi: 10.1016/S0304-3959(03)00265-3
Michael, A. C., and Borland, L. (2006). Electrochemical Methods for Neuroscience. Boca Raton, FL: CRC Press.
Mickle, A. D., Won, S. M., Noh, K. N., Yoon, J., Meacham, K. W., Xue, Y., et al. (2019). A wireless closed-loop system for optogenetic peripheral neuromodulation. Nature 565, 361–365. doi: 10.1038/s41586-018-0823-6
Mirza, K. B., Alenda, A., Eftekhar, A., Grossman, N., Nikolic, K., Bloom, S. R., et al. (2018). Influence of cholecystokinin-8 on compound nerve action potentials from ventral gastric vagus in rats. Int. J. Neural Syst. 28:1850006. doi: 10.1142/S0129065718500065
Mirza, K. B., Kulasekeram, N., Liu, Y., Nikolic, K., and Toumazou, C. (2019). “System on chip for closed loop neuromodulation based on dual mode biosignals,” in 2019 IEEE International Symposium on Circuits and Systems (ISCAS) (Sapporo: IEEE), 1–5.
Mirza, K. B., Wildner, K., Kulasekeram, N., Cork, S. C., Bloom, S. R., Nikolic, K., et al. (2017). “Live demo: platform for closed loop neuromodulation based on dual mode biosignals,” in IEEE 2017 Biomedical Circuits and Systems Conference, BioCAS 2017 - Proceedings (Milan).
Moons, B., Uytterhoeven, R., Dehaene, W., and Verhelst, M. (2017). “14.5 envision: A 0.26-to-10tops/w subword-parallel dynamic-voltage-accuracy-frequency-scalable convolutional neural network processor in 28nm fdsoi,” in 2017 IEEE International Solid-State Circuits Conference (ISSCC) (San Francisco, CA: IEEE), 246–247.
Mufson, E. J., Counts, S. E., Fahnestock, M., and Ginsberg, S. D. (2007). Cholinotrophic molecular substrates of mild cognitive impairment in the elderly. Curr. Alzheimer Res. 4, 340–350. doi: 10.2174/156720507781788855
Mufson, E. J., Counts, S. E., Perez, S. E., and Ginsberg, S. D. (2008). Cholinergic system during the progression of alzheimer's disease: therapeutic implications. Expert Rev. Neurother. 8, 1703–1718. doi: 10.1586/14737175.8.11.1703
Murphy, D. L., Fox, M. A., Timpano, K. R., Moya, P. R., Ren-Patterson, R., Andrews, A. M., et al. (2008). How the serotonin story is being rewritten by new gene-based discoveries principally related to slc6a4, the serotonin transporter gene, which functions to influence all cellular serotonin systems. Neuropharmacology 55, 932–960. doi: 10.1016/j.neuropharm.2008.08.034
Ng, S. R., and O'Hare, D. (2015). An iridium oxide microelectrode for monitoring acute local pH changes of endothelial cells. Analyst 140, 4224–4231. doi: 10.1039/C5AN00377F
Ossowska, K., Konieczny, J., Wolfarth, S., and Pilc, A. (2005). Mtep, a new selective antagonist of the metabotropic glutamate receptor subtype 5 (mglur5), produces antiparkinsonian-like effects in rats. Neuropharmacology 49, 447–455. doi: 10.1016/j.neuropharm.2005.04.002
Owen, S. L., Green, A. L., Stein, J. F., and Aziz, T. Z. (2006). Deep brain stimulation for the alleviation of post-stroke neuropathic pain. Pain 120, 202–206. doi: 10.1016/j.pain.2005.09.035
Ozdemir, V., Jamal, M. M., Osapay, K., Jadus, M. R., Sandor, Z., Hashemzadeh, M., et al. (2007). Cosegregation of gastrointestinal ulcers and schizophrenia in a large national inpatient discharge database: revisiting the “brain-gut axis” hypothesis in ulcer pathogenesis. J. Invest. Med. 55, 315–320. doi: 10.2310/6650.2007.00014
Pani, L., Porcella, A., and Gessa, G. (2000). The role of stress in the pathophysiology of the dopaminergic system. Mol. Psychiatry 5:14. doi: 10.1038/sj.mp.4000589
Park, J., Takmakov, P., and Wightman, R. M. (2011). In vivo comparison of norepinephrine and dopamine release in rat brain by simultaneous measurements with fast-scan cyclic voltammetry. J. Neurochem. 119, 932–944. doi: 10.1111/j.1471-4159.2011.07494.x
Patel, Y. A., and Butera, R. J. (2015). Differential fiber-specific block of nerve conduction in mammalian peripheral nerves using kilohertz electrical stimulation. J. Neurophysiol. 113, 3923–3929. doi: 10.1152/jn.00529.2014
Payne, S. C., Furness, J. B., and Stebbing, M. J. (2018). Bioelectric neuromodulation for gastrointestinal disorders: effectiveness and mechanisms. Nat. Rev. Gastroenterol. Hepatol. 16, 89–105. doi: 10.1038/s41575-018-0078-6
Peters, J. L., Miner, L. H., Michael, A. C., and Sesack, S. R. (2004). Ultrastructure at carbon fiber microelectrode implantation sites after acute voltammetric measurements in the striatum of anesthetized rats. J. Neurosci. Methods 137, 9–23. doi: 10.1016/j.jneumeth.2004.02.006
Priori, A., Foffani, G., Rossi, L., and Marceglia, S. (2013). Adaptive deep brain stimulation (adbs) controlled by local field potential oscillations. Exp. Neurol. 245,77–86. doi: 10.1016/j.expneurol.2012.09.013
Raimondo, J. V., Burman, R. J., Katz, A. A., and Akerman, C. J. (2015). Ion dynamics during seizures. Front. Cell. Neurosci. 9:419. doi: 10.3389/fncel.2015.00419
Rand, E., Periyakaruppan, A., Tanaka, Z., Zhang, D. A., Marsh, M. P., Andrews, R. J., et al. (2013). A carbon nanofiber based biosensor for simultaneous detection of dopamine and serotonin in the presence of ascorbic acid. Biosensors Bioelectron. 42, 434–438. doi: 10.1016/j.bios.2012.10.080
Rasheed, N., and Alghasham, A. (2012). Central dopaminergic system and its implications in stress-mediated neurological disorders and gastric ulcers: short review. Adv. Pharmacol. Sci. 2012:182671. doi: 10.1155/2012/182671
Rehncrona, S., Johnels, B., Widner, H., Törnqvist, A.-L., Hariz, M., and Sydow, O. (2003). Long-term efficacy of thalamic deep brain stimulation for tremor: double-blind assessments. Mov. Disord. 18, 163–170. doi: 10.1002/mds.10309
Robinson, D. L., and Wightman, R. M. (2004). Nomifensine amplifies subsecond dopamine signals in the ventral striatum of freely-moving rats. J. Neurochem. 90, 894–903. doi: 10.1111/j.1471-4159.2004.02559.x
Rodeberg, N. T., Sandberg, S. G., Johnson, J. A., Phillips, P. E., and Mark Wightman, R. (2017). Hitchhiker's guide to voltammetry: acute and chronic electrodes for in vivo fast-scan cyclic voltammetry graphical abstract. ACS Chem. Neurosci 8, 221–234. doi: 10.1021/acschemneuro.6b00393
Rosa, M., Arlotti, M., Ardolino, G., Cogiamanian, F., Marceglia, S., Di Fonzo, A., et al. (2015). Adaptive deep brain stimulation in a freely moving parkinsonian patient. Mov. Disord. 30, 1003–1005. doi: 10.1002/mds.26241
Sandyk, R. (2006). Serotonergic mechanisms in amyotrophic lateral sclerosis. Int. J. Neurosci. 116, 775–826. doi: 10.1080/00207450600754087
Sarter, M., Parikh, V., and Howe, W. M. (2009). Phasic acetylcholine release and the volume transmission hypothesis: time to move on. Nat. Rev. Neurosci. 10, 383–390. doi: 10.1038/nrn2635
Sawaguchi, T., and Goldman-Rakic, P. S. (1994). The role of d1-dopamine receptor in working memory: local injections of dopamine antagonists into the prefrontal cortex of rhesus monkeys performing an oculomotor delayed-response task. J. Neurophysiol. 71, 515–528. doi: 10.1152/jn.1994.71.2.515
Sawaguchi, T., Matsumura, M., and Kubota, K. (1990). Effects of dopamine antagonists on neuronal activity related to a delayed response task in monkey prefrontal cortex. J. Neurophysiol. 63, 1401–1412. doi: 10.1152/jn.1990.63.6.1401
Sheikh, S., Blaszykowski, C., Nolan, R., Thompson, D., and Thompson, M. (2015). On the hydration of subnanometric antifouling organosilane adlayers: A molecular dynamics simulation. J. Colloid Interface Sci. 437, 197–204. doi: 10.1016/j.jcis.2014.09.025
Sheikh, S., Yang, D. Y., Blaszykowski, C., and Thompson, M. (2012). Single ether group in a glycol-based ultra-thin layer prevents surface fouling from undiluted serum. Chem. Commun. 48, 1305–1307. doi: 10.1039/C2CC15692J
Shikora, S., Toouli, J., Herrera, M. F., Kulseng, B., Zulewski, H., Brancatisano, R., et al. (2013). Vagal blocking improves glycemic control and elevated blood pressure in obese subjects with type 2 diabetes mellitus. J. Obes. 2013:245683. doi: 10.1155/2013/245683
Stanford-Bio-X (2018). Closed-Loop Neurochemical Sensing and Modulation System for Treating Psychiatric Disorders.
Sun, F. T., and Morrell, M. J. (2014). Closed-loop neurostimulation: the clinical experience. Neurotherapeutics 11, 553–563. doi: 10.1007/s13311-014-0280-3
Swamy, B. E., and Venton, B. J. (2007). Subsecond detection of physiological adenosine concentrations using fast-scan cyclic voltammetry. Anal. Chem. 79, 744–750. doi: 10.1021/ac061820i
Tass, P. A. (2003). A model of desynchronizing deep brain stimulation with a demand-controlled coordinated reset of neural subpopulations. Biol. Cybern. 89, 81–88. doi: 10.1007/s00422-003-0425-7
Theodore, W. H. (2003). Does serotonin play a role in epilepsy? Epilepsy Curr. 3, 173–177. doi: 10.1046/j.1535-7597.2003.03508.x
Thompson, M. (2017). Neurophysiological monitoring of potassium. in Compendium of in vivo Monitoring in Real-Time Molecular Neuroscience (World Scientific).
Trevathan, J. K., Yousefi, A., Park, H. O., Bartoletta, J. J., Ludwig, K. A., Lee, K. H., et al. (2015). Computational modeling of neurotransmitter release evoked by electrical stimulation: nonlinear approaches to predicting stimulation-evoked dopamine release. ACS Chem. Neurosci. 18, 386–392. doi: 10.1038/nn.3945
Trulson, M. E., and Jacobs, B. L. (1979). Raphe unit activity in freely moving cats: correlation with level of behavioral arousal. Brain Res. 163, 135–150.
Turner, R. F., Harrison, D. J., and Rojotte, R. V. (1991). Preliminary in vivo biocompatibility studies on perfluorosulphonic acid polymer membranes for biosensor applications. Biomaterials 12, 361–368.
Vajari, D. A., Vomero, M., Erhardt, J. B., Sadr, A., Ordonez, J. S., Coenen, V., et al. (2018). Integrity assessment of a hybrid DBS probe that enables neurotransmitter detection simultaneously to electrical stimulation and recording. Micromachines. 9:510. doi: 10.3390/mi9100510
Venton, B. J., Michael, D. J., and Wightman, R. M. (2003). Correlation of local changes in extracellular oxygen and pH that accompany dopaminergic terminal activity in the rat caudate-putamen. J. Neurochem. 84, 373–381. doi: 10.1046/j.1471-4159.2003.01527.x
Vidailhet, M., Jutras, M.-F., Roze, E., and Grabli, D. (2013). “Deep brain stimulation for dystonia,” in Handbook of Clinical Neurology, Vol. 116, eds P. Vinken and G. Bruyn (Elsevier), 167–187. doi: 10.1016/B978-0-444-53497-2.00014-0
Vidailhet, M., Vercueil, L., Houeto, J.-L., Krystkowiak, P., Benabid, A.-L., Cornu, P., et al. (2005). Bilateral deep-brain stimulation of the globus pallidus in primary generalized dystonia. N. Engl. J. Med. 352, 459–467. doi: 10.1056/NEJMoa042187
Volkmann, J., Herzog, J., Kopper, F., and Deuschl, G. (2002). Introduction to the programming of deep brain stimulators. Mov. Disord. 17, S181–s187. doi: 10.1002/mds.10162
Volkow, N. D., Wang, G.-J., Telang, F., Fowler, J. S., Logan, J., Childress, A.-R., et al. (2006). Cocaine cues and dopamine in dorsal striatum: mechanism of craving in cocaine addiction. J. Neurosci. 26, 6583–6588. doi: 10.1523/JNEUROSCI.1544-06.2006
Walters, S. H., Robbins, E. M., and Michael, A. C. (2015). Modeling the kinetic diversity of dopamine in the dorsal striatum. ACS Chem. Neurosci. 6, 1468–1475. doi: 10.1021/acschemneuro.5b00128
Walters, S. H., Taylor, I. M., Shu, Z., and Michael, A. C. (2014). A novel restricted diffusion model of evoked dopamine. ACS Chem. Neurosci. 5, 776–783. doi: 10.1021/cn5000666
Ward, M. P., and Irazoqui, P. P. (2010). Evolving refractory major depressive disorder diagnostic and treatment paradigms: toward closed-loop therapeutics. Front. Neuroeng. 3:7. doi: 10.3389/fneng.2010.00007
Ward, M. P., Qing, K. Y., Otto, K. J., Worth, R. M., John, S. W., and Irazoqui, P. P. (2015). A flexible platform for biofeedback-driven control and personalization of electrical nerve stimulation therapy. IEEE Trans. Neural Syst. Rehabil. Eng. 23, 475–484. doi: 10.1109/TNSRE.2014.2351271
Whishaw, I. Q., and Dunnett, S. B. (1985). Dopamine depletion, stimulation or blockade in the rat disrupts spatial navigation and locomotion dependent upon beacon or distal cues. Behav. Brain Res. 18, 11–29. doi: 10.1016/0166-4328(85)90165-2
Wightman, R. M., Amatorh, C., Engstrom, R. C., Hale, P. D., Kristensen, E. W., Kuhr, W. G., et al. (1988). Real-time characterization of dopamine overflow and uptake in the rat striatum. Neuroscience 25, 513–523. doi: 10.1016/0306-4522(88)90255-2
Winterer, G., and Weinberger, D. R. (2004). Genes, dopamine and cortical signal-to-noise ratio in schizophrenia. Trends Neurosci. 27, 683–690. doi: 10.1016/j.tins.2004.08.002
Wu, Q., Reith, M. E., Wightman, R. M., Kawagoe, K. T., and Garris, P. A. (2001). Determination of release and uptake parameters from electrically evoked dopamine dynamics measured by real-time voltammetry. J. Neurosci. Methods 112, 119–133. doi: 10.1016/S0165-0270(01)00459-9
Yousif, N., Borisyuk, R., Pavese, N., Nandi, D., and Bain, P. (2012). Spatiotemporal visualization of deep brain stimulation-induced effects in the subthalamic nucleus. Eur. J. Neurosci. 36, 2252–2259. doi: 10.1111/j.1460-9568.2012.08086.x
Yousif, N., Purswani, N., Bayford, R., Nandi, D., Bain, P., and Liu, X. (2010). Evaluating the impact of the deep brain stimulation induced electric field on subthalamic neurons: a computational modelling study. J. Neurosci. Methods 188, 105–112. doi: 10.1016/j.jneumeth.2010.01.026
Zahrt, J., Taylor, J. R., Mathew, R. G., and Arnsten, A. F. (1997). Supranormal stimulation of d1 dopamine receptors in the rodent prefrontal cortex impairs spatial working memory performance. J. Neurosci. 17, 8528–8535. doi: 10.1523/JNEUROSCI.17-21-08528.1997
Keywords: neurochemical monitoring, closed loop neuromodulation, deep brain stimulation (DBS), vagus nerve stimulation (VNS), FSCV, chemometrics
Citation: Mirza KB, Golden CT, Nikolic K and Toumazou C (2019) Closed-Loop Implantable Therapeutic Neuromodulation Systems Based on Neurochemical Monitoring. Front. Neurosci. 13:808. doi: 10.3389/fnins.2019.00808
Received: 10 December 2018; Accepted: 19 July 2019;
Published: 20 August 2019.
Edited by:
Olivier David, Institut National de la Santé et de la Recherche Médicale (INSERM), FranceReviewed by:
Ali Yadollahpour, Ahvaz Jundishapur University of Medical Sciences, IranMaria Teresa Fiorenza, Sapienza University of Rome, Italy
Russell J. Andrews, Ames Associate (Smart Systems & Nanotechnology) at NASA Ames Research Center, United States
Hoon-Ki Min, Mayo Clinic, United States
Copyright © 2019 Mirza, Golden, Nikolic and Toumazou. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Khalid B. Mirza, ay5taXJ6YSYjeDAwMDQwO2ltcGVyaWFsLmFjLnVr