Skip to main content

ORIGINAL RESEARCH article

Front. Neuroeng., 29 April 2014

Controlling neural network responsiveness: tradeoffs and constraints

  • 1Network Biology Research Laboratory, Faculty of Electrical Engineering, Technion - Israel Institute of Technology, Haifa, Israel
  • 2Department of Physiology, Faculty of Medicine, Technion - Israel Institute of Technology, Haifa, Israel

In recent years much effort is invested in means to control neural population responses at the whole brain level, within the context of developing advanced medical applications. The tradeoffs and constraints involved, however, remain elusive due to obvious complications entailed by studying whole brain dynamics. Here, we present effective control of response features (probability and latency) of cortical networks in vitro over many hours, and offer this approach as an experimental toy for studying controllability of neural networks in the wider context. Exercising this approach we show that enforcement of stable high activity rates by means of closed loop control may enhance alteration of underlying global input–output relations and activity dependent dispersion of neuronal pair-wise correlations across the network.

1. Introduction

The responsiveness of neural networks to repeated stimuli is inherently variable. This variability is expressed in broadly-distributed statistics of response features, reflecting a rich repertoire of cellular level processes, covering practically every observable timescale (Arieli et al., 1996; Marder and Goaillard, 2006; Faisal et al., 2008; Marom, 2010). From the medical applicative point of view, network response variation poses a challenge, motivating initiatives to devise closed loop schemes intended for the whole brain level (DiLorenzo, 2002; Rolston et al., 2009; Lee et al., 2010; Rosin et al., 2011; Berenyi et al., 2012). As this approach is potentially useful, the underlying tradeoffs and constraints involved remain a matter for trial-and-error exploration; this is due to the obvious complications entailed by studying whole brain dynamics.

In this work, we take advantage of a reduced in vitro preparation, combined with closed loop stimulation algorithms, in order to (1) demonstrate the feasibility of controlling network response features over extended time scales and (2) expose impacts of such control on underlying network properties. The said reduced preparation is a large-scale cortical network developing in vitro, on top of a substrate integrated multi-electrode array (MEA). This preparation proved useful, over the past 10–15 years, as a toy model in the study of functional network processes, ranging from development and adaptation to learning and stimulus representation (Maeda et al., 1995; Kamioka et al., 1996; Jimbo et al., 1998, 1999; Tateno and Jimbo, 1999; Shahaf and Marom, 2001; Corner et al., 2002; Eytan et al., 2003; Shahaf et al., 2008). A recent series of studies demonstrated the efficacy of several closed loop applications in controlling aspects of activity in these in vitro large-scale cortical networks (e.g., Wagenaar and Potter, 2004; Wagenaar et al., 2005; Arsiero et al., 2007; Rolston et al., 2010; Wallach et al., 2011; Weihberger et al., 2013). Here we implement one of these approaches, the so-called “response-clamp” procedure: a PI (Proportional-Integral) negative feedback algorithm (Wallach et al., 2011; Wallach, 2013), in order to control response features in vitro. In the present context we define controllability as a capacity to quench variations of functionally-relevant response features. We show that the response-clamp procedure may easily control the probability as well as the latency of network responses to repeated stimuli. At the same time we find that such control, by the very fact of enforcing relatively high activity levels, may lead to compromised stability of other network features. This latter point is demonstrated by monitoring network input–output relations as well as pair-wise correlations between latencies to first spikes.

2. Results

When an in vitro network of cortical neurons is stimulated locally through the multi-electrode array, a synchronous burst of spikes can be evoked, spreading across extended parts of the network (Maeda et al., 1995; Pinato et al., 1999; Jimbo et al., 2000; Wagenaar et al., 2004). Following the notation used in a previous study (Eytan and Marom, 2006), we denote this threshold-governed phenomenon a Network Spike (NS). When periodically delivered, these stimuli give rise to fluctuations in both the occurrence probability and the temporal envelope (latency, duration, amplitude) of evoked NSs. This is demonstrated in Figure 1A, where three consecutive responses are shown, extracted from a long series of responses to repeated identical voltage stimuli delivered at a frequency of 0.2 Hz. Variations are observed in the identity of participating neurons (as reflected in the identity of active electrodes), in the number of spikes detected by each electrode in response to stimuli, as well as in the latencies of emitted spikes. These variations are also apparent at the level of population responses, NSs, as shown in the lower panels of Figure 1A. Figure 1B shows NSs evoked by a series of 800 such stimuli, revealing slowly varying network response features, extending over many minutes.

FIGURE 1
www.frontiersin.org

Figure 1. Network response is highly variable; response probability and latency are correlated to stimulation amplitude. (A) Top: Responses to three consecutive stimuli (300 mV, 0.2 Hz). Stimulation events are depicted by vertical lines; points represent spikes detected by different electrodes (vertical axes). Bottom: Population post-stimulus time histograms (pPSTH) of all detected spikes, binned to 5 ms. (B) Responses to 800 stimuli (300 mV, 0.2 Hz). Each row represents response to one stimulus delivered at time zero; for clarity, only values larger than zero activity are depicted. (C, D) Response probability and latency are monotonically affected by stimulation amplitude; stimuli (from 100 to 900 mV; 50 mV bins) are delivered at 0.2 Hz in a randomized order. Each presented value of response probability and latency was calculated from at least 10 responses. Results extracted from six different networks are shown.

A basic requirement, before control of the variations shown above may be considered, is that there be consistent relations between input parameters (e.g., stimulus shape, amplitude, duration, frequency) and the feature to be controlled. We chose to focus our attention on the effects of stimulus amplitude, previously shown to monotonically impact on various response features in vivo (e.g., Day et al., 1989; Walker et al., 2012; Park et al., 2013). In the present in vitro setting, the stimulus is a square 200 μs voltage pulse, the amplitude of which may vary from 100 to 1000 mV, constrained from above by the electrochemistry of electrodes involved. Figures 1C,D show monotonic relations between stimulus amplitude and two key response features—occurrence probability and latency of evoked NSs. Conveniently, in most networks the range of stimulus amplitudes needed in order to modify NS latency and probability is found to be within the above mentioned (electrochemically imposed) boundary; such are the networks used in the present study. However, it is instructive to note that in cases where NS responsiveness is relatively low and cannot be explored by the above mentioned range of stimulation amplitudes, the matter may be rectified by pharmacologically blocking inhibitory synapses.

Given the consistent monotonic relations between stimulus amplitude, NS response probability and latency, a proportional-integral (PI) clamp circuit may be implemented. A response feature y(n), be it the occurrence of a NS (a binary value) or NS latency (a positive, continuous value), is recorded following each stimulus u(n). The PI control algorithm adjusts the amplitude of the subsequent stimulus u(n + 1) based on the “error” e(n)—the difference between the response output and the desired value of response feature, y*(n). In the case of response probability, the output is an estimated value, denoted Pτ, and the desired value is accordingly denoted P*. Further technical details are described in Materials and Methods as well as in Wallach et al. (2011); Wallach (2013).

The efficacy of the PI controller in clamping the response probability of our large scale networks is exemplified in the black trace of Figure 2A. The desired responsiveness (P*) was set to 0.5 (50% probability of a response to stimulation). The response to each stimulus is defined as a binary value. A detected NS within a post-stimulus time window of 10–800 ms, is designated 1; in the absence of a NS in that time window, the response is designated 0. Response probability Pτ, is computed by averaging the resulting binary time series, using an exponential kernel with a characteristic time scale τ = 250 s. For comparison, the blue trace (Figure 2A) shows Pτ in an open loop condition, where a series of stimuli at a constant amplitude (300 mV, the average of the closed loop input series) is delivered.

FIGURE 2
www.frontiersin.org

Figure 2. Feasibility of control. (A) Response probability values under closed loop control, targeted to P* = 0.5 are depicted black. The blue line shows the network response probability to a series of constant amplitude stimulation (the mean of above closed loop amplitudes). (B) Three consecutive sessions: Closed loop followed by open loop sessions where the input is a shuffled or a replayed version of the closed loop series of inputs (stimulation amplitudes). Input time series are depicted Gray. (C) Histograms of response probabilities under closed (Black) and open (Blue) loop conditions. (D) Histograms of response probabilities under closed loop stimulation, targeted to P* = 0.3, using different τ values (500, 250, or 100 s). (E) Response probability of two networks under closed loop using only the “P” component of the controller, followed by closed loop with both “P” and “I” components (see Materials and Methods for specific values).

A comparison of closed loop results to a constant amplitude open loop stimulation, as demonstrated in Figure 2A, is not sufficiently convincing. What one might wish to see is a comparison to varying open loop series. Two such open loop series are considered: (1) replayed and (2) shuffled versions of the stimulation series generated by the controller in the closed loop setting. Figure 2B shows the resulting fluctuations of response probability in both types of open loop conditions (blue), compared to the closed loop condition (black); the stimulus time series are depicted in gray. Results obtained by long term (3–5 h) of 12 such experiments are summarized in Figure 2C, demonstrating quenched fluctuations of response probability values under closed loop.

The choice to set the controller's time scale (τ) to 250 s reflects a tradeoff between reduction of fluctuations on the one hand, and capacity to modulate target response probabilities over minutes (as demonstrated in a later section), on the other. As shown in Figure 2D, the impacts of a 5-fold change in the value of τ on the standard deviation of response fluctuations are negligible. Related to this issue, given the fact that integration time of 500 s implies 100 stimuli, we suspect that the observed fluctuations under closed loop control, scratch the limits of our system. Obviously, the gains of the integral and proportional components are crucial here. But beyond these, the origin of this limit—biological (e.g., interference by spontaneous sporadic activity, some sub-threshold dynamics, etc.) or technical (e.g., electrodes chemistry, setup movements, etc.)—remains open at this stage. And, finally, note (in Figure 2E) that both the integral and proportional components of the controller are needed; while use of the proportional component only might lead to quenching of response variability, the resulting response probability may not be effectively controlled.

Figure 3A depicts three different networks that were exposed to two closed loop sessions (I and III, 5 h each), interleaved by open loop replay sessions (II and IV, 5 h each). The results, beyond demonstrating the ability to implement network control over many hours, uncover interesting phenomena observed in all the cases we have studied: (1) Control of different networks to the same desired responsiveness P* entails qualitatively different input series (i.e., generated stimulation amplitude values). (2) Different input time series are required in order to stabilize network responsiveness in repeated closed loop sessions; this is apparent from the input traces of the bottom panel (sessions I and III).

FIGURE 3
www.frontiersin.org

Figure 3. Efficacy and robustness of control. (A) Top: Two sessions (I and III) of controlling response probability to P* = 0.5, interleaved by sessions (II and IV) of open loop replay stimulation. These are shown for three different networks (colored). Bottom: Stimulation amplitudes corresponding to top traces. (B) A single network is clamped to either P* = 0.3 (purple) or P* = 0.7 (black) response probability; upper panel presents response probability values whereas inputs (stimulation amplitudes) are presented in respective colors at the bottom panel.

The target value of response probability (P*) is not limited to being 0.5. Figure 3B demonstrates implementation of control at two different desired probabilities (0.7 and 0.3) in the same network. Note the impact of these differences on the input time series (lower panel), reflecting a trend in our observations: When response probability is clamped to higher values, the required stimulation amplitudes are higher on average (across five networks clamped to P* = 0.7, the mean stimulation amplitude was 30% higher compared to clamping to P* = 0.2–0.3). Note that the impact of the value of P* on the quenching of response fluctuations under closed loop control, does not seem to be significant; the standard deviation of Pτ remains between 0.02 and 0.03 across 16 closed loop sessions to P* ranging from 0.2 to 0.7.

Figure 4 demonstrates extensions of the above described closed loop control capabilities. In Figure 4A an alternating, sine-wave like control of response probability is shown. In such cases, the time scale chosen for computing Pτ is important, affecting both the phase shifts and amplitudes of output patterns. Another extension involves simultaneous control over two response features: Where the sensitivity of response features to the input are correlated, control of more than one feature may be considered, limited by the nature of the correlation. This is demonstrated in the results of Figures 4B–D, where the nature of correlations between input (stimulation amplitude), response probability and response latency (see Figures 1C,D), is taken advantage of. Naturally, such simultaneous procedure is severely limited if control to relatively high response probability is attempted together with relatively delayed, long latencies to NSs. Figure 4D summarizes five different simultaneous control experiments (in five different networks).

FIGURE 4
www.frontiersin.org

Figure 4. Extensions of network control. (A) Response probability is manipulated by sine-wave control; the desired response probability is depicted gray. (B) Control of response probability (to P* = 0.3) for the first 2 h, after which control of both response probability and latency (to 10–80 ms) is exercised. (C) Responses to 400 consecutive stimuli during the simultaneous control (only values above zero activity are depicted). (D) Standard deviation of response latency values under response probability control and under simultaneous control is presented for five different networks.

The above enforcement of response features using closed loop control, entails instabilities at the underlying levels of network activity organization. Figure 5A (top), demonstrates that clamping network responsiveness to relatively high values of P* = 0.7 causes a significant dispersion of pair-wise correlations between latencies to first spikes, detected in the different electrodes, compared to P* = 0.2. A summary of the effects of P* values on the stability of pair-wise correlations is shown in the bottom right panel, where the results from nine networks are integrated; pair-wise correlations between times to first spikes are broadly-distributed when higher P* are maintained. To convince ourselves that the dispersion effect is due to higher activity rather than to the closed loop control itself, we extended each closed loop experiment by replaying the controller input series (or a shuffled version of it) in open loop conditions. We found that similar dispersions of correlation values occur under open loop conditions in high Pτ (see bottom left panel of Figure 5A).

FIGURE 5
www.frontiersin.org

Figure 5. Impacts of high activity rates enforced by closed loop. (A) Top: Pair-wise correlation coefficients (Pearson's correlation) between times to first spike, under control (P* = 0.2 and P* = 0.7); results from three networks are shown, each depicted by a different marker. First spikes that their latency values are <10 or >400 ms are discarded. Bottom: Right-hand panel shows that the distribution of pair-wise correlations (from nine different networks) is significantly narrower for P* < 0.5 compared to P* ≥ 0.5. The left-hand panel shows that the distribution of pair-wise correlations (six different networks) at Pτ ≥ 0.5 is equally broad, whether under closed or open loop conditions. (B) Input–output relations calculated over 40 min epochs along 5 h of closed loop control stimulation (upper panel) and 5 h of open loop stimulation (lower panel). Stimulation amplitudes are binned to 5 mV; Pi is calculated for each amplitude bin (a minimum of 10 responses is required for inclusion of a bin). Input–output relations of the first and last 40 min epochs are depicted black and blue, respectively. Continuous lines depict a fit to the Boltzmann equation. The standard deviation of inputs that evoke responses over an arbitrary range of 0.45–0.55 was calculated for both stimulation protocols (11 comparisons in nine networks) and presented in panel (C). (D) The rates of spontaneous and evoked NSs under closed loop, at two different desired response probabilities (P* = 0.2–0.3 and P* = 0.7). Rates are normalized to frequency of spontaneous NSs (i.e., no stimuli session).

Beyond dispersed pair-wise correlations of times to first spikes, control of network response probability compromises the stability of global, population-level input–output relations. Figure 5B demonstrates this effect in the case of one network, where the relations between stimulation amplitude and response probability are estimated along a 5 h closed loop control (top) and 5 h shuffled open loop stimulation (bottom). The sessions were sliced to 40 min epochs; for each epoch, the output, response probability, was estimated by calculating the fraction of evoked NSs in response to binned stimulation amplitudes (denoted Pi). Note the right-shift of input–output relations in closed loop control (top) compared to the stable input–output in open loop conditions. Of nine networks tested, eight showed such right-shift (i.e., becoming less sensitive to stimulus amplitude) along the closed loop session, whereas only one drifted to the left (i.e., becoming more sensitive). Figure 3 is as well informative in this context.

Quantification of input–output stability is offered in Figure 5C, generated as follows: In the above nine mentioned networks, the response probability (Pi) of the input–output relations extended across a range of 0.55 > Pi > 0.45. In these networks, the standard deviation of the input spanning this range was calculated (the extent of such amplitude values is represented by vertical lines in Figure 5B); a presentation of this value for each network in both closed and open loop conditions, is given in Figure 5C. In all cases, input–output stability thus estimated is compromised by the closed loop control. The (mostly rightwards) drift of input–output relations induced by closed loop control, is not fully reversible upon change from the closed loop to the open loop conditions (data not shown).

Finally, Figure 5D shows that there is a tradeoff between evoked and spontaneous NSs. As the rate of responsiveness increases by the closed loop controller, the fraction of spontaneously occurring NSs decreases. This result is congruent with data presented by Wagenaar et al. (2005), where feedback stimulation was implemented in order to increase the total spike rate across the network, causing a decrease in spontaneous NSs.

3. Concluding Remarks

Cortical networks developing in vitro are acknowledged as an experimental platform where features of in vivo activity may be effectively analyzed (Droge et al., 1986; Jimbo et al., 1993, 2000; Maeda et al., 1995; Shahaf and Marom, 2001; Corner et al., 2002; Marom and Shahaf, 2002; van Pelt et al., 2004; Eytan and Marom, 2006; Wagenaar et al., 2006; Ham et al., 2008; Stegenga et al., 2008). Here we implement a previously described response-clamp method (Wallach et al., 2011) to control the responsiveness of in vitro cortical networks to external stimulation over many hours, and point at several constraints and tradeoffs entailed by externally enforced stability. We show that network response probability and response latency, significantly fluctuating under open loop conditions, may be effectively restrained and manipulated by the closed loop algorithm. This ability relies on the fact of monotonic relations between stimulation amplitude and both response probability and latency.

We find that over time, enforced response stability leads to activity dependent dispersion of pair-wise correlations between times to first-spikes across the network, as well as destabilization of global input–output relations. These, we interpret, reflect reduced efficacy of internal homeostatic processes (reviewed in, e.g., Turrigiano and Nelson, 2004; Davis, 2006; Marder and Goaillard, 2006; Turrigiano, 2008, 2011; Maffei and Fontanini, 2009; Marder and Tang, 2010), which appear to be compromised by our externally imposed closed loop drive. Stated differently, under open loop conditions, the network responds when it can; where it cannot, no response is evoked and resources are regained. However, under closed loop conditions, when the network is incapable of responding to a given input, the amplitude of the latter is further increased, enforcing use of whichever activity resources are available; these, in turn might give rise to the observed plastic changes. This does not mean that open loop stimulation cannot induce plasticity; there are many reports that demonstrate this (e.g., Jimbo et al., 1998, 1999; Madhavan et al., 2006; Chao et al., 2007; Chiappalone et al., 2008; Vajda et al., 2008; Bologna et al., 2010; le Feber et al., 2010). We also observe activity dependent dispersion of pair-wise correlations between first-spikes across the network, under open loop stimulation. Enforced stable, high levels of activity by closed loop conditions seem to accelerate such changes. This interpretation is congruent with that offered by le Feber et al. (2010), describing enhanced changes in connectivity measures upon implementation of adaptive (closed loop) stimulation compared to open loop.

The extent to which the proposed in vitro experimental toy model offered here prove useful for the study of closed loop conditions in vivo, remains to be seen.

4. Materials and Methods

4.1. Cell Preparation

Cortical neurons were obtained from newborn rats (Sprague–Dawley) within 24 h after birth using mechanical and enzymatic procedures described in earlier studies (Marom and Shahaf, 2002). Rats were killed by CO2 inhalation according to protocols approved by the Technion's ethics committee. The neurons were plated directly onto substrate-integrated multi electrode arrays and allowed to develop into functionally and structurally mature networks over a period of 2–3 weeks. The number of plated neurons was of the order of 450,000, covering an area of about 380 mm2. The preparations were bathed in MEM supplemented with heat-inactivated horse serum (5%), glutamine (0.5 mM), glucose (20 mM), and gentamycin (10 μg/ml), and maintained in an atmosphere of 37°C, 5% CO2, and 95% air in an incubator as well as during the recording phases. An array of Ti/Au extracellular electrodes, 30 μm in diameter, spaced 500 μm from each other (MultiChannelSystems, Reutlingen, Germany) was used. The insulation layer (silicon nitride) was pre-treated with polyethyleneimine (Sigma, 0.01% in 0.1 M Borate buffer solution).

4.2. Electrophysiology

A commercial amplifier (MEA-1060-inv-BC, MCS, Reutlingen, Germany) with frequency limits of 150–3000 Hz and a gain of ×1024 was used for obtaining data. Data was digitized using an acquisition board (PD2-MF-64-3M/12H, UEI, Walpole, MA, USA). Each channel was sampled at a frequency of 16 kHz. Action potentials were detected on-line by threshold crossing. The thresholds (8 × root mean square units; typically in the range of 10–20 μV) were defined separately for each of the recording channels before the beginning of the experiment. All spike times and voltage traces were recorded for analyses. Electrical activity detected often originates from several sources, typically 2–3 neurons, as each recording electrode is surrounded by several cell bodies. Detection of NSs was performed on-line by threshold crossing of spike rate (20 action potentials recorded throughout the electrode array within a 25 ms time bin), considering a refractory period of about 500 ms. Voltage stimulation was applied in a monophasic 200 μs square pulse 100–1000 mV, through extracellular electrodes, using a dedicated stimulus generator (MCS, Reutlingen, Germany). The electrode chosen for stimulation was the one showing the highest probability to participate first in spontaneous NSs, typically assuring the capability to evoke reliable network responses. Using Simulink software, processing and analyzing of data on-line was paced at 500 μs iteration steps [see Zrenner et al. (2010) for more details]. Data acquired was further analyzed off-line using Matlab (Mathworks, Natick, MA, USA).

4.3. PI Control

Proportional-Integral (PI) controller was realized on the xPC target system (Levine, 1996). The input to the controller is the error signal,

en=P(n)Pτ(n)(1)

where P*(n) and Pτ(n) are the desired and estimated response probabilities at the nth stimulus, respectively. The output of the controller is generally composed of three components,

An=Abaseline+gPen+gIi=1nei(2)

where gP and gI are the proportional and integral gain parameters, respectively. Here, we typically used gP = 1 (400 mV) and gI = 0.2 (80 mV), and Abaseline was the baseline amplitude bias (set according to an open loop stimulation amplitude required for reaching the desired reference response probability).

On-line estimation of network response probability: Let y(n) be an indicator function, so that y(n) = 1 if the network generated a NS within a predefined interval after the nth stimulus (10–800 ms), and y(n) = 0 otherwise. We denote Pτ(n) the estimation calculated at time t > tn, based on the set of responses {y(1), y(2),…, y(n)} to stimuli given at times {t1, t2,…, tn}. A weighted average was realized by using the recursive formula,

Pτ(n)=(1etntn1τ)·y(n)+etntn1τ·Pτ(n1)(3)

The estimation time-constant, τ, was typically set to 250 s.

Funding

The research leading to these results has received funding from the European Union Seventh Framework Programme (FP7/2007-2013) under Grant agreement No. FP7-269459 CORONET, and was also supported by a grant from the Ministry of Science and Technology, Israel, and funding organization of EU countries.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors thank Avner Wallach, Danni Dagan, Asaf Gal, and Netta Haroush for their useful comments and suggestions.

References

Arieli, A., Sterkin, A., Grinvald, A., and Aertsen, A. (1996). Dynamics of ongoing activity: explanation of the large variability in evoked cortical responses. Science 273, 1868–1871. doi: 10.1126/science.273.5283.1868

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Arsiero, M., Luescher, H. R., and Giugliano, M. (2007). Real-time closed-loop electrophysiology: towards new frontiers in in vitro investigations in the neurosciences. Arch. Ital. Biol. 145, 193–209.

Pubmed Abstract | Pubmed Full Text

Berenyi, A., Belluscio, M., Mao, D., and Buzski, G. (2012). Closed-loop control of epilepsy by transcranial electrical stimulation. Science 337, 735–737. doi: 10.1126/science.1223154

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Bologna, L. L., Nieus, T., Tedesco, M., Chiappalone, M., Benfenati, F., and Martinoia, S. (2010). Low-frequency stimulation enhances burst activity in cortical cultures during development. Neuroscience 165, 692–704. doi: 10.1016/j.neuroscience.2009.11.018

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Chao, Z. C., Bakkum, D. J., and Potter, S. M. (2007). Region-specific network plasticity in simulated and living cortical networks: comparison of the center of activity trajectory (cat) with other statistics. J. Neural Eng. 4, 294–308. doi: 10.1088/1741-2560/4/3/015

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Chiappalone, M., Massobrio, P., and Martinoia, S. (2008). Network plasticity in cortical assemblies. Eur. J. Neurosci. 28, 221–237. doi: 10.1111/j.1460-9568.2008.06259.x

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Corner, M. A., van Pelt, J., Wolters, P. S., Baker, R. E., and Nuytinck, R. H. (2002). Physiological effects of sustained blockade of excitatory synaptic transmission on spontaneously active developing neuronal networks–an inquiry into the reciprocal linkage between intrinsic biorhythms and neuroplasticity in early ontogeny. Neurosci. Biobehav. Rev. 26, 127–185. doi: 10.1016/S0149-7634(01)00062-8

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Davis, G. W. (2006). Homeostatic control of neural activity: from phenomenology to molecular design. Annu. Rev. Neurosci. 29, 307–323. doi: 10.1146/annurev.neuro.28.061604.135751

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Day, B. L., Dressler, D., Maertens de Noordhout, A., Marsden, C. D., Nakashima, K., Rothwell, J. C., et al. (1989). Electric and magnetic stimulation of human motor cortex: surface emg and single motor unit responses. J. Physiol. 412, 449–473.

Pubmed Abstract | Pubmed Full Text

DiLorenzo, D. J. (2002). Apparatus and Method for Closed-Loop Intracranical Stimulation for Optimal Control of Neurological Disease. US 6366813 B1.

Droge, M. H., Gross, G. W., Hightower, M. H., and Czisny, L. E. (1986). Multielectrode analysis of coordinated, multisite, rhythmic bursting in cultured cns monolayer networks. J. Neurosci. 6, 1583–1592.

Pubmed Abstract | Pubmed Full Text

Eytan, D., Brenner, N., and Marom, S. (2003). Selective adaptation in networks of cortical neurons. J. Neurosci. 23, 9349–9356.

Pubmed Abstract | Pubmed Full Text

Eytan, D., and Marom, S. (2006). Dynamics and effective topology underlying synchronization in networks of cortical neurons. J. Neurosci. 26, 8465–8476. doi: 10.1523/JNEUROSCI.1627-06.2006

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Faisal, A. A., Selen, L. P. J., and Wolpert, D. M. (2008). Noise in the nervous system. Nat. Rev. Neurosci. 9, 292–303. doi: 10.1038/nrn2258

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Ham, M. I., Bettencourt, L. M., McDaniel, F. D., and Gross, G. W. (2008). Spontaneous coordinated activity in cultured networks: analysis of multiple ignition sites, primary circuits, and burst phase delay distributions. J. Comput. Neurosci. 24, 346–357. doi: 10.1007/s10827-007-0059-1

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Jimbo, Y., Kawana, A., Parodi, P., and Torre, V. (2000). The dynamics of a neuronal culture of dissociated cortical neurons of neonatal rats. Biol. Cybern. 83, 1–20. doi: 10.1007/PL00007970

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Jimbo, Y., Robinson, H., and Kawana, A. (1998). Strengthening of synchronized activity by tetanic stimulation in cortical cultures: application of planar electrode arrays. IEEE Trans. Biomed. Eng. 45, 1297–1304. doi: 10.1109/10.725326

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Jimbo, Y., Robinson, H. P., and Kawana, A. (1993). Simultaneous measurement of intracellular calcium and electrical activity from patterned neural networks in culture. IEEE Trans. Biomed. Eng. 40, 804–810. doi: 10.1109/10.238465

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Jimbo, Y., Tateno, T., and Robinson, H. (1999). Simultaneous induction of pathway-specific potentiation and depression in networks of cortical neurons. Biophys. J. 76, 670–678. doi: 10.1016/S0006-3495(99)77234-6

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Kamioka, H., Maeda, E., Jimbo, Y., Robinson, H. P., and Kawana, A. (1996). Spontaneous periodic synchronized bursting during formation of mature patterns of connections in cortical cultures. Neurosci. Lett. 206, 109–112. doi: 10.1016/S0304-3940(96)12448-4

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

le Feber, J., Stegenga, J., and Rutten, W. L. C. (2010). The effect of slow electrical stimuli to achieve learning in cultured networks of rat cortical neurons. PLoS ONE 5:e8871. doi: 10.1371/journal.pone.0008871

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Lee, J., Rhew, h. G., Kipke, D., and Flynn, M. (2010). A 64 channel programmable closed-loop neurostimulator with 8 channel neural amplifier and logarithmic adc. IEEE J. Solid State Circ. 45, 1935–1945. doi: 10.1109/JSSC.2010.2052403

CrossRef Full Text

Levine, W. S. (1996). The Control Handbook. Boca Raton, FL: CRC Press.

Madhavan, R., Chao, Z. C., Wagenaar, D. A., Bakkum, D. J., and Potter, S. M. (2006). Multi-site stimulation quiets network-wide spontaneous bursts and enhances functional plasticity in cultured cortical networks. Conf. Proc. IEEE Eng. Med. Biol. Soc. 1, 1593–1596. doi: 10.1109/IEMBS.2006.260571

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Maeda, E., Robinson, H. P., and Kawana, A. (1995). The mechanisms of generation and propagation of synchronized bursting in developing networks of cortical neurons. J. Neurosci. 15, 6834–6845.

Pubmed Abstract | Pubmed Full Text

Maffei, A., and Fontanini, A. (2009). Network homeostasis: a matter of coordination. Curr. Opin. Neurobiol. 19, 168–173. doi: 10.1016/j.conb.2009.05.012

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Marder, E., and Goaillard, J. M. (2006). Variability, compensation and homeostasis in neuron and network function. Nat. Rev. Neurosci. 7, 563–574. doi: 10.1038/nrn1949

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Marder, E., and Tang, L. S. (2010). Coordinating different homeostatic processes. Neuron 66, 161–163. doi: 10.1016/j.neuron.2010.04.022

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Marom, S. (2010). Neural timescales or lack thereof. Prog. Neurobiol. 90, 16–28. doi: 10.1016/j.pneurobio.2009.10.003

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Marom, S., and Shahaf, G. (2002). Development, learning and memory in large random networks of cortical neurons: lessons beyond anatomy. Q. Rev. Biophys. 35, 63–87. doi: 10.1017/S0033583501003742

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Park, H. J., Bonmassar, G., Kaltenbach, J. A., Machado, A. G., Manzoor, N. F., and Gale, J. T. (2013). Activation of the central nervous system induced by micro-magnetic stimulation. Nat. Commun. 4:2463. doi: 10.1038/ncomms3463

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Pinato, G., Parodi, P., Bisso, A., Macri, D., Kawana, A., Jimbo, Y., et al. (1999). Properties of the evoked spatio-temporal electrical activity in neuronal assemblies. Rev. Neurosci. 10, 279–290. doi: 10.1515/REVNEURO.1999.10.3-4.279

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Rolston, J. D., Gross, R. E., and Potter, S. M. (2009). A low-cost multielectrode system for data acquisition enabling real-time closed-loop processing with rapid recovery from stimulation artifacts. Front. Neuroeng. 2:12. doi: 10.3389/neuro.16.012.2009

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Rolston, J. D., Gross, R. E., and Potter, S. M. (2010). Closed-loop, open-source electrophysiology. Front. Neurosci. 4:31. doi: 10.3389/fnins.2010.00031

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Rosin, B., Slovik, M., Mitelman, R., Rivlin-Etzion, M., Haber, S. N., Israel, Z., et al. (2011). Closed-loop deep brain stimulation is superior in ameliorating parkinsonism. Neuron 72, 370–384. doi: 10.1016/j.neuron.2011.08.023

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Shahaf, G., Eytan, D., Gal, A., Kermany, E., Lyakhov, V., Zrenner, C., et al. (2008). Order-based representation in random networks of cortical neurons. PLoS Comput. Biol. 4:e1000228. doi: 10.1371/journal.pcbi.1000228

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Shahaf, G., and Marom, S. (2001). Learning in networks of cortical neurons. J. Neurosci. 21, 8782–8788.

Pubmed Abstract | Pubmed Full Text

Stegenga, J., le Feber, J., and Rutten, W. L. C. (2008). Changes within bursts during learning in dissociated neural networks. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2008, 4968–4971. doi: 10.1109/IEMBS.2008.4650329

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Tateno, T., and Jimbo, Y. (1999). Activity-dependent enhancement in the reliability of correlated spike timings in cultured cortical neurons. Biol. Cybern. 80, 45–55. doi: 10.1007/s004220050503

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Turrigiano, G. (2011). Too many cooks? intrinsic and synaptic homeostatic mechanisms in cortical circuit refinement. Annu. Rev. Neurosci. 34, 89–103. doi: 10.1146/annurev-neuro-060909-153238

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Turrigiano, G. G. (2008). The self-tuning neuron: synaptic scaling of excitatory synapses. Cell 135, 422–435. doi: 10.1016/j.cell.2008.10.008

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Turrigiano, G. G., and Nelson, S. B. (2004). Homeostatic plasticity in the developing nervous system. Nat. Rev. Neurosci. 5, 97–107. doi: 10.1038/nrn1327

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Vajda, I., van Pelt, J., Wolters, P., Chiappalone, M., Martinoia, S., van Someren, E., et al. (2008). Low-frequency stimulation induces stable transitions in stereotypical activity in cortical networks. Biophys. J. 94, 5028–5039. doi: 10.1529/biophysj.107.112730

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

van Pelt, J., Wolters, P. S., Corner, M. A., Rutten, W. L., and Ramakers, G. J. (2004). Long-term characterization of firing dynamics of spontaneous bursts in cultured neural networks. IEEE Trans. Biomed. Eng. 51, 2051–2062. doi: 10.1109/TBME.2004.827936

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Wagenaar, D. A., Madhavan, R., Pine, J., and Potter, S. M. (2005). Controlling bursting in cortical cultures with closed-loop multi-electrode stimulation. J. Neurosci. 25, 680–688. doi: 10.1523/JNEUROSCI.4209-04.2005

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Wagenaar, D. A., Pine, J., and Potter, S. M. (2004). Effective parameters for stimulation of dissociated cultures using multi-electrode arrays. J. Neurosci. Methods 138, 27–37. doi: 10.1016/j.jneumeth.2004.03.005

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Wagenaar, D. A., Pine, J., and Potter, S. M. (2006). An extremely rich repertoire of bursting patterns during the development of cortical cultures. BMC Neurosci. 7:11. doi: 10.1186/1471-2202-7-11

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Wagenaar, D. A., and Potter, S. M. (2004). A versatile all-channel stimulator for electrode arrays, with real-time control. J. Neural Eng. 1, 39–45. doi: 10.1088/1741-2560/1/1/006

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Walker, H. C., Huang, H., Gonzalez, C. L., Bryant, J. E., Killen, J., Knowlton, R. C., et al. (2012). Short latency activation of cortex by clinically effective thalamic brain stimulation for tremor. Mov. Disord. 27, 1404–1412. doi: 10.1002/mds.25137

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Wallach, A. (2013). The response clamp: functional characterization of neural systems using closed-loop control. Front. Neural Circ. 7:5. doi: 10.3389/fncir.2013.00005

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Wallach, A., Eytan, D., Gal, A., Zrenner, C., and Marom, S. (2011). Neuronal response clamp. Front. Neuroeng. 4:3. doi: 10.3389/fneng.2011.00003

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Weihberger, O., Okujeni, S., Mikkonen, J. E., and Egert, U. (2013). Quantitative examination of stimulus-response relations in cortical networks in vitro. J. Neurophysiol. 109, 1764–1774. doi: 10.1152/jn.00481.2012

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Zrenner, C., Eytan, D., Wallach, A., Thier, P., and Marom, S. (2010). A generic framework for real-time multi-channel neuronal signal analysis, telemetry control, and sub-millisecond latency feedback generation. Front. Neurosci. 4:173. doi: 10.3389/fnins.2010.00173

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Keywords: neural network, control, closed loop, stability, electrophysiology, response fluctuations, multi-electrode array

Citation: Keren H and Marom S (2014) Controlling neural network responsiveness: tradeoffs and constraints. Front. Neuroeng. 7:11. doi: 10.3389/fneng.2014.00011

Received: 11 February 2014; Accepted: 10 April 2014;
Published online: 29 April 2014.

Edited by:

Paolo Del Giudice, Italian National Institute of Health, Italy

Reviewed by:

Michele Giugliano, University of Antwerp, Belgium
Sergio Martinoia, University of Genova, Italy
Liang Guo, The Ohio State University, USA

Copyright © 2014 Keren and Marom. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Hanna Keren, Network Biology Research Laboratory, Technion - Israel Institute of Technology, Fischbach Building, Haifa 32000, Israel e-mail: hannyk@tx.technion.ac.il

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.