Part of this article's content has been mentioned in:
New Perspectives on the Dialogue between Brains and Machines
- Laboratory for Neuroengineering, Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University School of Medicine, Atlanta, GA, USA
A commentary on
New perspectives on the dialogue between brains and machines
by Ferdinando A. Mussa-Ivaldi, Simon T. Alford, Michela Chiappalone, Luciano Fadiga, Amir Karniel, Michael Kositsky, Emma Maggiolini, Stefano Panzeri, Vittorio Sanguineti, Marianna Semprini and Alessandro Vato.
Brain-machine interfaces (BMIs, or brain-computer interfaces, BCIs) have caused a lot of excitement in the past few years; they promise to make the lame walk, the mute talk, the blind see, and perhaps even to enhance cognition (Serruya and Kahana, 2008). Already, cochlear implants have proven immensely successful at making the deaf hear: over 150,000 completely deaf people can now participate in two-way oral communication with the rest of the hearing world, thanks to multi-electrode stimulation of their cochlear nerves, controlled by compact, even stylish, miniature computers worn behind their ears (Chorost, 2006). Deep-brain stimulators have also been quite successful at modulating aberrant neural activity to alleviate Parkinsonism, chronic pain and tremor, among other disorders (Gross, 2004). Artificial retinas for the blind (Yanai et al., 2007), voices for locked-in patients (Brumberg et al., 2010), and neurally-controlled robotic limbs for amputees (Ojakangas et al., 2006) have been substantially less successful, but progress seems to be accelerating. What is holding them back? Perhaps we are only beginning to appreciate the complexity and dynamics of the neural circuits involved.
Motor BMIs to date have been unidirectional, with, for example, neural recordings controlling a robotic limb using only visual feedback. Great advances in usability, dexterity, acceptance, or reduced cognitive load may occur when they include sensory feedback (tactile, temperature, proprioception) delivered directly to the nervous system via electrical stimulation. Even for sensory prostheses and deep-brain stimulators, it may prove useful to continuously monitor neural responses to stimulation, and adjust the stimulation to optimize function or therapeutic benefits. In the future, sensory, motor, and modulatory BMIs are likely to take advantage of a continuous dialog between the nervous system and artificial computational devices.
Bridging the large chasm between the present and that closed-loop future will certainly require much basic research using reduced preparations. Mussa-Ivaldi and co-workers have pioneered bidirectional BMIs between simple nervous systems maintained in vitro, and artificial robotic bodies ( Reger et al., 2000; Kositsky et al., 2009; Mussa-Ivaldi et al., 2010). These hybrid living/artificial robots (or hybrots, Potter, 2004) are simpler than intact animals, having fewer and more well-defined signals, which are under control of the experimenter.
Mussa-Ivaldi and co-workers studied the dynamics of a vestibular circuit in the lamprey brainstem, giving it an artificial body – a small wheeled robot – that was controlled by the lamprey brain’s motor output signals. The robot’s light sensors were translated (in real-time) into frequency-coded electrical stimuli for the vestibular circuit. By observing the neurally-controlled robot’s responses to light input, the dynamical dimension of the neural system could be estimated; that is, the number of free parameters in a set of equations that can accurately predict the system’s input-output behavior. Initial attempts to model the system with linear, and then with nonlinear (e.g., 4th-order polynomial) equations proved inadequate. Models in which current output is a function of recent output, i.e., using a simple first-order dynamic component, fared much better at accurately describing the system’s behavior, even with fewer free parameters. This points to the dynamical dimension as an important property of neural circuits, which can be estimated in hybrid systems as the difference between the known dimensionality of the artificial component (the robot), and the dimensionality of the whole system, which can be measured.
Thanks to their controllability and relative simplicity, artificially embodied in vitro networks provide excellent test beds for studying plasticity mechanisms. Using cortical networks cultured on multi-electrode arrays, several groups have demonstrated that the input-output functions of the networks can be reliably altered by multi-electrode stimulation, to effect desired behavior or normalize aberrant activity patterns (Wagenaar et al., 2005; Novellino et al., 2007; Bakkum et al., 2008; Chiappalone et al., 2008; Marom et al., 2009). It is not hard to imagine that this electrical training and modulation of cortical tissue could form the basis of future adaptive, closed-loop BMIs. The continuous electrical dialog would take advantage of brain plasticity to enhance functionality or merely to allow the user to adjust to the neural interface more quickly and easily. The ideal system also would have “learning” on the artificial side, such as the optimization of a set of nonlinear “force fields” that most effectively map recorded neural activity onto (artificial) motor behavior, or map artificial sensory input (or desired neuromodulation) onto neural stimulation.
References
Bakkum, D. J., Chao, C. H., and Potter, S. M. (2008). Spatio-temporal electrical stimuli shape behavior of an embodied cortical network in a goal-directed learning task. J. Neural Eng. 5, 310–323.
Brumberg, J. S., Nieto-Castanon, A., Kennedy, P. R., and Guenther, F. H. (2010). Brain–computer interfaces for speech communication. Speech Commun. 52, 367–379.
Chiappalone, M., Massobrio, P., and Martinoia, S. (2008). Network plasticity in cortical assemblies. Eur. J. Neurosci. 28, 221–237.
Chorost, M. (2006). Rebuilt: How Becoming Part Computer Made Me More Human. Boston: Houghton Mifflin Co.
Gross, R. E. (2004). Deep brain stimulation in the treatment of neurological and psychiatric disease. Expert Rev. Neurother. 4, 465–478.
Kositsky, M., Chiappalone, M., Alford, S. T., and Mussa-Ivaldi, F. A. (2009). Brain-machine interactions for assessing the dynamics of neural systems. Front. Neurorobotics 3:1. doi:10.3389/neuro.12.001.2009.
Marom, S., Meir, R., Braun, E., Gal, A., Kermany, E., and Eytan, D. (2009). On the precarious path of reverse neuro-engineering. Front. Comput. Neurosci. 3:5. doi:10.3389/neuro.10.005, 2009.
Mussa-Ivaldi, F. A., Alford, S. T., Chiappalone, M., Fadiga, L., Karniel, A., Kositsky, M., Maggiolini, E., Panzeri, S., Sanguineti, V., Semprini, M., and Vato, A. (2010). New perspectives on the dialogue between brains and machines. Front. Neurosci. 4, 44–52. doi:10.3389/neuro.01.008.2010.
Novellino, A., D’Angelo, P., Cozzi, L., Chiappalone, M., Sanguineti, V., and Martinoia, S. (2007). Connecting neurons to a mobile robot: an in vitro bidirectional neural interface. Comput. Intell Neurosci. 1–3. doi:10.1155/2007/12725.
Ojakangas, C. L., Shaikhouni, A., Friehs, G. M., Caplan, A. H., Serruya, M. D., Saleh, M., Morris, D. S., and Donoghue, J. P. (2006). Decoding movement intent from human premotor cortex neurons for neural prosthetic applications. J. Clin. Neurophysiol. 23, 577–584.
Potter, S. M. (2004). “Hybrots: hybrids of living neurons and robots for studying distributed neural dynamics,” in Neurobotic Models in Neuroscience and Neuroinformatics Session, 8th International Conference on the Simulation of Adaptive Behavior 2004 (Los Angeles: International Society for Adaptive Behavior)
Reger, B. D., Fleming, K. M., Sanguineti, V., Alford, S., and Mussa-Ivaldi, F. A. (2000). Connecting brains to robots: an artificial body for studying the computational properties of neural tissues. Artif. Life 6, 307–324.
Serruya, M. D., and Kahana, M. J. (2008). Techniques and devices to restore cognition. Behav. Brain Res. 192, 149–165.
Wagenaar, D. A., Madhavan, R., Pine, J., and Potter, S. M. (2005). Controlling bursting in cortical cultures with closed-loop multi-electrode stimulation. J. Neurosci. 25, 680–688.
Citation: Potter SM (2010) Closing the loop between neurons and neurotechnology. Front. Neurosci. 4:15.doi: 10.3389/fnins.2010.00015
Received: 22 February 2010;
Paper pending published: 26 February 2010;
Accepted: 26 February 2010;
Published online: 15 September 2010
Copyright: © 2010 Potter. This is an open-access publication subject to an exclusive license agreement between the authors and the Frontiers Research Foundation, which permits unrestricted use, distribution, and reproduction in any medium, provided the original authors and source are credited.
*Correspondence: steve.potter@bme.gatech.edu