Elaine Astrand
Claire Wardak
Suliann Ben Hamed- CNRS, Cognitive Neuroscience Center, UMR 5229, University of Lyon 1, Bron Cedex, France
Brain–machine interfaces (BMIs) using motor cortical activity to drive an external effector like a screen cursor or a robotic arm have seen enormous success and proven their great rehabilitation potential. An emerging parallel effort is now directed to BMIs controlled by endogenous cognitive activity, also called cognitive BMIs. While more challenging, this approach opens new dimensions to the rehabilitation of cognitive disorders. In the present work, we focus on BMIs driven by visuospatial attention signals and we provide a critical review of these studies in the light of the accumulated knowledge about the psychophysics, anatomy, and neurophysiology of visual spatial attention. Importantly, we provide a unique comparative overview of the several studies, ranging from non-invasive to invasive human and non-human primates studies, that decode attention-related information from ongoing neuronal activity. We discuss these studies in the light of the challenges attention-driven cognitive BMIs have to face. In a second part of the review, we discuss past and current attention-based neurofeedback studies, describing both the covert effects of neurofeedback onto neuronal activity and its overt behavioral effects. Importantly, we compare neurofeedback studies based on the amplitude of cortical activity to studies based on the enhancement of cortical information content. Last, we discuss several lines of future research and applications for attention-driven cognitive brain-computer interfaces (BCIs), including the rehabilitation of cognitive deficits, restored communication in locked-in patients, and open-field applications for enhanced cognition in normal subjects. The core motivation of this work is the key idea that the improvement of current cognitive BMIs for therapeutic and open field applications needs to be grounded in a proper interdisciplinary understanding of the physiology of the cognitive function of interest, be it spatial attention, working memory or any other cognitive signal.
Introduction
Only a couple of decades ago imagining an interface between the human brain and a machine was more of a science fiction than of a scientific endeavor. Chapin et al. (1999) pioneered the field with the first demonstration of a real time motor brain–machine interface (BMI) that is the demonstration that brain activity from the rat motor cortex can be used to control a robotic arm. This achievement brought about the realization of the enormous potential of the field, which up to this day has not ceased to expand.
The main objective of motor BMIs is the rehabilitation of patients with major motor deficits yet preserved cortical motor functions. Applications involve for example controlling a screen cursor using motor or premotor cortex brain activity in monkeys (Serruya et al., 2002; Taylor et al., 2002; Santhanam et al., 2006; Kim et al., 2011) and in tetraplegic human patients (Hochberg et al., 2006) which has been proven feasible with a remarkable spatial accuracy. As computer-assisted aids continue to permeate our everyday life environments, this approach is expected to grant patients who have difficulties moving their arms or hands an increased autonomy and freedom of action. Pushing BMIs yet a step further, several studies show that motor cortical activities can also be used to control robotic arms in their reaching and grasping components with an impressive degree of precision, both in monkeys (Carmena et al., 2003; Tillery et al., 2003; Lebedev et al., 2005; Velliste et al., 2008; Ifft et al., 2013) and in humans. This has for example allowed a tetraplegic patient to help herself with a drink with the aid of an artificial arm controlled by her motor cortex activity (Hochberg et al., 2012).
Several new directions are currently being explored by BMI research. For example, a recent study demonstrates that incorporating sensory feedback to a motor brain-computer interface (BCI) improves its performance (Suminski et al., 2010). Along another line, Shanechi et al. (2014) demonstrate that the signals decoded from the motor cortical activity recorded in a monkey performing a sensorimotor task can be used to stimulate the spinal cord and muscles of a second anesthetized monkey giving rise to directed movements of its limb toward distinct targets. This study opens new rehabilitation perspectives for paralyzed patients. The exhaustive review of the major advances in motor BMIs and their novel perspectives is however beyond the scope of the present review.
Basic Principles Underlying Brain–Machine Interfaces
The basic concept behind BMIs is the interpretation, in real time, of cortical neuronal population activities and their translation into a goal directed action through a diversity of external effectors (Figure 1A). Developing a BMI includes two distinct phases (Figure 1B): (1) a learning or training phase during which a classifier learns to associate the observed instantaneous simultaneous activity of a neuronal population with the actual state of the variable of interest (the position of a stimulus in space, the direction of an intended motor plan, the spatial location of visuospatial attention, or the content of short term memory etc.); (2) a testing phase during which the classifier defined in the learning phase is used to define the most probable state of the variable of interest, given the observed instantaneous simultaneous activity of the recorded neuronal population. Above-chance decoding accuracy indicates that the neuronal population contains reliable information about the variable of interest.
FIGURE 1. From brain signals to controlled external effectors. (A) Schematic representation of the workings behind brain–machine interfaces (BMI). (B) Open loop BMI. The subject is here implanted with intracortical electrodes in the primary motor cortex. The activity of this cortical region is used to select a target on the screen without the subject being required to adjust his or her neuronal activity. (C) Closed loop design. The activity of the motor cortex is used to guide a cursor on the screen. The subject sees the screen cursor in real time and is required to adapt his or her brain activity in order to increase the precision of the cursor’s trajectory.
In its simplest form, the mapping between the neuronal code and the desired output relies on the interpretation of the subject’s endogenous neuronal codes. For example identifying the neuronal codes with which a set of movements is encoded in the motor cortex allows to associate a given neuronal population activity (e.g., corresponding to moving one’s arm left) with a specific spatially congruent external effector output (e.g., moving a cursor left, Figure 1B). More complex designs are further based on the adaptive capabilities of the primate cortex and rely on learning and positive reinforcement procedures. In these designs, subjects learn to produce the neuronal population activities that best control the effector output, thanks to a sensory feedback (e.g., seeing the cursor’s trajectory) that allows them to assess how well they are successful at controlling the external effector (Figure 1C).
Cognitive Brain–Machine Interfaces (cBMI)
While most of the research effort in neural prosthetics has concentrated on the use of motor signals to drive external devices, new directions in the field of BMIs are also emerging. For example, Musallam et al. (2004) have shown, in the context of motor behavior, that cognitive signals such as the expected value of a reward, i.e., the subject’s motivation, can be decoded, at the single trial time scale, from parietal neural activity. Jerbi et al. (2009) show that such signals as attention orientation signals and mental calculation signals can be used to drive a cognitive BCI. Instead of decoding movement-related signals from motor specific cortical activity, these cognitive BMIs (cBMIs) seek to access the content of cognitive processes. One of their principal long-term goals is to develop therapeutic tools for the treatment of cognitive disorders.
In healthy subjects, motor cortical commands can be objectified and time-locked to overt limb displacements. In contrast, cognitive processes, such as planning, holding information in short-term memory or orienting one’s attention in the environment, are essentially internal subjective processes. From a behavioral point of view, their content is covert and can be inferred only indirectly from their effects on other overt measures (e.g., oral report, reaction time measures, detection rates etc.). From a neurophysiological point of view, their neural bases are increasingly understood and clear neuronal signatures can be assigned to them. However, unlike sensory or motor processes, these cognitive processes cannot be precisely time-locked to objective external events. In addition, they are often multiplexed with sensory, motor as well as other cognitive signals. As a result, cBMIs currently appear as more challenging than motor BMIs. The present review focuses on a major cognitive function, namely visuospatial attention (Figure 2A), which is known to enhance visual processing both at the behavioral (Figure 2B) and neurophysiological levels (Figure 2C, see below). It proposes a precisely quantified comparative overview of the different cBMI approaches that have been developed to decode this cognitive signal at the scale of the single trial (Figure 2D). It also explores the initial steps at using such cBMIs for cognitive rehabilitation purposes. These studies are discussed in the light of the accumulated knowledge about the psychophysics, anatomy, and neurophysiology of visual spatial attention. The core motivation of the present review is the key idea that the improvement of current cBMIs for therapeutic and open field applications needs to be grounded in a proper interdisciplinary understanding of the physiology of the cognitive function of interest, be it spatial attention, working memory or any other cognitive signal.
FIGURE 2. (A) Covert orienting of attention involves selecting a peripheral location in space (here *) while the eyes remain at the center of the screen. (B) Attention orientation results in faster response times and higher detection rates in response to visual stimuli presented at the attended location, as compared to the non-attended location. (C) Attention orientation enhances both the phasic and tonic neuronal response components in several cortical areas including the frontal eye fields (FEF). Schematic representation of this effect onto multi-unit neuronal activity. (D) Online monitoring of the spatial locus of attention. On the left: the subject is covertly moving his attention to covertly explore the screen. On the right: the decoder interprets in real time the activity related to the subject’s attention orientation.
Visuospatial Attention and its Neural Correlates
Orienting one’s attention toward a given location in space enhances visual processing at that location (Figure 2B). Reaction times are faster (Posner et al., 1980, but see also Albares et al., 2011), spatial processing (Bashinski and Bacharach, 1980; Prinzmetal et al., 2005; Ibos et al., 2009) and spatial resolution are enhanced at the attended location (Yeshurun and Carrasco, 1998; Gobell and Carrasco, 2005; Carrasco and Yeshurun, 2009; Anton-Erxleben and Carrasco, 2013) and spatial representation is distorted up to several degrees away from the attended location (Wardak et al., 2011a). At the neuronal level, attention is described to modulate both the baseline (e.g., Armstrong et al., 2009; Ibos et al., 2013) and the visual responses (e.g., McAdams and Maunsell, 1999), to decrease neuronal response latency (Lee et al., 2007), as well as to modify the neurons’ spatial selectivity profiles (Ben Hamed et al., 1997, 2002; Anton-Erxleben et al., 2009). At the neuronal population level, attention is also thought to decrease interneuronal correlations (Cohen and Maunsell, 2009).
Spatial orienting of attention can be achieved through two different mechanisms. It can either be driven by external stimuli that capture attention. This mechanism is referred to as exogenous, bottom-up or involuntary attention. Alternatively, attention can be voluntarily driven by internal goals. This mechanism is referred to as endogenous, top-down or voluntary attention. Early on, Posner et al. (1980) and Jonides (1981) suggested that a single cortical system controls both the endogenous and the exogenous orientation of attention. In contrast with this proposal, Müller and Rabbitt (1989) postulated that the endogenous and exogenous orienting of attention are functionally distinct and constitute separate mechanisms in constant competition with each other (e.g., Zénon et al., 2008, 2009). Confirming this view, recent functional magnetic resonance imaging (fMRI)-studies demonstrate the co-existence of two distinct frontoparietal networks involved in orienting attention (Corbetta and Shulman, 2002): a dorsal network that is active during top-down attentional control, i.e., when attention is internally maintained or voluntarily driven (Kastner et al., 1999; Shulman et al., 1999; Corbetta et al., 2000; Hopfinger et al., 2000; Kincade et al., 2005), and a ventral network that is activated when attention is reoriented both voluntarily and by relevant but unexpected stimuli (Arrington et al., 2000; Corbetta et al., 2000; Macaluso et al., 2002; Kincade et al., 2005; Vossel et al., 2006). In the non-human primate, a bilateral frontoparietal attentional network involving the frontal eye fields (FEF; Bruce and Goldberg, 1985) and the lateral intraparietal area (LIP; Barash et al., 1991; Ben Hamed et al., 2001) is described. These areas are activated by both endogenously driven attention and exogenously driven attention to task-relevant stimuli (Gottlieb et al., 1998; Armstrong et al., 2009; Gregoriou et al., 2009; Suzuki and Gottlieb, 2013). Interestingly, during endogenous top-down driven attention, FEF neurons tend to respond earlier than LIP neurons whereas during exogenous bottom-up driven attention, the inverse is observed (Buschman and Miller, 2007; Ibos et al., 2013). The distinction between a dorsal and a ventral frontoparietal network is still unclear in the macaque monkey. The FEF possibly belongs to a putative monkey dorsal attentional network while area 45, ventral to area FEF, possibly belongs to a putative monkey ventral attentional network (Wardak et al., 2011b).
Visuospatial Attentional Signals from a cBMI Perspective
Time-Locking
The feasibility of cBMIs based on visuospatial attention signals as compared to motor or sensory BMIs depends on the existence of neuronal population activity patterns that distinguish between whether the subject is orienting its attention say to the left or to the right of the visual field. The P300 speller is an example of a successful non-invasive cBMI driven by the decoding of visuospatial attentional locus as inferred from the modulation of neuronal responses to a visual stimulus presented at the specific locus of attention. Another approach is to decode sustained attentional brain correlates toward different spatial positions from neuronal population activities. This approach is different because decoding such sustained information cannot be precisely time-locked to an external event. As a result, identifying its precise neuronal activation pattern during the training phase of the decoding is in itself a challenge.
Decoding Attention-Related Cortical Information
One important question is whether such attentional information, because of its self-initiated endogenous nature, can be decoded with an accuracy that is comparable to that obtained from sensory and motor related activities. Two studies are interesting in this respect. Armstrong et al. (2009) recorded neuronal responses from the macaque FEF while the animals were involved in a cued target detection task. The cue was an exogenous cue, having the same spatial location as the target. Astrand et al. (2014a) also recorded neuronal responses from the macaque FEF while the animals were involved in a cued target detection task, except that in this case, the cue was calling for an endogenous orienting of attention toward the cued location (FarbodKia et al., 2011; Astrand et al., 2014a). An exogenous cue is thought to involuntarily shift the subject’s attention to its location whereas to shift attention to a location indicated by an endogenous cue, the subject needs to voluntarily orient its attention toward it (Jonides, 1981). Both studies thus manipulate spatial attention but the cue that was used called for different orientation processes. Armstrong et al. (2009) show that both visual and sustained attention information can be decoded from a macaque FEF population of neurons modulated both by visual stimuli and attention orientation. Specifically, they report 100% accuracy for the decoding of the spatial location of a visual peripheral stimulus and up to 90% accuracy for the decoding of the spatial locus of sustained attention. They also describe a lower decoding variability for a visual stimulus than for sustained attention. Astrand et al. (2014a) report a similar trend on a random neuronal population selection including both attention-selective neurons and attention non-selective neurons. They further quantify the sensitivity of decoding accuracy to neuronal population size and trial number. In addition, they show that, using populations of visual-selective and attention-related neurons of the exact same size, comparable decoding accuracies are obtained for both variables. This is a strong indication that both exogenous (visual) and endogenous (attention-related) information are encoded in the cortex with a similar reliability. As a result, cognitive variables such as attention can be expected to be decoded from neuronal population activities with similar accuracies as those achieved when decoding sensory or motor variables (for example, see Ben Hamed et al., 2003, 2007).
Using Attention-Related Signals to Control a Brain–Machine Interface
In the following, we will present an overview of recent studies evaluating the accuracy with which attention-related cortical information can be decoded. These range from non-invasive recording studies in humans [MagnetoEncephaloGraphic recordings (MEG), Electroencephalographic (EEG) recordings and fMRI] to invasive recording studies in human (ECoG) and non-human primate [ECoG, multi-unit neuronal activity (MUA) recordings and single-unit neuronal activity (SUA) recordings] subjects (Figure 3). Whenever possible, we document for each study the following information (Table 1): (1) the type of signal component each study relies on, (2), whether attention is driven endogenously or exogenously, (3) how well each method succeeds at decoding attentional engagement signals (i.e., the fact that the subject is focusing its attention as compared to no attentional focus), (4) how well each method allows to distinguish between left and right attentional orientation, (5) how well each method allows to distinguish between attentional loci situated in the same visual hemifield, and (6) how visual distractors interfere with the decoding of attention. Points 4 and 5 reflect the spatial resolution with which attention-related signals can be accessed. All this comparative information is presented in Table 1. Importantly, to be considered as robust, it has been proposed that BCI performance needs to be above 70% (Kübler et al., 2004, 2006), a threshold accuracy to keep in mind while analyzing Table 1.
FIGURE 3. Different recording methods used to control BMIs. Invasive methods includes: ECoG electrodes placed on the dura, SEEG electrodes placed through the skull into the cortex and intracortical electrodes implanted in the cortex. Non-invasive methods include: EEG electrodes placed on the scalp and MEG squids placed around the head.
TABLE 1. Comparative overview of the non-invasive EEG and MEG and invasive ECoG, SEEG and neuronal recording studies, in humans and non-human primates, that have aimed at decoding attention-related information from the ongoing neuronal activity in a perspective of using these signals to drive BMIs.
Non-Invasive Studies in Humans (MEG, EEG, and fMRI)
The first attempt at decoding attention orientation at the single trial level is that of van Gerven and Jensen (2009). The authors recorded the cortical activity using MEG while subjects were covertly attending to one amongst four possible locations in space, previously indicated by an endogenous central cue. Analyzing these signals offline, and specifically the alpha-band power (8–14 Hz) of the parieto-occipital captors, they report an average decoding performance of 69% when discriminating between two possible spatial locations (chance being at 50%). They observe better decoding performances at discriminating left/right locations (78%, average calculated over their best subjects) than up/down locations (58%, ibid). They additionally report an average decoding performance of 41% when discriminating between four possible spatial locations (chance being at 25%). This study thus provided the first evidence that endogenous spatial orientation of attention can potentially be monitored in real time. A subsequent EEG study, using a very similar experimental design reports an average performance of 75% (chance being at 50%) based on the alpha power of the recorded signals (Treder et al., 2011). Morioka et al. (2014), report a slightly higher average decoding performance (79%) using near-infrared spectroscopy (NIRS) as prior information for the analysis of the EEG signals. It is however not clear if this improved performance results from using the NIRS prior information or is due to the fact that an exogenous cue was used instead of an endogenous cue. Using fMRI, Andersson et al. (2011, 2012) take the field one step further by decoding, in real time, the spatial orientation of attention between three endogenously cued locations (one central and two peripheral locations, 2011) and five endogenously cued locations (one central and four peripheral locations, 2012).When using an adaptive threshold on the classification of the real-time BOLD signal, thanks to a real-time design, they obtain a decoding performance of attention orientation (79, 75% at decoding attention to the left and 85% at decoding attention to the right) equal to that obtained with EEG. In contrast with van Gerven and Jensen (2009), they demonstrate a slightly better performance at discriminating between up/down attention (82%) than between left/right attention (77%). When reprocessed offline the average decoding performances reported by Andersson et al. (2011, 2012) reaches 88% (89% at decoding attention to the left and 88% at decoding attention to the right).This sets the ground for a promising future in the field of attention cBMI. Importantly, it is to be noted that all of these non-invasive studies aiming at decoding spatial attention signals from human cortical activities report an important intersubject variability, overall attention orientation decoding performance being high in some subjects and almost at chance in other subjects. See Table 1 for comparison of the above studies.
Invasive Studies in Humans (ECoG)
Drawing nearer to the source of the cortical signals, ECoG studies in patients implanted for clinical purposes predicted higher performances for decoding spatial attention than non-invasive techniques. Gunduz et al. (2012) report a performance of 84% at decoding whether a subject is engaging its spatial attention or not using the spectral power amplitude from all frequency bands and a performance of only 48% at decoding the location of attention amongst three possible spatial positions (chance at 33%). Andersson et al. (2011) focus on the high gamma power and report an average of performance of 70% in a similar design (chance at 33%). The discrepancy between these two studies most probably reflects the dependence of the decoding performance upon the exact localization of the ECoG electrode arrays in each subject. Interestingly, Andersson et al. (2011) used the exact same design to decode spatial attention both from ECoG implanted patients and from subjects included in the fMRI experiment described in the previous section. Surprisingly enough, the average decoding performance is higher in the fMRI-based non-invasive approach than in the ECoG implanted patient. This is most probably due to the fact that the fMRI-based protocol specifically relies on the analysis of the regions of interest (ROIs) that are specifically activated by attention orientation, while the ECoG recording correspond to an averaged smoothed analog of these signals. See Table 1 for comparison of the above studies.
Invasive Studies in Non-Human Primates (ECoG, SUA, MUA)
These approaches are expected to yield the highest decoding performances as compared to the two previous approaches, due to the fact that the recording are specifically targeted to the cortical regions involved in attention processing (closest to these regions, on the cortical surface for ECoG, and right within these regions for MUA and SUA recordings), though the number of simultaneously recorded signal sources is also a variable to take into account (the higher the number of recording contacts, the higher the expected decoding performance). MUA can be considered as averaged SUA, as MUA represents several neurons at the same time while SUA represents well identified individual neurons. In a very elegant study, Rotermund et al. (2013) demonstrate extremely high accuracies in discriminating between two exogenously driven attentional loci (average 96%), with slightly better performance for two attentional loci situated in the same visual hemifield (99%) as compared to two attentional loci situated in different visual hemifields (94%), in agreement with the non-invasive fMRI driven study by Andersson et al. (2012). Importantly, Rotermund et al. (2013) placed the ECoG array onto the visual areas V1 and V4 the activity of which is known to be strongly modulated by attention, according to a strict topography matching attention allocation. While these areas can functionally be considered as downstream from the parietofrontal network described above, the fact that attention can be decoded with such high performances from these regions is noteworthy given that these areas are not expected to be subjected to eye-movement or motor planning interferences that can possibly degrade the decoding of spatial attention in other cortical regions (see below). This performance is to be compared with the performance of 90% at predicting the location of attentional locus amongst two possible locations (inside or outside the receptive field) following an endogenous cue (Armstrong et al., 2009), when using the SUA of attention-selective cells recorded in the monkey prefrontal cortex (FEF). Astrand et al. (2014a) report that it is possible to predict whether a monkey was orienting its attention to the right or to the left visual field from the activity of a cortical population of mixed selectivities (attentional and non-attentional) with a performance of 82%. Both these studies (Armstrong et al., 2009; Astrand et al., 2014a) correspond to a coarse approximation of real-time decoding of attention orientation, as they involve the artificial concatenation of cells recorded in independent sessions and having different spatial selectivities. More recently, Astrand et al. (2014b) report, in a real-time decoding design, a 67% performance at discriminating between four possible attentional locations from MUA recordings in the FEF, following an endogenous cue (79% when attention is oriented exogenously). The performance with which they can predict whether the monkey has engaged its attention or not is around 90% for endogenous cueing (98% when attention is oriented exogenously).
Dependence of Decoding Performance on the Experimental Design
Classification accuracy increases as a function of the number of recorded signals and as a function of the number of available training trials (e.g., Armstrong et al., 2009; Astrand et al., 2014a). The impact of these two parameters on classification accuracy depends on the classification algorithm being used. Indeed, regularized linear regression classifiers appear to be more resilient to low number of recorded signals and low number of trials than other decoders (e.g., support vector machine, reservoir, linear regression, see Astrand et al., 2014a). The impact of these two parameters on classification accuracy also depends on how much information about the variable of interest is present in each recorded signal. For example, a 75% decoding performance of spatial attention can be achieved with as few as 15 trials per condition when each recorded signal has been selected on the basis of its high attention-related content (e.g., attention-related cells in SUA decoding studies). When no prior selection is exerted onto the recorded signals, up to 80 trials are required to reach this 75% decoding performance (Astrand et al., 2014a). As the number of recorded signals and/or the number of trials increases, the impact of further increasing any of these two parameters onto the decoding performance decreases (Astrand et al., 2014a). Table 2 summarizes, for each of the different studies decoding spatial attention discussed above, the number of recorded signals and how they are placed with respect to the brain, the classifier being used as well as the number of available trials for the classification analysis. In general, there appears to be a trade-off between the number of recorded signals and the number of trials required to achieve a high decoding performance (Astrand et al., 2014a). A precise quantification of this trade-off per type of recorded signal, from non-invasive to invasive, is unfortunately missing and would be extremely useful. This would allow a more direct comparison between the different types of studies. But most importantly, this would allow to better adjust the experimental design to the constraints of the method being used. One expects for example that a higher number of trials will significantly improve the decoding performance achieved in implanted patients. Quantifying this trade-off is all the more important if we want to move from a two-class decoding design (e.g., left/right) to a multi-class (e.g., upper left/upper right/lower right/lower left) or to a 2D continuous decoding design (e.g., x, y), in which case, the number of available trials per condition clearly becomes a limitative parameter.
TABLE 2. Comparative overview of the type of signals used for the decoding of spatial attention in the studies discussed in Table 1.
Overall, most of these studies report a decoding performance above the 70% criteria for a robust BMI (Kübler et al., 2004, 2006). However, in spite of the fact that several experimental parameters contribute to the final decoding performance, invasive attention-based approaches in the non-human primate produce the highest decoding performances as compared to both invasive and non-invasive recording approaches in humans. This provides grounds of improvement for the latter. This is most probably due to the fact that the recordings can be performed closest to the source of the attention-related signals. Supporting this hypothesis, fMRI decoding of spatial attention (driven by activations in ROIs specifically identified based on their contribution to spatial attention processes) outperforms all other non-invasive decoding approaches.
Challenges of Attention-Driven Cognitive Brain–Machine Interfaces
Endogenous Versus Exogenous Attention
As seen above, attention can be voluntarily controlled by the subject or involuntarily oriented by an external event. An efficient cBMI is expected to be able to infer spatial attention signals independently of how attention has been driven. Given the functionally partially distinct neural bases of endogenous and exogenous attention orientation, it is thus crucial to quantify, from a cBMI perspective, (1) whether both types of attention orientation modes lead to comparable decoding accuracies, i.e., whether the performance of a cBMI driven by endogenous attention signals is comparable to that of a cBMI driven by exogenous attention signals; and (2) whether a cBMI driven by say endogenous attention signals can generalize and also be driven by exogenous attention signals and vice versa. As discussed above, a recent study shows that the decoding of spatial attention during a cued target detection task from MUA recordings in the non-human primate FEF is partially dependent on whether attention is oriented endogenously or exogenously (Astrand et al., 2014b). Importantly, the decoding performance of exogenous attention signals (79%) is higher than that obtained when decoding endogenous attention signals (67%). Most interestingly, they additionally show that a classifier trained at decoding endogenous attention successfully reads out exogenous spatial attention neuronal signals (54%), though significantly less than if the classifier is directly trained on exogenous attention (drop of 13%). The relationship is not symmetrical as a classifier trained at decoding exogenous attention successfully reads out endogenous spatial attention neuronal signals with a performance of 62%, again slightly lower than if the classifier is directly trained on endogenous attention (drop of 5%).
Susceptibility of Attention-Driven Cognitive Brain–Machine Interfaces to Sensory and Cognitive Factors
Neuronal signals collected from the primary motor cortex are only marginally affected by changes in the sensory environment (e.g., changes in the visual or somatosensory information) or by changes in the cognitive context (e.g., changes in what the subject is thinking about or planning to do). As a result, the generalization capabilities of motor BMIs are unaffected by such varying circumstances. It is still unclear whether this is also the case for cBMIs. While the several studies cited above quantified how well a cognitive variable, namely spatial attention, can be predicted from cortical activity response patterns, none directly tested whether and how this prediction was affected by either a change in the sensory environment or in the cognitive context. A recent report by Astrand et al. (2013) shows that the decoding of spatial attention orientation during the delay period of a memory-guided saccade task is affected by the presence of visual noise. Precisely, they report a 62% performance at decoding spatial attention orientation and spatial short-term memory information from MUA activities recorded in the non-human primate FEF during the delay period of a memory-guided saccade task in the absence of any visual noise and a performance of 63% in the presence of visual noise. When a classifier is trained at decoding this spatial attention orientation in the absence of visual noise and is tested on MUA activities collected in the presence of visual noise (or vice versa) performance drops by 12%, though it remains well above chance. The decoding of spatial attention signals are thus affected by changes in the sensory environment. Astrand et al. (2013) similarly show that the decoding of the spatial position of a visual stimulus from MUA activities recorded in the non-human primate FEF depends on whether the monkey is for example performing a memory-guided saccade task or a simple target detection task (decoding performance across contexts leads to a drop in 18%, Astrand et al., 2013). Last, as described above, the authors also show that the decoding performance of spatial attention depends on whether attention is oriented endogenously or exogenously, a situation that can be seen as a change in the cognitive context (Astrand et al., 2014b).
Susceptibility of Attention-Driven Cognitive Brain–Machine Interfaces to Distracters
Another important aspect to consider is how distracters affect the spatial location of attention and hence the stability of a cBMI based on spatial attention signals. Such distracters can be considered as a specific case of a sensory change in the subject’s environment (cf. above).In an urban environment where we are constantly exposed to salient stimuli, the endogenous attention that corresponds to an internal objective that the subject wishes to achieve will be continually interrupted by a diversity of external stimuli, both relevant (traffic lights, car horns, your children’s voice etc.) or irrelevant (christmas lights, traffic flow, strangers passing by etc.).Several behavioral studies show that peripheral cues automatically capture attention (Jonides and Irwing, 1981; Christ and Abrams, 2006; Neo and Chua, 2006; Schreij et al., 2008). However, attentional capture is not constant. For example, when subjects are explicitly instructed to ignore a peripheral cue, attentional capture is reduced, though not completely abolished (Lambert et al., 1987). Similarly, if attention is highly focused, for example when the subject strongly expects a visual event at a certain location (e.g., following a 100% validity cue), the attentional capture as measured from reaction times is extremely weak (Yantis and Jonides, 1990). In contrast, if the subject is expecting a visual event that can take place at an undefined location (its attention is thus diffuse, e.g., following a 25% validity cue), the attentional capture is much stronger (Yantis and Jonides, 1990). The same reduction in attentional capture can also be observed in visual search experiments where subjects need to distribute their attention over the whole search display in order to scan the scene efficiently (Schreij et al., 2008). Last, attentional capture also depends on the complexity of the visual scene (which is the case of our everyday environment). Cosman and Vecera (2009) show that, when subjects need to search for an item in a complex environment, attentional capture declines as the complexity of the visual scene increases.
These behavioral observations are in agreement with single cell recordings in the monkey parietal cortex. For example, the neurons of the LIP (Ben Hamed et al., 2001), an area functionally associated with attentional processes (Wardak et al., 2002, 2004), are specifically activated by behaviorally relevant visual events independently of whether relevance is due to the intrinsic properties of the stimuli (e.g., an abrupt onset high contrast stimulus) or to its extrinsic properties (e.g., a low contrast stimulus, the processing of which is important to the ongoing task, Gottlieb et al., 1998; Kusunoki et al., 2000). Spatial attentional priority is suggested to be encoded by the differential response between the neurons encoding a specific spatial location against the response of the entire LIP population (Bisley and Goldberg, 2003). Consequently, the selection of a spatial location by attention can be biased by focal LIP optogenetic or electrical microstimulation, mimicking an attention interference or capture (Dai et al., 2014). A recent study by Suzuki and Gottlieb (2013) further suggests that these suppression mechanisms might differ between the prefrontal and parietal nodes of the parietofrontal attentional network. Specifically, the neuronal response to distractors is weaker in the prefrontal cortex than in parietal cortex, indicating a stronger suppression. Additionally, the degree of this suppression with behavioral suppression markers is stronger in the prefrontal cortex. Last, reversible inactivation of the prefrontal cortex leads to a more severe distractability than observed following inactivation of the parietal cortex.
From a decoding perspective, Astrand et al. (2014b) show that a distracter interferes with the performance with which spatial attention can be decoded from FEF MUA recordings in the non-human primates performing a cued target detection task. As observed by others (Armstrong et al., 2009; Zhang et al., 2011), distractors interfere with the accuracy with which spatial attention can be decoded on correct trials. Astrand et al. (2014b) further show that this interference is maximal on false alarm trials, i.e., on trials in which the monkey erroneously responded to the distractor instead of waiting for the target. The distractor interference is similar between correct trials and trials on which the monkey missed the target. Remarkably, the accuracy with which spatial attention can be decoded is much lower on incorrect trials than on correct trials, whether attention has been oriented endogenously (25%) or exogenously (40%), a trend also reported by Armstrong et al. (2009).
Susceptibility of Attention-Driven Cognitive Brain–Machine Interfaces to Eye Movements
The last constraint that needs to be discussed in the context of attention-driven BMIs is eye movements. Indeed, the attentional frontoparietal network described above is highly overlapping with, though distinct from, the cortical oculomotor network (Corbetta et al., 1998; Wardak et al., 2006). In all of the studies considered above, the subjects are required to maintain eye fixation during the decoding procedure. As a result, they are behaviorally constrained to suppress an oculomotor-related signal. Studies evaluating the impact of eye movements on cBMIs are yet missing. Treder et al. (2011) demonstrate that high accuracy for EEG-based classification is often associated with low accuracy for eye movement electrooculography (EOG)-based classification, and vice versa. This suggests a dissociation between EEG- and EOG-based classification. It also indicates that eye movements disturb the decoding of attention orientation if not taken into account. Gunduz et al. (2012) further show that, in the absence of any prior processing, the performance with which attention orientation can be decoded in ECoG-implanted patients drops from 48 to 35% when the subjects are planning their motor response (i.e., hardly above the 33% chance level). This suggests that a “naïve” attention decoding performance is most probably disrupted by other signals than just eye-movements, including motor planning. The exact location of the recording sensors is expected to highly impact on such interferences. However, generally speaking, real-time denoising algorithms minimizing the impact of eye movement signals over the attention-related signals are potentially promising. Extremely simple strategies such as analyzing cortical signals only at a distance from eye movements might also prove sufficient.
Overall, in spite of the notable progress in the field of attention-driven cBMIs, several challenges need to be faced before large field therapeutical applications can be considered. A tight interaction between the field of real-time decoding of cortical activity and cognitive neurosciences is expected to have a major impact on facing these challenges, the growing understanding of how the brain functions playing a crucial role toward refined machine learning strategies to handle and analyze massive cortical recordings. This being said, prospective therapeutical application for such cBMIs can already be foreseen, as will be described below.
Neurofeedback and Cognitive Control
The capacity of the brain to restore and ameliorate its functioning after a major trauma or disease is still poorly understood. It is known that after a CNS disease or trauma (such as a stroke), the brain undergoes extensive functional reorganization (Murase et al., 2004; Nudo, 2006; He et al., 2007; Grefkes et al., 2008; Wang et al., 2010). Building on these impressive adaptive capabilities of the brain, researchers have, in the last 50 years, investigated the ability of the brain to modulate its activity and improve overt behavioral performance thanks to neurofeedback techniques. Initially, this technique consisted in continuously providing the patient with a feedback on the level of activity of a specific cortical region (e.g., thanks to an auditory or visual feedback correlating with the intensity of this cortical activity) and instructing the patient to increase or decrease this activity by their own volition. It has been proven efficient in treating patients with attention disorders and in reducing seizures in epileptic patients (reviewed below). More recent feedback techniques are not based on the raw cortical signals but rather use decoding procedures as described above in order to quantify the exact information of interest contained in the neuronal signals and provide this information as a feedback to the subjects. The subject’s goal is then to improve this specific information through cognitive control. This is a very promising tool that could be used to target specific functions in order to enhance the activity in the brain, both in patients with cognitive deficits arising from acute brain damage or neurodegenerative or neurodevelopmental conditions, as well as in normal subjects seeking to enhance their own cognitive functions.
Neurofeedback and Covert Neuronal Activity
When we are trained on a specific task, our performance often becomes better. Several studies have investigated the underlying neural bases that account for this behavioral improvement. In visual perceptual tasks that involve difficult discriminations, it has been observed that a behavioral improvement in perceptual sensitivity is strongly coupled with improved neural sensitivity in early and intermediate visual areas (Schoups et al., 2001; Yang and Maunsell, 2004; Hua et al., 2010) as well as in higher visual decision areas (Law and Gold, 2008). The idea behind neurofeedback is precisely grounded on such observations. Indeed, if the brain is capable of modulating its activity through learning, why not by voluntary control of the neuronal activity of specific brain areas? Several fMRI studies have approached this question by providing participants with a visual feedback of the level of activity (BOLD signal) in a specific area of the brain and asking them to increase or decrease this level. These studies have all come to the conclusion that brain activity can be regulated and enhanced volitionally by the subject (Weiskopf et al., 2003; deCharms et al., 2004, 2005; Caria et al., 2007; Scharnowski et al., 2014), even when trading the continuous visual feedback for a monetary reward feedback the value of which correlated with the level of activity of the cortical area of interest (Bray et al., 2007). On a neuronal level, electrophysiological studies not only confirm the above results but reveal a remarkable plasticity of individual neurons to modulate their activity under volitional control (Fetz, 1969, 2007; Cerf et al., 2010; Kobayashi et al., 2010; Schafer and Moore, 2011). For example, Fetz performed, in 1969, a visual and auditory feedback experiment where monkeys were rewarded for increasing the activity of newly isolated neurons in the precentral motor cortex. They observe that the activity could be increased with as much as 50–500% above the initial spike rates.
Neurofeedback and Overt Behavioral Performance
The above studies demonstrate the feasibility of modulating the activity of our own brain by voluntary control. The next question is thus whether this neuronal modulation has an impact on overt behavior? Being able to increase or decrease the activity in the brain is amazing but quite useless if it does not lead to a measurable change in cognitive performance. In the field of EEG neurofeedback, it has actually been known for a long time that a voluntary change in the EEG rhythm, i.e., in the frequency content of the scalp EEG signals, can improve behavior (Wyrwicka and Sterman, 1968; Sterman et al., 1969). For example, Sterman and colleagues highlighted the specific impact of the sensorimotor rhythm (SMR: 12–14 Hz) on the capacity to inhibit ongoing behavior. They used neurofeedback to regulate this electrophysiological signature and thereby the frequency of the refractory seizures of a female patient. Specifically, after several months of EEG neurofeedback training to enhance the SMR, the authors noted that the seizures essentially ceased at the same time that a significant increase in the 11–15 Hz frequency band and a corresponding decrease in lower frequencies were observed (Sterman and Friar, 1972). This initial study was followed by a wave of studies describing the clinical benefits of using EEG driven neurofeedback over placebo experimental designs on patients with seizure disorders refractory to pharmacological treatments (Sterman et al., 1974; Kaplan, 1975; Seifert and Lubar, 1975; Kuhlman and Allison, 1977; Kuhlman, 1978; Sterman and Macdonald, 1978; Lantz and Sterman, 1988; Andrews and Schonfeld, 1992; Hansen et al., 1996). A different line of research using the same technique has tried to treat attention disorders such as attention deficit/hyperactivity disorder (ADHD). The first study conducted by Lubar and Shouse (1976), showed that SMR training improved inattentive symptoms in an 11-year old boy with hyperactivity. Further studies confirm that neurofeedback training has a significant effect on reducing hyperactivity or impulsivity symptoms in ADHD (Lubar, 1991; Lubar et al., 1995; Lindén et al., 1996; Thompson and Thompson, 1998; Kaiser and Othmer, 2000). Remarkably, this SMR-driven neurofeedback has further been proven as equally effective as medication (Rossiter and La Vaque, 1995).
Several recent fMRI-based neurofeedback studies show that the operant control of cortical activity can also lead to changes in behavior and to interesting therapeutical applications. For example, Rota et al. (2009) show that the self-regulation of the activity of the right inferior frontal gyrus improves the identification of emotional prosodic intonations. Haller et al. (2010) show that the operant control of the activity of the auditory cortex allows to improve chronic tinnitus, a condition in which subjects perceive more or less constantly an aversive tone or noise, in the absence of any objective external sound source. More recently, Subramanian et al. (2011) show that the clinical motor symptoms of Parkinson disease patients can be improved thanks to neurofeedback driven by the fMRI activity of their supplementary motor area.
In a single-cell recording study in the non-human primates, Schafer and Moore (2011) show that monkeys can learn to modulate the firing rate of individual prefrontal neurons (specifically recorded in the FEF). Importantly, they show that during up-regulation sessions (as compared to down-regulation), an increased firing rate leads to enhanced target discrimination in the receptive field of that neuron. This is a nice demonstration that the voluntary control of FEF neuronal activity is specifically associated with an enhancement of selective spatial attention. It is interesting to compare the finding to Schafer and Moore (2011) in the non-human primate to those obtained by Scharnowski et al. (2012) using fMRI-driven neurofeedback in human subjects. In this study, Scharnowski et al. (2014) demonstrate that the control of the ongoing spontaneous activity as estimated by the BOLD fMRI signal in the visual cortex results in improved visual perception. The authors further show that these observations correlated with increased effective connectivity between the visual cortex and the superior parietal lobe, suggesting that the improved visual perception resulted from enhanced top-down attentional control processes. Top-down attention has been repeatedly shown to modulate the activity of early visual areas (Brefczynski and DeYoe, 1999; Kastner et al., 1999; Li et al., 2008; Gregoriou et al., 2009). The fact that operant control of the activity of visual cortex did not exclusively involve local processes restricted to this cortical region but also involved long-distance and large-scale networks is an indication that the behavioral effects of neurofeedback are maximized by the involvement of the adaptive capabilities of higher level associative cortical regions such as the parietal or the prefrontal cortex.
The above studies all have in common to require the subjects to either increase or decrease the cortical activity being recorded. Cerf et al. (2010) use a concept that is completely different. Instead of just modulating the level of activity, they ask the subjects to actually enhance the information content of the recorded population activity. Specifically, they show that by focusing attention on a concept represented by a target image, neurons in the medial temporal lobe (MTL), an area involved in generating memories of fact and events (Squire and Zola-Morgan, 1991), increase their activity. In this study twelve patients implanted with intracranial electrodes were instructed to manipulate the display of two superimposed images by modulating the firing rate of four MTL units in their brain. The initial visibility of the two images was 50% and the patients were instructed to enhance a target image so as to make it 100% visible. The visibility of the two images was continuously updated via a real-time decoding procedure reflecting the information contained in the spiking activity of these four neurons about either images. This nicely designed experiment is yet limited because the authors only used four units in the decoder which leads to a straightforward interpretation of the decoding performance. Indeed, in this configuration, an increased decoding performance directly translates into an increase in the activity of the unit specifically tuned to the target image and/or decreased activity for the other units. A decoding performance based on the increases or decreases in the information content of hundreds of neurons would result in a much more complex pattern of neuronal changes, possibly more based on functional population synergies than on the mere increase in the activity of selective cells associated with a decrease in the activity of the non-selective cells. Shibata et al. (2011) demonstrate the feasibility of such an experimental design. Participants were given feedback based on the real-time decoding of BOLD fMRI activity. The decoder was configured to discriminate between different angles of a Gabor patch (10°/70°/130°) based on the fMRI BOLD signal recorded from V1 and V2 prior to the neurofeedback procedure. During the neurofeedback sessions, the participants were instructed to enlarge a green circle presented on the screen. For each subject, the size of the green circle was manipulated by how well they could encode a given Gabor patch orientation in their fMRI BOLD activity. The specific angle driving the change in the circle’s size changed from one subject to the other. All participants succeeded in increasing the circle. They were therefore all able to increase the information content related to the assigned specific angle even though the strategies they overtly reported were far from the true workings of the experiment. Importantly, this led to an increased perceptual sensitivity specific to the angle used during feedback in contrast with the two other angles. The results of this experiment are important in several aspects. First, they prove the feasibility of human subjects voluntarily increasing their cortical information content relative to a specific visual feature. Second, they suggest that training the brain to increase its information content directly leads to an improvement in overt behavior. Third, they indicate that the improvements are specific to the exact feature that is being trained, similarly to what can be obtained through perceptual learning.
Future Directions
Cognitive Brain–Machine Interfaces for Cognitive Rehabilitation
As covered in the previous section, neurofeedback applications based on the raw or interpreted (decoded) cognitive information have already been proven efficient for several rehabilitation applications ranging from auditory tinnitus to Parkinson’s disease, seizures, ADHD. These applications are progressively infusing off the laboratory patient care protocols. For example, several start-ups are now providing ADHD EEG-based neurofeedback game platforms integrating enriched immersive virtual 3D environment technologies with neurofeedback training. A challenge facing these future directions is constructing neurofeedback environments that are optimally targeted to specific pathologies. In the above discussed examples, Parkinson’s disease clinical symptoms were improved using the activity of the supplementary motor area. ADHD was improved using the sensory motor rhythm involved in overt behavior inhibition. These conditions were thus critically improved by targeting the specific cortical nodes of the dysfunction which have been associated with the overt clinical symptoms. The further development of such rehabilitation methods based on neurofeedback will require a tight interaction between fundamental neuroscience research providing an ever growing understanding of the neural bases of cognition and its deficits and clinical neuroscience research evaluating the impact of specific neurofeedback designs on well identified groups of patients (as defined by clear-cut genotypes, functional deficits or behavioral deficits). For example, while SMR-based neurofeedback has been shown to reduce impulsivity in hyperactive ADHD patients, it is expected that ADHD patients with low hyperactivity symptoms but high inattention symptoms will not benefit by this approach, due to a different functional deficit underlying their symptoms.
Cognitive Brain–Machine Interfaces to Palliate for a Deficit in Communication
Most of these above foreseen applications will rely on non-invasive cBMI designs. However, in the case of extremely severe cognitive deficits, cost–benefit recommendations will be needed to evaluate whether invasive cBMIs are ethically acceptable. Two such conditions come to mind. The first condition is the case of total locked-in patients, who are unable to move any muscle of their body including their eyes, while they are otherwise aware and awake. The motor recovery is extremely rare and often very minimal. In a recent report, a locked-in patient was able to communicate via sniffing (Plotkin et al., 2010). Using a direct brain-interface, another total locked-in patient was able to answer yes-or-no questions (Parker, 2003; Keiper, 2006).The second condition that could justify invasive cBMIs corresponds to minimally conscious patients. Unlike patients in a persistent vegetative state, these patients have partially preserved conscious awareness. Recent studies indicate that the overall brain metabolism of these patients is 20–40% lower than that of normal subjects, though slightly higher than that of patients in a vegetative state (Schiff et al., 2005). In addition, several studies indicate some degree of preserved cognitive functions. For example, sounds result in a more widespread activation of the primary auditory and prefrontal associative areas in minimally conscious patients than in vegetative state patients (Laureys et al., 2004), more so when narratives were presented as compared to meaningless narratives played backward (Schiff et al., 2002; Coleman et al., 2007). More recently, and in tight relation with the attention-driven cBMIs discussed above, preserved exogenous attention functions and preserved underlying brain processes have been described in these patients, in association with a marked deficit in endogenous attention processes (Chennu et al., 2013). From a therapeutical perspective, deep brain thalamic stimulation has been described to improve the condition of minimally conscious patients (Laureys et al., 2007). Invasive cBMIs are also potentially interesting in this respect. In a first step, cBMIs can serve to assess and quantify the information content of the baseline or stimulus-induced cortical activity of these patients, and possibly serve to interpret part of their phenomenological experience (pain, surprise, attention, etc.). In a second step, cBMIs associated with focal stimulation approaches such as electric or optogenetic stimulations can help increase the information content of specific cortical regions. As soon as consciousness is high enough for the subject to express a preference (e.g., hearing the name of her loved ones instead of the names of strangers), this activity can be used for feedback-cBMI designs that can further help reinforce the weak yet meaningful endogenous cortical activities of minimally conscious patients. While this can seem like science fiction, all the theoretical and experimental grounds are set to make this possible.
Open Field Cognitive Brain–Machine Interfaces for Enhanced Cognition
In addition to rehabilitation, there is a growing social pressure for healthy individuals to increase their cognitive performance or preserve it from aging. Several tools are already being used to this goal, ranging from cognitive training (through a growing range of enriched video game applications, see for example Cardoso-Leite and Bavelier, 2014), to cognitive pharmacological enhancers (i.e., drugs primarily developed to treat people with cognitive or motor function difficulties that are used by healthy subjects to improve memory, attention, concentration, and planning, see for example Greely et al., 2008), to off-the-laboratory brain stimulation (transcranial direct current stimulation – tDCS-kits are now commercially available). In this context, given its consequences on behavioral performance as described above, non-invasive neurofeedback applications can be considered as a safe improved alternative to cognitive training, as compared to cognitive enhancers or brain stimulation.
Shared Cognition
In a recent report, Pais-Vieira et al. (2013) describe an astounding brain-to-brain interface (BTBI). The cortical activity of an “encoder” rat, performing a learned sensorimotor task was injected, using intracortical microstimulations, into the matching cortical area of a “decoder” rat that was able to learn to use these alien activity patterns to perform the sensorimotor choices as the “encoder” rat. This opens amazing perspectives. From a rehabilitation point of view, one can think of injecting in target cortical regions of the brain of a patient suffering from a severe cognitive deficit the activity patterns recorded from healthy subjects in well-defined contexts. This is not very different from deep brain stimulation procedures now classically used in Parkinson Disease patients for example or from trans-cranial direct current stimulation applied in severe refractory depression, except that the stimulations would in this case correspond to the cognitive information content of healthy subjects.
Closing the Loop
Overall, this review brings together several studies that not only demonstrate the feasibility of decoding spatial attention in real time using a diversity of experimental set-ups, but that also show that this real-time decoding can further be used for rehabilitation purposes. As a concluding note, we would like to highlight the fact that this field of cBMIs, and specifically attention-driven BMIs, is still young and that the reviewed studies mostly represent proofs of concept. We believe that the real-time access to spatial attention signals (and other cognitive information) also has the potential to bring about a novel understanding of the neural bases of these cognitive processes that cannot be accessed by more classical investigation methods. Taking this fundamental neuroscience perspective on cBMI research will also provide a better understanding of why and how neurofeedback improves cognition. These are the crucial challenges the field will need to face in the coming years.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
Elaine Astrand was funded by the Fondation pour la recherché médicale (FRM) and the Direction générale des armées (DGA). Suliann Ben Hamed was funded by the French Agence nationale de la recherche (Grant #ANR-05-JCJC-0230-01 and Grant # ANR-11-BSV4-0011), as well as by a CNRS bioinformatics grant.
References
Albares, M., Criaud, M., Wardak, C., Nguyen, S. C. T., Ben Hamed, S., and Boulinguez, P. (2011). Attention to baseline: does orienting visuospatial attention really facilitate target detection? J. Neurophysiol. 106, 809–816. doi: 10.1152/jn.00206.2011
Andersson, P., Pluim, J. P. W., Siero, J. C. W., Klein, S., Viergever, M. A., and Ramsey, N. F. (2011). Real-time decoding of brain responses to visuospatial attention using 7T fMRI. PLoS ONE 6:e27638. doi: 10.1371/journal.pone.0027638
Andersson, P., Ramsey, N. F., Raemaekers, M., Viergever, M. A., and Pluim, J. P. W. (2012). Real-time decoding of the direction of covert visuospatial attention. J. Neural Eng. 9:045004. doi: 10.1088/1741-2560/9/4/045004
Andrews, D. J., and Schonfeld, W. H. (1992). Predictive factors for controlling seizures using a behavioural approach. Seizure 1, 111–116. doi: 10.1016/1059-1311(92)90008-O
Anton-Erxleben, K., and Carrasco, M. (2013). Attentional enhancement of spatial resolution: linking behavioural and neurophysiological evidence. Nat. Rev. Neurosci. 14, 188–200. doi: 10.1038/nrn3443
Anton-Erxleben, K., Stephan, V. M., and Treue, S. (2009). Attention reshapes center-surround receptive field structure in macaque cortical area MT. Cereb. Cortex 19, 2466–2478. doi: 10.1093/cercor/bhp002
Armstrong, K. M., Chang, M. H., and Moore, T. (2009). Selection and maintenance of spatial information by frontal eye field neurons. J. Neurosci. 29, 15621–15629. doi: 10.1523/JNEUROSCI.4465-09.2009
Arrington, C. M., Carr, T. H., Mayer, A. R., and Rao, S. M. (2000). Neural mechanisms of visual attention: object-based selection of a region in space. J. Cogn. Neurosci. 12, 106–117. doi: 10.1162/089892900563975
Astrand, E., Enel, P., Ibos, G., Dominey, P. F., Baraduc, P., and Ben Hamed, S. (2014a). Comparison of classifiers for decoding sensory and cognitive information from prefrontal neuronal populations. PLoS ONE 9:e86314. doi: 10.1371/journal.pone.0086314
Astrand, E., Wardak, C., and Ben Hamed, S. (2014b). “Real-time decoding of visual attention from monkey prefrontal population activities: towards context independent high performance cognitive brain computer interfaces,” in FENS Meeting, Milan.
Astrand, E., Huguet, N., Wardak, C., and Ben Hamed, S. (2013). “Real-time decoding from prefrontal neuronal population activities: how flexible is the decoding?,” in Annual Meeting of the Sociétéfrançaise des neurosciences, Lyon.
Barash, S., Bracewell, R. M., Fogassi, L., Gnadt, J. W., and Andersen, R. A. (1991). Saccade-related activity in the lateral intraparietal area. II. Spatial properties. J. Neurophysiol. 66, 1109–1124.
Bashinski, H. S., and Bacharach, V. R. (1980). Enhancement of perceptual sensitivity as the result of selectively attending to spatial locations. Percept. Psychophys. 28, 241–248. doi: 10.3758/BF03204380
Ben Hamed, S., Duhamel, J.-R., Bremmer, F., and Graf, W. (1997). Attentional modulation of visual receptive fields in the posterior parietal cortex of the behaving macaque. Exp. Brain Res. Series 25, 371–384.
Ben Hamed, S., Duhamel, J.-R., Bremmer, F., and Graf, W. (2001). Representation of the visual field in the lateral intraparietal area of macaque monkeys: a quantitative receptive field analysis. Exp. Brain Res. 140, 127–144. doi: 10.1007/s002210100785
Ben Hamed, S., Duhamel, J.-R., Bremmer, F., and Graf, W. (2002). Visual receptive field modulation in the lateral intraparietal area during attentive fixation and free gaze. Cereb. Cortex 12, 234–245. doi: 10.1093/cercor/12.3.234
Ben Hamed, S., Page, W., Duffy, C., and Pouget, A. (2003). MSTd neuronal basis functions for the population encoding of heading direction. J. Neurophysiol. 90, 549–558. doi: 10.1152/jn.00639.2002
Ben Hamed, S., Schieber, M. H., and Pouget, A. (2007). Decoding M1 neurons during multiple finger movements. J. Neurophysiol. 98, 327–333. doi: 10.1152/jn.00760.2006
Bisley, J. W., and Goldberg, M. E. (2003). Neuronal activity in the lateral intraparietal area and spatial attention. Science 299, 81–86. doi: 10.1126/science.1077395
Bray, S., Shimojo, S., and O’Doherty, J. P. (2007). Direct instrumental conditioning of neural activity using functional magnetic resonance imaging-derived reward feedback. J. Neurosci. 27, 7498–7507. doi: 10.1523/JNEUROSCI.2118-07.2007
Brefczynski, J. A., and DeYoe, E. A. (1999). A physiological correlate of the “spotlight” of visual attention. Nat. Neurosci. 2, 370–374. doi: 10.1038/7280
Bruce, C. J., and Goldberg, M. E. (1985). Primate frontal eye fields. I. Single neurons discharging before saccades. J. Neurophysiol. 53, 603–635.
Buschman, T. J., and Miller, E. K. (2007). Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science 315, 1860–1862. doi: 10.1126/science.1138071
Cardoso-Leite, P., and Bavelier, D. (2014). Video game play, attention, and learning: how to shape the development of attention and influence learning? Curr. Opin. Neurol. 27, 185–191. doi: 10.1097/WCO.0000000000000077
Caria, A., Veit, R., Sitaram, R., Lotze, M., Weiskopf, N., Grodd, W.,et al. (2007). Regulation of anterior insular cortex activity using real-time fMRI. Neuroimage 35, 1238–1246. doi: 10.1016/j.neuroimage.2007.01.018
Carmena, J. M., Lebedev, M. A., Crist, R. E., O’Doherty, J. E., Santucci, D. M., Dimitrov, D. F.,et al. (2003). Learning to control a brain–machine interface for reaching and grasping by primates. PLoS Biol. 1:E42. doi: 10.1371/journal.pbio.0000042
Carrasco, M., and Yeshurun, Y. (2009). Covert attention effects on spatial resolution. Prog. Brain Res. 176, 65–86. doi: 10.1016/S0079-6123(09)17605-7
Cerf, M., Thiruvengadam, N., Mormann, F., Kraskov, A., Quiroga, R. Q., Koch, C.,et al. (2010). On-line, voluntary control of human temporal lobe neurons. Nature 467, 1104–1108. doi: 10.1038/nature09510
Chapin, J. K., Moxon, K. A., Markowitz, R. S., and Nicolelis, M. A. (1999). Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat. Neurosci. 2, 664–670. doi: 10.1038/10223
Chennu, S., Finoia, P., Kamau, E., Monti, M. M., Allanson, J., Pickard, J. D.,et al. (2013). Dissociable endogenous and exogenous attention in disorders of consciousness. Neuroimage Clin. 3, 450–461. doi: 10.1016/j.nicl.2013.10.008
Christ, S. E., and Abrams, R. A. (2006). Abrupt onsets cannot be ignored. Psychon. Bull. Rev. 13, 875–880. doi: 10.3758/BF03194012
Cohen, M. R., and Maunsell, J. H. R. (2009). Attention improves performance primarily by reducing interneuronal correlations. Nat. Neurosci. 12, 1594–1600. doi: 10.1038/nn.2439
Coleman, M. R., Rodd, J. M., Davis, M. H., Johnsrude, I. S., Menon, D. K., Pickard, J. D.,et al. (2007). Do vegetative patients retain aspects of language comprehension? Evidence from fMRI. Brain 130, 2494–2507. doi: 10.1093/brain/awm170
Corbetta, M., Akbudak, E., Conturo, T. E., Snyder, A. Z., Ollinger, J. M., Drury, H. A.,et al. (1998). A common network of functional areas for attention and eye movements. Neuron 21, 761–773. doi: 10.1016/S0896-6273(00)80593-0
Corbetta, M., Kincade, J. M., Ollinger, J. M., McAvoy, M. P., and Shulman, G. L. (2000). Voluntary orienting is dissociated from target detection in human posterior parietal cortex. Nat. Neurosci. 3, 292–297. doi: 10.1038/73009
Corbetta, M., and Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3, 201–215. doi: 10.1038/nrn755
Cosman, J. D., and Vecera, S. P. (2009). Perceptual load modulates attentional capture by abrupt onsets. Psychon. Bull. Rev. 16, 404–410. doi: 10.3758/PBR.16.2.404
Dai, J., Brooks, D. I., and Sheinberg, D. L. (2014). Optogenetic and electrical microstimulation systematically bias visuospatial choice in primates. Curr. Biol. 24, 63–69. doi: 10.1016/j.cub.2013.11.011
deCharms, R. C., Christoff, K., Glover, G. H., Pauly, J. M., Whitfield, S., and Gabrieli, J. D. E. (2004). Learned regulation of spatially localized brain activation using real-time fMRI. Neuroimage 21, 436–443. doi: 10.1016/j.neuroimage.2003.08.041
deCharms, R. C., Maeda, F., Glover, G. H., Ludlow, D., Pauly, J. M., Soneji, D.,et al. (2005). Control over brain activation and pain learned by using real-time functional MRI. Proc. Natl. Acad. Sci. U.S.A. 102, 18626–18631. doi: 10.1073/pnas.0505210102
FarbodKia, S., Åstrand, E., Ibos, G., and Ben Hamed, S. (2011). Readout of the intrinsic and extrinsic properties of a stimulus from un-experienced neuronal activities: towards cognitive neuroprostheses. J. Physiol. Paris 105, 115–122. doi: 10.1016/j.jphysparis.2011.07.015
Fetz, E. E. (1969). Operant conditioning of cortical unit activity. Science 163, 955–958. doi: 10.1126/science.163.3870.955
Fetz, E. E. (2007). Volitional control of neural activity: implications for brain–computer interfaces. J. Physiol. 579, 571–579. doi: 10.1113/jphysiol.2006.127142
Gobell, J., and Carrasco, M. (2005). Attention alters the appearance of spatial frequency and gap size. Psychol. Sci. 16, 644–651. doi: 10.1111/j.1467-9280.2005.01588.x
Gottlieb, J. P., Kusunoki, M., and Goldberg, M. E. (1998). The representation of visual salience in monkey parietal cortex. Nature 391, 481–484. doi: 10.1038/35135
Greely, H., Sahakian, B., Harris, J., Kessler, R. C., Gazzaniga, M., Campbell, P.,et al. (2008). Towards responsible use of cognitive-enhancing drugs by the healthy. Nature 456, 702–705. doi: 10.1038/456702a
Grefkes, C., Nowak, D. A., Eickhoff, S. B., Dafotakis, M., Küst, J., Karbe, H.,et al. (2008). Cortical connectivity after subcortical stroke assessed with functional magnetic resonance imaging. Ann. Neurol. 63, 236–246. doi: 10.1002/ana.21228
Gregoriou, G. G., Gotts, S. J., Zhou, H., and Desimone, R. (2009). High-frequency, long-range coupling between prefrontal and visual cortex during attention. Science 324, 1207–1210. doi: 10.1126/science.1171402
Gunduz, A., Brunner, P., Daitch, A., Leuthardt, E. C., Ritaccio, A. L., Pesaran, B.,et al. (2012). Decoding covert spatial attention using electrocorticographic (ECoG) signals in humans. Neuroimage 60, 2285–2293. doi: 10.1016/j.neuroimage.2012.02.017
Haller, S., Birbaumer, N., and Veit, R. (2010). Real-time fMRI feedback training may improve chronic tinnitus. Eur. Radiol. 20, 696–703. doi: 10.1007/s00330-009-1595-z
Hansen, L. M., Trudeau, D. L., and Grace, D. L. (1996). Neurotherapy and drug therapy in combination for adult ADHD, personality disorder, and seizure disorder. J. Neurother. 2, 6–14. doi: 10.1300/J184v02n01_02
He, B. J., Snyder, A. Z., Vincent, J. L., Epstein, A., Shulman, G. L., and Corbetta, M. (2007). Breakdown of functional connectivity in frontoparietal networks underlies behavioral deficits in spatial neglect. Neuron 53, 905–918. doi: 10.1016/j.neuron.2007.02.013
Hochberg, L. R., Bacher, D., Jarosiewicz, B., Masse, N. Y., Simeral, J. D., Vogel, J.,et al. (2012). Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature 485, 372–375. doi: 10.1038/nature11076
Hochberg, L. R., Serruya, M. D., Friehs, G. M., Mukand, J. A., Saleh, M., Caplan, A. H.,et al. (2006). Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 442, 164–171. doi: 10.1038/nature04970
Hopfinger, J. B., Buonocore, M. H., and Mangun, G. R. (2000). The neural mechanisms of top-down attentional control. Nat. Neurosci. 3, 284–291. doi: 10.1038/72999
Hua, T., Bao, P., Huang, C.-B., Wang, Z., Xu, J., Zhou, Y.,et al. (2010). Perceptual learning improves contrast sensitivity of V1 neurons in cats. Curr. Biol. 20, 887–894. doi: 10.1016/j.cub.2010.03.066
Ibos, G., Duhamel, J.-R., and Ben Hamed, S. (2009). The spatial and temporal deployment of voluntary attention across the visual field. PLoS ONE 4:e6716. doi: 10.1371/journal.pone.0006716
Ibos, G., Duhamel, J.-R., and Ben Hamed, S. (2013). A functional hierarchy within the parietofrontal network in stimulus selection and attention control. J. Neurosci. 33, 8359–8369. doi: 10.1523/JNEUROSCI.4058-12.2013
Ifft, P. J., Shokur, S., Li, Z., Lebedev, M. A., and Nicolelis, M. A. L. (2013). A brain–machine interface enables bimanual arm movements in monkeys. Sci. Transl. Med. 5:210ra154. doi: 10.1126/scitranslmed.3006159
Jerbi, K., Freyermuth, S., Minotti, L., Kahane, P., Berthoz, A., and Lachaux, J.-P. (2009). Watching brain TV and playing brain ball exploring novel BCI strategies using real-time analysis of human intracranial data. Int. Rev. Neurobiol. 86, 159–168. doi: 10.1016/S0074-7742(09)86012-1
Jonides, J. (1981). “Voluntary vs. automatic control over the mind’s eye’s movement,” in Attention and performance IX, eds J. B. Long and A. D. Baddely (Hillsdale, NJ: Lawrence Erlbaum Associates), 187–203.
Jonides, J., and Irwing, D. E. (1981). Capturing attention. Cognition 145–150. doi: 10.1016/0010-0277(81)90038-X
Kaiser, D. A., and Othmer, S. (2000). Effect of neurofeedback on variables of attention in a large multi-center trial. J. Neurother. 4, 5–15. doi: 10.1300/J184v04n01_02
Kaplan, B. J. (1975). Biofeedback in epileptics: equivocal relationship of reinforced EEG frequency to seizure reduction. Epilepsia 16, 477–485. doi: 10.1111/j.1528-1157.1975.tb06076.x
Kastner, S., Pinsk, M. A., De Weerd, P., Desimone, R., and Ungerleider, L. G. (1999). Increased activity in human visual cortex during directed attention in the absence of visual stimulation. Neuron 22, 751–761. doi: 10.1016/S0896-6273(00)80734-5
Kim, S.-P., Simeral, J. D., Hochberg, L. R., Donoghue, J. P., Friehs, G. M., and Black, M. J. (2011). Point- and-click cursor control with an intracortical neural interface system by humans with tetraplegia. IEEE Trans. Neural Syst. Rehabil. Eng. 19, 193–203. doi: 10.1109/TNSRE.2011.2107750
Kincade, J. M., Abrams, R. A., Astafiev, S. V., Shulman, G. L., and Corbetta, M. (2005). An event-related functional magnetic resonance imaging study of voluntary and stimulus-driven orienting of attention. J. Neurosci. 25, 4593–4604. doi: 10.1523/JNEUROSCI.0236-05.2005
Kobayashi, S., Schultz, W., and Sakagami, M. (2010). Operant conditioning of primate prefrontal neurons. J. Neurophysiol. 103, 1843–1855. doi: 10.1152/jn.00173.2009
Kübler, A., Mushahwar, V. K., Hochberg, L. R., and Donoghue, J. P. (2006). BCI meeting 2005 – workshop on clinical issues and applications. IEEE Trans. Neural Syst. Rehabil. Eng. 14, 131–134. doi: 10.1109/TNSRE.2006.875585
Kübler, A., Neumann, N., Wilhelm, B., Hinterberger, T., and Birbaumer, N. (2004). Predictability of brain – computer communication. J. Psychophysiol. 18, 121–129. doi: 10.1027/0269-8803.18.23.121
Kuhlman, W. N. (1978). EEG feedback training of epileptic patients: clinical and electroencephalographic analysis. Electroencephalogr. Clin. Neurophysiol. 45, 699–710. doi: 10.1016/0013-4694(78)90138-4
Kuhlman, W. N., and Allison, T. (1977). EEG feedback training in the treatment of epilepsy: some questions and some answers. Pavlov. J. Biol. Sci. 12, 112–122. doi: 10.1007/BF03004498
Kusunoki, M., Gottlieb, J., and Goldberg, M. E. (2000). The lateral intraparietal area as a salience map: the representation of abrupt onset, stimulus motion, and task relevance. Vision Res. 40, 1459–1468. doi: 10.1016/S0042-6989(99)00212-6
Lambert, A., Spencer, E., and Mohindra, N. (1987). Automaticity and the capture of attention by a peripheral display change. Curr. Psychol. 6, 136–147. doi: 10.1007/BF02686618
Lantz, D. L., and Sterman, M. B. (1988). Neuropsychological assessment of subjects with uncontrolled epilepsy: effects of EEG feedback training. Epilepsia 29, 163–171. doi: 10.1111/j.1528-1157.1988.tb04414.x
Laureys, S., Owen, A. M., and Schiff, N. D. (2004). Brain function in coma, vegetative state, and related disorders. Lancet Neurol. 3, 537–546. doi: 10.1016/S1474-4422(04)00852-X
Laureys, S., Perrin, F., and Brédart, S. (2007). Self-consciousness in non-communicative patients. Conscious. Cogn. 16, 722–741; discussion 742–745. doi: 10.1016/j.concog.2007.04.004
Law, C.-T., and Gold, J. I. (2008). Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area. Nat. Neurosci. 11, 505–513. doi: 10.1038/nn2070
Lebedev, M. A., Carmena, J. M., O’Doherty, J. E., Zacksenhouse, M., Henriquez, C. S., Principe, J. C.,et al. (2005). Cortical ensemble adaptation to represent velocity of an artificial actuator controlled by a brain – machine interface. J. Neurosci. 25, 4681–4693. doi: 10.1523/JNEUROSCI.4088-04.2005
Lee, J., Williford, T., and Maunsell, J. H. R. (2007). Spatial attention and the latency of neuronal responses in macaque area V4. J. Neurosci. 27, 9632–9637. doi: 10.1523/JNEUROSCI.2734-07.2007
Li, X., Lu, Z.-L., Tjan, B. S., Dosher, B. A., and Chu, W. (2008). Blood oxygenation level-dependent contrast response functions identify mechanisms of covert attention in early visual areas. Proc. Natl. Acad. Sci. U.S.A. 105, 6202–6207. doi: 10.1073/pnas.0801390105
Lindén, M., Habib, T., and Radojevic, V. (1996). A controlled study of the effects of EEG biofeedback on cognition and behavior of children with attention deficit disorder and learning disabilities. Biofeedback Self Regul. 21, 35–49. doi: 10.1007/BF02214148
Lubar, J. F. (1991). Discourse on the development of EEG diagnostics and biofeedback for attention-deficit/hyperactivity disorders. Biofeedback Self Regul. 16, 201–225. doi: 10.1007/BF01000016
Lubar, J. F., and Shouse, M. N. (1976). EEG and behavioral changes in a hyperkinetic child concurrent with training of the sensorimotor rhythm (SMR): a preliminary report. Biofeedback Self Regul. 1, 293–306. doi: 10.1007/BF01001170
Lubar, J. F., Swartwood, M. O., Swartwood, J. N., and O’Donnell, P. H. (1995). Evaluation of the effectiveness of EEG neurofeedback training for ADHD in a clinical setting as measured by changes in T.O.V.A. scores, behavioral ratings, and WISC-R performance. Biofeedback Self Regul. 20, 83–99. doi: 10.1007/BF01712768
Macaluso, E., Frith, C. D., and Driver, J. (2002). Supramodal effects of covert spatial orienting triggered by visual or tactile events. J. Cogn. Neurosci. 14, 389–401. doi: 10.1162/089892902317361912
McAdams, C. J., and Maunsell, J. H. (1999). Effects of attention on the reliability of individual neurons in monkey visual cortex. Neuron 23, 765–773. doi: 10.1016/S0896-6273(01)80034-9
Morioka, H., Kanemura, A., Morimoto, S., Yoshioka, T., Oba, S., Kawanabe, M.,et al. (2014). Decoding spatial attention by using cortical currents estimated from electroencephalography with near-infrared spectroscopy prior information. Neuroimage 90, 128–139. doi: 10.1016/j.neuroimage.2013.12.035
Müller, H. J., and Rabbitt, P. M. (1989). Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption. J. Exp. Psychol. Hum. Percept. Perform. 15, 315–330. doi: 10.1037/0096-1523.15.2.315
Murase, N., Duque, J., Mazzocchio, R., and Cohen, L. G. (2004). Influence of interhemispheric interactions on motor function in chronic stroke. Ann. Neurol. 55, 400–409. doi: 10.1002/ana.10848
Musallam, S., Corneil, B. D., Greger, B., Scherberger, H., and Andersen, R. A. (2004). Cognitive control signals for neural prosthetics. Science 305, 258–262. doi: 10.1126/science.1097938
Neo, G., and Chua, F. K. (2006). Capturing focused attention. Percept. Psychophys. 68, 1286–1296. doi: 10.3758/BF03193728
Nudo, R. J. (2006). Mechanisms for recovery of motor function following cortical damage. Curr. Opin. Neurobiol. 16, 638–644. doi: 10.1016/j.conb.2006.10.004
Pais-Vieira, M., Lebedev, M., Kunicki, C., Wang, J., and Nicolelis, M. A. L. (2013). A brain-to-brain interface for real-time sharing of sensorimotor information. Sci. Rep. 3:1319. doi: 10.1038/srep01319
Plotkin, A., Sela, L., Weissbrod, A., Kahana, R., Haviv, L., Yeshurun, Y.,et al. (2010). Sniffing enables communication and environmental control for the severely disabled. Proc. Natl. Acad. Sci. U.S.A. 107, 14413–14418. doi: 10.1073/pnas.1006746107
Posner, M. I., Snyder, C. R., and Davidson, B. J. (1980). Attention and the detection of signals. J. Exp. Psychol. 109, 160–174. doi: 10.1037/0096-3445.109.2.160
Prinzmetal, W., McCool, C., and Park, S. (2005). Attention: reaction time and accuracy reveal different mechanisms. J. Exp. Psychol. Gen. 134, 73–92. doi: 10.1037/0096-3445.134.1.73
Rossiter, D. T. R., and La Vaque, T. J. (1995). A comparison of EEG biofeedback and psychostimulants in treating attention deficit/hyperactivity disorders. J. Neurother. 1, 48–59. doi: 10.1300/J184v01n01_07
Rota, G., Sitaram, R., Veit, R., Erb, M., Weiskopf, N., Dogil, G.,et al. (2009). Self-regulation of regional cortical activity using real-time fMRI: the right inferior frontal gyrus and linguistic processing. Hum. Brain Mapp. 30, 1605–1614. doi: 10.1002/hbm.20621
Rotermund, D., Ernst, U., Mandon, S., Taylor, K., Smiyukha, Y., Kreiter, A.,et al. (2013). Toward high performance, weakly invasive brain computer interfaces using selective visual attention. J. Neurosci. 33, 6001–6011. doi: 10.1523/JNEUROSCI.4225-12.2013
Santhanam, G., Ryu, S. I., Yu, B. M., Afshar, A., and Shenoy, K. V. (2006). A high-performance brain – computer interface. Nature 442, 195–198. doi: 10.1038/nature04968
Schafer, R. J., and Moore, T. (2011). Selective attention from voluntary control of neurons in prefrontal cortex. Science 332, 1568–1571. doi: 10.1126/science.1199892
Scharnowski, F., Hutton, C., Josephs, O., Weiskopf, N., and Rees, G. (2012). Improving visual perception through neurofeedback. J. Neurosci. 32, 17830–17841. doi: 10.1523/JNEUROSCI.6334-11.2012
Scharnowski, F., Rosa, M. J., Golestani, N., Hutton, C., Josephs, O., Weiskopf, N.,et al. (2014). Connectivity changes underlying neurofeedback training of visual cortex activity. PLoS ONE 9:e91090. doi: 10.1371/journal.pone.0091090
Schiff, N. D., Plum, F., and Rezai, A. R. (2002). Developing prosthetics to treat cognitive disabilities resulting from acquired brain injuries. Neurol. Res. 24, 116–124. doi: 10.1179/016164102101199576
Schiff, N. D., Rodriguez-Moreno, D., Kamal, A., Kim, K. H. S., Giacino, J. T., Plum, F.,et al. (2005). fMRI reveals large-scale network activation in minimally conscious patients. Neurology 64, 514–523. doi: 10.1212/01.WNL.0000150883.10285.44
Schoups, A., Vogels, R., Qian, N., and Orban, G. (2001). Practising orientation identification improves orientation coding in V1 neurons. Nature 412, 549–553. doi: 10.1038/35087601
Schreij, D., Owens, C., and Theeuwes, J. (2008). Abrupt onsets capture attention independent of top-down control settings. Percept. Psychophys. 70, 208–218. doi: 10.3758/PP.70.2.208
Seifert, A. R., and Lubar, J. F. (1975). Reduction of epileptic seizures through EEG biofeedback training. Biol. Psychol. 3, 157–184. doi: 10.1016/0301-0511(75)90033-2
Serruya, M. D., Hatsopoulos, N. G., Paninski, L., Fellows, M. R., and Donoghue, J. P. (2002). Instant neural control of a movement signal. Nature 416, 141–142. doi: 10.1038/416141a
Shanechi, M. M., Hu, R. C., and Williams, Z. M. (2014). A cortical–spinal prosthesis for targeted limb movement in paralysed primate avatars. Nat. Commun. 5:3237. doi: 10.1038/ncomms4237
Shibata, K., Watanabe, T., Sasaki, Y., and Kawato, M. (2011). Perceptual learning incepted by decoded fMRI neurofeedback without stimulus presentation. Science 334, 1413–1415. doi: 10.1126/science.1212003
Shulman, G. L., Ollinger, J. M., Akbudak, E., Conturo, T. E., Snyder, A. Z., Petersen, S. E.,et al. (1999). Areas involved in encoding and applying directional expectations to moving objects. J. Neurosci. 19, 9480–9496.
Squire, L. R., and Zola-Morgan, S. (1991). The medial temporal lobe memory system. Science 253, 1380–1386. doi: 10.1126/science.1896849
Sterman, M. B., and Friar, L. (1972). Suppression of seizures in an epileptic following sensorimotor EEG feedback training. Electroencephalogr. Clin. Neurophysiol. 33, 89–95. doi: 10.1016/0013-4694(72)90028-4
Sterman, M. B., and Macdonald, L. R. (1978). Effects of central cortical EEG feedback training on incidence of poorly controlled seizures. Epilepsia 19, 207–222. doi: 10.1111/j.1528-1157.1978.tb04483.x
Sterman, M. B., Macdonald, L. R., and Stone, R. K. (1974). Biofeedback training of the sensorimotor electroencephalogram rhythm in man: effects on epilepsy. Epilepsia 15, 395–416. doi: 10.1111/j.1528-1157.1974.tb04016.x
Sterman, M. B., Wyrwicka, W., and Roth, S. (1969). Electrophysiological correlates and neural substrates of alimentary behavior in the cat. Ann. N. Y. Acad. Sci. 157, 723–739. doi: 10.1111/j.1749-6632.1969.tb12916.x
Subramanian, L., Hindle, J. V., Johnston, S., Roberts, M. V., Husain, M., Goebel, R.,et al. (2011). Real-time functional magnetic resonance imaging neurofeedback for treatment of Parkinson’s disease. J. Neurosci. 31, 16309–16317. doi: 10.1523/JNEUROSCI.3498-11.2011
Suminski, A. J., Tkach, D. C., Fagg, A. H., and Hatsopoulos, N. G. (2010). Incorporating feedback from multiple sensory modalities enhances brain–machine interface control. J. Neurosci. 30, 16777–16787. doi: 10.1523/JNEUROSCI.3967-10.2010
Suzuki, M., and Gottlieb, J. (2013). Distinct neural mechanisms of distractor suppression in the frontal and parietal lobe. Nat. Neurosci. 16, 98–104. doi: 10.1038/nn.3282
Taylor, D. M., Tillery, S. I. H., and Schwartz, A. B. (2002). Direct cortical control of 3D neuroprosthetic devices. Science 296, 1829–1832. doi: 10.1126/science.1070291
Thompson, L., and Thompson, M. (1998). Neurofeedback combined with training in metacognitive strategies: effectiveness in students with ADD. Appl. Psychophysiol. Biofeedback 23, 243–263. doi: 10.1023/A:1022213731956
Tillery, S. I. H., Taylor, D. M., and Schwartz, A. B. (2003). “The general utility of a neuroprosthetic device under direct cortical control,” in Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vol. 3, Cancun, 2043–2046.
Treder, M. S., Bahramisharif, A., Schmidt, N. M., van Gerven, M. A., and Blankertz, B. (2011). Brain – computer interfacing using modulations of alpha activity induced by covert shifts of attention. J. Neuroeng. Rehabil. 8:24. doi: 10.1186/1743-0003-8-24
van Gerven, M., and Jensen, O. (2009). Attention modulations of posterior alpha as a control signal for two-dimensional brain – computer interfaces. J. Neurosci. Methods 179, 78–84. doi: 10.1016/j.jneumeth.2009.01.016
Velliste, M., Perel, S., Spalding, M. C., Whitford, A. S., and Schwartz, A. B. (2008). Cortical control of a prosthetic arm for self-feeding. Nature 453, 1098–1101. doi: 10.1038/nature06996
Vossel, S., Thiel, C. M., and Fink, G. R. (2006). Cue validity modulates the neural correlates of covert endogenous orienting of attention in parietal and frontal cortex. Neuroimage 32, 1257–1264. doi: 10.1016/j.neuroimage.2006.05.019
Wang, L., Yu, C., Chen, H., Qin, W., He, Y., Fan, F.,et al. (2010). Dynamic functional reorganization of the motor execution network after stroke. Brain 133, 1224–1238. doi: 10.1093/brain/awq043
Wardak, C., Denève, S., and Ben Hamed, S. (2011a). Focused visual attention distorts distance perception away from the attentional locus. Neuropsychologia 49, 535–545. doi: 10.1016/j.neuropsychologia.2010.12.008
Wardak, C., Olivier, E., and Duhamel, J.-R. (2011b). The relationship between spatial attention and saccades in the frontoparietal network of the monkey. Eur. J. Neurosci. 33, 1973–1981. doi: 10.1111/j.1460-9568.2011.07710.x
Wardak, C., Ibos, G., Duhamel, J.-R., and Olivier, E. (2006). Contribution of the monkey frontal eye field to covert visual attention. J. Neurosci. 26, 4228–4235. doi: 10.1523/JNEUROSCI.3336-05.2006
Wardak, C., Olivier, E., and Duhamel, J.-R. (2002). Saccadic target selection deficits after lateral intraparietal area inactivation in monkeys. J. Neurosci. 22, 9877–9884.
Wardak, C., Olivier, E., and Duhamel, J.-R. (2004). A deficit in covert attention after parietal cortex inactivation in the monkey. Neuron 42, 501–508. doi: 10.1016/S0896-6273(04)00185-0
Weiskopf, N., Veit, R., Erb, M., Mathiak, K., Grodd, W., Goebel, R.,et al. (2003). Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI): methodology and exemplary data. Neuroimage 19, 577–586. doi: 10.1016/S1053-8119(03)00145-9
Wyrwicka, W., and Sterman, M. B. (1968). Instrumental conditioning of sensorimotor cortex EEG spindles in the waking cat. Physiol. Behav. 3, 703–707. doi: 10.1016/0031-9384(68)90139-X
Yang, T., and Maunsell, J. H. R. (2004). The effect of perceptual learning on neuronal responses in monkey visual area V4. J. Neurosci. 24, 1617–1626. doi: 10.1523/JNEUROSCI.4442-03.2004
Yantis, S., and Jonides, J. (1990). Abrupt visual onsets and selective attention: voluntary versus automatic allocation. J. Exp. Psychol. Hum. Percept. Perform. 16, 121–134. doi: 10.1037/0096-1523.16.1.121
Yeshurun, Y., and Carrasco, M. (1998). Attention improves or impairs visual performance by enhancing spatial resolution. Nature 396, 72–75. doi: 10.1038/23936
Zénon, A., Ben Hamed, S., Duhamel, J.-R., and Olivier, E. (2008). Spatial and temporal dynamics of attentional guidance during inefficient visual search. PLoS ONE 3:e2219. doi: 10.1371/journal.pone.0002219
Zénon, A., Ben Hamed, S., Duhamel, J.-R., and Olivier, E. (2009). Attentional guidance relies on a winner-take-all mechanism. Vision Res. 49, 1522–1531. doi: 10.1016/j.visres.2009.03.010
Keywords: brain–machine interfaces, brain–computer interfaces, cognition, spatial attention, neurofeedback, neural training, frontal eye field, prefrontal cortex
Citation: Astrand E, Wardak C and Ben Hamed S (2014) Selective visual attention to drive cognitive brain–machine interfaces: from concepts to neurofeedback and rehabilitation applications. Front. Syst. Neurosci. 8:144. doi: 10.3389/fnsys.2014.00144
Received: 28 May 2014; Accepted: 23 July 2014;
Published online: 12 August 2014.
Edited by:
Mikhail Lebedev, Duke University, USAReviewed by:
Guilherme Wood, Karl-Franzens-University of Graz, AustriaGeorgia Gregoriou, University of Crete, Greece
Copyright © 2014 Astrand, Wardak and Ben Hamed. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Suliann Ben Hamed, CNRS, Cognitive Neuroscience Center, UMR 5229, University of Lyon 1, 67 Boulevard Pinel, 69675 Bron Cedex, France e-mail: benhamed@isc.cnrs.fr