Thomas Fovet
Natasza Orlov
Miriam Dyck
Paul Allen
Klaus Mathiak
Renaud Jardri- 1Univ Lille, CNRS, UMR-9193, psyCHIC team & CHU Lille, Psychiatry Dpt (CURE), Fontan Hospital, Lille, France
- 2Department of Psychosis Studies, Institute of Psychiatry Psychology and Neuroscience, King’s College London, London, UK
- 3Department of Psychiatry, Psychotherapy and Psychosomatics, JARA-Brain, RWTH Aachen University, Aachen, Germany
- 4Department of Psychology, University of Roehampton, London, UK
Auditory-verbal hallucinations (AVHs) are frequent and disabling symptoms, which can be refractory to conventional psychopharmacological treatment in more than 25% of the cases. Recent advances in brain imaging allow for a better understanding of the neural underpinnings of AVHs. These findings strengthened transdiagnostic neurocognitive models that characterize these frequent and disabling experiences. At the same time, technical improvements in real-time functional magnetic resonance imaging (fMRI) enabled the development of innovative and non-invasive methods with the potential to relieve psychiatric symptoms, such as fMRI-based neurofeedback (fMRI-NF). During fMRI-NF, brain activity is measured and fed back in real time to the participant in order to help subjects to progressively achieve voluntary control over their own neural activity. Precisely defining the target brain area/network(s) appears critical in fMRI-NF protocols. After reviewing the available neurocognitive models for AVHs, we elaborate on how recent findings in the field may help to develop strong a priori strategies for fMRI-NF target localization. The first approach relies on imaging-based “trait markers” (i.e., persistent traits or vulnerability markers that can also be detected in the presymptomatic and remitted phases of AVHs). The goal of such strategies is to target areas that show aberrant activations during AVHs or are known to be involved in compensatory activation (or resilience processes). Brain regions, from which the NF signal is derived, can be based on structural MRI and neurocognitive knowledge, or functional MRI information collected during specific cognitive tasks. Because hallucinations are acute and intrusive symptoms, a second strategy focuses more on “state markers.” In this case, the signal of interest relies on fMRI capture of the neural networks exhibiting increased activity during AVHs occurrences, by means of multivariate pattern recognition methods. The fine-grained activity patterns concomitant to hallucinations can then be fed back to the patients for therapeutic purpose. Considering the potential cost necessary to implement fMRI-NF, proof-of-concept studies are urgently required to define the optimal strategy for application in patients with AVHs. This technique has the potential to establish a new brain imaging-guided psychotherapy for patients that do not respond to conventional treatments and take functional neuroimaging to therapeutic applications.
Introduction
Auditory-verbal hallucinations (AVHs), i.e., hearing voices in the absence of appropriate external stimuli, are frequent experiences in schizophrenia, with a lifetime prevalence of 60–80% (1, 2). AVHs are often strongly disabling symptoms, which can be refractory to conventional psychopharmacological treatment in more than 25% of the cases (3). A recent meta-analysis supports the effectiveness of cognitive–behavioral therapy (CBT) in the treatment of AVHs (4). However, in the specific case of treatment-refractory symptoms, CBT seems to have modest and only short-term benefits (5, 6).
In recent years, the number of brain imaging studies in the field of AVHs has grown substantially, leading to a better understanding of this subjective phenomenon (7, 8). Recent progress in deciphering the neural underpinnings of AVHs has strengthened transdiagnostic neurocognitive models that characterize AVHs, but, more specifically, these findings built the bases for new therapeutic strategies. Indeed, brain imaging now allows for the identification of therapeutic targets by determining the brain regions involved in the occurrence of AVHs. For example, based on findings implicating the left temporoparietal cortex in AVHs, repetitive Transcranial Magnetic Stimulation (rTMS), a non-invasive brain stimulation method, has been used to target this region and shown to have a significant, although moderate, effect in alleviating drug-resistant AVHs (9).
Recently, technical improvements in real-time functional magnetic resonance imaging (fMRI) have enabled the development of fMRI-based neurofeedback (fMRI-NF) (10). During fMRI-NF, brain activity is measured in real time and fed back to the participant, usually using visual or auditory information, in order to facilitate voluntary control over the participant’s own neural activity. Considering the advances in the identification of anatomical and functional changes linked with AVHs, fMRI-NF strategies constitute a promising tool, giving the possibility for patients to normalize their brain activity level or connectivity strength in the AVHs-specific brain regions, and thus reduce symptom severity. Precisely defining the target brain area/network(s) appears crucial for future fMRI-NF protocols designed to treat AVHs.
After briefly reviewing current literature about the neural basis of AVHs (mainly neurocognitive models and brain imaging findings) and providing an overview of how fMRI-NF can be used in psychiatry, the review will then elaborate on how recent advances in the field may help to develop strong a priori strategies for fMRI-NF target localization. Three different fMRI-NF strategies dedicated to AVHs’ treatment will be proposed. Current limits, potential difficulties for patients with schizophrenia to benefit from fMRI-NF, as well as future directions will be critically discussed.
What is fMRI-Neurofeedback?
fMRI-Neurofeedback: Principles
Neurofeedback is a non-invasive technique enabling participants to achieve voluntary control over the neuronal activity of one or more brain regions [for a recent review on the technique, see Ref. (11)]. In the case of fMRI-NF, this is accomplished by deriving and presenting blood oxygen level-dependent (BOLD) signal derived from the target brain area(s) to the subject in real time (12). Visual feedback is primarily used, but neurofeedback derived from other or combination of different modalities is also possible. Visual feedback can be presented in various formats: from a thermometer display to more complex interfaces [e.g., social feedback Ref. (13)]. The participants use this feedback to self-regulate their neuronal response or adjust their cognitive strategy, during the experimental task in real time (see Figure 1A). They must be informed in detail(s) of the hemodynamic delay of 4 or 5 s (due to the BOLD response) to update the neurofeedback signal. The general experimental design of an fMRI-NF protocol is described in Figure 1B. This technique is currently being used in cognitive modification (14) and clinical trials (15).
Figure 1. The principles of fMRI-neurofeedback. (A) Diagram of an fMRI-based neurofeedback system. (B) The neurofeedback training in fMRI-neurofeedback protocols.
fMRI-Neurofeedback in Psychiatry
fMRI-based neurofeedback could be a useful tool in psychiatry. Numerous studies have shown the benefits of fMRI-NF to relieve non-psychiatric clinical symptoms. Haller et al. demonstrated therapeutic effects of fMRI-NF (focusing on downregulation of auditory cortex) in the treatment of chronic tinnitus (16). deCharms et al. also published promising results for the management of chronic pain (17), although these results failed to be replicated (12).
Furthermore, recent progress in the field of brain imaging has allowed the identification of functional changes associated with a range of psychiatric symptoms (18). Because fMRI-NF can potentially be used to normalize the activity level of specific brain regions (which should be a key issue in new treatments), fMRI-NF could offer a new interesting way to treat mental health symptoms (19). To date, promising positive results have been already demonstrated in major depressive disorder (15, 20) and addiction (21–23).
Why Using fMRI-Neurofeedback for Auditory-Verbal Hallucinations in Schizophrenia?
In a paper published in 2012, McCarthy-Jones stressed the potential interests of developing neurofeedback as a new treatment of AVHs (24). In the past decade, significant progress in identifying the neural underpinning of AVHs has been made. This knowledge can inform on a target region for fMRI-NF.
To date, only a few studies reporting the use of neurofeedback in patients with schizophrenia have been published. Most of these studies used electroencephalogram (EEG)-based neurofeedback (the principle is the same as fMRI-NF, but the brain activity is measured with EEG) [e.g., Ref. (25–27), with one current study running a trial for the treatment of AVHs (28)]. Two studies have used fMRI-NF in patients with schizophrenia. Ruiz et al. demonstrated that patients with schizophrenia (n = 9) were able to achieve voluntary control of bilateral anterior insula cortex using an fMRI-NF protocol (29). Participants completed four training sessions spread over 2 weeks. Each training session comprised three runs of self-regulation training. Each run consisted of six upregulation and seven baseline blocks (30 s blocks). Patients were instructed that the recall of emotionally relevant past experiences combined with the feedback could enable them to control the thermometer bars. No specific emotional cues or recall strategies were given. The gain in the voluntary control was associated with behavioral changes assessed on a facial emotion recognition task (i.e., patients recognized disgust faces more accurately and happy faces less accurately after the fMRI-NF training). Furthermore, the training was associated with an increase in the number of the incoming and outgoing effective connections in the anterior insula. This proof-of-concept study demonstrates that patients with schizophrenia can not only benefit from fMRI-NF and learn volitional brain regulation but also find that such learning is accompanied with behavioral changes and neurophysiological changes in the underlying brain network (29). More recently, Cordes et al. showed that patients with schizophrenia (n = 11) were also able to learn to control the activity of their anterior cingulate cortex (ACC) (30). Here, three fMRI-NF training sessions were completed in 1 week. Each session included three runs consisting of eight regulation and nine baseline blocks lasting 30 s each. During the fMRI-NF session, the participants were asked to upregulate the signal using individual mental strategies. However, some template strategies from different cognitive domains were given: positive autobiographic memories, picturing oneself doing sports or playing an instrument, and concentration on given perceptions like feeling the temperature of one’s own left foot. The results demonstrated that both patients with schizophrenia and healthy controls were able to develop control abilities. However, they used different neural strategies: patients activated more of the dorsal and healthy controls activated more of the rostral subdivision of ACC. They also used different mental strategies: patients mainly imagined of music, whereas healthy controls used more imagined sports.
In summary, evidence suggests that patients with schizophrenia are able to learn voluntary control over their brain in spite of their pathology. All of this makes the fMRI-NF a promising tool to tackle frequent and disabling symptoms in this population, such as AVHs.
What Do we Know about the Neural Basis of Auditory-Verbal Hallucinations?
Neurocognitive Models
Phonologically, AVHs are heterogeneous in form and content (31). They vary from acousmas (primitive sounds, such as blowing, shooting), utterances, or simple words to full conversations, with defined characteristics such as pitch, volume, and accent. They might consist of a single voice or a collection of voices that speak the individual’s thought aloud, issuing commands and instructions, or provide a running commentary on the person’s behavior. The voices might be familiar or unknown (32). They often carry power, authority (33), and a negative quality [e.g., Ref. (2, 34)], and persons experiencing them often feel that they have no or little control over their AVHs (2).
From a neurocognitive perspective, hallucinations are erroneous perceptions or sensory deceptions without the presence of external stimuli and have been attributed to erroneous integration of sensory and cognitive processes (35) that may influence conscious perception (36). Brain regions that have been implicated in the experience of AVHs include the auditory cortex and the ventral attentional system that spontaneously orientates attention toward an incoming stimulus (37, 38).
A number of neurocognitive models have been proposed to account for heterogenic phenomenology of AVHs (39).1 The current models are based on research findings that illustrate the following contributing factors to the experience of AVHs. These are AVHs have clear perceptual qualities, AVHs are internally generated but are not attributed to an internal source, those experiencing AVHs have a reduced sense of control over the onset, content, and frequency of AVHs, and AVHs often carry an emotional component.
Externalization, or lack of agency, was explained by a model proposed by Frith (40), which postulated the breakdown in a physiological process known as self-monitoring. This model is based on the assumption that in patients with schizophrenia, inner speech and/thoughts fail to be recognized as self-generated due to a self-monitoring deficit; reflecting a dysfunction of the efference copy or corollary discharge mechanism that accompanies a motor action, such as speech or movement (41, 42).
In those experiencing hallucinations, the efference copy of inner speech does not produce a corollary discharge of the expected experience. Consequently, this failure in the corollary discharge mechanism can produce confusion regarding the agency between one’s own thoughts and externally generated voice, potentially resulting in an external attribution of the experience and the experience of AVHs. At a neuronal level, this may result in greater activity in the auditory cortex when self-generated speech or inner speech is produced (42, 43).
At a behavioral level, it has been shown that patients with schizophrenia and AVHs exhibit difficulty in identifying self-generated information (44–46). However, models based on the misattribution of inner speech do easily account for observed phenomenology of AVH (47, 48) and there is no evidence that the cancelation or suppression of reafference indicates the source of a sensory event: zero signal is not the same as self-generation (49).
Another early model postulates a deficit in source monitoring or reality testing (50). Source monitoring is a meta-cognitive (thinking about thinking) process that enables us to make attributions as to origins of beliefs and thoughts in order to form a cohesive representation of an experience (50). Bentall et al. suggested that patients with schizophrenia have deficits in discriminating between external (real) and internal (imagined) events, accompanied with a specific externalization bias. For example, it has been demonstrated that patients with schizophrenia and AVHs were more prone to misattribute self-generated items to other sources (51). Further, the experience of AVHs has also been related to deficits in reality testing. Based on signal detection theory (SDT), it was suggested that patients with schizophrenia and AVHs show a shift in the decision criterion (the point at which a person decides they perceive a stimulus) (52). SDT proposes that detection of a stimulus is based on two premises: perceptual sensitivity – the general efficiency of the perceptual system and response bias – the subjective decision criteria to deciding that a perceived event is a stimulus. For example, patients with schizophrenia and AVHs demonstrate higher perceptual sensitivity to detecting words or sounds embedded in white noise, as compared to non-hallucinating patients, but lower sensitivity compared to healthy controls (53). Further, patients with current AVHs also demonstrate a response bias, i.e., indicated that they were certain that a stimulus was presented, even when it was absent, suggesting that the perception/signal detection is unimpaired in patients with AVHs, but there is uncertainty in the signal recognition. This uncertainty, accompanied by a misattribution bias and source/reality monitoring deficits, perpetuates the attribution of thoughts to an external source. This may result in perceptual hypervigilance (54, 55) in responding to biases and lead to (strong) consolidation of such responses with time (56).
Substantial evidence supports the link between AVH and self-, source, and reality monitoring and has been provided over the last two decades (56, 57). Nonetheless, these early models alone cannot account for the presence of AVHs, as they fail to account for certain aspects of their phenomenology. AVHs are often experienced in the second and third person, they may consist of multiple voices that are not the voice of the experiencer, and the experiencers often converse with the AVHs (45, 49).
More recently, a number of models have been developed in order to incorporate the complex phenomenology of AVHs, by integrating the available neurophysiological data and adapting the predictive processing framework (PPF). For example, Allen et al. (35) proposed a neuroanatomical model founded upon a network of brain areas involved in both cognitive and perceptual processing; suggesting that hyperactivation of perceptual regions, including the primary and secondary auditory cortices evident during AVHs (38, 49, 58, 59), and in related speech and language areas (43, 58, 60). On the other hand, Wilkinson (61), adopted the PPF [e.g., Ref. (62)] to account for the phenomenology of AVH. In the framework of PPF, neuronal systems have evolved to predict statistical regularities in the environment based on prior experiences (63). Through successfully encoding predictions in an accurate manner, they minimize prediction errors or deviations from these predictions, and these are seen as the neural systems demonstrating an attenuated response to these predictable events; permitting the serial updating of prediction to create a picture of the external world. This creates a dynamic internal model that can impact on neuronal activity in sensory systems, increasing activity to unpredicted events through a failure of this predictive mechanism, with consequent alterations in subjective perception and elaboration into delusional belief formation (64).
Finally, these recent models suggest a number of cortical and subcortical brain networks involved in the experience of AVH and that verbal hallucinations involve hyperactivity in secondary and primary auditory cortex, accompanied by disrupted coupling with the cognitive processes associated with monitoring/reality testing.
Neuroimaging Studies
Structural Brain Imaging
Structural imaging studies (i.e., studies investigating the brain morphology) have identified subtle but robust reductions in the gray matter volume (GMV) in patients with AVHs, particularly in areas involved in speech and language. Altered GMV in the superior temporal gyrus (STG) has been highlighted by both priori-defined region of interest (ROI) analyses (65) and voxel-based morphometry studies (66). Modinos et al. demonstrated that AVHs severity was significantly associated with GMV reduction in the left STG, including the Heschl’s gyrus. Structural changes have also been identified in Broca’s area and its homotopic contralateral area (67) and the primary auditory cortex (Heschl’s gyrus) (68). In addition to reductions in GMV in language regions, numerous studies have reported modifications in other brain areas, such as temporal and frontal regions (69), insular cortex (70, 71), thalamus (72), and cerebellum (73).
In addition to these quantitative analyses, structural imaging also provides complementary qualitative measures of the cortical morphology, such as the shape of sulci and gyri (74). Indeed, gyrification is considered an indirect marker of brain development since cortical folding (i.e., gyrification and sulcation) begins in the tenth week of gestation and stabilizes by the end of the third trimester of pregnancy. The resulting complex sulcal/gyral patterns are then stable over life (75). Studying changes in cortical morphology associated with AVHs provides a novel way to assess the impact of developmental factors on this symptom (76). Significant reductions in the gyrification of language-related areas (e.g., the superior temporal ridges, the left middle frontal sulcus, Broca’s area) have been identified in chronic schizophrenia patients with AVHs when compared with healthy controls (77). The phenomenology of AVHs has also been associated with morphological changes within the language network. Indeed, the spatial location of AVHs (as internal or external percepts) has been associated with specific sulcal deviations in the right temporoparietal junction (78).
Functional Brain Imaging
Functional brain imaging studies in patients with AVHs have provided information about the neural bases of the susceptibility to hallucinate (trait studies), and neural activation that is seen during AVHs (state studies).
Trait Studies
Trait studies measure brain activity during specific tasks in patients who hallucinate and those who do not. Inquiring afterward for the absence of AVHs while scanning is necessary to avoid any “state” factor to interfere with this type of paradigm.
Trait studies have revealed altered functional activity in the temporal lobes of patients with AVHs (8, 79). Altered activation is thought to emerge from a competition between AVHs and normal external speech for processing sites within the temporal cortex (80). Similarly designed studies have identified a decrease in the functional activity of the rostral dorsal ACC, a structure known to be involved in the allocation of an internal or external origin for a given stimulus (81, 82). These results are not only compatible with the misattribution models of AVHs (see Neurocognitive Models) but also with recent structural data (83).
State Studies
Functional brain imaging suggests that a distributed network of brain regions underlies the experience of AVHs (84). Speech production and comprehension areas have been shown to be involved, but in addition to this network, brain areas involved in contextual memory seem to play a role in AVHs. This was notably revealed by a coordinate-based meta-analysis of AVHs capture studies, which demonstrated increased activity in Broca’s and Wernicke’s areas, and also in the hippocampal complex (84), suggesting that hallucinations could result from the aberrant activation of memory traces within associative cortices (85, 86). Although it is still a subject of debate, the activation of the primary auditory cortex does not appear to be necessary for the occurrence of AVHs. Nonetheless, its activation could be related to specific phenomenological aspects of the hallucinatory experience, such as the feeling of reality (87).
Connectivity Studies
Brain connectivity can be studied using three different approaches: functional connectivity, effective connectivity, and structural connectivity (88). Functional connectivity relies on correlation measures between spatially distant brain areas without information on the directionality or causality of the interaction. In contrast, effective connectivity explores the direct influence of one brain region on another, and thus provides information regarding the causal relationship between brain areas in a given network. Finally, structural connectivity is the measure of white matter tracts connecting different brain regions, based on diffusion MRI and tractography algorithms. Many connectivity studies have confirmed the dysconnectivity hypothesis in schizophrenia patients and in particular those who report hallucinations. Indeed, abnormal connectivity between brain regions has been shown at rest [for review, see Ref. (89, 90)] and during verbal tasks by functional and effective connectivity studies (91, 92). This dysconnectivity appears to play a major role in the emergence of hallucinations but was also found to change according to the sensory-modality involved (93, 94). Diffusion MRI studies comparing patients with schizophrenia who experience hallucinations, non-hallucinating patients with schizophrenia, and healthy controls have found differences in the coherence of the white matter bundles connecting language areas (68, 95, 96). This finding was particularly noteworthy in the arcuate fasciculus (97).
What Strategy to Relieve Auditory-Verbal Hallucinations with fMRI-Neurofeedback?
In this section, we propose three different fMRI-NF strategies dedicated to AVHs’ treatment on which our teams are currently working on (see Figure 2). We focus on the localization of the target and the type of feedback used for each strategy.
Figure 2. Presentation of three different strategies for fMRI-neurofeedback protocols to relieve AVHs. Strategy 1: co-registration of anatomical template of anterior cingulate cortex. Strategy 2: human voice responsive auditory cortex identified with a functional localizer. Strategy 3: linear Support Vector Machine discriminative maps of a classifier after recursive feature elimination steps, which is able to detect neural patterns associated with hallucinations in resting-state brain activity with a level of accuracy of 71%.
Strategy 1: A Priori Target Localized Using Structural MRI
Method Used to Localize the fMRI-Neurofeedback Target
During fMRI-NF protocols, the brain region(s) from which the NF signal is derived can be informed anatomically using structural MRI data and brain atlases (e.g., Talairach and Tournoux coordinates) or according to macroscopic anatomical landmarks. This method is the easiest to implement methodologically but assumes a good understanding of the underlying neural mechanisms and their anatomical location. The goal is to regulate neural activity in areas that show aberrant activations during AVHs (e.g., Broca’s and Wernicke’s areas) or to regulate activity in regions thought to be involved in compensatory or resilience processes (e.g., ACC). Below, we present an fMRI-NF protocol targeting the ACC (see Figure 2, Strategy 1).
Why Choose ACC as a Target for fMRI-Neurofeedback to Relieve AVHs?
Disrupted connectivity between the temporal and cingulate cortices has been demonstrated in schizophrenia, with AVHs severity correlating with the connectivity strength between the ACC and the STG (98, 99).
The ACC has a key role in regulating emotions, goal-directed behaviors, attentional processes, response selection, online source monitoring, and cognitive control (100, 101). Moreover, the ACC is involved in differentiating between self- and non-self related stimuli (82, 102). Furthermore, a meta-analysis of trait studies conducted in patients with AVHs and healthy controls revealed decreased ACC activity in hallucinators (79). This finding is in line with cognitive models of AVHs (30, 87).
A number of studies have demonstrated that the ACC can be reliably regulated using fMRI-based NF (13, 17, 103–106). Moreover, the successful upregulation of the rostral ACC was associated with an increase in positive affect (103, 106) and improved emotional perception of voices in healthy subjects (103).
Even though the theoretical accounts differ in the different studies (see Neurocognitive Models), they all assume a failure of typical ACC functions. The monitoring of inner speech processes, the monitoring of retrieval processes and error detection, as well as the suppression of task-irrelevant stimuli are all classical ACC functions that should be fostered by an upregulation of the ACC (107, 108). However, two previous studies report increased ACC activation during hallucinations (58, 109). It is possible that increased ACC activation may be related to default-mode fluctuations, considering simultaneous deactivations of auditory cortex and Wernicke’s area in the former study and resting-state activations without baseline subtraction in the latter study.
The fMRI-Neurofeedback Protocol
First, an anatomically predefined ACC mask is applied. From this ROI, the average signal is fed back on a thermometer-like display after filtering and artifact reduction. A custom anatomical template mask of the ACC defines the ROI [details in Ref. (110)]. This ACC mask is taken as a part of the cingulate cortex excluding parts inferior or posterior to the anterior fissure. The feedback signal is the average BOLD signal across this ACC mask for each volume with 1% representing the full scale. A custom toolbox conducts online processing comprising motion correction and co-registration to a template (111). Kalman filter reduces singular values and high-frequency components. An exponential moving average algorithm removes temporal drifts.
The patient performs three fMRI-NF training runs, each consisting of eight regulation blocks and nine baseline blocks (30 s each; see exemplary run in Figure 2). Increase of ACC signal makes a green bar moving upwards and decreasing downwards [Ref. (30)]. A fixed red bar in the regulation condition serves as a regulation target. It indicates the upper limit of ACC upregulation. The baseline condition is indicated by a blue line display. Mental strategies should be tried to move the green line upwards to the red line. During the baseline blocks, the patient counts backwards from 100. Every repetition time (TR; 1 s), the display is updated. The NF procedure is explained to subjects, including the delay of the NF signal for 3–5 s due to the hemodynamic response and data processing (<1 s).
Preliminary Data
Patients with schizophrenia can learn to regulate the ACC to a comparable level than healthy controls, albeit involving different networks and cognitive strategies (30). Moreover, a recent article involving three schizophrenia patients suggests that even with ongoing AVHs, patients are able to learn ACC regulation (110). In this work, patients seemed to be very interested in the methodology and were eager to learn. Since the target groups were patients with long-standing symptoms, a core preposition was a good patient–therapist relationship and only limited impairments in cognitive functions. RWTH Aachen University is just performing a clinical trial study investigating the effect of fMRI-NF training in schizophrenia patients with ongoing AVHs.
Previous fMRI-NF studies have demonstrated that upregulation of a single area can elicit alterations of functional and effective connectivity (112, 113). Further studies may elucidate whether ACC upregulation also induces changes of the network dynamics. In the long term, it may be even more effective if fMRI-NF could target several regions aiming to regulate the functional connectivity between these regions. This would allow fMRI-NF to address the neural dysconnectivity that is proposed to underpin AVHs (114). This approach would also enable the regulation of connectivity and activity with the salience network, also proposed to be dysfunctional in people with AVHs (115–117).
Strategy 2: Region of Interest Defined Using a Functional Localizer
Method Used to Localize the fMRI-Neurofeedback Target
The target chosen for fMRI-NF can also be functionally defined. In this case, the patient is asked to undertake a functional task within the scanner, and activated areas are then used as the ROI(s) for fMRI-NF. The choice in the “functional localizer” task should be based on an a priori hypothesis that is well validated in previous studies.
Why Use a Functional Localizer for fMRI-Neurofeedback to Relieve AVHs?
As already mentioned, in schizophrenia, both state and trait brain imaging studies have revealed aberrant neural activation in patients with AVHs. Resting-state or “non-task” studies suggest that several speech-related areas are linked with such experiences, as well as the ACC and the hippocampal complex (see What Do We Know about the Neural Basis of Auditory-Verbal Hallucinations?). Similarly, task-related paradigms have identified frontotemporal dysconnectivity in patients with AVHs, specifically between the left STG and the dorsal ACC (99) and the medial prefrontal cortex (118), regions thought to be involved in self-other source monitoring. Disruption of these mechanisms is consistent with cognitive models that postulate aberrant bottom-up and top-down processes in AVHs.
Any of these regions could potentially be defined as a target to create a ROI mask for fMRI-NF. However, rather than using a structural or anatomically defined mask, a functional localizer task can be used to define the ROI (119). The choice of an appropriate task for the functional localizer should be informed by previous imaging studies, i.e., studies consistently discriminating the target ROI from other brain activity.
For example, two meta-analyses of AVHs in schizophrenia demonstrated that the human voice sensitive region of the left and right STG is associated with the experience of AVHs (66, 79). Therefore, this region could serve as a potential ROI mask (see Figure 2, Strategy 2). The functional localizer task would need to be designed to specifically identify the human voice responsive auditory cortex [i.e., the task reported in Ref. (120)]. This could be obtained by running of blocks of words (activation) and non-word speech analogs (baseline).
The fMRI-Neurofeedback Protocol
After completing data acquisition, the effective signal change measured within the functional localizer tasks is analyzed with univariate fMRI methods, such as the general linear model. The difference between the average BOLD signal of the activation block and the baseline block should be used to create the ROI mask. Several programs offer tools for online analysis, e.g., the AFNI software (http://afni.nimh.nih.gov/afni/). Here, the mask is created by eyeballing the resulting 3D cluster and manually specifying the statistical thresholds until a cluster of the required size/shape is present in the target ROIs. Ideally, the cluster size choice should be informed by previous meta-analytic studies. The mask should also include a control region to serve the averaging out of non-specific brain activation. A randomized controlled trial should also include a control group utilizing a control ROI mask, and each participant should complete both the target and control ROI localizer tasks, in spite of group assignment.
A new mask ROI can be created during each scan, or a retrospective method can be used, whereby the mask obtained during the first visit is used during subsequent neurofeedback trainings. The retrospective method requires the alignment of the different time-series data obtained from different scans. Some MRI scanners allow the realignment of previously obtained data with the current images. However, if this option is not available, most online analysis software have inbuilt algorithms that allow to realigning images obtained during different scanning sessions. The advantage of the retrospective method is the reduction of scanning time and therefore participant discomfort as well as global costs. In addition, the ROI mask does not change shape or size.
In terms of the neurofeedback training, this procedure remains the same as during anatomically masked ROI real-time fMRI, i.e., feedback is provided during the entire training run but remains static during rest (no-regulation blocks). Similarly, participants need to be informed about the inherent delay in feedback due to the hemodynamic response and adhere to standardized instructions. To enhance motivation and the likelihood of successful signal downregulations, participants are instructed to devise their own strategy to downregulate their signal (29, 121).
Strategy 3: Pattern Recognition Using a Multivariate Classifier
Method Used to Localize the fMRI-NF Target
The two previous strategies rely on imaging-based “trait markers” (i.e., persistent traits or vulnerability markers that can also be detected in the presymptomatic and remitted phases of mental disorders). The patient is trained to gain control of areas known to be involved in the AVHs’ pathophysiology. When using such a methodology, the occurrence of hallucinations in the scanner during neurofeedback sessions is not necessary.
However, because hallucinations are acute symptoms, notably characterized by intrusiveness and phasic activity, they can also be targeted with a different type of strategy based on “state markers” (i.e., which correlate with symptomatic states). Here, the objective is to train the subject to self-regulate the activity of brain areas that reactivate during symptomatic states. Machine-learning, and particularly the recent development of “linear Support Vector Machine” (lSVM), offers several advantages in this context. Indeed, this technique classifies functional or anatomical patterns using a multivariate strategy. A training session allows the optimal classifier to be built on the basis of a training dataset, for which the periods of interest (e.g., symptomatic vs. asymptomatic) have been identified and provided (122). A validation session is then needed to test the performance and possible generalization of this classifier to new data based on an independent sample. Several interesting results for diagnosis or therapeutic response prediction purposes have been published, notably in bipolar disorder (123) or schizophrenia (124). However, this is not the only way to use such tools in psychiatry. Classifiers can quickly detect the emergence of subjective symptoms by detecting specific patterns of brain activity identified during symptomatic periods (see Figure 2, Strategy 3).
Why Use Classifiers for fMRI-NF to Relieve AVHs?
Using fMRI classifiers, it is now possible to detect the onset of subjective symptoms together with the associated brain activation patterns (125, 126). For example, our group developed such a classifier to detect AVHs occurrence while scanning a patient with a 71% accuracy (127). This algorithm is currently under optimization and already reaches 80% accuracy. Even if no data are currently available on the use of this kind of classifier in fMRI-NF protocols, the fine-grained activity patterns obtained could theoretically be used as the signal fed back to the patient. Future studies should allow specifying the minimal necessary accuracy.
However, to be eligible for this strategy, the patient’s hallucinations must exhibit some specific features. The most important criterion is frequent occurrence. Indeed, the symptom must occur several times during the fMRI session. Moreover, data analysis and patient interviews must allow the identification of “symptomatic” and “asymptomatic” periods to build an efficient classifier. In our case, we chose to build a subject-independent classifier based on the AVHs presence or absence, determined with the methodology described in Ref. (87). This strategy presents substantial benefits compared with a subject-dependent pattern classification of fMRI signals, notably a considerable time-saving (128).
The fMRI-Neurofeedback Protocol
Unlike the two methods described above, this strategy does not imply a block paradigm. Indeed, the visual feedback provides an information in real time about the current state of the participant (hallucinating or not) all along the session. The visual feedback may be a thermometer whose signal intensity is based on the level of activation in the ROIs (given by the discriminative maps of the classifier). But, other possibilities emerged from recent work on AVHs. Our team recently proposed a method to distinguish between the different periods in the occurrence of AVHs (117). Even if we are at a very preliminary stage, this could theoretically allow for the implementation of a multi-classifier strategy with the possibility to discriminate multiple “brain-states” as, in our case, (i) “No hallucination” (“Off” period on Figure 2), (ii) “Transition” (“Trans” period on Figure 2; i.e., period immediately preceding the AVHs occurrence), (iii) “Hallucination” (“On” period on Figure 2), and (iv) “End” (“End” period on Figure 2; i.e., period immediately following the AVHs occurrence). This technique can provide a feedback indicating which “brain-state” is identified. For example (as presented in Figure 2), a four-part diagram presenting the four brain-states can be used. If the “hallucination” period or “transition” period is identified, the participant must adapt his/her mental strategy to go back to “end” or “no hallucination” periods. This kind of feedback could also be combined with a thermometer display (to provide both a continuous and a discrete variable to the subject).
Limits and Future Directions
fMRI-Neurofeedback Experimental Designs
The most obvious limitation of the available studies testing fMRI-NF protocols are their small sample sizes, making generalization difficult. For AVHs, no study assessing the efficacy of fMRI-NF is currently available. Nevertheless, the improved understanding of the neural underpinnings of AVHs seen in recent years and the preliminary results presented here should inform future studies.
The gold-standard to assess new treatments is the double-blind, randomized controlled trial design. However, a major issue in fMRI-NF protocols is to achieve complete “blindness” in patients, because an active collaboration is needed during the sessions. This directly questions what could be an ideal control condition? Four kinds of control conditions have been described in the literature (11) (i) mental task outside of the scanner, (ii) sham feedback using brain signal of interest from previous participant, (iii) sham feedback using inverse brain signal of interest, and (iv) sham feedback using brain signal from an unrelated region. The first solution appears unsatisfactory because patients in the control group are not exposed to fMRI-NF. Using a brain signal of interest from previous participants may generate frustration and retention since participants may unravel the non-contingency of the feedback, which would unblind them and reduce their engagement with the intervention. Moreover, for patients with severe AVHs, this kind of feedback could increase anxiety, letting them think that they have no control on their neural activity. Using an inverse brain signal of interest is unethical in the specific case of AVHs treatment. Indeed, this kind of sham feedback aims to test if inverse brain modulation prompts opposite behavioral changes. As a consequence, the expected change would be a worsening of AVHs symptomatology. Neurofeedback from a non-interest region should be the “least bad” solution for a control condition in fMRI-NF protocols to treat AVHs. The selection of a non-interest region appears crucial here and could be a difficult challenge, given the complexity (and spread) of the brain networks involved in AVHs (unfortunately, no data are currently available on the potential non-interest ROI that could be used for protocol, testing the efficiency of fMRI-NF in AVHs).
Another significant challenge to adequately assess neurofeedback effectiveness is to develop dedicated post-session scales that are able to identify the specific cognitive coping strategies used by the patients during the session. Such individualized strategies could then be applied in psychotherapy, potentially leading to the development of neuroimaging-guided programs. A rigorous evaluation of the strategies used to cope with AVHs during the fMRI-NF sessions could then be helpful to optimize general hallucination-focused psychotherapy programs. We believe that this may constitute an interesting two-way relationship between conventional psychotherapy and fMRI-NF: fMRI-NF is a precious tool to optimize hallucination-focused psychotherapy programs, while the identification of brain changes after psychotherapy allows for the identification of new neurofeedback targets.
Finally, testing whether brain self-regulation persists after the fMRI-NF protocols is a crucial issue. The “transfer session” (see Figure 1) may provide information about the capacity of participants to self-regulate the target region(s) without feedback. Furthermore, it will be very important to determine how long this capacity persists after the fMRI-NF and how long the clinical improvement is maintained. To date, no formal follow-ups of symptoms were conducted with the patients. The question of the potential long-term effects of these treatments is clearly under-assessed in fMRI Brain–Computer Interface research in general (113) and no data are currently available for patients with schizophrenia.
fMRI-Neurofeedback Protocols
In addition to the non-invasive nature of fMRI-NF, one of its prominent features is to put the patient at the heart of the process. On one hand, the active participation of the patient in fMRI-NF may contribute to the reinforcement of their feeling self-efficacy [which constitutes an important therapeutic factor (129)]. On the other hand, this active nature may be source of limitations in schizophrenia patients with strong negative symptoms, who may lack motivation. Although some data seem to indicate that patients suffering from schizophrenia are able to achieve voluntary control of their own brain activity during fMRI-NF (29, 30), these results need to be confirmed in studies with larger samples. Given the importance of motivation in neurofeedback protocols, it seems very relevant to consider factors interfering with reward processing, such as negative symptoms and antipsychotic medication. The effort required by patients to undergo the fMRI-NF training should not be underestimated as well as the mixed motivation of the patients, since there often exists some positive aspects to the hallucinatory experiences, which the patients may fear losing as a result of the training. Future research will have to determine what the best experimental settings/instructions are for patients suffering from refractory AVHs together with severe negative symptoms.
Considering task design, the most of fMRI-NF studies use a block design (i.e., alternating periods of upregulation or downregulation with rest periods during neurofeedback runs, see Figure 1). However, the optimal number of blocks per run, the ideal duration of regulation blocks, and the best number of sessions to obtain a maximal efficacy in the treatment of AVHs remain unknown. Future research should determine if patients suffering from schizophrenia (particularly those who exhibit severe cognitive impairment) may benefit from special arrangements in fMRI-NF protocols to minimize the attention span and the tiredness.
Informal reassessments during clinical visits that were conducted during the pilot study of the currently ongoing study with schizophrenia patients with AVHs (see above) revealed that none of the patients reported adverse events, and two of the patients claimed to have developed different strategies in dealing with their AVHs up to few weeks after the training (110). However, during contact and assessment occurring more than a month after the training, none of the patients had the impression that fMRI-NF training had had any influence on their symptoms. Individual variability and fluctuation in the disease course may override the – so far rather small – effects of the fMRI-NF training. This may change with better targeted fMRI-NF protocols. However, based on clinical impressions, we would suggest that at least monthly booster session would be advisable for clinical trials.
From a methodological point of view, uncertainty lies also about the instructions to be given before the session. It remains unknown if explicit (the participant is asked to use specific mental strategies for self-regulation) or implicit (the participant is only asked to upregulate or downregulate with the feedback provided) instructions should be preferred. Implicit instructions are ideal in general population, because they favor the development of individualized strategies to achieve voluntary control of the target region(s). However, the identification of an optimal strategy may be difficult for patients with severe AVHs, which could lead to a rapid decline in motivation. That is why providing specific explicit strategies could be useful to enhance the efficacy of fMRI-NF to treat AVHs. Strategies inspired from CBT could allow the participant for achieving voluntary control more quickly.
Finally, considering the definition of the fMRI-NF target, many other neural networks may serve as target for the fMRI-NF training. Interestingly, one of the most robust effects of fMRI-NF training seems to be changes in connectivity [e.g., Ref. (112, 130)]. Indeed, the first fMRI-NF studies attempt to train network connectivity directly (131, 132). Considering the importance of network function on the AVHs phenotype, connectivity fMRI-NF will be one of the next targets for treatment approaches to AVHs.
Conclusion
Although a number of studies are currently investigating the efficacy of fMRI-NF for AVH, as for today, efficiency data from randomized controlled trials are lacking (11). In this paper, we focused on specific fMRI-NF strategies to treat AVHs and selected three of them that appear most feasible, emphasizing the need for preliminary studies. Indeed, considering the potential cost necessary to implement fMRI-NF, proof-of-concept studies are urgently required to define the optimal strategy for application in patients with AVHs. This technique has the potential to establish a new brain imaging-guided psychotherapy for patients that do not respond to conventional treatments and take functional neuroimaging to therapeutic applications.
Author Contributions
TF, NO, MD, PA, KM, and RJ equally contributed to the manuscript writing.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
TF is partially supported by a doctoral fellowship from the Pierre Deniker Foundation.
Footnote
- ^Belzeaux R, Cermolacce M, Jardri R. Hallucinations: toward a dialogue between phenomenology and brain imaging research. J Conscious Stud (Forthcoming).
References
1. Andreasen NC, Flaum M. Schizophrenia: the characteristic symptoms. Schizophr Bull (1991) 17:27–49. doi: 10.1093/schbul/17.1.27
2. Nayani TH, David AS. The auditory hallucination: a phenomenological survey. Psychol Med (1996) 26:177–89. doi:10.1017/S003329170003381X
3. Shergill SS, Murray RM, McGuire PK. Auditory hallucinations: a review of psychological treatments. Schizophr Res (1998) 32:137–50. doi:10.1016/S0920-9964(98)00052-8
4. van der Gaag M, Valmaggia LR, Smit F. The effects of individually tailored formulation-based cognitive behavioural therapy in auditory hallucinations and delusions: a meta-analysis. Schizophr Res (2014) 156:30–7. doi:10.1016/j.schres.2014.03.016
5. Valmaggia LR, van der Gaag M, Tarrier N, Pijnenborg M, Slooff CJ. Cognitive-behavioural therapy for refractory psychotic symptoms of schizophrenia resistant to atypical antipsychotic medication. Randomised controlled trial. Br J Psychiatry (2005) 186:324–30. doi:10.1192/bjp.186.4.324
6. Durham RC, Guthrie M, Morton RV, Reid DA, Treliving LR, Fowler D, et al. Tayside-Fife clinical trial of cognitive-behavioural therapy for medication-resistant psychotic symptoms. Results to 3-month follow-up. Br J Psychiatry (2003) 182:303–11. doi:10.1192/bjp.182.4.303
7. Hugdahl K. Auditory hallucinations: a review of the ERC “VOICE” project. World J Psychiatry (2015) 5:193–209. doi:10.5498/wjp.v5.i2.193
8. Allen P, Modinos G, Hubl D, Shields G, Cachia A, Jardri R, et al. Neuroimaging auditory hallucinations in schizophrenia: from neuroanatomy to neurochemistry and beyond. Schizophr Bull (2012) 38:695–703. doi:10.1093/schbul/sbs066
9. Demeulemeester M, Amad A, Bubrovszky M, Pins D, Thomas P, Jardri R. What is the real effect of 1-Hz repetitive transcranial magnetic stimulation on hallucinations? Controlling for publication bias in neuromodulation trials. Biol Psychiatry (2012) 71:e15–6. doi:10.1016/j.biopsych.2011.10.010
10. Fovet T, Jardri R, Linden D. Current issues in the use of fMRI-based neurofeedback to relieve psychiatric symptoms. Curr Pharm Des (2015) 21:3384–94. doi:10.2174/1381612821666150619092540
11. Thibault RT, Lifshitz M, Raz A. The self-regulating brain and neurofeedback: experimental science and clinical promise. Cortex (2015) 74:247–61. doi:10.1016/j.cortex.2015.10.024
12. Sulzer J, Haller S, Scharnowski F, Weiskopf N, Birbaumer N, Blefari ML, et al. Real-time fMRI neurofeedback: progress and challenges. Neuroimage (2013) 76:386–99. doi:10.1016/j.neuroimage.2013.03.033
13. Mathiak KA, Koush Y, Dyck M, Gaber TJ, Alawi E, Zepf FD, et al. Social reinforcement can regulate localized brain activity. Eur Arch Psychiatry Clin Neurosci (2010) 260(Suppl):S132–6. doi:10.1007/s00406-010-0135-9
14. Ruiz S, Buyukturkoglu K, Rana M, Birbaumer N, Sitaram R. Real-time fMRI brain computer interfaces: self-regulation of single brain regions to networks. Biol Psychol (2014) 95:4–20. doi:10.1016/j.biopsycho.2013.04.010
15. Linden DEJ, Habes I, Johnston SJ, Linden S, Tatineni R, Subramanian L, et al. Real-time self-regulation of emotion networks in patients with depression. PLoS One (2012) 7:e38115. doi:10.1371/journal.pone.0038115
16. Haller S, Birbaumer N, Veit R. Real-time fMRI feedback training may improve chronic tinnitus. Eur Radiol (2010) 20:696–703. doi:10.1007/s00330-009-1595-z
17. deCharms RC, Maeda F, Glover GH, Ludlow D, Pauly JM, Soneji D, et al. Control over brain activation and pain learned by using real-time functional MRI. Proc Natl Acad Sci U S A (2005) 102:18626–31. doi:10.1073/pnas.0505210102
18. Amad A, Fovet T, Geoffroy PA. Keep calm: psychiatric disorders are organic! The power of words in medicine. Aust N Z J Psychiatry (2016) 50:100–1. doi:10.1177/0004867415601730
19. Kim S, Birbaumer N. Real-time functional MRI neurofeedback: a tool for psychiatry. Curr Opin Psychiatry (2014) 27:332–6. doi:10.1097/YCO.0000000000000087
21. Hanlon CA, Hartwell KJ, Canterberry M, Li X, Owens M, Lematty T, et al. Reduction of cue-induced craving through realtime neurofeedback in nicotine users: the role of region of interest selection and multiple visits. Psychiatry Res (2013) 213:79–81. doi:10.1016/j.pscychresns.2013.03.003
22. Karch S, Keeser D, Hümmer S, Paolini M, Kirsch V, Karali T, et al. Modulation of craving related brain responses using real-time fMRI in patients with alcohol use disorder. PLoS One (2015) 10:e0133034. doi:10.1371/journal.pone.0133034
23. Kirsch M, Gruber I, Ruf M, Kiefer F, Kirsch P. Real-time functional magnetic resonance imaging neurofeedback can reduce striatal cue-reactivity to alcohol stimuli. Addict Biol (2015). doi:10.1111/adb.12278
24. McCarthy-Jones S. Taking back the brain: could neurofeedback training be effective for relieving distressing auditory verbal hallucinations in patients with schizophrenia? Schizophr Bull (2012) 38:678–82. doi:10.1093/schbul/sbs006
25. Bolea AS. Neurofeedback treatment of chronic inpatient Schizophrenia. J Neurother (2010) 14:47–54. doi:10.1080/10874200903543971
26. Gruzelier J, Hardman E, Wild J, Zaman R. Learned control of slow potential interhemispheric asymmetry in schizophrenia. Int J Psychophysiol (1999) 34:341–8. doi:10.1016/S0167-8760(99)00091-4
27. Surmeli T, Ertem A, Eralp E, Kos IH. Schizophrenia and the efficacy of qEEG-guided neurofeedback treatment: a clinical case series. Clin EEG Neurosci (2012) 43:133–44. doi:10.1177/1550059411429531
28. ISRCTN. ISRCTN23930628: Neurofeedback Treatment of Auditory Verbal Hallucinations. (2016). Available from: http://www.isrctn.com/ISRCTN23930628?q=neurofeedback%20hallucinations&filters=&sort=&offset=1&totalResults=1&page=1&pageSize=10&searchType=basic-search
29. Ruiz S, Lee S, Soekadar SR, Caria A, Veit R, Kircher T, et al. Acquired self-control of insula cortex modulates emotion recognition and brain network connectivity in schizophrenia. Hum Brain Mapp (2013) 34:200–12. doi:10.1002/hbm.21427
30. Cordes JS, Mathiak KA, Dyck M, Alawi EM, Gaber TJ, Zepf FD, et al. Cognitive and neural strategies during control of the anterior cingulate cortex by fMRI neurofeedback in patients with schizophrenia. Front Behav Neurosci (2015) 9:169. doi:10.3389/fnbeh.2015.00169
31. Aleman A, Larøi F. Hallucinations: The Science of Idiosyncratic Perception. Washington, DC: American Psychological Association (2008).
32. Larøi F, Sommer IE, Blom JD, Fernyhough C, Ffytche DH, Hugdahl K, et al. The characteristic features of auditory verbal hallucinations in clinical and nonclinical groups: state-of-the-art overview and future directions. Schizophr Bull (2012) 38:724–33. doi:10.1093/schbul/sbs061
33. Birchwood M, Chadwick P. The omnipotence of voices: testing the validity of a cognitive model. Psychol Med (1997) 27:1345–53. doi:10.1017/S0033291797005552
34. Johns LC, Hemsley D, Kuipers E. A comparison of auditory hallucinations in a psychiatric and non-psychiatric group. Br J Clin Psychol (2002) 41:81–6. doi:10.1348/014466502163813
35. Allen P, Larøi F, McGuire PK, Aleman A. The hallucinating brain: a review of structural and functional neuroimaging studies of hallucinations. Neurosci Biobehav Rev (2008) 32:175–91. doi:10.1016/j.neubiorev.2007.07.012
36. Aleman A, Böcker KBE, Hijman R, de Haan EHF, Kahn RS. Cognitive basis of hallucinations in schizophrenia: role of top-down information processing. Schizophr Res (2003) 64:175–85. doi:10.1016/S0920-9964(03)00060-4
37. Belin P, Fecteau S, Bédard C. Thinking the voice: neural correlates of voice perception. Trends Cogn Sci (2004) 8:129–35. doi:10.1016/j.tics.2004.01.008
38. Hunter MD, Eickhoff SB, Miller TWR, Farrow TFD, Wilkinson ID, Woodruff PWR. Neural activity in speech-sensitive auditory cortex during silence. Proc Natl Acad Sci U S A (2006) 103:189–94. doi:10.1073/pnas.0506268103
39. McCarthy-Jones S, Thomas N, Strauss C, Dodgson G, Jones N, Woods A, et al. Better than mermaids and stray dogs? Subtyping auditory verbal hallucinations and its implications for research and practice. Schizophr Bull (2014) 40(Suppl 4):S275–84. doi:10.1093/schbul/sbu018
41. Feinberg I. Efference copy and corollary discharge: implications for thinking and its disorders. Schizophr Bull (1978) 4:636–40. doi:10.1093/schbul/4.4.636
42. Ford JM, Mathalon DH. Corollary discharge dysfunction in schizophrenia: can it explain auditory hallucinations? Int J Psychophysiol (2005) 58:179–89. doi:10.1016/j.ijpsycho.2005.01.014
43. McGuire PK, Silbersweig DA, Wright I, Murray RM, Frackowiak RS, Frith CD. The neural correlates of inner speech and auditory verbal imagery in schizophrenia: relationship to auditory verbal hallucinations. Br J Psychiatry (1996) 169:148–59. doi:10.1192/bjp.169.2.148
44. Johns LC, McGuire PK. Verbal self-monitoring and auditory hallucinations in schizophrenia. Lancet (1999) 353:469–70. doi:10.1016/S0140-6736(98)05288-X
45. Allen PP, Johns LC, Fu CHY, Broome MR, Vythelingum GN, McGuire PK. Misattribution of external speech in patients with hallucinations and delusions. Schizophr Res (2004) 69:277–87. doi:10.1016/j.schres.2003.09.008
46. Johns LC, Gregg L, Allen P, McGuire PK. Impaired verbal self-monitoring in psychosis: effects of state, trait and diagnosis. Psychol Med (2006) 36:465–74. doi:10.1017/S0033291705006628
47. McCarthy-Jones S, Fernyhough C. The varieties of inner speech: links between quality of inner speech and psychopathological variables in a sample of young adults. Conscious Cogn (2011) 20:1586–93. doi:10.1016/j.concog.2011.08.005
48. Langdon R, Jones SR, Connaughton E, Fernyhough C. The phenomenology of inner speech: comparison of schizophrenia patients with auditory verbal hallucinations and healthy controls. Psychol Med (2009) 39:655–63. doi:10.1017/S0033291708003978
49. Cho R, Wu W. Mechanisms of auditory verbal hallucination in schizophrenia. Front Psychiatry (2013) 4:155. doi:10.3389/fpsyt.2013.00155
50. Johnson MK, Hashtroudi S, Lindsay DS. Source monitoring. Psychol Bull (1993) 114:3–28. doi:10.1037/0033-2909.114.1.3
51. Brébion G, Amador X, David A, Malaspina D, Sharif Z, Gorman JM. Positive symptomatology and source-monitoring failure in schizophrenia – an analysis of symptom-specific effects. Psychiatry Res (2000) 95:119–31. doi:10.1016/S0165-1781(00)00174-8
52. Bentall RP, Slade PD. Reality testing and auditory hallucinations: a signal detection analysis. Br J Clin Psychol (1985) 24(Pt 3):159–69. doi:10.1111/j.2044-8260.1985.tb01331.x
53. Vercammen A, de Haan EHF, Aleman A. Hearing a voice in the noise: auditory hallucinations and speech perception. Psychol Med (2008) 38:1177–84. doi:10.1017/S0033291707002437
54. Dodgson G, Gordon S. Avoiding false negatives: are some auditory hallucinations an evolved design flaw? Behav Cogn Psychother (2009) 37:325–34. doi:10.1017/S1352465809005244
55. Dudley R, Dodgson G, Sarll G, Halhead R, Bolas H, McCarthy-Jones S. The effect of arousal on auditory threat detection and the relationship to auditory hallucinations. J Behav Ther Exp Psychiatry (2014) 45:311–8. doi:10.1016/j.jbtep.2014.02.002
56. Waters F, Woodward T, Allen P, Aleman A, Sommer I. Self-recognition deficits in schizophrenia patients with auditory hallucinations: a meta-analysis of the literature. Schizophr Bull (2012) 38:741–50. doi:10.1093/schbul/sbq144
57. Brookwell ML, Bentall RP, Varese F. Externalizing biases and hallucinations in source-monitoring, self-monitoring and signal detection studies: a meta-analytic review. Psychol Med (2013) 43:2465–75. doi:10.1017/S0033291712002760
58. Shergill SS, Brammer MJ, Williams SCR, Murray RM, McGuire PK. Mapping auditory hallucinations in schizophrenia using functional magnetic resonance imaging. Arch Gen Psychiatry (2000) 57:1033. doi:10.1001/archpsyc.57.11.1033
59. Homan P, Kindler J, Hauf M, Walther S, Hubl D, Dierks T. Repeated measurements of cerebral blood flow in the left superior temporal gyrus reveal tonic hyperactivity in patients with auditory verbal hallucinations: a possible trait marker. Front Hum Neurosci (2013) 7:304. doi:10.3389/fnhum.2013.00304
60. Sommer IEC, Diederen KMJ, Blom JD, Willems A, Kushan L, Slotema K, et al. Auditory verbal hallucinations predominantly activate the right inferior frontal area. Brain (2008) 131:3169–77. doi:10.1093/brain/awn251
61. Wilkinson S. Accounting for the phenomenology and varieties of auditory verbal hallucination within a predictive processing framework. Conscious Cogn (2014) 30:142–55. doi:10.1016/j.concog.2014.09.002
62. Wolpert DM. Computational approaches to motor control. Trends Cogn Sci (1997) 1:209–16. doi:10.1016/S1364-6613(97)01070-X
63. Friston K. The free-energy principle: a unified brain theory? Nat Rev Neurosci (2010) 11:127–38. doi:10.1038/nrn2787
64. Horga G, Schatz KC, Abi-Dargham A, Peterson BS. Deficits in predictive coding underlie hallucinations in schizophrenia. J Neurosci (2014) 34:8072–82. doi:10.1523/JNEUROSCI.0200-14.2014
65. Levitan C, Ward PB, Catts SV. Superior temporal gyral volumes and laterality correlates of auditory hallucinations in schizophrenia. Biol Psychiatry (1999) 46:955–62. doi:10.1016/S0006-3223(98)00373-4
66. Modinos G, Costafreda SG, van Tol MJ, McGuire PK, Aleman A, Allen P. Neuroanatomy of auditory verbal hallucinations in schizophrenia: a quantitative meta-analysis of voxel-based morphometry studies. Cortex (2013) 49:1046–55. doi:10.1016/j.cortex.2012.01.009
67. García-Martí G, Aguilar EJ, Lull JJ, Martí-Bonmatí L, Escartí MJ, Manjón JV, et al. Schizophrenia with auditory hallucinations: a voxel-based morphometry study. Prog Neuropsychopharmacol Biol Psychiatry (2008) 32:72–80. doi:10.1016/j.pnpbp.2007.07.014
68. Hubl D, Dougoud-Chauvin V, Zeller M, Federspiel A, Boesch C, Strik W, et al. Structural analysis of Heschl’s gyrus in schizophrenia patients with auditory hallucinations. Neuropsychobiology (2010) 61:1–9. doi:10.1159/000258637
69. Shin SE, Lee JS, Kang MH, Kim CE, Bae JN, Jung G. Segmented volumes of cerebrum and cerebellum in first episode schizophrenia with auditory hallucinations. Psychiatry Res (2005) 138:33–42. doi:10.1016/j.pscychresns.2004.11.005
70. Crespo-Facorro B, Kim J, Andreasen NC, O’Leary DS, Bockholt HJ, Magnotta V. Insular cortex abnormalities in schizophrenia: a structural magnetic resonance imaging study of first-episode patients. Schizophr Res (2000) 46:35–43. doi:10.1016/S0920-9964(00)00028-1
71. Crespo-Facorro B, Roiz-Santiáñez R, Quintero C, Pérez-Iglesias R, Tordesillas-Gutiérrez D, Mata I, et al. Insular cortex morphometry in first-episode schizophrenia-spectrum patients: diagnostic specificity and clinical correlations. J Psychiatr Res (2010) 44:314–20. doi:10.1016/j.jpsychires.2009.08.014
72. Huang P, Xi Y, Lu ZL, Chen Y, Li X, Li W, et al. Decreased bilateral thalamic gray matter volume in first-episode schizophrenia with prominent hallucinatory symptoms: a volumetric MRI study. Sci Rep (2015) 5:14505. doi:10.1038/srep14505
73. Neckelmann G, Specht K, Lund A, Ersland L, Smievoll AI, Neckelmann D, et al. Mr morphometry analysis of grey matter volume reduction in schizophrenia: association with hallucinations. Int J Neurosci (2006) 116:9–23. doi:10.1080/00207450690962244
74. Cachia A, Amad A, Brunelin J, Krebs MO, Plaze M, Thomas P, et al. Deviations in cortex sulcation associated with visual hallucinations in schizophrenia. Mol Psychiatry (2014) 20(9):1101–7. doi:10.1038/mp.2014.140
75. Mangin JF, Jouvent E, Cachia A. In-vivo measurement of cortical morphology: means and meanings. Curr Opin Neurol (2010) 23:359–67. doi:10.1097/WCO.0b013e32833a0afc
76. Cachia A, Mangin JF, Rivière D, Kherif F, Boddaert N, Andrade A, et al. A primal sketch of the cortex mean curvature: a morphogenesis based approach to study the variability of the folding patterns. IEEE Trans Med Imaging (2003) 22:754–65. doi:10.1109/TMI.2003.814781
77. Cachia A, Paillère-Martinot ML, Galinowski A, Januel D, de Beaurepaire R, Bellivier F, et al. Cortical folding abnormalities in schizophrenia patients with resistant auditory hallucinations. Neuroimage (2008) 39:927–35. doi:10.1016/j.neuroimage.2007.08.049
78. Plaze M, Paillère-Martinot ML, Penttilä J, Januel D, de Beaurepaire R, Bellivier F, et al. “Where do auditory hallucinations come from?” – a brain morphometry study of schizophrenia patients with inner or outer space hallucinations. Schizophr Bull (2011) 37:212–21. doi:10.1093/schbul/sbp081
79. Kühn S, Gallinat J. Quantitative meta-analysis on state and trait aspects of auditory verbal hallucinations in schizophrenia. Schizophr Bull (2012) 38:779–86. doi:10.1093/schbul/sbq152
80. Plaze M, Bartrés-Faz D, Martinot JL, Januel D, Bellivier F, De Beaurepaire R, et al. Left superior temporal gyrus activation during sentence perception negatively correlates with auditory hallucination severity in schizophrenia patients. Schizophr Res (2006) 87:109–15. doi:10.1016/j.schres.2006.05.005
81. Swick D, Turken AU. Dissociation between conflict detection and error monitoring in the human anterior cingulate cortex. Proc Natl Acad Sci U S A (2002) 99:16354–9. doi:10.1073/pnas.252521499
82. Northoff G, Bermpohl F. Cortical midline structures and the self. Trends Cogn Sci (2004) 8:102–7. doi:10.1016/j.tics.2004.01.004
83. Garrison JR, Fernyhough C, McCarthy-Jones S, Haggard M; Australian Schizophrenia Research Bank, Simons JS. Paracingulate sulcus morphology is associated with hallucinations in the human brain. Nat Commun (2015) 6:8956. doi:10.1038/ncomms9956
84. Jardri R, Pouchet A, Pins D, Thomas P. Cortical activations during auditory verbal hallucinations in schizophrenia: a coordinate-based meta-analysis. Am J Psychiatry (2011) 168:73–81. doi:10.1176/appi.ajp.2010.09101522
85. Rossell SL. The role of memory retrieval and emotional salience in the emergence of auditory hallucinations. The Neuroscience of Hallucinations. New York, NY: Springer (2013). p. 137–51.
86. Waters FAV, Badcock JC, Michie PT, Maybery MT. Auditory hallucinations in schizophrenia: intrusive thoughts and forgotten memories. Cogn Neuropsychiatry (2006) 11:65–83. doi:10.1080/13546800444000191
87. Jardri R, Thomas P, Delmaire C, Delion P, Pins D. The neurodynamic organization of modality-dependent hallucinations. Cereb Cortex (2013) 23:1108–17. doi:10.1093/cercor/bhs082
88. Benetti S, Pettersson-Yeo W, Mechelli A. Connectivity issues of the hallucinating brain. In: Jardri R, Cachia A, Thomas P, Pins D, editors. The Neuroscience of Hallucinations. New York, NY: Springer (2013). p. 417–43.
89. Alderson-Day B, McCarthy-Jones S, Fernyhough C. Hearing voices in the resting brain: a review of intrinsic functional connectivity research on auditory verbal hallucinations. Neurosci Biobehav Rev (2015) 55:78–87. doi:10.1016/j.neubiorev.2015.04.016
90. Pettersson-Yeo W, Allen P, Benetti S, McGuire P, Mechelli A. Dysconnectivity in schizophrenia: where are we now? Neurosci Biobehav Rev (2011) 35:1110–24. doi:10.1016/j.neubiorev.2010.11.004
91. Oertel-Knöchel V, Knöchel C, Matura S, Prvulovic D, Linden DEJ, van de Ven V. Reduced functional connectivity and asymmetry of the planum temporale in patients with schizophrenia and first-degree relatives. Schizophr Res (2013) 147:331–8. doi:10.1016/j.schres.2013.04.024
92. Mou X, Bai F, Xie C, Shi J, Yao Z, Hao G, et al. Voice recognition and altered connectivity in schizophrenic patients with auditory hallucinations. Prog Neuropsychopharmacol Biol Psychiatry (2013) 44:265–70. doi:10.1016/j.pnpbp.2013.03.006
93. Amad A, Cachia A, Gorwood P, Pins D, Delmaire C, Rolland B, et al. The multimodal connectivity of the hippocampal complex in auditory and visual hallucinations. Mol Psychiatry (2013) 19(2):184–91. doi:10.1038/mp.2012.181
94. Rolland B, Amad A, Poulet E, Bordet R, Vignaud A, Bation R, et al. Resting-state functional connectivity of the nucleus accumbens in auditory and visual hallucinations in schizophrenia. Schizophr Bull (2014) 41(1):291–9. doi:10.1093/schbul/sbu097
95. Rotarska-Jagiela A, Oertel-Knoechel V, DeMartino F, van de Ven V, Formisano E, Roebroeck A, et al. Anatomical brain connectivity and positive symptoms of schizophrenia: a diffusion tensor imaging study. Psychiatry Res (2009) 174:9–16. doi:10.1016/j.pscychresns.2009.03.002
96. Ćurčić-Blake B, Nanetti L, van der Meer L, Cerliani L, Renken R, Pijnenborg GHM, et al. Not on speaking terms: hallucinations and structural network disconnectivity in schizophrenia. Brain Struct Funct (2015) 220:407–18. doi:10.1007/s00429-013-0663-y
97. Geoffroy PA, Houenou J, Duhamel A, Amad A, De Weijer AD, Curčić-Blake B, et al. The Arcuate Fasciculus in auditory-verbal hallucinations: a meta-analysis of diffusion-tensor-imaging studies. Schizophr Res (2014) 159(1):234–7. doi:10.1016/j.schres.2014.07.014
98. Wolf ND, Sambataro F, Vasic N, Frasch K, Schmid M, Schönfeldt-Lecuona C, et al. Dysconnectivity of multiple resting-state networks in patients with schizophrenia who have persistent auditory verbal hallucinations. J Psychiatry Neurosci (2011) 36:366–74. doi:10.1503/jpn.110008
99. Mechelli A, Allen P, Amaro E, Fu CHY, Williams SCR, Brammer MJ, et al. Misattribution of speech and impaired connectivity in patients with auditory verbal hallucinations. Hum Brain Mapp (2007) 28:1213–22. doi:10.1002/hbm.20341
100. Bush G, Luu P, Posner M. Cognitive and emotional influences in anterior cingulate cortex. Trends Cogn Sci (2000) 4:215–22. doi:10.1016/S1364-6613(00)01483-2
101. Carter CS, van Veen V. Anterior cingulate cortex and conflict detection: an update of theory and data. Cogn Affect Behav Neurosci (2007) 7:367–79. doi:10.3758/CABN.7.4.367
102. Allen P, Aleman A, McGuire PK. Inner speech models of auditory verbal hallucinations: evidence from behavioural and neuroimaging studies. Int Rev Psychiatry (2007) 19:407–15. doi:10.1080/09540260701486498
103. Gröne M, Dyck M, Koush Y, Bergert S, Mathiak KA, Alawi EM, et al. Upregulation of the rostral anterior cingulate cortex can alter the perception of emotions: fMRI-based neurofeedback at 3 and 7 T. Brain Topogr (2014). 28(2):197–207. doi:10.1007/s10548-014-0384-4
104. Hamilton JP, Glover GH, Hsu JJ, Johnson RF, Gotlib IH. Modulation of subgenual anterior cingulate cortex activity with real-time neurofeedback. Hum Brain Mapp (2011) 32:22–31. doi:10.1002/hbm.20997
105. Li X, Hartwell KJ, Borckardt J, Prisciandaro JJ, Saladin ME, Morgan PS, et al. Volitional reduction of anterior cingulate cortex activity produces decreased cue craving in smoking cessation: a preliminary real-time fMRI study. Addict Biol (2013) 18:739–48. doi:10.1111/j.1369-1600.2012.00449.x
106. Weiskopf N, Veit R, Erb M, Mathiak K, Grodd W, Goebel R, et al. Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI): methodology and exemplary data. Neuroimage (2003) 19:577–86. doi:10.1016/S1053-8119(03)00145-9
107. Jones SR, Fernyhough C. Neural correlates of inner speech and auditory verbal hallucinations: a critical review and theoretical integration. Clin Psychol Rev (2007) 27:140–54. doi:10.1016/j.cpr.2006.10.001
108. Shergill SS, Bullmore ET, Brammer MJ, Williams SC, Murray RM, McGuire PK. A functional study of auditory verbal imagery. Psychol Med (2001) 31:241–53. doi:10.1017/S003329170100335X
109. Cleghorn JM, Franco S, Szechtman B, Kaplan RD, Szechtman H, Brown GM, et al. Toward a brain map of auditory hallucinations. Am J Psychiatry (1992) 149:1062–9. doi:10.1176/ajp.149.8.1062
110. Dyck MS, Mathiak KA, Bergert S, Sarkheil P, Koush Y, Alawi EM, et al. Targeting treatment-resistant auditory verbal hallucinations in schizophrenia with fMRI-based neurofeedback – exploring different cases of schizophrenia. Front Psychiatry (2016) 7:37. doi:10.3389/fpsyt.2016.00037
111. Koush Y, Zvyagintsev M, Dyck M, Mathiak KA, Mathiak K. Signal quality and Bayesian signal processing in neurofeedback based on real-time fMRI. Neuroimage (2012) 59:478–89. doi:10.1016/j.neuroimage.2011.07.076
112. Harmelech T, Preminger S, Wertman E, Malach R. The day-after effect: long term, Hebbian-like restructuring of resting-state fMRI patterns induced by a single epoch of cortical activation. J Neurosci (2013) 33:9488–97. doi:10.1523/JNEUROSCI.5911-12.2013
113. Ruiz S, Birbaumer N, Sitaram R. Abnormal neural connectivity in schizophrenia and fMRI-brain-computer interface as a potential therapeutic approach. Front Psychiatry (2013) 4:17. doi:10.3389/fpsyt.2013.00017
114. Tracy DK, Shergill SS. Mechanisms underlying auditory hallucinations-understanding perception without stimulus. Brain Sci (2013) 3:642–69. doi:10.3390/brainsci3020642
115. Palaniyappan L, White TP, Liddle PF. The concept of salience network dysfunction in schizophrenia: from neuroimaging observations to therapeutic opportunities. Curr Top Med Chem (2012) 12:2324–38. doi:10.2174/156802612805289881
116. Palaniyappan L, Simmonite M, White TP, Liddle EB, Liddle PF. Neural primacy of the salience processing system in schizophrenia. Neuron (2013) 79:814–28. doi:10.1016/j.neuron.2013.06.027
117. Lefebvre S, Demeulemeester M, Leroy A, Delmaire C, Lopes R, Pins D, et al. Network dynamics during the different stages of hallucinations in schizophrenia. Hum Brain Mapp (2016) 37(7):2571–2586. doi:10.1002/hbm.23197
118. Wang L, Metzak PD, Woodward TS. Aberrant connectivity during self-other source monitoring in schizophrenia. Schizophr Res (2011) 125:136–42. doi:10.1016/j.schres.2010.11.012
119. Weiskopf N, Mathiak K, Bock SW, Scharnowski F, Veit R, Grodd W, et al. Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI). IEEE Trans Biomed Eng (2004) 51:966–70. doi:10.1109/TBME.2004.827063
120. Belin P, Zatorre RJ, Lafaille P, Ahad P, Pike B. Voice-selective areas in human auditory cortex. Nature (2000) 403:309–12. doi:10.1038/35002078
121. Caria A, Veit R, Sitaram R, Lotze M, Weiskopf N, Grodd W, et al. Regulation of anterior insular cortex activity using real-time fMRI. Neuroimage (2007) 35:1238–46. doi:10.1016/j.neuroimage.2007.01.018
122. Orrù G, Pettersson-Yeo W, Marquand AF, Sartori G, Mechelli A. Using support vector machine to identify imaging biomarkers of neurological and psychiatric disease: a critical review. Neurosci Biobehav Rev (2012) 36:1140–52. doi:10.1016/j.neubiorev.2012.01.004
123. Ellison-Wright I, Bullmore E. Anatomy of bipolar disorder and schizophrenia: a meta-analysis. Schizophr Res (2010) 117:1–12. doi:10.1016/j.schres.2009.12.022
124. Smieskova R, Fusar-Poli P, Allen P, Bendfeldt K, Stieglitz RD, Drewe J, et al. Neuroimaging predictors of transition to psychosis – a systematic review and meta-analysis. Neurosci Biobehav Rev (2010) 34:1207–22. doi:10.1016/j.neubiorev.2010.01.016
125. LaConte SM. Decoding fMRI brain states in real-time. Neuroimage (2011) 56:440–54. doi:10.1016/j.neuroimage.2010.06.052
126. Sitaram R, Lee S, Ruiz S, Rana M, Veit R, Birbaumer N. Real-time support vector classification and feedback of multiple emotional brain states. Neuroimage (2011) 56:753–65. doi:10.1016/j.neuroimage.2010.08.007
127. Jardri R, Pins D, Thomas P. Predictive functional brain imaging of hallucinations. Biol Psychiatry (2011) 69(9):s217.
128. Rana M, Gupta N, Dalboni Da Rocha JL, Lee S, Sitaram R. A toolbox for real-time subject-independent and subject-dependent classification of brain states from fMRI signals. Front Neurosci (2013) 7:170. doi:10.3389/fnins.2013.00170
130. Scharnowski F, Rosa MJ, Golestani N, Hutton C, Josephs O, Weiskopf N, et al. Connectivity changes underlying neurofeedback training of visual cortex activity. PLoS One (2014) 9:e91090. doi:10.1371/journal.pone.0091090
131. Koush Y, Rosa MJ, Robineau F, Heinen K, W Rieger S, Weiskopf N, et al. Connectivity-based neurofeedback: dynamic causal modeling for real-time fMRI. Neuroimage (2013) 81:422–30. doi:10.1016/j.neuroimage.2013.05.010
Keywords: hallucinations, neurofeedback, fMRI, therapeutic strategies, anterior cingulate cortex
Citation: Fovet T, Orlov N, Dyck M, Allen P, Mathiak K and Jardri R (2016) Translating Neurocognitive Models of Auditory-Verbal Hallucinations into Therapy: Using Real-time fMRI-Neurofeedback to Treat Voices. Front. Psychiatry 7:103. doi: 10.3389/fpsyt.2016.00103
Received: 15 January 2016; Accepted: 31 May 2016;
Published: 27 June 2016
Edited by:
Stefan Borgwardt, University of Basel, SwitzerlandReviewed by:
Matthias Kirschner, Zurich University Hospital for Psychiatry, SwitzerlandLaura Diaz Hernandez, University of Bern, Switzerland
Copyright: © 2016 Fovet, Orlov, Dyck, Allen, Mathiak and Jardri. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Thomas Fovet, dGhvbWFzLmZvdmV0JiN4MDAwNDA7Y2hydS1saWxsZS5mcg==