Does Cognitive Behavior Therapy for psychosis (CBTp) show a sustainable effect on delusions? A meta-analysis

Cognitive Behavior Therapy for psychosis (CBTp) is an effective treatment resulting in small to medium effect sizes with regard to changes in positive symptoms and psychopathology. As a consequence, CBTp is recommended by national guidelines for all patients with schizophrenia. However, although CBTp was originally developed as a means to improve delusions, meta-analyses have generally integrated effects for positive symptoms rather than for delusions. Thus, it is still an open question whether CBTp is more effective with regard to change in delusions compared to treatment as usual (TAU) and to other interventions, and whether this effect remains stable over a follow-up period. Moreover, it would be interesting to explore whether newer studies that focus on specific factors involved in the formation and maintenance of delusions (causal-interventionist approach) are more effective than the first generation of CBTp studies. A systematic search of the trial literature identified 19 RCTs that compared CBTp with TAU and/or other interventions and reported delusions as an outcome measure. Meta-analytic integration resulted in a significant small to medium effect size for CBTp in comparison to TAU at end-of-therapy (k = 13; $\overline{d}$ = 0.27). However, the comparison between CBTp and TAU after an average follow-up period of 47 weeks was not statistically significant (k = 12, $\overline{d}$ = 0.16). When compared with other interventions, there was no significant effect of CBTp at end-of-therapy (k = 8; $\overline{d}$ = 0.16) and after a follow-up period (k = 5; $\overline{d}$ = −0.04). Comparison between newer studies taking a causal-interventionist approach (k = 4) and first-generation studies showed a difference of 0.33 in mean effect sizes in favor of newer studies at end-of-therapy. The findings suggest that CBTp is superior to TAU post-therapy in bringing about a change in delusions, but that this change may not be maintained over the follow-up period. Moreover, interventions that focus on causal factors of delusions seem to be a promising approach to improving interventions for delusions.

Introduction

Before Cognitive Behavior Therapy for psychosis (CBTp) was introduced in the early 1990s, there was much concern that targeting delusions directly was likely to make matters worse. At the root of this concern was the assumption that psychotic symptoms such as delusions are qualitatively different from normal experiences and are therefore not amenable to reason or normal mechanisms of learning (Jaspers, 1913). Meanwhile, this view has been questioned by epidemiological studies that point to a continuum between normal and psychotic experiences (McGovern and Turkington, 2001; van Os et al., 2009) which indicates that normal reasoning could be involved in the formation and maintenance of delusional beliefs. This view, along with research on cognitive and emotional correlates of psychotic symptoms (Garety et al., 2001) has been one of the main suppositions upon which the systematic development of CBTp is based. CBTp was adapted from cognitive therapy, which was originally developed by A. T. Beck to treat depression (Beck, 2005). A characteristic aspect of CBTp compared to other psychological interventions for psychosis (e.g., psychoeducation, skill trainings etc.) is that the therapist works directly with delusional beliefs, not only by challenging the beliefs suspected of triggering and maintaining them (e.g., beliefs about the self and others) but also by questioning the delusional beliefs per se.

In the last 20 years, about 50 randomized controlled therapy studies (identified in a recent short review: Naeem et al., 2014) have demonstrated that CBTp is an effective adjunct to standard care. CBTp generally reduces positive symptoms, negative symptoms, general functioning and symptoms of depression (Gould et al., 2001; Rector and Beck, 2001; Zimmermann et al., 2005; Wykes et al., 2008; Sarin et al., 2011). Several national guidelines thus recommend CBTp for patients with schizophrenia in all phases of the disorder (DGPPN, 2006; NICE, 2014).

Despite the plentiful research on CBTp, the degree to which CBTp affects delusions as such has remained unclear. This is because the intervention studies generally used broader outcome measures of positive symptoms or general psychopathology as the primary outcome measure rather than delusions. Somewhat surprisingly, it was not until recently that researchers first attempted to address the question of how effective CBTp is in changing delusions as such. Van der Gaag et al. (2014) did this by analysing effects from secondary outcome measures of RCTs on CBTp. They included nine RCTs (from a total of 50 RCTs of CBTp) that had reported on change in delusions and found a significant, but small to medium effect of CBTp on delusions ($\overline{d}=$ 0.36, 95%-CI: 0.08, 0.63). However, due to the fairly narrow definition of individually tailored formulation-based CBTp, several RCTs evaluating CBTp were excluded (Cather et al., 2005; Turkington et al., 2006; Garety et al., 2008; Foster et al., 2010). Moreover, follow-up data were not analyzed. Thus, it would be interesting to see whether the effect remains significant if broader inclusion criteria are used. Also, it remains open whether change in delusions is sustainable over a follow-up period.

Finally, van der Gaag et al. (2014) excluded some of the more recent studies (Foster et al., 2010) that used a quite interesting approach with regard to change in delusions: an interventionist-causal model approach (Kendler and Campbell, 2009). This approach selects one of several cognitive and emotional factors that are hypothesized to be involved in the formation and maintenance of delusions (Freeman, 2007; Garety et al., 2007; Freeman and Garety, 2014) and aims to change this factor by means of cognitive-behavioral interventions that target this factor but do not challenge the delusion itself. For example, Freeman and colleagues targeted worrying by employing several interventions: (1) psychoeducation on worry, (2) identification and reviewing of positive and negative beliefs about worry, (3) increasing awareness of individual triggers of worry, (4) planning activity at times of worry, and learning to let go of worry (Freeman et al., 2015).

Thus, this meta-analysis tests whether CBTp has any benefits in comparison to (1) standard care and (2) other psychological treatments such as supportive therapy, problem solving, and family interventions and (3) whether its effects are still present after a follow-up period. (4) Finally, it explores whether newer cognitive-behavioral interventions that take a causal-interventionist approach by focusing solely on specific factors involved in the formation and maintenance of delusions are more effective in changing delusions than the first generation of CBTp studies.

Methods

Eligibility Criteria

To be included, studies had to be: (1) randomized controlled trials assessing (2) individualized CBTp for psychosis compared to (3) treatment as usual (TAU) or other psychological interventions (such as family interventions, supportive therapy, problem solving) in (4) patients with a psychotic disorder (at least 75% of the sample), be (5) published in peer-reviewed journals and report (6) on change in delusions using a reliable scale. (7) We excluded studies focusing on a specific subgroup of patients such as those with a comorbid substance disorder. CBTp was defined according to the criteria of the National Institute of Health and Clinical Excellence (NICE, 2014): (1) links are established between patients thoughts, feelings or actions and their current or past symptoms and functioning, (2) patient perceptions, beliefs or reasoning are reevaluated in relation to target symptoms. TAU or standard care included regular outpatient appointments with psychiatrists and prescription of medication. In contrast, supportive therapy included weekly sessions with a therapist who used basic therapeutic skills such as listening, reflecting, empathizing, and summarizing.

Information Sources and Search

Relevant studies were identified by an electronic literature search using five databases: MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials, PsycINFO, and PsycLIT from 1987 to 21st January 2015 in the English or German languages. Published meta-analyses and reviews were also searched.

We conducted three different searches that were combined later. First, we searched the databases on the terms “CBT” OR “cognitive therapy” OR “cognitive behavioural therapy” OR “cognitive behavior therapy” OR “cognitive behaviour therapy” OR “cognitive behavior therapy.” Second, we searched the databases on “psychosis” OR “psychotic symptoms” OR “schizophreni*” OR “paranoi*.” Third, we investigated the terms “RCT” OR “randomized controlled trial” OR “randomised controlled trial.” Then, we combined all three searches, using the operator AND, which yielded 1598 studies. Removing duplicates resulted in 816 studies (see flow chart depicted on Figure 1). Of these, 774 could be excluded beyond doubt after reading the title, leaving 42 studies. The search of existing meta-analyses identified three further studies. The remaining 45 studies were read by the first author and a Master's student of clinical psychology. Of these, 19 studies fulfilled our inclusion criteria and were ultimately included.

FIGURE 1

Figure 1. Flow chart of selected studies.

Statistical Analysis

Study characteristics and the appropriate statistics to calculate effect sizes were independently coded by the first and second authors. Statistical analyses were carried out in R (Version 3.1.2) using the meta-analysis package metafor (Version 1.9-5). We calculated the bias-corrected standardized mean difference (d) on all delusion-related outcomes for every treatment-control group comparison using the pooled standard deviation as the standardizer (Hedges and Olkin, 1985). A positive sign for d indicates that the CBTp group was better off after treatment compared to the control condition. If a study reported results for subscales or for more than one delusion-related outcome, we calculated a single composite effect size for each study to be able to analyze stochastically independent effect size estimates. Effect sizes were calculated on the basis of pretest data, posttest data, and at follow-up if appropriate statistics were available. We used end-of-treatment statistics (controlled for the smaller number of patients at follow-up) for one study that reported that there were “no significant differences” between end-of-treatment and follow-up scores but did not report the scores (Pinninti et al., 2010). Whenever a study reported more than one follow-up measurement, we calculated the effect size for the final measurement in order to estimate the long-term effects of treatment.

We did not assume that all included studies share a common effect size, because the studies obviously differ in various ways (e.g., duration of treatment, format of therapy, experience of therapists, patient population). To allow for variation in true effect sizes (δ_i) we fitted a random-effects model to the data and estimated the amount of heterogeneity with restricted maximum-likelihood estimation (Raudenbush, 2009).

We conducted two meta-analyses: one of all available comparisons of CBTp vs. TAU and one of all available comparisons of CBTp vs. other psychological interventions. For each analysis we report the estimated mean population effect size (${\hat{\mu }}_{\delta }$ subsequently denoted as $\overline{d}$), the p-value for the test H0: μδ = 0, the estimated variance of the true effect sizes (${\hat{\tau }}^2$), the results for the Q-test for heterogeneity with a p-value for the test H0: τ² = 0. As the number of included studies might be quite small and the Q-test might have low statistical power in order to test for heterogeneity, we also reported an I²-statistic to estimate the percentage of observed variation in effect sizes that is due to hetereogeneity, as recommended by Deeks et al. (2008). In order to compare newer studies that used a causal-interventionist approach with first-generation CBTp studies, we performed a subgroup analysis and calculated the mean effect size at end-of-treatment for (a) the studies that used the causal-interventionist approach and (b) for all other studies. Then we calculated the difference between both mean effect sizes. In addition, 95% confidence intervals were calculated for all above-mentioned statistics.

We investigated the possibility of publication bias with funnel-plots and regression-tests (Sterne and Egger, 2005). We used a trim-and-fill analysis (Duval, 2005) to investigate the impact of missing studies on the overall results.

Results

Descriptive Information on Included Studies

Fourteen studies were identified that compared CBTp with TAU (see flow-chart on Figure 1 and Table 1 for more information on the studies) and eight studies that compared CBTp with other psychological interventions. Three studies (Lewis et al., 2002; Durham et al., 2003; Garety et al., 2008) reported results for one CBTp and two control conditions and were included in both meta-analyses.

TABLE 1

Table 1. Studies included in the comparison of CBTp vs. TAU and CBTp vs. other psychological interventions: description of the intervention, patient characteristics and outcome measure.

Most studies (n = 18) used observer-rated assessments of delusions such as the Psychotic Symptom Rating Scale (k = 17; PSYRATS: Haddock et al., 1999a) or the Maudsley Assessment of Delusions Scale (k = 1; MADS: Wessely et al., 1993). Four of these studies did not use single-blind assessment (Tarrier et al., 1993; Foster et al., 2010; Kråkvik et al., 2013; Waller et al., 2015) and one study (Lincoln et al., 2012) used a self-report measure (Peters et al. Delusions Inventory: Peters et al., 1999). Most studies (k = 12) selectively included patients with delusions (Tarrier et al., 1993; Lewis et al., 2002; Durham et al., 2003; Valmaggia et al., 2005; O'Connor et al., 2007; Haddock et al., 2009; Foster et al., 2010; Kråkvik et al., 2013; Freeman et al., 2014, 2015; Morrison et al., 2014; Waller et al., 2015), but only one of these studies predefined change in delusions as the primary outcome (Waller et al., 2015).

Of the 14 studies that compared CBTp and TAU, most studies (Tarrier et al., 1993; Lewis et al., 2002; Durham et al., 2003; Garety et al., 2008; Haddock et al., 2009; Pinninti et al., 2010; Lincoln et al., 2012; Kråkvik et al., 2013; Morrison et al., 2014) used traditional CBTp based on established manuals (Kingdon and Turkington, 1994; Fowler et al., 1995; Chadwick et al., 1996; Lincoln, 2006). One study used a brief and more “technical” version of CBTp administered by trained nurses (Turkington et al., 2006), another used a culturally-adapted version of CBTp in a population of migrants (Rathod et al., 2013). Two studies assessed the effectiveness of CBTp in other specific populations, namely patients who refused to take antipsychotic medication (Morrison et al., 2014) and patients who reported suicide attempts or current suicidal ideation (Tarrier et al., 2014). Four studies used an interventionist causal model approach and focused on cognitive or emotional factors involved in the formation and maintenance of persecutory delusions: negative self-evaluations (Freeman et al., 2014), worrying (Foster et al., 2010; Freeman et al., 2015), and reasoning biases (Waller et al., 2015).

Patients received between 4 and 29 therapy sessions, the mean number of sessions was 14.8 (SD = 8.3 sessions) and the duration of treatment varied between 4 and 39 weeks with a mean duration of 19.9 weeks (SD = 14.7 weeks). Most of the studies (k = 13) reported results at end-of-therapy. One study was only included in comparisons after a follow-up period, as findings at end-of-therapy were not reported (Turkington et al., 2006). Two studies used a wait-list group that later received CBTp (Lincoln et al., 2012; Kråkvik et al., 2013). As they did no longer use a controlled design at follow-up, their results were not included in follow-up analysis. In sum, 12 studies were included in the comparison between CBTp and TAU after an average follow-up period of 46.8 weeks (SD = 58.5 weeks).

All studies that were included in comparisons between CBTp and other psychological interventions (k = 8) used traditional CBTp (Tarrier et al., 1993; Lewis et al., 2002; Durham et al., 2003; Cather et al., 2005; Valmaggia et al., 2005; O'Connor et al., 2007; Garety et al., 2008; Haddock et al., 2009) based on established manuals (Kingdon and Turkington, 1994; Fowler et al., 1995; Chadwick et al., 1996; Nelson, 1997; Haddock et al., 2004; Morrison et al., 2004) (see Table 1 and Figure 1 for more information on the studies). One study assessed the effectiveness of CBTp in patients with a history of violence (Haddock et al., 2009). Four of the studies compared CBTp with a therapy placebo such as supportive counseling/therapy (Lewis et al., 2002; Durham et al., 2003; Valmaggia et al., 2005) or attention placebo (O'Connor et al., 2007). Other studies used psychoeducation (Cather et al., 2005), problem solving (Tarrier et al., 1993), family intervention (Garety et al., 2008) and social activity therapy (Haddock et al., 2009). Patients received between 10 and 25 sessions of treatment. Average number of sessions was 16.81 (SD = 5.5). The average duration of treatment was 22 weeks (SD = 13.2 weeks). Only five studies (Lewis et al., 2002; Durham et al., 2003; Valmaggia et al., 2005; Garety et al., 2008; Haddock et al., 2009) reported comparisons between CBTp and other psychological interventions after a follow-up period with the average follow-up period being 34.4 weeks (SD = 23.0 weeks).

Comparisons of CBTp and Treatment as Usual (TAU)

Results of the comparisons between CBTp vs. TAU (k = 13 studies) at end-of-therapy are depicted in Figure 2 in form of a forest plot. The estimated mean effect size of CBTp was small to medium ($\overline{d}=$ 0.27, SE = 0.10, p = 0.005) with a 95% confidence interval ranging from 0.08 to 0.47. The estimator of the between-study variance revealed an estimate of ${\hat{\tau }}^2=$ 0.05 (95% CI: 0.00 to 0.32), the Q-statistic was non-significant (Q = 20.46, df = 12, p = 0.059). The small to medium value of I² = 42.1% indicates that approximately 42% of the observed variance in effect sizes might be due to heterogeneity. However, one study (Kråkvik et al., 2013) had an especially large influence on the amount of observed heterogeneity. If we exclude this study, the proportion of observed variance due to real differences in effect sizes drops to approximately 12% (I² = 11,7%).

FIGURE 2

Figure 2. Forest plot of effect sizes for the comparison between CBTp and treatment as usual (TAU) at end-of-therapy.

An inspection of the funnel plot (see Figure 3) gives the impression of a tendency toward higher effect sizes for studies with a smaller sample size. The regression test for funnel plot asymmetry at end-of-therapy was significant (p = 0.017). Results of a trim and fill analysis suggest that there may be four unpublished studies on the left side of the funnel plot (see Figure 3). Including these studies in a meta-analysis would reduce the mean effect size to $\overline{d}=$ 0.14 (SE = 0.12).

FIGURE 3

Figure 3. Funnel Plots for the comparison between CBTp and treatment as usual (TAU) at end-of-therapy.

Results of comparisons of CBTp vs. TAU (k = 12 studies) after an average follow-up period of 47 weeks are depicted in Figure 4. The estimate for the mean effect size of CBTp compared to TAU was small and non-significant ($\overline{d}=$ 0.16, SE = 0.10, p = 0.098, CI: −0.03, 0.35). The between-study variance was ${\widehat{\tau }}^2=$ 0.04 (95%-CI: 0.00, 0.23), and the Q-statistic (Q = 18.63, df = 11, p = 0.068) was non-significant. The value of I² = 43.38% indicated a small to medium level of heterogeneity. The regression test for funnel plot asymmetry revealed a statistically non-significant result (p = 0.15), thus, there was no indication of a bias. Finally, we tested whether the results of both comparisons would change if we excluded two studies that assessed specific subpopulations: patients who did not use medication (Morrison et al., 2014) and suicidal patients (Tarrier et al., 2014). However, exclusion of these studies revealed comparable mean effect sizes (CBTp vs. TAU at end-of-treatment: $\overline{d}$ = 0.32; CBTp vs. TAU at follow-up: $\overline{d}$ = 0.12).

FIGURE 4

Figure 4. Results of comparison between CBTp and treatment as usual (TAU) after a follow-up period of 47 weeks.

Comparisons of CBTp and Other Psychological Interventions

The comparisons between CBTp and other psychological interventions at end-of-therapy (k = 8 studies, depicted in Figure 5) revealed an estimated mean effect size that is small and non-significant ($\overline{d}=$ 0.16, SE = 0.14, p = 0.28: 95%-CI:–0.13, 0.44). The estimator of the between-study variance was ${\hat{\tau }}^2=$ 0.07 (95%-CI: 0.00, 0.54). The Q-statistic was non-significant (Q = 11.69, df = 7, p = 0.111). The value of I² = 42.1% indicated a small to medium degree of heterogeneity.

FIGURE 5

Figure 5. Results of comparisons between CBTp and other psychological interventions at end-of therapy.

Results of comparisons of CBTp vs. psychological interventions (k = 5) after an average follow-up period of 34.3 weeks are depicted in Figure 6. The estimate for the mean effect size was non-significant ($\overline{d}=-0.04$, SE = 0.11, p = 0.687, 95%-CI:–0.26; 0.17). The estimated between-study variance was zero (${\hat{\tau }}^2=$ 0.00, 95%-CI: 0.00, 0.15) as was the I²-statistic.

FIGURE 6

Figure 6. Results of the comparison between CBTp and other psychological interventions after a follow-up period of 35 weeks.

Comparison of Studies that used a Causal-interventionist Approach and First-generation CBTp Studies at End-of-therapy

In order to select newer CBTp studies, the first and the last author independently selected studies that stated in their introduction that they “used a causal-interventionist approach” or that they focused on “factors that are causally involved in the formation and maintenance of delusions.” Both consistently selected four studies, two of which focused on worrying (Foster et al., 2010; Freeman et al., 2015), one of which focused on self-esteem (Freeman et al., 2014) and one of which focused on reasoning biases (Waller et al., 2015). These studies were compared with all other studies that compared CBTp with standard treatment at end-of-therapy (k = 9: Lewis et al., 2002; Durham et al., 2003; Garety et al., 2008; Pinninti et al., 2010; Lincoln et al., 2012; Kråkvik et al., 2013; Rathod et al., 2013; Morrison et al., 2014; Tarrier et al., 2014). Results suggest a difference of 0.33 in mean effect sizes (95%-CI for the difference: −0.10, 0.75) in favor of the four studies focusing on causal factors ($\overline{d}=$ 0.51, SE = 0.19, p = 0.006), compared to all other studies ($\overline{d}=$ 0.18, SE = 0.11, p = 0.090), using an estimated between-study variance ${\hat{\tau }}^2=$ 0.04 within each group.

Discussion

First, our results suggest that CBTp is more beneficial in changing delusions than standard treatment. However, the effect of CBTp on delusions did not remain stable after an average follow-up period of 47 weeks. Compared to other psychological interventions, CBTp did not prove to be better at changing delusions, neither at end-of-treatment, nor after a follow-up period. However, more recent studies that focused on factors that are hypothetically involved in the formation and maintenance of delusions rather than on the delusions per se, produced a numerically larger effect size of moderate magnitude compared to first-generation CBTp studies.

With regard to comparisons between CBTp and standard treatment at end-of-therapy, our results are consistent with the large body of meta-analytic research which finds small to medium effect sizes for positive symptoms (Lincoln et al., 2008; Wykes et al., 2008; Sarin et al., 2011; Jauhar et al., 2014). Moreover, our results are comparable with the recent meta-analysis by van der Gaag et al. (2014) that focused on change in delusions in individually-tailored formulation-based CBTp. However, they reported a slightly higher estimated effect size (k = 9; $\overline{d}$ = 0.36, 95%-CI: 0.08, 0.63) which seems to be the result of using a smaller pool of studies. The broader selection of studies in our meta-analysis produced a slightly smaller effect size; this effect size had a smaller confidence interval ($\overline{d}$ = 0.27, 95%-CI: 0.08, 0.47). Thus, the broader inclusion criteria we used lead to a slightly smaller, but also to a more precise estimation of the mean effect size of change in delusions at end-of-therapy. Nevertheless, we also investigated the stability of the effects, but CBTp was not more effective than standard treatment over an average follow-up period of 47 weeks. Due to the small number of RCTs that addressed both the question of change in delusions and the stability of CBTp over a follow-up period, more studies are needed to be able to draw more definite conclusions in regard to long-term effects.

It is important to note that we found a small to medium amount of variance that is due to the heterogeneity between the studies (about 42%). This variance is largely due to the study by Kråkvik et al. (2013). This study included patients with both auditory hallucinations and delusions and produced a quite large effect size ($\overline{d}$ = 0.94), which might have been influenced by the lack of blinding.

Our results seem to suggest a slightly higher effect size in smaller studies (see Figure 3). This could be due to higher motivation, engagement and team-work of therapists, more intense training, more available supervision, and fewer communication problems between researchers in smaller studies. However, a publication/reporting bias could not be ruled out. Indeed, it seems unlikely that only 19 RCTs (included in our meta-analyses) from the pool of 50 RCTs on CBTp assessed change in delusions as a secondary outcome. When having to select findings from a complex study for a publication with limited space, statistically non-significant results will probably not have the highest priority. However, in general it is difficult to distinguish bias from genuine heterogeneity in meta-analyses (Ioannidis, 2005).

It is also important to take into account that the analyses are based on mostly secondary outcome measures and effect size estimates are based on small samples resulting in low statistical power for most analyses. Further methodically rigorous studies are necessary to achieve reliable effect-size estimates.

As in the former meta-analysis by van der Gaag et al. (2014), we did not find a significant effect of CBTp compared to other psychological interventions. Consequently, we found no evidence of an advantage of CBTp compared to other interventions after an average follow-up period of 35 weeks. This could be interpreted as meaning that CBTp is not superior to other therapies such as supportive therapy, social activity therapy, problem solving or family interventions. Another explanation is that the general effect of CBTp on delusions is relatively small, making it difficult to detect an advantage of CBTp over other effective treatments, especially ones that also involve cognitive behavioral elements, such as family interventions, problem solving or social activity therapy. We may possibly have detected a slightly larger effect size if we had analyzed a larger number of studies that compared CBTp solely with placebo therapies such as supportive therapy/counseling (Lewis et al., 2002; Durham et al., 2003; Valmaggia et al., 2005) or attention placebo control (O'Connor et al., 2007). However, this was not possible given the small number of studies.

As stated above, our preliminary findings suggest a trend toward a small advantage of recent RCTs that tested a causal-interventionist approach. These studies targeted delusions specifically by focusing on factors that are hypothetically involved in the formation and maintenance of delusions compared to the first-generation CBTp approach that focuses on delusions in a more direct manner. This comparison is based on a small number of studies and the effect difference in favor of the causal-interventionist approach should be interpreted with caution. However, it is interesting to note that the causal-interventionist studies were also much shorter (requiring an average number of five sessions) than the first-generation CBTp studies, that required an average of 25 sessions. It is possible, on the one hand, that the focus on causal factors of delusions might be more beneficial than working on the delusions per se. On the other hand, it is also likely that shorter and more focused interventions have a positive effect because both the therapist and the patient have only a short amount of time to achieve an improvement and are thus particularly motivated and focused on the aims of the therapy. Nevertheless, it is important to note that these interventions focused specifically on delusions, whereas the first-generation CBTp studies took a broader approach, which explains why their effect sizes for the broader outcome measures such as positive symptoms or psychopathology in general tend to be numerically higher (Turner et al., 2013) than those we found for delusions in this analysis. Again, more methodologically rigorous RCTs are needed that can help us to answer these questions.

Strengths of the present study are the broader inclusion criteria resulting in inclusion of more studies and smaller confidence intervals, the focus of the study on sustainability of CBTp over a follow-up period, and the use of several statistical techniques to assess the possible influence of publication bias. Limitations are the still small number of studies that reported results on change in delusions (19 studies compared to 50 RCTs assessing the effectiveness of CBTp in schizophrenia) and the small number of studies assessing effectiveness of CBTp compared to other psychological interventions (eight studies) that resulted in low statistical power (Hedges and Pigott, 2001). In addition, one has to be aware that some comparisons in the primary studies differed in the mean number of sessions that the CBTp group received compared to the control group. However, on average, patients were offered more sessions in the comparison interventions and treatment intensity did not affect the considered outcome measures, as clarified by an explorative meta-regression.

With respect to the small number of available RCTs addressing delusions, one therefore has to be aware that the estimated mean effect size might change in a future meta-analysis after the inclusion of a small number of new studies. Moreover, it is still unknown whether patients with severe delusions are not able to participate in CBTp, as suggested by a more severe drop-out rate among them (Lincoln et al., 2012). In future studies it would be interesting to compare drop-out samples with patients who completed therapy and to ask patients who refused the treatment for their personal reasons.

To sum up, our results suggest that CBTp is superior to TAU in regard to changing delusions, but CBTp effects might not be maintained over the course of the follow-up period. Moreover, at present, CBTp is not superior to other effective interventions, neither at end-of-therapy nor after a follow-up period. Finally, interventions that focus specifically on cognitive and emotional factors that are hypothetically involved in the formation and maintenance of delusions seem to be slightly more effective and thus are a promising approach to improving interventions for delusions.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors wish to thank Katharina Renz and Leonie Pleinert for their assistance in coding the studies.

References

Beck, A. T. (2005). The current state of cognitive therapy. A 40-year retrospective. Arch. Gen. Psychiatry 62, 953–959. doi: 10.1001/archpsyc.62.9.953

PubMed Abstract | CrossRef Full Text | Google Scholar

Cather, C., Penn, D., Otto, M. W., Yovel, I., Mueser, K. T., and Goff, D. C. (2005). A pilot study of functional Cognitive Behavioral Therapy (fCBT) for schizophrenia. Schizophr. Res. 74, 201–209. doi: 10.1016/j.schres.2004.05.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Chadwick, P., Birchwood, M. J., and Trower, P. (1996). Cognitive Behaviour Therapy for Delusions, Voices and Paranoia. Chichester: Wiley.

Deeks, J. J., Higgings, P. T., and Altmann, D. G. (2008). “Analysing data and undertaking meta-analysis,” in The Cochrane Handbook for Systematic Reviews of Interventions, eds J. P. T. Higgings and S. Green (New York, NY: Wiley), 243–296.

DGPPN. (2006). S3-Behandlungsleitlinie Schizophrenie. Berlin: Steinkopf.

Durham, R. C., Guthrie, M., Morton, R. V., Reid, D. A., Treliving, L. R., Fowler, D., et al. (2003). Tayside-Fife clinical trial of cognitive-behavioural therapy for medication-resistant psychotic symptoms. Results to 3-month follow-up. Br. J. Psychiatry 182, 303–311. doi: 10.1192/bjp.182.4.303

PubMed Abstract | CrossRef Full Text | Google Scholar

Duval, S. (2005). “The trim and fill method,” in Publication Bias in Meta-analysis: Prevention, Assessment and Adjustments, eds H. Rothstein, A. J. Sutton, and M. Borenstein (Chichester; Hoboken, NJ: Wiley), 127–144.

Foster, C., Startup, H., Potts, L., and Freeman, D. (2010). A randomised controlled trial of a worry intervention for individuals with persistent persecutory delusions. J. Behav. Ther. Exp. Psychiatry 41, 45–51. doi: 10.1016/j.jbtep.2009.09.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Fowler, D., Garety, P. A., and Kuipers, E. (1995). Cognitive Behaviour Therapy for Psychosis. Theory and Practice. Chichester: Wiley.

Freeman, D. (2007). Suspicious minds: the psychology of persecutory delusions. Clin. Psychol. Rev. 27, 425–457. doi: 10.1016/j.cpr.2006.10.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Freeman, D., Dunn, G., Startup, H., Pugh, K., Cordwell, J., Mander, H., et al. (2015). Effects of cognitive behaviour therapy for worry on persecutory delusions in patients with psychosis (WIT): a parallel, single-blind, randomised controlled trial with a mediation analysis. Lancet Psychiatry 2, 305–313. doi: 10.1016/s2215-0366(15)00039-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Freeman, D., and Freeman, J. (2012). You Can Be Happy: The Scientifical Proven Way to Change How You Feel. Harlow: Prentice Hall Life.

Freeman, D., and Freeman, J. (2013). How to Keep Calm and Carry On. Harlow: Pearson.

Google Scholar

Freeman, D., and Garety, P. (2014). Advances in understanding and treating persecutory delusions: a review. Soc. Psychiatry Psychiatr. Epidemiol. 49, 1179–1189. doi: 10.1007/s00127-014-0928-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Freeman, D., Pugh, K., Dunn, G., Evans, N., Sheaves, B., Waite, F., et al. (2014). An early Phase II randomised controlled trial testing the effect on persecutory delusions of using CBT to reduce negative cognitions about the self: the potential benefits of enhancing self confidence. Schizophr. Res. 160, 186–192. doi: 10.1016/j.schres.2014.10.038

PubMed Abstract | CrossRef Full Text | Google Scholar

Garety, P. A., Bebbington, P., Fowler, D., Freeman, D., and Kuipers, E. (2007). Implications for neurobiological research of cognitive models of psychosis: a theoretical paper. Psychol. Med. 37, 1377–1391. doi: 10.1017/S003329170700013X

PubMed Abstract | CrossRef Full Text | Google Scholar

Garety, P. A., Fowler, D. G., Freeman, D., Bebbington, P., Dunn, G., and Kuipers, E. (2008). Cognitive–behavioural therapy and family intervention for relapse prevention and symptom reduction in psychosis: randomised controlled trial. Br. J. Psychiatry 192, 412–423. doi: 10.1192/bjp.bp.107.043570

PubMed Abstract | CrossRef Full Text | Google Scholar

Garety, P. A., Kuipers, E., Fowler, D., Freeman, D., and Bebbington, P. E. (2001). A cognitive model of the positive symptoms of psychosis. Psychol. Med. 31, 189–195. doi: 10.1017/S0033291701003312

PubMed Abstract | CrossRef Full Text | Google Scholar

Gould, R. A., Mueser, K. T., Bolton, E., Mays, V., and Goff, D. (2001). Cognitive therapy for psychosis in schizophrenia: an effect size analysis. Schizophr. Res. 48, 335–342. doi: 10.1016/S0920-9964(00)00145-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Haddock, G., Barrowclough, C., Shaw, J. J., Dunn, G., Novaco, R. W., and Tarrier, N. (2009). Cognitive-behavioural therapy v. social activity therapy for people with psychosis and a history of violence: randomised controlled trial. Br. J. Psychiatry 194, 152–157. doi: 10.1192/bjp.bp.107.039859

PubMed Abstract | CrossRef Full Text | Google Scholar

Haddock, G., Lowens, I., Brosnan, N., Barrowclough, C., and Novaco, R. W. (2004). Cognitive behaviour therapy for inpatients with psychosis and anger problems within a low secure environment. Behav. Cogn. Psychother. 32, 77–98. doi: 10.1017/S1352465804001055

CrossRef Full Text | Google Scholar

Haddock, G., McCarron, J., Tarrier, N., and Faragher, E. B. (1999a). Scales to measure dimensions of hallucinations and delusions: the psychotic symptom rating scales (PSYRATS). Psychol. Med. 29, 879–889. doi: 10.1017/S0033291799008661

PubMed Abstract | CrossRef Full Text | Google Scholar

Haddock, G., Tarrier, N., Morrison, A. P., Hopkins, R., Drake, R., and Lewis, S. (1999b). A pilot study evaulating the effectiveness of individual inpatient cognitive-behavioural therapy in early psychosis. Sociol. Psychiatry Psychiatr. Epidemiol. 34, 254–258. doi: 10.1007/s001270050141

PubMed Abstract | CrossRef Full Text | Google Scholar

Hedges, L. V., and Olkin, I. (1985). Statistic Methods for Meta-analysis. Orlando, FL: Academic Press.

Google Scholar

Hedges, L. V., and Pigott, T. D. (2001). The power of statistical tests in meta-analysis. Psychol. Methods 6, 203–217. doi: 10.1037/1082-989X.6.3.203

PubMed Abstract | CrossRef Full Text | Google Scholar

Ioannidis, J. P. (2005). “Differentiating biases from genuine heterogeneity: distinguishing artifactual from substantive effects,” in Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments, eds H. Rothstein, A. J. Sutton, and M. Borenstein (Chichester: Wiley), 287–302.

Jaspers, K. (1913). Psychopathologie. Berlin: Springer.

Google Scholar

Jauhar, S., McKenna, P. J., Radua, J., Fung, E., Salvador, R., and Laws, K. R. (2014). Cognitive-behavioural therapy for the symptoms of schizophrenia: systematic review and meta-analysis with examination of potential bias. Br. J. Psychiatry 204, 20–29. doi: 10.1192/bjp.bp.112.116285

PubMed Abstract | CrossRef Full Text | Google Scholar

Kendler, K. S., and Campbell, J. (2009). Interventionist causal models in psychiatry: repositioning the mind-body problem. Psychol. Med. 39, 881–887. doi: 10.1017/S0033291708004467

PubMed Abstract | CrossRef Full Text | Google Scholar

Kingdon, D. G., and Turkington, D. (1994). Cognitive-behavioural Therapy of Schizophrenia. New York, NY: Guilford Press.

Google Scholar

Kingdon, D. G., and Turkington, D. (2005). Cognitive-behavioural Therapy of Schizophrenia. New York, NY: Guilford Press.

Google Scholar

Kråkvik, B., Gråwe, R. W., Hagen, R., and Stiles, T. C. (2013). Cognitive behaviour therapy for psychotic symptoms: a randomized controlled effectiveness trial. Behav. Cogn. Psychother. 41, 511–524. doi: 10.1017/S1352465813000258

PubMed Abstract | CrossRef Full Text | Google Scholar

Lewis, S., Tarrier, N., Haddock, G., Bentall, R., Kinderman, P., Kingdon, D., et al. (2002). Randomised controlled trial of cognitive-behavioural therapy in early schizophrenia: acute-phase outcomes. Br. J. Psychiatry Suppl. 43, s91–s97. doi: 10.1192/bjp.181.43.s91

PubMed Abstract | CrossRef Full Text | Google Scholar

Lincoln, T. M. (2006). Kognitive Verhaltenstherapie der Schizophrenie. Göttingen: Hogrefe.

Google Scholar

Lincoln, T. M., Suttner, C., and Nestoriuc, Y. (2008). Wirksamkeit kognitiver Interventionen für Schizophrenie. Psychol. Rundschau 59, 217–232. doi: 10.1026/0033-3042.59.4.217

CrossRef Full Text | Google Scholar

Lincoln, T. M., Ziegler, M., Mehl, S., Kesting, M. L., Lüllmann, E., Westermann, S., et al. (2012). Moving from efficacy to effectiveness in cognitive behavioral therapy for psychosis: a randomized clinical practice trial. J. Consult. Clin. Psychol. 80, 674–686. doi: 10.1037/a0028665

PubMed Abstract | CrossRef Full Text | Google Scholar

McGovern, J., and Turkington, D. (2001). ‘Seeing the wood from the trees’: a continuum model of psychopathology advocating cognitive behaviour therapy for schizophrenia. Clin. Psychol. Psychother. 8, 149–175. doi: 10.1002/cpp.283

CrossRef Full Text | Google Scholar

Morrison, A. P., Turkington, D., Pyle, M., Spencer, H., Brabban, A., Dunn, G., et al. (2014). Cognitive therapy for people with schizophrenia spectrum disorders not taking antipsychotic drugs: a single-blind randomised controlled trial. Lancet 383, 1395–1403. doi: 10.1016/S0140-6736(13)62246-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Morrison, A., Renton, J., Dunn, H., Williams, S., and Bentall, R. (2004). Cognitive Therapy for Psychosis: A Formulation-Based Approach. New York, NY: Routledge.

Google Scholar

Naeem, F., Farooq, S., and Kingdon, D. (2014). Cognitive behavioral therapy (brief vs standard duration) for schizophrenia. Schizophr. Bull. 40, 958–959. doi: 10.1093/schbul/sbu113

PubMed Abstract | CrossRef Full Text | Google Scholar

Nelson, H. E. (1997). Cognitive Behavioural Therapy with Schizophrenia. A Practice Manual. Cheltenham: Stanley Thornes Publishers.

Google Scholar

NICE. (2014). Psychosis and Schizophrenia in Adults: Treatment and Management [CG 178]. London: National Institute for Health and Clinical Excellence.

O'Connor, K., Stip, E., Pélissier, M. C., Aardema, F., Guay, S., Gaudette, G., et al. (2007). Treating delusional disorder: a comparison of cognitive-behavioural therapy and attention placebo control. Can. J. Psychiatry 52, 182–190.

PubMed Abstract | Google Scholar

Peters, E. R., Joseph, S. A., and Garety, P. A. (1999). Measurement of delusional ideation in the normal population: introducing the PDI (Peters et al., Delusions Inventory). Schizophr. Bull. 25, 553–576. doi: 10.1093/oxfordjournals.schbul.a033401

PubMed Abstract | CrossRef Full Text | Google Scholar

Pinninti, N. R., Rissmiller, D. J., and Steer, R. A. (2010). Cognitive-behavioral therapy as an adjunct to second-generation antipsychotics in the treatment of schizophrenia. Psychiatr. Serv. 61, 940–943. doi: 10.1176/ps.2010.61.9.940

PubMed Abstract | CrossRef Full Text | Google Scholar

Rathod, S., Kingdon, D., Phiri, P., and Gobbi, M. (2010). Developing culturally sensitive cognitive behaviour therapy for psychosis for ethnic minority groups by exploration and incorporation of Service Users and Health Professionals views and opinions. Behav. Cogn. Psychother. 38, 511–533. doi: 10.1017/S1352465810000378

CrossRef Full Text | Google Scholar

Rathod, S., Phiri, P., Harris, S., Underwood, C., Thagadur, M., Padmanabi, U., et al. (2013). Cognitive behaviour therapy for psychosis can be adapted for minority ethnic groups: a randomised controlled trial. Schizophr. Res. 143, 319–326. doi: 10.1016/j.schres.2012.11.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Raudenbush, S. W. (2009). “Analyzing effect sizes: random-effects models,” in The Handbook of Research Synthesis and Meta-analysis, eds H. M. Cooper, L. V. Hedges, and J. C. Valentine (New York, NY: Russell Sage Foundation), 295–315.

Rector, N. A., and Beck, A. T. (2001). Cognitive behavioral therapy for schizophrenia: an empirical review. J. Nerv. Ment. Dis. 189, 278–287. doi: 10.1097/00005053-200105000-00002

PubMed Abstract | CrossRef Full Text | Google Scholar

Sarin, F., Wallin, L., and Widerlöv, B. (2011). Cognitive behavior therapy for schizophrenia: a meta-analytical review of randomized controlled trials. Nord. J. Psychiatry 65, 162–174. doi: 10.3109/08039488.2011.577188

PubMed Abstract | CrossRef Full Text | Google Scholar

Sterne, J. A. C., and Egger, M. (2005). “Regression methods to detect publication and other bias in meta-analysis,” in Publication Bias in Meta-analysis. Prevention, Assessment and Adjustments, eds H. Rothstein, A. J. Sutton, and M. Borenstein (Chichester; Hoboken, NJ: Wiley), 99–110. doi: 10.1002/0470870168.ch6

PubMed Abstract | CrossRef Full Text

Tarrier, N. (1992). “Management and modification of residual psychotic symptoms,” in Innovations in the Psychological Management of Schizophrenia, eds M. Birchwood and N. Tarrier (Chichester: Wiley), 147–170.

Tarrier, N., Beckett, R., Harwood, S., Baker, A., Yusupoff, L., and Ugarteburu, I. (1993). A trial of two cognitive-behavioural methods of treating drug-resistant residual psychotic symptoms in Schizophrenic patients: I. Outcome. Br. J. Psychiatry 162, 524–532. doi: 10.1192/bjp.162.4.524

PubMed Abstract | CrossRef Full Text | Google Scholar

Tarrier, N., Gooding, P., Pratt, D., Kelly, J., Awenat, Y., and Maxwell, J. (2013). Cognitive Behavioural Prevention of Suicide in Psychosis: A Treatment Manual. London: Routledge.

Google Scholar

Tarrier, N., Kelly, J., Maqsood, S., Snelson, N., Maxwell, J., Law, H., et al. (2014). The cognitive behavioural prevention of suicide in psychosis: a clinical trial. Schizophr. Res. 156, 204–210. doi: 10.1016/j.schres.2014.04.029

PubMed Abstract | CrossRef Full Text | Google Scholar

Turkington, D., Kingdon, D., Rathod, S., Hammond, K., Pelton, J., and Mehta, R. (2006). Outcomes of an effectiveness trial of cognitive-behavioural intervention by mental health nurses in schizophrenia. Br. J. Psychiatry 189, 36–40. doi: 10.1192/bjp.bp.105.010884

PubMed Abstract | CrossRef Full Text | Google Scholar

Turner, D. T., van der Gaag, M., Karvotaki, E., and Cuijpers, P. (2013). Psychological interventions for Psychosis: a meta-analysis of comparative outcome studies. Am. J. Psychiatry 171, 523–538. doi: 10.1176/appi.ajp.2013.13081159

PubMed Abstract | CrossRef Full Text | Google Scholar

Valmaggia, L. R., van der Gaag, M., Tarrier, N., Pijnenborg, M., and Slooff, C. J. (2005). Cognitive-behavioural therapy for refractory psychotic symptoms of schizophrenia resistant to atypical antipsychotic medication. Randomised controlled trial. Br. J. Psychiatry 186, 324–330. doi: 10.1192/bjp.186.4.324

PubMed Abstract | CrossRef Full Text | Google Scholar

van der Gaag, M., Valmaggia, L. R., and Smit, F. (2014). The effects of individually tailored formulation-based cognitive behavioural therapy in auditory hallucinations and delusions: a meta-analysis. Schizophr. Res. 156, 30–37. doi: 10.1016/j.schres.2014.03.016

PubMed Abstract | CrossRef Full Text | Google Scholar

van Os, J., Linscott, R. J., Myin-Germeys, I., Delespaul, P., and Krabbendam, L. (2009). A systematic review and meta-analysis of the psychosis continuum: evidence for a psychosis proneness-persistence-impairment model of psychotic disorder. Psychol. Med. 39, 179–195. doi: 10.1017/S0033291708003814

PubMed Abstract | CrossRef Full Text | Google Scholar

Waller, H., Emsley, R., Freeman, D., Bebbington, P., Dunn, G., Fowler, D., et al. (2015). Thinking well: a randomised controlled feasibility study of a new CBT therapy targeting reasoning biases in people with distressing persecutory delusional beliefs. J. Behav. Ther. Exp. Psychiatry 48, 82–89. doi: 10.1016/j.jbtep.2015.02.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Wells, A. (1997). Cognitive Therapy of Anxiety Disorders: A Practice Manual and Conceptual Guide. Chichester: Wiley.

Google Scholar

Wessely, S., Buchanan, A., Reed, A., Cutting, J., Everitt, B., Garety, P., et al. (1993). Acting on delusions I: prevalence. Br. J. Psychiatry 163, 69–76. doi: 10.1192/bjp.163.1.69

PubMed Abstract | CrossRef Full Text | Google Scholar

Wykes, T., Steel, C., Everitt, B., and Tarrier, N. (2008). Cognitive behavior therapy for schizophrenia: effect sizes, clinical models, and methodological rigor. Schizophr. Bull. 34, 523–537. doi: 10.1093/schbul/sbm114

PubMed Abstract | CrossRef Full Text | Google Scholar

Zimmermann, G., Favrod, J., Trieu, V. H., and Pomini, V. (2005). The effect of cognitive behavioral treatment on the positive symptoms of schizophrenia spectrum disorders: a meta-analysis. Schizophr. Res. 77, 1–9. doi: 10.1016/j.schres.2005.02.018

PubMed Abstract | CrossRef Full Text | Google Scholar