What's really wrong with cognitive behavioral therapy for psychosis?

The CBT Debate

For persons with medication-refractory psychotic experiences such as auditory hallucinations, a psychological therapy referred to as cognitive behavioral therapy for psychosis (CBTp) has emerged as the standard recommended treatment in clinical practice guidelines (e.g., Kreyenbuhl et al., 2010; National Institute for Health and Clinical Excellence [NICE], 2014). However, the past few years have seen impassioned debate regarding the endorsement of CBTp as evidence-based practice, with some arguing that evidence in its favor has been “oversold” (McKenna and Kingdon, 2014). As a follow up to their earlier controversial review (Lynch et al., 2010), which claimed no evidence that CBTp was effective in “well-conducted” trials, a recent meta-analysis by Jauhar et al. (2014) drew the only slightly less pessimistic conclusion that CBTp's therapeutic effect was only in the small range. Coinciding with the continuing recommendation of CBTp for routine provision in the 2014 NICE guidelines, this has led to debates published in several journals, and a flurry of further meta-analyses analysing different permutations of trial characteristics and measures. These meta-analyses have formed the more optimistic conclusions that CBTp shows good effects for hallucinations (van der Gaag et al., 2014), for overall psychotic symptoms in people with persisting symptoms (Burns et al., 2014), and in direct contrasts with other interventions (Turner et al., 2014).

As a battle fought with meta-analysis, debate has focused on which data should be included in effect size calculations: for example, whether trials with different intervention targets should be included, conducted during acute psychosis should be mixed with persisting psychosis, and whether both group and one-to-one format intervention should be included (Birchwood et al., 2014; Burns et al., 2014; Mueser and Glynn, 2014; Peters, 2014). There has also been criticism of an excessive focus on overall psychotic symptom severity at post-treatment as the primary outcome (e.g., on measures like the Positive and Negative Symptom Scales, PANSS), when there is stronger evidence for effects on specific symptom measures (Peters, 2014; van der Gaag et al., 2014), and at follow-up time points (Peters, 2014), and when, in any case, CBTp primarily targets the emotional impact of psychotic experiences rather than their presence or frequency (Birchwood et al., 2014).

Beyond the Effect Size Debate

This debate has been valuable in drawing attention to the need for critical thinking in this field. However, the present paper argues that debate about which data to include in analyses, and how to interpret them, needs to consider some fundamental limitations of using broad CBTp protocols as a focus of study, and highlights that this whole debate has overlooked some potentially more fundamental limitations of what CBTp provides as an intervention for routine practice.

The term “cognitive behavioral therapy for psychosis” emerged in the 1990s within the context of a number of researchers beginning to study the application of psychological methods to help people manage their psychotic symptoms. At this time, this was helpful in grouping together a number of similar approaches, united by a pragmatic focus on reducing the impact of symptoms, and use of methods from a cognitive behavioral tradition, such as training in different skills in responding to symptoms, and restructuring distress-related appraisals. Hence, the operationalization of a CBTp served a useful purpose in defining an emerging literature, in developing therapy manuals for RCTs, and, ultimately, in providing data for the meta-analyses which have informed guidelines. However, as the field has progressed, the concept of CBTp has become less relevant and more limited, both as an object of scientific enquiry, and as a model of provision in practice.

Limitations of the CBTp Protocol as An Object of Scientific Enquiry

One of the key limitations of using CBTp as a trial protocol is the level of within-trial heterogeneity of therapy delivery. Trials have usually included persons with some combination of positive symptoms (hallucinations, delusions, or both), often in combination with negative symptoms and emotional symptoms, which means a variety of therapy targets are possible. Intervention protocols also describe a variety of therapeutic methods (e.g., coping enhancement, modification of delusions, relapse prevention), employed on the basis of an individualized case formulation, which makes it difficult to derive conclusions about the helpfulness and importance of component methods. In contemporary practice, as further intervention methods are incorporated, such as the use of mindfulness and imagery, CBTp represents an increasingly varied smorgasbord of intervention methods used in various combinations according to the person's presentation.

One consequence of this within-trial variability is that CBTp trials have required outcome measures sufficiently broad to capture the expected (variable) outcome domains. Whilst viable for broad outcomes such as quality of life and service use, within-trial variability reduces sensitivity to more direct but individualized outcomes such as hallucination- or delusion-related distress, compliance with command hallucinations, and interference of specific symptoms with social functioning. This has resulted in an overreliance on omnibus psychosis measures like the PANSS, which are so broad and indirect that they may measure more things that are not targeted by the intervention than things that are (Thomas, 2014). Such measures are inevitably going to lack sensitivity to individual outcomes, and, subsequently, provide trials with little more than a fairly insensitive test of a null hypothesis that CBTp does nothing at all. It would be misleading to consider the magnitude of effect sizes produced from these data as especially meaningful.

A second consequence of using an individualized formulation-based approach is that trials do not reveal which of the many intervention components that were included in the intervention contributed to outcome. For example, a recent review of psychological intervention methods for auditory hallucinations found that relatively little could be concluded about the relative usefulness of specific components of CBTp used with voices, with many assumptions untested, and a need for much more study at this level (Thomas et al., 2014).

A related, third, limitation regards the amenability of CBTp as a protocol for RCT designs contrasting with control conditions that match for therapist time, analogous to the use of placebo control in drug trials, argued by Lynch et al. to be a feature of “well-conducted” trials. In principle, this trial design could provide a strong experimental approach to examining therapeutic technologies: it would work well if there were a more tightly operationalised intervention, and more tightly defined outcome measure, to test whether the specific content of the intervention contributes over more contextual factors in delivery. However, this degree of specificity is not provided by the broad CBTp protocol, where the intervention arm involves a variably utilized package of intervention methods rather than a specific intervention. This, combined with broad outcome measurement, and the reality that psychological therapy control conditions have more active components than placebo/expectancy alone, means that such designs are likely to be very difficult to power adequately.

Limitations of CBTp as a Model of Best-Practice Therapy

Meanwhile, the second key issue regards how well the broad CBTp model, which has been the focus of trials, informs practice. Ultimately, the purpose of developing any intervention is to see it delivered. In the 1990s, CBTp was exciting in providing promise to target symptoms which were being left to pharmacotherapy alone. However, whilst clinical practice guidelines have been encouraging routine provision of CBTp since 2002, there continues to be discussion of it failing to be delivered (e.g., Farhall and Thomas, 2013; Nordentoft and Austin, 2014; van der Gaag, 2014). In explaining this, it is often argued that services need to better prioritize psychological interventions. However, what does CBTp actually offer? CBTp mainly provides a framework for adapting existing cognitive and behavioral methods to psychosis, thereby primarily being suited to delivery by practitioners with advanced levels of cognitive-behavioral skill, typically clinical psychologists. Indeed, the competency framework described for CBTp (Roth and Pilling, 2013) indicates a high and exclusive bar for delivery. In practice, the CBTp intervention we have validated as evidence-based practice within RCTs outlines a treatment protocol requiring such high prerequisite skill that it can only be used by a small—and expensive—segment of the mental health workforce.

Furthermore, without understanding which components of the CBTp black box are useful, this creates a challenge of either disseminating a simplified version of CBTp to less thoroughly trained practitioners, or increasing the workforce of skilled therapists. Both have been attempted with less success than would be hoped. Early initiatives such as THORN in the UK have had relatively poor success in leading to changes in delivery (Couldwell and Stickley, 2007), and it is notable that the most recent descriptions of “low intensity” CBT for psychosis have not, in fact, utilized elements of CBTp, but, rather, behavioral activation and graded exposure (Waller et al., 2013). Meanwhile, recent UK pilots have examined whether it is possible to increase delivery of CBTp by boosting the workforce of CBT practitioners. Jolley et al. (2015) recently described the outcomes in a demonstration site in which a total of 10 additional whole time equivalent NHS staff focused on delivering CBTp to psychosis services with approximately 7000 service users. They reported being successful in leading to a threefold increase in persons delivered CBTp with evidence for good outcomes and high satisfaction in participants within a year. However, with delivery reported to increase at a rate of approximately 20 cases per whole time equivalent therapist per year, the total increase in delivery would have represented less than 3% of the overall caseload. This suggests that, even with significant investment and prioritization, only quite low absolute levels of delivery can be realized, illustrating challenges in meeting consumers' treatment needs in a widespread way using CBTp as a model.

What can we Learn from this for the Ongoing Development of Interventions?

These limitations highlight issues, not of CBTp lacking efficacy, but of it providing a research focus not particularly revealing of its component methods or specific effects, and producing an all-or-nothing therapeutic technology that is not well-suited to being widely accessed. It is important to recognize when the CBTp protocol has uses and when it is limited. In research, it works well as a protocol representing current best-practice expert psychological therapy, something useful, for example, in contrasts with routine care to address cost-effectiveness questions, or when considering applications in particular contexts, such as with persons not taking medication (e.g., Morrison et al., 2014). However, its operationalization is not tight enough to know what exactly is working. Likewise, in practice, CBTp provides a useful operationalization of how to work psychologically with psychosis for persons already fluent in CBT, but is less accessible as an intervention for practitioners new to CBT to learn.

So what can we learn from this in advancing the field of psychological interventions for psychotic symptoms such as auditory hallucinations? Being much broader than, for example, cognitive therapy for depression, CBTp is not well-suited to dismantling trials. However, there is value in individual examination of more discrete intervention components, both old and new, that can be isolated more precisely, which has been showing some success with delusions (see Freeman, 2011; Thomas et al., 2014). This lesson is important not just for cognitive behavioral interventions, but also for the direction of ongoing research into new broad therapy paradigms being applied to psychotic experiences, such as acceptance and commitment therapy (e.g., Thomas et al., 2013) which may run into similar challenges in future.

In doing this, it appears particularly important to be focusing more attention to simple methods amenable to being widely delivered in practice. In considering the challenges that have been faced in disseminating CBTp, there is potential value in questioning the approach of starting with what expert therapists can do, and seeking to disseminate it, and instead starting with what patients need (e.g., Byrne and Morrison, 2014), and what mental health practitioners and services can deliver, and building interventions around this. This might include greater focus on consumer-defined ideas of personal recovery, and consumer-identified subjective and functional impacts of psychotic experiences found most problematic; as well as considering what can be provided by current mental health practitioners, and new elements such as a growing peer workforce (e.g., Dent-Pearce et al., 2015) and digital technologies (Alvarez-Jiminez et al., 2014).

Conflict of Interest Statement

The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Alvarez-Jiminez, M., Alcazar-Corcoles, M. A., Gonzalez-Blanch, C., Bendall, S., McGorry, P. D., and Gleeson, J. (2014). Online, social media and mobile technologies for psychosis treatment: a systematic review on novel user-led intervention. Schizophr. Res. 156, 96–106. doi: 10.1016/j.schres.2014.03.021

CrossRef Full Text | Google Scholar

Birchwood, M. J., Shiers, D., and Smith, J. (2014). CBT for psychosis: not a quasi-neuroleptic. Br. J. Psychiatry 204, 488–489. doi: 10.1192/bjp.204.6.488a

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Burns, A. M. N., Erickso, D. H., and Brenner, C. A. (2014). Cognitive-behavioural therapy for medication-resistant psychosis: a meta-analytic review. Psychiatr. Serv. 65, 874–880. doi: 10.1176/appi.ps.201300213

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Byrne, R., and Morrison, A. P. (2014). Service users' priorities and preferences for treatment of psychosis: a user-led Delphi study. Psychiatr. Serv. 65, 1167–1169. doi: 10.1176/appi.ps.201300289

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Couldwell, A., and Stickley, T. (2007). The Thorn course: rhetoric and reality. J. Psychiatr. Ment. Health Nurs. 14, 625–634. doi: 10.1111/j.1365-2850.2007.01143.x

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Dent-Pearce, L., Daya, I., Karagounis, J., and Thomas, N. (2015). “Integrating peer work with a specific therapeutic target: experiences from the voice exchange program,” in Contemporary TheMHS in Mental Health Services: Proceedings of the 24th TheMHS Conference, eds K. Kellehear, A. Lane, M. Cassaniti, B. Tooth, C. Chapman, S. Robertson, et al. (Balmain, NSW: TheMHS).

Farhall, J., and Thomas, N. (2013). Cognitive and behavioural therapies for psychosis. Aus. N. Z. J. Psychiatry 47, 508–511. doi: 10.1177/0004867413483370

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Freeman, D. (2011). Improving cognitive treatments for delusions. Schizophr. Res. 132, 135–139. doi: 10.1016/j.schres.2011.08.012

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Jauhar, S., McKenna, P. J., Radua, J., Fung, E., Salvador, R., and Laws, K. R. (2014). Cognitive-behavioural therapy for the symptoms of schizophrenia: systematic review and meta-analysis with examination of potential bias. Br. J. Psychiatry, 204, 20–29. doi: 10.1192/bjp.bp.112.116285

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Jolley, S., Garety, P., Peters, E., Fornells-Ambrojo, M., Onwumere, J., Harris, V., et al. (2015). Opportunities and challenges in Improving Access to Psychological Therapies for people with Severe Mental Illness (IAPT-SMI): evaluating the first operational year of the South London and Maudsley (SLaM) demonstration site for psychosis. Behav. Res. Ther. 64, 24–30. doi: 10.1016/j.brat.2014.11.006

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Kreyenbuhl, J., Buchanan, R. W., Dickerson, F. B., and Dixon, L. B. (2010). The Schizophrenia Patient Outcomes Research Team (PORT): updated treatment recommendations 2009. Schizophr. Bull. 36, 94–103. doi: 10.1093/schbul/sbp130

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Lynch, D., Laws, K. R., and McKenna, P. J. (2010). Cognitive behavioural therapy for major psychiatric disorder: does it really work? A meta-analytical review of well-controlled trials. Psychol. Med. 40, 9–24. doi: 10.1017/S003329170900590X

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

McKenna, P., and Kingdon, D. (2014). Has cognitive behavioural therapy for psychosis been oversold? BMJ 348:g2295. doi: 10.1136/bmj.g2295

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Morrison, A. P., Turkington, D., Pyle, M., Spencer, H., Brabban, A., Dunn, G., et al. (2014). Cognitive therapy for people with schizophrenia spectrum disroders not taking antipsychotic drugs: a single-blind randomised controlled trial. Lancet 383, 1395–1403. doi: 10.1016/S0140-6736(13)62246-1

CrossRef Full Text | Google Scholar

Mueser, K., and Glynn, S. M. (2014). Have the potential benefits of CBT for severe mental disorder been undersold? World Psychiatry 13, 253–256. doi: 10.1002/wps.20160

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

National Institute for Health and Clinical Excellence. (2014). Psychosis and Schizophrenia in Adults: Treatment and Management. Available online at: http://www.nice.org.uk

Nordentoft, M., and Austin, S. (2014). CBT for psychotic disorders: beyond meta-analyses and guidelines: it is time to implement! World Psychiatry 13, 260–261. doi: 10.1002/wps.20164

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Peters, E. (2014). Jauhar et al: an oversimplification of psychosis, its treatment, and its outcomes? Br. J. Psychiatry 205, 159–160. doi: 10.1192/bjp.205.2.159a

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Roth, A. D., and Pilling, S. (2013). A Competence Framework for Psychological Interventions with People with Psychosis and Bipolar Disorder. Available online at: http://www.ucl.ac.uk/clinical-psychology/CORE/competence_mentalillness_psychosisandbipolar.html

Thomas, N. (2014). “What have we learnt about how to capture and measure the outcomes of psychological therapies for voices?,” in Psychological Approaches to Understanding and Treating Auditory Hallucinations: from Theory to Therapy, eds M. Hayward, C. Strauss, and S. McCarthy-Jones (London: Routledge), 100–128.

Google Scholar

Thomas, N., Hayward, M., Peters, E., van der Gaag, M., Bentall, R. P., Jenner, J. M., et al. (2014). Psychological therapies for auditory hallucinations (voices): current status and key research directions. Schizophr. Bull. 40, s202–s212. doi: 10.1093/schbul/sbu037

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Thomas, N., Morris, E. M. J., Shawyer, F., and Farhall, J. (2013). “Acceptance and commitment therapy for voices,” in Acceptance and Commitment Therapy and Mindfulness for Psychosis, eds E. M. J. Morris, L. C. Johns, and J. E. Oliver (E Chichester: Wiley-Blackwell), 95–111.

Turner, D. T., van der Gaag, M., Karyotaki, E., and Cuijpers, P. (2014). Psychological interventions for psychosis: a meta-analysis of comparative outcome studies. Am. J. Psychiatry 171, 523–538. doi: 10.1176/appi.ajp.2013.13081159

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

van der Gaag, M. (2014). The efficacy of CBT for severe mental illness and the challenge of dissemination in routine care. World Psychiatry 13, 257–258. doi: 10.1002/wps.20162

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

van der Gaag, M., Valmaggia, L. R., and Smit, F. (2014). The effects of individually tailored formulation-based cognitive behavioural therapy in auditory hallucinations and delusions: a meta-analysis. Schizophr. Res. 156, 30–37. doi: 10.1016/j.schres.2014.03.016

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Waller, H., Garety, P. A., Jolley, S., Fornells-Ambrojo, M., Kuipers, E., Craig, T., et al. (2013). Low intensity cognitive behavioural therapy for psychosis: a pilot study. J. Behav. Ther. Exp. Psychiatry 44, 98–104. doi: 10.1016/j.jbtep.2012.07.013

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar