Skip to main content

OPINION article

Front. Psychiatry, 12 January 2023
Sec. Psychological Therapy and Psychosomatics
This article is part of the Research Topic Case Reports in Psychological Therapy and Psychosomatics View all articles

What is preventing psychotherapy case studies from having a greater impact on evidence-based practice, and how to address the challenges?

  • Louvain Psychotherapy Research Group, Psychological Sciences Research Institute, Université catholique de Louvain, Louvain-la-Neuve, Belgium

1. Introduction

Case studies are an essential part of evidence-based practice (EBP) because they provide a type of evidence for clinical practice that cannot be provided by other types of research. Case studies demonstrate how (not just which) change processes operate to achieve positive outcome, and how these processes can be influenced within the context of an individual treatment. Even in cases with positive outcome there are many barriers and resistances that can be documented in a case study and that are very helpful for practitioners to learn about. Case studies are also very well suited to demonstrate individualized, qualitative, and non-symptomatic changes through psychotherapy (1). In this sense, case studies contribute to the emergence of the personalized approach to treatment outcome. Through the focus on a single patient, case studies contain insights and knowledge in a format and at a level that is coherent with the practitioner's way of thinking. Clinical reasoning and case conceptualization are always about “thinking in cases” (2, 3). The key element here is particularization, not generalization: while efficacy studies demonstrate whether interventions work on average in a group, case studies demonstrate how they work with individual patients through a detailed description of therapeutic microprocesses. This is lost if case study approaches are not built into the fabric of EBP. However, there are several obstacles that are currently preventing case study research from having a greater impact on EBP.

2. The persuasiveness issue

Although case-based research complements other types of research in unique ways, it is often considered inferior to sample-based research. Efficacy studies apply a very straightforward and simple causal logic which consists of checking whether the same cause (under sufficiently similar conditions) produces the same effect. If a cause and an effect regularly follow each other (for instance in a sample of patients) it can be deduced that the cause (for instance a psychological intervention) creates an effect (for instance symptom reduction). Moreover, statistical significance testing provides efficacy studies with a clear binary criterion for determining the evidential value of psychological interventions. For these reasons, Cartwright (4) calls this type of studies “clinchers”: if the assumptions are met, the conclusion can be deduced with certainty. This makes them very persuasive for researchers, policy makers and the general public. At the same time, efficacy studies have limited value for clinical practice and cannot be the sole source of EBP (4). As pointed out in the introduction, other types of research evidence, including case studies, should be considered in the context of EBP. However, these other types of evidence have a less straightforward causal logic and have less clear criteria for determining the evidential value of interventions. In case study research, causality is situated in a complex psychological process that takes place at the level of the unique case, and case studies (at best) provide evidence that makes a case for a conclusion. Case studies never allow to deduce with certainty a clear yes/no answer to the question what works. Cartwright calls this type of research “vouchers”: in contrast to “clinchers,” they can only speak for a conclusion (4). This makes them less persuasive.

The persuasiveness issue cannot be solved by trying to emulate “clinchers.” What can improve their credibility is increasing the visibility of the strengths and impact of case study research, and increasing the awareness about new developments in the field. At the methodological level, specific approaches to rigorous data collection and data analysis for case studies have been developed (5, 6); quality criteria to improve the evidential value of clinical case studies have been proposed (7, 8). Moreover, methods to generalize by comparing and aggregating case studies are available and used (9, 10). Others have argued that the use of data from psychotherapy trials for conducting individual-focused case studies can “improve the yield” of painstakingly collected data, but also increase the impact of research on practice (11). The difference between sample-selection and case-selection has been highlighted as a crucial parameter in the process of generalization (12). At the epistemological level, Stake (13) introduced the concept of naturalistic generalization to describe knowledge that is gained through personal or vicarious experiences, for instance by reading case studies. Moreover, the concept of statistical generalization, which is so important for EBP based on efficacy studies, must be complemented with the concept of analytic generalization (14) which underpins the use of case studies for theory building (15). In the past, it has often been suggested that case studies are only useful for generating descriptions of and hypothesis about phenomena that are not well understood (“context of discovery”). However, these recent methodological and epistemological developments have shown that case studies can also contribute to the “context of justification.” That is, under the right conditions, they can provide rigorous tests of theory and therapeutic technique (16, 17).

3. The lack of framework issue

Within the community of case study “producers” and case study “users” (researchers, trainers, trainees, students, practitioners, policy makers), there is a lack of a shared framework of criteria to assess the quality of case studies. This problem can be situated at different levels. At the level of ethics, there are inconsistencies in the policies used by psychotherapy training institutions, universities and publishers that oversee the ethical aspects of case study research. Ethical committees within academic or clinical institutions often struggle to evaluate project applications that involve case study research, either because they don't see its scientific merit (see Section 2), or because their experience with the evaluation of sample-based studies is unhelpful when it comes to assessing the ethical intricacies of a case study project. At the level of the methodology, there are no tools to evaluate the quality of case studies. Existing frameworks and tools for evaluating the quality of research evidence (e.g., GRADE) categorize case studies as “low-quality evidence.” This is because these tools apply the criteria for efficacy studies to case reports. As a consequence, policy-makers undervalue the importance of case studies in the development of EBP. Organizations that promote and support EBP, such as the Joanna Briggs Institute and the Critical Appraisal Skills Programme, have developed checklists for rating the quality of qualitative research and case reports. However, these tools are developed for medical research, and they are diagnosis-oriented. Moreover, these tools and checklist operate on the basis of a categorical difference between qualitative and quantitative research, whereas case studies often take the form of mixed-method research.

The lack of framework issue can be addressed by developing ethics, methodology, and epistemology consensual frameworks for case study research. The general criteria for good science (objectivity and generalization) need to be adapted to case study research, in which the focus is on the individual and in which context plays a central role. In the field of social sciences, much work has been done on developing the methodological and epistemological principles that underpin case study research (14). This literature needs to be explored for relevant concepts and frameworks. Truijens et al. (18) argue that a precondition for EBP is the development of a theory of evidence that is clear on what should be evidenced to be useful and valid for psychological interventions. An important step toward the development of a framework is Kaluzeviciute's (19) Case Study Evaluation-tool (CaSE), the first tool that offers a framework and a checklist to evaluate the evidential value of case studies in the field of psychotherapy. This tool needs to be completed, disseminated, and implemented more broadly.

4. The accessibility issue

Case studies remain difficult to access by researchers, trainers, practitioners, and policy-makers. For case studies to have an impact on EBP, they should be easily accessible through searchable digital databases. However, current databases that are most often used for the development of EBP like Science Citation Index, PubMed and PsycInfo, do not allow to search the field of case study research efficiently. Case studies are often difficult to find with regular search terms, which makes it difficult to find relevant (sets of) case studies. Practitioners who want to look up case studies that can inform their work are not able to systematically identify relevant case studies. As a result, experiences and insights from clinical practice are insufficiently transformed into knowledge that can be shared and taught and, in a sense, each practitioner must discover the richness of clinical work anew. Practitioners write case studies in the context of their training and for professional development, but almost none of this work is available to other practitioners or for researchers (20). Training institutions have archives of case studies in the form of doctoral theses that are not cataloged and classified, and therefore not accessible.

The accessibility issue can be addressed by increasing the visibility of existing case study research and by making case studies more easily accessible. Practitioners need to be able to access case study research via different platforms and in different formats, for instance journals articles, online database of vignettes… A coordinated effort is needed to map available case study resources, for instance in the archives of training institutions. Several initiatives have been taken in the past. The Ulm Textbank (21) and the Psychoanalytic Research Consortium (22) are collections of recorded and transcribed therapy sessions that provide a rich resource for case study research. Miller (in 2004) and Iwakabe (in 2005) laid the foundation for building a searchable database of case studies. Their initiatives inspired a network of researchers from Ghent University, Université catholique de Louvain, and the University of Essex to create the Single Case Archive (www.singlecasearchive.com), an online searchable database of +3,400 published case studies that can be used by researchers, trainers, practitioners, and students. In the context of the Single Case Archive project, the first comprehensive review of case studies was published (23).

5. Discussion

The research-practice gap in the field of psychotherapy has been described as a lack of integration between the findings disseminated by researchers and the decisions made in the consulting room by therapists (19). This gap has negative consequences for the application of research findings in mental health services as well as on the development of research—supported psychological treatments. Case studies are an important means to reduce this gap because they provide templates of how to integrate basic research and knowledge into applied work at the individual case level. Reducing the research-practice gap should not be a matter of promoting the systematic uptake of research findings and other evidence-based practices into routine practice (top-down implementation). Rather, therapists should be engaged as learners that learn from their own and others' experiences and that learn from sharing and reflective on these experiences. The flexible case study research approach is a means to stimulate, support, and improve these learning processes, while considering different learning styles. For that reason, the above-mentioned obstacles need to be addressed urgently.

Author contributions

The author confirms being the sole contributor of this work and has approved it for publication.

Conflict of interest

The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Desmet M. The Pursuit of Objectivity in Psychology. Belgium: Borgerhoff & Lamberigts (2018). p. 109.

Google Scholar

2. Willemsen J. The use of evidence in clinical reasoning. J Contemp Psychother. (2022) 52:4. doi: 10.1007/s10879-022-09544-9

CrossRef Full Text | Google Scholar

3. Kaluzeviciute G, Willemsen J. Scientific thinking styles: the different ways of thinking in psychoanalytic case studies. Int J Psychoanal. (2020) 101:5. doi: 10.1080/00207578.2020.1796491

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Cartwright N. What evidence should guidelines take note of? J Eval Clin Pract. (2018) 24:5. doi: 10.111/jep.12959

CrossRef Full Text | Google Scholar

5. Fishman DB. The pragmatic case study method for creating rigorous and systematic, practitioner-friendly research. Pragmat Case Stud Psychother. (2013) 9:4. doi: 10.14713/pcsp.v9i4.1833

CrossRef Full Text | Google Scholar

6. McLeod J, Elliott R. Systematic case study research: a practice-oriented introduction to building an evidence base for counselling and psychotherapy. Couns Psychother Res. (2011) 11:1. doi: 10.1080/14733145.2011.548954

CrossRef Full Text | Google Scholar

7. Willemsen J, Della Rosa E, Kegerreis S. Clinical case studies in psychoanalytic and psychodynamic treatment. Front Psychol. (2017) 8:108. doi: 10.3389/fpsyg.2017.00108

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Eagle MN, Wolitzky DL. Systematic empirical research versus clinical case studies: a valid antagonism? J Am Psychoanal Assoc. (2011) 59:4. doi: 10.1177/0003065111416652

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Iwakabe S, Gazzola N. From single-case studies to practice-based knowledge: aggregating and synthesizing case studies. Psychother Res. (2009) 19:4–5. doi: 10.1080/10503300802688494

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Krivzov J, Hannon D, Meganck R. Approaching psychotherapy case studies in a metasynthesis: deficit vs. conflict in treatment of medically unexplained symptoms. In: Borcsa M, Willig C, editors. Qualitative Research Methods in Mental Health. Switzerland, AG: Springer Nature (2021). p. 37–63.

Google Scholar

11. Fishman DB, Messer SB, Edwards DJA, Dattilio FM. Case Studies Within Psychotherapy Trials: Integrating Qualitative and Quantitative Methods. New York: Oxford University Press (2017). p. 384.

Google Scholar

12. McLeod J. Case Study Research in Counselling and Psychotherapy. Thousand Oaks, CA: Sage (2010). p. 272.

Google Scholar

13. Stake RE. The Art of Case Study Research. Thousand Oaks, CA: Sage (1995). p. 192.

Google Scholar

14. Yin RK. Case Study Research and Applications: Design and Methods. London: Sage (2017). p. 352.

Google Scholar

15. Stiles WB. Theory-building case studies as practice-based evidence. In: Barkham M, Hardy GE, Mellor-Clark J, editors. Developing and Delivering Practice-based Evidence: A Guide for the Psychological Therapies. Chichester, UK: Wiley-Blackwell (2010). p. 91–108.

Google Scholar

16. Kächele H, Albani C, Buchheim A, Hölzer M, Hohage R, Mergenthaler E, et al. The German specimen case, Amalia X: empirical studies. Int J Psychoanal. (2006) 87:3. doi: 10.1516/17NN-M9HJ-U25A-YUU5

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Cornelis S, Desmet M, Meganck R, Van Nieuwenhove K, Willemsen J. Extending Blatt's two-polarity model of personality development to dissociative identity disorder: a theory-building case study. Res Psychother. (2021) 24:1. doi: 10.4081/ripppo.2021.505

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Truijens F, De Smet MM, Desmet M, Meganck R. Validity of data as precondition for evidence: a methodological analysis of what is taken to count as evidence in psychotherapy research. Philos Psychiatr Psychol. (2021) 28:2. doi: 10.1353/ppp.2021.0018

CrossRef Full Text | Google Scholar

19. Kaluzeviciute G. Appraising psychotherapy case studies in practice-based evidence: introducing Case Study Evaluation-tool (CaSE). Psicol Reflex Crit. (2021) 34:9. doi: 10.1186/s41155-021-00175-y

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Mackrill T, Iwakabe S. Making a case for case studies in psychotherapy training: a small step towards establishing an empirical basis for psychotherapy training. Couns Psychother Q. (2013) 26:3–4. doi: 10.1080/09515070.2013.832148

CrossRef Full Text | Google Scholar

21. Mergenthaler E, Kächele H. The Ulm Textbank management system: a tool for psychotherapy research. In: Dahl H, Kächele H, Thomä H, editors. Psychoanalytic Process Research Strategies. Berlin: Springer (1988). p. 195–212.

PubMed Abstract | Google Scholar

22. Waldron S, Gazzillo F, Stukenberg K, Gorman B. Advancing psychoanalysis and psychotherapy through research. In: Axelrod SD, Naso RC, Rosenberg LM, editors. Progress in Psychoanalysis: Envisioning the Future of the Profession. New York, NY: Routledge (2018). p. 151–80.

Google Scholar

23. Meganck R, Krivzov J, Notaerts L, Willemsen J, Kaluzeviciute G, Dewaele A, et al. The single case archive: review of a multitheoretical online database of published peer-reviewed single-case studies. Psychotherapy. (2022) 59:4. doi: 10.1037/pst0000431

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: case study, psychotherapy, evidence-based practice, training, methodology

Citation: Willemsen J (2023) What is preventing psychotherapy case studies from having a greater impact on evidence-based practice, and how to address the challenges? Front. Psychiatry 13:1101090. doi: 10.3389/fpsyt.2022.1101090

Received: 17 November 2022; Accepted: 28 December 2022;
Published: 12 January 2023.

Edited by:

Alberto Stefana, University of Pavia, Italy

Reviewed by:

Tracy Eells, University of Louisville, United States
Paolo Migone, University of Parma, Italy

Copyright © 2023 Willemsen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jochem Willemsen, yes Jochem.Willemsen@uclouvain.be

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.