Matthias Domhardt
Pim Cuijpers
David Daniel Ebert2
Harald Baumeister- 1Department of Clinical Psychology and Psychotherapy, Ulm University, Ulm, Germany
- 2Department of Clinical, Neuro- and Developmental Psychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
While the evidence on the effectiveness of different psychotherapies is often strong, it is not settled whereby and how these therapies work. Knowledge on the causal factors and change mechanisms is of high clinical and public relevance, as it contributes to the empirically informed advancement of psychotherapeutic interventions. Here, digitalized research approaches might possess the potential to generate new insights into human behavior change, contributing to augmented interventions and mental healthcare practices with better treatment outcomes. In this perspective article, we describe recent findings of research into change mechanisms that were only feasible with digital tools and outline important future directions for this rather novel branch of research. Furthermore, we indicate several challenges and pitfalls that are to be solved, in order to advance digitalized psychotherapy process research, both methodologically and technologically.
Introduction
Despite decades of research efforts to unveil the working mechanisms in psychotherapies for common mental disorders, the evidence base on the causal factors and therapeutic processes in most of these interventions remains largely uncertain (Cuijpers et al., 2019). Most researchers would probably agree that comprehensive knowledge on the mechanisms of change (i.e., the actual processes responsible for change) is central to develop more powerful intervention packages with optimized outcomes though. We highlight that certain features of digitalization convey novel opportunities for psychotherapy process research, which hold the potential to lift this kind of research on another level and shed more light upon an enduring black box. At the same time, we also point to important challenges and hurdles that might obstruct the full evolvement of this new branch of research.
Here, we conceive digitalized psychotherapy process research rather broadly, comprising different methods and means, which share the commonality that they are all technologically realized and were not available to prior psychotherapy research of the pre-digital age. Established examples of these digital approaches are video-taped analyses of therapeutic processes (e.g., Koole and Tschacher, 2016), videoconference-based psychotherapy (e.g., Etzelmueller et al., 2018), or routine outcome monitoring (e.g., Lutz, 2002; Lambert et al., 2018). These digital tools might be predominantly applied for research purposes only, but might also directly support psychotherapeutic practices in clinical routine. Most prominently, eHealth and mHealth interventions (i.e., psychotherapeutic treatment programs that are either delivered via personal computers and web-browsers, or smartphones and mobile applications, respectively) are extensively researched in recent years and show promise to extend mental healthcare, given their particular features, like flexibility and anonymity in conduct, possible cost-effectiveness, and outreach on a population scale (Andersson et al., 2019; Linardon et al., 2019; Domhardt et al., 2020a). Moreover, internet- and mobile-based interventions (IMIs) might not only augment the capabilities in mental healthcare (Ebert et al., 2017) but also hold a considerable potential for psychotherapy research on change mechanisms because of their specific properties.
Novel Methodological and Technological Opportunities
To begin with, a major asset of the implementation of IMIs in psychotherapy process research is the possibility to reach a higher standardization of interventions and their components, which was not possible with previous conventional research approaches within face-to-face therapy settings. This methodological progression enables a more reliable detection of the effects of single components in dismantling and additive design studies (Steubl et al., 2019), as previously hard to control confounds, like therapist factors (e.g., personal views, professional experience, and skills) or the actual presentation of manualized therapeutic content, can be hold constant. Thereby, dismantling studies have revealed several important insights so far, for example, the superiority of IMIs with guidance compared to pure self-help interventions (Baumeister et al., 2014) or the comparable effectiveness of transdiagnostic and disorder-specific interventions (Domhardt et al., 2019). These preliminary findings suggest that the therapeutic alliance might play a prominent role as common factor in digitalized psychotherapeutic interventions as well (Berger, 2016), and the potential of IMIs for scalability purposes might be further amplified by means of transdiagnostic treatment manuals (e.g., Weisel et al., 2019). Yet, future studies must expand our knowledge by disentangling the incremental or surrogating effects of central other components, like automation of support (as a possible cost-efficient alternative of human support in IMIs) and tailoring of intervention content to patients’ needs (in contrast to “one-size-fits-all”-interventions), in order to fully grasp the actual potential and limitations of IMIs to extend and augment mental healthcare efforts on a global scale.
Another advantage of experimental studies with IMIs is that they enable an unprecedented way to break down the utterly complex and dynamic processes of psychotherapeutic interventions into paradigmatic fragments, with the direct manipulation of isolated and clearly operationalized specific factors. In this sense, digital interventions might serve as a “mouse model” for psychotherapy process research and allow for the evaluation of distinct psychological and biological mechanisms of therapeutic change in original experimental designs. For instance, Hirsch et al. (2018) investigated the effects of experimentally inducing positive interpretations by means of a priming task before internet-delivered cognitive bias modification training (CBM) in patients with symptoms of depression and anxiety. The authors found that changes in interpretation bias partially mediated the effects of CBM on worry and rumination at follow-up, contributing to our understanding of the causal role of interpretation bias in worry and rumination, as a relevant target for face-to-face and online psychotherapy alike (Hirsch et al., 2018).
Moreover, ecological momentary assessment (EMA) and smart sensing studies make the step out of laboratories and facilitate the immediate detection of variables, irrespective of the constraints of space and time (Myin-Germeys et al., 2018). This can eventually lead to more valid multimodal assessments (i.e., “digital phenotyping”; Jain et al., 2015; Baumeister and Montag, 2019), free from several biases (e.g., recall, social desirability; Shiffman et al., 2008) and without overlapping measurements of outcome and mediator constructs in ordinary paper–pencil self-reports with similar—or even identical—items. Future research is needed however, to investigate, if novel biases arise within EMA studies themselves (e.g., reactive assessment; van Ballegooijen et al., 2016). The ease and high-intensity of data collection with EMA (Schuster et al., 2020) and digital tools will ultimately lead to larger sample sizes and big data sets that would alleviate the problem of limited statistical power, which is a long-lasting impediment of psychotherapy (process) research (Domhardt et al., 2021). This assumption is corroborated in a recent review, showing that mediation studies with IMIs for depression (Domhardt et al., 2021) exhibit a substantial larger amount of study participants on average (M = 262, SD = 243), when compared to conventional psychotherapy process research for depression (Lemmens et al., 2016; M = 173, SD = 145).
Fine-grained longitudinal data on therapeutic processes, gathered within or outside therapy sessions, can be shared among researchers conducting individual patient data meta-analyses, in order to develop multivariable algorithms that contribute to precision mental health (Furukawa et al., 2018, 2019; Lin et al., 2019). Innovative machine learning approaches might predict trajectories of change based on these data, which can inform pre-treatment and in-session decisions of mental healthcare practices (Cohen and DeRubeis, 2018; Goldberg et al., 2020; Rubel et al., 2020). Additionally, virtual reality (VR) interventions reveal novel findings on change mechanisms that were not conceivable with conventional studies so far. For instance, in their original study Pot-Kolder and colleagues randomized 116 patients with psychotic disorders either to VR-based Cognitive Behavior Therapy (CBT) or waitlist (treatment as usual). The VR-CBT intervention consisted of 16 sessions (8–12 weeks) with therapist-guided virtual-reality exercises, comprising reflections and challenges about the patients’ suspicious thoughts, safety behaviors, and harm expectancies. At this, the virtual social environments were individually designed for each patient, matching the idiosyncratic cues and paranoid fears of the individual patient. It goes without saying that the variations in the number, characteristics and responses of human avatars in VR would have not been controllable in real life exposure sessions. Overall, the findings of this recent RCT indicate that safety behaviors and modified social cognitions were mediators of treatment change and contributed to reductions in momentary paranoid ideation and anxiety (Pot-Kolder et al., 2018).
Current Challenges and Implications for Future Research
However, to exploit the full potential of digitalized approaches to psychotherapy process research, it is essential to address several prevailing pitfalls and ethical considerations. These are, amongst others, fundamental data security, confidentiality, and emergency issues, as well as concerns in regard to certain unresolved research questions (Stoll et al., 2019). For example, a major confinement in IMIs is a comparatively high attrition rate and limited engagement of patients in these digital interventions, especially when they are unguided and transferred from controlled research settings into routine healthcare (Domhardt et al., 2019; Graham et al., 2019). Numerous research efforts are currently committed to find effective ways to increase the engagement—i.e., the frequency patients adopt and interact with IMIs (Graham et al., 2019)—such as user-centered design (Graham et al., 2019), product quality and therapeutic persuasiveness (Baumel and Kane, 2018), striving for higher completer rates and, as a consequence thereof, better treatment outcomes (Yardley et al., 2016). Likewise, several attempts and efforts are currently underway, in order to reach a better understanding of the attitudes of patients, therapists and stakeholders toward IMIs (Topooco et al., 2017; Apolinário-Hagen et al., 2018), as well as to establish legal and regulatory frameworks for the implementation of IMIs (Ebert et al., 2018), in order to pave the way for a broader dissemination of digital psychotherapeutic interventions in research and practice.
Aside these current challenges, there are conceptual and methodological confines that hampered the field of psychotherapy process research for decades. This holds true for divergent operationalizations of central constructs of psychotherapy research, which ancillary obstructed the long-lasting debate about the relative importance of common and specific factors (Mulder et al., 2017). For instance between “factors” and “components” that are part of the therapy (e.g., problem solving training), versus “mediators” and “mechanisms of change” that occur in the patient (e.g., application of newly acquired problem solving skills). Other examples of somewhat tenacious misconceptions in the literature are between “moderators” and “mediators” (Johansson and Høglend, 2007). Thus, next to the importance to stick to consistent operationalizations of existing constructs, it is also key to conceptualize certain unique features of digital interventions that might represent novel digital common or digital specific factors. Therewith we refer to factors that are common to all (e.g., technological design and delivery) or specific to certain digital health interventions (e.g., persuasive design, mobile sensing and ecological momentary interventions, and continuous automated feedback with smartphones or wearables)—but are not constituent of face-to-face psychotherapies. Future research must disclose, which of these digital factors are indeed active ingredients of technology-delivered interventions (or are merely facilitating or obstructive moderating variables for genuine therapeutic processes), and if they induce the same or separate working mechanisms when compared to conventional face-to-face psychotherapies. Albeit, these questions of comparative research are hardly to answer, as long as there are substantial differences between these two branches of research concerning recruitment strategies and sample characteristics (Torous and Firth, 2018). Another current confinement of digital approaches to psychotherapy research is their primary focus on interventions based on CBT-principles to this point (Andersson et al., 2019; Domhardt et al., 2020b). Hence, IMIs developed from other therapeutic backgrounds (such as psychodynamic, interpersonal or mindfulness-based approaches) are of value to expand the evidence base—therewith omitting an imbalance still observable in conventional psychotherapy research today (Leichsenring et al., 2018).
An additional major current concern lies in the light-minded interchange of correlation and causality with flawed conclusions on presumed psychological processes (Antes, 2016; Caliebe et al., 2019), as observed in some privately funded studies resorting to big data gathered by large tech companies. Hence, it is of utmost importance to comply with the traditional explanatory research sequence: hypothesize, model, and test (Anderson, 2008). Alongside the cautious contemplation of central notions of epistemology (i.e., verify vs. falsify; Carnap, 1928; Popper, 1959) and approaches to causal inference (Ohlsson and Kendler, 2019). Thereby, an attentive awareness of the differences between conventional and digitalized research methods in deriving knowledge from big data is of high relevance, as certain automated approaches lack testable hypotheses, conceptual frameworks or theoretical foundations (Kriston, 2020), as indispensable theoretical presuppositions for causal inferences (Wilkinson et al., 2020). As such, some methods relying on machine learning and artificial intelligence are not suitable to detect causal mechanisms in clinical settings, as they might impede transparency and replicability, which have to remain indispensable criteria for various decisions in healthcare. Hence, the consideration and advocacy of theory-driven explanatory research with falsifiable scientific models might be of particular relevance at the present time, so as to convey the scientific achievements and epistemological methodologies from decades of research efforts into an ever-increasing digitalized world, with the concomitant advancement of technologized psychological and medical research.
Conclusion
Last but not least, in our view, the discussion about the opportunities and limitations of digitalized approaches to psychotherapy process research must not attend to technological and methodological aspects alone, but urgently needs to weigh the clinical and societal implications of their (non-)utilization hereafter. Accordingly, forthcoming research efforts ought to reveal, to which degree the innovations of digitalization will actually add more light on the mechanisms of change in psychotherapeutic interventions, and if we make the most out of technological opportunities to improve global mental health.
Data Availability Statement
The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.
Author Contributions
MD wrote the first draft of the manuscript. All authors have contributed to the further writing and have approved the final manuscript.
Funding
This work was supported by a grant from the German Federal Ministry of Education and Research (BMBF; FKZ 01KG1802). The funding source BMBF had no role in the study design, writing the manuscript, or the decision to submit this manuscript for publication.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Anderson, C. (2008). The End of Theory: The Data Deluge Makes the Scientific Method Obsolete. Available online at: https://www.wired.com/2008/06/pb-theory/ (accessed November 21, 2019).
Andersson, G., Titov, N., Dear, B. F., Rozental, A., and Carlbring, P. (2019). Internet-delivered psychological treatments: from innovation to implementation. World Psychiatry 18, 20–28. doi: 10.1002/wps.20610
Antes, G. (2016). Is the age of causality over? Z. Evid. Fortbild Qual. Gesundhwes 112 (Suppl 1):S16-S22. doi: 10.1016/j.zefq.2016.04.007
Apolinário-Hagen, J., Harrer, M., Kählke, F., Fritsche, L., Salewski, C., and Ebert, D. D. (2018). Public attitudes toward guided internet-based therapies: web-based survey study. JMIR Mental Health 5:e10735. doi: 10.2196/10735
Baumeister, H., and Montag, C. (eds). (2019). Digital Phenotyping and Mobile Sensing. Basel: Springer International Publishing.
Baumeister, H., Reichler, L., Munzinger, M., and Lin, J. (2014). The impact of guidance on internet-based mental health interventions — a systematic review. Inter. Intervent. 1, 205–215. doi: 10.1016/j.invent.2014.08.003
Baumel, A., and Kane, J. M. (2018). Examining predictors of real-world user engagement with self-guided ehealth interventions: analysis of mobile apps and websites using a novel dataset. J. Med. Internet. Res. 20:e11491. doi: 10.2196/11491
Berger, T. (2016). The therapeutic alliance in internet interventions: a narrative review and suggestions for future research. Psychother. Res. 27, 511–524. doi: 10.1080/10503307.2015.1119908
Caliebe, A., Leverkus, F., Antes, G., and Krawczak, M. (2019). Does big data require a methodological change in medical research? BMC Med. Res. Methodol. 19:125. doi: 10.1186/s12874-019-0774-0
Cohen, Z. D., and DeRubeis, R. J. (2018). Treatment selection in depression. Annu. Rev. Clin. Psychol. 14, 209–236. doi: 10.1146/annurev-clinpsy-050817-084746
Cuijpers, P., Reijnders, M., and Huibers, M. J. (2019). The role of common factors in psychotherapy outcomes. Annu. Rev. Clin. Psychol. 15, 207–231. doi: 10.1146/annurev-clinpsy-050718-095424
Domhardt, M., Geßlein, H., Rezori, R. E., and Baumeister, H. (2019). Internet- and mobile-based interventions for anxiety disorders: a meta-analytic review of intervention components. Depress Anxiety 36, 213–224. doi: 10.1002/da.22860
Domhardt, M., Letsch, J., Kybelka, J., Koenigbauer, J., Doebler, P., and Baumeister, H. (2020a). Are Internet- and mobile-based interventions effective in adults with diagnosed panic disorder and/or agoraphobia? A systematic review and meta-analysis. J. Affect. Disord. 276169–182. doi: 10.1016/j.jad.2020.06.059
Domhardt, M., Steubl, L., and Baumeister, H. (2020b). Internet- and mobile-based interventions for mental and somatic conditions in children and adolescents: a systematic review of meta-analyses. Z. Kinder Jugendpsychiatr. Psychother. 48, 33–46. doi: 10.1024/1422-4917/a000625
Domhardt, M., Steubl, L., Boettcher, J., Buntrock, C., Karyotaki, E., Ebert, D. D., et al. (2021). Mediators and mechanisms of change in Internet- and mobile-based interventions for depression: a systematic review. Clin. Psychol. Rev. 83:101953.
Ebert, D. D., Cuijpers, P., Muñoz, R. F., and Baumeister, H. (2017). Prevention of mental health disorders using internet and mobile-based interventions: a narrative review and recommendations for future research. Front. Psychiatry 8:116. doi: 10.3389/fpsyt.2017.00116
Ebert, D. D., van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., et al. (2018). Internet- and mobile-based psychological interventions: applications, efficacy, and potential for improving mental health. Eur. Psychol. 23, 167–187. doi: 10.1027/1016-9040/a000318
Etzelmueller, A., Radkovsky, A., Hannig, W., Berking, M., and Ebert, D. D. (2018). Patient’s experience with blended video- and internet based cognitive behavioural therapy service in routine care. Inter. Intervent. 12, 165–175. doi: 10.1016/j.invent.2018.01.003
Furukawa, T. A., Efthimiou, O., Weitz, E. S., Cipriani, A., Keller, M. B., Kocsis, J. H., et al. (2018). Cognitive-behavioral analysis system of psychotherapy, drug, or their combination for persistent depressive disorder: personalizing the treatment choice using individual participant data network metaregression. Psychother. Psychosom. 87, 140–153. doi: 10.1159/000489227
Furukawa, T. A., Karyotaki, E., Suganuma, A., Pompoli, A., Ostinelli, E. G., Cipriani, A., et al. (2019). Dismantling, personalising and optimising internet cognitive-behavioural therapy for depression: a study protocol for individual participant data component network meta-analysis. BMJ Open 8:e026137. doi: 10.1136/bmjopen-2018-026137
Goldberg, S. B., Flemotomos, N., Martinez, V. R., Tanana, M. J., Kuo, P. B., Pace, B. T., et al. (2020). Machine learning and natural language processing in psychotherapy research: alliance as example use case. J. Couns. Psychol. 67, 438–448. doi: 10.1037/cou0000382
Graham, A. K., Lattie, E. G., and Mohr, D. C. (2019). Experimental therapeutics for digital mental health. JAMA Psychiatry 76, 1223–1224. doi: 10.1001/jamapsychiatry.2019.2075
Hirsch, C. R., Krahé, C., Whyte, J., Loizou, S., Bridge, L., Norton, S., et al. (2018). Interpretation training to target repetitive negative thinking in generalized anxiety disorder and depression. J. Consult. Clin. Psychol. 86, 1017–1030. doi: 10.1037/ccp0000310
Jain, S. H., Powers, B. W., Hawkins, J. B., and Brownstein, J. S. (2015). The digital phenotype. Nat. Biotechnol. 33, 462–463. doi: 10.1038/nbt.3223
Johansson, P., and Høglend, P. (2007). Identifying mechanisms of change in psychotherapy: mediators of treatment outcome. Clin. Psychol. Psychother. 14, 1–9. doi: 10.1002/cpp.514
Koole, S. L., and Tschacher, W. (2016). Synchrony in psychotherapy: a review and an integrative framework for the therapeutic alliance. Front. Psychol. 7:862. doi: 10.3389/fpsyg.2016.00862
Kriston, L. (2020). Machine learning’s feet of clay. J. Eval. Clin. Pract. 26, 373–375. doi: 10.1111/jep.13191
Lambert, M. J., Whipple, J. L., and Kleinstäuber, M. (2018). Collecting and delivering progress feedback: a meta-analysis of routine outcome monitoring. Psychotherapy (Chic) 55, 520–537. doi: 10.1037/pst0000167
Leichsenring, F., Abbass, A., Hilsenroth, M. J., Luyten, P., Munder, T., Rabung, S., et al. (2018). “Gold standards,” plurality and monocultures: the need for diversity in psychotherapy. Front. Psychiatry 9:159. doi: 10.3389/fpsyt.2018.00159
Lemmens, L. H., Muller, V. N., Arntz, A., and Huibers, M. J. (2016). Mechanisms of change in psychotherapy for depression: an empirical update and evaluation of research aimed at identifying psychological mediators. Clin. Psychol. Rev. 50, 95–107. doi: 10.1016/j.cpr.2016.09.004
Lin, J., Scott, W., Carpenter, L., Norton, S., Domhardt, M., Baumeister, H., et al. (2019). Acceptance and commitment therapy for chronic pain: protocol of a systematic review and individual participant data meta-analysis. Syst. Rev. 8:140. doi: 10.1186/s13643-019-1044-2
Linardon, J., Cuijpers, P., Carlbring, P., Messer, M., and Fuller-Tyszkiewicz, M. (2019). The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials. World Psychiatry 18, 325–336. doi: 10.1002/wps.20673
Lutz, W. (2002). Patient-focused psychotherapy research and individual treatment progress as scientific groundwork for an empirically based clinical practice. Psychother. Res. 12, 251–272. doi: 10.1080/713664389
Mulder, R., Murray, G., and Rucklidge, J. (2017). Common versus specific factors in psychotherapy: opening the black box: opening the black box. Lancet Psychiatry 4, 953–962. doi: 10.1016/S2215-0366(17)30100-1
Myin-Germeys, I., Kasanova, Z., Vaessen, T., Vachon, H., Kirtley, O., Viechtbauer, W., et al. (2018). Experience sampling methodology in mental health research: new insights and technical developments. World Psychiatry 17, 123–132. doi: 10.1002/wps.20513
Ohlsson, H., and Kendler, K. S. (2019). Applying causal inference methods in psychiatric epidemiology: a review. JAMA Psychiatry 77, 637–644. doi: 10.1001/jamapsychiatry.2019.3758
Pot-Kolder, R. M., Geraets, C. N., Veling, W., van Beilen, M., Staring, A. B., Gijsman, H. J., et al. (2018). Virtual-reality-based cognitive behavioural therapy versus waiting list control for paranoid ideation and social avoidance in patients with psychotic disorders: a single-blind randomised controlled trial. Lancet Psychiatry 5, 217–226. doi: 10.1016/S2215-0366(18)30053-1
Rubel, J. A., Zilcha-Mano, S., Giesemann, J., Prinz, J., and Lutz, W. (2020). Predicting personalized process-outcome associations in psychotherapy using machine learning approaches-A demonstration. Psychother. Res. 30, 300–309. doi: 10.1080/10503307.2019.1597994
Schuster, R., Schreyer, M. L., Kaiser, T., Berger, T., Klein, J. P., Moritz, S., et al. (2020). Effects of intense assessment on statistical power in randomized controlled trials: simulation study on depression. Inter. Intervent. 20:100313. doi: 10.1016/j.invent.2020.100313
Shiffman, S., Stone, A. A., and Hufford, M. R. (2008). Ecological momentary assessment. Annu. Rev. Clin. Psychol. 4, 1–32. doi: 10.1146/annurev.clinpsy.3.022806.091415
Steubl, L., Sachser, C., Baumeister, H., and Domhardt, M. (2019). Intervention components, mediators, and mechanisms of change of Internet- and mobile-based interventions for post-traumatic stress disorder: protocol for a systematic review and meta-analysis. Syst. Rev. 8:265. doi: 10.1186/s13643-019-1190-6
Stoll, J., Müller, J. A., and Trachsel, M. (2019). Ethical issues in online psychotherapy: a narrative review. Front. Psychiatry 10:993. doi: 10.3389/fpsyt.2019.00993
Topooco, N., Riper, H., Araya, R., Berking, M., Brunn, M., Chevreul, K., et al. (2017). Attitudes towards digital treatment for depression: a European stakeholder survey. Inter. Intervent. 8, 1–9. doi: 10.1016/j.invent.2017.01.001
Torous, J., and Firth, J. (2018). Bridging the dichotomy of actual versus aspirational digital health. World Psychiatry 17, 108–109. doi: 10.1002/wps.20464
van Ballegooijen, W., Ruwaard, J., Karyotaki, E., Ebert, D. D., Smit, J. H., and Riper, H. (2016). Reactivity to smartphone-based ecological momentary assessment of depressive symptoms (MoodMonitor): protocol of a randomised controlled trial. BMC Psychiatry 16:359. doi: 10.1186/s12888-016-1065-5
Weisel, K. K., Zarski, A.-C., Berger, T., Krieger, T., Schaub, M. P., Moser, C. T., et al. (2019). Efficacy and cost-effectiveness of guided and unguided internet- and mobile-based indicated transdiagnostic prevention of depression and anxiety (ICare Prevent): a three-armed randomized controlled trial in four European countries. Inter. Intervent. 16, 52–64. doi: 10.1016/j.invent.2018.04.002
Wilkinson, J., Arnold, K. F., Murray, E. J., van Smeden, M., Carr, K., Sippy, R., et al. (2020). Time to reality check the promises of machine learning-powered precision medicine. Lancet Digital Health 2, e677–e680. doi: 10.1016/S2589-7500(20)30200-4
Keywords: psychotherapy, mechanisms of change, e- and m-health, mediators, components, active ingredients, digital factors
Citation: Domhardt M, Cuijpers P, Ebert DD and Baumeister H (2021) More Light? Opportunities and Pitfalls in Digitalized Psychotherapy Process Research. Front. Psychol. 12:544129. doi: 10.3389/fpsyg.2021.544129
Received: 19 March 2020; Accepted: 27 February 2021;
Published: 19 March 2021.
Edited by:
Peter Hilpert, University of Lausanne, SwitzerlandReviewed by:
Tiago Bento, Instituto Universitário da Maia (ISMAI), PortugalSven Rabung, University of Klagenfurt, Austria
Copyright © 2021 Domhardt, Cuijpers, Ebert and Baumeister. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Matthias Domhardt, bWF0dGhpYXMuZG9taGFyZHRAdW5pLXVsbS5kZQ==