Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 23 June 2023
Sec. Psychological Therapy and Psychosomatics
This article is part of the Research Topic Insights in Psychological Therapies: 2022 View all 4 articles

An interdisciplinary multimodal integrative healthcare program for depressive and anxiety disorders

Jaap Wijnen,,
Jaap Wijnen1,2,3*Nicole Louise GordonNicole Louise Gordon1Geert van 't HullenaarGeert van 't Hullenaar1Marc Lucas PontMarc Lucas Pont1Marciano Wilhelmina Henricus GeijselaersMarciano Wilhelmina Henricus Geijselaers1Jessica Van Oosterwijck,,Jessica Van Oosterwijck2,3,4Jeroen de JongJeroen de Jong1
  • 1Intergrin Academy, Geleen, Netherlands
  • 2Spine, Head and Pain Research Unit Ghent, Department of Rehabilitation Sciences, Faculty of Medicine and Health Sciences, Ghent University, Ghent, Belgium
  • 3Pain in Motion International Research Group, Brussels, Belgium
  • 4Center for InterProfessional Collaboration in Education Research and Practice (IPC-ERP UGent), Faculty of Medicine and Health Sciences, Ghent University, Ghent, Belgium

Objective: Although multimodal interventions are recommended in patients with severe depressive and/or anxiety disorders, available evidence is scarce. Therefore, the current study evaluates the effectiveness of an outpatient secondary care interdisciplinary multimodal integrative healthcare program, delivered within a transdiagnostic framework, for patients with (comorbid) depressive and/or anxiety disorders.

Methods: Participants were 3,900 patients diagnosed with a depressive and/or anxiety disorder. The primary outcome was Health-Related Quality of Life (HRQoL) measured with the Research and Development-36 (RAND-36). Secondary outcomes included: (1) current psychological and physical symptoms measured with the Brief Symptom Inventory (BSI) and (2) symptoms of depression, anxiety, and stress measured with the Depression Anxiety Stress Scale (DASS). The healthcare program consisted of two active treatment phases: main 20-week program and a subsequent continuation-phase intervention (i.e., 12-month relapse prevention program). Mixed linear models were used to examine the effects of the healthcare program on primary/secondary outcomes over four time points: before start 20-week program (T0), halfway 20-week program (T1), end of 20-week program (T2) and end of 12-month relapse prevention program (T3).

Results: Results showed significant improvements from T0 to T2 for the primary variable (i.e., RAND-36) and secondary variables (i.e., BSI/DASS). During the 12-month relapse prevention program, further significant improvements were mainly observed for secondary variables (i.e., BSI/DASS) and to a lesser extent for the primary variable (i.e., RAND-36). At the end of the relapse prevention program (i.e., T3), 63% of patients achieved remission of depressive symptoms (i.e., DASS depression score ≤ 9) and 67% of patients achieved remission of anxiety symptoms (i.e., DASS anxiety score ≤ 7).

Conclusion: An interdisciplinary multimodal integrative healthcare program, delivered within a transdiagnostic framework, seems effective for patients suffering from depressive and/or anxiety disorders with regard to HRQoL and symptoms of psychopathology. As reimbursement and funding for interdisciplinary multimodal interventions in this patient group has been under pressure in recent years, this study could add important evidence by reporting on routinely collected outcome data from a large patient group. Future studies should further investigate the long-term stability of treatment outcomes after interdisciplinary multimodal interventions for patients suffering from depressive and/or anxiety disorders.

1. Introduction

Depressive and anxiety disorders are the most common mental health disorders worldwide (1, 2). The Diagnostic and Statistical Manual of mental disorders, fifth edition (DSM-5) considers depressive and anxiety disorders as two separate diagnostic categories (3), and no longer includes a mixed subsyndromal anxiety-depressive diagnostic category as was the case in earlier versions of the DSM (4). Moreover, an increasing number of studies questions the independence of depression and anxiety, by providing evidence of: (1) shared genetic risk across the internalizing disorders (57), (2) high similarities in neurocircuit disruption across mental disorders, including depressive and anxiety disorders (8, 9), (3) a more parsimonious structure to psychopathology (i.e., overarching ‘p-factor’) as compared to current nosologies (i.e., DSM-5) (10, 11), and (4) comparable responses to the same treatment across different mental disorders (12). Furthermore, a study by Choi et al. (13) highlighted that 45–67% of patients with a major depressive disorder (MDD) meet criteria for at least one comorbid anxiety disorder and 30–63% of patients with anxiety disorders meet criteria for a comorbid MDD. Recent evidence from Shevlin et al. (14) concludes that co-occurring anxiety and depression may even be more common than ‘pure’ depression or anxiety disorders. In addition to high comorbidity, considerable heterogeneity in symptom presentation within diagnostic categories also poses a serious problem.

These findings emphasize the need to shift away from a ‘traditional diagnostic approach’, in which interventions are predominantly focused on symptom level and where the majority of interventions are tailored toward single diagnosis, generally ignoring comorbid conditions or symptoms that fall outside diagnostic classifications (15, 16). Instead, a shift is needed toward a ‘transdiagnostic approach’ (15), acknowledging that predisposing, precipitating and perpetuating factors implicated in mental health are not specific to particular diagnosis, but operate across traditional diagnostic categories (1618). It is therefore important to focus on the underlying mechanisms responsible for the development and maintenance of mental disorders, cutting across multiple diagnostic categories (19, 20). With regard to treatment, a transdiagnostic intervention would apply the same underlying treatment principles across a wide range of diagnosed mental disorders, without adjusting treatment to specific diagnosis (18, 21). Indeed, a growing body of research is supporting the effectiveness of transdiagnostic interventions for individuals experiencing depression and anxiety symptoms (16, 2224).

A remaining question concerns what treatment content constitutes best-evidence for depressive-and anxiety disorders, regardless whether an intervention is delivered within a transdiagnostic framework. Current best evidence for treatment in depressive-and anxiety disorders generally support the use of: cognitive behavioral therapy (CBT), third-wave CBT (e.g., acceptance and commitment therapy, mindfulness-based cognitive therapy, etc.), psychotherapy, relaxation, exposure therapy, biological interventions and physical activity/exercise therapy (2529). Highest quality evidence is generally found for the use of CBT (25, 29, 30). Most of the aforementioned recommendations are based on studies investigating treatment effects of mono-interventions in patients with single diagnoses (31). However, especially in more severe cases of (comorbid) depressive and anxiety disorders, it is important to not only target one aspect of the mental disorder (i.e., cognitions/behavior in CBT), while ignoring other aspects (i.e., somatic aspects, targeted during for example exercise therapy). This emphasizes the need for the use of more holistic interventions, targeting multiple aspects of depressive and anxiety disorders.

Interdisciplinary multimodal interventions could be a suitable alternative and use at least two different therapeutic interventions with different mechanisms of action (i.e., multimodality) and are delivered by a team of healthcare professionals from at least two different professions, with a common treatment philosophy and shared therapeutic aims and treatment goals (i.e., interdisciplinary) (3234). To date, few studies support the use of multimodal interventions in this patient group. Nonetheless, the guideline for depression from the National Institute for Health and Care Excellence (i.e., NICE) in the United Kingdom (UK) recommends multimodal interventions for patients with severe depression unresponsive to previous treatments (35). Also the UK guidelines for anxiety disorders (36, 37) recommends multimodal interventions only in severe cases of anxiety. Despite the fact that multimodal interventions are recommended in more severe cases of depressive and anxiety disorders, only a few studies have published results on the efficacy (38, 39) or effectiveness (31, 4045) of these interdisciplinary multimodal interventions. Four studies focused on populations with severe depressive disorders as single diagnoses (39, 42, 44, 45). Only five studies evaluated interdisciplinary multimodal interventions in more realistic patient samples with comorbid depression and anxiety disorders (31, 38, 40, 41, 43). These studies report remission rates post-treatment for depressive symptoms ranging from 17% (38) to 50% (31). Even less is known about sustainability of treatment results after multimodal interventions in comorbid depression and anxiety, with only one study (40) reporting long-term (i.e., 6 months) stability of treatment results. In conclusion, more research is warranted to investigate the short and long-term effects of interdisciplinary multimodal interventions in populations with comorbid depressive and anxiety disorders.

The aim of this study was to evaluate the effectiveness of an outpatient secondary care interdisciplinary multimodal integrative healthcare program, delivered within a transdiagnostic framework, for patients suffering from (comorbid) depressive and/or anxiety disorders. The healthcare program consisted of two treatment phases: a main 20-week program and a 12-month relapse prevention program (RPP). The primary outcome was health-related quality of life (HRQoL) and secondary outcomes were psychological and physical symptoms. HRQoL is the main variable of interest since the evaluated interdisciplinary multimodal healthcare program has a ‘recovery-oriented’ approach, meaning that recovery of daily functioning and perceived quality of life is the central focus within the program and recovery of somatic and/or psychiatric symptoms is a secondary aim. The healthcare program is expected to increase HRQoL and to a lesser extent to reduce psychological/physical symptoms. In addition, we expect further improvements in HRQoL but not in psychological and physical symptoms, after completion of the 12-month RPP.

2. Materials and methods

2.1. Study design and setting

The current study uses a descriptive study design (i.e., case series), without comparator group, in order to evaluate the effectiveness of an interdisciplinary multimodal integrative healthcare program for patients with depressive and/or anxiety disorders provided at “Premium Healthcare Interventions” (PHI), a specialized secondary care mental healthcare center with branches in seven different cities across the Netherlands.

2.2. Participants

All patients referred to the healthcare program by general practitioners, occupational physicians and medical specialists between January 2017 and May 2022 were considered for study participation based on the following inclusion and exclusion criteria. The main inclusion criterion was the presence of a depressive or anxiety disorder as primary disorder according to the DSM-5 (3), diagnosed by a psychologist or psychiatrist. Exclusion criteria were: (1) an ongoing personal injury lawsuit, (2) ongoing social security issues (i.e., incapacitated, unemployment benefits, etc.), (3) other psychological or somatic condition that is predominant to depressive or anxiety disorder, (4) insufficient proficiency of Dutch/English language in order to understand therapy content, (5) insufficient intellectual abilities in order to understand therapy content, (6) under the age of 18. All eligible patients were asked to provide permission to use their anonymized data for research purposes by providing written consent. The study complies with the Declaration of Helsinki and the Medical Ethics Review Committee of Maastricht University Medical Center decided that this study does not need a full review (register number: 2022–3266) according to the Dutch Medical Research with Human Subjects Law (i.e., Wet Medisch-wetenschappelijk onderzoek met mensen, WMO), because it concern a descriptive study that used anonymized data from medical records.

2.3. Procedure

The healthcare program consisted of three phases: intake procedures (i.e., phase 1), the main 20-week outpatient healthcare program (i.e., phase 2) and a 12-month RPP (i.e., phase 3). Data was collected through questionnaires at the following time points: start of phase 2 (i.e., before start 20-week program: T0), halfway phase 2 (i.e., halfway 20-week program: T1), end of phase 2 (i.e., after 20-week program: T2) and at the end of phase 3 (i.e., end of 12-month RPP: T3). Eligible patients received an explanation about the healthcare program during an information session prior to the intake procedures (i.e., before start of phase 1). Subsequently, patients decided whether or not to start the intake procedures (phase 1), which included the completion of several standardized questionnaires and psychological and physical assessments, performed by a coordinating practitioner, various psychologists and a physical therapist. The assessments are focused on identifying predisposing, perpetuating and maintaining factors implicated in the mental health problem and cover the following areas: (1) Psychosomatics: emotion regulation, body awareness, etc., (2) Lifestyle: social participation, sleep, nutrition, etc., (3) Cognition and behavior: coping, maladaptive thoughts and behavior, etc., (4) Somatic: physical well-being, energy management, etc. Based on the assessments and questionnaire outcomes, a coordinating practitioner (i.e., psychiatrist, clinical/health care psychologist) decided whether individual patients were eligible for the healthcare program. After mutual agreement to the treatment plan, the main 20-week outpatient intervention (i.e., phase 2) was started. After completion of phase 2, patients were free to choose whether or not to participate in a subsequent 12-month RPP (phase 3).

2.4. Treatment program

The healthcare program provided at the specialized secondary mental healthcare center (i.e., PHI) is characterized by an interdisciplinary, multimodal and integrative approach for patients with depressive and/or anxiety disorders. The healthcare program is best described as a multimodal cognitive behavioral therapy and combines the use of different therapeutic methods, based on the problems, needs and unique circumstances of each individual client. The basic principles of behavioral therapy (46) are central to the healthcare program and treatment techniques that are being used can be justified in an adequate behavioral therapeutic process, starting with a functional analysis of problem behavior (4648) and resulting in an individualized treatment plan. Other important elements within the healthcare program are: (1) a modular approach (15), where evidence-based elements can be delivered flexible and tailored toward the individual, based on specific underlying biopsychosocial risk, protective and/or maintaining factors of the mental health problem; (2) intensive, time-bound intervention program (49, 50); (3) an emphasis on the biopsychosocial model (51); (4) ‘shared decision making’ with collaborative goal-setting (52, 53); (5) a ‘recovery-oriented’ approach, in which patients are encouraged to cope autonomously with changing physical, emotional and social challenges (5457); (6) a focus on relapse prevention, through the incorporation of a 12-month RPP as part of the intervention (58, 59) and (7) ‘blended care’ (60), characterized by a combination of online and offline therapy, with the support of an e-health environment.

The healthcare program is led by an interdisciplinary team consisting of psychologists, physical therapists and a coordinating practitioner (i.e., psychiatrist, clinical/health care psychologist) (see Supplementary Table S1 for detailed provider information). Individual patients are assigned to an interdisciplinary treatment team consisting of three psychologists and a physical therapist, supervised by a coordinating practitioner. Each of the three psychologists within the treatment team has a different focus, namely: (1) the relationship between cognitive, behavioral, emotional, somatic and environmental factors that are proposed to maintain the self-perpetuating cycle of symptoms, distress and disability, (2) a focus on psychosomatics (i.e., reciprocity of body and mind), (3) focus on associations in unhealthy lifestyle behaviors and symptoms/disability. Physical therapists mainly focus on the somatic symptoms/bodily dysfunctions associated with the diagnosed mental disorder(s). The main 20-week outpatient healthcare program (phase 2) had a direct total treatment time of approximately 75 hours, consisting of 3 to 4 sessions per week with a duration of 1 hour. Phase 2 of the healthcare program consisted of five modules of approximately 4 weeks, covering the following themes: (1) Introduction, goal formulation, case conceptualization and (psycho)-education, (2) Recognition of maladaptive behavioral patterns and thoughts, emotion regulation, body awareness, mentalization and behavioral activation, (3) Application of newly learned skills in personal context, behavioral experiments and exposure, (4) Strengthening the capacity to cope/manage with physical, emotional and social challenges, encouragement for behavioral change, (5) Future goals, sustainability of treatment results and relapse prevention (see Supplementary Table S2 for more details). Within these modules, appropriate evidence-based interventions were selected, including: (1) Second and third-wave generation CBTs, (2) Psychosomatic interventions with a main focus of reciprocity of body and mind; (3) Operant-based interventions (61); (4) Body-related mentalization interventions (62); (5) Relaxation therapies/stress management; (6) Exercise therapy, with a focus on the somatic symptoms/bodily dysfunctions associated with the diagnosed mental disorder(s), and (7) Lifestyle interventions. Phase 2 was followed by a subsequent 12-months ‘RPP’ (phase 3), with a main focus on sustainability of treatment results through the encouragement of self-management and patient autonomy. The program consisted of e-health modules (delivered through an online platform) and/or several treatment sessions with members of the interdisciplinary team, either face-to-face or through e-communication. The content of the e-health modules and treatment sessions were always based on the main themes covered during phase 2. The combined ‘direct’ (i.e., treatment sessions with healthcare professional) and ‘indirect’ (i.e., e-health modules) treatment time over phase 3 is approximately 10 hours over a period of 12 months. The entire healthcare program (i.e., T0 to T3) is a blended treatment which combines face-to-face contact with online interventions through the support of an e-health environment. Through the e-health environment patients were able to use psycho-educative programs, e-health modules, exercises and videos tailored by the treatment team for each individual patient.

2.5. Outcome measures

2.5.1. RAND-36

General health and HRQoL was assessed by using the Dutch version of the Research and Development-36 (RAND-36) (63), which is the equivalent of the 36-Item Short Form Health Survey with the addition of one extra subscale, i.e., ‘health change’. The Dutch version of the RAND-36 consists of 36 items distributed across nine domains of which subscale scores can be calculated, i.e., physical functioning, role limitations due to physical health problems, role limitations due to emotional problems, general mental health, social functioning, bodily pain, vitality, general health perception and health change. Each domain is scored from 0 to 100, with higher scores indicating better health. In addition, the Physical Component Score (PCS) and Mental Component Score (MCS) can be calculated by using recommended scoring algorithms (64), with scores also ranging from 0 to 100. The PCS primarily reflects physical aspects of HRQoL and the following subscales contribute most to scoring of the PCS: physical functioning, bodily pain and role limitations due to physical health problems. The MCS primarily reflects mental aspects of HRQoL and the following subscales contribute most to scoring of the MCS: general mental health, role limitations due to emotional problems and social functioning (64). Good reliability has been reported with internal coefficients ranging from 0.71–0.93 (65). Several studies also support the validity of the RAND-36 by reporting adequate convergent validity and discriminant validity (6567). The RAND-36 has been widely used to measure HRQoL in different patient groups, including in patients suffering from mental disorders (68, 69). PCS, MCS and RAND-36 subscales, were used as primary outcome measures in the current study.

2.5.2. BSI

To assess current psychological and physical symptoms the current study used the Dutch version of the Brief Symptom Inventory (BSI) which is a multidimensional self-report inventory (70) and shorter version to the Symptom Checklist 90 (71, 72). The Dutch version of the BSI consists of 53 items with descriptions of symptoms on the following nine dimensions of which subscale scores can be calculated, i.e., somatization, cognitive problems, interpersonal sensitivity, depression, anxiety, hostility, phobic anxiety, paranoid ideation and psychoticism (i.e., 0–4 score range on all subscales). In addition, the BSI includes the Global Severity Index (GSI), which ranges from 0 to 4 and reflects the average intensity of all symptom subscales combined. Participants have to indicate on a five-point rating scale to what extent they have experienced symptoms over the past week. For each subscale, raw scores can be calculated by dividing the sum of all items for a dimension by the number of items within that subscale. The GSI is calculated by summing the scores on all nine dimensions (and scores of additional individual items) and dividing it by the total number of responses. Higher scores on the BSI reflect more severe psychopathology. Sufficient reliability has been reported with internal consistency coefficients ranging from 0.71–0.83 (70, 73, 74). Several studies also support the validity of the BSI by reporting adequate convergent validity and predictive validity (70, 7479). The GSI and BSI subscales were used as secondary outcome measures in the current study.

2.5.3. DASS

Symptoms of depression, anxiety and stress were measured by using the Dutch version (80) of the ‘Depression Anxiety Stress Scales’ (DASS) (81, 82). The DASS consists of 42 items divided over 3 subscales: depression, anxiety and stress (i.e., 14 items for each subscale). Each subscale is scored from 0 to 42, with higher scores indicating higher severity of depression, anxiety and/or stress. Respondents have to indicate on a 4-point Likert scale to what extent statements apply to them over the past week, (i.e., 0 = did not apply to me at all and 3 = applied to me very much, or most of the time). Sufficient reliability has been reported with internal consistency coefficients ranging from 0.84–0.98 (81, 8386). Adequate convergent and discriminant validity is also reported in non-clinical and clinical samples (80, 8487). DASS scores for depression, anxiety and stress were used as secondary outcomes in the current study.

2.6. Statistical analysis

Statistical analysis were performed with two Python software programs: Statsmodels (version 0.13.2) (88) and SciPy (version 1.8.0) (89). The significance level was set at 0.05 and normality was tested with the D’Agostino-Pearson omnibus test (90, 91) (see Supplementary materials, section 2.3 for python code of normality testing).

Because of unbalanced data (i.e., unequal numbers of observations per time point) mixed linear model (MLM) analysis for longitudinal data was performed by using Statsmodels (88). Separate MLMs were constructed for each dependent variable (i.e., RAND-36, BSI and DASS (sub)scales). The fixed effect added to the model as a first level predictor was ‘time’ (i.e., representing the four measurement phases: T0, T1, T2, and T3). No second level predictors were added as fixed effects to the model. For random effects, Statsmodels automatically selects the best fitting random effects covariance matrices for each MLM. In addition, random intercepts and random slopes were tested. The construction of MLM with Statsmodels was based on recommendations from previous research (88, 92). See Supplementary materials (Supplementary Data, section 2.1) for an archive link to the Statsmodels website for an explanation on how to perform an MLM in Statsmodels. In addition, python codes for the construction of the MLMs in the current study were also added to the Supplementary materials (Supplementary Data, section 2.2). For MLMs with a main effect of time, post-hoc pairwise comparisons of dependent variable means were carried out between subsequent time points, adjusting for multiple comparison using Bonferroni corrections (93) by using SciPy (89). In case of normally distributed data a dependent t-test for paired samples was used (89, 94), and for non-normal distributed data the Wilcoxon signed rank test was used (89, 95). The python code of the post-hoc pairwise comparisons are also added to the Supplementary materials (Supplementary Data, section 2.3). In order to visualize the change over time of BSI, RAND-36 and DASS (sub)scales, lines were connected between subscale averages at each time point (i.e., T0, T1, T2, and T3) (Supplementary Figures S1–S3).

Effect size calculation was done based on the independent sample and inequal sample size variant of Cohen’s d as described by (96). A ‘d’ value around 0.01 is described as very small, 0.20 as small, 0.50 as medium (moderate), 0.80 as large, 1.20 as very large and near 2 as huge (97, 98). Cohen’s d was calculated with the following formula: d = X ¯ p o s t X ¯ p r e s with the pooled standard deviation s defined as s = ( X p r e X ¯ p r e ) + ( X p o s t X ¯ p o s t ) n p r e + n p o s t 2 . In addition, python codes for effect size calculation as applied in the current study were also added in the Supplementary materials (Supplementary Data, section 2.4).

Minimal clinically important difference (MCID) was calculated for RAND-36 scores by using ‘multiples of standard deviation’ (i.e., 0.5*SD) as described by Norman et al. (99). The statistical analysis described here were also applied previously to another patient sample by the same research group [see Wijnen et al. (100)].

3. Results

3.1. Patient characteristics

Participants were 3,900 patients with a depressive and/or anxiety disorder as primary diagnoses. Figure 1 shows a flow diagram of all 4,630 referred patients in the period between January 2017 and May 2022. From the 4,630 consecutively referred patients, 730 patients did not start the healthcare program after the first information session and the intake procedures (i.e., phase 1) (i.e., ‘no-go’). The main 20-week healthcare program (i.e., phase 2) was started by 3,900 patients (i.e., ‘go’ – T1). During phase two, 332 patients discontinued the intervention between T0 and T1 and 193 patients discontinued the intervention between T1 and T2 (i.e., total of 525 drop-outs between T0 and T2). Phase 2 was eventually completed by 3,375 patients (i.e., T2). From these 3,375 patients, 2,074 patients were ultimately enrolled in the 12-month RPP (i.e., phase 3). The remaining 1,301 patients decided not to start phase 3 (i.e., ‘no-go’ RPP). During phase three, 1,265 patients discontinued the RPP (i.e., RPP drop-out), leaving 809 patients completing the entire healthcare program (i.e., T0 – T3). Reasons for drop-out during the healthcare program were unfortunately not available in the used database.

FIGURE 1
www.frontiersin.org

Figure 1. Participant flow diagram. T0, before start 20-week program; T1, halfway 20-week program; T2, after 20-week program; T3, end of 12-month relapse prevention program; RPP, relapse prevention program.

Socio-demographic and clinical characteristics of the 3,900 included patients are summarized in Table 1. All participants had a depressive or anxiety disorder as primary diagnosis. Depressive disorders were diagnosed in 61.5% of patients, anxiety disorders in 33.9% of patients and both a depressive and anxiety disorder was diagnosed in 13.3% of patients. Two or more DSM-5 diagnoses were present in 86.9% of patients and three or more DSM-5 diagnoses in 56.1% of patients. Common comorbid DSM-5 diagnoses included: somatic symptom and related disorders (51.7%), trauma-and stressor-related disorders (10.2%), personality disorders (5.7%) and substance-related and addictive disorders (3.6%). See Supplementary Table S3 for a full list of comorbid DSM-5 diagnoses. The duration of complaints was longer than 2 years in 45.3% of the patients. Average age was 45.7 years (SD = 12.3), the majority of patients were working (71.3%) and were married or in a cohabiting relationship (64.7%). Baseline values (i.e., T0) of primary and secondary variables are presented in Tables 24. DASS baseline values (i.e., T0) indicate moderate scores for depressive, anxiety and stress symptoms (81). The average baseline value (i.e., T0) for the GSI is more severe compared to established scores for outpatient and inpatient psychiatric patients as reported by Derogatis and Melisaratos (76). Baseline averages for some BSI subscales are markedly higher compared to established psychiatric outpatient norm scores (i.e., somatization and phobic anxiety) and some average baseline BSI subscale scores are lower compared to psychiatric outpatients norm scores (i.e., interpersonal sensitivity, depression, anxiety and hostility) (76). GSI and BSI subscales baseline scores are also more severe compared to established patient norms as reported by De Beurs (101, 102), except for the BSI subscales interpersonal sensitivity and psychoticism which are comparable to the patients norms as reported by De Beurs (101).

TABLE 1
www.frontiersin.org

Table 1. Socio-demographic and clinical characteristics.

TABLE 2
www.frontiersin.org

Table 2. Means and standard deviations of RAND-36 subscales.

TABLE 3
www.frontiersin.org

Table 3. Means and standard deviations of the brief symptom inventory (BSI) subscales.

TABLE 4
www.frontiersin.org

Table 4. Means and standard deviations of DASS scores.

A comparison of baseline characteristics between completers (n = 3,375) and drop-outs (n = 525) is presented in Supplementary Table S4. Results show significant differences on several baseline variables between drop-outs and completers. Drop-outs report significantly lower scores on the PCS and the RAND-36 subscales general health experience, bodily pain, physical functioning and social functioning. In addition, significantly higher scores among drop-outs are reported on several BSI subscales (i.e., somatization, depression, phobic anxiety, paranoid ideation and psychoticism) and DASS subscales (i.e., anxiety and depression).

3.2. Primary outcomes

3.2.1. Health-related quality of life (RAND-36)

MCS and PCS means and standard deviations at each time point are reported in Table 2. The MLM analysis revealed a significant main effect of time on MCS (F2,11,503 = 3599.0, p < 0.05, B = 6.95, 95% CI [6.78, 7.11]) and PCS (F2,11,503 = 809.2, p < 0.05, B = 1.50, 95% CI [1.39, 1.62]). Post-hoc pairwise comparisons of means between subsequent timepoints showed a significant (adjusted for multiple comparisons) increase in MCS between T0 (M = 27.36, SD = 9.30) and T1 (M = 37.21, SD = 10.78) (padj < 0.01), between T1 (M = 37.21, SD = 10.78) and T2 (M = 44.12, SD = 11.31), between T2 (M = 44.12, SD = 11.31) and T3 (M = 45.69, SD = 12.56) (padj < 0.01). PCS also increased significantly from T0 (M = 43.72, SD = 9.40) to T1 (M = 45.08, SD = 9.27) (padj < 0.01) and from T1 (M = 45.08, SD = 9.27) to T2 (M = 46.94, SD = 9.25) (padj < 0.01). The observed increase in PCS between T2 (M = 46.94, SD = 9.25) and T3 (M = 47.57, SD = 10.26) was non-significant (padj > 0.01). Very Large effect sizes (98) were found for MCS changes from T0 to T2 and T0 to T3. Small effect sizes (97) were found for PCS changes from T0 to T2 and T0 to T3 (Table 5). Changes in MCS score from T0 to T2 (i.e., 16.76) and T0 to T3 (i.e., 18.33) were both clinically significant, based on MCID calculations (i.e., 0.5*SD). However, changes in PCS score from T0 to T2 (i.e., 3.22) and T0 to T3 (i.e., 3.85) were both not clinically significant.

TABLE 5
www.frontiersin.org

Table 5. Cohen’s d effect sizes.

RAND-36 subscale means and SD at each time point are also reported in Table 2. MLM analysis yielded a significant effect of time on all RAND-36 subscales: emotional role restrictions (F2,11,503 = 1747.8, p < 0.05, B = 18.00, 95% CI [17.37, 18.64]), general health experience (F2,11,503 = 1681.4, p < 0.05, B = 6.20, 95% CI [5.95, 6.44]), health change (F2,11,503 = 3107.4, p < 0.05, B = 19.02, 95% CI [18.54, 19.51]), general mental health (F2,11,503 = 3629.0, p < 0.05, B = 10.90, 95% CI [10.64, 11.17]), bodily pain (F2,11,503 = 1091.1, p < 0.05, B = 6.05, 95% CI [5.72, 6.37]), physical functioning (F2,11,503 = 1180.6, p < 0.05, B = 4.29, 95% CI [4.06, 4.51]), physical role restrictions (F2,11,503 = 1213.0, p < 0.05, B = 13.37, 95% CI [12.8, 14.0]), social functioning (F2,11,503 = 2639.5, p < 0.05, B = 13.00, 95% CI [12.63, 13.38]) and vitality (F2,11,503 = 3597.2, p < 0.05, B = 11.6, 95% CI [11.3, 11.8]). Post-hoc pairwise comparisons of means between subsequent timepoints and adjusted for multiple comparisons showed a significant (padj < 0.01) increase of all RAND-36 subscales between T0 and T1, between T1 and T2 and between T0 and T2. The observed increases in scores on RAND-36 subscales between T2 and T3 were significant for the subscales: emotional role restrictions, general mental health, physical role restrictions and social functioning (padj < 0.01). For all other subscales the increases from T2 to T3 were non-significant (padj > 0.01). Scores on two RAND-36 subscales from T2 to T3 decreased, however non-significantly (i.e., health change and physical functioning). Small to very large effect sizes were found for changes in RAND-36 subscales from T1 to T2 and from T0 to T3 (Table 5) (97, 98). Changes on all RAND-36 subscales from T0 to T2 were clinically significant, based on MCID calculations (i.e., 0.5*SD). Also all RAND-36 subscale changes from T0 to T3 were clinically significant, except for the change from T0 to T3 in ‘physical functioning’. See also Supplementary Figure S1 for a visualization of change over time of RAND-36 subscales.

3.3. Secondary outcomes

3.3.1. Physical and psychological symptoms (BSI)

GSI means and SD at each time point are reported in Table 3. The MLM analysis revealed a significant main effect of time on GSI (F2,11,526 = 3436.1, p < 0.05, B = − 0.315, 95% CI [−0.323, −0.307]). Post-hoc pairwise comparisons of means between subsequent time points showed a significant (adjusted for multiple comparisons) decrease in GSI between T0 (M = 1.40, SD = 0.61) and T1 (M = 0.98, SD = 0.57) (padj < 0.01), between T1 (M = 0.98, SD = 0.57) and T2 (M = 0.68, SD = 0.55), between T2 (M = 0.68, SD = 0.55) and T3 (M = 0.60, SD = 0.59) (padj < 0.01). Large effect sizes (97) were found for GSI changes from T0 to T2 and very large effect sizes (98) for GSI changes from T0 to T3 (Table 5).

BSI subscale means and SD at each time point are also reported in Table 3. MLM analysis yielded a significant effect of time on all BSI subscales: somatization (F2,11,526 = 2324.5, p < 0.05, B = − 0.304, 95% CI [− 0.313, − 0.294]), cognitive problems (F2,11,526 = 2787.2, p < 0.05, B = − 0.407, 95% CI [− 0.419, − 0.396]), interpersonal sensitivity (F2,11,526 = 1902.0, p < 0.05, B = − 0.309, 95% CI [− 0.320, − 0.298]), depression (F2,11,526 = 2661.8, p < 0.05, B = − 0.386, 95% CI [− 0.398, − 0.375]), anxiety (F2,11,526 = 2574.3, p < 0.05, B = − 0.388, 95% CI [− 0.400, − 0.377]), hostility (F2,11,526 = 1609.1, p < 0.05, B = − 0.227, 95% CI [− 0.237, − 0.218]), phobic anxiety (F2,11,526 = 1691.9, p < 0.05, B = − 0.258, 95% CI [− 0.268, − 0.247]), paranoid ideation (F2,11,526 = 1388.2, p < 0.05, B = − 0.221, 95% CI [− 0.231, − 0.211]) and psychoticism (F2,11,526 = 1933.9, p < 0.05, B = − 0.266, 95% CI [− 0.276, − 0.257]). Post-hoc pairwise comparisons of means between subsequent time points and adjusted for multiple comparisons showed a significant (padj < 0.01) decrease of all BSI subscales between T0 and T1, between T1 and T2 and between T0 and T2. The observed decreases in scores on BSI subscales between T2 and T3 were significant (padj < 0.01) for the subscales: somatization, cognitive problems, interpersonal sensitivity, anxiety, paranoid ideation and psychoticism. Decreases in BSI subscale scores from T2 to T3 were non-significant for the subscales: depression, hostility and phobic anxiety (padj > 0.01). Medium to large effect sizes (97) were found for changes for all BSI subscales between T0 and T2 (Table 5). In addition, medium to very large effect sizes (97, 98) were found for BSI subscale changes between T0 and T3 (Table 5). See also Supplementary Figure S2 for a visualization of change over time of BSI subscales.

3.3.2. Symptoms of depression, anxiety, and stress (DASS)

DASS means and SD at each time point are reported in Table 4. MLM analysis yielded a significant effect of time on all DASS subscales: anxiety (F2,11,481 = 2228.5, p < 0.05, B = − 3.146, 95% CI [− 3.249, − 3.043]), depression (F2,11,481 = 2765.4, p < 0.05, B = − 4.638, 95% CI [− 4.771, − 4.505]) and stress (F2,11,481 = 3123.1, p < 0.05, B = − 4.535, 95% CI [− 4.654, − 4.415]). Post-hoc pairwise comparisons of means between subsequent time points and adjusted for multiple comparisons showed significant (padj < 0.01) decreases of all DASS subscales scores from T0 to T1, from T1 to T2 and from T0 to T2. The observed decreases in DASS subscale scores from T2 to T3 were significant (padj < 0.01) for the subscales anxiety and stress and non-significant for the subscale depression (padj > 0.01). Moreover, 57% of the patients showed a clinical response (i.e., ≥ 50% reduction of DASS depression score) in depressive symptoms at T2 and 66% at T3. For anxiety symptoms, 45% of patients showed a clinical response (i.e., ≥ 50% reduction in DASS anxiety score) at T2 and 53% at T3. Remission rates for depressive symptoms were 43% at T2 and 63% at T3 (i.e., DASS depression score ≤ 9) (81). Remission rates for anxiety symptoms were 50% at T2 and 67% at T3 (i.e., DASS anxiety score ≤ 7). In addition, large to very large effect sizes (97, 98) were found for DASS subscale score changes from T0 to T2 and from T0 to T3 (Table 5). See also Supplementary Figure S3 for a visualization of change over time of DASS subscales.

4. Discussion

The purpose of this study was to evaluate the effectiveness of an outpatient secondary care interdisciplinary multimodal integrative healthcare program for patients with depressive and/or anxiety disorders. The results seem to indicate that an interdisciplinary multimodal healthcare program and subsequent RPP contributes to the recovery of patients with depressive and/or anxiety disorders. Results revealed significant improvements from T0 to T2 (i.e., phase 2) for the primary variable HRQoL (i.e., RAND-36) and for all secondary variables, including: current psychological and physical symptoms (i.e., BSI) and symptoms of depression, anxiety and stress (i.e., DASS). Moreover, improvements attained during phase 2 in primary and secondary variables were not only maintained during phase 3 (i.e., T2 – T3), but significant improvements were observed for the majority of variables. In contrast to our expectations, further significant improvements during phase 3 (i.e., T2 – T3) were mainly observed for secondary variables (i.e., BSI and DASS) and to a lesser extent for the primary variable (i.e., HRQoL measured with RAND-36). Effect sizes for the primary variable HRQoL ranged from small for improvements in physical HRQoL (i.e., PCS) to very large for improvements in mental HRQOL (i.e., MCS). Effect sizes for RAND-36 subscales ranged from small to very large. For secondary variables, effect sizes ranged from medium to very large for BSI subscales and from large to very large for DASS subscales. Remission rates were 63% for depressive symptoms (i.e., DASS depression score ≤ 9) and 67% for anxiety symptoms (i.e., DASS anxiety score ≤ 7) at T3.

The current study extents on previous research that reported on the effectiveness of multimodal interventions in (comorbid) depressive and anxiety disorders (31, 4045). Reported effect sizes for the reduction in depressive and anxiety symptoms from baseline to post-treatment were comparable across most of these studies, including the current study, mostly ranging from large to very large (31, 41, 43). Since high rates of relapse/recurrence have been reported in depressive and anxiety disorders, it is important to consider long-term stability of intervention results. Relapse rates of 10 to 49% within one year after treatment have been reported for depressive disorders (59, 103, 104). For anxiety disorders, relapse rates of 14% are reported (105, 106). Continuation-phase interventions can be delivered to reduce relapse rates and maximize the long-term benefits of therapy (59). Even after continuation-phase interventions, relapse rates of 29% are reported for depressive disorders (59). Among the aforementioned multimodal interventions, only two studies evaluated the long-term stability of their results (40, 41). Both studies reported that intervention results were maintained from post-treatment to follow-up, despite the fact that depressive and anxiety symptoms started to increase again once treatment was completed (40, 41). It is however important to note that Herzog et al. (41) provided a continuation-phase intervention during the follow-up period (i.e., support groups or 4-week refresher course), whereas Hauksson et al. (40) did not provide a continuation-phase intervention during follow-up. The current study provided a 12-month blended RPP after the end of phase 2 (20-week main intervention: T0 – T2). Surprisingly, the results from the current study seem to indicate that after phase 2 (i.e., T0 – T2), psychological and physical symptoms (i.e., BSI) and symptoms of depression, anxiety and stress (i.e., DASS) continue to decrease until the end of phase 3 (i.e., end of RPP). Remission rates for depressive symptoms were 43% after phase 2 (T0 – T2) and 63% at the end of phase 3 (i.e., end of RPP) (i.e., DASS depression score ≤ 9) (81). Remission rates for anxiety symptoms were 50% after phase 2 and 67% at the end of phase 3 (i.e., end of RPP) (i.e., DASS anxiety score ≤ 7). Moreover, quality of life measures also continued to improve from T2 to T3 (i.e., phase 3), but to a lesser extent compared to the secondary variables. These results add to the current available evidence for the feasibility of blended interventions in relapse prevention as a possible continuation-phase intervention (107).

When comparing the aforementioned multimodal interventions, several differences among these studies can be discussed. First, all of the aforementioned studies provided inpatient multimodal interventions (31, 38, 40, 41, 43) in contrast to the outpatient multimodal intervention evaluated in the current study. Second, the majority of these studies, including the current study, described a ‘time-limited’ intervention program (38, 40, 41) with a fixed intervention length, instead of an open-ended intervention length (31, 43) where patient and therapist decide together when to end therapy. Third, treatment length and frequency were considerably heterogeneous across the aforementioned multimodal interventions (31, 38, 40, 41, 43). Intervention length ranged from 5 weeks (31) to 30 weeks (43) in the open-ended interventions and from 6 weeks (40) to 20 weeks (i.e., current study) in the ‘time-limited’ interventions. Treatment frequency ranged from two full days a week (41) to five full days a week (38, 40). Despite the observed heterogeneity in health care setting (i.e., inpatient vs. outpatient), treatment length and treatment frequency across the aforementioned studies, treatment outcomes are comparable. This is important to consider when taking healthcare costs into consideration, because inpatient, high intensive, open-ended interventions are usually more expensive in comparison to outpatient time-limited interventions.

In addition to treatment dose, considerably heterogeneity is also observed in treatment content among the previously mentioned studies (31, 40, 41, 43). Most of these studies mention six to eight treatment components, including: (1) psychiatric, medical and/or nursing care, (2) pharmacotherapy and/or medication management, (3) lifestyle interventions (with focus on healthy nutrition, sleep, physical activity and relaxation), (4) psychotherapy (individual and/or group), (5) exercise therapy, (6) psycho-education, (7) systems therapy, (8) social/recreational activities, (9) art therapy, (10) music therapy, (11) social competence training, (12) CBT and (13) electro convulsive therapy. Also the number of involved healthcare professionals is variable, ranging from three professionals (i.e., current study) to six professionals (40). Despite the heterogeneity with regard to individual treatment components and involved healthcare personnel, the results are nevertheless comparable across the aforementioned multimodal interventions. A possible interpretation for the comparable results across these studies could be that the benefits of these multimodal interventions is not necessarily explained by specific treatment components, but more likely due to the fact that these multimodal interventions apply the same underlying treatment principle across a wider range of diagnosed mental disorders, while individualizing treatment components for each patient. These results could suggest that multimodal interventions are best delivered within a transdiagnostic framework. In fact, a growing body of evidence is supporting the use of transdiagnostic interventions for individuals experiencing depression and anxiety symptoms (16, 22, 24).

A final important aspect of the healthcare program evaluated in the current study is that the exercise therapy was delivered by physical therapist, in contrast to most other multimodal interventions where different healthcare professionals usually deliver the exercise interventions. Since physical therapist are movement/somatic experts, they are prime candidates to address the bodily symptoms of depressive and anxiety disorders. To date, a growing body of studies support the use of exercise therapy for depressive (108110) and anxiety disorders (111114), both as mono-intervention and as add-on for CBT (115, 116). However, no evidence exists for the added value of exercise interventions within multimodal interventions for depressive and anxiety disorders. Furthermore, it is unknown whether exercise interventions delivered by physical therapists are superior compared to exercise interventions delivered by other healthcare professionals (108). Only one promising RCT by Bratberg et al. (117) compared physical therapy treatment with standard psychological/psychiatric treatment for patients experiencing mixed anxiety and depression. Results showed superior results for reducing depressive symptoms and improving quality of life in favor of physical therapy at short-term but no differences between both therapies were found at follow-up (117). Future studies should further investigate the added value of physical therapists delivering exercise interventions in depressive and anxiety disorders.

There are a few limitations concerning this study. First, the current study used a descriptive study design (i.e., case series). Internal validity of case series is usually very low, due to the absence of a comparator group. Therefore, it is not possible to conclude with certainty whether the observed effects are due to the healthcare program or other factors (i.e., time effects, etc.). Second, it is not possible to discern whether results reported at the end of phase 3 (i.e., end RPP) are in fact sustained effects of the initial intervention (i.e., phase 2) or only due to the RPP (i.e., phase 3). Third, it was not possible to provide conclusive evidence for the long-term stability of treatment results after the two active intervention phases (i.e., main 20-week intervention and RPP), as the current study did not include a follow-up period after completion of the 12-month RPP (i.e., phase 3). Fourth, reasons for drop-out were not registered in the used database, which is unfortunate since the drop-out rates in the current study are substantial. It is however important to mention that premature discontinuation of phase 2 (i.e., T0 – T2) due to the achievement of treatment goals in an earlier stadium (i.e., before end of phase 2) was also considered a drop-out in the current study. Finally, it is not possible to generalize the results beyond the used study sample despite the large sample size. It is unclear to what extent results can be generalized to patients with comorbid depression and anxiety, since only 13% of patients in the current study were diagnosed with both a depressive and anxiety disorder. In addition, case series are usually also vulnerable to selection bias, which makes generalization more difficult. Strengths of the current study are the use of a realistic study sample of participants with comorbid DSM-5 diagnoses, instead of single DSM-5 diagnoses. The ulilization of real-world data in an effectiveness study and the incorporation of a continuation-phase intervention (i.e., RPP) are other strengths.

The results of the current study are of added value to the existing evidence base consisting of mainly efficacy studies (38, 118124) for the use of these interdisciplinary multimodal interventions for patients suffering from depression and/or anxiety disorders. Moreover, Smeets (125) specifically pleaded for the use of alternative research designs, such as Single Case Replicated Designs (SCED) and observational studies of routinely collected data, in order to add to the existing evidence base mainly consisting of randomized controlled trials, since the clinical applicability of these alternative research designs might be higher. Therefore, the current descriptive study, using routinely collected data of a large patient group, might be of added value to policy makers and/or health insurers in the weighting process whether or not to reimburse interdisciplinary multimodal interventions. This is important since reimbursement and funding of these interdisciplinary multimodal interventions in different patient groups has been under pressure in recent years (125, 126).

Future research should further investigate the use of (blended) continuation-phase interventions in patients with depression and/or anxiety disorders. In addition, more studies are warranted to investigate the long-term stability of treatment results after interdisciplinary multimodal intervention for this patient group. Another important aspect that needs further attention is the added value of physical therapists delivering exercise interventions as compared to other healthcare professionals delivering these interventions for patients with depression and/or anxiety disorders. Finally, also alternative research designs, such as SCED (127), can be used to better capture the idiosyncratic nature of treatment in mental health disorders and to investigate the added value of individual treatment components (i.e., CBT, lifestyle interventions, exercise therapy, etc.) within interdisciplinary multimodal interventions.

In conclusion, the results of the current study are of added value to the existing evidence base for the use of interdisciplinary multimodal interventions for patients with (comorbid) depressive and/or anxiety disorders. In addition, results provide preliminary evidence for the value of using a blended relapse prevention program as continuation-phase intervention.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The current study was reviewed and approved by Medical Ethics Review Committee of Maastricht University Medical Center (MUMC+), P. Debyelaan 25, Postbus 5800, 6202 AZ Maastricht, Attn: METC azM/UM. The patients provided their written informed consent to participate in this study.

Author contributions

JW: conceptualization, methodology, writing – original draft, and project administration. NG: writing—review and editing. GH: writing—review and editing. MP: methodology, formal analysis, data curation, and visualization. MG: methodology, formal analysis, data curation, and visualization. JO: writing—review and editing. JJ: conceptualization and supervision. All authors contributed to the article and approved the submitted version.

Acknowledgments

The authors would like to thank all involved healthcare professionals of ‘PHI’ for collaborating in data collection and all patients for consenting for the use of their data in scientific research. Without the help of patients and healthcare professionals over all locations of ‘PHI’ this manuscript would not have been possible.

Conflict of interest

JW, NG, GH, MP, MG, and JJ are employed by Intergrin Academy. Intergrin Academy evaluates and improves specialized secondary care formats such as offered at ‘PHI’. Intergrin Academy and ‘PHI’ are part of the same overarching organization: Integrative Interventions Group. In addition, JW was a former employee of ‘Het Rughuis’, a mental healthcare facility also part of Integrative Interventions Group.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2023.1113356/full#supplementary-material

References

1. Saloni Dattani, H.R.A.M.R. (2021). Mental health. Published online at our world InData.org. Available at: https://ourworldindata.org/mental-health.

Google Scholar

2. Vos, T, Lim, SS, Abbafati, C, Abbas, KM, Abbasi, M, Abbasifard, M, et al. Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: a systematic analysis for the global burden of disease study 2019. Lancet. (2020) 396:1204–22. doi: 10.1016/S0140-6736(20)30925-9

PubMed Abstract | CrossRef Full Text | Google Scholar

3. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. Wahsington, DC: American Psychiatric Association (2013).

Google Scholar

4. American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-IV. Wahsington, DC: American Psychiatric Association (1994).

Google Scholar

5. Hettema, JM. What is the genetic relationship between anxiety and depression? Am J Med Genet C Semin Med Genet. (2008) 148C:140–6. doi: 10.1002/ajmg.c.30171

CrossRef Full Text | Google Scholar

6. Kendler, K, and Gardner, C. A longitudinal etiologic model for symptoms of anxiety and depression in women. Psychol Med. (2011) 41:2035–45. doi: 10.1017/S0033291711000225

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Poore, HE, Watts, AL, Friedman, HP, and Waldman, ID. A broad internalizing dimension accounts for the genetic associations between personality and individual internalizing disorders. J Psychopathol Clin Sci. (2022) 131:857. doi: 10.1037/abn0000782

PubMed Abstract | CrossRef Full Text | Google Scholar

8. McTeague, LM, Rosenberg, BM, Lopez, JW, Carreon, DM, Huemer, J, Jiang, Y, et al. Identification of common neural circuit disruptions in emotional processing across psychiatric disorders. Am J Psychiatr. (2020) 177:411–21. doi: 10.1176/appi.ajp.2019.18111271

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Ressler, KJ, and Nemeroff, CB. Role of serotonergic and noradrenergic systems in the pathophysiology of depression and anxiety disorders. Depress Anxiety. (2000) 12:2–19. doi: 10.1002/1520-6394(2000)12:1+<2::AID-DA2>3.0.CO;2-4

CrossRef Full Text | Google Scholar

10. Caspi, A, Houts, RM, Belsky, DW, Goldman-Mellor, SJ, Harrington, H, Israel, S, et al. The p factor: one general psychopathology factor in the structure of psychiatric disorders? Clin Psychol Sci. (2014) 2:119–37. doi: 10.1177/2167702613497473

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Selzam, S, Coleman, JR, Caspi, A, Moffitt, TE, and Plomin, R. A polygenic p factor for major psychiatric disorders. Transl Psychiatry. (2018) 8:205. doi: 10.1038/s41398-018-0217-4

CrossRef Full Text | Google Scholar

12. Barlow, DH, Farchione, TJ, Sauer-Zavala, S, Latin, HM, Ellard, KK, Bullis, JR, et al. Unified protocol for transdiagnostic treatment of emotional disorders: Therapist guide. Oxford: Oxford University Press (2017).

Google Scholar

13. Choi, KW, Kim, Y-K, and Jeon, HJ. Comorbid anxiety and depression: clinical and conceptual consideration and transdiagnostic treatment. Adv Exp Med Biol. (2020) 1191:219–35. doi: 10.1007/978-981-32-9705-0_14

CrossRef Full Text | Google Scholar

14. Shevlin, M, Hyland, P, Nolan, E, Owczarek, M, Ben-Ezra, M, and Karatzias, T. ICD-11 ‘mixed depressive and anxiety disorder’is clinical rather than sub-clinical and more common than anxiety and depression in the general population. Br J Clin Psychol. (2022) 61:18–36. doi: 10.1111/bjc.12321

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Dalgleish, T, Black, M, Johnston, D, and Bevan, A. Transdiagnostic approaches to mental health problems: current status and future directions. J Consult Clin Psychol. (2020) 88:179. doi: 10.1037/ccp0000482

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Newby, JM, McKinnon, A, Kuyken, W, Gilbody, S, and Dalgleish, T. Systematic review and meta-analysis of transdiagnostic psychological treatments for anxiety and depressive disorders in adulthood. Clin Psychol Rev. (2015) 40:91–110. doi: 10.1016/j.cpr.2015.06.002

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Buckholtz, JW, and Meyer-Lindenberg, A. Psychopathology and the human connectome: toward a transdiagnostic model of risk for mental illness. Neuron. (2012) 74:990–1004. doi: 10.1016/j.neuron.2012.06.002

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Schaeuffele, C, Schulz, A, Knaevelsrud, C, Renneberg, B, and Boettcher, J. CBT at the crossroads: the rise of transdiagnostic treatments. Int J Cogn Ther. (2021) 14:86–113. doi: 10.1007/s41811-020-00095-2

CrossRef Full Text | Google Scholar

19. Cuthbert, BN. The RDoC framework: facilitating transition from ICD/DSM to dimensional approaches that integrate neuroscience and psychopathology. World Psychiatry. (2014) 13:28–35. doi: 10.1002/wps.20087

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Cuthbert, BN. The role of RDoC in future classification of mental disorders. Dialogues Clin Neurosci. (2022) 22:81–5. doi: 10.31887/DCNS.2020.22.1/bcuthbert

CrossRef Full Text | Google Scholar

21. McEvoy, PM, Nathan, P, and Norton, PJ. Efficacy of transdiagnostic treatments: a review of published outcome studies and future research directions. J Cogn Psychother. (2009) 23:20–33. doi: 10.1891/0889-8391.23.1.20

CrossRef Full Text | Google Scholar

22. Andersen, P, Toner, P, Bland, M, and McMillan, D. Effectiveness of transdiagnostic cognitive behaviour therapy for anxiety and depression in adults: a systematic review and meta-analysis. Behav Cogn Psychother. (2016) 44:673–90. doi: 10.1017/S1352465816000229

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Carlucci, L, Saggino, A, and Balsamo, M. On the efficacy of the unified protocol for transdiagnostic treatment of emotional disorders: a systematic review and meta-analysis. Clin Psychol Rev. (2021) 87:101999. doi: 10.1016/j.cpr.2021.101999

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Pearl, SB, and Norton, PJ. Transdiagnostic versus diagnosis specific cognitive behavioural therapies for anxiety: a meta-analysis. J Anxiety Disord. (2017) 46:11–24. doi: 10.1016/j.janxdis.2016.07.004

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Bandelow, B, Michaelis, S, and Wedekind, D. Treatment of anxiety disorders. Dialogues Clin Neurosci. (2022) 19:93–107. doi: 10.31887/DCNS.2017.19.2/bbandelow

CrossRef Full Text | Google Scholar

26. Bandelow, B, Reitt, M, Röver, C, Michaelis, S, Görlich, Y, and Wedekind, D. Efficacy of treatments for anxiety disorders: a meta-analysis. Int Clin Psychopharmacol. (2015) 30:183–92. doi: 10.1097/YIC.0000000000000078

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Chen, C, and Shan, W. Pharmacological and non-pharmacological treatments for major depressive disorder in adults: a systematic review and network meta-analysis. Psychiatry Res. (2019) 281:112595. doi: 10.1016/j.psychres.2019.112595

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Farah, WH, Alsawas, M, Mainou, M, Alahdab, F, Farah, MH, Ahmed, AT, et al. Non-pharmacological treatment of depression: a systematic review and evidence map. BMJ Evid Based Medicine. (2016) 21:214–21. doi: 10.1136/ebmed-2016-110522

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Gartlehner, G, Wagner, G, Matyas, N, Titscher, V, Greimel, J, Lux, L, et al. Pharmacological and non-pharmacological treatments for major depressive disorder: review of systematic reviews. BMJ Open. (2017) 7:e014912. doi: 10.1136/bmjopen-2016-014912

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Bandelow, B, Michaelis, S, and Wedekind, D. Treatment of anxiety disorders. Dialogues Clin Neurosci. (2017) 19:93. doi: 10.31887/DCNS.2017.19.2/bbandelow

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Fowler, JC, Clapp, JD, Madan, A, Allen, JG, Frueh, BC, and Oldham, JM. An open effectiveness trial of a multimodal inpatient treatment for depression and anxiety among adults with serious mental illness. Psychiatry. (2017) 80:42–54. doi: 10.1080/00332747.2016.1196072

PubMed Abstract | CrossRef Full Text | Google Scholar

32. APA (2015). APA dictionary of psychology [Online]. American Psychological Association. Available at: https://dictionary.apa.org/

Google Scholar

33. Dragioti, E, Evangelou, E, Larsson, B, and Gerdle, B. Effectiveness of multidisciplinary programmes for clinical pain conditions: An umbrella review. J Rehabil Med. (2018, 2018) 50:779–91. doi: 10.2340/16501977-2377

CrossRef Full Text | Google Scholar

34. Gatchel, RJ, McGeary, DD, McGeary, CA, and Lippe, B. Interdisciplinary chronic pain management: past, present, and future. Am Psychol. (2014) 69:119. doi: 10.1037/a0035514

PubMed Abstract | CrossRef Full Text | Google Scholar

35. NICE (2022). Depression in adults: Treatment and management, NICE guideline [NG222]. Available at: https://www.nice.org.uk/guidance/ng.

Google Scholar

36. NICE. Generalised anxiety disorder in adults: Management in primary, secondary and community care. London: British Psychological Society (2011).

Google Scholar

37. NICE (2020). Generalised anxiety disorder and panic disorder in adults: Management (update information). Available at: https://www.nice.org.uk/guidance/cg113/chapter/Update-information.

Google Scholar

38. Dinger, U, Klipsch, O, Köhling, J, Ehrenthal, JC, Nikendei, C, Herzog, W, et al. Day-clinic and inpatient psychotherapy for depression (DIP-D): a randomized controlled pilot study in routine clinical care. Psychother Psychosom. (2014) 83:194. doi: 10.1159/000357437

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Little, SA, Kligler, B, Homel, P, Belisle, SS, and Merrell, W. Multimodal mind/body group therapy for chronic depression: a pilot study. Explore. (2009) 5:330–7. doi: 10.1016/j.explore.2009.08.004

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Hauksson, P, Ingibergsdóttir, S, Gunnarsdóttir, T, and Jónsdóttir, IH. Effectiveness of cognitive behaviour therapy for treatment-resistant depression with psychiatric comorbidity: comparison of individual versus group CBT in an interdisciplinary rehabilitation setting. Nord J Psychiatry. (2017) 71:465–72. doi: 10.1080/08039488.2017.1331263

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Herzog, P, Häusler, S, Normann, C, and Brakemeier, E-L. Negative effects of a multimodal inpatient CBASP program: rate of occurrence and their impact on treatment outcome in chronic and treatment-resistant depression. Front Psych. (2021) 1294:837. doi: 10.3389/fpsyt.2021.575837

CrossRef Full Text | Google Scholar

42. Peters, EM, Neusetzer, M, Akinci, S, Murat, A, Treuherz, S, Rose, M, et al. Multimodal psychotherapeutic inpatient therapy of depression is successful in patients with high cytokine production. Front Psych. (2020) 1158:1636. doi: 10.3389/fpsyt.2020.571636

CrossRef Full Text | Google Scholar

43. Taylor, RW, Coleman, JR, Lawrence, AJ, Strawbridge, R, Zahn, R, and Cleare, AJ. Predicting clinical outcome to specialist multimodal inpatient treatment in patients with treatment resistant depression. J Affect Disord. (2021) 291:188–97. doi: 10.1016/j.jad.2021.04.074

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Wooderson, SC, Fekadu, A, Markopoulou, K, Rane, LJ, Poon, L, Juruena, MF, et al. Long-term symptomatic and functional outcome following an intensive inpatient multidisciplinary intervention for treatment-resistant affective disorders. J Affect Disord. (2014) 166:334–42. doi: 10.1016/j.jad.2014.05.013

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Wooderson, SC, Juruena, MF, Fekadu, A, Commane, C, Donaldson, C, Cowan, M, et al. Prospective evaluation of specialist inpatient treatment for refractory affective disorders. J Affect Disord. (2011) 131:92–103. doi: 10.1016/j.jad.2010.11.002

CrossRef Full Text | Google Scholar

46. Orlemans, J, Eelen, P, and Hermans, D. Inleiding tot de gedragstherapie. Houten: Bohn Stafleu Van Loghum (1995).

Google Scholar

47. Hanley, GP, Iwata, BA, and McCord, BE. Functional analysis of problem behavior: a review. J Appl Behav Anal. (2003) 36:147–85. doi: 10.1901/jaba.2003.36-147

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Melanson, IJ, and Fahmie, TA. Functional analysis of problem behavior: a 40-year review. J Appl Behav Anal. (2023) 56:262–81. doi: 10.1002/jaba.983

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Eckert, PA. Acceleration of change: catalysts in brief therapy. Clin Psychol Rev. (1993) 13:241–53. doi: 10.1016/0272-7358(93)90022-E

CrossRef Full Text | Google Scholar

50. Falkenström, F, Josefsson, A, Berggren, T, and Holmqvist, R. How much therapy is enough? Comparing dose-effect and good-enough models in two different settings. Psychotherapy. (2016) 53:130. doi: 10.1037/pst0000039

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Engel, GL. The need for a new medical model: a challenge for biomedicine. Science. (1977) 196:129–36. doi: 10.1126/science.847460

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Bomhof-Roordink, H, Gärtner, FR, Stiggelbout, AM, and Pieterse, AH. Key components of shared decision making models: a systematic review. BMJ Open. (2019) 9:e031763. doi: 10.1136/bmjopen-2019-031763

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Weiland, A, Van de Kraats, RE, Blankenstein, AH, Van Saase, JL, Van der Molen, HT, Bramer, WM, et al. Encounters between medical specialists and patients with medically unexplained physical symptoms; influences of communication on patient outcomes and use of health care: a literature overview. Pers Med Educ. (2012) 1:192–206. doi: 10.1007/s40037-012-0025-0

CrossRef Full Text | Google Scholar

54. Davidson, L, O'Connell, MJ, Tondora, J, Lawless, M, and Evans, AC. Recovery in serious mental illness: a new wine or just a new bottle? Prof Psychol Res Pract. (2005) 36:480. doi: 10.1037/0735-7028.36.5.480

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Davidson, L, Rowe, M, DiLeo, P, Bellamy, C, and Delphin-Rittmon, M. Recovery-oriented systems of care: a perspective on the past, present, and future. Alcohol Res. (2021) 41:9. doi: 10.35946/arcr.v41.1.09

PubMed Abstract | CrossRef Full Text | Google Scholar

56. DHHS (2003). Achieving the promise: Transforming mental health care in America. President's New Freedom Commission on Mental Health.

Google Scholar

57. Huber, M, Knottnerus, JA, Green, L, Van Der Horst, H, Jadad, AR, Kromhout, D, et al. How should we define health? BMJ. (2011) 343:4163. doi: 10.1136/bmj.d4163

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Scott, J, Palmer, S, Paykel, E, Teasdale, J, and Hayhurst, H. Use of cognitive therapy for relapse prevention in chronic depression: cost-effectiveness study. Br J Psychiatry. (2003) 182:221–7. doi: 10.1192/bjp.182.3.221

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Wojnarowski, C, Firth, N, Finegan, M, and Delgadillo, J. Predictors of depression relapse and recurrence after cognitive behavioural therapy: a systematic review and meta-analysis. Behav Cogn Psychother. (2019) 47:514–29. doi: 10.1017/S1352465819000080

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Erbe, D, Eichert, H-C, Riper, H, and Ebert, DD. Blending face-to-face and internet-based interventions for the treatment of mental disorders in adults: systematic review. J Med Internet Res. (2017) 19:e306. doi: 10.2196/jmir.6588

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Nielson, WR, Jensen, MP, Karsdorp, PA, and Vlaeyen, JW. Activity pacing in chronic pain: concepts, evidence, and future directions. Clin J Pain. (2013) 29:461–8. doi: 10.1097/AJP.0b013e3182608561

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Spaans, J, Veselka, L, Luyten, P, and Bühring, M. Lichamelijke aspecten van mentalisatie; therapeutische focus bij ernstige onverklaarde lichamelijke klachten. Tijdschr Psychiatr. (2009) 51:239–48.

PubMed Abstract | Google Scholar

63. Van der Zee, K, and Sanderman, R. RAND-36. Groningen: Northern Centre for Health Care Research, vol. 28. the Netherlands: University of Groningen (1993).

Google Scholar

64. Ware, JE, Keller, SD, and Kosinski, M. SF-36: physical and mental health summary scales: a user's manual. Health Assessment Lab. Boston: Health Institute, New England Medical Center (1994).

Google Scholar

65. Vander Zee, KI, Sanderman, R, Heyink, JW, and de Haes, H. Psychometric qualities of the RAND 36-item health survey 1.0: a multidimensional measure of general health status. Int J Behav Med. (1996) 3:104–22. doi: 10.1207/s15327558ijbm0302_2

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Aaronson, NK, Muller, M, Cohen, PD, Essink-Bot, M-L, Fekkes, M, Sanderman, R, et al. Translation, validation, and norming of the Dutch language version of the SF-36 health survey in community and chronic disease populations. J Clin Epidemiol. (1998) 51:1055–68. doi: 10.1016/S0895-4356(98)00097-3

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Hays, RD, Sherbourne, CD, and Mazel, RM. The rand 36-item health survey 1.0. Health Econ. (1993) 2:217–27. doi: 10.1002/hec.4730020305

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Årdal, G, Lund, A, and Hammar, Å. Health-related quality of life in recurrent major depressive disorder—a 10-year follow-up study. Nord J Psychiatry. (2013) 67:339–43. doi: 10.3109/08039488.2012.746730

CrossRef Full Text | Google Scholar

69. Ten Doesschate, MC, Koeter, MW, Bockting, CL, and Schene, AH, Group, D.S. Health related quality of life in recurrent depression: a comparison with a general population sample. J Affect Disord. (2010) 120:126–32. doi: 10.1016/j.jad.2009.04.026

PubMed Abstract | CrossRef Full Text | Google Scholar

70. De Beurs, E, and Zitman, F. De brief symptom inventory (BSI): De betrouwbaarheid en validiteit van een handzaam alternatief voor de SCL-90. Maandblad Geestelijke Volksgezondheid. (2005) 61:120–41.

Google Scholar

71. Arrindell, W, and Ettema, J. Manual for a multidimensional psychopathology indicator SCL-90. Lisse: Swets & Zeitlinger/SwetsTest Publishers (1986).

Google Scholar

72. Arrindell, W, and Ettema, J. SCL-90: Manual to a multidimensional psychopathologyindicator [SCL-90: Handleiding bij een multidimensionele psychopathologieindicator]. London: Pearson (2003).

Google Scholar

73. Derogatis, L. Brief symptom inventory (BSI): Administration, scoring, and procedures manual. 4th ed. Minneapolis: NCS Pearson". Inc (1993).

Google Scholar

74. Derogatis, LR. Symptom checklist-90-revised, brief symptom inventory, and BSI-18 In: ME Maruish, editor. Handbook of psychological assessment in primary care settings. Milton Park: Routledge/Taylor & Francis Group (2017). 599–629.

Google Scholar

75. Amenson, CS, and Lewinsohn, PM. An investigation into the observed sex difference in prevalence of unipolar depression. J Abnorm Psychol. (1981) 90:1. doi: 10.1037/0021-843X.90.1.1

PubMed Abstract | CrossRef Full Text | Google Scholar

76. Derogatis, LR, and Melisaratos, N. The brief symptom inventory: an introductory report. Psychol Med. (1983) 13:595–605. doi: 10.1017/S0033291700048017

PubMed Abstract | CrossRef Full Text | Google Scholar

77. Derogotis, L. BSI-18: Administration, scoring, and procedures manual. Minneapolis, MN: National Computer Systems (2000).

Google Scholar

78. Kremer, EF, Atkinson, JH Jr, and Ignelzi, RJ. Pain measurement: the affective dimensional measure of the McGill pain questionnaire with a cancer pain population. Pain. (1982) 12:153–63. doi: 10.1016/0304-3959(82)90191-9

PubMed Abstract | CrossRef Full Text | Google Scholar

79. Recklitis, CJ, Parsons, SK, Shih, M-C, Mertens, A, Robison, LL, and Zeltzer, L. Factor structure of the brief symptom inventory--18 in adult survivors of childhood cancer: results from the childhood cancer survivor study. Psychol Assess. (2006) 18:22. doi: 10.1037/1040-3590.18.1.22

PubMed Abstract | CrossRef Full Text | Google Scholar

80. de Beurs, E, Van Dyck, R, Marquenie, L, Lange, A, and Blonk, R. De DASS: een vragenlijst voor het meten van depressie, angst en stress. Gedragstherapie. (2001) 34:35–54.

Google Scholar

81. Lovibond, PF, and Lovibond, SH. The structure of negative emotional states: comparison of the depression anxiety stress scales (DASS) with the Beck depression and anxiety inventories. Behav Res Ther. (1995) 33:335–43. doi: 10.1016/0005-7967(94)00075-U

PubMed Abstract | CrossRef Full Text | Google Scholar

82. Lovibond, SH, and Lovibond, PF. Manual for the depression anxiety stress scales. Sydney: Psychology Foundation of Australia (1996).

Google Scholar

83. Antony, MM, Bieling, PJ, Cox, BJ, Enns, MW, and Swinson, RP. Psychometric properties of the 42-item and 21-item versions of the depression anxiety stress scales in clinical groups and a community sample. Psychol Assess. (1998) 10:176. doi: 10.1037/1040-3590.10.2.176

CrossRef Full Text | Google Scholar

84. Brown, TA, Chorpita, BF, Korotitsch, W, and Barlow, DH. Psychometric properties of the depression anxiety stress scales (DASS) in clinical samples. Behav Res Ther. (1997) 35:79–89. doi: 10.1016/S0005-7967(96)00068-X

PubMed Abstract | CrossRef Full Text | Google Scholar

85. Page, AC, Hooke, GR, and Morrison, DL. Psychometric properties of the depression anxiety stress scales (DASS) in depressed clinical samples. Br J Clin Psychol. (2007) 46:283–97. doi: 10.1348/014466506X158996

PubMed Abstract | CrossRef Full Text | Google Scholar

86. Wardenaar, KJ, Wanders, RB, Jeronimus, BF, and de Jonge, P. The psychometric properties of an internet-administered version of the depression anxiety and stress scales (DASS) in a sample of Dutch adults. J Psychopathol Behav Assess. (2018) 40:318–33. doi: 10.1007/s10862-017-9626-6

PubMed Abstract | CrossRef Full Text | Google Scholar

87. Crawford, JR, and Henry, JD. The depression anxiety stress scales (DASS): normative data and latent structure in a large non-clinical sample. Br J Clin Psychol. (2003) 42:111–31. doi: 10.1348/014466503321903544

CrossRef Full Text | Google Scholar

88. Seabold, S., and Perktold, J. (2010). "Statsmodels: econometric and statistical modeling with python", in: Proceedings of the 9th Python in science conference: Austin, TX, 61.

Google Scholar

89. Virtanen, P, Gommers, R, Oliphant, TE, Haberland, M, Reddy, T, Cournapeau, D, et al. Sci Py 1.0: fundamental algorithms for scientific computing in Python. Nat Methods. (2020) 17:261–72. doi: 10.1038/s41592-019-0686-2

PubMed Abstract | CrossRef Full Text | Google Scholar

90. D'agostino, R, and Pearson, ES. Tests for departure from normality. Empirical results for the distributions of b 2 and√ b. Biometrika. (1973) 60:613–22. doi: 10.1093/biomet/60.3.613

CrossRef Full Text | Google Scholar

91. d'Agostino, RB. An omnibus test of normality for moderate and large size samples. Biometrika. (1971) 58:341–8. doi: 10.1093/biomet/58.2.341

CrossRef Full Text | Google Scholar

92. Lindstrom, MJ, and Bates, DM. Newton—Raphson and EM algorithms for linear mixed-effects models for repeated-measures data. J Am Stat Assoc. (1988) 83:1014–22. doi: 10.1080/01621459.1988.10478693

CrossRef Full Text | Google Scholar

93. Bonferroni, C. Teoria statistica delle classi e calcolo delle probabilita. Pubblicazioni del R Istituto Superiore di Scienze Econ Commer Firenze. (1936) 8:3–62.

Google Scholar

94. Student. The probable error of a mean. Biometrika. (1908) 1–25. doi: 10.2307/2331554

CrossRef Full Text | Google Scholar

95. Wilcoxon, F. “Individual comparisons by ranking methods,” in Breakthroughs in statistics. Berlin: Springer (1992) 196–202.

Google Scholar

96. Cohen, J. Statistical power analysis for the behavioral sciences. Abingdon: Routledge (2013).

Google Scholar

97. Cohen, J. (1988). Statistical power analysis for the behavioral sciences Lawrence Earlbaum associates.

Google Scholar

98. Sawilowsky, SS. New effect size rules of thumb. J Mod Appl Stat Methods. (2009) 8:26. doi: 10.22237/jmasm/1257035100

CrossRef Full Text | Google Scholar

99. Norman, GR, Sloan, JA, and Wyrwich, KW. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care. (2003):582–92. doi: 10.1097/01.MLR.0000062554.74615.4C

CrossRef Full Text | Google Scholar

100. Wijnen, J, van‘t Hullenaar, G, Gordon, N, Pont, ML, Geijselaers, MWHG, Van Oosterwijck, J, et al. An interdisciplinary multimodal integrative healthcare program for somatic symptom disorder, with predominant (spinal) pain. Psychother Res. (2022) 33:1–14. doi: 10.1080/10503307.2022.2144528

CrossRef Full Text | Google Scholar

101. De Beurs, E. Brief symptom inventory 18-BSI 18-Handleiding herziene editie. Leiden: PITS BV (2011).

Google Scholar

102. de Beurs, E, Oudejans, S, and Terluin, B. A common measurement scale for scores from self-report instruments in mental health care: T scores with a normal distribution. Eur J Psychol Assess. (2022). doi: 10.1027/1015-5759/a000740

CrossRef Full Text | Google Scholar

103. Paykel, E. Partial remission, residual symptoms, and relapse in depression. Dialogues Clin Neurosci. (2022) 10:431–7. doi: 10.31887/DCNS.2008.10.4/espaykel

CrossRef Full Text | Google Scholar

104. Paykel, ES. Cognitive therapy in relapse prevention in depression. Int J Neuropsychopharmacol. (2007) 10:131–6. doi: 10.1017/S1461145706006912

CrossRef Full Text | Google Scholar

105. Levy, HC, O’Bryan, EM, and Tolin, DF. A meta-analysis of relapse rates in cognitive-behavioral therapy for anxiety disorders. J Anxiety Disord. (2021) 81:102407. doi: 10.1016/j.janxdis.2021.102407

PubMed Abstract | CrossRef Full Text | Google Scholar

106. Van Dis, EA, Van Veen, SC, Hagenaars, MA, Batelaan, NM, Bockting, CL, Van Den Heuvel, RM, et al. Long-term outcomes of cognitive behavioral therapy for anxiety-related disorders: a systematic review and meta-analysis. JAMA Psychiat. (2020) 77:265–73. doi: 10.1001/jamapsychiatry.2019.3986

PubMed Abstract | CrossRef Full Text | Google Scholar

107. Hennemann, S, Farnsteiner, S, and Sander, L. Internet-and mobile-based aftercare and relapse prevention in mental disorders: a systematic review and recommendations for future research. Internet Interv. (2018) 14:1–17. doi: 10.1016/j.invent.2018.09.001

PubMed Abstract | CrossRef Full Text | Google Scholar

108. Davis, ME, and McGrane, N. Exercise as a treatment for clinical depression in adults and progressing the physiotherapists role: a systematic review and meta-analysis. Physiother Pract Res. (2021) 1-14:512. doi: 10.3233/PPR-210512

CrossRef Full Text | Google Scholar

109. Kvam, S, Kleppe, CL, Nordhus, IH, and Hovland, A. Exercise as a treatment for depression: a meta-analysis. J Affect Disord. (2016) 202:67–86. doi: 10.1016/j.jad.2016.03.063

PubMed Abstract | CrossRef Full Text | Google Scholar

110. Stathopoulou, G, Powers, MB, Berry, AC, Smits, JA, and Otto, MW. Exercise interventions for mental health: a quantitative and qualitative review. Clin Psychol Sci Pract. (2006) 13:179. doi: 10.1111/j.1468-2850.2006.00021.x

CrossRef Full Text | Google Scholar

111. Bartley, CA, Hay, M, and Bloch, MH. Meta-analysis: aerobic exercise for the treatment of anxiety disorders. Prog Neuro Psychopharmacol Biol Psychiatry. (2013) 45:34–9. doi: 10.1016/j.pnpbp.2013.04.016

PubMed Abstract | CrossRef Full Text | Google Scholar

112. Jayakody, K, Gunadasa, S, and Hosker, C. Exercise for anxiety disorders: systematic review. Br J Sports Med. (2014) 48:187–96. doi: 10.1136/bjsports-2012-091287

PubMed Abstract | CrossRef Full Text | Google Scholar

113. Stonerock, GL, Hoffman, BM, Smith, PJ, and Blumenthal, JA. Exercise as treatment for anxiety: systematic review and analysis. Ann Behav Med. (2015) 49:542–56. doi: 10.1007/s12160-014-9685-9

PubMed Abstract | CrossRef Full Text | Google Scholar

114. Stubbs, B, Vancampfort, D, Rosenbaum, S, Firth, J, Cosco, T, Veronese, N, et al. An examination of the anxiolytic effects of exercise for people with anxiety and stress-related disorders: a meta-analysis. Psychiatry Res. (2017) 249:102–8. doi: 10.1016/j.psychres.2016.12.020

PubMed Abstract | CrossRef Full Text | Google Scholar

115. Frederiksen, KP, Stavestrand, SH, Venemyr, SK, Sirevåg, K, and Hovland, A. Physical exercise as an add-on treatment to cognitive behavioural therapy for anxiety: a systematic review. Behav Cogn Psychother. (2021) 1-15:126. doi: 10.1017/S1352465821000126

CrossRef Full Text | Google Scholar

116. Smith, PJ, and Merwin, RM. The role of exercise in management of mental health disorders: an integrative review. Annu Rev Med. (2021) 72:45–62. doi: 10.1146/annurev-med-060619-022943

PubMed Abstract | CrossRef Full Text | Google Scholar

117. Bratberg, G, Leira, K, Granan, L-P, Jonsbu, E, Fadnes, BL, Thuland, SF, et al. Learning oriented physiotherapy (LOP) in anxiety and depression: an 18 months multicentre randomised controlled trial (RCT). Eur J Phys. (2021) 23:295–304. doi: 10.1080/21679169.2020.1739747

CrossRef Full Text | Google Scholar

118. Chien, HC, Chung, YC, Yeh, ML, and Lee, JF. Breathing exercise combined with cognitive behavioural intervention improves sleep quality and heart rate variability in major depression. J Clin Nurs. (2015) 24:3206–14. doi: 10.1111/jocn.12972

PubMed Abstract | CrossRef Full Text | Google Scholar

119. Conradi, HJ, de Jonge, P, Kluiter, H, Smit, A, Jenner, JA, Emmelkamp, PM, et al. Enhanced treatment for depression in primary care: long-term outcomes of a psycho-educational prevention program alone and enriched with psychiatric consultation or cognitive behavioral therapy. Psychol Med. (2007) 37:849–62. doi: 10.1017/S0033291706009809

PubMed Abstract | CrossRef Full Text | Google Scholar

120. de Roten, Y, Ambresin, G, Herrera, F, Fassassi, S, Fournier, N, Preisig, M, et al. Efficacy of an adjunctive brief psychodynamic psychotherapy to usual inpatient treatment of depression: results of a randomized controlled trial. J Affect Disord. (2017) 209:105–13. doi: 10.1016/j.jad.2016.11.013

PubMed Abstract | CrossRef Full Text | Google Scholar

121. Erkkilä, J, Punkanen, M, Fachner, J, Ala-Ruona, E, Pöntiö, I, Tervaniemi, M, et al. Individual music therapy for depression: randomised controlled trial. Br J Psychiatry. (2011) 199:132–9. doi: 10.1192/bjp.bp.110.085431

PubMed Abstract | CrossRef Full Text | Google Scholar

122. Imboden, C, Gerber, M, Beck, J, Holsboer-Trachsler, E, Pühse, U, and Hatzinger, M. Aerobic exercise or stretching as add-on to inpatient treatment of depression: similar antidepressant effects on depressive symptoms and larger effects on working memory for aerobic exercise alone. J Affect Disord. (2020) 276:866–76. doi: 10.1016/j.jad.2020.07.052

PubMed Abstract | CrossRef Full Text | Google Scholar

123. Lemmens, GM, Eisler, I, Buysse, A, Heene, E, and Demyttenaere, K. The effects on mood of adjunctive single-family and multi-family group therapy in the treatment of hospitalized patients with major depression. Psychother Psychosom. (2009) 78:98–105. doi: 10.1159/000201935

PubMed Abstract | CrossRef Full Text | Google Scholar

124. Murray, G, Michalak, EE, Axler, A, Yaxley, D, Hayashi, B, Westrin, Å, et al. Relief of chronic or resistant depression (re-ChORD): a pragmatic, randomized, open-treatment trial of an integrative program intervention for chronic depression. J Affect Disord. (2010) 123:243–8. doi: 10.1016/j.jad.2009.10.015

PubMed Abstract | CrossRef Full Text | Google Scholar

125. Smeets, RJ. How to sustain and improve client centred (matched) care in chronic musculoskeletal pain? Start by changing the way policy makers select and judge the large amount of available data, and get rid of the dogma of stepped care. Abingdon: Taylor & Francis (2021).

Google Scholar

126. Nahin, RL. Use of multimodal multidisciplinary pain management in the US. JAMA Netw Open. (2022) 5:e2240620–14. doi: 10.1001/jamanetworkopen.2022.40620

PubMed Abstract | CrossRef Full Text | Google Scholar

127. Eccleston, C, and Crombez, G. Advancing psychological therapies for chronic pain. F1000Research. (2017) 6:10612. doi: 10.12688/f1000research.10612.1

PubMed Abstract | CrossRef Full Text | Google Scholar

GLOSSARY

Keywords: depression, anxiety, multimodal intervention, behavioral therapy, interdisciplinary, transdiagnostic, psychosomatic

Citation: Wijnen J, Gordon NL, van 't Hullenaar G, Pont ML, Geijselaers MWH, Van Oosterwijck J and de Jong J (2023) An interdisciplinary multimodal integrative healthcare program for depressive and anxiety disorders. Front. Psychiatry. 14:1113356. doi: 10.3389/fpsyt.2023.1113356

Received: 01 December 2022; Accepted: 05 June 2023;
Published: 23 June 2023.

Edited by:

Veena Kumari, Brunel University London, United Kingdom

Reviewed by:

Mohsen Khosravi, Zahedan University of Medical Sciences, Iran
Meenakshi Shukla, Allahabad University, India

Copyright © 2023 Wijnen, Gordon, van 't Hullenaar, Pont, Geijselaers, Van Oosterwijck and de Jong. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jaap Wijnen, jaap.wijnen@intergrin.nl

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.