Skip to main content

CLINICAL TRIAL article

Front. Psychiatry, 10 May 2024
Sec. Psychological Therapy and Psychosomatics
This article is part of the Research Topic Women in Psychiatry 2023: Psychological Therapies View all 4 articles

Clinical effectiveness of internet-based cognitive behavioral therapy for insomnia in routine secondary care: results of a randomized controlled trial

Polina Pchelina*Polina Pchelina1*Mikhail PoluektovMikhail Poluektov1Tobias KriegerTobias Krieger2Simone B. DussSimone B. Duss3Thomas BergerThomas Berger2
  • 1Department of Neurology and Neurosurgery, I.M. Sechenov First Moscow State Medical University, Moscow, Russia
  • 2Department of Clinical Psychology and Psychotherapy, Institute of Psychology, University of Bern, Bern, Switzerland
  • 3Interdisciplinary Sleep-Wake-Epilepsy-Center and Swiss Sleep House Bern, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland

Introduction: Delivering cognitive behavioral therapy for insomnia over the internet bears the advantage of accessibility and uptake to many patients suffering from chronic insomnia. In the current study, we aimed to investigate the effectiveness of internet-based cognitive behavioral therapy for insomnia (iCBT-I) in routine care.

Materials and methods: We conducted a two-arm non-blinded randomized controlled trial with care as usual (CAU) as a control condition. Participants were recruited in a specialized outpatient sleep medicine department. Both arms had access to other healthcare resources, and the intervention group had access to the iCBT-I program for 2 months. The primary outcome was insomnia severity, measured by the Insomnia Severity Index (ISI). Secondary outcomes were fatigue severity, daytime sleepiness, affective symptoms, dysfunctional beliefs and attitudes about sleep, sleep locus of control, sleep hygiene, sleep efficiency (SE), sleep onset latency, wake time after sleep onset (WASO), and total sleep time (TST). Linear mixed models for repeated measures were used to analyze the longitudinal data at baseline, post-treatment, and after 3 months of follow-up. The trial was registered at www.clinicaltrials.gov (NCT04300218 21.04.2020).

Results: The results showed a significant time*group interaction effect (p = 0.001) at post-treatment with between-group effect size (d = 0.51), indicating that the ISI decreased by a score of 3.8-fold in the iCBT-I group than in the CAU group. There was no significant difference in ISI between groups at follow-up. Regarding secondary outcomes, dysfunctional beliefs about sleep, SE, and WASO decreased significantly during treatment in the intervention group with between-group effect sizes d = 0.35, d = 0.51, and d = 0.47, respectively. At the follow-up, between-group effects on DBAS and SE remained significant: d = 0.36 and d = 0.63, respectively. For TST, we observed a significant time*group effect of d = 0.38 only after follow-up.

Conclusion: Our findings suggest that iCBT-I has a significant effect on insomnia severity at post-treatment compared to CAU. iCBT-I further improved dysfunctional beliefs about sleep and improved subjective sleep characteristics, such as SE, WASO, and TST during 3 months after treatment.

Clinical trial registration: www.clinicaltrials.gov, identifier (NCT04300218).

1 Introduction

Chronic insomnia (CI) is the most common sleep disorder that affects 10% of the global population (1, 2). This disorder is characterized by both night and daytime symptoms and can affect an individual’s physical, emotional, and cognitive wellbeing and impact their social functioning, and work productivity (3). Moreover, insomnia is associated with other socially significant diseases: cardiovascular and metabolic diseases, depression, and anxiety, and can be integrated into their models of pathogenesis (48). Cognitive behavioral therapy for insomnia (CBT-I) has emerged as the gold standard for treating CI, which is supported by international recommendations (911). It is a non-pharmacological, multicomponent approach that aims to modify dysfunctional sleep-related behavior and thinking patterns by means of cognitive and behavioral techniques. Although CBT-I is highly effective, there is limited access to specialized clinicians (1214).

Internet-based cognitive behavioral therapy for insomnia (iCBT-I) has the potential to overcome these barriers (15). In this approach, the CBT-I sleep interventions are delivered to the patients through smartphone applications and online platforms, enabling greater accessibility and convenience. Prior studies have demonstrated the effectiveness of iCBT-I in improving sleep outcomes in research settings, in which participants were recruited via advertisements, online postings, and flyers and interviewed online or via telephone (1618). However, current findings may not be generalizable to patients in routine practice, for example, due to the higher heterogeneity of patients in routine care than in research samples. Understanding iCBT-I effects in clinical settings would also help to determine its place in a stepped-care model of CBT-I delivery (19). The stepped-care model is a healthcare approach providing insomnia patients with access to the various formats of CBT-I, which currently place iCBT-I at the bottom at a preclinical level (20). The only study examining iCBT-I in a routine care setting was published by Sato et al. and was conducted at an outpatient clinic focusing on the effectiveness of iCBT-I as an adjunct to usual care in insomnia patients who remained symptomatic after pharmacotherapy. Even in this treatment-resistant sample, iCBT-I significantly improved sleep quality and subjective sleep characteristics (21). However, the question about the applicability of iCBT-I in a routine clinical population remains open. Thus, the primary aim of the study was to evaluate the clinical effectiveness of the program of the internet-based cognitive behavioral therapy for insomnia “Sleepsy” (iCBT-I) in comparison with care as usual (CAU) among patients with CI recruited from clinical settings. As a secondary aim, we evaluated the effectiveness of this program regarding affective and wellbeing symptoms, subjective sleep characteristics, sleep-related behavior, and beliefs.

2 Materials and methods

This was a parallel-group add-on superiority randomized controlled trial comparing an active treatment condition (iCBT-I plus CAU) to CAU alone. Interventions in CAU could be assigned within the first visit to a referring doctor or at any point of the study on the next doctor visit. Thus, participants in both groups had access to any other healthcare resources at all forms and levels of healthcare, including other forms of CBT-I during their study participation. A choice in favor of CAU as a control condition was made to (1) reproduce clinical settings and evaluate the superiority of the investigated method over routine care; and (2) to overcome ethical problems that arise when a patient with insomnia receives no treatment (22). The disadvantage of this approach is the narrowing of differences in outcome between groups, which could result in a loss of power to detect a meaningful difference (22, 23).

Inclusion criteria were age between 18 and 80 years, fulfilling the criteria of CI according to the International Classification of Sleep Disorders-3 (ICSD-3), the ability to follow the procedures of the study, fluent in Russian language, and having access to stable internet that we assessed during the first visit with the semi-structured interview elaborated for this study. Patients were excluded if they had severe depressive or anxiety symptoms or were earlier diagnosed with psychiatric comorbidities other than depression and anxiety, and if they had other sleep, neurological, or somatic disorders affecting night sleep. The presence and severity of depressive or anxiety symptoms were assessed with the Beck Anxiety Inventory (BAI), the Beck Depression Inventory-II (BDI), and other exclusion criteria, with the semi-structured interview during the first visit. After considering inclusion and non-inclusion criteria and signing the informed consent form, the participants were registered on the Qualtrics Survey platform by the study personnel and received their individual allocation code. On completion of baseline measures, subjects were automatically assigned by the randomization function of the Qualtrics Survey Software using single block randomization with a 1:1 allocation ratio to either the iCBT-I + CAU or the CAU group. Neither the participants nor the referring specialist nor the research team have foreknowledge and/or control over randomization and the allocation procedure. The participants were stratified by the clinical center to avoid a situation when participants from one regional center were allocated to the same group. Neither participants nor the study personnel were blind to treatment allocation and randomization outcomes. The detailed protocol of the study recruitment, inclusion and exclusion criteria, intervention description, and outcomes have been previously reported (24). The trial was registered at www.clinicaltrials.gov (NCT04300218) and was approved by the local ethics committee of the I.M. Sechenov Moscow Medical University (No. 03-20/19.02.2020).

The internet-based intervention was an 8-week guided iCBT-I program. The program consisted of a sleep diary and eight 10- to 15-min video lectures about homeostatic and circadian mechanisms of human sleep regulation, pathogenesis of CI, and its daytime consequences. Every next video lecture became available given that participants submitted at least two sleep diary entries during the preceding week. Video lectures provide the rationale for the psychoeducational, behavioral (bedtime restriction, stimulus control, and relaxation), and cognitive (cognitive restructuring) techniques. Within the sleep restriction technique, the patients were recommended to reduce time in bed to average self-reported sleep time over 1 week of sleep diary plus 30 min, with a minimum of 6 h and getting up at the same time every day, regardless of sleep duration. If the sleep diary indicated a sleep efficiency (SE) of 85% or higher for the previous week, the participant will be encouraged to add 15 min to the sleep window. If it did not reach 85%, the recommended sleep window was decreased based on the preferred wake-up time and average total sleep time (TST) over the period of observation. If the SE fell between 80% and 85%, the sleep window remained stable. In accordance with the stimulus control technique, participants were recommended not to go to bed unless sleepy and to not stay in bed unless asleep within 20 min. Within the relaxation techniques module, the participants were offered to try the progressive muscle relaxation autotraining for 30 min before bedtime. The cognitive techniques include dysfunctional belief restructuring (e.g., targeting unrealistic beliefs about sleep and the consequences of sleep loss).

The patients independently familiarized themselves with all the materials. They received feedback about their progress in sleep statistics over time from an expert in sleep medicine weekly via email, and were encouraged to consult her if they faced questions on how to adjust CBT-I techniques to their situations. Assessments were made at weeks 0 (t0, baseline), week 8 (t1, post-treatment), and week 20 (t2, follow-up) for both groups. The control group participants who completed the follow-up assessment were subsequently offered the iCBT-I program and assessed additionally after completion of the program at week 28 (t3, post-treatment control group). In the current analysis, we used data at the time points t0, t1, and t2. The participant flowchart is presented in Figure 1.

Figure 1
www.frontiersin.org

Figure 1 Participant flowchart. iCBT-I, internet-based cognitive behavioral therapy for insomnia; CAU, care as usual group.

2.1 Participants

In total, 115 patients with CI fulfilling ICSD-3 criteria referred by neurologists specialized in sleep medicine in study clinical centers—Sleep Medicine Department, University Clinic 3, Sechenov First Moscow State Medical University, Moscow (n = 109) accepting patients from Moscow and other regions of the country; Stavropol Regional Clinical Sleep Center (n = 3); and Kuzbass Clinical Hospital for veterans (n = 3)—from March 2020 to December 2022 were assessed for eligibility. Eight patients were excluded due to the following reasons: comorbid sleep disorders (severe obstructive sleep apnea syndrome, poor internet knowledge, and exceeding the cutoff score of the BAI and BDI). The remaining 107 patients were considered eligible and signed an informed consent form. Since one part of the recruitment phase was conducted during the pandemic restrictions, some patients of the clinic were not able to see a doctor in person and were recruited through clinical interviews by phone. In both the in-clinic and phone interview insomnia criteria, concomitant sleep, psychiatric diseases, skills in using the internet, BAI, and BDI scores were assessed and used to check inclusion and exclusion criteria. The informed consent forms in these cases were signed by the participant and a researcher and sent by mail.

2.2 Primary and secondary outcomes

The primary outcome of the present study was the severity of insomnia measured with the Insomnia Severity Index (ISI) yielding a total score ranging from 0 (no insomnia) to 28 (severe insomnia). This is an assessment tool that examines both the nighttime and daytime aspects of insomnia disorder and is sensitive to insomnia severity change after CBT-I (2527). Anxiety and depressive symptoms were assessed with the BAI and the BDI (2830), comprising 21 questions and yielding a total score ranging from 0 to 63. A BAI total score higher than 25 corresponds to severe anxiety, and a BDI cutoff higher than 28 indicates severe depression. The health-related quality of life was measured by Short-Form Survey (SF-12) version 1.0 where higher scores indicate better health quality (31, 32). Common daytime symptoms of insomnia represented by the sense of fatigue and sleepiness were assessed with the Fatigue Severity Scale (FSS) (33) and Epworth Sleepiness Scale (ESS) (34) with higher scores indicating greater manifestation of the symptoms. Perpetuating factors of insomnia reflected in sleep habits and sleep-related beliefs were evaluated by the Sleep Hygiene Index (SHI) (35), Sleep Locus of Control Questionnaire (SLC) (27, 36), and Dysfunctional Beliefs and Attitudes About Sleep Scale (DBAS) (27, 37) accordingly. A high score on the questionnaires corresponds to a greater intensity of the factor. Forward and backward translation for the questionnaires was conducted if their validated version in Russian was not available.

Week average subjective sleep characteristics were derived from the consensus sleep diary capturing SE, TST, sleep onset latency (SOL), wake time after sleep onset (WASO), number of awakenings, and sleep quality (38). Two or more completed sleep diaries in a given week were required for the calculation of the weekly average subjective sleep characteristics; otherwise, the average subjective sleep parameters were set to missing for that particular week. Participants were filling in all the questionnaires and sleep diaries online at the Qualtrics Survey platform under their individual code. They received automatic reminders about the assessment every week for 1 month until they had completed the assessment. Adherence to the iCBT-I program was evaluated by the number of completed modules, the number of completed sleep diaries in the iCBT-I program, and the number of emails sent to the iCBT-I specialist during the program (excluding the emails about technical issues with the program). Participants were encouraged to ask questions and discuss arising problems in response emails; thus, the number of emails was not limited. Owing to technical reasons, it was not possible to evaluate such parameters as total time spent on the website, time spent on each module, and number of clicks.

2.3 Statistical analysis

To ensure 95% power to detect a small to medium between-group effect size (Cohen’s d) of 0.35 at post-treatment at an α level of 0.05, we calculated the sample size needed using a single-level repeated-measures ANOVA power analysis with G*Power (39), and our calculation yielded 55 participants per group and 110 for the total sample. The chosen effect size is reasonable since CAU being an active alternative treatment could decrease between-group outcome differences and a smaller effect size was considered to be irrelevant from a clinical point of view (16).

Linear mixed models in R were used to analyze the longitudinal data of the primary and secondary outcome measures at baseline, post-treatment, and after 3 months of follow-up. The approach of linear mixed models uses all available data of every subject without substituting missing values. Two models for the primary outcome were tested: (1) a base model testing the change of insomnia severity in all individuals across the three measurement time points; (2) the addition into the base model of the time*group interaction term (time*group) that shows the variability of the effect of time depending on the group. The models were tested using Akaike/Bayesian Information Criteria to select an optimal one. The best fit was for the model ISI_tg < −lmer (ISI ~ time*group + (1 | ID)) that included a time*group interaction term. The (1 | ID) term specifies that the intercept of the model varies randomly across individuals (ID), which assumes a random intercept model. In the final models, missing data were estimated using restricted maximum likelihood estimation. Within-group changes in outcome scores from posttreatment to follow-up were analyzed for the active condition. This was done with another mixed-effects model that included all time points and the respective outcome measure as the independent variable. Within- and between-group effect sizes (ds) were calculated based on estimated means from the mixed models using the following formula:

d= x1 x2sp

x1 and x2 are the means of the two groups at a certain time point or two time points being compared in between- and within-group analysis, accordingly; spis the pooled standard deviation. We used the R package lme4 to build linear mixed models and EMAtools to calculate Cohen’s d.

Furthermore, we conducted a sensitivity analysis to determine the robustness of our results for the primary and secondary outcomes. For this, we corrected models for the factors that could potentially influence the effect of therapy: any pharmacotherapy at baseline, and baseline scores of BAI and BDI. In order to assess the influence of adherence, we further conducted a per-protocol analysis. Only those participants of the iCBT-I + CAU group who had used the intervention for at least six out of eight modules were compared to all participants in the CAU group.

3 Results

Demographic characteristics and baseline clinical scores for the study sample are shown in Table 1. There was a significant difference in age and FSS between the two samples at baseline. Medications used for the management of insomnia included benzodiazepines and hypnotic benzodiazepine receptor agonists, sedating antidepressants, antipsychotics, antihistamines, melatonin, phytotherapy, and off-label substances. Ramelteon and orexin receptor antagonists were not used since they were not approved for use in Russia. The most frequently used medication group in both arms was antidepressants, then benzodiazepines or Z-drugs, followed by antipsychotics. There were no baseline between-group differences in the prevalence of use of all these medications. Only one of the enrolled participants had experience of the brief form of CBT-I before enrollment and none received any kind of CBT-I during the study period. Eight participants of the iCBT-I + CAU group and seven participants of the CAU group received regular psychological or psychotherapeutic help during the study.

Table 1
www.frontiersin.org

Table 1 Baseline demographics and sample characteristics for intervention and control groups.

3.1 Dropout analysis

In total, 15 participants (14%)—7 from the iCBT-I + CAU group (13%) and 8 from the CAU group (15%)—did not complete the post-treatment assessment, although they were invited three times in weekly intervals via email. At follow-up, the number of dropouts was 31 (29%): 18 dropped out from the iCBT-I+CAU group (34%) and 13 dropped out from the CAU group (24%). In the intervention group, non-completers did not differ from completers. Lower dropout in the CAU group after follow-up was presumably due to the study design: these participants were motivated to receive access to the iCBT-I treatment following the completion of all questionnaires.

3.2 Main outcomes

For the primary outcome, at post-treatment, the linear mixed model for insomnia severity showed a significant time*group interaction effect, F(2, 178.96) = 6.03, p = 0.001, indicating that the change in ISI over time was significantly different between the two groups at post-treatment. Specifically, the estimated effect toward ISI decreased by 3.8-fold [standard error (SE) = 1.1] in the iCBT-I group compared to the CAU group. At follow-up, there were no significant between-group differences (p = 0.16).

Regarding secondary outcomes, at post-treatment, a significant time*group interaction effect to the advantage of the iCBT-I group was found in the model for DBAS, F(2, 175.21) = 3.85, p = 0.02; SE, F(2, 152.72) = 9.38, p < 0.001; and WASO, F(2, 151.66) = 4.34, p = 0.01. At follow-up assessment, the time*group interaction effect on DBAS and SE remained significant: p = 0.02 and p = 0.0001 accordingly, while the same effect on WASO was only nearly significant: p = 0.07. An interaction effect for TST was significant only after the follow-up: p = 0.02. The coefficients for the interaction term and effect sizes (Cohen’s d) are presented in Table 2 for all outcomes.

Table 2
www.frontiersin.org

Table 2 Estimated effect sizes for primary and secondary outcome measures and between-group effect sizes with confidence intervals in the iCBT-I + CAU group.

In the within-group analysis, we observed a significant decrease of ISI from pre- to post-treatment in the intervention group, −5.7 (SE = 0.8), p < 0.0001, and from pre-treatment to follow-up, −4.1 (SE = 0.9), p < 0.0001, F(2, 88.8) =27.2. Participants from CAU also significantly improved although to a lesser extent, −1.9 (0.7), p = 0.01 at post-treatment and −2.5 (0.8), p = 0.001 at follow-up, F(2, 90.2) = 5.9. Significant effect of time at both post-treatment and follow-up was observed for BDI, DBAS, SHI, SE, WASO, LCS, and SOL in the intervention group, F(2, 73.5–95.0) = 10.4–107.1, all ps < 0.001. In the CAU group, we observed significant improvement for BDI, ESS, DBAS, LCS, and SE at post-treatment. At follow-up, BDI, DBAS, SHI, SE, WASO, and TST significantly decreased in the intervention group. In the CAU group, significant improvement at follow-up was observed for BDI, FSS, ESS, DBAS, and SHI. See Tables 3, 4 for the estimated means and effect sizes of within-group analysis for all outcomes in the iCBT-I + CAU and CAU groups.

Table 3
www.frontiersin.org

Table 3 Estimated effect sizes for primary and secondary outcome measures and within-group effect sizes with confidence intervals in the iCBT-I + CAU group.

Table 4
www.frontiersin.org

Table 4 Estimated effect sizes for primary and secondary outcome measures and within-group effect sizes with confidence intervals in the CAU group.

3.3 Effect sizes

Between- and within-group effect sizes (Cohen’s d) for different time points are presented in Tables 2, 3. The between-group effect sizes on the ISI at post-treatment was d = 0.51; for iCBT-I vs. CAU in favor of the iCBT-I, it decreased to d = 0.21 at follow-up.

The between-group comparisons on the secondary outcomes at post-treatment revealed small to medium effect sizes in favor of the iCBT-I regarding DBAS (d = 0.35), SE (d = 0.51), and WASO (d = 0.47). At follow-up, the between-group effect size remained small to medium DBAS (d = 0.36), SE (d = 0.63), and TST (d = 0.38). Within-group comparisons of the primary and secondary outcomes revealed medium to large effect sizes on ISI, BDI, DBAS, LCS, SHI, SE, SOL, and WASO in the iCBT-I group at post-treatment (d = 0.51–1.52) and on ISI, BDI, DBAS, SHI, SE, WASO, and TST in the iCBT-I + CAU group after follow-up (d = 0.46–2.00).

3.4 Program usage

The average number of completed modules in the iCBT-I group was 6.14 out of eight modules, over the 8 weeks. The average number of the completed sleep diaries was 44.9 per participant, and on average, participants answered 8.7 emails from the guiding iCBT-I specialist.

3.5 Sensitivity analysis

In the sensitivity analysis, the adjustment for the current pharmacotherapy did not change the results for the primary outcome substantially. Correction of the model for baseline BAI and BDI scores did not change the effect size, but had better goodness of fit. The effect sizes of the adjusted models are presented in the Supplementary Materials (Supplementary Table 1). In the context of the sensitivity analysis, we also conducted per-protocol analyses of the main and secondary outcomes adjusted to the completion rate among iCBT-I group participants. We considered those who completed at least six modules (40 participants from 53) as completers because the first 6 modules covered all the behavioral and cognitive techniques, while the 7th and 8th modules are dedicated to the psychoeducation, repeat, and relapse plan. The per-protocol analysis showed similar effect sizes, albeit of a higher magnitude in most of the outcomes, and reaching statistical significance for BDI, d = 0.37 [95% CI (confidence interval): −0.40, 4.70]. Effect sizes of the models of the per-protocol analysis and models adjusted for the pharmacotherapy and for baseline BAI and BDI are presented in the Supplementary Materials (Supplementary Table 1).

4 Discussion

Recruitment from the clinical settings and CAU in both groups determines the high prevalence of concurrent pharmacotherapy in this study. Except for this, the baseline clinical characteristics and scores of our recruited patients were comparable with those in the previous studies of iCBT-I. The primary outcome was the significant reduction of insomnia severity in the iCBT-I group, which is in line with results of previous meta-analyses where iCBT-I has demonstrated comparable effect sizes ranging from moderate to large effects post-treatment in comparison with the control group (18, 4042). As it was expected, the effect size is not large since a minor reduction of severity of insomnia symptoms could also be observed in the control group. However, even a medium effect is relevant for the investigated program, given that it is capable of reaching a lot of patients. The 95% CI, ranging from 1.66 to 5.88, lies above zero and corresponds to the meta-analysis by Seyffert M. et al. (2016) that supports the robustness of our results (18). The effect of sleep medications could mask the effect of nonpharmacological techniques, provided within the iCBT-I course, which can make patients less persistent and less motivated to follow recommendations after completion of active treatment. It should be noted that Hauri (1997) declared that the effect of CBT-I in combination with pharmacotherapy is less stable than that of CBT-I alone (43). However, the negative effect of sleep aids withdrawal on sleep outcomes was questioned by several authors (44, 45). Sensitivity analysis indicates that iCBT-I is equally effective in patients who took medications at baseline and those who did not receive treatment, i.e., medications did not reduce iCBT-I effects at post-treatment and follow-up.

By the follow-up assessment, the intervention group and the CAU group did not differ in insomnia severity. Meta-analysis of the long-term effects of face-to-face CBT-I has shown similar dynamics for ISI: between-group effect size gradually dropped from strong to moderate and small by 3, 6, and 12 months after the end of treatment (46). There was a similar dynamic of ISI in the intervention and control group in the study by Blom et al. (2016) (47). This scientific group also attributed this finding to the lesser consumption of pharmacotherapy, which was a part of the recommendation within the iCBT-I course in this study. However, our results appear inconclusive to the meta-analysis of Seyfert et al. (18), reporting the stability of the within-group effect of the iCBT-I. Stable within-group effect repeats the findings of Veda et al. (2019) and Luik et al. (2020) and the results of the meta-analysis by Zachariae et al. (2016) who reported robust within-group effects on main outcome after 12 and 18 months of follow-up (15, 48, 49).

The ICBT-I effect on dysfunctional beliefs about sleep was significant and robust in between-group analysis, which replicates the results of other iCBT-I studies (16, 50). In accordance with the previous studies, DBAS reinforces the sense of control in achieving better sleep and therefore can mediate the effects of CBT-I on the outcomes (50, 51). iCBT-I had a moderate between-group effect on SE post-treatment and after follow-up that was, in general, consistent with the previous studies demonstrating moderate to strong effects in research settings (18, 40) and in clinical settings (21).

The between-group effect of iCBT-I on SE and WASO was significant and ranged from small to moderate at post-treatment and follow-up. This is again consistent with the results of previous meta-analyses where the effect for WASO and SE ranged from moderate to large (18, 40, 42, 52). However, our findings contradict the results of Cheng et al. (2012) who reported no significant effect of the iCBT-I on WASO (41). As opposed to the literature, where iCBT-I has demonstrated significant between-group results for sleep onset latency, we did not find those in our study (40, 41). CAU as a control condition could be an explanation of this discrepancy. Most of the medications used by participants to control their sleep problems fell in the group of sleep aids acting on the GABA (γ aminobutyric acid) receptor–non-benzodiazepine Z-hypnotics. These medications are more likely to be effective in reducing sleep latency than in sleep maintenance (53, 54). Concerning the TST, the effects we found were larger than the results of iCBT-I described in the literature (18, 40, 41). Despite this, we may conclude that the effect of iCBT-I on the majority of the subjective sleep characteristics goes in line with the previous studies. The 95% CIs for the significant effects of the secondary outcomes (dysfunctional beliefs, SE, TSTs, and WASO) consistently align with the observed direction of effects—below or above zero, which strengthens the robustness of our findings.

The sensitivity analysis has shown that the baseline severity of depression and anxiety varying in a range determined by exclusion criteria does not change the effect of iCBT-I, which corresponds to the recommendations to use iCBT-I notwithstanding the presence of affective disorders (55). The absence of iCBT-I superiority over CAU in depression and anxiety symptom relief is inconsistent with the previous findings (40, 56). However, for the participants who completed six and more modules, iCBT-I has a significant small to moderate effect in alleviating depressive symptoms. This subgroup of patients has obtained an entire package of CBT-I techniques, especially cognitive techniques that were presented in modules 5 and 6, and an opportunity to practice them under the guidance of an iCBT-I specialist. This finding repeats the results of the meta-analysis where corrections for the adherence rate of 65% iCBT-I have shown greater effect sizes not only for depression, but also for anxiety and sleep outcomes (40).

One of the strengths of the current study is the recruitment in clinical settings, which allows us to generalize the results to patients in routine practice who may have insomnia comorbid with other medical or psychiatric conditions. Because of the well-determined inclusion and exclusion criteria, we were able to determine the target group more precisely and exclude other health problems that could severely affect the duration and depth of sleep. Dropout rate in our study was relatively low: 14% post-treatment and 29% after follow-up, which could be attributed to a higher motivation of patients to complete the procedure, since they were actively seeking treatment and referred to iCBT-I directly from the doctor’s office. Meta-analysis of randomized controlled trials of iCBT-I shows that an average dropout rate to follow-up is 24.7% in the iCBT-I group and 13.2% in the control group (15). The low dropout rate provided the study with sufficient power to detect a meaningful difference between groups after the treatment and at follow-up. The low dropout rate may indicate that participants recruited in the clinical settings are more motivated to complete the motivation and benefit from it.

There are, however, limitations of the present study to consider. The first is a rather short follow-up period. CAU, being the control condition, could reduce the power to detect a meaningful difference as was discussed previously. Owing to the nature of the intervention, blinding of participants was impossible, which increases the risk of bias (56). However, we assumed that the lack of blinding did not influence the study outcomes. It should be kept in mind that a smaller sample size can lead to less precise estimates, making them more susceptible to random variation or sampling error. The identified points limit the generalizability of our results and create the need for their verification in larger studies. The decision to opt for two diary entries per week for the calculation of weekly average values was undertaken to find a balance between mitigating data loss and ensuring enough representativeness of the average weekly values. However, employing only two diaries per week may compromise the accuracy of the weekly average sleep characteristics. Despite the limitations, the current study in sum provides evidence that in the clinical population under routine care conditions, iCBT-I was effective and showed similar effects although of somehow lower magnitude than in efficacy studies conducted in scientific settings. As a consequence, iCBT-I holds the potential to be effectively implemented in clinical settings and healthcare system and to contribute to alleviating the global burden associated with insomnia.

5 Conclusion

● iCBT-I decreases insomnia severity in comparison with CAU at post-treatment.

● iCBT-I decreases dysfunctional beliefs about sleep in comparison with CAU during the next 3 months after treatment.

● iCBT-I significantly decreases insomnia severity, depression symptoms, and dysfunctional beliefs about sleep; improves subjective sleep characteristics post-treatment and during the next 3 months after treatment; and improves sleep hygiene in iCBT-I patients during the next 3 months after treatment.

Despite its limitations, the present study extends the existing knowledge on iCBT-I effectiveness in clinical settings. iCBT-I has the advantage of accessibility to a large number of patients suffering from CI and can meet the existing need for mental health services.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by local ethics committee of the I.M. Sechenov Moscow Medical University. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.

Author contributions

PP: Conceptualization, Formal analysis, Investigation, Methodology, Writing – original draft. MP: Writing – review & editing, Investigation, Methodology. TK: Methodology, Writing – review & editing, Conceptualization. SD: Conceptualization, Methodology, Writing – review & editing. TB: Writing – review & editing, Supervision.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. The work on the protocol was supported by a research grant ESKAS Swiss Government Excellence scholarship 2019–2020. Personal ESKAS-Nr: 2019.0082.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2024.1301489/full#supplementary-material

References

1. Baglioni C, Altena E, Bjorvatn B, Blom K, Bothelius K, Devoto A, et al. The European Academy for CBT-I: An initiative of the European Insomnia Network to promote implementation and dissemination of treatment. J Sleep Res. (2020) 29:e12967. doi: 10.1111/jsr.12967

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Ohayon MM, Reynolds III CF. Epidemiological and clinical relevance of insomnia diagnosis algorithms according to the DSM-IV and the International Classification of Sleep Disorders (ICSD). Sleep Med. (2009) 10:952–60. doi: 10.1016/j.sleep.2009.07.008

PubMed Abstract | CrossRef Full Text | Google Scholar

3. American Academy of Sleep Medicine. The International Classification of Sleep Disorders, revised: Diagnostic and coding manual. Chicago, Illinois: American Academy of Sleep Medicine (2014).

Google Scholar

4. Baglioni C, Nanovska S, Regen W, Spiegelhalder K, Feige B, Nissen C, et al. Sleep and mental disorders: A meta-analysis of polysomnographic research. Psychol Bull. (2016) 142:969–90. doi: 10.1037/bul0000053

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Taylor DJ, Mallory LJ, Lichstein KL, Durrence HH, Riedel BW, Bush AJ. Comorbidity of chronic insomnia with medical problems. Sleep. (2007) 30:213–8. doi: 10.1093/sleep/30.2.213

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Lind MJ, Hawn SE, Sheerin CM, Aggen SH, Robert M, Kendler KS, et al. An examination of the etiologic overlap between the genetic and environmental influences on insomnia and common psychopathology. Depress Anxiety. (2017) 34:453–62. doi: 10.1002/da.22587

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Chellappa SL, Aeschbach D. Sleep and anxiety: From mechanisms to interventions. Sleep Med Rev. (2022) 61:101583. doi: 10.1016/j.smrv.2021.101583

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Hou C-L, Li Y, Cai M-Y, Ma X-R, Zang Y, Jia F-J, et al. Prevalence of insomnia and clinical and quality of life correlates in chinese patients with schizophrenia treated in primary care. Perspect Psychiatr Care. (2017) 53:80–6. doi: 10.1111/ppc.12139

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Riemann D, Baglioni C, Bassetti C, Groselj LD, Ellis JG, Espie CA, et al. European guideline for the diagnosis and treatment of insomnia. J Sleep Res. (2017) 26:675–700. doi: 10.1111/jsr.12594

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Wilson S, Anderson K, Baldwin D, Dijk D, Espie A, Espie C, et al. British Association for Psychopharmacology consensus statement on evidence-based treatment of insomnia, parasomnias and circadian rhythm disorders : An update. J Psychopharmacol. (2019) 33:923–47. doi: 10.1177/0269881119855343

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Edinger JD, Arnedt JT, Bertisch SM, Carney CE, Harrington JJ, Lichstein KL, et al. Behavioral and psychological treatments for chronic insomnia disorder in adults: an American Academy of Sleep Medicine clinical practice guideline. J Clin sleep Med JCSM Off Publ Am Acad Sleep Med. (2021) 17:255–62. doi: 10.5664/jcsm.8986

CrossRef Full Text | Google Scholar

12. Everitt H, Mcdermott L, Leydon G, Yules H, Baldwin D, Little P. GPs ‘ management strategies for patients with insomnia. Br J Gen Pract. (2014) 64(619):112–9. doi: 10.3399/bjgp14X677176

CrossRef Full Text | Google Scholar

13. Linder S, Duss SB, Dvořák C, Merlo C, Essig S, Tal K, et al. Treating insomnia in Swiss primary care practices : A survey study based on case vignettes. J Sleep Res. (2021) 30:e13169. doi: 10.1111/jsr.13169

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Currie CL, Kuzmina MV, Nadyuk RI. The counseling profession in Russia: historical roots, current trends, and future perspectives. J Couns Dev. (2012) 90:488–93. doi: 10.1002/j.1556-6676.2012.00060.x

CrossRef Full Text | Google Scholar

15. Zachariae R, Lyby MS, Ritterband LM, O’Toole MS. Efficacy of internet-delivered cognitive-behavioral therapy for insomnia – A systematic review and meta-analysis of randomized controlled trials. Sleep Med Rev. (2016) 30:1–10. doi: 10.1016/J.SMRV.2015.10.004

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Krieger T, Urech A, Duss SB, Blättler L, Schmitt W, Gast H, et al. A randomized controlled trial comparing guided internet-based multi-component treatment and internet-based guided sleep restriction treatment to care as usual in insomnia. Sleep Med. (2019) 62:43–52. doi: 10.1016/j.sleep.2019.01.045

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Horsch C, Lancee J, Beun RJ, Neerincx MA, Brinkman WP. Adherence to technology-mediated insomnia treatment: A meta-analysis, interviews, and focus groups. J Med Internet Res. (2015) 17:e214. doi: 10.2196/jmir.4115

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Seyffert M, Lagisetty P, Landgraf J, Chopra V, Pfeiffer PN, Conte ML, et al. Internet-delivered cognitive behavioral therapy to treat insomnia: A systematic review and meta-analysis. PloS One. (2016) 11:1–21. doi: 10.1371/journal.pone.0149139

CrossRef Full Text | Google Scholar

19. Espie CA. “ Stepped care “: A health technology solution for delivering cognitive behavioral therapy as a first line insomnia treatment. Sleep. (2009) 32(12):1549–58. doi: 10.1093/sleep/32.12.1549

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Riemann D, Benz F, Dressle RJ, Espie CA, Johann AF, Blanken TF, et al. Insomnia disorder: State of the science and challenges for the future. J Sleep Res England;. (2022) 31:e13604. doi: 10.1111/jsr.13604

CrossRef Full Text | Google Scholar

21. Sato D, Yoshinaga N, Nagai E, Nagai K, Shimizu E. Effectiveness of internet-delivered computerized cognitive behavioral therapy for patients with insomnia who remain symptomatic following pharmacotherapy: randomized controlled exploratory trial. J Med Internet Res. (2019) 21:e12686. doi: 10.2196/12686

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Freedland KE, Mohr DC, Davidson KW, Schwartz JE. Usual and unusual care: existing practice control groups in randomized controlled trials of behavioral interventions. Psychosom Med. (2011) 73:323–35. doi: 10.1097/PSY.0b013e318218e1fb

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Thompson BT, Schoenfeld D. Usual care as the control group in clinical trials of nonpharmacologic interventions. Proc Am Thorac Soc. (2007) 4:577–82. doi: 10.1513/pats.200706-072JK

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Pchelina P, Poluektov M, Berger T, Krieger T, Duss SB, Bassetti C. Effectiveness and cost-effectiveness of internet-based cognitive behavioral therapy for insomnia in clinical settings. Front Psychiatry. (2020) 11:838. doi: 10.3389/fpsyt.2020.00838

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Bastien CH, Vallières A, Morin CM. Validation of the insomnia severity index as an outcome measure for insomnia research. Sleep Med. (2001) 2:297–307. doi: 10.1016/S1389-9457(00)00065-4

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Morin CM, Belleville G, Bélanger L, Ivers H. The insomnia severity index : psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep. (2011) 34:18–20. doi: 10.1093/sleep/34.5.601

CrossRef Full Text | Google Scholar

27. Rasskazova EI. Psychological self-regulation disorders in neurotic insomnia. MGU im.M.V.Lomonosova. (2008).

Google Scholar

28. Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: Psychometric properties. J Consult Clin Psychol. (1988) 56:893–7. doi: 10.1037/0022-006X.56.6.893

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Ivanec NN, Kinkulkina MA, Avdeeva TI, Sysoeva VP. The possibility of using standardized self-report anxiety and depression scales in elderly patients: Depression scales/questionnaires in elderly. Zhurnal Nevrol i Psihiatr im SS Korsakova. (2016) 116:51–9. doi: 10.17116/jnevro201611610151-59

CrossRef Full Text | Google Scholar

30. Beck AT, Steer RA, Brown G. Manual for the beck depression inventory-II. San Antonio: TX: Psychological Corporation (1996). doi: 10.1037/t00742-000

CrossRef Full Text | Google Scholar

31. Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36) I. Conceptual framework and item selection. Medical Care. (2012) 30:473–83. doi: 10.1097/00005650-199206000-00002

CrossRef Full Text | Google Scholar

32. Novik AA, Ionova TI. Rukovodstvo po issledovaniju kachestva zhizni v medicine. St.Petersburg: Neva (2002).

Google Scholar

33. Krupp LB, Larocca NG, Muir Nash J, Steinberg AD. The fatigue severity scale: Application to patients with multiple sclerosis and systemic lupus erythematosus. Arch Neurol. (1989) 46:1121–3. doi: 10.1001/archneur.1989.00520460115022

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Johns MW. A new method for measuring daytime sleepiness : the epworth sleepiness scale. Sleep. (1991) 14:540–5. doi: 10.1093/sleep/14.6.540

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Mastin DF, Bryson J, Corwyn R. Assessment of sleep hygiene using the sleep hygiene index. J Behav Med. (2006) 29:223–7. doi: 10.1007/s10865-006-9047-6

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Vincent N, Sande G, Read C. Sleep locus of control : report on a new scale. Behavioral Sleep Medicine. (2010) 2(2):37–41. doi: 10.1207/s15402010bsm0202_1

CrossRef Full Text | Google Scholar

37. Morin CM, Vallières A, Ivers H. Dysfunctional beliefs and attitudes about sleep (DBAS): validation of a brief version (DBAS-16). Sleep. (2007) 30:1547–54. doi: 10.1093/sleep/30.11.1547

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Natale V, Léger D, Bayon V, Erbacci A, Tonetti L, Fabbri M, et al. The consensus sleep diary: quantitative criteria for primary insomnia diagnosis. Psychosomat Med. (2015) 77:413–8. doi: 10.1097/PSY.0000000000000177

CrossRef Full Text | Google Scholar

39. Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. (2007) 39:175–91. doi: 10.3758/BF03193146

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Lee S, Oh JW, Park KM, Lee S, Lee E. Digital cognitive behavioral therapy for insomnia on depression and anxiety: a systematic review and meta-analysis. NPJ Digit Med. (2023) 6:1–11. doi: 10.1038/s41746-023-00800-3

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Cheng SK. Therapy for insomnia : A systematic review and meta-analysis. Psychother Psychosom. (2012) 81:206–16. doi: 10.1159/000335379

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Ye Y, Chen N, Chen J, Liu J, Lin L, Liu Y, et al. Internet-based cognitive – behavioural therapy for insomnia (ICBT-i): a meta- analysis of randomised controlled trials. BMJ Open (2016) 6(11):1–10. doi: 10.1136/bmjopen-2015-010707

CrossRef Full Text | Google Scholar

43. Hauri PJ. Can we mix behavioral therapy with hypnotics when treating insomniacs? Sleep. (1997) 20:1111–8. doi: 10.1093/sleep/20.12.1111

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Park KM, Kim TH, Kim WJ, An SK, Namkoong K, Lee E. Cognitive behavioral therapy for insomnia reduces hypnotic prescriptions. Psychiatry Investig. (2018) 15(5):499–504. doi: 10.30773/pi.2017.11.20

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Taylor DJ, Pruiksma KE. Cognitive and behavioural therapy for insomnia (CBT-I) in psychiatric populations : A systematic review Cognitive and behavioural therapy for insomnia (CBT-I) in psychiatric populations : A systematic review. Int Rev Psychiatry. (2014) 26(2):205–13. doi: 10.3109/09540261.2014.902808

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Van Der Zweerde T, Bisdounis L, Kyle SD, Lancee J. Cognitive behavioral therapy for insomnia : A meta-analysis of long-term effects in controlled studies. Sleep Med Rev. (2019) 48:101208. doi: 10.1016/j.smrv.2019.08.002

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Blom K, Jernelöv S, Rück C, Lindefors N, Kaldo V. Three-year follow-up of insomnia and hypnotics after controlled internet treatment for insomnia. Sleep. (2016) 39:1267–74. doi: 10.5665/sleep.5850

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Vedaa Ø, Hagatun S, Kallestad H, Pallesen S, Smith ORF, Thorndike FP, et al. Long-term effects of an unguided online cognitive behavioral therapy for chronic insomnia. J Clin Sleep Med. (2019) 15:101–10. doi: 10.5664/jcsm.7580

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Luik AI, van der Zweerde T, van Straten A, Lancee J. Digital delivery of cognitive behavioral therapy for insomnia. Curr Psychiatry Rep. (2019) 21:50. doi: 10.1111/jsr.13018

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Chow PI, Ingersoll KS, Thorndike FP, Lord HR, Gonder-Frederick L, Morin CM, et al. Cognitive mechanisms of sleep outcomes in a randomized clinical trial of internet-based cognitive behavioral therapy for insomnia. Sleep Med. (2018) 47:77–85. doi: 10.1016/j.sleep.2017.11.1140

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Lancee J, Effting M, van der Zweerde T, van Daal L, van Straten A, Kamphuis JH. Cognitive processes mediate the effects of insomnia treatment: evidence from a randomized wait-list controlled trial. Sleep Med. (2019) 54:86–93. doi: 10.1016/j.sleep.2018.09.029

PubMed Abstract | CrossRef Full Text | Google Scholar

52. van der Zweerde T, Bisdounis L, Kyle SD, Lancee J, van Straten A. Cognitive behavioral therapy for insomnia: A meta-analysis of long-term effects in controlled studies. Sleep Med Rev. (2019) 48:101208. doi: 10.1016/j.smrv.2019.08.002

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Huedo-Medina TB, Kirsch I, Middlemass J, Klonizakis M, Siriwardena AN. Effectiveness of non-benzodiazepine hypnotics in treatment of adult insomnia: Meta-analysis of data submitted to the Food and Drug Administration. BMJ. (2013) 346:1–13. doi: 10.1136/bmj.e8343

CrossRef Full Text | Google Scholar

54. Frase L, Nissen C, Riemann D, Spiegelhalder K, Frase L, Nissen C, et al. Expert Opinion on Pharmacotherapy Making sleep easier : pharmacological interventions for insomnia Making sleep easier : pharmacological interventions for insomnia. Expert Opin Pharmacother. (2018) 19:1465–73. doi: 10.1080/14656566.2018.1511705

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Zhang T, Xie X, Li Q, Zhang L, Chen Y, Ji G-J, et al. Hypogyrification in generalized anxiety disorder and associated with insomnia symptoms. Nat Sci Sleep. (2022) 14:1009–19. doi: 10.2147/NSS.S358763

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Juul S, Gluud C, Simonsen S, Frandsen FW, Kirsch I, Jakobsen JC. Blinding in randomised clinical trials of psychological interventions: a retrospective study of published trial reports. BMJ Evidence-Based Med. (2021) 26:109. doi: 10.1136/bmjebm-2020-111407

CrossRef Full Text | Google Scholar

Keywords: chronic insomnia, internet-based cognitive behavioral therapy for insomnia, Insomnia Severity Index, sensitivity analysis, care as usual

Citation: Pchelina P, Poluektov M, Krieger T, Duss SB and Berger T (2024) Clinical effectiveness of internet-based cognitive behavioral therapy for insomnia in routine secondary care: results of a randomized controlled trial. Front. Psychiatry 15:1301489. doi: 10.3389/fpsyt.2024.1301489

Received: 25 September 2023; Accepted: 08 April 2024;
Published: 10 May 2024.

Edited by:

Tihana Jendričko, Sveučilišta u Zagrebu, Croatia

Reviewed by:

Takuma Inagawa, National Center of Neurology and Psychiatry, Japan
Markus Jansson-Fröjmark, Karolinska Institutet (KI), Sweden

Copyright © 2024 Pchelina, Poluektov, Krieger, Duss and Berger. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Polina Pchelina, cG9scGNoZWxpbmFAZ21haWwuY29t

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.