Skip to main content

SYSTEMATIC REVIEW article

Front. Psychiatry, 01 December 2022
Sec. Mood Disorders
This article is part of the Research Topic Recent Progress of Novel Approaches in Mood Disorders View all 8 articles

Optimal parameter determination of repetitive transcranial magnetic stimulation for treating treatment-resistant depression: A network meta-analysis of randomized controlled trials

\r\nJinbiao Li,&#x;Jinbiao Li1,2†Liqian Cui,*&#x;Liqian Cui1,2*†Hao Li,&#x;Hao Li1,2†
  • 1Department of Neurology, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
  • 2Guangdong Provincial Key Laboratory of Diagnosis and Treatment of Major Neurological Diseases, National Key Clinical Department and Key Discipline of Neurology, Guangzhou, China

Background: Many studies have shown the efficacy of repetitive transcranial magnetic stimulation (rTMS) in treatment-resistant depression (TRD). However, the choice of different parameters has been a challenging issue.

Methods: PubMed, Cochrane, and Embase databases were searched for relevant studies until June 20, 2022. The treatment efficacy was evaluated by the relative risk (RR) using the pairwise test for response and remission rates. Subgroup and sensitivity analyses were conducted to explore the primary outcome differences and to assess the reliability of the results.

Results: Thirty-seven trials comprising 2120 participants with TRD were included. The more efficacious interventions compared to sham controls included high-frequency left followed by low-frequency right sup-threshold (HFL-LFR-sup-rTMS, RR = 5.29, 95% CI: 1.24–22.50), high-frequency left sup-threshold (HFL-sup-rTMS, RR = 2.97, 95% CI: 1.74–5.05), low-frequency right sup-threshold (LFR-sup-rTMS, RR = 2.72, 95% CI: 1.50–4.90), low-frequency right followed by high-frequency left sup-threshold (LFR-HFL-sup-rTMS, RR = 2.71, 95% CI: 1.62–4.53), and high-frequency left sub-threshold (HFL-sub-rTMS, RR = 1.91, 95% CI: 1.18–3.10) rTMS. The estimated relative ranking of treatments suggested that HFL-LFR-sup-rTMS (84.4%) might be the most efficacious among all rTMS strategies. No treatments showed a lower acceptability than the sham control.

Limitations: Subgroup analysis was not conducted to compare the efficacy of rTMS treatment between bipolar and unipolar depression, and small-study effects possibly introduced bias.

Conclusion: Treatment with HFL-LFR-sup-rTMS, HFL-sup-rTMS, LFR-sup-rTMS, LFR-HFL-sup-rTMS, or HFL-sub-rTMS is more efficacious than the sham control. HFL-LFR-sup-rTMS and HFL-sup-rTMS may be the two best among the most efficacious rTMS treatments.

Systematic review registration: [https://www.crd.york.ac.uk/PROSPERO], identifier [CRD42022334481].

Introduction

Major depressive disorder (MDD) is one of the common psychiatric disorders. The World Health Organization considers this disorder the third most common cause of worldwide disease, and by 2030, it is forecasted to be the most common (13). However, most patients with MDD fail to benefit from conventional antidepressant treatments. In some cases, inconsistencies in treatment success have been observed, including one or more, two or more, and three or more treatment failures (4). It has been reported that 67% of patients could achieve overall cumulative remission after two treatment steps (5).

In comparison, the chances of subsequent remission were much lower (36.8%, 30.6%, 13.7%, and 13.0% for the first, second, third, and fourth acute treatment steps, respectively), suggesting that the second step was a significant turning point (5). Thus, treatment-resistant depression (TRD) is most commonly defined as depression in patients having a minimum of two prior treatments with an inadequate response to a sufficient dose and duration of antidepressant (4). Therefore, the treatment of TRD has been a significant concern, and it is still a major therapeutic challenge to develop novel and effective treatments.

In this context, researchers have found physical therapy to be an efficacious alternative, with repetitive transcranial magnetic stimulation (rTMS) showing great potential. In recent years, studies have demonstrated the efficacy and acceptability of rTMS for treating TRD (611). rTMS is a non-invasive neuromodulatory therapy for MDD that is safe and tolerable, with a low incidence of adverse events (12). A systematic review and meta-analysis of 32 randomized controlled trials (RCTs), including unilateral or bilateral rTMS, have revealed that compared to sham groups, the pooled response rate for unilateral rTMS was 2.00 [95% confidence interval (CI): 1.26–3.19], favoring unilateral rTMS; and for bilateral rTMS and sham groups, the pooled response rate was 3.55 (95% CI: 1.87–6.76), favoring bilateral rTMS (13). In another study, 47 RCTs were selected to perform the network meta-analysis (NMA), and the findings demonstrated that low-frequency right rTMS (LFR-rTMS, RR = 2.97, 95% CI: 1.61–5.49), high-frequency left rTMS (HFL-rTMS, RR = 2.91, 95% CI: 1.48–3.23), and bilateral rTMS (BL-rTMS, RR = 3.29, 95% CI: 1.88–5.73) have a higher efficacy than the sham control (14). rTMS also had a non-inferior acceptability compared to the sham control, and bilateral rTMS was more acceptable than bitemporal electroconvulsive therapy (BT-ECT, RR = 0.18, 95% CI: 0.03–0.89) (14).

Many meta-analyses have supported the efficacy and acceptability of rTMS (LFR-rTMS, HFL-rTMS, and bilateral rTMS) vs. the sham control, and the selection of rTMS parameters, including the frequency, intensity, intertrain interval, and number of pulses per session, has a key role in its treatment (1417). However, there is no definitive consensus regarding the optimal parameters for rTMS treatment. Moreover, previous meta-analyses usually did not distinguish in detail between the different parameters of rTMS (14, 16). In addition, several small RCTs have shown different efficacy of rTMS with other parameters. Thus, it is essential to determine the optimal parameters of rTMS and the intervention duration for treating TRD. The selection of the optimal parameters of rTMS is principally based on the stimulation sites, frequency, intensity, and treatment duration and has gained the attention of many researchers (13, 14, 16). Furthermore, NMA makes it possible to access the comparative efficacy, summarize the evidence, and analyze the merits of the various interventions. Therefore, this study aimed to perform a systematic review and NMA to determine the optimal parameters of rTMS for treating TRD.

Methods

Search strategy and selection criteria

A systematic review and NMA were performed according to the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement and its extension (18, 19). Various published literature reports that included RCTs were searched using the PubMed, Cochrane Central Register of Controlled Trials, and EMBASE databases from their inception to June 20, 2022. Different frequencies, locations of the coil, intensities (the percentage of the resting motor threshold; RMT), and treatment durations of rTMS to treat adults with TRD were considered while searching the literature. When screening the trials, careful measures were taken to search only selected published literature by applying the key medical subject headings or a combination of their text words like “transcranial magnetic stimulation” and “depressive disorder, treatment-resistant” (Supplementary Table 1). Full-text articles, both peer-reviewed and non-peer-reviewed in English, were retrieved and evaluated by two independent reviewers (JL and HL) who performed the search; any disagreements were resolved through discussion with a third reviewer (LC).

Randomized controlled trials (RCTs) of different parameter selections of rTMS used to treat TRD were included, and the following study characteristics were recorded: (1) Participant: Participants were limited to adults (over 18 years; both females and males) with a primary diagnosis of TRD including unipolar or bipolar depressive episodes and without secondary mood disorders, according to standard diagnostic criteria (DSM-IV, DSM-IV-TR, and ICD-10) (20). TRD was defined for MDD as failing to respond to at least two adequate doses and durations of antidepressant medications (4). (2) Intervention: Trials that have conducted at least two of the following interventions were included: Usually, in clinical practice, two significant modalities of rTMS are applied, i.e., low frequency and high frequency. However, both have specific functional activities; for example, rTMS with a high frequency (HF) and a low frequency (LF) are thought to impart a stimulating and inhibitory effect on the cerebral cortex, respectively. RMT > 100% was defined as sup-threshold rTMS (sup-rTMS), while RMT ≤ 100% defined as sub-threshold rTMS (sub-rTMS). Low frequency is graded as <5 Hz rTMS over the right dorsolateral prefrontal cortex (DLPFC) target at a delivered RMT > 100% (LFR-sup-rTMS). High frequency is graded as ≥5 Hz rTMS over the left DLPFC at a delivered RMT ≤ 100% (HFL-sub-rTMS) (21, 22). HFR-sub-rTMS, HFL-sup-rTMS, LFL-sup-rTMS, LFL-sub-rTMS, and LF stimulation were delivered to the right, followed by HF stimulation over the left DLPFC at the resting motor sup-threshold (LFR-HFL-sup-rTMS), HF over the left followed by LF over the right DLPFC at the resting motor sup-threshold (HFL-LFR-sup-rTMS), LF over the left followed by LF over the right DLPFC at the resting motor sup-threshold (LFL-LFR-sup-rTMS), and the sham control (Figure 1). (3) Comparison: The control group was restricted to another active treatment or the sham control. (4) Outcome: From all included studies, the main focus was to check the response rate of the treatment. Also, evaluation of depressive symptoms in TRD patients was performed with either the Hamilton Depression Rating Scale, 17 items, 24 items, or 28 items (HAMD-17, HAMD-24, and HAMD-28) or the Montgomery Asberg Depression Rating Scale (MARDS). (5) Study design: RCTs and randomized crossover trials were included, but only the first-phase data from crossover trials were obtained (23). Simultaneously, non-randomized controlled trials, quasi-randomized trials, and incomplete trials with only up to 20% of data or enrolled participants with secondary mood disorders like post-stroke depression or psychotic depression with Parkinson’s disease and other concomitant severe medical illnesses were excluded (20). (6) Papers published in a language other than English were excluded (14). The first and third authors (JL and HL) independently selected the studies, and all authors (JL, HL, and LC) discussed and resolved disagreements.

FIGURE 1
www.frontiersin.org

Figure 1. The classification of rTMS interventions analyzed in this study.

Data extraction and outcome measures

Data were initially gathered by the first and third authors (JL and HL) independently; later, all authors (JL, HL, and LC) scrutinized, discussed, and resolved any disagreements and finalized the studies. The following predefined hierarchical characteristics, which are the essential factors according to the study, are presented in Supplementary Table 2: (1) Sources: Careful screening was done on the gathered data to report the details like the first author, publication year, and so on; (2) Details: Details regarding the ethnicity of the population were studied along with a clear period or duration of the study. Furthermore, demographic and clinical details like the sample size, mean age, and medication details, whether the patients are taking antidepressant drugs or not, intervention measures like rTMS frequency, location of the coil, intension, number of pulses per session, intervention duration, and depression scale were documented carefully; (3) Results: In-depth observation and recording of the minute details regarding the response rate of the treatment, all-cause discontinuation, observing the remission rate by any chance, and the baseline and endpoint scores of the depression scale were graded.

The response and remission rates based on the primary outcome scale were provided. To evaluate the data efficacy and acceptability, the corresponding response rate and discontinuation rate were selected as the primary outcome. Secondary outcomes were the remission rate and the endpoint depression score. The patient’s treatment was considered valid if the response rate improvement was ≥50% from the baseline score of the study depression scale, and remission was considered if the remission rate was found to be ≤7, ≤8, or ≤10 on the HAMD-17, HAMD-21, or MADRS, respectively. The discontinuation rate is the percentage of patients who withdrew from the RCT for any reason.

Risk of bias assessment

The risk of bias was assessed according to the Cochrane Handbook for Systematic Reviews of Interventions (version 5.1.0) and the certainty of evidence. The details for judging the risk of bias were as follows: The investigators clearly described random components in the sequence generation process based on the score criteria of low risk, high risk, and unclear risk. Similarly, other criteria for judging the risk of bias included allocation concealment, blinding of participants and personnel, blinding of outcome assessment, incomplete outcome data, selective reporting, and other bias score criteria based on their low, high, and unclear risks. Two authors (JL and HL) independently evaluated the risk of bias and discussed reaching an agreement.

Data analysis

STATA version 15.1 was used to perform the pairwise analysis and NMA, while Revman 5.3.3 was used to perform the risk of bias assessment (24). For all data, the appropriate statistical analysis was applied wherever necessary. The relative risk (RR) for dichotomous outcome measures and standardized mean differences for continuous outcomes, combined with a 95% confidence interval (CI), were estimated. In certain cases, if the number of RCTs included was ≥2, pairwise meta-analyses were conducted through a random-effects model to estimate the direct effects of the interventions. Furthermore, statistical heterogeneity was assessed using I2 statistics (2527). If the estimated I2 values were <25%, between 25 and 50%, or >50%, the heterogeneity was considered low, moderate, or high, respectively. If I2 was ≥50%, subgroup analysis was performed to explore the source of the heterogeneity (27, 28).

Subsequently, NMA was carried out to analyze the mixed effects of direct and indirect comparison based on the frequentist framework using random-effects models (2426). The network plots were generated for each outcome (i.e., the response rate, remission rate, discontinuation rate, and endpoint depression score) to clarify the direct or indirect comparison of the included studies. Next, the overall rankings for the efficacy and acceptability of each treatment were estimated using the surface under the cumulative ranking curve (SUCRA), which ranged from 0 to 1. The closer the SUCRA value was to 1, the better the treatment effect (24, 29).

A common heterogeneity parameter (similarity, transitivity, and consistency) was assumed for all treatment comparisons. Similarity and transitivity require combining studies (e.g., A vs. C and B vs. C studies) similar to their effect modifiers (study type and population baselines, such as sample size, mean age, and sex) (30). To illustrate similarity, the RCTs of those groups having no significant differences in the population baseline data were included using eligible trials (16). Consistency was evaluated in the loop-specific approach using the inconsistency factor (IF) to compare the direct and indirect treatment effects (14, 31). In addition, the global Wald and the node splitting approach were used to evaluate the heterogeneity of the network (3032). A P < 0.05 for the global Wald or the node splitting test indicated the presence of a statistically significant inconsistency in the network model.

Furthermore, subgroup analyses were conducted to explore the difference in the primary outcomes based on different intervention durations between the two groups (divided into the <4 weeks group and ≥4 weeks group). Also, a funnel plot was made to estimate small-study effects, including comparisons of active intervention and a sham and between active intervention and another active intervention (33). Finally, sensitivity analyses, in which studies with too short (one week) of a treatment duration were excluded, were performed to assess the robustness and reliability of the results.

Results

The database search provided 2024 citations, of which only 77 studies were full-text articles retrieved successfully (Figure 2). After thoroughly screening all the publications, only 37 RCTs were finally included, with a publication year between 1999 and 2020. In this NMA (Figure 2), 2120 patients with TRD receiving 10 different strategies of treatments out of 90 treatment arms were included. The main characteristics of all the included studies are reported in Supplementary Table 1. The mean patient age range was 23.5–66.8 years old, and the intervention duration was mainly 2–6 weeks. One study (Miniussi et al.) was carried out for nine weeks, and two studies (Padberg et al. and Baeken et al.) had a duration of one week (3436). For the RCTs included in this study, there was no variability in the population baselines for the mean age; hence, common transitivity in the NMA study was accepted (Supplementary Figure 3). The characteristics listed for the risk of bias are presented in Supplementary Table 3, with 2, 14, and 21 studies graded as having a high, unclear, and low risk of bias, respectively. Therefore, the two studies (McDonald et al. and Isenberg et al.) with a high risk of bias were excluded from the pairwise and NMA analyses (37, 38).

FIGURE 2
www.frontiersin.org

Figure 2. PRISMA flow diagram of the study selection process.

Pairwise meta-analysis

A pairwise meta-analysis was conducted for eight groups of inter-comparisons to compare the response rates. First, the sham control was compared with each of the following groups: sham vs. HFL-sup-rTMS (11 RCTs, 200 participants), sham vs. HFL-sub-rTMS (12 RCTs, 213 participants), and sham vs. LFR-HFL-sup-rTMS (10 RCTs, 118 participants). At a later stage of analysis, LFR-sup-rTMS was compared with HFL-sup-rTMS (2 RCTs, 80 participants) and LFR-HFL-sup-rTMS (2 RCTs, 91 participants). Finally, HFL-sup-rTMS (4 RCTs, 80 participants) was compared with LFR-HFL-sup-rTMS, and HFL-sub-rTMS (2 RCTs, 16 participants) was compared with LFL-sub-rTMS.

More efficacious rTMS interventions than the sham control included HFL-sup-rTMS (RR = 4.35, 95% CI: 2.41–7.87, 12 RCTs, 213 participants), HFL-sub-rTMS (RR = 2.24, 95% CI: 1.03–4.87, 12 RCTs, 222 participants), and LFR-HFL-sup-rTMS (RR = 2.36, 95% CI: 1.26–4.40, 10 RCTs, 118 participants). There was no significant difference between the two rTMS groups.

All comparisons were shown to have a low-to-moderate heterogeneity (I2 < 50%), except for HFL sub-rTMS (I2 = 68.8%) vs. the sham control. Hence, sensitivity analyses were performed by excluding one of the studies from the HFL-sub-rTMS group vs. the sham control (12 RCTs, 222 participants) at the same time, and the impact of eliminating each of the studies on the overall results between HFL-sub-rTMS and the sham control was estimated.

After the study by Theleritis et al. was excluded, the I2 value of HFL-sub-rTMS vs. sham was shown to be 46.9%, with an RR value of 1.72 and a 95% CI of 0.93–3.17 (39). The full text was reviewed, and the risk of bias for the study was reassessed. This study was graded as having an unclear risk of bias. Hence, it was excluded. The detailed information of the sensitivity analyses is reported in Supplementary Table 12, and the direct comparison results, remission rates, endpoint depression scores, and all-cause discontinuation are listed in Supplementary Appendix 4.

Network meta-analysis

Evaluation of statistical heterogeneity and inconsistency

For global heterogeneity, the I2 values were 10.18% for efficacy and 6.85% for acceptability. The global Wald test results suggested no statistical inconsistency for the efficacy (P = 0.926) or acceptability (P = 0.985). For local heterogeneity, the tests of loop inconsistency showed one loop (formed by sham, HFL-sup-rTMS, and LFR-HFL-sup-rTMS) presenting statistical inconsistency for the response (IF = 1.71, 95% CI: 0.58–2.85) and none for acceptability (Supplementary Figure 6). Finally, the node-splitting model alone demonstrated a significant difference between the comparison of HFL-sub-rTMS and LFR-HFL-sup-rTMS in terms of acceptability (P = 0.038) but not for efficacy (P > 0.05). The details for global and local heterogeneity are documented in the Supplementary Table 9.

Relative effects and relative ranking of interventions

Efficacy

Thirty-five trials (two were removed due to a high risk of bias) reported the response rate and were included in the NMA to compare the efficacy, with a total of 1873 TRD patients. Figure 3A shows the network plot of the efficacy. According to the NMA results, HFL-LFR-sup-rTMS (RR = 5.29, 95% CI: 1.24–22.50), HFL-sup-rTMS (RR = 2.97, 95% CI: 1.74–5.05), LFR-sup-rTMS (RR = 2.72, 95% CI: 1.50–4.90), LFR-HFL-sup-rTMS (RR = 2.71, 95% CI: 1.62–4.53), and HFL-sub-rTMS (RR = 1.91, 95% CI: 1.18–3.10) were more efficacious than the sham control (Table 1). There was no significant difference between the nine active rTMS interventions. According to the ranked orders of the SUCRAs, HFL-LFR-sup-rTMS (84.4%), HFL-sup-rTMS (70.1%), and LFR-HFL-sup-rTMS (63.9%) were the most efficacious.

FIGURE 3
www.frontiersin.org

Figure 3. Network plot for efficacy (A) and acceptability (B): The width of the lines represents the number of trials comparing each pair of treatments. The size of each node represents the number of randomly assigned participants.

TABLE 1
www.frontiersin.org

Table 1. Comparisons for efficacy and acceptability of treatments.

Acceptability

Thirty-four trials (two trials with a high risk of bias and one without reporting the discontinuation rate) were included in the NMA to compare the acceptability comprising 1811 TRD patients were included. Figure 3B shows the network plot of the acceptability. NMA demonstrated that LFR-HFL-sup-rTMS was more acceptable than LFR-sup-rTMS (RR = 0.50, 95% CI: 0.31–0.80), HFL-sup-rTMS (RR = 0.52, 95% CI: 0.32–0.84), and LFL-LFR-sup-rTMS (RR = 0.49, 95% CI: 0.28–0.84) (Table 1). Also, there was no significant difference between any treatment measures compared with the sham controls for acceptability (Table 1). The SUCRA results showed that LFL-LFR-sup-rTMS (70.6%), LFR-sup-rTMS (70.0%), and HFL-sup-rTMS (64.9%) were ranked in the three first positions for the response.

Remission rates and endpoint scores

Network meta-analysis (NMA) reported that LFR-sup-rTMS and HFL-sup-rTMS allowed participants to achieve remission compared to the sham controls. For HFL-sub-rTMS and HFL-sup-rTMS, endpoint scores were lower and were statistically significant. Similarly, there was no significant difference in the comparison between active treatments for remission rates and endpoint scores (Supplementary Table 8). The SUCRA results both showed that HFL-LFR-sup-rTMS, LFR-sup-rTMS, and LFR-HFL-sup-rTMS were ranked in the three first positions for the remission and endpoint scores. The results of the remission rates and endpoint scores are provided in the Supplementary Figure 5 and Supplementary Tables 8, 9.

Subgroup analysis

Intervention duration of <4 weeks

In this subgroup analysis, 19 trials comprising 723 TRD patients were included, and 9 active treatments were included to compare the efficacy. The results showed that only HFL-sub-rTMS (RR = 2.43, 95% CI: 1.19–4.95) was more efficacious than the sham control. For acceptability, 661 TRD patients from 18 RCTs, including 9 active treatments, were included to assess the acceptability. No treatments revealed significantly lower acceptability than the sham controls. The two active treatments demonstrated no significant difference in efficacy or acceptability (Supplementary Table 10).

Intervention duration of ≥4 weeks

In this subgroup analysis, 16 trials that enrolled 1150 patients with TRD were included, with 9 active treatments in 37 treatment arms for efficacy and acceptability. The results suggested that LFR-sup-rTMS (RR = 2.58, 95% CI: 1.08–6.16), HFL-sup-rTMS (RR = 3.17, 95% CI: 1.60–6.31), and LFR-HFL-sup-rTMS (RR = 2.94, 95% CI: 1.54–5.64) were more effective than the sham control. The analysis also showed that LFR-HFL-sup-rTMS was more acceptable than LFR-sup-rTMS (RR = 0.47, 95% CI: 0.29–0.76), HFL-sup-rTMS (RR = 0.48, 95% CI: 0.29–0.80), and LFL-LFR-sup-rTMS (RR = 0.46, 95% CI: 0.26–0.81). Similarly, there was no significant difference between the two active treatments for the efficacy or acceptability (Supplementary Table 11).

Funnel plot analysis

The two funnel plots for efficacy and acceptability of treatment are depicted in Supplementary Figure 9. Overall, the funnel plots did not suggest any substantial asymmetry; thus, the presence of a publication bias was not suspected.

Discussion

This systematic review and NMA summarize the comparative effects of 9 rTMS interventions and sham controls based on 37 RCTs, including 2120 patients with TRD. In terms of the response rate, HFL-LFR-sup-rTMS, HFL-sup-rTMS, LFR-sup-rTMS, LFR-HFL-sup-rTMS, and HFL-sub-rTMS were found to be better treatments than the sham controls. Similarly, for remission rates, LFR-sup-rTMS, HFL-sup-rTMS, and LFR-HFL-sup-rTMS were superior to the sham controls (Supplementary Table 8). Also, the evidence in our NMA demonstrated the superiority of HFL-LFR-sup-rTMS followed by HFL-sup-rTMS in all rTMS interventions based on ranked orders of response and remission rates. Additionally, all interventions and sham controls were well accepted, but LFL-LFR-sup-rTMS and LFR-sup-rTMS had the highest likelihood of being the two most acceptable treatments.

Several previous meta-analyses have reported the superiority of bilateral rTMS compared with HF-rTMS, LF-rTMS, and the sham control in response and remission rates (13, 14, 16). This is consistent with the results in the present study that HFL-LFR-sup-rTMS is ranked as the most efficacious treatment in the SUCRA ranking for both response and remission rates. In addition, Grimm et al. have reported that depression is associated with an imbalance in bilateral DLPFC activity. Moreover, other studies have reported a reduced left DLPFC and increased metabolism at the right DLPFC (40).

Researchers also have illustrated the excitatory effects of HF stimulation (>5 Hz) and the inhibitory effects of LF stimulation (<1 Hz) in the brain. The excitatory or inhibitory effects may be that rTMS can alter synaptic plasticity, mainly the long-term potentiation/depression of excitatory synaptic transmission (22, 41). Altogether, these findings provide the theoretical basis for rTMS in treating MDD. However, when comparing bilateral rTMS and other unilateral rTMS, no significant differences were found in the RR for response and remission rates or the SMD for endpoint scores. Therefore, additional large head-to-head RCTs comparing bilateral rTMS and unilateral rTMS in the treatment of TRD are needed.

In addition, a further division of the order of stimulus position in bilateral rTMS was made in the present study (i.e., HFL-LFR-sup-rTMS and LFR-HFL-sup-rTMS). HFL-LFR-sup-rTMS was found to be the most likely efficacious measure. LFR-HFL-sup-rTMS was ranked in the third position for both response and remission. Although some research reports have revealed an insignificant difference for HFL-LFR-sup-rTMS or LFR-HFL-sup-rTMS in a sham-controlled study, there was a trend for subjects in the HFL-LFR-sup-rTMS group to show improvement in the HAMD (42). To date, no studies have directly compared the effect of the order of stimulus positions in the treatment of TRD using rTMS. The present study is the first to provide evidence that HFL-LFR-sup-rTMS may have a better efficacy than LFR-HFL-sup-rTMS. However, these results should be interpreted carefully, since there is only one RCT focusing on HFL-LFR-sup-rTMS at present. Further studies should be conducted to clarify the effects of the order of stimulus positions in rTMS (16).

Additionally, our study found that selection of RMT > 100% was more effective and tolerable than RMT ≤ 100%. RMT was defined as the minimum intensity that produces a response in either the abductor pollicis brevis or the first dorsal interosseous muscle for ≥50% of the stimuli (15, 42). The intensity is generally indicated as a percentage of the RMT (15, 42). However, several studies have demonstrated a dose–response relationship between stimulus intensity and efficacy (43). A significant treatment effect was not found when using sub-rTMS for TRD, compared to the sham control, which supports the use of suprathreshold stimulation (RMT > 100%) in rTMS treatment. However, others have argued that there is not a purely linear relationship between the intensity and efficacy. One study observed a change in intensity during rTMS treatment, affecting the severity of depressive and anxiety symptoms after treatment (44). Hence, further studies should pay more attention to this aspect.

Finally, subgroup analyses were performed based on different intervention durations (<4 weeks and ≥4 weeks). We found a better performance for rTMS than sham controls after 4 weeks, expounding the relationship between efficacy and intervention duration, which is consistent to some extent with the results of previous studies. Some studies have reported more dramatic treatment effects as early as 6 weeks in the acute phase (7). The time commitment required for a 4–6-week treatment course may need to be made. Because the intervention time for the RCTs included in our study was between 1 week and 9 weeks, the trend in the efficacy of a treatment course >4 weeks is still inconclusive (15, 45).

Limitations

Our study has some limitations that must be addressed. First, there was uncertainty in the estimations of the treatment outcomes. A few direct comparisons between two active interventions were included, but 15 of 35 did not report the remission rate. In addition, through 37 RCTs (2 RCTs were not analyzed due to a high risk of bias), 15 of 37 interventions were combined with more than two treatment arms, including 2120 patients.

Second, small-study effects possibly introduced bias as 65% of the trials included fewer than 50 participants. Also, because depressive symptoms in TRD patients were evaluated through either HAMD or MARDS, some methodological heterogeneity might exist. Therefore, the HAMD score followed by the MADRS score was used to calculate the response and remission rates; four studies using only MADRS as the assessment measure were included. Besides, approximately 30% of the studies had an unclear risk of bias, and two studies with a high risk of bias were removed from the analysis. Most of the trials presented an unclear randomization and assignment bias risk, leading to uncertainty for estimates of treatment efficacy.

Additionally, bipolar disorder is a potential cause of TRD (14). Of the included studies, only one trial included patients with bipolar TRD. Thus, subgroup analysis was not conducted to compare the efficacy of rTMS treatment between bipolar and unipolar depression. More trials regarding rTMS treatment of bipolar depression are warranted to gather more evidence. Also, we only used the all-cause discontinuation to assess the acceptability in the present study. However, the higher acceptability may result from efficacy instead of tolerability, leading to an overestimation of tolerability. Therefore, dropout due to the side effects needs to be investigated in future studies.

Another important shortcoming is the failure to assess the degree of cognitive improvement. Cognitive impairment is an important clinical feature of TRD and indicates a poor response to medication. However, only a few of the 37 RCTs conducted pre- and post-treatment cognitive assessments, resulting in insufficient data to allow meta-analysis. Moreover, the treatment duration of two RCTs was only one week. Therefore, sensitivity analysis was performed to assess the robustness and reliability of the results by removing these two trials. The sensitivity analysis results were not affected by these two trials (Supplementary Table 13).

Finally, although we used SUCRA to estimate the ranking order of the comparative effectiveness, the results need to be interpreted with caution because this method may only provide supportive but not conclusive evidence for treatment options (46, 47).

Conclusion

This NMA explored the clinical efficacy and acceptability between rTMS modalities. The results suggest that HFL-LFR-sup-rTMS, HFL-sup-rTMS, LFR-sup-rTMS, LFR-HFL-sup-rTMS, and HFL-sup-rTMS are more effective than the sham controls. HFL-LFR-sup-rTMS and HFL-sup-rTMS may be the best among the most efficacious rTMS treatments. All interventions and shams were well accepted, while LFL-LFR-sup-rTMS had the highest likelihood of being the most acceptable treatment. The results also demonstrate the relationship between efficacy and intervention duration and suggest a treatment course of more than four weeks.

Data availability statement

The original contributions presented in this study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.

Author contributions

JL, HL, and LC: conception and design of the study. JL and HL: acquisition of data. JL and LC: analysis and interpretation of data. JL: drafting the manuscript. HL and LC: revising the manuscript. All authors reviewed and approved the final version of this manuscript.

Funding

This study was supported by grants from Guangdong Provincial Key Laboratory of Diagnosis and Treatment of Major Neurological Diseases (2020B1212060017), Guangdong Provincial Clinical Research Center for Neurological Diseases (2020B1111170002), the Southern China International Cooperation Base for Early Intervention and Functional Rehabilitation of Neurological Diseases (2015B050501003 and 2020A0505020004), Guangdong Provincial Engineering Center For Major Neurological Disease Treatment, and Guangdong Provincial Translational Medicine Innovation Platform for Diagnosis and Treatment of Major Neurological Disease (201604020010).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2022.1038312/full#supplementary-material

References

1. Kessler RC, Bromet EJ. The epidemiology of depression across cu-ltures. Annu Rev Public Health. (2013) 34:119–38. doi: 10.1146/annurev-publhealth-031912-114409

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Malhi GS, Mann JJ. Depression. Lancet. (2018) 392:2299–312. doi: 10.1016/S0140-6736(18)31948-2

CrossRef Full Text | Google Scholar

3. McLachlan G. Treatment-resistant depression: what are the options? BMJ. (2018) 363:k5354. doi: 10.1136/bmj.k5354

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Gaynes BN, Lux L, Gartlehner G, Asher G, Forman-Hoffman V, Green J, et al. Defining treatment-resistant depression. Depress Anxiety. (2020) 37:134–45. doi: 10.1002/da.22968

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Rush AJ, Trivedi MH, Wisniewski SR, Nierenberg AA, Stewart JW, Warden D, et al. Acute and longer-term outcomes in depressed outpatients requiring one or several treatment steps: a STAR*D report. Am J Psychiatry. (2006) 163:1905–17. doi: 10.1176/ajp.2006.163.11.1905

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Kedzior KK, Reitz SK, Azorina V, Loo C. Durability of the antidepressant effect of the high-frequency repetitive transcranial magnetic stimulation (rTMS) in the absence of maintenance treatment in major depression: a systematic review and meta-analysis of 16 double-blind, randomized, SHAM-controlled trials. Depress Anxiety. (2015) 32:193–203. doi: 10.1002/da.22339

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Berlim MT, Van den Eynde F, Jeff Daskalakis Z. Clinically meaningful efficacy and acceptability of low-frequency repetitive transcranial magnetic stimulation (rTMS) for treating primary major depression: a meta-analysis of randomized, double-blind and sham-controlled trials. Neuropsychopharmacology. (2013) 38:543–51. doi: 10.1038/npp.2012.237

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Berlim MT, van den Eynde F, Tovar-Perdomo S, Daskalakis ZJ. Response, remission and drop-out rates followin-g high-frequency repetitive transcranial magnetic stimulation (rTMS) for treatingmajor depression: a systematic review and meta-analysis of randomized, double-blind and sham-controlled trials. Psychol Med. (2014) 44:225–39. doi: 10.1017/S0033291713000512

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Chen J, Zhou C, Wu B, Wang Y, Li Q, Wei Y, et al. Left versus right repetitive transcranial magnetic stimulation in treating major depression: a meta-analysis of randomized controlled trials. Psychiatry Res. (2013) 210:1260–4. doi: 10.1016/j.psychres.2013.09.007

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Gaynes BN, Lloyd SW, Lux L, Gartlehner G, Hansen RA, Brode S, et al. Repetitive transcranial magnetic stimulation for treatment-resistant depression: a systematic review and meta-analysis. J Clin Psychiatry. (2014) 75:477–89. doi: 10.4088/JCP.13r08815

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Wei Y, Zhu J, Pan S, Su H, Li H, Wang J. Meta-analysis of the efficacy and safety of repetitive transcranial magnetic stimulation (rTMS) in the treatment of depression. Shanghai Arch Psychiatry. (2017) 29:328–42. doi: 10.11919/j.issn.1002-0829.217106

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Janicak PG, O’Reardon JP, Sampson SM, Husain MM, Lisanby SH, Rado JT, et al. Transcranial magnetic stimulation in the treatment of major depressive disorder: a comprehensive summary of safety experience from acute exposure, extended exposure, and during reintroduction treatment. J Clin Psychiatry. (2008) 69:222–32. doi: 10.4088/jcp.v69n0208

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Sehatzadeh S, Daskalakis ZJ, Yap B, Tu HA, Palimaka S, Bowen JM, et al. Unilateral and bilateral repetitive transcranial magnetic stimulation for treatment-resistant depression: a meta-analysis of randomized controlled trials over 2 decades. J Psychiatry Neurosci. (2019) 44:151–63. doi: 10.1503/jpn.180056

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Li H, Cui L, Li J, Liu Y, Chen Y. Comparative efficacy and acceptability of neuromodulation procedures in the treatment of treatment-resistant depression: a network meta-analysis of randomized controlled trials. J Affect Disord. (2021) 287:115–24. doi: 10.1016/j.jad.2021.03.019

PubMed Abstract | CrossRef Full Text | Google Scholar

15. McClintock SM, Reti IM, Carpenter LL, McDonald WM, Dubin M, Taylor SF, et al. Consensus recommendations for the clinical application of repetitive transcranial magnetic stimulation (rTMS) in the treatment of depression. J Clin Psychiatry. (2018) 79:16cs10905. doi: 10.4088/JCP.16cs10905

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Brunoni AR, Chaimani A, Moffa AH, Razza LB, Gattaz WF, Daskalakis ZJ, et al. Repetitive transcranial magnetic stimulation for the acute treatment of major depressive episodes: a systematic review with network meta-analysis. JAMA Psychiatry. (2017) 74:143–52. doi: 10.1001/jamapsychiatry.2016.3644

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Zhao YJ, Tor PC, Khoo AL, Teng M, Lim BP, Mok YM. Cost-effectiveness modeling of repetitive transcranial magnetic stimulation compared to electroconvulsive therapy for treatment-resistant depression in Singapore. Neuromodulation. (2018) 21:376–82. doi: 10.1111/ner.12723

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. (2015) 350:g7647. doi: 10.1136/bmj.g7647

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Cornell JE. The PRISMA extension for network meta-analysis: bringing clarity and guidance to the reporting of systematic reviews incorporating network meta-analyses. Ann Intern Med. (2015) 162:797–8. doi: 10.7326/M15-0930

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Cipriani A, Furukawa TA, Salanti G, Chaimani A, Atkinson LZ, Ogawa Y, et al. Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: a systematic review and network meta-analysis. Lancet. (2018) 391:1357–66. doi: 10.1016/S0140-6736(17)32802-7

CrossRef Full Text | Google Scholar

21. Kennedy SH, Milev R, Giacobbe P, Ramasubbu R, Lam RW, Parikh SV, et al. Canadian Network for Mood and Anxiety Treatments (CANMAT) clinical guidelines for the management of major depressive disorder in adults. IV. Neurostimulation therapies. J Affect Disord. (2009) 117:S44–53. doi: 10.1016/j.jad.2009.06.039

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Peng Z, Zhou C, Xue S, Bai J, Yu S, Li X, et al. Mechanism of repetitive transcranial magnetic stimulation for depression. Shanghai Arch Psychiatry. (2018) 30:84–92.

Google Scholar

23. Stedman MR, Curtin F, Elbourne DR, Kesselheim AS, Brookhart MA. Meta-analyses involving cross-over trials: methodological issues. Int J Epidemiol. (2011) 40:1732–4. doi: 10.11919/j.issn.1002-0829.217047

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Shim S, Yoon BH, Shin IS, Bae JM. Network meta-analysis: application and practice using stata. Epidemiol Health. (2017) 39:e2017047. doi: 10.4178/epih.e2017047

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Cai Z, Fan X. A comparison of fixed-effects and random-effects models for multivariate meta-analysis using an SEM approach. Multivariate Behav Res. (2020) 55:839–54. doi: 10.1080/00273171.2019.1689348

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Jansen JP, Fleurence R, Devine B, Itzler R, Barrett A, Hawkins N, et al. Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR task force on indirect treatment comparisons good research practices: part 1. Value Health. (2011) 14:417–28. doi: 10.1016/j.jval.2011.04.002

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. (2002) 21:1539–58. doi: 10.1002/sim.1186

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. (2003) 327:557–60. doi: 10.1136/bmj.327.7414.557

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Salanti G, Ades AE, Ioannidis JP. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. (2011) 64:163–71. doi: 10.1016/j.jclinepi.2010.03.016

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Cipriani A, Higgins JP, Geddes JR, Salanti G. Conceptual and technical challenges in network meta-analysis. Ann Intern Med. (2013) 159:130–7. doi: 10.7326/0003-4819-159-2-201307160-00008

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Higgins JP, Jackson D, Barrett JK, Lu G, Ades AE, White IR. Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies. Res Synth Methods. (2012) 3:98–110. doi: 10.1002/jrsm.1044

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Salanti G. Indirect and mixed-treatment comparison, network, or multiple-treatments meta-analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool. Res Synth Methods. (2012) 3:80–97. doi: 10.1002/jrsm.1037

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Riley RD, Higgins JP, Deeks JJ. Interpretation of random effects meta-analyses. BMJ. (2011) 342:d549. doi: 10.1136/bmj.d549

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Miniussi C, Bonato C, Bignotti S, Gazzoli A, Gennarelli M, Pasqualetti P, et al. Repetitive transcranial magnetic stimulation (rTMS) at high and low frequency: an efficacious therapy for major drug-resistant depression? Clin Neurophysiol. (2005) 116:1062–71. doi: 10.1016/j.clinph.2005.01.002

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Padberg F, Zwanzger P, Thoma H, Kathmann N, Haag C, Greenberg BD, et al. Repetitive transcranial magnetic stimulation (rTMS) in pharmacotherapy-refractory major depression: comparative study of fast, slow and sham rTMS. Psychiatry Res. (1999) 88:163–71. doi: 10.1016/s0165-1781(99)00092-x

CrossRef Full Text | Google Scholar

36. Baeken C, Vanderhasselt MA, Remue J, Herremans S, Vanderbruggen N, Zeeuws D, et al. Intensive HF-rTMS treatment in refractory medication-resistant unipolar depressed patients. J Affect Disord. (2013) 151:625–31. doi: 10.1016/j.jad.2013.07.008

PubMed Abstract | CrossRef Full Text | Google Scholar

37. McDonald WM, Durkalski V, Ball ER, Holtzheimer PE, Pavlicova M, Lisanby SH, et al. Improving the antidepressant efficacy of transcranial magnetic stimulation: maximizing the number of stimulations and treatment location in treatment-resistant depression. Depress Anxiety. (2011) 28:973–80. doi: 10.1002/da.20885

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Isenberg K, Downs D, Pierce K, Svarakic D, Garcia K, Jarvis M, et al. Low frequency rTMS stimulation of the right frontal cortex is as effective as high frequency rTMS stimulation of the left frontal cortex for antidepressant-free, treatment-resistant depressed patients. Ann Clin Psychiatry. (2005) 17:153–9. doi: 10.1080/10401230591002110

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Theleritis C, Sakkas P, Paparrigopoulos T, Vitoratou S, Tzavara C, Bonaccorso S, et al. Two versus one high-frequency repetitive transcranial magnetic stimulation session per day for treatment-resistant depression: a randomized sham-controlled trial. J ECT. (2017) 33:190–7. doi: 10.1097/YCT.0000000000000387

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Grimm S, Beck J, Schuepbach D, Hell D, Boesiger P, Bermpohl F, et al. Imbalance between left and right dorsolateral prefrontal cortex in major depression is linked to negative emotional judgment: an fMRI study in severe major depressive disorder. Biol Psychiatry. (2008) 63:369–76. doi: 10.1016/j.biopsych.2007.05.033

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Ma J, Zhang Z, Kang L, Geng D, Wang Y, Wang M, et al. Repetitive transcranial magnetic stimulation (rTMS) influences spatial cognition and modulates hippocampal structural synaptic plasticity in aging mice. Exp Gerontol. (2014) 58:256–68. doi: 10.1016/j.exger.2014.08.011

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Westin GG, Bassi BD, Lisanby SH, Luber B. Determination of motor threshold using visual observation overestimates transcranial magnetic stimulation dosage: safety implications. Clin Neurophysiol. (2014) 125:142–7. doi: 10.1016/j.clinph.2013.06.187

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Padberg F, Zwanzger P, Keck ME, Kathmann N, Mikhaiel P, Ella R, et al. Repetitive transcranial magnetic stimulation (rTMS) in major depression: relation between efficacy and stimulation intensity. Neuropsychopharmacology. (2002) 27:638–45. doi: 10.1016/S0893-133X(02)00338-X

CrossRef Full Text | Google Scholar

44. Pretalli JB, Nicolier M, Chopard G, Vandel P, Tio G, Monnin J, et al. Resting motor threshold changes and clinical response to prefrontal repetitive transcranial magnetic stimulation in depressed patients. Psychiatry Clin Neurosci. (2012) 66:344–52. doi: 10.1111/j.1440-1819.2012.02341.x

PubMed Abstract | CrossRef Full Text | Google Scholar

45. O’Reardon JP, Solvason HB, Janicak PG, Sampson S, Isenberg KE, Nahas Z, et al. Efficacy and safety of transcranial magnetic stimulation in the acute treatment of major depression: a multisite randomized controlled trial. Biol Psychiatry. (2007) 62:1208–16. doi: 10.1016/j.biopsych.2007.01.018

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Wang Z, Carter RE. Ranking of the most effective treatments for cardiovascular disease using SUCRA: is it as sweet as it appears? Eur J Prev Cardiol. (2018) 25:842–3. doi: 10.1177/2047487318767199

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Gregori D, Giacovelli G, Minto C, Barbetta B, Gualtieri F, Azzolina D, et al. Association of pharmacological treatments with long-term pain control in patients with knee osteoarthritis: a systematic review and meta-analysis. JAMA. (2018) 320:2564–79. doi: 10.1001/jama.2018.19319

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: repetitive transcranial magnetic stimulation, treatment-resistant depression, network meta-analysis, randomized controlled trials, optimal parameter

Citation: Li J, Cui L and Li H (2022) Optimal parameter determination of repetitive transcranial magnetic stimulation for treating treatment-resistant depression: A network meta-analysis of randomized controlled trials. Front. Psychiatry 13:1038312. doi: 10.3389/fpsyt.2022.1038312

Received: 06 September 2022; Accepted: 14 November 2022;
Published: 01 December 2022.

Edited by:

Qingzhong Wang, Shanghai University of Traditional Chinese Medicine, China

Reviewed by:

Heather Burrell Ward, Beth Israel Deaconess Medical Center and Harvard Medical School, United States
Christos Theleritis, School of Academic Psychiatry, King’s College London, United Kingdom
Jin Haiyan, Shanghai Jiao Tong University, China

Copyright © 2022 Li, Cui and Li. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Liqian Cui, cuiliqian@mail.sysu.edu.cn

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.