This article is a commentary on:
Meta-analysis overstates benefit of antidepressant combination therapy with α2-antagonists and reuptake inhibitors in major depression
Jonathan Henssler
Tom Bschor
Christopher Baethge2- 1Department of Psychiatry and Psychotherapy, St. Hedwig-Krankenhaus, Charité–Universitätsmedizin Berlin, Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
- 2Department of Psychiatry and Psychotherapy, University of Cologne Medical School, Cologne, Germany
- 3Department of Psychiatry and Psychotherapy, University Hospital of Dresden, Dresden, Germany
A Commentary on
Meta-analysis overstates benefit of antidepressant combination therapy with α2-antagonists and reuptake inhibitors in major depression
by Kennedy, K. P. (2022) Front. Psychiatry 13:1053530. doi: 10.3389/fpsyt.2022.1053530
We appreciate Dr. Kennedy's thoughts (1) on our meta-analysis of antidepressant combination RCTs (2) as they provide an opportunity to address what may be common concerns.
Based on sample size, Kennedy retrospectively singles out five studies he considers “robust”—without defining the term or the threshold—and he emphasizes smaller effects in those studies relative to the summary standardized mean difference (SMD) of 0.37 [0.19–0.55] across all 18 RCTs. While Kennedy repeatedly calls the five trials he picked negative, this is simply not true for their summary effect (SMD: 0.1 [0.04–0.17]) (post-hoc analysis, conducted for this response letter). However, it is not size that matters most in meta-analysis: Risk of bias is the key feature of trials. Importantly, therefore, in a prospectively planned analysis restricted to low risk of bias studies the effect size turned out to be practically identical: 0.36 [0.19–0.53; 11 studies].
In principle, following large RCTs rather than a meta-analysis for clinical decision making, as Kennedy proposes, is a debatable approach. However, it is a deviation from a cornerstone of evidence-based medicine and runs a high risk of bias, particularly when done retrospectively. In the present case, for example, four out of five studies that Kennedy prefers are limited or largely limited to patients with treatment resistant or chronic depression and the fifth trial excluded patients exhibiting early response. Clinically, efficacy of any treatment is expected to be smaller in this population of patients. In fact, it is one result of our original analysis (2) that this common finding applies to antidepressant combinations too (Table 2 in the original paper).
Kennedy reiterates our discussion of the sizable heterogeneity found in the main meta-analysis. Unfortunately, he fails to mention that heterogeneity drops below 50% in various secondary outcome analyses, e.g., in regard to treatment response (OR 1.49 [1.18–1.87], I-squared 48%), supporting the findings of our primary analysis. As an aside, tau-squared, a measurement of heterogeneity independent of meta-analysis sample size, indicates acceptable variability in trial results.
In our paper, we also discussed the potential of small study effects (as a result of possible publication bias) —another topic of concern for Kennedy—and we provided calculations of its possible impact on our results. Nevertheless, in RCTs comparing antidepressant combination to monotherapy, publication bias, while a statistical possibility, appears much less likely than in placebo-controlled trials of antidepressant drugs. Indeed, it cannot be discounted that, regardless of statistical significance, 17 out of 18 RCTs resulted in stronger antidepressant effects of combination versus monotherapy – including all five trials selected by Kennedy, virtually excluding a role of chance (p = 0.0001, sign test). As a matter of fact, even the one diverging study cannot be considered negative with regard to combinations because responder rates were generally large and combination treatment was more acceptable to patients than high-dose imipramine monotherapy (3).
Finally, in an earlier paper we have provided evidence why the specific superiority of a reuptake inhibitor and α2-antagonist combinations results from synergistic interaction and is not due to a simple dose effect (4). Still, the effect size we arrived at is an estimate and, obviously, may be changed by future studies. Also, the confidence interval indicates a relatively wide range of possible average effects, but in discussing the significance of our estimate for clinical practice it must not be forgotten that, in the trials included, combination treatment has not been evaluated against placebo but against antidepressant monotherapy, that is, against a treatment of shown efficacy. In summary, even small incremental effects may prove to be valuable for patients.
Author contributions
JH and CB: conceptualization, data curation, formal analysis, investigation, interpretation, methodology, project administration, resources, validation, visualization, writing original draft, and writing review and editing. TB: conceptualization, investigation, interpretation, methodology, resources, supervision, validation, and writing review and editing. All authors approved the final version of the manuscript.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Kennedy KP. Meta-analysis overstates benefit of antidepressant combination therapy with α2-antagonists and reuptake inhibitors in major depression. Front Psychiat. (2022) 13:1053530. doi: 10.3389/fpsyt.2022.1053530
2. Henssler J, Alexander D, Schwarzer G, Bschor T, Baethge C. Combining Antidepressants vs Antidepressant Monotherapy for Treatment of Patients With Acute Depression: A Systematic Review and Meta-analysis. JAMA Psychiatry. (2022) 79:300–12. doi: 10.1001/jamapsychiatry.2021.4313
3. Navarro V, Boulahfa I, Obach A, Jerez D, Diaz-Ricart M, Gastó C. Switching to Imipramine Versus Add-on Mirtazapine in Venlafaxine-Resistant Major Depression: A 10-Week Randomized Open Study. J Clin Psychopharmacol Februar. (2019) 39:63–6. doi: 10.1097/JCP.0000000000000988
Keywords: antidepressants, response letter, antidepressant combination, meta-analysis, depression
Citation: Henssler J, Bschor T and Baethge C (2023) Commentary: Meta-analysis overstates benefit of antidepressant combination therapy with α2-antagonists and reuptake inhibitors in major depression. Front. Psychiatry 14:1164471. doi: 10.3389/fpsyt.2023.1164471
Received: 12 February 2023; Accepted: 18 April 2023;
Published: 11 May 2023.
Edited by:
Marcin Siwek, Jagiellonian University, PolandReviewed by:
Michael James Weightman, University of Adelaide, AustraliaCopyright © 2023 Henssler, Bschor and Baethge. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jonathan Henssler, jonathan.henssler@charite.de