Jinke Huang
Jiali Liu1†
Jing Ma
Fengyun Wang
Xudong Tang- 1Department of Gastroenterology, Xiyuan Hospital, China Academy of Chinese Medical Sciences, Beijing, China
- 2Department of Gastroenterology, Peking University Traditional Chinese Medicine Clinical Medical School (Xiyuan), Beijing, China
- 3China Academy of Chinese Medical Sciences, Beijing, China
Background and Aims: There has been a significant increase in the number of systematic reviews (SRs)/meta-analyses (MAs) investigating the effects of acupuncture for functional dyspepsia (FD). To systematically collate, appraise, and synthesize the current evidence, we carried out an umbrella review of SRs/MAs.
Methods: Systemic reviews/meta-analyses on acupuncture for FD were collected by searching major medical databases. The included studies were evaluated in terms of methodological quality, reporting quality, and evidence quality using the criteria from the Assessment of Multiple Systematic Reviews 2 (AMSTAR-2) tool, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement, and the Grades of Recommendation, Assessment, Development, and Evaluation (GRADE) system, respectively.
Results: Ten SRs/MAs were analyzed for this study. The methodological quality, reporting quality, and evidence quality of the included SRs/MAs were generally unsatisfactory. Lack of protocol registration, no list of excluded trials, or lack of a comprehensive search strategy were the main limitations. No high-quality evidence was found to support the effects of acupuncture for FD; the qualitative data synthesis relied on low quality trials with small sample sizes and was the main factor for evidence degradation.
Conclusions: Acupuncture seems to have a promising efficacy in the treatment of FD. It provides a new and prospective therapeutic method for FD. Although the quality of the included SRs/MAs was generally low and defects were frequent, this umbrella review highlights areas where improvement in methodology is required.
Introduction
Functional dyspepsia (FD) is a functional gastrointestinal disease marked chiefly by early satiation, postprandial fullness, epigastric pain, and epigastric burning (1). The annual prevalence of FD is 9–10%, with 15% of patients having frequent (>3 attacks per week) and chronic (>3 months per year) symptoms (2). As a result of continuous medical treatment and continuous drug use, indigestion symptoms create a huge socio-economic burden and have a negative impact on the quality of life (3, 4). It is reported that the total yearly direct cost of presentation and treatment is $805 per patient, yet the economic losses of FD on patients are much higher in combination with the indirect costs caused by resignation or reduced productivity (4). Abnormal gastric motility (delayed gastric emptying), impaired gastric adaptability to food, and visceral hypersensitivity (gastric hyperdistention sensitivity and acid hypersensitivity) are usually considered to be the main pathophysiological mechanisms of FD (5). Current pharmacological options include antidepressants, antacids, anxiolytics, prokinetics, and Helicobacter pylori eradication (6). However, none of the available therapies are effective in the majority of patients (6).
Acupuncture has been widely used to treat functional gastrointestinal disorders including FD. A literature search yielded that an increasing number of systematic reviews (SRs)/meta-analyses (MAs) regarding this topic have been conducted. However, not all SRs/MAs can provide reliable evidence, and low-quality SRs/MAs may instead mislead decision-makers (7). Furthermore, in an attempt to ensure validity of evidence and improve the quality of SRs/MAs, the measurement tools like the Assessment of Multiple Systematic Reviews 2 (AMSTAR-2) (8), the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) (9), and the Grades of Recommendation, Assessment, Development, and Evaluation (GRADE) (10) were published in 2007, 2009, and 2004, respectively. An umbrella review is defined as an evidence-based medicine approach to the systematic review of all SRs/MAs on the same topic. Conducting an umbrella review helps to integrate the evidence more comprehensively, thereby providing higher quality evidence for clinicians. Hence, to systematically collate, evaluate, and synthesize current evidence on acupuncture for FD, we conducted this study.
Methods
The protocol of this study was registrated in PROSPERO registry (CRD42021262020), and the methodology was performed following the criteria of the Cochrane Handbook.
Criteria for Considering Studies
The criteria for selection were as follows: (a) SRs/MAs of only enrolled randomized controlled trials (RCTs), (b) subjects were diagnosed with FD according to the Rome diagnostic criteria, (c) interventions applied to the experimental group included acupuncture alone or in combination with conventional medicine (CM), while interventions applied to the control included sham acupuncture or CM, (d) reporting at least one prespecified outcome: symptom score (SS), nepean dyspepsia index (NDI), main frequency of electrogastrogram (MF-EGG), gastric half-emptying time (GHET), plasma motilin level (PML), and effective rate (ER). The exclusion criteria were as follows: (a) repeated publications, (b) graduate dissertation, (c) lack of further data, and (d) conference abstracts.
Search Strategy
Systematic reviews/Meta-analysis of acupuncture on FD were systematically searched in the following databases from their inception till August 2021: the Cochrane Library, PubMed, Web of Science, Embase, Chinese Biomedical Database, Chinese VIP information, and Wanfang Data. Functional dyspepsia, acupuncture, and systematic review were used as key search terms. A strategy for using PubMed search is shown in Table 1.
Table 1. Detailed retrieval strategy for PubMed.
Literature Screening and Data Extraction
Literature selection and data extraction were conducted by two independent reviewers. For literature selection, titles and abstracts were screened first, and the full texts of potential literature were read for further evaluation. From the articles included, the following data were extracted: first author, publication year, sample size, interventions, outcomes, and main results. Disagreements were settled via discussion and consensus.
Quality Assessment
Methodological quality, reporting quality, and evidence quality of the enrolled studies were evaluated by two independent reviewers using the AMSTAR-2 tool, the PRISMA statement, and the GRADE system, respectively. The AMSTAR-2 consisted of 16 items, and the methodological quality was ranked as high, moderate, low, or critically low (8). The PRISMA statement consisted of 27 items, with each of the 16 items given a rating of yes, no, or partly yes (9). Evidence quality with GRADE was considered from five aspects (risk of bias, inconsistency, indirectness, imprecision, and publication bias) and given a rating of high to critically low (10). Disagreements were settled via discussion and consensus.
Results
Literature Screening
The literature search yielded 193 citations, of which 55 duplicates were removed. After screening the title and abstract, 121 citations were excluded and the remaining 17 were further evaluated through full-text reading. Finally, 10 SRs/MAs (11–20) met the inclusion criteria (Figure 1).
Figure 1. Literature screening flowchart.
Characteristics of the Primary Studies
Then, SRs/MAs published from 2014 to 2021 were included. The interventions applied to the experimental groups were acupuncture alone or in combination with CM, while those administered to the control groups were CM or sham acupuncture. More details are presented in Table 2.
Table 2. A description of the characteristics.
Methodological Quality
According to the AMSTAR-2, only one Cochrane SR/MA presented high level of methodological quality, while the other SRs/MAs presented critically low levels of methodological quality. Lack of protocol registration, no list of excluded trials, or lack of a comprehensive search strategy were the main limitations of the included SRs/MAs (Figures 2, 3).
Figure 2. Summary of the Assessment of Multiple Systematic Reviews 2 (AMSTAR-2).
Figure 3. Graphical representation of the AMSTAR-2.
Reporting Quality
According to the PRISMA statement, only one Cochrane SR/MA fully reported information on the 27 items, while the other SRs/MAs missed serious information in item Q5 (protocol and registration), Q8 (search), and Q27 (funding). More details are shown in Table 3.
Table 3. Result of the PRISMA checklist.
Evidence Quality
With the GRADE system, the evidence quality of all concerned outcome indicators ranged from “critically low” to “moderate” due to the risk of bias, inconsistency, imprecision, and publication bias. Furthermore, upgrading factors such as large effect and evidence of dose-response gradient were not applicable to the included outcome indicators. More details are shown in Table 4.
Table 4. Results of evidence quality.
Meta-Analyses Outcomes of Intervention
Acupuncture vs. Sham Acupuncture
Five studies (11, 12, 14–16) compared the effects of acupuncture with sham acupuncture. Three studies (11, 12, 14, 16) reported significant improvements in SSs in the acupuncture group compared to the sham acupuncture. Two studies reported ERs (11, 16), and the meta-analysis results revealed that the acupuncture group was significantly superior to the sham acupuncture group. The MF- EGG was reported in two studies (11, 12). One study (11) showed that the acupuncture group was significantly superior to the sham group, while the other (12) reported no significant difference between these two groups. Furthermore, it was reported that acupuncture was superior to sham acupuncture in NDI (15).
Acupuncture vs. Conventional Medication
Nine studies (11–14, 16–20) compared the effects of acupuncture with CM. Symptom score was reported in six studies (11–14, 16, 19), and the results of four studies (11, 13, 16, 19) revealed that acupuncture was superior to CM, while others (12, 14) showed that acupuncture was equivalent to CM. An effective rate was reported in eight studies (11–13, 16–20), and the results of five studies (13, 16, 18–20) revealed that acupuncture was superior to CM, while others (11, 12, 17) showed that acupuncture was equivalent to CM. The MF-EGG was reported in one study (11), and the pooled results showed that acupuncture was equivalent to CM. PML was reported in four studies (11–14), and the results of one study (13) revealed that acupuncture was superior to CM, while others (11, 12, 14) showed that acupuncture was equivalent to CM. Two studies reported the GHET (11, 12), and the results showed that the therapeutic effect of acupuncture group was comparable to that of CM. In addition, it was reported that acupuncture treatment was superior to CM in NDI (19).
Discussion
Systematic reviews/meta-analyses, as the highest level of evidence source in evidence-based medicine, have become an important basis for evidence-based decision-making (21). However, SRs/MAs with low quality might affect the applicability of evidence. In this study, we performed an umbrella review to collate, evaluate, and synthesize the current evidence on acupuncture for FD.
Main Results
First, 10 SRs/MAs published between 2014 and 2021 were included, nine of which were published over the past 5 years, indicating an increasing interest in acupuncture for FD. Second, based on the AMSTAR-2 tool, the PRISMA statement, and the GRADE system, the methodological quality, reporting quality, and evidence quality, respectively, of the included studies did not meet the requirements of the Cochrane Handbook, which means that the conclusions of the included studies may be different from the real situation and cannot provide reliable evidence for the investigators. Third, there is considerable room for improving the methodological quality and reporting the quality of SRs/MAs. This study highlights common areas for improvement such as protocols designed and registered in advance, comprehensive literature search strategies, providing a transparent list of excluded trials, and declaring funding and conflicts of interest. Fourth, there is considerable room for improving the methodological quality of RCTs. This study highlights the common areas for improvement in RCTs, such as a strict implementation of randomization and allocation concealment and adequate reporting of blinding methods. In addition, while almost all outcome measures lead to positive conclusions, it is worth noting that most authors were reluctant to draw definitive conclusions on the effects of acupuncture for FD due to the small size or low quality of the RCTs.
Impact on Further Research
This study highlights several challenges for producers of SRs/MAs that should be addressed. First, by using the AMSTAR-2 tool and the PRISMA statement, it was observed that the registration of protocols was far from being appreciated by authors of SRs/MAs. Only one Cochrane SR/MA provided a protocol registration, whereas none of the other studies provided that. It is well-known that a preregistration protocol helps to improve transparency, minimize the potential risk of bias arising from the research process, reduce duplicate work between different researchers, and keep the study up-to-date (22). Authors are advocated to register protocols in a freely open database (PROSPERO, http://www.crd.york.ac.uk/prospero) to avoid study bias. Secondly, the risk of bias in identification and literature selection was far from being paid attention to by authors of SRs/MAs. That is, authors of SRs/MAs should provide a comprehensive search strategy and be aware that an appropriate range of databases or electronic sources of published literature should be included. In addition to the database search, other methods were considered for identifying relevant literature, such as meeting reports and trial registration platforms. Furthermore, a list of excluded trials and account for exclusion help to guarantee transparency; it can be presented by direct reference or as a supplementary file. Finally, funding sources should be fully reported as results from commercially funded research might be biased toward funders (23).
Based on the GRADE system, the risk of bias of the enrolled RCTs was the most common downgrading factor, indicating that the root cause of the reduced quality of evidence lies in the quality of the original RCTs. Only well-designed and rigorously conducted RCTs may reduce or avoid bias (24). Specific methods of randomization should be clearly described to reflect whether randomization has been successfully achieved. In addition, the information on allocation concealment and blind method should be fully reported. Due to the peculiarity of acupuncture, although blinding physicians is challenging, attempts should be made to blind patients, other caregivers, and outcome assessors to minimize the risk of bias. With the development of evidence-based acupuncture, it is hoped that researchers will continue to promote standardization and precision in the future by improving the technical operating procedures of acupuncture. Moreover, it should be realized that a large sample size and high-quality RCTs should be fundamental to high-quality evidence sources.
Limitations
This study highlights areas of improvement in the SR/MA process that may help guide future high-quality research. However, the widely used AMSTAR-2 tool, PRISMA statement, and GRADE system are all subjective evaluation tools, and the accuracy of assessor's assessments cannot be guaranteed.
Conclusion
Acupuncture seems to have a promising efficacy in the treatment of FD. Although the quality of the included SRs/MAs was generally low and defects were frequent, our study highlights areas where methodologies need to be improved.
Data Availability Statement
The original contributions presented in the study are included in the article, further inquiries can be directed to the corresponding authors.
Author Contributions
JH and JL initiated the study design and drafted the manuscript. ML, JingM, ZL, and JinxM helped with the implementation of this work. FW and XT contributed to methodology, review, and editing. All authors read and approved the final manuscript.
Funding
This study was supported by the National Natural Science Foundation of China [Nos. 81873297 and 81804078], the State Administration of Traditional Chinese Medicine Digestive Refractory Disease Inheritance and Innovation Team Project [No. ZYYCXTD-C-202010], and the Excellent Young Scientist Fund of China Academy of Chinese Medical Sciences [No. ZZ13-YQ-006].
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Stanghellini V, Chan FK, Hasler WL, Malagelada JR, Suzuki H, Tack J, et al. Gastroduodenal disorders. Gastroenterology. (2016) 150:1380–92. doi: 10.1053/j.gastro.2016.02.011
2. Kumar A, Pate J, Sawant P. Epidemiology of functional dyspepsia. J Assoc Physicians India. (2012) 60:9–12.
3. Aro P, Talley NJ, Agréus L, Johansson SE, Bolling-Sternevald E, Storskrubb T, et al. Functional dyspepsia impairs quality of life in the adult population. Aliment Pharmacol Ther. (2011) 33:1215–24. doi: 10.1111/j.1365-2036.2011.04640.x
4. Lacy BE, Weiser KT, Kennedy AT, Crowell MD, Talley NJ. Functional dyspepsia: the economic impact to patients. Aliment Pharmacol Ther. (2013) 38:170–7. doi: 10.1111/apt.12355
5. Chuah KH, Mahadeva S. Cultural factors influencing functional gastrointestinal disorders in the east. J Neurogastroenterol Motil. (2018) 24:536–43. doi: 10.5056/jnm18064
6. Masuy I, Van Oudenhove L, Tack J. Review article: treatment options for functional dyspepsia. Aliment Pharmacol Ther. (2019) 49:1134–72. doi: 10.1111/apt.15191
7. Huang J, Wu M, Liang S, Qin X, Shen M, Li J, et al. A critical overview of systematic reviews and meta-analyses on acupuncture for poststroke insomnia. Evid Based Complement Alternat Med. (2020) 2020:2032575. doi: 10.1155/2020/2032575
8. Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. (2017) 358:j4008. doi: 10.1136/bmj.j4008
9. Moher D, Liberati A, Tetzlaff J, Altman D. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. (2009) 339:b2535. doi: 10.1136/bmj.b2535
10. Pollock A, Farmer SE, Brady MC, Langhorne P, Mead GE, Mehrholz J, et al. An algorithm was developed to assign GRADE levels of evidence to comparisons within systematic reviews. J Clin Epidemiol. (2016) 70:106–10. doi: 10.1016/j.jclinepi.2015.08.013
11. Han J, Wang HC, Rong P, et al. Systematic review and meta-analysis of the therapeutic effect on functional dyspepsia treated with acupuncture and electroacupuncture. World J Acupunct Moxibustion. (2021) 31:44–51. doi: 10.1016/j.wjam.2020.11.015
12. Mao X, Guo S, Ni W, et al. Electroacupuncture for the treatment of functional dyspepsia: a systematic review and meta-analysis. Medicine. (2020) 99:e23014. doi: 10.1097/MD.0000000000023014
13. Yuan XX, Wang BY, Yang L, Li D-d, Liang H, Zhang Y-l. Efficacy of manual acupuncture on functional dyspepsia: a meta-analysis of randomized, controlled trials. Afr J Tradit Complement Altern Med. (2017) 14:38–55. doi: 10.21010/ajtcam.v14i6.5
14. Zhou W, Su J, Zhang H. Efficacy and safety of acupuncture for the treatment of functional dyspepsia: meta-analysis. J Altern Complement Med. (2016) 22:380–9. doi: 10.1089/acm.2014.0400
15. Pang B, Jiang T, Du YH, Li J, Li B, Hu YC, et al. Acupuncture for Functional Dyspepsia: What Strength Does It Have? a systematic review and meta-analysis of randomized controlled trials evid based complement. Alternat Med. (2016) 2016:3862916. doi: 10.1155/2016/3862916
16. Kim KN, Chung SY, Cho SH. Efficacy of acupuncture treatment for functional dyspepsia: a systematic review and meta-analysis. Complement Ther Med. (2015) 23:759–66. doi: 10.1016/j.ctim.2015.07.007
17. Lan L, Zeng F, Liu GJ, Ying L, Wu X, Liu M, et al. Acupuncture for functional dyspepsia. Cochrane Database Syst Rev. (2014) 10:CD008487. doi: 10.1002/14651858.CD008487.pub2
18. Peng JR, Tao SY, Yang CX, et al. Efficacy of acupuncture on dyspesia subtypes: a systematic review. J Tradit Chin Med. (2018) 45:1594–8.
19. Jin X, Cai WR, Xu PD. The effect of acupuncture and moxibustion on functional dyspepsia compared with prokinetic agents: a meta-analysis. World Latest Medicine Information. (2018) 18:9–12.
20. Wu XW, Ji HZ, Xu LE, et al. The effect of acupuncture and moxibustion on functional dyspepsia compared with prokinetic agents: a meta-analysis. Chin J Integr Med. (2015) 23:100–4.
21. Manchikanti L, Benyamin RM, Helm S, Hirsch JA. Evidence-based medicine, systematic reviews, and guidelines in interventional pain management: part 3: systematic reviews and meta-analyses of randomized trials. Pain Physician. (2009) 12:35–72. doi: 10.36076/ppj.2009/12/35
22. PLoS Medicine Editors. Best practice in systematic reviews: the importance of protocols and registration. PLoS Med. (2011) 8:e1001009. doi: 10.1371/journal.pmed.1001009
23. Schmieder RE, Neuzil P. Scientific data and transparency of conflict of interest are important, not biased editorial without facts. JACC Cardiovasc Interv. (2016) 9:2263. doi: 10.1016/j.jcin.2016.09.004
Keywords: reliability, evidence, decision-making, acupuncture, functional dyspepsia
Citation: Huang J, Liu J, Liu Z, Ma J, Ma J, Lv M, Wang F and Tang X (2022) Reliability of the Evidence to Guide Decision-Making in Acupuncture for Functional Dyspepsia. Front. Public Health 10:842096. doi: 10.3389/fpubh.2022.842096
Received: 23 December 2021; Accepted: 21 February 2022;
Published: 01 April 2022.
Edited by:
Kevin Lu, University of South Carolina, United StatesReviewed by:
Seok-Jae Ko, Kyung Hee University, South KoreaShen Guoming, Anhui University of Chinese Medicine, China
Copyright © 2022 Huang, Liu, Liu, Ma, Ma, Lv, Wang and Tang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Fengyun Wang, d2Z5ODExJiN4MDAwNDA7MTYzLmNvbQ==; Xudong Tang, dHhkbHkmI3gwMDA0MDtzaW5hLmNvbQ==
†These authors have contributed equally to this work