Skip to main content

ORIGINAL RESEARCH article

Front. Immunol., 19 August 2024
Sec. Nutritional Immunology
This article is part of the Research Topic Natural Products and Their Derivatives in the Treatment of Inflammatory and Autoimmune Diseases View all 9 articles

Reporting quality and risk of bias of randomized controlled trials of Chinese herbal medicine for multiple sclerosis

Jing-Ying WuJing-Ying Wu1Jiang-Li YangJiang-Li Yang1Jia-Ling HuJia-Ling Hu1Shan XuShan Xu1Xiao-Jie ZhangXiao-Jie Zhang1Shi-Yan QianShi-Yan Qian1Min-Li ChenMin-Li Chen2Mahad Abdulkadir AliMahad Abdulkadir Ali1Juan ZhangJuan Zhang1Zheng ZhaZheng Zha1Guo-Qing Zheng*Guo-Qing Zheng1*
  • 1Department of Neurology, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou, China
  • 2Science and Technology Innovation Center, Guangzhou University of Chinese Medicine, Guangzhou, China

Background: Multiple sclerosis (MS) is the most common non-traumatic disabling disease affecting young adults. A definitive curative treatment is currently unavailable. Many randomized controlled trials (RCTs) have reported the efficacy of Chinese herbal medicine (CHM) on MS. Because of the uncertain quality of these RCTs, the recommendations for routine use of CHM for MS remain inconclusive. The comprehensive evaluation of the quality of RCTs of CHM for MS is urgent.

Methods: Nine databases, namely, PubMed, Embase, Web of Science, Cochrane Library, EBSCO, Sinomed, Wanfang Database, China National Knowledge Infrastructure, and VIP Database, were searched from inception to September 2023. RCTs comparing CHM with placebo or pharmacological interventions for MS were considered eligible. The Consolidated Standards of Reporting Trials (CONSORT) and its extension for CHM formulas (CONSORT-CHM Formulas) checklists were used to evaluate the reporting quality of RCTs. The risk of bias was assessed using the Cochrane Risk of Bias tool. The selection criteria of high-frequency herbs for MS were those with cumulative frequency over 50% among the top-ranked herbs.

Results: A total of 25 RCTs were included. In the included RCTs, 33% of the CONSORT items and 21% of the CONSORT-CHM Formulas items were reported. Eligibility title, sample size calculation, allocation concealment, randomized implementation, and blinded description in CONSORT core items were reported by less than 5% of trials. For the CONSORT-CHM Formulas, the source and authentication method of each CHM ingredient was particularly poorly reported. Most studies classified the risk of bias as “unclear” due to insufficient information. The top five most frequently used herbs were, in order, Radix Rehmanniae Preparata, Radix Rehmanniae Recens, Herba Epimedii, Scorpio, and Poria. No serious adverse effect had been reported.

Conclusions: The low reporting of CONSORT items and the unclear risk of bias indicate the inadequate quality of RCTs in terms of reporting completeness and result validity. The CONSORT-CHM Formulas appropriately consider the unique characteristics of CHM, including principles, formulas, and Chinese medicinal substances. To improve the quality of RCTs on CHM for MS, researchers should adhere more closely to CONSORT-CHM Formulas guidelines and ensure comprehensive disclosure of all study design elements.

1 Introduction

Multiple sclerosis (MS) is an autoimmune-mediated degenerative disease of the central nervous system (CNS), characterized by inflammatory demyelination (1). MS is the most common non-traumatic disabling disease to affect young adults (2). MS can lead to muscle weakness, sensory deficits, cognitive impairment, and fatigue (3), which ultimately affect quality of life. Despite extensive research, the underlying pathophysiology of MS remains poorly elucidated, and a definitive curative treatment is currently unavailable (4). The current treatment of MS mainly includes hormone therapies in the acute phase, disease-modifying therapies (DMTs), and symptomatic therapies in the remission phase (2). DMTs have been shown to decrease the frequencies of relapse and the accumulation of disability (5). However, the exacerbation and even new occurrence of several autoimmune diseases associated with MS have been reported as a result of DMTs (6). A network meta-analysis of the Cochrane database found that drugs used for immunotherapy may increase withdrawals (7). The American Academy of Neurology practice guideline on the efficacy and safety of DMTs in MS mentions the following (8): “Immunosuppressive medications may increase the risk of opportunistic infection and malignancy, especially with prolonged use”. Cryptococcal infections with fingolimod use and herpes family virus infections with natalizumab use have been reported (9, 10). DMTs may also cause other adverse events, including heart blocks, bradycardia, macular edema, and secondary autoimmune adverse effects (11).

Many patients with MS resorted to modalities of complementary and alternative medicine, which is used by 57%–81% of patients with MS in developed countries (12). More and more research focused on the efficacy of Chinese herbal medicine (CHM) on MS. For example, astragaloside IV (ASI) is an active monomer isolated from the Chinese medicine Astragalus membranaceus. In mice with experimental autoimmune encephalomyelitis (EAE), an ideal animal model for MS, early administration of ASI can delay onset and reduce disease severity (13). Bushen Yisui Formula contains 10 kinds of herbs, such as Radix Rehmanniae Preparata, Radix Rehmanniae Recens, Scorpio, and Polygonum Multiflorum, and exhibits neuroprotective effect against EAE by promoting oligodendrocyte progenitor cells’ proliferation and differentiation, thus facilitating remyelination (14). Two meta-analyses (15, 16) have proved the effectiveness of CHM in the treatment of MS. There are also a large number of randomized controlled trials (RCTs) demonstrating the effectiveness of CHM for MS. High-quality RCTs, particularly double-blind placebo-controlled trials, are generally considered to be the highest level of evidence for judging the therapeutic efficacy and safety of interventions. The credibility of the evidence supporting treatment depends on the quality of RCTs. However, an overwhelming body of evidence suggests that the quality of RCT reports remains sub-optimal (17). The reporting of methodology and bias in herbal RCTs is particularly inadequate (18). One review concluded that less than 10% of herbal medicine trials used an appropriate randomization method (19). It is noteworthy that no research has evaluated the quality of RCTs of CHM on MS currently.

The Consolidated Standards of Reporting Trials (CONSORT) checklist is commonly used to evaluate the reporting quality of RCT. Introduced in 1996 (20), it was further revised in the current 2010 version. Compliance with CONSORT has been studied in many medical fields with the general conclusion that reporting quality needs to be improved (2123). Different CHM formulas exhibit discrepancies in composition, dosage, and duration of interventions, which may translate into high variability and low reproducibility in the outcomes assessed. Therefore, we need an adequately robust design of RCT about CHM formulas. The CONSORT extension for CHM Formulas was created in 2017 (24).

Reporting checklists just evaluate whether a study is reported in detail or not, or if important information is provided to allow reproducibility (25). They do not assess whether the procedure reported was, in fact, the correct one to use. Therefore, reporting checklists do not have adequate content validity to assess whether a study is of good/bad quality or whether a study has a high or low risk of bias (26). The Cochrane Risk of Bias tool was developed to assess the degree to which the results of a study “should be believed” (27). Therefore, we used the CONSORT, CONSORT-CHM Formulas checklists, and the Cochrane Risk of Bias tool simultaneously for assessing the quality of the RCTs of CHM for MS in terms of completeness of reporting and validity of results, to provide a more comprehensive update on RCTs that investigated the efficacy and safety of CHM in the treatment of MS.

2 Methods

2.1 Data sources and search

Nine databases, namely, PubMed, Embase, Web of Science, Cochrane Library, EBSCO, Sinomed, Wanfang Database, China National Knowledge Infrastructure, and VIP Database, were searched from the establishment of the database to September 2023. MS and its synonyms in combination with the terms of CHM or their proprietary names were used as search terms, all as MeSH and as free-text words. Chinese databases were also searched using the above search terms in Chinese.

2.2 Eligibility criteria

The study design was RCTs that evaluate CHM in the treatment of MS, regardless of language or publication status. Patients were diagnosed with MS according to recognized criteria internationally, such as Poser (28) and McDonald (29, 30), regardless of sex, age, race/ethnicity, geographical residence, or course of disease. The experimental group used CHM as monotherapy or adjuvant therapy, not including acupuncture and needle punching. There is no restriction on the frequency and dosage of CHM. The duration of the treatment course was at least 3 weeks. The intervention for the control group was placebo plus Western medicine (WM), or WM alone or placebo alone.

2.3 Exclusion criteria

Exclusion criteria included animal experiments, case reports, reviews, retrospective studies, repeated publications, and historical controlled studies.

2.4 Data extraction

Two independent researchers (JW and JY) extracted the following data from the included studies using a standard table, including author, year, the criteria for diagnosing MS, intervention, dosage, control, number of participants, age, sex, treatment duration, follow-up period, outcome measures, and intergroup differences. Any disagreements on data extraction were resolved by a third reviewer (SX).

2.5 Reporting quality

We used the CONSORT 2010 and CONSORT-CHM Formulas 2017 checklists as assessment tool for reporting quality. Two researchers (JW and JH) independently extracted information according to two checklists, who were blinded to each other’s ratings. “1” or “0” was scored to represent whether the RCT had reported the relevant item/subitem or not. “0” indicates no description of the corresponding item/subitem, and “1” indicates that the author had mentioned the description of the item/subitem in the report. Discrepancies were resolved by a third reviewer (MC). Furthermore, we summarized the CONSORT checklist into five sections: Title/Abstract and Introduction, Methods, Results, Discussion, and Other Information. We also grouped and compared manuscripts revised before CONSORT (before 2010) and after it has been revised. The CONSORT-CHM Formulas checklist was published in 2017, and we compared manuscripts published before with those published after 2017.

2.6 Risk of bias

The risk of bias was evaluated by using the RCT risk of bias assessment tool recommended by the Cochrane Handbook (31) and was performed independently by two researchers (JW and JH). If there was disagreement, they were discussed with and resolved by a third reviewer (SQ).

2.7 Description of the CHMs

The selection criteria of high-frequency herbs in the treatment of MS were those with cumulative frequencies over 50% among the top-ranked herbs. We also summarized the mechanisms of Chinese medicine monomers for MS that have been reported in previous studies.

2.8 Data analysis

We used Microsoft Excel 2016 for descriptive statistical analysis and counted the total number of RCTs corresponding to each CONSORT project. The subsequent results shown as percentages and 95% confidence intervals (CIs) were calculated for each overall ratio. SPSS (version 25.0) was used for statistical calculation. The significance level was presumed as p < 0.05.

3 Results

3.1 Study selection

The flowchart of the research selection process is listed in Figure 1. A total of 4,029 potentially relevant articles were identified, and 1,249 duplicates were excluded. Another 2,736 articles were excluded through screening titles and abstracts, leaving 44 articles for further evaluation. Nineteen studies were excluded for the following reasons: 14 articles were not RCTs, 3 articles were less than 3 weeks in the duration of treatment course, and 2 articles were suspected of being published more than once. Ultimately, 25 eligible studies were selected in this study (3256).

Figure 1
www.frontiersin.org

Figure 1. Flowchart of research selection process.

3.2 Study characteristics

Table 1 shows partial information regarding the study characteristics. More details about the studies are shown in Additional file 1. A total of 1,450 participants were included in the 25 studies from 2004 to 2020, of whom 742 were in the treatment group, and 708 were in the control group. The ages ranged from 20 to 75 years old. The participants were 830 women and 607 men. Two studies (44, 45) did not report the sex of the participants. All the studies did not report sex disparity in response to treatment. All of the studies were conducted in China. One study was published in English (46), and the other 24 studies were published in Chinese. Eight studies (32, 33, 3538, 53, 55) were diagnosed according to the Poser criteria; 17 studies (34, 3952, 54, 56) were diagnosed according to the McDonald criteria. A total of 24 RCTs used CHM in combination with WM as the treatment group, and only 1 RCT used CHM alone as the treatment group. The duration of the studies lasted from 3 weeks to 135 days. As for outcome measure, 15 studies (32, 3437, 40, 41, 43, 46, 4850, 52, 54, 56) used the Expanded Disability Status Score (EDSS), 7 studies (32, 36, 37, 44, 46, 48, 49) used annual relapse frequency, 2 studies (46, 55) used annual relapse rate, and 2 studies (42, 44) used annual relapse interval. The total clinical efficacy rate was observed in 16 studies (3235, 3841, 43, 45, 5156). Two studies used (50, 53) the Barthel index, and 2 studies (53, 56) used the SF-36 score.

Table 1
www.frontiersin.org

Table 1. The characteristics of the included trials.

Adverse effects were reported in 6 studies (32, 33, 38, 43, 45, 52), while the remaining 19 studies did not mention them. Four (32, 38, 43, 52) out of the six studies reported that no adverse effects happened in the CHM group. Wang et al. (33) reported two cases of adverse events in the CHM group and three cases in the WM group. Obesity and acne (45) were reported in the CHM group. Obesity, acne, liver dysfunction, and neuropsychiatric symptoms were reported in the WM group (43, 45). However, all studies did not mention life-threatening adverse effects.

3.3 Reporting quality

The 25 included studies consisted of 24 CHM formula studies and 1 CHM monomer study (51). The CONSORT-CHM Formulas checklist is used to evaluate the reporting quality of CHM formula RCTs. We therefore performed CONSORT scores on all included studies and CONSORT-CHM scores on 24 studies except for the monomer study. The distribution of the number of CONSORT and CONSORT-CHM Formulas items satisfied by the included studies is shown in Figures 2, 3. The CONSORT and CONSORT-CHM Formulas checklist sections are summarized in Figure 4 and individual items are described in Table 2.

Figure 2
www.frontiersin.org

Figure 2. Distribution of the number of CONSORT items satisfied by the included studies.

Figure 3
www.frontiersin.org

Figure 3. Distribution of the number of CONSORT-CHM Formulas items satisfied by the included studies.

Figure 4
www.frontiersin.org

Figure 4. Numbers and percentages of CONSORT and CONSORT-CHM Formulas checklist sections reported by time period.

Table 2
www.frontiersin.org

Table 2. Number and percentage of CONSORT and CONSRT-CHM Formulas checklist items reported in the included studies.

3.3.1 CONSORT

Most of the items were satisfied by a few studies. Analysis of the included studies showed that, on average, 33% of the recommended items were reported. Fan et al. (52) reported the highest percentage of recommended items, at 47%, and Chen and Wang (48) and Yang et al. (39) reported the lowest percentage of recommended items, at 24%.

Only one (4%) trial could be identified as RCT after reading the title. Abstracts were structured appropriately in 92% of included studies and introductions were structured appropriately in 82%.

Seventeen items related to the methods section and were included in just 35% of included studies. Eight CONSORT items were not described in any of the articles (0%), and they were description of significant changes in the experimental method (item 3b), whether there are changes in the trial outcomes after the commencing of the experiment (item 6b), how sample size was determined (item 7a) and the explanation of any interim analysis and stopping guidelines (item 7b), the type of randomization (item 8b), the mechanism used to implement the random allocation sequence (item 9), the similarity of interventions (item 11b), and methods for additional analyses (item 12b).

The results sections included 11 items and were underreported. Overall, just 22% of included studies reported these items. None of the articles (0%) described the treatment progress with a diagram (item 13a), the reasons why the trial ended or was stopped (item 14b), the estimated effect size (item 17a), absolute or relative effect sizes (item 17b), and results of any other analyses performed (item 18).

Three items related to the discussion section, outlined study limitations, generalizability, and interpretation of results, and were reported in 44% of included studies. Information about the trial registration number, availability of the full protocol, and funding sources was reported in 0%, 0%, and 4% of included studies, respectively.

Studies published after the CONSORT checklist was revised in 2010 reported more items, although not significantly. Until 2010, 12 ± 2, or 32% of the items were reported in studies, and from 2010 onwards, 13 ± 2, or 34% were reported (p = 0.657, t = 0.449).

3.3.2 CONSORT-CHM Formulas

The CONSORT-CHM Formulas checklist items were not satisfactorily reported. Of the 39 items, an average of just 21% was reported in the included studies. Fan et al. (52) reported the highest percentage of recommended items, at 41%, and Shi (55), Chen and Wang (48), and Yang et al. (39) reported the lowest percentage of recommended items, at 13%.

Abstracts need to illustrate the name and form of the formula used and the TCM pattern applied. This was reported in only two (8%) of the included studies. None of the articles determined appropriate keywords, including “Chinese herbal medicine formula” and “RCT”. Introductions satisfied the criteria in 25% of the studies.

The methods section was poorly described, with only 21% of items reported on average. Four (17%) trials stated whether participants with a specific TCM pattern were recruited. Three (13%) articles reported the outcome measures related to TCM syndrome in detail. However, none of the articles described the CHM formula in detail, especially the source and authentication method of each CHM ingredient.

Items for the results section were the same as CONSORT. Discussion sections satisfied the criteria in 46% of the studies, but only three (13%) articles provided the discussion of how the formula works on different TCM patterns on disease.

After the CONSORT-CHM Formulas was published in 2017, RCT quality did not improve significantly. Until 2017, 8 ± 2, or 21% of the items were reported in studies, and from 2017 onwards, 8 ± 4, or 21% were reported (p = 0.894, t = 0.135).

3.4 Risk of bias

The summary and graph of the risk of bias are shown in Figures 5, 6. Although all the included trials claimed randomization, only eight trials (33, 36, 37, 40, 41, 47, 52, 56) reported the method of random sequence generation. Only one study (52) mentioned allocation concealment, the blinding of participants, and investigator and outcome assessment. All studies reported complete outcome data. All of the studies were free of selective reporting except one study (42). All studies had low risk of other bias, which included incomparable baseline characteristics between the groups. The average item of low risk of bias for the 25 trials was 3.4, accounting for 49% of the total items.

Figure 5
www.frontiersin.org

Figure 5. Risk of bias graph.

Figure 6
www.frontiersin.org

Figure 6. Risk of bias summary.

3.5 Description of the CHMs

A total of 92 herbs were included in the 25 studies. The top 29 most frequently used herbs were ordinally Prepared Rehmannia Root (Radix Rehmanniae Preparata), Fresh Rehmannia Root (Radix Rehmanniae Recens), Epimrdii (Herba Epimedii), Scorpion (Scorpio), Indian Bread (Poria), Asiatic Cornelian Cherry Fruit (Fructus Corni), Stiff Silkworm (Bombyx Batryticatus), Root of Membranous Milkvetch (Radix Astragali), Root of Medicil cyathula (Radix Cyathulae), Root of Chinese Angelica (Radix Angelicae Sinensis), Root of Ural Licorice (Radix Glycyrrhizae), Red Peony Root (Radix Paeoniae Rubra), Root Pilose Asiabell (Radix Codonopsis pilosulae), Dodder Seed (Semen Cuscuta), Tuber Fleeceflower (Polygonum Multiflorum), Seed of Jobstears (Semen Coicis), White Peony Root (Radix Paeoniae Alba), Desertliving Cistanche (Herba Cistanches), Phellodendron Bark (Cortex Phellodendri), Earthworm (Pheretima), Tall Gastrodia (Gastrodia Elata), Common Yam Rhizome (Rhizoma Dioscoreae), Eucommia Bark (Cortex Eucommiae), Fruit of Chinese Wolfberry (Fructus Lycii), Dried Tangerine Peel (Pericarpium Citri Reticulatae), Bulb of Fritillary (Bulbus Fritillariae), Leech (Hirudo), Szechuan Lovage Root (Rhizoma Chuanxiong), and Tuber of Pinellia (Rhizoma Pinelliae), which were used more than four times (Table 3). The cumulative percentage of these herbs was 62%.

Table 3
www.frontiersin.org

Table 3. Analysis of high-frequency herbs in the treatment of MS.

The summary of the mechanisms of Chinese medicine monomers in the treatment of MS is shown in Table 4. Most Chinese medicine monomers can relieve inflammatory injury by inhibiting PI3K/Akt, NF-κB, and TLR4 signaling pathways and reducing the release of inflammatory factors TNF-α, IL-17A, IL-6, IL-23, IL-1β, and IFN-γ (58, 65, 68). Ginsenoside-Rg3 can regulate NOX2/4 oxidative stress-related pathways, reduce the expression of NOX, exert the effect of anti-oxidative stress, and improve the blood–brain barrier integrity (64). Ginsenoside Rd, Tanshinon IIA, Cordyceps sinensis extract, Rhodiola rosea, Baicalein, and Periplocoside A regulate the imbalance of Th17/Th1/Treg subsets and modulate immunity (63, 67, 70, 71, 73). Emodin and Matrine can upregulate the expression of the neurotransmitter-nutrient factor BDNF, improve the microenvironment of nerve survival, promote myelin repair and regeneration, and exert neuroprotective effects (65, 69).

Table 4
www.frontiersin.org

Table 4. The mechanisms of Chinese medicine monomers in the treatment of MS.

4 Discussion

4.1 Principal findings

This article revealed that less than 50% of CONSORT and CONSORT-CHM Formulas items were reported in RCTs of CHM for MS. Moreover, revision of the CONSORT checklists and publication of CONSORT-CHM Formulas checklists had not significantly improved the quality of reporting in these studies. Consistently, the risk of bias in most RCTs was classified as “unclear.” The low proportion of CONSORT items reported and the unclear risk of bias indicated that the quality of RCTs of CHM for MS was inadequate in terms of completeness of reporting and validity of results.

4.1.1 Reporting quality

RCTs of CHM in the treatment of MS had poor compliance with CONSORT and CONSORT-CHM Formulas statements. The average CONSORT and CONSORT-CHM Formulas proportions of all included studies were only 33% and 21%, respectively. To sum up, these studies had the following shortcomings:

From the perspective of CONSORT (1): The title did not indicate that the corresponding article is an RCT. Only one article in this study could be seen as an RCT based on the title (2). No article explained how to calculate the sample size. Relevant studies have found that if the pre-test sample size is not estimated, there is a lack of statistical ability to ensure the proper estimation of the treatment effect (74) (3). Most articles lacked the description of the randomization process, allocation concealment, and the blind method. However, randomization is necessary to avoid selection bias and the blinding procedure is an essential method for preventing research outcomes from being influenced by either the placebo effect or observer bias (4). No article showed a diagram of participant flow. Dropouts were only reported in one trial. These might reduce the credibility of the results (5). The estimated effect size or absolute and relative effect size can help readers better understand the benefits of drugs, but no article in this study provided the corresponding content (6). In the discussion, only a few articles explained the limitations and generalizability (7). Among other things, none of the trials in this study were registered and provided trial protocol. It was not conducive to improve transparency and accountability (75). Only one article explained the source of funds and conflict of interest.

From the perspective of CONSORT-CHM Formulas (1): No article added “Chinese herbal medicine formula” and “RCT” to the keywords (2). None of the articles reported in detail the source and authentication method of each CHM ingredient of CHM formula (3). All articles described the outcome indicators in detail, but only 13% of them reported the outcome indicators related to traditional Chinese medicine (TCM) syndromes.

The poor reporting quality of RCTs related to CHMs may not only affect the judgment of commentators and readers on their efficacy and safety (76) and reduce the value of CHMs, but also finally hinder the application and development of CHMs in the treatment of MS. Using the CONSORT guideline to ensure complete reporting is not difficult, and even brief additions during manuscript writing can resolve important omissions. For example, merely adding the words “random” or “randomized” to the title increases the likelihood that readers can readily identify RCTs (77). Although blinding itself may not always be feasible, reporting the extent to which blinding was addressed is crucial to enable readers to judge whether the presence or absence of blinding may have influenced results. Registration of study protocols allows readers to contrast planned and reported study methods, assists researchers in identifying ongoing work, and reduces unnecessary duplication (78). Furthermore, descriptions of detailed information about the herb would help readers to generalize and replicate the study (79). If reporting guidelines such as CONSORT-CHM Formulas are used at the outset of study design, the impact on reporting quality may be the greatest.

4.1.2 Association and comparison between the risk of bias and reporting quality

In this article, we found that the study with the highest percentage of CONSORT and CONSORT-CHM Formulas items had the lowest risk of bias. Studies in other medical fields showed similar findings to our study, in that better reporting quality was associated with lower risk of bias (8082). However, the study with the lowest percentage of CONSORT and CONSORT-CHM Formulas items did not have the worst performance in the risk of bias. This indicated that although studies with poor reporting quality were incomplete and had low repeatability, the risk of bias might not be high and the results were valid to some extent. In this article, the study with the highest risk of bias did not have the lowest percentage of CONSORT and CONSORT-CHM Formulas items. It showed that the study with a high risk of bias lacked description of random sequence generation, allocation concealment, and outcome assessment blinding, but this did not mean the authors of the study used inappropriate research methods. Therefore, reporting quality and risk of bias are completely different concepts and still appear to create confusion in how they are being applied in the biomedical literature (26).

The risk of bias assesses the internal validity of RCTs, in other words, an evaluation of the true effect estimate. The reporting quality assesses the completeness of reporting. The risk of bias tool is most useful for assessing the authenticity of the result and bias retrospectively, but the CONSORT checklists are more appropriately applied in the guidance of prospective clinical studies (79). If researchers expect to obtain more complete and transparent RCTs in retrospective studies, the CONSORT checklists can also be a good choice.

It is worth noting that the herbal compounds are often in their natural form and quality control including authentication of constituents can be variable (83). Furthermore, effective application of traditional medicine theory to ensure data are valid and can be properly interpreted is difficult (84). The CONSORT-CHM Formulas adequately take into account the unique characteristics of TCM—theory, principles, formulas, and Chinese medicinal substances (24), which offer tailored guidance for assessing the methodological rigor and transparency of RCTs in CHM formulas. However, despite the availability of the CONSORT-CHM Formulas, introduced in 2017, its utilization appears to be less widespread compared to other CONSORT extensions (85). CONSORT extensions for nonpharmacological treatments have proven valuable in evaluating the reporting quality of relevant RCTs in corresponding domains (86). In this article, we recognized the potential of CONSORT-CHM Formulas in improving the reporting quality of RCTs in CHM formulas. Therefore, to develop better-quality RCTs of CHM for MS, a rigorous design that integrates safety, efficacy, and patient-centered endpoints in accordance with the CONSORT-CHM Formulas guidelines is needed.

4.2 CHM in the treatment of MS

In the included studies, there were seven (33, 36, 37, 41, 47, 52, 55) studies with a low bias score of 4 and above, and CONSORT and CONSORT-CHM scores of 8 and above, which were of higher quality in terms of result validity and reporting completeness. A total of 33 herbs were used in these seven studies. Prepared Rehmannia Root (Radix Rehmanniae Preparata) and Fresh Rehmannia Root (Radix Rehmanniae Recens) were used five and four times, respectively, and were also the top two herbs in our count of high-frequency herbs. The remaining seven herbs that were used three times were as follows: Scorpion (Scorpio), Tuber Fleeceflower (Polygonum Multiflorum), Bulb of Fritillary (Bulbus Fritillariae), Leech (Hirudo), Motherwort (Herba Leonuri), Tall Gastrodia (Gastrodia Elata), and Weeping Forsythia Capsule (Fructus Forsythiae), all of which were also high-frequency herbs, except for Motherwort and Weeping Forsythia Capsule. The seven studies reported four outcome measures. Four (36, 37, 41, 52) studies used EDSS, and three (36, 37, 41) studies showed a significant effect of CHM in reducing EDSS compared to the WM group. Four (33, 41, 52, 55) studies reported that CHM significantly improved the total clinical efficacy rate. One (33) out of two (33, 36) studies reported that CHM significantly reduced the annual relapse frequency. One (55) study reported that CHM significantly reduced the annual relapse rate. The selected high-frequency herbs from the present study mostly tonified the liver and kidney. In TCM, it is widely believed that the pathogenesis of MS is related to deficiencies in the kidney, liver, and spleen. These high-frequency herbs are promising candidates for future clinical applications and MS trials.

The major challenge in the treatment of MS remains understanding and targeting the continuous neurodegeneration in people with MS at present (87). The mechanisms that lead to neurodegeneration in MS involve a complex interplay between neuroinflammation, oxidative stress and mitochondrial dysfunction, and iron toxicity (88). Chinese medicine monomers have significant biological activity proved by many experiments. They can act on multiple aspects of the pathogenesis of MS, such as inflammatory response, immunity, apoptosis, and nerve injury (89). Our summary of previous research mechanisms reveal the following: The Chinese medicine monomers can reduce the release of inflammatory factors and relieve inflammatory injury by inhibiting PI3K/Akt, NF-κB, and TLR4 signaling pathways (58, 65, 68). They can also reduce NOX2 and NOX4 expression to exert the effect of anti-oxidative stress (64). The Chinese medicine monomers regulate the imbalance of Th17/Th1/Treg subsets and modulate immunity (63, 67, 70, 71, 73). The monomers can upregulate the expression of the neurotransmitter-nutrient factor BDNF and promote myelin repair and regeneration (65, 69). However, the current research mechanisms of Chinese medicine monomers are mostly limited to the study of inflammatory factors, chemokines, and common inflammatory metabolic pathways. There are few studies that discuss the potential molecular mechanisms of promoting myelin regeneration. The research on the internal relationship between various factors and the crosstalk mechanism between multiple signaling pathways is relatively scarce. Furthermore, the latest progress of MS reported in The Lancet Neurology journal states that “oxidative stress and mitochondrial dysfunction contributing to glial and neuronal injury, axonal energy failure, and loss of neuronal network function may be key molecular mechanisms driving disease progression. Excessive iron deposition in CNS parenchyma has been hypothesized to be a source of oxidative stress in MS (90).” Chinese medicine monomers are less studied in this area and need to be further explored.

The safety of CHM therapy for MS remains inconclusive. In this study, 24% (6/25) of RCTs mentioned the safety of interventions or investigated adverse effects. In four out of the six studies, it was reported that no adverse effects occurred in the CHM group. In the remaining studies, the adverse effects observed in the CHM group were fewer compared to the WM group. Studies have reported that herbal medicines are generally well tolerated, with adverse effects being limited to mild to moderate (91). Some herbal supplementations did not report risks of drug interactions with conventional MS drugs (4). There is still a need for powerful real-world evidence regarding the safety of CHM and more attention should be given to both recording and reporting the adverse effects of CHM therapy.

4.3 Strengths and limitations

To our knowledge, this is the first time the CONSORT, CONSORT-CHM Formulas checklists, and risk of bias have been simultaneously used to assess the quality of RCTs of CHM for MS.

MS remains one of the most common causes of neurological disability in the young adult population (87). A definitive curative treatment of MS is currently unavailable. The prolonged therapy of drugs constantly results in resistance and side effects. CHM formulas may provide a completely new area for the management of MS. Evaluating the quality of RCTs in CHM formulas helps bridge the gap between MS treatments using CHM formulas and modern WM. Our research may help provide a more rigorous understanding of CHM’s efficacy and safety by evaluating the quality of RCTs in CHM formulas for MS. Furthermore, in the modern era of evidence-based practice, our findings will help improve the quality of RCT in CHM formulas for MS, aiding clinicians in making informed decisions of CHM formulas based on the best available evidence. Finally, we screened high-frequency herbs as promising candidates for future clinical applications and MS trials. Mechanistic studies of Chinese medicine monomers in the field of oxidative stress, mitochondrial dysfunction, iron toxicity, and remyelination are rare and worthy of further research.

This study had some limitations. First, the number of RCTs included in this study was not enough, and there might be a risk of bias. Second, for many elements of reporting checklists and risk for bias, inconsistent judgment may have arisen from raters’ different understanding or difficulties in discerning information from the published reports. Third, the 25 included studies reported different CHMs with variation in terms of composition, dosage, and duration of interventions. Different concentration ratios of the components of CHMs produced different effects, which could influence the bias of the research. This makes it difficult to recommend specific CHMs for clinics. Fourth, exact diagnostic criteria for patients with MS were not considered, as multiple diagnostic criteria were reported in the included RCTs. Different inclusion criteria of the participants may contribute to the heterogeneity of the included studies.

5 Conclusions

The low reporting of CONSORT items and unclear risk of bias indicate inadequate quality of RCTs in terms of reporting completeness and result validity. The CONSORT-CHM Formulas appropriately consider the unique characteristics of CHM, including principles, formulas, and Chinese medicinal substances. To improve the quality of RCTs on CHM for MS, researchers should adhere more closely to CONSORT-CHM Formulas guidelines and ensure comprehensive disclosure of all study design elements. High-frequency herbs are promising candidates for future clinical applications and MS trials.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding author.

Ethics statement

This article is a literature study of previously published data and therefore does not require ethical approval or consent procedures. The manuscript does not contain any personal data in any form (including personal details, pictures or videos).

Author contributions

J-YW: Data curation, Formal analysis, Writing – original draft, Writing – review & editing. J-LY: Data curation, Writing – original draft. J-LH: Data curation, Writing – original draft. SX: Formal analysis, Writing – review & editing. X-JZ: Formal analysis, Writing – review & editing. S-YQ: Formal analysis, Writing – review & editing. M-LC: Formal analysis, Writing – review & editing. MA: Formal analysis, Writing – review & editing. JZ: Formal analysis, Writing – review & editing. ZZ: Formal analysis, Writing – review & editing. G-QZ: Formal analysis, Funding acquisition, Writing – review & editing.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by the preponderant discipline (2023) of the First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine).

Acknowledgments

The authors would like to thank researchers who provided their priceless data for the study.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fimmu.2024.1429895/full#supplementary-material

Abbreviations

MS, multiple sclerosis; CNS, central nervous system; DMTs, disease-modifying therapies; CHM, Chinese herbal medicine; EAE, experimental autoimmune encephalomyelitis; ASI, astragaloside IV; RCTs, randomized controlled trials; EDSS, Expanded Disability Status Score; CONSORT, Consolidated Standards of Reporting Trials; CONSORT-CHM, CONSORT extension criteria on reporting herbal interventions; WM, Western medicine; CIs, confidence intervals; CS, Cordyceps sinensis.

References

1. Wang Y, Wang J, Feng J. Multiple sclerosis and pregnancy: pathogenesis, influencing factors, and treatment options. Autoimmun Rev. (2023) 22:103449. doi: 10.1016/j.autrev.2023.103449

PubMed Abstract | Crossref Full Text | Google Scholar

2. Dobson R, Giovannoni G. Multiple sclerosis - a review. Eur J Neurol. (2019) 26:27–40. doi: 10.1111/ene.13819

PubMed Abstract | Crossref Full Text | Google Scholar

3. Adams L. Multiple sclerosis. Nat Rev Dis Primers. (2018) 4:44. doi: 10.1038/s41572-018-0046-z

PubMed Abstract | Crossref Full Text | Google Scholar

4. Petersen MJ, Bergien SO, Staerk D. A systematic review of possible interactions for herbal medicines and dietary supplements used concomitantly with disease-modifying or symptom-alleviating multiple sclerosis drugs. Phytother Res. (2021) 35:3610–31. doi: 10.1002/ptr.7050

PubMed Abstract | Crossref Full Text | Google Scholar

5. Olek MJ. Multiple sclerosis. Ann Intern Med. (2021) 174:Itc81–itc96. doi: 10.7326/aitc202106150

PubMed Abstract | Crossref Full Text | Google Scholar

6. Konen FF, Möhn N, Witte T, Schefzyk M, Wiestler M, Lovric S, et al. Treatment of autoimmunity: the impact of disease-modifying therapies in multiple sclerosis and comorbid autoimmune disorders. Autoimmun Rev. (2023) 22:103312. doi: 10.1016/j.autrev.2023.103312

PubMed Abstract | Crossref Full Text | Google Scholar

7. Tramacere I, Virgili G, Perduca V, Lucenteforte E, Benedetti MD, Capobussi M, et al. Adverse effects of immunotherapies for multiple sclerosis: A network meta-analysis. Cochrane Database Syst Rev. (2023) 11:Cd012186. doi: 10.1002/14651858.CD012186.pub2

PubMed Abstract | Crossref Full Text | Google Scholar

8. Rae-Grant A, Day GS, Marrie RA, Rabinstein A, Cree BAC, Gronseth GS, et al. Practice guideline recommendations summary: disease-modifying therapies for adults with multiple sclerosis: report of the guideline development, dissemination, and implementation subcommittee of the american academy of neurology. Neurology. (2018) 90:777–88. doi: 10.1212/wnl.0000000000005347

PubMed Abstract | Crossref Full Text | Google Scholar

9. Ellis R, Brown S, Boggild M. Therapy-related acute leukaemia with mitoxantrone: four years on, what is the risk and can it be limited? Mult Scler. (2015) 21:642–5. doi: 10.1177/1352458514541508

PubMed Abstract | Crossref Full Text | Google Scholar

10. Leroy C, Rigot JM, Leroy M, Decanter C, Le Mapihan K, Parent AS, et al. Immunosuppressive drugs and fertility. Orphanet J Rare Dis. (2015) 10:136. doi: 10.1186/s13023-015-0332-8

PubMed Abstract | Crossref Full Text | Google Scholar

11. McGinley MP, Goldschmidt CH, Rae-Grant AD. Diagnosis and treatment of multiple sclerosis: A review. Jama. (2021) 325:765–79. doi: 10.1001/jama.2020.26858

PubMed Abstract | Crossref Full Text | Google Scholar

12. Liu J, Zhang C, Xie Y, Zhou L, Guo L, Li B, et al. Demyelinating diseases of the central nervous system registry for patients with traditional chinese medicine: rationale and design of a prospective, multicenter, observational study. Front Pharmacol. (2022) 13:981300. doi: 10.3389/fphar.2022.981300

PubMed Abstract | Crossref Full Text | Google Scholar

13. Yang L, Han X, Yuan J, Xing F, Hu Z, Huang F, et al. Early astragaloside iv administration attenuates experimental autoimmune encephalomyelitis in mice by suppressing the maturation and function of dendritic cells. Life Sci. (2020) 249:117448. doi: 10.1016/j.lfs.2020.117448

PubMed Abstract | Crossref Full Text | Google Scholar

14. Zhao PY, Wang YQ, Liu XH, Zhu YJ, Zhao H, Zhang QX, et al. Bu shen yi sui capsule promotes remyelination correlating with sema3a/nrp-1, lif/lifr and nkx6.2 in mice with experimental autoimmune encephalomyelitis. J Ethnopharmacol. (2018) 217:36–48. doi: 10.1016/j.jep.2018.02.014

PubMed Abstract | Crossref Full Text | Google Scholar

15. Song L, Zhou QH, Wang HL, Liao FJ, Hua L, Zhang HF, et al. Chinese herbal medicine adjunct therapy in patients with acute relapse of multiple sclerosis: A systematic review and meta-analysis. Complement Ther Med. (2017) 31:71–81. doi: 10.1016/j.ctim.2017.02.004

PubMed Abstract | Crossref Full Text | Google Scholar

16. Liu J, Gao Y, Kan BH, Zhou L. [Systematic review and meta-analysis of randomized controlled trials of chinese herbal medicine in treatment of multiple sclerosis]. Zhong Xi Yi Jie He Xue Bao. (2012) 10:141–53. doi: 10.3736/jcim20120204

PubMed Abstract | Crossref Full Text | Google Scholar

17. Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, et al. Consolidated standards of reporting trials (Consort) and the completeness of reporting of randomised controlled trials (Rcts) published in medical journals. Cochrane Database Syst Rev. (2012) 11:2. doi: 10.1002/14651858.MR000030.pub2

Crossref Full Text | Google Scholar

18. Gagnier JJ, DeMelo J, Boon H, Rochon P, Bombardier C. Quality of reporting of randomized controlled trials of herbal medicine interventions. Am J Med. (2006) 119:800.e1–11. doi: 10.1016/j.amjmed.2006.02.006

PubMed Abstract | Crossref Full Text | Google Scholar

19. Bian Z, Liu B, Moher D, Wu T, Li Y, Shang H, et al. Consolidated standards of reporting trials (Consort) for traditional chinese medicine: current situation and future development. Front Med. (2011) 5:171–7. doi: 10.1007/s11684-011-0132-z

PubMed Abstract | Crossref Full Text | Google Scholar

20. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials. Consort Statement. JAMA. (1996) 276:637–9. doi: 10.1001/jama.276.8.637

Crossref Full Text | Google Scholar

21. Song TJ, Leng HF, Zhong LL, Wu TX, Bian ZX. Consort in China: past development and future direction. Trials. (2015) 16:243. doi: 10.1186/s13063-015-0769-z

PubMed Abstract | Crossref Full Text | Google Scholar

22. Chatzimanouil MKT, Wilkens L, Anders HJ. Quantity and reporting quality of kidney research. J Am Soc Nephrol. (2019) 30:13–22. doi: 10.1681/asn.2018050515

PubMed Abstract | Crossref Full Text | Google Scholar

23. Devos F, Ibrahim N, Foissac F, Bouazza N, Ancel PY, Chappuy H, et al. Comparison of the quality of pediatric randomized controlled trials published in both nursing and medical journals: adherence to the consort statement. Worldviews Evid Based Nurs. (2018) 15:447–54. doi: 10.1111/wvn.12329

PubMed Abstract | Crossref Full Text | Google Scholar

24. Cheng CW, Wu TX, Shang HC, Li YP, Altman DG, Moher D, et al. Consort extension for chinese herbal medicine formulas 2017: recommendations, explanation, and elaboration. Ann Intern Med. (2017) 167:112–21. doi: 10.7326/m16-2977

PubMed Abstract | Crossref Full Text | Google Scholar

25. Plesser HE. Reproducibility vs. Replicability: A brief history of a confused terminology. Front Neuroinform. (2017) 11:76. doi: 10.3389/fninf.2017.00076

PubMed Abstract | Crossref Full Text | Google Scholar

26. Faggion CM Jr. Methodological quality, risk of bias, and reporting quality: A confusion persists. J Evid Based Med. (2023) 16:261–3. doi: 10.1111/jebm.12550

PubMed Abstract | Crossref Full Text | Google Scholar

27. Hartling L, Ospina M, Liang Y, Dryden DM, Hooton N, Krebs Seida J, et al. Risk of bias versus quality assessment of randomised controlled trials: cross sectional study. Bmj. (2009) 339:b4012. doi: 10.1136/bmj.b4012

PubMed Abstract | Crossref Full Text | Google Scholar

28. Poser CM, Paty DW, Scheinberg L, McDonald WI, Davis FA, Ebers GC, et al. New diagnostic criteria for multiple sclerosis: guidelines for research protocols. Ann Neurol. (1983) 13:227–31. doi: 10.1002/ana.410130302

PubMed Abstract | Crossref Full Text | Google Scholar

29. McDonald WI, Compston A, Edan G, Goodkin D, Hartung HP, Lublin FD, et al. Recommended diagnostic criteria for multiple sclerosis: guidelines from the international panel on the diagnosis of multiple sclerosis. Ann Neurol. (2001) 50:121–7. doi: 10.1002/ana.1032

PubMed Abstract | Crossref Full Text | Google Scholar

30. Polman CH, Reingold SC, Edan G, Filippi M, Hartung HP, Kappos L, et al. Diagnostic criteria for multiple sclerosis: 2005 revisions to the "Mcdonald criteria. Ann Neurol. (2005) 58:840–6. doi: 10.1002/ana.20703

PubMed Abstract | Crossref Full Text | Google Scholar

31. Deeks JJ HJ, Altman DG. Chapter 8: assessing risk of bias in included studies. In: Higgins Jp, Green S, editors. Cochrane handbook or systematic reviews of interventions version 6.1.0. The Cochrane Collaboration, UK (2020).

Google Scholar

32. Shi LH, Wang QW. Preliminary study on the effect of integrated traditional chinese and western medicine on the prevention and treatment of recurrence of multiple sclerosis. Guangxi J Traditional Chin Med. (2004) 02):14–7.

Google Scholar

33. Wang YH, Zhao H, Huang JH, Su ZL. Clinical study of jiweiling decoction in the treatment of multiple sclerosis. Modern J Integrated Traditional Chin Western Med. (2006) 12):1608–9.

Google Scholar

34. Zhang GZ, Zhang JS. Clinical study of gusui tongluo decoction in the treatment of multiple sclerosis. J Emergency Traditional Chin Med. (2006) 06):595–6.

Google Scholar

35. Zuo SZ, Jia YL. Yishen gujin tongluo decoction plus western medicine in the treatment of 30 cases of multiple sclerosis. Traditional Chin Medicinal Res. (2006) 19:30–2. doi: 10.3969/j.issn.1001-6910.2006.08.016

Crossref Full Text | Google Scholar

36. Fan YP, Wang P, Zhang XH, Gong HY, Zhou L, Liu XZ, et al. Mechanism exploration of erhuang formula in treating acute episode of disseminated sclerosis. China J Traditional Chin Med Pharm. (2007) 01):25–9.

Google Scholar

37. Gao M, Lin MC, Zhang KN, Lin YY, Lv N. Clinical observation on 38 cases of acute recurrent multiple sclerosis treated with dihuangheji ( Capsule ). Hunan J Traditional Chin Med. (2008) 06):16–7. doi: 10.16808/j.cnki.issn1003-7705.2008.06.008

Crossref Full Text | Google Scholar

38. Zeng HM, Zhang M, Zhang G, Zi XF. A clinical effect observation on the buyang huanwu decoction with hormone treatment for multiple sclerosis. Pract Clin Med. (2009) 10:9–10+4.

Google Scholar

39. Yang HF, Lv EB, Sun CQ. Simiao yong 'an decoction combined with fengsui dan in the treatment of multiple sclerosis. Chin Med Modern Distance Educ China. (2009) 7:21–2.

Google Scholar

40. Li Q, Zhao D. Integrated traditional chinese and western medicine treatment of 30 cases of multiple sclerosis. Traditional Chin Medicinal Res. (2012) 25:22–3.

Google Scholar

41. Pu GF. Clinical Effect Observation of Kidney-Based Syndrome Differentiation and Treatment of Multiple Sclerosis: Beijing university of traditional chinese medicine. Dissertation [D] (2012).

Google Scholar

42. Wei Q. Clinical Study on Treatment of Multiple Sclerosis with Modified Sini Powder: Beijing university of traditional chinese medicine. Dissertation [D] (2012).

Google Scholar

43. Zhao WN. Integrated traditional chinese and western medicine treatment of 36 cases of multiple sclerosis. China J Pharm Economics. (2013) 01):55–6.

Google Scholar

44. Zhou YQ, Mao WQ, Zhang XJ, Li T. Effects of shugan jianpi gusui recipe on multiple sclerosis recurrence: A primary report. Chin J Integrated Traditional Western Med. (2013) 33:31–4.

Google Scholar

45. Li HH, Chen Q. Clinical analysis of integrated traditional chinese and western medicine treatment of multiple sclerosis. Contemp Med. (2015) 21:158–9.

Google Scholar

46. Zhou L, Fan YP. Randomized trial of erhuangfang for relapsing multiple sclerosis. Neurol Res. (2015) 37:633–7. doi: 10.1179/1743132815Y.0000000011

PubMed Abstract | Crossref Full Text | Google Scholar

47. Chen KL, Fan YP. Effect of kidney — Nourishing, Phlegm — Resolving and blood — Activating method on quality of life in patients with multiple sclerosis. Chin Arch Traditional Chin Med. (2016) 34:2141–4. doi: 10.13193/j.issn.1673-7717.2016.09.026

Crossref Full Text | Google Scholar

48. Chen L, Wang T. Clinical observation of dihuangheji in the treatment of elderly patients with multiple sclerosis. China Health Care Nutr. (2016) 26:240–. doi: 10.3969/j.issn.1004-7484.2016.30.382

Crossref Full Text | Google Scholar

49. Lu LP. Clinical observation on 35 cases of multiple sclerosis treated by heat-clearing and detoxifying method. China Health Care Nutr. (2016) 26:78–9.

Google Scholar

50. Wu P, Xie JE, Huang LW, Chen W, Liang H. Effect observation on multiple sclerosis with yanggan zishen decoction. J Shanxi Univ Chin Med. (2016) 17:28–30.

Google Scholar

51. Li SH. Clinical observation of tripterygium wilfordii polyglycosides in the treatment of multiple sclerosis. Res Integrated Traditional Chin Western Med. (2017) 9:288–9+92.

Google Scholar

52. Fan YP, Chen KL, You YZ, Wang S, Yang T, Wang JL. Clinical efficacy observation of bushen yisui capsule on relapsing remitting multiple sclerosis with syndrome of deficiency of kidney-liver yin. China J Traditional Chin Med Pharm. (2018) 33:4220–3.

Google Scholar

53. Huang C, Zhou ZY, Liu GW. Twenty-one cases of multiple sclerosis treated with formula of tonifying the kidney and supplementing the essence. Henan Traditional Chin Med. (2018) 38:1409–12. doi: 10.16367/j.issn.1003-5028.2018.09.0377

Crossref Full Text | Google Scholar

54. Qian BC, Wang BL. Integrated traditional chinese and western medicine treatment of 3 cases of acute stage multiple sclerosis. Traditional Chin Medicinal Res. (2020) 33:16–8.

Google Scholar

55. Shi LM. Clinical observation of impoved pingfu decoction in adjuvant treatment of multiple sclerosis. J Pract Traditional Chin Med. (2020) 36:361–2.

Google Scholar

56. Wu P, Xie JE, Chen F, Song QY. Clinical observation on nourishing liver and kidney recipe in the treatment of multiple sclerosis. Chin Med Modern Distance Educ China. (2020) 18:84–6.

Google Scholar

57. Li Q, Yang T, Guo AC, Fan YP. Role of catalpol in ameliorating the pathogenesis of experimental autoimmune encephalomyelitis by increasing the level of noradrenaline in the locus coeruleus. Mol Med Rep. (2018) 17:4163–72. doi: 10.3892/mmr.2018.8378

PubMed Abstract | Crossref Full Text | Google Scholar

58. Cong H, Zhang M, Chang H, Du L, Zhang X, Yin L. Icariin ameliorates the progression of experimental autoimmune encephalomyelitis by down-regulating the major inflammatory signal pathways in a mouse relapse-remission model of multiple sclerosis. Eur J Pharmacol. (2020) 885:173523. doi: 10.1016/j.ejphar.2020.173523

PubMed Abstract | Crossref Full Text | Google Scholar

59. Zhang R, Liu J, Xu B, Wu Y, Liang S, Yuan Q. Cornuside alleviates experimental autoimmune encephalomyelitis by inhibiting th17 cell infiltration into the central nervous system. J Zhejiang Univ Sci B. (2021) 22:421–30. doi: 10.1631/jzus.B2000771

PubMed Abstract | Crossref Full Text | Google Scholar

60. Yang L, Han X, Xing F, Wu H, Shi H, Huang F, et al. Total flavonoids of astragalus attenuates experimental autoimmune encephalomyelitis by suppressing the activation and inflammatory responses of microglia via jnk/akt/nfκb signaling pathway. Phytomedicine. (2021) 80:153385. doi: 10.1016/j.phymed.2020.153385

PubMed Abstract | Crossref Full Text | Google Scholar

61. Sun Y, Chen H, Dai J, Wan Z, Xiong P, Xu Y, et al. Glycyrrhizin protects mice against experimental autoimmune encephalomyelitis by inhibiting high-mobility group box 1 (Hmgb1) expression and neuronal hmgb1 release. Front Immunol. (2018) 9:1518. doi: 10.3389/fimmu.2018.01518

PubMed Abstract | Crossref Full Text | Google Scholar

62. Yang YL, Du SS. Effects of total glucosides of paeony on immune function in mice with experimental allergic encephalomyelitis. Chin J Clin Pharmacol. (2020) 36:4025–7+34. doi: 10.13699/j.cnki.1001-6821.2020.24.016

Crossref Full Text | Google Scholar

63. Jin B, Zhang C, Geng Y, Liu M. Therapeutic effect of ginsenoside rd on experimental autoimmune encephalomyelitis model mice: regulation of inflammation and treg/th17 cell balance. Mediators Inflamm. (2020) 2020:8827527. doi: 10.1155/2020/8827527

PubMed Abstract | Crossref Full Text | Google Scholar

64. Lee MJ, Choi JH, Oh J, Lee YH, In JG, Chang BJ, et al. Rg3-enriched korean red ginseng extract inhibits blood-brain barrier disruption in an animal model of multiple sclerosis by modulating expression of nadph oxidase 2 and 4. J Ginseng Res. (2021) 45:433–41. doi: 10.1016/j.jgr.2020.09.001

PubMed Abstract | Crossref Full Text | Google Scholar

65. Zheng K, Lv B, Wu L, Wang C, Xu H, Li X, et al. Protecting effect of emodin in experimental autoimmune encephalomyelitis mice by inhibiting microglia activation and inflammation via myd88/pi3k/akt/nf-κb signalling pathway. Bioengineered. (2022) 13:9322–44. doi: 10.1080/21655979.2022.2052671

PubMed Abstract | Crossref Full Text | Google Scholar

66. Safari H, Anani Sarab G, Naseri M, Artemisia Dracunculus L. Modulates the immune system in a multiple sclerosis mouse model. Nutr Neurosci. (2021) 24:843–9. doi: 10.1080/1028415x.2019.1681742

PubMed Abstract | Crossref Full Text | Google Scholar

67. Yang Y, Yang J. Effects of tanshinoniia on the clinical manifestation and peripheral treg of eae mice. J Tianjin Med Univ. (2017) 23:17–20.

Google Scholar

68. Xie FH, Xiong XM, Liang P, lin ZC, Zhang SS. Effects of tripterygium glycosides combined with dexamethasone on tlrs/nf — κb signaling pathway in eae rats. Chin J Pathophysiol. (2012) 28:1961–5.

Google Scholar

69. Liu SQ, Zhang ML, Zhang HJ, Liu FZ, Chu RJ, Zhang GX, et al. Matrine promotes oligodendrocyte development in cns autoimmunity through the pi3k/akt signaling pathway. Life Sci. (2017) 180:36–41. doi: 10.1016/j.lfs.2017.05.010

PubMed Abstract | Crossref Full Text | Google Scholar

70. Zhong SS, Xiang YJ, Liu PJ, He Y, Yang TT, Wang YY, et al. Effect of cordyceps sinensis on the treatment of experimental autoimmune encephalomyelitis: A pilot study on mice model. Chin (Engl). (2017) 130:2296–301. doi: 10.4103/0366-6999.215335

Crossref Full Text | Google Scholar

71. Lin X, Liu Y, Ma L, Ma X, Chen Z, Chen H, et al. Amelioration of experimental autoimmune encephalomyelitis by rhodiola rosea, a natural adaptogen. BioMed Pharmacother. (2020) 125:109960. doi: 10.1016/j.biopha.2020.109960

PubMed Abstract | Crossref Full Text | Google Scholar

72. Ying S, Yang H, Gu Q, Wu Z, Zou N, Wang CZ, et al. The small-molecule compound baicalein alleviates experimental autoimmune encephalomyelitis by suppressing pathogenetic cxcr6(+) cd4 cells. Int Immunopharmacol. (2023) 114:109562. doi: 10.1016/j.intimp.2022.109562

PubMed Abstract | Crossref Full Text | Google Scholar

73. Zhang J, Ni J, Chen ZH, Li X, Zhang RJ, Tang W, et al. Periplocoside a prevents experimental autoimmune encephalomyelitis by suppressing il-17 production and inhibits differentiation of th17 cells. Acta Pharmacol Sin. (2009) 30:1144–52. doi: 10.1038/aps.2009.101

PubMed Abstract | Crossref Full Text | Google Scholar

74. Schulz KF, Grimes DA. Sample size calculations in randomised trials: mandatory and mystical. Lancet. (2005) 365:1348–53. doi: 10.1016/s0140-6736(05)61034-3

PubMed Abstract | Crossref Full Text | Google Scholar

75. De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, et al. Clinical trial registration: A statement from the international committee of medical journal editors. Lancet. (2004) 364:911–2. doi: 10.1016/s0140-6736(04)17034-7

PubMed Abstract | Crossref Full Text | Google Scholar

76. Wieland LS, Manheimer E, Sampson M, Barnabas JP, Bouter LM, Cho K, et al. Bibliometric and content analysis of the cochrane complementary medicine field specialized register of controlled trials. Syst Rev. (2013) 2:51. doi: 10.1186/2046-4053-2-51

PubMed Abstract | Crossref Full Text | Google Scholar

77. Horsley T, Galipeau J, Petkovic J, Zeiter J, Hamstra SJ, Cook DA. Reporting quality and risk of bias in randomised trials in health professions education. Med Educ. (2017) 51:61–71. doi: 10.1111/medu.13130

PubMed Abstract | Crossref Full Text | Google Scholar

78. Zarin DA, Tse T, Sheehan J. The proposed rule for U.S. Clinical trial registration and results submission. N Engl J Med. (2015) 372:174–80. doi: 10.1056/NEJMsr1414226

PubMed Abstract | Crossref Full Text | Google Scholar

79. Shergis JL, Zhang AL, Zhou W, Xue CC. Quality and risk of bias in panax ginseng randomized controlled trials: A review. Am J Chin Med. (2013) 41:246. doi: 10.1142/S0192415X13500171

Crossref Full Text | Google Scholar

80. Ritchie A, Seubert L, Clifford R, Perry D, Bond C. Do randomised controlled trials relevant to pharmacy meet best practice standards for quality conduct and reporting? A systematic review. Int J Pharm Pract. (2020) 28:220–32. doi: 10.1111/ijpp.12578

PubMed Abstract | Crossref Full Text | Google Scholar

81. Riley SP, Swanson B, Brismée JM, Sawyer SF. A systematic review of orthopaedic manual therapy randomized clinical trials quality. J Man Manip Ther. (2016) 24:241–52. doi: 10.1080/10669817.2015.1119372

PubMed Abstract | Crossref Full Text | Google Scholar

82. Christina T, Jos V, Sharea I, HJ L, Julitta B, Carel H, et al. Quality of reporting and risk of bias: A review of randomised trials in occupational health. Occup Environ Med. (2021) 78:691. doi: 10.1136/oemed-2020-107038

PubMed Abstract | Crossref Full Text | Google Scholar

83. Gagnier JJ, Boon H, Rochon P, Moher D, Barnes J, Bombardier C. Recommendations for reporting randomized controlled trials of herbal interventions: explanation and elaboration. J Clin Epidemiol. (2006) 59:1134–49. doi: 10.1016/j.jclinepi.2005.12.020

PubMed Abstract | Crossref Full Text | Google Scholar

84. Tong XL, Dong L, Chen L, Zhen Z. Treatment of diabetes using traditional chinese medicine: past, present and future. Am J Chin Med. (2012) 40:877–86. doi: 10.1142/s0192415x12500656

PubMed Abstract | Crossref Full Text | Google Scholar

85. Liu Y, Hu C, Zhou K, Zhang Y, Kang J, Wen Y, et al. The reporting quality of randomized controlled trials in chinese herbal medicine (Chm) formulas for diabetes based on the consort statement and its extension for chm formulas. Front Pharmacol. (2024) 15:1288479. doi: 10.3389/fphar.2024.1288479

PubMed Abstract | Crossref Full Text | Google Scholar

86. Liu M, Chen J, Wu Q, Zhu W, Zhou X. Adherence to the consort statement and extension for nonpharmacological treatments in randomized controlled trials of bariatric surgery: A systematic survey. Obes Rev. (2021) 22:e13252. doi: 10.1111/obr.13252

PubMed Abstract | Crossref Full Text | Google Scholar

87. Jakimovski D, Bittner S, Zivadinov R, Morrow SA, Benedict RH, Zipp F, et al. Multiple sclerosis. Lancet. (2024) 403:183–202. doi: 10.1016/s0140-6736(23)01473-3

PubMed Abstract | Crossref Full Text | Google Scholar

88. Yong HYF, Yong VW. Mechanism-based criteria to improve therapeutic outcomes in progressive multiple sclerosis. Nat Rev Neurol. (2022) 18:40–55. doi: 10.1038/s41582-021-00581-x

PubMed Abstract | Crossref Full Text | Google Scholar

89. Song PP, Guan DS, Cui YL. Mechanisms of chinese medicine monomers and compounds in the treatment of multiple sclerosis: A review. Pharmacol Clinics Chin Materia. (2023) 39:93–100. doi: 10.13412/j.cnki.zyyl.20221209.001

Crossref Full Text | Google Scholar

90. Kuhlmann T, Moccia M, Coetzee T, Cohen JA, Correale J, Graves J, et al. Multiple sclerosis progression: time for a new mechanism-driven framework. Lancet Neurol. (2023) 22:78–88. doi: 10.1016/s1474-4422(22)00289-7

PubMed Abstract | Crossref Full Text | Google Scholar

91. Farzaei MH, Shahpiri Z, Bahramsoltani R, Nia MM, Najafi F, Rahimi R. Efficacy and tolerability of phytomedicines in multiple sclerosis patients: A review. CNS Drugs. (2017) 31:867–89. doi: 10.1007/s40263-017-0466-4

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: autoimmune diseases, natural products, traditional Chinese medicine, herbal, quality of reporting, ROB

Citation: Wu J-Y, Yang J-L, Hu J-L, Xu S, Zhang X-J, Qian S-Y, Chen M-L, Ali MA, Zhang J, Zha Z and Zheng G-Q (2024) Reporting quality and risk of bias of randomized controlled trials of Chinese herbal medicine for multiple sclerosis. Front. Immunol. 15:1429895. doi: 10.3389/fimmu.2024.1429895

Received: 08 May 2024; Accepted: 22 July 2024;
Published: 19 August 2024.

Edited by:

Jian Chen, Peking University, China

Reviewed by:

Guanhu Yang, Ohio University, United States
Hansen Chen, Stanford University, United States

Copyright © 2024 Wu, Yang, Hu, Xu, Zhang, Qian, Chen, Ali, Zhang, Zha and Zheng. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Guo-Qing Zheng, Z3FfemhlbmdAc29odS5jb20=

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.