Xin Sun1*†
Ling Li1†
Yanmei Liu1
Wen Wang1Minghong Yao1Jing Tan1Yan Ren1Ke Deng1Yu Ma1Yuning Wang1
Jin Chen1
Wei Huang2Qing Xia2Youping Li1
Hongcai Shang3*- 1Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, Chengdu, China
- 2Department of Integrated Traditional Chinese and Western Medicine, West China Hospital, Sichuan University, Chengdu, China
- 3Key Laboratory of Chinese Internal Medicine of Ministry of Education, Dongzhimen Hospital, Beijing University of Chinese Medicine, Beijing, China
Introduction
Traditional Chinese medicine (TCM) is a feature of Chinese civilization and has made significant contributions to development of the Chinese. Nowadays, TCM has attracted extensive attentions across the country and the support for TCM has become part of the national strategy (Anonymous, 2019; Anonymous, 2021). A fundamental policy of China is that equal importance is attached to TCM and western medicine. In the treatment of diseases, for instance the fight against COVID-19, TCM and western medicine are often used in an integrated medicine approach (Chan et al., 2020; Du et al., 2020; Ren et al., 2020), in which the strengths of TCM with modern medicine (western medicine) are combined to improve clinical effects of healthcare interventions (Wang and Xu, 1997; Anonymous, 2015). In particular, the unique features of TCM–holism and treatment based on syndrome identification–are demonstrated in combination with practice of western medicine.
Over the past decades, this practice pattern received wide acceptance in the Chinese healthcare system and the unique roles of TCM in the diseases prevention and treatment, for example acupuncture for migraine prophylaxis (Zhao et al., 2017) and stress urinary incontinence treatment (Liu et al., 2017), are increasingly recognized by the international community (Anonymous, 2020). However, TCM interventions are a highly complex system. The prescription of TCM interventions is usually individualized that is based on four theoretical foundations, including the combination of syndrome and disease for diagnosis, dynamic evolution of disease syndromes, treatment based on syndrome identification, and the integrated principle-method-recipe-medicines approach. Under these theoretical framework, dynamic changes of syndromes would require changes in prescription (Shi et al., 2021).
The emergence of evidence-based medicine brings new ideas and methods–such as randomized controlled trials (RCTs) and systematic reviews–to the generation of evidence on clinical effects (Djulbegovic and Guyatt, 2017; Tian et al., 2021). However, clear differences in theoretical bases and underlying philosophies between TCM and western medicine inevitably presents significant challenges in assessing clinical effects of TCM interventions. The development of clinical research methodologies that specifically address clinical effects of TCM is vital to the innovation and thriving of TCM and represents a key strategy for TCM modernization (Wang and Huang, 2019). In this article, we discussed potential strategies, proposed an integrated approach that may effectively address challenges, and reported our practices in the application of the integrated approach for establishing clinical effects of post-approval Chinese patent medicines.
Assessing Clinical Effects of TCM Interventions in the Context of Integrative Medicine: Moving Beyond Randomized Controlled Trials
Evidence-based medicine framework usually treats classical RCTs (i.e., explanatory RCTs) as the gold standard, and combines other research methods (e.g., cohort studies) to develop a hierarchy of evidence (Centre for Evidence-Based Medicine, 2011). However, due to complexity of TCM interventions and its differences from western medicine, it is unlikely that RCTs can fully reflect features of TCM interventions. In the past decades, efforts from the methodology community were mainly centered on therapeutic efficacy; this focus may result that other equally important questions such as effectiveness or safety in real-world clinical setting are less attended. Additionally, this research pattern–intensive focus on classical RCT–often has limitations in integrating complex theories and practical features of TCM interventions. The resulting findings may not reflect the nature of TCM interventions. Therefore, an enhanced approach is strongly desirable.
In addressing complexities of TCM interventions, one strategy is standardization of important diagnosis and treatment factors that have potential impacts on the estimates of treatment effects of TCM interventions. In view of the complexities of TCM interventions and challenges of standardizing TCM features (e.g., syndromes), a progressive standardization strategy may be applied when assessing clinical effects of TCM interventions, that is, first achieve standardization of those fully or largely standardizable factors, then partially standardizable factors. For example, the assessment of clinical effects of TCM interventions may be based on three different disease diagnoses models, including disease diagnosis using western medicine theory, diagnosis using TCM-based syndrome differentiation, or a combination of both (Anonymous, 2015). While the first is often standardized, the complexity of TCM interventions may not be fully represented. Diagnosis of diseases purely based on TCM theory is often variable and less standardized. In such case, a diagnosis may be made primarily based on western medicine, and the addition of disease differentiation using TCM theory may strengthen the feature of TCM interventions.
The other strategy is the development of innovative methods, in addition to explanatory RCTs, to embrace the complexities of TCM interventions, since standardization is unlikely applicable to all cases or scenarios of TCM interventions. In addressing the diversity of TCM interventions, it is necessary to build a problem-oriented methodology approach that encompasses all relevant research questions about TCM interventions and addresses research needs at different stages or phases.
Developing an Integrated Methodological Approach for Assessing TCM Interventions: Focusing on Standardizable TCM Interventions
Acupuncture and Chinese patent medicines are commonly used therapeutic modalities in integrative medicine. They are highly standardizable and widely recognized interventions both in China and abroad. However, even for such therapeutic modalities, the applicable methodologies for assessing their treatment effects still differ with those for western medicine. The key question about acupuncture and Chinese patent medicine is how their evidence contains features of TCM while treatment effects are reliably assessed.
Although classical RCTs carry strong interval validity, they are never enough largely due to its restrictions in study factors (e.g., setting, population and interventions) and the resulting limitations to reflect TCM features. The last two decades have witnessed the rise of practice-based research, whereby real-world data generated from routine practice are primarily used for research (Sherman et al., 2016; Sun et al., 2018). This feature particularly fits for the characteristics of acupuncture and Chinese patent medicines, in which practical variations are allowed while standardization is feasible. However, such studies are often observational in nature and are subject to bias.
In addressing the limitations of the current approaches, we propose an integrated methodological approach for assessing clinical effects of acupuncture and Chinese patent medicines (eRCT-pRCT-RCDOS-REGOS, 4R, Figure 1). Explanatory trials and studies at real-world practice setting are merged through a stepwise manner, and research questions at different stages–e.g., efficacy versus effectiveness–are addressed. In the two extremes between explanatory trials and observational studies with routinely collected data, the TCM features are increasingly involved. Consequently, all these four research methods, in a collective manner, contribute to reliable and comprehensive assessment of clinical effects of acupuncture and Chinese patent medicines.
FIGURE 1. Integrated approach for assessing clinical effects of traditional Chinese medicine (i.e., 4R approach). Notes: eRCT, explanatory randomized controlled trial; pRCT, pragmatic randomized controlled trial; RCDOS, observational studies using routinely collected data; REGOS, observational studies using patient registry data; IT, information technology; AI, artificial intelligence.
Within this integrated methodological approach, explanatory randomized controlled trials (eRCTs) may be used at early stage to establish efficacy of acupuncture and Chinese patent medicine. Although rigorous in design and having relatively low risk of bias, it may contain fewer features of TCM. Once the efficacy is established, research at real-world practice setting–that allows more flexible inclusion of study population and interventions–would be conducted. Pragmatic randomized controlled trials (pRCTs) represent an important vehicle to establish effectiveness of acupuncture and Chinese patent medicines in the real-world settings. This method integrates more features of TCM interventions, and combines advantages of explanatory trials (e.g., randomization), and such, it may be an ideal option for assessing clinical effectiveness of TCM interventions (Zuidgeest et al., 2017; Shi et al., 2021).
Observational studies using routinely collected data (RCDOS) or observational studies using patient registry data (REGOS) are two research approaches alternative to pRCTs that may be used for assessing clinical effects of acupuncture and Chinese patent medicines. Despite their significant strengths in collection of real-world practice data, these two approaches often suffer from serious limitations due to the nature of observational designs. Nevertheless, they may offer irreplicable advantages in assessing syndrome-driven treatment heterogeneity, understanding changes of treatment pattern, assessing real-world safety particularly those rare adverse reactions, exploring component effect in case of complex interventions, investigating interactions between western medicine and TCM, and predicting clinical effects of individual patients.
Across all these methods, one critical issue is how to infuse the theory and features of TCM into methodological components. Despite relatively high degree of standardization when using acupuncture and Chinese patent medicine, objective complex factors continue to present challenges in assessing clinical effects, including outcome measurements that are applicable to TCM features (Wang and Huang, 2019; Zhang et al., 2021), effect estimation in rare event setting (Greenland et al., 2016), study designs involving patient preferences (Angell, 1984; Rücker, 1989; Cameron et al., 2018), repeated measures in TCM setting (Albert, 1999; Twisk, 2004; Goetgeluk and Vansteelandt, 2008; Wang et al., 2012), causal inference of treatment effects in complex design and data settings (Zigler and Dominici, 2014; Koch et al., 2020), and decomposition of effects in complex intervention setting. Continuing efforts are warranted to address these issues.
Use of Integrated Approach for Assessing Clinical Effects of Post-Approval Chinese Patent Medicines: Practical Examples
Post-approval Chinese patent medicines are often faced with important evidence gaps. Because the approval of Chinese patent medicines usually relies on traditional clinical trials, the resulting findings are often subject to restrictions in study designs. Therefore, post-approval studies of Chinese patent medicines are critical. Such studies usually aim to establish clinical effects in the context of TCM theory, whereby TCM features are increasingly present. These may include effectiveness, long-term effects, safety and heterogeneity in effects among subpopulations with varying characteristics (e.g., differential syndromes). In the past years, efforts have been made to apply the proposed approach for assessing post-approval Chinese patent medicines among selected diseases, for which TCM interventions may have special advantages (Figure 2).
FIGURE 2. Use of the integrated approach for assessing clinical effects of post-approval Chinese patent medicines. Notes: NSCLC, non-small cell lung cancer; pRCT, pragmatic randomized controlled trial; REGOS, observational studies using patient registry data; RCDOS, observational studies using routinely collected data.
For example, stroke is characterized by high morbidity, disability, mortality, recurrence and economic burden (Virani et al., 2020). Although treatments with western medicine, such as intravenous thrombolysis and mechanical thrombectomy, have clear effect on patients with acute ischemic stroke, limited treatment options are available for patients with ischemic stroke in recovery and sequelae stages (Powers et al., 2018). Early evidence suggested efficacy of Chinese patent medicines on the lowering of stroke complications and improvement of stroke sequelae (Li et al., 2017; Liang et al., 2018; Liu et al., 2018). However, there continues to be major evidence gaps, including effectiveness and safety and differential effects by varying TCM features among patients in real-world clinical setting.
In our efforts to address these evidence needs, we have developed two stroke-specific databases, including one multicenter stroke-specific registry database from TCM hospitals and one nationwide stroke-specific routinely collected healthcare database from western medicine hospitals. We initially applied data processing technologies and common data model to standardize the data. We then applied the integrated approach to undertake studies addressing a series of research questions about clinical effects of Chinese patent medicines, including investigation of disease burden and treatment patterns of stroke using cross-sectional design; understanding types of Chinese medicine syndromes and regional distribution of acute cerebral hemorrhage and acute cerebral infarction, using model-based multidimensional clustering analysis; assessment of effectiveness and safety of Chinese patent medicines (e.g., TCM injection on top of routine thrombolysis treatment) among patients at stroke sequelae, using retrospective cohort study design and casual model; and development of a model for predicting individual treatment effects among patients with Chinese patent medicines treatments, based on machine learning methods.
In another example, effective treatments of non-small cell lung cancer (NSCLC) usually include surgery, chemotherapy, radiotherapy, molecular targeting and immunotherapy (Postmus et al., 2017). However, drug resistance and adverse reactions are two major limitations of these treatment options, which, in return, seriously compromise quality of life of patients (Chinese Medical Association, 2020). TCM may have advantages in alleviating adverse reactions caused by typical western medicine and raising patient immunity, thus improving quality of life, and potentially prolonging survival (Li et al., 2019; Yang et al., 2020). Nevertheless, evidence is lacking.
In the efforts to address this important evidence gap, we established a multicenter postoperative NSCLC patient registry, whereby we applied the integrated approach to address issues about clinical effects of Chinese patent medicines for cancer patients. These included a multi-center pRCT that compared Zhongliuping 3 formula versus usual care to examine its effects on clinical symptoms and quality of life in NSCLC patients after surgery, in which multiple data sources were collected; a multi-center pRCT that compared Shenlingcao oral liquid versus usual care among NSCLC patients after receiving surgery to confirm its effect on quality of life and alleviation of serious adverse reactions caused by chemotherapy; and a cohort study using data from multicenter pRCTs to analyze long-term effectiveness, safety and heterogeneity in effects among different syndromes.
Conclusion
In this paper, we proposed an integrated approach (i.e., 4R approach) that combines the strengths of classical RCTs and practice-based research, and infuses TCM theories and features into key study characteristics. Through this approach, the challenges may be effectively addressed in assessing clinical effects of TCM interventions. We also provided practical examples about the use of integrated approaches for assessing clinical effects of post-approval Chinese patent medicines in stroke and lung cancer patients. However, this approach has not been widely tested, and more applications are warranted. We are hopeful that the integrated approach may be further enhanced through wider efforts and become an accepted model in assessing clinical effects of TCM interventions.
Author Contributions
XS and HS contributed conception of the study. XS, LL, and LY wrote sections of the manuscript. All authors contributed to the manuscript revision and approved the submitted version.
Funding
This study was supported by National Key R&D Program of China (Grant Nos 2017YFC1700400, 2017YFC1700406 and 2019YFC1709804), the National Natural Science Foundation of China (Grant No. 81590955), Sichuan Youth Science and Technology Innovation Research Team (Grant No. 2020JDTD0015), and 1·3·5 Project for Disciplines of Excellence, West China Hospital, Sichuan University (Grant No. ZYYC08003).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Albert, P. S. (1999). Longitudinal Data Analysis (Repeated Measures) in Clinical Trials. Stat. Med. 18, 1707–1732. doi:10.1002/(sici)1097-0258(19990715)18:13<1707::aid-sim138>3.0.co;2-h
Angell, M. (1984). Patients' Preferences in Randomized Clinical Trials. N. Engl. J. Med. 310, 1385–1387. doi:10.1056/nejm198405243102111
Anonymous, (2015). Integrative Medicine of Chinese Medical Doctor Association, Evidence-Based Medicine Committee of the Chinese Society of Integrative Medicine. Guide to Clinical Research Methods in Traditional Chinese Medicine and Integrative Chinese and Western Medicine. Chin. J. Integr. Med. 35, 901–932. doi:10.7661/CJIM.2015.08.0901
Anonymous, (2020). The State Council Information Office of the People’s Republic of China. International Community Positively Evaluates Chinese Medicine Against Epidemic. Available at: http://www.scio.gov.cn/37259/Document/1675839/1675839.htm. Accessed Febuary 07, 2021.
Anonymous, (2019). The State Council of the People's Republic of China. China Issues Guideline to Promote the Preservation and Innovative Development of Traditional Chinese Medicine(TCM). Available at: http://english.www.gov.cn/policies/latestreleases/201910/26/content_WS5db44c20c6d0bcf8c4c15d43.html. Accessed Febuary 07, 2021.
Anonymous, (2021). The State Council of the People's Republic of China. Notice of the General Office of the China State Council on the Development of a Number of Policies and Measures to Accelerate the Characteristics of Chinese Medicine. Available at: http://www.gov.cn/zhengce/content/2021-02/09/content_5586278.htm. Accessed Febuary 07, 2021.
Cameron, B., Peduzzi, P., and Esserman, D. (2018). Extensions to the Two-Stage Randomized Trial Design for Testing Treatment, Self-Selection, and Treatment Preference Effects to Binary Outcomes. Stat. Med. 37, 3147–3178. doi:10.1002/sim.7830
Centre for Evidence-Based Medicine (2011). OCEBM Levels of Evidence Working Group. The Oxford Levels of Evidence 2. Available at: https://www.cebm.ox.ac.uk/resources/levels-of-evidence/ocebm-levels-of-evidence. Accessed Febuary 07, 2021.
Chan, K. W., Wong, V. T., and Tang, S. C. W. (2020). COVID-19: An Update on the Epidemiological, Clinical, Preventive and Therapeutic Evidence and Guidelines of Integrative Chinese-western Medicine for the Management of 2019 Novel Coronavirus Disease. Am. J. Chin. Med. 48, 737–762. doi:10.1142/s0192415x20500378
Chinese Medical Association (2020). Chinese Medical Association Guidelines for Clinical Diagnosis and Treatment of Lung Cancer (2019 Edition). Chin. J. Oncol. 42, 257–287. doi:10.3760/cma.j.cn112152-20200120-00049
Djulbegovic, B., and Guyatt, G. H. (2017). Progress in Evidence-Based Medicine: A Quarter century on. Lancet 390, 415–423. doi:10.1016/s0140-6736(16)31592-6
Du, H. Z., Hou, X. Y., Miao, Y. H., Huang, B. S., and Liu, D. H. (2020). Traditional Chinese Medicine: An Effective Treatment for 2019 Novel Coronavirus Pneumonia (NCP). Chin. J. Nat. Med. 18, 206–210. doi:10.1016/s1875-5364(20)30022-4
Goetgeluk, S., and Vansteelandt, S. (2008). Conditional Generalized Estimating Equations for the Analysis of Clustered and Longitudinal Data. Biometrics 64, 772–780. doi:10.1111/j.1541-0420.2007.00944.x
Greenland, S., Mansournia, M. A., and Altman, D. G. (2016). Sparse Data Bias: A Problem Hiding in plain Sight. BMJ 352, i1981. doi:10.1136/bmj.i1981
Koch, B., Vock, D. M., Wolfson, J., and Vock, L. B. (2020). Variable Selection and Estimation in Causal Inference Using Bayesian Spike and Slab Priors. Stat. Methods Med. Res. 29, 2445–2469. doi:10.1177/0962280219898497
Li, H., Ji, Y., Zhang, S., Gao, Z., Hu, C., Jiang, R., et al. (2019). Kangai Injection Combined with Platinum-Based Chemotherapy for the Treatment of Stage III/IV Non-Small Cell Lung Cancer: A Meta-Analysis and Systematic Review of 35 Randomized Controlled Trials. J. Cancer 10, 5283–5298. doi:10.7150/jca.31928
Li, S., Zhang, X., Fang, Q., Zhou, J., Zhang, M., Wang, H., et al. (2017). Ginkgo Biloba Extract Improved Cognitive and Neurological Functions of Acute Ischaemic Stroke: A Randomised Controlled Trial. Stroke Vasc. Neurol. 2, 189–197. doi:10.1136/svn-2017-000104
Liang, Q., Cai, Y., Chen, R., Chen, W., Chen, L., and Xiao, Y. (2018). The Effect of Naoxintong Capsule in the Treatment of Patients with Cerebral Infarction and Carotid Atherosclerosis: A Systematic Review and Meta-Analysis of Randomized Trials. Evid. Based Complement. Alternat Med. 2018, 5892306. doi:10.1155/2018/5892306
Liu, S., Wu, J. R., Zhang, D., Wang, K. H., Zhang, B., Zhang, X. M., et al. (2018). Comparative Efficacy of Chinese Herbal Injections for Treating Acute Cerebral Infarction: A Network Meta-Analysis of Randomized Controlled Trials. BMC Complement. Altern. Med. 18, 120. doi:10.1186/s12906-018-2178-9
Liu, Z., Liu, Y., Xu, H., He, L., Chen, Y., Fu, L., et al. (2017). Effect of Electroacupuncture on Urinary Leakage Among Women with Stress Urinary Incontinence: A Randomized Clinical Trial. Jama 317, 2493–2501. doi:10.1001/jama.2017.7220
Postmus, P. E., Kerr, K. M., Oudkerk, M., Senan, S., Waller, D. A., Vansteenkiste, J., et al. (2017). Early and Locally Advanced Non-Small-Cell Lung Cancer (NSCLC): ESMO Clinical Practice Guidelines for Diagnosis, Treatment and Follow-Up. Ann. Oncol. 28, iv1–iv21. doi:10.1093/annonc/mdx222
Powers, W. J., Rabinstein, A. A., Ackerson, T., Adeoye, O. M., Bambakidis, N. C., Becker, K., et al. (2018). 2018 Guidelines for the Early Management of Patients with Acute Ischemic Stroke: A Guideline for Healthcare Professionals from the American Heart Association/American Stroke Association. Stroke 49, e46–e110. doi:10.1161/str.0000000000000158
Ren, J.-l., Zhang, A.-H., and Wang, X.-J. (2020). Traditional Chinese Medicine for COVID-19 Treatment. Pharmacol. Res. 155, 104743. doi:10.1016/j.phrs.2020.104743
Rücker, G. (1989). A Two-Stage Trial Design for Testing Treatment, Self-Selection and Treatment Preference Effects. Stat. Med. 8, 477–485. doi:10.1002/sim.4780080411
Sherman, R. E., Anderson, S. A., Dal Pan, G. J., Gray, G. W., Gross, T., Hunter, N. L., et al. (2016). Real-World Evidence - What Is it and what Can it Tell Us?. N. Engl. J. Med. 375, 2293–2297. doi:10.1056/NEJMsb1609216
Shi, Q., Li, L., Li, S., and Sun, X. (2021). Statistical Methods in Pragmatic Randomized Controlled Trials (Ⅰ): Addressing Non-Compliance. Chin. J. Evidence-Based Med. 21, 117–124. doi:10.7507/1672-2531.202010019
Sun, X., Tan, J., Tang, L., Guo, J. J., and Li, X. (2018). Real World Evidence: Experience and Lessons from China. BMJ 360, j5262. doi:10.1136/bmj.j5262
Tian, G., Zhao, C., Zhang, X., Mu, W., Jiang, Y., Wei, X., et al. (2021). Evidence-Based Traditional Chinese Medicine Research: Two Decades of Development, its Impact, and Breakthrough. J. Evid. Based Med. 14, 65–74. doi:10.1111/jebm.12420
Twisk, J. W. (2004). Longitudinal Data Analysis. A Comparison between Generalized Estimating Equations and Random Coefficient Analysis. Eur. J. Epidemiol. 19, 769–776. doi:10.1023/b:ejep.0000036572.00663.f2
Virani, S. S., Alonso, A., Benjamin, E. J., Bittencourt, M. S., Callaway, C. W., Carson, A. P., et al. (2020). Heart Disease and Stroke Statistics-2020 Update: A Report from the American Heart Association. Circulation 141, e139–e596. doi:10.1161/cir.0000000000000757
Wang, J., and Xu, Z. (1997). Exploration of the Concept and Scope of Integrated Traditional and Western Medicine. Chin. J. Integr. Med. 17, 690–692.
Wang, L., Zhou, J., and Qu, A. (2012). Penalized Generalized Estimating Equations for High-Dimensional Longitudinal Data Analysis. Biometrics 68, 353–360. doi:10.1111/j.1541-0420.2011.01678.x
Wang, Y., and Huang, L. (2019). Taking a Broad and Long-Term View to Establish China Center for Evidence Based Traditional Chinese Medicine (CCEBTCM). Chin. J. Evidence-Based Med. 19, 1131–1137. doi:10.7507/1672-2531.201908098
Yang, J., Zhu, X., Yuan, P., Liu, J., Wang, B., and Wang, G. (2020). Efficacy of Traditional Chinese Medicine Combined with Chemotherapy in Patients with Non-Small Cell Lung Cancer (NSCLC): a Meta-Analysis of Randomized Clinical Trials. Support Care Cancer 28, 3571–3579. doi:10.1007/s00520-020-05433-w
Zhang, M., Li, K., Cai, H., Niu, B., and Zhang, J. (2021). Overview of the Development of Core Outcome Set for Clinical Trials and Related Key Issues in the Field of Traditional Chinese Medicine. J. Tradit Chin. Med. 62, 108–113. doi:10.13288/j.11-2166/r.2021.02.005
Zhao, L., Chen, J., Li, Y., Sun, X., Chang, X., Zheng, H., et al. (2017). The Long-Term Effect of Acupuncture for Migraine Prophylaxis: a Randomized Clinical Trial. JAMA Intern. Med. 177, 508–515. doi:10.1001/jamainternmed.2016.9378
Zigler, C. M., and Dominici, F. (2014). Uncertainty in Propensity Score Estimation: Bayesian Methods for Variable Selection and Model Averaged Causal Effects. J. Am. Stat. Assoc. 109, 95–107. doi:10.1080/01621459.2013.869498
Keywords: traditional Chinese medicine, clinical effects, clinical research methodology, integrative medicine, Chinese patent medicine
Citation: Sun X, Li L, Liu Y, Wang W, Yao M, Tan J, Ren Y, Deng K, Ma Y, Wang Y, Chen J, Huang W, Xia Q, Li Y and Shang H (2021) Assessing Clinical Effects of Traditional Chinese Medicine Interventions: Moving Beyond Randomized Controlled Trials. Front. Pharmacol. 12:713071. doi: 10.3389/fphar.2021.713071
Received: 28 May 2021; Accepted: 26 August 2021;
Published: 07 September 2021.
Edited by:
Ashwell Rungano Ndhlala, University of Limpopo, South AfricaReviewed by:
Xing Liao, China Academy of Chinese Medical Sciences, ChinaCopyright © 2021 Sun, Li, Liu, Wang, Yao, Tan, Ren, Deng, Ma, Wang, Chen, Huang, Xia, Li and Shang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Xin Sun, sunxin@wchscu.cn; Hongcai Shang, shanghongcai@126.com
†These authors have contributed equally to this work and share first authorship