A correction has been applied to this article in:
Corrigendum: Big Data and Real-World Data Based Cost-Effectiveness Studies and Decision-Making Models: A Systematic Review and Analysis
Z. Kevin Lu
Xiaomo Xiong
Taiying Lee1
Jun Wu
Jing Yuan- 1Department of Clinical Pharmacy and Outcomes Sciences, University of South Carolina, Columbia, SC, United States
- 2Department of Pharmaceutical and Administrative Sciences, Presbyterian College School of Pharmacy, Clinton, SC, United States
- 3Department of Clinical Pharmacy, School of Pharmacy, Fudan University, Shanghai, China
- 4Department of Administrative and Clinical Pharmacy, School of Pharmaceutical Sciences, Health Science Center, Peking University, Beijing, China
Background: Big data and real-world data (RWD) have been increasingly used to measure the effectiveness and costs in cost-effectiveness analysis (CEA). However, the characteristics and methodologies of CEA based on big data and RWD remain unknown. The objectives of this study were to review the characteristics and methodologies of the CEA studies based on big data and RWD and to compare the characteristics and methodologies between the CEA studies with or without decision-analytic models. Methods: The literature search was conducted in Medline (Pubmed), Embase, Web of Science, and Cochrane Library (as of June 2020). Full CEA studies with an incremental analysis that used big data and RWD for both effectiveness and costs written in English were included. There were no restrictions regarding publication date. Results: 70 studies on CEA using RWD (37 with decision-analytic models and 33 without) were included. The majority of the studies were published between 2011 and 2020, and the number of CEA based on RWD has been increasing over the years. Few CEA studies used big data. Pharmacological interventions were the most frequently studied intervention, and they were more frequently evaluated by the studies without decision-analytic models, while those with the model focused on treatment regimen. Compared to CEA studies using decision-analytic models, both effectiveness and costs of those using the model were more likely to be obtained from literature review. All the studies using decision-analytic models included sensitivity analyses, while four studies no using the model neither used sensitivity analysis nor controlled for confounders. Conclusion: The review shows that RWD has been increasingly applied in conducting the cost-effectiveness analysis. However, few CEA studies are based on big data. In future CEA studies using big data and RWD, it is encouraged to control confounders and to discount in long-term research when decision-analytic models are not used.
Background
With the development of health care technologies, a large number of innovative medications and health-related interventions have been approved and available on the market (Claxton et al., 2011; Hughes-Wilson et al., 2012). While these new therapies deliver better health outcomes, they often come with additional economic burdens (Hughes-Wilson et al., 2012). The cost-effectiveness analysis (CEA) is one of the economic evaluation techniques comparing both outcomes and costs between two or more interventions, which could help decision-makers to decide the most appropriate intervention and help payers to estimate the economic burden (Eichler et al., 2004; Drummond and McGuire, 2005; Bowrin et al., 2019). When the effectiveness is measured by a utility, it is called cost-utility analysis (CUA) (Drummond and McGuire, 2005). CEA has been increasingly used by health technology assessment (HTA) agencies in many countries for the decision-making of health-related interventions, including but not limited to market access, pricing, and formulary (Yang et al., 2008; Clement et al., 2009; Ciani and Jommi, 2014; Dakin et al., 2015; Jönsson, 2015).
CEA can be directly performed based on randomized controlled trials (RCTs) or pragmatic studies, or it can be indirectly conducted using decision-analytic models with mixed data derived from RCTs and the real-world settings (Drummond and McGuire, 2005; Briggs et al., 2006). Decision-analytic models, such as the decision tree and the Markov model, are a systematic decision-making approach widely using in the economic evaluation of healthcare interventions to compare decisions under uncertainty (Drummond and McGuire, 2005; Briggs et al., 2006). Real-world data (RWD) provided by observational studies other sources, including medical claims data and electronic health records (EHRs) have been used more and more in CEA studies (Drummond, 1996; Terkola et al., 2017; Bowrin et al., 2019). The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) Real-World Data Task Force published a report supporting the use of RWD for coverage and payment decisions in 2007, which defined RWD as the data used not collected in conventional RCTs (Garrison et al., 2007). Specifically, six sources of RWD were defined by the ISPOR, including supplements to traditional RCTs, large simple trials, registries, administrative data, health surveys, and EHRs and medical chart reviews. In 2017, ISPOR and International Society for Pharmacoepidemiology (ISPE) Joint Task Force published an article about the practice for real-world studies of comparative effectiveness (Berger et al., 2017). Compared to the RCTs considered as the “golden standard” in evaluating efficacies, RWD from observational studies or other real-world settings features a larger sample size (Silverman, 2009; Makady et al., 2018). Additionally, real-world settings can offer long-term scrutinization of effectiveness, which is reliable and ensures less uncertainty in a lifetime decision-analytic model compared to the RCTs commonly designed with a relatively short time horizon (Makady et al., 2018; Bowrin et al., 2019).
With the evolvement of technology, big data have been used more and more often in health care settings. Big data are a special kind of real-world data, which are characterized by high volume, high velocity, high variety, high value, and high veracity (5Vs) (Mehta and Pandit, 2018). Big data combine data from a variety of sources, including insurance claims, electronic medical records, patient-reported data, social media, etc. The combined data can be analyzed to predict the diagnosis and medication administration patterns using artificial intelligence models such as machine learning to compare health-related interventions (Wordsworth et al., 2018). However, because many big data are unstructured, certain challenges in the data collection, management, cleaning, and analysis need to be addressed before big data can be widely used in CEA studies (Wordsworth et al., 2018).
Limited studies have systematically reviewed the characteristics, methodologies, and quality of CEA studies based on big data and RWD. A study in 2019 reviewed the limitations in using RWD for CEA studies (Mehta and Pandit, 2018). However, this review does not include specific CEA studies using RWD, but overview literature (Mehta and Pandit, 2018). In addition, no studies have examined the differences between CEA studies based on big data and RWD with or without decision-analytic models. To fill the gap in the literature, the objectives of this study were to review the characteristics and methodologies of the cost-effectiveness analysis based on big data and real-world data and to compare the characteristics and methodologies between the cost-effectiveness analyses with or without decision-analytic models.
Methods
Search Strategy and Sources
A comprehensive literature search was implemented to identify CEA studies using big data and RWD. The literature search was conducted within the scope of four databases (as of June 2020) including Medline (Pubmed), Embase, Web of Science, and Cochrane Library. In addition, manual searches on the reference lists of included studies as well as related systematic reviews were performed to ensure the retrieval completeness. Search terms used in this study include cost-effectiveness analysis, cost-utility analysis, economic evaluation, pharmacoeconomics, big data, real-world study, real-world evidence, real-world data, RWD, RWE, RWS, electronic health records, EHRs, claims, and registry. Details are shown in Supplemental Material S1.
Eligibility Criteria
Full CEA studies with an incremental analysis that compared both incremental effectiveness and incremental cost between two or more interventions that used big data and RWD for both effectiveness and costs written in English were included. The definition of RWD in this review was based on the report published by ISPOR, where RWD was defined as data not derived from RCTs but rather come from pragmatic trials, registries, administrative data, health surveys, electronic records, or paper medical charts (Garrison et al., 2007). Big data were identified if two or more RWD were combined in a single parameter, or if any artificial intelligent methods, such as machine learning and deep learning methods, were used to process the data (Mehta and Pandit, 2018; Wordsworth et al., 2018). Furthermore, there were no restrictions regarding the publication date. Cost‐minimization analysis, cost-of-illness, cost-benefit analysis, reviews, meta‐analysis, comments, letters, protocols, posters or presentations at conferences or workshops, literature unavailable, and studies that are not health-related were excluded.
Study Selection
According to the patient/population, intervention, comparison and outcomes (PICOS) principle, patients were any patients, data for intervention and control groups were from the real world, and outcomes were ICER (Amir-Behghadami and Janati, 2020). Two rounds of screening were carried out independently by two reviewers after removing duplicates. In case a disagreement was expressed, a senior reviewer made the final decision. In the first round, titles and abstracts were screened for eligibility. Studies were included if 1) baseline population is based on real-world studies; 2) big data and RWD are used for both effectiveness and costs; 3) transition probabilities in the decision-analytic models are not obtained from RCTs. Then, the full-text review was performed for verification of potentially eligible studies according to the eligibility criteria. The entire selection process, including study identification, eligibility screening, and selection of full-text articles, followed the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement (Moher et al., 2009).
Information Extraction and Data Synthesis
The extracted information included the study characteristics: title, name of the first author, published year, study regions, affiliations of the first author, funding sources, diseases, interventions, and sample size. We also collected information on the study methodologies: study design, data type (RWD or big data), time horizon, methods of controlling confounders, the primary outcome, indirect costs (including the cost of absence from paid work, reduced productivity at paid work, and unpaid production), sources of effectiveness, sources of costs, report of missing data, methods of handling missing data, threshold consideration, sensitivity analysis, and discount rate (Liljas, 1998; McNamee, 2005). The process of study selection, along with the included and excluded number of studies, was presented in a PRISMA flowchart (Figure 1). The descriptive characteristics and methodologies were summarized and compared between the cost-effectiveness analyses with or without decision-analytic models.
FIGURE 1
FIGURE 1. Flowchart of publication selection.
Quality Assessment
We assessed the quality of the included studies using the Quality of Health Economic Studies (QHES) instrument (Ofman et al., 2003; Di Marco et al., 2018; McQueen et al., 2018). The QHES instrument consists of 16 items with scores ranging from 1 to 9, and the total score of the instrument is 100. During the assessment process, if the included study satisfied the criterion of an item, the study received an item-specific score, otherwise it received a score of zero. The quality assessment was conducted by two reviewers independently, and any controversies were resolved by discussion with a third investigator to reach a consensus. The QHES has a score-based grading system. The QHES has a score-based grading system. The scores are grouped into four groups: extremely poor quality (0–24), poor quality (25–49), fair quality (50–74), and high quality (75–100) (Ofman et al., 2003). Details of the QHES instrument are shown in Supplemental Material S2.
Results
Overview
The systematic literature search identified 6,751 studies after applying search strategies from different databases combined. After removing duplicates, 4,589 studies were eligible for the title and abstract screening. Upon screening of the titles and abstracts, 4,406 studies were excluded. The full-text screening was conducted on 183 eligible studies. A total of 113 studies were excluded from the full-text review, and a total of 70 studies were finally included for review (Figure 1). The number of publications on CEA studies based on big data and RWD increased over the years, and the majority of the studies were published between 2011 and 2020 (Figure 2).
FIGURE 2
FIGURE 2. Trends in the publications of real-world based cost-effectiveness analysis.
Charcteristics of Included Studies
Among 70 studies included, 37 (52.9%) were based on decision-analytic models, and 33 (47.1%) were not. The study regions of most studies were in Europe (42.9%). For the research design, the number of studies using CEA (55.7%) was slightly more than that of those using CUA (44.3%). Nearly 70% of the studies had a sample size higher than 100, and around a quarter of the stuides did not report the sample size. The most frequently used study perspective was the health care system (45.7%), followed by society (22.9%) and patients (11.4%). Most of the authors were from government or academic institutions (67.1%), and most of the funding came from the industry (48.6%). Neoplasms (25.7%) and circulation diseases (24.3%) were the most frequently studied diseases. The most frequently evaluated intervention was pharmacological treatment (54.3%). (Table 1).
TABLE 1
TABLE 1. Characteristics of included studies.
Methodologies of Included Studies
The majority of included studies (65.7%) reported patient baseline information. Nearly half of the studies (48.6%) did not report methods used to control for confounders, and matching (30.0%) was the most frequently used method for controlling, followed by regression (17.1%). Quality-adjusted life year (QALY) was the most frequently used effectiveness measure (55.7%), followed by the clinical endpoint (21.4%) and life year (18.6%). One-fifth of the studies included both direct and indirect costs (21.4%). The main sources of effectiveness were observational studies (48.6%), followed by registry and hospital information system (22.9%), while the main sources of cost were claims (31.4%), followed by the hospital information system (22.9%), and governmental published sources (18.6%). More than 70% of the studies did not report missing data of RWD. Among the studies with the report of missing data, excluding individuals with missing data was the most common method of handling the missing data, followed by imputation (25.0%). In addition, one study (5.0%) requested missing data from additional sources, while three studies reported missing data but did not use any method for handling. Half of the studies (52.9%) used a threshold to determine cost-effectiveness, and nearly one-third of the studies (17.1%) did not report any sensitivity analyses. The majority of the studies (82.9%) used a time horizon longer than 1 year, and nearly one-fifth of the studies (17.1%) did not report the time horizon. The number of discounted (52.9%) and undiscounted (47.1%) studies was about the same. (Table 2).
TABLE 2
TABLE 2. The methodologies used of included studies.
Comparison of Studies With or Without Decision-Analytic Models
The majority of included studies with decision-analytic models used CUA (86.5%), while most of the studies without the model used CEA (78.8%). (Table 1). For the diseases evaluated in the studies, Figure 3 showed that Studies with decision analysis models were more likely to study on pharmacological interventions, management programs, and screening, while studies not based on decision analysis models were more likely to study on surgical interventions, treatment regimens, and devices. In terms of the interventions evaluated, Figure 4 illustrated that the studies with decision-analytic models preferred to evaluate pharmacological interventions, management programs, and screening, whereas those without models preferred to study surgical interventions, treatment regimens, and devices.
FIGURE 3
FIGURE 3. Differences in disease categories between real-world cost-effectiveness analysis with or without decision-analytic model.
FIGURE 4
FIGURE 4. Differences in intervention categories between real-world cost-effectiveness analysis with or without decision-analytic model.
Compared to the studies without decision-analytic models, those with the model were less likely to control for confounding variables and preferred to use QALYs as the effectiveness measure. However, the studies without the model were less likely to use threshold and sensitivity analysis, and the time horizon of them was shorter compared to the studies with the model. For sources of effectiveness, compared to the studies without decision-analytic models, the effectiveness of those with the model was less likely to be obtained from claims and health information systems and was more likely to be obtained from the registry and observational studies (Figure 5). As for sources of costs, Figure 6 demonstrated that official resources, registry, observational studies, and especially literature review were preferable for the studies using decision-analytic models, while claims and hospital information systems were preferable for those not using the models. In terms of missing data, the studies that did not use the model were more likely to report missing data. The methods of handling missing data were mainly excluding regardless of whether the model was used.
FIGURE 5
FIGURE 5. Differences in effectiveness sources between real-world cost-effectiveness analysis with or without decision-analytic model.
FIGURE 6
FIGURE 6. Differences in cost sources between real-world cost-effectiveness analysis with or without decision-analytic model.
Quality of Included Studies
The average QHES score for the studies with decision-analytic models was 95.7, while the score for the studies without the model was 88.7. The detailed results of the quality assessment are shown in Figure 7. Most of the included studies were conducted reasonably well. However, many studies have failed to deal with the time horizon, where only 51.4% of studies stated the time horizon and used discounting correctly.
FIGURE 7
FIGURE 7. Quality assessment for the included studies.
Discussion
This systematic literature review assessed the characteristics and methodologies of the CEA studies based on big data and RWD. Out of 70 included studies, we found that the number of the CEA studies based on big data and RWD has been increased over the years, and the majority of the studies were published between 2011 and 2020, which is similar to previous studies reviewing the economic evaluations based on RWD and routine data (Gansen, 2018; Parody-Rúa et al., 2020). We also found that the study region with the most stuides was Europe. This distribution is as expected given that many European countries have HTA agencies and have been using CEA studies to make reimbursement and formulary decisions (Dakin et al., 2015; Makady et al., 2018). Most of the first authors were from government or academic institutions, and most of the funding came from the industry, which is similar to a previous study (Parody-Rúa et al., 2020).
A study by Bowrin et al. systematically reviewed the barriers of using RWD in CEA modeling as well as the existing guidelines and recommendations for incorporating RWD in CEA modeling, in which they found that RWD is valuable in CEA studies for their internal information and suggested that the methods and potential applications of RWD in CEA should be studied (Bowrin et al., 2019). Our study complemented this research gap with a systematic review of the published CEA studies based on big data and RWD. Bowrin et al. indicated that there might be several barriers in the CEA studies using RWD, among which confounding bias was one of the main issues (Bowrin et al., 2019). Our findings are consistent with their results. In the 70 studies using RWD we included, we found that nearly half of the RWD-based studies lacked the control for confounders. Direct use of RWD may be biased due to possible differences in characteristics between the control and experimental groups and may result in causality not being explained. Confounders need to be tightly controlled in future studies using RWD. In future research, it is important to control for confounders and make the experimental group and the control group comparable. A similar issue is a lack of reporting baseline information of the study population. If there is a deviation between RWD and the baseline characteristics of the study population in the CEA, the direct use of the RWD data may be biased. The studies that did not report baseline information accounted for nearly of the studies that used the decision-analytic model. Although all of these studies used sensitivity analysis that could reduce the uncertainty, the reporting of the results of base case analysis might be biased. Bowrin et al. also mentioned that CEA using RWE might have the issue of missing data (Bowrin et al., 2019). During our review, we found that more than 70% of the included studies did not report missing data and how it was handled. This issue was more common in the CEA studies using the model. In future research, missing data should be strictly reported for CEA studies using RWD. Although Bowrin et al. indicated that the use of RWD might have a small sample size, in our review (Bowrin et al., 2019), we found that most the included studies had a sample size larger than 500, and even eight studies had a sample size of more than 10,000. However, there were more than a quarter of the included studies without reporting the sample size.
Compared with the previous study, we also compared the CEA study using RWD with and without the decision-analytic model. The CEA studies using models were more likely to study chronic diseases and to use a lifetime horizon, which might be due to the ability of decision-analytic models in simulating the lifetime cost-effectiveness (Drummond and McGuire, 2005; Tarride et al., 2010). Although CEA studies directly based on RWD can also provide long-term effectiveness and costs, they are rarely lifelong. However, in most of the studies using the model with a lifetime horizon, RWD-based effectiveness did not reach the lifetime. Although sensitivity analysis can partially solve this problem by reducing the uncertainty with a range of ICER, how to solve the potential problems of extrapolating the use of RWD still needs to be studied (Makady et al., 2018). In terms of the diseases studied, the studies without decision-analytic were more likely to study pharmacological interventions, while those with the model were more likely to focus on the treatment regimen. A direct comparison of pharmacological interventions without the model can reduce the uncertainty introduced by the model (Briggs, 2000). However, for the treatment regimen, it might be difficult to select a sample in a real-world setting where the treatment regimen is always complicated (Schulman et al., 2013). Consequently, those studies aiming to compare different treatment regimens preferred to use a model approach that allows greater freedom in the choice of study and control groups (Behar et al., 2017; Thronicke et al., 2020). This might be due to the fact that most of the studies with the model used sensitivity analysis to control for uncertainty. Compared to CEA studies with decision-analytic models, both the effectiveness and costs were more likely to be obtained from the literature review, which might be due to CEA studies using models often use mixed data from different sources (Briggs et al., 2006). In addition, the effectiveness of the studies using the decision-analytic model was mainly from claims and hospital information system, while the sources of studies without the model were more extensive. In addition to the above two, registry and observational studies were also main sources for studies without the model. We also found that four studies without models did not test the uncertainty of the study or control for confounders for assessing the effectiveness and costs (Olivares et al., 2008; Isla-Tejera et al., 2013; Tsai et al., 2018; Chan et al., 2020). As we discussed above, the lack of these methods could bring biases to results, and it is difficult to inform decision-making by deterministic results alone (Briggs, 2000; Parody-Rúa et al., 2020). Furthermore, in long-term CEA studies without the model, most of them were not discounted. Some of these studies even used a life-long time horizon (Liao et al., 2017; Wei et al., 2017). Without the discounting for the long-term of effectiveness and costs might overestimate the cumulative effectiveness and costs and might bias in ICER depends on a greater impact of the discounting on costs or effectiveness (Gravelle and Smith, 2001). In addition, we used the QHES to identify the quality of the included studies. Compared to the CHEERS, the QHES items have a better specificity, and QHES has a scoring system, which could facilitate the comparison of different studies (Ofman et al., 2003; Husereau et al., 2013). We found that the score of the studies included was higher than 75 regardless of whether the model was used or not, indicating a high quality of the studies.
In addition to the specific issues of using RWD, we also found some common problems related to CEA in the included research. The vast majority of CEA studies that adopted a social perspective included indirect costs. However, there were still several studies from a societal perspective that did not include indirect costs (Aarnio et al., 2015; van Leent et al., 2015; Dor et al., 2018; de Jong et al., 2019a; de Jong et al., 2019b; Voermans et al., 2019). Although none of these studies focusing on malignant diseases that can cause serious damage to the patient’s productivity or infectious diseases that can infect others (Aarnio et al., 2015; van Leent et al., 2015; Dor et al., 2018; de Jong et al., 2019a; de Jong et al., 2019b; Voermans et al., 2019), ignoring indirect costs to some extent underestimates the total costs and the benefits of productivity that could accrue to patients from more effective interventions (Drummond and McGuire, 2005). When using society as a research perspective of cost, opportunity cost instead of acquisition cost should be measured as the cost of interventions or programs. However, in all the studies that we included using society as the perspective, the costs were directly used acquisition costs, and there was no discussion why these costs were not adjusted into opportunity costs (Lindgren et al., 2009; Lekander et al., 2010; Yang et al., 2010; Lekander et al., 2013; Aarnio et al., 2015; Zhao et al., 2016; Tanaka et al., 2017; Vassall et al., 2017; Dor et al., 2018; de Jong et al., 2019a; de Jong et al., 2019b; Behan et al., 2019; Lin et al., 2019; Voermans et al., 2019; Wang et al., 2019; Arrobas et al., 2021). This might lead to the overestimation of costs and ICER. In addition, we found that most of the utilities used in the studies using decision-analytic models were derived from literature review, which might not suit the model population and result in potential biases. Although this limitation is widespread in research using decision-analytic models and not only limited to those studies using RWD, such a limitation should also be circumvented in order to improve the validity of the study.
However, in this study we found that less big data is used in CEA. When searching for literature, in order to avoid the inclusion of the studies only using RWD as one minor part of the data sources, we used a more rigorous search strategy. This might lead to a reduction in the scope of our included studies and might excluded some CEA studies that used big data. However, because many studies might have multiple data sources, especially the CEA studies using the decision-analytic model. Including all the studies where RWD were used might lead to too much literature and reduce the feasibility of the study. Given the potentials of big data, we encourage future CEA studies to use big data to support decision-making (Wordsworth et al., 2018). Big data are featured by high volume, high velocity, high variety, high value, and high veracity (Mehta and Pandit, 2018). Beyond the economic evaluation of diseases or interventions based on a cohort, big data can act as an important role in personalized precision health economics and outcomes research (p-HEOR) (Chen et al., 2020). Advanced predictive algorithms of applying big data such as natural language processing (NLP) and machine learning (ML) should be used more in CEA studies and other economic evaluations (Fahr et al., 2019). Given the potentials of big data, we encourage future CEA studies to use big data to support decision-making.
According to the trend in the publications, the number of CEA studies using RWD is likely to continue increasing over the next decades. The 21st Century Cures Act passed in 2016 emphasized the use of RWD to support regulatory decision making, including the approval of new indications for approved drugs, and a series of guidance was launched later (Hudson and Collins, 2017). It is not difficult to imagine that over the next decades, more and more CEA studies will use RWD. In the case of big data, over the next decades, relevant CEA research using big data is likely to emerge, but not on a large scale, given that few mature algorithms and related methods are available (Fahr et al., 2019). Big data have far-reaching potential for prediction and could be used in some long-term CEA studies to replace some of the current methods to predict long-term effectiveness and costs (Fahr et al., 2019; Chen et al., 2020).
Although there is no systematic guideline on the use of RWE in CEA, there is some guidelines about using RWD from certain sources. Deidda et al. published a framework on the use of natural experiments, and some of the items contained therein are similar to the problems we found, which might be helpful to guide future CEA research using natural experiments as RWD sources to avoid methodology problems (Deidda et al., 2019). However, considering that there are more and more researches using RWD, there is still a need for systematic guidance on using RWD.
Some study limitations are worth mentioning. First, although the searching strategies used various terms, only a restricted set of synonyms was utilized within the systematic search. However, the terms used in the searching strategies are comparable to other reviews regarding the cost-effectiveness analysis. Second, since many diseases, as well as interventions, were included in the study, we did not compare the result of CEA studies based on big data and RWD to that of CEA studies based on RCT, because there were too much CEA literature using RCT data or mixed data for each disease or intervention, and it was difficult to ensure that all the literature can be fully included, for which the results of comparing might be biased. In future research, it is needed to conduct systematic reviews comparing the result of CEA studies based on big data and RWD to that of CEA studies based on RCT for a specific disease or intervention, in which the published literature can be covered completely. Third, the searching terms were restricted in the title, abstract, and keywords. Some studies based on big data and RWD but not mentioned in each respective field might have been missed. In addition, although our research found that there were eight studies with a sample size of more than 10,000, according to our definition of big data, these were not classified as studies using big data. When doing this research, there was no specific definition of big data in the HTA. Therefore, during the search process, we used definitions that if two or more RWD were combined in a single parameter, or if any artificial intelligent methods were used to process the data, which might limit the economic evaluation that we can include on the use of big data to a certain extent. Future research specifically on big data is still needed to enrich the review of this type of research. Fourth, this study only focused on CEA studies, and did include CBA studies, because we were concerned that if CBA was included, there might be some differences from CEA when extracting methodology or results. Future studies are needed for CBA studies using RWD. Finally, only full-text studies in English were included in the review, resulting in the disqualification of published studies that met other inclusion criteria.
Conclusion
A total of 70 studies were identified in this systematic literature review regarding cost-effectiveness analysis based on big data and real-world data. The review shows that big data and RWD have been increasingly applied in conducting the cost-effectiveness analysis. However, few CEA studies are based on big data characterized by 5Vs. The characteristics and methodologies were described and compared between the studies with decision-analytic models as well as the ones without the model. In future CEA studies using big data and RWD, it is encouraged to control confounders and to discount in long-term research when decision-analytic models are not used.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding authors.
Author Contributions
Concept and design: ZKL, JY. Acquisition, analysis, and/or interpretation of data: ZKL, XX, JY, BJ. Drafting of the manuscript: ZKL, XX, TL, JY, BJ. Critical revision of the manuscript for important intellectual content: JW, JY, BJ. Statistical analysis: XX.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at:https://www.frontiersin.org/articles/10.3389/fphar.2021.700012/full#supplementary-material
References
Aarnio, E., Korhonen, M. J., Huupponen, R., and Martikainen, J. (2015). Cost-effectiveness of Statin Treatment for Primary Prevention in Conditions of Real-World Adherence-Eestimates from the Finnish Prescription Register. Atherosclerosis 239, 240–247. doi:10.1016/j.atherosclerosis.2014.12.059
Ademi, Z., Liew, D., Hollingsworth, B., Steg, P. G., Bhatt, D. L., and Reid, C. M. (2013). Is it Cost-Effective to Increase Aspirin Use in Outpatient Settings for Primary or Secondary Prevention? Simulation Data from the REACH Registry Australian Cohort. Cardiovasc. Ther. 31, 45–52. doi:10.1111/j.1755-5922.2011.00291.x
Ademi, Z., Reid, C. M., Hollingsworth, B., Stoelwinder, J., Steg, P. G., Bhatt, D. L., et al. (2011). Cost-effectiveness of Optimizing Use of Statins in Australia: Using Outpatient Data from the REACH Registry. Clin. Ther. 33, 1456–1465. doi:10.1016/j.clinthera.2011.08.004
Amir-Behghadami, M., and Janati, A. (2020). Population, Intervention, Comparison, Outcomes and Study (PICOS) Design as a Framework to Formulate Eligibility Criteria in Systematic Reviews. Emerg. Med. J. 37 (6), 387. doi:10.1136/emermed-2020-209567
Ariyaratne, T. V., Ademi, Z., Huq, M., Rosenfeldt, F., Duffy, S. J., Parkinson, B., et al. (2018). The Real-World Cost-Effectiveness of Coronary Artery Bypass Surgery versus Stenting in High-Risk Patients: Propensity Score-Matched Analysis of a Single-Centre Experience. Appl. Health Econ. Health Pol. 16, 661–674. doi:10.1007/s40258-018-0407-5
Arrobas, A., Barbosa, M. P., Rabiais, S., Vandewalle, B., and Félix, J. (2021). Cost-effectiveness of Omalizumab in Real World Uncontrolled Allergic Asthma Patients. Pulmonology 27, 124–133. doi:10.1016/j.pulmoe.2020.03.001
Barnett, P. G., Ignacio, R. V., Kim, H. M., Geraci, M. C., Essenmacher, C. A., Hall, S. V., et al. (2019). Cost-effectiveness of Real-World Administration of Tobacco Pharmacotherapy in the United States Veterans Health Administration. Addiction 114, 1436–1445. doi:10.1111/add.14621
Behan, C., Kennelly, B., Roche, E., Renwick, L., Masterson, S., Lyne, J., et al. (2019). Early Intervention in Psychosis: Health Economic Evaluation Using the Net Benefit Approach in a Real-World Setting. Br. J. Psychiatry 217, 484–490. doi:10.1192/bjp.2019.126
Behar, J. M., Chin, H. M., Fearn, S., Ormerod, J. O., Gamble, J., Foley, P. W., et al. (2017). Cost-Effectiveness Analysis of Quadripolar versus Bipolar Left Ventricular Leads for Cardiac Resynchronization Defibrillator Therapy in a Large, Multicenter UK Registry. JACC Clin. Electrophysiol. 3, 107–116. doi:10.1016/j.jacep.2016.04.009
Berger, M. L., Sox, H., Willke, R. J., Brixner, D. L., Eichler, H. G., Goettsch, W., et al. (2017). Good Practices for Real-World Data Studies of Treatment And/or Comparative Effectiveness: Recommendations from the Joint ISPOR-ISPE Special Task Force on Real-World Evidence in Health Care Decision Making. Pharmacoepidemiol. Drug Saf. 26, 1033–1039. doi:10.1002/pds.4297
Bowrin, K., Briere, J. B., Levy, P., Millier, A., Clay, E., and Toumi, M. (2019). Cost-effectiveness Analyses Using Real-World Data: an Overview of the Literature. J. Med. Econ. 22, 545–553. doi:10.1080/13696998.2019.1588737
Brennan, A., Bansback, N., Nixon, R., Madan, J., Harrison, M., Watson, K., et al. (2007). Modelling the Cost Effectiveness of TNF-Alpha Antagonists in the Management of Rheumatoid Arthritis: Results from the British Society for Rheumatology Biologics Registry. Rheumatology (Oxford) 46, 1345–1354. doi:10.1093/rheumatology/kem115
Briggs, A. H. (2000). Handling Uncertainty in Cost-Effectiveness Models. Pharmacoeconomics 17, 479–500. doi:10.2165/00019053-200017050-00006
Briggs, Andrew., Sculpher, Mark., and Claxton, Karl. (2006). Decision Modelling for Health Economic Evaluation. Oxford, UK: Oxford University Press.
Burn, E., Liddle, A. D., Hamilton, T. W., Judge, A., Pandit, H. G., Murray, D. W., et al. (2018). Cost-effectiveness of Unicompartmental Compared with Total Knee Replacement: a Population-Based Study Using Data from the National Joint Registry for England and Wales. BMJ Open 8, e020977. doi:10.1136/bmjopen-2017-020977
Cárdenas, M., de la Fuente, S., Font, P., Castro-Villegas, M., Romero-Gómez, M., Ruiz-Vílchez, D., et al. (2016). Real-world Cost-Effectiveness of Infliximab, Etanercept and Adalimumab in Rheumatoid Arthritis Patients: Results of the CREATE Registry. Rheumatol. Int. 36, 231–241. doi:10.1007/s00296-015-3374-2
Chan, C. L., Li, A. A., Chung, H. A., and Phan, D. V. (2020). Cost Effectiveness Analysis and Payment Policy Recommendation-Population-Based Survey with Big Data Methodology for Readmission Prevention of Patients with Paroxysmal Supraventricular Tachycardia Treated with Radiofrequency Catheter Ablation. Int. J. Environ. Res. Public Health 17, 2334. doi:10.3390/ijerph17072334
Chen, G. F., Wei, L., Chen, J., Duan, Z. P., Dou, X. G., Xie, Q., et al. (2016). Will Sofosbuvir/Ledipasvir (Harvoni) Be Cost-Effective and Affordable for Chinese Patients Infected with Hepatitis C Virus? an Economic Analysis Using Real-World Data. PLoS One 11, e0155934. doi:10.1371/journal.pone.0155934
Chen, Y., Chirikov, V. V., Marston, X. L., Yang, J., Qiu, H., Xie, J., et al. (2020). Machine Learning for Precision Health Economics and Outcomes Research (P-HEOR): Conceptual Review of Applications and Next Steps. J. Health Econ. Outcomes Res. 7, 35–42. doi:10.36469/jheor.2020.12698
Cheng, H. M., Chiou, L. J., Chen, T. C., Sung, S. H., Chen, C. H., and Lang, H. C. (2019). Real-world Cost-Effectiveness of Drug-Eluting Stents vs. Bare-Metal Stents for Coronary Heart Disease-A Five-Year Follow-Up Study. Health Policy 123, 229–234. doi:10.1016/j.healthpol.2018.11.010
Chien, C. R., Hsia, T. C., and Chen, C. Y. (2014). Cost-effectiveness of Chemotherapy Combined with Thoracic Radiotherapy versus Chemotherapy Alone for Limited Stage Small Cell Lung Cancer: A Population-Based Propensity-Score Matched Analysis. Thorac. Cancer 5, 530–536. doi:10.1111/1759-7714.12125
Cho, J. H., Jang, H. M., Jung, H. Y., Choi, J. Y., Park, S. H., Kim, C. D., et al. (2018). A Real-World Cost-Effectiveness Analysis of Sevelamer versus Calcium Acetate in Korean Dialysis Patients. Clin. Ther. 40, 123–134. doi:10.1016/j.clinthera.2017.02.005
Ciani, O., and Jommi, C. (2014). The Role of Health Technology Assessment Bodies in Shaping Drug Development. Drug Des. Devel Ther. 8, 2273–2281. doi:10.2147/DDDT.S49935
Claxton, K., Paulden, M., Gravelle, H., Brouwer, W., and Culyer, A. J. (2011). Discounting and Decision Making in the Economic Evaluation of Health-Care Technologies. Health Econ. 20 (1), 2–15. doi:10.1002/hec.1612
Clement, F. M., Harris, A., Li, J. J., Yong, K., Lee, K. M., and Manns, B. J. (2009). Using Effectiveness and Cost-Effectiveness to Make Drug Coverage Decisions: a Comparison of Britain, Australia, and Canada. JAMA 302, 1437–1443. doi:10.1001/jama.2009.1409
Cromwell, I., van der Hoek, K., Melosky, B., and Peacock, S. (2011). Erlotinib or Docetaxel for Second-Line Treatment of Non-small Cell Lung Cancer: a Real-World Cost-Effectiveness Analysis. J. Thorac. Oncol. 6, 2097–2103. doi:10.1097/JTO.0b013e31822f657a
Cui, L., He, T., Jiang, Y., Li, M., Wang, O., Jiajue, R., et al. (2019). Predicting the Intervention Threshold for Initiating Osteoporosis Treatment Among Postmenopausal Women in China: a Cost-Effectiveness Analysis Based on Real-World Data. Osteoporos. Int. 31, 307–316. doi:10.1007/s00198-019-05173-6
Dakin, H., Devlin, N., Feng, Y., Rice, N., O'Neill, P., and Parkin, D. (2015). The Influence of Cost-Effectiveness and Other Factors on Nice Decisions. Health Econ. 24, 1256–1271. doi:10.1002/hec.3086
de Jong, L. A., Gout-Zwart, J. J., van den Bosch, M., Koops, M., and Postma, M. J. (2019). Rivaroxaban for Non-valvular Atrial Fibrillation and Venous Thromboembolism in the Netherlands: a Real-World Data Based Cost-Effectiveness Analysis. J. Med. Econ. 22, 306–318. doi:10.1080/13696998.2018.1563404
de Jong, L. A., Groeneveld, J., Stevanovic, J., Rila, H., Tieleman, R. G., Huisman, M. V., et al. (2019). Cost-effectiveness of Apixaban Compared to Other Anticoagulants in Patients with Atrial Fibrillation in the Real-World and Trial Settings. PLoS One 14, e0222658. doi:10.1371/journal.pone.0222658
de Pouvourville, G., Blin, P., and Karam, P. (2020). The Contribution of Real-World Evidence to Cost-Effectiveness Analysis: Case Study of Dabigatran Etexilate in France. Eur. J. Health Econ. 21, 235–249. doi:10.1007/s10198-019-01123-5
Deidda, M., Geue, C., Kreif, N., Dundas, R., and McIntosh, E. (2019). A Framework for Conducting Economic Evaluations Alongside Natural Experiments. Soc. Sci. Med. 220, 353–361. doi:10.1016/j.socscimed.2018.11.032
Di Marco, M., DAndrea, E., Panic, N., Baccolini, V., Migliara, G., Marzuillo, C., et al. (2018). Which Lynch Syndrome Screening Programs Could Be Implemented in the "real World"? A Systematic Review of Economic Evaluations. Genet. Med. 20 (10), 1131–1144. doi:10.1038/gim.2017.244
Djalalov, S., Beca, J., Hoch, J. S., Krahn, M., Tsao, M. S., Cutz, J. C., et al. (2014). Cost Effectiveness of EML4-ALK Fusion Testing and First-Line Crizotinib Treatment for Patients with Advanced ALK-Positive Non-small-cell Lung Cancer. J. Clin. Oncol. 32, 1012–1019. doi:10.1200/JCO.2013.53.1186
Dor, A., Luo, Q., Gerstein, M. T., Malveaux, F., Mitchell, H., and Markus, A. R. (2018). Cost-effectiveness of an Evidence-Based Childhood Asthma Intervention in Real-World Primary Care Settings. J. Ambul. Care Manage. 41, 213–224. doi:10.1097/JAC.0000000000000231
Drummond, M. F. (1996). The Future of Pharmacoeconomics: Bridging Science and Practice. Clin. Ther. 18, 969–968. doi:10.1016/s0149-2918(96)80053-1
Drummond, M. F., and McGuire, A. (2005). Economic Evaluation in Health Care: Merging Theory with Practice. Oxford, UK: Oxford University Press.
Eichler, H. G., Kong, S. X., Gerth, W. C., Mavros, P., and Jönsson, B. (2004). Use of Cost-Effectiveness Analysis in Health-Care Resource Allocation Decision-Making: How Are Cost-Effectiveness Thresholds Expected to Emerge? Value Health 7, 518–528. doi:10.1111/j.1524-4733.2004.75003.x
Fahr, P., Buchanan, J., and Wordsworth, S. (2019). A Review of the Challenges of Using Biomedical Big Data for Economic Evaluations of Precision Medicine. Appl. Health Econ. Health Pol. 17, 443–452. doi:10.1007/s40258-019-00474-7
Foglia, E., Bonfanti, P., Rizzardini, G., Bonizzoni, E., Restelli, U., Ricci, E., et al. (2013). Cost-utility Analysis of Lopinavir/ritonavir versus Atazanavir + Ritonavir Administered as First-Line Therapy for the Treatment of HIV Infection in Italy: from Randomised Trial to Real World. PLoS One 8, e57777. doi:10.1371/journal.pone.0057777
Gansen, F. M. (2018). Health Economic Evaluations Based on Routine Data in Germany: a Systematic Review. BMC Health Serv. Res. 18, 268. doi:10.1186/s12913-018-3080-3
Garrison, L. P., Neumann, P. J., Erickson, P., Marshall, D., and Mullins, C. D. (2007). Using Real-World Data for Coverage and Payment Decisions: the ISPOR Real-World Data Task Force Report. Value Health 10, 326–335. doi:10.1111/j.1524-4733.2007.00186.x
Gravelle, H., and Smith, D. (2001). Discounting for Health Effects in Cost-Benefit and Cost-Effectiveness Analysis. Health Econ. 10, 587–599. doi:10.1002/hec.618
Gruschkus, S. K., Lairson, D., Dunn, J. K., Risser, J., and Du, X. L. (2011). Cost-effectiveness of white Blood Cell Growth Factor Use Among a Large Nationwide Cohort of Elderly Non-hodgkin's Lymphoma Patients Treated with Chemotherapy. Value Health 14, 253–262. doi:10.1016/j.jval.2010.09.010
Hollier-Hann, G., Curry, A., Onishchenko, K., Akehurst, R., Ahmed, F., Davies, B., et al. (2020). Updated Cost-Effectiveness Analysis of onabotulinumtoxinA for the Prevention of Headache in Adults with Chronic Migraine Who Have Previously Received Three or More Preventive Treatments in the UK. J. Med. Econ. 23, 113–123. doi:10.1080/13696998.2019.1675417
Huang, M., Tian, Y., He, M., Liu, J., Ren, L., Gong, Y., et al. (2020). Crizotinib versus Chemotherapy: a Real-World Cost-Effectiveness Study in China. J. Comp. Eff. Res. 9, 93–102. doi:10.2217/cer-2019-0075
Hudson, K. L., and Collins, F. S. (2017). The 21st Century Cures Act - A View from the NIH. N. Engl. J. Med. 376, 111–113. doi:10.1056/NEJMp1615745
Hughes-Wilson, W., Palma, A., Schuurman, A., and Simoens, S. (2012). Paying for the Orphan Drug System: Break or bend? Is it Time for a New Evaluation System for Payers in Europe to Take Account of New Rare Disease Treatments?. Orphanet J. Rare Dis. 7, 74. doi:10.1186/1750-1172-7-74
Husereau, D., Drummond, M., Petrou, S., Carswell, C., Moher, D., Greenberg, D., et al. (2013). Consolidated Health Economic Evaluation Reporting Standards (CHEERS)--explanation and Elaboration: a Report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health 16 (2), 231–250. doi:10.1016/j.jval.2013.02.002
Isla-Tejera, B., Ruano, J., Alvarez, M. A., Brieva, T., Cárdenas, M., Baamonde, C., et al. (2013). Economic Evaluation of Botulinum Toxin versus Thoracic Sympathectomy for Palmar Hyperhidrosis: Data from a Real-World Scenario. Dermatol. Ther. (Heidelb) 3 (1), 63–72. doi:10.1007/s13555-013-0025-y
Jönsson, B. (2015). Bringing in Health Technology Assessment and Cost-Effectiveness Considerations at an Early Stage of Drug Development. Mol. Oncol. 9 (5), 1025–1033. doi:10.1016/j.molonc.2014.10.009
Kaiser, C., Brunner-La Rocca, H. P., Buser, P. T., Bonetti, P. O., Osswald, S., Linka, A., et al. (2005). Incremental Cost-Effectiveness of Drug-Eluting Stents Compared with a Third-Generation Bare-Metal Stent in a Real-World Setting: Randomised Basel Stent Kosten Effektivitäts Trial (BASKET). Lancet 366, 921–929. doi:10.1016/S0140-6736(05)67221-2
Kemp, L., Haughney, J., Barnes, N., Sims, E., von Ziegenweidt, J., Hillyer, E. V., et al. (2010). Cost-effectiveness Analysis of Corticosteroid Inhaler Devices in Primary Care Asthma Management: A Real World Observational Study. Clinicoecon Outcomes Res. 2, 75–85. doi:10.2147/ceor.s10835
Khor, S., Beca, J., Krahn, M., Hodgson, D., Lee, L., Crump, M., et al. (2014). Real World Costs and Cost-Effectiveness of Rituximab for Diffuse Large B-Cell Lymphoma Patients: a Population-Based Analysis. BMC Cancer 14, 586. doi:10.1186/1471-2407-14-586
Koto, P. S., Hu, S. X., Virani, K., Simpkin, W. L., Christian, C. A., Cao, H., et al. (2019). A Cost-Utility Analysis of Endovascular Thrombectomy in a Real-World Setting. Can. J. Neurol. Sci. 47, 1–11. doi:10.1017/cjn.2019.308
Lairson, D. R., Parikh, R. C., Cormier, J. N., and Du, X. L. (2014). Cost-utility Analysis of Platinum-Based Chemotherapy versus Taxane and Other Regimens for Ovarian Cancer. Value Health 17, 34–42. doi:10.1016/j.jval.2013.11.007
Landstedt-Hallin, L., Gundgaard, J., Ericsson, Å., and Ellfors-Zetterlund, S. (2017). Cost-effectiveness of Switching to Insulin Degludec from Other Basal Insulins: Evidence from Swedish Real-World Data. Curr. Med. Res. Opin. 33, 647–655. doi:10.1080/03007995.2016.1277194
Lang, H. C., Chen, H. W., Chiou, T. J., and Chan, A. L. (2016). The Real-World Cost-Effectiveness of Adjuvant Trastuzumab in HER-2/neu-Positive Early Breast Cancer in Taiwan. J. Med. Econ. 19, 923–927. doi:10.1080/13696998.2016.1185013
Langer, J., Wolden, M. L., Shimoda, S., Sato, M., and Araki, E. (2019). Short-Term Cost-Effectiveness of Switching to Insulin Degludec in Japanese Patients with Type 2 Diabetes Receiving Basal-Bolus Therapy. Diabetes Ther. 10, 1347–1356. doi:10.1007/s13300-019-0635-1
Lekander, I., Borgström, F., Svarvar, P., Ljung, T., Carli, C., and van Vollenhoven, R. F. (2010). Cost-effectiveness of Real-World Infliximab Use in Patients with Rheumatoid Arthritis in Sweden. Int. J. Technol. Assess. Health Care 26, 54–61. doi:10.1017/S0266462309990596
Lekander, I., Kobelt, G., Svarvar, P., Ljung, T., van Vollenhoven, R., and Borgström, F. (2013). The Comparison of Trial Data-Based and Registry Data-Based Cost-Effectiveness of Infliximab Treatment for Rheumatoid Arthritis in Sweden Using a Modeling Approach. Value Health 16, 251–258. doi:10.1016/j.jval.2012.11.002
Li, N., Yang, X., Fan, L., Totev, T., Guerin, A., Chen, L., et al. (2017). Nilotinib versus Dasatinib as Second-Line Therapy in Patients with Philadelphia Chromosome-Positive Chronic Myeloid Leukemia in Chronic Phase Who Are Resistant or Intolerant to Imatinib: a Cost-Effectiveness Analysis Based on Real-World Data. J. Med. Econ. 20, 328–336. doi:10.1080/13696998.2016.1261032
Liao, C. H., Tan, E. C., Chen, C. C., and Yang, M. C. (2017). Real-world Cost-Effectiveness of Laparoscopy versus Open Colectomy for colon Cancer: a Nationwide Population-Based Study. Surg. Endosc. 31, 1796–1805. doi:10.1007/s00464-016-5176-3
Liljas, B. (1998). How to Calculate Indirect Costs in Economic Evaluations. Pharmacoeconomics 13 (Pt 1), 1–7. doi:10.2165/00019053-199813010-00001
Lin, C. Y., Fang, H. Y., Feng, C. L., Li, C. C., and Chien, C. R. (2016). Cost-effectiveness of Neoadjuvant Concurrent Chemoradiotherapy versus Esophagectomy for Locally Advanced Esophageal Squamous Cell Carcinoma: A Population-Based Matched Case-Control Study. Thorac. Cancer 7, 288–295. doi:10.1111/1759-7714.12326
Lin, L. W., Teng, G. G., Lim, A. Y. N., Yoong, J. S., Zethraeus, N., and Wee, H. L. (2019). Cost-effectiveness of an Adherence-Enhancing Intervention for Gout Based on Real-World Data. Int. J. Rheum. Dis. 22, 545–554. doi:10.1111/1756-185X.13446
Lindgren, P., Geborek, P., and Kobelt, G. (2009). Modeling the Cost-Effectiveness of Treatment of Rheumatoid Arthritis with Rituximab Using Registry Data from Southern Sweden. Int. J. Technol. Assess. Health Care 25, 181–189. doi:10.1017/S0266462309090230
Mabin, T. A., and Condolfi, P. (2014). An Analysis of Real-World Cost-Effectiveness of TAVI in South Africa. Cardiovasc. J. Afr. 25, 21–26. doi:10.5830/CVJA-2013-090
Makady, A., van Veelen, A., Jonsson, P., Moseley, O., D'Andon, A., de Boer, A., et al. (2018). Using Real-World Data in Health Technology Assessment (HTA) Practice: A Comparative Study of Five HTA Agencies. Pharmacoeconomics 36, 359–368. doi:10.1007/s40273-017-0596-z
McNamee, R. (2005). Regression Modelling and Other Methods to Control Confounding. Occup. Environ. Med. 62, 5006. doi:10.1136/oem.2002.001115
McQueen, R. B., Sheehan, D. N., Whittington, M. D., van Boven, J. F. M., and Campbell, J. D. (2018). Cost-Effectiveness of Biological Asthma Treatments: A Systematic Review and Recommendations for Future Economic Evaluations. Pharmacoeconomics 36 (8), 957–971. doi:10.1007/s40273-018-0658-x
Mehta, N., and Pandit, A. (2018). Concurrence of Big Data Analytics and Healthcare: A Systematic Review. Int. J. Med. Inform. 114, 57–65. doi:10.1016/j.ijmedinf.2018.03.013
Moher, D., Liberati, A., Tetzlaff, J., and Altman, D. G.PRISMA Group (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA Statement. Plos Med. 6, e1000097. doi:10.1371/journal.pmed.1000097
Nilsson, F. O., Linnér, L., Samuelsson, E., and Milsom, I. (2012). Cost-effectiveness Analysis of Newer Anticholinergic Drugs for Urinary Incontinence vs Oxybutynin and No Treatment Using Data on Persistence from the Swedish Prescribed Drug Registry. BJU Int. 110, 240–246. doi:10.1111/j.1464-410X.2011.10729.x
Ofman, J. J., Sullivan, S. D., Neumann, P. J., Chiou, C. F., Henning, J. M., Wade, S. W., et al. (2003). Examining the Value and Quality of Health Economic Analyses: Implications of Utilizing the QHES. J. Manag. Care Pharm. 9, 53–61. doi:10.18553/jmcp.2003.9.1.53
Ohsfeldt, R. L., Gandhi, S. K., Fox, K. M., and McKenney, J. M. (2018). Statin Cost-Effectiveness Comparisons Using Real-World Effectiveness Data: Formulary Implications. Value Health 11, 1061–1069. doi:10.1111/j.1524-4733.2008.00354.x
Olivares, J. M., Rodriguez-Martinez, A., Burón, J. A., Alonso-Escolano, D., and Rodriguez-Morales, A.e-STAR Study Group (2008). Cost-effectiveness Analysis of Switching Antipsychotic Medication to Long-Acting Injectable Risperidone in Patients with Schizophrenia : a 12- and 24-month Follow-Up from the E-STAR Database in Spain. Appl. Health Econ. Health Pol. 6, 41–53. doi:10.2165/00148365-200806010-00004
Ou, H. T., Chen, Y. T., Liu, Y. M., and Wu, J. S. (2016). Comparative Cost-Effectiveness of Metformin-Based Dual Therapies Associated with Risk of Cardiovascular Diseases Among Chinese Patients with Type 2 Diabetes: Evidence from a Population-Based National Cohort in Taiwan. Diabetes Res. Clin. Pract. 116, 14–25. doi:10.1016/j.diabres.2016.03.013
Parody-Rúa, E., Rubio-Valera, M., Guevara-Cuellar, C., Gómez-Lumbreras, A., Casajuana-Closas, M., Carbonell-Duacastella, C., et al. (2020). Economic Evaluations Informed Exclusively by Real World Data: A Systematic Review. Int. J. Environ. Res. Public Health 17, 1171. doi:10.3390/ijerph17041171
Peng, S., Deger, K. A., Ustyugova, A., Gandhi, P., Qiao, N., Wang, C., et al. (2018). Cost-effectiveness Analysis of Dabigatran versus Rivaroxaban for Stroke Prevention in Patients with Non-valvular Atrial Fibrillation Using Real-World Evidence in Elderly US Medicare Beneficiaries. Curr. Med. Res. Opin. 34, 55–63. doi:10.1080/03007995.2017.1375470
Price, D., Asukai, Y., Ananthapavan, J., Malcolm, B., Radwan, A., and Keyzor, I. (2013). A UK-based Cost-Utility Analysis of Indacaterol, a Once-Daily Maintenance Bronchodilator for Patients with COPD, Using Real World Evidence on Resource Use. Appl. Health Econ. Health Pol. 11, 259–274. doi:10.1007/s40258-013-0021-5
Redig, J., Dalén, J., Harmenberg, U., Lindskog, M., Ljungberg, B., Lundstam, S., et al. (2019). Real-world Cost-Effectiveness of Targeted Therapy in Metastatic Renal Cell Carcinoma in Sweden: a Population-Based Retrospective Analysis. Cancer Manag. Res. 11, 1289–1297. doi:10.2147/CMAR.S188849
Rognoni, C., Ciani, O., Sommariva, S., and Tarricone, R. (2017). Real-World Data for the Evaluation of Transarterial Radioembolization versus Sorafenib in Hepatocellular Carcinoma: A Cost-Effectiveness Analysis. Value Health 20, 336–344. doi:10.1016/j.jval.2016.09.2397
Ronaldson, S. J., Raghunath, A., Torgerson, D. J., and Van Staa, T. (2017). Cost-effectiveness of Antibiotics for COPD Management: Observational Analysis Using CPRD Data. ERJ Open Res. 3, 00085–02016. doi:10.1183/23120541.00085-2016
Rubio-Valera, M., Peñarrubia-María, M. T., Iglesias-González, M., Knapp, M., McCrone, P., Roig, M., et al. (2019). Cost-effectiveness of Antidepressants versus Active Monitoring for Mild-To-Moderate Major Depressive Disorder: a Multisite Non-randomized-controlled Trial in Primary Care (INFAP Study). Eur. J. Health Econ. 20, 703–713. doi:10.1007/s10198-019-01034-5
Schulman, S., Shortt, B., Robinson, M., and Eikelboom, J. W. (2013). Adherence to Anticoagulant Treatment with Dabigatran in a Real-World Setting. J. Thromb. Haemost. 11, 1295–1299. doi:10.1111/jth.12241
Silverman, S. L. (2009). From Randomized Controlled Trials to Observational Studies. Am. J. Med. 122, 114–120. doi:10.1016/j.amjmed.2008.09.030
Sullivan, P. W., Li, Q., Bilir, S. P., Dang, J., Kavati, A., Yang, M., et al. (2020). Cost-effectiveness of Omalizumab for the Treatment of Moderate-To-Severe Uncontrolled Allergic Asthma in the United States. Curr. Med. Res. Opin. 36, 23–32. doi:10.1080/03007995.2019.1660539
Tanaka, E., Inoue, E., Yamaguchi, R., Shimizu, Y., Kobayashi, A., Sugimoto, N., et al. (2017). Pharmacoeconomic Analysis of Biological Disease Modifying Antirheumatic Drugs in Patients with Rheumatoid Arthritis Based on Real-World Data from the IORRA Observational Cohort Study in Japan. Mod. Rheumatol. 27, 227–236. doi:10.1080/14397595.2016.1205799
Tarride, J. E., Hopkins, R., Blackhouse, G., Bowen, J. M., Bischof, M., Von Keyserlingk, C., et al. (2010). A Review of Methods Used in Long-Term Cost-Effectiveness Models of Diabetes Mellitus Treatment. Pharmacoeconomics 28, 255–277. doi:10.2165/11531590-000000000-00000
Terkola, R., Antoñanzas, F., and Postma, M. (2017). Economic Evaluation of Personalized Medicine: a Call for Real-World Data. Eur. J. Health Econ. 18, 1065–1067. doi:10.1007/s10198-017-0890-x
Thein, H. H., Qiao, Y., Zaheen, A., Jembere, N., Sapisochin, G., Chan, K. K. W., et al. (2017). Cost-effectiveness Analysis of Treatment with Non-curative or Palliative Intent for Hepatocellular Carcinoma in the Real-World Setting. PLoS One 12, e0185198. doi:10.1371/journal.pone.0185198
Thijssen, J., van den Akker van Marle, M. E., Borleffs, C. J., van Rees, J. B., de Bie, M. K., van der Velde, E. T., et al. (2014). Cost-effectiveness of Primary Prevention Implantable Cardioverter Defibrillator Treatment: Data from a Large Clinical Registry. Pacing Clin. Electrophysiol. 37, 25–34. doi:10.1111/pace.12238
Thronicke, A., Reinhold, T., von Trott, P., Matthes, H., and Schad, F. (2020). Cost-Effectiveness of Real-World Administration of Concomitant Viscum Album L. Therapy for the Treatment of Stage IV Pancreatic Cancer. Evid. Based Complement. Alternat Med. 2020, 3543568. doi:10.1155/2020/3543568
Tsai, P. C., Liu, T. W., Huang, C. F., Yeh, M. L., Dai, C. Y., Chuang, W. L., et al. (2018). A Real World Cost Effectiveness Analysis of Interferon-Based Therapy for HCV naïve Super-responders. J. Chin. Med. Assoc. 81, 670–675. doi:10.1016/j.jcma.2017.05.015
van Gils, C. W., de Groot, S., Redekop, W. K., Koopman, M., Punt, C. J., and Uyl-de Groot, C. A. (2013). Real-world Cost-Effectiveness of Oxaliplatin in Stage III colon Cancer: a Synthesis of Clinical Trial and Daily Practice Evidence. Pharmacoeconomics 31, 703–718. doi:10.1007/s40273-013-0061-6
van Leent, M. W., Stevanović, J., Jansman, F. G., Beinema, M. J., Brouwers, J. R., and Postma, M. J. (2015). Cost-Effectiveness of Dabigatran Compared to Vitamin-K Antagonists for the Treatment of Deep Venous Thrombosis in the Netherlands Using Real-World Data. PLoS One 10, e0135054. doi:10.1371/journal.pone.0135054
Vassall, A., Siapka, M., Foster, N., Cunnama, L., Ramma, L., Fielding, K., et al. (2017). Cost-effectiveness of Xpert MTB/RIF for Tuberculosis Diagnosis in South Africa: a Real-World Cost Analysis and Economic Evaluation. Lancet Glob. Health 5, e710–e719. doi:10.1016/S2214-109X(17)30205-X
Voermans, A. M., Mewes, J. C., Broyles, M. R., and Steuten, L. M. G. (2019). Cost-Effectiveness Analysis of a Procalcitonin-Guided Decision Algorithm for Antibiotic Stewardship Using Real-World U.S. Hospital Data. OMICS 23, 508–515. doi:10.1089/omi.2019.0113
Wang, H., Wang, M., Wang, J., Liu, H., Lu, R., Duan, T., et al. (2019). Cost-effectiveness Analysis of Comprehensive Intervention Programs to Control Blood Glucose in Overweight and Obese Type 2 Diabetes Mellitus Patients Based on a Real-World Setting: Markov Modeling. Ann. Transl Med. 7, 676. doi:10.21037/atm.2019.10.38
Wei, W., Buysman, E., Grabner, M., Xie, L., Brekke, L., Ke, X., et al. (2017). A Real-World Study of Treatment Patterns and Outcomes in US Managed-Care Patients with Type 2 Diabetes Initiating Injectable Therapies. Diabetes Obes. Metab. 19, 375–386. doi:10.1111/dom.12828
Wordsworth, S., Doble, B., Payne, K., Buchanan, J., Marshall, D. A., McCabe, C., et al. (2018). Using "Big Data" in the Cost-Effectiveness Analysis of Next-Generation Sequencing Technologies: Challenges and Potential Solutions. Value Health 21, 1048–1053. doi:10.1016/j.jval.2018.06.016
Yang, B. M., Bae, E. Y., and Kim, J. (2008). Economic Evaluation and Pharmaceutical Reimbursement Reform in South Korea's National Health Insurance. Health Aff. (Millwood) 27, 179–187. doi:10.1377/hlthaff.27.1.179
Yang, J. J., Park, S. K., Cho, L. Y., Han, W., Park, B., Kim, H., et al. (2010). Cost-effectiveness Analysis of 5 Years of Postoperative Adjuvant Tamoxifen Therapy for Korean Women with Breast Cancer: Retrospective Cohort Study of the Korean Breast Cancer Society Database. Clin. Ther. 32, 1122–1138. doi:10.1016/j.clinthera.2010.05.013
Yong, J. H., Masucci, L., Hoch, J. S., Sujic, R., and Beaton, D. (2016). Cost-effectiveness of a Fracture Liaison Service-Aa Real-World Evaluation after 6 Years of Service Provision. Osteoporos. Int. 27, 231–240. doi:10.1007/s00198-015-3280-1
Keywords: big data, real-world data, cost-effectiveness analysis, pharmacoeconomics, systematic review
Citation: Lu ZK, Xiong X, Lee T, Wu J, Yuan J and Jiang B (2021) Big Data and Real-World Data based Cost-Effectiveness Studies and Decision-making Models: A Systematic Review and Analysis. Front. Pharmacol. 12:700012. doi: 10.3389/fphar.2021.700012
Received: 25 April 2021; Accepted: 27 August 2021;
Published: 19 October 2021.
Edited by:
Paul Scuffham, Griffith University, AustraliaReviewed by:
Sunita Nair, Consultant, Mumbai, IndiaKathleen Anne Boyd, University of Glasgow, United Kingdom
Bin Wu, Shanghai JiaoTong University, China
Copyright © 2021 Lu, Xiong, Lee, Wu, Yuan and Jiang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Z. Kevin Lu, lu32@email.sc.edu; Jing Yuan, jyuan@fudan.edu.cn
†These authors have contributed equally to this work