- 1RTI Health Solutions, Research Triangle Park, NC, United States
- 2MSD, Brussels, Belgium
- 3Department of Infectious Diseases, Centre Hospitalier Universitaire Saint-Pierre, Université Libre de Bruxelles (ULB), Brussels, Belgium
- 4School of Public Health, ULB, Brussels, Belgium
- 5Institute for Medical Immunology, ULB, Brussels, Belgium
- 6Department of Public Health, Epidemiology and Health Economics, Faculty of Medicine, University of Liège, Liège, Belgium
- 7SERFAN Innovation, Namur, Belgium
- 8Paediatric Infectious Diseases, Hôpital Universitaire des Enfants Reine Fabiola and Université Libre de Bruxelles, Brussels, Belgium
- 9Leuven Institute for Healthcare Policy, KU Leuven, Leuven, Belgium
- 10Jessa Hospital, Hasselt, Belgium
- 11Department of Pharmaceutical and Pharmacological Sciences, KU Leuven, Leuven, Belgium
- 12Rega Institute for Medical Research, KU Leuven, Leuven, Belgium
- 13Merck & Co., Inc., Rahway, NJ, United States
- 14Center for Observational and Real-World Evidence, MSD, Madrid, Spain
Objective: We evaluated the public health impact and return on investment of Belgium’s pediatric immunization program (PIP) from both healthcare-sector and societal perspectives.
Methods: We developed a decision analytic model for 6 vaccines routinely administered in Belgium for children aged 0–10 years: DTaP-IPV-HepB-Hib, DTaP-IPV, MMR, PCV, rotavirus, and meningococcal type C. We used separate decision trees to model each of the 11 vaccine-preventable pathogens: diphtheria, tetanus, pertussis, poliomyelitis, Haemophilus influenzae type b, measles, mumps, rubella, Streptococcus pneumoniae, rotavirus, and meningococcal type C; hepatitis B was excluded because of surveillance limitations. The 2018 birth cohort was followed over its lifetime. The model projected and compared health outcomes and costs with and without immunization (based on vaccine-era and pre–vaccine era disease incidence estimates, respectively), assuming that observed reductions in disease incidence were fully attributable to vaccination. For the societal perspective, the model included productivity loss costs associated with immunization and disease in addition to direct medical costs. The model estimated discounted cases averted, disease-related deaths averted, life-years gained, quality-adjusted life-years gained, costs (2020 euros), and an overall benefit–cost ratio. Scenario analyses considered alternate assumptions for key model inputs.
Results: Across all 11 pathogens, we estimated that the PIP prevented 226,000 cases of infections and 200 deaths, as well as the loss of 7,000 life-years and 8,000 quality-adjusted life-years over the lifetime of a birth cohort of 118,000 children. The PIP was associated with discounted vaccination costs of €91 million from the healthcare-sector perspective and €122 million from the societal perspective. However, vaccination costs were more than fully offset by disease-related costs averted, with the latter amounting to a discounted €126 million and €390 million from the healthcare-sector and societal perspectives, respectively. As a result, pediatric immunization was associated with overall discounted savings of €35 million and €268 million from the healthcare-sector and societal perspectives, respectively; every €1 invested in childhood immunization resulted in approximately €1.4 in disease-related cost savings to the health system and €3.2 in cost savings from a societal perspective for Belgium’s PIP. Estimates of the value of the PIP were most sensitive to changes in input assumptions for disease incidence, productivity losses due to disease-related mortality, and direct medical disease costs.
Conclusion: Belgium’s PIP, which previously had not been systematically assessed, provides large-scale prevention of disease-related morbidity and premature mortality, and is associated with net savings to health system and society. Continued investment in the PIP is warranted to sustain its positive public health and financial impact.
1. Introduction
Vaccines are among the most cost-effective strategies to promote public health and prevent infectious diseases and associated morbidity, mortality, and disability (1). However, the comprehensive economic value of vaccines may be under recognized because effects such as reductions in disease complications, productivity gains for caregivers, and improvements in quality of life may not fully be reflected in the economic evidence (2). Further, as infections prevented from vaccination are not directly observable, immunization programs can fall victim to their own success. To ensure that sufficient resources are allocated for immunization programs, it is important that studies document the return on investment (ROI) that such programs offer.
Belgium has established a pediatric immunization schedule to protect against childhood vaccine-preventable infectious diseases. Belgium’s Superior Health Council recommends the following routine immunizations for children: diphtheria, tetanus, acellular pertussis, inactivated poliovirus, hepatitis B, and Haemophilus influenzae type b (hexavalent; DTaP-IPV-HepB-Hib); diphtheria, tetanus, acellular pertussis, and inactivated poliovirus (DTaP-IPV); measles, mumps, rubella (MMR); meningococcal type ACWY, pneumococcal conjugate (PCV); and rotavirus (3). Oversight of Belgium’s vaccination program takes place from federated entities, with separate authorities for Flanders, Wallonia, and Brussels. Vaccination coverage rates are near or above 90% for pediatric vaccines across Belgium, with slightly higher rates in Flanders as compared with Wallonia/Brussels regions (4). Certain childhood vaccines that are included in neighboring countries, such as meningococcal type B and varicella, are not part of the routine immunization program in Belgium.
The cost of vaccine acquisition and administration throughout life in 7 European countries was found to range from €443 to €3,395 per person (5). Despite the public health value of immunization programs, most European Union countries spend less than 0.5% of their healthcare budgets on immunization (6). When considering the investment in vaccination programs, studies in low- and middle-income countries have estimated favorable ROI for pediatric immunization programs (PIPs) (7, 8). Additionally, in the United States (US), an evaluation of the costs and the ROI of routine immunization in children for the 2017 birth cohort yielded a savings of $13.7 billion in direct healthcare costs and $55.1 billion to society, with benefit–cost ratios (BCRs) of 2.8 and 7.5, respectively (9). However, to our knowledge, the public health impact and value for money of PIPs as a whole have not previously been evaluated in high-income countries other than the US. Therefore, this study evaluated the public health and value for money of the Belgium PIP from both a healthcare-sector perspective and a societal perspective.
2. Methods
2.1. Model description
We developed a decision tree model in Microsoft Excel to analyze the public health impact and value for money of Belgium’s PIP. The model focused on 6 vaccines routinely administered from birth through age 10 years in Belgium: hexavalent (DTaP-IPV-HepB-Hib), DTaP-IPV, MMR, PCV, rotavirus, and meningococcal type C. While meningococcal type ACWY vaccination is currently recommended by the Superior Health Council (3), it was not included in Belgium vaccination schemes at the time of the analysis. Meningococcal type C vaccination, which was recommended prior to the meningococcal type ACWY recommendation, was therefore modeled. Adolescent (e.g., human papilloma virus, DTaP booster) and adult vaccines were not modeled. Because reporting of hepatitis B incidence in Belgium improved after the introduction of a hepatitis B vaccine, pre-vaccine incidence was likely significantly underreported; therefore, the impact of the immunization program on hepatitis B disease incidence and costs was conservatively omitted (10–12).
The 2018 Belgian birth cohort was modeled and followed from birth to age 100 years. Two analytical scenarios were constructed: one in which routine pediatric immunization occurred and one in which no immunization occurred. The incidence of modeled diseases reflected current rates of disease in the scenario with pediatric immunization, whereas incidence in the counterfactual scenario without immunization was assumed to reflect pre-vaccine levels. Thus, reductions in disease incidence were estimated from observed incidence data rather than mathematically modeled from vaccination coverage and effectiveness data and observed reductions in disease incidence were assumed to be fully attributed to vaccination. This model structure and analytic framework was previously used to analyze the PIP in the US Carrico et al. (9).
Separate decision trees were used to estimate the incidence and costs of each pathogen covered by Belgium’s PIP (i.e., diphtheria, tetanus, pertussis, poliomyelitis, H influenzae type b, measles, mumps, rubella, Streptococcus pneumoniae, rotavirus, and meningococcal type C disease). Disease outcomes and costs were calculated every month from birth until age 12 months and then for every year thereafter. Each cycle, we subtracted the number of individuals who died from all-cause mortality from the birth cohort, and the remaining individuals progressed to the next cycle. Age-specific all-cause mortality, disease incidence, disease management costs, and probability of different clinical outcomes were used to parameterize the decision tree for each disease. For each disease, the total cases of a given severity were calculated by multiplying the likelihood of different clinical outcomes (including death) by the total number of expected cases. Total disease management costs were calculated by multiplying costs for a given clinical outcome by the number of clinical outcomes among the total number of disease cases. Surviving individuals who developed long-term complications for some diseases accumulated disability-related costs and quality-of-life reductions, which were discounted over their remaining lifetimes.
Vaccination costs for the birth cohort were modeled using vaccination coverage estimates and assumed timing of administering vaccine doses according to Belgium’s recommended pediatric immunization schedule (3). Vaccination coverage estimates were used for estimation of vaccination costs only, as disease cases were estimated using observed incidence data.
The model compared lifetime health outcomes and costs between the PIP scenario and a scenario without any immunization. Analyses were conducted from both a healthcare-sector perspective and a societal perspective. Health outcomes and costs were discounted at an annual rate of 1.5 and 3.0%, respectively, in line with Belgian recommendations for economic evaluation (20). Costs were inflated to 2020 euros using the consumer price index for Belgium (21).
2.2. Immunization program costs
We calculated the costs of the immunization program based on the 2021 immunization schedule and the most recent vaccine coverage data available at the time of the analysis, which were from 2019–2020 (Table 1). For simplicity reasons, we looked at vaccine coverage for Belgium as a whole for our model. This was done by obtaining vaccination coverage from the Flanders, Wallonia, and Brussels regions (4, 13, 15); then a weighted average coverage for Belgium was calculated using the 2020 total population size estimates among ages less than 10 years for each region from Statbel, the Belgian statistical office (14). The number of people in the birth cohort receiving each dose of recommended vaccines in Belgium’s PIP was calculated by multiplying the vaccination coverage for each dose by the size of the birth cohort at each age of recommended vaccination. No adjustments were made to account for a proportion of children receiving the vaccine later than the recommended age.
Vaccine acquisition costs were obtained from public vaccine prices from the Belgian National Institute for Health and Disability Insurance and the Belgian Pharmacotherapeutic Information Center (18, 19). Costs of vaccine administration were incurred per vaccination visit, with vaccination visits distributed among well-child clinics, pediatricians, and general practitioners (22, 23). Vaccine-related adverse events incurred costs associated with outpatient visits and hospitalizations (23–25).
Travel and productivity loss costs for time spent by a caregiver to bring their child to receive each vaccine were included in the societal perspective. Hourly costs of caregiver time were calculated from 2018 Statbel estimates of annual gross salary for Belgium residents. Travel costs were assumed to be €5 per vaccination visit. Fifty percent of the travel and productivity loss costs for each physician visit during which immunizations were given were attributed to the cost of the immunization program. Previous economic analyses presented wide variations in approaches for capturing indirect costs associated with child vaccination; therefore, this parameter was tested in sensitivity analysis using the widest range (0–100%).
2.3. Disease incidence
We considered incidence data before and after each vaccine was routinely recommended for each vaccine-preventable disease (Table 2). Pre-vaccine incidence was obtained using published incidence estimates for Belgium or calculated using published annual case estimates and Belgium population data for the same period (26–37). Average incidence over multiple years was used if available to account for fluctuations in annual disease incidence. Pre-vaccine incidence rates from other European countries were used for Belgium when local data were unavailable, which included Poland for tetanus, pertussis, and rubella and France for H influenzae type b (38–45). Our analysis assumed that that any observed reduction in disease incidence after vaccine introduction was fully caused by vaccination within the population. This approach of using pre-vaccine and vaccine-era incidence implicitly captured the impact that vaccination coverage, efficacy, and waning have on disease incidence at the population level. Thus, vaccination coverage rates used to estimate immunization program costs were not used to estimate reductions in disease incidence due to immunization. This approach was a simplification of the complex dynamics that drive infectious disease transmission, which also include factors such as changes in individual behaviors, sanitation and hygiene, epidemiological circumstances, and exchanges and interactions with other countries and populations. Nonetheless, there is a wide consensus that lower incidences from pediatric infectious diseases are largely caused by vaccine introduction within the population (46–50). To demonstrate the influence of this assumption, we conducted scenario analyses in which lower pre-vaccine incidences and higher vaccine-era incidences were separately tested.
Vaccine-era incidence for each disease was obtained from the most recent surveillance data from the European Centre for Disease Prevention and Control, calculated from published annual case estimates and Belgium population data, or derived from published vaccination impact and effectiveness studies (32, 33, 51–66). Average incidence over the most recent 5 years of surveillance data were used if available.
For both pre-vaccine and vaccine-era incidence, age-specific incidence was used when available. Incidence was not adjusted for underreporting; thus, disease underreporting was only captured in incidence estimates if the underlying data source adjusted for underreporting. Additional details regarding the date of vaccination program initiation for each disease, as well as sources and time periods for pre-vaccine and vaccine-era incidence estimates, are available in the Supplementary Material.
2.4. Healthcare-sector disease costs
To capture the costs from disease cases, the model considered disease-specific case severity distributions, disease case-fatality rates, direct medical costs per case, and costs for management of long-term sequelae, with estimates based on the published literature (Table 3; Supplementary Material Tables A-4 to A-17). Case-fatality rates and costs for disease management were intended to reflect the current standard of care for managing vaccine-preventable disease cases.
2.5. Productivity losses due to disease
The human capital approach was applied to calculate the value of time loss due to acute disease, long-term complications, and disease-related mortality (24, 67, 69). Mean workdays lost per disease case (Supplementary Material Table A-19) were multiplied by daily productivity, which was calculated from annual gross salary, to capture productivity losses due to acute disease. Age-specific annual productivity and life expectancy were used to calculate productivity losses associated with long-term complications and disease-related deaths. The percentage reduction in annual productivity for long-term complications was assumed to be equal to the percentage reduction in health-related utility weights associated with the complication (Supplementary Material Table A-20).
2.6. Quality-of-life impacts
Vaccinated individuals may experience adverse-event–related quality-of-life impacts. To calculate quality-adjusted life-years (QALYs) lost because of adverse events, the number of vaccine-related adverse events experienced by the birth cohort was multiplied by adverse event–specific disutilities and their associated durations (Supplementary Material Table A-3). Disease impact on quality of life was calculated using disease-specific disutilities and their associated durations (Supplementary Material Table A-18) (9).
2.7. Outcomes
Vaccine acquisition costs associated with the Belgium’s PIP were calculated by multiplying the number of vaccine doses administered by acquisition costs per dose. Vaccine administration costs were calculated by multiplying the expected number of vaccination visits by the administration cost per visit, allowing for multiple vaccines to be given at a single physician visit according to the immunization schedule. Vaccine-related adverse event incidence per dose, cost per adverse event, and number of vaccine doses administered were multiplied to calculate adverse event costs. For the societal perspective only, costs for travel and productivity loss for caregiver time for vaccination visits were calculated using the expected number of vaccination visits, travel costs per visit, and time loss costs per visit.
The number of disease cases for the 11 modeled pathogens for the 2018 birth cohort was calculated using incidence rates from the pre-vaccine and vaccine eras. Clinical outcomes by severity were then calculated, including the number of cases with lifelong sequelae and disease-related deaths.
Costs of disease for the 11 modeled pathogens were calculated with the current PIP and for comparison with the cost of disease if the PIP were discontinued and incidence were to revert to pre-vaccine levels. Specifically, the cost per disease outcome (by severity) was multiplied by the number of clinical outcomes in the pre-vaccine and vaccine eras. Costs of long-term sequelae were calculated using an annual cost, discounted over the duration of the sequela or over the cohort’s remaining lifetime. For the societal perspective only, productivity loss for disease-related deaths was calculated as the number of deaths at each age by the discounted lifetime productivity at that age.
QALYs were calculated similarly to costs, with the disutility and duration value per disease or adverse event outcome multiplied by the number of clinical outcomes. The monetary value of total QALYs gained was calculated by multiplying total QALYs gained by a willingness-to-pay threshold of €39,500 per QALY gained, which is roughly the gross domestic product per capita in Belgium (70, 68).
2.8. Analyses
The financial BCR of the Belgium PIP was calculated for each perspective by dividing the costs of disease cases averted by the net vaccination costs, as done in similar previous analyses (9, 67). This was calculated according to the equation:
where Bt represents the annual direct costs savings from cases prevented by vaccination in year t, Ct represents the annual direct costs of vaccination in year t, t represents the year of the analysis, r represents the discount rate, and T represents the number of years in the time horizon.
For the societal perspective, Bt also includes productivity losses from disease-related morbidity and mortality averted, and Ct also includes productivity losses owing to vaccination visits.
Cases averted and deaths averted because of the PIP were also calculated. QALYs gained were calculated as the difference in QALYs lost between the scenarios with and without the Belgium PIP. The monetary value of QALYs gained was not included in the financial BCR for the base-case analysis and is instead reported as a standalone outcome, as a formal cost–benefit analysis was not conducted.
2.8.1. Scenario analyses
In addition to base-case analyses, scenario analysis was conducted to assess the robustness of model results to changes in key assumptions. Scenarios considered variations to the following assumptions: (1–2) 10 and 20% reduction in pre-vaccine disease incidence; (3–4) 10 and 20% increase in vaccine-era disease incidence; (5–6) 20 and 40% reduction in vaccine acquisition costs to reflect vaccine tender prices; (7) 20% increase in pre-vaccine incidence underreporting for all diseases except meningococcal type C disease; (8) 20% increase in vaccine-era incidence underreporting for measles, mumps, pneumococcal disease, and rotavirus; (9–10) 20% increase and decrease in healthcare-sector disease-related costs; (11–12) 20% increase and decrease in health disutility values; (13) exclusion of productivity losses due to disease-related mortality; (14) 10-year time horizon (versus lifetime time horizon in base-case analysis); (15) inclusion of the economic value of QALYs gained in the benefits variable of the financial BCR calculation; (16) 20% reduction in pre-vaccine disease incidence and 20% reduction in vaccine acquisition costs (combination of Scenario 2 and Scenario 5); and (17) 20% increase in vaccine-era disease incidence and 20% reduction in vaccine acquisition costs (combination of Scenario 4 and Scenario 5).
3. Results
3.1. Health outcomes without and with immunization
For the 2018 Belgian birth cohort of 117,800 individuals, there were an estimated 265,000 preventable disease cases without the PIP, resulting in 508 disease-related deaths, 10,300 life-years (LYs) lost, and 11,000 QALYs lost because of disease-related morbidity and mortality. When modeled with the Belgium PIP, there were an estimated 39,000 vaccine-preventable disease cases and 294 disease-related deaths, with 3,300 LYs and 3,100 QALYs lost. Therefore, the Belgium PIP was associated with approximately 226,000 disease cases averted, 214 disease-related deaths averted, 7,100 LYs gained, and 8,000 QALYs gained (Table 4).
The PIP’s impact on disease morbidity and mortality varied by disease, with the most cases averted for measles (84,725 cases averted), mumps (59,938 cases averted), and pneumococcal disease (41,768 cases averted). Disease-related deaths averted, LYs gained, and QALYs gained were highest for measles (68 deaths averted, 3,071 LYs gained, and 3,425 QALYs gained), pneumococcal disease (68 deaths averted, 1,221 LYs gained, and 1,357 QALYs gained), and diphtheria (46 deaths averted, 1,532 LYs gained, and 1,348 QALYs gained; Table 4).
Table 4 presents undiscounted incremental health outcomes associated with the Belgium PIP. For each disease evaluated, each associated vaccine in the Belgium PIP reduced the number of cases from approximately 51% for pneumococcal disease to 100% for tetanus and polio. A reduction in cases of more than 90% was achieved for 8 of the 11 pathogens evaluated.
3.2. Cost outcomes without and with immunization
Without the Belgian PIP, lifetime discounted societal disease-related costs for the birth cohort were an estimated €515 million, 43% (€222 million) owing to productivity losses from disease-related mortality, 33% (€169 million) owing to healthcare-sector costs to treat cases of disease, and the remainder owing to productivity losses from cases of disease and long-term sequelae (€124 million). Lifetime societal disease-related costs were €125 million when diseases were modeled with the Belgium PIP, including €43 million in healthcare-sector costs to treat cases of disease, €15 million in productivity losses due to cases of disease and long-term sequelae, and €67 million in productivity losses due to disease-related mortality.
Therefore, discounted societal disease-related cost savings due to Belgian PIP totaled €390 million, with the highest savings from averted cases of measles, mumps, and pneumococcal disease (Figure 1). For disease-related costs averted, healthcare-sector costs to treat individuals with acute cases of disease and long-term sequelae accounted for 32% of the savings, while the remaining costs averted were from productivity losses due to cases of disease and long-term sequelae (28%) and productivity loss due to mortality (40%; Table 5).
Figure 1. Societal disease-related costs averted by the Belgium PIP by disease and cost category. MenC = meningococcal type C; PIP = pediatric immunization program. Costs are presented in 2020 euros discounted at an annual rate of 3%.
Immunization of the 2018 Belgian birth cohort resulted in €122 million in discounted societal vaccination costs, with most costs associated with vaccine acquisition (64%), administration (9%), and caregiver time and travel (25%); adverse events constituted a small proportion of costs (1%). Vaccination costs were significantly outweighed by disease-related costs averted, resulting in net savings of €268 million and a financial BCR of 3.2 from the societal perspective. This BCR indicates that every €1 invested in the Belgian PIP is expected to result in over €3 in savings to society. When productivity losses were excluded in the healthcare-sector perspective, a financial BCR of 1.4 was observed. Although the economic value of QALYs gained because of the Belgian PIP was not included in the financial BCR calculation in the base-case analysis, the total QALYs gained was valued at approximately €315 million when a willingness-to-pay threshold of €39,500 per QALY gained was considered (70, 68).
3.3. Scenario analyses
When key assumptions and analysis settings were modified in scenario analyses, the societal BCR for the Belgium PIP was lowest when productivity losses due to disease-related mortality were excluded (BCR = 1.9). Scenarios related to input data assumptions demonstrated that QALYs gained were most impacted by variations in assumptions for disease incidence and disutility values and that BCRs were most impacted by variations in assumptions for incidence and direct medical costs per case (Table 6). When the economic value of QALYs gained was included in the BCR calculation, the societal BCR substantially increased (BCR = 5.8). The impact of changes in pre-vaccine and vaccine era disease incidence on the societal BCR was mitigated when vaccine acquisition costs were reduced to reflect tender prices.
4. Discussion
This analysis found that Belgium’s PIP averted 226,000 cases and 214 premature deaths for the 2018 birth cohort over its lifetime, resulting in net savings from both a societal perspective (BCR = 3.2) and healthcare-sector perspective (BCR = 1.4). Public health achievements likely attributable to the PIP included the reduction in incidence of diphtheria, H influenzae type b, polio, rubella, and tetanus to negligible levels (<1 case per 100,000 population annually) and a reduction of >90% in incidence for 8 of the 11 pathogens covered by the PIP. When key input values were varied in scenario analyses, financial BCRs from the healthcare-sector and societal perspectives remained at or above 1, highlighting the robustness of the ROI for the Belgium PIP to the health system and society.
Previous cost–benefit analyses have evaluated the US PIP, with BCRs ranging from 2.8 to 3.0 and 7.5 to 10.1 from healthcare-sector and societal perspectives, respectively (9, 67). Analyses of immunization programs in low- and middle-income countries have also estimated a positive ROI for pediatric immunization (7, 8). Estimated BCRs for Belgium from the current analysis were lower than those estimated in the US. Differences in BCRs across countries could be explained by differences in healthcare costs, disease epidemiology, and magnitude and consistency of vaccination uptake, among other factors. Despite the lower BCRs relative to the US estimated in this study, pediatric immunization has been consistently demonstrated to provide significant economic value to society.
Results for the Belgium PIP found that averted cost of illness was greatest for averted cases of measles (i.e., €129.9 million), leading to nearly one-third of the total cost savings; this was aligned with prior findings that vaccination for the prevention of measles yielded the greatest costs savings across childhood immunization programs globally (~37% of total averted costs during the 2001–2020 period) (7). The visibility of the value of pediatric immunization is increasingly important, as the COVID-19 pandemic has significantly disrupted immunization rates in some European countries (71), creating a risk of resurgence of vaccine-preventable diseases. Outbreaks of measles have been increasingly documented since the start of the pandemic, and global measles cases have increased 79% year over year in the first 2 months of 2022 (72).
This analysis included limitations that must be noted. First, this analysis did not directly account for other public health improvements in addition to the Belgium PIP that have occurred in parallel with vaccine introductions over time and likely also contribute to reducing the burden of vaccine-preventable disease. In other words, the analysis framework assumed that all reductions in disease incidence were fully attributable to vaccination. Because of the limitations introduced by our incidence approach, we conducted scenarios with decreased pre-vaccine incidence (−10% and − 20%) and increased vaccine-era incidence (+10% and + 20%) across all modeled diseases to test the robustness of our analysis results. The PIP remained a valuable investment under such scenarios. Further, costs of adolescent and adult vaccines, as well as the proportion of disease reduction attributable to these vaccines, were not considered. A positive return on investment for the Belgium PIP was observed in a scenario analysis restricting the analysis time horizon to only model ages 0 to 10 years, indicating that the PIP was a valuable investment even when disease reductions that may be partially attributable to adolescent and adult vaccines were omitted. The human capital approach was used to estimate productivity losses due to mortality, consistent with previous economic evaluations of immunization programs (7, 9, 67, 73). Use of other methods of productivity loss estimation (e.g., friction cost approach) would result in reduced productivity losses due to mortality. These limitations may have allowed for overestimation of the impact of pediatric immunization on the reduction of vaccine-preventable disease morbidity, mortality, and economic burden. However, the analysis did not capture the impact of pediatric immunizations on groups outside the modeled cohort through herd immunity or other extended benefits of vaccination, such as increased educational attainment, increased productivity, reduced household financial risk, and reduced use of antimicrobials for vaccine-preventable diseases. These omissions may have contributed to underestimation of the disease impact and value of pediatric immunization. This analysis also considered public prices of vaccines, which are higher than tendered prices. Scenario analyses considering hypothetical reductions in vaccine prices improved the ROI for the PIP. Therefore, use of public prices in the analysis underestimates the value for money of the PIP.
Data limitations were also significant, as current estimates of disease outcomes (e.g., case-fatality ratios) and disease treatment costs could not be obtained for diseases that have been mostly eliminated. When such data unavailability was encountered, data from countries other than Belgium and/or assumptions supported by subject matter experts were applied. Scenario analyses demonstrated that the ROI for the PIP was robust to variations in assumptions for case-fatality ratios and healthcare-sector costs associated with disease cases. Disease-underreporting factors were conservatively not applied in the pre-vaccine era or vaccine era, which may underestimate the disease impact and value of pediatric immunization, as disease underreporting is likely more significant in the pre-vaccine era.
In conclusion, this is the first analysis to systematically assess the public health and economic effects of a European country’s PIP. The analysis estimated that routine pediatric immunization in Belgium averted more than 220,000 disease cases and 200 disease-related deaths for the 2018 birth cohort. Every €1 invested in pediatric immunization resulted in a €3 ROI from the societal perspective. Therefore, Belgium’s PIP brings large-scale prevention of morbidity and mortality and an associated reduction in costs, highlighting the value of pediatric immunization.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary material. Further inquiries can be directed to the corresponding author.
Ethics statement
Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
Author contributions
JC, CM, ST, and MN participated in the conception, design, and planning of the study, in the acquisition and analysis of the data, in the interpretation of the results, and in the drafting of the manuscript and critically reviewing and revising it for important intellectual content. AB-A and DB participated in the acquisition and analysis of the data, in the interpretation of the results, and in the drafting of the manuscript and critically reviewing and revising it for important intellectual content. BM and JV participated in the conception, design, and planning of the study, in the analysis of the data, in the interpretation of the results, and in critically reviewing and revising the manuscript for important intellectual content. ND, PL, JL, and OE participated in the analysis of the data, in the interpretation of the results, and in critically reviewing and revising the manuscript for important intellectual content. MR and AE participated in the interpretation of the results and in critically reviewing and revising the manuscript for important intellectual content. SS participated in the conception, design, and planning of the study, in the interpretation of the results, and in critically reviewing and revising the manuscript for important intellectual content. GB participated in the conception, design, and planning of the study, in the interpretation of the results, and in the drafting of the manuscript and critically reviewing and revising it for important intellectual content. All authors contributed to the article and approved the submitted version.
Funding
This study and preparation of this manuscript were funded by Merck Sharp & Dohme LLC, a subsidiary of Merck & Co., Inc., Rahway, NJ, USA.
Acknowledgments
Kate Lothman of RTI Health Solutions provided medical writing support for the development of this manuscript.
Conflict of interest
JC, CM, and ST are employed by RTI Health Solutions, which received funding for the conduct of this study. AB-A, BM, JV, and DB are employees of MSD, Belgium. GB is an employee of MSD, Spain. AE is an employee of Merck Sharp & Dohme LLC, a subsidiary of Merck & Co., Inc., Rahway, NJ, USA. MN was an employee of Merck Sharp & Dohme LLC, a subsidiary of Merck & Co., Inc., Rahway, NJ, USA, while this study was conducted. GB, AE, and MN are shareholders in Merck & Co., Inc., Rahway, NJ, USA. SS has been involved in research and advisory boards related to the economic evaluation of vaccines funded by MSD, GSK, and Pfizer. ND reports personal fees from Roche and Boehringer-Ingelheim and nonfinancial support from Pfizer, Janssen, and MSD outside the submitted work; ND also has been involved in research related to the economic evaluation of vaccines with MSD and Pfizer as an unpaid consultant. PL has received consulting fees for advisory board participation from Sanofi. OE has received consulting fees for advisory board participation and for support of model design in the evaluation of vaccines from MSD, Pfizer, GSK, and Sanofi. JL’s employer (KU Leuven) has received an hourly wage compensation for participation in workshops related to the economic evaluation of vaccines funded by MSD and Pfizer.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2023.1032385/full#supplementary-material
References
1. WHO (2014). The case for investing in public health. Available at: https://www.euro.who.int/__data/assets/pdf_file/0009/278073/Case-Investing-Public-Health.pdf [Accessed August 24, 2021].
2. Annemans, L, Beutels, P, Bloom, DE, De Backer, W, Ethgen, O, Luyten, J, et al. Economic evaluation of vaccines: Belgian reflections on the need for a broader perspective. Value Health. (2021) 24:105–11. doi: 10.1016/j.jval.2020.09.005
3. FPS Health FCSaE (2021). Report CSS 9606 – basic immunization schedule – 2021. Available at: https://www.health.belgium.be/sites/default/files/uploads/fields/fpshealth_theme_file/20210701_fiche_9606_vaccinatieschema_hgr_2021.pdf [Accessed January 14, 2022].
4. Grammens, T, and Cornelissen, L. (2021). Rapport annuel VPD 2021, couverture vaccinale. Available at: https://www.sciensano.be/sites/default/files/vaccine_coverage_2020-21_fr_final.pdf [Accessed March 24, 2023].
5. Ethgen, O, Cornier, M, Chriv, E, and Baron-Papillon, F. The cost of vaccination throughout life: a western European overview. Hum Vaccin Immunother. (2016) 12:2029–37. doi: 10.1080/21645515.2016.1154649
6. Faivre, P, Bencina, G, Campbell, R, Quilici, S, Dauby, N, Tesovic, G, et al. Immunization funding across 28 European countries. Expert Rev Vaccines. (2021) 20:639–47. doi: 10.1080/14760584.2021.1905257
7. Ozawa, S, Clark, S, Portnoy, A, Grewal, S, Stack, ML, Sinha, A, et al. Estimated economic impact of vaccinations in 73 low- and middle-income countries, 2001-2020. Bull World Health Organ. (2017) 95:629–38. doi: 10.2471/BLT.16.178475
8. Sim, SY, Watts, E, Constenla, D, Brenzel, L, and Patenaude, BN. Return on investment from immunization against 10 pathogens in 94 low- and middle-income countries, 2011-30. Health Aff. (2020) 39:1343–53. doi: 10.1377/hlthaff.2020.00103
9. Carrico, J, La, EM, Talbird, SE, Chen, YT, Nyaku, MK, Carias, C, et al. Value of the immunization program for children in the 2017 US birth cohort. Pediatrics. (2022) 150:e2021056007. doi: 10.1542/peds.2021-056013
10. Beutels, M, Van Damme, P, Aelvoet, W, Desmyter, J, Dondeyne, F, Goilav, C, et al. Prevalence of hepatitis A, B and C in the Flemish population. Eur J Epidemiol. (1997) 13:275–80. doi: 10.1023/a:1007393405966
11. Quoilin, S, Hutse, V, Vandenberghe, H, Claeys, F, Verhaegen, E, De Cock, L, et al. A population-based prevalence study of hepatitis a, B and C virus using oral fluid in Flanders, Belgium. Eur J Epidemiol. (2007) 22:195–202. doi: 10.1007/s10654-007-9105-6
12. Conseil supérieur de la santé (2013). Fiche de vaccination. CSS N° 8809. Available at: http://www.health.belgium.be/eportal/Aboutus/relatedinstitutions/SuperiorHealthCouncil/publications/factsheetsvaccination/index.htm?fodnlang=fr [Accessed May 19, 2022].
13. Vlaamse overheid van Belgie (2022). Studie van de vaccinatiegraad in Vlaanderen 2020. Available at: https://www.laatjevaccineren.be/vaccinatiegraadstudie [Accessed March 24, 2023].
14. Statbel (2021). Population. Available at: https://statbel.fgov.be/en/themes/population [Accessed January 24, 2021].
15. Vermeeren, A, and Goffin, F. (2015). Statistique de couverture vaccinale en 2ème primaire en Fédération Wallonie-Bruxelles en 2014–2015 [Convention Provac 2014–2015]. Available at: https://dial.uclouvain.be/pr/boreal/object/boreal:216153 [Accessed March 24, 2023].
16. Vlaamse overheid van Belgie (2016). Vaccinatiegraadstudie van Agentschap Zorg en Gezondheid. Available at: https://www.zorg-en-gezondheid.be/vaccinatiegraadstudie [Accessed October 28, 2021].
17. VaxInfo.org (2015). Enquête de couverture vaccinale en Wallonie (Vaccine coverage survey in Wallonia). Available at: https://www.vaxinfopro.be/spip.php?article2000&lang=fr [Accessed October 29, 2021].
18. RIZIV/INAMI (2021). Institut National d'Assurance Maladie-Invalidité. Programme web - Médicaments. Available at: https://ondpanon.riziv.fgov.be/SSPWebApplicationPublic/fr/Public/ProductSearch [Accessed July 30, 2021].
19. CBIP, AFMPS (n.d.). Centre Belge d'Information Pharmacothérapeutique, Agence Fédérale des Médicaments et des Produits de Santé. Vaccins Available at: https://www.cbip.be/fr/chapters/13?frag=11247 [Accessed October 4, 2021].
20. Cleemput, I, Neyt, M, Van De Sande, S, and Thiry, N. (2015). Belgian health care knowledge Centre (KCE). Belgian guidelines for economic evaluations and budget impact analyses: Second edition. Report No.: KCE reports 183C (D/2012/10.273/54).
21. Statbel, SPF Economie (2021). Belgium National Office for statistics. Indice des prix à la consommation (CPI). Available at: https://statbel.fgov.be/fr/themes/prix-la-consommation/indice-des-prix-la-consommation#figures [Accessed October 28, 2021].
22. Hanquet, G, Christensen, H, Agnew, E, Trotter, C, Robays, J, Dubois, C, et al. (2014). Belgian health care knowledge Centre (KCE). A quadrivalent vaccine against serogroup B meningococcal disease: a cost-effectiveness study. Health technology assessment (HTA) Report No.: KCE Reports 231. D/2014/10.273/77.
23. INAMI (2021). Institut National d'Assurance Maladie-Invalidité. NomenSoft. Available at: https://www.riziv.fgov.be/fr/programmes-web/Pages/NomenSoft.aspx [Accessed October 28, 2021].
24. Zhou, F, Santoli, J, Messonnier, ML, Yusuf, HR, Shefer, A, Chu, SY, et al. Economic evaluation of the 7-vaccine routine childhood immunization schedule in the United States, 2001. Arch Pediatr Adolesc Med. (2005) 159:1136–44. doi: 10.1001/archpedi.159.12.1136
25. Cleemput, I, Neyt, M, Van de Sande, S, and Thiry, N. (2012). Belgian health care knowledge Centre (KCE). Belgian guidelines for economic evaluations and budget impact analyses: second edition. Health technology assessment (HTA). Report No.: KCE Report 183C. D/2012/10.273/54.
26. Agentschap Zorg en Gezondheid (2013). Vlaamse overheid van Belgie (health and care agency, Flemish regional government of Belgium) Vaccinatie Difterie (Diphteria vaccination). Available at: https://www.zorg-en-gezondheid.be/sites/default/files/2022-12/Difterie_2022.pdf [Accessed 28 October 2021].
27. Statbel, SPF Economie (2021). Belgium National Office for Statistics. Population par lieu de résidence, nationalité, état civil, âge et sexe. Available at: https://statbel.fgov.be/fr/themes/population/structure-de-la-population#figures [Accessed October 5, 2021].
28. Van Casteren, V. Epidemiology of measles and mumps in Belgium, 1994-1995. Arch Public Health. (1997):15.
29. Noah, N. Surveillance of bacterial meningitis in Europe 1999/2000. Euro Surveill. (2002) 6:ii–2116. doi: 10.2807/esw.06.15.02116-en
30. ECDC (2010). European Centre for Disease Prevention and Control. Survaillance of invasive bacterial diseases in Europe 2007. Available at: https://www.ecdc.europa.eu/sites/default/files/media/en/publications/Publications/101011_SUR_Surveillance_of_invasive_bacterial_diseases_in_Europe_2007.pdf [Accessed October 28, 2021].
31. Cockburn, WC, and Drozdov, SG. Poliomyelitis in the world. Bull World Health Organ. (1970) 42:405–17.
32. Mendes da Costa, E, Grammens, T, Litzroth, A, Maes, V, Muyldermans, G, Quoiln, S, et al. (2015). Institut Scientifique de Santé Publique. Maladies Infectieuses pédiatriques a prévention vaccinale. Rapport annuel, 2015.
33. Blommaert, A, Hanquet, G, Willem, L, Theeten, H, Thiry, N, Bilcke, J, et al. (2016). Belgian health care knowledge Centre (KCE). Use of pneumococcal vaccines in the elderly: an economic evaluation. Health technology assessment (HTA). Report No.: KCE Reports 274. D/2016/10.273/79.
34. Beutels, P, Van Damme, P, and Oosterhuis-Kafeja, F. (2006). Belgian health care knowledge Centre (KCE). Effects and costs of pneumococcal conjugate vaccination of Belgian children. Health technology assessment (HTA). Report No.: KCE reports 33C (D/2006/10.273/53).
35. Jit, M, Bilcke, J, Mangen, MJ, Salo, H, Melliez, H, Edmunds, WJ, et al. The cost-effectiveness of rotavirus vaccination: comparative analyses for five European countries and transferability in Europe. Vaccine. (2009) 27:6121–8. doi: 10.1016/j.vaccine.2009.08.030
36. Bilcke, J, Van Damme, P, and Beutels, P. Cost-effectiveness of rotavirus vaccination: exploring caregiver(s) and “no medical care” disease impact in Belgium. Med Decis Mak. (2009) 29:33–50. doi: 10.1177/0272989x08324955
37. Bilcke, J, Van Damme, P, De Smet, F, Hanquet, G, Van Ranst, M, and Beutels, P. The health and economic burden of rotavirus disease in Belgium. Eur J Pediatr. (2008) 167:1409–19. doi: 10.1007/s00431-008-0684-3
38. Reinert, P, Liwartowski, A, Dabernat, H, Guyot, C, Boucher, J, and Carrere, C. Epidemiology of Haemophilus influenzae type b disease in France. Vaccine. (1993) 11:S38–42. doi: 10.1016/0264-410x(93)90158-t
39. Gałązka, A. Czy możemy lepiej zapobiegać krztuścowi? I. Zmiany w epidemiologii krztuśca Przeg Epid. (1997) 51:275–84.
40. NIZP-PZH (1999). Pan’stwowy Zakład Higieny. Choroby zakaz’ne i zatrucia w Polsce w 1999 roku. Available at: http://wwwold.pzh.gov.pl/oldpage/epimeld/1999/Ch_1999.pdf [Accessed August 5, 2020].
41. NIZP-PZH (2000). Pan’stwowy Zakład Higieny. Choroby zakaz’ne i zatrucia w Polsce w 2000 roku. Available at: http://wwwold.pzh.gov.pl/oldpage/epimeld/2000/Ch_2000.pdf [Accessed August 5, 2020].
42. NIZP-PZH (2001). Pan’stwowy Zakład Higieny. Choroby zakaz’ne i zatrucia w Polsce w 2001 roku. Available at: http://wwwold.pzh.gov.pl/oldpage/epimeld/2001/Ch_2001.pdf [Accessed August 5, 2020].
43. NIZP-PZH (2002). Pan’stwowy Zakład Higieny. Choroby zakaz’ne i zatrucia w Polsce w 2002 roku. Available at: http://wwwold.pzh.gov.pl/oldpage/epimeld/2002/Ch_2002.pdf [Accessed August 5, 2020].
44. NIZP-PZH (2003). Pan’stwowy Zakład Higieny. Choroby zakaz’ne i zatrucia w Polsce w 2002 roku. Available at: http://wwwold.pzh.gov.pl/oldpage/epimeld/2003/Ch_2003.pdf [Accessed August 5, 2020].
45. Kostrzewski, J. Choroby zakaźne w Polsce i ich zwalczanie w latach (PZWL) 1919–1962 Warszawa: Państwowy Zakład Wydawnictwa Lekarskich (1964).
46. van Panhuis, WG, Grefenstette, J, Jung, SY, Chok, NS, Cross, A, Eng, H, et al. Contagious diseases in the United States from 1888 to the present. N Engl J Med. (2013) 369:2152–8. doi: 10.1056/NEJMms1215400
47. CDC. Impact of vaccines universally recommended for children--United States, 1990-1998. MMWR Morb Mortal Wkly Rep. (1999) 48:243–8.
48. Pezzotti, P, Bellino, S, Prestinaci, F, Iacchini, S, Lucaroni, F, Camoni, L, et al. The impact of immunization programs on 10 vaccine preventable diseases in Italy: 1900-2015. Vaccine. (2018) 36:1435–43. doi: 10.1016/j.vaccine.2018.01.065
49. Roush, SW, and Murphy, TV. Historical comparisons of morbidity and mortality for vaccine-preventable diseases in the United States. JAMA. (2007) 298:2155–63. doi: 10.1001/jama.298.18.2155
50. Talbird, SE, Carrico, J, La, EM, Carias, C, Marshall, GS, Roberts, CS, et al. Impact of routine childhood immunization in reducing vaccine-preventable diseases in the US. Pediatrics. (2022) 150:e2021056013. doi: 10.1542/peds.2021-056013
51. ECDC (2019). European Centre for Disease Prevention and Control. Diphtheria: annual epidemiological report for 2017. Available at: https://www.ecdc.europa.eu/sites/default/files/documents/diphtheria-annual-epidemiological-report-2017.pdf [Accessed October 28, 2021].
52. ECDC (2020). European Centre for Disease Prevention and Control. Hepatitis B: annual epidemiological report for 2018. Available at: https://www.ecdc.europa.eu/sites/default/files/documents/HEPB_AER_2018_Report.pdf [Accessed October 28, 2021].
53. ECDC. European Centre for Disease Prevention and Control. (2017). Haemophilus influenzae, annual epidemiological report for 2017. (2019). https://www.ecdc.europa.eu/sites/default/files/documents/haemophilus-influenzae-annual-epidemiological-report-2017.pdf [Accessed October 28, 2021].
54. ECDC. European Centre for Disease Prevention and Control (2019). Measles, annual epidemiological report for 2019 https://www.ecdc.europa.eu/sites/default/files/documents/measles-2019-aer.pdf [Accessed October 28, 2021].
55. ECDC. European Centre for Disease Prevention and Control (2017). Mumps, annual epidemiological report for 2017. (2020)https://www.ecdc.europa.eu/sites/default/files/documents/Measles-and-Rubella-Surveillance-2017.pdfhttps://www.ecdc.europa.eu/sites/default/files/documents/mumps-2017-aer.pdf
56. ECDC (2018). European Centre for Disease Prevention and Control. Pertussis: annual epidemiological report for 2018. (2020). https://www.ecdc.europa.eu/sites/default/files/documents/AER_for_2018_pertussis.pdf [Accessed October 28, 2021].
57. ECDC (2018). European Centre for Disease Prevention and Control. Measles and rubella surveillance report, 2017. Available at: https://www.ecdc.europa.eu/sites/default/files/documents/Measles-and-Rubella-Surveillance-2017.pdf [Accessed October 28, 2021].
58. ECDC (2017). European Centre for Disease Prevention and Control. Poliomyelitis, annual epidemiological report for 2017. (2019). https://www.ecdc.europa.eu/en/publications-data/poliomyelitis-annual-epidemiological-report-2017 [Accessed October 28, 2021].
59. ECDC (2017). European Centre for Disease Prevention and Control. Tetanus: annual epidemiological report for 2017. (2019).https://www.ecdc.europa.eu/sites/default/files/documents/tetanus-annual-epidemiological-report-2017_0.pdf [Accessed October 28, 2021].
60. Jacquinet, S, Mattheus, W, Lajot, A, and Wyndham-Thomas, C. (2018). Institut Scientifique de Santé Publique. Surveillance épidémiologique des infections invasives à méningocoques - 2018.
61. Vergison, A, Tuerlinckx, D, Verhaegen, J, and Malfroot, A. Epidemiologic features of invasive pneumococcal disease in Belgian children: passive surveillance is not enough. Pediatrics. (2006) 118:e801–9. doi: 10.1542/peds.2005-3195
62. Braeye, T, Wyndham-Thomas, C, Lagrou, K, Grammens, T, and Desmet, S. (2018). Institut Scientifique de Santé Publique. Epidemiologische surveillance van invasieve pneumokokkeninfecties (IPD).
63. Beutels, P, Blommaert, A, Hanquet, G, Bilcke, J, Thiry, N, Sabbe, M, et al. (2011). Belgian health care knowledge Centre (KCE). Cost-effectiveness of 10- and 13-valent pneumococcal conjugate vaccines in childhood. Health technology assessment (HTA). Report No.: 155C. D/2011/10.273/21.
64. Kawai, K, Adil, EA, Barrett, D, Manganella, J, and Kenna, MA. Ambulatory visits for otitis media before and after the introduction of pneumococcal conjugate vaccination. J Pediatr. (2018) 201:e1:122–127.e1. doi: 10.1016/j.jpeds.2018.05.047
65. Sabbe, M, Berger, N, Blommaert, A, Ogunjimi, B, Grammens, T, Callens, M, et al. Sustained low rotavirus activity and hospitalisation rates in the post-vaccination era in Belgium, 2007 to 2014. Euro Surveill. (2016) 21:21. doi: 10.2807/1560-7917.ES.2016.21.27.30273
66. Zeller, M, Rahman, M, Heylen, E, De Coster, S, De Vos, S, Arijs, I, et al. Rotavirus incidence and genotype distribution before and after national rotavirus vaccine introduction in Belgium. Vaccine. (2010) 28:7507–13. doi: 10.1016/j.vaccine.2010.09.004
67. Zhou, F, Shefer, A, Wenger, J, Messonnier, M, Wang, LY, Lopez, A, et al. Economic evaluation of the routine childhood immunization program in the United States, 2009. Pediatrics. (2014) 133:577–85. doi: 10.1542/peds.2013-0698
68. World Bank (2022). GDP per capita (current local currency unit) - Belgium, 1990–2020. Available at: https://data.worldbank.org/indicator/NY.GDP.PCAP.CN?end=2020&locations=BE&start=1990&view=chart [Accessed February 25, 2022].
69. Weisbrod, BA. The valuation of human capital. J Polit Econ. (1961) 69:425–36. doi: 10.1086/258535
70. Adam, T, Baltussen, R, Tan Torres, T, Evans, D, Hutubessy, R, Acharya, A, et al. (2003). Making choices in health: WHO guide to cost-effectiveness analysis.
71. WHO (2021). Varied impact of COVID-19 on routine immunization in the European region. Available at: https://www.euro.who.int/en/health-topics/disease-prevention/vaccines-and-immunization/news/news/2021/7/varied-impact-of-covid-19-on-routine-immunization-in-the-european-region [Accessed May 19, 2022].
72. UNICEF (2022). Measles cases are spiking globally. Available at: https://www.unicef.org/stories/measles-cases-spiking-globally [Accessed July 1, 2022].
73. Wateska, AR, Nowalk, MP, Zimmerman, RK, Smith, KJ, and Lin, CJ. Cost-effectiveness of increasing vaccination in high-risk adults aged 18-64 years: a model-based decision analysis. BMC Infect Dis. (2018) 18:52. doi: 10.1186/s12879-018-2967-2
74. De Schutter, I, Vergison, A, Tuerlinckx, D, Raes, M, Smet, J, Smeesters, PR, et al. Pneumococcal aetiology and serotype distribution in paediatric community-acquired pneumonia. PLoS One. (2014) 9:e89013. doi: 10.1371/journal.pone.0089013
75. Said, MA, Johnson, HL, Nonyane, BA, Deloria-Knoll, M, O'Brien, KL, Team AAPBS, et al. Estimating the burden of pneumococcal pneumonia among adults: a systematic review and meta-analysis of diagnostic techniques. PLoS One. (2013) 8:e60273. doi: 10.1371/journal.pone.0060273
76. Kaur, R, Morris, M, and Pichichero, ME. Epidemiology of acute otitis media in the postpneumococcal conjugate vaccine era. Pediatrics. (2017) 140:140. doi: 10.1542/peds.2017-0181
Keywords: vaccination, model, cost-benefit analysis, national immunization program, expanded immunization program, infectious disease
Citation: Carrico J, Mellott CE, Talbird SE, Bento-Abreu A, Merckx B, Vandenhaute J, Benchabane D, Dauby N, Ethgen O, Lepage P, Luyten J, Raes M, Simoens S, Van Ranst M, Eiden A, Nyaku MK and Bencina G (2023) Public health impact and return on investment of Belgium’s pediatric immunization program. Front. Public Health 11:1032385. doi: 10.3389/fpubh.2023.1032385
Edited by:
Alessandro Muzzi, GlaxoSmithKline (Italy), ItalyReviewed by:
Laura Cornelissen, Sciensano, BelgiumEner Cagri Dinleyici, Eskisehir Osmangazi University Faculty of Medicine, Türkiye
Copyright © 2023 Carrico, Mellott, Talbird, Bento-Abreu, Merckx, Vandenhaute, Benchabane, Dauby, Ethgen, Lepage, Luyten, Raes, Simoens, Van Ranst, Eiden, Nyaku and Bencina. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: André Bento-Abreu, andre.bento.abreu@merck.com
†These authors share last authorship