Skip to main content

ORIGINAL RESEARCH article

Front. Public Health, 18 November 2024
Sec. Infectious Diseases: Epidemiology and Prevention

Assessing the impact of vaccines on COVID-19 efficacy in survival rates: a survival analysis approach for clinical decision support

\r\nJuan Luis Gonzlez Rodríguez&#x;Juan Luis González Rodríguez1Andreea M. Oprescu&#x;Andreea M. Oprescu2Sergio Muoz LezcanoSergio Muñoz Lezcano3Jaime Cordero Ramos,
Jaime Cordero Ramos4,5*Juan Luis Romero Cabrera,&#x;Juan Luis Romero Cabrera6,7Miguel ngel Armengol de la Hoz&#x;Miguel Ángel Armengol de la Hoz1ngel Estella
Ángel Estella8*
  • 1Big Data Department, Andalusian Public Foundation Progress and Health-FPS, Seville, Spain
  • 2Electronic Technology Department, Universidad de Sevilla, Sevilla, Spain
  • 3Research Institute for Innovation & Technology in Education (iTED), Universidad Internacional de La Rioja (UNIR), Logroño, Spain
  • 4Hospital Pharmacy Central Management, Extremadura Health Service, Badajoz, Spain
  • 5Pharmacotherapeutic Monitoring and Personalized Medicine Group (IBIS-DS-25), Institute for Biomedical Research in Sevilla (IBIS), Sevilla, Spain
  • 6Lipids and Atherosclerosis Unit, Maimonides Institute for Biomedical Research in Cordoba (IMIBIC), Reina Sofia University Hospital, University of Córdoba, Córdoba, Spain
  • 7CIBER in Physiopathology of Obesity and Nutrition (CIBEROBN), Instituto de Salud Carlos III, Madrid, Spain
  • 8Intensive Care Unit University Hospital of Jerez, Medicine Department University of Cádiz, INIBiCA, Cádiz, Spain

Background: The global COVID-19 pandemic, caused by the SARS-CoV-2 virus, has presented significant challenges to healthcare systems worldwide.

Objective: This study, based on an analysis of a cohort from the Public Health System of Andalusia (Spain), aims to evaluate how vaccination affects case-fatality rate in patients hospitalized due to COVID-19 infection in Andalusia.

Methods: The cohort consists of 37,274 individuals after applying the inclusion criteria. We conducted survival analyses employing the Cox proportional hazards models and generated adjusted survival curves to examine the outcomes. The analyses were performed from three perspectives: vaccinated vs. unvaccinated patients, vaccinated and unvaccinated patients grouped by age, and stratified by vaccination status.

Results: Results indicate a substantial correlation between vaccination and a 20% reduction in the risk of case-fatality. Age-specific effects reveal varying degrees of protection across different age groups.

Conclusion: These findings emphasize the pivotal role of vaccination status in COVID-19 risk assessment, supporting the development of a clinical decision support system for accurate predictions and optimizing healthcare management at admission.

1 Introduction

The global COVID-19 pandemic, caused by the SARS-CoV-2 virus, has resulted in an unprecedented healthcare crisis since early 2020, exerting immense pressure on healthcare systems worldwide (1, 2). The high incidence and mortality rates of the disease have critically depleted healthcare resources globally, necessitating extraordinary measures such as resource rationing (3, 4). Amidst uncertainties surrounding disease behavior, clinical management, and resource allocation, the scientific community has been vigorously engaged in extensive research efforts.

Despite significant progress in understanding the disease—including genome sequencing (5), drug utilization (68), and vaccine development (9)—there remains a notable absence of robust prognostic tools for predicting severe outcomes or short-to-medium-term mortality. This highlights the urgent need for tools and systems that support clinical decision-making and resource allocation based on the prediction of disease progression toward severe forms, ICU admission, and the need for mechanical or non-invasive ventilation, along with short-to-medium-term mortality. Previous studies have validated predictive scales for clinical deterioration and mortality in similar clinical scenarios using vital signs and clinical variables upon admission. Notable examples include the Sequential Organ Failure Assessment (SOFA) for sepsis patients (10, 11), the Acute Physiology and Chronic Health Evaluation II (APACHE II) scale for ICU patients (12), and the National Early Warning Score 2 (NEWS2) scale used in the British healthcare system. Some of these scales have demonstrated acceptable predictive results for severe outcomes and mortality in COVID-19 patients (13).

Identified risk factors for clinical deterioration and short-to-medium-term mortality in COVID-19 include advanced age, pre-existing conditions (such as hypertension, diabetes, obesity, cardiovascular diseases, immunosuppression, and immunodepression), analytical parameters (such as troponin, D-dimer, lymphocytes, and ferritin), patterns in chest X-rays upon admission, vital signs in the first 24 h, and the development of complications [such as acute respiratory distress syndrome (ARDS) and myocardial involvement] (14, 15).

Recent studies, such as those by Escobar et al., have employed machine learning for predictive modeling and alerts for high-risk clinical deterioration in hospitalized patients, facilitating rapid responses and improved resource management, ultimately leading to a reduction in mortality (16). These analyses and predictive models have shown promising results in populations affected by COVID-19 (1719). Additionally, Waku et al.'s (20) research examines disease dynamics and forecasts transitions between epidemic and endemic phases of COVID-19, and assesses the impact of vaccination.

Developing a clinical decision support system based on predictive models for short-to-medium-term case-fatality rates in COVID-19 patients, utilizing patient clinical variables, laboratory parameters, and imaging, holds significant potential for improving resource management and patient care, potentially reducing mortality. Our study seeks to create a comprehensive predictive tool for effective risk assessment of COVID-19 patients. This will be accomplished by incorporating demographic information, vaccination status, healthcare setting, clinical outcomes, pandemic waves, pre-existing conditions, and laboratory parameters into the development of multivariate proportional hazards models, thereby providing a thorough analysis of the impact of vaccines on case-fatality rates among COVID-19 patients.

In this regard, it is important to note that the vaccines used in Andalusia, their timelines of introduction, and potential factors influencing their efficacy play a significant role in the observed case-fatality rates. The Pfizer vaccine was introduced at the end of 2020, followed by Moderna in March 2021. AstraZeneca began its rollout in June 2021, and Janssen, the single-dose vaccine, was introduced shortly after in mid-2021. The variation in vaccine distribution and administration, influenced by factors such as evolving public health recommendations, the emergence of new virus variants, and regional capacity for distribution, has been integrated into our analysis. This provides a comprehensive understanding of the impact of these vaccines on COVID-19 mortality across different waves of the pandemic.

The development process of the clinical decision support system involves three main phases. Initially, the process includes the request, pseudonymization, and processing of data, followed by the selection, training, and hyperparameter tuning of the model, and culminating in the evaluation of prediction metrics. If the metrics of this retrospective model prove promising, we will advance to the subsequent phase. The second phase entails implementing the system in pilot hospitals, conducting data download tests, correcting software and operational errors, and assessing initial results for potential clinical benefits. Ultimately, if the results are favorable, a future phase will proceed with the prospective real-time development and validation, integrating the system into the Electronic Health Record and connecting it to various data sources, while ensuring privacy and obtaining informed consent from patients. Our study focuses on the initial phase.

2 Materials and methods

The study cohort consisted of COVID-19 patients from the Andalusian Public Health System (Sistema Sanitario Público Andaluz, SSPA) who were admitted to participating hospitals. The dataset initially included 59,001 admissions, all of whom were 18 years old or older. This temporal structure provides a cohort defined according to specific pandemic periods: Wave 1 (01/01/2020–10/05/2020), Wave 2 (11/05/2020–20/12/2020), Wave 3 (21/12/2020–07/03/2021), Wave 4 (08/03/2021–20/06/2021), Wave 5 (21/06/2021–10/10/2021), Wave 6 (11/10/2021–27/03/2022), and Wave 7 (28/03/2022–31/12/2022) (21). This temporal structure offers a comprehensive overview of hospital admissions across various phases of the pandemic.

The analysis of vaccine consumption in Andalusia during the different pandemic waves reveals the evolution of the administration of the four main vaccines: Pfizer developed its mRNA-based vaccine, Comirnaty, while Moderna produced its own mRNA vaccine, branded as Spikevax. AstraZeneca introduced Vaxzevria, a viral vector vaccine, and Janssen, marketed as Jcovden, provided a single-dose viral vector option (22).

During Wave 3 (March 7, 2021), the Pfizer vaccine had already reached a total of 743,428 doses administered. Meanwhile, the Moderna vaccine was still in its initial phase, with 39,914 doses administered. At this point, no doses of AstraZeneca or Janssen had been administered. In Wave 4 (June 21, 2021), there was a significant increase in the administration of all vaccines. Pfizer doses rose to 4,707,383, while Moderna reached 574,251 doses. AstraZeneca had started to be administered, with 1,117,484 doses administered, and Janssen was introduced with 116,562 doses. By Wave 5 (October 20, 2021), Pfizer vaccine administration continued to grow, reaching 9,098,680 doses. Moderna doses also increased, reaching 1,723,404, while AstraZeneca recorded 1,758,232 doses. The Janssen vaccine reached 319,344 doses administered by this point. In Wave 6 (March 29, 2022), Pfizer continued its increase, reaching 14,304,189 doses. Moderna nearly doubled its total compared to the previous wave, reaching 3,557,961 doses administered. AstraZeneca recorded 1,784,771 doses, and Janssen reached 327,141 doses. Finally, in Wave 7 (January 3, 2023), Pfizer maintained its total of 14,304,189 doses without further increases from the previous wave. Moderna administration rose slightly to 3,663,365 doses, while AstraZeneca reached 1,789,825 doses. The administration of Janssen stabilized at 328,326 doses. This progression illustrates the varied adoption of each vaccine throughout the waves, with Pfizer remaining the dominant vaccine in terms of total doses administered, followed by Moderna, AstraZeneca, and Janssen.

The following exclusion criteria were applied, as illustrated in Figure 1. First, for patients with multiple admissions, we retained only the last admission, as it is the only one where fatality could occur. In the context of COVID-19 in Andalusia, the case-fatality rate is defined as the proportion of deaths among identified confirmed cases of the disease. Specifically, it measures the severity of the disease by dividing the number of deaths attributed to COVID-19 by the total number of confirmed cases, expressed as a percentage. This metric is distinct from mortality, which refers to the incidence of death within the general population over a specific period, providing insights into the overall impact of the disease on the regional population without directly linking deaths to confirmed cases. Consequently, 1,793 admissions were excluded. Second, 7,212 admissions corresponding to patients whose records lacked laboratory data or associated comorbidities in the Electronic Health Record were excluded. Additionally, admissions from Wave 1 (17 admissions) and Wave 2 (12,481 admissions) were excluded due to the absence of vaccination during these periods. Validation criteria were applied to address discrepancies between the admission, discharge, or expiration dates, resulting in the removal of 26 admissions.

Figure 1
www.frontiersin.org

Figure 1. Criteria for inclusion/exclusion and reasons for data removal.

We defined a follow-up time variable based on patient outcomes. If the patient died, the variable was defined as the number of days between the admission and expiration date. If the patient survived, the variable is calculated as the number of days elapsed between admission and discharge date plus 30 days, reflecting that the patient remained alive for at least 30 days post-discharge. Upon examining this follow-up time, we observed that its distribution was right-skewed. We decided to eliminate admissions where follow-up time fell within the top 0.5% of the entire study population, resulting in 198 cases being excluded. To achieve this, we employed the winsorization technique, which involves capping or trimming extreme values of follow-up times to ensure that outliers do not disproportionately influence the analysis.

For records with laboratory data but missing variables, we used the Iterative Imputation technique, which involves iteratively modeling each feature with missing values as a function of other features. This approach uses a regressor to predict unavailable values for each feature through successive iterations. Variables where more than 50% of the patients had missing values were imputed. This process yielded a final cohort of 37,274 admissions, all of which were confirmed COVID-19 positive upon admission and available for analysis after applying the exclusion criteria.

Data were obtained following ethical approval from the Committee for Biomedical Research in Andalusia (Comité para la Investigación Biomédica en Andalucía, CCEIBA) through Protocol Version 1.4 dated August 27, 2021, and HIP/CI Version 1.0 dated August 27, 2021. The internal protocol code associated with the approval is 1303-N-21.

We conducted survival analyses with the following considerations: (i) a general model, with a cohort stratified into vaccinated and unvaccinated patients; (ii) a model by age groups, with the cohort stratified into vaccinated and unvaccinated patients, grouped by age; and (iii) a model stratified by immunization groups, with the cohort categorized by vaccination status: unprotected, incomplete vaccination, and complete vaccination. We assessed the relationship between survival outcomes and various factors, such as demographic information and clinical data. Specifically, the model incorporated variables such as age, clinical laboratory parameters, comorbidities, and date of admission to comprehensively evaluate potential predictors of survival. The model summary, including Hazard Ratios and confidence intervals, was generated to quantify the impact of each variable on survival. We used a survival analysis approach to investigate the impact of vaccination status on patient outcomes.

In this study, we defined the event as the case fatality rate among COVID-19 patients admitted to the hospital with a confirmed positive diagnosis upon admission. The event includes patients who die during hospitalization as well as those who die within 30 days following discharge. For patients without an expiration date in the dataset, the survival time is unknown. The following rationales have been considered: (a) patients who are hospitalized beyond the data collection period; (b) patients lost to follow-up, resulting in a lack of information during the study; (c) patients facing alternative events hindering continuous follow-up, such as traffic accidents. We assumed that, in all three cases, the patients had not died. The Hazard Ratio allows us to compare the risk of an event occurring between groups. It is expressed as the ratio of their instantaneous risk functions, enabling us to assess the influence of different risk factors on the event over time (23).

For the first analysis, patients were classified as “vaccinated” if they had received at least one vaccine dose at least 14 days prior to the hospital admission date. Conversely, patients who had not received any doses before hospitalization were considered “unvaccinated.”

For the second analysis, we divided the already stratified vaccinated and unvaccinated cohort (maintaining the definition from our first analysis) into different groups according to patient age. The defined age groups are as follows: Group A, ≥80 years; Group B, ≥70 years; Group C, ≥60 years; Group D, ≥40 years; Group E, ≥18 years. Each group corresponds to the starting date of the vaccination campaign periods in Spain: Group A, 27/12/2020; Group B, 05/04/2021; Group C, 03/05/2021; Group D, 01/06/2021; Group E, 20/07/2021. The analysis by age groups was designed to enhance our understanding of how vaccination impacts survival outcomes of patients of different ages, considering the timelines of the vaccination campaigns for each group.

For the third analysis, in which the cohort was stratified by vaccination status, we categorized the patients into three distinct subgroups: unprotected, incomplete, and complete. This cohort corresponds to the period in which the entire population had access to vaccination. The unprotected group encompassed unvaccinated patients who had not received any vaccine dose. The incomplete group comprised patients who had received at least one dose but fewer than three, with the last dose administered more than 180 days prior. Lastly, the protected group included patients who had received a minimum of three vaccine doses, with the time interval between the last dose and admission falling within 180 days, indicating ongoing protection.

For data cleaning and preprocessing, Python and Jupyter notebooks were utilized to facilitate a comprehensive understanding of the statistical procedures applied. The Scikit-learn library for Python was used to impute missing values. The survival analysis was executed in R, using Rmarkdown notebooks for enhanced reproducibility.

3 Results

A case fatality rate of 7,202 (19.3%) was observed within the cohort, of which 3,476 (48.3%) had received at least one vaccine dose. The median age of patients who died was 81 years, in contrast to a median age of 64 years among survivors. Patients who died had received a median of 0 vaccine doses, whereas survivors had received a median of two doses. ICU stays were markedly elevated among the deceased, indicating a pronounced association between ICU admission and adverse outcomes. Patients who died had a median of 10 inpatient days compared to 5 days for survivors. Additionally, follow-up days were notably shorter for patients who died, with a median of 10 days compared to 37 days for survivors. The clinical and sociodemographic characteristics of the cohort are presented in Table 1.

Table 1
www.frontiersin.org

Table 1. Study population characteristics.

The Cox Proportional Hazards survival curve reveals a lower survival rate among unvaccinated patients (see Figure 2). The number of patients at risk at each stage of the analysis is available in Supplementary Figure 1.

Figure 2
www.frontiersin.org

Figure 2. Adjusted survival analysis for Cox proportional hazards general model for case-mortality rate between unvaccinated and vaccinated population.

We present the following results from the first analysis (general model). The “Vaccinated” variable, representing patients who received at least one vaccine dose at least 14 days prior to hospital admission, indicates a protective effect, with a Hazard Ratio of 0.80 (95% CI: 0.76–0.84; p = 0.026; see Figure 3). This finding underscores a correlation between vaccination and an immediate 20% reduction in the risk of case fatality rate compared to the unvaccinated group. Hazard ratios and confidence intervals for the general model addressing case-mortality rates between the unvaccinated and vaccinated populations are available in Supplementary Table 1.

Figure 3
www.frontiersin.org

Figure 3. Forest plot of hazard ratios for general model for case-mortality rate between unvaccinated and vaccinated population.

Patients who died had a notably higher median age [81 (72, 87)] compared to those who survived [64 (51, 77)], suggesting that age is a key factor influencing case-fatality rate outcomes. Patients requiring ICU admission also exhibited a substantially higher case fatality rate. Pre-existing conditions, such as active cancer and ischemic heart disease, show strong correlations with higher case fatality rates. Additionally, C-Reactive Protein (CRP) levels present a significant difference between patients who died and those who survived (p < 0.001). Patients who died had a notably higher median CRP level [108.9 (66.2, 176.2)] compared to survivors [83.7 (37.1, 124.0)].

Finally, the median follow-up days variable significantly differed between deceased and surviving groups (p < 0.001), indicating that patients who died had a much shorter median follow-up period [10 (5, 20)] compared to survivors [38 (35, 42)].

The second analysis (model by age groups) reveals that the protective effect of vaccination is more pronounced in patients aged 80 years and older (Group A), gradually diminishing across younger age groups (see Figure 4). In the 60-year-old group (Group B), the survival pattern shows less pronounced protection, and this trend continues to decrease in the 40-year-old group (Group C). Finally, in the 18 years and older group, the survival curves between vaccinated and unvaccinated patients intertwine, indicating a less marked difference in terms of protection. During the initial 25–50 days, a distinct divergence in survival outcomes is evident between patients who are unprotected and those who have some form of protection (see Supplementary Figure 5). Hazard ratios and confidence intervals for models by age groups addressing case-mortality rates between unvaccinated and vaccinated populations are available in Supplementary Tables 2AE. Forest plots with the HR represented visually are available in Supplementary Figures 2AE.

Figure 4
www.frontiersin.org

Figure 4. Adjusted survival curves for Cox proportional hazards model by age groups.

The third analysis (model stratified by immunization status) indicates a significant decrease in the risk of mortality for the incompletely vaccinated group (HR: 0.33, 95% CI: 0.30–0.36) compared to the fully protected group (HR: 0.30, 95% CI: 0.28–0.32), as shown in Supplementary Figure 6. Beyond the 50-day threshold, the trend between incompletely vaccinated and unvaccinated patients remains consistent, although with a less pronounced reduction in survival differences.

On the other hand, ICU stay is associated with a higher risk of mortality, with an HR of 2.03 (95% CI: 1.88–2.19), reflecting the clinical severity of these patients. Regarding age, the HR of 1.05 (95% CI: 1.05–1.05) shows that aging is associated with a slight increase in the risk of mortality. Similarly, lower hemoglobin levels are associated with an increased risk of mortality (HR: 1.11, 95% CI: 1.03–1.21).

Note that in Supplementary Figure 6, we exclusively represent the protected and incomplete groups, with the unprotected group serving as the reference line for hazard ratio (HR) calculation. Consequently, the unprotected group is not depicted in Supplementary Figure 6. Hazard ratios and confidence intervals for immunization-stratified groups addressing case-mortality rates between unvaccinated and vaccinated populations are available in Supplementary Table 3. The number of patients at risk in each stage of the analysis is provided in Supplementary Figure 7.

4 Discussion

This study places particular emphasis on discerning the influence of vaccination status on patient recovery rates and survival in hospitalized patients. The ultimate goal is to enhance the accuracy and interpretability of survival analysis methodologies, providing valuable insights into the impact of COVID-19 vaccines across different patient cohorts. The reduction in case-fatality rate observed in vaccinated patients pertains to a specific population—those who required hospitalization. Patients requiring hospital admission to medical wards or the ICU often present additional factors influencing their deterioration, primarily conditioned by their comorbidities in addition to the viral infection. Therefore, it is crucial to document the reduction in case-fatality rate that the vaccine provides despite the severity of the patient's condition. Consequently, the overall effect on reducing case-fatality rate, including hospitalizations prevented by the vaccine, is not considered in the percentage described in this population.

Our study reveals that demographic factors, particularly age, sex, and pre-existing conditions, significantly affect COVID-19 mortality. ICU stay was the most substantial predictor of death across all age groups, while vaccination consistently reduced mortality risk, reaffirming its importance in mitigating severe outcomes. Pre-existing conditions, particularly active cancer and chronic liver disease were associated with increased mortality risk, with older patients displaying a greater vulnerability to conditions such as COPD and diabetes. Additionally, males had a slightly lower risk of mortality compared to females, highlighting a modest yet significant impact of sex on outcomes.

The study aims to create a predictive tool in the form of a clinical prediction support system that incorporates various patient parameters for effective risk assessment. We document factors related to the prognosis of SARS-CoV-2 infection in patients who, despite vaccination, have required hospitalization. The study's design, based on Cox Proportional Hazard modeling, aims to provide decision support systems for clinical professionals to identify patients at risk of developing a complicated course of the disease.

Previous studies using similar methodologies did not consider the vaccination status of patients (2426). Most studies identifying poor prognosis factors for SARS-CoV-2 infection were conducted before widespread vaccination, focusing on clinical risk profiles. In the Andalusian population admitted to the ICU, age, the development of organ failure, and severity upon ICU admission were related to case-fatality rate (27). This is crucial considering that many recommendations for managing SARS-CoV-2 infection are based on studies conducted before vaccination, raising questions about their applicability to patients with characteristics different from those in clinical trials. Vaccination effectiveness has been documented in numerous studies, showing a significant decrease in hospitalization (89.1%), ICU admission (97.1%), and case-fatality rate (97.3%) (28). In the U.S., it was documented that vaccination was around 90% effective in preventing hospitalizations and ICU admissions (29). Similar findings have been documented in Spain (30). Vaccination against SARS-CoV-2 has not only drastically decreased the number of hospitalizations and the development of more severe clinical forms of the infection but also seems to have influenced the decrease in other infections in hospitalized older adult patients (31).

Vaccination in Spain started with older adult patients and healthcare workers, progressively expanding to the remaining age groups. Despite being vaccinated, some patients still required hospital admission, possibly due to immune escape when complete vaccination schemes were not generated (32). Vaccine effectiveness in preventing new infections and severe forms of the disease has been well established (33). However, the impact of vaccination on case-fatality rate in hospitalized patients is not well-developed. Vaccinated patients who still require hospitalization may present a clinical profile that makes them more vulnerable to the infection, rendering the vaccine less effective. Factors such as cancer have been identified as related to worse prognosis, supporting studies showing reduced vaccine effectiveness in immunocompromised patients (34). Comorbidities such as chronic obstructive pulmonary disease have also been identified as factors associated with case-fatality rate (35). We also identified an increase in case-fatality rate in patients with a medical history of ischemic coronary artery disease, consistent with a systematic review that included 81 published studies involving 157,439 patients (36). Patients with higher levels of C-reactive protein (CRP) exhibited a worse prognosis.

The second analysis (model by age groups) confirms the protective effect of the vaccines even in patients requiring hospitalization. This protective effect of vaccination was more pronounced in older age groups, although the difference in survival from vaccination was less pronounced among younger vaccinated patients.

In the third analysis (model grouped by immunization status), we observed the protective effect of the vaccine when identifying three groups of patients: unprotected, incomplete (those who had exceeded 6 months after the last dose of the vaccine), and protected. The study confirms the protective effect of the vaccines even in hospitalized patients, considering vaccinated groups in different periods. The association between ICU admission and a worse prognosis is related to the fact that these admissions are intended for the most severe cases requiring invasive treatments.

This study has the following limitations. We did not measure antibody levels post-vaccination to assess efficacy, as it was a large population sample, and such determinations were not routinely performed in hospitalized patients. Concomitant medications were not considered, since the indications for antiviral treatment, monoclonal antibodies, and immunomodulatory treatments lacked universal indicators due to insufficient evidence and depended on the attending clinician's discretion. At certain times during the pandemic, treatments with questionable evidence were indicated due to the absence of well-designed studies to support them. We did not account for the different variants of the virus circulating during the various waves of the pandemic, as they were not determined in the majority of hospitalized patients.

Our study presents the following strengths. To date, this is the study with the largest sample of patients hospitalized for COVID-19 in which the effect of vaccination is analyzed using the Cox Proportional Hazards Model. Additionally, it considers not only the risk factors associated with mortality but also different age groups, and how the effect of the vaccine varies according to age.

Additionally, our study demonstrates that COVID-19 vaccination significantly reduces mortality risk across all age groups, with a consistent hazard ratio of 0.80. However, older populations, particularly those over 60, are at heightened risk due to age-related factors and pre-existing conditions such as chronic liver disease, COPD, and cancer, which further increase mortality. These findings suggest that routine COVID-19 vaccination should be prioritized for individuals over 60, with periodic booster doses considered to maintain immunity, similar to existing influenza vaccination strategies. For younger populations, vaccination should be tailored based on comorbidities and risk exposure, in addition to epidemiological reasons to prevent the spread of the disease and protect the most vulnerable population, aligned with the guidelines from health authorities. Overall, the study underscores the critical role of vaccination in reducing COVID-19 mortality and provides evidence to guide long-term vaccination policies, especially for high-risk groups.

This approach aims to reduce ICU admissions, long-term hospitalizations, and the overall strain on healthcare systems, leading to significant cost savings. Prioritizing vaccines for these groups, as well as healthcare workers, ensures effective use of resources and reduces the likelihood of severe outcomes and disruptions from future outbreaks.

The cost-benefit analysis shows that these policies can lower healthcare costs by preventing severe cases, reducing the burden on healthcare workers, minimizing long-term complications such as long COVID, and avoiding the economic consequences of lockdowns. By maintaining high immunity levels in high-risk populations, the strategy maximizes vaccine efficiency and reduces overall economic and healthcare burdens.

In conclusion, our study emphasizes the pivotal role of vaccination status in COVID-19 risk assessment. This highlights the importance of integrating vaccination status as a key factor, along with other demographic and medical data, in comprehensive risk assessment models. Based on these findings, there is a strong rationale for the development of a clinical decision support system, providing clinicians with a valuable tool to identify patients at higher risk and tailor interventions accordingly. From a policy-making standpoint, our results could aid managers and clinicians in refining admission protocols and treatment strategies.

Data availability statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found at: https://github.com/jlgonrod/survival_vaccination_analysis.

Ethics statement

The data was obtained following ethical approvals from CCEIBA through Protocol Version 1.4 dated August 27, 2021, and HIP/CI Version 1.0 dated August 27, 2021. The internal protocol code (PEIBA) associated with these approvals is 1303-N-2. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required from the participants or the participants' legal guardians/next of kin in accordance with the national legislation and institutional requirements.

Author contributions

JG: Conceptualization, Data curation, Formal analysis, Resources, Visualization, Writing – original draft, Software. AO: Writing – original draft, Data curation. SM: Writing – original draft, Writing – review & editing. JC: Writing – original draft, Conceptualization, Data curation, Formal analysis, Resources, Software, Visualization. JR: Formal analysis, Investigation, Supervision, Writing – original draft, Writing – review & editing. MA: Methodology, Supervision, Writing – original draft, Writing – review & editing. ÁE: Formal analysis, Investigation, Supervision, Writing – review & editing.

Funding

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Acknowledgments

We acknowledge ChatGPT 3.5 (January 2024 Version) for its support in refining grammar and spelling. We express our utmost gratitude to the Technical Advisory Subdirection for Information Management (STAGI) for their invaluable collaboration. Their prompt and effective provision of data from the Health Population Database (BPS) has been pivotal to the successful completion of this study. From the outset, their unwavering support and contribution have played a vital role in meeting the study's requirements. Their adept adherence to established timelines is greatly appreciated, ensuring the prompt delivery of data to address the treatment needs of COVID-19 patients. From the beginning, their steadfast support and contribution have been integral to meeting the study's requirements. The demonstrated diligence and commitment have proven crucial in ensuring that the information was available when needed, thereby facilitating timely and effective medical knowledge.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2024.1437388/full#supplementary-material

References

1. Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med. (2020) 382:727–33. doi: 10.1056/NEJMoa2001017

PubMed Abstract | Crossref Full Text | Google Scholar

2. Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis. (2020) 20:533–4. doi: 10.1016/S1473-3099(20)30120-1

PubMed Abstract | Crossref Full Text | Google Scholar

3. Weiss P, Murdoch DR. Clinical course and mortality risk of severe COVID-19. Lancet. (2020) 395:1014–5. doi: 10.1016/S0140-6736(20)30633-4

PubMed Abstract | Crossref Full Text | Google Scholar

4. Richardson S, Hirsch JS, Narasimhan M, Crawford JM, McGinn T, Davidson KW, et al. Presenting characteristics, comorbidities, and outcomes among 5700 patients hospitalized with COVID-19 in the New York City area. JAMA. (2020) 323:2052–9. doi: 10.1001/jama.2020.6775

PubMed Abstract | Crossref Full Text | Google Scholar

5. Lu R, Zhao X, Li J, Niu P, Yang B, Wu H, et al. Genomic characterisation and epidemiology of 2019 novel coronavirus: implications for virus origins and receptor binding. Lancet. (2020) 395:565–74. doi: 10.1016/S0140-6736(20)30251-8

PubMed Abstract | Crossref Full Text | Google Scholar

6. Cao B, Wang Y, Wen D, Liu W, Wang J, Fan G, et al. A trial of lopinavir–ritonavir in adults hospitalized with severe COVID-19. N Engl J Med. (2020) 382:1787–99. doi: 10.1056/NEJMc2008043

Crossref Full Text | Google Scholar

7. Rosenberg ES, Dufort EM, Udo T, Wilberschied LA, Kumar J, Tesoriero J, et al. Association of treatment with hydroxychloroquine or azithromycin with in-hospital mortality in patients with COVID-19 in New York State. JAMA. (2020) 323:2493–502. doi: 10.1001/jama.2020.8630

PubMed Abstract | Crossref Full Text | Google Scholar

8. RECOVERY Collaborative Group, Horby P, Lim WS, Emberson JR, Mafham M, Bell JL, et al. Dexamethasone in hospitalized patients with COVID-19. N Engl J Med. (2021) 384:693–704. doi: 10.1056/NEJMoa2021436

PubMed Abstract | Crossref Full Text | Google Scholar

9. Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Safety and efficacy of the BNT162b2 mRNA COVID-19 vaccine. N Engl J Med. (2020) 383:2603–15. doi: 10.1056/NEJMoa2034577

PubMed Abstract | Crossref Full Text | Google Scholar

10. Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. Intensive Care Med. (1996) 22:707–10. doi: 10.1007/s001340050156

Crossref Full Text | Google Scholar

11. Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. (2016) 315:801–10. doi: 10.1001/jama.2016.0287

PubMed Abstract | Crossref Full Text | Google Scholar

12. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II a severity of disease classification system. Crit Care Med. (1985) 13:818–29. doi: 10.1097/00003246-198510000-00009

Crossref Full Text | Google Scholar

13. Kostakis I, Smith GB, Prytherch DR, Meredith P, Price C, Chauhan A, et al. The performance of the National Early Warning Score and National Early Warning Score 2 in hospitalised patients infected by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Resuscitation. (2021) 159:150–7. doi: 10.1016/j.resuscitation.2020.10.039

PubMed Abstract | Crossref Full Text | Google Scholar

14. Grasselli G, Zangrillo A, Zanella A, Albano G, Antonelli M, Bellani G, et al. Risk factors associated with mortality among patients with COVID-19 in intensive care units in Lombardy, Italy. JAMA Intern Med. (2020) 180:1345–55. doi: 10.1001/jamainternmed.2020.3539

PubMed Abstract | Crossref Full Text | Google Scholar

15. Li X, Xu S, Yu M, Wang K, Tao Y, Zhou Y, et al. Risk factors for severity and mortality in adult COVID-19 inpatients in Wuhan. J Allergy Clin Immunol. (2020) 146:110–8. doi: 10.1016/j.jaci.2020.04.006

PubMed Abstract | Crossref Full Text | Google Scholar

16. Escobar GJ, Liu VX, Schuler A, Lawson B, Greene JD, Kipnis P. Automated identification of adults at risk for in-hospital clinical deterioration. N Engl J Med. (2020) 383:1951–60. doi: 10.1056/NEJMsa2001090

PubMed Abstract | Crossref Full Text | Google Scholar

17. Gao Y, Cai G, Fang W, Li HY, Wang SY, Chen L, et al. Machine learning based early warning system enables accurate mortality risk prediction for COVID-19. Nat Commun. (2020) 11:5033. doi: 10.1038/s41467-020-18684-2

PubMed Abstract | Crossref Full Text | Google Scholar

18. Di Castelnuovo A, Costanzo S, Antinori A, Gialluisi A, Antinori A, Berselli N, et al. Common cardiovascular risk factors and in-hospital mortality in 3,894 patients with COVID-19: survival analysis and machine learning-based findings from the multicentre Italian CORIST Study. Nutr Metab Cardiovasc Dis. (2020) 30:1899–913. doi: 10.1016/j.numecd.2020.07.031

PubMed Abstract | Crossref Full Text | Google Scholar

19. Vaid A, Somani S, Russak AJ, De Freitas JK, Chaudhry FF, Paranjpe I, et al. Machine learning to predict mortality and critical events in a cohort of patients with COVID-19 in New York City: model development and validation. J Med Internet Res. (2020) 22:e24018. doi: 10.2196/24018

PubMed Abstract | Crossref Full Text | Google Scholar

20. Waku J, Oshinubi K, Adam UM, Demongeot J. Forecasting the endemic/epidemic transition in COVID-19 in some countries: influence of the vaccination. Diseases. (2023) 11:135. doi: 10.3390/diseases11040135

PubMed Abstract | Crossref Full Text | Google Scholar

21. Consejería de Salud y Familias, Junta de Andalucía. Informe COVID-19 en Andalucía tras la fase aguda de la pandemia. Available at: https://www.ieca.juntaandalucia.es/salud/COVID19.html (accessed January 23, 2024).

Google Scholar

22. Información de vacunas autorizadas, Agencia Española de Medicamentos y Productos Sanitarios. Available at: https://www.aemps.gob.es/la-aemps/ultima-informacionde-la-aemps-acerca-del-covid-19/vacunas-contra-la-covid-19/informacion-de-vacunasautorizadas/?lang=en (accessed October 25, 2024).

Google Scholar

23. Therneau TM, Lumley T, Atkinson EJ, Crowson CS. Survival: Survival Analysis. (2023). Available at: https://cran.r-project.org/web/packages/survival/index.html (accessed January 23, 2024).

Google Scholar

24. Bottrighi A, Di Santo D, Vimercati A, Massarino C, Cassinari A, Betti M, et al. A machine learning approach for predicting high risk hospitalized patients with COVID-19 SARS-Cov-2. BMC Med Inform Decis Mak. (2022) 22:340. doi: 10.1186/s12911-022-02076-1

PubMed Abstract | Crossref Full Text | Google Scholar

25. He F, Page JH, Weinberg KR, Mishra A. The development and validation of simplified machine learning algorithms to predict prognosis of hospitalized patients with COVID-19: multicenter, retrospective study. J Med Internet Res. (2022) 24:e31549. doi: 10.2196/31549

PubMed Abstract | Crossref Full Text | Google Scholar

26. Sarmiento Varón LS, Rozo-Bolívar DR, Olarte Carrasquilla LM, Aldridge J, Alvarez-Saravia D, Uribe-Paredes R, et al. The role of machine learning in health policies during the COVID-19 pandemic and in long COVID management. Front Public Health. (2023) 11:1140353. doi: 10.3389/fpubh.2023.1140353

PubMed Abstract | Crossref Full Text | Google Scholar

27. Estella Á, Vidal-Cortés P, Rodríguez A, Machado Casas JF, Yuste ME, Amaya Villar R, et al. Predictive factors of six-week mortality in critically ill patients with SARS-CoV-2: a multicenter prospective study. Med Intensiva. (2021) 46:179–91. doi: 10.1016/j.medine.2021.02.008

PubMed Abstract | Crossref Full Text | Google Scholar

28. Zheng C, Shao W, Chen X, Zhang B, Wang G, Zhang W. Real-world effectiveness of COVID-19 vaccines: a literature review and meta-analysis. Int J Infect Dis. (2022) 114:252–60. doi: 10.1016/j.ijid.2021.11.009

PubMed Abstract | Crossref Full Text | Google Scholar

29. Thompson MG, Natarajan K, Irving SA, Ball SW, Naleway AL, Ong TC, et al. Effectiveness of COVID-19 vaccines in ambulatory and inpatient care settings. N Engl J Med. (2021) 385:1355–71. doi: 10.1056/NEJMoa2110362

PubMed Abstract | Crossref Full Text | Google Scholar

30. Barandalla I, Alvarez C, Barreiro P, de Mendoza C, González-Crespo R, Soriano V. Impact of scaling up SARS-CoV-2 vaccination on COVID-19 hospitalizations in Spain. Int J Infect Dis. (2021) 112:81–8. doi: 10.1016/j.ijid.2021.09.022

PubMed Abstract | Crossref Full Text | Google Scholar

31. Balducci M, Corsonello A, Meloni E, Geary DC. SARS-CoV-2 vaccination and risk of infectious diseases in hospitalized older patients. Eur Geriatr Med. (2024). doi: 10.1007/s41999-023-00902-x

PubMed Abstract | Crossref Full Text | Google Scholar

32. Moreno-Nunez P., de la Torre M, Delgado-Arana S, Vicente-Guijarro J, Fernández Chávez AC, Aranaz-Andrés JM, et al. How does vaccination against SARS-CoV-2 affect hospitalized patients with COVID-19? J Clin Med. (2022) 11:3905. doi: 10.3390/jcm11133905

PubMed Abstract | Crossref Full Text | Google Scholar

33. Wu N, Bai S, Zhou R, Vieira AM, Stojanovic J, Sanuade C, et al. Long-term effectiveness of COVID-19 vaccines against infections, hospitalisations, and mortality in adults: findings from a rapid living systematic evidence synthesis and meta-analysis up to December, 2022. Lancet Respir Med. (2023) 11:439–52. doi: 10.1016/S2213-2600(23)00015-2

PubMed Abstract | Crossref Full Text | Google Scholar

34. Embi PJ, Levy ME, Naleway AL, DeSilva MB, Gaglani M, Dascomb K, et al. Effectiveness of COVID-19 vaccines at preventing emergency department or urgent care encounters and hospitalizations among immunocompromised adults: an observational study of real-world data across 10 US states from August-December 2021. Vaccine. (2023) 41:5424–34. doi: 10.1016/j.vaccine.2023.05.038

PubMed Abstract | Crossref Full Text | Google Scholar

35. Finnerty JP, Hussain ABMAB, Ponnuswamy A, Kamil HG, Abdelaziz A. Asthma and COPD as co-morbidities in patients hospitalised with COVID-19 disease: a global systematic review and meta-analysis. BMC Pulm Med. (2023) 23:462. doi: 10.1186/s12890-023-02761-5

PubMed Abstract | Crossref Full Text | Google Scholar

36. Wang S, Zhang Y, Ding L, Guo Y, Lv M, Zhang C, et al. Effects of the pre-existing coronary heart disease on the prognosis of COVID-19 patients: a systematic review and meta-analysis. PLoS ONE. (2023) 18:e0292021. doi: 10.1371/journal.pone.0292021

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: vaccine, COVID-19, clinical decision-making, predictive modeling, clinical decision support system

Citation: González Rodríguez JL, Oprescu AM, Muñoz Lezcano S, Cordero Ramos J, Romero Cabrera JL, Armengol de la Hoz MÁ and Estella Á (2024) Assessing the impact of vaccines on COVID-19 efficacy in survival rates: a survival analysis approach for clinical decision support. Front. Public Health 12:1437388. doi: 10.3389/fpubh.2024.1437388

Received: 24 May 2024; Accepted: 30 October 2024;
Published: 18 November 2024.

Edited by:

Mariana Magalhães, University of Coimbra, Portugal

Reviewed by:

Ibrahim Dadari, United Nations Children's Fund, United States
Sujata Ranshing, Children's Hospital of Philadelphia, United States

Copyright © 2024 González Rodríguez, Oprescu, Muñoz Lezcano, Cordero Ramos, Romero Cabrera, Armengol de la Hoz and Estella. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Ángel Estella, bGl0b2VzdGVsbGEmI3gwMDA0MDtob3RtYWlsLmNvbQ==; Jaime Cordero Ramos, Y29yZGVyb2phaW1lNyYjeDAwMDQwO2dtYWlsLmNvbQ==

These authors have contributed equally to this work and share first authorship

These authors have contributed equally to this work and share senior authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.