Xiaofeng He
Jiao Su3
Yu’nan Ma
Shixing Tang- 1Department of Epidemiology, School of Public Health, Southern Medical University, Guangzhou, China
- 2Institute of Evidence-Based Medicine, Heping Hospital Affiliated to Changzhi Medical College, Changzhi, China
- 3Department of biochemistry, Changzhi Medical College, Changzhi, China
- 4Department of Cardiothoracic Surgery, Heping Hospital Affiliated to Changzhi Medical College, Changzhi, China
- 5Department of Infectious Diseases, Nanfang Hospital, Southern Medical University, Guangzhou, China
It is urgently needed to update the comprehensive analysis about the efficacy or effectiveness of COVID-19 vaccines especially during the COVID-19 pandemic caused by SARS-CoV-2 Delta and Omicron variants. In general, the current COVID-19 vaccines showed a cumulative efficacy of 66.4%, 79.7%, and 93.6% to prevent SARS-CoV-2 infection, symptomatic COVID-19, and severe COVID-19, respectively, but could not prevent the asymptomatic infection of SARS-CoV-2. Furthermore, the current COVID-19 vaccines could effectively prevent COVID-19 caused by the Delta variant although the incidence of breakthrough infection of the SARS-CoV-2 Delta variant increased when the intervals post full vaccination extended, suggesting the waning effectiveness of COVID-19 vaccines. In addition, one-dose booster immunization showed an effectiveness of 74.5% to prevent COVID-19 caused by the Delta variant. However, current COVID-19 vaccines could not prevent the infection of Omicron sub-lineage BA.1.1.529 and had about 50% effectiveness to prevent COVID-19 caused by Omicron sub-lineage BA.1.1.529. Furthermore, the effectiveness was 87.6% and 90.1% to prevent severe COVID-19 and COVID-19-related death caused by Omicron sub-lineage BA.2, respectively, while one-dose booster immunization could enhance the effectiveness of COVID-19 vaccines to prevent the infection and COVID-19 caused by Omicron sub-lineage BA.1.1.529 and sub-lineage BA.2. Two-dose booster immunization showed an increased effectiveness of 81.8% against severe COVID-19 caused by the Omicron sub-lineage BA.1.1.529 variant compared with one-dose booster immunization. The effectiveness of the booster immunization with RNA-based vaccine BNT162b2 or mRNA-1273 was over 75% against severe COVID-19 more than 17 weeks after booster immunization whereas the heterogenous booster immunization showed better effectiveness than homologous booster immunization. In summary, the current COVID-19 vaccines could effectively protect COVID-19 caused by Delta and Omicron variants but was less effective against Omicron variant infection. One-dose booster immunization could enhance protection capability, and two-dose booster immunization could provide additional protection against severe COVID-19.
Introduction
In December 2019, a novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) was identified to cause a new severe acute respiratory disease, coronavirus disease 2019 (COVID-19) (1). Development and administration of COVID-19 vaccines are one of the most important strategies to prevent and control the COVID-19 pandemic. At present, different types of COVID-19 vaccine have been developed. Most frequently used vaccines are mRNA vaccine, viral vector-based vaccine, inactivated virus vaccine, and viral protein subunit vaccine. Till now, 194 candidate vaccines have been assessed in the preclinical development stage whereas 132 vaccines are in clinical development stage (2). As of April 23, 2022, the confirmed cumulative COVID-19 cases and deaths reached 505,817,953 and 6,213,876, respectively, while 58.75% of people have been fully vaccinated worldwide and the vaccination coverage rate of over 70% was reported in more than 60 countries according to the data of the World Health Organization (WHO) (3).
SARS-CoV-2 is continuously evolving to produce various variants, which have been classified by WHO into variants of concern (VOCs, including Alpha, Beta, Gamma, Delta, and recently identified Omicron), variants of interest (VOIs, including Lambda and Mu), or variants under monitoring (VUMs, including Kappa, Iota, and Eta) (4). The ongoing pandemic of COVID-19 caused by the Omicron variant of SARS-CoV-2 is a great challenge for the prevention and control of the COVID-19 pandemic. The SARS-CoV-2 variants can compromise the protective efficacy of COVID-19 vaccines due to the mutations in its spike protein especially the newly emerged variant Omicron which has many mutations in the S protein, and has been proved to be associated with increased transmissibility and immune evasion against the acquired immunity (5–7).
Several systematic reviews and meta-analyses have been conducted to evaluate the cumulative efficacy or effectiveness of COVID-19 vaccines (8–17), but the results need to be updated when more studies about COVID-19 vaccines to prevent the infection of Delta and Omicron variants are available. More and more studies indicated the waning immunity against SARS-CoV-2 infection and the decreased efficacy of COVID-19 vaccines to prevent the infection of Omicron variants (18–22). Therefore, booster immunization of COVID-19 vaccines has been proposed and evaluated in both clinical trials and observational studies (22–27). However, the role and effect of booster vaccination, especially two-dose booster immunization, remained to be comprehensively analyzed. Furthermore, SARS-CoV-2 infection among fully vaccinated subjects, so-called breakthrough infection, has been documented (28). It is necessary to evaluate the risk and incidence of the breakthrough infection of SARS-COV-2.
In the current study, we systematically assessed and updated the results about the efficacy and effectiveness of COVID-19 vaccines to prevent the infection of Delta and Omicron variants based on phase III randomized clinical trials (RCTs) and observational studies. We also systematically evaluated the effect of booster vaccination and the risk and incidence of breakthrough infection of the Delta variant among vaccinated people.
Methods
This study was performed according to the statement on Preferred Reporting Items for Systematic Reviews and Meta-Analyses (S1 PRISMA Checklist) (29).
Inclusion and exclusion criteria
Studies were eligible on the COVID-19 vaccine efficacy or effectiveness for inclusion if they (1) were clinical trial studies, case–control, and cohort studies (2); evaluated the efficacy or effectiveness of COVID-19 vaccines (3); reported the efficacy or effectiveness of COVID-19 vaccines and booster immunization to prevent infection of SARS-CoV-2 Delta and Omicron variants (4); compared the efficacy or effectiveness of COVID-19 vaccines between vaccinated and placebo, vaccinated and unvaccinated, or booster and non-booster individuals; and (5) reported adjusted effectiveness in the real-world studies and if (6) all outcomes must be laboratory confirmed. For the studies to utilize the same data sources for their investigations, we only included the studies based on the latest data. Moreover, breakthrough infection was selected among vaccinated subjects at discrete time points after full vaccination during the pandemic of Delta or Omicron variants.
Search strategy
Publications were identified by searching PubMed, Embase, Web of Science, the Cochrane Library, BIOSIS Previews, WHO, and medRxiv databases to apply the following search strategies: (SARS-Cov-2 or 2019-nCOv or COVID-19 or coronavirus) AND (vaccination or vaccine) and (“2020/12/1”[Date - Publication]: “2022/3/30”[Date - Publication]). In addition, the references of the identified meta-analyses and reviews were checked if there were other relevant studies.
Data extraction
Two authors reviewed the titles and abstracts and removed the studies that did not meet the inclusion criteria. Disagreements were resolved by discussion with the corresponding author. By using predesigned Microsoft Excel 2016 (Microsoft Corp, Redmond, WA, www.microsoft.com) Tables, authors XFH, JS, and WPZ independently extracted data. The characteristics of included studies for the COVID-19 vaccine information are shown in Supplementary Table 1. Adjusted results of vaccine efficacy or effectiveness were extracted for each outcome according to type of COVID-19 vaccines as well as age and gender of vaccinees (Supplementary Tables 2–7). We extracted vaccine efficacy or effectiveness estimates for SARS-CoV-2 infection, symptomatic COVID-19, severe COVID-19, COVID-19-related death, and asymptomatic SARS-CoV-2 infection. We used the authors’ definitions for the outcomes in a person with SARS-CoV-2 infections. In general, SARS-CoV-2 infection is defined as laboratory-confirmed SARS-CoV-2 infection with or without COVID-19 symptoms whereas asymptomatic infection refers to SARS-CoV-2 infection without clinical symptoms during at least 7 days after testing although some studies defined asymptomatic infection as absence of self-reported symptoms of COVID-19 (30, 31). Symptomatic COVID-19 refers to COVID-19 cases that are diagnosed according to the criteria with modifications from the Diagnosis and Treatment Scheme for COVID-19 released by the National Health Commission of China, the WHO, and the US Centers for Disease Control and Prevention (CDC) whereas severe COVID-19 is defined as confirmed COVID-19 cases with at least one clinical sign of severe systemic illness, such as clinical signs that are indicative of severe systemic illness; respiratory failure; evidence of shock; significant acute renal, hepatic, or neurologic dysfunction; admission to an intensive care unit; or death (32, 33).
In the RCTs and observational studies, we defined full vaccination as ≥7 days after the second-dose vaccination for COVID-19 vaccines BNT162b2 and NVX-CoV2373; ≥14 days for COVID-19 vaccines BNT162b2, mRNA-1273, ChAdOx1 nCoV-19, CoronaVac, BBV152, CVnCoV, WIV04, Sputnik V, HB02, and SCB-2019; or after the single-dose vaccination for COVID-19 vaccines Ad26.COV2.S; and ≥21 days after the first-dose vaccination for COVID-19 vaccine Sputnik V (Supplementary Tables 2, 3). We defined one-dose booster vaccination as ≥7, 12, or 14 days after the third shot of COVID-19 vaccines BNT162b2, mRNA-1273, ChAdOx1 nCoV-19, and CoronaVac, respectively (Supplementary Table 4). In addition, we included the studies that provided risk ratios, rate ratios, and odds ratios or original data for breakthrough infection of SARS-CoV-2. We specifically selected the studies that included COVID-19 cases caused by the Delta variant (Supplementary Table 5). A total of 47,502 publications were initially screened, of which 47,249 were irrelevant according to the title and abstract. In addition, 155 studies were excluded after reading the full text. Eventually, 98 publications met the inclusion criteria (Figure 1; Supplementary Tables 2-718–27, 32–118). Of note, a total of 27 publications including 28 RCTs (32–50, 52, 53, 55–57, 59, 108, 109) reported the symptomatic COVID-19 (Supplementary Table 2). Among them, seven studies (41, 44, 46, 50, 59, 108, 109) were excluded from the overall analysis because their samples overlapped with another four studies (33, 34, 43, 56). Moreover, one RNA-based vaccine candidate CVnCoV (48) was not analyzed in the present study due to their lower efficacy than the goal of 50% efficacy set by WHO. One protein subunit candidate SCB-2019 vaccine (56) was not further analyzed in the present study because it was not listed as a vaccine of emergency use by WHO.
Figure 1 The Flow chart of literature search in the present study.
Risk of bias within individual studies
Two authors independently evaluated the risk of bias for eligible studies and checked the results. A ROBINS-I risk-of-bias tool was used to assess the case–control and cohort studies (119) (Supplementary Table 9). Moreover, a revised tool for assessing the risk of bias in randomized trials (ROBINS-2) was used (120) (Supplementary Table 8). The overall risk of bias was categorized as low, moderate, high, or serious in the current study.
Statistical analysis
According to the WHO recommendation, the lowest vaccine efficacy or effectiveness and lower 95% confidence interval (CI) were set at 50% and 30%, respectively (121). The probability of type 1 error and statistical power were set at one-sided 0.025 and 0.90, respectively. The minimum sample size should be 44,488 when the incidence rate was 850 per 100,000 person-years (122). A random-effect model was applied to calculate the pooled ratio risk (RR) or odd ratio (OR) for the occurrence of COVID-19 and its 95% CI when three or more studies reported the same type of effect measure. The heterogeneity was evaluated by the Cochran Q test and the I2 value (123). For RCTs, subgroup analysis was conducted according to the vaccine type as well as age and gender of vaccinees. The 95% CIs were not included if the lower bound was up to 0% and the upper bound was 100%. For the analysis of breakthrough infection, we calculated incidence rate or risk by dividing the numerator (number of cases) over the denominator (total number of persons or number of person-years). Rate ratio or RR was calculated by dividing the risk of a vaccinated group over a reference group while its 95% CI was calculated using the Byar and Taylor series methods (124, 125). Publication bias was analyzed by using Begg’s funnel plot (126) and Egger’s test (127) when the number of studies was >10. The vaccine efficacy or effectiveness was calculated as (1-RR) × 100% or (1-OR) × 100%. When a meta-analysis was not feasible, we directly described the results reported in the studies. For all the analyses, P < 0.05 was considered statistically significant. All statistical analyses were performed using STATA version 12.0 (STATA Corporation, College Station, TX).
Results
The updated efficacy of COVID-19 vaccines before the Omicron pandemic
We updated the efficacy analysis of COVID-19 vaccines based on the RCT studies before the pandemic of Omicron variant infection (Supplementary Table 2). Compared with the placebo group, the overall efficacy was 66.4% (95% CI: 51.9%, 76.5%) in preventing symptomatic infection and 47.6% (95% CI: 31.4%, 60.0%) in preventing asymptomatic infections for all COVID-19 vaccines analyzed (Table 1 and Figures 2, 5), respectively. The efficacy to prevent COVID-19 and severe COVID-19 was 79.7% (95% CI: 31.4%, 60.0%) and 93.6% (95% CI: 82.9%, 97.6%), respectively (Table 1 and Figures 3, 4), indicating that the current COVID-19 vaccines were much better in preventing severe and symptomatic COVID-19 than asymptomatic infection. There was one study to analyze the mRNA-1273 vaccine to prevent COVID-19-related death, and the efficacy was 100% (33).
Table 1 The efficacy of COVID-19 vaccines based on RCT studies before the Omicron pandemic.
Figure 2 Forest plot of the efficacy of COVID-19 vaccines against SARS-CoV-2 infection in overall and different vaccine types analyses.
Figure 3 Forest plot of the efficacy of COVID-19 vaccines against symptomatic COVID-19 disease in overall and different vaccine types analyses.
Figure 4 Forest plot of the efficacy of COVID-19 vaccines against severe COVID-19 disease in overall and different vaccine types analyses.
More detailed analysis indicated that for preventing SARS-CoV-2 infection, six RCTs showed that the efficacy was 69.4% (95% CI: 36.5%, 85.8%), 68.1% (95% CI: 59.7%, 74.8%), and 52.6% (95% CI: 43.0%, 61.6%) for RNA-based vaccine mRNA-1273; three inactivated virus vaccines HB02, WIV04, and BBV152; and one trial of viral vector (non-replicating) vaccine ChAdOx1 nCoV-19, respectively (Table 1; Figure 2). For preventing COVID-19, 21 RCTs showed the efficacy of 91.4% (95% CI: 89.8%, 92.8%) for two RNA-based vaccines BNT162b2 and mRNA-1273 and 82.2% (95% CI: 49.7%, 93.7%) for protein subunit vaccine NVX-CoV2373 (Table 1; Figure 3). The efficacy of 71.9% (95% CI: 58.1%, 81.1%) and 70.1% (95% CI: 57.7%, 78.8%) was observed for four inactivated vaccines CoronaVac, WIV04, HB02, and BBV152 and four viral vector (non-replicating) vaccines Ad26.COV2.S, Ad5-nCoV, AZD1222, and Sputnik V, respectively (Table 1; Figure 3). Further subgroup analyses indicated similar efficacy for male (79.7% [95% CI: 71.2%, 86.2%]) and female (79.4% [95% CI: 63.6%, 88.3%]) subjects and for those aged 5–17 years old (91.7% [90.0%, 93.1%]),18–64 years old (91.5% [89.2%, 93.7%]), and ≥65 years old (92.5% [87.6%, 95.5%]), respectively (Table 1). These results indicate that age and gender may not affect the efficacy of COVID-19 vaccines to prevent COVID-19 disease.
Moreover, all COVID-19 vaccines analyzed were significantly effective in preventing severe COVID-19 in 13 RCTs (Table 1; Figure 4). Among them, two RNA-based vaccines showed the CE of 98.4% (95% CI: 94.3%, 99.5%) while the efficacy of 91.1% (95% CI: 64.4%, 97.8%) and 89.7% (95% CI: 61.7%, 97.2%) was found for four viral vector (non-replicating) vaccines and four inactivated vaccines, respectively. Furthermore, the efficacy of 93.1% (95% CI: 46.0%, 99.1%) was observed in protein subunit vaccine NVX-CoV2373 (Table 1; Figure 4).
In general, the current COVID-19 vaccines were not effective in preventing asymptomatic infection based on the seven RCTs (Table 1; Figure 5). The efficacy was only 53.6% (95% CI: 38.2%, 65.2%) for the mRNA-1273 vaccine, 48.4% (95% CI: 20.3%, 66.6%) for three inactivated vaccines (HB02, WIV04, and BBV152), and 45.1% (95% CI: -20.1%, 74.9%) for two viral vector (non-replicating) vaccines (Table 1; Figure 5).
Figure 5 Forest plot of the efficacy of COVID-19 vaccines against asymptomatic SARS-CoV-2 infection in overall and vaccine types analyses.
The effectiveness of COVID-19 vaccines to prevent SARS-CoV-2 infection of Delta variant
The case–control studies showed that the overall effectiveness was 79.5% (95% CI: 73.9%, 83.8%), 80.2% (95% CI: 74.1%, 84.9%), 95.1% (95% CI: 93.1%, 96.5%), and 92.4% (95% CI: 88.6, 94.9) to prevent Delta variant infection, COVID-19, severe COVID-19, and COVID-19-related death, respectively (Table 2). Although mRNA-based vaccines were better than viral-vector and inactivated vaccines in preventing Delta variant infection and COVID-19, all the COVID-19 vaccines analyzed were highly effective in preventing severe COVID-19 and COVID-19-related death caused by the Delta variant (Table 2).
Table 2 The effectiveness of COVID-19 vaccines to prevent SARS-CoV-2 Delta variant infection.
Similar results were also obtained in the cohort studies about Delta variant infection (Table 2). In addition, mRNA-based vaccines were more effective in preventing Delta variant infection in the subjects 12–18 years old (87.2% [95% CI: 82.3%, 90.8%]) than those 60–79 years old (55.9% [95% CI: 50.8%, 60.7%]). Moreover, mRNA-based vaccines are more effective against severe COVID-19 (77.2% [95% CI: 68.6%, 82.4%]) than SARS-CoV-2 infection (34.8% [95% CI: 17.2%, 48.6%]) in the subjects ≥80 years old (Table 2). Similar results were also obtained in the case–control studies (Table 2). However, the case–control studies showed that the BNT162b2 and mRNA-1273 vaccines (47.3% [95% CI: 39.2, 54.3]) was not effective in preventing asymptomatic Delta infection (Table 2).
The effectiveness of one-dose COVID-19 vaccine booster immunization against the Delta variant
Compared with unvaccinated subjects, the cohort studies showed that the overall effectiveness of one-dose booster immunization was 85.9% (95% CI: 76.2%, 91.6%) for all COVID-19 vaccines analyzed and 85.5% (95% CI: 68.7%, 93.3%) for two RNA-based vaccines (BNT162b2 and mRNA-1273) to prevent the infection caused by the Delta variant (Table 3). Booster immunization with two RNA-based vaccines obtained an effectiveness of 93.9% (95% CI: 91.7%, 95.4%) and 96.0% (95% CI: 93.0, 98.0) to prevent severe COVID-19 and COVID-19-related death caused by the Delta variant, respectively, while the effectiveness to prevent COVID-19 was only 78.9% (95% CI: 69.3%, 85.6%, Table 3). Similar results were observed in the case–control studies in which for two RNA-based vaccines, the effectiveness of booster immunization was 94.8% (95% CI: 90.7%, 97.3%) to prevent SARS-CoV-2 infection, 94.8% (95% CI: 93.6%, 95.8%) to prevent COVID-19, 97.9% (95% CI: 95.7%, 99.1%) to prevent severe COVID-19, and 96.0% (95% CI: 88.0, 99.0) to prevent COVID-19-related death caused by the Delta variant (Table 3).
Table 3 The effectiveness of booster immunization of the COVID-19 vaccine to prevent SARS-CoV-2 infection and COVID-19 caused by the Delta variant*.
Compared with non-booster subjects, the cohort studies showed that the overall effectiveness of one-dose booster immunization was 82.1% (95% CI: 74.1%, 87.6%) to prevent infection of the Delta variant for two mRNA-based vaccines and 90.8% (95% CI: 89.5%, 92.3%) to prevent COVID-19 for the BNT162b2 vaccine (Table 3). Moreover, the overall effectiveness of one-dose booster immunization to prevent COVID-19 was 84.5% (95% CI: 82.4%, 86.4%) for BNT162b2 and mRNA-1273 vaccines based on the case–control studies (Table 3). Furthermore, three cohort studies showed that the effectiveness of one-dose booster immunization in preventing severe COVID-19 caused by the Delta variant was 92.6% (95% CI: 85.8%, 96.2%) for two mRNA vaccines (Table 3). Moreover, one cohort study (89) showed that the effectiveness of one-dose booster immunization was 84.0% (95% CI: 67.0%, 93.0%) to prevent COVID-19-related death for the BNT162b2 vaccine.
Incidence and risk of breakthrough infection of the SARS-CoV-2 Delta variant stratified by the intervals post-vaccination and age of vaccinees
For all the COVID-19 vaccines analyzed, the incidence of breakthrough infection of the SARS-CoV-2 Delta variant increased when the intervals post-vaccination extended and was 1.1% (95% CI: 0.2%, 2.0%) within 2–10 weeks post-vaccination, 4.1% (95% CI: 0.2%, 8.1%) within 10–18 weeks post-vaccination, 6.1% (1.7%, 10.5%) within 18–26 weeks post-vaccination, 9.3% (3.4%, 15.3%) within 26–33 weeks post-vaccination, and 12.3% (4.1%, 20.5%) more than 33 weeks post-vaccination, respectively (Table 4). Similar results were also observed for the two mRNA-based vaccines BNT162b2 and mRNA-1273 (Table 4). Furthermore, the incidence of breakthrough infection of the SARS-CoV-2 Delta variant decreased from 6.0% (1.4%, 10.5%) for those 18–49 years old, 4.3% (1.2%, 7.5%) for those 50–64 years old, to 1.0% (0.1, 2.0) for those over 65 years old within 2–26 weeks post-vaccination (Table 4). The decreased incidence of breakthrough infection of SARS-CoV-2 Delta variant risk among old people was also found when the interval post-vaccination was more than 26 weeks (Table 4).
Table 4 Breakthrough infection and symptomatic COVID-19 of the SARS-CoV-2 Delta variant.
RCTs showed that the incidence of COVID-19 caused by the breakthrough infection of the SARS-CoV-2 Delta variant increased from 5.0% within 26–34 weeks post-vaccination to 7.4% within 34–56 weeks post-vaccination with an RR of 0.71 (95% CI: 0.58, 0.87, p < 0.001, Table 4). Furthermore, the incidence of COVID-19 was significantly higher in those 18–64 years old than those over 65 years old with an RR of 0.57, 95% CI: 0.38, 0.86, p < 0.001) within 34–56 weeks post-vaccination (Table 8). Similar results were observed in the cohort studies and confirmed the relatively higher incidence of COVID-19 in the young people and those with extended intervals post-vaccination (Table 4).
Furthermore, the incidence of severe COVID-19 caused by the breakthrough infection of the Delta variant was only 0.1% and increased from 0.0% (95% CI: 0.0%, 2.0%) within 2–18 weeks post-vaccination, 0.1% (95% CI: 0.0%, 0.1%) within 18–26 weeks post-vaccination, 0.2% (95% CI: 0.0%, 0.3%) within 26–33 weeks post-vaccination, to 0.4% (95% CI: 0.1%, 0.8%) more than 33 weeks post-vaccination, respectively (Table 5). By comparing with the incidence of severe COVID-19 within 2–18 weeks post-vaccination, the risk ratio of severe COVID-19 increased from 8.8 (7.1, 10.9) within 18–26 weeks post-vaccination, 21.4 (17.1, 26.8) within 26–33 weeks post-vaccination, to 56.3 (44.6, 71.1) more than 33 weeks post-vaccination, respectively, for all the COVID-19 vaccines analyzed (Table 5). Similar results were also observed for the two mRNA-based vaccines BNT162b2 and mRNA-1273 (Table 5). Interestingly, severe COVID-19 was more often observed when the age of vaccinees and the intervals after vaccination increased. For example, by comparing with those 16–59 years old, the risk ratio for severe COVID-19 of the SARS-CoV-2 Delta variant was 24.38 (17.53, 33.91) for those ≥60 years old within 6–28 weeks post-vaccination (Table 5). These results showed a unique characteristic of breakthrough infection of SARS-CoV-2, i.e., more frequent symptomatic COVID-19 in young people and severe COVID-19 in old people.
Table 5 Breakthrough severe COVID-19 of the SARS-CoV-2 Delta variant by cohort studies.
The effectiveness of COVID-19 vaccines to prevent SARS-CoV-2 infection of the Omicron variant
The evaluation of COVID-19 vaccines to prevent Omicron variant infection was mainly conducted in the case–control studies or cohort studies. The case–control studies indicated that the current COVID-19 vaccines could not effectively prevent the infection of Omicron sub-lineage BA.1 since the effectiveness of 32.7% (95% CI: 18.4%, 44.5%) was lower than the goal of 50% set by WHO. However, the overall effectiveness was 64.8% (95% CI: 33.4%, 81.6%) to prevent symptomatic COVID-19 and 75.6% (95% CI: 50.8%, 87.9%) to prevent severe COVID-19 caused by Omicron variant B.1.1.529, respectively (Table 6). The cohort studies showed a similar low effectiveness (37.8% [95% CI: 29.3%, 45.6%]) of COVID-19 vaccines to prevent the infection of Omicron sub-lineage BA.1 and marginal effectiveness of 53.3% (95% CI: 40.5%, 63.3%) to prevent severe COVID-19 caused by Omicron variant B.1.1.529 (Table 6).
Table 6 The effectiveness of COVID-19 vaccines to prevent SARS-CoV-2 Omicron variant infection in case–control and cohort studies.
Moreover, several cohort studies indicated that the effectiveness of the current COVID-19 vaccines to prevent the occurrence of severe COVID-19 and COVID-19-related death caused by Omicron sub-lineage BA.2 was 80.8% (95% CI: 66.2%, 89.1%) and 90.1% (95% CI: 83.6, 94.0), respectively. Further analysis showed that the effectiveness was 87.6% (95% CI: 81.5%, 91.6%) and 70.9% (95% CI: 45.5%, 84.6%) for mRNA and inactivated vaccines, respectively, to prevent severe COVID-19 caused by the Omicron BA.2 variant, and 93.0% (95% CI: 88.7%, 95.7%) and 86.3% (95% CI: 73.0%, 93.0%) for mRNA and inactivated vaccines, respectively, to prevent COVID-19-related death (Table 6). In addition, one case–control study showed the effectiveness of 75% (95% CI: 52%, 87%) to prevent COVID-19-related death for two mRNA vaccines (20) while one cohort study showed that the effectiveness was only 40% (95% CI: 35%, 45%) (101).
The effectiveness of one-dose COVID-19 vaccine booster immunization against the Omicron variant
Compared with the unvaccinated population, the overall effectiveness of one-dose booster immunization to prevent Omicron variant infection was 63.9% (95% CI: 37.6%, 78.8%) for all the COVID-19 vaccines analyzed and 68.7% (42.2%, 83.1%) for two RNA-based vaccines based on the cohort studies (Table 7). Similar effectiveness was also confirmed by the case–control studies in which the overall effectiveness of one-dose booster immunization to prevent symptomatic COVID-19 caused by the Omicron B.1.1.529 variant was 64.8% (95% CI: 60.7%, 68.9%) for two RNA-based vaccines (Table 7). Furthermore, four cohort studies were selected to analyze the overall effectiveness of one-dose booster immunization to prevent severe COVID-19 caused by the Omicron B.1.1.529 variant, which was 84.9% (95% CI: 81.5%, 87.7%) for all the COVID-19 vaccines analyzed and 85.3% (95% CI: 78.1%, 90.1%) for two RNA-based vaccine (Table 7). Seven case–control studies showed that the overall effectiveness of one-dose booster immunization to prevent severe COVID-19 caused by the Omicron B.1.1.529 variant was 90.7% (86.2%, 94.2%) while the CE was 91.9% (95% CI: 86.7%, 94.8%) for two mRNA-based vaccines (Table 7). The effectiveness was 94.0% (95% CI: 85.0, 98.0) to prevent COVID-19-related death caused by the Omicron B.1.1.529 variant in cohort studies, and a similar result was found in case–control studies.
Table 7 The effectiveness of booster immunization of COVID-19 vaccines to prevent SARS-CoV-2 infection and COVID-19 caused by Omicron variants*.
Four cohort studies evaluated the effectiveness of one-dose booster immunization against symptomatic COVID-19 caused by the Omicron variant BA.2 and showed an effectiveness of 60.7% (95% CI: 44.6%, 71.9%, Table 7). Among them, the effectiveness was 71.8% (95% CI: 56.3%, 82.2%) for two RNA-based vaccines and 48.8% (95% CI: 25.7%, 64.6%) for inactivated virus vaccine CoronaVac. Moreover, the overall effectiveness of booster immunization against severe COVID-19 of the Omicron BA.2 variant was 97.7% (95% CI: 96.3%, 98.6%) (Table 7) whereas the effectiveness was 97.3% (95% CI: 94.8%, 98.6%) for two mRNA-based vaccines and 97.8% (95% CI: 95.5%, 99.3%) for inactivated virus vaccine CoronaVac. The overall effectiveness of booster immunization against COVID-19-related death was 98.3% (95% CI: 96.8%, 99.1%), and similar results were also found in BNT162b2 (98.3% [95% CI: 94.8%, 99.5%]) and CoronaVac vaccines (98.6% [95% CI: 96.1, 99.5]) for the Omicron BA.2 variant.
When compared with the non-booster group, we evaluated and found that the overall effectiveness of one-dose booster immunization was 61.4% (95% CI: 48.6%, 71.1%) to prevent the infection of the Omicron B.1.1.529 variant and 62.8% (95% CI: 46.2%, 74.2%) for two mRNA-based vaccines (Table 8). Moreover, the overall effectiveness of booster immunization to prevent symptomatic COVID-19 caused by the Omicron B.1.1.529 variant was 67.4% (95% CI: 65.6%, 69.1%) for two mRNA-based vaccines. The booster immunization effectiveness to prevent symptomatic COVID-19, severe COVID-19, and COVID-19-related death caused by the Omicron BA.2 variant was 57.8% (95% CI: 26.9%, 75.6%), 87.8% (95% CI: 82.7%, 91.3%), and 89.0% (95% CI: 81.4%, 94.0%) for mRNA-based vaccine BNT162b2, respectively (Table 8).
Table 8 The relative effectiveness of booster immunization of COVID-19 vaccines to prevent SARS-CoV-2 infection and COVID-19 caused by the Omicron variant.
The effectiveness of two-dose COVID-19 vaccine booster immunization overone-dose booster group against the Omicron variant
We compared the effectiveness of booster immunization of one dose vs. two doses 4 months apart. Non-randomized clinical studies showed that the two-dose booster immunization provided no additional protection against Omicron variant B.1.1.529 infection (adjusted RR: 0.784, 95% CI: 0.568, 1.081, P: 0.138) and symptomatic COVID-19 caused by the Omicron sub-lineage B.1.1.529 with an effectiveness of 37.9% (95% CI: 10.7, 56.8) among the young healthcare workers (Table 8). In addition, three cohort studies were included to evaluate the effectiveness of the fourth dose of COVID-19 vaccines to prevent Omicron B.1.1.529 variant infection and showed no significant benefit since the overall effectiveness was only 49.2% (95% CI: 46.3%, 51.8%) and 47.9% (95% CI: 41.8%, 53.2%) for the mRNA-based vaccine BNT162b2 was to prevent Omicron (B.1.1.529) infection (Table 8). Moreover, the overall effectiveness of the fourth dose of COVID-19 vaccine was 81.8% (95% CI: 54.1%, 92.7%) and 93.0% (95% CI: 54.0%, 99.0%) to prevent severe COVID-19 and COVID-19-related death caused by Omicron sub-lineage B.1.1.529, respectively (Table 8).
Duration of COVID-19 vaccines against severe COVID-19 caused by the Omicron B.1.1.529 variant
The above analysis indicted that the current COVID-19 vaccines could not prevent Omicron variant infection (Table 6) and could effectively prevent symptomatic COVID-19 against the Omicron variant (Table 6). Moreover, the effectiveness was quickly waning against Omicron variant infection and symptomatic COVID-19 (Supplementary Tables 10, 11). Cohort studies showed that the effectiveness of RNA-based vaccine BNT162b2 against severe COVID-19 caused by the Omicron B.1.1.529 variant declined from 75.0% (95% CI: 66.7%, 81.2%) 2–13 weeks and 76.0% (95% CI: 56.0%, 86.0%) 13–26 weeks to 61.0% (95% CI: 48.0%, 71.0%) more than 26 weeks post-vaccination (Table 9). Moreover, case–control studies indicated that the effectiveness of RNA-based vaccine BNT162b2 against severe COVID-19 caused by the Omicron B.1.1.529 variant decreased from 68.6% (95% CI: 56.0%, 77.6%) 1–14 weeks, 70.4% (95% CI: 60.8%, 77.7%) 14–27 weeks, and 72.0% (95% CI: 65.7%, 77.2%) 27–40 weeks to 42.8% (95% CI: 30.2%, 53.2%) or more than 40 weeks post-vaccination. For RNA-based vaccine mRNA-1273, cohort studies showed that the effectiveness against severe COVID-19 caused by the Omicron B.1.1.529 variant decreased from 92.0% (95% CI: 43.0%, 99.0%) 2–13 weeks and 90.0% (95% CI: 28.0%, 99.0%) 13–26 weeks to 72.0% (95% CI: 43.0%, 86.0%) or over 26 weeks. The case–control studies also found that the effectiveness against severe COVID-19 caused by the Omicron B.1.1.529 variant declined from 76.9% (95% CI: 19.2%, 93.4%) at 4–30 weeks to 64.0% (95% CI: 39.1%, 78.7%) at more than 30 weeks post-vaccination (Table 9). Of note, the effectiveness of RNA-based vaccine BNT162b2 against severe COVID-19 increased from 65.2% (95% CI: 43.7%, 78.5%) among the subjects aged 5–11 years within 2–9 weeks post-vaccination, 76.0% (95% CI: 71.3%, 80.0%) of those aged 12–17 years within 2–11 weeks, to 91.0% (95% CI: 79.0%, 96.0%) of those aged 70 or over years within 2–13 years (Table 9) probably due to the high frequency of severe COVID-19 in old people.
Table 9 The duration of effectiveness of COVID-19 vaccines against severe COVID-19 caused by the Omicron (B.1.1.529) variant.
For the viral vector (non-replicating) ChAdOx1 nCoV-19 vaccine, one cohort study showed that the effectiveness against severe COVID-19 caused by the Omicron B.1.1.529 variant decreased from 99.0% (95% CI: 98.0%, 99.0%) 2–13 weeks post-vaccination to 41.0% (95% CI: −140%, 86.0%) 13–26 weeks and 43.0% (95% CI: −10.0%, 70.0%) or more than 26 weeks post-vaccination (Table 9). For the inactivated virus CoronaVac vaccine, one case–control study showed that the effectiveness against severe COVID-19 caused by the Omicron B.1.1.529 variant was 49.9% (95% CI: 30.7%, 63.7%) within 2–8 weeks, 62.6% (95% CI: 58.5%, 66.3%) within 8–26 weeks, and 57.0% (53.5%, 60.2%) or more than 26 weeks after full vaccination, respectively (Table 9). The same study also showed that the CoronaVac vaccine effectiveness against severe COVID-19 caused by the Omicron B.1.1.529 variant was higher among people aged 18–60 years (68.8% [95% CI: 63.2%, 73.6%] than those aged 60–74 years (58.9% [95% CI: 52.9%, 64.1%]) and those aged 75 or more years (46.2% [95% CI: 39.4%, 52.2%]) when the time interval was 26 weeks post-vaccination (Table 9).
Duration of COVID-19 vaccine booster immunization against SARS-CoV-2 infection or COVID-19 caused by the Omicron B.1.1.529 variant
Only one case–control study (21) reported the duration of the effectiveness of RNA-based vaccine mRNA-1273 homologous booster immunization against SARS-CoV-2 infection caused by the Omicron B.1.1.529 variant, which was waning from 71.6% (95% CI: 69.7%, 73.4%) 2–8 weeks to 47.4% (95% CI: 40.5%, 53.5%) over 8 weeks post-booster immunization.
Furthermore, the effectiveness of RNA-based vaccine BNT162b2 or mRNA-1273 homologous or heterogenous booster immunization was waning from 60.3% (95% CI: 57.6%, 62.8%) 1–10 weeks post-immunization, 50.2% (95% CI: 39.1%, 59.3%) 10–15 weeks, to 45.5% (95% CI: 43.8%, 47.2%) or more than 15 weeks (Supplementary Table 12). For RNA-based vaccine BNT162b2 homologous booster immunization, the effectiveness decreased from 56.9% (95% CI: 50.7%, 62.4%) 1–5 weeks, 49.9% (95% CI: 42.4%, 56.5%) 4–10 weeks, to 45.7% (95% CI: 44.7%, 46.7%) 10 or more weeks. For RNA-based vaccine BNT162b2 heterogenous booster mRNA-1273, the effectiveness declined from 74.0% (95% CI: 73.1%, 74.9%) 1–2 weeks and 73.9% (73.1%, 74.6%) 2–5 weeks to 64.4% (95% CI: 62.6%, 66.1) 5–10 weeks (Table 4). For RNA-based vaccine mRNA-1273 homologous booster immunization, the effectiveness was waning from 55.4% (95% CI: 43.6%, 64.7%) 1–6 weeks to 38.6% (95% CI: 19.4%, 53.1%) 6–8 weeks (Supplementary Table 12). For RNA-based vaccine mRNA-1273 heterogenous booster BNT162b2, the effectiveness was 64.3% (95% CI: 61.7%, 66.8%) within 1–2 weeks and 64.9% (95% CI: 62.3%, 67.3%) within 2–5 weeks (Supplementary Table 12).
For viral vector (non-replicating) ChAdOx1 nCoV-19 homologous booster immunization, the effectiveness decreased from 57.7% (95% CI: 37.6%, 71.3%) 1–2 weeks and 55.6% (95% CI: 44.4%, 64.6%) 2–5 weeks to 46.7% (95% CI: 34.3%, 56.7%) 5–10 weeks (Supplementary Table 12). Moreover, for the viral vector (non-replicating) ChAdOx1 nCoV-19 heterogenous booster BNT162b2 vaccine, the effectiveness was waning from 58.8% (95% CI: 57.8%, 59.7%) 1–2 weeks and 62.4% (95% CI: 61.8%, 63.0%) 2–5 weeks, 52.9% (95% CI: 52.1%, 53.7%) 5–10 weeks, to 39.6% (95% CI: 38.0%, 41.1%) 10 or more weeks (Supplementary Table 12). Furthermore, for viral vector (non-replicating) ChAdOx1 nCoV-19 heterogenous booster mRNA-1273 vaccine, the effectiveness declined from 68.0% (95% CI: 67.0, 68.9%) 1–2 weeks and 70.1% (95% CI: 69.5%, 70.7%) to 60.9% (95% CI: 59.7%, 62.1%) 5–10 weeks (Supplementary Table 12). Our results indicated that inactivated virus CoronaVac homologous booster immunization was not effective (Supplementary Table 12). The inactivated virus CoronaVac plus heterogenous booster with BNT162b2 could provide marginal protection against symptomatic COVID-19 caused by the Omicron B.1.1.529 variant (56.8% [95% CI: 56.3%, 57.4%] at 1–8 weeks and 34.9% [95% CI: 34.3%, 35.6%] at 8 or more weeks, Supplementary Table 12).
Case–control studies showed that the effectiveness of any RNA-based vaccine BNT162b2 or mRNA-1273 homologous or heterogenous booster immunization against symptomatic COVID-19 caused by the Omicron BA.2 variant was waning from 67.6% (95% CI: 58.5%, 74.6%) 2–15 weeks to 48.4% (95% CI: 45.2%, 51.4%) 15 or more weeks post-immunization (Supplementary Table 12).
The effectiveness of any RNA-based vaccine BNT162b2 or mRNA-1273 homologous or heterogenous booster immunization was over 75% against severe COVID-19 at 17 or more weeks post-immunization based on the cohort studies and over 80% within 15 or more weeks according to the case–control studies (Supplementary Table 13). The effectiveness was over 65% against severe COVID-19 caused by the Omicron B.1.1.529 variant at more than 8 weeks post-immunization for inactivated virus CoronaVac homologous booster immunization, and 86.1% (95% CI: 85.0%, 87.1%) for the combination of inactivated virus CoronaVac and heterogenous booster immunization with BNT162b2 (Supplementary Table 13).
Discussion
In the present study, we updated the results about the efficacy or effectiveness of COVID-19 vaccines before the pandemic of the Omicron variant and comprehensively analyzed the effectiveness of COVID-19 vaccines in preventing infection of Delta and Omicron variants, which are the two most important and dominant strains of SARS-CoV-2. Our results further confirm the important role of COVID-19 vaccines in preventing the occurrence of COVID-19.
Our results indicated that the current COVID-19 vaccines could effectively prevent COVID-19 illness, especially severe COVID-19 and COVID-19-related death based on phase III RCTs before the pandemic of the Omicron variant. However, a major challenge for COVID-19 vaccines is its effectiveness in preventing infection and COVID-19 caused by SARS-CoV-2 variants. In the past 2 years, the pandemic of COVID-19 was dominated by Delta and Omicron variants. The mutations in the spike protein of SARS-CoV-2 have dramatically changed its biological features including its interaction with host receptor ACE2, weakened the host immune system, and compromised vaccine efficacy (30, 31). In the present study, we confirmed the effectiveness of COVID-19 vaccines to prevent Delta variant infection, in particular the symptomatic COVID-19, severe COVID-19, and COVID-19-related death caused by the Delta variant after full vaccination. However, we found the incidence of breakthrough infection of the SARS-CoV-2 Delta variant increased when the intervals after full vaccination extended due to the waning immunity for the current vaccines. These findings are consistent with neutralization data. Several studies showed that neutralizing antibody titers induced by the first two doses of vaccines declined 6 months later to near or below the seropositive cutoff (100, 128, 129). A booster vaccination of CoronaVac then dramatically increased neutralizing antibody titers to 137·9 and 143·1 GMTs 14–28 days later (128). Moreover, one phase II RCT (129) demonstrated the potential of all vaccines tested (AZD1222 (ChAdOx1 nCoV-19), mRNA-1273, NVX-CoV2373, Ad26.COV2.S, CVnCoV, Valneva, and BNT162b2) to boost immunity following an initial course of ChAd/ChAd and of six vaccines (AZD1222 (ChAdOx1 nCoV-19), BNT162b2, mRNA-1273, NVX-CoV2373, Ad26.COV2.S, and CVnCoV) following an initial course of BNT/BNT. These results indicated that a booster dose might provide longer-lasting immunity and higher levels of protection than a two-dose schedule. Therefore, an ongoing strategy is to adapt booster immunization to enhance the protection efficacy of COVID-19 vaccines. In the present study, we observed that the effectiveness of one-dose booster immunization was over 74.5% to prevent COVID-19 caused by the Delta variant, which confirmed the role of booster immunization.
However, the SARS-CoV-2 virus is continuously mutating from the original strain to the current epidemic strains of Omicron variants. Therefore, it is urgently needed to comprehensively analyze the effectiveness of COVID-19 vaccines and booster vaccination during the pandemic of the SARS-CoV-2 Omicron variant. In the present study, our results showed that two RNA vaccines BNT162b2 and mRNA-1273 could prevent 64.8% and ~70% of symptomatic and severe COVID-19 cases caused by Omicron sub-lineage BA.1.1.529, respectively. Moreover, both RNA vaccine BNT162b2 and inactivated virus CoronaVac could effectively prevent severe COVID-19 cases and COVID-19-related death caused by Omicron sub-lineage BA.2 after full vaccination. These results indicate that the current COVID-19 vaccines are still able to prevent COVID-19 caused by the SARS-CoV-2 Omicron variant. However, the current COVID-19 vaccines could not effectively prevent the infection of the Omicron variant, suggesting that SARS-CoV-2 variants especially the Omicron variant significantly decreased the effectiveness of COVID-19 vaccines. One possibility is its decreased virulence to result in the large amount of asymptomatic infection of Omicron variants (130), which affect the overall efficacy of COVID-19 vaccines. Another possibility for the decreased efficiency of COVID-19 vaccines for the Omicron variant is likely due to a combination of extended time interval post-vaccination and the immune escape caused by the mutations in the viral spike proteins (30, 31, 131). In this study, we found that booster immunization could enhance the effectiveness of COVID-19 vaccines to prevent the infection, symptomatic COVID-19, severe COVID-19, and COVID-19-related death which were about 62%, 65%, 88%, and 94% for Omicron sub-lineage BA.1.1.529, respectively. Moreover, the overall effectiveness was about 61%, 98%, and 98% in preventing symptomatic, severe COVID-19, and COVID-19-related death caused by Omicron sub-lineage BA.2, respectively. Two doses of booster immunization could provide additional protection for severe COVID-19 and COVID-19-related death with an effectiveness of 81.8% and 93% compared with dose 3 over 3 months, respectively, but not for the infection and symptomatic COVID-19 caused by the Omicron variant. These results indicated that booster immunization could effectively protect COVID-19 illness caused by the Omicron variant. Although booster immunization is less effective for the Omicron variant against infection, it could effectively protect COVID-19 and COVID-19-related death.
Another important issue is about the duration of COVID-19 vaccination since the waning immunity post-vaccination has been repeatedly reported. In our study, we systematically evaluated the duration of the effectiveness of COVID-19 vaccines to prevent SARS-CoV-2 infection and COVID-19 during the pandemic of SARS-CoV-2 Omicron variant infection. Our results confirmed that the effectiveness of COVID-19 vaccines was rapidly waning. Fortunately, homologous or heterogenous booster immunization with RNA-based vaccine BNT162b2 or mRNA-1273 could effectively prevent severe COVID-19 with over 75% efficacy. Moreover, we found that heterogenous booster immunization showed better effectiveness than homologous booster immunization. These findings are consistent with neutralization data for the Omicron variant. Several studies indicated a reduction in neutralizing antibody activity in serum specimens by a factor of 20- to 40-fold for the neutralizing antibodies acquired after two doses of BNT162b2 vaccination against SARS-CoV-2 strains from the early pandemic and by a factor of at least 10 against the Delta variant (132–134). In serum specimens obtained from the recipients of two doses of ChAdOx1 nCoV-19, a greater reduction in neutralizing activity was also observed among the serum samples of vaccines and a large proportion of them showed neutralizing activity below the limit of quantification (134). Low neutralizing antibody responses against the Omicron variant have been observed in individuals receiving two doses and three doses of CoronaVac (135–138). However, a heterogenous booster immunization could increase neutralizing activity (132–134). In addition, one booster dose of mRNA vaccine BNT162b2 has been shown to increase the neutralizing antibodies against the Omicron variant when compared to the original inactivated CoronaVac vaccine or mRNA vaccine BNT162b2 (135–138). Several possibilities may explain a decline in the effectiveness of COVID-19 vaccines when the time interval extended after vaccination. The decreased efficacy may reflect lower vaccine effectiveness against SARS-CoV-2 variants, or the true waning immunity caused by loss of vaccine-induced immunological protection, or sampling biases that may cause large heterogeneity of the studies or inconsistent results among the studies.
Our results indicate that the overall efficacy of COVID-19 vaccines is <50% in preventing asymptomatic infection of SARS-CoV-2 (Table 1), indicating that the current COVID-19 vaccines are inefficient in preventing infection of SARS-CoV-2, especially against asymptomatic SARS-CoV-2 infection. Unlike traditional vaccines, WHO also defines COVID-19 rather than SARS-CoV-2 infection as the primary endpoint of the efficacy of COVID-19 vaccines (121). SARS-CoV-2 infection exhibits symptomatic COVID-19 (including severe COVID-19) and asymptomatic infection (139). Sah et al. found that 35.1% (95% CI: 30.7, 39.9) of SARS-CoV-2-infected persons never developed clinical symptoms and thus were truly asymptomatic infection (140). Hence, it is necessary to evaluate the vaccine efficacy to prevent asymptomatic SARS-CoV-2 infection. People with asymptomatic infection of SARS-CoV-2 may be an important source of COVID-19 epidemic and may inevitably distort the dynamics of the COVID-19 pandemic especially for the pandemic of the Omicron variant since they may have high viral loads even a few days prior to symptom onset and cannot be timely diagnosed (141). In the present study, the current COVID-19 vaccines were not effective in preventing asymptomatic SARS-CoV-2 infection based on the RCTs. The efficacy was only 53.6% for RNA-based vaccine mRNA-1273, 48.4% for inactivated vaccines, and 45.1% for the viral vector (non-replicating) vaccines (Table 1). Moreover, the case–control studies showed that the overall effectiveness was only 47.3% to prevent asymptomatic COVID-19 illness caused by Delta variant for the two RNA-based vaccines BNT162b2 and mRNA-1273. Of note, the data about asymptomatic infection of SARS-CoV-2 and the efficacy evaluation of COVID-19 vaccines are prone to some biases. Some studies did not record negative PCR results of patients, which may lead to some presymptomatic cases to be mistakenly classified as asymptomatic patients. Moreover, the recorded symptoms of patients mainly based on self-reporting data in some studies, which may not be accurate and reliable. Furthermore, the proportion of asymptomatic infections was different and is associated with SARS-CoV-2 variants (130). Therefore, the efficacy or effectiveness of COVID-19 vaccines against asymptomatic COVID-19 infection should be further evaluated and explained with caution. In addition, the reasons and factors that affect the efficacy of COVID-19 vaccines to prevent SARS-CoV-2 infection, especially asymptomatic infection, remain to be elucidated.
Furthermore, breakthrough infection is urgently needed to be investigated since the studies may provide important information for the development of refined COVID-19 vaccines and for the identification of the subjects who are susceptible to breakthrough infection of SARS-CoV-2. In the present study, we found that the risk and incidence of breakthrough infections with the delta variant were increased when the time extended after vaccination. These results confirmed the feature of waning vaccine efficacy or effectiveness over time. Moreover, young people had a higher risk of breakthrough infection, which may indicate the presence of potential confounding behavioral factors in these people to cause a higher exposure to the virus. In addition, older people had a higher risk of severe COVID-19 of the SARS-CoV-2 Delta variant due to breakthrough infection probably because they had coexisting medical conditions, which are the major risk factors associated with the occurrence of severe COVID-19. Therefore, COVID-19 vaccination should give priority to the elderly people to prevent severe COVID-19 illness.
This study has several limitations and some biases. First, it is possible that additional studies on the COVID-19 vaccines’ effectiveness were not captured by our search strategy, and new studies will become available considering the rapid pace and multiple preprint publishing options for COVID-19-related papers. Second, preprint studies involved might change their results in the final publication. Third, a small number of vaccines were evaluated in observational studies that may affect the quality and reliability of the study results. Fourth, all the included studies did not evaluate the effectiveness to prevent asymptomatic Omicron infection. Fifth, we did not evaluate the effectiveness of COVID-19 vaccines among the subjects with chronic diseases and those with previous SARS-CoV-2 infections; Sixth, the major bias was incomplete adjustment for the confounders for the observational studies. Moreover, some potential biases in assessing the vaccine effectiveness over time can occur. For example, people who are vaccinated change behavior over time. Seventh, publication bias was observed on the efficacy of COVID-19 vaccines to prevent symptomatic COVID-19 illness based on RCT studies. However, when we applied a non-parametric “trim and fill” method (Figure 6), the analysis showed that no more study should be added. Ninth, heterogeneity between studies was much large in overall and among several subgroups. Our analysis indicated that the heterogeneity may come from the data itself since adequate statistical correction and analysis did not significantly improve the heterogeneity. The source of heterogeneity may be due to the factors such as the areas in which the studies were conducted, the risk of exposure to SARS-CoV-2, and other factors that were beyond our control, such as type of vaccines and different vaccine manufacturers. Moreover, non-reporting of negative data and heterogeneity of samples may also be a source of heterogeneity and may affect the accuracy of results. Further analysis is needed to use real-world data about the efficacy or effectiveness of COVID-19 vaccines.
Figure 6 The Duval and Tweedie nonparametric "trim and fill" method's funnel plot on the efficacy of COVID-19 vaccines to prevent symptomatic COVID-19 illness based on RCT studies.
In summary, the current COVID-19 vaccines could effectively protect COVID-19 caused by the Delta variant and relatively less effective for the Omicron variant. The waning immunity was observed especially in old people after full vaccination. Breakthrough infection seems rare within 6 months and is less likely to cause severe COVID-19 in young people after full vaccination against the Delta variant. Booster immunization could enhance protection capability. Moreover, two doses’ immunization could provide additional protection for severe COVID-19 against the Omicron variant.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding author.
Author contributions
Conceptualization: XH, ST. Data curation: XH, JS, YM, WZ. Formal analysis: JS, YM, WZ. Investigation: JS. Methodology: XH, YM, JS. Project administration: XH, JS, YM, WZ. Supervision: ST. Validation: XH, JS, ST. Writing—original draft: XH, ST. Writing—review and editing: XH, JS, YM, WZ, ST. All authors contributed to the article and approved the submitted version.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fimmu.2022.945930/full#supplementary-material
References
1. Hu B, Guo H, Zhou P, Shi ZL. Characteristics of SARS-CoV-2 and COVID-19. Nat Rev Microbiol (2021) 19:141–54. doi: 10.1038/s41579-020-00459-7
2. WHO. Draft landscape and tracker of COVID-19 candidate vaccines. World Health Organization (2022). Available at: https://www.who.int/publications/m/item/draft-landscape-of-covid-19-candidate-vaccines.
3. WHO. WHO coronavirus (COVID-19) dashboard. World Health Organization (2022). Available at: https://covid19.who.int/table.
4. WHO. Coronavirus disease (COVID-19) SARS-CoV-2-variants. World Health Organization (2022). Available at: https://www.who.int/en/activities/tracking-SARS-CoV-2-variants/.
5. Dobrynin D, Polishchuk I, Portal L, Zlotver I, Sosnik A, Pokroy B. Adsorption of SARS CoV-2 spike proteins on various functionalized surfaces correlates with the high transmissibility of delta and omicron variants. Mater Today Bio (2022) 14:100265. doi: 10.1016/j.mtbio.2022.100265
6. Guo D, Duan H, Cheng Y, Wang Y, Hu J, Shi H. Omicron-included mutation-induced changes in epitopes of SARS-CoV-2 spike protein and effectiveness assessments of current antibodies. Mol BioMed (2022) 3:12. doi: 10.1186/s43556-022-00074-3
7. Tetz G, Tetz V. Prion-like domains in spike protein of SARS-CoV-2 differ across its variants and enable changes in affinity to ACE2. Microorganisms (2022) 10:280. doi: 10.3390/microorganisms10020280
8. Cai C, Peng Y, Shen E, Huang Q, Chen Y, Liu P, et al. A comprehensive analysis of the efficacy and safety of COVID-19 vaccines. Mol Ther (2021) 29:2794–805. doi: 10.1016/j.ymthe.2021.08.001
9. Calzetta L, Ritondo BL, Coppola A, Matera MG, Di Daniele N, Rogliani P. Factors influencing the efficacy of COVID-19 vaccines: A quantitative synthesis of phase III trials. Vaccines (Basel) (2021) 9:341. doi: 10.3390/vaccines9040341
10. Sharif N, Alzahrani KJ, Ahmed SN, Dey SK. Efficacy, immunogenicity and safety of COVID-19 vaccines: A systematic review and meta-analysis. Front Immunol (2021) 12:714170. doi: 10.3389/fimmu.2021.714170
11. Cheng H, Peng Z, Luo W, Si S, Mo M, Zhou H, et al. Efficacy and safety of COVID-19 vaccines in phase III trials: A meta-analysis. Vaccines (Basel) (2021) 9:582. doi: 10.3390/vaccines9060582
12. Sathian B, Asim M, Banerjee I, Roy B, Pizarro AB, Mancha MA, et al. Development and implementation of a potential coronavirus disease 2019 (COVID-19) vaccine: A systematic review and meta-analysis of vaccine clinical trials. Nepal J Epidemiol (2021) 11:959–82. doi: 10.3126/nje.v11i1.36163
13. Harder T, Koch J, Vygen-Bonnet S, Külper-Schiek W, Pilic A, Reda S, et al. Efficacy and effectiveness of COVID-19 vaccines against SARS-CoV-2 infection: interim results of a living systematic review. Euro Surveill (2021) 26:2100563 doi: 10.2807/1560-7917.ES.2021.26.28.2100563
14. Harder T, Külper-Schiek W, Reda S, Treskova-Schwarzbach M, Koch J, Vygen-Bonnet S, et al. Effectiveness of COVID-19 vaccines against SARS-CoV-2 infection with the delta (B.1.617.2) variant: second interim results of a living systematic review and meta-analysis, 1 January to 25 august 2021. Euro Surveill (2021) 26:2100920. doi: 10.2807/1560-7917.ES.2021.26.41.2100920
15. Higdon MM, Wahl B, Jones CB, Rosen JG, Truelove SA, Baidya A, et al. A systematic review of COVID-19 vaccine efficacy and effectiveness against SARS-CoV-2 infection and disease. medRxiv (2021). doi: 10.1101/2021.09.17.21263549
16. Kow CS, Hasan SS. Real-world effectiveness of BNT162b2 mRNA vaccine: a meta-analysis of large observational studies. Inflammopharmacology (2021) 29:1075–90. doi: 10.1007/s10787-021-00839-2
17. Zeng B, Gao L, Zhou Q, Yu K, Sun F. Effectiveness of COVID-19 vaccines against SARS-CoV-2 variants of concern: a systematic review and meta-analysis. medRxiv (2021). doi: 10.1101/2021.09.23.21264048
18. Powell AA, Kirsebom F, Stowe J, McOwat K, Saliba V, Ramsay ME, et al. Adolescent vaccination with BNT162b2 (Comirnaty, pfizer-BioNTech) vaccine and effectiveness against COVID-19: national test-negative case-control study, England. medRxiv (2021). doi: 10.1101/2021.12.10.21267408
19. Šmíd M, Berec L, Májek O, Pavlík T, Jarkovský J, Weiner J, et al. Protection by vaccines and previous infection against the omicron variant of SARS-CoV-2. medRxiv (2022). doi: 10.1101/2022.02.24.22271396
20. Yinong YX. Effectiveness of mRNA COVID-19 vaccines against omicron among veterans. medRxiv (2022). doi: 10.1101/2022.01.15.22269360
21. Tseng HF, Ackerson BK, Luo Y, Sy LS, Talarico CA, Tian Y, et al. Effectiveness of mRNA-1273 against SARS-CoV-2 omicron and delta variants. Nat Med (2022) 28:1063-71. doi: 10.1038/s41591-022-01753-y
22. Yoon SK, Hegmann KT, Thiese MS, Burgess JL, Ellingson K, Lutrick K, et al. Protection with a third dose of mRNA vaccine against SARS-CoV-2 variants in frontline workers. N Engl J Med (2022) 386:1855-7. doi: 10.1056/NEJMc2201821
23. Regev-Yochay G, Amit S, Bergwerk M, Lipsitch M, Leshem E, Kahn R, et al. Decreased infectivity following BNT162b2 vaccination: A prospective cohort study in Israel. Lancet Reg Health Eur (2021) 7:100150. doi: 10.1016/j.lanepe.2021.100150
24. Ferdinands JM, Rao S, Dixon BE, Mitchell PK, DeSilva MB, Irving SA, et al. Waning 2-dose and 3-dose effectiveness of mRNA vaccines against COVID-19-Associated emergency department and urgent care encounters and hospitalizations among adults during periods of delta and omicron variant predominance - VISION network, 10 states, august 2021-January 2022. MMWR Morb Mortal Wkly Rep (2022) 71:255–63. doi: 10.15585/mmwr.mm7107e2
25. Accorsi EK, Britton A, Fleming-Dutra KE, Smith ZR, Shang N, Derado G, et al. Association between 3 doses of mRNA COVID-19 vaccine and symptomatic infection caused by the SARS-CoV-2 omicron and delta variants. JAMA (2022) 327:639–51. doi: 10.1001/jama.2022.0470
26. Andrews N, Stowe J, Kirsebom F, Toffa S, Rickeard T, Gallagher E, et al. Covid-19 vaccine effectiveness against the omicron (B.1.1.529) variant. N Engl J Med (2022) 386:1532-46. doi: 10.1056/NEJMoa2119451
27. Buchan SA, Chung H, Brown KA, Austin PC, Fell DB, Gubbay J, et al. Effectiveness of COVID-19 vaccines against omicron or delta infection. medRxiv (2021). doi: 10.1101/2021.12.30.21268565
28. Hsu L, Grüne B, Buess M, Joisten C, Klobucnik J, Nießen J, et al. COVID-19 breakthrough infections and transmission risk: Real-world data analyses from germany's largest public health department (Cologne). Vaccines (Basel) (2021) 9:1267. doi: 10.3390/vaccines9111267
29. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The prisma statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. PloS Med (2009) 6:e1000100. doi: 10.1371/journal.pmed.1000100
30. Price AM, Olson SM, Newhams MM, Halasa NB, Boom JA, Sahni LC, et al. BNT162b2 protection against the omicron variant in children and adolescents. N Engl J Med (2022) 386(20):1899–909. doi: 10.1056/NEJMoa2202826
31. Huang M, Wu L, Zheng A, Xie Y, He Q, Rong X, et al. Atlas of currently available human neutralizing antibodies against SARS-CoV-2 and escape by omicron sub-variants BA.1/BA.1.1/BA.2/BA.3. Immunity (2022) 55:1501-14.e3.doi: 10.1016/j.immuni.2022.06.005
32. Al Kaabi N, Zhang Y, Xia S, Yang Y, Al Qahtani MM, Abdulrazzaq N, et al. Effect of 2 inactivated SARS-CoV-2 vaccines on symptomatic COVID-19 infection in adults: A randomized clinical trial. JAMA (2021) 326:35–5. doi: 10.1001/jama.2021.8565
33. El Sahly HM, Baden LR, Essink B, Doblecki-Lewis S, Martin JM, Anderson EJ, et al. Efficacy of the mRNA-1273 SARS-CoV-2 vaccine at completion of blinded phase. N Engl J Med (2021) 385:1774–85. doi: 10.1056/NEJMoa2113017
34. Voysey M, Costa Clemens SA, Madhi SA, Weckx LY, Folegatti PM, Aley PK, et al. Single-dose administration and the influence of the timing of the booster dose on immunogenicity and efficacy of ChAdOx1 nCoV-19 (AZD1222) vaccine: A pooled analysis of four randomised trials. Lancet (2021) 397:881–91. doi: 10.1016/S0140-6736(21)00432-3
35. Logunov DY, Dolzhikova IV, Shcheblyakov DV, Tukhvatulin AI, Zubkova OV, Dzharullaeva AS, et al. Safety and efficacy of an rAd26 and rAd5 vector-based heterologous prime-boost COVID-19 vaccine: an interim analysis of a randomised controlled phase 3 trial in Russia. Lancet (2021) 397:671–81. doi: 10.1016/S0140-6736(21)00234-8
36. Ella R, Reddy S, Blackwelder W, Potdar V, Yadav P, Sarangi V, et al. Efficacy, safety, and lot-to-lot immunogenicity of an inactivated SARS-CoV-2 vaccine (BBV152): interim results of a randomised, double-blind, controlled, phase 3 trial. Lancet (2021) 398:2173–84. doi: 10.1016/S0140-6736(21)02000-6
37. Ali K, Berman G, Zhou H, Deng W, Faughnan V, Coronado-Voges M, et al. Evaluation of mRNA-1273 SARS-CoV-2 vaccine in adolescents. N Engl J Med (2021) 385:2241–51. doi: 10.1056/NEJMoa2109522
38. Falsey AR, Sobieszczyk ME, Hirsch I, Sproule S, Robb ML, Corey L, et al. Phase 3 safety and efficacy of AZD1222 (ChAdOx1 nCoV-19) covid-19 vaccine. N Engl J Med (2021) 385:2348–60. doi: 10.1056/NEJMoa2105290
39. Frenck RW Jr, Klein NP, Kitchin N, Gurtman A, Absalon J, Lockhart S, et al. Safety, immunogenicity, and efficacy of the BNT162b2 covid-19 vaccine in adolescents. N Engl J Med (2021) 385:239–50. doi: 10.1056/NEJMoa2107456
40. Heath PT, Galiza EP, Baxter DN, Boffito M, Browne D, Burns F, et al. Safety and efficacy of NVX-CoV2373 covid-19 vaccine. N Engl J Med (2021) 385:1172–183. doi: 10.1056/NEJMoa2107659
41. Sadoff J, Gray G, Vandebosch A, Cárdenas V, Shukarev G, Grinsztejn B, et al. Safety and efficacy of single-dose Ad26.COV2.S vaccine against covid-19. N Engl J Med (2021) 384:2187–201. doi: 10.1056/NEJMoa2101544
42. Tanriover MD, Doğanay HL, Akova M, Güner HR, Azap A, Akhan S, et al. Efficacy and safety of an inactivated whole-virion SARS-CoV-2 vaccine (CoronaVac): interim results of a double-blind, randomised, placebo-controlled, phase 3 trial in Turkey. Lancet (2021) 398:213–22. doi: 10.1016/S0140-6736(21)01429-X
43. Thomas SJ, Moreira ED Jr, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Safety and efficacy of the BNT162b2 mRNA covid-19 vaccine through 6 months. N Engl J Med (2021) 385:1761–73. doi: 10.1056/NEJMoa2110345
44. Madhi SA, Baillie V, Cutland CL, Voysey M, Koen AL, Fairlie L, et al. Efficacy of the ChAdOx1 nCoV-19 covid-19 vaccine against the B.1.351 variant. N Engl J Med (2021) 384:1885–98. doi: 10.1056/NEJMoa2102214
45. Fadlyana E, Rusmil K, Tarigan R, Rahmadi AR, Prodjosoewojo S, Sofiatin Y, et al. A phase III, observer-blind, randomized, placebo-controlled study of the efficacy, safety, and immunogenicity of SARS-CoV-2 inactivated vaccine in healthy adults aged 18-59 years: An interim analysis in Indonesia. Vaccine (2021) 39:6520–8. doi: 10.1016/j.vaccine.2021.09.052
46. Clemens SAC, Folegatti PM, Emary KRW, Weckx LY, Ratcliff J, Bibi S, et al. Efficacy of ChAdOx1 nCoV-19 (AZD1222) vaccine against SARS-CoV-2 lineages circulating in Brazil. Nat Commun (2021) 12:5861. doi: 10.1038/s41467-021-25982-w
47. Palacios R, Batista AP, Albuquerque CSN, Patiño EG, Santos JDP, Conde MTRP, et al. Efficacy and safety of a COVID-19 inactivated vaccine in healthcare professionals in Brazil: The PROFISCOV study. EuropePMC (2021). doi: 10.2139/ssrn.3822780
48. Kremsner PG, Ahuad Guerrero RA, Arana-Arri E, Aroca Martinez GJ, Bonten M, Chandler R, et al. Efficacy and safety of the CVnCoV SARS-CoV-2 mRNA vaccine candidate in ten countries in Europe and Latin America (HERALD): a randomised, observer-blinded, placebo-controlled, phase 2b/3 trial. Lancet Infect Dis (2022) 22:329–40. doi: 10.1016/S1473-3099(21)00677-0
49. Walter EB, Talaat KR, Sabharwal C, Gurtman A, Lockhart S, Paulsen GC, et al. Evaluation of the BNT162b2 covid-19 vaccine in children 5 to 11 years of age. N Engl J Med (2022) 386:35–46. doi: 10.1056/NEJMoa2116298
50. Voysey M, Clemens SAC, Madhi SA, Weckx LY, Folegatti PM, Aley PK, et al. Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: an interim analysis of four randomised controlled trials in Brazil, south Africa, and the UK. Lancet (2021) 397:99–111. doi: 10.1016/S0140-6736(20)32661-1
51. US FDA. BNT162b2 [Comirnaty (COVID-19 vaccine, mRNA)] evaluation of a booster dose (third dose) vaccines and related biological products advisory committee briefing document. US Food and Drug Administration (2022). Available at: https://www.fda.gov/media/152161/download.
52. Dunkle LM, Kotloff KL, Gay CL, Áñez G, Adelglass JM, Barrat Hernández AQ, et al. Efficacy and safety of NVX-CoV2373 in adults in the united states and Mexico. N Engl J Med (2022) 386:531–43. doi: 10.1056/NEJMoa2116185
53. Halperin SA, Ye L, MacKinnon-Cameron D, Smith B, Cahn PE, Ruiz-Palacios GM, et al. Final efficacy analysis, interim safety analysis, and immunogenicity of a single dose of recombinant novel coronavirus vaccine (adenovirus type 5 vector) in adults 18 years and older: an international, multicentre, randomised, double-blinded, placebo-controlled phase 3 trial. Lancet (2022) 399:237–48. doi: 10.1016/S0140-6736(21)02753-7
54. Baden LR, El Sahly HM, Essink B, Follmann D, Neuzil KM, August A, et al. Phase 3 trial of mRNA-1273 during the delta-variant surge. N Engl J Med (2021) 385:2485–7. doi: 10.1056/NEJMc2115597
55. Bravo L, Smolenov I, Han HH, Li P, Hosain R, Rockhold F, et al. Efficacy of the adjuvanted subunit protein COVID-19 vaccine, SCB-2019: a phase 2 and 3 multicentre, double-blind, randomised, placebo-controlled trial. Lancet (2022) 399:461–72. doi: 10.1016/S0140-6736(22)00055-1
56. Sadoff J, Gray G, Vandebosch A, Cárdenas V, Shukarev G, Grinsztejn B, et al. Final analysis of efficacy and safety of single-dose Ad26.COV2.S. N Engl J Med (2022) 386:847–60. doi: 10.1056/NEJMoa2117608
57. Shinde V, Bhikha S, Hoosain Z, Archary M, Bhorat Q, Fairlie L, et al. Efficacy of NVX-CoV2373 covid-19 vaccine against the B.1.351 variant. N Engl J Med (2021) 384:1899–909. doi: 10.1056/NEJMoa2103055
58. McMenamin ME, Nealon J, Lin Y, Wong JY, Cheung JK, Lau EHY, et al. Vaccine effectiveness of two and three doses of BNT162b2 and CoronaVac against COVID-19 in Hong Kong. medRxiv (2022). doi: 10.1101/2022.03.22.22272769
59. Thomas SJ, Perez JL, Lockhart SP, Hariharan S, Kitchin N, Bailey R, et al. Efficacy and safety of the BNT162b2 mRNA COVID-19 vaccine in participants with a history of cancer: subgroup analysis of a global phase 3 randomized clinical trial. Vaccine (2022) 40:1483–92. doi: 10.1016/j.vaccine.2021.12.046
60. Klein NP, Stockwell MS, Demarco M, Gaglani M, Kharbanda AB, Irving SA, et al. Effectiveness of COVID-19 pfizer-BioNTech BNT162b2 mRNA vaccination in preventing COVID-19-Associated emergency department and urgent care encounters and hospitalizations among nonimmunocompromised children and adolescents aged 5-17 years - VISION network, 10 states, April 2021-January 2022. MMWR Morb Mortal Wkly Rep (2022) 71:352–8. doi: 10.15585/mmwr.mm7109e3
61. Thiruvengadam R, Awasthi A, Medigeshi G, Bhattacharya S, Mani S, Sivasubbu S, et al. Effectiveness of ChAdOx1 nCoV-19 vaccine against SARS-CoV-2 infection during the delta (B.1.617.2) variant surge in India: a test-negative, case-control study and a mechanistic study of post-vaccination immune responses. Lancet Infect Dis (2022) 22:473–82. doi: 10.1016/S1473-3099(21)00680-0
62. Collie S, Champion J, Moultrie H, Bekker LG, Gray G. Effectiveness of BNT162b2 vaccine against omicron variant in south Africa. N Engl J Med (2022) 386:494–6. doi: 10.1056/NEJMc2119270
63. Tang P, Hasan MR, Chemaitelly H, Yassine HM, Benslimane FM, Al Khatib HA, et al. BNT162b2 and mRNA-1273 COVID-19 vaccine effectiveness against the SARS-CoV-2 delta variant in Qatar. Nat Med (2021) 27:2136–43. doi: 10.1038/s41591-021-01583-4
64. Li XN, Huang Y, Wang W, Jing QL, Zhang CH, Qin PZ, et al. Effectiveness of inactivated SARS-CoV-2 vaccines against the delta variant infection in guangzhou: a test-negative case-control real-world study. Emerg Microbes Infect (2021) 10:1751–9. doi: 10.1080/22221751.2021.1969291
65. Hansen CH, Schelde AB, Moustsen-Helm IR, Emborg HD, Krause TG, Mølbak K, et al. Vaccine effectiveness against SARS-CoV-2 infection with the omicron or delta variants following a two-dose or booster BNT162b2 or mRNA-1273 vaccination series: a Danish cohort study. medRxiv (2021). doi: 10.1101/2021.12.20.21267966
66. Lopez Bernal J, Andrews N, Gower C, Gallagher E, Simmons R, Thelwall S, et al. Effectiveness of covid-19 vaccines against the B.1.617.2 (Delta) variant. N Engl J Med (2021) 385:585–94. doi: 10.1056/NEJMoa2108891
67. Bruxvoort KJ, Sy LS, Qian L, Ackerson BK, Luo Y, Lee GS, et al. Effectiveness of mRNA-1273 against delta, mu, and other emerging variants of SARS-CoV-2: test negative case-control study. Bmj (2021) 375:e068848. doi: 10.1136/bmj-2021-068848
68. Dorabawila V, Hoefer D, Bauer UE, Bassett MT, Lutterloh E, Rosenberg ES, et al. Effectiveness of the BNT162b2 vaccine among children 5-11 and 12-17 years in new York after the emergence of the omicron variant. MedRxiv (2022). doi: 10.1101/2022.02.25.22271454
69. Chin ET, Leidner D, Zhang Y, Long E, Prince L, Li Y, et al. Effectiveness of the mRNA-1273 vaccine during a SARS-CoV-2 delta outbreak in a prison. N Engl J Med (2021) 385:2300–1. doi: 10.1056/NEJMc2114089
70. Norddahl GL, Melsted P, Gunnarsdottir K, Halldorsson GH, Olafsdottir TA, Gylfason A, et al. Effect of booster vaccination against delta and omicron variants in Iceland. medRxiv (2022). doi: 10.1101/2022.02.26.22271509
71. Lauring AS, Tenforde MW, Chappell JD, Gaglani M, Ginde AA, McNeal T, et al. Clinical severity of, and effectiveness of mRNA vaccines against, covid-19 from omicron, delta, and alpha SARS-CoV-2 variants in the united states: prospective observational study. BMJ (2022) 376:e069761. doi: 10.1136/bmj-2021-069761
72. Bar-On YM, Goldberg Y, Mandel M, Bodenheimer O, Amir O, Freedman L, et al. Protection by 4th dose of BNT162b2 against omicron in Israel. medRxiv (2022). doi: 10.1101/2022.02.01.22270232
73. Nasreen S, Chung H, He S, Brown KA, Gubbay JB, Buchan SA, et al. Effectiveness of COVID-19 vaccines against symptomatic SARS-CoV-2 infection and severe outcomes with variants of concern in Ontario. Nat Microbiol (2022) 7:379–85. doi: 10.1038/s41564-021-01053-0
74. Andeweg SP, de Gier B, Eggink D, van den Ende C, van Maarseveen N, Ali L, et al. Protection of COVID-19 vaccination and previous infection against omicron BA.1 and delta SARS-CoV-2 infections, the Netherlands, 22 November 2021- 19 January 2022. medRxiv (2022). doi: 10.1101/2022.02.06.22270457
75. Gray GE, Collie S, Garrett N, Goga A, Champion J, Zylstra M, et al. Vaccine effectiveness against hospital admission in south African health care workers who received a homologous booster of Ad26.COV2 during an omicron COVID19 wave: Preliminary results of the sisonke 2 study. medRxiv (2021). doi: 10.1101/2021.12.28.21268436
76. Nunes MC, Sibanda S, Baillie VL, Kwatra G, Aguas R, Madhi SA, et al. SARS-CoV-2 omicron symptomatic infections in previously infected or vaccinated south African healthcare workers. medRxiv (2022). doi: 10.1101/2022.02.04.22270480
77. Fabiani M, Puopolo M, Morciano C, Spuri M, Spila Alegiani S, Filia A, et al. Effectiveness of mRNA vaccines and waning of protection against SARS-CoV-2 infection and severe covid-19 during predominant circulation of the delta variant in Italy: retrospective cohort study. BMJ (2022) 376:e069052. doi: 10.1136/bmj-2021-069052
78. Fowlkes A, Gaglani M, Groover K, Thiese MS, Tyner H, Ellingson K, et al. Effectiveness of COVID-19 vaccines in preventing SARS-CoV-2 infection among frontline workers before and during B.1.617.2 (Delta) variant predominance - eight U.S. locations, December 2020-august 2021. MMWR Morb Mortal Wkly Rep (2021) 70:1167–9. doi: 10.15585/mmwr.mm7034e4
79. Tartof SY, Slezak JM, Fischer H, Hong V, Ackerson BK, Ranasinghe ON, et al. Effectiveness of mRNA BNT162b2 COVID-19 vaccine up to 6 months in a large integrated health system in the USA: a retrospective cohort study. Lancet (2021) 398:1407–16. doi: 10.1016/S0140-6736(21)02183-8
80. Sritipsukho P, Khawcharoenporn T, Siribumrungwong B, Damronglerd P, Suwantarat N, Satdhabudha A, et al. Comparing real-life effectiveness of various COVID-19 vaccine regimens during the delta variant-dominant pandemic: A test-negative case-control study. Emerg Microbes Infect (2022) 11:585–92. doi: 10.1080/22221751.2022.2037398
81. Sheikh A, McMenamin J, Taylor B, Robertson C, Public Health Scotland and the EAVE II Collaborators. SARS-CoV-2 delta VOC in Scotland: Demographics, risk of hospital admission, and vaccine effectiveness. Lancet (2021) 397:2461–2. doi: 10.1016/S0140-6736(21)01358-1
82. Kang M, Yi Y, Li Y, Sun LM, Deng AP, Hu T, et al. Effectiveness of inactivated COVID-19 vaccines against illness caused by the B.1.617.2 (Delta) variant during an outbreak in guangdong, China: A cohort study. Ann Intern Med (2022) 175:533–40. doi: 10.7326/M21-3509
83. Seppälä E, Veneti L, Starrfelt J, Danielsen AS, Bragstad K, Hungnes O, et al. Vaccine effectiveness against infection with the delta (B.1.617.2) variant, Norway, April to august 2021. Euro Surveill (2022) 26:2100793. doi: 10.2807/1560-7917.ES.2021.26.35.2100793
84. Pouwels KB, Pritchard E, Matthews PC, Stoesser N, Eyre DW, Vihta KD, et al. Effect of delta variant on viral burden and vaccine effectiveness against new SARS-CoV-2 infections in the UK. Nat Med (2021) 27:2127–35. doi: 10.1038/s41591-021-01548-7
85. Nanduri S, Pilishvili T, Derado G, Soe MM, Dollard P, Wu H, et al. Effectiveness of pfizer-BioNTech and moderna vaccines in preventing SARS-CoV-2 infection among nursing home residents before and during widespread circulation of the SARS-CoV-2 B.1.617.2 (Delta) variant - national healthcare safety network, march 1-august 1, 2021. MMWR Morb Mortal Wkly Rep (2021) 70:1163–6. doi: 10.15585/mmwr.mm7034e3
86. Spitzer A, Angel Y, Marudi O, Zeltser D, Saiag E, Goldshmidt H, et al. Association of a third dose of BNT162b2 vaccine with incidence of SARS-CoV-2 infection among health care workers in Israel. Jama (2022) 327:341–9. doi: 10.1001/jama.2021.23641
87. Thompson MG, Natarajan K, Irving SA, Rowley EA, Griggs EP, Gaglani M, et al. Effectiveness of a third dose of mRNA vaccines against COVID-19-Associated emergency department and urgent care encounters and hospitalizations among adults during periods of delta and omicron variant predominance - VISION network, 10 states, august 2021-January 2022. MMWR Morb Mortal Wkly Rep (2022) 71:139–45. doi: 10.15585/mmwr.mm7104e3
88. Saciuk Y, Kertes J, Shamir Stein N, Ekka Zohar A. Effectiveness of a third dose of BNT162b2 mRNA vaccine. J Infect Dis (2022) 225:30–3. doi: 10.1093/infdis/jiab556
89. Barda N, Dagan N, Cohen C, Hernán MA, Lipsitch M, Kohane IS, et al. Effectiveness of a third dose of the BNT162b2 mRNA COVID-19 vaccine for preventing severe outcomes in Israel: an observational study. Lancet (2021) 398:2093–100. doi: 10.1016/S0140-6736(21)02249-2
90. Nordström P, Ballin M, Nordström A. Effectiveness of heterologous ChAdOx1 nCoV-19 and mRNA prime-boost vaccination against symptomatic covid-19 infection in Sweden: A nationwide cohort study. Lancet Reg Health Eur (2021) 11:100249. doi: 10.1016/j.lanepe.2021.100249
91. Tenforde MW, Patel MM, Gaglani M, Ginde AA, Douin DJ, Talbot HK, et al. Effectiveness of a third dose of pfizer-BioNTech and moderna vaccines in preventing COVID-19 hospitalization among immunocompetent and immunocompromised adults - united states, august-December 2021. MMWR Morb Mortal Wkly Rep (2022) 71:118–24. doi: 10.15585/mmwr.mm7104a2
92. Tan SHX, Pung R, Wang LF, Lye DC, Ong B, Cook AR, et al. Association of homologous and heterologous vaccine boosters with COVID-19 incidence and severity in Singapore. JAMA (2022) 327:1181–2. doi: 10.1001/jama.2022.1922
93. Spensley K, Gleeson S, Martin P, Thomson T, Clarke CL, Pickard G, et al. Comparison of vaccine effectiveness against the omicron (B.1.1.529) variant in patients receiving haemodialysis. medRxiv (2022). doi: 10.1101/2022.01.25.22269804
94. Tai CG, Maragakis LL, Connolly S, DiFiori J, Sims L, Adams E, et al. Booster protection against omicron infection in a highly vaccinated cohort. medRxiv (2022). doi: 10.1101/2022.02.24.22271347
95. Martínez-Baz I, Trobajo-Sanmartín C, Miqueleiz A, Guevara M, Fernández-Huerta M, Burgui C, et al. Product-specific COVID-19 vaccine effectiveness against secondary infection in close contacts, navarre, Spain, April to august 2021. Euro Surveill (2021) 26:2100894. doi: 10.2807/1560-7917.ES.2021.26.39.2100894
96. Poukka E, Baum U, Palmu AA, Lehtonen TO, Salo H, Nohynek H, et al. Cohort study of covid-19 vaccine effectiveness among healthcare workers in Finland, December 2020–October 2021. Vaccine (2022) 40:701–5. doi: 10.1016/j.vaccine.2021.12.032
97. Skowronski DM, Setayeshgar S, Febriani Y, Ouakki M, Zou M, Talbot D, et al. Two-dose SARS-CoV-2 vaccine effectiveness with mixed schedules and extended dosing intervals: test-negative design studies from British Columbia and Quebec, Canada. medRxiv (2021). doi: 10.1101/2021.10.26.21265397
98. Reis BY, Barda N, Leshchinsky M, Kepten E, Hernán MA, Lipsitch M, et al. Effectiveness of BNT162b2 vaccine against delta variant in adolescents. N Engl J Med (2021) 385:2101–3. doi: 10.1056/NEJMc2114290
99. Andrews N, Tessier E, Stowe J, Gower C, Kirsebom F, Simmons R, et al. Vaccine effectiveness and duration of protection of comirnaty, vaxzevria and spikevax against mild and severe COVID-19 in the UK. medRxiv (2021). doi: 10.1101/2021.09.15.21263583
100. Goldberg Y, Mandel M, Bar-On YM, Bodenheimer O, Freedman L, Haas EJ, et al. Waning immunity after the BNT162b2 vaccine in Israel. New Engl J Med (2021) 385:e85. doi: 10.1056/NEJMoa2114228
101. Kiss Z, Wittmann I, Polivka L, Surjan G, Surjan O, Barcza Z, et al. Nationwide effectiveness of first and second SARS-CoV2 booster vaccines during the delta and omicron pandemic waves in Hungary (HUN-VE 2 study). medRxiv (2022). doi: 10.1101/2022.03.27.22273000
102. Starrfelt J, Danielsen AS, Buanes EA, Juvet LK, Lyngstad TM, Roe GOI, et al. Age and product dependent vaccine effectiveness against SARS-CoV-2 infection and hospitalisation among adults in Norway: A national cohort study, July - November 2021. medRxiv (2022). doi: 10.1101/2022.03.29.22273086
103. Veneti L, Berild JD, Watle SV, Starrfelt J, Greve-Isdahl M, Langlete P, et al. Vaccine effectiveness with BNT162b2 (Comirnaty, pfizer-BioNTech) vaccine against reported SARS-CoV-2 delta and omicron infection among adolescents, Norway, august 2021 to January 2022. medRxiv (2022). doi: 10.1101/2022.03.24.22272854
104. Kirsebom FCM, Andrews N, Stowe J, Toffa S, Sachdeva R, Gallagher E, et al. COVID-19 vaccine effectiveness against the omicron BA.2 variant in England. medRxiv (2022). doi: 10.1101/2022.03.22.22272691
105. Mizrahi B, Lotan R, Kalkstein N, Peretz A, Perez G, Ben-Tov A, et al. Correlation of SARS-CoV-2-breakthrough infections to time-from-vaccine. Nat Commun (2021) 12:6379. doi: 10.1038/s41467-021-26672-3
106. Israel A, Merzon E, Schäffer AA, Shenhar Y, Green I, Golan-Cohen A, et al. Elapsed time since BNT162b2 vaccine and risk of SARS-CoV-2 infection: test negative design study. BMJ (2021) 375:e067873. doi: 10.1136/bmj-2021-067873
107. Rosenberg ES, Dorabawila V, Easton D, Bauer UE, Kumar J, Hoen R, et al. Covid-19 vaccine effectiveness in new York state. N Engl J Med (2022) 386:116–27. doi: 10.1056/NEJMoa2116063
108. Baden LR, El Sahly HM, Essink B, Kotlof K, Frey S, Novak R, et al. Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine. N Engl J Med (2021) 384:403–16. doi: 10.1056/NEJMoa2035389
109. Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Safety and efficacy of the BNT162b2 mRNA covid-19 vaccine. N Engl J Med (2020) 383(27):2603–15. doi: 10.1056/NEJMoa2034577
110. Cohen MJ, Oster Y, Moses AE, Spitzer A, Benenson S, the Israeli-hospitals 4th vaccine Working Group. Effectiveness of the BNT162b vaccine fourth dose in reducing SARS-CoV-2 infection among healthcare workers in Israel, a multi-center cohort study. medRxiv (2022). doi: 10.1101/2022.04.11.22273327
111. Fowlkes AL, Yoon SK, Lutrick K, Gwynn L, Burns J, Grant L, et al. Effectiveness of 2-dose BNT162b2 (Pfizer BioNTech) mRNA vaccine in preventing SARS-CoV-2 infection among children aged 5-11 years and adolescents aged 12-15 years - PROTECT cohort, July 2021-February 2022. MMWR Morb Mortal Wkly Rep (2022) 71(11):422–8. doi: 10.15585/mmwr.mm7111e1
112. Buchan SA, Nguyen L, Wilson SE, Kitchen SA, Kwong JC. Vaccine effectiveness of BNT162b2 against omicron and delta outcomes in adolescents. medRxiv (2022). doi: 10.1101/2022.04.07.22273319
113. Chemaitelly H, Ayoub HH, AlMukdad S, Tang P, Hasan MR, Yassine HM, et al. Duration of protection of BNT162b2 and mRNA-1273 COVID-19 vaccines against symptomatic SARS-CoV-2 omicron infection in Qatar. medRxiv (2022). doi: 10.1101/2022.02.07.22270568
114. Ranzani OT, Hitchings MDT, de Melo RL, de França GVA, de Fátima RC, Fernandes, et al. Effectiveness of an inactivated covid-19 vaccine with homologous and heterologous boosters against the omicron (B.1.1.529) variant. medRxiv (2022). doi: 10.1101/2022.03.30.22273193
115. Baum U, Poukka E, Leino T, Kilpi T, Nohynek H, Palmu AA. High vaccine effectiveness against severe covid-19 in the elderly in Finland before and after the emergence of omicron. medRxiv (2022). doi: 10.1101/2022.03.11.22272140
116. Tartof SY, Slezak JM, Puzniak L, Hong V, Xie F, Ackerson BK, et al. Durability of BNT162b2 vaccine against hospital and emergency department admissions due to the omicron and delta variants in a large health system in the USA: A test-negative case-control study. Lancet Respir Med (2022) 10:689-99. doi: 10.1016/S2213-2600(22)00101-1
117. Stowe J, Andrews N, Kirsebom F, Ramsay M, Bernal JL. Effectiveness of COVID-19 vaccines against omicron and delta hospitalisation: Test negative case-control study. medRxiv (2022). doi: 10.1101/2022.04.01.22273281
118. Patalon T, Saciuk Y, Peretz A, Perez G, Lurie Y, Maor Y, et al. Waning effectiveness of the third dose of the BNT162b2 mRNA COVID-19 vaccine. medRxiv (2022). doi: 10.1101/2022.02.25.22271494
119. Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ (2016) 355:i4919. doi: 10.1136/bmj.i4919
120. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ (2019) 366:l4898. doi: 10.1136/bmj.l4898
121. WHO. An international randomised trial of candidate vaccines against COVID-19. World Health Organization (2021). Available at: https://www.who.int/publications/i/item/an-internationalrandomised-trial-of-candidate-vaccines-against-covid-19.
122. Chan ISF, Bohidar NR. Exact power and sample size for vaccine efficacy studies. Commun Stat Theory Methods (1998) 27:1305–22. doi: 10.1080/03610929808832160
123. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials (1986) 7:177–88. doi: 10.1016/0197-2456(86)90046-2
124. Breslow NE, Day NE. Statistical methods in cancer research. volume II–the design and analysis of cohort studies. IARC Sci Publ (1987) 87:1–406.
125. Kleinbaum DG, Kupper LL, Morgenstern H. Epidemiologic research: principles and quantitative methods. Belmont: Lifetime Learning Publications (1982).
126. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics (1994) 50:1088–101. doi: 10.2307/2533446
127. Egger M, Smith DG, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. Br Med J (1997) 315:629–34. doi: 10.1136/bmj.315.7109.629
128. Zeng G, Wu QH, Pan HX, Li MJ, Yang J, Wang L, et al. Immunogenicity and safety of a third dose of CoronaVac, and immune persistence of a two-dose schedule, in healthy adults: interim results from two single-centre, double-blind, randomised, placebo-controlled phase 2 clinical trials. Lancet Infect Dis (2021) 22:483–95. doi: 10.1016/S1473-3099(21)00681-2
129. Munro APS, Janani L, Cornelius V, Aley PK, Babbage G, Baxter D, et al. Safety and immunogenicity of seven COVID-19 vaccines as a third dose (booster) following two doses of ChAdOx1 nCov-19 or BNT162b2 in the UK (COV-BOOST): a blinded, multicentre, randomised, controlled, phase 2 trial. Lancet (2021) 398:2258–76. doi: 10.1016/S0140-6736(21)02717-3
130. Garrett N, Tapley A, Andriesen J, Seocharan I, Fisher LH, Bunts L, et al. High rate of asymptomatic carriage associated with variant strain omicron. medRxiv (2022). doi: 10.1101/2021.12.20.21268130
131. Xiong D, Zhao X, Luo S, Cong Y, Zhang JZH, Duan L. Immune escape mechanisms of SARS-CoV-2 delta and omicron variants against two monoclonal antibodies that received emergency use authorization. J Phys Chem Lett (2022) 27:6064–73. doi: 10.1021/acs.jpclett.2c00912
132. Cele S, Jackson L, Khoury DS, Khan K, Moyo-Gwete T, Tegally H, et al. SARS-CoV-2 omicron has extensive but incomplete escape of pfizer BNT162b2 elicited neutralization and requires ACE2 for infection. medRxiv (2021). doi: 10.1101/2021.12.08.21267417v3
133. Wilhelm A, Widera M, Grikscheit K, Toptan T, Schenk B, Pallas C, et al. Reduced neutralization of SARS- CoV-2 omicron variant by vaccine sera and monoclonal antibodies medRxiv (2021). doi: 10.1101/2021.12.07.21267432v4
134. Dejnirattisai W, Huo J, Zhou D, Zahradník J, Supasa P, Liu C, et al. Omicron-B.1.1.529 leads to widespread escape from neutralizing antibody responses. Cell (2022)185:467-84.e15. doi: 10.1016/j.cell.2021.12.046
135. Costa Clemens SA, Weckx L, Clemens R, Almeida Mendes AV, Ramos Souza A, Silveira MBV, et al. Heterologous versus homologous COVID-19 booster vaccination in previous recipients of two doses of CoronaVac COVID-19 vaccine in Brazil (RHH-001): a phase 4, non-inferiority, single blind, randomised study. Lancet (2022) 399(10324):521–9. doi: 10.1016/S0140-6736(22)00094-0
136. Cheng SMS, Mok CKP, Leung YWY, Ng SS, Chan KCK, Ko FW, et al. Neutralizing antibodies against the SARS-CoV-2 omicron variant BA.1 following homologous and heterologous CoronaVac or BNT162b2 vaccination. Nat Med (2022) 28(3):486–9. doi: 10.1038/s41591-022-01704-7
137. Lu L, Mok BW-Y, Chen L-L, Chan JM, Tsang OT, Lam BH, et al. Neutralization of severe acute respiratory syndrome coronavirus 2 omicron variant by sera from BNT162b2 or CoronaVac vaccine recipients. Clin Infect Dis (2021), ciab1041. doi: 10.1093/cid/ciab1041
138. Pérez-Then E, Lucas C, Monteiro VS, Miric M, Brache V Cochon L, et al. Neutralizing antibodies against the SARS-CoV-2 delta and omicron variants following heterologous CoronaVac plus BNT162b2 booster vaccination. Nat Med (2022) 28(3):481–5. doi: 10.1038/s41591-022-01705-6
139. Lipsitch M, Swerdlow DL, Finelli L. Defining the epidemiology of Covid-19–studies needed. N Engl J Med (2020) 382:1194–6. doi: 10.1056/NEJMp2002125
140. Sah P, Fitzpatrick MC, Zimmer CF, Abdollahi E, Juden-Kelly L, Moghadas SM, et al. Asymptomatic SARS-CoV-2 infection: A systematic review and meta-analysis. Proc Natl Acad Sci USA (2021) 118:e2109229118. doi: 10.1073/pnas.2109229118
Keywords: COVID-19, vaccine, efficacy, effectiveness, breakthrough infection
Citation: He X, Su J, Ma Y, Zhang W and Tang S (2022) A comprehensive analysis of the efficacy and effectiveness of COVID-19 vaccines. Front. Immunol. 13:945930. doi: 10.3389/fimmu.2022.945930
Received: 17 May 2022; Accepted: 08 August 2022;
Published: 26 August 2022.
Edited by:
Alagarraju Muthukumar, University of Texas Southwestern Medical Center, United StatesReviewed by:
Maryna Skok, Palladin Institute of Biochemistry (NAS Ukraine), UkraineElizabeth Clarke, University of New Mexico, United States
Copyright © 2022 He, Su, Ma, Zhang and Tang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Shixing Tang, dGFtZ3NoaXhpbmdAc211LmVkdS5jbg==