- 1Department of Immunology and Rheumatology, Instituto Nacional de Ciencias Médicas y Nutrición Salvador Zubirán, Mexico City, Mexico
- 2Operative Solutions, Carlos Slim Foundation, Mexico City, Mexico
- 3Sección de Estudios de Posgrado e Investigación, Escuela Superior de Medicina-Instituto Politécnico Nacional (IPN), Mexico City, Mexico
- 4Laboratorio de Inmunoquimica 1, Posgrado en Ciencias Químicobiológicas, Escuela Nacional de Ciencias Biológicas, Instituto Politécnico Nacional, Mexico City, Mexico
- 5Universidad Nacional Autónoma de México, Facultad de Medicina, Mexico City, Mexico
- 6Internal Medicine Department, Instituto Nacional de Ciencias Médicas y Nutrición Salvador Zubirán, Mexico City, Mexico
- 7Red de Apoyo a la Investigación, Universidad Nacional Autónoma de México e Instituto Nacional de Ciencias Médicas y Nutrición Salvador Zubirán, Mexico City, Mexico
- 8Clinical Research, London School of Hygiene and Tropical Medicine, London, United Kingdom
- 9Temporary COVID-19 Hospital, Hipódromo de las Américas, Mexico City, Mexico
- 10Division of Health Sciences, Juárez Autonomous University of Tabasco, Tabasco, Mexico
- 11Centro Universitario de Ciencias de la Salud (CUCS), Universidad de Guadalajara, Guadalajara, Mexico
Background: Until now, most of the research addressing long-term humoral responses in coronavirus disease 2019 (COVID-19) had only evaluated the serum titers of anti-severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) IgGs, without the assessment of the baseline antiviral clinical and immune profile, which is the aim of this study and may be the key factor leading to a broad and sustained antibody response.
Methods: We included 103 patients with COVID-19. When the patients sought medical attention (baseline), a blood sample was drawn to perform immunophenotype of lymphocytes by flow cytometry. The patients were assessed 15 days after baseline and then every month until the third month, followed by a last visit 6 months after recruitment. We evaluated the anti-SARS-COV-2 IgG at all time points, and the serum levels of cytokines, chemokines, anti-cellular (AC) antibodies and neutrophil extracellular traps were also assessed during the follow-up. The primary outcome of the study was the presence of a sustained immune humoral response, defined as an anti-SARS-CoV-2 IgG titer >4.99 arbitrary units/mL in at least two consecutive measures. We used generalized lineal models to assess the features associated with this outcome and to assess the effect of the changes in the cytokines and chemokines throughout time on the development of a sustained humoral immune response.
Results: At baseline the features associated to a sustained immune humoral response were the diagnosis of critical disease, absolute number of lymphocytes, serum IP-10, IL-4, IL-2, regulatory T cells, CD8+ T cells, and positive AC antibodies. Critical illness and the positivity of AC antibodies were associated with a sustained humoral immune response after 3 months, whilst critical illness and serum IL-13 were the explanatory variables after 6 months.
Conclusion: A sustained immune humoral response is strongly related to critical COVID-19, which is characterized by the presence of AC antibodies, quantitative abnormalities in the T cell compartment, and the serum cytokines and chemokines during acute infection and throughout time.
Introduction
Severe acute respiratory syndrome (SARS-CoV-2) has affected 78 million individuals and is responsible for over 1.7 million deaths to date (1). After its emergence, initial scientific efforts were focused on the understanding of the acute antiviral immune response (2), but currently, the long-term cellular and humoral immune responses against SARS-CoV-2 have become relevant (3). In this regard, there is an increased interest in the detection of a sustained humoral immune response as a marker of anti-SARS-CoV-2 vaccination, as well as a key risk factor for re-infection (3, 4), and for the development of post-coronavirus disease 2019 (COVID-19) syndrome (5).
Nearly all patients with COVID-19 develop a humoral antiviral immune response (6). The magnitude of the humoral immune response is strongly correlated with the disease severity (7) and the duration of active infection (8), highlighting the importance of the initial antiviral response in the development of sustained humoral immunity. A prolonged and severe COVID-19 is the clinical consequence of a disturbed adaptive and innate antiviral immune response. In this regard, patients with COVID-19 are characterized by the expression of PD1 and CD57 in the T cell compartment, which has been related to an enhanced production of TNF, CD107a, IFN-γ, IL-2 and IL-17 (9). Many pro-inflammatory cytokines and chemokines are chemoattractant and activator of neutrophils, promoting an exuberant myeloid immune response, which is another typical feature of severe COVID-19 (10). After activation, neutrophils secrete extracellular traps (NETs), which are key drivers of COVID-19 severity, by the promotion of immunothrombosis and the cytokine storm (11). Regarding the B cell compartment, during acute SARS-CoV-2 infection, there is evidence of an extrafollicular B cell response, resulting in non-class-switched memory B cell development. Also, during acute COVID-19, some B cells enter the germinal center and differentiate into class-switched memory B lymphocytes and plasma cells (12). Although patients with severe COVID-19 have a potent inflammatory response, it is usually ineffective for viral clearance, which may lead to higher viral antigen loads with epitope spreading, resulting in a broad and robust anti-SARS-CoV-2 humoral response (12). Compared with uninfected controls, COVID-19 patients exhibit dramatic increases in autoantibody reactivity, including a high prevalence of autoantibodies against immunomodulatory proteins, such as cytokines, chemokines, complement components, and cell surface proteins, altogether leading to impaired immune function (13).
Currently, most of the research about the long-term humoral immune response in COVID-19 has been focused on the assessment of the serum titers of anti-SARS-CoV-2 IgG throughout time (14), without any insight into the dysregulated immune response at baseline, which may be the key driver of a sustained humoral immunity. In this study we aimed to explore the previously unrecognized role of the clinical and immunological profile of patients with COVID-19 during the acute infection as drivers of the development of a sustained humoral immune response. Our data contributes to the characterization of the clinical and immunological features leading to a broad and persistent antibody response in patients with COVID-19.
Methods
An observational cohort study was conducted in 103 patients with COVID-19 diagnosis, which was confirmed by a positive polymerase chain reaction (PCR) test from a nasopharyngeal swab. The patients were seen at the Temporary COVID-19 Hospital, which served as the main reference center for the care of patients with COVID-19 in Mexico City. Patients were recruited between August 2020 and February 2021 and were followed up until August 2021. The Institutional Ethics and Research committees from the Temporary COVID-19 Hospital approved the study protocol (Ref. 3341). All participants provided written informed consent to participate in the study at enrollment. The present research study was in accordance with the ethical principles outlined in the Declaration of Helsinki.
When the patients sought medical attention, which corresponded to the baseline evaluation, clinical data and laboratory parameters were obtained. According to their disease severity, patients were classified into the following categories: mild/moderate (patients with or without pneumonia who also had fever and upper respiratory infection symptoms); severe (patients presenting respiratory failure with ≥30 breaths per minute, a resting oxygen saturation ≤93% or PaO2/FiO2 ≤300); or critical (patients in a state of shock, multiple organ failure or those requiring invasive mechanical ventilation) (15). The exclusion criteria were the diagnosis of cancer, chronic infections, autoimmune diseases, pregnancy, and puerperium.
A blood sample was drawn to isolate peripheral blood mononuclear cells (PBMCs) at baseline. Patients were followed up two weeks after the onset of symptoms, then every month until the third month, and at 6 months post recruitment. Serum samples were collected in all patients at baseline and at all visits. Sera were stored at −80 °C until analyses. Immunophenotyping of T and B cell subsets was performed by multiparametric flow cytometry, and serum samples were analyzed for detection of anti-SARS-CoV-2 IgG antibodies, anti-cellular (AC) antibodies, chemokines/cytokines, and circulating neutrophil extracellular traps (NETs), as described in detail below. The primary outcome of the study was the development of a sustained humoral immune response, which was defined as the positivity of anti-SARS-CoV-2 IgG antibodies in at least two consecutive measurements. Positivity was defined as a titer higher than 4.99 arbitrary units (AU)/mL, as previously reported (16). We decided to use this cutoff point because this titer correlated with the neutralizing activity and can be widely used in many laboratories without access to the viral neutralizing assays (16). Samples processing was carried out in a blinded manner, that is, by investigators who were unaware of the study outcome. There were no missing serum samples from any patient at any timepoint and all subjects completed follow-up.
Immunophenotyping
PBMCs were purified by density gradient from peripheral blood using Ficoll-Paque (GE Healthcare Life Sciences, Chicago, IL, USA) and centrifugation. After isolation, cells were washed twice with phosphate-buffered saline (PBS). Viability was then assessed by Zombie Aqua staining (Biolegend, San Diego, CA, USA). Then, PBS was used for washing the cells, which were incubated with the FcX blocker (Biolegend) for 30 min at room temperature using several combinations of the following fluorochrome-coupled antibodies: CD4-Alexa Fluor 488, CD25-BV421, CD45RA-PE/Cy7, CD8-PE/Dazzle-594, CD45RO-PerCP, CD62L-PE, CCR7-Alexa Fluor 700, CD57-BV785, CD21-APC/Fire-750, CD24-PerCP, CD73-BV711, CD11c-PE/Dazzle-594, IgM-PE, CD27-APC, CD38-Alexa Fluor 488, CD3-APC/Fire-750, IgD-Alexa Fluor 700, PD-1-APC, CD127-BV650, CD19-Pacific Blue, and CD138-BV605 (all from Biolegend). For the assessment of Th and Tc cell subsets, phorbol 12-myristate 13-acetate (50 ng/mL), ionomycin (1µg/mL), and monensin (4 µL/6 mL) were used for stimulating the PBMCs for 5 h at 37°C. The fluorochrome-coupled antibodies (IFN-γ-APC, IL-4-PE, and IL-17-BV421 [Biolegend]) were used for the detection of intracytoplasmic cytokines. According to the manufacturer’s instructions, fixation and permeabilization were performed using the Cytofix/Cytoperm fixation/permeabilization kit (BD Biosciences, Franklin Lakes, NJ, USA). A 4-laser LSR Fortessa flow cytometer (BD Biosciences) was used for sample acquisition.
Characterization of the following lymphocyte subsets was performed: CD4+ T cells (CD3+CD4+), naïve T cells (CD3+CD4+ or CD8+CD45RA+CD45RO-), CD8+ T cells (CD3+CD8+), memory T cells (CD3+CD4+ or CD8+CD45RA-CD45RO+), effector memory T cells (CD3+CD4+ or CD8+CD45RA-CD45RO+CD62L-CCR7-), central memory T cells (CD3+CD4+ or CD8+CD45RA-CD45RO+CD62L+CCR7+), exhausted T cells (CD3+CD4+CD8+PD-1+/hi), senescent T cells (CD3+CD4+CD8+CD57+), regulatory T cells (CD4+CD25hiCD127lo/-) and anergic T cells (CD3+CD4+CD8+CD73+) as depicted in Supplementary Figure 1 and Supplementary Figure 2; Th1 (CD4+IFNγ+), Th2 (CD4+IL-4+), Th17 (CD4+IL-17+), Tc1 (CD8+IFNγ+), Tc2 (CD8+IL-4+) and Tc17 (CD8+IL-17+) as displayed in Supplementary Figure 3; total B cells (CD3-CD19+), CD21- transitional B cells (CD19+CD27-CD38hiCD24hiCD21-/lo), CD21+ transitional B cells (CD19+CD27-CD38hiCD24loCD21+), activated naïve B cells (CD19+CD27-IgD+CD38-CD24-CD11c+), resting naïve B cells (CD19+CD27-IgD+CD38-CD24-CD11c-), mature B cells (CD19+CD27-CD24-/lo), unswitched classical memory B cells (CD19+CD27+IgD+), plasmablasts (CD19+CD27hi CD38hi), switched classical memory B cells (CD19+CD27+IgD-), non-classical CD27-IgD- memory B cells (CD19+CD38-/loCD24+CD27-IgD-), and non-classical CD27-IgD+ memory B cells (CD19+CD38-/loCD24+CD27-IgD+) as depicted in Supplementary Figure 4.
PBMCs subset proportions at baseline were expressed as absolute numbers according to the number of lymphocytes in the complete blood count. The FlowJo v10.7 software (BD Biosciences) was used for the analyses.
Assessment of cytokine/chemokine profiles
At baseline, 3 and 6 months after recruitment, twenty-nine serum cytokines and chemokines were measured using the MILLIPLEX Multi-Analyte Profiling Human Cytokine/Chemokine Magnetic Bead Panel 29-plex kit (EMD Millipore, Darmstadt, Germany) and a 2-laser Bio-Plex 200 suspension array system coupled to a Bio-Plex Pro Wash Station (Bio-Rad, Hercules, CA, USA), following the manufacturer’s instructions. Bead-fluorescence intensity readings for all the samples and standards were converted to the corresponding analyte concentrations using the Bio-Plex Manager software v6·2 (Bio-Rad).
The following analytes were measured: IL-1α, IL-1β, IL-1RA, IL-2, IL-3, IL-4, IL-5, IL-6, IL-7, IL-8, IL-10, IL-12p40, IL-12p70, IL-13, IL-15, IL-17A, IFNα2, IFNγ, tumor necrosis factor-α (TNF-α), TNF-β, macrophage inflammatory protein-1α/CCL3, monocyte chemoattractant protein 1/C–C motif chemokine ligand (CCL) 2, macrophage inflammatory protein-1β/CCL4, IP-10/C-X-C motif chemokine ligand 10, granulocyte-macrophage colony-stimulating factor, eotaxin-1/CCL11, granulocyte colony-stimulating factor, epidermal growth factor, and vascular endothelial growth factor.
Assessment of circulating NETs
As previously described, serum NETs levels were assessed using a neutrophil elastase enzyme-linked immunosorbent assay (ELISA) (17) at baseline and 3 months after recruitment. Briefly, mouse anti-human neutrophil elastase (Calbiochem, Darmstadt, Germany) was diluted 1:2000 in coating buffer from the cell death detection ELISA kit (Roche, Basil, Switzerland) and incubated in high-binding 96-well plates overnight at 4 °C to generate mouse anti-human neutrophil elastase-coated plates. Plates were washed three times with PBS/Tween20 and then blocked with 1% bovine serum albumin (BSA) in PBS for 6 h at room temperature. Afterward, serum samples (1:10 in 1% BSA) were added to the plates and incubated overnight at 4 °C. Following three washes with PBS/Tween20 solution, the samples were incubated with anti-human DNA-peroxidase antibody (1:10 dilution in incubation buffer) from the cell death detection ELISA kit (Roche) for 1 h at room temperature. Next, the plates were washed five times with PBS/Tween20 before adding TMB substrate (Thermofisher Scientific, Waltham, MA, USA), followed by a stop solution. The plates were read at 450 nm, and the optic density index was calculated as previously described (17) in a Sunrise-RC/ST Evolyzer Plate Reader (Tecan Life Sciences, Männendorf, Switzerland).
Assessment of anti-cellular (AC) antibodies
At baseline 3 and 6 months after recruitment, AC/antinuclear IgG antibodies were detected by indirect immunofluorescence using the HEp-2 cell line as substrate and the NOVA Lite HEp-2 ANA kit, according to the manufacturer’s instructions (INOVA Diagnostics, San Diego, CA, USA). Serum samples were tested at a 1:40 dilution using a Bee Line System (HTZ, East Grinstead, West Sussex, UK). Three experts read data for all samples, and the results were discussed and registered (AutoCyte Image Titer software, Burlington, NC, USA).
Assessment of anti-SARS-CoV-2 IgG antibodies
According to the manufacturer’s instructions, anti-spike S1 domain antibodies were measured using an anti-SARS-CoV-2 ELISA IgG Kit (EUROIMMUN; Lübeck, Germany). The plates were processed using a DSX System (DYNEX Technologies, Chantilly, VA, USA). We calculated the cutoff value to be <0.51 AU at the 99th percentile using serum samples from our healthy donor bank that were collected from 2017 to 2018. Using this cutoff, we observed a sensitivity of 98.2%, a specificity of 98.9%, and an area under the curve (AUC) of 0.99. The cutoff value suggested by the manufacturer is ≥1.1 AU.
Statistical analysis
We reported quantitative variables as medians and interquartile range (IQR). Medians were compared with Kruskal–Wallis and Wilcoxon tests. An iterative imputation method based on random forest was performed for missing data. For the assessment of the clinical and immunological features associated with the development of a sustained humoral immune response, we performed a univariate generalized linear model with binomial error using the variables at baseline, 3, and 6 months after recruitment. In this assessment, we performed an analysis for each one of the time-points. Since the most important factor for the development of a sustained humoral immune response is the COVID-19 severity, the model included this feature as a two-level fixed factor (critical vs non-critical). We included the significant variables in a multivariate generalized linear model and performed stepwise selection using minimum Akaike information criteria. Odds ratios (OR) with 95% confidence intervals (95% CI) were calculated. Finally, to address the effect of the changes of the serum levels of cytokines and chemokines throughout the follow-up in the development of a sustained humoral immune response, we performed a univariate generalized linear mixed model with binomial error. Post-hoc comparisons were performed for significant variables at 6 months after recruitment in the following group of patients: critical COVID-19 with and without sustained humoral immune response and non-critical COVID-19 with and without this primary outcome. Statistical analysis was performed using the R project software (R Core Team (2021, R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL http://www.R-project.org/).
Results
Of the 103 patients in this study, 56 (54.3%) were women. The cohort’s median (IQR) of age was 50.0 (41.5–58.0) years. The most frequent comorbidities were obesity, hypertension, and type 2 diabetes, which were reported in 48 (46.2%), 28 (26.9%), and 24 (23.1%) patients, respectively. At baseline, 46 (44.2%) patients had mild/moderate disease, 31 (29.8%) had severe disease, and 27 (25.9%) had critical disease. The baseline clinical and laboratory features of patients with COVID-19 according to disease severity are shown in Tables 1 and 2. Similar to previous COVID-19 cohorts, patients with critical disease were older and had a higher body mass index (Table 1). Likewise, patients with severe and critical COVID-19 had many markers of adverse prognosis including neutrophilia, lymphopenia, and increased D-dimer (Table 2).
Using our calculated cutoff value, 67 patients (65%) had positive anti-SARS-CoV-2 IgGs at baseline. Fifty-eight (56.3%) were positive for anti-SARS-CoV-2 antibodies at baseline using the cutoff value recommended by the manufacturer (≥1.1 AU). The positivity for anti-SARS-CoV-2 antibodies remained over 95% in the following time points regardless of the used cutoff point. Afterward, we aimed to evaluate the proportion of patients maintaining a virus-neutralizing humoral response as described in our primary outcome. Sixty-eight (66%) patients had a sustained humoral immune response, which was more frequent in subjects with critical disease in comparison to those with non-critical COVID-19 (88% vs 57%, respectively, P=0.004). In Figure 1 we show the titers and kinetics of the anti-SARS-CoV-2 IgG according to disease severity and the development of a sustained humoral immune response. Patients with critical COVID-19 and a sustained humoral response were characterized by a higher amount of anti-SARS-CoV-2 IgG, but the amount of anti-SARS-CoV-2 IgG at baseline was not different in patients with and without sustained humoral immunity.
Figure 1 Assessment of the anti-SARS-CoV-2 IgG throughout time in the cohort of patients from mild to critical COVID-19. (A) The titers of anti-SARS-CoV-2 IgG was higher at all timepoints in patients with critical COVID-19 (P<0.05). (B) Patients with a sustained humoral immune response had a higher amount of anti-SARS-CoV-2 IgG at all timepoints (P<0.05) but not at baseline (n.s.). Anti-SARS-CoV-2 IgG titers are expressed as medians with interquartile range and were compared with the Wilcoxon test. AU: arbitrary units; IgG: immunoglobin G; SARS-CoV-2: severe acute respiratory syndrome coronavirus 2. n.s: non-significant.
In Supplementary Table 1, we depict the comparison of the immunological features at baseline between patients who developed the primary outcome and those who did not. As shown in the Supplementary Table 1 and in accordance with their more frequent critical status and more pronounced lymphopenia, patients with sustained humoral immune response were characterized by a lower proportion of many CD4+ T cell subsets, CD8+ lymphocytes and B cell subtypes. The immunological features that were different between patients with and without a sustained humoral immune response at baseline and that achieve statistically significance are described in Figure 2.
Figure 2 Baseline differences in the immunological profile of patients with COVID-19 according to the development of a sustained immune humoral response. The absolute numbers of T and B cell subsets, the cytokines, chemokines and AC/ANA titers are expressed as medians and interquartile ranges and were compared with the Wilcoxon test.
In the Supplementary Tables 2, 3 we show the comparison of the variables 3 and 6 months after recruitment between patients who developed a sustained humoral immune response and those who did not. In Figure 3, we depict the variables that achieve a statistically significant difference between patients with and without a sustained humoral immune response during follow-up. Three months after recruitment, patients with a sustained humoral immune response had higher levels of IL-2, whilst at 6 months they had increased serum levels of MIP-1β, MCP-1, IL-3 and IL-12p40 (Figure 3).
Figure 3 Differential expression of serum cytokine and chemokines 3 and 6 months after recruitment of patients with COVID-19 according to the presence of a sustained immune humoral response. The serum levels of the cytokines and chemokines are expressed as medians and interquartile ranges and were compared with the Wilcoxon test.
Using the development of a sustained immune humoral response as an outcome variable, we performed a univariate analysis with the variables that were available at baseline, 3 and 6 months after recruitment. The results obtained from this analysis are depicted in the Supplementary Table 4. In the multivariate analysis, the features independently associated with a sustained humoral immune response at baseline were the following: critical disease (OR 58.823 [95% CI 4.480–1666.66], P<0.0001), absolute number of lymphocytes (cells/mm3) (OR 1.001 [95% CI 1.0001–1.002], P=0.025), serum IP-10 (pg/mL) (OR 1.001 [95% CI 1.0003–1.002], P<0.0001), IL-4 (pg/mL) (OR 0.997 [95% CI 0.995–0.999], P=0.001), IL-2 (pg/mL) (OR 1.358 [95% CI 1.010–3.553], P=0.038), absolute number of regulatory T cells (cells/mm3) (OR 0.913 [0.826–0.991], P=0.025), absolute number of CD8+ T cells (cells/mm3) (OR 0.996 [95% CI 0.993–0.999], P=0.038), and positive AC antibodies (OR 14.459 [95% CI 2.645–147.395], P<0.001).
Three months after recruitment, the features independently associated with a sustained humoral immune response were the diagnosis of critical disease (OR 6.944 [95% CI 2.008–35.714], P=0.001) and the positivity of AC antibodies (OR 10.975 [95% CI 1.855–192.629], P=0.005). The presence of critical COVID-19 (OR 6.666 [95% CI 1.886–34.481], P=0.002) and serum levels of IL-13 (pg/mL) OR 0.978 [95% CI 0.957-0.997], P=0.028) were the explanatory features of a sustained humoral immune response 6 months after recruitment. The effect of the explanatory variables at each timepoint on the possibility to develop a sustained immune humoral response is depicted in Figure 4. As shown in the graphs, patients with a higher possibility to develop a sustained humoral immune response (close to 1 or 100%) were those with critical disease, positive AC antibodies, higher amounts of IL-2, IP-10 and of total lymphocytes, and decreased IL-4, Tregs, CD8+ T cells, and IL-13.
Figure 4 Independent variables associated with the presence of a sustained immune humoral response at baseline (A–H), 3 (I, J) and 6 months (K, L) after COVID-19 onset. The proportion of patients with a sustained immune humoral response was defined as those maintaining anti-SARS-CoV-2 IgG titers above 4.99, which has been shown to correlate with a viral neutralizing capacity. The graphs represent the effect of the explanatory variables on the probability to have a sustained immune humoral response, being the maximum probability 1 (100%).
Finally, we aimed to assess if the changes of the cytokines and chemokines throughout time were related to the development of the sustained immune humoral response. With the univariate generalized linear mixed model, we observed that the changes in the serum levels of 5 cytokines (TNF-β, IL-5, IL-3, IL-1α and IL-13) during follow-up were associated with the development of a sustained immune humoral response. To include the effect of the disease severity in the analysis, we assessed the serum levels of these cytokines 6 months after recruitment among the following comparison groups: critical and non-critical COVID-19 patients with and without the presence of a sustained humoral immune response. The findings of this analysis are presented in Supplementary Table 5. As shown in Supplementary Figure 5, the main differences in cytokine levels were found in critical patients without a sustained humoral immune response. This patient group showed the highest serum cytokine levels compared with critical patients with a sustained humoral response and both groups of non-critical patients. However, patients with critical disease and sustained humoral immune response had higher levels of IL-3 compared with the other groups.
Discussion
In this study, we stablished associations between the clinical and immunological features during acute COVID-19 and the development of a sustained humoral immune response. Also, with the longitudinal follow-up, we were able to describe not only the kinetics of the anti-SARS-CoV-2 IgGs, but also the changes in the serum cytokines and chemokines related to this outcome. In our study, we found that critical COVID-19 is a key factor associated with the development of a sustained immune humoral response with anti-SARS-CoV-2 IgG titers that correlate with a viral neutralizing capacity. At baseline and in the prospective analysis, the diagnosis of critical COVID-19 was the main factor associated with a sustained humoral immune response. In addition, this response was related to lower serum levels of IL-4, IL-13 and a decreased proportion of CD8+ and regulatory T cells, a higher absolute number of total lymphocytes and increased serum concentrations of IP-10, IL-2, and AC antibodies.
Zhang, et al. described that SARS-CoV-2 neutralizing antibodies could persist in 49% of patients after disease onset and are positively associated with disease severity (18). Also, patients who survive severe COVID-19 have a faster and more robust humoral response compared with patients with less severe disease and develop higher titers of anti-SARS-CoV-2 antibodies (19), which agrees with our findings.
We observed that an immune profile associated with critical COVID-19 is a fundamental driver of the development of a sustained humoral immune response. In this regard, an effective T cell response is a key prognostic factor in COVID-19. CD4+ and CD8+ lymphopenia are hallmarks of severe COVID-19 (20). The expression of genes related to apoptosis has been observed in memory T cells from patients with COVID-19 (20). One theory is that these memory cells experience activation-induced cell death, which is difficult to overcome in the context of lymphopenia (20).This is in line with our results since we found that patients with severe COVID-19 had a lower proportion of memory CD4+ T cells and of total lymphocytes. A dysfunction in the cytotoxic response and the production of IFN-γ in CD8+ T cells has been demonstrated in severe COVID-19 (21). Our results coincide with other reports, which state that during severe infection, most patients present lower amounts of CD8+ T cells. CD8+ T cell lymphopenia is especially prominent in patients with prolonged disease courses (22). Previous studies have demonstrated that an effective CD8+ T cells response is the key factor for the resolution of the SARS-CoV-2 infection (23). Therefore, the CD8+ T cell lymphopenia may be the reflection of the progression to a critical disease state, which was the main factor associated to the development of a sustained humoral immune response in our study.
In this work, we found a direct relationship between the amount of lymphocytes and the development of a sustained humoral immune response. Although lymphopenia is a characteristic feature of severe COVID-19, previous studies have shown that an effective humoral response to vaccines is related to a higher percentage of B lymphocytes in multiple myeloma patients (24). Likewise, subjects receiving B cell depletion therapies are less likely to have a humoral response after SARS-CoV-2 vaccination (25). Also, it has been shown that hospitalized patients with COVID-19 have a higher amount of follicular T helper cells, which directly correlates with anti-SARS-CoV-2 antibodies and is inversely correlated with the proportion of regulatory T cells (26). Therefore, even in the context of lymphopenia, a high number of certain lymphocyte subsets may be necessary for the development of a sustained humoral immune response.
Following viral antigen-mediated lymphocyte stimulation, there is a robust production of IFN-γ, TNF-α, and IL-2 in COVID-19 (27). A previous study found that this potent CD4+ response correlates with serum anti-SARS-CoV-2 IgGs (28), consistent with our results since we found that IL-2 is a determinant of the sustained humoral immune response. In this regard, this prominent inflammatory response may not be counteracted by the low levels of regulatory T cells, which we found to be inversely related to sustained humoral immunity. Previous work has suggested that the decrement in regulatory T cells in patients with severe COVID-19 is the result of their re-distribution into the lung, since animal models have proven that these cells are fundamental for the resolution of acute respiratory distress syndrome (ARDS) (20). Other theories to explain the decreased amount of this cell subset in COVID-19 are the IL-6 induced transformation of regulatory T cells into Th17 effector cells and the hypoxia-induced degradation of Foxp3 through the activation of the hypoxia-inducible factor-1α (29). This prior evidence supports our findings. Besides, regulatory T cells are fundamental to prevent immune system hyperactivation, including autoimmunity (29), which may be related to our finding of a correlation between AC antibodies and a sustained immune humoral response. The production of AC antibodies could be caused by infection-induced clonal expansion and the infiltration of self-reactive cells, leading to the development and activation of lymphoid follicles, favoring a broad and robust humoral response that may include the production of autoantibodies, as described in other viral infection, such as Epstein-Barr virus (30).
Critical COVID-19 patients also present IP-10 driven extrafollicular humoral responses, which are strongly correlated with large antibody-secreting cells expansion and early production of high concentrations of SARS-CoV-2-specific neutralizing antibodies (31). IP-10 and IL-2 are biomarkers of disease severity (32), which supports our findings. Also, extrafollicular B cell responses are related to a higher production of anti-SARS-CoV-2 autoantibodies and could cause autoimmunity because of the lack of certain immune checkpoints that help avoid the production of autoantibodies (33). Previous studies have found a correlation between the production of autoantibodies and anti-SARS-CoV-2 IgGs in patients with critical disease. Anti-chromatin antibodies are a sign of severe and critical COVID-19 and a sign of adverse prognosis (34), which agrees with our findings.
During the longitudinal follow-up, we observed that changes in growth factors, chemokines, and interleukins were associated with the presence of a sustained immune humoral response in COVID-19. Serum levels of IL-4 and IL-13 were negatively correlated with the robust inflammatory response and CD8+ T cell counts. Although hyperinflammation is a hallmark of critical COVID-19, previous research has shown that this leads to a lower immune response to subsequent stimuli (35). In line with these previous findings, the longitudinal cytokine behavior observed in our study showed that most patients with a sustained humoral immune response had lower levels of cytokines at the end of follow-up, despite being in a critical stage of the disease at baseline, with a peak of IL-3 and IL-2 at 3 months post recruitment. Only the increased levels of IL-3 persisted at 6 months after baseline in critical patients, whereas patients with higher concentrations of cytokines had no sustained humoral immune response. In this regard, we hypothesize that the lower amount of cytokines in patients with sustained humoral immune response who were previously critically-ill, may be the result of a higher threshold in the capacity to respond to an immune stimuli, but further studies are needed to confirm this theory. Because IL-3 is a key factor in activating B cells and inflammatory disease (36) we conclude that exceptionally high levels of IL-3 are directly related to disease severity and humoral immune response.
The role of IL-4 in COVID-19 severity is controversial. Consistent with the current findings, several previous studies have demonstrated that serum IL-4 levels are not increased in critical COVID-19 patients (37) however, contradictory evidence also exists. IL-4 is a regulatory cytokine that limits the inflammatory response against microorganisms (38). Moreover, IL-4 regulates the secretion of IL-1, TNF-β, and prostaglandin E2; therefore, lower serum IL-4 concentrations may favor a higher production of these mediators, which are known to promote tissue damage. IL-4 also limits autoimmune responses (38) consistent with our finding of a lower IL-4 concentration and positive AC antibodies among patients with a sustained humoral immune response. Other studies have found a negative correlation between IL-4 and serum levels of anti-SARS-CoV-2 antibodies (r=−0.208, P=0·023) (39) which agrees with our results.
The main limitation of our study is its observational design, which only allow us to establish associations without inferring any causality. In this regard, we acknowledge that the interpretation of our results is based in the extensive research regarding the COVID-19 immune response and not in a functional or experimental analysis of the features that we found to be associated with the sustained humoral immune response. Furthermore, we only included Mexican-mestizo patients, and we did not assess the viral load and SARS-CoV-2 genotyping, which were unavailable when the study was conducted. Additionally, we could not address the neutralizing capacity of anti-SARS-CoV-2 specific antibodies. Nonetheless, in the clinical practice, the assessment of the CD8+ and regulatory T cells as well as the serum levels of IL-4 and IP-10 can be used to identify patients with a more robust humoral immunity allowing us to address the clinical significance of these antibodies in the appearance of post-COVID-19 syndrome and as markers of a sustained humoral immunity.
Conclusion
A sustained humoral immune response against SARS-CoV-2 was associated with severe disease and quantitative alterations in the T cell subsets, cytokines and chemokines as well as with the production of AC antibodies. It is possible that a defective cellular anti-viral response leads to a more prolonged and severe disease with a higher antigen exposure and a more robust production of antibodies. A low amount of regulatory T cells and IL-4 may not be able to counteract this hyperinflammation, which may allow the B cells to produce a high quantity of IgGs, some of them against self-antigens which is clinically manifested as the presence of AC antibodies. Eventually, this hyperstimulation of the immune system may result in a higher activation threshold in the long-term, which may explain the finding of a lower amount of cytokines in patients with a sustained immune humoral response who were previously critically-ill.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding authors.
Ethics statement
The studies involving human participants were reviewed and approved by Instituto Nacional de Ciencias Médicas y Nutrición Salvador Zubirán (Ref. 3341). The patients/participants provided their written informed consent to participate in this study.
Author contributions
JT-R, JL-G, AV-C, JL-L, AP-F, RT-C, MN-A, BA-C, AA-A, JM-M, NM-D, CN-A, MR-G, LL, SR-R, VS-H, RC-D, GJ-V, DM-S, LM-J, RV-V, JF-L, and DG-M participated in the conceptualization of the study. JT-R, JL-G, AV-C, AP-F, JM-M, NM-D, CN-A, MR-G, LL, LM-J, LM-J, LL-L, JN-T, JF-L, RV-V, HG-R, and DG-M collaborated with the study design. Data acquisition and analysis were done by JT-R, JL-G, AV-C, DG-M, JL-L, AP-F, RT-C, MN-A, BA-C, AA-A, JM-M, NM-D, CN-A, GJ-V, DM-S, LL-L, and JN-T. Data interpretation was done by JT-R, JL-G, AV-C, DG-M, JL-L, AP-F, RT-C, MN-A, BA-C, AA-A, JM-M, NM-D, CN-A, MR-G, LL, SR-R, VS-H, RC-D, GJ-V, DM-S, LM-J, LM-J, JF-L, RV-V, and DG-M. JT-R, JL-G, AV-C, DG-M, JL-L, AP-F, RT-C, MN-A, BA-C, AA-A, JM-M, NM-D, CN-A, MR-G, LL, SR-R, VS-H, RC-D, GJ-V, DM-S, LM-J, LM-J, and RV-V wrote the original draft. All authors contributed to the article and approved the submitted version.
Funding
The funds provided by Fundación Carlos Slim were only used to purchase reagents and other consumables. Fundación Carlos Slim employees were involved in the conduct of the study and contributed to the collection and interpretation of the data. The funder did not have any role in the writing or decision to submit the manuscript for publication. The authors worked independently of the funder and all authors, external and internal, had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Acknowledgments
The authors would like to acknowledge the technical support provided by the Red de Apoyo a la Investigación (RAI). The graphical abstract was created using the Biorender website.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fimmu.2022.943563/full#supplementary-material
Supplementary Figure 1 | Gating strategy for the evaluation of T helper, cytotoxic, naïve, exhausted, anergic, regulatory, senescent cell subsets.
Supplementary Figure 2 | Gating strategy for the evaluation of T memory cell subsets.
Supplementary Figure 3 | Gating strategy for the evaluation of CD4+ Th1, Th2, Th17 and CD8+ Th1, Th2, Th17 cell subsets
Supplementary Figure 4 | Gating strategy for the evaluation of B cell subsets
Supplementary Figure 5 | Repeated-measures analysis of serum cytokines by disease severity and development of sustained humoral immune response. (A) TNF-β. (B) IL-5. (C) IL-3. (D) IL-1α. (E) IL-13. The significant post-hoc comparisons are shown. IL: interleukin; SHIR: sustained humoral immune response; TNF-β: tumor necrosis factor-β.
Supplementary Table 1 | Baseline immunological features of patients with COVID-19 according to the presence of a sustained immune humoral response. The absolute numbers of T and B cell subsets were compared with the Wilcoxon test.
Supplementary Table 2 | Evaluation of the serum levels of cytokines, chemokines, NETs and AC antibodies 3 months after recruitment according to the development of a sustained humoral immune response. The serum levels of the cytokines, chemokines, NETs and the titers of AC antibodies are expressed as medians and interquartile ranges and were compared with the Wilcoxon test.
Supplementary Table 3 | Comparison of the serum levels of cytokines, chemokines and AC antibodies in patients with COVID-19, 6 months after recruitment according to the diagnosis of a sustained humoral immune response. The serum levels of the cytokines and chemokines are expressed as medians and interquartile ranges and were compared with the Wilcoxon test.
Supplementary Table 4 | Univariate logistic regression analysis of the statistically significant features associated to the development of a sustained humoral immune response in patients with COVID-19.
Supplementary Table 5 | Repeated-measures analysis of the differential serum levels of cytokines 6 months after recruitment considering the disease severity and the development of a sustained humoral immune response.
References
1. Gaebler C, Wang Z, Lorenzi JCC, Muecksch F, Finkin S, Tokuyama M, et al. Evolution of antibody immunity to SARS-CoV-2. Nature (2021) 591(7851):639–44. doi: 10.1038/s41586-021-03207-w
2. Li Q, Wang Y, Sun Q, Knopf J, Herrmann M, Lin L, et al. Immune response in COVID-19: what is next? Cell Death Differ (2022) 29(6):1107–22. doi: 10.1038/s41418-022-01015-x
3. Milne G, Hames T, Scotton C, Gent N, Johnsen A, Anderson RM, et al. Does infection with or vaccination against SARS-CoV-2 lead to lasting immunity? Lancet Respir Med (2021) 9(12):1450–66. doi: 10.1016/S2213-2600(21)00407-0
4. Li Y, Wang X, Shen XR, Geng R, Xie N, Han JF, et al. A 1-year longitudinal study on COVID-19 convalescents reveals persistence of anti-SARS-CoV-2 humoral and cellular immunity. Emerg Microbes Infect (2022) 11(1):902–13. doi: 10.1080/22221751.2022.2049984
5. Peghin M, De Martino M, Palese A, Gerussi V, Bontempo G, Graziano E, et al. Post-COVID-19 syndrome and humoral response association after 1 year in vaccinated and unvaccinated patients. Clin Microbiol Infect (2022). doi: 10.1016/j.cmi.2022.06.003
6. Galipeau Y, Greig M, Liu G, Driedger M, Langlois MA. Humoral responses and serological assays in SARS-CoV-2 infections. Front Immunol (2020) 11:610688. doi: 10.3389/fimmu.2020.610688
7. Alshami A, Al Attas R, Anan H, Al Maghrabi A, Ghandorah S, Mohammed A, et al. Durability of antibody responses to SARS-CoV-2 infection and its relationship to disease severity assessed using a commercially available assay. Front Microbiol (2021) 12:770727. doi: 10.3389/fmicb.2021.770727
8. Lei Q, Li Y, Hou HY, Wang F, Ouyang ZQ, Zhang Y, et al. Antibody dynamics to SARS-CoV-2 in asymptomatic COVID-19 infections. Allergy (2021) 76(2):551–61. doi: 10.1111/all.14622
9. De Biasi S, Meschiari M, Gibellini L, Bellinazzi C, Borella R, Fidanza L, et al. Marked T cell activation, senescence, exhaustion and skewing towards TH17 in patients with COVID-19 pneumonia. Nat Commun (2020) 11(1):3434. doi: 10.1038/s41467-020-17292-4
10. Knoll R, Schultze JL, Schulte-Schrepping J. Monocytes and macrophages in COVID-19. Front Immunol (2021) 12:720109. doi: 10.3389/fimmu.2021.720109
11. Zhu Y, Chen X, Liu X. NETosis and neutrophil extracellular traps in COVID-19: Immunothrombosis and beyond. Front Immunol (2022) 13:838011. doi: 10.3389/fimmu.2022.838011
12. Röltgen K, Boyd SD. Antibody and b cell responses to SARS-CoV-2 infection and vaccination. Cell Host Microbe (2021) 29(7):1063–75. doi: 10.1016/j.chom.2021.06.009
13. Wang EY, Mao T, Klein J, Dai Y, Huck JD, Jaycox JR, et al. Diverse functional autoantibodies in patients with COVID-19. Nature (2021) 595(7866):283–8. doi: 10.1038/s41586-021-03631-y
14. Knies A, Ladage D, Braun RJ, Kimpel J, Schneider M. Persistence of humoral response upon SARS-CoV-2 infection. Rev Med Virol (2022) 32(2):e2272. doi: 10.1002/rmv.2272
15. Liu W, Tao ZW, Wang L, Yuan ML, Liu K, Zhou L, et al. Analysis of factors associated with disease outcomes in hospitalized patients with 2019 novel coronavirus disease. Chin Med J (Engl) (2020) 133(9):1032–8. doi: 10.1097/CM9.0000000000000775
16. Wu J, Liang B, Chen C, Wang H, Fang Y, Shen S, et al. SARS-CoV-2 infection induces sustained humoral immune responses in convalescent patients following symptomatic COVID-19. Nat Commun (2021) 12(1):1813. doi: 10.1038/s41467-021-22034-1
17. Lood C, Blanco LP, Purmalek MM, Carmona-Rivera C, De Ravin SS, Smith CK, et al. Neutrophil extracellular traps enriched in oxidized mitochondrial DNA are interferogenic and contribute to lupus-like disease. Nat Med (2016) 22(2):146–53. doi: 10.1038/nm.4027
18. Zhang J, Lin H, Ye B, Zhao M, Zhan J, Dong S, et al. One-year sustained cellular and humoral immunities of COVID-19 convalescents. Clin Infect Dis (2021) ciab884. doi: 10.1093/cid/ciab884
19. Zohar T, Loos C, Fischinger S, Atyeo C, Wang C, Slein MD, et al. Compromised humoral functional evolution tracks with SARS-CoV-2 mortality. Cell (2020) 183(6):1508–19.e12. doi: 10.1016/j.cell.2020.10.052
20. Hasan A, Al-Ozairi E, Al-Baqsumi Z, Ahmad R, Al-Mulla F. Cellular and humoral immune responses in covid-19 and immunotherapeutic approaches. Immunotar Ther (2021) 10:63–85. doi: 10.2147/ITT.S280706
21. Le Bert N, Tan AT, Kunasegaran K, Tham CYL, Hafezi M, Chia A, et al. SARS-CoV-2-specific T cell immunity in cases of COVID-19 and SARS, and uninfected controls. Nature (2020) 584(7821):457–62. doi: 10.1038/s41586-020-2550-z
22. Kared H, Redd AD, Bloch EM, Bonny TS, Sumatoh H, Kairi F, et al. SARS-CoV-2-specific CD8+ T cell responses in convalescent COVID-19 individuals. J Clin Invest (2021) 131(5):1–13. doi: 10.1172/JCI145476
23. Bergamaschi L, Mescia F, Turner L, Hanson AL, Kotagiri P, Dunmore BJ, et al. Longitudinal analysis reveals that delayed bystander CD8+ T cell activation and early immune pathology distinguish severe COVID-19 from mild disease. Immunity (2021) 54(6):1257–75.e8. doi: 10.1016/j.immuni.2021.05.010
24. Ghandili S, Schönlein M, Wiessner C, Becher H, Lütgehetmann M, Brehm TT, et al. Lymphocytopenia and anti-CD38 directed treatment impact the serological SARS-CoV-2 response after prime boost vaccination in patients with multiple myeloma. J Clin Med (2021) 10(23):1–12. doi: 10.3390/jcm10235499
25. Conte WL. B-cell depleters attenuate the humoral response to SARS-CoV-2 vaccines in multiple sclerosis patients: A case-control study. Mult Scler Relat Disord (2022) 57:103413. doi: 10.1016/j.msard.2021.103413
26. Meckiff BJ, Ramírez-Suástegui C, Fajardo V, Chee SJ, Kusnadi A, Simon H, et al. Imbalance of regulatory and cytotoxic SARS-CoV-2-Reactive CD4. Cell (2020) 183(5):1340–53.e16. doi: 10.1016/j.cell.2020.10.001
27. Karki R, Sharma BR, Tuladhar S, Williams EP, Zalduondo L, Samir P, et al. Synergism of TNF-α and IFN-γ triggers inflammatory cell death, tissue damage, and mortality in SARS-CoV-2 infection and cytokine shock syndromes. Cell (2021) 184(1):149–68.e17. doi: 10.1016/j.cell.2020.11.025
28. Wang Z, Yang X, Mei X, Zhou Y, Tang Z, Li G, et al. SARS-CoV-2-specific CD4. Signal Transduct Target Ther (2022) 7(1):132. doi: 10.1038/s41392-022-00978-0
29. Wang H, Wang Z, Cao W, Wu Q, Yuan Y, Zhang X. Regulatory T cells in COVID-19. Aging Dis (2021) 12(7):1545–53. doi: 10.14336/AD.2021.0709
30. Pender MP. CD8+ T-cell deficiency, Epstein-Barr virus infection, vitamin d deficiency, and steps to autoimmunity: A unifying hypothesis. Autoimmune Dis (2012) 2012:189096. doi: 10.1155/2012/189096
31. Woodruff MC, Ramonell RP, Nguyen DC, Cashman KS, Saini AS, Haddad NS, et al. Extrafollicular b cell responses correlate with neutralizing antibodies and morbidity in COVID-19. Nat Immunol (2020) 21(12):1506–16. doi: 10.1038/s41590-020-00814-z
32. Chen Y, Wang J, Liu C, Su L, Zhang D, Fan J, et al. IP-10 and MCP-1 as biomarkers associated with disease severity of COVID-19. Mol Med (2020) 26(1):97. doi: 10.1186/s10020-020-00230-x
33. Knight JS, Caricchio R, Casanova JL, Combes AJ, Diamond B, Fox SE, et al. The intersection of COVID-19 and autoimmunity. J Clin Invest (2021) 131(24):1–9. doi: 10.1172/JCI154886
34. Lerma LA, Chaudhary A, Bryan A, Morishima C, Wener MH, Fink SL. Prevalence of autoantibody responses in acute coronavirus disease 2019 (COVID-19). J Transl Autoimmun (2020) 3:100073. doi: 10.1016/j.jtauto.2020.100073
35. Park SH. An impaired inflammatory and innate immune response in COVID-19. Mol Cells (2021) 44(6):384–91. doi: 10.14348/molcells.2021.0068
36. Bénard A, Jacobsen A, Brunner M, Krautz C, Klösch B, Swierzy I, et al. Interleukin-3 is a predictive marker for severity and outcome during SARS-CoV-2 infections. Nat Commun (2021) 12(1):1112. doi: 10.1038/s41467-021-21310-4
37. Luo W, Zhang JW, Zhang W, Lin YL, Wang Q. Circulating levels of IL-2, IL-4, TNF-α, IFN-γ, and c-reactive protein are not associated with severity of COVID-19 symptoms. J Med Virol (2021) 93(1):89–91. doi: 10.1002/jmv.26156
38. Brown MA, Hural J. Functions of IL-4 and control of its expression. Crit Rev Immunol (2017) 37(2-6):181–212. doi: 10.1615/CritRevImmunol.v37.i2-6.30
Keywords: SARS-CoV-2, humoral response, COVID-19, lymphopenia, anti-cellular antibodies
Citation: Torres-Ruiz J, Lomelín-Gascón J, Vargas-Castro AS, Lira-Luna J, Pérez-Fragoso A, Tapia-Conyer R, Nuñez-Aguirre M, Alcalá-Carmona B, Absalón-Aguilar A, Maravillas-Montero JL, Mejía-Domínguez NR, Núñez-Álvarez C, Rull-Gabayet M, Llorente L, Romero-Ramírez S, Sosa-Hernández VA, Cervantes-Díaz R, Juárez-Vega G, Meza-Sánchez DE, Martínez-Juárez LA, Morales-Juárez L, López-López LN, Negrete-Trujillo JA, Falcón-Lezama JA, Valdez-Vázquez RR, Gallardo-Rincón H and Gómez-Martín D (2022) Clinical and immunological features associated to the development of a sustained immune humoral response in COVID-19 patients: Results from a cohort study. Front. Immunol. 13:943563. doi: 10.3389/fimmu.2022.943563
Received: 13 May 2022; Accepted: 29 July 2022;
Published: 15 August 2022.
Edited by:
Carl G. Feng, The University of Sydney, AustraliaReviewed by:
Ilnaz Rahimmanesh, Isfahan University of Medical Sciences, IranSentiljana Gumeni, National and Kapodistrian University of Athens, Greece
Copyright © 2022 Torres-Ruiz, Lomelín-Gascón, Vargas-Castro, Lira-Luna, Pérez-Fragoso, Tapia-Conyer, Nuñez-Aguirre, Alcalá-Carmona, Absalón-Aguilar, Maravillas-Montero, Mejía-Domínguez, Núñez-Álvarez, Rull-Gabayet, Llorente, Romero-Ramírez, Sosa-Hernández, Cervantes-Díaz, Juárez-Vega, Meza-Sánchez, Martínez-Juárez, Morales-Juárez, López-López, Negrete-Trujillo, Falcón-Lezama, Valdez-Vázquez, Gallardo-Rincón and Gómez-Martín. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Diana Gómez-Martín, ZGlhbmEuZ29tZXptQGluY21uc3oubXg=; Héctor Gallardo-Rincón, Z2FsbGFyZG9kckB5YWhvby5jb20=
†These authors have contributed equally to this work