- 1Servicio de Análisis Clínicos e Inmunología, Hospital Universitario Virgen de las Nieves, Granada, Spain
- 2Servicio de Medicina Interna, Hospital Universitario Virgen de las Nieves, Granada, Spain
- 3Instituto de Investigación Biosanitaria de Granada (ibs.GRANADA), Granada, Spain
- 4Departamento Bioquímica, Biología Molecular e Inmunología III, University of Granada, Granada, Spain
- 5Servicio de Enfermedades Infecciosas, Hospital Universitario Virgen de las Nieves, Granada, Spain
- 6Departamento de Medicina, University of Granada, Granada, Spain
The severity of SARS-CoV-2 infection has been related to uncontrolled inflammatory innate responses and impaired adaptive immune responses mostly due to exhausted T lymphocytes and lymphopenia. In this work we have characterized the nature of the lymphopenia and demonstrate a set of factors that hinder the effective control of virus infection and the activation and arming of effector cytotoxic T CD8 cells and showing signatures defining a high-risk population. We performed immune profiling of the T helper (Th) CD4+ and T CD8+ cell compartments in peripheral blood of 144 COVID-19 patients using multiparametric flow cytometry analysis. On the one hand, there was a consistent lymphopenia with an overrepresentation of non-functional T cells, with an increased percentage of naive Th cells (CD45RA+, CXCR3-, CCR4-, CCR6-, CCR10-) and persistently low frequency of markers associated with Th1, Th17, and Th1/Th17 memory-effector T cells compared to healthy donors. On the other hand, the most profound alteration affected the Th1 subset, which may explain the poor T cells responses and the persistent blood virus load. Finally, the decrease in Th1 cells may also explain the low frequency of CD4+ and CD8+ T cells that express the HLA-DR and CD38 activation markers observed in numerous patients who showed minimal or no lymphocyte activation response. We also identified the percentage of HLA-DR+CD4+ T cells, PD-1+CD+4/CD8+ T cells in blood, and the neutrophil/lymphocyte ratio as useful factors for predicting critical illness and fatal outcome in patients with confirmed COVID-19.
Introduction
The novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is the cause of the coronavirus disease 2019 (COVID-19) pandemic that emerged in Wuhan (China) in early December 2019 (1). On the 30th of January 2020, the world health organization declared the SARS-CoV-2 outbreak an international health emergency and 9 months later more than 41,000,000 infected have been reported worldwide, with more than 1,125,000 deaths (2).
SARS-CoV-2 belongs to the betacoronavirus (β-CoVs) genus, as do the SARS-CoV and MERS-CoV (3). It is a zoonotic virus whose possible reservoirs are bats and/or pangolins (4). Phylogenetic analysis showed that SARS-CoV-2 is closely related to a bat coronavirus but also has sequence identity to SARS-CoV and MERS-CoV (5). Like SARS-CoV, SARS-CoV-2 uses angiotensin-converting enzyme 2 (ACE2) as a receptor for entry into the cells, infecting type II pneumocytes of the lung epithelium (6, 7). ACE2 is also expressed in the upper epithelium of the esophagus, ileum and colon enterocytes, myocardial cells, cells of the proximal kidney tubule, bladder urothelium, and the oral mucosa (8).
The SARS-CoV-2 infection is characterized by cough, fever, dyspnea, myalgia, rhinorrhea, diarrhea, and conjunctivitis (9, 10). Most cases (80–90%) are mild or asymptomatic, while 10% can develop severe disease (9). The most severe cases suffer unilateral or bilateral pneumonia and acute respiratory distress syndrome (ARDS), shock and multi-organ failure which might result in death (9). The mortality rate of the disease is around 3% (11). There are several factors that influence the risk of intensive care unit (ICU) admission or death, including advanced age, previous pathologies, and overweight (12).
Regarding clinical and biochemical parameters, COVID-19 patients present an elevation of proinflammatory cytokines like interleukin-1 (IL-1), IL-6, tumor necrosis factor alpha (TNF- α), interferon gamma (IFN-γ), C-X-C motif chemokine ligand 10 (CXCL10), and monocyte chemoattractant protein-1 (MCP-1), which can lead in certain cases to a cytokine storm (11, 12). The cytokine storm is one of the main reasons for the development of ARDS and multi-organ failure (13). In addition to cytokines, there are several inflammation and coagulation parameters that are elevated in these patients, such as C-reactive protein (CRP), ferritin, lactate dehydrogenase (LDH) D-dimer, and fibrinogen (12). Furthermore, lymphopenia has been observed in 85% of hospitalized patients (14) resulting in a worse prognosis (15).
Lymphopenia as an effect produced by SARS-CoV-2 infection has been reported in numerous works (16). However, no studies have specifically investigated functional Th subtypes or which specific subpopulation is affected by the lymphopenia. This information is valuable because it will clarify the nature of the compromised immunology response, and could provide a rationale for immune restorative treatments. Likewise, an answer to the cause of lymphopenia has not been found, although possible reasons have been described (17).
Our work is based on the clinical data of 145 COVID-19 patients admitted to the University Hospital Virgen de las Nieves (Granada), Spain. We have compared the immunological profile in peripheral blood between three groups of patients: asymptomatic, hospitalized, and patients admitted to the ICU. We performed a flow cytometric analysis of the different subpopulations of T lymphocytes [CD4, CD8, Th1, Th2, Th17, Th22, regulatory T cells (Treg), and T follicular helper cells (TFH)] at the time of admission, as well as activation and exhaustion markers [HLA-DR, CD38, CD39, programmed death 1 (PD-1) and T cell immunoreceptor with Ig and ITIM domains (TIGIT)], looking for which subpopulations are affected by the lymphopenia and their relationship with the different clinical, biochemical and hospital stay parameters, as well as the different effects that SARS-CoV-2 infection can generate on the immune response.
In this work, we show for the first time a profound effect of a SARS-CoV-2 infection on the Th1 component. The fact that these cells are important in the control of the response mediated by CD8+ T cells through the production of IL-2 and IFN-γ (18), makes us believe that our findings are relevant, since they can generally explain the poor T cell response and the prolonged viremia in COVID-19 patients.
Methods
Samples
Patients (N=144) diagnosed with COVID-19 admitted to University Hospital Virgen de las Nieves, Granada, Spain, were prospectively included in our study between March 2020 and June 2020 in order to conduct an observational study. The patients are distributed as follows.
A first cohort, “non-ICU hospitalized patients” was composed by one hundred patients recruited within 24 h of hospital admission. Peripheral blood was collected at enrolment. In this group the median age was 74.5 years and 51.0% were females. This cohort was composed of elderly patients, with a high incidence of cardiovascular diseases, with high blood pressure being the most common comorbidity, affecting more than half of the patients. Fourteen percent of our patients had a history of cerebrovascular disease, and 12% had a previous myocardial infarction. Approximately a quarter of patients were diabetic and 15% suffered from chronic kidney disease. Most of the patients had no other pre-existing pulmonary condition. Mean follow-up time for hospitalized patients was 12.5 (9.8–15.3) days. During the hospital stay, twenty patients (19.6%) from this group died and four (3.9%) needed transfer to the intensive care unit (ICU). From seven patients of this group, a second sample was collected 70 days after hospital admission for the realization of a longitudinal study.
A second cohort, “ICU hospitalized patients” was composed by an independent group of 17 ICU COVID-19 patients, composed mostly of men (76.5%) with a median age of 69 years. This group showed a high incidence of cardiovascular diseases, being hypertension the most common comorbidity, affecting 53% of the ICU patients. Diabetes mellitus was the second most common comorbidity among ICU patients, affecting approximately one third of them. The median length of admission in this group exceeded 2 months. Mortality in this group was 11.8%.
The third cohort “asymptomatic recovered donors” was composed by a group of 27 hospital staff members with no previous symptoms that tested positive for IgG against SARS-CoV-2. This group was composed of 81.5% (22) females and 18.5% (5) males, with a median age of 43 (34.0–58.0) years.
The control group comprised 42 healthy blood donors recruited among hospital staff tested negative for SARS-CoV-2, with a median age of 61 years (55–62), 90.5% (38) females and 9.5% (4) males.
Peripheral blood was collected from all subjects. We followed the patients until discharge or death, collecting data about clinical manifestations, laboratory data, and demographic data. Sequential Organ Failure Assessment Score (SOFA score), that integrates data from cardiovascular, respiratory, hepatic, coagulation, neurological, and renal systems (19), was calculated by trained physicians at admission. Supplementary Table 1 provides a summary of the demographic and clinical features of patients. All individuals were natives from the Granada area.
All patient samples were collected according to the local medical ethics regulations, after informed consent was obtained by the subjects, their legal representatives, or both, according to the Declaration of Helsinki. The study was approved by the local ethics committee (Cod. 0766-N-20).
Statistical Analysis
Categorical data were described as percentages, and non-categorical data were expressed as median and quartile intervals. The parametric Student’s t test was used to compare groups when the distribution was normal (as checked by the Kolmogorov-Smirnov test) and the non-parametric Mann–Whitney U test when it was not. Spearman analysis was used to evaluate correlations between quantitative variables. Fisher’s exact test was used to determine if there were associations between two categorical variables. The R function ggcorrplot was used to calculate and visualize correlations between variables, displaying the positive correlations in red and negative correlations in blue. Correlations with P-values > 0.05 were considered as insignificant and left blank. To evaluate the capacity to predict mortality using cytometry and biochemical parameters measured at hospital admission, we plotted the receiver operating characteristics (ROC) curve, and calculated the area under the receiver operating characteristic (AUC).
SPSS statistical software (Windows version 20, IBM, Armonk, NY, USA) was used for statistical analysis. To compute and visualize the correlation matrix R package ggcorrplot was used. The P-values are not corrected and it was considered a type 1 error (α) of 0.05 to reject the hypothesis testing.
Immune Characterization by Cytometry
Whole peripheral blood (PB) samples were stained for cell surface markers using a direct immunofluorescence technique. Eight-color combinations of monoclonal antibodies (Mab) were used to identify the different T cell subsets. CD3 cell subpopulations were determined by the selection of CD45+, CD3+ cells in the lymphocyte gate. The Th1, Th2, Th1/Th17, Th17, Th22, and TFH subpopulations were detected in the CD4+ plot, based on the expression levels of CXC chemokine receptor 3 (CXCR3), CXC chemokine receptor 5 (CXCR5), CD194, CCR4, CD196, and chemokine receptor 6 (CCR6) (Figure 1A). A human regulatory T cell cocktail was used to identify Tregs, defined as CD127low-CD25bright-CD4+. Naïve CD4+ T cells were detected by bright expression of CD45RA and negative expression for all other chemokine receptors (Figure 1A). The amount of Tregs was expressed as a percentage of total CD4+ cells. All Mabs were purchased from BD Biosciences, San Diego, CA. CD4+ T cell subsets were defined by chemokine receptors expression according to Supplementary Table 3.
Figure 1 Gating strategies for the identification of Th subsets and the evaluation of T cell activation and exhaustion markers. (A) First a lymphocyte gate was defined based on high CD3 expression and low side-scatter (SSC) complexity. A minimum of 200,000 events/sample were collected in this gate. Second, the cells in the lymphocyte gate were divided into CD4+ and CD8-lymphocytes. Third, we analyzed the CD4+ lymphocytes for the expression of CD183, CD196, and CCR10 in order to identify Th1 (CD4+CD183+CD196-), Th1/Th17 (CD4+CD196+CD183+), and Th17 cells (CD4+CD183-CD196+CCR10-). A human regulatory T cell (Tregs) cocktail was used to identify regulatory T cell subsets defined as CD4+CD25brightCD127low. This gating strategy was applied to all controls, asymptomatic recovered donors, non-ICU hospitalized patients, and ICU hospitalized patients, as indicated in the figure. For the identification of naïve CD4+ T cells we used antibodies against CD45RA, CD183, CD185, CD186, CD194, CD196, and CCR10, selecting those that were bright for CD45RA but negative for the rest of the mentioned markers, as shown in the top panel. The amount of each T cell subset was expressed as a percentage of total CD4+ cells. (B) Dot plots showing the expression of the HLA-DR, CD38, TIGIT, and PD-1 markers on CD4+ T cells from two patients with different degrees of HLA-DR expression, in addition to a control. Panel I shows a non-ICU hospitalized patient with high expression of HLA-DR on CD4+ T cells while II shows another non-ICU hospitalized patient with low expression of HLA-DR on CD4 + T cells. Panel III shows a control.
The Mab combinations for the detection of the different Th subsets were based on the panels used by EuroFlow-IMM TCD4 (20). T cell activation-associated markers (HLA-DR, and CD38) and T cell exhaustion markers (TIGIT and PD-1) were also examined (Figure 1B). The specificity and fluorochromes of each reagent used are listed in Supplementary Table 2. Stained cell suspensions were analyzed on a FACSCanto II flow cytometer (BD Biosciences, San José, CA, USA). An average of 300,000 events per tube corresponding to the whole PB cellularity was acquired. The InfinicytTM22.0 software was employed for multiparametric analysis. For instrument set up, BD one flow set up standard operating procedures were used. T cells were selected in a SSC versus CD3 bivariate dot plot histogram after exclusion of debris.
Results
Clinical Inflammatory Syndrome in COVID-19 Patients
Most COVID-19 patients presented at the time of hospital admission a clinical inflammatory syndrome, characterized by the elevation of several biochemical inflammatory markers.
In 93% of the non-ICU hospitalized patients, fibrinogen was raised. The levels of C reactive protein (CRP), lactate dehydrogenase (LDH), and D-dimer (a fibrin degradation product) were above normal range in 89, 85, and 75% of the non-ICU hospitalized patients, respectively. Two thirds of the non-ICU hospitalized patients showed an elevation of ferritin whereas troponin I was above normal range in 57%. Brain natriuretic peptide (BNP) was elevated in 53% of tested non-ICU hospitalized patients and procalcitonin was raised in 32%.
A total of 41 patients, were tested for IL-6 (30 non-ICU hospitalized patients and eleven ICU hospitalized patients). Twenty-three non-ICU hospitalized patients and all except one ICU hospitalized patients showed increased levels for IL-6 in serum. Additional analysis showed that IL-6 is positively correlated with Th17 (P=0.014), CRP (P<0.001), and fibrinogen (P=0.008).
All the ICU hospitalized patients had above normal levels of CRP, LDH, ferritin, troponin I, D-dimer, and fibrinogen, whereas procalcitonin was elevated in the 88% and BNP in 41%.
Changes in Leukocyte Populations in Peripheral Blood From COVID-19 Patients
Non-ICU hospitalized patients were observed to have an increased leukocyte count compared to controls. This was also observed in non-ICU hospitalized patients (Table 1). Though most patients had white blood cell counts (WBC) in the normal range, 23% of non-ICU hospitalized patients and 23.5% of ICU hospitalized patients showed clinical leukocytosis. There were no significant intra-group differences associated with sex in leukocyte populations.
Table 1 Absolute count and percentages of the different cell populations in peripheral blood samples of healthy controls and coronavirus disease 2019 (COVID-19) patients.
Increased neutrophil numbers were observed in non-ICU hospitalized patients and ICU hospitalized patients compared to healthy controls (Table 1). Furthermore, 25% of the non-ICU hospitalized patients and 17% of the ICU hospitalized patients had severe neutrophilia.
We also observed a significantly lower lymphocyte count in COVID-19 patients compared to healthy controls (Table 1). Besides, 49% of non-ICU hospitalized patients, and 65% of ICU hospitalized patients exhibited lymphopenia.
To assess the impact of acute SARS-CoV2 infection on T cell populations, we performed an in depth immunophenotypic analysis of the activation status and differentiation of functional T cell populations in peripheral blood of healthy donors, non-ICU hospitalized patients, ICU hospitalized patients, and asymptomatic recovered donors using flow cytometry. We could not detect significant intra-groups differences between sexes. A decrease in cell count was observed for CD4+ and CD8+ T cells in non-ICU hospitalized patients and in ICU hospitalized patients. The reduction in CD4+ and CD8+ T cells was equally pronounced. Indeed, there were no significant differences in the CD4:CD8 ratios between groups (Table 1).
Interestingly, we found that the percentages of Th1, Th1/Th17, and TFH cells were significantly reduced in non-ICU hospitalized patients with respect to healthy donors (Table 1). The reduction of Th1 cells was especially pronounced, decreasing by almost 10% in non-ICU hospitalized patients. In contrast, the percentage of Th22 cells in non-ICU hospitalized patients was slightly elevated compared to healthy donors (Table 1). The decrease in Th17 and Tregs cells, although not statistically significant when comparing percentages, was significant when comparing cell counts. Conversely, naïve CD4+ T cells were greatly overrepresented in non-ICU hospitalized patients and ICU hospitalized patients (Table 1).
In ICU hospitalized patients, albeit the T lymphocyte pool was more depleted compared to the other group of patients, only the TFH population was significantly reduced, whereas the reduction in Th1, Th17, and Th1/Th17 percentages was less pronounced, not reaching significance. In contrast to the non-ICU hospitalized patients, the Th22 population was significantly reduced in ICU hospitalized patients compared to healthy controls (Table 1). However, absolute cell counts of Th1, Th17, Th1/Th17, TFH, and Treg cells were significantly reduced compared to healthy donors. Furthermore, naïve CD4+ T cells were also notably elevated in this group (Table 1).
Asymptomatic recovered donors showed normal values in CD4+ T cells subpopulations, being only Th22 cells slightly elevated with respect to healthy donors.
Concerning T cell exhaustion markers, non-ICU hospitalized patients presented a significant decrease in PD-1+CD4+, and TIGIT+CD4+, PD-1+CD8+, and TIGIT+CD8+ populations. Noticeably, asymptomatic recovered donors still showed decreased levels of PD-1+CD8+ and TIGIT+CD8+ cell populations (Table 1).
Changes in Lymphocyte Subpopulations After Recovery
To evaluate the long-term impact SARS-CoV2 infection on T cell populations, we tested seven COVID-19 patients 10 weeks after hospital admission using flow cytometry. Notably, when compared to day 1, we observed a significative reduction in PD-1+CD4+T cells and an increase of TFH. Although not statistically significant due to the low number of cases tested, we observed a noticeable recovery of T cells, CD4+ T cells, Th1, and Th1/Th17 cells (Figure 2).
Figure 2 Longitudinal study of the fraction of Th populations in peripheral blood of non-intensive care unit (ICU) hospitalized patients. The line within the box represents the median, the top and the bottom of the box represents the 75th and 25th percentiles, respectively. (A–C) Boxplots for [left] lymphocyte pool (×10−3/ml), [middle] CD3 (%) and [right] CD4 (%). (D–F) Boxplots for [left] Th1 (%), [middle] Th17 (%), and [right] Th1/Th17 (%). (G–I) Boxplots for [left] TFH (%), [middle] CD4+PD-1+ T cells, and [right] CD8+PD-1+ T cells.
We also compared the levels of lymphocyte subpopulations on day 70, with those of healthy donors. Recovered patients showed significantly lower levels of PD-1+CD4+ T cells, TIGIT+CD4+ T cells, and PD-1+CD8+ T cells, while on the other hand, the levels of TFH cells were significantly higher (data not shown).
COVID-19 Infection Is Associated With Changes in Biochemical and Immunological Parameters
We next performed a correlation mapping to evaluate potential associations between clinical features, biochemical parameters, and leukocyte populations (Figure 3). We observed a negative correlation between biochemical inflammatory parameters (ferritin, fibrinogen, CRP, D-dimer, LDH) with the percentage of lymphocytes as well as with CD3, CD4, Th1, Th17, Th1/Th17, and THF. In contrast, the above inflammatory parameters showed a positive correlation with the neutrophils counts.
Figure 3 Spearman correlation heatmap of all measured cell populations, biochemical parameters and clinical parameters. Red indicates a positive correlation and blue represent a negative correlation. Non-significant correlations are left blank.
Interestingly, we found an inverse correlation between lymphocytes and neutrophils. Age exhibited a negative correlation with lymphocyte counts CD4, CD8, Th1, Th17, Th1/Th17, TFH; and a positive correlation with whole blood count and neutrophils.
The expression of the activation markers HLA-DR and CD38 correlated negatively with the percentage of CD3, CD4, CD8, Th17, Th1/Th17, TFH, and Th22 cells, while they correlated positively with CD4+TIGIT+ and CD4+PD-1+ cells. HLA-DR+CD4+ cells was positively correlated with length of hospitalization and with neutrophil counts.
The naïve T cell marker CD45RA had a strong negative correlation with Th1 cells and Tregs, as well as with exhaustion markers (CD4+TIGIT+, CD4+PD-1+, CD8+TIGIT+, CD8+PD-1+, and CD4+CD38+).
Length of stay was negatively correlated with CD3, CD4, CD8, Th17, Th1/Th17, and Th22. On the other hand, length of stay showed a positive correlation with neutrophils, Tregs, HLA-DR+CD4+, fibrinogen, CRP, and procalcitonin.
The SOFA score had a negative correlation with lymphocytes and T cells subpopulations, and a positive correlation with age, length of hospitalization, neutrophil counts, and biochemical inflammatory parameters (LDH, D-dimer, troponin I, and CRP).
In a further step, we evaluated the impact of neutrophilia and lymphopenia on the clinical outcome. We compared several biochemical and immunological parameters across patients with neutrophilia (n=25), and those with neutrophils in the normal range (n=75); besides across patients with lymphopenia (n=49), and those with lymphocytes in the normal range (n=51). Our results demonstrate that neutrophilic patients show an increase in the percentage of Tregs, CD38+CD4+ T cells, and HLA-DR+CD4+ T cells. Furthermore, patients with neutrophilia had increased levels of CRP, LDH, fibrinogen, D-dimer, procalcitonin, and troponin I, and reduced concentration of ferritin and BNP. The SOFA score was significantly elevated in neutrophilic patients (Table 2). In regard to the impact of lymphopenia, lymphopenic patients had increased Th2, CD38+CD4+ T cells, HLA-DR+CD4+ T cells, and Tregs (Table 3). In addition, patients with lymphopenia had increased mean levels of ferritin, CRP, fibrinogen, D dimer, procalcitonin, and troponin I (Table 3).
Table 2 Differences in diverse markers between patients with neutrophilia and no neutrophilia among non-intensive care unit (ICU) hospitalized patients.
Table 3 Differences in diverse markers between patients with and without lymphopenia non-intensive care unit (ICU) hospitalized patients.
Differences in Biochemical Parameters and Lymphocyte Subpopulations Between Survivors and Non-Survivors
Among the 100 non-ICU hospitalized patients diagnosed with COVID-19, 21 died in the hospital (21%). As shown in Table 3, non-survivors showed at admission higher serum levels of troponin I, CRP, D-dimer, LDH, and BNP compared to survivors.
In regard to lymphocytes, the percentages of lymphocytes, T cells, CD4+ T cells, and CD8+ T cells were significantly higher in surviving patients, and the ratio of neutrophils:lymphocytes was considerably elevated in non-survivors (Table 4). Moreover, the percentage of HLA-DR+CD4+, PD-1+CD4+ and PD-1+CD8+ T cells was notably raised in the group of patients that died (Table 4).
Table 4 Comorbidities and differences in several markers between survivors and deceased among non-intensive care unit (ICU) hospitalized patients.
With respect to comorbidities, heart failure is significantly more frequent in non survivors (Table 4). Although the differences are not statistically significant, hypertension, diabetes mellitus, chronic kidney disease, and cerebrovascular disease are also more frequent in non-survivors.
Receiver Operating Characteristic Analysis
To examine the diagnostic usefulness of the measured parameters for the prediction of death, we compared sensitivities and specificities at optimal cut-off values determined by ROC analysis.
According to the AUC results obtained, an optimal cut-off value of <13.7% lymphocytes showed a 71% sensibility and a 68% specificity for the prediction of a fatal outcome. HLA-DR+CD4+ (cut-off value >16.2%), and PD-1+CD4+ (cut-off value >24.85%) could also predict death with a sensibility of 71 and 86%, respectively; and a specificity of 68 and 54%, respectively.
Death of non-ICU hospitalized patients could be predicted by measuring serum concentrations at hospital admission of troponin I, CRP, D-dimer, and LDH. Our results also indicate that an elevated SOFA score at hospital admission is associated with an unfavorable prognosis. The curves are shown in Figure 4. The AUC and optimal thresholds of each risk or protection factor can be found in Table 5.
Figure 4 Receiver operating characteristic (ROC) curve showing the accuracy of measuring lymphocytes, PD-1+CD4+ T cells, HLA-DR+CD4+ T cells, troponin I, CRP, D-dimer, lactate dehydrogenase (LDH), and the score Sequential Organ Failure Assessment Score (SOFA) at hospital admission for the prediction of a fatal outcome. The true positive rate (sensitivity) is plotted in function of the false positive rate (1-specificity). The area under the ROC curve (AUC) is a measure of the predictive efficiency of the analyzed parameters to distinguish between the different outcomes. (A–C) ROC curves performed for [left] lymphocytes (%), [middle] lymphocyte pool (×10−3/ml), and [right] Troponin I. (D–F) ROC curves performed for [left] CRP, [middle] D dimer, and [right] LDH. (G–I) ROC curves performed for [left] CD4+PD-1+ T cells, [middle] HLA-DR+CD4+ T cells, and [right] the SOFA score.
Table 5 Receiver operating characteristic (ROC) curves of biochemical and cytometry markers measured at hospital admission for prediction of death.
Discussion
SARS-CoV-2 infection produces an immune disorder promoted by lymphopenia that mainly affects T lymphocytes. So far, the lymphopenia has been the main finding that may explain the inadequate immune response to SARS-CoV-2. Recently, variations have been described in populations of memory, naïve and effector T lymphocytes, as well as different markers of activation and exhaustion, both on CD4 and CD8 T lymphocytes (21). In our study, we have performed a comprehensive analysis of the Th cell component and CD8 T cells. In addition, we have analyzed the activation status and the appearance of T cell exhaustion markers. Our data reveal a profound impairment of T cell immunity, which can be explained by four different reasons: 1—important lymphopenia. 2—The highest proportion of cells in a non-functional effector state (naïve T lymphocytes), suggesting a persistent hypoactivation of the immune system. 3—An important reduction in the proportion of Th1 cells. 4—An insufficient activation measured by the expression of HLA-DR and CD38, which in many cases was similar to that observed in the control group.
Lymphopenia affects T lymphocytes, showing significant differences between non-ICU hospitalized patients and ICU hospitalized patients, compared to the asymptomatic recovered donors and healthy controls, with the lowest percentage of T lymphocytes in the ICU group. Lymphopenia affected mainly the populations of CD4 T lymphocytes, with a reduction in absolute numbers of the subpopulations Th1, Th2, Th17, Th1/Th17, Th22, TFH cells, and Tregs, highlighting an approximate 10% reduction in the proportion of Th1 cells. This decrease in the percentages of effector T lymphocytes can be explained by the higher frequency of naïve cells, Th0 (CD45RA +, CXCR3-, CCR6-, CCR10-, CCR4-). This increase in naïve T cells is observed in both the hospitalized patients and ICU patients, and has been referred to in other studies (22). We believe that it can be explained by a regenerative process in response to lymphopenia. Alternatively, it could correspond to a block in the complete stimulation carried out by dendritic cells. In this sense, a dysfunctional activation of dendritic cells has recently been observed, which would result in apoptosis and depletion of T lymphocytes (23).
Lymphopenia has been revealed in numerous studies on this disease, but the causes that produce it are not yet fully clarified and may be due to direct infection of lymphocytes or suppression of bone marrow by the antiviral response. The studies have been postulated from cytopathic effects by the virus (24), which have been questioned (25), to metabolic disorders (26). From an immunological point of view, the lymphopenia could depend on the possible dysfunctional activation of dendritic cells already mentioned (23) and the high concentration of cytokines such as TNF-α, IL-6, and IL-10, which act as negative regulators of the proliferation and survival of T lymphocytes (27). In this sense, we detected an inverse correlation between lymphocyte and neutrophil counts in COVID-19 patients. It is therefore very possible that this lymphopenia is caused by factors triggered during the exacerbation of the innate response. Hence the close association found between lymphopenia and the biochemical parameters analyzed (Table 3).
The low frequency of the cellular component Th1 is the main finding of this study and can negatively affect in the immune response against SARS-CoV-2 at various levels. Th1 cells are of vital importance in the elimination of intracellular microorganisms such as mycobacteria and viruses. Its reduction, as we see in COVID-19 patients, can have serious consequences for the control of the SARS-CoV-2 infection and its resolution. Th1 lymphocytes, through the production of the cytokines IL-2 and IFN-γ, participate in the activation, proliferation and differentiation of cytotoxic T lymphocytes (CTLs) and induction of cellular cytotoxicity of virus-infected cells (28). Furthermore, unlike SARS patients, patients with COVID-19 also have elevated levels of Th2 cell-secreted cytokines (such as IL-4 and IL-10), which inhibit the inflammatory Th1 responses (13). The Th1 deficiency would lead to a decrease in the number of active CTLs and therefore a poor immune response to the viral infection. Other studies, some published during the evaluation of our work, show similar findings (29–31). However, these studies are based on fewer cases and focus on IFN-γ-producing cells, or naïve/effector-memory cells. Furthermore, these studies, although interesting, do not distinguish between Th1 and Th1/Th17 cells and do not include a comprehensive analysis of additional functional Th-subtypes. Interestingly, a reduced Th1-type specific immune response (i.e., a lower proportion of IFN-γ secreting cells) against different SARS-CoV-2 antigens was observed and was related with age/comorbidity (32). Finally, data by Roncati and colleagues, suggest that the “moonlighting protein” CD26/DPP4 could explain the Th1 immune lockdown observed in severe cases of COVID-19 (33).
We show that there is a low activation (HLA-DR, CD38) of CD8 cells, which is probably also related to the deficiency in the Th1 population. Finally, the decrease in Th1 lymphocytes can affect the development of antibodies (34). In this sense, it is known that human coronavirus infections occasionally fails to generate protective immunity due to a poor adaptive immune response (35–38). This may be due to an insufficient durability or magnitude of the T cell response as the production of neutralizing antibodies is dependent on the T cell response (39, 40). In agreement, Grifoni and colleagues recently showed that the antibody response to SARS-CoV-2 correlated positively with the magnitude of the Th1 response (41).
To further investigate the relationship between immune responses and COVID-19 disease severity, we used death as a marker of severity. In regard to lymphocytes, the percentage of lymphocytes, T cells, CD4+ T cells, and CD8+ T cells was significantly elevated in survivors (Table 5). Moreover, the percentages of HLA-DR+CD4+, PD-1+CD4+, and PD-1+CD8+ T cells were notably raised in the group of patients that died (Table 5). PD-1 is a marker of exhausted T cells and is induced in response to continuous stimulation as occurs in chronic infections and cancer (42). In the case of SARS-CoV-2, the virus could be persistently stimulating T lymphocytes, inducing the exhausted state (27).
With regard to the expression of HLA-DR on CD4 and CD8 lymphocytes, it should be noted that in the large majority of patients there was either no or only a minimally significant increase in this marker which is in agreement with Mathew et al. (21). These authors show that the immune response is quite diverse and thus, while a subgroup of patients had T cell activation characteristic of acute viral infection another subgroup had lymphocyte activation comparable to uninfected subjects. This lack of activation contrasts with that observed in the course of other viral infections, which is very prolonged and stable over time (43–45). However, it should be noted that patients with a significant increase in HLA-DR exhibited a more aggressive disease course (Figure 1B). Interestingly, we found that COVID-19 patients with neutrophilia, lymphopenia and a more pronounced alteration in the biochemical parameters associated to inflammation had a higher percentage of CD4+ T cells with expression of activation markers HLA-DR and CD38. It is possible that the appearance of HLA-DR in patients with more intense lymphopenia could be due to an expression induced by inflammatory cytokines and is therefore not indicative of antigen-specific activation. It is therefore possible that the expression of HLA-DR is a consequence of dysregulated inflammation and the recruitment of inflammatory myeloid cells (21) and, hence its observation in the context of neutrophilia (Table 2). The increased inflammatory state induces the generation of neutrophils through the production of G-CSF, the regulation of the expression of chemoattractants and the activity of neutrophils (46). The positive relationship found between neutrophils and acute phase proteins can be explained too by the inflammatory state (47). The production of acute phase proteins such as ferritin and CRP, in addition to affecting the balance between the pro and anticoagulative pathways (increasing the D-dimer) (48, 49), can induce apoptosis in lymphocytes (13, 50). The study of ROC curves showed that troponin I, CRP, D-dimer, and LDH concentrations at hospital admission can be used as predictors of death. Measuring lymphocytes, HLA-DR+CD4+ T cells, or PD-1+CD4+ T cells could also be useful for the prediction of a fatal outcome. Our results also indicate that an elevated SOFA score at hospital admission is associated with an unfavorable prognosis.
Our study has some limitations. Firstly, we have not included a group of PCR-positive patients (asymptomatic or with mild symptoms) that did not require hospitalization. This group could have clarified the apparent contradictory relevance of HLA-DR/CD38 expression on CD4+ T cells. Secondly, considering the obtained results, it would have been informative to measure the levels of IFN-γ in the serum of the patients in order to compare it to the levels of Th1 cells. Furthermore, it would have been interesting to compare the changes in Th1 cells with the levels of viremia.
In conclusion, the decrease of Th1 cells in COVID-19 infection, especially in older patients, is related to the clinical course of disease. Assuming that virus-induced IFN-γ production is essential for the anti-viral response, a profound decrease in the proportion of Th1 cells in combination with the highest levels of cells in a non-functional effector state, represent an unfavorable scenario for COVID-19 patients, especially for those with a strong lymphopenia. Another important finding of this study are the description of parameters associated with a fatal outcome to COVID-19, including a high neutrophil/lymphocyte ratio, expression of PD-1 on CD4+ and CD8+ lymphocytes, and the expression of HLA-DR on CD4+ T cells in patients with a marked lymphopenia. These changes occur in the context of biochemical indicators associated with a clinical inflammatory syndrome.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by Portal de Ética de la Investigación Biomédica. Junta de Andalucía (Cod. 0766-N-20). The patients/participants provided their written informed consent to participate in this study.
Author Contributions
FR-C and PJ contributed to the design of the study. JG-B, PJ, FR-C, and AR-N performed the flow cytometry. JG-B and AR-N performed the analysis of the data obtained by cytometry. JG-B and AR-C built the clinical database. AR-N performed the statistical analysis of the data. ML-R and JG-B collected samples from non-ICU hospitalized patients, UCI hospitalized patients, asymptomatic recovered donors, and healthy donors. FR-C, AR-N, JG-B, PJ, and PA wrote the manuscript. AR-C and ML-R contributed to the clinical follow-up of patients. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by grants from the Instituto de Salud Carlos III co-financed by FEDER funds (European Union) (PI 16/00752) and Junta de Andalucía in Spain (Group CTS-143). PA is supported by the Consejería de Salud, Junta de Andalucía through the contract “Nicolás Monardes” [C-0013-2018]. This study was partially financed by Becton Dickinson.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors thank Pilar González, Alicia Aybar, Antonia Baca, and Dolores Maciá for technical assistance and Sonia Antequera for the design of the pictures. This study is part of the doctoral thesis of Juan Francisco Gutiérrez-Bautista, Programa de doctorado en Biomedicina, University of Granada, Granada, Spain.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fimmu.2020.596553/full#supplementary-material
References
1. Sohrabi C, Alsafi Z, O’Neill N, Khan M, Kerwan A, Al-Jabir A, et al. World Health Organization declares global emergency: A review of the 2019 novel coronavirus (COVID-19). Int J Surg (2020) 76:71–6. doi: 10.1016/j.ijsu.2020.02.034
2. World Health Organization. Coronavirus disease. Coronavirus Dis Situat Rep – (2020) 119(2019):2633. doi: 10.1001/jama.2020.2633
3. Chang L, Yan Y, Wang L. Coronavirus Disease 2019: Coronaviruses and Blood Safety. Transfus Med Rev (2020) 34:75–80. doi: 10.1016/j.tmrv.2020.02.003
4. Andersen KG, Rambaut A, Lipkin WI, Holmes EC, Garry RF. The proximal origin of SARS-CoV-2. Nat Med (2020) 26:450–2. doi: 10.1038/s41591-020-0820-9
5. Lai CC, Shih TP, Ko WC, Tang HJ, Hsueh PR. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and coronavirus disease-2019 (COVID-19): The epidemic and the challenges. Int J Antimicrob Agents (2020) 55:105924. doi: 10.1016/j.ijantimicag.2020.105924
6. Walls AC, Park YJ, Tortorici MA, Wall A, McGuire AT, Veesler D. Structure, Function, and Antigenicity of the SARS-CoV-2 Spike Glycoprotein. Cell (2020) 181:281–92.e6. doi: 10.1016/j.cell.2020.02.058
7. Hoffmann M, Kleine-Weber H, Schroeder S, Krüger N, Herrler T, Erichsen S, et al. SARS-CoV-2 Cell Entry Depends on ACE2 and TMPRSS2 and Is Blocked by a Clinically Proven Protease Inhibitor. Cell (2020) 181:271–80.e8. doi: 10.1016/j.cell.2020.02.052
8. Xu H, Zhong L, Deng J, Peng J, Dan H, Zeng X, et al. High expression of ACE2 receptor of 2019-nCoV on the epithelial cells of oral mucosa. Int J Oral Sci (2020) 12:1–5. doi: 10.1038/s41368-020-0074-x
9. Pascarella G, Strumia A, Piliego C, Bruno F, Del Buono R, Costa F, et al. COVID-19 diagnosis and management: a comprehensive review. J Intern Med (2020) 288(2):1–15. doi: 10.1111/joim.13091
10. Galluccio F, Ergonenc T, Garcia Martos A, Allam AES, Pérez-Herrero M, Aguilar R, et al. Treatment algorithm for COVID-19: a multidisciplinary point of view. Clin Rheumatol (2020) 39:2077–84. doi: 10.1007/s10067-020-05179-0
11. Singhal T. A Review of Coronavirus Disease-2019 (COVID-19). Indian J Pediatr (2020) 87:281–6. doi: 10.1007/s12098-020-03263-6
12. Henderson LA, Canna SW, Schulert GS, Volpi S, Lee PY, Kernan KF, et al. On the alert for cytokine storm: Immunopathology in COVID-19. Arthritis Rheumatol (2020) 72:1059–63. doi: 10.1002/art.41285
13. Ye Q, Wang B, Mao J. The pathogenesis and treatment of the ‘Cytokine Storm’’ in COVID-19.’ J Infect (2020) 80:607–13. doi: 10.1016/j.jinf.2020.03.037
14. Guan W, Ni Z, Hu Y, Liang W, Ou C, He J, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med (2020) 382:1708–20. doi: 10.1056/NEJMoa2002032
15. Fathi N, Rezaei N. Lymphopenia in COVID-19: Therapeutic opportunities. Cell Biol Int (2020) 44(9):1792–7. doi: 10.1002/cbin.11403
16. Li L-Q, Huang T, Wang Y-Q, Wang Z-P, Liang Y, Huang T-B, et al. COVID-19 patients’ clinical characteristics, discharge rate, and fatality rate of meta-analysis. J Med Virol (2020) 92:577–83. doi: 10.1002/jmv.25757
17. Tan L, Wang Q, Zhang D, Ding J, Huang Q, Tang YQ, et al. Lymphopenia predicts disease severity of COVID-19: a descriptive and predictive study. Signal Transduct Target Ther (2020) 5:16–8. doi: 10.1038/s41392-020-0148-4
18. Romagnani S. T-cell subsets (Th1 versus Th2). Ann Allergy Asthma Immunol Off Publ Am Coll Allergy Asthma Immunol (2000) 85:9–18; quiz 18, 21. doi: 10.1016/S1081-1206(10)62426-X
19. Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, et al. (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med (1996) 22:707–10. doi: 10.1007/BF01709751
20. Botafogo V, Pérez-Andres M, Jara-Acevedo M, Bárcena P, Grigore G, Hernández-Delgado A, et al. Age Distribution of Multiple Functionally Relevant Subsets of CD4+ T Cells in Human Blood Using a Standardized and Validated 14-Color EuroFlow Immune Monitoring Tube. Front Immunol (2020) 11:166. doi: 10.3389/fimmu.2020.00166
21. Mathew D, Giles JR, Baxter AE, Greenplate AR, Wu JE, Alanio C, et al. Deep immune profiling of COVID-19 patients reveals patient heterogeneity and distinct immunotypes with implications for therapeutic interventions. BioRxiv Prepr Serv Biol (2020) 369(6508):eabc8511. doi: 10.1101/2020.05.20.106401
22. Qin C, Zhou L, Hu Z, Zhang S, Yang S, Tao Y, et al. Dysregulation of immune response in patients with COVID-19 in Wuhan, China. Clin Infect Dis (2020) 2019:4–10. doi: 10.1093/cid/ciaa248
23. Moore JB, June CH. Cytokine release syndrome in severe COVID-19. Sci (80 ) (2020) 368:473–4. doi: 10.1126/science.abb8925
24. Li H, Liu L, Zhang D, Xu J, Dai H, Tang N, et al. SARS-CoV-2 and viral sepsis: observations and hypotheses. Lancet (2020) 395:1517–20. doi: 10.1016/S0140-6736(20)30920-X
25. Zhou P, Yang XL, Wang XG, Hu B, Zhang L, Zhang W, et al. A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature (2020) 579:270–3. doi: 10.1038/s41586-020-2012-7
26. Fischer K, Hoffmann P, Voelkl S, Meidenbauer N, Ammer J, Edinger M, et al. Inhibitory effect of tumor cell-derived lactic acid on human T cells. Blood (2007) 109:3812–9. doi: 10.1182/blood-2006-07-035972
27. Diao B, Wang C, Tan Y, Chen X, Liu Y, Ning L, et al. Reduction and Functional Exhaustion of T Cells in Patients With Coronavirus Disease 2019 (COVID-19). Front Immunol (2020) 11:827. doi: 10.3389/fimmu.2020.00827
28. Sercan Ö, Stoycheva D, Hämmerling GJ, Arnold B, Schüler T. IFN-γ Receptor Signaling Regulates Memory CD8 + T Cell Differentiation. J Immunol (2010) 184:2855–62. doi: 10.4049/jimmunol.0902708
29. Cacciapuoti S, De Rosa A, Gelzo M, Megna M, Raia M, Pinchera B, et al. Immunocytometric analysis of COVID patients: A contribution to personalized therapy? Life Sci (2020) 261:118355. doi: 10.1016/j.lfs.2020.118355
30. Mazzoni A, Salvati L, Maggi L, Capone M, Vanni A, Spinicci M, et al. Impaired immune cell cytotoxicity in severe COVID-19 is IL-6 dependent. J Clin Invest (2020) 130:4694–703. doi: 10.1172/JCI138554
31. Chen G, Wu D, Guo W, Cao Y, Huang D, Wang H, et al. Clinical and immunological features of severe and moderate coronavirus disease 2019. J Clin Invest (2020) 130:2620–9. doi: 10.1172/JCI137244
32. Sattler A, Angermair S, Stockmann H, Heim KM, Khadzhynov D, Treskatsch S, et al. SARS-CoV-2 specific T-cell responses and correlations with COVID-19 patient predisposition. J Clin Invest (2020). doi: 10.1172/JCI140965
33. Roncati L, Lusenti B. The «moonlighting protein» able to explain the T(h)1 immune lockdown in severe COVID-19. Med Hypotheses (2020) 143:110087. doi: 10.1016/j.mehy.2020.110087
34. Zohar T, Alter G. Dissecting antibody-mediated protection against SARS-CoV-2. Nat Rev Immunol (2020) 20:392–4. doi: 10.1038/s41577-020-0359-5
35. Zhao J, Alshukairi AN, Baharoon SA, Ahmed WA, Bokhari AA, Nehdi AM, et al. Recovery from the Middle East respiratory syndrome is associated with antibody and T cell responses. Sci Immunol (2017) 2:1–11. doi: 10.1126/sciimmunol.aan5393
36. Raj S, Widjaja I, de Bruin E, Farag E, Al-Hajri M, Bosch B, et al. Sensitive and Specific Detection of Low-Level Antibody Responses in Mild Middle East Respiratory Syndrome Coronavirus Infections. Emerg Infect Dis (Open Access) (2019) 25:1868–77. doi: 10.3201/eid2509.190051
37. Choe PG, Perera RAPM, Park WB, Song KH, Bang JH, Kim ES, et al. MERS-CoV antibody responses 1 year after symptom onset, South Korea, 2015. Emerg Infect Dis (2017) 23:1079–84. doi: 10.3201/eid2307.170310
38. Callow KA, Parry HF, Sergeant M, Tyrrell DAJ. The time course of the immune response to experimental coronavirus infection of man. Epidemiol Infect (1990) 105:435–46. doi: 10.1017/S0950268800048019
39. Crotty S. T Follicular Helper Cell Biology: A Decade of Discovery and Diseases. Immunity (2019) 50:1132–48. doi: 10.1016/j.immuni.2019.04.011
40. Zhao J, Zhao J, Mangalam AK, Channappanavar R, Fett C, Meyerholz DK, et al. Airway Memory CD4+ T Cells Mediate Protective Immunity against Emerging Respiratory Coronaviruses. Immunity (2016) 44:1379–91. doi: 10.1016/j.immuni.2016.05.006
41. Grifoni A, Weiskopf D, Ramirez SI, Mateus J, Dan JM, Moderbacher CR, et al. Targets of T Cell Responses to SARS-CoV-2 Coronavirus in Humans with COVID-19 Disease and Unexposed Individuals. Cell (2020) 181:1489–501.e15. doi: 10.1016/j.cell.2020.05.015
42. McLane LM, Abdel-Hakeem MS, Wherry EJ. CD8 T Cell Exhaustion During Chronic Viral Infection and Cancer. Annu Rev Immunol (2019) 37:457–95. doi: 10.1146/annurev-immunol-041015-055318
43. McElroy AK, Akondy RS, Davis CW, Ellebedy AH, Mehta AK, Kraft CS, et al. Human Ebola virus infection results in substantial immune activation. Proc Natl Acad Sci USA (2015) 112:4719–24. doi: 10.1073/pnas.1502619112
44. Ndhlovu ZM, Kamya P, Mewalal N, Kløverpris HN, Nkosi T, Pretorius K, et al. Magnitude and Kinetics of CD8+ T Cell Activation during Hyperacute HIV Infection Impact Viral Set Point. Immunity (2015) 43:591–604. doi: 10.1016/j.immuni.2015.08.012
45. Chandele A, Sewatanon J, Gunisetty S, Singla M, Onlamoon N, Akondy RS, et al. Characterization of Human CD8 T Cell Responses in Dengue Virus-Infected Patients from India. J Virol (2016) 90:11259–78. doi: 10.1128/jvi.01424-16
46. Barnes BJ, Adrover JM, Baxter-Stoltzfus A, Borczuk A, Cools-Lartigue J, Crawford JM, et al. Targeting potential drivers of COVID-19: Neutrophil extracellular traps. J Exp Med (2020) 217:1–7. doi: 10.1084/jem.20200652
47. Mehta P, McAuley DF, Brown M, Sanchez E, Tattersall RS, Manson JJ. COVID-19: consider cytokine storm syndromes and immunosuppression. Lancet (London England) (2020) 395:1033–4. doi: 10.1016/S0140-6736(20)30628-0
48. Connors JM, Levy JH. COVID-19 and its implications for thrombosis and anticoagulation. Blood (2020) 135:2033–40. doi: 10.1182/blood.2020006000
49. Giannis D, Ziogas IA, Gianni P. Coagulation disorders in coronavirus infected patients: COVID-19, SARS-CoV-1, MERS-CoV and lessons from the past. J Clin Virol Off Publ Pan Am Soc Clin Virol (2020) 127:104362. doi: 10.1016/j.jcv.2020.104362
Keywords: T-CD8 lymphocytes flow cytometric immunophenotyping, Th lymphocytes, T cell response, severe acute respiratory syndrome coronavirus 2, severe coronavirus disease 2019
Citation: Gutiérrez-Bautista JF, Rodriguez-Nicolas A, Rosales-Castillo A, Jiménez P, Garrido F, Anderson P, Ruiz-Cabello F and López-Ruz MÁ (2020) Negative Clinical Evolution in COVID-19 Patients Is Frequently Accompanied With an Increased Proportion of Undifferentiated Th Cells and a Strong Underrepresentation of the Th1 Subset. Front. Immunol. 11:596553. doi: 10.3389/fimmu.2020.596553
Received: 19 August 2020; Accepted: 03 November 2020;
Published: 26 November 2020.
Edited by:
Dong-Ming Su, University of North Texas Health Science Center, United StatesReviewed by:
In-Woo Park, University of North Texas Health Science Center, United StatesHu Zeng, Mayo Clinic, United States
Copyright © 2020 Gutiérrez-Bautista, Rodriguez-Nicolas, Rosales-Castillo, Jiménez, Garrido, Anderson, Ruiz-Cabello and López-Ruz. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Francisco Ruiz-Cabello, ZnJ1aXpjQHVnci5lcw==