Skip to main content

ORIGINAL RESEARCH article

Front. Microbiol., 06 October 2022
Sec. Virology
This article is part of the Research Topic The Interaction between Host and Viruses causing Respiratory or Gastrointestinal Tract Infections in Humans View all 3 articles

Neutrophil-to-lymphocyte ratio as a potential biomarker in predicting influenza susceptibility

\nGuoyun Wang,Guoyun Wang1,2Cheng LvCheng Lv1Cheng Liu,Cheng Liu3,4Wenjun Shen,
Wenjun Shen1,4*
  • 1Department of Bioinformatics, Shantou University Medical College, Shantou, China
  • 2Shenzhen Qianhai Shekou Free Trade Zone Hospital, Shenzhen, China
  • 3Department of Computer Science, Shantou University, Shantou, China
  • 4Guangdong Provincial Key Laboratory of Infectious Diseases and Molecular Immunopathology, Shantou, China

Background: Human population exposed to influenza viruses exhibited wide variation in susceptibility. The ratio of neutrophils to lymphocytes (NLR) has been examined to be a marker of systemic inflammation. We sought to investigate the relationship between influenza susceptibility and the NLR taken before influenza virus infection.

Methods: We investigated blood samples from five independent influenza challenge cohorts prior to influenza inoculation at the cellular level by using digital cytometry. We used multi-cohort gene expression analysis to compare the NLR between the symptomatic infected (SI) and asymptomatic uninfected (AU) subjects. We then used a network analysis approach to identify host factors associated with NLR and influenza susceptibility.

Results: The baseline NLR was significantly higher in the SI group in both discovery and validation cohorts. The NLR achieved an AUC of 0.724 on the H3N2 data, and 0.736 on the H1N1 data in predicting influenza susceptibility. We identified four key modules that were not only significantly correlated with the baseline NLR, but also differentially expressed between the SI and AU groups. Genes within these four modules were enriched in pathways involved in B cell-mediated immune responses, cellular metabolism, cell cycle, and signal transduction, respectively.

Conclusions: This study identified the NLR as a potential biomarker for predicting disease susceptibility to symptomatic influenza. An elevated NLR was detected in susceptible hosts, who may have defects in B cell-mediated immunity or impaired function in cellular metabolism, cell cycle or signal transduction. Our work can serve as a comparative model to provide insights into the COVID-19 susceptibility.

1. Introduction

Influenza viruses are highly contagious human respiratory pathogens that cause recurrent epidemics and occasional global pandemics. Seasonal influenza vaccines are traditionally trivalent and include components of influenza A viruses of the H1N1 and H3N2 subtypes and an influenza B virus. The pandemic influenza A(H1N1)pdm09 virus gave rise to the first influenza pandemic of the twenty-first century. The subtype H3N2 has been the most frequently occurring seasonal influenza since 1968, causing a significant threat to public health. Human population exposed to influenza viruses exhibited wide variation in susceptibility (Clohisey and Baillie, 2019). Earlier studies demonstrated that host factors, such as age, pregnancy, obesity, cardiovascular disease, and host genetics (Horby et al., 2012, 2013; Mertz et al., 2013; Patarčić et al., 2015), played a critical role in susceptibility to influenza viruses. In addition, several host factors of preexisting immune cell composition in blood have now been reported to associate with influenza susceptibility. The proportions of pre-existing CD4+ T cells recognizing nucleoprotein and matrix were inversely associated with total symptom scores and virus shedding of H3N2 (Wilkinson et al., 2012). The subjects having a higher proportion of pre-existing CD8+ T cells to conserved viral epitopes developed less severe illness after A(H1N1)pdm09 infection (Sridhar et al., 2013). Moreover, the proportion of KLRD1-expressing natural killer cells at baseline (i.e., prior to exposure to influenza) was lower in symptomatic shedders compared to asymptomatic nonshedders who were inoculated with H3N2 or H1N1 influenza (Bongen et al., 2018).

When there is local infection, various leukocyte populations are recruited to the infection site which is a critical early component of inflammatory responses (Luster et al., 2005; Leick et al., 2014). Neutrophils are the most abundant leukocytes in the circulation and the first to be recruited to the site of infection where they enhance local innate responses (Rosales, 2018). The innate immune system not only responses quickly to invasion by an infectious agent but also plays essential roles in activating adaptive immune responses (Clark and Kupper, 2005; Mantovani et al., 2011). While innate cells at the infection site (resident innate cells and newly recruited neutrophils) are generating antimicrobial and pro-inflammatory responses that will slow down the infection, they are also initiating steps to deliver the pathogens to lymphoid tissues where lymphocytes (T and B cells) can recognize them and generate adaptive immune responses (Schmolke and Garćıa-Sastre, 2010; Hufford et al., 2012; Chen et al., 2018). Innate immune responses and the inflammatory responses play critical roles in eliminating infections but also can be harmful when not adequately controlled. Overproduction of various normally beneficial mediators and uncontrolled local or systemic responses can cause illness and even death (Chen and Nuñez, 2010; Brandes et al., 2013). Prior studies have revealed that the host's inflammatory responses were likely to influence both the likelihood of influenza virus infection and disease severity (Hayden et al., 1998; Julkunen et al., 2000; Price et al., 2015). When the baseline levels of systemic inflammation increased, the host may be excessively susceptible to influenza virus infection (Clohisey and Baillie, 2019). The neutrophil-to-lymphocyte ratio (NLR), the ratio of the absolute neutrophil and lymphocyte counts, which can be measured during routine hematology is a simple and reliable method to evaluate the extent of systemic inflammation (Zahorec, 2001). The NLR was examined as a new prospective marker to estimate systemic inflammation and clinical outcomes in cancer patients (Templeton et al., 2014; Faria et al., 2016; Howard et al., 2019). A few studies have also reported the roles of NLR in influenza virus infection. For patients infected with avian influenza virus H7N9, the NLR taken within 24 h after admission was found to be independently associated with fatality (Zhang et al., 2019). Moreover, the NLR can be used to predict swine influenza virus infection among patients presenting with influenza like symptoms while awaiting throat swab culture and virus isolation reports (Indavarapu and Akinapelli, 2011). In patients with influenza virus infection, excessive neutrophil activation was examined to predict fatal outcome, and neutrophil-related host factors were associated with severe disease (Tang et al., 2019). Previous studies have observed a decline in lymphocyte count in patients infected with influenza virus (Chen et al., 2014; Shen et al., 2014). Both host's inflammatory responses and immune responses played essential roles in the likelihood of influenza virus infection and disease severity. The NLR which conjugates two interconnected arms of the immune system: innate immunity and adaptive immunity is an emerging biomarker of the relationships between the immune system and diseases. However, the relationship between influenza susceptibility and the baseline levels of the NLR has not been systematic investigated so far.

Digital cytometry, which quantifies cell type composition in a sample by using computational methods, allows interpretation of heterogeneous bulk blood or solid tissue transcriptomes at the cellular level. CIBERSORTx is a widely used computational method to deconvolve cell type composition and proportions (Newman et al., 2019). Existing cell type deconvolution methods normally require a signature matrix which is a collection of cell type-specific gene expression profiles. The signature matrix has been examined to determine the accuracy of deconvolution (Vallania et al., 2018). Thus, we combined CIBERSORTx with three well-defined immune signature matrices (Newman et al., 2015; Vallania et al., 2018; Monaco et al., 2019), respectively, to get reliable estimates of the NLR.

In this study, we performed a systematic investigation of the relationship between influenza susceptibility and the baseline NLR. Herein, we utilized digital cytometry to investigate heterogeneity of blood immune cell populations prior to infection. Using multi-cohort gene expression analysis, we found that the baseline NLR was significantly higher in symptomatic infected group compared to asymptomatic uninfected group. We then used a network analysis approach to identify host factors which were statistically significantly associated with the baseline NLR, and to detect several key biological pathways that may contribute to disease susceptibility to symptomatic influenza.

2. Results

2.1. Description of experimental human influenza challenge cohorts

We collected 5 human influenza virus challenge cohorts from the NCBI Gene Expression Omnibus (GEO) database. For each influenza challenge cohort, healthy adults (aged 18–45) were inoculated with A/Wisconsin/67/2005 (H3N2) or A/Brisbane/59/2007 (H1N1) influenza, and genome-wide gene expression profiles from peripheral blood collected prior to influenza challenge and the subsequent 2–7 days were assessed. All volunteers were selected based on low pre-existing immunity to the challenge virus. Subjects were classified as symptomatic or asymptomatic based on a modified Jackson score calculated from self-reported daily symptoms (Jackson et al., 1958). The infected and uninfected classification were determined by viral titers from nasopharyngeal washes using virus quantitative culture or virus quantitative PCR (Liu et al., 2016). We only considered samples from subjects whose viral titer and symptom status agree, i.e., those who were either asymptomatic and uninfected (AU) or symptomatic and infected (SI). The GSE73072 data set was profiled using Affymetrix microarrays, and it included four challenge studies which were referred to as DEE2 (H3N2), DEE5 (H3N2), DEE3 (H1N1), and DEE4 (H1N1). We utilized all samples taken before inoculation as baseline samples. The baseline samples for the DEE2 cohort were taken at −23 h post-inoculation (hpi) or immediately prior to inoculation (0 hpi), and those for the DEE5, DEE3, and DEE4 cohorts were taken at −30, −21 or 0, and −21 or 0 hpi, respectively. The baseline samples of DEE2 (H3N2) and DEE5 (H3N2) challenge studies were used as discovery cohorts, and those of the DEE3 (H1N1), DEE4 (H1N1) were used as validation cohorts. In addition, we utilized baseline samples of the GSE61754 cohort, which was profiled by Illumina microarrays as a cross-platform validation cohort. Table 1 summarizes the infection data for these included influenza challenge cohorts.

TABLE 1
www.frontiersin.org

Table 1. Characteristics of included influenza challenge cohorts taken as baseline.

2.2. Dissecting immune cell composition from whole blood samples

To explore the relationship across all samples prior to inoculation, we performed clustering analyses on the batch corrected profiles in the GSE73072 H3N2 and H1N1 cohorts, respectively (Figures 1A,B). We conducted hierarchical clustering on samples based on similarities in the top 5,000 gene expressions with the highest variance. This preliminary examination indicated that expression profiles differed between the SI and AU groups prior to inoculation (Figures 1C,D).

FIGURE 1
www.frontiersin.org

Figure 1. Clustering analyses on the batch corrected profiles in the GSE73072 H3N2 and H1N1 cohorts. PCA analyses of GSE73072 H3N2 (A) and H1N1 (B) cohorts before and after batch effect correction. Clustering on the samples prior to inoculation in GSE73072 H3N2 (C) and H1N1 (D) cohorts.

We next performed digital cytometry to investigate heterogeneity of blood immune cell populations prior to inoculation (Figure 2A). To accurately dissect immune cell composition of whole blood samples from healthy subjects inoculated with live H1N1 or H3N2 influenza, we applied CIBERSORTx to expression profiles of whole blood samples by using a well-defined signature matrix named as sigmatrixMicro from a previous study (Monaco et al., 2019; see Section 4 for details). Among 11 immune cell populations dissected from whole blood samples, we observed that neutrophils were consistently dominant across five challenge cohorts, followed by T cells, monocytes, B cells, and NK cells (Figure 2B).

FIGURE 2
www.frontiersin.org

Figure 2. Deconvolution of immune cell populations from gene expression data. (A) Deconvolution of immune cell populations reveals difference in NLR between SI and AU groups. (B) The relative abundance of 11 immune cell populations.

2.3. Variation in baseline NLR

Neutrophils and lymphocytes were the two most common leukocytes in the blood. We therefore performed comparable analyses for the estimated lymphocyte and neutrophil proportions between the SI and AU groups in baseline samples. We found that proportions of lymphocytes were significantly lower (p < 0.01; Figure 3A) whereas proportions of neutrophils were significantly higher (p < 0.05; Figure 3A) at baseline in the SI group compared to the AU group in the GSE73072 cohort for H3N2 influenza. We also observed significantly lower lymphocyte (p < 0.05; Figure 3B) but higher neutrophil proportions (p < 0.01; Figure 3B) at baseline in the SI group in the GSE73072 cohort inoculated for H1N1 influenza. For the GSE61754 cohort, we observed the same trend, though these differences were not statistically significant (p≥0.05; Figure 3C).

FIGURE 3
www.frontiersin.org

Figure 3. Differences in estimated lymphocyte and neutrophil proportions at baseline between SI and AU groups in the discovery (A) and validation cohorts (B,C).

The ratio of neutrophils to lymphocytes (NLR) were assessed, which was defined as the ratio of the estimated neutrophil and lymphocyte proportions. We found that the SI group had significantly higher baseline NLR than the AU group (p = 0.004; Figure 4A) in the discovery cohort. Higher baseline NLR in the SI group was also validated in the GSE73072 (H1N1) cohort (p = 0.0065; Figure 4B) and GSE61754 cohort (p = 0.28; Figure 4C). Although the difference in the GSE61754 cohort was not statistically significant, the baseline NLR was also higher in the SI group. In the GSE61754 cohort, 7 of 15 volunteers were vaccinated with a novel influenza vaccine MVA-NP+M1 30 days prior to influenza challenge (Davenport et al., 2015). The MVA-NP+M1 was designed to boost cross-reactive T-cell responses to antigens that were conserved across all subtypes (Lillie et al., 2012). Correspondingly, a markedly elevated memory T cell proportion was detected In the GSE61754 cohort (Figure 2B). Two of seven vaccinees developed laboratory-confirmed influenza (symptomatic infection) after challenge. We analyzed the baseline NLR between the SI and AU groups with pre-existing elevated memory T cells. The baseline NLR was still higher in the SI group, but not reached statistical significance because of the small sample size (p = 0.19; Figure 4D).

FIGURE 4
www.frontiersin.org

Figure 4. Differences in estimated baseline NLR between AU and SI groups in the discovery (A) and validation cohorts (B–D).

We further performed a multi-cohort meta-analysis to evaluate the differences in baseline NLR between the SI and AU groups. A forest plot of estimated differences on all five challenge cohorts indicated the baseline NLR was significantly higher in the SI group (Hedges'g = 0.96, 95% CI = 0.54–1.38, p < 0.0001; Figure 5A). Robust in silico quantification of immune cell populations from peripheral blood requires a signature matrix and a deconvolution method, and the deconvolution accuracy is largely determined by a signature matrix but not a deconvolution method (Vallania et al., 2018). Therefore, two additional signature matrices of immunoStates and LM22 were tested. Differences in estimated baseline NLR were also validated by combining CIBERSORTx with immunoStates and LM22, respectively. We observed that the baseline NLR was still significantly higher in the SI group by using immunoStates (Hedges'g = 0.83, 95% CI = 0.42–1.24, p < 0.0001; Figure 5B) or LM22 (Hedges'g = 0.86, 95% CI = 0.32–1.40, p = 0.002; Figure 5C) as a signature matrix.

FIGURE 5
www.frontiersin.org

Figure 5. Forest plot for the baseline NLR differences between SI and AU groups in five challenge cohorts. (A) SigmatrixMicro. (B) ImmunoStates. (C) LM22.

In addition, area under the receiver operating characteristic curve (AUC) analysis showed that the baseline NLR predicted influenza susceptibility (SI/AU) in both the challenge cohorts for H3N2 (AUC 0.724, 95% CI: 0.593–0.854; Figure 6A) and H1N1 (AUC 0.736, 95% CI: 0.593–0.878; Figure 6B) influenza.

FIGURE 6
www.frontiersin.org

Figure 6. Receiver operating characteristic curve showing the performance of the baseline NLR for predicting influenza susceptibility on the H3N2 (A) and H1N1 (B) cohorts.

2.4. NLR increases in peripheral blood after influenza virus infection

To examine concordance between proportions of neutrophil/lymphocyte measured through standard laboratory workout and the deconvolution estimates, we correlated the laboratory measurements with deconvolution estimates in the SI group of influenza H3N2. We collected the laboratory measurements of neutrophil/lymphocyte proportions from Table S6 of a previous published study (Huang et al., 2011), in which they involved the same volunteers included in the GSE73072 H3N2 cohort. The laboratory measurements of neutrophil/lymphocyte proportions were obtained daily from day 1 to 7 including baseline (prior to inoculation). In the SI group of GSE73072 H3N2 cohort, the mean estimated proportions of neutrophil/lymphocyte were strongly positively correlated with the laboratory measurements (Neutrophil: R = 0.93, p = 0.00079, Figure 7A; Lymphocyte: R = 0.95, p = 0.00035, Figure 7B). These data further validate the deconvolution approach can correctly estimate the proportions of neutrophil and lymphocyte, as well as the NLR.

FIGURE 7
www.frontiersin.org

Figure 7. Correlation between laboratory measured and estimated proportions of neutrophil (A) and lymphocyte (B) in SI group of influenza H3N2. Data points are labeled by the day post inoculation. Baseline represents prior to inoculation and day 1 represents the day of inoculation.

We further investigated the temporal alterations of the neutrophil/lymphocyte proportions by influenza virus infection. In the GSE73072 H3N2 cohort, we observed that subjects in the AU group demonstrated no significant changes in the neutrophil/lymphocyte proportions at any time post-inoculation (Figures 8A,B). However, subjects in the SI group underwent a slightly drop in the neutrophil proportion by 12 hpi in the early stage and then a significantly rise by day 2 post-inoculation, while experience a concomitant rise and fall in the lymphocyte proportions (Figures 8A,B). The temporal changes in the neutrophil/lymphocyte proportions we estimated using digital cytometry method were consistent with the changes detected using white blood cell counts in laboratory measurements (Figures 7A,B) (Douglas et al., 1966; Huang et al., 2011; McClain et al., 2013). Our findings parallel the observation of a relative lymphopenia/neutrophilia in influenza virus infection, caused by a leukocyte redistribution between blood, lymph nodes, and tissues. This redistribution is usually transient and profound changes appear on day 2 post-infection (Music et al., 2016).

FIGURE 8
www.frontiersin.org

Figure 8. Temporal changes in white blood cell proportions among volunteers after inoculation with influenza virus. (A,B) Temporal changes in neutrophil/lymphocyte proportions in the GSE73072 H3N2 cohort. (C–E) Temporal changes in NLR among individuals in three cohorts.

For the temporal alterations of the NLR by influenza virus infection, in both the discovery (Figure 8C) and validation cohorts (Figures 8D,E), we observed that subjects in the AU group demonstrated no significant changes at any time post-inoculation, while those in the SI group underwent a significantly rise by days 2–3 post-inoculation and then gradually returned to baseline by day 7 post-inoculation as symptoms resolved.

In the GSE111368 data set, samples of 94 adult patients hospitalized with A(H1N1)pdm09 influenza virus infection were collected at three time points T1 (recruitment), T2 (~2 days after T1), and T3 (at least 4 weeks after T1) covering the periods of influenza illness and clinical recovery. We observed that infected patients developed a significant increase in the NLR (Figure 9A) and neutrophil proportion (Figure 9B) compared to healthy control subjects (HC) during the period of influenza illness (T1 and T2), whereas there was no significant difference in the NLR compared to HC once the patients had clinically recovered (T3). An opposite alteration in lymphocyte proportion was detected (Figure 9C). The temporal changes in the neutrophil/lymphocyte proportions and the NLR among patients hospitalized with influenza were consistent with the changes detected in the influenza challenge cohorts.

FIGURE 9
www.frontiersin.org

Figure 9. Temporal changes in NLR (A), neutrophil (B), and lymphocyte (C) proportions among patients hospitalized with influenza.

2.5. Network analysis identified four disease modules associated with baseline NLR

To investigate disease modules associated with the baseline NLR, we performed gene co-expression network analysis in the discovery cohort using WGCNA (Zhang and Horvath, 2005; Figure 10). WGCNA constructs a network based on the pairwise correlations between gene expression profiles. It has been demonstrated that batch effects can lead to false correlations between gene expression profiles, thus introduced false edge connections or lose true edge connections (Parsana et al., 2019). Principal component analysis (PCA) revealed that both the discovery and validation cohorts included two sample batches (Figures 1A,B), therefore we regressed out the batch effects using linear models and constructed co-expression networks using batch corrected profiles (see Section 4 for details).

FIGURE 10
www.frontiersin.org

Figure 10. Network analysis reveals four disease modules associated with the baseline NLR and also differentially expressed between the SI and AU groups.

The WGCNA method found clusters (modules) of genes with highly correlated expression profiles and interconnectivity across samples. Using WGCNA, we build a gene dendrogram by using the topological overlap measure (TOM) as a proximity measure. We identified modules using dynamic tree cut approach and those closely related modules whose correlations of module eigengenes larger than 0.75 were merged. We then detected 22 distinct gene modules from the dendrogram (Figure 11A). To identify modules associated with the NLR, we calculated Pearson's correlation coefficient between the module eigengenes and the NLR. Of these 22 identified modules, 12 modules were statistically significant (p < 0.05) when correlated with the NLR for H3N2 (Figure 11B). In the GSE73072 cohort for H1N1, we observed the same direction of the correlation value in 10 of these 12 modules (Figure 11B). Furthermore, significant differential expressions between the SI and AU groups were detected in 4 of these 12 modules (Figure 11C). Three modules (steelblue, darkslateblue, salmon) were negatively correlated with the NLR and significantly down-regulated in the SI group, while the blue module was positively correlated with the NLR and significantly up-regulated in the SI group (Figure 11C). All four modules also shown significant difference in the validation cohort (GSE73072 H1N1; Figure 11D). Hence, these four modules were identified as significant disease modules associated with the NLR: module steelblue with 70 genes, module darkslateblue with 1,296 genes, module salmon with 1,526 genes, and module blue with 2,388 genes in total.

FIGURE 11
www.frontiersin.org

Figure 11. Network analysis identified four disease modules associated with the NLR. (A) Gene dendrogram and co-expressed modules obtained by WGCNA. (B) Statistically significant modules correlated with the NLR. (C,D) Differential expression (DE) of SI group compared to AU group in each module in the discovery and validation cohorts (*p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001).

2.6. Functional enrichment analysis in four disease modules associated with baseline NLR

To investigate the biological functions of the four disease modules, the enrichment of Gene Ontology (GO) Biological Process and Reactome ontologies in each module were analyzed and the top terms of each category are shown in Figures 12A,B. The GO enrichment results revealed that the steelblue module was significantly enriched in B cell activation, proliferation and differentiation, and humoral immune response. The Reactome enrichment results revealed that this module was mainly enriched in B cell activation and B cell receptor signaling pathways. Both GO and Reactome enriched terms indicated that genes in the steelblue module played critical roles in B cell-mediated immune responses. For the darkslateblue module, the genes were significantly enriched in GO terms of RNA catabolic and metabolic processes, RNA processing, translational initiation, viral gene expression and transcription, and cellular respiration, and were significantly enriched in Reactome terms of rRNA processing and translation, that implied genes in this module were mainly involved in the cellular metabolism. The genes in the salmon module were significantly enriched in GO terms of RNA localization, RNA transport and DNA biosynthetic process, and were significantly enriched in Reactome terms of SUMOylation, DNA damage response and DNA repair, that indicated genes in this module were mainly involved in regulating the cell cycle. The GO enrichment results revealed that genes in the blue module were significantly enriched in regulation of membrane potential, pattern specification process, G protein-coupled receptor (GPCR) signaling pathway and regulation of ion transmembrane transport. The Reactome enrichment results revealed that genes in this module were significantly enriched in GPCR ligand binding, peptide ligand-binding receptors and anti-inflammatory cytokines production pathways. Both functional enrichment analyses indicated that genes in the blue module were mainly involved in the cellular signal transduction pathways.

FIGURE 12
www.frontiersin.org

Figure 12. Functional enriched terms in four disease modules. (A) Top 15 enriched GO terms for biological processes in four disease modules. (B) Top 10 enrichment of Reactome ontologies in four disease modules.

2.7. Host factors contribute to susceptibility of symptomatic influenza

Influenza viruses depend on the host's cellular machinery to replicate, produce, and spread progeny virus particles. Further examination of the four disease modules identified a certain number of genes encoding host factors that could contribute to individual viral susceptibility. Of the three modules significantly down-regulated in the SI group compared to the AU group, the steelblue module showed the biggest decrease in modular expression, followed by the darkslateblue and salmon modules. Examination of differentially expressed genes (DEGs) within the steelblue module revealed a broad downregulation (Figure 13A). This downregulation included signaling components (CD79A, CD79B, CD19, CD22, CD40, MS4A1, BLK, and BLNK) involved in humoral immune response, driving B cell activation, proliferation, and differentiation. CD79A and CD79B are two important components of the B-cell receptor. CD19 and CD22 are typical B-cell activation markers. POU2AF1 is a transcription factor which is vital for the response of B cells to antigens and required for the formation of germinal centers (Teitell, 2003). These results indicated that the DEGs within the steelblue module were typical B cell markers and transcription factors associated with B cell activation and differentiation. Downregulation of gene expression in the SI group was also observed in genes within the darkslateblue module (Figure 13B). This downregulation included genes involved in cellular metabolism, such as genes encoding the ribosomal proteins (Figure 14A) involved in viral gene expression and transcription, RNA catabolic process, translational initiation and protein targeting to ER, and genes encoding the mitochondrial complex I (NADH: ubiquinone oxidoreductase) subunits (Figure 14B) involved in cellular respiration, as well as genes IMP3, NOP56, NOP2, QTRT1 involved in ncRNA and rRNA metabolic processes, ribonucleoprotein complex biogenesis, and ribosome biogenesis. For the salmon module involved in regulating cell cycle, the DEGs still displayed a broad downregulation in the SI group (Figure 13C). For the blue module involved in cellular signal transduction, the DEGs displayed an opposite trend of expression with an increased expression in the SI group (Figure 13D).

FIGURE 13
www.frontiersin.org

Figure 13. Heatmaps of DEGs in four disease modules (gray = SI; black = AU): (A) steelblue, (B) darkslateblue, (C) salmon and (D) blue. The top 50 genes with the smallest FDR-adjusted p-value of differential expression are presented in these heatmaps.

FIGURE 14
www.frontiersin.org

Figure 14. Heatmaps of genes encoding ribosomal proteins (A) and mitochondrial complex I subunits (B) in darkslateblue module (gray = SI; black = AU).

3. Discussion

In the present study, a systematic analysis of the relationship between influenza susceptibility and the baseline level of the NLR was developed. We examined five independent influenza challenge cohorts at the cellular level and found that individuals in the SI group had significantly higher baseline NLR than those in the AU group. The NLR achieved an AUC of 0.724 on the H3N2 data, and 0.736 on the external H1N1 data in predicting disease susceptibility to symptomatic influenza. The mechanisms underlying the association of the higher baseline NLR and the increased susceptibility to symptomatic influenza are poorly understood. The NLR is a biomarker conjugates two interconnected arms of the immune system: innate immunity and adaptive immunity. Neutrophils are the first line of innate immune defense against viral infection (Kaufmann, 2008). They migrate to infection sites for eliminating infectious particles, but also provide signals to other innate and adaptive immune cells about an invading foreign threat (Mantovani et al., 2011). The adaptive immunity is orchestrated mainly via T, B, and NK lymphocytes which provide antigen-specific responses. Prior studies revealed that the NLR was a particularly attractive measure of systemic inflammation (Zahorec, 2001). Neutrophils are crucial for innate immunity and are one of the main cell types involved in the inflammatory responses. The host innate immunity is activated by the inflammatory responses to control pathogen infection. Lymphocytes generate adaptive immune responses to eliminate specific pathogens. It is well established that the systemic inflammatory response is typically associated with decline in circulating lymphocyte count and increase in neutrophil count. Neutrophilia and lymphocytopenia are typical phenomena during systemic inflammation (de Jager et al., 2010; Templeton et al., 2014; Qun et al., 2020). Continuous infiltration of neutrophils at the site of infection raising an immune response produces exaggerated cytokines and chemokine that might result in the cytokine storm and contribute to severe disease during influenza virus infection (Bordon et al., 2013; Gu et al., 2019). Neutrophil extracellular traps (NETs) are released by neutrophils to contain infections. However, when not properly regulated, NETs have the potential to propagate inflammation (Porto and Stein, 2016; Twaddell et al., 2019). Beside this, more and more evidence has supported that neutrophils can significantly suppressed activation of CD4+ and CD8+ T cells, and further suppressed the immune responses (Pillay et al., 2013; Zemans, 2018). On the other side, lymphocytes are required for maintaining an effective immune response. The causes of lymphocytopenia as the marker of a depressed cell-mediated immunity, have been extensively studied (Cunha et al., 2011; Shen et al., 2014; Zhou and Ye, 2021). Lymphocytopenia also render the host susceptible to severe hyperinflammation (Chen et al., 2010). Thus, a healthy partnership between neutrophils and lymphocytes plays a very important role in the onset and resolution of inflammation which has a vital role in maintaining the health and integrity of an individual organism toward invading pathogens (Trammell and Toth, 2008; Buonacera et al., 2022). The condition of baseline NLR are indicative of the balance between the activation of host inflammatory responses and immune responses, therefore, it is a potential biomarker for predicting susceptibility to influenza virus infection. Hence, understanding of main NLR-related host factors associated with baseline systemic inflammatory status and influenza susceptibility may open doors for preventing influenza virus infection.

Despite many genomic and transcriptomic studies being conducted to identify host factors that are crucial for influenza susceptibility, the contribution of NLR-related host factors has not been fully explored. Using weighted gene co-expression network analysis (WGCNA), we identified four modules of the NLR-related systemic host factors associated with influenza susceptibility. In the discovery cohort for H3N2 influenza, we found that these four modules were not only significantly correlated with the baseline NLR, but also differentially expressed between the SI and AU groups. The reproducibility of these relationships was validated in an independent cohort for H1N1 influenza. Functional enrichment analyses revealed that these four modules were mainly involved in B cell-mediated immune responses, cellular metabolism, cell cycle, and cellular signal transduction, respectively.

Three of the four modules (i.e., modules involved in B cell-mediated immune responses, cellular metabolism, cell cycle) were significantly down-regulated in the SI group. Humoral immunity and cell-mediated immunity are two arms of adaptive immune responses. B cells play a major role in the humoral immune response (Marshall et al., 2018). Antigen binding to B cell receptor initiates B cell activation. The humoral immune system produces antigen-specific antibodies that can protect against primary and secondary infection. Antibodies against the hemagglutinin of influenza virus could prevent viral entry and replication (Wu and Wilson, 2020). Beside this, rapid B cell responses contribute to efficient viral clearance through neutralizing the virus and reducing virus spread (Gerhard et al., 1997; Rothaeusler and Baumgarth, 2010). The overall immune status at baseline, including the composition of B cell subsets and the up- or down-expression of genes related to B cell receptor signaling have been found to predict post-vaccination responses (Tsang et al., 2014; Fourati et al., 2016; HIPC-CHI Signatures Project Team and HIPC-I Consortium, 2017; Parvandeh et al., 2019). These studies implicated the pre-vaccination status of B cell signaling as important indicators of immune state that influenced the antibody response as well as vaccination outcome. Our study identified several B cell signaling pathways and transcription factors (POU2AF1 and E2F5) that regulated B cell activation and differentiation were significantly down-regulated in the SI group compared to the AU group. These results indicated the status of B cell signaling at baseline can be a useful predictor of influenza symptomatic infection. Moreover, influenza virus infection usually reprograms host cell's metabolism to assist virus replication. Influenza viruses require host cell ribosomes for expression of viral proteins. Ribosomal proteins (RPs) are major components of ribosomes. Recent studies revealed that RPs possessed antiviral function. Some RPs can interact with viral proteins to inhibit virus transcription (Abbas et al., 2012; Li et al., 2016). The ribosomal protein RPL10 was identified as a downstream effector of the NIK (NSP-interacting kinase)-mediated antiviral signaling pathway (Rocha et al., 2008). Beside this, the ribosomal protein RPL13A was reported as an innate immune factor for antiviral defense (Mazumder et al., 2014). Previous work reported that influenza virus suppressed host cellular respiration which was related to mitochondrial dysfunction (Derakhshan et al., 2006), but the molecular mechanism by which influenza virus alters cellular respiration is still unclear. Viruses deeply rely on host post-translational modifications for their replication. SUMOylation is an important post-translational modification controlling various cellular processes. Viruses could take advantage of the cellular SUMOylation system to facilitate viral propagation (Pal et al., 2011; Han et al., 2014; Domingues et al., 2015), but the SUMOylation system could also serve an antiviral function to restrict viral replication. Recent studies have indicated SUMOylation with a critical role in activating host intracellular pathogen defenses (Boutell et al., 2011; Li et al., 2012). Specifically, the SUMO pathway was revealed to contribute to intrinsic antiviral resistance to herpes simplex virus type-1 infection (Boutell et al., 2011). Moreover, influenza viruses introduced DNA damage in host cells during infection (Li et al., 2015). The DNA damage response (DDR) is a complex signal transduction pathway that can detect DNA damage and transduce this information to the cell to influence cellular responses to DNA damage (Ciccia and Elledge, 2010). Prior studies revealed that the DDR may inhibit (Lau et al., 2004) viral replication.

We further identified the module involved in cellular signal transduction was significantly up-regulated in the SI group, and eigengenes of this module were positively correlated with the baseline NLR. Within this module, we identified several key signaling pathways contributing to the efficiency of viral replication, including GPCR signaling and ion transport pathways. Influenza virus infection induces activation of a variety of cellular signaling pathways, which are required by virus replication (Ludwig et al., 2006; Ludwig, 2009). GPCRs contribute directly to stimulate the Raf/MEK/ERK signaling pathway (Rozengurt, 2007), which is crucial for influenza virus replication and has been demonstrated to possess antiviral properties (Pleschka et al., 2001). Ion channels expressed by host cells have emerged as key regulators of virus entry, and ion channels drugs have attracted some attention as suitable antiviral agents. Our findings highlighted the potential contribution of some key pathways involved in B cell-mediated immune responses, cellular metabolism, cell cycle, and signal transduction to influenza susceptibility. These identified pathways were concordant with underlying mechanisms that had previously been reported to be associated with host-virus interactions. The WGCNA network analysis is an unsupervised approach, which does not use a priori phenotype information (e.g., infection susceptibility). Thus, it provided an integrated and global view of host factors and allowed us to gain insights into the main host factors contributing to a healthy partnership between neutrophils and lymphocytes, and identify the main NLR-related host factors associated with influenza susceptibility.

The recent coronavirus disease 2019 (COVID 19) pandemic has resulted in significant morbidity and mortality worldwide (World Health Organization, 2020). Influenza and COVID-19 are both contagious respiratory illnesses, but COVID-19 is caused by infection with a coronavirus first identified in 2019. The NLR has recently generated a lot of interest regarding the role of potential poor prognosis in COVID-19 patients. Many studies have shown that the NLR was associated with disease severity and mortality for COVID-19 patients (Chan and Rout, 2020; Kong et al., 2020; Lagunas-Rangel, 2020; Regolo et al., 2022). A number of recently published studies have found that an elevated NLR on admission can serve as an early warning signal of severe COVID-19 (Feng et al., 2020; Liu J. et al., 2020; Liu Y. et al., 2020). A recent metanalysis (Henry et al., 2020) showed that lymphopenia and neutrophilia at hospital admission are associated with poor outcomes in patients with COVID-19. These studies exhibited that systemic inflammation played a key role in the development of severe COVID-19 which is in concordance with influenza. To our knowledge, no studies on baseline (i.e., prior to exposure to SARS-CoV-2) NLR to COVID-19 susceptibility have been reported. Influenza is our best comparative model for COVID-19 (Moore et al., 2020), hence our work can serve as a comparative model to provide insights into the COVID-19 susceptibility.

Several limitations of this study are noteworthy. The number of baseline samples available in the influenza challenge studies were low. We only included symptomatic infected and asymptomatic uninfected subjects in our study, thus the findings reported here are restricted to individuals who unambiguously reported health or illness, i.e., viral titer and symptom status agree. Moreover, individuals participated in the challenge studies were young and healthy adults, which may limit the broad applicability of our results to children, elderly or high-risk populations. Furthermore, as this study focused on H3N2 and H1N1 influenza, the association between baseline NLR and influenza susceptibility may not be extended to other type of influenza strains and infections.

In conclusion, our work identified the NLR as a simple and useful biomarker for predicting disease susceptibility to symptomatic influenza. An elevated NLR was detected in susceptible hosts, who may have defects in B cell-mediated immunity or impaired function in cellular metabolism, cell cycle, or signal transduction. The understanding of main NLR-related host factors associated with baseline systemic inflammatory status and influenza susceptibility may open doors for preventing influenza virus infection. Further study will be required to understand the underlying mechanism of susceptibility to influenza virus infection, and may yield therapeutic targets.

4. Materials and methods

4.1. Data availability

For the GSE73072 data set, we directly downloaded its preprocessed expression matrices from GEO, which had been normalized using the robust multi-array (RMA) method and log2-transformed. For the GSE61754 data set, we utilized the expression matrix available from GEO, which had been preprocessed using the variance stabilization and normalization method. For the GSE111368 cohort, we obtained the expression profiles from GEO which had been log2-transformed and normalized with a 75th percentile-shift algorithm by the original author. The infection and symptom status for the GSE73072 cohort were found at the web link (https://drive.google.com/open?id=0B2vLBS4X1c1ENzZpT216eGY1RjQ) provided by the original author, and those for the GSE61754 and GSE111368 cohorts were retrieved from their GEO Series Matrix Files.

4.2. Deconvolving whole blood gene expression samples

To quantify the proportions of human blood cell types, we utilized a signature matrix, named sigmatrixMicro provided in a previous study (Monaco et al., 2019), whose transcriptomic profiles were generated by microarray. The sigmatrixMicro consisted of 819 cell type-specific genes in 11 immune cell types. We next performed deconvolution with support vector regression using the CIBERSORTx method (Newman et al., 2019). Cell proportions within whole blood samples were estimated by combining CIBERSORTx with sigmatrixMicro in non-log linear space. All microarray data sets were quantile normalized before running CIBERSORTx. Bulk-mode batch correction was applied to remove technical differences between whole blood mixtures and the signature matrix.

To demonstrate that the differences in estimated baseline NLR between the SI and AU groups were robust to the signature matrix used, we quantified the proportions of human blood cell types in the same manner as described above except that two different signature matrices (LM22 and immunoStates) were used instead of sigmatrixMicro. The LM22 signature matrix contains 547 genes in 22 immune cell types and was obtained from the CIBERSORT website (https://cibersort.stanford.edu; Newman et al., 2015). It was built using samples from healthy subjects and profiled by Affymetrix microarray. The immunoStates provided in a previous study (Vallania et al., 2018) consisted of 317 cell type-specific genes in 20 immune cell types and was built using 6,160 samples with different disease states across 42 microarray platforms.

4.3. Application of batch correction to GSE73072 cohorts

The discovery cohort (GSE73072 H3N2) included two challenge studies. Principal component analysis (PCA) revealed that the discovery cohort included two sample batches, therefore the removeBatchEffect function provided in the limma package was used to correct the batch effects of gene expression values in the discovery cohort (Figure 1A). The PCA analysis was performed again on the corrected data, and the batch effects of the two challenge studies in the discovery cohort were basically eliminated. The same strategy was employed to remove batch effects in the GSE73072 H1N1 cohort (Figure 1B).

4.4. Co-expression network construction by WGCNA

WGCNA is the most widely used approach for weighted correlation network analysis. Co-expression networks were built using the R package WGCNA. The analysis was performed using the batch corrected gene expression profiles and only genes with variances ranked in top 9,000 were used. The soft-threshold power β was set to 10 which was selected based on the pickSoftThreshold function. A hierarchical clustering was performed using 1-TOM with β = 10 as the pairwise distance and average linkage distance as the cluster distance. We identified modules using dynamic tree cut approach with a minimal module size of 30 and a deepsplit cutoff of 4, and those closely related modules whose correlations of module eigengenes larger than 0.75 were merged by setting a branch merge cutoff height of 0.25.

4.5. Functional enrichment analysis

The pathway enrichment analyses of genes in four disease modules were analyzed. The biological processes from gene ontology (GO) and molecular pathways from the Reactome database are two of the most commonly used pathway enrichment analysis resources. GO enrichment analyses were conducted with enrichGO function in the R package clusterProfiler (version 3.18.1) with FDR < 0.05, and here the background set of genes was defined as default. Reactome enrichment analyses were performed with enrichPathway function in the R package ReactomePA (version 1.9.4).

4.6. Meta analysis and statistical analysis

Meta-analyses using random-effect models were performed with metagen function in the R package meta. Hedges' adjusted g (Cooper et al., 2019) was used to standardize the mean difference in the NLR between the SI and AU groups. The pooling weights were calculated as inverse of the effect size variance. All tests were performed two-sided, and a p-value cutoff for statistical significance was set as 0.05.

Wilcoxon tests were conducted to identify statistically significant differences in estimated baseline NLR, lymphocyte, and neutrophil proportions between the SI and AU groups. Statistically significant changes in modular expression between the SI and AU groups were assessed using Student's t-test. Statistically significances were indicated as follows: ns, not significant; *p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001.

Data availability statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found in the article/supplementary material.

Ethics statement

Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author contributions

Conceptualization, writing—original draft preparation, supervision, project administration, and funding acquisition: WS. Methodology, validation, formal analysis, and visualization: GW and WS. Software and writing—review and editing: GW, CLv, CLi, and WS. Data curation: GW, CLv, and WS. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by Shantou University Medical College Development Funds (510858027).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Abbas, W., Dichamp, I., and Herbein, G. (2012). The HIV-1 NEF protein interacts with two components of the 40S small ribosomal subunit, the RPS10 protein and the 18S rRNA. Virol. J. 9, 1–9. doi: 10.1186/1743-422X-9-103

PubMed Abstract | CrossRef Full Text | Google Scholar

Bongen, E., Vallania, F., Utz, P. J., and Khatri, P. (2018). KLRD1-expressing natural killer cells predict influenza susceptibility. Genome Med. 10, 1–12. doi: 10.1186/s13073-018-0554-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Bordon, J., Uriarte, S., Arnold, F., Fernandez-Botran, R., Rane, M., Peyrani, P., et al. (2013). Cytokines and neutrophils responses in influenza pneumonia. Infection 41, 1021–1024. doi: 10.1007/s15010-013-0461-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Boutell, C., Cuchet-Lourenço, D., Vanni, E., Orr, A., Glass, M., McFarlane, S., et al. (2011). A viral ubiquitin ligase has substrate preferential sumo targeted ubiquitin ligase activity that counteracts intrinsic antiviral defence. PLoS Pathog. 7:e1002245. doi: 10.1371/journal.ppat.1002245

PubMed Abstract | CrossRef Full Text | Google Scholar

Brandes, M., Klauschen, F., Kuchen, S., and Germain, R. N. (2013). A systems analysis identifies a feedforward inflammatory circuit leading to lethal influenza infection. Cell 154, 197–212. doi: 10.1016/j.cell.2013.06.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Buonacera, A., Stancanelli, B., Colaci, M., and Malatino, L. (2022). Neutrophil to lymphocyte ratio: an emerging marker of the relationships between the immune system and diseases. Int. J. Mol. Sci. 23:3636. doi: 10.3390/ijms23073636

PubMed Abstract | CrossRef Full Text | Google Scholar

Chan, A. S., and Rout, A. (2020). Use of neutrophil-to-lymphocyte and platelet-to-lymphocyte ratios in COVID-19. J. Clin. Med. Res. 12:448. doi: 10.14740/jocmr4240

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, G. Y., and Nu nez, G. (2010). Sterile inflammation: sensing and reacting to damage. Nat. Rev. Immunol. 10, 826–837. doi: 10.1038/nri2873

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, J., Lau, Y. F., Lamirande, E. W., Paddock, C. D., Bartlett, J. H., Zaki, S. R., et al. (2010). Cellular immune responses to severe acute respiratory syndrome coronavirus (SARS-CoV) infection in senescent BALB/c mice: CD4+ T cells are important in control of SARS-CoV infection. J. Virol. 84, 1289–1301. doi: 10.1128/JVI.01281-09

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, X., Liu, S., Goraya, M. U., Maarouf, M., Huang, S., and Chen, J.-L. (2018). Host immune response to influenza a virus infection. Front. Immunol. 9:320. doi: 10.3389/fimmu.2018.00320

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, Y., Li, X., Tian, L., Zheng, S., Yang, S., Dong, Y., et al. (2014). Dynamic behavior of lymphocyte subgroups correlates with clinical outcomes in human H7N9 infection. J. Infect. 69, 358–365. doi: 10.1016/j.jinf.2014.05.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Ciccia, A., and Elledge, S. J. (2010). The DNA damage response: making it safe to play with knives. Mol. Cell 40, 179–204. doi: 10.1016/j.molcel.2010.09.019

PubMed Abstract | CrossRef Full Text | Google Scholar

Clark, R., and Kupper, T. (2005). Old meets new: the interaction between innate and adaptive immunity. J. Invest. Dermatol. 125, 629–637. doi: 10.1111/j.0022-202X.2005.23856.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Clohisey, S., and Baillie, J. K. (2019). Host susceptibility to severe influenza a virus infection. Crit. Care 23, 1–10. doi: 10.1186/s13054-019-2566-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Cooper, H., Hedges, L. V., and Valentine, J. C. (2019). The Handbook of Research Synthesis and Meta-Analysis. New York, NY: Russell Sage Foundation. doi: 10.7758/9781610448864

CrossRef Full Text | Google Scholar

Cunha, B. A., Pherez, F. M., Strollo, S., Syed, U., and Laguerre, M. (2011). Severe swine influenza a (H1N1) versus severe human seasonal influenza a (H3N2): clinical comparisons. Heart Lung 40, 257–261. doi: 10.1016/j.hrtlng.2010.07.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Davenport, E. E., Antrobus, R. D., Lillie, P. J., Gilbert, S., and Knight, J. C. (2015). Transcriptomic profiling facilitates classification of response to influenza challenge. J. Mol. Med. 93, 105–114. doi: 10.1007/s00109-014-1212-8

PubMed Abstract | CrossRef Full Text | Google Scholar

de Jager, C. P., van Wijk, P. T., Mathoera, R. B., de Jongh-Leuvenink, J., van der Poll, T., and Wever, P. C. (2010). Lymphocytopenia and neutrophil-lymphocyte count ratio predict bacteremia better than conventional infection markers in an emergency care unit. Crit. Care 14, 1–8. doi: 10.1186/cc9309

PubMed Abstract | CrossRef Full Text | Google Scholar

Derakhshan, M., Willcocks, M. M., Salako, M. A., Kass, G. E., and Carter, M. J. (2006). Human herpesvirus 1 protein us3 induces an inhibition of mitochondrial electron transport. J. Gen. Virol. 87, 2155–2159. doi: 10.1099/vir.0.81949-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Domingues, P., Golebiowski, F., Tatham, M. H., Lopes, A. M., Taggart, A., Hay, R. T., et al. (2015). Global reprogramming of host sumoylation during influenza virus infection. Cell Rep. 13, 1467–1480. doi: 10.1016/j.celrep.2015.10.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Douglas, J. R., Alford, R. H., Cate, T. R., and Couch, R. B. (1966). The leukocyte response during viral respiratory illness in man. Ann. Intern. Med. 64, 521–530. doi: 10.7326/0003-4819-64-3-521

PubMed Abstract | CrossRef Full Text | Google Scholar

Faria, S. S., Fernandes, P. C. Jr, Silva, M. J. B., Lima, V. C., Fontes, W., Freitas-Junior, R., et al. (2016). The neutrophil-to-lymphocyte ratio: a narrative review. Ecancermedicalscience 10:702. doi: 10.3332/ecancer.2016.702

PubMed Abstract | CrossRef Full Text | Google Scholar

Feng, X., Li, S., Sun, Q., Zhu, J., Chen, B., Xiong, M., and Cao, G. (2020). Immune-inflammatory parameters in COVID-19 cases: a systematic review and meta-analysis. Front. Med. 7:301. doi: 10.3389/fmed.2020.00301

PubMed Abstract | CrossRef Full Text | Google Scholar

Fourati, S., Cristescu, R., Loboda, A., Talla, A., Filali, A., Railkar, R., et al. (2016). Pre-vaccination inflammation and b-cell signalling predict age-related hyporesponse to hepatitis B vaccination. Nat. Commun. 7, 1–12. doi: 10.1038/ncomms10369

PubMed Abstract | CrossRef Full Text | Google Scholar

Gerhard, W., Mozdzanowska, K., Furchner, M., Washko, G., and Maiese, K. (1997). Role of the B-cell response in recovery of mice from primary influenza virus infection. Immunol. Rev. 159, 95–103. doi: 10.1111/j.1600-065X.1997.tb01009.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Gu, Y., Hsu, A. C.-Y., Pang, Z., Pan, H., Zuo, X., Wang, G., et al. (2019). Role of the innate cytokine storm induced by the influenza a virus. Viral Immunol. 32, 244–251. doi: 10.1089/vim.2019.0032

PubMed Abstract | CrossRef Full Text | Google Scholar

Han, Q., Chang, C., Li, L., Klenk, C., Cheng, J., Chen, Y., et al. (2014). Sumoylation of influenza a virus nucleoprotein is essential for intracellular trafficking and virus growth. J. Virol. 88, 9379–9390. doi: 10.1128/JVI.00509-14

PubMed Abstract | CrossRef Full Text | Google Scholar

Hayden, F. G., Fritz, R., Lobo, M. C., Alvord, W., Strober, W., Straus, S. E., et al. (1998). Local and systemic cytokine responses during experimental human influenza a virus infection. Relation to symptom formation and host defense. J. Clin. Invest. 101, 643–649. doi: 10.1172/JCI1355

PubMed Abstract | CrossRef Full Text | Google Scholar

Henry, B. M., Cheruiyot, I., Vikse, J., Mutua, V., Kipkorir, V., Benoit, J., et al. (2020). Lymphopenia and neutrophilia at admission predicts severity and mortality in patients with COVID-19: A meta-analysis. Acta Bio Med. 91:e2020008. doi: 10.23750/abm.v91i3.10217

PubMed Abstract | CrossRef Full Text | Google Scholar

HIPC-CHI Signatures Project Team and HIPC-I Consortium (2017). Multicohort analysis reveals baseline transcriptional predictors of influenza vaccination responses. Sci. Immunol. 2:eaal4656. doi: 10.1126/sciimmunol.aal4656

PubMed Abstract | CrossRef Full Text | Google Scholar

Horby, P., Nguyen, N. Y., Dunstan, S. J., and Baillie, J. K. (2012). The role of host genetics in susceptibility to influenza: a systematic review. PLoS ONE 7:e33180. doi: 10.1371/journal.pone.0033180

PubMed Abstract | CrossRef Full Text | Google Scholar

Horby, P., Nguyen, N. Y., Dunstan, S. J., and Kenneth Baillie, J. (2013). An updated systematic review of the role of host genetics in susceptibility to influenza. Influenza Respir. Virus. 7, 37–41. doi: 10.1111/irv.12079

PubMed Abstract | CrossRef Full Text | Google Scholar

Howard, R., Kanetsky, P. A., and Egan, K. M. (2019). Exploring the prognostic value of the neutrophil-to-lymphocyte ratio in cancer. Sci. Rep. 9, 1–10. doi: 10.1038/s41598-019-56218-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Huang, Y., Zaas, A. K., Rao, A., Dobigeon, N., Woolf, P. J., Veldman, T., et al. (2011). Temporal dynamics of host molecular responses differentiate symptomatic and asymptomatic influenza A infection. PLoS Genet. 7:e1002234. doi: 10.1371/journal.pgen.1002234

PubMed Abstract | CrossRef Full Text | Google Scholar

Hufford, M. M., Richardson, G., Zhou, H., Manicassamy, B., García-Sastre, A., Enelow, R. I., et al. (2012). Influenza-infected neutrophils within the infected lungs act as antigen presenting cells for anti-viral CD8+ T cells. PLoS ONE 7:e46581. doi: 10.1371/journal.pone.0046581

PubMed Abstract | CrossRef Full Text | Google Scholar

Indavarapu, A., and Akinapelli, A. (2011). Neutrophils to lymphocyte ratio as a screening tool for swine influenza. Indian J. Med. Res. 134:389. doi: 10.3109/08923973.2010.523704

PubMed Abstract | CrossRef Full Text | Google Scholar

Jackson, G. G., Dowling, H. F., Spiesman, I. G., and Boand, A. V. (1958). Transmission of the common cold to volunteers under controlled conditions: I. the common cold as a clinical entity. AMA Arch. Intern. Med. 101, 267–278. doi: 10.1001/archinte.1958.00260140099015

PubMed Abstract | CrossRef Full Text | Google Scholar

Julkunen, I., Melén, K., Nyqvist, M., Pirhonen, J., Sareneva, T., and Matikainen, S. (2000). Inflammatory responses in influenza a virus infection. Vaccine 19, S32–S37. doi: 10.1016/S0264-410X(00)00275-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaufmann, S. H. (2008). Immunology's foundation: the 100-year anniversary of the nobel prize to Paul Ehrlich and Elie Metchnikoff. Nat. Immunol. 9, 705–712. doi: 10.1038/ni0708-705

PubMed Abstract | CrossRef Full Text | Google Scholar

Kong, M., Zhang, H., Cao, X., Mao, X., and Lu, Z. (2020). Higher level of neutrophil-to-lymphocyte is associated with severe COVID-19. Epidemiol. Infect. 148:e139. doi: 10.1017/S0950268820001557

PubMed Abstract | CrossRef Full Text | Google Scholar

Lagunas-Rangel, F. A. (2020). Neutrophil-to-lymphocyte ratio and lymphocyte-to-C-reactive protein ratio in patients with severe coronavirus disease 2019 (COVID-19): a meta-analysis. J. Med. Virol. 92, 1733–1734. doi: 10.1002/jmv.25819

PubMed Abstract | CrossRef Full Text | Google Scholar

Lau, A., Kanaar, R., Jackson, S. P., and O'Connor, M. J. (2004). Suppression of retroviral infection by the RAD52 DNA repair protein. EMBO J. 23, 3421–3429. doi: 10.1038/sj.emboj.7600348

PubMed Abstract | CrossRef Full Text | Google Scholar

Leick, M., Azcutia, V., Newton, G., and Luscinskas, F. W. (2014). Leukocyte recruitment in inflammation: basic concepts and new mechanistic insights based on new models and microscopic imaging technologies. Cell Tissue Res. 355, 647–656. doi: 10.1007/s00441-014-1809-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, N., Parrish, M., Chan, T. K., Yin, L., Rai, P., Yoshiyuki, Y., et al. (2015). Influenza infection induces host DNA damage and dynamic DNA damage responses during tissue regeneration. Cell. Mol. Life Sci. 72, 2973–2988. doi: 10.1007/s00018-015-1879-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, Y., Dong, W., Shi, Y., Deng, F., Chen, X., Wan, C., et al. (2016). Rabies virus phosphoprotein interacts with ribosomal protein L9 and affects rabies virus replication. Virology 488, 216–224. doi: 10.1016/j.virol.2015.11.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, Z., Wu, S., Wang, J., Li, W., Lin, Y., Ji, C., et al. (2012). Evaluation of the interactions of HIV-1 integrase with small ubiquitin-like modifiers and their conjugation enzyme UBC9. Int. J. Mol. Med. 30, 1053–1060. doi: 10.3892/ijmm.2012.1088

PubMed Abstract | CrossRef Full Text | Google Scholar

Lillie, P. J., Berthoud, T. K., Powell, T. J., Lambe, T., Mullarkey, C., Spencer, A. J., et al. (2012). Preliminary assessment of the efficacy of a T-cell-based influenza vaccine, MVA-NP+ m1, in humans. Clin. Infect. Dis. 55, 19–25. doi: 10.1093/cid/cis327

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, J., Liu, Y., Xiang, P., Pu, L., Xiong, H., Li, C., et al. (2020). Neutrophil-to-lymphocyte ratio predicts critical illness patients with 2019 coronavirus disease in the early stage. J. Transl. Med. 18, 1–12. doi: 10.1186/s12967-020-02374-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, T.-Y., Burke, T., Park, L. P., Woods, C. W., Zaas, A. K., Ginsburg, G. S., et al. (2016). An individualized predictor of health and disease using paired reference and target samples. BMC Bioinformatics 17:47. doi: 10.1186/s12859-016-0889-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, Y., Du, X., Chen, J., Jin, Y., Peng, L., Wang, H. H., et al. (2020). Neutrophil-to-lymphocyte ratio as an independent risk factor for mortality in hospitalized patients with COVID-19. J. Infect. 81, e6–e12. doi: 10.1016/j.jinf.2020.04.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Ludwig, S. (2009). Targeting cell signalling pathways to fight the flu: towards a paradigm change in anti-influenza therapy. J. Antimicrob. Chemother. 64, 1–4. doi: 10.1093/jac/dkp161

PubMed Abstract | CrossRef Full Text | Google Scholar

Ludwig, S., Pleschka, S., Planz, O., and Wolff, T. (2006). Ringing the alarm bells: signalling and apoptosis in influenza virus infected cells. Cell. Microbial. 8, 375–386. doi: 10.1111/j.1462-5822.2005.00678.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Luster, A. D., Alon, R., and von Andrian, U. H. (2005). Immune cell migration in inflammation: present and future therapeutic targets. Nat. Immunol. 6, 1182–1190. doi: 10.1038/ni1275

PubMed Abstract | CrossRef Full Text | Google Scholar

Mantovani, A., Cassatella, M. A., Costantini, C., and Jaillon, S. (2011). Neutrophils in the activation and regulation of innate and adaptive immunity. Nat. Rev. Immunol. 11, 519–531. doi: 10.1038/nri3024

PubMed Abstract | CrossRef Full Text | Google Scholar

Marshall, J. S., Warrington, R., Watson, W., and Kim, H. L. (2018). An introduction to immunology and immunopathology. Allergy Asthma Clin. Immunol. 14, 1–10. doi: 10.1186/s13223-018-0278-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Mazumder, B., Poddar, D., Basu, A., Kour, R., Verbovetskaya, V., and Barik, S. (2014). Extraribosomal L13a is a specific innate immune factor for antiviral defense. J. Virol. 88, 9100–9110. doi: 10.1128/JVI.01129-14

PubMed Abstract | CrossRef Full Text | Google Scholar

McClain, M. T., Park, L. P., Nicholson, B., Veldman, T., Zaas, A. K., Turner, R., et al. (2013). Longitudinal analysis of leukocyte differentials in peripheral blood of patients with acute respiratory viral infections. J. Clin. Virol. 58, 689–695. doi: 10.1016/j.jcv.2013.09.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Mertz, D., Kim, T. H., Johnstone, J., Lam, P.-P., Kuster, S. P., Fadel, S. A., et al. (2013). Populations at risk for severe or complicated influenza illness: systematic review and meta-analysis. BMJ 347:f5061. doi: 10.1136/bmj.f5061

PubMed Abstract | CrossRef Full Text | Google Scholar

Monaco, G., Lee, B., Xu, W., Mustafah, S., Hwang, Y. Y., Carre, C., et al. (2019). RNA-Seq signatures normalized by mRNA abundance allow absolute deconvolution of human immune cell types. Cell Rep. 26, 1627–1640. doi: 10.1016/j.celrep.2019.01.041

PubMed Abstract | CrossRef Full Text | Google Scholar

Moore, K., Lipsitch, M., Barry, J., and Osterholm, M. (2020). “Part 1: The future of the COVID-19 pandemic: Lessons learned from pandemic influenza,” in COVID-19; the CIDRAP Viewpoint Working Group (Minneapolis, MN: University of Minnesota).

Google Scholar

Music, N., Reber, A. J., Kim, J. H., and York, I. A. (2016). Peripheral leukocyte migration in ferrets in response to infection with seasonal influenza virus. PLoS ONE 11:e0157903. doi: 10.1371/journal.pone.0157903

PubMed Abstract | CrossRef Full Text | Google Scholar

Newman, A. M., Liu, C. L., Green, M. R., Gentles, A. J., Feng, W., Xu, Y., et al. (2015). Robust enumeration of cell subsets from tissue expression profiles. Nat. Methods 12, 453–457. doi: 10.1038/nmeth.3337

PubMed Abstract | CrossRef Full Text | Google Scholar

Newman, A. M., Steen, C. B., Liu, C. L., Gentles, A. J., Chaudhuri, A. A., Scherer, F., et al. (2019). Determining cell type abundance and expression from bulk tissues with digital cytometry. Nat. Biotechnol. 37, 773–782. doi: 10.1038/s41587-019-0114-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Pal, S., Santos, A., Rosas, J. M., Ortiz-Guzman, J., and Rosas-Acosta, G. (2011). Influenza a virus interacts extensively with the cellular sumoylation system during infection. Virus Res. 158, 12–27. doi: 10.1016/j.virusres.2011.02.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Parsana, P., Ruberman, C., Jaffe, A. E., Schatz, M. C., Battle, A., and Leek, J. T. (2019). Addressing confounding artifacts in reconstruction of gene co-expression networks. Genome Biol. 20, 1–6. doi: 10.1186/s13059-019-1700-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Parvandeh, S., Poland, G. A., Kennedy, R. B., and McKinney, B. A. (2019). Multi-level model to predict antibody response to influenza vaccine using gene expression interaction network feature selection. Microorganisms 7:79. doi: 10.3390/microorganisms7030079

PubMed Abstract | CrossRef Full Text | Google Scholar

Patarčić, I., Gelemanović, A., Kirin, M., Kolčić, I., Theodoratou, E., Baillie, K. J., et al. (2015). The role of host genetic factors in respiratory tract infectious diseases: systematic review, meta-analyses and field synopsis. Sci. Rep. 5, 1–10. doi: 10.1038/srep16119

PubMed Abstract | CrossRef Full Text | Google Scholar

Pillay, J., Tak, T., Kamp, V. M., and Koenderman, L. (2013). Immune suppression by neutrophils and granulocytic myeloid-derived suppressor cells: similarities and differences. Cell. Mol. Life Sci. 70, 3813–3827. doi: 10.1007/s00018-013-1286-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Pleschka, S., Wolff, T., Ehrhardt, C., Hobom, G., Planz, O., Rapp, U. R., and Ludwig, S. (2001). Influenza virus propagation is impaired by inhibition of the RAF/MEK/ERK signalling cascade. Nat. Cell Biol. 3, 301–305. doi: 10.1038/35060098

PubMed Abstract | CrossRef Full Text | Google Scholar

Porto, B. N., and Stein, R. T. (2016). Neutrophil extracellular traps in pulmonary diseases: too much of a good thing? Front. Immunol. 7:311. doi: 10.3389/fimmu.2016.00311

PubMed Abstract | CrossRef Full Text | Google Scholar

Price, I., Mochan-Keef, E. D., Swigon, D., Ermentrout, G. B., Lukens, S., Toapanta, F. R., et al. (2015). The inflammatory response to influenza a virus (H1N1): an experimental and mathematical study. J. Theor. Biol. 374, 83–93. doi: 10.1016/j.jtbi.2015.03.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Qun, S., Wang, Y., Chen, J., Huang, X., Guo, H., Lu, Z., et al. (2020). Neutrophil-to-lymphocyte ratios are closely associated with the severity and course of non-mild COVID-19. Front. immunol. 11:2160. doi: 10.3389/fimmu.2020.02160

PubMed Abstract | CrossRef Full Text | Google Scholar

Regolo, M., Vaccaro, M., Sorce, A., Stancanelli, B., Colaci, M., Natoli, G., et al. (2022). Neutrophil-to-lymphocyte ratio (NLR) is a promising predictor of mortality and admission to intensive care unit of COVID-19 patients. J. Clin. Med. 11:2235. doi: 10.3390/jcm11082235

PubMed Abstract | CrossRef Full Text | Google Scholar

Rocha, C. S., Santos, A. A., Machado, J. P. B., and Fontes, E. P. (2008). The ribosomal protein l10/QM-like protein is a component of the NIK-mediated antiviral signaling. Virology 380, 165–169. doi: 10.1016/j.virol.2008.08.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Rosales, C. (2018). Neutrophil: a cell with many roles in inflammation or several cell types? Front. Physiol. 9:113. doi: 10.3389/fphys.2018.00113

PubMed Abstract | CrossRef Full Text | Google Scholar

Rothaeusler, K., and Baumgarth, N. (2010). B-cell fate decisions following influenza virus infection. Eur. J. Immunol. 40, 366–377. doi: 10.1002/eji.200939798

PubMed Abstract | CrossRef Full Text | Google Scholar

Rozengurt, E. (2007). Mitogenic signaling pathways induced by g protein-coupled receptors. J. Cell. Physiol. 213, 589–602. doi: 10.1002/jcp.21246

PubMed Abstract | CrossRef Full Text | Google Scholar

Schmolke, M., and García-Sastre, A. (2010). Evasion of innate and adaptive immune responses by influenza a virus. Cell. Microbiol. 12, 873–880. doi: 10.1111/j.1462-5822.2010.01475.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Shen, Z., Chen, Z., Li, X., Xu, L., Guan, W., Cao, Y., et al. (2014). Host immunological response and factors associated with clinical outcome in patients with the novel influenza A H7N9 infection. Clin. Microbiol. Infect. 20, O493–O500. doi: 10.1111/1469-0691.12505

PubMed Abstract | CrossRef Full Text | Google Scholar

Sridhar, S., Begom, S., Bermingham, A., Hoschler, K., Adamson, W., Carman, W., et al. (2013). Cellular immune correlates of protection against symptomatic pandemic influenza. Nat. Med. 19, 1305–1312. doi: 10.1038/nm.3350

PubMed Abstract | CrossRef Full Text | Google Scholar

Tang, B. M., Shojaei, M., Teoh, S., Meyers, A., Ho, J., Ball, T. B., et al. (2019). Neutrophils-related host factors associated with severe disease and fatality in patients with influenza infection. Nat. Commun. 10, 1–13. doi: 10.1038/s41467-019-11249-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Teitell, M. A. (2003). OCA-B regulation of B-cell development and function. Trends Immunol. 24, 546–553. doi: 10.1016/j.it.2003.08.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Templeton, A. J., McNamara, M. G., Šeruga, B., Vera-Badillo, F. E., Aneja, P., Oca na, A., et al. (2014). Prognostic role of neutrophil-to-lymphocyte ratio in solid tumors: a systematic review and meta-analysis. J. Natl. Cancer Instit. 106:dju124. doi: 10.1093/jnci/dju124

PubMed Abstract | CrossRef Full Text | Google Scholar

Trammell, R. A., and Toth, L. A. (2008). Genetic susceptibility and resistance to influenza infection and disease in humans and mice. Expert Rev. Mol. Diagnost. 8, 515–529. doi: 10.1586/14737159.8.4.515

PubMed Abstract | CrossRef Full Text | Google Scholar

Tsang, J. S., Schwartzberg, P. L., Kotliarov, Y., Biancotto, A., Xie, Z., Germain, R. N., et al. (2014). Global analyses of human immune variation reveal baseline predictors of postvaccination responses. Cell 157, 499–513. doi: 10.1016/j.cell.2014.03.031

PubMed Abstract | CrossRef Full Text | Google Scholar

Twaddell, S. H., Baines, K. J., Grainge, C., and Gibson, P. G. (2019). The emerging role of neutrophil extracellular traps in respiratory disease. Chest 156, 774–782. doi: 10.1016/j.chest.2019.06.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Vallania, F., Tam, A., Lofgren, S., Schaffert, S., Azad, T. D., Bongen, E., et al. (2018). Leveraging heterogeneity across multiple datasets increases cell-mixture deconvolution accuracy and reduces biological and technical biases. Nat. Commun. 9, 1–8. doi: 10.1038/s41467-018-07242-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Wilkinson, T. M., Li, C. K., Chui, C. S., Huang, A. K., Perkins, M., Liebner, J. C., et al. (2012). Preexisting influenza-specific CD4+ T cells correlate with disease protection against influenza challenge in humans. Nat. Med. 18, 274–280. doi: 10.1038/nm.2612

PubMed Abstract | CrossRef Full Text | Google Scholar

World Health Organization (2020). Coronavirus Disease 2019 (COVID-19): Situation Report. World Health Organization, 73.

Google Scholar

Wu, N. C., and Wilson, I. A. (2020). Influenza hemagglutinin structures and antibody recognition. Cold Spring Harb. Perspect. Med. 10:a038778. doi: 10.1101/cshperspect.a038778

PubMed Abstract | CrossRef Full Text | Google Scholar

Zahorec, R. (2001). Ratio of neutrophil to lymphocyte counts-rapid and simple parameter of systemic inflammation and stress in critically ill. Bratisl. Lek. Listy 102, 5–14.

PubMed Abstract | Google Scholar

Zemans, R. L. (2018). Neutrophil-mediated T-cell suppression in influenza: novel finding raising additional questions. Am. J. Respir. Cell. Mol. Biol. 58, 423–425. doi: 10.1165/rcmb.2017-0425ED

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, B., and Horvath, S. (2005). A general framework for weighted gene co-expression network analysis. Stat. Appl. Genet. Mol. Biol. 4:17. doi: 10.2202/1544-6115.1128

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, Y., Zou, P., Gao, H., Yang, M., Yi, P., Gan, J., et al. (2019). Neutrophil-lymphocyte ratio as an early new marker in AIV-H7N9-infected patients: a retrospective study. Therap. Clin. Risk Manage. 15:911. doi: 10.2147/TCRM.S206930

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhou, X., and Ye, Q. (2021). Cellular immune response to COVID-19 and potential immune modulators. Front. Immunol. 12:646333. doi: 10.3389/fimmu.2021.646333

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: neutrophil-to-lymphocyte ratio, NLR, influenza susceptibility, digital cytometry, deconvolute, H3N2, H1N1

Citation: Wang G, Lv C, Liu C and Shen W (2022) Neutrophil-to-lymphocyte ratio as a potential biomarker in predicting influenza susceptibility. Front. Microbiol. 13:1003380. doi: 10.3389/fmicb.2022.1003380

Received: 26 July 2022; Accepted: 20 September 2022;
Published: 06 October 2022.

Edited by:

Sook-San Wong, The University of Hong Kong, Hong Kong SAR, China

Reviewed by:

Marco Iannetta, University of Rome Tor Vergata, Italy
Claudia Matteucci, University of Rome Tor Vergata, Italy

Copyright © 2022 Wang, Lv, Liu and Shen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Wenjun Shen, d2pzaGVuJiN4MDAwNDA7c3R1LmVkdS5jbg==

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.