Skip to main content

ORIGINAL RESEARCH article

Front. Immunol., 16 April 2021
Sec. Autoimmune and Autoinflammatory Disorders
This article is part of the Research Topic Systemic Lupus Erythematosus - Predisposition Factors, Pathogenesis, Diagnosis, Treatment and Disease Models View all 21 articles

Establishing a Risk Prediction Model for Atherosclerosis in Systemic Lupus Erythematosus

\nHaiping Xing&#x;Haiping Xing1Haiyu Pang&#x;Haiyu Pang2Tian Du,,&#x;Tian Du1,3,4Xufei YangXufei Yang1Jing ZhangJing Zhang5Mengtao Li
Mengtao Li6*Shuyang Zhang,
Shuyang Zhang1,3*
  • 1State Key Laboratory of Complex Severe and Rare Diseases, Department of Cardiology, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing, China
  • 2State Key Laboratory of Complex Severe and Rare Diseases, Medical Research Center, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing, China
  • 3School of Medicine, Tsinghua University, Beijing, China
  • 4Department of Breast Oncology, Sun Yat-sen University Cancer Center, Guangzhou, China
  • 5Department of Diagnostic Ultrasound, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing, China
  • 6Key Laboratory of Rheumatology and Clinical Immunology, Department of Rheumatology, National Clinical Research Center for Dermatologic and Immunologic Diseases, Ministry of Science & Technology, Ministry of Education, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing, China

Background and aims: Patients with systemic lupus erythematosus (SLE) have a significantly higher incidence of atherosclerosis than the general population. Studies on atherosclerosis prediction models specific for SLE patients are very limited. This study aimed to build a risk prediction model for atherosclerosis in SLE.

Methods: RNA sequencing was performed on 67 SLE patients. Subsequently, differential expression analysis was carried out on 19 pairs of age-matched SLE patients with (AT group) or without (Non-AT group) atherosclerosis using peripheral venous blood. We used logistic least absolute shrinkage and selection operator regression to select variables among differentially expressed (DE) genes and clinical features and utilized backward stepwise logistic regression to build an atherosclerosis risk prediction model with all 67 patients. The performance of the prediction model was evaluated by area under the curve (AUC), calibration curve, and decision curve analyses.

Results: The 67 patients had a median age of 42.7 (Q1–Q3: 36.6–51.2) years, and 20 (29.9%) had atherosclerosis. A total of 106 DE genes were identified between the age-matched AT and Non-AT groups. Pathway analyses revealed that the AT group had upregulated atherosclerosis signaling, oxidative phosphorylation, and interleukin (IL)-17-related pathways but downregulated T cell and B cell receptor signaling. Keratin 10, age, and hyperlipidemia were selected as variables for the risk prediction model. The AUC and Hosmer–Lemeshow test p-value of the model were 0.922 and 0.666, respectively, suggesting a relatively high discrimination and calibration performance. The prediction model had a higher net benefit in the decision curve analysis than that when predicting with age or hyperlipidemia only.

Conclusions: We built an atherosclerotic risk prediction model with one gene and two clinical factors. This model may greatly assist clinicians to identify SLE patients with atherosclerosis, especially asymptomatic atherosclerosis.

Background

Systemic lupus erythematosus (SLE) is a chronic autoimmune disease that affects multiple systems including the cardiovascular system (1). The incidence of cardiovascular events in SLE patients is significantly higher than that in the general population (24). Among females aged 35–44 years, SLE patients are 50 times more likely to develop myocardial infarction than healthy control subjects (4). Cardiovascular disease (CVD) is one of the most common causes of death in SLE patients, accounting for 25–30% of all deaths (57).

Atherosclerosis is the main cause of CVD. Patients with SLE also exhibit a higher prevalence of atherosclerosis than the general population (8, 9). In SLE, atherosclerosis is related to both traditional risk factors, such as age, sex, hyperlipidemia, and SLE-related features, such as disease duration, disease activity, and medications (3, 10). At the gene expression level, studies have determined that multiple proteins, including inflammatory cytokines [interleukin (IL)-1, IL-6, IL-10, interferon (IFN)-γ, tumor necrosis factor (TNF)-α, transforming growth factor (TGF)-β] and vascular endothelial related molecules [high-mobility group box protein (HMGB)1, vascular cell adhesion molecule (VCAM)-1, intercellular adhesion molecule (ICAM)-1, vascular endothelial growth factor (VEGF)], are closely related to atherosclerosis in SLE patients (10, 11). High-throughput sequencing is currently being applied to investigate atherosclerosis in SLE (1214). Although some interesting findings have been reported, the number of studies is relatively small, and the biological pathways that contribute to the increased atherosclerosis in SLE are not fully understood.

Early identification of SLE patients with atherosclerosis, which is often asymptomatic at the early stage, is important for prevention of atherosclerosis progression and future CVD. However, traditional prediction models, such as the Framingham risk score, largely underestimate the prevalence of atherosclerosis or cardiovascular events in SLE patients (15, 16), and studies on specific prediction models for atherosclerosis in SLE patients are limited. To the best of our knowledge, the only reported prediction model is the Predictors of Risk for Elevated Flares, Damage Progression, and Increased Cardiovascular Disease in Patients with SLE (PREDICTS) model developed by McMahon et al. (17). Composed of four biomarkers (leptin, soluble TWEAK, homocysteine, and proinflammatory high-density lipoprotein), age, and diabetes, the PREDICTS model has relatively high sensitivity (89%) and specificity (79%). Nevertheless, the four biomarkers were derived from a limited number of candidate biomarkers. Thus, it remains unclear whether combinations of untested biomarkers or genes can achieve better prediction accuracy. The objective of this study was to use RNA sequencing (RNA-seq) analysis to investigate the underlying mechanisms of atherosclerosis in SLE patients and to establish a diagnositic prediction model for atherosclerosis in SLE that combines high-throughput sequencing data and clinical risk factors.

Methods

Study Population and Age Matching

This cross-sectional study enrolled patients from the Chinese SLE Treatment and Research Group (CSTAR) registry (18) who presented to the outpatient clinic of the Peking Union Medical College Hospital between June 2019 and September 2019. All patients fulfilled the following criteria: (a) age >18 years and (b) meeting the 2012 Systemic Lupus erythematosus International Collaborating Clinics (SLICC) classification criteria (19). The exclusion criteria were as follows: (a) active infection, (b) presence of a tumor or other connective tissue disease, (c) currently in a period of moderate to severe SLE [SLE Disease Activity Index 2000 (SLEDAI-2K) ≥10], and (d) no history of CVD before the diagnosis of SLE. Subsequently, 1:1 age matching (±6 years) was performed for SLE patients with atherosclerosis (AT group) and without (Non-AT group) atherosclerosis. A 66-year-old patient was unable to be matched because the SLE AT group was significantly older than the SLE Non-AT group. There were five patients from the AT group who had several age- and sex-matching patients from the non-AT group. In such condition, we also took body mass index (BMI) and SLEDAI into consideration and excluded the other patients.

Clinical and Laboratory Data

Venous blood was extracted between 8:00 and 9:00 A.M. after an 8-h fasting. All laboratory tests were conducted at the Department of Clinical Laboratory, Peking Union Medical College Hospital. Complete blood counts were analyzed using an automated hematology system (Model XE2100; Sysmex Co., Kobe, Japan). Blood biochemistry data were measured by an automatic biochemistry analyzer (AU5821; Beckman Coulter, Miami, FL, US), including fasting blood glucose, creatinine (Cr), uric acid (UA), total cholesterol (TC), triglyceride (TG), high-density lipoprotein cholesterol (HDL-C), low-density lipoprotein cholesterol (LDL-C), complement 3, complement 4, and hypersensitive C-reactive protein (hs-CRP). Glycated hemoglobin A1c (HbA1c) was examined with a fully automated glycated hemoglobin analyzer (Variant II; Bio-Rad, Hercules, CA, US). Cardiac enzymes including creatine kinase, creatine kinase isoenzyme, cardiac troponin I, and N-terminal pro-B-type natriuretic peptide were evaluated by a fully automated integrated biochemical analyzer (Dimension EXL; Siemens, Erlangen, Germany). Anti-dsDNA antibodies (IgG type) were measured by indirect immunofluorescence and ELISA (EA1571-9601G; EUROIMMUN, Lubeck, Germany). Indirect immunofluorescence >1:5 or ELISA >100 IU/ml was defined as positive. The erythrocyte sedimentation rate (ESR) was also measured.

Clinical data were collected from the patients by physicians. These data included the following: (a) traditional CVD risk factors: age, sex, history of hypertension, hyperlipidemia, and diabetes, BMI, history of smoking, family history of early-onset CVD (men aged <55 years and women aged <65 years in first-degree relatives), menopause history; (b) history of CVD, current use of aspirin, statin, and angiotensin-converting enzyme inhibitor/angiotensin receptor blocker; (c) SLE-related CVD risk factors: disease course, cumulative dose of prednisone in the previous 1 year, current use of immunosuppressants, and the SLICC/ACR Damage Index and SLEDAI-2K score (20, 21).

The brachial-ankle pulse wave velocity (baPWV) was quantified using a non-invasive vascular screening device (VP-2000, Omron-Colin, Tokyo, Japan) as described by Ming Ding et al. (22). The carotid intima media thickness (CIMT) was measured by a doctor specialized in diagnostic ultrasound. The detection range included the region 1 cm distal to the common carotid artery, 1 cm to the carotid bifurcation, and 1 cm to the proximal end of the internal carotid artery (14). For each patient, the maximum CIMT values for three sites on the left and right sides were recorded. Atherosclerosis was defined as CIMT ≥1.2 mm or a history of CVD after diagnosis of SLE (23).

RNA Sequencing and Differential Gene Analysis

RNA was extracted from peripheral venous blood using a PAXgene Blood RNA purification kit (BD Bioscience, Franklin Lakes, NJ, USA). The integrity and concentration of the RNA were determined by an RNA Nano 6000 Kit (Agilent Technologies, Santa Clara, CA, USA). Paired-end RNA-seq was carried out on an Illumina HiSeq 2500 platform at Annoroad Gene Technology Co., Ltd. (Beijing, China). Salmon software (v1.14.1) was used to align the raw RNA-seq data to the reference genome hg38 (Ensemble version 84) to obtain gene counts (24). To remove the potential effect of age on the selection of differentially expressed (DE) genes, differential expression analysis was performed using R package DESeq2 (v.1.22.2) with age-matched AT and Non-AT groups. Absolute fold change >1.5 and p < 0.01 were used as cutoffs to select DE genes.

Heatmaps of the DE genes were constructed in R using the Heatmap.3 package. To generate the heatmap, raw gene counts from the 67 samples were normalized with a variance-stabilizing transformation (vst) using the DESeq2 package. The Euclidean distances between samples and genes were calculated and visualized by complete-linkage clustering.

Pathway Analysis

Pathway analysis was conducted with Ingenuity Pathways Analysis (IPA v01-12; Qiagen, Hilden, Germany) using the upregulated and downregulated DE genes. Pathways with p < 0.05 were defined as upregulated or downregulated pathways.

Gene set enrichment analysis (GSEA v.4.0.3; Broad Institute, USA) was performed on selected pathways using the GseaPreranked function. All genes were ranked by their log2(fold change). “Enrichment Statistic” and “Min Size: exclude smaller sets” were set as “classic” and “5,” respectively. All other settings were default. Pathways with p < 0.05 and Enrichment Score > 0 or < 0 were considered as upregulated and downregulated pathways, respectively. The 186 Kyoto Encyclopedia of Genes and Genomes (KEGG) pathways were downloaded from the Molecular Signatures database (MSigDB, v7.0, Broad Institute). The immune cell signatures reported by Davoli et al. (25) were used to assess the enrichment of different immune cell lineages. Atherosclerosis signatures were obtained from previous studies by Huang et al. (26) and Nuhrenberg et al. (27).

Statistical Analysis

All statistical analyses were conducted with the R software (v.3.6.2). For the AT and Non-AT groups, data were presented as median and quartiles (Q1–Q3) for continuous variables and as a percentage (n/N) for categorical variables. Comparisons between the two groups were conducted by the Wilcoxon rank-sum test and chi-square test for continuous variables and categorical variables, respectively.

The methods described in this article are in accordance with the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement (28). A prediction model was developed with all 67 SLE patients (n = 67). The logistic least absolute shrinkage and selection operator (LASSO) regression was implemented with R-package glmnet (v3.0-2). DE genes (vst normalized expression by DESeq2) and clinical risk factors for atherosclerosis (marked with # in Table 1) were used as candidate variables for LASSO selection (Figure 1). A 6-fold cross validation was used in the LASSO regression. Five candidate variables were selected by LASSO regression and further entered the multivariate logistic regression performed with R package “stat” (v3.6.2). Variables were sequentially excluded by the highest p-value in the multivariate logistic model until all the remaining variables had significant p-values. All p-values were two-sided, with the significance level set at 0.05. Receiver operating characteristic (ROC) curve and calibration curve were plotted using the “pROC” (v1.16.1) and “rms” (v5.1-4) packages, respectively. The 95% confidence interval of the area under the curve (AUC) was calculated by bootstrap resampling (500 times) of all SLE patients. The calibration curve was plotted with 1,000 times bootstrap resampling using “calibrate” function in the R package “rms.” The calibration performance of the model was tested by the Hosmer–Lemeshow goodness-of-fit test using R package “ResourceSelection” (v0.3-5). A decision curve was generated by the “rmda” package (v1.6) with “population.prevalence” set as 0.37, reflecting the prevalence of atherosclerosis in SLE patients reported by Roman et al. (8).

TABLE 1
www.frontiersin.org

Table 1. Demographics and clinical features of age-matched SLE atheroslerosis and non-atherosclerosis groups.

FIGURE 1
www.frontiersin.org

Figure 1. Study design and procedures of prediction model building. Sixty-seven patients fulfilled the inclusion criteria, among whom 20 had atherosclerosis (AT) by our definition. RNA sequencing (RNA-seq) was performed on all 67 patients. (A) For the differential expression analysis, 1:1 age-matched systemic lupus erythematosus (SLE) AT group (n = 19) and SLE Non-AT group (n = 19) were used. Ingenuity Pathway Analysis (IPA) and gene set enrichment analysis (GSEA) were performed with differentially expressed (DE) genes. (B) All 67 samples were used to build the prediction model for atherosclerosis. DE genes from (A) and clinical atherosclerosis risk factors were used as candidate variables for LASSO selection. Five variables were selected. A multivariate logistic regression was further applied to the five variables. Variables were excluded sequentially by the highest p-value in the multivariate logistic regression until all remaining variables had significant p-values. Three final variables were selected to build the final prediction model with multivariate logistic regression.

Results

Comparisons Between the Age-Matched AT and Non-AT Groups

A total of 67 patients fulfilled the inclusion criteria and were enrolled in the study. The median (Q1–Q3) age of all subjects was 42.7 (range 36.6–51.2) years with a median disease duration of 10.0 (6.6–15.2) years (Supplementary Table 1). Sixty-three (94%) patients were female, and 20 (29.9%) fulfilled the definition of atherosclerosis in our study. The AT group was significantly older than the Non-AT group (Supplementary Table 2).

Among the 67 patients, 19 pairs of patients from the AT and Non-AT groups were matched by age to remove the potential effect of age in screening DE genes. The median ages in the age-matched AT and Non-AT groups were 52.2 (48.5–57.2) years and 48.4 (45.9–51.8) years (p = 0.199, Wilcoxon rank-sum test; Table 1), respectively. Compared with the age-matched Non-AT group, the prevalence of hyperlipidemia in the AT group was significantly increased (p = 0.006), and the percentage of statin use was also higher (p = 0.026), while no significant differences were observed in TC, TG, HDL-C, and LDL-C. The inconsistency between hyperlipdimia and blood lipids could be attributed to the statin use among the AT group. Although the AT group had higher CIMT values on both sides (p < 0.05) than the age-matched Non-AT group, there was no significant difference in the other surrogate atherosclerosis marker, baPWV, between the two groups. The baPWV is associated with age, blood pressure and eGFR (29). And the AT group and the non-AT group showed no significant differences in all of these (the eGFR was not shown), which may account for the non-significance of baPWV between the two groups.

Immune and Atherosclerosis Pathways Are Significantly Upregulated in the AT Group

The differential expression analysis between the age-matched AT and Non-AT groups identified a total of 106 DE genes (Supplementary Table 3), of which 39 were upregulated and 67 were downregulated in the AT group. Uncorrected p-values were used to identify DE genes. The principal component analysis and heatmap (Figure 2) showed that patients in the AT group had similar gene expression patterns and that the 106 DE genes could clearly distinguish the AT group from the Non-AT group.

FIGURE 2
www.frontiersin.org

Figure 2. Systemic lupus erythematosus (SLE) atherosclerosis (AT) group has activated atherosclerosis signaling and interleukin (IL)17-related immune pathways. (A,B) Heatmap (A) and principal component analysis (PCA) plot (B) of differentially expressed (DE) genes. The clustering of genes and patients in heatmap was based on complete-linkage, Euclidean distance hierarchical clustering. Red, AT. Blue, Non-AT. (C,D) Top 10 upregulated (C) and downregulated (D) pathways in SLE AT group. Ranked by –log10(p-value). –log10(0.05) is marked with a red line. Ingenuity Pathway Analysis (IPA) was performed with upregulated (n = 39) and downregulated (n = 67) DE genes.

To better understand the differences between the AT and Non-AT groups, we performed an IPA and GSEA on the DE genes. The IPA (Figure 2) showed that “Atherosclerosis Signaling” and multiple IL-17-related pathways (“Role of IL-17F in Allergic Inflammatory Airway Diseases,” “Role of IL-17A in Psoriasis,” “Differential Regulation of Cytokine Production in Macrophages and T Helper Cells by IL-17A and IL-17F”) were significantly activated in the AT group, while multiple metabolic synthesis-related pathways (“Histamine Biosynthesis,” “Putrescine Biosynthesis III,” “Catecholamine Biosynthesis,” and “Prostanoid Biosynthesis”) were inhibited. The GSEA with the KEGG pathways (Supplementary Tables 4, 5) indicated that the pathways related to ribosomes (“KEGG Ribosome”), cell redox (“KEGG Oxidative Phosphorylation”), and cell cycle (“KEGG Cell Cycle”) were upregulated in the AT group, while T cell and B cell receptor pathways (“KEGG T Cell Receptor Signaling Pathway,” “KEGG B Cell Receptor Signaling Pathway”) were significantly downregulated.

To verify the activation of the atherosclerosis pathway in the AT group, we utilized the atherosclerosis signatures reported in previous studies to perform a GSEA (26, 27). In accordance with our expectation, “Huang 2011-Up Genes” were significantly upregulated, and the “Huang 2011-Down Genes” were downregulated in the AT group (Supplementary Figure 1). Up-regulated and down-regulated trends were also identified separately for “Nuhrenberg 2013-Up Genes” and “Nuhrenberg 2013-Down Genes.” These findings confirm that the AT group had increased atherosclerosis signaling.

Because multiple immune pathways showed differences between the AT and Non-AT groups, we further performed a GSEA using immune signatures specific to individual immune cell lineages (25). We observed increased natural killer (NK) cell and CD8+ T cell signatures in the AT group compared with the Non-AT group (Supplementary Figure 2), while B cell signatures were decreased, consistent with the downregulation of the B cell receptor pathway in our pathway analysis (Supplementary Table 5).

Establishment and Evaluation of Risk Prediction Models for Atherosclerosis in Systemic Lupus Erythematosus

We selected five candidate variables from the DE genes and reported clinical risk factors (marked with # in Table 1) for LASSO regression, including three clinical risk factors (age, hyperlipidemia, statin use) and expression levels of two genes (KRT10 and TNNT3) (Supplementary Figure 3). Because of the relative small sample size, we performed the LASSO regression in all SLE patients (n = 67), according to the (TRIPOD) statement (28). Multivariate logistic regression showed that KRT10 was significantly related to atherosclerosis in SLE patients (p < 0.05) (Supplementary Table 6). Statistical significance and clinical significance were both taken into consideration when we sequentially selected the five candidate variables. Statin use was removed because of its high p-value, and the TNNT3 gene was dropped because it is expressed mainly in skeletal muscle tissue and has little to do with atherosclerosis. After removing statin use and TNNT3, the variables with the highest p-values, the remaining three variables (age, hyperlipidemia, KRT10) were all significant in the multivariate logistic regression and were included in the final prediction model (Table 2).

TABLE 2
www.frontiersin.org

Table 2. The estimated coefficients in the prediction model.

We carried out ROC curve, calibration curve, and decision curve analyses to evaluate the performance of the risk prediction model. The AUC was 0.922 (95% confidence interval, 0.866–0.978, by 500 times bootstrap resampling; Figure 3). As shown in Supplementary Table 7, the prediction model had different sensitivity and specificity at different cutoffs, and the best cutoff in the model was 0.3 points, with a sensitivity of 85.0% and specificity of 87.2% (Supplementary Table 7). The calibration plot (Figure 3) showed relatively high agreement between the prediction by the model and the actual observation in terms of atherosclerosis rate, and the Hosmer–Lemeshow goodness-of-fit test had a vale of p = 0.666, suggesting an appreciable discrimination and calibration performance of the prediction model. We compared the net benefits of our prediction model and the models built with age, hyperlipidemia, or age plus hyperlipidemia and found the combination of age, hyperlipidemia, and KRT10 in our model had the highest net benefit (Figure 3). These data suggest that the prediction model had adequate performance and could effectively improve the clinical benefits for the SLE patients regarding atherosclerosis diagnosis and treatment.

FIGURE 3
www.frontiersin.org

Figure 3. Evaluation of the performance of the risk prediction model. (A) Receiver operating characteristic (ROC) curve of the prediction model. (B) Sensitivity and specificity of the prediction model with different cutoffs. (C) Calibration curve for the logistic regression model. The calibration curve was plotted with 1,000 times bootstrap resampling. p-value was calculated with Hosmer–Lemeshow (HL) goodness-of-fit test. (D) Decision curve analysis (DCA) comparing net benefit of different models. The net benefit of our prediction model (red line) was compared to models built by only hyperlipidemia (black line), only age (green line), and hyperlipidemia plus age (blue line). The lines labeled with “None” or “All” showed the net benefit of not treating any patients or treating all patients, respectively.

Discussion

In this study, we performed high-throughput RNA-seq and differential expression analysis in SLE patients with and without atherosclerosis. We found that atherosclerosis signaling, CD8+ T cell and NK cell signaling, and multiple IL-17-related pathways were significantly activated in SLE patients with atherosclerosis. By combining the DE genes with clinical factors, we constructed a diagnostic prediction model with good performance in predicting the presence of atherosclerosis in patients with SLE. To our knowledge, this is the first study to develop a prediction model for atherosclerosis in SLE patients using high-throughput RNA-seq data.

As well as traditional cardiovascular risk factors, atherosclerosis in SLE is also related to SLE-related risk factors like gene and protein expressions. Recently, several high-throughput RNA-seq analyses have been performed to further investigate the atherosclerosis process in SLE at the gene expression level (12, 13). Korman et al. (13) examined gene expressions during monocyte-to-macrophage differentiation in 20 SLE patients and 16 healthy controls. They identified 3,044 monocyte-to-macrophage differentiation-related genes, among which only 163 genes showed significant differential expression between SLE patients with and without atherosclerosis. These 163 DE genes failed to differentiate SLE patients by atherosclerosis status. Carlucci et al. (12) investigated gene expressions in SLE patients with and without high vascular inflammation or non-calcified plaque burden (NCB), indicators of early vascular disease and plaque vulnerability and rupture risks, respectively. They found that SLE patients with high vascular inflammation (n = 9) had increased IFN signaling but downregulated B cell development and T cell and B cell signaling. For SLE patients with high NCB (n = 9), NK cell signaling and cross talks between dendritic cells and NK cells were activated, and the NCB was significantly associated with a group of proinflammatory neutrophils/low-density granulocytes. Compared with these two studies, our analyses had a relatively higher number of patients and may add value toward a better understanding of atherosclerosis in SLE.

Our study identified multiple pathways that were differentially regulated in the SLE AT group, among which atherosclerosis signatures were activated. The atherosclerosis signatures in our IPA and from Huang et al. (26) and Nuhrenberg et al. (27) were developed from the general population. This suggests that, despite the identification of many atherosclerosis risk factors and genes specific to SLE (3, 10, 11), SLE patients at least partly share similar atherosclerosis signaling characteristics to the normal population. However, because we did not set a non-SLE control group in the present study, we were unable to determine which of the differentially regulated pathways were specific to SLE. As shown in Table 1, the patients in the AT group in our study were more hyperlipidemic and had a higher statin dosage.

Immune cells play an important role in the development of atherosclerosis (30, 31). In this study, we found that the AT group had increased CD8+ T cell and NK cell signatures but decreased B cell signatures. CD8+ T cells were reported to promote atherosclerosis progression by inducing inflammation and the formation of necrotic cores in atherosclerotic plaques (32, 33), while the function of NK cells in atherosclerotic plaque formation remained unclear. While previous studies showed that NK cells were pro-atherogenic (33, 34), recent studies demonstrated that few NK cells were identified in atherosclerotic lesions and suggested that NK cells may be irrelevant for atherosclerosis (35, 36). Our findings that NK cell signatures were enriched in the AT group may indicate a potential role of NK cells for the atherosclerosis in SLE. The role of B cells in atherosclerosis has been widely investigated. Different subsets of B cells have different functions in atherosclerosis, with B1 cells being anti-atherosclerotic and B2 cells being pro-atherosclerotic (30). Caligiuri et al. (37) and Major et al. (38) observed an increased incidence of atherosclerosis in B cell-deficient mice, suggesting that B cells exhibit an overall inhibitory effect against atherosclerosis, consistent with the decreased B cell signatures identified in the AT group. In contrast to the reported increased activity of CD4+ T cells, dendritic cells, and macrophages reported in atherosclerosis (31), no significant differences in the signatures of these cells were observed between the AT and Non-AT groups. Although these findings may suggest that these immune cells have different roles in the atherosclerosis between SLE patients and the general population, they are more likely to reflect the cells we sequenced, which were from peripheral blood rather than from atherosclerotic lesions. Besides, the pathway analysis revealed that IL-17-related pathways were upregulated in the AT group. IL-17 is important for T helper 17 cells to promote atherosclerosis, and the size of atherosclerotic lesions in IL-17-deficient mice was decreased by 46% (3941). The activation of IL-17-related pathways in our study suggests that CD4+ T cell subsets (such as T helper 17 cells) may be increased in the SLE AT group. Of note, all the immune cell component analyses in this study were based on gene expression data, and the changes in the composition of immune cells need to be verified by fluorescence-activated cell sorting (FACS) or single-cell sequencing.

Early detection and intervention of atherosclerosis are important for the prevention of future CVD. Vascular ultrasound is typically the first-line approach in the detection of atherosclerosis. However, the accuracy of ultrasound is significantly dependent on the experience of the examiner. Our prediction model here can provide an alternative method that is less dependent on the skills of the examiner and may thus be of benefit to SLE patients in developing countries with a lack of good healthcare. Furthermore, the model can be applied in large-scale screening and rountine clinical use and may assist clinicians to better detect subclinical atherosclerosis. To establish our prediction model, we combined DE genes identified by high-throughput RNA-seq and important clinical risk factors. Three variables were used in the final prediction model, among which age and hyperlipidemia are classic risk factors for atherosclerosis. KRT10 is a member of the cytokeratin family. A previous study showed that increased expressions of cytokeratin 8, 18, and 19 were related to increased arterial intimal thickening features in atherosclerosis (42), while a link between KRT10 and atherosclerosis has not been reported. The present data suggest that KRT10 may play a role in the atherosclerosis in SLE. Further investigations are required to clarify whether KRT10 is a driver or simply a marker for atherosclerosis.

Here, we utilized LASSO regression to build the prediction model, which could properly eliminate the multicollinearity among independent variables and reduce model complexity by parameter selection. Compared with the prediction models containing only age (AUC = 0.826), only hyperlipidemia (AUC = 0.722), or combination of age and hyperlipidemia (AUC = 0.880), addition of KRT10 to the model significantly increased the prediction performance (AUC = 0.922) and benefits for clinical decision-making (Figure 3). The PREDICTS model for atherosclerosis in SLE was developed by McMahon et al. (17) based on a western population. Their model utilized proinflammatory HDL (piHDL), leptin, TWEAK, homocysteine, history of diabetes, and age as predictors and had a sensitivity of 89% and specificity of 79% (AUC not available). With fewer variables (3 vs. 6), our model had a relatively lower sensitivity of 85% (0.3 as cutoff; Figure 3, Supplementary Table 7) than the PREDICTS model but a higher specificity of 87%. Furthermore, because Asian SLE populations have different prevalence of CVD and genetic backgrounds from western populations (43, 44), whether the PREDICTS model is applicable to the Chinese population remains to be confirmed. Thus, with better predictive capacity and Asian population specificity, this prediction model can serve as a useful tool in identifying atherosclerosis risk in Asian SLE patients early.

There are some limitations to our study. Firstly, our study included only Chinese individuals, and the number of samples was relatively small, which may probably limit the application of the prediction model. And with this small sample size, certain atherosclerosis-related genes may not be identified as DE genes. There was imbalance of classes in the dataset (20:47) because of the relative small sample size. While the sample size met the modeling requirements of the prediction model based on the internal verification of our study, it still limited the application of the prediction model in a larger population. And how the prediction model will perform in a larger sample size remains to be studied. Moreover, the patients in the AT group in our study were more hyperlipidemic and had a higher statin dosage, which could have effects on cellular lipid metabolism and other transcriptomic pathways. Secondly, as shown in Supplementary Table 1, our study population had long disease durations of SLE, and none of them was in active phase when their clinical information and blood were collected. Moreover, organ damage was observed in both AT and non-AT groups. These characteristics of the enrolled patients may reduce the representativeness. Thirdly, owing to the unavailability of clinical information or gene expression data in published studies, we could not perform external validation of our prediction model. Thus, the accuracy of our model generated from a small population will need to be further validated when it is applied to a greater population. Finally, the study had a cross-sectional design, and thus the causal relationships between DE genes like KRT10 and atherosclerosis could not be determined. Further studies are required to determine whether this model can predict the future risk of atherosclerosis.

Conclusion

In conclusion, we have built an atherosclerotic risk prediction model utilizing one gene and two clinical factors that can effectively predict the presence of atherosclerosis in Chinese SLE patients. This model may assist clinicians to identify SLE patients with a high risk of atherosclerosis.

Data Availability Statement

The data has been deposited at Genome Sequence Archive (https://bigd.big.ac.cn/gsa-human/browse/HRA000525) with accession number: HRA000525.

Ethics Statement

The studies involving human participants were reviewed and approved by The Institutional Review Board of Peking Union Medical College Hospital. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

SZ, ML, HP, TD, and HX contributed to the study conception and design. Blood samples and clinical data were collected by TD, HX, and XY. JZ measured the carotid intima media thickness. TD and HP performed the statistical analysis. The first draft of the manuscript was written by TD and HX. ML, HP, and SZ provided critical revision for the manuscript. All authors read and approved the final manuscript.

Funding

This work was supported by the Beijing Municipal Science & Technology Commission (Z131107002213005), the National Natural Science Foundation of China (Grant Number: 81641126), the Fundamental Research Funds for Central Universities (Grant Number: 2016RC330001), and the Chinese National Key Technology R&D Program of the Ministry of Science and Technology (Grant Number: 2017YFC0907601, 2017YFC0907602).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors thank Drs. Xiuchun Jiang, Jinglin Shi, Lihong Xu, Xue Li, and Yang Zhang for their assistance in the collection of clinical data. We thank Dr. Shuang Liu for her valuable input during the manuscript preparation. We also thank Alison Sherwin, PhD, from Liwen Bianji, Edanz Group China (www.liwenbianji.cn/ac), for editing the English text of a draft of this manuscript.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fimmu.2021.622216/full#supplementary-material

Abbreviations

SLE, systemic lupus erythematosus; AT, atherosclerosis; DE, differentially expressed; CVD, cardiovascular disease; CIMT, carotid intima media thickness; IPA, Ingenuity Pathway Analysis; GSEA, gene set enrichment analysis; LASSO, least absolute shrinkage and selection operator; ROC, receiver operating characteristics; AUC, area under the curve; SLEDAI, SLE Disease Activity Index 2000; baPWV, brachial-ankle pulse wave velocity; SLICC/ADI, Systemic Lupus International Collaborating Clinics/ACR Damage Index; PREDICTS, Predictors of Risk for Elevated Flares, Damage Progression, and Increased Cardiovascular Disease in Patients with SLE.

References

1. Kaul A, Gordon C, Crow MK, Touma Z, Urowitz MB, van Vollenhoven R, et al. Systemic lupus erythematosus. Nat Rev Dis Primers. (2016) 2:16039. doi: 10.1038/nrdp.2016.39

CrossRef Full Text | Google Scholar

2. Esdaile JM, Abrahamowicz M, Grodzicky T, Li Y, Panaritis C, Du BR, et al. Traditional Framingham risk factors fail to fully account for accelerated atherosclerosis in systemic lupus erythematosus. Arthritis Rheum. (2010) 44:2331–2337. doi: 10.1002/1529-0131(200110)44:10<2331::aid-art395>3.0.co;2-i

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Giannelou M, Mavragani CP. Cardiovascular disease in systemic lupus erythematosus: a comprehensive update. J Autoimmun. (2017) 82:1. doi: 10.1016/j.jaut.2017.05.008

CrossRef Full Text | Google Scholar

4. Manzi S, Meilahn EN, Rairie JE, Conte CG, Jansenmcwilliams L, D'Agostino RB, et al. Age-specific incidence rates of myocardial infarction and angina in women with systemic lupus erythematosus: comparison with the Framingham Study. Am J Epidemiol. (1997) 145:408–15. doi: 10.1093/oxfordjournals.aje.a009122

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Rees F, Doherty M, Grainge MJ, Lanyon P, Davenport G, Zhang W. Mortality in systemic lupus erythematosus in the United Kingdom 1999–2012. Rheumatology. (2016) 55:854–60. doi: 10.1093/rheumatology/kev424

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Bernatsky S, Boivin JF, Joseph L, Manzi S, Ginzler E, Gladman D, et al. Mortality in systemic lupus erythematosus. Arthritis Rheum. (2006) 54:2550–7. doi: 10.1002/art.21955

CrossRef Full Text | Google Scholar

7. Aranow C, Ginzler EM. Epidemiology of cardiovascular disease in systemic lupus erythematosus. Lupus. (2000) 9:166–9. doi: 10.1191/096120300678828208

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Roman MJ, Shanker B-A, Davis A, Lockshin MD, Sammaritano L, Simantov R, et al. Prevalence and correlates of accelerated atherosclerosis in systemic lupus erythematosus. N Engl J Med. (2003) 349:2399–406. doi: 10.1056/NEJMoa035471

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Nikpour M, Urowitz MB, Gladman DD. Premature atherosclerosis in systemic lupus erythematosus. Rheum Dis Clin North Am. (2005) 31:329–54. doi: 10.1016/j.rdc.2005.01.001

CrossRef Full Text | Google Scholar

10. Teixeira V, Tam L-S. Novel insights in systemic lupus erythematosus and atherosclerosis. Front Med. (2018) 4:262. doi: 10.3389/fmed.2017.00262

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Frieri M, Stampfl H. Systemic lupus erythematosus and atherosclerosis: review of the literature. Autoimmun Rev. (2016) 15:16–21. doi: 10.1016/j.autrev.2015.08.007

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Carlucci PM, Purmalek MM, Dey AK, Temesgen-Oyelakin Y, Kaplan MJ. Neutrophil subsets and their gene signature associate with vascular inflammation and coronary atherosclerosis in lupus. Jci Insight. (2018) 3:99276. doi: 10.1172/jci.insight.99276

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Korman BD, Huang C-C, Skamra C, Wu P, Koessler R, Yao D, et al. Inflammatory expression profiles in monocyte-to-macrophage differentiation in patients with systemic lupus erythematosus and relationship with atherosclerosis. Arthritis Res Ther. (2014) 16:R147. doi: 10.1186/ar4609

CrossRef Full Text | Google Scholar

14. Perezsanchez C, Barbarroja N, Messineo S, Ruizlimon P, Rodriguezariza A, Jimenezgomez Y, et al. Gene profiling reveals specific molecular pathways in the pathogenesis of atherosclerosis and cardiovascular disease in antiphospholipid syndrome, systemic lupus erythematosus and antiphospholipid syndrome with lupus. Ann Rheum Dis. (2015) 74:1441–9. doi: 10.1136/annrheumdis-2013-204600

CrossRef Full Text | Google Scholar

15. Esdaile JM, Abrahamowicz M, Grodzicky T, Li Y, Panaritis C, Berger RD, et al. Traditional Framingham risk factors fail to fully account for accelerated atherosclerosis in systemic lupus erythematosus. Arthritis Rheum. (2001) 44:2331–7. doi: 10.1002/1529-0131(200110)44:10<2331::AID-ART395>3.0.CO;2-I

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Magder LS, Petri M. Incidence of and risk factors for adverse cardiovascular events among patients with systemic lupus erythematosus. Am J Epidemiol. (2012) 176:708–19. doi: 10.1093/aje/kws130

PubMed Abstract | CrossRef Full Text | Google Scholar

17. McMahon M, Skaggs BJ, Grossman JM, Sahakian L, Fitzgerald J, Wong WK, et al. A panel of biomarkers is associated with increased risk of the presence and progression of atherosclerosis in women with systemic lupus erythematosus. Arthritis Rheumatol. (2014) 66:130–9. doi: 10.1002/art.38204

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Li M, Zhang W, Leng X, Li Z, Ye Z, Li C, et al. Chinese SLE Treatment and Research group (CSTAR) registry: I. Major clinical characteristics of Chinese patients with systemic lupus erythematosus. Lupus. (2013) 22:1192–9. doi: 10.1177/0961203313499086

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Petri M, Orbai AM, Alarcón GS, Gordon C, Merrill JT, Fortin PR, et al. Derivation and validation of the systemic lupus international collaborating clinics classification criteria for systemic lupus erythematosus. Arthritis Rheum. (2012) 64:2677–86. doi: 10.1002/art.34473

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Gladman DD, Ibanez D, Urowitz MB. Systemic lupus erythematosus disease activity index 2000. J Rheumatol. (2002) 29:288–91.

Google Scholar

21. Gladman D, Ginzler E, Goldsmith C, Fortin P, Liang M, Sanchez-Guerrero J, et al. The development and initial validation of the systemic lupus international collaborating clinics/American college of rheumatology damage index for systemic lupus erythematosus. Arthritis Rheum. (1996) 39:363–9. doi: 10.1002/art.1780390303

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Ming Ding F, Li M, Yang X, Ye Y, Kang L, Pang H, et al. Accelerated age-related arterial stiffness in systemic lupus erythematosus patients. JCR J Clin Rheumatol. (2016) 22:426–33. doi: 10.1097/RHU.0000000000000432

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Crouse JR, Raichlen JS, Riley WA, Evans GW, Palmer MK, Oleary DH, et al. Effect of rosuvastatin on progression of carotid intima-media thickness in low-risk individuals with subclinical atherosclerosis: The METEOR trial. JAMA. (2007) 297:1344–53. doi: 10.1001/jama.297.12.1344

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Patro R, Duggal G, Love MI, Irizarry RA, Kingsford C. Salmon provides fast and bias-aware quantification of transcript expression. Nat Methods. (2017) 14:417–9. doi: 10.1038/nmeth.4197

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Davoli T, Uno H, Wooten EC, Elledge SJ. Tumor aneuploidy correlates with markers of immune evasion and with reduced response to immunotherapy. Science. (2017) 355:eaaf8399. doi: 10.1126/science.aaf8399

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Huang CC, Liu K, Pope RM, Du P, Lin S, Rajamannan NM, et al. Activated TLR signaling in atherosclerosis among women with lower framingham risk score: the multi-ethnic study of atherosclerosis. PLoS ONE. (2011) 6:21067. doi: 10.1371/journal.pone.0021067

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Nuhrenberg TG, Langwieser N, Binder H, Kurz T, Stratz C, Kienzle R, et al. Transcriptome analysis in patients with progressive coronary artery disease: identification of differential gene expression in peripheral blood. J Cardiovasc Translat Res. (2013) 6:81–93. doi: 10.1007/s12265-012-9420-5

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Br J Surg. (2015) 102:148–58. doi: 10.1002/bjs.9736

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Stortz M, Triantafyllias K, Schwarting A, Weinmann-Menke J. Vascular stiffness: influencing factors on carotid-femoral pulse wave velocity in systemic lupus erythematosus. Clin Exp Rheumatol. 2020 38:74–81.

PubMed Abstract | Google Scholar

30. Wolf D, Ley K. Immunity and inflammation in atherosclerosis. Circulat Res. (2019) 124:315–27. doi: 10.1161/CIRCRESAHA.118.313591

CrossRef Full Text | Google Scholar

31. Ilhan F, Kalkanli ST. Atherosclerosis and the role of immune cells. World J Clin Cases. (2015) 3:345. doi: 10.12998/wjcc.v3.i4.345

CrossRef Full Text | Google Scholar

32. Kolbus D, Ramos OH, Berg KE, Persson J, Wigren M, Björkbacka H, et al. CD8+ T cell activation predominate early immune responses to hypercholesterolemia in Apoe-/-mice. BMC Immunol. (2010) 11:58. doi: 10.1186/1471-2172-11-58

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Kyaw T, Winship A, Tay C, Kanellakis P, Hosseini H, Cao A, et al. Cytotoxic and proinflammatory CD8+ T lymphocytes promote development of vulnerable atherosclerotic plaques in apoE-deficient mice. Circulation. (2013) 127:1028–39. doi: 10.1161/CIRCULATIONAHA.112.001347

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Aslanian AM, Chapman HA, Charo IF. Transient role for CD1d-restricted natural killer T cells in the formation of atherosclerotic lesions. Arterioscl Thrombo Vasc Biol. (2005) 25:628–32. doi: 10.1161/01.ATV.0000153046.59370.13

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Nour-Eldine W, Joffre J, Zibara K, Esposito B, Giraud A, Zeboudj L, et al. Genetic depletion or hyperresponsiveness of natural killer cells do not affect atherosclerosis development. Circulat Res. (2018) 122:47–57. doi: 10.1161/CIRCRESAHA.117.311743

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Selathurai A, Deswaerte V, Kanellakis P, Tipping P, Toh B-H, Bobik A, et al. Natural killer (NK) cells augment atherosclerosis by cytotoxic-dependent mechanisms. Cardiovasc Res. (2014) 102:128–37. doi: 10.1093/cvr/cvu016

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Caligiuri G, Nicoletti A, Poirier B, Hansson GK. Protective immunity against atherosclerosis carried by B cells of hypercholesterolemic mice. J Clin Investig. (2002) 109:745–53. doi: 10.1172/JCI7272

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Major AS, Fazio S, Linton MF. B-lymphocyte deficiency increases atherosclerosis in LDL receptor–null mice. Arterioscl Thromb Vasc Biol. (2002) 22:1892–8. doi: 10.1161/01.ATV.0000039169.47943.EE

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Van Es T, Van Puijvelde G, Ramos O, Segers F, Joosten L, van Den Berg W, et al. Attenuated atherosclerosis upon IL-17R signaling disruption in LDLr deficient mice. Biochem Biophys Res Commun. (2009) 388:261–5. doi: 10.1016/j.bbrc.2009.07.152

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Nordlohne J, Helmke A, Ge S, Rong S, Chen R, Waisman A, et al. Aggravated atherosclerosis and vascular inflammation with reduced kidney function depend on interleukin-17 receptor A and are normalized by inhibition of interleukin-17A. JACC Basic Translat Sci. (2018) 3:54–66. doi: 10.1016/j.jacbts.2017.08.005

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Gao Q, Jiang Y, Ma T, Zhu F, Gao F, Zhang P, et al. A critical function of Th17 proinflammatory cells in the development of atherosclerotic plaque in mice. J Immunol. (2010) 185:5820–7. doi: 10.4049/jimmunol.1000116

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Slomp J, Poelmann RE, Gittenberger-de Groot AC, Koteliansky VE, Glukhova MA, Bogers AJ. Cytokeratin expression in human arteries pertinent to intimal thickening formation in the ductus arteriosus. Differentiation. (1997) 61:305–11. doi: 10.1046/j.1432-0436.1997.6150305.x

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Barbhaiya M, Feldman C, Guan H, Gomezpuerta JA, Fischer MA, Solomon DH, et al. Race/ethnicity and cardiovascular events among patients with systemic lupus erythematosus. Arthritis Rheum. (2017) 69:1823–31. doi: 10.1002/art.40174

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Wang YF, Lau Yl, Yang W. Genetic studies on systemic lupus erythematosus in East Asia point to population differences in disease susceptibility. In: John C, Carey, MD, editors. American Journal of Medical Genetics Part C: Seminars in Medical Genetics: 2019. Wiley Online Library (2019). p. 262–8. doi: 10.1002/ajmg.c.31696

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: systemic lupus erythematosus, atherosclerosis, prediction model, RNA-Seq, differential gene analysis

Citation: Xing H, Pang H, Du T, Yang X, Zhang J, Li M and Zhang S (2021) Establishing a Risk Prediction Model for Atherosclerosis in Systemic Lupus Erythematosus. Front. Immunol. 12:622216. doi: 10.3389/fimmu.2021.622216

Received: 29 October 2020; Accepted: 19 February 2021;
Published: 16 April 2021.

Edited by:

Anisur Rahman, University College London, United Kingdom

Reviewed by:

George Anthony Robinson, University College London, United Kingdom
Leda Coelewij, University College London, United Kingdom

Copyright © 2021 Xing, Pang, Du, Yang, Zhang, Li and Zhang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Shuyang Zhang, c2h1eWFuZ3poYW5nMTAzJiN4MDAwNDA7bnJkcnMub3Jn; Mengtao Li, bWVuZ3Rhby5saSYjeDAwMDQwO2NzdGFyLm9yZy5jbg==

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.