A correction has been applied to this article in:
Corrigendum: Development and Validation of a Nomogram for the Prediction of Hospital Mortality of Patients With Encephalopathy Caused by Microbial Infection: A Retrospective Cohort Study
Lina Zhao
Yun Li3†
Yi Li- 1Emergency Department, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing, China
- 2Department of Critical Care Medicine, Chifeng Municipal Hospital, Chifeng Clinical Medical College of Inner Mongolia Medical University, Chifeng, China
- 3Department of Anesthesiology, Chifeng Municipal Hospital, Chifeng Clinical Medical College of Inner Mongolia Medical University, Chifeng, China
- 4Department of Neurology, Yidu Central Hospital Affiliated to Weifang Medical University, Weifang, China
Background: Hospital mortality is high for patients with encephalopathy caused by microbial infection. Microbial infections often induce sepsis. The damage to the central nervous system (CNS) is defined as sepsis-associated encephalopathy (SAE). However, the relationship between pathogenic microorganisms and the prognosis of SAE patients is still unclear, especially gut microbiota, and there is no clinical tool to predict hospital mortality for SAE patients. The study aimed to explore the relationship between pathogenic microorganisms and the hospital mortality of SAE patients and develop a nomogram for the prediction of hospital mortality in SAE patients.
Methods: The study is a retrospective cohort study. The lasso regression model was used for data dimension reduction and feature selection. Model of hospital mortality of SAE patients was developed by multivariable Cox regression analysis. Calibration and discrimination were used to assess the performance of the nomogram. Decision curve analysis (DCA) to evaluate the clinical utility of the model.
Results: Unfortunately, the results of our study did not find intestinal infection and microorganisms of the gastrointestinal (such as: Escherichia coli) that are related to the prognosis of SAE. Lasso regression and multivariate Cox regression indicated that factors including respiratory failure, lactate, international normalized ratio (INR), albumin, SpO2, temperature, and renal replacement therapy were significantly correlated with hospital mortality. The AUC of 0.812 under the nomogram was more than that of the Simplified Acute Physiology Score (0.745), indicating excellent discrimination. DCA demonstrated that using the nomogram or including the prognostic signature score status was better than without the nomogram or using the SAPS II at predicting hospital mortality.
Conclusion: The prognosis of SAE patients has nothing to do with intestinal and microbial infections. We developed a nomogram that predicts hospital mortality in patients with SAE according to clinical data. The nomogram exhibited excellent discrimination and calibration capacity, favoring its clinical utility.
Introduction
Sepsis is defined as a life-threatening organ dysfunction with host response imbalance caused by infection (Singer et al., 2016). Sepsis-associated encephalopathy (SAE) is defined as diffuse brain dysfunction without the central nervous system (CNS) infection in sepsis patients. Metabolic encephalopathy, drug intoxication, structural brain lesions, cerebrovascular events, encephalitis, meningitis, and non-convulsive status epilepticus need to be ruled out in sepsis patients before a diagnosis of SAE (Eidelman et al., 1996). SAE develops in up to 70% of septic patients (Gofton and Young, 2012; Fraser et al., 2014).
SAE is related to increased mortality, extensive costs, prolonged hospitalization, followed by persistent cognitive impairment (Iwashyna et al., 2010; Sonneville et al., 2017). The mortality rates of SAE patients over 60% in sepsis patients (Eidelman et al., 1996; Schuler et al., 2018). At hospital discharge, 45% of patients are related to the development of dementia (Annane and Sharshar, 2015). Early recognition of brain injury and prompt management are of great importance for the survival and prognosis of septic patients. Intestinal microbial infection is one of the important sites of infection in patients with sepsis. Intestinal microbes are not only related to infections. Studies have found that can have an impact on the brain through the microbiota-gut-brain axis, included depression, anxiety, dementia, and other diseases (Grochowska et al., 2018). Li et al. (2018) found that intestinal flora can affect SAE through the vagus nerve. The relationship between intestinal flora and the prognosis of SAE patients is still unclear.
Therefore, further studies for identifying the relationship between intestinal flora and the prognosis of SAE patients, and the predictors of the prognosis of SAE patients, especially accurate and measurable prediction models for hospital mortality, are pivotal for risk-optimized therapeutic strategies and to improve the prognosis of sepsis patients. This study aimed to investigate the predictors associated with hospital mortality in patients with SAE and establish a comprehensive visual predictive nomogram of hospital mortality, calculating a probabilistic estimate that could be of use to clinicians these patients.
Materials and Methods
Data Source
Data were obtained from the Medical Information Mart for Intensive Care (MIMIC-III, Version 1.4), which contains 46,520 patients admitted to the Beth Israel Deaconess Medical Center (Boston, MA, United States) from 2001 to 2012 (Johnson et al., 2016). The database documents included charted events such as demographics, vital signs, microbiology events, medication prescriptions, laboratory tests, etc. International Classification of Diseases, Ninth Revision (ICD-9) codes were also documented by hospital staff on patient discharge. The following CITI program course was completed: CITI 33690380. The raw data were extracted using a structure query language (SQL) using Navicat and further processed with R software.
Patient Population
Inclusion criteria were as follows: Patients with (1) sepsis 3.0. (2) age ≥ 18 years-old. (3) at least 24 h stay in the ICU. Sepsis was defined as an infected patient on discharge according to ICD-9 codes and microbial culture positive. According to the definition of sepsis 3.0, we included patients with SOFA score ≥ 2.
Exclusion criteria (Sonneville et al., 2017; Yang Y. et al., 2020): (1) Patients without SAE. (2) Primary brain injury including traumatic brain injury, intracerebral hemorrhage, cerebral embolism, ischemic stroke, epilepsy, or intracranial infection, and other cerebrovascular diseases according to ICD-9 codes. (Supplementary Materials 1–5); (3) Mental disorders and neurological disease (Supplementary Material 6); (4) Chronic alcohol or drug abuse (Supplementary Material 7); (5) Encephalopathy caused by other causes including metabolic encephalopathy, hepatic encephalopathy, hypertensive encephalopathy, hypoglycemic coma, and other liver disease or kidney disease affecting consciousness (Supplementary Material 8); (6) Severe electrolyte imbalances or blood glucose disturbances, including hyponatremia (<120 mmol/l), hyperglycemia (>180 mg/dl), or hypoglycemia (<54 mg/dl); (7) Partial pressure of CO2 (PCO2) ≥ 80 mmHg; (8)Without an evaluation of a Glasgow Coma Scale (GCS) score; (9) Patients who have been sedated by tracheal intubation at the time of admission.
Sepsis-Associated Encephalopathy
Sepsis-associated encephalopathy was defined as (1) patients with GCS < 15. (2) The patient was diagnosed with delirium, cognitive impairment, altered mental status according to the ICD-9 code. (3) The patient was treated with haloperidol during hospitalization. (4) Exclude consciousness disorders caused by other reasons. Many studies use GCS score as an essential tool for evaluating SAE patients (Iwashyna et al., 2010).
Data Extraction and Management
The following data was extracted from the MIMIC III database using R statistical software (R Foundation for Statistical Computing, Vienna, Austria): basic patient demographical data, vital signs (mean value) during the first 24 h of intensive care unit (ICU) stay, the first laboratory data since ICU admission and severity scores (including SAPS II, quick sequential organ failure assessment (qSOFA) score, sequential organ failure assessment (SOFA) score), comorbidity index at discharge according to the ICD-9 code (Supplementary Material 9), site of infection and types of microbial infections (Supplementary Material 10), organ failure (Supplementary Material 11). A matrix diagram of missing data is illustrated in the Data Profiling report (Supplementary Material 12). The percentage of missing values of partial thromboplastin time (0.47%), platelet (0.57%), aspartate aminotransferase (0.66%), alanine aminotransferase (0.47%), resprate (0.85%), heartrate (0.85%), blood urea nitrogen (1.14%), dysbp (1.14%), diasbp (1.23%), tempc (1.52%), glucose_min (1.42%), albumin (5.02%), lactate (3.6%), and hemoglobin (3.03%) were <6%. To facilitate statistical analysis, missing individual values were substituted with their mean values.
Statistical Analysis
The Shapiro–Wilk test for the sample distribution was used. Continuous variables with normal distribution were expressed as the mean ± standard deviation (SD), and continuous non-normal distributed variables were expressed as the median (interquartile range, IQR), categorical variables were expressed as frequency and percentage, as appropriate. A non-parametric test (Mann–Whitney U test or Kruskal–Wallis test) was applied for data with non-normal distribution or heterogeneity of variances. Pearson Chi-squared test was applied to categorize variables.
Patients were randomly assigned to either the training cohort (80%) or the validation cohort (20%). The selection of predictive features of the nomogram used the least absolute shrinkage and selection operator (Lasso) regression model (Sauerbrei et al., 2007; Sun et al., 2013; Wang et al., 2020). A multivariate COX regression analysis was performed on the selected variables, and a nomogram was constructed based on the results of the multivariate COX regression analysis (P < 0.05). We applied a bootstrapped resample with 1,000 iterations to verify the accuracy of the nomogram. The C-index was employed as an indicator to determine the discrimination ability of the nomogram through receiver operating characteristic (ROC) curve analysis and area under the curve (AUC). The calibration was performed by plotting the calibration curve to analyze the association between the observed incidence and the predicted probability. We evaluated the clinical usefulness and net benefit of the new predictive models by using decision curve analysis (DCA).
Statistical analysis was conducted with R software (version 3.4.3). Statistical significance was defined as p < 0.05.
Results
Demographic Baseline Characteristics
1,055 patients with SAE were identified from the MIMIC database after applying the inclusion and exclusion criteria. We randomly assigned 80% and 20% of the patients to the training (n = 844) and validation (n = 211) cohorts. The recruitment process is illustrated in Figure 1.
FIGURE 1
Figure 1. Flow chart of the enrolled patients. MIMIC-III, Medical Information Mart for Intensive Care III.
Table 1 shows the patient characteristics in the primary and validation cohorts. SAE patients who were older, had urinary tract infection or yeast infection were more likely to die. Circulatory failure was more common in non-survivors [Heartrate, 112 (96–132) vs. 109 (94–125), P = 0.008; Dysbp, 77 (64.8–86) vs. 85 (77–94), P < 0.001; Diasbp, 35 (26–41) vs. 39 (33–47), P < 0.001; Lactate, 2.3 (1.6–4.4) vs. 1.8 (1.2–2.7), P < 0.001] than survivors. Patients in the non-survival group had worse liver function [Alanine aminotransferase, 33 (17–84) vs. 24 (14–51.3), P = 0.001; Aspartate aminotransferase, 49 (25–139) vs. 31.5 (20–64), P < 0.001; Albumin, 2.8 (2.2–3.0) vs. 2.9 (2.5–3.3), P < 0.001], worse renal function [Creatinine, 1.1 (0.8–1.9) vs. 1.5 (0.9–2.6), P < 0.001; Blood urea nitrogen, 24 (16–41) vs. 33 (20–50.3), P < 0.001], and worse coagulation [Partial time, 14.3 (13.0–16.4) vs. 15.5 (13.8–19.6), P < 0.001; Partial thromboplastin time, 30.5 (26.9–36.9) vs. 36.7 (30.2–49.6), P < 0.001; INR 1.3 (1.1–1.5) vs. 1.5 (1.2–2.0), P < 0.001], and more serious infections [White blood cell count, 10.7 (7.2–15.3) vs. 11.9 (7.9–16.9), P = 0.061]. Patients in the non-survival group also had a higher incidence of anemia (53.2 vs. 67.8%). Non-surviving patients have more severe disease [SOFA 6.0 (9.0–12.0) vs. 6.0 (4.0–8.0), p < 0.001; qSOFA 2.0 (2.0–3.0) vs. 2.0 (2.0–3.0) p < 0.001; SAPS II 56 (45–72) vs. 42 (32–51), p < 0.001].
TABLE 1
Table 1. Characteristics of patients in the primary and validation cohorts.
Patient Outcomes
Table 2 shows the outcomes for the survival group and non-survival group. Among non-survivors, there was a higher incidence of multiple organ failure including respiratory failure (63.6 vs. 32.9%), renal failure (69.4 vs. 57.3%), hepatic failure (10.5 vs. 3.3%), cardiovascular failure (58.1 vs. 8.5%), and hematological failure (26.7 vs. 21.2%). This led to a higher rate of mechanical ventilation (52.7 vs. 35.2%) and renal replacement therapy (12.0 vs. 2.0%) among non-survivors.
TABLE 2
Table 2. Patients’ Outcome in the primary and validation cohorts.
Feature Selection
Using the LASSO regression model, among the non-survivors of SAE, we identified 89 features which reduced to 13 potential predictors. They include SAPS II, renal replacement therapy, temperature, SpO2, albumin, INR, lactate, respiratory failure, urinary tract infection, anemia, systolic blood pressure (sysbp), partial thromboplastin time (Supplementary Material 13: Data supplement) (Figures 2A,B).
FIGURE 2
Figure 2. Texture feature selection using the least absolute shrinkage and selection operator (LASSO) binary logistic regression model. (A) Each curve in the figure represents the change trajectory of each independent variable coefficient. The ordinate is the value of the coefficient, the lower abscissa is log(λ), and the upper abscissa is the number of non-zero coefficients in the model at this time. (B) 10-fold cross-cross validation fitting and then select the model, and at the same time have a more accurate estimate of the performance of the model. For each λ value, around the mean value of the target parameter shown by the red dot, we can get a confidence interval for the target parameter. The two dashed lines indicate two special λ values:c (cvfit$lambda.min, cvfit$lambda.1se). The area under the receiver operating characteristic (AUC) curve was plotted vs. log(λ).
Multivariate Cox Regression
Furthermore, we performed a univariate, and multivariate cox regression analysis of these 13 potential predictors, sex, and admission type. According to our results, SAPS II, renal replacement therapy, temperature, SpO2, albumin, international normalized ratio (INR), lactate, and respiratory failure were independent prognostic factors for SAE patients (p < 0.01 or p < 0.05) (Table 3).
TABLE 3
Table 3. Multivariate COX analysis of risk factors to hospital mortality.
Predictive Nomogram Development
A Lasso regression model and multivariate cox regression analysis identified SAPS II, renal replacement therapy, temperature, SpO2, albumin, INR, lactate, and respiratory failure as independent prognostic factors for SAE patients in the training cohort. These factors can be used to predict the hospital mortality of patients with SAE (Table 3), which was presented as the visualization nomogram (Figure 3). The hazard ratio values of these risk factors were established and scored for each level of prognostication. By adding up the scores associated with each variable to assess the hospital mortality of SAE patients.
FIGURE 3
Figure 3. Nomograms for the prediction of the hospital mortality of SAE patients. The line segment corresponding to each variable is marked with a scale, which represents the value range of the variable, and the length of the line segment reflects the contribution of the factor to the hospital mortality of SAE patients. The Point in the figure represents the individual score corresponding to each variable under different values, and the total score, namely Total Point, represents the total score of the sum of the corresponding individual scores after all the variables are valued. SAPS II, simplified acute physiology score; Lac, lactate. ** < 0.05, *** < 0.01.
Discrimination and Calibration
The AUC for the hospital mortality prediction nomogram was 0.812 (95% CI, 0.780–0.843) in the training cohort, which is greater than the SAPS II score of 0.745 (95% CI, 0.708–0.783) (Figure 4). The predictive accuracy of the nomogram was shown with a sensitivity of 0.601 and a specificity of 0.867. Our study employed the bootstrap resampling method for internal validation of the model. The calibration plot of hospital mortality of SAE patients revealed good agreement between the observed and predicted values (Figure 5).
FIGURE 4
Figure 4. Discriminatory accuracy for predicting the incidence of SAE assessed by receiver operator characteristics (ROC) analysis calculating area under the curve (AUC). SAPS II, simplified acute physiology score.
FIGURE 5
Figure 5. Calibration curves of a nomogram estimating the hospital mortality of SAE patients. The x-axis represents the predicted risk of hospital death in patients with SAE. The y-axis represents the actual risk of hospital death in patients with SAE. The dotted line represents the perfect prediction of the ideal model. The closer the red solid line is to the dotted line, the better the performance of this nomogram.
Clinical Utility
The DCA of the nomograms and SAPS II for the hospital mortality of patients with SAE are illustrated in Figure 6. The results showed that the nomogram provided a greater net benefit in predicting hospital mortality compared to that of SAPS II.
FIGURE 6
Figure 6. The DCA curve of medical intervention in patients with the nomogram and SAPS II. Model 1: nomogram; Model 2: SAPS II. Solid line: The patient does not apply the nomogram, and the net income is zero; Gray line: All patients used the nomogram. The further the red solid line and blue solid line are from the dotted line, the greater the clinical application value.
Discussion
In our study, patients with SAE have a hospitalized mortality rate of 30.5%. Intestinal infections and microbial infections were not found to be related to the prognosis of SAE patients. We identified independent factors for the prognosis of SAE patients, which included SAPS II, renal replacement therapy, albumin, INR, lactate, temperature, SpO2, and respiratory failure. We further developed and validated a comprehensive visual nomogram to predict the prognosis of SAE patients. The nomogram showed a high degree of validity, discrimination, and clinical utility.
Microorganisms in the body are related to many diseases. Li-Hong Peng and Lihong Peng et al. (2018, 2020a) established a model to predict the association of microorganisms with various diseases through microorganisms, and the model showed excellent performance. Probiotics can change the types of intestinal microflora and affect patients’ mood and memory function (Bagga et al., 2018). Xia et al. (2018) found that probiotics can improve the cognitive function of patients with hepatic encephalopathy. Wei et al. (2020) found that Enterobacteriaceae can improve patients’ mild cognitive impairment. Although the study of Li et al. (2018) has proved that the intestinal flora could affect SAE through the vagus nerve. Unfortunately, our study found that intestinal infections and microbes have nothing to do with the prognosis of SAE patients. It may require further experimental study in the future.
The SAPS II was developed from a European/North American study. Patients included in that study were from medical and surgical wards, as well as ICUs, in ten European and two North American countries. The authors showed that SAPS II demonstrated a high level of predictivity on the death of hospitalized patients (Le Gall et al., 1993). Although later studies have suggested better predictive tools than SAPS II (Norrie, 2015), our cohort study showed that the SAPS II score of non-surviving patients was significantly higher than that of patients in the survival group, which further supports the accuracy of SAPS II as an independent predictive factor for hospital mortality in SAE patients.
Our cohort study demonstrated that the incidence of renal replacement therapy in the non-survival group was significantly higher than that in the survival group. After LASSO and multivariate Cox regression analyses, it was found to be an independent risk factor for the death of SAE. However, the use of renal replacement therapy cannot be assumed to be an independent factor for death. Patients who were given renal replacement therapy were more likely to be severely ill with worse kidney function, more serious infection, and a higher incidence of multiple organ dysfunction, and internal environmental disorders (Palevsky, 2008; Bagshaw and Wald, 2018; Tandukar and Palevsky, 2018). This, in turn, leads to a higher mortality rate. Our cohort study also showed that SAE patients with respiratory failure, worse coagulation function, and lower albumin levels were more likely to die. The mechanism of multiple organ dysfunction in patients with SAE is consistent with sepsis patients, and it may be attributed to the immune response to sepsis (Nolt et al., 2018); circulatory abnormalities (De Backer et al., 2013; Finfer et al., 2013), organ ischemia; hypoxia endothelial permeability increases (Kopterides et al., 2011; Opal and van der Poll, 2015); cell death (Pinheiro da Silva and Nizet, 2009); and mitochondrial dysfunction (Yang et al., 2015; Sun et al., 2019). We should promptly correct the respiratory failure, give component blood transfusions, correct coagulation function, supplement albumin, and reduce the mortality of SAE patients.
Lactate is a vital laboratory indicator that affects the prognosis of patients with sepsis. It is widely known, the higher the lactate level, the worse the patient’s prognosis (Suetrong and Walley, 2016; Liu et al., 2019). Serum lactate is also an independent risk factor for the prognosis of SAE patients in our cohort study. In patients with septic shock, fluid resuscitation guided by monitoring the serum lactate is still the most effective method for reducing the mortality of septic shock (Hernández et al., 2019). Serum lactate is used to evaluate disease severity, guide treatment plan, and predict patient prognosis (Suetrong and Walley, 2016). Lower serum lactate levels are associated with reduced patient mortality (Puskarich et al., 2013; Vincent et al., 2016). Therefore, serum lactate is an important indicator for evaluating the prognosis of patients with sepsis and SAE. The results of previous studies further support our conclusion. Patients with lactate acidosis and hyperlactic acidosis, we should timely rehydration and other treatments to reduce lactate levels and improve the survival rate of SAE patients.
There is currently a lack of effective tools for predicting hospital mortality in SAE patients. By exploring the clinical indicators for evaluating the prognosis of SAE patients, through Lasso and Cox regression analysis, eight potential predictors, including SAPS II, renal replacement therapy, albumin, INR, lactate, body temperature, SpO2, respiratory failure were identified and used to establish a comprehensive visual nomogram for predicting hospital mortality of SAE patient. The nomogram demonstrated excellent discrimination (AUC, 0.812; 95%CI: 0.780–0.843) that was better than SAPS II (AUC, 0.745; 95%CI: 0.708–0.783) in the primary cohort. The validation cohort is used to verify the calibration function of the nomogram and has good consistency with the model (Figure 5). In terms of clinical application, the net benefit of patients using nomogram is better than that of SAPS II (Figure 6), and the nomogram shows good performance in predicting hospital mortality of SAE patients. For the evaluation of nomograms, in addition to the above-mentioned AUC value and other methods, some new methods may be needed to evaluate in the future (Zhou et al., 2019; Liu F. et al., 2020).
Several limitations must be acknowledged. Firstly, our study is retrospective based on the MIMIC database, which has its inherent limitations. For instance, our study identified septic patients using the definition from the ICD-9 diagnostic code, which may be different from the Sepsis-3 definition. However, this small discrepancy does not deny the clinical application value of our study. Although our nomogram has excellent performance, our data is older and we need new data to verify in the future. Secondly, we included ICU patients for analysis, which enhanced the heterogeneity of the study population, and thus our results may not be suitable for patients outside the ICU. Third, there are a lot of more widely used methods in feature selection and classification than Lasso, such as elastic net, random forest, and deep neural network (Huang et al., 2017; He et al.,2020a,b; Liang et al., 2020; Liu C. et al., 2020; Yang J. et al., 2020). Model development only uses the general linear regression method, fusing various biological information by multi-information fusion (Peng et al., 2017), bipartite local model (Peng et al., 2020b), and the KATZ method (Zhou et al., 2020) should be further studied in the future. We will apply these methods to further improve the performance of our model. Finally, the Model establishment was only verified internally, and further external verification is required in the future to illustrate its extrapolation.
Conclusion
A nomogram was established for predicting hospital mortality of SAE patients, which was accurate and clinically useful. The nomogram also performed better than the SAPS II with a higher net benefit.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.
Ethics Statement
The studies involving human participants were reviewed and approved by the establishment of the database was approved by the Massachusetts Institute of Technology (Cambridge, MA, United States) and the Institutional Review Boards of Beth Israel Deaconess Medical Center (Boston, MA, United States). Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
Author Contributions
LZ, YL, XS, and YL developed this manuscript central ideas. YW and ZG collected the data regarding the manuscript. LZ wrote the first draft of the manuscript. YL and XS revised the manuscript, worked on the English, and made the final version of the manuscript. All authors read and approved the final manuscript.
Funding
This work was supported by the CAMS Innovation Fund for Medical Sciences (CIFMS, serial number 2020-I2M-C&T-B-014).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmicb.2021.737066/full#supplementary-material
Supplementary Material 1 | Exclusion of patients with traumatic injury from the MIMIC III database according to ICD-9 codes.
Supplementary Material 2 | Exclusion of patients with intracerebral hemorrhage, cerebral embolism, and ischemic stroke disease from the MIMIC III database according to ICD-9 codes.
Supplementary Material 3 | Exclusion of patients with meningitis and encephalitis from the MIMIC III database according to ICD-9 codes.
Supplementary Material 4 | Exclusion of patients with Epilepsy disease from the MIMIC III database according to ICD-9 codes.
Supplementary Material 5 | Exclusion of patients with other cerebrovascular disease from the MIMIC III database according to ICD-9 codes.
Supplementary Material 6 | Exclusion of patients with mental disorders and neurological disease from the MIMIC III database according to ICD-9 codes.
Supplementary Material 7 | Exclusion of patients with alcohol intoxication/abuse or drug abuse from the MIMIC III database according to ICD-9 codes.
Supplementary Material 8 | Exclusion of patients with metabolic encephalopathy, hepatic encephalopathy, hypertensive encephalopathy, diabetes with coma, disorders of the urea cycle, hypernatremia from the MIMIC III database according to ICD-9 codes.
Supplementary Material 9 | Type of disease and ICD-9 codes.
Supplementary Material 10 | Infection site and ICD-9 codes.
Supplementary Material 11 | Organ failure was defined by a combination of ICD-9-CM and Current Procedural Terminology (CPT) codes.
Supplementary Material 12 | Data profiling report.
Supplementary Material 13 | Data supplement, potential predictors by LASSO logistic regression model.
Abbreviations
SAE, sepsis-associated encephalopathy; SAPS II, simplified acute physiology score; SOFA, sequential organ failure assessment; qSOFA, quick sequential organ failure assessment; GCS, Glasgow coma scale; ICU, intensive care unit; MIMIC-III, Medical Information Mart for Intensive Care III; ICD-9, International Classification of Diseases Ninth Revision; ROC, receiver operating characteristic curve; INR, international normalized ratio.
References
Annane, D., and Sharshar, T. (2015). Cognitive decline after sepsis. Lancet Respir. Med. 3, 61–69. doi: 10.1016/s2213-2600(14)70246-2
Bagga, D., Reichert, J. L., Koschutnig, K., Aigner, C. S., Holzer, P., Koskinen, K., et al. (2018). Probiotics drive gut microbiome triggering emotional brain signatures. Gut Microbes 9, 486–496.
Bagshaw, S. M., and Wald, R. (2018). Indications and timing of continuous renal replacement therapy application. Contrib. Nephrol. 194, 25–37. doi: 10.1159/000485598
De Backer, D., Donadello, K., Sakr, Y., Ospina-Tascon, G., Salgado, D., Scolletta, S., et al. (2013). Microcirculatory alterations in patients with severe sepsis: impact of time of assessment and relationship with outcome. Crit. Care Med. 41, 791–799. doi: 10.1097/ccm.0b013e3182742e8b
Eidelman, L. A., Putterman, D., Putterman, C., and Sprung, C. L. (1996). The spectrum of septic encephalopathy. Definitions, etiologies, and mortalities. JAMA 275, 470–473. doi: 10.1001/jama.1996.03530300054040
Finfer, S. R., Vincent, J. L., Vincent, J. L., and De Backer, D. (2013). Circulatory shock. N. Engl. J. Med. 369, 1726–1734.
Fraser, G. L., Riker, R. R., and Coursin, D. C. (2014). Long-term cognitive impairment after critical illness. N. Engl. J. Med. 370:184. doi: 10.1056/nejmc1313886
Gofton, T. E., and Young, G. B. (2012). Sepsis-associated encephalopathy. Nat. Rev. Neurol. 8, 557–566.
Grochowska, M., Wojnar, M., and Radkowski, M. (2018). The gut microbiota in neuropsychiatric disorders. Acta Neurobiol. Exp. 78, 69–81. doi: 10.21307/ane-2018-008
He, B., Dai, C., Lang, J., Bing, P., Tian, G., Wang, B., et al. (2020a). A machine learning framework to trace tumor tissue-of-origin of 13 types of cancer based on DNA somatic mutation. Biochim. Biophys. Acta Mol. Basis Dis. 1866:165916. doi: 10.1016/j.bbadis.2020.165916
He, B., Lang, J., Wang, B., Liu, X., Lu, Q., He, J., et al. (2020b). TOOme: a novel computational framework to infer cancer tissue-of-origin by integrating both gene mutation and expression. Front. Bioeng. Biotechnol. 8:394. doi: 10.3389/fbioe.2020.00394
Hernández, G., Ospina-Tascón, G. A., Damiani, L. P., Estenssoro, E., Dubin, A., Hurtado, J., et al. (2019). Effect of a resuscitation strategy targeting peripheral perfusion status vs serum lactate levels on 28-day mortality among patients with septic shock: the andromeda-shock randomized clinical trial. JAMA 321, 654–664. doi: 10.1001/jama.2019.0071
Huang, L., Li, X., Guo, P., Yao, Y., Liao, B., Zhang, W., et al. (2017). Matrix completion with side information and its applications in predicting the antigenicity of influenza viruses. Bioinformatics 33, 3195–3201. doi: 10.1093/bioinformatics/btx390
Iwashyna, T. J., Ely, E. W., Smith, D. M., and Langa, K. M. (2010). long-term cognitive impairment and functional disability among survivors of severe sepsis. JAMA 304, 1787–1794. doi: 10.1001/jama.2010.1553
Johnson, A. E., Pollard, T. J., Shen, L., Lehman, L. W., Feng, M., Ghassemi, M., et al. (2016). MIMIC-III, a freely accessible critical care database. Sci. Data 3:160035.
Kopterides, P., Nikitas, N., Vassiliadi, D., Orfanos, S. E., Theodorakopoulou, M., Ilias, I., et al. (2011). Microdialysis-assessed interstitium alterations during sepsis: relationship to stage, infection, and pathogen. Intensive Care Med. 37, 1756–1764.
Le Gall, J. R., Lemeshow, S., and Saulnier, F. (1993). A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA 270, 2957–2963. doi: 10.1001/jama.270.24.2957
Li, S., Lv, J., Li, J., Zhao, Z., Guo, H., Zhang, Y., et al. (2018). Intestinal microbiota impact sepsis associated encephalopathy via the vagus nerve. Neurosci. Lett. 662, 98–104. doi: 10.1016/j.neulet.2017.10.008
Liang, Y., Wang, H., Yang, J., Li, X., Dai, C., Shao, P., et al. (2020). A deep learning framework to predict tumor tissue-of-origin based on copy number alteration. Front. Bioeng. Biotechnol. 8:701. doi: 10.3389/fbioe.2020.00701
Liu, C., Wei, D., Xiang, J., Ren, F., Huang, L., Lang, J., et al. (2020). An improved anticancer drug-response prediction based on an ensemble method integrating matrix completion and ridge regression. Mol. Ther. Nucleic Acids 21, 676–686. doi: 10.1016/j.omtn.2020.07.003
Liu, F., Peng, L., Tian, G., Yang, J., Chen, H., Hu, Q., et al. (2020). Identifying small molecule-miRNA associations based on credible negative sample selection and random walk. Front. Bioeng. Biotechnol. 8:131. doi: 10.3389/fbioe.2020.00131
Liu, Z., Meng, Z., Li, Y., Zhao, J., Wu, S., Gou, S., et al. (2019). Prognostic accuracy of the serum lactate level, the SOFA score and the qSOFA score for mortality among adults with Sepsis. Scand. J. Trauma Resuc. Emerg. Med. 27:51.
Nolt, B., Tu, F., Wang, X., Ha, T., Winter, R., Williams, D. L., et al. (2018). Lactate and immunosuppression in sepsis. Shock 49, 120–125. doi: 10.1097/shk.0000000000000958
Norrie, J. (2015). Mortality prediction in ICU: a methodological advance. Lancet Respir. Med. 3, 5–6. doi: 10.1016/s2213-2600(14)70268-1
Opal, S. M., and van der Poll, T. (2015). Endothelial barrier dysfunction in septic shock. J. Intern. Med. 277, 277–293. doi: 10.1111/joim.12331
Palevsky, P. M. (2008). Indications and timing of renal replacement therapy in acute kidney injury. Crit. Care Med. 36(4 Suppl.), S224–S228.
Peng, L. H., Yin, J., Zhou, L., Liu, M. X., and Zhao, Y. (2018). Human microbe-disease association prediction based on adaptive boosting. Front. Microbiol. 9:2440. doi: 10.3389/fmicb.2018.02440
Peng, L., Bo, L., Wen, Z., Li, Z., and Li, K. (2017). Predicting drug–target interactions with multi-information fusion. IEEE J. Biomed. Health Inf. 21, 561–572. doi: 10.1109/jbhi.2015.2513200
Peng, L., Shen, L., Liao, L., Liu, G., and Zhou, L. (2020a). RNMFMDA: a microbe-disease association identification method based on reliable negative sample selection and logistic matrix factorization with neighborhood regularization. Front. Microbiol. 11:592430. doi: 10.3389/fmicb.2020.592430
Peng, L., Tian, X., Shen, L., Kuang, M., and Zhou, L. (2020b). Identifying effective antiviral drugs against SARS-CoV-2 by drug repositioning through virus-drug association prediction. Front. Genet. 11:577387. doi: 10.3389/fgene.2020.577387
Pinheiro da Silva, F., and Nizet, V. (2009). Cell death during sepsis: integration of disintegration in the inflammatory response to overwhelming infection. Apoptosis 14, 509–521. doi: 10.1007/s10495-009-0320-3
Puskarich, M. A., Trzeciak, S., Shapiro, N. I., Albers, A. B., Heffner, A. C., Kline, J. A., et al. (2013). Whole blood lactate kinetics in patients undergoing quantitative resuscitation for severe sepsis and septic shock. Chest 143, 1548–1553. doi: 10.1378/chest.12-0878
Sauerbrei, W., Royston, P., and Binder, H. (2007). Selection of important variables and determination of functional form for continuous predictors in multivariable model building. Stat. Med. 26, 5512–5528. doi: 10.1002/sim.3148
Schuler, A., Wulf, D. A., Lu, Y., Iwashyna, T. J., Escobar, G. J., and Shah, N. H. (2018). The impact of acute organ dysfunction on long-term survival in sepsis. Crit. Care Med. 46, 843–849. doi: 10.1097/ccm.0000000000003023
Singer, M., Deutschman, C. S., Seymour, C. W., Shankar-Hari, M., Annane, D., Bauer, M., et al. (2016). The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA 315, 801–810.
Sonneville, R., De Montmollin, E., Poujade, J., Garrouste-Orgeas, M., Souweine, B., Darmon, M., et al. (2017). Potentially modifiable factors contributing to sepsis-associated encephalopathy. Intensive Care Med. 43, 1075–1084. doi: 10.1007/s00134-017-4807-z
Suetrong, B., and Walley, K. R. (2016). Lactic Acidosis in sepsis: it’s not all anaerobic implications for diagnosis and management related systems. Chest 149, 252–261. doi: 10.1378/chest.15-1703
Sun, H., Yang, J., Zhang, T., Long, L. P., Jia, K., Yang, G., et al. (2013). Using sequence data to infer the antigenicity of influenza virus. mBio 4, e00230–13.
Sun, J., Zhang, J., Tian, J., Virzi, G. M., Digvijay, K., Cueto, L., et al. (2019). Mitochondria in sepsis-induced AKI. J. Am. Soc. Nephrol. 30, 1151–1161.
Tandukar, S., and Palevsky, P. M. (2018). Continuous renal replacement therapy - who, when, why and how. Chest 155, 626–638.
Vincent, J. L., Quintairos, E. S. A., Couto, L. Jr., and Taccone, F. S. (2016). The value of blood lactate kinetics in critically ill patients: a systematic review. Crit. Care 20:257.
Wang, F., Yang, J., Lin, H., Li, Q., Ye, Z., Lu, Q., et al. (2020). Improved human age prediction by using gene expression profiles from multiple tissues. Front. Genet. 11:1025. doi: 10.3389/fgene.2020.01025
Wei, W., Miao, L. V., Ng, T., Lei, F., and Lee, Y. K. (2020). Mental awareness improved mild cognitive impairment and modulated gut microbiome. Aging 12, 24371–24393. doi: 10.18632/aging.202277
Xia, X., Chen, J., Xia, J., Wang, B., Liu, H., Yang, L., et al. (2018). Role of probiotics in the treatment of minimal hepatic encephalopathy in patients with HBV-induced liver cirrhosis. J. Int. Med. Res. 46, 3596–3604. doi: 10.1177/0300060518776064
Yang, J., Huang, T., Petralia, F., Long, Q., Zhang, B., Argmann, C., et al. (2015). Synchronized age-related gene expression changes across multiple tissues in human and the link to complex diseases. Sci. Rep. 5:15145.
Yang, J., Peng, S., Zhang, B., Houten, S., Schadt, E., Zhu, J., et al. (2020). Human geroprotector discovery by targeting the converging subnetworks of aging and age-related diseases. Geroscience 42, 353–372. doi: 10.1007/s11357-019-00106-x
Yang, Y., Liang, S., Geng, J., Wang, Q., Wang, P., Cao, Y., et al. (2020). Development of a nomogram to predict 30-day mortality of patients with sepsis-associatwed encephalopathy: a retrospective cohort study. J. Intensive Care 8:45.
Zhou, L., Li, Z., Yang, J., Tian, G., Liu, F., Wen, H., et al. (2019). Revealing drug-target interactions with computational models and algorithms. Molecules 24:1714. doi: 10.3390/molecules24091714
Keywords: sepsis associated encephalopathy, prognosis, hospital mortality, nomogram, microbial infection
Citation: Zhao L, Li Y, Wang Y, Gao Q, Ge Z, Sun X and Li Y (2021) Development and Validation of a Nomogram for the Prediction of Hospital Mortality of Patients With Encephalopathy Caused by Microbial Infection: A Retrospective Cohort Study. Front. Microbiol. 12:737066. doi: 10.3389/fmicb.2021.737066
Received: 06 July 2021; Accepted: 02 August 2021;
Published: 19 August 2021.
Edited by:
Jialiang Yang, Genesis (Beijing) Co., Ltd., ChinaReviewed by:
Lihong Peng, Hunan University of Technology, ChinaXiao-zheng Zou, China Medical University, China
Copyright © 2021 Zhao, Li, Wang, Gao, Ge, Sun and Li. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yi Li, YmlsbGxpeWlAMTI2LmNvbQ==; orcid.org/0000-0002-7158-3624; Xibo Sun, c3VueGlibzkyQHNpbmEuY29t
†These authors have contributed equally to this work