Skip to main content

ORIGINAL RESEARCH article

Front. Med., 10 December 2021
Sec. Intensive Care Medicine and Anesthesiology
This article is part of the Research Topic Clinical Application of Artificial Intelligence in Emergency and Critical Care Medicine, Volume II View all 19 articles

A Machine Learning Approach for the Prediction of Traumatic Brain Injury Induced Coagulopathy

  • 1Department of Plastic Surgery and Burns, Tangdu Hospital, Fourth Military Medical University, Xi'an, China
  • 2Department of Health Statistics, Second Military Medical University, Shanghai, China
  • 3Department of Neurosurgery, Tangdu Hospital, Fourth Military Medical University, Xi'an, China

Background: Traumatic brain injury-induced coagulopathy (TBI-IC), is a disease with poor prognosis and increased mortality rate.

Objectives: Our study aimed to identify predictors as well as develop machine learning (ML) models to predict the risk of coagulopathy in this population.

Methods: ML models were developed and validated based on two public databases named Medical Information Mart for Intensive Care (MIMIC)-IV and the eICU Collaborative Research Database (eICU-CRD). Candidate predictors, including demographics, family history, comorbidities, vital signs, laboratory findings, injury type, therapy strategy and scoring system were included. Models were compared on area under the curve (AUC), accuracy, sensitivity, specificity, positive and negative predictive values, and decision curve analysis (DCA) curve.

Results: Of 999 patients in MIMIC-IV included in the final cohort, a total of 493 (49.35%) patients developed coagulopathy following TBI. Recursive feature elimination (RFE) selected 15 variables, including international normalized ratio (INR), prothrombin time (PT), sepsis related organ failure assessment (SOFA), activated partial thromboplastin time (APTT), platelet (PLT), hematocrit (HCT), red blood cell (RBC), hemoglobin (HGB), blood urea nitrogen (BUN), red blood cell volume distribution width (RDW), creatinine (CRE), congestive heart failure, myocardial infarction, sodium, and blood transfusion. The external validation in eICU-CRD demonstrated that adapting boosting (Ada) model had the highest AUC of 0.924 (95% CI: 0.902–0.943). Furthermore, in the DCA curve, the Ada model and the extreme Gradient Boosting (XGB) model had relatively higher net benefits (ie, the correct classification of coagulopathy considering a trade-off between false- negatives and false-positives)—over other models across a range of threshold probability values.

Conclusions: The ML models, as indicated by our study, can be used to predict the incidence of TBI-IC in the intensive care unit (ICU).

Introduction

Traumatic brain injury (TBI) is still one of the leading causes of death and disability worldwide with over 10 million people hospitalized every year (1). It is common to witness the alterations of the coagulative system and disturbed coagulation function in TBI patients. Results from previous studies indicated that two in three patients with severe TBI manifested coagulation system abnormalities upon admission to the emergency department, and then continued to worsen (2, 3). And the overall mortality of TBI-induced coagulopathy (TBI-IC) attains 17–86% (46). TBI-IC is characterized by both hypo-coagulopathy with prolonged bleeding or hyper-coagulopathy with an increased prothrombotic tendency, or both (4, 7). Previous study unearthed that coagulopathy following TBI was related to higher mortality and prolonged intensive care unit (ICU) stay (8). In early stage, potential mechanisms include the dysfunction of the coagulation cascade and hyperfibrinolysis, both of which contribute to hemorrhagic progression. Later, a poorly defined prothrombotic stage emerges, partly caused by fibrinolysis shutdown and hyperactive platelets (911).

Undoubtedly, it is imperative to promote the early identification of TBI-IC in a timely way. Laboratory assays, including international normalized ratio (INR) and thromboelastogram are widely used to diagnose TBI-IC. Nonetheless, these assays have limited value in predicting coagulopathy before it develops. In recent years, as a field of artificial intelligence, machine learning (ML) is able to learn from data based on computational modeling. Likewise, ML can fit high-order relationships between covariates and outcomes in data-rich environments (1214).

This study aimed to determine whether ML algorithms using demographic, comorbidities, laboratory examinations and other variables could predict TBI-IC with considerable accuracy and identify factors contributing to the prediction power.

Materials and Methods

Data Source

We conducted this retrospective study based on two sizeable critical care databases, the Medical Information Mart for Intensive Care (MIMIC)-IV version 1.0 (15) and eICU Collaborative Research Database (eICU-CRD) version 1.2 (16). In brief, the MIMIC-IV database, an updated version of MIMIC-III, incorporated comprehensive, de-identified data of patients admitted to the ICUs at the Beth Israel Deaconess Medical Center in Boston, Massachusetts, between 2008 and 2019, containing data from 383220 distinct admissions (single center). The other database, eICU-CRD, was a multicenter, freely available, sizeable database with de-identified high granularity health data associated for over 200,000 admissions to ICUs across the United States between 2014 and 2015. This study was approved by the Institutional Review Boards of Beth Israel Deaconess Medical Center (Boston, MA) and the Massachusetts Institute of Technology (Cambridge, MA). Requirement for individual patient consent was waived because the study did not impact clinical care and all protected health information was deidentified. One author (CP) has obtained access to both databases and was responsible for data extraction (Certification number: 41657645). The study was reported in accordance to the REporting of studies Conducted using Observational Routinely collected health Data (RECORD) statement (17).

Participant Selection

Inclusion criteria were patients with moderate and severe TBI [msTBI: defined as Glasgow Coma Score (GCS) = < 12]. People with an age of less than 16 years old, ICU stays less than 48 h, and no coagulation index within 24 h of ICU admission were excluded from the study. Moreover, for patients with ICU admissions more than once, only data of the first ICU admission of the first hospitalization were included in the analysis.

Predictors of Coagulopathy

A total of 53 predictor variables for the ML models were initially included. Specifically, in this study, the data were extracted from MIMIC-IV and eICU-CRD including age, gender, race, family history of stroke. Coexisting disorders were also collected based on the recorded International Classification of Diseases (ICD)-9 and ICD-10 codes. Then, the Charlson comorbidity index (CCI) was calculated from its component variables [myocardial infarction, congestive heart failure, peripheral vascular disease, cerebrovascular disease, dementia, chronic pulmonary disease, rheumatic disease, peptic ulcer disease, diabetes, paraplegia, renal disease, malignant cancer, severe liver disease, metastatic solid tumor and acquired immunodeficiency syndrome (AIDS)]. Lastly, we extracted data containing vital signs, laboratory findings, injury type, different therapy strategies and scoring system on the first day of ICU admission. Details of missing data can be seen in Supplementary Table 1.

Outcome

In accordance to previous literature, the following parameters were considered for diagnosing coagulopathy: an activated partial thromboplastin time (APTT) > 40s, an INR > 1.4, or platelet (PLT) counts < 100 × 109/L (4, 18).

Statistical Analysis

Values were presented as the means with standard deviations (if normal) or medians with interquartile ranges (IQR) (if non-normal) for continuous variables, and total numbers with percentages for categorical variables. Proportions were compared using χ2 test or Fisher exact tests while continuous variables were compared using the t test or Wilcoxon rank sum test, as appropriate.

In this study, recursive feature elimination (RFE) as a feature selection method was used to select the most relevant features. In short, RFE recursively fits a model based on smaller feature sets until a specified termination criterion is reached. In each loop, in the trained model, features were ranked based on their importance. Finally, dependency and collinearity were eliminated. Features were then considered in groups of 15/25/35/45/ALL (ALL = 53 variables, as represented in Figure 1) organized by the ranks obtained after the feature selection method. To find the optimal hyperparameters, 10-fold cross-validation was used as a resampling method. In each iteration, every nine folds were used as training subset, and the remaining one fold was processed to tune the hyperparameters. This training-testing process was repeated thirty times. And in this way, each sample would be involved in the training model, and also participated in the testing model, so that all data were used to the greatest extent.

FIGURE 1
www.frontiersin.org

Figure 1. Overview of the methods used for data extraction, training, and testing. ICU, intensive care unit; MIMIC-IV, Medical Information Mart for Intensive Care-IV; eICU-CRD, eICU Collaborative Research Database; TBI, traumatic brain injury; ML, machine learning; NNET, artificial neural network; NB, naïve bayes; GBM, gradient boosting machine; Ada, adapting boosting; RF, random forest; BT, bagged trees; XGB, eXtreme Gradient Boosting.

In this study, we employed seven diverse ML algorithms to develop models, containing artificial neural network (NNET), naïve bayes (NB), gradient boosting machine (GBM), adapting boosting (Ada), random forest (RF), bagged trees (BT), and eXtreme Gradient Boosting (XGB). Initially, we conducted internal validation on the development sets to quantify optimism in the predictive performance and evaluate stability of the prediction model. Bootstrap Resampling technique with 100 iterations was used to evaluate the internal validity of each model. External validation of the models was performed in eICU-CRD. All the models were assessed in multiple dimensions regarding their model performance. The median and 95% confidence intervals of area under the curve (AUC) were calculated, where an AUC value of 1.0 means perfect discrimination and 0.5 represents no discrimination. And the accuracy, sensitivity, specificity, negative predictive value, and positive predictive value were also calculated. Additionally, to determine the clinical usefulness of the included variables by quantifying the net benefit at different threshold probabilities, we conducted the decision curve analysis (DCA) (19). Finally, the “Shiny” package in the R was used to construct a visual data analysis platform.

All analyses were performed by the statistical software packages R version 4.0.2 (http://www.R-project.org, The R Foundation). In our study, we used the “Caret” R packages to achieve the process. P values less than 0.05 (two-sided test) were considered as statistically significant.

Results

Baseline Characteristics

Variable values on the first day of the TBI patients in MIMIC-IV were analyzed. As shown in Figure 1 and Table 1 of 5717 TBI patients in MIMIC-IV, 999 were included in the final cohort. A total of 493 patients developed coagulopathy, whereas 506 patients did not. A cohort of 285 patients with coagulopathy following TBI in eICU-CRD was included as external dataset (Supplementary Table 2). The process of data extraction, training preparation, data testing via different ML algorithms is depicted in Figure 1. People who had coagulopathy were more likely to be female, with family history of stroke, myocardial infarction, congestive heart failure, peripheral vascular disease, cerebrovascular disease, renal disease, malignant cancer, severe liver disease, metastatic solid tumor as well as having higher CCI, heart rate, respiratory rate, red blood cell volume distribution width (RDW), INR, lactate, buffer excess (BE), FiO2, chloride, sodium, glucose, creatinine (CRE), blood urea nitrogen (BUN), blood transfusion, sepsis related organ failure assessment (SOFA), acute physiology score III (APSIII), and longer APTT, prothrombin time (PT), mechanical ventilation (MV). Furthermore, they were less likely to have dementia, cerebral contusion, with lower temperature, mean artery pressure (MAP), red blood cell (RBC), white blood cell (WBC), hemoglobin (HGB), PLT, hematocrit (HCT), pH, bicarbonate, PaO2/FiO2, calcium, urine output, and GCS.

TABLE 1
www.frontiersin.org

Table 1. Baseline characteristics of the MIMIC-IV cohorts.

Variable Importance

A total of 15 important predictors (Figure 2) was selected by the RFE algorithm, including INR, PT, SOFA, APTT, PLT, HCT, RBC, HGB, BUN, RDW, CRE, congestive heart failure, myocardial infarction, sodium, and blood transfusion. Then, these 15 variables were used in all the subsequent analysis for all models in both training and testing sets.

FIGURE 2
www.frontiersin.org

Figure 2. Association between the number of variables allowed to be considered at each split and the prediction accuracy in the REF algorithm. REF, recursive feature elimination.

Prediction Performance in eICU-CRD

The discriminatory abilities of all models for the prediction of coagulopathy are in Figure 3 and Table 2. Within the training set, the NNET, NB, GBM, Ada, RF, BT and XGB models were established, and the testing set obtained AUCs of 0.910, 0.867, 0.920, 0.924, 0.915, 0.881, and 0.917, respectively. Comparatively, Ada had the highest predictive performance among these seven models (AUC 0.924, 95% Confidence Interval (CI) 0.902 to 0.943), while NB had the poorest generalization ability (AUC 0.867, 95% CI 0.839 to 0.891). The decision curve compared the net benefit of the best model and alternative approaches for clinical decision making. As shown in Figure 4, the net benefits of the Ada model and XGB model surpassed those of other ML models, including NB for all threshold values, showing that these two models were more superior in predicting the TBI-IC in this cohort.

FIGURE 3
www.frontiersin.org

Figure 3. Area under the curve of receiver operating characteristic curve by machine learning models in the validation cohort. ROC, receiver operate characteristics; AUC, area under the curve; NNET, artificial neural network; NB, naïve bayes; GBM, gradient boosting machine; Ada, adapting boosting; RF, random forest; BT, bagged trees; XGB, eXtreme Gradient Boosting.

TABLE 2
www.frontiersin.org

Table 2. Prediction performance of the machine learning models in the testing set.

FIGURE 4
www.frontiersin.org

Figure 4. Decision curve analysis. The net benefits of the Ada and XGB are relatively larger over a range of threshold probability values compared with those of other ML models. Ada, adapting boosting; XGB, eXtreme Gradient Boosting; ML, machine learning. NNET, arti?cial neural network; NB, naïve bayes; GBM, gradient boosting machine; RF, random forest; BT, bagged trees.

In the Figure 5, the fifth predictor variables in the ML models are shown. Each variable included in the study had varying importance over the TBI-IC relying on the ML approach. Overall, the coagulation profile (PLT, INR, PT) was the variable with relatively higher importance across all ML algorithms, followed by APTT, SOFA, and so forth.

FIGURE 5
www.frontiersin.org

Figure 5. Variable importance in seven different ML models. ML, machine learning; NNET, artificial neural network; NB, naïve bayes; GBM, gradient boosting machine; Ada, adapting boosting; RF, random forest; BT, bagged trees; XGB, eXtreme Gradient Boosting; INR, international normalized ratio; PT, prothrombin time; SOFA, sepsis related organ failure assessment; APTT, activated partial thromboplastin time; PLT, platelet; HCT, hematocrit; RBC, red blood cell; HGB, hemoglobin; BUN, blood urea nitrogen; RDW, red blood cell volume distribution width; CRE, creatinine.

Model Interpretation

We next used the Shiny to illustrate the impacts of key features on the coagulopathy prediction model in individual patients. As shown in Figure 6, the information of one patient was input into the model: PLT (186 × 109/L), INR (1.1), PT (12s), APTT (29s), SOFA (4), RDW (44%), no congestive heart failure, RBC (3.9 × 109/L), CRE (8.7 mg/dL), BUN (24 mg/dL), sodium (142.3 mmol/L), HCT (39.2%), no myocardial infarction, no blood transfusion, HGB (14 g/dl). The model analyzed that the risk of coagulopathy in this patient was 82.10%, indicating that the probability of coagulopathy for the patients was high, and precaution measures were recommended.

FIGURE 6
www.frontiersin.org

Figure 6. Examples of website usage. Entering the input value determined the coagulopathy and displayed how each value contributed to the prediction. PLT, platelet; INR, international normalized ratio; PT, prothrombin time; APTT, activated partial thromboplastin time; SOFA, sepsis related organ failure assessment; RDW, red blood cell volume distribution width; RBC, red blood cell; CRE, creatinine; BUN, blood urea nitrogen; HCT, hematocrit; HGB, hemoglobin.

Discussion

Altered hemostasis and hemorrhagic progression are substantial challenges in the clinical management of TBI. Patients with TBI-IC were at a high risk of death over those with normal coagulation. Notably, studies elucidating the rapid prediction of TBI-IC, are warranted. In this sense, our study developed and validated ML models, providing an accurate predictive tool for coagulopathy in TBI patients. Specifically, seven ML models (NNET, NB, GBM, Ada, RF, BT and XGB) were used to predict TBI-IC using variables frequently used in clinical practice. Concerning the predictive performance, the Ada outperformed the remaining models. Moreover, results from the DCA indicated that the Ada and XGB models had higher net benefits over a range of threshold probability values than other models. It is remarkable that this study combined preoperative characteristic, comorbidities, and laboratory findings other than coagulopathy profile to establish a prediction model.

To help surgeons use the model, a calculator was developed, which provided a user-friendly interface. After entering the variables, the incidence of TBI-IC will be shown. The explanation of the ML model at the individual level was consistent with the aforementioned explanations at the feature level, and gratifyingly, the black-box concern was further mitigated to a certain extent. Notably, these results facilitated correct clinical decisions, and more importantly, timely treatment strategy.

A previous study conducted by Cosgriff et al. (20) developed a simple score to predict traumatic brain injury-induced coagulopathy (TIC) using four binary predictors [systolic blood pressure <70 mm Hg, temperature <34°C, pH <7.1, and Injury Severity Score (ISS) >25]. However, due to the fact that the ISS cannot be obtained at the time of decision making, the application of such a score was limited. To predict TIC more accurately, two scores have been developed by prehospital information (21, 22). Mitraet al.'s score used 5 predictors (entrapment; systolic blood pressure < 100 mm Hg; temperature < 34°C; suspected abdominal or pelvic injury; and chest decompression), whereas Peltan et al.'s score employed 6 predictors (age, injury mechanism, prehospital shock index>= 1, GCS, and need for prehospital tracheal intubation and/or Cardiopulmonary Resuscitation (CPR)) (21, 22). Nevertheless, in new patients, both scores achieved only moderate performance, with sensitivity <30%. Additionally, the Trauma Induced Coagulopathy Clinical Score (TICCS) employed three components, including general severity, blood pressure, and extent of significant injuries to predict TIC (23). A major limitation of above scores was that much of the prognostic potential of available information was lost through limiting the number of predictors and dichotomizing continuous variables. Consequently, a novel predictive model for early-identification of TIC was established (Predictors: heart rate, systolic blood pressure, temperature, hemothorax, Focused Assessment with Sonography for Trauma (FAST) result, unstable pelvic fracture, long bone fracture, GCS, lactate, base deficit, pH, mechanism of injury, energy) (24). However, one point worth noting was that previous study focused on the entire trauma patient, not TBI patients in particular, which added confusion to some extent.

By interpreting the full model, it was found that many clinical variables can contribute to predict the risk of TBI-IC. In this study, coagulopathy profile (INR, PT, APTT) was found to be the most important variable in predicting TBI-IC, followed by SOFA, blood routine test (PLT, RBC, HCT, HGB, RDW), renal function (BUN and CRE), comorbidities (congestive heart failure, myocardial infarction) and so forth. Among the fifteen included variables, the SOFA was an important predictor. SOFA is an indicator to describe multiple organ dysfunction, including respiratory system, nervous system, cardiovascular system, liver, coagulation and kidney (25). Potential mechanisms may include the fact that SOFA scores are more likely to indicate liver failure or cardiovascular failure. Those organ failures have a high tendency to bleed, and subsequently leading to coagulopathy (26).

In this study, PLT, RBC, HCT, HGB and RDW were important predictors of TBI-IC. In a prospective observational study conducted by Davis PK et al. (27), PLT dysfunction was an early marker for TBI-IC. Potential mechanism included the blood dilution arised from the use of coagulation factor products (28). Nevertheless, we cannot exclude the likelihood that the blood coagulation system was activated by the continuous bleeding itself (29).

RDW, a parameter of red blood cell volume, measures the variability in size of circulating erythrocytes. Although primarily used to diagnose different types of anemias, the RDW was also associated with various thrombotic disease processes including venous thromboembolism (VTE) (30, 31).

Although the underlying mechanism is unclear, it is speculated that inflammatory factors destroy the vascular endothelial integrity, subsequently changing the glycoprotein and ion channel structure of the erythrocyte membrane (32, 33). Consequently, the deformability of the RBC is reduced, in turn, further enables endothelial damage to increase, causing the release of tissue factors that activate the coagulation pathway and triggers disseminated intravascular coagulation (DIC) (34).

In this study we found that renal function indicators (BUN and CRE) can help to indicate the risk of TBI-IC. Similarly, a ML model developed by Zhao QY et al. also identified renal function, including urine output and CRE to predict sepsis-induced coagulopathy (SIC) (35). It is worth noting that renal dysfunction has been associated with both thrombotic and hemorrhagic complications (36, 37). Potential mechanism included less adenosine diphosphate (ADP) and serotonin storage in PLT of patients with renal dysfunction (38, 39). Taken together, the force of impact at the time of TBI can cause shearing of large and small vessels, and result in subdural, subarachnoid, or intracerebral hemorrhages, or a combination of different types. TBI-associated factors might then alter the intricate balance between bleeding and thrombosis formation, leading to coagulopathy (9). Indeed, the complex interactions between the PLT dysfunction, changes in endogenous procoagulant, anticoagulant factors, endothelial cell activation, hypoperfusion, and inflammation related to TBI-IC remain to be elucidated (9, 40, 41).

The strengths of this study lied in the fact that it applied modern ML approaches to predict TBI-IC. It is worth noting that early and accurate prediction of TBI-IC can provide more time for clinicians to adjust corresponding treatment strategies. For example, this model is applicable if detailed medical history is not available for intubated severe head-injured ICU patient. Furthermore, given the heterogeneity of TBI-IC phenotypes (bleeding/thrombotic tendencies), timely treatment strategy would still require investigation and further testing to determine the type and therefore appropriate treatment. Furthermore, it was based on a real-world data with multicenter and external validation, which heighted the reliability of the performance of ML models. Besides, all the information in this dataset was coded independently of the practitioner, making it a reliable source.

Our study had limitations, consistent with those inherent to many large administrative database studies. First, only TBI-IC adults in ICUs were included, while TBI-IC children and hospitalized TBI-IC cases were not analyzed. Nevertheless, in light of the immaturity of the coagulation system in children, more research is indeed required. Second, derived from the ICU participants, the results of our study cannot be generalized to other population, and we did not obtain information including laboratory testing and interventions before ICU admission, which may cause confounders to some extent. Although our models can screen out patients who are at a high risk of TBI-IC, it is the surgeons who decide the administration of anticoagulant therapy. Usually, the interventions are time sensitive and need to occur early after admission, starting in the emergency department. Third, some new coagulation markers, for example, thrombin-antithrombin-III complex and plasmin-α2-antiplasmin complex, are useful in coagulopathy diagnosis (42, 43). Nevertheless, these indicators were not recorded in the MIMIC-IV and eICU database. This was also the case for viscoelastic coagulation testing [Thrombelastograghy (TEG), Rotational thromboelastometry (ROTEM), ClotPro]. Although these testings can provide detailed coagulopathy diagnosis rapidly and have multiple advantages over the traditional plasma-based coagulation tests (PT, APTT, INR), unfortunately, the above indicators were not included in these two databases. Fourth, we did not obtain the results of cranial Computer Tomography (CT) scans in this study, consequently, the original Corticosteroid Randomization After Significant Head Injury (CRASH)-CT score was not available. Moreover, as an administrative database, there was possibility for misclassification of TBI, to reduce bias caused by imprecise coding, we adopted the extensively used ICD-9, 10 codes. Fifth, as with all potential retrospective studies, there was a potential for unmeasured confounders, causing selection bias. Another major limitation worth noting was the changing nature of the variables in a critically ill patient from time of injury and right throughout the continuum of care to ICU discharge. The nature of the retrospective database did not allow for correction for when measurements were taken in relation to the time of injury. Lastly, although our study deeply explored the coagulopathy of TBI in the ICU settings, other outcomes, such as long-term incidence, are also needed further investigation.

Conclusions

In general, the present study suggested that some important features were potentially related to the TBI-IC. The ML model processed large number of variables and subsequently discriminated TBI patients who would and would not develop coagulopathy, facilitating the implement of timely yet efficient treatments. In the future, further validation regarding its clinical application value will become a necessity.

Data Availability Statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found below: These data can be found here: https://mimic-iv.mit.edu/; https://eicu-crd.mit.edu/.

Ethics Statement

The studies involving human participants were reviewed and approved by the Institutional Review Boards of Beth Israel Deaconess Medical Center (Boston, MA) and the Massachusetts Institute of Technology (Cambridge, MA). Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author Contributions

FY, CP, and LP: Conception and design. YL: Administrative support. JW: Collection and assembly of data. FY and CP: Data analysis and interpretation. All authors: Manuscript writing and final approval.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We would like to thank the Massachusetts Institute of Technology and the Beth Israel Deaconess Medical Center for the MIMIC project. We also would like to thank the Philips eICU Research Institute and Philips Healthcare for their contribution to the eICU-CRD project.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2021.792689/full#supplementary-material

Supplementary Table 1. Missing number (%) for included variables in the dataset.

Supplementary Table 2. Baseline characteristics of the eICU-CRD cohorts.

References

1. Iaccarino C, Carretta A, Nicolosi F, Morselli C. Epidemiology of severe traumatic brain injury. J Neurosurg Sci. (2018) 62:535–41. doi: 10.23736/S0390-5616.18.04532-0

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Hoyt DBA. clinical review of bleeding dilemmas in trauma. Semin Hematol. (2004) 41:40–3. doi: 10.1053/j.seminhematol.2003.11.009

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Harhangi BS, Kompanje EJ, Leebeek FW, Maas AI. Coagulation disorders after traumatic brain injury. Acta Neurochirurgica. (2008) 150:165–75. doi: 10.1007/s00701-007-1475-8

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Maegele M, Schöchl H, Menovsky T, Maréchal H, Marklund N, Buki A, et al. Coagulopathy and haemorrhagic progression in traumatic brain injury: advances in mechanisms, diagnosis, and management. Lancet Neurol. (2017) 16:630–47. doi: 10.1016/S1474-4422(17)30197-7

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Delano MJ, Rizoli SB, Rhind SG, Cuschieri J, Junger W, Baker AJ, et al. Prehospital resuscitation of traumatic hemorrhagic shock with hypertonic solutions worsens hypocoagulation and hyperfibrinolysis. Shock (Augusta, Ga). (2015) 44:25–31. doi: 10.1097/SHK.0000000000000368

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Greuters S, van den Berg A, Franschman G, Viersen VA, Beishuizen A, Peerdeman SM, et al. Acute and delayed mild coagulopathy are related to outcome in patients with isolated traumatic brain injury. Critical Care. (2011) 15:R2. doi: 10.1186/cc9399

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Samuels JM, Moore EE, Silliman CC, Banerjee A, Cohen MJ, Ghasabyan A, et al. Severe traumatic brain injury is associated with a unique coagulopathy phenotype. J Trauma Acute Care Surg. (2019) 86:686–93. doi: 10.1097/TA.0000000000002173

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Talving P, Benfield R, Hadjizacharia P, Inaba K, Chan LS, Demetriades D. Coagulopathy in severe traumatic brain injury: a prospective study. J Trauma. (2009) 66:55–61. doi: 10.1097/TA.0b013e318190c3c0

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Laroche M, Kutcher ME, Huang MC, Cohen MJ, Manley GT. Coagulopathy after traumatic brain injury. Neurosurgery. (2012) 70:1334–45. doi: 10.1227/NEU.0b013e31824d179b

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Chen H, Xue LX, Guo Y, Chen SW, Wang G, Cao HL, et al. The influence of hemocoagulation disorders on the development of posttraumatic cerebral infarction and outcome in patients with moderate or severe head trauma. Biomed Res Int. (2013) 2013:685174. doi: 10.1155/2013/685174

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Sun Y, Wang J, Wu X, Xi C, Gai Y, Liu H, et al. Validating the incidence of coagulopathy and disseminated intravascular coagulation in patients with traumatic brain injury–analysis of 242 cases. Br J Neurosurg. (2011) 25:363–8. doi: 10.3109/02688697.2011.552650

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Beam AL, Kohane IS. Big data and machine learning in health care. Jama. (2018) 319:1317–8. doi: 10.1001/jama.2017.18391

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Zhang Z, Ho KM, Hong Y. Machine learning for the prediction of volume responsiveness in patients with oliguric acute kidney injury in critical care. Critical Care. (2019) 23:112. doi: 10.1186/s13054-019-2411-z

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Zhang Z. Predictive analytics in the era of big data: opportunities and challenges. Ann Translat Med. (2020) 8:68. doi: 10.21037/atm.2019.10.97

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Goldberger AL, Amaral LA, Glass L, Hausdorff JM, Ivanov PC, Mark RG, et al. PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation. (2000) 101:E215–20. doi: 10.1161/01.CIR.101.23.e215

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Pollard TJ, Johnson AEW, Raffa JD, Celi LA, Mark RG, Badawi O. The eICU Collaborative Research Database, a freely available multi-center database for critical care research. Scientific Data. (2018) 5:180178. doi: 10.1038/sdata.2018.178

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Benchimol EI, Smeeth L, Guttmann A, Harron K, Moher D, Petersen I, et al. The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. PLoS Med. (2015) 12:e1001885. doi: 10.1371/journal.pmed.1001885

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Chang T, Yan X, Zhao C, Zhang Y, Wang B, Gao L. Risk factors and neurologic outcomes in patients with traumatic brain injury and coagulopathy within 72 h after surgery. Neuropsychiatr Dis Treat. (2021) 17:2905–13. doi: 10.2147/NDT.S323897

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. (2006) 26:565–74. doi: 10.1177/0272989X06295361

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Cosgriff N, Moore EE, Sauaia A, Kenny-Moynihan M, Burch JM, Galloway B. Predicting life-threatening coagulopathy in the massively transfused trauma patient: hypothermia and acidoses revisited. J Trauma. (1997) 42:857–61. doi: 10.1097/00005373-199705000-00016

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Mitra B, Cameron PA, Mori A, Maini A, Fitzgerald M, Paul E, et al. Early prediction of acute traumatic coagulopathy. Resuscitation. (2011) 82:1208–13. doi: 10.1016/j.resuscitation.2011.04.007

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Peltan ID, Rowhani-Rahbar A, Vande Vusse LK, Caldwell E, Rea TD, Maier RV, et al. Development and validation of a prehospital prediction model for acute traumatic coagulopathy. Critical Care. (2016) 20:371. doi: 10.1186/s13054-016-1541-9

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Tonglet ML, Minon JM, Seidel L, Poplavsky JL, Vergnion M. Prehospital identification of trauma patients with early acute coagulopathy and massive bleeding: results of a prospective non-interventional clinical trial evaluating the Trauma Induced Coagulopathy Clinical Score (TICCS). Critical Care. (2014) 18:648. doi: 10.1186/s13054-014-0648-0

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Perkins ZB, Yet B, Marsden M, Glasgow S, Marsh W, Davenport R, et al. Early identification of trauma-induced coagulopathy: development and validation of a multivariable risk prediction model. Ann Surg. (2020). doi: 10.1097/SLA.0000000000003771 [Epubh ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Inten Care Med. (1996) 22:707–10. doi: 10.1007/BF01709751

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Akaraborworn O, Chaiwat O, Chatmongkolchart S, Kitsiripant C, Chittawatanarat K, Morakul S, et al. Prediction of massive transfusion in trauma patients in the surgical intensive care units (THAI-SICU study). Chinese journal of traumatology = Zhonghua chuang shang za zhi. (2019) 22:219–22. doi: 10.1016/j.cjtee.2019.04.004

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Davis PK, Musunuru H, Walsh M, Cassady R, Yount R, Losiniecki A, et al. Platelet dysfunction is an early marker for traumatic brain injury-induced coagulopathy. Neurocrit Care. (2013) 18:201–8. doi: 10.1007/s12028-012-9745-6

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Maegele M, Lefering R, Yucel N, Tjardes T, Rixen D, Paffrath T, et al. Early coagulopathy in multiple injury: an analysis from the German Trauma Registry on 8724 patients. Injury. (2007) 38:298–304. doi: 10.1016/j.injury.2006.10.003

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Brohi K, Cohen MJ, Davenport RA. Acute coagulopathy of trauma: mechanism, identification and effect. Curr Opin Crit Care. (2007) 13:680–5. doi: 10.1097/MCC.0b013e3282f1e78f

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Ellingsen TS, Lappegård J, Skjelbakken T, Brækkan SK, Hansen JB. Red cell distribution width is associated with incident venous thromboembolism (VTE) and case-fatality after VTE in a general population. Thromb Haemost. (2015) 113:193–200. doi: 10.1160/TH14-04-0335

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Zöller B, Melander O, Svensson P, Engström G. Red cell distribution width and risk for venous thromboembolism: a population-based cohort study. Thromb Res. (2014) 133:334–9. doi: 10.1016/j.thromres.2013.12.013

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Piagnerelli M, Boudjeltia KZ, Brohee D, Piro P, Carlier E, Vincent JL, et al. Alterations of red blood cell shape and sialic acid membrane content in septic patients. Crit Care Med. (2003) 31:2156–62. doi: 10.1097/01.CCM.0000079608.00875.14

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Lasocki S, Lefebvre T, Mayeur C, Puy H, Mebazaa A, Gayat E. Iron deficiency diagnosed using hepcidin on critical care discharge is an independent risk factor for death and poor quality of life at one year: an observational prospective study on 1161 patients. Critical Care. (2018) 22:314. doi: 10.1186/s13054-018-2253-0

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Levi M, van der Poll T. Inflammation and coagulation. Critical Care Med. (2010) 38:S26–34. doi: 10.1097/CCM.0b013e3181c98d21

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Zhao QY, Liu LP, Luo JC, Luo YW, Wang H, Zhang YJ, et al. A machine-learning approach for dynamic prediction of sepsis-induced coagulopathy in critically ill patients with sepsis. Front Med. (2020) 7:637434. doi: 10.3389/fmed.2020.637434

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Boccardo P, Remuzzi G, Galbusera M. Platelet dysfunction in renal failure. Semin Thromb Hemost. (2004) 30:579–89. doi: 10.1055/s-2004-835678

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Iseki K, Kinjo K, Kimura Y, Osawa A, Fukiyama K. Evidence for high risk of cerebral hemorrhage in chronic dialysis patients. Kidney Int. (1993) 44:1086–90. doi: 10.1038/ki.1993.352

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Sohal AS, Gangji AS, Crowther MA, Treleaven D. Uremic bleeding: pathophysiology and clinical risk factors. Thromb Res. (2006) 118:417–22. doi: 10.1016/j.thromres.2005.03.032

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Gawaz MP, Dobos G, Späth M, Schollmeyer P, Gurland HJ, Mujais SK. Impaired function of platelet membrane glycoprotein IIb-IIIa in end-stage renal disease. J Am Soc Nephrol JASN. (1994) 5:36–46. doi: 10.1681/ASN.V5136

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Chang R, Cardenas JC, Wade CE, Holcomb JB. Advances in the understanding of trauma-induced coagulopathy. Blood. (2016) 128:1043–9. doi: 10.1182/blood-2016-01-636423

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Di Battista AP, Rizoli SB, Lejnieks B, Min A, Shiu MY, Peng HT, et al. Sympathoadrenal activation is associated with acute traumatic coagulopathy and endotheliopathy in isolated brain injury. Shock. (2016) 46:96–103. doi: 10.1097/SHK.0000000000000642

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Gall LS, Davenport RA. Fibrinolysis and antifibrinolytic treatment in the trauma patient. Curr Opin Anaesthesiol. (2018) 31:227–33. doi: 10.1097/ACO.0000000000000561

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Müller MC, Meijers JC, Vroom MB, Juffermans NP. Utility of thromboelastography and/or thromboelastometry in adults with sepsis: a systematic review. Critical Care. (2014) 18:R30. doi: 10.1186/cc13721

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: traumatic brain injury-induced coagulopathy, TBI-IC, machine learning, external validation, model interpretation

Citation: Yang F, Peng C, Peng L, Wang J, Li Y and Li W (2021) A Machine Learning Approach for the Prediction of Traumatic Brain Injury Induced Coagulopathy. Front. Med. 8:792689. doi: 10.3389/fmed.2021.792689

Received: 11 October 2021; Accepted: 08 November 2021;
Published: 10 December 2021.

Edited by:

Zhongheng Zhang, Sir Run Run Shaw Hospital, China

Reviewed by:

Luo Zhe, Fudan University, China
Arulselvi Subramanian, All India Institute of Medical Sciences, India
Gaurav Chhabra, All India Institute of Medical Sciences, Bhubaneswar, India

Copyright © 2021 Yang, Peng, Peng, Wang, Li and Li. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Weixin Li, tangdunaowai@163.com

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.