Skip to main content

ORIGINAL RESEARCH article

Front. Cardiovasc. Med., 17 November 2023
Sec. Intensive Care Cardiovascular Medicine
This article is part of the Research Topic Extracorporeal Cardio-Pulmonary Resuscitation (ECPR) View all 7 articles

Machine learning-based predictor for neurologic outcomes in patients undergoing extracorporeal cardiopulmonary resuscitation

\r\nTae Wan KimTae Wan Kim1Joonghyun AhnJoonghyun Ahn2Jeong-Am Ryu,
\r\nJeong-Am Ryu3,4*
  • 1Department of Pulmonary and Critical Care Medicine, Chung-Ang University Hospital, Chung-Ang University College of Medicine, Seoul, Republic of Korea
  • 2Biomedical Statistics Center, Samsung Medical Center, Data Science Research Institute, Seoul, Republic of Korea
  • 3Department of Critical Care Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
  • 4Department of Neurosurgery, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea

Background: We investigated the predictors of poor neurological outcomes in extracorporeal cardiopulmonary resuscitation (ECPR) patients using machine learning (ML) approaches.

Methods: This study was a retrospective, single-center, observational study that included adult patients who underwent ECPR while hospitalized between January 2010 and December 2020. The primary outcome was neurologic status at hospital discharge as assessed by the Cerebral Performance Categories (CPC) score (scores range from 1 to 5). We trained and tested eight ML algorithms for a binary classification task involving the neurological outcomes of survivors after ECPR.

Results: During the study period, 330 patients were finally enrolled in this analysis; 143 (43.3%) had favorable neurological outcomes (CPC score 1 and 2) but 187 (56.7%) did not. From the eight ML algorithms initially considered, we refined our analysis to focus on the three algorithms, eXtreme Gradient Boosting, random forest, and Stochastic Gradient Boosting, that exhibited the highest accuracy. eXtreme Gradient Boosting models exhibited the highest accuracy among all the machine learning algorithms (accuracy: 0.739, area under the curve: 0.837, Kappa: 0.450, sensitivity: 0.700, specificity: 0.740). Across all three ML models, mean blood pressure emerged as the most influential variable, followed by initial serum lactate, and arrest to extracorporeal membrane oxygenation (ECMO) pump-on-time as important predictors in machine learning models for poor neurological outcomes following successful ECPR.

Conclusions: In conclusion, machine learning methods showcased outstanding predictive accuracy for poor neurological outcomes in patients who underwent ECPR.

Introduction

Neurological prognosis following cardiopulmonary resuscitation (CPR) remains an issue of critical importance for survivors (1, 2). It is important to estimate the potential for normalization of cerebral function in patients after return of spontaneous circulation. The capacity to accurately forecast neurological outcomes can significantly impact subsequent medical management, enabling physicians to make informed decisions that optimize the balance between quality and quantity of intensive treatment (2, 3). Recently, the application of extracorporeal membrane oxygenation (ECMO) as a supplementary measure to conventional CPR has experienced a marked increase (4, 5). Concurrently, the estimation of neurological outcomes for patients subjected to extracorporeal cardiopulmonary resuscitation (ECPR) has become a critical aspect of patient management. However, the task of predicting neurological outcomes post-ECPR is intrinsically complex. It necessitates the comprehensive integration of a myriad of patient-specific factors along with unique circumstances associated with ECPR.

One of the strengths of machine learning (ML) approaches is their capacity to handle intricate nonlinear relationships between predictors, leading to more robust and consistent predictions (6). Harnessing the power of ML could offer a promising solution to the challenge of predicting neurological outcomes after ECPR. This approach can effectively analyze a myriad of patient-specific factors and ECPR-associated circumstances, possibly revealing new correlations and key variables. Consequently, it can enhance the accuracy of neurological prognosis predictions, and direct attention towards the most influential elements impacting patient outcomes in ECPR. While prior studies have identified associations between favorable neurological outcomes and predictors following successful ECPR (79), none have explored the potential of machine learning approaches to predict neurological outcomes in ECPR patients. In this study, we aim to utilize ML methodologies to identify critical factors that can influence neurological prognosis following ECPR. We postulate that this innovative approach will shed light on the hidden correlations and interactions among the variables and contribute to a more comprehensive and precise predictive model for neurological outcomes in ECPR patients.

Methods

Study population

This study was a retrospective, single-center, observational study that included adult patients who underwent ECPR while hospitalized between January 2010 and December 2020. The Institutional Review Board (IRB) of Samsung Medical Center approved this study (IRB No. 2020-09-082). Informed consent requirements were waived by the Institutional Review Board (IRB) of Samsung Medical Center, given the retrospective nature of the study. The study included all consecutive patients who underwent ECPR during the study period, resulting in a total of 389 patients. Of these patients who under the age of 18, those with inappropriate indications for ECPR, those with pre-existing severe neurological conditions such as traumatic brain injury, major stroke, malignant brain tumor, or severe dementia, those with insufficient medical records, and those who were transferred from another hospital after undergoing ECPR were excluded (Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1. Study flow chart. ECPR, extracorporeal cardiopulmonary resuscitation; CPC, cerebral performance Categories scale.

Definitions and outcomes

In this study, we retrospectively collected baseline characteristics, including comorbidities, behavioral risk factors, intensive care unit management, and laboratory data, utilizing our center’s dedicated “Clinical Data Warehouse Darwin-C.” This data warehouse has been specifically designed to facilitate investigators in searching and retrieving de-identified medical records from electronic archives. Mean blood pressure (MBP) was the mean of the values measured in the first 24 h, mainly based on arterial blood pressure, and patients without ABP used non-invasive blood pressure instead. Laboratory data was characterized by the most unfavorable value recorded within the 6 h window immediately preceding ECMO insertion, inclusive of the period during CPR. In this study, ECPR was defined as both a successful veno-arterial ECMO implantation and pump-on with cardiac massage during the index procedure in patients with cardiac arrest. Importantly, when ROSC occurs during ECMO cannulation, practitioners generally do not remove the already-inserted cannula nor do they halt the ECMO pump activation process, as referenced in studies (1, 10). The term “ECMO pump-on” was characterized as the cessation of chest compressions following the successful implantation and activation of the ECMO device. In this study, ECPR was initiated under specific criteria: a witnessed arrest was confirmed; conventional CPR had been administered for a duration exceeding 10 min without success; and the etiological event causing the cardiac arrest was deemed reversible (4). Exceptions to ECPR initiation were cases with: anticipated life expectancy of less than 6 months; terminal malignancy; an unwitnessed collapse; limited physical activity; an unprotected airway; or instances where CPR had been performed for over 60 min at the time of initial contact. It should be noted that age alone was not considered a contraindication for the initiation of ECPR (4). ECPR was defined as use of venoarterial ECMO intended to treat cardiac arrest and arrest to ECMO pump-on time was defined as time from collapse to the point of ECMO setup and administration (11). In patients undergoing ECPR, the process of extracorporeal circulation, combined with external volume infusion, has the potential to decrease body temperature. This reduction in temperature could confer some degree of neuroprotection via induced hypothermia. It should be noted that aggressive therapeutic hypothermia might not always be pursued in cases where the patient exhibits hemodynamic instability or has complications such as bleeding during ECMO support. Consequently, in the context of ECPR, the initiation and extent of surface cooling, as well as the targeted temperature, are individually determined by the attending ICU intensivist. This decision-making process adheres to the therapeutic hypothermia protocol established by Samsung Medical Center (12). The primary outcome was neurologic status at hospital discharge as assessed by the Glasgow-Pittsburgh Cerebral Performance Categories (CPC) score (scores range from 1 to 5) (13). CPC scores of 1 and 2 were classified as favorable neurologic outcomes; CPC scores of 3, 4, and 5 were considered poor neurologic outcomes (14, 15). We thoroughly reviewed medical records and patients were assigned to the CPC scale upon agreement by two authors (JAR and TWK).

Machine learning (Ml) models

Utilizing Shapley Additive exPlanations, we first identified the critical variables, which were then incorporated into the ML analyses. Initially, we trained and tested eight ML algorithms for a binary classification task involving the neurological outcomes of survivors after ECPR. The algorithms included logistic regression (LR), random forest (RF), AdaBoost Classification Trees (AdaBoost), Bagged CART (Bagging), Stochastic Gradient Boosting (GBM), eXtreme Gradient Boosting (XGBoost), Multivariate Adaptive Regression Spline (MARS), and Support Vector Machines with Radial Basis Function Kernel (SVM). For the final analysis, we only utilized the top three algorithms with the highest accuracy out of the aforementioned eight ML algorithms. We divided the dataset into training and testing sets with an 8:2 ratio. The training set was used for statistical analysis, feature selection, and model training, while the independent testing set was employed to evaluate the trained models. Additionally, we detected a small number of missing values in the dataset. To address this issue, we utilized the k-Nearest Neighbors algorithm for imputation during the ML analysis (1618). This technique involved estimating the missing values by considering the values of their nearest neighbors in the dataset. By applying this approach, we ensured that the dataset was complete and ready for further analysis and modeling. Furthermore, preprocessing procedure entailed scaling and one-hot encoding. Due to the limited sample size, we opted for the Leave-One-Out Cross-Validation (LOOCV) methodology. This approach could minimize bias by assessing the algorithm across the entire dataset, thereby ensuring more consistent and reproducible results. Afterwards, we trained each ML algorithm using the best hyperparameters until convergence was achieved on the training set. The cutoff threshold for each model was determined based on the receiver operating characteristic curve and Youden index (19, 20) obtained from the validation set, and this threshold was then applied to the test set. In order to identify which variables have the predictive performance, the importance of each variable in the ML model was evaluated by the permutation score of the test set. This score is defined as a decrease in model performance (area under the receiver operating characteristic curve) when all values of a given variable are randomly mixed (21). The magnitude of the model performance reduction reflects how dependent the model is on particular variable. The importance of variables is scaled so that the maximum value is 100.

Statistical analyses

For continuous variables, we first assessed their distribution for normality. Variables that followed a normal distribution were presented as means ± standard deviations, while those that did not were described using medians and interquartile ranges. Categorical variables are represented as numbers with subsequent percentages. Data comparison was carried out using Student’s t-test or Mann-Whitney U test for continuous variables, whereas the Chi-square test for categorical variables. Clinically relevant variables, including age, sex, comorbidities, habitual risk factors, variables associated with ECPR, classification of arrest subtypes, complications of ECMO, MBP and ICU management were subjected to multiple logistic regression analyses to obtain statistically meaningful predictors associated with poor neurological outcomes. All tests were two-sided and p values of less than 0.05 were considered statistically significant. Statistical analyses were performed with R Statistical Software (version 4.2.0; R Foundation for Statistical Computing, Vienna, Austria).

Results

Baseline characteristics and clinical outcomes

During the study period, 330 patients were finally enrolled in this analysis; 143 (43.3%) had favorable neurological outcomes but 187 (56.7%) did not. The characteristics of the patients are shown in Table 1. There was no difference between the two groups in the age, sex, and comorbidities except for chronic kidney disease. Compared to the group with poor neurological outcomes, the group with favorable outcomes exhibited a higher prevalence of shockable rhythms, ECPR in the coronary catheterization laboratory, cardiac cause of arrest, and arrest by acute coronary syndrome. Hemoglobin was also higher in favorable group than poor group (10.6 ± 2.6 g/dl vs. 9.6 ± 3.0 g/dl, p = 0.001), but troponin I was no significant difference between two groups (0.7 [0.1–4.0] ng/ml vs. 0.9 [0.1–7.2] ng/ml, p = 0.211). Arrest to ECMO pump-on time (23.0 [11.0–35.0] min vs. 35.0 [24.5–49.5] min, p < 0.001) and serum lactate (7.9 [5.5–12.9] mmol/L vs. 12.5 [9.2–15.0] mmol/L, p < 0.001) were higher in the poor neurologic outcome group than in the favorable group.

TABLE 1
www.frontiersin.org

Table 1. Baseline characteristics of patients.

In multivariate analysis, age (adjusted odds ratio [OR]: 2.18, 95% confidence interval [CI]: 1.56–3.13), chronic kidney disease (adjusted OR: 1.53, 95% CI: 1.10–2.19), ECPR in the coronary catheterization laboratory (adjusted OR: 0.61, 95% CI: 0.43–0.85), cardiac cause of arrest (adjusted OR: 0.56, 95% CI: 0.39–0.78), arrest to ECMO pump-on time (adjusted OR: 1.59, 95% CI: 1.10–2.41), PaCO2 (adjusted OR: 1.84, 95% CI: 1.25–2.83), initial hemoglobin (adjusted OR: 0.67, 95% CI: 0.47–0.98), and MBP (adjusted OR: 0.43, 95% CI: 0.29–0.61) were associated with poor neurological outcomes.

ML-based predictive performance of poor neurologic outcome after ECPR

The predictive performances of all algorithms were depicted in Supplementary Figure S1. After initial analysis using ML models, LR, AdaBoost, Bagging, MARS, and SVM were excluded in final analysis because of relatively low predictive power. We only utilized the top three algorithms, XGBoost, RF, GBM, and with the highest accuracy from the eight ML algorithms. Predictive performance of each ML model for poor neurologic outcome was shown in Figure 2 and Table 2. Overall, all three models showcased excellent proficiency in predicting poor neurological outcomes, with mean accuracy scores ranging between 72.3% and 73.9%. Notably, XGBoost models exhibited the highest accuracy among all the machine learning algorithms (Table 3). Figure 3 illustrated the top 10 variables that contribute to the predictive performance of each ML model. Across all three ML models, MBP emerged as the most influential variable, followed by initial serum lactate, and arrest to ECMO pump-on-time as important predictors. Finally, we tested the XGBoost model using the testing dataset, and it exhibited excellent predictive performance for poor neurological outcomes (accuracy: 0.712, 95% CI: 0.609–0.809, Kappa: 0.213, sensitivity: 0.643, specificity: 0.771, positive predictive value: 0.667, negative predictive value: 0.546). Additionally, the performance of initial lactate level for prediction of poor neurologic outcomes was evaluated. The area under the receiver operating characteristic curve was 0.66 (95% CI: 0.598–0.724) and the cut-off value was 7.37 with 86.6% sensitivity and 46.4% specificity.

FIGURE 2
www.frontiersin.org

Figure 2. Predictive performance of random forest (RF), bagged CART (bagging), and eXtreme gradient boosting (XGBoost) machine learning model for poor neurologic outcome. Sens, sensitivity; Spec, specificity; ROC, receiver operating characteristic.

TABLE 2
www.frontiersin.org

Table 2. Clinical outcomes according to neurologic outcomes.

TABLE 3
www.frontiersin.org

Table 3. Model performance in predicting poor neurologic outcome after extracorporeal cardiopulmonary resuscitation.

FIGURE 3
www.frontiersin.org

Figure 3. The top variables contributing to the predictive performance of each model. The magnitude of the model performance reduction reflects how dependent the model is on particular variable. The importance of variables is scaled so that the maximum value is 100.

Discussion

In the present study, we investigated the predictors of poor neurological outcomes in ECPR patients using ML approaches. From the eight ML algorithms initially considered, we refined our analysis to focus on the three algorithms, XGBoost, RF and GBM, that exhibited the highest accuracy. XGBoost models exhibited the highest accuracy among all the machine learning algorithms. In addition, when we tested the XGBoost model using the testing dataset, it demonstrated outstanding predictive accuracy for poor neurological outcomes. Across all three ML models, MBP emerged as the most influential variable, followed by initial serum lactate, and arrest to ECMO pump-on-time as important predictors.

Generally, lactic acid serves as a valuable indicator of tissue hypoxia (24) and is a reliable predictor of patient outcomes in cases of circulatory shock (2426). Previous studies showed that serum lactic acid levels are associated with neurological outcomes in survivors after cardiac arrest. Sawamoto et al. demonstrated a significant difference in serum lactic acid levels between patients with favorable and poor neurological outcomes who underwent ECPR (27). Moreover, Christian et al. demonstrated that absolute serum lactate levels might serve as pertinent markers for predicting mortality in ECPR patients. Furthermore, lactate clearance was associated with neurological outcomes in these patients (28). The findings from this study highlighted that the serum lactate level served as a prognostic indicator for poor neurological outcomes in patients treated with ECPR across all ML models.

Brain recovery hinges on the swift restoration of cerebral blood flow to meet the brain’s metabolic demands, with MAP being a principal determinant of this flow (29). The current guideline recommends circumvention and immediate correction of MAP less than 65 mmHg in post-resuscitation care (23). However, the exact MAP target conducive to optimal outcomes remains elusive, and several studies have indicated a potential correlation between higher MAP values and more favorable neurological results (30, 31). Specifically, Lee et al. found that average MAP levels were associated with neurological outcomes in patients undergoing ECPR (32). They suggest that maintaining an average MAP of approximately 75 mmHg could be pivotal for neurological recovery after ECPR. Our study also highlighted that the MAP served as a prognostic indicator for poor neurological outcomes in patients treated with ECPR across all ML models.

Given that the brain is the organ most susceptible to hypoxia and insufficient perfusion, delays in initiating ECMO during ECPR can lead to significant neurological deficits (33). Several previous studies have demonstrated that duration of no flow or low-flow is one of the most important predictors of overall outcomes after ECPR along with factors such as age, initial shockable rhythm and lactate level (4, 34, 35). Recently, Matsuyama et al. analyzed 256 patients undergoing ECPR and found the probability of favorable neurological outcome decreased as low-flow duration increased. Similarly, low-flow time represented by arrest to pump-on time was associated with poor neurologic outcomes in the present study. Eventually, enhancing survival and neurological outcomes is more likely when patients are put on the ECMO pump-on promptly (4, 34, 36).

In our previous study, factors such as shockable rhythm, initial hemoglobin levels, cardiac cause of arrest and ECPR conducted at the cardiac catheterization lab were identified as significantly associated with poor neurological outcomes (2, 4, 37). Low pre-ECMO hemoglobin levels might correlate with adverse neurological results (4, 28). Proactively addressing anemia either before or during ECMO deployment may improve oxygen delivery and offer neuroprotection (4). Shockable rhythm was associated with favorable neurological outcomes after ECPR (2, 38). ECPR conducted in a cardiac catheterization lab resulted in a reduction of low flow and cannulation time (39). In this study, most of the patients with cardiac arrest in the catheterization lab underwent ECPR in the coronary catheterization laboratory. Reducing “arrest to ECMO pump-on time” would be crucial to improve clinical outcomes, including neurologic outcomes, regardless of the location of ECPR.

This study had several limitations. First, this was a nonrandomized cohort study. Therefore, confounding factors and selection bias might have affected the results. Second, CPC scale was retrospectively determined based on medical records. We excluded patients whose neurological status could not be assessed because of deterioration followed by death. However, we included patients who had a diagnosis of brain death. Third, most ECPR patients had low body temperature caused by extracorporeal circulation and external volume infusion. Therefore, ECMO itself could have some degree of neuroprotective effect through hypothermia. Finally, lactate clearance is associated with neurological outcomes in ECPR patients, but due to the nature of retrospective studies, it cannot be provided due to insufficient data after a specific time following the initial lactic acid test.

Conclusions

In conclusion, serum lactic acid levels and arrest to ECMO pump-on time emerged as the most potent predictors in machine learning models for poor neurological outcomes following successful ECPR. Furthermore, these machine learning methods showcased outstanding predictive accuracy for poor neurological outcomes in patients who underwent ECPR.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by the Institutional Review Board of Samsung Medical Center (IRB No. 2020-09-082). The studies were conducted in accordance with the local legislation and institutional requirements. Given the retrospective nature of the study, the institutional review board of Samsung Medical Center waived the requirement of written informed consent for participation from the participants or the participants’ legal guardians/next of kin. Written informed consent was not obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article because Informed consent requirements were waived by the Institutional Review Board (IRB) of Samsung Medical Center.

Author contributions

TK: Conceptualization, Writing – original draft, Writing – review and editing. JA: Conceptualization, Formal Analysis, Methodology, Software, Writing – review and editing. JR: Conceptualization, Data curation, Formal Analysis, Investigation, Supervision, Writing – original draft, Writing – review and editing.

Funding

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Acknowledgments

We would like to thank the nursing director of the neurosurgical intensive care unit, Suk Kyung Choo, for providing excellent advice and fruitful discussions. We would also like to thank all the nurses of the neurosurgical intensive care unit at Samsung Medical Center for their support in the completion of this study.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fcvm.2023.1278374/full#supplementary-material

References

1. Ryu JA, Chung CR, Cho YH, Sung K, Suh GY, Park TK, et al. The association of findings on brain computed tomography with neurologic outcomes following extracorporeal cardiopulmonary resuscitation. Crit Care. (2017) 21(1):15. doi: 10.1186/s13054-017-1604-6

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Ryu JA, Chung CR, Cho YH, Sung K, Jeon K, Suh GY, et al. Neurologic outcomes in patients who undergo extracorporeal cardiopulmonary resuscitation. Ann Thorac Surg. (2019) 108(3):749–55. doi: 10.1016/j.athoracsur.2019.03.033

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Sondag L, Ruijter BJ, Tjepkema-Cloostermans MC, Beishuizen A, Bosch FH, van Til JA, et al. Early EEG for outcome prediction of postanoxic coma: prospective cohort study with cost-minimization analysis. Crit Care. (2017) 21(1):111. doi: 10.1186/s13054-017-1693-2

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Ryu JA, Cho YH, Sung K, Choi SH, Yang JH, Choi JH, et al. Predictors of neurological outcomes after successful extracorporeal cardiopulmonary resuscitation. BMC Anesthesiol. (2015) 15:26. doi: 10.1186/s12871-015-0002-3

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Ahn C, Kim W, Cho Y, Choi KS, Jang BH, Lim TH. Efficacy of extracorporeal cardiopulmonary resuscitation compared to conventional cardiopulmonary resuscitation for adult cardiac arrest patients: a systematic review and meta-analysis. Sci Rep. (2016) 6:34208. doi: 10.1038/srep34208

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Goto T, Camargo CA, Faridi MK, Freishtat RJ, Hasegawa K. Machine learning–based prediction of clinical outcomes for children during emergency department triage. JAMA Network Open. (2019) 2(1):e186937. doi: 10.1001/jamanetworkopen.2018.6937

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Bertic M, Worme M, Foroutan F, Rao V, Ross H, Billia F, et al. Predictors of survival and favorable neurologic outcome in patients treated with eCPR: a systematic review and meta-analysis. J Cardiovasc Transl Res. (2022) 15(2):279–90. doi: 10.1007/s12265-021-10195-9

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Gravesteijn BY, Schluep M, Disli M, Garkhail P, Dos Reis Miranda D, Stolker RJ, et al. Neurological outcome after extracorporeal cardiopulmonary resuscitation for in-hospital cardiac arrest: a systematic review and meta-analysis. Crit Care. (2020) 24(1):505. doi: 10.1186/s13054-020-03201-0

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Mandigers L, Scholten E, Rietdijk WJR, den Uil CA, van Thiel RJ, Rigter S, et al. Survival and neurological outcome with extracorporeal cardiopulmonary resuscitation for refractory cardiac arrest caused by massive pulmonary embolism: a two center observational study. Resuscitation. (2019) 136:8–13. doi: 10.1016/j.resuscitation.2018.12.008

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Chen YS, Lin JW, Yu HY, Ko WJ, Jerng JS, Chang WT, et al. Cardiopulmonary resuscitation with assisted extracorporeal life-support versus conventional cardiopulmonary resuscitation in adults with in-hospital cardiac arrest: an observational study and propensity analysis. Lancet. (2008) 372(9638):554–61. doi: 10.1016/S0140-6736(08)60958-7

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Park SB, Yang JH, Park TK, Cho YH, Sung K, Chung CR, et al. Developing a risk prediction model for survival to discharge in cardiac arrest patients who undergo extracorporeal membrane oxygenation. Int J Cardiol. (2014) 177(3):1031–5. doi: 10.1016/j.ijcard.2014.09.124

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Kang MJ, Lee TR, Shin TG, Sim MS, Jo IJ, Song KJ, et al. Survival and neurologic outcomes of out-of-hospital cardiac arrest patients who were transferred after return of spontaneous circulation for integrated post-cardiac arrest syndrome care: the another feasibility of the cardiac arrest center. J Korean Med Sci. (2014) 29(9):1301–7. doi: 10.3346/jkms.2014.29.9.1301

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Cummins RO, Chamberlain DA, Abramson NS, Allen M, Baskett PJ, Becker L, et al. Recommended guidelines for uniform reporting of data from out-of-hospital cardiac arrest: the utstein style. A statement for health professionals from a task force of the American Heart Association, the European resuscitation council, the heart and stroke foundation of Canada, and the Australian resuscitation council. Circulation. (1991) 84(2):960–75. doi: 10.1161/01.CIR.84.2.960

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Rittenberger JC, Raina K, Holm MB, Kim YJ, Callaway CW. Association between cerebral performance category, modified rankin scale, and discharge disposition after cardiac arrest. Resuscitation. (2011) 82(8):1036–40. doi: 10.1016/j.resuscitation.2011.03.034

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Hypothermia after Cardiac Arrest Study G. Mild therapeutic hypothermia to improve the neurologic outcome after cardiac arrest. N Engl J Med. (2002) 346(8):549–56. doi: 10.1056/NEJMoa012689

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Batista GE, Monard MC. A study of K-nearest neighbour as an imputation method. His. (2002) 87(251-260):48.

Google Scholar

17. Jonsson P, Wohlin C. An evaluation of k-nearest neighbour imputation using likert data. 10th International Symposium on Software Metrics, 2004 proceedings; IEEE (2004).

18. Pan R, Yang T, Cao J, Lu K, Zhang Z. Missing data imputation by K nearest neighbours based on grey relational structure and mutual information. Appl Intell. (2015) 43:614–32. doi: 10.1007/s10489-015-0666-x

CrossRef Full Text | Google Scholar

19. Schisterman EF, Perkins NJ, Liu A, Bondell H. Optimal cut-point and its corresponding youden index to discriminate individuals using pooled blood samples. Epidemiology. (2005) 16(1):73–81. doi: 10.1097/01.ede.0000147512.81966.ba

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Ruopp MD, Perkins NJ, Whitcomb BW, Schisterman EF. Youden index and optimal cut-point estimated from observations affected by a lower limit of detection. Biom J. (2008) 50(3):419–30. doi: 10.1002/bimj.200710415

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Zhang D, Li Y, Kalbaugh CA, Shi L, Divers J, Islam S, et al. Machine learning approach to predict in-hospital mortality in patients admitted for peripheral artery disease in the United States. J Am Heart Assoc. (2022) 11(20):e026987. doi: 10.1161/JAHA.122.026987

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Streitberger KJ, Endisch C, Ploner CJ, Stevens R, Scheel M, Kenda M, et al. Timing of brain computed tomography and accuracy of outcome prediction after cardiac arrest. Resuscitation. (2019) 145:8–14. doi: 10.1016/j.resuscitation.2019.09.025

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Panchal AR, Bartos JA, Cabañas JG, Donnino MW, Drennan IR, Hirsch KG, et al. Part 3: adult basic and advanced life support: 2020 American Heart Association guidelines for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation. (2020) 142(16_suppl_2):S366–s468. doi: 10.1161/CIR.0000000000000916

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Bernardin G, Pradier C, Tiger F, Deloffre P, Mattei M. Blood pressure and arterial lactate level are early indicators of short-term survival in human septic shock. Intensive Care Med. (1996) 22(1):17–25. doi: 10.1007/BF01728326

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Vincent JL, Dufaye P, Berre J, Leeman M, Degaute JP, Kahn RJ. Serial lactate determinations during circulatory shock. Crit Care Med. (1983) 11(6):449–51. doi: 10.1097/00003246-198306000-00012

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Husain FA, Martin MJ, Mullenix PS, Steele SR, Elliott DC. Serum lactate and base deficit as predictors of mortality and morbidity. Am J Surg. (2003) 185(5):485–91. doi: 10.1016/S0002-9610(03)00044-8

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Sawamoto K, Bird SB, Katayama Y, Maekawa K, Uemura S, Tanno K, et al. Outcome from severe accidental hypothermia with cardiac arrest resuscitated with extracorporeal cardiopulmonary resuscitation. Am J Emerg Med. (2014) 32(4):320–4. doi: 10.1016/j.ajem.2013.12.023

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Jung C, Bueter S, Wernly B, Masyuk M, Saeed D, Albert A, et al. Lactate clearance predicts good neurological outcomes in cardiac arrest patients treated with extracorporeal cardiopulmonary resuscitation. J Clin Med. (2019) 8(3):374. doi: 10.3390/jcm8030374

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Sundgreen C, Larsen FS, Herzog TM, Knudsen GM, Boesgaard S, Aldershvile J. Autoregulation of cerebral blood flow in patients resuscitated from cardiac arrest. Stroke. (2001) 32(1):128–32. doi: 10.1161/01.STR.32.1.128

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Kilgannon JH, Roberts BW, Jones AE, Mittal N, Cohen E, Mitchell J, et al. Arterial blood pressure and neurologic outcome after resuscitation from cardiac arrest*. Crit Care Med. (2014) 42(9):2083–91. doi: 10.1097/CCM.0000000000000406

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Nolan JP, Soar J, Cariou A, Cronberg T, Moulaert VR, Deakin CD, et al. European resuscitation council and European society of intensive care medicine guidelines for post-resuscitation care 2015: section 5 of the European resuscitation council guidelines for resuscitation 2015. Resuscitation. (2015) 95:202–22. doi: 10.1016/j.resuscitation.2015.07.018

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Lee YI, Ko RE, Yang JH, Cho YH, Ahn J, Ryu JA. Optimal mean arterial pressure for favorable neurological outcomes in survivors after extracorporeal cardiopulmonary resuscitation. J Clin Med. (2022) 11(2):290. doi: 10.3390/jcm11020290

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Barrett CS, Bratton SL, Salvin JW, Laussen PC, Rycus PT, Thiagarajan RR. Neurological injury after extracorporeal membrane oxygenation use to aid pediatric cardiopulmonary resuscitation. Pediatr Crit Care Med. (2009) 10(4):445–51. doi: 10.1097/PCC.0b013e318198bd85

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Yu H-Y, Wang C-H, Chi N-H, Huang S-C, Chou H-W, Chou N-K, et al. Effect of interplay between age and low-flow duration on neurologic outcomes of extracorporeal cardiopulmonary resuscitation. Intensive Care Med. (2019) 45(1):44–54. doi: 10.1007/s00134-018-5496-y

PubMed Abstract | CrossRef Full Text | Google Scholar

35. D'Arrigo S, Cacciola S, Dennis M, Jung C, Kagawa E, Antonelli M, et al. Predictors of favourable outcome after in-hospital cardiac arrest treated with extracorporeal cardiopulmonary resuscitation: a systematic review and meta-analysis. Resuscitation. (2017) 121:62–70. doi: 10.1016/j.resuscitation.2017.10.005

CrossRef Full Text | Google Scholar

36. Yang JH. Clinical significance of low-flow time in patients treated with extracorporeal cardiopulmonary resuscitation. Korean Circ J. (2018) 48(8):716–8. doi: 10.4070/kcj.2018.0187

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Hong S, Jang JH, Yang JH, Cho YH, Ahn J, Ryu JA. Optimal arterial blood gas tensions for the prognosis of favorable neurological outcomes in survivors after extracorporeal cardiopulmonary resuscitation. J Clin Med. (2022) 11(14):4211. doi: 10.3390/jcm11144211

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Ko RE, Ryu JA, Cho YH, Sung K, Jeon K, Suh GY, et al. The differential neurologic prognosis of low-flow time according to the initial rhythm in patients who undergo extracorporeal cardiopulmonary resuscitation. Resuscitation. (2020) 148:121–7. doi: 10.1016/j.resuscitation.2020.01.015

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Lim Y, Kim MC, Jeong I-S, Jung Y, Ahn JH, Lee SH, et al. Outcomes of extracorporeal cardiopulmonary resuscitation for in-hospital cardiac arrest according to cannulation sites: cath lab vs non-cath lab. J Cardiovasc Interv. (2022) 1(1):40–8. doi: 10.54912/jci.2021.0001

CrossRef Full Text | Google Scholar

Keywords: extracorporeal cardiopulmonary resuscitation, prognosis, machine learning, cerebral performance categories score, extracorporeal membrane oxygenation

Citation: Kim TW, Ahn J and Ryu J-A (2023) Machine learning-based predictor for neurologic outcomes in patients undergoing extracorporeal cardiopulmonary resuscitation. Front. Cardiovasc. Med. 10:1278374. doi: 10.3389/fcvm.2023.1278374

Received: 16 August 2023; Accepted: 6 November 2023;
Published: 17 November 2023.

Edited by:

Gary Schwartz, Baylor University Medical Center, United States

Reviewed by:

Sun Kyun Ro, Hanyang University, Republic of Korea
Sung-Min Cho, Johns Hopkins Medicine, United States
Gerrit J. Noordergraaf, Elisabeth-TweeSteden Hospital, Netherlands

© 2023 Kim, Ahn and Ryu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jeong-Am Ryu lamyud.ryu@samsung.com

Abbreviations CI, confidence interval; CPR, cardiopulmonary resuscitation; ECMO, extracorporeal membrane oxygenation; ECPR, extracorporeal cardiopulmonary resuscitation; MBP, mean blood pressure; ML, machine learning; OR, odds ratio; RF, random forest.

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.