Skip to main content

ORIGINAL RESEARCH article

Front. Neurol., 02 September 2024
Sec. Artificial Intelligence in Neurology

Constructing machine learning models based on non-contrast CT radiomics to predict hemorrhagic transformation after stoke: a two-center study

Yue Zhang,Yue Zhang1,2Gang XieGang Xie3Lingfeng Zhang,Lingfeng Zhang2,4Junlin Li,Junlin Li2,4Wuli Tang,Wuli Tang1,2Danni WangDanni Wang2Ling YangLing Yang2Kang Li,
Kang Li1,2*
  • 1Chongqing Medical University, Chongqing, China
  • 2Department of Radiology, Chongqing General Hospital, Chongqing University, Chongqing, China
  • 3Department of Radiology, Chengdu Third People’s Hospital, Chengdu, China
  • 4North Sichuan Medical College, Nanchong, China

Purpose: Machine learning (ML) models were constructed according to non-contrast computed tomography (NCCT) images as well as clinical and laboratory information to assess risk stratification for the occurrence of hemorrhagic transformation (HT) in acute ischemic stroke (AIS) patients.

Methods: A retrospective cohort was constructed with 180 AIS patients who were diagnosed at two centers between January 2019 and October 2023 and were followed for HT outcomes. Patients were analyzed for clinical risk factors for developing HT, infarct texture features were extracted from NCCT images, and the radiomics score (Rad-score) was calculated. Then, five ML models were established and evaluated, and the optimal ML algorithm was used to construct the clinical, radiomics, and clinical-radiomics models. Receiver operating characteristic (ROC) curves were used to compare the performance of the three models in predicting HT.

Results: Based on the outcomes of the AIS patients, 104 developed HT, and the remaining 76 had no HT. The HT group consisted of 27 hemorrhagic infarction (HI) and 77 parenchymal-hemorrhage (PH). Patients with HT had a greater neutrophil-to-lymphocyte ratio (NLR), baseline National Institutes of Health Stroke Scale (NIHSS) score, infarct volume, and Rad-score and lower Alberta stroke program early CT score (ASPECTS) (all p < 0.01) than patients without HT. The best ML algorithm for building the model was logistic regression. In the training and validation cohorts, the AUC values for the clinical, radiomics, and clinical-radiomics models for predicting HT were 0.829 and 0.876, 0.813 and 0.898, and 0.876 and 0.957, respectively. In subgroup analyses with different treatment modalities, different infarct sizes, and different stroke time windows, the assessment accuracy of the clinical-radiomics model was not statistically meaningful (all p > 0.05), with an overall accuracy of 79.5%. Moreover, this model performed reliably in predicting the PH and HI subcategories, with accuracies of 82.9 and 92.9%, respectively.

Conclusion: ML models based on clinical and NCCT radiomics characteristics can be used for early risk evaluation of HT development in AIS patients and show great potential for clinical precision in treatment and prognostic assessment.

1 Introduction

Hemorrhagic transformation (HT) is a significant adverse prognosis of acute ischemic stroke (AIS) (1), and AIS is a frequent critical cerebrovascular disease in clinical practice (2). HT is a hemorrhage resulting from the reestablishment of vascular perfusion in the ischemic area after a cerebral infarction. HT is categorized by clinical deterioration and imaging: (1) asymptomatic HT and symptomatic HT according to the presence or absence of clinical exacerbation or a National Institutes of Health Stroke Scale (NIHSS) score ≥4 (3), and (2) parenchymal hemorrhage (PH) and hemorrhagic infarction (HI) according to the European Cooperative Acute Stroke Study-II (ECASS II) (4). HT can occur in AIS patients after perfusion therapy, including endovascular therapy (EVT) and intravenous thrombolysis (IVT), or it can occur naturally during the course of the disease in non-reperfusion-treated patients (5). However, once HT occurs, regardless of the type of HT, the clinical prognosis and functional outcomes are worse (68). Therefore, if the risk of developing HT can be predicted early and accurately, clinicians can make optimal treatment decisions and perform more aggressive clinical assessments and monitoring to prevent early clinical deterioration.

Previous studies have shown that clinical-biological indicators (912), imaging data (1316), and clinical features combined with imaging markers (17, 18), such as the NIHSS score, neutrophil-to-lymphocyte ratio (NLR), and hyperdense middle cerebral artery sign (HMCAS), have good predictive performance for HT. Recently, radiomics analysis has emerged as a new technology to assist precision medicine, provide more information about textures that cannot be observed visually, and address the heterogeneity of lesions (19). A recent study (20) alone revealed that radiomic features show promise in quantifying blood-brain barrier disruption. Machine learning (ML), as an important branch of artificial intelligence (AI) that uses various algorithms to focus on learning and training complex data and hyperparameter optimization to build ideal classification, prediction, and evaluation models, is now widely used in the medical field. Several studies have shown that ML can feasibly predict HT (11, 16, 17, 21, 22).

In addition, non-contrast computed tomography (NCCT) remains the imaging test of choice for early identification of ischemic stroke (23) because it is simpler and faster. Therefore, in this study, we wished to validate the correlation between the initial NCCT radiomic features of infarcted brain tissues and the occurrence of HT, while we evaluated multiple ML algorithms based on the clinical and radiomic characteristics retained after screening and selected the optimal ML algorithm to construct the HT prediction models.

2 Materials and methods

2.1 Patient acquisition and clinical data collection

The research protocol was authorized by the ethics committee of the institution, and the requirement for informed consent was waived.

We retrospectively enrolled AIS patients who were diagnosed at two centers between January 2019 and October 2023. The inclusion criteria were as follows: (1) stroke patients who had a clear time from symptom onset to the initial non-contrast-enhanced head CT examination of less than 24 h (for patients with wakefulness stroke, we estimated the midpoint between waking and sleeping time as the time of stroke onset); (2) patients with AIS due to anterior circulation large artery occlusion; (3) patients whose image gray values were adjusted, and the CT image could identify patients with infarct region boundaries; otherwise, diffusion-weighted imaging (DWI) or follow-up CT within 6 h was required to match the infarct region to the infarct zone on the initial CT image (18); and (4) CT/magnetic resonance imaging (MRI) follow-up of more than 7 days if HT did not occur within 7 days. Patients with hemorrhagic cerebral infarction on admission, brain tumors, poor quality CT images, or severe missing data were excluded. Ultimately, we included 180 patients (Figure 1).

Figure 1
www.frontiersin.org

Figure 1. Flow chart of this study design.

The clinical data collected included sex, age, smoking status, drinking status, diabetes status, hypertension status, dyslipidemia status, atrial fibrillation status, coagulopathy status, heart failure status, NLR, stroke onset time, baseline NIHSS score (NIHSSbaseline), and treatment modalities. Clinical data and images were obtained through medical records and a picture archiving communication system (PACS), respectively. We used k-nearest neighbors (KNN) to estimate and supplement some of the missing clinical data to ensure the quality and stability of the data.

2.2 Imaging acquisition and analysis

Supplementary Table S1 describes in detail the CT scanner models, scanning parameters, and scanning positions used in this study.

CT images were analyzed individually by two neurological radiologists with 5 years of experience: (1) massive stroke characterized by an infarcted area of more than 1/3 of the area supplied by the middle cerebral artery; (2) HMCAS referred to the increased wall density of the middle cerebral artery on the side of the infarct; (3) the Alberta stroke program early CT score (ASPECTS) was based on the NCCT images to score the ischemic changes of the middle cerebral artery blood supply area in 10 areas of the two levels. Each affected area was subtracted by 1 point, the normal brain CT was 10 points; and (4) HT determined by the presence of hyperdense lesions on follow-up CT images that lasted for more than 2 days or abnormal hyper-density remaining despite removal of residual iodine agent by virtual non-contrast (VNC) of IQon spectroscopy or hemorrhagic signals on follow-up MR images. Agreement between the diagnoses of the two radiologists was judged by kappa analysis, as detailed in Supplementary Table S2. Any discrepancies were resolved by consensus.

2.3 Radiomics analysis

After the CT images were anonymized, they were imported in Digital Imaging and Communications in Medicine (DICOM) format into 3D-Slicer software (https://www.slicer.org; version 5.5.0) (24). A single radiologist performed the relevant imaging histological characterization, as shown below.

First, the 3D region of interest (ROI) was sketched manually along the contours of the infarcted lesion (Figure 2). If the contours of the lesion cannot be clearly visualized at the first CT examination, the boundary can be drawn with the aid of diffusion-weighted images taken over a short period of time or a second follow-up CT. And the volume of ROIs was measured through this software. Second, to reduce the potential effects of scanner and sweep parameters, we normalized all the ROIs by resampling them via linear interpolation, fixing the image gray values, and smoothing the images via a Gaussian filter. Finally, four major categories of features were extracted for each ROI in this study using the “Radiomics Module” in 3D-Slicer software: first-order statistical features, texture features, morphological features and wavelet features. To ensure the stability of the radiomic features, the above procedure was repeated after 1 month by the same doctor, who randomly selected 90 (1/2) patients from all patients. The intraclass correlation coefficient (ICC) was then calculated based on the radiomics features acquired by the same physician in the ROI sketches drawn before and after two times. Stable features with ICCs above 0.75 were retained, and all the features were normalized using a standard deviation normalization (Z-score) approach.

Figure 2
www.frontiersin.org

Figure 2. Typical example of ROI segmentation. (A,B) Segmented infarcted lesion (green area) on the axial slice of CT images. (C) 3D-ROI.

2.4 Feature selection

First, for clinical laboratory data and radiomics features, we screened features for between-group differences by univariate analysis in the training cohort. Then, the least absolute shrinkage and selection operator (LASSO) method was used to removal uncorrelated or redundant radiomic features, and the radiomics features that yielded the optimal predictive efficacy were selected by 5-fold cross-validation. Finally, the logistic regression (LR) classifier algorithm was applied to construct radiomics labels, and the weighting coefficients were summed to calculate the radiomics score (Rad-score).

2.5 Evaluating the best ML algorithm for building models

Based on the principle of random sampling in an 8:2 manner, 180 AIS patients were split into a training cohort (n = 144, 81 patients with HT) and a validation cohort (n = 36, 23 patients with HT). Under the clinical features (p < 0.05) and Rad-score obtained from the screening of the above methods, five ML algorithms KNN, support vector machine (SVM), decision tree, extreme gradient boosting (XGB), and LR were developed, and the optimal ML algorithm was determined by comparing their effects to construct a predictive model for HT (Figure 3 and Table 1).

Figure 3
www.frontiersin.org

Figure 3. ROC curves of five machine learning models for HT prediction in the training cohort (A) and validation cohort (B).

Table 1
www.frontiersin.org

Table 1. Performance comparison of five machine learning models for HT prediction.

2.6 Model construction and evaluation

After determining the optimal ML algorithm, the filtered radiomic features were combined with clinical features to construct the final joint model. In addition, both clinical (constructed by integrating clinical laboratory and traditional imaging features) and radiomics models were constructed for easy comparison. The validation cohort was used to verify the performance of the three models. The area under the receiver operating characteristic curve (AUC) of the constructed predictive models was tested for discrimination by using receiver operating characteristic (ROC) curves, with an AUC closer to 1 suggesting better discrimination of the model; calibration curves were plotted, with a slope closer to 1 suggesting better calibration; clinical applicability was tested by using decision curve analysis (DCA), with a larger area under the decision curve suggesting better clinical applicability of the model; and the DeLong test was used to compare the AUC between the models.

2.7 Statistical analysis

The mean ± standard deviation (SD) indicated that the data conformed to a normal distribution, the medians (25% quartile, 75% quartile) indicated that the data did not conform to a normal distribution, and frequencies and constitutive ratios (%) indicated categorical data. Clinical characteristics were assessed using an independent samples t-test and a variance test. Intergroup comparisons of the radiomic features were performed using the independent samples t-test. The data were analyzed and graphed using R software (version 4.3.1), Python (version 3.9) and SPSS (version 26.0). p < 0.05 (two-sided) indicated a significant difference.

3 Results

3.1 Patients’ clinical features

This study included 180 patients (training cohort 144, test cohort 36) from two centers—95 males, 85 females, and patients aged 42–94 years with a median age of 70.51 years (62.00, 79.25). Among them, 104 patients developed HT (76 with PH and 28 with HI), and 76 patients had no HT. All the data were not significantly different between the training and validation cohorts (p > 0.05) (Table 2).

Table 2
www.frontiersin.org

Table 2. Characteristics of patients in the training and validation cohorts.

Clinical and imaging characteristics with component differences associated with HT were screened by univariate analysis in the training cohort (Table 3). We found that the NLR, baseline NIHSS score, infarct volume and Rad-score were greater and the ASPECTS was lower in the HT group than in the no-HT group (all p < 0.01).

Table 3
www.frontiersin.org

Table 3. Univariate analysis of characteristics in the training cohort.

3.2 Radiomics score

A total of 851 radiomics features were calculated from the initial CT images of each patient. (1) A total of 706 features were obtained after ICC screening, (2) 182 features were screened via t-tests, and (3) six features highly correlated with HT were screened by the LASSO regression downscaling method and 5-fold cross-validation (Figures 4A,B). The six features were analyzed using LR and Rad-score was calculated as shown in equation.

f x = β i x i + β 0

β i was the coefficient of each feature, x i was the specific feature, and β 0 was the constant (Supplementary Table S3). Figures 4C,D shows the Rad-score of each patient in both cohorts for further analysis. The results indicated that Rad-scores were greater and significantly different in HT patients than in non-HT patients (mean 0.693 vs. −0.266, p < 0.001).

Figure 4
www.frontiersin.org

Figure 4. (A,B) Screening of radiomics features. (C,D) Waterfall plots of the Rad-score in the training and validation cohorts. Red is set to HT, blue is set to non-HT.

3.3 Performances of the models

This study revealed that the LR algorithm performed the most well. Therefore, this study established multiple logistic regression prediction models according to the histologic and clinical features obtained from the above screening, namely, the clinical model, the radiomics model, and the clinical-radiomics fusion model. In the training and validation cohorts, the AUCs were 0.829 (95% CI 0.762–0.896) and 0.876 (95% CI 0.759–0.994) for the clinical model and 0.813 (95% CI 0.742–0.884) and 0.898 (95% CI 0.776–1.000) for the radiomics model, respectively, and the AUCs of the clinical-radiomics model were 0.876 (95% CI 0.822–0.931) and 0.957 (95% CI 0.899–1.000), respectively (Figures 5A,B).

Figure 5
www.frontiersin.org

Figure 5. ROC curves of the clinical model, radiomics model, and clinical-radiomics model for HT prediction constructed in the training cohort (A) and validation cohort (B).

Table 4 compares the results of the three models, and Supplementary Figure S1 shows the DeLong test results. The results indicated that although the difference in predictive ability between the three models was not significant in the training and validation cohorts (p > 0.05), the predictive ability of the clinical-radiomics model improved in both cohorts when clinical and radiological histological features were analyzed together.

Table 4
www.frontiersin.org

Table 4. Performance of the clinical model, radiomics model, clinical-radiomics model for HT prediction.

In addition, the calibration curves showed high concordance between the predicted and actual risk for the clinical-radiomics models in both cohorts (Figures 6A,B). The DCA curves indicated that the clinical-radiomics fusion model had a greater net clinical benefit advantage than the single model (Figures 6C,D).

Figure 6
www.frontiersin.org

Figure 6. (A,B) Calibration curves of the clinical-radiomics model in the training and validation cohorts. (C,D) DCA curves of the clinical model, radiomics model, and clinical-radiomics model in the training and validation cohorts.

Finally, we transformed the multifactorial logistic regression model built using the Rad-score in conjunction with clinical characteristics into a visualized nomogram, which made the predictive model readable and facilitated the assessment of patients (Figure 7).

Figure 7
www.frontiersin.org

Figure 7. The clinical-radiomics nomogram for predicting HT after stroke.

This study further analyzed and discussed the expression ability of the clinical-radiomics model in different subgroups. The model predicted HT with an accuracy of 77.3–93.1% for stroke patients receiving different treatment modalities (Figure 8A). The accuracy of the model in predicting HT was 86.6 and 74.7% for patients with massive stroke and non-massive stroke, respectively (Figure 8B). In addition, the model predicted HT in patients within 4.5 h and over 4.5 h after stroke onset with accuracies of 80.5 and 81.6%, respectively (Figure 8C). We found that none of the model predictions were significantly different in the different subgroup analyses (all p > 0.05). Furthermore, this clinical-radiomics model performed reliably in predicting the PH and HI subcategories, with accuracies of 82.9 and 92.9%, respectively. In short, the model predicted HT well, with accuracies of 79.5 and 95.0% in the training and validation cohorts, respectively (Figure 8D).

Figure 8
www.frontiersin.org

Figure 8. Predictive ability of clinical-radiomics model in different subgroups. (A) Shows the different treatment methods. (B) Shows the different infarction size. (C) Shows the different stroke onset time. (D) Shows the two classifications of HT.

4 Discussion

HT is a significant adverse prognostic factor for AIS and determines patients’ therapeutic decisions and functional prognosis. Therefore, in this study, we explored the risk factors for HT by combining clinical laboratory indices and imaging images of stroke patients, constructed imaging biomarkers for predicting HT, and finally developed and validated a reliable predictive model for HT.

As in previous studies, this study revealed that four clinical characteristics, the NLR (12, 25, 26), baseline NIHSS score (2729), infarct volume (3032), and ASPECTS (33, 34), were significant risk factors strongly associated with HT. Neutrophils are important indicators of inflammation, which is an important factor in secondary brain injury after stroke (35, 36). At the same time, the systemic immunosuppression that occurs after stroke causes a decrease in lymphocytes (37), the relative decrease in lymphocytes in response to acute physiological stress promotes an increase in inflammatory cytokines, which exacerbates ischemic injury (38, 39). Therefore, a high NLR reflects the degree of brain damage after stroke and is important for predicting HT. Increasing values of the NIHSS score, which is used as an index to assess neurologic damage in stroke patients, tend to indicate more severe blood-brain barrier disruption. Consistent with previous findings (2729), our study suggested that higher baseline NIHSS scores are associated with a greater risk of HT. In addition, this study revealed that larger infarct volumes and lower ASPECTS were more likely to lead to HT because massive stroke can lead to more severe cytotoxic edema due to ischemia and hypoxia, exacerbating the breakdown of the blood-brain barrier (30, 31). Therefore, if the admission of a patient with AIS reveals a low ASPECTS and a large infarct volume, the physician needs to be alerted to the possibility of a high risk of HT in this patient when laboratory results are unavailable.

Radiomics features are more focused on internal differences within the infarct area than are clinical laboratory markers reflecting systemic systems and imaging markers simply reflecting the extent of the infarct. Thus, in the present study, the radiomic features of the infarcted area of the first CT on admission were also obtained. Six optimal radiomic features were ultimately included through screening, including one gray-level dependence matrix (GLDM) feature reflecting the small correlation of lower gray values in the infarct region, two shape features describing the size and flatness of the cerebral infarcts, one gray-level run length matrix (GLRLM) feature reflecting the running variance of the image, and two GLRLM features measuring the distribution of the long stroke. Finally, the radiomics model constructed by combining these features predicted HT well (AUC = 0.898 for the validation cohort). The DCA curves indicate that clinical models (constructed by integrating clinical laboratory and traditional imaging features) and radiomics models have essentially the same benefits in clinical applications. This finding suggested that radiomics features can be used to effectively and adequately assess the status of blood-brain barrier damage by indirectly identifying microscopic differences within the infarct zone from changes in image voxels alone while ignoring global immune status and imaging changes visualized by the naked eye (40). It is worth noting that in order to reduce the differences in imaging between different devices, and considering the clinical applicability of the model, all images were standardized in this study, and these operations may have a certain impact on the extraction of radiomics features. Therefore, when using the model, ensuring that all input images are uniformly preprocessed can fully utilize the best effect of the model.

In contrast to previous studies that constructed models to predict HT based only on clinical or radiomic characteristics, this study constructed a clinical-radiomics model that demonstrated strong predictive performance in the validation cohort (AUC of 0.957, 95% accuracy), while the DCA curves indicated that the model had a greater net clinical benefit advantage in HT prediction than did the clinical and radiomics models. In addition, the model showed greater potential for subgroup prediction with different treatment methods, different infarct sizes, and different stroke time windows, as well as for HT classification prediction, reflecting the greater stability and robustness of the model in different environments. Moreover, only a few studies (15, 41) have focused on the risk of HT in AIS patients not receiving recanalization therapy, who account for the majority of AIS patients. In fact, the need to develop individualized treatment for patients who cannot receive recanalization therapy is also increasing. Therefore, the present study simultaneously included stroke patients who received different treatment modalities, such as IVT, EVT, bridging therapy, and non-reperfusion therapy, constructing a model with a wider range of applicability. Finally, visualizing the model with a nomogram also makes the application easier and can quickly assist neurologists in comprehensively assessing patients’ HT risk and customizing personalized treatment plans, resulting in a greater rate of patient benefit.

However, there are several limitations. First, although the study was a two-center study, the sample size was small, and the study was retrospective. Second, the limitations of CT image resolution can lead to errors in sketching the boundary of the infarct lesion. Moreover, some patients with hyperacute AIS for whom the infarction boundary could not be determined on the first CT images and for whom follow-up CT/MRI images were not acquired within 6 h were not included in the study. Therefore, the reproducibility and clinical feasibility of this study were somewhat limited. Finally, because some laboratory data were incomplete, we did not include some important predictors associated with HT, such as matrix metalloproteinase (MMP) (42). There was also some information that was not analyzed in detail, such as coagulation function, which was not divided into fibrin degradation products (FDPs) and D-dimer. In future studies, big data support, multicenter validation, multidisciplinary collaboration, and prospective evaluation may help us gradually move closer to the goal of precision medicine.

5 Conclusion

In conclusion, the ML model constructed on the basis of initial NCCT images and clinical characteristics of AIS patients is valuable for early clinical screening of high-risk groups prone to HT and for the development of individualized and precise prevention and treatment measures.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by Chongqing General Hospital, Chongqing University. The studies were conducted in accordance with the local legislation and institutional requirements. The ethics committee/institutional review board waived the requirement of written informed consent for participation from the participants or the participants’ legal guardians/next of kin due to the retrospective nature of the study.

Author contributions

YZ: Conceptualization, Formal analysis, Investigation, Methodology, Software, Validation, Visualization, Writing – original draft. GX: Conceptualization, Data curation, Software, Writing – review & editing. LZ: Data curation, Investigation, Methodology, Writing – review & editing. JL: Writing – review & editing. WT: Writing – review & editing. DW: Data curation, Software, Writing – review & editing. LY: Methodology, Writing – review & editing. KL: Methodology, Project administration, Supervision, Writing – review & editing.

Funding

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fneur.2024.1413795/full#supplementary-material

References

1. Ande, SR, Grynspan, J, Aviv, RI, and Shankar, JJS. Imaging for predicting hemorrhagic transformation of acute ischemic stroke—a narrative review. Can Assoc Radiol J. (2022) 73:194–202. doi: 10.1177/08465371211018369

PubMed Abstract | Crossref Full Text | Google Scholar

2. GBD 2016 Stroke Collaborators. Global, regional, and national burden of stroke, 1990–2016: a systematic analysis for the global burden of disease study 2016. Lancet Neurol. (2019) 18:439–58. doi: 10.1016/S1474-4422(19)30034-1

Crossref Full Text | Google Scholar

3. von Kummer, R, Broderick, JP, Campbell, BCV, Demchuk, A, Goyal, M, Hill, MD, et al. The Heidelberg bleeding classification: classification of bleeding events after ischemic stroke and reperfusion therapy. Stroke. (2015) 46:2981–6. doi: 10.1161/STROKEAHA.115.010049

PubMed Abstract | Crossref Full Text | Google Scholar

4. Hacke, W, Kaste, M, Fieschi, C, von Kummer, R, Davalos, A, Meier, D, et al. Randomised double-blind placebo-controlled trial of thrombolytic therapy with intravenous alteplase in acute ischaemic stroke (ECASS II). Second European-Australasian Acute Stroke Study Investigators. Lancet. (1998) 352:1245–51. doi: 10.1016/s0140-6736(98)08020-9

PubMed Abstract | Crossref Full Text | Google Scholar

5. Hong, JM, Kim, DS, and Kim, M. Hemorrhagic transformation after ischemic stroke: mechanisms and management. Front Neurol. (2021) 12:703258. doi: 10.3389/fneur.2021.703258

PubMed Abstract | Crossref Full Text | Google Scholar

6. van Kranendonk, KR, Treurniet, KM, Boers, AMM, Berkhemer, OA, van den Berg, LA, Chalos, V, et al. Hemorrhagic transformation is associated with poor functional outcome in patients with acute ischemic stroke due to a large vessel occlusion. J Neurointerv Surg. (2019) 11:464–8. doi: 10.1136/neurintsurg-2018-014141

Crossref Full Text | Google Scholar

7. van der Steen, W, van der Ende, NAM, Luijten, SPR, Rinkel, LA, van Kranendonk, KR, van Voorst, H, et al. Type of intracranial hemorrhage after endovascular stroke treatment: association with functional outcome. J Neurointerv Surg. (2023) 15:971–6. doi: 10.1136/jnis-2022-019474

PubMed Abstract | Crossref Full Text | Google Scholar

8. He, J, Fu, F, Zhang, W, Zhan, Z, and Cheng, Z. Prognostic significance of the clinical and radiological haemorrhagic transformation subtypes in acute ischaemic stroke: a systematic review and meta-analysis. Eur J Neurol. (2022) 29:3449–59. doi: 10.1111/ene.15482

PubMed Abstract | Crossref Full Text | Google Scholar

9. Liu, C, Zhang, Y, Niu, L, and Li, J. High level of the fibrin degradation products at admission predicts parenchymal hematoma and unfavorable outcome of ischemic stroke after intravenous thrombolysis. Front Neurol. (2021) 12:797394. doi: 10.3389/fneur.2021.797394

PubMed Abstract | Crossref Full Text | Google Scholar

10. Xu, Y, Li, X, Wu, D, Zhang, Z, and Jiang, A. Machine learning-based model for prediction of hemorrhage transformation in acute ischemic stroke after alteplase. Front Neurol. (2022) 13:897903. doi: 10.3389/fneur.2022.897903

PubMed Abstract | Crossref Full Text | Google Scholar

11. Li, X, Xu, C, Shang, C, Wang, Y, Xu, J, and Zhou, Q. Machine learning predicts the risk of hemorrhagic transformation of acute cerebral infarction and in-hospital death. Comput Methods Prog Biomed. (2023) 237:107582. doi: 10.1016/j.cmpb.2023.107582

PubMed Abstract | Crossref Full Text | Google Scholar

12. Zhang, R, Wu, X, Hu, W, Zhao, L, Zhao, S, Zhang, J, et al. Neutrophil-to-lymphocyte ratio predicts hemorrhagic transformation in ischemic stroke: a meta-analysis. Brain Behav. (2019) 9:e01382. doi: 10.1002/brb3.1382

PubMed Abstract | Crossref Full Text | Google Scholar

13. Kassner, A, Liu, F, Thornhill, RE, Tomlinson, G, and Mikulis, DJ. Prediction of hemorrhagic transformation in acute ischemic stroke using texture analysis of postcontrast T1-weighted MR images. J Magn Reson Imaging. (2009) 30:933–41. doi: 10.1002/jmri.21940

PubMed Abstract | Crossref Full Text | Google Scholar

14. Bouts, MJ, Tiebosch, IA, Rudrapatna, US, van der Toorn, A, Wu, O, and Dijkhuizen, RM. Prediction of hemorrhagic transformation after experimental ischemic stroke using MRI-based algorithms. J Cereb Blood Flow Metab. (2017) 37:3065–76. doi: 10.1177/0271678X16683692

PubMed Abstract | Crossref Full Text | Google Scholar

15. Xie, G, Li, T, Ren, Y, Wang, D, Tang, W, Li, J, et al. Radiomics-based infarct features on CT predict hemorrhagic transformation in patients with acute ischemic stroke. Front Neurosci. (2022) 16:1002717. doi: 10.3389/fnins.2022.1002717

PubMed Abstract | Crossref Full Text | Google Scholar

16. Da Ros, V, Duggento, A, Cavallo, AU, Bellini, L, Pitocchi, F, Toschi, N, et al. Can machine learning of post-procedural cone-beam CT images in acute ischemic stroke improve the detection of 24-h hemorrhagic transformation? A preliminary study. Neuroradiology. (2023) 65:599–608. doi: 10.1007/s00234-022-03070-0

PubMed Abstract | Crossref Full Text | Google Scholar

17. Jiang, L, Zhou, L, Yong, W, Cui, J, Geng, W, Chen, H, et al. A deep learning-based model for prediction of hemorrhagic transformation after stroke. Brain Pathol. (2023) 33:e13023. doi: 10.1111/bpa.13023

PubMed Abstract | Crossref Full Text | Google Scholar

18. Ren, H, Song, H, Wang, J, Xiong, H, Long, B, Gong, M, et al. A clinical-radiomics model based on noncontrast computed tomography to predict hemorrhagic transformation after stroke by machine learning: a multicenter study. Insights Imaging. (2023) 14:52. doi: 10.1186/s13244-023-01399-5

PubMed Abstract | Crossref Full Text | Google Scholar

19. Lambin, P, Rios-Velazquez, E, Leijenaar, R, Carvalho, S, van Stiphout, RGPM, Granton, P, et al. Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer. (2012) 48:441–6. doi: 10.1016/j.ejca.2011.11.036

PubMed Abstract | Crossref Full Text | Google Scholar

20. Heo, J, Sim, Y, Kim, BM, Kim, DJ, Kim, YD, Nam, HS, et al. Radiomics using non-contrast CT to predict hemorrhagic transformation risk in stroke patients undergoing revascularization. Eur Radiol. (2024). doi: 10.1007/s00330-024-10618-6

PubMed Abstract | Crossref Full Text | Google Scholar

21. Wang, F, Huang, Y, Xia, Y, Zhang, W, Fang, K, Zhou, X, et al. Personalized risk prediction of symptomatic intracerebral hemorrhage after stroke thrombolysis using a machine-learning model. Ther Adv Neurol Disord. (2020) 13:1756286420902358. doi: 10.1177/1756286420902358

PubMed Abstract | Crossref Full Text | Google Scholar

22. Choi, JM, Seo, SY, Kim, PJ, Kim, YS, Lee, SH, Sohn, JH, et al. Prediction of hemorrhagic transformation after ischemic stroke using machine learning. J Pers Med. (2021) 11:863. doi: 10.3390/jpm11090863

PubMed Abstract | Crossref Full Text | Google Scholar

23. Powers, WJ, Rabinstein, AA, Ackerson, T, Adeoye, OM, Bambakidis, NC, Becker, K, et al. Guidelines for the early management of patients with acute ischemic stroke: 2019 update to the 2018 guidelines for the early management of acute ischemic stroke: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. (2019) 50:e344–418. doi: 10.1161/STR.0000000000000211

PubMed Abstract | Crossref Full Text | Google Scholar

24. Zhang, L, Wu, J, Yu, R, Xu, R, Yang, J, Fan, Q, et al. Non-contrast CT radiomics and machine learning for outcomes prediction of patients with acute ischemic stroke receiving conventional treatment. Eur J Radiol. (2023) 165:110959. doi: 10.1016/j.ejrad.2023.110959

PubMed Abstract | Crossref Full Text | Google Scholar

25. Liu, J, Wang, Y, Jin, Y, Guo, W, Song, Q, Wei, C, et al. Prediction of hemorrhagic transformation after ischemic stroke: development and validation study of a novel multi-biomarker model. Front Aging Neurosci. (2021) 13:667934. doi: 10.3389/fnagi.2021.667934

PubMed Abstract | Crossref Full Text | Google Scholar

26. Krishnamoorthy, S, Singh, G, Jose, KJ, Soman, B, Foerch, C, Kimberly, WT, et al. Biomarkers in the prediction of hemorrhagic transformation in acute stroke: a systematic review and meta-analysis. Cerebrovasc Dis. (2022) 51:235–47. doi: 10.1159/000518570

PubMed Abstract | Crossref Full Text | Google Scholar

27. Lei, YS, Li, H, Lei, JY, Li, SX, and Li, DF. Effect of intravenous thrombolysis in acute ischemic stroke patients with cerebral microbleeds and analysis of risk factors for hemorrhagic transformation. Eur Rev Med Pharmacol Sci. (2022) 26:779–86. doi: 10.26355/eurrev_202202_27986

PubMed Abstract | Crossref Full Text | Google Scholar

28. Hao, Y, Zhou, H, Pan, C, Xie, G, Hu, J, Zhang, B, et al. Prediction factors and clinical significance of different types of hemorrhagic transformation after intravenous thrombolysis. Eur J Med Res. (2023) 28:509. doi: 10.1186/s40001-023-01503-x

PubMed Abstract | Crossref Full Text | Google Scholar

29. Zubair, AS, and Sheth, KN. Hemorrhagic conversion of acute ischemic stroke. Neurotherapeutics. (2023) 20:705–11. doi: 10.1007/s13311-023-01377-1

PubMed Abstract | Crossref Full Text | Google Scholar

30. Muscari, A, Faccioli, L, Lega, MV, Lorusso, A, Masetti, M, Pastore Trossello, M, et al. Predicting hemorrhagic transformation and its timing from maximum cerebral lesion diameter in nonlacunar ischemic strokes. Brain Behav. (2020) 10:e01497. doi: 10.1002/brb3.1497

PubMed Abstract | Crossref Full Text | Google Scholar

31. Yoshimura, S, Sakai, N, Yamagami, H, Uchida, K, Beppu, M, Toyoda, K, et al. Endovascular therapy for acute stroke with a large ischemic region. N Engl J Med. (2022) 386:1303–13. doi: 10.1056/NEJMoa2118191

Crossref Full Text | Google Scholar

32. Tan, S, Wang, D, Liu, M, Zhang, S, Wu, B, and Liu, B. Frequency and predictors of spontaneous hemorrhagic transformation in ischemic stroke and its association with prognosis. J Neurol. (2014) 261:905–12. doi: 10.1007/s00415-014-7297-8

PubMed Abstract | Crossref Full Text | Google Scholar

33. Cheng, X, Shi, J, Wu, H, Dong, Z, Liu, J, Zhou, C, et al. ASPECTS-based attenuation changes on CT angiography as an imaging biomarker to predict hemorrhagic transformation in acute ischemic stroke. Cerebrovasc Dis. (2022) 51:532–41. doi: 10.1159/000521026

PubMed Abstract | Crossref Full Text | Google Scholar

34. Nawabi, J, Kniep, H, Schön, G, Flottmann, F, Leischner, H, Kabiri, R, et al. Hemorrhage after endovascular recanalization in acute stroke: lesion extent, collaterals and degree of ischemic water uptake mediate tissue vulnerability. Front Neurol. (2019) 10:569. doi: 10.3389/fneur.2019.00569

PubMed Abstract | Crossref Full Text | Google Scholar

35. Qun, S, Tang, Y, Sun, J, Liu, Z, Wu, J, Zhang, J, et al. Neutrophil-to-lymphocyte ratio predicts 3-month outcome of acute ischemic stroke. Neurotox Res. (2017) 31:444–52. doi: 10.1007/s12640-017-9707-z

Crossref Full Text | Google Scholar

36. Wang, Q, Wang, K, Ma, Y, Li, S, and Xu, Y. Serum galectin-3 as a potential predictive biomarker is associated with poststroke cognitive impairment. Oxid Med Cell Longev. (2021) 2021:5827812. doi: 10.1155/2021/5827812

PubMed Abstract | Crossref Full Text | Google Scholar

37. Wang, X, Wang, Q, Wang, K, Ni, Q, Li, H, Su, Z, et al. Is immune suppression involved in the ischemic stroke? A study based on computational biology. Front Aging Neurosci. (2022) 14:830494. doi: 10.3389/fnagi.2022.830494

PubMed Abstract | Crossref Full Text | Google Scholar

38. Park, BJ, Shim, JY, Lee, HR, Lee, JH, Jung, DH, Kim, HB, et al. Relationship of neutrophil-lymphocyte ratio with arterial stiffness and coronary calcium score. Clin Chim Acta. (2011) 412:925–9. doi: 10.1016/j.cca.2011.01.021

PubMed Abstract | Crossref Full Text | Google Scholar

39. Li, Z, Cui, L, Ma, J, Ma, X, and Li, G. Association between neutrophil to lymphocyte ratio and atrial fibrillation. Int J Cardiol. (2015) 187:361–2. doi: 10.1016/j.ijcard.2015.03.114

Crossref Full Text | Google Scholar

40. Valdés Hernández, MDC, González-Castro, V, Chappell, FM, Sakka, E, Makin, S, Armitage, PA, et al. Application of texture analysis to study small vessel disease and blood-brain barrier integrity. Front Neurol. (2017) 8:327. doi: 10.3389/fneur.2017.00327

PubMed Abstract | Crossref Full Text | Google Scholar

41. Huang, YH, Chen, ZJ, Chen, YF, Cai, C, Lin, YY, Lin, ZQ, et al. The value of CT-based radiomics in predicting hemorrhagic transformation in acute ischemic stroke patients without recanalization therapy. Front Neurol. (2024) 15:1255621. doi: 10.3389/fneur.2024.1255621

PubMed Abstract | Crossref Full Text | Google Scholar

42. Bani-Sadr, A, Mechtouff, L, De Bourguignon, C, Mauffrey, A, Boutelier, T, Cho, TH, et al. Blood-brain barrier permeability and kinetics of inflammatory markers in acute stroke patients treated with thrombectomy. Neurology. (2023) 101:e502–11. doi: 10.1212/WNL.0000000000207460

PubMed Abstract | Crossref Full Text | Google Scholar

Glossary

Keywords: radiomics, non-contrast computed tomography, machine learning, acute ischemic stroke, hemorrhagic transformation

Citation: Zhang Y, Xie G, Zhang L, Li J, Tang W, Wang D, Yang L and Li K (2024) Constructing machine learning models based on non-contrast CT radiomics to predict hemorrhagic transformation after stoke: a two-center study. Front. Neurol. 15:1413795. doi: 10.3389/fneur.2024.1413795

Received: 07 April 2024; Accepted: 21 August 2024;
Published: 02 September 2024.

Edited by:

Wenle Li, Xiamen University, China

Reviewed by:

Yuzhen Xu, Shanghai Jiao Tong University, China
Jixin Liu, Xidian University, China

Copyright © 2024 Zhang, Xie, Zhang, Li, Tang, Wang, Yang and Li. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Kang Li, bGtybXl5ZG9jdG9yQDEyNi5jb20=

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.