- 1North Sichuan Medical College, Nanchong, China
- 2Department of Radiology, The Third People's Hospital of Chengdu, Chengdu, China
- 3Department of Radiology, Chongqing General Hospital, Chongqing, China
- 4Chongqing Medical University, Chongqing, China
Purpose: This research aimed to create a machine learning model for clinical-radiomics that utilizes unenhanced computed tomography images to assess the likelihood of malignant cerebral edema (MCE) in individuals suffering from acute ischemic stroke (AIS).
Methods: The research included 179 consecutive patients with AIS from two different hospitals. These patients were randomly assigned to training (n = 143) and validation (n = 36) sets with an 8:2 ratio. Using 3DSlicer software, the radiomics features of regions impacted by infarction were derived from unenhanced CT scans. The radiomics features linked to MCE were pinpointed through a consistency test, Student’s t test and the least absolute shrinkage and selection operator (LASSO) method for selecting features. Clinical parameters associated with MCE were also identified. Subsequently, machine learning models were constructed based on clinical, radiomics, and clinical-radiomics. Ultimately, the efficacy of these models was evaluated by measuring the operating characteristics of the subjects through their area under the curve (AUCs).
Results: Logistic regression (LR) was found to be the most effective machine learning algorithm, for forecasting the MCE. In the training and validation cohorts, the AUCs of clinical model were 0.836 and 0.773, respectively, for differentiating MCE patients; the AUCs of radiomics model were 0.849 and 0.818, respectively; the AUCs of clinical and radiomics model were 0.912 and 0.916, respectively.
Conclusion: This model can assist in predicting MCE after acute ischemic stroke and can provide guidance for clinical treatment and prognostic assessment.
1 Introduction
AIS is widely acknowledged as the primary cause of mortality and impairment among adults (Meschia and Brott, 2018). Cerebral edema is a frequent complication after AIS and may be linked to poor outcomes. According to the guidelines of the “Safe Implementation of Thrombolysis in Stroke-Monitoring Study (SITS-MOST) program” (Thorén et al., 2017), cerebral edema can be classified into three levels: CED-1 denotes the moment when swelling in brain tissue extends to one-third of the brain’s hemisphere; CED-2 occurs when there is swelling covering over a third of the hemisphere but no midline displacement has occurred; and CED-3 occurs when the enlargement of brain tissue results in the displacement of the midline. Usually, a midline shift (MLS) greater than 5 mm is considered an indicator of malignant cerebral edema (MCE) (Barber et al., 2003). This is considered an indicator of malignant cerebral edema (MCE), which has a mortality rate of up to 80%. Neurological function typically deteriorates rapidly within 2 to 3 days after symptom onset (Liebeskind et al., 2019). Early decompression by debulking flaps can effectively reduce mortality (Minnerup et al., 2011). Prompt identification of the MCE is vital for stroke neurologists to proactively intervene to avert deterioration of the condition and decide on treatments.
To date, MCE can be predicted by various methods, such as the National Institutes of Health Stroke Scale (NIHSS) score, stroke size, Alberta stroke program early CT score (ASPECTS), collateral circulation score, net water uptake (NWU), and cerebrospinal fluid (CSF) displacement (Thomalla et al., 2003; MacCallum et al., 2014; Kim et al., 2015; Dhar et al., 2016; Jo et al., 2017; Nawabi et al., 2021). Currently, non-contrast computed tomography (NCCT) images are recommended by guidelines as the preferred examination for AIS (Powers et al., 2019). However, diffusion-weighted imaging (DWI), fluid-attenuated inversion recovery (FLAIR) imaging, and computed tomography perfusion (CTP) have also been developed as screening modalities for patients with suspected AIS. Although CTP has gradually gained popularity, it is time-consuming and has contraindications for screening.
In recent years, advances in computer technology have enabled the conversion of imaging data into high-throughput information, which can indirectly respond to heterogeneity at the microscopic level of tissue. Texture feature-based radiomics methods are now commonly used (Lin et al., 2020; Xu et al., 2020; Ren et al., 2023). However, it is not entirely clear how NCCT infarct region-based radiomics features correlate with the progression of MCE after AIS. Recently, advancements in artificial intelligence technology have resulted in the steady integration of machine learning (ML) into AIS-related research. This is due to its superior modeling performance over traditional statistical techniques (Hoffman et al., 2023). To date, ML has been used to achieve automatic segmentation of CSF after AIS as a way to predict the risk of MCE and has achieved good results (Dhar et al., 2018). While research has focused on forecasting MCE risk post-AIS using MRI radiomics, NCCT radiomics based on the middle cerebral artery territory, and ML models derived from clinical data (Wang et al., 2021; Hoffman et al., 2023; Wen et al., 2023), the integration of clinical and radiomics data in ML models for predicting MCE post-AIS remains undocumented. Our research led to the creation and validation of ML algorithms that merge clinical and NCCT infarct region radiomics features to predict MCE risk post-AIS. It was hypothesized that machine learning could accurately predict MCE risk post-AIS using both clinical and radiomic data.
2 Materials and methods
2.1 Patients
This retrospective analysis received approval from our institutional review board (approval number: KY S2023-077-01), and informed consent was waived because of its retrospective nature.
Between July 2016 and December 2023, clinical information and NCCT imagery were collected from a pair of hospitals: Affiliated Hospital of North Sichuan Medical College and Chongqing General Hospital. The study collected 461 consecutive AIS patients. The sample included individuals who were diagnosed with AIS and who satisfied the following conditions: (1) anterior circulation affected by AIS as per WHO guidelines (Aho et al., 1980); (2) a head CT scan was conducted within 1 day of symptom emergence before admission for treatment; (3) CT follow-up of at least 3 days unless malignant cerebral edema (MCE) occurred within 3 days; and (4) infarct zones identified by CT. The exclusion criteria were as follows: head trauma, initial brain hemorrhage or tumor, hemorrhagic infarction at admission, post-admission hemorrhagic alteration, insufficient data, and notable irregularities in NCCT imagery. Finally, the study enrolled a total of 179 patients, 131 of whom did not have MCE and 48 of whom did have MCE (Figure 1).
Figure 1. The flow chart of patient inclusion and exclusion criteria. AIS, acute ischemic stroke; MCE, malignant cerebral edema.
2.2 Endpoints
The main endpoint was any midline movement (be it the septum pellucidum or pineal gland) exceeding 5 mm during follow-up examination that required a decompressive hemicraniectomy craniectomy (DHC) (Barber et al., 2003; Tracol et al., 2020).
2.3 Data collection
The clinical data in our research included age, sex, stroke onset timing, and treatment, which were collected from the medical records. Additionally, assessments were carried out on patients regarding their NIHSS score; smoking habits; alcohol consumption; hypertension; diabetes; high fat levels; atrial fibrillation; and heart failure. The imaging data in our research included the ASPECTS, severe stroke, and hyperdense middle cerebral artery sign, which was obtained from the Picture Archiving and Communication System (PACS).
2.4 Capturing and analyzing images
Our research used the LightSpeed VCT (GE) or IQon Spectral CT (Philips) technique to capture head CT scans without any contrast enhancement. The patients were laid on their backs, with the orbital tract line serving as the baseline for scanning. The scanning zone extended from the apex of the head to the base of the skull. The scanning criteria were as follows: a tube voltage of 120 kV, a current setting of 220 mAs, a pitch ratio of 1.0, and layer thickness of 5 mm and layer spacing of 5 mm.
The patients’ NCCT scans were examined by two seasoned radiologists (F and Y, each with more than 5 years of expertise, independently). (1) The initial CT scan delineated the infarct area boundaries by identifying regions of marked hypointensity following the adjustment of image gray values. (2) The hyperdense middle cerebral artery (MCA) sign exhibited increased densification within the MCA on the affected side of the infarct compared to the contralateral side. (3) Massive cerebral infarction was defined as an infarct area that was more than one-third of the cerebral hemisphere or an infarct volume > 80 mL (Hua et al., 2023). Furthermore, the ASPECTS was determined by subtracting the hypodense area score from the NCCT image’s overall score of 10 (Mokin et al., 2017). Upon admission, the patient’s initial neurological condition was evaluated utilizing the NIHSS. Discrepancies in the assessments made by the two evaluators were settled by mutual agreement via dialog.
2.5 Data preprocessing
Missing values in the clinical data were filled using K nearest neighbors (KNN) (Ren et al., 2023). Moreover, normalization of the NCCT images was achieved by adjusting the image voxels to dimensions of 1 mm × 1 mm × 1 mm via linear interpolation, refining the images with a Gaussian filter, and setting the gray bin width of the images at 25.
2.6 Infarct lesion segmentation and radiomics feature screening
Infarct lesion segmentation and screening of radiomic feature were performed using 3DSlicer.1
This software facilitated the analysis of the initial head CT scans of all AIS patients, which were not enhanced in contrast, in DICOM format. The perimeters of the infarct area were ascertained by modifying the gray hues in the CT scans. Following this, a semiautomatic segmentation technique was employed to acquire a three-dimensional region of interest (ROI) for the infarct area (Figure 2). To maintain consistency, the same radiologist selected 90 AIS patients at random after 1 week for the purpose of resegmentation of the ROIs and extraction of the radiomics features by imaging. The ICC was used to assess the uniformity of characteristics between two occasions. To avoid overfitting, feature selection was conducted as a necessary preprocessing step. Accordingly, only features demonstrating an Intraclass Correlation Coefficient (ICC) value above 0.75 were selected for inclusion in subsequent analyses to ensure their reliability for future studies.
Figure 2. The region of interest (ROI) was manually segmented along the edges of the infarcted region on each slice of the NCCT image using the 3D-Slicer software. (A,B) ROIs in the infarct area across different axial planes. (C) A 3D-ROI within the infarcted area. ROI, region of interest; 3D, three-dimensional.
Using the PyRadiomics plug-in of the software, radiomics signature was derived from the ROIs in the images. These included various matrices, such as the gray-level co-occurrence matrix (GLCM), gray-level dependence matrix (GLDM), gray-level run length matrix (GLRLM), gray-level size zone matrix (GLSZM), neighboring gray-tone difference matrix (NGTDM), wavelet-based features, 3D-shaped features, and first-order features.
After analyzing the radiomics features extracted twice using ICC, we subjected the radiomics signature with an ICC > 0.75 to a t-test for intergroup comparisons of radiomics scores. Subsequently, LASSO regression and 5-fold cross-validation were employed to identify and ascertain the most suitable radiomics signature linked with the MCE. Lasso regression is a regression analysis technique that has gained considerable recognition for its capacity to identify pivotal features in radiomics, avert overfitting, and yield sparse models that are concise and readily interpretable. By incorporating a regularization term, it reduces model complexity, automatically selects features that contribute the most to the model, and demonstrates robustness against outliers and noise (Huang et al., 2016; Bhatia et al., 2019; Kim et al., 2019). Ultimately, we incorporated the radiomics features associated with MCE obtained after screening and created a radiomics score by a logistic regression algorithm. The Rad-score for every patient on radiomics was calculated by summing the regression coefficients and the product of the equation’s characteristics.
2.7 Model building and validation
These patients were assigned to two sets: one for training (n = 143) and another for validation (n = 36), keeping the ratio at 8:2. In the training cohort, clinical variables were screened using t-test and ANOVA to select variables with p < 0.05. According to the one-way analysis, clinical factors with p < 0.05, along with Rad-score, were identified as significant risk factors for MCE. Using techniques such as KNN, Support Vector Machine (SVM), Tree, eXtreme Gradient Boosting (XGB), and LR, five distinct machine learning models were developed. The models were then validated in a separate cohort, and their predictive performance was further evaluated. The AUC of the models was determined through the analysis of the subject’s operating characteristic curve. Calibration curves were employed to evaluate the concordance between the model’s predicted probabilities and observed outcomes. Subsequently, clinical decision curve analysis (DCA) was applied to determine the model’s net clinical benefit.
2.8 Analytical statistics
Analysis of the statistical data was conducted with R software (version 4.3.1)2 and Python 3.9.3 Normally distributed data are represented as means ± standard deviation, whereas qualitatively distributed data are represented as numbers and percentages. The evaluation of clinical traits was conducted through the application of t-test and ANOVA. A two-by-two comparative analysis of the AUC across three models was conducted utilizing the DeLong test. In every statistical evaluation, p values on both sides below 0.05 were deemed significant.
ICC analyses were conducted to compare radiomics scores between groups. Radiomics features were filtered using a t-test with high correlation and no redundancy. The best feature subset was selected, and the radiomics model was developed through LASSO logistic regression within the ‘Glmnet’ software suite. The ‘class’, ‘kernlab’, ‘rpart’, ‘xgboost’ and ‘glmnet’ packages were utilized to construct KNN, SVM, Tree, XGBoost, and LR machine learning models, respectively. The ‘pROC’, ‘rmda’, and ‘rms’ packages were utilized to construct receiver operating characteristic curve (ROC) curves, DCA curves, and calibration curves, respectively. To evaluate the variance in the AUC among the different models, Delong tests were conducted. Statistical significance was attributed solely to tests where the p value was less than 0.05.
3 Results
3.1 Clinical demographic characteristics
The study analyzed data from 179 patients (102 males [56.98%] and 77 females [43.02%]) with a median age of 68.89 years from two hospitals. Of these, 48 patients suffered from MCE, while 131 did not. There were no significant differences between the patients’ clinical data (Tables 1, 2). Notable differences were detected in the NIHSS score, infarct volume, and ASPECTS among the MCE (+) and MCE (−) groups within the training dataset after univariate analysis (P<0.001) (Table 3).
Table 3. Univariate analysis of the risk factors for malignant cerebral edema (MCE) in the training cohort.
3.2 Radiomics score and nomogram development
From each patient, 851 distinct radiomics features were derived, focusing on the specific region of interest (ROI) within the infarct zone, as seen in non-contrast-enhanced CT scans. After conducting an ICC analysis and t-test, we identified 215 stable features with between-group differences. Ultimately, 9 radiomics features showed a strong correlation with the MCE, as determined through LASSO and a 5-fold cross-validation process (Figures 3A,B). The meanings of these 9 radiomics features are listed in Supplementary Table S1. The 9 characteristics were examined using logistic regression to formulate an equation. Subsequently, the Rad-score was determined using the regression coefficients in the formula to demonstrate the predictive accuracy of the MCE.
Figure 3. Radiomics score (Rad-score) development. (A,B) Radiomics feature selection based on least absolute shrinkage and selection operator (LASSO) and 5-fold cross-validation. When binomial deviance is the smallest, a total of nine optimal features are obtained (A) shows the LASSO regression model’s variable reduction and coefficient adjustment. (B) Shows the model’s mean squared error (MSE) evolving with the log of the penalty coefficient λ, helping to pinpoint optimal features. (C,D) The Rad-score of each patient in the training and validation cohorts. Red indicates malignant cerebral edema (MCE), and blue indicates non-MCE.
For each patient, waterfall diagrams were generated utilizing the Rad-score (Figures 3C,D). The nomogram was created by combining the clinical risk factors mentioned above, namely, the NIHSS at admission, stroke volume, and ASPECTS, with the radiomics labels. Each best predictor was assigned a separate score, and the total score were greater different between MCE patients and non-MCE patients (mean 0.198 vs. −2.048, p < 0.001) (Figure 4). The formula for calculating the risk score is provided.
3.3 Machine learning models development
The training of the model utilized clinical factors (NIHSS score, infarct volume, ASPECTS), achieving a p < 0.05 following univariate analysis and the examination of radiomics features through t-test and logistic regression, utilizing five distinct ML algorithms: KNN, SVM, Tree, XGB, and LR. Model performance was evaluated using the AUCs to identify the optimal machine learning algorithms based on clinical-radiomics features (Table 4, Figures 5A,B). The LR model successfully forecasted the likelihood of MCE, with AUCs of 0.912 (95% CI, 0.868–0.957) and 0.916 (95% CI, 0.808–1.000) in the training and validation cohorts, respectively. Its accuracy, sensitivity, specificity, positive prediction rate and negative prediction rate in the validation set were 0.861, 0.750, 0.875, 0.429, and 0.966, respectively. Despite the low PPV in the validation set, the model can still be considered to have good predictive accuracy when combined with other metrics. Clinical-radiomics machine learning models based on LR were created by incorporating clinical risk factors and key radiomics features from the training cohort, and then validated in the validation cohort. The logistic regression classification algorithm in machine learning was selected for the construction of the clinical model, radiomics model, and joint clinical-radiomics model in the training set and validation set, respectively.
Table 4. Diagnostic performance of clinical-radiomic features across machine learning models in training and validation cohorts.
Figure 5. ROC curves of clinical-radiomic features in the training (A) and validation (B) cohorts for each machine learning model.
3.4 Model evaluation
To evaluate the performance of each model, we created subject operating characteristic curves and calculated the AUC.
3.4.1 Performance of clinical models
In distinguishing patients with MCE, the clinical model had an AUC of 0.836 (95% CI, 0.769–0.903) in the training cohort and 0.773 (95% CI, 0.504–1.000) in the validation cohort (Figures 6A,B and Table 5).
Figure 6. ROC curves for the clinical model, radiomics model, and clinical-radiomics model in the training cohort (A) and validation cohort (B).
Table 5. Diagnostic Performance of logistic regression machine learning models based on clinical features, radiomics features, and clinical-radiomics features in training and validation cohorts.
3.4.2 Performance of radiomics models
In terms of discriminating MCE patients, the radiomics model had an AUC of 0.849 (95% CI, 0.781–0.917) in the training cohort and 0.818 (95% CI, 0.641–0.994) in the validation cohort (Figures 6A,B and Table 5).
3.4.3 Performance of combined clinical-radiomics models
For differentiating MCE patients, the combined clinical-radiomics method achieved an AUC of 0.912 (95% CI, 0.868–0.957) in the training cohort and 0.916 (95% CI, 0.808–1.000) in the validation cohort (Figures 6A,B and Table 5). The results from the DeLong test showed no notable statistical variance among three models (p > 0.05) in the training and validation cohorts (Figures 7A,B).
In both the training and validation sets, there was a strong correlation between the combined clinical-radiomics model and the observed results on the calibration curves for the predictive potential of MCE (Figures 8A,B).
Figure 8. Calibration curves of clinical-radiomics model in the training cohort (A) and validation cohort (B).
Analysis of clinical decisions across all three models revealed the clinical-radiomics model’s clinical importance in predicting MCE (Figures 9A,B).
Based on the optimal critical diagnostic value (0.5) of the clinical-radiomics model, subjects were divided into high-risk and low-risk cohorts in the training and validation sets (Figures 10A,B). The results showed that our model could effectively predict MCE (+).
Figure 10. Classification performance of the clinical-radiomics model in the training (A) and Validation (B) cohorts. MCE, malignant cerebral edema. MCE, malignant cerebral edema.
4 Discussion
To our knowledge, the research introduces an innovative machine learning approach to develop a predictive framework for the MCE. This technique combines machine learning techniques with the visualization of radiomics features in infarcted areas using non-contrast-enhanced CT scans and traditional clinical features. This model is capable of evaluating the likelihood of MCE in AIS patients experiencing anterior circulation complications following reperfusion or non-reperfusion treatment. This approach enhances visual recognition in NCCT images for MCE prediction performance and enhances the diagnostic accuracy of primary care doctors. The data were obtained from a multicenter study via routine post admission examinations, allowing for quick and generalizable application of the model. Our model demonstrated AUC values of 0.912 and 0.916 in both training and validation sets, respectively.
Patients suffering from acute ischemic stroke face a critical complication known as MCE, which carries a significant risk of mortality, potentially increasing to 80% (Liebeskind et al., 2019). The usual cause is the sudden blockage of blood vessels in either the proximal middle cerebral artery or the distal internal carotid artery. Cerebral edema is typically a result of the failure of energy-dependent ion transfer from brain cells after AIS and disruption of the blood–brain barrier. These factors combine to allow excess water to leak into brain tissue, impairing normal neuronal function (Hu and Song, 2017; Abdullahi et al., 2018). Prompt identification of MCE and prompt surgical intervention, coupled with early debulking decompression, are key to lowering patient mortality risks (Hofmeijer et al., 2009). Current clinical diagnostic measures for MCE rely on CT-based observations of midline brain deviation or brain herniation formation, which are usually indicators of delayed onset (Pham and Ng, 2024). Therefore, it is crucial to identify early diagnostic markers for MCE.
The correlation between clinical data and MCE was analyzed, revealing that the NCCT-based infarct volume, ASPECTS, and NIHSS score were correlated with MCE. These scores could indicate the extent of ischemic or infarcted lesions. Patients with MCE (+) had lower ASPECTS, greater infarct volume, and higher NIHSS scores than patients with MCE (−). Research indicates that individuals with MCE (+) experienced more intense initial infarct size and higher NIHSS scores than did those with MCE (−), which is consistent with the results of Wu et al. (2018). Furthermore, the research revealed that patients with MCE (+) exhibited a reduced ASPECTS upon admission in comparison to those with MCE (−), which is consistent with the results of Jo et al. (2017). (p = 0.007).
Radiomics features indicate the intensity, distribution, and interrelationships between pixels that cannot be observed by the naked eye. Radiomics feature analysis is widely used in radiomics to convert high-throughput data extracted from medical images into quantitative metrics. These metrics provide a better and more intuitive understanding of disease heterogeneity (Castellano et al., 2004; Miles et al., 2013; Ren et al., 2018). Currently, there are relatively few applications of imaging in AIS. CT-based radiomics has proven effective in predicting hemorrhagic transformation risks in AIS patients and in evaluating the prognosis of those undergoing standard treatment (Zhang et al., 2023; Heo et al., 2024). Furthermore, radiomics analysis using MRI successfully pinpointed the time of stroke onset in AIS patients (Lu et al., 2024). Additionally, the radiomics features of brain MRI images could serve as initial indicators for the emergence of cognitive deficits and pneumonia poststroke (Luo et al., 2024; Wang et al., 2024). This study presents a radiomics model that uses signature extracted from NCCT images to predict serious complications-MCE after AIS. The model performed well, and the 9 best quantitative radiomics signature were identified. Among them, the GLRLM feature reflects the distribution of consecutive low gray pixels in the image, one GLCM feature reflects the homogeneity of the image texture, two shape features reflect the shape properties of the image region, three first-order features, one GLSZM feature reflects the roughness of the image texture, and one GLDM feature reflects the similarity of the image dependencies.
Among them, the wavelet transform-based grayscale tour length matrix (GLRLM) feature (wavelet-HLH_glrlm._LongRunLowGrayLevelEmphasis) and the grayscale covariance matrix (GLCM) (original_glcm._JointAverage) were identified as the most important features. Ischemic stroke is an injury to brain tissue due to cerebrovascular obstruction in which dysfunction of certain ion channels and transporters can cause disruption of the blood–brain barrier. This disruption can lead to edema and structural changes in the brain tissue of the affected region. Conventional imaging techniques, such as computed tomography (CT) and magnetic resonance imaging (MRI), are primarily used to identify areas of cerebral infarction, but these techniques typically provide image information only about macroscopic structural changes in the brain, and it is difficult to detect microtextural changes. Radiomics methods are able to reflect information about the texture, density, and shape of brain tissue by extracting high-dimensional features from CT or MRI images, thus providing a finer representation of the microscopic changes in brain tissue after stroke. In imaging, infarcted areas tend to have low gray levels, while surrounding healthy brain tissue has higher gray levels. As a result, there is usually a significant textural difference between the infarcted area and the healthy brain tissue. In this study, the wavelet-HLH_glrlm._LongRunLowGrayLevelEmphasis feature was extracted by wavelet transform (HLH direction) and gray-level run-length matrix (GLRLM) analysis and used to characterize the texture of dark regions in the image. This radiomics feature helps to quantify the heterogeneity between infarcted and normal tissue and thus assess the complexity of the lesion area. For example, high values of this feature indicate a continuous distribution of low gray values over a large area, which may be associated with extensive ischemic necrosis, indicating the severity of brain injury. Another feature, original_glcm_JointAverage, is a texture feature based on a gray value covariance matrix that quantifies the gray value variability of a stroke region by capturing the average relationship of gray values between adjacent pixels. This variability may be related to the severity of the lesion and the homogeneity of the tissue damage. In the present study, the above two types of radiomics features were most significantly correlated with MCE. The predictive performance of the developed radiomics model was better than that of the conventional clinical model (AUC: 0.849 vs. 0.836), suggesting that the model can be used to assess the severity of the lesion and the homogeneity of the tissue damage, to analyze the risk of occurrence of MCE after AIS, and may be helpful in optimizing the therapeutic regimen. These findings indicate that a heightened risk of MCE is correlated with diversity in the stroke area. However, additional studies are required to clarify the connection between MCE and pathological changes in the radiomics features of NCCT-based images. In this research, predictive models developed with the 9 radiomics features closely linked to MCE exhibited notably greater AUCs than those utilizing clinical data in both the training and validation sets. This indicates that radiomics signature surpass clinical records in predicting MCE efficacy. Thus, while infarct volume, the ASPECTS, and the NIHSS score can predict the risk of MCE, models based on NCCT radiomics can further improve MCE prediction performance. This allows clinicians to identify AIS patients requiring debulking decompression at an early stage, thereby improving patient benefit rates.
In this research, the DeLong test did not show statistical significance for the three models. Notably, the clinical-radiomics model demonstrated superior AUC and precision compared to the clinical model across both the training and validation cohorts. This suggests that radiomics has the potential to improve MCE prediction in the future. Additionally, the DCA results demonstrated that this clinical-radiomics model provides a significant net benefit in predicting MCE. Therefore, the clinical-radiomics model can be considered a reliable and reproducible tool to aid treatment decisions. It may be implemented in clinical practice following validation in a larger cohort.
It is crucial to acknowledge the constraints inherent in this research. Initially, the backward-looking aspect of this subject could lead to biases in information and selection. Although the five machine learning algorithms used in this study, namely KNN, Tree, XGB, SVM, and LR, all include strategies for dealing with data imbalance, the applicability of the models still needs to be further confirmed through prospective and multi-center validation with a broader range of samples due to the data set imbalance caused by sample size limitations and the lack of external validation for the constructed models. Additionally, additional studies using CT or Magnetic Resonance Imaging (MRI) brain perfusion imaging might be required for more significant outcomes, given the model’s potential inapplicability to hyperacute AIS patients whose infarct limits are indeterminable by modifying image gray values. Despite its limitations, this study developed a prediction model for MCE by combining radiomics features with clinical features. The proposed model could assist in the prompt and precise prediction of MCE in individuals suffering from acute anterior circulation infarction.
5 Conclusion
In summary, this research offers fresh perspectives on forecasting MCE in cases of ischemic stroke. The findings indicate that the integration of clinical and radiomics signature in machine learning models can precisely predict MCE, aiding in clinical decision-making processes.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving humans were approved by the ethics committee of Chongqing General Hospital. The studies were conducted in accordance with the local legislation and institutional requirements. The ethics committee/institutional review board waived the requirement of written informed consent for participation from the participants or the participants' legal guardians/next of kin because Informed consent was waived for this retrospective analysis because of its retrospective nature.
Author contributions
LZ: Writing – review & editing, Data curation, Formal analysis, Investigation, Software, Writing – original draft. GX: Data curation, Formal analysis, Investigation, Writing – review & editing, Methodology. YZ: Data curation, Formal analysis, Writing – review & editing. JL: Data curation, Writing – review & editing. WT: Formal analysis, Writing – review & editing. LY: Investigation, Writing – review & editing. KL: Data curation, Formal analysis, Investigation, Writing – review & editing.
Funding
The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.
Acknowledgments
We would like to thank the staff of the Radiology Department of Chongqing General Hospital in China for their selfless and invaluable help.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnins.2024.1443486/full#supplementary-material
Abbreviations
MCE, malignant cerebral edema; AIS, acute ischemic stroke; LASSO, the least absolute shrinkage and selection operator; AUC, area under the receiver operating characteristic curve; LR, Logistic regression; CED, cerebral edema; MLS, midline shift; NIHSS, National Institutes of Health Stroke Scale; ASPECTS, Alberta stroke program early CT score; CSF, cerebrospinal fluid; CT, computed tomography; NCCT, non-contrast computed tomography; DWI, diffusion-weighted imaging; FLAIR, fluid-attenuated inversion recovery; CTP, computed tomography perfusion; ML, machine learning; DHC, decompressive hemicraniectomy craniectomy; PACS, picture archiving and communication system; MCA, middle cerebral artery; KNN, K nearest neighbors; ICC, Intraclass Correlation Coefficient; GLCM, gray-level co-occurrence matrix; GLDM, gray-level dependence matrix; GLRLM, gray-level run length matrix; GLSZM, gray-level size zone matrix; NGTDM, neighboring gray-tone difference matrix; Rad-score, radiomics score; SVM, Support Vector Machine; XGB, eXtreme Gradient Boosting; DCA, decision curve analysis; ROC, receiver operating characteristic curve; ROI, region of interest; MRI, Magnetic Resonance Imaging.
Footnotes
References
Abdullahi, W., Tripathi, D., and Ronaldson, P. T. (2018). Blood-brain barrier dysfunction in ischemic stroke: targeting tight junctions and transporters for vascular protection. Am. J. Physiol. Cell Physiol. 315, C343–C356. doi: 10.1152/ajpcell.00095.2018
Aho, K., Harmsen, P., Hatano, S., Marquardsen, J., Smirnov, V. E., and Strasser, T. (1980). Cerebrovascular disease in the community: results of a WHO collaborative study. Bull. World Health Organ. 58, 113–130.
Barber, P. A., Demchuk, A. M., Zhang, J., Kasner, S. E., Hill, M. D., Berrouschot, J., et al. (2003). Computed tomographic parameters predicting fatal outcome in large middle cerebral artery infarction. Cerebrovasc. Dis. 16, 230–235. doi: 10.1159/000071121
Bhatia, A., Birger, M., Veeraraghavan, H., Um, H., Tixier, F., McKenney, A. S., et al. (2019). MRI radiomic features are associated with survival in melanoma brain metastases treated with immune checkpoint inhibitors. Neuro-Oncology 21, 1578–1586. doi: 10.1093/neuonc/noz141
Castellano, G., Bonilha, L., Li, L. M., and Cendes, F. (2004). Texture analysis of medical images. Clin. Radiol. 59, 1061–1069. doi: 10.1016/j.crad.2004.07.008
Dhar, R., Chen, Y., An, H., and Lee, J.-M. (2018). Application of machine learning to automated analysis of cerebral edema in large cohorts of ischemic stroke patients. Front. Neurol. 9:687. doi: 10.3389/fneur.2018.00687
Dhar, R., Yuan, K., Kulik, T., Chen, Y., Heitsch, L., An, H., et al. (2016). CSF volumetric analysis for quantification of cerebral edema after hemispheric infarction. Neurocrit. Care. 24, 420–427. doi: 10.1007/s12028-015-0204-z
Heo, J., Sim, Y., Kim, B. M., Kim, D. J., Kim, Y. D., Nam, H. S., et al. (2024). Radiomics using non-contrast CT to predict hemorrhagic transformation risk in stroke patients undergoing revascularization. Eur. Radiol. 34, 6005–6015. doi: 10.1007/s00330-024-10618-6
Hoffman, H., Wood, J. S., Cote, J. R., Jalal, M. S., Masoud, H. E., and Gould, G. C. (2023). Machine learning prediction of malignant middle cerebral artery infarction after mechanical thrombectomy for anterior circulation large vessel occlusion. J. Stroke Cerebrovasc. Dis. 32:106989. doi: 10.1016/j.jstrokecerebrovasdis.2023.106989
Hofmeijer, J., Kappelle, L. J., Algra, A., Amelink, G. J., van Gijn, J., van der Worp, H. B., et al. (2009). Surgical decompression for space-occupying cerebral infarction (the Hemicraniectomy after middle cerebral artery infarction with life-threatening edema trial [HAMLET]): a multicentre, open, randomised trial. Lancet Neurol. 8, 326–333. doi: 10.1016/S1474-4422(09)70047-X
Hu, H.-J., and Song, M. (2017). Disrupted ionic homeostasis in ischemic stroke and new therapeutic targets. J. Stroke Cerebrovasc. Dis. 26, 2706–2719. doi: 10.1016/j.jstrokecerebrovasdis.2017.09.011
Hua, X., Liu, M., and Wu, S. (2023). Definition, prediction, prevention and management of patients with severe ischemic stroke and large infarction. Chin. Med. J. 136, 2912–2922. doi: 10.1097/CM9.0000000000002885
Huang, Y.-Q., Liang, C.-H., He, L., Tian, J., Liang, C.-S., Chen, X., et al. (2016). Development and validation of a Radiomics nomogram for preoperative prediction of lymph node metastasis in colorectal Cancer. J. Clin. Oncol. 34, 2157–2164. doi: 10.1200/JCO.2015.65.9128
Jo, K., Bajgur, S. S., Kim, H., Choi, H. A., Huh, P.-W., and Lee, K. (2017). A simple prediction score system for malignant brain edema progression in large hemispheric infarction. PLoS One 12:e0171425. doi: 10.1371/journal.pone.0171425
Kim, H., Jin, S. T., Kim, Y. W., Kim, S. R., Park, I. S., and Jo, K. W. (2015). Predictors of malignant brain edema in middle cerebral artery infarction observed on CT angiography. J. Clin. Neurosci. 22, 554–560. doi: 10.1016/j.jocn.2014.08.021
Kim, J. Y., Park, J. E., Jo, Y., Shim, W. H., Nam, S. J., Kim, J. H., et al. (2019). Incorporating diffusion- and perfusion-weighted MRI into a radiomics model improves diagnostic performance for pseudoprogression in glioblastoma patients. Neuro Oncol. 21, 404–414. doi: 10.1093/neuonc/noy133
Liebeskind, D. S., Jüttler, E., Shapovalov, Y., Yegin, A., Landen, J., and Jauch, E. C. (2019). Cerebral edema associated with large hemispheric infarction. Stroke 50, 2619–2625. doi: 10.1161/STROKEAHA.118.024766
Lin, J., Li, X., Wu, G., Chen, X., Weng, Y., Wang, H., et al. (2020). White matter high signals interfere with noncontrast computed tomography in the early identification of cerebral infarction. Cerebrovasc. Dis. 49, 135–143. doi: 10.1159/000505807
Lu, J., Guo, Y., Wang, M., Luo, Y., Zeng, X., Miao, X., et al. (2024). Determining acute ischemic stroke onset time using machine learning and radiomics features of infarct lesions and whole brain. Math. Biosci. Eng. 21, 34–48. doi: 10.3934/mbe.2024002
Luo, H., Li, J., Chen, Y., Wu, B., Liu, J., Han, M., et al. (2024). Feasibility of a clinical-radiomics combined model to predict the occurrence of stroke-associated pneumonia. BMC Neurol. 24:45. doi: 10.1186/s12883-024-03532-3
MacCallum, C., Churilov, L., Mitchell, P., Dowling, R., and Yan, B. (2014). Low Alberta stroke program early CT score (ASPECTS) associated with malignant middle cerebral artery infarction. Cerebrovasc. Dis. 38, 39–45. doi: 10.1159/000363619
Meschia, J. F., and Brott, T. (2018). Ischaemic stroke. Eur. J. Neurol. 25, 35–40. doi: 10.1111/ene.13409
Miles, K. A., Ganeshan, B., and Hayball, M. P. (2013). CT texture analysis using the filtration-histogram method: what do the measurements mean? Cancer Imaging 13, 400–406. doi: 10.1102/1470-7330.2013.9045
Minnerup, J., Wersching, H., Ringelstein, E. B., Heindel, W., Niederstadt, T., Schilling, M., et al. (2011). Prediction of malignant middle cerebral artery infarction using computed tomography-based intracranial volume reserve measurements. Stroke 42, 3403–3409. doi: 10.1161/STROKEAHA.111.619734
Mokin, M., Primiani, C. T., Siddiqui, A. H., and Turk, A. S. (2017). ASPECTS (Alberta stroke program early CT score) measurement using Hounsfield unit values when selecting patients for stroke Thrombectomy. Stroke 48, 1574–1579. doi: 10.1161/STROKEAHA.117.016745
Nawabi, J., Flottmann, F., Kemmling, A., Kniep, H., Leischner, H., Sporns, P., et al. (2021). Elevated early lesion water uptake in acute stroke predicts poor outcome despite successful recanalization - when “tissue clock” and “time clock” are desynchronized. Int. J. Stroke 16, 863–872. doi: 10.1177/1747493019884522
Pham, J., and Ng, F. C. (2024). Novel advanced imaging techniques for cerebral oedema. Front. Neurol. 15:1321424. doi: 10.3389/fneur.2024.1321424
Powers, W. J., Rabinstein, A. A., Ackerson, T., Adeoye, O. M., Bambakidis, N. C., Becker, K., et al. (2019). Guidelines for the early Management of Patients with Acute Ischemic Stroke: 2019 update to the 2018 guidelines for the early Management of Acute Ischemic Stroke: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 50, e344–e418. doi: 10.1161/STR.0000000000000211
Ren, H., Song, H., Wang, J., Xiong, H., Long, B., Gong, M., et al. (2023). A clinical-radiomics model based on noncontrast computed tomography to predict hemorrhagic transformation after stroke by machine learning: a multicenter study. Insights Imaging 14:52. doi: 10.1186/s13244-023-01399-5
Ren, J., Tian, J., Yuan, Y., Dong, D., Li, X., Shi, Y., et al. (2018). Magnetic resonance imaging based radiomics signature for the preoperative discrimination of stage I-II and III-IV head and neck squamous cell carcinoma. Eur. J. Radiol. 106, 1–6. doi: 10.1016/j.ejrad.2018.07.002
Thomalla, G. J., Kucinski, T., Schoder, V., Fiehler, J., Knab, R., Zeumer, H., et al. (2003). Prediction of malignant middle cerebral artery infarction by early perfusion- and diffusion-weighted magnetic resonance imaging. Stroke 34, 1892–1899. doi: 10.1161/01.STR.0000081985.44625.B6
Thorén, M., Azevedo, E., Dawson, J., Egido, J. A., Falcou, A., Ford, G. A., et al. (2017). Predictors for cerebral edema in acute ischemic stroke treated with intravenous thrombolysis. Stroke 48, 2464–2471. doi: 10.1161/STROKEAHA.117.018223
Tracol, C., Vannier, S., Hurel, C., Tuffier, S., Eugene, F., and Le Reste, P. J. (2020). Predictors of malignant middle cerebral artery infarction after mechanical thrombectomy. Rev. Neurol. (Paris) 176, 619–625. doi: 10.1016/j.neurol.2020.01.352
Wang, M., Lin, Y., Gu, F., Xing, W., Li, B., Jiang, X., et al. (2024). Diagnosis of cognitive and motor disorders levels in stroke patients through explainable machine learning based on MRI. Med. Phys. 51, 1763–1774. doi: 10.1002/mp.16683
Wang, H., Sun, Y., Ge, Y., Wu, P.-Y., Lin, J., Zhao, J., et al. (2021). A clinical-Radiomics nomogram for functional outcome predictions in ischemic stroke. Neurol. Ther. 10, 819–832. doi: 10.1007/s40120-021-00263-2
Wen, X., Hu, X., Xiao, Y., and Chen, J. (2023). Radiomics analysis for predicting malignant cerebral edema in patients undergoing endovascular treatment for acute ischemic stroke. Diagn. Interv. Radiol. 29, 402–409. doi: 10.4274/dir.2023.221764
Wu, S., Yuan, R., Wang, Y., Wei, C., Zhang, S., Yang, X., et al. (2018). Early prediction of malignant brain edema after ischemic stroke. Stroke 49, 2918–2927. doi: 10.1161/STROKEAHA.118.022001
Xu, W., Ding, Z., Shan, Y., Chen, W., Feng, Z., Pang, P., et al. (2020). A nomogram model of Radiomics and satellite sign number as imaging predictor for intracranial hematoma expansion. Front. Neurosci. 14:491. doi: 10.3389/fnins.2020.00491
Keywords: ischemic, malignant cerebral edema, radiomics feature, machine learning, prediction
Citation: Zhang L, Xie G, Zhang Y, Li J, Tang W, Yang L and Li K (2024) A CT-based machine learning model for using clinical-radiomics to predict malignant cerebral edema after stroke: a two-center study. Front. Neurosci. 18:1443486. doi: 10.3389/fnins.2024.1443486
Edited by:
Xiangzhi Bai, Beihang University, ChinaReviewed by:
Guangyu Dan, University of Illinois Chicago, United StatesSusan Klapproth, University Medical Center Hamburg-Eppendorf, Germany
Copyright © 2024 Zhang, Xie, Zhang, Li, Tang, Yang and Li. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Kang Li, lkrmyydoctor@126.com