Skip to main content

ORIGINAL RESEARCH article

Front. Neurol., 18 June 2021
Sec. Stroke
This article is part of the Research Topic Leveraging Machine and Deep Learning Technologies for Clinical Applications in Stroke Imaging View all 7 articles

Prediction of Progression to Severe Stroke in Initially Diagnosed Anterior Circulation Ischemic Cerebral Infarction

\nLai WeiLai Wei1Yidi Cao,Yidi Cao2,3Kangwei ZhangKangwei Zhang1Yun XuYun Xu1Xiang ZhouXiang Zhou1Jinxi MengJinxi Meng1Aijun ShenAijun Shen1Jiong NiJiong Ni1Jing YaoJing Yao1Lei Shi,Lei Shi2,3Qi Zhang,,
Qi Zhang2,3,4*Peijun Wang
Peijun Wang1*
  • 1Department of Radiology, Tongji Hospital, Tongji University, Shanghai, China
  • 2Shanghai Key Laboratory of Artificial Intelligence for Medical Image and Knowledge Graph, Shanghai, China
  • 3Institute of Healthcare Research, Shanghai, China
  • 4Shanghai Institute for Advanced Communication and Data Science/School of Communication and Information Engineering, Shanghai University, Shanghai, China

Purpose: Accurate prediction of the progression to severe stroke in initially diagnosed nonsevere patients with acute–subacute anterior circulation nonlacuna ischemic infarction (ASACNLII) is important in making clinical decision. This study aimed to apply a machine learning method to predict if the initially diagnosed nonsevere patients with ASACNLII would progress to severe stroke by using diffusion-weighted images and clinical information on admission.

Methods: This retrospective study enrolled 344 patients with ASACNLII from June 2017 to August 2020 on admission, and 108 cases progressed to severe stroke during hospitalization within 3–21 days. The entire data were randomized into a training set (n = 271) and an independent test set (n = 73). A U-Net neural network was employed for automatic segmentation and volume measurement of the ischemic lesions. Predictive models were developed and used for evaluating the progression to severe stroke using different feature sets (the volume data, the clinical data, and the combination) and machine learning methods (random forest, support vector machine, and logistic regression).

Results: The U-Net showed high correlation with manual segmentation in terms of Dice coefficient of 0.806 and R2 value of the volume measurements of 0.960 in the test set. The random forest classifier of the volume + clinical combination achieved the best area under the receiver operating characteristic curve of 0.8358 (95% CI 0.7321–0.9269), and the accuracy, sensitivity, and specificity were 0.7780 (0.7397–0.7945), 0.7695 (0.6102–0.9074), and 0.8686 (0.6923–1.0), respectively. The Shapley additive explanation diagram showed the volume variable as the most important predictor.

Conclusion: The U-Net was fully automatic and showed a high correlation with manual segmentation. An integrated approach combining clinical variables and stroke lesion volumes that were derived from the advanced machine learning algorithms had high accuracy in predicting the progression to severe stroke in ASACNLII patients.

Introduction

Cerebral ischemic infarction leads to approximately 80% of stroke. The mortality rate in patients with cerebral ischemic infarction, which is one of the major causes of long-term disability globally, is increasing year by year (1, 2). Magnetic resonance imaging (MRI) is one of the most effective methods for assessing patients with ischemic stroke, and diffusion-weighted imaging (DWI), in particular, has the advantages of diagnosing acute ischemic lesion in the early stage (3, 4). It is necessary to analyze multidimensional information including imaging examination, clinical history, and laboratory tests to make an objective and comprehensive assessment of a patient's condition and provide accurate diagnostic evaluations and treatment plans to reduce disabilities and deaths. It is clinically common that part of the acute cerebral infarction progressed to severe stroke during hospitalization. Therefore, it is meaningful to predict the severity progress of patients with acute ischemic stroke, as it might be quite useful in treatment decision-making and management of prognostic expectations (5).

At present, the critical assessment of patients with acute cerebral infarction often depends on the experiences of physicians, in reference of clinical information (general information, medical history, neurological scores, laboratory examinations), and imaging examinations, but such assessment can be subjective. Artificial intelligence (AI) algorithms can effectively process multidimensional medical data (6, 7), and machine learning, which is one of the most popular techniques in the AI area, has been increasingly adopted in the diagnosis and prognosis of stroke (811), such as the automatic segmentation of cerebral infarction lesions, the quantitative analysis of perfusion, and the prediction of stroke prognosis on computed tomography and MRI images. The calculation and prediction results of AI are more reproducible and objective.

Cerebral ischemic stroke is a complicated condition that involves different brain regions and vessels, while anterior circulation ischemic infarction is more common in clinical practice and lacunar infarcts are rare in severe disease condition. Lacunar infarction is small and eventually forms a softened cyst cavity structure, which is often difficult to distinguish from Virchow–Robin spaces. Larger than 15 mm is a giant cavity and even up to 25 mm. The predictive endpoint in our study was the progression to severe stroke, and therefore, we used the following exclusion standard: maximum diameter of infarct ≤ 25 mm.

Therefore, in this study, the initially diagnosed non-severe patients with acute–subacute anterior circulation nonlacuna ischemic infarction (ASACNLII) were included, and machine learning algorithms were employed to predict if non-severe ASACNLII patients would progress to severe stroke during hospitalization.

Methods

Study Population

The initially diagnosed patients with ASACNLII who were admitted to the Tongji Hospital, Shanghai, between June 1, 2017, and August 31, 2020 were retrospectively reviewed. The inclusion criteria were as follows: (1) patients who had brain MRI (including MRI-DWI sequence) within 7 days after the onset of symptoms, (2) patients who underwent DWI imaging for depicting lesions with a maximum diameter of >2.5 cm, and (3) initially diagnosed non-severe patients who were admitted to the hospital for treatment. The criteria for non-severe stroke were as follows: National Institutes of Health Stroke Scale (NIHSS) <17; Glasgow Coma Scale (GCS) >8; no hemodynamic instability, no systemic organ dysfunction, no epilepsy, and no mechanical ventilation; and patients with good quality images without any severe artifacts. A total of 1,237 patients with acute–subacute cerebral infarction were included, and 893 patients were excluded due to posterior cerebral infarction (n = 110), anterior and posterior cerebral infarction (n = 62), anterior lacunar cerebral infarction (n = 534), image artifacts (n = 12), and severe stroke on admission (n = 175). Finally, 344 cases met the enrollment criteria. According to electronic medical records, 108 cases progressed to severe stroke during hospitalization within 3–21 days (Figure 1). The criteria for severe stroke were as follows: NIHSS ≥17, GCS ≤ 8, hemodynamic instability, systemic organ dysfunction, epilepsy, and mechanical ventilation. This study was approved by the institutional review board, and informed consent was exempted due to the retrospective nature of the study. The procedures were performed in accordance with all relevant guidelines and regulations. The subjects were randomly assigned to a training set (n = 271) and a test set (n = 73). The training set was used for training the AI model and the test set for independent evaluation. The training set was also used for 5-fold cross-validation.

FIGURE 1
www.frontiersin.org

Figure 1. Flow chart illustrating patients selection.

Data Collection

The MRI-DWI images were obtained using three different MRI scanners. The acquisition parameters were as follows: (1) Philips Ingenia 3.0 T: TR = 2,584 ms, TE = 96.7 ms, slice thickness = 6 mm, slice spacing = 7 mm, field of view = 23 cm × 23 cm, matrix = 256 × 256, excitation times = 2, echo gap = 0.75 ms, b value = 1,000 s/mm2; (2) Siemens Verio 3.0 T: TR = 4,600 ms, TE = 89 ms, slice thickness = 5 mm, scanning without spacing, field of view = 24 cm × 24 cm, matrix = 256 × 256, echo gap = 0.75 ms, b value = 1,000 s/mm2; and (3) uMR 1.5 T: TR = 5,400 ms, TE = 94 ms, slice thickness = 5 mm, layer spacing = 6 mm, field of view = 23 cm × 23 cm, echo gap = 0.75 ms, b value = 1,000 s/mm2.

The following clinical data were collected: (1) general information: sex and age; (2) medical history: history of smoking, alcohol, diabetes, myocardial infarction, coronary atherosclerosis, atrial fibrillation, hypertension, and stroke; (3) neurological score scale: NIHSS and GCS on admission; and (4) laboratory tests on admission: prothrombin time (PT), fibrinogen, D-dimer, serum troponin I, blood glucose, blood lipids, and plasma brain natriuretic peptide (BNP).

Lesion Segmentation and Volume Measurement on MRI-DWI

Image Segmentation and Labeling

The segmentation task was completed by three junior radiologists (Lai Wei 144 cases; Kangwei Zhang 100 cases; Yun Xu 100 cases), and two senior radiologists refined the segmentation results (Aijun Shen 124 cases; Jiong Ni 120 cases). The radiologists segmented and refined the ischemic lesions on MRI-DWI images with ITK-SNAP software (Version 3.8.0, http://www.itksnap.org). Manual labeling was used as the supervisor or teacher of the AI-based automatic segmentation model.

Image Preprocessing and Augmentation

The DWI image with a b value of 1,000 s/mm2 was normalized to the grayscale range, which was defined by the window width and window level. The images at each cross-section were resampled to a size of 256 × 256 pixels. As the amount of data used to train the model was relatively limited, this study used online data augmentation, which included two parts: (1) morphological transformation: −10°~10° rotation around the z-axis, 0.95~1.05 scaling, −0.1~0.1 times translation along the x and y directions, respectively, and left and right mirror transform with 50% probability; and (2) grayscale transformation: linear contrast transformation of 0.8~1.2 times, brightness change of 0.8~1.2 times, and Gaussian blur with a sigma of 0.5.

U-Net Model and Training

A convolutional neural network model called the U-Net was designed to accomplish the automatic segmentation of cerebral infarction on MRI-DWI images. The U-Net is a popular AI segmentation model in the medical field. Each DWI image was scaled to a size of 256 × 256, and the U-Net has yielded the lesion masks of the same size. The 3D segmentation mask of a lesion was obtained by stacking the masks of all slices.

The U-Net model had a total of four down-sampling convolutional layers and four up-sampling transposed convolutional layers (Figure 2). The feature maps of the same resolution were connected by concatenation to integrate the shallow features and deep features. Cosine annealing scheduler was set as the learning rate strategy, with a period of 50 epochs. The minimal learning rate was set to 0.00001 and the initial learning rate was set as 0.01. Stochastic gradient descent was used as the optimizer in the model, and it had a weight attenuation coefficient of 1e−8 to prevent overfitting. The batch size of the model training was 4, and a total of 200 epochs were adopted for training.

FIGURE 2
www.frontiersin.org

Figure 2. The architecture of the proposed U-net model.

Predictive Model

Predictive Task

The predictive task included those initially diagnosed non-severe patients with ASACNLII who progressed to severe stroke during hospitalization. In this retrospective study, the information with regard to patients who were initially diagnosed and their treatment records were obtained from the electronic medical record system. The enrolled patients were divided into a group of patients who progressed to severe stroke (n = 236) and a group of patients who did not progress to severe stroke (n = 108) according to their medical history. The patients who progressed to severe stroke were all transferred to the neurology intensive care unit (N-ICU) for further treatment according to medical history record.

Development and Validation of the Predictive Model

Based on the patients' clinical data and/or AI-derived volume data, three machine learning models were constructed for binary classification (yes/no for progressing to severe stroke) by using three classifiers, namely, random forest (RF), support vector machine (SVM), and logistic regression (LR).

The input data of the prediction model were one of the three feature sets: (1) AI-derived volume data (1 variable), (2) clinical data (19 variables), and (3) volume + clinical combination (20 variables).

The training phase consisted of two stages. In the first stage, the whole training set was separated into training and validation subsets, in a 5-fold cross-validation manner. The hyperparameters were optimized according to the cross-validation experiments. In the second stage, we applied the optimal hyperparameters on the whole training set to train the models, and the computed metrics on the test set were reported. The procedure was similar to traditional training, validation, and test set separation. The test set did not help on hyperparameter optimization.

Statistical Analysis

Unpaired Student's t-test and chi-square test were used for evaluating significant differences in the variables (such as age, NIHSS score, etc.) between the training set and the test set. The Dice coefficient was used to evaluate the performance of AI-based automatic segmentation. The squared Spearman correlation coefficient (R2) was used to assess the consistency between the lesion volume obtained by AI and the gold standard volume as measured by the radiologists. The receiver operating characteristic curve (ROC) was drawn, and the sensitivity (SEN), specificity (SPE), accuracy (ACC), Youden's index (YI), and the area under the curve (AUC) were calculated for evaluating the model performance.

In addition to the independent evaluation on the test set, the 5-fold cross-validation was also performed on the training set (12). The Shapley additive explanation (SHAP) diagram for the test set was drawn for model explanation. Bootstrapping was used to compute the confidence intervals in the test set. DeLong's method was used to compare the ROCs of different predictive models. A p-value lower than 0.05 was considered to be statistically significant. The segmentation task, the training and validation of the predictive model, as well as the statistical analysis, were all programmed by Python (version 3.6).

Results

Basic Characteristics

As shown in Table 1, the basic variables of most of the patients showed no statistical differences (p > 0.05) between the training set and the test set, such as general conditions (gender and age), medical history (hypertension, diabetes, etc.), neurological score scales (NIHSS and GCS), and laboratory tests (BNP, etc.).

TABLE 1
www.frontiersin.org

Table 1. Basic patient information.

Performance of U-Net

The U-Net achieved highly consistent results of segmentation in the test set when compared with the manual labeling (Figure 3), and the Dice coefficient was 0.806. The correlation coefficient R2 between AI-derived volumes and the manual segmentation volumes was 0.960 (p < 0.0001) (Figure 4A). The grouping by lesion sizes (<100,000 and <30,000 mm3) yielded the R2 values of 0.930 and 0.860, respectively (Figures 4B,C).

FIGURE 3
www.frontiersin.org

Figure 3. Comparison between artificial intelligence (AI)-based segmentation and manual segmentation in three cases of ASACNLII. (A) DWI images. (B) Segmentation results, in which red represents manual labeling results, green the AI output results, and yellow the consistent areas.

FIGURE 4
www.frontiersin.org

Figure 4. The correlation between AI-derived volumes and the manually segmented volumes. The squared correlation coefficients R2 were calculated for all patients (A), patients with lesion sizes <100,000 mm3 (B), and those with lesion sizes <30,000 mm3 (C).

Comparison of Predictive Models

Predictive models were constructed by using the three feature sets (volume data, clinical data, and volume + clinical combination) and the three classifiers (RF, SVM, and LR). The RF classifier-based model using the volume + clinical combination achieved the best predictive classification with an AUC of 0.8358 (95% CI 0.7321–0.9269). Therefore, a comparative analysis was made as follows: (1) fixing the RF classifier and comparing the three feature sets and (2) fixing the combination and comparing the three classifiers.

Comparison Between Different Feature Sets

The AUCs of the models using the RF classifier with the clinical data, the volume data, and the combination on the test set were 0.7686 (0.6474–0.8717), 0.6929 (0.5434–0.8262), and 0.8358 (0.7321–0.9269), respectively (Table 2), which were close to the out-of-bag AUCs of 0.7829, 0.6147, and 0.8110 and the 5-fold cross-validation AUCs of 0.8113, 0.7105, and 0.8291 for the clinical data, the volume data, and the combination, respectively. The predictive model of the combination data showed the highest AUC on the test set when compared with the clinical data (p = 0.036) and AI-derived volume data (p = 0.048) by the DeLong test (Figure 5). The SEN, SPE, and YI of the combination data on the test set have reached 0.7695 (0.6102–0.9074), 0.8686 (0.6923–1.0), and 0.6380 (0.4475–0.8182), respectively.

TABLE 2
www.frontiersin.org

Table 2. Comparison between different feature sets.

FIGURE 5
www.frontiersin.org

Figure 5. Performances of machine learning models for the prediction of progression to severe stroke: receiver operating characteristic (ROC) curves of three feature sets when using the random forest classifier.

Comparison Between Different Classifiers

As shown in Table 3, when fixing the clinical + volume combination, the AUCs of RF, SVM, and LR on the test set were 0.8358 (0.7321–0.9269), 0.8165 (0.6854–0.9344), and 0.8104 (0.6952–0.0.9113), respectively. The ROCs between different classifiers on the test set were compared in pairs, and the results showed no statistical differences (all p > 0.05). The hyperparameter optimization of the three machine learning models was searched out in a cross-validation way, and thus, the hyperparameters were finally set as follows: (1) for SVM, C = 0.01, kernel = “rbf,” degree = 3, gamma = “scale,” probability = True, random_state = 1, decision_function_shape = “ovo,” max_iter = −1, verbose = 1, tol = 0.0001, and class_weight = {0:2, 1:1}; (2) for LR, C = 1, random_state = 1, solver = “lbfgs,” multi_class = “multinomial,” max_iter = 5,000, penalty = “l2,” verbose = 1, and class_weight = {0:181, 1:90}; and (3) for RF, criterion = “entropy,” bootstrap = True, random_state = 1, oob_score = True, n_estimators = 100, max_features = 1, max_depth = 6, min_samples_split = 3, min_samples_leaf = 1, and class_weight = {0:181, 1:90}.

TABLE 3
www.frontiersin.org

Table 3. Comparison between different classifiers.

Model Interpretability

As shown in Figure 6, the SHAP diagram of the above optimal predictive model, namely, the RF classifier with the clinical + volume combination, showed that cerebral infarction volume was the most important predictor in severe stroke progression. The NIHSS and GCS on admission also played an important role in this predictive model, and BNP acted as an important biochemical indicator of severe stroke progression for ASACNLII. In addition, other conventional biochemical indicators and age contributed to the predictive model. However, gender and medical history factors showed slight significance in this predictive model. Moreover, SHAP values for all 73 patients in the test set were shown in Figure 7A. The detailed SHAP values of the most important variables for one typical patient in the positive group (progression to severe stroke) and one in the negative group (non-progression to severe stroke) are illustrated in Figures 7B,C. These figures further demonstrated that the AI-derived volume serves as an essential risk factor for prediction of progression to severe stroke.

FIGURE 6
www.frontiersin.org

Figure 6. Shapley additive explanation (SHAP) diagram of variable contributions for the optimal predictive model, i.e., the random forest classifier with volume + clinical data. (A) The relative contributions of AI-derived volumes and clinical variables for progression prediction. Features on the right of the risk explanation bar pushed the risk higher, and features on the left pushed the risk lower: a patient with a larger volume, higher NIHSS, and lower GCS is at a higher risk. (B) The relative contributions of variables for progression prediction quantified with the mean of the absolute SHAP values.

FIGURE 7
www.frontiersin.org

Figure 7. Shapley additive explanation (SHAP) values to show interpretability of the effects of AI-derived volumes and clinical variables as the input risk factors for the prediction of progression to severe stroke. (A) SHAP values for all 73 patients in the test set. Samples from left to right are ordered by the sum of the SHAP values from all variables, and the bottom bar shows the true labels of each sample, namely, red for the positive group (progression to severe stroke) and blue for the negative group (non-progression to severe stroke). The 27 samples on the left are predicted as positive samples by the random forest model. (B, C) SHAP values of two typical patients from the positive group (B) and the negative group (C), illustrated with their most important variables.

Discussion

Our study used a U-Net deep learning model for lesion segmentation. The Dice coefficient was boosted from 0.680 to 0.790 by diverse data augmentation, and cosine annealing learning rate scheduler was used to further improve the Dice coefficient to 0.806, indicating that the data augmentation method was essential for enhancing the segmentation performance. The high quality of automatic segmentation led to high accuracy of subsequent lesion volume measurement with an R2 value of 0.960. The infarction volumes on DWI were combined with the multidimensional clinical information for more accurate prediction of progression to severe stroke. The results of this study revealed that the lesion volume of ASACNLII was the most important predictor as illustrated in the SHAP diagram and this was consistent with the literature and clinical practice (12, 13). The predictive model of clinical information (AUC = 0.7686) also showed good performance, and the AUC of the predictive model on volume + clinical combination using RF was as high as 0.8358, which was better than the model that used the volume data or clinical data alone (p < 0.05). The difference of AUC was very small between using the AI-predicted volume as a predictor (0.8358) and using the radiologist's volume (0.8387). It was not surprising because the AI-predicted volume was very close to the radiologist's volume (squared correlation coefficient R2 = 0.960).

The three factors that contributed the most were the lesion volume, NIHSS on admission, and GCS on admission, and this was in concordance with the current consensus (1416).

The AI-based segmentation methods of cerebral infarction areas on DWI images were divided into two main categories: (1) the thresholding methods: Lee et al. have reported that the correlation coefficient between the thresholding method of the infarct core area and the gold standard of manual segmentation was 0.62 ± 0.18 (17); Boldsen et al. have developed a thresholding method on DWI for acute anterior circulation stroke with a median Dice coefficient of 0.3951 (18). (2) Deep learning methods: Nishi et al. have reported that the Dice coefficient of the U-Net model of the core infarct area was 0.58 ± 0.01 (19); Kim et al. have reported that the average Dice coefficients of infarct region segmentation based on U-Net for DWI + ADC and DWI were 0.60 and 0.57, respectively (20); and Wu et al. have reported that a deep learning segmentation model achieved a Dice coefficient of 0.86 (0.79–0.89) (9). These previous studies have indicated that the AI methods have increased popularity in DWI lesion segmentation, and the AI algorithms, especially the deep learning approaches, can accurately and automatically trace the lesion border of ischemic stroke.

Imaging findings can be used as an input feature, as well as a supplement to clinical features, for predicting stroke prognosis or outcome. Vogt et al. have reported that the initial lesion volume of cerebral infarction acted as an independent predictor of prognosis (90d-Rankin score) (13). Heo et al. have built a deep learning model of clinical information including general information, medical history, and laboratory tests to predict the prognosis of patients with acute cerebral infarction (yes/no 90d mRS: 0–2), and the area under the ROC curve has reached to 0.81 ± 0.06 (21). Lee et al. have revealed that the prediction of 6-month swallowing recovery was feasible based on clinical and radiological factors using the Bayesian network model, and their study also emphasized the importance of bilateral subcortical lesions as prognostic factors as these could be utilized to develop prediction models for long-term swallowing recovery (22). However, combining both lesion volumes and clinical data for predicting the progression to severe stroke has not yet been reported.

Our study has built a machine learning model to accurately predict the progression to severe stroke in initially diagnosed nonsevere patients with ASACNLII. It is quite essential for treatment planning, preparing transfer to the N-ICU, and effective communication between doctors and patients. A meta-analysis study has shown that the transfer to N-ICU has significantly reduced the mortality and improved the prognosis of stroke patients, while not all patients required transfer to the N-ICU from the perspective of health economics (14). Accurate prediction of progression to severe stroke can provide clinical evidence and help prepare for transfer to the N-ICU in order to obtain better therapeutic efficacy for patients with high risks. In addition, the AI-based predictive model provides a more objective reference for treatment decision, and it would be particularly helpful for the medical staff who do not specialize in stroke.

The data were randomly partitioned into training and test sets in a ratio of 3:1. There were 19 variables in the basic patient information, and it was very difficult to generate random sets which had no significant differences in any of the 19 variables between the training and test sets. Finally, we chose a partition which had no significant differences in 17 of the variables (p > 0.05) and only the history of smoking and the history of alcohol exhibited significant differences (p < 0.05). Previous studies showed that smoking and alcohol use were complicated epidemiological risk factors of stroke. Smoking increased the risk proportionally with the number of cigarettes smoked per day (23), and heavy alcohol use and acute alcohol ingestion increased the risk of stroke, especially hemorrhagic stroke (24). In these studies, the behaviors of smoking and alcohol use were quantified or semiquantified, but in our study, we only retrospectively collected the history of smoking or alcohol as binary variables of medical history information without quantification. Hence, we speculated that these two variables of patient history should have a minor effect on our results of prediction of severe stroke progression.

This study has some limitations. Firstly, the data collection had a single-center geographic limitation, which cannot represent the overall distribution of the disease in a wide range of population. The predictive model was trained and fitted based on the data generated by this particular center. Data from other sources should be collected for external validation. Secondly, this study collected multidimensional data, such as basic information, image information, and clinical information, and this was time-consuming, resulting in a small sample size. However, compared with previous studies with regard to the diagnosis and prediction of cerebral infarction using deep learning technology, the sample size is basically the same (2527). Thirdly, despite high average AUCs, the confidence intervals were relatively large, which showed model instability and needed further fine-tuning on larger datasets to improve its stability. Lastly, when collecting data, lacunar cerebral infarction patients with good prognosis were excluded, which meant that this study did not include all clinically common cases of cerebral infarction.

Conclusions

The U-Net for infarction lesion segmentation is fully automatic and shows a high correlation with manual segmentation. A machine learning approach using both clinical and volume feature sets has demonstrated a high accuracy for the prediction of the progression to severe stroke in initially diagnosed non-severe patients with ASACNLII, and hence, it has good potential for clinical application and guarantees further clinical validation in larger samples.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the Ethics Committee of Tongji Hospital (approval number: K-2020-021). Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author Contributions

PW made substantial contributions to the design of the work. LW, KZ, JM, and JY accomplished the acquisition of data. LW, KZ, and YX finished the segmentation labelling task. AS and JN refined the labelling results. LW, YC, and QZ built the segmentation and predictive models. LW accomplished the analysis, interpretation of the work, and drafted the manuscript. QZ, LS, and PW revised it for important intellectual content. All authors have approved the final version to be published.

Funding

This study was supported by the Science and Technology Commission of Shanghai Municipality (grant no. 19411951400) and the National Natural Science Foundation of China (grant no. 61911530249).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Abbreviations

ASACNLII, acute–subacute anterior circulation nonlacuna ischemic infarction; SHAP, shapley additive explanation; RF, random forest; SVM, support vector machine; LR, logistic regression.

References

1. Lee EJ, Kim YH, Kim N, Kang DW. Deep into the brain: artificial intelligence in stroke imaging. J Stroke. (2017) 19:277–85. doi: 10.5853/jos.2017.02054

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Feng R, Badgeley M, Mocco J, Oermann EK. Deep learning guided stroke management: a review of clinical applications. J Neurointerv Surg. (2018) 10:358–62. doi: 10.1136/neurintsurg-2017-013355

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Murray NM, Unberath M, Hager GD, Hui FK. Artificial intelligence to diagnose ischemic stroke and identify large vessel occlusions: a systematic review. J Neurointerv Surg. (2020) 12:156–64. doi: 10.1136/neurintsurg-2019-015135

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Mayo RC, Leung J. Artificial intelligence and deep learning - radiology's next frontier? Clin Imaging. (2018) 49:87–8. doi: 10.1016/j.clinimag.2017.11.007

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Kamal H, Lopez V, Sheth SA. Machine learning in acute ischemic stroke neuroimaging. Front Neurol. (2018) 9:945. doi: 10.3389/fneur.2018.00945

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Yu J, Shi Z, Lian Y, Li Z, Liu T, Gao Y, et al. Noninvasive idh1 mutation estimation based on a quantitative radiomics approach for grade ii glioma. Eur Radiol. (2016) 27:3509–22. doi: 10.1007/s00330-016-4653-3

PubMed Abstract | CrossRef Full Text | Google Scholar

7. McBee MP, Awan OA, Colucci AT, Ghobadi CW, Kadom N, Kansagra AP, et al. Deep learning in radiology. Acad Radiol. (2018) 25:1472–80. doi: 10.1016/j.acra.2018.02.018

CrossRef Full Text | Google Scholar

8. Chan DK, Cordato D, O'Rourke F, Chan DL, Pollack M, Middleton S, et al. Comprehensive stroke units: a review of comparative evidence and experience. Int J Stroke. (2013) 8:260–4. doi: 10.1111/j.1747-4949.2012.00850.x

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Winzeck S, Giese AK, Hancock BL, Etherton MR, Bouts MJRJ, Donahue K, et al. Big data approaches to phenotyping acute ischemic stroke using automated lesion segmentation of multi-center magnetic resonance imaging data. Stroke. (2019) 50:1734–41. doi: 10.1161/STROKEAHA.119.025373

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Xu Y, Yang X, Huang H, Peng C, Ge Y, Wu H, et al. Extreme gradient boosting model has a better performance in predicting the risk of 90-day readmissions in patients with ischemic stroke. J Stroke Cerebrovasc Dis. (2019) 28:104441. doi: 10.1016/j.jstrokecerebrovasdis.2019.104441

CrossRef Full Text | Google Scholar

11. Badrinarayanan V, Kendall A, Cipolla R. SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell. (2017) 39:2481–95. doi: 10.1109/TPAMI.2016.2644615

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Chen L, Bentley P, Rueckert D. Fully automatic acute ischemic lesion segmentation in DWI using convolutional neural networks. Neuroimage Clin. (2017) 15:633–43. doi: 10.1016/j.nicl.2017.06.016

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Vogt G, Laage R, Shuaib A, Schneider A, Collaboration V. Initial lesion volume is an independent predictor of clinical stroke outcome at day 90: an analysis of the virtual international stroke trials archive (VISTA) database. Stroke. (2012) 43:1266–72. doi: 10.1161/STROKEAHA.111.646570

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Govan L, Langhorne P, Dennis M, Hankey G, Laursen SO. Stroke Unit Trialists' Collaboration. Organized inpatient (stroke Unit) care for stroke. Cochrane Database Syst Rev. (2013) 2013:CD000197. doi: 10.1002/14651858.CD000197

CrossRef Full Text | Google Scholar

15. Tu WJ, Zhao SJ, Xu DJ, Chen H. Serum 25-hydroxyvitamin D predicts the short-term outcomes of Chinese patients with acute ischemic stroke. Clin Sci. (2014) 126:339–46. doi: 10.1042/CS20130284

CrossRef Full Text | Google Scholar

16. Leng T, Xiong ZG. Treatment for ischemic stroke: from thrombolysis to thrombectomy and remaining challenges. Brain Circ. (2019) 5:8. doi: 10.4103/bc.bc_36_18

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Lee H, Jung K, Kang DW, Kim N. Fully automated and real-time volumetric measurement of infarct core and penumbra in diffusion-and perfusion-weighted MRI of patients with hyper-acute stroke. J Digit Imaging. (2019) 33:262–72. doi: 10.1007/s10278-019-00222-2

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Boldsen JK, Engedal TS, Pedraza S, Cho TH, Thomalla G, Nighoghossian N, et al. Better diffusion segmentation in acute ischemic stroke through automatic tree learning anomaly segmentation. Front Neuroinform. (2018) 12:21. doi: 10.3389/fninf.2018.00021

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Nishi H, Oishi N, Ishii A, Ono I, Ogura T, Sunohara T, et al. Deep learning-derived high-level neuroimaging features predict clinical outcomes for large vessel occlusion. Stroke. (2020) 51:1484–92. doi: 10.1161/STROKEAHA.119.028101

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Kim YC, Lee JE, Yu I, Song HN, Baek IY, Seong JK, et al. Evaluation of diffusion lesion volume measurements in acute ischemic stroke using encoder-decoder convolutional network. Stroke. (2019) 50:1444–51. doi: 10.1161/STROKEAHA.118.024261

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Heo J, Yoon JG, Park H, Kim YD, Nam HS, Heo JH. Machine learning-based model for prediction of outcomes in acute stroke. Stroke. (2019) 50:1263–5. doi: 10.1161/STROKEAHA.118.024293

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Lee WH, Lim MH, Seo HG, Seong MY, Oh BM, Kim S. Development of a novel prognostic model to predict 6-month swallowing recovery after ischemic stroke. Stroke. (2020) 51:440–8. doi: 10.1161/STROKEAHA.119.027439

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Meredith G, Rudd A. Reducing the severity of stroke. Postgrad Med J. (2019) 95:271–8. doi: 10.1136/postgradmedj-2018-136157

CrossRef Full Text | Google Scholar

24. Isabel C, Calvet D, Mas JL. Stroke prevention. Presse Med. (2016) 45:e457–71. doi: 10.1016/j.lpm.2016.10.009

CrossRef Full Text | Google Scholar

25. Chung CC, Hong CT, Huang YH, Su EC, Chan L, et al. Predicting major neurologic improvement and long-term outcome after thrombolysis using artificial neural networks. J Neurol Sci. (2020) 410:116667. doi: 10.1016/j.jns.2020.116667

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Qiu W, Kuang H, Teleg E, Ospel JM, Sohn SI, Almekhlafi M, et al. Machine learning for detecting early infarction in acute stroke with non-contrast-enhanced CT. Radiology. (2020) 294:638–44. doi: 10.1148/radiol.2020191193

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Lee H, Lee EJ, Ham S, Lee HB, Lee JS, Kwon SU, et al. Machine learning approach to identify stroke within 4.5 Hours. Stroke. (2020) 51:860–66. doi: 10.1161/STROKEAHA.119.027611

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: ischemic infarction, stroke volume, artificial intelligence, machine learning, severe stroke prediction

Citation: Wei L, Cao Y, Zhang K, Xu Y, Zhou X, Meng J, Shen A, Ni J, Yao J, Shi L, Zhang Q and Wang P (2021) Prediction of Progression to Severe Stroke in Initially Diagnosed Anterior Circulation Ischemic Cerebral Infarction. Front. Neurol. 12:652757. doi: 10.3389/fneur.2021.652757

Received: 13 January 2021; Accepted: 10 May 2021;
Published: 18 June 2021.

Edited by:

Mauricio Reyes, University of Bern, Switzerland

Reviewed by:

Lucas Alexandre Ramos, Academic Medical Center, Netherlands
Wen-Jun Tu, Chinese Academy of Medical Sciences and Peking Union Medical College, China

Copyright © 2021 Wei, Cao, Zhang, Xu, Zhou, Meng, Shen, Ni, Yao, Shi, Zhang and Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Peijun Wang, dG9uZ2ppcGp3YW5nMTk2MCYjeDAwMDQwOzE2My5jb20=; Qi Zhang, cWl6aGFuZy5mZHUmI3gwMDA0MDtnbWFpbC5jb20=

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.