- 1Beijing Tiantan Hospital, Capital Medical University, Beijing, China
- 2CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China
- 3School of Electronics and Information, Xi'an Polytechnic University, Xi'an, China
- 4Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Medicine, Beihang University, Beijing, China
- 5Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, China
- 6School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
- 7Department of Molecular Pathology, Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
- 8Center of Brain Tumor, Beijing Institute for Brain Disorders, Beijing, China
- 9China National Clinical Research Center for Neurological Diseases, Beijing, China
Purpose: The majority of patients with low-grade gliomas (LGGs) experience tumor-related epilepsy during the disease course. Our study aimed to build a radiomic prediction model for LGG-related epilepsy type based on magnetic resonance imaging (MRI) data.
Methods: A total of 205 cases with LGG-related epilepsy were enrolled in the retrospective study and divided into training and validation cohorts (1:1) according to their surgery time. Seven hundred thirty-four radiomic features were extracted from T2-weighted imaging, including six location features. Pearson correlation coefficient, univariate area under curve (AUC) analysis, and least absolute shrinkage and selection operator regression were adopted to select the most relevant features for the epilepsy type to build a radiomic signature. Furthermore, a novel radiomic nomogram was developed for clinical application using the radiomic signature and clinical variables from all patients.
Results: Four MRI-based features were selected from the 734 radiomic features, including one location feature. Good discriminative performances were achieved in both training (AUC = 0.859, 95% CI = 0.787–0.932) and validation cohorts (AUC = 0.839, 95% CI = 0.761–0.917) for the type of epilepsy. The accuracies were 80.4 and 80.6%, respectively. The radiomic nomogram also allowed for a high degree of discrimination. All models presented favorable calibration curves and decision curve analyses.
Conclusion: Our results suggested that the MRI-based radiomic analysis may predict the type of LGG-related epilepsy to enable individualized therapy for patients with LGG-related epilepsy.
Introduction
World Health Organization (WHO) grade II or low-grade glioma (LGG) (1) accounts for the majority of primary brain tumors in young adults (2, 3). The majority of patients with LGG experiences tumor-related epilepsy (4, 5) that impacts their quality of life and may contribute to long-term disability (6–8). Broadly, the type of epilepsy can be generalized or focal based on its presentation (9) and require different methods of treatment. Generalized epilepsy occurs more frequently, is more severe, and requires a relatively higher dose of antiepileptic therapy with the potential for increased side effects, compared to focal epilepsy. An accurate prediction of epilepsy type that occurs in patients with brain tumors could allow customization of antiepileptic therapy.
Radiomics is a research branch in the field of medical imaging (10). Based on the rapid development of machine learning and image processing techniques, radiomic analyses have been successfully applied in the field of oncology (11–16), including glioma (17). Magnetic resonance imaging (MRI) is a routinely used diagnostic tool for glioma management. A lot of tumor information that is not recognized by human eye remains unmined (12). Radiomics can extract high-dimensional radiomic features from medical images to fully exploit the in-depth information of tumors (18). Based on T2-weighted imaging (T2WI), Liu et al. successfully predicted the occurrence of LGG-associated epilepsy by radiomic analysis (19). However, the prediction of the type of epilepsy remains to be determined.
The current study conducted a radiomic analysis to explore the relationship between quantitative radiomic features and the type of tumor-related epilepsy in patients with LGG. Precise radiomic prediction models for epilepsy type could be established and further validated using the screened features.
Methods
Patients
In this retrospective study, we consecutively enrolled a total of 205 patients with LGG who underwent surgery at the Beijing Tiantan Hospital from September 2012 to December 2014. The inclusion criteria of all enrolled cases were (a) pathologically confirmed grade II gliomas according to WHO criteria 2016 (20) and (b) presurgical T2-weighted imaging. The exclusion criteria of all enrolled cases were no craniotomy or stereotactic biopsy before MRI scan. The enrolled cases were allocated to either the training or the validation cohort according to the surgery time with a 1:1 ratio, i.e., the first 102 cases enrolled formed the training cohort, and the other 103 cases formed the validation cohort. Data on routine clinical variables were collected, including age, gender, tumor pathology, and epilepsy type. The present study further utilized clinical and MRI data from all enrolled cases. The ethics committee of Beijing Tiantan Hospital approved this study, and the requirement for informed consent was waived. Our study was conducted in accordance with the Declaration of Helsinki. The study design is illustrated in Figure 1.
Patients were considered to have experienced tumor-related epilepsy when a history of at least one seizure with the presence of an enduring alteration (i.e., LGG) in the brain (21) was reported. The history and type (generalized and focal) of epilepsy were evaluated by an epileptologist based on the patient's presentation according to the classification and terminology of the International League Against Epilepsy (9, 22). The epilepsy type was determined consistently for all the enrolled patients with a history of epilepsy based on the aforementioned criteria.
Brain MRI and Tumor Segmentation
All MRI examinations were performed using a Magnetom Trio 3.0 T scanner (Siemens, Erlangen, Germany) with a 12-channel receive-only head coil scan acquisition. The T2WI parameters were as follows: repetition time (TR), 5,800 ms; echo time (TE), 110 ms; flip angle, 150°; the field of view (FOV), 240 × 188 mm2; voxel size, 0.6 × 0.6 × 5.0 mm3; and matrix, 384 × 300. The MRI data were stored in DICOM format.
Regions of interest (ROIs) of the gliomas were drawn by two neuroradiologists with more than 5 years of clinical experience with ITK-snap (www.itksnap.org). The neuroradiologists were blinded to each other's results. Gliomas were segmented on each MRI slice. We defined ROIs of the LGGs as areas of the MRI images that exhibited abnormal hyperintense signals. The intraclass correlation coefficient (ICC) was used to assess whether the segmentation results of the two doctors were significantly different. No difference was defined as ICC >0.8. In the absence of a difference, each patient would obtain a segmentation result from one of the two neuroradiologists randomly.
Extraction of Quantitative Radiomic Features
A total of 734 radiomic features were extracted based on the research of Liu et al. (19) and Li et al. (23, 24), including 6 location features, 17 first order statistics (FOS) features, 8 shape and size features, 26 gray-level co-occurrence matrix (GLCM) features, 16 gray-level run-length matrix (GLRLM) features, 16 gray-level size zone matrix (GLSZM) features, 5 neighborhood gray-tone difference matrix (NGTDM) features, and 640 wavelet features.
The location features were extracted based on our previous research (19) using (a) polar coordinates parameters (r, θ, and Φ) based on the centroid of the tumor, and (b) City Block distance, (c) Chebyshev distance, and (d) Euclidean distance from the anterior commissure (AC) to the centroid of the tumor. The FOS features reflected the distribution of voxel values within the ROI 3D matrix and the overall information of the tumor. The shape and size features reflected the volume, surface area, and shape of the tumor. GLCM, GLRLM, GLSZM, and NGTDM were collectively referred to as texture features. The GLCM reflected the arrangement of voxels. The GLRLM reflected the arrangement of voxels with equal voxel values. The GLSZM reflected the characteristics of the homogeneous region. The NGTDM reflected the difference between each voxel in the ROI and the adjacent voxels. The wavelet features were calculated by FOS, GLCM, GLRLM, GLSZM, and NGTDM features through Coiflet 1 3D wavelet transform. The detailed information and formulas for the detection of the 734 features were published in our previous researches (19, 24).
Feature Selection and Radiomic Signature Building
The 734 radiomic features were normalized before feature selection using the z-score method. A univariate analysis was used to screen the radiomic features. The criteria for screening features include (a) p-values of Pearson correlation coefficient <0.05 and (b) area under curve (AUC) of the radiomic features >0.6. Least absolute shrinkage and selection operator (LASSO) regression was widely used to compress the coefficients of features and select features to prevent overfitting. Logistic regression was used for data classification to build a reliable prediction model. Thereafter, LASSO and logistic regression were used to calculate the radiomic signature for epilepsy-type prediction using Glmnet package (25). Features dimension reduction and selection, i.e., univariate analyses and LASSO regression, were based on the training cohort. The optimal value of the LASSO's parameter λ was determined by leave-one-out cross-validation (LOOCV) using classification error as criterion during the training phase. We calculated the radiomic signature for the patients after determining the selected features' values using the optimal value of the LASSO's parameter λ. Radiomic signature was the linear weighting of the selected features' coefficients. Radiomic analyses of the study were implemented by MATLAB R2016a (MathWorks, Natick, MA).
Development of an Individualized Prediction Model
Based on cohort of all patients, a multivariable logistic regression analysis was built to predict epilepsy type with clinical information, using the radiomic signature, age, gender, and tumor pathology. Akaike's information criterion was used to select the indicator with the predictive ability for building the multivariable logistic regression model (26, 27). With this radiomics-based model, we also built a novel radiomic nomogram for quantitative prediction of the epilepsy type (28).
Performance Evaluation of the Models
The classification performance of the radiomic signature and radiomic nomogram was assessed by the receiver operating characteristic (ROC) curves and AUCs in each cohort. Calibration curves were plotted to assess the calibration of the radiomic signature and radiomic nomogram (29), accompanied by the Hosmer–Lemeshow test (30). Decision curve analyses (DCAs) determined the clinical usefulness of the radiomic signature and radiomic nomogram by quantifying the net benefits at different threshold probabilities in cohort of all patients (31).
Statistical Analysis
Age and radiomic signature were reported as median and range. The differences between subgroups were assessed by independent samples t-test. Gender and histopathology were reported in frequencies and proportions, and differences between subgroups were assessed by Fisher's exact test. The statistical tests were two sided, and p < 0.05 were defined as significant. Nomogram building and models' validation were implemented with R software (version 3.6.1, Vienna, Austria).
Results
Demographic and Clinical Data
The main clinical and pathological characteristics of all 205 patients are listed in Table 1. Of the 205 enrolled patients, 139 (67.8%) had generalized and 66 (32.2%) had focal seizures. Those with generalized epilepsy accounted for 72 (70.6%) and 67 (65.0%) patients, while those with focal epilepsy accounted for 30 (29.4%) and 36 (35.0%) patients in the training and validation cohorts, respectively. There were no significant differences between the two epilepsy types based on age, gender, and tumor histopathology in cohort of all patients, training cohort, and validation cohort. However, radiomic signature was significantly different between the two epilepsy types (p < 0.001) and hence a potential indicator for diagnosing the types of epilepsy.
Performance of Radiomic Signature
Based on the training cohort, a logistic regression prediction model was constructed by integrating the four key radiomic features selected using the univariate analyses and LASSO regression (Table 2). The parameter λ = 0.067 was used as the optimal value. The radiomic signature for each patient in both cohorts was calculated with the train-based model. The predictive ability of the radiomic signature was interpreted from the ROC curve (Figure 2A), where it achieved a performance with classification accuracy = 80.4%, AUC = 0.859 [95% confidence interval (CI), 0.787–0.932] in the training cohort and classification accuracy = 80.6%, AUC = 0.839 (95% CI, 0.761–0.917) in the validation cohort. The radiomic signature demonstrated favorable calibration in the training and validation cohorts (Figure 2B). The p-values of the Hosmer–Lemeshow test for classification predictive ability of the radiomic signature were 0.12 and 0.10, respectively. The DCA showed that using radiomic signature to predict epilepsy type adds more benefit than either the treat-all-patients scheme or the treat-none scheme (Figure 2C).
Figure 2. Receiver operating characteristic (ROC) curves, calibration curves, and decision curve analyses of models. (A) ROC curves and (B) calibration curves of the radiomic signature in training and validation cohorts. (C) Decision curve analysis of the radiomic signature. (D) ROC curve and (E) calibration curve of the radiomic nomogram in all patients' cohort. (F) Decision curve analysis of the radiomic nomogram.
Performance of Radiomic Nomogram
Radiomic nomogram for epilepsy type prediction was developed based on the radiomic signature, age, and tumor pathology data (Figure 3). It showed excellent performance in predicting epilepsy type with AUC = 0.863 (95% CI, 0.810–0.916) in cohort of all patients (Figure 2D). The calibration curve and DCA of the radiomic nomogram for the epilepsy type prediction also demonstrated favorable results (Figures 2E,F). The p-value of the Hosmer–Lemeshow test was 0.11.
Figure 3. Radiomic nomogram for prediction of epilepsy type. The radiomic-based nomogram was built using radiomics signature, age, and tumor pathology data.
Discussion
This study develops and presents a quantitative and individualized epilepsy type radiomic prediction model using a series of radiomic T2-weighted imaging features associated with the type of LGG-related epilepsy. The results demonstrate that the MRI-based radiomic model could successfully stratify patients according to their epilepsy type. This easy-to-use nomogram may be a powerful clinical tool for assisting clinicians with personalized therapeutic decisions.
Treatment based on the type of LGG-related epilepsy allows for a more targeted use of antiepileptic drugs, thus minimizing therapy-related side effects in patients with LGG. However, determining the epilepsy type based on its clinical presentation imposes an apparent lag. Thus, there is a need for a clinical model capable of predicting epilepsy type before treatment initiation. In this study, a newly developed radiomic signature and radiomic nomogram predict the epilepsy type for each patient in the study. Thus, patients identified as either generalized or focal epilepsy are subjected to appropriate therapies. Therefore, the radiomic signature and radiomic nomogram provided clinicians with a reliable tool for better prediction of LGG-related epilepsy type.
For the better prediction of epilepsy type, a large number of high-throughput radiomic features that were widely used in previous radiomics studies (18) were also extracted in this study, including location features designed for brain tumor studies by Liu et al. (19). Specifically, we extracted many high-dimensional features that are intuitively challenging to be recognized by humans. Radiomic features provide abundant information on the heterogeneity and microenvironments of gliomas (32), including reliable information for its personalized treatment (33). The use of radiomics-based research in the field of oncology has indisputably impacted the survival outcomes (34, 35), lymph node metastasis (36), and treatment responses (37–39).
Furthermore, based on the quantitative MRI features, radiomic analyses have the ability to assess the clinical characteristics and molecular background of gliomas (40, 41). Therefore, this study further suggests the associations of these radiomics-based MRI features with the type of LGG-related epilepsy.
Tumor location is an influential factor associated with LGG-related epilepsy. Several MRI-based studies indicate the association between the involvement of eloquent (42), cortical (45), and insular regions (43) with epilepsy occurrence, along with the probabilistic risk atlas of LGG-related epilepsy (44). However, there is a need to investigate and predict the type of epilepsy. Furthermore, previous studies not only used the location information as categorized data but also ignored the imaging information inside the tumor area. Since various subregions of a brain lobe may differently influence the occurrence of epilepsy type, we used a quantitative description of tumor location for brain tumors. The distances from the AC to the centroid and the polar coordinates based on centroid of the tumor accurately described tumor location. These location features provide more detailed information for the radiomic prediction models in the current study.
LASSO and logistic regression are widely accepted algorithms in the field of machine learning. In this study, the 734 features extracted could cause overfitting when building the radiomic prediction model, which makes the model lose its generalization ability. Therefore, we performed feature dimension reduction and selection to detect the key features most closely related to the type of epilepsy to improve the discriminative power in the present model. The LASSO regression was used to achieve the best performance in predicting the type of LGG-related epilepsy. With features associated with epilepsy type, a prediction model was constructed using logistic regression. As a sensitive and stable machine learning method for dichotomous forecast, logistic regression has been widely used in feature-based classification. In the current study, the application of LASSO and logistic regression raises the predictive capability of the established model and consequently provided relatively high discrimination accuracies and AUCs.
There are some limitations to the present study. First, the diagnoses provided by experienced epileptologists was based on clinical presentations, and patient's epilepsy originations were unconfirmed because the stereotactic electroencephalographic data were incomplete. Second, the divergence of tumor histopathology in causing various types of epilepsy was not quantitatively assessed by the radiomic model in this study. Third, a multicenter, prospective clinical trial is required to address the limitation caused by small samples. Fourth, the interpretability of radiomic features has always been an intractable task in the study of radiomics.
Conclusions
Radiomic location features and wavelet-based textural features are associated with the type of LGG-related epilepsy. Radiomics-based prediction models allow for non-invasive, preoperative, and low-cost prediction of epilepsy type. The results of this study suggest that radiomics could be a reliable tool for personalized treatment in patients with LGG-related epilepsy.
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.
Ethics Statement
The ethics committee of Beijing Tiantan Hospital approved this study, and the requirement for informed consent was waived. Our study was conducted in accordance with the Declaration of Helsinki.
Author Contributions
YW, WW, ZL, TJ, and JT conceived of and designed the study. YW, WW, ZL, YLia, XL, YLi, ZT, and TJ collected and assembled all data. YW, WW, and ZL performed data analysis. WW, ZL, and YLia wrote the manuscript. YW revised the manuscript. All authors approved of the final manuscript.
Funding
This research was supported by the National Natural Science Foundation of China (81772012, 81922040, 81227901, and 61231004), the National Key R&D Program of China (2017YFA0205200, 2016YFA0100900, and 2016YFA0100902), the Beijing Municipal Natural Science Foundation (7182109), and the Youth Innovation Promotion Association CAS (2019136).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors would like to acknowledge the instrumental and technical support of the multimodal biomedical imaging experimental platform at the Chinese Academy of Sciences Institute of Automation.
Abbreviations
AC, anterior commissure; AUC, area under curve; DCA, decision curve analysis; DICOM, Digital Imaging and Communications in Medicine; FOS, first-order statistics; GLCM, gray-level co-occurrence matrix; GLRLM, gray-level run-length matrix; GLSZM, gray-level size zone matrix; IBE, International Bureau for Epilepsy; ICC, intraclass correlation coefficient; ILAE, International League Against Epilepsy; LASSO, least absolute shrinkage and selection operator; LGG, low-grade glioma; LOOCV, leave one out cross-validation; MRI, magnetic resonance imaging; NGTDM, neighborhood gray-tone difference matrix; ROC, receiver operating characteristic; ROI, region of interest; WHO, World Health Organization
References
1. Scheithauer BW, Fuller GN, VandenBerg SR. The 2007 WHO classification of tumors of the nervous system: controversies in surgical neuropathology. Brain Pathol. (2008) 18:307–16. doi: 10.1111/j.1750-3639.2008.00179.x
2. Schiff D. Molecular profiling optimizes the treatment of low-grade glioma. Neuro Oncol. (2016) 18:1593–4. doi: 10.1093/neuonc/now262
3. Avila EK, Chamberlain M, Schiff D, Reijneveld JC, Armstrong TS, Ruda R, et al. Seizure control as a new metric in assessing efficacy of tumor treatment in low-grade glioma trials. Neuro Oncol. (2017) 19:12–21. doi: 10.1093/neuonc/now190
4. van Breemen MS, Wilms EB, Vecht CJ. Epilepsy in patients with brain tumours: epidemiology, mechanisms, and management. Lancet Neurol. (2007) 6:421–30. doi: 10.1016/S1474-4422(07)70103-5
5. Chang EF, Potts MB, Keles GE, Lamborn KR, Chang SM, Barbaro NM, et al. Seizure characteristics and control following resection in 332 patients with low-grade gliomas. J Neurosurg. (2008) 108:227–35. doi: 10.3171/JNS/2008/108/2/0227
6. Maschio M, Dinapoli L. Patients with brain tumor-related epilepsy. J Neurooncol. (2012) 109:1–6. doi: 10.1007/s11060-012-0867-7
7. Weller M, Stupp R, Wick W. Epilepsy meets cancer: when, why, and what to do about it? Lancet Oncol. (2012) 13:e375–82. doi: 10.1016/S1470-2045(12)70266-8
8. Shan X, Fan X, Liu X, Zhao Z, Wang Y, Jiang T. Clinical characteristics associated with postoperative seizure control in adult low-grade gliomas: a systematic review and meta-analysis. Neuro Oncol. (2018) 20:324–31. doi: 10.1093/neuonc/nox130
9. Fisher RS, Cross JH, French JA, Higurashi N, Hirsch E, Jansen FE, et al. Operational classification of seizure types by the International League Against Epilepsy: Position Paper of the ILAE Commission for Classification and Terminology. Epilepsia. (2017) 58:522–30. doi: 10.1111/epi.13670
10. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RG, Granton P, et al. Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer. (2012) 48:441–6. doi: 10.1016/j.ejca.2011.11.036
11. Lambin P, Leijenaar RTH, Deist TM, Peerlings J, de Jong EEC, van Timmeren J, et al. Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol. (2017) 14:749–62. doi: 10.1038/nrclinonc.2017.141
12. Bi WL, Hosny A, Schabath MB, Giger ML, Birkbak NJ, Mehrtash A, et al. Artificial intelligence in cancer imaging: clinical challenges and applications. CA Cancer J Clin. (2019) 69:127–57. doi: 10.3322/caac.21552
13. Lei C, Wei W, Liu Z, Xiong Q, Yang C, Yang M, et al. Mammography-based radiomic analysis for predicting benign BI-RADS category 4 calcifications. Eur J Radiol. (2019) 121:108711. doi: 10.1016/j.ejrad.2019.108711
14. Liu ZY, Wang S, Dong D, Wei JW, Fang C, Zhou XZ, et al. The applications of radiomics in precision diagnosis and treatment of oncology: opportunities and challenges. Theranostics. (2019) 9:1303–22. doi: 10.7150/thno.30309
15. Wei W, Liu Z, Rong Y, Zhou B, Bai Y, Wei W, et al. A computed tomography-based radiomic prognostic marker of advanced high-grade serous ovarian cancer recurrence: a multicenter study. Front Oncol. (2019) 9:255. doi: 10.3389/fonc.2019.00255
16. Wei W, Wang K, Liu Z, Tian K, Wang L, Du J, et al. Radiomic signature: a novel magnetic resonance imaging-based prognostic biomarker in patients with skull base chordoma. Radiother Oncol. (2019) 141:239–46. doi: 10.1016/j.radonc.2019.10.002
17. Xi YB, Guo F, Xu ZL, Li C, Wei W, Tian P, et al. Radiomics signature: a potential biomarker for the prediction of MGMT promoter methylation in glioblastoma. J Magn Reson Imag. (2018) 47:1380–7. doi: 10.1002/jmri.25860
18. Aerts HJWL, Velazquez ER, Leijenaar RTH, Parmar C, Grossmann P, Carvalho S, et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. (2014) 5:4006. doi: 10.1038/ncomms5006
19. Liu Z, Wang Y, Liu X, Du Y, Tang Z, Wang K, et al. Radiomics analysis allows for precise prediction of epilepsy in patients with low-grade gliomas. NeuroImage Clin. (2018) 19:271–8. doi: 10.1016/j.nicl.2018.04.024
20. Louis DN, Perry A, Reifenberger G, von Deimling A, Figarella-Branger D, Cavenee WK, et al. The 2016 World Health Organization classification of tumors of the central nervous system: a summary. Acta Neuropathol. (2016) 131:803–20. doi: 10.1007/s00401-016-1545-1
21. Fisher RS, van Emde Boas W, Blume W, Elger C, Genton P, Lee P, et al. Epileptic seizures and epilepsy: definitions proposed by the International League Against Epilepsy (ILAE) and the International Bureau for Epilepsy (IBE). Epilepsia. (2005) 46:470–2. doi: 10.1111/j.0013-9580.2005.66104.x
22. (1981). Proposal for revised clinical and electroencephalographic classification of epileptic seizures. From the Commission on Classification and Terminology of the International League Against Epilepsy. Epilepsia 22:489–501. doi: 10.1111/j.1528-1157.1981.tb06159.x
23. Li L, Mu W, Wang Y, Liu Z, Liu Z, Wang Y, et al. A non-invasive radiomic method using 18F-FDG PET predicts isocitrate dehydrogenase genotype and prognosis in patients with glioma. Front Oncol. (2019) 9:1183. doi: 10.3389/fonc.2019.01183
24. Li L, Wang K, Ma X, Liu Z, Wang S, Du J, et al. Radiomic analysis of multiparametric magnetic resonance imaging for differentiating skull base chordoma and chondrosarcoma. Eur J Radiol. (2019) 118:81–7. doi: 10.1016/j.ejrad.2019.07.006
25. Tibshirani R, Bien J, Friedman J, Hastie T, Simon N, Taylor J, et al. Strong rules for discarding predictors in lasso-type problems. J R Stat Soc Series B Stat Methodol. (2012) 74:245–66. doi: 10.1111/j.1467-9868.2011.01004.x
26. Sauerbrei W, Boulesteix AL, Binder H. Stability investigations of multivariable regression models derived from low- and high-dimensional data. J Biopharm Stat. (2011) 21:1206–31. doi: 10.1080/10543406.2011.629890
27. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement. Eur Urol. (2015) 67:1142–51. doi: 10.1016/j.eururo.2014.11.025
28. Iasonos A, Schrag D, Raj GV, Panageas KS. How to build and interpret a nomogram for cancer prognosis. J Clin Oncol. (2008) 26:1364–70. doi: 10.1200/Jco.2007.12.9791
29. Stallard N. Simple tests for the external validation of mortality prediction scores. Stat Med. (2009) 28:377–88. doi: 10.1002/sim.3393
30. Kramer AA, Zimmerman JE. Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Crit Care Med. (2007) 35:2052–6. doi: 10.1097/01.Ccm.0000275267.64078.B0
31. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. (2006) 26:565–74. doi: 10.1177/0272989X06295361
32. Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data. Radiology. (2016) 278:563–77. doi: 10.1148/radiol.2015151169
33. Lambin P, van Stiphout RG, Starmans MH, Rios-Velazquez E, Nalbantov G, Aerts HJ, et al. Predicting outcomes in radiation oncology—multifactorial decision support systems. Nat Rev Clin Oncol. (2013) 10:27–40. doi: 10.1038/nrclinonc.2012.196
34. Kim JY, Park JE, Jo Y, Shim WH, Nam SJ, Kim JH, et al. Incorporating diffusion- and perfusion-weighted MRI into a radiomics model improves diagnostic performance for pseudoprogression in glioblastoma patients. Neuro Oncol. (2018) 21:404–4. doi: 10.1093/neuonc/noy133
35. Wang S, Liu Z, Rong Y, Zhou B, Bai Y, Wei W, et al. Deep learning provides a new computed tomography-based prognostic biomarker for recurrence prediction in high-grade serous ovarian cancer. Radiother Oncol. (2019) 132:171–7. doi: 10.1016/j.radonc.2018.10.019
36. Shen C, Liu Z, Wang Z, Guo J, Zhang H, Wang Y, et al. Building CT radiomics based nomogram for preoperative esophageal cancer patients lymph node metastasis prediction. Transl Oncol. (2018) 11:815–24. doi: 10.1016/j.tranon.2018.04.005
37. Grossmann P, Narayan V, Chang K, Rahman R, Abrey L, Reardon DA, et al. Quantitative imaging biomarkers for risk stratification of patients with recurrent glioblastoma treated with bevacizumab. Neuro Oncol. (2017) 19:1688–97. doi: 10.1093/neuonc/nox092
38. Liu ZY, Zhang XY, Shi YJ, Wang L, Zhu HT, Tang ZC, et al. Radiomics analysis for evaluation of pathological complete response to neoadjuvant chemoradiotherapy in locally advanced rectal cancer. Clin Cancer Res. (2017) 23:7253–62. doi: 10.1158/1078-0432.CCR-17-1038
39. Liu Z, Li Z, Qu J, Zhang R, Zhou X, Li L, et al. Radiomics of multi-parametric MRI for pretreatment prediction of pathological complete response to neoadjuvant chemotherapy in breast cancer: a multicenter study. Clin Cancer Res. (2019). doi: 10.1158/1078-0432.CCR-18-3190
40. Gevaert O, Mitchell LA, Achrol AS, Xu J, Echegaray S, Steinberg GK, et al. Glioblastoma Multiforme: Exploratory Radiogenomic Analysis by Using Quantitative Image Features. Radiology. (2015) 276:313. doi: 10.1148/radiol.2015154019
41. Itakura H, Achrol AS, Mitchell LA, Loya JJ, Liu T, Westbroek EM, et al. Magnetic resonance image features identify glioblastoma phenotypic subtypes with distinct molecular pathway activities. Sci Transl Med. (2015) 7:303ra138. doi: 10.1126/scitranslmed.aaa7582
42. Pallud J, Audureau E, Blonski M, Sanai N, Bauchet L, Fontaine D, et al. Epileptic seizures in diffuse low-grade gliomas in adults. Brain. (2014) 137:449–62. doi: 10.1093/brain/awt345
43. Lee JW, Wen PY, Hurwitz S, Black P, Kesari S, Drappatz J, et al. Morphological characteristics of brain tumors causing seizures. Arch Neurol. (2010) 67:336–42. doi: 10.1001/archneurol.2010.2
44. Wang YY, Zhang T, Li SW, Qian TY, Fan X, Peng XX, et al. Mapping p53 mutations in low-grade glioma: a voxel-based neuroimaging analysis. AJNR Am J Neuroradiol. (2015) 36:70–6. doi: 10.3174/ajnr.A4065
Keywords: epilepsy type, low-grade gliomas, machine learning, radiomics, T2-weighted imaging
Citation: Wang Y, Wei W, Liu Z, Liang Y, Liu X, Li Y, Tang Z, Jiang T and Tian J (2020) Predicting the Type of Tumor-Related Epilepsy in Patients With Low-Grade Gliomas: A Radiomics Study. Front. Oncol. 10:235. doi: 10.3389/fonc.2020.00235
Received: 20 November 2019; Accepted: 12 February 2020;
Published: 13 March 2020.
Edited by:
Bo Gao, Affiliated Hospital of Guizhou Medical University, ChinaReviewed by:
Seyedmehdi Payabvash, Yale University, United StatesGuolin Ma, China-Japan Friendship Hospital, China
Copyright © 2020 Wang, Wei, Liu, Liang, Liu, Li, Tang, Jiang and Tian. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yinyan Wang, tiantanyinyan@126.com; Jie Tian, jie.tian@ia.ac.cn
†These authors have contributed equally to this work