Skip to main content

ORIGINAL RESEARCH article

Front. Oncol., 03 March 2022
Sec. Cancer Imaging and Image-directed Interventions
This article is part of the Research Topic Artificial Intelligence and MRI: Boosting Clinical Diagnosis View all 28 articles

Multiparametric MRI-Based Radiomics Model for Predicting H3 K27M Mutant Status in Diffuse Midline Glioma: A Comparative Study Across Different Sequences and Machine Learning Techniques

Wei GuoWei Guo1Dejun SheDejun She1Zhen XingZhen Xing1Xiang LinXiang Lin1Feng WangFeng Wang1Yang SongYang Song2Dairong Cao,,*Dairong Cao1,3,4*
  • 1Department of Radiology, First Affiliated Hospital of Fujian Medical University, Fuzhou, China
  • 2MR Scientific Marketing, Siemens Healthineers Ltd., Shanghai, China
  • 3Department of Radiology, Fujian Key Laboratory of Precision Medicine for Cancer, The First Affiliated Hospital, Fujian Medical University, Fuzhou, China
  • 4Key Laboratory of Radiation Biology of Fujian Higher Education Institutions, The First Affiliated Hospital, Fujian Medical University, Fuzhou, China

Objectives: The performance of multiparametric MRI-based radiomics models for predicting H3 K27M mutant status in diffuse midline glioma (DMG) has not been thoroughly evaluated. The optimal combination of multiparametric MRI and machine learning techniques remains undetermined. We compared the performance of various radiomics models across different MRI sequences and different machine learning techniques.

Methods: A total of 102 patients with pathologically confirmed DMG were retrospectively enrolled (27 with H3 K27M-mutant and 75 with H3 K27M wild-type). Radiomics features were extracted from eight sequences, and 18 feature sets were conducted by independent combination. There were three feature matrix normalization algorithms, two dimensionality-reduction methods, four feature selectors, and seven classifiers, consisting of 168 machine learning pipelines. Radiomics models were established across different feature sets and machine learning pipelines. The performance of models was evaluated using receiver operating characteristic curves with area under the curve (AUC) and compared with DeLong’s test.

Results: The multiparametric MRI-based radiomics models could accurately predict the H3 K27M mutant status in DMG (highest AUC: 0.807–0.969, for different sequences or sequence combinations). However, the results varied significantly between different machine learning techniques. When suitable machine learning techniques were used, the conventional MRI-based radiomics models shared similar performance to advanced MRI-based models (highest AUC: 0.875–0.915 vs. 0.807–0.926; DeLong’s test, p > 0.05). Most models had a better performance when generated with a combination of MRI sequences. The optimal model in the present study used a combination of all sequences (AUC = 0.969).

Conclusions: The multiparametric MRI-based radiomics models could be useful for predicting H3 K27M mutant status in DMG, but the performance varied across different sequences and machine learning techniques.

Introduction

As a newly defined subtype of the 2016 WHO Classification of Tumors of the Central Nervous System, “diffuse midline glioma (DMG), H3 K27M mutant” is characterized by a genetic alteration pattern in either H3F3A or HIST1H3B/C (1). Compared to the wild-type group, the group with DMG with an H3 K27M mutation exhibited a particularly dismal prognosis, with 3-year overall survival of 5% and 2-year overall survival of less than 10% (25). In addition, the previous studies revealed that H3 K27M mutant status represented a potential novel therapeutic target for DMG, which confronts the fact of resistance to the conventional therapy strategies (610). Identifying H3 K27M mutant status plays an essential role in tumor diagnosis, survival prediction, and therapeutic decision-making. Surgical resection or biopsy could provide an accurate result of H3 K27M mutant status but is not always feasible due to tumor tissue’s spatial heterogeneity and unforeseeable complications. Developing a non-invasive method for accurately predicting H3 K27M mutant status is critical for DMG management.

Several recent attempts have been made to use the multiparametric MRI-based radiomics model to predict H3 K27M mutant status, but the results varied greatly (1116). Most of them focused on different kinds of conventional MRI (cMRI), which could only reflect the tumor’s morphologic information and benefit limitedly to reveal tumor heterogeneity. The advanced MRI (aMRI) (e.g., diffusion-weighted imaging [DWI], susceptibility-weighted imaging [SWI], and dynamic susceptibility contrast perfusion-weighted imaging [DSC-PWI]), which could provide physiological information within the tumor, has been proved to be helpful in radiomics-based glioma genotype prediction (1719). However, the utility of an advanced MRI-based radiomics model in predicting H3 K27M mutant status has not been well evaluated. On the other hand, previous studies indicated that the performance of the radiomics model predominantly varied with the type of image set used (20, 21). As such, it is unclear whether aMRI or a combination of cMRI and aMRI could make an equivalent or superior performance as compared to cMRI.

In addition to the heterogeneous sequence used, the previous studies on H3 K27M mutant status prediction employed a great diversity of machine learning techniques, including dimensionality-reduction algorithm, feature selector, and classifier. It has been well recognized that the radiomics model established via different machine learning techniques could achieve diverse results even when the same sequence was used (22, 23). This could be a potential reason for the inconsistent prior radiomics-based H3 K27M mutant status prediction results. Therefore, there is an urgent need for a head-to-head comparison of the prediction power across different machine learning techniques and sequence or sequence combinations to determine the best machine learning techniques with the best image sets.

The purposes of this study were to 1) detect the best MRI sequence or sequence combinations for predicting H3 K27M mutant status in DMG and 2) determine the optimal machine learning technique for different image sets.

Materials and Methods

Study Population

The Ethical Committee of the First Affiliated Hospital of Fujian Medical University approved this study. The requirement for written informed consent was waived due to the retrospective nature. One hundred two patients were consecutively enrolled in the present study from July 2010 to August 2021. The inclusion criteria were as follows: 1) patients have a pathological diagnosis of diffuse glioma and confirmation of H3 K27M mutant status; 2) tumor is located in the midline structure of the brain; and 3) full preoperative MR images were available. Exclusion criteria were as follows: 1) absence of any required MR images or the image quality was insufficient for analysis and 2) the tumor volume was less than 1.5 cm3. The patients were randomly split into training and test groups with a ratio of 7:3. Extra effort was made to keep the balance between the training and test cohorts.

MRI Protocol

The neurologic MRI examinations were performed with the 3.0-Tesla MR scanner (MAGNETOM Verio/Skyra/Prisma, Siemens Healthcare, Erlangen, Germany). The standard multiparametric MRI sequences in the present study, including T2-weighted imaging (T2WI), T1-weighted imaging (T1WI), fluid-attenuated inversion recovery (FLAIR), contrast-enhanced T1WI (CE-T1WI), SWI, DWI, and DSC-PWI. The details of MRI acquisition parameters are listed in the Supplementary Material 1 (Table S1). The apparent diffusion coefficient (ADC) map was automatically derived from DWI data with b-values of 0 and 1,000 s/mm2. The DSC-PWI raw data were scrolled into a dedicated commercial software package (SyngoVia, Siemens), and the standard perfusion maps (cerebral blood volume [CBV] and cerebral blood flow [CBF]) were conducted as guidance of the software. In the 4th phase during the DSC-PWI scanning, a standard dose (0.1 mmol/kg) of gadobenate dimeglumine (Gd-BOPTA) followed by 20 ml of saline was injected intravenously with a flow rate of 3 ml/s. CE-T1WI was scanned after DSC-PWI.

Image Pre-Processing and Tumor Segmentation

Before pre-processing, the DICOM images were converted to the nifti format. The standard image pre-processing included four steps: 1) all sequences were registered to T2WI initially with a block matching algorithm; 2) following the co-registration, the images were resampled into the uniform voxel size of 1 × 1 × 5 mm3; 3) N4 Bias Field Correction package was applied to correct the bias filed; 4) finally, the image intensities were standardized to [0, 255] to reduce the influence of imaging intensity inconsistency. All of the pre-processing procedures were achieved using G.K software (Glioma kit, version 1.2.1.R, GE Healthcare, Shanghai, China).

Tumor segmentation was performed by one radiologist (DS, with 10 years of experience in neuroradiology) and verified by another radiologist (DC, with 30 years of experience in neuroradiology) who were unaware of the pathological results. The volume of interest (VOI) was created to cover the tumor core (including the enhancing, non-enhancing, and necrotic/cystic components) on T2WI with ITK-SNAP (http://www.itksnap.org) by referring to the T1WI, CE-T1WI, and FLAIR images. According to VASARI guidelines (Visually AcceSAble Rembrandt Images; https://wiki.nci.nih.gov/display/CIP/VASARI), the respective portions of the tumor were defined as described in the previous study (24, 25). As the radiomics feature extraction differed between VOIs, the intra-observer and inter-observer reproducibility analyses were achieved to minimize the influence of segmentation bias. Of intra-observer reproducibility analysis, the VOIs of 30 randomly chosen patients were segmented twice by one radiologist (DS). The inter-observer reproducibility analysis was performed based on the same cohort above, where the VOIs were segmented by two radiologists (ZX and DS, both with 10 years of experience in neuroradiology). The intraclass correlation coefficient (ICC) was calculated to evaluate the agreement of radiomics feature extraction.

Radiomics Feature Extraction

An open-source software, FeAture Explore (V 0.4.2), was used for quantitative radiomics feature extraction with the Pyradiomics module on Python (3.7.6) (26, 27). A total of 851 features were extracted from each sequence image, consisting of 18 first-order statistics features, 14 shape-based features, 75 texture features, and 744 wavelet features from eight wavelet-transformed images (https://pyradiomics.readthedocs.io/en/latest/features.html). The details of the extracted features are listed in the Supplementary Material 1 (Table S2). Eight sequences (T2WI, T1WI, FLAIR, CE-T1WI, ADC, SWI, CBV, and CBF) were used in the present study. Thus, a total of 6,808 features were extracted for analysis. We conducted 18 feature sets by the independent combination of features extracted from these eight sequences. The feature sets were generally named with the name of sequences. Especially, “cMRI,” “aMRI,” and “ALL” denote the combination of all cMRI sequences, aMRI sequences, and eight sequences, respectively.

Radiomics Feature Matrix Pre-Processing

As described above, for the sake of minimizing the influence of VOI segmentation bias on radiomics feature calculation and further machine learning analysis, the features with an ICC value lower than 0.75 in either the intra-observer or inter-observer reproducibility analysis were removed. Then we applied the normalization to the remaining feature matrix. Three feature normalization methods were considered: mean normalization, min–max normalization, and Z-score normalization. The mean normalization subtracted each feature vector by the mean value of the vector and divided each feature by the length of the vector. For the min–max normalization, we rescaled the minimum and maximum values of the feature from zero to one. Then the feature vector was mapped to a unit vector. When the Z-score method was applied, we calculated each feature vector’s mean value and SD. Then each feature was subtracted by the mean value and was divided by the SD. Notably, only one normalization method was used in one machine learning pipeline.

Radiomics Feature Dimensionality Reduction and Feature Selection

Since the feature space dimension was high, we applied two alternative feature dimensionality-reduction methods in the presented study, including Pearson’s correlation coefficient (PCC) and principal component analysis (PCA). The PCC was calculated for each pair of two normalized features, and we removed one of them if the PCC was larger than the preset threshold. By referring to the previous study, the threshold was set to 0.8 for the model using a single sequence and 0.6 for the model using a combination of different sequences (20). When the PCA method was chosen, the high dimension features were transformed into the relative lower dimension features. The feature vector of the transformed feature matrix was independent of each other.

Following feature dimensionality reduction, four optional methods were provided for feature selection, including ANOVA, recursive feature elimination (RFE), Kruskal–Wallis (KW), and Relief.

Predictive Model Establishment

Seven machine learning classifiers were analyzed to determine the optimal model. The SVM classifier we used was based on a linear kernel function , and it may be more appreciated to be cataloged into the linear classifier. The sentence should be corrected as "These classifiers could be divided into three categories: linear (logistic regression [LR], linear discriminant analysis [LDA], and support vector machine [SVM]), non-linear classifiers (auto-encoder [AE] and decision tree [DT]), and ensemble classifiers (random forest [RF] and AdaBoost [AB]). The five-fold cross-validation was applied on the training dataset to determine the model’s hyper-parameter, such as the number of features and specific hyper-parameters of each classifier, which can be referred on the scikit-learn (https://scikit-learn.org/stable/index.html). The hyper-parameters were set according to the model performance on the cross-validation dataset.

Considering different combinations of each procedure during model development, including sequence used, feature matrix normalization, dimensionality reduction, and feature selection, could provide controversial results with different classifiers. We analyzed models’ performance from 8 single sequences and 10 different sequence combinations with different machine learning techniques. Thus, a total of 3,024 models were conducted in the present study (18 [sequence groups] × 3 [feature matrix normalization] × 2 [dimensionality reduction] × 4 [features selector] × 7 [classifiers] = 3,024 [models]). The flowchart of the present study is illustrated in Figure 1. The above processes, including feature matrix normalization, dimensionality reduction, feature selection, and classifier fitness, were implemented with FeAture Explorer (V 0.4.2) on the training cohort. Then, we evaluated the models’ performance on the independent test cohort.

FIGURE 1
www.frontiersin.org

Figure 1 The flowchart of the presented study. (A) Multiparametric MRI data collection, image pre-processing, tumor segmentation, and radiomics feature extraction. (B) Machine learning and model performance analysis.

Statistical Analysis

The performance of each model was evaluated with receiver operating characteristic curve analysis. The area under the receiver operating characteristic curve (AUC) and accuracy were calculated. We also estimated the 95% CI by bootstrap with 1,000 samples. To assess the variability in the performance of different models, we compared the top-one-performing models and the top-five-performing models of each sequence or sequence combination. Continuous variables of the baseline characteristics were described as the mean ± SD and compared using the Mann–Whitney U test. Categorical variables of the baseline characteristics were described as number (percentage) and compared using Pearson’s chi-squared test. The comparison of AUCs between different models was performed using Delong’s test. The statistical analyses were performed with R statistical software (version 3.5.3; https://www.r-project.org/). A p-value <0.05 was considered statistically significant.

Results

Baseline Characteristics of Patients

Of the 102 patients, 27 (26.47%) patients were confirmed with an H3 K27M mutation. The mean age was 41.19 ± 20.64 years, and the male ratio was 64 (62.75%). No statistically significant difference was found in the baseline characteristics between the training and test groups (p > 0.05) (Table 1).

TABLE 1
www.frontiersin.org

Table 1 Baseline characteristics of the training and test groups.

Performance of Sequence

In general, most of the high-performing models (with an AUC value larger than 0.9 in the test set) were conducted from the combination of different sequences (Figures 2, 3 and Tables 2 and S3). The ALL model showed the strongest predictive power among various models for H3 K27M mutant status (AUC = 0.969), while the best single-sequence model was the CBF-based model (AUC = 0.926), followed by the T2WI-based model (AUC = 0.915). The CBV-based model yielded the lowest AUC value of 0.807 among the top-one-performing models of different sequences or sequence combinations (Figure 4).

FIGURE 2
www.frontiersin.org

Figure 2 The machine learning pipelines and performance of top-five-performing models of different sequences. The color of lines indicated the performance of models in the test set.

FIGURE 3
www.frontiersin.org

Figure 3 Box-and-whisker plots illustrate the top-five-performing area under the curve (AUC) values of different sequences.

TABLE 2
www.frontiersin.org

Table 2 The performance of the top-one-performing models.

FIGURE 4
www.frontiersin.org

Figure 4 The receiver operating characteristic curve of the top-one-performing models of different sequences in the training (A, C) and test sets (B, D).

The cMRI showed comparable performance to aMRI when suitable machine learning techniques were employed (DeLong’s test, all p > 0.05) (Table 3). In models based on a single sequence, the highest AUCs were 0.875–0.915 for cMRI sequences and 0.807–0.926 for aMRI sequences (Table 2 and Figure 4). The model of cMRI yielded a slightly higher AUC than the model of aMRI in the test set (AUC: 0.921 vs. 0.915). When combining limited sequences of cMRI and aMRI, the model of T2WI+CE-T1WI+SWI+CBF reached the highest AUC of 0.955. No statistically significant difference of the highest AUC values between the optimal model (ALL, AUC = 0.969) and other sequence-based models was found (DeLong’s test, all p > 0.05) (Table 3).

TABLE 3
www.frontiersin.org

Table 3 Results of DeLong’s test of the best models with different classifiers.

Performance of Machine Learning Technique

Figures 2 and S1 demonstrate the performance of different machine learning techniques. The machine learning pipeline of the optimal model was Z-score_PCA_KW_RF and Z-score_PCA_ANOVA_RF, both with an AUC value of 0.969 (Figure 2 and Table S3). Among the 90 top-five-performing models, the Z-score normalization method outperformed others with darker color lines in Figure 2 and a higher mean AUC value in Figure S1. In the same way, feature sets applying dimensionality reduction with the PCA method had a higher AUC value. Figure 5 shows the best performance across different sequences and classifiers. The comparison results of the different classifiers are shown in Table 3. Of ADC-based models, CBF-based models, and T2WI+CE-T1WI+ADC+CBF-based models, a significant difference could be found in the AUC values between the best classifier and worst classifier (DeLong’s test, p < 0.05) (Table 3). In contrast to the sequence with a suitable classifier, if the non-optimal classifier was used, the performance of different sequences varied significantly (DeLong’s test, p < 0.05) (Table 3).

FIGURE 5
www.frontiersin.org

Figure 5 The optimal performance across different sequences and classifiers.

Among the top-five-performing models, the distribution of machine learning techniques varied considerably in different categories of MRI sequences (Figures 2, 6). PCA was more frequently used in the top-five-performing models (66% of all sequences), especially in the model that simultaneously combined multiple MR images (86%). Feature selector of KW has a higher percentage in both single sequence-based (which have fewer features) and combined sequence-based (which have more features) models.

FIGURE 6
www.frontiersin.org

Figure 6 The percentage of machine learning techniques in 90 top-five-performing models of different model categories. “Conventional MRI only” represents models developed only with conventional MRI sequences; “Advanced MRI only” for models only with advanced MRI sequences; “Mixed MRI” for models with both conventional and advanced MRI sequences; “Single sequences” for models with one sequence; “combined sequences” for models with at least two sequences; and “All sequences” for models of all sequence sets.

Discussion

This study developed and validated various machine learning-based models with radiomics features extracted from multiparametric MRI to predict H3 K27M mutant status in DMG. The model’s performance was compared across different sequences and machine learning techniques. Radiomics models derived from multiparametric MRI performed well in differentiating H3 K27M mutant and wild-type DMGs when a suitable machine learning technique was used (highest AUC: 0.807–0.969). However, the performance of the models can vary significantly regarding different machine learning techniques (DeLong’s test, p < 0.05). Generally, the models developed with multi-sequence had a better performance than one with a single sequence. The cMRI-based model showed comparable performance to aMRI (highest AUC: 0.875–0.915 for cMRI, 0.807–0.926 for aMRI).

In line with the previous study, radiomics models based on cMRI could accurately predict the H3 K27M mutant status in DMGs (1114). As an essential supplement to prior studies, our result also declared that the radiomics model developed with the aMRI, including ADC, SWI, CBV, and CBF, could be qualified for this purpose. Meanwhile, when appropriate machine learning techniques were used, the cMRI and aMRI shared comparable performance (DeLong’s test, p > 0.05). A significant difference in ADC, CBV, and CBF values (measured with the freehand regions of interest) has been reported between H3 K27M mutant and wild-type DMGs (2830). Other studies found that several semantic and semiquantitative features on cMRI could be used to predict H3 K27M mutant status in DMG (31, 32). But other non-radiomics studies using cMRI and DWI to predict H3 K27M mutant status showed converse results (33, 34). Radiomics has been proved to excavate numerous features from medical images, and most of these features are undiscoverable by the naked eye (35, 36). Analyzing medical images with a non-radiomics method may result in a loss of information within images. Wu et al. used radiological features and radiomics features to predict H3 K27M mutant status. Their results showed that the radiomics model performed significantly better than the clinical model (developed with radiological features) (16). The controversial results of non-radiomics studies and the robust results of radiomics studies supported that if the diagnostic information had been sufficiently explored using the radiomics method, the predictive ability of multiparametric MRI could be improved. This has been proved again by our results.

Another important observation was that most models that originated from combined sequences have a better predictive performance, whether the optimal classifier was used (Figures 2, 3) or not (Figure 5). Previous studies using a multiparametric MRI-based radiomics model to predict glioma molecular subtype also showed similar results to ours (18, 37). However, only three multiparametric MRI-based radiomics models were established previously and achieved the highest AUC value of 0.920 in the test cohort for H3 K27M mutant status prediction (12, 14, 16). They only make a direct combination of all sequences used, and the performance between single and combined sequences was not compared. Liu et al. developed a machine learning model based on T1WI images only to predict H3 K27M mutant status in DMGs, which yielded the highest AUC value of 0.953 (11). However, the sample size was relatively small (n = 55), and the final model features were slightly overmuch (n = 30). Another radiomics model based on FLAIR images showed an AUC value of 0.903 (13). It is unfair to compare the model’s performance when different datasets were used. Our study compared the model performance based on the same dataset. The results showed that the model had the best predictive power when combined with all sequences (AUC = 0.969). The reason may be that complementary information among multiparametric MRI could provide a more comprehensive understanding of tumor heterogeneity and discriminate more precisely tumor classes. Also noteworthy is that the model combined with limited sequences was sufficient to differentiate H3 K27M-mutant and K27M-wt DMGs, such as the model based on feature sets from T2WI+CE-T1WI+SWI+CBF (AUC = 0.955) and T2WI+CE-T1WI+CBF (AUC = 0.932). This is relevant, as it could guide model application in various clinical circumstances and make it more time-efficient.

According to previous results, the feature selector and classifier were two major determinant factors of radiomics model performance (2023, 38, 39). When a suitable classifier was used, there was no significant difference in the AUC value of different sequences. Constantly, when an inappropriate classifier was used, both intra-sequence and inter-sequence comparisons yielded a significant difference in AUC values (Table 3). For the single sequence-based model, SVM, LDA, and LR classifiers were more frequently to have a lower AUC. The reason may be that the LR and LAD were both linear classifiers, and the SVM used linear kernel function in our study; thus, these classifiers were not flexible enough to fit a non-linear relationship between features and tumor groups. Furthermore, features extracted from a single sequence could only offer limited messages on tumor biological heterogeneity. Of note, the multiparametric MRI-based model with SVM, LDA, and LR demonstrated more favorable results. The prior study used various classifiers (e.g., SVM, RF, and XGBoost) and generated an AUC value of 0.549–0.953, which were lower than ours (AUC = 0.969) (1115). Several reasons may account for this variety, including patient data, MRI data, and machine learning techniques. Hence, a head-to-head comparison may be more reliable to reveal the influence of these factors and determine optimal models when different image data are available.

Apart from the feature selector and classifier, our results revealed that the feature matrix normalization and dimensionality-reduction method also played a non-negligible role in model performance evaluation (Figure S1). The previous study focused on H3 K27M mutant status prediction, which rarely considered these elements. Two of them made an effort to compare the predictive power of different classifiers and another for different feature selectors (11, 15). The limitation of these studies on model development warrants extra caution in terms of result explanation. Our results demonstrated that the appropriate machine learning techniques mentioned above could vary greatly when various image data were used (Figure 6). This reemphasized that both the type of image data used and the employment of machine learning techniques will carry a diverse result. Thus, it is essential and encouraged to seek the optimal machine learning techniques when different image data are used. The compatible combination of medical images with machine learning techniques could maximize and robust the radiomics model’s performance.

There are several limitations in the current study. First, this is a single-center retrospective study, which results in an unavoidable selecting bias and relatively small sample size. The imbalanced proportion of H3 K27M mutant DMG might influence the development of our models. A prospective and multi-institution study is needed for confirming our results. Second, the dataset was randomly split into the training and test cohorts. To reduce the selection bias with this kind of splitting, nest cross-validation may be needed in the future. The third is the lack of extra validation to facilitate the generalization of our findings. Unlike other gliomas, the morbidity of DMG was lower. Furthermore, we analyzed eight MR image sets, which makes it more challenging to match an external validation cohort. Fourth, we did not compare our model with the human reader as recommended by a previous study (40). However, the performance of MRI features evaluated by radiologists with the non-radiomics method was controversial, and the discriminative ability was not as well as ours (highest AUC = 0.872) (28). A prior study showed that the radiomics model was significantly superior to the clinical model (based on radiological features) (16). In this regard, our radiomics model might be superior to human readers, although a head-to-head comparison needs to be implemented in the future. Finally, the performance of deep learning algorithms was not evaluated and compared in our study. Deep learning algorithms have been widely used in glioma molecular subtype prediction (4145). However, deep learning usually needs a huge amount of dataset, such as hundreds or thousands of cases, and the dataset is limited for our approach. More datasets would be collected, and deep-learning algorithms would be compared to classical machine learning algorithms in the future.

Conclusion

Our results indicated that the H3 K27M mutant status of DMG can be effectively predicted with multiparametric MRI radiomics models. However, the performance of models varies significantly across different machine learning techniques and sequences used.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.

Ethics Statement

The studies involving human participants were reviewed and approved by the Ethical Committee of the First Affiliated Hospital of Fujian Medical University. Written informed consent from the participants’ legal guardian/next of kin was not required to participate in this study in accordance with the national legislation and the institutional requirements.

Author Contributions

WG: writing, study design, and data analysis. DS: study design and data analysis. ZX: data analysis. XL and FW: data collection. YS: model development and statistical analysis. DC: study design, data analysis, and revisions to the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This study has received funding from the Leading Project of the Department of Science and Technology of Fujian Province (No. 2020Y0025), the National Natural Science Foundation of China (No. 82071869), the Joint Funds of the Innovation of Science and Technology of Fujian Province (No. 2019Y9115), and the Young and Middle-aged Key Personnel Training Project of Fujian Provincial Health Commission (No.2021GGA025).

Conflict of Interest

Author YS was employed by Siemens Healthineers Ltd.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

The authors thank Xingfu Wang for pathological support at First Affiliated Hospital of Fujian Medical University, Fuzhou, China.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2022.796583/full#supplementary-material

Abbreviations

AB, AdaBoost; ADC, apparent diffusion coefficient; AE, auto-encoder; AUC, area under the curve; CBF, cerebral blood flow; CBV, cerebral blood volume; CE-T1WI, contrast-enhanced T1-weighted imaging; DMG, diffuse midline glioma; DSC-PWI, dynamic susceptibility contrast perfusion-weighted imaging; DT, decision tree; DWI, diffusion-weighted imaging; FLAIR, fluid-attenuated inversion recovery; ICC, intraclass correlation coefficient; KW, Kruskal–Wallis; LDA, linear discriminant analysis; LR, logistic regression; PCA, principal component analysis; PCC, Pearson’s correlation coefficient; RF, random forest; RFE, recursive feature elimination; SVM, support vector machine; SWI, susceptibility-weighted imaging; T1WI, T1-weighted imaging; T2WI, T2-weighted imaging; VOI, volume of interest.

References

1. Louis DN, Perry A, Reifenberger G, von Deimling A, Figarella-Branger D, Cavenee WK, et al. The 2016 World Health Organization Classification of Tumors of the Central Nervous System: A Summary. Acta Neuropathol (2016) 131(6):803–20. doi: 10.1007/s00401-016-1545-1

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Chiang J, Diaz AK, Makepeace L, Li X, Han Y, Li Y, et al. Clinical, Imaging, and Molecular Analysis of Pediatric Pontine Tumors Lacking Characteristic Imaging Features of DIPG. Acta Neuropathol Commun (2020) 8(1):57. doi: 10.1186/s40478-020-00930-9

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Korshunov A, Ryzhova M, Hovestadt V, Bender S, Sturm D, Capper D, et al. Integrated Analysis of Pediatric Glioblastoma Reveals a Subset of Biologically Favorable Tumors With Associated Molecular Prognostic Markers. Acta Neuropathol (2015) 129(5):669–78. doi: 10.1007/s00401-015-1405-4

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Karremann M, Gielen GH, Hoffmann M, Wiese M, Colditz N, Warmuth-Metz M, et al. Diffuse High-Grade Gliomas With H3 K27M Mutations Carry a Dismal Prognosis Independent of Tumor Location. Neuro Oncol (2018) 20(1):123–31. doi: 10.1093/neuonc/nox149

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Qiu T, Chanchotisatien A, Qin Z, Wu J, Du Z, Zhang X, et al. Imaging Characteristics of Adult H3 K27M-Mutant Gliomas. J Neurosurg (2019) 15:1–9. doi: 10.3171/2019.9.JNS191920

CrossRef Full Text | Google Scholar

6. Graham MS, Mellinghoff IK. Histone-Mutant Glioma: Molecular Mechanisms, Preclinical Models, and Implications for Therapy. Int J Mol Sci (2020) 21(19):7193. doi: 10.3390/ijms21197193

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Zhang Y, Zhou L, Safran H, Borsuk R, Lulla R, Tapinos N, et al. EZH2i EPZ-6438 and HDACi Vorinostat Synergize With ONC201/TIC10 to Activate Integrated Stress Response, DR5, Reduce H3K27 Methylation, ClpX and Promote Apoptosis of Multiple Tumor Types Including DIPG. Neoplasia (2021) 23(8):792–810. doi: 10.1016/j.neo.2021.06.007

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Bailey CP, Figueroa M, Gangadharan A, Yang Y, Romero MM, Kennis BA, et al. Pharmacologic Inhibition of Lysine-Specific Demethylase 1 as a Therapeutic and Immune-Sensitization Strategy in Pediatric High-Grade Glioma. Neuro Oncol (2020) 22(9):1302–14. doi: 10.1093/neuonc/noaa058

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Grasso CS, Tang Y, Truffaux N, Berlow NE, Liu L, Debily MA, et al. Functionally Defined Therapeutic Targets in Diffuse Intrinsic Pontine Glioma. Nat Med (2015) 21(6):555–9. doi: 10.1038/nm.3855

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Pedersen H, Schmiegelow K, Hamerlik P. Radio-Resistance and DNA Repair in Pediatric Diffuse Midline Gliomas. Cancers (Basel) (2020) 12(10):2813. doi: 10.3390/cancers12102813

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Liu J, Chen F, Pan C, Zhu M, Zhang X, Zhang L, et al. A Cascaded Deep Convolutional Neural Network for Joint Segmentation and Genotype Prediction of Brainstem Gliomas. IEEE Trans BioMed Eng (2018) 65(9):1943–52. doi: 10.1109/TBME.2018.2845706

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Pan CC, Liu J, Tang J, Chen X, Chen F, Wu YL, et al. A Machine Learning-Based Prediction Model of H3K27M Mutations in Brainstem Gliomas Using Conventional MRI and Clinical Features. Radiother Oncol (2019) 130:172–9. doi: 10.1016/j.radonc.2018.07.011

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Su X, Chen N, Sun H, Liu Y, Yang X, Wang W, et al. Automated Machine Learning Based on Radiomics Features Predicts H3 K27M Mutation in Midline Gliomas of the Brain. Neuro Oncol (2020) 22(3):393–401. doi: 10.1093/neuonc/noz184

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Kandemirli SG, Kocak B, Naganawa S, Ozturk K, Yip SSF, Chopra S, et al. Machine Learning-Based Multiparametric Magnetic Resonance Imaging Radiomics for Prediction of H3K27M Mutation in Midline Gliomas. World Neurosurg (2021) 151:e78–85. doi: 10.1016/j.wneu.2021.03.135

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Zhuo Z, Qu L, Zhang P, Duan Y, Cheng D, Xu X, et al. Prediction of H3K27M-Mutant Brainstem Glioma by Amide Proton Transfer-Weighted Imaging and its Derived Radiomics. Eur J Nucl Med Mol Imaging (2021) 48(13):4426–36. doi: 10.1007/s00259-021-05455-4

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Wu C, Zheng H, Li J, Zhang Y, Duan S, Li Y, et al. MRI-Based Radiomics Signature and Clinical Factor for Predicting H3K27M Mutation in Pediatric High-Grade Gliomas Located in the Midline of the Brain. Eur Radiol (2021) 32(3):1813–22. doi: 10.1007/s00330-021-08234-9

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Kim M, Jung SY, Park JE, Jo Y, Park SY, Nam SJ, et al. Diffusion- and Perfusion-Weighted MRI Radiomics Model may Predict Isocitrate Dehydrogenase (IDH) Mutation and Tumor Aggressiveness in Diffuse Lower Grade Glioma. Eur Radiol (2020) 30(4):2142–51. doi: 10.1007/s00330-019-06548-3

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Tan Y, Zhang ST, Wei JW, Dong D, Wang XC, Yang GQ, et al. A Radiomics Nomogram may Improve the Prediction of IDH Genotype for Astrocytoma Before Surgery. Eur Radiol (2019) 29(7):3325–37. doi: 10.1007/s00330-019-06056-4

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Manikis GC, Ioannidis GS, Siakallis L, Nikiforaki K, Iv M, Vozlic D, et al. Multicenter DSC-MRI-Based Radiomics Predict IDH Mutation in Gliomas. Cancers (Basel) (2021) 13(16):3965. doi: 10.3390/cancers13163965

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Priya S, Liu Y, Ward C, Le NH, Soni N, Pillenahalli Maheshwarappa R, et al. Radiomic Based Machine Learning Performance for a Three Class Problem in Neuro-Oncology: Time to Test the Waters? Cancers (Basel) (2021) 13(11):2568. doi: 10.3390/cancers13112568

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Bathla G, Priya S, Liu Y, Ward C, Le NH, Soni N, et al. Radiomics-Based Differentiation Between Glioblastoma and Primary Central Nervous System Lymphoma: A Comparison of Diagnostic Performance Across Different MRI Sequences and Machine Learning Techniques. Eur Radiol (2021) 31(11):8703–13. doi: 10.1007/s00330-021-07845-6

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Chen C, Zheng A, Ou X, Wang J, Ma X. Comparison of Radiomics-Based Machine-Learning Classifiers in Diagnosis of Glioblastoma From Primary Central Nervous System Lymphoma. Front Oncol (2020) 10:1151. doi: 10.3389/fonc.2020.01151

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Wang X, Wan Q, Chen H, Li Y, Li X. Classification of Pulmonary Lesion Based on Multiparametric MRI: Utility of Radiomics and Comparison of Machine Learning Methods. Eur Radiol (2020) 30(8):4595–605. doi: 10.1007/s00330-020-06768-y

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Menze BH, Jakab A, Bauer S, Kalpathy-Cramer J, Farahani K, Kirby J, et al. The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS). IEEE Trans Med Imaging (2015) 34(10):1993–2024. doi: 10.1109/TMI.2014.2377694

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Gevaert O, Mitchell LA, Achrol AS, Xu J, Echegaray S, Steinberg GK, et al. Glioblastoma Multiforme: Exploratory Radiogenomic Analysis by Using Quantitative Image Features. Radiology (2014) 273:168. doi: 10.1148/radiol.14131731

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Song Y, Zhang J, Zhang YD, Hou Y, Yan X, Wang Y, et al. FeAture Explorer (FAE): A Tool for Developing and Comparing Radiomics Models. PloS One (2020) 15(8):e0237587. doi: 10.1371/journal.pone.0237587

PubMed Abstract | CrossRef Full Text | Google Scholar

27. van Griethuysen JJM, Fedorov A, Parmar C, Hosny A, Aucoin N, Narayan V, et al. Computational Radiomics System to Decode the Radiographic Phenotype. Cancer Res (2017) 77(21):e104–e7. doi: 10.1158/0008-5472.CAN-17-0339

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Chen H, Hu W, He H, Yang Y, Wen G, Lv X. Noninvasive Assessment of H3 K27M Mutational Status in Diffuse Midline Gliomas by Using Apparent Diffusion Coefficient Measurements. Eur J Radiol (2019) 114:152–9. doi: 10.1016/j.ejrad.2019.03.006

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Piccardo A, Tortora D, Mascelli S, Severino M, Piatelli G, Consales A, et al. Advanced MR Imaging and (18)F-DOPA PET Characteristics of H3K27M-Mutant and Wild-Type Pediatric Diffuse Midline Gliomas. Eur J Nucl Med Mol Imaging (2019) 46(8):1685–94. doi: 10.1007/s00259-019-04333-4

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Kathrani N, Chauhan RS, Kotwal A, Kulanthaivelu K, Bhat MD, Saini J, et al. Diffusion and Perfusion Imaging Biomarkers of H3 K27M Mutation Status in Diffuse Midline Gliomas. Neuroradiology (2022). doi: 10.1007/s00234-021-02857-x

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Banan R, Akbarian A, Samii M, Samii A, Bertalanffy H, Lehmann U, et al. Diffuse Midline Gliomas, H3 K27M-Mutant are Associated With Less Peritumoral Edema and Contrast Enhancement in Comparison to Glioblastomas, H3 K27M-Wildtype of Midline Structures. PloS One (2021) 16(8):e0249647. doi: 10.1371/journal.pone.0249647

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Chauhan RS, Kulanthaivelu K, Kathrani N, Kotwal A, Bhat MD, Saini J, et al. Prediction of H3K27M Mutation Status of Diffuse Midline Gliomas Using MRI Features. J Neuroimaging (2021) 31(6):1201–10. doi: 10.1111/jon.12905

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Aboian MS, Solomon DA, Felton E, Mabray MC, Villanueva-Meyer JE, Mueller S, et al. Imaging Characteristics of Pediatric Diffuse Midline Gliomas With Histone H3 K27M Mutation. AJNR Am J Neuroradiol (2017) 38(4):795–800. doi: 10.3174/ajnr.A5076

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Aboian MS, Tong E, Solomon DA, Kline C, Gautam A, Vardapetyan A, et al. Diffusion Characteristics of Pediatric Diffuse Midline Gliomas With Histone H3-K27M Mutation Using Apparent Diffusion Coefficient Histogram Analysis. AJNR Am J Neuroradiol (2019) 40(11):1804–10. doi: 10.3174/ajnr.A6302

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Gillies RJ, Kinahan PE, Hricak HJR. Radiomics: Images Are More Than Pictures. They Are Data (2016) 278(2):563–77. doi: 10.1148/radiol.2015151169

CrossRef Full Text | Google Scholar

36. Lambin P, Leijenaar RTH, Deist TM, Peerlings J, de Jong EEC, van Timmeren J, et al. Radiomics: The Bridge Between Medical Imaging and Personalized Medicine. Nat Rev Clin Oncol (2017) 14(12):749–62. doi: 10.1038/nrclinonc.2017.141

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Peng H, Huo J, Li B, Cui Y, Zhang H, Zhang L, et al. Predicting Isocitrate Dehydrogenase (IDH) Mutation Status in Gliomas Using Multiparameter MRI Radiomics Features. J Magn Reson Imaging (2021) 53(5):1399–407. doi: 10.1002/jmri.27434

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Song SE, Cho KR, Cho Y, Kim K, Jung SP, Seo BK, et al. Machine Learning With Multiparametric Breast MRI for Prediction of Ki-67 and Histologic Grade in Early-Stage Luminal Breast Cancer. Eur Radiol (2021) 32(2):853-63. doi: 10.1007/s00330-021-08127-x

CrossRef Full Text | Google Scholar

39. Huang Y, Wei L, Hu Y, Shao N, Lin Y, He S, et al. Multi-Parametric MRI-Based Radiomics Models for Predicting Molecular Subtype and Androgen Receptor Expression in Breast Cancer. Front Oncol (2021) 11:706733. doi: 10.3389/fonc.2021.706733

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Bluemke DA, Moy L, Bredella MA, Ertl-Wagner BB, Fowler KJ, Goh VJ, et al. Assessing Radiology Research on Artificial Intelligence: A Brief Guide for Authors, Reviewers, and Readers-From the Radiology Editorial Board. Radiology (2020) 294(3):487–9. doi: 10.1148/radiol.2019192515

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Bangalore Yogananda CG, Shah BR, Vejdani-Jahromi M, Nalawade SS, Murugesan GK, Yu FF, et al. A Novel Fully Automated MRI-Based Deep-Learning Method for Classification of IDH Mutation Status in Brain Gliomas. Neuro Oncol (2020) 22(3):402–11. doi: 10.1093/neuonc/noz199

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Choi YS, Bae S, Chang JH, Kang S-G, Kim SH, Kim J, et al. Fully Automated Hybrid Approach to Predict the IDH Mutation Status of Gliomas via Deep Learning and Radiomics. Neuro-Oncology (2021) 23(2):304–13. doi: 10.1093/neuonc/noaa177

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Cluceru J, Interian Y, Phillips JJ, Molinaro AM, Luks TL, Alcaide-Leon P, et al. Improving the Noninvasive Classification of Glioma Genetic Subtype With Deep Learning and Diffusion-Weighted Imaging. Neuro Oncol (2021). doi: 10.1093/neuonc/noab238

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Yogananda CGB, Shah BR, Nalawade SS, Murugesan GK, Yu FF, Pinho MC, et al. MRI-Based Deep-Learning Method for Determining Glioma MGMT Promoter Methylation Status. AJNR Am J Neuroradiol (2021) 42(5):845–52. doi: 10.3174/ajnr.A7029

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Matsui Y, Maruyama T, Nitta M, Saito T, Tsuzuki S, Tamura M, et al. Prediction of Lower-Grade Glioma Molecular Subtypes Using Deep Learning. J Neurooncol (2020) 146(2):321–7. doi: 10.1007/s11060-019-03376-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: diffuse midline glioma, H3 K27M mutant, multiparametric MRI, radiomics, machine learning

Citation: Guo W, She D, Xing Z, Lin X, Wang F, Song Y and Cao D (2022) Multiparametric MRI-Based Radiomics Model for Predicting H3 K27M Mutant Status in Diffuse Midline Glioma: A Comparative Study Across Different Sequences and Machine Learning Techniques. Front. Oncol. 12:796583. doi: 10.3389/fonc.2022.796583

Received: 17 October 2021; Accepted: 08 February 2022;
Published: 03 March 2022.

Edited by:

Oliver Diaz, University of Barcelona, Spain

Reviewed by:

Weiwei Zong, Henry Ford Health System, United States
Gökalp Çınarer, Bozok University, Turkey

Copyright © 2022 Guo, She, Xing, Lin, Wang, Song and Cao. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Dairong Cao, dairongcao@163.com

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.