- Department of Radiology, Xiang’an Hospital of Xia Men University, Xiamen, China
This study aimed to investigate the value of amplitude of low-frequency fluctuation (ALFF)-based histogram analysis in the diagnosis of Parkinson’s disease (PD) and to investigate the regions of the most important discriminative features and their contribution to classification discrimination. Patients with PD (n = 59) and healthy controls (HCs; n = 41) were identified and divided into a primary set (80 cases, including 48 patients with PD and 32 HCs) and a validation set (20 cases, including 11 patients with PD and nine HCs). The Automated Anatomical Labeling (AAL) 116 atlas was used to extract the histogram features of the regions of interest in the brain. Machine learning methods were used in the primary set for data dimensionality reduction, feature selection, model construction, and model performance evaluation. The model performance was further validated in the validation set. After feature data dimension reduction and feature selection, 23 of a total of 1,276 features were entered in the model. The brain regions of the selected features included the frontal, temporal, parietal, occipital, and limbic lobes, as well as the cerebellum and the thalamus. In the primary set, the area under the curve (AUC) of the model was 0.974, the sensitivity was 93.8%, the specificity was 90.6%, and the accuracy was 93.8%. In the validation set, the AUC, sensitivity, specificity, and accuracy were 0.980, 90.9%, 88.9%, and 90.0%, respectively. ALFF-based histogram analysis can be used to classify patients with PD and HCs and to effectively identify abnormal brain function regions in PD patients.
Introduction
Parkinson’s disease (PD) is one of the most common clinically progressive neurodegenerative diseases worldwide, with prevalence second only to Alzheimer’s disease, and it affects more than 10 million people worldwide (Kim et al., 2017; Srivastav et al., 2017). Early diagnosis and treatment of PD are crucial to stop its progression in the initial stages (Chen et al., 2014; Adeli et al., 2016; Heim et al., 2017). In the early stage of PD, the main manifestations are non-motor symptoms, which are nonspecific and difficult to diagnose (Peng et al., 2017; Cigdem et al., 2018; Tuovinen et al., 2018; Rubbert et al., 2019). However, advancements in neuroimaging and machine learning technologies have led to an increasing role of such technologies in the accurate diagnosis of PD (Chen et al., 2014; Szewczyk-Krolikowski et al., 2014; Peng et al., 2017; Amoroso et al., 2018).
Resting-state functional magnetic resonance (rs-fMRI; Qin et al., 2019; Zhou Z. W. et al., 2019) is one of the most commonly used techniques for neuroimaging. The amplitude of low-frequency fluctuation (ALFF; Zhang et al., 2017; Xu et al., 2019), which can detect the amplitude of spontaneous brain fluctuations, is one of the most commonly used fMRI measurements.
Radiomics has been widely used in clinical oncology studies (Ji et al., 2020; Zhao K. et al., 2020); the medical images can be converted into feature sets that can be used to characterize tumor characteristics by a series of algorithms (Lambin et al., 2012; Ji et al., 2020). Radiomics has now been widely used in the study of neuropsychological diseases, their diagnosis, and their neurological mechanism (Sun et al., 2018; Huang K. et al., 2019; Mo et al., 2019; Wang et al., 2020). Histogram analysis is the most commonly used radiomic feature extraction method, which is widely used in neuroimaging research (Cui et al., 2016; Sun et al., 2018; Huang K. et al., 2019; Zhou et al., 2020). To our knowledge, there is no existing study that has used histogram analysis to diagnose PD.
Therefore, this study aimed to explore the value of using ALFF-based histogram analysis in the diagnosis of PD and to investigate the regions of the most important discriminative features and their contribution to classification discrimination in order to explore its potential pathological mechanism.
Materials and Methods
Subjects
The data in this article were obtained from a public database1 (Hu et al., 2015) including 41 healthy controls (HCs) and 59 PD patients. Previous studies (Varoquaux, 2018; Gorriz et al., 2021) have demonstrated that cross-validation in a small sample size leads to large error bars, and the predictive power of the fitted classifiers is arguable. Varoquaux (2018) also pointed out that the best resolution was to test the model performance across several datasets. Consequently, we divided the subjects into a primary set (32 HCs and 48 PDs) for training the model and a validation set (nine HCs and 11 PDs) for testing the model according to the order in which they entered the group based on an 8:2 ratio (to ensure a balanced ratio of PD and HC between the two groups). The clinical data obtained from each subject included age, sex, years of education, and Mini-Mental State Examination (MMSE) scores.
Image Acquisition
High-resolution three-dimensional (3D) T1-weighted structure images and the rs-fMRI data of each participant were collected with a 3T Siemens MRI scanner (Siemens Healthineers, Erlangen, Germany). The parameters were as follows (Hu et al., 2015): 3D T1-weighted anatomical images: repetition time (TR)/echo time (TE) = 2,530/3.43 ms, field of view (FOV) = 256 × 256 mm, slice thickness = 1.3 mm, slice interval = 0.5 mm, slices = 128, matrix = 256 × 192, flip angle = 7°; rs-fMRI images: TR/TE = 2,000/30 ms, FOV = 220 × 220 mm, voxel size = 3.4 × 3.4 × 3.5 mm3, slice interval = 0.6 mm, slices = 31, matrix = 64 × 64, and flip angle = 90°.
Data Preprocessing and ALFF Calculation
The data obtained in this study are the mean ALFF images. The data had already been preprocessed and the mean ALFF had been calculated. This processing is a standardized preprocessing step. The detailed mean ALFF preprocessing and calculation procedure can be found in a previous study (Hu et al., 2015). Briefly, the procedure includes the removal of the first 10 time points of the data, slice timing and realignment (subjects whose head motion parameters exceeded 2.5 mm of the maximum translation displacement or 2.5° of angular motion were excluded), image registration, spatial standardization, and image resampling (3 × 3 × 3 mm3), spatial smoothing using a 6 × 6 × 6-mm3 full-width half-maximum Gaussian kernel, high-pass filtering (0.01–0.08 Hz), and linear drift removal. The ALFF calculation and mean standardization were further performed on the preprocessed rs-fMRI data.
Histogram Feature Extraction
Previous studies (Balagurunathan et al., 2014; Zhao et al., 2016; Berenguer et al., 2018) have demonstrated that histogram statistical features are reproducible and easy to interpret. Meanwhile, if the feature dimension is too high, it is easy for the model to fall into a “curse of dimensionality.” Consequently, in this study, we segmented the individual mean ALFF map into 116 regions of interest (ROIs) using the Automated Anatomical Labeling (AAL) 116 atlas (Figure 1), which consists of 90 subregions in the cerebrum and 26 subregions in the cerebellum. We extracted 11 intensity-based histogram features of the ALFF in each ROI, including the mean, minimum, maximum, range, standard deviation, variance, median, skewness, kurtosis, 10th percentile, and 90th percentile. The definitions and details of the features are described elsewhere (Aerts et al., 2014; Sun et al., 2018; Zhao K. et al., 2020). We extracted a total of 1,276 features for each subject.
Feature Selection, Model Construction, and Evaluation
First, Z-normalization was performed before feature selection. In the primary set, a two-sample t-test was performed on the 1,276 histogram features, and the features with P < 0.05 were selected for the next analysis. If the correlation coefficient of the two variables was greater than 0.9, we deleted the latter of the two variables to reduce the multicollinearity between the variables (Tang et al., 2019). For the selected features, the least absolute shrinkage and selection operator (LASSO) logistic regression based on 10-fold cross-validation was used for further feature selection and data dimensionality reduction in the primary set, which used the mean squared error (MSE) and the minimum λ as the feature selection criteria. The LASSO logistic regression is suitable for the regression of high-dimensional data and is widely used in binary classification machine learning studies (Huang et al., 2016; Nie et al., 2019; Ji et al., 2020; Zhao L. et al., 2020), including neuropsychiatric disease classification (Tang et al., 2017; Zhao et al., 2018; Zhang Y. et al., 2019; Zheng et al., 2019). The LASSO can reduce data dimensionality by compressing the unimportant feature coefficients to zero, and then a formula is generated using a linear combination of selected features that are weighted by their respective LASSO coefficients. The radiomic signature score (Rag-score) of each subject was calculated by the formula generated by the LASSO logistic regression algorithm. Rag-score is a comprehensive measurement that is calculated based on multiple significance features, and it can reflect the heterogeneity of the lesion, ROI, and volume of interest. It has been applied in radiomics-related studies and in the construction of classification models extensively (Tang et al., 2019; Ji et al., 2020; Zhao L. et al., 2020). In the 10-fold cross-validation, the primary set was divided into 10 parts: one part was left out for testing the model, and the model was trained on the remaining parts, with each part then repeated in turn. Receiver operating characteristic (ROC) curve analysis based on the Rag-score was performed, and we calculated the area under the curve (AUC), sensitivity, specificity, and accuracy to evaluate the diagnostic efficacy of the model. In the validation set, we calculated the Rag-score of each participant with the same features and the formula derived from the LASSO logistic regression algorithm in the primary set. The diagnostic performance of the model in the validation set was evaluated and validated. The threshold obtained by the ROC analysis in the primary set was used as the cutoff value to evaluate the performance. As described above, cross-validation in a small sample size leads to large error bars, and the predictive power of the fitted classifiers is arguable. We also calculated the 95% confidence interval (CI) of the AUC, sensitivity, and specificity (Gorriz et al., 2021).
Validating the Performance
To evaluate the robustness and generalization of the model performance, we performed the LASSO logistic algorithm with 5-fold cross-validation and leave-one-out (LOO) cross-validation for feature selection. We also reported the AUC, accuracy, sensitivity, specificity, and the 95% CI to evaluate the performance of the model.
Statistical Analysis
The statistical analysis of this study was conducted using MATLAB 2012b (MathWorks, Natick, MA, USA) and R version 3.6.12. The χ2 test was used to assess the sex differences between patients with PD and the HCs, and the independent samples t-test was used to estimate the differences between PD patients and HCs in age, years of education, and MMSE scores. LASSO and ROC analyses used the “glmnt” and “pROC” software packages in R software. P < 0.05 was considered statistically significant.
Results
Clinical and Demographic Characteristics
In the primary and validation sets, there was no statistically significant difference between the HCs and PD patients in terms of sex, age, years of education, and MMSE scores (Table 1).
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/624731/fnagi-13-624731-HTML/image_m/fnagi-13-624731-t001.jpg)
Table 1. Comparison of the general clinical data between healthy controls (HCs) and Parkinson’s disease (PD) patients in the primary and validation sets.
Radiomic Feature Selection, Radiomic Signature Score, and Discriminative Features
In the primary set, the two-way t-test after Z-standardization showed that 236 of the 1,276 features had intergroup differences (P < 0.05); the multicollinearity variables (correlation coefficient, r > 0.9) were deleted for the remaining 236 features. Finally, the remaining 129 features (Figure 2) underwent LASSO regression based on 10-fold cross-validation for further feature selection using MSE and the minimum λ as the feature selection criteria. When the MSE was minimum (λ = 0.069), there were 23 nonzero features (Figure 3), including the left middle frontal gyrus (Frontal_MidL)mean, right hippocampus (Hippocampus_R)mean, left inferior parietal gyrus (Parietal_InfL)mean, left paracentral lobule (Paracentral_LobuleL)mean, left thalamus (Thalamus_L)mean, left inferior cerebellum_9 (Cerebelum9L)minimum, left inferior occipital gyrus (Occipital_InfL)maximum, right inferior temporal gyrus (Temporal_InfR)maximum, left superior cerebellum_6 (Cerebelum6L)maximum, right supplementary motor area (Supp_MotorAreaR)standard deviation, left inferior occipital gyrus (Occipital_InfL)standard deviation, right precuneus (Precuneus_R)median, left parahippocampal gyrus (ParaHippocampal_L)skewness, right parahippocampal gyrus (ParaHippocampal_R)skewness, right amygdala (Amygdala_R)skewness, left middle occipital gyrus (Occipital_MidL)skewness, right inferior parietal gyrus (Parietal_InfR)skewness, left frontal middle gyrus (Frontal_MidL)kurtosis, left superior frontal gyrus (Frontal_SupL)10th percentile, left supplementary motor area (Supp_MotorAreaL)10th percentile, left inferior parietal gyrus (Parietal_InfL)10th percentile, right inferior parietal gyrus (Parietal_InfR)10th percentile, and the right thalamus (Thalamus_R)10th percentile (Figure 4 and Table 2). The Rag-score calculation formula is as follows:
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/624731/fnagi-13-624731-HTML/image_m/fnagi-13-624731-g003.jpg)
Figure 3. Feature selection using the LASSO model. (A) In the primary dataset, the penalization parameter λ was selected using 10-fold cross-validation LASSO method with the mean squared error (MSE) as the criterion. In this study, the minimum MSE was at λ = 0.069, log(λ) = –2.68. (B) LASSO coefficient profile of 129 radiomic features. There are 23 nonzero coefficient features at the optimal λ. LASSO, least absolute shrinkage and selection operator.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/624731/fnagi-13-624731-HTML/image_m/fnagi-13-624731-g004.jpg)
Figure 4. The brain regions of the selected features. The color bar value represents the feature weight value.
The Rag-scores of each subject are shown in Figure 5. It can be seen from the figure that the Rag-score can distinguish HCs and PD patients well in both the primary and validation sets.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/624731/fnagi-13-624731-HTML/image_m/fnagi-13-624731-g005.jpg)
Figure 5. The Rag-score for each subject in the primary (A) and validation (B) sets. Red bars represent the HC group and blue bars represent the PD group. The greater the score, the more likely it is to be PD. Rag-scores, radiomic signature scores; HC, healthy control; PD, Parkinson’s disease.
Model Evaluation
The ROC analysis of the Rag-scores in the primary set showed that the AUC was 0.974. When the cutoff value was 0.117, the sensitivity was 93.8%, the specificity was 90.6%, and the accuracy was 93.8% (Figure 6A and Table 3). The accuracy of the validation set was 90.0%, with a primary set threshold of 0.117 as the standard, and the sensitivity and specificity of the validation set were 90.9% and 88.9%, respectively (Figure 6B and Table 3).
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/624731/fnagi-13-624731-HTML/image_m/fnagi-13-624731-g006.jpg)
Figure 6. Receiver operating characteristic (ROC) analysis of the radiomic signature scores in the primary (A) and validation (B) sets.
Validation Analysis
To assess the effect of the cross-validation method, we repeated the LASSO regression process with 5-fold and LOO cross-validations. We found that our models achieved high classification performances with the 5-fold cross-validation and LOO cross-validation in both the primary and validation sets. However, the CIs were relatively wide, especially in the validation set (Table 3).
Discussion
In this study, we used the ALFF measurement of rs-fMRI data to perform feature selection and data dimensionality reduction by two-way independent samples t-test and LASSO logistic regression based on 10-fold cross-validation. We calculated the participants’ Rag-score and performed ROC analysis based on the selected features. The classification model had a high diagnostic efficiency, with an AUC of 0.966, a sensitivity of 92.9%, a specificity of 97.6%, and an accuracy of 95.2%. These results demonstrate that histogram analysis based on rs-fMRI can be used for the diagnosis of PD.
Radiomics was first proposed by Lambin et al. (2012). It can extract high-throughput quantitative features of medical images and can provide greater features than conventional image analysis methods, thus improving disease diagnosis and prognostic evaluation (Nie et al., 2019; Tang et al., 2019; Ji et al., 2020). It was first used for tumor heterogeneity evaluation, tumor diagnosis and differential diagnosis (Nie et al., 2019), prognostic evaluation (Zhao L. et al., 2020), and tumor recurrence (Tang et al., 2019; Ji et al., 2020), among other uses. Recent studies have also indicated that it has a great application value in neuropsychological diseases (Tang et al., 2017; Péran et al., 2018; Sun et al., 2018; Huang K. et al., 2019). Different from the previous radiomic studies in the field of oncology, they often have only one ROI. However, in our study, there are 116 brain ROIs. We therefore only extracted the first-order intensity statistical features—histogram features; otherwise, our model will have too many features. It is easy for a model to fall into a “curse of dimension” and model overfitting.
Rs-fMRI is widely used in the study of PD (Gu et al., 2016; Amoroso et al., 2018; Hohenfeld et al., 2018; Rispoli et al., 2018), and ALFF is one of its commonly used metrics (Hu et al., 2015; Gu et al., 2016). In this study, the ROI-based method (Tang et al., 2017; Sun et al., 2018) was used to extract the histogram features of the ALFF images in specific brain areas using the AAL 116 atlas, and the machine learning method was used for data dimensionality reduction and modeling to explore the diagnostic value of the rs-fMRI-based machine learning in PD.
In this study, we standardized the data before data analysis. This procedure is widely used in the preprocessing of machine learning, which can effectively reduce the influence of the different units between features or reduce the influence of signal changes in a larger image signal range, which is beneficial to the improvement of model performance (Pereira et al., 2009; Tang et al., 2019). Among them, the Z-standardization (Tang et al., 2019; Wang et al., 2020) used in this research is one of the most commonly used methods.
Most previous studies have extracted features based on the brain atlas, which only extracted the mean values of the metrics (such as ALFF, fractional anisotropy, mean diffusivity, regional homogeneity, functional connectivity, voxel-mirrored homotopic connectivity, etc.) in the ROI defined by the brain atlas (Dai et al., 2012; Cui et al., 2016; Ding et al., 2017; Tang et al., 2017; Sun et al., 2018; Zhou et al., 2020). In our study, we extracted not only the mean ALFF values in the predefined ROIs but also other histogram features, including the minimum, maximum, range, standard deviation, variance, median, skewness, kurtosis, 10th percentile, and the 90th percentile, which could more comprehensively reflect ALFF information in the predefined ROIs. Our method achieved great classification performance on both the primary set and the validation set. We found that these features could be used to distinguish PD patients and HCs, which indicated that these features have physiological significance. Tang et al. (2017) combined the mean diffusion tensor imaging metrics to detect HIV patients. The accuracy and AUC of the model were 83.08% and 0.911, respectively. A machine learning study using ALFF metrics to detect PD used the AAL 116 atlas to extract the mean ALFF features. The accuracy and AUC were 80.75% and 0.8109, respectively. Another study used the Harvard–Oxford atlas to extract the mean ReHo, ALFF, VMHC, gray matter volume, and FC features. The authors found that both random forest (accuracy = 0.8261, AUC = 0.9015) and support vector machine (accuracy = 0.8483, AUC = 0.9697) achieved the perfect accuracy and AUC for distinguishing between PD and HC subjects (Cao et al., 2020). Our results are better than those of these studies, which may indicate that our histogram analysis method can extract more information in the ROIs (Lambin et al., 2012; Gillies et al., 2016).
Radiomics can extract a large number of quantitative features; however, its data dimensionality is too high when compared with the sample size of most studies, making it is easy to fall into a “curse of dimensionality,” thus causing the model to overfit. Hence, the features must be selected for dimensionality reduction to obtain the most valuable features in order to improve the reliability and accuracy of the model (Gu et al., 2016; Péran et al., 2018; Rubbert et al., 2019; Wang et al., 2020). In our study, we performed a two-way independent samples t-test on the standardized data to select the features that were significantly different between groups for subsequent analysis. Then, we applied previous research data processing methods (Mo et al., 2019; Tang et al., 2019; Wang et al., 2020) and used correlation analysis to remove the features with high correlation coefficients in order to reduce the multicollinearity of variables. We chose a correlation coefficient threshold of 0.9 to remove highly correlated variables (Tang et al., 2019). The LASSO logistic regression is very suitable for high-dimensional data processing. It can select the most predictive radiomic features and compress the non-important feature coefficients to zero in order to achieve the purpose of data dimensionality reduction and feature selection (Huang K. et al., 2019; Wang et al., 2020). The linear combination of the selected features weighted by their respective coefficients was used to calculate the Rag-score of each subject, and the resulting Rag-score was analyzed by ROC analysis to evaluate the diagnostic efficacy of the model. In this study, LASSO based on 10-fold cross-validation was used for further dimensionality reduction and feature selection of the data; at the same time, the Rag-score of each subject was calculated and ROC analysis was performed to evaluate the performance of the model.
Previous studies (Varoquaux, 2018; Gorriz et al., 2021) have demonstrated that cross-validation in a small sample size leads to large error bars. Varoquaux (2018) also pointed out that the best way to solving the problem was to test the model performance across several datasets. Therefore, we divided the dataset into a primary set and an independent validation set, and we tested the model performance using the independent validation set. In our study, we found that our models achieved high classification performances with different cross-validation methods both in the primary and validation sets. However, the error bars were relatively large, especially in the validation set. Our findings are consistent with those of previous studies (Varoquaux, 2018; Gorriz et al., 2021). In spite of the arguable power of the model, cross-validation is the best tool available because it is the only non-parametric method to test for model generalization and it can measure the ability of the model to predict new data (Varoquaux, 2018). Currently, cross-validation is still the most popular method in use.
In this study, the discriminative brain areas that can be used for PD diagnosis are located in the frontal, temporal, parietal, occipital, and limbic lobes, as well as in the cerebellum and the thalamus, which are consistent with the results of previous PD studies (Szewczyk-Krolikowski et al., 2014; O’Callaghan et al., 2016; Chen et al., 2017; Tuovinen et al., 2018). Many studies have indicated that damage to the corticothalamus–striatum–cortical pathway and the reciprocal striatum–cerebellar loop is the basis of many clinical symptoms of PD, and the thalamus plays an important role in function regulation and conduction (Szewczyk-Krolikowski et al., 2014; O’Callaghan et al., 2016; Tuovinen et al., 2018). In this study, we found that the radiomic features of the bilateral thalamus are helpful in the diagnosis of PD. A previous study (O’Callaghan et al., 2016) showed that multiple brain areas of the cerebellum of PD patients were atrophied, including the bilateral lobules I–IV, VI, VII (crus I and crus II), VIIb, VIIIa, VIIIb, right V, and the cerebellar vermis. The study also indicated that the modulatory relationship of the subthalamic nucleus on intracerebellar connectivity was lost in PD patients and that there were extensive cerebellar–cortical network abnormalities. Tuovinen et al. (2018) found that the connections within the cerebellum and between the cerebellum and the sensorimotor network in PD patients increased, the connections between the cerebellum and the caudate nucleus, thalamus, and amygdala increased, and the connection between the supplementary motor area and the cingulate gyrus decreased. Chen et al. (2017) found that the bilateral cerebellar gray matter volume was reduced and that the functional connections among the bilateral cerebellum, angular gyrus, hippocampus, middle occipital gyrus, and posterior cingulate gyrus were abnormal. Hu et al. (2015) also showed that PD patients had cerebellum ALFF abnormalities and abnormal functional connections between the cerebellum and the left middle cingulate gyrus. In our study, we also found extensive brain dysfunction in the cerebellum and multiple gray matter areas, which is consistent with the findings of a previous study. Besides, previous studies (Szewczyk-Krolikowski et al., 2014; Hu et al., 2015; Lucas-Jiménez et al., 2015; Hou et al., 2016; Li et al., 2016; Huang L. C. et al., 2019) also found structural and functional abnormalities in the insula, lingual gyrus, paracentral lobule, right inferior temporal gyrus, parahippocampal gyrus, precuneus, middle frontal cortex, dorsolateral prefrontal lobe, and other brain areas, which were similar to the results of the present study. This study showed that radiomics based on rs-fMRI can effectively identify abnormal brain activity areas in PD patients and provide support for the interpretation of PD neural mechanisms.
This study has some limitations. Firstly, as obtaining a large dataset is difficult in neuroimaging, where data acquisition is costly, the sample size of this study is relatively limited, but compared with the sample sizes of previous intergroup comparison studies (Lei et al., 2017; Zhou M. et al., 2019) and some machine learning articles (Hou et al., 2016; Tang et al., 2017), the sample size of this study is relatively large. Previous studies (Sun et al., 2018; Huang K. et al., 2019) have shown that multimodal imaging and clinical indicators can improve the performance of machine learning models. This study only selected the ALFF of rs-fMRI as input variables. Subsequent work can incorporate more rs-fMRI metrics, different functional imaging sequences, and clinical measurements to explore its effect on the classification model. In this study, both the primary and validation sets confirmed that the model has good classification accuracy, but no external validation was performed to further verify the generalization ability of the model. Other machine learning models or methods, such as support vector machine (Zhou et al., 2020), convolution neural network (Zhang J. et al., 2019), deep neural network (Liu et al., 2020), and transfer learning (Wang S. et al., 2019), have also been applied in previous neuroimaging studies, and they can obtain great classification performance. A previous study (Wang S. H. et al., 2019) used AlexNet as the basic transfer learning model to identify alcoholism. The method yielded a sensitivity of 97.44 ± 1.15%, a specificity of 97.41 ± 1.51%, and an accuracy of 97.42 ± 0.95% on the test set. In another study (Wang S. H. et al., 2019) employing densely connected neural network as the basic algorithm for transfer learning to detect cerebral micro-bleedings, the model achieved 97.71% classification accuracy. In the future, we will try other machine learning methods to detect PD.
In conclusion, this study used rs-fMRI data to extract the histogram features of brain regions based on brain atlases and used machine learning analysis to build a PD classification model. The study showed that this method can classify PD patients and HCs well and effectively identify PD patients’ regions of abnormal brain function; furthermore, it can assist in the early diagnosis of PD and provide a means for PD mechanism research and clinical therapeutic efficacy evaluation.
Data Availability Statement
The original contributions presented in the study are included in the article, further inquiries can be directed to the corresponding author.
Ethics Statement
The studies involving human participants were reviewed and approved by Medical Research Ethical Committee of Nanjing Brain Hospital. The ethics committee waived the requirement of written informed consent for participation.
Author Contributions
DS conducted the experiment, performed the data processing and analysis, and wrote the manuscript. HZ, GW, and SW collected the data and performed the data processing and analysis. KR supervised the whole study, including experiments and manuscript writing. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by the Scientific Research Foundation for Advanced Talents, Xiang’an Hospital of Xiamen University (no. PM201809170011).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We thank the investigators for providing access to the data.
Footnotes
References
Adeli, E., Shi, F., An, L., Wee, C. Y., Wu, G., Wang, T., et al. (2016). Joint feature-sample selection and robust diagnosis of Parkinson’s disease from MRI data. NeuroImage 141, 206–219. doi: 10.1016/j.neuroimage.2016.05.054
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., et al. (2014). Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat. Commun. 5:4006. doi: 10.1038/ncomms5644
Amoroso, N., La Rocca, M., Monaco, A., Bellotti, R., and Tangaro, S. (2018). Complex networks reveal early MRI markers of Parkinson’s disease. Med. Image Anal. 48, 12–24. doi: 10.1016/j.media.2018.05.004
Balagurunathan, Y., Kumar, V., Gu, Y. H., Kim, J., Wang, H., Liu, Y., et al. (2014). Test-retest reproducibility analysis of lung CT image features. J. Digit. Imaging 27, 805–823. doi: 10.1007/s10278-014-9716-x
Berenguer, R., Pastor-Juan, M. D. R., Canales-Vázquez, J., Castro-García, M., Villas, M. V., Mansilla Legorburo, F., et al. (2018). Radiomics of CT features may be nonreproducible and redundant: influence of CT acquisition parameters. Radiology 288, 407–415. doi: 10.1148/radiol.2018172361
Cao, X., Wang, X., Xue, C., Zhang, S., Huang, Q., and Liu, W. (2020). A radiomics approach to predicting Parkinson’s disease by incorporating whole-brain functional activity and gray matter structure. Front. Neurosci. 14:751. doi: 10.3389/fnins.2020.00751
Chen, Y., Storrs, J., Tan, L., Mazlack, L. J., Lee, J. H., and Lu, L. J. (2014). Detecting brain structural changes as biomarker from magnetic resonance images using a local feature based SVM approach. J. Neurosci. Methods 221, 22–31. doi: 10.1016/j.jneumeth.2013.09.001
Chen, B., Wang, S., Sun, W., Shang, X., Liu, H., Liu, G., et al. (2017). Functional and structural changes in gray matter of parkinson’s disease patients with mild cognitive impairment. Eur. J. Radiol. 93, 16–23. doi: 10.1016/j.ejrad.2017.05.018
Cigdem, O., Beheshti, I., and Demirel, H. (2018). Effects of different covariates and contrasts on classification of Parkinson’s disease using structural MRI. Comput. Biol. Med. 99, 173–181. doi: 10.1016/j.compbiomed.2018.05.006
Cui, Z., Xia, Z., Su, M., Shu, H., and Gong, G. (2016). Disrupted white matter connectivity underlying developmental dyslexia: a machine learning approach. Hum. Brain Mapp. 37, 1443–1458. doi: 10.1002/hbm.23112
Dai, Z., Yan, C., Wang, Z., Wang, J., Xia, M., Li, K., et al. (2012). Discriminative analysis of early Alzheimer’s disease using multi-modal imaging and multi-level characterization with multi-classifier (M3). NeuroImage 59, 2187–2195. doi: 10.1016/j.neuroimage.2011.10.003
Ding, X., Yang, Y., Stein, E. A., and Ross, T. J. (2017). Combining multiple resting-state fMRI features during classification: optimized frameworks and their application to nicotine addiction. Front. Hum. Neurosci. 11:362. doi: 10.3389/fnhum.2017.00362
Gillies, R. J., Kinahan, P. E., and Hricak, H. (2016). Radiomics: images are more than pictures, they are data. Radiology 278, 563–577. doi: 10.1148/radiol.2015151169
Gorriz, J. M., Jimenez-Mesa, C., Romero-Garcia, R., Segovia, F., Ramirez, J., Castillo-Barnes, D., et al. (2021). Statistical agnostic mapping: a framework in neuroimaging based on concentration inequalities. Info. Fusion 66, 198–212. doi: 10.1016/j.inffus.2020.09.008
Gu, Q., Zhang, H., Xuan, M., Luo, W., Huang, P., Xia, S., et al. (2016). Automatic classification on multi-modal mri data for diagnosis of the postural instability and gait difficulty subtype of Parkinson’s disease. J. Parkinsons Dis. 6, 545–556. doi: 10.3233/JPD-150729
Heim, B., Krismer, F., De Marzi, R., and Seppi, K. (2017). Magnetic resonance imaging for the diagnosis of Parkinson’s disease. J. Neural Transm. 124, 915–964. doi: 10.1007/s00702-017-1717-8
Hohenfeld, C., Werner, C. J., and Reetz, K. (2018). Resting-state connectivity in neurodegenerative disorders: is there potential for an imaging biomarker? NeuroImage Clin. 18, 849–870. doi: 10.1016/j.nicl.2018.03.013
Hou, Y., Luo, C., Yang, J., Ou, R., Song, W., Wei, Q., et al. (2016). Prediction of individual clinical scores in patients with Parkinson’s disease using resting-state functional magnetic resonance imaging. J. Neurol. Sci. 366, 27–32. doi: 10.1016/j.jns.2016.04.030
Hu, X., Song, X., Li, E., Liu, J., Yuan, Y., Liu, W., et al. (2015). Altered resting-state brain activity and connectivity in depressed Parkinson’s disease. PLoS One 10:e0131133. doi: 10.1371/journal.pone.0131133
Huang, Y. Q., Liang, C. H., He, L., Tian, J., Liang, C. S., Chen, X., et al. (2016). Development and validation of a radiomics nomogram for preoperative prediction of lymph node metastasis in colorectal cancer. J. Clin. Oncol. 34, 2157–2164. doi: 10.1200/JCO.2015.65.9128
Huang, K., Lin, Y., Yang, L., Wang, Y., Cai, S., Pang, L., et al. (2019). A multipredictor model to predict the conversion of mild cognitive impairment to Alzheimer’s disease by using a predictive nomogram. Neuropsychopharmacology 45, 358–366. doi: 10.1038/s41386-019-0551-0
Huang, L. C., Wu, P. A., Lin, S. Z., Pang, C. Y., and Chen, S. Y. (2019). Graph theory and network topological metrics may be the potential biomarker in Parkinson’s disease. J. Clin. Neurosci. 68, 235–242. doi: 10.1016/j.jocn.2019.07.082
Ji, G. W., Zhu, F. P., Xu, Q., Wang, K., Wu, M. Y., Tang, W. W., et al. (2020). Radiomic features at contrast-enhanced CT predict recurrence in early stage hepatocellular carcinoma: a multi-institutional study. Radiology 294, 568–579. doi: 10.1148/radiol.2020191470
Kim, J., Criaud, M., Cho, S. S., Díez-Cirarda, M., Mihaescu, A., Coakeley, S., et al. (2017). Abnormal intrinsic brain functional network dynamics in Parkinson’s disease. Brain 140, 2955–2967. doi: 10.1093/brain/awx233
Lambin, P., Rios-Velazquez, E., Leijenaar, R., Carvalho, S., van Stiphout, R. G. P. M., Granton, P., et al. (2012). Radiomics: extracting more information from medical images using advanced feature analysis. Eur. J. Cancer 48, 441–446. doi: 10.1016/j.ejca.2011.11.036
Lei, X., Zhong, M., Liu, Y., Jin, X., Zhou, Q., Xi, C., et al. (2017). A resting-state fMRI study in borderline personality disorder combining amplitude of low frequency fluctuation, regional homogeneity and seed based functional connectivity. J. Affect. Disord. 218, 299–305. doi: 10.1016/j.jad.2017.04.067
Li, Y., Liang, P., Jia, X., and Li, K. (2016). Abnormal regional homogeneity in Parkinson’s disease: a resting state fMRI study. Clin. Radiol. 71, e28–e34. doi: 10.1016/j.crad.2015.10.006
Liu, M., Li, F., Yan, H., Wang, K., Ma, Y., Shen, L., et al. (2020). A multi-model deep convolutional neural network for automatic hippocampus segmentation and classification in Alzheimer’s disease. NeuroImage 208:116459. doi: 10.1016/j.neuroimage.2019.116459
Lucas-Jiménez, O., Díez-Cirarda, M., Ojeda, N., Peña, J., Cabrera-Zubizarreta, A., and Ibarretxe-Bilbao, N. (2015). Verbal memory in Parkinson’s disease: a combined dti and fMRI study. J. Parkinsons Dis. 5, 793–804. doi: 10.3233/jpd-150623
Mo, J., Liu, Z., Sun, K., Ma, Y., Hu, W., Zhang, C., et al. (2019). Automated detection of hippocampal sclerosis using clinically empirical and radiomics features. Epilepsia 60, 2519–2529. doi: 10.1111/epi.16392
Nie, P., Yang, G., Wang, Z., Yan, L., Miao, W., Hao, D., et al. (2019). A CT-based radiomics nomogram for differentiation of renal angiomyolipoma without visible fat from homogeneous clear cell renal cell carcinoma. Eur. Radiol. 30, 1274–1284. doi: 10.1007/s00330-019-06427-x
O’Callaghan, C., Hornberger, M., Balsters, J. H., Halliday, G. M., Lewis, S. J. G., and Shine, J. M. (2016). Cerebellar atrophy in Parkinson’s disease and its implication for network connectivity. Brain 139, 845–855. doi: 10.18597/rcog.3666
Peng, B., Wang, S., Zhou, Z., Liu, Y., Tong, B., Zhang, T., et al. (2017). A multilevel-ROI-features-based machine learning method for detection of morphometric biomarkers in Parkinson’s disease. Neurosci. Lett. 651, 88–94. doi: 10.1016/j.neulet.2017.04.034
Péran, P., Barbagallo, G., Nemmi, F., Sierra, M., Galitzky, M., Traon, A. P.-L., et al. (2018). MRI supervised and unsupervised classification of Parkinson’s disease and multiple system atrophy. Mov. Disord. 33, 600–608. doi: 10.1002/mds.27307
Pereira, F., Mitchell, T., and Botvinick, M. (2009). Machine learning classifiers and fMRI: a tutorial overview. NeuroImage 45, 199–209. doi: 10.1016/j.neuroimage.2008.11.007
Qin, C., Liang, Y., Tan, X., Leng, X., Lin, H., Zeng, H., et al. (2019). Altered whole-brain functional topological organization and cognitive function in type 2 diabetes mellitus patients. Front. Neurol. 10:599. doi: 10.3389/fneur.2019.00599
Rispoli, V., Schreglmann, S. R., and Bhatia, K. P. (2018). Neuroimaging advances in Parkinson’s disease. Curr. Opin. Neurol. 31, 415–424. doi: 10.1097/WCO.0000000000000584
Rubbert, C., Mathys, C., Jockwitz, C., Hartmann, C. J., Eickhoff, S. B., Hoffstaedter, F., et al. (2019). Machine-learning identifies Parkinson’s disease patients based on resting-state between-network functional connectivity. Br. J. Radiol. 92:20180886. doi: 10.1259/bjr.20180886
Srivastav, S., Fatima, M., and Mondal, A. C. (2017). Important medicinal herbs in Parkinson’s disease pharmacotherapy. Biomed. Pharmacother. 92, 856–863. doi: 10.1016/j.biopha.2017.05.137
Sun, H., Chen, Y., Huang, Q., Lui, S., Huang, X., Shi, Y., et al. (2018). Psychoradiologic utility of MR imaging for diagnosis of attention deficit hyperactivity disorder: a radiomics analysis. Radiology 287, 620–630. doi: 10.1148/radiol.2017170226
Szewczyk-Krolikowski, K., Menke, R. A. L., Rolinski, M., Duff, E., Salimi-Khorshidi, G., Filippini, N., et al. (2014). Functional connectivity in the basal ganglia network differentiates PD patients from controls. Neurology 83, 208–214. doi: 10.1212/WNL.0000000000000592
Tang, T. Y., Li, X., Zhang, Q., Guo, C. X., Zhang, X. Z., Lao, M. Y., et al. (2019). Development of a novel multiparametric MRI radiomic nomogram for preoperative evaluation of early recurrence in resectable pancreatic cancer. J. Magn. Reson. Imaging 52, 231–245. doi: 10.1002/jmri.27024
Tang, Z., Liu, Z., Li, R., Yang, X., Cui, X., Wang, S., et al. (2017). Identifying the white matter impairments among ART-naïve HIV patients: a multivariate pattern analysis of DTI data. Eur. Radiol. 27, 4153–4162. doi: 10.1007/s00330-017-4820-1
Wang, Y., Sun, K., Liu, Z., Chen, G., Jia, Y., Zhong, S., et al. (2020). Classification of unmedicated bipolar disorder using whole-brain functional activity and connectivity: a radiomics analysis. Cereb. Cortex 30, 1117–1128. doi: 10.1093/cercor/bhz152
Tuovinen, N., Seppi, K., de Pasquale, F., Müller, C., Nocker, M., Schocke, M., et al. (2018). The reorganization of functional architecture in the early-stages of Parkinson’s disease. Parkinsonism Relat. Disord. 50, 61–68. doi: 10.1016/j.parkreldis.2018.02.013
Varoquaux, G. (2018). Cross-validation failure: small sample sizes lead to large error bars. NeuroImage 180, 68–77. doi: 10.1016/j.neuroimage.2017.06.061
Wang, S., Tang, C., Sun, J., and Zhang, Y. (2019). Cerebral micro-bleeding detection based on densely connected neural network. Front. Neurosci. 13:422. doi: 10.3389/fnins.2019.00422
Wang, S. H., Xie, S., Chen, X., Guttery, D. S., Tang, C., Sun, J., et al. (2019). Alcoholism identification based on an alexnet transfer learning model. Front. Psychiatry 10:205. doi: 10.3389/fpsyt.2019.00205
Xu, Z., Zhang, J., Wang, D., Wang, T., Zhang, S., Ren, X., et al. (2019). Altered brain function in drug-naive major depressive disorder patients with early-life maltreatment: a resting-state fMRI study. Front. Psychiatry 10:255. doi: 10.3389/fpsyt.2019.00255
Zhang, J., Li, X., Li, Y., Wang, M., Huang, B., Yao, S., et al. (2019). Three dimensional convolutional neural network-based classification of conduct disorder with structural MRI. Brain Imaging Behav. 14, 2333–2340. doi: 10.1007/s11682-019-00186-5
Zhang, J., Su, J., Wang, M., Zhao, Y., Zhang, Q. T., Yao, Q., et al. (2017). The sensorimotor network dysfunction in migraineurs without aura: a resting-state fMRI study. J. Neurol. 264, 654–663. doi: 10.1007/s00415-017-8404-4
Zhang, Y., Zhang, H., Chen, X., Liu, M., Zhu, X., Lee, S. W., et al. (2019). Strength and similarity guided group-level brain functional network construction for MCI diagnosis. Pattern Recognit. 88, 421–430. doi: 10.1016/j.patcog.2018.12.001
Zhao, K., Ding, Y., Han, Y., Fan, Y., Alexander-Bloch, A. F., Han, T., et al. (2020). Independent and reproducible hippocampal radiomic biomarkers for multisite Alzheimer’s disease: diagnosis, longitudinal progress and biological basis. Sci. Bull. 65, 1103–1113. doi: 10.1016/j.scib.2020.04.003
Zhao, L., Gong, J., Xi, Y., Xu, M., Li, C., Kang, X., et al. (2020). MRI-based radiomics nomogram may predict the response to induction chemotherapy and survival in locally advanced nasopharyngeal carcinoma. Eur. Radiol. 30, 537–546. doi: 10.1007/s00330-019-06211-x
Zhao, B., Tan, Y., Tsai, W.-Y., Qi, J., Xie, C., Lu, L., et al. (2016). Reproducibility of radiomics for deciphering tumor phenotype with imaging. Sci. Rep. 6:23428. doi: 10.1038/srep23428
Zhao, F., Zhang, H., Rekik, I., An, Z., and Shen, D. (2018). Diagnosis of autism spectrum disorders using multi-level high-order functional networks derived from resting-state functional MRI. Front. Hum. Neurosci. 12:184. doi: 10.3389/fnhum.2018.00184
Zheng, Y., Chen, X., Li, D., Liu, Y., Tan, X., Liang, Y., et al. (2019). Treatment-naive first episode depression classification based on high-order brain functional network. J. Affect. Disord. 256, 33–41. doi: 10.1016/j.jad.2019.05.067
Zhou, B., An, D., Xiao, F., Niu, R., Li, W., Li, W., et al. (2020). Machine learning for detecting mesial temporal lobe epilepsy by structural and functional neuroimaging. Front. Med. 14, 630–641. doi: 10.1007/s11684-019-0718-4
Zhou, Z. W., Fang, Y. T., Lan, X. Q., Sun, L., Cao, Q. J., Wang, Y. F., et al. (2019). Inconsistency in abnormal functional connectivity across datasets of adhd-200 in children with attention deficit hyperactivity disorder. Front. Psychiatry 10:692. doi: 10.3389/fpsyt.2019.00692
Keywords: Parkinson’s disease, functional MRI, amplitude of low-frequency fluctuation, histogram analysis, least absolute shrinkage and selection operator, machine learning
Citation: Shi D, Zhang H, Wang S, Wang G and Ren K (2021) Application of Functional Magnetic Resonance Imaging in the Diagnosis of Parkinson’s Disease: A Histogram Analysis. Front. Aging Neurosci. 13:624731. doi: 10.3389/fnagi.2021.624731
Received: 01 November 2020; Accepted: 22 March 2021;
Published: 11 May 2021.
Edited by:
Juan Manuel Gorriz, University of Granada, SpainReviewed by:
Rivka R. Colen, University of Pittsburgh Medical Center, United StatesYudong Zhang, University of Leicester, United Kingdom
Copyright © 2021 Shi, Zhang, Wang, Wang and Ren. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ke Ren, renke815@sina.com