Multimodal MR Images-Based Diagnosis of Early Adolescent Attention-Deficit/Hyperactivity Disorder Using Multiple Kernel Learning

Attention-deficit/hyperactivity disorder (ADHD) is one of the most common brain diseases among children. The current criteria of ADHD diagnosis mainly depend on behavior analysis, which is subjective and inconsistent, especially for children. The development of neuroimaging technologies, such as magnetic resonance imaging (MRI), drives the discovery of brain abnormalities in structure and function by analyzing multimodal neuroimages for computer-aided diagnosis of brain diseases. This paper proposes a multimodal machine learning framework that combines the Boruta based feature selection and Multiple Kernel Learning (MKL) to integrate the multimodal features of structural and functional MRIs and Diffusion Tensor Images (DTI) for the diagnosis of early adolescent ADHD. The rich and complementary information of the macrostructural features, microstructural properties, and functional connectivities are integrated at the kernel level, followed by a support vector machine classifier for discriminating ADHD from healthy children. Our experiments were conducted on the comorbidity-free ADHD subjects and covariable-matched healthy children aged 9–10 chosen from the Adolescent Brain and Cognitive Development (ABCD) study. This paper is the first work to combine structural and functional MRIs with DTI for early adolescents of the ABCD study. The results indicate that the kernel-level fusion of multimodal features achieves 0.698 of AUC (area under the receiver operating characteristic curves) and 64.3% of classification accuracy for ADHD diagnosis, showing a significant improvement over the early feature fusion and unimodal features. The abnormal functional connectivity predictors, involving default mode network, attention network, auditory network, and sensorimotor mouth network, thalamus, and cerebellum, as well as the anatomical regions in basal ganglia, are found to encode the most discriminative information, which collaborates with macrostructure and diffusion alterations to boost the performances of disorder diagnosis.

1. Introduction

Attention-deficit/hyperactivity disorder (ADHD) has become one of the most common neurobehavioral disorders among children (Polanczyk et al., 2015). In 2016, 9.4% of children and adolescents aging 2–17 in the United States had ever been diagnosed with ADHD, 89.4% of which still kept the diagnosis at present (Danielson et al., 2018). Untreated ADHD can cause substance abuse and tremendous academic, social, and financial/employment burdens on the individual and family (Hamed et al., 2015), reflecting the importance of diagnosing and treating the disorder. Medication and behavioral intervention have been demonstrated to ameliorate the conditions of ADHD patients (Hoogman et al., 2019). To afford the affected ability to achieve their full potential in school or at home, ADHD is screened for and diagnosed as early as possible (Hamed et al., 2015). However, the most advanced standard of ADHD diagnosis is symptom-based, according to the Diagnostic and Statistical Manual of Mental Disorders, the 5th edition (Wolraich et al., 2019) (DSM-5), relying on the questionnaires collected from the parents or caregivers for young children. The multi-source reports, however, are subjective and usually cause inconsistency and bias. Therefore, the diagnosis of ADHD requires objective and quantizable evidence.

The advancement of high-resolution brain imaging technologies and high-throughput computing makes it possible to build a computer-aided diagnostic system for mental health disorders based on the quantitative features extracted from the images. The brain imaging technologies, such as magnetic resonance and computed tomography, have shown brightening perspectives to reveal the underlying pathophysiology of ADHD. MRI becomes the ideal technology to study brain diseases for its high-resolution inner tissue imaging capability. Structural MRI (sMRI), diffusion MRI (dMRI), and functional MRI (fMRI) have been widely applied in ADHD studies in recent years to explore the quantizable features indicating various-level brain alterations in cortical and subcortical measures, such as morphometric traits, diffusion properties, and functional connectivity (FC). However, these findings depend on the hypothesis tests between the experiment and control groups with small sample sizes, limiting the power for unveiling the relationship between features and building usable automatic diagnosis (Arbabshirani et al., 2017).

The growing minable image-based features motivated radiomics (Gillies et al., 2016), an emerging efficient paradigm aiming at quantitative image analytics and automatic diagnosis through recognizing intricate patterns among the high-dimensional traits from images (Hosny et al., 2018; Ibrahim et al., 2020). In this medical image analysis framework, the collected image data are segmented into regions of interest (ROIs). The features of multiple levels, including the intensity distribution, shape, and texture, are extracted from these ROIs and qualified. Subsequently, the predictive models are built on the features to support the decision-making for diagnostic or prognostic. The state-of-art machine learning and deep learning approaches have triggered vitality in the medical image recognition community (Hosny et al., 2018). The radiomics practices in automatic ADHD diagnosis have sprouted in the past 10 years along with the release of the ADHD-200 consortium (Milham et al., 2012; Bellec et al., 2017), the hitherto largest multimodal dataset concentrating on ADHD. ADHD-200 provides the sMRI and resting-state fMRI (rsfMRI) images and the personal characteristic features of 362 patients and 585 healthy people aging 7–27 aggregated from 17 different studies conducted across eight various sites. Based on the dataset, researchers extracted features from MRI data within clustered voxels or predefined ROIs and built machine learning algorithms for classification task. Support vector machine (SVM) has become the most popular classification model (Arbabshirani et al., 2017; Sakai and Yamada, 2019; Biswas et al., 2020; Lohmann et al., 2020) for its outperformance in multivariable data using appropriate kernel functions. Ghiassian et al. combined the sMRI or fMRI features with the characteristic features and applied RBF-SVM as classifiers for predicting ADHD (Ghiassian et al., 2016). However, most studies only use the sMRI or/and rsfMRI to diagnose ADHD; rare practice considered dMRI features, which is believed to reveal the critical microstructure abnormality in ADHD's brain (van Ewijk et al., 2012; Lei et al., 2014; Gehricke et al., 2017), into the predictive model. Moreover, the current multimodal studies directly concatenated all of the features to a large vector and fed it to the classifiers (Sun et al., 2018; Luo et al., 2020). Though the improved performance suggests that multiple modalities have complementary information for classification, the features encoding minor information and the curse of high dimension might impair such a strategy.

The current study applies multiple kernel learning (MKL) framework to fuse the sMRI, rsfMRI, and DTI features collected from the Adolescent Brain and Cognitive Development (ABCD) study and predict ADHD diagnosis. MKL, a commonly used model-based fusion strategy in multimodal learning (Baltrusaitis et al., 2019), has been verified to effectively integrate the heterogenetic source information by assigning specified kernels and weight to distinct modalities (Gönen and Alpaydın, 2011). It has been widely implemented in visual object recognition (Bucak et al., 2014), remote sensing (Niazmardi et al., 2018), hyperspectral image classification (Gu et al., 2017), and medical image fusion and classification (Wen et al., 2017; Schrouff et al., 2018; Wani and Raza, 2018). Our study focuses on comorbidity-free early adolescent patients aging 9–10. To solve the high-dimension problem, we apply Boruta, a random-forest-based feature selection method, to choose all the relevant features of ADHD. This technique is appropriate for the highly correlated network of human brain structures. We hypothesize that the MKL framework, the kernel-level multimodal fusion strategy, would achieve higher performance in the task of ADHD diagnosis based on multimodal imaging data, and the discovered all relevant predictors from multimodal MRI would help unveil the underlying mechanism of ADHD.

2. Materials and Methods

2.1. Dataset Description and Participants

ABCD study is the most extensive long-term study of brain development and child health in the United States, which recruited 11,878 children ages 9–10 in 21 research sites across the United States. This project sampled children through schools based on US society's demographic profile (Garavan et al., 2018) and keeps following them up through their adolescence to early adulthood for tracking their biological and behavioral development. Various MR imaging data, genomics data, and the scales and questionnaires of mental health, physical health, demographics, and neurocognition are deposited (Barch et al., 2018) and released yearly. The image data that children underwent include T1- and T2-weighted MRI, DTI, rsfMRI, and three task-based fMRI scans. After the image acquisition, these multimodal MR images were uploaded to the Data Analysis, Informatics, and Resource Center (DAIRC) of the ABCD Study. Then there, the quality control, image preprocessing, measuring based on multi-atlases, and tabulating were completed in a standard pipeline. The published paper (Hagler et al., 2019) from the ABCD team has stated the acquisition, scanning parameters, and processing pipelines in detail. For the brevity of the main text, we describe the images processing steps and acquisition parameters concisely in Supplementary Material. The relatively narrow and early age span, consistent diagnostic criteria across all the sites, and multimodal data sources characterize the ABCD study with the potential of studying the mental disorders' development trajectory. This work concentrates on the tabulated multiple-type image-based features, including the quantitative brain properties extracted from sMRI (T1/2 weighted parts), rsfMRI, and DTI, of the baseline year in release 2.0.1 (Jernigan et al., 2019) for further analysis of ADHD.

To label the ADHD patients, we reviewed the ABCD Parent Diagnostic Interview scale for DSM-5 Full of K-SADS of the baseline year for ADHD diagnosis. The subjects under the following conditions were excluded: with missing values in MRI scanning and the covariables, the left-handed, ever-experienced traumatic brain injury with loss of consciousness, the main comorbidities of ADHD (Homer et al., 2000; Wolraich et al., 2019), covering tic disorders, emotional disorders (phobia, anxiety disorders, disruptive mood dysregulation disorders, depression disorders, and bipolar disorders), autism spectrum, psychotic disorders, post-traumatic stress disorder, oppositional defiant disorders, and conduct disorders for reducing the influence of covariables as much as possible. According to the suggestion in the Fix Note of the ABCD study, we censored the subjects that detected clinical referrals or did not pass the quality control procedure of T1w, T2w, dMRI, and rsfMRI. The subjects scanned on Phillips machines were excluded due to incorrect post-processing of fMRI data noticed in the officially released issue. Without any ADHD-related diagnosis and symptoms or any other mental health diagnosis, the children were chosen to match the race and sex with ADHD as the typical controls (TC). The workflow in Supplementary Figure 2A shows the number of subjects that are considered after applying various exclusion criteria, and Supplementary Figures 2B,C with Supplementary Tables 1, 2 list the percentage and count of subjects filtered by each item within the groups. The demographic information of the matched groups of ADHD and TC is summarized in Table 1. There are no statistically significant differences in the main covariates of age, gender, and race.

TABLE 1

Table 1. Demographic description.

2.2. Imaging Measures

In our study, the cortical ROIs were labeled with structural-based atlas (Desikan-Killiany atlas, Desikan et al., 2006 for sMRI and DTI, major white matter tracts' AtlasTrack Hagler et al., 2009 for DTI), genetic-based atlas [fuzzy-cluster parcels (Chen et al., 2012) for sMRI], tract fiber atlas, and functional connectome atlas [Gordon parcellations (Gordon et al., 2016) for fMRI], and the subcortical regions were labeled with atlas-based segmentation (Fischl et al., 2002) (for sMRI, DTI, and fMRI). These brain atlases were frequently used in the corresponding modalities so that the accumulated publications would offer direct evidence supporting our findings.

In this work, the macrostructural property of the brain refers to the morphometry and image intensity measures extracted from sMRI. Morphometric measures consist of cortical volume, thickness, area, and sulcal depth, and subcortical volume. Image intensity measures include intensity properties of T1w, T2w, and T1w and T2w cortical contrast. The alterations in morphometry and intensity indicate the abnormal development and changed composition of brain tissue (Kotov, 2017; Bloem et al., 2018), which are common features of many neurological diseases. Cortical contrast has also been confirmed to serve as a sensitive cortical marker of brain development and psychopathology (Lewis et al., 2018; Norbom et al., 2019).

The major white fibers' volume and four measures accessing water diffusion in cortical and subcortical tissues, including fractional anisotropy (FA) and mean, longitudinal, and transverse diffusivity (MD, LD, and TD), were extracted from DTI to indicate microstructural tissue properties. The FA reflects directionality estimation in tissue characteristics like myelination and fiber density, and MD, LD, and TD characterize the diffusion magnitude in distinct directions (Alexander et al., 2007). These measures have been applied in image-based brain diseases analysis (van Ewijk et al., 2012; Lei et al., 2014; Gehricke et al., 2017).

For rsfMRI, the candidate features are functional connectivity of cortical function network and subcortical regions. The average correlation values were calculated between paired cortical function network ROIs and then transformed to z-score, representing the strength of FC (Van Dijk et al., 2010). Similarly, the FC between each network and each subcortical region was collected as well. FC reflects a straightforward, observational measure of functional relationships between the target networks, which has been a universal tool to analyze ADHD (Lin and Roth, 2017; Samea et al., 2019; Sörös et al., 2019).

The study considered 2,704 candidate predictors collected from the tree modalities (1,184 from sMRI, 1,182 from DTI, and 338 from rsfMRI) and modeled them to remove the scanners' fixed bias of batch effect with Combat (Johnson et al., 2007), the effectiveness of which has been confirmed in MRI-derived features in the recent years (Fortin et al., 2017, 2018; Yu et al., 2018). Details of the candidate predictors were listed in Supplementary Table 3, and the model and formulas of Combat were described in the Supplementary Materials.

2.3. Multimodal Feature Selection and Assessment

Boruta (Kursa and Rudnicki, 2010) is an outperformed all-relevant feature selection method based on the random forest (RF). Boruta concatenates shuffled features, named shadow features, with the original data and builds an RF classifier. The Gini impurity's decrease in each base decision tree indicates the contribution of features to classification. RF summarizes and normalizes the score for each feature. The original features that achieve higher scores than the highest in the shadow features are marked. The shuffling-scoring-marking procedures are iteratively executed, and a series of features set is selected. A binomial distribution is established to test if a given feature significantly scores higher than any random one until all the original features are confirmed relevant or rejected. P-value correction for multiple testing is considered. Comparing with the minimal optimal feature selection methods that try to find a compact feature subset to minimize the error of a classifier, all-relevant methods manage to pick up all features coding information usable for classification, the property of which is suitable for highly intercorrelated biomedical data (Kursa, 2014). It has been applied in various contexts, including ADHD image-based predictors finding (Sun et al., 2018), and achieved outstanding performance in robustness, efficiency, and effectiveness (Kursa, 2014; Speiser et al., 2019).

2.4. Multimodal Fusion and Disease Classification

SVM is a general framework of classification or regression based on the kernel method. Linear or non-linear kernel applied, SVM has rendered itself outperformance with other models in various domains. According to the dual problem of SVM, we supposed the optimized objective of the multiple kernel SVM as the following equation:

$\begin{array}{ll}{\displaystyle \underset{\alpha ,w}{\text{min}}}\frac{1}{2}{\displaystyle \sum _{i=1}^N}{\displaystyle \sum _{j=1}^N}{\alpha }_i{\alpha }_j{y}_i{y}_j{\displaystyle \sum _{m\in M}}{w}_m{k}_m(x_i^m,x_j^m)-{\displaystyle \sum _{i=1}^N}{\alpha }_i& (1)\end{array}$

$\begin{array}{l}s.t.{\displaystyle \sum _{i=1}^N}{\alpha }_i{y}_i=0,0\le {\alpha }_i\le C,i=1,2,\dots ,N\end{array}$

where $\{{({\{x_i^m\}}_{m\in M},y_i\}}_{i=1}^N$ are the samples with multiple feature sets ${\left\{x_i^m\right\}}_{m\in M}$ and label y_i of the training set with sample size N, k_m(·, ·) represents a positive definite Gram matrix or kernel, w_m is the weight assigned to the corresponding kernel with the constraint $\sum _{m\in M}{w}_m=1$, the ${\left\{{\alpha }_i\right\}}_{i=1}^N$ are the Lagrange multipliers introduced by dual algorithm, and C is the penalty assigned to misclassified samples. We solved the problem by iteratively searching the w_m and optimizing the ${\left\{{\alpha }_i\right\}}_{i=1}^N$. The decision function is given as Equation (2):

$\begin{array}{ll}f(x)=sign({\displaystyle \sum _{i=1}^N}{\alpha }_i^{*}{y}_i{\displaystyle \sum _{m\in M}}{w}_m^{*}{k}_m(x_i^m,x^m)+b^{*})& (2)\end{array}$

where ${\left\{x^m\right\}}_{m\in M}$ is the sample with M feature sets in the testing set, and ${\left\{{\alpha }_i^{*}\right\}}_{i=1}^N$, ${\left\{w_m^{*}\right\}}_{m\in M}$ and b^* are the optimized parameters, $b^{*}=y_j-\sum _i^N{\alpha }_i^{*}{y}_i\sum _{m\in M}{w}_m^{*}{k}_m(x_i^m,x_j^m)$.

Our study set the searching stride of w_m to 0.1 for the feature sets M, including DTI, rsfMRI, and sMRI. The kernel functions include linear kernel and radial basis function (RBF) kernel, the most popular kernel function for continuous features for its infinite kernel feature space to exploit the non-linear relationship. The kernel function implicitly projects the original data to a higher-dimensional space and measure the distance (or similarity) between two samples in that space. Classification performance is promoted via choosing a kernel suitable for specific data. The data from different modalities, however, are probably ideal for distinct kernel functions or different parameters. By linearly combining the kernels from different feature spaces, the integration of heterogenetic sources can be achieved at the kernel level. In the MKL framework, additional restrictions, such as setting any w_m = 0, can be given to tackle with modality missing.

Single-kernel SVMs were applied to each modality as the unimodal baseline and the directly concatenated multimodal features as the early fusion baseline. As a commonly used classifier in mental disorder studies, RF was implemented in both settings as a baseline.

2.5. Classifier Training and Cross-Validation

As shown in Figure 1, the 10-fold cross-validation was manipulated on the three modalities using the same division of subjects every fold, respectively. In an individual iteration, we performed Boruta selection on the training set to pick up all relevant features. The dataset of each modality shrunk to a smaller dimension. We constructed the kernel matrix for every modality and applied optimistic weight to fuse them by grid-searching. In each iteration, as shown in Figure 2, five-fold nested cross-validation was performed on the training set to search the optimistic parameters (C, from 10⁻⁴ ~ 10³), and the re-trained optimistic models were evaluated on the holdout testing set. The entire cross-validation process was repeated ten times. The all-relevant feature subsets from the repeated cross-validations were collected to determine the whole dataset's significantly essential predictors. We posed that the features were picked randomly as the null hypothesis. The ten iterations' expected frequency distributions were estimated by a binomial distribution B(p,N), where p was estimated as the mean fraction of selected features in the given modality's candidate features space, and N (=10) referred to the times of iterations. The significant ones were reported and discussed.

FIGURE 1

Figure 1. The pipeline of feature extraction and cross-validation Multiple Kernel Learning (MKL) classification. T1/2WI, T1 weighted imaging and T2 weighted imaging; rsfMRI, resting-state fMRI; DTI, diffusion tensor imaging; FA, fractional anisotropy; MD, mean diffusivity; LD, longitudinal diffusivity; TD, transverse diffusivity; RF, random forest; SVM, support vector machine. The used atlases include Desikan–Killiany atlas, fuzzy-cluster parcels, subcortical regions, AtlasTrack, and Gordon parcellations; the morphological features include subcortical region volume, cortical volume, thickness, area, and sulcal depth.

FIGURE 2

Figure 2. The CV and nested CV processes. CV, cross-validation. The parameter optimization of model was implemented on the inner CV and retrained optimized model was evaluated on the outer CV. The metrics of all fold were summarized as the expected performance of the model.

2.6. Performance Metrics

The main classification performance metrics, including AUC (area under the receiver operating characteristic curves), accuracy, sensitivity, specificity, and F1-score, are considered for evaluating the given diagnostic system. These metrics are originated from a confusion matrix. In our study's ambiance, condition positive samples are referred to subjects with ADHD, condition negative one's typical healthy subjects, prediction positive, and negative ones marked by the models. From the view of the models with a specific decision threshold, true-positive (TP) represents the count of subjects correctly labeled as ADHD, true-negative (TN) the count of ones correctly marked as TCs, and false-positive (FP) and false-negative (FN) the counts of misdiagnosis and missed diagnosis, respectively. Based on the definitions mentioned above, the metrics can be formulated as follows:

$\begin{array}{l}accuracy=\frac{TP+TN}{TP+TN+FP+FN}\end{array}$

$\begin{array}{l}sensitivity=\frac{TP}{TP+FN}\end{array}$

$\begin{array}{l}specificity=\frac{TN}{TN+FP}\end{array}$

$\begin{array}{l}F1score=\frac{2\times TP}{2\times TP+FP+FN}\end{array}$

Considering continuous decision thresholds from the strictest to the slackest, we can receive sequential pairs of sensitivity and specificity and plot the curve on the coordinate of 1 − specificity and sensitivity, the area under which is defined AUC. Accuracy, sensitivity, specificity, and F1-score are computed on the single probability cut-off = 0.5, while AUC, more comprehensive, evaluates the discriminative power under all thresholds. Therefore, we regarded AUC as the primary criterion of the models.

3. Results

This section will present the experimental results, including the selected features relevant to the ADHD disorder, the results of disorder diagnosis using the single modal and multimodal features and different fusion methods of multimodal features, and the effect of kernel weights for multiple kernel learning.

3.1. The Relevant Multimodal Features

The selected feature subset's average size was 4.7 (0.397% of all 1,184 features) for sMRI, 9.7 (0.821% of 1182) for DTI, and 12.8 (3.79% of 338) for rsfMRI shown as Figure 3A. With a p-value threshold of 0.05 (Holm–Bonferroni's multiple tests adjusted p-value, Holm, 1979), the features with significantly higher selection frequency were summarized, and we finally reported the intersection of significant features over ten independent experiments.

FIGURE 3

Figure 3. The brain regions and connectivity associated with attention-deficit/hyperactivity disorder (ADHD). (A) Macrostructural abnormal regions, (B) microstructural abnormal regions, and (C) abnormal functional connectivity The blue color represents a lessened measure in the ADHD group, while the red color represents a strengthened one. The more frequently they are picked in the selection procedure, the wider their bonds are.

We obtained four significant features from sMRI, six from DTI, and ten from rsfMRI, listed in Table 2. Their distributions in two groups were plotted in Supplementary Figure 2, with the total selection frequencies and p-values between groups. The ROIs related to macrostructure and microstructure abnormalities were mapped to virtual brains from different perspectives, as shown in Figures 3A,B, respectively. The abnormal functional connectivity is shown in Figure 3C.

TABLE 2

Table 2. Summarized predictors selected from multimodal MRI.

3.2. Comparison of Unimodal and Multimodal Classification

In unimodal contexts, we built SVMs and RF to classify ADHD and TC. Resting-state MRI features achieved a significantly higher AUC (0.655) than the other two modalities. DTI features reached their own best AUC of 0.600, while sMRI features' best AUC was 0.564. We found the RBF kernel was suitable for FC, while the classification of DTI properties performed better on the linear kernel. Macrostructure features showed no significant preference between the linear kernel and RBF kernel. The RF classifiers did not perform better than any SVMs in unimodal contexts. We concatenated all selected predictors and fed them to the same SVMs and RF models as baseline fusion strategies, early fusion, of multimodal features. The AUC of SVM arises up to 0.668, but the RF classifier's performance dropped. The results are shown in Figure 4 and Table 3.

FIGURE 4

Figure 4. (A) The average number of selected features from each modality; (B) AUC of unimodal and multimodal classification. LSVM, linear kernel SVM; RBFSVM, radial basis function kernel SVM; RF, random forest; MKL, multiple kernel learning. ^***Means that the p-value are less than 0.001.

TABLE 3

Table 3. Performances of unimodal and multimodal classification.

3.3. Comparison of Early Fusion and Kernel-Level Fusion

In the MKL framework, we fused the RBF kernel of sMRI features, a linear kernel of DTI features, and an RBF kernel of rsfMRI features. The AUC of MKL rose to 0.698, significantly higher than the early fusion strategies and any unimodal classifications. Besides the AUC, the accuracy and F1-score of MKL were 0.643 and 0.626, respectively, higher than any other context. The MKL's sensitivity and specificity were 0.609 and 0.676, which were better than most other classification settings but had limited improvement. Table 3 averaged the MKL frameworks' cross-validation performances of ten independent experiments. The statistically significant values were shown in Supplementary Table 4.

3.4. Effect of Kernel Weights for MKL-Based Multimodal Fusion

The searched optimal weights assigned to the three modalities are plotted in Figure 5A. The predictors from rsfMRI have a significantly larger weight than sMRI and DTI predictors. The heatmaps in Figures 5B–F showed the main metric values of MKL concerning different weights combinations assigned to sMRI, DTI, and rsfMRI features. The shape of the heatmap is an upper triangle because of the constraint w_s + w_rsf + w_d = 1. The vertices present the unimodality-based classification result in each triangle, the top left rsfMRI, the top right sMRI, and the bottom left DTI. Similarly, the triangle edges between any two vertices display bimodal classifications with different weights. The results of bimodal and trimodal MKL classification are tabulated in Table 4. The trimodal setting achieved the best AUC, accuracy, and specificity, suggesting that every modality contributes to the classification indispensably. RsfMRI contributed the most from bimodal to trimodal classification. The fusion of sMRI + rsfMRI with DTI kernel significantly boosts the five metrics as well. However, the best F1-score and sensitivity reached their best on the bimodal fusion of rsfMRI and DTI, meaning that sMRI features have no extra contribution. The statistically significant values are shown in Supplementary Table 5.

FIGURE 5

Figure 5. (A) The optimal weights of three modalities; (B–F) AUC, accuracy, sensitivity, specificity, and F1-score of different weight combinations in MKL, respectively. In each triangle, the vertices present the unimodality-based classification result, the top left rsfMRI, the top right sMRI, and the bottom left DTI. Similarly, the triangle edges between any two vertices display bimodal classifications with different weights.

TABLE 4

Table 4. Performances of bimodal and trimodal multiple kernel learning (MKL) classification.

4. Discussion

To the best of our knowledge, there is no other published study focusing on adolescent ADHD diagnosis based on the ABCD study. Our study proposed a kernel-level multimodal fusion and classification method for discriminating ADHD from the typical healthy controls. The kernel combination method assigned proper kernel functions and weights to the predictors from different modalities, including macrostructure properties, microstructure characters, and FC. The combined kernel can be naturally embedded into a typical SVM solver. The MKL shows better classification performance than unimodal or early fusion multimodal strategies on the ADHD image data from the ABCD study baseline year. Moreover, in the MKL framework, it is easy to quantify every modality's contributions, which are told by the optimal weights, propitious to explaining the result.

4.1. Support of Abnormality Findings

An RF-based all-relevant feature selection method, Boruta, was introduced to shrink the original feature space to discover all relevant brain image-based predictors for discriminating ADHD and TC. The predictors summarized in Figure 5 include four ROIs from macro-view, five ROIs from micro-view, and the connectivity related to nine cortical function networks and seven subcortical regions. The current literature can verify the anatomical regions and function networks. In our study, rsfMRI encodes the most information for distinguishing ADHD and TC. It achieves the best performance in unimodal testing and contributes to the most multimodal kernel for discriminating cases and controls. In the current literature, default mode network (DMN) (Cortese et al., 2012; Kucyi et al., 2015; Castellanos and Aoki, 2016), dorsal/ventral attention network (DAN and VAN) (Cortese et al., 2012; Kucyi et al., 2015; Castellanos and Aoki, 2016), sensorimotor network (SMN) (Cortese et al., 2012; Kucyi et al., 2015; Sörös et al., 2019), salience network (Sal) (Kucyi et al., 2015; Castellanos and Aoki, 2016), frontoparietal network (FP) (Cortese et al., 2012; Castellanos and Aoki, 2016), and auditory network (Aud) (Sörös et al., 2019) are the frequently reported abnormal FC in ADHD. On the other hand, the subcortical findings in connectivity, including pallidum (Castellanos and Aoki, 2016; Samea et al., 2019), thalamus (Bailey and Joyce, 2015), putamen (Cortese et al., 2012; Sörös et al., 2019), and cerebellum (Kucyi et al., 2015; Castellanos and Aoki, 2016), are in line with the existing literature, approved to play essential roles in the undergoing of ADHD. The DMN is selected most frequently in our study. As a network associated with task-irrelevant mental processes and mind wandering, DMN is usually suppressed when the subject is attending attention-needed external tasks. The abnormal hyperactivation of DMN will intrude on other task-related networks' functions, like attention and execution, and get the cognition distracted (Sonuga-Barke and Castellanos, 2007). Besides motor regulation, recent studies realized that the cerebellum intensively interacts in the activity, cognition, and emotion processes (Adamaszek et al., 2017; Sokolov et al., 2017; Schmahmann, 2019). We found the correlation between DMN and the cerebellum cortex gets decreased and diverging. Kucyi et al. has emphasized that the coupling between them, named CerDMN, plays an essential role in the cognition function mediated by cerebro-cerebellar interaction in ADHD (Kucyi et al., 2015). Moreover, the dysfunction within CerDMN can spread to other networks, including salience, dorsal attention, sensorimotor and frontoparietal networks (Kucyi et al., 2015). When it comes to the microstructural aspect, we found lower FA, which usually reflects axonal degeneration, in the right pars orbitalis parcellation. According to the prefrontal hypothesis of ADHD (Lin and Roth, 2017), the cerebral orbital region lesions associate with social disinhibition and impulse dyscontrol. We found the LD and MD increased in ADHD's right isthmus cingulate, a part of DMN, indicating the enhanced structural connectivity. The region associated with the left postcentral, located within SMN/Aud, has diminished FA value in ADHD. The MD was found to increase within ADHDs left amygdala, which was reported to receive inhibitory signals from the emotion control network (Dessel et al., 2020). As a transfer station connecting the cortex, basal ganglia, and cerebellum, the thalamus participates in modulating excitatory and inhibitory signals from both the ascending and descending pathways, which contributes to attention behaviors (Bailey and Joyce, 2015). We found the thalamus proper abnormality was related to both microstructure property (increased LD value) and FC with cortical networks (salience network and frontoparietal network). The area and volume decrease in the left caudal middle frontal of ADHD. This area was reported as the primary center of the frontal-striatum-thalamus circuit, responsible for cognitive and executive functioning (Audenaert et al., 2002) and associated with attention problems (Hoogman et al., 2019). The striatum, involving caudate, putamen, and pallidum, is regarded as a critical descending fiber bundle conducting the cerebral cortex and thalamus, maintaining muscular tension regulating fine motion. The recent study supported that striatum is involved in the hyperactivity pathogenesis of ADHD (Sörös et al., 2019).

It is interesting to notice the limited overlap of the ROIs summarized from the three modalities. For example, the basal ganglia regions, including pallidum, putamen, caudate, and thalamus, as well as the cerebellum, are frequently reported abnormal in ADHD in both macro-/micro-structure and function connection by existing literature (Greven et al., 2015; Castellanos and Aoki, 2016; Gehricke et al., 2017; Hoogman et al., 2017). However, we found that abnormal ROIs are more widespread in FC than structure. A study based on large-scale samples of ADHD reports that the cortical and subcortical structure abnormalities of ADHD are distinct across the lifespan (Hoogman et al., 2019). Given our study's relatively narrow age span, the misalignment might imply the asynchronous advancement of the macrostructural, microstructural, and brain functional abnormalities. Another possible reason is that FC is multi-linked by distinct nerve fiber tracts, which means there is no one-to-one relationship between FC and structural connectivity. The structural dysfunction of hub regions may lead to widespread functional connection anomalies. In our study, the coupling of FC predictors and structural, especially microstructural, predictors boost the ADHD diagnosis, suggesting the complementary advantage of multimodalities.

4.2. Effectiveness of MKL and Multimodal Features

The MKL framework achieves better performance than the single-kernel-based classifiers or RF classifiers that directly concatenate the features of all modalities. The kernel-level combination provides more flexibility to allocate distinct weights and kernel functions for individual modality. For example, string and categorical features cannot be concatenated with numeric features directly. Proper kernel functions can convert these heterogeneous features into comparable similarity scores (kernel matrix), which support weighted average. Like sMRI, dMRI, resting-state fMRI, task-based fMRI, CT, and electronic medical records, multiple data sources have become easily accessed these days in neuroscience. The kernel-based multimodal fusion method shows potentials in ADHD diagnosis.

In our experiment, rsfMRI drove the high performance, and the introduction of DTI brought significant classification improvement. However, the macrostructural features from sMRI did not show an impressive contribution, even though the kernels of sMRI and DTI shared comparable weights, which suggests FC coupled with microstructural property captures ADHD's profile in this age. The complicated relationship between functional and structural connectivity should be investigated further.

4.3. Comparison With Published Works

Up to now, most of the published works aiming at image-based ADHD diagnosis are based on ADHD-200. We chose several representative pieces of research for comparison. Their performances are listed in Table 5. We used additional features from DTI and outperformed the previous MKL method proposed by Dai et al. (Dai et al., 2012). However, our framework's performance only reached an above-average level in accuracy among the citations. These results could not illustrate that our MKL framework was inferior because we used a different dataset. The dataset of ADHD-200 has imbalanced demographic distribution between the cases and controls and the heterogeneity of ADHD diagnostic criteria and imaging sources (Milham et al., 2012). The winning team (Brown, 2012), from the University of Alberta, built the classifier on the phenotypic data of age, sex, handedness, and IQ and achieved the highest accuracy (62.5%) in this competition, even higher than image-based models or image-phenotype-mixed models, which has triggered discussion in the community about the usefulness of brain data in diagnosing a brain disorder (Brown, 2012; Arbabshirani et al., 2017). The brain's profile reflects the demographic divergence involving race, age, and gender. The underlying demographic/clinical differences between patients and health groups are believed to provide predictive power classification. However, the differences in demographic factors cannot be included in the diagnostic criteria. Meanwhile, the imbalance of the disease group's demographic distribution and control may cause false-positive findings that indicate the demography rather than mental diseases. The findings in these pieces of researches may originate from the imbalanced distribution of covariables between ADHD and its typical controls. Therefore, it is necessary to fix the covariables of demographic/clinical differences and look for more significant disease causes. In this study, we tried to cancel the covariable's intrinsic differences between groups to avoid false positives as much as possible. The batch effect of scanners was modeled and removed, which enabled the comparison among machines, and the main covariables were balanced between the groups, even though it may increase the classification difficulty.

TABLE 5

Table 5. Attention-deficit/hyperactivity disorder (ADHD) classification results from published studies.

Recently, Owens et al. (2021) reported cross-validated elastic net regression to predict a continuous measure of ADHD symptomatology. Elastic net regression can simultaneously implement feature selection and regression by adding weighted L1/L2 regularized terms to the linear model's loss, limiting the scale of variable coefficients for avoiding overfitting. The models were built on morphometric profiles extracted from sMRI and brain region activation properties measured during three tasks of working memory, inhibitory control, and reward processing separately. The demographic, personal characteristic, and medical features were considered in the regression models as covariables. They observed a robust effect (R² = 2%) of the working memory in predicting ADHD symptomatology and a dissipated impact (R² = 1%) of the morphometric profiles when introducing covariables into the regression model. This group reported that they did not get robust models when utilizing the elastic net to predict the diagnosis from KSADS. It is worth noting that our study used more features than the published research and two modalities, DTI and resting-state fMRI, that they did not explore. We canceled the covariable effects by balancing the dataset and avoided overfitting by explicitly selecting all relevant features before prediction. The RF-based feature selection method shrinks the data dimension directly. It supports discovering the non-linear relationship between the features and target, but the linear regression model has no such capacity. Our SVM and MKL models achieved modest prediction performance of ADHD diagnosis, even though the weak discriminative power of sMRI features is partially consistent with this published work.

5. Limitation and Conclusion

Our study has several limitations that should be considered. We tried to diminish the influence of ADHD's comorbidities by simply removing the subjects suffering these, so the advantage of the large sample size cannot be fully taken. Our study has approved that the MKL method possesses the potentials to take full advantage of multimodal features, yet the moderate classification performance might be hard to apply in clinical diagnosis at the nonce.

These studies have approved that the features from distinct neuroimages modalities, including sMRI, DTI, and rsfMRI, encode complementary information for ADHD diagnosis, and kernel-level fusion could improve classification performance. The literature confirmed the identified multimodal predictors in the current study, and each modality provided specific importance in the MKL model, where the FC showed the most discriminative power.

Data Availability Statement

Data used in the preparation of this article were obtained from the Adolescent Brain Cognitive Development (ABCD) Study (https://abcdstudy.org), held in the NIMH Data Archive (NDA). This is a multisite, longitudinal study designed to recruit more than 10,000 children age 9-10 and follow them over 10 years into early adulthood. The ABCD Study^® is supported by the National Institutes of Health and additional federal partners under award numbers U01DA041048, U01DA050989, U01DA051016, U01DA041022, U01DA051018, U01DA051037, U01DA050987, U01DA041174, U01DA041106, U01DA041117, U01DA041028, U01DA041134, U01DA050988, U01DA051039, U01DA041156, U01DA041025, U01DA041120, U01DA051038, U01DA041148, U01DA041093, U01DA041089, U24DA041123, and U24DA041147. A full list of supporters is available at https://abcdstudy.org/federal-partners.html. A listing of participating sites and a complete listing of the study investigators can be found at https://abcdstudy.org/scientists/workgroups/. ABCD consortium investigators designed and implemented the study and/or provided data but did not necessarily participate in the analysis or writing of this report. This article reflects the views of the authors and may not reflect the opinions or views of the NIH or ABCD consortium investigators. The ABCD data repository grows and changes over time. The ABCD data used in this report came from version 2.0.1. DOIs can be found at https://nda.nih.gov/study.html?id=721.

Author Contributions

XZ designed and implemented the multimodal ADHD classification pipeline, plotted the figures, and drafted this work. QL interpreted the found predictors related to ADHD. YG collected and interpreted the literature about ADHD. ZW undertook the statistical testing. HL and ML directed the experiment design and reviewed this article. All authors took part in the discussion of experiment design and edition of the article.

Funding

This work was partly supported by the National Key R&D Program of China 2018YFC0910500, Neil Shen's SJTU Medical Research Fund, and Clinical Research Plan of SHDC (Grant NO. SHDC2020CR1047B).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

It is appreciated that our colleagues, Zhaobin Wang from Shanghai Jiao Tong University and Dingjue Ji from Yale University, helped to explore the dataset and offered valuable advice to this work.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnins.2021.710133/full#supplementary-material

References

Adamaszek, M., D'Agata, F., Ferrucci, R., Habas, C., Keulen, S., Kirkby, K. C., et al. (2017). Consensus paper: cerebellum and emotion. Cerebellum 16, 552–576. doi: 10.1007/s12311-016-0815-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Alexander, A. L., Lee, J. E., Lazar, M., and Field, A. S. (2007). Diffusion tensor imaging of the brain. Neurotherapeutics 4, 316–329. doi: 10.1016/j.nurt.2007.05.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Arbabshirani, M. R., Plis, S., Sui, J., and Calhoun, V. D. (2017). Single subject prediction of brain disorders in neuroimaging: promises and pitfalls. Neuroimage 145, 137–165. doi: 10.1016/j.neuroimage.2016.02.079

PubMed Abstract | CrossRef Full Text | Google Scholar

Audenaert, K., Goethals, I., Van Laere, K., Lahorte, P., Brans, B., Versijpt, J., et al. (2002). Spect neuropsychological activation procedure with the verbal fluency test in attempted suicide patients. Nuclear Med. Commun. 23, 907–916. doi: 10.1097/00006231-200209000-00015

PubMed Abstract | CrossRef Full Text | Google Scholar

Bailey, T., and Joyce, A. (2015). The role of the thalamus in ADHD symptomatology and treatment. Appl. Neuropsychol. Child 4, 89–96. doi: 10.1080/21622965.2015.1005475

PubMed Abstract | CrossRef Full Text | Google Scholar

Baltrusaitis, T., Ahuja, C., and Morency, L.-P. (2019). Multimodal machine learning: a survey and taxonomy. IEEE Trans. Pattern Anal. Mach. Intell. 41, 423–443. doi: 10.1109/TPAMI.2018.2798607

PubMed Abstract | CrossRef Full Text | Google Scholar

Barch, D. M., Albaugh, M. D., Avenevoli, S., Chang, L., Clark, D. B., Glantz, M. D., et al. (2018). Demographic, physical and mental health assessments in the adolescent brain and cognitive development study: rationale and description. Dev. Cogn. Neurosci. 32, 55–66. doi: 10.1016/j.dcn.2017.10.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Bellec, P., Chu, C., Chouinard-Decorte, F., Benhajali, Y., Margulies, D. S., and Craddock, R. C. (2017). The neuro bureau ADHD-200 preprocessed repository. Neuroimage 144, 275–286. doi: 10.1016/j.neuroimage.2016.06.034

PubMed Abstract | CrossRef Full Text | Google Scholar

Biswas, S. D., Chakraborty, R., and Pramanik, A. (2020). “A brief survey on various prediction models for detection of ADHD from brain-MRI images,” in A Brief Survey on Various Prediction Models for Detection of ADHD from Brain-MRI Images, ICDCN 2020: 21st International Conference on Distributed Computing and Networking (Kolkata: ACM), 1–5. doi: 10.1145/3369740.3372775

CrossRef Full Text | Google Scholar

Bloem, J. L., Reijnierse, M., Huizinga, T. W. J., and Mil, A. H. M. (2018). MR signal intensity: staying on the bright side in MR image interpretation. RMD Open 4:e000728. doi: 10.1136/rmdopen-2018-000728

PubMed Abstract | CrossRef Full Text | Google Scholar

Brown, M. R. G. (2012). ADHD-200 global competition: diagnosing ADHD using personal characteristic data can outperform resting state fMRI measurements. Front. Syst. Neurosci. 6:69. doi: 10.3389/fnsys.2012.00069

PubMed Abstract | CrossRef Full Text | Google Scholar

Bucak, S., Jin, R., and Jain, A. K. (2014). Multiple kernel learning for visual object recognition: a review. IEEE Trans. Pattern Anal. Mach. Intell. 36, 1354–1369. doi: 10.1109/TPAMI.2013.212

PubMed Abstract | CrossRef Full Text | Google Scholar

Castellanos, F. X., and Aoki, Y. (2016). Intrinsic functional connectivity in attention-deficit/hyperactivity disorder: a science in development. Biol. Psychiatry Cogn. Neurosci. Neuroimaging 1, 253–261. doi: 10.1016/j.bpsc.2016.03.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, C. H., Gutierrez, E. D., Thompson, W., Panizzon, M. S., Jernigan, T. L., Eyler, L. T., et al. (2012). Hierarchical genetic organization of human cortical surface area. Science 335, 1634–1636. doi: 10.1126/science.1215330

PubMed Abstract | CrossRef Full Text | Google Scholar

Colby, J. B., Rudie, J. D., Brown, J. A., Douglas, P. K., Cohen, M. S., and Shehzad, Z. (2012). Insights into multimodal imaging classification of ADHD. Front. Syst. Neurosci. 6:59. doi: 10.3389/fnsys.2012.00059

PubMed Abstract | CrossRef Full Text | Google Scholar

Cortese, S., Kelly, C., Chabernaud, C., Proal, E., Di Martino, A., Milham, M. P., et al. (2012). Toward systems neuroscience of ADHD: a meta-analysis of 55 fMRI sudies. Am. J. Psychiatry 169, 1038–1055. doi: 10.1176/appi.ajp.2012.11101521

PubMed Abstract | CrossRef Full Text | Google Scholar

Dai, D., Wang, J., Hua, J., and He, H. (2012). Classification of ADHD children through multimodal magnetic resonance imaging. Front. Syst. Neurosci. 6:63. doi: 10.3389/fnsys.2012.00063

PubMed Abstract | CrossRef Full Text | Google Scholar

Danielson, M. L., Bitsko, R. H., Ghandour, R. M., Holbrook, J. R., Kogan, M. D., and Blumberg, S. J. (2018). Prevalence of parent-reported ADHD diagnosis and associated treatment among u.s. children and adolescents, 2016. J. Clin. Child Adolesc. Psychol. 47, 199–212. doi: 10.1080/15374416.2017.1417860

PubMed Abstract | CrossRef Full Text | Google Scholar

Desikan, R. S., Ségonne, F., Fischl, B., Quinn, B. T., Dickerson, B. C., Blacker, D., et al. (2006). An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage 31, 968–980. doi: 10.1016/j.neuroimage.2006.01.021

PubMed Abstract | CrossRef Full Text | Google Scholar

Dessel, J. V., Sonuga-Barke, E., Moerkerke, M., Oord, D. S. V., Lemiere, J., Morsink, S., et al. (2020). The amygdala in adolescents with attention-deficit/hyperactivity disorder: structural and functional correlates of delay aversion. World J. Biol. Psychiatry 21, 673–684. doi: 10.1080/15622975.2019.1585946

PubMed Abstract | CrossRef Full Text | Google Scholar

Eloyan, A., Muschelli, J., Nebel, M. B., Liu, H., Han, F., Zhao, T., et al. (2012). Automated diagnoses of attention deficit hyperactive disorder using magnetic resonance imaging. Front. Syst. Neurosci. 6:61. doi: 10.3389/fnsys.2012.00061

PubMed Abstract | CrossRef Full Text | Google Scholar

Fischl, B., Salat, D. H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., et al. (2002). Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron 33, 341–355. doi: 10.1016/S0896-6273(02)00569-X

PubMed Abstract | CrossRef Full Text | Google Scholar

Fortin, J. P., Cullen, N., Sheline, Y. I., Taylor, W. D., Aselcioglu, I., Cook, P. A., et al. (2018). Harmonization of cortical thickness measurements across scanners and sites. Neuroimage 167, 104–120. doi: 10.1016/j.neuroimage.2017.11.024

PubMed Abstract | CrossRef Full Text | Google Scholar

Fortin, J. P., Parker, D., Tune, B., Watanabe, T., Elliott, M. A., Ruparel, K., et al. (2017). Harmonization of multi-site diffusion tensor imaging data. Neuroimage 161, 149–170. doi: 10.1016/j.neuroimage.2017.08.047

PubMed Abstract | CrossRef Full Text | Google Scholar

Garavan, H., Bartsch, H., Conway, K., Decastro, A., Goldstein, R. Z., Heeringa, S., et al. (2018). Recruiting the abcd sample: design considerations and procedures. Dev. Cogn. Neurosci. 32, 16–22. doi: 10.1016/j.dcn.2018.04.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Gehricke, J.-G., Kruggel, F., Thampipop, T., Alejo, S. D., Tatos, E., Fallon, J., et al. (2017). The brain anatomy of attention-deficit/hyperactivity disorder in young adults-a magnetic resonance imaging study. PLoS ONE 12:e0175433. doi: 10.1371/journal.pone.0175433

PubMed Abstract | CrossRef Full Text | Google Scholar

Ghiassian, S., Greiner, R., Jin, P., and Brown, M. R. G. (2016). Using functional or structural magnetic resonance images and personal characteristic data to identify ADHD and autism. PLOS ONE 11:e0166934. doi: 10.1371/journal.pone.0166934

PubMed Abstract | CrossRef Full Text | Google Scholar

Gillies, R. J., Kinahan, P. E., and Hricak, H. (2016). Radiomics: images are more than pictures, they are data. Radiology 278, 563–577. doi: 10.1148/radiol.2015151169

PubMed Abstract | CrossRef Full Text | Google Scholar

Gönen, M., and Alpaydın, E. (2011). Multiple kernel learning algorithms. J. Mach. Learn. Res. 12, 2211–2268. doi: 10.5555/1953048.2021071

CrossRef Full Text | Google Scholar

Gordon, E. M., Laumann, T. O., Adeyemo, B., Huckins, J. F., Kelley, W. M., and Petersen, S. E. (2016). Generation and evaluation of a cortical area parcellation from resting-state correlations. Cereb. Cortex 26, 288–303. doi: 10.1093/cercor/bhu239

PubMed Abstract | CrossRef Full Text | Google Scholar

Greven, C. U., Bralten, J., Mennes, M., O'Dwyer, L., van Hulzen, K. J. E., Rommelse, N., et al. (2015). Developmentally stable whole-brain volume reductions and developmentally sensitive caudate and putamen volume alterations in those with attention-deficit/hyperactivity disorder and their unaffected siblings. JAMA Psychiatry 72, 490–499. doi: 10.1001/jamapsychiatry.2014.3162

PubMed Abstract | CrossRef Full Text | Google Scholar

Gu, Y., Chanussot, J., Jia, X., and Benediktsson, J. A. (2017). Multiple kernel learning for hyperspectral image classification: a review. IEEE Trans. Geosci. Remote Sens. 55, 6547–6565. doi: 10.1109/TGRS.2017.2729882

CrossRef Full Text | Google Scholar

Hagler, D. J., Ahmadi, M. E., Kuperman, J., Holland, D., McDonald, C. R., Halgren, E., et al. (2009). Automated white-matter tractography using a probabilistic diffusion tensor atlas: application to temporal lobe epilepsy. Hum. Brain Mapp. 30, 1535–1547. doi: 10.1002/hbm.20619

PubMed Abstract | CrossRef Full Text | Google Scholar

Hagler, D. J., Hatton, S., Cornejo, M. D., Makowski, C., Fair, D. A., Dick, A. S., et al. (2019). Image processing and analysis methods for the adolescent brain cognitive development study. Neuroimage 202:116091. doi: 10.1016/j.neuroimage.2019.116091

PubMed Abstract | CrossRef Full Text | Google Scholar

Hamed, A. M., Kauer, A. J., and Stevens, H. E. (2015). Why the diagnosis of attention deficit hyperactivity disorder matters. Front. Psychiatry 6:168. doi: 10.3389/fpsyt.2015.00168

PubMed Abstract | CrossRef Full Text | Google Scholar

Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scand. J. Statist. 6, 65–70.

Google Scholar

Homer, C. J., Blatz, R. D., Hickson, G. B., Miles, V. P., Newman, T. B., Shook, J. E., et al. (2000). Clinical practice guideline: diagnosis and evaluation of the child with attention-deficit/hyperactivity disorder. Pediatrics 105, 1158–1170. doi: 10.1542/peds.105.5.1158

PubMed Abstract | CrossRef Full Text | Google Scholar

Hoogman, M., Bralten, J. E, van Hulzen, K. J., Shumskaya, E., Wolfers, T., et al. (2017). Subcortical brain volume differences in participants with attention deficit hyperactivity disorder in children and adults: a cross-sectional mega-analysis. Lancet Psychiatry 4, 310–329. doi: 10.1016/S2215-0366(17)30049-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Hoogman, M., Muetzel, R., Guimaraes, J. P., Shumskaya, E., Mennes, M., Zwiers, M. P., et al. (2019). Brain imaging of the cortex in ADHD: a coordinated analysis of large-scale clinical and population-based samples. Am. J. Psychiatry 176, 531–542. doi: 10.1176/appi.ajp.2019.18091033

PubMed Abstract | CrossRef Full Text | Google Scholar

Hosny, A., Parmar, C., Quackenbush, J., Schwartz, L. H., and Aerts, H. J. W. L. (2018). Artificial intelligence in radiology. Nat. Rev. Cancer 18, 500–510. doi: 10.1038/s41568-018-0016-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Ibrahim, A., Primakov, S., Beuque, M., Woodruff, H. C., Halilaj, I., Wu, G., et al. (2020). Radiomics for precision medicine: current challenges, future prospects, and the proposal of a new framework. Methods 188, 20–29. doi: 10.1016/j.ymeth.2020.05.022

PubMed Abstract | CrossRef Full Text | Google Scholar

Jernigan, T. L., Casey, B., Clark, D., Colrain, I., Dale, A., Ernst, T., et al. (2019). Adolescent Brain Cognitive Development Study (ABCD) 2.0.1 Release.

Google Scholar

Johnson, W. E., Li, C., and Rabinovic, A. (2007). Adjusting batch effects in microarray expression data using empirical bayes methods. Biostatistics 8, 118–127. doi: 10.1093/biostatistics/kxj037

PubMed Abstract | CrossRef Full Text | Google Scholar

Kotov, S. (2017). “MRI morphometry of the brain and neurological diseases,” in New Insights into Morphometry Studies, ed P. M. Pares-Casanova (London: InTech), 47–60. doi: 10.5772/intechopen.69098

CrossRef Full Text | Google Scholar

Kucyi, A., Hove, M. J., Biederman, J., Van Dijk, K. R., and Valera, E. M. (2015). Disrupted functional connectivity of cerebellar default network areas in attention-deficit/hyperactivity disorder. Hum. Brain Mapp. 36, 3373–3386. doi: 10.1002/hbm.22850

PubMed Abstract | CrossRef Full Text | Google Scholar

Kursa, M. B. (2014). Robustness of random forest-based gene selection methods. BMC Bioinformatics 15:8. doi: 10.1186/1471-2105-15-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Kursa, M. B., and Rudnicki, W. R. (2010). Feature selection with the boruta package. J. Stat. Softw. 36, 1–13. doi: 10.18637/jss.v036.i11

CrossRef Full Text | Google Scholar

Lei, D., Ma, J., Du, X., Shen, G., Jin, X., and Gong, Q. (2014). Microstructural abnormalities in the combined and inattentive subtypes of attention deficit hyperactivity disorder: a diffusion tensor imaging study. Sci. Rep. 4:6875. doi: 10.1038/srep06875

PubMed Abstract | CrossRef Full Text | Google Scholar

Lewis, J. D., Evans, A. C., and Tohka, J. (2018). T1 white/gray contrast as a predictor of chronological age, and an index of cognitive performance. Neuroimage 173, 341–350. doi: 10.1016/j.neuroimage.2018.02.050

PubMed Abstract | CrossRef Full Text | Google Scholar

Lin, G., and Roth, R. M. (2017). The status of structural and functional MRI in adolescents with attention-deficit/hyperactivity disorder. Psychol. Injury Law 10, 209–222. doi: 10.1007/s12207-017-9296-4

CrossRef Full Text | Google Scholar

Lohmann, P., Galldiks, N., Kocher, M., Heinzel, A., Filss, C. P., Stegmayr, C., et al. (2020). Radiomics in neuro-oncology: basics, workflow, and applications. Methods 188, 112–121. doi: 10.1016/j.ymeth.2020.06.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Luo, Y., Alvarez, T. L., Halperin, J. M., and Li, X. (2020). Multimodal neuroimaging-based prediction of adult outcomes in childhood-onset ADHD using ensemble learning techniques. Neuroimage Clin. 26:102238. doi: 10.1016/j.nicl.2020.102238

PubMed Abstract | CrossRef Full Text | Google Scholar

Milham, M. P. P. D., Fair, D. P.-C., Mennes, M. P. D., and Mostofsky, S. H. M. D. (2012). The ADHD-200 consortium: a model to advance the translational potential of neuroimaging in clinical neuroscience. Front. Syst. Neurosci. 6:62. doi: 10.3389/fnsys.2012.00062

PubMed Abstract | CrossRef Full Text | Google Scholar

Niazmardi, S., Demir, B., Bruzzone, L., Safari, A., and Homayouni, S. (2018). Multiple kernel learning for remote sensing image classification. IEEE Trans. Geosci. Remote Sens. 56, 1425–1443. doi: 10.1109/TGRS.2017.2762597

PubMed Abstract | CrossRef Full Text | Google Scholar

Norbom, L. B., Doan, N. T., Alnas, D., Kaufmann, T., Moberget, T., Rokicki, J., et al. (2019). Probing brain developmental patterns of myelination and associations with psychopathology in youths using gray/white matter contrast. Biol. Psychiatry 85, 389–398. doi: 10.1016/j.biopsych.2018.09.027

PubMed Abstract | CrossRef Full Text | Google Scholar

Owens, M. M., Allgaier, N., Hahn, S., Yuan, D., Albaugh, M., Adise, S., et al. (2021). Multimethod investigation of the neurobiological basis of ADHD symptomatology in children aged 9-10: baseline data from the ABCD study. Transl. Psychiatry 11, 1–11. doi: 10.1038/s41398-021-01320-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Polanczyk, V. G., Salum, G. A., Sugaya, L. S., Caye, A., and Rohde, L. A. (2015). Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J. Child Psychol. Psychiatry 56, 345–365. doi: 10.1111/jcpp.12381

PubMed Abstract | CrossRef Full Text | Google Scholar

Sakai, K., and Yamada, K. (2019). Machine learning studies on major brain diseases: 5-year trends of 2014-2018. Jpn. J. Radiol. 37, 34–72. doi: 10.1007/s11604-018-0794-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Samea, F., Soluki, S., Nejati, V., Zarei, M., Cortese, S., Eickhoff, S. B., et al. (2019). Brain alterations in children/adolescents with ADHD revisited: a neuroimaging meta-analysis of 96 structural and functional studies. Neurosci. Biobehav. Rev. 100, 1–8. doi: 10.1016/j.neubiorev.2019.02.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Sato, J. R., Hoexter, M. Q., Fujita, A., and Rohde, L. A. (2012). Evaluation of pattern recognition and feature extraction methods in ADHD prediction. Front. Syst. Neurosci. 6:68. doi: 10.3389/fnsys.2012.00068

PubMed Abstract | CrossRef Full Text | Google Scholar

Schmahmann, J. D. (2019). The cerebellum and cognition. Neurosci. Lett. 688, 62–75. doi: 10.1016/j.neulet.2018.07.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Schrouff, J., Monteiro, J. M., Portugal, L., Rosa, M. J., Phillips, C., and Mourao-Miranda, J. (2018). Embedding anatomical or functional knowledge in whole-brain multiple kernel learning models. Neuroinformatics 16, 117–143. doi: 10.1007/s12021-017-9347-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Sen, B., Borle, N. C., Greiner, R., and Brown, M. R. G. (2018). A general prediction model for the detection of ADHD and autism using structural and functional MRI. PLoS ONE 13:e0194856. doi: 10.1371/journal.pone.0194856

PubMed Abstract | CrossRef Full Text | Google Scholar

Sidhu, G. S., Asgarian, N., Greiner, R., and Brown, M. R. G. (2012). Kernel Principal Component Analysis for dimensionality reduction in fMRI-based diagnosis of ADHD. Front. Syst. Neurosci. 6:74. doi: 10.3389/fnsys.2012.00074

PubMed Abstract | CrossRef Full Text | Google Scholar

Sokolov, A. A., Miall, R. C., and Ivry, R. B. (2017). The cerebellum: adaptive prediction for movement and cognition. Trends Cogn. Sci. 21, 313–332. doi: 10.1016/j.tics.2017.02.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Sonuga-Barke, E. J. S., and Castellanos, F. X. (2007). Spontaneous attentional fluctuations in impaired states and pathological conditions: a neurobiological hypothesis. Neurosci. Biobehav. Rev. 31, 977–986. doi: 10.1016/j.neubiorev.2007.02.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Sörös, P., Hoxhaj, E., Borel, P., Sadohara, C., Feige, B., Matthies, S., et al. (2019). Hyperactivity/restlessness is associated with increased functional connectivity in adults with ADHD: a dimensional analysis of resting state fMRI. BMC Psychiatry 19:43. doi: 10.1186/s12888-019-2031-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Speiser, J. L., Miller, M. E., Tooze, J., and Ip, E. (2019). A comparison of random forest variable selection methods for classification prediction modeling. Expert Syst. Appl. 134, 93–101. doi: 10.1016/j.eswa.2019.05.028

PubMed Abstract | CrossRef Full Text | Google Scholar

Sun, H., Chen, Y., Huang, Q., Lui, S., Huang, X., Shi, Y., et al. (2018). Psychoradiologic utility of mr imaging for diagnosis of attention deficit hyperactivity disorder: a radiomics analysis. Radiology 287, 620–630. doi: 10.1148/radiol.2017170226

PubMed Abstract | CrossRef Full Text | Google Scholar

Tan, L., Guo, X., Ren, S., Epstein, J. N., and Lu, L. J. (2017). A computational model for the automatic diagnosis of attention deficit hyperactivity disorder based on functional brain volume. Front. Comput. Neurosci. 11:75. doi: 10.3389/fncom.2017.00075

PubMed Abstract | CrossRef Full Text | Google Scholar

Van Dijk, K. R. A., Hedden, T., Venkataraman, A., Evans, K. C., Lazar, S. W., and Buckner, R. L. (2010). Intrinsic functional connectivity as a tool for human connectomics: Theory, properties, and optimization. J. Neurophysiol. 103, 297–321. doi: 10.1152/jn.00783.2009

PubMed Abstract | CrossRef Full Text | Google Scholar

van Ewijk, H., Heslenfeld, D. J., Zwiers, M. P., Buitelaar, J. K., and Oosterlaan, J. (2012). Diffusion tensor imaging in attention deficit/hyperactivity disorder: a systematic review and meta-analysis. Neurosci. Biobehav. Rev. 36, 1093–1106. doi: 10.1016/j.neubiorev.2012.01.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, P., Zhao, X., Zhong, J., and Zhou, Y. (2021). Localization and diagnosis of attention-deficit/hyperactivity disorder. Healthcare 9:372. doi: 10.3390/healthcare9040372

PubMed Abstract | CrossRef Full Text | Google Scholar

Wani, N., and Raza, K. (2018). “Chapter 3: Multiple kernel-learning approach for medical image analysis,” in Soft Computing Based Medical Image Analysis, eds N. Dey, A. S. Ashour, F. Shi, and V. E. Balas (London: Academic Press), 31–47. doi: 10.1016/B978-0-12-813087-2.00002-6

CrossRef Full Text | Google Scholar

Wen, H., Liu, Y., Rekik, I., Wang, S., Chen, Z., Zhang, J., et al. (2017). Multi-modal multiple kernel learning for accurate identification of tourette syndrome children. Pattern Recogn. 63, 601–611. doi: 10.1016/j.patcog.2016.09.039

CrossRef Full Text | Google Scholar

Wolraich, M. L., Hagan, J. F., Allan, C., Chan, E., Davison, D., Earls, M., et al. (2019). Clinical practice guideline for the diagnosis, evaluation, and treatment of attention-deficit/hyperactivity disorder in children and adolescents. Pediatrics 144:e20192528. doi: 10.1542/peds.2019-2528

PubMed Abstract | CrossRef Full Text | Google Scholar

Yu, M., Linn, K. A., Cook, P. A., Phillips, M. L., McInnis, M., Fava, M., et al. (2018). Statistical harmonization corrects site effects in functional connectivity measurements from multi-site fMRI data. Hum. Brain Mapp. 39, 4213–4227. doi: 10.1002/hbm.24241

PubMed Abstract | CrossRef Full Text | Google Scholar

Zou, L., Zheng, J., Miao, C., Mckeown, M. J., and Wang, Z. J. (2017). 3d CNN based automatic diagnosis of attention deficit hyperactivity disorder using functional and structural MRI. IEEE Access 5, 23626–23636. doi: 10.1109/ACCESS.2017.2762703

CrossRef Full Text | Google Scholar