DarkASDNet: Classification of ASD on Functional MRI Using Deep Neural Network

Non-invasive whole-brain scans aid the diagnosis of neuropsychiatric disorder diseases such as autism, dementia, and brain cancer. The assessable analysis for autism spectrum disorders (ASD) is rationally challenging due to the limitations of publicly available datasets. For diagnostic or prognostic tools, functional Magnetic Resonance Imaging (fMRI) exposed affirmation to the biomarkers in neuroimaging research because of fMRI pickup inherent connectivity between the brain and regions. There are profound studies in ASD with introducing machine learning or deep learning methods that have manifested advanced steps for ASD predictions based on fMRI data. However, utmost antecedent models have an inadequacy in their capacity to manipulate performance metrics such as accuracy, precision, recall, and F1-score. To overcome these problems, we proposed an avant-garde DarkASDNet, which has the competence to extract features from a lower level to a higher level and bring out promising results. In this work, we considered 3D fMRI data to predict binary classification between ASD and typical control (TC). Firstly, we pre-processed the 3D fMRI data by adopting proper slice time correction and normalization. Then, we introduced a novel DarkASDNet which surpassed the benchmark accuracy for the classification of ASD. Our model's outcomes unveil that our proposed method established state-of-the-art accuracy of 94.70% to classify ASD vs. TC in ABIDE-I, NYU dataset. Finally, we contemplated our model by performing evaluation metrics including precision, recall, F1-score, ROC curve, and AUC score, and legitimize by distinguishing with recent literature descriptions to vindicate our outcomes. The proposed DarkASDNet architecture provides a novel benchmark approach for ASD classification using fMRI processed data.

1. Introduction

Autism spectrum disorder (ASD) is also familiar as a “spectrum” disorder that can cause different abnormalities such as social deficits, repetitive behaviors, speech, and nonverbal communication (Baio et al., 2018; Noriega, 2019). The fact-finding for the frequency of ASD is estimated at about 1% or higher (1 subject in 54, Figure 1) by the Center for Disease Control and Prevention in the United States (Senn, 2020). Previous treatments are based on the behavior observations of the patients, and the doctor asks a lot of psychological questions to the patient or their parents or guardians (Höfer et al., 2017; Hyman et al., 2020). These questionnaires often produce a false positive rate. The principal goal of neuroscience research is to sort out brain disorder treatment in an effective way (Yahata et al., 2016; Ahmed et al., 2018). Nevertheless, when patients seek a doctor for their treatment, sometimes the diagnosis of ASD is burdensome due to a lack of proper symptoms and the process requiring too much time (Mandell et al., 2007; Nylander et al., 2013). In consequence, it is indispensable to come up with conscientious techniques that can easily get make the diagnosis ASD more meticulous and efficient in an assessable way beyond depending utterly on behavioral questions.

FIGURE 1

Figure 1. Estimated ASD prevalence of 2020 by CDC.

The increasing investigation of neuroimaging research using up-to-date technologies in the last few years led to the classification of ASD, resulting in more effective performance in treatment (Bi et al., 2018). With the help of fMRIs, we can inspect the abnormalities between ASD vs. TC by analyzing functional connectivity (Kaiser et al., 2010; Lee et al., 2018). After introducing machine learning (ML) in neuroimaging, it becomes a legitimate means to obtain information from the raw data to illustrate the pattern of the disease (Klöppel et al., 2012). Amongst the ML approaches, in the area of neuroimaging research, support vector machines (SVM) is a powerful classifier to classify the problems (Sundermann et al., 2014; Chen et al., 2016).

Region of interest (ROI) bestows the structural medium, quantifying connectivities within the individual brain's active functional patterns. Many researchers investigate ASD individuals based on data-driven strategies or brain parcelation, such as independent component analysis (ICA), clustering, and dictionary learning by adopting ROI techniques (Cociu et al., 2018; Bi et al., 2019). Although the ROI strategy has some limitations regarding the arbitrary decision and standardization, considering the special regions can be biased for the subjects (Thirion et al., 2014). To overcome these challenges, support vector machines (SVM) have been extensively utilized to manipulate individual brain functional connectivity variation and classify ASD (Yao et al., 2016; Wang et al., 2019). Recently, DL (Deep Learning) approaches have been successfully deployed in neuroimaging research to identify ASD disorder (Li et al., 2018b). Although most of the DL methods used functional connectivity, time-series data analysis, ROI analysis, and spatial or temporal information of fMRI data (Iidaka, 2015; Zhao et al., 2018a), some have issues such as clinical application, lack of model comprehensibility.

As we observed from the recent findings, there are still some drawbacks to overcome in ASD classification using deep learning knowledge, such as lack of data mining techniques from the heterogeneous, complex fMRI data and model interpretation to classify ASD. Besides, a large group of scientists adopted ROIs, or functional connectivity (FC) features to classify ASD. As ASD is heterogeneous, a more pertinent approach is required to classify ASD patients from a typical control. In this paper, we consider a novel DL algorithm for ASD classification to overcome these challenges. The pivotal contributions in this experiment are as follows:

• We preprocessed 3D fMRI data according to the model input requirement through slice-time correction and min-max normalization. We preferred min-max scaling so that data variables can contribute equally and overcome the model biases during training of the classification model.

• We improved the original DarkNet and proposed a novel framework named DarkASDNet for ASD classification. Our proposed framework's main advantage is that it has a fast operating speed and is easily interpretable to weigh against other state-of-the-art methods.

• Finally, to evaluate DarkASDNet performances using the preprocessed fMRI data, we contemplated metrics functioning such as recall, precision, F1-score, and accuracy with ROC curve and AUC score and legitimized our outcomes by distinguishing with recent literature descriptions.

The designed DarkASDNet framework with fMRI processing steps provides a novel benchmark approach for ASD classification on the Autism Brain Imaging Data Exchange (ABIDE) dataset.

2. Related Work

The coalescence of brain imaging and machine learning approach concession of ASD classification can alleviate the critical affliction and give precautions to the patient's day-by-day prosperity. Research for brain networks using functional connectivity is a robust method for understanding the neurological bases of various brain disorders, for example, autism (Pascual-Belda et al., 2018). Abraham et al. used a support vector classifier (SVC) in 871 resting-state fMRI data to classify ASD vs. TC and got an accuracy of about 67% (Abraham et al., 2017). According to work in Jin et al. (2015), they proposed the SVM to classify ASD and got the highest accuracy of 76% during testing results with the original multi-kernel.

In Parikh et al. (2019), k-fold cross-validation was promulgated to measure classification performance using specificity, sensitivity, accuracy, and area under the curve (AUC). In Yu et al. (2020), a reverse mapping system was anticipated to further learn reverse mapping to assist mining and representation of task dependencies. Then, an adversarial assumption training approach combined a multi-tasking learning network with a reverse mapping network. Finally, an MRI of the two network parameters learned from the source was shared with target imaging CT (computed tomography). In Zhang et al. (2018), their method treated data at various points in time as different perspectives and built an overarching representation to collect complementary data from the entire time period. The potential representation investigates the complementarity between various time points in order to increase prediction accuracy. The problem is solved using the Alternate Direction Method of Multiplier (ADMM).

For the classification and identification of the regions of interest (ROIs) of functional connectivity magnetic resonance imaging (FC-MRI), Yang et al. (2019) deal with different ML algorithms, including SVM, ridge, and logistic regression where the highest accuracy of 71.98% obtained by ridge classifier. Multiple stacked auto-encoder (SAE) was considered by Guo et al. (2017) as a feature selection technique by ROIs from whole-brain FC. They obtained a classification accuracy of 86.36% utilizing only one data site named UM (University of Michigan) from ABIDE. However, ROIs for the time series data can illustrate and classify ASD from the whole brain. Usually, ROI figures out the functional connectivity pattern and activation of the brain (Eickhoff et al., 2015; Cociu et al., 2018). Dvornek et al. integrated rs-fMRI phenotypic data and obtained an accuracy of 70.1% by deploying LSTM (Long short-term memory) (Dvornek et al., 2018). Without the cross-validation and global signal regression system, they used CCS pipeline data.

In particular, maintaining the 3D and 2D data with the Convolutional Neural Network (CNN) from the DL methods, opens a new era for the classification and segmentation tasks (Parisot et al., 2017; Li et al., 2018a). In order to classify and distinguish ASD from healthy controls, Zhao et al. (2018b) assessed a satisfactory 3D CNN to unite the distinctiveness of functional and spatial brain networks. They integrated only two hundred rs-fMRI (ASD-100, HC-100) data. For the neuropathological biomarker, another way to recognize the brain's patterns is graph convolutional neural networks (G-CNN). Ktena et al. (2017) introduced the connectome-based classification model by applying CNN. Anirudh and Thiagarajan (2019) investigated ensemble learning and G-CNN to classify the problems and achieved 70.86% testing accuracy. Khosla et al. (2018) employed the connectivity fingerprint as a voxel input for the 3D convolutional neural network (CNN) with an accuracy of 73.3% and with ensemble CNN of 75.8%. Wutao et al. learned the features from the raw features by using an autoencoder (AE; Yin et al., 2020). Finally, they amalgamated the pretrained AE and DNN, which leads to an AUC of 82.4% and an accuracy of 79.2%. According to Ahmed et al. (2020), this was performed per site classification to see the data variability. The ABIDE-NYU dataset achieved the highest accuracy of 86 and 88% for stat map and glass brain images, using improved CNN architecture. On the other hand, in Kong et al. (2019), the authors extracted the ROI connectivity features for ASD classification using deep neural network (DNN). They used ABIDE-I, NYU dataset with 10-fold cross-validation. Using the softmax classifier and the stacked autoencoder (SAE) to get the most promising results for the ABIDE-NYU site of 90.39% accuracy according to our best knowledge.

The contemporary scientific knowledge for ASD classification is summarized in Table 1. According to Table 1, it is evident that most of the researcher goes through for classification purposes with functional connectivity (FC) or ROIs data for their work. We noticed there had been an inclination to use machine or deep learning approaches to solve classification problems. In the meantime, with the ABIDE dataset, a preponderance of works focused on a particular atlas, site, or pipeline image to overcome the classification problems. Medical image data are practically preferable to convalesce concrete contributions in the field of brain disorder research like ASD for treatment and reliability (Ravì et al., 2016; Phinyomark et al., 2017). To overcome these challenges, we preprocess every single slice from the whole brain images for each ABIDE-NYU dataset subject. We build DarkASDNet to extract features for the classification problems and check the stability of our model. We executed confusion metrics for precision, recall, F1-score, ROC curve, and AUC value.

TABLE 1

Table 1. A concise representation of the erstwhile deep learning algorithms in autism classification.

3. Materials and Methodology

3.1. Dataset

In our experiments, we used ABIDE-I data processed through the Connectome Computation System (CCS) (Craddock et al., 2013). The raw 3D NIFTI fMRI data has been downloaded from ABIDE-I through the CCS pipeline, a publicly available dataset for ASD and TC. Among the 17 sites, we endeavor with the CCS-NYU (New York University Langone Medical Center) site. The publicly available CCS was preprocessed, including a register of the anatomical brain mask to functional image: FLIRT, slice time correction: 3dTshift, Skull-strip: AFNI's 3dAutomask, motion correction: 3dvolreg, voxel intensity normalization, nuisance signal removal, band-pass filtering (0.01–0.1 Hz) [http://preprocessed-connectomes-project.org/abide/ccs.html]. The phenotypic information of the CCS-NYU dataset is shown in Table 2.

TABLE 2

Table 2. NYU phenotypic data information for ABIDE-I database.

3.2. Data Preprocessing

The CCS ABIDE data preprocessing pipelines are analogous due to the parameters and software used for each of the steps. The CCS parameters and steps are presented in Table 3. In this work, data are selected from the filt_global preprocessing stratagem, which is band-pass filtered (0.01–0.1 Hz) and spatially registered using a nonlinear method to MNI152 template space for each of four pipelines. The overall 3D fMRI data processing procedure is shown in Figure 2. For data processing, firstly, we loaded the 3D fMRI data and saved it as 2D images. To pursue this process, we proceeded with the slice time corrections and normalizations. The whole steps are explained briefly in the following section.

TABLE 3

Table 3. Overview of the basic parameters and steps of used by CCS.

FIGURE 2

Figure 2. The overview of the 3D fMRI data processing for both ASD and TC.

3.2.1. Slice-Time Correction

The original 3D fMRI data has 73 slices per volume according to the data description of ABIDE-I. In our experiments, from the 73 slices, we contemplated the last 50 slices because of the precise sketches of the brain images.

3.2.2. Normalization

Normalization is a process wherein the database is reoriented in such a way that users can suitably handle that for further interrogation and analysis. We used the Min-Max normalization technique to overcome the image inappropriateness, which transformed the images into numerical values from 0 to 1.

$\begin{array}{ll}{Y}_i=\left[X_i-min(X)\right]/\left[max(X)-min(X)\right]& (1)\end{array}$

Where X_i is the ith data point, min and max stands for minimum and maximum, and Y_i is the converted output.

3.3. Proposed DarkASDNet Model

The appositeness of the deep learning approach has to be remolded in artificial intelligence, helping to find neuropsychiatric brain disorders such as ASD. Deep learning is designated with the increasing number of layers as well as the network. An exemplary CNN performed for the feature extraction by the convolution layer, and reduced the size of the computational operation and a fully connected layer before the classification. The overall demonstration of our conceptual DarkASDNet architecture is presented in Figure 3. Here, DN represents the set-up for the convolutional layer, batch normalization layer, and max-pooling layer in sequential order. For the time being, 3^*DN is betoken for the three times of DN ensuing one after another DN block. There are a considerable number of deep learning algorithms. In this work, we have followed the Darknet-19 model (Redmon and Farhadi, 2017) for our experiment and updated this model to get the utmost accuracy. The Darknet-19 preeminently builds for classifier object detection where they used 19 convolutional layers, 5 Maxpooling layers, and disparate stride values, sizes, and filter numbers. In this work, we proposed DarkASDNet for classifying the autism brain images between ASD vs. TC. For this reason, we have originated 20 Convolutional layers and six Max pooling layers.

FIGURE 3

Figure 3. The proposed DarkASDNet framework for ASD classification.

Where Convol represents the 2D Convolution, and MP stand for Max pooling layers. Each Convolutional layer come out with Batch Normalization (BN) and LeakyReLU operations. There has been the same set-up when we are using three Convolutional layers in successive order. For the two-dimensional convolution operation, kernel is epitomized as K and input images as X, while * is symbolized as discrete convolution operation, as given in the following Equation (2).

$\begin{array}{ll}{(X\ast K)}_{(i,j)}={\displaystyle \sum _m}{\displaystyle \sum _n}{K}_{(m,n)}{X}_{(i-m,j-n)}& (2)\end{array}$

The superiority of adopting batch normalization is increased learning rate, improved gradient flow, reduced dependency on initialization, standardized inputs, and reduced training time to overcome the overfitting problem. Although ReLu (Rectified Linear Unit) or Sigmoid activation functions are prominent in deep learning, we used LeakyReLU as our activation function. Unlike ReLu, LeakyReLU has the biggest advantages in calculating the negative part which forestalls dying neurons. The mathematical formula for LeakyRelu is shown in Equation (3).

$\begin{array}{ll}f(x)=\{\begin{array}{ll}0.01x,& \text{for }x<0\\ x,& \text{for }x>0\end{array}& (3)\end{array}$

Resembling the DarkNet-19, Maxpool has the same operation in our model. It has several advantages, such as reducing the number of parameters to get prime information, diminishing the computational cost, and preventing over-fitting by fixing up with an abstracted form of the depiction. To classify the binary classification problem, we inked the loss function called Cross-Entropy Loss, and for the optimization, we set the Adam optimizer. The main ascendancy of using the Cross-Entropy loss function in binary classification problems is that it can reduce the distance between predicted and actual. The equation for the binary classification of the Cross-Entropy Loss function as follows.

$\begin{array}{ll}CE=-{\displaystyle \sum _{i=1}^{C^{\prime }=2}}{t}_{i}log(s_i)=-t_{1}log(s_1)-(1-t_1)log(1-s_1)& (4)\end{array}$

where C′ = 2 (for two classes C₁ and C₂), t₁[0, 1] and s₁ are the ground truth and score for C₁, s₂ = 1 − s₁ and t₂ = 1 − t₁ for C₂. Finally, the layers and layers parameter are described in Table 4.

TABLE 4

Table 4. The number of layers and layer parameters of the proposed DarkASDNet model.

We utilized the Cross-Entropy loss function with the Linear classifier because they are best fitted to our proposed binary ASD classification instead of preserving the original DarkNet's loss calculation strategy. In the meantime, we change the average pooling layer to maxpooling layer and add one more convolutional layer than DarkNet. Moreover, the trainable parameters of the proposed DarkASDNet model are about 4.5 million compared to the underlying DarkNet model, which contains around 25 million. Therefore, our model is six times lighter than the original DarkNet, ensuring our model's computational efficiency.

4. Data Visualization and Performance Metrics

4.1. Visualization of the Sliced fMRI Data

For the outrun treatment, reinforcement with prior diagnosis is important for ASD patients in order to delay deterioration and retain quality of life The visualization of the neuroimaging data can outrun perceptible biomarkers to illustrate prognosis and particular pathology for ASD patients. In our proposed work, we preprocess the 3D fMRI data into 2D images with slice time correction and normalization. Figure 4 represents the perfect visualization of our preprocessed images, and the manifestation of our per slice images are easily depicted for both ASD and TC. In the meantime, we disclosed only the first eight images for ASD and TC.

FIGURE 4

Figure 4. The visualization of single sliced ASD and TC images.

4.2. Evaluation Metrics

To ensure the performance of our proposed model, we consummate an in-depth search to learn hyperparameters and investigate the average accuracy, f1-score, precision, and recall. True positive (TP) can correctly predict the ASD class and true negative (TN) for TC. False positive (FP) is the outcome of incorrect prediction of ASD and false negative (FN) for TC. The corresponding formula for the evaluation metrics is given below.

$\begin{array}{ll}Accuracy=\frac{Totalcorrectprediction}{Totalnumberoflabels}\times 100& (5)\end{array}$

$\begin{array}{ll}Precision=\frac{TruePositive}{TruePositive+FalsePositive}& (6)\end{array}$

$\begin{array}{ll}Recall=\frac{TruePositive}{TruePositive+FalseNegative}& (7)\end{array}$

$\begin{array}{ll}{F}_{1_{-}\text{score}}=2\times \frac{(Precision\ast Recall)}{(Precision+Recall)}& (8)\end{array}$

5. Experimental Results and Discussion

Deep learning approaches have been successfully employed in ASD classification using ABIDE data based on fMRI images. In this work, we have proposed DarkASDNet to classify ASD showing different measurement metrics in the same manner with recall, precision, F1-score, and accuracy with ROC curve and AUC score to legitimize the performance of the proposed method. The training loss and accuracy comparison curve of the proposed DarkASDNet is shown in Figure 5. From Figure 5, it is depicting that the training accuracy is increasing with decreasing the training loss. The highest accuracy of 94.7% we have obtained while testing the DarkASDNet model. Figure 6 shows the performance values for different evaluation metrics, including precision, recall, f1-score, and AUC for ASD classification using proposed DarkASDNet. After testing our model for ASD classification, we have achieved the highest accuracy of 94.7%, the precision of 94.5%, recall of 92.5%, f1-score of 95%, and the AUC score 94.703%.

FIGURE 5

Figure 5. Training loss vs. accuracy curve for DarkASDNet.

FIGURE 6

Figure 6. Accuracy comparison of DarkASDNet with state-of-the-art methods used in ASD classification.

Furthermore, to evaluate our proposed DarkASDNet, we have implemented the VGG16 (Simonyan and Zisserman, 2015), MobileNetV2 (Sandler et al., 2018), and SVM (Jebapriya et al., 2019) algorithms as competence methods to classify ASD using the same dataset. We have also implemented two most recent works preferably using CNN in Ahmed et al. (2020), and 2CC3D in Li et al. (2018a). Figure 6 represents the performance comparison for the competence method with our proposed DarkASDNet model. Using SVM, MobileNetV2, and VGG16 models for ASD classification, we get an accuracy of 72.6, 76.5, and 78.43%, respectively. Comparing with the performance of competitive methods, in DarkASDNet, we get state-of-the-art accuracy during classification. As we know, deep learning techniques are nowadays performing very satisfactorily in ASD classification using ABIDE data. For example, in Ahmed et al. (2020), authors adopted the CNN model for single site (NYU) classification, where they got the highest accuracy of 88% for glass brain images. On the other hand, using extracted ROIs connectivity features and NYU dataset with 10-fold cross-validation, Kong et al. (2019) achieved the highest accuracy of 90.39% by considering stacked autoencoder (SAE) and softmax as a classifier. Furthermore, Auto-ASD-Network proposed by Eslami and Saeed (2019) based on the multilayer perceptron (MLP) with two hidden layers, and SVM got the highest accuracy of 80% for ASD classification using the NYU dataset. The accuracy comparison curve of our proposed DarkASDNet and other state-of-the-art methods for ASD classification using the ABIDE-NYU dataset is shown in Figure 6. From the bar diagram in Figure 6, the nearest model has a mean accuracy difference of about 3.4% with our method (Kong et al., 2019). Therefore, based on the results, our proposed DarkASDNet method outperforms other methods on average for classifying ASD.

Besides the matrices explained above, we have also described the confusion matrix table for DarkASDNet in Figure 7. It is clear from Figure 7 that there are two predicted classes: ASD and TC, a binary classification problem. The proposed DarkASDNet classifier made 472 subjective predictions, and out of these subjects, the classifier predicts 243 times as ASD patients and 229 times as the TC subjects. However, in the original dataset, there were 236 subjects for ASD patients and 236 subjects as TC. From the confusion matrix, we see that the overall misclassification rate is ~5.3%, with a true positive and false positive rate of 0.96 and 0.93, respectively, which is comparatively highly acceptable. The corresponding ROC curve is shown in Figure 8.

FIGURE 7

Figure 7. The evaluation performances of confusion metrics.

FIGURE 8

Figure 8. Receiver operating characteristic curve for ASD.

6. Conclusion and Future Work

It is challenging to find the proficient classifier for ASD, while most of the classifier depends on functional connectivity and brain ROIs analysis. In this work, we proposed a novel DarkASDNet model for ASD classification using 3D fMRI data. Different from the conventional machine learning method in which the extraction of the image features for the training set is done manually, our method handles the extraction of the image features automatically during the computation. We processed the fMRI data according to the DarkASDNet requirement through proper slice-time correction and normalization. We assessed the DarkASDNet performances using the generated fMRI data and utilized metrics functioning as recall, precision, F1-score, and accuracy with ROC curve and AUC value. Finally, we validated our outcomes by comparing with five other recent competency methods, including three leading benchmark approaches showing state-of-the-art results. To the end, the proposed framework provides a new benchmark method for ASD classification.

Future work will increase the number of subjects, such as the whole ABIDE database, considering each subject's phenotypic information. Although our model has presented outstanding results for ASD classification, improvements still need to be made to the model to handle the 3D fMRI data directly. We will solve these issues in our future work by employing the sample demographic information.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Author Contributions

MSA and SN conceived the study. MSA pursued the implementation of the methodology, conducted the data processing and experiments, and generated and validated the results. MSA, SN, and MRA performed the formal analysis and wrote the original draft. SN provided critical feedback and suggestions for performing the experiments. SN, MRA, JD, XG, and YC provided valuable suggestions in writing the manuscript. All authors have read and agreed to the published version of the manuscript.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

Data used in this manuscript were obtained from the ABIDE (Autism Brain Imaging Data Exchange), an open-source database for Autism and typical controls comprising 17 individual international sites' data from world-renowned laboratories and hospitals. The author also acknowledges the support from the coauthors for their meaningful suggestions during manuscript preparation.

References

Abraham, A., Milham, M. P., Di Martino, A., Craddock, R. C., Samaras, D., Thirion, B., et al. (2017). Deriving reproducible biomarkers from multi-site resting-state data: an autism-based example. NeuroImage 147, 736–745. doi: 10.1016/j.neuroimage.2016.10.045

PubMed Abstract | CrossRef Full Text | Google Scholar

Ahmed, M. R., Zhang, Y., Feng, Z., Lo, B., Inan, O. T., and Liao, H. (2018). Neuroimaging and machine learning for dementia diagnosis: recent advancements and future prospects. IEEE Rev. Biomed. Eng. 12, 19–33. doi: 10.1109/RBME.2018.2886237

PubMed Abstract | CrossRef Full Text | Google Scholar

Ahmed, M. R., Zhang, Y., Liu, Y., and Liao, H. (2020). Single volume image generator and deep learning-based asd classification. IEEE J. Biomed. Health Inform. 24, 3044–3054. doi: 10.1109/JBHI.2020.2998603

PubMed Abstract | CrossRef Full Text | Google Scholar

Anirudh, R., and Thiagarajan, J. J. (2019). “Bootstrapping graph convolutional neural networks for autism spectrum disorder classification,” in ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Brighton), 3197–3201. doi: 10.1109/ICASSP.2019.8683547

CrossRef Full Text | Google Scholar

Baio, J., Wiggins, L., Christensen, D. L., Maenner, M. J., Daniels, J., Warren, Z., et al. (2018). Prevalence of autism spectrum disorder among children aged 8 years-autism and developmental disabilities monitoring network, 11 sites, United States, 2014. MMWR Surveill. Summar. 67:1. doi: 10.15585/mmwr.ss6706a1

PubMed Abstract | CrossRef Full Text | Google Scholar

Bi, X.-a., Liu, Y., Sun, Q., Luo, X., Tan, H., Chen, J., et al. (2019). The genetic-evolutionary random support vector machine cluster analysis in autism spectrum disorder. IEEE Access 7, 30527–30535. doi: 10.1109/ACCESS.2019.2902889

CrossRef Full Text | Google Scholar

Bi, X.-a., Wang, Y., Shu, Q., Sun, Q., and Xu, Q. (2018). Classification of autism spectrum disorder using random support vector machine cluster. Front. Genet. 9:18. doi: 10.3389/fgene.2018.00018

PubMed Abstract | CrossRef Full Text | Google Scholar

Byeon, K., Kwon, J., Hong, J., and Park, H. (2020). “Artificial neural network inspired by neuroimaging connectivity: application in autism spectrum disorder,” in 2020 IEEE International Conference on Big Data and Smart Computing (BigComp) (Busan), 575–578. doi: 10.1109/BigComp48618.2020.00013

CrossRef Full Text | Google Scholar

Chen, H., Duan, X., Liu, F., Lu, F., Ma, X., Zhang, Y., et al. (2016). Multivariate classification of autism spectrum disorder using frequency-specific resting-state functional connectivity-a multi-center study. Prog. Neuro-Psychopharmacol. Biolog. Psychiatry 64, 1–9. doi: 10.1016/j.pnpbp.2015.06.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Cociu, B., Das, S., Billeci, L., Jamal, W., Maharatna, K., Calderoni, S., et al. (2018). Multimodal functional and structural brain connectivity analysis in autism: a preliminary integrated approach with EEG, fMRI, and DTI. IEEE Trans. Cogn. Dev. Syst. 10, 213–226. doi: 10.1109/TCDS.2017.2680408

CrossRef Full Text | Google Scholar

Craddock, C., Benhajali, Y., Chu, C., Chouinard, F., Evans, A., Jakab, A., et al. (2013). The neuro bureau preprocessing initiative: open sharing of preprocessed neuroimaging data and derivatives. Neuroinformatics 7. doi: 10.3389/conf.fninf.2013.09.00041

CrossRef Full Text | Google Scholar

Dvornek, N. C., Ventola, P., and Duncan, J. S. (2018). “Combining phenotypic and resting-state fmri data for autism classification with recurrent neural networks,” in 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) (Washington, DC), 725–728. doi: 10.1109/ISBI.2018.8363676

PubMed Abstract | CrossRef Full Text | Google Scholar

Dvornek, N. C., Ventola, P., Pelphrey, K. A., and Duncan, J. S. (2017). “Identifying autism from resting-state fmri using long short-term memory networks,” in International Workshop on Machine Learning in Medical Imaging (Quebec City, QC: Springer), 362–370. doi: 10.1007/978-3-319-67389-9_42

PubMed Abstract | CrossRef Full Text | Google Scholar

Eickhoff, S. B., Thirion, B., Varoquaux, G., and Bzdok, D. (2015). Connectivity-based parcellation: critique and implications. Hum. Brain Mapp. 36, 4771–4792. doi: 10.1002/hbm.22933

PubMed Abstract | CrossRef Full Text | Google Scholar

Eslami, T., and Saeed, F. (2019).

Guo, X., Dominick, K. C., Minai, A. A., Li, H., Erickson, C. A., and Lu, L. J. (2017). Diagnosing autism spectrum disorder from brain resting-state functional connectivity patterns using a deep neural network with a novel feature selection method. Front. Neurosci. 11:460. doi: 10.3389/fnins.2017.00460

PubMed Abstract | CrossRef Full Text | Google Scholar

Höfer, J., Hoffmann, F., and Bachmann, C. (2017). Use of complementary and alternative medicine in children and adolescents with autism spectrum disorder: a systematic review. Autism 21, 387–402. doi: 10.1177/1362361316646559

PubMed Abstract | CrossRef Full Text | Google Scholar

Hyman, S. L., Levy, S. E., Myers, S. M., et al. (2020). Identification, evaluation, and management of children with autism spectrum disorder. Pediatrics 145:e20193447. doi: 10.1542/peds.2019-3447

PubMed Abstract | CrossRef Full Text | Google Scholar

Iidaka, T. (2015). Resting state functional magnetic resonance imaging and neural network classified autism and control. Cortex 63, 55–67. doi: 10.1016/j.cortex.2014.08.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Jebapriya, S., David, S., Jaspher, W., and Sundar, N. (2019). Support vector machine for classification of autism spectrum disorder based on abnormal structure of corpus callosum. Int. J. Adv. Comput. Sci. Appl. 10:2019. doi: 10.14569/IJACSA.2019.0100965

CrossRef Full Text

Jiao, Z., Li, H., and Fan, Y. (2020). “Improving diagnosis of autism spectrum disorder and disentangling its heterogeneous functional connectivity patterns using capsule networks,” in 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI) (Iowa City, IA), 1331–1334. doi: 10.1109/ISBI45749.2020.9098524

PubMed Abstract | CrossRef Full Text | Google Scholar

Jin, Y., Wee, C.-Y., Shi, F., Thung, K.-H., Ni, D., Yap, P.-T., et al. (2015). Identification of infants at high-risk for autism spectrum disorder using multiparameter multiscale white matter connectivity networks. Hum. Brain Mapp. 36, 4880–4896. doi: 10.1002/hbm.22957

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaiser, M. D., Hudac, C. M., Shultz, S., Lee, S. M., Cheung, C., Berken, A. M., et al. (2010). Neural signatures of autism. Proc. Natl. Acad. Sci. U.S.A. 107, 21223–21228. doi: 10.1073/pnas.1010412107

PubMed Abstract | CrossRef Full Text | Google Scholar

Khosla, M., Jamison, K., Kuceyeski, A., and Sabuncu, M. R. (2018). “3d convolutional neural networks for classification of functional connectomes,” in Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support (Granada: Springer), 137–145. doi: 10.1007/978-3-030-00889-5_16

CrossRef Full Text | Google Scholar

Klöppel, S., Abdulkadir, A., Jack, C. R. Jr, Koutsouleris, N., Mour ao-Miranda, J., and Vemuri, P. (2012). Diagnostic neuroimaging across diseases. Neuroimage 61, 457–463. doi: 10.1016/j.neuroimage.2011.11.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Kong, Y., Gao, J., Xu, Y., Pan, Y., Wang, J., and Liu, J. (2019). Classification of autism spectrum disorder by combining brain connectivity and deep neural network classifier. Neurocomputing 324, 63–68. doi: 10.1016/j.neucom.2018.04.080

CrossRef Full Text | Google Scholar

Ktena, S. I., Parisot, S., Ferrante, E., Rajchl, M., Lee, M., Glocker, B., et al. (2017). Distance metric learning using graph convolutional networks: application to functional brain networks. arXiv preprint arXiv:1703.02161. doi: 10.1007/978-3-319-66182-7_54

CrossRef Full Text | Google Scholar

Lee, M.-H., Kim, D. Y., Chung, M. K., Alexander, A. L., and Davidson, R. J. (2018). Topological properties of the structural brain network in autism via ϵ-neighbor method. IEEE Trans. Biomed. Eng. 65, 2323–2333.

PubMed Abstract | Google Scholar

Leming, M., Górriz, J. M., and Suckling, J. (2020). Ensemble deep learning on large, mixed-site fMRI datasets in autism and other tasks. arXiv preprint arXiv:2002.07874. doi: 10.1142/S0129065720500124

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, X., Dvornek, N. C., Papademetris, X., Zhuang, J., Staib, L. H., Ventola, P., et al. (2018a). “2-channel convolutional 3D deep neural network (2CC3D) for fMRI analysis: ASD classification and feature learning,” in 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), 1252–1255. doi: 10.1109/ISBI.2018.8363798

CrossRef Full Text | Google Scholar

Li, X., Dvornek, N. C., Zhuang, J., Ventola, P., and Duncan, J. S. (2018b). “Brain biomarker interpretation in asd using deep learning and fMRI,” in International Conference on Medical Image Computing and Computer-Assisted Intervention (Washington, DC: Springer), 206–214. doi: 10.1007/978-3-030-00931-1_24

CrossRef Full Text | Google Scholar

Lu, H., Liu, S., Wei, H., and Tu, J. (2020). Multi-kernel fuzzy clustering based on auto-encoder for fMRI functional network. Expert Syst. Appl. 2020:113513. doi: 10.1016/j.eswa.2020.113513

CrossRef Full Text | Google Scholar

Mandell, D. S., Ittenbach, R. F., Levy, S. E., and Pinto-Martin, J. A. (2007). Disparities in diagnoses received prior to a diagnosis of autism spectrum disorder. J. Autism Dev. Disord. 37, 1795–1802. doi: 10.1007/s10803-006-0314-8

CrossRef Full Text | Google Scholar

Niu, K., Guo, J., Pan, Y., Gao, X., Peng, X., Li, N., et al. (2020). Multichannel deep attention neural networks for the classification of autism spectrum disorder using neuroimaging and personal characteristic data. Complexity 2020:1357853. doi: 10.1155/2020/1357853

CrossRef Full Text | Google Scholar

Noriega, G. (2019). Restricted, repetitive, and stereotypical patterns of behavior in autism-an fMRI perspective. IEEE Trans. Neural Syst. Rehabil. Eng. 27, 1139–1148. doi: 10.1109/TNSRE.2019.2912416

PubMed Abstract | CrossRef Full Text | Google Scholar

Nylander, L., Holmqvist, M., Gustafson, L., and Gillberg, C. (2013). Attention-deficit/hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) in adult psychiatry. A 20-year register study. Nordic J. Psychiatry 67, 344–350. doi: 10.3109/08039488.2012.748824

PubMed Abstract | CrossRef Full Text | Google Scholar

Parikh, M. N., Li, H., and He, L. (2019). Enhancing diagnosis of autism with optimized machine learning models and personal characteristic data. Front. Comput. Neurosci. 13:9. doi: 10.3389/fncom.2019.00009

PubMed Abstract | CrossRef Full Text | Google Scholar

Parisot, S., Ktena, S. I., Ferrante, E., Lee, M., Moreno, R. G., Glocker, B., et al. (2017). “Spectral graph convolutions for population-based disease prediction,” in International Conference on Medical Image Computing and Computer-Assisted Intervention (Quebec City, QC: Springer), 177–185. doi: 10.1007/978-3-319-66179-7_21

CrossRef Full Text | Google Scholar

Pascual-Belda, A., Díaz-Parra, A., and Moratal, D. (2018). Evaluating functional connectivity alterations in autism spectrum disorder using network-based statistics. Diagnostics 8:51. doi: 10.3390/diagnostics8030051

PubMed Abstract | CrossRef Full Text | Google Scholar

Phinyomark, A., Ibanez-Marcelo, E., and Petri, G. (2017). Resting-state fMRI functional connectivity: big data preprocessing pipelines and topological data analysis. IEEE Trans. Big Data 3, 415–428. doi: 10.1109/TBDATA.2017.2734883

CrossRef Full Text | Google Scholar

Raví, D., Wong, C., Deligianni, F., Berthelot, M., Andreu-Perez, J., Lo, B., and Yang, G.-Z. (2016). Deep learning for health informatics. IEEE J. Biomed. Health Inform. 21, 4–21. doi: 10.1109/JBHI.2016.2636665

PubMed Abstract | CrossRef Full Text | Google Scholar

Redmon, J., and Farhadi, A. (2017). “Yolo9000: better, faster, stronger,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 7263–7271. doi: 10.1109/CVPR.2017.690

CrossRef Full Text | Google Scholar

Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L. (2018). “Mobilenetv2: inverted residuals and linear bottlenecks,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (Salt Lake City, UT), 4510–4520. doi: 10.1109/CVPR.2018.00474

CrossRef Full Text | Google Scholar

Senn, M. (2020). CDC Estimate on Autism Prevalence Increases by Nearly 10 Percent, to 1 in 54 Children in the U.S. Available online at: https://www.autismspeaks.org/press-release/cdc-estimate-autism-prevalence-increases-nearly-10-percent-1-54-children-us (accessed April 26, 2020).

Simonyan, K., and Zisserman, A. (2015). “Very deep convolutional networks for large-scale image recognition,” in International Conference on Learning Representations (San Diego, CA).

Google Scholar

Sundermann, B., Herr, D., Schwindt, W., and Pfleiderer, B. (2014). Multivariate classification of blood oxygen level-dependent fMRI data with diagnostic intention: a clinical perspective. Am. J. Neuroradiol. 35, 848–855. doi: 10.3174/ajnr.A3713

PubMed Abstract | CrossRef Full Text | Google Scholar

Thirion, B., Varoquaux, G., Dohmatob, E., and Poline, J.-B. (2014). Which fMRI clustering gives good brain parcellations? Front. Neurosci. 8:167. doi: 10.3389/fnins.2014.00167

PubMed Abstract | CrossRef Full Text | Google Scholar

Thomas, R. M., Gallo, S., Cerliani, L., Zhutovsky, P., El-Gazzar, A., and van Wingen, G. (2020). Classifying autism spectrum disorder using the temporal statistics of resting-state functional MRI data with 3D convolutional neural networks. Front. Psychiatry 11:440. doi: 10.3389/fpsyt.2020.00440

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, C., Xiao, Z., Wang, B., and Wu, J. (2019). Identification of autism based on SVM-RFE and stacked sparse auto-encoder. IEEE Access 7, 118030–118036. doi: 10.1109/ACCESS.2019.2936639

CrossRef Full Text | Google Scholar

Yahata, N., Morimoto, J., Hashimoto, R., Lisi, G., Shibata, K., Kawakubo, Y., et al. (2016). A small number of abnormal brain connections predicts adult autism spectrum disorder. Nat. Commun. 7, 1–12. doi: 10.1038/ncomms11254

PubMed Abstract | CrossRef Full Text | Google Scholar

Yang, X., Islam, M. S., and Khaled, A. A. (2019). “Functional connectivity magnetic resonance imaging classification of autism spectrum disorder using the multisite abide dataset,” in 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI) (Chicago, IL), 1–4. doi: 10.1109/BHI.2019.8834653

CrossRef Full Text | Google Scholar

Yao, Z., Hu, B., Xie, Y., Zheng, F., Liu, G., Chen, X., et al. (2016). Resting-state time-varying analysis reveals aberrant variations of functional connectivity in autism. Front. Hum. Neurosci. 10:463. doi: 10.3389/fnhum.2016.00463

PubMed Abstract | CrossRef Full Text | Google Scholar

Yin, W., Mostafa, S., and Wu, F.-x. (2020). Diagnosis of autism spectrum disorder based on functional brain networks with deep learning. J. Comput. Biol. 28, 146–165. doi: 10.1089/cmb.2020.0252

PubMed Abstract | CrossRef Full Text | Google Scholar

Yu, C., Gao, Z., Zhang, W., Yang, G., Zhao, S., Zhang, H., et al. (2020). Multitask learning for estimating multitype cardiac indices in MRI and CT based on adversarial reverse mapping. IEEE Trans. Neural Netw. Learn. Syst. 32, 493–506. doi: 10.1109/TNNLS.2020.2984955

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, C., Adeli, E., Wu, Z., Li, G., Lin, W., and Shen, D. (2018). Infant brain development prediction with latent partial multi-view representation learning. IEEE Trans. Med. Imaging 38, 909–918. doi: 10.1109/ISBI.2018.8363751

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhao, Y., Dong, Q., Zhang, S., Zhang, W., Chen, H., Jiang, X., et al. (2018a). Automatic recognition of fmri-derived functional networks using 3-D convolutional neural networks. IEEE Trans. Biomed. Eng. 65, 1975–1984. doi: 10.1109/TBME.2017.2715281

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhao, Y., Ge, F., Zhang, S., and Liu, T. (2018b). “3D deep convolutional neural network revealed the value of brain network overlap in differentiating autism spectrum disorder from healthy controls,” in Medical Image Computing and Computer Assisted Intervention-MICCAI 2018, eds A. F. Frangi, J. A. Schnabel, C. Davatzikos, C. Alberola-López, and G. Fichtinger (Cham: Springer International Publishing), 172–180. doi: 10.1007/978-3-030-00931-1_20

CrossRef Full Text | Google Scholar