Clustering Coefficients for Correlation Networks

Graph theory is a useful tool for deciphering structural and functional networks of the brain on various spatial and temporal scales. The clustering coefficient quantifies the abundance of connected triangles in a network and is a major descriptive statistics of networks. For example, it finds an application in the assessment of small-worldness of brain networks, which is affected by attentional and cognitive conditions, age, psychiatric disorders and so forth. However, it remains unclear how the clustering coefficient should be measured in a correlation-based network, which is among major representations of brain networks. In the present article, we propose clustering coefficients tailored to correlation matrices. The key idea is to use three-way partial correlation or partial mutual information to measure the strength of the association between the two neighboring nodes of a focal node relative to the amount of pseudo-correlation expected from indirect paths between the nodes. Our method avoids the difficulties of previous applications of clustering coefficient (and other) measures in defining correlational networks, i.e., thresholding on the correlation value, discarding of negative correlation values, the pseudo-correlation problem and full partial correlation matrices whose estimation is computationally difficult. For proof of concept, we apply the proposed clustering coefficient measures to functional magnetic resonance imaging data obtained from healthy participants of various ages and compare them with conventional clustering coefficients. We show that the clustering coefficients decline with the age. The proposed clustering coefficients are more strongly correlated with age than the conventional ones are. We also show that the local variants of the proposed clustering coefficients (i.e., abundance of triangles around a focal node) are useful in characterizing individual nodes. In contrast, the conventional local clustering coefficients were strongly correlated with and therefore may be confounded by the node's connectivity. The proposed methods are expected to help us to understand clustering and lack thereof in correlational brain networks, such as those derived from functional time series and across-participant correlation in neuroanatomical properties.

1. Introduction

Networks have been proven to be a useful language to understand structural and functional properties of the brain. The research field is collectively called network neuroscience (Bassett and Sporns, 2017). Initial studies in network neuroscience revealed that brain networks on various spatial scales have properties common to other biological and non-biological networks, such as the small-world property and community structure. More recent studies tend to depend on the availability of new tools to record data with, look at other properties of brain networks such as network hubs, rich clubs and economic efficiency, and endeavor into the analysis of impaired brains (Bullmore and Sporns, 2009; Sporns, 2011; Fornito et al., 2013; Stam, 2014; Bassett and Sporns, 2017).

In this article, we focus on a measure which has often been applied to brain (and other) networks: clustering coefficient (Watts and Strogatz, 1998). The clustering coefficient quantifies the abundance of connected triangles in a network. In network neuroscience, the clustering coefficient has been shown to be a useful quantity for understanding function-structure associations in the brain for at least the following two reasons. First, it is one of the two building blocks with which to measure the small-worldness of a network; small-world networks are those having a large clustering coefficient and a small shortest path length between two nodes (such as regions of interest; ROIs) on average (Watts and Strogatz, 1998; Bullmore and Sporns, 2009). Brain networks are usually small-world networks in this sense (Achard et al., 2006; Bassett and Bullmore, 2006). Loss of small-worldness is a signature of, for example, Alzheimer disease (Supekar et al., 2008; Brier et al., 2014) and schizophrenia (Liu et al., 2008). Second, the abundance of connected triangles around a given node, which is measured by local variants of the clustering coefficient, informs us of other structure and functions of networks, namely, community structure (Radicchi et al., 2004; Palla et al., 2005) and local efficiency (Latora and Marchiori, 2001). Both community structure and local efficiency are often measured for brain networks (Achard and Bullmore, 2007; Bullmore and Sporns, 2009; Rubinov and Sporns, 2010, 2011); for example, community structure of functional brain networks is less pronounced in childhood-onset schizophrenia than controls (Alexander-Bloch et al., 2010).

However, the current measurement of the clustering coefficient can be easily fooled when it is applied to correlational brain/neuronal networks, where the connectivity between two nodes is defined by Pearson correlation and potentially some other correlation indices. Such correlational brain networks are often built on the basis of a correlation measure between two ROIs such as the pairwise correlation between time-dependent blood oxygen level-dependent (BOLD) signals obtained from functional magnetic resonance imaging (fMRI) or neural signals obtained from electroencephalogram (EEG) and magnetoencephalogram (MEG) (Bullmore and Sporns, 2009; Bassett and Sporns, 2017). Correlational networks are also employed to construct structural networks of the brain, where an edge between two ROIs is calculated as the across-participant correlation in the cortical thickness (Alexander-Bloch et al., 2013; Evans, 2013). A naive application of network analysis tools, including the clustering coefficient, to such correlation networks can go awry due to the following reasons.

First, a network derived from a correlation matrix tends to have many triangles owing to the so-called indirect paths, i.e., a correlation between nodes i and j and one between i and ℓ result in a correlation between j and ℓ even when there is no direct relationship between j and ℓ (Adachi et al., 2012; Zalesky et al., 2012). This mathematical property raises the clustering coefficient values. The same pseudo-correlation effect also automatically produces an inflated correlation between the connectivity of node i and the local clustering coefficient (i.e., which refers to the abundance of triangles around a particular node i and has been used for characterizing individual ROIs Sporns and Zwi, 2004; Achard et al., 2006; He et al., 2007; Alexander-Bloch et al., 2010; Lynall et al., 2010; Power et al., 2010; van den Heuvel et al., 2010; van den Heuvel and Sporns, 2011; Wee et al., 2011; Fornito et al., 2012; Tijms et al., 2013; Sala-Llonch et al., 2014) as we will show (section 3.5). One remedy is to use appropriate null models (Zalesky et al., 2012), which respect the natural constraints imposed on correlation matrices including a large clustering coefficient value even in the case of networks generated at random. Nevertheless, this solution does not address the issue of the threshold value, which we will discuss below. The partial correlation matrix is a method of choice for removing pseudo-correlation between ROIs that is present in networks based on the Pearson correlation matrix. However, estimation of the partial correlation matrix is difficult, particularly when the number of image volumes is relatively small as compared to the number of ROIs, which is typical of fMRI experiments (Schäfer and Strimmer, 2005; Ryali et al., 2012; Brier et al., 2015).

Second, to create a network, we conventionally threshold on the correlation value to dichotomize the presence or absence of an edge between each pair of ROIs. However, the choice of the threshold is arbitrary (Rubinov and Sporns, 2010, 2011; De Vico Fallani et al., 2014; Garrison et al., 2015) and results of graph-theoretical analyses often depend on the choice of the threshold (Zalesky et al., 2012; Garrison et al., 2015; Jalili, 2016). Specifically, clustering coefficient values considerably depend on the threshold value (Zalesky et al., 2012; Garrison et al., 2015). One can avoid thresholding by using weighted networks, i.e., networks with weighted edges (Rubinov and Sporns, 2010, 2011). There are several definitions of clustering coefficient for weighted networks (Barrat et al., 2004; Onnela et al., 2005; Zhang and Horvath, 2005; Saramäki et al., 2007; Rubinov and Sporns, 2010, 2011; Costantini and Perugini, 2014; Wang et al., 2017). However, it is unclear how the weighted network approach should deal with negatively weighted edges; most network analysis tools including the clustering coefficient assume non-negative edges (Newman, 2010). An interesting possibility is to separately analyse networks composed of positive edges and those composed of negative edges, and then to combine the measurements obtained from the two types of networks (Rubinov and Sporns, 2011). However, there seems to be no consensus regarding the treatment of negatively signed edges (Sporns and Betzel, 2016).

In the present study, we develop two clustering coefficients tailored to correlation matrices. The first type of clustering coefficient is based on three-way partial correlation coefficient. The second type is based on partial mutual information. Partial mutual information is a nonlinear correlation measure, which is defined as the conventional mutual information between two random variables but conditioned on other variables (Frenzel and Pompe, 2007). These clustering coefficients are expected to overcome some of the aforementioned difficulties. First, they discount the effect of indirect paths to quantify association between two neighbors of a node given the activity of the focal node. In this manner, we avoid both the problem of pseudo-correlation in ordinary correlation matrices and computational issues in the calculation of partial correlation matrices. Second, as in the case of the clustering coefficients for weighted networks, our clustering coefficients do not use thresholding on the correlation value. Third, we measure how far the realized pairwise correlation value is (no matter positive or negative) from the correlation anticipated by the presence of indirect paths. Although this treatment does not solve the problem of negative edges, we intend to use the information contained in negative as well as positive edges in this manner. For a proof of concept, we apply the proposed clustering coefficient indices to fMRI data obtained from healthy subjects with a wide range of age. We show that the clustering coefficients are negatively correlated with the age. This observation is in general less pronounced with the conventional clustering coefficient measures, although decline in the clustering coefficient with ageing should not be regarded as a ground truth in light of the literature (Wang et al., 2010; Matthäus et al., 2012; Zhu et al., 2012; Brier et al., 2014; Liu et al., 2014; Sala-Llonch et al., 2014; Knyazev et al., 2015; Grady et al., 2016). We also show that the local clustering coefficients at specific ROIs provide information orthogonal to the mere strength of connectivity and that their association with the participant's age is independent of brain systems.

2. Methods

2.1. Functional Connectivity

We used N_ROI = 30 regions of interest (ROIs) whose coordinates were determined in a previous study (Fair et al., 2009). Note that we excluded the four cerebellar ROIs out of the 34 ROIs. The system of the 30 ROIs contained the default mode network (DMN; 12 ROIs), cingulo-opercular network (CON; 7 ROIs) and fronto-parietal network (FPN; 11 ROIs).

Denote by ρ(i, j) the Pearson correlation coefficient between the BOLD signals at two ROIs i and j (1 ≤ i, j ≤ N_ROI). We primarily use ρ(i, j) as a measure of functional connectivity between ROIs. However, we will discount the effect of indirect paths, which is present when the edge between ROIs i and j is solely determined by ρ(i, j), by defining new clustering coefficients (section 2.5).

For comparison purposes, we will also examine conventional clustering coefficients for networks (sections 2.3, 2.4), which are applied to the Pearson correlation matrix and the partial correlation matrix. The partial correlation matrix, which we use as a benchmark, is an alternative measure of functional connectivity (Salvador et al., 2005; Marrelec et al., 2006), and its (i, j) element is estimated by ${\overline{\rho }}^{\text{partial}}(i,j)=-{\mathrm{\text{cov}}}^{-1}(i,j)/\sqrt{{\mathrm{\text{cov}}}^{-1}(i,i){\mathrm{\text{cov}}}^{-1}(j,j)}$, where cov denotes the covariance matrix (Whittaker, 1990). It should be noted that ρ(i, j) = ρ(j, i) and ${\overline{\rho }}^{\text{partial}}(i,j)={\overline{\rho }}^{\text{partial}}(j,i)$. We interchangeably use node and ROI in the following.

2.2. Average Functional Connectivity

We used the following two indices of average functional connectivity: the pairwise Pearson correlation coefficient averaged over all pairs of ROIs, denoted by s, and the same average but only over the ROI pairs having the non-negative ρ(i, j) values, denoted by s⁺. The introduction of s⁺ is motivated by the observation that the interpretation of negative correlation coefficients remains difficult (Fox et al., 2009; Murphy et al., 2009; Rubinov and Sporns, 2011; Fornito et al., 2013).

2.3. Clustering Coefficients for Unweighted Networks

In this section and the next, we explain the previously proposed clustering coefficients for unweighted and weighted networks based on the Pearson correlation coefficient, ρ(i, j). Those based on the partial correlation coefficient, ${\overline{\rho }}^{\text{partial}}(i,j)$, are analogously calculated.

To construct an unweighted functional network, we lay an edge between nodes i and j (1 ≤ i ≠ j ≤ N) if and only if ρ(i, j) ≥ θ, where θ is a pre-determined threshold. The generated network is undirected. We denote the adjacency matrix of the network by A = (a_ij), where 1 ≤ i, j ≤ N_ROI. In other words, a_ij = 1 if (i, j) is an edge and a_ij = 0 otherwise. The clustering coefficient represents the abundance of connected triangles in a network (Watts and Strogatz, 1998). The local clustering coefficient of node i is defined by

$\begin{array}{l}{C}_i^{\text{unw}}=\frac{(\mathrm{\text{Number of connected triangles including node }}i)}{k_i(k_i-1)/2}\\ =\frac{{\displaystyle {\sum }_{\begin{array}{c}1\le j<\ell \le N_{\text{ROI}}\\ j,\ell \ne i\end{array}}}{a}_{ij}{a}_{i\ell }{a}_{j\ell }}{k_i(k_i-1)/2},& (1)\end{array}$

where $k_i=\sum _{j=1}^{N_{\text{ROI}}}{a}_{ij}=\sum _{j=1}^{N_{\text{ROI}}}{a}_{ji}$ is the degree of node i, i.e., the number of edges to which node i is adjacent. The denominator on the right-hand side of Equation (1) represents the largest possible number of triangles to which node i belongs. Note that $0\le C_i^{\text{unw}}\le 1$ (1 ≤ i ≤ N_ROI) and that $C_i^{\text{unw}}$ is undefined if k_i = 0 or 1. The global clustering coefficient for the entire network, denoted by C^unw, is given by the average of $C_i^{\text{unw}}$ over all nodes. We exclude the nodes with k_i ≤ 1 from the calculation of C^unw. Note that 0 ≤ C^unw ≤ 1. Similar to other types of networks, most brain networks, anatomical or functional, have large values of C^unw as compared to randomized networks (Bullmore and Sporns, 2009; Bassett and Sporns, 2017).

2.4. Clustering Coefficients for Weighted Networks

One can define a weighted functional network by regarding ρ(i, j) as the weight of edge (i, j). Because we do not have established methods to deal with negatively weighted edges (but see Rubinov and Sporns, 2011) and it is common to discard edges with a negative ρ(i, j) value (Rubinov and Sporns, 2010; Kaiser, 2011), the weighted adjacency matrix is given by w_ij = ρ(i, j) if ρ(i, j) > 0 and w_ij = 0 otherwise. As benchmarks, we consider three variants of weighted clustering coefficient commonly used in the literature (Saramäki et al., 2007; Rubinov and Sporns, 2010, 2011; Wang et al., 2017). We denote by (a_ij) the adjacency matrix of the unweighted network obtained by ignoring the edge weight in the weighted network. In other words, we set a_ij = 1 if w_ij > 0 (equivalently, ρ(i, j) > 0) and a_ij = 0 otherwise.

The local clustering coefficient of node i proposed by Barrat et al. (2004) is given by

$\begin{array}{ll}{C}_i^{\text{wei},\text{B}}=\frac{1}{s_i(k_i-1)}{\displaystyle \sum _{\begin{array}{c}1\le j,\ell \le N_{\text{ROI}}\\ j,\ell \ne i\end{array}}}\frac{w_{ij}+w_{i\ell }}{2}{a}_{ij}{a}_{i\ell }{a}_{j\ell },& (2)\end{array}$

where $s_i=\sum _{j=1}^{N_{\text{ROI}}}{w}_{ij}$ is the node strength (i.e., weighted degree). It should be noted that a_ija_iℓa_jℓ = 1 if and only if nodes i, j and ℓ form a triangle in the unweighted network; a_ija_iℓa_jℓ = 0 otherwise. The average of $C_i^{\text{wei},\text{B}}$ over all nodes defines the global weighted clustering coefficient denoted by C^wei,B.

The local clustering coefficient proposed by Onnela et al. (2005), which is implemented in the Brain Connectivity Toolbox (Rubinov and Sporns, 2010), is given by

$\begin{array}{ll}{C}_i^{\text{wei},\text{O}}=\frac{1}{k_i(k_i-1)}{\displaystyle \sum _{\begin{array}{c}1\le j,\ell \le N_{\text{ROI}}\\ j,\ell \ne i\end{array}}}\frac{{(w_{ij}{w}_{i\ell }{w}_{j\ell })}^{1/3}}{{\displaystyle {max}_{i\prime j\prime }}{w}_{i\prime j\prime }}.& (3)\end{array}$

Factor $\underset{i^{\prime }{j}^{\prime }}{max}{w}_{i^{\prime }{j}^{\prime }}$ normalizes $C_i^{\text{wei},\text{O}}$ between 0 and 1 and prevents it from scaling when the scale of w_ij is changed (i.e., when w_ij for all 1 ≤ i, j ≤ N_ROI is multiplied by the same constant). The corresponding global clustering coefficient, denoted by C^wei,O, is given by the average of $C_i^{\text{wei},\text{O}}$ over all nodes.

The local clustering coefficient proposed by Zhang and Horvath (2005) is written as (Saramäki et al., 2007)

$\begin{array}{ll}{C}_i^{\text{wei},\text{Z}}=\frac{1}{{\displaystyle {max}_{i\prime j\prime }}{w}_{i\prime j\prime }}\frac{{\displaystyle {\sum }_{\begin{array}{c}1\le j,\ell \le N_{\text{ROI}}\\ j,\ell \ne i\end{array}}}{w}_{ij}{w}_{i\ell }{w}_{j\ell }}{{\displaystyle {\sum }_{\begin{array}{c}1\le j,\ell \le N_{\text{ROI}}\\ j,\ell \ne i;j\ne \ell \end{array}}}{w}_{ij}{w}_{i\ell }}.& (4)\end{array}$

The corresponding global clustering coefficient, denoted by C^wei,Z, is given by the average of $C_i^{\text{wei},\text{Z}}$ over all nodes.

2.5. Our Proposal: Clustering Coefficients Tailored to Correlation Matrices

We propose two clustering coefficient measures for correlation matrices (C^cor,A and C^cor,M). Both of them discount correlation between ROIs j and ℓ that is expected from the correlation between ROIs i and j and that between i and ℓ, i.e., indirect path between j and ℓ through i (Figure 1) (Zalesky et al., 2012). One measure uses the three-way partial correlation coefficient and the other measure uses the partial mutual information.

FIGURE 1

Figure 1. Schematic of the indirect path between nodes j and ℓ through node i.

The three-way partial correlation coefficient between ROIs j and ℓ controlling for the influence of ROI i, denoted by ρ^partial(j, ℓ|i), is defined by Whittaker (1990)

$\begin{array}{ll}{\rho }^{\text{partial}}(j,\ell |i)=\frac{\rho (j,\ell )-\rho (i,j)\rho (i,\ell )}{\sqrt{1-{\rho }^2(i,j)}\sqrt{1-{\rho }^2(i,\ell )}}.& (5)\end{array}$

Equation (5) indicates that ROIs i and j would be correlated with an amount ρ(i, j)ρ(i, ℓ) by default owing to the indirect path between j and ℓ through i (e.g., Zalesky et al., 2012). Deviations of ρ(j, ℓ) from ρ(i, j)ρ(i, ℓ) quantify the tendency that j and ℓ are more strongly or weakly connected than is expected from the presence of an indirect path between j and ℓ through i. Based on this observation, we define a first variant of the clustering coefficient as follows.

It is difficult to interpret negative correlation values in functional connectivity data (Fox et al., 2009; Murphy et al., 2009; Rubinov and Sporns, 2011; Smith et al., 2011; Sporns, 2011; Fornito et al., 2013). Therefore, we assume that any deviation of ρ(j, ℓ) from ρ(i, j)ρ(i, ℓ) caused by the effect of i, irrespective of whether it is positive or negative, contributes to the local clustering coefficient at i. We define the local clustering coefficient for ROI i, denoted by $C_i^{\text{cor},\text{A}}$ (superscript A standing for the absolute value), as

$\begin{array}{ll}{C}_i^{\text{cor},\text{A}}=\frac{{\displaystyle {\sum }_{\begin{array}{c}1\le j<\ell \le N_{\text{ROI}}\\ j,\ell \ne i\end{array}}}\left|\rho (i,j)\rho (i,\ell ){\rho }^{\text{partial}}(j,\ell |i)\right|}{{\displaystyle {\sum }_{\begin{array}{c}1\le j<\ell \le N_{\text{ROI}}\\ j,\ell \ne i\end{array}}}|\rho (i,j)\rho (i,\ell )|}.& (6)\end{array}$

In other words, $C_i^{\text{cor},\text{A}}$ is a weighted average of the absolute value of the partial correlation over pairs of j and ℓ. We have employed the weight |ρ(i, j)ρ(i, ℓ)| for averaging because a high clustering around ROI i should imply strong association between ROIs j and ℓ (in the sense of partial correlation) when i and j are strongly connected and i and ℓ are. We have used ρ^partial(j, ℓ|i) instead of ${\overline{\rho }}^{\text{partial}}(j,\ell )$, i.e., the partial correlation between j and ℓ controlling for the effect of the other N_ROI−2 ROIs, to make $C_i^{\text{cor},\text{A}}$ a locally calculated quantity as is the case for the clustering coefficients for networks (e.g., $C_i^{\text{und}}$, $C_i^{\text{wei},\text{B}}$, $C_i^{\text{wei},\text{O}}$ and $C_i^{\text{wei},\text{Z}}$). The corresponding global clustering coefficient, denoted by C^cor,A, is given by the average of $C_i^{\text{cor},\text{A}}$ over all nodes. Note that $0\le C_i^{\text{cor},\text{A}}\le 1(1\le i\le N_{\text{ROI}})$ and 0 ≤ C^cor,A ≤ 1.

We also use another definition of the clustering coefficient based on the partial mutual information, which is a nonlinear correlation measure (Frenzel and Pompe, 2007). By definition, the mutual information is nonnegative and invariant under flipping of the sign of the random variable. We use the partial mutual information between ROIs j and ℓ conditioned on ROI i in place of ρ^partial(j, ℓ|i) to define the second variant of the local clustering coefficient for correlation matrices, denoted by $C_i^{\text{cor},\text{M}}$ (superscript M standing for the mutual information).

The partial mutual information is defined as

$\begin{array}{ll}I(X_j,X_{\ell }|X_i)=h(X_j,X_i)+h(X_{\ell },X_i)-h(X_i)-h(X_j,X_{\ell },X_i),& (7)\end{array}$

where X_i, X_j and X_ℓ are the random variables on ROIs i, j and ℓ, respectively, and h is the (joint) entropy. For example, $h(X_i)=-\sum _{x}p(x){log}_{2}p(x)$, where p(x) is the probability that X_i = x, and $h(X_j,X_i)=-\sum _{x,x\prime }p(x,x\prime ){log}_{2}p(x,x^{\prime })$, where p(x, x′) is the probability that $(X_j,X_i)=(x,x^{\prime })$. By assuming that the BOLD signals at ROIs i, j and ℓ obey a multivariate Gaussian distribution, one obtains the entropy values in Equation (7) as follows (Rieke et al., 1999; Cover and Thomas, 2006; Frenzel and Pompe, 2007):

$\begin{array}{ll}h(X_{{\alpha }_1},\dots ,X_{{\alpha }_d})=\frac{d}{2}(1+ln2\pi )+\frac{1}{2}lndet{\mathrm{\text{cov}}}^{\prime },& (8)\end{array}$

where d is the number of random variables and ${\mathrm{\text{cov}}}^{\prime }=({\mathrm{\text{cov}}}_{ij}^{\prime })$ is the d × d covariance matrix constructed by X_α1, …, X_αd, i.e., ${\mathrm{\text{cov}}}_{ij}^{\prime }=\mathrm{\text{E}}\left[X_{{\alpha }_i}{X}_{{\alpha }_j}\right]$, where E[·] represents the expectation. By substituting Equation (8) in Equation (7) and setting ${\mathrm{\text{cov}}}_{ij}^{\prime }=\rho (i,j)$, we obtain

$\begin{array}{l}I(X_j,X_{\ell }|X_i)=\frac{1}{2}[\ln \left(1-{\rho }^2(i,j)\right)+\ln \left(1-{\rho }^2(i,\ell )\right)\\ -\ln (1-{\rho }^2(i,j)-{\rho }^2(i,\ell )-{\rho }^2(j,\ell )\\ +2\rho (i,j)\rho (i,\ell )\rho (j,\ell ))].& (9)\end{array}$

Using the partial mutual information, we define

$\begin{array}{ll}{C}_i^{\text{cor},\text{M}}=\frac{{\displaystyle {\sum }_{\begin{array}{c}1\le j<\ell \le N_{\text{ROI}}\\ j,\ell \ne i\end{array}}}|\rho (i,j)\rho (i,\ell )|I(X_j,X_{\ell }|X_i)}{\frac{1+ln2\pi }{2}{\displaystyle {\sum }_{\begin{array}{c}1\le j<\ell \le N_{\text{ROI}}\\ j,\ell \ne i\end{array}}}|\rho (i,j)\rho (i,\ell )|}.& (10)\end{array}$

The denominator normalizes the $C_i^{\text{cor},\text{M}}$ value to range between 0 and 1. The corresponding global clustering coefficient, denoted by C^cor,M, is given by the average of $C_i^{\text{cor},\text{M}}$ over all nodes.

As a robustness test, we also examined variants of these clustering coefficients constrained to only positive triangles or negative triangles. We define C^cor,A,+ by restricting the enumeration of triangles in the calculation of C^cor,A to the positive triangles. In other words, we restrict the summation on the numerator and denominator of Equation (6) to j and ℓ satisfying ρ(i, j), ρ(i, ℓ), ρ(j, ℓ) > 0. We similarly define C^cor,A,−, C^cor,M,+ and C^cor,M,−. We removed six participants from the calculation of C^cor,A,− and C^cor,M,−. This is because, for these participants, there was at least one ROI i at which there was no triangle with ρ(i, j), ρ(i, ℓ), ρ(j, ℓ) < 0, rendering C^cor,A,− and C^cor,M,− undefined.

We provided C++ code for calculating the proposed clustering coefficients on Github (https://github.com/naokimas/clustering-corr-mat).

2.6. H-Q-S Algorithm

As a null model of the covariance matrix, we employed the Hirschberger-Qu-Steuer (H-Q-S) algorithm (Hirschberger et al., 2007). As recent fMRI data analysis has demonstrated, the H-Q-S algorithm is a more suitable null model than conventional null models in which the topology is randomized (Zalesky et al., 2012; Hosseini and Kesler, 2013). The H-Q-S algorithm preserves the mean of the diagonal elements, the mean of the off-diagonal elements and the variance of the off-diagonal elements of the given covariance matrix. From the fMRI data of each participant, we obtained the covariance matrix in the course of calculating the functional connectivity, which is the correlation matrix. Based on this covariance matrix, we generated random covariance matrices using H-Q-S algorithm. We then converted the generated random covariance matrices into correlation matrices, which were used as randomized functional connectivity matrices. We did not implement a fine-tuned heuristic variant proposed in Zalesky et al. (2012).

Denote by μ_on the average of the diagonal elements of the covariance matrix over the N_ROI diagonal elements. Denote by μ_off and ${\sigma }_{\text{off}}^2$ the average and variance of the off-diagonal elements, respectively. We set ${\overline{t}}_{max}=max\left(2,\lfloor (\underset{\text{on}}{\overset{2}{\mu }}-{\mu }_{\text{off}}^2)/{\sigma }_{\text{off}}^2\rfloor \right)$, where ⌊·⌋ is the largest integer smaller than or equal to the argument. Then, we generate $N_{\text{ROI}}\times {\overline{t}}_{max}$ variables, denoted by x_{i, t} (1 ≤ i ≤ N_ROI, $1\le t\le {\overline{t}}_{max}$) that independently obey the normal distribution with mean $\sqrt{{\mu }_{\text{off}}/{\overline{t}}_{max}}$ and variance $-{\mu }_{\text{off}}/{\overline{t}}_{max}+\sqrt{{\mu }_{\text{off}}^2/{\overline{t}}_{max}^2+{\sigma }_{\text{off}}^2/{\overline{t}}_{max}}$. The H-Q-S algorithm generates a randomized covariance matrix by ${\mathrm{\text{cov}}}_{ij}=\sum _{t=1}^{{\overline{t}}_{max}}{x}_{i\ell }{x}_{j\ell }$ (1 ≤ i, j ≤ N_ROI). In other words, the algorithm assumes that the signal at ROI i is a white-noise time series with a positive bias of length ${\overline{t}}_{max}$, which is independent across the time and ROIs.

2.7. White-Noise Signals

To generate another null model of the covariance matrix, we used white-noise signals. For each ROI, we generated a time series of length 200 in which the signal at each time step and ROI independently obeyed the normal distribution with mean 0 and standard deviation 1. Then, we calculated the covariance matrix using pairs of the N_ROI time series and converted it into the correlation matrix.

2.8. Participants

One-hundred thirty eight (n = 138) healthy and right-handed participants (54 females and 84 males) were selected from the Nathan Kline Institute's (NKI) Rockland Sample (Nooner et al., 2012). The NKI's data that we used are publicly available. The age of the participants ranged between 18 and 85 years (mean = 41.7, std = 18.4).

For four of our participants, the H-Q-S algorithm did not work because the average off-diagonal element for the empirical covariance matrix was negative, violating the precondition for the algorithm (Hirschberger et al., 2007). Therefore, we removed the four participants in the analysis that used the H-Q-S algorithm.

2.9. fMRI Data Acquisition and Preprocessing

The MRI data were recorded in a 3T scanner (MAGNETOM, TrioTim syngo MR B15, Siemens). fMRI data were obtained during rest with an echo planner imaging (EPI) sequence (TR = 2500 ms, TE = 30 ms, flip angle = 80°, 38 slices, spatial resolution = 3 × 3 × 3 mm³, FOV = 216 ms, acquisition time = 10 m 55 s). A total of t_max = 258 volumes was recorded from each participant. Anatomical images were acquired with T1-weighted sequence (MPRAGE) (TR = 2,500 ms, TE = 3.5 ms, flip angle = 8°, spatial resolution = 1 × 1 × 1 mm³). During the EPI data acquisition, the participants were asked to be relaxed with their eyes open.

Data preprocessing was performed using FMRIB's Software Library (FSL; www.fmrib.ox.ac.uk/fsl), including skull stripping of structural images with BET and registration with FLIRT; each functional image was registered to the participant's high-resolution brain-extracted structural image and the standard Montreal Neurological Institute (MNI) 2-mm brain. Functional data were then preprocessed with motion correction with MCFLIRT and smoothing with full-width half-maximum 5 mm. We also applied additional preprocessing steps to the functional data to remove spurious variance. First, we regressed out six head motion parameters, the global signal, cerebrospinal fluid (CSF) signal, and white matter (WM) signal with FSL FEAT. For each participant, CSF, gray matter (GM) and WM were segmented through FSL's FAST based on his/her T1. The signal averaged over all voxels in GM, WM and CSF was used as global signal. We then applied band-pass temporal filtering (0.01–0.1 Hz).

2.10. Linear Mixed Model

To estimate the linear mixed model with a fixed effect and random effects, we used the lmer function in lme4 package in R (v.3.4.1). The dependent variable in the linear mixed model was the local clustering coefficient. The fixed and random effects were the node strength and the participant, respectively. To obtain the P value, we used the F-test with Kenward-Roger approximation implemented as the KRmodcomp function in pbkrtest package in R.

3. Results

We demonstrate the utility of the proposed clustering coefficients on fMRI data collected from participants of a wide range of the age. We looked for associations of the clustering coefficients with the age and its dependence on the ROIs.

3.1. Comparison With Null Models

Statistically larger values of conventional clustering coefficients have repeatedly been observed in empirical brain networks as compared to the null models (Bullmore and Sporns, 2009; Bassett and Sporns, 2017). Motivated by these studies, we examined whether the amount of clustering was different between the empirical data and these null models after we controlled for the amount of correlation between two ROIs j and ℓ expected from an indirect path between j and ℓ through a third ROI i. For each participant, we compared the proposed clustering coefficients between the fMRI data obtained from all the participants, those calculated for the H-Q-S null model (Hirschberger et al., 2007; Zalesky et al., 2012), and white-noise signals.

The empirical correlation matrices yielded significantly larger values of the clustering coefficient than the correlation matrices for white-noise signals did. The results were consistent between the two definitions of the clustering coefficient, i.e., C^cor,A [empirical: 0.221 ± 0.029, white noise: 0.057 ± 0.002, t₍₁₃₇₎ = 66.0, P < 10⁻⁶, d = 11.28] and C^cor,M [empirical: 0.031 ± 0.008, white noise: 0.002 ± 0.000, t₍₁₃₇₎ = 40.3, P < 10⁻⁶, d = 6.89]. This result is consistent with the previous findings with the conventional clustering coefficients for networks, where empirical functional networks tended to have large clustering coefficients than randomized networks (Eguíluz et al., 2005; Salvador et al., 2005; Achard et al., 2006; Bassett and Bullmore, 2006).

In contrast, the two types of clustering coefficient were smaller for the empirical data than for the randomized data generated by the H-Q-S algorithm [for C^cor,A, H-Q-S: 0.281 ± 0.073, t₍₁₃₃₎ = −12.4, P < 10⁻⁶, d = −2.15; for C^cor,M, H-Q-S: 0.056 ± 0.039, t₍₁₃₃₎ = −8.59, P < 10⁻⁶, d = −1.49]. This result has probably arisen because the H-Q-S algorithm generates a correlation matrix from short white-noise time series assumed at each ROI. Then, the partial correlation (Equation 5) calculated for the H-Q-S algorithm is distributed relatively widely due to statistical fluctuations, whose distribution can be even wider than that for the empirical data. This fact makes C^cor,A and C^cor,M, which more or less depends on the absolute value of the partial correlation, large for the randomized data generated by the H-Q-S algorithm.

3.2. Age-Related Differences in the Clustering Coefficients Tailored to Correlation Matrices

Normal ageing was shown to adversely affect small-worldness of brain networks (Achard and Bullmore, 2007). Because the clustering coefficient is a major index which is used to assess the small-worldness of networks (Watts and Strogatz, 1998), we examined whether our clustering coefficients were able to detect such age-related changes in network structure. We found a negative relationship between each of the two types of clustering coefficients (i.e., C^cor,A and C^cor,M) and the age [C^cor,A: r₍₁₃₆₎ = −0.377, P < 10⁻⁵; C^cor,M: r₍₁₃₆₎ = −0.397, P < 10⁻⁵; Figures 2a,b, Table 1]. To explore whether the age is correlated with an index that can be more easily calculated than the clustering coefficient, we examined the relationships between the age and two indices of average functional connectivity. We found that the age was uncorrelated with s [r₍₁₃₆₎ = 0.020, P = 0.82; Figure 2c, Table 1] but negatively correlated with s⁺ [r₍₁₃₆₎ = −0.311, P = 0.0002; Figure 2d, Table 1]. The two clustering coefficients were also strongly correlated with s⁺, whereas they were not correlated with s (Table 2). Therefore, we suspected that the negative correlation between the clustering coefficients and the age was caused by the combination of the negative correlation between s⁺ and the age and the positive correlation between s⁺ and the clustering coefficient. However, significant negative correlation persisted between the clustering coefficients and the age even after controlling for the effect of s⁺ [C^cor,A: r₍₁₃₆₎ = −0.224, P = 0.0076; C^cor,M: r₍₁₃₆₎ = −0.259, P = 0.0019; see Figures 2e,f for the scatter plot between the clustering coefficient and the age after the linear effect of s⁺ has been regressed out from both variables; also see Table 1]. This result indicates that the negative correlation between the clustering coefficients and age is not completely explained by s⁺. Therefore, C^cor,A and C^cor,M quantify effects of the age on fMRI signals beyond what is revealed by the average functional connectivity.

FIGURE 2

Figure 2. Relationship between the age and network indices. (a) C^cor,A vs. age. (b) C^cor,M vs. age. (c) s vs. age. (d) s⁺ vs. age. (e) C^cor,A vs. age, where the effect of s⁺ is regressed out. (f) C^cor,M vs. age, where the effect of s⁺ is regressed out. A symbol represents an individual. The lines represent the linear fit: (a) age = −237.0 × C^cor,A + 94.1, (b) age = −857.5 × C^cor,M + 68.2, (c) age = 16.1 × s + 41.1, (d) age = −296.8 × s⁺ + 80.3, (e) age = −229.2 × C^cor,A, (f) age = −882.0 × C^cor,M. In (e,f), the linear contribution of s⁺ to the variables plotted in (a,b) are subtracted from the original variables and the residuals are plotted. The Pearson correlation coefficient between the residuals gives the partial correlation coefficient.

TABLE 1

Table 1. Correlation between the clustering coefficient and age.

TABLE 2

Table 2. Correlation between the clustering coefficient and the node strength.

Positive edges and negative edges may have distinct meanings (Rubinov and Sporns, 2011). Therefore, we examined variants of the proposed clustering coefficients calculated only from positive triangles (denoted by C^cor,A,+ and C^cor,M,+) or negative triangles (denoted by C^cor,A,− and C^cor,M,−). These variants of clustering coefficients were negatively correlated with the age [C^cor,A,+: r₍₁₃₆₎ = −0.398, P < 10⁻⁵; C^cor,A,−: r₍₁₃₀₎ = −0.291, P = 0.0007; C^cor,M,+: r₍₁₃₆₎ = −0.431, P < 10⁻⁵; C^cor,M,−: r₍₁₃₀₎ = −0.304, P = 0.0004]. This negative relationship was significant even after controlling for the effect of s⁺ [C^cor,A,+: r₍₁₃₆₎ = −0.263, P = 0.0019; C^cor,A,−: r₍₁₃₀₎ = −0.197, P = 0.024; C^cor,M,+: r₍₁₃₆₎ = −0.315, P = 0.0002; C^cor,M,−: r₍₁₃₀₎ = −0.196, P = 0.024]. The negative correlation was stronger for the clustering coefficients based on the positive triangles (i.e., C^cor,A,+ and C^cor,M,+) than those based on the negative triangles (i.e., C^cor,A,− and C^cor,M,−). We conclude that the age-related differences in the clustering coefficients observed with C^cor,A and C^cor,M are robust against the restriction of the method to the positive or negative triangles. Note that the age-related decline of C^cor,A,+ and C^cor,M,+ was stronger than that of C^cor,A and C^cor,M, respectively.

The rationale behind our clustering coefficients is that the correlation between two neighbors of a focal ROI should be discounted due to the effect of the indirect path. The clustering coefficients C^cor,A and C^cor,M are not the only indices complying with this rationale. To examine the robustness of our results with respect to specific definitions of the clustering coefficient, we examined the relationship among two other variants of the clustering coefficient designed for correlation matrices and s, s⁺ and the age. Although the correlation between the clustering coefficient and the age was somewhat weaker than in the case of C^cor,A and C^cor,M, the results with the other two variants of the clustering coefficient were qualitatively the same as those for C^cor,A and C^cor,M (Appendix A).

3.3. Age-Related Differences in the Conventional Clustering Coefficients

We repeated the same analysis using the clustering coefficients previously proposed for unweighted networks (i.e., C^unw) and weighted networks (i.e., C^wei,B, C^wei,O and C^wei,Z). For unweighted networks, we used two edge density values, 0.1 and 0.2. Qualitatively, the clustering coefficients for unweighted and weighted networks behaved similarly to C^cor,A and C^cor,M did. In other words, the clustering coefficients were negatively correlated with the age (Table 1), positively and strongly correlated with s⁺ and not with s with the exception of C^wei,B (Table 2). However, the correlation with the age was weaker than in the case of C^cor,A and C^cor,M (Table 1; see Appendix B for the statistical results). In fact, the partial correlation between the conventional clustering coefficients (i.e., C^unw, C^wei,B, C^wei,O, and C^wei,Z) and the age was not significant when one controls the effect of s⁺ (Table 1). These results suggest that these conventional clustering coefficients extract relatively similar information to that extracted by s⁺ as compared to C^cor,A and C^cor,M do.

3.4. Age-Related Differences in the Clustering Coefficients for Networks Derived from Partial Correlation Matrix

Functional networks are often defined in terms of the partial correlation matrix (Salvador et al., 2005; Marrelec et al., 2006; Smith et al., 2011). Therefore, as a benchmark, we calculated the conventional clustering coefficients (for unweighted and weighted networks) for functional networks defined by the partial correlation matrix. The clustering coefficients were not correlated with s or s⁺ (Table 2). These clustering coefficients were also uncorrelated with the age (Table 1).

3.5. Relationship Between the Local Clustering Coefficients and the Node Strength (Weighted Degree of the Node)

Local clustering coefficients have been used for characterizing individual ROIs (Sporns and Zwi, 2004; Achard et al., 2006; He et al., 2007; Alexander-Bloch et al., 2010; Lynall et al., 2010; Power et al., 2010; van den Heuvel et al., 2010; van den Heuvel and Sporns, 2011; Wee et al., 2011; Fornito et al., 2012; Tijms et al., 2013; Sala-Llonch et al., 2014). In this section we show that, differently from the conventional clustering coefficients, the present clustering coefficients do not confound the strength of local clustering at an ROI and the magnitude of the ROI's connectivity.

The clustering coefficients $C_i^{\text{cor},\text{A}}$ and $C_i^{\text{cor},\text{M}}$ are plotted against ${\tilde{s}}_i\equiv s_i/(N_{\text{ROI}}-1)$, i.e., the node strength normalized between −1 and 1, in Figure 3A, where a symbol represents a combination of an ROI and an individual. Figure 3A suggests that s_i and the local clustering coefficient are uncorrelated. To statistically prove this casual observation, we fitted a linear mixed-effects model for each type of local clustering coefficient. In the linear mixed-effects model, the local clustering coefficient value for the combination of a participant and an ROI was the dependent variable (n = 138 participants and N_ROI = 30 ROIs). The independent variable was the equivalent of the node strength, i.e., $\sum _{j=1;j\ne i}^{N_{\text{ROI}}}\rho (i,j)$. We assumed random effects over participants influencing the slope and intercept. We found that $C_i^{\text{cor},\text{A}}$ and $C_i^{\text{cor},\text{M}}$ did not show strong positive correlation with $\sum _{j=1;j\ne i}^{N_{\text{ROI}}}\rho (i,j)$ [$C_i^{\text{cor},\text{A}}$: t₍₄₁₃₉₎ = −2.33, P = 0.023, Pearson correlation coefficient between $C_i^{\text{cor},\text{A}}$ and $\sum _{j=1;j\ne i}^{N_{\text{ROI}}}\rho (i,j)$, i = 1, …, N_ROI for each participant, which is then averaged over all the participants, as a measure of effect size r₍₂₈₎ = −0.023, $C_i^{\text{cor},\text{A}}=-0.013{\tilde{s}}_i+0.222$; $C_i^{\text{cor},\text{M}}$: t₍₄₁₃₉₎ = −3.20, P = 0.0019, r₍₂₈₎ = −0.047, $C_i^{\text{cor},\text{M}}=-0.0050{\tilde{s}}_i+0.031$]. Note that the effect size as measured by r₍₂₈₎ was small, although the effects were significant owing to a large sample size.

FIGURE 3

Figure 3. (A) Relationship between ${\tilde{s}}_i$ and the local clustering coefficients for correlation matrices. (B) Relationship between ${\tilde{s}}_i$ and the local clustering coefficients for weighted networks. The solid lines represent the fixed effect estimated by the linear mixed model.

We investigated the same linear relationship for the correlation matrices generated by the randomization of the original correlation matrices using the H-Q-S algorithm. We generated one null model network per participant. For four participants, the algorithm did not work because the average off-diagonal element of the covariance matrix for the empirical covariance matrix was negative, violating the condition for the algorithm to be used (Hirschberger et al., 2007). For the remaining n−4 = 134 participants, the dependence of the local clustering coefficient of ROI i on $\sum _{j=1;j\ne i}^{N_{\text{ROI}}}\rho (i,j)$ remained small [$C_i^{\text{cor},\text{A}}$: t₍₄₀₁₉₎ = −1.93, P = 0.059, r₍₂₈₎ = −0.021, $C_i^{\text{cor},\text{A}}=-0.0051{\tilde{s}}_i+0.28$; $C_i^{\text{cor},\text{M}}$: t₍₄₀₁₉₎ = −1.21, P = 0.23, r₍₂₈₎ = −0.019, $C_i^{\text{cor},\text{M}}=-0.0016{\tilde{s}}_i+0.055$]. Therefore, we conclude that $C_i^{\text{cor},\text{A}}$ and $C_i^{\text{cor},\text{M}}$ (and hence C^cor,A and C^cor,M) are not affected by pseudo-correlation and provide measurements orthogonal to the node strength.

In contrast, the previously provided local clustering coefficients for unweighted or weighted networks [i.e., $C_i^{\text{unw}}$, $C_i^{\text{wei},\text{B}}$, $C_i^{\text{wei},\text{O}}$, and $C_i^{\text{wei},\text{Z}}$ given by Equations (1), (2), (3), and (4), respectively] should be correlated with the degree (i.e., the number of edges connected to a node), k_i (in the case of unweighted networks) or node strength, i.e., weighted degree s_i (in the case of weighted networks) when applied to correlation matrices. Let us explain this point for weighted networks for the sake of clarity. Because of indirect paths, if w_ij and w_iℓ are large, w_jℓ tends to be large, which increases the value of the local clustering coefficient of ROI i. At the same time, s_i is large if w_ij and w_iℓ are. Therefore, we expect systematic positive correlation between s_i and any of $C_i^{\text{unw}}$, $C_i^{\text{wei},\text{B}}$, $C_i^{\text{wei},\text{O}}$, and $C_i^{\text{wei},\text{Z}}$.

The three types of clustering coefficient for weighted networks ($C_i^{\text{wei},\text{B}}$, $C_i^{\text{wei},\text{O}}$, and $C_i^{\text{wei},\text{Z}}$) are plotted against ${\tilde{s}}_i$ in Figure 3B. We did not examine the local clustering coefficient for unweighted networks (i.e., $C_i^{\text{unw}}$) because it was undefined for many ROIs, whose nodal degree k_i was either 0 or 1; our network is relatively small (i.e., N_ROI = 30) and the edge density is not assumed to be too large. The three local weighted clustering coefficients and ${\tilde{s}}_i$ were strongly correlated [$C_i^{\text{wei},\text{B}}$: t₍₄₁₃₉₎ = 23.7 for the fixed effects of ${\tilde{s}}_i$, P < 10⁻¹⁵, r₍₂₈₎ = 0.43, the estimated fixed effects: $C_i^{\text{wei},\text{B}}=0.960{\tilde{s}}_i+0.601$; $C_i^{\text{wei},\text{O}}$: t₍₄₁₃₉₎ = 43.4, P < 10⁻¹⁵, r₍₂₈₎ = 0.70, $C_i^{\text{wei},\text{O}}=0.950{\tilde{s}}_i+0.064$; $C_i^{\text{wei},\text{Z}}$: t₍₄₁₃₉₎ = 10.8, P < 10⁻¹⁵, r₍₂₈₎ = 0.27, $C_i^{\text{wei},\text{Z}}=0.382{\tilde{s}}_i+0.325$].

Upon randomization of the original correlation matrices by the H-Q-S algorithm, the positive relationship between the local clustering coefficient and ${\tilde{s}}_i$ persisted for each weighted clustering coefficient index [$C_i^{\text{wei},\text{B}}$: t₍₄₀₁₉₎ = 13.1, P < 10⁻¹⁵, r₍₂₈₎ = 0.27, $C_i^{\text{wei},\text{B}}=0.509{\tilde{s}}_i+0.595$; $C_i^{\text{wei},\text{O}}$: t₍₄₀₁₉₎ = 37.0, P < 10⁻¹⁵, r₍₂₈₎ = 0.60, $C_i^{\text{wei},\text{O}}=0.628{\tilde{s}}_i+0.100$; $C_i^{\text{wei},\text{Z}}$: t₍₄₀₁₉₎ = 8.56, P = 3.7 × 10⁻¹³, r₍₂₈₎ = 0.17, $C_i^{\text{wei},\text{Z}}=0.217{\tilde{s}}_i+0.355$]. These results suggest that these local clustering coefficients are confounded by the effect of node strength, which could arise from the pseudo-correlation due to indirect paths.

3.6. Dependence of the Local Clustering Coefficients on the Brain System

Previous studies found systematic regional differences (e.g., across different lobes) in the local clustering coefficient in functional brain networks (Achard et al., 2006; Alexander-Bloch et al., 2010; Lynall et al., 2010; Sala-Llonch et al., 2014). However, this effect may be confounded by the effect of the node strength. As a case study, in this section we show that we do not see the association between previously defined brain systems (i.e., subsets of the ROIs constituting the entire network) and age-related changes in conventional local clustering coefficients if the effect of the node strength is controlled.

We first calculated the Pearson correlation coefficient (r) between the age and a nodal index such as the local clustering coefficient at each ROI. Then, we examined whether r was different across three brain systems whose functions and structures have been examined (Fair et al., 2009; Power et al., 2011): the default mode network (DMN), cingulo-opercular network (CON) and fronto-parietal network (FPN).

The r values between various nodal indices and the age, averaged over the ROIs in each of the DMN, CON, and FPN, are shown in Figure 4. For the clustering coefficients for weighted networks (i.e., C^wei,B, C^wei,O, and C^wei,Z), r was negative for most ROIs, confirming the results reported in section 3.2 that the (global) clustering coefficient was negatively correlated with the age of the participant. The r value was different between the three brain systems for each type of weighted clustering coefficient [$C_i^{\text{wei},\text{B}}$: F_{(2, 27)} = 4.32, P = 0.023, η² = 0.24; $C_i^{\text{wei},\text{O}}$: F_{(2, 27)} = 5.69, P = 0.0087, η² = 0.30; C^wei,Z: F_{(2, 27)} = 6.87, P = 0.0039, η² = 0.34; a one-way factorial analysis of variance (ANOVA) [System: DMN/CON/FPN]]. Post-hoc two-sample t-tests revealed that the effect of the age was larger in the DMN than in the CON and FPN [$C_i^{\text{wei},\text{B}}$, DMN − CON: t₍₁₇₎ = −2.64, P = 0.017, d = −1.28; $C_i^{\text{wei},\text{B}}$, DMN − FPN: t₍₂₁₎ = −2.38, P = 0.017, d = −1.04; $C_i^{\text{wei},\text{O}}$, DMN − CON: t₍₁₇₎ = −2.86, P = 0.011, d = −1.39; $C_i^{\text{wei},\text{O}}$, DMN − FPN: t₍₂₁₎ = −2.95, P = 0.00077, d = −1.29; $C_i^{\text{wei},\text{Z}}$, DMN − CON: t₍₁₇₎ = −3.84, P = 0.0013, d = −1.86; $C_i^{\text{wei},\text{Z}}$, DMN − FPN: t₍₂₁₎ = −2.78, P = 0.011, d = −1.21].

FIGURE 4

Figure 4. Pearson correlation coefficient between a nodal index and the age, averaged over the ROIs in the DMN, CON, or FPN. The circle represents the correlation coefficient value for a single node.

However, qualitatively the same association between the age and the brain system was also found when r was defined as the correlation between the node strength (i.e., s_i) and the age [F_{(2, 27)} = 8.01, P = 0.0019, η² = 0.37] and when r was defined as the correlation between $s_i^{+}$, which was defined as $\sum _{j=1;\rho (i,j)>0}^{N_{\text{ROI}}}\rho (i,j)$, and the age [F_{(2, 27)} = 4.43, P = 0.022, η² = 0.25]. Because the local clustering coefficients for weighted networks (i.e., $C_i^{\text{wei},\text{B}}$, $C_i^{\text{wei},\text{O}}$, and $C_i^{\text{wei},\text{Z}}$) were positively correlated with the node strength and $s_i^{+}$, we take s_i or $s_i^{+}$ as a simpler signature of the system dependence of the age effect than the local clustering coefficient.

In contrast, the proposed local clustering coefficients, which were not correlated with s_i or $s_i^{+}$ (Figure 3A), were not different across the brain systems [$C_i^{\text{cor},\text{A}}$: F_{(2, 27)} = 0.13, P = 0.88, η² = 0.01; $C_i^{\text{cor},\text{M}}$: F_{(2, 27)} = 0.04, P = 0.96, η² = 0.003; also see Figure 4]. These observations suggest that the apparent dependence of the clustering coefficient on the brain system when a conventional clustering coefficient is used is explained by the nodal measure, s_i or $s_i^{+}$.

We found similar results in sensory-motor regions in the brain (Appendix C). In other words, the association between the clustering coefficient and the age is more positive for the ROIs in a somatosensory-motor system than for the ROIs in an auditory system and a visual system when we used the clustering coefficients for weighted networks. Qualitatively the same dependence on the brain system was also found when we looked at the association between the node strength and the age. In contrast, with the proposed local clustering coefficients, the auditory system showed the strongest association between the clustering coefficient and the age. These results bear robustness to our suggestion that the proposed local clustering coefficients are not confounded by the node's strength, whereas the conventional clustering coefficients are.

4. Discussion

We proposed two clustering coefficients tailored to correlation matrices. They do not suffer from pseudo-correlation induced by indirect paths between two ROIs through a third ROI, do not require thresholding, do not discard negative pairwise correlation, and do not suffer from the difficulty in estimating partial correlation matrices. The proposed clustering coefficients were more strongly correlated with the participants' age than the conventional clustering coefficients, including those calculated for partial correlation matrices, were. In addition, our clustering coefficients can be used as a local measure to characterize nodes, whereas the counterparts for the conventional clustering coefficients were confounded with the (weighted) degree of the node. These results hold true for two alternative definitions of the clustering coefficient for correlation matrices that we additionally propose (Appendix A).

Previous research has produced incongruent results regarding the changes in the clustering coefficient along ageing. In an fMRI study, both at rest and during tasks, the clustering coefficient in functional networks decreased with ageing (Grady et al., 2016), which is consistent with the present results. This observation is also consistent with results of an EEG study at rest (Knyazev et al., 2015). In different studies, however, no difference was found in the clustering coefficient between younger and older individuals (Wang et al., 2010; Brier et al., 2014), or the clustering coefficient increased with ageing (Matthäus et al., 2012; Zhu et al., 2012; Liu et al., 2014; Sala-Llonch et al., 2014). The diversity in these results may owe to participant's heterogeneity, inefficiency of the conventional clustering coefficients or other reasons. It should be noted that the decrease in the clustering coefficient found in a recent study (Grady et al., 2016) and the present study is consistent with the decline in small-worldness of brain networks, which have been documented by using different indices (Achard and Bullmore, 2007; Gong et al., 2009). However, we do not claim that the decline in the clustering coefficient along ageing is a ground truth. In fact, the coordinates of the ROIs in the current data set were determined from participants aged 7–31 (Fair et al., 2009) so that they may not reflect functional ROIs in older adults (Chan et al., 2014; Geerligs et al., 2017). This issue warrants further study.

We demonstrated the utility of the proposed correlation coefficients with fMRI data collected from individuals of different ages. They may also be useful in deciphering functional brain networks collected from different types of individuals such as those with psychiatric or other disorders, those under different task conditions and children under developments. Furthermore, the present method can be used to any correlation or covariance matrix, thus promising their applicability to other functional data of the brain, such as EEG, MEG, correlation in the cortical thickness between ROIs, where correlation is calculated across individuals (see Introduction for references), and even correlation data outside neuroscience.

The proposed clustering coefficients are expected to find immediate applications in the assessment of small-worldness. In the small-world analysis, a major method is to combine the clustering coefficient and the average path length between a pair of nodes, denoted by L. When L is small and the clustering coefficient is large, one says that the network is small-world (Watts and Strogatz, 1998; Bullmore and Sporns, 2009) (but see Achard and Bullmore, 2007; Gong et al., 2009 for different definitions based on the so-called network efficiency indices). In neuroscience, it is often the case to combine these two indices to examine a single small-worldness index (Humphries et al., 2006) (also see Muldoon et al., 2016 for a recent development). The motivation behind the present study is that the definition or measurement of clustering is nontrivial for correlation matrices, i.e., functional data.

The same caution applies to the path length. A common way to calculate the path length in correlation data is to threshold on the correlation matrix to generate an unweighted network and then measure the path length. However, this method suffers from arbitrariness of thresholding, as discussed in Introduction. Another common way is to define a relationship between the edge weight, i.e., correlation coefficient value, and the cost of passing through the edge. Popular choices of the cost function are the reciprocal of the edge weight (Rubinov and Sporns, 2010) and a constant subtracted by the edge weight (Achard and Bullmore, 2007; Gong et al., 2009). However, the theoretical basis of these decisions seems unclear. A more sensible definition of the distance between ROIs i and j may be $\sqrt{2(1-\rho (i,j))}$, which qualifies as a Euclidean distance (Mantegna and Stanley, 2000).

We used the three-way partial correlation coefficient controlling for a single ROI to define the clustering coefficients. In contrast, some previous studies derived functional networks from partial correlation matrices (Salvador et al., 2005; Marrelec et al., 2006; Smith et al., 2011). Both types of methods intend to remove the spurious correlation induced by indirect paths between ROIs. While getting common, the methods based on partial correlation matrices face a technical challenge that the partial correlation matrix cannot be determined uniquely from data in general (Schäfer and Strimmer, 2005; Ryali et al., 2012; Brier et al., 2015). In addition, its calculation for a single pair of nodes involves all the other N_ROI − 2 nodes, contradicting the original premise of the clustering coefficient that it is a local quantity (Watts and Strogatz, 1998). Our clustering coefficients, which use the three-way partial correlation coefficient, do not suffer from the non-uniqueness problem and is a local quantity. Furthermore, we showed that the present clustering coefficients were associated with the age, whereas those calculated for the partial correlation matrices were not. Generalization of this finding to different ROIs, data sets and types of participants, such as those with a particular brain-related disorder, warrants future work.

Author Contributions

NM designed the research. MS preprocessed the data. NM and TE analyzed the data. NM, MS, TE, and TW discussed the results and wrote the manuscript.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We thank Koji Oishi for valuable feedback on the manuscript. NM acknowledges the support provided through JST CREST Grant Number JPMJCR1304 and the JST ERATO Grant Number JPMJER1201, Japan. MS acknowledges the support provided through European Commission (CIG618600) and Japan Society for the Promotion of Science (16H05959, 16KT0002 and 16H02053). TE acknowledges the support provided through PRESTO, JST (No. JPMJPR16D2).

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fninf.2018.00007/full#supplementary-material

References

Achard, S., and Bullmore, E. (2007). Efficiency and cost of economical brain functional networks. PLoS Comput. Biol. 3:e17. doi: 10.1371/journal.pcbi.0030017

PubMed Abstract | CrossRef Full Text | Google Scholar

Achard, S., Salvador, R., Whitcher, B., Suckling, J., and Bullmore, E. (2006). A resilient, low-frequency, small-world human brain functional network with highly connected association cortical hubs. J. Neurosci. 26, 63–72. doi: 10.1523/JNEUROSCI.3874-05.2006

PubMed Abstract | CrossRef Full Text | Google Scholar

Adachi, Y., Osada, T., Sporns, O., Watanabe, T., Matsui, T., Miyamoto, K., et al. (2012). Functional connectivity between anatomically unconnected areas is shaped by collective network-level effects in the macaque cortex. Cereb. Cortex 22, 1586–1592. doi: 10.1093/cercor/bhr234

PubMed Abstract | CrossRef Full Text | Google Scholar

Alexander-Bloch, A. F., Gogtay, N., Meunier, D., Birn, R., Clasen, L., Lalonde, F., et al. (2010). Disrupted modularity and local connectivity of brain functional networks in childhood-onset schizophrenia. Front. Syst. Neurosci. 4:147. doi: 10.3389/fnsys.2010.00147

PubMed Abstract | CrossRef Full Text | Google Scholar

Alexander-Bloch, A., Giedd, J. N., and Bullmore, E. (2013). Imaging structural co-variance between human brain regions. Nat. Rev. Neurosci. 14, 322–336. doi: 10.1038/nrn3465

PubMed Abstract | CrossRef Full Text | Google Scholar

Barrat, A., Barthélemy, M., Pastor-Satorras, R., and Vespignani, A. (2004). The architecture of complex weighted networks. Proc. Natl. Acad. Sci. U.S.A. 101, 3747–3752. doi: 10.1073/pnas.0400087101

PubMed Abstract | CrossRef Full Text | Google Scholar

Bassett, D. S., and Bullmore, E. (2006). Small-world brain networks. Neuroscientist 12, 512–523. doi: 10.1177/1073858406293182

PubMed Abstract | CrossRef Full Text | Google Scholar

Bassett, D. S., and Sporns, O. (2017). Network neuroscience. Nat. Neurosci. 20, 353–364. doi: 10.1038/nn.4502

PubMed Abstract | CrossRef Full Text | Google Scholar

Brier, M. R., Mitra, A., McCarthy, J. E., Ances, B. M., and Snyder, A. Z. (2015). Partial covariance based functional connectivity computation using Ledoit-Wolf covariance regularization. NeuroImage 121, 29–38. doi: 10.1016/j.neuroimage.2015.07.039

PubMed Abstract | CrossRef Full Text | Google Scholar

Brier, M. R., Thomas, J. B., Fagan, A. M., Hassenstab, J., Holtzman, D. M., Benzinger, T. L., et al. (2014). Functional connectivity and graph theory in preclinical Alzheimer's disease. Neurobiol. Aging 35, 757–768. doi: 10.1016/j.neurobiolaging.2013.10.081

PubMed Abstract | CrossRef Full Text | Google Scholar

Bullmore, E., and Sporns, O. (2009). Complex brain networks: graph theoretical analysis of structural and functional systems. Nat. Rev. Neurosci. 10, 186–198. doi: 10.1038/nrn2575

PubMed Abstract | CrossRef Full Text | Google Scholar

Chan, M. Y., Park, D. C., Savalia, N. K., Petersen, S. E., and Wig, G. S. (2014). Decreased segregation of brain systems across the healthy adult lifespan. Proc. Natl. Acad. Sci. U.S.A. 111, E4997–E5006. doi: 10.1073/pnas.1415122111

PubMed Abstract | CrossRef Full Text | Google Scholar

Costantini, G., and Perugini, M. (2014). Generalization of clustering coefficients to signed correlation networks. PLoS ONE 9:e88669. doi: 10.1371/journal.pone.0088669

PubMed Abstract | CrossRef Full Text | Google Scholar

Cover, T. M., and Thomas, J. A. (2006). Elements of Information Theory, 2nd Edn. New Jersey, NJ: John Wiley & Sons, Inc.

De Vico Fallani, F., Richiardi, J., Chavez, M., and Achard, S. (2014). Graph analysis of functional brain networks: practical issues in translational neuroscience. Philos. Trans. R. Soc. B 369:20130521. doi: 10.1098/rstb.2013.0521

PubMed Abstract | CrossRef Full Text | Google Scholar

Eguíluz, V. M., Chialvo, D. R., Cecchi, G. A., Baliki, M., and Apkarian, A. V. (2005). Scale-free brain functional networks. Phys. Rev. Lett. 94:018102. doi: 10.1103/PhysRevLett.94.018102

PubMed Abstract | CrossRef Full Text | Google Scholar

Evans, A. C. (2013). Networks of anatomical covariance. NeuroImage 80, 489–504. doi: 10.1016/j.neuroimage.2013.05.054

PubMed Abstract | CrossRef Full Text | Google Scholar

Facchetti, G., Iacono, G., and Altafini, C. (2011). Computing global structural balance in large-scale signed social networks. Proc. Natl. Acad. Sci. U.S.A. 108, 20953–20958. doi: 10.1073/pnas.1109521108

PubMed Abstract | CrossRef Full Text | Google Scholar

Fair, D. A., Cohen, A. L., Power, J. D., Dosenbach, N. U. F., Church, J. A., Miezin, F. M., et al. (2009). Functional brain networks develop from a “local to distributed” organization. PLoS Comput. Biol. 5:e1000381. doi: 10.1371/journal.pcbi.1000381

CrossRef Full Text | Google Scholar

Fornito, A., Zalesky, A., and Breakspear, M. (2013). Graph analysis of the human connectome: promise, progress, and pitfalls. NeuroImage 80, 426–444. doi: 10.1016/j.neuroimage.2013.04.087

PubMed Abstract | CrossRef Full Text | Google Scholar

Fornito, A., Zalesky, A., Pantelis, C., and Bullmore, E. T. (2012). Schizophrenia, neuroimaging and connectomics. NeuroImage 62, 2296–2314. doi: 10.1016/j.neuroimage.2011.12.090

PubMed Abstract | CrossRef Full Text | Google Scholar

Fox, M. D., Zhang, D., Snyder, A. Z., and Raichle, M. E. (2009). The global signal and observed anticorrelated resting state brain networks. J. Neurophysiol. 101, 3270–3283. doi: 10.1152/jn.90777.2008

PubMed Abstract | CrossRef Full Text | Google Scholar

Frenzel, S., and Pompe, B. (2007). Partial mutual information for coupling analysis of multivariate time series. Phys. Rev. Lett. 99:204101. doi: 10.1103/PhysRevLett.99.204101

PubMed Abstract | CrossRef Full Text | Google Scholar

Garrison, K. A., Scheinost, D., Finn, E. S., Shen, X., and Constable, R. T. (2015). The (in)stability of functional brain network measures across thresholds. NeuroImage 118, 651–661. doi: 10.1016/j.neuroimage.2015.05.046

PubMed Abstract | CrossRef Full Text | Google Scholar

Geerligs, L., Tsvetanov, K. A., and Cam-CAN Henson, R. N. (2017). Challenges in measuring individual differences in functional connectivity using fMRI: the case of healthy aging. Hum. Brain Mapp. 38, 4125–4156. doi: 10.1002/hbm.23653

PubMed Abstract | CrossRef Full Text | Google Scholar

Gong, G., Rosa-Neto, P., Carbonell, F., Chen, Z. J., He, Y., and Evans, A. C. (2009). Age- and gender-related differences in the cortical anatomical network. J. Neurosci. 29, 15684–15693. doi: 10.1523/JNEUROSCI.2308-09.2009

PubMed Abstract | CrossRef Full Text | Google Scholar

Grady, C., Sarraf, S., Saverino, C., and Campbell, K. (2016). Age differences in the functional interactions among the default, frontoparietal control, and dorsal attention networks. Neurobiol. Aging 41, 159–172. doi: 10.1016/j.neurobiolaging.2016.02.020

PubMed Abstract | CrossRef Full Text | Google Scholar

He, Y., Chen, Z. J., and Evans, A. C. (2007). Small-world anatomical networks in the human brain revealed by cortical thickness from MRI. Cereb. Cortex 17, 2407–2419. doi: 10.1093/cercor/bhl149

PubMed Abstract | CrossRef Full Text | Google Scholar

Heider, F. (1946). Attitudes and cognitive organization. J. Psychol 21, 107–112. doi: 10.1080/00223980.1946.9917275

PubMed Abstract | CrossRef Full Text | Google Scholar

Hirschberger, M., Qi, Y., and Steuer, R. E. (2007). Randomly generating portfolio-selection covariance matrices with specified distributional characteristics. Eur. J. Oper. Res. 177, 1610–1625. doi: 10.1016/j.ejor.2005.10.014

CrossRef Full Text | Google Scholar

Hosseini, S. M. H., and Kesler, S. R. (2013). Influence of choice of null network on small-world parameters of structural correlation networks. PLoS ONE 8:e67354. doi: 10.1371/journal.pone.0067354

PubMed Abstract | CrossRef Full Text | Google Scholar

Humphries, M. D., Gurney, K., and Prescott, T. J. (2006). The brainstem reticular formation is a small-world, not scale-free, network. Proc. R. Soc. B 273, 503–511. doi: 10.1098/rspb.2005.3354

CrossRef Full Text | Google Scholar

Jalili, M. (2016). Functional brain networks: does the choice of dependency estimator and binarization method matter? Sci. Rep. 6:29780. doi: 10.1038/srep29780

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaiser, M. (2011). A tutorial in connectome analysis: topological and spatial features of brain networks. NeuroImage 57, 892–907. doi: 10.1016/j.neuroimage.2011.05.025

PubMed Abstract | CrossRef Full Text | Google Scholar

Knyazev, G. G., Volf, N. V., and Belousova, L. V. (2015). Age-related differences in electroencephalogram connectivity and network topology. Neurobiol. Aging 36, 1849–1859. doi: 10.1016/j.neurobiolaging.2015.02.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Latora, V., and Marchiori, M. (2001). Efficient behavior of small-world networks. Phys. Rev. Lett. 87:198701. doi: 10.1103/PhysRevLett.87.198701

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, Y., Liang, M., Zhou, Y., He, Y., Hao, Y., Song, M., et al. (2008). Disrupted small-world networks in schizophrenia. Brain 131, 945–961. doi: 10.1093/brain/awn018

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, Z., Ke, L., Liu, H., Huang, W., and Hu, Z. (2014). Changes in topological organization of functional PET brain network with normal aging. PLoS ONE 9:e88690. doi: 10.1371/journal.pone.0088690

PubMed Abstract | CrossRef Full Text | Google Scholar

Lynall, M. E., Bassett, D. S., Kerwin, R., McKenna, P. J., Kitzbichler, M., Muller, U., et al. (2010). Functional connectivity and brain networks in schizophrenia. J. Neurosci. 30, 9477–9487. doi: 10.1523/JNEUROSCI.0333-10.2010

PubMed Abstract | CrossRef Full Text | Google Scholar

Mantegna, R. N., and Stanley, H. E. (2000). An Introduction to Econophysics. Cambridge: Cambridge University Press.

Google Scholar

Marrelec, G., Krainik, A., Duffau, H., Pélégrini-Issac, M., Lehéricy, S., Doyon, J., et al. (2006). Partial correlation for functional brain interactivity investigation in functional MRI. NeuroImage 32, 228–237. doi: 10.1016/j.neuroimage.2005.12.057

PubMed Abstract | CrossRef Full Text | Google Scholar

Matthäus, F., Schmidt, J. P., Banerjee, A., Schulze, T. G., Demirakca, T., and Diener, C. (2012). Effects of age on the structure of functional connectivity networks during episodic and working memory demand. Brain Conn. 2, 113–124. doi: 10.1089/brain.2012.0077

PubMed Abstract | CrossRef Full Text | Google Scholar

Muldoon, S. F., Bridgeford, E. W., and Bassett, D. S. (2016). Small-world propensity and weighted brain networks. Sci. Rep. 6:22057. doi: 10.1038/srep22057

PubMed Abstract | CrossRef Full Text | Google Scholar

Murphy, K., Birn, R. M., Handwerker, D. A., Jones, T. B., and Bandettini, P. A. (2009). The impact of global signal regression on resting state correlations: are anti-correlated networks introduced? NeuroImage 44, 893–905. doi: 10.1016/j.neuroimage.2008.09.036

PubMed Abstract | CrossRef Full Text | Google Scholar

Newman, M. E. J. (2010). Networks — An Introduction. Oxford: Oxford University Press.

Google Scholar

Nooner, K. B., Colcombe, S. J., Tobe, R. H., Mennes, M., Benedict, M. M., Moreno, A. L., et al. (2012). The NKI-Rockland sample: a model for accelerating the pace of discovery science in psychiatry. Front. Neurosci. 6:152. doi: 10.3389/fnins.2012.00152

PubMed Abstract | CrossRef Full Text | Google Scholar

Onnela, J.-P., Saramäki, J., Kertész, J., and Kaski, K. (2005). Intensity and coherence of motifs in weighted complex networks. Phys. Rev. E 71:065103(R). doi: 10.1103/PhysRevE.71.065103

PubMed Abstract | CrossRef Full Text | Google Scholar

Palla, G., Derényi, I., Farkas, I., and Vicsek, T. (2005). Uncovering the overlapping community structure of complex networks in nature and society. Nature 435, 814–818. doi: 10.1038/nature03607

PubMed Abstract | CrossRef Full Text | Google Scholar

Power, J. D., Cohen, A. L., Nelson, S. M., Wig, G. S., Barnes, K. A., Church, J. A., et al. (2011). Functional network organization of the human brain. Neuron 72, 665–678. doi: 10.1016/j.neuron.2011.09.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Power, J. D., Fair, D. A., Schlaggar, B. L., and Petersen, S. E. (2010). The development of human functional brain networks. Neuron 67, 735–748. doi: 10.1016/j.neuron.2010.08.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Radicchi, F., Castellano, C., Cecconi, F., Loreto, V., and Parisi, D. (2004). Defining and identifying communities in networks. Proc. Natl. Acad. Sci. U.S.A. 101, 2658–2663. doi: 10.1073/pnas.0400054101

PubMed Abstract | CrossRef Full Text | Google Scholar

Rieke, F., Warland, D., de Ruyter van Steveninck, R., and Bialek, W. (1999). Spikes. Cambridge, MA: The MIT Press.

Rubinov, M., and Sporns, O. (2010). Complex network measures of brain connectivity: uses and interpretations. NeuroImage 52, 1059–1069. doi: 10.1016/j.neuroimage.2009.10.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Rubinov, M., and Sporns, O. (2011). Weight-conserving characterization of complex functional brain networks. NeuroImage 56, 2068–2079. doi: 10.1016/j.neuroimage.2011.03.069

PubMed Abstract | CrossRef Full Text | Google Scholar

Ryali, S., Chen, T., Supekar, K., and Menon, V. (2012). Estimation of functional connectivity in fMRI data using stability selection-based sparse partial correlation with elastic net penalty. NeuroImage 59, 3852–3861. doi: 10.1016/j.neuroimage.2011.11.054

PubMed Abstract | CrossRef Full Text | Google Scholar

Sala-Llonch, R., Junqué, C., Arenaza-Urquijo, E. M., Vidal-Piñeiro, D., Valls-Pedret, C., Palacios, E. M., et al. (2014). Changes in whole-brain functional networks and memory performance in aging. Neurobiol. Aging 35, 2193–2202. doi: 10.1016/j.neurobiolaging.2014.04.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Salvador, R., Suckling, J., Coleman, M. R., Pickard, J. D., Menon, D., and Bullmore, E. (2005). Neurophysiological architecture of functional magnetic resonance images of human brain. Cereb. Cortex 15, 1332–1342. doi: 10.1093/cercor/bhi016

PubMed Abstract | CrossRef Full Text | Google Scholar

Saramäki, J., Kivelä, M., Onnela, J.-P., Kaski, K., and Kertész, J. (2007). Generalizations of the clustering coefficient to weighted complex networks. Phys. Rev. E 75:027105. doi: 10.1103/PhysRevE.75.027105

PubMed Abstract | CrossRef Full Text | Google Scholar

Schäfer, J., and Strimmer, K. (2005). A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics. Stat. Appl. Genet. Mol. Biol. 4:32. doi: 10.2202/1544-6115.1175

PubMed Abstract | CrossRef Full Text | Google Scholar

Smith, S. M., Miller, K. L., Salimi-Khorshidi, G., Webster, M., Beckmann, C. F., Nichols, T. E., et al. (2011). Network modelling methods for FMRI. NeuroImage 54, 875–891. doi: 10.1016/j.neuroimage.2010.08.063

PubMed Abstract | CrossRef Full Text | Google Scholar

Sporns, O. (2011). Networks of the Brain. Cambridge, MA: The MIT Press.

Google Scholar

Sporns, O., and Betzel, R. F. (2016). Modular brain networks. Annu. Rev. Psychol. 67, 613–640. doi: 10.1146/annurev-psych-122414-033634

PubMed Abstract | CrossRef Full Text | Google Scholar

Sporns, O., and Zwi, J. D. (2004). The small world of the cerebral cortex. Neuroinformatics 4, 145–162. doi: 10.1385/NI:2:2:145

CrossRef Full Text | Google Scholar

Stam, C. J. (2014). Modern network science of neurological disorders. Nat. Rev. Neurosci. 15, 683–695. doi: 10.1038/nrn3801

PubMed Abstract | CrossRef Full Text | Google Scholar

Supekar, K., Menon, V., Rubin, D., Musen, M., and Greicius, M. D. (2008). Network analysis of intrinsic functional brain connectivity in Alzheimer's disease. PLoS Comput. Biol. 4:e1000100. doi: 10.1371/journal.pcbi.1000100

PubMed Abstract | CrossRef Full Text | Google Scholar

Szell, M., Lambiotte, R., and Thurner, S. (2010). Multirelational organization of large-scale social networks in an online world. Proc. Natl. Acad. Sci. U.S.A. 107, 13636–13641. doi: 10.1073/pnas.1004008107

PubMed Abstract | CrossRef Full Text | Google Scholar

Tijms, B. M., Wink, A. M., de Haan, W., van der Flier, W. M., Stam, C. J., Scheltens, P., et al. (2013). Alzheimer's disease: connecting findings from graph theoretical studies of brain networks. Neurobiol. Aging 34, 2023–2036. doi: 10.1016/j.neurobiolaging.2013.02.020

PubMed Abstract | CrossRef Full Text | Google Scholar

van den Heuvel, M. P., Mandl, R. C. W., Stam, C. J., Kahn, R. S., and Hulshoff Pol, H. E. (2010). Aberrant frontal and temporal complex network structure in schizophrenia: a graph theoretical analysis. J. Neurosci. 30, 15915–15926. doi: 10.1523/JNEUROSCI.2874-10.2010

PubMed Abstract | CrossRef Full Text | Google Scholar

van den Heuvel, M. P., and Sporns, O. (2011). Rich-club organization of the human connectome. J. Neurosci. 31, 15775–15786. doi: 10.1523/JNEUROSCI.3539-11.2011

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, L., Li, Y., Metzak, P., He, Y., and Woodward, T. S. (2010). Age-related changes in topological patterns of large-scale brain functional networks during memory encoding and recognition. NeuroImage 50, 862–872. doi: 10.1016/j.neuroimage.2010.01.044

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, Y., Ghumare, E., Vandenberghe, R., and Dupont, P. (2017). Comparison of different generalizations of clustering coefficient and local efficiency for weighted undirected graphs. Neural Comput. 29, 313–331. doi: 10.1162/NECO_a_00914

PubMed Abstract | CrossRef Full Text | Google Scholar

Wasserman, S., and Faust, K. (1994). Social Network Analysis. New York, NY: Cambridge University Press.

Google Scholar

Watts, D. J., and Strogatz, S. H. (1998). Collective dynamics of ‘small-world’ networks. Nature 393, 440–442. doi: 10.1038/30918

PubMed Abstract | CrossRef Full Text | Google Scholar

Weaver, B., and Wuensch, K. L. (2013). SPSS and SAS programs for comparing Pearson correlations and OLS regression coefficients. Behav. Res. Meth. 45, 880–895. doi: 10.3758/s13428-012-0289-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Wee, C. Y., Yap, P. T., Li, W., Denny, K., Browndyke, J. N., Potter, G. G., et al. (2011). Enriched white matter connectivity networks for accurate identification of MCI patients. NeuroImage 54, 1812–1822. doi: 10.1016/j.neuroimage.2010.10.026

PubMed Abstract | CrossRef Full Text | Google Scholar

Whittaker, J. (1990). Graphical Models in Applied Multivariate Statistics. Chichester: John Wiley & Sons.

Google Scholar

Zalesky, A., Fornito, A., and Bullmore, E. (2012). On the use of correlation as a measure of network connectivity. NeuroImage 60, 2096–2106. doi: 10.1016/j.neuroimage.2012.02.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, B., and Horvath, S. (2005). A general framework for weighted gene co-expression network analysis. Stat. Appl. Genet. Mol. Biol. 4:17. doi: 10.2202/1544-6115.1128

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhu, W., Wen, W., He, Y., Xia, A., Anstey, K. J., and Sachdev, P. (2012). Changing topological patterns in normal aging using large-scale structural networks. Neurobiol. Aging 33, 899–913. doi: 10.1016/j.neurobiolaging.2010.06.022

PubMed Abstract | CrossRef Full Text | Google Scholar