Shared and Unshared Feature Extraction in Major Depression During Music Listening Using Constrained Tensor Factorization

Ongoing electroencephalography (EEG) signals are recorded as a mixture of stimulus-elicited EEG, spontaneous EEG and noises, which poses a huge challenge to current data analyzing techniques, especially when different groups of participants are expected to have common or highly correlated brain activities and some individual dynamics. In this study, we proposed a data-driven shared and unshared feature extraction framework based on nonnegative and coupled tensor factorization, which aims to conduct group-level analysis for the EEG signals from major depression disorder (MDD) patients and healthy controls (HC) when freely listening to music. Constrained tensor factorization not only preserves the multilinear structure of the data, but also considers the common and individual components between the data. The proposed framework, combined with music information retrieval, correlation analysis, and hierarchical clustering, facilitated the simultaneous extraction of shared and unshared spatio-temporal-spectral feature patterns between/in MDD and HC groups. Finally, we obtained two shared feature patterns between MDD and HC groups, and obtained totally three individual feature patterns from HC and MDD groups. The results showed that the MDD and HC groups triggered similar brain dynamics when listening to music, but at the same time, MDD patients also brought some changes in brain oscillatory network characteristics along with music perception. These changes may provide some basis for the clinical diagnosis and the treatment of MDD patients.

1. Introduction

Major depressive disorder (MDD) is a globally prevalent mental disorder with multifactorial causes (Belmaker and Agam, 2008; Gotlib and Joormann, 2010; Jia et al., 2010). Over the past decades, the neural mechanisms of MDD have been widely explored using non-invasive neuroimaging techniques, like functional magnetic resonance imaging (fMRI), electroencephalogram (EEG), and magnetoencephalography (Gotlib and Hamilton, 2008; Kaiser et al., 2015). Most previous studies of MDD are under the conditions of resting states or well-controlled stimuli. In recent years, naturalistic paradigms have been challenging conventional paradigms because they can approximate real-life experiences using naturalistic and continuous stimuli, like music listening and movie watching (Hasson et al., 2004; Sonkusare et al., 2019). Naturalistic paradigms have shown a clinical potential in mental disorders, such as MDD, autism-spectrum disorder, paranoia, and so on (Sonkusare et al., 2019). Music perception can induce emotional arousal for affective processing, and music therapy has shown the feasibility in MDD treatment (Michael et al., 2005; Maratos et al., 2008). However, few studies have correlated the music perceptive arousal with neural mechanisms in MDD, and the studies mainly explored the networks of brain connectivity at the source space (Liu et al., 2020, 2021; Zhu et al., 2021). Furthermore, the current findings are often inconsistent or even contradictory due to the different methodological approaches and involved participants, unified neural mechanisms of MDD (in music perception) can not be concluded (Zhi et al., 2018). Therefore, it is still urgent and important to develop novel experimental designs and advanced computational methodologies to better investigate the neural biomarkers of MDD. In our study, we aim to investigate the biomarkers in MDD during music listening using EEG data at the sensor level.

Due to the high temporal resolution, electroencephalography (EEG) signals contain rich spectral contents. During continuous cognition, the spatial reconfiguration will be dynamically sustained along time, and the spatial signatures are modulated by oscillations (Buzsaki, 2006; Yan et al., 2020; Sadaghiani et al., 2021). Apparently, the EEG signals can be represented by the high-order multi-way array, i.e., tensor, which can fully describe the inherent interaction relationships among multiple dimensions in the data (Kolda and Bader, 2009; Cichocki et al., 2015; Cong et al., 2015). Recently, some studies have investigated the electrophysiological signatures characterized by spatio-temporal-spectral modes of covariation from the tensor representation of EEG data via Canonical Polyadic (CP) decomposition (Mørup et al., 2007; Cong et al., 2012, 2015; Zhu et al., 2020). These studies are based on the assumption of spatial-, spectral-, temporal consistency, which means that each subject or group shares the same frequency-specific brain topography or networks with the same temporal dynamics (Cong et al., 2012, 2015). However, except for common features, individual features should also be considered for subject or group differences (Wang et al., 2020; Liu et al., 2021). Therefore, the incomplete spatial, temporal and spectral consistency should be assumed to better fit the data characteristics and practical applications. Meanwhile, numerous versions of independent component analysis (ICA)-based methods and their group analysis variants have also been popularly adopted to analyse EEG signals (Cong et al., 2013; Labounek et al., 2018; Zhu et al., 2021). For example, Zhu et al. performed group-level spatial Fourier ICA to explore the frequency-specific brain networks of musical feature processing, and found the alpha lateral component engaged in music perception in MDD (Zhu et al., 2021). These two-way methods simply stack or concatenate the extra modes of EEG signals into two-way matrix for processing, but lose the potential internal relationships among modes and destroy the inherent multi-linear structure of the data (Cong et al., 2015). Considering the high-dimensional structure of the data and the incomplete consistency of different modes, we applied a constrained tensor factorization model by imposing nonnegative and coupled constraints in the present study, by which we can access to the shared and unshared features simultaneously. Liu et al. only considered the coupling structure in spectral and connectivity modes and explored the connectivity alteration in EEG signals during music perception in MDD using tensor decomposition-based methods (Liu et al., 2021). Therefore, different from the previous work (Liu et al., 2020, 2021; Zhu et al., 2021), we further consider the coupling characteristics in the temporal modes between the MDD and healthy controls (HC) data at the sensor-level, i.e., we assume that some of the spatio-temporal-spectral patterns are the same between the two group data while the rest are different.

In this study, for the EEG signals of MDD and HC groups during music listening, we investigated spatio-temporal-spectral modes of covariation using a coupled nonnegative tensor factorization framework, aiming to extract the shared and unshared features between/in the two groups. Specifically, we first recorded the EEG signals during freely listening to a piece of 512-s tango music. Using the time-frequency representation, we then constructed two fourth-order tensors of time, frequency, space and participant for the two groups. Considering the incomplete consistency in spatio-temporal-spectral modes, we applied the triple-coupled nonnegative tensor factorization model optimized by alternating direction method of multipliers (ADMM, Boyd et al., 2011) algorithm, which enables the simultaneous decomposition of shared components and unshared components among tensors. Meanwhile, we extracted five long-term musical features from the musical stimulus using musical information retrieval in order to build the connections with the extracted components from EEG signals. Next, correlation analysis was performed between temporal courses of musical features and the extracted temporal components from EEG signals, and we obtained the spatio-temporal-spectral brain dynamics of interest that were believed to be activated by music modulation. Following this, hierarchical clustering was conducted on the shared and unshared spatial components of the results from multiple runs. Finally, we obtained two clusters of feature patterns shared by MDD and HC groups, as well as one cluster from the HC group and two clusters from the MDD group, which may contribute to the biomarkers for the clinical diagnosis and treatment for MDD patients. The proposed framework based on the constrained tensor factorization is completely data-driven and provides a solution to extract the shared and unshared spatio-temporal-spectral features of EEG signals from different groups.

2. Materials and Methods

2.1. Data Description

2.1.1. Participants

In this study, we analyzed the data from 39 participants in total, including nineteen healthy controls (HC) and 20 major depression disorder (MDD) patients. No one was reported to have hearing loss and formal training in music. The mental health of each participant was evaluated and diagnosed by a clinical expert using Hamilton Rating Scale for Depression (HRSD), Hamilton Anxiety Rating Scale (HAMA) and Mini-Mental State Examination (MMSE). The relative values of these indices as well as age, gender, education, duration of illness for HC and MDD groups are listed in Table 1. All participants signed the informed consent forms approved by the ethics committee of First Affiliated Hospital of Dalian Medical University and Dalian University of Technology.

TABLE 1

Table 1. Basic information of the participants in HC and MDD groups.

2.1.2. EEG data

A 512-second modern tango music “Adios Nonino” played by Astor Piazzolla was adopted as the naturalistic stimulus in this experiment. The participants were told to seat as still as possible with eyes open and listen to the tango music. The ongoing EEG data were recorded using the international 10–20 system-based Neuroscan Quik-cap device of 64 electrodes with the sampling frequency of 1,000 Hz. The recorded EEG data were preprocessed off-line using MATLAB software and EEGLAB toolbox (Delorme and Makeig, 2004), down-sampled to 256 Hz, and filtered by the high-pass and low-pass filters with 4 Hz and 30 Hz cut-off frequencies. The components indicating eye movements artifacts were rejected by independent component analysis (ICA). The data were also visually checked to remove the obvious artifacts brought by head movement, and then used for further analysis.

2.1.3. Musical Features

In this study, five long-term musical features (including two tonal and three rhythmic features) were extracted by a frame-by-frame analysis method using MIR toolbox (Lartillot and Toiviainen, 2007). The duration of each frame was 3 s and the overlap ratio between two frames was 66.7%, which was consistent with the window settings in the time-frequency representation of EEG data. Finally, in order to match the length of recorded EEG data, we selected the first 500 samples for each time course of these musical features with a 1 Hz sampling rate. For the tonal features, Mode denotes the strength of major or minor mode, and Key Clarity is the measure of the tonal clarity. For the rhythmic features, Fluctuation Centroid is defined as the geometric mean of the fluctuation spectrum, and it represents the global repartition of rhythm periodicities within the range of 0~10 Hz, indicating the average frequency of these periodicities. Fluctuation entropy is the Shannon entropy of the fluctuation spectrum, and it represents the global repartition of rhythm periodicities. Pulse Clarity is regarded as an estimate of clarity of the pulse. The details of musical features and extraction method can be found in the previous studies (Alluri et al., 2012; Cong et al., 2013).

2.2. Constrained Tensor Factorization

2.2.1. Tensor Construction

In order to comprehensively analyze the data from more aspects, we first converted the data from the time domain to the time-frequency domain. Specifically, we obtained the time-frequency representation of the preprocessed EEG data via performing the short-time Fourier transform (STFT) on the time series of each channel for each participant. The Hamming window was adopted as the window function, with the window length of 3 s and 66.7% overlap ratio between windows. The number of Fourier points in each window was 1,280, which was five times of the sampling rate. Finally, for the data of each channel, we obtained the spectrograms with the size of 130 (frequency bins) × 500 (time samples). Therefore, for the HC group and MDD group, the EEG data were reconstructed to two fourth-order tensors with the dimensions of channel (64), frequency (130), time (500) and participants (19 or 20), i.e., ${{X}}_{\mathrm{\text{HC}}}\in {ℝ}_{+}^{64\times 130\times 500\times 19}$ and ${{X}}_{\mathrm{\text{MDD}}}\in {ℝ}_{+}^{64\times 130\times 500\times 20}$.

2.2.2. Tensor Factorization

Tensors, also known as multi-way arrays, are the higher-order generalizations of scalars, vectors and matrices. So far, the two most commonly used models for tensor factorization are the canonical polyadic [CP (Hitchcock, 1927), also known as CANDECOMP/PARAFAC (Carroll and Chang, 1970; Harshman, 1970)] model and the Tucker model (Tucker, 1966). The CP model, as a special case of the Tucker model, has better unique identifiability under mild conditions, and was adopted in this study. Thus, the factorizations of the data ${{X}}_{\mathrm{\text{HC}}}$ and ${{X}}_{\mathrm{\text{MDD}}}$ can be, respectively expressed, using a sum of fourth-order rank-one tensors or a set of factor matrices, as

$\begin{array}{ll}{{X}}_{\text{HC}}\approx {\displaystyle \sum _{r=1}^{R_{\text{HC}}}{a}_r^{(1)}}○a_r^{(2)}○a_r^{(3)}○a_r^{(4)}=〚A_1,A_2,A_3,A_4〛& (1)\end{array}$

and

$\begin{array}{ll}{{X}}_{\text{MDD}}\approx {\displaystyle \sum _{r=1}^{R_{\text{MDD}}}{b}_r^{(1)}}○b_r^{(2)}○b_r^{(3)}○b_r^{(4)}=〚B_1,B_2,B_3,B_4〛& (2)\end{array}$

where R_HC and R_MDD are the tensor rank or the number of components that will be extracted from ${{X}}_{\mathrm{\text{HC}}}$ and ${{X}}_{\mathrm{\text{MDD}}}$. “○” denotes the vector outer product. $A_i=\left[a_1^{(i)}\cdots a_{R_{\mathrm{\text{HC}}}}^{(i)}\right]\in {ℝ}_{+}^{I_i\times R_{\mathrm{\text{HC}}}}$ and $B_i=\left[b_1^{(i)}\cdots b_{R_{\mathrm{\text{MDD}}}}^{(i)}\right]\in {ℝ}_{+}^{J_i\times R_{\mathrm{\text{MDD}}}}$, i = 1, 2, 3, 4, correspond to the factor matrices in the spatial, spectral, temporal and participant modes, respectively.

2.2.3. Non-negative Coupled Tensor Factorization

Constrained tensor factorization can accurately extract and explain the hidden components from the input data, by imposing particular penalties/regularizations (e.g., nonnegativity, sparsity, smoothness, coupling) on the corresponding factor matrices in the factorization process. Consider the connections and inherent characteristics of the data ${{X}}_{\mathrm{\text{HC}}}$ and ${{X}}_{\mathrm{\text{MDD}}}$, we imposed the nonnegative constraint in all of modes and the coupling structure in spatial, spectral, temporal modes across the data during the optimization. For the factor matrices A_i and B_i, i = 1⋯4, we assume each one consists of two parts as $A_i=\left[A_i^C{A}_i^I\right]$ and $B_i=\left[B_i^C{B}_i^I\right]$, where $A_i^C=B_i^C\in {ℝ}_{+}^{I_i\times L_i}$ denotes L_i components are shared by the data, while $A_i^I\in {ℝ}_{+}^{I_i\times (R_{\text{HC}}-L_i)}$ and $B_i^I\in {ℝ}_{+}^{I_i\times (R_{\text{MDD}}-L_i)}$ correspond to the individual components in each data. L_i is the number of shared components among data (L₄ = 0). Thus, the shared and unshared components can be simultaneously extracted via the formulated nonnegative coupled tensor factorization (NCTF) model, in which the objective function should be minimized as follows:

$\begin{array}{l}\text{minmize }{L}(A_i,B_i)={\Vert {{X}}_{\text{HC}}-〚A_1,A_2,A_3,A_4〛\Vert }_F^2+\Vert {{X}}_{\text{MDD}}\\ {-〚B_1,B_2,B_3,B_4〛\Vert }_F^2& (3)\end{array}$

$\text{subject to }{A}_i\ge 0,B_i\ge 0\text{ for }i=1\cdots 4$

where ||·||_F denotes the Frobenius norm.

2.2.4. Algorithm Optimization

Obviously, the minimization in Equation (3) is not convex but in fact an NP-hard problem. Aiming for an easy-to-handle and robust approximation, we propose to use the ADMM method within the framework of block coordinate descent (BCD) to solve the above optimization problem, which has been proven to be very efficient in the regularized matrix and tensor factorizations (Huang et al., 2016; Schenker et al., 2020). Specifically, BCD framework can obtain a local solution of Equation (3) by converting it into a set of subproblems, in which the factor matrices A₁&B₁, A₂&B₂, A₃&B₃ and A₄&B₄ will be updated alternatively one by one in each iteration, then each subproblem can be solved using ADMM strategy. Taking the update of the primal variable pair A_i and B_i, i = 1, ⋯4 as an example, the problem in Equation (3) can be reformulated by introducing the auxiliary variables ${\tilde{A}}_i$ and ${\tilde{B}}_i$ as follows:

$\begin{array}{l}\text{minmize }{L}(A_i,{\tilde{A}}_i,B_i,{\tilde{B}}_i)={\Vert {{X}}_{\text{HC}}-〚A_1,A_2,A_3,A_4〛\Vert }_F^2\\ +{\Vert {{X}}_{\text{MDD}}-〚B_1,B_2,B_3,B_4〛\Vert }_F^2& (4)\end{array}$

$\text{subject to }{A}_i={\tilde{A}}_i,B_i={\tilde{B}}_i,{\tilde{A}}_i\ge 0{\tilde{B}}_i\ge 0.$

The augmented Lagrangian function of Equation (4) is given as:

$\begin{array}{l}\text{minmize }{L}(A_i,\widetilde{A_i},{\Lambda }_{{\text{A}}_i},B_i,\widetilde{B_i},{\Lambda }_{{\text{B}}_i})={\Vert {{X}}_{\text{HC}}-〚A_1,A_2,A_3,A_4〛\Vert }_F^2\\ +{\rho }_i{\Vert A_i-{\tilde{A}}_i+{\Lambda }_i\Vert }_F^2+{\Vert {{X}}_{\text{MDD}}-〚B_1,B_2,B_3,B_4〛\Vert }_F^2\\ +{\sigma }_i{\Vert B_i-{\tilde{B}}_i+{\Gamma }_i\Vert }_F^2& (5)\end{array}$

where ${\Lambda }_i\in {ℝ}_{+}^{I_i\times R_{\mathrm{\text{HC}}}}$ and ${\Gamma }_i\in {ℝ}_{+}^{J_i\times R_{\mathrm{\text{MDD}}}}$ are the Lagrangian multipliers or dual variables, ρ_i and σ_i are the penalty parameters. The solutions for Equation (5) can be calculated by successively minimizing ${L}$ with respect to A_i, B_i, ${\tilde{A}}_i$, ${\tilde{B}}_i$, Λ_i and Γ_i one at a time while fixing the others until convergence. The update rules of these variables can be seen in Equation (6), where F_A = A₄⊙⋯A_i+1⊙⋯A_i−1⊙A₁, and F_B = B₄⊙⋯B_i+1⊙⋯B_i−1⊙B₁, “⊙” is the Khatri-Rao product. $X_{\mathrm{\text{HC}},i}\in {ℝ}_{+}^{I_i\times {\prod }_{k\ne i}^4}$ and $X_{\mathrm{\text{MDD}},i}\in {ℝ}_{+}^{J_i\times {\prod }_{k\ne i}^4}$ mean the mode-i matricization of tensors ${{X}}_{\mathrm{\text{HC}}}$ and ${{X}}_{\mathrm{\text{MDD}}}$. (·)^C represents the first L_i columns of the matrix and (·)^I is the remaining columns. Analogously, we can obtain the updating solutions of other variables. It should be noted that the derivation of the coupling parts $A_i^C=B_i^C,i=1,2,3$ should be refer to the information from ${{X}}_{\mathrm{\text{HC}}}$ and ${{X}}_{\mathrm{\text{MDD}}}$. The entire optimization process is termed as NCTF-ADMM algorithm and summarized in Algorithm 1. Moreover, in this study, two stopping criteria were adopted in the algorithm optimization. (i) ||RelErr_new − RelErr_old|| < tol, it means that the relative error (RelErr) change of data fittings between the adjacent iterations should be smaller than tol (here we set tol = 10e − 8). RelErr is defined as $\mathrm{\text{RelErr}}=\frac{\left|\right|{{X}}_{\mathrm{\text{HC}}}-{\tilde{{X}}}_{\mathrm{\text{HC}}}|{|}_F}{\left|\right|{{X}}_{\mathrm{\text{HC}}}|{|}_F}+\frac{\left|\right|{{X}}_{\mathrm{\text{MDD}}}-{\tilde{{X}}}_{\mathrm{\text{MDD}}}|{|}_F}{\left|\right|{{X}}_{\mathrm{\text{MDD}}}|{|}_F}$, ${\tilde{{X}}}_{\mathrm{\text{HC}}}$ and ${\tilde{{X}}}_{\mathrm{\text{MDD}}}$ are the recovered tensors. Meanwhile, the Fit value is defined as $\mathrm{\text{Fit}}=1-\frac{\mathrm{\text{RelErr}}}{2}$. (ii) The maximum number of iterations is no more than 1,000.

ALGORITHM 1:

Algorithm 1: NCTF-ADMM algorithm.

2.3. Correlation Analysis

To discover the relationships between musical stimuli and the EEG data, five musical features were first extracted from the music stimuli. After performing NCTF-ADMM algorithm on the HC and MDD tensor data, a correlation analysis method was conducted between time courses of extracted temporal components and time courses of musical features. We adopted Pearson correlation to calculated the correlation efficient, and applied the Monte Carlo method and permutation test to determine the significant thresholds of the correlation and correct for multiple comparisons (Alluri et al., 2012; Cong et al., 2013; Wang et al., 2020). For the time course of each musical feature, a threshold of correlation coefficient at a significant level of p < 0.05 was calculated with the time courses of extracted temporal components. Then those components whose temporal components satisfied significant correlation were considered to be related to musical stimuli, and will be of interest and further analyzed.

$\begin{array}{ll}\{\begin{array}{l}{A}_i^C=B_i^C=\hfill \\ \left[X_{\text{HC},i}{F}_A^C+X_{\text{MDD},i}{F}_B^C-A_1^I{\left(F_A^I\right)}^T{F}_A^C-B_1^I{\left(F_B^I\right)}^T{F}_B^C-{\Lambda }_i^C-{\Gamma }_i^C+{\rho }_i{\tilde{A}}_i^C+{\sigma }_i{\tilde{B}}_i^C\right]\hfill \\ {\left[{\left(F_A^C\right)}^T{F}_A^C+{\left(F_B^C\right)}^T{F}_B^C+\left({\rho }_i+{\sigma }_i\right)I\right]}^{-1}\hfill \\ A_i^I=\left[X_{\text{HC},i}{F}_A^I-A_i^C{\left(F_A^I\right)}^T{F}_A^C-{\Lambda }_i^I+{\rho }_i{\tilde{A}}_1^I\right]{\left[{\left(F_{\text{A}}^I\right)}^T{F}_{\text{A}}^I+{\rho }_{i}I\right]}^{-1}\hfill \\ B_i^I=\left[X_{\text{MDD},i}{F}_B^I-B_i^C{\left(B_A^I\right)}^T{F}_B^C-{\Gamma }_i^I+{\sigma }_i{\tilde{B}}_i^I\right]{\left[{\left(F_{\text{B}}^I\right)}^T{F}_{\text{B}}^I+{\sigma }_{i}I\right]}^{-1}\hfill \\ {\tilde{A}}_i={\left[A_i+{\Lambda }_i\right]}_{+},{\tilde{B}}_i={\left[B_i+{\Gamma }_i\right]}_{+},{\Lambda }_i={\Lambda }_i+A_i-{\tilde{A}}_i,{\Gamma }_i={\Gamma }_i+B_i-{\tilde{B}}_i\hfill \end{array}& (6)\end{array}$

2.4. Shared and Unshared Feature Clustering

In order to guarantee the reliability of the results, we independently performed the constrained tensor factorization multiple times (in this study we set 50 times). After performing correlation analysis for the multiple results, we adopted clustering method to cluster the shared and unshared spatial components, respectively. Meanwhile, we merged the corresponding spectral component and counted the musical feature distributions that were involved in the same cluster. For stable clustering, we adopted hierarchical agglomerative clustering algorithm, in which complete linkage was used to calculate the furthest distance (here we used correlation) between pairs of clusters and the pairs of clusters with the nearest distance were merged.

3. Results

The EEG data used in this study can be obtained from the corresponding authors according to reasonable requirements, and the code to reproduce the simulation in Section 3.1 is available at https://github.com/xiulinwang/FrontierHN-NCTF-ADMM.

The following experiments are done with the following computer configurations; CPU: Intel^Ⓡ Xeon(R) E5-2680 v2 @ 2.80 Hz × 40; Memory: 125.80 GiB; System: 64-bit ubuntu 16.04; Matlab R2014b.

3.1. Simulation Results

In this study, we first designed the simulation data to verify the performance of the proposed constrained tensor factorization method. We generated four kinds of predefined component factors indicating spatial, spectral, temporal and participant information, respectively, and then constructed two fourth-order tensors representing the simulated HC and MDD data via the outer product of corresponding vectors as follows:

$\begin{array}{ll}{X}={\displaystyle \sum _{r=1}^R{u}_r^{(1)}}{u}_r^{(2)}{u}_r^{(3)}{u}_r^{(4)}& (7)\end{array}$

where $u_r^{(1)}\in {ℝ}_{+}^{64\times 1}$, $u_r^{(2)}\in {ℝ}_{+}^{130\times 1}$, $u_r^{(3)}\in {ℝ}_{+}^{500\times 1}$ and $u_r^{(4)}\in {ℝ}_{+}^{19(20)\times 1}$ present topography, power spectrum, waveform and magnitude of participant, respectively, as shown in Figure 1A. ${X}\in {ℝ}_{+}^{64\times 130\times 500\times 19(20)}$ denotes the ground true EEG data, and the noised synthetic EEG data was generated as

$\begin{array}{ll}{Z}={\sigma }_x\frac{{X}}{\Vert {X}\Vert }+{\sigma }_n\frac{{N}}{\Vert {N}\Vert }& (8)\end{array}$

where σ_x and σ_n denote the levels of signal and noise. ${N}$ is the noise tensor data uniformly distributed on the open interval (0, 1) and of the same size with ${X}$. SNR refers to the signal-to-noise ratio defined as SNR = 10log10(σ_x/σ_n), and we set SNR to 20dB in this experiment. For the two synthetic tensors, the number of component is set to R_HC = 3 and R_MDD = 4. We assume there are two common components in the spatial, spectral and temporal modes between two tensors, i.e., L₁ = L₂ = L₃ = 2 and L₄ = 0, which are parallel to the assumptions in the following ongoing EEG data processing. The spatial patterns were generated based on the brain activations located in the occipito-parietal, center, right occipital, frontal and left occipital regions (the 1st row of Figure 1A), respectively, corresponding to the frequency fluctuations centered at 10, 13, 20, 7, and 24 Hz (the 2nd row of Figure 1A). The temporal patterns were constructed using the time courses from the benchmark simulated complex fMRI dataset¹ (the 3rd row of Figure 1A). The magnitude of participants is uniformly distributed, but for the common components, we limited the corresponding magnitude to (0, 0.2) and (0.5, 0.7) in order to better discriminate the two groups (the 4th row of Figure 1A).

FIGURE 1

Figure 1. Illustration of simulation generation and recovered results. (A) Simulated spatial, spectral, temporal and participant patterns (from top to bottom) for the two groups with partially coupled constraints in the first two components of spatial, spectral and temporal modes (see them in the 1st, 2nd, 4th, and 5th columns). (B) Reconstructed spatial, spectral, temporal and participant patterns (from top to bottom) using constrained tensor factorization methods.

We applied NCTF-ADMM algorithm to the simulated HC and MDD data, and the extracted spatial, spectral, temporal and participant components can be seen in Figure 1B. We conducted the algorithm 50 times, and got the averaged tensor fit of 0.9343 with the averaged running time of 111.85 s. The averaged correlation between the two sets of true factor matrices and recovered factor matrices is close to 1.

3.2. EEG Results

In terms of the number of components for the tensor data, a simple explained variance-based principal component analysis (PCA) method was adopted (Liu et al., 2021), and the number of principal components with 99% accumulated explained variance were assigned to R_HC and R_MDD, then we set R_HC = 26, R_MDD = 36. Regarding the number of coupled components, we first ran the NCTF-ADMM without coupling constraints 10 times, and then we directly calculated the correlations in the spectral/spatial modes and performed correlation analysis in the temporal mode between the two groups of data, respectively. Finally, we selected the averaged number of highly correlated (0.87 and 0.90) and significantly correlated (p < 0.05) components as the number of shared components, i.e., L₁ = L₂ = L₃ = 17 and L₄ = 0.

We first carried out the proposed NCTF-ADMM algorithm 50 times on the two groups of ongoing EEG data, and then through correlation analysis and hierarchical clustering, we totally obtained 5 clusters of shared and unshared component patterns between/in HC and MDD groups. The averaged topographies, power spectrum, musical feature distribution and spatial correlation maps in the same cluster are plotted in Figure 2. Specifically, from the shared components extracted from HC and MDD data, we found two clusters of interested component patterns which were considered to be activated by the music modulation, and the probabilities of components in clusters #1 and #2 occurring in 50 runs reach 96% and 90%. Regarding cluster #1, the topography reveals that the right parietal region of the brain was activated with the low alpha oscillations modulated by the music feature “Mode”, while the cluster #2 represents the activation of parietal region of the brain with high alpha oscillations. The averaged correlations of spatial components in clusters #1 and #2 reached 0.9618 and 0.9757. For unshared components in HC group, we obtained one cluster in which the left occipital region was activated with the alpha oscillations and mostly modulated by the music features “Key Clarity” and “Fluctuation Centroid”. This cluster was unstable probably due to the low signal-to-noise ratio nature of EEG signals, and it was only clustered 32 times out of 50 times with the averaged spatial correlation of 0.8765. Moreover, the shared components in the MDD group were included into two clusters, cluster #4 reveals that the frontal region of the brain was activated with theta oscillations and modulated by the music feature “Mode”, and cluster #5 reveals that the modulation of musical feature “Key Clarity” brought about the activation of alpha oscillations in the parietal-occipital region of the brain. The occurrence probabilities of spatial components from clusters #4 and #5 in 50 runs are 100% and 96% with the averaged spatial correlations of 0.9831 and 0.8408.

FIGURE 2

Figure 2. Illustration of the extracted component patterns (from left to right column: mean topography, overall power spectrum, music feature distribution and intra-cluster correlation maps) from HC and MDD EEG data via 50 runs of constrained tensor factorization method, and the parallel temporal component was significantly correlated with at least one of the musical features. (A) Common component patterns clustered from the shared components of 50 runs between HC and MDD data. (B) Individual component patterns clustered from the individual components of 50 runs in HC data. (C) Individual component patterns clustered from the individual components of 50 runs in MDD data. Md, Mode; KE, Key Clarity; FC, Fluctuation Centroid; FE, Fluctuation entropy; PC, Pulse Clarity.

4. Discussion

In this study, we investigated the shared and unshared brain activities of spatio-temporal-spectral modes from the HC and MDD data using EEG collections during freely listening to music. To this end, we proposed a complete solution combining constrained tensor factorization, musical information retrieval and spatial clustering, in which the brain activities of interest that were believed to be activated by music modulation were discovered. Through the time-frequency representation, we constructed two fourth-order tensors of time × frequency × space × participant for HC and MDD groups, and the two tensors were decomposed at the same time with the extraction of common and individual components using nonnegative coupled tensor factorization, and its performance has been verified using simulation data in section 3.1. Meanwhile, five long-term musical features, including two tonal and three rhythmic features, were extracted using the MIR toolbox. Then we adopted the correlation analysis to identify the components of interest whose temporal components were significantly correlated with any of the five music features, and performed clustering analysis on the outcomes of correlation analysis of the repeated runs in order to obtain reliable and convincing results.

For the simulated data, as shown in Figure 1, we can see that the simulated factor matrices representing space, frequency, time and participant loadings were successfully recovered using nonnegative and coupled tensor factorization with high tensor fittings. The participant loadings of the two coupled components are significantly different in the magnitude distribution. Compared with the conventional tensor factorization (Cichocki et al., 2015; Cong et al., 2015; Sidiropoulos et al., 2017), the constrained tensor factorization applied in this study simultaneously considered the shared and unshared information between/in the two groups of data via imposing the coupling structure (Zhou et al., 2016; Wang et al., 2019, 2020). Moreover, it can achieve unique solutions and interpretable components, while circumventing the independence constraint compared to its matrix counterparts (Calhoun et al., 2009; Hunyadi et al., 2017; Labounek et al., 2018; Zhu et al., 2021). As we all know, EEG signals are recorded as the multi-way tensors of time, space, subject, or group modes, thus multi-way analysis methods are attractive and promising tools for processing such tensor data, while the two-way analysis will lose the multilinear structure and hidden internal relationships in the original data (Cong et al., 2015).

The researchers have reported that a considerable amount of neural dynamic changes distributed in multiple subcortical and cortical regions (such as auditory, tactile, visual) were found in EEG/fMRI recordings during music perception (Andrade and Bhattacharya, 2003; Khalfa et al., 2005; King et al., 2019). These regions including hippocampus, hypothalamus, orbitofrontal and ventral medial prefrontal cortex are typically involved during emotion evocation, processing and hedonic regulation in voices (Menon and Levitin, 2005). Therefore, the potential of music to modulate activities in brain networks is worth investigating in MDD. Using the constrained tensor factorization-based framework, we were able to provide the feasibility to identify the brain dynamics involved in the processing of acoustical music from the ongoing EEG signals, and finally obtained two shared and three unshared feature patterns between or in HC and MDD data as shown in Figure 2. Studies have found that music can evoke a variety of emotions from simple arousal responses, basis emotions to more complex emotions such as subjective feeling, emotional expression or physiological changes in listeners (Witvliet and Vrana, 2007; Juslin et al., 2015). First, from the shared components extracted from both HC and MDD data, we obtained two clusters of interest patterns including a series of ~10 Hz right parietal components and ~13 Hz centro-parietal components, which were believed to be elicited by the tonal music feature of “Mode”. As we all know, MDD is a kind of mental disorders characterized by affective and cognitive dysfunctions, and existing studies have shown that brain networks of MDD patients have abnormal network topology structure (Gotlib and Joormann, 2010; Jia et al., 2010; Mulders et al., 2015). Moreover, the study also reported individuals with MDD were associated with impaired recognition of emotion in music as well as in facial and vocal stimuli (Naranjo et al., 2011). Therefore, in addition to some basic emotional processing and regulation that are indistinguishable from the MDD patients and the HCs, some uncontrolled responses with music of MDD patients may be more negative due to their cognitive dysfunctions. We also observed the right occipital components of ~10 Hz oscillations mostly elicited by the tonal feature of “Key clarity” and the rhythmic feature “Fluctuation Centroid” which were clustered from the individual components of HC group, but such brain dynamics in MDD patients were not sensitive to music perception and were suppressed. The dopaminergic system is activated during music processing, however, some dopamine responses to music in MDD patients may be weakened, which makes some brain neural dynamics that should be appeared not captured (Menon and Levitin, 2005; Blum et al., 2010). Our findings replicate some of the results of our previous studies in which similar alpha brain oscillations located in the centro-parietal or occipital regions were found from the EEG signals of 14 healthy participants when freely listening to music (Cong et al., 2013; Wang et al., 2020). Lin et al. also found the electrodes of parietal lobes across alpha band contributed a lot in the emotion recognition during music listening (Lin et al., 2010). Second, for the individual components extracted from MDD patients, we obtained two clusters of interest: theta oscillations in the frontal region and alpha oscillations in the bilateral parieto-occipital region, which were considered more overactive than the HC groups. From the perspective of functional connectivity in the source level, Liu et al. revealed three oscillatory hyperconnectivity networks including right hemisphere of alpha and beta bands, left auditory region of delta band and prefrontal region of delta band in MDD (Liu et al., 2021). The frontal region was involved in planning complex cognitive behaviour, decision making and working memory (Liu et al., 2021). In other words, the frontal regions played an important role in depression development and have received widespread attention (Rajkowska et al., 1999). Previous studies reported that the fronto-limbic neural networks were implicated in MDD, particularly in relation to the subgenual anterior cingulate cortex (ACC) which was considered to regulate amygdala activity in order to prevent excessive emotional reactivity and stress responses (Drevets et al., 1997; Phillips et al., 2003). The fMRI studies also uncovered the modification of functions in frontal and temporal regions (Wang et al., 2012). The alpha temporo-occipital component located in the left angular gyrus was engaged in music perception from most MDD patients (Zhu et al., 2021). Significant alternations of brain dynamics in the left frontal lobe, (left) parieto-occipital lob in theta and alpha bands were observed from the functional networks of MDD patients when using resting-state EEG signals (Sun et al., 2019; Zhang et al., 2020). The abnormal regions near parieto-occipital sulcus in MDD may be associated with the inability to detach from the visual dorsal stream, robust biases in attention or inhibitory control of irrelevant sensory (Gotlib and Joormann, 2010; Sacchet et al., 2016). Meanwhile, the sources in parieto-occipital regions were considered to contribute to the working memory load in the alpha band (Tuladhar et al., 2007). Our results are indeed consistent with some of the research findings in MDD, but in the end, it is difficult to compare directly due to the different methodological approaches and selected participants.

In conclusion, we provide a comprehensive framework for the shared and unshared feature extraction from the EEG recordings of MDD and HC groups during music listening, our findings are well supported and in line with the results of some previous studies to some extent, and contribute to providing some novel biomarkers for the clinical diagnosis and treatment of MDD patients. Meanwhile, the proposed methods based on nonnegative coupled tensor factorization may provide a new perspective for the analysis of other EEG recordings or the data with other psychiatric disorders. However, there are still some limitations in this study. First, we directly assume the temporal, spatial and spectral consistency among participants in MDD or HC group; that is, we only pay attention to group similarities and differences between the MDD and HC groups, and ignore the participant differences in each individual group, which will be a key issue that needs to be considered in our future work. Second, the analysis in this study was performed at the sensor level, which will be extended to the source level in the following work. Third, we have proposed a way to select the number of common components by correlation analysis. However, its selection is still subjective to some extent, which remains an open issue and invites more discussion.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by First Affiliated Hospital of Dalian Medical University and Dalian University of Technology. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

XLW conceived and carried out the idea of the study, and drafted the manuscript under the guidance of JW and FC throughout the preparation process. WL took part in the introduction and discussion parts and provided critical revisions and feedback with the rest of authors. XYW preprocessed the data and revised the manuscript. ZM designed the experiment and EEG collected the data. JX and YC provided the EEG data used in this study, and QZ reviewed the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This work is supported by National Natural Science Foundation of China (grant no. 91748105), National Foundation in China (no. JCKY2019110B009 and 2020-JCJQ-JJ-252), the Fundamental Research Funds for the Central Universities (DUT2019 and DUT20LAB303) in Dalian University of Technology in China, Dalian Science and Technology Innovation Fund Project (2021JJ12SN38), and the scholarship from China scholarship Council (no. 201706060263).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

1. ^http://mlsp.umbc.edu/simulated_complex_fmri_data.html

References

Alluri, V., Toiviainen, P., Jääskeläinen, I. P., Glerean, E., Sams, M., and Brattico, E. (2012). Large-scale brain networks emerge from dynamic processing of musical timbre, key and rhythm. Neuroimage 59, 3677–3689. doi: 10.1016/j.neuroimage.2011.11.019

PubMed Abstract | CrossRef Full Text | Google Scholar

Andrade, P. E., and Bhattacharya, J. (2003). Brain tuned to music. J. R. Soc. Med. 96, 284–287. doi: 10.1177/014107680309600607

CrossRef Full Text | Google Scholar

Belmaker, R., and Agam, G. (2008). Major depressive disorder. N. Engl. J. Med. 358, 55–68. doi: 10.1056/NEJMra073096

PubMed Abstract | CrossRef Full Text | Google Scholar

Blum, K., Chen, T. J., Chen, A. L., Madigan, M., Downs, B. W., Waite, R. L., et al. (2010). Do dopaminergic gene polymorphisms affect mesolimbic reward activation of music listening response? therapeutic impact on reward deficiency syndrome (rds). Med. Hypoth. 74, 513–520. doi: 10.1016/j.mehy.2009.10.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Boyd, S., Parikh, N., Chu, E., Peleato, B., and Eckstein, J. (2011). Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3, 1–122. doi: 10.1561/2200000016

CrossRef Full Text | Google Scholar

Buzsaki, G. (2006). Rhythms of the Brain. New York, NY: Oxford University Press.

Google Scholar

Calhoun, V. D., Liu, J., and Adalı, T. (2009). A review of group ica for fmri data and ica for joint inference of imaging, genetic, and erp data. Neuroimage 45, S163–S172. doi: 10.1016/j.neuroimage.2008.10.057

PubMed Abstract | CrossRef Full Text | Google Scholar

Carroll, J. D., and Chang, J.-J. (1970). Analysis of individual differences in multidimensional scaling via an n-way generalization of "eckart-young" decomposition. Psychometrika 35, 283–319. doi: 10.1007/BF02310791

CrossRef Full Text | Google Scholar

Cichocki, A., Mandic, D., De Lathauwer, L., Zhou, G., Zhao, Q., Caiafa, C., et al. (2015). Tensor decompositions for signal processing applications: from two-way to multiway component analysis. IEEE Signal Process Mag. 32, 145–163. doi: 10.1109/MSP.2013.2297439

PubMed Abstract | CrossRef Full Text | Google Scholar

Cong, F., Alluri, V., Nandi, A. K., Toiviainen, P., Fa, R., Abu-Jamous, B., et al. (2013). Linking brain responses to naturalistic music through analysis of ongoing eeg and stimulus features. IEEE Trans. Multimedia 15, 1060–1069. doi: 10.1109/TMM.2013.2253452

PubMed Abstract | CrossRef Full Text | Google Scholar

Cong, F., Lin, Q.-H., Kuang, L.-D., Gong, X.-F., Astikainen, P., and Ristaniemi, T. (2015). Tensor decomposition of eeg signals: a brief review. J. Neurosci. Methods 248, 59–69. doi: 10.1016/j.jneumeth.2015.03.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Cong, F., Phan, A. H., Zhao, Q., Nandi, A. K., Alluri, V., Toiviainen, P., et al. (2012). “Analysis of ongoing eeg elicited by natural music stimuli using nonnegative tensor factorization,” in 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO) (Bucharest: IEEEE), 494–498.

Google Scholar

Delorme, A., and Makeig, S. (2004). Eeglab: an open source toolbox for analysis of single-trial eeg dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21. doi: 10.1016/j.jneumeth.2003.10.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Drevets, W. C., Price, J. L., Simpson, J. R., Todd, R. D., Reich, T., Vannier, M., et al. (1997). Subgenual prefrontal cortex abnormalities in mood disorders. Nature 386, 824–827. doi: 10.1038/386824a0

PubMed Abstract | CrossRef Full Text | Google Scholar

Gotlib, I. H., and Hamilton, J. P. (2008). Neuroimaging and depression: current status and unresolved issues. Curr. Dir. Psychol. Sci. 17, 159–163. doi: 10.1111/j.1467-8721.2008.00567.x

CrossRef Full Text | Google Scholar

Gotlib, I. H., and Joormann, J. (2010). Cognition and depression: current status and future directions. Annu. Rev. Clin. Psychol. 6, 285–312. doi: 10.1146/annurev.clinpsy.121208.131305

PubMed Abstract | CrossRef Full Text | Google Scholar

Harshman, R. A. (1970). Foundations of the parafac procedure: models and conditions for an “explanatory” multimodal factor analysis. UCLA Work. Pap. Phon. 16, 1–84.

Google Scholar

Hasson, U., Nir, Y., Levy, I., Fuhrmann, G., and Malach, R. (2004). Intersubject synchronization of cortical activity during natural vision. Science 303, 1634–1640. doi: 10.1126/science.1089506

PubMed Abstract | CrossRef Full Text | Google Scholar

Hitchcock, F. L. (1927). The expression of a tensor or a polyadic as a sum of products. J. Math. Phys. 6, 164–189. doi: 10.1002/sapm192761164

PubMed Abstract | CrossRef Full Text | Google Scholar

Huang, K., Sidiropoulos, N. D., and Liavas, A. P. (2016). A flexible and efficient algorithmic framework for constrained matrix and tensor factorization. IEEE Trans. Signal Proc. 64, 5052–5065. doi: 10.1109/TSP.2016.2576427

PubMed Abstract | CrossRef Full Text | Google Scholar

Hunyadi, B., Dupont, P., Van Paesschen, W., and Van Huffel, S. (2017). Tensor decompositions and data fusion in epileptic electroencephalography and functional magnetic resonance imaging data. Wiley Interdiscipl. Rev. Data Min. Knowl. Discov. 7, e1197. doi: 10.1002/widm.1197

PubMed Abstract | CrossRef Full Text | Google Scholar

Jia, Z., Huang, X., Wu, Q., Zhang, T., Lui, S., Zhang, J., et al. (2010). High-field magnetic resonance imaging of suicidality in patients with major depressive disorder. Am. J. Psychiatry 167, 1381–1390. doi: 10.1176/appi.ajp.2010.09101513

PubMed Abstract | CrossRef Full Text | Google Scholar

Juslin, P. N., Barradas, G., and Eerola, T. (2015). From sound to significance: exploring the mechanisms underlying emotional reactions to music. Am. J. Psychol. 128, 281–304. doi: 10.5406/amerjpsyc.128.3.0281

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaiser, R. H., Andrews-Hanna, J. R., Wager, T. D., and Pizzagalli, D. A. (2015). Large-scale network dysfunction in major depressive disorder: a meta-analysis of resting-state functional connectivity. JAMA Psychiatry 72, 603–611. doi: 10.1001/jamapsychiatry.2015.0071

PubMed Abstract | CrossRef Full Text | Google Scholar

Khalfa, S., Schon, D., Anton, J.-L., and Liégeois-Chauvel, C. (2005). Brain regions involved in the recognition of happiness and sadness in music. Neuroreport 16, 1981–1984. doi: 10.1097/00001756-200512190-00002

PubMed Abstract | CrossRef Full Text | Google Scholar

King, J., Jones, K., Goldberg, E., Rollins, M., MacNamee, K., Moffit, C., et al. (2019). Increased functional connectivity after listening to favored music in adults with alzheimer dementia. J. Prevent. Alzheimers Dis. 6, 56–62. doi: 10.14283/jpad.2018.19

PubMed Abstract | CrossRef Full Text | Google Scholar

Kolda, T. G., and Bader, B. W. (2009). Tensor decompositions and applications. SIAM Rev. 51, 455–500. doi: 10.1137/07070111X

CrossRef Full Text | Google Scholar

Labounek, R., Bridwell, D. A., Mareček, R., Lamoš, M., Mikl, M., Slavíček, T., et al. (2018). Stable scalp eeg spatiospectral patterns across paradigms estimated by group ica. Brain Topogr. 31, 76–89. doi: 10.1007/s10548-017-0585-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Lartillot, O., and Toiviainen, P. (2007). “A matlab toolbox for musical feature extraction from audio,” in International Conference on Digital Audio Effects, Vol. 237 (Bordeaux), 244.

Google Scholar

Lin, Y.-P., Wang, C.-H., Jung, T.-P., Wu, T.-L., Jeng, S.-K., Duann, J.-R., et al. (2010). Eeg-based emotion recognition in music listening. IEEE Trans. Biomed. Eng. 57, 1798–1806. doi: 10.1109/TBME.2010.2048568

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, W., Wang, X., Xu, J., Chang, Y., Hämäläinen, T., and Cong, F. (2021). Identifying oscillatory hyperconnectivity and hypoconnectivity networks in major depression using coupled tensor decomposition. IEEE Trans. Neural Syst. Rehabil. Eng. 29, 1895–1904. doi: 10.1109/TNSRE.2021.3111564

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, W., Zhang, C., Wang, X., Xu, J., Chang, Y., Ristaniemi, T., et al. (2020). Functional connectivity of major depression disorder using ongoing eeg during music perception. Clin. Neurophysiol. 131, 2413–2422. doi: 10.1016/j.clinph.2020.06.031

PubMed Abstract | CrossRef Full Text | Google Scholar

Maratos, A., Gold, C., Wang, X., and Crawford, M. (2008). Music therapy for depression. Cochrane Database Syst. Rev. 2017:CD004517. doi: 10.1002/14651858.CD004517.pub2

CrossRef Full Text | Google Scholar

Menon, V., and Levitin, D. J. (2005). The rewards of music listening: response and physiological connectivity of the mesolimbic system. Neuroimage 28, 175–184. doi: 10.1016/j.neuroimage.2005.05.053

PubMed Abstract | CrossRef Full Text | Google Scholar

Michael, A. J., Krishnaswamy, S., and Mohamed, J. (2005). An open label study of the use of eeg biofeedback using beta training to reduce anxiety for patients with cardiac events. Neuropsychiatr. Dis. Treat. 1, 357.

PubMed Abstract | Google Scholar

Mørup, M., Hansen, L. K., and Arnfred, S. M. (2007). Erpwavelab: a toolbox for multi-channel analysis of time-frequency transformed event related potentials. J. Neurosci. Methods 161, 361–368. doi: 10.1016/j.jneumeth.2006.11.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Mulders, P. C., van Eijndhoven, P. F., Schene, A. H., Beckmann, C. F., and Tendolkar, I. (2015). Resting-state functional connectivity in major depressive disorder: a review. Neurosci. Biobehav. Rev. 56, 330–344. doi: 10.1016/j.neubiorev.2015.07.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Naranjo, C., Kornreich, C., Campanella, S., Noël, X., Vandriette, Y., Gillain, B., et al. (2011). Major depression is associated with impaired processing of emotion in music as well as in facial and vocal stimuli. J. Affect. Disord. 128, 243–251. doi: 10.1016/j.jad.2010.06.039

PubMed Abstract | CrossRef Full Text | Google Scholar

Phillips, M. L., Drevets, W. C., Rauch, S. L., and Lane, R. (2003). Neurobiology of emotion perception ii: Implications for major psychiatric disorders. Biol. Psychiatry 54, 515–528. doi: 10.1016/S0006-3223(03)00171-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Rajkowska, G., Miguel-Hidalgo, J. J., Wei, J., Dilley, G., Pittman, S. D., Meltzer, H. Y., et al. (1999). Morphometric evidence for neuronal and glial prefrontal cell pathology in major depression. Biol. Psychiatry 45, 1085–1098. doi: 10.1016/S0006-3223(99)00041-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Sacchet, M. D., Ho, T. C., Connolly, C. G., Tymofiyeva, O., Lewinn, K. Z., Han, L. K., et al. (2016). Large-scale hypoconnectivity between resting-state functional networks in unmedicated adolescent major depressive disorder. Neuropsychopharmacology 41, 2951–2960. doi: 10.1038/npp.2016.76

PubMed Abstract | CrossRef Full Text | Google Scholar

Sadaghiani, S., Brookes, M. J., and Baillet, S. (2021). Connectomics of human electrophysiology. PsyArXiv. doi: 10.31234/osf.io/dr7zh

CrossRef Full Text | Google Scholar

Schenker, C., Cohen, J. E., and Acar, E. (2020). A flexible optimization framework for regularized matrix-tensor factorizations with linear couplings. IEEE J. Select. Top. Signal Proc. 15, 506–521. doi: 10.1109/JSTSP.2020.3045848

PubMed Abstract | CrossRef Full Text | Google Scholar

Sidiropoulos, N. D., De Lathauwer, L., Fu, X., Huang, K., Papalexakis, E. E., and Faloutsos, C. (2017). Tensor decomposition for signal processing and machine learning. IEEE Trans. Signal Proc. 65, 3551–3582. doi: 10.1109/TSP.2017.2690524

PubMed Abstract | CrossRef Full Text | Google Scholar

Sonkusare, S., Breakspear, M., and Guo, C. (2019). Naturalistic stimuli in neuroscience: critically acclaimed. Trends Cogn. Sci. 23, 699–714. doi: 10.1016/j.tics.2019.05.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Sun, S., Li, X., Zhu, J., Wang, Y., La, R., Zhang, X., et al. (2019). Graph theory analysis of functional connectivity in major depression disorder with high-density resting state eeg data. IEEE Trans. Neural Syst. Rehabil. Eng. 27, 429–439. doi: 10.1109/TNSRE.2019.2894423

PubMed Abstract | CrossRef Full Text | Google Scholar

Tucker, L. R. (1966). Some mathematical notes on three-mode factor analysis. Psychometrika 31, 279–311. doi: 10.1007/BF02289464

PubMed Abstract | CrossRef Full Text | Google Scholar

Tuladhar, A. M., Huurne, N., t., Schoffelen, J.-M., Maris, E., Oostenveld, R., et al. (2007). Parieto-occipital sources account for the increase in alpha activity with working memory load. Hum. Brain Mapp. 28, 785–792. doi: 10.1002/hbm.20306

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, L., Hermens, D. F., Hickie, I. B., and Lagopoulos, J. (2012). A systematic review of resting-state functional-mri studies in major depression. J. Affect. Disord. 142, 6–12. doi: 10.1016/j.jad.2012.04.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, X., Liu, W., Toiviainen, P., Ristaniemi, T., and Cong, F. (2020). Group analysis of ongoing eeg data based on fast double-coupled nonnegative tensor decomposition. J. Neurosci. Methods 330:108502. doi: 10.1016/j.jneumeth.2019.108502

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, X., Ristaniemi, T., and Cong, F. (2019). “Fast implementation of double-coupled nonnegative canonical polyadic decomposition,” in ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Brighton: IEEE), 8588–8592.

Google Scholar

Witvliet, C. V., and Vrana, S. R. (2007). Play it again sam: Repeated exposure to emotionally evocative music polarises liking and smiling responses, and influences other affective reports, facial emg, and heart rate. Cogn. Emot. 21, 3–25. doi: 10.1080/02699930601000672

CrossRef Full Text | Google Scholar

Yan, Y., Qian, T., Xu, X., Han, H., Ling, Z., Zhou, W., et al. (2020). Human cortical networking by probabilistic and frequency-specific coupling. Neuroimage 207:116363. doi: 10.1016/j.neuroimage.2019.116363

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, B., Yan, G., Yang, Z., Su, Y., Wang, J., and Lei, T. (2020). Brain functional networks based on resting-state eeg data for major depressive disorder analysis and classification. IEEE Trans. Neural Syst. Rehabil. Eng. 29, 215–229. doi: 10.1109/TNSRE.2020.3043426

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhi, D., Calhoun, V. D., Lv, L., Ma, X., Ke, Q., Fu, Z., et al. (2018). Aberrant dynamic functional network connectivity and graph properties in major depressive disorder. Front. Psychiatry 9:339. doi: 10.3389/fpsyt.2018.00339

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhou, G., Zhao, Q., Zhang, Y., Adalı, T., Xie, S., and Cichocki, A. (2016). Linked component analysis from matrices to high-order tensors: Applications to biomedical data. Proc. IEEE 104, 310–331. doi: 10.1109/JPROC.2015.2474704

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhu, Y., Liu, J., Ye, C., Mathiak, K., Astikainen, P., Ristaniemi, T., et al. (2020). Discovering dynamic task-modulated functional networks with specific spectral modes using meg. Neuroimage 218:116924. doi: 10.1016/j.neuroimage.2020.116924

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhu, Y., Wang, X., Mathiak, K., Toiviainen, P., Ristaniemi, T., Xu, J., et al. (2021). Altered eeg oscillatory brain networks during music-listening in major depression. Int. J. Neural Syst. 31, 2150001. doi: 10.1142/S0129065721500015

PubMed Abstract | CrossRef Full Text | Google Scholar