Skip to main content

ORIGINAL RESEARCH article

Front. Appl. Math. Stat., 15 July 2021
Sec. Dynamical Systems
This article is part of the Research Topic From Structure to Function in Neuronal Networks: Effects of Adaptation, Time-Delays, and Noise View all 14 articles

Synchronization in Networks With Heterogeneous Adaptation Rules and Applications to Distance-Dependent Synaptic Plasticity

  • 1Institut für Mathematik, Technische Universität Berlin, Berlin, Germany
  • 2Institut für Theoretische Physik, Technische Universität Berlin, Berlin, Germany

This work introduces a methodology for studying synchronization in adaptive networks with heterogeneous plasticity (adaptation) rules. As a paradigmatic model, we consider a network of adaptively coupled phase oscillators with distance-dependent adaptations. For this system, we extend the master stability function approach to adaptive networks with heterogeneous adaptation. Our method allows for separating the contributions of network structure, local node dynamics, and heterogeneous adaptation in determining synchronization. Utilizing our proposed methodology, we explain mechanisms leading to synchronization or desynchronization by enhanced long-range connections in nonlocally coupled ring networks and networks with Gaussian distance-dependent coupling weights equipped with a biologically motivated plasticity rule.

1 Introduction

In nature and technology, complex networks serve as a ubiquitous paradigm with a broad range of applications from physics, chemistry, biology, neuroscience, socioeconomic, and other systems [1]. Dynamical networks consist of interacting dynamical units, such as neurons or lasers. Collective behavior in dynamical networks has attracted much attention in recent decades. Depending on the network and the specific dynamical system, various synchronization patterns with increasing complexity were explored [25]. Even in simple models of coupled oscillators, patterns such as complete synchronization [6, 7], cluster synchronization [811], and various forms of partial synchronization have been found, such as frequency clusters [12], solitary [1315], or chimera states [1620]. In particular, synchronization is believed to play a crucial role in brain networks, for example, under normal conditions in the context of cognition and learning [21, 22], and under pathological conditions, such as Parkinson’s disease [2325], epilepsy [2629], tinnitus [30, 31], schizophrenia, to name a few [32].

The powerful methodology of master stability function [33] has been a milestone for the analysis of synchronization phenomena. This method allows for the separation of dynamic and structural features in dynamical networks. It greatly simplifies the problem by reducing the dimension and unifying the synchronization study for different networks. Since its introduction, the master stability approach has been extended and refined for various complex systems [3442], and methods beyond the local stability analysis have been developed [4347]. More recently, the master stability approach has been extended to another class of oscillator networks with high application potential, namely adaptive networks [48].

Adaptive networks are commonly used models for various systems from nature and technology [4957]. A prominent example are neuronal networks with spike-timing dependent plasticity, in which the synaptic coupling between neurons changes depending on their relative spiking times [5861]. There are a large number of studies investigating the dynamic properties induced by this form of synaptic plasticity [62]. However, analysis is usually limited to only one or two forms of spike timing-dependent plasticity within a neuronal population. On the other hand, experimental studies indicate that different forms of spike timing-dependent plasticity may be present within a neuronal population, where the form depends on the connection structure between the axons and dendrites [63]. Among all structural aspects, an important factor for the specific form of the plasticity rule is the distance between neurons [6466]. More specifically, it has been found that the plasticity rule between proximal or distal neurons, respectively, can change from Hebbian-like to anti-Hebbian-like [67, 68].

This work introduces a methodology to study synchronization in adaptive networks with heterogeneous plasticity (adaptation) rules. As a paradigmatic system, we consider an adaptively coupled phase oscillator network [6975], which is proven to be useful for predicting and describing phenomena occurring in more realistic and detailed models [7679]. More specifically, in the spirit of the master stability function approach, we consider the synchronization problem as the interplay between network structure and a heterogeneous adaptation rule arising from distance- (or location-)dependent synaptic plasticity. For a given heterogeneous adaptation rule, our master stability function provides synchronization criteria for any coupling configuration. As illustrative examples, we consider a nonlocally coupled ring with biologically motivated plasticity rule, and a network with a Gaussian distance-dependent coupling weights. We explained such intriguing effects as synchronization or desynchronization by enhancement of long-distance links.

We introduce the model in Section 2. Building on findings from [48], we develop a master stability approach in Section 3 that takes a heterogeneous adaptation rule in account. In Section 4.1, we provide an approximation of the structural eigenvalues that determine the stability of the synchronous state. We then consider two different setups: a nonlocally coupled ring in Section 4.2 and a weighted network with Gaussian distance distribution of coupling weights in Section 4.3. Both systems are equipped with a biologically motivated plasticity rule. In Section 5, we summarize the results.

2 Model

In this work, we study the synchronization on networks with adaptive coupling weights, where the adaptation (plasticity) rule depends on the distance between oscillators (neurons). We consider the model of adaptively coupled phase oscillators, which has proven to be useful for understanding dynamics in neuronal systems with spike timing-dependent plasticity [77, 79, 48]. The model reads as follows:

ddtϕi=ω+j=1Naijκijg(ϕiϕj),(1)
ddtκij=ϵ(κij+hij(ϕiϕj)),(2)

where ϕiS1=/2π (i=1,,N) is the phase of the ith oscillator, κij (i,j=1,,N) is the dynamical coupling weight from oscillator j to i, ω denotes the natural frequency of each oscillator, and aij[0,1] are the entries of the weighted adjacency matrix A describing the network connectivity. The time scales of the “fast” phase oscillators and “slow” coupling weights are separated by the parameter ϵ, which we assume to be small 0<ϵ1. The functions g and hij denote the coupling and the N2 plasticity functions, respectively. For illustrative purposes, the coupling function is set throughout the paper to g(ϕ)=sin(ϕ+α)/N with the phase lag parameter α [80]. Such a phase lag can account for a small synaptic propagation delay [81, 48]. For formal derivations, however, a generic coupling function is used. Note that the system Eqs. 1, 2 is shift-symmetric, i.e., invariant under the transformation ϕiϕi+ψ for any ψS1. This allows us to restrict our consideration to the case ω=0 by introducing a new “co-rotating” coordinate system ϕi,new=ψiωt.

The main difference of system Eqs. 1, 2 from the models considered previously in the literature [40, 70, 71, 74, 82], is that the plasticity functions hij can be different for each network connection ji.

A solution to Eqs. 1, 2 is called phase-locked if, for all i=1,,N, the phases evolve as ϕi=Ωt+ϑi with some collective frequencyΩ and ϑiS1. If ϑi=ϑ for all i=1,,N, the phase-locked state is called in-phase synchronous or, short, synchronous state.

In the case of in-phase synchronous state, we can set ϑi=0 for each oscillator due to the shift symmetry of Eqs. 1, 2. The in-phase synchronous state is given as

ϕs(t)=wg(0)t,(3)
κijs=hij(0),(4)

where we assume that the weighted row sum w=j=1Naijhij(0) is constant for all. Such an assumption of constant row sum is necessary for the existence of the synchronous state. Moreover, it is satisfied for commonly considered cases of global or nonlocal shift-invariant coupling.

In the following section, we show how the stability of the synchronous state is determined in a master-stability-like approach.

3 Master Stability Approach

In Section 2, we have introduced a general class of models and the synchronous state, that are considered throughout this paper. In this section, we derive a framework for the local stability analysis of the synchronous states. We note that the master stability approach for homogeneous adaptations hij=h was introduced in [48, 83]. Here we extend the methodology to heterogeneous adaptation rules.

To describe the local stability, we introduce the variations ξi=ϕiϕs and χij=κijκijs. The linearized equations for these variations can be written in the following matrix form

ddt(ξχ)=J(ξχ)=(Dg(0)Lhg(0)BϵCϵIN2)(ξχ),(5)

where ξ=(ξ1,,ξN)T is N-dimensional vector containing the perturbations ξi=δϕi of the phases and χ=(χ11,χ12,,χNN)T are N2- dimensional vectorized perturbations of coupling weights χ=vec[δκij], respectively. The N×N weighted Laplacian matrix Lh has the following elements

lijh={m=1,miNaimhim(0),i=j,aijhij(0),ij.(6)

The time-independent matrices B and C are

B=(a1aN),C=((Dh)1T(Dh)NT)(diag(Dh)1diag(Dh)N),

where ai=(ai1,,aiN), (Dh)i=(Dhi1(0),,DhiN(0)), and

diag(Dh(0))i=(Dhi1(0)DhiN(0)).

Note that due to the shift symmetry of Eqs. 1, 2, the Jacobian J in Eq. 5 is time independent. Therefore, the real parts of the N(N+1) eigenvalues λ of J are the Lyapunov exponents of the synchronous state and hence determine its local stability. In the following proposition, we exploit the fact that J contains a large diagonal block ϵIN2 to reduce the dimension of the eigenvalue problem for J.

Proposition 1. Supposeϕi=Ωtis an in-phase synchronous state of Eqs. 1, 2. Then its linear stability is determined by the 2N-dimensional linear system

ddtv=(Dg(0)Lhg(0)INϵLDhϵIN)v,(7)

where Dg(0) and Lhare as in Eq. 5and theN×N weighted Laplacian matrix LDhpossesses the following elements

lijDh={m=1,miNaimDhim(0),i=j,aijDhij(0),ij.(8)

Proof. We remind that system Eq. 5 determines the spectrum (Lyapunov exponents) of the synchronous state. The Jacobian matrix in Eq. 5 is sparse with a large N2×N2 block given by the simple diagonal matrix ϵIN2. This implies that Eq. 5 possess N2N stable directions with Lyapunov exponents ϵ. To find these directions, we substitute (ξ,χ)=eϵt(ξ0,χ0) into Eq. 5 and obtain the linear system

(Dg(0)Lh+ϵINg(0)BϵC0)(ξ0χ0)=0.(9)

This system has at least N2N linearly independent solutions, since the matrix in Eq. 9 is degenerate due to the large N2×N2 zero block. The structure of the invariant subspaces in system Eq. 5 allows for introducing new coordinates, which separate the N2N stable directions (corresponding to the eigenvalues ϵ) from the remaining 2N directions. Explicitly, this transformation is given by

(ξχ)=R(ξχ^),R=(IN000(1/r)BTK)

with (N2+N)×(N2+N) matrix R. Here K is an (N2N)×(N2N) orthogonal matrix with BK=0. Applying this transformation, we obtain the following system

ddt(ξχNχN2N)=(Dg(0)Lhg(0)IN0ϵLDhϵIN0ϵKTC0ϵIN2N)(ξχNχN2N),(10)

where (ξ,χN,χN2N)T=(ξ,χ^)T, with χN and χN2N are an N and N2N-dimensional vectors, respectively, and the N×N weighted Laplacian matrix LDh as given in Eq. 8. For more details on the transformation, we refer the reader to [48, 83]. We observe that the variables (ξ,χN) are independent on χN2N. Hence, separating the master from the slave system, the resulting coupled differential equations that determine the stability of the synchronous state are given by system Eq. 7. This concludes the proof. Proposition 1 reduces the problem’s dimension significantly from N(N+1) to 2N. In the spirit of the master stability approach [33], we aim for further decomposition of the 2N- dimensional coupled system Eq. 7 into dynamically independent blocks of dimension 2. For this, we restrict our consideration to the case when Lh can be diagonalized Sh=Q1LhQ by a nonsingular complex-valued matrix Q. Note that the eigenvalues μi of Lh lie on the diagonal of Sh. In general, the matrices Lh and LDh do not commute. Therefore, Q1LDhQ is not necessarily of upper triangular shape. Regardless of this fact, the following proposition provides an explicit form for the eigenvalues of J in Eq. 5 in the limit of slow adaptation, i.e., ϵ1.

Proposition 2. Assume thatLhis diagonalizable, withSh=Q1LhQbeing the associated diagonal matrix and Q the corresponding transformation. Letϕi=Ωtbe an in-phase synchronous state ofEqs. 1, 2Then, the local stability of this state is determined by the solutions of N quadratic equations, which are given up to the first order in ϵ as

λ2+(ϵDg(0)μi)λϵ(Dg(0)μi+g(0)νi)=0,i=1,,N,(11)

whereμiare the eigenvalues ofLhlocated on the diagonal ofShandνiare the corresponding diagonal elements ofQ1LDhQ. IfLhandLDhcommute, thenEq. 11is exact, andνiare the eigenvalues ofLDh.Proof. Due to Proposition 1, the eigenvalues of the Jacobian in Eq. 5 are given by

det(Dg(0)LhλINg(0)INϵLDh(ϵ+λ)IN)=det(Dg(0)ShλINg(0)INϵQ1LDhQ(ϵ+λ)IN)=0,

where we have used the transformation Q that brings Lh to the diagonal form Sh=Q1LhQ. Making further use of the Schur complement [84], we obtain

det(Dg(0)ShλINg(0)INϵQ1LDhQ(ϵ+λ)IN)=det((λ+ϵ)(λINDg(0)Sh)ϵg(0)Q1LDhQ)=0.(12)

The latter equation is almost diagonal. The only off-diagonal components remain from Q1LDhQ and scale with ϵ. Let us consider the Leibniz formula for the determinant of an N×N matrix F with entries fij, that reads det(F)=σPerm(N)sgn(σ)i=1Nfiσ(i). In the latter expression Perm(N) denotes the set of all permutations σ of the integer numbers 1,,N and sgn(σ){1,1} is the sign of the permutation. Since all off-diagonal terms of the matrix considered in Eq. 12 scale with ϵ, for any but the identical permutation each term i=1Nfiσ(i) scales with ϵ2 or higher. Hence, we are left with det(F)=i=1Nfii+(ϵ2) and find

det((λ+ϵ)(λINDg(0)Sh)ϵg(0)Q1LDhQ)=i=1(λ2+(ϵDg(0)μi)λϵ(Dg(0)μi+g(0)νi))+(ϵ2)=0,(13)

where μi are the eigenvalues of Lh, νi are the diagonal elements of Q1LDhQ and (ϵ2) denotes higher order terms (ϵm,m>1). If Lh and LDh commute, both matrices share the same set of eigenvectors and hence they can be brought to the diagonal form with the same transformation Q. In this case, the diagonal elements νi are the eigenvalues of LDh and the higher order terms (ϵ2) in Eq. 13 vanish.The 2N solutions λi of the NEq. 11 determine the stability of the synchronous state. More precisely, the real parts of theses solutions determine the Lyapunov exponents. If Λ=maxiRe(λi)<0, then the synchronous state is locally stable, while for Λ>0 it is locally unstable. The case Λ=0 provides the stability boundary.Note that for a fixed time scale parameter ϵ1, the Eq. 11 and hence its solutions depend on the coupling function g, the connectivity, and the adaptation structure. This dependence, however, is only encoded in the two complex parameters Dg(0)μ and g(0)ν. Therefore, we define the master stability function Λ:2 with Λ(Dg(0)μ,g(0)ν)=maxiRe(λi(Dg(0)μ,g(0)ν)) that maps each pair of parameters (Dg(0)μ,g(0)ν) to the corresponding Lyapunov exponent.For an illustration, we consider a cross-section of (Dg(0)μ,g(0)ν)- space by setting Im(μ)=0 and Im(ν)=0. This cross-section is of particular interest in cases of symmetric matrices Lh and LDh since their eigenvalues are real. In Figure 1, we present the master stability function for the coupling function g(ϕ)=sin(ϕ+α)/N and different values of the parameter α. In case of real μ and ν, we obtain two explicit stability conditions from Eq. 11: The synchronous state is locally stable (Λ<0) if

c1(α,μ)=cos(α)μ>ϵ,(14)
c2(α,μ,ν)=cos(α)μ+sin(α)ν>0.(15)

These conditions agree with the black dashed lines in Figure 1 and are used subsequently to describe stability for certain network models.

FIGURE 1
www.frontiersin.org

FIGURE 1. The master stability function Λ(Dg(0)μ,g(0)ν) for the coupling function g(ϕ)=sin(ϕ+α)/N and real μ and ν (Im(μ)=0, Im(ν)=0). The values of the master stability function are color-coded in all panels (A–E). The dashed black line describes the border between regions corresponding to local stability and instability, respectively. Parameters: ϵ=0.01, (A)α=0.8π, (B)α=0.4π, (C)α=0, (D)α=0.4π, and (E)α=0.8π.

4 Synchronization on Networks With Distance-Dependent Plasticity

In the previous section, we established a generic analytic tool for studying stability of synchronous states. In this section, we focus on the application of the tool to certain network models. For the rest of the work, we restrict our attention to the following generalization of the Kuramoto-Sakaguchi system with distance-dependent synaptic plasticity

ddtϕi=ω1Nj=1Naijκijsin(ϕiϕj+α),(16)
ddtκij=ϵ(κij+h(ϕiϕj,dij)).(17)

The plasticity function h depends on the phase difference ϕiϕj and on the distance dij. In this work, we associate the distance to the difference of indices by dij=|ji|. For the plasticity function, we consider

hij(ϕ)=h(ϕ,dijN)={h^(ϕ,dijN)dijN/2,h^(ϕ,1dijN)dij>N/2.(18)

With this form of the adaptation function, we have a symmetric hij(ϕ)=hji(ϕ) and a circulant hi+l,j+l(ϕ)=hij(ϕ) structure of the corresponding matrix with entries hij. Particularly, for the numerical analysis, we use

h^(ϕ,dij/N)=sin(ϕ+β(dij/N)),(19)

where the distance dependence is encoded in the phase shift function

β(dijN)={(2Ndij1)π,N even,(2(N+1)dij1)π,N odd.(20)

In Figure 2A, we illustrate the distance-dependent plasticity function Eqs. 1820 for a network of N=12 nodes. The illustration shows the different plasticity functions depending on the distance between the nodes dij. The plasticity function changes from a Hebbian to anti-Hebbian rule for proximal and distal node, respectively. This change, particularly in the proximity of ϕ=0, is in qualitative agreement with the experimental findings in [67]. Note the symmetry of the plasticity function that renders the matrix with elements hij circulant.

FIGURE 2
www.frontiersin.org

FIGURE 2. Panel (A) shows the plasticity function h1j given in Eqs. 1820 depending on the distance d1j exemplified for node i=1 in a network with N=12 nodes. Note that the colors of the links in the network (left) correspond to the colors of the depicted plasticity function (right). Panel (B) displays the connectivity structure of a nonlocally coupled ring network with N=12 nodes and a coupling range P=3. Panel (C) displays the weighted connectivity structure of a network with N=12 nodes (left) with distance-dependent Gaussian weight distribution (right). Note that the colors of the links in the network (left) correspond to the colors of the bars in the weight distribution (right).

If not indicated differently, we consider the coupling structure given by

aij=a(dij/N),(21)

where a:[0,1][0,1] is a bounded and piece-wise continuous function. This corresponds to a distant-dependent coupling, and it results to a dihedral symmetry in the coupling structure (ring-like).

In the following section, we provide an approximation for the eigenvalues of Lh and LDh for large networks with circulant connectivity and plasticity structure. Using this approximation, we subsequently analyze the stability of the synchronous state on nonlocally coupled networks and on isotropic networks with Gaussian weight distribution.

4.1 Approximation of the Eigenvalues for Large Systems With Circulant Structure

In the previous part, we have defined the plasticity functions hij in such a way that the structures of Lh and LDh inherit important properties from the underlying network structure a(dij/N). In particular, assuming that the adjacency matrix is circulant, renders Lh and LDh to be circulant, as well.

In this section, we briefly recall how one can derive the eigenvalues μk and νk (k=0,,N1) in case of a circulant structure. It is well-known that for a circulant matrix the eigenvalues are determined by applying a discrete Fourier approach [85]. More precisely, suppose L is a circulant N×N matrix where the elements of the first row are given by the entries lj with j=1,,N. Then the kth eigenvalue is explicitly given by

μk=l1+j=2Nljexp(i2πN(j1)k).

For the case of Lh as in Eq. 6, aij and hij as in Eqs. 18 and 21, we obtain

Re(μk)=Re(l11h)+1Nj=2Na(xj)h(0,xj)cos(2πxjk),(22)

with xj=d1j/N and Re(l11h)=1Nj=2Na(xj)h(0,xj). Since the adjacency matrix A is assumed to be symmetric, the eigenvalues of Lh are real. Therefore, we omit considering the imaginary part of μk. Eq. 22 provides exact expressions for the eigenvalues. However, the values depend on the total number of oscillators N that makes it harder to study the influence of other system properties, such as the coupling structure or the plasticity function. To remove this N-dependence, we consider the continuum limit N (compare with [86]) and obtain

Re(μk)=Re(l11h)+01a(x)h(0,x)cos(2πxk)dx,

Due to the definition of h and the symmetry of a(x), we find

Re(μk)=201/2a(x)h(0,x)(cos(2πxk)1)dx(23)

for any k. This explicit expression allows studying the distribution of the eigenvalues μk for a given plasticity function h and coupling structure a. Note that a similar expression as (23) can be analogously derived for the eigenvalues of LDh and reads

Re(νk)=201/2a(x)Dh(0,x)(cos(2πxk)1)dx.(24)

We note that μ0=ν0=0 due to the Laplacian structure of Lh and LDh.

The results from Eqs. 23 and 24 are applied in the next sections to analyze different networks.

4.2 Synchronization on Nonlocally Coupled Ring Networks

In this section, we analyze the effect of long distance connections on the stability of synchronous states in nonlocally coupled ring networks. We consider the coupling structure given by

aij=a(dij/N)={1for0<dijP,1for0<NdijP,0otherwise.(25)

This means that any two oscillators are coupled if they are separated at most by the coupling range P. The coupling Eq. 25 defines a nonlocal ring structure with coupling range p to each side and two special limiting cases: local ring for P=1 and globally coupled network for P=N/2 (if N is even, else P=(N+1)/2). The matrix of the form Eq. 25 is circulant [85] and has constant row sum, i.e., j=1Naij=2P for all i=1,,N. An illustration for N=12 adn P=3 is presented in Figure 2B.

In order to study the influence of the coupling range, we use the approximations for the eigenvalues μk and νk derived in Section 4.1. The nonlocally coupled ring structure is expressed by the piecewise continuous function a(x)=0 for p<x<1p and a(x)=1 otherwise with relative coupling range p=P/N. Thus, for a nonlocally coupled ring Eq. 25 and plasticity function Eqs. 1820, we find

Re(μk)=20psin(2πx)(cos(2πkx)1)dx=(1cos(2πp))π+1π{12(cos2(2πp)1)k=11(1k2)(ksin(2πp)sin(2πkp)+cos(2πp)cos(2πkp)1)k1(26)

for the eigenvalues μk of Lh. Analogously, we obtain

Re(νk)=20pcos(2πx)(cos(2πkx)1)dx=sin(2πp)π1π{pπ+sin(4πp)4k=11(1k2)(sin(2πp)cos(2πkp)kcos(2πp)sin(2πkp))k1(27)

for νk of LDh.

In Figure 3A, we provide an error analysis of the approximations Eqs. 26 and 27 compared to the exact eigenvalues given by Eq. 22. As expected, the errors tend to zero as the number of oscillators increases. Additionally in Figures 3B,C, we display μk and νk for several values of k depending on the relative coupling range p. We observe that μk0 for all k. This is due to given plasticity function Eqs. 1820, for which the update is positive (or equal to zero) for all distances at ϕ=0, i.e., h(0,dij)0 for all dij.

FIGURE 3
www.frontiersin.org

FIGURE 3. Panel (A) shows the errors e(μ) (black) and e(ν) (blue) with e(γ)=k=0N1(γkexactγk)2N of the approximations Eqs. 26, 27, respectively, where γkexact are the exact eigenvalues derived by a discrete Fourier transformation, see Eq. 22. The errors are displayed in dependence of the system size N (number of oscillators). The relative coupling range is set to p=0.1. Panel (B) and (C) show the approximated eigenvalues given by Eqs. 26, 27, respectively, depending on the relative coupling range p for different values of k.

It is important to note, that our choice of the circulant adaptation functions imply that the matrices Lh and LDh are diagonalizable and commute. Hence, Proposition 2 holds with the master stability Eq. 11 being exact. Therefore, the stability criterium Eq. 14 is also exact.

Combining the fact μk0 with the stability criterium Eq. 14, we find cos(α)>0 as a necessary condition for the stability of the synchronous state for ϵ0. This yields, that the synchronous state can be stable only for α(π/2,π/2). In contrast to Lh, the LDh is in general neither positive nor negative definite, hence the eigenvalues νk may take positive or negative values. This is due to the fact that the plasticity function may change sign at the origin, i.e., Dhij may change signs depending on the distance dij. In particular, we find that only the eigenvalue ν1 changes the sign, see Figure 3C. This change may lead to a destabilization of the synchronous states as we show in the subsequent analysis. Finally, note that there exist μ=(1cos(2πp))/π and ν=sin(2πp)/π to which the eigenvalues converge for large values of k. These limits are displayed in Figures 3B,C as black lines.

In Figure 4, we show different scenarios for the stability of the synchronous state depending on the phase lag parameter α and the coupling range p. Due to the necessary condition cos(α)>0 as ϵ0, we consider α(π/2,π,2) only. Figures 4A,B show that for π/2<α<0, the second stability condition Eq. 15 is only fulfilled for p larger than a critical value of the coupling range pc(α). In these cases, a higher coupling range stabilizes the synchronous state. Note that pc(α)0 as α0 with α<0. The results seen in Figures 4A,B are in agreement with the results for a network of N=200 coupled phase oscillators. For this network, we calculate the Laplacian eigenvalues and plot them along with the master stability function in Figures 4E,F. The outcomes from numerical simulations are presented in Figures 4I,J.

FIGURE 4
www.frontiersin.org

FIGURE 4. Stability analysis of the synchronous state of system Eqs. 16, 17 with plasticity rule Eqs. 1820 and coupling structure Eq. 25. Panels (A–D) show the function c2(α,μk(p),νk(p)) for different α, see Eq. 15, calculated with the approximations Eqs. 26, 27 depending on the relative coupling range p. In each panel, c2 is displayed for different values of k. The gray shaded regions refer to unstable synchronous states. Panels (e,f,g,h) show the master stability function Λ(Dg(0)μ,g(0)ν) for the cross-section Im(μ)=0 and Im(ν)=0 for different values of α with color code as in Figure 1. The crosses and dots correspond to two sets of eigenvalue pairs (μk,νk) (k=0,,N1) for relative coupling range p=0.1 (blue crosses) and p=0.45 (black points), respectively. Panels (I–L) show the synchronization error E(t)=i=1N(ϕi(t)ϕ1(t))2 for simulations with relative coupling range p=0.1 (blue) and p=0.45 (black). Each simulation is initialized at a slightly perturbed synchronous state. Parameters: N=200, ϵ=0.01, (A, E, I)α=0.4π, (B, F, J)α=0.2π, (C, G, K)α=0.2π, (D, H, L)α=0.4π.

The situation changes for 0<α<π/2, as shown in Figures 4C,D. Here, for a large range of α, all nonlocally coupled networks lead to a stable synchronous state. However, closer to π/2, long distance connections destabilize the synchronous state. In particular, this destabilization can be traced back to the single negative eigenvalue ν1 of the Laplacian LDh, see Figure 4H. Hence, the unstable manifold of the synchronous state is only one-dimensional. This finding is in agreement with the example of N=200 phase oscillators presented in Figures 4G,H,K, L. Particularly in Figure 4L, the low dimension of the unstable manifold manifests itself as follows: The black trajectory first tends to the synchronous state along the N(N+1)1 stable directions before it is repelled along the direction corresponding to ν1.

We have shown that long distance interactions may stabilize or destabilize the synchronous state depending on the phase lag parameter α. In this section, all links have the same weight independent of the corresponding distance. In the next section, we analyze a network with a more realistic structure with a distance-dependent distribution of weights.

4.3 Synchronization on Isotropic and Homogeneous Network With Gaussian Distance Distribution

In the previous section, we used the prototypical example of a nonlocally coupled rings to study the effects of long-range interaction on synchronization. In this setup, however, all links are equally weighted. In realistic systems, in contrast, the number of links with a certain distance are distributed, see [67] for details. To incorporate this into our network model, we weight the links with respect to a distance distribution. Measurements suggest that the distance distribution can be estimated by a mean and a distribution width [67]. The Gaussian distributions is a paradigmatic distribution that allows for studying effects emanating from the mean and the distribution width. For the remainder of the section, we consider the link distance distribution given by a Gaussian distribution, and weight the links of the network connectivity structure A accordingly, i.e.

aij(dij/N)={e(dij/Nξ)22σ2dijN/2,e(1dij/Nξ)22σ2dij>N/2.(28)

where ξ and σ are the mean value and the standard deviation, respectively. Note that the standard deviation characterizes the width of the distribution. For the numerical simulations, we normalize each row of A by j=1Naij. Here, we further make the assumption that the network is homogeneous and isotropic. This means that in any direction from a node and at each node the network looks the same. Hence, we obtain a circulant connectivity structure. An illustration of the weight distribution for N=12 is presented in Figure 2C.

As we know from Eqs. 14 and 15, for ϵ1, the values of c2(α,μk,νk) determine the stability of the synchronous state. In particular, the synchronous state is stable if cmin=mink1,N1c2(α,μk,νk)>0 for a given N and unstable otherwise. In Figure 5A, we display cmin for α=0.4π and different mean values ξ and standard deviations σ of the weight distribution. In agreement with the finding in Section 4.2, the synchronized state stabilizes due to an increase of long distance interaction expressed by an increase of σ. Complementing the finding in Section 4.2, here, we note that the stability can be also achieved by distributions with peaks at long distance links alone. In this case, the width of the distribution is not important. Figure 5B shows how the boundary between regions corresponding to stable and unstable synchronization change for different values of α. As in the case of nonlocally coupled ring networks, with α0 (with α<0) the boundary tends to the limiting point (σ,ξ)=(0,0). On the contrary, if απ/2 (with α>π/2), the width of the distribution has to increase to have stable synchronization for small values of the mean ξ.

FIGURE 5
www.frontiersin.org

FIGURE 5. Stability analysis of the synchronous state of system Eqs. 16, 17 with plasticity rule Eqs. 1820 and coupling structure Eq. 28. Panels (A, C) show the minimum over all k0<N of c2, se Eq. 15, for two different values of α depending on the mean value ξ and the standard deviation σ of the weight distribution. The minima are displayed in color code. Panels (B, D) show the boundaries between stable and unstable regions in (σ,ξ)- plane for different values of α as given in the figure. Parameters: (A)N=400, α=0.4π, (C)N=400, α=0.4π, (B, C)N=200.

An opposite scenario is shown in Figure 5C for α=0.4π. Here, an increase of the weights for long distance links destabilizes the synchronous state, as in Figures 4D,H,L. We also note that for small values α, the synchronous state is stable for almost all values of σ and ξ, see Figure 5D. Only in cases of distribution sharply peaked at long distances, i.e., ξ close to 1/2 and σ close to 0, the synchronous state is unstable. This effect could not be found in networks with nonlocally coupled rings, see Section 4.2.

5 Conclusion

In summary, we have investigated the phenomenon of synchronization on adaptive networks with heterogeneous plasticity rules. In particular, we have modeled systems with distance-dependent plasticity as they have been found in neuronal networks experimentally [6467] as well as computational models [68]. For the realization, we have used a ring-like network architecture and associated the distance of two nodes with the distance of their placement on the ring.

In Section 3, we have developed a generalized master stability approach for phase oscillator models that are adaptively coupled and where each link has its own adaptation rule (plasticity). By using an explicit splitting of the time scales between fast dynamics of the phase oscillators and slow dynamics of the link weights, we have established an explicit stability condition for the synchronous state. More precisely, we found that the stability is governed by the coupling function and the eigenvalues of two structure matrices. These structure matrices Lh and LDh are determined by the connectivity of the network and the plasticity rules of the link weights. Note that for the structural matrices, the plasticity rule needs only to be known in the vicinity of 0, which greatly facilitates the application of the approach to realistic forms of synaptic plasticity. Thus, we have extended previous work on the master stability function of adaptive networks [48, 83] and broaden the scope of potential future applications for this methodology.

In Section 4, we applied the novel technique to a system of adaptively coupled oscillators with distance-dependent plasticity. Here, we have used a ring-like network structure to study the impact of long- and short-distance connections on the stability of synchronization. For this purpose we introduced an approximation of the eigenvalues for the structure matrices in Section 4.1. This approximation allows for a comprehensive analysis of the stability as a function of various system parameters. Moreover, it enables us to identify critical eigenvalues that govern the stability of the synchronous state. In Sections 4.2 and 4.3, we have brought together all methodological findings and applied them to systems with a nonlocally coupled ring structure and with a Gaussian distribution of link weights. The latter structure accounts for the fact that in realistic neuronal populations the number of links with different distances are not uniformly distributed [67]. We found that long-distance connections can stabilize or destabilize the synchronous state, depending on the coupling function between the oscillators. A remarkable fact with respect to neuronal applications relates to the destabilization scenario. Here we observed that the destabilization can be attributed to the pronounced change of the plasticity rule from Hebbian to anti-Hebbian. For more realistic connectivity structures, we found that weight distributions of the connectivity structure with sharp peaks at long distances lead to destabilization for a wide range of the coupling function.

All in all, in this article, we have provided a general framework to study the emergence of synchronization in neuronal system with a heterogeneous plasticity rule. The developed methodology is not limited to distance-dependent types of plasticity and can also be used for non-symmetric setups. For the latter case, we have provided the necessary analytical result. In this work, we have restricted our attention to the case of phase oscillators, but the methods can be extended to more realistic neuron models by using techniques established, for example, in [48]. Moreover, techniques are available that allow for further generalization toward systems with slightly different local dynamics at each node [87]. On the one hand, the master stability approach offers a great tool to study the stability of the synchronous state depending on the networks structure. On the other hand, this approach allows for characterizing the network structures that are, in some sense, optimal for synchronization [88, 89]. In this regard, it remains an open question as to how plasticity optimizes the synchronizability of the network in a self-organized way. In addition, recent studies have shown that there is a great interest in synchronization phenomena to understand diseases such as Parkinson’s disease [9092] or epilepsy [29, 93] for the development of proper therapeutic treatments. We believe that our work provides an important step toward understanding synchronization under realistic conditions.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Author Contributions

RB designed the study and did the numerical simulations. RB and SY developed the analytical results. Both authors contributed to the preparation of the manuscript. Both authors read and approved the final manuscript.

Funding

This work was supported by the German Research Foundation DFG, Project Nos. 411803875 and 440145547, and the Open Access Publication Fund of TU Berlin.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

1. Newman, MEJ. The Structure and Function of Complex Networks. SIAM Rev (2003) 45:167–256. doi:10.1137/s003614450342480

CrossRef Full Text | Google Scholar

2. Pikovsky, A, Rosenblum, M, and Kurths, J. Synchronization: A Universal Concept in Nonlinear Sciences. 1st ed. Cambridge: Cambridge University Press (2001).

3. Strogatz, SH. Exploring Complex Networks. Nature (2001) 410:268–76. doi:10.1038/35065725

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Arenas, A, Díaz-Guilera, A, Kurths, J, Moreno, Y, and Zhou, C. Synchronization in Complex Networks. Phys Rep (2008) 469:93–153. doi:10.1016/j.physrep.2008.09.002

CrossRef Full Text | Google Scholar

5. Boccaletti, S, Pisarchik, AN, del Genio, CI, and Amann, A. Synchronization: From Coupled Systems to Complex Networks. Cambridge: Cambridge University Press (2018).

6. Kuramoto, Y. Chemical Oscillations, Waves and Turbulence. Berlin: Springer-Verlag (1984).

7. Pecora, LM, Carroll, TL, Johnson, GA, Mar, DJ, and Heagy, JF. Fundamentals of Synchronization in Chaotic Systems, Concepts, and Applications. Chaos (1997) 7:520–43. doi:10.1063/1.166278 https://doi.org/10.1063/1.166278

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Yanchuk, S, Maistrenko, Y, and Mosekilde, E. Partial Synchronization and Clustering in a System of Diffusively Coupled Chaotic Oscillators. Mathematics Comput Simulation (2001) 54:491–508. doi:10.1016/S0378-4754(00)00276-7

CrossRef Full Text | Google Scholar

9. Choe, C-U, Dahms, T, Hövel, P, and Schöll, E. Controlling Synchrony by Delay Coupling in Networks: from In-phase to Splay and Cluster States. Phys Rev E (2010) 81:025205. doi:10.1103/physreve.81.025205

CrossRef Full Text | Google Scholar

10. Belykh, I, and Hasler, M. Mesoscale and Clusters of Synchrony in Networks of Bursting Neurons. Chaos (2011) 21:016106. doi:10.1063/1.3563581

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Zhang, Y, and Motter, AE. Symmetry-independent Stability Analysis of Synchronization Patterns. SIAM Rev (2020) 62:817–36. doi:10.1137/19m127358x

CrossRef Full Text | Google Scholar

12. Berner, R, Schöll, E, and Yanchuk, S. Multiclusters in Networks of Adaptively Coupled Phase Oscillators. SIAM J Appl Dyn Syst (2019) 18:2227–66. doi:10.1137/18m1210150

CrossRef Full Text | Google Scholar

13. Jaros, P, Brezetsky, S, Levchenko, R, Dudkowski, D, Kapitaniak, T, and Maistrenko, Y. Solitary States for Coupled Oscillators with Inertia. Chaos (2018) 28:011103. doi:10.1063/1.5019792

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Teichmann, E, and Rosenblum, M. Solitary States and Partial Synchrony in Oscillatory Ensembles with Attractive and Repulsive Interactions. Chaos (2019) 29:093124. doi:10.1063/1.5118843

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Berner, R, Polanska, A, Schöll, E, and Yanchuk, S. Solitary States in Adaptive Nonlocal Oscillator Networks. Eur Phys J Spec Top (2020) 229:2183–203. doi:10.1140/epjst/e2020-900253-0

CrossRef Full Text | Google Scholar

16. Kuramoto, Y, and Battogtokh, D. Coexistence of Coherence and Incoherence in Nonlocally Coupled Phase Oscillators. Nonlin Phen Complex Sys (2002) 5(4):380–5.

Google Scholar

17. Abrams, DM, and Strogatz, SH. Chimera States for Coupled Oscillators. Phys Rev Lett (2004) 93:174102. doi:10.1103/physrevlett.93.174102

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Schöll, E. Synchronization Patterns and Chimera States in Complex Networks: Interplay of Topology and Dynamics. Eur Phys J Spec Top (2016) 225:891–919. doi:10.1140/epjst/e2016-02646-3

CrossRef Full Text | Google Scholar

19. Omel’chenko, OE. The Mathematics behind Chimera States. Nonlinearity (2018) 31:R121. doi:10.1088/1261-6544/aaaa07

CrossRef Full Text | Google Scholar

20. Omel’chenko, OE, and Knobloch, E. Chimerapedia: Coherence-Incoherence Patterns in One, Two and Three Dimensions. New J Phys (2019) 21:093034. doi:10.1088/1367-2630/ab3f6b

CrossRef Full Text | Google Scholar

21. Singer, W. Neuronal Synchrony: A Versatile Code for the Definition of Relations? Neuron (1999) 24:49–65. doi:10.1016/s0896-6273(00)80821-1

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Fell, J, and Axmacher, N. The Role of Phase Synchronization in Memory Processes. Nat Rev Neurosci (2011) 12:105–18. doi:10.1038/nrn2979

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Hammond, C, Bergman, H, and Brown, P. Pathological Synchronization in Parkinson's Disease: Networks, Models and Treatments. Trends Neurosciences (2007) 30:357–64. doi:10.1016/j.tins.2007.05.004

CrossRef Full Text | Google Scholar

24. Goriely, A, Kuhl, E, and Bick, C. Neuronal Oscillations on Evolving Networks: Dynamics, Damage, Degradation, Decline, Dementia, and Death. Phys Rev Lett (2020) 125:128102. doi:10.1103/physrevlett.125.128102

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Pfeifer, KJ, Kromer, JA, Cook, AJ, Hornbeck, T, Lim, EA, Mortimer, BJP, et al. Coordinated Reset Vibrotactile Stimulation Induces Sustained Cumulative Benefits in Parkinson's Disease. Front Physiol (2021) 12:624317. doi:10.3389/fphys.2021.624317

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Jiruska, P, de Curtis, M, Jefferys, JGR, Schevon, CA, Schiff, SJ, and Schindler, K. Synchronization and Desynchronization in Epilepsy: Controversies and Hypotheses. J Physiol (2013) 591(4):787–97. doi:10.1113/jphysiol.2012.239590

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Jirsa, VK, Stacey, WC, Quilichini, PP, Ivanov, AI, and Bernard, C. On the Nature of Seizure Dynamics. Brain (2014) 137:2210–30. doi:10.1093/brain/awu133

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Andrzejak, RG, Rummel, C, Mormann, F, and Schindler, K. All Together Now: Analogies between Chimera State Collapses and Epileptic Seizures. Sci Rep (2016) 6:23000. doi:10.1038/srep23000

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Gerster, M, Berner, R, Sawicki, J, Zakharova, A, Škoch, A, Hlinka, J, et al. FitzHugh-Nagumo Oscillators on Complex Networks Mimic Epileptic-Seizure-Related Synchronization Phenomena. Chaos (2020) 30:123130. doi:10.1063/5.0021420

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Tass, PA, Adamchic, I, Freund, H-J, von Stackelberg, T, and Hauptmann, C. Counteracting Tinnitus by Acoustic Coordinated Reset Neuromodulation. Restor Neurol Neurosci (2012) 30:137–59. doi:10.3233/rnn-2012-110218

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Tass, PA, and Popovych, OV. Unlearning Tinnitus-Related Cerebral Synchrony with Acoustic Coordinated Reset Stimulation: Theoretical Concept and Modelling. Biol Cybern (2012) 106:27–36. doi:10.1007/s00422-012-0479-5

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Uhlhaas, P, Pipa, G, Lima, B, Melloni, L, Neuenschwander, S, Nikolic, D, et al. Neural Synchrony in Cortical Networks: History, Concept and Current Status. Front Integr Neurosci (2009) 3:17. doi:10.3389/neuro.07.017.2009

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Pecora, LM, and Carroll, TL. Master Stability Functions for Synchronized Coupled Systems. Phys Rev Lett (1998) 80:2109–12. doi:10.1103/physrevlett.80.2109

CrossRef Full Text | Google Scholar

34. Flunkert, V, Yanchuk, S, Dahms, T, and Schöll, E. Synchronizing Distant Nodes: a Universal Classification of Networks. Phys Rev Lett (2010) 105:254101. doi:10.1103/physrevlett.105.254101

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Dahms, T, Lehnert, J, and Schöll, E. Cluster and Group Synchronization in Delay-Coupled Networks. Phys Rev E (2012) 86:016202. doi:10.1103/physreve.86.016202

CrossRef Full Text | Google Scholar

36. Keane, A, Dahms, T, Lehnert, J, Suryanarayana, SA, Hövel, P, and Schöll, E. Synchronisation in Networks of Delay-Coupled Type-I Excitable Systems. Eur Phys J B (2012) 85:407. doi:10.1140/epjb/e2012-30810-x

CrossRef Full Text | Google Scholar

37. Kyrychko, YN, Blyuss, KB, and Schöll, E. Synchronization of Networks of Oscillators with Distributed Delay Coupling. Chaos (2014) 24:043117. doi:10.1063/1.4898771

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Lehnert, J. Controlling Synchronization Patterns in Complex Networks. Springer Theses. Heidelberg: Springer (2016).

39. Tang, L, Wu, X, Lü, J, Lu, JA, and D'Souza, RM. Master Stability Functions for Complete, Intralayer, and Interlayer Synchronization in Multiplex Networks of Coupled Rössler Oscillators. Phys Rev E (2019) 99:012304. doi:10.1103/PhysRevE.99.012304

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Berner, R, Sawicki, J, and Schöll, E. Birth and Stabilization of Phase Clusters by Multiplexing of Adaptive Networks. Phys Rev Lett (2020) 124:088301. doi:10.1103/physrevlett.124.088301

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Börner, R, Schultz, P, Ünzelmann, B, Wang, D, Hellmann, F, and Kurths, J. Delay Master Stability of Inertial Oscillator Networks. Phys Rev Res (2020) 2:023409. doi:10.1103/physrevresearch.2.023409

CrossRef Full Text | Google Scholar

42. Mulas, R, Kuehn, C, and Jost, J. Coupled Dynamics on Hypergraphs: Master Stability of Steady States and Synchronization. Phys Rev E (2020) 101:062313. doi:10.1103/physreve.101.062313

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Belykh, VN, Belykh, IV, and Hasler, M. Connection Graph Stability Method for Synchronized Coupled Chaotic Systems. Physica D: Nonlinear Phenomena (2004) 195:159–87. doi:10.1016/j.physd.2004.03.012

CrossRef Full Text | Google Scholar

44. Belykh, I, de Lange, E, and Hasler, M. Synchronization of Bursting Neurons: What Matters in the Network Topology. Phys Rev Lett (2005) 94:188101. doi:10.1103/physrevlett.94.188101

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Belykh, I, Belykh, V, and Hasler, M. Generalized Connection Graph Method for Synchronization in Asymmetrical Networks. Physica D: Nonlinear Phenomena (2006) 224:42–51. doi:10.1016/j.physd.2006.09.014

CrossRef Full Text | Google Scholar

46. Belykh, I, Belykh, V, and Hasler, M. Synchronization in Asymmetrically Coupled Networks with Node Balance. Chaos (2006) 16:015102. doi:10.1063/1.2146180 https://doi.org/10.1063/1.2146180

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Daley, K, Zhao, K, and Belykh, IV. Synchronizability of Directed Networks: The Power of Non-existent Ties. Chaos (2020) 30:043102. doi:10.1063/1.5134920

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Berner, R, Vock, S, Schöll, E, and Yanchuk, S. Desynchronization Transitions in Adaptive Networks. Phys Rev Lett (2021) 126:028301. doi:10.1103/physrevlett.126.028301

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Jain, S, and Krishna, S. A Model for the Emergence of Cooperation, Interdependence, and Structure in Evolving Networks. Proc Natl Acad Sci (2001) 98:543–7. doi:10.1073/pnas.98.2.543

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Proulx, S, Promislow, D, and Phillips, P. Network Thinking in Ecology and Evolution. Trends Ecol Evol (2005) 20:345–53. doi:10.1016/j.tree.2005.04.004

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Gross, T, D’Lima, CJD, and Blasius, B. Epidemic Dynamics on an Adaptive Network. Phys Rev Lett (2006) 96:208701. doi:10.1103/physrevlett.96.208701

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Martens, EA, and Klemm, K. Transitions from Trees to Cycles in Adaptive Flow Networks. Front Phys (2017) 5:62. doi:10.3389/fphy.2017.00062

CrossRef Full Text | Google Scholar

53. Kuehn, C. Multiscale Dynamics of an Adaptive Catalytic Network. Math Model Nat Phenom (2019) 14:402. doi:10.1051/mmnp/2019015

CrossRef Full Text | Google Scholar

54. Horstmeyer, L, and Kuehn, C. Adaptive Voter Model on Simplicial Complexes. Phys Rev E (2020) 101:022305. doi:10.1103/physreve.101.022305

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Meisel, C, and Gross, T. Adaptive Self-Organization in a Realistic Neural Network Model. Phys Rev E (2009) 80:061917. doi:10.1103/physreve.80.061917

CrossRef Full Text | Google Scholar

56. Mikkelsen, K, Imparato, A, and Torcini, A. Emergence of Slow Collective Oscillations in Neural Networks with Spike-Timing Dependent Plasticity. Phys Rev Lett (2013) 110:208101. doi:10.1103/physrevlett.110.208101

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Mikkelsen, K, Imparato, A, and Torcini, A. Sisyphus Effect in Pulse-Coupled Excitatory Neural Networks with Spike-timing-dependent Plasticity. Phys Rev E (2014) 89:062701. doi:10.1103/physreve.89.062701

CrossRef Full Text | Google Scholar

58. Markram, H, Lübke, J, Frotscher, M, and Sakmann, B. Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs. Science (1997) 275:213–5. doi:10.1126/science.275.5297.213

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Abbott, LF, and Nelson, SB. Synaptic Plasticity: Taming the Beast. Nat Neurosci (2000) 3:1178–83. doi:10.1038/81453

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Caporale, N, and Dan, Y. Spike Timing-dependent Plasticity: A Hebbian Learning Rule. Annu Rev Neurosci (2008) 31:25–46. doi:10.1146/annurev.neuro.31.060407.125639

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Popovych, OV, Yanchuk, S, and Tass, PA. Self-organized Noise Resistance of Oscillatory Neural Networks with Spike Timing-dependent Plasticity. Sci Rep (2013) 3:2926. doi:10.1038/srep02926

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Zenke, F, Agnes, EJ, and Gerstner, W. Diverse Synaptic Plasticity Mechanisms Orchestrated to Form and Retrieve Memories in Spiking Neural Networks. Nat Commun (2015) 6:6922. doi:10.1038/ncomms7922

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Tazerart, S, Mitchell, DE, Miranda-Rottmann, S, and Araya, R. A Spike-timing-dependent Plasticity Rule for Dendritic Spines. Nat Commun (2020) 11:4276. doi:10.1038/s41467-020-17861-7

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Froemke, RC, Poo, M-m., and Dan, Y. Spike-timing-dependent Synaptic Plasticity Depends on Dendritic Location. Nature (2005) 434:221–5. doi:10.1038/nature03366

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Sjöström, PJ, and Häusser, M. A Cooperative Switch Determines the Sign of Synaptic Plasticity in Distal Dendrites of Neocortical Pyramidal Neurons. Neuron (2006) 51:227–38. doi:10.1016/j.neuron.2006.06.017

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Froemke, RC, Letzkus, JJ, Kampa, BM, Hang, GB, and Stuart, GJ. Dendritic Synapse Location and Neocortical Spike-timing-dependent Plasticity. Front.Syna.Neurosci. (2010) 2:29. doi:10.3389/fnsyn.2010.00029

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Letzkus, JJ, Kampa, BM, and Stuart, GJ. Learning Rules for Spike Timing-dependent Plasticity Depend on Dendritic Synapse Location. J Neurosci (2006) 26:10420–9. doi:10.1523/jneurosci.2650-06.2006

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Meissner-Bernard, C, Tsai, MC, Logiaco, L, and Gerstner, W. Dendritic Voltage Recordings Explain Paradoxical Synaptic Plasticity: A Modeling Study. Front Synaptic Neurosci (2020) 12:585539. doi:10.3389/fnsyn.2020.585539

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Aoki, T, and Aoyagi, T. Co-evolution of Phases and Connection Strengths in a Network of Phase Oscillators. Phys Rev Lett (2009) 102:034101. doi:10.1103/physrevlett.102.034101

PubMed Abstract | CrossRef Full Text | Google Scholar

70. Kasatkin, DV, Yanchuk, S, Schöll, E, and Nekorkin, VI. Self-organized Emergence of Multilayer Structure and Chimera States in Dynamical Networks with Adaptive Couplings. Phys Rev E (2017) 96:062211. doi:10.1103/physreve.96.062211

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Kasatkin, DV, and Nekorkin, VI. The Effect of Topology on Organization of Synchronous Behavior in Dynamical Networks with Adaptive Couplings. Eur Phys J Spec Top (2018) 227:1051–61. doi:10.1140/epjst/e2018-800077-7

CrossRef Full Text | Google Scholar

72. Berner, R, Fialkowski, J, Kasatkin, D, Nekorkin, V, Yanchuk, S, and Schöll, E. Hierarchical Frequency Clusters in Adaptive Networks of Phase Oscillators. Chaos (2019) 29:103134. doi:10.1063/1.5097835

PubMed Abstract | CrossRef Full Text | Google Scholar

73. Berner, R, Yanchuk, S, and Schöll, E. What Adaptive Neuronal Networks Teach Us about Power Grids. Phys Rev E (2021) 103:042315. doi:10.1103/physreve.103.042315

PubMed Abstract | CrossRef Full Text | Google Scholar

74. Feketa, P, Schaum, A, and Meurer, T. Synchronization and Multi-Cluster Capabilities of Oscillatory Networks with Adaptive Coupling. IEEE Trans Automat Control (2020) 66(7):3084. doi:10.1109/tac.2020.3012528

CrossRef Full Text | Google Scholar

75. Franović, I, Yanchuk, S, Eydam, S, Bačić, I, and Wolfrum, M. Dynamics of a Stochastic Excitable System with Slowly Adapting Feedback. Chaos (2020) 30:083109. doi:10.1063/1.5145176

PubMed Abstract | CrossRef Full Text | Google Scholar

76. Popovych, OV, Xenakis, MN, and Tass, PA. The Spacing Principle for Unlearning Abnormal Neuronal Synchrony. PLoS ONE (2015) 10:e0117205. doi:10.1371/journal.pone.0117205

PubMed Abstract | CrossRef Full Text | Google Scholar

77. Lücken, L, Popovych, OV, Tass, PA, and Yanchuk, S. Noise-enhanced Coupling between Two Oscillators with Long-Term Plasticity. Phys Rev E (2016) 93:032210. doi:10.1103/physreve.93.032210

PubMed Abstract | CrossRef Full Text | Google Scholar

78. Chakravartula, S, Indic, P, Sundaram, B, and Killingback, T. Emergence of Local Synchronization in Neuronal Networks with Adaptive Couplings. PLoS ONE (2017) 12:e0178975. doi:10.1371/journal.pone.0178975

PubMed Abstract | CrossRef Full Text | Google Scholar

79. Röhr, V, Berner, R, Lameu, EL, Popovych, OV, and Yanchuk, S. Frequency Cluster Formation and Slow Oscillations in Neural Populations with Plasticity. PLoS ONE (2019) 14:e0225094. doi:10.1371/journal.pone.0225094

PubMed Abstract | CrossRef Full Text | Google Scholar

80. Sakaguchi, H, and Kuramoto, Y. A Soluble Active Rotater Model Showing Phase Transitions via Mutual Entertainment. Prog Theor Phys (1986) 76:576–81. doi:10.1143/ptp.76.576

CrossRef Full Text | Google Scholar

81. Madadi Asl, M, Valizadeh, A, and Tass, PA. Dendritic and Axonal Propagation Delays Determine Emergent Structures of Neuronal Networks with Plastic Synapses. Sci Rep (2017) 7:39682. doi:10.1038/srep39682

PubMed Abstract | CrossRef Full Text | Google Scholar

82. Madadi Asl, M, Valizadeh, A, and Tass, PA. Dendritic and Axonal Propagation Delays May Shape Neuronal Networks with Plastic Synapses. Front Physiol (2018) 9:1849. doi:10.3389/fphys.2018.01849

PubMed Abstract | CrossRef Full Text | Google Scholar

83. Vock, S, Berner, R, Yanchuk, S, and Schöll, E. Effect of Diluted Connectivities on Cluster Synchronization of Adaptively Coupled Oscillator Networks. Scientia Iranica D (2021) 28(3):1669.

84. Liesen, J, and Mehrmann, V. Linear Algebra. Cham: Springer (2015). doi:10.1007/978-3-319-24346-7

CrossRef Full Text

85. Gray, RM Toeplitz and Circulant Matrices: A Review. Found. Trends Commun. Inf. Theory, Hanover, MA, USA: Now Publishers Inc. (2006). p. 155–239.

86. Aoki, T, and Aoyagi, T. Self-organized Network of Phase Oscillators Coupled by Activity-dependent Interactions. Phys Rev E (2011) 84:066109. doi:10.1103/physreve.84.066109

CrossRef Full Text | Google Scholar

87. Sun, J, Bollt, EM, and Nishikawa, T. Master Stability Functions for Coupled Nearly Identical Dynamical Systems. Europhys Lett (2009) 85:60011. doi:10.1209/0295-5075/85/60011

CrossRef Full Text | Google Scholar

88. Skardal, PS, Taylor, D, and Sun, J. Optimal Synchronization of Complex Networks. Phys Rev Lett (2014) 113:144101. doi:10.1103/physrevlett.113.144101

PubMed Abstract | CrossRef Full Text | Google Scholar

89. Acharyya, S, and Amritkar, RE. Synchronization of Nearly Identical Dynamical Systems: Size Instability. Phys Rev E (2015) 92:052902. doi:10.1103/physreve.92.052902

CrossRef Full Text | Google Scholar

90. Kromer, JA, and Tass, PA. Long-lasting Desynchronization by Decoupling Stimulation. Phys Rev Res (2020) 2:033101. doi:10.1103/physrevresearch.2.033101

CrossRef Full Text | Google Scholar

91. Kromer, JA, Khaledi-Nasab, A, and Tass, PA. Impact of Number of Stimulation Sites on Long-Lasting Desynchronization Effects of Coordinated Reset Stimulation. Chaos (2020) 30:083134. doi:10.1063/5.0015196

PubMed Abstract | CrossRef Full Text | Google Scholar

92. Khaledi-Nasab, A, Kromer, JA, and Tass, PA. Long-Lasting Desynchronization of Plastic Neural Networks by Random Reset Stimulation. Front Physiol (2021) 11:622620. doi:10.3389/fphys.2020.622620

PubMed Abstract | CrossRef Full Text | Google Scholar

93. Olmi, S, Petkoski, S, Guye, M, Bartolomei, F, and Jirsa, V. Controlling Seizure Propagation in Large-Scale Brain Networks. Plos Comput Biol (2019) 15:e1006805. doi:10.1371/journal.pcbi.1006805

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: synaptic plasticity, adaptive networks, phase oscillator, synchronization, distance-dependent synaptic plasticity, nonlocally coupled rings, master stability approach

Citation: Berner R and Yanchuk S (2021) Synchronization in Networks With Heterogeneous Adaptation Rules and Applications to Distance-Dependent Synaptic Plasticity. Front. Appl. Math. Stat. 7:714978. doi: 10.3389/fams.2021.714978

Received: 26 May 2021; Accepted: 21 June 2021;
Published: 15 July 2021.

Edited by:

Jun Ma, Lanzhou University of Technology, China

Reviewed by:

Syamal Kumar Dana, Jadavpur University, India
Gopal R., SASTRA University, India

Copyright © 2021 Berner and Yanchuk. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Rico Berner, cmljby5iZXJuZXJAcGh5c2lrLnR1LWJlcmxpbi5kZQ==

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.