Skip to main content

ORIGINAL RESEARCH article

Front. Appl. Math. Stat., 09 August 2024
Sec. Mathematical Biology
This article is part of the Research Topic Mathematical Modeling of Gene Networks View all 6 articles

Subnetwork inclusion and switching of multilevel Boolean networks preserve parameter graph structure and dynamics

\r\nWilliam DuncanWilliam Duncan1Breschine CumminsBreschine Cummins2Tom&#x; Gedeon
Tomáš Gedeon2*
  • 1Immunetrics, Pittsburgh, PA, United States
  • 2Department of Mathematical Sciences, Montana State University, Bozeman, MT, United States

This study addresses a problem of correspondence between dynamics of a parameterized system and the structure of interactions within that system. The structure of interactions is captured by a signed network. A network dynamics is parameterized by collections of multi-level monotone Boolean functions (MBFs), which are organized in a parameter graph PG. Each collection generates dynamics which are captured in a structure of recurrent sets called a Morse graph. We study two operations on signed graphs, switching and subnetwork inclusion, and show that these induce dynamics-preserving maps between parameter graphs. We show that duality, a standard operation on MBFs, and switching are dynamically related: If M is the switch of N, then duality gives an isomorphism between PG(N) and PG(M) which preserves dynamics and thus Morse graphs. We then show that for each subnetwork MN, there are embeddings of the parameter graph PG(M) into PG(N) that preserve the Morse graph. Since our combinatorial description of network dynamics is closely related to switching ODE network models, our results suggest similar results for parameterized sets of smooth ODE network models of the network dynamics.

1 Introduction

The concept of a network plays a central role in systems biology, where it encodes interactions between the molecular species. Each directed edge has a sign, which represents either a monotonically increasing or monotonically decreasing effect of the source on the target. The restriction to monotone interactions suggests a possibility that there is a relationship between structure of the network and its emergent dynamics.

There are different types of dynamics that can be associated to a network. Some, like those generated by Boolean functions wherein each node can take on a value of 0 or 1, are very tightly linked to the structure of the network. On the other hand, the dynamics generated by ordinary differential equations (ODE) models with an interaction structure given by the network strongly depends on choice of non-linearities and parameters. Within the class of ODE network models, the question of limitations on dynamics imposed by network structure is much more difficult. In particular, one has to carefully define what constitutes the “same” dynamics to compare the dynamics of different networks. Traditional definitions used in comparison of dynamical systems include the concept of conjugate dynamics, or conjugate dynamics on a recurrent set Ω [1]. While the first condition is stronger, both conditions are very difficult to verify. To illustrate the difficulties, it is known that the hope that for a generic set of Morse-Smale systems the set Ω is finite is false [2].

In this study, we address the question of the relationship between network structure and its dynamics in the context of multi-valued Boolean systems in which each vertex can take on a set of integer values based on its number of out-edges. The approach is based on [36] Dynamic Signatures Generated by Regulatory Networks (DSGRN) which parameterizes the dynamics of a network with a collection of monotone Boolean functions (MBFs) that are compatible with its structure, that is, the monotonicity is compatible with the signs of the network edges. These collections are organized in a finite parameter graph PG that takes the form of a product graph PG = ∏uVPG(u) where the product is over vertices of the network. Each node in PG represents a collection of MBFs called a DSGRN parameter or just parameter. The edges in PG represent adjacency within the collections of MBFs.

There is a correspondence [7] between each DSGRN parameter and the dynamics of a switching ODE system [816], whose dynamics can be captured by a finite state transition graph (STG). A switching ODE can be approximated arbitrarily well by a smooth ODE system; there are rigorous results [1719] that connect smooth ODE dynamics to that of a switching system and thus STG. DSGRN uses a more compact description of the dynamics of an STG in the form of a Morse graph (MG). Nodes of a Morse graph are strongly connected components of the STG, and the edges of MG are given by reachability within the STG. Therefore, our description of the dynamics of network N consists of its parameter graph PG(N) with an associated collection of Morse graphs MG(N), one for each node. Since the parameter graph PG(N) provides direct correspondence between the collection of monotone Boolean functions and the continuous time ODE dynamics of smooth approximations of switching systems, comparing the PGs across networks provides a global comparison between dynamic repertoires of these networks for both discrete and continuous time dynamics.

The connection between parameterization of continuous dynamics of switching systems and collections of multi-valued Boolean models of the same network was also described in Abou-Jaoudé and Monteiro [20]. While DSGRN starts with switching ODE system and arrives at Boolean description of ODE parameter domains, Abou-Jaoudé and Monteiro [20] starts with collection of multi-valued Boolean models and uses switching system parameters to generate sequences of Boolean systems. Changes in the structure of attractors are examined as an analog of bifurcations. The parameter graph PG is equivalent to the collection of all monotone multi-valued Boolean systems compatible with network N in Abou-Jaoudé and Monteiro [20]. The set of attractors is represented as the set of leaves in the Morse graph, and therefore, our description of dynamics using Morse graphs is more general.

With a finite characterization of network dynamics, it is natural to ask whether homomorphisms of signed directed graphs preserve network dynamics D(N): = (PG(N),MG(N)). We emphasize that we seek maps that preserve the graph structure of PG(N), where the map preserves the relationships between nodes given by edges. Under such a map not only dynamics at individual parameters p is preserved, but also the changes in the dynamics (bifurcations) between neighboring parameters p, qPG(N) are preserved. While we do not answer this question in its full generality, we study two important homomorphisms. First is the so-called switch map, introduced in Zaslavsky [21], on signed directed graphs that switches the signs of all edges incident to a set of vertices. In an ODE model, a switch can be realized via a change of variables x → −x for all variables corresponding to this set of vertices and has been used for monotone systems and monotone cyclic feedback systems to bring them to a normal form [2224]. Clearly, a switch map preserves incidence of all edges and also the number and sign of all closed loops [21, 2527]. In Aracena et al. [26], it was shown that a switch preserves the maximum number of fixed points of a network across all strict Boolean systems for that network. Here, we show that the maximum number of fixed points is preserved due to the preservation of all dynamics: A switch map induces an involution on the parameter graph PG that preserves the STG and hence MG. This shows that the dynamics of the two networks is the same.

The second homomorphism we study is inclusion of a network as subgraph in another network. This is a very important example in systems biology where gene regulatory networks cannot be assumed to be in their final form as new experimental evidence may reveal additional genes (nodes) and edges. Since the basis of any scientific approach is to study small problems first before using that knowledge to tackle larger problems, we must understand if, and how, the dynamics D(M) of a subnetwork M persists within the dynamics D(N) of a larger network N. Within the DSGRN framework, at some parameters pPG, a particular edge can be constitutively ON or constitutively OFF. We show that at parameters pPG where all edges in N\M are either constitutively ON or constitutively OFF, the parameter graph PG(M) is a subgraph of PG(N). In fact, we describe precisely the conditions under which there are several isomorphic copies of the parameter graph PG(M) within PG(N), where each copy carries the same collection of dynamics MG(M).

The second homomorphism is strongly motivated by systems biology. Gene regulatory networks do not exist in isolation and interact with other networks. It is important to understand if and under what conditions the dynamics of subnetworks persist within a larger network. As a motivating example, consider [28] where they considered the interaction of the yeast cell cycle network with the pheromone-sensing network that stops the cell cycle in the presence of mating pheromone. The study concludes that in the absence of pheromone the cell cycle network drives parts of the pheromone network, while in the presence of pheromone the cell cycle is driven to a rest state. One can conceptualize this interaction by assuming that the cell cycle network on its own supports a periodic orbit corresponding to the cell cycle and the pheromone-sensing network supports a steady state. This study shows that both of these dynamical behaviors occur in the larger network comprised of both subnetworks but at different parameters. This insight leads to the conjecture that by changing parameters it is possible for one or the other behavior to prevail within the larger network; however, at intermediate parameters, completely new dynamics may emerge.

A further motivating example comes from examining the subnetworks of the cell cycle itself, which support multiple phenotypes. The dual view of the cell cycle as either a biochemical “clock” vs. a set of “dominos”, that is, a series of switches where the completion of one step is required for the completion of the next step, has been discussed for at least 35 years [29, 30]. Support for the biochemical clock view comes, among others, from studies that showed that even in the absence of cyclins, a cell cycle-associated program of periodic transcription program is intact [31]. On the other hand, a bistable switch facilitates transition from G1 to S phase of the cell cycle [5, 32, 33], and other switches likely facilitate other checkpoints. Since recent modeling work suggests that different cell cycle phenotypes are the result of changes in parameters [34], these two views can be reconciled by realizing that cell cycle network [31, 34] contains multiple positive and negative feedback loops. Since negative loops in isolation can support periodic behavior [35], while positive loops can support bistability [36], the cell cycle phenotype depends on particular parameters (i.e., cellular conditions) that determine which behavior dominates. For instance, in many cancers, the uncontrolled proliferation is caused by defective checkpoints [37, 38]. How the checkpoint steady state dynamics driven by positive loops interacts with periodic behavior driven by negative loops, and the proximity of these behaviors in the parameter space, may suggest perturbations that restore the checkpoint function.

Apart from addressing a general question of comparison of dynamic repertoires of networks, the work presented here provides the capability to answer the rigorously central hypothesis of motif theory [3941] within systems biology. Motifs are small networks with 3-4 nodes each that are postulated to have a particular cellular function based on their dynamics. However, it is not clear whether independent motif dynamics persists after embedding into a larger network. Our work suggests conditions under which the independent motif dynamics can be observed within the larger network.

We illustrate our work on a small network N in Figure 1A throughout the study. There are two motifs embedded in this network: a mutual activation loop PL (positive loop) between z and y and a negative feedback loop NL xyzx. Theorems 5.4, 5.5 describe how the dynamics of these loops persists within the larger network in Figure 1A. We outline these results here on network N, while leaving the details for the text that follows.

Figure 1
www.frontiersin.org

Figure 1. (A) Network N with positive loop motif PL between z and y and a negative loop motif NL xyzx. (B) There are three monotone Boolean functions (MBF) at node x forming parameter factor graph PG(x); (C) six MBF forming PG(y); (D) twelve MBFs forming PG(z). The set of all parameters is PG(N) =PG(x) × PG(y) × PG(z). There are two embeddings of PG(NL) into PG(N). Both embeddings are products of PG(x) with subgraph of PG(y) and a subgraph of PG(z). When edge e:zy is always ON, these subgraphs are {I,II, IV} and {10,11,12}, marked by square nodes. If the edge e:zy is always OFF, the subgraphs are {IV,V, VI} and {1,2,3}, marked by circle nodes.

We represent all possible ways in which the network can function by enumerating a collection of monotone Boolean functions (MBF) (Section 2.1). These describe how the concentration levels of the input edge(s) of each node activate the output edges. Node x has single input and single output and there are three MBFs (see Table 1) that describe potential activation patterns of the output edge xy in response to a Boolean input Z ∈ {0, 1}: a constant function with value 0 (A), a constant function with value 1 (C), and an identity function B. Figure 1B shows the structure of this set of MBFs where we join by an edge any MBFs that differ in a single value. This is the parameter factor graph PG(x).

Table 1
www.frontiersin.org

Table 1. Three monotone Boolean functions in PG(x) with Boolean input Z.

In Figure 1C shows PG(y) consisting of MBFs with two inputs and one output and in Figure 1D is PG(z) of MBFs with one input and two outputs. Their structure is explained in Tables 2, 3 later in the study. The parameter graph of the network N is PG(N) =PG(x) × PG(y) × PG(z), the product of the parameter factor graphs.

Table 2
www.frontiersin.org

Table 2. Six monotone Boolean functions in PG(y) with Boolean inputs X and Z.

Table 3
www.frontiersin.org

Table 3. Logic parameters of PG(z) corresponding to nodes 1-12 (first row).

As a consequence of Theorem 5.5, there are two subgraphs of PG(N) that are isomorphic to parameter graph of the negative loop PG(NL). These are products of PG(x) with subgraphs of PG(y) and PG(z) described in Figure 1. As explained in detail in Appendix B, there are four such embeddings of the parameter graph of the positive loop PG(PL) into PG(N) and consequently, at those parameters the dynamics of N is the same as that of the positive loop. These results make it possible to investigate relative positions of parameters that support bistability and those that support oscillations.

The organization of the study is as follows. In Section 2, we review the basic concepts of DSGRN: the parameter graph, state transition graph and Morse graph. In Section 3, we describe homomorphisms of signed graphs and a particular example of switching homomorphism. In Section 4, we show that the switching homomorphism preserves dynamics by inducing a graph isomorphism of the parameter graph that preserves dynamics. In Section 5, we start focusing on the network embedding as our second example of signed graph homomorphism. We formulate our main results as Theorem 5.4 about correspondence of dynamics at input inessential parameters and Theorem 5.5 at output inessential parameters. These Theorems are then proved in Sections 6 and 7, respectively. Section 8 contains discussion, while some proofs of the more technical results are delegated to the Section 8 and a detailed analysis of network N from Figure 1 is in Section 9.

2 Regulatory networks

A regulatory network N = (V, E, δ) is a directed graph with nodes V, directed edges E, and an edge sign function δ:E → {−1, 1}. We denote an edge from node u to node v without indicating its sign by uv. The edge uv is activating if δuv=1 and repressing if δuv=-1. Graphically, an activating edge is denoted by uv and a repressing edge by uv. The sources and targets of a node u are given by

S(u):={wV|wuE}   T(u):={vV|uvE},

respectively.

2.1 Parameters

The parameterization of the dynamics of a network depends on the choice of model. We discuss two different types of models and briefly review literature on how the parameterizations of these two types of models are related. Boolean models compatible with regulatory network N have a long history [11, 42, 43], and their study remains an active research area [20, 4446]. There are two closely related but distinct types of Boolean models. The standard Boolean network model considers a single Boolean function fu:𝔹|S(u)|𝔹 at each node u which is monotone in each input respecting the edge sign δ. When a node is activated via fu = 1, then this activated state, in turn, activates all edges from u to T(u) [44, 4749]. The parameterization of such a network involves enumerating monotone Boolean functions fu compatible with edge signs between S(u) and u. Often one is interested in non-degenerate [50] or, equivalently, observable [45] functions which are non-constant and each input affects the value of fu.

An alternative and richer set of models starts with the original work of Thomas et al. [42]. They consider discrete dynamics where u can selectively activate some nodes in T(u), but not others, as this activation happens at different thresholds for different targets. This naturally leads to the consideration of multi-level Boolean functions, where the discrete levels of node u are related to the number of nodes in T(u). Parameterization of all such possible multi-valued Boolean functions compatible with the network structure has been described by Abou-Jaoudé and Monteiro [20] and by Cummins et al. [3, 4], and Gedeon [6], arriving at the same concept from different perspectives. The goal of Abou-Jaoudé and Monteiro [20] is to construct natural families of multi-valued Boolean functions that describe changes in the dynamics as a function of a continuous parameter. In order to do this, they need to relate the collection of multi-valued Boolean functions to a continuous time differential equation switching model where the change of continuous parameter then induces a sequence of multi-valued Boolean functions. The sequence of attractors of these functions constitutes a logical bifurcation diagram.

As mentioned in the introduction, our work [3] starts with an ODE switching model and realizes that the continuous parameter space of these models decomposes to a set of domains each of which admits the same dynamics, as described by a discrete state transition graph. This naturally leads to the representation of this decomposition in a form of a graph, called a parameter graph where each node represents one such domain and edges represent co-dimension one boundaries (immediate proximity) in the parameter space. As we describe in more detail below, each node of the parameter graph is specified by two sets of information: the ordering of thresholds of edges u to T(u), which we call below an order parameter, and the description of values of the multi-valued Boolean function fu as a collection of monotone Boolean functions, each describing which Boolean inputs b ∈ 𝔹S(u) activate a particular node vT(u). This collection is called below a logic parameter. This description is equivalent to the multi-valued Boolean function description of Abou-Jaoudé and Monteiro [20] (Definition 2).

We now start with rigorous description of the set of parameters associated with a regulatory network N = (V, E, δ). This set depends on the nodes V and the edges E but not on the sign of edges δ. For simplicity, we fix the network N and suppress these dependencies. We will reintroduce the dependencies in later sections as needed.

Let mu: = |T(u)| denotes the number of target nodes of u. A u-order parameter is a bijection θu:T(u) → {1, …, mu} which defines an ordering of the out-edges of u. The set of u-order parameters is denoted by Θ(u). A collection θ: = (θu)uV is an order parameter. The set of all order parameters is given by Θ: = ∏uV Θ (u). The target nodes are ordered based on how easy are they to activate: As level of expression of node u increases, the target nodes will activate in the order given by the value of the order parameter.

Let 𝔹: = ({0, 1};0 ≺ 1}) be a Boolean lattice with natural order 0 ≺ 1 and let 𝔹n be a lattice of Boolean n vectors with order induced component-wise by ≺.

To define the logic parameter, we need the following definition.

Definition 2.1. A function f : 𝔹n → 𝔹 is a positive monotone Boolean function if b1b2 implies f(b1) ≼ f(b2).

A u-logic parameter is a collection of positive monotone Boolean functions

fu=(fu1,,fumu)

satisfying the ordering condition

fu1(b)fumu(b)    (1)

for all b ∈ 𝔹S(u). The purpose of the function fuθu(v) is to describe when a given input b is above the activation threshold for the edge θu(v), that is, if fuθu(v)(b)=1 then b is above the activation threshold for the edge uv and if fuθu(v)(b)=0 then b is below the activation threshold for the edge uv. A collection f: = (fu)uV is a logic parameter. The set of all u-logic parameters is denoted L(u), while the set of all logic parameters is L:=uVL(u).

The set of parameters is the product of logic and order parameters P:=L×Θ. We call P(u):=L(u)×Θ(u) the set of u-parameters and note the parameters are given by the product P=uVP(u). The following section endows the set P with structure of a graph by defining adjacency between elements of P.

In Section 2.3, we show that the u-logic parameter fu can be equivalently described by a single multi-valued Boolean function gu. Such a description is used in Abou-Jaoudé and Monteiro [20].

2.2 The parameter graph

Two u-parameter nodes, (fu,θu),(gu,ϕu)P(u) are adjacent if exactly one of the following conditions is satisfied.

Order adjacency: fu = gu and the values of the order parameters θu and ϕu are exchanged on a single pair of neighboring entries on which the logic parameters agree. Explicitly, there is an adjacent transposition π of {1, …, mu} such that θu = π°ϕu and fui=guπ(i) for each i. Letting j be the index with j + 1 = π(j), we note that fuj=guπ(j) and fu = gu together imply fuj=fuj+1.

Logical adjacency: θu = ϕu and the u-logic parameters fu and gu differ in a single input. Explicitly, there is unique i ∈ {1, …, mu} and unique b0 ∈ 𝔹S(u) such that fui(b0)gui(b0). For ji, we require fuj(b)=guj(b) for all b ∈ 𝔹n and for bb0 we require fui(b)=gui(b).

The u-factor graph is the undirected graph PG(u):=(P(u),E(u)) whose nodes are u-parameter nodes and whose edges are given by adjacency. The parameter graph PG:=(P,E) is the Cartesian product PG: = ∏uVPG(u). That is, there is an edge (p1,p2)E if and only if there is a unique uV such that (pu1,pu2)E(u) and pv1=pv2 for all vu.

We illustrate the parameter graph construction on network N in Figure 1A by constructing parameter factor graphs PG(y) in Figure 1C and PG(z) in Figure 1D.

First consider node y with S(y) = {x, z} and T(y) = {z}. Therefore, logic parameters are all monotone Boolean functions fy:𝔹2𝔹 and since |T(y)| = 1 there is a single order parameter θz with value θy(z) = 1.

We list all MBFs at node y in Table 2. Note that the fact that the input from x is repressing is modeled by function B (see Equation 2) whose values are in the second column of the table. The edges in PG(y) in Figure 1C reflect parameter node adjacency.

Each node in the factor parameter graph PG(z) is a pair (fz, θz) where fz is a logic parameter and θz is an order parameter. Since there are two targets of z and T(z) = {x, y} there are two order parameters θz1 mapping x → 1 and y → 2, and θz2 mapping x → 2 and y → 1. Therefore, the logic parameter fz=(fz1,fz2) consists two MBFs, where fz1 models activation of the first target and fz2 the second target, given by the value of the order parameter. The order parameter θz1 corresponds to left half of PG(z) (nodes 1-6) and the order parameter θz2 to right half of PG(z) (nodes 7–12). Within each half, the order parameter is fixed, but the logic parameter changes and is described in Table 3.

2.3 Dynamics

The multi-valued Boolean dynamics associated with a network N = (V, E, δ) depends on a choice of parameter pP and the edge sign function δ.

The dynamics occurs on the state space

X:=uVXu,   Xu:={0,1,,mu}.

We call xX a state of the network N. The multi-valued Boolean function at each node will update the state based on the input that depends on the state, order parameter θ and the edge sign function δ. The state x = (xu)uV is mapped to an input to a node v via the input map

Bv:X𝔹S(v),   Bv:=(Buv)uS(v)

where

Buv(x):={0,   if xu<θu(v) and δuv=1 or xuθu(v) and δuv=-11,   if xuθu(v) and δuv=1 or xu<θu(v) and δuv=-1.    (2)

Note that for activating edge uv, if xu is below (above) the activating threshold θu(v), then the input is 0 (1). This assignment is reversed if the edge is repressing.

An equivalent description of the u-logic parameter fu uses a single multi-valued Boolean function gu:XuXu defined by

gu(x)=v=1mufvmu(Buv(x)).

Clearly, for every logic parameter fu=(fu1,,fumu), there is well-defined multi-valued function gu; given gu and the order parameter θu, one can reconstruct the collection fu. Logic parameter description using a single multi-valued function gu is used in Abou-Jaoudé and Monteiro [20].

Definition 2.2. The dynamics for network N at parameter (f,θ)P is defined as follows.

1. The multi-level Boolean target point F0:XX is defined by

Fu0(x):=|{i{1,,mu}|fui(Bu(x))=1}|.

This map is also called the synchronous update [51] of the multi-level Boolean function g that corresponds to f.

2. The multi-level Boolean dynamics F:X×PX is a multi-valued map generated by F0 and defined by

• If F0(x)=x then F(x)={x}.

• For any u and η ∈ {−1, 1} satisfying ηFu0(x)>ηxu the state

x¯u=xu+η,  x¯v=xv for vu

satisfies x¯F(x).

The maps F0 and F implicitly depend on the choice of network and the associated parameters. We will explicitly include these dependencies as arguments as needed.

The multi-level Boolean dynamics F can be represented as a a state transition graph STG(X) with vertices given by the states X: there is a directed edge xx¯ in STG(X) if, and only if, x¯F(x).

2.4 The Morse graph

The recurrent dynamics of F(·;p) are encoded by a Morse graph MG(p). The Morse graph MG(p) = (SCC, A) is a directed graph with nodes SCC consisting of strongly connected components of STG(X, p). The Morse graph is the Haase diagram on SCC of the reachability relation on the corresponding strongly connected components within STG(X, p) SCC. We label each strongly connected component sSCC according to the following.

• If sSCC consists of a single recurrent state, s = {x}, then x is a fixed point of F and we label s by FP(x).

• If sSCC is not an FP, then we label s as a partial cycle PC or a full cycle FC. The strongly connected component s is a PC if s is constant in at least one coordinate: There is a node uV and an integer k such that xs implies xu = k. If s is not an FP or an PC, then s is an FC.

• If sSCC has no out-edges in MG(p), then s is stable. Otherwise, s is unstable. The collection of stable s, that is, the leaves of MG(p), are the attractors described in Abou-Jaoudé and Monteiro [20]. While the attractors correspond to observable dynamics and hence are important in biological models, the unstable s plays a role in bifurcations under parameter changes.

3 Homomorphisms of signed networks

Following Naserasr et al. [27], we define a homomorphism of signed networks to be a graph homomorphism which preserves the signs of closed walks.

Definition 3.1. Let N = (V, E, δ) be a network.

• A walk of N is a sequence of edges v0v1 ⊸ ⋯ ⊸ vn. It is a closed walk if vn = v0. The sign of the walk is given by

i=1nδvi-1vi

• A switching homomorphism of network N = (V, E, δ) to a network M = (V′, E′, η) is a map h:VV′ such that uvE implies h(u) ⊸ h(v) ∈ E′ and a closed walk v0v1 ⊸ ⋯ ⊸ vn is positive in N if and only if h(v0) ⊸ h(v1) ⊸ ⋯ ⊸ h(vn) is positive in M.

The switching homomorphism between networks is a homomorphism of the underlying directed graphs with the additional constraint of preserved signs of closed walks. A switching homomorphism is distinct from a stricter notion of homomorphisms of signed graphs that require edge signs to be preserved [25, 27, 53]. We will see that switching homomorphisms are more natural in the context of network dynamics. The term switching homomorphism comes from the switching operation defined in Zaslavsky [21].

Definition 3.2. Let N = (V, E, δ) be a regulatory network and UV. The U-switch of N is the network σU(N) = (V, E, η) where

ηuv={δuv,  if both  u,vU or both  u,vU-δuv,  otherwise.

Since this operation preserves both nodes V and edges E of N, and only changes the signs of the edges, we will often write η = σU(δ).

The U-switch is motivated by the following change of variables in an ODE system associated with the network N. To N we associate a system of ODEs where a single variable represents each node and where the type (increasing vs. decreasing) monotone interactions between variables is represented by the sign of the edges. Then, the U-switch corresponds to a change of variables x → −x for all xU. Such a change of variables reverses sign of all edges adjacent to a vertex xU (see Figure 2).

Figure 2
www.frontiersin.org

Figure 2. U-switch of network N. Original network N on the left with set U = {A, B} in bold. The network σU(N) on the right.

For any choice of U, the U-switch is a switching homomorphism and an involution; therefore, it is a switching isomorphism. In Naserasr et al. [27], it was shown that any switching homomorphism is a U-switch followed by an edge sign preserving homomorphism. Basic properties of the switch operation are recorded in the following proposition.

Proposition 3.3. 1. If U = V then σU is the identity: σU = Id.

2. For all UV, σU is an involution: σU ∘ σU = Id.

3. Given U, WV, σU and σW commute: σU ∘ σW = σW ∘ σU.

4. Given U = {u1, …, un} ⊂ V, σU=σu1σun.

4 Switch isomorphisms preserve network dynamics

In this section, we examine the relationship between the dynamics of network N and the switched network σU(N). Since the switch operation σU fixes the nodes V and edges E, and the set of parameter nodes P(N) does not depend on the edge signs, we have P(N)=P(σU(N)).

Before we formulate the main result, we outline the main idea. Define bijection λU:XX component-wise by

λU(x)=(λuU(xu))uV   λuU(xu)={mu-xu,   if uUxu,   if xuU.

That is, λU reflects the components Xu for each uU and is the identity on the components Xu for uU. Clearly, λU is an involution. Then, given F0(·;p,N):XX at parameter pP(N), the map F0,U:=λUF0λU is isomorphic to F0. Therefore, both synchronous dynamics given by iterates of F0 and asynchronous dynamics given by F on STG are identical. The main result of this section precisely identifies the map on the parameter graph DU:P(N)P(σU(N)) such that F0,U=F0(·;DU(p),σU(N)). Importantly, we show that the map DU is graph automorphism; that is, it maps not only nodes to nodes but also edges to edges.

Theorem 4.1. Given the U-switch σU, there is an induced isomorphism DU:P(N)P(σU(N)) and a bijection λU:XX such that the the following diagram commutes

yes

In other words, the dynamics of F0(·;p,N) and F0(·;DU(p),σU(N)) is conjugate at parameters related by DU. The map λU is a graph isomorphism between the STG representing F(·;p,N) and the STG representing F(·;DU(p),σU(N)). Consequently, the Morse graphs MG(p) and MG(DU(p)) are isomorphic and corresponding Morse nodes have the same label.

A consequence of Proposition 3.3(4) is that we need only to demonstrate that the diagram Equation 3 commutes in the case that U = {u} consists of a single node.

4.1 The dual parameter map DU

Let uV be a node and pu=(fu,θu)P(u) be a u-parameter. The dual parameter to pu is defined to be qu = (gu, ϕu) where

ϕu(v)=mu+1-θu(v)  and  gui(b)=¬fumu+1-i(¬b),    (4)

and mu = |T(u)|. The reason we say qu is the dual parameter to pu is because gui is the dual Boolean function to fumu+1-i. There is a large literature on dualization of Boolean functions and its computational complexity. See, for example [54].

Define du:P(u)P(u) to be the map from a u-parameter to its dual parameter. The following Lemma is a direct consequence of the definition of du.

Lemma 4.2. Given any u-parameter puP(u), its dual parameter du(pu)P(u), that is, the map du is well-defined. Moreover, du is an involution: dudu = Id.

Proof. We show that du(pu)P(u). Clearly, ϕu is a valid order parameter. We now show that gu satisfies the ordering condition (Equation 1). Since fu satisfies the ordering condition, we have fu1(¬(b))fumu(¬b) and therefore ¬fu1(¬b)¬fumu(¬b). By Definition 4, gu1(b)gumu(b) so that gu satisfies the ordering condition. Next, we show that gui is an MBF. Let b1b2, which implies ¬b1 ≻ ¬b2. Since fumu+1-i is an MBF, we have

gui(b1)=¬fumu+1-i(¬b1)¬fumu+1-i(¬b2)=gui(b2).

This shows gui is an MBF.

The second part of the Lemma follows by inspection.     

We are now ready to define the parameter graph isomorphism corresponding to σU. Since σU fixes the nodes V and edges E, and the set of parameter nodes P(N) does not depend on the edge signs, we have P(N)=P(σU(N)). Therefore, we will omit the network N from the argument of the parameter set P and the parameter graph PG.

Let UV. The U-dual parameter map DU:PP is defined by

DU(p)=(DuU(pu))uV   DuU(pu)={du(pu),   if uUpu,   if uU.

Proposition 4.3. The U-dual parameter map DU is a graph automorphism of PG for all UV.

Proof. By Lemma 4.2 du, is an involution on P(u). Since each component of DU is either the identity on that component or given by du, DU is an involution on P and hence a bijection. It remains to show that DU preserves parameter graph adjacency.

Let p=(f,θ),p¯=(f¯,θ¯)P be adjacent parameters. Let q = (g, ϕ) = DU((f, θ)) and q¯=(g¯,ϕ¯)=DU((f¯,θ¯)). Furthermore, let u be the unique node such that pu and p¯u are adjacent. For wu, pw=p¯w and therefore qw=q¯w.

First suppose pu and p¯u are order adjacent. Then there is an adjacent transposition π such that

θu=πθ¯u.

If uU then ϕu = θu and ϕ¯u=θ¯u so that qu and q¯u are order adjacent. If uU, then

ϕu=mu+1-θu=mu+1-πθ¯u=τϕ¯u

where τ(i): = mu + 1 − π(mu + 1 − i) is an adjacent transposition. Order adjacency of pu and p¯u implies f=f¯ and thus g=g¯, so we conclude q and q¯ are order adjacent.

Finally, suppose pu and p¯u are logically adjacent. If uU then qu = pu and q¯u=p¯u so that qu and q¯u are logically adjacent.

If uU, then θ=θ¯ and thus ϕ=ϕ¯. Let i be the unique index and b0 be the unique input such that fui(b0)f¯ui(b0). Then

gumu+1-i(¬b0)=¬fui(b0)¬f¯ui(b0)=g¯umu+1-i(¬b0)

and for bb0, fuj(b)=f¯uj(b) so that

gumu+1-i(¬b)=¬fumu+1-i(b)=¬f¯umu+1-i(b)=g¯umu+1-i(¬b).

Similarly for ji and any b

gumu+1-j(¬b)=¬fumu+1-j(b)=¬f¯umu+1-j(b)=g¯umu+1-j(¬b).

We conclude that mu + 1 − i is the unique index and ¬b0 is the unique input such that gumu+1-i(¬b0)g¯umu+1-i(¬b0) It follows that q and q¯ are logically adjacent.

Since DU is invertible and preserves both order and logical adjacency, DU is an automorphism of PG.

     

4.2 Preservation of dynamics

The difference between the target point map F0 for the network N and the network σU(N) is due to the dependence of the input map Bu (see the beginning of Section 2.3) on the edge signs δ. The following lemma relates the input map Bu(·;θ, δ) for N and the input map Bu(·;ϕ, σU(δ)) for σU(N). By Proposition 3.3(4), we need only consider the case U = {u}.

Lemma 4.4. Let, uV, (f,θ)P, and (g, ϕ) = D{u}((f, θ)). Let η = σ{u}(δ). Then for all wS(u),

Bwu(x;θ,δ)=¬Bwu(λ{u}(x),ϕ,η).    (5)

For vu and all wS(v),

Bwv(x;θ,δ)=Bwv(λ{u}(x),ϕ,η).    (6)

Consequently,

Bu(x;θ,δ)=¬Bu(λ{u}(x),ϕ,η)  and  Bv(x;θ,δ)=Bv(λ{u}(x),ϕ,η)

for vu.

Proof. To simplify notation, let λ = λ{u}.

First consider wS(u)\{u}. Since λw = Id and ϕw = θw, we have xw < θw(u) if and only if λw(xw) < ϕw(u). Equation (5) then follows after observing δwu=-ηwu.

Next, we consider the case uS(u), that is, a self-edge. Note that for all vT(u),

xu<θu(v)  implies  λu(xu)=mu-xumu+1-θu(v)=ϕu(v)  and  xuθu(v)  implies  λu(xu)=mu-xu<mu+1-θu(v)=ϕu(v).

So, if uS(u), we have xu < θu(u) if and only if xu ≥ ϕu(u). Since δuu=ηuu, Equation (5) holds with w = u.

Now, suppose vu and wS(v). If wu, then λw = Id, ϕw = θw, and ηwv=δwv implies Equation (6) holds. If w = u, then xu < θu(v) holds if and only if

λu(xu)=mu-xumu+1-θu(v)=ϕu(v).

Since ηuv=-δuv, Equation (6) holds.     

Proof of Theorem 4.1. By Proposition 3.3(4), it is sufficient to consider the case U = {u}. To simplify notation, we omit U as an argument of λ and D and let η = σU(δ). Let p = (f, θ) and (g, ϕ) = D(p) be the U-dual parameter.

Note that for vu, λv(xv) = xv, gv = fv, and, by Lemma 4.4 also Bv(x; θ, δ) = Bv(λ(x);ϕ, η). Therefore

|{fvi(Bv(x;θ,δ))=1}|=|{gvi(Bv(λ(x);ϕ,η))=1}|.

Consequently, if we denote x¯v=Fv0(x;p,N) then λv(x¯v)=x¯v=Fv0(λ(x);D(p),σU(N)).

For node u itself, we have

|{gui(Bu(λ(x);ϕ,η))=1}|=|{fumu+1-i(¬Bu(x;θ,δ))=0}|                                                 =mu-|{fui(¬Bu(x);θ,δ)=1}|

Consequently, with x¯u=Fu0(x;p,N),

Fu0(λ(x);D(p),σU(N))=mu-Fu0(x;p,N)=mu-x¯u=λu(x¯u).

We have shown that λU verifies the conjugacy of F0(·;p,N) and F0(·;DU(p),σU(N)). Since F is derived from F0, it follows that λU is a graph isomorphism between STG(p, N) and STG(DU(p), σU(N)). Since the STGs are isomorphic, the corresponding Morse graphs MG(p) and MG(DU(p)) are isomorphic.     

Remark 4.5. We want to point out that when U = V the set of all nodes, and the switch σV:NN is the identity, the map DV:P(N)P(N) is not necessarily an identity automorphism on the parameter graph. As we will show in Section 8, the non-trivial automorphism DV commutes with network projections defined in the next section.

5 Embedding

In this section, we address the question of when the dynamics of a subnetwork M agree with the dynamics of a larger network N. In fact, we find it more convenient to consider the inverse operation of removing (cutting) edges of a regulatory network N and study the effect on the dynamics.

Definition 5.1. Let N = (V, E, δ) be a regulatory network and E¯E be a set of edges. The E¯-cut of N is the network CE¯(N):=(V,E\E¯,η) where

ηuv=δuv  if  uvE¯.

Alternatively, the map IE¯:(V,E\E¯,η)(V,E,δ) satisfying CE¯IE¯=Id is a graph embedding (inclusion).

Since the cut operation only removes edges from N, our results will only explicitly apply when considering subnetworks MN which have the same number of nodes. This assumption is convenient but not restrictive; if M=(V,E\E¯,η) is a subnetwork of N with V′ ⊂ V, then we may add the missing nodes to M′ and consider M=(V,E\E¯,η). A missing node uV\V′ is completely disconnected from every other node; its state is fixed and plays no role in the dynamics. The dynamics of M′ and M are therefore identical.

We outline the main ideas of this section. Our goal is to relate the dynamics of network N at a parameter pP(N) with dynamics of subnetwork M at a parameter qP(M). In general, there is no such relationship as cutting edges will result in a change in dynamics. However, there are parameters p where one or more edges play no role in the dynamics. This happens when an edge is always active or always inactive, that is, one of the functions fuv is constant. We call the corresponding edge uv an output inessential edge. In the context of Boolean functions, such function fuv has been called a degenerate [50] or non-observable [45] function. In addition, even when fuv is non-constant, there may be cases where the edge uv never independently causes a change at a target node. These will be called input inessential edges (see Definition 5.2 below). Clearly, at a parameter pP(N), there can be multiple edges of both types and we expect that cutting any subset of these edges would result in a network M with the same, or similar, dynamics.

However, there are important differences between these two types of edges. At a parameter where we remove only input inessential edges from N to create subnetwork M, the thresholds corresponding to cut edges do not affect the dynamics. As a consequence, the direction of edges in pairs of domains straddling such a threshold is the same and we can combine these pairs to a single domain (see Figure 3). This operation results in semi-conjugacy between the dynamics of X(N) and X(M), described in Theorem 5.4.

Figure 3
www.frontiersin.org

Figure 3. Maps of edges in STG(N, p) under the collapse map μe. The gray regions indicate (right) the layer Luv about uv in the state transition graph of N, and (left) the collapse map of the layer, μe(Luv), in the state transition graph of Ce(N). Each row represents a case from Proposition 6.1 that relates how the arrows in STG(N, p) are altered under the collapse map. In Case 1, either both undashed arrows or both dashed arrows are in STG(N, p), but not both.

On the other hand, at parameters where we remove output inessential edges, we find that the result can be strengthened in two important directions. First, the dynamics at pP(N) and the dynamics at the corresponding parameter Φ(p)P(M) are conjugate, rather than semi-conjugate. In fact, we will identify a subgraph of X(N) that is isomorphic to X(M) (see Figure 4). More importantly, we show that the map Φ:P(N)P(M) has a collection of well-defined right inverses with disjoint images. Each inverse is a graph embedding of P(M) into a subgraph of P(N), and the images are mutually disjoint. Therefore not only dynamics, but parameterized dynamics of M is embedded inside parameterized dynamics of P(N). Furthermore, this dynamics is embedded multiple times within the parameterized dynamics of P(N).

Figure 4
www.frontiersin.org

Figure 4. The (OFF,ON)-attractor X(OFF,ON). (A) Projection of X(N) into two dimensions; the subspace Xu(OFF,ON) × Xv(OFF,ON), outlined in bold, is an attractor in X(N). The dashed arrows between states in STG(N, p) are implied by the fact that pP(N;OFF,ON). The solid arrows represent transitions that are dependent on the specific choice of pP(N;OFF,ON). Boundaries corresponding to edges in OFF and ON are labeled with their corresponding edges. Here, T(u;ON) = {z1}, T(u;OFF) = {w1, w2}, T(v;ON) = {z2, z3}, and T(v;OFF) = ∅. (B) STG(M, Φ(p,OFF,ON)) for network M=CE¯(N) is isomorphic to the subgraph of STG(N, p) contained in X(OFF,ON).

We now proceed with precise description of inessential edges.

Definition 5.2. Let p=(f,θ)P be a parameter.

• The edge uvE is output-off inessential at p if fuθu(v)0, that is, when the monotone Boolean function corresponding to uv is always off, and output-on inessential at p if fuθu(v)1, that is, when the monotone Boolean function corresponding to uv is always on. If uv is neither output-off nor output-on inessential, then uv is output essential.

• The edge wuE is input essential at p if there is an i ∈ {1, …, mu} and a b ∈ 𝔹S(u) such that fui(b)=¬fui(b+ew) where ew ∈ 𝔹S(u) is defined by

eww=1   evw=0  for  vw.

Otherwise, the edge wuE is input inessential.

• An edge uvE is essential at p if it is both input and output essential and inessential otherwise. We say that the parameter p is output or input inessential if there is an edge which is output or input inessential at p, respectively.

While the output inessential edges uv transmit constant information to node v, the input inessential edge wu does not affect the node u in the sense that if u changed state, there must be an input node w′ ≠ w that also changed state.

Example: To illustrate the input and output inessential edges consider PG(y) from Figure 1C. The essential parameters are II (logical function AND) and V (logical function OR). Functions I and VI are constant and thus both input and output inessential; I is output-off inessential, and VI is output-on inessential. Note that the function III copies the value of the input ¬X; this implies that the edge xy is input essential, but the edge zy is input inessential. Similarly, function IV makes xy input inessential but zy is input essential. At both parameters III and IV, the output edge yz is output essential.

In parameter factor graph PG(x) in Figure 1A, the node B is essential, while both A and C are both input and output inessential.

Finally, in parameter graph PG(z) only the nodes 4 and 9 are essential, all others are inessential.

In the following exposition, it will be easier to consider the cutting of input inessential and output inessential edges independently, that is, E¯ will either consist of a single input inessential edge or a set of output inessential edges. Since the cut edges E¯ can be decomposed into these groups, and because we show in Proposition A4 that maps defined on these independent groups commute, the relationship between the dynamics of N and CE¯(N) can be described for an arbitrary collection of inessential edges E¯.

We define the set of parameter nodes in pP(N) where it is possible for the dynamics to be related to a parameter node qP(M) by cutting a single input inessential edge e or a set of output inessential edges. For a given set of nodes SV let T(u; S) = T(u)∩S.

Definition 5.3. Let eE be an edge uv. Then

• Let Pin(e)P(N) be a set of parameters at which the edge e is input inessential.

• Let P(OFF,ON)P(N) be the set of parameters such that

1. each edge eOFF is output-off inessential at p,

2. each edge eON is output-on inessential at p, and

3. for every uV, the edges in ON are ranked first by θ and the edges in OFF are ranked last by θ:

θu(T(u;ON))<θu(T(u;E\(OFFON))<θu(T(u;OFF)).    (7)

Note that POFF(e)PON(e)=, but that Pin(e)P(OFF,ON) may not be empty as there can be parameters at which a given edge e is both input and output inessential. Note further that it is the last condition (3) for output inessential edges that motivated us to define P(OFF,ON) for a set rather than for a single edge as in the input inessential case.

We define in Section 5.1 two projections. First,

Φin(·;e):Pin(e)P(Ce(N))

that relates parameters with the same dynamics when we cut a single input inessential edge eE¯ from N. Second, consider the case when E¯=OFFON consists of (several) output inessential edges. We define a projection map

Φ(·;OFF,ON):P(OFF,ON)P(COFFON(N))

that relates parameters with the same dynamics when we cut a collection of output inessential edges. Importantly, as we show in Proposition 8.4, these two projections commute:

Φin(·;e)Φ(·;OFF,ON)=Φ(·;OFF,ON)Φin(·;e)Φin(·;e)Φin(·;ê)=Φin(·;ê)Φin(·;e).

The following two theorems are the main results of this section, establishing a correspondence between the dynamics of the networks N and CE¯(N).

Theorem 5.4. Let eE be an input inessential edge and pPin(e) be an input inessential parameter. The projection Φin(·;e) satisfies the following.

1. There is a surjective map μe:X(N) → X(Ce(N)) such that the target point map F0(·;Φin(p),Ce(N)) is semi-conjugate to F0(·;p,N), that is, the following diagram commutes

yes

2. The Morse graph MGin(p), Ce(N)) is a subgraph of MG(p, N).

3. There is a one-to-one correspondence between the Morse nodes labeled FP that contain fixed points of the dynamics.

The semi-conjugacy of the dynamics is strengthened to conjugacy when every cut edge is output inessential so that E¯=OFFON.

Theorem 5.5. Let E¯=OFFONE and pP(OFF,ON) be an output inessential parameter. The projection Φ(·;OFF,ON) has a collection of right inverses {Ψ(·;ζQ,ζR,f^)}(ζQ,ζR,f^) indexed by order parameters ζQ ∈ Θ(OFF) and ζR ∈ Θ(ON), and anchoring logics f^A(N;OFF,ON) (Definition 7.5). For each choice (ζQ,ζR,f^)

1. The target point map F0(·;Φ(p),CE¯(N)) is conjugate to F0(·;p,N) restricted to a subset X(OFF,ON) ⊂ X(N), that is, the following diagram commutes

yes

Consequently, the map ρOFF,ON is an embedding of the state transition graph STG(X(CE¯(N)),Φ(p)) into STG(X(N), p).

2. The Morse graph MG(Φ(p),CE¯(N)) is a subgraph of MG(p, N). The only Morse nodes of MG(p, N) that do not correspond to a node in MG(Φ(p),CE¯(N)) must be labeled PC and have a successor node in the Morse graph.

3. Φ(·;OFF,ON)Ψ(·;ζQ,ζR,f^)=Id;

4. Ψ(·;ζQ,ζR,f^):P(CE¯(N))P(N;OFF,ON) is a graph embedding.

In the remainder of the section, we will build the machinery for the proofs of Theorems 5.4, 5.5, to be found in Sections 6, 7, respectively.

5.1 The projection maps Φin and Φ

In this section, we define the projection maps

Φin(·;e)):Pin(e)P(Ce(N))Φ(·;OFF,ON): P(OFF,ON)  P(CE¯(N)).

where the set of cut edges is E¯={e} in the first case and E¯=OFFON in the second.

Given a subset of edges E′ ⊂ E, it is useful to define

S(u;E):={wS(u;N)|wuE}  and  
T(u;E):={vT(u;N)|uvE}    (9)

to be the set of source and target nodes of u which correspond to edges in E′, respectively.

To define either of the projections Φin, Φ for given parameter p=(f,θ)P(N), we need to construct a subnetwork parameter (g,ϕ)P(CE¯(N)).

The idea for the construction of the order parameter ϕu from θu is simple: We define ϕu so that the ordering of the uncut edges is the same as the ordering given by θu. Explicitly, for (g, ϕ) = Φ((f, θ);OFF,ON) where the set E¯=OFFON could have more than one element, we proceed as follows. For each uV and vT(u), define

#u(v):=|{i<θu(v)|θu-1(i)T(u;E¯)}|    (10)

to be the number of out-edges of u with rank less than θu(v) which are cut from N. The u-order parameter is defined by

ϕu(v)=θu(v)-#u(v).    (11)

For (g, ϕ) = Φin((f, θ);e) we proceed in the same way realizing that E¯={e} has a single element.

To construct a gL(CE¯(N)) from fL(N), we will replace inputs that correspond to edges in E¯ in function f by constant inputs. If the edge is input inessential at parameter p, we can replace this input by either 0 or 1; since the edge is input inessential, the value of g does not depend on the value that is selected. On the other hand, if the edge is output inessential, the values of these constants depend on whether the cut edge e = (wu) belongs to set ON, whether it belongs to set OFF, and the sign of the edge. We start with this latter case. Assume E¯=OFFON and let p=(f,θ)P(OFF,ON). We construct a logic parameter gL(CE¯(N)) from f as follows. For each wS(u;E¯), let

βwu(OFF,ON):={0,   if δwu=1  and  wuOFF       or δwu=-1  and  wuON1,   if δwu=1  and  wuON       or or δwu=-1  and  wuOFF.    (12)

That is, βwu is the constant input from w to u based on whether the edge wuOFF and therefore inactive or wuON and therefore active. Let βu=(βwu)wS(u;E¯) be the collection of these inputs. The function guϕu(v) is constructed by evaluating the function fuθu(v). In general, there are fewer inputs to gu then to fu. So, for a given input to gu, its value is computed by evaluating fu on the same input with missing inputs replaced with βu. For each bS(u;CE¯(N)), we define

guϕu(v)(b):=fuθu(v)(b,βu).    (13)

The (OFF,ON)-projection of (f,θ)P(N) onto P(CE¯(N)) is defined to be

Φ((f,θ);OFF,ON):=(g,ϕ).

Assume now E¯={e} and let p=(f,θ)Pin(e). Let e = (wu). Let βwu{0,1} be arbitrary. We then define guϕu(v)(b) as in Equation 13. Because wu is input inessential, guϕu(v) is independent of the choice of βwu. Then, the Φin(·;e) projection of (f,θ)P(N) onto P(Ce(N)) is defined to be

Φin((f,θ);e):=(g,ϕ).

Remark 5.6. An astute reader will notice that the definition of Φin and Φ only differs in choice of fixed input β; in Equation 12 for output inessential parameters, the choice is dictated by the membership of the cut edge in ON vs. OFF, while for input inessential parameters β can have arbitrary value since this value does not affect the target node. This can be expressed by

Φin(p;e)=Φ(p;{e},)=Φ(p;,{e}),    (14)

that is, the Φin(p; e) agrees with Φ(p) if we chose to designate the edge e as either belonging to ON or to OFF set of edges.

Remark 5.7. Observe that although we designated the domain of Φ as the set of parameters in P(OFF,ON), the map Φ is well-defined on the entire parameter space P(N). Using relationship (Equation 14), the map Φin is also defined on P(N). However, there is only a well-predicted relationship between the dynamics of N and CE¯(N) for E¯-cuts that are composed entirely of inessential edges. For E¯-cuts involving essential edges, the relationship between the dynamics of N and the dynamics of the cut network is unknown.

In Section 8, we provide some algebraic properties of Φ. In particular, in Theorem 8.1, we show that the V-dual automorphism DV:P(N)P(N), which is a result of the switch map σV that changes the signs of all edges incident to all nodes, commutes with Φ when the identities of OFF and ON edges are switched: letting E¯=E¯1E¯2,

DVΦ(·;E¯1,E¯2)=Φ(·;E¯2,E¯1)DV.

We also prove that Φin(·;e) commutes with DV.

6 Input inessential parameters

6.1 Proof of Theorem 5.4

Recall that Pin(e)P(N) denotes the set of parameters p such that the edge e = uv is input inessential. Define the layer LuvX(N)

Luv:={xX|xu{θu(v)-1,θu(v)}}

to be the set of states which border the threshold corresponding to uv. Note that Luv has “thickness” 2 in u direction as all states x have xu with one of two values. See the gray double rectangles in the right column of Figure 3 as an illustration of a layer surrounding a threshold.

Given an edge e = uv, let μe:X(N) → X(Ce(N)) be the map which collapses Luv to a thickness 1 layer with single u-state:

μe(·;θ):=(μwe)wV          μwe(xw)=xw     for  wu                        μue(xu):={xu,   if xu<θu(v)xu-1,   if xuθu(v).

An illustration of this collapse is given by comparing the single gray rectangles in the left column of Figure 3 to the double gray rectangles in the right column. The left column is a portion of the state space of Ce(N), while the right column is a portion of the state space of N.

In Proposition 8.3, we show that μe commutes with λV, the reflection bijection defined at the beginning of Section 4, as is suggested by Theorem 8.1 which says Φin and DV commute.

Proof of Theorem 5.4 (1). Let p=(f,θ)Pin(e) with e = uv. To simplify notation, let M = Ce(N).

For wV\{u, v}, pw = qw and μwe is the identity so that the target point maps commute with the collapse map

μweFw0(·;p,N)=Fw0(·;q,M)μwe.

Next, we consider node u. To show that the input maps Bu to node u (used to define the target point map in Section 2.3) for both networks agree, let xX and wS(u; M), that is, there is an edge wu. If wu, then μwe(xw)=xw and θw = ϕw so that Bwu(x;θ,N)=Bwu(μe(x);ϕ,M). If w = u, that is, there is a self-edge uu, then, recalling the definition of ϕu Equation 11 and comparing to μue, we have ϕu(u)=μue(θu(u)). Consequently,

Buu(x;θ,N)=Buu(μe(x);ϕ,M).

If v = u, we need to compare the logic parameters fu and gu. By assumption, fui(b) is independent of bu since uv is input inessential at p. Since the inputs to fu and gu agree,

fuθu(z)(Bu(x;θ,N))=guϕu(z)(Bu(μe(x);ϕ,M))  for  all  zT(u;N)\{v}.    (15)

If fuθu(v)(Bu(x;θ,N))=0, then Equation 15 and the definition of F0 imply that the u target point maps agree on x and μe(x), that is, Fu0(x;p,N)=Fu0(μe(x);q,M). Moreover, fuθu(v)(Bu(x;θ,N))=0 implies Fu0(x;p,N)<θu(v), so that Fu0(x;p,N)=μue(Fu0(x;p,N)). Similarly, if fuθu(v)(Bu(x;θ,n))=1, then

Fu0(μe(x);q,M)=Fu0(x;p,N)-1=μue(Fu0(x;p,N)),

as desired.

Finally, we consider node v, assuming vu. For all wu, μwe is the identity and ϕw = θw, so that Bwv(x;θ,N)=Bwv(μe(x);ϕ,M). Since fv(b) is independent of bu, we have

fv(Bv(x;θ,N))=gv(Bv(μe(x);ϕ,M))

which implies μve(Fv0(x;p,N))=Fv0(μe(x);q,M) for all xX since μve is the identity. This completes the proof.

     

Theorem 5.4 (2) follows from the semi-conjugacy: For any path τ̄ in X(Ce(N)), there is at least one path τ in X(N) with μe(τ)=τ̄.

To prove Theorem 5.4 (3), we need the following Proposition that shows that most of the edges in STG(N, p) can be recovered from STG(Ce(N), Φin(p)). Each case in the proposition is illustrated in Figure 3.

Proposition 6.1. Consider a single edge E¯={e=uv}. Let pPin(N;e), and q = Φin(p; e). Let xx¯STG(Ce(N),q). If x,x¯μe(Luv), then there are unique y,y¯X(N) with μe(y) = x and μe(y¯)=x¯ such that yy¯STG(N,p).

On the other hand, if xμe(Luv) or x¯μe(Luv), then there are four cases.

1. If x=x¯, then there there are exactly two y1, y2X(N) with μe(y1) = μe(y2) = x. Either y1y2, y2y2STG(N, p) or y2y1, y1y1STG(N, p).

2. If xμe(Luv), then there is a unique edge yy¯STG(N,p) with μe(y) = x and μe(y¯)=x¯.

3. If x,x¯μe(Luv) and xx¯, then there are two edges yiy¯iSTG(N,p) with μe(yi) = x and μe(y¯i)=x¯ for i = 1, 2.

4. If xμe(Luv) and x¯μe(Luv), then there is a unique edge yy¯STG(N,p) with μe(y) = x and μe(y¯)=x¯. In addition, the state y=y-(x¯-x) has an edge y′ → ySTG(N, p).

Proof. First suppose x,x¯μe(Luv) and xx¯. We start by noting that the map μwe for wu is an identity on a finite set Xw and it is strictly monotone in that it satisfies

ημwe(zw1)>ημwe(zw2)ηzw1>ηzw2    (16)

for η ∈ {±1}. Furthermore, μue, which is not an identity, satisfies (Equation 15) for all pairs z1,z2Luv, and satisfies the forward implication in Equation 15 when z1Luv or z2Luv.

Since μe is injective on X(N)\Luv, there are unique y,y¯X(N) with μe(y) = x and μe(y¯)=x¯. Since x¯F(x;q,Ce(N)), there is a unique node wV (recall N = (V, E, δ)) and η ∈ {±1} with x¯w=xw+η and therefore y¯w=yw+η. Applying Theorem 5.4 1 and Definition 2.2, we have

ημwe(Fw0(y;p,N))=ηFw0(x;q,Ce(N))>ηxw=ημwe(yw).    (17)

Using Equation 15 with zw1=Fw0(y;p,N) and zw2=yw, we conclude that

ηFw0(y;p,N))>ηyw,

which implies yy¯STG(N,p) as desired.

To complete the first claim of the proof, now suppose x,x¯μe(Luv) and x=x¯. Since μe is injective on X(N)\Luv, there is a unique yX(N) with μe(y) = x. By Definition 2.2,

F0(x;q,Ce(N))=x.

Since the target point F0(x;q,Ce(N))μe(Luv), the map μe is injective on F0(y;p,N), and therefore by Theorem 5.4 (1), we have

μe(F0(y;p,N))=F0(x;q,Ce(N))=x=μe(y),

implying F0(y;p,N)=y, which indicates a self-edge at ySTG(N, p) as desired.

Next, we consider the four cases of xμe(Luv) or x¯μe(Luv).

Case 1 (x=x¯). The pre-image of x is exactly two states {y1, y2} = (μe)−1(x) with

yu1+1=θu(v)=yu2    and    yw1=yw2  for  wu.

Since uv is input inessential, Fv0(y1;p,N)=Fv0(y2;p,N). For wv, if wT(u; N), θu(w)<yu1 if and only if θu(w)<yu2 so that the inputs Bw(y1; N) = Bw(y2; N). Consequently Fw0(y1;p,N)=Fw0(y2;p,N). Since this holds for all nodes, F0(y1;p,N)=F0(y2;p,N). We also have

μe(F0(yi;p,N))=F0(x;q,Ce(N))=x

so that either F0(yi;p,N)=y1 for both i = 1, 2, or F0(yi;p,N)=y2 for both i = 1, 2. This shows exactly one of y1y2, y2y2STG(N, p) or y2y1, y1y1STG(N, p) holds.

Case 2 (xμe(Luv) and x¯μe(Luv)). There is a unique y with μe(y) = x. Let w be the unique node with x¯w=xw+η where η ∈ {±1}. Then by Theorem 5.4 (1) and Definition 2.2, the Equation (17) holds. Using Equation (16) this implies that ηFw0(y;p,N)>ηyw so there is an edge yy¯STG(N,p) with y¯w=yw+η and thus μe(y¯)=x¯.

Case 3 (x,x¯μe(Luv) and xx¯). Let w be the unique node with x¯w=xw+η where η ∈ {±1}. Note that we must have wu (see Figure 3). The pre-image of x and x¯ each consist of two states, {y1, y2} = (μe)−1(x) and {y¯1,y¯2}=(μ2)-1(x¯) with

yu1+1=y¯u1+1=θu(v)=yu2=y¯u2.

Then, for both i = 1, 2, we have

ημwe(Fw0(yi;p,N))=ηFw0(x;q,Ce(N))>ηxw=ημwe(yi).

Using Equation 15 applied to wu we have ηFw0(yi;p,N)>ηyi so that yiy¯iSTG(N,p).

Case 4 (xμe(Luv) and x¯μe(Luv)). There is a unique y¯X(N) with μe(y¯)=x¯ and two states y1,y2Luv with μe(yi) = x. Let η ∈ {±1} such that x¯u=x+η. For both i = 1, 2, we have

ημue(Fu0(yi;p,N))=ηFu0(x;q,Ce(N))>ηxu=ημue(yi).    (18)

Let y~iX(N) be the state defined by

y~ui=yui+η         y~wi=ywi  for  wu.

Equation (18) together with Equation (16) implies that yiy~iSTG(N,p). For one choice of i, say i = 1, y~1Luv so that y~1=y2. On the other hand, y~2Luv and μe(y~2)=x¯. Set y¯:=y~2, y: = y2, and y′ = y1. Noting that (x¯-x)u=η and (x¯-x)w=0 for wu, we have y=y-(x¯-x) (see Figure 3).     

Theorem 5.4 (3) is obtained from Proposition 6.1 as follows. When the Morse graph MG(Φ(p),CE¯(N)) has an FP at state xLuv, then there is unique y with μE¯(y)=x which is an FP in MG(p, N). On the other hand, if xLuv, then Case 1 of Proposition 6.1 shows that there is a FP y in MG(p, N) with μE¯(y)=x.

7 Output inessential parameters

7.1 The projection map Φ preserves dynamics

In this section, we begin the proof of Theorem 5.5 with the proof of point (1). Recall that an assumption of the theorem is that the E¯-cut is composed entirely of output inessential edges, some of which may also be input inessential. The following definition identifies the attracting region X(OFF,ON) ⊂ X(N), which will turn out to be isomorphic to X(CE¯(N)).

Definition 7.1. Let E¯=OFFONE and p=(f,θ)P(N;OFF,ON). The (OFF,ON)-attractor of the STG X(N) is the subset X(OFF,ON) ⊂ X(N) given by

X(OFF,ON):=uVXu(OFF,ON)

where for each network node uV

Xu(OFF,ON):={|T(u;ON)|,|T(u;ON)|+1,,|T(u)|-|T(u;OFF)|},

using Equation (9).

Note that X(OFF,ON) consists of the set of contiguous states x such that the value of fuv(Bu(x))=0 for all edges e:uv with eOFF and the value of fuw(Bu(x))=1 for all edges e:uw with eON (see Figure 4). Note that in the Figure 4, the edge uv corresponding to the smallest threshold θu(v) = 1 of u belongs to ON, while the two edges that correspond to largest two thresholds belong to OFF. As a result, the values of the multi-valued function gu and the target point map Fu0 lie within the u-projection of the outlined area Xu(OFF,ON). A similar argument for the v-direction implies that all components of F0 lie in Xv(OFF,ON). Therefore, the asynchronous dynamics of F is attracted to X(OFF,ON), as indicated by the arrows.

As suggested by the name, for pP(OFF,ON), the (OFF,ON)-attractor is a global attractor of the multi-level dynamics. The next proposition proves this by showing that the image of the target point map F0 is contained in X(OFF,ON). As a consequence, all recurrent dynamics of F are contained in X(OFF,ON). We will make use of the input map Bu:XBS(u) introduced at the beginning of Section 2.3.

Proposition 7.2. Let E¯=OFFONE and pP(N;OFF,ON). Then for all xX(N), F0(x;p,N)X(OFF,ON).

Proof. Let uV and p = (f, θ). For each vT(u;ON), we have fuθu(v)1. Consequently, for any state xX,

Fu0(x;p)=|{fuv(Bu(x))=1}||T(u;ON)|=minXu(OFF,ON).

For each vT(u;OFF), we have fuθu(v)0 since uv is output-off inessential at p. Consequently, for any state xX,

Fu0(x;p)=|T(u;N)|-|{fuv(Bu(x))=0}||T(u;N)|-|T(u;OFF)|=maxXu(OFF,ON).

Since u was arbitrary, this proves the proposition.     

The idea of the proof of Theorem 5.5 (1) is to show that for the parameters in P(N;OFF,ON) the target points F0(N) of the (OFF,ON)-attractor are the same as the target points F0(CE¯(N)) of the cut network after relabeling. An immediate consequence is that the STG for CE¯(N) is graph isomorphic to the STG of the (OFF,ON)-attractor (Figure 4). We proceed to define the relabeling map ρOFF,ON, which appears in the commutative diagram (Equation 8).

Definition 7.3. The relabeling map ρOFF,ON:X(OFF,ON)X(CE¯(N)) is

ρOFF,ON(x)=(ρuOFF,ON(xu))uV,    ρuOFF,ON(xu)=xu-|T(u;ON)|.

We now show that the value of the input map for N at x agrees with the value of the input map for CE¯(N) at ρOFF,ON(x).

Lemma 7.4. Let E¯=OFFONE, (f,θ)P(N;OFF,ON), and (g, ϕ) = Φ((f, θ);OFF,ON) be the (OFF,ON)-projection of (f, θ). For each state xX(OFF,ON), uV, and wS(u; N)

Bwu(x;N)={βwu,   if wuE¯Bwu(ρOFF,ON(x);CE¯(N)),   if wuE¯,

where we suppressed the dependency βwu=βwu(OFF,ON) from Equation (12).

Proof. Let xX(OFF,ON). First suppose wuE¯. If wuON, then (f,θ)P(N;OFF,ON) implies by Equation (7) that θw(u) ≤ |T(w;ON)| ≤ xw. Consequently, by the definition of Bwu and βwu,

Bwu(x;θ,N)={0,   if δwu=-11,   if δwu=1=βwu.

If wuOFF, then (f,θ)P(N;OFF,ON) implies θw(u) > |T(w)|−|T(w;OFF)| ≥ xw. Consequently, by the definition of Bwu and βwu,

Bwu(x;θ,N)={0,   if δwu=11,   if δwu=-1=βwu.

This completes the proof for the case wuE¯.

Now consider an edge wuE¯. Since (f,θ)P(N;OFF,ON), Equation (7) is satisfied and the edges in ON are ranked first by θ. This implies #w(u) = |T(w;ON)|. In particular, we have

ϕw(u)=θw(u)-|T(w;ON)|=ρwOFF,ON(θw(u)).

Since ρwOFF,ON is monotonically increasing, we have xw < θw(u) if and only if ρOFF,ON(xw)<ρOFF,ON(θw(u))=ϕw(u). Since the sign of wu in N is the same as the sign of wu in CE¯(N), the lemma holds in the case wuE¯.     

We are now ready to prove the main result of this subsection.

Proof of Theorem 5.5 (1). Let p=(f,θ)P(N;OFF,ON) and q = (g, ϕ) = Φ(p;OFF,ON). To simplify notation, let ρ = ρOFF,ON and M=CE¯(N). Let xX(OFF,ON). We need to show that

ρ(F0(x;p,N))=F0(ρ(x);q,M).

First note that by Lemma 7.4 and the definition of g, we have

fuθu(v)(Bu(x);θ,N)=guϕu(v)(Bu(ρ(x));ϕ,M)

for each vT(u; M). Therefore, we have

ρu(Fu0(x;p,N))=|{fui(Bu(x;θ,N))=1 | i{1,,|T(u;N)|}||T(u;ON)|=|T(u;ON)|+|{gui(Bu(ρ(x);ϕ,M)=1 | i{1,,|T(u;M)|}||T(u;ON)|=|{gui(Bu(ρ(x);ϕ,M)=1i{1,,|T(u;M)|} }|= F0(ρ(x);q,M)

where the second equality follows from the fact that fuθu(v)1 when vT(u;ON). This shows that the diagram (Equation 8) commutes so that the target point maps are conjugate.

Since the target point maps are conjugate and the asynchronous dynamics F are completely determined by the target point maps, we conclude that STG(X(M), q) is isomorphic to STG(X(OFF,ON), p), a subgraph of STG(X(N), p).

     

Finally, we derive consequences of this result for the Morse graphs. Theorem 5.5 (1) implies that the only recurrent set of STG(X(N), p) which does not correspond to a recurrent set of STG(X(M), q) must be outside of the (OFF,ON)-attractor X(OFF,ON). Since X(OFF,ON) is the global attractor, these recurrent sets are represented as unstable Morse nodes in the Morse graph. Moreover, an FC cannot exist outside of X(OFF,ON) since all edges between states which are outside of X(OFF,ON) and adjacent in the u direction point toward X(OFF,ON). This argument proves Theorem 5.5 (2).

7.2 Embeddings of a subnetwork's parameter graph

In this section, we prove Theorem 5.5 (3) and (4) by constructing a collection of right inverses, {Ψ} to each projection Φ, each of which embeds the parameter graph PG(CE¯(N)) into PG(N) of the original network.

Given a parameter qP(CE¯(N)), in order to construct a parameter p = (f, θ): = Ψ(q), we need to first determine the order parameter θ. However, the construction of θ requires a choice of an ordering for the edges that have been cut. We therefore let ζOFF ∈ Θ(OFF) and ζON ∈ Θ(ON) be orderings of the sets OFF and ON, respectively. Let P(N;ζOFF,ζON)P(N;OFF,ON) be the subset of output inessential parameters p = (f, θ) such that the order parameter θ agrees with the orderings given by ζOFF and ζON:

ζuON(v)=θu(v)  for  vT(u;ON)       (19)
ζuOFF(v)=θu(v)-|T(u;E\OFF)|  for  vT(u;OFF).

We next discuss how to construct a logic parameter fL(N;ζOFF,ζON) for p = (f, θ) = Ψ((g, ϕ)).

We start by listing conditions we impose on map Ψ in order for it be the right inverse of Φ and to preserve parameter graph adjacency. Let b1𝔹S(u;CE¯(N)) and b2𝔹S(u;E¯), that is, b1 is an input vector with entries corresponding to the edges that exist in both networks and b2 is an input with entries for edges that exist only in N and are being cut.

1. fL(N;ζOFF,ζON) requires each edge in E¯ to be output inessential: for each input b,

fuθu(v)(b){0,   if uvOFF1,   if uvON.

2. Whenever uv is an edge in both N and CE¯(N), (recalling the definition of β from Equation 12) we will set

fuθu(v)(b1,b2)=guϕu(v)(b1)  when  b2=βu,  and      (20)
fuθu(v)(b1,b2)  is  independent  of  g  when  b2βu,    (21)

Condition (Equation 20) is necessary for f to map to g under Φ, that is, for Ψ to be a right inverse of Φ. As we explain below, condition (Equation 21) is necessary for Ψ to preserve parameter graph adjacency.

3. For each logic parameter gL(CE¯(N)), the logic parameter f = Ψ(g) that satisfies (Equations 20, 21) must be an MBF. As an example, consider g to be the parameter for which each edge in E¯ is output-off inessential

gui(b1)=0   for  each  u,i,  and  b1.

Then, this implies fuθu(v)(b1,b2βu)=0 since fuθu(v)(b1,βu)=0. On the other hand, taking g to be the parameter for which each edge in E¯ is output-on inessential

gui(b1)=1   for  each  u,i,  and  b1,

implies fuθu(v)(b1,b2βu)=1 since fuθu(v)(b1,βu)=1.

To see that the condition (Equation 21) is necessary for Ψ to preserve parameter graph adjacency, let g,g¯L(CE¯(N)) be logically adjacent. We wish for the corresponding logic parameter f = Ψ((g, ϕ)) and f¯=Ψ((g¯,ϕ)) to be logically adjacent. Since the values of fui(b1,b2=βu) and f¯ui(b1,b2=βu) will need to inherit the logical adjacency of g and g¯, there will be a unique b1 and unique i such that fui(b1,βu)f¯ui(b1,βu). For f and f¯ to be adjacent, this needs to be the only difference. Therefore, we need to require that for b2 ≠ βu, fui(b1,b2)=f¯ui(b1,b2), implying that fuθu(v)(b1,b2βu) must be independent of g.

In general, there are many embeddings of PG(CE¯(N)) into PG(N; ζOFF, ζON) because the values of fuθu(v)(b1,b2βu) are unconstrained by g. Assuming each embedding is mutually disjoint (which we will prove in Proposition 7.7), an embedding is uniquely specified by identifying the image of a single logic parameter ĝL(CE¯(N)). We say the image of ĝ, denoted f^, anchors the embedding; we call f^ an anchoring logic, and ĝ the anchor type. The anchor type ĝ is arbitrary, but for concreteness we will choose ĝL(CE¯(N)) to be the logic parameter at which every edge is output-off inessential:

ĝui(b)=0         for  each  u,i,  and  b.    (22)

Because the anchoring logic f^ must satisfy constraints (1)–(3), the only unconstrained values of f^ui are at inputs (b1, b2) where b2 is incomparable to βu.

Definition 7.5. Given the anchor type (Equation 22) and a disjoint union E¯=OFFON, the set of anchoring logics A(N;OFF,ON)L(N;OFF,ON) is the set of logic parameters f^ satisfying

f^ui(b1,b2)={0,   if i>|T(u;E\OFF)| or b2βu1,   if i|T(u;ON)| or b2βu    (23)

for each (b1,b2)𝔹S(u;CE¯(N))×𝔹S(u;E¯).

The first condition in each line of Equation 23 is required by constraint (1). The definition in the cases b2 ≺ βu and b2 ≻ βu is required by constraint (3). The case b2 = βu is a consequence of our choice of anchor type, ĝ.

Given an anchoring logic f^A(N;OFF,ON), let P(N;ζOFF,ζON,f^)P(N;ζOFF,ζON) be the set of parameters (f, θ) such that θ satisfies (Equation 19) and f satisfies

fui(b1,b2βu)=f^ui(b1,b2).    (24)

We define

Ψ(·;ζOFF,ζON,f^):P(CE¯(N))P(N;ζOFF,ζON,f^)

where (f, θ): = Ψ((g, ϕ)), and for each node u, (fu, θu) is defined as follows.

• The u-order parameter θu is defined so that the edges in ON are ranked first by θu and ordered according to ζuON. The edges in OFF are ranked last by θu and ordered according to ζuOFF. The remaining edges are between the edges in the set ON and the edges in the set OFF and ordered according to ϕu. Explicitly,

θu(v)={ζuON(v),   if uvON|T(u;E\OFF)|+ζuOFF(v),   if uvOFF|T(u;ON)|+ϕu(v),  otherwise.    (25)

• The u-logic parameter fu is defined so that the edges in OFF and ON are output-off and output-on inessential, respectively, and by Equations (20, 24). This can be summarized by

fuθu(v)(b1,b2)={guϕu(v)(b1),   if uvE¯  and  b2=βuf^uθu(v)(b1,b2),  otherwise.    (26)

We illustrate our construction of Ψ in Figure 5 for a factor graph with two sources and one target. See the caption for a detailed description.

Figure 5
www.frontiersin.org

Figure 5. Embedding of factor graphs. (A) The u-factor graph for a node u with two sources and one target as pictured in (D, E). Each u-parameter is represented by a rectangle. Inside each rectangle is the Boolean lattice BS(u) with each circle containing an input b = bvbw. Empty (filled) circles indicate inputs where the value of the logic parameter fu1(b)=0 (fu1(b)=1). The projection Φ(p; {vu}, ∅) is determined by the values of fu1 on the dashed circles since βu=βvu=0 in the first component of the input. The projection Φ(p; {vu}, {wu}) is determined by the values on the blue circles, since βu=βvuβwu=01 based on the selection of OFF = {vu},ON = {wu}. The capital letters label each parameter for reference. (B) The u-factor graph after cutting the edge vu. Using parameter D in (A) as the anchoring logic, setting OFF = {vu} and ON = ∅, Ψ maps this factor graph isomorphically to the subgraph given by parameters D-E-F in (A). (C) The u-factor graph after cutting both vu and wu. Using parameter D in (a) as the anchoring logic, setting OFF = {vu} and ON = {wu}, Ψ maps this factor graph isomorphically to the subgraph D-E in (A). Using parameter B in (A) as the anchoring logic, Ψ maps this factor graph ismorphically to the subgraph B-C in (A). (D, E) The edges are labeled “off” or “on” according to the choice of OFF and ON in the descriptions of (B, C), respectively.

Our first result on Ψ is that the constraints on the set of anchoring logics A(N;OFF,ON) are sufficient for Ψ to be well defined. That is, we verify that any function f defined by Equations (20, 24) is a valid logic parameter.

Proposition 7.6. For any choice of anchoring logic f^A(N;OFF,ON) and qP(CE¯(N)), Ψ(q;ζOFF,ζON,f^)P(N;ζOFF,ζON,f^) so that Ψ is well defined.

Proof. Let q = (g, ϕ) and (f,θ)=Ψ(q;ζOFF,ζON,f^). First, we show that fui is an MBF for each u and i. For vT(u;E¯), the function fuθu(v) is constant and therefore trivially an MBF.

Let vT(u;CE¯(N)). Let b = (b1, b2) and c = (c1, c2) be elements of 𝔹S(u;CE¯(N))×𝔹S(u;E¯) with bc.

• If b2 = βu = c2 then bc implies b1c1. Since guϕu(v) is an MBF and f satisfies (Equation 20),

fuθu(v)(b1,b2)=guϕu(v)(b1)guϕu(v)(c1)=fuθu(v)(c1,c2)

• If both b2 ≠ βu and c2 ≠ βu then, since the anchoring logic f^uθu(v) is an MBF and f satisfies (Equation 24),

fuθu(v)(b)=f^uθu(v)(b)f^uθu(v)(c)=fuθu(v)(c).

• Let b2 = βu and c2 ≠ βu. Then b2c2 implies βuc2 so that f^uθu(v)(c1,c2)=1. Therefore,

fuθu(v)(c1,c2)=f^uθu(v)=1fuθu(v)(b1,b2).

• Similarly, if b2 ≠ βu and c2 = βu, then b2c2 implies b2 ≺ βu so that f^uθu(v)(b1,b2)=0. Therefore,

fuθu(v)(b1,b2)=f^uθu(v)(b1,b2)=0fuθu(v)(c1,c2).

This shows that fui is an MBF.

Next, we show that fu satisfies the ordering condition (Equation 1). Since the anchoring logic f^ satisfies the ordering condition, when b2 ≠ βu

fui(b1,b2)=f^ui(b1,b2)f^ui+1(b1,b2)=fui+1(b1,b2)

and the ordering condition for fu is satisfied. Suppose b2 = βu. Then

fui(b1,b2)={1,   if i|T(u;ON)|0,   if i>|T(u;E\OFF)|gui(b1),  otherwise.

Since gu satisfies the ordering condition, this implies fu satisfies the ordering condition at (b1, b2).

It is straightforward to check that θ satisfies (Equation 19). Since we have shown that f is a valid logic parameter and f satisfies (Equation 24 by definition, (f,θ)P(N;ζOFF,ζON,f^).     

We next establish that the collection of co-domains {P(N;ζOFF,ζON,f^)}(ζOFF,ζON,f^) of the collection of maps Ψ(·;ζOFF,ζON,f^), are disjoint. The fact that distinct choices of ζOFF or ζON produce distinct sets of order parameters Θ(N; ζOFF, ζON) follows directly from Equation 19.

Proposition 7.7. 1. The set of anchoring logics A(N;OFF,ON) is non-empty.

2. If f^,ĥA(N;OFF,ON) are distinct anchoring logics then P(N;ζOFF,ζON,f^) and P(N;ζOFF,ζON,ĥ) are disjoint sets.

Proof. (1) It is straightforward to check that f^ defined by

f^ui(b1,b2)={0,   if i>|T(u;E\OFF)| or b2βu1,  otherwise

is a valid anchoring logic in A(N;OFF,ON).

(2) Suppose f^ and ĥ are distinct anchoring logics. Then, there is a node u and index i such that the values of f^ui and ĥui differ on an input (b1, b2). Since f^ and ĥ both satisfy (Equation 23), we must have that b2 and βu are incomparable, and hence b2 ≠ βu. Let fP(N;ζOFF,ζON,f^) and hP(N;ζOFF,ζON,ĥ). Since b2 ≠ βu and f and h satisfy (Equations 21, 26), we have fui(b1,b2)=f^ui(b1,b2) and hui(b1,b2)=ĥui(b1,b2). This shows

fui(b1,b2)=f^ui(b1,b2)ĥui(b1,b2)=hui(b1,b2)

so that fh. Since f and h are arbitrary, the statement holds.     

We are now ready to prove Theorem 5.5 (3) which states that Ψ is a right inverse of Φ. It is implied immediately from the following theorem which also identifies P(N;ζOFF,ζON,f^) as the image of Ψ.

Theorem 7.8. Fix ζOFF ∈ Θ(OFF), ζON ∈ Θ(ON), and an anchoring logic f^A(N;OFF,ON). The map Ψ(·;ζOFF,ζON,f^) is the inverse of Φ(·;OFF,ON) restricted to P(N;ζOFF,ζON,f^).

Proof. First, we show that Ψ is a right inverse of Φ. Let q=(g,ϕ)P(CE¯(N)) and p=(f,θ)=Ψ(q;ζOFF,ζON,f^). We wish to show that Φ ∘ Ψ(q) = q.

Let (g¯,ϕ¯)=Φ(p;OFF,ON). First, we verify that ϕ¯=ϕ. Let uV be a network node and vT(u;CE¯(N)). By Equation (25),

θu(v)=|T(u;ON)|+ϕu(v).

By Equation (11) in the definition of Φ,

ϕ¯u(v)=θu(v)-#u(v).

Since θu orders the edges in ON first and the edges in OFF last, for all w ∈ |T(u;ON)|, θu(w) < θu(v) and for all wT(u;OFF), θu(w) > θu(v). In particular, #u(v) = |T(u;ON)| so that

ϕ¯u(v)=|T(u;ON)|+ϕu(v)-#u(v)=ϕu(v).

This holds for each u and vT(u;CE¯(N)), that is, each node v in the domain of ϕu, so ϕ¯=ϕ.

Next, we verify that g¯=g. For a node uV, vT(u;CE¯(N)), and an input b𝔹S(u;CE¯(N))

g¯uϕu(v)(b)=fuθu(v)(b,βu)=guϕu(v)(b)

where the first equality follows from Equation (13) and the second equality follows from Equation (26). Since u and b were arbitrary, and vT(u;CE¯(N)) was an arbitrary target node of u in CE¯(N), we must have g¯=g.

Having shown Ψ is a right inverse, we now show that Ψ is a left inverse when Φ is restricted to P(N;ζOFF,ζON,f^). Let p=(f,θ)P(N;ζOFF,ζON,f^), q = (g, ϕ) = Φ(p;OFF,ON), and (f¯,θ¯)=Ψ(q;ζOFF,ζON,f^). We wish to show that Ψ ∘ Φ(p) = p.

First, we show that θ¯=θ. For vT(u;E\E¯), we have

θ¯u(v)=|T(u;ON)|+ϕu(v)=|T(u;ON)|+θu(v)-#u(v)=θu(v)

because #u(v) = |T(u;ON)|. For vT(u;ON),

θ¯u(v)=ζuON(v)=θu(v)

because by definition of P(N;ζON,ζOFF,f^) the order parameter θ satisfies (Equation 19) and therefore θu(v)=ζuON(v). Similarly, for vT(u;OFF),

θ¯u(v)=|T(u;E\OFF)|+ζuOFF(v)=θu(v)

because by definition θ orders the edges in OFF last and according to ζOFF. This covers all types of target nodes v of u. Since u was arbitrary, θ¯=θ.

Next, we show that f¯=f. For vT(u;E¯), since f¯ satisfies (Equation 24) and f satisfies (Equation 26), we have

f¯uθu(v)=f^uθu(v){0,   if vT(u;OFF)1,   if vT(u;ON)=fuθu(v).

Now consider vT(u;E\E¯). Let b1𝔹S(u;CE¯(N)) and b2𝔹S(u;E¯). For b2 = βu, we have

f¯uθu(v)(b1,βu)=guϕu(v)(b1)=fuθu(v)(b1,βu)

where the first equality follows from Equation 26. For b2 ≠ βu, we have

f¯uθu(v)(b1,b2)=f^uθu(v)(b1,b2)=fuθu(v)(b1,b2)

where the first equality follows from Equation 24, the definition of Ψ. The second equality follows from the definition of P(N;ζOFF,ζON,f^). This completes the proof that f¯=f.

Since (f¯,θ¯)=(f,θ), we have that Ψ is a left inverse of the restricted Φ. Since Ψ is both a left and right inverse, Ψ is the inverse of the restricted Φ.     

Finally, we prove Theorem 5.5 (4) which states that Ψ is a graph embedding of PG(CE¯(N)) into PG(N;OFF,ON).

Proof of Theorem 5.5 (4). Fix orderings ζOFF, ζON, and anchoring logic f^A(N;OFF,ON). We will show that Ψ(·;ζOFF,ζON,f^) maps PG(CE¯(N)) isomorphically into PG(N;ζOFF,ζON,f^). Since Theorem 7.8 shows that Ψ is invertible, it only remains to show that Ψ preserves parameter adjacency.

Let q = (g, ϕ) and q¯=(g¯,ϕ¯) be adjacent in PG(CE¯(N)). Let p = (f, θ) = Ψ(q) and p¯=Ψ(q¯). Let u be the unique node such that qu and q¯u are adjacent in the u-factor graph. Since Ψ is defined component-wise, for each wu, pw=p¯w.

To see that pu and p¯u are adjacent, first suppose qu and q¯u are order adjacent. Let π be the transposition of adjacent integers so that ϕu=πϕ¯u. Then, the adjacent transposition τ of {1, …, T(u; N)} is defined by

τ(i):={i,   if i|T(u;ON)|π(i),   if |T(u;ON)|<i|T(u;E\OFF)|i,   if i>|T(u;E\OFF)|

satisfies θu=τθ¯u. Moreover, since gui=g¯uτ(i), it follows that fui=f¯uτ(i). This shows that pu and p¯u are order adjacent.

Next, suppose qu and q¯u are logically adjacent. Since ϕu=ϕ¯u we have θu=θ¯u. Let i be the unique index and b𝔹S(u;CE¯(N)) be the unique input such that gui(b)g¯ui(b). Let v=ϕu-1(i). Then, by Equation 26, we have

fuθu(v)(b,βu)=gui(b)g¯ui(b)=f¯uθu(v)(b,βu).

On the other hand, for b1b, gui(b1)=g¯ui(b1) because g and g¯ are adjacent logic parameters in L(CE¯(N)). Therefore,

fuθu(v)(b1,βu)=gui(b1)=g¯ui(b1)=f¯uθu(v)(b1,βu).

On the input (b1, b2 ≠ βu), the value of fu and f¯u is determined by the reference logic f^ and thus they agree:

fuθu(v)(b1,b2)=f^uθu(v)(b1,b2)=f¯uθu(v)(b1,b2).

That is, (b, βu) is the unique input so that fuθu(v)(b,βu)f¯uθu(v)(b,βu).

Next we show that for wT(u; N)\{v}, fuw=f¯uw. If wT(u;E\E¯) then guϕu(w)=g¯uϕu(w) because gu and g¯u differ only at component i = ϕu(v). Therefore for such a w

fuθu(w)(b1,βu)=guϕu(w)(b1)=g¯uϕu(w)(b1)=f¯uθu(w)(b1,βu)

and for b2βu,

fuθu(w)(b1,b2)=f^uθu(w)(b1,b2)=f¯uθu(w)(b1,b2).

On the other hand, if wT(u;E¯) then

fuθu(w){0,   if wT(u;OFF)1,   if wT(u;ON)f¯uθu(w).

We conclude that θu(v) is the unique index such that fuθu(v)f¯uθu(v). That is, pu and p¯u are logically adjacent.

Since Ψ is invertible and adjacency of q and q¯ implies adjacency of p and p¯, we conclude Ψ is an isomorphism.     

8 Algebraic properties of the projection maps

Theorem 8.1. (a) Let E¯=E¯1E¯2E, where E¯1=ON and E¯2=OFF. The V-dual parameter map DV commutes with the projection map Φ(·;OFF,ON) when the identities of OFF and ON edges are exchanged:

DVΦ(·;E¯1,E¯2)=Φ(·;E¯2,E¯1)DV.

(b) Let E¯={e}. The V-dual parameter map DV commutes with the projection map Φin(·;e):

DVΦin(·;e)=Φin(·;eDV.

Proof. (a) Let p=(f,θ)P(N). Let

q=(g,ϕ)=DV(Φ(p;E¯1,E¯2))  and  q¯=(g¯,ϕ¯)=Φ(DV(p);E¯2,E¯1).

We will show that q=q¯.

First, we show that ϕ=ϕ¯. Recall (see Equation 10) that we defined the number of out-edges of u with rank less than θu(v)

#u(v;p,E¯)=|{i<θu(v)|θu-1(i)T(u;E¯)}|

where we now explicitly include the dependency on the parameter p = (f, θ). From Equation 4, 11, for each uvE\E¯ we have

ϕu(v)=|T(u;CE¯(N))|+1-(θu(v)-#u(v;p)),  and  ϕ¯u(v)=(|T(u;N)|+1-θu(v))-#u(v;DV(p)).

We therefore need to show that

|T(u;CE¯(N))|+#u(v;p)=|T(u;N)|-#u(v;DV(p)), or #u(v;DV(p))=|T(u;N)|-|T(u;CE¯(N))|-#u(v;p).

Note that |T(u;N)|-|T(u;CE¯(N))|=|T(u;E¯)| is the number of cut edges which have source u. To compute #u(v;DV(p)), let θ¯ be the order parameter for DV(p) and mu = |T(u; N)|. We have

#u(v;DV(p))=|{i<θ¯u(v)|θ¯u-1(i)|T(u;E¯)|}|                        =|{mu+1-i<θ¯u(v)|θ¯u-1(mu+1-i)|T(u;E¯)|}|                        =|{iθu(v)|θu-1(i)|T(u;E¯)|}|                        =|T(u;E¯)|-#u(v;p),

as desired.

Now we show g=g¯. Let (g~,ϕ~)=Φ(p;E¯1,E¯2). By Equation 13, for each uvE\E¯

g˜uϕ˜u(v)(b)=fuθu(v)(b,βu(E¯1,E¯2).

Since (g,ϕ)=DV((g~,ϕ~)),

guϕu(v)(b)=¬g~uϕ~u(v)(¬b)=¬fuθu(v)(¬b,βu(E¯1,E¯2))    (27)

where in the first equality, we have used ϕ¯u(v)=|T(u;CE¯(N))|+1-ϕu(v). Let (f~,θ~)=DV((f,θ)). By Equation 4,

f~uθ~u(v)(b1,b2)=¬fuθu(v)(¬b1,¬b2).

Since (g¯,ϕ¯)=Φ((f~,θ~),E¯2,E¯1), we have

g¯uϕ¯u(v)(b)=f~uθ~u(v)(b,βu(E¯2,E¯1))=¬fuθu(v)(¬b,¬βu(E¯2,E¯1)).    (28)

We have already shown that ϕ¯=ϕ. By inspecting the definition of βu in Equation 12, it is also clear that βu(E¯1,E¯2)=¬βu(E¯2,E¯1). Comparing the expressions for g in Equation 27 and g¯ in Equation 28, we conclude that g=g¯. This proves first part of the Theorem.

To prove the second part, we note that the only difference between Φ and Φin is that in the definition of logic parameter g, the input from the cut edge e is replaced by arbitrary value β, rather than a specific value that depend on whether the cut edge belongs to ON and OFF. Therefore, this construction proves also the second statement.     

Since the projection map Φ and the V-dual parameter map commute, it is natural to expect that the corresponding maps between STGs, ρOFF,ON, μE¯, and λV commute as well. In the following two propositions, we show that this is indeed the case.

The first proposition relates attractors X(E¯1,E¯2) (see 7.1) in the STG of the full network N and the STG of the cut network X(CE¯(N)) under the map λV.

Proposition 8.2. Let E¯=E¯1E¯2E. The following diagram commutes

yes

Proof. First, we prove that image of X(E¯1,E¯2) under λV(·;N) is X(E¯2,E¯1). Let xX(E¯1,E¯2). For each node uV, xuXu(E¯1,E¯2) implies

|T(u;E¯2)|xu|T(u;N)|-|T(u;E¯1)|.

Since λuV(xu;N)=|T(u;N)|-xu,

|T(u;E¯1)|xu|T(u;N)|-|T(u;E¯2)|

and therefore xuXu(E¯2,E¯1). This holds for each u which implies λV(x;N)X(E¯2,E¯1).

Next, we show

ρE¯1,E¯2=λV(·;CE¯(N))ρE¯2,E¯1λV(·;N).    (29)

Since λV is an involution and ρ is invertible, this will prove the proposition. Let xX(E¯1,E¯2) and uV. We have

ρuE¯1,E¯2(xu)=xu-|T(u;E¯2)|.

On the other hand,

[λuV(·;CE¯(N))ρuE¯2,E¯1λ(·;N)](xu)=[λuV(·;CE¯(N))ρuE¯2,E¯1](|T(u;N)|-xu)=[λuV(·;CE¯(N))](|T(u;N)|-xu-|T(u;E¯1)|)=|T(u;E\E¯)|-(|T(u;N)|-xu-|T(u;E¯1)|)=xu+|T(u;E\E¯)|-|T(u;N)|+|T(u;E¯1)|=xu-(|T(u;E¯)|-|T(u;E¯1)|)=xu-|T(u;E¯2)|.

Since u was arbitrary, the statement (Equation 29) holds, which finishes the proof of the proposition.

     

The second proposition relates the surjective map μe(N), used in relating state transition graphs for input inessential parameters in Theorem 5.4, and the map λV.

Proposition 8.3. Let p=(f,θ)P(N) and (f′, θ′) = DV(p) be the V-dual parameter of p. Let e = uv be an edge. The following diagram commutes

yes

Proof. We will prove

μe(·;θ)=λV(·;Ce(N))μe(·;θ)λV(·;N).

Since λV is an involution, this will prove the proposition.

Let M = Ce(N). For wu, μwe is the identity. Furthermore, λwV(·;M)=λwV(·;N) since Xw(M) = Xw(N). Since λwV is its own inverse, this shows

μwe(·;θ)=λwV(·;M)μwe(·;θ)λwV(·;N).

Now consider the u component and let xX. We have

(λuV(·;M)μue(·;θ)λuV(·;N))(xu)                  =|T(u;M)|μue(|T(u;N)|xu;θ)                  =|T(u;M)|{|T(u;N)|xu if |T(u;N)|xu<θu(v)|T(u;N)|xu1 if |T(u;N)|xuθu(v)                  ={xu1 if xuθu(v)xu if xu<θu(v)=μue(xu)

where the last line follows from

|T(u;M)|=|T(u;N)|-1  and  θu(v)=|T(u;N)|+1-θu(v).

     

Finally, we prove that projections commute and that successive projections are equivalent to projecting every edge simultaneously.

Proposition 8.4. The projection map Φ satisfies the following properties.

1. Φ(·;∅, {e2}) ∘ Φ(·;{e1}, ∅) = Φ(·;{e1}, {e2}) = Φ(·;{e1}, ∅) ∘ Φ(·;∅, {e2}).

2. Φ(·;{e1}, ∅) ∘ Φ(·;{e2}, ∅) = Φ(·;{e1, e2}, ∅) = Φ(·;{e2}, ∅) ∘ Φ(·;{e1}, ∅).

3. Φ(·;∅, {e1}) ∘ Φ(·;∅, {e2}) = Φ(·;∅, {e1, e2}) = Φ(·;∅, {e2}) ∘ Φ(·;∅, {e1}).

The projection map Φin satisfies

(4)  Φin(·;e1)Φin(·;e2)=Φin(·;{e1,e2})=Φin(·;e2)Φin(·;e1).

Finally,

(5)  Φin(·;e1)Φ(·;,{e2})=Φ(·;,{e2})Φin(·;e1)(6)  Φin(·;e1)Φ(·;{e2},,)=Φ(·;{e2},)Φin(·;e1)

Proof. (1): We first show that

Φ(·;,{e2})Φ(·;{e1},)=Φ(·;{e1},{e2}).

Let p=(f,θ)P(N), q = (g, ϕ) = Φ(p; {e1}, {e2}), and

q¯=(g¯,ϕ¯)=Φ(·;,{e2})Φ(·;{e1},)(p).

We will show that q=q¯.

First, we show that ϕ=ϕ¯. Recall from Equation 10 that

#u(v;p,E¯)=|{i<θu(v)|θu-1(i)T(u;E¯)}|

where we now explicitly include the dependencies on the parameter p = (f, θ) and the edges E¯. Let p~=(f~,θ~)=Φ(p;{e1},). By Equation 11,

ϕu(v)=θu(v)-#u(v;p,{e1,e2})ϕ¯u(v)=θu(v)-#u(v;p,{e1})-#u(v;p~,{e2}).

To prove ϕ=ϕ¯, we need to show that

#u(v;p,{e1,e2})=#u(v;p,{e1})+#u(v;p~,{e2}).

Applying Equation 11 to θ~ and using the definition of #u, we have

#u(v;p˜,{e2})=|{i<θ˜u(v) | θ˜u1(i)T(u;{e2}) }|                             =|{i<θu(v)#u(v;p,{e1}) | θu1(i+#u(v;p,{e1})T(u;{e2}) }|                             =|{i<θu(v) | θu1(i)T(u;{e2}) }|=#u(v;p,{e2}).

Since #u(v;p,E¯) counts the number of edges θu below uv, we have

#u(v;p,{e1})+#u(v;p,{e2})=#u(v;p,{e1,e2}).

We therefore conclude ϕ=ϕ¯.

Next, we show that g=g¯. Applying Equation 13,

guϕu(v)(b)=fuθu(v)(b,βu({e1},{e2})),  and  g¯ϕ¯u(v)(b)=f~uθ~u(v)(b,βu(,{e2}))=fuθu(v)(b,βu(,{e2}),βu({e1},)).

Since we have shown ϕ=ϕ¯ and βu({e1},{e2})=(βu(,{e2}),βu({e1},)) is clear from the definition of β, g=g¯. This completes the proof of the first equality in (1).

To show the second equality, we apply Theorem 8.1 and the fact that DV is an involution to the first equality:

Φ(·;{e1},{e2})=DVΦ(·;{e2},{e1})DV                                 =DVΦ(·;,{e1})Φ(·;{e2},)DV                                 =Φ(·;{e1},)DVDVΦ(·;,{e2})                                 =Φ(·;{e1},)Φ(·;,{e2}).

Both equalities in (2) follow from a similar argument for the first equality in (1). Statement (3) follows from applying Theorem 8.1 to (2). Statement (4) follows from statement (3) and a realization that the only difference between Φ and Φin is independence of the latter on division of cut edges into ON and OFF. Similar argument implies that statements (5) and (6) follow from (1) and (2).

     

9 Network example

We describe the embeddings of the parameter graph of negative feedback loop PG(NL) and parameter graph of the positive loop PG(PL) into parameter graph PG(N) of the network N in Figure 1A. Theorem 5.5 requires that the edges that are cut from N to arrive at a subgraph NL, or PL, are output inessential.

We first consider the negative loop which requires that we cut the edge e: = zy from N and therefore E¯={e}. There are two choices for edge e to be output inessential: this edge can be always ON and thus output-on inessential, or always OFF, and hence output-off inessential. Cutting this edge produces network Ce(N) = NL which consists of negative loop zxyz. Since each node in this loop has one input edge and one output edge, the parameter graph PG(NL) is a product of three copies of factor graph PG(x) with 27 elements

PG(NL)=PG(x)×PG(x)×PG(x).

There are two embeddings: If e is output-on inessential there is an embedding Ψ1:PG(NL)P(N;,{e})PG(N), and when e is output-off inessential, there is an Ψ2:PG(NL)P(N;{e},)PG(N). These are illustrated in Figure 1 and further explained below.

Checking the Table 3, the edge e is always ON in parameters that 7, 8, and 10 while always OFF in parameters 3, 5, and 6. Looking now at Table 2, the input from z being ON corresponds to first and third rows of the truth table, where the input from x determines the value of the MBF. The nodes I, II, and IV parameterize possible behaviors of the input edge xy. Similarly, considering Table 2, input z being OFF corresponds to second and fourth rows of the truth table. In this case, the nodes IV, V, and VI parameterize possible behaviors of the input edge xy.

Therefore, the embedding Ψ1(PG(NL)) is

(u,v,w){A,B,C}×{I,II,IV}×{7,8,10}.

The embedding Ψ2(PG(NL)) is

(u,v,w){A,B,C}×{IV,V,VI}×{3,5,6},

Note that the fact that these embeddings intersect does not contradict Theorem 7.7, since both of these embeddings have a single anchor logic.

We also note that the oscillatory behavior in the PG(NL) is supported by its central node. This node embeds into

(B,II,5)  and  (B,V,8)  by  Ψ1  and  Ψ2,  respectively.    (30)

We conclude that these two nodes in PG(N) support oscillatory behavior.

The embedding of PG(PL) into PG(N) requires that the edges eyx:xy and exz:zx are output inessential. The first condition corresponds to node A, when xy is output-off inessential, and to node C when xy is output-on inessential. The edge zx is output-on inessential at nodes 1, 2, and 3 and output-off inessential at nodes 10, 11, and 12. Therefore, there are four embeddings given by combinations of labels ON and OFF on edges eyx, exz. Evaluating the MBF at node y in Table 2 on the appropriate constant input from x as above, we obtain disjoint embeddings of PG(PL) into PG(N):

    (ON,ON):(u,v,w){C}×{III,V, VI}×{1,2,3}  (ON,OFF):(u,v,w){C}×{III,V,VI}×{10,11,12}  (OFF,ON):(u,v,w){A}×{I,II,III}×{1,2,3}(OFF,OFF):(u,v,w){A}×{I,II,II}×{10,11,12}

We note that the bistable behavior in the PG(PL) is only supported by its central node. This node embeds into

(C,V,2),(C,V,11),(A,II,2),  and  (A,II,11)  respectively.

We conclude that these four nodes in PG(N) support bistable behavior.

So far, we only considered cutting of output inessential edges which results in the embedding of the entire parameter graph. We now consider parameters at which the edges that are being cut are input inessential.

9.1 Input inessential parameters

We now describe input inessential parameters (u, v, w) ∈ PG(x) × PG(y) × PG(z) (see Figure 1) which support the dynamics of the negative loop NL. Such parameters must satisfy two properties:

1. support essential edges forming the negative feedback loop NL; and

2. the edge zy must be input inessential at y.

To satisfy the first condition, the only choice in PG(x) is B since choices A and C would disconnect the loop at the network node x. In PG(y), the only option is node III where the edge zy is input essential. At node z to satisfy the first condition, we can choose from nodes 4, 5, 8, and 9. Apart from essential nodes 4 and 9, at parameter nodes 5 and 8 the edge zx that participates in the negative loop is output essential.

Therefore at 4 parameters

(B,III,w)  where  w{4,5,8,9}

Theorem 5.4 applies. There is a semi-conjugacy of the dynamics on the state transition graph, and therefore, these parameters support oscillations generated by the negative feedback loop.

Similar arguments show that all parameters where at least one of the edges eyx and exz is input inessential, but the bistable loop is essential, will exhibit bistable dynamics.

We first consider the first condition that eyx is input inessential. This does not affect the choice of parameter in PG(x), so all three nodes are acceptable. In PG(y), the only MBF where eyx is input inessential, eyz is input essential, and where the edge ezy is output essential is the function IV. In PG(z), the nodes where the edge eyz is output essential are {2, 4, 9, 11}. Therefore for parameter combinations

(u,v,w)PG(N),  with  u{A,B,C},    v{IV},    w{2,4,9,11}    (31)

there is a semi-conjugacy of state transition graph dynamics onto dynamics of positive loop PL, which exhibits bistability.

The second condition that exz is input inessential is satisfied in PG(x) by functions A and C. At PG(y), three choices II, IV,V make eyz input essential, while choices {2, 4, 9, 11} in PG(z) make the edge eyz output essential. Therefore for parameters

(u,v,w)PG(N),  with  u{A,C},   v{II,IV,V},   w{2,4,9,11}    (32)

Theorem 5.4 also implies existence of bistability. Both edges eyx and exz are input in-essential on parameters where two collections (Equation 31) and (Equation 32) overlap.

It is now possible to investigate relative positions of parameters that support bistability and those that support oscillations. For instance, parameter (B, II, 5) supports oscillation (see Equation 30) and parameter (C, II, 4) supports bistability (see Equation 32). These parameters are not neighbors in the parameter space, but a simultaneous lowering of activation threshold of xy and lowering of activation threshold of zy, changes the dynamic behavior of the network N.

10 Discussion

In this article, we study a question of the relationship between network structure and its dynamics. In the DSGRN approach, the parameter space of switching ODE systems compatible with the network structure is first decomposed into a finite number of domains that correspond to multi-level Boolean systems [7] and then organized into a finite parameter graph. This supports a description of the dynamics by finite state transition graphs and allows us to formulate our question precisely. Because the finitness of this description avoids algorithmically difficult questions of existence of smooth conjugacies, this framework provides a tractable way to address this question. The price we pay is that the description of the dynamics is by necessity approximate and only captures features of the dynamics that are stable under parameter perturbations.

DSGRN analysis is in some sense complementary to the analysis of equations of mass action kinetics. Enzymatic chemical reactions in cellular biology are often modeled by saturating Hill functions. While DSGRN follows a switching system approximation of Hill functions by piecewise constant functions, thus emphasizing the saturating behavior of the Hill functions, the mass action polynomial approximation emphasizes the non-saturated part of the Hill function. General lack of experimentally determined values of parameters requires the development of combinatorial, often graph based, approaches for both types of approximations [5558].

The main result of the study describes how dynamics of a subnetwork manifests itself in the dynamics of a larger network. In systems biology, the concept of a network is central to understanding the function of a cell and its responses to the environment. Unfortunately, the networks studied by biologists are always incomplete, uncertain, and the parameters mostly unmeasurable. Yet the need for predictive models is very high. The results presented here suggest that the DSGRN approach can provide precise understanding of whether or not a network can produce distinct phenotypes (i.e., normal vs. cancer) and how robust are such predictions under network embedding, provided that the expectations imposed on predictive modeling are properly adjusted, that is, there is no expectation that our approach can reproduce precise time series trajectories of multiple genes.

A popular link between structure and function has been proposed in the theory of motifs [3941]. In this approach, a search over large databases of regulatory networks revealed statistically significant over-representation of certain 3-4 node subnetworks, called motifs. The hypothesis, supported by simple models and a compelling narrative, is that these motifs are over-represented because they serve a particular cellular function. However, there is limited evidence that these small subnetworks consistently work in the same way within the larger networks as they do in isolation.

Our present study provides some answer to these questions. We show that the dynamics of the subnetwork can be always found in the dynamics of the larger network, provided that it is “uncovered” by setting parameters of the additional edges of the larger network to be constitutively ON or OFF. As such, the larger network is always capable of reproducing dynamics of each of its subnetworks for an appropriate choice of parameters.

Another important conjecture in systems biology asserts that the reason why we observe large networks exhibiting dynamics that smaller networks can produce on their own (say oscillations) is that redundancy enhances robustness of the phenotype. Our observation that the parameter graph PG(M) of the subnetwork M is embedded in multiple copies in the parameter graph PG(N) of network N supports this assertion. We did not directly study the mutual position of these embedded subgraphs within the larger graph beyond showing they are disjoint. The robustness argument would be strengthened if these subgraphs lie close to each other in such a way that perturbation of a node in one may lead to a node in the other embedding with the same dynamics.

We believe that the proposed framework of DSGRN to study the relationship between network structure and its function (i.e., dynamics) will provide many important insights in systems biology.

Data availability statement

The original contributions presented in the study are included in the article, further inquiries can be directed to the corresponding author.

Author contributions

WD: Writing – original draft, Visualization, Investigation, Formal analysis. BC: Writing – review & editing. TG: Writing – review & editing, Supervision, Conceptualization.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This research was partially supported by NIH 5R01GM126555-01.

Conflict of interest

WD was employed by Immunetrics.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Katok A, Hasselblatt B. Introduction to Modern Theory of Dynamical Systems. Cambridge: Cambridge University Press. (1995). doi: 10.1017/CBO9780511809187

Crossref Full Text | Google Scholar

2. Newhouse S. The abundance of wild hyperbolic sets and non-smooth stable sets for diffeomorphisms. Publ Math IHES. (1979) 50:101–51. doi: 10.1007/BF02684771

Crossref Full Text | Google Scholar

3. Cummins B, Gedeon T, Harker S, Mischaikow K, Mok K. Combinatorial representation of parameter space for switching systems. SIAM J Appl Dyn Syst. (2016) 15:2176–212. doi: 10.1137/15M1052743

PubMed Abstract | Crossref Full Text | Google Scholar

4. Cummins B, Gedeon T, Harker S, Mischaikow K. Database of dynamic signatures generated by regulatory networks (DSGRN). In: Koeppl JFH, , editor. Computational Methods in Systems Biology - 2017. Cham: Springer (2017). p. 300–308. doi: 10.1007/978-3-319-67471-1_19

Crossref Full Text | Google Scholar

5. Gedeon T, Cummins B, Harker S, Mischaikow K. Identifying robust hysteresis in networks. PLoS Comput Bio. (2018) 14:e1006121. doi: 10.1371/journal.pcbi.1006121

PubMed Abstract | Crossref Full Text | Google Scholar

6. Gedeon T. Multi-parameter exploration of dynamics of regulatory networks. Biosystems. (2020) 190:104113. doi: 10.1016/j.biosystems.2020.104113

PubMed Abstract | Crossref Full Text | Google Scholar

7. Crawford-Kahrl P, Cummins B, Gedeon T. Joint realizability of monotone boolean functions. J Theor Comp Sci. (2022) 922:447–74. doi: 10.1016/j.tcs.2022.04.045

PubMed Abstract | Crossref Full Text | Google Scholar

8. Glass L, Kauffman S. Co-operative components, spatial localization and oscillatory cellular dynamics. J Theoret Biol. (1972) 34:219–37. doi: 10.1016/0022-5193(72)90157-9

PubMed Abstract | Crossref Full Text | Google Scholar

9. Glass L, Kauffman S. The logical analysis of continuous, non-linear biochemical control networks. J Theoret Biol. (1973) 39:103–29. doi: 10.1016/0022-5193(73)90208-7

PubMed Abstract | Crossref Full Text | Google Scholar

10. Thomas R. Regulatory networks seen as asynchronous automata: a logical description. J Theor Biol. (1991) 153:1–23. doi: 10.1016/S0022-5193(05)80350-9

Crossref Full Text | Google Scholar

11. Snoussi EH. Qualitative dynamics of piecewise-linear differential equations: a discrete mapping approach. Dyn Stab Syst. (1989) 4:565–83. doi: 10.1080/02681118908806072

Crossref Full Text | Google Scholar

12. de Jong H, Gouze J, Hernandez C, Page M, Sari T, Geiselmann J. Qualitative simulation of genetic regulatory networks using piecewise-linear models. Bull Math Biol. (2004) 66:301–40. doi: 10.1016/j.bulm.2003.08.010

PubMed Abstract | Crossref Full Text | Google Scholar

13. Tournier L, Chaves M. Uncovering operational interactions in genetic networks using asynchronous Boolean dynamics. J Theor Biol. (2009) 260:196–209. doi: 10.1016/j.jtbi.2009.06.006

PubMed Abstract | Crossref Full Text | Google Scholar

14. Gouzé JL. Positive and negative circuits in dynamical systems. J Biol Syst. (1998) 6:11–15. doi: 10.1142/S0218339098000054

Crossref Full Text | Google Scholar

15. Ironi L, Panzeri L, Plahte E, Simoncini V. Dynamics of actively regulated gene networks. Physica D. (2011) 240:779–794. doi: 10.1016/j.physd.2010.12.010

Crossref Full Text | Google Scholar

16. Edwards R, Machina a, McGregor G, van den Driessche P. A modelling framework for gene regulatory networks including transcription and translation. Bull Mathem Biol. (2015) 77:953–983. doi: 10.1007/s11538-015-0073-9

PubMed Abstract | Crossref Full Text | Google Scholar

17. Gedeon T, Harker S, Kokubu H, Mischaikow K, Oka H. Global dynamics for steep sigmoidal nonlinearities in two dimensions. Physica D. (2017) 339:18–38. doi: 10.1016/j.physd.2016.08.006

PubMed Abstract | Crossref Full Text | Google Scholar

18. Duncan W, Gedeon T, Kokubu H, Oka H, Mischaikow K. Equilibria and their stability in networks with steep sigmoidal nonlinearities. J Appl Dyn Syst. (2021) 20:2108–41. doi: 10.1137/21M1398331

Crossref Full Text | Google Scholar

19. Duncan W, Gedeon T. Stability and bifurcations of equilibria in networks with piecewise linear interactions. Inter J Bif Chaos. (2021) 31:2130032. doi: 10.1142/S0218127421300329

Crossref Full Text | Google Scholar

20. Abou-Jaoudé W, Monteiro P. On logical bifurcation diagrams. J Theor Biol. (2019) 466:39–63. doi: 10.1016/j.jtbi.2019.01.008

PubMed Abstract | Crossref Full Text | Google Scholar

21. Zaslavsky T. Signed graphs. Discr Appl Mathem. (1982) 4:47–74. doi: 10.1016/0166-218X(82)90033-6

Crossref Full Text | Google Scholar

22. Smith H. Monotone Dynamical Systems, An Introduction to the Theory of Competitive and Cooperative Systems. Providence, RI: American Mathematical Society. (1995).

Google Scholar

23. Gedeon T, Mischaikow K. Structure of the global attractor of cyclic feedback systems. J Dyn Diff Eq. (1995) 7:141–90. doi: 10.1007/BF02218817

Crossref Full Text | Google Scholar

24. Gedeon T. Cyclic Feedback Systems. Providence, RI: American Mathematical Society (1998). doi: 10.1090/memo/0637

Crossref Full Text | Google Scholar

25. Naserasr R, Rollová E, Sopena É. Homomorphisms of signed graphs. J Graph Theory. (2015) 79:178–212. doi: 10.1002/jgt.21817

Crossref Full Text | Google Scholar

26. Aracena J, Richard A, Salinas L. Number of fixed points and disjoint cycles in monotone Boolean networks. SIAM J Discr Mathem. (2017) 31:1702–25. doi: 10.1137/16M1060868

Crossref Full Text | Google Scholar

27. Naserasr R, Sopena E, Zaslavsky T. Homomorphisms of signed graphs: an update. Eur J Combinat. (2021) 91:103222. doi: 10.1016/j.ejc.2020.103222

Crossref Full Text | Google Scholar

28. Atay O, Doncic A, Skotheim J. Switch-like transitions insulate network motifs to modularize biological networks. Cell Syst. (2016) 3:121–32. doi: 10.1016/j.cels.2016.06.010

PubMed Abstract | Crossref Full Text | Google Scholar

29. Hartwell LH, Weinert TA. Checkpoints: controls that ensure the order of cell cycle events. Science. (1989) 246:629–34. doi: 10.1126/science.2683079

PubMed Abstract | Crossref Full Text | Google Scholar

30. Murray AW, Kirschner MW. Dominoes and clocks: the union of two views of the cell cycle. Science. (1989) 246:614–21. doi: 10.1126/science.2683077

PubMed Abstract | Crossref Full Text | Google Scholar

31. Orlando D, Lin C, Bernard A, Wang J, Socolar J, Iversen E, et al. Global control of cell-cycle transcription by coupled CDK and network oscillators. Nature. (2008) 453:944–7. doi: 10.1038/nature06955

PubMed Abstract | Crossref Full Text | Google Scholar

32. Skotheim JM, Di Talia S, Siggia E, Cross FR. Positive feedback of G1 cyclins ensures coherent cell cycle entry. Nature. (2008) (454):291–6. doi: 10.1038/nature07118

PubMed Abstract | Crossref Full Text | Google Scholar

33. Yao G, Tan C, West M, Nevins J, You L. Origin of bistability underlying mammalian cell cycle entry. Molec Syst Biol. (2011) 7:485. doi: 10.1038/msb.2011.19

PubMed Abstract | Crossref Full Text | Google Scholar

34. Novak B, Tyson J. Mitotic kinase oscillation governs the latching of cell cycle switches. Current Biologt. (2022) 32:1–6. doi: 10.1016/j.cub.2022.04.016

PubMed Abstract | Crossref Full Text | Google Scholar

35. Elowitz M, Leibler S, A. synthetic oscillatory network of transcriptional regulators. Nature. (2000) 403:335–8. doi: 10.1038/35002125

PubMed Abstract | Crossref Full Text | Google Scholar

36. Gardner T, Cantor C, Collins J. Construction of a genetic toggle switch in Escherichia coli. Nature. (2000) 403:339–42. doi: 10.1038/35002131

PubMed Abstract | Crossref Full Text | Google Scholar

37. Manning A, Dyson N. RB mitotic implications of a tumour suppressor. Nat Rev Cancer. (2012) 12:220–6. doi: 10.1038/nrc3216

PubMed Abstract | Crossref Full Text | Google Scholar

38. Viatour P, Sage J. Newly identified aspects of tumor suppression by RB. Dis Model Mech. (2011) 4:581–5. doi: 10.1242/dmm.008060

PubMed Abstract | Crossref Full Text | Google Scholar

39. Alon U. Network motifs: theory and experimental approaches. Nat Rev Genet. (2007) 8:450–61. doi: 10.1038/nrg2102

PubMed Abstract | Crossref Full Text | Google Scholar

40. Alon U. An Introduction to Systems Biology. London: Chapman & Hall/CRC. (2007).

Google Scholar

41. Milo R, Shen-Orr S, Itzkovitz S, Kashtan N, Chklovskii D, Alon U. Network motifs: Simple building blocks of complex networks. Science. (2002) 298:824–7. doi: 10.1126/science.298.5594.824

PubMed Abstract | Crossref Full Text | Google Scholar

42. Thieffry D, Thomas R. Qualitative analysis of gene networks. In: Pacific Symposium on Biocomputing. (1998). p. 77–88.

Google Scholar

43. Thomas R. Boolean formalization of genetic control circuits. J Theor Biol. (1973) 42:563–85. doi: 10.1016/0022-5193(73)90247-6

PubMed Abstract | Crossref Full Text | Google Scholar

44. Pauleve L, Kolcak J, Chatain T, Haar S. Reconciling qualitative, abstract, and scalable modeling of biological networks. Nat Commun. (2020) 11:4256. doi: 10.1038/s41467-020-18112-5

PubMed Abstract | Crossref Full Text | Google Scholar

45. Kolcak J, Safranek D, Haar S, Pauleve L. Parameter space abstraction and unfolding semantics of discrete regulatory networks. Theor Comput Sci. (2019) 765:120–44. doi: 10.1016/j.tcs.2018.03.009

Crossref Full Text | Google Scholar

46. Abou-Jaoude W, Thieffry D, Feret J. Formal derivation of qualitative dynamical models from biochemical networks. Biosystems. (2016) (149):70–112. doi: 10.1016/j.biosystems.2016.09.001

PubMed Abstract | Crossref Full Text | Google Scholar

47. Albert R, Collins JJ, Glass L. Introduction to Focus Issue: quantitative approaches to genetic networks. Chaos. (2013) 23:025001. doi: 10.1063/1.4810923

PubMed Abstract | Crossref Full Text | Google Scholar

48. Saadatpour A, Reka A. Boolean modeling of biological regulatory networks: a methodology tutorial. Methods. (2013) 62:3–12. doi: 10.1016/j.ymeth.2012.10.012

PubMed Abstract | Crossref Full Text | Google Scholar

49. Bornholt S. Boolean network models of cellular regulation: prospects and limitations. J R Soc Interface. (2008) 5:134–50. doi: 10.1098/rsif.2008.0132.focus

PubMed Abstract | Crossref Full Text | Google Scholar

50. Cury JER, Monteiro PT, Chaouiya C. Partial order on the set of Boolean regulatory functions. arXiv:190107623v1. (2019).

Google Scholar

51. Chatain T, Haar S, Pauleve L. Most permissive semantics of Boolean networks. arXiv preprint arXiv:1808.10240. (2018).

Google Scholar

52. Bernot G, Casse F, Comet JP, Delaplace F, Muller C, Roux O. Semantics of biological regulatory networks. Electron Notes Theor Comput Sci. (2007) 180:3–14. doi: 10.1016/j.entcs.2004.01.038

Crossref Full Text | Google Scholar

53. Brewster RC, Foucaud F, Hell P, Naserasr R. The complexity of signed graph and edge-coloured graph homomorphisms. Discrete Math. (2017) 340:223–35. doi: 10.1016/j.disc.2016.08.005

Crossref Full Text | Google Scholar

54. Eiter T, Makino K, Gottlob G. Computational aspects of monotone dualization: a brief survey. Discr Appl Mathem. (2008) 156:2035–49. doi: 10.1016/j.dam.2007.04.017

Crossref Full Text | Google Scholar

55. Savageau M, Voit E. Power-law approach to modeling biological systems: I. Theory J Ferment Technol. (1982) 60:221–8.

Google Scholar

56. Savageau M. Biochemical systems theory: operational differences among variant representations and their significance. J Theor Biol. (1991) 151:509–30. doi: 10.1016/S0022-5193(05)80367-4

PubMed Abstract | Crossref Full Text | Google Scholar

57. Mincheva M, Roussel M. Graph-theoretic methods for the analysis of chemical and biochemical networks. I Multistability and oscillations in ordinary differential equation models. J Math Biol. (2007) 55:61–86. doi: 10.1007/s00285-007-0099-1

PubMed Abstract | Crossref Full Text | Google Scholar

58. Mincheva M, Conradi C. Graph-theoretic analysis of multistationarity using degree theory. Math Comp Simul. (2017) 133:76–90. doi: 10.1016/j.matcom.2015.08.010

Crossref Full Text | Google Scholar

Keywords: network, gene regulation, dynamical system (DS), network motif inclusion, Boolean model

Citation: Duncan W, Cummins B and Gedeon T (2024) Subnetwork inclusion and switching of multilevel Boolean networks preserve parameter graph structure and dynamics. Front. Appl. Math. Stat. 10:1286957. doi: 10.3389/fams.2024.1286957

Received: 31 August 2023; Accepted: 15 July 2024;
Published: 09 August 2024.

Edited by:

Felix Sadyrbaev, University of Latvia, Latvia

Reviewed by:

Yunjiao Wang, Texas Southern University, United States
Paolo Milazzo, University of Pisa, Italy

Copyright © 2024 Duncan, Cummins and Gedeon. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Tomáš Gedeon, Z2VkZW9uJiN4MDAwNDA7bWF0aC5tb250YW5hLmVkdQ==

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.