Aggregated (Bi-)Simulation of Finite Valued Networks
Abstract
The paper provides a method to approximate a large-scale finite-valued network by a smaller model called the aggregated simulation, which is a combination of aggregation and (bi-)simulation. First, the algebraic state space representation (ASSR) of a transition system is presented. Under output equivalence, the quotient system is obtained, which is called the simulation of the original transition system. The ASSR of the quotient system is obtained. The aggregated (bi-)simulation is execueted in several steps: a large scale finite-valued network is firstly aggregated into several blocks, each of which is considered as a network where the in-degree nodes and out-degree nodes are considered as the block inputs and block outputs respectively. Then the dynamics of each block is converted into its quotient system, called its simulation. Then the overall network can be approximated by the quotient systems of each blocks, which is called the aggregated simulation. If the simulation of a block is a bi-simulation, the approximation becomes a lossless transformation. Otherwise, the quotient system is only a (non-deterministic) transition system, and it can be replaced by a probabilistic networks. Aggregated simulation can reduce the dimension of the original network, while a tradeoff between computation complexity and approximation error need to be decided.
keywords:
Transition system, finite-valued network, simulation, aggregation, semi-tensor product of matrices.1 Introduction
In recent years networked systems, as one of the most important objects of complex systems, become a hot topic in overall scientific community. There are so many networks from high technologies to daily life, such as internet, neural network, logistic network, Boolean network for gen regularity network, networked game, etc.
Among them, finite-valued network is one of the most important networks. The historical origin of finite-valued networks may be tracked to finite-valued machine such as Turing machine [31, 33, 34]; coding-decoding in cryptography [3, 5, 35]; mapping and functions over finite sets [4, 28, 29]; and Boolean networks [7, 14, 17, 18, 19]; etc. In the early 1960s two Robel price winners Jacob and Monod showed that any cell contains a number of regulatory genes that acts as switches, which inspired Kauffman to propose a model, called Boolean network, to formulate genetic regulatory network [32]. Since the Boolean network has been successfully applied to biological networks, it caused a enthusiasm in studying Boolean network and Boolean control network.
A Boolean network is described as a logical system, there was no convenient tool to deal with it, until semi-tensor product (STP) of matrix was used into the investigation. STP converts a logical (control) system into a linear (bilinear) difference system, called the algebraic state space representation (ASSR). Then the classical mathematical tools, such as the matrix theory and the theory of difference equation etc., can be used to analysing and control designing of Boolean networks [7]. This approach promotes the investigation of Boolean networks as well as other kind of finite valued networks.
Nowadays, the classes of finite valued networks investigated are various. According to the domain values there are Boolean networks, -valued networks [1], and mix-valued networks [7]; according to the state transition form, there are deterministic (which means there is at most one successor to each state such as Boolean networks) and non-deterministic (which means a state may have more than one successors such as finite automata), and the transition type maybe conventional (i.e., uniquely determined), probabilistic [30], and stochastic [9]; according to the algebraic structure of the bearing space, there are Boolean algebra [8], finite field [26], finite ring [11], lattice [15], etc. In addition, several other kinds of networks can be converted into such category, such as finite networked games [10], finite valued machines [33, 34], etc.
All the above mentioned different kinds of finite valued networks have been investigated using STP. Various of analysis and control problems have been discussed, including topological structure [6], controllability, observability, disturbance decoupling, decomposition, identification, realization, tracking, and optimal control, etc. We refer to some survey papers for the application of STP to control problems of finite-valued networks [12, 27, 25, 21].
As depicted in Fig. 1, to apply STP approach to practical problems there is a bottleneck, that is, the computational complexity.
It is a common phenomenon that a large scale networked system may have nodes , but the degrees of nodes (in-degree and out-degree) are very small. Say, it was pointed by Kauffman [19] that a genetic regularity network may have over a thousand of nodes but the degrees are always less than . This fact makes an aggregation efficient in reducing the computational complexity.
2 Transition Systems
Definition \thethm.
[2] A tuple is called a transition system, where
-
(i)
is the set of states,
-
(ii)
is the set of inputs (controls or actions),
-
(iii)
is a transition mapping,
-
(iv)
is the observations,
-
(v)
: observation mapping.
If , is said to be deterministic.
A conventional way to describe a transition system is using a transition graph. We use an example to explain this.
Example \thethm.
Consider a transition system
where
-
(i)
,
-
(ii)
,
-
(iii)
-
(iv)
,
-
(v)
The system can be described by Figure 2).
We are only interested in finite transition system. Then similarly to multi-valued logic, a finite transition system has its algebraic state space representation (ASSR).
Proposition \thethm.
Consider a transition system . Assume , , . Using vector form expression , , , then the has its ASSR as follows:
(1) |
where is a Boolean matrix, is a logical matrix.
Example \thethm.
3 Quotient Systems and Simulation
Definition \thethm.
[2] Consider a transition system . Two states are said to be observationally equivalent, denoted by , if
The set of equivalence classes is denoted by .
Let be an equivalent class, is the set of , that is,
where is called the concretization mapping.
Definition \thethm.
Consider a transition system . is called the quotient system of under observability equivalence, where
-
(i)
is the set of (observability) equivalence classes.
-
(ii)
(original) set of inputs.
-
(iii)
is defined as follows: Assume . , if and only if, there exist , such that
-
(iv)
(original) set of observations.
-
(v)
is defined as follows:
Example \thethm.
-
(i)
Recall Example 2, where the transition system is described by Figure 2). Under observability equivalence we have
Hence, the quotient system is described by Figure 3.
Figure 3: Quotient system of Example 2 (i)
The ASSR of quotient system is easily obtained as
(3) where,
-
(ii)
Consider a transition system depicted by Figure 4).
Figure 4: Transition System in Example 3 (ii)
Under observability equivalence the quotient system can be obtained as
Figure 5) shows the quotient system .
Figure 5: Quotient System
Then the ASSR of can be obtained as
(5) where,
The ASSR representation of transition systems is very convenient in analysis and control design of transition systems. In the following we show how to get the ASSR of quotient systems.
Theorem 1.
Consider a transition system
(6) |
where , are Boolean vectors, is the logical vector, is a Boolean matrix, is a logical matrix.
Then the quotient system is
(7) |
where is the equivalence class of , ,
(8) |
where is the Boolean product of matrices;
(9) |
Proof. Since is the equivalence class of , that is, , then formula (LABEL:fm.5.7) is obvious.
First, note that according to (7), is the transition matrix of subsets to subsets when the control .
Second, according to the structure it is clear that is the index function of , .
Recall the transition matrix of one set of subsets to another set of subsets (refer to Chapter 4 of Volume 2, or [che18]), it is clear that when the transition matrix of set of subsets to set of subsets is
Hence we have
(10) |
A transition system without control is called an autonomous transition system.
Corollary 2.
Assume is an autonomous transition system with ASSR
(11) |
Then the quotient system under output equivalence relation is
(12) |
where
(15) |
Denote the set of output trajectories of by . (If is not determinant the trajectories are not unique.) If , then
Let be a transition system and is its quotient system. Then according to the definition it is clear that
(16) |
That is, each output sequence can be produced by its quotient system. Because of this, the quotient system is said to be a simulation of the original .
The following simple example shows an output sequence of may not be obtained from the original .
Example 3.
Observe a depicted in Figure 6.
It is clear that is an output trajectory, which is not an output trajectory of .
Definition 4.
[2] Consider a transition system . Assume are (output) equivalence, if for each control with there exists an such that , then . If for any , we have , then is called a bi-simulation of , denoted by .
According to Definition 4, bi-simulation means for all we have
(17) |
The following is an important property of bi-simulation:
Proposition 5.
[2] Consider a transition system .
-
(i)
If is a deterministic system, then is a bi-simulation.
-
(ii)
If is a deterministic system, that is a bi-simulation, if and only if, is deterministic.
4 Aggregation via Bi-simulation
Definition 6.
-
(i)
A -valued (autonomous) networked system can be described as
(18) where , are states, , are state transition functions.
-
(ii)
A valued networked control system can be described as
(21) where , are states, , are inputs (or controls), , are outputs (or observations), , are state updating functions, , are output functions.
Consider networked system (18), usually only part of appear into . That is,
Similarly, for system (21),
Definition 7.
Example 8.
Consider a Boolean network, which has its network equation as
(24) |
Then its network graph is depicted by Figure 7.
Definition 9.
Consider an autonomous network with its network graph , where . Let , where .
-
(i)
If , , , is called a block input of .
-
(ii)
If , , , is called a formal output of .
is called an aggregate-able block if there does not exist such that is a formal input and is a formal output.
Proposition 10.
Assume is an aggregate-able block with as its block inputs, and as its block outputs. Then the dynamic subnetwork of can be expressed as a controlled network with block control
and block output
Replacing block in by this block control system does not affect the dynamics of the rest part of .
Proof. From the construction it is clear that this replacement does not change anything for except changing some variable names.
Example 11.
Next, we consider . It is easy to verify that is an aggregate-able set with block input and block output . Then can be expressed as
(26) |
where , , , ,
Definition 12.
Consider a networked system with its network graph . Assume is an aggregate-able subset, and the aggregated (block control) system is . is said to be aggregated by its simulation, if is replaced by its quotient system .
Example 13.
Remark 14.
-
(i)
From Example 13 one sees that when a block of a networked system is aggregated by simulation its size is reduced. Unfortunately, the resulting overall system is only a transition system, which may not be determinant.
-
(ii)
The aggregation by simulation proposed for networked system is also applicable to networked control system with an obvious extension. Precisely, it can be done for each original control separately.
-
(iii)
For a simulation aggregation of , if , the aggregation is called a bi-simulation.
Proposition 15.
Assume is a networked system with its network graph , is an aggregate-able subset, is a bi-simulation, then the aggregation does not affect the dynamics of the overall system.
Proof. When is a bisimulation of , according to Proposition 5, is deterministic; therefore, the values of input nodes and output nodes characterize the states of at each time and uniquely determines the input and output at next moment, hence the inner structure of the subnetwork can be neglected.
Example 16.
Consider a Boolean control network whose network graph is depicted by Figure 8.
Assume the set of nodes of is and , where
5 Aggregated Simulation
Consider a -valued network with its network graph . Assume a set of sub-nodes is an aggregate-able and output decoupled block depicted in Fig. 9.
Moreover, assume the dynamic equations of with block inputs and block outputs is
(32) |
Then its quotient system under output equivalence, denoted by , is
(33) |
where , where
If is a logical matrix, which means is deterministic, then the bisimulation is applicable. That is, the block can be replaced by , which does not affect the input-output relationship of the overall network . In the following assume is not deterministic.
In the following we propose a method called the aggregation by simulation, which is an approximation by probabilistic networks.
Definition 17.
Given a -valued network with network graph . A subset is an aggregate-able and output decoupled block, which is described as above. The aggregation by simulation is defined as follows:
-
•
Step 1. Construct the quotient system .
-
•
Step 2. Using to build a probabilistic network as follows: Set
Denote
Define a probabilistic system, denoted by as follows:
where
with probability
-
•
Step 3. Replace by .
6 Aggregated Simulation of a Biological System
This section considers an example of T-cell receptor kinetics which was originally modeled in [20]. The following model is copied from [36] and ignoring nodes’ physical meanings.
The dynamics of network of T-cell receptor kinetics with nodes and controls, depicted in Fig. 10, is described in (59).
(59) |
It is natural to consider the nodes with zero out-degree as observers. Hence we have
(65) |
As depicted in Fig. 10, the network is divided into 5 blocks. In the following we use simulation to aggregate them.
-
•
Consider . Rename the variables as follows:
where , are block outputs.
Then the block dynamics can be expressed as
(66) where
Since
where
Then the quotient system of (66) is obtained by updating by
-
•
Consider . Rename the variables as follows:
where , are block inputs, , are block outputs.
Then the block dynamics can be expressed as
(67) where
Since
where
Then the quotient system of (67) is obtained by updating by
The probabilistic approximation of (67) is obtained by updating by
-
•
Consider . Rename the variables as follows:
where , are block inputs, is overall system output, is block output.
Then the block dynamics can be expressed as
(68) where
Since
where
Then the quotient system of (68) is obtained by updating by
The probabilistic approximation of (68) is obtained by updating by
-
•
Consider . Rename the variables as follows:
where is a block input, , are overall system outputs, is a block output.
Then the block dynamics can be expressed as
(69) where
It is calculated that
where
Then the quotient system of (69) is obtained by updating by
The probabilistic approximation of (69) is obtained by updating by
-
•
Consider . Rename the variables as follows:
where , are block inputs, , are overall system outputs.
Then the block dynamics can be expressed as
(70) where
It is calculated that
where
Then the quotient system of (70) is obtained by updating by
The probabilistic approximation of (70) is obtained by updating by
Summarizing the above blocked simulated systems, an overall aggregated simulation for T-cell is depicted in Fig. 11, where
This aggregated simulation of the original system has only state nodes and controls. Of course, using the transition form of this quotient system, a further simplification can be done by using , as new nodes. This is a trad-off between computational load and precision of approximation.
7 Application to Finite Valued Networks
Consider a large scale -valued network . Assume is its aggregated simulation and is its probabilistic form. According to the construction one sees easily that they satisfy the following relation, which is depicted in Fig. 12.
Proposition 19.
-
(i)
When a -valued (large scale) network is approximated by its (aggregated) quotient system, the quotient system is its simulation, denoted by .
-
(ii)
When is approximated by its probabilistic form, , then . That is, they are bi-simulated.
Corollary 20.
Corollary 7.2
-
(i)
Consider Input-Output Decoupling:
-
(ii)
Consider Disturbance Decoupling:
-
(iii)
Consider Realization:
References
- [1] A. Adamatzky, On dynamically non-trivial three-valued logics: oscillatory and bifurcatory species, Chaos Sokitons Fractals, Vol. 18, 917-936, 2003.
- [2] C. Belta, B. Yordanov, E.A. Gol, Formal Methods for Discrete-Time Dynamic Systems, Springer, Switzerland, 2017.
- [3] E. Berlekamp(1968), Algebraic Coding Theory, McGraw-Hill, New York.
- [4] G. Birkhoff(1967), Lattice Theory, 3 rd ed., Colloq. Pub., Vol. 25, Amer. Math. Soc., Providence.
- [5] C. Carlet(2010), Boolean Function for Cryptography and Correcting Codes, in Boolean Models and Methods in Mathematics, (Y. Crama, P. Hammer (eds.)), 257-397, Cambridge Univ. Press, Cambridge.
- [6] D. Cheng, H. Qi, Linea representation of dynamics of Boolean networks, IEEE Trans. Aut. Contr., Vol. 55, No. 10, 2251-2258, 2010.
- [7] D. Cheng, H. Qi, Z. Li (2011), Analysis and Control of Boolean Networks - A Semi-tensor Product Approach, Springer, London, 2011.
- [8] D. Cheng, H. Qi, Y. Zhao, An Introduction to Semi-tensor Product of Matrices and Its Applications, World Scientific, Singapo, 2012.
- [9] T. Chen, U.M. Braga-Neto, Maximum-likelihood estimation of the discrete coefficient of determination if stochastic Noolean systems, IEEE Trans. Signal Process, Vol. 61, No. 15, 3880-3894, 2013.
- [10] D. Cheng, Y. Wu, G. Zhao, S. Fu, A comprehensive survey on STP approach to finite games, J. Sys. Sci. Compl., Vol. 34, No. 5, 1666-1680, 2021.
- [11] D. Cheng, Z. Ji, On networks over finite rings, J. Franklin Inst., Vol. 359, No. 14, 7562-7599, 2022.
- [12] E. Fornasini, M.E. Valcher, Recent developments in Boolean networks control, J. Contr. Dec., Vol. 3, No. 1, 1-18, 2016.
- [13] A.G. Hamilton, Logic for Mathematicialn, Revised Edition, Pub. Tsionhua Univ., Beijing, 2003.
- [14] S. Huang, D. Ingber(2000), Shape-dependent control of cell growth, differentiation, and apoptosis: switching between attractors in cell regulatory networks. Exp. Cell Res., Vol. 261, No. 1, 91-103.
- [15] Z. Ji, D. Cheng, Control networks over finite lattices, preprint, arxiv:2208.03716, 2022.
- [16] N. Jiang, C. Huang, Y. Chen, J. Kurths, Bisimulation-based stabilization of probabilistic Boolean control networks with state feedback control, Front Inform. Technol. Electron. Eng., Vol. 21, No. 2, 268-280, 2020.
- [17] S. Kauffman(1969), Metabolic stability and epigenesis in randomly constructed genetic nets, J. Theor. Biol., Vol. 22, No. 3, 437-467.
- [18] S. Kauffman(1993), The Origins of Order: Self-organization and Selection in Evolution, Oxford Univ. Press, London.
- [19] S. Kauffman(1995), At Home in the Universe, Oxford Univ. Press, London.
- [20] S. Klamt, J. Saez-Rodriguez, J.A. Lindquist, L. Simeomi, E.D. Gilles, A methodology for the structural and functional analysis of signaling and regulatory networks, BMC Bioinform., Vol. 7, No. 1, Art.no.56, 2006.
- [21] H. Li, G. Zhao, M. Meng, J. Feng, A survey on applications of semi-tensor product method in engineering, Science China, Vol. 61, 010202:1-010202:17, 2018.
- [22] R. Li, T. Chu, X. Wang, Bisimulations of Boolean control networks, SIAM J. Opt., Vol. 51, No. 1, 388-416, 2018.
- [23] R. Li, Q. Zhang, T. Chu, Reduction and analysis of Boolean control networks by bisimulation, SIAM J. Opt., Vol. 59, No. 2, 1033-1056, 2021.
- [24] R. Li, Q. Zhang, T. Chu, Bisimulations of Probabilistic Boolean networks, SIAM J. Opt., Vol. 60, No. 5, 2631-2657, 2022.
- [25] J. Lu, H. Li, Y. Liu, F. Li, Survey on semi-tensor product method with its applications in logical networks and other finite-valued systems, IET Contr. Thm& Appl., Vol. 11, No. 13, 2040-2047, 2017.
- [26] M. Meng, X. Li, G. Xiao, Synchronization of networks over finite fields, Automatica 115 (2020) 108877.
- [27] A. Muhammad, A. Rushdi, F.A. M. Ghaleb, A tutorial exposition of semi-tensor products of matrices with a stress on their representation of Boolean function, JKAU Comp. Sci., Vol. 5, 3-30, 2016.
- [28] F. Robert(1986), Discrete Iterations: A Metric Study, Translated by J. Rolne, Springer, Berlin.
- [29] W.M. Schmidt(1976), Equations over Finite Fields, An Elementary Approach, Springer-Verlag, Berlin.
- [30] I. Shmulevich, E. Dougherty, S. Kim, W. Zhang, Probabilistic Boolean networks: a rulebased uncertainty model for gene regulatory networks, Bioinformatics, Vol. 18, No. 2, 261-274, 2002.
- [31] A.M. Turin(1950), Computing machinery and intelligence, Mind, Vol. 59, 433-460. (retitled as “Can a machine think?” in The world of mathematics, Vol. 5, Ed. J.R. Newman, et al., New York, 1956).
- [32] M. Waldrop, Complexity: The emerging Science at the Edge of Order and Chaos, Touchstone, New York, 1992.
- [33] Y. Yan, D. Cheng, J. Feng, J. Yue(2022), Survey on applications of algebraic state space theory of logical systems to finite state machines, Sci. China Inf. Sci., https://doi.org/10.1007/s11432-022-3538-4.
- [34] J. Yue, Y. Yan, Z. Chen, H. Deng(2021), State space optimization of finite state machines from the viewpiont of control theory, ıFront Inform. Technol. Electron. Egg., Vol. 22, No. 12, 1598-1609.
- [35] J. Zhong, Y. Pan, D. Lin(2021), On Galois NFSRs equivalent to Fibonacci Ones, In Y. Wu, M. Yung (eds), Information Security and Cryptology. Inscript 2020. Lecture Notes in Computer Science (LNCS), Vol. 12612, Springer, Cham., 433-449, 2021.
- [36] S. Zhu, J. Liu, J. Zhong, Y. Liu, J. Cao(2022), Sensors design for large-scale Boolean networks vis pinning observability, IEEE Trans. Aut. Contr., Vol. 67, No. 8, 4162-4169.