Distributed Synchronization of Coupled Time-Delay Neural Networks Based on Randomly Occurring Control ()
1. Introduction
With the rapid development of the information age, complex networks have received extensive attention as a frontier of interdisciplinary and challenging research fields. In real life, complex networks are everywhere, from the huge Internet to WWW [1], from large power networks to transportation networks, from neural networks to the metabolism of living things and social networks. It is no exaggeration to say that we live in a world full of various complex networks.
As one of the more significant dynamic behaviors of complex dynamical networks, synchronization widely exists in real life, for example, the chorus of crickets, the applause of the audience at a concert, the spread of computer viruses, the epidemic of infectious diseases in the crowd, etc. All of these are well-known phenomena of synchronization, because it can describe many natural phenomena and has many potential applications, such as image processing, neuronal synchronization, secure communication, etc. [2] [3] [4] [5] [6]. The synchronization of large-scale complex networks has been extensively studied in various fields of science and engineering.
As we all know, there are random uncertainties in any actual system and its external environment, for example, stochastic errors in system input and output, environmental noise, etc. With the deepening of research, people gradually realized that stochastic models can sometimes better reflect the inherent essential properties of natural and engineering systems. Various random emergencies or environmental noise will have a significant impact on natural systems, engineering systems, stock prices and other socio-economic systems, and some of them may even be subversive. For example, due to the existence of random interference factors, the modeling and analysis of the system become complicated, and the control and design of the system become difficult. Conventional deterministic algebraic equations and differential equations are no longer sufficient to accurately describe such network systems. In fact, since scientists discovered the Brownian motion (1827, Brown), proposed the Markov chain (1907, Markov), presented Langevin stochastic differential equation (1908, Langevin), gave an accurate mathematical description of Brownian motion (1923, Wiener), proposed Ornstein-Uhlenbeck noise (1930), laid the mathematical theoretical foundation of stochastic process (1931, Kolmogorov), discussed the mathematical theory of stochastic process (1951, Doob), and established Itô calculus theory, published a famous paper on stochastic differential equations (1951, K.Itô), laid the theoretical foundation of stochastic differential equations. In the past two hundred years, scientists have studied and analyzed stochastic phenomena, explored stochastic laws, and established a complete theoretical system of stochastic systems. Since then, the theory of stochastic systems based on stochastic analysis and stochastic differential equations has received full attention, and a large number of research results have been obtained which have permeated into many research fields and been widely applied. Therefore, the stochastic system control theory has become a hot research topic today and has important research value.
In the past ten years, many scholars have obtained a large number of constructive results on the study of synchronization of complex networks, and have proposed many effective methods. In [7], Barahona and Pecora proposed master stability functions to characterize the synchronization of complex networks. In [8], an improved simulated annealing method was used to detect optimal synchronization networks. Researchers have further studied the synchronization of complex networks with time-delay coupling [9] [10], weighted coupling matrices [11], linearly coupled form [12], adaptive updating weights [13], randomly occurring nonlinearities [14], stochastic coupling [15]. In [16], an adaptive strategy is used to study the synchronization of general complex networks when network topology is slowly time-varying. However, synchronization of complex networks may not be guaranteed if control is not introduced [17]. Researchers have developed many control-based methods to synchronize complex dynamical networks. For example, in [18], the problem of pinning control of complex dynamical networks is studied. When synchronizing and controlling networks, pinning control has been shown to be a simple but effective technique for stabilization and synchronization [17] [19] [20] [21] [22]. In [23] [24] [25] [26], some studies have discovered how to effectively control complex networks with a small number of nodes. The distributed synchronization of networks has attracted more and more attention from researchers in various fields. Vertex i in the network synchronizes the system state based not only on the state of vertex i, but also on the states of its neighboring vertices according to the given complex network topology [27]. In [28], an adaptive technique was proposed to synchronize Complex networks, where only neighborhood information was used to design updating law. Literature [29] has designed a distributed adaptive controller, the main feature of which is that nodes can more effectively use the local information on its neighbors without the need for global information on the entire networks. The actual implementation of the controller is always disturbed by various uncertainties caused by internal and external environments [30] [31]. Such disturbances widely exist in control implementation and system design, and are due to random abrupt changes [14] [30]. The distributed controller designed in [29] takes stochastic disturbances into consideration and proposes a distributed controller that occurs randomly. The first reason is that the signals in the network system cannot be completely transmitted or cannot be controlled, just as in the cases of packet dropouts, random failures and repairs of actuators [30] [31]. Another reason is positive. With consideration of economic or system life, control will be suspended from time to time [31]. Therefore, control activation and network systems may occur in a probabilistic or switching manner, and vary randomly in terms of their types and/or intensity [14] [30] [31] [32]. However, the synchronization research of complex networks mainly focuses on fixed controllers [15] [23] [33] [34]. Although it is of practical significance to study the randomly occurring control of complex networks, it has received little attention. In particular, the distributed synchronization of neural networks under randomly occurring control has received little attention from the academic community.
Time-delay is a universal objective phenomenon in nature and human society, which is usually caused by limited signal transmission and memory effects. For example, in the field of automation and information technology, information acquisition, processing and transmission of sensors all require time. In fact, communication systems, transmission systems, and power systems are all typical time-delay systems. Therefore, the phenomenon of time delay is ubiquitous. In the topological structure of complex dynamical networks, there are inevitably coupled time-delays. Moreover, the coupled time-delay of the network will have a certain impact on the synchronization capability and control effect of the network. Therefore, the analysis and research on time-delay systems is very meaningful.
In summary, randomness and time-delay are the most common phenomena in real systems, such as power and biological systems in actual engineering systems are typical time-delayed stochastic systems. In the past, the research on synchronization of complex networks mainly focused on the fixed controller. In reference [29], considering that the controlled system is interfered by random mutations, a method of randomly occurring control is proposed, and the synchronization behavior of complex networks is studied, but it does not take into account the impact of time-delay factors, so its model is somewhat conservative.
Based on the above viewpoints, a more general coupled time-varying delay complex dynamical network model under randomly occurring control is proposed in this paper. This model has the following characteristics: both controller activation and updating law of control gain occur in a probabilistic way, and the synchronization of stochastic complex networks is studied by considering randomly occurring control and updating law. The complex network model proposed in reference [29] is extended to the complex dynamical network model with coupled time-varying delay. Based on the Lyapunov stability theory, by constructing appropriate Lyapunov functional, the sufficient conditions for the distributed synchronization of such networks in mean square are obtained.
2. Model Description and Preliminaries
Notations: Let
denote the set of real (positive) numbers.
and
denote , respectively, the n-dimensional Euclidean space and the set of all
-dimensional real matrices. A > 0 denotes that the matrix A is a symmetric and positive definite matrix. The notation AT is the transpose of a vector or matrix A. I represents the identity matrix with appropriate dimensions.
denotes the Euclidean norm of a matrix A and
(respectively,
) denotes the maximum (respectively, minimum) eigen value of matrix A. The symbol
represents the trace of square matrix
, i.e.
.
stands for the Kronecker product. And
represents the expectation of the random variable X. Define a graph by
, where
denotes the vertex set and
denotes the edge set.
denotes the neighborhood of vertex i in the sense
. In this paper, graph
is supposed to be undirected [
implies
] and simple (without self-loops and multiple edges). Let
be the Laplacian matrix of graph
, which is defined as follows: for any pair
,
if
and
otherwise .
stands for the degree of vertex
. Let
be a complete probability space, where Ω represents a sample space,
is called an σ-algebra, and
is a probability measure.
In this paper, we consider the following model of a complex network stochastic system with coupled time-varying delays, which can be expressed as:
(1)
where
is the state vector of the ith vertex,
is a continuous vector function, C is the coupling strength of the network. The inner coupling matrix
is a constant diagonal matrix, and
.
is a time-varying coupling delay. Furthermore,
is the noise intensity function vector, and
is a scalar Brownian motion defined on
satisfying
and
. Additionally, from the Gershgorin disk theorem, all the eigenvalues of the Laplacian matrix L corresponding to graph
satisfy
. Furthermore,
is connected if and only if
: i.e., L is irreducible.
In order to achieve the synchronization of the stochastic complex network in (1), controllers are added to each vertex.
(2)
where
is a distributed adaptive controller.
For the ith vertex,
is designed as
(3)
where
is the control strength of vertex i.
In (3),
is a Bernoulli stochastic variable that describes the following random events for (2):
(4)
Let
be defined by
(5)
where the probability of event
is
, so the expectation of random variable
is
.
The distributed controller (3) in this paper takes stochastic disturbances into account. The distributed controller
occurs in a probabilistic manner and uses feedback information from neighboring points. Different from the conventional adaptive controller, the distributed controller
is not always implemented and it can model control failure in a stochastic way. In short, randomly occurring distributed control can effectively use the information of neighboring points to simulate real-world disturbances.
in (3) is updated according to the following randomly occurring distributed updating law:
(6)
where
and
is a Bernoulli stochastic variable representing the following random events for (6):
(7)
Similarly, Let
be defined by
(8)
where the probability of event
is
, so the expectation of stochastic variable
is
.
Remark 1: If
and
, the control and updating rule will be simplified to normal control and updating law, as shown in [25] [28]. If
and
, the problem considered in this article will be simplified to the synchronization of complex networks without controllers.
It can be seen from the above model that the network studied in this paper has the following characteristics:
1) The activation of the controller and the updating law of control gain both occur in a probabilistic manner, and the distributed synchronization of stochastic complex networks is studied by considering randomly occurring control and updating law.
2) Considering the effect of coupled time-delays, the model is more general.
In order to get the main results, the following definitions, assumptions and lemmas are needed.
Definition 1: Let
be the solution of the stochastic complex network with coupled time-varying delay in (1) or (2), if they satisfy the following condition:
(9)
then the stochastic complex network is said to achieve synchronization in mean square.
Lemma 1 (Itô formula) [35]: Let
be an Itô process on
with the stochastic differential
Let
be a real-valued function, which is continuously twice differentiable in x and once differentiable in t. Then
is again an Itô process with the stochastic differential given by
(10)
Lemma 2 [36]: For any
and any positive definite symmetric matrix
, the following inequalities hold
. (11)
Lemma 3 [37]: Assuming that
is a positive definite matrix, for any
, the following inequalities hold
. (12)
Assumption 1 [28] [38]: A vector-valued continuous function
is said to be uniformly decreasing for a matrix
if there exist
and
such that
(13)
holds for all
and
.
Assumption 2 [14]:
is said to be locally uniformly Lipschitz continuous with respect to t if there exist a constant
such that the following inequality holds for all
:
(14)
Assumption 2 can describe many real-world systems very well. It has been widely employed or discussed in [14] [35].
Assumption 3: Time-varying delay
satisfies:
, where
represents the derivative of
to t.
3. Main Results
In this section, we study the distributed synchronization problem of the stochastic complex network in (2) coupled with time-varying delay via randomly occurring control and updating law and obtain sufficient conditions for the distributed synchronization of such networks in mean square.
Theorem 1: Suppose that Assumptions 1-3 hold, then the stochastic complex network in (2) under the distributed adaptive controller (3) and updating law (6) will be globally synchronized in mean square, if the following conditions are satisfied:
(15)
Proof: It should be noted that the stochastic dynamical network in (2) with
and
is a special stochastic system with Markovian switching. Therefore, the existence and uniqueness of solutions to (2) can be transformed into the existence and uniqueness of solutions to a stochastic system with Markovian switching. The proof of the existence and uniqueness of solutions to a stochastic system with Markovian switching can be found in [32]. Also, the proof of the existence and uniqueness of solutions to (2) is shown in Supporting Information.
Let
and
.
Consider the following Lyapunov function
(16)
where
(17)
(18)
(19)
where b is a positive constant. According to (2) and (3) we can easily obtain
(20)
By the Lemma 1 (Itô formula), the stochastic derivative of
can be obtained as
(21)
and according to (20), the Itô differential operator
is given as
(22)
Note that
(23)
and take expectations of
and
, we obtain
and
, furthermore
(24)
Then, using Assumptions 1 and 2, (22), and (24), we have
(25)
From the definitions of
and the Laplacian matrix L, we get
(26)
(27)
Besides, by using Lemma 2 and Lemma 3, one obtains that
(28)
From Assumption 3 we can see that
. And substitute (26), (27) and (28) into (25), one gets that
(29)
Note that condition (15) in Theorem 1 yields
(30)
(31)
Therefore, from (26), (29), (30) and (31) we can derive
(32)
where μ is a positive constant. Thus, the distributed synchronization of the stochastic complex network with coupled time-varying delay in (2) via randomly occurring control and updating law can be achieved in mean square.
When the delay in the stochastic complex network in (2) is a constant delay, the following simpler conditions can be obtained.
Corollary 1: Suppose that Assumptions 1 and 2 hold, then the stochastic complex network in (2) under the distributed adaptive controller (3) and updating law (6) will be globally synchronized in mean square, if the following conditions are satisfied:
(33)
Proof: The Lyapunov function constructed at this time becomes
(34)
where b is a positive constant. The subsequent proof process is similar to the proof of Theorem 1, and will not be described in detail here.
4. Conclusion
In this paper, we have studied the distributed synchronization problem of stochastic complex networks with coupled time-varying delays via randomly occurring control and updating law. The activation of the controller and the updating law of control gain both occur in a probabilistic manner. According to the Lyapunov stability theory, Itô differential equations, etc., by constructing the appropriate Lyapunov functional, the sufficient conditions for the distributed synchronization of such networks in mean square are obtained.
Acknowledgements
This work was supported by the Fujian Provincial Department of Education Young and Middle-aged Teacher Education Research Project (JAT170914). The author would also like to thank the Editor-in-Chief, the Associate Editor, and the anonymous reviewers for their careful reading of the manuscript and constructive comments.