The No-Ellipsoidal Bound of Reachable Sets for Neutral Markovian Jump Systems with Disturbances ()
1. Introduction
In practice and engineering applications, many dynamical systems may cause abrupt variations in their structure, due to stochastic failures or repairs of the components, changes in the interconnections of subsystems, sudden environment changes, and so on. Markovian jump systems, modeled by a set of subsystems with transitions among the models determined by a Markov chain taking values in a finite set, have appealed to a lot of researchers in the control community. In the past few decades, the Markovian jump systems have been extensively studied, see [1] [2] [3] [4] and the references therein.
The reachable set [5] estimation of dynamic systems is to derive some closed bounded set that bounds the state trajectories starting from the origin by inputs with peak value. Reachable set estimation is not only an important issue in the control theory [6] [7] [8] [9], which plays an important role in solving the problem of state estimation and parameter estimation, but also in practical engineering when safe operation is required through synthesizing controllers to avoid undesirable (or unsafe) regions in the state space. For the bound of reachable sets for linear systems without any time delay, we can find a well-known result which has been formulated in terms of linear matrix inequality (LMI) [10], and it is widely used to design control systems that have saturating actuators [11] [12]. However, time delay phenomenon is frequently encountered in many practical systems, such as biological systems, chemical systems, hydraulic systems and electrical networks. It is well known that the existence of time delays in a system may cause instability or bad system performance (see [13] [14] [15]). Hence it is natural to ask what about the reachable set of systems with time-delays.
Recently, the reachable set estimation problems for time-delay systems have been received growing attention. Then, an increasing number of researchers have devoted their efforts to the problem of reachable set estimation [16] [17] [18]. In [16], a delay-dependent condition for an ellipsoid bounding the set of reachable states was presented by using the Lyapunov-Razumikhin function and the S-procedure. Five non-convex scalar parameters have to be treated as tuning parameters to find the “smallest” possible ellipsoid. Recently, Kim [17] modified the Lyapunov-Krasovskii functional used for exponential stability analysis [19] [20], and, based on it, he proposed an improved ellipsoidal bound of the reachable set of reachable states. The derivative of the time delay is assumed to be less than one in [16]. This limitation may restrict the scope of application for this method. However, if the value of the derivative of the time delay is large, this method will yield a bigger ellipsoid bounding the reachable set than that in [16]. The reachable set bounding for delayed systems subject to both polytopic uncertainties and bounded peak inputs was considered in [21]. Some criteria bounding the reachable set are derived, by using a maximal Lyapunov-Krasovskii functional, which is constructed by taking pointwise maximum over a family of Lyapunov-Krasovskii functionals. But the bound of reachable set bounding for delayed systems with polytopic uncertainties is not small enough.
As is well known, neutral system being a special case of time delay system exists in many dynamic systems [22] [23] [24] [25]. However, the bound of reachable sets for neutral Markovian jump systems with bounded peak disturbances has not been investigated, which motivates this paper. In this paper, we consider the problem of finding the no-ellipsoidal bound of reachable sets for neutral Markovian jump systems with bounded peak disturbances. Based on the modified Lyapunov-Krasovskii type functional, some delay-dependent results are derived in the form of matrix inequalities containing only one non-convex scalar. Furthermore, a modified matrix inequality is used to remove the limitation on the variation rate of the delay and obtain a “smaller” no-ellipsoidal bound of reachable sets. Numerical examples illustrate the effectiveness and improvement of the obtained results.
2. Problem Statement
Consider the following neutral Markovian jump systems with disturbances
(1)
where
is the state vector,
is a constant neutral delay, the discrete delay
is a time-varying function that satisfies
(2)
is a differentiable vector-valued initial function,
,
is Markovian process taking values on the probability space in a finite state
with generator
, and
is described as follows
(3)
where
,
,
is the transition probability from i to j at time
,
.
,
,
and
are known constant matrices of the Markov process.
Since the state transition probability of the Markovian jump process is considered in this paper is partially known, the transition probability matrix of Markovian jumping process
is defined as
(4)
where
represents the unknown transition rate. For notational clarity,
, the set
denotes
with
(5)
moreover, if
, it is further described as
, where m is a non-negation integer with
and
,
,
represent the known element of the ith row and jth column in the state transition probability matrix
.
For the sake of brevity,
is used to represent the solution of the system under initial conditions
, and
satisfies the initial condition
. And its weak infinitesimal generator, acting on function V, is defined in [3].
This paper aims to find a reachable set for neutral Markovian jump systems (1) based on the Lyapunov-Krasovskii functional approach. We denote the set of reachable states with
that satisfies (2) by
(6)
We will bound
by an ellipsoid of the form
(7)
For simplicity, there are the following representations:
In this paper, the following Lemma and Assumption are needed:
Lemma 1 [10]. Let
and
. If
then we have
for
.
Lemma 2 [4]. Suppose
and
, for any positive definite matrix W the following inequality holds
Lemma 3 [17]. For any positive-definite matrix
, scalar
, vector function
such that the integrations concerned are well defined, then
3. Main Results
Our aim is to find an ellipsoid set as small as possible to bound the reachable set defined in (3). In this section, based on an appropriate Lyapunov functional and matrix inequality techniques (Lemma (1-3)), following Theorems are derived.
Theorem 1. Consider the Markov neutral system (1) with constraints (2), if there exist symmetric matrices
,
,
,
(
),
,
,
and a scalar
satisfying the following matrix inequalities:
(8)
(9)
(10)
where
,
,
,
,
,
,
,
,
.
Then, the reachable set of the system (1) having the constraints (2) is bounded by a non-ellipsoid boundary
, which
is defined in (7).
Proof. We choose the following Lyapunov-Krasovskii functional candidate as follows:
(11)
where
where
,
,
,
(
),
,
,
and
are solutions of (10).
First, we show that
in (11) is a good L-K functional candidate. For
, we have
. Furthermore, for
, we have
.
Therefore, we get
(12)
Then, for given
,
,
,
and the weak infinitesimal operator L of the stochastic process
along the evolution of
are given as
Taking into account the situation that the information of transition probabilities is not accessible completely, due to
(
), the following equations hold for arbitrary appropriate matrices
are satisfied
It is trivial to obtain the following equality:
(13)
(14)
(15)
(16)
Then substituting (13-16) into (12), we further have
where
is the same as defined in the Theorem 1 and
Thus, from matrix inequalities (10)-(11), we get
(17)
which means, by Lemma 1, that
, and this results in
for
, since
from (11).
So the reachable set of the system (1) is bounded by ellipsoid
(
) defined in (7), which implies that the reachable sets of the system (1) having the constraints (2) is bounded by a non-ellipsoid boundary
. This completes the proof. £
Remark 1. It should be noted that the more the unknown elements there are in (4), the lower the maximum of time delay will be in Theorem 1. Actually, if all transition probabilities are unknown, the corresponding system can be viewed as a switched neutral Markovian jump system under arbitrary switching. Thus, the conditions obtained in Theorem 1 will cover the results for arbitrary switched neutral Markovian jump systems with disturbances. In that case, one can see the bounds of reachable sets in Theorem 1 become seriously conservative, for many constraints. Fortunately, we can use the Lyapunov functional method to analyze the bound of reachable sets for the neutral Markovian jump system under the assumption that all transition probabilities are not known.
For finding the bound of reachable sets for neutral Markovian jump systems with all transition probabilities are not known, one can construct the following Lyapunov functional
Following a similar line as in proof of Theorem 1, we can obtain the following Theorem.
Theorem 2. Consider the Markov neutral system (1) with all elements unknown in transition rate matrix (4), if there exist symmetric matrices
,
,
,
,
,
and a scalar
satisfying the following matrix inequalities for
(18)
(19)
(20)
where
,
,
,
,
,
,
,
,
.
Then, the reachable sets of the system (1) having the constraints (2) is bounded by a non-ellipsoid boundary
, which
is defined in (7).
Remark 2. The solution for (8-10) or (18-20), if it exists, need not be unique. It is well-known [10] that the volume of
defined in (7) is proportional to
, which means a square root of the determinant of
, so the minimization of
is the same as minimizing the volume of
. However, the minimization of
needs additional variables, so we use a simple approximation as that in [16] [17] [21]. That is, maximize
subject to
which can be equivalent to the following optimization problem:
(21)
Remark 3. The matrix inequalities in Theorem 1 and Theorem 2 contain only one non-convex scalar
(for given
and
), and these become LMI by fixing the scalar
. The feasibility check of a matrix inequality having only one non-convex scalar parameter is numerically tractable, and a local optimum value of
can be found by fminsearch.m.
4. Numerical Examples
In this section, a numerical example demonstrates the effectiveness of the approaches presented in this paper. Consider the neutral Markov jump systems with three operation modes whose state matrices are listed as follow:
(22)
where
The transition rate matrix
is considered as the following three cases.
Case 1. The transition rate matrix
is completely known, which is considered as
Case 2. The transition rate matrix
is partly known, which is considered as
Case 3. The transition rate matrix
is completely unknown, which is considered as
Firstly, by giving the transition probabilities
, a possible mode evolution of the neutral Markov jump system (22) is derived as shown in Figure 1. Based on the mode evolution shown in Figure 1, and choosing disturbances
as the random signal satisfying
, all the reachable states of neutral Markov jump system (22) starting from the origin are given in Figure 2.
By using theorem 2 and solving the optimization problem (20) in case 1, we can obtain the maximize
when
, and the corresponding feasible matrices are given as
,
,
. The reachable sets of the system (22) in case 1 is bounded by a intersection of three ellipsoids:
, which is depicted in Figure 3.
By using theorem 1 and solving the optimization problem (22) in case 2, we can obtain the maximize
when
, and the corresponding feasible matrices are given as
,
,
. The reachable sets of the system (22) in case 2 is bounded by a intersection of three ellipsoids:
, which is depicted in Figure 4.
By using theorem 3 and solving the optimization problem (22) in case 3, we can obtain the maximize
when
, and the corresponding feasible matrices are given as
,
,
. The reachable sets of the system (22) in case 3 is bounded by a intersection of three ellipsoids:
, which is depicted in Figure 5.
Figure 1. Random jumping mode r(t) of neutral Markov jump system (22).
Figure 2. The time responses of state variable x(t) of neutral Markov jump system (22) in case 1.
Figure 3. The bound of reachable sets for neutral Markov jump system (22) in case 1.
Figure 4. The bound of reachable sets for neutral Markov jump system (22) in case 2.
Figure 5. The bound of reachable sets for neutral Markov jump system (22) in case 3.
5. Conclusion
In this paper, the problem of robust stability for a class of uncertain neutral systems with time-varying delays is investigated. Sufficient conditions are given in terms of linear matrix inequalities which can be easily solved by LMI Toolbox in Matlab. Numerical examples are given to indicate significant improvements over some existing results.
Acknowledgements
This research was supported by Science and Technology Foundation of Guizhou Province (No. LKM[2013]21; No. J[2015]2074; No. J[2016]1074), Innovation Group Major Program of Guizhou Province (No. KY[2016]029) and National Natural Science Foundation of China (No. 11761021).