Synthesis of an Optimal Control for Linear Stationary Discrete Dynamical Systems ()
1. Statement and Solution of the Problem
As in [1]-[3], we assume that the processes in the open part of the system (excluding the controller) are described by the equation of order
(1.1)
in which the coefficients
and
are constants. Let us express Equation (1.1) as a system of first-order difference equations:
(1.2)
If
, the system state is determined by
(1.3)
We need to find an analytical expression for the control
(1.4)
which transfers the system from any given point in the region (1.3) to the origin
(1.5)
while attaining the minimum value of the quadratic functional
(1.6)
where
, and
are given numbers.
To solve the task, we introduce the auxiliary functional (see [4])
(1.7)
(1.8)
The necessary conditions of extremum for the functional (1.8) are (see [4])
(1.9)
We rewrite the optimality conditions (1.2) and (1.9) as follows:
(1.10)
(1.11)
(1.12)
2. Synthesis of a Control That Transfers the System from an
Arbitrary Point in Open Space to the Origin
We need to obtain the expressions for the variables of the system of Equations (1.10)-(1.12).
First, we write the system’s characteristic equation. To do this, we exclude
from the system (1.10) using expression (1.12). As a result, we obtain a system of order
:
(2.1)
(2.2)
Let us write the characteristic equations of system (2.1), (2.2):
(2.3)
Assume that none of the roots of this equation in the root plane lies on the unit circle with the center at the origin. Furthermore, Equation (2.3) is self-adjoint [4], which means that its roots have the property
. We assume that
are roots with a modulus less than 1 and, correspondingly,
are those with a modulus exceeding 1.
To write the solution of systems (2.1), (2.2), we will use the source (see [5])
(2.4)
where
and
are arbitrary constants,
and
are combinations with repetition [6] on the roots
and
, consisting of
and
roots, correspondingly. For instance,
From system (2.1) and solutions (2.4), it follows that
(2.5)
According to the boundary conditions, the variables
, and
must tend to zero as
. This is only possible if
. Therefore, according to solutions (2.4) and (2.5), we have
(2.6)
(2.7)
Note that solutions (2.6) and (2.7) do not require information about the multiplicity of the roots. From the resulting equations, we exclude
and obtain
(2.8)
where the determinant
(2.9)
and
is the determinant obtained from
by replacing the mth column with the vector
. Let us expand the determinant
along the column
. The result is
(2.10)
where
is the algebraic complement (cofactor) of the entry in the ith row and mth column of determinant
. In Equation (2.10), we have
(2.11)
Moreover, in Equation (2.11), we have
(2.12)
since this expression is the sum of the entries in the ith row of determinant
(see Equation (2.9)) multiplied by the cofactors of the βth row of the same determinant. Accordingly, we can write Equation (2.10) as
(2.13)
Further transformations of expression (2.13) are performed in the Appendix.
According to Equations (A.11), (2.12), and (1.12), the desired control becomes
(2.14)
Let us introduce Vieta’s numbers, defined as indicated below:
(2.15)
Now, we can rewrite expression (2.14) as
(2.16)
Under control Equation (2.16), process Equation (1.2) acquires either the form
(2.17)
or the form
(2.18)
According to Equation (2.6), we obtain
(2.19)
and
as
since the combinations
correspond to roots with a modulus less than 1. The constants
are computed from conditions (1.3).
Thus, when solving a specific problem, find the roots
, of Equation (2.3). Among these roots, select those whose modulus is less than 1. Then, construct a control Equation (2.16). Compute the constants
. Obtain the transient process Equation (2.19).
Example 1. Let us suppose that
. In this case, system (1.2) has the form
Characteristic Equation (2.3) is
(2.20)
The equation does not change if we substitute the variable
with
. This indicates that it is self-adjoint, i.e., the roots satisfy the condition
. Assume that the roots
, do not lie on the unit circle with the center at the origin and their moduli are less than 1. The desired control Equation (2.16) is written in this case as
(2.21)
with
The controlled process (2.18) is
(2.22)
From Equation (2.6), we obtain
(2.23)
where
According to Equation (2.23), we have the initial conditions
(2.24)
3. Systems of Difference Equations
Let us consider a system described by a system of difference equations of order k with constant coefficients
(3.1)
where
(3.2)
the control
is a scalar,
is the
-dimensional zero vector, and
is a constant parameter. We need to solve problem Equations (1.4)-(1.6).
Let us write system (3.1) in the form Equation (1.2) (see 5):
(3.3)
(3.4)
According to Equation (3.2), we have in Equation (3.4)
(3.5)
The
matrix
(3.6)
We assume that
.
The
matrix
and
are the columns of this matrix.
In Equation (3.3), we have
(3.7)
where
(3.8)
Let us rewrite Equation (3.3) in the form
with scalar equation
(3.9)
We have obtained the problem Equations (1.4)-(1.6). Let us write down the determinant Equation (2.3) after replacing the coefficients
, by
, as expressed in Equation (3.4). Among the 2k roots of Equation (2.3), we select roots whose modulus is less than 1. Using these roots, we construct the numbers
where
are j-combinations of the roots
. Thus, control Equation (3.9) becomes
(3.10)
According to Equation (3.9), the control
for problem Equation (3.3) is
(3.11)
Example 2. Let us consider system (3.1) when
:
(3.12)
The remarks we made in Example 1 are also valid in this case.
For system (3.12), we have
Let us write Equation (3.12) in the form
(3.13)
where, according to Equation (3.4), we have
The characteristic equation of the process is
(3.14)
The moduli of
and
are less than 1. With these roots, we construct the numbers
(3.15)
Further, according to Equation (3.11), we obtain the desired control:
(3.16)
It follows from expressions (3.13) and (3.16) that the controlled process has the form
Example 3. Stabilization of a rocket’s rotation angle relative to its longitudinal axis.
The equation of a rocket’s rotation relative to its longitudinal axis has the form
(3.17)
where
and
are, respectively, the moment of inertia and the absolute angle of rotation of the rocket relative to its longitudinal axis,
is the control torque, and
is a known moment of resistance depending only on the angle
. Let us write Equation (3.12) in difference form:
For the discrete time
, we can write the same equation in matrix form as
(3.18)
where, using the notations
and
, we have
We have obtained the problem from Example 2.
4. Conclusion
We obtained analytical expressions for optimal controls depending only on the parameters of the original system and the roots of the characteristic equations of the accompanying variational problems. The roots should not lie on the unit circle with the center at the origin. If at least one root lies on that circle, then the control problem does not have a solution. Self-oscillations arise in the system.
Acknowledgements
The author is deeply grateful to Dr. S. Trestman.
List of Mathematical Notations
: a discrete quantity,
;
: constant quantities;
: functions;
: constants;
: γ-combinations of the roots
,
;
: a determinant of order k;
: matrices.
Appendix
Transformation of expression (2.13). The algebraic complement (cofactor)
of the determinant Equation (2.9) can be written as
(A.1)
Let us transform the determinant in Equation (A.1). Multiply row
by
and subtract the result from row
, and so on; multiply row
by
and subtract the result from row
; multiply row
by
and subtract the result from row
; and so on; multiply the first row by
and subtract the result from the second row. Apply the following formula to all obtained differences [2]:
(A.2)
Multiply row
by
and subtract the result from row
. Then apply the following formula to the obtained expressions [2]:
(A.3)
From Equation (A.1), we obtain
(A.4)
(A.5)
Expand the determinant in Equation (A.5) along row
:
(A.6)
where
and
are the algebraic complements of the following determinant of order
:
(A.7)
The algebraic complements of this determinant are such that
(A.8)
(A.9)
Notice that if
, then we have
(A.10)
We use the Formula (A.10) in the method of complete induction. Next, we will show that the equality
(A.11)
holds in Equation (2.13).
Case
. We should prove that
(A.12)
Let us prove that Formula (A.12) holds when
. On the left-hand side of Formula (A.12), we obtain
The right-hand side in Formula (A.12) also equals
when
. Consequently, Formula (A.12) holds when
.
For
, according to Equation (A.10), we have
(A.13)
Plug the expression (A.13) into Equation (A.12):
(A.14)
Assume that Equation (A.11) has been proven for
and
, that is,
According to Equation (A.14), in this case we obtain
(A.15)
or
Thus, Equation (A.12) has been proven for
.
Let us consider Equation (A.11) for
. We shall prove that Equation (A.11) holds when
. We should obtain the equality
which reduces to
. This means that Equation (A.11) holds for
. Let us prove Equation (A.11) for
and
. On the left-hand side, we have
The right-hand side is
. Therefore, Equation (A.11) holds when
and
.
In the considered case, i.e., when
, it follows from Equation (A.10) that
(A.16)
whenever
. Consequently, on the left-hand side of Equation (A.11), we obtain
(A.17)
Let us now suppose that Equation (A.11) has been proven for
. If this is the case, we can write Equation (A.17) as
that is,
(A.18)
Thus, Formula (A.11) has been proven for
.
Let us now consider Equation (A.10) for
. It can be inferred from Equation (A.11) that we need to prove the formula
(A.19)
Let us transform the sum
in Equation (A.19). We denote this sum by
and rewrite it as a kth order determinant:
(A.20)
Now multiply row
by
and subtract the result from row
. Next, multiply row
by
and subtract the result from row
, and so on. Finally, multiply the first row by
and subtract the result from the second row. After all these operations, we obtain
Apply Formula (A.2) to rows
and Formula (A.3) to the last row:
(A.21)
Next,
(A.22)
The first determinant of order
on the right-hand side of Equation (A.22) coincides with the determinant
from Equation (A.7). Furthermore, the determinants
and
are related by the following formula (see Equation (A.10)):
(A.23)
Let us introduce the following notations:
(A.24)
Now we can rewrite Equation (A.22) as
From Equation (A.23) we therefore obtain
In a similar manner, we deduce that
Continuing these transformations and using Equation (A.24) and formulae
(A.25)
which are more general than Equation (A.23), we can write
(A.26)
where
Thus, we find from Equation (A.26) that
This concludes the proof of Formula (A.19).