Higher Order Strongly Biconvex Functions and Biequilibrium Problems ()
1. Introduction
Variational inequality theory, which was introduced and studied by Stampacchia [1] can be viewed as an important and significant extension of the variational principles, the origin of which can be traced back to Euler, Lagrange, Newton, and Bernoulli brothers. This theory has had a great impact and influence in the development of several branches of pure, applied, and engineering sciences. It has been shown that variational inequalities include complementarity problems, fixed-point, optimization problems, and game theory as special cases. Variational inequalities have drawn much attention from researchers because of their importance as a core model for studying many mathematical problems which include convex programming, equilibrium problem, inclusion problem, split feasibility problem, complementarity problem, minimization problem, see [2] [3].
It is well known that the minimum of differentiable convex function on a convex set can be characterized by an inequality, which is called the variational inequality. This simple fact has influenced several branches of pure and applied sciences. For the formulation, applications, numerical methods, and other aspects of the variational inequalities, see [4] - [17] and the references therein. Variational inequalities can be viewed as a novel and significant extension of the variational principles. Blum and Oettlie [18] and Noor and Oettlie [19] introduced the concept of equilibrium, which has appeared as an interesting generalization of the variational inequalities. Equilibrium problems include variational inequalities and fixed point problems as special cases. Several equilibrium problems provide us a unified framework to study unrelated arising in transportation, economics, and management sciences in a unified framework.
In recent years, several extensions and generalizations of the convex sets and convex functions have been considered and investigated. Noor et al. [20] [21] introduced the concept of biconvex sets and biconvex functions. It is known that the differentiable biconvex functions are biconvex functions. The converse also holds under certain conditions, see [20]. Noor et al. [20] [21] proved that the minimum of the differentiable biconvex functions on the biconvex set can be characterized by a class of variational inequalities, which is known as the bivariational inequality. Noor [20] [21] studied the biconvex equilibrium problems, which can be viewed as an interesting and significant extension of the variational inequalities. For the recent developments in bivariational inequalities and biconvex equilibrium problems, see [20] [21] [22] and the references therein. These results have inspired a great deal of subsequent work, which has expanded the role and applications of convexity in nonlinear optimization and engineering sciences.
In many problems, a set may not be a convex set. To overcome this drawback, the underlying set can be made a k-convex set with respect to an arbitrary function. Micherda et al. [23], Hazy [24], and Crestescu et al. [25] defined the so- called
convex function which is a natural generalization of the usual convexity, the s-convexity in the first and second sense. It is worth mentioning that
, the φ-convex functions were introduced and studied by Noor [26].
We would like to point out that biconvex sets, biconvex functions, k-convex sets, and k-convex functions are different generalizations of convex sets and convex functions in various directions. These types of functions have played a leading role in the developments of various branches of pure and applied sciences. It is natural to unify these classes of functions and to investigate their characterizations. Motivated and inspired by the recent activities in these areas, we introduce some new classes of biconvex sets and biconvex functions involving an arbitrary function k, which are called modified k-biconvex sets and k-biconvex functions. These new classes of k-biconvex sets and k-biconvex functions include the φ-biconvex sets, φ-biconvex and Toader type k-convex sets and k-convex functions. These k-biconvex functions can be viewed as modified refinement of the
convex functions of Micherda et al. [23] and Hazy [24]. Several new concepts are defined and their properties have been studied. We prove that the minimum of the differential k-biconvex functions on the k- biconvex sets can be characterized by a class of equilibrium problems. This result inspired us to consider the biequilibrium problems.
As a result of interaction between different branches of mathematical and engineering sciences, we now have a variety of techniques to suggest and analyze various iterative algorithms for solving equilibrium problems, variational inequalities and related optimization problems. Analysis of these problems requires a blend of techniques and ideas from convex analysis, functional analysis, numerical analysis and nonsmooth analysis. There are several methods for solving variational inequalities and equilibrium problems. Due to the nature of the biequilibrium problems, projection and resolvent methods can not be applied for solving directional equilibrium-like problems. To overcome these difficulties, one usually uses the auxiliary principle technique, which is mainly due to Glowinski et al. [4]. The main idea involving this technique is to first consider an auxiliary problem and then to show that the solution of the auxiliary problem is the solution of the original problem by using the fixed-point approach. Noor [9] [11] [12] [19] and Noor et al. [13] [14] [15] [16] have used this approach to suggest and analyze some iterative methods for solving various classes of variational inequalities and equilibrium problems. It is worth mentioning that one can use several principles to suggest auxiliary problem associated with the original problem. Bregman [27] introduced the convex functions involving the distance functions and discussed its applications in convex programming and optimization problems. Noor et al. [13] [14] [15] [16] and Zhu and Marcote [17] used the auxiliary principle involving the Bregman functions. They have suggested and analyzed a wide class of iterative method for solving variational inequalities and equilibrium problems. They have shown [2] [3] that the Bregman functions have some practical important types of functions such as Burg entropy, which is very important in information theory and Shannon entropy, having applications in several areas of applied mathematics such as machine learning. This shows that the entropy methods have been used in the development of methods for solving equilibrium problems in various ways. Thus one concluded the entropy technique has been used effectively in studying the variational inequalities and equilibrium problems. We again show that the auxiliary principle technique involving Bregman functions can be used to suggest some iterative schemes for solving the higher order biequilibrium problems. We prove that the convergence of these methods requires either pseudomonotonicity or partially relaxed strongly monotonicity. These are weaker conditions than monotonicity. As special cases, we obtain iterative schemes for solving biequilibrium problems and related optimization problems. The comparison of these methods with other methods is a subject of future
In section 2, we introduce and study some new concepts regarding higher order strongly biconvex functions and their properties are discussed. Main properties of the higher order strongly biconvex are discussed in Section 3. Various parallelograms have been derived in Section 4 as applications of higher order strongly k-biconvex affine functions, which can be used to characterize several inner product and Banach spaces. In Section 5, we show that the optimality conditions of the higher order strongly generalize biconvex functions can be characterized by biequilibrium problems. Using the auxiliary technique coupled with Bregman functions, we have suggested and investigated several iterative methods for solving the higher order strongly biequilibrium problems. Convergence of the proposed methods is considered using the pseudomonotone operators, which is weaker condition than monotonicity. Several special cases are discussed as applications of our results. Comparison with other methods and implementation of the suggested methods need further efforts. Several open problems are discussed for future research.
2. Preliminaries
Let
be a nonempty closed set in a normed space H. We denote by
and
the inner product and norm, respectively.
Definition 2.1. The set
is said to be k-biconvex set with respect to arbitrary function k and the bifunction
, if
(2.1)
Clearly, for
, the set
is a biconvex set
, which was introduced and studied by Noor and Noor [20].
Definition 2.2. [20] [21] The set K is said to be biconvex set with respect to arbitrary the bifunction
, if
(2.2)
If
, then (2.1) reduces to:
Definition 2.3. [23] [24] The set
is said to be k-convex set with respect to arbitrary function k, if
(2.3)
which was introduced by Hazy [13]. Also see [25] for relevant literature.
From now onwards, the set
is a k-biconvex set, unless otherwise specified.
We now introduce the concept of higher order generalized biconvex function with respect to an arbitrary function k and bifunction
.
Definition 2.4. The function f on
is called higher order generalized biconvex function, if there exists an arbitrary function k, bifunction
and a constant
, such that
(2.4)
If
, then definition 2.4 reduces to:
Definition 2.5. The function f on
is called higher order generalized biconvex function, if there exists an arbitrary function k, bifunction
and a constant
, such that
(2.5)
The higher order biconvex functions were introduced and studied by Noor et al. [20] [21]. Obviously every higher order
biconvex function with
is a higher order biconvex function, but the converse may is not true.
If
, then higher order k-biconvex functions collapse to:
Definition 2.6. The function f on
is called higher order k-convex function, if there exists an arbitrary function k, and a constant
such that
(2.6)
If
, then definition 2.6 reduces to:
Definition 2.7. The function f on K is called higher order strongly convex function, if there exists a constant
, such that
(2.7)
Higher order convex functions and their variant forms were introduced and studied by Mohsin et al. [28] and Noor et al. [15] [22] recently. It is worth mentioning that these concepts were also represent significant refinement and improvement of the concepts of higher order functions considered in Alabdali et al. [29], Olbrys [30], Hazy [24], Lin et al. [6] and Mako et al. [31]. It has been shown [15] [28] that parallelogram laws for Banach spaces can be obtained as novel applications of the higher order convex affine functions, which have application in various fields of mathematical and engineering sciences including prediction theory.
For
, the k-convex function reduces to:
Condition A The function f is said to satisfy
(2.8)
which is called the condition A.
Definition 2.8. The function f on
is said to be higher order strongly generalized quasi k-biconvex function, if there exist a function k and a constant
such that
(2.9)
Definition 2.9. The function f on
is said to be higher order strongly generalized logarithmic biconvex function, if there exist a function k and the bifunction
, such that
(2.10)
where
.
We note that, if
, then definition 2.9 reduces to:
Definition 2.10. The function f on
is said to be logarithmic biconvex function, if there exist a function k, such that
(2.11)
or equivalently, it can be written as:
Definition 2.11 The function f on
is said to be higher order strongly logarithmic generalized biconvex function, if there exist a function k, such that
(2.12)
Using this idea, we can define the higher order logarithmic generalized biconvex functions as:
Definition 2.12. The function f on
is said to be higher order strongly logarithmic generalized biconvex function, if there exist a function k, such that
(2.13)
(2.14)
which appears to be a new one.
From the above definitions, we have:
(2.15)
This shows that higher order strongly logarithmic generalized biconvex function
higher order strongly generalized biconvex functions and higher order strongly generalized biconvex functions
higher order strongly generalized quasi biconvex functions, but the converse is not true.
We remark that, if F is both higher order strongly biconvex function and higher order strongly biconcave function, then we can define the following new concept.
Definition 2.13. The function f on
is called higher order strongly biconvex affine function, if there exist an arbitrary function k and a constant
such that
(2.16)
For proper and suitable choice of the functions
and the bifunction
, one can a wide classes of higher order generalized biconvex functions and their variant forms, see [32] [33] [34] [35]. This shows that the concepts introduced in this paper are quite flexible and general ones.
We also need the following assumption regarding the bifunction
and the function
.
Condition M. Let
satisfy assumptions:
1)
(2.17)
2)
(2.18)
Remark 2.1. Let
Clearly
,if and only if,
,and
that is, the bifunction
is skew symmetric.
We now introduce the concept of k-directional derivative, which is mainly due to Noor [26].
Definition 2.14. We define the k-directional derivative of f at a point
in the direction
by
(2.19)
Note that for
and
, the k-directional derivative of f at
in the direction
coincides with the usual directional derivative of f at u in a direction v given by
It is well known that the function
is subadditive, positively homogeneous.
Definition 2.15. A differentiable function f on the biconvex set
is said to be higher order strongly pseudo k-biconvex function, iff, if there exists a constant
such that
Definition 2.16. A differentiable function f on
is said to be higher order strongly quasi-k-biconvex function, iff, if there exists a constant
such that
Definition 2.17. The function f on the set
is said to be pseudo-
- biconvex, iff,
Definition 2.18. The differentiable function f on the
is said to be quasi k-biconvex function, iff,
I All these new concepts may play important and fundamental part in the developments of mathematical programming and optimization theory.
3. Properties of Biconvex Functions
In this section, we consider some basic properties of higher order strongly generalized biconvex functions on the biconvex set
.
Theorem 3.1. Let F be a differentiable function on the biconvex set
in H and let the condition M hold. Then the function F is higher order generalized biconvex function, if and only if,
(3.1)
Proof. Let f be a higher order generalized biconvex function on biconvex set
. Then,
which can be written as:
Taking the limit in the above inequality as
, we have
which is the required (20).
Conversely, let F satisfy (20). Then,
,
and using the condition M, we have
(3.2)
In a similar way, we have
(3.3)
Multiplying (3.2) by
and (3.3) by
and adding the resultant, we have
showing that F is a higher order strongly biconvex function.
Theorem 3.2. Let F be differentiable higher order generalized biconvex function on the biconvex set
. If F is a higher order strongly biconvex function, then,
(3.4)
Proof. Let F be a higher order strongly biconvex function on the biconvex set
. Then,
(3.5)
Changing the role of u and v in (24), we have
(3.6)
Adding (24) and (25), we have
(3.7)
which shows that
is a higher order strongly monotone operator.
Theorem 3.3. If the differential
is a higher order strongly monotone, then,
Proof. Let
be a higher order strongly
-monotone. From (26), we have
(3.8)
Since K is an biconvex set,
,
,
. Taking
in (27) and using Condition M, we have
which implies that
(3.9)
Let
. Then, from (28), we have
(3.10)
Integrating (3.10) between 0 and 1, we have
that is
By using Condition A, we have
the required result.
We now give a necessary condition for higher order strongly pseudo-biconvex function.
Theorem 3.4. Let
be a higher order strongly relaxed k-pseudomonotone operator and Conditions A and M hold. Then
(3.11)
Proof. Let
be higher order relaxed k-pseudomonotone. Then,
,
implies that
(3.12)
Since
is an biconvex set,
,
,
.
Taking
in (3.12) and using condition Condition M, we have
(3.13)
Let
Then, using (3.13), we have
Integrating the above relation between 0 to 1, we have
that is,
which implies, using Condition A,
which is the required (3.11).
Theorem 3.5. Let the differential F’(u) of a differentiable biconvex function
be Lipschitz continuous on the biconvex set
with a constant
. Then,
Proof. Its proof follow from Noor and Noor [22].
Definition 3.1. The function F is said to be sharply higher order strongly pseudo biconvex, if there exists a constant
such that
Theorem 3.6. Let F be a sharply higher order strongly pseudo biconvex function on
with a constant
. Then
Proof. Let F be a sharply higher strongly pseudo generalized biconvex function on
. Then
from which we have
Taking limit in the above-mentioned inequality, as
, we have
the required result.
Definition 3.2. A function F is said to be a higher order strongly pseudo biconvex function with respect to strictly positive bifunction
, if
Theorem 3.7. If the function F is higher order strongly biconvex function such that
, then the function F is higher order strongly pseudo biconvex.
Proof. Since
and F is higher order strongly biconvex function, then
, we have
where
. This shows that the function F is higher order strongly pseudo biconvex.
4. Applications
In this section, we derive new parallelogram laws for uniformly Banach spaces as a novel application of higher order strongly biconvex functions.
From definition 2.13, we have
(4.1)
Taking
in (4.1), we have
(4.2)
which is known as the generalized parallelogram-like laws for the Banach spaces involving higher order generalized biconvex functions.
We now discuss some special cases of the generalized parallelogram-like laws.
1) If
,
, then, Equation (4.2) becomes
(4.3)
2) If
,
, then (4.3) reduces to the parallelogram-like law as:
(4.4)
which is known as the parallelogram-like law for the uniform Banach spaces involving the biconvex functions. Xu [36] obtained these characterizations of p- uniform convexity and q-uniform smoothness of a Banach space via the functionals
and
, respectively. Bynum [37] and Chen et al. [38] [39] have studied the properties and applications of the parallelogram laws for the Banach spaces. For the applications of the parallelogram laws in Banach spaces in prediction theory and applied sciences, see [36] [37] [38] [39] and the references therein.
3) If
,
, then parallelogram law (4.2) reduces to:
(4.5)
This is a new parallelogram law, which characterizes the inner product spaces involving bifunction
.
4) If
,
, then parallelogram law (37) becomes
(4.6)
which is a well known parallelogram and characterizes the inner product spaces.
Remark 4.1. In this section, we have derived some new parallelogram laws as important applications of the higher order strongly biconvex functions. For suitable and appropriate choice of the function k, bifunction
and parameter p, one can obtain a wide class of parallelogram laws, which can be used to characterize various classes of inner products. Applications of the new parallelogram laws in different areas are an open problem for future research.
5. Biequilibrium Problems
In this section, we introduce the biequilibrium problems. We also use the auxiliary principle techniques coupled with Bregman functions to consider the convergence criteria of the proposed iterative methods. This is the main motivation of this section.
For the readers convenience, we recall some basic properties of the Bregman [27] distance functions on the convex set K. For strongly convex function F, we define the Bregman distance function as:
(5.1)
It is important to emphasize that various types of function F gives different Bregman distance. We give the following important examples of some practical important types of function F and their corresponding Bregman distance, see [2] [3].
Examples
1) If
, then
, which is the squared Euclidean distance (SE).
2) If
, which is known as Shannon entropy, then its corresponding Bregman distance is given as:
.
This distance is called KullbackLeibler distance (KL) and as become a very important tool in several areas of applied mathematics such as machine learning.
3) If
, which is called Burg entropy, then its corresponding Bregman distance is given as:
This is called ItakuraSaito distance (IS), which is very important in information theory.
It is a challenging problem to explore the applications of Bregman distance for other types of nonconvex functions as biconvex, k-convex functions and harmonic functions.
We now discuss the optimality for the differentiable higher order generalized biconvex functions.
Theorem 5.1. Let F be a differentiable higher order strongly biconvex function with modulus
. If
is the minimum of the function F, then
(5.2)
Proof. Let
be a minimum of the function F. Then,
(5.3)
Since
is an biconvex set, so,
,
,
.
Taking
in (5.3), we have
(5.4)
Since F is differentiable higher order strongly biconvex function, so
from which, using (5.4), we have
the required result (5.2).
We would like to mention that, if
satisfies the inequality,
(5.5)
then
is the minimum of the function F. The inequality of the type (5.5) is called the higher order strongly biequilibrium problem and appears to new one.
It is worth mentioning that inequalities of the type (5.5) may not arise as the minimization of the higher order strongly biconvex functions. This motivated us to consider a more general higher order strongly biequilibrium problem of which (5.5) is a special case.
To be more precise, for given operator D, bifunction
and a constant
, consider the problem of finding
, such that
(5.6)
which is called the higher order strongly biequilibrium problem.
1) If
, then the higher order strongly biequilibrium problem (2.1) reduces to finding
such that
which is called the biequilibrium problem. For the formulation, numerical methods and other aspects of the bivariational inequalities and biequilibrium problem, see [28] [30].
2) If f
, where A is a nonlinear operator, then the higher order strongly biequilibrium problem (2.1) is equivalent to finding
such that
which is the higher order strongly bivariational inequality and appears to be a new one.
It is worth mentioning that for suitable and appropriate choice of the operators,
-biconvex sets and spaces, one can obtain a wide class of equilibrium problem, variational-like inequalities and optimization programming. This shows that the higher order strongly biequilibrium problems are quite flexible and unified ones.
Due to the inherent nonlinearity, the projection method and its variant form can not be used to suggest the iterative methods for solving these higher order strongly biequilibrium problems. To overcome these drawback, one may use the auxiliary principle technique of Glowinski et al. [11] as developed by Noor [26] [28] [30] Noor et al. [14] [15] [16] to suggest and analyze some iterative methods for solving the higher order strongly biequilibrium problems (5.6). This technique does not involve the concept of the projection, which is the main advantage of this technique.
We again use the auxiliary principle technique coupled with Bergman distance functions. These applications are based on the type of convex functions associated with the Bregman distance function. We now suggest and analyze some iterative methods for higher order strongly biequilibrium problems (5.6) using the auxiliary principle technique coupled with Bregman functions as developed by Noor [28] [30].
For a given
satisfying the biequilibrium problem (5.6), we consider the auxiliary problem of finding a
such that
(5.7)
where
is a constant and
is the differential of a strongly biconvex function
at
.
Remark 3.1: The function
associated with the biconvex function
is called the generalized Bregman function. By the strongly biconvexity of the function
, the Bregman function
is nonnegative and
, if and only if
,
. For the applications of the Bregman function in solving variational inequalities and complementarity problems, see [28] [30].
We note that, if
, then clearly w is solution of the higher order strongly biequilibrium problem (5.6). This observation enables us to suggest and analyze the following iterative method for solving (2.1).
Algorithm 3.1. For a given
, compute the approximate solution
by the iterative scheme:
(5.8)
where
is a constant. Algorithm 3.1 is called the proximal method for solving higher order strongly biequilibrium-like problem (5.6). In passing we remark that the proximal point method was suggested in the context of convex programming problems as a regularization technique.
If
, then Algorithm 3.1 collapses to:
Algorithm 3.2. For a given
, compute the approximate solution
by the iterative scheme:
for solving the bivariational inequality.
For suitable and appropriate choice of the operators and the spaces, one can obtain a number of known and new algorithms for solving variational inequalities and related problems.
Definition 2.2. The bifunction
is said to be:
1) monotone, iff,
2) pseudomonotone with respect to
, iff,
3) higher order strongly partially relaxed monotone, if there exists a constant
such that
Note that for
higher order strongly partially relaxed monotonicity reduces to monotonicity. This shows that higher order strongly partially relaxed monotonicity implies monotonicity, but the converse is not true.
Theorem 5.2. Let the bifunction
be pseudomonotone with respect to
. If E be differentiable higher order strongly biconvex function with module
, then the approximate solution
obtained from Algorithm 3.1 converges to a solution
satisfying the biequilibrium problem (5.6).
Proof. Let
be a solution of (5.6). Then,
implies that
(5.9)
since
is pseudomonotone with respect to
.
Taking
in (5.8) and
in (5.9), we have
(5.10)
And,
(5.11)
We now consider the Bregman function
(5.12)
using higher order strongly biconvexity of E.
Now combining (5.10), (5.11) and (5.12), we have
If
, then clearly
is a solution of the problem (5.6). Otherwise, it follows that
is nonnegative and we must have
from which, we have
It follows that the sequence
is bounded. Let
be a cluster point of the subsequence
, and let
be a subsequence converging toward
. Now using the technique of Zhu and Marcotte [17], it can be shown that the entire sequence
converges to the cluster point
satisfying the biequilibrium problem (5.6).
It is well-known that to implement the proximal point methods, one has to find the approximate solution implicitly, which is itself a difficult problem. To overcome this drawback, we now consider another method for solving the higher order strongly biequilibrium problem (5.6) using the auxiliary principle technique.
For a given
, find
, such that
(5.13)
where
is the differential of a strongly k-biconvex function
at
. Note that problems (5.13) and (5.8) are quite different problems. It is clear that for
, w is a solution of (5.6). This fact allows us to suggest and analyze another iterative method for solving the higher order strongly biequilibrium problem (5.6).
Algorithm 3.3. For a given
, compute the approximate solution
by the iterative scheme:
(5.14)
for solving the higher order strongly biequilibrium problem (5.6).
If
, Algorithm 3.3 collapses to:
Algorithm 3.4. For a given
, compute the approximate solution
by the iterative schemes:
for solving the higher order strongly bivariational inequalities and appears to be a new one.
Discussion of Results: We have introduced and investigated higher order strongly biequilibrium problems. The auxiliary principle technique coupled with Bregman distance functions is used to suggest some iterative methods for solving biequilibrium problems, which is the main contributions of this section. We also mention that for suitable and appropriate choice of the operators and the spaces, one can obtain various known and new algorithms for solving higher order strongly equilibrium problem (5.6) and related optimization problems. It is an interesting problem from both analytically and numerically point of view.
6. Conclusion
In this paper, we have introduced and studied some new classes of biconvex functions, which are called higher order strongly biconvex functions. These concepts are more general and unifying than the previous ones. Several new properties of these higher order strongly biconvex functions are discussed and their relations with previously known results are highlighted. Several parallelogram laws for inner product spaces and Banach spaces are obtained as applications of the higher order strongly k-convex functions, which is its can viewed as novel applications of higher order strongly biconvex functions. It is shown that the optimality conditions of the differentiable k-biconvex functions can be characterized by a class of higher order strongly biequilibrium problems. This result is used to introduce some new classes of higher order strongly biequlibrium problems. The auxiliary principle technique involving the Bregman functions are used to suggest and investigate some iterative methods for solving higher order strongly biequilibrium problem. These techniques include the entropy method and its variant forms. Consequently, we can conclude that the entropy methods have played an important in the analysis of the convergence criteria of the proposed methods implicitly. It is itself an interesting problem to develop some efficient numerical methods for solving higher order strongly biequilibrium problems along with their applications in pure and applied sciences. Despite the current activity, much clearly remains to be done in these fields. It is expected that the ideas and techniques of this paper may be the starting point for future research activities.
Acknowledgements
We wish to express our deepest gratitude to our colleagues, collaborators, and friends, who have direct or indirect contributions in the process of this paper. We are also like to thank the Rector, COMSATS University Islamabad, Pakistan for the research facilities and support in our research endeavors.