1. Introduction
Game theory is the study of mathematical decision-making made by a finite number of players either as individuals or in coalitions. A player’s choices are made according to his approach of treating both himself and others, as well as to his expectation of the actions of the other players. In cooperative games, there is competition between groups of players, whereas in noncooperative games, there is competition between individual players. Games may also involve an arbitrator who selects the players’ strategies in some hopefully reasonable way.
Historically, Borel informally introduced two-person zero-sum game theory beginning in 1921 as summarized in Borel (1941) and discussed by Fréchet in 1953. Borel did not establish the minimax theorem, which von Neuman later did in 1944, and also considered there cooperative coalitional games as well as noncooperative zero-sum games. Subsequently in Nash (1950a), Nash assumed each player was selfish and established that an equilibrium for noncooperative games always exists in mixed strategies. In Nash (1950b), he further formulated and solved a game-theoretic bargaining problem. Much later, Bacharach (1987) formalized an axiomatic theory of solutions for normal-form games.
More specific to this work, von Neumann and Morgenstern (1944) considered cooperative games with coalitions in which the players within a coalition collaborate for their mutual benefit in competing with other coalitions. They defined the notion of a solution to such a game as the core, a certain set of undominated rewards for the game’s players reminiscent of Pareto maxima. This definition was refined by Gillies in (2016). Later, Shapley provided an alternative solution concept for cooperative games, and the resulting Shapley value gives more equitable solutions than does the core (Shapley, 1951; Winston, 1987).
Although von Neumann and Morgenstern (1944) defined the core of a cooperative game, they provided no method for the players to agree on a particular member of the core. One method for doing so is for the players to agree to an arbitrator’s choice. Raiffa (1953) defined an arbitration scheme for a given generalized two-person game to yield a unique mixed strategy for the arbitrator to enforce. Unlike Raiffa’s mixed-strategy model for two-person games, Rosenthal (1976) presented a single Pareto-optimal pure strategy reflecting the relative strengths of the players for the arbitrator to select. Later, Kalai and Rosenthal (1978) devised schemes for an arbitrator to assign a fair outcome in the game where two players possess complete information.
More recently, Bacharach (1999) expressed the interactions between players who choose to act as individuals sometimes and as teams at other times with the possibility of being in more than one team. Unlike the model of Bacharach (1999), where players vacillate between acting as individuals and as teams, Bacharach et al. (2006) also considered a team reasoning approach where players made the optimal decisions for their respective teams without having determined the optimal teams and without considering themselves individually.
As opposed to Bacharach (1999) and Bacharach et al. (2006), our development involves games in which there is competition between players as individuals, as well as cooperation between the players in a coalition. With a somewhat similar goal, Kalai and Kalai (2013) decomposed a two-person normal-form game with transferable utility into cooperative and competitive components to determine the original game’s so called coco (competitive and cooperative) value that assigns payoffs to the two players.
In further related literature, Gerber (2000) interpreted a general nontransferable utility game as a collection of pure bargaining games that can be played by individual coalitions and developed a solution concept that predicts which coalitions are formed and how the payoffs are distributed. Similarly, Gomes (2022) proposed a new solution for coalition bargaining among n players. For any coalition, there is a fixed probability that it will form and known payoffs for the players if it does. Bloch (2003) considered the formation of coalitions as a consequence of spillovers, that is, the impact that seemingly unrelated events in one nation can have on the economy of another nation.
The notion of coalitional equilibria was considered by Gavan (2022) and Ray (1997) who gave conditions under which a Nash equilibrium exists for coalitions when the coalitions are taken as the players. Then in an approach applied in this paper to avoid the existence and computational issues of the Nash equilibrium, Corley (2017) defined the notion of a scalar equilibria that maximizes a scalar objective function. In addition, Corley (2017), as well as Nahhas and Corley (2018), discussed the difficulties with the interpretation and use of mixed strategies in games. As a consequence, we consider only pure strategies here.
In this paper, we consider an n-person normal-form game G with payoffs measured in the same units of some transferable utility allowing side payments among the players. The goal of the n players is to maximize their individual payoffs as much as jointly possible. Toward that end, we form all possible sets of mutually exclusive and collective exhaustive coalitions of the n players, including the set of singleton coalitions of the original game. For each set of coalitions, we define a coalitional semi-cooperative game of G as one in which coalitions are taken as the players of this new game, each coalition wants to maximize the sum of its individual players’ payoffs among their possible pure strategies, and the players within a coalition may cooperate to do so with the inducement of side payments between them. For each coalitional semi-cooperative game, we determine its Greedy Scalar Equilibria, where a Greedy Scalar Equilibrium (GSE) is an analog of the Nash equilibrium modeling selfishness but always exists in pure strategies. Next we select an optimal set of coalitions for G by comparing the GSEs of its coalitional semi-cooperative according to a specified criterion, and finally we present examples.
The paper is organized as follows. We present preliminary notation, definitions, and results in Section 2. In Section 3 we formally define a coalitional semi-cooperative game and present an algorithm for selecting an optimal set of coalitions. Two examples are given in Section 4, and conclusions are stated in Section 5.
2. Preliminaries
Let
be an n-player game where
is the set of players,
is the finite set of
pure strategies for player i, and
is the transferable utility of player i for an action profile
. The
matrix of n-tuples
for all
is called the payoff matrix for G, and a game given in terms of a payoff matrix is called a normal-form game as usual. As discussed in Corley (2017), we consider here only pure strategies (or actions) for the players since mixed strategies are known to be difficult to calculate, interpret, and implement except possibly in repeated games. The average payoff of player i
(i.e., the arithmetic mean of his payoffs over S) is
, where
is the finite number of pure strategy profiles in S. An action profile
is a Nash equilibrium (NE) if no player with a unilateral change of strategy can increase his payoff. While an NE always exists in mixed strategies for G, one may not exist in pure strategies.
For the game G, assume that each player is greedy and desires a payoff as high as jointly possible. Consider the scalar utility function
defined in Corley (2017) as
(1)
where
. A pure strategy profile
is called a Greedy Scalar Equilibrium (GSE) for G if and only if
maximizes
over S. From (1), a GSE
has the property that each
is as close as jointly possible to the corresponding
. The reason is that the maximization of (1) is a discrete
version of the continuous problem of maximizing
subject to the
constraints
, for which the optimal xi’s are 0. Setting
in (1) establishes the relationship between the two problems. From the above discussion, it follows that the GSE may be construed as a scalar analog of the NE since each player is greedy and wants a payoff as high as possible. As opposed to an NE, however, a GSE always exists in pure strategies.
It should be noted that a GSE for one payoff matrix cannot be directly compared to a GSE for a different payoff matrix (i.e., a GSE for a different game). In addition, Corley (2017) proves that the GSE is Pareto maximal over all the strategies of G. In other words, the n-tuple of payoffs
associated with a GSE
is not dominated component wise by any other
in the payoff matrix.
3. Determining an Optimal Set of Coalitions for a Normal-Form Game
A coalition P of G is a nonempty subset of the set of n players I. A complete set Ω of coalitions for G is a set of Q mutually exclusive and collectively exhaustive subsets of I (i.e., a partition of I). For example, the coalition
is called the grand coalition, while
, represent the complete set of singleton coalitions. A complete set Ω of coalitions is written with the coalitions enumerated in order beginning from the lowest numbered player in each coalition and with the individual coalitions enclosed within vertical bars. Moreover, each individual coalition is written in ascending order of its players’ numbers separated by commas. In particular, coalition
has Ck players denoted
. We would thus write Ω as
.
Associated with G and an arbitrary complete set Ω of coalitions is a Q-person game Γ whose players are the Q coalitions of Ω. These players are called coalitional players. Γ is a distinct game from G, but a strategy for the coalitional player P of Γ is a tuple of the individual strategies in G for the players composing P. The payoff for the coalitional player P at a given strategy profile for Γ is the sum of the utilities for the players of P in the payoff matrix of G for the strategy profile of G corresponding to the given strategy profile in Γ. For a given Ω, Γ is called a Q-person coalitional semi-cooperative game of G if there is competition among the coalitions defining Ω and cooperation by the players within each coalition.
In particular, consider the coalitional semi-cooperative game Γ with a set of Q coalitional players. We can specify Γ more completely as
. A strategy profile t of
is written as
with a corresponding payoff vector
, where
, are the payoffs of players
of coalition k, respectively, in the payoff matrix of G evaluated at the n players’ individual strategies in t.
As an example, suppose that 5 coalitions are formed in a 12-player normal-form game G. Let players 1, 3, 4 form one coalition; players 2, 11 a second; players 5, 8, 9 a third; players 6, 10, 12 a fourth; and player 7 a fifth. The associated 5-person coalitional semi-cooperative game Γ is denoted
with the coalitions enclosed within vertical bars and the players in each coalition arranged in ascending order and separated by commas. Each strategy profile for
is written as
with corresponding payoff
obtained from the payoff matrix for G.
Since an individual coalition P of G is a nonempty subset of I, there are
possible individual coalitions that can be formed from the players of G. Moreover, the number of complete sets of coalitions for the
players of G is precisely the number of partitions of I, which is known as the Bell number Bn (https://en.wikipedia.org/wiki/Bell_number, accessed 9/04/2022). For example,
,
,
, and
. More Bell numbers are found at (https://oeis.org/, accessed 9/04/2022). There is no known simple formula for the Bn. However, a recurrence relation is given in (https://www.whitman.edu/mathematics/cgt_online/book/section01.04.html, accessed 9/04/2022), where it is also noted that Bn increases exponentially with n. Thus for large n, comparing the Bn possible complete sets of coalitions of G to obtain an optimal one, as next described, will be computationally intensive.
We now develop an approach for selecting an optimal complete set
of coalitions for the n players of G. For each possible Ω and associated coalitional semi-cooperative game
and for each payoff matrix cell of this game corresponding to a GSE of Γ, we divide the total payoff for each coalition among its members in the same proportions as its members average over the whole payoff matrix of G. Doing so gives n new individual player payoffs associated with each GSE. These new payoffs are called modified payoffs. Then for each GSE of Γ (its players being coalitions), we compute the geometric mean of the n modified payoffs associated with this GSE. Denote the largest of these geometric means for Γ as GM (Ω), which becomes a decision metric. We then designate
as an optimal complete set of coalitions for G if
maximizes GM (Ω) over the Bn possibilities. The associated coalitional semi-cooperative game is written
. There may be multiple
and
. Ties could be broken by the players or by an arbitrator. Since any
corresponds to a GSE of some
, then
models the selfishness of the coalitions. Moreover,
minimizes the variability between the modified payoffs of the n players by analogy with the fact that geometric mean of numbers
is maximized when
are equal. In other words, fairness is enforced. We now present Algorithm 1 below to determine an
for a given G.
4. Examples
In this section, we present two examples to illustrate Algorithm 1. In Example 1, the GSE of the original game G is different from the GSE of the coalitional game for the optimal set of coalitions in Step 9. Unlike Example 1, in Example 2 the GSE of the coalitional game for an optimal set of coalitions in Step 9 coincides with the GSE of the original game G.
Example 1
Let G be a 3-player game in normal-form where the strategies for player i are
and
,
, as shown in the payoff matrix of Table 1.
To determine an optimal set of coalitions to form using Algorithm 1, consider the coalitional semi-cooperative games of G. There are five possibilities. The first possibility consists of two coalitions: coalition I consisting of player 1 alone and coalition II consisting of players 2 and 3. We model the associated coalitional semi-cooperative game consisting of coalition I versus coalition II as a two-player normal-form game
, where coalition I is construed as the first player and coalition II as the second player. Similarly, the other possibilities are
,
,
, and
. In Step 1 of Algorithm 1,
,
and
. Now consider
with payoff matrix in Table 2 as determined in Step 2.
Coalition II in
has four strategies, which are simply all combinations of the strategies of players 2 and 3. For example, the cell
in Table 2 has the payoff vector
where the payoff 10 for coalition II comes from cell
in Table 1 by adding the payoffs 5 for player 2 and 5 for player 3. Note that in Table 2, none of the original strategies of G has been omitted. There are still 8 possibilities. Table 3 represents the GSE matrix of
of Step 3 with the bold value 0.2500 for the two GSEs
and
with their corresponding payoffs in
as
and
respectively.
In Step 4,
for player 1 in coalition I and the sum of the averages of players 2 and 3 in coalition II is
. In Step 5,
Table 2. Payoff Matrix for
.
,
and
. In Step 6, the new
payoffs corresponding to the first GSE of
for player 1 is 6 because player 1’s ratio of contribution to coalition I is
. The payoff for coalition II corresponding to this GSE of
is divided between players 2 and 3 using their ratios of contribution
and
respectively. Player 2’s new payoff is
and the new payoff of player 3 is
. The modified payoffs corresponding to this GSE of
are
, and the geometric mean of this payoff in Step 7 is
. The new payoff corresponding to the second GSE of
for player 1 is 3 since
. The payoff for coalition II corresponding to the GSE of
is again divided between players 2 and 3 using
and
respectively. Player 2’s new payoff is
and the new payoff of player 3 is
. The modified payoff corresponding to this GSE of
is
, and the geometric mean of this payoff as in Step 7 is
.
In Step 8, we consider the remaining coalitional games and repeat Steps 2 to 7 for each of these games. Next is the game
made of two coalitions where coalition I consists of players 1 and 2 and coalition II consists of player 3 alone. In Step 2, the payoff matrix for
is Table 4. Table 5 shows the GSE matrix
Table 3. GSE Matrix for
.
Table 4. Payoff Matrix for
.
of
of Step 3 with GSEs
and
with respective payoffs
and
in
.
The sum of the averages of players 1 and 2 in Step 4 is
and player 3’s in coalition II is
. In Step 5,
,
and
. In Step 6, player 1’s new payoff corresponding to the first GSE
is
, and player 2’s is
. In coalition II,
since player 3 is the only player in it. Thus player 3’s new payoff corresponding to this GSE of
is 5. The modified payoff of all three players that corresponds to this GSE of
is
in Step 6, and the geometric mean of this modified payoff in Step 7 is
. Again in Step 6, player 1’s new payoff corresponding to the second GSE
is
, and player 2’s is
. In coalition II,
since player 3 is the only player in it. Hence player 3’s new payoff corresponding to this GSE of
is 7. The modified payoff of all three players that corresponds to this GSE of
is
, and the geometric mean of the modified payoff in Step 7 is
.
Now consider the game
with two coalitions where coalition I comprises players 1 and 3 and coalition II comprises player 2 alone. The payoff matrix for
in Step 2 is Table 6. Then in Step 3, Table 7 is the GSE matrix for
with GSEs
and
with respective payoffs
and
.
The sum of the averages of players 1 and 3 in Step 4 is
Table 6. Payoff Matrix for
.
Table 7. GSE Matrix for
.
and the sum of the average of player 2 in coalition II is
. In Step 5,
,
, and
. In Step 6, player
1’s new payoff corresponding to the first GSE
is
, player 2’s new payoff is 5 since
, and player 3’s is
. The modified payoff of all three players corresponding to this GSE of
is
, and the geometric mean of the modified payoff in Step 7 is
. Again in Step 6, player 1’s new payoff corresponding to the second GSE
is
, player 2’s new payoff is 6 since
, and player 3’s is
. The modified payoff of all three players corresponding to this GSE of
is
, and the geometric mean of the modified payoff in Step 7 is
.
We next consider the grand coalition in which all players of G form the single coalition
. Table 8 gives the corresponding payoff matrix from Step 2. Then the GSEs of
in Step 3 are
and
with respective payoffs in Table 9 as 16.
In Step 4,
. Moreover,
,
, and
in Step 5. In Step 6, Player 1’s new
payoff corresponding to the first GSE
is
, player 2’s new payoff is
, and player 3’s is
. The modified payoff of all three players corresponding to the first GSE of
is
, and the geometric mean of the modified payoff in Step 7 is
. Similarly, the modified payoff and geometric mean corresponding to the second GSE
are
and 4.9703 respectively.
Finally, consider the game
with three coalitions in which each player constitutes a coalition unto himself. The payoff matrix of
in Step 2 is Table 1. In
Table 8. Payoff Matrix for
.
Step 3, the GSE matrix of
is depicted in Table 10 with GSE
and corresponding payoff in Table 11 as
. Thus each player’s new payoff corresponding to the GSE of
is the corresponding payoff in G.
In Step 4,
and
. Since each player is a coalition onto himself,
from Step 5. The modified payoff of all three players that corresponds to the GSE of
is
, and the geometric mean of this modified payoff in Step 7 is
.
The geometric means GM (Ω) of the game G are 4.9805 and 4.7159 for
, 5.1070 and 5.0132 for
, and 5.2991 and 5.2877 for
. In addition, the geometric mean of
is 5.0132 and that of
is 4.9703. Then according to Step 9, the best complete set of coalitions is given by
since the associated geometric mean is the largest among all the geometric means for the coalitional semi-cooperative games of G. Hence the optimal complete set of coalitions is
.
Note in Example 1 that the three players get the modified payoffs
from the coalitional game
instead of the payoff
from
, i.e., the original game G. These modified payoffs for players 2 and 3 are smaller than their payoffs in
. But as previously mentioned, fairness is enforced in the following ways. The
’s in Step 5 of Algorithm 1 ensure that the players’ new payoffs after joining their respective coalitions are in the same proportions as their average payoffs over the game G. In addition, the geometric mean minimizes the variability in the modified payoffs for the best coalition and gives the n players payoffs that are jointly closest together. These observations result from the Algorithm 1’s trade-off between the selfish behavior of each coalition as a whole in Step 3, as well as from the cooperative behavior for each individual player within his coalition with the understanding that he will be fairly treated as in Steps 6 and Step 7. Finally, observe in Example 1 that the maximum GSE
corresponding to
and the maximum GSE
of the original game G are different. We next present an example where they coincide.
Example 2
Let G be a 3-player game in normal form where the strategies for player i are
and
,
, as shown in the payoff matrix of Table 11.
To determine a best complete set
of coalitions in the sense of Algorithm 1), consider the coalitional semi-cooperative games Γ of G. There are five possibilities, namely
,
,
, and
. In Step 1 of Algorithm 1,
,
and
. Now consider
with payoff matrix Table 12 as in Step 2. Then Table 13 represents the GSE matrix of
as in Step 3 with GSE
and corresponding payoffs
.
In Step 4,
for player 1 in coalition I, and the sum of the averages of players 2 and 3 in coalition II is
. In Step 5,
,
, and
. In Step 6, the new
payoff corresponding to the GSE of
for player 1 is 5 because
. The payoff for coalition II corresponding to the GSE of
is divided between players 2 and 3 using
and
respectively. Player 2’s modified payoff is
, and the modified payoff of player 3 is
. The modified payoffs corresponding to the GSE of
are
. and the geometric mean in Step 7 is
.
In Step 8, we consider the remaining coalitional games and repeat Steps 2 to 7 for each of these games. Next is
with coalition I consisting of players 1 and 2 and coalition II consisting of player 3 alone. In Step 2, the payoff matrix for
is given in Table 14. Table 15 then shows the GSE matrix of
of Step 3 with GSE
and corresponding payoff
in
.
The sum of the averages of players 1 and 2 in Step 4 is
and player 2’s in coalition II is
. In Step 5,
,
and
. Player 1’s new payoff in Step 6 is
, and player 2’s is
. For coalition II,
since player 3 is the only player in it. Thus player 3’s modified payoff corresponding to the unique GSE is 2. The modified payoffs for all three players are
, and the geometric mean of the modified payoffs of Step 7 is
.
Now consider the game
with two coalitions, where coalition I has players 1 and 3 while coalition II has player 2 alone. The payoff matrix for
in Step 2 is Table 16. Then Table 17 for Step 3 shows the GSE matrix with GSE
, with payoff
in Table 16.
The sum of the averages of players 1 and 3 in Step 4 is
and the sum of the average of player 2 in coalition II is
. In Step 5,
,
, and
. In Step 6, player
1’s new payoff is
, player 2’s new payoff is 7 since
, and player 3’s is
. The modified payoffs of all three players corresponding to the GSE of
are
, and the geometric mean of the modified payoffs in Step 7 is
.
We next consider the grand coalition of G and the associated
. Table 18 gives the corresponding payoff matrix from Step 2. The GSE of
in Step 3 is
in Table 19 with corresponding payoff 14 in Table 18.
In Step 4,
. Moreover,
,
, and
in Step 5. In Step 6, Player 1’s new payoff corresponding to the GSE is
, player 2’s new payoff is
, and player 3’s is
. The modified payoffs of all three players corresponding to the unique GSE of
are
, and the geometric mean of the modified payoffs in Step 7 is
.
Next consider
with three coalitions in which each player constitutes a coalition unto himself. The payoff matrix of
in Step 2 is Table 11. In Step 3, the GSE matrix of
is depicted in Table 20 with GSE
and corresponding payoff in Table 11 as
. Each player’s modified payoff corresponding to the GSE is the corresponding payoff for G.
In Step 4,
. Moreover,
,
, and
in Step 5. In Step 6, Player 1’s new
payoff corresponding to the GSE is
, player 2’s new payoff is
, and player 3’s is
. The modified payoffs of all three players corresponding to the unique GSE of
are
, and the geometric mean of the modified payoffs in Step 7 is
.
Next consider
with three coalitions in which each player constitutes a coalition unto himself. The payoff matrix of
in Step 2 is Table 11. In Step 3, the GSE matrix of
is depicted in Table 20 with GSE
and corresponding payoff in Table 11 as
. Each player’s modified payoff corresponding to the GSE is the corresponding payoff for G.
In Step 4,
, and
. Since each player is a coalition unto himself,
from Step 5. The modified payoffs corresponding to the GSE of
in Step 6 are thus
, and the geometric mean of the modified payoffs in Step 7 is
.
In summary, the geometric means of all coalitional semi-cooperative games for G are 4.6509, 4.1579, 4.3885, 4.6432, 4.1212 for
,
,
,
,
, respectively. According to Step 9, the optimal complete set of coalitions is
.
5. Conclusion
The principle contribution of this work is the development of a simple approach for forming coalitions in n-person normal-form games where only pure strategies for the players are considered. In particular, the notion of a coalitional semi-cooperative game studied here models a normal-form game with both cooperative and competitive aspects. An optimal set of coalitions is then obtained via Algorithm 1. In this approach, we use the GSE, which gives players their largest individual payoffs jointly possible, always exists in pure strategies, and can be readily computed. We note that in the examples of section 4, Algorithm 1 determines coalitions that, in fact, seemed intuitively optimal. In Example 1, the optimal set of coalitions is
with the strategies
yielding the associated GSE for
. The original payoffs for G were (6, 5, 5), which had the largest sum in the payoff matrix. Because of the cooperation required to form these coalitions, however, the players would actually receive (4.8, 5, 6.2) since players 2 and 3 usually had lower payoffs in the payoff matrix than 5 and 5, respectively. Similar remarks can be made about Example 2 with an optimal set of coalitions
.
There is an immediate conceivable extension to this paper. The coalitions formed here are based on the assumption that the players want their respective coalitions to obtain the largest possible payoffs. We used the GSE to model this greediness. However, the coalitions need not be greedy. Future work might define optimal coalitions using other scalar equilibria than the GSE. Alternatives can be found in Corley (2017).