Existence of Correlated Equilibria III: A Game with Compact Hausdorff Strategy Spaces and Continuous Payoffs Has a Countably Additive Correlated EquilibriumResearch Paper
Motivation
A correlated equilibrium (Aumann 1974) describes play in a game where a mediator draws a profile of recommended actions from a joint distribution and tells each player only that player's own recommendation; the distribution is an equilibrium when no player gains, on average, by departing from the recommendation. Correlated equilibria are the natural outcome of regret-minimizing learning dynamics and the solution concept underlying much of algorithmic game theory, so it matters in which games they are guaranteed to exist.
For finite games existence follows from Nash's theorem, since every Nash equilibrium is a correlated one. Hart and Schmeidler (1989) gave a direct proof based on linear duality, with no fixed-point theorem, and then extended it beyond finite games. This mission formalizes the last and most general of their three existence theorems: games with arbitrarily many players whose strategy spaces are compact Hausdorff spaces.
Timeline.
- 1952: Fan and Glicksberg prove fixed-point theorems that yield Nash equilibria, hence correlated equilibria, for continuous games on compact strategy spaces.
- 1969: Peleg proves existence of Nash equilibria for games with infinitely many players, finite strategy sets and continuous payoffs.
- 1974: Aumann introduces correlated equilibria (J. Math. Econ. 1).
- 1987: Aumann characterizes correlated equilibrium as Bayesian rationality (Econometrica 55).
- 1989: Hart and Schmeidler prove existence of correlated equilibria by a separation argument: Theorem 1 for finite games, Theorem 2 for infinitely many players with finite strategy sets, Theorem 3 for compact Hausdorff strategy spaces (Math. Oper. Res. 14).
Setting
A game consists of a nonempty set of players, possibly uncountable; for each player a nonempty set of pure strategies; and for each player a payoff function on the set of strategy profiles . For a profile and a strategy , denotes the profile obtained from by replacing player 's coordinate with ; thus .
In this mission each is a compact Hausdorff space with its Borel σ-algebra , the profile space carries the product topology, and is the Borel σ-algebra of . The product σ-algebra generated by the is contained in , and the inclusion may be strict when is not metrizable (the paper's footnote 13).
Let be a probability measure on . Think of as the mediator's distribution; player learns the coordinate of the drawn profile. A deviation of player is a -measurable map that replaces each recommendation by an action. The measure is a correlated equilibrium with respect to and when, for every player and every deviation ,
The left side is the expected gain from obeying the recommendation instead of following .
Formalization targets
Goal: Theorem 3
If every is compact Hausdorff and every is continuous on with the product topology, then
"Countably additive" in the paper's statement is automatic: is a measure.
Milestones, in the order of the proof
- Every f-set game has a correlated equilibrium. An f-set is a product of finite nonempty sets with a singleton for all but finitely many ; the game restricts each player to , and its correlated equilibrium is a finitely supported probability on .
- On a compact Hausdorff space, every net of probability measures has a regular probability measure as a cluster point for the topology induced by the continuous functions.
- For a regular probability on and a Borel set , there are a closed and an open with : the marginal of a regular measure is regular.
- The special case. A regular cluster point of the satisfies (4) for every deviation that equals a fixed on a Borel set and the identity elsewhere.
- For continuous and , has a finite Borel partition with for in the same piece and every .
- The general case. If (4) holds for all deviations of the special form, it holds for every Borel deviation.
An optional milestone records the remark on p. 23 that, for a finite strategy set , condition (4) for player is equivalent to the earlier condition (3), one inequality per recommendation and alternative .
Significance
The result. Theorem 3 guarantees correlated equilibria, with a genuine (countably additive) probability measure, in every continuous game on compact strategy spaces, however many players there are. It also justifies taking to be the full Borel σ-algebra rather than the smaller product σ-algebra, so that every Borel-measurable deviation rule is allowed. Nash existence under the same hypotheses (Fan 1952, Glicksberg 1952) implies existence of correlated equilibria too, but through a fixed-point theorem; the proof here uses only finite-dimensional duality and compactness.
Formalizing it. The theorem is classical and its proof is published; nothing here is open. To our knowledge no machine-checked proof of Theorem 3, or of any existence result for correlated equilibria in infinite games, exists. Finite-game existence results are on the platform (AGT.nash_existence; the correlated-equilibrium encodings of Aumann 1987 and Foster and Vohra 1997, and AGT.swap_regret_correlated_equilibrium). The formalization would add reusable measure-theoretic tools on compact products: the regular cluster point of a net of probability measures, the regularity of marginals, and uniform partitions for continuous functions on a product.
Difficulty
The obvious argument is the one that proves Theorem 2: approximate the game by finite games , take correlated equilibria , extract a weak-* cluster point , and pass the inequalities of to the limit. Passing to the limit works only for integrands that are continuous in , because is a cluster point against continuous functions only. The integrand of (4) is , and is merely Borel measurable, so this integrand need not be continuous and the limit step fails. Restricting to continuous deviations would avoid the difficulty but would prove a weaker theorem. Two further points need care: on a non-metrizable product the Borel σ-algebra is larger than the product σ-algebra, and the f-sets ordered by inclusion are not a directed set.
Formalization scope
The profile space is a type synonym Profile S of ∀ i, S i carrying the product topology and the instance borel (Profile S), so measures on live on the Borel σ-algebra and not on Mathlib's product σ-algebra MeasurableSpace.pi (). The pair is Function.update s i t. Players form a type ι with Nonempty ι; each S i is nonempty, compact and Hausdorff with BorelSpace (S i); payoffs are h : ι → Profile S → ℝ with each h i continuous. Deviations are all maps ζ : S i → S i with Measurable ζ.
The predicate IsCorrelatedEq h μ requires IsProbabilityMeasure μ and, for each player and measurable deviation, both integrability of the integrand and nonnegativity of its integral. The integrability clause prevents a trivializing reading in which a non-integrable integrand, whose Lean integral is , satisfies (4) vacuously; restricting deviations to continuous maps, or using the product σ-algebra, would also change the theorem and is ruled out.
The f-set net is indexed by the f-sets containing a fixed profile , which are directed; the paper's "ordered by inclusion of the sets " over all f-sets is not directed, and anchoring repairs this without affecting any statement of the paper. A correlated equilibrium of is encoded by its finite support and weights (IsFSetCE). The special case is stated for a regular cluster point of the given by these constructed objects, not for an arbitrary measure.
A complete development needs Banach–Alaoglu or the compactness of probability measures on a compact space, the Riesz–Markov–Kakutani representation (RealRMK), regularity of measures (Measure.Regular), Urysohn's lemma, and uniform continuity on compact spaces, all available in Mathlib in some form. Proofs of any milestone, including the general-purpose milestones 2, 3 and 5, are welcome.
Selected references
- S. Hart and D. Schmeidler, Existence of Correlated Equilibria, Mathematics of Operations Research 14(1), 18–25, 1989. https://doi.org/10.1287/moor.14.1.18
- R. J. Aumann, Subjectivity and Correlation in Randomized Strategies, Journal of Mathematical Economics 1, 67–96, 1974. https://doi.org/10.1016/0304-4068(74)90037-8
- R. J. Aumann, Correlated Equilibrium as an Expression of Bayesian Rationality, Econometrica 55(1), 1–18, 1987. https://doi.org/10.2307/1911154
- B. Peleg, Equilibrium Points for Games with Infinitely Many Players, Journal of the London Mathematical Society s1-44, 292–294, 1969. https://doi.org/10.1112/jlms/s1-44.1.292
- I. L. Glicksberg, A Further Generalization of the Kakutani Fixed Point Theorem, with Application to Nash Equilibrium Points, Proceedings of the AMS 3, 170–174, 1952. https://doi.org/10.1090/S0002-9939-1952-0046638-5
- K. Fan, Fixed-Point and Minimax Theorems in Locally Convex Topological Linear Spaces, PNAS 38, 121–126, 1952. https://doi.org/10.1073/pnas.38.2.121
- N. Dunford and J. T. Schwartz, Linear Operators, Part I, Interscience, 1958.