Motivation
A finite strategic game can be changed in ways that no player can detect strategically. Adding to player m's utility any function that does not depend on player m's own strategy leaves every unilateral comparison "is strategy a better for me than strategy b, given what the others do?" unchanged, so it leaves every best response and every pure Nash equilibrium unchanged. Such changes are not irrelevant, however: they move the payoff levels, and therefore change which outcomes are efficient.
Candogan, Menache, Ozdaglar and Parrilo (arXiv:1005.2405; Math. Oper. Res. 36(3), 2011, DOI 10.1287/moor.1110.0500) make this precise. They decompose every finite game uniquely into a potential component, a harmonic component and a nonstrategic component (their Theorem 4.1). The first two determine all pairwise comparisons; the third determines nothing about equilibria. Section 5.3 of the paper asks what the third component can do to efficiency, and answers with Theorem 5.9: by changing only the nonstrategic component, the pure Nash equilibria of a game can be made to coincide exactly with its Pareto optimal profiles. This mission formalizes that result.
The question matters wherever a designer can transfer payoffs without altering incentives (for instance side payments to a player that depend only on the other players' actions): the theorem says such transfers can always align equilibrium with efficiency, provided an equilibrium exists.
Setting
There is a finite set M of players. Player m has a finite nonempty set Em of strategies; a strategy profile is p=(pm)m∈M∈E=∏mEm, and (qm,p−m) denotes p with player m's strategy replaced by qm. A game is a family of utilities u=(um)m, um:E→R.
Two profiles are m-comparable if they differ, and differ only in player m's strategy. The game graph has node set E and an edge between every pair of profiles that are m-comparable for some m. On this graph:
- C0 is the space of functions E→R with ⟨φ,ψ⟩0=∑pφ(p)ψ(p);
- C1 is the space of edge flows X (X(p,q)=−X(q,p) on edges, 0 off edges) with ⟨X,Y⟩1=21∑(p,q)X(p,q)Y(p,q), summed over ordered adjacent pairs;
- δ0:C0→C1, (δ0φ)(p,q)=φ(q)−φ(p) on edges, is the combinatorial gradient;
- Dm:C0→C1 is the same difference restricted to m-comparable pairs, and Du=∑mDmum. For m-comparable p,q, (Du)(p,q)=um(q)−um(p): D records the game's pairwise comparisons.
Games form the space C0M with the inner product ∑m⟨um,vm⟩0. With † the Moore–Penrose pseudoinverse for these inner products, the potential and harmonic components of a game are
uP=D†δ0δ0†Du,uH=D†(I−δ0δ0†)Du,
and the nonstrategic component is what remains. A profile p is a pure Nash equilibrium of u if um(qm,p−m)≤um(p) for all m and qm, and it is Pareto optimal (Definition 5.3) if no profile q has um(q)≥um(p) for all m and uk(q)>uk(p) for some k.
Formalization targets
Goal: Theorem 5.9
For every game u that has a pure Nash equilibrium there is a game uˉ with
uˉP=uP,uˉH=uH,{p:p pure NE of uˉ}={p:p Pareto optimal in uˉ}.
The statement is existential and fixes nothing about uˉ beyond its potential and harmonic components; it asserts the full equality of the two sets, not one inclusion.
Milestones
- §5.3, p. 32. Games with the same potential and harmonic components have the same pure Nash equilibria.
- Lemma 5.4. For every game u there is a game u^ with u^P=uP, u^H=uH, and u^m(p)=0 for every player m at every pure Nash equilibrium p of u.
Significance
The result. The nonstrategic component has no influence on the pairwise comparisons, and hence on equilibria, yet Theorem 5.9 shows that it controls efficiency completely: whenever a pure equilibrium exists, some choice of it makes every equilibrium Pareto optimal and every Pareto optimal profile an equilibrium. Read the other way, two games that are strategically indistinguishable can have opposite efficiency properties, so any efficiency statement about a class of games (a price-of-anarchy bound, for instance) must depend on more than the strategic structure. The paper also uses Lemma 5.4 as a normalisation: the payoff levels at equilibria are a free parameter of the nonstrategic component.
Formalizing it. The theorem has a short proof on paper, but the proof works with the pairwise comparisons, whereas the statement is about the components uP, uH defined through pseudoinverses. Connecting the two requires the identities of the decomposition: that uP+uH=D†Du and that DD†D=D. The mission therefore produces a machine-checked link between the linear-algebraic decomposition of games and their equilibrium sets, which other results of the paper (and of the literature on near-potential games) also need. To the best of our knowledge, none of these statements has been formalized before; the result itself is proved in the paper.
Difficulty
The construction on pp. 31–33 is explicit, so the difficulty is not finding uˉ but keeping two descriptions of "differ only in the nonstrategic component" consistent. The statement uses the component maps; the proof checks pointwise that um(p)−um(q)=uˉm(p)−uˉm(q) for m-comparable p,q. Passing from the second to the first needs the pseudoinverse identities for D and δ0 with respect to the specific inner products of C0M and C1; a naive argument that treats D† as an inverse fails because D has a large kernel. A second point is the case analysis in the definition of uˉ: whether a profile is m-comparable to an equilibrium must be shown independent of which of two m-comparable profiles is examined, and the case where a non-equilibrium profile is m-comparable to an equilibrium for every player m needs the separate argument of p. 33.
Formalization scope
Players form a finite type ι with decidable equality; strategy sets E m are finite, nonempty and have decidable equality. A game is an element of PiLp 2 (fun _ => EuclideanSpace ℝ (∀ k, E k)), i.e. C0M with the unweighted sum inner product of Section 4; the weighted inner product of Section 6 is not used. C1 carries the inner product with the factor 21. The pseudoinverse is defined directly (Mathlib has none) as the inverse of L on (kerL)⊥ composed with the orthogonal projection onto the range. Pure Nash equilibrium is AGT.IsPureNash from the published agt_games bundle; Pareto optimality is Definition 5.3, stated for a plain utility function.
Added hypothesis. The paper leaves implicit that G has a pure Nash equilibrium, and the goal carries it as a hypothesis. It is necessary: every finite game has a Pareto optimal profile (a maximizer of ∑mum), while a game without pure equilibria, such as matching pennies, has none in any game with the same potential and harmonic components, so the set equality would fail. The paper's proof uses an equilibrium in the step "deviation to a NE increases the payoff of at least one player". Lemma 5.4 needs no such hypothesis.
"Same potential and harmonic components" is stated as equality of the two component maps of Theorem 4.1, never as membership of u−uˉ in kerD; the two are equivalent only through the decomposition theorem. Without condition (i) the goal would be trivial (take uˉ constant, so that every profile is both an equilibrium and Pareto optimal), so condition (i) is what makes the statement nontrivial.
Needed infrastructure: the Penrose identities for the pseudoinverse; DD†D=D; the fact that Du determines each Dmum (the m-comparable edge sets for different m are disjoint); and the explicit constructions of u^ and uˉ. The pseudoinverse lemmas and the "same comparisons, same equilibria" bridge are reusable throughout the series. Proofs of the milestones, of the bridge in either direction, and of the Penrose identities are welcome as separate contributions.
Selected references
- O. Candogan, I. Menache, A. Ozdaglar, P. A. Parrilo, Flows and Decompositions of Games: Harmonic and Potential Games, arXiv:1005.2405v2, 2010. https://arxiv.org/abs/1005.2405 — journal version: Mathematics of Operations Research 36(3):474–503, 2011. https://doi.org/10.1287/moor.1110.0500
- D. Monderer, L. S. Shapley, Potential Games, Games and Economic Behavior 14(1):124–143, 1996. https://doi.org/10.1006/game.1996.0044
- R. Penrose, A generalized inverse for matrices, Mathematical Proceedings of the Cambridge Philosophical Society 51(3):406–413, 1955. https://doi.org/10.1017/S0305004100030401