Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Algorithmic Game Theory

425 missions · 177 completed

Missions

Open248Completed177All425
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

Cores of Convex Games: The Core of a Convex Game Is Its Unique von Neumann-Morgenstern Stable SetResearch Paper

Motivation

A cooperative game with transferable utility assigns to every coalition of players the total payoff the coalition can secure on its own. Two solution concepts for such games go back to the foundations of game theory: the core, the set of payoff divisions no coalition can improve upon, and the stable set (von Neumann–Morgenstern solution), a set of divisions that is internally consistent and externally absorbing under the relation of domination. For general games the two concepts behave badly: the core may be empty, stable sets may fail to exist (Lucas 1968), and when they exist there are usually many of them.

Lloyd Shapley's paper Cores of Convex Games (Int. J. Game Theory 1, 1971) isolates a class of games, the convex games (supermodular characteristic functions), on which all of this becomes well behaved. Convex games arise in cost allocation, in bankruptcy and airport problems, in scheduling and sequencing games, and in any setting with increasing returns to cooperation; the supermodular functions behind them are the same objects studied as polymatroid rank functions in combinatorial optimization (Edmonds 1970). For such games the paper shows that the core is nonempty, that its faces fit together in a rigid combinatorial pattern, that its vertices are exactly the marginal-contribution vectors, and that the core is the unique stable set.

Setting

Let N={1,…,n}N=\{1,\dots,n\}N={1,…,n} be a finite set of players. A game is a function vvv from subsets of NNN to the reals with v(∅)=0v(\emptyset)=0v(∅)=0. It is convex if

v(S)+v(T)≤v(S∪T)+v(S∩T)for all S,T⊆N.v(S)+v(T)\le v(S\cup T)+v(S\cap T)\qquad\text{for all } S,T\subseteq N.v(S)+v(T)≤v(S∪T)+v(S∩T)for all S,T⊆N.

A payoff vector is a∈RNa\in\mathbb R^Na∈RN, and a(S)=∑i∈Saia(S)=\sum_{i\in S}a_ia(S)=∑i∈S​ai​. It is feasible if a(N)≤v(N)a(N)\le v(N)a(N)≤v(N). The core CCC is the set of feasible aaa with a(S)≥v(S)a(S)\ge v(S)a(S)≥v(S) for every S⊆NS\subseteq NS⊆N; in particular a(N)=v(N)a(N)=v(N)a(N)=v(N) on CCC.

For a nonempty coalition SSS, the face CSC_SCS​ is the set of core points with a(S)=v(S)a(S)=v(S)a(S)=v(S); by convention C∅=CC_\emptyset=CC∅​=C, and CN=CC_N=CCN​=C. The family {CS}\{C_S\}{CS​} is the core configuration. It is complete if no CSC_SCS​ is empty, and regular if CN≠∅C_N\ne\emptysetCN​=∅ and

CS∩CT⊆CS∪T∩CS∩Tfor all S,T⊆N.C_S\cap C_T\subseteq C_{S\cup T}\cap C_{S\cap T}\qquad\text{for all } S,T\subseteq N.CS​∩CT​⊆CS∪T​∩CS∩T​for all S,T⊆N.

For an ordering ω\omegaω of the players, Sω,kS_{\omega,k}Sω,k​ is the set of the first kkk players, and the marginal vector aωa^\omegaaω pays each player iii its marginal contribution v(Sω,ω(i))−v(Sω,ω(i)−1)v(S_{\omega,\omega(i)})-v(S_{\omega,\omega(i)-1})v(Sω,ω(i)​)−v(Sω,ω(i)−1​).

A payoff vector bbb is dominated by aaa if some nonempty coalition SSS has a(S)≤v(S)a(S)\le v(S)a(S)≤v(S) and ai>bia_i>b_iai​>bi​ for all i∈Si\in Si∈S. A set VVV of feasible vectors is stable if every feasible vector is either a member of VVV or dominated by a member of VVV, but not both.

Formalization targets

Goal: Theorem 8

C is stable, and every stable set V equals C(v convex).C \text{ is stable, and every stable set } V \text{ equals } C \qquad (v \text{ convex}).C is stable, and every stable set V equals C(v convex).

The goal contains both halves of the page's statement: stability of the core, and uniqueness ("the unique von Neumann–Morgenstern solution").

Milestones, in the order the argument uses them

  • Lemma 1 (p. 18) and Lemma 2 (p. 19): for a regular configuration, a point on two nested faces CS∩CTC_S\cap C_TCS​∩CT​ with ∣T∖S∣≥2|T\setminus S|\ge2∣T∖S∣≥2 can be moved to a face CQC_QCQ​ of an intermediate coalition, and a point of CSC_SCS​ to CS∩CS∪{j}C_S\cap C_{S\cup\{j\}}CS​∩CS∪{j}​, keeping its coordinates on SSS.
  • Theorem 2 (p. 18): in a regular configuration CS1∩⋯∩CSm≠∅C_{S_1}\cap\cdots\cap C_{S_m}\ne\emptysetCS1​​∩⋯∩CSm​​=∅ for every strictly increasing chain S1⊂⋯⊂SmS_1\subset\cdots\subset S_mS1​⊂⋯⊂Sm​; in particular a regular configuration is complete.
  • Theorem 4 (p. 21): the core of a convex game is nonempty.
  • Theorem 5 (p. 22): a game is convex if and only if its core configuration is regular.
  • Two claims of §4.3 (p. 24): every stable set contains the core, and no stable set properly includes another.
  • The claim that opens the proof of Theorem 8 (p. 24): in a convex game every feasible vector outside the core is dominated by a core point.

The mission also states Theorem 3 (p. 19), the vertices of a regular core are exactly the marginal vectors aωa^\omegaaω, as a further item that is not on the path to the goal.

Significance

The result. Theorem 8 gives, for a natural and widely occurring class of games, a complete answer to the existence and uniqueness questions for von Neumann–Morgenstern solutions, which are open or negative in general. Theorems 3 and 5 describe the core of a convex game explicitly as the polytope spanned by the n!n!n! marginal vectors, the combinatorial description that underlies later work on the Shapley value, the Weber set, and the polymatroid greedy algorithm. Theorem 5 is the geometric characterization of supermodularity through the face structure of the core.

Formalizing it. All results in this mission are proved in the paper; none has a machine-checked proof on the platform. Theorem 4 is already stated on the platform (as part of a statement that also puts every marginal vector and the Shapley value in the core) and enters the mission as an existing item. The remaining work is a formal development of face configurations of the core, of stable sets and domination, and of the passage from supermodularity to the geometry of the core. The definitions of stable set and domination are general and reusable for any transferable-utility game.

Difficulty

The internal half of stability is immediate from the definitions: a core point cannot be dominated by any vector satisfying a coalition constraint a(S)≤v(S)a(S)\le v(S)a(S)≤v(S). Uniqueness also follows from two short observations. The substance is external stability: every feasible vector outside the core must be dominated by a core point, and the dominating vector has to be produced explicitly. The obvious attempt, raising the payoffs of one violated coalition and leaving the other coordinates of bbb unchanged, does not in general produce a core point, and nothing in the definition of the core alone controls how the core meets the hyperplane of a given coalition; that control is what the face theory of §3 is about. For non-convex games the external half genuinely fails, so no argument that ignores convexity can succeed.

Formalization scope

Players are Fin n (a relabelling of the paper's finite set NNN), a game is f : Finset (Fin n) → ℝ, payoff vectors are Fin n → ℝ, and a(S)a(S)a(S) is ∑ i ∈ S, a i. The existing platform definitions Supermodularity.Cooperative.IsConvexGame (v(∅)=0v(\emptyset)=0v(∅)=0 plus supermodularity on all subsets), Core, InitialCoalition and GreedyPayoff (the marginal vectors, orderings being permutations of Fin n) are reused; the reused Theorem 4 statement is Supermodularity.Cooperative.convex_game_core_and_shapley.

Conventions committed to:

  • Wherever the page says "a game", the hypothesis is exactly v(∅)=0v(\emptyset)=0v(∅)=0; convexity is IsConvexGame.
  • Faces satisfy C∅=CC_\emptyset=CC∅​=C literally: the tightness condition is imposed only for nonempty SSS.
  • Regularity includes CN≠∅C_N\ne\emptysetCN​=∅, as on the page.
  • Lemmas 1–2 and Theorems 2–3 assume a regular configuration, not convexity, as on the page.
  • S⊂⊂TS\subset\subset TS⊂⊂T is S⊊TS\subsetneq TS⊊T with ∣T∣−∣S∣≥2|T|-|S|\ge2∣T∣−∣S∣≥2; Lemma 1's two preassigned elements are distinct.
  • An increasing sequence of m≥1m\ge1m≥1 coalitions is a strictly monotone map from Fin (m + 1).
  • "Vertex" is Set.extremePoints ℝ.
  • Domination requires a nonempty coalition and strict coordinate inequalities; stable sets consist of feasible vectors and the "either … or …, but not both" condition ranges over feasible vectors, following the page rather than the classical imputation-based variant.

A formalization in which the dominating coalition may be empty, in which regularity omits CN≠∅C_N\ne\emptysetCN​=∅, or in which the goal asserts stability without uniqueness does not state the paper's theorem and is ruled out.

Welcome contributions: proofs of the milestones in any order, general lemmas about faces of polytopes cut out by set-function inequalities, and reusable API for domination and stable sets.

Selected references

  • L. S. Shapley, Cores of Convex Games, International Journal of Game Theory 1 (1971), 11–26. https://doi.org/10.1007/BF01753431
  • J. von Neumann and O. Morgenstern, Theory of Games and Economic Behavior, Princeton University Press, 1944.
  • J. Edmonds, Submodular functions, matroids, and certain polyhedra, in Combinatorial Structures and Their Applications, Gordon and Breach, 1970, 69–87. https://doi.org/10.1007/3-540-36478-1_2
  • W. F. Lucas, A game with no solution, Bulletin of the American Mathematical Society 74 (1968), 237–239. https://doi.org/10.1090/S0002-9904-1968-12039-2
  • D. M. Topkis, Supermodularity and Complementarity, Princeton University Press, 1998, §5.2.
20 thms6 active usersReviewed
🏆Completed
Dynamical SystemsProbabilityStochastic Systems·Captain: mikedeng1

On the Global Convergence of Stochastic Fictitious Play IV: Almost Sure Convergence in Supermodular Games with a Unique Rest PointResearch Paper

Motivation

Fictitious play is the oldest model of learning in games: each player repeatedly best-responds to the empirical frequencies of the opponents' past play. Stochastic fictitious play adds random payoff disturbances before each choice, so that players choose smoothed ("perturbed") best responses. It is a standard model in economics and in the study of learning in games (Fudenberg and Levine, 1998), and its long-run behavior is described through a deterministic mean dynamic, the perturbed best response dynamic, using stochastic approximation theory (Benaïm and Hirsch, 1999).

Supermodular games model strategic complementarities: the gain from moving to a higher strategy increases when opponents move to higher strategies. They arise in coordination, oligopoly and macroeconomic models (Milgrom and Roberts, 1990; Vives, 1990). Hofbauer and Sandholm (Econometrica 2002) show that in such games stochastic fictitious play converges almost surely whenever its mean dynamic has a unique rest point. This mission formalizes that result and the chain of lemmas behind it (Section 5 and the Appendix of the paper).

Timeline. Benaïm and Hirsch (1999) observed that supermodular games with exactly two strategies per player yield strongly monotone perturbed best response dynamics. Hofbauer and Sandholm (2002) extended this to any number of strategies by introducing stochastic dominance coordinates, and proved Theorem 6.1(iv). Benaïm (2000) supplied the low-dimensional convergence theorem used for the dimension ≤ 2 clause.

Setting

A ppp player normal form game gives player α\alphaα an ordered finite strategy set Sα={0,…,nα−1}S^\alpha = \{0,\dots,n^\alpha - 1\}Sα={0,…,nα−1} and a utility uαu^\alphauα on pure profiles. Σ=∏αΔSα\Sigma = \prod_\alpha \Delta S^\alphaΣ=∏α​ΔSα is the set of mixed profiles, and player α\alphaα's payoff vector is Uiα(x−α)=∑s: sα=iuα(s)∏β≠αxsββU^\alpha_i(x^{-\alpha}) = \sum_{s:\, s^\alpha = i} u^\alpha(s) \prod_{\beta \ne \alpha} x^\beta_{s^\beta}Uiα​(x−α)=∑s:sα=i​uα(s)∏β=α​xsββ​.

The game is strictly supermodular if for all distinct players α≠β\alpha \ne \betaα=β and all profiles s,s^s, \hat ss,s^ with sα>s^αs^\alpha > \hat s^\alphasα>s^α and s−α=s^−αs^{-\alpha} = \hat s^{-\alpha}s−α=s^−α, the difference uα(s)−uα(s^)u^\alpha(s) - u^\alpha(\hat s)uα(s)−uα(s^) is strictly increasing in sβ=s^βs^\beta = \hat s^\betasβ=s^β.

Each player α\alphaα has a shock density fαf^\alphafα on Rnα\mathbb R^{n^\alpha}Rnα, strictly positive, whose choice function Ciα(π)=P(argmax⁡jπj+εj=i)C^\alpha_i(\pi) = P(\operatorname{argmax}_j \pi_j + \varepsilon_j = i)Ciα​(π)=P(argmaxj​πj​+εj​=i) is continuously differentiable. The perturbed best response is B~α(x−α)=Cα(Uα(x−α))\tilde B^\alpha(x^{-\alpha}) = C^\alpha(U^\alpha(x^{-\alpha}))B~α(x−α)=Cα(Uα(x−α)), and the perturbed best response dynamic is

(P)x˙α=B~α(x−α)−xα.(\mathrm P)\qquad \dot x^\alpha = \tilde B^\alpha(x^{-\alpha}) - x^\alpha .(P)x˙α=B~α(x−α)−xα.

RP(P)RP(\mathrm P)RP(P) is its set of rest points in Σ\SigmaΣ and CR(P)CR(\mathrm P)CR(P) its chain recurrent set.

In standard stochastic fictitious play the shocks εtα\varepsilon^\alpha_tεtα​ have densities fαf^\alphafα and are independent over time and across players. From an arbitrary initial pure profile ζ1\zeta_1ζ1​, each player at time t+1t+1t+1 plays the pure strategy maximizing Ukα(Zt−α)+(εtα)kU^\alpha_k(Z_t^{-\alpha}) + (\varepsilon^\alpha_t)_kUkα​(Zt−α​)+(εtα​)k​, where Zt=1t∑u≤tζuZ_t = \frac1t \sum_{u \le t} \zeta_uZt​=t1​∑u≤t​ζu​ is the vector of empirical frequencies.

The stochastic dominance coordinates are (Tαxα)i=∑j>ixjα∈Rnα−1(T^\alpha x^\alpha)_i = \sum_{j > i} x^\alpha_j \in \mathbb R^{n^\alpha - 1}(Tαxα)i​=∑j>i​xjα​∈Rnα−1, the mass on strategies above iii; Tx≤TyT x \le T yTx≤Ty means each yαy^\alphayα stochastically dominates xαx^\alphaxα. In these coordinates (P) becomes a dynamic (T) on T(Σ)T(\Sigma)T(Σ).

Formalization targets

Goal: Theorem 6.1(iv), unique rest point clause

For a strictly supermodular game with p≥2p \ge 2p≥2 players and shock densities as above, if RP(P)={x∗}RP(\mathrm P) = \{x^*\}RP(P)={x∗} then

P(lim⁡t→∞Zt=x∗)=1,P\Big(\lim_{t\to\infty} Z_t = x^*\Big) = 1,P(t→∞lim​Zt​=x∗)=1,

on every probability space, for every independent shock family with the given densities and every initial profile.

Milestones

  • Lemma A.2, eq. (14), Lemma A.3 and eqs. (17)–(18): the order-theoretic and differential facts behind monotonicity.
  • Theorem 5.1: T−αy−α≥T−αx−α⇒TαB~α(y−α)≥TαB~α(x−α)T^{-\alpha} y^{-\alpha} \ge T^{-\alpha} x^{-\alpha} \Rightarrow T^\alpha \tilde B^\alpha(y^{-\alpha}) \ge T^\alpha \tilde B^\alpha(x^{-\alpha})T−αy−α≥T−αx−α⇒TαB~α(y−α)≥TαB~α(x−α).
  • Theorem 5.2: there are rest points x‾,xˉ\underline x, \bar xx​,xˉ with RP(P)⊆[x‾,xˉ]RP(\mathrm P) \subseteq [\underline x, \bar x]RP(P)⊆[x​,xˉ].
  • Proposition 5.3: (P) and (T) are linearly conjugate.
  • Theorem 5.4: (T) is cooperative and irreducible.
  • Corollary 5.5(i)–(ii): (P) is strongly monotone, and CR(P)⊆[x‾,xˉ]CR(\mathrm P) \subseteq [\underline x, \bar x]CR(P)⊆[x​,xˉ], so CR(P)={x∗}CR(\mathrm P) = \{x^*\}CR(P)={x∗} when the rest point is unique.

Significance

The result gives global almost-sure convergence of a stochastic learning process in a broad class of games with many strategies, where earlier results needed two strategies per player or specific payoff structures. It also shows which properties of the choice function matter: only eqs. (17)–(18), not the symmetry of its derivative used for potential and zero-sum games.

The paper's proof is complete but relies on outside results: stochastic approximation (Benaïm–Hirsch 1999, Benaïm 1999), monotone dynamical systems (Smith 1995), and the inclusion of the chain recurrent set in the global attractor (Robinson 1995). None of these, nor the Hofbauer–Sandholm theorem itself, is formalized in any proof assistant as far as known. The mission produces a machine-checked version of the theorem and of the Section 5 monotonicity theory.

Difficulty

The monotonicity lemmas are finite-dimensional calculus and summation by parts. The substantial steps are elsewhere. Strong monotonicity of a cooperative irreducible system (Corollary 5.5(i)) is a theorem of monotone dynamical systems that Mathlib does not have, and it must hold on the closed, non-open state space T(Σ)T(\Sigma)T(Σ). The step from the ODE to the random process needs the stochastic approximation theorem: the empirical frequencies are an asymptotic pseudotrajectory of (P), and their limit set is almost surely internally chain transitive. Knowing that x∗x^*x∗ is globally asymptotically stable for (P) does not by itself give almost-sure convergence of ZtZ_tZt​. The limit set of the random process must be related to the chain recurrent set of (P), which is where Corollary 5.5(ii) enters.

Formalization scope

Players are Fin p, strategies Fin (n α) (0-based, same order as the paper), with every nα≥1n^\alpha \ge 1nα≥1. Mixed profiles live in the ambient space ∏αRnα\prod_\alpha \mathbb R^{n^\alpha}∏α​Rnα with the sup norm. The fields of (P) and (T) are defined on the whole ambient space, so partial derivatives are ordinary Fréchet derivatives. Densities are [0,∞][0,\infty][0,∞]-valued. Solutions are forward solutions staying in the state space. The chain recurrent set quantifies over solutions, which are unique here because the fields are C1C^1C1. The process ZtZ_tZt​ is defined pathwise from the shocks, with ties in the argmax broken by the smallest index (a null event). Densities may differ across players.

A statement about the ODE (P), or about a single noise law such as logit, would be a different and much weaker theorem. The goal is about the random process ZtZ_tZt​, on every probability space carrying independent shocks with the given densities. Irreducibility and strong monotonicity additionally assume that two distinct players each have at least two strategies; when one player owns every stochastic dominance coordinate and has at least two of them, supermodularity holds vacuously while irreducibility fails.

A complete development needs: random utility choice functions and their derivatives; monotone and cooperative ODE theory on convex sets; the chain recurrent set and the global attractor; stochastic approximation for processes with step size 1/t1/t1/t. The last three are reusable well beyond this mission. Contributions to any milestone, and general-purpose lemmas on cooperative systems or stochastic approximation, are welcome.

Selected references

  • J. Hofbauer and W. H. Sandholm, On the Global Convergence of Stochastic Fictitious Play, Econometrica 70 (2002), 2265–2294. https://doi.org/10.1111/1468-0262.00376 (formalized from the authors' manuscript of February 21, 2002)
  • M. Benaïm and M. W. Hirsch, Mixed Equilibria and Dynamical Systems Arising from Repeated Games, Games and Economic Behavior 29 (1999), 36–72. https://doi.org/10.1006/game.1997.0636
  • M. Benaïm, Dynamics of Stochastic Approximation Algorithms, Séminaire de Probabilités XXXIII, Lecture Notes in Mathematics 1709, Springer (1999). https://doi.org/10.1007/BFb0096509
  • M. Benaïm, Convergence with Probability One of Stochastic Approximation Algorithms Whose Average is Cooperative, Nonlinearity 13 (2000), 601–616. https://doi.org/10.1088/0951-7715/13/3/305
  • H. L. Smith, Monotone Dynamical Systems, AMS Mathematical Surveys and Monographs 41 (1995). https://doi.org/10.1090/surv/041
  • P. Milgrom and J. Roberts, Rationalizability, Learning, and Equilibrium in Games with Strategic Complementarities, Econometrica 58 (1990), 1255–1277. https://doi.org/10.2307/2938316
  • D. Fudenberg and D. K. Levine, The Theory of Learning in Games, MIT Press (1998).
19 thms5 active usersReviewed
🏆Completed
EconomicsOperations Research·Captain: mikedeng1

Economics of Social Media Fake Accounts 1: A Purely Profit-Driven Platform Optimally Chooses Zero Antifake EffortResearch Paper

Motivation

Fake accounts (purchased followers, likes and engagement) are a large part of influencer marketing on social media, and platforms say they invest in detecting and removing them. Huang and Liu (Management Science 71(10), 2025) model this market as a signaling game. An influencer of unknown quality buys fake followers to look popular, consumers decide whether to follow, an advertiser pays for the real followers it expects, and the platform, which takes a share of the advertising revenue, chooses how much antifake effort to spend. A practical question for regulators and platform designers follows: does a platform that maximizes profit have any reason to fight fake accounts? This mission formalizes the paper's answer for the purely profit-driven platform: it does not.

The model draws on the signaling literature, in particular the undefeated equilibrium refinement of Mailath, Okuno-Fujiwara and Postlewaite (1993), and is close to the welfare analysis of social-learning manipulation in Chen and Papanastasiou (Management Science 67(11), 2021).

Setting

An influencer is of type HHH (probability ρ∈(0,1)\rho\in(0,1)ρ∈(0,1)) or LLL, with content quality qH>qL>0q_H>q_L>0qH​>qL​>0, and E[q]=ρqH+(1−ρ)qLE[q]=\rho q_H+(1-\rho)q_LE[q]=ρqH​+(1−ρ)qL​. A fraction l∈(0,1)l\in(0,1)l∈(0,1) of consumers (social media literacy) are informed and know the type. The platform picks an effort d≥0d\ge0d≥0. With technology level τ∈[0,1)\tau\in[0,1)τ∈[0,1) and base price p0p_0p0​, a fake account costs pf=p0+d/(1−τ)p_f=p_0+d/(1-\tau)pf​=p0​+d/(1−τ) (1), and following costs a consumer c=c0+c1(1−τ)dc=c_0+c_1(1-\tau)dc=c0​+c1​(1−τ)d (2), with c0,c1≥0c_0,c_1\ge0c0​,c1​≥0.

Informed followers of a ttt-type number nint=l(1−c/qt)n^t_{in}=l(1-c/q_t)nint​=l(1−c/qt​) (8). Uninformed consumers see the early follower count n2tn_2^tn2t​ and follow in number nunt=(1−l)(1−c/E[q∣n2t])n^t_{un}=(1-l)(1-c/E[q\mid n_2^t])nunt​=(1−l)(1−c/E[q∣n2t​]) (9). The real followers are nr,iat=nint+nuntn^t_{r,ia}=n^t_{in}+n^t_{un}nr,iat​=nint​+nunt​ (10). An uninformed advertiser expects E[nr,ua]=Pr⁡(H∣n)nr,iaH+Pr⁡(L∣n)nr,iaLE[n_{r,ua}]=\Pr(H\mid n)n^H_{r,ia}+\Pr(L\mid n)n^L_{r,ia}E[nr,ua​]=Pr(H∣n)nr,iaH​+Pr(L∣n)nr,iaL​ (11). From the ttt-type's side, the advertiser pays for E[nrt]=l nr,iat+(1−l)E[nr,ua]E[n^t_r]=l\,n^t_{r,ia}+(1-l)E[n_{r,ua}]E[nrt​]=lnr,iat​+(1−l)E[nr,ua​] real followers (12). Under a pooling equilibrium both types show the same count and the posterior is ρ\rhoρ. Under a separating equilibrium (costly or natural) the posterior is 111 at the HHH-type's count and 000 at the LLL-type's.

With advertising revenue μ>0\mu>0μ>0 per real consumer and platform share λp\lambda_pλp​, the platform's profit under equilibrium type rrr is (6)

πpr(d)=λpμE[nr]−γ2d2,γ>0,\pi^r_p(d)=\lambda_p\mu E[n_r]-\frac{\gamma}{2}d^2,\qquad \gamma>0,πpr​(d)=λp​μE[nr​]−2γ​d2,γ>0,

where E[nr]E[n_r]E[nr​] averages (12) over the type. Two thresholds, d1=(1−τ)(η1−p0)d_1=(1-\tau)(\eta_1-p_0)d1​=(1−τ)(η1​−p0​) (13) and d2=(1−τ)(η2−p0)d_2=(1-\tau)(\eta_2-p_0)d2​=(1−τ)(η2​−p0​) (16), with η1=λiμ(1−l)[qH(E[q]−qL)/(lE[q](qH−qL))+ρ]\eta_1=\lambda_i\mu(1-l)\big[q_H(E[q]-q_L)/(lE[q](q_H-q_L))+\rho\big]η1​=λi​μ(1−l)[qH​(E[q]−qL​)/(lE[q](qH​−qL​))+ρ] and η2=1lλiμ(1−l2)\eta_2=\frac1l\lambda_i\mu(1-l^2)η2​=l1​λi​μ(1−l2), select the equilibrium (Proposition 1). If d1>0d_1>0d1​>0 and d≤d1d\le d_1d≤d1​ the equilibrium is pooling. Otherwise it is costly separating for d≤d2d\le d_2d≤d2​ and naturally separating beyond. The equilibrium profit is πp(d)=πpr(d)(d)\pi_p(d)=\pi^{r(d)}_p(d)πp​(d)=πpr(d)​(d).

Formalization targets

Goal: Proposition 4(a)

πp(d)≤πp(0)(d≥0),πp(d)<πp(0)(d>0).\pi_p(d)\le\pi_p(0)\quad(d\ge0),\qquad \pi_p(d)<\pi_p(0)\quad(d>0).πp​(d)≤πp​(0)(d≥0),πp​(d)<πp​(0)(d>0).

A purely profit-driven platform (w=0w=0w=0 in the objective Πp=(1−w)πp+wU\Pi_p=(1-w)\pi_p+wUΠp​=(1−w)πp​+wU of (3)) optimally chooses zero antifake effort, and zero is the unique optimum.

Milestones

  1. (18): d1<d2d_1<d_2d1​<d2​.
  2. Lemma 7: each πppool,πpcsep,πpnsep\pi^{pool}_p,\pi^{csep}_p,\pi^{nsep}_pπppool​,πpcsep​,πpnsep​ strictly decreases in d≥0d\ge0d≥0.
  3. The concavity comparison after Lemma 8: for c>0c>0c>0, ρ nun(qH)+(1−ρ) nun(qL)<nun(E[q])\rho\,n_{un}(q_H)+(1-\rho)\,n_{un}(q_L)<n_{un}(E[q])ρnun​(qH​)+(1−ρ)nun​(qL​)<nun​(E[q]).
  4. Advertising revenue is higher under pooling: E[nrcsep](d)≤E[nrpool](d)E[n^{csep}_r](d)\le E[n^{pool}_r](d)E[nrcsep​](d)≤E[nrpool​](d), strictly if c>0c>0c>0.
  5. Lemma 8(a): if d1≤0d_1\le0d1​≤0, πpcsep(0)>πpnsep(d2)\pi^{csep}_p(0)>\pi^{nsep}_p(d_2)πpcsep​(0)>πpnsep​(d2​) (under Assumption 3, p0<η2p_0<\eta_2p0​<η2​).
  6. Lemma 8(b)(1): if d1>0d_1>0d1​>0, πppool(0)>πpcsep(d1)\pi^{pool}_p(0)>\pi^{csep}_p(d_1)πppool​(0)>πpcsep​(d1​).
  7. Lemma 8(b)(2): if d1>0d_1>0d1​>0, πpcsep(d1)>πpnsep(d2)\pi^{csep}_p(d_1)>\pi^{nsep}_p(d_2)πpcsep​(d1​)>πpnsep​(d2​).

Significance

Proposition 4(a) separates two motives for antifake effort. Effort harms a profit-maximizing platform twice: it raises the consumers' following cost, which lowers participation and revenue, and it costs γ2d2\frac{\gamma}{2}d^22γ​d2. Pooling, in which low-quality influencers successfully mimic high-quality ones, also earns more revenue than separation, because uninformed consumers follow an average influencer more readily than the average of the two types. So any antifake effort a platform makes must come from its concern for consumer welfare (Proposition 4(b)), not from advertising profit. That is the paper's argument for external pressure or regulation.

The result is proved in the paper's Online Appendix. This mission formalizes the main-text claims behind it: the threshold ordering, Lemma 7, the concavity argument and Lemma 8, together with the goal. To our knowledge none of these has a machine-checked proof. The definitions of the follower and profit model are reusable for the companion mission on the influencer's defensive purchasing (Proposition 3).

Difficulty

The obvious argument is "effort only costs, so choose zero". It is incomplete, because effort changes which equilibrium is played, and the equilibrium profit πp\pi_pπp​ is discontinuous at d1d_1d1​ and d2d_2d2​. Comparing profits across regimes needs two facts. First, pooling revenue dominates separating revenue at the same effort, a strict-convexity (Jensen) inequality for x↦1/xx\mapsto 1/xx↦1/x applied to the uninformed followers through (11)–(12). Second, the thresholds are ordered, d1<d2d_1<d_2d1​<d2​, which uses the explicit η1,η2\eta_1,\eta_2η1​,η2​. The bookkeeping of (10)–(12), where the advertiser's expectation is nested inside the type-average, has to be unfolded exactly. The boundary case d1=0d_1=0d1​=0 falls under Proposition 1(a), so zero effort then induces costly separation, not pooling.

Formalization scope

Parameters form a Lean structure with ASCII field names (mu, lamI, lamP, rho, l, qH, qL, c0, c1, tau, p0, gamma). A Standing predicate records the ranges: μ>0\mu>0μ>0; λi,λp>0\lambda_i,\lambda_p>0λi​,λp​>0 with λi+λp<1\lambda_i+\lambda_p<1λi​+λp​<1; ρ,l∈(0,1)\rho,l\in(0,1)ρ,l∈(0,1); 0<qL<qH0<q_L<q_H0<qL​<qH​; c0,c1≥0c_0,c_1\ge0c0​,c1​≥0; τ∈[0,1)\tau\in[0,1)τ∈[0,1); γ>0\gamma>0γ>0. p0p_0p0​ is unconstrained, and Assumption 3 (p0<η2p_0<\eta_2p0​<η2​) is a separate hypothesis, used only in Lemma 8(a). The model's expectations are the closed forms (8)–(12); no probability space is built. Follower formulas are untruncated, as in the paper. Assumptions 1–2 depend on ddd, are never stated for a range of ddd, and are not needed, so they are not imposed.

The equilibrium regime map is Proposition 1 taken as a definition: the belief systems, the undefeated refinement and the proofs of Lemmas 1–4 are in the Online Appendix, which this mission does not use. The regime test is "d1>0d_1>0d1​>0 and d≤d1d\le d_1d≤d1​" for pooling, which matches Proposition 1(a) at d1=0d_1=0d1​=0. Lemma 7 is stated on all of d≥0d\ge0d≥0, a superset of each regime's range. The two separating profits are the same function, because real followers depend only on the information revealed. The concavity milestone assumes c>0c>0c>0, without which both sides are equal.

The goal is about the equilibrium profit computed from (6) and (8)–(12). It is not about abstract regime profits with Lemmas 7–8 as hypotheses, and pooling revenue is not defined by substituting E[q]E[q]E[q] into a single-type formula, which would hide the Jensen step. Consumer welfare UUU is not formalized: its formula is not in the main text, so Proposition 4(b) and Table 3 are out of scope. Contributions welcome: proofs of the milestones and the goal, and a formalization of the signaling game behind Proposition 1.

Selected references

  • Z. Huang and D. Liu, Economics of Social Media Fake Accounts, Management Science 71(10):8865–8883, 2025. https://doi.org/10.1287/mnsc.2022.02616
  • G. J. Mailath, M. Okuno-Fujiwara and A. Postlewaite, Belief-Based Refinements in Signalling Games, Journal of Economic Theory 60(2):241–276, 1993. https://doi.org/10.1006/jeth.1993.1022
  • L. Chen and Y. Papanastasiou, Seeding the Herd: Pricing and Welfare Effects of Social Learning Manipulation, Management Science 67(11):6734–6750, 2021.
9 thms4 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

How Bad is Selfish Routing? 1: A Nash Flow Costs No More Than Any Flow Feasible for Twice the Rates, for Continuous Nondecreasing LatenciesResearch Paper

Motivation

In a road or communication network, traffic is routed by many independent users, each choosing a route that is fastest for itself given the congestion caused by everyone else. The resulting Nash flow (also called a Wardrop equilibrium, after Wardrop 1952) need not minimize the total delay experienced by all users: Braess's paradox shows that adding a road can make everyone slower. Network designers, transport economists and the designers of Internet congestion-control protocols therefore ask how much total delay is lost to selfish routing, compared with a centrally optimized routing of the same traffic.

Roughgarden and Tardos (J. ACM 2002) gave the first general answers. For linear latency functions they showed that the loss is at most a factor 4/34/34/3. For general latency functions they showed that no such factor exists, and proved instead a bicriteria bound: selfish routing is never worse than optimal routing of twice the traffic. This mission formalizes that bicriteria bound (§3 of the paper) together with its variants for an arbitrary traffic increase (Theorem 3.2) and for approximate equilibria (§5.1).

Timeline:

  • 1952: Wardrop states the equilibrium principle for traffic networks.
  • 1968: Braess exhibits a network where adding an edge increases the equilibrium delay of every user.
  • 2000–2002: Roughgarden and Tardos prove the 4/34/34/3 bound for linear latencies and the bicriteria bound of Theorem 3.1 for all continuous nondecreasing latencies (conference version FOCS 2000, journal version 2002).

Setting

A network has edges eee and routes PPP; route PPP is a set of edges. There are kkk commodities i=1,…,ki = 1,\dots,ki=1,…,k; commodity iii is served by a set of routes Pi\mathcal P_iPi​ and has a rate ri>0r_i > 0ri​>0, the amount of traffic it must send. A flow assigns an amount fP≥0f_P \ge 0fP​≥0 to each route; it is feasible for the rates rrr if ∑P∈PifP=ri\sum_{P \in \mathcal P_i} f_P = r_i∑P∈Pi​​fP​=ri​ for every iii. The flow on edge eee is fe=∑P∋efPf_e = \sum_{P \ni e} f_Pfe​=∑P∋e​fP​.

Each edge has a latency function ℓe\ell_eℓe​, nonnegative, continuous and nondecreasing on [0,∞)[0,\infty)[0,∞): the delay of one unit of traffic crossing eee when the edge carries fef_efe​. The latency of a route is ℓP(f)=∑e∈Pℓe(fe)\ell_P(f) = \sum_{e \in P} \ell_e(f_e)ℓP​(f)=∑e∈P​ℓe​(fe​), and the cost of a flow is the total delay

C(f)=∑PℓP(f) fP=∑eℓe(fe) fe.C(f) = \sum_P \ell_P(f)\, f_P = \sum_e \ell_e(f_e)\, f_e .C(f)=P∑​ℓP​(f)fP​=e∑​ℓe​(fe​)fe​.

A feasible flow fff is at Nash equilibrium (Definition 2.1) if no amount δ>0\delta > 0δ>0 of the flow on a route P1∈PiP_1 \in \mathcal P_iP1​∈Pi​, moved to another route P2∈PiP_2 \in \mathcal P_iP2​∈Pi​, would find a latency on P2P_2P2​ smaller than the latency it had on P1P_1P1​. Lemma 2.2 shows this is equivalent to the Wardrop condition: every route carrying flow has minimum latency among the routes of its commodity. Definition 5.1 relaxes the equilibrium by a factor 1+ϵ1 + \epsilon1+ϵ.

In the Lean development: pathLatency A ℓ x r is ℓP(f)\ell_P(f)ℓP​(f), cost A ℓ x is C(f)C(f)C(f), IsNashFlow A s ℓ rate x is Definition 2.1, IsApproxNashFlow A s ℓ rate ε x is Definition 5.1, and barLatency is the auxiliary latency ℓˉ\bar\ellℓˉ of the proof of Theorem 3.1. Edge flows and feasibility are the published KellyStochasticNetworks.linkFlow and wardropFeasible.

Formalization targets

Goal: Theorem 3.1

If fff is a Nash flow for the rates rrr and f∗f^*f∗ is any flow feasible for the rates 2r2r2r, then

C(f)≤C(f∗).C(f) \le C(f^*).C(f)≤C(f∗).

The comparison is with every flow of twice the rates, not only an optimal one.

Milestones

The edge form of the cost (§2.1), Lemma 2.2 (Nash ⇔\Leftrightarrow⇔ Wardrop), Lemma 2.3 (C(f)=∑iLi(f)riC(f) = \sum_i L_i(f) r_iC(f)=∑i​Li​(f)ri​ for the common latency Li(f)L_i(f)Li​(f) of the flow-carrying routes of commodity iii), and the two displayed inequalities of the proof of Theorem 3.1:

∑eℓˉe(fe∗)fe∗−C(f∗)≤C(f),∑PℓˉP(f∗)fP∗≥2C(f).\sum_e \bar\ell_e(f^*_e) f^*_e - C(f^*) \le C(f), \qquad \sum_P \bar\ell_P(f^*) f^*_P \ge 2C(f).e∑​ℓˉe​(fe∗​)fe∗​−C(f∗)≤C(f),P∑​ℓˉP​(f∗)fP∗​≥2C(f).

Stronger and related statements

Theorem 3.2: for γ>0\gamma > 0γ>0 and f∗f^*f∗ feasible for (1+γ)r(1+\gamma) r(1+γ)r,

C(f)≤1γ C(f∗).C(f) \le \tfrac{1}{\gamma}\, C(f^*).C(f)≤γ1​C(f∗).

Lemma 5.2 (the approximate analogue of Lemma 2.2) and Theorem 5.3: for 0<ϵ<10 < \epsilon < 10<ϵ<1, an ϵ\epsilonϵ-approximate Nash flow fff and f∗f^*f∗ feasible for 2r2r2r,

C(f)≤1+ϵ1−ϵ C(f∗).C(f) \le \frac{1+\epsilon}{1-\epsilon}\, C(f^*).C(f)≤1−ϵ1+ϵ​C(f∗).

Significance

The price of anarchy, the ratio of the cost of a Nash flow to the minimum cost, is unbounded for general latencies: with two parallel links of latencies 111 and xpx^pxp, the ratio tends to infinity as ppp grows. Theorem 3.1 shows that the inefficiency of selfish routing can nevertheless always be offset by doubling capacity, in the sense that the optimal cost of twice the traffic is at least the Nash cost. Theorem 3.2 quantifies the trade-off for any traffic increase and is essentially tight. These results were among the first quantitative bounds of the price-of-anarchy programme and are a standard part of algorithmic game theory courses.

All statements here are proved in the paper (Theorem 5.3 with its proof omitted there as a close copy of Theorem 3.1). To our knowledge none has a machine-checked proof. This mission produces Lean proofs of Theorem 3.1, its supporting lemmas and its two variants, on top of the published Wardrop-equilibrium definitions of Kelly and Yudovina's chapter on road traffic; existence of a Wardrop equilibrium is already proved on the platform (KellyStochasticNetworks.wardrop_equilibrium_exists), so the goal's hypothesis is satisfiable.

Difficulty

The obvious comparison of fff with f∗f^*f∗ route by route fails: f∗f^*f∗ can place its traffic on edges whose latency is much lower than the Nash latencies, and nothing in the latency functions bounds how much lower, since they are only continuous and nondecreasing. A naive bound on the ratio C(f)/C(f∗)C(f)/C(f^*)C(f)/C(f∗) is ruled out by the xpx^pxp example above, so any proof must use the doubled rates essentially. In the Lean development, the passage from Definition 2.1 (a statement about perturbed flows) to the Wardrop condition needs a limit δ→0\delta \to 0δ→0 through continuity on [0,∞)[0,\infty)[0,∞), and the cost manipulations need exchanges of finite double sums over routes and edges.

Formalization scope

  • Routes, not graphs. Routes are arbitrary columns of a 0/10/10/1 edge–route incidence matrix A, each assigned a commodity by s. The paper's family of simple sis_isi​–tit_iti​ paths is one instance; the statements therefore hold for every route family (a disclosed generalization; the proofs use no graph structure). Two copies of one edge set serving two commodities are two routes.
  • Latencies are assumed nonnegative, nondecreasing and continuous on [0,∞)[0,\infty)[0,∞) only. Continuity replaces the paper's differentiability, as licensed by footnote 3 (p. 7) and by §3 (p. 11).
  • Rates are positive reals ri>0r_i > 0ri​>0. The number of commodities may be 000, the paper's k=0k = 0k=0, where all statements hold trivially.
  • Definition 2.1 is formalized with P1≠P2P_1 \ne P_2P1​=P2​ and 0<δ≤fP10 < \delta \le f_{P_1}0<δ≤fP1​​. The page writes δ∈[0,fP1]\delta \in [0, f_{P_1}]δ∈[0,fP1​​] and does not exclude P1=P2P_1 = P_2P1​=P2​; read literally, δ=0\delta = 0δ=0 would force every route of a commodity, used or not, to have the same latency (contradicting Lemma 2.2), and P1=P2P_1 = P_2P1​=P2​ would make Nash flows fail to exist for strictly increasing latencies. Definition 5.1 follows the same convention.
  • No ratios. Bounds are stated as C(f)≤c C(f∗)C(f) \le c\, C(f^*)C(f)≤cC(f∗) for every feasible f∗f^*f∗, never as a quotient of costs, so a zero optimal cost cannot make a statement trivial. The constants 1/γ1/\gamma1/γ and (1+ϵ)/(1−ϵ)(1+\epsilon)/(1-\epsilon)(1+ϵ)/(1−ϵ) carry γ>0\gamma > 0γ>0 and 0<ϵ<10 < \epsilon < 10<ϵ<1.
  • Feasibility for 2r2r2r is wardropFeasible s (fun i => 2 * rate i); for (1+γ)r(1+\gamma) r(1+γ)r it is wardropFeasible s (fun i => (1 + γ) * rate i). Replacing 2r2r2r by rrr would make the goal false (Pigou's example), and comparing only with an optimal f∗f^*f∗ would weaken it.
  • ℓˉ\bar\ellℓˉ is a function of the Nash flow's edge flows, not a free parameter.

Needed infrastructure: finite double-sum exchanges, a one-sided limit argument for continuous functions on [0,∞)[0,\infty)[0,∞), and bookkeeping of the perturbed flow f~\tilde ff~​. The lemmas relating Definition 2.1 to the Wardrop condition are reusable by every later result on nonatomic routing games, including the other missions of this series. Contributions of proofs of any milestone are welcome.

Selected references

  • T. Roughgarden and É. Tardos, How Bad is Selfish Routing?, Journal of the ACM 49(2), 236–259, 2002. https://doi.org/10.1145/506147.506153
  • J. G. Wardrop, Some Theoretical Aspects of Road Traffic Research, Proceedings of the Institution of Civil Engineers 1(3), 325–378, 1952. https://doi.org/10.1680/ipeds.1952.11259
  • D. Braess, A. Nagurney and T. Wakolbinger, On a Paradox of Traffic Planning (translation of Braess 1968), Transportation Science 39(4), 446–450, 2005. https://doi.org/10.1287/trsc.1050.0127
  • F. Kelly and E. Yudovina, Stochastic Networks, Cambridge University Press, 2014, Chapter 4. https://doi.org/10.1017/CBO9781107284722
13 thms4 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Worst-Case Equilibria I: On Two Identical Parallel Links Every Mixed Nash Equilibrium Has Expected Makespan at Most 3/2 Times the OptimumResearch Paper

Motivation

When many users share a network and each routes its own traffic selfishly, the outcome is a Nash equilibrium rather than a centrally optimized assignment. Koutsoupias and Papadimitriou, in Worst-case equilibria (STACS 1999; journal version 2009), proposed to measure the loss caused by this lack of coordination by the worst-case ratio between the social cost of an equilibrium and the social optimum. The ratio, first called the coordination ratio and now the price of anarchy, became a central quantity of algorithmic game theory, studied for routing, scheduling, congestion games, auctions and network design.

The paper analyses the simplest setting in which the question is nontrivial: agents sending traffic over parallel links, which is the same as scheduling independent jobs on parallel machines with the jobs choosing their machines. For two identical links it determines the price of anarchy exactly.

Timeline.

  • 1999: Koutsoupias and Papadimitriou introduce the model and the measure; on two identical links the price of anarchy is 3/23/23/2, and on mmm identical links it is Ω(log⁡m/log⁡log⁡m)\Omega(\log m/\log\log m)Ω(logm/loglogm), with a nonmatching upper bound in the conference version.
  • 2002: Czumaj and Vöcking, and independently Koutsoupias, Mavronicolas and Spirakis, show that this lower bound is tight for mmm identical links, Θ(log⁡m/log⁡log⁡m)\Theta(\log m/\log\log m)Θ(logm/loglogm); Czumaj and Vöcking also give tight bounds for links of different speeds.

Setting

There are nnn agents and mmm identical parallel links. Agent iii has an amount of traffic wi>0w_i>0wi​>0 to send over one link. A pure profile s=(j1,…,jn)∈{1,…,m}ns=(j_1,\dots,j_n)\in\{1,\dots,m\}^ns=(j1​,…,jn​)∈{1,…,m}n assigns a link to each agent; the load of link jjj is ℓj(s)=∑k: jk=jwk\ell_j(s)=\sum_{k:\,j_k=j}w_kℓj​(s)=∑k:jk​=j​wk​, and the cost of agent iii is ℓji(s)\ell_{j_i}(s)ℓji​​(s), the traffic on its own link.

A mixed strategy of agent iii is a probability distribution (pi1,…,pim)(p_i^1,\dots,p_i^m)(pi1​,…,pim​) on the links; the agents randomize independently, so sss occurs with probability ∏ipiji\prod_i p_i^{j_i}∏i​piji​​. The cost to agent iii of a mixed profile ppp is its expected cost cic_ici​. The profile ppp is a Nash equilibrium if no agent can lower its expected cost by changing its own distribution while the others keep theirs.

The expected traffic on link jjj is Mj=∑ipijwiM^j=\sum_i p_i^jw_iMj=∑i​pij​wi​, and the cost of agent iii when its traffic is assigned to link jjj is cij=wi+∑k≠ipkjwk=Mj+(1−pij)wic_i^j=w_i+\sum_{k\ne i}p_k^jw_k=M^j+(1-p_i^j)w_icij​=wi​+∑k=i​pkj​wk​=Mj+(1−pij​)wi​.

The social cost of ppp is the expected maximum load,

cost=∑j1=1m⋯∑jn=1m∏i=1npiji max⁡j∑k: jk=jwk,\mathrm{cost}=\sum_{j_1=1}^m\cdots\sum_{j_n=1}^m\prod_{i=1}^n p_i^{j_i}\,\max_{j}\sum_{k:\,j_k=j}w_k ,cost=j1​=1∑m​⋯jn​=1∑m​i=1∏n​piji​​jmax​k:jk​=j∑​wk​,

and the social optimum opt\mathrm{opt}opt is the least maximum load over all pure assignments, the optimum of the mmm-way partition problem for w1,…,wnw_1,\dots,w_nw1​,…,wn​.

The proof of the main theorem uses two further quantities: the contribution probability qiq_iqi​, the probability that agent iii is on the (lexicographically first) link of maximum load, and the collision probability tik=∑jpijpkjt_{ik}=\sum_jp_i^jp_k^jtik​=∑j​pij​pkj​ of agents iii and kkk.

Formalization targets

Goal: Theorem 3

For any number nnn of agents with positive traffics and m=2m=2m=2 identical links, every Nash equilibrium ppp satisfies

cost(p) ≤ 32 opt.\mathrm{cost}(p)\ \le\ \frac32\,\mathrm{opt}.cost(p) ≤ 23​opt.

Milestones

In the order the proof of Theorem 3 uses them:

  1. Equation (2): cij=wi+∑k≠ipkjwk=Mj+(1−pij)wic_i^j=w_i+\sum_{k\ne i}p_k^jw_k=M^j+(1-p_i^j)w_icij​=wi​+∑k=i​pkj​wk​=Mj+(1−pij​)wi​ for every mixed profile.
  2. The support property: at an equilibrium agent iii uses only links minimizing cijc_i^jcij​, and ci=min⁡jcijc_i=\min_jc_i^jci​=minj​cij​.
  3. The lower bounds opt≥max⁡{wi, ∑kwk/m}\mathrm{opt}\ge\max\{w_i,\ \sum_kw_k/m\}opt≥max{wi​, ∑k​wk​/m}.
  4. Theorem 2 with (6): at every equilibrium on mmm identical links,
ci ≤ ∑kwkm+m−1m wi ≤ (2−1m)opt.c_i\ \le\ \frac{\sum_kw_k}{m}+\frac{m-1}{m}\,w_i\ \le\ \Big(2-\frac1m\Big)\mathrm{opt}.ci​ ≤ m∑k​wk​​+mm−1​wi​ ≤ (2−m1​)opt.
  1. cost=∑iqiwi\mathrm{cost}=\sum_iq_iw_icost=∑i​qi​wi​.
  2. Inequality (7): qi+qk≤1+tikq_i+q_k\le1+t_{ik}qi​+qk​≤1+tik​ for distinct agents i,ki,ki,k.
  3. ci=wi+∑k≠itikwkc_i=w_i+\sum_{k\ne i}t_{ik}w_kci​=wi​+∑k=i​tik​wk​.
  4. On two links, at every equilibrium, ∑k≠iqkwk≤(32−qi)∑k≠iwk\sum_{k\ne i}q_kw_k\le\big(\tfrac32-q_i\big)\sum_{k\ne i}w_k∑k=i​qk​wk​≤(23​−qi​)∑k=i​wk​.

Companion items

The second sentence of Theorem 1 (on two links some equilibrium has cost=32 opt>0\mathrm{cost}=\tfrac32\,\mathrm{opt}>0cost=23​opt>0), which shows the goal is tight, and the fact from its proof that the uniform profile pij=1/mp_i^j=1/mpij​=1/m of mmm unit agents on mmm links is an equilibrium.

Significance

Theorem 3 and the instance of Theorem 1 show that on two identical links selfish randomized routing never costs more than 50%50\%50% above the optimum, whatever the number of agents and their traffics, and that this factor is attained. Theorem 2 gives a per-agent guarantee for any number of links: the expected cost an individual agent experiences at any equilibrium is within 2−1/m2-1/m2−1/m of the optimum, the same factor as Graham's list-scheduling bound. Together they separate the individual and the social view: individual costs stay within a constant, while the expected maximum load, the social cost, can be a factor Ω(log⁡m/log⁡log⁡m)\Omega(\log m/\log\log m)Ω(logm/loglogm) above the optimum.

The results are proved in the paper. As far as is known they have not been machine-checked. Formalizing them produces a verified model of mixed equilibria in load balancing games, with the social cost as an expected maximum over the product distribution, which is the starting point of the later literature on links with speeds, on general congestion games and on smoothness arguments. The intermediate identities (the contribution and collision probabilities) are reusable for any expected-maximum bound over independent random assignments.

Difficulty

The social cost is an expectation of a maximum over mnm^nmn outcomes, and the equilibrium probabilities are given only implicitly, as the solution of a linear system determined by the agents' supports. The natural first idea, to bound the expected maximum load by the maximum expected load max⁡jMj\max_jM^jmaxj​Mj, fails: the expected maximum can be much larger, and bounding it is exactly what makes the problem hard (for mmm links it grows like the maximum occupancy of mmm balls in mmm bins). Computing the equilibrium probabilities explicitly does not help either; the paper gives them for two links and notes it does not see how to use them to bound the social cost. The argument has to relate the per-agent expected costs, which the equilibrium condition controls, to the expected maximum, which it does not control directly.

Formalization scope

Agents are Fin n and links Fin m (the goal uses Fin 2); the paper's agent iii and link jjj are indices i−1i-1i−1, j−1j-1j−1. A mixed profile is p : Fin n → Fin m → ℝ with p i j =pij=p_i^j=pij​. The game is built on the published definitions agt_games (AGT.IsMixedNash, AGT.expectedPayoff, AGT.profileProb). That vocabulary maximizes payoffs, so the payoff of an agent is minus the load of its link, and the expected cost is minus the expected payoff. The equilibrium is the full mixed Nash condition, including that each pip_ipi​ is a probability distribution; the support description is a milestone, not the definition. The social cost is the expected maximum load over the product distribution, never the maximum expected load. opt\mathrm{opt}opt is a minimum over pure assignments, with the number of links an explicit argument. The lexicographically first maximum link is the lowest-indexed link of maximum load.

Traffics are positive, as in the paper's model; some milestones need only nonnegative traffics or no sign condition, and say so. Statements over mmm links assume m≥1m\ge1m≥1. Price-of-anarchy statements are inequalities cost≤c⋅opt\mathrm{cost}\le c\cdot\mathrm{opt}cost≤c⋅opt for every equilibrium, never a quotient cost/opt\mathrm{cost}/\mathrm{opt}cost/opt, whose value at opt=0\mathrm{opt}=0opt=0 would be a junk 000. A formalization in which the social cost is max⁡jMj\max_jM^jmaxj​Mj, or in which the equilibrium is only a support condition without the requirement that the pip_ipi​ be distributions, would trivialize or falsify the goal and is ruled out by these definitions.

A complete development needs finite sums over the mnm^nmn pure profiles, marginalization of product distributions, and the case analysis of the final step. The marginalization lemmas (summing out the other agents, collision probabilities of independent choices) are reusable beyond this mission. Proofs of the milestones, alternative arguments for Theorem 3, and a proof of Theorem 2 for its own sake are all welcome.

Page numbers are those of the PDF file of the journal version; it prints a page number only on its first page.

Selected references

  • E. Koutsoupias and C. Papadimitriou, Worst-case equilibria, STACS 1999, LNCS 1563, pp. 404–413. https://doi.org/10.1007/3-540-49116-3_38 (this mission cites the authors' journal version of 2009, Computer Science Review 3(2), 65–69, https://doi.org/10.1016/j.cosrev.2009.04.003)
  • A. Czumaj and B. Vöcking, Tight bounds for worst-case equilibria, SODA 2002, pp. 413–420; ACM Transactions on Algorithms 3(1), 2007. https://doi.org/10.1145/1186810.1186814
  • E. Koutsoupias, M. Mavronicolas and P. Spirakis, Approximate equilibria and ball fusion, Theory of Computing Systems 36, 683–693, 2003. https://doi.org/10.1007/s00224-003-1131-5
  • R. L. Graham, Bounds on multiprocessing timing anomalies, SIAM Journal on Applied Mathematics 17(2), 416–429, 1969. https://doi.org/10.1137/0117039
11 thms4 active usersReviewed
🏆Completed
CombinatoricsMechanism Design·Captain: mikedeng1

Strategy-Proofness and Arrow's Conditions 1: A Strict Voting Procedure with at Least Three Possible Outcomes Is Strategy-Proof Iff It Is DictatorialResearch Paper

Motivation

A committee that chooses one alternative by voting would like a voting procedure under which no member can gain by misreporting their preferences. Such a procedure is called strategy-proof. Gibbard (Econometrica 41, 1973) and Satterthwaite (J. Econ. Theory 10, 1975) proved independently that, once at least three outcomes are possible, the only strategy-proof procedures are dictatorial. The result is the starting point of the theory of strategy-proof mechanisms: it is why mechanism design restricts preference domains (single-peaked preferences, quasi-linear utilities) or allows randomization.

This mission formalizes Theorem 1 of Satterthwaite's paper, in the version circulated as Northwestern University CMS-EMS Discussion Paper No. 122 (revised December 12, 1974). Its formulation has one feature that the textbook version lacks: the hypothesis is on the range of the procedure, not on the whole alternative set, and the dictatorship is accordingly relative to that range.

Setting

A committee has a finite set InI_nIn​ of n≥1n\ge 1n≥1 individuals and a finite set SmS_mSm​ of mmm alternatives. In a strict committee every individual's ballot BiB_iBi​ is a strong order on SmS_mSm​, a ranking without ties; x Bˉi yx\,\bar B_i\,yxBˉi​y means that BiB_iBi​ ranks xxx strictly above yyy. The set of strong orders is ρm\rho_mρm​, and a ballot set is B=(B1,…,Bn)∈ρmnB=(B_1,\dots,B_n)\in\rho^n_mB=(B1​,…,Bn​)∈ρmn​.

A strict voting procedure vnmv^{nm}vnm assigns to each ballot set a single alternative vnm(B)∈Smv^{nm}(B)\in S_mvnm(B)∈Sm​. Its range TpT_pTp​ is the set of alternatives it selects at some ballot set, and p=∣Tp∣p=|T_p|p=∣Tp​∣, so 1≤p≤m1\le p\le m1≤p≤m.

Individual iii can manipulate vnmv^{nm}vnm at BBB if some ballot Bi′B_i'Bi′​ gives

vnm(B1,…,Bi′,…,Bn) Bˉi vnm(B1,…,Bi,…,Bn),v^{nm}(B_1,\dots,B_i',\dots,B_n)\ \bar B_i\ v^{nm}(B_1,\dots,B_i,\dots,B_n),vnm(B1​,…,Bi′​,…,Bn​) Bˉi​ vnm(B1​,…,Bi​,…,Bn​),

an outcome iii strictly prefers by the standard of the original ballot. The procedure is strategy-proof if no individual can manipulate it at any ballot set.

The procedure is dictatorial if some individual iii exists such that, at every ballot set BBB, vnm(B)v^{nm}(B)vnm(B) is the element of the range TpT_pTp​ that BiB_iBi​ ranks highest. It is fully dictatorial if in addition Tp=SmT_p=S_mTp​=Sm​ and partially dictatorial if Tp⊊SmT_p\subsetneq S_mTp​⊊Sm​.

The proof uses three further notions. Condition U requires that if every BiB_iBi​ ranks the same x∈Tpx\in T_px∈Tp​ above all other elements of TpT_pTp​, then vnm(B)=xv^{nm}(B)=xvnm(B)=x. The procedure is weak alternative-excluding if Tp⊊SmT_p\subsetneq S_mTp​⊊Sm​, and strong alternative-excluding if in addition it satisfies Condition U. Finally θT(Bi)\theta_T(B_i)θT​(Bi​) is the restriction of BiB_iBi​ to a subset TTT.

Formalization targets

Goal: Theorem 1 (p. 11)

For a strict committee with n≥1n\ge 1n≥1 and m≥p≥3m\ge p\ge 3m≥p≥3,

vnm is strategy-proof  ⟺  vnm is dictatorial.v^{nm}\ \text{is strategy-proof}\iff v^{nm}\ \text{is dictatorial}.vnm is strategy-proof⟺vnm is dictatorial.

Milestones

  1. Lemma 1 (p. 13): a strategy-proof strict procedure satisfies Condition U.
  2. Lemma 2 (p. 15): with one individual and three alternatives, a strategy-proof procedure is fully dictatorial or strong alternative-excluding.
  3. Lemma 3 (pp. 16–17): for n+1n+1n+1 individuals and three alternatives, individuals 1,…,n1,\dots,n1,…,n cannot manipulate vn+1,3v^{n+1,3}vn+1,3 if and only if each of the procedures B↦vn+1,3(B,Bn+1)B\mapsto v^{n+1,3}(B,B_{n+1})B↦vn+1,3(B,Bn+1​), one for each ballot of individual n+1n+1n+1, is strategy-proof.
  4. Lemma 4 (p. 22): the induction step from nnn to n+1n+1n+1 individuals for three alternatives.
  5. Lemma 5 (p. 25): for n≥1n\ge 1n≥1, m≥3m\ge 3m≥3, a strategy-proof procedure is fully dictatorial or strong alternative-excluding.
  6. Lemma 6 (p. 26): for n≥2n\ge 2n≥2, if θT(Ci)=θT(Di)\theta_{T}(C_i)=\theta_{T}(D_i)θT​(Ci​)=θT​(Di​) for all iii, with T=TpT=T_pT=Tp​, then vnm(C)=vnm(D)v^{nm}(C)=v^{nm}(D)vnm(C)=vnm(D).
  7. Proof of Theorem 1, (27)–(28) (p. 27): in the case of a strategy-proof, strong alternative-excluding vnmv^{nm}vnm with m>p≥3m>p\ge 3m>p≥3, it induces a strategy-proof procedure vnpv^{np}vnp on the alternatives of its range with vnp[θT(B1),…,θT(Bn)]=vnm(B)v^{np}[\theta_T(B_1),\dots,\theta_T(B_n)]=v^{nm}(B)vnp[θT​(B1​),…,θT​(Bn​)]=vnm(B).

Significance

Theorem 1 characterizes the strategy-proof strict voting procedures completely: given p≥3p\ge 3p≥3, they are exactly the procedures that let one individual pick, from a fixed menu TpT_pTp​, their favourite element. The classical statement assumes the procedure can select every alternative; Theorem 1 shows that excluding alternatives from the menu does not help, since a procedure with any menu of at least three alternatives is still governed by one individual. The paper's correspondence theorem with Arrow's social welfare functions (its Theorem 2) and its extension to ballots with indifference (Theorem 1') build on this statement.

The full-range case is on the platform already: AGT.gibbard_satterthwaite (Theorem 9.8 of Nisan–Roughgarden–Tardos–Vazirani, Algorithmic Game Theory) is proved and states that an incentive compatible social choice function onto at least three alternatives has a dictator; it is included here as a reference item and is exactly the case Tp=SmT_p=S_mTp​=Sm​ of Lemma 5. The open item MechanismDesign.SocialChoice.gibbard_satterthwaite (Börgers, Proposition 8.1) poses the full-range equivalence. Theorem 1 contains both as the special case Tp=SmT_p=S_mTp​=Sm​. What this mission adds is the range-restricted statement and the paper's own route to it: the induction on the number of individuals for three alternatives (Lemmas 2–4) and the reduction of a procedure with a proper range to its range (Lemma 6 and (27)–(28)). The paper only sketches Lemma 4 and defers the induction on mmm to Satterthwaite's dissertation, so the formal development fills these gaps.

Difficulty

The "if" direction is immediate. For the "only if" direction the natural first idea is to apply the full-range theorem to the procedure viewed as a map into TpT_pTp​. This fails as stated: the procedure is still defined on rankings of all mmm alternatives, and nothing yet says that its choice ignores how individuals rank alternatives outside TpT_pTp​. That is the content of Lemma 6, which needs strategy-proofness and Condition U; only after it does the procedure factor through rankings of TpT_pTp​, and only then is the factor itself strategy-proof. The full-range case itself is the classical theorem, whose known proofs (via Arrow's theorem, or by pivotal-voter arguments) are combinatorial and long.

Formalization scope

  • Individuals and alternatives are finite types ι and A; nnn = Fintype.card ι, mmm = Fintype.card A, and the n+1n+1n+1 individuals of Lemmas 3–4 are Option ι, with none the individual n+1n+1n+1.
  • Strict ballots and strategy-proofness come from the published definition agt_social (namespace AGT): a ballot is a relation r with IsStrictTotalOrder A r, r x y is the paper's x Bˉi yx\,\bar B_i\,yxBˉi​y, and strategy-proofness is AGT.IncentiveCompatible, which is the paper's definition (1) on ρmn\rho^n_mρmn​.
  • The range is taken over strict ballot sets only, and ppp is its Set.ncard. Theorem 1 assumes n≥1n\ge 1n≥1 and p≥3p\ge 3p≥3; m≥pm\ge pm≥p holds automatically, so m≥3m\ge 3m≥3 is not a separate hypothesis.
  • Dictatorial reads the paper's dictator function fTif^i_TfTi​ as "the BiB_iBi​-maximal element of TpT_pTp​", which for strong orders is unique.
  • θT(Ci)=θT(Di)\theta_T(C_i)=\theta_T(D_i)θT​(Ci​)=θT​(Di​) is encoded as agreement of the two strict relations on T×TT\times TT×T, and the procedure vnpv^{np}vnp of (28) lives on the subtype of the range.
  • Lemmas keep their printed hypotheses (m≥3m\ge 3m≥3, p≥1p\ge 1p≥1, Lemma 6's n≥2n\ge 2n≥2), even where the conclusion would hold without them. The range restriction milestone keeps the proof's case assumptions of strong alternative exclusion and m>p≥3m>p\ge 3m>p≥3.

Two encodings would trivialize the goal and are excluded: a range taken over all relation profiles (junk values would make p≥3p\ge 3p≥3 meaningless), and a dictatorship that only constrains ballot sets at which the dictator's overall favourite lies in TpT_pTp​, or that asks for the dictator's favourite in all of SmS_mSm​ (false whenever Tp⊊SmT_p\subsetneq S_mTp​⊊Sm​). The bound p≥3p\ge 3p≥3 is needed: a procedure with two possible outcomes, such as majority vote between two fixed alternatives, is strategy-proof and not dictatorial, and an imposed procedure (p=1p=1p=1) is dictatorial only vacuously.

Contributions are welcome at every milestone, and the restriction-to-range step (Lemma 6 and (27)–(28)) is reusable for any statement that transfers results from full-range to range-restricted procedures.

Selected references

  • M. A. Satterthwaite, Strategy-proofness and Arrow's Conditions: Existence and Correspondence Theorems for Voting Procedures and Social Welfare Functions, Northwestern University CMS-EMS Discussion Paper No. 122, rev. Dec. 12, 1974; published in J. Econ. Theory 10(2) (1975) 187–217. https://doi.org/10.1016/0022-0531(75)90050-2
  • A. Gibbard, Manipulation of Voting Schemes: A General Result, Econometrica 41(4) (1973) 587–601. https://doi.org/10.2307/1914083
  • N. Nisan, Introduction to Mechanism Design (for Computer Scientists), Chapter 9 of N. Nisan, T. Roughgarden, É. Tardos, V. V. Vazirani (eds.), Algorithmic Game Theory, Cambridge University Press, 2007. https://doi.org/10.1017/CBO9780511800481
  • T. Börgers, An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015, Chapter 8. https://doi.org/10.1093/acprof:oso/9780199734023.001.0001
11 thms4 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

Equilibrium Points in n-Person Games: the Countering Correspondence Has Nonempty Convex Values and a Closed Graph, and Its Fixed Points Are the Equilibrium PointsResearch Paper

Motivation

A Nash equilibrium is a joint choice of strategies at which no player can improve their own expected payoff by changing their strategy alone. This gives a testable notion of stable behavior for a finite game, including games in which the players' aims differ. Nash's two-page 1950 note established the existence of such a point for finite games by organizing each player's best replies into a single correspondence and using a fixed-point theorem. The note identifies several properties of that correspondence and ends by comparing equilibrium payoffs in zero-sum and general games. Those claims, stated together in Nash's published note, are the subject of this mission.

The existence conclusion itself already has a proved formal statement, AGT.nash_existence, in the game vocabulary used here. The remaining claims explain what the fixed-point argument acts on: which profiles are related by countering, why countering sets are usable as values of a correspondence, and what their fixed points mean. Keeping those statements explicit makes the 1950 argument legible independently of the existence theorem's proof.

Setting

There is a finite set III of players. Each player iii has a finite, nonempty set SiS_iSi​ of pure strategies. A pure-strategy profile sss chooses one element of every SiS_iSi​, and ui(s)∈Ru_i(s)\in\mathbb Rui​(s)∈R is player iii's payoff. A mixed strategy PiP_iPi​ assigns a nonnegative real weight to each element of SiS_iSi​, with weights summing to one. The space Σ\SigmaΣ of mixed profiles P=(Pi)i∈IP=(P_i)_{i\in I}P=(Pi​)i∈I​ is the product of these finite probability simplices.

Players randomize independently. Thus the probability of a pure profile sss under PPP is ∏j∈IPj(sj)\prod_{j\in I}P_j(s_j)∏j∈I​Pj​(sj​), and player iii's expected payoff is

Ui(P)=∑s∈∏jSj(∏j∈IPj(sj))ui(s).U_i(P)=\sum_{s\in\prod_j S_j}\left(\prod_{j\in I}P_j(s_j)\right)u_i(s).Ui​(P)=s∈∏j​Sj​∑​​j∈I∏​Pj​(sj​)​ui​(s).

For a strategy τi\tau_iτi​ of player iii, write Ui(τi,P−i)U_i(\tau_i,P_{-i})Ui​(τi​,P−i​) for the payoff obtained by replacing only coordinate iii of PPP. A profile QQQ counters PPP if Q∈ΣQ\in\SigmaQ∈Σ and, for every player iii, its coordinate QiQ_iQi​ gives that player the highest expected payoff available against the other players' coordinates of PPP:

Q∈C(P)⟺Q∈ΣandUi(τi,P−i)≤Ui(Qi,P−i)for every i∈I and every mixed τi.Q\in C(P)\quad\Longleftrightarrow\quad Q\in\Sigma\quad\text{and}\quad U_i(\tau_i,P_{-i})\le U_i(Q_i,P_{-i}) \quad\text{for every }i\in I\text{ and every mixed }\tau_i.Q∈C(P)⟺Q∈ΣandUi​(τi​,P−i​)≤Ui​(Qi​,P−i​)for every i∈I and every mixed τi​.

The countering correspondence CCC assigns the set C(P)C(P)C(P) to each P∈ΣP\in\SigmaP∈Σ. Its graph comprises the pairs (P,Q)(P,Q)(P,Q) with P∈ΣP\in\SigmaP∈Σ and Q∈C(P)Q\in C(P)Q∈C(P). A fixed point is a profile PPP belonging to C(P)C(P)C(P); Nash calls it an equilibrium point.

Formalization targets

The goal states the three properties of CCC that Nash uses, along with the identification of its fixed points:

∀P∈Σ,∅≠C(P)⊆Σ,C(P) is convex;\forall P\in\Sigma,\qquad \varnothing\ne C(P)\subseteq\Sigma, \qquad C(P)\text{ is convex};∀P∈Σ,∅=C(P)⊆Σ,C(P) is convex; Pk→P, Qk→Q, Qk∈C(Pk) for all k⟹Q∈C(P);P∈C(P) ⟺ P is a Nash equilibrium.P_k\to P,\ Q_k\to Q,\ Q_k\in C(P_k)\text{ for all }k \quad\Longrightarrow\quad Q\in C(P); \qquad P\in C(P)\ \Longleftrightarrow\ P\text{ is a Nash equilibrium}.Pk​→P, Qk​→Q, Qk​∈C(Pk​) for all k⟹Q∈C(P);P∈C(P) ⟺ P is a Nash equilibrium.

The milestone list follows the claims in the note: the payoff functions are polylinear and continuous; the correspondence maps mixed profiles to nonempty subsets of mixed profiles; its values are convex; its graph is closed in the sequential formulation Nash writes; and self-countering is equilibrium. A separate closed-set formulation records the graph property in the product topology.

The note also asserts a distinction about payoffs. In a two-person zero-sum game, where u0(s)+u1(s)=0u_0(s)+u_1(s)=0u0​(s)+u1​(s)=0 on every pure profile, any two equilibria have the same expected payoff for each player:

Ui(σ)=Ui(σ′)(i=0,1).U_i(\sigma)=U_i(\sigma')\qquad(i=0,1).Ui​(σ)=Ui​(σ′)(i=0,1).

For general games, this can fail. A companion target asks for a finite two-person game with two equilibria having different expected payoffs.

Significance

The correspondence theorem records the precise conditions on which Nash's application of Kakutani's fixed-point theorem rests. Nonempty convex values and a closed graph make the fixed-point route applicable to the mixed-strategy space; the fixed-point clause says why its output is an equilibrium of the game rather than only a topological point. The zero-sum companion separates the common value of a two-person zero-sum game from the possible range of equilibrium payoffs in a general game. These consequences and the comparison appear in Nash's note.

The equilibrium existence theorem is already proved as the referenced AGT.nash_existence. What remains here is to formalize the correspondence properties and the payoff comparison as their own auditable statements, using that theorem's published game definitions. The claims are known results from 1950; their appearance as goals means proofs of these particular statements are still to be supplied in this development.

Difficulty

The payoff of a player depends on every player's strategy, while countering compares only one changed coordinate at a time. The relevant set of maximizers is therefore indexed by the countered profile, and all players' choices must fit into one countering profile. Establishing closedness requires passing the payoff comparisons and the probability-vector conditions through limits of profiles. The zero-sum equality concerns arbitrary pairs of equilibria, which need not use the same strategies; an argument based only on the existence of an equilibrium cannot give it. For general games, a single equilibrium says nothing about whether another equilibrium has a different payoff.

Formalization scope

The Lean development uses a finite player type ι, finite pure-strategy types S i, real payoffs u, and the published definitions AGT.IsLottery, AGT.IsMixedProfile, AGT.expectedPayoff, and AGT.IsMixedNash. The goal and nonempty-value milestone require each S i to be nonempty. The note's probability distributions implicitly require this; the player type itself may be empty. A mixed profile is a tuple of finite real weight vectors, with no measure-theoretic integration or hidden normalization. In the two-person claim, players are 0, 1 : Fin 2.

Convergence is in the ordinary product topology of the real coordinate spaces. The sequence index is kkk because the note also uses nnn for the number of players. Counters u P Q requires QQQ to be a mixed profile and compares QiQ_iQi​ with every mixed deviation against P−iP_{-i}P−i​; this rules out arbitrary weight vectors and comparisons against the wrong opponents. Neither continuity nor the existence of a best response is assumed in the goal: those properties are targets. The definition layer and the payoff continuity and polylinearity results can be reused by other finite-game formalizations.

Selected references

  • J. F. Nash, Jr., Equilibrium Points in n-Person Games, Proceedings of the National Academy of Sciences 36(1), 48–49 (1950). DOI: 10.1073/pnas.36.1.48.
  • S. Kakutani, A Generalization of Brouwer's Fixed Point Theorem, Duke Mathematical Journal 8, 457–459 (1941), cited in Nash's footnote 1. DOI: 10.1215/S0012-7094-41-00838-4.
10 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations Research·Captain: mikedeng1

Existence of Correlated Equilibria I: Every Finite Game Has a Correlated EquilibriumResearch Paper

Motivation

In a finite game, a referee can recommend one action privately to each player according to a joint distribution. The recommendations may be correlated: learning one's own recommendation can convey information about the others'. A correlated equilibrium is a distribution for which no player gains, in expectation, by replacing a particular recommendation with another action. This solution concept uses the same payoff data as a strategic-form game but allows more joint distributions than independent mixed strategies. Hart and Schmeidler's Theorem 1 establishes that at least one such distribution exists for every finite game, with no assumptions on the payoffs beyond being real-valued. Their paper uses the finite result as the starting point for existence results with infinitely many players and, later, compact strategy spaces. Hart and Schmeidler (1989)

The authors explain that the standard route passes through a mixed Nash equilibrium: independent equilibrium strategies induce a correlated distribution. The finite theorem here is the same existence conclusion expressed directly through recommendation inequalities, which are linear in the joint distribution. That distinction matters for the later sections of the paper, where the authors examine games with infinitely many players, including an example with a countably additive correlated equilibrium but no Nash equilibrium. Hart and Schmeidler (1989), pp. 18, 21–22

Setting

Let NNN be a finite player set. Each player i∈Ni\in Ni∈N has a finite, nonempty set SiS^iSi of pure strategies, and a pure profile is a tuple s=(si)i∈Ns=(s^i)_{i\in N}s=(si)i∈N​ in S=∏i∈NSiS=\prod_{i\in N}S^iS=∏i∈N​Si. The real number hi(s)h^i(s)hi(s) is player iii's payoff at sss. For a player iii, write s−is^{-i}s−i for all coordinates except iii and (s−i,ti)(s^{-i},t^i)(s−i,ti) for the profile obtained by replacing the iiith coordinate with tit^iti. A probability vector on SSS is a function p:S→Rp:S\to\mathbb Rp:S→R with p(s)≥0p(s)\ge0p(s)≥0 for every sss and ∑s∈Sp(s)=1\sum_{s\in S}p(s)=1∑s∈S​p(s)=1. These are exactly the paper's finite-game and probability-vector conventions. Hart and Schmeidler (1989), pp. 18–19

Suppose the referee draws sss with probability p(s)p(s)p(s) and privately tells player iii only sis^isi. For every recommended action ri∈Sir^i\in S^iri∈Si and alternative action ti∈Sit^i\in S^iti∈Si, the incentive inequality is

∑s−i∈S−ip(s−i,ri)[hi(s−i,ri)−hi(s−i,ti)]≥0.\sum_{s^{-i}\in S^{-i}}p(s^{-i},r^i) \bigl[h^i(s^{-i},r^i)-h^i(s^{-i},t^i)\bigr]\ge0.s−i∈S−i∑​p(s−i,ri)[hi(s−i,ri)−hi(s−i,ti)]≥0.

When the recommendation rir^iri has zero probability, this inequality holds automatically. Thus no conditional probability needs to be defined in that case. A probability vector satisfying every such inequality is a correlated equilibrium. The inequalities include ri=tir^i=t^iri=ti, whose left-hand side is zero. Hart and Schmeidler (1989), p. 19, condition (1)

Formalization targets

Theorem 1: existence in every finite game

The mission's goal is the paper's Theorem 1, with its definition of correlated equilibrium kept explicit:

∀(N,(Si)i∈N,h),∃p∈Δ(S)∀i∈N ∀ri,ti∈Si,∑s−ip(s−i,ri)[hi(s−i,ri)−hi(s−i,ti)]≥0.\forall (N,(S^i)_{i\in N},h),\quad \exists p\in\Delta(S)\quad \forall i\in N\ \forall r^i,t^i\in S^i,\quad \sum_{s^{-i}}p(s^{-i},r^i) \bigl[h^i(s^{-i},r^i)-h^i(s^{-i},t^i)\bigr]\ge0.∀(N,(Si)i∈N​,h),∃p∈Δ(S)∀i∈N ∀ri,ti∈Si,s−i∑​p(s−i,ri)[hi(s−i,ri)−hi(s−i,ti)]≥0.

Here Δ(S)\Delta(S)Δ(S) denotes the set of probability vectors on the finite set SSS. The quantified payoffs are arbitrary real functions; the result specifies neither a unique equilibrium nor a particular equilibrium distribution. The milestone list records the paper's auxiliary-game correspondence, its finite minimax criterion, the nonnegative-matrix lemma, equation (2), and the final product-strategy identity. The lemma is linked to the already proved platform theorem CalibratedCE.Forecast.flow_conservation_solvable, which states the equivalent balance equations for a nonnegative matrix indexed by a nonempty finite set. Hart and Schmeidler (1989), pp. 19–20

Significance

The result guarantees feasibility of the complete system of recommendation inequalities for every finite payoff table. It is stronger as a foundation than checking an equilibrium in one game: later arguments can invoke the result after restricting a larger game to finite strategy sets. Hart and Schmeidler do exactly that in their infinite-game existence theorems. The finite theorem is already known mathematically; the task here is to give its particular statement and proof structure reusable, machine-checked declarations. Hart and Schmeidler (1989), pp. 20, 22, 24

The platform already has the general finite-game lottery vocabulary in agt_games and a proved mixed Nash-existence theorem, AGT.nash_existence. It also has AGT.IsCorrelatedEquilibrium in swap-function cost notation, AGT.swap_regret_correlated_equilibrium for approximate equilibria, and Aumann 1987's finite-probability-space model. Those results provide related notions and consequences. With ε=0\varepsilon = 0ε=0 and costs −hi-h^i−hi, the swap-function form of AGT.IsCorrelatedEquilibrium is equivalent to condition (1), since a switching rule can be optimized separately for each recommendation; the mission nevertheless states condition (1) as printed. The finite Minimax Theorem invoked on p. 19 is proved on the platform as AGT.zero_sum_minimax (a saddle-point statement for matrices indexed by Fin (m+1) and Fin (n+1), in another Mathlib environment), so the minimax milestone is the consequence the paper draws from it rather than the theorem itself. This mission fixes Hart and Schmeidler's payoff-maximizing condition (1) directly, with its recommendation-specific inequalities and auxiliary-game steps. The linked flow-conservation theorem was formalized in the Foster–Vohra series; its balance equations have the same content as the lemma on p. 19 after expanding the coefficients of an arbitrary vector uuu. Hart and Schmeidler (1989), p. 19

Difficulty

The inequalities must hold simultaneously for every player and every recommended-action/deviation pair. Choosing a distribution that makes one inequality hold does not ensure the others: the same weights p(s)p(s)p(s) occur in several constraints. An arbitrary product distribution can fail even in a two-player coordination game. Passing through an existing mixed Nash equilibrium proves existence, but gives no formal account of the paper's own finite minimax and nonnegative-matrix claims. The proof obligations here include the exact correspondence between the conditional recommendation constraints and an auxiliary two-person game, plus the algebra of a product of playerwise probability vectors. Hart and Schmeidler (1989), pp. 18–20

Formalization scope

Players are a finite Lean type ι\iotaι; SiS^iSi is a finite, nonempty type, and hi:S→Rh^i:S\to\mathbb Rhi:S→R. The profile space is the dependent product S=∏iSiS=\prod_iS^iS=∏i​Si. The expression (s−i,ti)(s^{-i},t^i)(s−i,ti) is Function.update s i t, and summing over S−iS^{-i}S−i with the iiith coordinate fixed to rir^iri is represented by summing over profiles satisfying si=ris^i=r^isi=ri. Probability vectors use the published AGT.IsLottery: nonnegative real weights whose finite sum is one. No measure-theoretic integral or conditional probability appears in this finite mission. The auxiliary minimizing player's pure strategies form one set of triples (i,ri,ti)(i,r^i,t^i)(i,ri,ti), with one probability vector over all triples. Hart and Schmeidler (1989), p. 19

Nonemptiness of each SiS^iSi is required: an empty strategy set would leave no probability vector on SSS. The player set itself may be empty; then SSS has one profile and the incentive conditions have no instances. The generic minimax milestone separately assumes that both of its pure-strategy sets are nonempty, so solvers must handle the playerless goal directly. Equality decisions are computational instances for finite enumeration, not restrictions on mathematical games. The correlated-equilibrium definition includes normalization and all incentive inequalities; it is not defined to hold automatically. The goal is the existence of a probability vector satisfying condition (1) itself, not a restatement through AGT.nash_existence that would make it a corollary of Nash's theorem. A sorry-free local check exhibits a correlated point mass in a two-player coordination game and another point mass that violates an incentive inequality. Contributions to the finite minimax criterion, its connection to the published balance theorem, and the sum rearrangement in the product-strategy milestone are all useful beyond this one goal.

Selected references

  • Sergiu Hart and David Schmeidler, Existence of Correlated Equilibria, Mathematics of Operations Research 14(1), 1989, pp. 18–25. DOI.
  • Noam Nisan, Tim Roughgarden, Éva Tardos, and Vijay V. Vazirani, eds., Algorithmic Game Theory, Cambridge University Press, 2007, Chapter 1. DOI.
8 thms4 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Supply Chain Coordination with Contracts IV: Competing Newsvendors with Proportional Allocation Have a Unique Equilibrium, and a Coordinating Buy-Back Gives the Supplier ((p(n − 1) + b)/(pn))Π(q°)Textbook

Why competing retailers change the contracting problem

A supplier who sells through a single newsvendor retailer faces double marginalization: the retailer bears the whole cost of leftover stock but earns only the retail margin, so under a plain wholesale-price contract he orders less than the integrated supply chain would. The literature reviewed in G. P. Cachon's chapter Supply Chain Coordination with Contracts (Handbooks in OR & MS, vol. 11, 2003) shows that buy-back, revenue-sharing and related contracts correct this distortion. Section 6.5 asks what happens when the supplier sells through several retailers who compete for the same customers.

Competition can push in the opposite direction. When customers buy wherever stock is available, a retailer who stocks more also takes demand from his rivals, and he does not count that loss as a cost. This demand-stealing effect pushes the retailers towards over-ordering, which offsets double marginalization. §6.5.1 makes this precise in the proportional allocation model, in which total demand is split among the retailers in proportion to their inventories. The model goes back to the deterministic version of Wang and Gerchak (2001); related allocation models are those of Lippman and McCardle (1997) and Anupindi and Bassok (1999), and Mahajan and van Ryzin (2001) observe the same mitigation of the need for coordinating contracts.

This mission formalizes §6.5.1 of the chapter's January 2003 third draft, pp. 48–53.

The proportional allocation model

There are n≥2n \ge 2n≥2 retailers and one supplier. Total retail demand D≥0D \ge 0D≥0 is random, with distribution function FFF that is differentiable on (0,∞)(0,\infty)(0,∞) with density fff, strictly increasing on [0,∞)[0,\infty)[0,∞), and satisfies F(0)=0F(0)=0F(0)=0. The retail price is ppp and the supplier's unit production cost is ccc, with 0<c<p0 < c < p0<c<p. Goodwill costs, the salvage value and the retailers' handling cost are zero.

Retailer iii orders qi≥0q_i \ge 0qi​≥0. Write q=∑jqjq = \sum_j q_jq=∑j​qj​ and q−i=q−qiq_{-i} = q - q_iq−i​=q−qi​. Retailer iii receives the demand Di=(qi/q)DD_i = (q_i/q)DDi​=(qi​/q)D. Under a buy-back contract (w,b)(w, b)(w,b) he pays www per unit ordered and is refunded bbb per unit left over; b=0b = 0b=0 is the wholesale-price contract. His expected profit is

πi(qi,q−i)=E[pmin⁡(qi,Di)+b(qi−Di)+]−wqi=(p−w)qi−(p−b)qiq∫0qF(x) dx.\pi_i(q_i, q_{-i}) = \mathbb E\big[p\min(q_i, D_i) + b(q_i - D_i)^+\big] - wq_i = (p-w)q_i - (p-b)\frac{q_i}{q}\int_0^q F(x)\,dx .πi​(qi​,q−i​)=E[pmin(qi​,Di​)+b(qi​−Di​)+]−wqi​=(p−w)qi​−(p−b)qqi​​∫0q​F(x)dx.

Because total sales min⁡(q,D)\min(q, D)min(q,D) depend only on the total stock, the integrated chain earns Π(q)=pS(q)−cq\Pi(q) = pS(q) - cqΠ(q)=pS(q)−cq with S(q)=E[min⁡(q,D)]S(q) = \mathbb E[\min(q,D)]S(q)=E[min(q,D)], and its optimal stock qoq^oqo solves the newsvendor equation F(qo)=(p−c)/pF(q^o) = (p-c)/pF(qo)=(p−c)/p, Eq. (20). A Nash equilibrium is a profile of orders in which each qi∗q^*_iqi∗​ maximizes πi(⋅,q−i∗)\pi_i(\cdot, q^*_{-i})πi​(⋅,q−i∗​) over all orders x≥0x \ge 0x≥0. A contract coordinates the chain when its equilibrium total order is qoq^oqo.

Two contract prices appear on p. 52: the wholesale price w^(q)=p(1−1nF(q)−n−1n⋅1q∫0qF)\widehat w(q) = p\big(1 - \tfrac1n F(q) - \tfrac{n-1}{n}\cdot\tfrac1q\int_0^qF\big)w(q)=p(1−n1​F(q)−nn−1​⋅q1​∫0q​F) that induces total stock qqq, and the buy-back wholesale price

wb(b)=p−(p−b)[1n⋅p−cp+n−1n⋅1qo∫0qoF(x) dx].w_b(b) = p - (p-b)\left[\frac1n\cdot\frac{p-c}{p} + \frac{n-1}{n}\cdot\frac{1}{q^o}\int_0^{q^o}F(x)\,dx\right].wb​(b)=p−(p−b)[n1​⋅pp−c​+nn−1​⋅qo1​∫0qo​F(x)dx].

Formalization targets

Goal: the coordinating buy-back contract (pp. 51–53)

For n≥2n \ge 2n≥2, b<pb < pb<p and qoq^oqo solving (20), with w=wb(b)w = w_b(b)w=wb​(b): qoq^oqo maximizes Π\PiΠ; b<wb(b)<pb < w_b(b) < pb<wb​(b)<p; the profile in which every retailer orders qo/nq^o/nqo/n is the unique Nash equilibrium; and at that equilibrium

πi=p−bpn2 Π(qo),πs=wqo−cqo−b E[(qo−D)+]=p(n−1)+bpn Π(qo).\pi_i = \frac{p-b}{pn^2}\,\Pi(q^o), \qquad \pi_s = wq^o - cq^o - b\,\mathbb E[(q^o-D)^+] = \frac{p(n-1)+b}{pn}\,\Pi(q^o).πi​=pn2p−b​Π(qo),πs​=wqo−cqo−bE[(qo−D)+]=pnp(n−1)+b​Π(qo).

Milestones

The milestones are the section's own claims, in attack order: the newsvendor characterization (20); the inequality 1q∫0qF<F(q)\frac1q\int_0^qF < F(q)q1​∫0q​F<F(q); the closed form of πi\pi_iπi​ and its strict concavity in the retailer's own order (p. 50); the first-order condition and Eq. (21); the monotonicity and limits of the left side LnL_nLn​ of Eq. (22), giving a unique root for b<w<pb < w < pb<w<p; the unique, symmetric Nash equilibrium for every b<w<pb < w < pb<w<p; the increase of the equilibrium total in nnn; that w^(q)\widehat w(q)w(q) induces qqq, that w^(qo)>c\widehat w(q^o) > cw(qo)>c, and that the supplier's profit under wholesale pricing has negative slope at qoq^oqo; the coordinating price wb(b)w_b(b)wb​(b) with wb(b)>w^(qo)w_b(b) > \widehat w(q^o)wb​(b)>w(qo) for b>0b > 0b>0; and the ratio πs(qo,wb(0),0)/Π(qo)=(n−1)/n\pi_s(q^o, w_b(0), 0)/\Pi(q^o) = (n-1)/nπs​(qo,wb​(0),0)/Π(qo)=(n−1)/n (p. 53). A companion item states the endpoint b=pb = pb=p, at which the supplier takes all of Π(qo)\Pi(q^o)Π(qo).

Significance

The section answers two questions. First, with competing retailers a plain wholesale-price contract can coordinate the chain and still leave the supplier a positive margin, which a single retailer never allows. Second, that contract is not the supplier's best wholesale price, and it fixes a single division of profit. Buy-back contracts remove both limitations: the family (wb(b),b)(w_b(b), b)(wb​(b),b) coordinates for every b<pb < pb<p and moves the supplier's share continuously from (n−1)/n(n-1)/n(n−1)/n to all of Π(qo)\Pi(q^o)Π(qo). The ratio (n−1)/n(n-1)/n(n−1)/n also measures how little a coordinating contract adds when many retailers compete (80% of the optimal profit at n=5n = 5n=5).

The results are proved in the chapter, mostly by short computations, and none of them has been machine-checked. The formalization makes explicit what the page leaves implicit: that no equilibrium has a retailer ordering zero, the limits behind "from 0 to 1", and the density condition behind the strict sign on p. 52. It also produces a reusable proportional-allocation game and a Nash-equilibrium predicate for nonnegative real strategies.

Difficulty

The algebraic identities (the profits at the coordinating contract, the ratio (n−1)/n(n-1)/n(n−1)/n, the derivative at qoq^oqo) are routine once πi\pi_iπi​ has its closed form. The closed form itself requires computing the expectation with proportional shares and identifying E[min⁡(q,D)]\mathbb E[\min(q,D)]E[min(q,D)] with q−∫0qFq - \int_0^q Fq−∫0q​F.

The real obstacle is the uniqueness of the equilibrium. The page argues from first-order conditions, which describe only interior best responses. A complete proof must show that each retailer's profit is strictly concave in his own order, that no retailer orders zero in equilibrium, and that the all-zero profile (where πi\pi_iπi​ has q=0q = 0q=0 in a denominator) is not an equilibrium. Strict concavity is the delicate step. The second derivative mixes the density with the term 2q−iq3(qF(q)−∫0qF)\frac{2q_{-i}}{q^3}\big(qF(q) - \int_0^qF\big)q32q−i​​(qF(q)−∫0q​F), and concavity has to be established on the closed half-line, including the boundary qi=0q_i = 0qi​=0.

Formalization scope

Retailers are indexed by Fin n with n≥2n \ge 2n≥2 (the page's n>1n > 1n>1). The comparison in nnn also allows a single retailer, as the page does. Orders are real numbers qi≥0q_i \ge 0qi​≥0, and best responses range over all x≥0x \ge 0x≥0. The demand law is a probability measure on R\mathbb RR carried by [0,∞)[0,\infty)[0,∞) with finite mean, FFF is its cdf, and fff is a field with HasDerivAt F (f y) y for y>0y > 0y>0. These are the chapter's standing assumptions (p. 7). The condition c>0c > 0c>0 is needed for (20) to have a solution. The integrated optimum qoq^oqo enters each theorem through the hypothesis F(qo)=(p−c)/pF(q^o) = (p-c)/pF(qo)=(p−c)/p, which determines it uniquely. Transfers run from the retailers to the supplier.

Added or made explicit relative to the page: b<pb < pb<p in the concavity claim (at b=pb = pb=p the profit is linear); f(qo)>0f(q^o) > 0f(qo)>0 for the strict sign of the supplier's marginal profit; positivity of the total order wherever 1q∫0qF\frac1q\int_0^qFq1​∫0q​F appears. The page's printed slips (the first-order condition rescaled by q∗/(p−b)q^*/(p-b)q∗/(p−b), "F(qo)=(p−c)/cF(q^o) = (p-c)/cF(qo)=(p−c)/c", "w(b)w(b)w(b)") are corrected in the statements and kept in the milestone quotes.

Ruled out as trivializing: w^\widehat ww and wbw_bwb​ are the printed formulas, not "the price at which qoq^oqo is an equilibrium"; the supplier's profit is computed from the transfers, not as Π\PiΠ minus the retailers' profits; the equilibrium statement quantifies over all nonnegative deviations, so restricting attention to interior or symmetric profiles is not an option.

A complete development needs interval integrals of a cdf, the fundamental theorem of calculus for q↦∫0qFq \mapsto \int_0^qFq↦∫0q​F, and strict concavity from a strictly decreasing derivative. The proportional-allocation game and the Nash predicate are reusable for the other allocation models of §6.5. No platform item is referenced: the competing-retailer game of Cachon and Lariviere (2005), RevShareCoord.Competing.*, uses deterministic revenue functions and is a different model.

Selected references

  • G. P. Cachon, Supply Chain Coordination with Contracts, in S. Graves and T. de Kok (eds.), Handbooks in Operations Research and Management Science, vol. 11, North-Holland, 2003; read in the author's 3rd draft (Jan. 2003), §6.5.1. https://doi.org/10.1016/S0927-0507(03)11006-7
  • Y. Wang and Y. Gerchak, Supply chain coordination when demand is shelf-space dependent, Manufacturing & Service Operations Management 3(1), 2001, 82–87. https://doi.org/10.1287/msom.3.1.82.9998
  • S. A. Lippman and K. F. McCardle, The competitive newsboy, Operations Research 45(1), 1997, 54–65. https://doi.org/10.1287/opre.45.1.54
  • S. Mahajan and G. van Ryzin, Inventory competition under dynamic consumer choice, Operations Research 49(5), 2001, 646–657. https://doi.org/10.1287/opre.49.5.646.10603
  • G. P. Cachon and M. A. Lariviere, Supply chain coordination with revenue-sharing contracts: strengths and limitations, Management Science 51(1), 2005, 30–44. https://doi.org/10.1287/mnsc.1040.0215
18 thms4 active usersReviewed
🏆Completed
AnalysisOperations ResearchTopology·Captain: mikedeng1

A Generalization of Brouwer's Fixed Point Theorem: An Upper Semi-Continuous Map with Nonempty Closed Convex Values on a Bounded Closed Convex Set in Euclidean Space Has a Fixed PointResearch Paper

Motivation

Brouwer's fixed point theorem says that a continuous map of a closed simplex into itself has a fixed point. Many existence questions in game theory and mathematical economics produce instead a point-to-set mapping: to each point xxx it assigns a whole set Φ(x)\Phi(x)Φ(x) of admissible responses, for instance the set of best replies of a player to the others' strategies. Such a set need not be a single point, and no continuous single-valued selection need exist. Kakutani's 1941 note, A generalization of Brouwer's fixed point theorem, gives the fixed point theorem for this setting, and shows on the same three pages that it implies two results of J. von Neumann: an intersection theorem for two closed subsets of a product of convex sets, and the minimax theorem.

Timeline, as the paper records it:

  • 1912–1929: Brouwer's theorem; the paper cites the proof of Knaster, Kuratowski and Mazurkiewicz (Fund. Math. 14, 1929).
  • 1928: von Neumann proves the minimax theorem for matrix games (Math. Ann. 100).
  • 1937: von Neumann proves the intersection theorem (Kakutani's Theorem 2) in his paper on an economic equilibrium system, "by using a notion of integral in Euclidean spaces".
  • 1941: Kakutani proves Theorem 1 (simplex), the Corollary (bounded closed convex sets), and derives Theorems 2 and 3 from it.
  • 1950: Nash's existence proof for equilibrium points of nnn-person games applies Kakutani's theorem (PNAS 36).

Setting

Let E=RmE=\mathbb R^mE=Rm with its Euclidean norm, and let S⊆ES\subseteq ES⊆E. Kakutani writes R(S)\mathfrak R(S)R(S) for the family of all closed convex subsets of SSS; as printed, it contains the empty set. A point-to-set mapping of SSS into R(S)\mathfrak R(S)R(S) assigns to each x∈Sx\in Sx∈S a closed convex set Φ(x)⊆S\Phi(x)\subseteq SΦ(x)⊆S.

Φ\PhiΦ is upper semi-continuous (in the paper's sense) when

xn∈S,xn→x0∈S,yn∈Φ(xn),yn→y0⟹y0∈Φ(x0).x_n\in S,\quad x_n\to x_0\in S,\quad y_n\in\Phi(x_n),\quad y_n\to y_0\quad\Longrightarrow\quad y_0\in\Phi(x_0).xn​∈S,xn​→x0​∈S,yn​∈Φ(xn​),yn​→y0​⟹y0​∈Φ(x0​).

This is a sequential closed-graph condition. The paper remarks that for a closed SSS it is equivalent to the graph {(x,y):x∈S, y∈Φ(x)}\{(x,y):x\in S,\ y\in\Phi(x)\}{(x,y):x∈S, y∈Φ(x)} being closed in S×SS\times SS×S.

An rrr-dimensional closed simplex is the convex hull of r+1r+1r+1 affinely independent points of EEE. A fixed point of Φ\PhiΦ is a point x0∈Sx_0\in Sx0​∈S with x0∈Φ(x0)x_0\in\Phi(x_0)x0​∈Φ(x0​).

Formalization targets

Goal: the Corollary (p. 458)

Let S⊆RmS\subseteq\mathbb R^mS⊆Rm be nonempty, bounded, closed and convex, and let Φ\PhiΦ be upper semi-continuous on SSS with every value Φ(x)\Phi(x)Φ(x), x∈Sx\in Sx∈S, a nonempty closed convex subset of SSS. Then

∃ x0∈S:x0∈Φ(x0).\exists\,x_0\in S:\qquad x_0\in\Phi(x_0).∃x0​∈S:x0​∈Φ(x0​).

Milestones

  1. Brouwer's fixed point theorem (§1, p. 457) — a published, proved platform theorem, referenced.
  2. Approximation step of the proof of Theorem 1 (pp. 457–458): for every ε>0\varepsilon>0ε>0 there are a point xxx of the simplex, points x0,…,xrx_0,\dots,x_rx0​,…,xr​ within ε\varepsilonε of xxx, selections yi∈Φ(xi)y_i\in\Phi(x_i)yi​∈Φ(xi​) and weights λ∈Δr\lambda\in\Delta_rλ∈Δr​ with x=∑iλixi=∑iλiyix=\sum_i\lambda_ix_i=\sum_i\lambda_iy_ix=∑i​λi​xi​=∑i​λi​yi​.
  3. Limit step of the proof of Theorem 1 (p. 458): such data for every ε>0\varepsilon>0ε>0, on a compact SSS, force a fixed point.
  4. Theorem 1 (p. 457): the fixed point statement for an rrr-dimensional closed simplex.
  5. Enclosing simplex (proof of the Corollary, p. 458): every bounded subset of Rm\mathbb R^mRm lies in an mmm-dimensional closed simplex S′S'S′.
  6. Retraction (proof of the Corollary, p. 458): a continuous map of S′S'S′ into SSS fixing SSS.
  7. Composition (proof of the Corollary, p. 458): x↦Φ(ψ(x))x\mapsto\Phi(\psi(x))x↦Φ(ψ(x)) is upper semi-continuous on S′S'S′ with values in R(S)⊆R(S′)\mathfrak R(S)\subseteq\mathfrak R(S')R(S)⊆R(S′).
  8. Closed-graph equivalence (§1, p. 457), for closed SSS and Φ(x)⊆S\Phi(x)\subseteq SΦ(x)⊆S.
  9. Theorem 2 (p. 458, von Neumann's intersection theorem): if K⊆RmK\subseteq\mathbb R^mK⊆Rm, L⊆RnL\subseteq\mathbb R^nL⊆Rn are bounded closed convex, K≠∅K\neq\emptysetK=∅, and U,V⊆K×LU,V\subseteq K\times LU,V⊆K×L are closed with all sections Ux0⊆LU_{x_0}\subseteq LUx0​​⊆L, Vy0⊆KV_{y_0}\subseteq KVy0​​⊆K nonempty, closed and convex, then U∩V≠∅U\cap V\neq\emptysetU∩V=∅.

Milestones 8 and 9 stand off the goal's proof path: the paper proves Theorem 2 from the Corollary, using milestone 8 to check upper semi-continuity.

Significance

The Corollary is the form in which Kakutani's theorem is used: existence of equilibrium points in nnn-person games (Nash), of competitive equilibria (Arrow–Debreu), and of solutions of generalized games and variational inequalities all reduce to a fixed point of a point-to-set mapping with nonempty closed convex values on a compact convex set. Theorem 2 in turn gives the minimax theorem (the paper's Theorem 3) in a few lines.

The results are classical and their proofs are known; what is missing is a machine-checked version. Mathlib does not contain Kakutani's theorem, and on Prove2Me the theorem is not posed. Brouwer's theorem is proved on the platform (AGT.brouwer_fixed_point) and enters as a reference milestone. Theorem 3 is already proved on the platform as a special case of Sion's minimax theorem (FamousTheorems.sion_minimax_theorem, Mathlib's Sion.minimax) and is therefore not posed here. A related open platform statement, Debreu's 1952 fixed point lemma for a contractible polyhedron with contractible values and a closed graph (SocialEquilibrium.Existence.fixed_point_of_contractible_polyhedron), generalizes Theorem 1 on polyhedra but not the Corollary, since a bounded closed convex set need not be a polyhedron. Once proved, the goal is the standard entry point for formalized equilibrium existence results.

Difficulty

Brouwer's theorem needs a continuous single-valued map, and a point-to-set mapping with closed convex values need not admit a continuous selection: the mapping on [−1,1][-1,1][−1,1] equal to {1}\{1\}{1} for x<0x<0x<0, [−1,1][-1,1][−1,1] at 000 and {−1}\{-1\}{−1} for x>0x>0x>0 is upper semi-continuous and has none. So the obvious route, select and apply Brouwer, fails; any proof must pass through approximations and a limit in which the graph condition and the convexity of the limiting value both enter. The approximation step needs a family of triangulations of the simplex with mesh tending to zero, which Mathlib does not provide. The transfer from a simplex to a general convex set needs a continuous retraction, which uses convexity and closedness of SSS in Euclidean space.

Formalization scope

  • The ambient space is EuclideanSpace ℝ (Fin m), m=0m=0m=0 included. A point-to-set mapping is a total function Φ : E → Set E; only its values on SSS are constrained.
  • IsClosedConvexSubset S A is the paper's A∈R(S)A\in\mathfrak R(S)A∈R(S) (A⊆SA\subseteq SA⊆S, closed, convex) and admits A=∅A=\emptysetA=∅ as printed. Nonemptiness of the values (and of SSS, and of KKK in Theorem 2) is a separate, labelled hypothesis: with Φ≡∅\Phi\equiv\emptysetΦ≡∅, or S=∅S=\emptysetS=∅, the printed hypotheses hold and there is no fixed point, while the paper's proof picks "an arbitrary point yny^nyn from Φ(xn)\Phi(x^n)Φ(xn)".
  • IsUpperSemicontinuous S Φ is the paper's sequential condition, with sequences in SSS and limit x0∈Sx_0\in Sx0​∈S. It is not Berge's open-neighbourhood upper hemicontinuity.
  • Explicit readings of loose phrases: "the nnn-th barycentric simplicial subdivision" becomes "for every ε>0\varepsilon>0ε>0" with the selected vertices within ε\varepsilonε of the point (no subdivision is built into the statement); "it is clear that … converges" becomes compactness of SSS in the limit step; "take a closed simplex S′S'S′ which contains SSS" becomes an mmm-dimensional affinely independent hull; "a continuous retracting point-to-point mapping" becomes ContinuousOn ψ S', MapsTo ψ S' S and ψ x = x on SSS; "clearly an upper semi-continuous point-to-set mapping of S′S'S′ into R(S)⊆R(S′)\mathfrak R(S)\subseteq\mathfrak R(S')R(S)⊆R(S′)" is stated as three conclusions; "closed subset of S×SS\times SS×S" is closedness in E×EE\times EE×E (the same for closed SSS); U⋅VU\cdot VU⋅V is U∩VU\cap VU∩V; "K×LK\times LK×L in Rm+nR^{m+n}Rm+n" is the product Rm×Rn\mathbb R^m\times\mathbb R^nRm×Rn.
  • A trivializing formalization would allow empty values, an empty domain, a degenerate simplex, or approximation data for a single coarse ε\varepsilonε; each is excluded by the statements as written.
  • Infrastructure a complete development needs: barycentric subdivisions or another construction of approximate fixed points; nearest-point projection onto closed convex sets in Euclidean space; transport of the Corollary to Rm×Rn\mathbb R^m\times\mathbb R^nRm×Rn for Theorem 2. The two definitions are generic and reusable for any later set-valued existence result. Proofs by any faithful route are welcome, including a route through Brouwer's theorem and a continuous approximate selection.

Selected references

  • S. Kakutani, A generalization of Brouwer's fixed point theorem, Duke Math. J. 8 (1941), 457–459. https://doi.org/10.1215/s0012-7094-41-00838-4
  • B. Knaster, C. Kuratowski, S. Mazurkiewicz, Ein Beweis des Fixpunktsatzes für n-dimensionale Simplexe, Fund. Math. 14 (1929), 132–137. https://doi.org/10.4064/fm-14-1-132-137
  • J. von Neumann, Zur Theorie der Gesellschaftsspiele, Math. Ann. 100 (1928), 295–320. https://doi.org/10.1007/BF01448847
  • J. von Neumann, Über ein ökonomisches Gleichungssystem und eine Verallgemeinerung des Brouwerschen Fixpunktsatzes, Ergebnisse eines Math. Kolloquiums 8 (1937), 73–83.
  • J. F. Nash, Equilibrium points in n-person games, Proc. Natl. Acad. Sci. USA 36 (1950), 48–49. https://doi.org/10.1073/pnas.36.1.48
  • M. Sion, On general minimax theorems, Pacific J. Math. 8 (1958), 171–176. https://doi.org/10.2140/pjm.1958.8.171
13 thms4 active usersReviewed
🏆Completed
Complexity TheoryOperations Research·Captain: mikedeng1

The Complexity of Computing a Nash Equilibrium 3: Trimming an Approximate Nash Equilibrium Yields a Well-Supported OneResearch Paper

Motivation

The complexity of computing a Nash equilibrium is usually studied for an approximate equilibrium, because an exact equilibrium of a game with three or more players can require irrational probabilities. Two approximation notions are in use, and results proved for one do not automatically transfer to the other. Daskalakis, Goldberg and Papadimitriou (SIAM J. Comput. 39(1), 2009) prove their PPAD-hardness results for the stronger notion, the ε-approximately well-supported Nash equilibrium, and then show in their §4.7 (Lemma 4.28, announced as Lemma 2.1) that any ε-approximate Nash equilibrium can be turned, by an explicit and cheap transformation, into an approximately well-supported one with a polynomially worse accuracy. This is what lets their hardness results hold for both notions. A weaker version of the relation had been pointed out by Chen, Deng and Teng (FOCS 2006, reference [9] of the paper).

This mission formalizes Lemma 4.28 together with the steps of its proof: the best-response inequality (28), Claims 5 and 6, and the Lipschitz estimate of Lemma 4.26 (used in the proof as Lemma 4.29).

Setting

A game in normal form has r≥2r\ge2r≥2 players. Player ppp has a finite set SpS_pSp​ of pure strategies; S=∏pSpS=\prod_p S_pS=∏p​Sp​ is the set of pure strategy profiles and S−pS_{-p}S−p​ the set of profiles of the players other than ppp. For each player ppp and profile s∈Ss\in Ss∈S there is a payoff usp≥0u^p_s\ge0usp​≥0; for j∈Spj\in S_pj∈Sp​ and s∈S−ps\in S_{-p}s∈S−p​ the payoff to ppp at the profile (j,s)(j,s)(j,s) is written ujspu^p_{js}ujsp​. The number max⁡{u}\max\{u\}max{u} is the largest entry uspu^p_susp​ over all players and all profiles.

A mixed profile x={xjp}x=\{x^p_j\}x={xjp​} assigns to each player ppp a probability distribution xpx^pxp on SpS_pSp​; the players randomize independently, and for s∈S−ps\in S_{-p}s∈S−p​ we write xs=∏q≠pxsqqx_s=\prod_{q\ne p}x^q_{s_q}xs​=∏q=p​xsq​q​. The expected payoff of player ppp for playing the pure strategy jjj against the others is

Ujp=∑s∈S−pujsp xs,Umax⁡p=max⁡j∈SpUjp.\mathcal U^p_j=\sum_{s\in S_{-p}}u^p_{js}\,x_s,\qquad \mathcal U^p_{\max}=\max_{j\in S_p}\mathcal U^p_j .Ujp​=s∈S−p​∑​ujsp​xs​,Umaxp​=j∈Sp​max​Ujp​.
  • xxx is an ε-approximate Nash equilibrium if no player can gain more than ϵ\epsilonϵ by deviating to any mixed strategy ypy^pyp:
∑j∈SpUjp xjp ≥ ∑j∈SpUjp yjp−ϵfor all p and all mixed yp.\sum_{j\in S_p}\mathcal U^p_j\,x^p_j\ \ge\ \sum_{j\in S_p}\mathcal U^p_j\,y^p_j-\epsilon\quad\text{for all }p\text{ and all mixed }y^p .j∈Sp​∑​Ujp​xjp​ ≥ j∈Sp​∑​Ujp​yjp​−ϵfor all p and all mixed yp.
  • xxx is an ε-approximately well-supported Nash equilibrium if every strategy played with positive probability is within ϵ\epsilonϵ of the best:
Ujp>Uj′p+ϵ ⟹ xj′p=0for all p and j,j′∈Sp.\mathcal U^p_j>\mathcal U^p_{j'}+\epsilon\ \Longrightarrow\ x^p_{j'}=0\quad\text{for all }p\text{ and }j,j'\in S_p .Ujp​>Uj′p​+ϵ ⟹ xj′p​=0for all p and j,j′∈Sp​.

The trimmed profile x^\hat xx^ of xxx with parameter kkk deletes the strategies whose expected payoff is more than ϵk\epsilon kϵk below Umax⁡p\mathcal U^p_{\max}Umaxp​ and renormalizes:

zp=∑j∈Spxjp X{Ujp<Umax⁡p−ϵk},x^jp={xjp/(1−zp),Ujp≥Umax⁡p−ϵk,0,otherwise.z^p=\sum_{j\in S_p}x^p_j\,\mathcal X_{\{\mathcal U^p_j<\mathcal U^p_{\max}-\epsilon k\}},\qquad \hat x^p_j=\begin{cases}x^p_j/(1-z^p), & \mathcal U^p_j\ge\mathcal U^p_{\max}-\epsilon k,\\ 0, & \text{otherwise.}\end{cases}zp=j∈Sp​∑​xjp​X{Ujp​<Umaxp​−ϵk}​,x^jp​={xjp​/(1−zp),0,​Ujp​≥Umaxp​−ϵk,otherwise.​

In the Lean development these are purePayoff u x p j, maxPurePayoff u x p, maxPayoff u, IsEpsApproxNash u x ε, IsEpsWellSupportedNash u x ε, trimMass u x ε k p and trim u x ε k, all in the namespace DGPNash.WellSupported.

Formalization targets

Goal: Lemma 4.28

For ϵ>0\epsilon>0ϵ>0 and an ϵ\epsilonϵ-approximate Nash equilibrium xxx, the trimmed profile x^\hat xx^ with k=1+1/ϵk=1+1/\sqrt\epsilonk=1+1/ϵ​ is a mixed profile and a

ϵ⋅(ϵ+1+4(r−1)max⁡{u})-approximately well-supported Nash equilibrium.\sqrt\epsilon\cdot\bigl(\sqrt\epsilon+1+4(r-1)\max\{u\}\bigr)\text{-approximately well-supported Nash equilibrium.}ϵ​⋅(ϵ​+1+4(r−1)max{u})-approximately well-supported Nash equilibrium.

The constant is the paper's. The statement is about the specific profile x^\hat xx^ built from xxx, not about the existence of some well-supported equilibrium.

Milestones, in proof order

  • Eq. (28): ∑jUjpxjp≥Umax⁡p−ϵ\sum_j\mathcal U^p_j x^p_j\ge\mathcal U^p_{\max}-\epsilon∑j​Ujp​xjp​≥Umaxp​−ϵ for every player ppp.
  • Claim 5: for every k>0k>0k>0, zp≤1/kz^p\le 1/kzp≤1/k.
  • Claim 6: for every k>1k>1k>1, ∑j∈Sp∣xjp−x^jp∣≤2/(k−1)\sum_{j\in S_p}|x^p_j-\hat x^p_j|\le 2/(k-1)∑j∈Sp​​∣xjp​−x^jp​∣≤2/(k−1).
  • Lemma 4.26 (Lemma 4.29): for mixed profiles x,yx,yx,y,
∣∑s∈S−pujspxs−∑s∈S−pujspys∣≤max⁡s∈S−p{ujsp}∑q≠p∑i∈Sq∣xiq−yiq∣.\Bigl|\sum_{s\in S_{-p}}u^p_{js}x_s-\sum_{s\in S_{-p}}u^p_{js}y_s\Bigr|\le\max_{s\in S_{-p}}\{u^p_{js}\}\sum_{q\ne p}\sum_{i\in S_q}|x^q_i-y^q_i| .​s∈S−p​∑​ujsp​xs​−s∈S−p​∑​ujsp​ys​​≤s∈S−p​max​{ujsp​}q=p∑​i∈Sq​∑​∣xiq​−yiq​∣.

Significance

The result. Lemma 4.28 makes the two approximation notions polynomially equivalent for computation: every well-supported equilibrium is approximate with the same ϵ\epsilonϵ, and conversely an approximate equilibrium yields a well-supported one at accuracy O(ϵ)O(\sqrt\epsilon)O(ϵ​) for fixed rrr and payoff range. Hardness results proved for well-supported equilibria, including the PPAD-completeness of 3-player Nash in the paper and the two-player result of Chen, Deng and Teng, therefore apply to approximate equilibria as well, and algorithms for one notion give algorithms for the other. Lemma 4.26, the Lipschitz dependence of expected payoffs on the opponents' strategies in L1L_1L1​, is a general tool for perturbation and rounding arguments in finite games.

Formalizing it. The result is proved in the paper; as far as we know there is no machine-checked version, and the platform has neither approximation notion. The mission produces both definitions, on top of the published game vocabulary agt_games, and the quantitative chain from an approximate equilibrium to a well-supported one. These definitions are what any later formalization of approximate-equilibrium algorithms or hardness results would need.

Difficulty

The obvious attempt, to show that xxx itself is approximately well-supported, fails: an approximate equilibrium may put small positive probability on a strategy that is far from optimal, which a well-supported equilibrium forbids for any accuracy. Removing those strategies changes the opponents' expected payoffs, so the well-supported condition must be checked for U^\hat{\mathcal U}U^, computed from x^\hat xx^, not for U\mathcal UU. The accuracy of the result therefore depends on how far all r−1r-1r−1 opponents' strategies move, which is why the bound carries the factor (r−1)max⁡{u}(r-1)\max\{u\}(r−1)max{u}. Lemma 4.26 is a statement about product distributions: the change in a multilinear expected payoff is controlled by the sum of the per-player L1L_1L1​ distances, not by their product.

Formalization scope

  • Players form a finite type ι with decidable equality; player p has a finite strategy type S p; payoffs are u : ι → (∀ i, S i) → ℝ with the standing hypothesis ∀ p s, 0 ≤ u p s of §2.1. The number of players is r=r=r= Fintype.card ι, and 2 ≤ Fintype.card ι is assumed in every statement, as in §2.1. Strategy sets may differ between players.
  • Mixed profiles and lotteries are AGT.IsMixedProfile and AGT.IsLottery from agt_games; both equilibrium notions include the requirement that the profile be mixed. Ujp\mathcal U^p_jUjp​ is AGT.expectedPayoff after player ppp alone switches to the pure strategy jjj, and the approximate-Nash condition compares AGT.expectedPayoff before and after player ppp alone switches to a lottery yyy, which is the paper's inequality (27).
  • Umax⁡p\mathcal U^p_{\max}Umaxp​ and max⁡{u}\max\{u\}max{u} are suprema over finite types; they are the maxima, since a mixed profile forces each SpS_pSp​ to be nonempty. In Lemma 4.26 the maximum over s∈S−ps\in S_{-p}s∈S−p​ is the supremum of upu^pup over full profiles whose ppp-th coordinate is jjj.
  • The strict and non-strict inequalities are the paper's: the trim keeps Ujp≥Umax⁡p−ϵk\mathcal U^p_j\ge\mathcal U^p_{\max}-\epsilon kUjp​≥Umaxp​−ϵk, zpz^pzp counts Ujp<Umax⁡p−ϵk\mathcal U^p_j<\mathcal U^p_{\max}-\epsilon kUjp​<Umaxp​−ϵk, and the well-supported condition uses >>>. The goal assumes ϵ>0\epsilon>0ϵ>0, as the paper's 1/ϵ1/\sqrt\epsilon1/ϵ​ requires; Claim 5 is stated for k>0k>0k>0 and Claim 6 for k>1k>1k>1.
  • The clause "can be computed in polynomial time" of Lemma 4.28 is not formalized; the goal states the property of the profile the proof computes. A complexity statement would need the PPAD machinery, which is outside this series.
  • A trivializing formalization is ruled out: by Nash's theorem (on the platform as AGT.nash_existence) a δ-well-supported equilibrium exists for every δ ≥ 0, so the goal is stated for x^\hat xx^, defined from xxx, and not as an existence claim.

Contributions welcome: proofs of the milestones, in particular the decomposition ∑sxsusp=∑jxjp Ujp\sum_s x_s u^p_s=\sum_j x^p_j\,\mathcal U^p_j∑s​xs​usp​=∑j​xjp​Ujp​ of the expected payoff, which Eq. (28) and the goal both need, and Lemma 4.26, which is reusable in any perturbation argument for finite games.

Selected references

  • C. Daskalakis, P. W. Goldberg, C. H. Papadimitriou, The Complexity of Computing a Nash Equilibrium, SIAM Journal on Computing 39(1):195–259, 2009. https://doi.org/10.1137/070699652
  • X. Chen, X. Deng, S.-H. Teng, Computing Nash Equilibria: Approximation and Smoothed Complexity, FOCS 2006. https://arxiv.org/abs/cs/0602043
  • X. Chen, X. Deng, S.-H. Teng, Settling the Complexity of Computing Two-Player Nash Equilibria, Journal of the ACM 56(3), 2009. https://doi.org/10.1145/1516512.1516516
  • J. Nash, Non-Cooperative Games, Annals of Mathematics 54(2):286–295, 1951. https://doi.org/10.2307/1969529
8 thms4 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

The Price of Anarchy of Finite Congestion Games V: The Mixed Price of Anarchy of the Average Social Cost Is at Most (3+sqrt 5)/2Research Paper

Motivation

When many self-interested users share resources whose cost grows with use (links of a network, servers, machines), each user picks the option that is cheapest for them given what the others do, and the resulting equilibrium can be worse for the group than a centrally planned allocation. The price of anarchy, introduced by Koutsoupias and Papadimitriou (STACS 1999), measures this loss as the worst ratio between the social cost of an equilibrium and the optimal social cost. Congestion games (Rosenthal 1973) are the standard finite model of such resource sharing: they always have pure Nash equilibria, and they cover atomic routing, load balancing and many network design questions.

Timeline of the linear-latency case:

  • 2002: Roughgarden and Tardos (J. ACM) bound the price of anarchy of nonatomic selfish routing with linear latencies by 4/34/34/3.
  • 2005: Awerbuch, Azar and Epstein (STOC 2005) and, independently, Christodoulou and Koutsoupias (STOC 2005) show that for atomic (finite) congestion games with linear latencies the pure price of anarchy of the total cost is 5/25/25/2. Awerbuch, Azar and Epstein also obtain (3+5)/2≈2.618(3+\sqrt5)/2 \approx 2.618(3+5​)/2≈2.618 for weighted players.
  • 2005: Christodoulou and Koutsoupias observe that their argument for 5/25/25/2 extends to mixed Nash equilibria, at the price of the larger constant (3+5)/2(3+\sqrt5)/2(3+5​)/2 (their Theorem 14, the goal of this mission).

Setting

A congestion game consists of a finite set NNN of players, a finite set EEE of facilities, for each player iii a collection Σi\Sigma_iΣi​ of pure strategies, each a subset of EEE, and for each facility eee a latency function fe:N→Rf_e : \mathbb N \to \mathbb Rfe​:N→R. In a pure profile A=(A1,…,An)A = (A_1, \dots, A_n)A=(A1​,…,An​), Ai∈ΣiA_i \in \Sigma_iAi​∈Σi​, the load ne(A)n_e(A)ne​(A) is the number of players whose set contains eee, and player iii pays

ci(A)=∑e∈Aife(ne(A)).c_i(A) = \sum_{e \in A_i} f_e\bigl(n_e(A)\bigr).ci​(A)=e∈Ai​∑​fe​(ne​(A)).

The social cost of a pure profile is SUM(A)=∑i∈Nci(A)\mathrm{SUM}(A) = \sum_{i\in N} c_i(A)SUM(A)=∑i∈N​ci​(A) (NNN times the average cost). Latencies are linear: fe(k)=aek+bef_e(k) = a_e k + b_efe​(k)=ae​k+be​ with ae,be≥0a_e, b_e \ge 0ae​,be​≥0.

A mixed strategy pip_ipi​ of player iii is a probability distribution on Σi\Sigma_iΣi​. The players randomize independently, so the pure profile sss occurs with probability Pr⁡(s)=∏jpj(sj)\Pr(s) = \prod_j p_j(s_j)Pr(s)=∏j​pj​(sj​). Player iii's expected cost is E[ci]=∑sPr⁡(s) ci(s)\mathbb E[c_i] = \sum_s \Pr(s)\, c_i(s)E[ci​]=∑s​Pr(s)ci​(s), and the expected load of eee is E[ne]=∑sPr⁡(s) ne(s)\mathbb E[n_e] = \sum_s \Pr(s)\, n_e(s)E[ne​]=∑s​Pr(s)ne​(s). A mixed profile is a mixed Nash equilibrium if no player can lower their expected cost by switching unilaterally to another distribution on their strategies. The social cost of a mixed profile is the sum of the expected costs, SUM(p)=∑iE[ci]\mathrm{SUM}(p) = \sum_i \mathbb E[c_i]SUM(p)=∑i​E[ci​].

In Lean: CongestionGame ι E with fields strategies and latency, load, cost, IsProfile, sumCost, IsLinear, expCost, expLoad, mixedSumCost and IsMixedNash, all in the namespace CongestionPoA.Mixed; lotteries and independent randomization come from the platform definition agt_games (AGT.IsLottery, AGT.profileProb, AGT.IsMixedNash).

Formalization targets

Goal: Theorem 14

For every congestion game with linear latencies, every mixed Nash equilibrium ppp and every pure profile PPP with Pi∈ΣiP_i \in \Sigma_iPi​∈Σi​,

∑i∈NE[ci]  ≤  3+52 SUM(P).\sum_{i\in N} \mathbb E[c_i] \;\le\; \frac{3+\sqrt5}{2}\,\mathrm{SUM}(P).i∈N∑​E[ci​]≤23+5​​SUM(P).

Taking PPP optimal, the mixed price of anarchy of the average social cost is at most (3+5)/2(3+\sqrt5)/2(3+5​)/2.

Milestones

  1. Lemma 3 (corrected). For real x≥0x \ge 0x≥0 and integer y≥0y \ge 0y≥0, y(x+1)≤5−14x2+5+54y2y(x+1) \le \frac{\sqrt5-1}{4}x^2 + \frac{\sqrt5+5}{4}y^2y(x+1)≤45​−1​x2+45​+5​y2.
  2. Deviation inequality (Theorem 1's proof, mixed). At a mixed Nash equilibrium, for every player iii,
E[ci]≤∑e∈Pi(ae(E[ne]+1)+be).\mathbb E[c_i] \le \sum_{e\in P_i}\bigl(a_e(\mathbb E[n_e]+1) + b_e\bigr).E[ci​]≤e∈Pi​∑​(ae​(E[ne​]+1)+be​).
  1. Summing step (Theorem 1's proof, mixed).
∑iE[ci]≤∑e∈Ene(P)(ae(E[ne]+1)+be).\sum_i \mathbb E[c_i] \le \sum_{e\in E} n_e(P)\bigl(a_e(\mathbb E[n_e]+1) + b_e\bigr).i∑​E[ci​]≤e∈E∑​ne​(P)(ae​(E[ne​]+1)+be​).

Significance

The bound says that randomization by the players cannot make linear congestion games much worse than pure play: the loss stays within a constant factor independent of the number of players and facilities. Mixed equilibria matter because they always exist in every finite game and because they model populations of users whose individual choices are not known in advance. The same authors report (PDF p. 2) extending these bounds to correlated equilibria with the same values, which places the mixed bound in a hierarchy of equilibrium notions whose worst cases coincide.

The result is proved in the paper, in one sentence that defers to the proof of Theorem 1. The work here is a complete machine-checked version: the expected-cost layer for congestion games on top of agt_games, the deviation and summing inequalities under product distributions, and the corrected Lemma 3. The paper prints Lemma 3 for all nonnegative reals x,yx, yx,y, where it is false (at x=0x = 0x=0, y=1/10y = 1/10y=1/10 the left side is 0.10.10.1 and the right side about 0.0180.0180.018); the formal statement keeps yyy an integer, which is how the lemma is used. No formalization of congestion-game price-of-anarchy bounds was on the platform when this mission was drafted.

Difficulty

The pure proof compares ne(P)(ne(A)+1)n_e(P)(n_e(A)+1)ne​(P)(ne​(A)+1) with ne(A)2n_e(A)^2ne​(A)2 and ne(P)2n_e(P)^2ne​(P)2 through an integer inequality (Lemma 1). Under a mixed equilibrium the equilibrium side is an expectation, so the cost of a facility is no longer a function of one integer load, and Lemma 1's constant 1/31/31/3 is not available for real arguments: a real-variable version is needed, and the constant degrades from 5/25/25/2 to (3+5)/2(3+\sqrt5)/2(3+5​)/2. A second obstacle is bookkeeping: the deviating player's load changes only on their own deviation, while the other players' randomization stays independent, and the expected cost of a player has to be related to expected facility loads, which uses linearity of the latencies in an essential way. The naive idea of applying Theorem 1 to each pure profile in the support of the equilibrium fails, because those profiles are not themselves Nash equilibria.

Formalization scope

Players and facilities are finite types ι and E; profiles are functions ι → Finset E, with feasibility IsProfile a separate predicate. Latencies are real-valued on natural-number loads, and "linear" means affine with nonnegative coefficients, fe(k)=aek+bef_e(k) = a_e k + b_efe​(k)=ae​k+be​; the paper displays only the identity latency fe(k)=kf_e(k)=kfe​(k)=k and states that its proofs extend. Mixed strategies are real weight functions on the finite strategy type Σi\Sigma_iΣi​; independence is built into AGT.profileProb; Nash deviations range over all lotteries, which is equivalent to pure deviations. agt_games maximizes payoffs, so the game is passed to it with payoff −ci-c_i−ci​. The goal is stated against every feasible pure profile rather than as a ratio, so no division by an optimum that may be 000 occurs. The social cost is the expected sum of the players' costs; the paper's second option, ∑eE[ne2]\sum_e \mathbb E[n_e^2]∑e​E[ne2​], is not part of this mission. A version with correlated distributions on profiles, or one that bounds the cost of an "averaged" profile instead of the expected cost, is a different statement and does not discharge the goal.

A complete development needs elementary finite-sum manipulation of product distributions (marginals of AGT.profileProb, expectations of loads), and a Jensen-type inequality (E[ne])2≤E[ne2](\mathbb E[n_e])^2 \le \mathbb E[n_e^2](E[ne​])2≤E[ne2​] for finite distributions. The expectation lemmas for congestion games are reusable for the other mixed results of the literature (weighted games, polynomial latencies). Proofs of the milestones, of the expectation layer, and alternative arguments are all welcome.

Selected references

  • G. Christodoulou, E. Koutsoupias, The Price of Anarchy of Finite Congestion Games, STOC 2005, pp. 67–73. https://doi.org/10.1145/1060590.1060600
  • B. Awerbuch, Y. Azar, A. Epstein, The Price of Routing Unsplittable Flow, STOC 2005, pp. 57–66. https://doi.org/10.1145/1060590.1060599
  • E. Koutsoupias, C. Papadimitriou, Worst-case Equilibria, STACS 1999, LNCS 1563, pp. 404–413. https://doi.org/10.1007/3-540-49116-3_38
  • R. W. Rosenthal, A Class of Games Possessing Pure-Strategy Nash Equilibria, International Journal of Game Theory 2 (1973), pp. 65–67. https://doi.org/10.1007/BF01737559
  • T. Roughgarden, É. Tardos, How Bad Is Selfish Routing?, Journal of the ACM 49 (2002), pp. 236–259. https://doi.org/10.1145/506147.506153
7 thms4 active usersReviewed
🏆Completed
Complexity TheoryOperations Research·Captain: mikedeng1

The Complexity of Computing a Nash Equilibrium 1: Approximate Fixed Points of Nash's Map Are Approximate Nash EquilibriaResearch Paper

Motivation

A finite game describes several decision makers whose payoffs depend on everyone's choices. A Nash equilibrium is a collection of choices at which no single player can improve their expected payoff by changing strategy alone. Equilibrium existence is a classical result, but a computational argument needs to connect an object that can be approximated numerically to a strategically meaningful outcome. Daskalakis, Goldberg and Papadimitriou make that connection using Nash's map on mixed-strategy profiles in their study of equilibrium computation (Daskalakis, Goldberg and Papadimitriou 2009, §3.2). This mission isolates their quantitative connection: a profile close to a fixed point of that particular map is close to a Nash equilibrium, with the paper's explicit error bound.

The result is a known lemma from the published paper, not an open conjecture. It belongs to the paper's route from finite games to approximate equilibrium computation. The present mission treats the analytic statements about the map and finite payoffs; it does not state the paper's PPAD completeness theorem or encode computational reductions.

Setting

A normal-form game has r≥2r\ge2r≥2 players. In the Nash-map section each player has the same nonempty set [n][n][n] of nnn pure strategies. A pure profile sss chooses one strategy for each player, and player ppp receives a nonnegative real payoff uspu^p_susp​. The largest entry among all these payoff tables is Umax⁡U_{\max}Umax​. A mixed profile xxx assigns each player ppp probabilities xjp≥0x^p_j\ge0xjp​≥0 that sum to one over j∈[n]j\in[n]j∈[n]; different players randomize independently. The expected payoff when everyone uses xxx is Up(x)U^p(x)Up(x). If player ppp instead uses the pure strategy jjj while the others keep their mixed strategies, the expected payoff is Ujp(x)U^p_j(x)Ujp​(x).

Write Bjp(x)=max⁡{0,Ujp(x)−Up(x)}B^p_j(x)=\max\{0,U^p_j(x)-U^p(x)\}Bjp​(x)=max{0,Ujp​(x)−Up(x)} for the positive part of this unilateral payoff gain. Nash's map fff assigns to each coordinate of a mixed profile the normalized value

f(x)jp=xjp+Bjp(x)1+∑k∈[n]Bkp(x).f(x)^p_j=\frac{x^p_j+B^p_j(x)}{1+\sum_{k\in[n]}B^p_k(x)}.f(x)jp​=1+∑k∈[n]​Bkp​(x)xjp​+Bjp​(x)​.

The numerator raises the weight of a strategy whose pure payoff exceeds the current expected payoff. The common denominator ensures that the new weights for a player sum to one. These are exactly the quantities and normalization displayed on page 205 of the paper (Daskalakis, Goldberg and Papadimitriou 2009).

An ε\varepsilonε-approximate Nash equilibrium here means a mixed profile at which no player can increase expected payoff by more than ε\varepsilonε through any mixed-strategy deviation. This is the alternative approximation notion identified on page 199 and written as Eq. (27) on page 243. It is weaker than the paper's ε\varepsilonε-approximately well-supported condition; the two notions must remain distinct.

Formalization targets

The goal is Lemma 3.8 (p. 207). For any mixed profile xxx with ∥f(x)−x∥∞≤ε′\|f(x)-x\|_\infty\le\varepsilon'∥f(x)−x∥∞​≤ε′, where ε′≥0\varepsilon'\ge0ε′≥0, its approximate-equilibrium error is bounded by the paper's exact quantity:

εNash=nε′(1+nUmax⁡)(1+ε′(1+nUmax⁡))max⁡{Umax⁡,1}.\varepsilon_{\mathrm{Nash}}= n\sqrt{\varepsilon'(1+nU_{\max})} \left(1+\sqrt{\varepsilon'(1+nU_{\max})}\right) \max\{U_{\max},1\}.εNash​=nε′(1+nUmax​)​(1+ε′(1+nUmax​)​)max{Umax​,1}.

No numerical constant is left free or replaced by an unspecified asymptotic bound. The goal is universal over games and profiles satisfying the stated conditions; it does not merely assert the existence of one favorable profile.

The milestone list also includes Lemma 3.5, bounding the variation of a pure-strategy payoff when opponents change their distributions; Lemma 3.6, an inequality for normalized nonnegative sums; and Lemma 3.4, the explicit Lipschitz bound

∥f(x)−f(x′)∥∞≤[1+2Umax⁡rn(n+1)] δwhen∥x−x′∥∞≤δ.\|f(x)-f(x')\|_\infty\le[1+2U_{\max}rn(n+1)]\,\delta \quad\text{when}\quad \|x-x'\|_\infty\le\delta.∥f(x)−f(x′)∥∞​≤[1+2Umax​rn(n+1)]δwhen∥x−x′∥∞​≤δ.

Equation (3) on page 208 is a further milestone: it bounds each coordinate's share of the total positive gain under approximate fixedness. Lemma 3.4 has a separate role in the paper's grid analysis; it is not claimed as a prerequisite of Lemma 3.8.

Significance

The goal gives a quantitative translation between two kinds of approximation. An error measured in the coordinates of a fixed-point map becomes an upper bound on a player's incentive to deviate. The dependence on nnn, Umax⁡U_{\max}Umax​ and ε′\varepsilon'ε′ matters because the later computational construction chooses its grid scale using an explicit threshold, not simply a convergence claim. Lemma 3.4 provides the separate sensitivity estimate for that map, also with its exact constant (Daskalakis, Goldberg and Papadimitriou 2009, pp. 205–207).

Formalizing these known statements supplies a reusable bridge between finite-game payoffs, mixed profiles and a concrete fixed-point map. The shared finite-game representation already exists in the published agt_games definition bundle. What remains here is a machine-checked proof of each quantitative statement and of the payoff identities needed to relate pure and mixed deviations. The local Lean statements compile as open theorem targets; the mission does not claim that their proofs are already formalized.

Difficulty

A coordinatewise small value of f(x)−xf(x)-xf(x)−x does not by itself bound the largest payoff advantage by the same number. The map normalizes by a sum of all positive advantages, and a strategy with a large advantage might have little probability under xxx. Conversely, controlling a player's current expected payoff requires information about the entire probability vector, including strategies that are worse than the current mix. The explicit square-root dependence in Lemma 3.8 captures this mismatch. A direct substitution of the fixed-point error for the equilibrium error would lose both the dimension and payoff-scale factors in the published bound.

Formalization scope

Lean represents players by Fin r, strategies by Fin n, payoffs by a real function on pure profiles, and mixed strategies by real-valued weight functions satisfying AGT.IsMixedProfile. The paper numbers players and strategies from one; Fin uses zero-based indices without changing the mathematical sets. AGT.expectedPayoff and AGT.profileProb implement the independent product distribution. Pure-strategy expected payoff is the same expectation after replacing just one player's lottery by a point mass. The maximum payoff is computed from the game's actual finite table; the statements require r≥2r\ge2r≥2 and n>0n>0n>0, so this maximum exists. Nonnegative payoff entries, the standing convention from §2.1, are hypotheses.

The formula for fff is defined on all real coordinate arrays, exactly as an algebraic expression. Every theorem about an equilibrium supplies mixed-profile membership. This explicit condition rules out interpreting Lemma 3.8 on arbitrary vectors, for which “approximate Nash equilibrium” has no strategic meaning and the paper's argument does not apply. The infinity norm is written as a bound for every player-strategy pair, avoiding any dependence on a chosen norm instance. All error parameters appearing in the statements are nonnegative, and the denominator of fff is positive on mixed profiles because each Bjp(x)B^p_j(x)Bjp​(x) is nonnegative.

The development needs finite products and sums, real inequalities, the game bundle, and elementary facts about lotteries and unilateral deviations. Results about how expectations vary under a changed product distribution are reusable for other finite-game formalizations. Contributions proving the milestone inequalities, the payoff identities, and the goal's exact bound are welcome.

Selected references

  • C. Daskalakis, P. W. Goldberg and C. H. Papadimitriou, The Complexity of Computing a Nash Equilibrium, SIAM Journal on Computing 39(1):195–259, 2009. DOI: 10.1137/070699652.
7 thms4 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

Theory of Games and Economic Behavior IX: Solutions for Acyclic RelationsTextbook

Motivation

The solution concept of von Neumann and Morgenstern's Theory of Games and Economic Behavior (1944) is defined from two ingredients: a set of imputations and a domination relation between them. A solution is a set of imputations that is internally stable (no member dominates another) and externally stable (every non-member is dominated by some member). In §65 of the book the authors observe that this definition never uses what imputations and domination actually are. They abstract it to an arbitrary set DDD and an arbitrary relation S\mathcal SS on DDD, and ask which properties of S\mathcal SS guarantee that exactly one solution exists.

The abstract notion is what graph theory now calls a kernel of a directed graph: draw an arc x→yx \to yx→y whenever xSyx\mathcal S yxSy; a solution is a set of vertices that is independent and absorbs every vertex outside it. Kernels appear in combinatorial game theory (the losing positions of a finite impartial game form a kernel of its move graph) and in the theory of preference and choice.

Timeline.

  • 1944 (1st ed.; 3rd ed. 1953, reprinted 2007): von Neumann and Morgenstern define solutions for an arbitrary relation (§65), show that a finite set with an acyclic relation has exactly one solution (65:X), and that acyclicity is necessary for every subset to have a unique solution (65:Z).
  • 1953: M. Richardson, Solutions of irreflexive relations, extends existence (not uniqueness) to finite relations without cycles of odd length.

Setting

Let DDD be an arbitrary set and S\mathcal SS an arbitrary relation on DDD; xSyx\mathcal S yxSy is read "xxx dominates yyy". A solution (in DDD for S\mathcal SS) is a set V⊆DV \subseteq DV⊆D with

(65:1)V={ y∈D:xSy holds for no x∈V }.\text{(65:1)}\qquad V = \{\, y \in D : x\mathcal S y \text{ holds for no } x \in V \,\}.(65:1)V={y∈D:xSy holds for no x∈V}.

For E⊆DE \subseteq DE⊆D, an element xxx is a maximum of EEE if x∈Ex \in Ex∈E and no y∈Ey \in Ey∈E has ySxy\mathcal S xySx; the set of maxima is EmE^mEm.

For m≥1m \ge 1m≥1, condition (Am)(A_m)(Am​) says: never x1Sx0,x2Sx1,…,xmSxm−1x_1\mathcal S x_0, x_2\mathcal S x_1, \dots, x_m\mathcal S x_{m-1}x1​Sx0​,x2​Sx1​,…,xm​Sxm−1​ with x0=xmx_0 = x_mx0​=xm​ and all xi∈Dx_i \in Dxi​∈D. The relation is acyclic if it satisfies every (Am)(A_m)(Am​), m=1,2,…m = 1, 2, \dotsm=1,2,…; in particular never xSxx\mathcal S xxSx. It is strictly acyclic if there is no infinite sequence x0,x1,x2,…x_0, x_1, x_2, \dotsx0​,x1​,x2​,… in DDD with xi+1Sxix_{i+1}\mathcal S x_ixi+1​Sxi​ for every iii. Property (65:K) says that every non-empty E⊆DE \subseteq DE⊆D has Em≠⊖E^m \ne \ominusEm=⊖. A partial ordering (65:B) is a transitive relation for which at most one of x=yx = yx=y, xSyx\mathcal S yxSy, ySxy\mathcal S xySx holds.

For the main theorem the book constructs a candidate solution by induction (65.7.1): A1=DA_1 = DA1​=D; Bi=AimB_i = A_i^mBi​=Aim​; CiC_iCi​ is the set of elements of AiA_iAi​ dominated by some element of BiB_iBi​; Ai+1=Ai−Bi−CiA_{i+1} = A_i - B_i - C_iAi+1​=Ai​−Bi​−Ci​. With i0i_0i0​ the first index for which Ai0=⊖A_{i_0} = \ominusAi0​​=⊖,

(65:2)V0=B1∪⋯∪Bi0−1.\text{(65:2)}\qquad V_0 = B_1 \cup \cdots \cup B_{i_0 - 1}.(65:2)V0​=B1​∪⋯∪Bi0​−1​.

In Lean the elements live in a type α, D V : Set α, and S : α → α → Prop with S x y meaning xSyx\mathcal S yxSy; the predicates are IsSolution D S V, maxima E S, IsAcyclic, IsStrictlyAcyclic, HasMaximaProperty, IsPartialOrdering, ConditionG, and the construction stageA, stageB, stageC, V0.

Formalization targets

Goal: (65:X)

If DDD is finite and S\mathcal SS is acyclic on DDD, then

∃! V: V is a solution in D for S,andV is a solution  ⟺  V=V0.\exists!\, V:\ V \text{ is a solution in } D \text{ for } \mathcal S, \qquad\text{and}\qquad V \text{ is a solution} \iff V = V_0 .∃!V: V is a solution in D for S,andV is a solution⟺V=V0​.

Milestones, in attack order

  1. (65:I) For a partial ordering, a finite DDD satisfies (65:G): every non-maximal yyy is dominated by some maximum.
  2. (65:H) For a partial ordering of an arbitrary DDD: VVV is a solution   ⟺  \iff⟺ (65:G) holds and V=DmV = D^mV=Dm.
  3. (65:O:c) Strict acyclicity implies acyclicity; for finite DDD the two are equivalent.
  4. (65:P) (65:K)   ⟺  \iff⟺ strict acyclicity, for arbitrary DDD.
  5. (65:S) For finite DDD and acyclic S\mathcal SS, some AiA_iAi​ is empty.
  6. (65:V) For finite DDD and acyclic S\mathcal SS, every solution equals V0V_0V0​.
  7. (65:W) For finite DDD and acyclic S\mathcal SS, V0V_0V0​ is a solution.
  8. (65:Z) If every E⊆DE \subseteq DE⊆D has a unique solution in EEE for S\mathcal SS, then S\mathcal SS is acyclic on DDD.

Significance

The result itself. (65:X) is the most general of the book's three existence-and-uniqueness theorems for solutions (complete ordering, partial ordering, acyclic relation; 65.8.1). For games proper it has no direct application: the set of imputations of an essential game has no maxima, so (65:K) fails (65.9.1). Its role is to isolate a sufficient condition for a unique solution. With (65:Z), and applied to every subset of DDD, it characterizes the finite relations for which every subset has exactly one solution: exactly the acyclic ones (65.8.2). In graph language it is the statement that a finite directed acyclic graph has exactly one kernel. In combinatorial game theory this is the partition of the positions of a finite impartial game into P- and N-positions. The complete- and partial-ordering results (65:E)–(65:I) are the special cases the book treats first.

Formalizing it. The results are classical and fully proved in the book; to the best of our knowledge none of them is on the Prove2Me platform, and Mathlib has well-foundedness (WellFounded, RelEmbedding of ℕ) but no kernel or von Neumann–Morgenstern solution notion for an abstract relation. The mission produces machine-checked proofs of the book's §65 chain: the equivalence of (65:K) with strict acyclicity for arbitrary sets, the finite equivalence of acyclicity and strict acyclicity, the explicit construction of V0V_0V0​, and the characterization of 65.8.2.

Difficulty

Most of the individual steps are short. The work is in making the book's finite induction precise. The sets AiA_iAi​ are defined recursively and V0V_0V0​ refers to the first empty stage i0i_0i0​. The uniqueness proof (65:V) is a minimal-counterexample argument over the stage index, which moves between "smallest kkk with y∉Aky \notin A_ky∈/Ak​" and the disjoint decomposition (65:U) of DDD into the BiB_iBi​ and CiC_iCi​. A tempting shortcut, taking an arbitrary well-founded rank function instead of the book's construction, proves existence and uniqueness but not that the solution is the V0V_0V0​ of (65:2), which is part of the goal. For (65:P) and (65:O:c) the difficulty is the passage between finite cycles and infinite chains. Going from a chain in a finite set to a repetition needs a pigeonhole argument, and going from a set without maxima to a chain needs dependent choice.

Formalization scope

  • Representation. An ambient type α; D, E, V are Set α; the relation is S : α → α → Prop and is only ever consulted on elements of the set under consideration, so it is the book's relation on DDD (or its restriction to EEE). Finite and infinite sequences are functions ℕ → α.
  • Solutions. IsSolution D S V is the set equation (65:1) literally; it forces V⊆DV \subseteq DV⊆D. Uniqueness in the goal is ∃! over all V : Set α, not over a subtype; there is no degenerate reading in which the solution is fixed by construction.
  • Acyclicity. IsAcyclic D S requires (Am)(A_m)(Am​) for every m≥1m \ge 1m≥1, all cycle elements in DDD. The case m=0m = 0m=0 is excluded, as in the book (it would be unsatisfiable). This is equivalent to the absence of a Relation.TransGen loop inside DDD, but the book's form is stated.
  • Construction. Stages are indexed from 000: stageA D S k is the book's Ak+1A_{k+1}Ak+1​. V0 D S is the union of all BiB_iBi​, which equals B1∪⋯∪Bi0−1B_1 \cup \cdots \cup B_{i_0 - 1}B1​∪⋯∪Bi0​−1​ because every later BiB_iBi​ is empty.
  • Standing hypotheses instantiated. (65:S), (65:V), (65:W) and the goal (65:X) carry the hypotheses of 65.7.1, "DDD finite and S\mathcal SS acyclic" (for finite DDD equivalently strictly acyclic, i.e. (65:K)), as D.Finite and IsAcyclic D S. (65:H) and (65:I) carry the partial-ordering hypothesis (65:B:a), (65:B:b) of 65.5.1, and (65:I) also finiteness of DDD. (65:O:c), (65:P) and (65:Z) are for arbitrary DDD and S\mathcal SS, as 65.6.2 and 65.8.2 state. The empty DDD is allowed everywhere; there the unique solution is ⊖\ominus⊖.
  • Not stated. The infinite case of (65:X) and of (65:Y), which the book leaves open (65.7.1, 65.8.3, question (65:9)); the complete-ordering results (65:E), (65:F), which silently assume D≠⊖D \neq \ominusD=⊖; the counting statement (65:8).
  • Needed infrastructure. Finite-set induction and pigeonhole on Set.Finite, dependent choice for (65:P). The definitions are reusable for any later work on kernels of digraphs and on abstract stable sets. Proofs of any milestone, and alternative proofs of the goal, are welcome.

Selected references

  • J. von Neumann and O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary edition, Princeton University Press, 2007 (reprint of the 3rd ed., 1953), §65, pp. 587–602. https://doi.org/10.1515/9781400829460
  • M. Richardson, Solutions of irreflexive relations, Annals of Mathematics 58 (1953), 573–590. https://doi.org/10.2307/1969755
13 thms4 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

Theory of Games and Economic Behavior VIII: Characteristic Functions of General n-Person GamesTextbook

Motivation

The theory of Theory of Games and Economic Behavior (von Neumann and Morgenstern, 1944; 3rd ed. 1953) rests on one object: the characteristic function v(S)v(S)v(S), the amount a coalition SSS of players can secure for itself whatever the other players do. For zero-sum nnn-person games, Chapter VI defines v(S)v(S)v(S) and proves (25.3.1 and 26.1.1) that the set functions arising this way are exactly those with v(∅)=0v(\emptyset)=0v(∅)=0, v(−S)=−v(S)v(-S)=-v(S)v(−S)=−v(S) and superadditivity. Economic applications, however, are rarely zero-sum: exchange and production create value. Chapter XI extends the theory to general (non-zero-sum) games by adding a fictitious player who absorbs the total gain, and §57 answers the question that decides the scope of this extension: which set functions are characteristic functions of general games?

The answer, that these are exactly the superadditive set functions vanishing on the empty set, is the reason why the cooperative game theory that followed could take "a superadditive vvv with v(∅)=0v(\emptyset)=0v(∅)=0" as its primitive object, usually without any underlying strategic game.

Setting

A general nnn-person game Γ\GammaΓ in normalized form has players I={1,…,n}I=\{1,\dots,n\}I={1,…,n}. Player kkk chooses τk∈{1,…,βk}\tau_k\in\{1,\dots,\beta_k\}τk​∈{1,…,βk​} with βk≥1\beta_k\ge 1βk​≥1, without knowing the choices of the others, and receives the real amount Hk(τ1,…,τn)\mathcal H_k(\tau_1,\dots,\tau_n)Hk​(τ1​,…,τn​). No condition is imposed on ∑kHk\sum_k\mathcal H_k∑k​Hk​. The game is zero-sum if ∑k=1nHk≡0\sum_{k=1}^n\mathcal H_k\equiv 0∑k=1n​Hk​≡0.

The zero-sum extension Γ‾\overline\GammaΓ (56.2.2) adds a fictitious player n+1n+1n+1, who has no move and receives

Hn+1(τ1,…,τn)=−∑k=1nHk(τ1,…,τn).\mathcal H_{n+1}(\tau_1,\dots,\tau_n)=-\sum_{k=1}^n\mathcal H_k(\tau_1,\dots,\tau_n).Hn+1​(τ1​,…,τn​)=−k=1∑n​Hk​(τ1​,…,τn​).

Write I‾={1,…,n,n+1}\overline I=\{1,\dots,n,n+1\}I={1,…,n,n+1}. For S⊆I‾S\subseteq\overline IS⊆I, the coalition SSS and its complement ⊥S=I‾−S\bot S=\overline I-S⊥S=I−S play a zero-sum two-person game. The pure strategies of SSS are the tuples of choices of its real members. A mixed strategy ξ\xiξ of SSS is a single probability distribution over these tuples, so the members of a coalition randomize jointly, and likewise η\etaη for ⊥S\bot S⊥S. The payoff to SSS is ∑k∈SHk\sum_{k\in S}\mathcal H_k∑k∈S​Hk​. Then

v(S)=max⁡ξmin⁡ηK(ξ,η),v(S)=\max_\xi\min_\eta K(\xi,\eta),v(S)=ξmax​ηmin​K(ξ,η),

where KKK is the expected payoff to SSS. The function vvv on all S⊆I‾S\subseteq\overline IS⊆I is the extended characteristic function; its restriction to S⊆IS\subseteq IS⊆I is the restricted characteristic function (57.1). For a zero-sum game the restricted function is the characteristic function of Chapter VI.

Formalization targets

Goal: 57.3.4

For every nnn and every set function vvv on the subsets of III,

v is the restricted characteristic function of some general game  ⟺  v(∅)=0 and v(S∪T)≥v(S)+v(T) for S∩T=∅,v \text{ is the restricted characteristic function of some general game} \iff v(\emptyset)=0 \text{ and } v(S\cup T)\ge v(S)+v(T) \text{ for } S\cap T=\emptyset,v is the restricted characteristic function of some general game⟺v(∅)=0 and v(S∪T)≥v(S)+v(T) for S∩T=∅,

and for every set function vvv on the subsets of I‾\overline II,

v is the extended characteristic function of some general game  ⟺  v(∅)=0, v(⊥S)=−v(S), v superadditive.v \text{ is the extended characteristic function of some general game} \iff v(\emptyset)=0,\ v(\bot S)=-v(S),\ v \text{ superadditive}.v is the extended characteristic function of some general game⟺v(∅)=0, v(⊥S)=−v(S), v superadditive.

In each direction a single game realizes vvv on every set simultaneously; v(I)v(I)v(I) is not constrained.

Milestones

  1. (57:1:a)–(57:1:c): necessity of the extended conditions.
  2. (57:2:a), (57:2:c), (57:2:b): necessity of the restricted conditions, including v(−S)≤v(I)−v(S)v(-S)\le v(I)-v(S)v(−S)≤v(I)−v(S).
  3. 57.3.1: sufficiency of (57:2:a), (57:2:c).
  4. 57.3.3: sufficiency of (57:1:a)–(57:1:c).
  5. (57:G): for such vvv, v(−S)=−v(S)v(-S)=-v(S)v(−S)=−v(S) for all SSS holds iff v(S)+v(−S)=v(I)v(S)+v(-S)=v(I)v(S)+v(−S)=v(I) for all SSS and v(I)=0v(I)=0v(I)=0.
  6. (57:B): in a zero-sum game every one-element set of players is removable, meaning that some zero-sum game with the same characteristic function has payoffs that do not depend on that player's choice.
  7. (57:C): the set of all players is removable iff the game is inessential, i.e. v(S)=∑k∈Sαkv(S)=\sum_{k\in S}\alpha_kv(S)=∑k∈S​αk​.

Significance

The characterization fixes the domain of Chapter XI: every statement about solutions of general games is, by 57.3.4, a statement about superadditive set functions with v(∅)=0v(\emptyset)=0v(∅)=0, and conversely every such function is attained by a strategic game. That converse justifies studying cooperative games abstractly. (57:G) separates the zero-sum and constant-sum subclasses inside this domain. (57:B) and (57:C) quantify how much of a player's strategic role survives when his moves are removed, which is the book's justification for the fictitious player.

Status: all results are proved in the book (1944). To our knowledge none of them is machine-checked; the Prove2Me catalog has superadditive and convex cooperative games, but none tied to a strategic game, and no characteristic function built from a minimax value. The work here is formalizing the known proofs.

Difficulty

Necessity reduces to the zero-sum theory applied to Γ‾\overline\GammaΓ, but still requires the minimax theorem for the coalition's two-person game and a careful treatment of joint mixing when two disjoint coalitions merge. Sufficiency requires building one finite game whose coalition values equal an arbitrary superadditive vvv exactly, for all 2n2^n2n coalitions at once. The obvious attempt, choosing payoffs coalition by coalition, fails because the payoffs are shared: a construction that gives SSS the right value can change the value of every set that overlaps SSS. The difficulty is to obtain the upper bound v(S)≤v0(S)v(S)\le v_0(S)v(S)≤v0​(S) for every SSS simultaneously. For the extended function there is a further difficulty. The fictitious player has no move, so the values on sets containing n+1n+1n+1 are forced by the others, and they must be reconciled with (57:1:b).

For (57:B), the target game must reproduce an arbitrary zero-sum characteristic function while one prescribed player's choice has no effect on any payoff.

Formalization scope

Players are Fin n (book indices 1,…,n1,\dots,n1,…,n become 0,…,n−10,\dots,n-10,…,n−1); sets of players are Finset (Fin n). The extended domain I‾\overline II is Fin (n + 1) with the fictitious player Fin.last n, and ⊥S\bot S⊥S is the complement in Fin (n + 1). A game (GeneralGame n) has βk≥1\beta_k\ge1βk​≥1 strategies Fin (β k) per player and real payoffs; zero-sum is the predicate IsZeroSum. The fictitious player's single strategy is left out of the coalition's strategy tuples, which does not change the two-person game. Max and Min are ⨆/⨅ over Mathlib's stdSimplex on the coalition's strategy tuples (one joint distribution per coalition). Both simplices are nonempty and the payoff is bounded, so these are attained values and no junk value from an empty or unbounded supremum occurs.

Standing hypotheses and their instantiation:

  • finite strategy sets with βk≥1\beta_k\ge1βk​≥1 (11.2.3, 56.2.2): a field of GeneralGame;
  • "always assuming (57:2:a), (57:2:c)" for (57:G) (p. 537): an explicit hypothesis;
  • "zero-sum nnn-person game" in (57:A)–(57:C) (p. 533): the hypothesis Γ.IsZeroSum and the requirement that the replacement game Γ′\Gamma'Γ′ is zero-sum;
  • "no influence upon the course of the game" (57:A): all payoffs are independent of that player's variable, as in the proof of (57:C) on p. 534;
  • "inessential" (57:C): the additive form (57:13), which p. 534 calls "precisely the definition of inessentiality".

No normalization is imposed: v(I)v(I)v(I) is arbitrary and nothing is reduced. Every statement is made for all n≥0n\ge0n≥0; the book's n≥1n\ge1n≥1 is not needed, so this is a strengthening.

A trivializing formalization is ruled out: the characteristic function is defined from the game through the coalition's minimax value, so it is never a free parameter, and the existence claims must produce one game for all coalitions at once.

Needed infrastructure: finite zero-sum two-person games with joint mixed strategies over dependent product types; the minimax theorem ((17:6), on the platform as AGT.zero_sum_minimax for matrices); and product decompositions of coalition strategy tuples. The coalition-value API is reusable for any mission built on characteristic functions (Chapters VI, IX–XI). Contributions of this API as separate lemmas are welcome.

Not stated: (57:E*), (57:F*) (given without proof on p. 535), the open question (57:D), and (57:H), because the notion of a "dummy" it uses (from 46.9 and 56.3) is not defined on these pages.

Selected references

  • J. von Neumann, O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary edition, Princeton University Press, 2007 (reprint of the 3rd ed., 1953), §§56–57, pp. 504–537. https://doi.org/10.1515/9781400829460
  • J. von Neumann, "Zur Theorie der Gesellschaftsspiele", Mathematische Annalen 100 (1928), 295–320. https://doi.org/10.1007/BF01448847
12 thms4 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

Theory of Games and Economic Behavior VII: Simple Games, Weighted Majorities and the Main Simple SolutionTextbook

Motivation

Many collective decisions are taken by coalitions that either carry the vote or do not: committees, legislatures, shareholder meetings, councils with weighted votes. In such a situation the only aim of a participant is to be part of a coalition that wins, and nothing is left to bargain about except the division of the prize inside the winning coalition. Chapter X of von Neumann and Morgenstern's Theory of Games and Economic Behavior (1944; 3rd ed. 1953) isolates exactly this class of zero-sum nnn-person games, the simple games, and studies their numerical description by weighted majorities and their finite main simple solutions.

The chapter is the origin of a large later literature: simple games and weighted voting games are the standard model of voting bodies in political science and social choice (for instance the Shapley–Shubik power index, 1954). The characterization of which simple games admit homogeneous weights, and the solutions they carry, starts here.

Setting

A zero-sum nnn-person game with players I={1,…,n}I = \{1, \dots, n\}I={1,…,n} is represented by its characteristic function vvv, a real function on the subsets of III with v(⊖)=0v(\ominus) = 0v(⊖)=0, v(−S)=−v(S)v(-S) = -v(S)v(−S)=−v(S) (−S-S−S the complement) and v(S∪T)≧v(S)+v(T)v(S \cup T) \geqq v(S) + v(T)v(S∪T)≧v(S)+v(T) for disjoint S,TS, TS,T. An imputation is a vector α⃗\vec\alphaα with αi≧v((i))\alpha_i \geqq v((i))αi​≧v((i)) and ∑iαi=0\sum_i \alpha_i = 0∑i​αi​=0; α⃗\vec\alphaα dominates β⃗\vec\betaβ​ if some nonempty SSS has ∑i∈Sαi≦v(S)\sum_{i\in S}\alpha_i \leqq v(S)∑i∈S​αi​≦v(S) and αi>βi\alpha_i > \beta_iαi​>βi​ for i∈Si \in Si∈S; a solution is a set VVV of imputations none of which dominates another and which dominates every imputation outside it (30.1.1). The game is inessential when its reduced form vanishes identically, essential otherwise.

A coalition SSS is flat if v(S)=∑k∈Sv((k))v(S) = \sum_{k\in S} v((k))v(S)=∑k∈S​v((k)). The losing coalitions LΓL_\GammaLΓ​ are the flat sets, and the winning coalitions WΓW_\GammaWΓ​ are the sets whose complement is flat. The game is simple if it is essential and every coalition is winning or losing. WmW^mWm denotes the minimal winning coalitions, those of which no proper subset wins.

Weights w1,…,wnw_1, \dots, w_nw1​,…,wn​ define the winning system W={S:∑i∈Swi>12∑iwi}W = \{S : \sum_{i\in S} w_i > \tfrac12 \sum_i w_i\}W={S:∑i∈S​wi​>21​∑i​wi​}, and under the conditions (50:B) (non-negative weights, no player with half the total weight, no ties) this is the weighted majority game [w1,…,wn][w_1,\dots,w_n][w1​,…,wn​]. The weights are homogeneous if the advantage aS=∑i∈Swi−∑i∈−Swia_S = \sum_{i\in S} w_i - \sum_{i\in -S} w_iaS​=∑i∈S​wi​−∑i∈−S​wi​ is the same for all SSS in WmW^mWm.

In §50 the game is taken in reduced form with γ=1\gamma = 1γ=1, so v((i))=−1v((i)) = -1v((i))=−1. For numbers xi≧0x_i \geqq 0xi​≧0 and a coalition SSS let α⃗S\vec\alpha^SαS give −1-1−1 to the players outside SSS and −1+xi-1 + x_i−1+xi​ to player iii in SSS. When the xix_ixi​ satisfy ∑i∈Sxi=n\sum_{i \in S} x_i = n∑i∈S​xi​=n for every S∈WmS \in W^mS∈Wm, the set VVV of all α⃗S\vec\alpha^SαS, S∈WmS \in W^mS∈Wm, is a main simple solution.

Formalization targets

Goal: (50:K), p. 444

Every homogeneous weighted majority game possesses a main simple solution,\text{Every homogeneous weighted majority game possesses a main simple solution,}Every homogeneous weighted majority game possesses a main simple solution,

namely the set of α⃗S\vec\alpha^SαS, S∈WmS \in W^mS∈Wm, with xi=nbwix_i = \frac{n}{b} w_ixi​=bn​wi​, b=12(∑iwi+a)b = \frac12(\sum_i w_i + a)b=21​(∑i​wi​+a), aaa the common advantage. Conversely, if xi≧0x_i \geqq 0xi​≧0 solve ∑i∈Sxi=n\sum_{i\in S} x_i = n∑i∈S​xi​=n on WmW^mWm, then wi=xiw_i = x_iwi​=xi​ are homogeneous weights for the game if and only if

∑i=1nxi<2n.\sum_{i=1}^n x_i < 2n .i=1∑n​xi​<2n.

Milestones

  1. (49:C) LΓL_\GammaLΓ​ contains the empty set and all one-element sets.
  2. (49:A) WΓ,LΓW_\Gamma, L_\GammaWΓ​,LΓ​ are mapped onto each other by complementation, WΓW_\GammaWΓ​ is closed under supersets, and LΓL_\GammaLΓ​ is closed under subsets.
  3. (49:B) WΓ∩LΓ=⊖W_\Gamma \cap L_\Gamma = \ominusWΓ​∩LΓ​=⊖ if and only if the game is essential. If the game is inessential, every set is both winning and losing.
  4. (49:F) The pairs W,LW, LW,L of simple games are exactly those satisfying (48:A:a)–(48:A:d) and (49:C).
  5. (50:A) The essential three-person game is simple: it is the direct majority game.
  6. (50:B) Non-negative weights define a winning system with (49:W*) if and only if (50:B:a), (50:B:b) hold.
  7. (50:D) aS>0a_S > 0aS​>0 on WWW, aS<0a_S < 0aS​<0 on LLL, and aS=0a_S = 0aS​=0 never occurs.
  8. (50:G) An imputation β⃗\vec\betaβ​ is undominated by V={α⃗S:S∈U}V = \{\vec\alpha^S : S \in U\}V={αS:S∈U} if and only if R(β⃗)∈U+R(\vec\beta) \in U^+R(β​)∈U+.
  9. (50:J) The exact criterion (50:8*), (50:9*) for VVV to be a solution.

Significance

The result links two descriptions of a simple game. One is numerical: a vector of weights, normalized by homogeneity. The other is game-theoretic: a finite solution in which each minimal winning coalition forms and divides a fixed total among its members. When the weights are homogeneous they are, up to scale, the shares in the main simple solution. When a main simple solution exists, its shares are homogeneous weights exactly under the inequality (50:20). The criterion (50:J) behind it is the chapter's general tool for deciding which systems of "profitable" minimal winning coalitions yield a finite solution. It is used again in the enumeration of simple games in §§51–55.

All of the results are proved in the book. As far as a search of the Prove2Me library shows (queries on simple game, weighted majority, winning coalition and stable set, 2026-09-28), none of them has been machine-checked. The only stable-set statements on the platform concern feasible payoff vectors of convex games, which is a different domain. The mission therefore asks for a formal proof of the known results, including the case analysis of §50.5–50.6, and in doing so it produces a reusable Lean theory of simple games and their winning systems.

Difficulty

The characterizations of §49 are set-theoretic, but they depend on superadditivity to show that subsets of flat sets are flat, and on the strategic-equivalence description of essentiality. The substantial part is (50:J). Deciding whether VVV is a solution means classifying every imputation β⃗\vec\betaβ​ by the set R(β⃗)R(\vec\beta)R(β​) where it meets the shares −1+xi-1 + x_i−1+xi​.

The natural first attempt is to check only the minimal winning coalitions. It fails, because domination can be exercised through any winning coalition. The book's argument has to exclude sets of U+U^+U+ with ∑i∈Txi<n\sum_{i\in T} x_i < n∑i∈T​xi​<n by producing infinitely many undominated imputations against a finite VVV. It also has to handle indifferent players with xi=0x_i = 0xi​=0, whose presence makes R(β⃗)R(\vec\beta)R(β​) larger than the coalition that generated β⃗\vec\betaβ​. For the converse half of the goal, the obstacle is the strict inequality a>0a > 0a>0: the equations (50:17) are linear and say nothing about it.

Formalization scope

Players are Fin n (the book's player iii is index i−1i - 1i−1), coalitions are Finset (Fin n), and characteristic functions are Finset (Fin n) → ℝ. Imputations are vectors Fin n → ℝ, and systems of coalitions are Set (Finset (Fin n)). A game is identified with its characteristic function (by 26.1 every vvv satisfying (25:3:a)–(25:3:c) arises from a game). The theory is the "old" one of 30.1.1 (49.1.1), with no excess. The definitions of imputation, domination and solution are the same as in mission V of this series and are restated here, because a draft cannot import another draft.

The standing hypotheses, stated in each theorem where the book has them in force:

  • (25:3:a)–(25:3:c) on vvv in every theorem;
  • simplicity (essential + (49:1:b)) in (50:G), (50:J), (50:K);
  • the reduced form with γ=1\gamma = 1γ=1, as v((i))=−1v((i)) = -1v((i))=−1 for all iii (50.4.1), in (50:G), (50:J), (50:K);
  • U⊆WmU \subseteq W^mU⊆Wm, (50:7) xi≧0x_i \geqq 0xi​≧0 and (50:8) ∑i∈Sxi=n\sum_{i\in S} x_i = n∑i∈S​xi​=n for S∈US \in US∈U (50.5.1) in (50:G), (50:J);
  • (50:B) on the weights in (50:D) and in the first half of (50:K);
  • non-negative weights in (50:B). The book states (50:B) for arbitrary real weights, but its "only if" direction is false without wi≧0w_i \geqq 0wi​≧0: [10,10,10,−110][10, 10, 10, -\tfrac1{10}][10,10,10,−101​] is a counterexample. The corrected statement is recorded in the item.

The numbers xix_ixi​ are given for every player. Players in no minimal winning coalition, for whom the book defines no xix_ixi​, do not affect any α⃗S\vec\alpha^SαS. In the converse of (50:K) the derived weights are wi=xiw_i = x_iwi​=xi​ for every player.

The goal is not the bare solvability of (50:17). A statement that only asserted "xxx exists with (50:7), (50:17)" would reduce to linear algebra. The goal asserts that the set of α⃗S\vec\alpha^SαS is a solution in the sense of 30.1.1, with domination requiring a nonempty effective set, and it adds the converse equivalence with (50:20). The set VVV is built from WmW^mWm only, never from all of WWW.

Welcome contributions: proofs of the §49 milestones, which form a small reusable library on winning and losing systems; a proof of (50:G) and (50:J); and lemmas connecting WΓW_\GammaWΓ​ of a simple reduced game with the explicit formula (49:2), v(S)=n−∣S∣v(S) = n - |S|v(S)=n−∣S∣ on WWW and −∣S∣-|S|−∣S∣ on LLL.

Selected references

  • J. von Neumann, O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary ed., Princeton University Press, 2007 (reprint of the 3rd ed., 1953), Chapter X, §§48–50, pp. 420–444. https://doi.org/10.1515/9781400829460
  • L. S. Shapley, M. Shubik, "A method for evaluating the distribution of power in a committee system", American Political Science Review 48 (1954) 787–792. https://doi.org/10.2307/1951053
13 thms4 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

Theory of Games and Economic Behavior IV: The Characteristic Function of a Zero-Sum n-Person GameTextbook

Motivation

Chapter VI of von Neumann and Morgenstern's Theory of Games and Economic Behavior (1944; 3rd ed. 1953) opens the general theory of zero-sum games with more than two players. The authors propose to describe everything that can be said about coalitions, compensations between partners and fights between coalitions through one numerical object, the characteristic function v(S)v(S)v(S): the amount a group of players SSS can secure for itself against all the others (25.2.1). The whole later theory of the book (imputations, domination, solutions, simple games, decomposition) is built on this set function, and the same object, under the name "coalitional game" or "TU game", is the starting point of cooperative game theory as a field (cores, Shapley value, nucleolus).

§§25–27 settle two foundational questions about it. First, which set functions arise as characteristic functions of actual games? Second, which characteristic functions describe the same strategic situation, and how is a canonical representative chosen? The answers (a complete characterization by three conditions, and the reduced form under strategic equivalence) are what later chapters, and much of the cooperative literature, use when they take "a characteristic function" as a primitive without reference to any game.

Setting

A zero-sum nnn-person game in normalized form Γ\GammaΓ (11.2.3, 25.1.3) has players k=1,…,nk = 1, \dots, nk=1,…,n. Player kkk chooses a pure strategy τk∈{1,…,βk}\tau_k \in \{1, \dots, \beta_k\}τk​∈{1,…,βk​}, βk≧1\beta_k \geqq 1βk​≧1, uninformed about the others' choices, and then receives the real amount Hk(τ1,…,τn)\mathcal H_k(\tau_1, \dots, \tau_n)Hk​(τ1​,…,τn​), subject to (25:1)

∑k=1nHk(τ1,…,τn)≡0.\sum_{k=1}^n \mathcal H_k(\tau_1, \dots, \tau_n) \equiv 0 .k=1∑n​Hk​(τ1​,…,τn​)≡0.

Let I={1,…,n}I = \{1, \dots, n\}I={1,…,n} and, for S⊆IS \subseteq IS⊆I, −S=I∖S-S = I \setminus S−S=I∖S. The book defines v(S)v(S)v(S) in 25.1.3 through a fictitious two-person game: all players of SSS form one composite player 1′1'1′, all players of −S-S−S another, 2′2'2′. The pure strategies of 1′1'1′ are the aggregates τS\tau^SτS (one choice τk\tau_kτk​ for each k∈Sk \in Sk∈S), those of 2′2'2′ are the aggregates τ−S\tau^{-S}τ−S, and 1′1'1′ receives (25:2)

H‾(τS,τ−S)=∑k∈SHk(τ1,…,τn).\overline{\mathcal H}(\tau^S, \tau^{-S}) = \sum_{k \in S} \mathcal H_k(\tau_1, \dots, \tau_n).H(τS,τ−S)=k∈S∑​Hk​(τ1​,…,τn​).

A mixed strategy of 1′1'1′ is a probability vector ξ\xiξ on the set of all aggregates τS\tau^SτS, and one of 2′2'2′ is a probability vector η\etaη on the aggregates τ−S\tau^{-S}τ−S. With K(ξ,η)=∑τS,τ−SH‾(τS,τ−S) ξτSητ−SK(\xi, \eta) = \sum_{\tau^S, \tau^{-S}} \overline{\mathcal H}(\tau^S, \tau^{-S})\, \xi_{\tau^S} \eta_{\tau^{-S}}K(ξ,η)=∑τS,τ−S​H(τS,τ−S)ξτS​ητ−S​,

v(S)=Max⁡ξMin⁡ηK(ξ,η)=Min⁡ηMax⁡ξK(ξ,η).v(S) = \operatorname{Max}_\xi \operatorname{Min}_\eta K(\xi, \eta) = \operatorname{Min}_\eta \operatorname{Max}_\xi K(\xi, \eta).v(S)=Maxξ​Minη​K(ξ,η)=Minη​Maxξ​K(ξ,η).

The coalition therefore randomizes jointly: ξ\xiξ is one distribution over its members' strategy tuples, not a product of independent mixtures. The empty set and III are coalitions too (footnote 2, p. 241).

The three conditions of 25.3.1 on a set function vvv are

(25:3:a) v(⊖)=0,(25:3:b) v(−S)=−v(S),(25:3:c) v(S∪T)≧v(S)+v(T)  if S∩T=⊖.\text{(25:3:a)}\ v(\ominus) = 0, \qquad \text{(25:3:b)}\ v(-S) = -v(S), \qquad \text{(25:3:c)}\ v(S \cup T) \geqq v(S) + v(T) \ \text{ if } S \cap T = \ominus .(25:3:a) v(⊖)=0,(25:3:b) v(−S)=−v(S),(25:3:c) v(S∪T)≧v(S)+v(T)  if S∩T=⊖.

From 26.2 on, every set function satisfying them is called a characteristic function.

Two such functions are strategically equivalent (27.1) if v′(S)=v(S)+∑k∈Sαk0v'(S) = v(S) + \sum_{k \in S} \alpha^0_kv′(S)=v(S)+∑k∈S​αk0​ for numbers αk0\alpha^0_kαk0​ with ∑kαk0=0\sum_k \alpha^0_k = 0∑k​αk0​=0 ((27:1), (27:2)). A function is reduced if all one-element coalitions have the same value, (27:3); with that common value written −γ-\gamma−γ, (27:5). A game is inessential if the reduced form of its characteristic function is ≡0\equiv 0≡0, and essential otherwise (27.3).

Formalization targets

Goal: the characterization of characteristic functions (26.2)

v satisfies (25:3:a)–(25:3:c)  ⟺  ∃ Γ zero-sum n-person game with vΓ=v.v \text{ satisfies (25:3:a)–(25:3:c)} \iff \exists\, \Gamma \text{ zero-sum } n\text{-person game with } v_\Gamma = v .v satisfies (25:3:a)–(25:3:c)⟺∃Γ zero-sum n-person game with vΓ​=v.

The "only if" half is 25.3.1; the "if" half is 26.1.1, which requires a single game Γ\GammaΓ realizing vvv on every coalition simultaneously.

Milestones

  1. 25.3.1: every vΓv_\GammavΓ​ satisfies (25:3:a)–(25:3:c).
  2. (25:A): the three conditions are equivalent to v(S1)+⋯+v(Sp)≦0v(S_1) + \dots + v(S_p) \leqq 0v(S1​)+⋯+v(Sp​)≦0 on decompositions of III for p=1,2,3p = 1, 2, 3p=1,2,3, with equality for p=1,2p = 1, 2p=1,2.
  3. 26.1.1: every vvv satisfying (25:3:a)–(25:3:c) is vΓv_\GammavΓ​ for some game Γ\GammaΓ.
  4. (27:A): every characteristic function is strategically equivalent to exactly one reduced characteristic function, given by (27:2), (27:4).
  5. (27:7): for reduced vˉ\bar vvˉ and every ppp-element SSS, −pγ≦vˉ(S)≦(n−p)γ-p\gamma \leqq \bar v(S) \leqq (n-p)\gamma−pγ≦vˉ(S)≦(n−p)γ, with equality in the stated boundary cases.
  6. (27:B): inessential iff ∑jv((j))=0\sum_j v((j)) = 0∑j​v((j))=0; essential iff ∑jv((j))<0\sum_j v((j)) < 0∑j​v((j))<0.
  7. (27:C) and (27:D): inessential iff vvv is additive, v(S)≡∑k∈Sαk0v(S) \equiv \sum_{k \in S} \alpha^0_kv(S)≡∑k∈S​αk0​, equivalently iff (25:3:c) always holds with equality.

Significance

The characterization makes the three conditions (25:3:a)–(25:3:c) the complete axiomatics of zero-sum characteristic functions. Every later result in the book that is stated "for a characteristic function" (the solutions of the three-person game in §32, the simple games of Chapter X, the decomposition theory of Chapter IX) is thereby a result about zero-sum games, and conversely no further constraint on vvv is hidden in the game model. The reduced form of §27 cuts the parameter space of characteristic functions by nnn and turns essentiality into a sign condition, which is used throughout the rest of the book.

These results are proved in the book. As far as a search of the Prove2Me catalog shows (queries on characteristic function, coalition, strategic equivalence, inessential, superadditive), none of them is formalized there; the existing cooperative-game definitions on the platform use other normalizations (v(∅)=0v(\emptyset) = 0v(∅)=0 only, no complementarity condition) and are not this object. The mission produces a machine-checked link between the non-cooperative model of an nnn-person game and the cooperative set function, including the book's explicit game construction behind 26.1.1.

Difficulty

The "only if" direction requires comparing values of different two-person games: (25:3:c) asks that the coalition S∪TS \cup TS∪T can guarantee as much as SSS and TTT separately, which rests on the coalition mixing jointly, and (25:3:b) needs the minimax theorem, since v(−S)v(-S)v(−S) is a Max-Min for the opposite side. The "if" direction is an existence claim: from an abstract vvv one must produce one finite game whose characteristic function matches vvv on all 2n2^n2n coalitions at once. Producing, for each SSS separately, a game with the right value vΓ(S)v_\Gamma(S)vΓ​(S) is easy and proves nothing. The §27 results are finite linear algebra over set functions, but the uniqueness in (27:A) and the boundary equalities in (27:7) depend on using all three conditions.

Formalization scope

Players are Fin n (the book's 1,…,n1, \dots, n1,…,n are 0,…,n−10, \dots, n-10,…,n−1), coalitions are Finset (Fin n), −S-S−S is the complement Sᶜ, and set functions are Finset (Fin n) → ℝ. A game is a structure ZeroSumGame n with strategy sets Fin (β k), a field β k > 0 (finitely many and at least one pure strategy per player), real payoffs H τ k, and the zero-sum condition (25:1) as a field. An aggregate τS\tau^SτS is a dependent function on the members of SSS; mixed strategies are elements of Mathlib's stdSimplex, and the coalition's ξ\xiξ is a single distribution on aggregates, as in 25.1.3. The Max and Min in v(S)v(S)v(S) are written as ⨆/⨅ over the simplices; these are nonempty and the bilinear form is bounded on them, so no junk value arises. No lower bound on nnn is imposed: the book's statements remain true for n=0n = 0n=0 and n=1n = 1n=1, so dropping the implicit n≧1n \geqq 1n≧1 is a harmless strengthening.

Standing hypotheses instantiated in the statements: finiteness of the strategy sets and (25:1) (25.1.3) are part of ZeroSumGame; the §27 results carry (25:3:a)–(25:3:c) as a hypothesis, the book's standing assumption from 26.2 on ("characteristic function"); (27:7) carries reducedness (27:3) and the definition (27:5) of γ\gammaγ; strategic equivalence includes (27:1). The reduced form is the explicit function of (27:2), (27:4), with 1n\frac1nn1​ as a real division that only matters for n≧1n \geqq 1n≧1.

A trivializing reading of the goal, "for every SSS there is a game with vΓ(S)=v(S)v_\Gamma(S) = v(S)vΓ​(S)=v(S)", is excluded: the statement asks for one game Γ\GammaΓ with vΓ=vv_\Gamma = vvΓ​=v as functions. The coalition value is not the value under independent mixtures of the members, which is smaller in general and for which (25:3:c) can fail.

A complete development needs the minimax theorem for finite matrix games (the platform's AGT.zero_sum_minimax covers it for matrices indexed by Fin (m+1), and can be transported to the aggregate types), bookkeeping for splitting and joining strategy profiles along SSS and −S-S−S, and the construction of 26.1 with its zero-sum check. The profile-splitting lemmas and the value facts for coalition games are reusable for the book's Chapter XI (general games) and for any work on coalitional values of strategic games. Contributions welcome: the §27 milestones, which are self-contained, and the two directions of the goal.

Selected references

  • J. von Neumann and O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary edition, Princeton University Press, 2007 (reprint of the 3rd edition, 1953), §§25–27, pp. 238–254. https://doi.org/10.1515/9781400829460
  • J. von Neumann, "Zur Theorie der Gesellschaftsspiele", Mathematische Annalen 100 (1928), 295–320 (the minimax theorem used for v(S)v(S)v(S)). https://doi.org/10.1007/BF01448847
  • M. Maschler, E. Solan and S. Zamir, Game Theory, Cambridge University Press, 2013, Ch. 16 (coalitional games with transferable utility). https://doi.org/10.1017/CBO9780511794216
13 thms4 active usersReviewed
🏆Completed
Convex OptimizationLinear OptimizationOperations Research·Captain: mikedeng1

Theory of Games and Economic Behavior III: Mixed Strategies, the Minimax Theorem and Good StrategiesTextbook

Motivation

A zero-sum two-person game in normalized form is a real matrix H(τ1,τ2)\mathcal H(\tau_1, \tau_2)H(τ1​,τ2​): player 1 chooses a row τ1\tau_1τ1​, player 2 simultaneously chooses a column τ2\tau_2τ2​, and player 2 pays player 1 the amount H(τ1,τ2)\mathcal H(\tau_1, \tau_2)H(τ1​,τ2​). Matrix games are the base case of non-cooperative game theory, the prototype of every minimax statement in optimization, statistics (Wald's decision theory) and online learning, and, through their equivalence with linear programming, a standard tool of operations research.

Chapter III of von Neumann and Morgenstern's Theory of Games and Economic Behavior (1944; third edition 1953) gives the book's complete solution of these games. Timeline:

  • 1928. J. von Neumann, "Zur Theorie der Gesellschaftsspiele", Math. Annalen 100, proves that every matrix game has a value in mixed strategies (the minimax theorem), by a topological argument. https://doi.org/10.1007/BF01448847
  • 1937. von Neumann's growth-model paper gives a second proof via a fixed-point argument, later generalized by Kakutani (1941).
  • 1938. J. Ville gives the first elementary proof, based on convexity.
  • 1944. The Theory of Games presents Ville's route: a theorem of the alternative for matrices (§16) yields the minimax theorem (17:6), from which §17 derives the structure of the sets of good strategies.
  • 1951. Gale, Kuhn and Tucker, and Dantzig, relate matrix games to linear-programming duality.

Setting

Player 1 has β1≥1\beta_1 \ge 1β1​≥1 pure strategies τ1\tau_1τ1​, player 2 has β2≥1\beta_2 \ge 1β2​≥1 pure strategies τ2\tau_2τ2​, and H\mathcal HH is an arbitrary real β1×β2\beta_1 \times \beta_2β1​×β2​ matrix (14.1.1). A mixed strategy of player 1 is a probability vector ξ\xiξ in the simplex

Sβ1={ξ∈Rβ1:ξτ1≥0, ∑τ1ξτ1=1},S_{\beta_1} = \Big\{ \xi \in \mathbb R^{\beta_1} : \xi_{\tau_1} \ge 0,\ \sum_{\tau_1} \xi_{\tau_1} = 1 \Big\},Sβ1​​={ξ∈Rβ1​:ξτ1​​≥0, τ1​∑​ξτ1​​=1},

and similarly η∈Sβ2\eta \in S_{\beta_2}η∈Sβ2​​ for player 2. The pure strategy τ\tauτ is the coordinate vector δτ\delta^{\tau}δτ. The expected payoff is the bilinear form (17:2)

K(ξ,η)=∑τ1=1β1∑τ2=1β2H(τ1,τ2) ξτ1ητ2.K(\xi, \eta) = \sum_{\tau_1=1}^{\beta_1} \sum_{\tau_2=1}^{\beta_2} \mathcal H(\tau_1, \tau_2)\, \xi_{\tau_1} \eta_{\tau_2}.K(ξ,η)=τ1​=1∑β1​​τ2​=1∑β2​​H(τ1​,τ2​)ξτ1​​ητ2​​.

The good strategies of player 1 form the set Aˉ\bar AAˉ of those ξ∈Sβ1\xi \in S_{\beta_1}ξ∈Sβ1​​ at which Min⁡ηK(ξ,η)\operatorname{Min}_\eta K(\xi, \eta)Minη​K(ξ,η) assumes its maximum; those of player 2 form the set Bˉ\bar BBˉ of those η∈Sβ2\eta \in S_{\beta_2}η∈Sβ2​​ at which Max⁡ξK(ξ,η)\operatorname{Max}_\xi K(\xi, \eta)Maxξ​K(ξ,η) assumes its minimum ((17:B:a), (17:B:b)). A saddle point of KKK is a pair with K(ξ′,η)≤K(ξ,η)≤K(ξ,η′)K(\xi', \eta) \le K(\xi, \eta) \le K(\xi, \eta')K(ξ′,η)≤K(ξ,η)≤K(ξ,η′) for all ξ′,η′\xi', \eta'ξ′,η′. With pure strategies alone one has v1=Max⁡τ1Min⁡τ2Hv_1 = \operatorname{Max}_{\tau_1}\operatorname{Min}_{\tau_2}\mathcal Hv1​=Maxτ1​​Minτ2​​H and v2=Min⁡τ2Max⁡τ1Hv_2 = \operatorname{Min}_{\tau_2}\operatorname{Max}_{\tau_1}\mathcal Hv2​=Minτ2​​Maxτ1​​H; the game is specially strictly determined when v1=v2v_1 = v_2v1​=v2​.

For a general real function ϕ(x,y)\phi(x, y)ϕ(x,y) (§13) the same notions are Max⁡xMin⁡yϕ\operatorname{Max}_x \operatorname{Min}_y \phiMaxx​Miny​ϕ, Min⁡yMax⁡xϕ\operatorname{Min}_y \operatorname{Max}_x \phiMiny​Maxx​ϕ, saddle points, and the sets AϕA^\phiAϕ (maximizers of Min⁡yϕ\operatorname{Min}_y \phiMiny​ϕ) and BϕB^\phiBϕ (minimizers of Max⁡xϕ\operatorname{Max}_x \phiMaxx​ϕ), always under the book's standing hypothesis that these maxima and minima exist.

Formalization targets

Goal: (17:D), good strategies characterized by their supports

For all ξ∈Sβ1\xi \in S_{\beta_1}ξ∈Sβ1​​ and η∈Sβ2\eta \in S_{\beta_2}η∈Sβ2​​: ξ∈Aˉ\xi \in \bar Aξ∈Aˉ and η∈Bˉ\eta \in \bar Bη∈Bˉ if and only if

ξτ1=0 whenever ∑τ2H(τ1,τ2)ητ2<max⁡τ1′∑τ2H(τ1′,τ2)ητ2,\xi_{\tau_1} = 0 \text{ whenever } \sum_{\tau_2} \mathcal H(\tau_1, \tau_2)\eta_{\tau_2} < \max_{\tau_1'} \sum_{\tau_2} \mathcal H(\tau_1', \tau_2)\eta_{\tau_2},ξτ1​​=0 whenever τ2​∑​H(τ1​,τ2​)ητ2​​<τ1′​max​τ2​∑​H(τ1′​,τ2​)ητ2​​, ητ2=0 whenever ∑τ1H(τ1,τ2)ξτ1>min⁡τ2′∑τ1H(τ1,τ2′)ξτ1.\eta_{\tau_2} = 0 \text{ whenever } \sum_{\tau_1} \mathcal H(\tau_1, \tau_2)\xi_{\tau_1} > \min_{\tau_2'} \sum_{\tau_1} \mathcal H(\tau_1, \tau_2')\xi_{\tau_1}.ητ2​​=0 whenever τ1​∑​H(τ1​,τ2​)ξτ1​​>τ2′​min​τ1​∑​H(τ1​,τ2′​)ξτ1​​.

The statement fixes no value and no constant; it says which pairs of mixed strategies are optimal.

Milestones, in attack order

  1. (13:A*) Max⁡xMin⁡yϕ≤Min⁡yMax⁡xϕ\operatorname{Max}_x \operatorname{Min}_y \phi \le \operatorname{Min}_y \operatorname{Max}_x \phiMaxx​Miny​ϕ≤Miny​Maxx​ϕ.
  2. (13:D*) If Max⁡Min⁡=Min⁡Max⁡\operatorname{Max}\operatorname{Min} = \operatorname{Min}\operatorname{Max}MaxMin=MinMax, the saddle points of ϕ\phiϕ are exactly Aϕ×BϕA^\phi \times B^\phiAϕ×Bϕ.
  3. (17:A) Min⁡ηK(ξ,η)=Min⁡τ2∑τ1H(τ1,τ2)ξτ1\operatorname{Min}_\eta K(\xi, \eta) = \operatorname{Min}_{\tau_2} \sum_{\tau_1} \mathcal H(\tau_1, \tau_2)\xi_{\tau_1}Minη​K(ξ,η)=Minτ2​​∑τ1​​H(τ1​,τ2​)ξτ1​​, and dually for Max⁡ξ\operatorname{Max}_\xiMaxξ​.
  4. (16:C) For every matrix a(i,j)a(i, j)a(i,j) exactly one of: some x∈Smx \in S_mx∈Sm​ with ∑ja(i,j)xj≤0\sum_j a(i,j)x_j \le 0∑j​a(i,j)xj​≤0 for all iii; some w∈Snw \in S_nw∈Sn​ with ∑ia(i,j)wi>0\sum_i a(i,j)w_i > 0∑i​a(i,j)wi​>0 for all jjj.
  5. (16:F) The weak form with ≥0\ge 0≥0 in place of >0> 0>0.
  6. (17:6) The minimax theorem: a saddle point of KKK exists (already on the platform as AGT.zero_sum_minimax, proved).
  7. (17:C:f) ξ∈Aˉ\xi \in \bar Aξ∈Aˉ and η∈Bˉ\eta \in \bar Bη∈Bˉ iff ξ,η\xi, \etaξ,η is a saddle point of KKK.

After the goal: (17:E) the game is specially strictly determined iff each player has a pure good strategy.

Significance

(17:D) is the complementary-slackness description of the optimal strategy pairs of a matrix game: a good strategy puts weight only on pure strategies that are best replies to the opponent's good strategy, and conversely any pair of mutually supported best replies is optimal. It is the basis of support-enumeration methods for matrix games, of the equalizing arguments used to solve small games by hand (the book's Chapter IV applies it to Matching Pennies, Stone–Paper–Scissors and Poker), and of the rectangular structure Aˉ×Bˉ\bar A \times \bar BAˉ×Bˉ of the set of optimal pairs. (17:E) connects the mixed-strategy solution to the pure-strategy theory of §14 and to the perfect-information games of §15.

The results are classical and proved in the book. The minimax theorem itself is already machine-checked on the platform (AGT.zero_sum_minimax), and Mathlib contains Sion's minimax theorem and the basic saddle-point lemmas for extended-real functions on sets. This mission adds the book's own chain: the §13 saddle-point calculus under its standing attainment hypothesis, the theorems of the alternative (16:C) and (16:F) in the simplex-normalized form the book uses, the reduction (17:A) to pure strategies, and the characterizations (17:C:f), (17:D), (17:E) of good strategies, which are not on the platform in any form.

Difficulty

The "if" direction of (17:D) cannot be proved from the support conditions alone by local reasoning: that a pair of mutual best replies consists of good strategies uses that the value Max⁡ξMin⁡ηK\operatorname{Max}_\xi \operatorname{Min}_\eta KMaxξ​Minη​K equals Min⁡ηMax⁡ξK\operatorname{Min}_\eta \operatorname{Max}_\xi KMinη​Maxξ​K, i.e. the minimax theorem. Without that equality the "if" direction of (13:D*) fails (points of Aϕ×BϕA^\phi \times B^\phiAϕ×Bϕ exist but are not saddle points), so the calculus of §13 alone does not suffice. Likewise (16:C) is not a direct instance of the Farkas lemma forms on the platform: its alternatives are normalized to the simplex and the second one is strict, and both the existence and the mutual exclusion must be shown.

Formalization scope

Lean conventions, fixed throughout:

  • Pure strategies are Fin β₁, Fin β₂ (numbered from 000), the matrix is H : Fin β₁ → Fin β₂ → ℝ, and SβS_\betaSβ​ is Mathlib's stdSimplex ℝ (Fin β).
  • Nonempty strategy sets (β≥1\beta \ge 1β≥1, from "τ = 1, …, β" in 14.1.1): every theorem assumes 0 < β₁, 0 < β₂, or mixed strategies ξ∈Sβ1\xi \in S_{\beta_1}ξ∈Sβ1​​, η∈Sβ2\eta \in S_{\beta_2}η∈Sβ2​​, which force it. The theorems of the alternative assume n,m≥1n, m \ge 1n,m≥1 (a matrix with rows and columns).
  • Standing hypothesis of 13.2.1 ("we are restricting our considerations to such functions, for which Max and Min exist"): the §13 results (13:A*), (13:D*) are stated for an arbitrary ϕ:X×Y→R\phi : X \times Y \to \mathbb Rϕ:X×Y→R under the predicate MaxMinAttained φ, which says that Min⁡yϕ(x,y)\operatorname{Min}_y \phi(x, y)Miny​ϕ(x,y), Max⁡xϕ(x,y)\operatorname{Max}_x \phi(x, y)Maxx​ϕ(x,y), Max⁡xMin⁡yϕ\operatorname{Max}_x \operatorname{Min}_y \phiMaxx​Miny​ϕ and Min⁡yMax⁡xϕ\operatorname{Min}_y \operatorname{Max}_x \phiMiny​Maxx​ϕ are attained. (13:D*) also carries the hypothesis of 13.5.2 that saddle points exist, stated as Max⁡xMin⁡yϕ=Min⁡yMax⁡xϕ\operatorname{Max}_x \operatorname{Min}_y \phi = \operatorname{Min}_y \operatorname{Max}_x \phiMaxx​Miny​ϕ=Miny​Maxx​ϕ.
  • Max⁡\operatorname{Max}Max and Min⁡\operatorname{Min}Min are the real ⨆, ⨅; they are the book's attained values under the hypotheses above (compactness of the simplex and continuity of KKK for the mixed game). (17:A) asserts attainment explicitly (IsLeast, IsGreatest). "Does not assume its maximum at τ1\tau_1τ1​" in the goal is written without any Max operator.
  • Aˉ\bar AAˉ, Bˉ\bar BBˉ are defined as maximizers and minimizers directly from KKK, not through an assumed value v′v'v′.

A trivializing formalization is ruled out: Aˉ\bar AAˉ and Bˉ\bar BBˉ are not taken as hypotheses or defined through the support conditions, strategy sets cannot be empty, and no Max over an empty or unbounded set occurs.

Contributions welcome: proofs of the milestones, especially (16:C) (from Mathlib's convex separation or from a platform Farkas lemma) and the bridge from AGT.zero_sum_minimax to (17:C:f). The §13 lemmas and the (17:A) reduction are reusable by any mission about matrix games or bilinear saddle points.

Selected references

  • J. von Neumann and O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary edition, Princeton University Press, 2007 (reprint of the 3rd edition, 1953), §§13, 16, 17. https://doi.org/10.1515/9781400829460
  • J. von Neumann, "Zur Theorie der Gesellschaftsspiele", Mathematische Annalen 100 (1928), 295–320. https://doi.org/10.1007/BF01448847
  • J. Ville, "Sur la théorie générale des jeux où intervient l'habileté des joueurs", in É. Borel, Traité du calcul des probabilités et de ses applications, IV.2, Gauthier-Villars, 1938, 105–113.
  • S. Kakutani, "A generalization of Brouwer's fixed point theorem", Duke Mathematical Journal 8 (1941), 457–459. https://doi.org/10.1215/S0012-7094-41-00838-4
  • D. Gale, H. W. Kuhn and A. W. Tucker, "Linear programming and the theory of games", in Activity Analysis of Production and Allocation, Wiley, 1951, 317–329.
11 thms4 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

Theory of Games and Economic Behavior I: Numerical Utility from the Axioms of Preference and MixtureTextbook

Motivation

Game theory as von Neumann and Morgenstern built it measures every outcome by a single number, the utility a player attaches to it, and combines those numbers linearly when an outcome is uncertain: a lottery that yields uuu with probability α\alphaα and vvv with probability 1−α1-\alpha1−α is worth α v(u)+(1−α) v(v)\alpha\,\mathrm v(u) + (1-\alpha)\,\mathrm v(v)αv(u)+(1−α)v(v). Every later chapter of Theory of Games and Economic Behavior uses this without comment, from the value of a zero-sum game to the characteristic function of a coalition. Section 3 of the book justifies it: it states axioms on preferences and on the combination of alternatives with probabilities, and claims that they force utility to be a number, unique up to the choice of a zero and a unit. The proof, announced in 3.6.1 as "somewhat lengthy", was added as the Appendix The Axiomatic Treatment of Utility in the second edition (1947).

The result, the expected utility theorem, is the foundation of decision theory under risk and of expected-payoff reasoning in game theory, statistics and operations research. The axiomatics were later recast by Marschak (1950), Herstein and Milnor (1953) in the language of mixture spaces (Herstein–Milnor). This mission formalizes the original statement and its original proof structure.

Setting

A system of utilities (3.6.1) is an abstract set UUU of entities u,v,w,…u, v, w, \dotsu,v,w,…, together with

  1. a relation u>vu > vu>v ("uuu is preferable to vvv"); write u<vu < vu<v for v>uv > uv>u;
  2. for every number α\alphaα with 0<α<10 < \alpha < 10<α<1, an operation producing an element written αu+(1−α)v\alpha u + (1-\alpha) vαu+(1−α)v of UUU from u,v∈Uu, v \in Uu,v∈U.

The axioms are:

  • (3:A) >>> is a complete ordering: (3:A:a) for any u,vu, vu,v exactly one of u=vu = vu=v, u>vu > vu>v, u<vu < vu<v holds; (3:A:b) u>vu > vu>v, v>wv > wv>w imply u>wu > wu>w.
  • (3:B) Ordering and combining: (3:B:a) u<vu < vu<v implies u<αu+(1−α)vu < \alpha u + (1-\alpha)vu<αu+(1−α)v; (3:B:b) u>vu > vu>v implies u>αu+(1−α)vu > \alpha u + (1-\alpha)vu>αu+(1−α)v; (3:B:c) u<w<vu < w < vu<w<v implies αu+(1−α)v<w\alpha u + (1-\alpha)v < wαu+(1−α)v<w for some α\alphaα; (3:B:d) u>w>vu > w > vu>w>v implies αu+(1−α)v>w\alpha u + (1-\alpha)v > wαu+(1−α)v>w for some α\alphaα.
  • (3:C) Algebra of combining: (3:C:a) αu+(1−α)v=(1−α)v+αu\alpha u + (1-\alpha)v = (1-\alpha)v + \alpha uαu+(1−α)v=(1−α)v+αu; (3:C:b) α(βu+(1−β)v)+(1−α)v=γu+(1−γ)v\alpha(\beta u + (1-\beta)v) + (1-\alpha)v = \gamma u + (1-\gamma)vα(βu+(1−β)v)+(1−α)v=γu+(1−γ)v with γ=αβ\gamma = \alpha\betaγ=αβ.

All weights lie strictly between 000 and 111, and === is identity. The expression αu+(1−α)v\alpha u + (1-\alpha)vαu+(1−α)v is notation for an abstract operation: UUU carries no linear structure. The Appendix mostly writes the operation as (1−γ)u+γv(1-\gamma)u + \gamma v(1−γ)u+γv, and writes u≦vu \leqq vu≦v for "u=vu = vu=v or u<vu < vu<v". In the Lean development the system is the structure UtilitySystem U with fields gt and mix; S.cmb γ u v is (1−γ)u+γv(1-\gamma)u + \gamma v(1−γ)u+γv.

A numerical utility (3.5.1) is a map v:U→R\mathrm v : U \to \mathbb Rv:U→R with

(i)u>v  ⟹  v(u)>v(v),(ii)v((1−γ)u+γv)=(1−γ)v(u)+γ v(v)(0<γ<1).\text{(i)}\quad u > v \implies \mathrm v(u) > \mathrm v(v), \qquad \text{(ii)}\quad \mathrm v\big((1-\gamma)u + \gamma v\big) = (1-\gamma)\mathrm v(u) + \gamma\,\mathrm v(v) \quad (0<\gamma<1).(i)u>v⟹v(u)>v(v),(ii)v((1−γ)u+γv)=(1−γ)v(u)+γv(v)(0<γ<1).

Formalization targets

Goal: (A:V) and (A:W), p. 627

For every system of utilities satisfying (3:A)–(3:C):

∃ v:U→R with (i), (ii),and∀ v,v′ with (i), (ii): ∃ ω0>0, ω1, ∀w,  v′(w)=ω0 v(w)+ω1.\exists\, \mathrm v : U \to \mathbb R \ \text{with (i), (ii)}, \qquad\text{and}\qquad \forall\, \mathrm v, \mathrm v' \text{ with (i), (ii)}:\ \exists\, \omega_0 > 0,\ \omega_1,\ \forall w,\ \ \mathrm v'(w) = \omega_0\,\mathrm v(w) + \omega_1 .∃v:U→R with (i), (ii),and∀v,v′ with (i), (ii): ∃ω0​>0, ω1​, ∀w,  v′(w)=ω0​v(w)+ω1​.

The constants ω0,ω1\omega_0, \omega_1ω0​,ω1​ are chosen before www. No assumption on the size of UUU is made.

Milestones

The milestones follow the Appendix's own chain:

  • (A:A) if u<vu < vu<v and α<β\alpha < \betaα<β then (1−α)u+αv<(1−β)u+βv(1-\alpha)u + \alpha v < (1-\beta)u + \beta v(1−α)u+αv<(1−β)u+βv;
  • (A:B), (A:C) for u0<v0u_0 < v_0u0​<v0​, the map α↦(1−α)u0+αv0\alpha \mapsto (1-\alpha)u_0 + \alpha v_0α↦(1−α)u0​+αv0​ is a one-to-one, monotone map of (0,1)(0,1)(0,1) onto the utility interval u0<w<v0u_0 < w < v_0u0​<w<v0​;
  • (A:E), (A:F) the interval function fu0,v0f_{u_0,v_0}fu0​,v0​​ of (A:D) (value 000 at u0u_0u0​, 111 at v0v_0v0​, and the weight α\alphaα in between) is monotone and linear toward each endpoint, and is characterized by these properties;
  • (A:R), (A:S) for fixed u∗<v∗u^* < v^*u∗<v∗, the normalized mapping hhh with h(u∗)=0h(u^*) = 0h(u∗)=0, h(v∗)=1h(v^*) = 1h(v∗)=1, monotone, and linear on combinations of u<vu < vu<v, exists and is unique;
  • (A:T) (1−γ)u+γu=u(1-\gamma)u + \gamma u = u(1−γ)u+γu=u always;
  • (A:U) hhh is linear on all combinations, without the restriction u<vu < vu<v.

Significance

The theorem turns an ordinal preference over uncertain prospects into a cardinal scale on which expectation is meaningful. It is what licenses replacing a player's preferences by numerical payoffs whose mixtures are averaged, which the rest of the book, and most of game theory and stochastic optimization after it, assumes. The uniqueness part (A:W) states exactly how much freedom the scale has: a positive linear transformation, i.e. zero and unit may be fixed at will and nothing else.

The theorem has been proved many times since 1947, in textbooks and in the mixture-space literature, but the book's axiom system differs from the later ones (it uses a strict order with identity, strict monotony, and the two algebraic axioms (3:C) only). As far as the curators know, neither this axiom system nor the Appendix's derivation has a machine-checked proof, and Mathlib has no mixture-space or expected-utility module. The mission produces a checked proof of the original theorem under its original hypotheses and a reusable abstract mixture-space layer.

Difficulty

The obvious argument treats UUU as a convex set and αu+(1−α)v\alpha u + (1-\alpha)vαu+(1−α)v as a convex combination, then reads the utility off the segment between two reference points. None of that is available. The operation is formal, so identities that hold in a vector space, idempotence (1−γ)u+γu=u(1-\gamma)u + \gamma u = u(1−γ)u+γu=u included, must be derived from (3:B) and (3:C) alone; only one associativity rule (3:C:b), for a repeated right argument, is given. The correspondence between a utility interval and a numerical interval requires the continuity axioms (3:B:c), (3:B:d) and the completeness of the reals. The local scales on different intervals have to be fitted into one global function, and the linearity for pairs u>vu > vu>v and u=vu = vu=v has to be recovered from the case u<vu < vu<v.

Formalization scope

  • UUU is an arbitrary type (Type*); the relation is gt : U → U → Prop and the operation mix : OpenUnit → U → U → U, where OpenUnit is the subtype (0,1)(0,1)(0,1) of R\mathbb RR. mix α u v stands for αu+(1−α)v\alpha u + (1-\alpha)vαu+(1−α)v. The operation is not defined at α=0,1\alpha = 0, 1α=0,1 (3.6.1, footnote 4) and is not extended there.
  • Axiom (3:A:a) is stated literally ("exactly one of the three relations"), so the order is a strict total order and indifference is identity (A.1.2). The weak-order generalization of §66 is not this theorem.
  • Numbers are real numbers. Monotony is strict, as in (3:1:a).
  • Standing hypotheses: every item assumes (3:A)–(3:C), bundled in UtilitySystem. The items from (A:E) on assume fixed u0<v0u_0 < v_0u0​<v0​ or u∗<v∗u^* < v^*u∗<v∗ as explicit hypotheses, as the book does "from now on until we get to (A:V) and (A:W)"; the goal does not, since (A:V), (A:W) hold for every UUU.
  • The interval function fu0,v0f_{u_0,v_0}fu0​,v0​​ is a total Lean function; its value outside u0≦w≦v0u_0 \leqq w \leqq v_0u0​≦w≦v0​ is a placeholder that no statement uses.
  • A formalization in which UUU is a convex subset of a vector space, or a space of probability measures, assumes more than the book and makes (A:T) free; it does not count. Neither does a weak monotony, under which constant maps satisfy (A:V) and (A:W) fails.

A complete development needs only order theory and the completeness of the reals from Mathlib. The mixture-space layer (the structure, (A:A)–(A:C), (A:T)) is reusable for any later work on expected utility, including the generalization in §66 and 67 of the book. Proofs of any milestone, alternative routes to the goal (for instance through the Herstein–Milnor axioms, once shown to follow from (3:A)–(3:C)), and statements of the omitted intermediate results (A:G)–(A:Q) are all welcome.

Selected references

  • J. von Neumann, O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary edition, Princeton University Press, 2007 (reprint of the 3rd edition, 1953), §3 and Appendix. https://doi.org/10.1515/9781400829460
  • I. N. Herstein, J. Milnor, An axiomatic approach to measurable utility, Econometrica 21 (1953), 291–297. https://doi.org/10.2307/1905540
  • J. Marschak, Rational behavior, uncertain prospects, and measurable utility, Econometrica 18 (1950), 111–141. https://doi.org/10.2307/1907264
12 thms4 active usersReviewed
🏆Completed
Mechanism DesignOperations ResearchOptimization·Captain: mikedeng1

Algorithmic Mechanism Design I: MinWork Is a Strongly Truthful n-Approximation Mechanism for Task Scheduling on Unrelated MachinesResearch Paper

Motivation

Algorithmic mechanism design asks for algorithms whose inputs are held by self-interested parties. Each party reports its private data, the algorithm computes an outcome, and payments are arranged so that no party gains by misreporting. Nisan and Ronen introduced the field in Algorithmic Mechanism Design (Games Econ. Behav. 35, 2001). Their running example is task scheduling on unrelated machines: kkk tasks are distributed among nnn machines owned by different agents, each agent knows only its own processing times, and the designer wants to minimize the make-span.

Without incentives the problem is classical: minimizing make-span on unrelated machines is NP-hard and admits a polynomial 2-approximation (Lenstra, Shmoys, Tardos, 1990). With selfish agents the question changes: which approximation ratios can a truthful mechanism guarantee? This mission formalizes the paper's upper bound, the MinWork mechanism, which is the benchmark every later lower bound for truthful scheduling is compared with.

Timeline.

  • 1961: Vickrey introduces the second-price auction (J. Finance 16).
  • 1971–1973: Clarke and Groves generalize it to the VCG family of truthful mechanisms for utilitarian objectives (Groves, Econometrica 41, 1973).
  • 1999/2001: Nisan and Ronen show MinWork is a strongly truthful nnn-approximation, and that no truthful mechanism beats ratio 2.
  • 2007: Christodoulou, Koutsoupias and Vidali raise the deterministic lower bound to 1+21+\sqrt21+2​ for n≥3n \ge 3n≥3; Koutsoupias and Vidali later raise it to 1+φ≈2.6181+\varphi \approx 2.6181+φ≈2.618.
  • 2023: Christodoulou, Koutsoupias and Kovács prove the Nisan–Ronen conjecture: no deterministic truthful mechanism achieves a ratio below nnn (STOC 2023, arXiv:2301.11905), so MinWork is optimal among deterministic truthful mechanisms.

Setting

There are nnn agents and kkk tasks. Agent iii's type is the vector ti=(t1i,…,tki)t^i = (t^i_1,\dots,t^i_k)ti=(t1i​,…,tki​) of positive times, tji>0t^i_j > 0tji​>0 being the time agent iii needs to perform task jjj. A type vector is t=(t1,…,tn)t = (t^1,\dots,t^n)t=(t1,…,tn). An allocation xxx sends each task jjj to one agent; xix^ixi is the set of tasks agent iii receives. The make-span of xxx is

g(x,t)=max⁡i∑j∈xitji,g(x,t) = \max_{i} \sum_{j \in x^i} t^i_j ,g(x,t)=imax​j∈xi∑​tji​,

and agent iii's valuation is vi(x,ti)=−∑j∈xitjiv^i(x,t^i) = -\sum_{j \in x^i} t^i_jvi(x,ti)=−∑j∈xi​tji​.

A direct mechanism asks every agent to declare a type, computes an allocation x(d)x(d)x(d) from the declared vector ddd, and hands agent iii a payment pi(d)p^i(d)pi(d). Agent iii's utility is pi(d)+vi(x(d),ti)p^i(d) + v^i(x(d), t^i)pi(d)+vi(x(d),ti), with tit^iti its true type. The mechanism is truthful if declaring tit^iti maximizes agent iii's utility for every declaration of the others, and strongly truthful if truth-telling is the only such dominant strategy. An allocation rule is a ccc-approximation if g(x(t),t)≤c⋅g(y,t)g(x(t),t) \le c \cdot g(y,t)g(x(t),t)≤c⋅g(y,t) for every type vector ttt and every allocation yyy.

The MinWork mechanism allocates each task to an agent with minimal declared time for it, breaking ties arbitrarily. For each task it wins, an agent receives the second-best declared time min⁡i′≠idji′\min_{i' \ne i} d^{i'}_jmini′=i​dji′​:

pi(d)=∑j∈xi(d)min⁡i′≠idji′.p^i(d) = \sum_{j \in x^i(d)} \min_{i' \neq i} d^{i'}_j .pi(d)=j∈xi(d)∑​i′=imin​dji′​.

The Lean development uses the same names: load, makespan, IsTruthful, IsStronglyTruthful, IsApprox, IsMinWorkAlloc, secondBest, minTime, minWorkPay.

Formalization targets

Goal: Theorem 4.1

For n≥2n \ge 2n≥2 and every MinWork allocation rule xxx with payments ppp as above,

(x,p) is strongly truthfulandg(x(t),t)≤n⋅g(y,t)  for all positive t and all allocations y.(x,p)\ \text{is strongly truthful} \quad\text{and}\quad g(x(t),t) \le n \cdot g(y,t)\ \ \text{for all positive } t \text{ and all allocations } y .(x,p) is strongly truthfulandg(x(t),t)≤n⋅g(y,t)  for all positive t and all allocations y.

Milestones

  1. Theorem 3.1 (Groves): a VGC mechanism is truthful. This is an existing platform theorem, used as a reference.
  2. MinWork belongs to the VGC family. Its allocation maximizes ∑ivi(ti,x)\sum_i v^i(t^i,x)∑i​vi(ti,x), and its payment is ∑i′≠ivi′(ti′,x(t))+h−i\sum_{i'\ne i} v^{i'}(t^{i'},x(t)) + h^{-i}∑i′=i​vi′(ti′,x(t))+h−i with h−i=∑jmin⁡i′≠itji′h^{-i} = \sum_j \min_{i'\ne i} t^{i'}_jh−i=∑j​mini′=i​tji′​.
  3. Claim 4.2: MinWork is strongly truthful.
  4. g(x(t),t)≤∑jmin⁡itjig(x(t),t) \le \sum_{j} \min_i t^i_jg(x(t),t)≤∑j​mini​tji​.
  5. g(y,t)≥1n∑jmin⁡itjig(y,t) \ge \frac1n \sum_j \min_i t^i_jg(y,t)≥n1​∑j​mini​tji​ for every allocation yyy.
  6. Claim 4.3: MinWork is an nnn-approximation.

Significance

The theorem gives the first positive result for truthful scheduling: a mechanism that is truthful in the strongest sense and is within a factor nnn of optimal, whatever the tie-breaking rule. Every lower bound in the paper (Theorems 4.6, 4.10 and 4.12) and in the later literature measures itself against this ratio. Since the 2023 resolution of the Nisan–Ronen conjecture, the ratio nnn is known to be tight for deterministic truthful mechanisms.

The result is proved in the paper; it is not known to be formalized in any proof assistant. The platform already has Groves' theorem in an abstract form (AGT.vcg_incentive_compatible). This mission connects that abstract statement to a concrete combinatorial mechanism, and it adds the strict part of strong truthfulness for any number of tasks and agents, which the paper proves only for one task and two agents. The vocabulary (make-span over unrelated machines, direct scheduling mechanisms, strong truthfulness) is shared with the seven later missions of this series.

Difficulty

Truthfulness follows from Groves' theorem once MinWork is identified as a VGC mechanism. The identification requires the payment identity at every declared vector and under every tie-breaking rule, including ties at the winning time. The main difficulty is the strict part of strong truthfulness. A misreport that differs from the truth only on one task must still be shown to lose strictly for some declarations of the others. Those declarations must stay positive, and on every other task they must leave the outcome unchanged. The paper's proof covers only one task and two agents and leaves the general case as "similar". Its printed inequality also has the two utilities in the wrong order (see below), so it cannot be transcribed directly.

Formalization scope

  • Agents are Fin n and tasks are Fin k. An allocation is a function Fin k → Fin n, and an agent may receive no task. Types are positive reals, and every truthfulness and approximation quantifier ranges over positive true types, positive misreports and positive declarations of the others.
  • Payments are handed to the agent, so utility is the payment minus the true time spent. Payments are computed from the declared vector, never from true types.
  • The allocation rule is a parameter satisfying the MinWork specification (IsMinWorkAlloc). Every result holds for every tie-breaking rule, including rules that depend on the whole declared vector. No particular argmin is fixed.
  • n≥2n \ge 2n≥2 is a hypothesis of the goal and of the truthfulness items: with a single agent the paper's second-best minimum is undefined. The approximation items need only n≥1n \ge 1n≥1. There is no hypothesis on kkk.
  • The make-span and both minima are Finset.sup' / Finset.inf' over nonempty finite sets, so they are true maxima and minima with no default values.
  • Strong truthfulness is formalized as truthfulness plus: every misreport di≠tid^i \ne t^idi=ti is strictly worse than the truth for some positive declarations of the others. Given truthfulness this is equivalent to Definition 5. A formalization that states only that truth-telling is dominant, or proves strictness only for single-task instances, does not meet the goal. Neither does an existential ratio in place of nnn.
  • Printed slip: in the proof of Claim 4.2 (p. 177) the case di>tid^i > t^idi>ti reads "the utility for agent iii is ti−di<0t^i - d^i < 0ti−di<0, instead of 0 in the case of truth-telling". With the Definition 11 payments the misreporting agent loses the task (utility 0), and the truthful agent wins it with utility d3−i−ti>0d^{3-i} - t^i > 0d3−i−ti>0. The milestone text keeps the paper's words; the Lean statements assert what the argument establishes.
  • Out of scope: running time ("polynomial time"), and the paper's general revelation-principle framework (Proposition 2.1).
  • Welcome contributions: proofs of the milestones, and a reusable lemma connecting the local VGC milestone to AGT.vcg_incentive_compatible.

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • T. Groves, Incentives in Teams, Econometrica 41 (1973) 617–631. https://doi.org/10.2307/1914085
  • W. Vickrey, Counterspeculation, Auctions, and Competitive Sealed Tenders, Journal of Finance 16 (1961) 8–37. https://doi.org/10.1111/j.1540-6261.1961.tb02789.x
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Mathematical Programming 46 (1990) 259–271. https://doi.org/10.1007/BF01585745
  • G. Christodoulou, E. Koutsoupias, A. Kovács, A Proof of the Nisan-Ronen Conjecture, STOC 2023. https://arxiv.org/abs/2301.11905
9 thms4 active usersReviewed
🏆Completed
Mechanism DesignOperations ResearchOptimization·Captain: mikedeng1

Approximation Algorithms for Combinatorial Auctions with Complement-Free Bidders IV: A Truthful Value-Query Mechanism for Subadditive BiddersResearch Paper

Motivation

In a combinatorial auction a seller offers several indivisible items at once, and bidders value bundles of items rather than items one at a time. Allocating the items to maximize total value is the central optimization problem of the area, and it arises in spectrum licensing, procurement and transport contracting (Cramton, Shoham and Steinberg, Combinatorial Auctions, MIT Press, 2006). Two obstacles meet. Computationally, a valuation has 2m2^m2m numbers, so an algorithm can only query it, and even then optimization is hard. Strategically, the valuations are private: a bidder reports whatever maximizes its own utility, so an algorithm that is a good approximation on true inputs may be useless on reported ones.

The classical answer to the strategic obstacle is the VCG payment scheme, which makes truthful reporting a dominant strategy but requires the exact optimum. Nisan and Ronen (2007) showed that an approximation algorithm becomes truthful under VCG payments essentially only when it is maximal in range: it fixes a restricted set of allocations in advance and optimizes exactly over that set. Dobzinski, Nisan and Schapira (Math. Oper. Res. 35(1), 2010, §5) give such an algorithm for complement-free (subadditive) bidders that uses only value queries and loses a factor of order m\sqrt mm​. For general valuations in the value-query model the paper cites a lower bound of order m/log⁡mm/\log mm/logm (Dobzinski and Schapira, working paper 2005; Blumrosen and Nisan, Hebrew University Discussion Paper 381, 2005; see the paper's references [7] and [2]), and the same paper (Theorem 6.1) shows that even XOS bidders cannot be approximated within m1/2−ϵm^{1/2-\epsilon}m1/2−ϵ with polynomially many value queries.

Setting

A set M={1,…,m}M=\{1,\dots,m\}M={1,…,m} of items is sold to nnn bidders. Bidder iii has a valuation viv_ivi​ that assigns a real number vi(S)v_i(S)vi​(S) to every bundle S⊆MS\subseteq MS⊆M. Throughout, valuations are normalized, vi(∅)=0v_i(\emptyset)=0vi​(∅)=0, and monotone, S⊆T⇒vi(S)≤vi(T)S\subseteq T\Rightarrow v_i(S)\le v_i(T)S⊆T⇒vi​(S)≤vi​(T). A valuation is complement free (CF) if v(S∪T)≤v(S)+v(T)v(S\cup T)\le v(S)+v(T)v(S∪T)≤v(S)+v(T) for all bundles S,TS,TS,T. An allocation A=(A1,…,An)A=(A_1,\dots,A_n)A=(A1​,…,An​) gives the bidders pairwise disjoint bundles (items may stay unallocated), and its social welfare is ∑ivi(Ai)\sum_i v_i(A_i)∑i​vi​(Ai​).

The mechanism receives reports b=(b1,…,bn)b=(b_1,\dots,b_n)b=(b1​,…,bn​) and runs the following algorithm ALG\mathrm{ALG}ALG:

  1. query bi(M)b_i(M)bi​(M) and bi({j})b_i(\{j\})bi​({j}) for every bidder iii and item jjj;
  2. compute a maximum-weight matching PPP in the complete bipartite graph between items and bidders, where the edge between item jjj and bidder iii costs bi({j})b_i(\{j\})bi​({j});
  3. if the bidder ttt maximizing bi(M)b_i(M)bi​(M) has bt(M)b_t(M)bt​(M) strictly larger than the weight ∣P∣|P|∣P∣, give all items to ttt; otherwise give every item matched by PPP to its matched bidder.

Its range RRR is the set of allocations that give all of MMM to one bidder, together with the allocations in which every bidder receives at most one item. Under VCG payments bidder iii receives ∑k≠ibk(ALG(b)k)\sum_{k\ne i}b_k(\mathrm{ALG}(b)_k)∑k=i​bk​(ALG(b)k​), so its utility is vi(ALG(b)i)+∑k≠ibk(ALG(b)k)v_i(\mathrm{ALG}(b)_i)+\sum_{k\ne i}b_k(\mathrm{ALG}(b)_k)vi​(ALG(b)i​)+∑k=i​bk​(ALG(b)k​). The mechanism is incentive compatible on a class of valuations if no bidder can raise its utility by misreporting within that class, whatever the others report.

Formalization targets

Goal: Theorem 5.1 (p. 11)

For every choice of the maximum-weight matching and of the top bidder as functions of the reports, for every profile vvv of normalized, monotone, CF valuations and every allocation OOO,

∑i=1nvi(Oi)  ≤  2m ∑i=1nvi(ALG(v)i),\sum_{i=1}^n v_i(O_i)\;\le\;2\sqrt m\,\sum_{i=1}^n v_i\big(\mathrm{ALG}(v)_i\big),i=1∑n​vi​(Oi​)≤2m​i=1∑n​vi​(ALG(v)i​),

and the mechanism (ALG,VCG payments)(\mathrm{ALG},\text{VCG payments})(ALG,VCG payments) is incentive compatible on the CF valuations.

Milestones, in attack order

  1. §5.1, VCG. Welfare maximization with Groves payments is incentive compatible (a published platform theorem, AGT.vcg_incentive_compatible).
  2. §5.1, maximal in range. Any allocation rule that optimizes reported welfare exactly over a fixed range is incentive compatible under VCG payments on the same domain.
  3. ALG is maximal in range with range RRR on normalized reports.
  4. The CF single-item bound. For a CF valuation and c∈Tc\in Tc∈T maximizing v({j})v(\{j\})v({j}) over TTT: v(T)≤∑j∈Tv({j})≤∣T∣ v({c})v(T)\le\sum_{j\in T}v(\{j\})\le|T|\,v(\{c\})v(T)≤∑j∈T​v({j})≤∣T∣v({c}).
  5. First case. If bidders with ∣Oi∣≥m|O_i|\ge\sqrt m∣Oi​∣≥m​ carry at least half the welfare of OOO, then ∑ivi(Oi)≤2m vt(M)\sum_i v_i(O_i)\le 2\sqrt m\,v_t(M)∑i​vi​(Oi​)≤2m​vt​(M) for the top bidder ttt.
  6. Second case. Otherwise some allocation in which every bidder gets at most one item has welfare at least ∑ivi(Oi)/(2m)\sum_i v_i(O_i)/(2\sqrt m)∑i​vi​(Oi​)/(2m​).

Significance

The theorem shows that, for subadditive bidders, the m\sqrt mm​ barrier known for general valuations can be matched by a truthful mechanism that asks each bidder only m+1m+1m+1 value queries. It is one of the early examples of maximal-in-range mechanism design, a template later used for many truthful approximation mechanisms in combinatorial auctions, and it sits against Theorem 6.1 of the same paper, which shows that for XOS bidders no value-query algorithm with polynomially many queries does better than m1/2−ϵm^{1/2-\epsilon}m1/2−ϵ.

The result is proved in the paper. What this mission adds is a machine-checked proof: a formal model of VCG-based mechanisms over a restricted range, a proof that the §5.2 algorithm is maximal in range for every tie-breaking of its two optimization steps, and the explicit constant 222 in the O(m)O(\sqrt m)O(m​) bound. To our knowledge neither half of Theorem 5.1 is formalized elsewhere; the general VCG theorem exists on the platform in the setting of arbitrary outcome sets.

Difficulty

The approximation argument partitions the bidders of a reference allocation by whether their bundles have at least m\sqrt mm​ items, and the two cases need different facts: disjointness bounds the number of large bundles by m\sqrt mm​, and subadditivity bounds each small bundle by its size times its best item. A naive transcription breaks at degenerate inputs: the page divides by ∣Ti∣|T_i|∣Ti​∣ and writes strict inequalities, both of which fail when a bundle is empty or all values are zero, so the formal statement must be organized around non-strict bounds.

Incentive compatibility has a different obstacle. It holds only if the allocation rule depends on the reports alone and optimizes exactly over its range, including at ties between the grand bundle and the matching. The matching and the top bidder are not unique, so the proof must work for an arbitrary but fixed tie-breaking, and the welfare of the matching allocation must be identified with the matching weight, which uses normalization of every bidder who receives nothing.

Formalization scope

Bidders are Fin n, items Fin m, bundles Finset (Fin m), valuations Finset (Fin m) → ℝ. Normalization and monotonicity (the paper's standing assumptions, p. 1) and complement freedom are hypotheses; IsCFValuation bundles all three. An allocation is a family of pairwise disjoint bundles; unallocated items are allowed. A matching is a partial map Fin m → Option (Fin n) with no bidder matched twice.

Conventions the formalization commits to:

  • Explicit constant. The paper writes O(m)O(\sqrt m)O(m​); its proof yields 2m2\sqrt m2m​ (both cases end with ∣OPT∣/(2m)|OPT|/(2\sqrt m)∣OPT∣/(2m​)), and the goal states 2m2\sqrt m2m​ with Real.sqrt m.
  • Oracles and ties. The maximum-weight matching and the top bidder enter as functions mat, top of the report profile, each with a specification hypothesis; the goal is stated for every such pair. The algorithm reads only the reports; the tie between bt(M)b_t(M)bt​(M) and ∣P∣|P|∣P∣ goes to the matching, as on the page.
  • Payments. The mechanism pays each bidder ∑k≠ibk(⋅)\sum_{k\ne i}b_k(\cdot)∑k=i​bk​(⋅), the paper's convention (footnote 2, p. 11); incentive compatibility is stated on the CF domain, the paper's. The local definition mirrors AGT.MechIncentiveCompatible on outcomes a↦vi(ai)a\mapsto v_i(a_i)a↦vi​(ai​).
  • Reference allocation. The approximation is stated against every allocation OOO, not only an optimal one; this is equivalent and avoids a junk maximum.
  • Printed slips. The strict inequalities and the division by ∣Ti∣|T_i|∣Ti​∣ in the second case are replaced by non-strict, multiplied forms; the first case concludes for a bidder maximizing vi(M)v_i(M)vi​(M) rather than vi(Oi)v_i(O_i)vi​(Oi​).
  • Degenerate sizes. At m=0m=0m=0 everything is zero and the bound holds trivially; with n=0n=0n=0 no top-bidder rule exists.
  • Out of scope. "In polynomial time" is a running-time claim and is not modelled.

A trivializing formalization is ruled out: the ratio is the explicit 2m2\sqrt m2m​ rather than an existential constant, incentive compatibility is over the full CF domain (not additive reports only) for a rule that cannot see true valuations, and the rules mat, top are satisfiable (a maximum over the finitely many matchings exists; a top bidder exists when n≥1n\ge1n≥1).

Useful infrastructure: finite maximum-weight matchings on complete bipartite graphs, subadditivity bounds over Finset sums, and a reusable lemma that maximal-in-range rules with VCG payments are truthful. Contributions of any milestone are welcome; milestones 2 and 4 are self-contained.

Selected references

  • S. Dobzinski, N. Nisan, M. Schapira, Approximation Algorithms for Combinatorial Auctions with Complement-Free Bidders, Mathematics of Operations Research 35(1):1–13, 2010. https://doi.org/10.1287/moor.1090.0436
  • N. Nisan, A. Ronen, Computationally Feasible VCG Mechanisms, Journal of Artificial Intelligence Research 29:19–47, 2007. https://doi.org/10.1613/jair.2046
  • S. Dobzinski, M. Schapira, Optimal Upper and Lower Approximation Bounds for k-Duplicates Combinatorial Auctions, working paper, The Hebrew University of Jerusalem, 2005 (reference [7] of the paper).
  • L. Blumrosen, N. Nisan, On the Computational Power of Iterative Auctions I: Demand Queries, Discussion Paper 381, Center for the Study of Rationality, The Hebrew University of Jerusalem, 2005 (reference [2] of the paper).
  • N. Nisan, Introduction to Mechanism Design (for Computer Scientists), in N. Nisan, T. Roughgarden, E. Tardos, V. Vazirani (eds.), Algorithmic Game Theory, Cambridge University Press, 2007, pp. 209–242.
  • P. Cramton, Y. Shoham, R. Steinberg (eds.), Combinatorial Auctions, MIT Press, 2006.
8 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations Research·Captain: mikedeng1

The Assignment Game I: The Core 2: The High-Price and Low-Price Corners of the CoreResearch Paper

Motivation

A two-sided market in which each seller owns one indivisible good (a house, in the paper's example) and each buyer wants at most one is the simplest model in which prices emerge from bargaining between individuals rather than from a supply curve. Shapley and Shubik, The Assignment Game I: The Core (Int. J. Game Theory 1 (1971)), treat this market as a cooperative game with transferable utility and describe its core, the set of payoff divisions that no group of traders can improve upon by trading among themselves. The paper is the foundation of the literature on assignment markets, auctions of heterogeneous items, and two-sided matching with money.

This mission formalizes the paper's structural result on the shape of the core, Theorem 3 (p. 121): among all core outcomes there is a high-price corner in which every seller simultaneously receives the highest payoff available in the core and every buyer the lowest, and a low-price corner with the roles reversed; these two corners are the farthest-apart pair of core points. The authors note (p. 121, footnote 2) that a similar theorem for markets without money is proved by Gale and Shapley (1962), where it becomes the existence of seller-optimal and buyer-optimal stable matchings.

Setting

Let MMM be a finite set of sellers and NNN a finite set of buyers, with m=∣M∣m = |M|m=∣M∣ and n=∣N∣n = |N|n=∣N∣ not necessarily equal. For each seller iii and buyer jjj a number aij≥0a_{ij} \ge 0aij​≥0 is given: the gain the pair can realize by trading (Eq. (2.5), p. 114; Sec. 2.3, p. 116).

A coalition S⊆M∪NS \subseteq M \cup NS⊆M∪N is described by its seller part A=S∩MA = S \cap MA=S∩M and buyer part B=S∩NB = S \cap NB=S∩N. A matching inside (A,B)(A, B)(A,B) is a set P⊆A×BP \subseteq A \times BP⊆A×B of seller–buyer pairs in which no player occurs twice. The characteristic function (Eq. (2.6), p. 115) gives the coalition the best total gain it can realize by pairing its members:

worth⁡(A,B)=max⁡P matching in (A,B)∑(i,j)∈Paij.\operatorname{worth}(A, B) = \max_{P \text{ matching in } (A,B)} \sum_{(i,j) \in P} a_{ij}.worth(A,B)=P matching in (A,B)max​(i,j)∈P∑​aij​.

A matching of the whole market attaining worth⁡(M,N)\operatorname{worth}(M, N)worth(M,N) is an optimal assignment.

A payoff vector is a pair (u,v)(u, v)(u,v) with u∈RMu \in \mathbb{R}^Mu∈RM (sellers' payoffs) and v∈RNv \in \mathbb{R}^Nv∈RN (buyers' payoffs). The core (p. 118) consists of the payoff vectors with

∑i∈Mui+∑j∈Nvj=worth⁡(M,N)(3.5),∑i∈Aui+∑j∈Bvj≥worth⁡(A,B)  for all A⊆M, B⊆N(3.6).\sum_{i \in M} u_i + \sum_{j \in N} v_j = \operatorname{worth}(M, N) \quad (3.5), \qquad \sum_{i \in A} u_i + \sum_{j \in B} v_j \ge \operatorname{worth}(A, B) \ \text{ for all } A \subseteq M,\ B \subseteq N \quad (3.6).i∈M∑​ui​+j∈N∑​vj​=worth(M,N)(3.5),i∈A∑​ui​+j∈B∑​vj​≥worth(A,B)  for all A⊆M, B⊆N(3.6).

Singleton coalitions have worth 000, so core vectors are nonnegative; the paper calls them "imputations in the core".

For a seller iii, write ui∗u^*_iui∗​ and u∗iu_{*i}u∗i​ for the highest and lowest value of uiu_iui​ over the core; for a buyer jjj, write vj∗v^*_jvj∗​ and v∗jv_{*j}v∗j​ likewise.

Formalization targets

Goal: Theorem 3 (p. 121)

The low-price corner (u∗,v∗)(u_*, v^*)(u∗​,v∗) and the high-price corner (u∗,v∗)(u^*, v_*)(u∗,v∗​) are in the core, and for all core vectors (u′,v′)(u', v')(u′,v′), (u′′,v′′)(u'', v'')(u′′,v′′),

∑i∈M(ui′−ui′′)2+∑j∈N(vj′−vj′′)2≤∑i∈M(u∗i−ui∗)2+∑j∈N(vj∗−v∗j)2.\sum_{i \in M} (u'_i - u''_i)^2 + \sum_{j \in N} (v'_j - v''_j)^2 \le \sum_{i \in M} (u_{*i} - u^*_i)^2 + \sum_{j \in N} (v^*_j - v_{*j})^2 .i∈M∑​(ui′​−ui′′​)2+j∈N∑​(vj′​−vj′′​)2≤i∈M∑​(u∗i​−ui∗​)2+j∈N∑​(vj∗​−v∗j​)2.

Milestones, in attack order

  1. Sec. 3.2, p. 118 — the core is nonempty.
  2. Sec. 3.3, p. 120 — the core is closed, convex and bounded (a polytope).
  3. Sec. 3.3, proof of the Lemma, p. 121 — on an optimal assignment PPP, every core vector has ui+vj=aiju_i + v_j = a_{ij}ui​+vj​=aij​ for (i,j)∈P(i, j) \in P(i,j)∈P and pays 000 to players PPP leaves unassigned.
  4. Lemma, p. 121 — for core vectors (u′,v′)(u', v')(u′,v′), (u′′,v′′)(u'', v'')(u′′,v′′), the vectors (min⁡(u′,u′′),max⁡(v′,v′′))(\min(u', u''), \max(v', v''))(min(u′,u′′),max(v′,v′′)) and (max⁡(u′,u′′),min⁡(v′,v′′))(\max(u', u''), \min(v', v''))(max(u′,u′′),min(v′,v′′)) (coordinatewise) are in the core.
  5. Sec. 3.3, p. 122 — any two core vectors satisfy ∣ui′−ui′′∣≤ui∗−u∗i|u'_i - u''_i| \le u^*_i - u_{*i}∣ui′​−ui′′​∣≤ui∗​−u∗i​ and ∣vj′−vj′′∣≤vj∗−v∗j|v'_j - v''_j| \le v^*_j - v_{*j}∣vj′​−vj′′​∣≤vj∗​−v∗j​ for every iii and jjj.

Milestone 5 is the strongest form of the distance clause of the goal: it gives the same conclusion for every distance that depends only on the absolute values of the coordinate differences, as the paper remarks on p. 122.

Significance

The result. Theorem 3 says that the core of an assignment market is elongated along the direction of market-wide price movements: "intergroup allocations are relatively indeterminate, intragroup allocations are relatively precise" (p. 121). The high-price corner is the outcome most favourable to all sellers at once, and the low-price corner the one most favourable to all buyers; that such simultaneous optima exist is a property of this game, not of cores in general. The low-price corner, the buyers' optimum, is the outcome reached by the ascending multi-item auction of Demange, Gale and Sotomayor (J. Polit. Econ. 94 (1986)), and the lattice structure underlies the incentive analysis of assignment mechanisms.

Formalizing it. The theorem is classical and fully proved in the paper; Prove2Me has no formalization of it, and nothing on the platform treats transferable-utility assignment games (the platform's stable-matching material concerns the non-transferable-utility model). The mission produces a reusable definition of the assignment game and its core, the lattice property of the core, and the extremal-corner theorem, stated with the core's extrema defined intrinsically rather than as parameters.

Difficulty

The proof in the paper takes a finite family of core vectors realizing all the extremal values and applies the Lemma repeatedly (p. 122). That argument presupposes that each extremum ui∗u^*_iui∗​, u∗iu_{*i}u∗i​, vj∗v^*_jvj∗​, v∗jv_{*j}v∗j​ is attained by some core vector, which the paper takes from the core being a nonempty polytope without stating it separately. Nonemptiness is itself the substantive result of the paper's linear-programming analysis (Theorem 2, via the duality theorem and the integrality of the assignment polytope), and it is not available here as a black box. The other nontrivial point is the Lemma's efficiency claim: that the coordinatewise min/max vectors still distribute exactly worth⁡(M,N)\operatorname{worth}(M, N)worth(M,N), which depends on the structure of an optimal assignment and fails for the naive combination (max⁡(u′,u′′),max⁡(v′,v′′))(\max(u', u''), \max(v', v''))(max(u′,u′′),max(v′,v′′)).

Formalization scope

  • Players and matrix. MMM and NNN are arbitrary finite types (Fintype); either may be empty and m≠nm \ne nm=n is allowed. The matrix is a : M → N → ℝ, and every theorem carries the paper's standing assumption aij≥0a_{ij} \ge 0aij​≥0 as a hypothesis. No other hypothesis is added.
  • Coalitions are pairs (A, B) : Finset M × Finset N. Matchings are finsets of pairs with injective projections. The paper maximizes over exactly k=min⁡(∣S∩M∣,∣S∩N∣)k = \min(|S \cap M|, |S \cap N|)k=min(∣S∩M∣,∣S∩N∣) disjoint pairs; the formalization maximizes over matchings of every size, which gives the same value because aij≥0a_{ij} \ge 0aij​≥0.
  • Naming. The characteristic function is worth, since v denotes buyers' payoffs.
  • Core is a Set ((M → ℝ) × (N → ℝ)) defined by (3.5) and (3.6) over all coalitions, with no separate nonnegativity clause (it follows from singleton coalitions).
  • Extremal payoffs uHi, uLo, vHi, vLo are sSup/sInf in ℝ of the image of the core under a coordinate. On an empty or unbounded set these return 000; the goal does not assume the core nonempty or bounded, so it is not vacuous and does not hide milestones 1–2 as hypotheses. The goal's membership clauses imply attainment of the extrema.
  • Distance. The goal uses the Euclidean distance on RM×RN\mathbb{R}^M \times \mathbb{R}^NRM×RN through sums of squared coordinate differences. Lean's default dist on a product of function types is the sup-distance and is not used.
  • Ruled out. A formalization in which u∗,u∗,v∗,v∗u^*, u_*, v^*, v_*u∗,u∗​,v∗,v∗​ are free parameters constrained only by the conclusion, or in which the goal assumes a nonempty bounded core, would trivialize or weaken Theorem 3; the extrema here are computed from the core.
  • Not formalized. The dimension statements of p. 120 ("typically equal to min(m,n)") are informal. The LP characterization of the core (Theorem 2) is the subject of the companion mission of this series and is not restated.
  • Welcome contributions. Lemmas about matchings inside coalitions (injectivity, sums over images), the implication "dual feasible ⇒\Rightarrow⇒ coalitionally rational", and general facts about sSup/sInf of compact coordinate images are reusable for any assignment-market or TU-matching development.

Selected references

  • L. S. Shapley and M. Shubik, The Assignment Game I: The Core, International Journal of Game Theory 1 (1971), 111–130. https://doi.org/10.1007/BF01753437
  • D. Gale and L. S. Shapley, College Admissions and the Stability of Marriage, American Mathematical Monthly 69 (1962), 9–15. https://doi.org/10.2307/2312726
  • G. Demange, D. Gale and M. Sotomayor, Multi-Item Auctions, Journal of Political Economy 94 (1986), 863–872. https://doi.org/10.1086/261393
  • G. B. Dantzig, Linear Programming and Extensions, Princeton University Press, 1963. https://doi.org/10.1515/9781400884179
7 thms4 active usersReviewed
🏆Completed
Machine LearningProbabilityStatistics·Captain: mikedeng1

Calibrated Learning and Correlated Equilibrium III: A Randomized Forecast Calibrated against Every OpponentResearch Paper

Motivation

A forecaster who announces "70% chance of rain" is calibrated if, among the days on which that number was announced, it rained on about 70% of them. Dawid (The well-calibrated Bayesian, JASA 1982) proposed calibration as the minimal requirement of an honest probability forecaster. Oakes (Self-calibrating priors do not exist, JASA 1985) showed that no deterministic forecasting rule can be calibrated against every sequence of outcomes: an adversary who knows the rule can always choose the outcome that contradicts the forecast.

Foster and Vohra (Calibrated learning and correlated equilibrium, Games Econ. Behav. 21 (1997) 40–55) use calibration as the bridge between learning and equilibrium in repeated games. Their Theorem 1 says that if each player best-responds to calibrated forecasts of the opponent, the empirical distribution of play converges to the set of correlated equilibria. That theorem is only useful if calibrated forecasts can actually be produced whatever the opponent does. Theorem 3 of the paper, credited to an unpublished 1991 manuscript of the same authors and proved in the paper's Appendix, says they can, provided the forecaster randomizes.

Timeline. Dawid (1982) defines calibration. Oakes (1985) rules out deterministic calibrated forecasting against arbitrary sequences. Foster and Vohra (1991 manuscript; 1997 paper, Theorem 3 and Appendix) give a randomized forecaster calibrated against any opponent, through a pairwise ("internal") no-regret property. The full argument appeared in Foster and Vohra, Asymptotic calibration, Biometrika 85 (1998). Hart and Mas-Colell (A simple adaptive procedure leading to correlated equilibrium, Econometrica 2000) later made internal regret the standard route to correlated equilibrium.

Setting

Player 2 has n≥1n\ge 1n≥1 pure strategies j∈{0,…,n−1}j\in\{0,\dots,n-1\}j∈{0,…,n−1}. In every round, player 1 announces a forecast p∈Rnp\in\mathbb R^np∈Rn, a probability vector (pj≥0p_j\ge 0pj​≥0, ∑jpj=1\sum_j p_j = 1∑j​pj​=1), and player 2 plays a strategy jjj. The two moves are simultaneous: player 2 does not see the current forecast.

A history hhh of length ttt is the list of the ttt pairs (forecast, play), oldest first. For a forecast vector ppp and a strategy jjj:

  • N(p,t)N(p,t)N(p,t) is the number of rounds of hhh in which ppp was forecast;
  • ρ(p,j,t)\rho(p,j,t)ρ(p,j,t) is the fraction of those rounds in which player 2 played jjj (and 000 if N(p,t)=0N(p,t)=0N(p,t)=0);
  • the calibration score (Eq. (1), p. 49) is
Ct=∑p∑j∣ρ(p,j,t)−pj∣ N(p,t)t.C_t = \sum_p\sum_j \bigl|\rho(p,j,t) - p_j\bigr|\,\frac{N(p,t)}{t}.Ct​=p∑​j∑​​ρ(p,j,t)−pj​​tN(p,t)​.

A randomized forecaster FFF maps each history to a probability distribution on forecasts. A learning rule AAA of player 2 maps each history to a probability distribution on strategies. In round t+1t+1t+1 the forecast is drawn from F(h)F(h)F(h) and the play from A(h)A(h)A(h), independently given the history hhh of the first ttt rounds. This defines the law PF,A\mathbb P_{F,A}PF,A​ of the first ttt rounds (histLaw F A t).

For the Appendix: with kkk forecasts, losses LtiL_t^iLti​ and mixing weights wtiw_t^iwti​, the pairwise regret of replacing forecast iii by forecast jjj is

RTi→j=max⁡{0, ∑t=1Twti (Lti−Ltj)}.R_T^{i\to j} = \max\Bigl\{0,\ \sum_{t=1}^T w_t^i\,(L_t^i - L_t^j)\Bigr\}.RTi→j​=max{0, t=1∑T​wti​(Lti​−Ltj​)}.

Formalization targets

Goal: Theorem 3 (p. 49)

There is a forecaster FFF, with probability-vector forecasts, such that for every learning rule AAA of player 2 and every ε>0\varepsilon>0ε>0,

lim⁡t→∞PF,A(Ct<ε)=1.\lim_{t\to\infty}\mathbb P_{F,A}\bigl(C_t<\varepsilon\bigr) = 1.t→∞lim​PF,A​(Ct​<ε)=1.

The forecaster is fixed before the opponent; no rate is claimed, and the rate may depend on AAA.

Milestones, in the order the Appendix uses them

  1. Flow conservation is solvable (p. 52). For every nonnegative k×kk\times kk×k matrix RRR, k≥1k\ge 1k≥1, there is a probability vector www with wi∑jRi→j=∑jwjRj→iw^i\sum_j R^{i\to j} = \sum_j w^j R^{j\to i}wi∑j​Ri→j=∑j​wjRj→i for all iii.
  2. Lemma 1 (No-Regret) (p. 52). With losses in [0,1][0,1][0,1] and weights solving flow conservation for the previous regrets,
RTi→j≤2kTfor all i,j,T.R_T^{i\to j}\le\sqrt{2kT}\quad\text{for all } i,j,T.RTi→j​≤2kT​for all i,j,T.
  1. Regrets sandwich L-2 calibration (p. 54). For a grid p1,…,pkp^1,\dots,p^kp1,…,pk that is ε\varepsilonε-dense in squared distance and losses Lti=∣Xt−pi∣2L_t^i = |X_t - p^i|^2Lti​=∣Xt​−pi∣2,
∑imax⁡jRTi→jT ≤ C2,w(T) ≤ ε+∑imax⁡jRTi→jT,\sum_i\max_j \frac{R_T^{i\to j}}{T}\ \le\ C_{2,w}(T)\ \le\ \varepsilon + \sum_i\max_j\frac{R_T^{i\to j}}{T},i∑​jmax​TRTi→j​​ ≤ C2,w​(T) ≤ ε+i∑​jmax​TRTi→j​​,

with C2,wC_{2,w}C2,w​ the fractional L-2 calibration score. 4. L-1 versus L-2 (p. 54). For each jjj, ∑p∣ρ(p,j,t)−pj∣ N(p,t)/t≤∑p(ρ(p,j,t)−pj)2N(p,t)/t\sum_p|\rho(p,j,t)-p_j|\,N(p,t)/t \le \sqrt{\sum_p(\rho(p,j,t)-p_j)^2 N(p,t)/t}∑p​∣ρ(p,j,t)−pj​∣N(p,t)/t≤∑p​(ρ(p,j,t)−pj​)2N(p,t)/t​.

Significance

The result. Theorem 3 makes the hypothesis of Theorem 1 attainable: combined, they show that there are learning procedures under which play converges in probability to the set of correlated equilibria of any finite game (the paper's Corollary, p. 49). The intermediate Lemma 1 is an early internal-regret bound; internal (swap) regret minimization later became the standard algorithmic route to correlated equilibria and to calibrated prediction in online learning.

Formalizing it. The result is proved, in the 1997 Appendix in telegraphic form and in full in Foster and Vohra (1998). The Appendix leaves several steps informal (see Formalization scope), so a machine-checked proof must supply them. No formalization of calibration or of internal regret was found on Prove2Me as of 2026-09-26. The mission produces a formal model of randomized forecasters against adaptive opponents, a checked internal-regret bound with an explicit constant, and the passage from regret to calibration.

Difficulty

The obvious approach is to pick, at each round, a forecast that corrects the current miscalibration. This is a deterministic rule, and by Oakes' theorem an opponent can defeat it. Randomization alone does not help either: the forecaster must randomize in a way that controls every pairwise regret Ri→jR^{i\to j}Ri→j at once, not only the regret against the best fixed forecast. External no-regret does not imply calibration.

Two further gaps separate Lemma 1 from Theorem 3. First, the Appendix controls a fractional score in which the event "forecast pip^ipi was issued" is replaced by its probability wtiw_t^iwti​. The realized calibration score involves the random choices, so a concentration argument is needed against an adaptive opponent. Second, a fixed grid gives calibration only up to its mesh ε\varepsilonε. Exact convergence requires letting the grid size kkk grow and ε\varepsilonε shrink over time, and the scores of the different phases must be combined.

Formalization scope

  • Model. Strategies are Fin n; forecasts are vectors Fin n → ℝ that are probability vectors (IsDist). Histories are Lean lists of (forecast, play) pairs, oldest first. Forecaster and opponent are maps from histories to Mathlib PMFs. The history law is built with PMF.bind/PMF.map, with the two draws independent given the past. P(Ct<ε)\mathbb P(C_t<\varepsilon)P(Ct​<ε) is the toOuterMeasure of the law, in ℝ≥0∞; no σ-algebra on histories is used.
  • Opponent. The opponent may be randomized and may depend on all past forecasts and plays; fixed sequences and deterministic rules are special cases. The opponent never sees the current forecast. Letting it see the current forecast would make the goal false, and restricting to fixed sequences would make it weaker than the paper.
  • Quantifiers. The forecaster is chosen before the opponent (∃ F, ∀ A). The reverse order is trivial, since one can forecast AAA's next play.
  • Conventions. Rounds are counted from 000, so the paper's rounds 1,…,t1,\dots,t1,…,t are the first ttt list entries. The paper's Rt−1R_{t-1}Rt−1​ is the regret over the 000-based rounds before ttt. Forecasts are grouped by exact equality of real vectors. Sums over ppp run over the forecasts that occur, and every other term vanishes. Scores divide by the history length, and are 000 for the empty history. "Converges in probability" is the lim⁡P(Ct<ε)=1\lim\mathbb P(C_t<\varepsilon)=1limP(Ct​<ε)=1 form the page states. The grid of milestone 3 is indexed 1,…,k1,\dots,k1,…,k (the page writes i=0,…,ki = 0,\dots,ki=0,…,k on p. 53 and 1,…,k1,\dots,k1,…,k in Lemma 1), and "within ε\varepsilonε" is read in squared Euclidean distance.
  • Pinned reading. The page writes the middle term of milestone 3 as E(C2(t))E(C_2(t))E(C2​(t)) with a garbled formula. The mission states the inequality for the fractional score C2,wC_{2,w}C2,w​, for which it holds.
  • Steps the paper leaves informal, not stated as milestones. (a) "E(C2(t))≤ε+O(k/2)E(C_2(t))\le\varepsilon + O(k/\sqrt2)E(C2​(t))≤ε+O(k/2​)" when the weights solve flow conservation; the OOO-term is garbled and should decay in ttt. (b) "if we let kkk grow slowly and ε\varepsilonε go slowly to zero … C2(t)→0C_2(t)\to 0C2​(t)→0 in expectation which implies C2(t)→0C_2(t)\to0C2​(t)→0 in probability by Jensen's inequality", together with the passage from the fractional score to the realized one. Solvers will have to formalize these steps on the way to the goal.
  • Not included. The Corollary on p. 49 (convergence in probability of play to the correlated equilibria when both players use the scheme). It needs the game layer and a quantitative form of Theorem 1, and the page gives no proof.
  • Infrastructure welcome. Finite Markov chain stationary distributions (for milestone 1), for which Prove2Me has MarkovChain.exists_isStationary for row-stochastic matrices. Also useful: martingale concentration for PMF-built processes, and Cauchy–Schwarz with weights. The history-law construction is reusable for any repeated forecasting game.

Selected references

  • D. P. Foster and R. V. Vohra, Calibrated learning and correlated equilibrium, Games and Economic Behavior 21 (1997) 40–55. https://doi.org/10.1006/game.1997.0595
  • D. P. Foster and R. V. Vohra, Asymptotic calibration, Biometrika 85 (1998) 379–390. https://doi.org/10.1093/biomet/85.2.379
  • A. P. Dawid, The well-calibrated Bayesian, J. Amer. Statist. Assoc. 77 (1982) 605–613. https://doi.org/10.1080/01621459.1982.10477856
  • D. Oakes, Self-calibrating priors do not exist, J. Amer. Statist. Assoc. 80 (1985) 339. https://doi.org/10.1080/01621459.1985.10478117
  • S. Hart and A. Mas-Colell, A simple adaptive procedure leading to correlated equilibrium, Econometrica 68 (2000) 1127–1150. https://doi.org/10.1111/1468-0262.00153
10 thms4 active usersReviewed
🏆Completed
Machine LearningOperations Research·Captain: mikedeng1

Calibrated Learning and Correlated Equilibrium I: Calibrated Forecasts with Best Responses Converge to the Set of Correlated EquilibriaResearch Paper

Motivation

A correlated equilibrium (Aumann 1974) is a joint distribution over the players' strategy profiles such that no player gains by deviating from the strategy the distribution recommends to them. It is the equilibrium notion that learning dynamics in repeated games most naturally reach, and a basic question in learning in games is which simple rules, played repeatedly, drive the empirical distribution of play to the set of correlated equilibria.

Foster and Vohra (1997) answer this with a hypothesis on forecasts instead of a particular algorithm. Each player forecasts the other's next move and best-responds to the forecast. They only require the forecasts to be calibrated in the sense of Dawid (1982): among the rounds in which a player forecast a given probability vector, the empirical frequencies of the opponent's moves must approach that vector. Their Theorem 1 says that this already forces the empirical joint distribution of play to approach the set of correlated equilibria. The paper uses this to argue that Bayesian players under a common prior, whose forecasts are calibrated by Dawid's theorem, end up playing a correlated equilibrium. That is an alternative to Aumann's (1987) derivation of correlated equilibrium from common priors and rationality.

Timeline:

  • Aumann (1974, 1987) introduces correlated equilibrium and derives it from Bayesian rationality.
  • Dawid (1982) proposes calibration as a minimal requirement on probability forecasts.
  • Foster and Vohra (1997) prove Theorem 1 (this mission) and show that calibrated forecasts exist once the forecaster may randomize.
  • Hart and Mas-Colell (2000) give regret matching, an adaptive procedure with the same limit set.

Setting

A finite two-player game GGG has strategy sets S(1)={0,…,m−1}S(1) = \{0, \dots, m-1\}S(1)={0,…,m−1} and S(2)={0,…,n−1}S(2) = \{0, \dots, n-1\}S(2)={0,…,n−1} and payoff matrices u1,u2:S(1)×S(2)→Ru_1, u_2 : S(1) \times S(2) \to \mathbb{R}u1​,u2​:S(1)×S(2)→R, which the players maximize. A joint distribution DDD is a nonnegative m×nm \times nm×n matrix with entries summing to 111. It is a correlated equilibrium if

∑x,yD(x,y) u1(Φ(x),y)≤∑x,yD(x,y) u1(x,y)for all Φ:S(1)→S(1),\sum_{x,y} D(x,y)\, u_1(\Phi(x), y) \le \sum_{x,y} D(x,y)\, u_1(x,y) \quad \text{for all } \Phi : S(1) \to S(1),x,y∑​D(x,y)u1​(Φ(x),y)≤x,y∑​D(x,y)u1​(x,y)for all Φ:S(1)→S(1),

and symmetrically for player 2. The set of correlated equilibria is π(G)\pi(G)π(G).

The game is played in rounds s=0,1,2,…s = 0, 1, 2, \dotss=0,1,2,…. In round sss player 1 issues a forecast f1(s)f_1(s)f1​(s), a probability vector over S(2)S(2)S(2), and player 2 issues a forecast f2(s)f_2(s)f2​(s) over S(1)S(1)S(1). Each player then plays a best response to its forecast, x(s)=R1(f1(s))x(s) = R_1(f_1(s))x(s)=R1​(f1​(s)) and y(s)=R2(f2(s))y(s) = R_2(f_2(s))y(s)=R2​(f2​(s)). Here R1R_1R1​ and R2R_2R2​ are best-reply functions: R1(p)R_1(p)R1​(p) maximizes ∑ypyu1(⋅,y)\sum_y p_y u_1(\cdot, y)∑y​py​u1​(⋅,y) for every probability vector ppp, and R1R_1R1​ is a fixed function of the forecast alone. This is the paper's standing assumption of a stationary, deterministic tie-breaking rule.

For a forecast sequence fff and the opponent's plays zzz, N(p,t)N(p,t)N(p,t) counts the rounds among the first ttt in which fff forecast ppp. ρ(p,j,t)\rho(p,j,t)ρ(p,j,t) is the fraction of those rounds in which the opponent played jjj, and 000 if there are none. The forecast is calibrated with respect to zzz if for every jjj

∑p∣ρ(p,j,t)−pj∣ N(p,t)t⟶0(t→∞).\sum_p |\rho(p,j,t) - p_j|\, \frac{N(p,t)}{t} \longrightarrow 0 \qquad (t \to \infty).p∑​∣ρ(p,j,t)−pj​∣tN(p,t)​⟶0(t→∞).

The empirical joint distribution Dt(x,y)D_t(x,y)Dt​(x,y) is the fraction of the first ttt rounds in which player 1 played xxx and player 2 played yyy.

Formalization targets

Goal: Theorem 1

If f1f_1f1​ is calibrated with respect to yyy and f2f_2f2​ is calibrated with respect to xxx, then

min⁡D∈π(G) max⁡x∈S(1), y∈S(2)∣Dt(x,y)−D(x,y)∣⟶0(t→∞).\min_{D \in \pi(G)} \ \max_{x \in S(1),\, y \in S(2)} |D_t(x,y) - D(x,y)| \longrightarrow 0 \qquad (t \to \infty).D∈π(G)min​ x∈S(1),y∈S(2)max​∣Dt​(x,y)−D(x,y)∣⟶0(t→∞).

The goal fixes no rate and no particular forecasting method: it asserts only convergence of DtD_tDt​ to the set π(G)\pi(G)π(G), for every calibrated forecast.

Milestones: the steps of the proof (pp. 44–45)

  1. DtD_tDt​ lies in the simplex for t≥1t \ge 1t≥1.
  2. For each x∈S(1)x \in S(1)x∈S(1), the set Mb(x)M_b(x)Mb​(x) of mixtures to which xxx is a best response is closed and convex.
  3. The mixtures Mp(x)M_p(x)Mp​(x) at which player 1 actually plays xxx satisfy Mp(x)⊆Mb(x)M_p(x) \subseteq M_b(x)Mp​(x)⊆Mb​(x).
  4. The identity writing Dt(x,y)D_t(x,y)Dt​(x,y) as a forecast-weighted term plus a calibration error.
  5. Calibration makes the error term vanish.
  6. The weighted average of the forecasts at which player 1 plays xxx lies in Mb(x)M_b(x)Mb​(x).
  7. For a convergent subsequence Dti→DD_{t_i} \to DDti​​→D, every row of DDD with positive mass, normalized, lies in Mb(x)M_b(x)Mb​(x).
  8. Every subsequential limit of DtD_tDt​ is a correlated equilibrium.

Further result: matching pennies (p. 46)

With the constant forecast (1/2,1/2)(1/2, 1/2)(1/2,1/2) and the non-stationary tie-break "heads on even rounds, tails on odd rounds", both forecasts are calibrated and every play is a best reply, yet DtD_tDt​ does not approach π(G)\pi(G)π(G). The stationarity assumption cannot be dropped.

Significance

The result. Theorem 1 separates what learning needs from how it is achieved. Any forecasting procedure that is calibrated, combined with myopic best responses, yields correlated equilibrium behaviour in the long run. The paper's Theorem 3 constructs a randomized calibrated forecaster, so the theorem gives an uncoupled learning procedure for correlated equilibrium, one that needs no knowledge of the opponent's payoffs. The converse direction, that every correlated equilibrium arises this way for almost every game, is the paper's Theorem 2 (a separate mission of this series).

Formalizing it. The theorem is proved in the paper and has no machine-checked proof on Prove2Me or, to the knowledge of this mission, elsewhere. The platform's existing correlated-equilibrium results (the Algorithmic Game Theory swap-regret development, AGT.swap_regret_correlated_equilibrium) reach correlated equilibrium through swap regret of mixed strategies, a different hypothesis and a different object. This mission adds a formal notion of calibration and the convergence argument, both reusable for the paper's Theorems 2 and 3 and for later work on calibration and learning.

Difficulty

The obvious reading of calibration is that each player's forecast converges to the opponent's empirical distribution; if that held, best responses to it would give convergence. It does not hold. Calibration constrains the opponent's frequencies only conditionally on the forecast issued, and the forecasts need not converge at all. What must be shown is a statement about the conditional distributions of the joint play given each strategy of player 1, while the set of forecasts issued keeps growing. Rows of the limit with zero mass carry no conditional distribution. The "min → 0" form also asks for more than a property of limit points: it is a uniform statement about all large ttt.

Formalization scope

  • Strategies are Fin m and Fin n; payoffs are real matrices; forecasts are real vectors required to be probability vectors in every round.
  • A correlated equilibrium is the joint-distribution form of p. 44 (the correlated strategy on a finite probability space is represented by its law). It is the ε=0\varepsilon = 0ε=0, two-player, payoff (not cost) instance of the published AGT.IsCorrelatedEquilibrium, restated rather than imported.
  • The stationary deterministic tie-break is modelled by arbitrary best-reply functions RiR_iRi​ of the forecast. They do not depend on the round, and the statements quantify over all of them, which includes the lowest-index rule.
  • Forecasts are sequences fi:N→Rkf_i : \mathbb{N} \to \mathbb{R}^kfi​:N→Rk. The theorem uses only the realized forecasts, and every sequence is realized by a rule reading the round number from the history.
  • Rounds are indexed from 000: "the first ttt rounds" are 0,…,t−10, \dots, t-10,…,t−1. D0=0D_0 = 0D0​=0 by Lean's division convention; only t≥1t \ge 1t≥1 and limits are used.
  • The calibration sum runs over the forecasts issued in the first ttt rounds, which is the paper's sum over all ppp with its zero terms removed. ρ(p,j,t)=0\rho(p,j,t) = 0ρ(p,j,t)=0 when N(p,t)=0N(p,t) = 0N(p,t)=0, as on the page.
  • "min … → 0" is stated as: for every ε>0\varepsilon > 0ε>0, eventually some D∈π(G)D \in \pi(G)D∈π(G) is within ε\varepsilonε of DtD_tDt​ in every coordinate. The two forms are equivalent because π(G)\pi(G)π(G) is compact and nonempty. The formalization avoids an infimum over π(G)\pi(G)π(G), which Lean would evaluate to 000 on an empty set.
  • A statement that drops the best-reply property, the probability-vector condition on forecasts, or the stationarity of RiR_iRi​ is not Theorem 1: the matching pennies example shows the last one is essential. Swapping the calibration hypotheses (player 1's forecast calibrated against player 1's own plays) type-checks when m=nm = nm=n and is not the theorem.
  • Only the two-player case is claimed. The paper says the results "generalize easily to the nnn-person case" without proof.

Proofs of any milestone, and reusable lemmas about calibration scores and compactness of the simplex of joint distributions, are welcome.

Selected references

  • D. P. Foster, R. V. Vohra, Calibrated learning and correlated equilibrium, Games and Economic Behavior 21 (1997) 40–55. https://doi.org/10.1006/game.1997.0595
  • R. J. Aumann, Subjectivity and correlation in randomized strategies, Journal of Mathematical Economics 1 (1974) 67–96. https://doi.org/10.1016/0304-4068(74)90037-8
  • R. J. Aumann, Correlated equilibrium as an expression of Bayesian rationality, Econometrica 55 (1987) 1–18. https://doi.org/10.2307/1911154
  • A. P. Dawid, The well-calibrated Bayesian, Journal of the American Statistical Association 77 (1982) 605–610. https://doi.org/10.1080/01621459.1982.10477856
  • S. Hart, A. Mas-Colell, A simple adaptive procedure leading to correlated equilibrium, Econometrica 68 (2000) 1127–1150. https://doi.org/10.1111/1468-0262.00153
15 thms4 active usersReviewed
🏆Completed
Mechanism DesignOperations ResearchProbability·Captain: mikedeng1

Bargaining under Incomplete Information I: Class A Equilibrium Offer Strategies Satisfy the Linked Differential EquationsResearch Paper

Motivation

A buyer and a seller negotiate over a single indivisible good. Each knows how much the good is worth to them, but not how much it is worth to the other side. Whether the two will trade, and at what price, then depends on how each party shades its offer to exploit the other's uncertainty. Chatterjee and Samuelson (Bargaining under Incomplete Information, Operations Research 31(5), 1983) modelled this situation as a one-shot game in which both parties submit sealed offers simultaneously, and characterised its Bayesian equilibria.

The model became the standard reference point for bilateral trade with two-sided private information. Myerson and Satterthwaite (J. Econ. Theory 29, 1983) showed that no mechanism can guarantee efficient trade in this setting, and that the equilibrium of the Chatterjee–Samuelson game with k=1/2k = 1/2k=1/2 and uniform values attains the second-best efficiency bound. Later work on the kkk-double auction (Satterthwaite and Williams, J. Econ. Theory 48, 1989; Leininger, Linhart and Radner, J. Econ. Theory 48, 1989) studies the continuum of equilibria of exactly this game. The object of the present mission, a pair of linked differential equations, is the tool these papers use to construct and classify equilibria.

Setting

A seller has reservation price vs∈[v‾s,vˉs]v_s \in [\underline v_s, \bar v_s]vs​∈[v​s​,vˉs​] and a buyer has reservation price vb∈[v‾b,vˉb]v_b \in [\underline v_b, \bar v_b]vb​∈[v​b​,vˉb​]. Each knows their own value. The buyer's belief about vsv_svs​ is a probability measure μb\mu_bμb​ with distribution function FbF_bFb​; the seller's belief about vbv_bvb​ is μs\mu_sμs​ with distribution function FsF_sFs​. The subscript names the player who holds the belief, not the variable. Each belief is regular: F(v‾)=0F(\underline v) = 0F(v​)=0, F(vˉ)=1F(\bar v) = 1F(vˉ)=1, and FFF is strictly increasing and differentiable on the value interval, with density fbf_bfb​ (respectively fsf_sfs​).

Under the Bargaining Rule, the seller asks sss and the buyer offers bbb simultaneously. If b≥sb \ge sb≥s the good is sold at P=kb+(1−k)sP = kb + (1-k)sP=kb+(1−k)s for a fixed k∈[0,1]k \in [0, 1]k∈[0,1]; otherwise nothing happens. Profits are P−vsP - v_sP−vs​ for the seller and vb−Pv_b - Pvb​−P for the buyer on trade, and zero otherwise.

An offer strategy is a function SSS (for the seller) or BBB (for the buyer) from values to offers. Against SSS, a buyer with value vvv offering bbb earns in expectation

πb(b,v)=∫1{S(vs)≤b} (v−kb−(1−k)S(vs)) dμb(vs),\pi_b(b, v) = \int \mathbf 1\{S(v_s) \le b\}\,\bigl(v - kb - (1-k)S(v_s)\bigr)\,d\mu_b(v_s),πb​(b,v)=∫1{S(vs​)≤b}(v−kb−(1−k)S(vs​))dμb​(vs​),

and symmetrically πs(s,v)=∫1{s≤B(vb)} (kB(vb)+(1−k)s−v) dμs(vb)\pi_s(s, v) = \int \mathbf 1\{s \le B(v_b)\}\,(kB(v_b) + (1-k)s - v)\,d\mu_s(v_b)πs​(s,v)=∫1{s≤B(vb​)}(kB(vb​)+(1−k)s−v)dμs​(vb​). The pair (S,B)(S, B)(S,B) is an equilibrium if B(v)B(v)B(v) maximises πb(⋅,v)\pi_b(\cdot, v)πb​(⋅,v) over all real offers for every buyer value vvv, and S(v)S(v)S(v) maximises πs(⋅,v)\pi_s(\cdot, v)πs​(⋅,v) for every seller value vvv.

A strategy is of class AAA if its offers are bounded, it is nondecreasing, it is strictly increasing except where it sits at its lowest offer mmm or its highest offer MMM, and it is differentiable wherever its offer lies strictly between mmm and MMM. A class AAA equilibrium is an equilibrium in which both strategies are of class AAA.

Formalization targets

Goal: Theorem 2, the linked differential equations

In a class AAA equilibrium, wherever the seller's strategy is strictly increasing around yyy and the buyer value xxx offers B(x)=S(y)B(x) = S(y)B(x)=S(y),

kFb(y)S′(y)+fb(y)S(y)=x fb(y),(3a)k F_b(y) S'(y) + f_b(y) S(y) = x\, f_b(y), \tag{3a}kFb​(y)S′(y)+fb​(y)S(y)=xfb​(y),(3a)

and wherever the buyer's strategy is strictly increasing around xxx and the seller value yyy asks S(y)=B(x)S(y) = B(x)S(y)=B(x),

(1−k)(1−Fs(x))B′(x)−fs(x)B(x)=− y fs(x).(3b)(1-k)\bigl(1 - F_s(x)\bigr) B'(x) - f_s(x) B(x) = -\,y\, f_s(x). \tag{3b}(1−k)(1−Fs​(x))B′(x)−fs​(x)B(x)=−yfs​(x).(3b)

The paper writes x=B−1(S(y))x = B^{-1}(S(y))x=B−1(S(y)) in (3a) and y=S−1(B(x))y = S^{-1}(B(x))y=S−1(B(x)) in (3b).

Milestones: the displays of the proof

  1. Gb(S(y))=Fb(y)G_b(S(y)) = F_b(y)Gb​(S(y))=Fb​(y): the buyer's probability that the seller asks at most S(y)S(y)S(y) equals Fb(y)F_b(y)Fb​(y).
  2. The buyer's first-order condition: ∂πb/∂b=(v−b)gb(b)−kGb(b)\partial \pi_b / \partial b = (v - b) g_b(b) - k G_b(b)∂πb​/∂b=(v−b)gb​(b)−kGb​(b) at b=S(y)b = S(y)b=S(y), with offer density gb(S(y))=fb(y)/S′(y)g_b(S(y)) = f_b(y)/S'(y)gb​(S(y))=fb​(y)/S′(y), and it vanishes at an equilibrium offer.
  3. The seller's first-order condition: ∂πs/∂s=(v−s)gs(s)+(1−k)(1−Gs(s))\partial \pi_s / \partial s = (v - s) g_s(s) + (1-k)(1 - G_s(s))∂πs​/∂s=(v−s)gs​(s)+(1−k)(1−Gs​(s)) at s=B(x)s = B(x)s=B(x), and it vanishes at an equilibrium ask.

The milestones assume S′(y)>0S'(y) > 0S′(y)>0 (respectively B′(x)>0B'(x) > 0B′(x)>0), which the paper's formula for the offer density needs. The goal does not assume it.

Significance

Theorem 2 reduces the search for equilibria to the analysis of a pair of ordinary differential equations. Every explicit equilibrium in the paper and in the later kkk-double-auction literature is found as a solution of (3a)–(3b) with suitable boundary conditions: the linear equilibrium for uniform beliefs (the paper's Example 1), the one-parameter families of Satterthwaite–Williams, and the non-linear equilibria of Leininger–Linhart–Radner. The equations also expose how the split parameter kkk distributes bargaining power: at k=1k = 1k=1 equation (3b) forces the seller to ask their own value, and at k=0k = 0k=0 equation (3a) forces the buyer to bid theirs.

The result is proved in the paper. To the best of a search of the platform, no formalization of it or of the bargaining model exists. This mission produces a machine-checked version of the necessary conditions. Its definitions of beliefs, expected profits, equilibrium and class AAA are also the basis for companion missions on the uniform linear equilibrium and its trade probability.

Difficulty

The paper's proof is four lines: differentiate the expected profit, set the derivative to zero, substitute. Three steps of that argument do not survive a careful reading.

First, the paper differentiates under an offer density gbg_bgb​ that exists only if SSS is strictly increasing and has a positive derivative. Class AAA allows SSS to be flat at its bounds, to jump between them, and to have zero derivative. The formal goal assumes none of this. It must handle the case S′(y)=0S'(y) = 0S′(y)=0, where the offer distribution has an infinite density at S(y)S(y)S(y) and the first-order condition becomes a one-sided argument.

Second, identifying Gb(S(y))G_b(S(y))Gb​(S(y)) with Fb(y)F_b(y)Fb​(y) requires that no seller value outside a neighbourhood of yyy makes the same offer. That is a global statement about SSS, and it is where monotonicity on the whole interval and the "flat only at the bounds" clause of class AAA enter.

Third, the first-order condition needs the equilibrium offer S(y)S(y)S(y) to be an interior maximiser of a function of bbb that is differentiable there. The profit πb\pi_bπb​ is an integral over the belief, and its differentiability at S(y)S(y)S(y) must be derived from the differentiability of SSS at the single point yyy and of FbF_bFb​. Neither SSS nor πb\pi_bπb​ is assumed continuous elsewhere.

Formalization scope

Values, offers and kkk are real numbers. Beliefs are probability measures on R\mathbb RR, with distribution function Mathlib's ProbabilityTheory.cdf. Expected profits are Bochner integrals over the opponent's value, not over an offer density. The two agree whenever the density exists, and the integral form needs none. Integrability is not assumed: for a class AAA strategy and a regular belief supported on the value interval, the integrand is bounded and almost everywhere measurable. Ties (b=sb = sb=s) trade. Deviations range over all real offers. Strategies are arbitrary functions R→R\mathbb R \to \mathbb RR→R whose values outside the value interval play no role.

The derivative S′(y)S'(y)S′(y) is deriv S y. The paper's inverses B−1B^{-1}B−1 and S−1S^{-1}S−1 are not introduced as functions. The matching value is a universally quantified variable xxx with B(x)=S(y)B(x) = S(y)B(x)=S(y), so no junk value of an inverse can make an equation true or false. The equations are asserted only at values yyy interior to an open subinterval on which SSS is strictly increasing. A formalization that assumed the first-order condition, or restricted to strategies with S′>0S' > 0S′>0 everywhere, would be a different and weaker theorem.

A complete development needs: differentiation of parametric integrals of indicator type (the derivative of b↦∫1{S≤b} h dμb \mapsto \int \mathbf 1\{S \le b\}\,h\,d\mub↦∫1{S≤b}hdμ), the change of variables from values to offers under a strictly increasing strategy, and Fermat's rule (IsLocalMax.hasDerivAt_eq_zero). The first two are reusable for auctions and other Bayesian games with monotone strategies. Proofs of the milestones, alternative proofs of the goal, and general lemmas about monotone strategies are welcome.

Selected references

  • K. Chatterjee and W. Samuelson, Bargaining under Incomplete Information, Operations Research 31(5):835–851, 1983. https://doi.org/10.1287/opre.31.5.835
  • R. B. Myerson and M. A. Satterthwaite, Efficient Mechanisms for Bilateral Trading, Journal of Economic Theory 29(2):265–281, 1983. https://doi.org/10.1016/0022-0531(83)90048-0
  • M. A. Satterthwaite and S. R. Williams, Bilateral Trade with the Sealed Bid k-Double Auction: Existence and Efficiency, Journal of Economic Theory 48(1):107–133, 1989. https://doi.org/10.1016/0022-0531(89)90120-8
  • W. Leininger, P. B. Linhart and R. Radner, Equilibria of the Sealed-Bid Mechanism for Bargaining with Incomplete Information, Journal of Economic Theory 48(1):63–106, 1989. https://doi.org/10.1016/0022-0531(89)90121-X
9 thms4 active usersReviewed
PreviousPage 1 of 8Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me