Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Algorithmic Game Theory

425 missions · 177 completed

Missions

Open248Completed177All425
EconomicsOperations Research·Captain: mikedeng1

Fair and Consistent Prize Allocation in Competitions 3: Anonymity, Order Preservation, Winner Strict Endowment Monotonicity and Top Consistency Characterize Parametric RulesResearch Paper

Motivation

Rank-order competitions — sports tournaments, poker final tables, golf tours, crowdsourcing contests, sales leagues — end with a ranking of the participants and a pot of prize money that has to be split according to that ranking. Organisers publish prize tables that change with the number of entrants and with the size of the purse, and these tables are usually justified only by tradition. Dietzenbacher and Kondratev (arXiv:2008.08985v2, published in Management Science 2023, doi:10.1287/mnsc.2022.4520) take the axiomatic approach of fair-division theory and ask which prize allocation rules are characterised by natural requirements of fairness and coherence across competitions of different sizes.

Consistency — invariance of a rule under "re-running the allocation" for a subgroup with the money it collectively received — has a long history in axiomatic allocation: bankruptcy problems (Aumann and Maschler 1985), taxation (Young 1987), bargaining (Lensberg 1987, 1988) and cooperative games (Peleg 1986; Hart and Mas-Colell 1989). The paper applies it to competitions. Full consistency together with order preservation and endowment monotonicity yields the interval rules (Theorem 1); weakening consistency to local consistency yields the single-parametric rules (Theorem 2). This mission concerns the weakest version, top consistency, which only constrains the top segment of the ranking and describes real prize schemes such as the golf tournament of Table 1(b) of the paper. It is the third mission of a series on this paper; the first two treat Theorems 1 and 2.

Setting

Fix a countable set UUU of at least three potential competitors. A competition (N,R,E)(N,\mathcal R,E)(N,R,E) consists of a finite nonempty set N⊆UN\subseteq UN⊆U, a ranking R:N→{1,…,∣N∣}\mathcal R:N\to\{1,\dots,|N|\}R:N→{1,…,∣N∣} (a bijection; competitor iii is ranked above jjj when R(i)<R(j)\mathcal R(i)<\mathcal R(j)R(i)<R(j)), and a prize endowment E≥0E\ge0E≥0. For S⊆NS\subseteq NS⊆N the subranking RS:S→{1,…,∣S∣}\mathcal R_S:S\to\{1,\dots,|S|\}RS​:S→{1,…,∣S∣} orders SSS as R\mathcal RR does.

A prize allocation rule φ\varphiφ assigns to each competition a vector φ(N,R,E)∈R+N\varphi(N,\mathcal R,E)\in\mathbb R_+^Nφ(N,R,E)∈R+N​ with ∑i∈Nφi(N,R,E)=E\sum_{i\in N}\varphi_i(N,\mathcal R,E)=E∑i∈N​φi​(N,R,E)=E. The axioms are:

  • anonymity: φi(N,R,E)=φj(N′,R′,E)\varphi_i(N,\mathcal R,E)=\varphi_j(N',\mathcal R',E)φi​(N,R,E)=φj​(N′,R′,E) whenever ∣N∣=∣N′∣|N|=|N'|∣N∣=∣N′∣ and R(i)=R′(j)\mathcal R(i)=\mathcal R'(j)R(i)=R′(j);
  • order preservation: R(i)<R(j)\mathcal R(i)<\mathcal R(j)R(i)<R(j) implies φi≥φj\varphi_i\ge\varphi_jφi​≥φj​;
  • winner strict endowment monotonicity: if E<E′E<E'E<E′ then φi(N,R,E)≤φi(N,R,E′)\varphi_i(N,\mathcal R,E)\le\varphi_i(N,\mathcal R,E')φi​(N,R,E)≤φi​(N,R,E′) for all iii, strictly for the winner R(i)=1\mathcal R(i)=1R(i)=1;
  • top consistency: for each S⊆NS\subseteq NS⊆N with R(i)≤∣S∣\mathcal R(i)\le|S|R(i)≤∣S∣ for every i∈Si\in Si∈S, and each i∈Si\in Si∈S,
φi(N,R,E)=φi(S,RS,∑j∈Sφj(N,R,E)).\varphi_i(N,\mathcal R,E)=\varphi_i\Big(S,\mathcal R_S,\sum_{j\in S}\varphi_j(N,\mathcal R,E)\Big).φi​(N,R,E)=φi​(S,RS​,j∈S∑​φj​(N,R,E)).

A rule is parametric if there are continuous non-decreasing f1,f2,⋯:R+→R+f_1,f_2,\dots:\mathbb R_+\to\mathbb R_+f1​,f2​,⋯:R+​→R+​ with f1(x)=xf_1(x)=xf1​(x)=x and fk+1(x)≤fk(x)f_{k+1}(x)\le f_k(x)fk+1​(x)≤fk​(x) such that φi(N,R,E)=fR(i)(x)\varphi_i(N,\mathcal R,E)=f_{\mathcal R(i)}(x)φi​(N,R,E)=fR(i)​(x), where x≥0x\ge0x≥0 solves ∑k=1∣N∣fk(x)=E\sum_{k=1}^{|N|}f_k(x)=E∑k=1∣N∣​fk​(x)=E. The winner gets xxx and position kkk gets fk(x)f_k(x)fk​(x). Equal Division (fk(x)=xf_k(x)=xfk​(x)=x) and Winner-Takes-All (fk=0f_k=0fk​=0 for k≥2k\ge2k≥2) are parametric.

Formalization targets

Goal: Theorem 3 (p. 22)

φ is anonymous, order preserving, winner strictly endowment monotonic and top consistent  ⟺  φ is a parametric rule.\varphi \text{ is anonymous, order preserving, winner strictly endowment monotonic and top consistent}\iff\varphi\text{ is a parametric rule.}φ is anonymous, order preserving, winner strictly endowment monotonic and top consistent⟺φ is a parametric rule.

Both directions are part of the goal.

Milestones (proof of Theorem 3, pp. 32–33)

  1. Every parametric rule satisfies the four axioms (the "readily checked" direction).
  2. Under order preservation, endowment continuity and winner strict endowment monotonicity, the winner's prize E↦φ1(N,R,E)E\mapsto\varphi_1(N,\mathcal R,E)E↦φ1​(N,R,E) is strictly increasing, continuous and unbounded on R+\mathbb R_+R+​, so each x≥0x\ge0x≥0 is the winner's prize for exactly one EEE.
  3. The induction step: a representation f1,…,fnf_1,\dots,f_nf1​,…,fn​ valid on all competitions with at most nnn competitors extends, by a new continuous non-decreasing fn+1≤fnf_{n+1}\le f_nfn+1​≤fn​, to all competitions with n+1n+1n+1 competitors.

Lemma 1 of the paper (endowment monotonicity implies endowment continuity, p. 10) is used in the proof; it is formalized in the first mission of this series and will be referenced from there.

Companion: Corollary 8 (p. 22)

Replacing winner strict endowment monotonicity by endowment additivity (equivalently scale invariance) characterises the proportional rules φi=λR(i)E/∑k≤∣N∣λk\varphi_i=\lambda_{\mathcal R(i)}E/\sum_{k\le|N|}\lambda_kφi​=λR(i)​E/∑k≤∣N∣​λk​ with λ1>0\lambda_1>0λ1​>0 and λk+1≤λk\lambda_{k+1}\le\lambda_kλk+1​≤λk​.

Significance

Theorem 3 says that the four axioms leave exactly one degree of freedom per position: a monotone function of the winner's prize. This gives organisers a complete menu of prize schemes that are fair in the anonymous, order-preserving sense and that keep the top of the table unchanged when lower-ranked entrants leave — the property that matters when competitors are eliminated one at a time and paid at the moment of elimination. It contains the single-parametric rules of Theorem 2, the Winner-Takes-Surplus rules, the geometric rules and the proportional rules (Corollary 8) as special cases, and the paper shows in a Remark (p. 33) that the four axioms are logically independent.

The theorem is proved in the paper; to our knowledge no part of it has been machine-checked. The formalization adds a reusable layer for variable-population allocation problems — rankings of finite subsets of a fixed universe, subrankings, and consistency axioms restricted to families of subsets — that is not in Mathlib. Formal proofs of both directions, of the milestones, and of Corollary 8 are all welcome.

Difficulty

The "if" direction is a computation, but it requires showing that the parameter xxx is well defined and moves monotonically with EEE, which uses f1(x)=xf_1(x)=xf1​(x)=x and the intermediate value theorem. The "only if" direction must construct the functions fkf_kfk​ from an abstract rule. The natural first idea — define fk(x)f_k(x)fk​(x) as the prize of position kkk when the winner receives xxx — needs the winner's prize to be invertible as a function of EEE, which uses continuity (supplied by Lemma 1, not assumed), strict monotonicity only for the winner, and unboundedness, which comes from order preservation together with exhaustion of the endowment. Top consistency then has to transfer the representation from competitions of size nnn to size n+1n+1n+1, and anonymity has to transfer it from one ranked set to every other one of the same size; the induction over the number of competitors must keep all smaller sizes, since top consistency reduces to every top segment.

Formalization scope

  • A ranked set (N,R)(N,\mathcal R)(N,R) is a duplicate-free nonempty List U, best competitor first; R(i)\mathcal R(i)R(i) is the 1-based index pos l i, and RS\mathcal R_SRS​ is the sublist of entries in SSS. UUU is an arbitrary type with decidable equality; the paper's standing assumptions (countable, at least three elements) are hypotheses of the goal and of Corollary 8, and are omitted from milestones that do not use them.
  • A rule is a function φ : List U → ℝ → U → ℝ; it is required to be a prize allocation rule (nonnegative prizes summing to EEE) on rankings and E≥0E\ge0E≥0, and every axiom quantifies only over that domain. Endowments are reals with E≥0E\ge0E≥0.
  • The representation f1,f2,…f_1,f_2,\dotsf1​,f2​,… is f : ℕ → ℝ → ℝ, indexed from 1 as on the page (f0f_0f0​ unused); continuity, monotonicity, nonnegativity and f1(x)=xf_1(x)=xf1​(x)=x are required on [0,∞)[0,\infty)[0,∞). The parameter xxx is given existentially; it is unique, so this is the page's "where x∈R+x\in\mathbb R_+x∈R+​ is such that".
  • Endowment continuity is coordinatewise continuity on [0,∞)[0,\infty)[0,∞).

Trivializing formalizations are ruled out: rules act on every finite ranked subset of UUU, not on a fixed competitor set; top consistency quantifies over exactly the top segments (full or local consistency would change the theorem — the rule of Example 6 is parametric but not locally consistent); the goal is a biconditional; the parametric family includes f1=idf_1=\mathrm{id}f1​=id, the decreasing chain fk+1≤fkf_{k+1}\le f_kfk+1​≤fk​, and continuity of every fkf_kfk​.

Corollary 7 of the paper is not included: its "only if" parts ("for each kkk") fail as written when UUU is finite, since fkf_kfk​ for k>∣U∣k>|U|k>∣U∣ is not determined by the rule.

Selected references

  • B. J. Dietzenbacher and A. Y. Kondratev, Fair and Consistent Prize Allocation in Competitions, arXiv:2008.08985v2, 2021; Management Science, 2023. https://arxiv.org/abs/2008.08985v2, https://doi.org/10.1287/mnsc.2022.4520
  • R. J. Aumann and M. Maschler, Game theoretic analysis of a bankruptcy problem from the Talmud, Journal of Economic Theory 36(2):195–213, 1985. https://doi.org/10.1016/0022-0531(85)90102-4
  • S. Hart and A. Mas-Colell, Potential, value, and consistency, Econometrica 57(3):589–614, 1989. https://doi.org/10.2307/1911054
8 thms2 active usersReviewed
EconomicsOperations Research·Captain: mikedeng1

Fair and Consistent Prize Allocation in Competitions 1: A Prize Allocation Rule Satisfies Order Preservation, Endowment Monotonicity and Consistency iff It Is an Interval RuleResearch Paper

Motivation

Sports leagues, tournaments, esports events and research competitions all end with a ranking of the participants and a sum of prize money to divide among them. How the money is split according to the ranking is a design choice with visible consequences: Winner-Takes-All schemes reward only the top, equal division ignores the ranking, and most real prize schedules sit in between. The economics of tournaments has studied prize structures as incentive devices, but it has not asked which schedules follow from principles of fairness and coherence.

Dietzenbacher and Kondratev (arXiv:2008.08985, Management Science 2023) take the axiomatic approach of fair allocation theory to this question. The central axiom is consistency, the variable-population principle that has characterized solutions in bankruptcy, taxation, bargaining and cooperative games (Aumann and Maschler 1985; Young 1987; Lensberg 1988; Thomson 1988; Hart and Mas-Colell 1989): if any subgroup of competitors pools its prizes and re-divides them among themselves by the same rule, nobody's prize changes. This mission formalizes the paper's first main result, which identifies exactly the rules that are consistent, weakly respect the ranking, and never take money away when the endowment grows.

Setting

Let UUU be a countable set of at least three potential competitors. A competition is a triple (N,R,E)(N, \mathcal R, E)(N,R,E): a nonempty finite set N⊆UN \subseteq UN⊆U, a ranking R:N→{1,…,∣N∣}\mathcal R : N \to \{1, \dots, |N|\}R:N→{1,…,∣N∣} (a bijection; iii is ranked above jjj if R(i)<R(j)\mathcal R(i) < \mathcal R(j)R(i)<R(j)), and a prize endowment E≥0E \ge 0E≥0. For a nonempty S⊆NS \subseteq NS⊆N, the subranking RS\mathcal R_SRS​ lists SSS in the order of R\mathcal RR.

A prize allocation rule φ\varphiφ assigns to every competition an allocation φ(N,R,E)∈R+N\varphi(N, \mathcal R, E) \in \mathbb R^N_+φ(N,R,E)∈R+N​ with ∑i∈Nφi(N,R,E)=E\sum_{i \in N} \varphi_i(N, \mathcal R, E) = E∑i∈N​φi​(N,R,E)=E. Two basic rules are Equal Division, EDi=E/∣N∣\mathrm{ED}_i = E/|N|EDi​=E/∣N∣, and Winner-Takes-All, WTAi=E\mathrm{WTA}_i = EWTAi​=E if R(i)=1\mathcal R(i) = 1R(i)=1 and 000 otherwise.

The axioms of the main theorem are, for every competition and i,j∈Ni, j \in Ni,j∈N:

  • order preservation: R(i)<R(j)⇒φi(N,R,E)≥φj(N,R,E)\mathcal R(i) < \mathcal R(j) \Rightarrow \varphi_i(N, \mathcal R, E) \ge \varphi_j(N, \mathcal R, E)R(i)<R(j)⇒φi​(N,R,E)≥φj​(N,R,E);
  • endowment monotonicity: E<E′⇒φi(N,R,E)≤φi(N,R,E′)E < E' \Rightarrow \varphi_i(N, \mathcal R, E) \le \varphi_i(N, \mathcal R, E')E<E′⇒φi​(N,R,E)≤φi​(N,R,E′);
  • consistency: for every nonempty S⊆NS \subseteq NS⊆N and i∈Si \in Si∈S,
φi(N,R,E)=φi(S,RS,∑j∈Sφj(N,R,E)).\varphi_i(N, \mathcal R, E) = \varphi_i\Big(S, \mathcal R_S, \sum_{j \in S} \varphi_j(N, \mathcal R, E)\Big).φi​(N,R,E)=φi​(S,RS​,j∈S∑​φj​(N,R,E)).

Anonymity (prizes depend only on ∣N∣|N|∣N∣, the position and EEE) and endowment continuity are auxiliary properties.

An interval rule is given by pairwise disjoint open intervals (ak,bk)(a_k, b_k)(ak​,bk​), k=1,2,…k = 1, 2, \dotsk=1,2,…, with ak∈R+a_k \in \mathbb R_+ak​∈R+​ and bk∈R+∪{+∞}b_k \in \mathbb R_+ \cup \{+\infty\}bk​∈R+​∪{+∞}. With n=∣N∣n = |N|n=∣N∣ and r=R(i)r = \mathcal R(i)r=R(i),

φi(N,R,E)={akif nak≤E≤(n−r+1)ak+(r−1)bk;E−(n−r)ak−(r−1)bkif (n−r+1)ak+(r−1)bk≤E≤(n−r)ak+rbk;bkif (n−r)ak+rbk≤E≤nbk;E/notherwise.\varphi_i(N, \mathcal R, E) = \begin{cases} a_k & \text{if } n a_k \le E \le (n - r + 1) a_k + (r - 1) b_k; \\ E - (n - r) a_k - (r - 1) b_k & \text{if } (n - r + 1) a_k + (r - 1) b_k \le E \le (n - r) a_k + r b_k; \\ b_k & \text{if } (n - r) a_k + r b_k \le E \le n b_k; \\ E / n & \text{otherwise.} \end{cases}φi​(N,R,E)=⎩⎨⎧​ak​E−(n−r)ak​−(r−1)bk​bk​E/n​if nak​≤E≤(n−r+1)ak​+(r−1)bk​;if (n−r+1)ak​+(r−1)bk​≤E≤(n−r)ak​+rbk​;if (n−r)ak​+rbk​≤E≤nbk​;otherwise.​

At endowment nakn a_knak​ everyone receives aka_kak​; as EEE grows, prizes are raised to bkb_kbk​ one competitor at a time from the top; when E/nE/nE/n lies in no [ak,bk][a_k, b_k][ak​,bk​] the endowment is divided equally. ED has ak=bk=0a_k = b_k = 0ak​=bk​=0; WTA has a1=0a_1 = 0a1​=0, b1=+∞b_1 = +\inftyb1​=+∞.

Formalization targets

Goal: Theorem 1 (p. 13)

φ satisfies order preservation, endowment monotonicity and consistency  ⟺  φ is an interval rule.\varphi \text{ satisfies order preservation, endowment monotonicity and consistency} \iff \varphi \text{ is an interval rule.}φ satisfies order preservation, endowment monotonicity and consistency⟺φ is an interval rule.

Both directions are part of the goal.

Milestones, in the order the proof uses them

  1. Lemma 1 (p. 10): endowment monotonicity implies endowment continuity.
  2. Lemma 2 (p. 11): order preservation, endowment monotonicity and consistency imply anonymity.
  3. Lemma 3 (p. 11): two endowment monotonic, consistent rules that agree on all two-competitor competitions agree on all competitions.
  4. The "if" direction (p. 28): every interval rule satisfies the three axioms.
  5. Step 1 (p. 28): for two competitors, if φ(N,R,x1+x2)=(x1,x2)\varphi(N, \mathcal R, x_1 + x_2) = (x_1, x_2)φ(N,R,x1​+x2​)=(x1​,x2​) then φ(N,R,2x1)=(x1,x1)\varphi(N, \mathcal R, 2x_1) = (x_1, x_1)φ(N,R,2x1​)=(x1​,x1​) or φ(N,R,2x2)=(x2,x2)\varphi(N, \mathcal R, 2x_2) = (x_2, x_2)φ(N,R,2x2​)=(x2​,x2​).
  6. Step 2 (p. 29): the two-competitor restriction has the interval form (9),
φ(N,R,E)=(E−ak,ak) on [2ak,ak+bk],(bk,E−bk) on [ak+bk,2bk],(E/2,E/2) otherwise.\varphi(N, \mathcal R, E) = (E - a_k, a_k) \text{ on } [2a_k, a_k + b_k], \quad (b_k, E - b_k) \text{ on } [a_k + b_k, 2b_k], \quad (E/2, E/2) \text{ otherwise.}φ(N,R,E)=(E−ak​,ak​) on [2ak​,ak​+bk​],(bk​,E−bk​) on [ak​+bk​,2bk​],(E/2,E/2) otherwise.

Further statements of §2.3

Lemma 4 (endowment additivity ⇔ scale invariance) and Corollaries 1–4, which single out WTA (winner-loser strict order preservation), ED (strict endowment monotonicity), the Winner-Takes-Surplus rules (winner strict endowment monotonicity) and the pair {ED, WTA} (additivity) inside the family of Theorem 1, are included as supporting theorems.

Significance

Theorem 1 replaces three qualitative requirements by an explicit, countably parametrized family. The family is broad (Equal Division, Winner-Takes-All, the "dollar at a time" rule of Example 1, and their concatenations along the endowment axis), so the theorem is the starting point for every sharper characterization in the paper: strengthening one axiom at a time selects WTA, ED or a Winner-Takes-Surplus rule (Corollaries 1–4), and the second and third missions of this series replace consistency by its local and top variants to obtain the single-parametric and parametric rules. Lemma 3 also isolates a general principle: a monotone consistent rule is determined by its behaviour on pairs.

On the formal side, Mathlib and the platform have no model of variable-population allocation with rankings. This mission provides one (competitions over a universe, subrankings, prize allocation rules and the consistency family of axioms) together with the first machine-checkable statement of a characterization theorem in this area. The paper's proofs are complete; nothing here is open mathematics, and none of it has been formalized before.

Difficulty

Consistency only constrains the rule across competitions; on its own it says nothing about how two competitors share a given endowment. The obvious plan, to read the intervals off the two-competitor allocation path and extend by Lemma 3, fails at the first step: an order preserving, monotone two-competitor path need not be a staircase of horizontal and vertical segments, and nothing about two competitors alone forces it to be. The staircase shape (Step 1) is a genuinely multi-competitor phenomenon that also relies on anonymity, which is not assumed and must be derived (Lemma 2, a six-case analysis over how two competitions share competitors). The countable family of intervals then has to be extracted from the path (Step 2), including endpoints at +∞+\infty+∞ and the gaps where the rule is equal division.

Formalization scope

A ranked set (N,R)(N, \mathcal R)(N,R) is a duplicate-free nonempty List U, best first; ∣N∣|N|∣N∣ is its length and R(i)\mathcal R(i)R(i) = pos l i, the 1-based index. The subranking is the sublist of members of SSS. A rule is a function φ : List U → ℝ → U → ℝ; its values on non-rankings, negative endowments and non-members are irrelevant, and every axiom and the interval-rule definition quantify only over rankings, E≥0E \ge 0E≥0 and i∈Ni \in Ni∈N. The standing assumption on UUU is carried as [Countable U] plus three distinct elements on every statement whose proof needs a third competitor (Lemma 2, Steps 1–2, Theorem 1, Corollaries 1–4); it is unnecessary for Lemmas 1, 3, 4 and for the "if" direction. Interval endpoints bkb_kbk​ are extended reals (EReal), the intervals are indexed by N\mathbb NN (finitely many intervals are padded with ak=bk=0a_k = b_k = 0ak​=bk​=0), ak≤bka_k \le b_kak​≤bk​, and disjointness is of the open intervals. The four cases are implications; "otherwise" means E∉[nak,nbk]E \notin [n a_k, n b_k]E∈/[nak​,nbk​] for every kkk.

The following formalizations would trivialize or change the theorem and are ruled out: a fixed competitor set or a finite UUU of size two (consistency then has no reduced competitions to act on, and Corollary 1(i) fails); consistency restricted to two-element subsets or to some subsets only; a one-directional goal; interval rules without +∞+\infty+∞ endpoints (which excludes WTA and makes the "only if" direction false); and anonymity as an extra hypothesis.

The definitions are reusable by the two companion missions of this series (local and top consistency), which use the same model. Contributions welcome: proofs of the milestones, a general lemma that consistent monotone rules are determined by pairs, and proofs that ED, WTA and the Example 1 rule are interval rules.

Selected references

  • B. J. Dietzenbacher and A. Y. Kondratev, Fair and Consistent Prize Allocation in Competitions, arXiv:2008.08985v2, 2021; Management Science 69 (2023). https://arxiv.org/abs/2008.08985, https://doi.org/10.1287/mnsc.2022.4520
  • R. J. Aumann and M. Maschler, Game theoretic analysis of a bankruptcy problem from the Talmud, Journal of Economic Theory 36 (1985), 195–213. https://doi.org/10.1016/0022-0531(85)90102-4
  • W. Thomson, A study of choice correspondences in economies with a variable number of agents, Journal of Economic Theory 46 (1988), 237–254. https://doi.org/10.1016/0022-0531(88)90131-7
  • T. Lensberg, Stability and the Nash solution, Journal of Economic Theory 45 (1988), 330–341. https://doi.org/10.1016/0022-0531(88)90274-8
  • S. Hart and A. Mas-Colell, Potential, value, and consistency, Econometrica 57 (1989), 589–614. https://doi.org/10.2307/1911054
9 thms2 active usersReviewed
EconomicsOperations ResearchProbability·Captain: mikedeng1

Economics of Permissioned Blockchain Adoption I: Blockchain Adoption Raises Total Welfare for Large Horizontal Differentiation Yet Is Not an EquilibriumResearch Paper

Why blockchain adoption in supply chains is an economic question

A permissioned blockchain is a shared ledger that only invited parties may write to. In supply chains it is promoted as a way to make the provenance and quality of goods verifiable by the end consumer: a manufacturer who joins records how a good was produced, and consumers can read that record. Joining is costly, and the parties who pay the cost are not the parties who benefit most from the information. Whether such a technology is adopted at all is therefore a question about incentives, not engineering.

G. Iyengar, F. Saleh, J. Sethuraman and W. Wang, Economics of Permissioned Blockchain Adoption (SSRN 3602376; Management Science, 2023, DOI 10.1287/mnsc.2022.4532), build a stylised supply chain with vendors, price-competing manufacturers and consumers with an outside option, and show that welfare-improving adoption can fail to arise in equilibrium. This mission formalizes the first of the paper's two main results, Proposition 4.8, together with the welfare comparisons it rests on. A companion mission formalizes the second, the self-financing transfers of Proposition 4.9.

The supply chain

There are two vendors, of high and low quality h>l≥0h > l \ge 0h>l≥0, and a set MMM of 4m4m4m manufacturers, m≥2m \ge 2m≥2 of each type (qi,ξi)∈{A,B}×{h,l}(q_i,\xi_i) \in \{A,B\}\times\{h,l\}(qi​,ξi​)∈{A,B}×{h,l}. A consumer of horizontal type tkt_ktk​ obtains utility HHH from a good with qi=tkq_i = t_kqi​=tk​ and LLL otherwise, plus the vertical utility ξi\xi_iξi​; here 0≤L<H0 \le L < H0≤L<H, and Δ:=H−L>0\Delta := H - L > 0Δ:=H−L>0 measures horizontal differentiation. Consumers can always take an outside option φk\varphi_kφk​, drawn from a continuous distribution GGG supported on [0,∞)[0,\infty)[0,∞). The high type vendor produces at cost ch(x)=γxc_h(x) = \gamma xch​(x)=γx, γ>0\gamma > 0γ>0; the low type vendor at a strictly increasing convex cost clc_lcl​ with cl(0)=0c_l(0)=0cl​(0)=0 and strictly increasing derivative cl′c_l'cl′​ (Assumption 1, items 1–2).

Manufacturer iii may join the blockchain at cost χi>0\chi_i > 0χi​>0 (ai=1a_i = 1ai​=1) or not (ai=0a_i = 0ai​=0). Three scenarios are compared: full adoption FFF (all adopt), partial adoption PPP (exactly the high type manufacturers adopt) and non-adoption NNN. The paper's Proposition A.1 gives each scenario's equilibrium in closed form: every consumer's best manufacturer offers utility

uF=uP=H+h−γ,uN=H+L+h+l2−γ,u^F = u^P = H + h - \gamma,\qquad u^N = \tfrac{H+L+h+l}{2} - \gamma,uF=uP=H+h−γ,uN=2H+L+h+l​−γ,

the low type vendor price is ΨlF=max⁡{γ−(h−l),0}\Psi^F_l = \max\{\gamma-(h-l),0\}ΨlF​=max{γ−(h−l),0}, ΨlP=max⁡{γ−(h−l)−H−L2,0}\Psi^P_l = \max\{\gamma-(h-l)-\frac{H-L}{2},0\}ΨlP​=max{γ−(h−l)−2H−L​,0}, ΨlN=γ\Psi^N_l = \gammaΨlN​=γ (the high type price is always γ\gammaγ), the low type market shares are slF=(cl′)−1(γ−(h−l))s^F_l = (c_l')^{-1}(\gamma-(h-l))slF​=(cl′​)−1(γ−(h−l)), slP=(cl′)−1(γ−(h−l)−H−L2)s^P_l = (c_l')^{-1}(\gamma-(h-l)-\frac{H-L}{2})slP​=(cl′​)−1(γ−(h−l)−2H−L​), slN=(cl′)−1(γ)s^N_l = (c_l')^{-1}(\gamma)slN​=(cl′​)−1(γ), and shX=G(uX)−slXs^X_h = G(u^X) - s^X_lshX​=G(uX)−slX​. Manufacturers earn zero gross profit Π\PiΠ in every scenario because of price competition.

Welfare in scenario XXX is the sum WX=WVX+WMX+WCXW^X = W^X_V + W^X_M + W^X_CWX=WVX​+WMX​+WCX​ of vendor welfare WVXW^X_VWVX​ (revenue minus production cost of both vendors, (10)), manufacturer welfare WMX=∑i(Π−χiaiX)W^X_M = \sum_{i}(\Pi - \chi_i a^X_i)WMX​=∑i​(Π−χi​aiX​) and consumer welfare WCX=E[max⁡{uX,φ}]W^X_C = \mathbb E[\max\{u^X,\varphi\}]WCX​=E[max{uX,φ}] ((12)). The adoption game (8) lets each manufacturer choose aia_iai​ to maximise Π(ai,a−i)−χiai\Pi(a_i,a_{-i}) - \chi_i a_iΠ(ai​,a−i​)−χi​ai​. An adoption failure is a situation in which full adoption raises total welfare, WF>WNW^F > W^NWF>WN, but is not an equilibrium of the adoption game.

Formalization targets

Goal: Proposition 4.8 (p. 19)

With LLL fixed and H=L+ΔH = L + \DeltaH=L+Δ,

∃ Δ‾  ∀ Δ>Δ‾:WF(Δ)>WN(Δ)  and full adoption is not an equilibrium,\exists\,\underline\Delta\ \ \forall\,\Delta > \underline\Delta:\quad W^F(\Delta) > W^N(\Delta)\ \text{ and full adoption is not an equilibrium},∃Δ​  ∀Δ>Δ​:WF(Δ)>WN(Δ)  and full adoption is not an equilibrium,

at every such Δ\DeltaΔ at which Assumption 1 holds. The threshold Δ‾\underline\DeltaΔ​ is left unspecified, as in the paper.

Milestones

  • Proposition 4.1 (pp. 15–16): WCF≥WCP>WCNW^F_C \ge W^P_C > W^N_CWCF​≥WCP​>WCN​.
  • Proposition 4.3 (p. 17): WMF<WMP<WMNW^F_M < W^P_M < W^N_MWMF​<WMP​<WMN​.
  • Proposition 4.4 (p. 17): WVF, WVP<WVNW^F_V,\ W^P_V < W^N_VWVF​, WVP​<WVN​.
  • Proposition 4.6 (p. 18): WF,WP>WNW^F, W^P > W^NWF,WP>WN for all sufficiently large Δ\DeltaΔ; at fixed Δ\DeltaΔ, WF<WNW^F < W^NWF<WN once ∑i∈Mχi\sum_{i\in M}\chi_i∑i∈M​χi​ is large and WP<WNW^P < W^NWP<WN once ∑i:ξi=hχi\sum_{i:\xi_i=h}\chi_i∑i:ξi​=h​χi​ is large.
  • Proposition 4.7 (p. 19): neither full nor partial adoption is an equilibrium.

What the result gives

The proposition isolates a mechanism: blockchain information raises consumer surplus, which grows without bound in Δ\DeltaΔ, while Bertrand competition prevents the manufacturers who pay for adoption from capturing any of it. The conclusion is a market failure that persists however valuable the information is, and it motivates the paper's transfer scheme (Proposition 4.9), in which a consumer access fee finances the adopters. The welfare comparisons of Propositions 4.1–4.6 are reusable on their own: they quantify who gains and who loses from information disclosure in a vertically and horizontally differentiated market.

The results are proved in the paper (App. A.2, pp. 33–36). None is machine-checked. This mission produces a checked version of the welfare comparisons and of the failure result in the reduced form described below; the proofs as printed use a density for GGG and a second derivative of clc_lcl​, neither of which the model assumes, so a formal proof has to avoid both.

Where the difficulty lies

The equilibrium part is light once the gross profit is zero. The substance is in the welfare comparisons. Consumer welfare is an expectation E[max⁡{u,φ}]\mathbb E[\max\{u,\varphi\}]E[max{u,φ}] of an outside option with an arbitrary continuous law: strict monotonicity in uuu needs positive mass of φ\varphiφ below uNu^NuN, which is a consequence of Assumption 1 rather than an assumption, and the growth in Δ\DeltaΔ of WF−WNW^F - W^NWF−WN has to be bounded below without a density. Vendor welfare involves the generalised inverse (cl′)−1(c_l')^{-1}(cl′​)−1, which is 000 below cl′(0)c_l'(0)cl′​(0): the comparison WVF<WVNW^F_V < W^N_VWVF​<WVN​ must handle the regime where the low type vendor's share collapses to zero and the regime where it is interior, and must obtain continuity of cl′c_l'cl′​ from convexity rather than from a second derivative.

Formalization scope

The paper describes a signalling and pricing game but does not define its equilibrium concept precisely; Proposition A.1 states the outcomes and every proof in App. A.2 uses only those closed forms. The mission adopts the same reduced form, disclosed in every item: welfare is evaluated at Proposition A.1's prices, shares and utilities; the manufacturers' gross profit Π\PiΠ is the constant 000 for every adoption profile (the paper's statement in the proof of Proposition 4.3, p. 34); an equilibrium of the adoption stage is a pure Nash equilibrium of (8) with that payoff, expressed with AGT.IsPureNash from the published agt_games vocabulary. The signal accuracy is fixed at α=1/2\alpha = 1/2α=1/2, as in the paper's main text.

Conventions: manufacturers are Fin 2 × Bool × Fin m (the Boolean records ξi=h\xi_i = hξi​=h), adoption profiles are Boolean functions, GGG is ProbabilityTheory.cdf μ for a probability measure μ\muμ on R\mathbb RR, Δ\DeltaΔ is an argument of every statement with H=L+ΔH = L + \DeltaH=L+Δ, and (cl′)−1(x)=sup⁡{s≥0:cl′(s)≤x}(c_l')^{-1}(x) = \sup\{s \ge 0 : c_l'(s) \le x\}(cl′​)−1(x)=sup{s≥0:cl′​(s)≤x}. The standing assumptions are bundled in Model.Standing: m≥2m \ge 2m≥2, 0≤L0 \le L0≤L, 0≤l<h0 \le l < h0≤l<h, γ>0\gamma > 0γ>0, χi>0\chi_i > 0χi​>0, μ\muμ an atomless probability measure with μ((−∞,0))=0\mu((-\infty,0)) = 0μ((−∞,0))=0 and positive mass on every interval (a,b)⊆[0,∞)(a,b) \subseteq [0,\infty)(a,b)⊆[0,∞), clc_lcl​ strictly increasing and convex on [0,∞)[0,\infty)[0,∞) with cl(0)=0c_l(0) = 0cl​(0)=0 and a strictly increasing derivative there. One hypothesis is added to the paper's: φ\varphiφ has a finite mean, which the paper uses (its proof of Proposition 4.1 integrates v p(v)v\,p(v)vp(v)) without stating it. Assumption 1, item 3, depends on Δ\DeltaΔ through HHH and is a hypothesis at each Δ\DeltaΔ; it is satisfiable (for instance with cl(x)=x2c_l(x) = x^2cl​(x)=x2, φ∼Exp(1)\varphi \sim \mathrm{Exp}(1)φ∼Exp(1), γ=1/2\gamma = 1/2γ=1/2, h=1h=1h=1, L=l=0L=l=0L=l=0, Δ=4\Delta = 4Δ=4) and monotone in Δ\DeltaΔ.

The formalization rules out the trivializing readings: the equilibrium predicate is concrete, not an abstract hypothesis; the integrals are of integrable functions, so no junk value 000 enters; the inverse of cl′c_l'cl′​ is the explicit supremum, not Function.invFun; and LLL, not HHH, is held fixed as Δ\DeltaΔ grows.

Needed infrastructure: expectations of max⁡{c,φ}\max\{c,\varphi\}max{c,φ} as a function of ccc (monotonicity, growth), and the generalised inverse of a strictly increasing derivative of a convex function. Both are reusable beyond this mission. Proofs of the milestones in any order are welcome, as are alternative arguments that avoid the density and the second derivative of the printed proofs.

Selected references

  • G. Iyengar, F. Saleh, J. Sethuraman, W. Wang, Economics of Permissioned Blockchain Adoption, SSRN 3602376, version of 2022-08-19. https://ssrn.com/abstract=3602376
  • G. Iyengar, F. Saleh, J. Sethuraman, W. Wang, Economics of Permissioned Blockchain Adoption, Management Science, 2023. https://doi.org/10.1287/mnsc.2022.4532
  • N. Nisan, T. Roughgarden, É. Tardos, V. Vazirani (eds.), Algorithmic Game Theory, Cambridge University Press, 2007, Ch. 1 (pure Nash equilibrium). https://doi.org/10.1017/CBO9780511800481
8 thms2 active usersReviewed
EconomicsOperations Research·Captain: mikedeng1

Platform Competition and Interoperability: The Net Fee Model II: Interoperability Mitigates Dominance, as Lower Interoperability Admits a Duopoly Equilibrium with an Even Larger Dominant PlatformResearch Paper

Interoperability and dominant platforms

Digital markets with strong network effects (messaging, social networks, app stores) tend to concentrate: a platform with more users is worth more to each user. Interoperability, the ability of a platform's users to interact with the users of rival platforms, is a central remedy in current competition policy; the EU Digital Markets Act (2022) mandates it for messaging services offered by designated gatekeepers. Whether interoperability actually reduces the market share of a dominant platform is a question about equilibria of a pricing game.

Ekmekci, White and Wu (Management Science, 2025) answer it in a model of platform competition built on net fees. Their Proposition 6 shows, for a Logit duopoly, that lowering interoperability always admits an equilibrium with an even larger dominant platform; equivalently, interoperability may mitigate dominance. This mission formalizes that result and the steps of its proof.

Setting

There are two platforms j∈{1,2}j\in\{1,2\}j∈{1,2} and one side of users. Platform jjj chooses a net fee tj∈Rt^j\in\mathbb Rtj∈R: the price a user pays, net of the interaction value the platform extracts once the user has joined. With Logit demand and no outside option, platform jjj's market share at the fee profile t=(t1,t2)t=(t^1,t^2)t=(t1,t2) is

nj(t)=e−tje−t1+e−t2.n^j(t)=\frac{e^{-t^j}}{e^{-t^1}+e^{-t^2}} .nj(t)=e−t1+e−t2e−tj​.

Both platforms have marginal cost ccc, and each user values each other user of the same platform at γ\gammaγ, the network externality. The degree of interoperability λ∈[0,1]\lambda\in[0,1]λ∈[0,1] lets a user of platform jjj also enjoy λγ\lambda\gammaλγ per user of the rival platform (the paper's (19)), and the platform extracts this value too. Platform jjj's profit is

πj(t)=(tj+γnj+λγn−j−c) nj,n−j=1−nj.\pi^j(t)=\bigl(t^j+\gamma n^j+\lambda\gamma n^{-j}-c\bigr)\,n^j,\qquad n^{-j}=1-n^j .πj(t)=(tj+γnj+λγn−j−c)nj,n−j=1−nj.

A fee profile ttt is a Nash equilibrium in net fees under λ\lambdaλ if no platform can raise its profit by changing its own fee to any other real number. In an equilibrium with nj(t)>1/2n^j(t)>1/2nj(t)>1/2, platform jjj is the dominant platform.

The Lean development (namespace NetFeePlatform.InteropDominance) writes nj(t)n^j(t)nj(t) as demand 0 t j (the 0 is the weight of the absent outside option), πj\pi^jπj as profit 0 c γ lam t j, and equilibrium as IsEquilibrium 0 c γ lam t, with t : Fin 2 → ℝ.

Formalization targets

Goal: Proposition 6 (p. 23)

Let γ>0\gamma>0γ>0, 0≤λ‾<λ‾≤10\le\underline\lambda<\overline\lambda\le10≤λ​<λ≤1 and γ(1−λ‾)≤27/8\gamma(1-\underline\lambda)\le 27/8γ(1−λ​)≤27/8. If ttt is an equilibrium under λ‾\overline\lambdaλ and nj(t)>1/2n^j(t)>1/2nj(t)>1/2, then there is an equilibrium t′t't′ under λ‾\underline\lambdaλ​ with

nj(t′)>nj(t).n^j(t')>n^j(t).nj(t′)>nj(t).

The equilibrium t′t't′ is not unique in general, and the statement does not say which one; it asserts existence, exactly as the paper does.

Milestones

  1. Logit derivative (p. 13): ∂nj/∂tj=−nj(1−nj)\partial n^j/\partial t^j=-n^j(1-n^j)∂nj/∂tj=−nj(1−nj).
  2. First-order condition (20) (p. 23): every equilibrium satisfies tj=c+11−nj−2γnj−γλ(1−nj)+γλnjt^j=c+\frac1{1-n^j}-2\gamma n^j-\gamma\lambda(1-n^j)+\gamma\lambda n^jtj=c+1−nj1​−2γnj−γλ(1−nj)+γλnj.
  3. Sufficiency (Appendix E.1.3 with (36)): if γ(1−λ)≤27/8\gamma(1-\lambda)\le 27/8γ(1−λ)≤27/8, a fee satisfying (20) is a best response.
  4. Equivalence (p. 24): the market (c,γ,λ)(c,\gamma,\lambda)(c,γ,λ) has the equilibria of the market (c−γλ, γ(1−λ), 0)(c-\gamma\lambda,\ \gamma(1-\lambda),\ 0)(c−γλ, γ(1−λ), 0).
  5. Characterization (p. 51): equilibrium shares are the zeros of ζ(n;λ)=ln⁡n1−n+11−n−1n−2γ(1−λ)(2n−1)\zeta(n;\lambda)=\ln\frac{n}{1-n}+\frac1{1-n}-\frac1n-2\gamma(1-\lambda)(2n-1)ζ(n;λ)=ln1−nn​+1−n1​−n1​−2γ(1−λ)(2n−1), and conversely under the bound of item 3.
  6. Comparison (p. 52): ζ(n;λ‾)−ζ(n;λ‾)=2γ(λ‾−λ‾)(2n−1)<0\zeta(n;\underline\lambda)-\zeta(n;\overline\lambda)=2\gamma(\underline\lambda-\overline\lambda)(2n-1)<0ζ(n;λ​)−ζ(n;λ)=2γ(λ​−λ)(2n−1)<0 for n>1/2n>1/2n>1/2.
  7. Boundary behaviour (p. 52): ζ(n;λ)→∞\zeta(n;\lambda)\to\inftyζ(n;λ)→∞ as n→1−n\to1^-n→1−.

Significance

The result. Proposition 6 is the paper's argument that interoperability mandates can reduce concentration without any change in the platforms' cost or quality: at a fixed network externality, every equilibrium with a dominant platform under a higher degree of interoperability is outsized by an equilibrium under a lower degree, so the largest dominant share an equilibrium can sustain does not increase as interoperability rises. The proof rests on the equivalence of item 4, under which interoperability acts as a reduction of the effective network externality from γ\gammaγ to γ(1−λ)\gamma(1-\lambda)γ(1−λ); Figure 2 of the paper plots the resulting largest equilibrium share as λ\lambdaλ varies at γ=3.375\gamma=3.375γ=3.375.

Formalizing it. The paper's proof is three paragraphs, and it identifies equilibria with zeros of ζ\zetaζ. A formal proof has to supply what the text takes for granted: that the first-order condition is necessary at a global Nash equilibrium, that it is sufficient in the stated range, and that a zero of ζ\zetaζ can be turned back into a fee profile. No part of the result has been machine-checked before. A complete development also gives a reusable treatment of Logit demand and of best responses in one-variable concave games.

Difficulty

The algebra of ζ\zetaζ and the intermediate value step are short. The work lies in the equilibrium notion. A Nash equilibrium is a global condition over every unilateral deviation s∈Rs\in\mathbb Rs∈R, and profit is not concave in the platform's own fee. Measured against the platform's own share n∈(0,1)n\in(0,1)n∈(0,1), profit has second derivative −1/(n(1−n)2)+2γ(1−λ)-1/(n(1-n)^2)+2\gamma(1-\lambda)−1/(n(1−n)2)+2γ(1−λ); it is concave exactly when 2γ(1−λ)2\gamma(1-\lambda)2γ(1−λ) does not exceed the minimum 27/427/427/4 of 1/(n(1−n)2)1/(n(1-n)^2)1/(n(1−n)2). Outside that range the first-order condition is not sufficient, and a zero of ζ\zetaζ need not be an equilibrium; the paper does not treat that case.

Formalization scope

  • Model. One side (S=1S=1S=1), two platforms indexed by Fin 2, Logit demand with no outside option (outside weight w=0w=0w=0, literally), common ccc and γ\gammaγ, interoperability λ\lambdaλ written lam. The Setting file states the general JJJ-platform objects (demand with an outside-option weight w≥0w\ge0w≥0, profit with the interoperability term λγ∑k≠jnk\lambda\gamma\sum_{k\ne j}n^kλγ∑k=j​nk, equilibrium, the diversion ratio of (32)); this mission uses them at J=2J=2J=2, w=0w=0w=0.
  • Hypotheses. The paper assumes γ>0\gamma>0γ>0 and λ∈[0,1]\lambda\in[0,1]λ∈[0,1]. The goal adds γ(1−λ‾)≤27/8\gamma(1-\underline\lambda)\le 27/8γ(1−λ​)≤27/8, the range in which the paper proves that the first-order condition is sufficient (Appendix E.1.3 with (36), the 3.3753.3753.375 of Proposition 2′); the paper's own proof stops at the first-order condition and is not complete without it.
  • Correction. The paper prints ζ(n‾1;λ‾)−ζ(n‾1;λ‾)=4(λ‾−λ‾)γn‾1\zeta(\overline n^1;\underline\lambda)-\zeta(\overline n^1;\overline\lambda)=4(\underline\lambda-\overline\lambda)\gamma\overline n^1ζ(n1;λ​)−ζ(n1;λ)=4(λ​−λ)γn1; the correct value is 2γ(λ‾−λ‾)(2n‾1−1)2\gamma(\underline\lambda-\overline\lambda)(2\overline n^1-1)2γ(λ​−λ)(2n1−1). Its sign is the same, and milestone 6 states the correct value.
  • Ruled out. Equilibrium is never replaced by "the pricing formula (20) holds": that would reduce the goal to an intermediate value argument and remove its substance. Shares are always demand 0 t j at a fee profile, never free variables. Profit keeps the interoperability term; without it λ\lambdaλ would not enter the model at all.
  • Out of scope. General (non-Logit) demand and Assumptions A1–A2, S≥2S\ge2S≥2 sides, J≥3J\ge3J≥3 platforms (Proposition 12), platform-specific cj,γjc^j,\gamma^jcj,γj, the microfoundation of Appendix A, and the numerical Figure 2.
  • Welcome contributions. Proofs of the milestones, in particular the Logit change of variable from fees to shares and the concavity bound, which are reusable in the two companion missions of this series.

Selected references

  • M. Ekmekci, A. White, L. Wu, Platform Competition and Interoperability: The Net Fee Model, Management Science, 2025; accepted working-paper version of December 12, 2024 (the version cited here). https://doi.org/10.1287/mnsc.2023.02810
  • J. Crémer, P. Rey, J. Tirole, Connectivity in the Commercial Internet, Journal of Industrial Economics 48(4), 2000. https://doi.org/10.1111/1467-6451.00129
  • Regulation (EU) 2022/1925 (Digital Markets Act), Official Journal of the European Union L 265, 2022. https://eur-lex.europa.eu/eli/reg/2022/1925/oj
10 thms2 active usersReviewed
EconomicsOperations Research·Captain: mikedeng1

Platform Competition and Interoperability: The Net Fee Model I: Adding a Third Platform Can Produce an Equilibrium Whose Dominant Platform Outsizes Every Platform of Every Duopoly EquilibriumResearch Paper

Motivation

Markets organized by platforms (social networks, marketplaces, messaging services) exhibit network effects: a user values a platform more when more users join it. A standing concern in competition policy is that such markets "tip" towards one dominant platform, and the usual remedy proposed is to foster entry. Ekmekci, White and Wu (Platform Competition and Interoperability: The Net Fee Model, Management Science, 2025) develop a tractable model of platform oligopoly in which platforms compete in net fees, the price a user pays net of the interaction value the platform delivers, and use it to examine policy interventions. Their Proposition 4 shows that the intuition "more platforms, less dominance" can fail: with strong network effects, adding a third platform to a duopoly can produce an equilibrium whose leader is larger than any platform of any duopoly equilibrium.

The net-fee approach is the authors' alternative to the "insulated equilibrium" of White and Weyl (2016); the paper's §5 specializes it to Logit demand, where pricing formulas are explicit.

Setting

There are JJJ platforms and one side of users. Platform jjj charges a net fee tj∈Rt^j\in\mathbb Rtj∈R; write t=(t1,…,tJ)t=(t^1,\dots,t^J)t=(t1,…,tJ). Demand has the Logit form (13): with outside-option weight w=ez≥0w=e^{z}\ge0w=ez≥0,

nj(t)=e−tjw+∑ke−tk,n^j(t)=\frac{e^{-t^j}}{w+\sum_k e^{-t^k}},nj(t)=w+∑k​e−tke−tj​,

and in this mission there is no outside option, w=0w=0w=0, so the shares sum to one. Platforms are ex ante identical: common marginal cost ccc and common interaction value γ\gammaγ. Platform jjj's profit ((8) with one side) is

πj(t)=(tj+γ nj(t)−c) nj(t),\pi^j(t)=\big(t^j+\gamma\,n^j(t)-c\big)\,n^j(t),πj(t)=(tj+γnj(t)−c)nj(t),

the net fee plus the interaction value the platform extracts per user, less cost, times its share. A net-fee equilibrium is a pure-strategy Nash equilibrium: no platform jjj can raise πj\pi^jπj by changing its own net fee to any s∈Rs\in\mathbb Rs∈R. Duopoly is J=2J=2J=2, triopoly J=3J=3J=3.

At an equilibrium, each net fee satisfies the Logit pricing formula (14), tj=c+11−nj−2γnjt^j=c+\frac{1}{1-n^j}-2\gamma n^jtj=c+1−nj1​−2γnj. For equilibria with one dominant platform of share 1−n1-n1−n and J−1J-1J−1 equal small platforms of share n/(J−1)n/(J-1)n/(J−1), the paper reduces the equilibrium conditions to a zero of the characterization function

g(n;J)=ln⁡n−ln⁡(J−1)−ln⁡(1−n)+11−nJ−1−2γnJ−1−(1n−2γ(1−n)),0<n<1.g(n;J)=\ln n-\ln(J-1)-\ln(1-n)+\frac{1}{1-\frac{n}{J-1}}-2\gamma\frac{n}{J-1}-\Big(\frac1n-2\gamma(1-n)\Big),\qquad 0<n<1.g(n;J)=lnn−ln(J−1)−ln(1−n)+1−J−1n​1​−2γJ−1n​−(n1​−2γ(1−n)),0<n<1.

Formalization targets

Goal: Proposition 4 (competition may increase dominance)

For 2ln⁡2+43<γ≤2782\ln2+\tfrac43<\gamma\le\tfrac{27}{8}2ln2+34​<γ≤827​: duopoly has an equilibrium, and there exist a triopoly equilibrium t3t_3t3​ and a platform iii with

nk(t2)<ni(t3)for every duopoly equilibrium t2 and every platform k.n^k(t_2)<n^i(t_3)\quad\text{for every duopoly equilibrium }t_2\text{ and every platform }k.nk(t2​)<ni(t3​)for every duopoly equilibrium t2​ and every platform k.

The comparison is against every duopoly equilibrium and every platform in it, not against one selected equilibrium.

Milestones

  1. The Logit derivative ∂nj/∂tj=−nj(1−nj)\partial n^j/\partial t^j=-n^j(1-n^j)∂nj/∂tj=−nj(1−nj) (p. 13).
  2. Proposition 1 in Logit form (14): every equilibrium satisfies tj=c+11−nj−2γnjt^j=c+\frac1{1-n^j}-2\gamma n^jtj=c+1−nj1​−2γnj (pp. 12–13).
  3. The Logit concavity bound (36): for γ≤27/8\gamma\le27/8γ≤27/8, the pricing formula gives a global best response (p. 43).
  4. The zeros of g(⋅;J)g(\cdot;J)g(⋅;J) are exactly the equilibria with one dominant and J−1J-1J−1 equal small platforms (p. 49).
  5. lim⁡n→0+g(n;J)=−∞\lim_{n\to0^+}g(n;J)=-\inftylimn→0+​g(n;J)=−∞ (p. 49).
  6. g(n;3)−g(n;2)=−ln⁡2+11−n/2−11−n+γng(n;3)-g(n;2)=-\ln2+\frac1{1-n/2}-\frac1{1-n}+\gamma ng(n;3)−g(n;2)=−ln2+1−n/21​−1−n1​+γn (p. 50).
  7. For 2ln⁡2+43<γ≤2782\ln2+\tfrac43<\gamma\le\tfrac{27}{8}2ln2+34​<γ≤827​, g(n;3)>0g(n;3)>0g(n;3)>0 at every zero n∈(0,12]n\in(0,\tfrac12]n∈(0,21​] of g(⋅;2)g(\cdot;2)g(⋅;2) (p. 50).

Significance

The result. Proposition 4 is a counterexample to a policy presumption: entry need not reduce concentration in markets with network effects. With a third platform, the two small platforms can split the fringe so thinly that the leader's share rises above anything sustainable in a duopoly. The result identifies an explicit parameter window; together with the companion results on interoperability (Propositions 6 and 7 of the same paper), it frames which interventions reduce dominance in this model.

Formalizing it. The proposition is proved in the paper partly by a numerical check ("we can verify", p. 50), and its printed interval (2.71,3.375](2.71,3.375](2.71,3.375] is slightly too wide at the bottom: at the symmetric duopoly equilibrium the paper's own criterion requires γ>2ln⁡2+43≈2.7196\gamma>2\ln2+\tfrac43\approx2.7196γ>2ln2+34​≈2.7196. A machine-checked proof would settle the corrected statement, replace the numerical step by an argument, and make the equilibrium characterization through g(n;J)g(n;J)g(n;J) (including the step from first-order conditions to global Nash equilibrium) available for the other results of the series. None of these statements is formalized anywhere to our knowledge.

Difficulty

Three steps resist the obvious argument.

  • First-order conditions are not equilibria. The pricing formula is necessary; that it is sufficient requires profit to be concave in the platform's own share, which holds only for 2γ≤1/(n(1−n)2)2\gamma\le 1/(n(1-n)^2)2γ≤1/(n(1−n)2), i.e. for γ≤27/8\gamma\le 27/8γ≤27/8. Without this, zeros of ggg need not be equilibria.
  • "Any duopoly equilibrium" is universal. Duopoly may have asymmetric equilibria for γ\gammaγ near the top of the range, so the triopoly leader must beat the smallest zero of g(⋅;2)g(\cdot;2)g(⋅;2) in (0,12](0,\tfrac12](0,21​], not only the symmetric one.
  • The positivity of g(n;3)g(n;3)g(n;3) at duopoly zeros is an inequality between transcendental functions of nnn on a γ\gammaγ-dependent set; the paper checks it numerically. Its margin vanishes as γ\gammaγ approaches 2ln⁡2+432\ln2+\tfrac432ln2+34​ at n=12n=\tfrac12n=21​, and the paper's rewriting γ=f(n,J)\gamma=f(n,J)γ=f(n,J) is 0/00/00/0 exactly there.

Formalization scope

  • Lean namespace NetFeePlatform.Competition. The definitions file Setting declares the Logit demand demand w t j, the profit profit w c γ lam t j (with an interoperability term λγ∑k≠jnk\lambda\gamma\sum_{k\ne j}n^kλγ∑k=j​nk, set to λ=0\lambda=0λ=0 throughout this mission), the global Nash predicate IsEquilibrium, and the diversion ratio; GChar declares g(n;J)g(n;J)g(n;J). Platforms are indexed by Fin J.
  • Committed conventions: one side (S=1S=1S=1), Logit demand, common ccc and γ\gammaγ, no outside option (w=0w=0w=0, literally, not a limit z→−∞z\to-\inftyz→−∞), real-valued net fees with deviations over all of R\mathbb RR.
  • The goal's lower bound is 2ln⁡2+432\ln2+\tfrac432ln2+34​ instead of the printed 2.712.712.71 (see Difficulty and the goal's Formalization Note); the upper bound 27/8=3.37527/8=3.37527/8=3.375 is exact. The goal adds the conjunct "duopoly has an equilibrium", the existence claim of Proposition 2′ in this case, so that "any duopoly equilibrium" is not vacuous.
  • Trivializing formalizations are ruled out: equilibrium is the global Nash condition, never the first-order condition; the comparison quantifies over all duopoly equilibria; the dominant platform's index is existential, not fixed.
  • Out of scope: general (non-Logit) demand and Assumptions A1–A2, S≥2S\ge2S≥2 sides, platform-specific γj\gamma^jγj and cjc^jcj, the microfoundation of Appendix A, Propositions 2, 2′, 3, 5 and 13.
  • Infrastructure: one-variable calculus (derivatives, concavity, the intermediate value theorem, limits) from Mathlib. The Logit derivative and the concavity-based best-response lemma (milestones 1–3) are reusable for any Logit oligopoly with network effects. Contributions of alternative proofs of milestone 7 (interval arithmetic or monotonicity arguments) are welcome.

Selected references

  • M. Ekmekci, A. White, L. Wu, Platform Competition and Interoperability: The Net Fee Model, Management Science, 2025 (accepted working-paper version of December 12, 2024). https://doi.org/10.1287/mnsc.2023.02810
  • A. White, E. G. Weyl, Insulated Platform Competition, SSRN working paper, 2016. https://ssrn.com/abstract=1694317
10 thms2 active usersReviewed
Mechanism DesignOperations ResearchProbability·Captain: mikedeng1

On the Robustness of Second-Price Auctions in Prior-Independent Mechanism Design IV: The Fixed-Reserve Second-Price Auction Has Worst-Case Regret (n/(n+1))ⁿ at Its Best Reserve 1/(n+1)Research Paper

Motivation

A seller who must auction one item without knowing how buyers value it needs a mechanism that performs acceptably against every plausible value distribution. Anunrojwong, Balseiro and Besbes (arXiv:2204.10478, Operations Research 2025) measure performance by regret: the expected revenue lost relative to a seller who knows the realized valuations and extracts the highest one. Their main result (Theorem 1, the subject of mission I of this series) shows that against independent and identically distributed valuations the minimax-regret mechanism is a second-price auction whose reserve price is random, drawn from an explicit distribution.

Practitioners rarely randomize reserves. The natural benchmark is the familiar second-price auction with a fixed deterministic reserve rrr, and the question this mission addresses is how much is lost by insisting on a deterministic reserve: what is the worst-case regret of that auction, and which reserve minimizes it? The paper answers this exactly in Proposition 5 (§5.2.1, p. 24, proof in Appendix D, pp. App-10–11). For a single buyer, regret-optimal posted pricing was studied by Bergemann and Schlag (2008), where a deterministic price 1/21/21/2 has worst-case regret 1/21/21/2; Proposition 5 is the nnn-buyer version of that benchmark.

Setting

There are n≥1n\ge1n≥1 buyers with valuations v=(v1,…,vn)v=(v_1,\dots,v_n)v=(v1​,…,vn​) in the type cube [0,1]n[0,1]^n[0,1]n, drawn from a joint distribution F\mathbf FF unknown to the seller. Write v(1)=max⁡iviv^{(1)}=\max_i v_iv(1)=maxi​vi​ and v(2)v^{(2)}v(2) for the second-highest valuation. A direct mechanism charges buyer iii a payment pi(v)p_i(v)pi​(v), and its regret under F\mathbf FF is

Rn(m,F)=Ev∼F[v(1)−∑i=1npi(v)].R_n(m,\mathbf F)=\mathbb E_{v\sim\mathbf F}\Big[v^{(1)}-\sum_{i=1}^n p_i(v)\Big].Rn​(m,F)=Ev∼F​[v(1)−i=1∑n​pi​(v)].

The second-price auction with reserve rrr, SPA(r)\mathrm{SPA}(r)SPA(r), gives the item to the highest bidder if the highest bid is at least rrr, at price max⁡(v(2),r)\max(v^{(2)},r)max(v(2),r), and otherwise does not sell. Its revenue is max⁡(v(2),r) 1(v(1)≥r)\max(v^{(2)},r)\,\mathbf 1(v^{(1)}\ge r)max(v(2),r)1(v(1)≥r).

Three classes of distributions on [0,1]n[0,1]^n[0,1]n are considered:

  • Fiid\mathcal F_{\mathrm{iid}}Fiid​: product laws G⊗nG^{\otimes n}G⊗n, with GGG a law on [0,1][0,1][0,1];
  • Faff\mathcal F_{\mathrm{aff}}Faff​: exchangeable laws (invariant under permuting buyers) that are affiliated, meaning Pr⁡(A∩B∣S)≥Pr⁡(A∣S)Pr⁡(B∣S)\Pr(A\cap B\mid S)\ge\Pr(A\mid S)\Pr(B\mid S)Pr(A∩B∣S)≥Pr(A∣S)Pr(B∣S) for all increasing sets A,BA,BA,B and every sublattice SSS (a set closed under coordinatewise minimum and maximum);
  • Fmix\mathcal F_{\mathrm{mix}}Fmix​: mixtures of i.i.d. laws, whose joint CDF is F(v)=∫∏iG(vi) dμ(G)\mathbf F(v)=\int\prod_i G(v_i)\,d\mu(G)F(v)=∫∏i​G(vi​)dμ(G) for a probability measure μ\muμ on distributions.

The worst-case regret of SPA(r)\mathrm{SPA}(r)SPA(r) over a class F\mathcal FF is sup⁡F∈FRn(SPA(r),F)\sup_{\mathbf F\in\mathcal F}R_n(\mathrm{SPA}(r),\mathbf F)supF∈F​Rn​(SPA(r),F). The closed form found by the paper is

Wn(r)={max⁡(1−r, r),n=1,(1−r)n(n−1)n−1((1−r)n−r)n−1,n≥2, r≤12,r,n≥2, r>12,W_n(r)=\begin{cases}\max(1-r,\,r), & n=1,\\[2pt] \dfrac{(1-r)^n(n-1)^{n-1}}{((1-r)n-r)^{n-1}}, & n\ge 2,\ r\le\tfrac12,\\[4pt] r, & n\ge2,\ r>\tfrac12,\end{cases}Wn​(r)=⎩⎨⎧​max(1−r,r),((1−r)n−r)n−1(1−r)n(n−1)n−1​,r,​n=1,n≥2, r≤21​,n≥2, r>21​,​

called wcFixed n r in the Lean development.

Formalization targets

Goal: Proposition 5

For every n≥1n\ge1n≥1, every class F∈{Fiid,Faff,Fmix}\mathcal F\in\{\mathcal F_{\mathrm{iid}},\mathcal F_{\mathrm{aff}},\mathcal F_{\mathrm{mix}}\}F∈{Fiid​,Faff​,Fmix​} and every r∈[0,1]r\in[0,1]r∈[0,1],

sup⁡F∈FRn(SPA(r),F)=Wn(r),\sup_{\mathbf F\in\mathcal F}R_n(\mathrm{SPA}(r),\mathbf F)=W_n(r),F∈Fsup​Rn​(SPA(r),F)=Wn​(r),

the no-reserve auction has Wn(0)=1W_n(0)=1Wn​(0)=1 for n=1n=1n=1 and (n−1n)n−1\big(\frac{n-1}{n}\big)^{n-1}(nn−1​)n−1 for n≥2n\ge2n≥2, and

min⁡r∈[0,1]Wn(r)=Wn(1n+1)=(nn+1)n,\min_{r\in[0,1]}W_n(r)=W_n\Big(\frac1{n+1}\Big)=\Big(\frac n{n+1}\Big)^n,r∈[0,1]min​Wn​(r)=Wn​(n+11​)=(n+1n​)n,

with r∗=1/(n+1)r^*=1/(n+1)r∗=1/(n+1) the unique minimizer.

Milestones

  1. The regret of SPA(r)\mathrm{SPA}(r)SPA(r) under an i.i.d. law with marginal CDF FFF: rF−(r)n−∫0rFn+∫r1(nFn−1−nFn)rF_-(r)^n-\int_0^rF^n+\int_r^1(nF^{n-1}-nF^n)rF−​(r)n−∫0r​Fn+∫r1​(nFn−1−nFn).
  2. For n≥2n\ge2n≥2, the maximum of rcn+(1−r)(ncn−1−ncn)rc^n+(1-r)(nc^{n-1}-nc^n)rcn+(1−r)(ncn−1−ncn) over c∈[n−1n,1]c\in[\frac{n-1}{n},1]c∈[nn−1​,1] equals Wn(r)W_n(r)Wn​(r).
  3. For n=1n=1n=1, the maximum of rc+(1−r)(1−c)rc+(1-r)(1-c)rc+(1−r)(1−c) over c∈[0,1]c\in[0,1]c∈[0,1] is max⁡(1−r,r)\max(1-r,r)max(1−r,r).
  4. WnW_nWn​ is minimized on [0,1][0,1][0,1] exactly at 1/(n+1)1/(n+1)1/(n+1), with value (n/(n+1))n(n/(n+1))^n(n/(n+1))n.
  5. For n≥2n\ge2n≥2, every exchangeable affiliated law gives SPA(r)\mathrm{SPA}(r)SPA(r) regret at most Wn(r)W_n(r)Wn​(r).

Significance

The result. Proposition 5 gives the exact price of determinism. The optimal fixed reserve 1/(n+1)1/(n+1)1/(n+1) has worst-case regret (n/(n+1))n(n/(n+1))^n(n/(n+1))n: 1/21/21/2 for one buyer, 4/94/94/9 for two. The minimax regret of the optimal randomized auction is about 0.3680.3680.368 and 0.3240.3240.324 for the same cases, so the benchmark shows how much of the paper's improvement comes from randomizing the reserve. Both values converge to 1/e1/e1/e as n→∞n\to\inftyn→∞. Proposition 5 also shows that the worst case does not change when valuations are positively dependent (affiliated, or mixtures of i.i.d.), the same robustness the paper establishes for its optimal mechanism.

Formalizing it. The result is proved on paper in the paper's Appendix D, and no machine-checked version is known. A formal proof needs an expression of the expected revenue of a second-price auction through the order-statistic CDFs, a careful treatment of atoms at the reserve, two elementary but fiddly one-variable optimizations, and, for Faff\mathcal F_{\mathrm{aff}}Faff​ and Fmix\mathcal F_{\mathrm{mix}}Fmix​, the reduction to the i.i.d. case.

Difficulty

The supremum over Fiid\mathcal F_{\mathrm{iid}}Fiid​ is not attained. The auction's revenue jumps at the reserve: a buyer valued exactly at rrr buys, while one valued just below does not. Nature exploits this with two-point laws placing mass just below rrr and the rest at 111, and the regret approaches Wn(r)W_n(r)Wn​(r) only in the limit. So the first idea, exhibiting a maximizing distribution, fails, and any formalization must treat the worst case as a least upper bound. The upper bound over Faff\mathcal F_{\mathrm{aff}}Faff​ is the real difficulty: it rests on an order-statistic identity and on an inequality between the CDFs of the maxima of n−1n-1n−1 and nnn affiliated valuations, which in turn needs properties of affiliation that are quoted from Milgrom and Weber (1982) rather than proved in the paper. For Fmix\mathcal F_{\mathrm{mix}}Fmix​ the bound needs the regret to be linear in the mixing measure, i.e. a disintegration of the mixture law through its joint CDF.

Formalization scope

  • Representation. Buyers are Fin n; valuations are vectors Fin n → ℝ; a distribution is a probability measure on Fin n → ℝ whose complement of the cube [0,1]n[0,1]^n[0,1]n is null. Fiid\mathcal F_{\mathrm{iid}}Fiid​ is the set of products Measure.pi (fun _ => G) of a probability law G on [0,1][0,1][0,1]. Fmix\mathcal F_{\mathrm{mix}}Fmix​ uses a probability measure on Measure ℝ with the Giry σ-algebra and states the CDF identity of Definition 6 for every vvv.
  • The auction. SPA(r)\mathrm{SPA}(r)SPA(r) is the random-reserve auction SPA ρ at ρ = Measure.dirac r; the winner pays max⁡(v(2),r)\max(v^{(2)},r)max(v(2),r) when its bid is at least rrr. Ties go to the lowest index (the paper breaks them arbitrarily; revenue does not depend on the rule).
  • Affiliation is stated cross-multiplied, μ(A∩S)μ(B∩S)≤μ(A∩B∩S)μ(S)\mu(A\cap S)\mu(B\cap S)\le\mu(A\cap B\cap S)\mu(S)μ(A∩S)μ(B∩S)≤μ(A∩B∩S)μ(S), for measurable increasing A,BA,BA,B and measurable sublattices SSS.
  • Conventions committed to. The reserve ranges over [0,1][0,1][0,1] (the page leaves this implicit; for r>1r>1r>1 the closed form is false). Worst-case regret is IsLUB of the set of regrets, not a maximum and not sSup. "The optimal reserve" is IsLeast of WnW_nWn​ on [0,1][0,1][0,1], its value at 1/(n+1)1/(n+1)1/(n+1), and uniqueness of the minimizer.
  • Ruled out. A statement with IsGreatest would be false (the supremum is not attained); sSup of the regret image would be a junk value if the image were unbounded; classes without the [0,1]n[0,1]^n[0,1]n support condition, or rrr unconstrained, change the theorem.
  • Infrastructure. Expected revenue of a second-price auction via order statistics, the CDF of the maximum and second maximum of i.i.d. variables, and the reduction of mixtures to their components are reusable for the rest of this series and for auction theory generally. Contributions to the affiliation inequalities (Milgrom–Weber) are particularly welcome.

Selected references

  • J. Anunrojwong, S. R. Balseiro, O. Besbes, On the Robustness of Second-Price Auctions in Prior-Independent Mechanism Design, arXiv:2204.10478v5, 2024; Operations Research, 2025. https://arxiv.org/abs/2204.10478
  • D. Bergemann, K. Schlag, Pricing without Priors, Journal of the European Economic Association 6(2–3), 560–569, 2008. https://doi.org/10.1162/JEEA.2008.6.2-3.560
  • P. R. Milgrom, R. J. Weber, A Theory of Auctions and Competitive Bidding, Econometrica 50(5), 1089–1122, 1982. https://doi.org/10.2307/1911865
7 thms2 active usersReviewed
EconomicsOperations Research·Captain: mikedeng1

Coopetition in Platform-Based Retailing: On the Platform’s Entry I: The Seller Prefers Entry Exactly Above Thresholds in Spillover and Referral Rate and Outside a Band of Competition IntensityResearch Paper

Motivation

Large online marketplaces such as Amazon, JD.com and Walmart.com act both as a sales channel for third-party sellers and as a retailer of their own. A platform watches which third-party products sell well and may start selling the same product itself, a move called platform entry. Over ten months of 2013–2014, Amazon entered about 3% of the products first offered only by third-party sellers, and its entry lowered the affected products' sales rankings, that is, raised their total sales (Zhu & Liu, Strategic Management Journal 2018). The conventional view is that a seller should deter entry, since the platform becomes a competitor that also collects a referral fee on every sale the seller makes.

L. Qi, H. Song and W. Xiao (Management Science 2025) build a two-stage model with three features: the platform charges a referral rate on the seller's revenue, the platform's marketing effort spills over to the seller's product, and the two parties compete in quantities with differentiated products. Their Proposition 2 identifies exactly when the seller is better off if the platform enters. This mission formalizes that result together with the equilibrium analysis it rests on.

Setting

There are five parameters: the degree of spillover δ∈[0,1]\delta \in [0,1]δ∈[0,1], the referral rate f∈[0,1)f \in [0,1)f∈[0,1), the competition intensity β∈[0,1]\beta \in [0,1]β∈[0,1], the seller's effort-cost coefficient cSc_ScS​ and the platform's entry cost KKK. The product has base value aaa. The platform's effort-cost coefficient is normalized to 1/21/21/2.

Stage 1. The seller chooses an effort eSe_SeS​ at cost cSeS2c_S e_S^2cS​eS2​, which raises the product value to a+eSa + e_Sa+eS​, and a quantity q1q_1q1​. The price is p1=a+eS−q1p_1 = a + e_S - q_1p1​=a+eS​−q1​, and the seller earns q1p1(1−f)−cSeS2q_1 p_1 (1-f) - c_S e_S^2q1​p1​(1−f)−cS​eS2​ after paying the referral fee fq1p1f q_1 p_1fq1​p1​.

Stage 2 without entry. The seller alone sells qSq_SqS​ at price pS=a+eS−qSp_S = a + e_S - q_SpS​=a+eS​−qS​ and earns qSpS(1−f)q_S p_S(1-f)qS​pS​(1−f).

Stage 2 with entry. The platform chooses an effort eP≥0e_P \ge 0eP​≥0 at cost eP2/2e_P^2/2eP2​/2. Its own product's value becomes a+eS+ePa + e_S + e_Pa+eS​+eP​, and the seller's product's value becomes a+eS+δePa + e_S + \delta e_Pa+eS​+δeP​. The two then choose quantities simultaneously, with prices

pS=a+eS+δeP−qS−βqP,pP=a+eS+eP−qP−βqS.p_S = a + e_S + \delta e_P - q_S - \beta q_P, \qquad p_P = a + e_S + e_P - q_P - \beta q_S .pS​=a+eS​+δeP​−qS​−βqP​,pP​=a+eS​+eP​−qP​−βqS​.

The seller earns qSpS(1−f)q_S p_S (1-f)qS​pS​(1−f). The platform earns qSpSf+qPpP−eP2/2−Kq_S p_S f + q_P p_P - e_P^2/2 - KqS​pS​f+qP​pP​−eP2​/2−K: the referral fee on the seller's revenue plus its own margin.

Backward induction gives closed forms. Write

N5=4(1+δ)−2β(2−δ+δ2)+β3(1+f)−β2(2+f+δf)N_5 = 4(1+\delta) - 2\beta(2-\delta+\delta^2) + \beta^3(1+f) - \beta^2(2+f+\delta f)N5​=4(1+δ)−2β(2−δ+δ2)+β3(1+f)−β2(2+f+δf)

and let DDD be the quartic denominator of the platform's optimal effort (Lemma 2). Condition (5) is N5>0N_5 > 0N5​>0: under it the seller stays in the market after entry. The paper assumes (5) from that point on. Let

H={N52/D2if (5) holds,0otherwise,H = \begin{cases} N_5^2/D^2 & \text{if (5) holds},\\ 0 & \text{otherwise,}\end{cases}H={N52​/D20​if (5) holds,otherwise,​

so that the seller's two-stage profits as functions of the effort eSe_SeS​ are

ΠNS(eS)=12(1−f)(a+eS)2−cSeS2,ΠES(eS)=(14+H)(1−f)(a+eS)2−cSeS2.\Pi^S_N(e_S) = \tfrac12 (1-f)(a+e_S)^2 - c_S e_S^2, \qquad \Pi^S_E(e_S) = \big(\tfrac14 + H\big)(1-f)(a+e_S)^2 - c_S e_S^2 .ΠNS​(eS​)=21​(1−f)(a+eS​)2−cS​eS2​,ΠES​(eS​)=(41​+H)(1−f)(a+eS​)2−cS​eS2​.

The receptive regime is Ω={(δ,f,β)∣H>1/4}\Omega = \{(\delta,f,\beta) \mid H > 1/4\}Ω={(δ,f,β)∣H>1/4}.

Formalization targets

Goal: Proposition 2

ΠES(eS)>ΠNS(eS)  ⟺  (δ,f,β)∈Ω(a+eS≠0),\Pi^S_E(e_S) > \Pi^S_N(e_S) \iff (\delta,f,\beta) \in \Omega \qquad (a + e_S \ne 0),ΠES​(eS​)>ΠNS​(eS​)⟺(δ,f,β)∈Ω(a+eS​=0),

and the shape of Ω\OmegaΩ on the box [0,1]×[0,1)×[0,1][0,1]\times[0,1)\times[0,1][0,1]×[0,1)×[0,1]:

  • for fixed (f,β)(f,\beta)(f,β) there is δ~(f,β)\tilde\delta(f,\beta)δ~(f,β) with (δ,f,β)∈Ω  ⟺  δ>δ~(f,β)(\delta,f,\beta)\in\Omega \iff \delta > \tilde\delta(f,\beta)(δ,f,β)∈Ω⟺δ>δ~(f,β);
  • for fixed (δ,β)(\delta,\beta)(δ,β) there is f~(δ,β)\tilde f(\delta,\beta)f~​(δ,β) with (δ,f,β)∈Ω  ⟺  f>f~(δ,β)(\delta,f,\beta)\in\Omega \iff f > \tilde f(\delta,\beta)(δ,f,β)∈Ω⟺f>f~​(δ,β);
  • for fixed (δ,f)(\delta,f)(δ,f) there are β1(δ,f)≤β2(δ,f)\beta_1(\delta,f) \le \beta_2(\delta,f)β1​(δ,f)≤β2​(δ,f) with (δ,f,β)∈Ω  ⟺  β<β1(\delta,f,\beta)\in\Omega \iff \beta < \beta_1(δ,f,β)∈Ω⟺β<β1​ or β>β2\beta > \beta_2β>β2​.

The thresholds are existentials, as the paper defines them only inside its proof.

Milestones

  1. Lemma 1: the stage-2 quantity game after entry has a unique equilibrium, given in closed form.
  2. Lemma 2 under (5): the platform's optimal effort eP∗e^*_PeP∗​ in closed form, and the seller stays (qS∗>0q^*_S > 0qS∗​>0). The positivity of eP∗e^*_PeP∗​ and of its denominator is a separate milestone.
  3. Equations (6)–(8): the seller's equilibrium two-stage profits are ΠNS\Pi^S_NΠNS​ and ΠES\Pi^S_EΠES​ above.
  4. The identity 4N52−D2=P11⋅S24N_5^2 - D^2 = P_{11}\cdot S_24N52​−D2=P11​⋅S2​ from the proof of Proposition 2, where P11P_{11}P11​ is the function (11).
  5. Under (5) the second factor S2S_2S2​ is positive.
  6. Lemma 3, in three parts: the sign pattern of (11) in δ\deltaδ, in fff and in β\betaβ.

Significance

The result. Proposition 2 says that the seller's preference does not depend on the seller's own effort or on the base value, only on (δ,f,β)(\delta, f, \beta)(δ,f,β). It shows that the conventional advice to deter entry is wrong on a nonempty region: a strong enough spillover, or a high enough referral rate (which gives the platform a stake in the seller's sales and so a reason to invest more effort), makes entry welcome. In the competition intensity the regime is not monotone. The seller welcomes entry when products are well differentiated, opposes it at intermediate β\betaβ, and can welcome it again near perfect substitutes. The paper's later results on the seller's optimal effort and on entry deterrence (Proposition 3 onward) are stated separately inside and outside Ω\OmegaΩ, so this classification is their starting point.

Formalizing it. The result is proved in the paper, and nothing about it is machine-checked yet. Its proof leans on "one can verify" claims about quartic polynomials on a box: the positivity of DDD, of the platform's effort and of S2S_2S2​ under (5), and the sign patterns of (11). A formal proof checks each of them. The mission also ties the closed forms (6)–(7) to an explicit game, with equilibria defined as best responses, so the comparison is between equilibrium profits and not between formulas taken on trust.

Difficulty

The first part of the goal is immediate once (6)–(7) are known, since ΠES−ΠNS=(H−14)(1−f)(a+eS)2\Pi^S_E - \Pi^S_N = (H - \tfrac14)(1-f)(a+e_S)^2ΠES​−ΠNS​=(H−41​)(1−f)(a+eS​)2. The content lies elsewhere.

  • The equilibrium analysis. The platform's payoff includes the referral fee on the seller's revenue, so its best-response slope is β(1+f)/2\beta(1+f)/2β(1+f)/2, not the textbook β/2\beta/2β/2. The seller's quantity has a corner at zero. The platform's effort problem must be solved against every equilibrium after every deviation, and it reduces to a single variable only after uniqueness in Lemma 1.
  • Polynomial sign conditions. Positivity of DDD and S2S_2S2​ under (5), and the threshold structure of (11) in each variable, are statements about polynomials of degree up to four on a box with the semialgebraic side condition (5).
  • A step the paper omits. Ω\OmegaΩ is defined through HHH, and H=0H = 0H=0 off (5). Moving Lemma 3's thresholds from (11) to Ω\OmegaΩ therefore also needs "(11) >0> 0>0 implies (5)", which the paper does not state. It holds numerically: on a 2013201^32013 grid, wherever (11) is positive the left side of (5) is above 1.011.011.01. A complete proof of the goal must supply it.

Formalization scope

All quantities are real numbers. The parameters are explicit arguments, and the standing ranges δ∈[0,1]\delta\in[0,1]δ∈[0,1], f∈[0,1)f\in[0,1)f∈[0,1), β∈[0,1]\beta\in[0,1]β∈[0,1] are a hypothesis InBox δ f β. Every polynomial (N5N_5N5​, DDD, the numerator of eP∗e^*_PeP∗​, (11), S2S_2S2​) is written term for term as printed. HHH keeps the case split of (8), so Ω\OmegaΩ is false wherever (5) fails. Conventions:

  • Defined from the game: the quantity equilibrium (a pure Nash equilibrium over nonnegative quantities, through the published general two-player definition CompetingChains.Cournot.IsPureNash), the entry equilibrium (the platform's effort eP≥0e_P \ge 0eP​≥0 is a global maximizer against every equilibrium after every deviation), and the stage-1 and no-entry problems.
  • The paper's closed forms: HHH, Ω\OmegaΩ, ΠNS\Pi^S_NΠNS​ and ΠES\Pi^S_EΠES​. Milestone 3 proves that the closed forms equal the equilibrium profits.
  • "Optimal" means a global maximizer, ties allowed.
  • The platform's effort is nonnegative. The seller's effort eSe_SeS​ is any real number, as in the paper.
  • Lemmas 1–2 assume a+eS>0a + e_S > 0a+eS​>0 (a positive product value), and Lemma 2 assumes (5), the paper's standing assumption.
  • Only the branch of Lemma 2 under (5) is formalized.
  • The goal's first part assumes a+eS≠0a + e_S \ne 0a+eS​=0. At a+eS=0a + e_S = 0a+eS​=0 both profits equal −cSeS2-c_S e_S^2−cS​eS2​ and no strict preference exists.
  • Condition (5) is not a hypothesis of the goal.

The first part of the goal is near-definitional given (6)–(7). The mission's content is the threshold structure of Ω\OmegaΩ and milestones 1–3, which make (6)–(7) the equilibrium profits. A formalization in which the thresholds may depend on the varying parameter, or in which Ω\OmegaΩ is taken as {(11)>0}\{(11) > 0\}{(11)>0} by definition, would not be this theorem.

A complete development needs real polynomial inequalities on boxes (nlinarith/polyrith-style certificates or interval arguments) and elementary concave maximization. A uniqueness lemma for two-player games whose best responses have slopes with product below one would be reusable for other differentiated Cournot models. Contributions are welcome for any milestone, for the step "(11) >0> 0>0 implies (5)", and for proofs of the sign lemmas by certificates.

Selected references

  • L. Qi, H. Song, W. Xiao, Coopetition in Platform-Based Retailing: On the Platform's Entry, Management Science, 2025. https://doi.org/10.1287/mnsc.2023.00260 (formalized from the authors' manuscript with Online Supplement, 2024-08-03).
  • F. Zhu, Q. Liu, Competing with complementors: An empirical look at Amazon.com, Strategic Management Journal 39(10), 2018. https://doi.org/10.1002/smj.2932
  • N. Singh, X. Vives, Price and quantity competition in a differentiated duopoly, RAND Journal of Economics 15(4), 1984. https://doi.org/10.2307/2555525
12 thms2 active usersReviewed
EconomicsOperations ResearchProbability·Captain: mikedeng1

Imperfect Targeting and Advertising Strategies: With Costless Advertising and A < 1/4, Equilibrium Industry Profit Falls as Targeting Improves, Jumps Up at α̂₂(A), Then Stays ConstantResearch Paper

Motivation

Online advertising lets a firm aim its messages at the consumers most likely to want its product, but the data behind that aim is noisy: a platform's prediction of who belongs to a demographic or interest segment is right only with some probability. A natural expectation is that sharper targeting raises firms' profits, since fewer messages are wasted. Karle and Reisinger (SSRN 4626076, March 2024; published in Management Science, doi:10.1287/mnsc.2023.03632) show that this can fail: when both firms chase the same valuable consumers, better targeting also increases the number of consumers who see both firms' advertisements, which intensifies price competition.

The model combines a targeting stage with the clearinghouse price-competition model of Varian (1980) and Narasimhan (1988), in which some consumers are informed about one firm only (loyal consumers) and others about both (shoppers), and equilibrium prices are dispersed. This mission formalizes the paper's result for costless advertising: industry profit first falls as targeting improves, then jumps up when firms switch to segmenting the market, then stays flat.

Setting

There are two consumer groups aaa and bbb, each of mass one. Group-bbb consumers value the product at 111, group-aaa consumers at AAA, with 0<A<10 < A < 10<A<1. Two firms produce at zero cost. For every consumer each firm receives a signal of the consumer's group that is correct with probability α∈(1/2,1]\alpha \in (1/2, 1]α∈(1/2,1], independently across firms. Only consumers of the group a firm targets are interested in its product.

Stage 1. Each firm chooses a target group k∈{a,b}k \in \{a, b\}k∈{a,b} and a message scope: expected (message only the consumers its signal places in group kkk, which reaches a mass α\alphaα of group kkk) or all (message every consumer, which reaches all of group kkk). Messages cost c≥0c \ge 0c≥0 each; in this mission c=0c = 0c=0.

Stage 2. Having observed stage 1, firms set prices. For a stage-1 profile sss, if both firms target the same group, the shoppers S(s)=r1r2S(s) = r_1 r_2S(s)=r1​r2​ are the targeted consumers reached by both, where ri∈{α,1}r_i \in \{\alpha, 1\}ri​∈{α,1} is firm iii's reach; firm iii's loyal mass is Li(s)=ri−S(s)L_i(s) = r_i - S(s)Li​(s)=ri​−S(s). If they target different groups, S(s)=0S(s) = 0S(s)=0 and Li(s)=riL_i(s) = r_iLi​(s)=ri​. A consumer buys if the price does not exceed her valuation; shoppers buy from the cheaper firm and split equally on ties. Firm iii's profit at prices (p,q)(p, q)(p,q) is p (Li+S)p\,(L_i + S)p(Li​+S), p (Li+S/2)p\,(L_i + S/2)p(Li​+S/2) or p Lip\,L_ipLi​ according as p<qp < qp<q, p=qp = qp=q or p>qp > qp>q, and 000 if ppp exceeds the valuation.

Firms may randomize prices: a price strategy is a probability measure on [0,1][0,1][0,1], and Ui(s;μ,ν)U_i(s; \mu, \nu)Ui​(s;μ,ν) is firm iii's expected profit. A subgame perfect Nash equilibrium (SPNE) is a pure stage-1 profile s⋆s^\stars⋆ and a continuation that assigns to each of the sixteen stage-1 profiles a Nash equilibrium of its pricing subgame, such that no firm gains at stage 1 by changing its action. The sum of expected profits is V1(s⋆)+V2(s⋆)V_1(s^\star) + V_2(s^\star)V1​(s⋆)+V2​(s⋆).

Two cumulative distribution functions appear, on [1−α,1)[1-\alpha, 1)[1−α,1):

F(p)=1α−1−ααp,H(p)=p−(1−α)p,F(p) = \frac1\alpha - \frac{1-\alpha}{\alpha p}, \qquad H(p) = \frac{p - (1-\alpha)}{p},F(p)=α1​−αp1−α​,H(p)=pp−(1−α)​,

both 000 below 1−α1-\alpha1−α and 111 from 111 on, so HHH has an atom 1−α1 - \alpha1−α at p=1p = 1p=1. The thresholds are α^1(A)=1−A\hat\alpha_1(A) = 1 - Aα^1​(A)=1−A and α^2(A)=(1+1−4A)/2\hat\alpha_2(A) = \bigl(1 + \sqrt{1 - 4A}\bigr)/2α^2​(A)=(1+1−4A​)/2.

Formalization targets

Goal: Proposition 2 (p. 15)

For 0<A<1/40 < A < 1/40<A<1/4: 1/2<α^2(A)<α^1(A)1/2 < \hat\alpha_2(A) < \hat\alpha_1(A)1/2<α^2​(A)<α^1​(A); for every α∈(1/2,α^2(A))\alpha \in (1/2, \hat\alpha_2(A))α∈(1/2,α^2​(A)) there is an SPNE with

∑iE[πi⋆(α)]=1−α2,\textstyle\sum_i E[\pi_i^\star(\alpha)] = 1 - \alpha^2,∑i​E[πi⋆​(α)]=1−α2,

which is strictly decreasing in α\alphaα; for every α∈(α^2(A),1]\alpha \in (\hat\alpha_2(A), 1]α∈(α^2​(A),1] there is an SPNE with sum 1+A1 + A1+A; and 1−α^2(A)2<1+A1 - \hat\alpha_2(A)^2 < 1 + A1−α^2​(A)2<1+A (the upward jump).

Milestones

  1. Display (1), p. 11. If both firms target bbb and message expected consumers, both pricing by FFF is an equilibrium with profit α(1−α)\alpha(1-\alpha)α(1−α) each.
  2. Lemma 2 part 1, display (2), pp. 14–15. If firm 1 messages expected and firm 2 all group-bbb consumers, (F,H)(F, H)(F,H) is an equilibrium with profits α(1−α)\alpha(1-\alpha)α(1−α) and 1−α1-\alpha1−α.
  3. Bertrand, p. 13. If both message all group-bbb consumers, pricing at 000 is an equilibrium with zero profits.
  4. Segmentation, pp. 9, 13. If firm 1 targets aaa and firm 2 targets bbb, prices AAA and 111 are an equilibrium.
  5. Threshold, p. 14. For α∈(1/2,1]\alpha \in (1/2, 1]α∈(1/2,1] and A≤1/4A \le 1/4A≤1/4: α(1−α)≥A  ⟺  α≤α^2(A)\alpha(1-\alpha) \ge A \iff \alpha \le \hat\alpha_2(A)α(1−α)≥A⟺α≤α^2​(A).
  6. Footnote 36, p. 15. α^2(A)<α^1(A)\hat\alpha_2(A) < \hat\alpha_1(A)α^2​(A)<α^1​(A) for 0<A<1/40 < A < 1/40<A<1/4.
  7. Lemma 2, pp. 14–15. The SPNE with c=0c = 0c=0 in both regimes.

Significance

The proposition shows that the non-monotonicity of industry profit in targeting precision, which the paper first derives for high advertising costs, does not rely on advertising being costly. With free messages a firm could inform every consumer, which is equivalent to perfect targeting; the equilibrium instead has one firm refrain from doing so, because the resulting asymmetry keeps prices high. For regulation of consumer data and for platforms selling targeting precision, the result says that better targeting technology can lower sellers' profits over a range of precisions and raise them discontinuously elsewhere.

The result is proved in the paper (main text and Online Appendix A). It has not been machine-checked. Formalizing it means verifying mixed-strategy equilibria of a pricing game with a continuum of prices, including an atom at the valuation, in all sixteen subgames of a two-stage game, a pattern that recurs throughout the clearinghouse and price-dispersion literature.

Difficulty

The stage-1 comparison is arithmetic once the stage-2 payoffs are known; the work is in the pricing subgames. Each mixed equilibrium must be verified against every real price deviation, which needs the expected profit at price ppp against a distribution with an atom, where the tie-splitting rule matters exactly at the atom. Subgame perfection requires a pricing equilibrium in every off-path subgame too, including those where both firms target group aaa (the group-bbb equilibria rescaled by AAA) and the Bertrand subgames. The obvious shortcut, assigning each subgame its textbook profit as a number, is not available: the stage-1 values are defined as integrals against the equilibrium strategies.

Formalization scope

Lean 4 with Mathlib. The pricing game is a separate definition (a general clearinghouse duopoly with valuations viv_ivi​, loyal masses LiL_iLi​ and shopper mass SSS); the targeting game builds on it. Committed conventions:

  • price strategies are probability measures on R\mathbb RR with no mass outside [0,1][0,1][0,1]; expected profits are Bochner integrals; deviations range over all real prices;
  • a consumer buys at a price equal to her valuation (the page says "lower than"; the atom of HHH at 111 needs the sale);
  • targeting is in pure strategies (the paper's footnotes 26 and 34); the message scope is binary, the paper's options (1) and (2); the no-message option and the continuous message masses of the appendix proof are not modelled;
  • cdfs are Mathlib's ProbabilityTheory.cdf; statements about all measures with cdf FFF also assert that such a measure exists;
  • the paper's "firm iii / firm −i-i−i" are firm 1 (the expected-only firm, and the group-aaa firm) and firm 2;
  • for A>1/4A > 1/4A>1/4 Lean's square root gives α^2(A)=1/2\hat\alpha_2(A) = 1/2α^2​(A)=1/2, the reading Lemma 2's range (max⁡{1/2,α^2(A)},1](\max\{1/2, \hat\alpha_2(A)\}, 1](max{1/2,α^2​(A)},1] needs;
  • pricing-stage profits exclude the sunk message cost; the goal and Lemma 2 are at c=0c = 0c=0.

The goal is Proposition 2 in existence form: it asserts an SPNE with the stated total. The paper exhibits that equilibrium; uniqueness of equilibrium payoffs is not claimed. Propositions 1 and 3 (high and general costs) are not posed. Trivializing encodings are excluded by construction: stage-1 values are integrals of the continuation strategies, not a table; the equilibrium condition quantifies over all sixteen subgames, not just the path; strategies are probability measures on [0,1][0,1][0,1], so no integral takes a junk value; and statements quantifying over measures with a given cdf include the existence of one.

Contributions welcome: integration of the tie-split profit against cdfs with atoms, a reusable lemma that a clearinghouse with given loyal and shopper masses has an equilibrium, and the rescaling of equilibria by the valuation.

Selected references

  • H. Karle and M. Reisinger, Imperfect Targeting and Advertising Strategies, SSRN working paper 4626076, March 25, 2024. https://ssrn.com/abstract=4626076 ; published in Management Science, 2024. https://doi.org/10.1287/mnsc.2023.03632
  • H. R. Varian, A Model of Sales, American Economic Review 70(4), 651–659, 1980. https://www.jstor.org/stable/1805229
  • C. Narasimhan, Competitive Promotional Strategies, Journal of Business 61(4), 427–449, 1988. https://doi.org/10.1086/296442
10 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Prophet Secretary Through Blind Strategies 2: No Stopping Strategy Can Guarantee More Than √3 − 1 of the Prophet's Expected Maximum in Random OrderResearch Paper

Motivation

In a prophet inequality a gambler sees the realizations of independent nonnegative random variables one at a time and must decide irrevocably, at each step, whether to stop and keep the current value. Her performance is compared with that of a prophet who sees everything in advance and takes the maximum. The ratio between the two is the standard benchmark for online selection, and through the correspondence between threshold stopping rules and posted prices it governs the efficiency of sequential posted-price mechanisms in algorithmic mechanism design.

The constant depends on the order in which the values arrive. In adversarial order the best guarantee is 1/21/21/2 (Krengel and Sucheston; Samuel-Cahn). For independent and identically distributed values it is about 0.7450.7450.745 (Hill and Kertz 1982 gave the upper bound; Correa, Foncea, Hoeksma, Oosterwijk and Vredeveld 2017 proved it tight). The prophet secretary problem sits between these two: the distributions may differ, but the values arrive in a uniformly random order.

Timeline.

  • 2015: Esfandiari, HajiAghayi, Liaghat and Monemizadeh introduce the prophet secretary problem and give a guarantee of 1−1/e≈0.6321-1/e\approx0.6321−1/e≈0.632 with nonincreasing thresholds.
  • 2018: Ehsani, Hajiaghayi, Kesselheim and Singla obtain 1−1/e1-1/e1−1/e with a single threshold and random tie-breaking.
  • 2018: Azar, Chiplunkar and Kaplan beat 1−1/e1-1/e1−1/e slightly. They also show that deterministic distribution-insensitive algorithms cannot beat 11/15≈0.73311/15\approx0.73311/15≈0.733.
  • 2019 (arXiv:1807.07483v2): Correa, Saona and Ziliotto prove a guarantee of 0.6690.6690.669 for blind strategies. They also prove the upper bound of 3−1≈0.732\sqrt3-1\approx0.7323​−1≈0.732 for all strategies, the subject of this mission.

Before this bound no separation between the prophet secretary problem and the i.i.d. prophet inequality was known.

Setting

An instance with NNN variables is a family of laws μ0,…,μN−1\mu_0,\dots,\mu_{N-1}μ0​,…,μN−1​ on [0,∞)[0,\infty)[0,∞). The values Vi∼μiV_i\sim\mu_iVi​∼μi​ are independent. A permutation σ\sigmaσ of {0,…,N−1}\{0,\dots,N-1\}{0,…,N−1}, uniform and independent of the values, fixes the arrival order: at time jjj the gambler sees which variable σj\sigma_jσj​ arrives and its value VσjV_{\sigma_j}Vσj​​.

A strategy decides at each time jjj whether to stop. The decision may use the observed history ((σ0,Vσ0),…,(σj,Vσj))((\sigma_0,V_{\sigma_0}),\dots,(\sigma_j,V_{\sigma_j}))((σ0​,Vσ0​​),…,(σj​,Vσj​​)) and an independent seed ω\omegaω, uniform on [0,1][0,1][0,1], and must depend on them measurably. These are the randomized stopping times TTT of the gambler's information. The gambler knows the distributions, so a strategy may be chosen after the instance. The reward is VσT1T<∞V_{\sigma_T}\mathbf 1_{T<\infty}VσT​​1T<∞​: the value at the first stop, and 000 if she never stops. The value of a strategy is E(VσT)\mathbb E(V_{\sigma_T})E(VσT​​), and the prophet's value is E(max⁡iVi)\mathbb E(\max_i V_i)E(maxi​Vi​).

A strategy guarantees ccc if E(VσT)≥c E(max⁡iVi)\mathbb E(V_{\sigma_T})\ge c\,\mathbb E(\max_iV_i)E(VσT​​)≥cE(maxi​Vi​) on every instance.

The §5 instance has n+1n+1n+1 variables, for n≥1n\ge1n≥1 and a∈[0,1]a\in[0,1]a∈[0,1]. Each of V1,…,VnV_1,\dots,V_nV1​,…,Vn​ equals nnn with probability 1/n21/n^21/n2 and 000 otherwise, and Vn+1≡aV_{n+1}\equiv aVn+1​≡a. For j∈{1,…,n+1}j\in\{1,\dots,n+1\}j∈{1,…,n+1}, the time-jjj rule accepts a value nnn whenever one appears, and accepts Vn+1V_{n+1}Vn+1​ exactly when it arrives at time jjj or later.

Formalization targets

Goal: Theorem 1.3 (p. 4)

For every c>3−1c>\sqrt3-1c>3​−1 there is an instance with 0<E(max⁡iVi)<∞0<\mathbb E(\max_iV_i)<\infty0<E(maxi​Vi​)<∞ on which every strategy satisfies

E(VσT)<c⋅E(max⁡iVi).\mathbb E(V_{\sigma_T}) < c\cdot\mathbb E\Big(\max_{i}V_i\Big).E(VσT​​)<c⋅E(imax​Vi​).

The instance comes first and all strategies second. This is what "no strategy can guarantee more than 3−1\sqrt3-13​−1" means once strategies may depend on the distributions. Universally quantifying a fixed strategy first would describe a weaker gambler.

Milestones (all from §5, p. 19)

  1. The prophet's value on the §5 instance:
E(max⁡i≤n+1Vi)=n[1−(1−1n2)n]+(1−1n2)na →n→∞ 1+a.\mathbb E\Big(\max_{i\le n+1}V_i\Big)=n\Big[1-\Big(1-\tfrac1{n^2}\Big)^n\Big]+\Big(1-\tfrac1{n^2}\Big)^na\ \xrightarrow[n\to\infty]{}\ 1+a .E(i≤n+1max​Vi​)=n[1−(1−n21​)n]+(1−n21​)na n→∞​ 1+a.
  1. The elementary bound n[1−(1−1/n2)i−1]≤(i−1)/nn[1-(1-1/n^2)^{i-1}]\le (i-1)/nn[1−(1−1/n2)i−1]≤(i−1)/n, which is a published platform theorem (1−(1−t)m≤mt1-(1-t)^m\le mt1−(1−t)m≤mt for t∈[0,1]t\in[0,1]t∈[0,1]).
  2. The conditional values of the time-jjj rule given that Vn+1V_{n+1}Vn+1​ arrives at position iii: n[1−(1−1/n2)n]n[1-(1-1/n^2)^n]n[1−(1−1/n2)n] for i<ji<ji<j, and n[1−(1−1/n2)i−1]+(1−1/n2)i−1an[1-(1-1/n^2)^{i-1}]+(1-1/n^2)^{i-1}an[1−(1−1/n2)i−1]+(1−1/n2)i−1a for i≥ji\ge ji≥j.
  3. For every strategy on the §5 instance,
E(VσT)≤1+a22+O(1n).\mathbb E(V_{\sigma_T})\le 1+\frac{a^2}{2}+O\Big(\frac1n\Big).E(VσT​​)≤1+2a2​+O(n1​).

At a=3−1a=\sqrt3-1a=3​−1 the ratio of milestones 4 and 1 tends to (1+a2/2)/(1+a)=3−1(1+a^2/2)/(1+a)=\sqrt3-1(1+a2/2)/(1+a)=3​−1.

Significance

The bound shows that random order with non-identical distributions is strictly harder for the gambler than i.i.d. values: the constant cannot exceed 3−1≈0.732\sqrt3-1\approx0.7323​−1≈0.732, which is below 0.7450.7450.745. It improves the 11/1511/1511/15 bound of Azar, Chiplunkar and Kaplan and extends it from deterministic distribution-insensitive algorithms to all strategies, including randomized ones that know the distributions. With the 0.6690.6690.669 guarantee of the same paper, it brackets the optimal prophet secretary constant in [0.669,0.732][0.669, 0.732][0.669,0.732]. Later work raised the lower end, but the exact value is still open.

The result is proved in the paper. It is not formalized anywhere we know of, and no prophet secretary statement exists on the platform. Formalizing it means writing down a general model of randomized stopping strategies in random order, which other random-order results can reuse. The heart of the proof is a dynamic-programming argument that is easy to state informally and has never been machine-checked. The finite-nnn bound of milestone 4, with an explicit constant in place of O(1/n)O(1/n)O(1/n), is also a welcome contribution.

Difficulty

Computing the value of one good strategy on the §5 instance is routine (milestone 3). The goal, though, quantifies over every strategy, including randomized ones that observe identities and the whole history. The paper's sentence "Solving the dynamic programming, the algorithm picks the value aaa if and only if it appears at time jjj or later" carries the whole reduction. It requires:

  • showing that accepting a value nnn is always optimal;
  • showing that accepting a 000 never helps;
  • showing that randomization does not help;
  • showing that the only relevant state is the time and whether Vn+1V_{n+1}Vn+1​ has already passed.

Bounding a few natural strategies does not suffice. The asymptotic analysis must also be made uniform in the strategy, so that a single constant CCC in O(1/n)O(1/n)O(1/n) works for all of them.

Formalization scope

  • Indices are 0-based. The paper's ViV_iVi​ is coordinate i−1i-1i−1 of Fin (n+1), and Vn+1V_{n+1}Vn+1​ is Fin.last n.
  • Independence is built in through the product measure Measure.pi μ.
  • The uniform order is the average over all N!N!N! permutations.
  • The seed is uniform on [0,1][0,1][0,1] (volume.restrict (Icc 0 1)).
  • Expectations are lower Lebesgue integrals in [0,∞][0,\infty][0,∞] of ENNReal.ofReal of the reward, so no integrability hypotheses appear.
  • A conditional expectation given σi=n+1\sigma_i=n+1σi​=n+1 is written in joint form, as (n+1)(n+1)(n+1) times the expectation on that event.
  • The strategy class (Strategy N) is the class of all measurable decision rules on the full observed history plus an independent seed, and it is quantified after the instance. Restricting it to threshold rules, time-jjj rules or deterministic rules would make the goal a different, weaker theorem; that restriction is ruled out. The class is nonempty, and its measurability requirement is satisfiable: jRule carries its proof.
  • The instance is not required to have continuous laws. The paper assumes continuity only for its blind strategies, and the §5 instance has atoms.
  • The goal adds 0<E(max⁡)<∞0<\mathbb E(\max)<\infty0<E(max)<∞, which the §5 instance satisfies; this excludes a degenerate instance.
  • §5 writes max⁡i∈[n]\max_{i\in[n]}maxi∈[n]​, but the maximum is over all n+1n+1n+1 variables, since the formula contains aaa. The Lean states the corrected reading.
  • The PDF used is arXiv:1807.07483v2. Pages are PDF pages, because the preprint prints no page numbers.

Reusable infrastructure includes the random-order stopping model, the reward of the first stop, and the dynamic-programming reduction for a single deterministic variable. Contributions are welcome on any milestone, and on an explicit CCC in milestone 4.

Selected references

  • J. Correa, R. Saona, B. Ziliotto, Prophet Secretary Through Blind Strategies, arXiv:1807.07483v2, 2019; Mathematical Programming, 2021. https://arxiv.org/abs/1807.07483
  • S. Esfandiari, M. HajiAghayi, V. Liaghat, M. Monemizadeh, Prophet Secretary, ESA 2015; SIAM J. Discrete Math. 31(3), 2017. https://doi.org/10.1137/15M1029394
  • S. Ehsani, M. Hajiaghayi, T. Kesselheim, S. Singla, Prophet Secretary for Combinatorial Auctions and Matroids, SODA 2018. https://arxiv.org/abs/1710.11213
  • Y. Azar, A. Chiplunkar, H. Kaplan, Prophet Secretary: Surpassing the 1 − 1/e Barrier, EC 2018. https://arxiv.org/abs/1711.01834
  • T. P. Hill, R. P. Kertz, Comparisons of stop rule and supremum expectations of i.i.d. random variables, Annals of Probability 10(2), 1982. https://doi.org/10.1214/aop/1176993772
  • J. Correa, P. Foncea, R. Hoeksma, T. Oosterwijk, T. Vredeveld, Posted Price Mechanisms for a Random Stream of Customers, EC 2017. https://doi.org/10.1145/3033274.3085137
7 thms2 active usersReviewed
Control TheoryMarkov ChainStochastic Systems·Captain: mikedeng1

Strong and Weak Equilibria for Time-Inconsistent Stochastic Control in Continuous Time 1: Weak and Strong Equilibria Exist When the Admissible Generator Rows Form Convex Compact SetsResearch Paper

Motivation

An agent whose preferences change over time cannot simply optimize. Under non-exponential discounting, for instance hyperbolic or pseudo-exponential discount functions, a plan that is optimal today stops being optimal tomorrow, and a later self deviates from it. Strotz (1955) proposed that a sophisticated agent treat future selves as players in a game and look for a subgame-perfect equilibrium strategy instead. In discrete time this notion is unambiguous. In continuous time, Ekeland and Lazrak (2006) gave the first rigorous definition, through a first-order (derivative-type) condition, and nearly all later work on time-inconsistent stochastic control in continuous time uses it.

Huang and Zhou (2021) point out that this standard notion, here called a weak equilibrium, can admit strategies that the agent strictly wants to abandon over arbitrarily short intervals. They introduce a strong equilibrium, which rules out every profitable short deviation. For a controlled finite-state Markov chain they characterize both notions and prove that both exist under compactness. This mission formalizes that existence theorem together with the expansions and characterizations it rests on.

Setting

Let S={1,…,N}S=\{1,\dots,N\}S={1,…,N}. A continuous-time Markov chain XXX on SSS is controlled through its generator Q∈RN×NQ\in\mathbb R^{N\times N}Q∈RN×N, with iii-th row QiQ_iQi​. A row must lie in

Ei={q∈RN:qj≥0 (j≠i), qi=−∑j≠iqj},E_i=\Big\{q\in\mathbb R^N: q_j\ge0\ (j\ne i),\ q_i=-\sum_{j\ne i}q_j\Big\},Ei​={q∈RN:qj​≥0 (j=i), qi​=−j=i∑​qj​},

and an admissible set Di⊆EiD_i\subseteq E_iDi​⊆Ei​ is fixed for each state. The control space is Q={Q:Qi∈Di ∀i}\mathcal Q=\{Q: Q_i\in D_i\ \forall i\}Q={Q:Qi​∈Di​ ∀i}.

A payoff rate f(t,i,q)f(t,i,q)f(t,i,q) is paid at time difference t≥0t\ge0t≥0 when the chain is in state iii and uses row qqq. The standing assumptions are that t↦f(t,i,q)t\mapsto f(t,i,q)t↦f(t,i,q) is continuous on [0,∞)[0,\infty)[0,∞) and that, for every c>0c>0c>0, sup⁡i, q∈Di, ∥q∥≤c∣f(t,i,q)∣\sup_{i,\,q\in D_i,\,\|q\|\le c}|f(t,i,q)|supi,q∈Di​,∥q∥≤c​∣f(t,i,q)∣ is integrable in ttt. The expected payoff is

F(i,Q)=Ei,Q[∫0∞f(t,Xt,QXt) dt],F(Q)=(F(1,Q),…,F(N,Q)).F(i,Q)=\mathbb E_{i,Q}\Big[\int_0^\infty f(t,X_t,Q_{X_t})\,dt\Big],\qquad F(Q)=(F(1,Q),\dots,F(N,Q)).F(i,Q)=Ei,Q​[∫0∞​f(t,Xt​,QXt​​)dt],F(Q)=(F(1,Q),…,F(N,Q)).

For ε>0\varepsilon>0ε>0, the concatenation Q⊗εQ∗Q\otimes_\varepsilon Q^*Q⊗ε​Q∗ follows QQQ on [0,ε][0,\varepsilon][0,ε] and Q∗Q^*Q∗ afterwards.

  • Q∗∈QQ^*\in\mathcal QQ∗∈Q is a weak equilibrium if lim inf⁡ε↓0(F(i,Q∗)−F(i,Q⊗εQ∗))/ε≥0\liminf_{\varepsilon\downarrow0}\big(F(i,Q^*)-F(i,Q\otimes_\varepsilon Q^*)\big)/\varepsilon\ge0liminfε↓0​(F(i,Q∗)−F(i,Q⊗ε​Q∗))/ε≥0 for all Q∈QQ\in\mathcal QQ∈Q and i∈Si\in Si∈S.
  • Q∗∈QQ^*\in\mathcal QQ∗∈Q is a strong equilibrium if for all iii and QQQ there is ε>0\varepsilon>0ε>0 with F(i,Q∗)≥F(i,Q⊗ε′Q∗)F(i,Q^*)\ge F(i,Q\otimes_{\varepsilon'}Q^*)F(i,Q∗)≥F(i,Q⊗ε′​Q∗) for every 0<ε′≤ε0<\varepsilon'\le\varepsilon0<ε′≤ε.

The first-order gain of a row qqq in state iii is ΓQ∗(q)=f(0,i,q)+q⋅F(Q∗)\Gamma^{Q^*}(q)=f(0,i,q)+q\cdot F(Q^*)ΓQ∗(q)=f(0,i,q)+q⋅F(Q∗).

Formalization targets

Goal: Theorem 3.3 (p. 10)

Suppose every DiD_iDi​ is nonempty, convex and compact, q↦f(t,i,q)q\mapsto f(t,i,q)q↦f(t,i,q) is continuous on DiD_iDi​, and f(0,i,⋅)f(0,i,\cdot)f(0,i,⋅) is concave. Then

∃ Q∗∈Q weak equilibrium.\exists\,Q^*\in\mathcal Q\ \text{weak equilibrium}.∃Q∗∈Q weak equilibrium.

If moreover f(0,i,⋅)f(0,i,\cdot)f(0,i,⋅) is strictly concave and fff satisfies the C1C^1C1 and remainder conditions of Lemma 3.2, then

∃ Q∗∈Q strong equilibrium.\exists\,Q^*\in\mathcal Q\ \text{strong equilibrium}.∃Q∗∈Q strong equilibrium.

Milestones

  1. Lemma 3.1 (p. 6): the first-order expansions (3.2) and, under the shift bound (3.3)–(3.5),
F(i,Q∗)−F(i,Q⊗εQ∗)=(ΓQ∗(Qi∗)−ΓQ∗(Qi))ε+o(ε).F(i,Q^*)-F(i,Q\otimes_\varepsilon Q^*)=\big(\Gamma^{Q^*}(Q^*_i)-\Gamma^{Q^*}(Q_i)\big)\varepsilon+o(\varepsilon).F(i,Q∗)−F(i,Q⊗ε​Q∗)=(ΓQ∗(Qi∗​)−ΓQ∗(Qi​))ε+o(ε).
  1. Theorem 3.1 (p. 7): Q∗Q^*Q∗ is a weak equilibrium iff ΓQ∗(Qi∗)≥ΓQ∗(Qi)\Gamma^{Q^*}(Q^*_i)\ge\Gamma^{Q^*}(Q_i)ΓQ∗(Qi∗​)≥ΓQ∗(Qi​) for all (i,Q)(i,Q)(i,Q).
  2. Continuity of Q↦F(Q)Q\mapsto F(Q)Q↦F(Q) on Q\mathcal QQ (proof of Theorem 3.3, p. 26).
  3. The best-response map Φ(Q)={R∈Q:Ri∈arg⁡max⁡q∈Di[f(0,i,q)+F(Q)⋅q]}\Phi(Q)=\{R\in\mathcal Q: R_i\in\arg\max_{q\in D_i}[f(0,i,q)+F(Q)\cdot q]\}Φ(Q)={R∈Q:Ri​∈argmaxq∈Di​​[f(0,i,q)+F(Q)⋅q]} has nonempty closed convex values and is upper semicontinuous (p. 26).
  4. Kakutani's fixed-point theorem, already proved on the platform, as used on p. 26.
  5. Lemma 3.2 (p. 8): the second-order expansion (3.16) with coefficient ΛQ∗\Lambda^{Q^*}ΛQ∗ (3.17).
  6. Proposition 3.2 (p. 9): strict inequality in the gain whenever Qi≠Qi∗Q_i\ne Q^*_iQi​=Qi∗​ implies a strong equilibrium.
  7. Remark 2.3 (p. 5): every strong equilibrium is weak.

Significance

Theorem 3.3 is the general existence result of the paper. Theorem 3.1 and Proposition 3.2 give a way to find equilibria in a given model, but they do not say whether one exists. Remark 3.4 shows that without compactness of the DiD_iDi​, no equilibrium need exist. The strong half shows that the stricter concept is not empty in general: under strict concavity a strong equilibrium exists. Example 4.3 of the paper shows that weak equilibria need not be strong, so the two halves are different results.

The paper gives a proof, and none of it has been formalized. A formalization produces a checked equilibrium-existence theorem for a controlled continuous-time Markov chain. It also produces reusable small-time expansions of matrix-exponential payoffs. These expansions are shared by the paper's other results: the two-state example and the convergence of discrete-time equilibria.

Difficulty

The fixed-point step itself is routine once its hypotheses are in place. The work lies in the analysis that feeds it. First, the continuity of Q↦F(Q)Q\mapsto F(Q)Q↦F(Q) needs a limit passage under an infinite-horizon integral, which requires a uniform integrable bound on fff along a converging sequence of generators. Second, the step from a fixed point to a weak equilibrium goes through Theorem 3.1, whose hypothesis (3.3) is not among those of Theorem 3.3. Showing that Fε(i,Q)→F(i,Q)F_\varepsilon(i,Q)\to F(i,Q)Fε​(i,Q)→F(i,Q) without (3.3) is not one of the paper's numbered statements. Third, the strong half needs Proposition 3.2. Its proof treats deviations that agree with Q∗Q^*Q∗ in the current state, which are felt only at second or higher order in ε\varepsilonε, through the first order at which the chain can reach a state where the deviation differs. The obvious argument, comparing first-order terms only, says nothing in that case.

Formalization scope

States are Fin N, so state kkk of the paper is index k−1k-1k−1. Rows are Fin N → ℝ and generators are Matrix (Fin N) (Fin N) ℝ with the entrywise topology. Expectations are not built from a Markov process. Under QQQ the law of XtX_tXt​ given X0=iX_0=iX0​=i is the iii-th row of etQe^{tQ}etQ, so F(i,Q)=∫0∞∑j(etQ)ijf(t,j,Qj) dtF(i,Q)=\int_0^\infty\sum_j(e^{tQ})_{ij}f(t,j,Q_j)\,dtF(i,Q)=∫0∞​∑j​(etQ)ij​f(t,j,Qj​)dt. Under Q⊗εQ′Q\otimes_\varepsilon Q'Q⊗ε​Q′ the transition matrix is etQe^{tQ}etQ for t≤εt\le\varepsilont≤ε and eεQe(t−ε)Q′e^{\varepsilon Q}e^{(t-\varepsilon)Q'}eεQe(t−ε)Q′ afterwards. Integrals are Bochner integrals over (0,∞)(0,\infty)(0,∞). The norm in (2.3) is the sup norm, which is equivalent because (2.3) quantifies over every c>0c>0c>0. The liminf in the weak-equilibrium definition is encoded as "for every η>0\eta>0η>0, eventually ≥−η\ge-\eta≥−η". "Increasing" in (3.4) and (3.15) means nondecreasing.

Two hypotheses are added to the printed Theorem 3.3:

  • Di≠∅D_i\neq\emptysetDi​=∅. Otherwise Q\mathcal QQ is empty.
  • Continuity of q↦f(t,i,q)q\mapsto f(t,i,q)q↦f(t,i,q) on DiD_iDi​. The proof uses it, and the printed statement is false without it: a payoff whose sign jumps in qqq admits no weak equilibrium.

The shift bound (3.3) is deliberately not assumed in the weak half. No statement assumes integrability of a payoff; it follows from (2.3) because etQe^{tQ}etQ is a stochastic matrix. The time derivative ftf_tft​ in Lemma 3.2 is tied to fff by a derivative condition, and Λ\LambdaΛ is meaningless otherwise. These choices rule out formalizations that are trivially true because an integral is junk or an admissible set is empty. Every hypothesis on fff ranges over q∈Diq\in D_iq∈Di​ only.

A complete development needs:

  • dominated convergence for integrals over (0,∞)(0,\infty)(0,∞);
  • small-time expansions of eεQe^{\varepsilon Q}eεQ;
  • the fact that etQe^{tQ}etQ is stochastic for a generator;
  • the identification of RN×N\mathbb R^{N\times N}RN×N with a Euclidean space, to apply the referenced Kakutani theorem.

The matrix-exponential facts about generators are reusable beyond this mission. Contributions to any milestone are welcome, and so are lemmas on generators and etQe^{tQ}etQ.

Selected references

  • Y.-J. Huang and Z. Zhou, Strong and Weak Equilibria for Time-Inconsistent Stochastic Control in Continuous Time, Mathematics of Operations Research 46(2), 2021; read as arXiv:1809.09243v3. https://arxiv.org/abs/1809.09243 , https://doi.org/10.1287/moor.2020.1066
  • I. Ekeland and A. Lazrak, Being serious about non-commitment: subgame perfect equilibrium in continuous time, technical report, University of British Columbia, 2006. https://arxiv.org/abs/math/0604264
  • R. H. Strotz, Myopia and inconsistency in dynamic utility maximization, Review of Economic Studies 23(3), 1955. https://doi.org/10.2307/2295722
  • K. Fan, Fixed-point and minimax theorems in locally convex topological linear spaces, PNAS 38(2), 1952. https://doi.org/10.1073/pnas.38.2.121
  • S. Kakutani, A generalization of Brouwer's fixed point theorem, Duke Mathematical Journal 8(3), 1941. https://doi.org/10.1215/S0012-7094-41-00838-4
13 thms2 active usersReviewed
Convex OptimizationDynamical Systems·Captain: mikedeng1

Learning in Games via Reinforcement and Regularization 2: Under Regularized Reinforcement Learning, Every Strict Nash Equilibrium Is Asymptotically StableResearch Paper

Motivation

In a repeated game, players who do not know the payoff structure can still learn by reinforcement: each player keeps a running score for every action, the cumulative payoff that action would have earned, and plays a mixed strategy that favours actions with high scores. Turning scores into mixed strategies through a regularized best response (maximize score minus a convex penalty) gives a family of dynamics that includes exponential weights and the replicator dynamics (entropic penalty), and also the projection dynamics (quadratic penalty). The same scheme is the continuous-time counterpart of online mirror descent and dual averaging in online optimization.

For the replicator dynamics, the standard folk results of evolutionary game theory say that Nash equilibria are stationary, that limits of interior orbits are Nash equilibria, that Lyapunov stable states are Nash equilibria, and that strict equilibria are asymptotically stable (Weibull 1995; Hofbauer–Sigmund 1998). Mertikopoulos and Sandholm (arXiv:1407.6267v2, Math. Oper. Res. 41(4), 2016) show that all four results survive for the whole family. For steep, decomposable penalties several of them were known (Coucheney–Gaujal–Mertikopoulos 2015). The new part is the nonsteep case, where mixed strategies can hit the boundary of the simplex and the induced dynamics on strategies are no longer well defined.

Setting

A finite game G\mathcal GG has a finite set N\mathcal NN of players. Player kkk has a finite nonempty set Ak\mathcal A_kAk​ of pure strategies and a payoff function uk:∏ℓAℓ→Ru_k:\prod_\ell\mathcal A_\ell\to\mathbb Ruk​:∏ℓ​Aℓ​→R. A mixed profile is x=(xk)k∈X=∏kΔ(Ak)x=(x_k)_k\in\mathcal X=\prod_k\Delta(\mathcal A_k)x=(xk​)k​∈X=∏k​Δ(Ak​), and uk(x)u_k(x)uk​(x) is player kkk's expected payoff when the players randomize independently. The payoff vector is vkα(x)=uk(α;x−k)v_{k\alpha}(x)=u_k(\alpha;x_{-k})vkα​(x)=uk​(α;x−k​), the payoff of pure strategy α\alphaα against x−kx_{-k}x−k​.

A penalty function on a simplex Δ\DeltaΔ (Definition 2.1) is a function h:Δ→Rh:\Delta\to\mathbb Rh:Δ→R that is continuous, smooth on the relative interior of every face, and KKK-strongly convex:

h(tx1+(1−t)x2)≤t h(x1)+(1−t) h(x2)−12Kt(1−t)∥x1−x2∥22.h(tx_1+(1-t)x_2)\le t\,h(x_1)+(1-t)\,h(x_2)-\tfrac12Kt(1-t)\|x_1-x_2\|_2^2 .h(tx1​+(1−t)x2​)≤th(x1​)+(1−t)h(x2​)−21​Kt(1−t)∥x1​−x2​∥22​.

Steepness (gradients blowing up at the boundary) is not required. Its choice map is Q(y)=arg⁡max⁡x∈Δ{⟨y∣x⟩−h(x)}Q(y)=\arg\max_{x\in\Delta}\{\langle y|x\rangle-h(x)\}Q(y)=argmaxx∈Δ​{⟨y∣x⟩−h(x)}. Every player kkk has a penalty function hkh_khk​ with constant KkK_kKk​.

The reinforcement learning dynamics (RL) are

y˙kα=vkα(x),xk=Qk(yk),\dot y_{k\alpha}=v_{k\alpha}(x),\qquad x_k=Q_k(y_k),y˙​kα​=vkα​(x),xk​=Qk​(yk​),

and an orbit is a pair (y(t),x(t))(y(t),x(t))(y(t),x(t)), t≥0t\ge0t≥0, satisfying them. A Nash equilibrium is a profile x∗x^*x∗ with uk(x∗)≥uk(xk;x−k∗)u_k(x^*)\ge u_k(x_k;x^*_{-k})uk​(x∗)≥uk​(xk​;x−k∗​) for every kkk and every mixed xkx_kxk​. It is strict if the inequality is strict for every xk≠xk∗x_k\neq x^*_kxk​=xk∗​.

Because (RL) lives in the space of scores and QQQ is neither injective nor surjective, stability is defined on the trajectories of play (Definition 5.1):

  • x∗x^*x∗ is Lyapunov stable if for every ε>0\varepsilon>0ε>0 there is δ>0\delta>0δ>0 such that every orbit with ∥x(0)−x∗∥<δ\|x(0)-x^*\|<\delta∥x(0)−x∗∥<δ stays within ε\varepsilonε of x∗x^*x∗ forever;
  • it is attracting if every orbit started close enough to x∗x^*x∗ converges to x∗x^*x∗;
  • it is asymptotically stable if it is both;
  • it is stationary if x∗∈im⁡Qx^*\in\operatorname{im}Qx∗∈imQ and every orbit with x(0)=x∗x(0)=x^*x(0)=x∗ stays at x∗x^*x∗.

Formalization targets

Goal: Theorem 5.2, Part IV

x∗ strict Nash equilibrium of G ⟹ x∗ asymptotically stable under (RL),x^*\ \text{strict Nash equilibrium of }\mathcal G\ \Longrightarrow\ x^*\ \text{asymptotically stable under (RL)},x∗ strict Nash equilibrium of G ⟹ x∗ asymptotically stable under (RL),

for every finite game and every choice of penalty functions hkh_khk​, steep or not.

Milestones (the steps of the proof, pp. 23–24, and the Appendix results it uses)

  • A strict equilibrium is a pure profile x∗=(α1∗,…,αN∗)x^*=(\alpha^*_1,\dots,\alpha^*_N)x∗=(α1∗​,…,αN∗​), and δk=min⁡μ≠αk∗{vkαk∗(x∗)−vkμ(x∗)}>0\delta_k=\min_{\mu\neq\alpha^*_k}\{v_{k\alpha^*_k}(x^*)-v_{k\mu}(x^*)\}>0δk​=minμ=αk∗​​{vkαk∗​​(x∗)−vkμ​(x∗)}>0.
  • Proposition A.1(iii): Qα(y)→0Q_\alpha(y)\to0Qα​(y)→0 whenever yα−yβ→−∞y_\alpha-y_\beta\to-\inftyyα​−yβ​→−∞.
  • Proposition C.3: the Fenchel coupling Fh(p,y)=h(p)+h∗(y)−⟨y∣p⟩F_h(p,y)=h(p)+h^*(y)-\langle y|p\rangleFh​(p,y)=h(p)+h∗(y)−⟨y∣p⟩ satisfies Fh(p,y)≥12K∥Q(y)−p∥2F_h(p,y)\ge\tfrac12K\|Q(y)-p\|^2Fh​(p,y)≥21​K∥Q(y)−p∥2.
  • Proposition C.2(i)–(iii): the Bregman divergence Dh(p,x)=h(p)−h(x)−h′(x;p−x)D_h(p,x)=h(p)-h(x)-h'(x;p-x)Dh​(p,x)=h(p)−h(x)−h′(x;p−x), built from the one-sided derivative, is finite, nonnegative with (C.6), and continuous on Δp={x:supp⁡x⊇supp⁡p}\Delta_p=\{x:\operatorname{supp}x\supseteq\operatorname{supp}p\}Δp​={x:suppx⊇suppp}.
  • (C.11): Fh(p,y)=Dh(p,Q(y))F_h(p,y)=D_h(p,Q(y))Fh​(p,y)=Dh​(p,Q(y)) whenever Q(y)∈ΔpQ(y)\in\Delta_pQ(y)∈Δp​.
  • The monotonicity step: h∗(y)−yα∗=max⁡x{∑μ≠α∗xμzμ−h(x)}h^*(y)-y_{\alpha^*}=\max_{x}\{\sum_{\mu\ne\alpha^*}x_\mu z_\mu-h(x)\}h∗(y)−yα∗​=maxx​{∑μ=α∗​xμ​zμ​−h(x)} is nondecreasing in the relative scores zμ=yμ−yα∗z_\mu=y_\mu-y_{\alpha^*}zμ​=yμ​−yα∗​.

Companions

Theorem 5.2, Parts I–III (stationary   ⟺  \iff⟺ Nash and in im⁡Q\operatorname{im}QimQ; limits of orbits and Lyapunov stable states are Nash), Proposition 5.3, Proposition 3.1 (global existence and uniqueness of orbits) and Proposition A.1(i)–(ii).

Significance

Theorem 5.2 says that, as far as the qualitative long-run behaviour is concerned, the whole class of regularized reinforcement dynamics behaves like the replicator dynamics. Part IV is the positive half: strict equilibria are robust attractors of learning. This is used to justify equilibrium selection by learning, and Proposition 5.4 (not part of this mission) builds the rates of convergence, including convergence in finite time for nonsteep penalties, on top of it.

The result is proved in the paper; none of it is formalized. A Lean development would provide a reusable layer of game-theoretic learning dynamics: penalty functions without steepness, choice maps as regularized argmax, the Fenchel coupling and the one-sided Bregman divergence on the simplex. Two companion missions on the same paper use the same layer, for the extinction of dominated strategies and for time averages in zero-sum games. As far as is known, the stability theory of Section 5 has no machine-checked proof even for the replicator dynamics.

Difficulty

The obvious argument would be a Lyapunov argument for the induced dynamics on X\mathcal XX, as for the replicator equation. For nonsteep penalties these dynamics are not well defined: orbits reach the boundary and QQQ is not invertible there. The proof works in the dual space instead, where the natural Lyapunov candidate is the Fenchel coupling Fh(x∗,y)F_h(x^*,y)Fh​(x∗,y). The coupling is not differentiable along the orbit in the usual sense, and its sublevel sets in score space must be related to genuine neighbourhoods of x∗x^*x∗ in X\mathcal XX. That needs the Bregman divergence with one-sided derivatives at boundary points and its continuity across faces of different dimension (Proposition C.2(iii)). A second obstacle is that the coupling does not strictly decrease when the maximizer sits at the vertex. The page states a strict inequality there, which fails for nonsteep penalties, so the argument has to be run with the weak inequality and a first-exit-time argument.

Formalization scope

  • The game uses the published agt_games vocabulary: AGT.IsLottery, AGT.IsMixedProfile, AGT.expectedPayoff, and AGT.IsMixedNash for (5.1). Players form a Fintype ι, and actions are A k with Fintype and DecidableEq.
  • Penalty functions are IsPenalty h K, Definition 2.1 with the Euclidean norm in (2.5) and C∞C^\inftyC∞ smoothness along curves inside the relative interiors of faces. There is no steepness.
  • The choice map is the predicate IsChoice h y x, never a chosen argmax.
  • Orbits are IsRLOrbit u h y x, the differential form (3.1) with one-sided derivatives at t=0t=0t=0. Statements quantify over orbits and never construct one.
  • Neighbourhoods of x∗x^*x∗ in X\mathcal XX are balls of the sup metric on ∏kRAk\prod_k\mathbb R^{\mathcal A_k}∏k​RAk​, and Definition 5.1 is stated in ε\varepsilonε–δ\deltaδ form.
  • Strict equilibria are not assumed pure; purity is a milestone.
  • The one-sided derivative (C.3) is a limit predicate with a real value, so the Bregman divergence's value +∞+\infty+∞ is never represented by a junk number.
  • Proposition 3.1 adds that every Ak\mathcal A_kAk​ is nonempty. This is implicit in "finite game", and without it no orbit exists.
  • The monotonicity step is stated with ≤\le≤, not the printed <<<.

Trivializing encodings are excluded. Q is not a chosen maximizer that could be chosen badly. Orbit hypotheses are not vacuous: a verification file exhibits an orbit and a strict equilibrium together with a penalty function. Steepness is not added to the hypotheses. The conclusion is genuine convergence x(t)→x∗x(t)\to x^*x(t)→x∗ together with Lyapunov stability, not a lim inf⁡\liminfliminf or a stability-only statement. Proofs of any milestone are welcome. The conjugate and Bregman layer (Appendix C), the regularized-argmax lemmas (Appendix A) and the well-posedness of (RL) (Proposition 3.1) are reusable beyond this mission.

Selected references

  • P. Mertikopoulos and W. H. Sandholm, Learning in games via reinforcement and regularization, Math. Oper. Res. 41(4), 2016. Cited as arXiv:1407.6267v2. https://arxiv.org/abs/1407.6267v2
  • P. Coucheney, B. Gaujal and P. Mertikopoulos, Penalty-regulated dynamics and robust learning procedures in games, Math. Oper. Res. 40(3), 2015. https://doi.org/10.1287/moor.2014.0687
  • J. W. Weibull, Evolutionary Game Theory, MIT Press, 1995. https://mitpress.mit.edu/9780262731218/
  • J. Hofbauer and K. Sigmund, Evolutionary Games and Population Dynamics, Cambridge University Press, 1998. https://doi.org/10.1017/CBO9781139173179
  • K. C. Kiwiel, Free-steering relaxation methods for problems with strictly convex costs and linear constraints, Math. Oper. Res. 22(2), 1997. https://doi.org/10.1287/moor.22.2.326
12 thms2 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

Intrinsic Robustness of the Price of Anarchy III: For Every Set of Cost Functions, Congestion Games Are Tight — the Worst-Case Pure Price of Anarchy Equals the Best Smoothness BoundResearch Paper

Motivation

In a congestion game, each player chooses resources and pays a cost that depends on how many players use each chosen resource. Such games model shared facilities and network use, where independently chosen strategies can cost more in total than a coordinated choice. The price of anarchy measures this inefficiency by comparing the social cost of an equilibrium with the minimum social cost. A familiar way to bound it is to prove a smoothness inequality that applies to every pair of strategy profiles. That inequality has a useful reach: once established, it bounds not only pure Nash equilibria but also broader equilibrium notions. The question in this mission is how much that reach costs in sharpness. Roughgarden (2015) proves that for congestion games it costs nothing at the level of the worst case over any fixed collection of allowed resource cost functions.

For affine resource costs, earlier analyses had already identified a worst-case value of 5/25/25/2, attained by a finite congestion game and matched by a smoothness bound. The 2015 paper asks whether this agreement reflects affine costs or a general property of congestion games. Its Theorem 5.8 gives the latter answer, even when the collection of allowed functions is infinite and has no prescribed formula. The mission treats the theorem at that generality, while giving the finite positive case and the boundary case their own supporting targets. Roughgarden (2015), §§2.3 and 5.

Setting

A finite congestion game has a finite player set, a finite resource set EEE, and for each player iii a nonempty set SiS_iSi​ of subsets of EEE called strategies. Each resource eee has a cost function ce:N→Rc_e:\mathbb N\to\mathbb Rce​:N→R. For a strategy profile A=(Ai)iA=(A_i)_iA=(Ai​)i​, its load xe(A)x_e(A)xe​(A) is the number of players whose selected strategy contains eee. Player iii pays Ci(A)=∑e∈Aice(xe(A))C_i(A)=\sum_{e\in A_i}c_e(x_e(A))Ci​(A)=∑e∈Ai​​ce​(xe​(A)), and the social cost is C(A)=∑iCi(A)C(A)=\sum_i C_i(A)C(A)=∑i​Ci​(A). A profile is a pure Nash equilibrium when no player can lower its own cost by changing its strategy alone. These are the objects of Example 2.5 in Roughgarden (2015).

Fix a nonempty set C\mathcal CC of resource cost functions, each nonnegative, nondecreasing, and not identically zero on positive loads. The class G(C)\mathcal G(\mathcal C)G(C) contains every finite congestion game whose resource functions belong to C\mathcal CC. It permits any finite number of players and resources and any nonempty strategy families. The pure price of anarchy ρpure(G)\rho_{\mathrm{pure}}(G)ρpure​(G) is the largest equilibrium-to-optimum cost ratio in one game, allowing +∞+\infty+∞ when an equilibrium costs more than zero but the optimum costs zero.

A game is (λ,μ)(\lambda,\mu)(λ,μ)-smooth if, for every two feasible profiles A,A∗A,A^*A,A∗, the sum of the player costs after each player individually switches from AiA_iAi​ to Ai∗A_i^*Ai∗​ is at most λC(A∗)+μC(A)\lambda C(A^*)+\mu C(A)λC(A∗)+μC(A). The set A(G(C))\mathcal A(\mathcal G(\mathcal C))A(G(C)) consists of pairs with μ<1\mu<1μ<1 that satisfy this inequality for every game in the class. A related resourcewise set A(C)\mathcal A(\mathcal C)A(C) asks, for every c∈Cc\in\mathcal Cc∈C, current load x≥0x\ge0x≥0, and comparison load x∗≥1x^*\ge1x∗≥1, that

c(x+1)x∗≤λc(x∗)x∗+μc(x)x.c(x+1)x^*\le\lambda c(x^*)x^*+\mu c(x)x.c(x+1)x∗≤λc(x∗)x∗+μc(x)x.

Its best ratio is γ(C)=inf⁡(λ,μ)∈A(C)λ/(1−μ)\gamma(\mathcal C)=\inf_{(\lambda,\mu)\in\mathcal A(\mathcal C)}\lambda/(1-\mu)γ(C)=inf(λ,μ)∈A(C)​λ/(1−μ), with value +∞+\infty+∞ if there is no admissible pair. The bounded-load versions A(C,n)\mathcal A(\mathcal C,n)A(C,n) and γ(C,n)\gamma(\mathcal C,n)γ(C,n) use 0≤x≤n0\le x\le n0≤x≤n and 1≤x∗≤n1\le x^*\le n1≤x∗≤n. Roughgarden (2015), equations (34)–(36) and (41).

Formalization targets

Tightness of the congestion-game class

Theorem 5.8, in the form of equation (34), is the goal:

sup⁡G∈G(C)ρpure(G)=inf⁡(λ,μ)∈A(G(C))λ1−μ.\sup_{G\in\mathcal G(\mathcal C)}\rho_{\mathrm{pure}}(G) =\inf_{(\lambda,\mu)\in\mathcal A(\mathcal G(\mathcal C))}\frac{\lambda}{1-\mu}.G∈G(C)sup​ρpure​(G)=(λ,μ)∈A(G(C))inf​1−μλ​.

It applies to every nonempty set C\mathcal CC satisfying the standing cost-function conditions, whether finite, countable, or uncountable. Neither the number of players nor the number of resources is fixed. The equality is stronger than the routine upper bound from smoothness: it says that the best upper bound available from a uniform smoothness argument matches actual worst-case pure-equilibrium inefficiency. Roughgarden (2015), Theorem 5.8 and (34).

Resourcewise characterization

The paper also identifies the common value with γ(C)\gamma(\mathcal C)γ(C):

sup⁡G∈G(C)ρpure(G)=γ(C).\sup_{G\in\mathcal G(\mathcal C)}\rho_{\mathrm{pure}}(G)=\gamma(\mathcal C).G∈G(C)sup​ρpure​(G)=γ(C).

The milestone list follows the paper's statements: the general upper bound; nonnegativity of μ\muμ; passage from resource constraints to game smoothness; the bound for one game; the two finite optimization lemmas; the finite lower-bound theorem; the infinite-price boundary case; the countable case; and the characterization by γ(C)\gamma(\mathcal C)γ(C). The finite lower-bound target uses the one-sided conclusion established in the proof of Theorem 5.6. Roughgarden (2015), §§5.1–5.5.

Significance

The equality rules out a uniform improvement of the worst-case pure price-of-anarchy bound by using features of pure Nash equilibrium that a smoothness argument ignores. In this domain the broader applicability of smoothness does not force a worse class-wide bound. For a chosen cost-function family, the resourcewise characterization expresses that bound through explicit inequalities rather than a search over every possible finite game. Roughgarden (2015), §§2.4 and 5.5.

The result is proved in the paper. The remaining work here is a machine-checked proof of its formal statement and supporting theorems. The published congestion-game model supplies loads, player costs, feasible profiles, and pure Nash equilibria. The definitions of smoothness parameters and prices of anarchy built for this mission can also support later work on other cost-function classes and equilibrium bounds. The goal statement itself is a proof target, not an already verified result.

Difficulty

The smoothness inequality immediately gives an upper bound on equilibrium costs, but it does not by itself show that a game attains or approaches that bound. The difficult direction relates a small family of resourcewise constraints to actual games with inefficient equilibria. For finite positive cost-function sets, the optimum parameter value may be attained or may be approached only at infinity in parameter space; the two cases have different statements in Lemmas 5.3 and 5.5. The general theorem must also cover functions that vanish at a positive load, unbounded worst-case ratios, and sets of functions of arbitrary cardinality. Simply optimizing a bound for one fixed game would miss the supremum over the entire class. Roughgarden (2015), §§5.2–5.4.

Formalization scope

Lean represents players and resources by Fin k and Fin m and quantifies over every k,m∈Nk,m\in\mathbb Nk,m∈N. A strategy is a finite resource subset, a strategy family is finite and nonempty, and all costs are real-valued at each load. The value c(0)c(0)c(0) is unrestricted because it is unused in a player's cost and is multiplied by zero in (35). The all-zero function is excluded as in §5.1. Nonemptiness of C\mathcal CC, stated at the start of that section, is carried into the finite optimization lemmas because their conclusions select functions from C\mathcal CC. Zero-player and zero-resource games are allowed and do not raise the worst-case supremum.

Prices of anarchy and the values γ\gammaγ are extended nonnegative reals. Thus an empty smoothness-parameter set has infimum +∞+\infty+∞; a positive equilibrium cost over zero optimum gives +∞+\infty+∞; and a game with no equilibrium contributes zero to the supremum. The paper's finite congestion games with nonempty strategy sets do have pure equilibria. The conversion of a real ratio λ/(1−μ)\lambda/(1-\mu)λ/(1−μ) into this type does not truncate admissible class-wide ratios: if some cost function has c(1)>0c(1)>0c(1)>0, a one-resource game forces the ratio to be at least one; if none does, the parameter set is empty. Smoothness and optimum quantify over feasible profiles only. These choices prevent the equality from becoming vacuous through an empty real infimum, total division by zero, or a supremum over a fixed small game size.

The complete development needs finite-set sums, function updates, extended nonnegative infima and suprema, and the published congestion-game definitions. Reusable contributions include lemmas about the resourcewise parameter sets and their relation to game smoothness. The paper's uncountable approximation paragraph has a gap for flat cost functions; the theorem remains the stated target, and a formal proof may use a different argument at that stage. Roughgarden (2015), pp. 31–32.

Selected references

  • Tim Roughgarden, Intrinsic Robustness of the Price of Anarchy, Journal of the ACM 62(5), Article 32, 2015. DOI. The source used here is the author's final version dated July 14, 2015; the cited page numbers are its printed pages.
13 thms2 active usersReviewed
Mechanism DesignOperations ResearchProbability·Captain: mikedeng1

Approximate Revenue Maximization with Multiple Items 2: Selling Two I.I.D. Goods Separately Guarantees at Least e/(e + 1) ≈ 73% of the Optimal RevenueResearch Paper

Motivation

A seller with several goods can sell them one at a time or offer a mechanism that links allocation and payment across goods. Separate selling asks the seller to solve a one-good pricing problem for each item. A general mechanism can offer lotteries and menus whose outcomes depend on the buyer's whole valuation vector. The difference matters because the buyer's private information covers several values at once, and an optimal multidimensional mechanism need not resemble an ordinary posted price. Hart and Nisan ask how much revenue is guaranteed by simple selling rules when the joint valuation distribution is unrestricted apart from the stated independence assumptions (Hart and Nisan, arXiv:1204.1846v3).

This mission isolates their two-good, identically distributed result, Theorem B. The paper first gives a one-half guarantee for two independent goods with potentially different distributions, then improves the guarantee to e/(e+1)e/(e+1)e/(e+1) when their distributions agree. The improvement is a claim about every probability law on nonnegative values. It assumes neither a density nor a regularity condition on the tail of that law. The paper proves the result in Appendix A.1 after stating it in the introduction (Hart and Nisan, pp. 6 and 31–35).

Setting

There is one risk-neutral buyer and one seller. For two goods, the buyer's private valuation is a vector (Y,Z)(Y,Z)(Y,Z) with Y,Z≥0Y,Z\ge0Y,Z≥0. Values are additive: receiving both goods is worth Y+ZY+ZY+Z. The seller knows the distribution of the vector but not the realized values. In this mission, YYY and ZZZ are independent and have the same arbitrary probability law ν\nuν on R≥0\mathbb R_{\ge0}R≥0​. A law, rather than a named pair of random variables on a probability space, carries all the data needed by the revenue quantities.

A direct mechanism μ=(q,s)\mu=(q,s)μ=(q,s) takes a reported pair x=(y,z)x=(y,z)x=(y,z) and returns an allocation probability qi(x)∈[0,1]q_i(x)\in[0,1]qi​(x)∈[0,1] for each good and a real payment s(x)s(x)s(x) to the seller. The buyer's payoff from reporting truthfully is b(x)=q(x)⋅x−s(x)b(x)=q(x)\cdot x-s(x)b(x)=q(x)⋅x−s(x). The mechanism is incentive compatible (IC) if truthful reporting is at least as good as any other report for every possible valuation, and individually rational (IR) if truthful payoff is nonnegative everywhere. These requirements hold on the whole nonnegative orthant, as in Section 2.1 of the paper (Hart and Nisan, pp. 11–14).

Write R(μ;X)R(\mu;X)R(μ;X) for the expected payment under a valuation law XXX and Rev⁡(X)\operatorname{Rev}(X)Rev(X) for the supremum of R(μ;X)R(\mu;X)R(μ;X) over feasible, IC, IR mechanisms. For one good, write Rev⁡1(ν)\operatorname{Rev}_1(\nu)Rev1​(ν). The separate-selling revenue for two identically distributed goods is SRev⁡(Y,Z)=2Rev⁡1(ν)\operatorname{SRev}(Y,Z)=2\operatorname{Rev}_1(\nu)SRev(Y,Z)=2Rev1​(ν). Equation (1) of the paper identifies the one-good value with the supremum of posted-price revenue pPr⁡[Y≥p]p\Pr[Y\ge p]pPr[Y≥p]; the supremum formulation covers laws for which no maximizing price exists (Hart and Nisan, p. 12; Myerson, 1981).

Formalization targets

Theorem B: the guarantee for two i.i.d. goods

The goal is the exact upper bound written at the start of the paper's proof:

Rev⁡(Y,Z)≤e+1e(Rev⁡(Y)+Rev⁡(Z))=e+1eSRev⁡(Y,Z).\operatorname{Rev}(Y,Z)\le\frac{e+1}{e}\bigl(\operatorname{Rev}(Y)+\operatorname{Rev}(Z)\bigr)=\frac{e+1}{e}\operatorname{SRev}(Y,Z).Rev(Y,Z)≤ee+1​(Rev(Y)+Rev(Z))=ee+1​SRev(Y,Z).

Equivalently, separate selling guarantees at least e/(e+1)e/(e+1)e/(e+1) of optimal revenue whenever the ratio has an ordinary meaning. The inequality itself is the stable formulation at zero and infinite revenues. The formal goal uses the exact constant (e+1)/e(e+1)/e(e+1)/e, not the rounded percentage in the theorem's prose (Hart and Nisan, Theorem B, p. 6; proof, p. 31).

Supporting targets

The milestones include the one-good posted-price identity, the fact that nonnegative payments suffice when optimizing, symmetrization for identical independent goods, Lemma 19's lower-valuation revenue bound, equation (12), and the two expectation estimates and final numerical bound used after it. Proposition 5's IC characterization is also a draft theorem, though it is not a milestone. Each statement retains its source's domain and the constant 1/e1/e1/e. The final inequality for the right side of (12) is stated for every nondecreasing allocation function into [0,1][0,1][0,1], as required by the paper's argument on pp. 33–35.

Significance

Theorem B gives a distribution-free quantitative guarantee for an easy-to-describe selling rule in a setting where the optimal rule may depend on the buyer's entire two-dimensional private type. Its e/(e+1)e/(e+1)e/(e+1) guarantee is stronger than the one-half guarantee for merely independent goods stated as Theorem A. The conclusion concerns the best revenue available from all feasible IC and IR mechanisms, so the benchmark includes randomized allocations and payments depending on both reported values (Hart and Nisan, pp. 6 and 11–13).

The formalization target is a machine-checked version of a proved result, not a new conjecture. The proposal currently contains compiled Lean statements with unproved theorem bodies. A completed development would prove the stated inequality and its selected supporting results. It would also supply reusable definitions for direct mechanisms with additive nonnegative values, extended-real revenue, optimal revenue as a supremum, and symmetry of two-good mechanisms. No machine-checked proof of these proposed Hart–Nisan statements is claimed here.

Difficulty

The one-good posted-price formula does not directly control an arbitrary two-good mechanism: allocation of either good and the payment can depend on both reported values. Applying a one-good bound separately to the two coordinates therefore leaves terms that depend on the other coordinate. In particular, a direct comparison between each marginal posted-price optimum and the total payment loses the improved constant. The proof has to control the dependence created by a joint mechanism while retaining the exact 1/e1/e1/e numerical estimate. A second formal difficulty is that an admissible mechanism can have a negative expected payment even though optimal revenue is nonnegative, while an unrestricted law can give infinite optimal revenue. Replacing every expectation by an ordinary real integral or clipping each mechanism's revenue would change Lemma 19 and the intermediate inequalities (Hart and Nisan, pp. 31–35).

Formalization scope

Valuations are finite vectors ι→R≥0\iota\to\mathbb R_{\ge0}ι→R≥0​; the main theorem fixes ι=Fin⁡(2)\iota=\operatorname{Fin}(2)ι=Fin(2). The two-good law is the product of the same one-good probability measure in both coordinates, so independence and identical distribution are built into the data. The model represents allocation probabilities as real numbers with explicit bounds 0≤qi≤10\le q_i\le10≤qi​≤1. It requires IC and IR pointwise on all reports. No positive transfer (NPT) means s(x)≥0s(x)\ge0s(x)≥0 and is imposed only on supporting statements where the paper uses it. Following the paper's footnote 12, admissibility also requires the payment function to be measurable.

An individual expected payment is an extended real difference of positive and negative Lebesgue integrals. For IC mechanisms, the negative part is finite because the payment is bounded below by its value at zero. Optimal revenue is the supremum of the nonnegative clips of admissible mechanisms' expected payments; the zero mechanism makes this the same supremum as in the paper. Lemma 19 and equation (12) keep individual revenue in the extended reals. Supporting inequalities that write r=Rev⁡1(ν)r=\operatorname{Rev}_1(\nu)r=Rev1​(ν) as a real number explicitly assume r<∞r<\inftyr<∞; Theorem B does not. Integrals of bounded threshold functions use ordinary real expectation, while the nonnegative term WWW uses a nonnegative Lebesgue integral. The goal cannot be satisfied by a correlated joint law, a bounded-support special case, a vacuous assumption on ν\nuν, or a rounded constant.

The reusable work includes one-good posted-price revenue for arbitrary laws, a nonnegative-transfer reduction, a faithful single-mechanism revenue type, and probability identities for two independent coordinates. Theorem A, Theorem 7, Theorem 16, and a full formalization of the paper's other selling rules are outside this mission.

Selected references

  • Sergiu Hart and Noam Nisan, Approximate Revenue Maximization with Multiple Items, Journal of Economic Theory, 2017. Source used here: arXiv:1204.1846v3.
  • Roger B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1), 1981. DOI:10.1287/moor.6.1.58.
11 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Posted Price Mechanisms and Optimal Threshold Strategies for Random Arrivals I: Under Random Arrival Order, Nonadaptive Thresholds Earn a 1 − 1/e Fraction of E[max Xᵢ]Research Paper

Motivation

In a prophet inequality, a gambler sees prizes one at a time and must decide when to stop, while a prophet knows every realization and takes the largest. A stopping guarantee compares the gambler’s expected prize with the prophet’s. The order of arrival changes the problem: here the prizes are independent but can have different distributions, and every permutation of their arrival is equally likely. Before seeing any prize, the gambler chooses a threshold for each distribution and accepts the first prize above its threshold. Such a rule has no need to update thresholds after observing rejections. Correa, Foncea, Hoeksma, Oosterwijk, and Vredeveld prove that this restricted rule still earns at least a 1−1/e1-1/e1−1/e fraction of the prophet’s expected maximum (Theorem 1, pp. 1455, 1459).

The random-arrival stopping model also supplies guarantees for posted-price mechanisms. A posted price gives a buyer a take-it-or-leave-it offer; the first buyer who accepts ends the sale. The paper explains the connection between its stopping rules and expected revenue under random buyer arrival (§1.1 and §5). This mission formalizes the stopping theorem itself, which is the mathematical guarantee used before that economic translation.

Setting

Let n≥1n\ge1n≥1, and let X1,…,XnX_1,\ldots,X_nX1​,…,Xn​ be independent, nonnegative real random variables with known, possibly different distributions. Their realizations arrive in a uniformly random order. A nonadaptive threshold rule chooses constants τi∈[0,∞]\tau_i\in[0,\infty]τi​∈[0,∞] before any realization is observed. It accepts the first arriving index iii with Xi>τiX_i>\tau_iXi​>τi​ and receives XiX_iXi​. If no prize crosses its threshold, its reward is zero. An infinite threshold deliberately excludes an index. The strict comparison matches Theorem 1, even though an earlier description in §1.2 uses a weak comparison (pp. 1454–1455).

For fixed realized prizes, write Yi=1{Xi>τi}Y_i=\mathbf1_{\{X_i>\tau_i\}}Yi​=1{Xi​>τi​}​. Conditional on the set of indices with Yi=1Y_i=1Yi​=1, each accepted index is equally likely to arrive first. The conditional expected reward is therefore

Rτ(X)=∑i=1nXiYi∑i=1nYi,0/0:=0.R_\tau(X)=\frac{\sum_{i=1}^{n}X_iY_i}{\sum_{i=1}^{n}Y_i},\qquad 0/0:=0.Rτ​(X)=∑i=1n​Yi​∑i=1n​Xi​Yi​​,0/0:=0.

The prophet benchmark is X∗=max⁡iXiX^*=\max_i X_iX∗=maxi​Xi​. The theorem compares ERτ(X)\mathbb E R_\tau(X)ERτ​(X) with EX∗\mathbb E X^*EX∗, including distributions for which either expectation may be infinite. The variables need no common distribution and no atomlessness assumption.

The paper’s main supporting result is the Bernoulli Selection Lemma. It starts with independent Bernoulli indicators YiY_iYi​ of success probabilities qiq_iqi​, fixed real prizes bib_ibi​, and a chosen subset SSS. Its payoff is the average ∑i∈SbiYi/∑i∈SYi\sum_{i\in S}b_iY_i/\sum_{i\in S}Y_i∑i∈S​bi​Yi​/∑i∈S​Yi​, again zero when the denominator vanishes. The lemma compares the best subset with a finite linear optimization problem over 0≤zi≤qi0\le z_i\le q_i0≤zi​≤qi​ and ∑izi≤1\sum_i z_i\le1∑i​zi​≤1 (Lemma 1, p. 1455).

Formalization targets

Nonadaptive threshold guarantee

The goal is the exact constant of Theorem 1:

∃τ∈[0,∞]n:ERτ(X) ≥ (1−e−1) EX∗.\exists\tau\in[0,\infty]^n:\quad \mathbb E R_\tau(X)\ \ge\ (1-e^{-1})\,\mathbb E X^*.∃τ∈[0,∞]n:ERτ​(X) ≥ (1−e−1)EX∗.

The quantifiers range over every finite nonempty family of independent nonnegative variables. The thresholds are deterministic and indexed by the distributions, and the assertion covers atoms as well as continuous laws. This is the paper’s headline nonadaptive result (Theorem 1, p. 1459).

Bernoulli selection and comparison steps

The milestone list includes the paper’s multilinear formulation (4), its substitution (5), Proposition A.1, Lemmas 2 and 3, and the Bernoulli Selection Lemma. The latter states, in particular, that the maximum expected selected average dominates (1−e−1)(1-e^{-1})(1−e−1) times the optimum over feasible zzz. Two further milestones express the decomposition of the expected maximum and the upper-tail comparison used for continuous distributions (§2–3 and Appendix A). These targets fix the finite selection problem and the probabilistic quantities that the goal must connect.

Significance

The guarantee identifies what fixed, distribution-specific thresholds can achieve under random arrival: the expected accepted prize reaches a constant fraction of the prophet’s benchmark for every collection of independent nonnegative distributions. The paper also gives examples showing why a rule that keeps every positive prize is inadequate and studies where the 1−e−11-e^{-1}1−e−1 factor is tight (§2.1 and §3.1). These are claims about the performance of a restricted class of stopping rules, not about an optimal adaptive strategy.

The paper proves Theorem 1; a machine-checked proof of this mission’s goal remains to be supplied. The finite Bernoulli model, its subset optimum, and the nonnegative expectation conventions would be reusable for other random-order stopping and allocation results. This mission makes the paper’s claimed constants, event comparisons, and boundary cases explicit in the theorem statements so a later proof has a fixed target.

Difficulty

Taking the first value above a single low threshold can accept a modest prize before a rare large one arrives. Raising every threshold can instead reject too many prizes. The paper’s example with a constant prize and a rare large prize shows that accepting all available values does not meet the claimed factor (p. 1460). The difficulty is obtaining one set of fixed thresholds that balances those risks across different distributions, while the benchmark selects the largest realization after seeing them all. The Bernoulli selection inequality carries the sharp constant; connecting it to general distributions must also account for ties and atoms.

Formalization scope

Lean represents the index set by Fin n with n≥1n\ge1n≥1, so its index zero is the paper’s index one. The existing published definition SamuelCahnProphet.Median.Setting.maxX supplies the sample maximum; this mission defines the strict accepted set and its real-valued reward ratio. Thresholds live in [0,∞][0,\infty][0,∞] because the paper explicitly uses ∞\infty∞ to exclude a variable. Expectations are nonnegative extended integrals of ENNReal.ofReal, preserving infinite values and avoiding a default zero for nonintegrable real integrals. The source’s nonnegativity assumption is represented almost surely, which is enough for these expectations and does not restrict the distributions further.

The Bernoulli law is a finite product formula. Its probabilities lie in [0,1][0,1][0,1], while prizes are arbitrary real numbers as in the printed lemma. The feasibility condition includes zi≥0z_i\ge0zi​≥0: these variables are probabilities, and allowing negative values would change the optimization problem. The finite subset optimum is an attained maximum. Proposition A.1 is stated for M≠∅M\ne\varnothingM=∅; an empty MMM contradicts the budget conclusion for a>0a>0a>0. It also includes the printed a=0a=0a=0 case. Lemma 2 includes y=1y=1y=1 as printed: the removable division by zero in (6) is assigned its continuous value 2/e2/e2/e. The comparison milestones for continuous distributions assume atomlessness explicitly; the goal does not.

The accepted set depends only on fixed thresholds and the realized values. It cannot depend on the sampled arrival order or on prior observations. A constant choice such as accepting every positive prize does not prove the target guarantee. Contributions that establish the finite Bernoulli selection result, its analytic bounds, the random-order reward identity, or the passage from continuous to arbitrary distributions all serve the stated goal. The random-order identity and the discontinuous case are further work beyond the current milestone list.

Selected references

  • José Correa, Patricio Foncea, Ruben Hoeksma, Tim Oosterwijk, and Tjark Vredeveld, Posted Price Mechanisms and Optimal Threshold Strategies for Random Arrivals, Mathematics of Operations Research 46(4), 1452–1478, 2021. DOI: 10.1287/moor.2020.1105.
12 thms2 active usersReviewed
Operations Research·Captain: mikedeng1

On the Complexity of Nash Equilibria and Other Fixed Points 3: In Every Nash Equilibrium of Bubelis's Gadget the Primary Player Plays 0 with Probability α, the Unique Root of f in [0, 1]Research Paper

Motivation

For games with three or more players, Nash equilibria can be irrational, so they cannot in general be computed exactly. Bubelis made this precise: any real root of any univariate polynomial arises as the probability of a particular strategy, or the payoff of a particular player, in a Nash equilibrium of a three-player game whose payoffs depend on the coefficients of the polynomial (Bubelis 1979).

Etessami and Yannakakis (SIAM J. Comput. 39 (2010)) restate Bubelis's construction as Lemma 7, in a form that controls the equilibrium probabilities rather than a payoff, and that guarantees the equilibrium is unique. They use it, for linear polynomials, as the single gadget behind every arithmetic operation in their reduction from PosSLP and SQRT-SUM to deciding properties of the unique Nash equilibrium of a three- or four-player game (their Theorem 4). The uniqueness clause is what makes the composed game itself have a unique equilibrium.

  • 1951: Nash proves every finite game has an equilibrium in mixed strategies.
  • 1979: Bubelis shows that every real algebraic number is an equilibrium probability or payoff of some three-player game (Theorem 2 of the cited paper).
  • 2007–2010: Etessami and Yannakakis restate the construction as Lemma 7, with uniqueness and full support of the equilibrium, and use it to prove PosSLP- and SQRT-SUM-hardness of Nash equilibrium problems (FOCS 2007; journal version 2010).

Setting

Fix an integer m≥0m \ge 0m≥0 and real coefficients c0,…,cmc_0, \dots, c_mc0​,…,cm​, and let

f(x)=c0xm+c1xm−1+⋯+cm=∑j=0mcj xm−j,f(x) = c_0 x^m + c_1 x^{m-1} + \dots + c_m = \sum_{j=0}^m c_j\, x^{m-j},f(x)=c0​xm+c1​xm−1+⋯+cm​=j=0∑m​cj​xm−j,

so cjc_jcj​ is the coefficient of xm−jx^{m-j}xm−j; the leading coefficient may vanish.

The gadget GfG_fGf​ is a game with three players. The primary player 1 has the strategies 0,10, 10,1; the auxiliary players 2 and 3 each have the strategies 0,1,…,m0, 1, \dots, m0,1,…,m. For a pure profile s=(s1,s2,s3)s = (s_1, s_2, s_3)s=(s1​,s2​,s3​), and with χ(P)\chi(P)χ(P) the indicator of a predicate PPP, the payoffs are

h1f(s)={cs2s1=10s1=0,h2(s)=χ(s2=s3),h^f_1(s) = \begin{cases} c_{s_2} & s_1 = 1 \\ 0 & s_1 = 0 \end{cases}, \qquad h_2(s) = \chi(s_2 = s_3),h1f​(s)={cs2​​0​s1​=1s1​=0​,h2​(s)=χ(s2​=s3​), h3(s)=χ(s2+1≡s3 mod (m+1))−χ(s1=0) χ(s2=s3)−χ(s1=1) χ(s3=0).h_3(s) = \chi\big(s_2 + 1 \equiv s_3 \bmod (m+1)\big) - \chi(s_1 = 0)\,\chi(s_2 = s_3) - \chi(s_1 = 1)\,\chi(s_3 = 0).h3​(s)=χ(s2​+1≡s3​mod(m+1))−χ(s1​=0)χ(s2​=s3​)−χ(s1​=1)χ(s3​=0).

The auxiliary payoffs do not depend on fff and take values in {0,1,−1}\{0, 1, -1\}{0,1,−1}.

A mixed profile x=(x1,x2,x3)x = (x_1, x_2, x_3)x=(x1​,x2​,x3​) assigns to each player ppp a probability vector xpx_pxp​ on its strategies; the players randomize independently. Player ppp's expected payoff up(x)u_p(x)up​(x) is the expectation of its payoff under the product distribution, and up((p:j);x−p)u_p((p:j); x_{-p})up​((p:j);x−p​) is its expected payoff when it switches to the pure strategy jjj. A Nash equilibrium is a mixed profile in which no player can raise its expected payoff by switching unilaterally to any other mixed strategy. A profile is fully mixed if every pure strategy of every player has positive probability. Throughout, ξ=x1(0)\xi = x_1(0)ξ=x1​(0), and v2v_2v2​, v3v_3v3​ are the equilibrium payoffs of players 2 and 3.

Formalization targets

Goal: Lemma 7

Assume f(0)≤0f(0) \le 0f(0)≤0, f(1)≥0f(1) \ge 0f(1)≥0, and that fff has a unique root α\alphaα in [0,1][0,1][0,1]. Then every Nash equilibrium xxx of GfG_fGf​ satisfies

x1(0)=α,x1(1)=1−α,x_1(0) = \alpha, \qquad x_1(1) = 1 - \alpha,x1​(0)=α,x1​(1)=1−α,

and if α≠0\alpha \ne 0α=0 and α≠1\alpha \ne 1α=1, then GfG_fGf​ has exactly one Nash equilibrium, and it is fully mixed.

Milestones (proof of Lemma 7, p. 26)

  1. In any finite game, at a Nash equilibrium, up((p:j);x−p)≤up(x)u_p((p:j); x_{-p}) \le u_p(x)up​((p:j);x−p​)≤up​(x), with equality when xp(j)>0x_p(j) > 0xp​(j)>0.
  2. In every Nash equilibrium of GfG_fGf​: v2>0v_2 > 0v2​>0 and v3≥0v_3 \ge 0v3​≥0.
  3. In every Nash equilibrium of GfG_fGf​: x2(j)=ξm−j/∑i=0mξix_2(j) = \xi^{m-j} \big/ \sum_{i=0}^m \xi^ix2​(j)=ξm−j/∑i=0m​ξi for all jjj.
  4. In every Nash equilibrium of GfG_fGf​: u1((1:1);x−1)=f(ξ)/∑i=0mξiu_1((1:1); x_{-1}) = f(\xi) \big/ \sum_{i=0}^m \xi^iu1​((1:1);x−1​)=f(ξ)/∑i=0m​ξi.
  5. Under the hypotheses of Lemma 7 and α≠0\alpha \ne 0α=0: x3(j)=1/(m+1)x_3(j) = 1/(m+1)x3​(j)=1/(m+1) for all jjj.

Milestones 2–4 hold for every coefficient vector; only milestone 5 and the goal use the hypotheses on fff.

Significance

The lemma is the arithmetic engine of the hardness results of Etessami and Yannakakis: a polynomial equation in one unknown is solved, exactly and uniquely, by the equilibrium of a fixed-size game whose auxiliary payoffs do not depend on the equation. With fff linear, the gadget implements addition, multiplication and division of probabilities in (0,1)(0,1)(0,1); with higher degree it implements roots and fractional powers. Without the uniqueness clause, the composed games of Theorem 4 could have spurious equilibria, and the reduction would not apply to games promised to have a unique equilibrium.

The result is proved in the paper (pp. 25–26, following Bubelis). As far as is known, no part of it is machine-checked: there is no formal statement of Bubelis's gadget, and the support property of Nash equilibria is not on the platform in this vocabulary. This mission produces the first formal statement and proof of the gadget's equilibrium characterization, including the existence half of "has a unique Nash equilibrium", which the paper takes from Nash's theorem but which here is a concrete profile to check.

Difficulty

The gadget's equilibria are those of a three-player game, so the payoffs are cubic in the probabilities and no linear-programming argument applies. The obvious first idea, writing down the indifference conditions of players 2 and 3 and solving them, presupposes that every strategy of player 2 is played; nothing guarantees that in advance, and the profiles in which some strategies are unplayed have to be excluded. The boundary cases ξ=0\xi = 0ξ=0 and ξ=1\xi = 1ξ=1 are not covered by an indifference argument for the primary player and need the sign conditions f(0)≤0f(0) \le 0f(0)≤0 and f(1)≥0f(1) \ge 0f(1)≥0 separately. The strategy of player 3 is pinned down only when α≠0\alpha \neq 0α=0, which is why the uniqueness part of the lemma excludes the endpoints. Finally, existence of the equilibrium is part of the statement and cannot be delegated to Nash's theorem, which is not available on the platform.

Formalization scope

The game uses the published vocabulary agt_games (mixed profiles as weight functions, AGT.expectedPayoff, AGT.IsMixedNash with mixed deviations) and DGPNash.NashMap.purePayoff for up((p:j);x−p)u_p((p:j); x_{-p})up​((p:j);x−p​). The players are a three-element type primary | aux2 | aux3; strategies are Fin 2 and Fin (m+1), 0-based as on the page. The coefficients are c : Fin (m+1) → ℝ and fff is the explicit sum ∑jcjξm−j\sum_j c_j \xi^{m-j}∑j​cj​ξm−j with natural-number exponent; the congruence s2+1≡s3s_2 + 1 \equiv s_3s2​+1≡s3​ is addition in Fin (m+1); ξ0=1\xi^0 = 1ξ0=1 for every ξ\xiξ, including 000.

Explicit readings committed to:

  • "has a unique root α\alphaα in [0,1][0,1][0,1]" is a named α\alphaα with 0≤α≤10 \le \alpha \le 10≤α≤1, f(α)=0f(\alpha) = 0f(α)=0, and β=α\beta = \alphaβ=α for every root β∈[0,1]\beta \in [0,1]β∈[0,1];
  • "the game has a unique Nash equilibrium" is existence and uniqueness (∃! over mixed profiles);
  • "the NE is fully mixed" applies to all three players;
  • coefficients are real, generalizing the paper's rationals; the degree is at most mmm;
  • the support property is stated for an arbitrary finite game;
  • the last two clauses of Lemma 7 (auxiliary payoffs independent of fff, values in {0,1,−1}\{0,1,-1\}{0,1,−1}; primary payoff cs2c_{s_2}cs2​​ or 000) hold by the definition of the gadget and are not separate theorems.

The goal is not trivialized by a pure-strategy notion of equilibrium (deviations are mixed), by dropping uniqueness of the root (without it x1(0)=αx_1(0) = \alphax1​(0)=α is false), or by reading "unique equilibrium" as uniqueness alone. For m=0m = 0m=0 the hypotheses cannot hold, as on the page.

A complete development needs the support property (reusable for any finite game), the linearity of expected payoff in one player's strategy, and finite-sum manipulations for the geometric weights ξm−j\xi^{m-j}ξm−j. Contributions of general lemmas about AGT.IsMixedNash and purePayoff are welcome and reusable well beyond this mission.

Selected references

  • K. Etessami and M. Yannakakis, On the complexity of Nash equilibria and other fixed points, SIAM J. Comput. 39(6) (2010) 2531–2597 (author manuscript; Lemma 7, pp. 25–26). https://doi.org/10.1137/080720826
  • K. Etessami and M. Yannakakis, On the complexity of Nash equilibria and other fixed points (extended abstract), Proc. FOCS 2007. https://doi.org/10.1109/FOCS.2007.48
  • V. Bubelis, On equilibria in finite games, Int. J. Game Theory 8(2) (1979) 65–79. https://doi.org/10.1007/BF01768703
  • J. Nash, Non-cooperative games, Ann. of Math. 54(2) (1951) 286–295. https://doi.org/10.2307/1969529
9 thms2 active usersReviewed
Differential GeometryOperations Research·Captain: mikedeng1

Inefficiency of Nash Equilibria: For an Open Dense Set of C² Payoffs, Nash Equilibria Are Finite, an Efficient One Has a Player at a Vertex, and a Strong One Has at Most One Player off a VertexResearch Paper

Motivation

That noncooperative play usually wastes something is part of the folklore of game theory, with the Prisoner's Dilemma as its emblem: each player's best reply leads to an outcome that both would trade for another. Pradeep Dubey's paper turns this folklore into a theorem about smooth games. For games whose payoffs are twice continuously differentiable, and for all payoffs outside a negligible (closed, nowhere dense) set, Nash equilibria are finite in number and are Pareto-inefficient unless some player sits at a vertex of his strategy set. The same conclusion applies to Nash's mixed extensions of finite games (Nash 1951), where a vertex is a pure strategy.

The question is basic to welfare analysis of strategic interaction: market games, oligopoly, public goods and trading mechanisms (Shapley and Shubik 1977) all ask whether equilibrium outcomes can be efficient. Dubey's answer is that efficiency of an equilibrium is non-generic, so a model that delivers it is exploiting special structure.

Timeline. Nash (1951) introduced equilibrium points and multi-matrix games. Smale (1973, "Optimizing several functions") gave the first-order condition for Pareto optimality of several smooth functions: at an efficient interior point the gradients are linearly dependent. Harsanyi (1973, IJGT 2:235–250) proved that generic finite games have finitely many, indeed an odd number of, mixed equilibria. Dubey's Cowles Foundation Discussion Paper 508R (1978) stated finiteness and inefficiency; the version formalized here is the rewrite IIASA WP-83-74 (1983), published as Mathematics of Operations Research 11(1):1–8 (1986).

Setting

There are n≥2n\ge2n≥2 players N={1,…,n}N=\{1,\dots,n\}N={1,…,n}. Player iii's strategy set is the unit simplex

Si={x∈R+k(i):∑j=1k(i)xj≤1},k(i)≥1,S^i=\Big\{x\in\mathbb R^{k(i)}_+ : \sum_{j=1}^{k(i)}x_j\le1\Big\},\qquad k(i)\ge1,Si={x∈R+k(i)​:j=1∑k(i)​xj​≤1},k(i)≥1,

whose vertices (extreme points) are the origin and the unit vectors. Profiles s=(s1,…,sn)s=(s^1,\dots,s^n)s=(s1,…,sn) range over S=S1×⋯×Sn⊂Rr(n)S=S^1\times\dots\times S^n\subset\mathbb R^{r(n)}S=S1×⋯×Sn⊂Rr(n), r(n)=∑ik(i)r(n)=\sum_i k(i)r(n)=∑i​k(i).

Fix open neighbourhoods Vi⊇SiV^i\supseteq S^iVi⊇Si and V=V1×⋯×VnV=V^1\times\dots\times V^nV=V1×⋯×Vn. The space UUU consists of the C2C^2C2 functions f:V→Rf:V\to\mathbb Rf:V→R with finite C2C^2C2-norm ∥f∥=sup⁡{∥f(s)∥,∥Df(s)∥,∥D2f(s)∥:s∈V}\|f\|=\sup\{\|f(s)\|,\|Df(s)\|,\|D^2f(s)\|: s\in V\}∥f∥=sup{∥f(s)∥,∥Df(s)∥,∥D2f(s)∥:s∈V}. A game is u=(u1,…,un)∈(U)nu=(u^1,\dots,u^n)\in(U)^nu=(u1,…,un)∈(U)n. For T⊆NT\subseteq NT⊆N, (s∣e)(s|e)(s∣e) replaces sis^isi by eie^iei for i∈Ti\in Ti∈T. A profile s∈Ss\in Ss∈S is TTT-efficient if no e∈×i∈TSie\in\times_{i\in T}S^ie∈×i∈T​Si gives ui(s∣e)≥ui(s)u^i(s|e)\ge u^i(s)ui(s∣e)≥ui(s) for all i∈Ti\in Ti∈T with strict inequality for some j∈Tj\in Tj∈T. It is a Nash equilibrium if it is {i}\{i\}{i}-efficient for each iii, efficient if it is NNN-efficient, and a strong Nash equilibrium if it is TTT-efficient for every TTT. The three sets are N(u)N(u)N(u), E(u)E(u)E(u), G(u)G(u)G(u).

In the proof, Du(s)D_u(s)Du​(s) is the n×r(n)n\times r(n)n×r(n) matrix with rows Dui(s)Du^i(s)Dui(s); N∗N^*N∗ is the subspace of matrices whose iii-th row vanishes on player iii's block of columns; E∗E^*E∗ is the set of matrices with linearly dependent rows.

Formalization targets

Goal: the Theorem (p. 3)

There is an open dense set U0⊆(U)nU_0\subseteq(U)^nU0​⊆(U)n such that for u∈U0u\in U_0u∈U0​:

(a) N(u) is finite;(b) s∈N(u)∩E(u)⇒∃j, sj is a vertex;(c) s∈G(u)⇒at most one sj is not a vertex.\text{(a) } N(u)\text{ is finite};\quad \text{(b) } s\in N(u)\cap E(u)\Rightarrow \exists j,\ s^j\text{ is a vertex};\quad \text{(c) } s\in G(u)\Rightarrow \text{at most one } s^j \text{ is not a vertex}.(a) N(u) is finite;(b) s∈N(u)∩E(u)⇒∃j, sj is a vertex;(c) s∈G(u)⇒at most one sj is not a vertex.

Milestones (pp. 4–6)

For interior profiles (si∈Int⁡Sis^i\in\operatorname{Int}S^isi∈IntSi for all iii):

(i) s∈N(u)⇒Du(s)∈N∗,(ii) s∈E(u)⇒Du(s)∈E∗,\text{(i) } s\in N(u)\Rightarrow D_u(s)\in N^*,\qquad \text{(ii) } s\in E(u)\Rightarrow D_u(s)\in E^*,(i) s∈N(u)⇒Du​(s)∈N∗,(ii) s∈E(u)⇒Du​(s)∈E∗,

codim⁡N∗=r(n)\operatorname{codim}N^*=r(n)codimN∗=r(n); the linear perturbation uti(x)=u0i(x)+t∑jyijxju_t^i(x)=u_0^i(x)+t\sum_j y_{ij}x_juti​(x)=u0i​(x)+t∑j​yij​xj​ satisfies ddtD(ut,s0)∣t=0=y\frac{d}{dt}D(u_t,s_0)|_{t=0}=ydtd​D(ut​,s0​)∣t=0​=y (the computation behind (**)); claim (*) for M=N∗M=N^*M=N∗: for an open dense set of games DuD_uDu​ is transverse to N∗N^*N∗ on a compact neighbourhood V‾\underline VV​ of SSS; under that transversality S∩Du−1(N∗)S\cap D_u^{-1}(N^*)S∩Du−1​(N∗) is finite; and the Theorem restricted to interior profiles.

Companions

The Theorem (Multi-Matrix) (p. 14): for an open dense set of payoff vectors a∈(RK)na\in(\mathbb R^K)^na∈(RK)n, the mixed Nash equilibria of Πa\Pi_aΠa​ are finite, an efficient one has a player using a pure strategy, and a strong one is pure. From the example of §3: every game (P,Q)(P,Q)(P,Q) on [0,1]2[0,1]^2[0,1]2 with payoffs uP(x,y)=−[(x−a)2+(y−b)2]u_P(x,y)=-[(x-a)^2+(y-b)^2]uP​(x,y)=−[(x−a)2+(y−b)2] has a unique Nash equilibrium (p. 9); Lemma 1, E(P,Q)=rX(L(P,Q))E(P,Q)=r_X(L(P,Q))E(P,Q)=rX​(L(P,Q)) (p. 9); Lemma 2(a), an interior equilibrium is efficient iff a=ca=ca=c or b=db=db=d (p. 10).

Significance

The theorem gives the generic structure of equilibrium sets in smooth games: isolated and finitely many equilibria, and a sharp location of the only places where efficient equilibria can survive, namely the vertices. It explains why efficiency results for noncooperative models need boundary solutions or non-generic structure, and in its multi-matrix form it shows that strong equilibria of generic finite games are in pure strategies. It also supplies the finiteness of equilibria used in comparative-statics and index arguments.

On the formalization side, the result is proved on paper but has no machine-checked version. A complete development would give Lean its first generic-finiteness theorem for Nash equilibria of smooth games, a first-order Pareto condition in the form of Smale's lemma, and a parametric transversality argument in finite dimensions. The multi-matrix companion connects to the published vocabulary of finite games (agt_games), and the example of §3 is an elementary, fully explicit check of the general picture.

Difficulty

The interior case reduces, by (i) and (ii), to a dimension count: Du−1(N∗)D_u^{-1}(N^*)Du−1​(N∗) should be zero-dimensional and Du−1(N∗∩E∗)D_u^{-1}(N^*\cap E^*)Du−1​(N∗∩E∗) empty. Neither holds for every game: they hold only when DuD_uDu​ is transverse to N∗N^*N∗ and to the strata of N∗∩E∗N^*\cap E^*N∗∩E∗, and the step that requires work is showing that transversality is an open and dense condition in the C2C^2C2 topology. Density is not obtained by adding linear functions to the payoffs: a linear function has finite C2C^2C2-norm on VVV only when VVV is bounded, so perturbations must be localized. The step from interior profiles to the whole of SSS is a second difficulty. It requires repeating the argument on every product of faces of the simplices and on every subgame, and then intersecting finitely many open dense sets. Efficiency at a boundary point is not TTT-efficiency in a subgame, so the reduction has to be made with care.

Formalization scope

Players are Fin n with 2 ≤ n; block sizes k : Fin n → ℕ with 1 ≤ k i; profiles are ∀ i, Fin (k i) → ℝ. The simplex is the paper's corner simplex {x ≥ 0, ∑ x ≤ 1}, not the probability simplex; "vertex" is Set.extremePoints. The neighbourhoods ViV^iVi are taken open, and the goal is stated for every such choice, not assuming VVV bounded or convex. Payoffs are total functions; a game is ContDiffOn ℝ 2 on VVV with finite C2C^2C2-norm, which takes values in [0,∞][0,\infty][0,∞], so no junk real supremum enters. "Open dense in (U)n(U)^n(U)n" is written in ε\varepsilonε-form for the product of C2C^2C2-norm topologies; Lean's sup-type norms are equivalent to the Euclidean ones, so the open dense sets are the same. Deviations range over all strategies in ×i∈TSi\times_{i\in T}S^i×i∈T​Si, not only pure or vertex deviations.

Added hypotheses, all disclosed in the items: openness of ViV^iVi; interiority of every sis^isi on milestones (i), (ii) and the finiteness step (the proof's standing case assumption); M=N∗M=N^*M=N∗ in claim (*). The printed "By (i), N(u)⊂S∩Du−1(N∗)N(u)\subset S\cap D_u^{-1}(N^*)N(u)⊂S∩Du−1​(N∗)" is stated for interior equilibria, which is where (i) applies.

A trivializing formalization is ruled out: the open dense set must contain games arbitrarily close to every game (the zero game is a game, so it is never empty), interiority appears only in the milestones and not in the goal, and efficiency is with respect to all deviations in SSS.

Not stated: (*) for a general submanifold MMM, and the decomposition of N∗∩E∗N^*\cap E^*N∗∩E∗ into submanifolds of codimension ≥r(n)+1\ge r(n)+1≥r(n)+1, both of which need embedded submanifolds of RN\mathbb R^NRN; Remarks 1–4 (Remark 4's openness claim for strictly concave payoffs is false as printed); Lemma 2(b); §5, which the author leaves as a conjecture. Contributions welcome: a finite-dimensional parametric transversality theorem, Smale's first-order Pareto condition, and the face-by-face reduction.

Selected references

  • P. Dubey, Inefficiency of Nash Equilibria, IIASA Working Paper WP-83-74, 1983; Mathematics of Operations Research 11(1):1–8, 1986. https://doi.org/10.1287/moor.11.1.1
  • J. F. Nash, Non-Cooperative Games, Annals of Mathematics 54:286–295, 1951. https://doi.org/10.2307/1969529
  • J. C. Harsanyi, Oddness of the Number of Equilibrium Points: A New Proof, International Journal of Game Theory 2:235–250, 1973. https://doi.org/10.1007/BF01737572
  • S. Smale, Optimizing Several Functions, Manifolds — Tokyo 1973, Proceedings of the International Conference on Manifolds, University of Tokyo Press, 1975.
  • R. Abraham and J. Robbin, Transversal Mappings and Flows, W. A. Benjamin, New York, 1967.
  • L. S. Shapley and M. Shubik, Trade Using One Commodity as a Means of Payment, Journal of Political Economy 85:937–968, 1977. https://doi.org/10.1086/260617
13 thms2 active usersReviewed
Theoretical Computer Science·Captain: marwahaha

Randomized quasipolynomial-time mean-payoff gamesOpen Problem

Motivation

Mean-payoff games ask which starting positions allow a player to guarantee a nonnegative long-run average reward. Binary-encoded weights make the bit cost of solving the complete winning set a central part of the question. The source manuscript presents the surrounding research claim.

Setting

A game is a finite nonempty directed multigraph with integer edge weights, an owner for each vertex and an outgoing edge everywhere. Winning means that a history-dependent maximizer strategy guarantees liminf average payoff at least zero against every opponent strategy.

Formalization target

Construct one randomized three-tape machine and C>0 such that every encoded game of length L has a time bound

T≤2C(log⁡2(L+2))2,T\le2^{C(\log_2(L+2))^2},T≤2C(log2​(L+2))2,

all T-bit random tapes halt by T, and at least 7/8 of them output the exact winning-set indicator, with all other output cells blank.

The selected formal target is OAI.randomized_quasipolynomial_mean_payoff.

Significance and status

The target makes the input encoding, computation model, success fraction and complete output explicit. It is an existence theorem for a uniform machine, not a separate solver for each game. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

The running time must hold on every random tape, while correctness holds on the specified fraction. Signed weights and the full binary input length cannot be replaced by unary magnitude bounds.

Formalization scope

The published definitions specify games, strategies, plays, liminf payoffs, serialization and tape transitions. The independent finite Truffet elimination counterexample is retained as contextual reference; it is not a prerequisite or an asserted proof of the randomized algorithm. The manuscript’s certification/always-correct consequence is not an additional attached goal.

Selected references

  • OpenAI, Randomized quasipolynomial-time mean-payoff games, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
4 thms2 active usersReviewed
Linear algebraOperations Research·Captain: mikedeng1

Flows and Decompositions of Games: Harmonic and Potential Games 3: In Every Harmonic Game the Uniformly Mixed Strategy Profile Is a Mixed Nash EquilibriumResearch Paper

Motivation

Finite games in strategic form are the basic model of strategic interaction in economics, engineering and computer science. Potential games (Monderer and Shapley, 1996, DOI 10.1006/game.1996.0044) are the class with the most tractable equilibrium behaviour: every finite potential game has a pure Nash equilibrium, and simple learning dynamics converge to one.

Candogan, Menache, Ozdaglar and Parrilo (arXiv:1005.2405; Mathematics of Operations Research 36(3), 2011, DOI 10.1287/moor.1110.0500) decompose every finite game canonically into a potential, a harmonic and a nonstrategic component, by viewing the payoff differences of a game as a flow on a graph and applying the combinatorial Helmholtz decomposition. Harmonic games are the complement of potential games, and their equilibria behave in the opposite way: they generically have no pure Nash equilibrium. This mission formalizes the paper's positive result on the harmonic side. In every harmonic game, whatever the number of players and strategies, the profile in which every player randomizes uniformly over its strategies is a mixed Nash equilibrium. Rock–paper–scissors and matching pennies are the familiar two-player instances.

Setting

A finite game has a finite set of players M\mathcal MM and, for each player mmm, a nonempty finite strategy set EmE^mEm with hm=∣Em∣h_m = |E^m|hm​=∣Em∣ elements. A strategy profile is p=(pm)m∈E=∏mEmp = (p^m)_m \in E = \prod_m E^mp=(pm)m​∈E=∏m​Em. We write p−mp^{-m}p−m for the strategies of the players other than mmm, E−m=∏k≠mEkE^{-m} = \prod_{k\ne m}E^kE−m=∏k=m​Ek, and (qm,p−m)(q^m, p^{-m})(qm,p−m) for ppp with player mmm's strategy replaced by qmq^mqm. A game is identified with its utilities u=(um)mu = (u^m)_mu=(um)m​, um:E→Ru^m : E \to \mathbb Rum:E→R, which form an element of C0MC_0^MC0M​, where C0={f:E→R}C_0 = \{f : E\to\mathbb R\}C0​={f:E→R} carries ⟨φ1,φ2⟩0=∑pφ1(p)φ2(p)\langle\varphi_1,\varphi_2\rangle_0 = \sum_p\varphi_1(p)\varphi_2(p)⟨φ1​,φ2​⟩0​=∑p​φ1​(p)φ2​(p).

Two profiles are mmm-comparable if they are distinct and differ only in player mmm's strategy. The game graph has the profiles as nodes and joins every comparable pair. An edge flow is a function XXX on ordered pairs of profiles with X(p,q)=−X(q,p)X(p,q) = -X(q,p)X(p,q)=−X(q,p) on edges and X=0X = 0X=0 off edges. The space C1C_1C1​ of edge flows carries ⟨X,Y⟩1=12∑(p,q)∈AX(p,q)Y(p,q)\langle X,Y\rangle_1 = \tfrac12\sum_{(p,q)\in A}X(p,q)Y(p,q)⟨X,Y⟩1​=21​∑(p,q)∈A​X(p,q)Y(p,q). The combinatorial gradient is (δ0φ)(p,q)=W(p,q)(φ(q)−φ(p))(\delta_0\varphi)(p,q) = W(p,q)(\varphi(q)-\varphi(p))(δ0​φ)(p,q)=W(p,q)(φ(q)−φ(p)), with WWW the edge indicator, and δ0∗\delta_0^*δ0∗​ is its adjoint. Restricting to mmm-comparable pairs gives Dm:C0→C1D_m : C_0\to C_1Dm​:C0​→C1​, and Du=∑mDmumDu = \sum_m D_m u^mDu=∑m​Dm​um is the flow of payoff differences of uuu. With Πm=Dm†Dm\Pi_m = D_m^\dagger D_mΠm​=Dm†​Dm​ (Moore–Penrose pseudoinverse) and Π=diag⁡(Π1,…,ΠM)\Pi = \operatorname{diag}(\Pi_1,\dots,\Pi_M)Π=diag(Π1​,…,ΠM​), Definition 4.2 of the paper sets

H={u∣u=Πu, Du∈ker⁡δ0∗},N=ker⁡D.\mathcal H = \{u \mid u = \Pi u,\ Du \in \ker\delta_0^*\},\qquad \mathcal N = \ker D .H={u∣u=Πu, Du∈kerδ0∗​},N=kerD.

A game is a harmonic game if u∈H⊕Nu\in\mathcal H\oplus\mathcal Nu∈H⊕N, and a normalized harmonic game if u∈Hu\in\mathcal Hu∈H.

A mixed strategy of player mmm is a probability vector xm∈ΔEmx^m\in\Delta E^mxm∈ΔEm, and a mixed strategy profile is x={xm}m∈∏mΔEmx = \{x^m\}_m\in\prod_m\Delta E^mx={xm}m​∈∏m​ΔEm. The mixed extension is um(x)=∑p∈Eum(p)∏kxk(pk)u^m(x) = \sum_{p\in E}u^m(p)\prod_k x^k(p^k)um(x)=∑p∈E​um(p)∏k​xk(pk) (34). The payoff of the pure strategy qmq^mqm against x−mx^{-m}x−m is um(qm,x−m)=∑p−mum(qm,p−m)∏k≠mxk(pk)u^m(q^m,x^{-m}) = \sum_{p^{-m}}u^m(q^m,p^{-m})\prod_{k\ne m}x^k(p^k)um(qm,x−m)=∑p−m​um(qm,p−m)∏k=m​xk(pk) (35). A mixed Nash equilibrium (Definition 5.1.1) is a mixed profile with um(xm,x−m)≥um(pm,x−m)u^m(x^m,x^{-m})\ge u^m(p^m,x^{-m})um(xm,x−m)≥um(pm,x−m) for every mmm and pm∈Emp^m\in E^mpm∈Em. A probability distribution x∈ΔEx\in\Delta Ex∈ΔE on profiles is a correlated equilibrium (Definition 5.1.2) if ∑p−m(um(pm,p−m)−um(qm,p−m)) x(pm,p−m)≥0\sum_{p^{-m}}(u^m(p^m,p^{-m})-u^m(q^m,p^{-m}))\,x(p^m,p^{-m})\ge 0∑p−m​(um(pm,p−m)−um(qm,p−m))x(pm,p−m)≥0 for all mmm and pm,qmp^m,q^mpm,qm. The uniformly mixed strategy profile (Definition 5.2) has xm(qm)=1/hmx^m(q^m) = 1/h_mxm(qm)=1/hm​ for every mmm and qmq^mqm.

Formalization targets

Goal: Theorem 5.4

For every harmonic game u∈H⊕Nu\in\mathcal H\oplus\mathcal Nu∈H⊕N, the uniformly mixed strategy profile xxx is a mixed Nash equilibrium:

um(xm,x−m)  ≥  um(pm,x−m)for all m∈M, pm∈Em.u^m(x^m,x^{-m}) \;\ge\; u^m(p^m,x^{-m})\qquad\text{for all } m\in\mathcal M,\ p^m\in E^m .um(xm,x−m)≥um(pm,x−m)for all m∈M, pm∈Em.

Milestones

  1. Lemma A.1: for every edge flow X^\hat XX^ and every set of profiles S^\hat SS^, ∑p∈S^(δ0∗X^)(p)=−∑p∈S^∑q∈S^cX^(p,q)\sum_{p\in\hat S}(\delta_0^*\hat X)(p) = -\sum_{p\in\hat S}\sum_{q\in\hat S^c}\hat X(p,q)∑p∈S^​(δ0∗​X^)(p)=−∑p∈S^​∑q∈S^c​X^(p,q).
  2. Lemma 5.2: in a harmonic game, ∑p−m∈E−m(um(rm,p−m)−um(qm,p−m))=0\sum_{p^{-m}\in E^{-m}}\big(u^m(r^m,p^{-m}) - u^m(q^m,p^{-m})\big) = 0∑p−m∈E−m​(um(rm,p−m)−um(qm,p−m))=0 for all mmm and qm,rmq^m, r^mqm,rm.
  3. Proposition 5.2: in a normalized harmonic game, a distribution x∈ΔEx\in\Delta Ex∈ΔE is a correlated equilibrium iff all the inequalities of Definition 5.1.2 hold with equality (36), iff ∑p−mum(qm,p−m) x(pm,p−m)=0\sum_{p^{-m}}u^m(q^m,p^{-m})\,x(p^m,p^{-m}) = 0∑p−m​um(qm,p−m)x(pm,p−m)=0 for all m,pm,qmm,p^m,q^mm,pm,qm (37).
  4. Remark after Proposition 5.2: the equivalence of correlated equilibrium with (36) holds for all harmonic games.
  5. Corollary 5.2: in a harmonic game, a mixed profile is a mixed Nash equilibrium iff um(xm,x−m)=um(pm,x−m)u^m(x^m,x^{-m}) = u^m(p^m,x^{-m})um(xm,x−m)=um(pm,x−m) for all mmm and pmp^mpm (42).

Significance

Theorem 5.4 is the counterpart, for harmonic games, of the existence of pure equilibria in potential games. It exhibits an explicit equilibrium that does not depend on the payoffs at all, only on the strategy counts hmh_mhm​. Corollary 5.2, a milestone here, adds that at any mixed equilibrium of a harmonic game every player is indifferent among all its pure strategies, including those outside the support. That is much stronger than the usual support condition. Proposition 5.2 shows that the correlated equilibria of a normalized harmonic game are the points of the probability simplex in a linear subspace determined by the utilities. The paper uses that description in its later analysis of two-player harmonic games.

The results are proved in the paper; none of them is machine-checked. The formalization connects the paper's operator layer (flows on the game graph, the gradient and its adjoint with the 12\tfrac1221​-weighted inner product, pseudoinverses) with standard equilibrium notions on finite games. It reuses published definitions of lotteries, the mixed extension and correlated equilibria.

Difficulty

The equilibrium statement follows quickly once Lemma 5.2 is available. The difficulty lies in translating the harmonic condition, a statement about the adjoint of an operator on edge flows, into an identity about payoffs. That needs the explicit form of δ0∗\delta_0^*δ0∗​, which depends on the 12\tfrac1221​ in the inner product of C1C_1C1​. It also needs the fact that DDD kills the nonstrategic component, and a computation of the flow of DuDuDu across the boundary of the set of profiles in which player mmm plays rmr^mrm. Corollary 5.2 needs the passage from mixed profiles to product distributions on profiles and a careful accounting of sums over p−mp^{-m}p−m against sums over full profiles.

The first idea, to use the normalization ∑qmum(qm,p−m)=0\sum_{q^m}u^m(q^m,p^{-m}) = 0∑qm​um(qm,p−m)=0, is not available. The goal concerns all harmonic games, not only normalized ones, and normalization alone does not give indifference against uniform opponents: the harmonic condition is essential.

Formalization scope

Players form a finite type ι with decidable equality, and the strategy sets E m are nonempty finite types, as in the paper (Em={1,…,hm}E^m = \{1,\dots,h_m\}Em={1,…,hm​}). The hypothesis [∀ m, Nonempty (E m)] is stated explicitly on the game theorems, because the uniform profile 1/hm1/h_m1/hm​ is a probability vector only if hm≥1h_m\ge1hm​≥1. A game is an element of PiLp 2 (fun _ => EuclideanSpace ℝ (∀ k, E k)) with the unweighted sum inner product of p. 14. C1C_1C1​ is the subspace of edge flows with the inner product 12∑\tfrac12\sum21​∑ of (7). δ0∗\delta_0^*δ0∗​ is Mathlib's adjoint, and the pseudoinverse is defined directly. H\mathcal HH and N\mathcal NN are defined by (28), and harmonic games are the submodule H ⊔ N. Lotteries, mixed profiles and the mixed extension (34) come from the published agt_games definitions; correlated equilibrium is the published HartSchmeidler.Finite.IsCorrelatedEq. The pure-deviation payoff (35), mixed Nash equilibrium with pure deviations (Definition 5.1.1, as printed), and the uniform profile are defined in the mission. Sums over p−mp^{-m}p−m are written as sums over the profiles with player mmm's strategy fixed, so each p−mp^{-m}p−m is counted once.

The goal concerns mixed Nash equilibria. Stating it for the uniform product distribution as a correlated equilibrium, or for normalized games only, would be a weaker statement and is not the target. No hypothesis is added beyond the nonemptiness of the strategy sets.

Contributions welcome: proofs of the milestones, and general lemmas on adjoints of graph gradients and on product distributions that are reusable beyond this mission.

Selected references

  • O. Candogan, I. Menache, A. Ozdaglar, P. A. Parrilo, Flows and Decompositions of Games: Harmonic and Potential Games, arXiv:1005.2405v2, 2010; Mathematics of Operations Research 36(3), 2011. https://arxiv.org/abs/1005.2405, https://doi.org/10.1287/moor.1110.0500
  • D. Monderer, L. S. Shapley, Potential Games, Games and Economic Behavior 14, 1996. https://doi.org/10.1006/game.1996.0044
  • S. Hart, D. Schmeidler, Existence of Correlated Equilibria, Mathematics of Operations Research 14(1), 1989. https://doi.org/10.1287/moor.14.1.18
12 thms2 active usersReviewed
Linear algebraOperations Research·Captain: mikedeng1

Flows and Decompositions of Games: Harmonic and Potential Games 2: Harmonic Games Generically Have No Pure Nash EquilibriumResearch Paper

Motivation

Finite games in strategic form are the basic model of interaction between self-interested agents in economics, engineering and computer science. Among them, potential games (Monderer and Shapley, 1996) are the class with the most tractable equilibrium behaviour: every finite potential game has a pure Nash equilibrium, and simple learning dynamics such as best response and fictitious play converge to one. A natural question is what lies at the opposite end of the space of games, and how far a general game is from that tractable class.

Candogan, Menache, Ozdaglar and Parrilo (arXiv:1005.2405; Mathematics of Operations Research 36(3), 2011, DOI 10.1287/moor.1110.0500) answer this with a canonical decomposition of every finite game into a potential, a harmonic and a nonstrategic component, obtained by viewing the payoff differences of a game as a flow on a graph and applying the combinatorial Helmholtz decomposition. Harmonic games, those whose potential component vanishes, are the complement of potential games, and the paper shows that their equilibrium behaviour is opposite as well. This mission formalizes the first such result: harmonic games generically have no pure Nash equilibrium, so the guaranteed existence of pure equilibria in potential games has no counterpart on the harmonic side. The decomposition has since been used to study near-potential games and the convergence of learning dynamics in them.

Setting

A finite game has a finite set of players M\mathcal MM with M=∣M∣M = |\mathcal M|M=∣M∣ and, for each player mmm, a nonempty finite strategy set EmE^mEm with hm=∣Em∣h_m = |E^m|hm​=∣Em∣ elements. A strategy profile is p=(pm)m∈E=∏mEmp = (p^m)_m \in E = \prod_m E^mp=(pm)m​∈E=∏m​Em, and (qm,p−m)(q^m, p^{-m})(qm,p−m) denotes ppp with player mmm's strategy replaced by qmq^mqm. The utilities u=(um)mu = (u^m)_mu=(um)m​ assign to each player a function um:E→Ru^m : E \to \mathbb Rum:E→R; for fixed M\mathcal MM and EEE a game is identified with its utilities, an element of C0MC_0^MC0M​, where C0={f:E→R}C_0 = \{f : E \to \mathbb R\}C0​={f:E→R} carries the inner product ⟨φ1,φ2⟩0=∑pφ1(p)φ2(p)\langle \varphi_1,\varphi_2\rangle_0 = \sum_p \varphi_1(p)\varphi_2(p)⟨φ1​,φ2​⟩0​=∑p​φ1​(p)φ2​(p).

A profile ppp is a pure Nash equilibrium if um(pm,p−m)≥um(qm,p−m)u^m(p^m, p^{-m}) \ge u^m(q^m, p^{-m})um(pm,p−m)≥um(qm,p−m) for every player mmm and every qm∈Emq^m \in E^mqm∈Em.

Two profiles are mmm-comparable if they are distinct and differ only in player mmm's strategy. The game graph has the profiles as nodes and joins every comparable pair. An edge flow is a function XXX on ordered pairs of profiles with X(p,q)=−X(q,p)X(p,q) = -X(q,p)X(p,q)=−X(q,p) on edges and X=0X = 0X=0 off edges; the space C1C_1C1​ of edge flows carries ⟨X,Y⟩1=12∑(p,q)∈AX(p,q)Y(p,q)\langle X,Y\rangle_1 = \tfrac12\sum_{(p,q)\in A} X(p,q)Y(p,q)⟨X,Y⟩1​=21​∑(p,q)∈A​X(p,q)Y(p,q). The combinatorial gradient is (δ0φ)(p,q)=W(p,q)(φ(q)−φ(p))(\delta_0\varphi)(p,q) = W(p,q)(\varphi(q)-\varphi(p))(δ0​φ)(p,q)=W(p,q)(φ(q)−φ(p)), with WWW the edge indicator, and δ0∗\delta_0^*δ0∗​ is its adjoint. Restricting to mmm-comparable pairs gives Dm:C0→C1D_m : C_0 \to C_1Dm​:C0​→C1​, and Du=∑mDmumD u = \sum_m D_m u^mDu=∑m​Dm​um is the flow of payoff differences of the game uuu. With Πm=Dm†Dm\Pi_m = D_m^\dagger D_mΠm​=Dm†​Dm​ (Moore–Penrose pseudoinverse) and Π=diag⁡(Π1,…,ΠM)\Pi = \operatorname{diag}(\Pi_1,\dots,\Pi_M)Π=diag(Π1​,…,ΠM​), the paper's Definition 4.2 sets

P={u∣u=Πu, Du∈im⁡δ0},H={u∣u=Πu, Du∈ker⁡δ0∗},N=ker⁡D.\mathcal P = \{u \mid u = \Pi u,\ Du \in \operatorname{im}\delta_0\},\quad \mathcal H = \{u \mid u = \Pi u,\ Du \in \ker\delta_0^*\},\quad \mathcal N = \ker D .P={u∣u=Πu, Du∈imδ0​},H={u∣u=Πu, Du∈kerδ0∗​},N=kerD.

A game is a harmonic game if u∈H⊕Nu \in \mathcal H \oplus \mathcal Nu∈H⊕N: its payoff differences form a flow with no source or sink at any profile.

Formalization targets

Goal: Proposition 5.1

For finite games in which at least two players have at least two strategies each, and for any additive Haar measure μ\muμ on the finite-dimensional space H⊕N\mathcal H \oplus \mathcal NH⊕N,

μ({u∈H⊕N:u has a pure Nash equilibrium})=0.\mu\big(\{u \in \mathcal H\oplus\mathcal N : u \text{ has a pure Nash equilibrium}\}\big) = 0 .μ({u∈H⊕N:u has a pure Nash equilibrium})=0.

This is the paper's "harmonic games generically do not have pure Nash equilibria", with "generically" read as the paper defines it: true except on a set of measure zero within the harmonic games.

Stronger structural form

For each profile ppp, the harmonic games having ppp as a pure Nash equilibrium form a proper linear subspace of H⊕N\mathcal H \oplus \mathcal NH⊕N. The exceptional set of the goal is then a finite union of lower-dimensional subspaces.

Milestones

  1. Lemma 5.1: at a pure Nash equilibrium of a harmonic game, every player is indifferent among all of their strategies.
  2. Proposition 4.1: dim⁡P=∏mhm−1\dim\mathcal P = \prod_m h_m - 1dimP=∏m​hm​−1, dim⁡H=(M−1)∏mhm−∑m∏k≠mhk+1\dim\mathcal H = (M-1)\prod_m h_m - \sum_m\prod_{k\ne m}h_k + 1dimH=(M−1)∏m​hm​−∑m​∏k=m​hk​+1, dim⁡N=∑m∏k≠mhk\dim\mathcal N = \sum_m\prod_{k\ne m}h_kdimN=∑m​∏k=m​hk​.

Significance

The result separates harmonic games sharply from potential games. A finite potential game always has a pure equilibrium; a harmonic game almost never has one. Together with the decomposition theorem, it says that the obstruction to pure equilibria in a general game is carried by its harmonic component, and it motivates the paper's later results on mixed equilibria of harmonic games (the uniformly mixed profile is always a mixed equilibrium). Proposition 4.1, a milestone here, also gives the dimension of the harmonic games, (M−1)∏mhm+1(M-1)\prod_m h_m + 1(M−1)∏m​hm​+1, and so measures how large that class is.

The results are proved in the paper; none of them is machine-checked. Formalizing them requires the paper's operator layer (flows on the game graph, the gradient with its adjoint, pseudoinverses) in Lean for the first time, and pins down two points the paper leaves informal: the measure with respect to which "generically" is meant, and the shape condition on the game under which the statement holds.

Difficulty

Lemma 5.1 is a short counting argument once the divergence-free condition δ0∗Du=0\delta_0^* D u = 0δ0∗​Du=0 is unpacked, but unpacking it requires knowing that DDD kills N\mathcal NN and computing δ0∗\delta_0^*δ0∗​ from the 12\tfrac1221​-weighted inner product. The main obstacle of the goal is showing that the exceptional subspaces are proper. The proof needs a harmonic game with nonzero payoff differences, that is dim⁡H>0\dim\mathcal H > 0dimH>0, and the only route the paper offers is the dimension count of Proposition 4.1. That count rests on the full decomposition C0M=P⊕H⊕NC_0^M = \mathcal P\oplus\mathcal H\oplus\mathcal NC0M​=P⊕H⊕N, on the kernel of each DmD_mDm​ and on the connectivity of the game graph, all of which must be built in Lean. The measure-theoretic last step, that a finite union of proper subspaces is Haar-null, is in Mathlib.

A tempting shortcut fails: placing Lebesgue measure on all of C0MC_0^MC0M​ and observing that H⊕N\mathcal H \oplus \mathcal NH⊕N is a proper subspace would prove the goal without saying anything about equilibria.

Formalization scope

Players form a finite type ι with decidable equality, and the strategy sets E m are nonempty finite types, as in the paper (Em={1,…,hm}E^m = \{1,\dots,h_m\}Em={1,…,hm​}). A game is an element of PiLp 2 (fun _ => EuclideanSpace ℝ (∀ k, E k)), with the unweighted sum inner product of p. 14. C1C_1C1​ is the subspace of edge flows with the inner product 12∑\tfrac12\sum21​∑ of (7). δ0∗\delta_0^*δ0∗​ is Mathlib's adjoint, and the pseudoinverse is defined directly as the inverse of LLL on (ker⁡L)⊥(\ker L)^\perp(kerL)⊥ composed with the orthogonal projection onto im⁡L\operatorname{im} LimL. P,H,N\mathcal P,\mathcal H,\mathcal NP,H,N are defined by (28), not by the alternative description (29). Harmonic games are the submodule H ⊔ N, and pure Nash equilibrium is AGT.IsPureNash from the published agt_games definitions.

Added hypothesis. The paper leaves implicit that at least two distinct players have at least two strategies each. Its proof uses this through "dimension of H\mathcal HH is larger than zero". Without it Proposition 5.1 is false: with two players having 111 and hhh strategies, dim⁡H=(2−1)h−(h+1)+1=0\dim\mathcal H = (2-1)h - (h+1) + 1 = 0dimH=(2−1)h−(h+1)+1=0, every harmonic game is nonstrategic, and every profile is a pure equilibrium of every harmonic game. The goal and the structural theorem therefore carry this hypothesis explicitly.

The measure. The measure is an arbitrary additive Haar measure on the subspace H⊕N\mathcal H\oplus\mathcal NH⊕N itself, with the Borel σ-algebra of its subspace topology. A measure on the ambient C0MC_0^MC0M​ would make the statement trivial, because the whole subspace is null there. Proposition 4.1 is stated as equalities in Z\mathbb ZZ, so that M−1M-1M−1 and the subtraction in part 2 are not truncated.

Needed infrastructure: kernels of the DmD_mDm​ (the paper's Lemma 4.2), the projection property of D†DD^\dagger DD†D, the decomposition theorem, and the connectivity of the game graph. The operator layer is shared with the other missions of this series and is reusable for any work on flows on graphs. Proofs of the milestones, and of the structural form independently of the goal, are welcome.

Selected references

  • O. Candogan, I. Menache, A. Ozdaglar, P. A. Parrilo, Flows and Decompositions of Games: Harmonic and Potential Games, arXiv:1005.2405v2, 2010; Mathematics of Operations Research 36(3):474–503, 2011. https://arxiv.org/abs/1005.2405, https://doi.org/10.1287/moor.1110.0500
  • D. Monderer, L. S. Shapley, Potential Games, Games and Economic Behavior 14(1):124–143, 1996. https://doi.org/10.1006/game.1996.0044
  • X. Jiang, L.-H. Lim, Y. Yao, Y. Ye, Statistical ranking and combinatorial Hodge theory, Mathematical Programming 127(1):203–244, 2011. https://doi.org/10.1007/s10107-010-0419-x
9 thms2 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

How Bad is Selfish Routing? 3: With Finitely Many Agents Splitting Their Flow and x·ℓₑ(x) Convex, a Nash Flow Costs No More Than Any Flow Feasible for Twice the RatesResearch Paper

Motivation

In a road or communication network, traffic is routed by its users, not by a central planner. Each user picks the route that is cheapest for itself, and the resulting equilibrium can be much more expensive for the network as a whole than the best centrally planned routing. Roughgarden and Tardos, How Bad is Selfish Routing? (J. ACM 2002), quantified this loss. Their basic model is nonatomic: infinitely many users, each controlling a negligible amount of traffic. There, the cost of a Nash flow can exceed the optimum by an unbounded factor, but it never exceeds the cost of an optimal flow that routes twice as much traffic (their Theorem 3.1).

Many networks are not like that. A few large operators (internet service providers, freight companies, a navigation app routing its whole user base) each control a strictly positive share of the traffic and can split it over many paths. Section 5.2 of the paper treats this finite splittable model and proves the analogue of the bicriteria bound, Theorem 5.4. This mission formalizes that theorem and the three steps of its proof.

Setting

A network has a finite set EEE of edges. Each edge eee carries a latency function ℓe\ell_eℓe​, nonnegative, nondecreasing and continuous on [0,∞)[0,\infty)[0,∞): the delay on eee when xxx units of flow use it is ℓe(x)\ell_e(x)ℓe​(x).

There are kkk agents. Agent iii must send ri>0r_i>0ri​>0 units of flow from a source sis_isi​ to a destination tit_iti​, over its set Pi\mathcal P_iPi​ of paths. Distinct agents may have the same source and destination; their path sets are then separate copies. A flow fff assigns a nonnegative amount fPf_PfP​ to each path; agent iii's part is f(i)f^{(i)}f(i), the restriction of fff to Pi\mathcal P_iPi​. The flow is feasible for the rates rrr if ∑P∈PifP=ri\sum_{P\in\mathcal P_i} f_P = r_i∑P∈Pi​​fP​=ri​ for every iii, and feasible for 2r2r2r if each agent instead sends 2ri2r_i2ri​.

The edge flow fe=∑P∋efPf_e=\sum_{P\ni e} f_Pfe​=∑P∋e​fP​ is the flow of all agents through eee. The latency of a path is ℓP(f)=∑e∈Pℓe(fe)\ell_P(f)=\sum_{e\in P}\ell_e(f_e)ℓP​(f)=∑e∈P​ℓe​(fe​), and

C(f)=∑PℓP(f) fP,Ci(f)=∑P∈PiℓP(f) fP(i)C(f)=\sum_P \ell_P(f)\,f_P,\qquad C_i(f)=\sum_{P\in\mathcal P_i}\ell_P(f)\,f^{(i)}_PC(f)=P∑​ℓP​(f)fP​,Ci​(f)=P∈Pi​∑​ℓP​(f)fP(i)​

are the cost of the flow (its total latency) and the cost of agent iii. A feasible flow fff is at Nash equilibrium if no agent can lower its own cost by rerouting its own flow: for each iii, f(i)f^{(i)}f(i) minimizes CiC_iCi​ given f(j)f^{(j)}f(j) for j≠ij\neq ij=i.

In Lean, edges, paths and agents are Fin J, Fin R and Fin Sd; a path is a 0/10/10/1 incidence column A j r, s r is the agent owning path r, and rate i is rir_iri​. The edge flow linkFlow and the feasible set wardropFeasible come from the published definition KellyStochasticNetworks_Wardrop; pathLatency, cost and the modified latencies barLatency come from the series' shared model definitions (SelfishRouting.Bicriteria), and agentCost and IsSplittableNash are defined in this mission.

Formalization targets

Goal: Theorem 5.4 (p. 20)

If x⋅ℓe(x)x\cdot\ell_e(x)x⋅ℓe​(x) is convex on [0,∞)[0,\infty)[0,∞) for every edge, fff is at Nash equilibrium for the finite splittable instance (G,r,ℓ)(G,r,\ell)(G,r,ℓ), and f∗f^*f∗ is feasible for (G,2r,ℓ)(G,2r,\ell)(G,2r,ℓ), then

C(f)≤C(f∗).C(f)\le C(f^*).C(f)≤C(f∗).

The comparison flow f∗f^*f∗ is arbitrary, so the statement implies the bound against an optimal flow for 2r2r2r without naming one.

Milestones (proof of Theorem 5.4, p. 20)

The proof uses the modified latencies ℓˉe(x)=ℓe(fe)\bar\ell_e(x)=\ell_e(f_e)ℓˉe​(x)=ℓe​(fe​) for x≤fex\le f_ex≤fe​ and ℓˉe(x)=ℓe(x)\bar\ell_e(x)=\ell_e(x)ℓˉe​(x)=ℓe​(x) for x≥fex\ge f_ex≥fe​, built from the Nash flow fff (p. 12). Writing Cˉ(g)=∑PℓˉP(g)gP\bar C(g)=\sum_P\bar\ell_P(g)g_PCˉ(g)=∑P​ℓˉP​(g)gP​:

  1. Cˉ(f∗)−C(f∗)≤C(f)\bar C(f^*) - C(f^*)\le C(f)Cˉ(f∗)−C(f∗)≤C(f) for any flows with nonnegative path flows;
  2. fff is optimal for (G,r,ℓˉ)(G,r,\bar\ell)(G,r,ℓˉ): Cˉ(f)≤Cˉ(g)\bar C(f)\le\bar C(g)Cˉ(f)≤Cˉ(g) for every ggg feasible for rrr;
  3. every ggg feasible for 2r2r2r has Cˉ(g)≥2C(f)\bar C(g)\ge 2C(f)Cˉ(g)≥2C(f).

Significance

Theorem 5.4 says that in a network shared by finitely many traffic-splitting operators, the inefficiency of selfish routing can always be offset by doubling the network's capacity to carry traffic, whatever the network topology and whatever the (convexity-qualified) delay functions. Theorem 3.1 is its limit as the number of agents grows and each share shrinks to zero. The finite splittable model is the setting of later work on atomic splittable routing games and their price of anarchy, which this mission's definitions can serve.

On the formalization side, the result is proved on paper but, as far as a search of the platform and of Mathlib shows, no part of selfish-routing equilibrium theory with finitely many agents has been formalized. The mission provides a reusable encoding of the finite splittable model (per-agent costs, per-agent best responses with all other agents fixed) on top of the published Wardrop definitions, and the three proof steps as separately provable milestones. Milestone 2 is the one with independent content: it turns a game-theoretic equilibrium into the optimum of a convex program.

Difficulty

The obvious attempt copies the proof of Theorem 3.1. That proof uses the nonatomic equilibrium condition: every used path of a commodity has the same, minimal latency Li(f)L_i(f)Li​(f), so ℓˉP(g)≥Li(f)\bar\ell_P(g)\ge L_i(f)ℓˉP​(g)≥Li​(f) for every path and the lower bound Cˉ(g)≥2C(f)\bar C(g)\ge 2C(f)Cˉ(g)≥2C(f) follows path by path. In the finite splittable model this fails: an agent at equilibrium balances marginal costs ℓP(f)+fP(i)⋅(slope)\ell_P(f)+f^{(i)}_P\cdot(\text{slope})ℓP​(f)+fP(i)​⋅(slope), not latencies, and its used paths can have different latencies. The proof must go through the optimality of fff for the modified program (G,r,ℓˉ)(G,r,\bar\ell)(G,r,ℓˉ), and that needs both the convexity of x⋅ℓe(x)x\cdot\ell_e(x)x⋅ℓe​(x) and a comparison between the change of agent iii's cost and the change of the ℓˉ\bar\ellℓˉ-cost under the same local move. The paper invokes a first-order optimality lemma (its Lemma 2.4) for ℓˉ\bar\ellℓˉ, which is not differentiable at fef_efe​; a formal proof has to handle one-sided derivatives or argue by convexity directly.

Formalization scope

  • Routes, not graphs. Paths are arbitrary 0/10/10/1 incidence columns with an owner map; the paper's simple-path families are one instance. The proof never uses graph structure. Two agents with the same source and destination have disjoint index sets of routes.
  • Latency hypotheses on [0,∞)[0,\infty)[0,∞) only: 0 ≤ ℓ j t for 0 ≤ t, MonotoneOn and ContinuousOn on Set.Ici 0, and ConvexOn ℝ (Set.Ici 0) (fun t => t * ℓ j t). Continuity replaces the differentiability of §2.1, as footnote 3 (p. 7) and §5.2 allow; this weakens a hypothesis.
  • Rates are positive (0 < rate i). The case of zero agents is allowed and trivial, as in the paper.
  • Nash equilibrium is the precise form printed on p. 19: each agent's part minimizes its cost among feasible flows that agree with fff on every other agent's paths. A deviating agent keeps its total at rir_iri​ and cannot change others' flows; the agent's cost is evaluated at the total edge flow of all agents.
  • No ratios. The theorem is the inequality C(f)≤C(f∗)C(f)\le C(f^*)C(f)≤C(f∗) for every f∗f^*f∗ feasible for 2r2r2r; no division by an optimal cost appears.
  • Feasible for 2r2r2r is wardropFeasible s (fun i => 2 * rate i).
  • The existence of a Nash flow (Rosen) is neither assumed nor claimed. A sorry-free check shows the definition is satisfiable: in the two-link Pigou network with one agent of rate 1 and latencies 111 and xxx, the flow (1/2,1/2)(1/2,1/2)(1/2,1/2) is a Nash flow.
  • A trivializing formalization is excluded: the equilibrium is not the Wardrop condition, deviations are restricted to the deviating agent's own feasible flows, and the theorem quantifies over every feasible comparison flow rather than over an assumed optimum.

Contributions welcome: proofs of the three milestones and the goal; a general lemma that a feasible flow minimizing a convex separable edge cost has no improving two-path move, and its converse; a proof that x↦ℓˉe(x) xx\mapsto\bar\ell_e(x)\,xx↦ℓˉe​(x)x is convex when x ℓe(x)x\,\ell_e(x)xℓe​(x) is.

Selected references

  • T. Roughgarden and É. Tardos, How Bad is Selfish Routing?, Journal of the ACM 49(2):236–259, 2002. https://doi.org/10.1145/506147.506153
  • J. B. Rosen, Existence and Uniqueness of Equilibrium Points for Concave N-Person Games, Econometrica 33(3):520–534, 1965. https://doi.org/10.2307/1911749
  • F. Kelly and E. Yudovina, Stochastic Networks, Cambridge University Press, 2014, Chapter 4. https://doi.org/10.1017/CBO9781139565363
8 thms2 active usersReviewed
Convex OptimizationOperations ResearchOptimization·Captain: mikedeng1

How Bad is Selfish Routing? 4: With Polynomial Latencies of Degree p and Nonnegative Coefficients the Cost of a Nash Flow Is at Most p + 1 Times the Optimal CostResearch Paper

Motivation

In a road or communication network carrying a large population of users, each user picks a route that is fastest for itself given the congestion caused by everyone else. The resulting traffic pattern, a Wardrop or Nash equilibrium, need not minimize the total travel time: Braess's paradox shows that adding a road can make every user slower. Transportation science has modelled such equilibria since Wardrop (1952) and Beckmann, McGuire and Winsten (1956), and the question of how much efficiency selfish behaviour costs was posed in computer science by Koutsoupias and Papadimitriou (1999).

Roughgarden and Tardos, How Bad is Selfish Routing? (J. ACM, 2002) gave the first general answers for networks with many infinitesimal users. This mission formalizes the first of them, from §2.5 of the paper: when every edge latency is a polynomial of degree at most ppp with nonnegative coefficients, the total latency at equilibrium is at most p+1p+1p+1 times the optimum. The argument goes through the convex program of Beckmann et al., whose optimal solutions are exactly the equilibria (Dafermos and Sparrow, 1969).

Timeline. 1952: Wardrop states the equilibrium principle. 1956: Beckmann, McGuire and Winsten characterize equilibria as minimizers of a convex potential and prove existence. 1969: Dafermos and Sparrow reprove existence and essential uniqueness for general networks. 1999: Koutsoupias and Papadimitriou introduce the worst-case ratio between equilibrium and optimum. 2000–2002: Roughgarden and Tardos prove the bounds p+1p+1p+1 for polynomials (Corollary 2.8) and 4/34/34/3 for linear latencies. 2002–2003: Roughgarden shows the worst ratio for degree-ppp polynomials is Θ(p/ln⁡p)\Theta(p/\ln p)Θ(p/lnp), attained already on two parallel links.

Setting

An instance consists of finitely many edges eee, finitely many commodities i∈{1,…,k}i\in\{1,\dots,k\}i∈{1,…,k} and finitely many routes PPP. Each route is a set of edges, recorded by a 0/10/10/1 incidence matrix AAA (AeP=1A_{eP}=1AeP​=1 iff e∈Pe\in Pe∈P), and serves exactly one commodity; Pi\mathcal P_iPi​ is the set of routes serving commodity iii. Commodity iii has a rate ri>0r_i>0ri​>0.

A flow assigns a value fPf_PfP​ to each route. It induces the edge flows fe=∑P∋efPf_e=\sum_{P\ni e}f_Pfe​=∑P∋e​fP​ and is feasible if fP≥0f_P\ge0fP​≥0 for all PPP and ∑P∈PifP=ri\sum_{P\in\mathcal P_i}f_P=r_i∑P∈Pi​​fP​=ri​ for all iii. Each edge has a latency function ℓe\ell_eℓe​, nonnegative, nondecreasing and continuous on [0,∞)[0,\infty)[0,∞). The latency of a route is ℓP(f)=∑e∈Pℓe(fe)\ell_P(f)=\sum_{e\in P}\ell_e(f_e)ℓP​(f)=∑e∈P​ℓe​(fe​) and the cost of a flow is

C(f)=∑PℓP(f) fP=∑eℓe(fe) fe.C(f)=\sum_P\ell_P(f)\,f_P=\sum_e\ell_e(f_e)\,f_e .C(f)=P∑​ℓP​(f)fP​=e∑​ℓe​(fe​)fe​.

A feasible flow is at Nash equilibrium (Definition 2.1) if moving any amount δ∈[0,fP1]\delta\in[0,f_{P_1}]δ∈[0,fP1​​] of commodity iii from a used route P1P_1P1​ to another route P2∈PiP_2\in\mathcal P_iP2​∈Pi​ leaves P2P_2P2​ at least as slow, after the move, as P1P_1P1​ was before. Lemma 2.2 shows that this is the Wardrop condition: every route that carries flow has minimum latency among the routes of its commodity.

The Beckmann potential of a flow is Φ(f)=∑e∫0feℓe(t) dt\Phi(f)=\sum_e\int_0^{f_e}\ell_e(t)\,dtΦ(f)=∑e​∫0fe​​ℓe​(t)dt, the objective of the program (NLP2) of the paper.

Formalization targets

Goal: Corollary 2.8

For latencies ℓe(x)=∑i=0pae,ixi\ell_e(x)=\sum_{i=0}^{p}a_{e,i}x^iℓe​(x)=∑i=0p​ae,i​xi with p≥1p\ge1p≥1 an integer and ae,i≥0a_{e,i}\ge0ae,i​≥0, every flow fff at Nash equilibrium and every feasible flow f∗f^*f∗ satisfy

C(f)≤(p+1) C(f∗).C(f)\le(p+1)\,C(f^*).C(f)≤(p+1)C(f∗).

This is the paper's ρ(G,r,ℓ)=C(f)/C(f∗)≤p+1\rho(G,r,\ell)=C(f)/C(f^*)\le p+1ρ(G,r,ℓ)=C(f)/C(f∗)≤p+1 written without division.

Milestones

  1. Lemma 2.2: Nash equilibrium (Definition 2.1)   ⟺  \iff⟺ the Wardrop condition.
  2. Proof of Lemma 2.6: the flows at Nash equilibrium are exactly the feasible minimizers of Φ\PhiΦ.
  3. Lemma 2.6: a Nash flow exists, and all Nash flows have the same cost.
  4. Corollary 2.7: if x ℓe(x)≤α∫0xℓe(t) dtx\,\ell_e(x)\le\alpha\int_0^x\ell_e(t)\,dtxℓe​(x)≤α∫0x​ℓe​(t)dt for every edge and every x>0x>0x>0, with α≥1\alpha\ge1α≥1, then
C(f)≤α C(f∗)for every Nash flow f and feasible f∗.C(f)\le\alpha\,C(f^*)\quad\text{for every Nash flow } f \text{ and feasible } f^* .C(f)≤αC(f∗)for every Nash flow f and feasible f∗.

Significance

The result. Corollary 2.8 was, according to the authors, the first bound of its kind for polynomial latencies (p. 11). It shows that for the latency functions used in practice (the Bureau of Public Roads function ℓ(x)=a+bx4\ell(x)=a+bx^4ℓ(x)=a+bx4 has p=4p=4p=4) uncoordinated routing loses at most a bounded factor, independent of the network size, the number of commodities and the rates. Corollary 2.7 isolates the mechanism: a single scalar property of each latency function, how far the cost xℓ(x)x\ell(x)xℓ(x) can exceed the potential ∫0xℓ\int_0^x\ell∫0x​ℓ, controls the efficiency loss of the whole network.

Formalizing it. The results are proved in the paper (and the bound p+1p+1p+1 has since been sharpened); none of them is machine-checked on the platform. The mission produces a reusable Lean development of nonatomic selfish routing: Definition 2.1 in its deviation form, its equivalence with the Wardrop condition, the Beckmann characterization of equilibria with an honest integral potential, existence and cost-uniqueness of equilibria, and the potential-based efficiency bound. The same layer is used by the companion missions on the bicriteria bound and the 4/34/34/3 bound for linear latencies.

Difficulty

The bound itself is a short chain of inequalities once the equilibrium is known to minimize the potential Φ\PhiΦ. That step is the substance: it requires showing that the Wardrop condition is a first-order optimality condition of a convex program over the polytope of feasible flows, with latencies that are only continuous, so Φ\PhiΦ is differentiable but its derivative may have kinks. Passing from Definition 2.1 (finite deviations) to the Wardrop condition needs a limit δ→0\delta\to0δ→0, which fails without continuity of the latencies. Mathlib has no Karush–Kuhn–Tucker theory for such programs, so the optimality characterization has to be built from first principles.

Formalization scope

  • Encoding. Edges, routes and commodities are Fin J, Fin R, Fin Sd. Edge flows, feasibility, the Wardrop condition and the potential Φ\PhiΦ are the published KellyStochasticNetworks.linkFlow, wardropFeasible, IsWardropEquilibrium and wardropObjective, reused unchanged.
  • Routes, not graphs. Routes are arbitrary 0/10/10/1 incidence columns rather than the simple sis_isi​–tit_iti​ paths of a graph, a generalization the paper's arguments never use. Two copies of one path serving two commodities are two routes.
  • Definition 2.1 is read with P1≠P2P_1\ne P_2P1​=P2​ and fP1>0f_{P_1}>0fP1​​>0. As printed, P1=P2P_1=P_2P1​=P2​ makes the condition fail for strictly increasing latencies, and fP1=0f_{P_1}=0fP1​​=0 forces unused routes to have the same latency as used ones; either reading would make Nash flows nonexistent in simple instances.
  • Latencies are nonnegative, nondecreasing and continuous on [0,∞)[0,\infty)[0,∞) only. Continuity replaces the paper's differentiability, as its footnote 3 allows; it also makes ∫0xℓe\int_0^x\ell_e∫0x​ℓe​ a genuine integral.
  • Rates are positive. In Lemma 2.6's existence part every commodity must be served by a route, the route-encoding meaning of "an instance".
  • No ratios. Every bound ρ≤c\rho\le cρ≤c is stated as C(f)≤c C(f∗)C(f)\le c\,C(f^*)C(f)≤cC(f∗) for every feasible f∗f^*f∗, which is what each proof shows and which avoids division by a zero cost.
  • Polynomials share one degree bound p≥1p\ge1p≥1; leading coefficients may vanish; coefficients are required nonnegative for i≤pi\le pi≤p.

A statement in which Nash flows cannot exist (the literal Definition 2.1), or in which ∫0xℓe\int_0^x\ell_e∫0x​ℓe​ is the junk value of a non-integrable function, would make the goal vacuous; the guards above rule both out, and the sorry-free check that two small instances admit Nash flows confirms it.

Contributions welcome: proofs of the milestones, in particular the first-order characterization of minimizers of Φ\PhiΦ over the feasible polytope, which is reusable for every potential game on flows.

Selected references

  • T. Roughgarden and É. Tardos, How Bad is Selfish Routing?, J. ACM 49(2):236–259, 2002. https://doi.org/10.1145/506147.506153
  • M. Beckmann, C. B. McGuire and C. B. Winsten, Studies in the Economics of Transportation, Yale University Press, 1956 (RAND RM-1488). https://www.rand.org/pubs/research_memoranda/RM1488.html
  • S. C. Dafermos and F. T. Sparrow, The traffic assignment problem for a general network, J. Res. Nat. Bur. Standards 73B(2):91–118, 1969. https://doi.org/10.6028/jres.073B.010
  • J. G. Wardrop, Some theoretical aspects of road traffic research, Proc. Inst. Civil Engineers, Part II, 1:325–378, 1952. https://doi.org/10.1680/ipeds.1952.11259
  • E. Koutsoupias and C. Papadimitriou, Worst-case equilibria, STACS 1999, LNCS 1563, 404–413. https://doi.org/10.1007/3-540-49116-3_38
  • T. Roughgarden, The price of anarchy is independent of the network topology, J. Comput. System Sci. 67(2):341–364, 2003. https://doi.org/10.1016/S0022-0000(03)00044-8
10 thms2 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

The Price of Anarchy is Independent of the Network Topology: For a Standard Latency Class Containing the Constants, Two-Link Networks Attain the Worst Nash/Optimal Cost Ratio α(L)Research Paper

Motivation

In a road or communication network where each unit of traffic picks its own route, the outcome is a Nash flow (Wardrop equilibrium): no traffic can lower its own latency by switching paths. It is well known since Pigou (1920) that such selfish routing can be inefficient: the total latency of a Nash flow may exceed that of the best centrally planned flow. The ratio between the two, maximized over a family of instances, is the price of anarchy. Network designers, transportation economists and computer scientists use it to decide when central coordination (tolls, routing protocols) is worth its cost.

Timeline:

  • 1920–1956. Pigou's two-road example shows inefficiency; Wardrop (1952) and Beckmann, McGuire and Winsten (1956) formalize equilibrium flows and characterize optimal flows by marginal costs.
  • 2002. Roughgarden and Tardos (J. ACM 49(2), 2002) prove that with affine latencies ℓ(x)=ax+b\ell(x)=ax+bℓ(x)=ax+b the price of anarchy is exactly 4/34/34/3 in every network.
  • 2002–2003. Roughgarden (STOC 2002; journal version J. Comput. Syst. Sci. 67(2), 2003) shows that for any class of latency functions satisfying mild conditions the price of anarchy does not depend on the network: two parallel links are already worst possible. This mission formalizes that paper.
  • 2004. Correa, Schulz and Stier-Moses (Math. Oper. Res. 29(4), 2004) give a geometric proof of the same bound and extend it to capacitated networks.

Setting

A network is a finite directed multigraph G=(V,E)G=(V,E)G=(V,E); parallel edges are allowed. There are kkk commodities; commodity iii has a source sis_isi​, a sink tit_iti​, a rate ri>0r_i>0ri​>0, and at least one simple sis_isi​–tit_iti​ path. A flow fff assigns a nonnegative amount fPif^i_PfPi​ to each simple sis_isi​–tit_iti​ path PPP; it is feasible if ∑PfPi=ri\sum_P f^i_P=r_i∑P​fPi​=ri​ for every iii. The edge flow is fe=∑i∑P∋efPif_e=\sum_i\sum_{P\ni e}f^i_Pfe​=∑i​∑P∋e​fPi​.

Each edge carries a latency function ℓe:[0,∞)→R\ell_e:[0,\infty)\to\mathbb Rℓe​:[0,∞)→R, nonnegative, differentiable and nondecreasing. The latency of a path is ℓP(f)=∑e∈Pℓe(fe)\ell_P(f)=\sum_{e\in P}\ell_e(f_e)ℓP​(f)=∑e∈P​ℓe​(fe​) and the cost of a flow is C(f)=∑i∑PℓP(f)fPiC(f)=\sum_i\sum_P\ell_P(f)f^i_PC(f)=∑i​∑P​ℓP​(f)fPi​. A feasible flow of least cost is optimal. A flow is a Nash flow (Definition 2.1) if moving any amount δ∈(0,fP1i]\delta\in(0,f^i_{P_1}]δ∈(0,fP1​i​] of commodity iii from a used path P1P_1P1​ to another path P2P_2P2​ yields a flow f~\tilde ff~​ with ℓP1(f)≤ℓP2(f~)\ell_{P_1}(f)\le\ell_{P_2}(\tilde f)ℓP1​​(f)≤ℓP2​​(f~​). The ratio between the cost of a Nash flow and of an optimal flow is ρ(G,r,ℓ)\rho(G,r,\ell)ρ(G,r,ℓ).

A latency function is standard if x ℓ(x)x\,\ell(x)xℓ(x) is convex on [0,∞)[0,\infty)[0,∞); its marginal cost is ℓ∗(x)=ddx(x ℓ(x))\ell^*(x)=\frac{d}{dx}(x\,\ell(x))ℓ∗(x)=dxd​(xℓ(x)). A class L\mathcal LL of latency functions is standard if it contains a nonzero function and all its members are standard. The anarchy value of a standard ℓ\ellℓ is

α(ℓ)=sup⁡r>0: ℓ(r)>0[λμ+(1−λ)]−1,ℓ∗(λr)=ℓ(r), λ∈[0,1], μ=ℓ(λr)ℓ(r),\alpha(\ell)=\sup_{r>0:\ \ell(r)>0}\bigl[\lambda\mu+(1-\lambda)\bigr]^{-1},\qquad \ell^*(\lambda r)=\ell(r),\ \lambda\in[0,1],\ \mu=\frac{\ell(\lambda r)}{\ell(r)},α(ℓ)=r>0: ℓ(r)>0sup​[λμ+(1−λ)]−1,ℓ∗(λr)=ℓ(r), λ∈[0,1], μ=ℓ(r)ℓ(λr)​,

and α(L)=sup⁡0≠ℓ∈Lα(ℓ)∈[1,∞]\alpha(\mathcal L)=\sup_{0\neq\ell\in\mathcal L}\alpha(\ell)\in[1,\infty]α(L)=sup0=ℓ∈L​α(ℓ)∈[1,∞]. It is the worst ratio in a Pigou-type network: two parallel links, one with a constant latency and one with ℓ\ellℓ. Finally, G2G_2G2​ is the network with one source, one sink and two edges from source to sink.

Formalization targets

Goal: Theorem 4.2

For a standard class L\mathcal LL that contains the constant functions ℓ(x)=c\ell(x)=cℓ(x)=c, c>0c>0c>0, with I\mathcal II the set of all instances with latencies in L\mathcal LL and I2⊆I\mathcal I_2\subseteq\mathcal II2​⊆I the single-commodity instances on G2G_2G2​,

sup⁡(G2,r,ℓ)∈I2ρ(G2,r,ℓ)=α(L)=sup⁡(G,r,ℓ)∈Iρ(G,r,ℓ).\sup_{(G_2,r,\ell)\in\mathcal I_2}\rho(G_2,r,\ell)=\alpha(\mathcal L)=\sup_{(G,r,\ell)\in\mathcal I}\rho(G,r,\ell).(G2​,r,ℓ)∈I2​sup​ρ(G2​,r,ℓ)=α(L)=(G,r,ℓ)∈Isup​ρ(G,r,ℓ).

It is stated as two parts: every ratio C(f)/C(f∗)C(f)/C(f^*)C(f)/C(f∗) of a feasible Nash flow to a feasible flow of positive cost, in any network with any number of commodities, is at most α(L)\alpha(\mathcal L)α(L); and every value below α(L)\alpha(\mathcal L)α(L) is exceeded by such a ratio on G2G_2G2​.

Milestones

The milestones follow the paper's proof: the edge form of the cost (§2.1), the shortest-path characterization of Nash flows (Proposition 2.2), the cost of a Nash flow (Proposition 2.3), monotonicity and continuity of marginal costs (§2.3), existence of λ\lambdaλ (§3.1), Lemmas 3.5–3.7, the upper bound ρ≤α(L)\rho\le\alpha(\mathcal L)ρ≤α(L) (Theorem 3.8) and the two-link lower bound (Lemma 4.1).

Companion results

Lemma 4.4 and Theorem 4.5 replace "contains the constants" by diversity (for each c>0c>0c>0 some ℓ∈L\ell\in\mathcal Lℓ∈L has ℓ(0)=c\ell(0)=cℓ(0)=c) and show that networks of parallel links are worst possible among single-commodity instances. Proposition 5.1 computes the price of anarchy of polynomials of degree at most ppp with nonnegative coefficients:

sup⁡Ipρ=[1−p (p+1)−(p+1)/p]−1=Θ ⁣(pln⁡p).\sup_{\mathcal I_p}\rho=\bigl[1-p\,(p+1)^{-(p+1)/p}\bigr]^{-1}=\Theta\!\left(\frac{p}{\ln p}\right).Ip​sup​ρ=[1−p(p+1)−(p+1)/p]−1=Θ(lnpp​).

Significance

The theorem reduces a combinatorial question (the worst instance over all networks and all commodity structures) to a one-dimensional calculus problem: computing α(ℓ)\alpha(\ell)α(ℓ) for the steepest functions of the class. It yields exact prices of anarchy for polynomial latencies (Proposition 5.1), for M/M/1 delay functions and others, and it shows that the inefficiency of selfish routing is never caused by the interaction of commodities or by network structure: Pigou's two-link example already captures it. The bound has become a standard reference point for later work on smoothness arguments, tolls and Stackelberg routing.

The result is proved; it has not been formalized. This mission produces a machine-checked model of nonatomic multicommodity routing on directed multigraphs (simple paths, path flows, Nash flows in the paper's own definition, marginal costs), the general upper bound for an arbitrary standard class, and the matching lower bound in two-link and parallel-link networks. Alternative arguments, such as the variational-inequality proof of Correa, Schulz and Stier-Moses, are equally welcome as proofs of the same statements.

Difficulty

The obvious approach, following Roughgarden–Tardos for affine latencies, scales the Nash flow down by a constant factor and shows the result is optimal for reduced rates. For nonlinear latencies no single factor works. The paper's proof scales each edge by its own factor λe\lambda_eλe​, which produces a pseudoflow that obeys no conservation constraints, and the augmentation from it to an optimal flow must then be priced edge by edge. Formally, the scaling factors are solutions of ℓe∗(λefe)=ℓe(fe)\ell_e^*(\lambda_e f_e)=\ell_e(f_e)ℓe∗​(λe​fe​)=ℓe​(fe​) that need not be unique, marginal costs are one-sided derivatives at 000, and the anarchy value may be infinite, so every comparison has to be valid in the extended reals.

Formalization scope

All declarations live in PoAIndep.Topology. A network is a pair of finite types with endpoint maps src tgt : E → V; parallel edges are free. Simple paths are nonempty edge lists with a repetition-free vertex sequence, so commodities with si=tis_i=t_isi​=ti​ are excluded. A flow stores one finitely supported path flow per commodity. Latency functions are maps R→R\mathbb R\to\mathbb RR→R whose properties (nonnegative, differentiable, nondecreasing; for standard ones, xℓ(x)x\ell(x)xℓ(x) convex) are required on [0,∞)[0,\infty)[0,∞) only, and ℓ∗\ell^*ℓ∗ is the derivative within [0,∞)[0,\infty)[0,∞). The standing assumptions of §2.1 (ri>0r_i>0ri​>0, Pi≠∅\mathcal P_i\neq\emptysetPi​=∅, latency properties) are fields of the Instance structure; standardness of the latencies enters through the class L\mathcal LL.

The anarchy values live in [0,∞][0,\infty][0,∞]; α(ℓ)\alpha(\ell)α(ℓ) is the supremum over all admissible pairs (r,λ)(r,\lambda)(r,λ), which equals the page's value because the expression does not depend on the choice of λ\lambdaλ. Instead of ρ\rhoρ, which presupposes existence and uniqueness of the Nash cost (Proposition 2.4, cited by the paper), statements bound C(f)/C(f∗)C(f)/C(f^*)C(f)/C(f∗) for every feasible Nash flow fff and every feasible f∗f^*f∗ with C(f∗)>0C(f^*)>0C(f∗)>0. The networks G2G_2G2​ and GmG_mGm​ are instances of the general model, so I2⊆I\mathcal I_2\subseteq\mathcal II2​⊆I holds literally.

The Nash condition is Definition 2.1, not the shortest-path characterization, and the cost is the path sum, not the edge sum; both alternatives would make milestones trivial. The goal is not satisfied by the two-link lower bound alone: its upper part quantifies over every network and every number of commodities.

Reusable beyond this mission: the routing model, Nash flows, marginal costs and the anarchy value, which also underlie the companion paper on the 4/34/34/3 bound and later work on tolls and Stackelberg strategies. Proofs of any milestone, and supporting lemmas about convex functions with one-sided derivatives, are welcome.

Selected references

  • T. Roughgarden, The price of anarchy is independent of the network topology, STOC 2002, pp. 428–437; journal version J. Comput. Syst. Sci. 67(2):341–364, 2003. https://doi.org/10.1145/509967.509971
  • T. Roughgarden and É. Tardos, How bad is selfish routing?, J. ACM 49(2):236–259, 2002. https://doi.org/10.1145/506147.506153
  • J. R. Correa, A. S. Schulz and N. E. Stier-Moses, Selfish routing in capacitated networks, Math. Oper. Res. 29(4):961–976, 2004. https://doi.org/10.1287/moor.1040.0098
  • M. Beckmann, C. B. McGuire and C. B. Winsten, Studies in the Economics of Transportation, Yale University Press, 1956.
  • J. G. Wardrop, Some theoretical aspects of road traffic research, Proc. Inst. Civil Engineers, Part II, 1:325–378, 1952. https://doi.org/10.1680/ipeds.1952.11259
12 thms2 active usersReviewed
Dynamical SystemsLinear algebra·Captain: mikedeng1

Uncoupled Dynamics Do Not Lead to Nash Equilibrium 1: Near the Two-Player Unit-Disk Game Γ₀ of Section II, No Uncoupled Dynamic Is Nash-ConvergentResearch Paper

Motivation

Learning in games asks whether players who adjust their strategies over time, by simple rules, end up at a Nash equilibrium. Many adaptive dynamics share one informational feature: each player's adjustment depends on the current play and on that player's own payoff function, but not on the payoffs of the others. Hart and Mas-Colell (AER 2003) call such dynamics uncoupled, and show that this feature alone rules out guaranteed convergence to Nash equilibrium, even for families of games in which every game has exactly one equilibrium. Earlier non-convergence results, such as Shapley's example for fictitious play and the cycling examples of Jordan (1993) and Foster and Young (1998), concern particular dynamics; this one applies to the whole class of uncoupled dynamics. It is one reason the learning literature turned to weaker targets such as correlated equilibrium, which regret-based uncoupled procedures do reach (Hart and Mas-Colell, Econometrica 2000).

The paper proves its theorem in two settings: a two-player game with a continuum of strategies (§II and the Appendix) and a three-player game with two strategies each (§III). This mission formalizes the first setting.

Setting

There are two players, i=1,2i=1,2i=1,2, and j=3−ij=3-ij=3−i denotes the other player. Each player's strategy set is the closed unit disk D={z∈R2:∥z∥≤1}D=\{z\in\mathbb R^2:\|z\|\le1\}D={z∈R2:∥z∥≤1}, and a profile is x=(x1,x2)∈X:=D×Dx=(x^1,x^2)\in X:=D\times Dx=(x1,x2)∈X:=D×D. A game Γ=(u1,u2)\Gamma=(u^1,u^2)Γ=(u1,u2) is a pair of payoff functions on XXX. A profile xˉ\bar xxˉ is a (pure) Nash equilibrium if no player gains by changing only their own strategy. A dynamic for a family U\mathcal UU of games is a vector field F(x;Γ)F(x;\Gamma)F(x;Γ) on XXX for each Γ∈U\Gamma\in\mathcal UΓ∈U, read x˙=F(x;Γ)\dot x=F(x;\Gamma)x˙=F(x;Γ). It is uncoupled if FiF^iFi depends on the game only through uiu^iui: two games of U\mathcal UU in which player iii has the same payoff function give the same Fi(x;⋅)F^i(x;\cdot)Fi(x;⋅) at every x∈Xx\in Xx∈X.

A dynamic is Nash-convergent for U\mathcal UU if, for every Γ∈U\Gamma\in\mathcal UΓ∈U with its Nash equilibrium xˉ(Γ)\bar x(\Gamma)xˉ(Γ):

  1. F(⋅ ;Γ)F(\cdot\,;\Gamma)F(⋅;Γ) is C1C^1C1 on XXX;
  2. F(xˉ(Γ);Γ)=0F(\bar x(\Gamma);\Gamma)=0F(xˉ(Γ);Γ)=0;
  3. all eigenvalues of the 4×44\times44×4 Jacobian matrix of F(⋅ ;Γ)F(\cdot\,;\Gamma)F(⋅;Γ) at xˉ(Γ)\bar x(\Gamma)xˉ(Γ) have negative real parts;
  4. every solution x(t)x(t)x(t) converges to xˉ(Γ)\bar x(\Gamma)xˉ(Γ) as t→∞t\to\inftyt→∞, from any initial condition.

The game Γ0\Gamma_0Γ0​ has payoffs u0i(xi,xj)=−∥xi−φ(xj)∥2u_0^i(x^i,x^j)=-\|x^i-\varphi(x^j)\|^2u0i​(xi,xj)=−∥xi−φ(xj)∥2. Here φ:D→D\varphi:D\to Dφ:D→D is continuous, φ(z)=2z\varphi(z)=2zφ(z)=2z for ∥z∥≤13\|z\|\le\frac13∥z∥≤31​, φ\varphiφ rotates the unit circle by π/4\pi/4π/4, and φ\varphiφ is affine on rays in between. The family U0\mathcal U_0U0​ consists of the games ui(xi,xj)=−∥xi−ξi(xj)∥2u^i(x^i,x^j)=-\|x^i-\xi^i(x^j)\|^2ui(xi,xj)=−∥xi−ξi(xj)∥2 with continuous ξi:D→D\xi^i:D\to Dξi:D→D such that ξi(ξj(xi))=xi\xi^i(\xi^j(x^i))=x^iξi(ξj(xi))=xi has a unique solution. Every such game has a unique Nash equilibrium, and Γ0∈U0\Gamma_0\in\mathcal U_0Γ0​∈U0​ has the equilibrium (0,0)(0,0)(0,0).

Formalization targets

Goal: THEOREM 1 for the game Γ0\Gamma_0Γ0​ of §II

Let U\mathcal UU be a family in which each game has a single Nash equilibrium and which contains every game of U0\mathcal U_0U0​ within some η>0\eta>0η>0 of Γ0\Gamma_0Γ0​. Then

F uncoupled for U ⟹ F is not Nash-convergent for U.F\ \text{uncoupled for}\ \mathcal U\ \Longrightarrow\ F\ \text{is not Nash-convergent for}\ \mathcal U.F uncoupled for U ⟹ F is not Nash-convergent for U.

Milestones

  • the explicit φ\varphiφ has the two required properties, and rotates by an angle in [0,π/4][0,\pi/4][0,π/4] (fn. 21);
  • every game of U0\mathcal U_0U0​ has a unique Nash equilibrium, and that of Γ0\Gamma_0Γ0​ is (0,0)(0,0)(0,0);
  • Lemma 2: for an uncoupled Nash-convergent dynamic on U0\mathcal U_0U0​, at a unique best reply Fi=0F^i=0Fi=0 and the own-strategy Jacobian block JiJ^iJi has eigenvalues with negative real parts;
  • the derivative identity, giving the Jacobian at Γ0\Gamma_0Γ0​ the block form
J=[J1−2J1−2J2J2];J=\begin{bmatrix}J^1&-2J^1\\-2J^2&J^2\end{bmatrix};J=[J1−2J2​−2J1J2​];
  • the coefficient a3=3det⁡(J1)tr⁡(J2)+3det⁡(J2)tr⁡(J1)a_3=3\det(J^1)\operatorname{tr}(J^2)+3\det(J^2)\operatorname{tr}(J^1)a3​=3det(J1)tr(J2)+3det(J2)tr(J1) of λ\lambdaλ in det⁡(J−λI)\det(J-\lambda I)det(J−λI), and Lemma 3: if J1,J2J^1,J^2J1,J2 are stable, then JJJ has an eigenvalue with positive real part;
  • the main-text result: no uncoupled dynamic is Nash-convergent for U0\mathcal U_0U0​;
  • the Appendix: the functions ψa\psi_aψa​ satisfy conditions (1)–(4), and the conclusions of Lemma 2 at Γ0\Gamma_0Γ0​ already follow from the games of U0\mathcal U_0U0​ near Γ0\Gamma_0Γ0​.

A companion statement, that the coupled dynamic x˙=xˉ(Γ)−x\dot x=\bar x(\Gamma)-xx˙=xˉ(Γ)−x is Nash-convergent, shows that the notion of Nash-convergence can be met.

Significance

The theorem identifies an informational obstruction rather than a computational one. Convergence to Nash equilibrium is easy if the dynamic may use the whole game, as the coupled dynamic x˙=xˉ(Γ)−x\dot x=\bar x(\Gamma)-xx˙=xˉ(Γ)−x shows. It fails once each player may react only to their own payoff function, and the failure persists on an arbitrarily small neighborhood of a single game. It explains why no natural adaptive procedure has been found that converges to Nash equilibrium in general, and it motivates the stochastic, finite-memory and correlated-equilibrium variants studied afterwards (for example Hart and Mas-Colell, GEB 2006).

The result is proved in the paper. As far as the curators know, it has no machine-checked proof. A formalization fixes the model precisely. That matters here, because the conclusion depends on details the prose treats lightly: which perturbations the family must contain, what the Jacobian is at boundary points, and which solutions count.

Difficulty

The obvious argument fails because an uncoupled dynamic is a different vector field for each game, and nothing forces the fields to fit together except the uncoupledness constraint. The proof extracts information about F(⋅ ;Γ0)F(\cdot\,;\Gamma_0)F(⋅;Γ0​) from auxiliary games that share one player's payoff with Γ0\Gamma_0Γ0​, and in which that player's best reply is constant. Making those auxiliary games lie in the family is the delicate part: in U0\mathcal U_0U0​ they are immediate, but near Γ0\Gamma_0Γ0​ they require the functions ψa\psi_aψa​ of the Appendix, whose fixed-point conditions (3) and (4) rest on an angle argument. The linear-algebra step is exact: the stability of J1J^1J1 and J2J^2J2 must be shown to force instability of the coupled 4×44\times44×4 matrix through the sign of one coefficient of its characteristic polynomial.

Formalization scope

R2\mathbb R^2R2 is modelled as C\mathbb CC, and rotation by θ\thetaθ is multiplication by eiθe^{i\theta}eiθ. Players are Fin 2, 0-based, and the other player is i + 1. A game is a pair of real functions on C2\mathbb C^2C2, but every definition looks only at its values on X=D×DX=D\times DX=D×D. Nash equilibria are pure equilibria in XXX (fn. 9 notes there are no mixed ones). Derivatives are Fréchet derivatives within XXX. Eigenvalue conditions use the published predicate FatkhullinPolyak.Discrete.IsHurwitz, with the 4×44\times44×4 Jacobian indexed in player-major order. The C1C^1C1 and Jacobian conditions, which the paper imposes on every dynamic it considers, are part of NashConvergent. The single-Nash-equilibrium property is a hypothesis of the goal.

Two encodings are deliberate:

  • The neighborhood. "U\mathcal UU contains a neighborhood of Γ0\Gamma_0Γ0​" is read as the Appendix reads it: U\mathcal UU contains every game of U0\mathcal U_0U0​ close to Γ0\Gamma_0Γ0​ in the sense of fn. 7. This is implied by the literal hypothesis, so the formal theorem is at least as strong. A full neighborhood contains games with several equilibria, so together with the single-equilibrium hypothesis it would make the theorem vacuous.
  • Solutions. Solutions are curves that stay in XXX. If curves were allowed to leave XXX, they would follow values of FFF that no game constrains, and Nash-convergence would fail for every FFF, which makes the goal trivial. The goal must also not be met through an empty family: the hypotheses are jointly satisfiable, for instance by {Γ∈U0:Γ within 1 of Γ0}\{\Gamma\in\mathcal U_0:\Gamma\text{ within }1\text{ of }\Gamma_0\}{Γ∈U0​:Γ within 1 of Γ0​}.

The development needs:

  • calculus of C1C^1C1 maps on a product of disks;
  • spectra of real matrices viewed over C\mathbb CC and the characteristic polynomial of a 4×44\times44×4 block matrix;
  • elementary planar geometry of rotations and radial interpolation.

The linear-algebra milestones (block Jacobian, a3a_3a3​, Lemma 3) are independent of game theory and reusable. Contributions are welcome on any milestone, in any order.

Selected references

  • S. Hart and A. Mas-Colell, Uncoupled Dynamics Do Not Lead to Nash Equilibrium, American Economic Review 93(5), 1830–1836, 2003. https://doi.org/10.1257/000282803322655581
  • S. Hart and A. Mas-Colell, A Simple Adaptive Procedure Leading to Correlated Equilibrium, Econometrica 68(5), 1127–1150, 2000. https://doi.org/10.1111/1468-0262.00153
  • J. S. Jordan, Three Problems in Learning Mixed-Strategy Nash Equilibria, Games and Economic Behavior 5(3), 368–386, 1993. https://doi.org/10.1006/game.1993.1022
  • D. P. Foster and H. P. Young, On the Nonconvergence of Fictitious Play in Coordination Games, Games and Economic Behavior 25(1), 79–96, 1998. https://doi.org/10.1006/game.1997.0615
  • S. Hart and A. Mas-Colell, Stochastic Uncoupled Dynamics and Nash Equilibrium, Games and Economic Behavior 57(2), 286–303, 2006. https://doi.org/10.1016/j.geb.2005.09.007
14 thms2 active usersReviewed
Machine LearningProbability·Captain: mikedeng1

A Simple Adaptive Procedure Leading to Correlated Equilibrium 2: Playing an Invariant Vector of the Regret Matrix (3.1) Drives Every Regret R_t(j,k) to Zero Almost SurelyResearch Paper

Motivation

A correlated equilibrium (Aumann, 1974) is a probability distribution over the strategy profiles of a game such that no player gains by deviating from the strategy it recommends. It is the natural solution concept for repeated play by adaptive agents, because the set of correlated equilibria is a polytope described by linear inequalities and, as Hart and Mas-Colell showed, it can be reached by simple learning rules that use only a player's own past payoffs and regrets.

Hart and Mas-Colell's paper (Econometrica 68 (2000) 1127–1150) has two procedures. Its Main Theorem concerns regret matching (2.2), in which a player switches away from its last strategy with probabilities proportional to its regrets; it is the subject of a companion mission. Section 3 studies a variant in which, at every period, the player plays an invariant vector of the regret matrix, and proves with Blackwell's approachability theorem (Blackwell, 1956) that the player's regrets vanish almost surely, whatever the other players do. This result, Theorem A, is the target of this mission. It is the conditional ("internal") counterpart of Hannan's no-regret property (Hannan, 1957) and the template for later internal-regret algorithms in online learning (Cesa-Bianchi and Lugosi, 2006).

Timeline. Hannan (1957) gave a procedure with vanishing unconditional regret; Blackwell (1956) proved the approachability theorem and derived a universally consistent procedure from it; Foster and Vohra (1997) obtained convergence to correlated equilibria through calibrated forecasts; Fudenberg and Levine (1995, 1999) introduced universal consistency and calibrated smooth fictitious play; Hart and Mas-Colell (2000) gave Theorem A and regret matching.

Setting

A finite game Γ=(N,(Si)i∈N,(ui)i∈N)\Gamma=(N,(S^i)_{i\in N},(u^i)_{i\in N})Γ=(N,(Si)i∈N​,(ui)i∈N​) has a finite set NNN of players, a finite nonempty strategy set SiS^iSi for each player, and payoffs ui:S→Ru^i:S\to\mathbb Rui:S→R on S=∏iSiS=\prod_i S^iS=∏i​Si. For s∈Ss\in Ss∈S and k∈Sik\in S^ik∈Si, ui(k,s−i)u^i(k,s^{-i})ui(k,s−i) is iii's payoff when iii's coordinate of sss is replaced by kkk.

The game is played at t=1,2,…t=1,2,\dotst=1,2,…. After the history ht=(s1,…,st)h_t=(s_1,\dots,s_t)ht​=(s1​,…,st​) each player chooses a mixed action, and given hth_tht​ the players randomize independently. For j≠kj\ne kj=k in SiS^iSi the regret of player iii for not having played kkk whenever it played jjj is

Dti(j,k)=1t∑τ≤t: sτi=j[ui(k,sτ−i)−ui(sτ)],Rti(j,k)=max⁡{Dti(j,k),0}.D^i_t(j,k)=\frac1t\sum_{\tau\le t:\,s^i_\tau=j}\big[u^i(k,s^{-i}_\tau)-u^i(s_\tau)\big],\qquad R^i_t(j,k)=\max\{D^i_t(j,k),0\}.Dti​(j,k)=t1​τ≤t:sτi​=j∑​[ui(k,sτ−i​)−ui(sτ​)],Rti​(j,k)=max{Dti​(j,k),0}.

With Rti(j,j):=0R^i_t(j,j):=0Rti​(j,j):=0, a probability vector qti∈Δ(Si)q^i_t\in\Delta(S^i)qti​∈Δ(Si) satisfies (3.1) if

∑k∈Siqti(k)Rti(k,j)=qti(j)∑k∈SiRti(j,k)for every j∈Si,\sum_{k\in S^i}q^i_t(k)R^i_t(k,j)=q^i_t(j)\sum_{k\in S^i}R^i_t(j,k)\qquad\text{for every }j\in S^i,k∈Si∑​qti​(k)Rti​(k,j)=qti​(j)k∈Si∑​Rti​(j,k)for every j∈Si,

i.e. qtiq^i_tqti​ is an invariant distribution of the transition matrix of regret matching. The empirical distribution of play is zt(s)=1t∣{τ≤t:sτ=s}∣z_t(s)=\frac1t|\{\tau\le t: s_\tau=s\}|zt​(s)=t1​∣{τ≤t:sτ​=s}∣.

Formalization targets

Goal: Theorem A (p. 1133)

If at every period t+1t+1t+1 player iii plays a probability vector satisfying (3.1), then, whatever the other players do,

Rti(j,k)→t→∞0almost surely, for all j≠k in Si.R^i_t(j,k)\xrightarrow[t\to\infty]{}0\quad\text{almost surely, for all }j\ne k\text{ in }S^i.Rti​(j,k)t→∞​0almost surely, for all j=k in Si.

Milestones (the proof of Theorem A, pp. 1135–1138)

  1. (3.5): the nonnegative matrix with entries λ(j,k)\lambda(j,k)λ(j,k) off the diagonal and 000 on it has an invariant vector qλ∈Δ(Si)q_\lambda\in\Delta(S^i)qλ​∈Δ(Si).
  2. (3.4a)–(3.4b): for the vector payoff v(si,s−i)∈RLv(s^i,s^{-i})\in\mathbb R^Lv(si,s−i)∈RL, L={(j,k):j≠k}L=\{(j,k):j\ne k\}L={(j,k):j=k}, the quantity λ⋅v(q,s−i)\lambda\cdot v(q,s^{-i})λ⋅v(q,s−i) equals ∑jα(j)ui(j,s−i)\sum_j\alpha(j)u^i(j,s^{-i})∑j​α(j)ui(j,s−i).
  3. Blackwell's condition for R−L\mathbb R^L_-R−L​: for λ≥0\lambda\ge0λ≥0 and qλq_\lambdaqλ​ solving (3.5), λ⋅v(qλ,s−i)=0\lambda\cdot v(q_\lambda,s^{-i})=0λ⋅v(qλ​,s−i)=0 for every s−is^{-i}s−i.
  4. Support function: wR−L(λ)=0w_{\mathbb R^L_-}(\lambda)=0wR−L​​(λ)=0 on R+L\mathbb R^L_+R+L​ and +∞+\infty+∞ elsewhere.
  5. Closest point: DtD_tDt​ has coordinates Dti(j,k)D^i_t(j,k)Dti​(j,k), the projection onto R−L\mathbb R^L_-R−L​ is [Dt]−[D_t]^-[Dt​]−, and λ(Dt)=[Dt]+\lambda(D_t)=[D_t]^+λ(Dt​)=[Dt​]+ is the regret vector.
  6. Blackwell's approachability theorem, "Moreover" part: the Blackwell procedure drives dist⁡(Dt,C)\operatorname{dist}(D_t,\mathcal C)dist(Dt​,C) to 000 almost surely against any opponent.

Companions

The Corollary (p. 1134): if every player follows (3.1), ztz_tzt​ converges almost surely to the set of correlated equilibria. The equivalence of (3.1) with invariance for the (2.2) matrix (p. 1133). Theorem B (p. 1139): the procedure proportional to unconditional regrets [Dti(k)]+[D^i_t(k)]^+[Dti​(k)]+ satisfies Hannan's universal consistency (4.1).

Significance

Theorem A shows that conditional regrets can be driven to zero by a stationary rule of fixed size mi×mim^i\times m^imi×mi, with no assumption on the other players beyond conditional independence. Combined with the Proposition of §3 it gives the Corollary: if all players follow such a rule, play converges to the set of correlated equilibria. The same argument with a different vector payoff yields Theorem B, a short proof of Hannan consistency. The approachability reduction used here is the standard route from vector-valued games to no-regret learning.

Theorem A and Blackwell's theorem are proved results. What this mission adds is a machine-checked development: a formal statement of Theorem A for arbitrary opponents, a formal statement of Blackwell's procedure in Hart and Mas-Colell's form (condition (3.2) via the support function, opponents that see the whole history), and the algebra connecting the two. Prove2Me already has Blackwell's original THEOREM 1 (strategies depending only on past payoff vectors, geometric separation condition); it is a different statement, and deriving this one from it, or proving it directly, is part of the work.

Difficulty

The algebra (milestones 1–5) is finite-dimensional and elementary, apart from the existence of an invariant vector, which needs a fixed-point or Perron–Frobenius type argument for a matrix that is not stochastic. The probabilistic core is milestone 6. The geometric picture of the paper (Figure 1) shows that the expected next average payoff moves closer to C\mathcal CC, but that controls only dist⁡(E[Dt+1∣ht],C)\operatorname{dist}(E[D_{t+1}\mid h_t],\mathcal C)dist(E[Dt+1​∣ht​],C), not the realized averages (footnote 15 of the paper); the opponent adapts to the whole history, so the increments are neither independent nor identically distributed, and the almost-sure statement has to be obtained on a measure known only through its conditional laws given each history.

Formalization scope

  • The game is finite with nonempty strategy sets; payoffs are real. Δ(Q)\Delta(Q)Δ(Q) is Mathlib's stdSimplex. RL\mathbb R^LRL is EuclideanSpace ℝ L with its inner product and Euclidean distance.
  • Time is 0-based in Lean (play τ is sτ+1s_{\tau+1}sτ+1​); every regret quantity is a function of a finite history Fin t → S, and every statement uses histories of length t+1≥1t+1\ge1t+1≥1.
  • A behaviour profile assigns a probability vector to every player, period and history. A play is any sequence of random variables on any probability space such that, given each history of positive probability, the next profile has the product law of the players' mixed actions. Theorem A constrains only player iii, and only from period 2 on; the other players are arbitrary.
  • The zero diagonal of (3.1) is explicit. The support function's value +∞+\infty+∞ is never computed in the reals: (3.2) is encoded as "λ⋅v(qλ,b)≤M\lambda\cdot v(q_\lambda,b)\le Mλ⋅v(qλ​,b)≤M for every real upper bound MMM of λ⋅C\lambda\cdot\mathcal Cλ⋅C", and milestone 4 uses IsLUB/¬ BddAbove.
  • In Blackwell's theorem, nonemptiness of C\mathcal CC is stated explicitly (it is implicit in the existence of the closest point), and the choices λ↦qλ\lambda\mapsto q_\lambdaλ↦qλ​ and the projection FFF are given as functions with the stated properties.
  • Requiring qtiq^i_tqti​ to be a probability vector rules out the trivial solution q=0q=0q=0 of (3.1); the goal mentions neither vvv, R−L\mathbb R^L_-R−L​ nor Blackwell, so it cannot be discharged by its own milestones' definitions.

Useful infrastructure, reusable beyond this mission: the existence of invariant vectors of nonnegative matrices, projections onto orthants, and a general Blackwell approachability theorem for history-dependent opponents. Proofs of any milestone, of the companions, and alternative proofs of Theorem A are welcome.

Selected references

  • S. Hart and A. Mas-Colell, A simple adaptive procedure leading to correlated equilibrium, Econometrica 68(5) (2000), 1127–1150. https://doi.org/10.1111/1468-0262.00153
  • D. Blackwell, An analog of the minimax theorem for vector payoffs, Pacific Journal of Mathematics 6 (1956), 1–8. https://doi.org/10.2140/pjm.1956.6.1
  • R. J. Aumann, Subjectivity and correlation in randomized strategies, Journal of Mathematical Economics 1 (1974), 67–96. https://doi.org/10.1016/0304-4068(74)90037-8
  • J. Hannan, Approximation to Bayes risk in repeated play, Contributions to the Theory of Games III (1957), 97–139. https://doi.org/10.1515/9781400882151-006
  • D. P. Foster and R. V. Vohra, Calibrated learning and correlated equilibrium, Games and Economic Behavior 21 (1997), 40–55. https://doi.org/10.1006/game.1997.0595
  • N. Cesa-Bianchi and G. Lugosi, Prediction, Learning, and Games, Cambridge University Press, 2006. https://doi.org/10.1017/CBO9780511546921
9 thms2 active usersReviewed
AnalysisOperations ResearchOptimization·Captain: mikedeng1

Cooperative Fuzzy Games 3: The Diagonal Formula Is the Unique Continuous Linear Pareto-Optimal, Symmetric and Atomic Value of Smooth Fuzzy GamesResearch Paper

Motivation

A value for cooperative games assigns to every game a payoff vector, chosen by axioms rather than by bargaining. Shapley's value (1953) does this for finite games with side payments, and Aumann and Shapley (Values of Non-Atomic Games, 1974) extended it to games with a continuum of players, where it is given by a diagonal formula: a player's value is the average of their marginal worth along the diagonal from the empty coalition to the grand coalition. Aubin's Cooperative Fuzzy Games (Math. Oper. Res. 6(1), 1981, doi:10.1287/moor.6.1.1) brings this formula to finitely many players who may participate in coalitions at fractional rates, and characterises it by axioms in §8.

The result matters in cost allocation: the Aumann–Shapley price mechanism (Billera, Heath and Raanan 1978; Mirman and Tauman 1982) shares the cost of a bundle of products by exactly this diagonal formula, applied to a smooth cost function of the quantities produced. Theorem 8.1 is the finite-player, fuzzy-coalition version of the axiomatic justification behind that mechanism.

Setting

There are nnn players N={1,…,n}N=\{1,\dots,n\}N={1,…,n}. A fuzzy coalition is a vector τ∈[0,1]n\tau\in[0,1]^nτ∈[0,1]n, where τi\tau_iτi​ is the rate at which player iii participates; an ordinary coalition AAA is its indicator vector τA\tau^AτA, and τN=(1,…,1)\tau^N=(1,\dots,1)τN=(1,…,1) is the grand coalition.

A smooth fuzzy game is a coalitional worth function v:[0,1]n→Rv:[0,1]^n\to\mathbb Rv:[0,1]n→R that is continuously differentiable and satisfies v(0)=0v(0)=0v(0)=0. These form the space VnV^nVn, a Banach space under the C1C^1C1 norm sup⁡[0,1]n∣v∣+sup⁡[0,1]n∥Dv∥\sup_{[0,1]^n}|v|+\sup_{[0,1]^n}\|Dv\|sup[0,1]n​∣v∣+sup[0,1]n​∥Dv∥.

A sequence of fuzzy values is a family of continuous linear operators ψn:Vn→Rn\psi_n:V^n\to\mathbb R^nψn​:Vn→Rn satisfying three axioms.

  • Pareto optimality: ∑i∈N(ψnv)i=v(τN)\sum_{i\in N}(\psi_n v)_i=v(\tau^N)∑i∈N​(ψn​v)i​=v(τN).
  • Symmetry: for a permutation θ\thetaθ of NNN, with (θ∗v)(τ)=v(τθ−1(1),…,τθ−1(n))(\theta^*v)(\tau)=v(\tau_{\theta^{-1}(1)},\dots,\tau_{\theta^{-1}(n)})(θ∗v)(τ)=v(τθ−1(1)​,…,τθ−1(n)​) and (θ∗c)i=cθ(i)(\theta^*c)_i=c_{\theta(i)}(θ∗c)i​=cθ(i)​, one has ψn(θ∗v)=θ∗(ψnv)\psi_n(\theta^*v)=\theta^*(\psi_n v)ψn​(θ∗v)=θ∗(ψn​v).
  • Atomicity: a partition P={A1,…,Am}P=\{A_1,\dots,A_m\}P={A1​,…,Am​} of NNN into nonempty types sends a fuzzy coalition σ∈[0,1]m\sigma\in[0,1]^mσ∈[0,1]m of types to the fuzzy coalition (P⋅σ)i=σj(P\cdot\sigma)_i=\sigma_j(P⋅σ)i​=σj​ for i∈Aji\in A_ji∈Aj​, and an nnn-player game vvv to the mmm-type game (P∗v)(σ)=v(P⋅σ)(P^*v)(\sigma)=v(P\cdot\sigma)(P∗v)(σ)=v(P⋅σ). The axiom requires ψm(P∗v)j=∑i∈Aj(ψnv)i\psi_m(P^*v)_j=\sum_{i\in A_j}(\psi_nv)_iψm​(P∗v)j​=∑i∈Aj​​(ψn​v)i​: a type receives what its members receive.

The core of a game vvv with side payments is the set of c∈Rnc\in\mathbb R^nc∈Rn with ∑ici=v(τN)\sum_ic_i=v(\tau^N)∑i​ci​=v(τN) and ∑iτici≥v(τ)\sum_i\tau_ic_i\ge v(\tau)∑i​τi​ci​≥v(τ) for every τ∈[0,1]n\tau\in[0,1]^nτ∈[0,1]n (§2 (4)).

Formalization targets

Goal: Theorem 8.1

There exists a unique sequence of fuzzy values, given by the diagonal formula

ψnv=∫01Dv(tτN) dt(v∈Vn).(4)\psi_n v=\int_0^1 Dv(t\tau^N)\,dt\qquad(v\in V^n).\tag{4}ψn​v=∫01​Dv(tτN)dt(v∈Vn).(4)

For every linear A:Rm→RnA:\mathbb R^m\to\mathbb R^nA:Rm→Rn with AτM=τNA\tau^M=\tau^NAτM=τN,

ψm(v∘A)=A∗ψnv(v∈Vn),(5)\psi_m(v\circ A)=A^*\psi_n v\qquad(v\in V^n),\tag{5}ψm​(v∘A)=A∗ψn​v(v∈Vn),(5)

where A∗A^*A∗ is the transpose of AAA. If v∈Vnv\in V^nv∈Vn is concave and positively homogeneous, then ψnv\psi_nvψn​v is the unique element of the core.

Milestones

These are the steps of the proof in the paper (pp. 10–11), in attack order:

  1. the maps (4) are linear, continuous and satisfy (5);
  2. they satisfy the Pareto optimality, symmetry and atomicity axioms;
  3. the monomials τ1k1⋯τnkn\tau_1^{k_1}\cdots\tau_n^{k_n}τ1k1​​⋯τnkn​​ (k≠0k\ne0k=0) span a dense subspace of VnV^nVn;
  4. Pareto optimality and symmetry force ψn(τ1⋯τn)=1nτN\psi_n(\tau_1\cdots\tau_n)=\frac1n\tau^Nψn​(τ1​⋯τn​)=n1​τN;
  5. the three axioms force (ψnτk)i=ki/(k1+⋯+kn)(\psi_n\tau^k)_i=k_i/(k_1+\dots+k_n)(ψn​τk)i​=ki​/(k1​+⋯+kn​), which is also the value of (4);
  6. for positively homogeneous vvv, Dv(tτN)=Dv(τN)Dv(t\tau^N)=Dv(\tau^N)Dv(tτN)=Dv(τN), so ψnv=Dv(τN)\psi_nv=Dv(\tau^N)ψn​v=Dv(τN);
  7. (Remark 8.2) ψn\psi_nψn​ applied to Owen's multilinear extension of a game with side payments is its Shapley value.

Significance

The result. Theorem 8.1 singles out the diagonal formula among all ways of valuing smooth fuzzy games, using only efficiency, anonymity and invariance under merging players into types. Property (5) shows that the value transforms correctly under every linear change of coordinates fixing the grand coalition. The core statement links the value to stability: for concave homogeneous games (for instance, market games), the value is the only allocation no fuzzy coalition can improve upon. Through Owen's extension, the classical Shapley value is recovered as a special case.

Formalizing it. The theorem is proved in the paper, briefly, and its proof leans on an unproved density claim and on a short appeal to atomicity. A formalization makes the uniqueness argument complete: in particular, how atomicity, which only allows nonempty types, determines the value of a monomial in which some player has exponent 000. No machine-checked version of the Aumann–Shapley diagonal formula or its axiomatisation is known to us. Mathlib has the Stone–Weierstrass theorem for continuous functions but no C1C^1C1 density of polynomials on a cube; the latter is reusable well beyond game theory.

Difficulty

Existence (milestones 1–2) is calculus: differentiation under the integral sign and the chain rule. The difficulty sits in uniqueness. The first idea, computing ψn\psi_nψn​ on monomials by symmetry alone, fails as soon as the exponents differ: symmetry relates only games that are permutations of each other. Atomicity relates games with different numbers of players, and its types must be nonempty, so a player with exponent 000 cannot simply be merged away. Uniqueness on all of VnV^nVn then needs density of polynomials in the C1C^1C1 norm, not merely the uniform norm: without continuity in the C1C^1C1 norm, linear maps that agree on polynomials can disagree elsewhere, and the theorem is false.

Formalization scope

  • Players are Fin n, fuzzy coalitions and payoff vectors are Fin n → ℝ, and the cube is Set.Icc 0 1 in the product order.
  • VnV^nVn is a submodule of functions on all of Rn\mathbb R^nRn that are C1C^1C1 there and vanish at 000. Every C1C^1C1 function on the cube extends to such a function, and only values and derivatives on the cube enter the norm and the axioms. The global domain makes v∘Av\circ Av∘A meaningful for every linear AAA.
  • "Continuous" means ∥ψnv∥≤C ∥v∥C1\|\psi_nv\|\le C\,\|v\|_{C^1}∥ψn​v∥≤C∥v∥C1​ with the C1C^1C1 seminorm of the cube (sup norm on Rn\mathbb R^nRn, operator norm on DvDvDv). This is the continuity of the Banach space VnV^nVn. Continuity for the uniform norm alone would make formula (4) discontinuous, and dropping continuity would make uniqueness false.
  • The axioms are stated for all n≥1n\ge1n≥1; the paper's "∀n∈N\forall n\in N∀n∈N" in the symmetry axiom is read as n≥1n\ge1n≥1. In the atomicity axiom (3), the paper's "∀v∈Vm\forall v\in V^m∀v∈Vm" is read as v∈Vnv\in V^nv∈Vn, because P∗vP^*vP∗v is defined by (2) for an nnn-player game. A partition into nonempty types is a surjection Fin n → Fin m. The symbols τθ−1(i)\tau_{\theta-1(i)}τθ−1(i)​ are τθ−1(i)\tau_{\theta^{-1}(i)}τθ−1(i)​.
  • The games θ∗v\theta^*vθ∗v, P∗vP^*vP∗v and v∘Av\circ Av∘A are passed as elements of VnV^nVn, VmV^mVm together with their defining identities; they always lie in those spaces.
  • In the core statement, concavity and positive homogeneity (v(tτ)=tv(τ)v(t\tau)=tv(\tau)v(tτ)=tv(τ) for t>0t>0t>0, τ≥0\tau\ge0τ≥0) are required on the orthant R+n\mathbb R^n_+R+n​, to which §2 (2) extends vvv; the core quantifies over the cube, as in §2 (4)(a). The paper's "VNV^NVN" there is VnV^nVn.
  • Remark 8.2 is stated for games defined on all coalitions with v(∅)=0v(\emptyset)=0v(∅)=0, since formula (7) uses v(A∖{i})v(A\setminus\{i\})v(A∖{i}) for every AAA. The Shapley value is the published platform definition Supermodularity.Cooperative.ShapleyValue, whose formula is (7) re-indexed by S=A∖{i}S=A\setminus\{i\}S=A∖{i}. The Cornet extension of the same remark is left out because it is not C1C^1C1 on the boundary of the cube.
  • A trivializing reading is ruled out: the goal asserts both existence of a sequence satisfying all axioms with C1C^1C1 continuity and uniqueness among all such sequences, so neither an empty axiom system nor a vacuous continuity requirement makes it hold.

Infrastructure that a complete development needs, and that is welcome as separate contributions: C1C^1C1 approximation of functions on a cube by polynomials; differentiation under the integral sign for the diagonal integral; Euler's identity and the supergradient inequality for concave homogeneous C1C^1C1 functions.

Selected references

  • J.-P. Aubin, Cooperative Fuzzy Games, Mathematics of Operations Research 6(1) (1981) 1–13. https://doi.org/10.1287/moor.6.1.1
  • R. J. Aumann and L. S. Shapley, Values of Non-Atomic Games, Princeton University Press, 1974. https://doi.org/10.1515/9781400867080
  • L. S. Shapley, A Value for n-Person Games, in Contributions to the Theory of Games II, Annals of Mathematics Studies 28 (1953) 307–317. https://doi.org/10.1515/9781400881970-018
  • G. Owen, Multilinear Extensions of Games, Management Science 18(5) (1972) P64–P79. https://doi.org/10.1287/mnsc.18.5.64
  • L. J. Billera, D. C. Heath and J. Raanan, Internal Telephone Billing Rates — A Novel Application of Non-Atomic Game Theory, Operations Research 26(6) (1978) 956–965. https://doi.org/10.1287/opre.26.6.956
  • L. J. Mirman and Y. Tauman, Demand Compatible Equitable Cost Sharing Prices, Mathematics of Operations Research 7(1) (1982) 40–56. https://doi.org/10.1287/moor.7.1.40
12 thms2 active usersReviewed
PreviousPage 2 of 10Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me