Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Algorithmic Game Theory

425 missions · 177 completed

Missions

Open248Completed177All425
🏆Completed
Functional AnalysisProbability·Captain: mikedeng1

Existence of Correlated Equilibria III: A Game with Compact Hausdorff Strategy Spaces and Continuous Payoffs Has a Countably Additive Correlated EquilibriumResearch Paper

Motivation

A correlated equilibrium (Aumann 1974) describes play in a game where a mediator draws a profile of recommended actions from a joint distribution and tells each player only that player's own recommendation; the distribution is an equilibrium when no player gains, on average, by departing from the recommendation. Correlated equilibria are the natural outcome of regret-minimizing learning dynamics and the solution concept underlying much of algorithmic game theory, so it matters in which games they are guaranteed to exist.

For finite games existence follows from Nash's theorem, since every Nash equilibrium is a correlated one. Hart and Schmeidler (1989) gave a direct proof based on linear duality, with no fixed-point theorem, and then extended it beyond finite games. This mission formalizes the last and most general of their three existence theorems: games with arbitrarily many players whose strategy spaces are compact Hausdorff spaces.

Timeline.

  • 1952: Fan and Glicksberg prove fixed-point theorems that yield Nash equilibria, hence correlated equilibria, for continuous games on compact strategy spaces.
  • 1969: Peleg proves existence of Nash equilibria for games with infinitely many players, finite strategy sets and continuous payoffs.
  • 1974: Aumann introduces correlated equilibria (J. Math. Econ. 1).
  • 1987: Aumann characterizes correlated equilibrium as Bayesian rationality (Econometrica 55).
  • 1989: Hart and Schmeidler prove existence of correlated equilibria by a separation argument: Theorem 1 for finite games, Theorem 2 for infinitely many players with finite strategy sets, Theorem 3 for compact Hausdorff strategy spaces (Math. Oper. Res. 14).

Setting

A game consists of a nonempty set NNN of players, possibly uncountable; for each player i∈Ni\in Ni∈N a nonempty set SiS^iSi of pure strategies; and for each player a payoff function hi:S→Rh^i:S\to\mathbb Rhi:S→R on the set of strategy profiles S=∏j∈NSjS=\prod_{j\in N}S^jS=∏j∈N​Sj. For a profile sss and a strategy ti∈Sit^i\in S^iti∈Si, (s−i,ti)(s^{-i},t^i)(s−i,ti) denotes the profile obtained from sss by replacing player iii's coordinate with tit^iti; thus hi(s)=hi(s−i,si)h^i(s)=h^i(s^{-i},s^i)hi(s)=hi(s−i,si).

In this mission each SiS^iSi is a compact Hausdorff space with its Borel σ-algebra Σi\Sigma^iΣi, the profile space SSS carries the product topology, and Σ\SigmaΣ is the Borel σ-algebra of SSS. The product σ-algebra Σ0\Sigma_0Σ0​ generated by the Σi\Sigma^iΣi is contained in Σ\SigmaΣ, and the inclusion may be strict when SSS is not metrizable (the paper's footnote 13).

Let ppp be a probability measure on (S,Σ)(S,\Sigma)(S,Σ). Think of ppp as the mediator's distribution; player iii learns the coordinate sis^isi of the drawn profile. A deviation of player iii is a Σi\Sigma^iΣi-measurable map ζi:Si→Si\zeta^i:S^i\to S^iζi:Si→Si that replaces each recommendation by an action. The measure ppp is a correlated equilibrium with respect to {Σi}i∈N\{\Sigma^i\}_{i\in N}{Σi}i∈N​ and Σ\SigmaΣ when, for every player iii and every deviation ζi\zeta^iζi,

∫S[hi(s−i,si)−hi(s−i,ζi(si))] dp(s) ≥ 0.(4)\int_S\bigl[h^i(s^{-i},s^i)-h^i\bigl(s^{-i},\zeta^i(s^i)\bigr)\bigr]\,dp(s)\ \ge\ 0 . \tag{4}∫S​[hi(s−i,si)−hi(s−i,ζi(si))]dp(s) ≥ 0.(4)

The left side is the expected gain from obeying the recommendation instead of following ζi\zeta^iζi.

Formalization targets

Goal: Theorem 3

If every SiS^iSi is compact Hausdorff and every hih^ihi is continuous on SSS with the product topology, then

∃ p probability measure on (S,Σ) such that (4) holds for all i∈N and all Σi-measurable ζi.\exists\, p\ \text{probability measure on } (S,\Sigma)\ \text{such that (4) holds for all } i\in N \text{ and all } \Sigma^i\text{-measurable } \zeta^i .∃p probability measure on (S,Σ) such that (4) holds for all i∈N and all Σi-measurable ζi.

"Countably additive" in the paper's statement is automatic: ppp is a measure.

Milestones, in the order of the proof

  1. Every f-set game has a correlated equilibrium. An f-set is a product T=∏iTiT=\prod_iT^iT=∏i​Ti of finite nonempty sets Ti⊆SiT^i\subseteq S^iTi⊆Si with TiT^iTi a singleton for all but finitely many iii; the game ΓT\Gamma_TΓT​ restricts each player to TiT^iTi, and its correlated equilibrium qTq_TqT​ is a finitely supported probability on SSS.
  2. On a compact Hausdorff space, every net of probability measures has a regular probability measure as a cluster point for the topology induced by the continuous functions.
  3. For a regular probability ppp on SSS and a Borel set Ri⊆SiR^i\subseteq S^iRi⊆Si, there are a closed Fi⊆RiF^i\subseteq R^iFi⊆Ri and an open Gi⊇RiG^i\supseteq R^iGi⊇Ri with p((Gi∖Fi)×S−i)<εp\bigl((G^i\setminus F^i)\times S^{-i}\bigr)<\varepsilonp((Gi∖Fi)×S−i)<ε: the marginal of a regular measure is regular.
  4. The special case. A regular cluster point ppp of the qTq_TqT​ satisfies (4) for every deviation that equals a fixed tit^iti on a Borel set RiR^iRi and the identity elsewhere.
  5. For continuous hih^ihi and ε>0\varepsilon>0ε>0, SiS^iSi has a finite Borel partition A1,…,AKA_1,\dots,A_KA1​,…,AK​ with ∣hi(s−i,a)−hi(s−i,b)∣<ε|h^i(s^{-i},a)-h^i(s^{-i},b)|<\varepsilon∣hi(s−i,a)−hi(s−i,b)∣<ε for a,ba,ba,b in the same piece and every s−is^{-i}s−i.
  6. The general case. If (4) holds for all deviations of the special form, it holds for every Borel deviation.

An optional milestone records the remark on p. 23 that, for a finite strategy set SiS^iSi, condition (4) for player iii is equivalent to the earlier condition (3), one inequality per recommendation rir^iri and alternative tit^iti.

Significance

The result. Theorem 3 guarantees correlated equilibria, with a genuine (countably additive) probability measure, in every continuous game on compact strategy spaces, however many players there are. It also justifies taking Σ\SigmaΣ to be the full Borel σ-algebra rather than the smaller product σ-algebra, so that every Borel-measurable deviation rule is allowed. Nash existence under the same hypotheses (Fan 1952, Glicksberg 1952) implies existence of correlated equilibria too, but through a fixed-point theorem; the proof here uses only finite-dimensional duality and compactness.

Formalizing it. The theorem is classical and its proof is published; nothing here is open. To our knowledge no machine-checked proof of Theorem 3, or of any existence result for correlated equilibria in infinite games, exists. Finite-game existence results are on the platform (AGT.nash_existence; the correlated-equilibrium encodings of Aumann 1987 and Foster and Vohra 1997, and AGT.swap_regret_correlated_equilibrium). The formalization would add reusable measure-theoretic tools on compact products: the regular cluster point of a net of probability measures, the regularity of marginals, and uniform partitions for continuous functions on a product.

Difficulty

The obvious argument is the one that proves Theorem 2: approximate the game by finite games ΓT\Gamma_TΓT​, take correlated equilibria qTq_TqT​, extract a weak-* cluster point ppp, and pass the inequalities of ΓT\Gamma_TΓT​ to the limit. Passing to the limit works only for integrands that are continuous in sss, because ppp is a cluster point against continuous functions only. The integrand of (4) is hi(s)−hi(s−i,ζi(si))h^i(s)-h^i(s^{-i},\zeta^i(s^i))hi(s)−hi(s−i,ζi(si)), and ζi\zeta^iζi is merely Borel measurable, so this integrand need not be continuous and the limit step fails. Restricting to continuous deviations would avoid the difficulty but would prove a weaker theorem. Two further points need care: on a non-metrizable product the Borel σ-algebra is larger than the product σ-algebra, and the f-sets ordered by inclusion are not a directed set.

Formalization scope

The profile space is a type synonym Profile S of ∀ i, S i carrying the product topology and the instance borel (Profile S), so measures on SSS live on the Borel σ-algebra Σ\SigmaΣ and not on Mathlib's product σ-algebra MeasurableSpace.pi (=Σ0=\Sigma_0=Σ0​). The pair (s−i,ti)(s^{-i},t^i)(s−i,ti) is Function.update s i t. Players form a type ι with Nonempty ι; each S i is nonempty, compact and Hausdorff with BorelSpace (S i); payoffs are h : ι → Profile S → ℝ with each h i continuous. Deviations are all maps ζ : S i → S i with Measurable ζ.

The predicate IsCorrelatedEq h μ requires IsProbabilityMeasure μ and, for each player and measurable deviation, both integrability of the integrand and nonnegativity of its integral. The integrability clause prevents a trivializing reading in which a non-integrable integrand, whose Lean integral is 000, satisfies (4) vacuously; restricting deviations to continuous maps, or using the product σ-algebra, would also change the theorem and is ruled out.

The f-set net is indexed by the f-sets containing a fixed profile s^\hat ss^, which are directed; the paper's "ordered by inclusion of the sets TTT" over all f-sets is not directed, and anchoring repairs this without affecting any statement of the paper. A correlated equilibrium qTq_TqT​ of ΓT\Gamma_TΓT​ is encoded by its finite support and weights (IsFSetCE). The special case is stated for a regular cluster point of the qTq_TqT​ given by these constructed objects, not for an arbitrary measure.

A complete development needs Banach–Alaoglu or the compactness of probability measures on a compact space, the Riesz–Markov–Kakutani representation (RealRMK), regularity of measures (Measure.Regular), Urysohn's lemma, and uniform continuity on compact spaces, all available in Mathlib in some form. Proofs of any milestone, including the general-purpose milestones 2, 3 and 5, are welcome.

Selected references

  • S. Hart and D. Schmeidler, Existence of Correlated Equilibria, Mathematics of Operations Research 14(1), 18–25, 1989. https://doi.org/10.1287/moor.14.1.18
  • R. J. Aumann, Subjectivity and Correlation in Randomized Strategies, Journal of Mathematical Economics 1, 67–96, 1974. https://doi.org/10.1016/0304-4068(74)90037-8
  • R. J. Aumann, Correlated Equilibrium as an Expression of Bayesian Rationality, Econometrica 55(1), 1–18, 1987. https://doi.org/10.2307/1911154
  • B. Peleg, Equilibrium Points for Games with Infinitely Many Players, Journal of the London Mathematical Society s1-44, 292–294, 1969. https://doi.org/10.1112/jlms/s1-44.1.292
  • I. L. Glicksberg, A Further Generalization of the Kakutani Fixed Point Theorem, with Application to Nash Equilibrium Points, Proceedings of the AMS 3, 170–174, 1952. https://doi.org/10.1090/S0002-9939-1952-0046638-5
  • K. Fan, Fixed-Point and Minimax Theorems in Locally Convex Topological Linear Spaces, PNAS 38, 121–126, 1952. https://doi.org/10.1073/pnas.38.2.121
  • N. Dunford and J. T. Schwartz, Linear Operators, Part I, Interscience, 1958.
9 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

The Bargaining Problem: The Nash Product Maximizer Is the Unique Solution Satisfying Invariance, Symmetry, IIA and Pareto EfficiencyResearch Paper

Motivation

Two parties who can cooperate for mutual benefit must still agree on how to share the benefit. In The Bargaining Problem (Econometrica, 1950) John Nash asked which agreement two rational bargainers of equal skill should reach. His answer is not a model of haggling: it is a list of conditions any reasonable rule should satisfy, together with a proof that exactly one point of the set of feasible agreements is compatible with them. That point maximizes the product of the two parties' utility gains. Known as the Nash bargaining solution, it is the reference point of cooperative bargaining theory. Economics, operations research and networking all use it: in supply contracts, in wage bargaining, and in fair bandwidth allocation, where maximizing a product of gains becomes maximizing a sum of logarithms (proportional fairness).

Timeline:

  • 1944. von Neumann and Morgenstern axiomatize expected utility. A utility is determined up to a positive affine transformation au+bau+bau+b. Nash quotes this on p. 157.
  • 1950. Nash introduces the two-person bargaining problem and the axioms of Pareto efficiency, independence of irrelevant alternatives and symmetry, the solution being invariant under the choice of utility scales. He proves that they force the maximizer of the product u1u2u_1u_2u1​u2​ (doi:10.2307/1907266).
  • 1953. Nash's Two-Person Cooperative Games adds the threat game that fixes the disagreement point.
  • 1975. Kalai and Smorodinsky replace independence of irrelevant alternatives by monotonicity and obtain a different solution.
  • 1986. Binmore, Rubinstein and Wolinsky show that the Nash solution is the limit of equilibria of alternating-offers bargaining as the time between offers vanishes.

Setting

A bargaining problem is a pair ⟨S,d⟩\langle S,d\rangle⟨S,d⟩. Here S⊆R2S\subseteq\mathbb R^2S⊆R2 is the set of utility pairs u=(u1,u2)u=(u_1,u_2)u=(u1​,u2​) the two players can reach by agreement, including lotteries over agreements. d∈Sd\in Sd∈S is the disagreement point, the utilities of no cooperation. As in the platform goal, SSS is compact and convex, and some s∈Ss\in Ss∈S has s1>d1s_1>d_1s1​>d1​ and s2>d2s_2>d_2s2​>d2​ (both individuals could gain). Write B\mathcal BB for the set of such pairs.

A bargaining solution is a map ggg from B\mathcal BB to R2\mathbb R^2R2. Nash requires:

  • Selection. g(S,d)∈Sg(S,d)\in Sg(S,d)∈S.
  • PAR (Nash's assumption 6). If s,t∈Ss,t\in Ss,t∈S and ttt is strictly better than sss for both players, then g(S,d)≠sg(S,d)\neq sg(S,d)=s.
  • IIA (assumption 7). If S⊆TS\subseteq TS⊆T and g(T,d)∈Sg(T,d)\in Sg(T,d)∈S, then g(S,d)=g(T,d)g(S,d)=g(T,d)g(S,d)=g(T,d).
  • SYM (assumption 8). If d1=d2d_1=d_2d1​=d2​ and SSS is symmetric in the line u1=u2u_1=u_2u1​=u2​, then g(S,d)g(S,d)g(S,d) lies on that line.
  • INV. For L(s)=(α1s1+β1, α2s2+β2)L(s)=(\alpha_1s_1+\beta_1,\ \alpha_2s_2+\beta_2)L(s)=(α1​s1​+β1​, α2​s2​+β2​) with α1,α2>0\alpha_1,\alpha_2>0α1​,α2​>0, g(L(S),L(d))=L(g(S,d))g(L(S),L(d))=L(g(S,d))g(L(S),L(d))=L(g(S,d)).

The paper has no separate INV axiom. It normalizes the disagreement utility to 000 and notes that each utility is then determined only up to a positive multiple (p. 158), so the solution must not depend on that choice.

Formalization targets

Goal

The goal is the platform theorem NashBargaining.nash_bargaining_solution_unique, posed by Nickrobbins95 and currently Open. This mission references it and does not restate it. It asserts that there is a solution fff such that a solution ggg satisfies selection, INV, SYM, IIA and PAR if and only if g=fg=fg=f, and that for every ⟨S,d⟩∈B\langle S,d\rangle\in\mathcal B⟨S,d⟩∈B

f(S,d)≥d,(s1−d1)(s2−d2)<(f1−d1)(f2−d2)  for all s∈S, s≥d, s≠f(S,d).f(S,d)\ge d,\qquad (s_1-d_1)(s_2-d_2)<(f_1-d_1)(f_2-d_2)\ \text{ for all } s\in S,\ s\ge d,\ s\neq f(S,d).f(S,d)≥d,(s1​−d1​)(s2​−d2​)<(f1​−d1​)(f2​−d2​)  for all s∈S, s≥d, s=f(S,d).

Nash's paper proves the necessity half: a solution satisfying the conditions must select the maximizer of the Nash product. The sufficiency half, that the maximizer map satisfies the five conditions, is not argued in the paper. It must be supplied by whoever closes the goal.

Milestones

  1. On a compact convex S∋(0,0)S\ni(0,0)S∋(0,0) that contains a point where both players gain, u1u2u_1u_2u1​u2​ has exactly one strict maximizer ppp in the closed first quadrant, and p1,p2>0p_1,p_2>0p1​,p2​>0.
  2. Multiplying the utilities by positive constants maps the maximizer to the maximizer, so ppp may be moved to (1,1)(1,1)(1,1).
  3. If SSS is convex and (1,1)(1,1)(1,1) maximizes u1u2u_1u_2u1​u2​, then u1+u2≤2u_1+u_2\le2u1​+u2​≤2 on all of SSS.
  4. A compact SSS under that line lies in a square Qh={2−2h≤u1+u2≤2, ∣u1−u2∣≤h}Q_h=\{2-2h\le u_1+u_2\le2,\ |u_1-u_2|\le h\}Qh​={2−2h≤u1​+u2​≤2, ∣u1​−u2​∣≤h}.
  5. (1,1)(1,1)(1,1) is the only point of QhQ_hQh​ on the diagonal that no point of QhQ_hQh​ strictly dominates.
  6. Necessity. Under the five conditions, g(S,d)g(S,d)g(S,d) is the strict maximizer of (s1−d1)(s2−d2)(s_1-d_1)(s_2-d_2)(s1​−d1​)(s2​−d2​) over S∩{s≥d}S\cap\{s\ge d\}S∩{s≥d}.

Two further items formalize the paper's examples: the Bill–Jack barter, whose solution is the vertex (12,5)(12,5)(12,5) reached by exactly one exchange, and trade with money, where the solution gives equal money profits.

Significance

The Nash product characterization is used, mostly without proof, wherever a "fair" split of a cooperative surplus is needed. Examples are generalized Nash bargaining in supply-chain contracting and labour economics, the proportional-fairness criterion in network rate control, and the Nash-in-Nash models of bilateral negotiations. Many papers that build on it apply it to a specific feasible set. They therefore rely on the necessity direction, which is the step that makes the maximizer the unique answer rather than one answer among several.

The result has been proved since 1950, while the referenced Prove2Me goal remains Open. This mission supplies the milestones of Nash's own argument in the encoding of that goal, so that the necessity direction can be assembled from them. Sufficiency remains as separate work. The two examples are small, concrete checks of the solution concept.

Difficulty

Each step is elementary. The difficulty is in keeping the bookkeeping honest across the normalizations. The axioms are stated on the class B\mathcal BB, and a solution is a function on a subtype. Every application of INV, SYM or IIA therefore needs a membership proof for a transformed set: the image of SSS under an affine map, or the enclosing square. It also needs the disagreement point to be carried along. The tempting short cut is to argue "without loss of generality d=0d=0d=0 and p=(1,1)p=(1,1)p=(1,1)". That is exactly what INV licenses, but only after compactness, convexity, the point where both gain, and the location of ddd inside the square have been re-established for each transformed problem. Uniqueness of the maximizer also needs care at the boundary of the quadrant, where the product vanishes.

Formalization scope

Utility pairs are ℝ × ℝ, with u.1 player 1's utility and u.2 player 2's. Milestones 1–5 work at d=(0,0)d=(0,0)d=(0,0), the paper's normalization. Milestone 6 has a general ddd and the goal's encoding. Milestones 1–5 make the following readings explicit:

  • "First quadrant" is the closed quadrant u1≥0, u2≥0u_1\ge0,\ u_2\ge0u1​≥0, u2​≥0.
  • "The point where u1u2u_1u_2u1​u2​ is maximized" is the strict maximizer over SSS in that quadrant, in the goal's form. Milestone 1 also states p1,p2>0p_1,p_2>0p1​,p2​>0, which follows from the point where both gain (p. 158).
  • Milestone 3's hypothesis is the weak maximum s1s2≤1s_1s_2\le1s1​s2​≤1. Its conclusion covers every point of SSS, not only first-quadrant points.
  • The square is the explicit set QhQ_hQh​. Its compactness, convexity and literal symmetry (a,b)∈Qh  ⟺  (b,a)∈Qh(a,b)\in Q_h\iff(b,a)\in Q_h(a,b)∈Qh​⟺(b,a)∈Qh​ are part of milestone 4's conclusion.
  • "Satisfying assumptions (6) and (8)" in the square means lying on u1=u2u_1=u_2u1​=u2​ and being strictly dominated by no point of the square.

Milestone 6's five hypotheses are copied verbatim from the goal, and its conclusion is the goal's last conjunct for the given ggg. It does not restate the goal: it has no existence claim and no "if and only if".

Trivializing formalizations are ruled out. The point where both gain is a hypothesis wherever uniqueness is claimed; without it a segment on an axis has many maximizers of u1u2=0u_1u_2=0u1​u2​=0. The square is a concrete set, not "some symmetric compact convex set", and the solution's properties are quantified over the goal's class B\mathcal BB, which is nonempty.

The examples need finite sums, convex hulls of finite sets, and extreme points, all in Mathlib. Contributions are welcome on each milestone and on the sufficiency half of the goal.

Related platform work treats other bargaining models. These are Rubinstein's alternating-offers game (RubinsteinBargaining.PEP) and the Chatterjee–Samuelson sealed-offer double auction (ChatterjeeSamuelson). Neither is used here. The von Neumann–Morgenstern utility theorem behind the normalization is formalized as TheoryOfGames.Utility.utility_existence_uniqueness.

Selected references

  • J. F. Nash, Jr., The Bargaining Problem, Econometrica 18(2), 155–162, 1950. doi:10.2307/1907266
  • J. von Neumann, O. Morgenstern, Theory of Games and Economic Behavior, Princeton University Press, 1944.
  • J. F. Nash, Jr., Two-Person Cooperative Games, Econometrica 21(1), 128–140, 1953. doi:10.2307/1906951
  • E. Kalai, M. Smorodinsky, Other Solutions to Nash's Bargaining Problem, Econometrica 43(3), 513–518, 1975. doi:10.2307/1914280
  • K. Binmore, A. Rubinstein, A. Wolinsky, The Nash Bargaining Solution in Economic Modelling, RAND Journal of Economics 17(2), 176–188, 1986. doi:10.2307/2555382
  • M. J. Osborne, A. Rubinstein, Bargaining and Markets, Academic Press, 1990, Theorem 2.3.
10 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Supply Chain Coordination with Revenue-Sharing Contracts: Strengths and Limitations 2: With Competing Retailers, Revenue Sharing Supports the System-Optimal Quantities as a Nash EquilibriumResearch Paper

Motivation

A supplier that sells through independent retailers usually loses part of the profit an integrated firm would earn: each retailer orders to maximize its own profit, not the channel's. Supply chain coordination asks which contracts make the decentralized choices coincide with the integrated optimum. Cachon and Lariviere study revenue-sharing contracts, under which a retailer pays a per-unit wholesale price and keeps only a fraction ϕ\phiϕ of its revenue, the rest going to the supplier. The contracts were made prominent by the video rental industry around 1998, where studios lowered tape prices in exchange for a share of rental income.

With a single retailer, revenue sharing at the wholesale price ϕc\phi cϕc coordinates the channel and splits its profit in the proportion ϕ\phiϕ. This mission formalizes the extension in Section 3.2 of the paper to competing retailers: several locations whose revenues depend on each other's stock, so that one retailer's order lowers the others' revenue. Competition creates externalities the single-retailer argument does not have, and the question is whether revenue sharing still coordinates, and at what prices. Section 4.1.2 then works out a Cournot example in closed form, measuring how far the supplier's own optimal wholesale price leaves the channel from the integrated profit.

The source is the authors' working paper of June 2000; the published version (Management Science 51(1), 2005) renumbers and revises the results. The working paper numbers no theorem, so results are cited by section, displayed equation and page.

Setting

A single supplier sells one product through nnn locations i=1,…,ni = 1,\dots,ni=1,…,n, each run by an independent retailer. A stocking profile is qˉ=(q1,…,qn)\bar q = (q_1,\dots,q_n)qˉ​=(q1​,…,qn​), and the revenue at location iii is Ri(qˉ)R_i(\bar q)Ri​(qˉ​), which may depend on every location's quantity. The system revenue is R(qˉ)=∑iRi(qˉ)R(\bar q) = \sum_i R_i(\bar q)R(qˉ​)=∑i​Ri​(qˉ​), every unit costs the supplier c>0c > 0c>0, and the integrated system profit is

Π(qˉ)=R(qˉ)−c∑i=1nqi.\Pi(\bar q) = R(\bar q) - c\sum_{i=1}^n q_i .Π(qˉ​)=R(qˉ​)−ci=1∑n​qi​.

Write Rji(qˉ)=∂Rj(qˉ)/∂qiR_j^i(\bar q) = \partial R_j(\bar q)/\partial q_iRji​(qˉ​)=∂Rj​(qˉ​)/∂qi​: the superscript is the variable differentiated, the subscript the revenue function. The paper assumes that each RiR_iRi​ is continuous, that ∂2Ri/∂qi∂qj≤0\partial^2 R_i/\partial q_i\partial q_j \le 0∂2Ri​/∂qi​∂qj​≤0 for j≠ij \ne ij=i (locations are substitutes), and that RiR_iRi​ is unimodal in qiq_iqi​. The system-optimal profile qˉI\bar q^Iqˉ​I has positive entries and solves the first-order system

Rii(qˉI)+∑j≠iRji(qˉI)=c,i=1,…,n.(6)R_i^i(\bar q^I) + \sum_{j\ne i} R_j^i(\bar q^I) = c, \qquad i = 1,\dots,n. \tag{6}Rii​(qˉ​I)+j=i∑​Rji​(qˉ​I)=c,i=1,…,n.(6)

Under a revenue-sharing contract (ϕ,wi)(\phi, w_i)(ϕ,wi​) retailer iii earns πri(qˉ,ϕ,wˉ)=ϕRi(qˉ)−wiqi\pi_{r_i}(\bar q,\phi,\bar w) = \phi R_i(\bar q) - w_i q_iπri​​(qˉ​,ϕ,wˉ)=ϕRi​(qˉ​)−wi​qi​ and the supplier earns πs(qˉ,ϕ,wˉ)=∑i((1−ϕ)Ri(qˉ)+wiqi)−c∑iqi\pi_s(\bar q,\phi,\bar w) = \sum_i\big((1-\phi)R_i(\bar q) + w_i q_i\big) - c\sum_i q_iπs​(qˉ​,ϕ,wˉ)=∑i​((1−ϕ)Ri​(qˉ​)+wi​qi​)−c∑i​qi​; the wholesale-price contract is ϕ=1\phi = 1ϕ=1, with profits written πri(qˉ,wˉ)\pi_{r_i}(\bar q,\bar w)πri​​(qˉ​,wˉ) and πs(qˉ,wˉ)\pi_s(\bar q,\bar w)πs​(qˉ​,wˉ). A Nash equilibrium in order quantities is a profile qˉ≥0\bar q \ge 0qˉ​≥0 from which no retailer gains by changing its own quantity to any x≥0x \ge 0x≥0. The coordinating wholesale prices are

wiI=c−∑j≠iRji(qˉI).w_i^I = c - \sum_{j\ne i} R_j^i(\bar q^I).wiI​=c−j=i∑​Rji​(qˉ​I).

The Cournot example (7) is Ri(qˉ)=qi(1−qi−β∑j≠iqj)R_i(\bar q) = q_i\big(1 - q_i - \beta\sum_{j\ne i} q_j\big)Ri​(qˉ​)=qi​(1−qi​−β∑j=i​qj​) with 0≤β<10 \le \beta < 10≤β<1.

Formalization targets

Goal: revenue sharing supports qˉI\bar q^Iqˉ​I (Sec. 3.2, p. 14)

For ϕ∈[0,1]\phi\in[0,1]ϕ∈[0,1] and wi(ϕ)=ϕwiIw_i(\phi) = \phi w_i^Iwi​(ϕ)=ϕwiI​:

qˉI is a Nash equilibrium,πri(qˉI,ϕ,ϕwˉI)=ϕ πri(qˉI,wˉI),πs(qˉI,ϕ,ϕwˉI)=(1−ϕ)Π(qˉI)+ϕ πs(qˉI,wˉI).\bar q^I \text{ is a Nash equilibrium},\quad \pi_{r_i}(\bar q^I,\phi,\phi\bar w^I) = \phi\,\pi_{r_i}(\bar q^I,\bar w^I),\quad \pi_s(\bar q^I,\phi,\phi\bar w^I) = (1-\phi)\Pi(\bar q^I) + \phi\,\pi_s(\bar q^I,\bar w^I).qˉ​I is a Nash equilibrium,πri​​(qˉ​I,ϕ,ϕwˉI)=ϕπri​​(qˉ​I,wˉI),πs​(qˉ​I,ϕ,ϕwˉI)=(1−ϕ)Π(qˉ​I)+ϕπs​(qˉ​I,wˉI).

Wholesale-price contracts (Sec. 3.2, pp. 13–14)

An interior equilibrium satisfies Rii(qˉN)=wiR_i^i(\bar q^N) = w_iRii​(qˉ​N)=wi​ (Eq. (8)), so marginal-cost pricing does not support qˉI\bar q^Iqˉ​I when a location imposes a negative externality; the prices wˉI\bar w^IwˉI make qˉI\bar q^Iqˉ​I an equilibrium; wiI≥cw_i^I \ge cwiI​≥c when cross-effects are nonpositive; and wˉI\bar w^IwˉI supports exactly the split πs(qˉI,wˉI)=∑iqiI∑j≠i(−Rji(qˉI))\pi_s(\bar q^I,\bar w^I) = \sum_i q_i^I\sum_{j\ne i}(-R_j^i(\bar q^I))πs​(qˉ​I,wˉI)=∑i​qiI​∑j=i​(−Rji​(qˉ​I)).

Revenue sharing (Sec. 3.2, p. 14)

An interior equilibrium satisfies ϕRii(qˉN)=wi(ϕ)\phi R_i^i(\bar q^N) = w_i(\phi)ϕRii​(qˉ​N)=wi​(ϕ); the two profit identities hold for every ϕ\phiϕ; and πri(qˉI,wˉI)≥0\pi_{r_i}(\bar q^I,\bar w^I) \ge 0πri​​(qˉ​I,wˉI)≥0.

The Cournot example (Sec. 4.1.2, pp. 19–20)

At a common price w<1w<1w<1 the unique equilibrium is qiN=(1−w)/(2+β(n−1))q_i^N = (1-w)/(2+\beta(n-1))qiN​=(1−w)/(2+β(n−1)); the integrated optimum is qiI=(1−c)/(2+2β(n−1))q_i^I = (1-c)/(2+2\beta(n-1))qiI​=(1−c)/(2+2β(n−1)); the coordinating price wI=c+β(n−1)(1−c)/(2+2β(n−1))w^I = c + \beta(n-1)(1-c)/(2+2\beta(n-1))wI=c+β(n−1)(1−c)/(2+2β(n−1)) increases in β\betaβ and nnn; the supplier's optimal price is w∗=(1+c)/2w^* = (1+c)/2w∗=(1+c)/2; and the efficiency at w∗w^*w∗ is

Π(qˉN(w∗))Π(qˉI)=1−1(2+β(n−1))2.\frac{\Pi(\bar q^N(w^*))}{\Pi(\bar q^I)} = 1 - \frac{1}{(2+\beta(n-1))^2}.Π(qˉ​I)Π(qˉ​N(w∗))​=1−(2+β(n−1))21​.

Significance

The goal shows that the single-retailer coordination result survives competition, with one change: the coordinating price must charge each retailer for the externality it imposes on the others, so it depends on every location's revenue function, and wiIw^I_iwiI​ exceeds the production cost. The supplier's profit then moves along a line between what wholesale prices alone give her and the whole system profit, which is how revenue sharing provides a profit split that linear prices cannot. The Cournot results make the comparison quantitative: when retailers compete intensely, the supplier's own optimal wholesale price already achieves most of the integrated profit, so revenue sharing, which has administrative costs, is less attractive.

No machine-checked proof of these results is known. The mission produces a reusable formal description of an nnn-player quantity game under per-retailer linear contracts, equilibrium conditions for it, and a fully worked Cournot instance, including a uniqueness claim for equilibria among all (not only symmetric) profiles.

Difficulty

The equilibrium claims are global: a retailer must not gain from any nonnegative deviation, not only from small ones. A first-order condition at qˉI\bar q^Iqˉ​I does not give this by itself. The page assumes RiR_iRi​ unimodal in qiq_iqi​, but unimodality does not survive subtracting the linear purchase cost, so the first-order condition is not sufficient under that assumption alone; the formalization uses concavity in the own quantity, under which it is. The participation claim πri(qˉI,wˉI)≥0\pi_{r_i}(\bar q^I,\bar w^I) \ge 0πri​​(qˉ​I,wˉI)≥0 is stated on the page without proof and needs a bound on the revenue of a location that stocks nothing.

In the Cournot example, uniqueness of the equilibrium must exclude asymmetric profiles and profiles where some retailers stock nothing, and the supplier's optimal price must be compared against every equilibrium at every price, including prices at which the retailers order nothing.

Formalization scope

Locations are Fin n; a profile is Fin n → ℝ; revenues are R : Fin n → (Fin n → ℝ) → ℝ, and dR i j q is Rji(qˉ)=∂Rj/∂qiR_j^i(\bar q) = \partial R_j/\partial q_iRji​(qˉ​)=∂Rj​/∂qi​, given as a partial derivative at every profile with all entries positive. A deviation of retailer iii to xxx is Function.update q i x, and Nash equilibria quantify over all x≥0x \ge 0x≥0. The standing assumptions of Section 3.2 are fields of the structure Model: c>0c > 0c>0; continuity of RiR_iRi​ on the nonnegative orthant; the partial derivatives; ∂2Ri/∂qi∂qj≤0\partial^2 R_i/\partial q_i\partial q_j \le 0∂2Ri​/∂qi​∂qj​≤0, encoded as "RiiR_i^iRii​ does not increase in qjq_jqj​"; and concavity of RiR_iRi​ in qiq_iqi​, which is the formalization's reading of "unimodal in qiq_iqi​". The paper's assumption that marginal revenue eventually falls below every δ>0\delta > 0δ>0 is used only for existence of an equilibrium, which is not formalized, and is omitted.

Deviations from the page, each disclosed in the item concerned:

  • qˉI\bar q^Iqˉ​I is taken as any positive solution of (6); its optimality for Π\PiΠ is not used.
  • "qˉ∗\bar q^*qˉ​∗ is a Nash equilibrium" (p. 13) is read as qˉI\bar q^Iqˉ​I.
  • In ϕ(Ri(qˉI)−qiIwi)\phi(R_i(\bar q^I) - q_i^I w_i)ϕ(Ri​(qˉ​I)−qiI​wi​) (p. 14), wiw_iwi​ is read as wiIw_i^IwiI​.
  • "Rii(qˉI)>cR_i^i(\bar q^I) > cRii​(qˉ​I)>c" needs a negative externality ∑j≠iRji(qˉI)<0\sum_{j\ne i}R_j^i(\bar q^I) < 0∑j=i​Rji​(qˉ​I)<0, which is assumed.
  • "Rji(qˉ)≤0R_j^i(\bar q) \le 0Rji​(qˉ​)≤0" is not a standing assumption, so it is a hypothesis of wiI≥cw_i^I \ge cwiI​≥c, and strictness needs some strictly negative cross-effect.
  • πri(qˉI,wˉI)≥0\pi_{r_i}(\bar q^I,\bar w^I) \ge 0πri​​(qˉ​I,wˉI)≥0 assumes nonnegative revenue at a location that stocks nothing.
  • In the Cournot example the implicit w<1w < 1w<1 and 0<c<10 < c < 10<c<1 are hypotheses; all retailers pay a common price; "increasing" is strict exactly where it holds (n≥2n \ge 2n≥2 for β\betaβ, β>0\beta > 0β>0 for nnn).

A formalization that defines "the prices coordinate" as "the prices satisfy the first-order condition at qˉI\bar q^Iqˉ​I" restates (6) and is ruled out: every equilibrium claim here is the game-theoretic statement about unilateral deviations. Contributions welcome: proofs of the equilibrium lemmas from concavity and the derivative, the Cournot uniqueness argument, and a general existence theorem for the quantity game.

Selected references

  • G. P. Cachon, M. A. Lariviere, Supply Chain Coordination with Revenue-Sharing Contracts: Strengths and Limitations, working paper, June 2000. Published version: Management Science 51(1):30–44, 2005. https://doi.org/10.1287/mnsc.1040.0215
  • D. Fudenberg, J. Tirole, Game Theory, MIT Press, 1991 (Theorem 1.2, existence of pure-strategy equilibria).
  • F. Bernstein, A. Federgruen, Pricing and Replenishment Strategies in a Distribution System with Competing Retailers, Operations Research 51(3):409–426, 2003. https://doi.org/10.1287/opre.51.3.409.14957
  • J. Tirole, The Theory of Industrial Organization, MIT Press, 1988.
16 thms3 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

The Price of Stability for Network Design with Fair Cost Allocation I: The Price of Stability of Fair Cost Sharing Is at Most H(k), and This Is TightResearch Paper

Motivation

Many networks are built and paid for by the users they serve: multicast trees, virtual overlays, shared subnetworks of the Internet. A protocol proposes a design and a rule for splitting its cost, and each participant is free to accept the proposal or defect to a cheaper alternative. The designer therefore cannot impose the global optimum; the best it can do is propose the cheapest outcome that no participant wants to leave, a Nash equilibrium. The ratio between the cost of the best equilibrium and the optimal cost, the price of stability, measures the loss caused by requiring stability. It contrasts with the price of anarchy, which compares the worst equilibrium with the optimum and suits settings with no coordinating protocol at all.

Anshelevich, Dasgupta, Kleinberg, Tardos, Wexler and Roughgarden (SIAM J. Comput. 2008; preliminary version FOCS 2004) studied this question for the most common cost-sharing rule, the Shapley (equal-split) rule, under which every user of an edge pays the same share of its cost. Their first result, the subject of this mission, is that the price of stability is at most the harmonic number H(k)H(k)H(k), where kkk is the number of players, and that this bound is attained in the limit.

Setting

There are kkk players and a finite set EEE of edges. Each player iii has a family Σi\Sigma_iΣi​ of feasible strategies, each a set of edges; in the network setting Σi\Sigma_iΣi​ consists of the edge sets connecting player iii's terminals in a directed graph. Each edge eee has a nonnegative cost cec_ece​. In a strategy vector S=(S1,…,Sk)S=(S_1,\dots,S_k)S=(S1​,…,Sk​), Si∈ΣiS_i\in\Sigma_iSi​∈Σi​, let xex_exe​ be the number of players whose strategy contains eee. Under Shapley cost sharing player iii pays

Ci(S)=∑e∈Sicexe.C_i(S)=\sum_{e\in S_i}\frac{c_e}{x_e}.Ci​(S)=e∈Si​∑​xe​ce​​.

The cost of the designed network is

cost⁡(S)=∑e∈⋃iSice,\operatorname{cost}(S)=\sum_{e\in\bigcup_i S_i}c_e ,cost(S)=e∈⋃i​Si​∑​ce​,

and the payments add up to exactly this amount. The profile SSS is a (pure) Nash equilibrium if no player iii has a strategy Si′∈ΣiS_i'\in\Sigma_iSi′​∈Σi​ with Ci(S−i,Si′)<Ci(S)C_i(S_{-i},S_i')<C_i(S)Ci​(S−i​,Si′​)<Ci​(S). Finally,

H(k)=1+12+⋯+1k.H(k)=1+\tfrac12+\dots+\tfrac1k .H(k)=1+21​+⋯+k1​.

The game is a congestion game: the per-user cost of an edge, fe(x)=ce/xf_e(x)=c_e/xfe​(x)=ce​/x, depends only on the edge and its number of users. Rosenthal's potential

Φ(S)=∑e∈E∑x=1xefe(x)\Phi(S)=\sum_{e\in E}\sum_{x=1}^{x_e}f_e(x)Φ(S)=e∈E∑​x=1∑xe​​fe​(x)

changes by exactly the deviating player's change in cost when a single player changes strategy. The same objects are used with load-dependent edge costs ce(x)c_e(x)ce​(x), in which case fe(x)=ce(x)/xf_e(x)=c_e(x)/xfe​(x)=ce​(x)/x.

Formalization targets

Goal: Theorem 2.1 and its tightness

For every game with ce≥0c_e\ge0ce​≥0 in which each player has a feasible strategy there is a Nash equilibrium SSS with

cost⁡(S)≤H(k)⋅cost⁡(P)for every profile P,\operatorname{cost}(S)\le H(k)\cdot\operatorname{cost}(P)\quad\text{for every profile }P,cost(S)≤H(k)⋅cost(P)for every profile P,

and for every k≥1k\ge1k≥1, ε>0\varepsilon>0ε>0 the instance of Fig. 1.1 (player iii has its own path of cost 1/i1/i1/i, and all players can share a path of cost 1+ε1+\varepsilon1+ε) has a Nash equilibrium, every Nash equilibrium of it costs H(k)H(k)H(k), and some profile costs 1+ε1+\varepsilon1+ε. The ratio H(k)/(1+ε)H(k)/(1+\varepsilon)H(k)/(1+ε) tends to H(k)H(k)H(k) as ε→0\varepsilon\to0ε→0.

Milestones

  1. Budget balance: ∑iCi(S)=cost⁡(S)\sum_iC_i(S)=\operatorname{cost}(S)∑i​Ci​(S)=cost(S) for every SSS (Sect. 1).
  2. Rosenthal's potential is exact (Theorem 2.1, proof, (2.1)).
  3. From every profile some Nash equilibrium of no larger potential is reached (Theorem 2.1, proof).
  4. Theorem 3.1: if cost⁡(S)≤A Φ(S)\operatorname{cost}(S)\le A\,\Phi(S)cost(S)≤AΦ(S) and Φ(S)≤Bcost⁡(S)\Phi(S)\le B\operatorname{cost}(S)Φ(S)≤Bcost(S) for all SSS, the price of stability is at most ABABAB.
  5. For nondecreasing concave edge costs ce(x)c_e(x)ce​(x): cost⁡(S)≤Φ(S)≤H(k)cost⁡(S)\operatorname{cost}(S)\le\Phi(S)\le H(k)\operatorname{cost}(S)cost(S)≤Φ(S)≤H(k)cost(S) (Theorem 2.3, proof).
  6. Theorem 2.3: the H(k)H(k)H(k) bound for nondecreasing concave edge costs.
  7. The Fig. 1.1 instance: its Nash equilibrium is unique and costs H(k)H(k)H(k); a profile costs 1+ε1+\varepsilon1+ε.

Significance

The bound shows that requiring stability under the Shapley rule costs at most a logarithmic factor, H(k)=Θ(log⁡k)H(k)=\Theta(\log k)H(k)=Θ(logk), whereas the price of anarchy of the same game is kkk (two parallel edges of costs 111 and kkk already show this). It was among the first price-of-stability results and is the starting point for a line of work on network design games: the undirected case, where the H(k)H(k)H(k) bound is not tight and the correct value remained open for years, weighted players, and other cost-sharing rules. The argument (an exact potential that over- and under-estimates the social cost by bounded factors) is the standard tool for price-of-stability bounds, and Theorem 3.1 isolates it in a reusable form.

The theorem is proved in the paper; to our knowledge no machine-checked proof exists. This mission produces a formal account of Shapley cost-sharing games as congestion games, of Rosenthal's potential and the finite improvement property, of the potential-sandwich argument of Theorem 3.1, and of the matching lower-bound instance, for constant and for nondecreasing concave edge costs.

Difficulty

The obvious approach, bounding the cost of an arbitrary equilibrium, fails: some equilibria cost kkk times the optimum, so any proof must select a particular equilibrium. The selection uses the finiteness of the strategy space together with the exact potential, and the bound needs the inequality Φ≤H(k)⋅cost⁡\Phi\le H(k)\cdot\operatorname{cost}Φ≤H(k)⋅cost, which for concave costs requires the per-user cost ce(x)/xc_e(x)/xce​(x)/x to be nonincreasing. On the lower-bound side, the claim that every equilibrium of Fig. 1.1 costs H(k)H(k)H(k) requires excluding all equilibria in which some players share the common path, for every kkk at once, not only checking that the all-own profile is stable.

Formalization scope

Games are encoded as congestion games over arbitrary finite families of edge sets, reusing the published CongestionPoA.AsymSum.Model (congestion game, loads, player costs, cost-form pure Nash equilibrium, total cost). The paper notes that its proofs do not use the graph structure; the directed-graph game is the instance in which Σi\Sigma_iΣi​ is the family of edge sets connecting player iii's terminals. Players and edges form finite types; kkk is the number of players and H(k)H(k)H(k) is Mathlib's harmonic k cast to R\mathbb RR. The price of stability is stated as the existence of a Nash equilibrium whose cost is at most the constant times the cost of every profile, with no division by the optimum, and with the hypothesis that some profile exists. Concave costs are functions on N\mathbb NN with nonincreasing increments, nondecreasing, with ce(0)≥0c_e(0)\ge0ce​(0)≥0; this last condition is implicit in the paper and needed for ce(x)/xc_e(x)/xce​(x)/x to be nonincreasing. Theorem 3.1 carries the implicit hypothesis A≥0A\ge0A≥0.

A statement that bounds every equilibrium is false, and one that asserts a cheap profile without the Nash condition is trivial; both are excluded, and the tightness part quantifies over every Nash equilibrium of the instance and asserts that one exists.

Needed infrastructure: finite improvement paths in potential games, sum manipulations over loads, and bounds on harmonic sums. The potential lemmas apply to every finite congestion game and are reusable beyond this mission. Proofs of any milestone are welcome independently.

Selected references

  • E. Anshelevich, A. Dasgupta, J. Kleinberg, É. Tardos, T. Wexler, T. Roughgarden, The Price of Stability for Network Design with Fair Cost Allocation, SIAM J. Comput. 38(4):1602–1623, 2008. https://doi.org/10.1137/070680096
  • R. W. Rosenthal, A class of games possessing pure-strategy Nash equilibria, Int. J. Game Theory 2:65–67, 1973. https://doi.org/10.1007/BF01737559
  • D. Monderer, L. S. Shapley, Potential games, Games Econ. Behav. 14:124–143, 1996. https://doi.org/10.1006/game.1996.0044
11 thms3 active usersReviewed
🏆Completed
Complexity TheoryOperations Research·Captain: mikedeng1

The Complexity of Computing a Nash Equilibrium 2: The Three-Colorable Addition-Multiplication Gadget Has Error Amplification 81Research Paper

Motivation

Nash's theorem guarantees that every finite game has a mixed equilibrium, but says nothing about how hard one is to find. Daskalakis, Goldberg and Papadimitriou (SIAM J. Comput. 39(1), 2009) showed that computing a Nash equilibrium is complete for the class PPAD of total search problems whose solutions are guaranteed by a parity argument on a directed graph (Papadimitriou 1994). Their proof simulates an arithmetic circuit by a graphical game: a multiplayer game in which each player's payoff depends on a few neighbours only, built from small game gadgets whose equilibria compute x↦αxx \mapsto \alpha xx↦αx, x+yx + yx+y, xyxyxy, constants and comparisons on mixed-strategy probabilities.

These gadgets are the reusable core of the reduction. The PPAD-completeness results for three-player games, and the later results for two-player games and for approximate equilibria, all rest on gadget analyses of this kind.

Timeline.

  • 1994: Papadimitriou defines PPAD and shows that Nash equilibrium computation lies in it (JCSS 48).
  • 2001: Kearns, Littman and Singh introduce graphical games (UAI 2001).
  • 2005–2006: Goldberg and Papadimitriou reduce rrr-player games to four-player games, and Daskalakis, Goldberg and Papadimitriou prove PPAD-completeness for four players (STOC 2006). The three-player case is obtained independently by Daskalakis and Papadimitriou and by Chen and Deng (ECCC reports, 2005); the two-player case by Chen and Deng (FOCS 2006; J. ACM 56(3), 2009, with Teng).
  • 2009: the journal version unifies the three-player argument; its Proposition 4.18 is the gadget G+,∗\mathcal G_{+,*}G+,∗​ that makes the reduction to three players work.

Setting

A game has finitely many players; player ppp has a finite set SpS_pSp​ of pure strategies and a nonnegative payoff uspu^p_susp​ for each pure profile sss. A mixed profile xxx gives each player a probability distribution (xjp)j∈Sp(x^p_j)_{j\in S_p}(xjp​)j∈Sp​​, and xsx_sxs​ denotes the product of the probabilities of the components of a partial profile sss. The expected payoff of a pure strategy jjj of ppp is ∑s∈S−pujspxs\sum_{s\in S_{-p}} u^p_{js}x_s∑s∈S−p​​ujsp​xs​.

An ϵ\epsilonϵ-Nash equilibrium (the paper's notion, an ϵ\epsilonϵ-approximately well-supported equilibrium, Eq. (2)) is a mixed profile in which no player puts weight on a pure strategy that another of its pure strategies beats by more than ϵ\epsilonϵ:

∀p, j,j′∈Sp:∑s∈S−pujspxs>∑s∈S−puj′spxs+ϵ  ⟹  xj′p=0.\forall p,\ j, j' \in S_p:\quad \sum_{s\in S_{-p}} u^p_{js}x_s > \sum_{s\in S_{-p}} u^p_{j's}x_s + \epsilon \implies x^p_{j'} = 0 .∀p, j,j′∈Sp​:s∈S−p​∑​ujsp​xs​>s∈S−p​∑​uj′sp​xs​+ϵ⟹xj′p​=0.

For ϵ=0\epsilon = 0ϵ=0 this characterizes Nash equilibria.

A player with strategies {0,1}\{0,1\}{0,1} is binary; p[v]\mathbf p[v]p[v] is the probability that it plays 111, and p[v:s]\mathbf p[v : s]p[v:s] is the probability that vvv plays sss. The affects graph (Definition 2.2) has an edge (v1,v2)(v_1, v_2)(v1​,v2​) between distinct players when the payoff of v2v_2v2​ is a nonconstant function of the action of v1v_1v1​. A legal kkk-coloring (Definition 4.8) gives each player one of kkk colors so that the two ends of an edge differ and two distinct players with a common successor differ.

The game G+,∗\mathcal G_{+,*}G+,∗​ (Fig. 11) has inputs v1,v2v_1, v_2v1​,v2​, output v3v_3v3​ and intermediate players w1,v1′,w2,v2′,w3,w,uw_1, v_1', w_2, v_2', w_3, w, uw1​,v1′​,w2​,v2′​,w3​,w,u, all binary except v2′v_2'v2′​, which has strategies {0,1,∗}\{0, 1, *\}{0,1,∗}. Its payoff tables are fixed by nonnegative integers α,β,γ\alpha, \beta, \gammaα,β,γ; the inputs' payoffs are unconstrained.

Formalization targets

Goal: Proposition 4.18

For nonnegative integers α,β,γ\alpha, \beta, \gammaα,β,γ with α+β+γ≤3\alpha + \beta + \gamma \le 3α+β+γ≤3, the affects graph of G+,∗\mathcal G_{+,*}G+,∗​ has a legal 3-coloring, and for every ϵ∈[0,0.01]\epsilon \in [0, 0.01]ϵ∈[0,0.01], at every ϵ\epsilonϵ-Nash equilibrium,

∣ p[v3]−min⁡{1, αp[v1]+βp[v2]+γp[v1]p[v2]}∣≤81 ϵ.\Big|\,\mathbf p[v_3] - \min\{1,\ \alpha\mathbf p[v_1] + \beta\mathbf p[v_2] + \gamma\mathbf p[v_1]\mathbf p[v_2]\}\Big| \le 81\,\epsilon .​p[v3​]−min{1, αp[v1​]+βp[v2​]+γp[v1​]p[v2​]}​≤81ϵ.

The case ϵ=0\epsilon = 0ϵ=0 is exact computation at every Nash equilibrium.

Milestones: the four claims of the proof

  • Claim 1: p[v1′]=18p[v1]±ϵ\mathbf p[v_1'] = \tfrac18\mathbf p[v_1] \pm \epsilonp[v1′​]=81​p[v1​]±ϵ.
  • Claim 2: p[v2′:1]=18p[v2]±ϵ\mathbf p[v_2' : 1] = \tfrac18\mathbf p[v_2] \pm \epsilonp[v2′​:1]=81​p[v2​]±ϵ.
  • Claim 3: p[v2′:∗]=α8p[v1]+β8p[v2]+γ8p[v1]p[v2]±10ϵ\mathbf p[v_2' : *] = \tfrac{\alpha}{8}\mathbf p[v_1] + \tfrac{\beta}{8}\mathbf p[v_2] + \tfrac{\gamma}{8}\mathbf p[v_1]\mathbf p[v_2] \pm 10\epsilonp[v2′​:∗]=8α​p[v1​]+8β​p[v2​]+8γ​p[v1​]p[v2​]±10ϵ.
  • Claim 4: the output bound of the goal.

Milestones: the elementary gadgets

  • Proposition 4.2 (G×α\mathcal G_{\times\alpha}G×α​): p[v2]=min⁡(αp[v1],1)±ϵ\mathbf p[v_2] = \min(\alpha\mathbf p[v_1], 1) \pm \epsilonp[v2​]=min(αp[v1​],1)±ϵ for real α≥0\alpha \ge 0α≥0, ϵ<1\epsilon < 1ϵ<1.
  • Proposition 4.3: p[v3]=min⁡(αp[v1]+βp[v2]+γp[v1]p[v2],1)±ϵ\mathbf p[v_3] = \min(\alpha\mathbf p[v_1] + \beta\mathbf p[v_2] + \gamma\mathbf p[v_1]\mathbf p[v_2], 1) \pm \epsilonp[v3​]=min(αp[v1​]+βp[v2​]+γp[v1​]p[v2​],1)±ϵ for real α,β,γ≥0\alpha, \beta, \gamma \ge 0α,β,γ≥0.
  • Proposition 4.5 (Gα\mathcal G_\alphaGα​): p[v1]=min⁡(α,1)±ϵ\mathbf p[v_1] = \min(\alpha, 1) \pm \epsilonp[v1​]=min(α,1)±ϵ.
  • Lemma 5.3 (comparator G<\mathcal G_<G<​): p[d]=1\mathbf p[d] = 1p[d]=1 if p[a]<p[b]−ϵ\mathbf p[a] < \mathbf p[b] - \epsilonp[a]<p[b]−ϵ and p[d]=0\mathbf p[d] = 0p[d]=0 if p[a]>p[b]+ϵ\mathbf p[a] > \mathbf p[b] + \epsilonp[a]>p[b]+ϵ.

Significance

The result. The paper reduces rrr-player games to three-player games by building a graphical game from gadgets, legally coloring it with three colors, and turning each color class into one player of a normal-form game (§4.2, §4.5). Proposition 4.18 supplies a gadget that computes min⁡{1,αx+βy+γxy}\min\{1, \alpha x + \beta y + \gamma xy\}min{1,αx+βy+γxy} and can be glued into such a construction while keeping it legally 3-colorable (p. 233), at the price of an error constant 818181 instead of the constant 111 of the elementary gadgets. The error bound is what carries the reduction over to approximate equilibria: an ϵ\epsilonϵ-Nash equilibrium of the gadget computes its function to within 81ϵ81\epsilon81ϵ.

Formalizing it. All results here are proved in the paper (Proposition 4.5 is stated with the remark that its proof is similar to those of Propositions 4.2 and 4.3). None of them has a machine-checked proof, and no graphical-game or gadget infrastructure exists in Lean. The mission formalizes the known proofs and produces a library of verified gadgets with explicit error bounds, the first layer of any formal treatment of the PPAD-hardness of Nash equilibria.

Difficulty

Each claim is a case analysis on which strategy of an intermediate player is dominated by more than ϵ\epsilonϵ, but the cases interact. Claim 3 needs Claims 1 and 2 as inputs, and it is the step where both α+β+γ≤3\alpha + \beta + \gamma \le 3α+β+γ≤3 and ϵ≤0.01\epsilon \le 0.01ϵ≤0.01 are used: without them one of the regimes of www cannot be excluded. The three-strategy player v2′v_2'v2′​ cannot be handled by the "binary player copies or disagrees" argument of the elementary gadgets; its weight on 111 and on ∗*∗ must be tracked separately. The error constants 101010 and 818181 propagate through products of approximate quantities, so a proof that is loose at any step does not reach them.

On the Lean side, the expected payoff of a pure strategy is a sum over all pure profiles of a ten-player game; every claim first has to reduce it to the few coordinates the player's payoff actually depends on.

Formalization scope

Games, mixed profiles and expected payoffs are those of the published agt_games bundle: a finite player type, strategy types S i, payoffs u : ι → (∀ i, S i) → ℝ, AGT.IsMixedProfile, AGT.expectedPayoff. The expected payoff of a pure strategy jjj is the expected payoff of the profile with ppp's strategy replaced by the point mass at jjj. An ϵ\epsilonϵ-Nash equilibrium requires a genuine mixed profile.

Each gadget is one explicit game on its own player type, with the payoff tables of the paper. Binary strategies are Fin 2 with the paper's labels 0,10, 10,1, and p[v]\mathbf p[v]p[v] is the weight on 1; v2′v_2'v2′​'s strategies are an inductive type {zero, one, star}. The input players' payoffs are unconstrained in the paper; here they are 000, which makes the ϵ\epsilonϵ-condition at the inputs vacuous. Since every non-input payoff depends only on gadget players, "ϵ\epsilonϵ-Nash equilibrium of the standalone gadget" quantifies over all mixed strategies of the inputs and imposes the condition exactly on the other players, which is the paper's meaning when the gadget sits inside a larger game. The affects graph is computed from the payoff functions, without self-loops, and colors {1,…,k}\{1,\dots,k\}{1,…,k} are Fin k. The ranges α,β,γ∈N\alpha, \beta, \gamma \in \mathbb Nα,β,γ∈N (Proposition 4.18) and α,β,γ∈R≥0\alpha, \beta, \gamma \in \mathbb R_{\ge 0}α,β,γ∈R≥0​ (Propositions 4.2, 4.3, 4.5) follow the paper; ϵ≥0\epsilon \ge 0ϵ≥0 is added where the paper writes only ϵ<1\epsilon < 1ϵ<1.

The paper states Proposition 4.18 and Lemma 5.3 as "there is a graphical game"; an existential statement would be met by a game whose output has a dominant strategy and whose inputs are forced, so both are stated for the explicit game of the proof, with free inputs.

A complete development needs a computation lemma for the pure-strategy payoff in each gadget (reusable for any gadget on these definitions) and the case analyses of the claims. Proofs of the elementary gadgets, which are short, and of Claims 1 and 2 are good first contributions; Claim 3 is the main step.

Selected references

  • C. Daskalakis, P. W. Goldberg, C. H. Papadimitriou, The Complexity of Computing a Nash Equilibrium, SIAM J. Comput. 39(1):195–259, 2009. https://doi.org/10.1137/070699652
  • C. H. Papadimitriou, On the complexity of the parity argument and other inefficient proofs of existence, J. Comput. System Sci. 48(3):498–532, 1994. https://doi.org/10.1016/S0022-0000(05)80063-7
  • M. Kearns, M. L. Littman, S. Singh, Graphical Models for Game Theory, UAI 2001. https://arxiv.org/abs/1301.2281
  • X. Chen, X. Deng, S.-H. Teng, Settling the complexity of computing two-player Nash equilibria, J. ACM 56(3):14, 2009. https://doi.org/10.1145/1516512.1516516
15 thms3 active usersReviewed
🏆Completed
Convex OptimizationOperations Research·Captain: mikedeng1

Consensus of Subjective Probabilities: The Pari-Mutuel Method: Equilibrium Track Probabilities Exist and Are UniqueResearch Paper

Motivation

A group of mmm individuals each hold a subjective probability distribution over the same nnn outcomes, and one wants a single distribution representing their consensus. Averaging and convolution are the obvious candidates. Eisenberg and Gale (Ann. Math. Statist. 30(1), 1959) observe that a real institution already performs such an aggregation: the pari-mutuel method of betting on horse races, in which the final "track's odds" on a horse are proportional to the total amount bet on it.

The difficulty is circular. Each bettor wants to bet where the ratio of their own probability to the track probability is largest, but the track probabilities are only known after everyone has bet. The paper asks whether track probabilities and bets compatible with both the bettors' strategies and the pari-mutuel principle exist, and whether they are determined by the data. It answers yes on both counts for the probabilities, which gives a well-defined notion of pari-mutuel consensus.

The variational problem the paper introduces, maximizing ∑ibilog⁡(utilityi)\sum_i b_i \log(\text{utility}_i)∑i​bi​log(utilityi​), is now known as the Eisenberg–Gale convex program. It is the standard tool for computing equilibria of linear Fisher markets, and the pari-mutuel market is the special case in which every bettor's utility for a horse is their subjective win probability.

Setting

There are mmm bettors B1,…,BmB_1,\dots,B_mB1​,…,Bm​ and nnn horses H1,…,HnH_1,\dots,H_nH1​,…,Hn​.

  • The subjective probability matrix P=(pij)P=(p_{ij})P=(pij​) is m×nm\times nm×n; pijp_{ij}pij​ is the probability, in the opinion of BiB_iBi​, that HjH_jHj​ wins. Each row is a probability distribution: pij≥0p_{ij}\ge 0pij​≥0 and ∑jpij=1\sum_j p_{ij}=1∑j​pij​=1.
  • Bettor BiB_iBi​ has a budget bi>0b_i>0bi​>0, with the unit of money chosen so that ∑ibi=1\sum_i b_i=1∑i​bi​=1.
  • Each column of PPP contains at least one positive entry (a horse nobody believes in can be removed).

Unknowns are Greek. πj\pi_jπj​ is the track probability of HjH_jHj​ and βij\beta_{ij}βij​ is the amount BiB_iBi​ bets on HjH_jHj​. Nonnegative πj,βij\pi_j,\beta_{ij}πj​,βij​ are equilibrium probabilities and bets when

(1) ∑j=1nβij=bi,(2) ∑i=1mβij=πj,(3) if μi=max⁡spisπs and βij>0, then μi=pijπj.\text{(1)}\ \sum_{j=1}^n\beta_{ij}=b_i,\qquad \text{(2)}\ \sum_{i=1}^m\beta_{ij}=\pi_j,\qquad \text{(3)}\ \text{if } \mu_i=\max_s\frac{p_{is}}{\pi_s}\text{ and }\beta_{ij}>0,\text{ then }\mu_i=\frac{p_{ij}}{\pi_j}.(1) j=1∑n​βij​=bi​,(2) i=1∑m​βij​=πj​,(3) if μi​=smax​πs​pis​​ and βij​>0, then μi​=πj​pij​​.

(1) is the budget relation, (2) the pari-mutuel condition, and (3) says each bettor bets only on horses that maximize the subjective expectation pij/πjp_{ij}/\pi_jpij​/πj​.

The paper's variational problem is

φ(ξ)=∑i=1mbilog⁡∑j=1npijξijonD={ξ: ξij≥0, ∑i=1mξij=1 for all j},\varphi(\xi)=\sum_{i=1}^m b_i\log\sum_{j=1}^n p_{ij}\xi_{ij}\quad\text{on}\quad D=\Big\{\xi:\ \xi_{ij}\ge0,\ \sum_{i=1}^m\xi_{ij}=1\ \text{for all } j\Big\},φ(ξ)=i=1∑m​bi​logj=1∑n​pij​ξij​onD={ξ: ξij​≥0, i=1∑m​ξij​=1 for all j},

with φ=−∞\varphi=-\inftyφ=−∞ where an inner sum vanishes. From a maximizer ξˉ\bar\xiξˉ​ it builds πj=max⁡ibipij/∑spisξˉis\pi_j=\max_i b_ip_{ij}/\sum_s p_{is}\bar\xi_{is}πj​=maxi​bi​pij​/∑s​pis​ξˉ​is​ (6) and βij=ξˉijπj\beta_{ij}=\bar\xi_{ij}\pi_jβij​=ξˉ​ij​πj​ (7). In Lean the market is PariMutuel.Consensus.Market m n, equilibrium is Market.IsEquilibrium, and φ\varphiφ, DDD, the maximizer predicate, (6) and (7) are Market.phi, D m n, Market.IsPhiMaximizer, Market.trackProb, Market.bets.

Formalization targets

Goal: existence and uniqueness of equilibrium probabilities

∃! π∈Rn  ∃ β∈Rm×n: (π,β) are equilibrium probabilities and bets.\exists!\,\pi\in\mathbb R^n\ \ \exists\,\beta\in\mathbb R^{m\times n}:\ (\pi,\beta)\ \text{are equilibrium probabilities and bets}.∃!π∈Rn  ∃β∈Rm×n: (π,β) are equilibrium probabilities and bets.

Only π\piπ is unique; the paper notes that equilibrium bets need not be.

Milestones

  1. φ\varphiφ attains its maximum on DDD at a point with every inner sum positive (p. 167).
  2. ∂φ/∂ξij=bipij/∑spisξis\partial\varphi/\partial\xi_{ij}=b_ip_{ij}/\sum_s p_{is}\xi_{is}∂φ/∂ξij​=bi​pij​/∑s​pis​ξis​ wherever the inner sums are positive (p. 167).
  3. (8): at a maximizer, ξˉij>0\bar\xi_{ij}>0ξˉ​ij​>0 implies πj=∂φ/∂ξˉij\pi_j=\partial\varphi/\partial\bar\xi_{ij}πj​=∂φ/∂ξˉ​ij​ (p. 167).
  4. Every πj\pi_jπj​ of (6) is positive (p. 167).
  5. EXISTENCE THEOREM: for every maximizer ξˉ\bar\xiξˉ​, (6)–(7) are equilibrium probabilities and bets (p. 167).
  6. Every equilibrium has πj>0\pi_j>0πj​>0 (p. 168).
  7. For two equilibria, ∑kπˉkπˉk/πk≤1\sum_k\bar\pi_k\bar\pi_k/\pi_k\le 1∑k​πˉk​πˉk​/πk​≤1 (p. 168).
  8. If π>0\pi>0π>0, πˉ≥0\bar\pi\ge0πˉ≥0, both sum to 1 and ∑kπˉk2/πk≤1\sum_k\bar\pi_k^2/\pi_k\le1∑k​πˉk2​/πk​≤1, then πˉ=π\bar\pi=\piπˉ=π (p. 168).
  9. UNIQUENESS THEOREM: equilibrium probabilities are unique (p. 168).

A further, non-milestone item states the referee's example (p. 168): with two bettors of equal budgets and two horses, if the first bettor's distribution is (12,12)(\tfrac12,\tfrac12)(21​,21​), the equilibrium probabilities are (12,12)(\tfrac12,\tfrac12)(21​,21​) whatever the second bettor believes.

Significance

The result makes pari-mutuel odds a well-defined function of the bettors' beliefs and budgets, so the consensus can be studied as a mathematical object; the referee's example shows it behaves very differently from averaging, since a single indifferent bettor can fix it. The existence proof replaces a fixed-point argument by a concave maximization, which is the origin of the Eisenberg–Gale program, later the basis of convex-programming and combinatorial algorithms for Fisher market equilibria.

The theorems are classical and fully proved in the paper. To the knowledge of this mission they have no machine-checked proof. The mission produces a formal pari-mutuel market model, the Eisenberg–Gale program with the correct treatment of log⁡0=−∞\log 0=-\inftylog0=−∞, and Lean proofs of existence and uniqueness. The platform's Market Equilibrium under Separable, Piecewise-Linear, Concave Utilities missions (Vazirani–Yannakakis) concern a related Fisher-market model with rational piecewise-linear utilities.

Difficulty

The existence statement, as the paper proves it, has two delicate points. φ\varphiφ is −∞-\infty−∞ on part of the boundary of DDD, so "continuous on a compact set" needs the extended-real reading, and a real-valued formalization must handle the boundary separately. The first-order condition (8) has to be derived from maximality on a polytope with equality constraints on columns, not from an unconstrained critical point.

For uniqueness, the natural first idea, strict concavity of φ\varphiφ, fails: φ\varphiφ is concave but not strictly concave in ξ\xiξ, and indeed equilibrium bets are not unique. Uniqueness has to be proved for the probabilities directly, for arbitrary equilibria and not only those built from a maximizer, and it needs positivity of all πj\pi_jπj​, which the paper uses without proof.

Formalization scope

  • Bettors are Fin m and horses Fin n, indexed from 0. All data are real. Every standing assumption (rows of PPP are probability vectors, no zero column, bi>0b_i>0bi​>0, ∑ibi=1\sum_i b_i=1∑i​bi​=1) is a field of Market; m≥1m\ge1m≥1 follows from ∑ibi=1\sum_ib_i=1∑i​bi​=1.
  • Condition (3) is written multiplied out: βij>0⇒pisπj≤pijπs\beta_{ij}>0\Rightarrow p_{is}\pi_j\le p_{ij}\pi_sβij​>0⇒pis​πj​≤pij​πs​ for all sss. This equals (3) when π>0\pi>0π>0 and encodes the paper's p/0=+∞p/0=+\inftyp/0=+∞ when some πs=0\pi_s=0πs​=0. Positivity of π\piπ is not part of the definition of equilibrium; it is milestone 6.
  • DDD has column sums one, as in (5).
  • φ\varphiφ is real-valued. A maximizer is a point of DDD with positive inner sums that dominates every point of DDD with positive inner sums; the excluded points have φ=−∞\varphi=-\inftyφ=−∞ on the page. The max in (6) is Finset.sup' over the nonempty set of bettors.
  • Ruled out: a version of (3) with real division (x/0=0x/0=0x/0=0) admits spurious equilibria with πs=0\pi_s=0πs​=0 and makes uniqueness false; a maximizer defined with the raw real φ\varphiφ (log⁡0=0\log0=0log0=0) changes the set of maximizers; adding π>0\pi>0π>0 or ∑jπj=1\sum_j\pi_j=1∑j​πj​=1 to the equilibrium definition weakens the goal.
  • Needed infrastructure: compactness of DDD and an argument handling the −∞-\infty−∞ boundary, one-variable derivatives of log⁡\loglog of linear forms, and the equality case of the Cauchy–Schwarz inequality. Milestones 7–9 use no analysis and can be attacked independently of 1–5. Proofs of any milestone, and reusable lemmas on the Eisenberg–Gale program, are welcome.

Selected references

  • E. Eisenberg and D. Gale, Consensus of subjective probabilities: the pari-mutuel method, The Annals of Mathematical Statistics 30(1):165–168, 1959. https://doi.org/10.1214/aoms/1177706369
  • V. V. Vazirani and M. Yannakakis, Market equilibrium under separable, piecewise-linear, concave utilities, Journal of the ACM 58(3), 2011. https://doi.org/10.1145/1970392.1970394
12 thms3 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

The Price of Anarchy of Finite Congestion Games II: For Symmetric Games the Average Social Cost Price of Anarchy Is (5N-2)/(2N+1)Research Paper

Motivation

Selfish routing and resource sharing are modelled by congestion games: each player picks a set of shared resources, and the cost of a resource grows with the number of players using it. The price of anarchy, introduced by Koutsoupias and Papadimitriou (STACS 1999), measures how much worse the social cost of a worst Nash equilibrium is than the optimum. For non-atomic (infinitesimal) traffic with linear latencies, Roughgarden and Tardos (J. ACM 2002) showed the ratio is 4/34/34/3. Christodoulou and Koutsoupias (STOC 2005) turned to finite (atomic, unweighted) congestion games, where each of NNN players controls one indivisible unit of load, and determined the pure price of anarchy for linear latencies in four settings: asymmetric or symmetric strategy sets, and average or maximum social cost. Awerbuch, Azar and Epstein (STOC 2005) obtained the value 5/25/25/2 for the asymmetric average case independently.

This mission covers the symmetric average-cost entry of that table (Sect. 3.2 of the paper). It shows that when all players share one strategy set, the ratio is not 5/25/25/2 but (5N−2)/(2N+1)(5N-2)/(2N+1)(5N−2)/(2N+1), which depends on the number of players and tends to 5/25/25/2 only as N→∞N\to\inftyN→∞.

Setting

A congestion game has a finite set of players N={1,…,n}N=\{1,\dots,n\}N={1,…,n} (in Lean, Fin N), a finite set of facilities EEE, for each player iii a collection of pure strategies Σi⊆2E\Sigma_i\subseteq 2^EΣi​⊆2E, and for each facility a latency fe:N→Rf_e:\mathbb N\to\mathbb Rfe​:N→R. A profile A=(A1,…,An)A=(A_1,\dots,A_n)A=(A1​,…,An​) picks Ai∈ΣiA_i\in\Sigma_iAi​∈Σi​ for each player (IsProfile). The load ne(A)n_e(A)ne​(A) is the number of players whose strategy contains eee (load), the cost of player iii is

ci(A)=∑e∈Aife(ne(A))c_i(A)=\sum_{e\in A_i} f_e\bigl(n_e(A)\bigr)ci​(A)=e∈Ai​∑​fe​(ne​(A))

(cost), and the social cost is SUM(A)=∑ici(A)\mathrm{SUM}(A)=\sum_i c_i(A)SUM(A)=∑i​ci​(A) (sumCost), NNN times the average cost. A profile AAA is a pure Nash equilibrium (IsPureNash) if ci(A)≤ci(A−i,S)c_i(A)\le c_i(A_{-i},S)ci​(A)≤ci​(A−i​,S) for every player iii and every S∈ΣiS\in\Sigma_iS∈Σi​, where (A−i,S)(A_{-i},S)(A−i​,S) replaces AiA_iAi​ by SSS.

Latencies are linear (IsLinear) when fe(k)=aek+bef_e(k)=a_ek+b_efe​(k)=ae​k+be​ with ae,be≥0a_e,b_e\ge0ae​,be​≥0. The game is symmetric (IsSymmetric) when all players have the same strategy set, Σi=Σ\Sigma_i=\SigmaΣi​=Σ. The pure price of anarchy of a class of games is the supremum, over games in the class and pure Nash equilibria AAA, of SUM(A)/opt\mathrm{SUM}(A)/\mathit{opt}SUM(A)/opt, with opt=min⁡PSUM(P)\mathit{opt}=\min_P\mathrm{SUM}(P)opt=minP​SUM(P).

Formalization targets

Goal: Theorems 3 and 4

For every N≥1N\ge1N≥1: every pure Nash equilibrium AAA of every symmetric linear congestion game with NNN players satisfies

SUM(A)≤5N−22N+1 SUM(P)for every profile P,\mathrm{SUM}(A)\le\frac{5N-2}{2N+1}\,\mathrm{SUM}(P)\quad\text{for every profile }P,SUM(A)≤2N+15N−2​SUM(P)for every profile P,

and some symmetric linear game with NNN players has a pure Nash equilibrium AAA and a profile PPP with SUM(P)>0\mathrm{SUM}(P)>0SUM(P)>0 and equality. Together these state that the pure price of anarchy of the class is exactly (5N−2)/(2N+1)(5N-2)/(2N+1)(5N−2)/(2N+1).

Milestones

  1. Lemma 1: β(α+1)≤13α2+53β2\beta(\alpha+1)\le\frac13\alpha^2+\frac53\beta^2β(α+1)≤31​α2+35​β2 for nonnegative integers α,β\alpha,\betaα,β.
  2. Theorem 3, proof: the Nash inequality of player iii against the strategy PjP_jPj​ of any player jjj.
  3. Theorem 3, proof: the bound on N ci(A)N\,c_i(A)Nci​(A) obtained by summing over jjj.
  4. Theorem 3, proof: the bound on SUM(A)\mathrm{SUM}(A)SUM(A) obtained by summing over iii.
  5. Theorem 3: the upper bound alone.
  6. Theorem 4: the matching instances alone.

Significance

The result separates symmetric from asymmetric games for every finite number of players: for N=2N=2N=2 the symmetric bound is 8/58/58/5, for N=3N=3N=3 it is 13/713/713/7, against 5/25/25/2 for asymmetric games with N≥3N\ge3N≥3 players. Theorem 4 shows the bound is tight, so the function N↦(5N−2)/(2N+1)N\mapsto(5N-2)/(2N+1)N↦(5N−2)/(2N+1) is the exact answer, not an artefact of the proof. The asymptotic value 5/25/25/2 coincides with the asymmetric one, which says that symmetry helps only by a vanishing amount for large populations. Later work on smoothness arguments (Roughgarden, STOC 2009) takes the 5/25/25/2 bound of this paper as its central example.

The theorems are proved in the paper; the authors print the proofs for identity latencies fe(k)=kf_e(k)=kfe​(k)=k and state that they extend to aek+bea_ek+b_eae​k+be​. No machine-checked proof of these bounds is known to exist. This mission produces a statement for general affine latencies with nonnegative coefficients, the affine forms of the intermediate inequalities, and an explicit family of instances for every NNN, all of which are reusable for the other entries of the paper's table.

Difficulty

The upper bound requires combining the N2N^2N2 deviation inequalities (player iii against the strategy of each player jjj in the comparison profile) and then bounding cross terms facility by facility; the step that needs care is that the bound of Lemma 1 holds for integer loads only and fails for real numbers, so any argument that relaxes loads to reals loses the constant. The asymmetric argument, which compares player iii only with its own optimal strategy PiP_iPi​, gives 5/25/25/2 and cannot see the dependence on NNN.

For the lower bound, the instance must be a Nash equilibrium against every strategy in the common strategy set, which contains the equilibrium strategies of all other players as well as the optimal ones. Exact equality of the ratio requires the block sizes to be tuned to NNN; verifying the equilibrium condition involves counting facilities shared by pairs and triples of players.

Formalization scope

Players are Fin N with N≥1N\ge1N≥1; facilities are an arbitrary finite type with decidable equality; strategies and profiles are Finsets of facilities, with feasibility a separate predicate. Latencies are real-valued functions of the natural-number load. Linear latencies are affine with nonnegative coefficients, as in Sect. 2 of the paper; the milestone inequalities carry the coefficients ae,bea_e,b_eae​,be​ explicitly and reduce to the printed displays when ae=1a_e=1ae​=1, be=0b_e=0be​=0. The Nash condition is in cost form. Upper bounds are stated against every feasible profile PPP, which is equivalent to the bound on SUM(A)/opt\mathrm{SUM}(A)/\mathit{opt}SUM(A)/opt without dividing by opt\mathit{opt}opt. All constants are computed in R\mathbb RR.

The lower bound requires SUM(P)>0\mathrm{SUM}(P)>0SUM(P)>0: without it the statement is satisfied by zero latencies or empty strategies, where both sides vanish. Symmetry is a hypothesis of the upper bound and a property of the instance; without it the upper bound is false, since asymmetric instances reach 5/25/25/2.

A complete development needs finite-sum manipulations (double counting ∑j∑e∈Pj=∑ene(P)\sum_j\sum_{e\in P_j}=\sum_e n_e(P)∑j​∑e∈Pj​​=∑e​ne​(P)), the integer inequality of Lemma 1, and an explicit facility type for the instance. The model layer is shared with the other missions of this series. Proofs of the milestones and alternative proofs of the bound are welcome.

Selected references

  • G. Christodoulou and E. Koutsoupias, The Price of Anarchy of Finite Congestion Games, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060600
  • B. Awerbuch, Y. Azar and A. Epstein, The Price of Routing Unsplittable Flow, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060599
  • E. Koutsoupias and C. Papadimitriou, Worst-case Equilibria, STACS 1999. https://doi.org/10.1007/3-540-49116-3_38
  • T. Roughgarden and É. Tardos, How Bad Is Selfish Routing?, J. ACM 49(2), 2002. https://doi.org/10.1145/506147.506153
  • T. Roughgarden, Intrinsic Robustness of the Price of Anarchy, Proc. 41st ACM STOC, 2009. https://doi.org/10.1145/1536414.1536485
9 thms3 active usersReviewed
🏆Completed
Convex OptimizationMachine LearningOptimization·Captain: mikedeng1

Blackwell Approachability and No-Regret Learning are Equivalent 3: An Efficient Forecaster Whose (ℓ1, ε)-Calibration Rate Is at Most √(2/(εT))Research Paper

Calibrated forecasting

A forecaster announces, each day, a probability that it will rain; afterwards nature reveals whether it did. The forecaster is calibrated if, on the days on which it announced roughly 30%, it rained roughly 30% of the time, and likewise for every other announced value. Calibration is a minimal consistency requirement for probabilistic forecasts, used in meteorology, in the evaluation of probabilistic classifiers, and in game theory, where calibrated forecasts of the opponents' play lead to correlated equilibrium (Foster and Vohra, 1997).

Calibration is achievable even against an adversary who chooses the outcomes, provided the forecaster randomizes. Timeline:

  • 1998. Foster and Vohra construct an asymptotically calibrated randomized forecaster against an arbitrary outcome sequence.
  • 1999. Foster reduces calibration to Blackwell's approachability theorem by exhibiting, for each halfspace, a forecast that keeps the payoff inside it.
  • 2009. Mannor and Stoltz give an approachability-based calibration procedure concurrently with the paper below.
  • 2011. Abernethy, Bartlett and Hazan prove that Blackwell approachability and no-regret online linear optimization are equivalent, and use the equivalence to obtain an efficient calibrated forecaster: O(log⁡1/ε)O(\log 1/\varepsilon)O(log1/ε) time per round and calibration rate O(1/εT)O(1/\sqrt{\varepsilon T})O(1/εT​).

This mission formalizes the last result, Theorem 22 of the 2011 paper, in the explicit form given by its proof.

Setting

Fix a positive integer mmm and the grid width ε=1/m\varepsilon = 1/mε=1/m. Each round t=1,…,Tt = 1, \dots, Tt=1,…,T the forecaster chooses a probability vector wtw_twt​ in the simplex Δm+1\Delta_{m+1}Δm+1​ over the grid indices i=0,…,mi = 0, \dots, mi=0,…,m, draws it∼wti_t \sim w_tit​∼wt​ and announces pt=it/mp_t = i_t/mpt​=it​/m. Nature then reveals yt∈{0,1}y_t \in \{0, 1\}yt​∈{0,1}.

Vectors live in Rm+1\mathbb R^{m+1}Rm+1 with the Euclidean norm ∥⋅∥2\|\cdot\|_2∥⋅∥2​. The ℓ₁ norm is ∥x∥1=∑i∣xi∣\|x\|_1 = \sum_i |x_i|∥x∥1​=∑i​∣xi​∣, the ℓ₁ ball is B1(r)={y:∥y∥1≤r}B_1(r) = \{y : \|y\|_1 \le r\}B1​(r)={y:∥y∥1​≤r}, and the unit cube is B∞(1)={θ:∣θi∣≤1 for all i}B_\infty(1) = \{\theta : |\theta_i| \le 1 \text{ for all } i\}B∞​(1)={θ:∣θi​∣≤1 for all i}.

The calibration game (11) has payoff

u(w,y)=(w(0)(y−0m), w(1)(y−1m), …, w(m)(y−1))∈Rm+1.u(w, y) = \Bigl(w(0)\bigl(y - \tfrac0m\bigr),\ w(1)\bigl(y - \tfrac1m\bigr),\ \dots,\ w(m)(y - 1)\Bigr) \in \mathbb R^{m+1}.u(w,y)=(w(0)(y−m0​), w(1)(y−m1​), …, w(m)(y−1))∈Rm+1.

The (ℓ1,ε)(\ell_1, \varepsilon)(ℓ1​,ε)-calibration rate (Definition 19) of the announced forecasts is max⁡{0,∑i=0m∣1T∑t=1TI[pt=i/m](i/m−yt)∣−ε/2}\max\{0, \sum_{i=0}^m |\frac1T\sum_{t=1}^T \mathbb I[p_t = i/m](i/m - y_t)| - \varepsilon/2\}max{0,∑i=0m​∣T1​∑t=1T​I[pt​=i/m](i/m−yt​)∣−ε/2}. Replacing each indicator by its expectation wt(i)w_t(i)wt​(i) gives the rate of the forecast distributions,

CˉTε=max⁡{0, ∑i=0m∣1T∑t=1Twt(i)(im−yt)∣−ε2},\bar C^\varepsilon_T = \max\Bigl\{0,\ \sum_{i=0}^m \Bigl|\frac1T \sum_{t=1}^T w_t(i)\Bigl(\frac im - y_t\Bigr)\Bigr| - \frac\varepsilon2\Bigr\},CˉTε​=max{0, i=0∑m​​T1​t=1∑T​wt​(i)(mi​−yt​)​−2ε​},

which is max⁡{0,∥uˉT∥1−ε/2}\max\{0, \|\bar u_T\|_1 - \varepsilon/2\}max{0,∥uˉT​∥1​−ε/2} for the average payoff uˉT=1T∑tu(wt,yt)\bar u_T = \frac1T\sum_t u(w_t, y_t)uˉT​=T1​∑t​u(wt​,yt​).

The forecaster is Algorithm 5. It keeps a point θt\theta_tθt​ in the cube, starting from θ1=0\theta_1 = 0θ1​=0 with w1w_1w1​ arbitrary. After round ttt it takes a projected gradient step (Algorithm 4, online gradient descent) against the loss vector ft=−u(wt,yt)f_t = -u(w_t, y_t)ft​=−u(wt​,yt​):

θt+1=ΠB∞(1)(θt+η u(wt,yt)),\theta_{t+1} = \Pi_{B_\infty(1)}\bigl(\theta_t + \eta\, u(w_t, y_t)\bigr),θt+1​=ΠB∞​(1)​(θt​+ηu(wt​,yt​)),

where Π\PiΠ is the Euclidean projection. It then sets wt+1w_{t+1}wt+1​ to the output of the oracle Algorithm 3 on θt+1\theta_{t+1}θt+1​, which puts weight on at most two adjacent grid points where θ\thetaθ changes sign.

Formalization targets

Goal: Theorem 22 in the form (14)

For m≥1m \ge 1m≥1, T≥1T \ge 1T≥1, every outcome sequence y1,…,yT∈{0,1}y_1, \dots, y_T \in \{0, 1\}y1​,…,yT​∈{0,1} and every run of Algorithm 5 with η=(m+1)/T\eta = \sqrt{(m+1)/T}η=(m+1)/T​,

CˉTε≤2εT.\bar C^\varepsilon_T \le \sqrt{\frac{2}{\varepsilon T}}.CˉTε​≤εT2​​.

This is the bound CTε≤GD/TC^\varepsilon_T \le GD/\sqrt TCTε​≤GD/T​ of display (14) with the paper's constant G=2G = \sqrt 2G=2​.

Milestones

  1. Claim 1 (proof): min⁡∥y∥1≤ε/2∥x−y∥1=max⁡{0,−ε/2+∥x∥1}\min_{\|y\|_1 \le \varepsilon/2}\|x - y\|_1 = \max\{0, -\varepsilon/2 + \|x\|_1\}min∥y∥1​≤ε/2​∥x−y∥1​=max{0,−ε/2+∥x∥1​}.
  2. Display (13): for ∥x∥1>ε/2\|x\|_1 > \varepsilon/2∥x∥1​>ε/2, also =−ε/2−min⁡∥θ∥∞≤1⟨−x,θ⟩= -\varepsilon/2 - \min_{\|\theta\|_\infty \le 1}\langle -x, \theta\rangle=−ε/2−min∥θ∥∞​≤1​⟨−x,θ⟩.
  3. Algorithm 3: for every θ\thetaθ in the cube there is an output w∈Δm+1w \in \Delta_{m+1}w∈Δm+1​, and every output satisfies ⟨u(w,y),θ⟩≤ε/2\langle u(w, y), \theta\rangle \le \varepsilon/2⟨u(w,y),θ⟩≤ε/2 for all y∈[0,1]y \in [0, 1]y∈[0,1].
  4. Display (12): under that guarantee, max⁡{0,∥uˉT∥1−ε/2}≤1T(∑t⟨−ut,θt⟩−min⁡θ∈B∞(1)∑t⟨−ut,θ⟩)\max\{0, \|\bar u_T\|_1 - \varepsilon/2\} \le \frac1T\bigl(\sum_t \langle -u_t, \theta_t\rangle - \min_{\theta \in B_\infty(1)}\sum_t\langle -u_t, \theta\rangle\bigr)max{0,∥uˉT​∥1​−ε/2}≤T1​(∑t​⟨−ut​,θt​⟩−minθ∈B∞​(1)​∑t​⟨−ut​,θ⟩).
  5. Online gradient descent: regret at most DGTDG\sqrt TDGT​ with step η=D/(GT)\eta = D/(G\sqrt T)η=D/(GT​).
  6. Theorem 21 (response-satisfiability and approachability): for every y∈[0,1]y \in [0,1]y∈[0,1] some w∈Δm+1w \in \Delta_{m+1}w∈Δm+1​ has u(w,y)∈B1(ε/2)u(w, y) \in B_1(\varepsilon/2)u(w,y)∈B1​(ε/2); hence some algorithm choosing wtw_twt​ from y1,…,yt−1y_1, \dots, y_{t-1}y1​,…,yt−1​ drives the distance of the average payoff to B1(ε/2)B_1(\varepsilon/2)B1​(ε/2) to 000 against every outcome sequence in [0,1][0,1][0,1].

Significance

The bound shows that a forecaster with logarithmic per-round cost has calibration error vanishing at rate T−1/2T^{-1/2}T−1/2 against every outcome sequence. Earlier calibrated forecasters required solving a linear program or computing a fixed point each round. The construction is also the paper's worked instance of its general equivalence: a calibration problem, posed as approachability of an ℓ₁ ball, is solved by a no-regret learner on the dual unit cube together with a halfspace oracle.

The result is proved in the paper; no machine-checked version is known to exist. The formalization makes explicit three points the paper leaves informal: the step size, the sign of the gradient step, and the gap between the forecast distributions and the sampled forecasts. The milestones are reusable on their own: the ℓ₁/ℓ∞ duality, and the regret bound of online gradient descent for linear losses on a general closed convex set.

Difficulty

The chain (12)–(14) looks like a direct composition, but each link has content. The oracle guarantee needs a case analysis over the sign pattern of θ\thetaθ, including the degenerate case θ(i+1)=0\theta(i+1) = 0θ(i+1)=0. The reduction (12) needs the duality (13) with attained minima, and it holds only outside the ball B1(ε/2)B_1(\varepsilon/2)B1​(ε/2). The regret bound of online gradient descent needs the non-expansiveness of the Euclidean projection and a telescoping argument. The tempting shortcut of quoting "OGD has regret O(T)O(\sqrt T)O(T​)" does not give the stated constant without fixing the step size.

Formalization scope

Vectors are EuclideanSpace ℝ (Fin (m+1)), with grid index i∈{0,…,m}i \in \{0, \dots, m\}i∈{0,…,m} as Fin (m+1) and i/mi/mi/m as a real quotient; the ℓ₁ norm and the cube are written out coordinatewise. Rounds are t=1,…,Tt = 1, \dots, Tt=1,…,T. Minima over sets are stated through IsLeast or as the infimum of the image of a nonempty bounded set. Algorithm 3 is a relation that allows every sign-change index the binary search might return. The projection is any Euclidean minimizer onto the cube.

Conventions and corrections, each disclosed in the item's Formalization Note:

  • Gradient-step sign. Algorithm 4 prints θt−ηut\theta_t - \eta u_tθt​−ηut​, but the proof runs the learner on the losses ft=−utf_t = -u_tft​=−ut​ (condition 2), so the step is θt+ηut\theta_t + \eta u_tθt​+ηut​. With the printed sign the bound fails.
  • Step size. The page sets η=O(T−1/2)\eta = O(T^{-1/2})η=O(T−1/2); the goal pins η=(m+1)/T\eta = \sqrt{(m+1)/T}η=(m+1)/T​, the standard tuning with radius m+1\sqrt{m+1}m+1​ of the cube and ∥ut∥2≤1\|u_t\|_2 \le 1∥ut​∥2​≤1. The page's D=1/εD = \sqrt{1/\varepsilon}D=1/ε​ is not the cube's diameter.
  • Forecast distributions. The rate is that of the distributions wtw_twt​, the expectation of the calibration vector over the forecaster's draws (Lemma 20). The high-probability statement for the sampled forecasts is not formalized, nor is the running-time claim.
  • Other misprints. Algorithm 3's header "w↦θw \mapsto \thetaw↦θ" is θ↦w\theta \mapsto wθ↦w, and the calibration vector has m+1m + 1m+1 coordinates, not ⌊ε−1⌋\lfloor \varepsilon^{-1} \rfloor⌊ε−1⌋.
  • Added hypotheses. m≥1m \ge 1m≥1 and T≥1T \ge 1T≥1.

A trivializing formalization is ruled out. The rate is defined from Definition 19's formula, not as a distance, and the step size is pinned. A free step size would make the bound false, and an empty oracle relation would make it vacuous; milestone 3's existence clause excludes the latter.

Contributions are welcome on each milestone. The online gradient descent bound and the ℓ₁/ℓ∞ duality are independent of calibration. The published one-step inequality LogRegretOCO.OGD.one_step_inequality is included as a reference item for the regret bound.

Selected references

  • J. Abernethy, P. L. Bartlett, E. Hazan, Blackwell Approachability and No-Regret Learning are Equivalent, COLT 2011, JMLR W&CP 19, pp. 27–46, 2011. https://proceedings.mlr.press/v19/abernethy11b.html
  • D. P. Foster, R. V. Vohra, Asymptotic calibration, Biometrika 85(2), 1998. https://doi.org/10.1093/biomet/85.2.379
  • D. P. Foster, A proof of calibration via Blackwell's approachability theorem, Games and Economic Behavior 29, 1999. https://doi.org/10.1006/game.1999.0724
  • D. P. Foster, R. V. Vohra, Calibrated learning and correlated equilibrium, Games and Economic Behavior 21, 1997. https://doi.org/10.1006/game.1997.0595
  • S. Mannor, G. Stoltz, A geometric proof of calibration, Mathematics of Operations Research 35(4), 2010. https://arxiv.org/abs/0908.3576
  • M. Zinkevich, Online convex programming and generalized infinitesimal gradient ascent, ICML 2003. https://dl.acm.org/doi/10.5555/3041838.3041955
11 thms3 active usersReviewed
🏆Completed
Mechanism DesignOperations ResearchProbability·Captain: mikedeng1

Multi-parameter Mechanism Design and Sequential Posted Pricing 3: Order-Oblivious Posted Prices 2-Approximate the Optimal Revenue under a Uniform Matroid ConstraintResearch Paper

Motivation

Myerson's optimal auction (Myerson 1981) maximizes a seller's expected revenue when buyers have independent private values, but it is a sealed-bid mechanism: every buyer reports a value, and the allocation and payments are computed from all reports at once. Real sellers more often post prices: buyers arrive, each sees a take-it-or-leave-it price, and buys or leaves. Chawla, Hartline, Malec and Sivan (arXiv:0907.2435) ask how much revenue such simple mechanisms lose. Their strongest notion is the order-oblivious posted-price mechanism (OPM): the prices are fixed in advance, and the guarantee must hold whatever order the buyers arrive in, even an adversarial one.

The tool behind the guarantee for sellers of kkk identical units is a prophet inequality. In the single-choice version, a gambler inspects independent random rewards one at a time and must accept or reject each on the spot; Krengel and Sucheston, and Samuel-Cahn (Ann. Probab. 1984), showed that a single fixed threshold earns at least half of what a prophet who sees all rewards earns. The paper extends Samuel-Cahn's threshold rule to kkk choices (Appendix D.2) and turns it into a revenue guarantee (Theorem 10).

Setting

There are nnn agents [n][n][n]. Agent iii's value viv_ivi​ for being served is drawn independently from a distribution FiF_iFi​ with density fif_ifi​; the virtual valuation is ϕi(v)=v−(1−Fi(v))/fi(v)\phi_i(v) = v - (1 - F_i(v))/f_i(v)ϕi​(v)=v−(1−Fi​(v))/fi​(v) (Definition 1), and FiF_iFi​ is regular if ϕi\phi_iϕi​ is non-decreasing (Definition 2). The seller may serve any set of agents in a downward-closed set system J\mathcal JJ; this mission uses the kkk-uniform matroid, where a set is feasible exactly when it has at most kkk members.

A mechanism MMM maps reported values v\mathbf vv to an allocation M(v)∈JM(\mathbf v) \in \mathcal JM(v)∈J and payments πi(v)\pi_i(\mathbf v)πi​(v). It is truthful if reporting the true value is a dominant strategy and no agent ever gets negative utility. Its expected revenue is RM=Ev[∑iπi(v)]\mathcal R^M = \mathbb E_{\mathbf v}[\sum_i \pi_i(\mathbf v)]RM=Ev​[∑i​πi​(v)], and RM\mathcal R^{\mathcal M}RM denotes the revenue of Myerson's mechanism, the largest over truthful mechanisms (Theorem 19).

Given prices p\mathbf pp and values v\mathbf vv, agent iii desires service if vi≥piv_i \ge p_ivi​≥pi​. Let Sv\mathcal S_{\mathbf v}Sv​ be the class of maximal feasible sets of desiring agents. When agents arrive in an arbitrary order and each buys if it desires service and can still be feasibly served, the set of buyers lies in Sv\mathcal S_{\mathbf v}Sv​. The paper's pessimistic revenue estimate is

Rpobl=Ev∼F min⁡S∈Sv∑i∈Spi.\mathcal R^{\mathrm{obl}}_{\mathbf p} = \mathbb E_{\mathbf v \sim \mathbf F}\ \min_{S \in \mathcal S_{\mathbf v}} \sum_{i \in S} p_i .Rpobl​=Ev∼F​ S∈Sv​min​i∈S∑​pi​.

For the prophet inequality, X1,…,XnX_1, \dots, X_nX1​,…,Xn​ are independent nonnegative random variables with order statistics X(1)≥⋯≥X(n)X_{(1)} \ge \dots \ge X_{(n)}X(1)​≥⋯≥X(n)​, and (x)+=max⁡(0,x)(x)^+ = \max(0, x)(x)+=max(0,x). The threshold rule with threshold ccc picks indices t1(c),…,tk(c)t_1(c), \dots, t_k(c)t1​(c),…,tk​(c), where ti(c)t_i(c)ti​(c) is the lesser of n−k+in-k+in−k+i and the iii-th smallest index jjj with Xj≥cX_j \ge cXj​≥c (or n−k+in - k + in−k+i if there is none). The numbers a∗a^*a∗ and b∗b^*b∗ are the unique solutions of

a=∑i=1kE(X(i)−a/k)+,b=∑i=1nE(Xi−b/k)+.a = \sum_{i=1}^k \mathbb E\big(X_{(i)} - a/k\big)^+, \qquad b = \sum_{i=1}^n \mathbb E\big(X_i - b/k\big)^+ .a=i=1∑k​E(X(i)​−a/k)+,b=i=1∑n​E(Xi​−b/k)+.

Formalization targets

Goal: Theorem 10 (p. 9)

∃ p  ∀M truthful:RM≤2 Rpobl\exists\, \mathbf p\ \ \forall M \text{ truthful}:\qquad \mathcal R^M \le 2\, \mathcal R^{\mathrm{obl}}_{\mathbf p}∃p  ∀M truthful:RM≤2Rpobl​

for every instance with regular distributions and a kkk-uniform matroid constraint. The prices are chosen once, before the mechanism it is compared with; this is the paper's "Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ 2-approximates RM\mathcal R^{\mathcal M}RM".

Milestones

  1. Proposition 1 (p. 5): under regularity, the expected revenue of a truthful mechanism equals its expected virtual surplus E[∑i∈M(v)ϕi(vi)]\mathbb E[\sum_{i \in M(\mathbf v)} \phi_i(v_i)]E[∑i∈M(v)​ϕi​(vi​)] (with the lowest type receiving zero utility).
  2. a∗a^*a∗ and b∗b^*b∗ exist and are unique (App. D.2, p. 18).
  3. The claim a∗≤b∗a^* \le b^*a∗≤b∗ (App. D.2, p. 18).
  4. Theorem 24 (p. 18), the kkk-choice prophet inequality: for a∗≤kc≤b∗a^* \le k c \le b^*a∗≤kc≤b∗,
∑i=1kE[X(i)]≤2∑i=1kE[Xti(c)].\sum_{i=1}^k \mathbb E\big[X_{(i)}\big] \le 2 \sum_{i=1}^k \mathbb E\big[X_{t_i(c)}\big].i=1∑k​E[X(i)​]≤2i=1∑k​E[Xti​(c)​].

Significance

The theorem says that a seller of kkk identical units can fix one price per buyer, ignore the arrival order entirely, and still collect half of the optimal revenue. The factor 2 is tight: Appendix D.2 gives a single-item example with two buyers where no order-oblivious pricing does better. Corollary 11 extends the result to partition matroids, and Theorem 24 is reused for the graphical-matroid result (Theorem 12, App. D.3). Theorem 24 is a statement in optimal stopping independent of mechanism design, and kkk-choice prophet inequalities are now a standard tool for online allocation.

The results are proved in the paper (preprint arXiv:0907.2435v2; a conference version appeared at STOC 2010). To our knowledge none of them, nor any prophet inequality, has a machine-checked proof; Mathlib has independence of random variables but no order statistics, stopping-rule prophet inequalities, or Myerson's revenue characterization in this multi-agent dominant-strategy form. A related single-unit, Bayesian-incentive-compatible form of Proposition 1 exists on the platform (MechanismDesign.Auctions.revenue_eq_virtual_surplus), in a different model.

Difficulty

The threshold rule picks the first values above ccc, not the largest, and its picks are dependent random indices; the expectation E[Xti(c)]\mathbb E[X_{t_i(c)}]E[Xti​(c)​] does not factor. The obvious comparison of the gambler with the prophet term by term fails, because the gambler can exhaust its kkk picks on early, small values. The bound has to balance two events: either at least kkk values reach ccc, or a value is picked whenever it exceeds ccc; independence enters exactly in the second. The rule also has forced picks at the end of the sequence, which must be handled as stated.

On the mechanism side, Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ is a minimum over an adversarially chosen family, not the revenue of one run, so it cannot be read off from a single sequential mechanism. Proposition 1 needs the full revenue-equivalence argument: monotone allocations, the payment identity, and an integration by parts against the density.

Formalization scope

  • Distributions: each FiF_iFi​ has a bounded support [v‾i,v‾i][\underline v_i, \overline v_i][v​i​,vi​] with 0≤v‾i0 \le \underline v_i0≤v​i​, and a measurable density positive on it (a pinned convention; the paper says only "with density fif_ifi​"). Regularity is required on the support. The prior is the product of the marginals.
  • Mechanisms: deterministic, dominant-strategy incentive compatible and ex-post individually rational on the type space, with measurable allocation events and measurable, integrable payments. Payments of unserved agents are not forced to be zero.
  • RM\mathcal R^{\mathcal M}RM is not constructed. The goal is stated against every truthful mechanism, which by Theorem 19 is equivalent. Quantifier order matters: "for every mechanism there are prices" is a weaker statement and is not the goal.
  • Proposition 1 carries the normalization that an agent of the lowest type gets zero utility, which the paper presupposes on p. 12.
  • Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ is a genuine minimum over the finite, nonempty family Sv\mathcal S_{\mathbf v}Sv​; maximality is essential, since without it the empty set makes the estimate 000 and the goal false. Prices are arbitrary reals.
  • a∗a^*a∗ and b∗b^*b∗ are characterised by their equations as hypotheses, not defined by an infimum. Order statistics count multiplicity. Lean indices are 0-based. The threshold rule includes the page's forced picks ti(c)=n−k+it_i(c) = n - k + iti​(c)=n−k+i; it is not replaced by a pure threshold rule. Theorem 24 and the claims about a∗,b∗a^*, b^*a∗,b∗ assume 1≤k≤n1 \le k \le n1≤k≤n; the goal assumes nothing about kkk.
  • Out of scope: non-regular distributions (ironing), Corollary 11, and the p. 19 identity rewriting Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ as a sum of virtual values (a proof step, not a milestone).

Useful reusable infrastructure: order statistics and their measurability, Samuel-Cahn-type threshold rules, and Myerson's payment identity for dominant-strategy mechanisms. Proofs of any milestone, and supporting lemmas on these objects, are welcome.

Selected references

  • S. Chawla, J. D. Hartline, D. Malec, B. Sivan, Multi-parameter Mechanism Design and Sequential Posted Pricing, arXiv:0907.2435v2, 2010 (STOC 2010). https://arxiv.org/abs/0907.2435
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1), 1981. https://doi.org/10.1287/moor.6.1.58
  • E. Samuel-Cahn, Comparison of Threshold Stop Rules and Maximum for Independent Nonnegative Random Variables, Annals of Probability 12(4), 1984. https://doi.org/10.1214/aop/1176993150
10 thms3 active usersReviewed
🏆Completed
CombinatoricsMechanism DesignOperations Research+1·Captain: mikedeng1

Multi-parameter Mechanism Design and Sequential Posted Pricing 2: Sequential Posted Prices e/(e−1)-Approximate the Optimal Revenue under a Partition Matroid ConstraintResearch Paper

Motivation

A seller who knows the distributions of buyers' values can maximise expected revenue with Myerson's optimal mechanism (Myerson 1981): collect bids, compute virtual values, serve a feasible set of maximum virtual surplus, and charge threshold payments. Real sellers seldom run such auctions. They post prices: a buyer is offered a take-it-or-leave-it price and either accepts or walks away. Posted prices need no bidding, involve no competition between buyers, and are trivially truthful. The question is how much revenue they give up.

Chawla, Hartline, Malec and Sivan (arXiv:0907.2435, STOC 2010) answer this for a range of feasibility constraints with a single construction, the sequential posted-price mechanism (SPM) S\mathcal SS. For general matroids it loses at most a factor 222 (Theorem 5). For uniform and partition matroids, that is, multi-unit sales and unions of multi-unit sales, it loses at most a factor e/(e−1)≈1.58e/(e-1)\approx1.58e/(e−1)≈1.58 (Theorem 6), and the paper shows this factor is tight for its mechanism. This mission targets Theorem 6.

Timeline. Myerson (1981) characterised the optimal single-parameter mechanism. Blumrosen and Holenstein (2008) showed that the best single-unit SPM can be a factor π/2\sqrt{\pi/2}π/2​ below Myerson's revenue even with i.i.d. buyers. Chawla, Hartline and Kleinberg (EC 2007) used posted prices to approximate multi-parameter unit-demand pricing. Chawla, Hartline, Malec and Sivan (2010) gave the matroid, partition-matroid and matroid-intersection bounds. Yan (SODA 2011) explained the e/(e−1)e/(e-1)e/(e−1) factor through the correlation gap of submodular functions and sharpened it for kkk units to 1−kke−k/k!1-k^ke^{-k}/k!1−kke−k/k!.

Setting

There are nnn agents. Agent iii has a private value viv_ivi​ for being served, drawn independently from a distribution FiF_iFi​ with density fif_ifi​. The virtual value is φi(v)=v−1−Fi(v)fi(v)\varphi_i(v)=v-\frac{1-F_i(v)}{f_i(v)}φi​(v)=v−fi​(v)1−Fi​(v)​, and FiF_iFi​ is regular if φi\varphi_iφi​ is non-decreasing. The seller may serve any set in a downward-closed family J⊆2[n]\mathcal J\subseteq2^{[n]}J⊆2[n].

A partition matroid assigns each agent iii to a part part(i)\mathrm{part}(i)part(i) and each part bbb a capacity cap(b)∈N\mathrm{cap}(b)\in\mathbb Ncap(b)∈N. A set is feasible iff it contains at most cap(b)\mathrm{cap}(b)cap(b) agents of every part bbb. With one part of capacity kkk this is the kkk-uniform matroid: at most kkk agents are served.

A truthful mechanism MMM maps a value vector v\mathbf vv to a feasible set M(v)M(\mathbf v)M(v) and payments πi(v)\pi_i(\mathbf v)πi​(v). It is dominant-strategy incentive compatible and individually rational. Its expected revenue is RM=E[∑iπi(v)]\mathcal R^M=\mathbb E[\sum_i\pi_i(\mathbf v)]RM=E[∑i​πi​(v)], and qiM=Pr⁡[i∈M(v)]q^M_i=\Pr[i\in M(\mathbf v)]qiM​=Pr[i∈M(v)] is its service probability for agent iii.

The sequential posted-price mechanism S\mathcal SS built from MMM sets the price pi=Fi−1(1−qiM)p_i=F_i^{-1}(1-q^M_i)pi​=Fi−1​(1−qiM​) for agent iii, so that agent iii accepts with probability exactly qiMq^M_iqiM​. It approaches the agents one at a time in decreasing order of price (σ\sigmaσ is the ordering). It offers agent iii the price pip_ipi​ if adding iii to the agents already served keeps the set feasible. The agent accepts iff pi≤vip_i\le v_ipi​≤vi​. Its expected revenue is Rpσ\mathcal R^\sigma_{\mathbf p}Rpσ​.

Formalization targets

Goal: Theorem 6, partition matroids

For every partition matroid, every truthful MMM, and S\mathcal SS built from MMM as above,

RM≤ee−1 Rpσ.\mathcal R^M\le\frac{e}{e-1}\,\mathcal R^\sigma_{\mathbf p}.RM≤e−1e​Rpσ​.

Taking MMM to be Myerson's mechanism gives the paper's statement.

Milestones

  1. Lemma 2 (regular case): RM≤∑ipiMqiM\mathcal R^M\le\sum_ip^M_iq^M_iRM≤∑i​piM​qiM​ with piM=Fi−1(1−qiM)p^M_i=F_i^{-1}(1-q^M_i)piM​=Fi−1​(1−qiM​).
  2. Rank bound (§4): ∑i∈SqiM≤rank⁡(S)\sum_{i\in S}q^M_i\le\operatorname{rank}(S)∑i∈S​qiM​≤rank(S) for every set SSS; for a part bbb this reads ∑part(i)=bqiM≤cap(b)\sum_{\mathrm{part}(i)=b}q^M_i\le\mathrm{cap}(b)∑part(i)=b​qiM​≤cap(b).
  3. Single-unit revenue formula (App. C.2): RS=∑kckpkqk\mathcal R^{\mathcal S}=\sum_kc_kp_kq_kRS=∑k​ck​pk​qk​ with ck=∏j<k(1−qj)c_k=\prod_{j<k}(1-q_j)ck​=∏j<k​(1−qj​), positions in offer order.
  4. Lemma 20: with ppp defined by ∑kpkqk=p∑kqk\sum_kp_kq_k=p\sum_kq_k∑k​pk​qk​=p∑k​qk​ (equation (2)) and prices decreasing, p∑kckqk≤∑kckpkqkp\sum_kc_kq_k\le\sum_kc_kp_kq_kp∑k​ck​qk​≤∑k​ck​pk​qk​.
  5. Display (3): if ∑kqk=s≤1\sum_kq_k=s\le1∑k​qk​=s≤1, then p∑kckqk=p(1−∏k(1−qk))≥p(1−(1−s/n)n)≥(1−1/e)psp\sum_kc_kq_k=p(1-\prod_k(1-q_k))\ge p(1-(1-s/n)^n)\ge(1-1/e)psp∑k​ck​qk​=p(1−∏k​(1−qk​))≥p(1−(1−s/n)n)≥(1−1/e)ps.
  6. Theorem 21: the goal for the 111-uniform matroid.
  7. Theorem 22: the goal for the kkk-uniform matroid, every kkk.

Significance

The theorem shows that a mechanism with no bidding loses at most about 37%37\%37% of the optimal revenue when the constraint is a union of multi-unit supplies. That covers selling several kinds of goods, each in limited stock, to single-minded buyers. The prices are computed once from the distributions. The order is fixed before any value is seen. No agent's payment depends on another agent's report. The factor is tight for this mechanism (App. C.2), and the same template (prices from service probabilities, decreasing order) gives factor 222 for all matroids and m+1m+1m+1 for intersections of mmm matroids.

On the formal side, the paper's results are proved but none is machine-checked as far as we know. The platform has Myerson-type results for a single unit with Bayesian incentive compatibility and a common support (Börgers), and for i.i.d. buyers with a fixed number of units (Talluri and van Ryzin). Neither covers independent, non-identical buyers under a set-system constraint with dominant-strategy truthfulness. A complete development would include the ex-ante revenue bound of Lemma 2 for regular distributions, which is reusable for any posted-price or prophet-inequality argument, and the 1−1/e1-1/e1−1/e correlation-gap inequality.

Difficulty

The obvious argument compares S\mathcal SS with Myerson's mechanism one agent at a time. That fails, because S\mathcal SS may stop offering to an agent once the units of its part are gone, and the agents blocked this way can be the ones Myerson's mechanism serves. The loss has to be bounded in aggregate, using only the ex-ante constraint ∑part(i)=bqi≤cap(b)\sum_{\mathrm{part}(i)=b}q_i\le\mathrm{cap}(b)∑part(i)=b​qi​≤cap(b). The single-unit case reduces to an inequality about products ∏(1−qj)\prod(1-q_j)∏(1−qj​). For kkk units, the printed proof (pp. 15–16) is an induction that compares the run with a hypothetical single-unit instance with probabilities qi/kq_i/kqi​/k. Its second case is informal, so a formal proof needs its own argument for the kkk-unit bound. Passing from uniform to partition matroids needs the observation that with a global order the run inside each part depends only on that part's agents. Lemma 2 needs the revenue-curve concavity that regularity gives, stated through densities rather than derivatives.

Formalization scope

  • Values. Each FiF_iFi​ has a density that is measurable and strictly positive on a bounded interval [v‾i,vˉi][\underline v_i,\bar v_i][v​i​,vˉi​] with 0≤v‾i0\le\underline v_i0≤v​i​, integrates to 111 there, and has no mass outside. The paper says only "with density fif_ifi​". This pin rules out point masses, so the randomised-price variant of S\mathcal SS never arises. The prior is the product of these laws.
  • Regularity is φi\varphi_iφi​ non-decreasing on the support, assumed for every agent in the goal, as in the paper's §4 analyses. The non-regular extension (second paragraph of Lemma 2, Appendix E) is out of scope.
  • Truthful means deterministic, dominant-strategy incentive compatible over the support, ex-post individually rational, feasible, with measurable allocations and integrable payments.
  • Prices are arguments tied to MMM by pi∈[v‾i,vˉi]p_i\in[\underline v_i,\bar v_i]pi​∈[v​i​,vˉi​] and Fi(pi)=1−qiMF_i(p_i)=1-q^M_iFi​(pi​)=1−qiM​. No inverse distribution function is defined.
  • Order. The order σ\sigmaσ is a permutation with σ(0)\sigma(0)σ(0) first, decreasing in price, and ties are arbitrary. It is global across parts. Parts of capacity 000 are allowed.
  • Constant. The constant is exactly e/(e−1)e/(e-1)e/(e−1).
  • No free prices. The theorem is not stated with free or existentially chosen prices. Prices are pinned to MMM's service probabilities, and S\mathcal SS uses the same constraint as MMM. A statement in which the prices could be chosen after the fact, or in which MMM were not required to be individually rational, would be a different or false theorem.
  • Every truthful MMM. The comparison is with every truthful MMM, not with a constructed Myerson mechanism. This form is at least as strong as the paper's, and it is what the paper's proof shows.

Welcome contributions: proofs of the algebraic milestones (Lemma 20, display (3)), the revenue formula, Lemma 2 (reusable payment-identity infrastructure for dominant-strategy mechanisms), and a correlation-gap argument for kkk units.

Selected references

  • S. Chawla, J. D. Hartline, D. L. Malec, B. Sivan, Multi-parameter Mechanism Design and Sequential Posted Pricing, STOC 2010; arXiv:0907.2435v2, 2010. https://arxiv.org/abs/0907.2435
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1), 1981. https://doi.org/10.1287/moor.6.1.58
  • L. Blumrosen, T. Holenstein, Posted Prices vs. Negotiations: An Asymptotic Analysis, ACM EC 2008.
  • Q. Yan, Mechanism Design via Correlation Gap, ACM-SIAM SODA 2011.
12 thms3 active usersReviewed
🏆Completed
CombinatoricsMechanism DesignOperations Research+1·Captain: mikedeng1

Multi-parameter Mechanism Design and Sequential Posted Pricing 1: Sequential Posted Prices 2-Approximate the Optimal Revenue under a Matroid ConstraintResearch Paper

Why posted prices

A seller who must decide whom to serve among several buyers with private values can, in principle, run Myerson's revenue-optimal mechanism: collect bids, compute virtual values, serve the feasible set of largest virtual surplus, and charge threshold payments (Myerson 1981). In practice sellers rarely do this. Retail, ticketing and online platforms mostly use posted prices: each buyer is offered a take-it-or-leave-it price and accepts if and only if the price does not exceed the buyer's value. Posted prices are simple to explain, are trivially truthful, and do not require buyers to reveal their values.

Chawla, Hartline, Malec and Sivan (arXiv:0907.2435, STOC 2010) asked how much revenue is lost by this simplification, and showed that for a wide range of feasibility constraints a sequential posted-price mechanism recovers a constant fraction of the optimal revenue. The matroid case, a factor of 2, is the first and most widely cited of their results. It is a revenue analogue of the prophet inequality and was one of the starting points of the literature on "simple versus optimal" mechanisms.

Setting

There are nnn single-parameter agents, indexed by [n][n][n], and one seller. Agent iii has a private value viv_ivi​ for being served, drawn independently from a distribution FiF_iFi​ with density fif_ifi​. The virtual valuation of agent iii is

ϕi(vi)=vi−1−Fi(vi)fi(vi),\phi_i(v_i) = v_i - \frac{1 - F_i(v_i)}{f_i(v_i)},ϕi​(vi​)=vi​−fi​(vi​)1−Fi​(vi​)​,

and FiF_iFi​ is regular if ϕi\phi_iϕi​ is non-decreasing.

The seller faces a feasibility constraint: a downward-closed family J\mathcal JJ of subsets of [n][n][n], the sets of agents that can be served together. The rank of a set SSS is rank⁡(S)=max⁡S′⊆S, S′∈J∣S′∣\operatorname{rank}(S) = \max_{S' \subseteq S,\, S' \in \mathcal J} |S'|rank(S)=maxS′⊆S,S′∈J​∣S′∣. The constraint is a matroid if it satisfies the augmentation axiom: whenever A,B∈JA, B \in \mathcal JA,B∈J and ∣A∣>∣B∣|A| > |B|∣A∣>∣B∣, some e∈A∖Be \in A \setminus Be∈A∖B has B∪{e}∈JB \cup \{e\} \in \mathcal JB∪{e}∈J. Examples are kkk identical units (kkk-uniform matroids) and disjoint markets with separate capacities (partition matroids).

A mechanism MMM maps reported values v\mathbf vv to a feasible set M(v)∈JM(\mathbf v) \in \mathcal JM(v)∈J of served agents and a payment πi(v)\pi_i(\mathbf v)πi​(v) for each agent. It is truthful if reporting the true value is a dominant strategy and no agent ends with negative utility. Its expected revenue is RM=E[∑iπi(v)]\mathcal R^M = \mathbb E[\sum_i \pi_i(\mathbf v)]RM=E[∑i​πi​(v)], and qiM=Pr⁡[i∈M(v)]q^M_i = \Pr[i \in M(\mathbf v)]qiM​=Pr[i∈M(v)] is the probability that it serves agent iii.

A sequential posted-price mechanism (SPM) with ordering σ\sigmaσ and prices p\mathbf pp approaches the agents in the order σ\sigmaσ. When agent iii's turn comes, if adding iii to the set AAA of agents served so far keeps AAA feasible, iii is offered price pip_ipi​ and is served (and pays pip_ipi​) if pi≤vip_i \le v_ipi​≤vi​; otherwise iii is blocked. Its expected revenue is Rpσ\mathcal R^\sigma_{\mathbf p}Rpσ​.

The mechanism S\mathcal SS of the paper sets pi=Fi−1(1−qiM)p_i = F_i^{-1}(1 - q^M_i)pi​=Fi−1​(1−qiM​), so that agent iii accepts an offer with probability exactly qiMq^M_iqiM​, and approaches the agents in decreasing order of price.

Formalization targets

Goal: Theorem 5

For regular, independent values and a matroid constraint, for every truthful mechanism MMM and the SPM S\mathcal SS built from its service probabilities,

RM≤2 Rpσ.\mathcal R^M \le 2\, \mathcal R^\sigma_{\mathbf p}.RM≤2Rpσ​.

Taking MMM to be Myerson's optimal mechanism gives the paper's statement that S\mathcal SS 2-approximates the optimal revenue.

Milestones

  1. Proposition 1 (p. 5): the expected revenue of a truthful mechanism equals its expected virtual surplus E[∑i∈M(v)ϕi(vi)]\mathbb E[\sum_{i \in M(\mathbf v)} \phi_i(v_i)]E[∑i∈M(v)​ϕi​(vi​)].
  2. Lemma 2 (p. 5): RM≤∑ipiMqiM\mathcal R^M \le \sum_i p^M_i q^M_iRM≤∑i​piM​qiM​ with piM=Fi−1(1−qiM)p^M_i = F_i^{-1}(1 - q^M_i)piM​=Fi−1​(1−qiM​).
  3. Revenue of an SPM (§2.2, p. 4): Rpσ=∑iciqipi\mathcal R^\sigma_{\mathbf p} = \sum_i c_i q_i p_iRpσ​=∑i​ci​qi​pi​, where cic_ici​ is the probability that agent iii is offered service and qi=1−Fi(pi)q_i = 1 - F_i(p_i)qi​=1−Fi​(pi​).
  4. Rank bound (§4, p. 6): ∑i∈SqiM≤rank⁡(S)\sum_{i \in S} q^M_i \le \operatorname{rank}(S)∑i∈S​qiM​≤rank(S) for every set SSS.
  5. Lost revenue (proof of Theorem 5, p. 7): in any run under a matroid, with prices in decreasing order and weights qqq satisfying the rank bound, ∑i blockedpiqi≤∑i servedpi\sum_{i \text{ blocked}} p_i q_i \le \sum_{i \text{ served}} p_i∑i blocked​pi​qi​≤∑i served​pi​.
  6. Half of the benchmark (p. 7): under the same conditions, ∑ipiqi≤2Rpσ\sum_i p_i q_i \le 2 \mathcal R^\sigma_{\mathbf p}∑i​pi​qi​≤2Rpσ​.

Significance

The theorem shows that under a matroid constraint the optimal mechanism's advantage over a single round of posted prices is at most a factor of 2, uniformly over all regular distributions. Prices, rather than an auction, then suffice up to a constant, which justifies posted pricing in settings where an auction is impractical. The same argument, with the matroid replaced by an intersection of mmm matroids, gives the paper's Theorems 7 and 8, and the bound underlies the analysis of VCG with reserve prices (Theorem 32). Lemma 2's benchmark ∑ipiMqiM\sum_i p^M_i q^M_i∑i​piM​qiM​ became a standard tool for "ex ante relaxation" arguments.

The results are proved in the paper; none of them has a machine-checked proof. Formalizing them requires Myerson's revenue characterization in a multi-agent, dominant-strategy setting with a general feasibility constraint, which Lean's libraries do not have, and a probabilistic analysis of a sequential process over a product measure. Related formalizations exist for narrower models: the single-unit, Bayesian incentive compatible revenue identity MechanismDesign.Auctions.revenue_eq_virtual_surplus (Börgers' textbook, common support) and the i.i.d. multi-unit RevenueManagement.revenue_equivalence. Neither covers per-agent supports, set-system constraints or dominant-strategy truthfulness.

Difficulty

The obvious argument compares the SPM with the hypothetical mechanism that ignores the feasibility constraint, whose revenue is exactly ∑ipiqi\sum_i p_i q_i∑i​pi​qi​. The SPM loses the revenue of agents who would have accepted but are blocked. The difficulty is that blocking is correlated with the values of earlier agents, and the lost revenue must be bounded by revenue actually collected. A naive per-agent charge fails in a general matroid, because one served agent can block many others; the bound has to use the matroid's rank structure together with the decreasing price order.

On the mechanism side, Lemma 2 needs the full Myerson theory: monotonicity of truthful allocations, the payment identity, and an optimization over interim allocation rules with a fixed service probability, where regularity is used.

Formalization scope

All objects live in the namespace CHMSPricing.SpmMatroid. Agents are Fin n. The following conventions are fixed.

  • Distributions. Each FiF_iFi​ is given by a measurable density, strictly positive on a bounded interval [v‾i,v‾i][\underline v_i, \overline v_i][v​i​,vi​] with 0≤v‾i<v‾i0 \le \underline v_i < \overline v_i0≤v​i​<vi​, integrating to 111 there, with no mass outside. There are no point masses, so the randomized variant of S\mathcal SS in §4 does not arise. The prior is the product measure.
  • Regularity. Monotone non-decreasing virtual values on the support (Definition 2). All goals assume regular distributions, as the body's analyses do; the non-regular case (the second paragraph of Lemma 2, Appendix E) uses randomized prices and is out of scope.
  • Truthfulness. Deterministic mechanisms, dominant-strategy incentive compatible with deviations within the support, ex-post individually rational, feasible on the type space, with measurable allocation events and measurable integrable payments. Payments of unserved agents are not forced to zero.
  • Benchmark. The goal is stated for every truthful MMM, with S\mathcal SS built from MMM's own service probabilities; this is stronger than comparing with Myerson's mechanism alone and avoids constructing it.
  • Prices. pi=Fi−1(1−qi)p_i = F_i^{-1}(1 - q_i)pi​=Fi−1​(1−qi​) is passed as an argument with the hypotheses pi∈[v‾i,v‾i]p_i \in [\underline v_i, \overline v_i]pi​∈[v​i​,vi​] and Fi(pi)=1−qiF_i(p_i) = 1 - q_iFi​(pi​)=1−qi​, rather than through a generalized inverse.
  • SPM. Positions are 000-based; the price belongs to the agent; acceptance is pi≤vip_i \le v_ipi​≤vi​; ties in the decreasing price order are arbitrary, and the goal holds for every such order.
  • Proposition 1 additionally assumes the normalization that an agent with value v‾i\underline v_iv​i​ has zero utility, which is how the paper's payments are pinned down.

The goal cannot be trivialized by a free choice of prices: the prices are tied to the mechanism's service probabilities, and the SPM uses the same matroid as the mechanism. Individual rationality is essential, since without it a "truthful" mechanism can extract unbounded revenue.

A complete development needs Myerson's lemma for dominant-strategy single-parameter mechanisms, a quantile/revenue-curve argument under regularity, matroid span and rank facts for the paper's finite set systems, and independence arguments for a sequential process on a product measure. The rank bound and the deterministic lost-revenue inequality are independent of the probabilistic parts and are good first contributions; the Myerson-side lemmas are reusable for the other missions of this series.

Selected references

  • S. Chawla, J. D. Hartline, D. Malec, B. Sivan, Multi-parameter Mechanism Design and Sequential Posted Pricing, arXiv:0907.2435v2, 2010; STOC 2010. https://arxiv.org/abs/0907.2435
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1):58–73, 1981. https://doi.org/10.1287/moor.6.1.58
  • J. Bulow, J. Roberts, The Simple Economics of Optimal Auctions, Journal of Political Economy 97(5):1060–1090, 1989. https://doi.org/10.1086/261643
  • R. Kleinberg, S. M. Weinberg, Matroid Prophet Inequalities, STOC 2012. https://arxiv.org/abs/1201.4764
11 thms3 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

The Price of Anarchy of Finite Congestion Games IV: For Symmetric Games the Maximum Social Cost Price of Anarchy Is at Most 5/2Research Paper

Motivation

The price of anarchy measures how much a system of selfish agents loses compared with a centrally optimized one: it is the worst ratio, over all Nash equilibria, between the social cost of the equilibrium and the optimal social cost. Koutsoupias and Papadimitriou introduced it in 1999 (Worst-case equilibria, STACS 1999), and bounding it for routing and congestion games became a central topic of algorithmic game theory. Congestion games model routing in networks, load balancing on machines and any setting where agents choose sets of shared resources whose cost grows with their usage.

Christodoulou and Koutsoupias (The price of anarchy of finite congestion games, STOC 2005) determined the pure price of anarchy of finite (atomic, unweighted) congestion games with linear latencies for two social costs — the sum of the players' costs and the maximum cost of a player — and for asymmetric and symmetric games. Awerbuch, Azar and Epstein obtained the 5/25/25/2 bound for the sum independently in the same proceedings (The price of routing unsplittable flow, STOC 2005). This mission is the fourth of a series that formalizes the paper: the symmetric games with the maximum social cost (Sect. 3.4). For asymmetric games the maximum social cost has price of anarchy Θ(N)\Theta(\sqrt N)Θ(N​) (mission III); symmetry brings it down to a constant.

Setting

A congestion game has a finite set of players N={1,…,n}N=\{1,\dots,n\}N={1,…,n}, a finite set EEE of facilities, for each player iii a collection Σi\Sigma_iΣi​ of pure strategies (each a subset of EEE), and for each facility eee a latency function fe:N→Rf_e:\mathbb N\to\mathbb Rfe​:N→R. A pure strategy profile A=(A1,…,An)A=(A_1,\dots,A_n)A=(A1​,…,An​) picks Ai∈ΣiA_i\in\Sigma_iAi​∈Σi​ for every player. The load ne(A)n_e(A)ne​(A) is the number of players whose strategy contains eee, and the cost of player iii is

ci(A)=∑e∈Aife(ne(A)).c_i(A)=\sum_{e\in A_i} f_e\big(n_e(A)\big).ci​(A)=e∈Ai​∑​fe​(ne​(A)).

A profile AAA is a pure Nash equilibrium if no player can lower its cost by changing only its own strategy: ci(A)≤ci(A−i,S)c_i(A)\le c_i(A_{-i},S)ci​(A)≤ci​(A−i​,S) for every iii and every S∈ΣiS\in\Sigma_iS∈Σi​, where (A−i,S)(A_{-i},S)(A−i​,S) replaces AiA_iAi​ by SSS.

The maximum social cost is MAX(A)=max⁡ici(A)\mathrm{MAX}(A)=\max_{i} c_i(A)MAX(A)=maxi​ci​(A) and the sum social cost is SUM(A)=∑ici(A)\mathrm{SUM}(A)=\sum_i c_i(A)SUM(A)=∑i​ci​(A). Latencies are linear when fe(k)=aek+bef_e(k)=a_e k+b_efe​(k)=ae​k+be​ with ae,be≥0a_e,b_e\ge 0ae​,be​≥0. The game is symmetric when all players share one strategy set, Σi=Σ\Sigma_i=\SigmaΣi​=Σ. The pure price of anarchy for the maximum social cost is

PA=sup⁡A NashMAX(A)min⁡PMAX(P).\mathrm{PA}=\sup_{A\ \text{Nash}}\frac{\mathrm{MAX}(A)}{\min_{P}\mathrm{MAX}(P)}.PA=A Nashsup​minP​MAX(P)MAX(A)​.

Formalization targets

Goal: Theorems 7 and 8

For every symmetric linear congestion game with at least one player, every pure Nash equilibrium AAA and every pure strategy profile PPP,

MAX(A)≤52 MAX(P),\mathrm{MAX}(A)\le\tfrac52\,\mathrm{MAX}(P),MAX(A)≤25​MAX(P),

and for every N≥3N\ge3N≥3 there is a symmetric linear congestion game with NNN players, a pure Nash equilibrium AAA and a profile PPP that minimizes the maximum social cost, with MAX(P)>0\mathrm{MAX}(P)>0MAX(P)>0 and

MAX(A)=5N+12N+2 MAX(P).\mathrm{MAX}(A)=\frac{5N+1}{2N+2}\,\mathrm{MAX}(P).MAX(A)=2N+25N+1​MAX(P).

The second part shows that the constant 5/25/25/2 of the first is tight as N→∞N\to\inftyN→∞.

Milestones

  1. Theorem 7, proof (first display). In a symmetric linear game, a Nash equilibrium cost is bounded by the cost of every strategy PjP_jPj​ evaluated at loads ne(A)+1n_e(A)+1ne​(A)+1: ci(A)≤∑e∈Pjfe(ne(A)+1)c_i(A)\le\sum_{e\in P_j}f_e(n_e(A)+1)ci​(A)≤∑e∈Pj​​fe​(ne​(A)+1).
  2. Theorem 7, proof (second display). Summed over jjj: N⋅ci(A)≤∑ene(P)fe(ne(A)+1)N\cdot c_i(A)\le\sum_e n_e(P)f_e(n_e(A)+1)N⋅ci​(A)≤∑e​ne​(P)fe​(ne​(A)+1).
  3. Lemma 1. β(α+1)≤13α2+53β2\beta(\alpha+1)\le\frac13\alpha^2+\frac53\beta^2β(α+1)≤31​α2+35​β2 for nonnegative integers α,β\alpha,\betaα,β.
  4. Theorem 7, proof (Lemma 1 step). ∑ene(P)fe(ne(A)+1)≤13SUM(A)+53SUM(P)\sum_e n_e(P)f_e(n_e(A)+1)\le\frac13\mathrm{SUM}(A)+\frac53\mathrm{SUM}(P)∑e​ne​(P)fe​(ne​(A)+1)≤31​SUM(A)+35​SUM(P).
  5. Theorem 1. For linear congestion games, SUM(A)≤52SUM(P)\mathrm{SUM}(A)\le\frac52\mathrm{SUM}(P)SUM(A)≤25​SUM(P) at every pure Nash equilibrium AAA.
  6. Theorem 7 and Theorem 8 as separate statements.

Significance

The result says that in symmetric congestion games with linear costs no player at an equilibrium is ever more than 5/25/25/2 times worse off than the worst-off player under the best allocation, regardless of the number of players. This contrasts with the asymmetric case, where the ratio grows like N\sqrt NN​ (Theorems 5 and 6 of the paper), and it fills the symmetric–maximum entry of the paper's Table 1. Together with the sum bounds it completes the picture of pure equilibria under linear latencies that later work on smoothness and robust price of anarchy (Roughgarden, Intrinsic robustness of the price of anarchy, STOC 2009) generalized.

The results are proved in the paper, which only displays the identity-latency case and states that the arguments extend to affine latencies. No machine-checked version of any of the paper's bounds is known to exist; the mission produces a formal proof of the affine statement, a checked construction for the lower bound (the paper verifies its Nash condition only partly), and a congestion-game layer shared with the rest of the series.

Difficulty

The obvious attempt bounds the worst player's cost by its deviation to its own optimal strategy only, as in the proof for the sum; that gives one inequality per player and loses the factor NNN needed to compare with MAX(P)\mathrm{MAX}(P)MAX(P). Without symmetry the factor cannot be recovered at all (Theorem 6 of the paper). For the lower bound, the difficulty is that the construction must be a Nash equilibrium against all strategies in the common set — including the other players' equilibrium strategies and the isolated strategy of the maximum-cost player — while the paper only writes out the deviation to the optimal strategies; its parameters are left as the solution of a linear equation, which must be chosen integral for every N≥3N\ge3N≥3.

Formalization scope

Players form a finite type (Fin N in the lower bound) and facilities a finite type; profiles are maps from players to Finsets of facilities, with feasibility Ai∈ΣiA_i\in\Sigma_iAi​∈Σi​ as a separate predicate IsProfile. Latencies are real-valued functions on natural-number loads; "linear" means affine with nonnegative coefficients. MAX is the maximum over a nonempty player set. Upper bounds are stated for every Nash equilibrium and every feasible profile, never dividing by the optimum. The lower bound asserts that PPP minimizes MAX over all profiles and that MAX(P)>0\mathrm{MAX}(P)>0MAX(P)>0: without positivity the equality would be satisfied by a game with all costs 000, and without symmetry or the full common strategy set the instance would not be the paper's. The lower bound gives PA≥5N+12N+2\mathrm{PA}\ge\frac{5N+1}{2N+2}PA≥2N+25N+1​ for the instance, which is what the paper's proof shows.

The development needs sums over facilities exchanged with sums over players (∑j∑e∈Pjg(e)=∑ene(P)g(e)\sum_j\sum_{e\in P_j}g(e)=\sum_e n_e(P)g(e)∑j​∑e∈Pj​​g(e)=∑e​ne​(P)g(e)), monotonicity of affine latencies, and an explicit finite instance. The congestion-game definitions are shared with the other missions of the series and will be merged with them; Lemma 1 and Theorem 1 are also milestones of mission I. Proofs of any milestone, and alternative constructions for Theorem 8, are welcome.

Selected references

  • G. Christodoulou and E. Koutsoupias, The price of anarchy of finite congestion games, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060600
  • B. Awerbuch, Y. Azar and A. Epstein, The price of routing unsplittable flow, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060599
  • E. Koutsoupias and C. Papadimitriou, Worst-case equilibria, STACS 1999, LNCS 1563. https://doi.org/10.1007/3-540-49116-3_38
  • R. W. Rosenthal, A class of games possessing pure-strategy Nash equilibria, International Journal of Game Theory 2, 1973. https://doi.org/10.1007/BF01737559
  • T. Roughgarden, Intrinsic robustness of the price of anarchy, Proc. 41st ACM STOC, 2009. https://doi.org/10.1145/1536414.1536430
9 thms3 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

The Price of Anarchy of Finite Congestion Games I: The Pure Price of Anarchy of the Average Social Cost Is 5/2Research Paper

Motivation

When many independent users share a resource whose cost grows with use (links of a network, servers, machines), each user chooses for itself, and the outcome is a Nash equilibrium rather than a socially optimal allocation. The price of anarchy, introduced by Koutsoupias and Papadimitriou (STACS 1999), measures the cost of this decentralisation: the worst ratio between the social cost of an equilibrium and the optimal social cost. It has become a standard yardstick in algorithmic game theory, network routing and the design of distributed protocols.

Christodoulou and Koutsoupias (STOC 2005) determined the price of anarchy of finite congestion games with linear latencies, the atomic, unweighted counterpart of selfish routing. This mission formalizes the central entry of their table: pure equilibria, general (asymmetric) strategy sets, and the average social cost.

Timeline:

  • 1973. Rosenthal defines congestion games and shows that they always have pure Nash equilibria (IJGT 2).
  • 1999. Koutsoupias and Papadimitriou define the price of anarchy, for load balancing on parallel links (STACS 1999).
  • 2002. Roughgarden and Tardos prove that the price of anarchy of non-atomic selfish routing with linear latencies is 4/34/34/3 (J. ACM 49).
  • 2005. Christodoulou and Koutsoupias prove that for finite (atomic) congestion games with linear latencies the pure price of anarchy of the average social cost is exactly 5/25/25/2; independently, Awerbuch, Azar and Epstein obtain 2.52.52.5 for unweighted and (3+5)/2≈2.618(3+\sqrt5)/2\approx2.618(3+5​)/2≈2.618 for weighted games (STOC 2005).
  • 2009. Roughgarden shows that this type of bound extends to mixed, correlated and coarse correlated equilibria (STOC 2009).

Setting

A congestion game has a finite set NNN of players, a finite set EEE of facilities, for every player iii a set Σi⊆2E\Sigma_i\subseteq 2^EΣi​⊆2E of pure strategies (each a set of facilities), and for every facility eee a latency function fef_efe​ giving the cost of eee to each of its users as a function of how many users it has. A pure strategy profile A=(A1,…,An)A=(A_1,\dots,A_n)A=(A1​,…,An​) picks Ai∈ΣiA_i\in\Sigma_iAi​∈Σi​ for each player. The load ne(A)n_e(A)ne​(A) is the number of players iii with e∈Aie\in A_ie∈Ai​, and player iii pays

ci(A)=∑e∈Aife(ne(A)).c_i(A)=\sum_{e\in A_i}f_e\bigl(n_e(A)\bigr).ci​(A)=e∈Ai​∑​fe​(ne​(A)).

The profile AAA is a pure Nash equilibrium if no player can lower its cost by switching alone: ci(A)≤ci(A−i,S)c_i(A)\le c_i(A_{-i},S)ci​(A)≤ci​(A−i​,S) for all iii and all S∈ΣiS\in\Sigma_iS∈Σi​, where (A−i,S)(A_{-i},S)(A−i​,S) replaces AiA_iAi​ by SSS. The social cost is SUM(A)=∑i∈Nci(A)\mathrm{SUM}(A)=\sum_{i\in N}c_i(A)SUM(A)=∑i∈N​ci​(A), which is ∣N∣|N|∣N∣ times the average cost of a player. Latencies are linear: fe(k)=aek+bef_e(k)=a_ek+b_efe​(k)=ae​k+be​ with ae,be≥0a_e,b_e\ge0ae​,be​≥0. The game is asymmetric in the sense that each player has its own strategy set (symmetric games, where all Σi\Sigma_iΣi​ coincide, are a special case).

The pure price of anarchy of the average social cost is

PA=sup⁡A NashSUM(A)opt,opt=min⁡PSUM(P),PA=\sup_{A\text{ Nash}}\frac{\mathrm{SUM}(A)}{\mathrm{opt}},\qquad \mathrm{opt}=\min_{P}\mathrm{SUM}(P),PA=A Nashsup​optSUM(A)​,opt=Pmin​SUM(P),

the minimum taken over pure strategy profiles. In Lean these objects are CongestionGame, load, cost, IsProfile, IsPureNash, sumCost and IsLinear in the namespace CongestionPoA.AsymSum.

Formalization targets

Goal: the pure price of anarchy is exactly 5/2

The goal theorem pure_poa_sum_eq_five_halves is the conjunction of Theorems 1 and 2 of the paper:

for every linear game, Nash A and profile P:SUM(A)≤52 SUM(P),\text{for every linear game, Nash } A \text{ and profile } P:\quad \mathrm{SUM}(A)\le\tfrac52\,\mathrm{SUM}(P),for every linear game, Nash A and profile P:SUM(A)≤25​SUM(P), for every N≥3 there are a linear game with N players, Nash A and profile P:SUM(A)=52 SUM(P).\text{for every } N\ge3 \text{ there are a linear game with } N \text{ players, Nash } A \text{ and profile } P:\quad \mathrm{SUM}(A)=\tfrac52\,\mathrm{SUM}(P).for every N≥3 there are a linear game with N players, Nash A and profile P:SUM(A)=25​SUM(P).

The first part is the upper bound; the second shows that it is attained for every number of players from three on.

Milestones

  1. Lemma 1: β(α+1)≤13α2+53β2\beta(\alpha+1)\le\frac13\alpha^2+\frac53\beta^2β(α+1)≤31​α2+35​β2 for nonnegative integers α,β\alpha,\betaα,β.
  2. Deviation inequality (proof of Theorem 1): at a Nash equilibrium AAA, ci(A)≤ci(A−i,Pi)≤∑e∈Pife(ne(A)+1)c_i(A)\le c_i(A_{-i},P_i)\le\sum_{e\in P_i}f_e(n_e(A)+1)ci​(A)≤ci​(A−i​,Pi​)≤∑e∈Pi​​fe​(ne​(A)+1).
  3. Summing over players (proof of Theorem 1): SUM(A)≤∑e∈Ene(P) fe(ne(A)+1)\mathrm{SUM}(A)\le\sum_{e\in E}n_e(P)\,f_e(n_e(A)+1)SUM(A)≤∑e∈E​ne​(P)fe​(ne​(A)+1).
  4. Theorem 1: the upper bound SUM(A)≤52SUM(P)\mathrm{SUM}(A)\le\frac52\mathrm{SUM}(P)SUM(A)≤25​SUM(P).
  5. Theorem 2: the matching instances for every N≥3N\ge3N≥3.

Significance

The value 5/25/25/2 is the benchmark for atomic congestion with affine costs. It is the reference point for the later results of the paper (the symmetric case (5N−2)/(2N+1)(5N-2)/(2N+1)(5N−2)/(2N+1), the maximum social cost Θ(N)\Theta(\sqrt N)Θ(N​), mixed equilibria (3+5)/2(3+\sqrt5)/2(3+5​)/2) and for a large literature on coordination mechanisms, taxes and the price of stability, which compare their guarantees against it. The bound is also the standard example of what later became the smoothness framework, through which the same constant governs mixed and coarse correlated equilibria and hence no-regret learning outcomes.

Both theorems are proved in the paper; nothing here is open. The proofs for affine latencies, however, are only indicated: the paper displays the identity case fe(k)=kf_e(k)=kfe​(k)=k and states that the arguments extend. The mission states the affine case and asks for complete machine-checked proofs, including the lower-bound construction, which the paper describes and declares "not hard to verify". No machine-checked proof of these results is on the platform.

Difficulty

The Nash conditions give one inequality per player, each mixing the equilibrium loads ne(A)n_e(A)ne​(A) with the strategies PiP_iPi​ of the comparison profile. Bounding the loads crudely, for instance by the number of players, gives a ratio that grows with NNN; the constant 5/25/25/2 requires comparing the cross term ∑ene(P) ne(A)\sum_e n_e(P)\,n_e(A)∑e​ne​(P)ne​(A) with both social costs simultaneously and with the right weights. The integrality of the loads matters at that point: the natural pointwise inequality is false for real arguments, so a proof that treats loads as real numbers cannot reach 5/25/25/2.

For the lower bound, a Nash equilibrium must be verified against every unilateral deviation of every player, for all N≥3N\ge3N≥3 at once, in a construction with cyclic indices. The case N=2N=2N=2 is genuinely different (the paper states that its price of anarchy is 222), so the argument has to use N≥3N\ge3N≥3.

Formalization scope

Players and facilities are finite types; a profile is a map from players to finite sets of facilities, and feasibility (Ai∈ΣiA_i\in\Sigma_iAi​∈Σi​) is a separate predicate. Latencies are real-valued functions of the natural-number load, and "linear" means affine with nonnegative coefficients. The upper bound is stated multiplicatively, for every Nash AAA and every feasible PPP, which is equivalent to PA≤5/2PA\le5/2PA≤5/2 and avoids dividing by opt\mathrm{opt}opt. The lower bound quantifies over players Fin N, N≥3N\ge3N≥3, and existentially over a finite facility type, a linear game, a Nash equilibrium and an optimal feasible profile of positive social cost. The positivity rules out the trivializing witness: in the all-zero latency game every profile is a Nash equilibrium and 0=52⋅00=\frac52\cdot00=25​⋅0. The Nash condition is the paper's cost form; it agrees with the payoff-form AGT.IsPureNash of agt_games for payoffs −ci-c_i−ci​.

Trivializing formalizations are ruled out: the comparison profile PPP must be feasible (otherwise SUM(P)\mathrm{SUM}(P)SUM(P) could be 000 by letting players use no facility), the upper bound covers all affine latencies rather than only fe(k)=kf_e(k)=kfe​(k)=k, and the lower-bound instance must have linear latencies with nonnegative coefficients.

A complete development needs finite double counting (regrouping ∑i∑e∈Pi\sum_i\sum_{e\in P_i}∑i​∑e∈Pi​​ by facilities), monotonicity of affine latencies, and a decidable or explicit check of the lower-bound game. The congestion-game layer is reused by the other missions of this series. Proofs of individual milestones, and alternative proofs of the upper bound, are welcome.

Selected references

  • G. Christodoulou and E. Koutsoupias, The Price of Anarchy of Finite Congestion Games, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060600
  • B. Awerbuch, Y. Azar and A. Epstein, The Price of Routing Unsplittable Flow, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060599
  • E. Koutsoupias and C. Papadimitriou, Worst-case Equilibria, STACS 1999, LNCS 1563. https://doi.org/10.1007/3-540-49116-3_38
  • R. W. Rosenthal, A Class of Games Possessing Pure-Strategy Nash Equilibria, International Journal of Game Theory 2, 1973. https://doi.org/10.1007/BF01737559
  • T. Roughgarden and É. Tardos, How Bad Is Selfish Routing?, Journal of the ACM 49(2), 2002. https://doi.org/10.1145/506147.506153
  • T. Roughgarden, Intrinsic Robustness of the Price of Anarchy, Proc. 41st ACM STOC, 2009. https://doi.org/10.1145/1536414.1536485
7 thms3 active usersReviewed
🏆Completed
Machine LearningMechanism Design·Captain: mikedeng1

How Much Data Is Sufficient to Learn High-Performing Algorithms? Generalization Guarantees for Data-Driven Algorithm Design 2: Neutral Affine Maximizers Have Pseudo-Dimension at Least ⌊n/2⌋Research Paper

Motivation

In data-driven algorithm design, an algorithm or mechanism comes with a vector of tunable parameters ρ\rhoρ, and the parameters are chosen by optimizing average performance over sample instances drawn from an unknown distribution. How many samples suffice for the empirical optimum to be near-optimal in expectation is governed by the pseudo-dimension of the class U={uρ}\mathcal U=\{u_\rho\}U={uρ​} of performance functions, where uρ(x)u_\rho(x)uρ​(x) is the performance of the parameter ρ\rhoρ on instance xxx. Balcan, DeBlasio, Dick, Kingsford, Sandholm and Vitercik (arXiv:1908.02894v4, 2021) give a general upper bound on Pdim(U)\mathrm{Pdim}(\mathcal U)Pdim(U) for classes whose dual functions are piecewise structured (their Theorem 3.3, the subject of mission 1 of this series), and apply it across integer programming, computational biology, clustering and mechanism design.

A general upper bound raises the question of whether it can be improved. Section 5 of the paper answers it for one application: neutral affine maximizers (NAMs), a family of voting mechanisms studied by Roberts (1979), Mishra and Sen (2012) and Nath and Sandholm (2019). For NAMs with nnn agents and mmm alternatives the general theorem gives Pdim(U)=O(nln⁡m)\mathrm{Pdim}(\mathcal U)=O(n\ln m)Pdim(U)=O(nlnm), and Theorem 5.2 shows a lower bound linear in nnn. So the sample complexity of tuning a NAM by sampling cannot be reduced below order nnn by a sharper analysis, and the general bound is tight up to logarithmic factors.

Setting

There are nnn agents and mmm alternatives. Agent iii has a value vi(j)∈Rv_i(j)\in\mathbb Rvi​(j)∈R for each alternative j∈[m]j\in[m]j∈[m]; a valuation profile is v=(v1,…,vn)∈Rnmv=(v_1,\dots,v_n)\in\mathbb R^{nm}v=(v1​,…,vn​)∈Rnm.

A NAM is specified by a weight vector ρ=(ρ[1],…,ρ[n])∈R≥0n\rho=(\rho[1],\dots,\rho[n])\in\mathbb R^n_{\ge0}ρ=(ρ[1],…,ρ[n])∈R≥0n​ in which at least one agent has weight zero; an agent with ρ[i]=0\rho[i]=0ρ[i]=0 is a sink agent. The NAM's outcome on a profile vvv is an alternative maximizing the weighted value,

ψρ(v)∈argmax⁡j∈[m] ∑i=1nρ[i] vi(j).\psi_\rho(v)\in\operatorname*{argmax}_{j\in[m]}\ \sum_{i=1}^n\rho[i]\,v_i(j).ψρ​(v)∈j∈[m]argmax​ i=1∑n​ρ[i]vi​(j).

Its utility is the social welfare of that outcome,

uρ(v)=∑i=1nvi(ψρ(v)),u_\rho(v)=\sum_{i=1}^n v_i\bigl(\psi_\rho(v)\bigr),uρ​(v)=i=1∑n​vi​(ψρ​(v)),

and the class studied is U={uρ∣ρ∈R≥0n, {i∣ρ[i]=0}≠∅}\mathcal U=\{u_\rho \mid \rho\in\mathbb R^n_{\ge0},\ \{i\mid\rho[i]=0\}\ne\emptyset\}U={uρ​∣ρ∈R≥0n​, {i∣ρ[i]=0}=∅}. NAMs also charge VCG-style payments that are redistributed to the sink agents; these do not enter uρu_\rhouρ​.

A class H\mathcal HH of real-valued functions on a set YYY shatters points y1,…,yNy_1,\dots,y_Ny1​,…,yN​ if there are thresholds z1,…,zN∈Rz_1,\dots,z_N\in\mathbb Rz1​,…,zN​∈R such that every pattern b∈{0,1}Nb\in\{0,1\}^Nb∈{0,1}N is realized by some h∈Hh\in\mathcal Hh∈H, in the sense that h(yℓ)>zℓh(y_\ell)>z_\ellh(yℓ​)>zℓ​ exactly when bℓ=1b_\ell=1bℓ​=1. The pseudo-dimension Pdim(H)\mathrm{Pdim}(\mathcal H)Pdim(H) is the largest NNN for which some NNN points are shattered. In Lean: a profile is v : Fin n → Fin m → ℝ, the outcome rule is ψ, the utility is welfare ψ ρ, the class is namClass ψ, and shattering is the published FoundationsML.Regression.Shatters.

Formalization targets

Goal: Theorem 5.2, corrected

For every n≥1n\ge1n≥1, every m≥2m\ge2m≥2 and every tie-breaking rule,

Pdim(U) ≥ ⌊n2⌋.\mathrm{Pdim}(\mathcal U)\ \ge\ \Bigl\lfloor\frac n2\Bigr\rfloor .Pdim(U) ≥ ⌊2n​⌋.

The printed statement reads Pdim(U)≥n/2\mathrm{Pdim}(\mathcal U)\ge n/2Pdim(U)≥n/2; see Formalization scope for why the floor is needed.

Milestones: the two claims of the proof (p. 24)

The proof fixes N=⌊n/2⌋N=\lfloor n/2\rfloorN=⌊n/2⌋ explicit profiles v(1),…,v(N)v^{(1)},\dots,v^{(N)}v(1),…,v(N) and, for each bit vector b∈{0,1}Nb\in\{0,1\}^Nb∈{0,1}N, an explicit weight vector ρ∈{0,1}n\rho\in\{0,1\}^nρ∈{0,1}n (both are definitions of this mission). The two milestones are the claims the proof makes about them: for every ℓ∈[N]\ell\in[N]ℓ∈[N] and ε∈(0,12)\varepsilon\in(0,\tfrac12)ε∈(0,21​),

bℓ=0 ⟹ uρ(v(ℓ))=ε,bℓ=1 ⟹ uρ(v(ℓ))=1.b_\ell=0\ \Longrightarrow\ u_\rho\bigl(v^{(\ell)}\bigr)=\varepsilon,\qquad b_\ell=1\ \Longrightarrow\ u_\rho\bigl(v^{(\ell)}\bigr)=1 .bℓ​=0 ⟹ uρ​(v(ℓ))=ε,bℓ​=1 ⟹ uρ​(v(ℓ))=1.

Significance

The result. Theorem 5.2 is the paper's evidence that its main upper bound cannot be improved in general by more than logarithmic factors: for NAMs the upper bound is O(nln⁡m)O(n\ln m)O(nlnm) and the lower bound is of order nnn. Through the standard link between pseudo-dimension and uniform convergence, it also means that any learner choosing NAM weights from samples needs a number of samples growing with the number of agents, whatever tie-breaking rule the mechanism uses.

Formalizing it. The theorem is proved in the paper; no machine-checked proof of it, or of any pseudo-dimension lower bound for a mechanism class, was found on Prove2Me. This mission produces a Lean model of NAM outcomes and welfare that does not fix a tie-breaking rule, an explicit lower-bound construction stated as definitions, and a pseudo-dimension lower bound in the vocabulary of the published FoundationsML pseudo-dimension items. It complements mission 1, which formalizes the matching upper-bound machinery.

Difficulty

The mathematical content is a single explicit construction, and the work lies in stating and verifying it at full generality rather than in a deep argument. Three points make the naive transcription wrong. First, the printed bound n/2n/2n/2 is false at n=1n=1n=1 and is not what the proof establishes for odd nnn; the even-nnn reduction must be replaced by a statement in ⌊n/2⌋\lfloor n/2\rfloor⌊n/2⌋. Second, the outcome ψρ(v)\psi_\rho(v)ψρ​(v) is defined by an argmax with unspecified tie-breaking, so the claims must hold for every maximizer; this requires showing the relevant maximizers are unique on the constructed profiles, not reading off a convenient one. Third, the construction embeds ⌊n/2⌋\lfloor n/2\rfloor⌊n/2⌋ indices into the nnn agents twice (as ℓ\ellℓ and ⌊n/2⌋+ℓ\lfloor n/2\rfloor+\ell⌊n/2⌋+ℓ), and the printed index condition for the second alternative is a typo; an off-by-one in this embedding silently breaks both claims. Finally, every constructed ρ\rhoρ must be admissible: it needs a sink agent, which holds only because N≥1N\ge1N≥1 or because nnn is odd and the last agent keeps weight 000.

Formalization scope

Representation. Agents are Fin n, alternatives Fin m, profiles Fin n → Fin m → ℝ, all 0-based: the paper's agent iii is i - 1, and its first and second alternatives are 0 and 1. Bits are Bool with true for 111. An outcome rule is any ψ : (Fin n → ℝ) → (Fin n → Fin m → ℝ) → Fin m with IsArgmaxSelector ψ, which requires ψ ρ v to maximize ∑ i, ρ i * v i j for every ρ and v; the theorem and both claims are stated for every such ψ. "Pdim(U)≥N\mathrm{Pdim}(\mathcal U)\ge NPdim(U)≥N" is the existence of an NNN-tuple of profiles shattered by namClass ψ in the sense of FoundationsML.Regression.Shatters, whose strict threshold t i < g (z i) shatters the same tuples as the paper's sign convention.

Corrections and readings of the printed text.

  1. The bound is ⌊n/2⌋\lfloor n/2\rfloor⌊n/2⌋ (natural-number division n / 2) instead of n/2n/2n/2. The proof assumes nnn even; at n=1n=1n=1 the only admissible ρ\rhoρ is 000, so U\mathcal UU is a single function and Pdim(U)=0<12\mathrm{Pdim}(\mathcal U)=0<\tfrac12Pdim(U)=0<21​.
  2. The hypotheses n≥1n\ge1n≥1 and m≥2m\ge2m≥2 are explicit. For n=0n=0n=0 no weight vector has a zero coordinate and U=∅\mathcal U=\emptysetU=∅; for m=1m=1m=1 the class is a single function. The proof takes m=2m=2m=2; the statement is for every m≥2m\ge2m≥2, with value 000 on every further alternative in the constructed profiles.
  3. The set-builder "{ρ[i]∣i=0}≠∅\{\rho[i]\mid i=0\}\ne\emptyset{ρ[i]∣i=0}=∅" in Theorem 5.2 is read as {i∣ρ[i]=0}≠∅\{i\mid\rho[i]=0\}\ne\emptyset{i∣ρ[i]=0}=∅, as written in Lemma 5.1.
  4. The construction's condition "ℓ=n/2+i\ell=n/2+iℓ=n/2+i" for vi(ℓ)(2)=εv_i^{(\ell)}(2)=\varepsilonvi(ℓ)​(2)=ε is read as i=n/2+ℓi=n/2+\elli=n/2+ℓ, as the paper's own n=6n=6n=6 example shows. The milestone texts are verbatim and keep the printed "vn/2+ℓ(ℓ)(1)v^{(\ell)}_{n/2+\ell}(1)vn/2+ℓ(ℓ)​(1)", which should read "(2)(2)(2)".

Ruled-out trivializations. Fixing one tie-breaking rule would state a special case and is excluded by quantifying over all argmax selectors. Dropping the sink-agent condition, or allowing n=0n=0n=0 or m=1m=1m=1, would change the class or make the statement vacuous or false; the conventions above exclude all three.

Infrastructure. Only Mathlib finite sums over Fin and the published Shatters definition are needed. The NAM model (IsNAMParam, IsArgmaxSelector, welfare, namClass) is reusable for any further statement about learning NAM parameters, including the matching O(nln⁡m)O(n\ln m)O(nlnm) upper bound once mission 1's general theorem is available. Proofs of the two claims, of the admissibility of the constructed weight vectors, and of the goal are all welcome.

Selected references

  • M.-F. Balcan, D. DeBlasio, T. Dick, C. Kingsford, T. Sandholm, E. Vitercik, How Much Data Is Sufficient to Learn High-Performing Algorithms? Generalization Guarantees for Data-Driven Algorithm Design, arXiv:1908.02894v4, 2021. https://arxiv.org/abs/1908.02894v4
  • K. Roberts, The characterization of implementable social choice rules, in J.-J. Laffont (ed.), Aggregation and Revelation of Preferences, North-Holland, 1979 (reference [86] of the paper).
  • D. Mishra, A. Sen, Roberts' theorem with neutrality: a social welfare ordering approach, Games and Economic Behavior 75(1):283–298, 2012 (reference [74] of the paper).
  • S. Nath, T. Sandholm, Efficiency and budget balance in general quasi-linear domains, Games and Economic Behavior 113:673–693, 2019 (reference [78] of the paper).
  • D. Pollard, Convergence of Stochastic Processes, Springer, 1984 (pseudo-dimension; reference [83] of the paper).
6 thms3 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Correlated Equilibrium as an Expression of Bayesian Rationality I: Bayes Rationality at Every State Yields Exactly the Correlated Equilibrium DistributionsResearch Paper

Motivation

Nash equilibrium is the standard solution concept for strategic games, but it is usually justified by appeal to what players "would" do once they somehow coordinate on a profile. Correlated equilibrium, introduced by Aumann (J. Math. Econ. 1, 1974), enlarges the set of outcomes by letting players condition their actions on correlated private signals. In Correlated Equilibrium as an Expression of Bayesian Rationality (Econometrica 55, 1987), Aumann gave the concept a decision-theoretic foundation: if the players share a common prior over the states of the world and each player maximizes expected utility given his information at every state, then what they play is a correlated equilibrium — and every correlated equilibrium arises this way. The result is a standard entry point to the epistemic foundations of game theory, and correlated equilibria are central in algorithmic game theory because no-swap-regret learning dynamics converge to them (Foster–Vohra 1997; Hart–Mas-Colell 2000).

Timeline:

  • 1974, Aumann: correlated equilibrium defined, in a measure-theoretic model with subjective probabilities and information σ-fields.
  • 1987, Aumann: the Main Theorem (Bayes rationality at every state under a common prior implies correlated equilibrium play) and its converse, in a finite model with information partitions.

Setting

A game GGG in strategic form has players iii, action sets SiS^iSi, action nnn-tuples s∈S=S1×⋯×Sns\in S=S^1\times\dots\times S^ns∈S=S1×⋯×Sn, and payoffs hi(s)∈Rh^i(s)\in\mathbb Rhi(s)∈R.

A correlated strategy nnn-tuple is a function f:Γ→Sf:\Gamma\to Sf:Γ→S on a finite probability space (Γ,q)(\Gamma,q)(Γ,q), with q≥0q\ge 0q≥0 and ∑γq(γ)=1\sum_\gamma q(\gamma)=1∑γ​q(γ)=1. Its expected payoff is Ehi(f)=∑γq(γ)hi(f(γ))Eh^i(f)=\sum_\gamma q(\gamma)h^i(f(\gamma))Ehi(f)=∑γ​q(γ)hi(f(γ)). For gi:Γ→Sig^i:\Gamma\to S^igi:Γ→Si, the profile (f−i,gi)(f^{-i},g^i)(f−i,gi) replaces player iii's coordinate of fff by gig^igi. The function fff is a correlated equilibrium (Definition 2.1) if

Ehi(f) ≥ Ehi(f−i,gi)(2.2)Eh^i(f)\ \ge\ Eh^i(f^{-i},g^i)\qquad(2.2)Ehi(f) ≥ Ehi(f−i,gi)(2.2)

for every player iii and every gig^igi that is a function of fif^ifi (i.e. gi=φ∘fig^i=\varphi\circ f^igi=φ∘fi). The distribution of fff assigns to each s∈Ss\in Ss∈S the number q{f−1(s)}q\{f^{-1}(s)\}q{f−1(s)}, and a correlated equilibrium distribution (c.e.d.) is the distribution of some correlated equilibrium.

An information system consists of a finite set Ω\OmegaΩ of states of the world, a common prior ppp on Ω\OmegaΩ, an information partition Pi\mathcal P^iPi of Ω\OmegaΩ for each player, and action functions si:Ω→Si\mathbf s^i:\Omega\to S^isi:Ω→Si with s=(s1,…,sn)\mathbf s=(\mathbf s^1,\dots,\mathbf s^n)s=(s1,…,sn), each si\mathbf s^isi constant on the elements of Pi\mathcal P^iPi (each player knows his own action). For a random variable xxx, E(x∣Pi)(ω)E(x\mid\mathcal P^i)(\omega)E(x∣Pi)(ω) is the ppp-average of xxx over the element of Pi\mathcal P^iPi containing ω\omegaω. Player iii is Bayes rational at ω\omegaω if

E(hi(s)∣Pi)(ω) ≥ E(hi(s−i,a)∣Pi)(ω)for every a∈Si.E\big(h^i(\mathbf s)\mid\mathcal P^i\big)(\omega)\ \ge\ E\big(h^i(\mathbf s^{-i},a)\mid\mathcal P^i\big)(\omega)\quad\text{for every }a\in S^i .E(hi(s)∣Pi)(ω) ≥ E(hi(s−i,a)∣Pi)(ω)for every a∈Si.

Formalization targets

Goal: Main Theorem with its converse

Q is a c.e.d. of G  ⟺  ∃ information system (Ω,p,(Pi),s): every player is Bayes rational at every state, and Q(a)=p{s=a} ∀a.Q\ \text{is a c.e.d. of }G\iff\exists\ \text{information system }(\Omega,p,(\mathcal P^i),\mathbf s):\ \text{every player is Bayes rational at every state, and } Q(a)=p\{\mathbf s=a\}\ \forall a.Q is a c.e.d. of G⟺∃ information system (Ω,p,(Pi),s): every player is Bayes rational at every state, and Q(a)=p{s=a} ∀a.

This is the two-sided statement the paper announces in its introduction (p. 2) and closes in Sect. 4d (p. 11): "under Bayesian rationality, the set of all information systems corresponds precisely to the set of all correlated equilibria."

Milestones

  1. Main Theorem, proof: summing the cell-wise inequalities over the partition, Ehi(s−i,gi)≤Ehi(s)Eh^i(\mathbf s^{-i},g^i)\le Eh^i(\mathbf s)Ehi(s−i,gi)≤Ehi(s) for gig^igi constant on the cells of Pi\mathcal P^iPi.
  2. Main Theorem, proof: s\mathbf ss itself is a correlated equilibrium on (Ω,p)(\Omega,p)(Ω,p).
  3. Main Theorem (p. 7): the distribution of s\mathbf ss is a c.e.d.
  4. Sect. 4d: in the system generated by fff (partitions generated by fif^ifi), Bayes rationality everywhere is equivalent to (2.2).
  5. Sect. 4d: every correlated equilibrium is realized by a Bayes-rational information system with the same distribution.

The mission also states, as a supporting lemma without a milestone, the cell-wise step of the proof of the Main Theorem: Bayes rationality at every state gives E(hi(s−i,gi)∣P)≤E(hi(s)∣P)E(h^i(\mathbf s^{-i},g^i)\mid P)\le E(h^i(\mathbf s)\mid P)E(hi(s−i,gi)∣P)≤E(hi(s)∣P) on every cell PPP for gig^igi constant on cells.

Significance

The theorem identifies correlated equilibrium as the outcome of individual Bayesian decision making under a common prior, without any assumption that players randomize or that their choices are independent. It shows that the Nash equilibrium's independence requirement is not implied by rationality alone, and it is the template for later epistemic characterizations of solution concepts. On the computational side, correlated equilibrium distributions form a polytope described by linear inequalities (the companion mission of this series), which is why they are the tractable equilibrium notion in algorithmic game theory.

The result is proved in the paper; it has no machine-checked formalization known to this mission. Formalizing it pins down the exact role of the standing assumptions — finiteness, a common prior, measurability of each player's action with respect to his own partition, rationality at every state — and of the conditional expectation on cells of probability zero. The definitions (information systems, Bayes rationality, correlated equilibria as functions on a finite probability space) are reusable for later formalizations of the paper's Sect. 5 (subjective correlated equilibrium) and of other epistemic results.

Difficulty

The mathematics is short; the difficulty lies in the bookkeeping that the paper's notation hides. The hypothesis is interim (a conditional inequality at each state), while Definition 2.1 is ex ante (an unconditional inequality). Passing between them requires the law of total expectation over a partition whose cells may have probability zero, where conditional expectations are undefined. Deviations in Definition 2.1 are functions of fif^ifi, not arbitrary maps, and must be shown constant on cells, which uses measurability of si\mathbf s^isi. A tempting first idea — that rationality against every fixed action already gives rationality against every deviation — fails without measurability: a player who does not know his own action could be rational at each state against constant deviations while a deviation φ∘si\varphi\circ\mathbf s^iφ∘si varies inside his cells. The converse direction needs an information system that satisfies every axiom of the goal's right-hand side, not just one that is Bayes rational.

Formalization scope

  • Players form a finite type ι with decidable equality; action sets S i are arbitrary types (the paper's finiteness of SiS^iSi is not used); payoffs are h : ι → (∀ i, S i) → ℝ.
  • Probability spaces are finite types with a real weight vector satisfying AGT.IsLottery (from the published definition agt_games). State spaces and the witnessing probability spaces of a c.e.d. range over Type; for finite sets this loses nothing.
  • Partitions are Setoids. The Common Prior Assumption is built into the information system, which has a single prior. Measurability of each action function is a field of the structure.
  • Conditional expectation on a cell is a ratio of finite sums; on a cell of probability zero Lean returns 000, so Bayes rationality at such states holds vacuously. The prior is not required to have full support. This matches the paper, whose argument multiplies each cell inequality by the cell's probability.
  • Deviations in Definition 2.1 are exactly the compositions φ∘fi\varphi\circ f^iφ∘fi; neither all maps nor only constant maps. A c.e.d. requires a genuine probability vector, ruling out the trivializing reading in which the zero weight function witnesses every QQQ.
  • Contributions welcome: proofs of the milestones, a general law-of-total-expectation lemma for finite partitions, and lemmas relating distr to sums over action profiles.

Selected references

  • R. J. Aumann, Correlated Equilibrium as an Expression of Bayesian Rationality, Econometrica 55 (1987), no. 1, 1–18. https://doi.org/10.2307/1911154
  • R. J. Aumann, Subjectivity and Correlation in Randomized Strategies, Journal of Mathematical Economics 1 (1974), 67–96. https://doi.org/10.1016/0304-4068(74)90037-8
  • D. P. Foster and R. V. Vohra, Calibrated Learning and Correlated Equilibrium, Games and Economic Behavior 21 (1997), 40–55. https://doi.org/10.1006/game.1997.0595
  • S. Hart and A. Mas-Colell, A Simple Adaptive Procedure Leading to Correlated Equilibrium, Econometrica 68 (2000), 1127–1150. https://doi.org/10.1111/1468-0262.00153
9 thms3 active usersReviewed
🏆Completed
Linear OptimizationMechanism DesignOperations Research+1·Captain: mikedeng1

An Introduction to the Theory of Mechanism Design VII: Crémer–McLean Full Surplus Extraction with Correlated TypesTextbook

Motivation

Bayesian mechanism design asks which collective decisions and payments a designer can implement when every agent holds private information, the type, drawn from a commonly known prior. Most of the classical theory (Myerson's optimal auction, the Myerson–Satterthwaite impossibility, the public goods results) assumes that types are independent. Once types are correlated, as they are when bidders' values share a common component, the theory changes in a way that is best read as a paradox: Crémer and McLean (Econometrica 1988) showed that a designer can then extract the entire surplus, leaving agents no information rents. This mission formalizes Chapter 6 of Börgers, An Introduction to the Theory of Mechanism Design (Oxford University Press 2015), which sets up Bayesian mechanism design in general, treats independent types, and proves the Crémer–McLean theorem, together with the one numbered result of Chapter 9, the impossibility theorem of Jehiel and Moldovanu for interdependent values.

Timeline of the results formalized here:

  • Rochet (1987) characterized implementable decision rules by cyclical monotonicity; Proposition 6.1 is its interim version for independent types.
  • Crémer and McLean (1988): under their condition on the prior, every direct mechanism can be made Bayesian incentive-compatible without changing its decision rule or interim payments (Proposition 6.4).
  • Krishna and Maenner (2001): revenue equivalence for convex type sets and convex utilities (Proposition 6.2).
  • Jehiel and Moldovanu (2001): with interdependent values, efficient decisions are generically not Bayesian implementable (Proposition 9.1).
  • Kosenok and Severinov (2008): an identifiability condition added to Crémer–McLean gives ex post budget balance as well (Proposition 6.6).

Setting

There are finitely many agents i∈Ii \in Ii∈I and a set AAA of alternatives. Agent iii has a type θi∈Θi\theta_i \in \Theta_iθi​∈Θi​ and utility ui(a,θi)−tiu_i(a,\theta_i) - t_iui​(a,θi​)−ti​ from alternative aaa and payment tit_iti​. Types θ=(θ1,…,θN)∈Θ=∏iΘi\theta = (\theta_1,\dots,\theta_N) \in \Theta = \prod_i \Theta_iθ=(θ1​,…,θN​)∈Θ=∏i​Θi​ are drawn from a common prior μ\muμ; μ(⋅∣θi)\mu(\cdot\mid\theta_i)μ(⋅∣θi​) is the conditional distribution of the others' types θ−i\theta_{-i}θ−i​ given θi\theta_iθi​. Types are independent if μ(⋅∣θi)\mu(\cdot\mid\theta_i)μ(⋅∣θi​) does not depend on θi\theta_iθi​.

A direct mechanism (q,t1,…,tN)(q, t_1,\dots,t_N)(q,t1​,…,tN​) is a decision rule q:Θ→Aq:\Theta\to Aq:Θ→A and payment rules ti:Θ→Rt_i:\Theta\to\mathbb Rti​:Θ→R. It is Bayesian incentive-compatible (BIC) if for every iii and all θi,θi′\theta_i,\theta_i'θi​,θi′​,

∫Θ−iui(q(θi,θ−i),θi)−ti(θi,θ−i) dμ(θ−i∣θi) ≥ ∫Θ−iui(q(θi′,θ−i),θi)−ti(θi′,θ−i) dμ(θ−i∣θi).\int_{\Theta_{-i}} u_i(q(\theta_i,\theta_{-i}),\theta_i) - t_i(\theta_i,\theta_{-i})\,d\mu(\theta_{-i}\mid\theta_i) \ \ge\ \int_{\Theta_{-i}} u_i(q(\theta_i',\theta_{-i}),\theta_i) - t_i(\theta_i',\theta_{-i})\,d\mu(\theta_{-i}\mid\theta_i).∫Θ−i​​ui​(q(θi​,θ−i​),θi​)−ti​(θi​,θ−i​)dμ(θ−i​∣θi​) ≥ ∫Θ−i​​ui​(q(θi′​,θ−i​),θi​)−ti​(θi′​,θ−i​)dμ(θ−i​∣θi​).

The interim decision rule Qi(θi)Q_i(\theta_i)Qi​(θi​) is the distribution of q(θi,θ−i)q(\theta_i,\theta_{-i})q(θi​,θ−i​) given θi\theta_iθi​, and the interim expected payment is Ti(θi)=∫ti(θi,θ−i) dμ(θ−i∣θi)T_i(\theta_i) = \int t_i(\theta_i,\theta_{-i})\,d\mu(\theta_{-i}\mid\theta_i)Ti​(θi​)=∫ti​(θi​,θ−i​)dμ(θ−i​∣θi​). A mechanism is ex post budget balanced if ∑iti(θ)=0\sum_i t_i(\theta) = 0∑i​ti​(θ)=0 for every θ\thetaθ, and ex ante budget balanced if ∫Θ∑iti dμ=0\int_\Theta \sum_i t_i\,d\mu = 0∫Θ​∑i​ti​dμ=0.

In §6.4 every Θi\Theta_iΘi​ is finite and μ(θ)>0\mu(\theta) > 0μ(θ)>0 for every θ\thetaθ. The prior satisfies the Crémer–McLean condition if for no agent iii and type θi\theta_iθi​ there are weights λ≥0\lambda \ge 0λ≥0 on Θi∖{θi}\Theta_i\setminus\{\theta_i\}Θi​∖{θi​} with

μ(θ−i∣θi)=∑θi′≠θiλ(θi′) μ(θ−i∣θi′)for all θ−i.\mu(\theta_{-i}\mid\theta_i) = \sum_{\theta_i'\ne\theta_i}\lambda(\theta_i')\,\mu(\theta_{-i}\mid\theta_i')\quad\text{for all }\theta_{-i}.μ(θ−i​∣θi​)=θi′​=θi​∑​λ(θi′​)μ(θ−i​∣θi′​)for all θ−i​.

Identifiability requires that for every full-support distribution ν≠μ\nu\ne\muν=μ some agent's type θi\theta_iθi​ has a belief ν(⋅∣θi)\nu(\cdot\mid\theta_i)ν(⋅∣θi​) that is not a nonnegative combination of the beliefs μ(⋅∣θi′)\mu(\cdot\mid\theta_i')μ(⋅∣θi′​).

Formalization targets

Goal: Crémer–McLean (Proposition 6.4)

If μ\muμ satisfies the Crémer–McLean condition, then for every direct mechanism (q,t)(q,t)(q,t) there is a BIC direct mechanism (q,t′)(q,t')(q,t′) with

∑θ−iti(θi,θ−i) μ(θ−i∣θi)=∑θ−iti′(θi,θ−i) μ(θ−i∣θi)for all i,θi.\sum_{\theta_{-i}} t_i(\theta_i,\theta_{-i})\,\mu(\theta_{-i}\mid\theta_i) = \sum_{\theta_{-i}} t_i'(\theta_i,\theta_{-i})\,\mu(\theta_{-i}\mid\theta_i)\quad\text{for all } i,\theta_i.θ−i​∑​ti​(θi​,θ−i​)μ(θ−i​∣θi​)=θ−i​∑​ti′​(θi​,θ−i​)μ(θ−i​∣θi​)for all i,θi​.

Milestones

  1. Proposition 6.1 (independent types): qqq is part of a BIC mechanism iff it is interim cyclically monotone, ∑κ=1k−1(∫Aui(a,θiκ+1) dQi(θiκ)−∫Aui(a,θiκ) dQi(θiκ))≤0\sum_{\kappa=1}^{k-1}\big(\int_A u_i(a,\theta_i^{\kappa+1})\,dQ_i(\theta_i^\kappa) - \int_A u_i(a,\theta_i^\kappa)\,dQ_i(\theta_i^\kappa)\big)\le 0∑κ=1k−1​(∫A​ui​(a,θiκ+1​)dQi​(θiκ​)−∫A​ui​(a,θiκ​)dQi​(θiκ​))≤0 for every cycle θik=θi1\theta_i^k = \theta_i^1θik​=θi1​.
  2. Proposition 6.2 (independent types, convex type sets, convex utilities): two BIC mechanisms with Qi′=QiQ_i' = Q_iQi′​=Qi​ have Ti′=Ti+τiT_i' = T_i + \tau_iTi′​=Ti​+τi​.
  3. Proposition 6.3 (independent types): every ex ante budget balanced mechanism has an equivalent ex post budget balanced one.
  4. Proposition 6.5 (Farkas's alternative), already proved on the platform as Polyhedral.farkas_lemma.
  5. Proposition 6.6 (Kosenok–Severinov): under Crémer–McLean and identifiability, every ex ante budget balanced mechanism has an equivalent BIC and ex post budget balanced one.
  6. Proposition 9.1 (Jehiel–Moldovanu): in the linear interdependent-values model, under a regularity condition on first best rules and the weight condition αaii/αbii≠∑jαaji/∑jαbji\alpha^i_{ai}/\alpha^i_{bi}\ne\sum_j\alpha^i_{aj}/\sum_j\alpha^i_{bj}αaii​/αbii​=∑j​αaji​/∑j​αbji​ for some i,a,bi,a,bi,a,b, no first best direct mechanism is BIC. It uses its own model (§9.3) and is not on the goal's proof path.

Significance

The Crémer–McLean theorem says that, with correlated finite types, incentive compatibility imposes essentially no constraint: every decision rule and every interim payment rule can be implemented. In a single-unit auction this gives full surplus extraction. The result is the benchmark against which the literature on risk aversion, limited liability, collusion and the genericity of priors (Robert 1991, Laffont–Martimort 2000, Heifetz–Neeman 2006) measures its departures, and Proposition 6.6 extends it to budget-balanced mechanisms, which is what bilateral trade and public goods applications need. Propositions 6.1–6.3 are the independent-types counterpart that the correlated case breaks: they show why revenue equivalence and the ex ante/ex post budget-balance equivalence hold there and fail here. Proposition 9.1 shows the opposite failure, for interdependent values, where efficient decisions cannot be implemented even without participation or budget constraints.

All results are proved in the literature (Kosenok–Severinov's proof is omitted in the book). Apart from Farkas's alternative (Proposition 6.5), which is proved on the platform, none of them is formalized in Mathlib or on the platform; the platform's other mechanism design results (dominant-strategy results in a valuation model, revenue equivalence for symmetric independent auctions) do not cover correlated types.

Difficulty

For the goal the difficulty is the uniformity of the construction: a single payment adjustment must make truth-telling optimal against every possible deviation of every type of every agent, while leaving each type's expected payment unchanged. The obvious scoring-rule adjustment, charging −ln⁡μ(θ−i∣θi′)-\ln\mu(\theta_{-i}\mid\theta_i')−lnμ(θ−i​∣θi′​), changes interim payments, and removing that change is where the Crémer–McLean condition enters. For Proposition 6.2 the envelope argument must handle convex type sets that are not open and utilities that are only convex, not differentiable. For Proposition 9.1 the obvious argument differentiates interim utility twice; the proposition does not assume that interim utility is twice differentiable, so that regularity has to be derived from the hypotheses on the interim probabilities.

Formalization scope

Three definition files carry the three models. Independent types (§6.2–6.3): type sets are arbitrary measurable spaces, the prior is the product of probability measures ρi\rho_iρi​, and interim quantities are integrals against it. Finite correlated types (§6.4): finite type sets, a prior μ:Θ→R\mu:\Theta\to\mathbb Rμ:Θ→R with μ(θ)>0\mu(\theta)>0μ(θ)>0 and ∑θμ(θ)=1\sum_\theta\mu(\theta)=1∑θ​μ(θ)=1, and conditional beliefs μ(θ−i∣θi)=μ(θ)/μ(θi)\mu(\theta_{-i}\mid\theta_i) = \mu(\theta)/\mu(\theta_i)μ(θ−i​∣θi​)=μ(θ)/μ(θi​); the alternative set AAA is arbitrary. Interdependent values (§9.3): finite AAA, signals in [0,1]A[0,1]^A[0,1]A with positive densities, independent across agents, linear utilities with nonzero weights αaij\alpha^j_{ai}αaij​.

Committed conventions and explicit formulas:

  • The Crémer–McLean condition uses nonnegative weights without a sum-to-one constraint, as Definition 6.7 prints it.
  • "Equivalent" in Propositions 6.4 and 6.6 means the same decision rule and the same interim expected payments at truthful reports, as Proposition 6.4 states; in Proposition 6.3 it is the report-by-report notion, which under independence is equality of the interim payment rules TiT_iTi​.
  • Proposition 6.2 adds continuity of ui(a,⋅)u_i(a,\cdot)ui​(a,⋅) on Θi\Theta_iΘi​, and Proposition 6.3 adds at least two agents; without them the printed statements are false.
  • Measurability, which the book omits throughout, is made explicit: decision rules are measurable, and the payment sections and utilities are integrable against the relevant interim distributions.
  • In Proposition 9.1 the partial derivatives are derivatives within the closed cube [0,1]K[0,1]^K[0,1]K, and the weight condition is the displayed ratio inequality.

A trivializing formalization of the goal, one that proves it only for mechanisms that are already incentive compatible, or with a payment rule that is not a function of the reported type profile, or with "equivalent" weakened to "some BIC mechanism exists", is ruled out: the statement quantifies over every direct mechanism and fixes both the decision rule and every interim payment.

Reusable infrastructure: finite conditional expectations under a full-support prior, the Crémer–McLean and identifiability conditions, and the interim model with product priors. Proofs of any milestone and of the goal, including via the Farkas reference, are welcome.

Selected references

  • T. Börgers, An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015. https://doi.org/10.1093/acprof:oso/9780199734023.001.0001
  • J. Crémer and R. P. McLean, "Full extraction of the surplus in Bayesian and dominant strategy auctions", Econometrica 56(6), 1988. https://doi.org/10.2307/1913096
  • G. Kosenok and S. Severinov, "Individually rational, budget-balanced mechanisms and allocation of surplus", Journal of Economic Theory 140(1), 2008.
  • P. Jehiel and B. Moldovanu, "Efficient design with interdependent valuations", Econometrica 69(5), 2001. https://doi.org/10.1111/1468-0262.00237
  • V. Krishna and E. Maenner, "Convex potentials with an application to mechanism design", Econometrica 69(4), 2001. https://doi.org/10.1111/1468-0262.00225
  • J.-C. Rochet, "A necessary and sufficient condition for rationalizability in a quasi-linear context", Journal of Mathematical Economics 16(2), 1987. https://doi.org/10.1016/0304-4068(87)90007-3
10 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization·Captain: mikedeng1

Bellman's Dynamic Programming VIII: Multi-Stage Games, Games of Survival and the Extended Min-Max TheoremTextbook

Why multi-stage games

Chapter X of Richard Bellman's Dynamic Programming (Princeton University Press, 1957; Princeton Landmarks edition 2010, DOI 10.2307/j.ctv1nxcw0f) carries the functional-equation method of the earlier chapters from one-player decision processes to two-player zero-sum games that are played over many stages. At each stage the two players make simultaneous choices, and those choices change the state in which the next stage is played. Games of survival are the standard example. They generalize the gambler's ruin: two players with finite resources play until one of them is ruined. The same framework is the discrete-time form of what Shapley (1953) called stochastic games. It underlies pursuit games, attrition models and the later theory of dynamic games in operations research and economics.

The chapter builds on von Neumann's min-max theorem (1928), which Bellman assumes without proof (§ 3, Eq. (3.4)). It proves three kinds of result: existence and uniqueness for the general multi-stage game equation (§§ 11–16), existence and uniqueness for games of survival with integer payoffs (§ 19), and an extended min-max theorem for ratios of bilinear forms (§ 23). Bellman proposes the ratio as a criterion for non-zero-sum games.

Setting

A matrix game is given by a real M×NM\times NM×N matrix A=(aij)A=(a_{ij})A=(aij​). Player AAA chooses row iii with probability pip_ipi​ and player BBB chooses column jjj with probability qjq_jqj​; ppp and qqq are distribution vectors (points of the standard simplex). The expected return to AAA is

EA(p,q)=∑i,jaij pi qj.E_A(p,q)=\sum_{i,j}a_{ij}\,p_i\,q_j .EA​(p,q)=i,j∑​aij​pi​qj​.

The game has value vvv when max⁡pmin⁡qEA=v=min⁡qmax⁡pEA\max_p\min_q E_A=v=\min_q\max_p E_Amaxp​minq​EA​=v=minq​maxp​EA​, all extrema attained. In the Lean development this is IsMaxMinMinMaxValue, and the bilinear form is bilin.

In the general multi-stage game (§ 12) the state is a pair of vectors P∈D⊆RnP\in D\subseteq\mathbb R^nP∈D⊆Rn, P′∈D′⊆Rn′P'\in D'\subseteq\mathbb R^{n'}P′∈D′⊆Rn′ with norms ∥P∥=∑i∣Pi∣\|P\|=\sum_i|P_i|∥P∥=∑i​∣Pi​∣. In state (P,P′)(P,P')(P,P′), AAA chooses uuu in a choice domain S(P,P′)S(P,P')S(P,P′) and BBB chooses vvv in S′(P,P′)S'(P,P')S′(P,P′). AAA receives R(u,v)R(u,v)R(u,v), and play continues from the state T(P,P′;u,v)T(P,P';u,v)T(P,P′;u,v), T′(P,P′;u,v)T'(P,P';u,v)T′(P,P′;u,v) with weight h(P,P′;u,v)h(P,P';u,v)h(P,P′;u,v). Mixed strategies GGG, G′G'G′ are probability measures on the choice domains. The multi-stage game equation is

f(P,P′)=max⁡Gmin⁡G′∬[R(u,v)+h(P,P′;u,v) f(T,T′)] dG(u) dG′(v)=min⁡G′max⁡G[ ⋯ ].f(P,P')=\max_G\min_{G'}\iint\big[R(u,v)+h(P,P';u,v)\,f(T,T')\big]\,dG(u)\,dG'(v)=\min_{G'}\max_G[\ \cdots\ ].f(P,P′)=Gmax​G′min​∬[R(u,v)+h(P,P′;u,v)f(T,T′)]dG(u)dG′(v)=G′min​Gmax​[ ⋯ ].

A game of survival with integer payoffs (§ 19) has one integer state xxx, the resources of AAA out of a fixed total ddd. AAA is ruined at x≤0x\le0x≤0 and wins at x≥dx\ge dx≥d. At each stage the players play the 2×22\times22×2 game with matrix (−1ac−b)\begin{pmatrix}-1&a\\c&-b\end{pmatrix}(−1c​a−b​), whose entries are the transfers to AAA.

Formalization targets

Goal: the extended min-max theorem (Chapter X, Theorem 7)

For real matrices A=(aij)A=(a_{ij})A=(aij​), B=(bij)B=(b_{ij})B=(bij​) with ∑i,jbijpiqj≥d>0\sum_{i,j}b_{ij}p_iq_j\ge d>0∑i,j​bij​pi​qj​≥d>0 for all distribution vectors p,qp,qp,q,

max⁡pmin⁡q∑i,jaijpiqj∑i,jbijpiqj=min⁡qmax⁡p∑i,jaijpiqj∑i,jbijpiqj.\max_p\min_q\frac{\sum_{i,j}a_{ij}p_iq_j}{\sum_{i,j}b_{ij}p_iq_j}=\min_q\max_p\frac{\sum_{i,j}a_{ij}p_iq_j}{\sum_{i,j}b_{ij}p_iq_j}.pmax​qmin​∑i,j​bij​pi​qj​∑i,j​aij​pi​qj​​=qmin​pmax​∑i,j​bij​pi​qj​∑i,j​aij​pi​qj​​.

It is the chapter's final result, and its statement involves only finite matrices.

Milestones

  1. Eq. (3.4), von Neumann's theorem VA=VBV_A=V_BVA​=VB​. It is already on the platform as AGT.zero_sum_minimax (existence of a saddle point) and enters as a reference.
  2. Lemma 1: the value of a one-stage game moves by at most the largest change of its kernel, ∣L(f)−L1(F)∣≤max⁡u,v [ ∣R−R1∣+∣h∣ ∣f(T,T′)−F(T,T′)∣ ]|L(f)-L_1(F)|\le\max_{u,v}\,[\,|R-R_1|+|h|\,|f(T,T')-F(T,T')|\,]∣L(f)−L1​(F)∣≤maxu,v​[∣R−R1​∣+∣h∣∣f(T,T′)−F(T,T′)∣].
  3. Theorem 1: under hypotheses (4a)–(4e), the multi-stage game equation has a unique solution among functions continuous on D×D′D\times D'D×D′ that vanish at the origin, and it is the uniform limit on bounded regions of the successive approximations.
  4. Theorem 3: the successive approximations converge from any admissible initial function.
  5. Theorem 4: stability, ∣f(P,P′)−F(P,P′)∣≤∑n≥0Δ(knc)|f(P,P')-F(P,P')|\le\sum_{n\ge0}\Delta(k^nc)∣f(P,P′)−F(P,P′)∣≤∑n≥0​Δ(knc).
  6. Theorem 5: the game of survival equation with boundary values 000 and 111 has a unique solution with values in [0,1][0,1][0,1].

Significance

Theorem 7 gives a value for ratio games, the games in which a player maximizes a return per unit of a resource consumed. Bellman uses it to give a rationale for the play of non-zero-sum games (§ 24) and to derive the approximate equation (22.4) for non-zero-sum games of survival. Chapter XI, Theorem 5 generalizes it to Markovian decision processes. Theorem 1 is the existence and uniqueness result that justifies replacing an infinite game by its functional equation, and Theorems 3 and 4 make that equation usable for computation and perturbation. Theorem 5 is an early uniqueness theorem for a discrete stochastic game with absorbing boundaries.

None of these statements is formalized on the platform. Von Neumann's theorem is (AGT.zero_sum_minimax, and Sion's theorem as FamousTheorems.sion_minimax_theorem). Theorem 7 is a classical result: with a positive denominator the ratio is quasiconcave in ppp and quasiconvex in qqq. This mission asks for a machine-checked proof of the book's statement, by Bellman's route or by any other. Theorems 1, 3 and 4 need a formal theory of games whose mixed strategies are probability measures on moving compact choice domains. No such theory is on the platform yet.

Difficulty

The ratio in Theorem 7 is not bilinear, and in general it is neither concave in ppp nor convex in qqq, so neither von Neumann's theorem nor a concave-convex min-max theorem applies to it directly. For Theorem 1, the contraction argument needs each one-stage game to have a value and the value to depend continuously on the state. That requires a min-max theorem for continuous games on compact sets, together with continuity of the value when the choice domains move. In Theorem 5, existence follows from monotone iteration. The uniqueness step is the hard part: the operator is not a contraction in the sup norm, and a second solution must be ruled out even at states where the optimal mixed strategies are degenerate.

Formalization scope

  • Distribution vectors are points of stdSimplex ℝ ι for nonempty finite types. "Max-min equals min-max" always asserts attainment (IsGreatest/IsLeast) and never uses sSup/sInf, which return 000 on empty or unbounded sets. Theorem 7 must not assume a saddle point; its only hypothesis is the bound on the denominator.
  • States are Fin n → ℝ with the ℓ1\ell^1ℓ1 norm of Eq. (12.1). Choice domains are nonempty compact sets (NonemptyCompacts), and mixed strategies are probability measures of full mass on them. "Vary continuously" in (4b), which the book does not define, is read as continuity in Mathlib's topology on nonempty compact sets (for a metric space, the topology of the Hausdorff distance).
  • The maxima w(c)w(c)w(c) of (4d) and Δ(c)\Delta(c)Δ(c) of Theorem 4 are expressed through majorants, which is equivalent to the book's condition. k≥0k\ge0k≥0 is stated explicitly. In Lemma 1 the kernels are assumed measurable and bounded on S×S′S\times S'S×S′ so that the integrals exist, and each game having a value is a hypothesis, as in Bellman's footnote 4.
  • Theorem 3's "converges" is stated as uniform convergence on bounded regions, the mode of Theorem 1, whose proof Theorem 3 repeats. Theorem 4's unspecified ccc is any c≥∥P∥+∥P′∥c\ge\|P\|+\|P'\|c≥∥P∥+∥P′∥. The book's p. 301 prints the first min-max of Theorem 4 with the subscripts GGG, G′G'G′ interchanged; the equation used is that of Theorem 1.
  • Theorem 5 adds the implicit d≥1d\ge1d≥1: for d≤0d\le0d≤0 the boundary conditions contradict each other. The state is an integer and f:Z→Rf:\mathbb Z\to\mathbb Rf:Z→R.
  • Taking the choice domains constant would trivialize Theorem 1: condition (4d) would then force R≡0R\equiv0R≡0 on them. The choice domains therefore depend on the state.
  • Not included: Theorem 2 (optimal strategies of the infinite game, which needs a model of the game's plays), Theorem 6 (non-zero-sum survival; the boundary conditions (21.3) do not cover all states, see the moderation notes).

Contributions of reusable infrastructure are welcome: the min-max theorem for continuous games on compact sets (Eq. (4.2)), continuity of the value in the choice domains, and value iteration for contracting game operators.

Selected references

  • R. Bellman, Dynamic Programming, Princeton University Press, 1957; Princeton Landmarks in Mathematics, 2010. DOI 10.2307/j.ctv1nxcw0f
  • J. von Neumann, Zur Theorie der Gesellschaftsspiele, Mathematische Annalen 100, 1928. DOI 10.1007/BF01448847
  • L. S. Shapley, Stochastic games, Proceedings of the National Academy of Sciences 39, 1953. DOI 10.1073/pnas.39.10.1095
  • M. Sion, On general minimax theorems, Pacific Journal of Mathematics 8, 1958. DOI 10.2140/pjm.1958.8.171
  • I. L. Glicksberg, A further generalization of the Kakutani fixed point theorem, with application to Nash equilibrium points, Proceedings of the AMS 3, 1952. DOI 10.1090/S0002-9939-1952-0046638-5
9 thms3 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

Theory of Games and Economic Behavior II: Games with Perfect Information Are Strictly DeterminedTextbook

Motivation

Chess, checkers, Go and Backgammon share a feature that card games such as Poker lack: whenever a player moves, the player knows everything that has happened so far. von Neumann and Morgenstern call this perfect information and devote §15 of Theory of Games and Economic Behavior (1944; 3rd ed. 1953) to it. Their result is that such a game, viewed as a zero-sum two-person game, is strictly determined: it has a value that each player can secure with a pure strategy, without any randomization. For Chess this means that exactly one of three statements is true: White can force a win, Black can force a win, or both can force at least a draw ((15:D:a)–(15:D:c)).

Timeline. Zermelo (1913, Über eine Anwendung der Mengenlehre auf die Theorie des Schachspiels) showed for Chess that either one side can force a win or both can avoid losing; his argument is not phrased in terms of strategies and a value, and was later corrected and completed by König (1927) and Kalmár (1928/29). von Neumann and Morgenstern (1944, §15) proved strict determinateness for every finite zero-sum two-person game with perfect information, including chance moves (15.7.1), and gave the explicit formula (15:12) for the value. Kuhn (1953, Extensive games and the problem of information, Annals of Mathematics Studies 28) recast games in tree form and extended the pure-strategy existence result to general-sum games with perfect information (subgame-perfect equilibria by backward induction).

Setting

A game tree Γ\GammaΓ is a finite rooted tree. Each leaf is a finished play π\piπ and carries the payoff F1(π)∈R\mathfrak F_1(\pi) \in \mathbb RF1​(π)∈R to player 1; player 2 receives −F1(π)-\mathfrak F_1(\pi)−F1​(π). Each internal node is a move M\mathfrak MM of one of three kinds kkk, with alternatives σ=1,…,α\sigma = 1, \dots, \alphaσ=1,…,α leading to subtrees Γσ\Gamma_\sigmaΓσ​:

  • k=0k = 0k=0, a chance move, where alternative σ\sigmaσ occurs with probability p(σ)≧0p(\sigma) \geqq 0p(σ)≧0, ∑σp(σ)=1\sum_\sigma p(\sigma) = 1∑σ​p(σ)=1;
  • k=1k = 1k=1, a personal move of player 1, with α≧1\alpha \geqq 1α≧1;
  • k=2k = 2k=2, a personal move of player 2, with α≧1\alpha \geqq 1α≧1.

A pure strategy τ1\tau_1τ1​ of player 1 is a complete plan choosing an alternative at every node of kind 1; τ2\tau_2τ2​ does the same at every node of kind 2. The normalized form H(τ1,τ2)\mathcal H(\tau_1, \tau_2)H(τ1​,τ2​) is the expected payoff to player 1, the expectation being over the chance moves. With the maxima and minima taken over the finitely many pure strategies,

v1=Max⁡τ1Min⁡τ2H(τ1,τ2),v2=Min⁡τ2Max⁡τ1H(τ1,τ2).v_1 = \operatorname{Max}_{\tau_1} \operatorname{Min}_{\tau_2} \mathcal H(\tau_1, \tau_2), \qquad v_2 = \operatorname{Min}_{\tau_2} \operatorname{Max}_{\tau_1} \mathcal H(\tau_1, \tau_2).v1​=Maxτ1​​Minτ2​​H(τ1​,τ2​),v2​=Minτ2​​Maxτ1​​H(τ1​,τ2​).

Always v1≦v2v_1 \leqq v_2v1​≦v2​; the game is strictly determined when v1=v2v_1 = v_2v1​=v2​ (14.4.2).

For a function f(σ1)f(\sigma_1)f(σ1​) of the alternatives of the first move M1\mathfrak M_1M1​, of kind k1k_1k1​, the operation Mσ1k1M^{k_1}_{\sigma_1}Mσ1​k1​​ of (15:8) is ∑σ1p1(σ1)f(σ1)\sum_{\sigma_1} p_1(\sigma_1) f(\sigma_1)∑σ1​​p1​(σ1​)f(σ1​), Max⁡σ1f(σ1)\operatorname{Max}_{\sigma_1} f(\sigma_1)Maxσ1​​f(σ1​) or Min⁡σ1f(σ1)\operatorname{Min}_{\sigma_1} f(\sigma_1)Minσ1​​f(σ1​) for k1=0,1,2k_1 = 0, 1, 2k1​=0,1,2. Applying these operations from the leaves back to the root gives the backward-induction value v(Γ)v(\Gamma)v(Γ).

Formalization targets

Goal: 15.6.1 with (15:12)

For every finite game tree Γ\GammaΓ,

v1=v2=v=Mσ1k1Mσ2k2(σ1)⋯Mσνkν(σ1,…,σν−1)F1(π(σ1,…,σν)).v_1 = v_2 = v = M^{k_1}_{\sigma_1} M^{k_2(\sigma_1)}_{\sigma_2} \cdots M^{k_\nu(\sigma_1, \dots, \sigma_{\nu-1})}_{\sigma_\nu} \mathfrak F_1(\pi(\sigma_1, \dots, \sigma_\nu)).v1​=v2​=v=Mσ1​k1​​Mσ2​k2​(σ1​)​⋯Mσν​kν​(σ1​,…,σν−1​)​F1​(π(σ1​,…,σν​)).

Both the equality v1=v2v_1 = v_2v1​=v2​ and the value formula are part of the goal.

Milestones

  • (13:E): for finite nonempty domains and fff ranging over all functions of xxx, Max⁡xMin⁡fψ(x,f(x))=Min⁡fMax⁡xψ(x,f(x))\operatorname{Max}_x \operatorname{Min}_f \psi(x, f(x)) = \operatorname{Min}_f \operatorname{Max}_x \psi(x, f(x))Maxx​Minf​ψ(x,f(x))=Minf​Maxx​ψ(x,f(x)); and (13:G): Max⁡xMin⁡fψ(x,f(x))=Max⁡xMin⁡uψ(x,u)\operatorname{Max}_x \operatorname{Min}_f \psi(x, f(x)) = \operatorname{Max}_x \operatorname{Min}_u \psi(x, u)Maxx​Minf​ψ(x,f(x))=Maxx​Minu​ψ(x,u).
  • (15:2)–(15:7): vk=Mσ1k1vσ1/kv_k = M^{k_1}_{\sigma_1} v_{\sigma_1/k}vk​=Mσ1​k1​​vσ1​/k​ for k=1,2k = 1, 2k=1,2, one milestone for each kind of first move, without assuming that any game is strictly determined.
  • (15:C:a): a game of length 000 is strictly determined with value www; (15:C:b): if every Γσ1\Gamma_{\sigma_1}Γσ1​​ is strictly determined, so is Γ\GammaΓ.
  • (15:13), (15:D:a)–(15:D:c): for games without chance moves whose plays end in 1,0,−11, 0, -11,0,−1, the value is one of these three numbers, and it decides which player can force a win or whether both can force a tie.

Significance

The theorem is the first existence result for the value of a class of games in pure strategies. It shows that the whole difficulty of the general zero-sum two-person game, the need for mixed strategies (§17), comes from imperfect information. It gives a construction as well as an existence proof: the value and optimal strategies are computed by backward induction, the procedure behind retrograde analysis of endgames, minimax search in game-playing programs, and the dynamic programming recursions of sequential decision problems with an adversary. The Chess trichotomy (15:D) is its best-known consequence.

Formalizing it adds a checked account of the passage from the extensive to the normalized form for a whole class of games, which the book carries out informally (15.4.2, 15.5.1: "the reader may verify it from the formalistic point of view"). The result is classical and fully proved in the book; the work is to formalize that proof on a tree model. Mathlib has saddle points (Order/SaddlePoint) and the minimax theorem for continuous functions (Topology/Sion), but no game trees, strategies of extensive games, or backward induction. No machine-checked version of this theorem with chance moves and the normalized form over complete plans is known to the mission.

Difficulty

The recursions (15:2)–(15:7) are not formal consequences of the definitions: v1v_1v1​ and v2v_2v2​ are extrema over whole plans of Γ\GammaΓ, while the right-hand sides are extrema over plans of the separate games Γσ1\Gamma_{\sigma_1}Γσ1​​. At a personal move of player 1, v2=Max⁡σ1vσ1/2v_2 = \operatorname{Max}_{\sigma_1} v_{\sigma_1/2}v2​=Maxσ1​​vσ1​/2​ requires interchanging a Min over player 2's plans, which are functions of player 1's first choice, with a Max over that choice: this is exactly (13:E), a max-min equality that fails for general functions of two variables and holds here because the minimizing variable is a function of the maximizing one. A proof that treats the Max over τ1\tau_1τ1​ and the Min over τ2\tau_2τ2​ as interchangeable without this step is circular.

A second difficulty is the strategy spaces themselves. A complete plan chooses at nodes the plan itself excludes, so the pure strategies of Γ\GammaΓ are not simply pairs of a first choice and one strategy of the chosen subgame; the identification the book uses in 15.5.1 has to be justified by showing that the extra coordinates do not change H\mathcal HH.

Formalization scope

A game is an inductive type GameTree with constructors leaf w, chance α p next hp hsum, move1 α hα next, move2 α hα next; alternatives are Fin α (numbered from 000). The conditions p≧0p \geqq 0p≧0, ∑p=1\sum p = 1∑p=1 and α≧1\alpha \geqq 1α≧1 at personal moves are constructor fields, so every tree is a legitimate game. Pure strategies are dependent types Strategy1 t, Strategy2 t defined by recursion on the tree (complete plans), with Fintype and Nonempty instances; H\mathcal HH is payoff t τ₁ τ₂, the expected leaf payoff; v1, v2 are Finset.sup'/Finset.inf' over all strategies, so every Max and Min is attained.

Standing hypotheses and conventions taken from the book:

  • finite strategy sets and attained extrema (13.2.1, 14.1.1): finite trees with finitely many alternatives at every move;
  • perfect information, i.e. preliminarity equals anteriority (6.4.1, (15:B)): built into the tree model, which is the sequence of games (15:1);
  • zero-sum two-person (15.3.1): one payoff F1\mathfrak F_1F1​, player 2 receives −F1-\mathfrak F_1−F1​ and minimizes H\mathcal HH;
  • chance probabilities nonnegative and summing to one (15.4.2, 10.1.1); α≧1\alpha \geqq 1α≧1 at every move;
  • (15:D) additionally assumes no chance moves and outcomes 1,0,−11, 0, -11,0,−1 (15.7.1).

The book's formal model is the set-theoretic one of §§9–10, with partitions of the set of plays; the tree restates it for the perfect-information case and does not formalize §§9–10. The book fixes one length ν\nuν for all plays; trees with plays of different lengths contain the book's games as a special case, so the goal is at least as strong as the book's theorem.

Strategies are plans, never responses: a strategy of player 1 is fixed before play and cannot depend on player 2's strategy, which would make v1=v2v_1 = v_2v1​=v2​ trivial. Chance moves are part of the goal; a version without them proves only the Chess case and is weaker than the book.

Reusable beyond this mission: the tree model, its strategy types and the normalized form, which later chapters on extensive games can import. Welcome contributions: proofs of the milestones, and a lemma identifying the strategies of Γ\GammaΓ with the book's recursive description (15.4.2, 15.5.1).

Selected references

  • J. von Neumann, O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary edition, Princeton University Press, 2007 (reprint of the 3rd ed., 1953), §§6, 11, 13–15. https://doi.org/10.1515/9781400829460
  • E. Zermelo, Über eine Anwendung der Mengenlehre auf die Theorie des Schachspiels, Proc. Fifth International Congress of Mathematicians, vol. II, 1913, pp. 501–504.
  • U. Schwalbe, P. Walker, Zermelo and the early history of game theory, Games and Economic Behavior 34 (2001), 123–137. https://doi.org/10.1006/game.2000.0794
  • H. W. Kuhn, Extensive games and the problem of information, in Contributions to the Theory of Games II, Annals of Mathematics Studies 28, Princeton, 1953, 193–216. https://doi.org/10.1515/9781400881970-012
14 thms3 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Online Primal-Dual Algorithms for Maximizing Ad-Auctions Revenue: The Competitive Ratio of the Primal-Dual Allocation AlgorithmResearch Paper

Motivation

Search engines sell advertisement slots next to their results through ad-auctions. Advertisers bid on keywords, and each advertiser also sets a daily budget: the most it is willing to pay in a day. Queries arrive one at a time and each must be assigned to an advertiser at once, with no knowledge of the queries still to come. The seller's revenue from an advertiser is capped by its budget, so an allocation rule that ignores budgets can exhaust a high bidder early and forgo revenue that a more even allocation would have collected. The question is how much of the offline optimum an online rule can guarantee against every arrival sequence.

Mehta, Saberi, Vazirani and Vazirani (FOCS 2005 / J. ACM 2007) gave a deterministic algorithm whose competitive ratio tends to 1−1/e1 - 1/e1−1/e when bids are small compared with budgets, and showed that no deterministic algorithm does better. Their algorithm builds on online bipartite matching (Karp, Vazirani and Vazirani, STOC 1990) and online bbb-matching (Kalyanasundaram and Pruhs, 2000). Buchbinder, Jain and Naor (ESA 2007) rederived the 1−1/e1 - 1/e1−1/e bound with an online primal-dual algorithm, which gives the ratio in closed form for every value of the bid-to-budget ratio and extends to multiple slots, stochastic information, bounded degree and budget flexibility. This mission formalizes the basic algorithm of that paper and its Theorem 1.

Setting

There is a finite nonempty set III of buyers. Buyer iii has a known budget B(i)>0B(i) > 0B(i)>0. Products j=1,…,mj = 1, \dots, mj=1,…,m arrive one by one; when product jjj arrives, every buyer's bid b(i,j)≥0b(i,j) \ge 0b(i,j)≥0 on it is revealed. The bid-to-budget ratio is

Rmax⁡=max⁡i∈I, jb(i,j)B(i).R_{\max} = \max_{i \in I,\, j} \frac{b(i,j)}{B(i)} .Rmax​=i∈I,jmax​B(i)b(i,j)​.

A fractional allocation y(i,j)≥0y(i,j) \ge 0y(i,j)≥0 assigns fractions of products to buyers; the revenue from buyer iii is the minimum of ∑jb(i,j) y(i,j)\sum_j b(i,j)\,y(i,j)∑j​b(i,j)y(i,j) and B(i)B(i)B(i).

The offline fractional problem is the packing LP, which the paper calls the dual:

max⁡∑j∑ib(i,j) y(i,j)s.t.∑iy(i,j)≤1  ∀j,∑jb(i,j) y(i,j)≤B(i)  ∀i,y≥0.\max \sum_{j}\sum_{i} b(i,j)\,y(i,j) \quad\text{s.t.}\quad \sum_i y(i,j) \le 1 \ \ \forall j,\qquad \sum_j b(i,j)\,y(i,j) \le B(i)\ \ \forall i,\qquad y \ge 0 .maxj∑​i∑​b(i,j)y(i,j)s.t.i∑​y(i,j)≤1  ∀j,j∑​b(i,j)y(i,j)≤B(i)  ∀i,y≥0.

Its LP dual, the paper's primal, is the covering LP:

min⁡∑iB(i) x(i)+∑jz(j)s.t.b(i,j) x(i)+z(j)≥b(i,j)  ∀i,j,x,z≥0.\min \sum_i B(i)\,x(i) + \sum_j z(j) \quad\text{s.t.}\quad b(i,j)\,x(i) + z(j) \ge b(i,j)\ \ \forall i,j,\qquad x, z \ge 0 .mini∑​B(i)x(i)+j∑​z(j)s.t.b(i,j)x(i)+z(j)≥b(i,j)  ∀i,j,x,z≥0.

The Allocation Algorithm has a parameter c>1c > 1c>1 and starts from x≡0x \equiv 0x≡0. When product jjj arrives it takes a buyer iii maximizing b(i,j)(1−x(i))b(i,j)(1 - x(i))b(i,j)(1−x(i)). If x(i)≥1x(i) \ge 1x(i)≥1, the product is not sold. Otherwise it charges iii the minimum of b(i,j)b(i,j)b(i,j) and iii's remaining budget, sets y(i,j)←1y(i,j) \leftarrow 1y(i,j)←1 and z(j)←b(i,j)(1−x(i))z(j) \leftarrow b(i,j)(1 - x(i))z(j)←b(i,j)(1−x(i)), and updates

x(i)←x(i)(1+b(i,j)B(i))+b(i,j)(c−1) B(i).x(i) \leftarrow x(i)\Big(1 + \frac{b(i,j)}{B(i)}\Big) + \frac{b(i,j)}{(c-1)\,B(i)} .x(i)←x(i)(1+B(i)b(i,j)​)+(c−1)B(i)b(i,j)​.

Its revenue is the total amount charged.

Formalization targets

Goal: Theorem 1

For every instance and every bound R>0R > 0R>0 with b(i,j)≤R B(i)b(i,j) \le R\,B(i)b(i,j)≤RB(i) for all i,ji, ji,j, the Allocation Algorithm run with c=(1+R)1/Rc = (1+R)^{1/R}c=(1+R)1/R, under any tie-breaking of the maximum, satisfies for every feasible y′y'y′ of the packing LP

Revenue  ≥  (1−1c)(1−R)∑j∑ib(i,j) y′(i,j).\mathrm{Revenue} \;\ge\; \Big(1 - \frac1c\Big)(1 - R)\sum_{j}\sum_{i} b(i,j)\,y'(i,j).Revenue≥(1−c1​)(1−R)j∑​i∑​b(i,j)y′(i,j).

With R=Rmax⁡R = R_{\max}R=Rmax​ this is the paper's statement that the algorithm is (1−1/c)(1−Rmax⁡)(1 - 1/c)(1 - R_{\max})(1−1/c)(1−Rmax​)-competitive; the fractional optimum bounds every integral offline allocation.

Milestones

The proof of Theorem 1 rests on three claims and three auxiliary facts, each a milestone:

  1. the inequality ln⁡(1+x)/x≥ln⁡(1+y)/y\ln(1+x)/x \ge \ln(1+y)/yln(1+x)/x≥ln(1+y)/y for 0<x≤y≤10 < x \le y \le 10<x≤y≤1;
  2. Claim (1): the final (x,z)(x, z)(x,z) is feasible for the covering LP;
  3. Claim (2): the covering cost of the run equals (1+1/(c−1))(1 + 1/(c-1))(1+1/(c−1)) times the packing value of the run's own yyy;
  4. Inequality (1): x(i)≥1c−1(c∑jb(i,j)y(i,j)/B(i)−1)x(i) \ge \frac{1}{c-1}\big(c^{\sum_j b(i,j) y(i,j)/B(i)} - 1\big)x(i)≥c−11​(c∑j​b(i,j)y(i,j)/B(i)−1) at every stage of the run;
  5. Claim (3): ∑jb(i,j) y(i,j)≤B(i)+max⁡jb(i,j)\sum_j b(i,j)\,y(i,j) \le B(i) + \max_j b(i,j)∑j​b(i,j)y(i,j)≤B(i)+maxj​b(i,j), and the amount charged to iii is at least (1−R)∑jb(i,j) y(i,j)(1 - R)\sum_j b(i,j)\,y(i,j)(1−R)∑j​b(i,j)y(i,j);
  6. weak duality for the LP pair above;

and, separately, the second sentence of Theorem 1,

lim⁡R→0+(1−1(1+R)1/R)(1−R)=1−1e.\lim_{R\to 0^+}\Big(1 - \frac{1}{(1+R)^{1/R}}\Big)(1-R) = 1 - \frac1e .R→0+lim​(1−(1+R)1/R1​)(1−R)=1−e1​.

Significance

Theorem 1 gives an explicit ratio for every value of Rmax⁡R_{\max}Rmax​, not only in the limit. It tends to the optimal deterministic ratio 1−1/e1 - 1/e1−1/e as bids become small, and it quantifies how the guarantee degrades as single bids become a larger share of a budget. The primal-dual analysis is the template for the paper's later sections and for a line of work on online packing and covering problems, surveyed in Buchbinder and Naor's monograph The Design of Competitive Online Algorithms via a Primal-Dual Approach (Foundations and Trends in TCS, 2009).

The result is proved in the paper, and the proof is short. What this mission adds is a machine-checked proof about an algorithm that is defined, not described: the run is computed by recursion from the instance, and the guarantee is proved for that run and every tie-breaking. A related private mission on the platform, The Design of Competitive Online Algorithms via a Primal-Dual Approach VI: Maximizing Ad-Auctions Revenue, states the monograph's Theorem 10.1, which is this theorem, in a form that takes the analysis's intermediate inequalities as hypotheses over arbitrary lists of won bids; the present mission states it for the algorithm itself. No machine-checked proof of Theorem 1 is known to this mission.

Difficulty

Each step of the proof is elementary; the difficulty is the bookkeeping of an online process. Claims (1) and (2) are statements about a single iteration that must be lifted to the whole run: Claim (1) uses that xxx only increases, and Claim (2) that each product is processed once. Inequality (1) is an induction over the iterations that allocate to one buyer, interleaved with iterations that allocate to others and is the only place where the value of ccc matters. Claim (3) needs a further invariant: the amount charged equals the minimum of the allocated bids and the budget.

A tempting shortcut is to take Inequality (1) and the "at most one undercharge" fact as hypotheses about some list of bids. That does not describe the algorithm and is not the theorem; here the only hypotheses are on the instance and on the tie-breaking rule.

Formalization scope

Buyers are a type I with [Fintype I] and [Nonempty I]; products are Fin m, whose order is the arrival order. Bids and budgets are real, with B(i)>0B(i) > 0B(i)>0 and b(i,j)≥0b(i,j) \ge 0b(i,j)≥0. The state of the algorithm records xxx, the amounts charged, yyy and zzz; one iteration is step, the run after kkk products is runPrefix, and revenue sums the charges of the final state. The tie-breaking rule is a function sel of the current xxx and the product, required to return a maximizer of b(i,j)(1−x(i))b(i,j)(1-x(i))b(i,j)(1−x(i)); the theorem holds for every such rule. The constant c=(1+R)1/Rc = (1+R)^{1/R}c=(1+R)1/R is a real power and requires R>0R > 0R>0. The theorem is stated for any bound RRR on the ratios, of which the exact maximum is one instance. Claims (1) and (2) are stated for every c>1c > 1c>1, which covers the paper's choice. The paper's inequality for ln⁡(1+x)/x\ln(1+x)/xln(1+x)/x allows x=0x = 0x=0, read as a limit; the Lean statement requires x>0x > 0x>0.

A statement over an unconstrained allocation, or one conditioned on the proof's own intermediate inequalities, would be trivially true or false; the targets here concern only the run the definitions compute.

The development needs finite sums, real powers and logarithms from Mathlib and an induction principle for the run. The LP pair and weak duality are reusable for the paper's extensions, and the run invariants for any primal-dual online algorithm with multiplicative updates. Proofs of any milestone are welcome, as are sharper variants, such as the exact-Rmax⁡R_{\max}Rmax​ form or the bound against integral allocations.

Selected references

  • N. Buchbinder, K. Jain, J. Naor, Online Primal-Dual Algorithms for Maximizing Ad-Auctions Revenue, Algorithms – ESA 2007, LNCS 4698, 2007. https://doi.org/10.1007/978-3-540-75520-3_24
  • A. Mehta, A. Saberi, U. Vazirani, V. Vazirani, AdWords and Generalized Online Matching, Journal of the ACM 54(5), 2007. https://doi.org/10.1145/1284320.1284321
  • R. M. Karp, U. V. Vazirani, V. V. Vazirani, An Optimal Algorithm for On-line Bipartite Matching, STOC 1990. https://doi.org/10.1145/100216.100262
  • B. Kalyanasundaram, K. R. Pruhs, An Optimal Deterministic Algorithm for Online b-Matching, Theoretical Computer Science 233(1–2), 2000. https://doi.org/10.1016/S0304-3975(99)00140-1
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal-Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3), 2009. https://doi.org/10.1561/0400000024
10 thms3 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization·Captain: mikedeng1

Value of Information in Bayesian Routing Games I: Sign and Monotonicity of the Relative Value of Information Across Size RegimesResearch Paper

Motivation

Traffic information systems (TIS) such as navigation apps send drivers noisy signals about the state of a road network: incidents, weather, closures. When several such systems coexist, each with its own subscriber base and its own information, a natural question for operators and regulators is whether subscribing to one system rather than another actually lowers a driver's expected travel cost in equilibrium, and how this advantage depends on how many drivers use each system. More information for one population also changes the congestion everybody else faces, so the answer is not simply "more information is better".

Wu, Amin and Ozdaglar (Operations Research 69(1), 2021) answer this question for nonatomic routing games with heterogeneous, possibly correlated information. Their model builds on the weighted potential game framework of Sandholm (2001) and on sensitivity analysis of convex programs. This mission formalizes their Section 5 result: for any two populations the sign of the relative value of information is determined by which of three explicitly computable size regimes the population sizes lie in, and the relative value decreases as one population grows at the expense of the other.

Setting

A Bayesian routing game has a finite set of populations I\mathcal II, one per TIS, a finite set of network states S\mathcal SS, and for each population iii a finite nonempty type space Ti\mathcal T^iTi of signals. A common prior π\piπ is a probability distribution on S×T\mathcal S\times\mathcal TS×T, T=∏iTi\mathcal T=\prod_i\mathcal T^iT=∏i​Ti. A network with a single origin–destination pair has edges E\mathcal EE and a finite nonempty set of routes R\mathcal RR; each edge has a state-dependent cost cesc^s_eces​ that is positive, strictly increasing and differentiable. The total demand is D>0D>0D>0, and population iii carries the fraction λi\lambda^iλi of it, with λi≥0\lambda^i\ge0λi≥0 and ∑iλi=1\sum_i\lambda^i=1∑i​λi=1.

A strategy profile qqq assigns to each population iii and type tit^iti a split qri(ti)≥0q^i_r(t^i)\ge0qri​(ti)≥0 of its demand λiD\lambda^iDλiD over routes. It induces the route flow fr(t)=∑iqri(ti)f_r(t)=\sum_iq^i_r(t^i)fr​(t)=∑i​qri​(ti) and the edge load we(t)=∑r∋efr(t)w_e(t)=\sum_{r\ni e}f_r(t)we​(t)=∑r∋e​fr​(t). With the belief βi(s,t−i∣ti)=π(s,ti,t−i)/Pr⁡(ti)\beta^i(s,t^{-i}\mid t^i)=\pi(s,t^i,t^{-i})/\Pr(t^i)βi(s,t−i∣ti)=π(s,ti,t−i)/Pr(ti), type tit^iti evaluates route rrr by its expected cost E[cr(q)∣ti]\mathbb E[c_r(q)\mid t^i]E[cr​(q)∣ti]. A Bayesian Wardrop equilibrium (BWE) is a feasible qqq in which every type uses only routes of minimal expected cost. The equilibrium population cost is Ci∗(λ)=∑tiPr⁡(ti)min⁡rE[cr(q)∣ti]C^{i*}(\lambda)=\sum_{t^i}\Pr(t^i)\min_r\mathbb E[c_r(q)\mid t^i]Ci∗(λ)=∑ti​Pr(ti)minr​E[cr​(q)∣ti] at a BWE qqq.

The game has a weighted potential Φ(q)=∑s,e,tπ(s,t)∫0we(t)ces(z) dz\Phi(q)=\sum_{s,e,t}\pi(s,t)\int_0^{w_e(t)}c^s_e(z)\,dzΦ(q)=∑s,e,t​π(s,t)∫0we​(t)​ces​(z)dz; its minimum over feasible profiles is the equilibrium potential value Ψ(λ)\Psi(\lambda)Ψ(λ). For two populations i≠ji\ne ji=j, the direction zijz^{ij}zij moves demand share from jjj to iii, and ∣λ−ij∣|\lambda^{-ij}|∣λ−ij∣ is the total share of the other populations. The impact of information J^i(f)\widehat J^i(f)Ji(f) measures how much of population iii's demand is moved by its signal. Two thresholds λ‾i≤λ‾i\underline\lambda^i\le\overline\lambda^iλ​i≤λi are computed from the optimal set Fij,†\mathcal F^{ij,\dagger}Fij,† of an auxiliary convex program over route flows in which the separate information constraints of iii and jjj are merged. They define three regimes: Λ1ij\Lambda^{ij}_1Λ1ij​ (λi<λ‾i\lambda^i<\underline\lambda^iλi<λ​i), Λ2ij\Lambda^{ij}_2Λ2ij​ (λ‾i≤λi≤λ‾i\underline\lambda^i\le\lambda^i\le\overline\lambda^iλ​i≤λi≤λi) and Λ3ij\Lambda^{ij}_3Λ3ij​ (λi>λ‾i\lambda^i>\overline\lambda^iλi>λi). The relative value of information is Vij∗(λ)=Cj∗(λ)−Ci∗(λ)V^{ij*}(\lambda)=C^{j*}(\lambda)-C^{i*}(\lambda)Vij∗(λ)=Cj∗(λ)−Ci∗(λ).

Formalization targets

Goal: Theorem 3

For i≠ji\ne ji=j and admissible λ\lambdaλ (in the simplex with λi,λj>0\lambda^i,\lambda^j>0λi,λj>0), and every BWE of Γ(λ)\Gamma(\lambda)Γ(λ),

Vij∗(λ)>0 on Λ1ij,Vij∗(λ)=0 on Λ2ij,Vij∗(λ)<0 on Λ3ij,V^{ij*}(\lambda)>0 \text{ on } \Lambda^{ij}_1,\qquad V^{ij*}(\lambda)=0 \text{ on } \Lambda^{ij}_2,\qquad V^{ij*}(\lambda)<0 \text{ on } \Lambda^{ij}_3,Vij∗(λ)>0 on Λ1ij​,Vij∗(λ)=0 on Λ2ij​,Vij∗(λ)<0 on Λ3ij​,

and Vij∗V^{ij*}Vij∗ is nonincreasing along zijz^{ij}zij: Vij∗(λ+εzij)≤Vij∗(λ)V^{ij*}(\lambda+\varepsilon z^{ij})\le V^{ij*}(\lambda)Vij∗(λ+εzij)≤Vij∗(λ) for ε>0\varepsilon>0ε>0 with both endpoints admissible.

Milestones

The route to the goal follows the paper: Lemma 1 (weighted potential), Lemma 2 (strict convexity of the edge-load potential), Theorem 1 (equilibria are the minimizers of Φ\PhiΦ; unique edge load), Lemma 3 (unique Lagrange multipliers), Proposition 1 (the feasible route flows form a polytope F(λ)\mathcal F(\lambda)F(λ)), Proposition 2 (equilibrium route flows minimize Φ^\widehat\PhiΦ over F(λ)\mathcal F(\lambda)F(λ)), Lemma 4 (0≤λ‾i≤λ‾i≤1−∣λ−ij∣0\le\underline\lambda^i\le\overline\lambda^i\le1-|\lambda^{-ij}|0≤λ​i≤λi≤1−∣λ−ij∣), Theorem 2 (equilibrium flows in each regime), Proposition 3 (Ψ\PsiΨ decreases, stays constant, increases along zijz^{ij}zij in the three regimes) and Lemma 5 (Ψ\PsiΨ is convex and directionally differentiable, and Vij∗(λ)=−1D∇zijΨ(λ)V^{ij*}(\lambda)=-\frac1D\nabla_{z^{ij}}\Psi(\lambda)Vij∗(λ)=−D1​∇zij​Ψ(λ)).

Significance

Theorem 3 says that a population has an advantage over another exactly when it is the minor population of the pair, relative to thresholds that depend only on the other populations' sizes. Both populations face the same equilibrium cost in the middle regime. It gives a procedure for comparing two information systems without computing equilibria for each size vector: solve one convex program, read off two thresholds, and locate λi\lambda^iλi. The paper's Section 6 uses the same machinery, through Lemma 5, to characterize the equilibrium adoption rates of information systems.

The paper proves these results with the main proofs in the article and the sensitivity-analysis lemmas (Lemmas EC.1–EC.4) in its e-companion. None of them has a machine-checked proof. The formalization requires a Lean account of Bayesian Wardrop equilibria, of the equivalence between equilibria and a convex program, and of directional derivatives of the optimal value of a parametric convex program. Parts of this are reusable for any nonatomic routing or congestion game.

Difficulty

The equilibrium strategy profile is not unique and changes discontinuously with λ\lambdaλ. Differentiating equilibrium costs in λ\lambdaλ directly therefore fails. The paper instead works with the optimal value Ψ(λ)\Psi(\lambda)Ψ(λ), whose one-sided directional derivative is expressed through Lagrange multipliers. That requires a sensitivity theorem for convex programs whose constraints depend affinely on the parameter, together with uniqueness of multipliers, which fails for populations of size zero. The regime analysis also needs a characterization of the route flows that are induced by feasible strategy profiles. That set is described by the nonlinear-looking constraint J^i(f)≤λiD\widehat J^i(f)\le\lambda^iDJi(f)≤λiD, a minimum over types inside a sum over routes. Strict monotonicity of Ψ\PsiΨ in the side regimes needs the tightness of an information constraint at every equilibrium, not only at one.

Formalization scope

The model is a Lean structure BayesRouting.VOI.Game over finite types of populations, type spaces, states, edges and routes. Routes are given by their edge sets, and the directed-graph structure is not used. Type spaces and the route set are nonempty. The prior is a probability distribution, D>0D>0D>0, and costs are positive on nonnegative loads, strictly increasing and differentiable on R\mathbb RR. One assumption is added: every type profile has positive probability. It makes beliefs well defined and the equilibrium edge load unique, and it excludes perfectly correlated signals.

Conventions: Ci∗C^{i*}Ci∗ is the last form of eq. (7), which does not divide by λiD\lambda^iDλiD. J^i\widehat J^iJi is the maximum of eq. (16) over the reference profile, so that J^i(f)≤λiD\widehat J^i(f)\le\lambda^iDJi(f)≤λiD is exactly (14d). Ψ\PsiΨ and the thresholds are sInf/sSup over sets that are nonempty and compact for size vectors in the simplex, and every statement keeps size vectors there. Statements about "the" equilibrium are stated for every BWE, and existence of a BWE is a separate item, so they are not vacuous. The thresholds are defined from the optimal set of the auxiliary program, not assumed as parameters. Taking them as parameters constrained only by Lemma 4 would give a different theorem.

Disclosed deviations: Lemma 2's C2C^2C2 clause assumes C1C^1C1 costs; Lemma 3 is stated for populations of positive size; Lemma 5 assumes λj>0\lambda^j>0λj>0; Proposition 3 is stated with strict monotonicity in the side regimes, as used in the proof of Theorem 3. Contributions of reusable infrastructure are welcome: interval-integral potentials of monotone costs, KKT theory for polyhedral constraints, and directional derivatives of parametric optimal values.

Selected references

  • M. Wu, S. Amin, A. Ozdaglar, Value of Information in Bayesian Routing Games, Operations Research 69(1):148–163, 2021. https://doi.org/10.1287/opre.2020.1999
  • W. H. Sandholm, Potential Games with Continuous Player Sets, Journal of Economic Theory 97(1):81–108, 2001. https://doi.org/10.1006/jeth.2000.2696
  • R. T. Rockafellar, Directional Differentiability of the Optimal Value Function in a Nonlinear Programming Problem, in Sensitivity, Stability and Parametric Analysis (Mathematical Programming Studies 21), Springer, 1984, pp. 213–226.
  • A. V. Fiacco, J. Kyparisis, Convexity and Concavity Properties of the Optimal Value Function in Parametric Nonlinear Programming, Journal of Optimization Theory and Applications 48(1):95–126, 1986.
15 thms3 active usersReviewed
🏆Completed
Mechanism DesignOperations ResearchOptimization·Captain: mikedeng1

Algorithmic Mechanism Design VI: With Verification, the Compensation-and-Bonus Mechanism Is a Strongly Truthful Optimal ImplementationResearch Paper

Motivation

Scheduling tasks on machines owned by self-interested parties is the running example of Nisan and Ronen's Algorithmic Mechanism Design (Games and Economic Behavior 35, 2001), the paper that introduced the study of mechanisms whose allocation rule is an algorithm with a computational objective. Each machine (agent) privately knows how long it needs for each task; the designer wants to minimize the make-span, the completion time of the last machine, and can only influence the agents through payments.

Without further information the designer is in a weak position: the paper shows that no mechanism approximates the optimal make-span within a factor below 2 (Theorem 4.6), and that the natural truthful mechanism, MinWork, only achieves a factor nnn. Section 5 of the paper observes that in many applications the designer learns more than the agents' reports: it can pay after the work is done and observe how long each task actually took. It introduces mechanisms with verification and shows that, with this extra information, the make-span can be minimized exactly by a strongly truthful mechanism. This mission formalizes that result, Theorem 5.1, together with the steps of its proof and the participation variant, Theorem 5.4.

Setting

There are kkk tasks and nnn agents. The type of agent iii is the vector ti=(t1i,…,tki)t^i = (t^i_1,\dots,t^i_k)ti=(t1i​,…,tki​) of positive numbers, tjit^i_jtji​ being the least time in which agent iii can perform task jjj. An allocation xxx gives each task to one agent; xix^ixi is the set of tasks of agent iii. For a type vector ttt and for a vector t~\tilde tt~ of actual execution times the make-spans are

g(x,t)=max⁡i∑j∈xitji,g(x,t~)=max⁡i∑j∈xit~j.g(x,t) = \max_i \sum_{j\in x^i} t^i_j, \qquad g(x,\tilde t) = \max_i \sum_{j\in x^i} \tilde t_j .g(x,t)=imax​j∈xi∑​tji​,g(x,t~)=imax​j∈xi∑​t~j​.

A mechanism with verification is a pair (x,p)(x, p)(x,p). The allocation x(d)x(d)x(d) is computed from the agents' declarations d=(d1,…,dn)d = (d^1,\dots,d^n)d=(d1,…,dn) only. Each agent then performs its tasks, in any times t~j≥tji\tilde t_j \ge t^i_jt~j​≥tji​ it chooses, and the mechanism pays agent iii the amount pi(d,t~)p^i(d, \tilde t)pi(d,t~), which may depend on the declarations and on the observed actual times. Agent iii's utility is pi(d,t~)−∑j∈xit~jp^i(d,\tilde t) - \sum_{j \in x^i} \tilde t_jpi(d,t~)−∑j∈xi​t~j​. A strategy of agent iii therefore has two parts: a declaration did^idi and an execution plan eie^iei that says, for every allocation, how long the agent takes on each of its tasks.

A strategy is dominant if it maximizes the agent's utility against all declarations and all execution plans of the other agents. The mechanism is truthful if, for every agent and type, declaring the true type (with a suitable execution plan) is dominant, and strongly truthful if the only dominant strategy is to declare the true type and to execute every task in minimal time.

The Compensation-and-Bonus mechanism uses an optimal allocation algorithm x(⋅)x(\cdot)x(⋅) and pays

pi(d,t~)=∑j∈xi(d)t~j⏟compensation ci  − g(x(d),corri(x(d),d,t~))⏟bonus bi,p^i(d,\tilde t) = \underbrace{\sum_{j \in x^i(d)} \tilde t_j}_{\text{compensation } c^i} \;\underbrace{-\, g\big(x(d), \mathrm{corr}^i(x(d), d, \tilde t)\big)}_{\text{bonus } b^i},pi(d,t~)=compensation cij∈xi(d)∑​t~j​​​bonus bi−g(x(d),corri(x(d),d,t~))​​,

where the corrected time vector corri\mathrm{corr}^icorri lists agent iii's own tasks at their actual times and every other task at the time declared by the agent it was given to.

Formalization targets

Goal: Theorem 5.1

For n≥2n \ge 2n≥2 agents and every optimal allocation algorithm (ties broken arbitrarily), the Compensation-and-Bonus mechanism is a strongly truthful implementation of task scheduling:

strongly truthfulandg(x(D),t~)≤min⁡yg(y,t) whenever every agent plays a dominant strategy for its true type.\text{strongly truthful} \quad\text{and}\quad g\big(x(D), \tilde t\big) \le \min_y g(y, t) \text{ whenever every agent plays a dominant strategy for its true type.}strongly truthfulandg(x(D),t~)≤ymin​g(y,t) whenever every agent plays a dominant strategy for its true type.

Milestones (proof of Claim 5.2)

  1. The utility of every agent equals its bonus.
  2. For every allocation, the bonus of agent iii is maximized by executing its tasks in minimal time.
  3. With t=(d−i,ti)t = (d^{-i}, t^i)t=(d−i,ti), for every declaration t′it'^it′i,
−g(x(t),corr∗(x(t),t))≥−g(x(t′i,d−i),corr∗(x(t′i,d−i),t)).-g\big(x(t), \mathrm{corr}^*(x(t), t)\big) \ge -g\big(x(t'^i, d^{-i}), \mathrm{corr}^*(x(t'^i, d^{-i}), t)\big).−g(x(t),corr∗(x(t),t))≥−g(x(t′i,d−i),corr∗(x(t′i,d−i),t)).
  1. Declaring the true type and executing in minimal time is dominant.
  2. Claim 5.2: the mechanism is strongly truthful.

Further target: Theorem 5.4

For n≥2n \ge 2n≥2 there is a strongly truthful mechanism with an optimal allocation algorithm that satisfies participation constraints: an agent that performs its tasks in its declared times never ends with negative utility.

Significance

The result. Theorem 5.1 shows that the lower bound of 2 for task scheduling (Theorem 4.6) is an artefact of the information structure, not of incentives as such: once execution times are observable, the exact optimum is achievable in dominant strategies, and the agents have a unique rational behaviour. The construction also isolates a general principle, used again in §5.6 of the paper: an agent paid by the global objective value, computed with the others' declarations, has the designer's incentives. Theorem 5.4 shows that the bonus can be shifted to make participation individually rational, which the plain mechanism violates (its bonus is negative).

Formalizing it. The theorem is proved in the paper, in a few lines, and has no machine-checked version. A formalization has to settle what the paper leaves informal: what a strategy with an execution part is, over which strategies of the others dominance is quantified, what "the only dominant strategy" demands of the execution plan on allocations that seem never to arise, and which hypotheses on the number of agents the uniqueness needs. The model built here is also the base of two companion missions of the same series (Compensation-and-Bonus with a non-optimal allocation algorithm, and the rounding mechanism with verification).

Difficulty

Truthfulness (milestones 1–4) is short once the model is right. The difficulty is uniqueness. For a misreport or a slow execution to be excluded, one must exhibit, for every alternative strategy, declarations of the other agents under which that strategy is strictly worse. The declarations must be positive, the optimal allocation algorithm breaks ties arbitrarily, and agent iii's slower execution only hurts it when agent iii is the bottleneck. The paper's proof dismisses this step with "clearly, … there are circumstances"; the naive reading ("the others declare +∞+\infty+∞ elsewhere") is not available in a model with finite positive times, and the uniqueness clause must also cover the execution plan on every allocation, not only on the allocation produced by truthful play.

Formalization scope

  • Agents are Fin n, tasks Fin k, allocations functions Fin k → Fin n; both make-spans are Finset.sup' over the nonempty set of agents ([NeZero n]).
  • Types and declarations are positive real vectors; declarations range over this type space (Definition 18's "unrestricted" declaration is any element of it).
  • An execution plan is a function from allocations to actual times; feasibility for type tit^iti requires t~j≥tji\tilde t_j \ge t^i_jt~j​≥tji​ on the agent's own tasks only. In the dominance quantifier the other agents' plans are arbitrary.
  • Payments are amounts handed to the agent; utility is quasi-linear.
  • The optimal allocation algorithm is a parameter with the hypothesis that it minimizes g(⋅,d)g(\cdot, d)g(⋅,d) on every positive ddd; every theorem holds for every such algorithm.
  • Strong truthfulness constrains both parts of the strategy: the declaration equals the type, and the plan executes every task in minimal time under every allocation.
  • Thresholds made explicit: n≥2n \ge 2n≥2 in Claim 5.2, Theorem 5.1 and Theorem 5.4 (not printed; with one agent every declaration is dominant, and the construction of Theorem 5.4 needs a second agent).
  • Printed slips: the displayed inequality prints >=; Theorem 5.4 prints "strongly truthfulmechanism"; Definition 28 writes t~j=tj\tilde t_j = t_jt~j​=tj​ for t~j=tji\tilde t_j = t^i_jt~j​=tji​.
  • Running time is out of scope.
  • A formalization in which dominance is checked only against truthful other agents, in which the mechanism ignores executions, in which strong truthfulness constrains only the declaration, or in which the implementation clause is stated only at the truthful profile, is not the theorem and is ruled out by the statements.

Welcome contributions: proofs of the milestones, the uniqueness witnesses as reusable lemmas, and the contribution-based mechanism behind Theorem 5.4. Theorem 5.3 (generalized Compensation-and-Bonus) is not stated in this mission.

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • T. Groves, Incentives in Teams, Econometrica 41 (1973) 617–631. https://doi.org/10.2307/1914085
  • A. Mas-Colell, M. D. Whinston, J. R. Green, Microeconomic Theory, Oxford University Press, 1995.
8 thms3 active usersReviewed
🏆Completed
Mechanism DesignOperations ResearchOptimization+1·Captain: mikedeng1

Algorithmic Mechanism Design V: The Randomly Biased Min Work Mechanism Is a Strongly Truthful 7/4-Approximation for Two AgentsResearch Paper

Motivation

Algorithmic mechanism design, introduced by Nisan and Ronen (Games Econ. Behav. 35, 2001), studies optimization problems whose input is held by self-interested agents. Each agent reports its private data to a protocol, and the protocol must choose an output and payments so that reporting the truth is in every agent's interest while the chosen output is close to optimal.

The paper's test case is task scheduling on unrelated machines: kkk tasks must be assigned to nnn agents, agent iii needs time tjit^i_jtji​ for task jjj, and the goal is to minimize the make-span. For deterministic mechanisms the paper shows that truthfulness is costly: the MinWork mechanism achieves ratio nnn, and no mechanism achieves a ratio below 222 (Theorem 4.6). Section 4.4 asks whether randomization helps and answers yes for two agents: a randomized mechanism, truthful for every outcome of its coins, achieves expected ratio 7/4<27/4 < 27/4<2.

Timeline.

  • 1979: Roberts characterizes weighted (affine) maximizers; the weighted Vickrey–Groves–Clarke (VGC) mechanisms are truthful.
  • 1999: Lehmann supplies the case analysis that improves the authors' original bound of 1.8231.8231.823 to 7/47/47/4 (acknowledged on p. 182).
  • 2001: Nisan and Ronen publish the randomly biased min work mechanism and Theorem 4.16.

Setting

There are two agents, 111 and 222, and kkk tasks. A type vector t=(t1,t2)t = (t^1, t^2)t=(t1,t2) gives, for each agent iii and task jjj, the positive time tjit^i_jtji​ agent iii needs for task jjj. An allocation xxx assigns each task to one agent; xix^ixi is the set of tasks of agent iii. The make-span of xxx is

g(x,t)=max⁡i∈{1,2}∑j∈xitji.g(x, t) = \max_{i \in \{1,2\}} \sum_{j \in x^i} t^i_j .g(x,t)=i∈{1,2}max​j∈xi∑​tji​.

A direct mechanism receives declared types ddd and returns an allocation x(d)x(d)x(d) and payments pi(d)p^i(d)pi(d) handed to the agents. Agent iii with true type tit^iti gets utility pi(d)−∑j∈xi(d)tjip^i(d) - \sum_{j \in x^i(d)} t^i_jpi(d)−∑j∈xi(d)​tji​. The mechanism is truthful if declaring the true type maximizes an agent's utility whatever the other agent declares, and strongly truthful if in addition every false declaration is strictly worse for some declaration of the other agent.

A randomized mechanism is a probability distribution over deterministic mechanisms; its objective is the expected make-span. It is universally truthful if every mechanism in its support is truthful, and universally strongly truthful if moreover truth-telling is the only strategy dominant in every mechanism of the support.

The biased min work mechanism with parameters β≥1\beta \ge 1β≥1 and s∈{1,2}ks \in \{1,2\}^ks∈{1,2}k treats each task jjj separately. With i=sji = s_ji=sj​ the favoured agent and i′=3−ii' = 3 - ii′=3−i the other: if tji≤β⋅tji′t^i_j \le \beta \cdot t^{i'}_jtji​≤β⋅tji′​, task jjj goes to iii, who is paid β⋅tji′\beta \cdot t^{i'}_jβ⋅tji′​; otherwise it goes to i′i'i′, who is paid β−1⋅tji\beta^{-1} \cdot t^i_jβ−1⋅tji​. The randomly biased min work mechanism draws sss uniformly from {1,2}k\{1,2\}^k{1,2}k and uses β=4/3\beta = 4/3β=4/3. Its expected make-span is

Es g(xs(t),t)=12k∑s∈{1,2}kg(xs(t),t).\mathbb{E}_s\, g(x_s(t), t) = \frac{1}{2^k} \sum_{s \in \{1,2\}^k} g(x_s(t), t).Es​g(xs​(t),t)=2k1​s∈{1,2}k∑​g(xs​(t),t).

Formalization targets

Goal: Theorem 4.16

For every kkk: the randomly biased min work mechanism is universally strongly truthful, and for every positive type vector ttt and every allocation yyy,

12k∑s∈{1,2}kg(xs(t),t)≤74 g(y,t).\frac{1}{2^k} \sum_{s \in \{1,2\}^k} g(x_s(t), t) \le \frac74\, g(y, t).2k1​s∈{1,2}k∑​g(xs​(t),t)≤47​g(y,t).

Milestones

  • Theorem 3.2 (Roberts): for positive weights βi\beta^iβi, a mechanism whose output maximizes ∑iβivi(ti,o)\sum_i \beta^i v^i(t^i, o)∑i​βivi(ti,o) and whose payments are pi=1βi∑j≠iβjvj(tj,o)+hi(t−i)p^i = \frac{1}{\beta^i}\sum_{j \ne i}\beta^j v^j(t^j, o) + h^i(t^{-i})pi=βi1​∑j=i​βjvj(tj,o)+hi(t−i) is truthful.
  • Lemma 4.15: for every β≥1\beta \ge 1β≥1 and every sss, the biased min work mechanism is strongly truthful.
  • Lemma 4.17: the randomly biased min work mechanism is universally strongly truthful.
  • Claim 4.19, part 5: allocating two tasks independently at random gives an expected make-span no larger than allocating their merge at random.
  • Reduced case (Fig. 2, Cases 1–3): for a,b,c,d≥0a, b, c, d \ge 0a,b,c,d≥0 with a+c=43b+da + c = \frac43 b + da+c=34​b+d,
14(max⁡(a+b+c+43d,0)+max⁡(a+b+c,d)+max⁡(a+b+43d,43c)+max⁡(a+b,43c+d))≤74(a+c).\tfrac14\Big(\max(a+b+c+\tfrac43 d, 0) + \max(a+b+c, d) + \max(a+b+\tfrac43 d, \tfrac43 c) + \max(a+b, \tfrac43 c + d)\Big) \le \tfrac74 (a+c).41​(max(a+b+c+34​d,0)+max(a+b+c,d)+max(a+b+34​d,34​c)+max(a+b,34​c+d))≤47​(a+c).
  • Lemma 4.18: the 7/47/47/4 bound on the expected make-span.

Significance

The result. Theorem 4.16 separates randomized from deterministic truthful mechanisms for scheduling two unrelated machines: 7/47/47/4 against the deterministic lower bound of 222. The notion of truthfulness it uses is the strong one, dominance for every coin outcome, so the separation does not rest on agents being risk-neutral or knowing the distribution. Later work on truthful randomized scheduling, and on the gap between deterministic and randomized truthful mechanisms, starts from this construction.

Formalizing it. The theorem is proved in the paper; no machine-checked proof of it is known. A formalization produces a checked definition of universal truthfulness for randomized mechanisms, a checked weighted VGC theorem usable for any affine-maximizer mechanism, and a checked version of the reduction argument (Claim 4.19), which the paper states in five informal instance transformations, one of them a limiting argument.

Difficulty

Truthfulness reduces to one task at a time, where the mechanism is a weighted VGC mechanism; the difficulty lies in the approximation bound. A naive task-by-task comparison with the optimum fails: the bound is on a maximum of two loads averaged over 2k2^k2k coin vectors, and the maximum does not decompose over tasks. The paper reduces an arbitrary instance to four tasks through transformations that each move the ratio in one direction, and the reduced instance still needs a three-way case analysis. Making the reduction rigorous is the main work: part 1 of Claim 4.19 replaces a ratio "arbitrarily close to β\betaβ" by β\betaβ, and under the mechanism's tie rule a task with ratio exactly β\betaβ is allocated by the coin rather than to the efficient agent.

Formalization scope

  • Agents are Fin 2 (agent 111 is 0, agent 222 is 1); the other agent is other i = 1 - i. Tasks are Fin k; allocations are functions Fin k → Fin 2. The statements hold for every kkk, including k=0k = 0k=0.
  • Types are positive: every truthfulness quantifier ranges over positive declarations, true types and misreports, and the approximation bound is stated on positive type vectors. The reduced-case and merging milestones are pure real inequalities with nonnegative times, since the paper represents missing tasks by zero times.
  • Payments are handed to the agent; utility is quasi-linear.
  • The make-span is a finite maximum (Finset.sup') over the two agents. The expected make-span is the average over all 2k2^k2k vectors sss, which is exactly the expectation of Definition 15 for the uniform distribution; no measure theory is used.
  • Universal (strong) truthfulness quantifies over all s∈{1,2}ks \in \{1,2\}^ks∈{1,2}k, the support of the uniform distribution. Truthfulness in expectation over sss is weaker and is not the notion stated.
  • The tie rule of Fig. 1 (≤\le≤: ties go to the favoured agent) is kept.
  • The goal fixes β=4/3\beta = 4/3β=4/3; only Lemma 4.15 is stated for every β≥1\beta \ge 1β≥1. The ratio is compared with every allocation yyy, not with one fixed allocation, and the average is over all sss, not the best sss.
  • Roberts' theorem is stated for arbitrary output sets, type sets and valuations, with positive weights.
  • "Polynomial time computable" in Theorem 4.16 is not formalized; running time is out of scope.
  • Claim 4.19 (the reduction to the four-task case) is not a separate item beyond its part 5, because its parts are instance transformations with a limiting step, not a single statement; a solver may formalize the reduction in any form that proves Lemma 4.18.

Contributions welcome: proofs of the milestones, and reusable lemmas on averages of maxima over product coin spaces.

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • K. Roberts, The characterization of implementable choice rules, in J.-J. Laffont (ed.), Aggregation and Revelation of Preferences, North-Holland, 1979, pp. 321–349.
  • T. Groves, Incentives in teams, Econometrica 41 (1973) 617–631. https://doi.org/10.2307/1914085
10 thms3 active usersReviewed
🏆Completed
Mechanism DesignOperations ResearchOptimization·Captain: mikedeng1

Algorithmic Mechanism Design IV: No Local Truthful Mechanism Achieves a c-Approximation for Task Scheduling for Any c < nResearch Paper

Motivation

Nisan and Ronen's Algorithmic Mechanism Design (Games and Economic Behavior 35, 2001) asks how well a computational task can be carried out when its inputs are held by self-interested agents who may lie about them. Their test case is scheduling on unrelated machines: tasks must be assigned to agents (machines), each agent privately knows how long it needs for each task, and the planner wants to minimize the time at which the last agent finishes. The paper shows that the mechanism MinWork, which gives each task to the fastest agent and pays it the second-fastest time, is truthful and loses a factor of at most nnn against the optimum, and that no truthful mechanism can do better than a factor 222. It then conjectures (Conjecture 4.9) that the factor nnn cannot be improved by any truthful mechanism.

That conjecture became the Nisan–Ronen conjecture, one of the central questions of algorithmic mechanism design. A sequence of papers raised the general lower bound from 222 to 1+21 + \sqrt 21+2​ (Christodoulou, Koutsoupias and Vidali), to 1+φ≈2.6181 + \varphi \approx 2.6181+φ≈2.618 (Koutsoupias and Vidali) and to larger constants, and Christodoulou, Koutsoupias and Kovács (STOC 2023) finally proved the conjecture for all deterministic truthful mechanisms. In the original paper, Nisan and Ronen confirm the conjecture for two restricted classes of mechanisms, with short direct arguments. This mission concerns the second class, local mechanisms (Theorem 4.12).

Setting

There are kkk tasks j∈{1,…,k}j \in \{1, \dots, k\}j∈{1,…,k} and nnn agents i∈{1,…,n}i \in \{1, \dots, n\}i∈{1,…,n}. A type vector ttt records, for every agent iii and task jjj, the positive time tjit^i_jtji​ agent iii needs for task jjj. An allocation xxx assigns every task to one agent; xix^ixi is the set of tasks of agent iii. For a set XXX of tasks write ti(X)=∑j∈Xtjit^i(X) = \sum_{j \in X} t^i_jti(X)=∑j∈X​tji​. The make-span of xxx is g(x,t)=max⁡iti(xi)g(x, t) = \max_i t^i(x^i)g(x,t)=maxi​ti(xi).

A direct mechanism (x,p)(x, p)(x,p) asks every agent for its type, computes an allocation x(t)x(t)x(t) from the declarations, and hands agent iii the payment pi(t)p^i(t)pi(t). Agent iii's utility is pi(t)−ti(xi(t))p^i(t) - t^i(x^i(t))pi(t)−ti(xi(t)) measured with its true times. The mechanism is truthful if declaring the true type maximizes each agent's utility whatever the other agents declare. The allocation rule is a ccc-approximation if g(x(t),t)≤c⋅g(y,t)g(x(t), t) \le c \cdot g(y, t)g(x(t),t)≤c⋅g(y,t) for every type vector ttt and every allocation yyy.

For a truthful mechanism the payment to agent iii depends only on the set it receives and on the declarations t−it^{-i}t−i of the others (Proposition 4.4). This gives the price offered to agent iii for a set XXX (Definition 12):

pi(X,t−i)={pi(t′i,t−i)if some t′i gives xi(t′i,t−i)=X,0otherwise.p^i(X, t^{-i}) = \begin{cases} p^i(t'^i, t^{-i}) & \text{if some } t'^i \text{ gives } x^i(t'^i, t^{-i}) = X, \\ 0 & \text{otherwise.} \end{cases}pi(X,t−i)={pi(t′i,t−i)0​if some t′i gives xi(t′i,t−i)=X,otherwise.​

A mechanism is local (Definition 14) if pi(X,t−i)p^i(X, t^{-i})pi(X,t−i) depends only on the other agents' times {tjl:l≠i,j∈X}\{t^l_j : l \ne i, j \in X\}{tjl​:l=i,j∈X} on the tasks of XXX. MinWork is local: its price for XXX is ∑j∈Xmin⁡l≠itjl\sum_{j \in X} \min_{l \ne i} t^l_j∑j∈X​minl=i​tjl​.

Formalization targets

Goal: Theorem 4.12

For every n≥1n \ge 1n≥1, every k≥n2k \ge n^2k≥n2 and every real c<nc < nc<n, no truthful local mechanism is a ccc-approximation:

∀(x,p) truthful and local, ∀c<n:∃ t, yg(x(t),t)>c⋅g(y,t).\forall (x, p) \text{ truthful and local},\ \forall c < n:\quad \exists\, t,\ y \quad g(x(t), t) > c \cdot g(y, t).∀(x,p) truthful and local, ∀c<n:∃t, yg(x(t),t)>c⋅g(y,t).

The bound holds for every c<nc < nc<n, so together with MinWork it shows that nnn is the exact best ratio for local truthful mechanisms.

Milestones

  1. Proposition 4.4 (Independence). Payments depend only on the allocated set and on t−it^{-i}t−i.
  2. Proposition 4.5 (Maximization). xi(t)x^i(t)xi(t) maximizes pi(X,t−i)−ti(X)p^i(X, t^{-i}) - t^i(X)pi(X,t−i)−ti(X) over the sets XXX that agent iii can obtain.
  3. Lemma 4.13. Every type vector has type vectors arbitrarily close to it at which each agent's maximizing set is unique.
  4. Claim 4.14, first step. If xi(t)x^i(t)xi(t) is the unique maximizer, lowering agent iii's times on xi(t)x^i(t)xi(t) keeps xi(t)x^i(t)xi(t).
  5. Ratio step. An allocation that gives one agent nnn tasks of time about 111, while every other agent's own tasks are nearly free, has make-span about nnn, while splitting those nnn tasks gives make-span about 111.

Significance

The result. Theorem 4.12 settles the Nisan–Ronen conjecture for a natural class of mechanisms. Locality captures the mechanisms in which the price for a bundle of tasks is set only by the competition for those tasks. It includes MinWork and, more generally, every mechanism that prices tasks separately using the other agents' bids on them. The theorem says that for this class the trivial per-task auction is already optimal, so any improvement over the ratio nnn must use prices that depend on the other agents' times on tasks outside the bundle.

Formalizing it. The statement is not open: it follows from the 2023 proof of the Nisan–Ronen conjecture, and Nisan and Ronen's own argument is much shorter. That argument is a sketch, though. Lemma 4.13 rests on an informal measure-theoretic appeal, and the core claim relies on a maximization property stated over all sets of tasks. A machine-checked proof pins down exactly which properties of truthful mechanisms the short argument needs. None of these results is known to have been formalized. The definitions (type vectors, truthful mechanisms, prices, locality) are shared with the other missions of this series.

Difficulty

An argument that looks at one agent at a time does not go through. Changing one agent's declaration changes the prices offered to every other agent, so an allocation that is stable for one agent can shift for another. The argument needs a type vector at which every agent's choice is strict, and only then can it lower times agent by agent and follow the allocation. Producing such a type vector is Lemma 4.13. The printed argument for it applies a "for almost every type vector" statement to sets defined by the price functions of an arbitrary mechanism, which need not be measurable. A proof must therefore work without any regularity of the mechanism. A second difficulty is Definition 12's convention that a set the agent cannot obtain has price 000. Locality constrains these zero prices too, and the argument has to account for sets that are obtainable at one type vector and not at a nearby one.

Formalization scope

Agents are Fin n, tasks Fin k. An allocation is a function Fin k → Fin n, a type vector is Fin n → Fin k → ℝ, and a mechanism is a pair of functions alloc (declarations to allocation) and pay (declarations to the payment handed to each agent). Utilities are quasi-linear. All types, declarations and misreports are positive, and every truthfulness, locality and approximation quantifier ranges over positive type vectors. The make-span is a Finset.sup' over the nonempty set of agents ([NeZero n]).

Conventions and explicit thresholds:

  • k≥n2k \ge n^2k≥n2. The theorem is printed without a bound on the number of tasks, and its proof begins "Let k≥n2k \ge n^2k≥n2". The goal carries k≥n2k \ge n^2k≥n2 as a hypothesis.
  • Truthfulness is assumed. §4.3 assumes throughout that the mechanism is truthful (by the revelation principle this is no loss). The goal quantifies over all truthful local mechanisms.
  • Prices use Definition 12 literally, including the value 000 for sets the agent cannot obtain, and locality is Definition 14 applied to that price function over all sets XXX, not only single tasks. When several declarations give the same set, the price uses one chosen witness; by Proposition 4.4 the choice does not matter for truthful mechanisms.
  • Proposition 4.5 is stated over the sets the agent can obtain. As printed, over all subsets, it is false for a truthful mechanism that never leaves an agent idle and pays it negative amounts. Uniqueness of maximizers (Lemma 4.13, Claim 4.14) refers to the same family.
  • Lemma 4.13 uses Mathlib's norm on Fin n → Fin k → ℝ, the sup norm. No measurability of the mechanism is assumed.
  • Claim 4.14 is printed at tji=1t^i_j = 1tji​=1 with 0<ε<10 < \varepsilon < 10<ε<1. The first step is stated at any type vector, with 0<ε≤tji0 < \varepsilon \le t^i_j0<ε≤tji​ on the lowered tasks.
  • Running time and computability are out of scope.

Ruled-out trivializations: locality is not restricted to single tasks; the goal does not assume that maximizers are unique at every type vector (that is Lemma 4.13's conclusion at one point, not a hypothesis); and the bound holds for every c<nc < nc<n, not for some.

Needed infrastructure: finite sums over allocation fibres, sup norms on function spaces, and a genericity argument for finitely many affine functions (Lemma 4.13). The model file and the price and locality definitions are reusable in the other missions of the series. Proofs of individual milestones are welcome independently.

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • A. Mas-Colell, M. D. Whinston, J. R. Green, Microeconomic Theory, Oxford University Press, 1995 (pp. 876–880, basic properties of truthful mechanisms).
  • G. Christodoulou, E. Koutsoupias, A. Vidali, A lower bound for scheduling mechanisms, Algorithmica 55 (2009).
  • E. Koutsoupias, A. Vidali, A lower bound of 1+φ for truthful scheduling mechanisms, Algorithmica 66 (2013).
  • G. Christodoulou, E. Koutsoupias, A. Kovács, A proof of the Nisan–Ronen conjecture, STOC 2023.
8 thms3 active usersReviewed
🏆Completed
Mechanism DesignOperations ResearchOptimization·Captain: mikedeng1

Algorithmic Mechanism Design II: A Lower Bound for Truthful Task SchedulingResearch Paper

Motivation

Algorithms deployed on the Internet often take their inputs from parties who own them and who may lie when lying pays. Nisan and Ronen's Algorithmic Mechanism Design (Games and Economic Behavior 35, 2001) proposed studying optimization problems in this setting: the algorithm designer may hand out payments, and must guarantee that the intended output is produced when every participant acts in its own interest. The paper's central test case is scheduling on unrelated machines, a standard problem of combinatorial optimization, in which the machines are the selfish participants and only they know how long each job takes them.

For this problem the paper shows that incentives cost a factor of two at least: with two or more machines, no mechanism can guarantee a make-span below twice the optimum. This was the first lower bound separating what incentive-compatible mechanisms can achieve from what ordinary approximation algorithms can achieve, and it started a line of work on the "Nisan–Ronen conjecture" (that the right factor for nnn machines is nnn), with improved lower bounds by Christodoulou, Koutsoupias and Vidali (Algorithmica, 2009) and by Koutsoupias and Vidali (Algorithmica, 2013), and a resolution announced by Christodoulou, Koutsoupias and Kovács (STOC 2023).

Setting

There are nnn agents (machines) i=1,…,ni = 1,\dots,ni=1,…,n and kkk tasks j=1,…,kj = 1,\dots,kj=1,…,k. Agent iii's private type is the vector ti=(t1i,…,tki)t^i = (t^i_1,\dots,t^i_k)ti=(t1i​,…,tki​) of positive real numbers, tjit^i_jtji​ being the time agent iii needs for task jjj; a type vector is t=(t1,…,tn)t = (t^1,\dots,t^n)t=(t1,…,tn). An allocation xxx assigns every task to one agent; xix^ixi is the set of tasks given to agent iii. For a set XXX of tasks write ti(X)=∑j∈Xtjit^i(X) = \sum_{j\in X} t^i_jti(X)=∑j∈X​tji​. The objective is the make-span

g(x,t)=max⁡iti(xi),g(x,t) = \max_{i} t^i(x^i),g(x,t)=imax​ti(xi),

and an allocation rule is a ccc-approximation if its make-span is at most ccc times that of every allocation, on every type vector.

A mechanism m=(o,p)m = (o,p)m=(o,p) gives each agent iii a set AiA^iAi of strategies. On a strategy profile a=(a1,…,an)a = (a^1,\dots,a^n)a=(a1,…,an) it outputs an allocation o(a)o(a)o(a) and hands agent iii a payment pi(a)p^i(a)pi(a). An agent of type tit^iti has utility pi(a)−ti(oi(a))p^i(a) - t^i(o^i(a))pi(a)−ti(oi(a)). A strategy is dominant if it maximizes the agent's utility whatever the others play. The mechanism implements a ccc-approximation if every agent of every type has a dominant strategy and every profile of dominant strategies yields a ccc-approximate allocation.

A direct mechanism (x,p)(x,p)(x,p) has AiA^iAi equal to the set of types, and is truthful if reporting the true type is dominant. For a truthful mechanism, the price pi(X,t−i)p^i(X,t^{-i})pi(X,t−i) is the payment agent iii receives when, against the others' reports t−it^{-i}t−i, some report of its own makes it receive exactly XXX (and 000 if none does); the price difference is Δi(A,B)=pi(A∪B,t−i)−pi(A,t−i)\Delta^i(A,B) = p^i(A\cup B,t^{-i}) - p^i(A,t^{-i})Δi(A,B)=pi(A∪B,t−i)−pi(A,t−i).

Formalization targets

Goal: Theorem 4.6

For every n≥2n\ge 2n≥2, k≥3k\ge3k≥3 and c<2c<2c<2, no mechanism with any strategy sets implements a ccc-approximation:

∀ (A,o,p):¬ Implements(o,p,c).\forall\, (A, o, p):\quad \neg\ \mathrm{Implements}(o,p,c).∀(A,o,p):¬ Implements(o,p,c).

Milestones

  1. Proposition 2.1 (revelation principle): a mechanism implementing a ccc-approximation yields a truthful direct mechanism whose allocation rule is a ccc-approximation.
  2. Theorem 4.6 for truthful mechanisms (§4.3): no truthful direct mechanism has a ccc-approximate allocation rule for c<2c<2c<2. With milestone 1 it gives the goal.
  3. Proposition 4.4 (independence): for a truthful mechanism, t1−i=t2−it_1^{-i}=t_2^{-i}t1−i​=t2−i​ and xi(t1)=xi(t2)x^i(t_1)=x^i(t_2)xi(t1​)=xi(t2​) imply pi(t1)=pi(t2)p^i(t_1)=p^i(t_2)pi(t1​)=pi(t2​).
  4. Proposition 4.5 (maximization): xi(t)x^i(t)xi(t) maximizes pi(X,t−i)−ti(X)p^i(X,t^{-i}) - t^i(X)pi(X,t−i)−ti(X) over attainable XXX.
  5. Lemma 4.7: the price-difference inequalities satisfied by xi(t)x^i(t)xi(t), and the uniqueness statement for sets satisfying them strictly.
  6. Claim 4.8: for two agents, all-ones types and 0<ε<10<\varepsilon<10<ε<1, moving agent 1's times to ε\varepsilonε on its own bundle and 1+ε1+\varepsilon1+ε elsewhere leaves the allocation unchanged.
  7. The even case of the ratio: at that perturbed instance the mechanism's make-span is ∣x2(t)∣|x^2(t)|∣x2(t)∣ while some allocation achieves 12∣x2(t)∣+kε\tfrac12|x^2(t)| + k\varepsilon21​∣x2(t)∣+kε.

Significance

The result. Theorem 4.6 shows that the requirement of dominant-strategy incentive compatibility, by itself, rules out approximation ratios below 222 for scheduling on unrelated machines, a problem for which polynomial-time 222-approximation algorithms that ignore incentives exist (Lenstra, Shmoys, Tardos 1990) and for which the exact optimum is computable in exponential time. Combined with the MinWork mechanism of the same paper (an nnn-approximation), it determines the optimal ratio for two machines. It is the base case of the Nisan–Ronen conjecture and the prototype of the "characterize truthful mechanisms by prices" technique used throughout later work on the conjecture.

Formalizing it. The theorem has been proved since 1999, but no machine-checked version is known to exist. The mission produces a formal account of general mechanisms with arbitrary strategy sets, dominant-strategy implementation, the revelation principle in that generality, and the price characterization of truthful mechanisms (independence and maximization). These are reusable for every other lower bound in this paper and for the later literature on the conjecture.

Difficulty

The statement quantifies over all mechanisms, with arbitrary strategy sets and arbitrary payment functions, so no finite search settles it. The revelation principle reduces to truthful direct mechanisms, but even these are an infinite-dimensional family: the allocation rule may break ties in any way, and prices may be any functions of the other agents' reports.

The printed argument also has two places that need care. Proposition 4.5 and Lemma 4.7, as printed, range over all sets of tasks, while Definition 12 gives unattainable sets price 000; the statements hold only over attainable sets, and are formalized that way. And the case where agent 2's bundle has odd size is dispatched in one sentence ("which still yields the same allocation"), which the preceding lemma does not justify when agent 2's best bundle at the perturbed prices is not unique. A complete formal proof of the goal must supply an argument for that case.

Formalization scope

  • Agents are Fin n, tasks Fin k; an allocation is a function Fin k → Fin n; bundles may be empty. The make-span is a finite maximum and assumes n≥1n\ge1n≥1 (NeZero n).
  • Types, declarations and misreports are strictly positive reals throughout (Definition 10). Utility is quasi-linear; payments are handed to the agent and may have either sign.
  • A general mechanism has strategy sets A : Fin n → Type u (any universe), output ooo and payments ppp on dependent strategy profiles. Implements requires both that every agent of every positive type has a dominant strategy and that every profile of dominant strategies yields a ccc-approximate allocation. Dominance is against every profile of the others, not only dominant ones. Without the existence clause, a mechanism with no dominant strategies would implement vacuously; the definition excludes that.
  • Thresholds made explicit: n≥2n\ge2n≥2 and k≥3k\ge3k≥3, both taken from the proof ("We prove the theorem for the case of two agents"; "Let k≥3k\ge3k≥3"). The goal holds for each fixed nnn and kkk and every c<2c<2c<2, for every mechanism, with no restriction on tie-breaking and no requirement of strong truthfulness. At n=1n=1n=1 the claim is false.
  • Proposition 2.1 is stated for task scheduling with the ccc-approximation specification; "truthful implementation" is read as truth-telling dominant and the truthful output ccc-approximate.
  • Printed slips: Proposition 4.5 and Lemma 4.7 are stated over attainable sets; the "Moreover" of Lemma 4.7 requires YYY attainable. The odd case of the ratio step is not a milestone.
  • The reduction from n>2n>2n>2 to two agents ("having the other agents be much slower") is not a separate milestone; the goal covers every n≥2n\ge2n≥2.
  • Running time ("polynomial-time computable") is out of scope and not modelled.

Contributions of any of the milestones are welcome, as are alternative proofs of the goal that avoid the terse odd case.

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • A. Mas-Colell, M. D. Whinston, J. R. Green, Microeconomic Theory, Oxford University Press, 1995 (revelation principle, p. 871).
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Mathematical Programming 46 (1990) 259–271. https://doi.org/10.1007/BF01585745
  • G. Christodoulou, E. Koutsoupias, A. Vidali, A lower bound for scheduling mechanisms, Algorithmica 55 (2009).
  • E. Koutsoupias, A. Vidali, A lower bound of 1+φ for truthful scheduling mechanisms, Algorithmica 66 (2013).
  • G. Christodoulou, E. Koutsoupias, A. Kovács, A proof of the Nisan–Ronen conjecture, STOC 2023.
11 thms3 active usersReviewed
🏆Completed
Dynamical SystemsProbabilityStochastic Systems·Captain: mikedeng1

On the Global Convergence of Stochastic Fictitious Play II: Almost Sure Convergence in Zero-Sum Games and Symmetric Games with an Interior ESSResearch Paper

Motivation

Fictitious play is the oldest model of learning in games: players repeatedly play a fixed normal form game, and each round every player best-responds to the empirical frequencies of the opponents' past play. Brown (1951) proposed it as an algorithm for computing the value of a zero-sum game, and Robinson (1951) proved that the empirical frequencies converge to the set of equilibria in that case. In stochastic fictitious play (Fudenberg and Kreps 1993) each player's payoffs are perturbed by fresh random shocks before every choice. The shocks make best responses single-valued and smooth in beliefs, which puts the process within reach of stochastic approximation theory: its long-run behaviour is governed by a deterministic perturbed best response dynamic.

Before Hofbauer and Sandholm (2002), convergence of stochastic fictitious play was known only for 2×2 games (Fudenberg and Kreps 1993; Kaniovski and Young 1995) and for certain games with two strategies per player (Benaïm and Hirsch 1999). The difficulty was the perturbed dynamic itself, whose vector field involves choice probabilities with no closed form for general noise distributions. Hofbauer and Sandholm showed that every such dynamic can be rewritten with a deterministic payoff perturbation (their Theorem 2.1), and used that to carry Lyapunov functions over to arbitrary noise distributions. This mission covers the first two classes of games in their main convergence theorem: symmetric games with an interior evolutionarily stable strategy, and two player zero-sum games.

Setting

A two player normal form game has strategy sets S1={1,…,n1}S^1 = \{1,\dots,n^1\}S1={1,…,n1} and S2={1,…,n2}S^2 = \{1,\dots,n^2\}S2={1,…,n2} and utilities uα:S1×S2→Ru^\alpha : S^1 \times S^2 \to \mathbb Ruα:S1×S2→R. Player α\alphaα's mixed strategies form the simplex ΔSα\Delta S^\alphaΔSα, and Σ=ΔS1×ΔS2\Sigma = \Delta S^1 \times \Delta S^2Σ=ΔS1×ΔS2. The payoff vector Uα(x−α)∈RnαU^\alpha(x^{-\alpha}) \in \mathbb R^{n^\alpha}Uα(x−α)∈Rnα lists the expected payoff of each pure strategy of α\alphaα against the opponent's mixed strategy. The game is zero-sum if u1(s)=−u2(s)u^1(s) = -u^2(s)u1(s)=−u2(s) for every profile sss.

Each player α\alphaα has a shock density fαf^\alphafα on Rnα\mathbb R^{n^\alpha}Rnα. The choice function Cα(π)i=P(argmax⁡jπj+εj=i)C^\alpha(\pi)_i = P(\operatorname{argmax}_j \pi_j + \varepsilon_j = i)Cα(π)i​=P(argmaxj​πj​+εj​=i), for ε\varepsilonε with density fαf^\alphafα, gives the perturbed best response B~α(x−α)=Cα(Uα(x−α))\tilde B^\alpha(x^{-\alpha}) = C^\alpha(U^\alpha(x^{-\alpha}))B~α(x−α)=Cα(Uα(x−α)). The densities are required to be strictly positive with continuously differentiable choice functions ("the conditions of Theorem 2.1").

Standard stochastic fictitious play. Pure strategies are identified with basis vectors eie_iei​. Choices ζ1\zeta_1ζ1​ are arbitrary. At every time t≥1t \ge 1t≥1 each player α\alphaα draws a shock εtα\varepsilon^\alpha_tεtα​ with density fαf^\alphafα and plays at time t+1t+1t+1 the pure strategy maximizing Ukα(Zt−α)+(εtα)kU^\alpha_k(Z^{-\alpha}_t) + (\varepsilon^\alpha_t)_kUkα​(Zt−α​)+(εtα​)k​, where the beliefs are the time averages

Zt=1t∑u=1tζu∈Σ.Z_t = \frac1t \sum_{u=1}^t \zeta_u \in \Sigma .Zt​=t1​u=1∑t​ζu​∈Σ.

The shocks are independent over time and across players. The expected motion of ZtZ_tZt​ is the perturbed best response dynamic

(P)x˙α=B~α(x−α)−xαon Σ.\text{(P)}\qquad \dot x^\alpha = \tilde B^\alpha(x^{-\alpha}) - x^\alpha \quad\text{on } \Sigma .(P)x˙α=B~α(x−α)−xαon Σ.

Symmetric games. A two player game is symmetric if S1=S2={1,…,m}S^1 = S^2 = \{1,\dots,m\}S1=S2={1,…,m} and u1(i,j)=u2(j,i)u^1(i,j) = u^2(j,i)u1(i,j)=u2(j,i); it is described by the matrix Aij=u1(i,j)A_{ij} = u^1(i,j)Aij​=u1(i,j), and U1(z)=AzU^1(z) = AzU1(z)=Az. In symmetric stochastic fictitious play two players in roles 1 and 2 play at every time, their shocks are independent and identically distributed with one density fff, and the state is the average of all past plays in both roles,

Z^t=12t∑u=1t(ζ^u1+ζ^u2)∈ΔS1.\hat Z_t = \frac1{2t}\sum_{u=1}^t \big(\hat\zeta^1_u + \hat\zeta^2_u\big) \in \Delta S^1 .Z^t​=2t1​u=1∑t​(ζ^​u1​+ζ^​u2​)∈ΔS1.

Its mean dynamic is (SP) x˙=C(Ax)−x\text{(SP)}\ \dot x = C(Ax) - x(SP) x˙=C(Ax)−x on ΔS1\Delta S^1ΔS1. A mixed strategy x∗x^*x∗ in the interior of ΔS1\Delta S^1ΔS1 is an interior evolutionarily stable strategy (ESS) if x∗⋅Ax>x⋅Axx^*\cdot Ax > x\cdot Axx∗⋅Ax>x⋅Ax for all mixed x≠x∗x \ne x^*x=x∗ near x∗x^*x∗.

Rest points and chain recurrence. For a dynamic x˙=F(x)\dot x = F(x)x˙=F(x) on a compact set XXX, the rest points are the zeros of FFF in XXX. A point xxx is chain recurrent if for every ε>0\varepsilon > 0ε>0 one can return from xxx to xxx by following solution segments of length at least 111, with jumps of size less than ε\varepsilonε between segments.

Formalization targets

Goal: Theorem 6.1 (i) and (ii)

(i) If AAA has an interior ESS, then (SP) has a unique rest point x^\hat xx^ and

P(lim⁡t→∞Z^t=x^)=1.P\Big(\lim_{t\to\infty} \hat Z_t = \hat x\Big) = 1 .P(t→∞lim​Z^t​=x^)=1.

(ii) If the two player game is zero-sum, then (P) has a unique rest point x∗x^*x∗ and

P(lim⁡t→∞Zt=x∗)=1.P\Big(\lim_{t\to\infty} Z_t = x^*\Big) = 1 .P(t→∞lim​Zt​=x∗)=1.

Both hold for all shock densities meeting the conditions of Theorem 2.1, all probability spaces carrying the shocks, and all initial choices.

Milestones

  1. Theorem 2.1: for such a density, the choice function CCC is the unique maximizer C(π)=argmax⁡y∈int⁡Δ(y⋅π−V(y))C(\pi) = \operatorname{argmax}_{y \in \operatorname{int}\Delta}(y\cdot\pi - V(y))C(π)=argmaxy∈intΔ​(y⋅π−V(y)) for one admissible deterministic perturbation VVV.
  2. With an interior ESS, Λ^(x)=x⋅Ax−V(x)−W(Ax)\hat\Lambda(x) = x\cdot Ax - V(x) - W(Ax)Λ^(x)=x⋅Ax−V(x)−W(Ax), where W(π)=max⁡y(y⋅π−V(y))W(\pi) = \max_y (y\cdot\pi - V(y))W(π)=maxy​(y⋅π−V(y)), is strictly concave and a strict Lyapunov function for the deterministically perturbed dynamic (SPV).
  3. Its maximizer is the unique chain recurrent point of (SPV).
  4. In zero-sum games, Λ(x1,x2)=−V1(x1)−W1(U1(x2))−V2(x2)−W2(U2(x1))\Lambda(x^1,x^2) = -V^1(x^1) - W^1(U^1(x^2)) - V^2(x^2) - W^2(U^2(x^1))Λ(x1,x2)=−V1(x1)−W1(U1(x2))−V2(x2)−W2(U2(x1)) is strictly concave and a strict Lyapunov function for (PV).
  5. Its maximizer is the unique chain recurrent point of (P).
  6. The maximizer of Λ^\hat\LambdaΛ^ is the unique chain recurrent point of (SP).

Significance

The theorem gives global, almost sure convergence of a learning process for arbitrary noise distributions, not only for the logit (Gumbel) noise under which the perturbed dynamic has a closed form. For zero-sum games it is the stochastic counterpart of Robinson's theorem. For symmetric games with an interior ESS it shows that a population learning by stochastic fictitious play settles at a single mixed state. Since the choice functions are continuous, the players' choice probabilities converge as well. The limit is the rest point of the perturbed dynamic, which approximates a Nash equilibrium (in case (i), the ESS) as the noise vanishes.

On the formal side, the paper's results are proved, but no part of them is machine-checked, and the platform has no model of learning in games, of chain recurrence, or of stochastic approximation. The mission produces a formal model of stochastic fictitious play as a random process, formal statements of the Hofbauer and Hofbauer–Hopkins Lyapunov functions, and the chain recurrence characterizations that connect them to the process.

Difficulty

The obvious route replaces the process ZtZ_tZt​ by the ODE (P) and argues that (P) converges. That step is where the argument is incomplete: convergence of every solution of (P) does not give convergence of the stochastic process, because a stochastic approximation can in principle circulate near a set of orbits the ODE never follows. The right invariant is the chain recurrent set, and the limit sets of the process lie in a connected component of it (Benaïm and Hirsch 1999; Benaïm 1999). The characterization therefore has to be of chain recurrence, which is strictly weaker than asymptotic stability of individual orbits.

The second obstacle is that (P) itself is defined through the noise distribution and admits no useful Lyapunov function in general. The Lyapunov functions exist for the deterministic form (PV)/(SPV), and moving between the two forms requires the representation of Theorem 2.1, whose perturbation VVV has no closed form either.

Formalization scope

Players and strategies are indexed from 000. Mixed profiles live in ∏αRnα\prod_\alpha \mathbb R^{n^\alpha}∏α​Rnα and every vector field is defined on that ambient space. The processes are defined pathwise from a family of shock vectors on an arbitrary probability space. Ties in the argmax are broken by the smallest index, an event of probability zero because the shocks have densities. The shock drawn at time ttt produces the choice at time t+1t+1t+1. Shock densities are arbitrary strictly positive densities with continuously differentiable choice functions; no noise law is fixed, and the two players' densities in (ii) may differ. Independence is joint over times and players (and roles in (i)). The symmetric process has its own state in one simplex and is not the standard process applied to a symmetric game.

Deterministic perturbations are functions defined on the whole space whose values off the open simplex are ignored; derivatives are taken of their composition with the projection onto the affine plane {∑iyi=1}\{\sum_i y_i = 1\}{∑i​yi​=1}. Perturbed best responses in (PV) and (SPV) are supplied as maps together with the hypothesis that they are the unique maximizers. A strict Lyapunov function must increase strictly along every non-constant solution on (0,∞)(0,\infty)(0,∞). The ESS definition includes x≠x∗x \ne x^*x=x∗, which the source omits.

The conclusions assert existence and uniqueness of the rest point; they are not hypotheses. A statement for the ODE (P) in place of the process ZtZ_tZt​, for one fixed noise law, or with the ESS as the limit point would be a different theorem.

A complete development needs Theorem 2.1 (convex duality and the Legendre transform on the simplex), existence and uniqueness of solutions of (P), basic chain recurrence theory, and the stochastic approximation results of Benaïm and Hirsch, which are not restated here and are welcome as independent contributions. The model layer (games, payoff vectors, choice functions, stochastic fictitious play) is shared with the other missions of this series.

Selected references

  • J. Hofbauer and W. H. Sandholm, On the Global Convergence of Stochastic Fictitious Play, Econometrica 70(6), 2265–2294, 2002. https://doi.org/10.1111/1468-0262.00376 (theorem numbers and pages here follow the authors' manuscript of February 21, 2002).
  • D. Fudenberg and D. M. Kreps, Learning Mixed Equilibria, Games and Economic Behavior 5, 320–367, 1993. https://doi.org/10.1006/game.1993.1021
  • Y. M. Kaniovski and H. P. Young, Learning Dynamics in Games with Stochastic Perturbations, Games and Economic Behavior 11, 330–363, 1995. https://doi.org/10.1006/game.1995.1054
  • M. Benaïm and M. W. Hirsch, Mixed Equilibria and Dynamical Systems Arising from Fictitious Play in Perturbed Games, Games and Economic Behavior 29, 36–72, 1999. https://doi.org/10.1006/game.1999.0717
  • M. Benaïm, Dynamics of Stochastic Approximation Algorithms, Séminaire de Probabilités XXXIII, Lecture Notes in Mathematics 1709, 1–68, 1999. https://doi.org/10.1007/BFb0096509
  • J. Robinson, An Iterative Method of Solving a Game, Annals of Mathematics 54, 296–301, 1951. https://doi.org/10.2307/1969530
  • J. Hofbauer and E. Hopkins, Learning in Perturbed Asymmetric Games, Games and Economic Behavior 52, 133–152, 2005. https://doi.org/10.1016/j.geb.2004.06.006
12 thms3 active usersReviewed
PreviousPage 3 of 8Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me