Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Algorithmic Game Theory

425 missions · 177 completed

Missions

Open248Completed177All425
🏆Completed
CombinatoricsMechanism Design·Captain: mikedeng1

Strategy-Proofness and Arrow's Conditions 4: With Indifference Allowed, a Social Welfare Function Satisfying CS, NNR and IIA Is DictatorialResearch Paper

Motivation

A social welfare function turns the rankings of the members of a committee into one ranking for the committee. Arrow's general possibility theorem (Arrow, 1951/1963) shows that, once there are at least three alternatives, no such rule satisfies a short list of conditions that each look harmless unless it follows a single member's ranking. The theorem is the starting point of social choice theory and underlies the study of voting rules, preference aggregation in economics, and rank aggregation in computer science.

Arrow's own setting allows indifference: ballots and the social ordering are weak orders, and the conditions he imposed are citizens' sovereignty, non-negative response, and independence of irrelevant alternatives. Many textbook proofs, and the existing machine-checked versions, instead take strict ballots and replace the first two conditions by the Pareto condition.

Satterthwaite's discussion paper (Satterthwaite, Northwestern DP No. 122, 1974, journal version J. Econ. Theory 10 (1975)) gives a new proof of Arrow's theorem. Strict Arrovian social welfare functions correspond one-to-one to strategy-proof voting procedures with full range, and the Gibbard–Satterthwaite theorem then forces a dictator. His §6 extends the argument to weak orders by decomposing a social welfare function into a tie-breaking step followed by a strict one. This mission formalizes that weak-order extension and the strict theorem it rests on.

Timeline.

  • 1951: Arrow proves the general possibility theorem for weak orders under CS, NNR, IIA and non-dictatorship. The second edition (1963) corrects the first edition's statement.
  • 1973: Gibbard proves that every strategy-proof game form with at least three outcomes is dictatorial (Econometrica 41).
  • 1975: Satterthwaite proves the same independently for voting procedures, and shows that strategy-proof procedures and Arrovian social welfare functions correspond. This gives a proof of Arrow's theorem by way of strategy-proofness.

Setting

A committee InI_nIn​ of nnn individuals ranks a finite set SmS_mSm​ of mmm alternatives. A weak order RRR on SmS_mSm​ is a complete, transitive relation, and x R yx\,R\,yxRy reads "xxx is preferred or indifferent to yyy". Its strict part is x Rˉ yx\,\bar R\,yxRˉy: x R yx\,R\,yxRy and not y R xy\,R\,xyRx. The weak orders form πm\pi_mπm​. A strong order is a weak order with no indifference between distinct alternatives, and the strong orders form ρm\rho_mρm​. A ballot set is B=(B1,…,Bn)∈πmnB=(B_1,\dots,B_n)\in\pi_m^nB=(B1​,…,Bn​)∈πmn​.

A social welfare function uuu assigns to every ballot set a social ordering A=u(B)∈πmA=u(B)\in\pi_mA=u(B)∈πm​. A strict social welfare function μ\muμ is defined only on strong ballot sets ρmn\rho_m^nρmn​ and takes values in ρm\rho_mρm​. For W⊆SmW\subseteq S_mW⊆Sm​, ΨW(R)\Psi_W(R)ΨW​(R) is the set of RRR-best elements of WWW, and θW(R)\theta_W(R)θW​(R) is the restriction of RRR to WWW.

  • CS (citizens' sovereignty): for all distinct x,yx,yx,y some ballot set yields x Aˉ yx\,\bar A\,yxAˉy.
  • IIA (independence of irrelevant alternatives): if θW(Ci)=θW(Di)\theta_W(C_i)=\theta_W(D_i)θW​(Ci​)=θW​(Di​) for every iii, then ΨW(AC)=ΨW(AD)\Psi_W(A_C)=\Psi_W(A_D)ΨW​(AC​)=ΨW​(AD​).
  • NNR (non-negative response): if DDD differs from CCC only by raising an alternative xxx on some ballots, then x AˉC zx\,\bar A_C\,zxAˉC​z implies x AˉD zx\,\bar A_D\,zxAˉD​z for all z≠xz\neq xz=x.
  • Dictatorial: some iii exists such that x Bˉi yx\,\bar B_i\,yxBˉi​y implies x Aˉ yx\,\bar A\,yxAˉy for every ballot set and all x,yx,yx,y.

A tie-breaking function α\alphaα maps every weak ballot set to a strong one while keeping every strict preference. It is regular if each individual's ties are broken by a fixed strong order QiQ_iQi​.

Formalization targets

Goal: Theorem 3' (p. 49)

For n≥2n\ge 2n≥2, m≥3m\ge 3m≥3 and any social welfare function uuu on weak ballot sets,

u satisfies CS, NNR, IIA  ⟹  ∃ i  ∀B  ∀x,y:  x Bˉi y⇒x u(B)‾ y.u \text{ satisfies CS, NNR, IIA} \;\Longrightarrow\; \exists\, i\;\forall B\;\forall x,y:\; x\,\bar B_i\,y \Rightarrow x\,\overline{u(B)}\,y .u satisfies CS, NNR, IIA⟹∃i∀B∀x,y:xBˉi​y⇒xu(B)​y.

The converse is false with indifference, so the goal is one-directional.

Milestones

  1. Theorem 3 (p. 36): for strict μ\muμ, CS, NNR and IIA hold if and only if μ\muμ is dictatorial.
  2. Lemma 10, first sentence (p. 44): if uuu has range in ρm\rho_mρm​ and u=μ∘γu=\mu\circ\gammau=μ∘γ with γ\gammaγ regular and μ\muμ strict Arrovian, then uuu satisfies IIA, CS and NNR.
  3. Lemma 10, second sentence (p. 44): if uuu has range in ρm\rho_mρm​ and satisfies IIA, CS and NNR, then u=μ∘αu=\mu\circ\alphau=μ∘α for a tie-breaking function α\alphaα and a strict μ\muμ satisfying IIA, CS and NNR.
  4. Lemma 11 (p. 48): breaking the ties of each social ordering u(B)u(B)u(B) by a strong order QQQ preserves CS, NNR and IIA and gives range in ρm\rho_mρm​.

Significance

Theorem 3' is Arrow's theorem in the setting Arrow stated it: weak-order ballots, a weak social ordering, and the conditions CS and NNR instead of the Pareto condition. Lemma 10 and Lemma 11 together say that Arrovian social welfare functions with indifference are determined by strict ones up to tie-breaking. This is the structural fact the paper also uses for its weak-order correspondence (Theorem 2').

All results here are proved in the paper. None is formalized as stated. The platform holds a proved strict Arrow theorem, AGT.arrow_theorem, for social welfare functions on strict total orders under unanimity and pairwise IIA. Theorem 3's only-if half follows from it once CS, NNR and IIA are shown to imply the Pareto condition and the two encodings are bridged. The weak-order statement, the tie-breaking lemmas, and the "if" half of Theorem 3 are new to the platform.

Difficulty

Passing from strict to weak orders is the hard step. Restricting a weak ordering to a pair of alternatives does not determine its choice sets on larger sets once ties are present. A social welfare function that satisfies IIA on weak orders need not induce one on strong orders through an arbitrary tie-breaker. Breaking ties ballot by ballot with a non-regular rule can destroy IIA, and breaking ties in the social ordering can destroy NNR unless the same fixed order is used throughout. The obvious reduction is "break all ties and apply the strict theorem", and it fails: the dictator of the tie-broken function could depend on the tie-breaking order. The fact that it does not is part of what must be shown.

Formalization scope

  • Alternatives and individuals are finite types A and ι with decidable equality. nnn = Fintype.card ι, mmm = Fintype.card A, and n≥2n\ge 2n≥2, m≥3m\ge 3m≥3 are hypotheses as printed. All statements live in StrategyProofArrow.WeakArrow.
  • A weak order is a structure (a relation with completeness and transitivity). A strong order is the subtype with no indifference between distinct elements. Strong ballot sets are functions into that subtype, so a strict social welfare function is defined on admissible profiles only.
  • θW(C)=θW(D)\theta_W(C)=\theta_W(D)θW​(C)=θW​(D) is agreement of the two relations on W×WW\times WW×W. ΨW\Psi_WΨW​ is a set, compared as a set, since weak orders can have several best elements.
  • CS is stated for distinct x≠yx\neq yx=y. As printed ("for every x,yx,yx,y") it is unsatisfiable at x=yx=yx=y, and every theorem would become vacuous. No other trivializing reading is possible: the dictator conclusion is the paper's one-directional negation of ND, not u(B)=Biu(B)=B_iu(B)=Bi​, which would be false for weak orders.
  • Lemma 11's tie-breaker acts on a single ordering. It is encoded as breaking the ties of u(B)u(B)u(B) by a strong order QQQ, the "tie-breaking order for γ\gammaγ" of the proof of Theorem 3'.
  • Lemma 10's printed unm(B)=unm[γ(B)]u^{nm}(B)=u^{nm}[\gamma(B)]unm(B)=unm[γ(B)] is read u(B)=μ(γ(B))u(B)=\mu(\gamma(B))u(B)=μ(γ(B)), following the proof.

The definitions duplicate objects drafted in the sibling missions of this series (weak and strong orders, CS, NNR, IIA). Proofs of the strict theorem from the Gibbard–Satterthwaite theorem, bridges to AGT.arrow_theorem, and reusable lemmas about tie-breaking of weak orders are all welcome.

Selected references

  • M. A. Satterthwaite, Strategy-proofness and Arrow's Conditions: Existence and Correspondence Theorems for Voting Procedures and Social Welfare Functions, Northwestern University CMS-EMS Discussion Paper No. 122, 1974 (rev. Dec. 12, 1974); J. Econ. Theory 10 (1975) 187–217. https://doi.org/10.1016/0022-0531(75)90050-2
  • K. J. Arrow, Social Choice and Individual Values, 2nd ed., Yale University Press, 1963. https://doi.org/10.12987/9780300186987
  • A. Gibbard, Manipulation of Voting Schemes: A General Result, Econometrica 41 (1973) 587–601. https://doi.org/10.2307/1914083
6 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

An Iterative Method of Solving a Game: For Every Vector System, min U(t)/t and max V(t)/t Converge to the Value of the GameResearch Paper

Motivation

A finite two-person zero-sum game is given by a real pay-off matrix, and its value can be computed by linear programming. In 1949 George W. Brown proposed a much simpler procedure, now called fictitious play: each player in turn plays a best pure reply to the accumulated play of the opponent so far, and the running averages are read off as estimates of the value (Brown, RAND P-78, 1949). Brown conjectured that both estimates converge to the value. Julia Robinson proved the conjecture in An Iterative Method of Solving a Game, Annals of Mathematics 54 (1951).

The result is the starting point of the theory of learning in games. Fictitious play is the basic model of boundedly rational players who best-respond to empirical frequencies, and the question "for which classes of games does it converge?" has driven a long line of work.

Timeline.

  • 1949–1951: Brown proposes the method and conjectures convergence for zero-sum games.
  • 1951: Robinson proves it for every vector system of every zero-sum matrix game; the statement contains no rate.
  • 1958: Shapiro extracts from Robinson's argument a rate: the gap (max⁡V(t)−min⁡U(t))/t(\max V(t) - \min U(t))/t(maxV(t)−minU(t))/t is O(t−1/(m+n−2))O(t^{-1/(m+n-2)})O(t−1/(m+n−2)) (doi:10.1002/cpa.3160110408).
  • 1964: Shapley gives a 3 × 3 bimatrix (non-zero-sum) game in which fictitious play does not converge (doi:10.1515/9781400882014-002).
  • 1996: Monderer and Shapley prove convergence for games with identical interests (doi:10.1006/jeth.1996.0014).
  • 2014: Daskalakis and Pan show that with adversarial tie-breaking the convergence can be much slower than the rate t−1/2t^{-1/2}t−1/2 conjectured by Karlin (arXiv:1412.4840).

Setting

Let A=(aij)A = (a_{ij})A=(aij​) be a real m×nm \times nm×n matrix, m,n≥1m, n \ge 1m,n≥1. The first player chooses a row iii, the second a column jjj, and the second pays the first aija_{ij}aij​. A mixed strategy is a probability vector x=(x1,…,xm)x = (x_1, \dots, x_m)x=(x1​,…,xm​) for the first player, or y=(y1,…,yn)y = (y_1, \dots, y_n)y=(y1​,…,yn​) for the second. For all mixed strategies,

min⁡j∑iaijxi≤max⁡i∑jaijyj.(1)\min_j \sum_i a_{ij} x_i \le \max_i \sum_j a_{ij} y_j. \tag{1}jmin​i∑​aij​xi​≤imax​j∑​aij​yj​.(1)

A pair (X,Y)(X, Y)(X,Y) for which equality holds is a solution, and the common number vvv is the value of the game. The minimax theorem says that a solution exists.

Write Ai⋅A_{i\cdot}Ai⋅​ for the iii-th row, A⋅jA_{\cdot j}A⋅j​ for the jjj-th column, and max⁡W\max WmaxW, min⁡W\min WminW for the largest and smallest component of a vector WWW. A vector system for AAA is a pair of sequences U(0),U(1),…U(0), U(1), \dotsU(0),U(1),… of nnn-vectors and V(0),V(1),…V(0), V(1), \dotsV(0),V(1),… of mmm-vectors with min⁡U(0)=max⁡V(0)\min U(0) = \max V(0)minU(0)=maxV(0) and

U(t+1)=U(t)+Ai⋅,V(t+1)=V(t)+A⋅j,U(t+1) = U(t) + A_{i\cdot}, \qquad V(t+1) = V(t) + A_{\cdot j},U(t+1)=U(t)+Ai⋅​,V(t+1)=V(t)+A⋅j​,

where vi(t)=max⁡V(t)v_i(t) = \max V(t)vi​(t)=maxV(t) and uj(t)=min⁡U(t)u_j(t) = \min U(t)uj​(t)=minU(t). In the alternate vector system the column satisfies uj(t+1)=min⁡U(t+1)u_j(t+1) = \min U(t+1)uj​(t+1)=minU(t+1) instead. A row iii is eligible in the interval (t,t′)(t, t')(t,t′) if vi(t1)=max⁡V(t1)v_i(t_1) = \max V(t_1)vi​(t1​)=maxV(t1​) for some t≤t1≤t′t \le t_1 \le t't≤t1​≤t′, and similarly a column jjj if uj(t2)=min⁡U(t2)u_j(t_2) = \min U(t_2)uj​(t2​)=minU(t2​) for some t≤t2≤t′t \le t_2 \le t't≤t2​≤t′.

With U(0)=V(0)=0U(0) = V(0) = 0U(0)=V(0)=0, U(t)/tU(t)/tU(t)/t is the payoff vector of the first player's empirical mixed strategy against each column, and V(t)/tV(t)/tV(t)/t that of the second player's against each row. In the Lean development these objects are vmax, vmin, IsVectorSystem, IsAltVectorSystem, RowEligible, ColEligible and IsSolution, in the namespace RobinsonFP.Convergence.

Formalization targets

Goal: the Theorem (p. 297)

For every vector system (U,V)(U, V)(U,V) for AAA, and vvv the value of the game,

lim⁡t→∞min⁡U(t)t=lim⁡t→∞max⁡V(t)t=v.\lim_{t\to\infty} \frac{\min U(t)}{t} = \lim_{t\to\infty} \frac{\max V(t)}{t} = v.t→∞lim​tminU(t)​=t→∞lim​tmaxV(t)​=v.

The statement holds for arbitrary initial vectors with min⁡U(0)=max⁡V(0)\min U(0) = \max V(0)minU(0)=maxV(0) and for every way of breaking ties.

Milestones, in the order of the proof

  1. Inequality (1).
  2. Lemma 1: lim inf⁡t→∞(max⁡V(t)−min⁡U(t))/t≥0\liminf_{t\to\infty} (\max V(t) - \min U(t))/t \ge 0liminft→∞​(maxV(t)−minU(t))/t≥0.
  3. Lemma 2: if every row and column is eligible in (s,s+t)(s, s+t)(s,s+t), then max⁡U(s+t)−min⁡U(s+t)≤2at\max U(s+t) - \min U(s+t) \le 2atmaxU(s+t)−minU(s+t)≤2at and max⁡V(s+t)−min⁡V(s+t)≤2at\max V(s+t) - \min V(s+t) \le 2atmaxV(s+t)−minV(s+t)≤2at, where a=max⁡i,j∣aij∣a = \max_{i,j}|a_{ij}|a=maxi,j​∣aij​∣.
  4. Lemma 3: under the same hypothesis, max⁡V(s+t)−min⁡U(s+t)≤4at\max V(s+t) - \min U(s+t) \le 4atmaxV(s+t)−minU(s+t)≤4at.
  5. Display (3) of the proof of Lemma 4: if some row or column is not eligible in (s,s+t∗)(s, s+t^*)(s,s+t∗), the gap max⁡V−min⁡U\max V - \min UmaxV−minU grows by less than 12εt∗\tfrac12 \varepsilon t^*21​εt∗ over that window, given the bound 12εt\tfrac12\varepsilon t21​εt for the vector systems of the submatrices.
  6. Lemma 4: for every ε>0\varepsilon > 0ε>0 there is t0t_0t0​, uniform over all vector systems for AAA, with max⁡V(t)−min⁡U(t)<εt\max V(t) - \min U(t) < \varepsilon tmaxV(t)−minU(t)<εt for t≥t0t \ge t_0t≥t0​.
  7. (max⁡V(t)−min⁡U(t))/t→0(\max V(t) - \min U(t))/t \to 0(maxV(t)−minU(t))/t→0.
  8. lim sup⁡min⁡U(t)/t≤v\limsup \min U(t)/t \le vlimsupminU(t)/t≤v and lim inf⁡max⁡V(t)/t≥v\liminf \max V(t)/t \ge vliminfmaxV(t)/t≥v.

Two further items are not milestones: the Theorem for the alternate vector system, which the paper says follows by the same proofs, and the bracketing min⁡U(t)/t≤v≤max⁡V(t′)/t′\min U(t)/t \le v \le \max V(t')/t'minU(t)/t≤v≤maxV(t′)/t′ when U(0)=V(0)=0U(0) = V(0) = 0U(0)=V(0)=0 (p. 297).

Significance

The Theorem shows that a payoff-based procedure with no linear algebra finds the value of every zero-sum matrix game. It was one of the first iterative methods for linear programs with a convergence proof, and it is the base case for every later convergence result about fictitious play: potential games, games with identical interests, 2×n2\times n2×n games, and continuous-time best-response dynamics.

The result is proved, and its proof is short. To our knowledge it has no machine-checked proof. The mission produces a Lean proof of the Theorem and its four lemmas, together with reusable definitions of vector systems and eligibility. A statement with an explicit rate, such as Shapiro's, or a proof for the alternate system, is a natural extension.

Difficulty

Lemmas 1–3 are elementary estimates. The difficulty is Lemma 4. The obvious approach follows a single run of the iteration and tries to show that the gap max⁡V(t)−min⁡U(t)\max V(t) - \min U(t)maxV(t)−minU(t) grows sublinearly. This fails because a run can spend arbitrarily long windows in which some row or column is never a best reply, and nothing about one fixed run controls the gap over such a window. What is needed is a bound that is uniform over all vector systems, whatever their initial vectors and tie-breaking, which is why t0t_0t0​ in Lemma 4 comes before the vector system, and why display (3) quantifies over every vector system of the smaller matrices. In Lean, this uniformity has to range over matrices of every smaller size, so the statements must be general in the index types.

Formalization scope

  • Rows and columns are indexed by finite nonempty types ι, κ (the paper's m,n≥1m, n \ge 1m,n≥1); Fin m, Fin n is a special case. The matrix is Matrix ι κ ℝ.
  • max⁡W\max WmaxW, min⁡W\min WminW are Finset.sup' and Finset.inf' over all indices, hence attained.
  • A vector system allows any maximizing row and minimizing column at each step (an existential per step). No tie-breaking rule is fixed, and the initial vectors are arbitrary subject to min⁡U(0)=max⁡V(0)\min U(0) = \max V(0)minU(0)=maxV(0). The case U(0)=V(0)=0U(0) = V(0) = 0U(0)=V(0)=0 is not imposed.
  • Time is a natural number. Limits are Tendsto … atTop (𝓝 ·); lim inf and lim sup of real sequences are stated in ε\varepsilonε-form (for every ε>0\varepsilon > 0ε>0, eventually), with no boundedness side conditions.
  • The value vvv is given by a solution: every statement about vvv assumes IsSolution A x y v, i.e. probability vectors xxx, yyy with min⁡j∑iaijxi=v=max⁡i∑jaijyj\min_j \sum_i a_{ij} x_i = v = \max_i \sum_j a_{ij} y_jminj​∑i​aij​xi​=v=maxi​∑j​aij​yj​. Such a solution exists by the minimax theorem, which is proved on the platform as MatousekLP.ZeroSum.minimax_equality in a different encoding. A statement with vvv free, or with "there exists vvv", would be false or would lose the identification with the value; neither is used.
  • In Lemmas 2 and 3, aaa is any upper bound on the ∣aij∣|a_{ij}|∣aij​∣. This is equivalent to the paper's a=max⁡i,j∣aij∣a = \max_{i,j}|a_{ij}|a=maxi,j​∣aij​∣.
  • In display (3), the bound for submatrices is assumed only for the submatrices that delete one row or one column, which makes the statement at least as strong as the paper's.
  • The paper's closing display on p. 301 prints lim⁡min⁡V(t)/t\lim \min V(t)/tlimminV(t)/t for lim⁡min⁡U(t)/t\lim \min U(t)/tlimminU(t)/t. The goal follows the statement of the Theorem on p. 297.

A general "restriction of a vector system to a submatrix" lemma would be reusable for later work on fictitious play. Proofs of any milestone are welcome, as are proofs of the two extra items.

Selected references

  • J. Robinson, An Iterative Method of Solving a Game, Annals of Mathematics 54(2), 296–301, 1951. https://doi.org/10.2307/1969530
  • G. W. Brown, Some notes on computation of games solutions, RAND Report P-78, 1949. https://www.rand.org/pubs/papers/P78.html
  • H. N. Shapiro, Note on a computation method in the theory of games, Communications on Pure and Applied Mathematics 11(4), 587–593, 1958. https://doi.org/10.1002/cpa.3160110408
  • L. S. Shapley, Some topics in two-person games, Advances in Game Theory, Annals of Mathematics Studies 52, 1964. https://doi.org/10.1515/9781400882014-002
  • D. Monderer, L. S. Shapley, Fictitious play property for games with identical interests, Journal of Economic Theory 68, 258–265, 1996. https://doi.org/10.1006/jeth.1996.0014
  • C. Daskalakis, Q. Pan, A counter-example to Karlin's strong conjecture for fictitious play, FOCS 2014. https://arxiv.org/abs/1412.4840
10 thms2 active usersReviewed
🏆Completed
Graph TheoryOperations Research·Captain: mikedeng1

Graphs and Cooperation in Games: The Unique Fair Allocation Rule, the Shapley Value of the Graph-Restricted Game, Is Totally Stable for Superadditive GamesResearch Paper

Motivation

Classical cooperative game theory assumes that any coalition of players can form and coordinate. In many settings cooperation is mediated by pairwise relationships: communication lines, contracts, alliances, or trade links. Roger Myerson's discussion paper Graphs and Cooperation in Games (Northwestern University, 1976; published in Mathematics of Operations Research 2(3), 1977, doi:10.1287/moor.2.3.225) models such a cooperation structure as a graph on the set of players and asks how the players should share the worth of the game when only linked players can coordinate directly.

The answer, now called the Myerson value, is the starting point of the literature on communication situations and network games. It underlies later work on network formation (Jackson and Wolinsky, A strategic model of social and economic networks, JET 1996) and on allocation rules for networks, and it is a standard textbook example of an axiomatic solution concept.

Timeline:

  • 1953. Shapley defines the Shapley value φ\varphiφ for transferable-utility games by efficiency, symmetry, a carrier axiom and additivity (Shapley 1953).
  • 1976–1977. Myerson introduces cooperation graphs, the fairness (equal gains from each link) condition, proves existence and uniqueness of the fair allocation rule, identifies it as the Shapley value of the graph-restricted game, proves its total stability for superadditive games, and extends existence and uniqueness to games without transferable utility in graph function form.

Setting

Let NNN be a nonempty finite set of players and CLCLCL the set of nonempty coalitions S⊆NS\subseteq NS⊆N. A game in characteristic function form is a vector v∈RCLv\in\mathbb R^{CL}v∈RCL; vSv_SvS​ is the transferable wealth coalition SSS can divide.

A link n:mn{:}mn:m is an unordered pair of distinct players and a graph ggg is a set of links; GRGRGR is the set of all graphs, gˉN\bar g^Ngˉ​N the complete graph, g∖n:mg\setminus n{:}mg∖n:m the graph with one link removed, and ∣g∣|g|∣g∣ the number of links. Players a,ba,ba,b are connected in SSS by ggg if a=b∈Sa=b\in Sa=b∈S or a path of links of ggg joins them through players of SSS only; the classes form the partition S/gS/gS/g of SSS, and N/gN/gN/g is the set of connected components of ggg. The graph-restricted game is

(v/g)S=∑T∈S/gvT.(v/g)_S=\sum_{T\in S/g}v_T .(v/g)S​=T∈S/g∑​vT​.

An allocation rule is a function Y:GR→RNY:GR\to\mathbb R^NY:GR→RN, with Yn(g)Y_n(g)Yn​(g) the payoff of player nnn under cooperation structure ggg. It is a fair allocation rule for vvv if

  1. (efficiency, (7)) ∑n∈SYn(g)=vS\sum_{n\in S}Y_n(g)=v_S∑n∈S​Yn​(g)=vS​ for every ggg and every component S∈N/gS\in N/gS∈N/g, and
  2. (equity, (10)) Yn(g)−Yn(g∖n:m)=Ym(g)−Ym(g∖n:m)Y_n(g)-Y_n(g\setminus n{:}m)=Y_m(g)-Y_m(g\setminus n{:}m)Yn​(g)−Yn​(g∖n:m)=Ym​(g)−Ym​(g∖n:m) for every ggg and every link n:m∈gn{:}m\in gn:m∈g.

YYY is totally stable if Yn(g)≥Yn(g∖n:m)Y_n(g)\ge Y_n(g\setminus n{:}m)Yn​(g)≥Yn​(g∖n:m) for every ggg and every link n:m∈gn{:}m\in gn:m∈g, and vvv is superadditive if vS∪T≥vS+vTv_{S\cup T}\ge v_S+v_TvS∪T​≥vS​+vT​ for disjoint S,T∈CLS,T\in CLS,T∈CL.

A game in graph function form assigns to every pair (S,g)(S,g)(S,g) with S∈N/gS\in N/gS∈N/g a closed, comprehensive (closed under decreasing coordinates), proper (∅≠W≠RS\emptyset\ne W\ne\mathbb R^S∅=W=RS) set w(S,g)⊆RSw(S,g)\subseteq\mathbb R^Sw(S,g)⊆RS of feasible payoffs; its fair allocation rule replaces (7) by (14), (Yn(g))n∈S∈∂w(S,g)(Y_n(g))_{n\in S}\in\partial w(S,g)(Yn​(g))n∈S​∈∂w(S,g).

Formalization targets

Goal: Theorem 3 (p. 8)

If vvv is superadditive, then the fair allocation rule YYY for vvv is totally stable:

Yn(g)≥Yn(g∖n:m)for all g∈GR, n:m∈g.Y_n(g)\ge Y_n(g\setminus n{:}m)\qquad\text{for all } g\in GR,\ n{:}m\in g .Yn​(g)≥Yn​(g∖n:m)for all g∈GR, n:m∈g.

Theorem 1 (p. 7) and Theorem 4 (p. 10)

Every v∈RCLv\in\mathbb R^{CL}v∈RCL has a unique fair allocation rule; every game www in graph function form has a unique YYY satisfying (14) and (10).

Theorem 2 (p. 8)

The fair allocation rule is

Y(g)=φ(v/g)for all g∈GR,in particular Y(gˉN)=φ(v).Y(g)=\varphi(v/g)\quad\text{for all }g\in GR,\qquad\text{in particular } Y(\bar g^N)=\varphi(v).Y(g)=φ(v/g)for all g∈GR,in particular Y(gˉ​N)=φ(v).

The milestones follow the paper's Section 7: the steps of the proof of Theorem 4 (displays (15)–(17)), Theorem 4, Theorem 1, the decomposition of v/gv/gv/g and the efficiency and equity of φ(v/g)\varphi(v/g)φ(v/g) (proof of Theorem 2), Theorem 2, and the monotonicity of v/gv/gv/g and φ(v/g)\varphi(v/g)φ(v/g) in a link (proof of Theorem 3). Theorem 3 is the goal because its proof uses the formula of Theorem 2, whose proof uses the uniqueness of Theorem 1, which is the transferable-utility case of Theorem 4: all four numbered results lie on one path.

Significance

The theorems give an axiomatic foundation for allocation in networks: two natural requirements, component-wise efficiency and equal gains from each link, single out one rule, and that rule is an explicit formula built from the Shapley value. At the complete graph it recovers the Shapley value itself, so the result is also a new characterization of the Shapley value. Total stability says that, for superadditive games, no player has an incentive to break a link, which connects the allocation rule to the question of which networks form.

The results are proved in the paper. A search of the platform found no formalization of cooperation graphs, the graph-restricted game, the Myerson value or total stability; the Shapley value is available as a platform definition and is reused. This mission produces machine-checked statements of all four theorems and of the intermediate steps of their proofs, together with a reusable definition layer for communication situations.

Difficulty

The equity condition (10) relates the payoff at a graph to the payoff at a graph with one fewer link, and it constrains only pairs of linked players; it is not evident that these conditions, together with efficiency on components, determine the rule at every graph, nor that they are consistent. Uniqueness and existence must hold simultaneously for all 2∣gˉN∣2^{|\bar g^N|}2∣gˉ​N∣ graphs, and the constraints couple each graph to all of its subgraphs and each player to every other player of its component. In the graph function form, efficiency becomes a boundary condition on a closed comprehensive set, and the existence and uniqueness of the relevant extremal point depend on all three properties of w(S,g)w(S,g)w(S,g).

Identifying the rule with φ(v/g)\varphi(v/g)φ(v/g) requires the efficiency of the Shapley value on each component of ggg, which is not the efficiency of φ\varphiφ on NNN, and equity requires tracking how the partitions S/gS/gS/g change when a link is removed. Total stability is false for general games: without superadditivity a player can gain by cutting a link, so the hypothesis cannot be dropped.

Formalization scope

Players are Fin n, with 0<n0<n0<n in every theorem as the paper assumes NNN nonempty; the paper's player kkk is index k−1k-1k−1. The general game carrier has its own definition module, and the graph-specific definitions build on it. Graphs are SimpleGraph (Fin n): gˉN\bar g^Ngˉ​N is ⊤, the empty graph ⊥, h⊆gh\subseteq gh⊆g is h ≤ g and h⊂gh\subset gh⊂g is h < g. A game is a function Finset (Fin n) → ℝ; its value at ∅\emptyset∅ is a junk coordinate that no definition reads, and no theorem assumes v∅=0v_\emptyset=0v∅​=0. Superadditivity quantifies over nonempty coalitions only. The Shapley value is the platform definition Supermodularity.Cooperative.ShapleyValue, applied after resetting the value at ∅\emptyset∅ to 000. RS\mathbb R^SRS is ↥S → ℝ with the product topology, and ∂\partial∂ is the topological frontier.

Explicit readings of the typescript:

  • The printed definition of "connected in SSS by ggg" (p. 3) asks ni∈Sn^i\in Sni∈S only for i≥1i\ge1i≥1; the formalization requires every vertex of the path, including the start, to lie in SSS, which makes S/gS/gS/g the partition of SSS the paper describes.
  • Comprehensiveness (p. 10) prints "∀n∈N\forall n\in N∀n∈N" for coordinates of vectors in RS\mathbb R^SRS; read as n∈Sn\in Sn∈S.
  • Display (17) writes Yn(h)Y_n(h)Yn​(h) under the index m∈Sm\in Sm∈S; read as Ym(h)Y_m(h)Ym​(h), as in (18b).
  • The proof headed "PROOF OF THEOREM 4." on p. 13 is the proof of Theorem 3.
  • "The unique fair allocation rule" in Theorems 2 and 3 is stated for every fair allocation rule; existence and uniqueness are Theorem 1.
  • The paper's NNN is nonempty; every theorem carries the corresponding hypothesis 0<n0<n0<n.

The equity and stability conditions quantify over links of ggg only. Quantifying over all pairs of players would make Theorem 1 false and the goal vacuous, so that reading is ruled out. Likewise (14) is boundary membership, not membership in w(S,g)w(S,g)w(S,g).

Contributions welcome: general lemmas on the partitions S/gS/gS/g (refinement under link deletion, restriction to components), Möbius inversion over the subgraph lattice of a finite simple graph, the carrier and null-player properties of the Shapley value, and the extremal-point lemma for closed comprehensive sets. These are reusable beyond this mission.

Selected references

  • R. B. Myerson, Graphs and Cooperation in Games, Discussion Paper No. 246, CMS-EMS, Northwestern University, September 1976; published in Mathematics of Operations Research 2(3):225–229, 1977. https://doi.org/10.1287/moor.2.3.225
  • L. S. Shapley, A Value for n-Person Games, in Contributions to the Theory of Games II, Annals of Mathematics Studies 28, Princeton University Press, 1953, pp. 307–317. https://doi.org/10.1515/9781400881970-018
  • M. O. Jackson and A. Wolinsky, A Strategic Model of Social and Economic Networks, Journal of Economic Theory 71(1):44–74, 1996. https://doi.org/10.1006/jeth.1996.0108
18 thms2 active usersReviewed
🏆Completed
Functional AnalysisProbability·Captain: mikedeng1

Existence of Correlated Equilibria II: A Game with Finite Strategy Sets and Continuous Payoffs Has a Countably Additive Correlated Equilibrium, However Many PlayersResearch Paper

Motivation

A correlated equilibrium describes a recommendation scheme for a game: a common random device selects a profile of actions, tells each player only their own recommended action, and no player gains in expectation by replacing that recommendation with another action. This makes sense even when there are infinitely many players. The finite-player existence theorem, however, does not settle what happens to a probability distribution on the product of infinitely many strategy sets, or whether that distribution is countably additive. Hart and Schmeidler proved that continuous payoffs and finite individual strategy sets suffice, with no countability assumption on the player set. Their Theorem 2(ii) is the target here.

The distinction between correlation and independent play is material. Peleg's 1969 paper studied equilibrium points with infinitely many players. Hart and Schmeidler reproduce a discontinuous binary-action example with no Nash equilibrium yet a countably additive correlated equilibrium, then change its payoffs to obtain a game with no countably additive correlated equilibrium. Those examples explain why the measure class and payoff regularity in the theorem need to be stated precisely. The modified example is an additional target of this mission. The main existence theorem is already proved in the 1989 paper; the mission asks for a machine-checked formalization of that known result and its selected proof steps.

Setting

Let NNN be a nonempty set of players, possibly uncountable. Player i∈Ni\in Ni∈N has a nonempty finite set SiS^iSi of pure strategies. A strategy profile is a tuple s∈S=∏i∈NSis\in S=\prod_{i\in N}S^is∈S=∏i∈N​Si. A game specifies a real payoff hi(s)h^i(s)hi(s) for every player and profile. Each SiS^iSi has the discrete topology; SSS has the product topology. Write Σ0\Sigma_0Σ0​ for the product σ-algebra, generated by cylinder events that inspect finitely many coordinates. It can be strictly smaller than the Borel σ-algebra of SSS when NNN is uncountable.

For ri,ti∈Sir^i,t^i\in S^iri,ti∈Si, write (s−i,ti)(s^{-i},t^i)(s−i,ti) for the profile obtained by replacing only the iiith coordinate of sss by tit^iti. A countably additive probability measure ppp on (S,Σ0)(S,\Sigma_0)(S,Σ0​) is a correlated equilibrium when every recommendation rir^iri gives a nonnegative expected advantage over switching to tit^iti:

∫{s:si=ri}[hi(s)−hi(s−i,ti)] dp(s)≥0.\int_{\{s:s^i=r^i\}}\left[h^i(s)-h^i(s^{-i},t^i)\right]\,dp(s)\ge 0.∫{s:si=ri}​[hi(s)−hi(s−i,ti)]dp(s)≥0.

The inequality is weighted by the probability of receiving rir^iri; it remains meaningful when that probability is zero. The integrand must be integrable on this cylinder. In the theorem, continuity and compactness provide the boundedness and measurability needed for the integral. For the separate discontinuous example, integrability is checked as part of the equilibrium condition.

Formalization targets

Theorem 2(ii): countably additive existence

For arbitrary nonempty NNN, finite nonempty SiS^iSi, and continuous payoffs hi:S→Rh^i:S\to\mathbb Rhi:S→R, the goal is

∃p∈Pσ(S,Σ0)∀i∈N ∀ri,ti∈Si,∫{s:si=ri}[hi(s)−hi(s−i,ti)] dp(s)≥0.\exists p\in\mathcal P_{\sigma}(S,\Sigma_0)\quad \forall i\in N\ \forall r^i,t^i\in S^i, \quad \int_{\{s:s^i=r^i\}}[h^i(s)-h^i(s^{-i},t^i)]\,dp(s)\ge0.∃p∈Pσ​(S,Σ0​)∀i∈N ∀ri,ti∈Si,∫{s:si=ri}​[hi(s)−hi(s−i,ti)]dp(s)≥0.

Here Pσ\mathcal P_{\sigma}Pσ​ denotes countably additive probability measures. The supporting targets follow the source's proof: every finite-restriction game has an equilibrium, a family of such equilibrium measures has a cluster point when tested against continuous real functions, and that cluster point satisfies the incentive inequalities. The cluster statement tests finite collections of functions, which is what a neighborhood in the weak topology requires.

Example 2: the continuity boundary

Players i=1,2,…i=1,2,\ldotsi=1,2,… choose si∈{0,1}s^i\in\{0,1\}si∈{0,1}. Let Case 1 mean that only finitely many players choose 111. The payoff is si/i2s^i/i^2si/i2 in Case 1 and −si-s^i−si otherwise. The additional target states

∄ a countably additive correlated equilibrium on (S,Σ0).\nexists\text{ a countably additive correlated equilibrium on }(S,\Sigma_0).∄ a countably additive correlated equilibrium on (S,Σ0​).

Theorem 2(i), which asserts existence for bounded measurable payoffs using a finitely additive probability on a larger algebra, is outside this proposal. It is a different conclusion requiring finitely additive integration.

Significance

Theorem 2(ii) gives an equilibrium distribution that is an ordinary countably additive probability measure, while allowing arbitrarily many players. It lets the same incentive test be applied to each player's observable recommendation event, without replacing the product σ-algebra by a larger space of events. Example 2 shows the statement changes when continuity is dropped: bounded measurable binary payoffs alone do not guarantee a countably additive equilibrium. Both claims are established in the source paper.

Formalizing the result produces reusable interfaces for probability measures on products of finite strategy spaces, finite-support equilibrium distributions, and weak tests by continuous functions. The local Lean files compile as statements; the goal and milestone theorems remain open for machine-checked proofs. Platform work on finite Nash and correlated equilibria, including AGT.nash_existence, AGT.IsCorrelatedEquilibrium, Aumann1987.*, and CalibratedCE.*, supplies related vocabulary but uses finite-player or different distribution conventions. None of those declarations is used as a substitute for this theorem about an arbitrary player set.

Difficulty

Finite strategy sets do not make the full profile space finite when the player set is infinite. A direct finite-game argument therefore supplies only finite restrictions, and an arbitrary limit of their distributions may lose either countable additivity or the incentive inequalities if the topology and σ-algebra are handled carelessly. Continuity is what makes the payoff-difference tests compatible with the weak topology on measures. The paper's discontinuous Example 2 rules out the tempting extension from continuous to merely bounded measurable payoffs.

Formalization scope

Profiles have Lean type ∀ i, S i; payoffs have type ι → (∀ i, S i) → ℝ. The theorem assumes [Nonempty ι], a finite nonempty strategy type for each player, discrete topologies and discrete measurable structures on the factors, and continuity of every payoff on the product. It does not assume Countable ι. The default Pi measurable structure is Σ0\Sigma_0Σ0​. Measures are Mathlib's countably additive Measure, with IsProbabilityMeasure. IsCorrelatedEq includes IntegrableOn explicitly, because an undefined Bochner integral otherwise evaluates to zero in Lean and could make the equilibrium condition empty.

An f-set has a nonempty finite strategy subset at every coordinate and differs from a singleton at only finitely many coordinates. Finite weighted profiles represent its equilibrium measure; this avoids treating a profile singleton as measurable in an uncountable product. For the cluster-point statements, f-sets contain a fixed anchor profile s^\hat ss^. The paper orders all f-sets by inclusion and calls them a net, but that index set is not directed: two singleton products can disagree at infinitely many coordinates. Anchored f-sets are directed and admit every finite coordinate demand used in the argument. This repair is explicit in the milestone statements and audit notes. Neither the goal nor the equilibrium definition depends on the chosen anchor.

The development needs product topology and σ-algebra facts, finite-game correlated-equilibrium existence, compactness for probability measures tested by continuous functions, and finite-sum-to-integral connections. Contributions proving these steps or the main theorem are in scope. The finitely additive conclusion of Theorem 2(i), Peleg's first example, and the paper's noncountably additive example measure are not formalized here. A sorry-free check supplies a concrete two-player coordination game and a correlated equilibrium, demonstrating that the main hypotheses are satisfiable.

Selected references

  • Sergiu Hart and David Schmeidler, Existence of Correlated Equilibria, Mathematics of Operations Research 14 (1989), 18–25. DOI: 10.1287/moor.14.1.18.
  • Bezalel Peleg, Equilibrium Points for Games with Infinitely Many Players, Journal of the London Mathematical Society s1-44 (1969), 292–294. DOI: 10.1112/jlms/s1-44.1.292.
7 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingLinear OptimizationOperations Research+1·Captain: mikedeng1

Linear Programming and Finite Markovian Control Problems VIII: Single-Controller Stochastic Games — a Dual Pair of Linear Programs Gives the Value and Stationary Optimal PoliciesTextbook

Motivation

A two-person zero-sum stochastic game (also called a Markov game) is a Markov decision problem with two decision makers who pull in opposite directions: at every time point both players choose an action simultaneously, one player pays the other, and the system moves to a random next state whose law depends on the current state and both actions. Stochastic games were introduced by Shapley (Shapley 1953) and are the standard model for adversarial sequential decisions in operations research, economics and computer science (pursuit–evasion, inspection, robust control against an adversarial environment).

Shapley proved that a discounted stochastic game has a value and that both players have stationary optimal policies. The value, however, is in general not computable by linear programming: it need not lie in the field generated by the data. Kallenberg's Example 6.2.1 (after Parthasarathy and Raghavan) has rational data and an irrational value in one state. When only one player controls the transition probabilities, the situation changes: the value and stationary optimal policies are the optimal solutions of one pair of dual linear programs (Parthasarathy & Raghavan, as cited in Kallenberg 1983, pp. 192 and 196; Kallenberg 1983, Chapter 6).

Timeline.

  • 1953: Shapley proves existence of the value and of stationary optimal policies for the discounted game.
  • 1977–1978: Parthasarathy and Raghavan study games in which one player controls the transitions and identify an order-field property for the value and optimal decision rules (cited in Kallenberg 1983, pp. 192, 196).
  • 1983: Kallenberg presents the dual pair (6.2.1)/(6.2.2), with the controlling player's policy read off the dual and the opponent's from the primal, and a constructive existence proof (Remark 6.2.2).

Setting

The state space is E={1,…,N}E = \{1,\dots,N\}E={1,…,N} with N>0N>0N>0. In state iii player I chooses an action aaa from a finite nonempty set A(i)A(i)A(i) and player II an action bbb from a finite nonempty set B(i)B(i)B(i). Player I then receives riabr_{iab}riab​ from player II, and the next state is jjj with probability piabj≥0p_{iabj} \ge 0piabj​≥0, where ∑jpiabj≤1\sum_j p_{iabj} \le 1∑j​piabj​≤1.

A history at time ttt is (i1,a1,b1,…,it−1,at−1,bt−1,it)(i_1,a_1,b_1,\dots,i_{t-1},a_{t-1},b_{t-1},i_t)(i1​,a1​,b1​,…,it−1​,at−1​,bt−1​,it​). A policy R1R_1R1​ of player I chooses, at each time and history, a probability distribution on A(it)A(i_t)A(it​); policies R2R_2R2​ of player II are defined likewise. A policy is stationary, written π∞\pi^\inftyπ∞ or ρ∞\rho^\inftyρ∞, if the distribution depends only on the current state. With vit(R1,R2)v_i^t(R_1,R_2)vit​(R1​,R2​) the expected reward in period ttt from initial state iii, the total reward is vi(R1,R2)=∑t≥1vit(R1,R2)v_i(R_1,R_2) = \sum_{t\ge1} v_i^t(R_1,R_2)vi​(R1​,R2​)=∑t≥1​vit​(R1​,R2​).

A pair (R1∗,R2∗)(R_1^*,R_2^*)(R1∗​,R2∗​) is optimal if, componentwise,

v(R1,R2∗)≤v(R1∗,R2∗)≤v(R1∗,R2)for all policies R1,R2,(6.1.1)v(R_1,R_2^*) \le v(R_1^*,R_2^*) \le v(R_1^*,R_2) \qquad\text{for all policies } R_1,R_2, \tag{6.1.1}v(R1​,R2∗​)≤v(R1∗​,R2∗​)≤v(R1∗​,R2​)for all policies R1​,R2​,(6.1.1)

and then val(TMG):=v(R1∗,R2∗)\mathrm{val(TMG)} := v(R_1^*,R_2^*)val(TMG):=v(R1∗​,R2∗​) is the value of the game.

Assumption 6.2.1 (contraction). There are μ≫0\mu \gg 0μ≫0 and α∈[0,1)\alpha\in[0,1)α∈[0,1) with ∑jpiabjμj≤αμi\sum_j p_{iabj}\mu_j \le \alpha\mu_i∑j​piabj​μj​≤αμi​ for all iii, a∈A(i)a\in A(i)a∈A(i), b∈B(i)b\in B(i)b∈B(i). The discounted game is the case μ=e\mu = eμ=e.

Assumption 6.2.2 (single controller). piabjp_{iabj}piabj​ does not depend on bbb; it is written piajp_{iaj}piaj​.

For a stationary ρ\rhoρ write ria(ρ)=∑briabρibr_{ia}(\rho) = \sum_b r_{iab}\rho_{ib}ria​(ρ)=∑b​riab​ρib​ and piaj(ρ)=∑bpiabjρibp_{iaj}(\rho)=\sum_b p_{iabj}\rho_{ib}piaj​(ρ)=∑b​piabj​ρib​. A vector yyy is TMG-superharmonic if some stationary ρ∞\rho^\inftyρ∞ of player II satisfies yi≥ria(ρ)+∑jpiaj(ρ)yjy_i \ge r_{ia}(\rho) + \sum_j p_{iaj}(\rho) y_jyi​≥ria​(ρ)+∑j​piaj​(ρ)yj​ for all a∈A(i)a\in A(i)a∈A(i), i∈Ei\in Ei∈E. For weights βj>0\beta_j>0βj​>0 the two linear programs are

min⁡{∑jβjyj ∣ ∑j(δij−piaj)yj−∑briabρib≥0; ∑bρib=1; ρib≥0}(6.2.1)\min\Big\{\textstyle\sum_j\beta_jy_j \ \Big|\ \sum_j(\delta_{ij}-p_{iaj})y_j-\sum_b r_{iab}\rho_{ib}\ge0;\ \sum_b\rho_{ib}=1;\ \rho_{ib}\ge0\Big\} \tag{6.2.1}min{∑j​βj​yj​ ​ ∑j​(δij​−piaj​)yj​−∑b​riab​ρib​≥0; ∑b​ρib​=1; ρib​≥0}(6.2.1) max⁡{∑izi ∣ ∑i∑a(δij−piaj)xia=βj; −∑ariabxia+zi≤0; xia≥0}(6.2.2)\max\Big\{\textstyle\sum_iz_i \ \Big|\ \sum_i\sum_a(\delta_{ij}-p_{iaj})x_{ia}=\beta_j;\ -\sum_a r_{iab}x_{ia}+z_i\le0;\ x_{ia}\ge0\Big\} \tag{6.2.2}max{∑i​zi​ ​ ∑i​∑a​(δij​−piaj​)xia​=βj​; −∑a​riab​xia​+zi​≤0; xia​≥0}(6.2.2)

Formalization targets

Goal: Theorem 6.2.3

Under Assumptions 6.2.1 and 6.2.2, let (y∗,ρ∗)(y^*,\rho^*)(y∗,ρ∗) and (x∗,z∗)(x^*,z^*)(x∗,z∗) be optimal solutions of (6.2.1) and (6.2.2), and πia∗:=xia∗/∑axia∗\pi^*_{ia} := x^*_{ia}/\sum_a x^*_{ia}πia∗​:=xia∗​/∑a​xia∗​. Then

v(R1,(ρ∗)∞)≤v((π∗)∞,(ρ∗)∞)=y∗≤v((π∗)∞,R2)for all policies R1,R2.v(R_1,(\rho^*)^\infty) \le v((\pi^*)^\infty,(\rho^*)^\infty) = y^* \le v((\pi^*)^\infty,R_2)\qquad\text{for all policies } R_1,R_2 .v(R1​,(ρ∗)∞)≤v((π∗)∞,(ρ∗)∞)=y∗≤v((π∗)∞,R2​)for all policies R1​,R2​.

The goal fixes no constants; it states that the LP pair produces the value and optimal stationary policies.

Milestones

  1. Theorem 6.2.1 (Shapley): under Assumption 6.2.1 both players have stationary optimal policies.
  2. Theorem 6.2.2: under Assumption 6.2.1, val(TMG)\mathrm{val(TMG)}val(TMG) is the smallest TMG-superharmonic vector.
  3. Theorem 6.2.4 (i): for a stationary π∞\pi^\inftyπ∞ of player I, xia(π)=[βT(I−P(π))−1]iπiax_{ia}(\pi) = [\beta^T(I-P(\pi))^{-1}]_i\pi_{ia}xia​(π)=[βT(I−P(π))−1]i​πia​ and zi(π)=min⁡brib(π)∑axia(π)z_i(\pi) = \min_{b} r_{ib}(\pi)\sum_a x_{ia}(\pi)zi​(π)=minb​rib​(π)∑a​xia​(π) give a feasible point of (6.2.2) with ∑izi(π)=min⁡ρ∑jβjvj(π∞,ρ∞)\sum_i z_i(\pi) = \min_\rho \sum_j\beta_j v_j(\pi^\infty,\rho^\infty)∑i​zi​(π)=minρ​∑j​βj​vj​(π∞,ρ∞).
  4. Theorem 6.2.4 (ii): every feasible (x,z)(x,z)(x,z) of (6.2.2) has x=x(π)x = x(\pi)x=x(π) and z≤z(π)z\le z(\pi)z≤z(π) for πia=xia/∑axia\pi_{ia} = x_{ia}/\sum_a x_{ia}πia​=xia​/∑a​xia​.

Theorems 6.2.1 and 6.2.2 hold for the general contracting game. Assumption 6.2.2 enters only from (6.2.1) on.

Significance

The result. Theorem 6.2.3 turns a single-controller game into a finite computation, Algorithm XXVII: solve one LP pair and read off the value and optimal stationary policies of both players. A consequence (Remark 6.2.1) is that the value and the optimal decision rules lie in the field generated by the rewards and transition probabilities. Example 6.2.1 shows this fails without Assumption 6.2.2. Theorem 6.2.4 matches the feasible points of the dual program with the stationary policies of the controlling player. This is the game version of the correspondence between state-action frequencies and policies in Markov decision problems.

Formalizing it. All results are proved in the book, and Theorem 6.2.1 is classical. None of them is formalized: the platform has turn-based stochastic games with positional strategies (TBSGStrategyIteration), which do not cover simultaneous moves or history-dependent randomized policies. The mission adds a reusable model of simultaneous-move stochastic games with history-dependent policies, together with machine-checked optimality of the LP solution against every such policy.

Difficulty

There are two difficulties. First, optimality in (6.1.1) is against every history-dependent randomized policy of the opponent, while the LP produces only stationary policies. Fixing one player's stationary policy reduces the game to a Markov decision problem for the other player (Remark 6.1.1), and the facts needed from that problem (stationary policies suffice, and the value is the smallest superharmonic vector) are theorems about contracting MDPs, not consequences of the LP. Second, Theorem 6.2.2 rests on Shapley's existence theorem, which is not a linear-programming fact: its usual proof is a fixed-point argument for the Shapley operator built from one-stage matrix games. Remark 6.2.2 indicates a route that avoids it, through the bounded polytope of state-action frequencies of a contracting MDP. Either way, LP duality alone does not give optimality against non-stationary opponents.

Formalization scope

  • Model. EEE is Fin N with N>0N>0N>0. Actions live in finite types α, β, and A(i)A(i)A(i), B(i)B(i)B(i) are nonempty Finsets. Rows are substochastic.
  • Policies. A history in Hn+1H_{n+1}Hn+1​ is a record of n+1n+1n+1 states and nnn actions of each player. A policy is a family of distributions indexed by time and history, supported on the current action set. Stationary policies are the image of state-dependent decision rules.
  • Probabilities and reward. History probabilities are explicit finite products, with no measure theory. The total reward is the tsum of the period rewards, which converges absolutely under Assumption 6.2.1, and every theorem assumes it.
  • Linear programs. Their variables are functions on all actions that vanish off A(i)A(i)A(i) (resp. B(i)B(i)B(i)). Optimality means feasible and attaining the min/max over the feasible set. The common piajp_{iaj}piaj​ is piab0jp_{iab_0j}piab0​j​ for a fixed b0∈B(i)b_0\in B(i)b0​∈B(i), and Assumption 6.2.2 makes the choice irrelevant. βj>0\beta_j>0βj​>0 is a hypothesis, as on p. 194.
  • The minimum in Theorem 6.2.4 (i) is over stationary policies of player II and is stated with attainment.

Restricting either player's policy class to stationary policies would make the optimality claims of Theorems 6.2.1 and 6.2.3 a statement about a finite family and is ruled out: the comparison class is all history-dependent randomized policies.

Lemma 6.1.1 is Mathlib's isSaddlePointOn_value (Mathlib/Order/SaddlePoint.lean) and is not restated. The LP duality theorems of Chapter 1 are proved on the platform (LinearOptimization.lp_strong_duality, lp_complementary_slackness) and may be used. Useful contributions include: the reduction of Remark 6.1.1 (a fixed stationary opponent gives an MDP), the contracting-MDP facts it needs, and a proof of Theorem 6.2.1. The model definitions are reusable for any finite stochastic game.

Selected references

  • L. C. M. Kallenberg, Linear Programming and Finite Markovian Control Problems, Mathematical Centre Tracts 148, Mathematisch Centrum, Amsterdam, 1983, Chapter 6. https://ir.cwi.nl/pub/13008
  • L. S. Shapley, Stochastic games, Proceedings of the National Academy of Sciences 39 (1953) 1095–1100. https://doi.org/10.1073/pnas.39.10.1095
  • T. Parthasarathy and T. E. S. Raghavan, Finite algorithms for stochastic games, International Conference on Dynamic Programming, Vancouver, 1977; cited in Kallenberg 1983, p. 232. https://ir.cwi.nl/pub/13008
  • T. Parthasarathy and T. E. S. Raghavan, An order field property for stochastic games when one player controls the transition probabilities, Game Theory Conference, Cornell, 1978; cited in Kallenberg 1983, p. 233. https://ir.cwi.nl/pub/13008
7 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Supply Chain Coordination with Contracts X: Under Forced Compliance, Options Contracts with Shares λ_l and min{λ_h, λ̂_h} Separate the Two Demand Types and Coordinate CapacityTextbook

Motivation

A manufacturer launching a new product often depends on a single supplier for a critical component, and the supplier must build capacity before demand is known. The manufacturer usually knows more about demand than the supplier does: her sales force, market research and order history give her a forecast the supplier cannot verify, and she has a reason to inflate it, since more capacity costs her nothing if the supplier pays for it. Whether contracts can make forecast sharing credible, and at what cost to the supply chain, is the subject of Cachon and Lariviere, "Contracting to assure supply: how to share demand forecasts in a supply chain" (Management Science 47(5), 2001, doi:10.1287/mnsc.47.5.629.10486). Section 6.10 of G. P. Cachon's survey chapter Supply Chain Coordination with Contracts (Handbooks in OR & MS, Vol. 11, 2003) presents a simplified version of that model, and this mission formalizes it from the author's January 2003 draft.

The section separates two regimes. Under forced compliance the supplier must build exactly the capacity the contract specifies; under voluntary compliance he may build less. The section's conclusion is that forced compliance allows both coordination and credible forecast sharing, while voluntary compliance allows forecast sharing only at the price of under-investment in capacity.

Setting

Demand DθD_\thetaDθ​ has one of two types θ∈{h,l}\theta \in \{h, l\}θ∈{h,l} with distribution function Fθ(x)=F(x∣θ)F_\theta(x) = F(x\mid\theta)Fθ​(x)=F(x∣θ). The page assumes Fθ(x)=0F_\theta(x) = 0Fθ​(x)=0 for x<0x < 0x<0, Fθ(x)>0F_\theta(x) > 0Fθ​(x)>0 for x≥0x \ge 0x≥0 (so demand has an atom at 000), FθF_\thetaFθ​ increasing and differentiable, and stochastic dominance Fh(x)<Fl(x)F_h(x) < F_l(x)Fh​(x)<Fl​(x) for all x≥0x \ge 0x≥0. The supplier SSS builds capacity kkk at cost ck>0c_k > 0ck​>0 per unit; after demand is observed he produces min⁡{Dθ,k}\min\{D_\theta, k\}min{Dθ​,k} at cost cp>0c_p > 0cp​>0 per unit; the manufacturer MMM earns r>cp+ckr > c_p + c_kr>cp​+ck​ per unit of demand satisfied; unused capacity is worth nothing.

Expected sales with xxx units of capacity are Sθ(x)=x−E[(x−Dθ)+]S_\theta(x) = x - E[(x - D_\theta)^+]Sθ​(x)=x−E[(x−Dθ​)+], and the supply chain's expected profit is

Ωθ(k)=(r−cp)Sθ(k)−ckk.\Omega_\theta(k) = (r - c_p)S_\theta(k) - c_k k .Ωθ​(k)=(r−cp​)Sθ​(k)−ck​k.

An optimal capacity kθok_\theta^okθo​ maximizes Ωθ\Omega_\thetaΩθ​ over k≥0k \ge 0k≥0, and Ωθo=Ωθ(kθo)\Omega_\theta^o = \Omega_\theta(k_\theta^o)Ωθo​=Ωθ​(kθo​).

In an options contract MMM buys qiq_iqi​ options at wow_owo​ each and pays wew_ewe​ for each option exercised. With k=qik = q_ik=qi​ her profit is Πθ(qi)=(r−we)Sθ(qi)−woqi\Pi_\theta(q_i) = (r - w_e)S_\theta(q_i) - w_o q_iΠθ​(qi​)=(r−we​)Sθ​(qi​)−wo​qi​ and the supplier's is (we−cp)Sθ(qi)+woqi−ckqi(w_e - c_p)S_\theta(q_i) + w_o q_i - c_k q_i(we​−cp​)Sθ​(qi​)+wo​qi​−ck​qi​. The contract with share λ\lambdaλ sets r−we=λ(r−cp)r - w_e = \lambda(r - c_p)r−we​=λ(r−cp​) and wo=λckw_o = \lambda c_kwo​=λck​. Under a wholesale price contract with price www the supplier earns πθ(k)=(w−cp)Sθ(k)−ckk\pi_\theta(k) = (w - c_p)S_\theta(k) - c_k kπθ​(k)=(w−cp​)Sθ​(k)−ck​k; the price inducing capacity kkk is wθ(k)=ck/Fˉθ(k)+cpw_\theta(k) = c_k/\bar F_\theta(k) + c_pwθ​(k)=ck​/Fˉθ​(k)+cp​ with Fˉθ=1−Fθ\bar F_\theta = 1 - F_\thetaFˉθ​=1−Fθ​, and the manufacturer then earns Πθ(k)=(r−wθ(k))Sθ(k)\Pi_\theta(k) = (r - w_\theta(k))S_\theta(k)Πθ​(k)=(r−wθ​(k))Sθ​(k).

With asymmetric information only MMM observes θ\thetaθ. Let π^\hat\piπ^ be the supplier's minimum acceptable profit, and define the shares

λl=1−π^Ωlo,λh=1−π^Ωho,λ^h=Ωlo−π^Ωl(kho),λH=min⁡{λh,λ^h}.\lambda_l = 1 - \frac{\hat\pi}{\Omega_l^o},\qquad \lambda_h = 1 - \frac{\hat\pi}{\Omega_h^o},\qquad \hat\lambda_h = \frac{\Omega_l^o - \hat\pi}{\Omega_l(k_h^o)},\qquad \lambda_H = \min\{\lambda_h, \hat\lambda_h\}.λl​=1−Ωlo​π^​,λh​=1−Ωho​π^​,λ^h​=Ωl​(kho​)Ωlo​−π^​,λH​=min{λh​,λ^h​}.

Formalization targets

Goal: forced-compliance separating contracts (§6.10.3, pp. 103–104)

The low type offers the options contract with share λl\lambda_lλl​ and initial order klok_l^oklo​, the high type the one with share λH\lambda_HλH​ and initial order khok_h^okho​. Assuming 0<π^<Ωlo0 < \hat\pi < \Omega_l^o0<π^<Ωlo​ and Ωl(kho)>0\Omega_l(k_h^o) > 0Ωl​(kho​)>0:

0<λl<λH<1,λl Ωh(klo)<λH Ωho,λH Ωl(kho)≤Ωlo−π^,0 < \lambda_l < \lambda_H < 1,\qquad \lambda_l\,\Omega_h(k_l^o) < \lambda_H\,\Omega_h^o,\qquad \lambda_H\,\Omega_l(k_h^o) \le \Omega_l^o - \hat\pi,0<λl​<λH​<1,λl​Ωh​(klo​)<λH​Ωho​,λH​Ωl​(kho​)≤Ωlo​−π^,

the supplier earns π^\hat\piπ^ from the low type and at least π^\hat\piπ^ from the high type, and each initial order kθok_\theta^okθo​ maximizes both firms' profits. The profit comparisons are stated between the contract profit functions, not between shares.

Milestones

  1. Sθ(x)=x−∫0xFθS_\theta(x) = x - \int_0^x F_\thetaSθ​(x)=x−∫0x​Fθ​ (p. 98).
  2. Ωθ\Omega_\thetaΩθ​ is concave, and k>0k > 0k>0 is optimal iff Fˉθ(k)=ck/(r−cp)\bar F_\theta(k) = c_k/(r - c_p)Fˉθ​(k)=ck​/(r−cp​) (p. 99).
  3. Ωl(k)<Ωh(k)\Omega_l(k) < \Omega_h(k)Ωl​(k)<Ωh​(k) for k>0k > 0k>0, hence Ωlo<Ωho\Omega_l^o < \Omega_h^oΩlo​<Ωho​ (implicit on p. 104).
  4. The options contract with share λ∈[0,1]\lambda \in [0,1]λ∈[0,1] gives Πθ=λΩθ\Pi_\theta = \lambda\Omega_\thetaΠθ​=λΩθ​ and the supplier (1−λ)Ωθ(1-\lambda)\Omega_\theta(1−λ)Ωθ​, so it coordinates (pp. 99–100).
  5. Under voluntary compliance, ∂π(kθo,kθo,θ)/∂k<0\partial\pi(k_\theta^o, k_\theta^o, \theta)/\partial k < 0∂π(kθo​,kθo​,θ)/∂k<0 (p. 100).
  6. A capacity k>0k > 0k>0 is optimal for the supplier under a wholesale price www iff w=wθ(k)w = w_\theta(k)w=wθ​(k) (p. 101).
  7. A stationary point k∗k^*k∗ of Πθ\Pi_\thetaΠθ​ satisfies Fˉθ(k∗)=Fˉθ(kθo)(1+fθ(k∗)Sθ(k∗)/Fˉθ(k∗)2)\bar F_\theta(k^*) = \bar F_\theta(k_\theta^o)\bigl(1 + f_\theta(k^*)S_\theta(k^*)/\bar F_\theta(k^*)^2\bigr)Fˉθ​(k∗)=Fˉθ​(kθo​)(1+fθ​(k∗)Sθ​(k∗)/Fˉθ​(k∗)2), so k∗<kθok^* < k_\theta^ok∗<kθo​ (p. 102).

Significance

The goal shows that with forced compliance a high-demand manufacturer can share her forecast credibly through the terms of a coordinating contract rather than its form: both types use the same contract family, the supply chain is coordinated in every state, and the only cost of asymmetric information is that the high type may be unable to push the supplier down to his reservation profit. The voluntary-compliance milestones show the other side: once the supplier may under-build, only the wholesale price affects his capacity, and the resulting capacity is strictly below the integrated optimum. Together they explain why compliance regimes matter in capacity contracting.

The results are established on the page with short arguments; none has a machine-checked proof. Formalizing them requires the derivative of expected sales for a distribution with an atom, the first-order characterization of a concave maximizer on a half-line, and careful bookkeeping of the incentive constraints. The demand and profit definitions are reusable for other capacity-procurement and newsvendor-type models.

Difficulty

The incentive constraints look like arithmetic on shares, but the strict inequality λl<λ^h\lambda_l < \hat\lambda_hλl​<λ^h​ needs Ωl(kho)<Ωlo\Omega_l(k_h^o) < \Omega_l^oΩl​(kho​)<Ωlo​: the low type's chain profit at the high type's capacity must be strictly below its optimum. The obvious argument via uniqueness of the maximizer is not available, because the page does not assume FθF_\thetaFθ​ strictly increasing, so Ωl\Omega_lΩl​ need not be strictly concave and may have a whole interval of maximizers. Likewise Ωlo<Ωho\Omega_l^o < \Omega_h^oΩlo​<Ωho​ needs a strict comparison of integrals of distribution functions. In the voluntary-compliance part, the derivative of wθ(k)w_\theta(k)wθ​(k) needs the density at k∗k^*k∗, and k∗<kθok^* < k_\theta^ok∗<kθo​ fails when that density is 000.

Formalization scope

Each demand law is a probability measure on R\mathbb RR and FθF_\thetaFθ​ is Mathlib's cdf. FθF_\thetaFθ​ is required to be differentiable only on (0,∞)(0,\infty)(0,∞), because the page's Fθ(0)>0F_\theta(0) > 0Fθ​(0)>0 makes it jump at 000. SθS_\thetaSθ​ is defined by the expectation x−E[(x−Dθ)+]x - E[(x - D_\theta)^+]x−E[(x−Dθ​)+], whose integrand is integrable because Dθ≥0D_\theta \ge 0Dθ​≥0 almost surely. Optimal capacities are passed as arguments characterized as maximizers over [0,∞)[0,\infty)[0,∞), never chosen; kθo>0k_\theta^o > 0kθo​>0 is footnote 46's assumption. Derivatives are HasDerivAt statements.

Hypotheses added relative to the page, all disclosed in the items: 0<π^<Ωlo0 < \hat\pi < \Omega_l^o0<π^<Ωlo​ and Ωl(kho)>0\Omega_l(k_h^o) > 0Ωl​(kho​)>0 in the goal (the page divides by Ωl(kho)\Omega_l(k_h^o)Ωl​(kho​) and needs λl∈(0,1)\lambda_l \in (0,1)λl​∈(0,1)); λ>0\lambda > 0λ>0 for the voluntary-compliance derivative (at λ=0\lambda = 0λ=0 it vanishes); Fˉθ(k∗)>0\bar F_\theta(k^*) > 0Fˉθ​(k∗)>0 and fθ(k∗)>0f_\theta(k^*) > 0fθ​(k∗)>0 for the non-coordination result. The page's assumption wθ′′>0w''_\theta > 0wθ′′​>0 is not needed and not imposed; its strict-concavity claim on p. 101 is not stated, because it would need FθF_\thetaFθ​ strictly increasing. The prior Pr⁡(θ=h)=ρ\Pr(\theta = h) = \rhoPr(θ=h)=ρ does not enter any statement. The page's "separating equilibrium" is formalized by its defining incentive and participation conditions, not by a general signalling-game solution concept; a predicate that holds by construction of λ^h\hat\lambda_hλ^h​ (for example λH≤λ^h\lambda_H \le \hat\lambda_hλH​≤λ^h​) is not an acceptable substitute for the profit inequalities. The fixed-fee condition of p. 105 is pure algebra on four numbers and is not included.

All definitions are local to the namespace CachonCoord.CapacityForecast. No platform theorem formalizes this model; the Snyder–Shen newsvendor definitions (SupplyChainTheory_contracts) and the revenue-sharing model of Cachon–Lariviere 2005 (RevShareCoord.*) concern different games and are not reused. Proofs of any milestone, and a sanity instance showing the model's hypotheses are satisfiable (for example demand with an atom pθp_\thetapθ​ at 000 and an exponential tail, ph<plp_h < p_lph​<pl​), are welcome.

Selected references

  • G. P. Cachon, Supply Chain Coordination with Contracts, in S. Graves and T. de Kok (eds.), Handbooks in Operations Research and Management Science, Vol. 11: Supply Chain Management, North-Holland, 2003, Ch. 6. doi:10.1016/S0927-0507(03)11006-7 (formalized from the author's 3rd draft, January 2003).
  • G. P. Cachon and M. A. Lariviere, Contracting to assure supply: how to share demand forecasts in a supply chain, Management Science 47(5), 629–646, 2001. doi:10.1287/mnsc.47.5.629.10486
  • R. E. Barlow and F. Proschan, Mathematical Theory of Reliability, Wiley, 1965 (increasing failure rate distributions, cited on p. 102).
10 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Supply Chain Coordination with Contracts IX: An Internal Market at the Shadow Price w(α, Q) Allocates Output Optimally, and Paying Its Expectation per Unit Induces the Optimal Effort e°Textbook

Motivation

In most contracts of the supply chain coordination literature the transfer payments are fixed when the contract is signed: a wholesale price www, a buy-back rate bbb, a revenue share ϕ\phiϕ. Some settings need payments that respond to information arriving after signing, such as realized demand at several retailers and realized production output. Fixing the per-unit price in advance then fails twice: for some output realizations the retailers do not buy everything that was produced, and for others they want more than exists, so the supplier must ration, which invites strategic ordering and misallocation (Cachon and Lariviere, 1999).

Section 6.9 of Cachon's survey chapter Supply Chain Coordination with Contracts (Handbooks in OR & MS, vol. 11, 2003) studies an alternative after Kouvelis and Lariviere (2000): the supplier commits to hold an internal market for output after demand is observed, and pays her own production manager a fixed amount per unit of realized output. The model is a variant of Porteus and Whang (1991), who studied incentives between manufacturing and marketing managers in a firm. The section shows that this pair of mechanisms coordinates both the production decision and the allocation decision without the supplier observing either the demand shocks or the manager's effort.

This mission is part IX of a series formalizing the capstone results of that chapter.

Setting

One supplier employs a production manager and sells to two independent retailers. The constant demand elasticity is η>1\eta>1η>1.

  1. The manager chooses a production input level e≥0e\ge0e≥0. The output is Q=YeQ=YeQ=Ye, where Y∈[0,1]Y\in[0,1]Y∈[0,1] is a random variable. The manager incurs the cost c(e)c(e)c(e), strictly convex and increasing, with derivative c′c'c′.
  2. Retailer i∈{1,2}i\in\{1,2\}i∈{1,2} observes the realization αi\alpha_iαi​ of a random variable Ai>0A_i>0Ai​>0.
  3. The supplier allocates qiq_iqi​ units to retailer iii with q1+q2≤Qq_1+q_2\le Qq1​+q2​≤Q. Retailer iii earns revenue qipi(qi)q_ip_i(q_i)qi​pi​(qi​) with the inverse demand pi(qi)=αiqi−1/ηp_i(q_i)=\alpha_iq_i^{-1/\eta}pi​(qi​)=αi​qi−1/η​, that is, αiqi(η−1)/η\alpha_iq_i^{(\eta-1)/\eta}αi​qi(η−1)/η​.

If retailer one receives the share γ\gammaγ of QQQ, total retailer revenue is

π(γ,α,Q)=(α1γ(η−1)/η+α2(1−γ)(η−1)/η)Q(η−1)/η.\pi(\gamma,\alpha,Q)=\big(\alpha_1\gamma^{(\eta-1)/\eta}+\alpha_2(1-\gamma)^{(\eta-1)/\eta}\big)Q^{(\eta-1)/\eta}.π(γ,α,Q)=(α1​γ(η−1)/η+α2​(1−γ)(η−1)/η)Q(η−1)/η.

The optimal share is γo(α)=α1η/(α1η+α2η)\gamma^o(\alpha)=\alpha_1^\eta/(\alpha_1^\eta+\alpha_2^\eta)γo(α)=α1η​/(α1η​+α2η​) (Eq. (44)), and π(α,Q)=π(γo(α),α,Q)\pi(\alpha,Q)=\pi(\gamma^o(\alpha),\alpha,Q)π(α,Q)=π(γo(α),α,Q) is revenue under it. The expected supply chain profit is Π(e)=E[π(A,Ye)]−c(e)\Pi(e)=E[\pi(A,Ye)]-c(e)Π(e)=E[π(A,Ye)]−c(e), and the optimal effort eoe^oeo solves the first-order condition (45).

In the decentralized system, if the per-unit price is www, retailer iii's profit is πi(qi,w)=αiqi(η−1)/η−wqi\pi_i(q_i,w)=\alpha_iq_i^{(\eta-1)/\eta}-wq_iπi​(qi​,w)=αi​qi(η−1)/η​−wqi​. The contingent price is

w(α,Q)=(η−1η)(α1η+α2η)1/ηQ−1/η.w(\alpha,Q)=\Big(\frac{\eta-1}{\eta}\Big)(\alpha_1^\eta+\alpha_2^\eta)^{1/\eta}Q^{-1/\eta}.w(α,Q)=(ηη−1​)(α1η​+α2η​)1/ηQ−1/η.

The manager is paid a fixed amount per unit of realized output. With K=E[(A1η+A2η)1/ηY(η−1)/η]K=E\big[(A_1^\eta+A_2^\eta)^{1/\eta}Y^{(\eta-1)/\eta}\big]K=E[(A1η​+A2η​)1/ηY(η−1)/η], the payment is

(η−1η)(eo)−1/ηK/E[Y](46),\Big(\frac{\eta-1}{\eta}\Big)(e^o)^{-1/\eta}K/E[Y]\qquad(46),(ηη−1​)(eo)−1/ηK/E[Y](46),

and his expected utility is u(e)=(payment)⋅E[Ye]−c(e)u(e)=(\text{payment})\cdot E[Ye]-c(e)u(e)=(payment)⋅E[Ye]−c(e).

Formalization targets

Goal

The goal has two parts.

  1. For every realization α1,α2>0\alpha_1,\alpha_2>0α1​,α2​>0 and output Q>0Q>0Q>0, at the price w(α,Q)w(\alpha,Q)w(α,Q) retailer one's unique optimal order is γo(α)Q\gamma^o(\alpha)Qγo(α)Q and retailer two's is (1−γo(α))Q(1-\gamma^o(\alpha))Q(1−γo(α))Q. So the retailers order exactly QQQ, the allocation maximizes revenue over all feasible allocations, and
∂π(α,Q)∂Q=w(α,Q).\frac{\partial\pi(\alpha,Q)}{\partial Q}=w(\alpha,Q).∂Q∂π(α,Q)​=w(α,Q).
  1. If eo>0e^o>0eo>0 satisfies (45), then under the payment (46) the manager's unique optimal effort is eoe^oeo. The payment equals E[Qw(A,Q)∣eo]/E[Q∣eo]E[Qw(A,Q)\mid e^o]/E[Q\mid e^o]E[Qw(A,Q)∣eo]/E[Q∣eo], and the supplier's expected profit from the market is zero.

Milestones

  • (44): revenue is strictly concave in γ\gammaγ, and γo(α)\gamma^o(\alpha)γo(α) is the unique optimal share.
  • The closed form π(α,Q)=(α1η+α2η)1/ηQ(η−1)/η\pi(\alpha,Q)=(\alpha_1^\eta+\alpha_2^\eta)^{1/\eta}Q^{(\eta-1)/\eta}π(α,Q)=(α1η​+α2η​)1/ηQ(η−1)/η.
  • (45): Π(e)=Ke(η−1)/η−c(e)\Pi(e)=Ke^{(\eta-1)/\eta}-c(e)Π(e)=Ke(η−1)/η−c(e) is strictly concave, and an interior eoe^oeo is optimal if and only if ((η−1)/η)(eo)−1/ηK−c′(eo)=0((\eta-1)/\eta)(e^o)^{-1/\eta}K-c'(e^o)=0((η−1)/η)(eo)−1/ηK−c′(eo)=0.
  • The retailers' first-order condition, and the market allocation at w(α,Q)w(\alpha,Q)w(α,Q).
  • ∂π(α,Q)/∂Q=w(α,Q)\partial\pi(\alpha,Q)/\partial Q=w(\alpha,Q)∂π(α,Q)/∂Q=w(α,Q).
  • The identity (46).
  • The manager's optimal effort and the supplier's zero expected profit.

Significance

The result shows that one mechanism handles two separate information problems. The market price w(α,Q)w(\alpha,Q)w(α,Q) is the shadow price of output. Charging it makes the retailers' independent orders add up to exactly the output and split it as the integrated firm would, and the supplier never needs to observe AAA. Paying the manager the output-weighted expectation of that shadow price, a single number fixed in advance, aligns his marginal incentive with the supply chain's, and the supplier does not need to observe eee. The supplier breaks even on the market. Kouvelis and Lariviere (2000) show that in more general settings she breaks even or loses money, so any profit must come from fixed fees. The section therefore illustrates a general design principle: market-based transfer prices inside a firm, combined with linear output-based pay.

The derivations are short calculus on the page. Formalizing them pins down what the page leaves implicit: the range of efforts and allocations; the role of E[Y]>0E[Y]>0E[Y]>0 and of the integrability of the shock; the fact that each retailer's problem has a unique interior optimum only at a positive price; and how the realized output Q=0Q=0Q=0 enters the expectation E[Qw(A,Q)]E[Qw(A,Q)]E[Qw(A,Q)]. To our knowledge none of these statements has been machine-checked before.

Difficulty

The deterministic part requires real-power calculus with a non-integer exponent (η−1)/η∈(0,1)(\eta-1)/\eta\in(0,1)(η−1)/η∈(0,1). Strict concavity of γ↦γ(η−1)/η\gamma\mapsto\gamma^{(\eta-1)/\eta}γ↦γ(η−1)/η has to be used on the closed interval [0,1][0,1][0,1], where the derivative blows up at the endpoints. The retailer's optimum has to be shown to be interior even though the profit at q=0q=0q=0 is defined.

The stochastic part requires pulling the effort out of the expectation, E[π(A,Ye)]=Ke(η−1)/ηE[\pi(A,Ye)]=Ke^{(\eta-1)/\eta}E[π(A,Ye)]=Ke(η−1)/η, pointwise in the shock, including at realizations with Y=0Y=0Y=0. The natural first idea, to differentiate under the expectation sign, is unnecessary but tempting. The obstacle it hides is that w(α,Ye)w(\alpha,Ye)w(α,Ye) is undefined where Y=0Y=0Y=0, so the identity (46) only holds once Qw(A,Q)Qw(A,Q)Qw(A,Q) is read as its limit 000 at Q=0Q=0Q=0. Uniqueness of the manager's optimum depends on strict convexity of ccc alone, since his payment is linear in eee.

Formalization scope

All objects live in the namespace CachonCoord.InternalMarket. The deterministic file Revenue defines π(γ,α,Q)\pi(\gamma,\alpha,Q)π(γ,α,Q), γo(α)\gamma^o(\alpha)γo(α) (as the printed formula, not as an argmax), π(α,Q)\pi(\alpha,Q)π(α,Q), πi(qi,w)\pi_i(q_i,w)πi​(qi​,w) and w(α,Q)w(\alpha,Q)w(α,Q) with real powers (Real.rpow). The file Model bundles a probability space with measurable A1,A2>0A_1,A_2>0A1​,A2​>0 and Y∈[0,1]Y\in[0,1]Y∈[0,1], the elasticity η>1\eta>1η>1, and the cost ccc. The cost is strictly convex and increasing on [0,∞)[0,\infty)[0,∞) and has derivative c′c'c′ at every e>0e>0e>0. On top of these, Model defines Π\PiΠ, KKK, the payment (46) (by its printed left side, not as the ratio it is claimed to equal), expected output and market revenue, and the manager's utility (from the payment scheme, not by the printed formula). Derivatives are HasDerivAt statements and optima are IsMaxOn over [0,1][0,1][0,1] or [0,∞)[0,\infty)[0,∞).

The standing assumptions are those of the model paragraph on p. 92: risk neutrality and the distributional assumptions above. Added hypotheses, each disclosed in the item's Formalization Note:

  • E[Y]>0E[Y]>0E[Y]>0, because (46) divides by it.
  • Integrability of (A1η+A2η)1/ηY(η−1)/η(A_1^\eta+A_2^\eta)^{1/\eta}Y^{(\eta-1)/\eta}(A1η​+A2η​)1/ηY(η−1)/η.
  • A positive price in the retailer's first-order condition.
  • Differentiability of ccc only on (0,∞)(0,\infty)(0,∞).

The existence of an effort satisfying (45) is a hypothesis, as on the page. Clauses 1 of the goal are stated for fixed realizations, not as random variables.

A trivializing formalization would define γo(α)\gamma^o(\alpha)γo(α) as an argmax, or define the payment (46) as E[Qw]/E[Q]E[Qw]/E[Q]E[Qw]/E[Q]; neither is done here. Outside γ∈[0,1]\gamma\in[0,1]γ∈[0,1] and Q>0Q>0Q>0, Lean's real power returns junk values, and every statement restricts to that range. The companion claim that w(α,Q)w(\alpha,Q)w(α,Q) is the unique market-clearing price is not posed.

The formalization needs no infrastructure beyond Mathlib's real powers, convexity and Bochner integral. The concavity and first-order-condition lemmas for x↦axr−bxx\mapsto ax^{r}-bxx↦axr−bx with 0<r<10<r<10<r<1 may be reused for other constant-elasticity models. Contributions are welcome at any milestone; each is independent of the others except through the closed forms.

Selected references

  • G. P. Cachon, Supply Chain Coordination with Contracts, in S. Graves and T. de Kok (eds.), Handbooks in Operations Research and Management Science, Vol. 11: Supply Chain Management, North-Holland, 2003, Ch. 6, §6.9. https://doi.org/10.1016/S0927-0507(03)11006-7 (formalized from the author's 3rd draft, January 2003).
  • P. Kouvelis and M. A. Lariviere, Decentralizing cross-functional decisions: Coordination through internal markets, Management Science 46(8), 2000, 1049–1058. https://doi.org/10.1287/mnsc.46.8.1049.12025
  • E. L. Porteus and S. Whang, On manufacturing/marketing incentives, Management Science 37(9), 1991, 1166–1181. https://doi.org/10.1287/mnsc.37.9.1166
  • G. P. Cachon and M. A. Lariviere, Capacity choice and allocation: strategic behavior and supply chain performance, Management Science 45(8), 1999, 1091–1108. https://doi.org/10.1287/mnsc.45.8.1091
11 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Supply Chain Coordination with Contracts VIII: In the Two-Location Base-Stock Model the Linear Transfers (39)–(41) Make the Optimal Base Stocks the Unique Nash EquilibriumTextbook

Motivation

In a supply chain with stock at two locations, a supplier holds inventory that replenishes a retailer, and the retailer serves customers. Each firm sets its own inventory level to minimize its own cost. The retailer bears only part of the cost of customer backorders, and the supplier bears none of the retailer's holding cost, so their incentives differ. The resulting equilibrium generally differs from the policy that minimizes total cost. Cachon and Zipkin (Management Science 45(7), 1999) studied this game and proposed linear transfer payments that align the firms' incentives. In the chapter Supply Chain Coordination with Contracts (Handbooks in OR & MS, vol. 11, 2003, doi:10.1016/S0927-0507(03)11006-7), Cachon re-derives that analysis, adds a parameter λ\lambdaλ that divides the retail-level costs between the firms, and answers two questions the original paper left open: whether the contracts allow an arbitrary division of cost, and whether the optimal policy is the unique equilibrium under the contracts. This mission formalizes the second answer, together with the analysis of the decentralized game and of the optimal policy that it rests on (§6.8 of the 2003 chapter, read in the author's January 2003 draft).

Setting

Two firms, a retailer rrr and a supplier sss, each use a base stock policy: firm iii keeps its inventory position equal to its base stock level si∈Rs_i \in \mathbb Rsi​∈R. A negative supplier base stock means planned backorders. Let DrD_rDr​ and DsD_sDs​ be the demands during the retailer's and the supplier's lead times. They are nonnegative with finite means μr\mu_rμr​, μs\mu_sμs​, and their distribution functions FrF_rFr​, FsF_sFs​ are continuous, zero at 000, strictly increasing on [0,∞)[0,\infty)[0,∞) and differentiable on (0,∞)(0,\infty)(0,∞). Holding costs are hrh_rhr​ and hsh_shs​, with 0<hs<hr0 < h_s < h_r0<hs​<hr​. Each backorder at the retailer costs the retailer βr>0\beta_r > 0βr​>0 and the supplier βs>0\beta_s > 0βs​>0 per unit time. Write β=βr+βs\beta = \beta_r + \beta_sβ=βr​+βs​.

At retailer inventory level yyy the expected on-hand stock is Ir(y)=E[(y−Dr)+]I_r(y) = E[(y-D_r)^+]Ir​(y)=E[(y−Dr​)+] and the expected backorders are Br(y)=E[(Dr−y)+]B_r(y) = E[(D_r-y)^+]Br​(y)=E[(Dr​−y)+]. The retail-level cost rates are cr(y)=hrIr(y)+βrBr(y)c_r(y) = h_rI_r(y) + \beta_rB_r(y)cr​(y)=hr​Ir​(y)+βr​Br​(y), cs(y)=βsBr(y)c_s(y) = \beta_sB_r(y)cs​(y)=βs​Br​(y) and c(y)=cr(y)+cs(y)c(y) = c_r(y) + c_s(y)c(y)=cr​(y)+cs​(y). Because the supplier may stock out, the retailer's actual inventory level is sr−(Ds−ss)+s_r - (D_s - s_s)^+sr​−(Ds​−ss​)+, and every retail-level quantity is averaged accordingly:

g(sr,ss)=E[g(sr−(Ds−ss)+)]=Fs(ss)g(sr)+∫ss∞g(sr+ss−x)fs(x) dx.g(s_r,s_s) = E\big[g(s_r - (D_s-s_s)^+)\big] = F_s(s_s)g(s_r) + \int_{s_s}^\infty g(s_r+s_s-x)f_s(x)\,dx .g(sr​,ss​)=E[g(sr​−(Ds​−ss​)+)]=Fs​(ss​)g(sr​)+∫ss​∞​g(sr​+ss​−x)fs​(x)dx.

With the supplier's inventory Is(y)=E[(y−Ds)+]I_s(y) = E[(y-D_s)^+]Is​(y)=E[(y−Ds​)+] and backorders Bs(y)=μs−y+Is(y)B_s(y) = \mu_s - y + I_s(y)Bs​(y)=μs​−y+Is​(y), the firms' costs and the chain's cost are

πr(sr,ss)=cr(sr,ss),πs(sr,ss)=hsIs(ss)+cs(sr,ss),Π=πr+πs.\pi_r(s_r,s_s) = c_r(s_r,s_s), \qquad \pi_s(s_r,s_s) = h_sI_s(s_s) + c_s(s_r,s_s), \qquad \Pi = \pi_r + \pi_s .πr​(sr​,ss​)=cr​(sr​,ss​),πs​(sr​,ss​)=hs​Is​(ss​)+cs​(sr​,ss​),Π=πr​+πs​.

A pair {sro,sso}\{s_r^o, s_s^o\}{sro​,sso​} minimizing Π\PiΠ is an optimal policy. A Nash equilibrium is a pair from which neither firm can lower its own cost by a unilateral change of its base stock.

Under a linear transfer the supplier pays the retailer tIIr(sr,ss)+tBrBr(sr,ss)+tBsBs(ss)t_II_r(s_r,s_s) + t_B^rB_r(s_r,s_s) + t_B^sB_s(s_s)tI​Ir​(sr​,ss​)+tBr​Br​(sr​,ss​)+tBs​Bs​(ss​) (a negative amount is a payment the other way). The Cachon–Zipkin contracts with parameter λ∈(0,1]\lambda \in (0,1]λ∈(0,1] are

tI=(1−λ)hr,tBr=βr−λβ,tBs=λhsFs(sso)1−Fs(sso).t_I = (1-\lambda)h_r, \qquad t_B^r = \beta_r - \lambda\beta, \qquad t_B^s = \lambda h_s\frac{F_s(s_s^o)}{1-F_s(s_s^o)} .tI​=(1−λ)hr​,tBr​=βr​−λβ,tBs​=λhs​1−Fs​(sso​)Fs​(sso​)​.

Formalization targets

Goal: the contracts coordinate, uniquely

If {sro,sso}\{s_r^o, s_s^o\}{sro​,sso​} is optimal with sso>0s_s^o > 0sso​>0 and λ∈(0,1]\lambda \in (0,1]λ∈(0,1], then under the contracts

πr=λc(sr,ss)−tBsBs(ss),πs=(hs+tBs)Is(ss)+(1−λ)c(sr,ss)+tBs(μs−ss),\pi_r = \lambda c(s_r,s_s) - t_B^sB_s(s_s), \qquad \pi_s = (h_s+t_B^s)I_s(s_s) + (1-\lambda)c(s_r,s_s) + t_B^s(\mu_s - s_s),πr​=λc(sr​,ss​)−tBs​Bs​(ss​),πs​=(hs​+tBs​)Is​(ss​)+(1−λ)c(sr​,ss​)+tBs​(μs​−ss​),

{sro,sso}\{s_r^o, s_s^o\}{sro​,sso​} is a Nash equilibrium, and it is the only one. The goal contains no numerical constants. It holds for every demand distribution in the class and every λ\lambdaλ in the range.

Milestones

  1. In the uncontracted game, every retailer best response exceeds s^r>0\hat s_r > 0s^r​>0, where Fr(s^r)=βr/(hr+βr)F_r(\hat s_r) = \beta_r/(h_r+\beta_r)Fr​(s^r​)=βr​/(hr​+βr​), and every supplier best response is positive (pp. 79–80).
  2. In the uncontracted game, for every sss_sss​ the retailer's optimal base stock is below the chain's; consequently the competition penalty (Π(s∗)−Π(so))/Π(so)(\Pi(s^*) - \Pi(s^o))/\Pi(s^o)(Π(s∗)−Π(so))/Π(so) is positive at every equilibrium s∗s^*s∗ (pp. 80–81).
  3. The partial derivatives (35)–(36) of Π\PiΠ, and every optimum with ss>0s_s > 0ss​>0 satisfies c′(sr)=hsc'(s_r) = h_sc′(sr​)=hs​, i.e. Fr(sr)=(hs+β)/(hr+β)F_r(s_r) = (h_s+\beta)/(h_r+\beta)Fr​(sr​)=(hs​+β)/(hr​+β) (37) (p. 83).
  4. Optima with ss≤0s_s \le 0ss​≤0 have sr+ss=sˉs_r + s_s = \bar ssr​+ss​=sˉ, where Pr⁡(Dr+Ds≤sˉ)=β/(hr+β)\Pr(D_r + D_s \le \bar s) = \beta/(h_r+\beta)Pr(Dr​+Ds​≤sˉ)=β/(hr​+β) (38) (p. 83).
  5. The cost identities (42)–(43) under the contracts (p. 84).
  6. Under the contracts the retailer's best response decreases in sss_sss​, and the supplier's marginal cost along it has the closed form printed on p. 84.

Significance

The goal says that a contract built from quantities both firms can measure, namely the retailer's inventory and backorders and the supplier's backorders, makes the system-optimal policy the only equilibrium. The firms therefore reach the optimum without coordinating on an equilibrium. The parameter λ\lambdaλ splits the retail-level costs between the firms in any proportion up to λ=1\lambda = 1λ=1. Milestone 2 shows the contract is needed: without transfers, decentralization is always strictly suboptimal when the supplier is charged for retail backorders. The transfers tIt_ItI​ and tBrt_B^rtBr​ are those of the single-location model (§6.7), even though the retailer's target fractile changes from β/(β+hr)\beta/(\beta+h_r)β/(β+hr​) to (β+hs)/(β+hr)(\beta+h_s)/(\beta+h_r)(β+hs​)/(β+hr​).

The results are proved in the source and in Cachon and Zipkin (1999), with informal derivative arguments. No machine-checked version is known. Formalizing them requires differentiating expectations of piecewise-linear convex functions of a random lead-time shortfall. The page's argument also assumes densities, which the formal statements avoid, and contains several printing slips (see below). These would be settled by a complete development.

Difficulty

The firms' costs are compositions: a convex single-location cost evaluated at the random level sr−(Ds−ss)+s_r - (D_s - s_s)^+sr​−(Ds​−ss​)+, which is concave in sss_sss​. The supplier's cost is therefore not obviously convex in sss_sss​; its convexity at sr=sros_r = s_r^osr​=sro​ depends on the value of tBst_B^stBs​ and on c′(sro)=hsc'(s_r^o) = h_sc′(sro​)=hs​. Uniqueness is the hard part. Under the contracts the retailer's best response sr(ss)s_r(s_s)sr​(ss​) decreases, but the supplier's marginal cost along that best response, Fs(ss)(hs−(1−λ)c′(sr(ss))+tBs)−tBsF_s(s_s)(h_s - (1-\lambda)c'(s_r(s_s)) + t_B^s) - t_B^sFs​(ss​)(hs​−(1−λ)c′(sr​(ss​))+tBs​)−tBs​, is not monotone in general when λ\lambdaλ is small, contrary to a literal reading of p. 84. A uniqueness argument has to show that it has at most one zero, not that it increases.

Formalization scope

Demand laws are probability measures on R\mathbb RR with no mass below 000, finite means, and continuous distribution functions, zero at 000, strictly increasing on [0,∞)[0,\infty)[0,∞) and differentiable on (0,∞)(0,\infty)(0,∞). These are the section's standing assumptions, together with 0<hs<hr0 < h_s < h_r0<hs​<hr​ and βr,βs>0\beta_r, \beta_s > 0βr​,βs​>0 (footnote 34 excludes the zero cases). Expectations are Lebesgue integrals: IrI_rIr​, BrB_rBr​, IsI_sIs​ and the two-location averages are defined by expectation, and the page's integral forms are consequences. Integrals against fs(x) dxf_s(x)\,dxfs​(x)dx are written against the law of DsD_sDs​, so no density hypothesis is made. Base stocks range over all of R\mathbb RR, and "optimal" means minimizing Π\PiΠ over R2\mathbb R^2R2; the existence of an optimum is a hypothesis, as on p. 77. Derivatives are stated with HasDerivAt. Independence of DrD_rDr​ and DsD_sDs​, implicit on the page, enters only through the convolution of their laws in (38).

The contracted costs are defined from the firms' original costs and the transfer payment. Defining them by the closed forms (42)–(43) would make the identities trivial and is ruled out.

Corrected slips: (42) is stated with λc(sr,ss)\lambda c(s_r,s_s)λc(sr​,ss​) where the page prints λΠ(sr,ss)\lambda\Pi(s_r,s_s)λΠ(sr​,ss​) (the difference λhsIs(ss)\lambda h_sI_s(s_s)λhs​Is​(ss​) does not depend on srs_rsr​). The retailer's single-location fractile on p. 79 is stated as βr/(hr+βr)\beta_r/(h_r+\beta_r)βr​/(hr​+βr​), not the printed β/(hr+β)\beta/(h_r+\beta)β/(hr​+β). The garbled display after (43) and the fsf_sfs​/FsF_sFs​ slip in the best-response derivative are not reproduced. Not included: the contraction condition (34), the case split for the optimal policy (p. 84), the case sso≤0s_s^o \le 0sso​≤0, and the alternative schemes of §6.8.5 (Lee–Whang, Chen). Contributions of those, or of a reusable library for derivatives of E[g(s−(D−t)+)]E[g(s - (D-t)^+)]E[g(s−(D−t)+)], are welcome. The platform's Clark–Scarf items (InventoryControl_clarkScarf, ClarkScarf.Serial.*) concern periodic-review echelon policies and are not reused.

Selected references

  • G. P. Cachon, Supply Chain Coordination with Contracts, in S. Graves and T. de Kok (eds.), Handbooks in Operations Research and Management Science, vol. 11, North-Holland, 2003, §6.8. https://doi.org/10.1016/S0927-0507(03)11006-7
  • G. P. Cachon and P. H. Zipkin, Competitive and cooperative inventory policies in a two-stage supply chain, Management Science 45(7), 936–953, 1999. https://doi.org/10.1287/mnsc.45.7.936
  • F. Chen and Y.-S. Zheng, Lower bounds for multi-echelon stochastic inventory systems, Management Science 40(11), 1426–1443, 1994. https://doi.org/10.1287/mnsc.40.11.1426
  • A. Federgruen and P. Zipkin, Computational issues in an infinite-horizon, multiechelon inventory model, Operations Research 32(4), 818–836, 1984. https://doi.org/10.1287/opre.32.4.818
10 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Supply Chain Coordination with Contracts V: With Market-Clearing Prices the Best Wholesale Price Earns θ/(2(1 + θ)) or θ/8, Below the (1 + θ)/8 a Full-Refund Buy-Back AttainsTextbook

Motivation

A supplier that sells through many competing retailers usually worries that competition among them pushes orders too high, because each retailer ignores the demand it takes from the others. Deneckere, Marvel and Peck (1997) identified the opposite failure. When the retail price is set by the market after demand is realized, retailers who hold too much stock in a weak market bid the price down, and anticipating this, perfectly competitive retailers order too little. The supplier then needs a contract that raises orders, and the classical justification for resale price maintenance (a price floor imposed on retailers) comes out of this model. G. P. Cachon's survey chapter Supply Chain Coordination with Contracts (Handbooks in OR & MS, Vol. 11, 2003) presents the model in §6.5.2 as a closed-form example. In it the supplier's best wholesale price contract is computed explicitly and compared with two contracts that recover the monopoly profit: resale price maintenance and a full-refund buy-back.

This mission is volume V of a series that formalizes the section capstones of that chapter, read in the author's 3rd draft (January 2003), pp. 53–58.

Setting

Fix θ>1\theta>1θ>1. Industry demand is low or high, each with probability 1/21/21/2. If the retailers hold a total stock qqq, the market clearing price is

pl(q)=(1−q)+ (low state),ph(q)=(1−qθ)+ (high state).p_l(q)=(1-q)^+\ \text{(low state)},\qquad p_h(q)=\Big(1-\frac q\theta\Big)^+\ \text{(high state)}.pl​(q)=(1−q)+ (low state),ph​(q)=(1−θq​)+ (high state).

Leftover inventory has no salvage value, and the supplier's production cost is zero.

  • Monopolist benchmark. A single firm orders a stock QQQ, observes the state, and sells xl≤Qx_l\le Qxl​≤Q (low) or xh≤Qx_h\le Qxh​≤Q (high) at the market clearing price. Its expected profit is 12pl(xl)xl+12ph(xh)xh\tfrac12p_l(x_l)x_l+\tfrac12p_h(x_h)x_h21​pl​(xl​)xl​+21​ph​(xh​)xh​, and Πo\Pi^oΠo is the maximum of this.
  • Wholesale price contract. The supplier charges www per unit. A continuum of retailers orders before demand is known and sells everything at the market clearing price. Their aggregate expected profit is
π(q)=12pl(q)q+12ph(q)q−wq.\pi(q)=\tfrac12p_l(q)q+\tfrac12p_h(q)q-wq .π(q)=21​pl​(q)q+21​ph​(q)q−wq.

Perfect competition means the retailers keep ordering until expected profit is zero. The competitive order is the q>0q>0q>0 with π(q)=0\pi(q)=0π(q)=0 and π>0\pi>0π>0 on (0,q)(0,q)(0,q). The supplier earns wqwqwq.

  • Resale price maintenance (pˉ,w)(\bar p,w)(pˉ​,w): retailers may not sell below pˉ\bar ppˉ​. When the clearing price would fall below pˉ\bar ppˉ​, only the demand at pˉ\bar ppˉ​ is sold, allocated in proportion to stock.
  • Buy-back (w,b)(w,b)(w,b): the supplier pays bbb per unsold unit. The market price then cannot fall below bbb, and retailers sell at most 1−b1-b1−b units (low) and θ(1−b)\theta(1-b)θ(1−b) units (high).

The page's notation q1(w)=2θ1+θ(1−w)q_1(w)=\frac{2\theta}{1+\theta}(1-w)q1​(w)=1+θ2θ​(1−w), q2(w)=θ(1−2w)q_2(w)=\theta(1-2w)q2​(w)=θ(1−2w), πs(w)\pi_s(w)πs​(w) and w∗(θ)w^*(\theta)w∗(θ) is kept in Lean under the names q1, q2, supplierProfit, wStar.

Formalization targets

Goal (pp. 55, 57)

With

πs∗={θ2(1+θ)θ≤3,θ8θ>3,\pi_s^*=\begin{cases}\dfrac{\theta}{2(1+\theta)}&\theta\le3,\\[4pt]\dfrac\theta8&\theta>3,\end{cases}πs∗​=⎩⎨⎧​2(1+θ)θ​8θ​​θ≤3,θ>3,​

the goal states four things:

  1. πs∗\pi_s^*πs∗​ is the greatest supplier profit wqwqwq over all wholesale prices and their competitive orders.
  2. w∗(θ)w^*(\theta)w∗(θ) attains it.
  3. The monopolist's maximum is Πo=(1+θ)/8\Pi^o=(1+\theta)/8Πo=(1+θ)/8, and πs∗<Πo\pi_s^*<\Pi^oπs∗​<Πo.
  4. Under the buy-back b=w=1/2b=w=1/2b=w=1/2 the competitive order is θ/2\theta/2θ/2 and the supplier earns exactly Πo\Pi^oΠo.

Milestones

  1. Πo=(1+θ)/8\Pi^o=(1+\theta)/8Πo=(1+θ)/8 (p. 54).
  2. The competitive order is q1(w)q_1(w)q1​(w) if w≥12−12θw\ge\tfrac12-\tfrac1{2\theta}w≥21​−2θ1​ and q2(w)q_2(w)q2​(w) otherwise, for 0≤w<10\le w<10≤w<1 (p. 55).
  3. w∗(θ)w^*(\theta)w∗(θ) maximizes πs\pi_sπs​ on [0,1)[0,1)[0,1), with the value πs∗\pi_s^*πs∗​ (p. 55).
  4. The orders and market clearing prices at w∗(θ)w^*(\theta)w∗(θ) (p. 55).
  5. Under resale price maintenance with pˉ=1/2\bar p=1/2pˉ​=1/2 and total stock θ/2\theta/2θ/2, πr(t)=q(t)(1+θ4θ−w)\pi_r(t)=q(t)\big(\frac{1+\theta}{4\theta}-w\big)πr​(t)=q(t)(4θ1+θ​−w) (p. 56).
  6. Under (pˉ,wˉ)(\bar p,\bar w)(pˉ​,wˉ) the competitive order is θ/2\theta/2θ/2 and the supplier earns Πo\Pi^oΠo (p. 57).
  7. Under the buy-back b=1/2b=1/2b=1/2 the retailers' profit is q(34−w−q2θ)q\big(\frac34-w-\frac q{2\theta}\big)q(43​−w−2θq​) for 1/2<q<θ/21/2<q<\theta/21/2<q<θ/2 (p. 57).
  8. 1/2>(1+θ)/(4θ)1/2>(1+\theta)/(4\theta)1/2>(1+θ)/(4θ) (p. 57).

Significance

The goal shows that in this model a wholesale price contract always falls short of the integrated profit, whatever θ\thetaθ. It also shows where the shortfall comes from: at the optimal wholesale price the low-state market price falls below the monopoly price 1/21/21/2 (milestone 4). Restoring the monopoly profit therefore requires a mechanism that holds the low-state price at 1/21/21/2. Resale price maintenance and a full-refund buy-back both do this, so the section gives a closed-form efficiency argument for vertical restraints that are often treated as anticompetitive. The section also contrasts the buy-back with revenue sharing, which coordinates the single newsvendor (§6.2) but not this model.

The results are proved on the printed pages by elementary algebra. None of them has a machine-checked proof, and nothing on Prove2Me covers this model. The mission produces checked versions of the case analysis, including the θ=3\theta=3θ=3 tie and the two regimes of the competitive order. It also adds a reusable encoding of "perfect competition" as the first zero of aggregate expected profit.

Difficulty

Every statement reduces to one-variable inequalities, but the case structure is easy to get wrong.

  • The retailers' profit is piecewise (prices hit zero at q=1q=1q=1 in the low state and at q=θq=\thetaq=θ in the high state). The competitive order lies on either side of q=1q=1q=1 depending on www.
  • The supplier's profit πs\pi_sπs​ is piecewise in www, and its second branch peaks at w=1/4w=1/4w=1/4 only when θ>2\theta>2θ>2.
  • The global optimum switches at θ=3\theta=3θ=3, where both prices are optimal.
  • A statement "the competitive order is q1(w)q_1(w)q1​(w)" needs the order to exist, to be unique, and to have positive profit everywhere below it. Exhibiting a root is not enough.
  • The buy-back profit is identically zero for q≥θ/2q\ge\theta/2q≥θ/2 when b=w=1/2b=w=1/2b=w=1/2. Only the "first zero" reading of perfect competition pins the order at θ/2\theta/2θ/2.

Formalization scope

All quantities are real numbers and θ>1\theta>1θ>1 throughout. The continuum of retailers enters only through the total order. No measure space of retailers is formalized, and footnote 26's multiplicity of individual equilibria is not stated. The sales rules under resale price maintenance (proportional allocation) and under the buy-back (price floor bbb) are written into the contract definitions, as the page describes them in words. The theorems use only pˉ=b=1/2\bar p=b=1/2pˉ​=b=1/2.

The formulas q1q_1q1​, q2q_2q2​, πs\pi_sπs​ and w∗w^*w∗ are definitions transcribed from the page. That they are the competitive order and the optimum is the content of the theorems. Defining Πo\Pi^oΠo or the competitive order by its closed form would trivialize the mission, so the competitive order is defined only by the zero-profit property and Πo\Pi^oΠo as a greatest element of the monopolist's feasible profits. The goal is stated over all real wholesale prices, so it also rules out profitable prices outside [0,1)[0,1)[0,1). Uniqueness of w∗(θ)w^*(\theta)w∗(θ) is not asserted at θ=3\theta=3θ=3.

The chapter's standing assumptions used here are risk neutrality and full information, together with the model paragraph of pp. 53–54 (two equally likely states, zero salvage value, zero production cost). No platform definition is referenced: no published item formalizes this model.

Selected references

  • G. P. Cachon, Supply Chain Coordination with Contracts, in S. Graves, T. de Kok (eds.), Handbooks in Operations Research and Management Science, Vol. 11: Supply Chain Management, North-Holland, 2003, §6.5.2 (3rd draft, January 2003, pp. 53–58). https://doi.org/10.1016/S0927-0507(03)11006-7
  • R. Deneckere, H. P. Marvel, J. Peck, Demand Uncertainty and Price Maintenance: Markdowns as Destructive Competition, American Economic Review 87(4), 619–641, 1997. https://www.jstor.org/stable/2951366
  • R. Deneckere, H. P. Marvel, J. Peck, Demand Uncertainty, Inventories, and Resale Price Maintenance, Quarterly Journal of Economics 111(3), 885–913, 1996. https://doi.org/10.2307/2946675
11 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Purchasing, Pricing, and Quick Response in the Presence of Strategic Consumers: Under Condition (6), Quick Response Is More Valuable with Strategic Consumers than with Only Myopic OnesResearch Paper

Motivation

Fashion and consumer-electronics retailers sell a product at full price early in a season and mark down what is left. Consumers learn the pattern, and some of them wait for the markdown. Such strategic consumers lower the revenue of the full-price period, and the retailer's stocking decision affects how deep the markdown is expected to be. Quick response — a second, more expensive replenishment placed after demand is observed — is usually valued as a way to match supply with exogenous demand (Fisher and Raman 1996; Cachon and Terwiesch, Matching Supply with Demand, 2005). Cachon and Swinney ask how strategic waiting changes that value.

The source is the authors' working paper of April 2007, revised November 25, 2007, not the 2009 Management Science version, whose numbering and wording may differ. Its answer: with strategic consumers the retailer stocks less (Theorem 1), and under an explicit cost condition, quick response is worth more to a retailer facing strategic consumers than to one facing only myopic consumers (Theorem 3).

Setting

A retailer sells over two periods. It sells at the exogenous full price ppp in period 1 and at a markdown price s∈[0,p]s\in[0,p]s∈[0,p] chosen at the start of period 2. Leftover units are worth 000. First-period demand D≥0D\ge0D≥0 has density fff and distribution function FFF, and fff satisfies the monotone scaled likelihood ratio (MSLR) property: for every λ∈(0,1]\lambda\in(0,1]λ∈(0,1], x↦f(λx)/f(x)x\mapsto f(\lambda x)/f(x)x↦f(λx)/f(x) is monotonic on the support of fff.

The market has three segments:

  • myopic consumers, (1−α)D(1-\alpha)D(1−α)D of them, with value vMv_MvM​, who only buy in period 1;
  • strategic consumers, αD\alpha DαD of them, with value vMv_MvM​ in period 1 and second-period values uniform on [v‾,vˉ][\underline v,\bar v][v​,vˉ];
  • an unlimited pool of bargain hunters with value vBv_BvB​, who only buy on sale.

The standing assumptions are vˉ≤p\bar v\le pvˉ≤p and v‾≥vM−p+vB\underline v\ge v_M-p+v_Bv​≥vM​−p+vB​. Let Gˉ(s)\bar G(s)Gˉ(s) be the fraction of strategic values above sss.

By a threshold argument (Lemma 1), strategic consumers with value below some v^\hat vv^ buy at ppp and the rest wait. A fraction ξ=1−Gˉ(v^)α\xi=1-\bar G(\hat v)\alphaξ=1−Gˉ(v^)α of demand then buys in period 1, and the inventory left for period 2 is I=(q−ξD)+I=(q-\xi D)^+I=(q−ξD)+. The period-2 revenue R(s,I)R(s,I)R(s,I) counts the waiting strategic consumers with value at least sss and, if s≤vBs\le v_Bs≤vB​, the bargain hunters, up to the inventory III. The retailer's expected profit at unit cost ccc is

π(q,v^)=E[pmin⁡(q,ξD)−cq+sup⁡0≤s≤pR(s,I)].\pi(q,\hat v)=\mathbb E\Big[p\min(q,\xi D)-cq+\sup_{0\le s\le p}R(s,I)\Big].π(q,v^)=E[pmin(q,ξD)−cq+0≤s≤psup​R(s,I)].

With quick response, units ordered before the season cost c1c_1c1​ and units ordered after observing DDD cost c2c_2c2​, with c1≤c2≤pc_1\le c_2\le pc1​≤c2​≤p. The second order covers all first-period demand and may add stock for the sale. The resulting profit is πr(q,v^)\pi_r(q,\hat v)πr​(q,v^).

In the sale period, waiting strategic consumers are rationed: they effectively face the inventory θI\theta IθI, where θ∈[0,1]\theta\in[0,1]θ∈[0,1] measures their place in the queue. A strategic consumer with value v^\hat vv^ who waits gains, in expectation,

ψ(v^)=(v^−vB)Pr⁡(D<Dl and a unit is received),\psi(\hat v)=(\hat v-v_B)\Pr(D<D_l\text{ and a unit is received}),ψ(v^)=(v^−vB​)Pr(D<Dl​ and a unit is received),

where DlD_lDl​ is the demand level below which the retailer clears stock at sl=vBs_l=v_Bsl​=vB​. A rational expectations equilibrium (q∗,v∗)(q^*,v^*)(q∗,v∗) is a pair in which q∗q^*q∗ maximizes π(⋅,v∗)\pi(\cdot,v^*)π(⋅,v∗) and v∗v^*v∗ is a best response of consumers who correctly expect q∗q^*q∗. The superscript mmm denotes the benchmark with only myopic consumers (α=0\alpha=0α=0): πm\pi^mπm and πrm\pi^m_rπrm​ are the optimal myopic profits without and with quick response.

Formalization targets

Goal: Theorem 3

Assume MSLR and no rationing, 0<α≤10<\alpha\le10<α≤1, vB<c1<pv_B<c_1<pvB​<c1​<p, c1≤c2≤pc_1\le c_2\le pc1​≤c2​≤p, and condition (6):

vM−pvˉ−vB ≥ c2−c1c2−vB.\frac{v_M-p}{\bar v-v_B}\ \ge\ \frac{c_2-c_1}{c_2-v_B}.vˉ−vB​vM​−p​ ≥ c2​−vB​c2​−c1​​.

Let (q∗,v∗)(q^*,v^*)(q∗,v∗) be any equilibrium without quick response, (qr∗,vr∗)(q_r^*,v_r^*)(qr∗​,vr∗​) any equilibrium with it, and πm\pi^mπm, πrm\pi_r^mπrm​ the myopic optima. Then

πr(qr∗,vr∗)−π(q∗,v∗) ≥ πrm−πm.\pi_r(q_r^*,v_r^*)-\pi(q^*,v^*)\ \ge\ \pi_r^m-\pi^m .πr​(qr∗​,vr∗​)−π(q∗,v∗) ≥ πrm​−πm.

Milestones

The milestones follow the paper's path:

  • the threshold structure (Lemma 1);
  • the optimal sale price (Lemma 2) and quasi-concavity of π\piπ with first-order condition (2) (Lemma 3);
  • the fill probability and the limits of the best response (Lemma 4);
  • existence and the comparison q∗≤qmq^*\le q^mq∗≤qm, π∗≤πm\pi^*\le\pi^mπ∗≤πm (Theorem 1), with the myopic newsvendor F(qm)=(p−c)/(p−vB)F(q^m)=(p-c)/(p-v_B)F(qm)=(p−c)/(p−vB​);
  • the quick-response analogues (Lemma 5, Theorem 2 (i)), with the myopic fractile F(qrm)=(c2−c1)/(c2−vB)F(q^m_r)=(c_2-c_1)/(c_2-v_B)F(qrm​)=(c2​−c1​)/(c2​−vB​);
  • the statement that under (6) every equilibrium with quick response has vr∗=vˉv^*_r=\bar vvr∗​=vˉ (Theorem 2, last sentence).

Corollary 1 is the percentage form, Δ/π∗≥Δm/πm\Delta/\pi^*\ge\Delta_m/\pi^mΔ/π∗≥Δm​/πm.

Significance

Theorem 3 identifies a second channel through which quick response creates value. Beyond matching supply to demand, it lets the retailer keep its initial stock low enough that a deep markdown becomes unlikely, so strategic consumers buy at full price. Under (6), all of them do. Quick response thus reduces strategic waiting without withholding availability, unlike the inventory-signalling remedies in the literature, and the theorem quantifies when this effect dominates.

The results are proved in the working paper, partly in a technical appendix. No machine-checked version of them, or of the underlying markdown game, is known. A formalization pins down several statements that the paper states loosely:

  • the uniqueness claims of Lemmas 2 and 5;
  • the case condition of Lemma 4 (i), which is false as printed;
  • the sign in display (5);
  • the boundary cases of the threshold lemma.

It also produces reusable components: the newsvendor with salvage and the reactive-capacity fractile under a general density, and a rational-expectations equilibrium predicate for a retailer–consumer game.

Difficulty

The profit π(⋅,v^)\pi(\cdot,\hat v)π(⋅,v^) is not concave: with strategic consumers it is concave–convex (Figure 4 of the paper). The newsvendor argument therefore does not give a unique optimal order, and Lemma 3's quasi-concavity rests on MSLR in a short appendix step.

Existence (Theorem 1) needs a fixed point of the map q↦q\mapstoq↦ best response, but the consumer best response is a correspondence, not a function, so the printed intermediate-value argument does not apply directly. Theorem 3 needs a statement about every equilibrium with quick response, while Theorem 2's proof only exhibits one. Ruling out an equilibrium with vr∗<vˉv_r^*<\bar vvr∗​<vˉ requires comparing the derivative (4) of πr\pi_rπr​ with the myopic derivative along the whole demand distribution.

Formalization scope

Lean represents prices, quantities and valuations as reals, demand by a density f:R→Rf:\mathbb R\to\mathbb Rf:R→R on [0,∞)[0,\infty)[0,∞), and expectations as Lebesgue integrals against fff. The model carries the standing assumptions of §3 as fields, plus the following additions and corrections, each disclosed in the item notes:

  • vB>0v_B>0vB​>0: DlD_lDl​ divides by sl=vBs_l=v_Bsl​=vB​.
  • p<vMp<v_Mp<vM​, strengthening vM≥pv_M\ge pvM​≥p: Lemma 4 (ii) and Theorem 2's last claim need it.
  • A finite mean: πr\pi_rπr​ contains E[pξD]\mathbb E[p\xi D]E[pξD].
  • The paper's "θc≤θ\theta_c\le\thetaθc​≤θ" (p. 15) is replaced by the no-rationing condition slGˉ(v^)≤θsmGˉ(sm)s_l\bar G(\hat v)\le\theta s_m\bar G(s_m)sl​Gˉ(v^)≤θsm​Gˉ(sm​) for every belief, which is exactly Dl≤DθD_l\le D_\thetaDl​≤Dθ​. The printed condition agrees with it only when sm=v^s_m=\hat vsm​=v^.
  • Lemma 4 (i) is stated with the corrected case split.
  • Lemmas 2 and 5 claim uniqueness only off the tie points.
  • c<pc<pc<p is the reading of the "p−c>0p-c>0p−c>0" step in the proof of Theorem 1.
  • In the quick-response profit, ξD\xi DξD replaces the DDD that the proof of Theorem 2 prints.

Optimal revenues are suprema over all prices s∈[0,p]s\in[0,p]s∈[0,p] (and q2≥0q_2\ge0q2​≥0 with quick response). "Optimal order" means a maximizer over all q≥0q\ge0q≥0, never a stationary point, and the myopic benchmarks are the same functions at α=0\alpha=0α=0. Defining the optimal revenue by Lemma 2's closed form would make Lemma 2 and the first-order conditions definitional; it is not done.

The fill rate is min⁡{(1−ξ)x,θI}/((1−ξ)x)\min\{(1-\xi)x,\theta I\}/((1-\xi)x)min{(1−ξ)x,θI}/((1−ξ)x), set to 111 when no strategic consumer waits. With Lean's 0/0=00/0=00/0=0 instead, vˉ\bar vvˉ would be a best response to every order and Theorem 2's last claim would be trivial.

A complete development needs:

  • differentiation under the integral for piecewise-smooth integrands;
  • quasi-concavity from a single-crossing derivative;
  • a fixed-point argument for the equilibrium correspondence;
  • the newsvendor and reactive-capacity fractiles.

The last two are reusable beyond this mission. Proofs of any milestone, alternative existence arguments, and sorry-free proofs of the newsvendor items are welcome. The comparison "qr∗≤q∗q_r^*\le q^*qr∗​≤q∗, πr∗≥π∗\pi_r^*\ge\pi^*πr∗​≥π∗" of Theorem 2 and §8's numerical study are outside the scope.

Selected references

  • G. P. Cachon, R. Swinney, Purchasing, Pricing, and Quick Response in the Presence of Strategic Consumers, working paper, revised November 25, 2007; published in Management Science 55(3), 2009. https://doi.org/10.1287/mnsc.1080.0948
  • M. L. Fisher, A. Raman, Reducing the Cost of Demand Uncertainty Through Accurate Response to Early Sales, Operations Research 44(1), 1996. https://doi.org/10.1287/opre.44.1.87
  • J. F. Muth, Rational Expectations and the Theory of Price Movements, Econometrica 29(3), 1961. https://doi.org/10.2307/1909635
19 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Revenue Management with Forward-Looking Buyers: Under Weakly Decreasing Demand the Deterministic Optimal Cutoffs Fall over Time and Satisfy One-Period Look-AheadResearch Paper

Motivation

Retailers of seasonal goods (fashion, electronics, airline seats) sell a fixed stock over a finite season to customers who arrive over time, and those customers know that prices may fall. A customer who expects a markdown waits, and a seller who ignores this loses revenue. The classical revenue-management literature (Gallego and van Ryzin 1994; Talluri and van Ryzin 2004) models myopic customers who buy on arrival or leave; the literature on forward-looking (strategic) buyers, for instance Aviv and Pazgal (2008), studies particular price paths.

Board and Skrzypacz ask the mechanism-design question: among all selling schemes, which maximizes the seller's expected discounted revenue when buyers arrive over time, have private values and time their purchases strategically? Their answer, published in the Journal of Political Economy in 2016, is that the optimal mechanism has a simple structure: in every period the seller sells to the highest remaining buyer if and only if his value exceeds a cutoff that depends only on the period and the number of units left. When demand is weakly decreasing over time, the cutoffs are characterized by one-period indifference conditions, which in the continuous-time limit can be implemented by posted prices. The source used here is the authors' accepted manuscript of February 6, 2015; all page numbers refer to that manuscript.

Setting

A seller has units of a good and sells them over periods t∈{1,…,T}t\in\{1,\dots,T\}t∈{1,…,T}; unsold units are worth zero after period TTT. Payoffs are discounted by δ∈(0,1)\delta\in(0,1)δ∈(0,1). At the start of period ttt a random number NtN_tNt​ of buyers arrives, independently across periods, with a law that may depend on ttt. Each buyer wants one unit; his value is drawn independently from a distribution with continuous density fff, distribution function FFF and support [v‾,vˉ][\underline v,\bar v][v​,vˉ]. The marginal revenue of a buyer with value vvv is

m(v)=v−1−F(v)f(v),m(v)=v-\frac{1-F(v)}{f(v)},m(v)=v−f(v)1−F(v)​,

assumed strictly increasing and continuously differentiable, with m(v‾)<0m(\underline v)<0m(v​)<0.

By the standard mechanism-design reduction (§2.1, eq. (2.5)), the seller's problem is to choose when to serve each buyer so as to maximize the expected discounted sum of the served buyers' marginal revenues. The state in period ttt, after the period-ttt entrants have arrived, is the number kkk of units left and the values y1≥y2≥⋯y^1\ge y^2\ge\cdotsy1≥y2≥⋯ of the buyers present. The value Πtk\Pi^k_tΠtk​ and the pre-entry value Π~tk\tilde\Pi^k_{t}Π~tk​ satisfy the Bellman equation (4.3):

Πtk(y)=max⁡0≤j≤k[∑i=1jm(yi)+δ Π~t+1k−j(y−j)],Π~t+1k(y)=Et+1[Πt+1k(y∪vt+1)],\Pi^k_t(\mathbf y)=\max_{0\le j\le k}\Big[\sum_{i=1}^j m(y^i)+\delta\,\tilde\Pi^{k-j}_{t+1}(\mathbf y^{-j})\Big],\qquad \tilde\Pi^k_{t+1}(\mathbf y)=E_{t+1}\big[\Pi^k_{t+1}(\mathbf y\cup\mathbf v_{t+1})\big],Πtk​(y)=0≤j≤kmax​[i=1∑j​m(yi)+δΠ~t+1k−j​(y−j)],Π~t+1k​(y)=Et+1​[Πt+1k​(y∪vt+1​)],

where y−j\mathbf y^{-j}y−j is the set of buyers left after the jjj highest are served and vt+1\mathbf v_{t+1}vt+1​ the next period's entrants. Selling one unit to y1y^1y1 today rather than none gives the difference function

ΔΠtk(y1,y−1)=m(y1)+δΠ~t+1k−1(y−1)−δΠ~t+1k(y1,y−1),\Delta\Pi^k_t(y^1,\mathbf y^{-1})=m(y^1)+\delta\tilde\Pi^{k-1}_{t+1}(\mathbf y^{-1})-\delta\tilde\Pi^k_{t+1}(y^1,\mathbf y^{-1}),ΔΠtk​(y1,y−1)=m(y1)+δΠ~t+1k−1​(y−1)−δΠ~t+1k​(y1,y−1),

and the cutoff xtkx^k_txtk​ is the smallest y∈[v‾,vˉ]y\in[\underline v,\bar v]y∈[v​,vˉ] with ΔΠtk(y,∅)≥0\Delta\Pi^k_t(y,\varnothing)\ge 0ΔΠtk​(y,∅)≥0. Comparing selling to y1y^1y1 today with waiting and selling at least one unit tomorrow (to the best of y1y^1y1 and the entrants) gives DΠtk(y1)D\Pi^k_t(y^1)DΠtk​(y1) (p. 17). Demand is weakly decreasing in the usual stochastic order if P(Nt+1>x)≤P(Nt>x)P(N_{t+1}>x)\le P(N_t>x)P(Nt+1​>x)≤P(Nt​>x) for all xxx and ttt.

Formalization targets

Goal: Theorem 2 (p. 17)

If NtN_tNt​ is weakly decreasing in the usual stochastic order then, for every k≥1k\ge 1k≥1,

xt+1k≤xtk(1≤t≤T−1),DΠtk(xtk)=0,x^k_{t+1}\le x^k_t\quad(1\le t\le T-1),\qquad D\Pi^k_t(x^k_t)=0,xt+1k​≤xtk​(1≤t≤T−1),DΠtk​(xtk​)=0,

and xtkx^k_txtk​ is the unique root of DΠtkD\Pi^k_tDΠtk​ in [v‾,vˉ][\underline v,\bar v][v​,vˉ] for t≤T−1t\le T-1t≤T−1: the seller is indifferent between selling to the cutoff type today and waiting one period to sell that unit tomorrow (the one-period-look-ahead property).

Central milestone: Theorem 1 (p. 15)

For every ttt and k≥1k\ge 1k≥1, the optimal rule sells to the highest buyer iff y1≥xtky^1\ge x^k_ty1≥xtk​, whatever the values of the lower buyers; xtk+1≤xtkx^{k+1}_t\le x^k_txtk+1​≤xtk​; and xtkx^k_txtk​ is the unique root of ΔΠtk\Delta\Pi^k_tΔΠtk​.

Milestones

In attack order:

  1. Lemma 1: allocations are monotone in values.
  2. Lemma 2: with cutoffs decreasing in the unit index, units can be treated one at a time.
  3. Equation (A.1): increasing differences of Π\PiΠ.
  4. Lemma 3: ΔΠ\Delta\PiΔΠ is independent of lower buyers, continuous and strictly increasing in y1y^1y1, and increasing in kkk.
  5. Footnote 12: the boundary values of ΔΠ\Delta\PiΔΠ.
  6. Theorem 1.
  7. Strict monotonicity of DΠD\PiDΠ in y1y^1y1 (p. 18).
  8. Lemma 4: DΠt+1k≥DΠtkD\Pi^k_{t+1}\ge D\Pi^k_tDΠt+1k​≥DΠtk​.

After the goal, (4.7) gives the period-(T−1)(T-1)(T−1) cutoff equation m(xT−1k)=δET[max⁡{m(xT−1k),m(vTk)}]m(x^k_{T-1})=\delta E_T[\max\{m(x^k_{T-1}),m(v^k_T)\}]m(xT−1k​)=δET​[max{m(xT−1k​),m(vTk​)}].

Significance

Theorem 1 says that the optimal allocation does not depend on how many buyers are present or what their values are, only on time and inventory. This is what makes the optimal mechanism implementable without eliciting values from buyers as they arrive. Theorem 2 turns the global dynamic program into local indifference conditions. In the continuous-time limit (§5 of the paper) these become differential equations, and the optimum is implemented by posted prices with an auction at the end of the season. Under weakly decreasing demand, therefore, the classical revenue-management practice of posting prices loses nothing against the best possible mechanism.

The paper's results are proved, in prose, with envelope-theorem and coupling arguments. They have not been machine-checked. A formal development would produce a verified backward-induction model of multi-unit dynamic allocation with random arrivals, with the structural results (monotonicity, deterministic cutoffs, monotone comparative statics in inventory and time) that recur across dynamic pricing and optimal stopping. Two printed gaps are recorded below: the positivity of m(vˉ)m(\bar v)m(vˉ), and the restriction of footnote 12 to t≤T−1t\le T-1t≤T−1.

Difficulty

The obvious argument fails at "deterministic". A priori the cutoff for the highest buyer depends on the values of the lower buyers, because selling a unit today changes which of them will be served later and when. Lemma 3(a) holds only under the induction hypothesis that all future cutoffs are already deterministic and decreasing in inventory, so Lemma 3, Theorem 1 and (A.1) form a single backward induction over periods and units, and none of them can be proved in isolation. The value function is an expectation, over a random number of i.i.d. entrants, of a maximum over sorted values, so continuity and strict monotonicity in y1y^1y1 (Lemma 3(b), and the same for DΠD\PiDΠ) are not available from general facts. The tempting argument for Theorem 2, that cutoffs fall over time simply because fewer buyers arrive later, is incomplete: Lemma 4 has to compare two periods with different arrival laws and different future cutoffs at once.

Formalization scope

Periods are natural numbers 1,…,T1,\dots,T1,…,T with T≥1T\ge1T≥1, and units are natural numbers. Values, marginal revenues and profits are real numbers. The buyers present form a finite multiset of reals, and an absent buyer is absent, never a value 000. The value law is the measure with density fff; the density is positive and continuous on [v‾,vˉ][\underline v,\bar v][v​,vˉ] and zero outside, and mmm is defined from fff and FFF. Expectations over a cohort are lower Lebesgue integrals against ∑nP(Nt=n) μ⊗n\sum_n P(N_t=n)\,\mu^{\otimes n}∑n​P(Nt​=n)μ⊗n of nonnegative bounded quantities, so no non-measurable or non-integrable integrand can silently become 000. The value function is defined by the Bellman equation (4.3), with ΠT+1≡0\Pi_{T+1}\equiv0ΠT+1​≡0. The sequence problem (4.1) over purchase times is not formalized; the paper says either may be used (footnote 16).

Standing assumptions and handled gaps:

  • δ∈(0,1)\delta\in(0,1)δ∈(0,1);
  • NtN_tNt​ independent across periods (only the marginal laws enter);
  • mmm strictly increasing and C1C^1C1 on [v‾,vˉ][\underline v,\bar v][v​,vˉ] with m(v‾)<0m(\underline v)<0m(v​)<0;
  • added: m(vˉ)>0m(\bar v)>0m(vˉ)>0, which footnote 12 uses without stating; without it no unit is ever sold and no cutoff exists;
  • added: f>0f>0f>0 on the closed support, needed for mmm to be defined there;
  • footnote 12's equality ΔΠtk(vˉ)=(1−δ)m(vˉ)\Delta\Pi^k_t(\bar v)=(1-\delta)m(\bar v)ΔΠtk​(vˉ)=(1−δ)m(vˉ) is stated for t≤T−1t\le T-1t≤T−1 only, since ΔΠTk=m\Delta\Pi^k_T=mΔΠTk​=m;
  • DΠtkD\Pi^k_tDΠtk​ is used only for t≤T−1t\le T-1t≤T−1, and Lemma 4 needs t+1≤T−1t+1\le T-1t+1≤T−1;
  • "decreasing" and "increasing" are weak except in Lemma 3(b) and for DΠD\PiDΠ;
  • at y1=xtky^1=x^k_ty1=xtk​ both selling and waiting are optimal.

The cutoff is defined from ΔΠ\Delta\PiΔΠ, never as the threshold of an optimal policy, and "optimal" always means maximal in (4.3) over every number of units sold. A formalization that postulates a threshold policy, replaces the random cohort by its mean, or sets absent buyers to value 000 would trivialize or change the statements and is ruled out. The mechanism-design reduction (IC/IR to (2.5)) and the continuous-time results of §5 are out of scope.

The usual stochastic order is the published platform definition StochasticOrders.Usual.UsualOrder. A complete development needs finite-horizon dynamic programming over multisets, expectations of functions of sorted i.i.d. samples, envelope arguments, and monotone coupling for the usual stochastic order on N\mathbb NN; these parts are reusable beyond this mission. Proofs of any milestone are welcome, as is a proof that (4.3) agrees with the sequence problem (4.1).

Selected references

  • S. Board and A. Skrzypacz, Revenue Management with Forward-Looking Buyers, Journal of Political Economy 124(4), 2016. https://doi.org/10.1086/686713
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1), 1981. https://doi.org/10.1287/moor.6.1.58
  • G. Gallego and G. van Ryzin, Optimal Dynamic Pricing of Inventories with Stochastic Demand over Finite Horizons, Management Science 40(8), 1994. https://doi.org/10.1287/mnsc.40.8.999
  • Y. Aviv and A. Pazgal, Optimal Pricing of Seasonal Products in the Presence of Forward-Looking Consumers, Manufacturing & Service Operations Management 10(3), 2008. https://doi.org/10.1287/msom.1070.0183
  • K. T. Talluri and G. J. van Ryzin, The Theory and Practice of Revenue Management, Springer, 2004. https://doi.org/10.1007/b139000
  • M. Shaked and J. G. Shanthikumar, Stochastic Orders, Springer, 2007. https://doi.org/10.1007/978-0-387-34675-5
14 thms2 active usersReviewed
🏆Completed
Graph TheoryOperations Research·Captain: mikedeng1

The Price of Stability for Network Design with Fair Cost Allocation II: Two Players with a Common Terminal in an Undirected Graph Have Price of Stability at Most 4/3, and This Is TightResearch Paper

Motivation

In network design games, selfish users build a shared network and split the cost of every edge among the users of that edge. Anshelevich, Dasgupta, Kleinberg, Tardos, Wexler and Roughgarden (SIAM J. Comput. 38 (2008), DOI 10.1137/070680096) studied the fair connection game, in which the cost of an edge is shared equally (the Shapley value) among its users. In this game the worst equilibrium can cost kkk times the optimum, so the relevant measure is the price of stability: the ratio between the cheapest pure Nash equilibrium and the optimal centralized design. Their Theorem 2.1 bounds it by the harmonic number H(k)=1+12+⋯+1kH(k)=1+\frac12+\dots+\frac1kH(k)=1+21​+⋯+k1​ in every directed graph, and that bound is tight for directed graphs.

For undirected graphs the paper notes that H(k)H(k)H(k) is not tight and calls the correct bound "an interesting open problem". Its Section 4 settles the smallest case: two players with a common terminal. The general theorem gives H(2)=3/2H(2)=3/2H(2)=3/2 there; Claim 4.1 improves this to 4/34/34/3, and a three-node example shows that 4/34/34/3 is the right value.

Timeline. Rosenthal (1973) showed that congestion games have pure Nash equilibria through a potential function. Anshelevich et al. (FOCS 2004; journal version 2008) introduced the price of stability for the fair connection game, proved the H(k)H(k)H(k) bound and the two-player undirected bound 4/34/34/3 treated here. Subsequent work studied the undirected multi-player case, which remains without a matching upper and lower bound in general.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite undirected simple graph, with a cost ce≥0c_e\ge0ce​≥0 on every edge eee. There are two players, a common terminal s∈Vs\in Vs∈V and personal terminals t1,t2∈Vt_1,t_2\in Vt1​,t2​∈V. A strategy of player iii is a set of edges Si⊆ES_i\subseteq ESi​⊆E that connects tit_iti​ with sss: in the graph (V,Si)(V,S_i)(V,Si​), tit_iti​ and sss lie in the same connected component. A profile is a pair S=(S1,S2)S=(S_1,S_2)S=(S1​,S2​) of strategies.

Under fair cost sharing each edge is paid for equally by the players using it. With xe∈{1,2}x_e\in\{1,2\}xe​∈{1,2} the number of players whose strategy contains eee, player iii pays

Ci(S)=∑e∈Sicexe.C_i(S)=\sum_{e\in S_i}\frac{c_e}{x_e}.Ci​(S)=e∈Si​∑​xe​ce​​.

A pure Nash equilibrium is a profile in which no player can lower its payment by switching to another strategy while the other player's strategy stays fixed. The total cost of a profile is the cost of the network it builds,

cost(S)=∑e∈S1∪S2ce.\mathrm{cost}(S)=\sum_{e\in S_1\cup S_2}c_e .cost(S)=e∈S1​∪S2​∑​ce​.

For a set FFF of edges write cost(F)=∑e∈Fce\mathrm{cost}(F)=\sum_{e\in F}c_ecost(F)=∑e∈F​ce​. For a profile (S1,S2)(S_1,S_2)(S1​,S2​), the quantities x1=cost(S1∖S2)x_1=\mathrm{cost}(S_1\setminus S_2)x1​=cost(S1​∖S2​), x2=cost(S2∖S1)x_2=\mathrm{cost}(S_2\setminus S_1)x2​=cost(S2​∖S1​) and x3=cost(S1∩S2)x_3=\mathrm{cost}(S_1\cap S_2)x3​=cost(S1​∩S2​) split the total cost into the private and the shared parts.

The game is an instance of a congestion game, with per-user latency ce/xc_e/xce​/x on edge eee; the mission builds on the published congestion-game layer CongestionPoA.AsymSum.Model.

Formalization targets

Goal: Claim 4.1 and its tightness

If the game has a profile, then some pure Nash equilibrium SSS satisfies

cost(S) ≤ 43 cost(P)for every profile P.\mathrm{cost}(S)\ \le\ \tfrac43\,\mathrm{cost}(P)\qquad\text{for every profile }P.cost(S) ≤ 34​cost(P)for every profile P.

Moreover, in the three-node example (nodes s,t1,t2s,t_1,t_2s,t1​,t2​, edges (s,t1),(s,t2)(s,t_1),(s,t_2)(s,t1​),(s,t2​) of cost 222, edge (t1,t2)(t_1,t_2)(t1​,t2​) of cost 1+ε1+\varepsilon1+ε, with 0<ε<10<\varepsilon<10<ε<1) the cheapest pure Nash equilibrium costs exactly 444 and the optimum costs exactly 3+ε3+\varepsilon3+ε, so the ratio 4/(3+ε)4/(3+\varepsilon)4/(3+ε) approaches 4/34/34/3.

Milestones

  1. (4.1). From every profile (S1,S2)(S_1,S_2)(S1​,S2​), some pure Nash equilibrium (S1′,S2′)(S'_1,S'_2)(S1′​,S2′​) has y1+y2+32y3≤x1+x2+32x3y_1+y_2+\frac32y_3\le x_1+x_2+\frac32x_3y1​+y2​+23​y3​≤x1​+x2​+23​x3​, where yiy_iyi​ are the quantities of (S1′,S2′)(S'_1,S'_2)(S1′​,S2′​).
  2. Deviation inequalities. If (S1′,S2′)(S'_1,S'_2)(S1′​,S2′​) is a Nash equilibrium and each SiS_iSi​ is an inclusion-minimal strategy, then y1+y32≤x1+x2+y22+y32y_1+\frac{y_3}2\le x_1+x_2+\frac{y_2}2+\frac{y_3}2y1​+2y3​​≤x1​+x2​+2y2​​+2y3​​ and symmetrically for player 2.
  3. (4.2). Under the same hypotheses, y12+y22≤2x1+2x2\frac{y_1}2+\frac{y_2}2\le 2x_1+2x_22y1​​+2y2​​≤2x1​+2x2​.
  4. The three-node example, as in the second half of the goal.

Significance

The result shows that the price of stability of fair cost sharing depends on the network: the H(k)H(k)H(k) bound, tight for directed graphs, is not tight for undirected ones even with two players. It is the first undirected bound below H(k)H(k)H(k) and the starting point for the later study of undirected fair network design, where the question for many players is still open.

The theorem is proved in the paper; this mission formalizes it. A search of the Prove2Me library found no formalization of the price of stability of fair connection games. Beyond the theorem itself, the mission produces a reusable undirected layer over the congestion-game library: connectivity strategies stated with Mathlib's graph reachability, fair cost sharing as a congestion game, and the total-cost functional. A checked proof of the potential inequality (4.1) is the two-player case of the potential argument behind Theorem 2.1.

Difficulty

The obvious argument starts from an optimal solution, follows improving moves to an equilibrium and compares potentials. For two players this only yields the factor H(2)=3/2H(2)=3/2H(2)=3/2: the potential counts shared edges with weight 3/23/23/2, so a potential inequality alone cannot rule out an equilibrium in which both players share expensive edges. The improvement to 4/34/34/3 needs a second inequality, (4.2), obtained from a specific deviation of each player in the equilibrium, and that deviation is valid only because of the undirected structure: the private parts of the two optimal paths together connect t1t_1t1​ with t2t_2t2​, and the deviating player can then follow the other player's equilibrium route to sss. Making this connectivity claim precise for edge sets rather than drawn paths is where the formal work lies. It holds when the optimal strategies are inclusion-minimal, which is why the deviation milestones carry that hypothesis.

Formalization scope

  • Vertices form a Fintype with decidable equality; edges are unordered pairs Sym2 V; the graph is a SimpleGraph V. Edge costs are a real function c with 0 ≤ c e for every e.
  • A strategy of player i : Fin 2 (the paper's players 1 and 2 are 0 and 1) is a Finset of edges contained in G.edgeSet such that t i and s are Reachable in SimpleGraph.fromEdgeSet. Strategies are not restricted to paths.
  • The game is a CongestionGame from CongestionPoA.AsymSum.Model with latency ce/xc_e/xce​/x; profiles, player costs and pure Nash equilibria are that library's IsProfile, cost and IsPureNash.
  • "Price of stability at most 4/34/34/3" is stated in existence form: some pure Nash equilibrium costs at most 43\frac4334​ times every profile. A formalization quantifying over all equilibria would be false (the price of anarchy is 222), and one dropping the Nash condition would be trivial; neither is acceptable. The tightness half fixes a concrete instance and asserts both that an equilibrium of cost 444 exists and that every equilibrium costs at least 444.
  • The deviation inequalities and (4.2) assume inclusion-minimal reference strategies; this hypothesis is implicit in the paper and does not appear in the goal, which quantifies over all profiles.

Contributions welcome: a proof of the potential inequality (finite improvement paths in the two-player fair game), the graph-theoretic lemma that the symmetric difference of two simple paths with a common endpoint connects their other endpoints, and a computation of the three-node example.

Selected references

  • E. Anshelevich, A. Dasgupta, J. Kleinberg, É. Tardos, T. Wexler, T. Roughgarden, The Price of Stability for Network Design with Fair Cost Allocation, SIAM Journal on Computing 38(4):1602–1623, 2008. https://doi.org/10.1137/070680096
  • R. W. Rosenthal, A class of games possessing pure-strategy Nash equilibria, International Journal of Game Theory 2:65–67, 1973. https://doi.org/10.1007/BF01737559
  • D. Monderer, L. S. Shapley, Potential games, Games and Economic Behavior 14(1):124–143, 1996. https://doi.org/10.1006/game.1996.0044
  • G. Christodoulou, E. Koutsoupias, The price of anarchy of finite congestion games, STOC 2005, 67–73. https://doi.org/10.1145/1060590.1060600
9 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

The Price of Stability for Network Design with Fair Cost Allocation IV: In Weighted Games with a Common Source and Sink, Best-Response Dynamics Converge to a Nash EquilibriumResearch Paper

Motivation

In a network design game each player must connect its terminals in a graph whose edges carry fixed costs, and the cost of an edge is split among the players that use it. Anshelevich, Dasgupta, Kleinberg, Tardos, Wexler and Roughgarden (SIAM J. Comput. 38 (2008)) studied the fair (Shapley) split, in which the users of an edge pay equal shares. That game is a congestion game in the sense of Rosenthal (Int. J. Game Theory 2 (1973)), so it has an exact potential and pure Nash equilibria always exist.

Section 6 of the same paper turns to weighted players: player iii has a weight wi≥1w_i \ge 1wi​≥1 (a traffic volume, a bandwidth demand, a share of ownership) and pays for each edge it uses a share proportional to its weight. The equal-split potential is then lost, and the paper notes that weighted games with three or more players need not have a pure Nash equilibrium at all (Chen and Roughgarden, Network design with weighted players, SPAA 2006). Theorem 6.3 identifies a natural class in which equilibria survive: all players share one source and one sink. For that class it shows more than existence. The simplest decentralized procedure, letting players in turn switch to a cheapest route, always stops, and where it stops is an equilibrium.

Setting

A finite directed multigraph DDD has a finite set EEE of arcs; each arc eee has a tail and a head vertex, and parallel arcs between the same two vertices are allowed. Fix a source sss and a sink ttt. A simple sss–ttt path is a sequence of arcs e1,…,eme_1,\dots,e_me1​,…,em​ (m≥1m\ge1m≥1), each starting where the previous one ends, beginning at sss, ending at ttt, and visiting no vertex twice; it is identified with its arc set P⊆EP\subseteq EP⊆E. Write Sst\mathcal S_{st}Sst​ for the finite set of these paths.

The weighted single-commodity game has a finite set of players; player iii has a weight wi≥1w_i\ge1wi​≥1, arc eee has a fixed cost ce≥0c_e\ge0ce​≥0, and every player's strategy set is Sst\mathcal S_{st}Sst​. In a profile S=(Si)iS=(S_i)_iS=(Si​)i​ let

We=∑i : e∈SiwiW_e=\sum_{i\,:\,e\in S_i} w_iWe​=i:e∈Si​∑​wi​

be the total weight on arc eee. Player iii pays

payi(S)=∑e∈SiwiWe ce.\mathrm{pay}_i(S)=\sum_{e\in S_i}\frac{w_i}{W_e}\,c_e .payi​(S)=e∈Si​∑​We​wi​​ce​.

A profile is a (pure) Nash equilibrium if no player can lower its payment by switching alone to another path.

A best-response move of player iii replaces SiS_iSi​ by a path TTT that minimises iii's payment given the other players' paths, provided this strictly lowers iii's payment. Best-response dynamics is any sequence of profiles in which each profile arises from the previous one by a best-response move of some player.

Formalization targets

Goal: Theorem 6.3 (p. 1620)

For every such game with wi≥1w_i\ge1wi​≥1 and ce≥0c_e\ge0ce​≥0:

there is no infinite sequence S0,S1,… with Sn+1 a best-response move from Sn;\text{there is no infinite sequence } S^0,S^1,\dots \text{ with } S^{n+1} \text{ a best-response move from } S^n;there is no infinite sequence S0,S1,… with Sn+1 a best-response move from Sn; a profile admitting no best-response move is a Nash equilibrium;\text{a profile admitting no best-response move is a Nash equilibrium;}a profile admitting no best-response move is a Nash equilibrium; Sst≠∅  ⟹  a pure Nash equilibrium exists.\mathcal S_{st}\neq\emptyset \;\Longrightarrow\; \text{a pure Nash equilibrium exists.}Sst​=∅⟹a pure Nash equilibrium exists.

The goal asserts only termination and existence; it fixes no bound on the length of a run.

Milestones (proof of Theorem 6.3, p. 1620)

For a profile SSS define the marginal cost of a path, cS(P)=∑e∈Pce/We∈[0,+∞]c_S(P)=\sum_{e\in P}c_e/W_e\in[0,+\infty]cS​(P)=∑e∈P​ce​/We​∈[0,+∞], and the tuple P(S)P(S)P(S) of all values cS(P)c_S(P)cS​(P), P∈SstP\in\mathcal S_{st}P∈Sst​, sorted increasingly. With strictly positive arc costs:

  1. a player on path PPP pays wi cS(P)w_i\,c_S(P)wi​cS​(P) (this one needs only ce≥0c_e\ge0ce​≥0);
  2. inequality (6.1): if player iii makes a best-response move from P1P_1P1​ to P2P_2P2​ and P\mathcal PP is the set of paths sharing an arc with P1∪P2P_1\cup P_2P1​∪P2​, then min⁡P∈PcS′(P)<min⁡P∈PcS(P)\min_{P\in\mathcal P}c_{S'}(P)<\min_{P\in\mathcal P}c_S(P)minP∈P​cS′​(P)<minP∈P​cS​(P);
  3. every best-response move strictly decreases P(S)P(S)P(S) in the lexicographic order.

Significance

The theorem gives a guarantee about dynamics, not only about existence: in single-commodity weighted network design, any order in which players take turns playing best responses reaches a stable outcome in finitely many steps. This places the single-commodity case on the positive side of the boundary drawn by the nonexistence examples for general weighted games. The tuple of sorted path costs is a potential that is not a single number, a device that applies to other games without an exact potential.

The result is proved in the paper; it has no machine-checked proof that this mission is aware of. A formal development contributes a reusable layer for weighted cost-sharing games (payments, best responses, Nash equilibria on arbitrary strategy families), a treatment of simple directed paths in multigraphs as strategy sets, and a lexicographic termination argument over sorted lists of extended reals. The goal is stated for nonnegative costs, as in the paper's model, while the printed proof uses positive costs; closing that gap is part of the work.

Difficulty

The obvious route, finding a real-valued function that every improving move decreases, is unavailable: the paper notes that Rosenthal's potential Φ\PhiΦ is not a potential once weights are added, and that improving moves can increase it. Termination must instead come from an ordinal quantity, a whole sorted list compared lexicographically, and the move of one player changes the marginal costs of every path that shares an arc with the old or the new route, in both directions.

The argument also depends on the shape of the strategy sets. Two distinct simple sss–ttt paths are never nested as arc sets; with walks that repeat vertices, or with arbitrary strategy families, the comparison between a path's marginal cost before and after a deviation can fail. Arcs of cost zero create a further gap: ce/Wec_e/W_ece​/We​ is 0/00/00/0 on an unused free arc, and the strict inequalities of the proof degenerate, so the nonnegative-cost goal needs more than the printed argument.

Formalization scope

  • Players form a finite type; arcs form a finite type with tail and head maps into a vertex type. Parallel arcs are kept.
  • A strategy is a Finset of arcs; the strategy family of every player is the finite set of arc sets of simple sss–ttt paths (a list of consecutive arcs with distinct visited vertices). There are no paths when s=ts=ts=t.
  • Weights and costs are real numbers with wi≥1w_i\ge1wi​≥1, ce≥0c_e\ge0ce​≥0 (the predicate IsStandard); the milestones (6.1) and the lexicographic decrease assume ce>0c_e>0ce​>0.
  • Payments are real; on every used arc We≥wi≥1W_e\ge w_i\ge1We​≥wi​≥1, so the division is never by zero.
  • The marginal cost cS(P)c_S(P)cS​(P) is valued in [0,+∞][0,+\infty][0,+∞] (ℝ≥0∞): an unused arc of positive cost contributes +∞+\infty+∞. Computing it in the reals, where x/0=0x/0=0x/0=0, would make unused paths free and the milestones false.
  • Termination is the well-foundedness of the relation "S′S'S′ is reached from SSS by one best-response move" with S′S'S′ below SSS; the reverse orientation is a different statement.
  • A best-response move requires a strict improvement and an exact minimiser; dropping either makes termination trivially true or false, and the second clause of the goal (no move possible implies Nash) guards against a move relation that is too narrow.

Contributions welcome: lemmas on simple paths in multigraphs (non-nestedness), the multiset-to-sorted-list lexicographic comparison, and the treatment of zero-cost arcs.

Selected references

  • E. Anshelevich, A. Dasgupta, J. Kleinberg, É. Tardos, T. Wexler, T. Roughgarden, The Price of Stability for Network Design with Fair Cost Allocation, SIAM Journal on Computing 38(4):1602–1623, 2008. https://doi.org/10.1137/070680096
  • R. W. Rosenthal, A class of games possessing pure-strategy Nash equilibria, International Journal of Game Theory 2:65–67, 1973. https://doi.org/10.1007/BF01737559
  • D. Monderer, L. S. Shapley, Potential games, Games and Economic Behavior 14:124–143, 1996. https://doi.org/10.1006/game.1996.0044
  • H. Chen, T. Roughgarden, Network design with weighted players, Proceedings of the 18th ACM Symposium on Parallelism in Algorithms and Architectures (SPAA), 2006, pp. 28–37.
6 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

The Price of Stability for Network Design with Fair Cost Allocation III: Weighted Games in Which Each Edge Serves at Most Two Players Have a Potential and a Nash EquilibriumResearch Paper

Motivation

In a network design game each of kkk players must connect its own terminals in a shared graph, and the cost of every edge that is bought is split among the players who use it. Anshelevich, Dasgupta, Kleinberg, Tardos, Wexler and Roughgarden (SIAM J. Comput. 2008) studied the fair (Shapley) split, in which the xex_exe​ users of an edge each pay ce/xec_e/x_ece​/xe​. That game is a congestion game in the sense of Rosenthal (Networks 1973), so it has an exact potential function and pure Nash equilibria always exist.

When players carry different amounts of traffic, the natural rule is to split an edge's cost in proportion to weight: a player of weight wiw_iwi​ on an edge whose users have total weight WeW_eWe​ pays (wi/We) ce(w_i/W_e)\,c_e(wi​/We​)ce​. The paper notes that this rule is analogous to weighted generalizations of the Shapley value (Monderer and Samet, Variations of the Shapley Value, Handbook of Game Theory III, 2002). The weighted model leaves Rosenthal's framework: the share depends on which players use an edge, not only on how many, and Chen and Roughgarden (SPAA 2006) showed that weighted games with three or more players need not have a pure Nash equilibrium at all. Section 6 of the paper identifies structural conditions under which equilibria do exist. This mission covers the first of them.

Timeline. Rosenthal (1973): every congestion game has a pure Nash equilibrium, via an exact potential. Monderer and Shapley (GEB 1996): potential and weighted potential games, and the equivalence of exact potential games with congestion games. Anshelevich et al. (FOCS 2004, journal 2008): Theorem 6.1, existence when every resource is shared by at most two players, and Theorem 6.3, existence when all players share a source and a sink. Chen and Roughgarden (2006): weighted network design games with three or more players may have no pure equilibrium.

Setting

A weighted cost-sharing game GGG consists of a finite set of players, a finite ground set EEE of edges (resources), and for each player iii:

  • a finite family Σi\Sigma_iΣi​ of feasible strategies, each a subset of EEE;
  • a weight wi≥1w_i \ge 1wi​≥1;

together with a fixed edge cost ce≥0c_e \ge 0ce​≥0 for every e∈Ee \in Ee∈E. A profile S=(Si)iS = (S_i)_iS=(Si​)i​ picks Si∈ΣiS_i \in \Sigma_iSi​∈Σi​ for every player. For an edge eee, WeW_eWe​ is the total weight of the players with e∈Sie \in S_ie∈Si​, and player iii's payment is

Ci(S)=∑e∈SiwiWe ce.C_i(S) = \sum_{e \in S_i} \frac{w_i}{W_e}\, c_e .Ci​(S)=e∈Si​∑​We​wi​​ce​.

A profile is a pure Nash equilibrium when no player iii has a T∈ΣiT \in \Sigma_iT∈Σi​ with Ci(S−i,T)<Ci(S)C_i(S_{-i}, T) < C_i(S)Ci​(S−i​,T)<Ci​(S), where (S−i,T)(S_{-i}, T)(S−i​,T) is the profile in which iii plays TTT and everyone else keeps their strategy.

The strategy space of player iii is the set of edges that occur in at least one strategy of Σi\Sigma_iΣi​. The hypothesis of Theorem 6.1 is that every edge lies in the strategy spaces of at most two players: no edge can ever be shared by three players, whatever they choose.

The network design game is the instance in which EEE is the edge set of a graph and Σi\Sigma_iΣi​ is the set of edge sets of paths connecting player iii's source sis_isi​ to its sink tit_iti​.

The paper's proof uses an explicit function Φ(S)=∑eΦe(S)\Phi(S) = \sum_e \Phi_e(S)Φ(S)=∑e​Φe​(S) with Φe(S)=0\Phi_e(S) = 0Φe​(S)=0 when eee is unused, cewic_e w_ice​wi​ when iii alone uses eee, and ceθijc_e\theta_{ij}ce​θij​ when iii and jjj both use it, where θij=wi+wj−wiwj/(wi+wj)\theta_{ij} = w_i + w_j - w_i w_j/(w_i + w_j)θij​=wi​+wj​−wi​wj​/(wi​+wj​). It is part of the definitions of this mission.

Formalization targets

Goal: Theorem 6.1

If every edge lies in the strategy spaces of at most two players, there is a weighted potential: a real function Φ\PhiΦ on profiles with

Φ(S−i,T)−Φ(S)=wi (Ci(S−i,T)−Ci(S))for every profile S, player i, T∈Σi,\Phi(S_{-i}, T) - \Phi(S) = w_i\,\bigl(C_i(S_{-i}, T) - C_i(S)\bigr) \quad\text{for every profile } S,\ \text{player } i,\ T \in \Sigma_i ,Φ(S−i​,T)−Φ(S)=wi​(Ci​(S−i​,T)−Ci​(S))for every profile S, player i, T∈Σi​,

and, if every Σi\Sigma_iΣi​ is nonempty, a pure Nash equilibrium exists. The goal asserts the existence of such a Φ\PhiΦ rather than fixing the paper's formula, so it remains valid for any other weighted potential.

Milestones

  1. Joining a shared edge (proof of Theorem 6.1): when iii joins an edge already used by exactly one other player jjj, Φe\Phi_eΦe​ rises by cewi2/(wi+wj)c_e w_i^2/(w_i + w_j)ce​wi2​/(wi​+wj​), which is wiw_iwi​ times iii's new share of eee.
  2. The identity for the explicit potential: the displayed identity holds for the paper's Φ\PhiΦ.
  3. From a weighted potential to an equilibrium: in any weighted game with positive weights and nonempty strategy sets, a function satisfying the identity forces a pure Nash equilibrium to exist.

An extra item states Corollary 6.2: every two-player weighted game with nonempty strategy sets has a pure Nash equilibrium.

Significance

The result. Theorem 6.1 is one of the two existence results the paper proves for weighted cost sharing, a game that in general has no pure equilibrium. It shows that the obstruction found by Chen and Roughgarden needs resources shared by three or more players: whenever sharing is limited to pairs, the game is a weighted potential game, so improving moves cannot cycle and equilibria exist. Corollary 6.2 makes the two-player case unconditional, and the paper notes that the same potential gives a (weak) bound on the price of stability.

Formalizing it. The result is proved in the paper; to our knowledge no machine-checked version exists. The mission produces a reusable Lean model of weight-proportional cost sharing (shared in form with the companion mission on single-source single-sink weighted games), an explicit weighted potential, and the general step from a weighted potential to a pure equilibrium, which applies to any finite game with positive weights.

Difficulty

The obvious approach, reusing Rosenthal's potential from the unweighted game, fails: the paper observes that in a weighted game improving moves can increase it. A player's share of an edge depends on the weights of the specific co-users, so no function of the edge loads alone can track all players' costs. The identity must therefore hold for every unilateral move, including moves that leave some edges and join others at the same time, and for every pair of possible co-users of an edge. The statement fails without the at-most-two hypothesis, so any argument has to use it in an essential way. The existence step needs the identity on all profiles reachable by feasible deviations, not only along a single path of moves.

Formalization scope

Lean namespace PriceOfStability.WeightedPotential. Players form a Fintype ι and edges a Fintype E; a game is a structure with strategies : ι → Finset (Finset E), weight : ι → ℝ and edgeCost : E → ℝ. Standing assumptions wᵢ ≥ 1 and c_e ≥ 0 are the predicate IsStandard. Profiles are functions ι → Finset E with the feasibility predicate IsProfile; every deviation is to a feasible strategy, via Function.update. Nash equilibria are pure and in cost form. The strategy-space hypothesis is a bound on the number of players whose strategy space (the union of their strategies) contains each edge — not a bound on the users in one profile, which would be a different statement. Φ_e is computed from the current users of e; its value with three or more users is a placeholder that never arises under the hypothesis. Strategies are arbitrary subsets of the ground set, as the paper's remark after the proof allows, so the network game is a special case.

The goal is not satisfiable trivially: the function Φ must satisfy the weighted identity for every feasible unilateral deviation from every profile, and an exact (unweighted) potential is not what is asserted. Nonempty strategy sets are added explicitly for the existence part, since without a profile there is no equilibrium.

Needed infrastructure: finite sums over filtered Finsets, the improvement-path argument over the finite set of profiles. The improvement-path lemma (milestone 3) is reusable for any weighted potential game. Contributions of proofs for any milestone are welcome.

Selected references

  • E. Anshelevich, A. Dasgupta, J. Kleinberg, É. Tardos, T. Wexler, T. Roughgarden, The Price of Stability for Network Design with Fair Cost Allocation, SIAM Journal on Computing 38(4):1602–1623, 2008. https://doi.org/10.1137/070680096
  • R. W. Rosenthal, The network equilibrium problem in integers, Networks 3:53–59, 1973. https://doi.org/10.1002/net.3230030104
  • D. Monderer, L. S. Shapley, Potential games, Games and Economic Behavior 14:124–143, 1996. https://doi.org/10.1006/game.1996.0044
  • H.-L. Chen, T. Roughgarden, Network design with weighted players, Proc. 18th ACM SPAA, 28–37, 2006. https://doi.org/10.1145/1148109.1148114
5 thms2 active usersReviewed
🏆Completed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

Secretary Problems: Weights and Discounts 1: An (8+3e)-Competitive Algorithm for the Weighted Secretary ProblemResearch Paper

Motivation

The classical secretary problem asks how to select one valuable candidate when candidates arrive in random order and a decision must be made when each candidate appears. Many allocation settings have several goods of unequal quality instead of a single position. An employer may have roles of different desirability, or a seller may have placements with different visibility. In the weighted secretary problem, an agent's value is multiplied by the weight of the good assigned to that agent. The algorithm must decide irrevocably as agents arrive, while the benchmark sees every value before assigning goods. Babaioff, Dinitz, Gupta, Immorlica and Talwar study this model with arbitrary fixed agent values and a uniformly random arrival order, and give a constant competitive ratio independent of the number of agents and goods (authors' version, §§2–3).

The paper also studies time discounts and matroid constraints. This mission concerns its weighted-goods result, Theorem 3.4. The result combines an online allocation rule for several comparably valuable agents with the familiar one-choice secretary rule for an unusually valuable agent. These are distinct ways in which the sorted offline assignment can earn value; both are present even when the weights are fixed in advance. The weighted model matters because matching a valuable agent to an unsuitable good can lose value despite accepting the right agent.

Setting

There are nnn agents e∈Ue\in Ue∈U, each with a nonnegative value v(e)v(e)v(e), and KKK goods indexed in decreasing order of nonnegative weight:

w(1)≥w(2)≥⋯≥w(K)≥0.w(1)\ge w(2)\ge\cdots\ge w(K)\ge0.w(1)≥w(2)≥⋯≥w(K)≥0.

An assignment sss gives each good to at most one agent, and each agent receives at most one good. A good may remain unassigned, represented by ⊥\bot⊥ with v(⊥)=0v(\bot)=0v(⊥)=0. Its value is ∑k=1Kv(s(k))w(k)\sum_{k=1}^K v(s(k))w(k)∑k=1K​v(s(k))w(k). Agent values are arbitrary, not drawn independently from a distribution. The uncertainty is the arrival order π\piπ, chosen uniformly from all permutations; an agent's value becomes visible on arrival, and an allocation decision cannot be revised.

The offline optimum, OPT\mathrm{OPT}OPT, assigns the heaviest good to the highest-valued agent, the next good to the next agent, and so on. If K>nK>nK>n, the extra goods remain unassigned. A consistent tie break makes the ordering unique without changing the numerical value. This sorted assignment is defined directly; the mission does not replace it with an unconstrained variable said to be optimal.

The reservation algorithm draws a sample size τ∼Binom(n,1/2)\tau\sim\mathrm{Binom}(n,1/2)τ∼Binom(n,1/2), observes the first τ\tauτ agents without allocation, and retains the best min⁡(K,τ)\min(K,\tau)min(K,τ) sampled agents. Positive values are grouped into value classes [2i−1,2i)[2^{i-1},2^i)[2i−1,2i) for integer iii. A sampled agent in class iii reserves one good in that class's contiguous block, with higher classes receiving heavier blocks. A later agent receives the heaviest unassigned good reserved for its class when one is available. The classical secretary rule instead observes the first ⌊n/e⌋\lfloor n/e\rfloor⌊n/e⌋ agents, then selects the first later arrival better than every predecessor; its winner receives good 111.

Formalization targets

The mission's goal is the exact guarantee of Theorem 3.4 for Algorithm AAA, which runs the reservation algorithm with probability 8/(3e+8)8/(3e+8)8/(3e+8) and the classical rule with probability 3e/(3e+8)3e/(3e+8)3e/(3e+8):

OPT≤(8+3e) E[A].\mathrm{OPT}\le(8+3e)\,\mathbb E[A].OPT≤(8+3e)E[A].

Here the expectation covers the uniform arrival permutation, the independent binomial sample size used by the reservation branch, and the mixing coin. The multiplicative inequality expresses competitiveness even when an expected payoff is zero. It uses the explicit constant in the paper's proof rather than an instance-dependent or unspecified constant.

Four source results form the milestones. The classical secretary rule selects the maximum with probability at least 1/e1/e1/e. Lemma 3.2 compares the starting indices bib_ibi​ and oio_ioi​ of class-iii blocks in the reservation and optimum assignments. Lemma 3.1 says that if the optimum assigns at least two agents from class iii, the reservation rule assigns at least ui/4u_i/4ui​/4 agents from that class in expectation. Lemma 3.3 converts this to expected value at least OPTi/8\mathrm{OPT}_i/8OPTi​/8. The target retains the paper's class condition and both numerical fractions (authors' version, pp. 4–5).

Significance

Theorem 3.4 supplies a constant factor guarantee for irrevocable allocation when goods have different weights and agents arrive in random order. The factor does not grow with nnn or KKK. It separates the effects of uncertain arrivals from the offline matching of high values to high weights, and it supplies a benchmark for later variants with more complicated feasibility constraints. The paper extends the reservation idea to additional combinatorial settings, including partition-matroid variants in Appendix C (authors' version, Appendix C).

The theorem is proved in the source paper, while the Lean statements in this mission are proof obligations. Formalizing them requires checking that the random-order model, sample distribution, tie convention and assignments jointly express the same algorithm. A complete development will also establish reusable finite-average facts for random permutations and binomial samples, and structural facts about sorted assignments and reserved blocks. Those pieces can support other secretary problems in the series; the mission's specific promise remains the weighted algorithm's exact bound.

Difficulty

A count of how many agents a class receives does not by itself control the weighted value of those goods. Goods have unequal weights, and the value of assigning the next good changes with its position in a block. A class whose offline optimum receives several agents can also lose all its sampled members from the allocation phase. Thus a direct comparison of expected class counts with expected class values is insufficient. The paper's separate count, block-position and value statements identify the claims a solver must establish; the final theorem must also account for classes represented only once in the offline assignment (authors' version, p. 5).

Formalization scope

Agents and goods are Fin n and Fin K; their indices start at zero in Lean, so paper time ttt corresponds to Lean index t−1t-1t−1. An arrival permutation maps time to agent. Values and weights are real and explicitly nonnegative, and weights are antitone in the good index. The finite sums defining expectations are normalized by n!n!n! for permutations and by (nτ)/2n\binom n\tau/2^n(τn​)/2n for sample sizes. No measurability or integration convention is needed. For the goal, K≥1K\ge1K≥1 makes the heaviest good available; K>nK>nK>n is allowed.

Equal values are ordered by smaller original agent index throughout the sorted optimum, the sample's top agents and the classical rule. The classical rule observes exactly ⌊n/e⌋\lfloor n/e\rfloor⌊n/e⌋ arrivals, and zero-valued agents reserve no value-class goods. Positive values below one use negative integer class indices. The paper says only that class iii holds the values “between” 2i−12^{i-1}2i−1 and 2i2^i2i (p. 4, and again in Appendix C, p. 12); the mission fixes the half-open interval [2i−1,2i)[2^{i-1},2^i)[2i−1,2i), so that the classes partition the positive reals (authors' version, pp. 4, 12). A reservation assignment is built from each post-sample agent's rank within its class, so a good is offered to at most one such agent. The theorem is about this concrete algorithm and the concrete sorted offline assignment; an arbitrary favorable policy or an optimum supplied as a hypothesis would not express the source result.

The development needs a finite assignment interface, a tie-aware rank order, value classes, the two online rules, and normalized finite expectations. The assignment and finite-average definitions are reusable. Contributions that prove the structural validity of the reservation assignment, the classical success guarantee, Lemmas 3.1–3.3, or the final combination all advance the stated target.

Selected references

  • Moshe Babaioff, Michael Dinitz, Anupam Gupta, Nicole Immorlica and Kunal Talwar, Secretary Problems: Weights and Discounts, Proceedings of SODA 2009; authors' full version, proceedings DOI.
7 thms2 active usersReviewed
🏆Completed
Convex OptimizationMachine LearningOptimization·Captain: mikedeng1

Blackwell Approachability and No-Regret Learning are Equivalent 2: A No-Regret Algorithm and a Valid Halfspace Oracle Approach a Compact Convex Set at Rate 2·Regret_T/TResearch Paper

Motivation

Blackwell approachability is the vector-payoff analogue of von Neumann's minimax theorem. In a repeated game where each round's outcome is a vector u(xt,yt)∈Rdu(x_t, y_t) \in \mathbb R^du(xt​,yt​)∈Rd, a player wants the running average of these vectors to converge to a target set SSS, whatever the opponent does. Blackwell (1956) showed when this is possible, and approachability has since become a standard tool for calibrated forecasting, regret minimization with respect to general benchmarks, and learning in games.

Online linear optimization (OLO) is the problem of choosing points θt\theta_tθt​ in a fixed decision set K\mathcal KK against a sequence of linear losses ⟨ft,⋅⟩\langle f_t, \cdot\rangle⟨ft​,⋅⟩, with performance measured by regret against the best fixed point in hindsight. Algorithms with regret o(T)o(T)o(T) — "no-regret" algorithms such as online gradient descent (Zinkevich, 2003) — are among the most studied objects of machine learning.

Abernethy, Bartlett and Hazan (COLT 2011) showed that the two problems are algorithmically equivalent: each can be converted into the other with explicit control of the rates. This mission covers the direction from OLO to approachability.

Timeline:

  • 1956: Blackwell proves the approachability theorem for convex sets, via a geometric projection strategy.
  • 2003: Zinkevich introduces online gradient descent, a no-regret algorithm for any bounded convex decision set.
  • 2009: Even-Dar, Kleinberg, Mannor and Mansour state approachability in the response-satisfiability form (as cited on p. 32 of the 2011 paper).
  • 2011: Abernethy, Bartlett and Hazan give the two reductions, with explicit rates, and apply them to efficient calibration.

Setting

A Blackwell instance (X,Y,u,S)(\mathcal X, \mathcal Y, u, S)(X,Y,u,S) consists of compact convex sets X⊆Rn\mathcal X \subseteq \mathbb R^nX⊆Rn, Y⊆Rm\mathcal Y \subseteq \mathbb R^mY⊆Rm, a payoff u:X×Y→Rdu : \mathcal X \times \mathcal Y \to \mathbb R^du:X×Y→Rd that is affine in each argument (biaffine), and a closed convex target set S⊆RdS \subseteq \mathbb R^dS⊆Rd. Write dist(z,U)=inf⁡w∈U∥z−w∥\mathtt{dist}(z, U) = \inf_{w \in U}\|z - w\|dist(z,U)=infw∈U​∥z−w∥ for the Euclidean distance to a set, and B2(r)B_2(r)B2​(r) for the closed Euclidean ball of radius rrr.

A halfspace oracle takes a halfspace H={z:⟨a,z⟩≤c}H = \{z : \langle a, z\rangle \le c\}H={z:⟨a,z⟩≤c} and returns a point O(H)∈X\mathcal O(H) \in \mathcal XO(H)∈X; it is valid if for every halfspace H⊇SH \supseteq SH⊇S, u(O(H),y)∈Hu(\mathcal O(H), y) \in Hu(O(H),y)∈H for all y∈Yy \in \mathcal Yy∈Y.

A set X⊆RdX \subseteq \mathbb R^dX⊆Rd is a cone if αz∈X\alpha z \in Xαz∈X for all z∈Xz \in Xz∈X, α≥0\alpha \ge 0α≥0. For K⊆RdK \subseteq \mathbb R^dK⊆Rd, cone(K)={αx:α≥0,x∈K}\mathtt{cone}(K) = \{\alpha x : \alpha \ge 0, x \in K\}cone(K)={αx:α≥0,x∈K}, and the polar cone of CCC is C0={θ:⟨θ,x⟩≤0 ∀x∈C}C^0 = \{\theta : \langle \theta, x\rangle \le 0 \ \forall x \in C\}C0={θ:⟨θ,x⟩≤0 ∀x∈C}.

An OLO algorithm L\mathcal LL maps past loss vectors (f1,…,ft−1)(f_1, \dots, f_{t-1})(f1​,…,ft−1​) to a point θt∈K\theta_t \in \mathcal Kθt​∈K, and its regret is

RegretT=∑t=1T⟨ft,θt⟩−min⁡θ∈K∑t=1T⟨ft,θ⟩.\mathrm{Regret}_T = \sum_{t=1}^T \langle f_t, \theta_t\rangle - \min_{\theta \in \mathcal K} \sum_{t=1}^T \langle f_t, \theta\rangle .RegretT​=t=1∑T​⟨ft​,θt​⟩−θ∈Kmin​t=1∑T​⟨ft​,θ⟩.

Algorithm 2 runs L\mathcal LL on K=S0∩B2(1)\mathcal K = S^0 \cap B_2(1)K=S0∩B2​(1) when SSS is a cone: at round ttt it sets θt=L(f1,…,ft−1)\theta_t = \mathcal L(f_1, \dots, f_{t-1})θt​=L(f1​,…,ft−1​), plays xt=O({z:⟨θt,z⟩≤0})x_t = \mathcal O(\{z : \langle \theta_t, z\rangle \le 0\})xt​=O({z:⟨θt​,z⟩≤0}), observes yt∈Yy_t \in \mathcal Yyt​∈Y, and feeds ft=−u(xt,yt)f_t = -u(x_t, y_t)ft​=−u(xt​,yt​) back to L\mathcal LL.

When SSS is compact but not a cone, it is lifted: with κ=max⁡s∈S∥s∥\kappa = \max_{s\in S}\|s\|κ=maxs∈S​∥s∥ and κ⊕z∈Rd+1\kappa \oplus z \in \mathbb R^{d+1}κ⊕z∈Rd+1 the concatenation, put u′(x,y)=κ⊕u(x,y)u'(x, y) = \kappa \oplus u(x, y)u′(x,y)=κ⊕u(x,y) and S′=cone({κ}×S)S' = \mathtt{cone}(\{\kappa\} \times S)S′=cone({κ}×S), and run Algorithm 2 on (X,Y,u′,S′)(\mathcal X, \mathcal Y, u', S')(X,Y,u′,S′).

Formalization targets

Goal: Corollary 18 (p. 39)

For a Blackwell instance with SSS nonempty and compact, any valid halfspace oracle for the lifted instance, any OLO algorithm with values in K′=(S′)0∩B2(1)\mathcal K' = (S')^0 \cap B_2(1)K′=(S′)0∩B2​(1), any T≥1T \ge 1T≥1 and any y1,…,yT∈Yy_1, \dots, y_T \in \mathcal Yy1​,…,yT​∈Y, the run of Algorithm 2 on the lifted instance satisfies

dist(1T∑t=1Tu(xt,yt),S)≤2 dist(1T∑t=1Tu′(xt,yt),S′)≤2T RegretT.\mathtt{dist}\Big(\frac1T\sum_{t=1}^T u(x_t,y_t), S\Big) \le 2\,\mathtt{dist}\Big(\frac1T\sum_{t=1}^T u'(x_t,y_t), S'\Big) \le \frac2T\,\mathrm{Regret}_T .dist(T1​t=1∑T​u(xt​,yt​),S)≤2dist(T1​t=1∑T​u′(xt​,yt​),S′)≤T2​RegretT​.

The bound holds for every TTT and every adversary, with no rate assumed for L\mathcal LL; a no-regret L\mathcal LL then gives approachability.

Milestones

  1. Lemma 13 (p. 35): for a nonempty convex cone CCC, dist(x,C)=max⁡θ∈C0∩B2(1)⟨θ,x⟩\mathtt{dist}(x, C) = \max_{\theta \in C^0 \cap B_2(1)} \langle \theta, x\rangledist(x,C)=maxθ∈C0∩B2​(1)​⟨θ,x⟩.
  2. Theorem 17 (p. 38): if SSS is a cone, Algorithm 2 achieves dist(1T∑tu(xt,yt),S)≤Regret(LK;f1:T)/T\mathtt{dist}\big(\frac1T\sum_t u(x_t,y_t), S\big) \le \mathrm{Regret}(\mathcal L_{\mathcal K}; f_{1:T})/Tdist(T1​∑t​u(xt​,yt​),S)≤Regret(LK​;f1:T​)/T.
  3. Lemma 14 (p. 35): for nonempty compact convex K\mathcal KK, κ=max⁡K∥⋅∥\kappa = \max_{\mathcal K}\|\cdot\|κ=maxK​∥⋅∥ and x∉Kx \notin \mathcal Kx∈/K, dist(κ⊕x,cone({κ}×K))≤dist(x,K)≤2 dist(κ⊕x,cone({κ}×K))\mathtt{dist}(\kappa\oplus x, \mathtt{cone}(\{\kappa\}\times\mathcal K)) \le \mathtt{dist}(x, \mathcal K) \le 2\,\mathtt{dist}(\kappa\oplus x, \mathtt{cone}(\{\kappa\}\times\mathcal K))dist(κ⊕x,cone({κ}×K))≤dist(x,K)≤2dist(κ⊕x,cone({κ}×K)).

Significance

The result. Corollary 18 turns any no-regret algorithm into an approachability strategy for a compact convex target, provided a valid halfspace oracle is available, with rate 2 RegretT/T2\,\mathrm{Regret}_T/T2RegretT​/T. Combined with online gradient descent it gives an O(1/T)O(1/\sqrt T)O(1/T​) approachability rate, and through the choice of OLO algorithm it lets approachability inherit the computational efficiency of online learning. The paper uses this route to build an efficient calibrated forecaster (Section 5). Together with the converse reduction (Theorem 16), it shows that the two problems are equivalent.

Formalizing it. The results are proved in the paper; none of them has been machine-checked. Formalizing them requires the conic duality formula for distances (Lemma 13), a quantitative lifting lemma (Lemma 14) and the bookkeeping of an interactive protocol. The proof of Lemma 14 on the page is a sketch: it refers to an undefined point and uses a triangle-similarity argument, so a complete proof is new work.

Difficulty

The reduction's core is Lemma 13: the distance to a cone is a maximum of a linear function over the polar cone's unit ball. Lemma 13 needs projection onto a cone in Euclidean space; for a non-closed cone the projection may not exist, and the argument must go through the closure. The lifting Lemma 14 is a geometric statement whose page proof relies on a picture and an undefined point, so the factor 2 has no complete written argument. Finally, connecting the average lifted payoff to the lift of the average payoff, and the halfspace guarantee ⟨θt,ft⟩≥0\langle\theta_t, f_t\rangle \ge 0⟨θt​,ft​⟩≥0 to the regret, requires keeping the round indexing and the oracle's validity domain exactly aligned.

Formalization scope

All spaces are EuclideanSpace ℝ (Fin d). The concatenation κ⊕z\kappa\oplus zκ⊕z lives in EuclideanSpace ℝ (Fin (d+1)) with coordinate 0 equal to κ\kappaκ, so ∥κ⊕z∥2=κ2+∥z∥2\|\kappa\oplus z\|^2 = \kappa^2 + \|z\|^2∥κ⊕z∥2=κ2+∥z∥2; a product type with the sup norm would change every distance and is ruled out. Distances are Metric.infDist. The polar cone uses the paper's sign (≤0\le 0≤0), the negative of Mathlib's innerDual. A halfspace is the pair (a,c)(a, c)(a,c); a valid oracle must answer every halfspace containing SSS, including a=0a = 0a=0, not only the halfspaces the algorithm happens to query. The OLO algorithm is a map from histories Fin t → ℝᴰ with values in S0∩B2(1)S^0 \cap B_2(1)S0∩B2​(1) at every history. Rounds are t=1,…,Tt = 1, \dots, Tt=1,…,T, and the run of Algorithm 2 is given as hypotheses on sequences θ,x,f\theta, x, fθ,x,f, which exist and are unique by recursion. The minimum in the regret and κ\kappaκ are written as sInf/sSup of images over nonempty compact sets, where they are attained.

Hypotheses added relative to the page: S≠∅S \neq \emptysetS=∅ and T≥1T \ge 1T≥1 in the goal; C≠∅C \ne \emptysetC=∅ in Lemma 13 (the empty set is a cone under Definition 11 and the identity fails for it); K≠∅\mathcal K \ne \emptysetK=∅ in Lemma 14. Corrected misprints, each disclosed in the item's note: "RegretT(A)\mathrm{Regret}_T(\mathcal A)RegretT​(A)" in Corollary 18 and (9) denotes the regret of the OLO algorithm L\mathcal LL on the lifted losses; Lemma 14's "K⊆H\mathcal K \subseteq \mathcal HK⊆H" has a stray H\mathcal HH; κ\kappaκ is the maximal norm of the set, not its diameter. The oracle in the goal is a valid oracle for the lifted instance, which is what applying Algorithm 2 to (X,Y,u′,S′)(\mathcal X, \mathcal Y, u', S')(X,Y,u′,S′) requires.

A formalization in which the oracle is valid only at the run's own queries, the OLO algorithm is unconstrained, the regret's minimum ranges over all of Rd+1\mathbb R^{d+1}Rd+1, or the middle term of the goal is dropped, is a different statement and is ruled out.

The development needs: the dual formula for the distance to a convex cone, nearest-point projection onto closed convex sets (in Mathlib), compactness of polar-cone slices, and finite sums of biaffine payoffs. The cone layer (Lemma 13) is reusable for the converse direction of the paper and for conic duality generally. Proofs of any milestone, and of the bridge from an oracle for the original instance to one for the lifted instance, are welcome.

Selected references

  • J. Abernethy, P. L. Bartlett, E. Hazan, Blackwell Approachability and No-Regret Learning are Equivalent, JMLR W&CP 19 (COLT 2011), pp. 27–46. https://proceedings.mlr.press/v19/abernethy11b.html
  • D. Blackwell, An analog of the minimax theorem for vector payoffs, Pacific Journal of Mathematics 6(1), 1956, pp. 1–8. https://doi.org/10.2140/pjm.1956.6.1
  • M. Zinkevich, Online convex programming and generalized infinitesimal gradient ascent, ICML 2003. https://www.aaai.org/Papers/ICML/2003/ICML03-120.pdf
6 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Correlated Equilibrium as an Expression of Bayesian Rationality II: Two-Person Correlated Equilibrium Distributions Are the Solutions of Linear InequalitiesResearch Paper

Motivation

A correlated equilibrium is the equilibrium notion that arises when the players of a game take their actions on the advice of a common randomizing device, each player seeing only his own recommendation. It was introduced by Aumann in 1974 (Aumann 1974). Aumann's 1987 paper (Aumann 1987) gives the simple, finite form of the definition used today (Definition 2.1) and shows that the notion is what Bayesian rationality with a common prior predicts. On the way it records, as Proposition 2.3, the fact that makes correlated equilibrium tractable in practice: for a finite two-person game, the distributions over action pairs that come from correlated equilibria are exactly the solutions of an explicit finite system of linear inequalities.

That characterization is the starting point of the computational theory of correlated equilibria. Because the set is a polyhedron, an optimal correlated equilibrium can be found by linear programming, and no-swap-regret learning dynamics converge to this set (Foster and Vohra 1997; Hart and Mas-Colell 2000). In each of these works the linear-inequality description is taken as the definition; the paper's Proposition 2.3 is the bridge back to the strategic definition.

Setting

Player 1 has a finite set S1S^1S1 of actions and player 2 a finite set S2S^2S2. For j∈S1j \in S^1j∈S1 and k∈S2k \in S^2k∈S2, hjk1h^1_{jk}hjk1​ and hjk2h^2_{jk}hjk2​ are the two players' payoffs at the action pair (j,k)(j,k)(j,k).

A correlated strategy pair is a pair of functions f1:Γ→S1f^1 : \Gamma \to S^1f1:Γ→S1, f2:Γ→S2f^2 : \Gamma \to S^2f2:Γ→S2 on a finite probability space (Γ,μ)(\Gamma, \mu)(Γ,μ): a finite set Γ\GammaΓ with nonnegative weights μ(γ)\mu(\gamma)μ(γ) summing to 111. Chance draws γ\gammaγ and suggests the action fi(γ)f^i(\gamma)fi(γ) to player iii. The pair is a correlated equilibrium (Definition 2.1, condition (2.2)) if no player gains by a deviation that depends only on his own suggestion: for every φ:S1→S1\varphi : S^1 \to S^1φ:S1→S1,

E h1(φ(f1),f2)≤E h1(f1,f2),\mathbb E\, h^1(\varphi(f^1), f^2) \le \mathbb E\, h^1(f^1, f^2),Eh1(φ(f1),f2)≤Eh1(f1,f2),

and the analogous inequality holds for player 2 and every ψ:S2→S2\psi : S^2 \to S^2ψ:S2→S2.

A distribution is a family (pjk)j∈S1,k∈S2(p_{jk})_{j \in S^1, k \in S^2}(pjk​)j∈S1,k∈S2​ with pjk≥0p_{jk} \ge 0pjk​≥0 and ∑j∑kpjk=1\sum_j \sum_k p_{jk} = 1∑j​∑k​pjk​=1. The distribution of a correlated strategy pair assigns to (j,k)(j,k)(j,k) the probability μ{f1=j, f2=k}\mu\{f^1 = j,\ f^2 = k\}μ{f1=j, f2=k}. A correlated equilibrium distribution (c.e.d.) is the distribution of some correlated equilibrium on some finite probability space.

In the Lean development these are IsDistribution p, IsProbVec μ, IsCE h₁ h₂ μ f₁ f₂, distr μ f₁ f₂ and IsCED h₁ h₂ p, with h₁ j k =hjk1= h^1_{jk}=hjk1​ and p j k =pjk= p_{jk}=pjk​.

Formalization targets

Goal: Proposition 2.3

For every distribution (pjk)(p_{jk})(pjk​): (pjk)(p_{jk})(pjk​) is a correlated equilibrium distribution if and only if

∑k(hjk1−hqk1) pjk≥0for all j,q∈S1,(2.4)\sum_k \big(h^1_{jk} - h^1_{qk}\big)\, p_{jk} \ge 0 \quad \text{for all } j, q \in S^1, \tag{2.4}k∑​(hjk1​−hqk1​)pjk​≥0for all j,q∈S1,(2.4) ∑j(hjk2−hjr2) pjk≥0for all k,r∈S2.(2.5)\sum_j \big(h^2_{jk} - h^2_{jr}\big)\, p_{jk} \ge 0 \quad \text{for all } k, r \in S^2. \tag{2.5}j∑​(hjk2​−hjr2​)pjk​≥0for all k,r∈S2.(2.5)

Milestones

  1. Identification with distributions (Sect. 2, p. 4). A correlated strategy pair is a correlated equilibrium if and only if its distribution ppp satisfies ∑j∑kpjkhφ(j)k1≤∑j∑kpjkhjk1\sum_j\sum_k p_{jk} h^1_{\varphi(j)k} \le \sum_j\sum_k p_{jk} h^1_{jk}∑j​∑k​pjk​hφ(j)k1​≤∑j​∑k​pjk​hjk1​ for all φ\varphiφ, and the analogous condition for player 2.
  2. Conditioning on possible suggestions (proof of Prop. 2.3, p. 6). For a distribution, player 1's condition holds if and only if H1(q∣j)≤H1(j∣j)H^1(q \mid j) \le H^1(j \mid j)H1(q∣j)≤H1(j∣j) for every suggestion jjj of positive probability and every qqq, where H1(q∣j)=∑khqk1pjk/∑kpjkH^1(q\mid j) = \sum_k h^1_{qk} p_{jk} / \sum_k p_{jk}H1(q∣j)=∑k​hqk1​pjk​/∑k​pjk​; likewise for player 2.
  3. Player 1 gives (2.4): player 1's condition on ppp is equivalent to (2.4).
  4. Player 2 gives (2.5): player 2's condition on ppp is equivalent to (2.5).

A further statement, not a milestone, records the paper's example on p. 5: in the game of chicken (Figure 4) the distribution of Figure 5 is a c.e.d. with expected payoff (5,5)(5,5)(5,5).

Significance

The result. Proposition 2.3 turns an existential statement — there is some probability space and some correlated strategy pair that is an equilibrium and has distribution ppp — into finitely many linear inequalities on ppp alone. Consequently the set of c.e.d.'s is a compact convex polyhedron, membership is decidable by evaluating ∣S1∣2+∣S2∣2|S^1|^2 + |S^2|^2∣S1∣2+∣S2∣2 linear forms, and optimizing a linear objective over it is a linear program. The paper states the two-person case and remarks that "the principle, however, is no different in the general case".

Formalizing it. The proposition is classical and its proof is short; to our knowledge it has no machine-checked proof. The platform already has the linear-inequality (swap) form of correlated equilibrium for two-player games on Fin m × Fin n (Foster–Vohra 1997 missions) and Aumann's 1974 randomizing-structure model, but no statement that connects the strategic definition over arbitrary finite probability spaces with the linear system. This mission supplies that connection, so that results proved about the polyhedron apply to equilibria in Aumann's sense and conversely.

Difficulty

The mathematics is elementary; the care is in the statement. Two points need attention. First, the direction from the inequalities to a c.e.d. requires constructing a probability space and a correlated strategy pair whose distribution is the given ppp; the c.e.d. notion quantifies over probability spaces, not over distributions. Second, the paper's argument divides by the probability ∑kpjk\sum_k p_{jk}∑k​pjk​ of a suggestion, which may be zero; the conditional formulation (milestone 2) holds only over possible suggestions, while (2.4) and (2.5) quantify over all actions and hold trivially at impossible ones. Deviations must be functions of the player's own suggestion: restricting to constant deviations gives coarse correlated equilibrium, which (2.4)–(2.5) do not characterize, and allowing arbitrary functions of γ\gammaγ gives a stronger notion.

Formalization scope

Two players with finite action types S₁ S₂ : Type* (Fintype, DecidableEq); payoffs h₁ h₂ : S₁ → S₂ → ℝ; distributions p : S₁ → S₂ → ℝ with the sign and sum conditions as an explicit hypothesis of every statement about distributions. Finite probability spaces are finite types Γ : Type with a probability vector μ : Γ → ℝ; deviations are compositions φ ∘ f₁ with φ : S₁ → S₁. The conditional payoffs H1H^1H1, H2H^2H2 use Lean's x / 0 = 0 and are only ever used at possible suggestions. Empty action sets admit no distribution, so the statements are then vacuous, exactly as in the paper.

A trivializing formalization is ruled out: "c.e.d." is the existential notion over finite probability spaces with a genuine probability vector and an equilibrium in the sense of Definition 2.1, not the inequalities themselves or the swap form on ppp.

No infrastructure beyond finite sums and Finset.filter is needed. Contributions welcome: proofs of the milestones, and the nnn-player generalization the paper alludes to.

Selected references

  • R. J. Aumann, Correlated Equilibrium as an Expression of Bayesian Rationality, Econometrica 55 (1987), 1–18. https://doi.org/10.2307/1911154
  • R. J. Aumann, Subjectivity and Correlation in Randomized Strategies, Journal of Mathematical Economics 1 (1974), 67–96. https://doi.org/10.1016/0304-4068(74)90037-8
  • D. P. Foster and R. V. Vohra, Calibrated Learning and Correlated Equilibrium, Games and Economic Behavior 21 (1997), 40–55. https://doi.org/10.1006/game.1997.0595
  • S. Hart and A. Mas-Colell, A Simple Adaptive Procedure Leading to Correlated Equilibrium, Econometrica 68 (2000), 1127–1150. https://doi.org/10.1111/1468-0262.00153
6 thms2 active usersReviewed
🏆Completed
Convex OptimizationMachine LearningOptimization·Captain: mikedeng1

Blackwell Approachability and No-Regret Learning are Equivalent 1: Any Approachability Algorithm Yields Online Linear Optimization with Regret/T at Most 2κ Times Its Approachability RateResearch Paper

Motivation

Online decision makers often have to choose an action before seeing the cost assigned to it. A no-regret algorithm performs almost as well, in total, as the best single action that could have been chosen after the costs were known. In a related repeated-game problem, Blackwell approachability asks a player to keep the average of vector payoffs close to a desired set despite an adversary's choices. These two performance criteria look different: one compares scalar costs to a fixed benchmark, while the other measures a geometric distance. Abernethy, Bartlett, and Hazan establish algorithmic reductions between them, with explicit finite-horizon bounds in their COLT 2011 paper. This mission isolates the direction that turns an approachability algorithm into an online linear optimization algorithm.

The bound matters even when the input algorithm has no known rate. It relates the regret of the resulting online algorithm to the actual distance attained on the corresponding sequence. Any subsequent guarantee on that distance then yields a regret guarantee through the same reduction. The paper also gives the reverse reduction and an application to calibrated forecasting; those are separate missions in this series.

Setting

Fix a dimension ddd and a nonempty compact convex decision set K⊆RdK\subseteq\mathbb R^dK⊆Rd. On round ttt, an algorithm selects xt∈Kx_t\in Kxt​∈K using only the preceding cost vectors f1,…,ft−1f_1,\ldots,f_{t-1}f1​,…,ft−1​. The adversary then reveals ftf_tft​ in the Euclidean unit ball B2(1)B_2(1)B2​(1). The incurred linear cost is ⟨ft,xt⟩\langle f_t,x_t\rangle⟨ft​,xt​⟩. For a horizon TTT, regret compares these costs with the cost of the best single point of KKK evaluated on all TTT rounds:

Regret⁡T=∑t=1T⟨ft,xt⟩−min⁡x∈K∑t=1T⟨ft,x⟩.\operatorname{Regret}_T = \sum_{t=1}^T\langle f_t,x_t\rangle - \min_{x\in K}\sum_{t=1}^T\langle f_t,x\rangle.RegretT​=t=1∑T​⟨ft​,xt​⟩−x∈Kmin​t=1∑T​⟨ft​,x⟩.

The minimum exists because KKK is nonempty and compact. No probabilistic model for the cost sequence is assumed. The round index begins at one, and xtx_txt​ cannot depend on ftf_tft​.

The reduction uses κ=max⁡x∈K∥x∥\kappa=\max_{x\in K}\|x\|κ=maxx∈K​∥x∥, the maximum norm of a decision. Write a⊕xa\oplus xa⊕x for Euclidean concatenation of a scalar and a vector, an element of Rd+1\mathbb R^{d+1}Rd+1. The generated cone of a set MMM consists of its nonnegative scalar multiples, cone⁡(M)={αm:α≥0, m∈M}\operatorname{cone}(M)=\{\alpha m:\alpha\ge0,\ m\in M\}cone(M)={αm:α≥0, m∈M}. For a set CCC, its polar cone is C0={θ:⟨θ,z⟩≤0 for every z∈C}C^0=\{\theta:\langle\theta,z\rangle\le0\text{ for every }z\in C\}C0={θ:⟨θ,z⟩≤0 for every z∈C}. This negative-sign convention is fixed throughout the mission.

Algorithm 1 of the paper constructs a vector-payoff game. Its player actions are KKK, its adversary actions are B2(1)B_2(1)B2​(1), its payoff and target are

u(x,f)=(⟨f,x⟩/κ)⊕(−f),S=cone⁡({κ}×K)0.u(x,f)=\bigl(\langle f,x\rangle/\kappa\bigr)\oplus(-f), \qquad S=\operatorname{cone}(\{\kappa\}\times K)^0.u(x,f)=(⟨f,x⟩/κ)⊕(−f),S=cone({κ}×K)0.

A Blackwell approachability algorithm for this game chooses each xtx_txt​ from the preceding adversary moves. Its finite-horizon approachability rate on a given sequence is DT(A)=dist⁡(T−1∑t=1Tu(xt,ft),S)D_T(A)=\operatorname{dist}(T^{-1}\sum_{t=1}^T u(x_t,f_t),S)DT​(A)=dist(T−1∑t=1T​u(xt​,ft​),S), where distance means the Euclidean distance from a point to a set. The online algorithm created by Algorithm 1 uses precisely the same choices xtx_txt​.

Formalization targets

The goal is Theorem 16 of the paper. For every admissible history-based algorithm, every sequence of unit-ball costs, and every T≥1T\ge1T≥1, it asserts

Regret⁡TT≤2κDT(A).\frac{\operatorname{Regret}_T}{T}\le 2\kappa D_T(A).TRegretT​​≤2κDT​(A).

This is a statement about the rate actually obtained on the chosen cost sequence. It assumes no upper bound on DT(A)D_T(A)DT​(A) and does not require an oracle call in the statement. Thus it also covers algorithms whose behavior is specified directly rather than through an implementation of the oracle.

The milestone targets are the distance formula of Lemma 13, the conic distance identity in display (8) of Theorem 16's proof, and the existence of a valid halfspace oracle in Lemma 15. Lemma 13 says distance to a nonempty convex cone equals the attained maximum of a linear functional over the polar cone's unit ball. Display (8) specializes this geometry to Algorithm 1's lifted target. Lemma 15 says that every halfspace containing that target admits a player action whose payoff remains in the halfspace against every permitted adversary move. Together these statements specify the geometry and the oracle needed by the reduction.

Significance

Theorem 16 gives a numerical transfer rule: a bound on approachability distance for Algorithm 1's game immediately bounds average regret for the same sequence. Its factor depends only on the size κ\kappaκ of the decision set. This permits comparison of algorithms in a common finite-horizon language, without replacing the online cost sequence by a distribution or an asymptotic limit. The source paper uses this direction as one half of its equivalence between approachability and no-regret learning Abernethy, Bartlett, and Hazan, 2011.

The mathematical results are established in that paper; the goal here is a machine-checked Lean development of their statements and eventually their proofs. The mission also supplies reusable definitions of generated and polar cones, a Euclidean lift, a finite-history online algorithm, and regret over a compact decision set. Lemma 13 is useful outside this reduction whenever distance to a cone is compared with linear functionals on its polar. The proposed theorem items currently carry open proofs, while their statements and definition files are checked for elaboration in the pinned Lean environment.

Difficulty

The main obstacle is the change of viewpoint from a scalar regret comparison to distance from a set of lifted vector payoffs. A direct comparison of individual round costs does not describe that distance. The target is a polar cone in one additional Euclidean dimension, so a faithful account must keep the lift's geometry, the cone's sign convention, and the normalization by κ\kappaκ aligned. The distance formula also asserts that its maximum is attained. An encoding that merely writes an infimum or supremum with default values can silently make an edge case look valid without representing the paper's claim.

The oracle milestone has a separate quantifier demand. One selected action must work against every adversary move for each halfspace containing the target. It cannot be replaced by a possibly different action for each move, or by a claim only about tangent halfspaces. The theorem includes halfspaces with arbitrary offsets and zero normals because the source oracle accepts any containing halfspace.

Formalization scope

Vectors live in EuclideanSpace ℝ (Fin d), and a⊕xa\oplus xa⊕x lives in EuclideanSpace ℝ (Fin (d+1)) with the Euclidean norm. The generated cone uses exactly one nonnegative multiple of a point of the generating set, as in Definition 11. The polar uses ⟨θ,z⟩≤0\langle\theta,z\rangle\le0⟨θ,z⟩≤0, the opposite sign from a positive dual-cone convention. Distances are Euclidean point-to-set distances. All arithmetic is over exact real numbers, and the regret minimum ranges over the image of the nonempty compact set KKK.

The statements require κ>0\kappa>0κ>0 because the source payoff divides by κ\kappaκ. This excludes the degenerate case K={0}K=\{0\}K={0}, in which the source instance is undefined. They require T≥1T\ge1T≥1 wherever an average is formed. Admissible histories consist of unit-ball adversary moves, and each round's decision belongs to KKK. The dimension may be zero syntactically, but the positive-κ\kappaκ hypothesis excludes that case in results using Algorithm 1. These conditions keep the bound from being satisfied through Lean's default values for division by zero, distance to an empty set, or infima over empty sets.

The paper's display (8) writes cone⁡(κ⊕K)\operatorname{cone}(\kappa\oplus K)cone(κ⊕K) and labels its unit ball with dimension ddd; the formalization uses the cone of {κ}×K\{\kappa\}\times K{κ}×K in Rd+1\mathbb R^{d+1}Rd+1, matching Algorithm 1. Lemma 12's printed bipolar claim omits closedness; this mission does not use that uncorrected sentence as a milestone. The oracle statement covers all containing halfspaces. Contributions are welcome for the distance identity, the oracle existence result, and the final regret inequality, as well as geometric lemmas supporting those proofs.

Selected references

  • Jacob Abernethy, Peter L. Bartlett, and Elad Hazan, Blackwell Approachability and No-Regret Learning are Equivalent, Proceedings of the 24th Annual Conference on Learning Theory, JMLR Workshop and Conference Proceedings 19, 2011, pp. 27–46. Published paper.
6 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

Understanding and Using Linear Programming VI: The Minimax Theorem for Zero-Sum GamesTextbook

Why zero-sum games belong in a linear programming course

A two-player zero-sum game models any situation in which one party's gain is exactly the other party's loss: a military allocation in the spirit of Colonel Blotto, a sealed-bid contest, rock–paper–scissors. The central question is what each player should do when the opponent is also reasoning about them. John von Neumann answered it in 1928 with the minimax theorem (von Neumann 1928): each player has a strategy guaranteeing the same number, the value of the game, whatever the opponent does. The theorem underlies modern game theory, robust decision making, and the analysis of online learning algorithms, where regret bounds are routinely derived from it.

Section 8.1 of Matoušek and Gärtner's Understanding and Using Linear Programming (Springer 2007) presents the theorem as an application of linear programming duality. This mission is the sixth of a series formalizing the capstone results of the book.

Setting

Alice has m≥1m \ge 1m≥1 pure strategies and Bob has n≥1n \ge 1n≥1. A real m×nm \times nm×n payoff matrix M=(mij)M = (m_{ij})M=(mij​) records Alice's gain, and Bob's loss, when Alice plays her iiith and Bob his jjjth pure strategy. A mixed strategy of Alice is a probability vector x∈Rm\mathbf x \in \mathbb R^mx∈Rm, ∑ixi=1\sum_i x_i = 1∑i​xi​=1, x≥0\mathbf x \ge \mathbf 0x≥0; a mixed strategy of Bob is a probability vector y∈Rn\mathbf y \in \mathbb R^ny∈Rn. When the players randomize independently, Alice's expected payoff is

xTMy=∑i,jmijxiyj.\mathbf x^T M \mathbf y = \sum_{i,j} m_{ij} x_i y_j .xTMy=i,j∑​mij​xi​yj​.

The worst-case payoffs are

β(x)=min⁡yxTMy,α(y)=max⁡xxTMy,\beta(\mathbf x) = \min_{\mathbf y} \mathbf x^T M \mathbf y, \qquad \alpha(\mathbf y) = \max_{\mathbf x} \mathbf x^T M \mathbf y,β(x)=ymin​xTMy,α(y)=xmax​xTMy,

over mixed strategies. A mixed strategy of Bob is a best response against x\mathbf xx if it minimizes xTMy\mathbf x^T M\mathbf yxTMy; a mixed strategy of Alice is a best response against y\mathbf yy if it maximizes it. A pair (x~,y~)(\tilde{\mathbf x}, \tilde{\mathbf y})(x~,y~​) is a mixed Nash equilibrium (Definition 8.1.1) if each is a best response against the other. Alice's x~\tilde{\mathbf x}x~ is worst-case optimal if β(x~)=max⁡xβ(x)\beta(\tilde{\mathbf x}) = \max_{\mathbf x} \beta(\mathbf x)β(x~)=maxx​β(x); Bob's y~\tilde{\mathbf y}y~​ is worst-case optimal if α(y~)=min⁡yα(y)\alpha(\tilde{\mathbf y}) = \min_{\mathbf y}\alpha(\mathbf y)α(y~​)=miny​α(y).

The proof in the book passes through three linear programs: the dual of (8.1), which for a fixed x\mathbf xx maximizes x0x_0x0​ subject to MTx−1x0≥0M^T \mathbf x - \mathbf 1 x_0 \ge \mathbf 0MTx−1x0​≥0; program (8.2), the same with x\mathbf xx as variables subject to ∑ixi=1\sum_i x_i = 1∑i​xi​=1, x≥0\mathbf x \ge \mathbf 0x≥0; and program (8.4), which minimizes y0y_0y0​ subject to My−1y0≤0M \mathbf y - \mathbf 1 y_0 \le \mathbf 0My−1y0​≤0, ∑jyj=1\sum_j y_j = 1∑j​yj​=1, y≥0\mathbf y \ge \mathbf 0y≥0.

Formalization targets

Goal: Theorem 8.1.3 (minimax theorem for zero-sum games)

For every m×nm \times nm×n payoff matrix with m,n≥1m, n \ge 1m,n≥1: worst-case optimal mixed strategies exist for both players; for any worst-case optimal x~\tilde{\mathbf x}x~ of Alice and y~\tilde{\mathbf y}y~​ of Bob, the pair (x~,y~)(\tilde{\mathbf x}, \tilde{\mathbf y})(x~,y~​) is a mixed Nash equilibrium; and there is a single number vvv, the value of the game, with

β(x~)=x~TMy~=α(y~)=v\beta(\tilde{\mathbf x}) = \tilde{\mathbf x}^T M \tilde{\mathbf y} = \alpha(\tilde{\mathbf y}) = vβ(x~)=x~TMy~​=α(y~​)=v

for every such pair. The third clause is what distinguishes the theorem from the existence of some saddle point.

Milestones

  1. β\betaβ and α\alphaα are attained minima and maxima (p. 135).
  2. Lemma 8.1.2(i): β(x)≤xTMy≤α(y)\beta(\mathbf x) \le \mathbf x^T M \mathbf y \le \alpha(\mathbf y)β(x)≤xTMy≤α(y) for all mixed x,y\mathbf x, \mathbf yx,y, hence max⁡xβ≤min⁡yα\max_{\mathbf x}\beta \le \min_{\mathbf y}\alphamaxx​β≤miny​α.
  3. Lemma 8.1.2(ii): both strategies of a mixed Nash equilibrium are worst-case optimal.
  4. Lemma 8.1.2(iii): β(x~)=α(y~)\beta(\tilde{\mathbf x}) = \alpha(\tilde{\mathbf y})β(x~)=α(y~​) implies that (x~,y~)(\tilde{\mathbf x}, \tilde{\mathbf y})(x~,y~​) is a mixed Nash equilibrium.
  5. The dual of (8.1) has optimal value β(x)\beta(\mathbf x)β(x) (p. 137).
  6. Eq. (8.3): an optimal solution (x~0,x~)(\tilde x_0, \tilde{\mathbf x})(x~0​,x~) of (8.2) satisfies x~0=β(x~)=max⁡xβ(x)\tilde x_0 = \beta(\tilde{\mathbf x}) = \max_{\mathbf x}\beta(\mathbf x)x~0​=β(x~)=maxx​β(x).
  7. Eq. (8.5): an optimal solution (y~0,y~)(\tilde y_0, \tilde{\mathbf y})(y~​0​,y~​) of (8.4) satisfies y~0=α(y~)=min⁡yα(y)\tilde y_0 = \alpha(\tilde{\mathbf y}) = \min_{\mathbf y}\alpha(\mathbf y)y~​0​=α(y~​)=miny​α(y).
  8. Programs (8.2) and (8.4) both have optimal solutions, and their optimum values coincide (p. 138).
  9. The minimax equality (p. 137):
max⁡xmin⁡yxTMy=min⁡ymax⁡xxTMy.\max_{\mathbf x}\min_{\mathbf y}\mathbf x^T M \mathbf y = \min_{\mathbf y}\max_{\mathbf x}\mathbf x^T M \mathbf y .xmax​ymin​xTMy=ymin​xmax​xTMy.

Significance

The theorem gives a complete prescription for zero-sum play: a worst-case optimal strategy secures at least the value against any opponent, and a worst-case optimal opponent holds the player to at most the value, so both players can announce their strategies in advance without loss. With Lemma 8.1.2(ii) it yields a characterization: a pair of mixed strategies is a Nash equilibrium if and only if both are worst-case optimal. The minimax equality is used downstream in online learning (regret-to-value arguments), in robust optimization, and in Yao's principle for randomized algorithms.

The mathematics is classical and proved; what this mission adds is a machine-checked version in the book's own formulation. The platform already has AGT.zero_sum_minimax (Algorithmic Game Theory I), which proves the existence of a saddle point, and the general FamousTheorems.sion_minimax_theorem. Neither states that every pair of worst-case optimal strategies is an equilibrium with a common value, and neither exhibits the LP route: the dual of (8.1), the programs (8.2) and (8.4), and their duality. The mission records that route statement by statement, so that it can be reused as a worked instance of LP duality.

Difficulty

Lemma 8.1.2 is routine; the entire content is the reverse inequality max⁡xβ(x)≥min⁡yα(y)\max_{\mathbf x}\beta(\mathbf x) \ge \min_{\mathbf y}\alpha(\mathbf y)maxx​β(x)≥miny​α(y). The obvious attack, maximizing β\betaβ directly, fails because β\betaβ is a minimum of linear functions and hence not linear, so its maximization is not a linear program as written. The obstacle is removed only by an appeal to LP duality in the proof, together with the facts that the simplices are nonempty and compact, and that the relevant programs are feasible and bounded so that optima exist. None of this is supplied by the pure-strategy structure of the game: pure Nash equilibria need not exist (rock–paper–scissors has none).

Formalization scope

Pure strategies are indexed by Fin m and Fin n, with the book's standing assumption m,n≥1m, n \ge 1m,n≥1 carried as hypotheses 1 ≤ m, 1 ≤ n by every theorem; the book's indices 1,…,m1,\dots,m1,…,m become 0,…,m−10,\dots,m-10,…,m−1. Mixed strategies are Mathlib's stdSimplex ℝ (Fin m), the payoff is x ⬝ᵥ (M *ᵥ y). β(x)\beta(\mathbf x)β(x) is the real sInf and α(y)\alpha(\mathbf y)α(y) the real sSup of the payoffs over the opponent's simplex; milestone 1 states that these are attained. A mixed Nash equilibrium is defined in the verbal form of Definition 8.1.1 (mutual best responses). Worst-case optimality is defined against all mixed strategies, never as a saddle-point condition, so the goal is not circular with Lemma 8.1.2(iii). LP optimality is stated as "feasible and at least as good as every feasible point", so no supremum over a possibly empty or unbounded feasible set is used.

The book's clause that worst-case optimal strategies "can be efficiently computed by linear programming" is algorithmic and is not part of the formal statement; there is no complexity model. A goal asserting only the existence of worst-case optimal strategies, or only the existence of some equilibrium, would drop the theorem's third clause and is ruled out: the common value vvv is quantified before all pairs of worst-case optimal strategies.

A complete development needs compactness of the standard simplex, continuity of the bilinear payoff, and a strong duality theorem for linear programs in the form of the programs (8.2)/(8.4); the latter is reusable across the whole series. Proofs by other routes (Sion's theorem, a separating hyperplane argument, fixed points) are welcome for the goal; the LP milestones stand on their own as statements about the programs.

Selected references

  • J. Matoušek, B. Gärtner, Understanding and Using Linear Programming, Springer Universitext, 2007, §8.1, pp. 131–142. https://doi.org/10.1007/978-3-540-30717-4
  • J. von Neumann, "Zur Theorie der Gesellschaftsspiele", Mathematische Annalen 100 (1928), 295–320. https://doi.org/10.1007/BF01448847
  • M. Sion, "On general minimax theorems", Pacific Journal of Mathematics 8 (1958), 171–176. https://doi.org/10.2140/pjm.1958.8.171
12 thms2 active usersReviewed
🏆Completed
Mechanism DesignOperations ResearchProbability·Captain: mikedeng1

An Introduction to the Theory of Mechanism Design X: Robust Mechanism Design — Belief Revelation on Finite Type SpacesTextbook

Motivation

Classical Bayesian mechanism design assumes that the designer knows the agents' beliefs about each other: typically a commonly known prior over independent private values. Wilson's critique (1987) observed that mechanisms tuned to such a prior can depend on details that no designer knows, and a literature on robust mechanism design replaced the fixed prior by a large family of possible beliefs. Chapter 10 of Börgers, An Introduction to the Theory of Mechanism Design (OUP 2015), develops this programme in the framework of Bergemann and Morris (2001, 2005): agents' information is described by a type space, the designer is uncertain which beliefs agents hold, and mechanisms are compared across all type profiles at once.

Timeline of the results formalized here:

  • 1980: Hylland shows that strategy-proof random mechanisms satisfying unanimity conditions are random dictatorships; Dutta, Peters and Sen (2007, 2008) give and correct the cardinal version used in the chapter.
  • 1985: Mertens and Zamir construct the universal type space of belief hierarchies; the space of finite types is emphasized by Dekel, Fudenberg and Morris (2006).
  • 1988: Crémer and McLean show that with correlated types satisfying a spanning condition, beliefs can be elicited at no cost (Proposition 6.4 of the book).
  • 2001–2005: Bergemann and Morris introduce payoff and belief types and prove that on finite type spaces only incentive constraints between types with the same beliefs matter (their Proposition 4.5, the goal of this mission).
  • 2010–2014: Smith, Börgers and Smith study the ranking of mechanisms without a common prior; random dictatorship with compromise comes from Börgers and Smith (2012, 2014).

Setting

There are finitely many agents i∈Ii \in Ii∈I, and agent iii has a set Θi\Theta_iΘi​ of payoff types. An outcome xxx gives agent iii the utility ui(x,θ)u_i(x,\theta)ui​(x,θ), which may depend on all payoff types. A type space T=(Ti,θ^i,β^i)i∈I\mathcal T = (T_i,\hat\theta_i,\hat\beta_i)_{i\in I}T=(Ti​,θ^i​,β^​i​)i∈I​ consists of nonempty sets TiT_iTi​ of types, a payoff type map θ^i:Ti→Θi\hat\theta_i : T_i \to \Theta_iθ^i​:Ti​→Θi​ and a belief map β^i:Ti→Δ(T−i)\hat\beta_i : T_i \to \Delta(T_{-i})β^​i​:Ti​→Δ(T−i​), where T−i=∏j≠iTjT_{-i} = \prod_{j\ne i}T_jT−i​=∏j=i​Tj​. Different types may share a payoff type and differ only in their beliefs, and vice versa. A common prior is a distribution μ\muμ on TTT from which every type's belief is obtained by conditioning. A type space has a large variety of certainties if for every θi\theta_iθi​ and θ−i\theta_{-i}θ−i​ some type with payoff type θi\theta_iθi​ is certain that the others' payoff types are θ−i\theta_{-i}θ−i​. The space of finite types T+\mathcal T^+T+ collects every infinite hierarchy of beliefs ("I believe that you believe that …") that is generated by a type of some finite type space.

A mechanism (S1,…,SN,g)(S_1,\dots,S_N,g)(S1​,…,SN​,g) has strategy sets SiS_iSi​ and an outcome rule g:S→Δ(X)g : S \to \Delta(X)g:S→Δ(X). Strategies σi:Ti→Δ(Si)\sigma_i : T_i \to \Delta(S_i)σi​:Ti​→Δ(Si​) form a Bayesian equilibrium if each type maximizes expected utility under its own belief; it is belief-independent if types with equal payoff types play alike, and ex post if each type's choice stays optimal when it becomes certain of the others' types. A direct mechanism asks agents for their types, a reduced direct mechanism only for their payoff types. In the quasi-linear case outcomes are (a,t1,…,tN)(a,t_1,\dots,t_N)(a,t1​,…,tN​) and ui=vi(a,θ)−tiu_i = v_i(a,\theta) - t_iui​=vi​(a,θ)−ti​, with tit_iti​ paid by agent iii; a direct mechanism is (q,t)(q,t)(q,t).

Formalization targets

Goal: belief revelation on finite type spaces (Proposition 10.6)

On a finite type space with quasi-linear utilities, suppose that for every agent no belief in {β^i(τi):τi∈Ti}\{\hat\beta_i(\tau_i) : \tau_i\in T_i\}{β^​i​(τi​):τi​∈Ti​} is a convex combination of the others, and that in the direct mechanism (q,t)(q,t)(q,t) no type wants to imitate another type with the same belief. Then there is a direct mechanism (q~,t~)(\tilde q,\tilde t)(q~​,t~) in which truth telling is a Bayesian equilibrium, with

q~(τ)=q(τ)  ∀τ∈T,∑τ−iβ^i(τi)(τ−i) t~i(τ)=∑τ−iβ^i(τi)(τ−i) ti(τ)  ∀i,τi.\tilde q(\tau) = q(\tau)\ \ \forall \tau\in T,\qquad \sum_{\tau_{-i}}\hat\beta_i(\tau_i)(\tau_{-i})\,\tilde t_i(\tau) = \sum_{\tau_{-i}}\hat\beta_i(\tau_i)(\tau_{-i})\, t_i(\tau)\ \ \forall i,\tau_i.q~​(τ)=q(τ)  ∀τ∈T,τ−i​∑​β^​i​(τi​)(τ−i​)t~i​(τ)=τ−i​∑​β^​i​(τi​)(τ−i​)ti​(τ)  ∀i,τi​.

The goal fixes neither the transfers t~\tilde tt~ nor any bound on them; it asserts the existence of a truthful mechanism with the same alternatives and the same interim payments.

Milestones

The other fourteen numbered results of the chapter: conditional independence of payoff types under a full-support common prior (10.1); three revelation principles (10.2–10.4); existence of Bayesian equilibria of finite mechanisms on T+\mathcal T^+T+ (10.5); betting between agents with inconsistent beliefs (10.7); ex post implementation of unique equilibrium outcomes and alternatives (10.8, 10.9); emptiness of the set of undominated auctions under interim Pareto welfare and under ex post revenue (10.10, 10.11); Hylland's characterization of random dictatorship (10.12); and three comparisons of random dictatorship with random dictatorship with compromise (10.13–10.15).

Significance

Proposition 10.6 reduces the design problem on a finite type space to incentive constraints among types with the same beliefs: belief types can always be elicited by side payments that leave interim utilities unchanged. With a common prior and Proposition 10.1 this yields optimal mechanisms by solving an independent-types problem for each profile of belief types (§10.8; Farinha Luz 2013 carries this out for auctions). Proposition 10.7 and its consequences 10.10–10.11 show why the same construction cannot be used without a common prior: inconsistent beliefs allow unbounded bets, so interim or revenue criteria admit no undominated mechanism. Propositions 10.12–10.15 show that relaxing belief independence escapes Hylland's impossibility result in the voting problem.

None of these results is formalized elsewhere to our knowledge. The book proves only some of them (10.1, 10.5, 10.8, 10.9, 10.13–10.15 are proved or outlined; 10.6 is sketched; the proofs of 10.2–10.4 are omitted as standard; 10.7 and 10.10–10.12 are stated without proof), so formalization also produces complete proofs of results the book leaves informal. Two printed statements are corrected (see Formalization scope).

Difficulty

The obvious approach to Proposition 10.6 applies the Crémer–McLean construction type by type. This fails because several types may share a belief: a side payment that depends on the reported belief cannot separate them, and the convex-independence condition concerns the set of distinct beliefs rather than the indexed family of types.

For the results on T+\mathcal T^+T+, a type is an infinite belief hierarchy, and a strategy must be one function on all finite types simultaneously. Existence (10.5) cannot be obtained by applying Nash's theorem to a single finite type space, because a type belongs to many finite type spaces and must play the same strategy in all of them. Hylland's theorem (10.12) requires a full characterization of strategy-proof random rules on a cardinal preference domain.

Formalization scope

  • Distributions Δ(X)\Delta(X)Δ(X) are countably supported (PMF X); expected utilities are sums. The book leaves the measure structure of type spaces unspecified (p.179, note 3); finite type spaces, T+\mathcal T^+T+ and point beliefs are covered exactly. A Bayesian equilibrium requires every type's expected utility to exist (absolute summability) under every mixed strategy.
  • A type's belief is a distribution on ∏j≠iTj\prod_{j\ne i}T_j∏j=i​Tj​. Beliefs in Proposition 10.6 are vectors in RT−i\mathbb R^{T_{-i}}RT−i​, and condition (i) is stated with the convex hull of the other distinct beliefs.
  • Quasi-linear direct mechanisms are deterministic, q:T→Aq : T\to Aq:T→A, ti:T→Rt_i : T\to\mathbb Rti​:T→R. Mixed misreports are allowed in every equilibrium notion.
  • T+\mathcal T^+T+ is built from belief hierarchies encoded level by level (L0=ΘiL_0 = \Theta_iL0​=Θi​, Ln+1=Θi×Δ(∏j≠iLn,j)L_{n+1} = \Theta_i\times\Delta(\prod_{j\ne i}L_{n,j})Ln+1​=Θi​×Δ(∏j=i​Ln,j​)) and the finite type spaces generating them. The universal type space (Definition 10.5) is not needed and not formalized.
  • §10.11: two agents Fin 2, candidates {a,b,c}\{a,b,c\}{a,b,c}, strict private vNM utilities with every strict utility attained; mechanisms map to lotteries over candidates; rankings are bijections C ≃ Fin 3.
  • Corrections of the page: in Proposition 10.7 the signs of the transfers in (v) are reversed on the page relative to the bet described on p.186 and are stated as described; Proposition 10.9 is false under a large variety of certainties alone and is stated under the common-certainty condition that its proof uses, on type spaces whose beliefs have finite support (with countably supported beliefs the reduced mechanism's expected utilities need not exist). Both are explained in the item notes.
  • The goal is not trivialized by taking (q~,t~)=(q,t)(\tilde q,\tilde t) = (q,t)(q~​,t~)=(q,t): condition (ii) constrains only types with the same belief, so the original mechanism is in general not incentive-compatible, and the conclusion demands full Bayesian incentive compatibility.

Welcome contributions: a finite Farkas/separation lemma in the form needed for 10.6 (the platform has Polyhedral.farkas_lemma), basic API for PMF-valued type spaces (products of mixed strategies, conditioning), and the hierarchy map of finite type spaces, which all T+\mathcal T^+T+ milestones share.

Selected references

  • T. Börgers, An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015, Ch. 10. https://doi.org/10.1093/acprof:oso/9780199734023.001.0001
  • D. Bergemann, S. Morris, Robust Mechanism Design, Cowles Foundation Discussion Paper 1421, 2001; Econometrica 73 (2005) 1771–1813. https://doi.org/10.1111/j.1468-0262.2005.00638.x
  • J. Crémer, R. McLean, Full Extraction of the Surplus in Bayesian and Dominant Strategy Auctions, Econometrica 56 (1988) 1247–1257. https://doi.org/10.2307/1913096
  • J.-F. Mertens, S. Zamir, Formulation of Bayesian Analysis for Games with Incomplete Information, International Journal of Game Theory 14 (1985) 1–29. https://doi.org/10.1007/BF01770224
  • B. Dutta, H. Peters, A. Sen, Strategy-Proof Cardinal Decision Schemes, Social Choice and Welfare 28 (2007) 163–179. https://doi.org/10.1007/s00355-006-0152-4
  • T. Börgers, D. Smith, Robust Mechanism Design and Dominant Strategy Voting Rules, Theoretical Economics 9 (2014) 339–360. https://doi.org/10.3982/TE1100
19 thms2 active usersReviewed
🏆Completed
CombinatoricsMechanism DesignOperations Research·Captain: mikedeng1

An Introduction to the Theory of Mechanism Design IX: Monotone Direct Mechanisms Are Dictatorial (Gibbard–Satterthwaite)Textbook

Motivation

Voting rules, committee procedures and any other method that turns individual rankings into one collective choice face the same question: can the rule be designed so that no participant ever gains by misreporting their ranking? The Gibbard–Satterthwaite theorem (Gibbard, 1973; Satterthwaite, 1975) answers no. When at least three alternatives can be chosen and all strict rankings are admissible, the only rules immune to manipulation are dictatorships. The result is the starting point of mechanism design without money. It explains why the positive results of the transferable-utility chapters of the book (Groves, VCG, posted prices) depend on quasi-linear preferences, and why research on voting turned to restricted preference domains and weaker solution concepts.

This mission formalizes Chapter 8 of Börgers, An Introduction to the Theory of Mechanism Design (Oxford University Press, 2015), §§8.2–8.3. The book's route to the theorem follows Reny (2001). Strategy-proofness implies Maskin monotonicity, and every monotone rule with full range over at least three alternatives is dictatorial. The second step is the Muller–Satterthwaite theorem (Muller and Satterthwaite, 1977), which is stronger than Gibbard–Satterthwaite because monotonicity is weaker than strategy-proofness. The chapter closes with the classical escape route: on single-peaked preferences (Moulin, 1980) the median voting rule is strategy-proof and not dictatorial.

Timeline. Arrow (1951/1963) proved the impossibility of non-dictatorial preference aggregation under independence of irrelevant alternatives. Gibbard (1973) and Satterthwaite (1975) proved the manipulation version independently, and Satterthwaite showed the two theorems are equivalent. Muller and Satterthwaite (1977) showed that on the full domain strategy-proofness is equivalent to a monotonicity condition (strong positive association). Moulin (1980) characterized strategy-proof rules on single-peaked domains that depend only on reported peaks. Reny (2001) gave the short common proof of Arrow's and the Muller–Satterthwaite theorems that the book follows.

Setting

There is a finite set I={1,…,N}I=\{1,\dots,N\}I={1,…,N} of agents and a finite set AAA of alternatives. Each agent iii has a preference relation RiR_iRi​ over AAA; a Ri ba\,R_i\,baRi​b reads "aaa is weakly preferred to bbb". Every RiR_iRi​ is a linear order: complete, transitive, and the only indifference is among identical alternatives. Its strict part is PiP_iPi​. The set of all linear orders over AAA is R\mathcal RR, and a profile is R=(R1,…,RN)∈RNR=(R_1,\dots,R_N)\in\mathcal R^NR=(R1​,…,RN​)∈RN. (Ri′,R−i)(R_i',R_{-i})(Ri′​,R−i​) is the profile obtained from RRR by replacing agent iii's preference with Ri′R_i'Ri′​.

A direct mechanism is a function f:RN→Af:\mathcal R^N\to Af:RN→A (Definition 8.1). It is

  • dominant strategy incentive-compatible (DSIC) if f(Ri,R−i) Ri f(Ri′,R−i)f(R_i,R_{-i})\,R_i\,f(R_i',R_{-i})f(Ri​,R−i​)Ri​f(Ri′​,R−i​) for all iii, RRR, Ri′R_i'Ri′​ (Definition 8.2);
  • dictatorial if some agent iii satisfies f(R) Ri af(R)\,R_i\,af(R)Ri​a for all profiles RRR and all a∈Aa\in Aa∈A (Definition 8.3);
  • monotone if f(R)=af(R)=af(R)=a and, for every iii, a Ri b⇒a Ri′ ba\,R_i\,b\Rightarrow a\,R_i'\,baRi​b⇒aRi′​b for all bbb, together imply f(R′)=af(R')=af(R′)=a (Definition 8.4);
  • set-monotone if f(R)∈Bf(R)\in Bf(R)∈B and, for every iii, Ri′R_i'Ri′​ differs from RiR_iRi​ only in the ranking of elements of BBB, together imply f(R′)∈Bf(R')\in Bf(R′)∈B (Definition 8.5);
  • unanimity-respecting if f(R)=af(R)=af(R)=a whenever every agent ranks aaa at the top (Definition 8.6).

"The range of fff is AAA" means that every alternative is chosen at some profile.

For §8.3 the alternatives are labelled 1,…,K1,\dots,K1,…,K. A preference is single-peaked if it has a top alternative k(i)k(i)k(i) and declines monotonically to the right and to the left of it. R^\hat{\mathcal R}R^ is the set of single-peaked preferences, and on the restricted domain R^N\hat{\mathcal R}^NR^N DSIC and dictatorship are read with all profiles and deviations taken from R^\hat{\mathcal R}R^.

Formalization targets

Goal: Proposition 8.5 (Muller–Satterthwaite)

∣A∣≥3,f(RN)=A,f monotone ⟹ ∃ i∈I  ∀R∈RN ∀a∈A: f(R) Ri a.|A|\ge 3,\quad f(\mathcal R^N)=A,\quad f\ \text{monotone}\ \Longrightarrow\ \exists\, i\in I\ \ \forall R\in\mathcal R^N\ \forall a\in A:\ f(R)\,R_i\,a.∣A∣≥3,f(RN)=A,f monotone ⟹ ∃i∈I  ∀R∈RN ∀a∈A: f(R)Ri​a.

This is the book's own capstone ("the core of the proof", p.144). No constant needs to be fixed, and the statement is strictly stronger than the necessity half of Gibbard–Satterthwaite.

Milestones

  • Proposition 8.2: DSIC ⇒\Rightarrow⇒ monotone.
  • Proposition 8.3: monotone ⇒\Rightarrow⇒ set-monotone.
  • Proposition 8.4: monotone and full range ⇒\Rightarrow⇒ respects unanimity.
  • Proposition 8.1 (Gibbard–Satterthwaite): for ∣A∣≥3|A|\ge3∣A∣≥3 and full range, fff is DSIC   ⟺  \iff⟺ fff is dictatorial.
  • Proposition 8.6: for ∣A∣≥3|A|\ge3∣A∣≥3 and at least two agents, there is a mechanism on R^N\hat{\mathcal R}^NR^N with range AAA that is DSIC on R^N\hat{\mathcal R}^NR^N and not dictatorial on R^N\hat{\mathcal R}^NR^N.

Significance

The result itself. Proposition 8.5 turns an incentive question into a purely ordinal one: any full-range rule that is Maskin monotone is a dictatorship once three alternatives are available. With Proposition 8.2 it gives Gibbard–Satterthwaite. Proposition 8.6 marks the boundary of the impossibility: with a one-dimensional ordering of alternatives and single-peaked preferences, the median voter rule escapes it.

Formalizing it. All results are classical and proved. The platform already has a proved Gibbard–Satterthwaite theorem (AGT.gibbard_satterthwaite, Algorithmic Game Theory III), derived from Arrow's theorem in the alternative Mathlib environment c5ea0035…. It uses strict-order profiles and a one-agent-deviation monotonicity. This mission adds Maskin monotonicity, the Muller–Satterthwaite theorem, Reny's direct proof route, and the single-peaked possibility result, none of which is on the platform, all in the default environment.

Difficulty

Propositions 8.2–8.4 are short. The difficulty is in Proposition 8.5. Its proof moves one alternative up or down agents' rankings one agent at a time, and it has to keep the chosen alternative pinned at every step using only monotonicity, set-monotonicity and unanimity. It needs a pivotal agent, whose identity depends on the pair of alternatives, and then an argument that the pivots for different alternatives coincide. The argument uses a third alternative ccc in an essential way. With two alternatives the conclusion is false (majority rule), so any argument that never uses ∣A∣≥3|A|\ge3∣A∣≥3 cannot succeed. Formally, each "move bbb just below aaa in agent jjj's ranking" is an explicit construction of a new linear order, together with a check that the monotonicity hypothesis applies. The figures on pp.146–149 describe these orders only partially ("the other alternatives in arbitrary order"). For Proposition 8.6, the obstacle is that DSIC must be checked against every single-peaked misreport, not only misreports of the peak.

Formalization scope

  • A linear order is the structure LinPref A (relation rel, completeness, transitivity, antisymmetry). A profile is ι → LinPref A for a finite agent type ι, and a direct mechanism is (ι → LinPref A) → A. AAA is a Fintype. "The range of fff is AAA" is Function.Surjective f, and ∣A∣≥3|A|\ge3∣A∣≥3 is 3 ≤ Fintype.card A.
  • Monotonicity is the book's Definition 8.4 for arbitrary pairs of profiles, with the lower-contour condition required for each agent separately. Dictatorship is ∃ i, ∀ R a, f R ≥_{R_i} a, with the agent chosen before the profile. A weaker monotonicity (one-agent deviations only) or a weaker dictatorship ("some agent's top is chosen at some profile") would trivialize the goal and is ruled out.
  • §8.3: the labelling is lab : A ≃ Fin K (labels 0,…,K−10,\dots,K-10,…,K−1). The restricted domain is a predicate on LinPref A, and DSIC, dictatorship and full range are relativized to profiles in the domain (IsDSICOn, IsDictatorialOn, HasFullRangeOn). Values of the mechanism off the domain are never consulted.
  • Two corrections of the page. The left-hand clause of single-peakedness is printed as (ℓ−1) Ri ℓ(\ell-1)\,R_i\,\ell(ℓ−1)Ri​ℓ and is used as ℓ Ri (ℓ−1)\ell\,R_i\,(\ell-1)ℓRi​(ℓ−1) (the book's words "decline monotonically to the left"). Proposition 8.6 carries the added hypothesis N≥2N\ge2N≥2, since with one agent every onto strategy-proof rule is dictatorial.
  • Proposition 8.6 is an existence statement. The median voting mechanism is the book's witness, but the statement does not fix it.
  • Reusable beyond this mission: the linear-order profile model, Maskin monotonicity and the restricted-domain notions, which apply to Arrow-type results, implementation theory and Moulin's characterization. Proofs of any milestone, or an independent formal proof of Proposition 8.5, are welcome.

Selected references

  • T. Börgers, An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015, Ch. 8. https://doi.org/10.1093/acprof:oso/9780199734023.001.0001
  • A. Gibbard, "Manipulation of voting schemes: a general result", Econometrica 41 (1973) 587–601. https://doi.org/10.2307/1914083
  • M. A. Satterthwaite, "Strategy-proofness and Arrow's conditions", Journal of Economic Theory 10 (1975) 187–217. https://doi.org/10.1016/0022-0531(75)90050-2
  • E. Muller and M. A. Satterthwaite, "The equivalence of strong positive association and strategy-proofness", Journal of Economic Theory 14 (1977) 412–418. https://doi.org/10.1016/0022-0531(77)90140-5
  • P. J. Reny, "Arrow's theorem and the Gibbard–Satterthwaite theorem: a unified approach", Economics Letters 70 (2001) 99–105. https://doi.org/10.1016/S0165-1765(00)00332-3
  • H. Moulin, "On strategy-proofness and single peakedness", Public Choice 35 (1980) 437–455. https://doi.org/10.1007/BF00128122
  • S. Barberà, "An introduction to strategy-proof social choice functions", Social Choice and Welfare 18 (2001) 619–653. https://doi.org/10.1007/s003550100151
8 thms2 active usersReviewed
🏆Completed
Mechanism DesignOperations Research·Captain: mikedeng1

An Introduction to the Theory of Mechanism Design VIII: Dominant-Strategy Implementation of Efficient Decision Rules Is VCGTextbook

Motivation

A group of agents must choose one alternative from a set AAA (whether to build a public project, who receives an object, which of several policies to adopt). Each agent privately knows how much each alternative is worth to them, and money can be transferred. A designer who wants the welfare-maximizing alternative must ask the agents for their valuations, and must set payments so that no agent gains by misreporting, whatever the others report. This requirement, dominant strategy incentive compatibility, does not depend on what agents believe about one another, which is why it is the standard robustness benchmark in public economics, auction design and algorithmic game theory.

The Vickrey–Clarke–Groves (VCG) mechanisms solve this problem for every efficient decision rule. The central question of Chapter 7 of Börgers, An Introduction to the Theory of Mechanism Design (Oxford University Press, 2015), is whether they are the only solution, and what can be implemented in dominant strategies at all.

Timeline:

  • 1961–1973: Vickrey (1961), Clarke (1971) and Groves (1973) introduce the payments that make efficient decisions dominant-strategy incentive-compatible.
  • 1977: Green and Laffont (Econometrica 45) show that, when valuations range over a sufficiently rich connected domain, every efficient dominant-strategy mechanism has the Groves form.
  • 1979: Holmström (Econometrica 47) extends the uniqueness result to smoothly connected domains. Roberts (1979) characterizes decision rules with positive association of differences on unrestricted domains as weighted welfare maximizers.
  • 1987: Rochet (J. Math. Econ. 16) characterizes implementable decision rules by cyclical monotonicity, with no structure on alternatives or types.
  • 2001: Krishna and Maenner (Econometrica 69) prove payoff equivalence for convex type sets and utilities convex in the type.
  • 2009: Lavi, Mu'alem and Nisan (Soc. Choice Welf. 32) give two short proofs of Roberts' theorem.

Setting

There is a finite set III of agents and a set AAA of alternatives. Agent iii has a type θi\theta_iθi​ from an abstract set Θi\Theta_iΘi​. If alternative aaa is chosen and agent iii pays tit_iti​, agent iii's utility is ui(a,θi)−tiu_i(a,\theta_i) - t_iui​(a,θi​)−ti​. A type vector is θ∈Θ=∏iΘi\theta \in \Theta = \prod_i \Theta_iθ∈Θ=∏i​Θi​; θ−i∈Θ−i=∏j≠iΘj\theta_{-i} \in \Theta_{-i} = \prod_{j \ne i}\Theta_jθ−i​∈Θ−i​=∏j=i​Θj​ omits agent iii, and (θi′,θ−i)(\theta_i', \theta_{-i})(θi′​,θ−i​) replaces agent iii's type by θi′\theta_i'θi′​.

A direct mechanism (q,t1,…,tN)(q, t_1, \dots, t_N)(q,t1​,…,tN​) consists of a decision rule q:Θ→Aq : \Theta \to Aq:Θ→A and transfer rules ti:Θ→Rt_i : \Theta \to \mathbb Rti​:Θ→R. It is dominant strategy incentive-compatible (DSIC) if for all θ\thetaθ, iii and θi′\theta_i'θi′​,

ui(q(θ),θi)−ti(θ) ≥ ui(q(θi′,θ−i),θi)−ti(θi′,θ−i).u_i(q(\theta),\theta_i) - t_i(\theta) \ \ge\ u_i(q(\theta_i',\theta_{-i}),\theta_i) - t_i(\theta_i',\theta_{-i}).ui​(q(θ),θi​)−ti​(θ) ≥ ui​(q(θi′​,θ−i​),θi​)−ti​(θi′​,θ−i​).

A decision rule is efficient if q(θ)q(\theta)q(θ) maximizes ∑iui(a,θi)\sum_i u_i(a,\theta_i)∑i​ui​(a,θi​) over a∈Aa \in Aa∈A at every θ\thetaθ. A mechanism is VCG if qqq is efficient and every agent's transfer has the form

ti(θ)=−∑j≠iuj(q(θ),θj)+τi(θ−i)t_i(\theta) = -\sum_{j \ne i} u_j(q(\theta),\theta_j) + \tau_i(\theta_{-i})ti​(θ)=−j=i∑​uj​(q(θ),θj​)+τi​(θ−i​)

for some function τi\tau_iτi​ of the other agents' types. The chapter also uses positive association of differences (PAD: if q(θ)=aq(\theta) = aq(θ)=a and every agent's utility advantage of aaa over every other alternative strictly increases from θ\thetaθ to θ′\theta'θ′, then q(θ′)=aq(\theta') = aq(θ′)=a), flexibility (the range q(Θ)q(\Theta)q(Θ) has at least three elements), ex post individual rationality and ex post budget balance (∑iti(θ)=0\sum_i t_i(\theta) = 0∑i​ti​(θ)=0).

Formalization targets

Goal: uniqueness of VCG (Corollary 7.1, Green–Laffont–Holmström)

If every Θi\Theta_iΘi​ is a convex subset of a Euclidean space Rdi\mathbb R^{d_i}Rdi​ and every ui(a,⋅)u_i(a,\cdot)ui​(a,⋅) is convex and continuous on Θi\Theta_iΘi​, then every DSIC mechanism (q,t)(q,t)(q,t) with an efficient qqq is a VCG mechanism: for each iii there is τi:Θ−i→R\tau_i : \Theta_{-i} \to \mathbb Rτi​:Θ−i​→R with

ti(θ)=−∑j≠iuj(q(θ),θj)+τi(θ−i)for all θ.t_i(\theta) = -\sum_{j \ne i} u_j(q(\theta),\theta_j) + \tau_i(\theta_{-i}) \qquad \text{for all } \theta.ti​(θ)=−j=i∑​uj​(q(θ),θj​)+τi​(θ−i​)for all θ.

The goal leaves AAA, the number of agents and the dimensions did_idi​ free; it asserts only the form of the transfers.

Milestones

Every numbered result of Chapter 7 except Proposition 7.6 (see Formalization scope):

  1. Proposition 7.1: implementability iff cyclical monotonicity in each agent's type (Rochet).
  2. Proposition 7.2: on bounded, one-dimensional type sets, implementability iff monotonicity.
  3. Proposition 7.3: under the goal's convexity hypotheses, the transfers implementing a given qqq are unique up to τi(θ−i)\tau_i(\theta_{-i})τi​(θ−i​).
  4. Proposition 7.4: VCG mechanisms are DSIC.
  5. Proposition 7.5: weak monotonicity in every θi\theta_iθi​ implies PAD.
  6. Proposition 7.7 (Roberts): on unrestricted domains with finite AAA, a flexible qqq with range q(Θ)=Aq(\Theta) = Aq(Θ)=A satisfies PAD iff there are ki≥0k_i \ge 0ki​≥0, not all zero, and F:A→RF : A \to \mathbb RF:A→R with ∑ikiui(q(θ),θi)+F(q(θ))≥∑ikiui(a,θi)+F(a)\sum_i k_i u_i(q(\theta),\theta_i) + F(q(\theta)) \ge \sum_i k_i u_i(a,\theta_i) + F(a)∑i​ki​ui​(q(θ),θi​)+F(q(θ))≥∑i​ki​ui​(a,θi​)+F(a) for all a∈Aa \in Aa∈A.
  7. Proposition 7.8: affine maximizers with all ki>0k_i > 0ki​>0 are implementable.
  8. Proposition 7.9: ex post individual rationality holds iff it holds at the lowest type θ‾i\underline\theta_iθ​i​ with outside option a‾i\underline a_ia​i​.
  9. Proposition 7.10: with N≥2N \ge 2N≥2, a budget-balanced VCG mechanism for efficient qqq exists iff ∑iui(q(θ),θi)=∑ifi(θ−i)\sum_i u_i(q(\theta),\theta_i) = \sum_i f_i(\theta_{-i})∑i​ui​(q(θ),θi​)=∑i​fi​(θ−i​) for some fi:Θ−i→Rf_i : \Theta_{-i} \to \mathbb Rfi​:Θ−i​→R.

Significance

Corollary 7.1 turns the VCG construction from one solution into the complete answer. Any question about efficient dominant-strategy mechanisms (revenue, budget balance, individual rationality) reduces to a question about the functions τi\tau_iτi​. With Proposition 7.10 it gives a necessary and sufficient condition for efficient, budget-balanced dominant-strategy implementation. That condition fails in bilateral trade, and the failure does not use individual rationality. Roberts' theorem plays the same role for inefficient rules: on unrestricted domains, weighted welfare maximization is essentially all that can be implemented.

All of these results are proved in the literature, and none is formalized. The platform has VCG incentive compatibility and weak monotonicity for valuation-based types (the Algorithmic Game Theory IV mission). It has no uniqueness theorem, no revenue equivalence for multidimensional convex types, no Rochet theorem and no Roberts theorem. The book proves Corollary 7.1 from Proposition 7.3, but proves 7.3 itself only by reference to Krishna and Maenner. It states Roberts' theorem without proof.

Difficulty

The uniqueness claim does not follow from incentive compatibility alone. With finitely many types it is false, because any transfers inside the gaps left by the incentive constraints work (Börgers §5.8). The work lies in showing that, along every segment in the convex type set, an agent's equilibrium utility is pinned down by the decision rule. The equilibrium utility is a pointwise supremum of convex functions, one for each report, and the chosen alternative can change at uncountably many points of the segment. A differentiable envelope argument is therefore not directly available. At the boundary of the type set, convexity alone does not prevent upward jumps, which is why continuity is part of the hypotheses. Roberts' theorem needs a separate, combinatorial analysis of the sets of utility differences at which each alternative is chosen, and flexibility is essential there.

Formalization scope

Agents form a finite type ι with decidable equality. Types are arbitrary types Θ i, and utilities are u : ∀ i, A → Θ i → ℝ. The profile (θi′,θ−i)(\theta_i',\theta_{-i})(θi′​,θ−i​) is Function.update θ i θ'. Θ−i\Theta_{-i}Θ−i​ is the product Others Θ i over j ≠ i, so each τi\tau_iτi​ and fif_ifi​ is a function of the others' types only; a constant or a function of the full profile would change the theorem. In the goal and Proposition 7.3, Θi\Theta_iΘi​ is a convex set S i in EuclideanSpace ℝ (Fin (d i)).

Deviations from the page, each forced by a counterexample recorded in the item's natural-language statement:

  • Corollary 7.1 and Proposition 7.3 add continuity of ui(a,⋅)u_i(a,\cdot)ui​(a,⋅) on Θi\Theta_iΘi​. With convexity alone, a utility with a jump at the endpoint of [0,1][0,1][0,1] admits a non-VCG DSIC mechanism.
  • Proposition 7.7 is stated with ki≥0k_i \ge 0ki​≥0, not all zero, instead of ki>0k_i > 0ki​>0, and with the added hypothesis that qqq is onto AAA (the conclusion still ranges over all a∈Aa \in Aa∈A, as on the page). Dictatorships and affine maximizers over a proper subset of AAA are counterexamples to the printed version.
  • Proposition 7.6 (flexible PAD rules on unrestricted domains are implementable) is false as printed. It is not a milestone; the reason is in the mission's hard list.
  • Proposition 7.10 adds N≥2N \ge 2N≥2, since its proof divides by N−1N-1N−1.

The trivializing formalization to avoid is proving Proposition 7.4 (VCG ⇒\Rightarrow⇒ DSIC) in place of the goal (DSIC +++ efficient ⇒\Rightarrow⇒ VCG). A development that proves the goal needs reusable infrastructure: convex functions restricted to segments, absolute continuity of continuous convex functions on compact intervals, and an envelope theorem for suprema of convex functions. Proofs of Rochet's and Roberts' theorems in this abstract setting are also welcome.

Selected references

  • T. Börgers (with D. Krähmer and R. Strausz), An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015, Chapter 7. https://doi.org/10.1093/acprof:oso/9780199734023.001.0001
  • W. Vickrey, Counterspeculation, Auctions, and Competitive Sealed Tenders, Journal of Finance 16, 1961. https://doi.org/10.1111/j.1540-6261.1961.tb02789.x
  • E. H. Clarke, Multipart Pricing of Public Goods, Public Choice 11, 1971. https://doi.org/10.1007/BF01726210
  • T. Groves, Incentives in Teams, Econometrica 41, 1973. https://doi.org/10.2307/1914085
  • J. Green and J.-J. Laffont, Characterization of Satisfactory Mechanisms for the Revelation of Preferences for Public Goods, Econometrica 45, 1977. https://doi.org/10.2307/1911219
  • B. Holmström, Groves' Scheme on Restricted Domains, Econometrica 47, 1979. https://www.jstor.org/stable/1911954
  • K. Roberts, The Characterization of Implementable Choice Rules, in J.-J. Laffont (ed.), Aggregation and Revelation of Preferences, North-Holland, 1979, pp. 321–348.
  • J.-C. Rochet, A Necessary and Sufficient Condition for Rationalizability in a Quasi-Linear Context, Journal of Mathematical Economics 16, 1987. https://doi.org/10.1016/0304-4068(87)90007-3
  • V. Krishna and E. Maenner, Convex Potentials with an Application to Mechanism Design, Econometrica 69, 2001. https://doi.org/10.1111/1468-0262.00233
  • R. Lavi, A. Mu'alem and N. Nisan, Two Simplified Proofs for Roberts' Theorem, Social Choice and Welfare 32, 2009. https://doi.org/10.1007/s00355-008-0333-3
  • P. Milgrom, Putting Auction Theory to Work, Cambridge University Press, 2004. https://doi.org/10.1017/CBO9780511813825
11 thms2 active usersReviewed
🏆Completed
Convex OptimizationMechanism DesignOperations Research·Captain: mikedeng1

An Introduction to the Theory of Mechanism Design VI: Rochet's Theorem — Implementability Is Cyclical MonotonicityTextbook

Motivation

Almost every screening, auction and regulation model asks the same preliminary question: which allocation rules can be made incentive-compatible by some choice of payments? In the one-dimensional models of auction theory and nonlinear pricing the answer is monotonicity: higher types must receive higher allocations. Many applications are not one-dimensional, though. Examples are multi-object auctions, multi-product pricing, and lotteries over several outcomes. For those, a characterization that uses no structure at all is needed. Rochet (1987) gave one: an allocation rule is implementable exactly when it is cyclically monotone, a condition that originates in Rockafellar's characterization of subdifferentials of convex functions. Later work on dominant-strategy implementation, the "weak monotonicity" literature of algorithmic mechanism design, and revenue equivalence all build on it.

This mission formalizes Chapter 5 of Börgers, An Introduction to the Theory of Mechanism Design (Oxford University Press, 2015): all nine numbered results of the chapter.

Timeline. Rockafellar (1970, Theorem 24.8) characterized the cyclically monotone maps between vector spaces as the subgradient selections of convex functions. Rochet (1987) extended the idea to arbitrary alternatives and types with quasi-linear utility and proved that implementability is exactly cyclical monotonicity. Krishna and Maenner (2001) proved revenue equivalence on convex type spaces with utilities convex in the type. Bikhchandani, Chatterji, Lavi, Mu'alem, Nisan and Sen (2006) showed that for finitely many alternatives, weak monotonicity (the two-type case of cyclical monotonicity) already suffices on rich, order-based domains. Saks and Yu (2005) proved the same on convex domains.

Setting

A designer and one agent choose an alternative aaa from a set AAA. The agent has a type θ\thetaθ in a nonempty set Θ\ThetaΘ. With utility function u:A×Θ→Ru : A \times \Theta \to \mathbb Ru:A×Θ→R, her payoff from aaa when she pays ttt is u(a,θ)−tu(a,\theta) - tu(a,θ)−t. Neither AAA nor Θ\ThetaΘ carries any structure.

A direct mechanism is a decision rule q:Θ→Aq : \Theta \to Aq:Θ→A and a transfer rule t:Θ→Rt : \Theta \to \mathbb Rt:Θ→R. It is incentive-compatible if u(q(θ),θ)−t(θ)≥u(q(θ′),θ)−t(θ′)u(q(\theta),\theta) - t(\theta) \ge u(q(\theta'),\theta) - t(\theta')u(q(θ),θ)−t(θ)≥u(q(θ′),θ)−t(θ′) for all θ,θ′\theta,\theta'θ,θ′. A decision rule is implementable if some ttt makes it incentive-compatible. It is weakly monotone if u(q(θ1),θ1)−u(q(θ2),θ1)≥u(q(θ1),θ2)−u(q(θ2),θ2)u(q(\theta_1),\theta_1) - u(q(\theta_2),\theta_1) \ge u(q(\theta_1),\theta_2) - u(q(\theta_2),\theta_2)u(q(θ1​),θ1​)−u(q(θ2​),θ1​)≥u(q(θ1​),θ2​)−u(q(θ2​),θ2​) for all pairs of types. It is cyclically monotone if for every finite sequence of types θ1,…,θk\theta^1,\dots,\theta^kθ1,…,θk with θk=θ1\theta^k = \theta^1θk=θ1,

∑κ=1k−1(u(q(θκ),θκ+1)−u(q(θκ),θκ))≤0.\sum_{\kappa=1}^{k-1}\bigl(u(q(\theta^\kappa),\theta^{\kappa+1}) - u(q(\theta^\kappa),\theta^\kappa)\bigr) \le 0 .κ=1∑k−1​(u(q(θκ),θκ+1)−u(q(θκ),θκ))≤0.

A complete and transitive order RRR of AAA induces a partial order on types: θ≻Rθ′\theta \succ_R \theta'θ≻R​θ′ if θ\thetaθ values every RRR-higher alternative strictly more, relative to an RRR-lower one, than θ′\theta'θ′ does, and neither type distinguishes RRR-indifferent alternatives. The type set is one-dimensional if any two distinct types are ≻R\succ_R≻R​-comparable, and bounded if all utility differences lie in (−c,c)(-c,c)(−c,c) for some c>0c > 0c>0. It is rich if, for some reflexive and transitive relation RRR, every function v:A→Rv : A \to \mathbb Rv:A→R with aRb⇒v(a)≥v(b)aRb \Rightarrow v(a) \ge v(b)aRb⇒v(a)≥v(b) is some type's utility function. A mechanism is individually rational with outside option aaa if every type does at least as well as with aaa and no payment.

Formalization targets

Goal: Proposition 5.2 (Rochet)

q implementable  ⟺  q cyclically monotone,q \text{ implementable} \iff q \text{ cyclically monotone},q implementable⟺q cyclically monotone,

for arbitrary AAA, nonempty Θ\ThetaΘ and uuu.

Milestones

  1. Proposition 5.1: implementable ⇒\Rightarrow⇒ weakly monotone.
  2. Proposition 5.3: for lotteries over finitely many outcomes, Θ⊆RΩ\Theta \subseteq \mathbb R^\OmegaΘ⊆RΩ convex and u(p,θ)=p⋅θu(p,\theta) = p\cdot\thetau(p,θ)=p⋅θ, qqq is implementable iff there is a convex UUU on Θ\ThetaΘ with U(θ′)≥U(θ)+q(θ)⋅(θ′−θ)U(\theta') \ge U(\theta) + q(\theta)\cdot(\theta'-\theta)U(θ′)≥U(θ)+q(θ)⋅(θ′−θ) for all θ,θ′\theta,\theta'θ,θ′.
  3. Proposition 5.4: weakly monotone ⇒\Rightarrow⇒ (θ≻Rθ′⇒q(θ) R q(θ′)\theta \succ_R \theta' \Rightarrow q(\theta)\,R\,q(\theta')θ≻R​θ′⇒q(θ)Rq(θ′)), for every complete transitive RRR.
  4. Proposition 5.5: on one-dimensional type sets, weak monotonicity   ⟺  \iff⟺ monotonicity with respect to RRR.
  5. Proposition 5.6: AAA finite, Θ\ThetaΘ bounded and one-dimensional: monotone with respect to RRR ⇒\Rightarrow⇒ implementable.
  6. Proposition 5.7 (Bikhchandani et al.): AAA finite, rich and consistent domain: weakly monotone ⇒\Rightarrow⇒ implementable.
  7. Proposition 5.8 (revenue equivalence): on convex Θ⊆Rn\Theta \subseteq \mathbb R^nΘ⊆Rn with u(a,⋅)u(a,\cdot)u(a,⋅) convex and continuous, if (q,t)(q,t)(q,t) is incentive-compatible then (q,t′)(q,t')(q,t′) is iff t′=t+τt' = t + \taut′=t+τ for a constant τ\tauτ.
  8. Proposition 5.9: on one-dimensional type sets with a lowest type θ‾\underline\thetaθ​ and a worst alternative a‾\underline aa​, an incentive-compatible mechanism is individually rational with outside option a‾\underline aa​ iff u(q(θ‾),θ‾)−t(θ‾)≥u(a‾,θ‾)u(q(\underline\theta),\underline\theta) - t(\underline\theta) \ge u(\underline a,\underline\theta)u(q(θ​),θ​)−t(θ​)≥u(a​,θ​).

Significance

Rochet's theorem turns the existence of payments, an infinite system of linear inequalities in unknowns t(θ)t(\theta)t(θ), into a condition on the decision rule alone. It underlies the characterization of implementable rules in multidimensional screening, the taxation principle, and the dominant-strategy characterizations of Chapter 7 (applied agent by agent). Propositions 5.4–5.6 recover the "monotone allocation" results of the one-dimensional chapters from it. Proposition 5.8 is the general form of the payoff-equivalence lemmas used for optimal auctions.

All results are classical and proved on paper, except Propositions 5.7 and 5.8, whose proofs the book omits and refers to the literature. None of them is formalized on Prove2Me. The platform's algorithmic-game-theory series has the weak-monotonicity half in a multi-agent valuation model (types are valuations A→RA \to \mathbb RA→R), not the abstract-type statement, and has no cyclical-monotonicity or Rochet result.

Difficulty

Necessity is a two-line telescoping argument. Sufficiency needs a transfer rule built from the decision rule, and the first idea fails: prices attached to alternatives chosen pair by pair (which weak monotonicity supplies) need not be globally consistent. Figure 5.1 of the book gives a three-type example that is weakly monotone but not implementable. The transfer must come from a supremum over all finite chains of types starting at a fixed type. The supremum is finite only because of cyclical monotonicity, and no finiteness, compactness or boundedness is available. Proposition 5.8 needs an envelope argument along segments in Θ\ThetaΘ without differentiability. Proposition 5.7 needs a combinatorial argument that uses richness of the domain.

Formalization scope

Alternatives and types are arbitrary Lean types A, Θ with Nonempty Θ, and the utility is u : A → Θ → ℝ. A cycle of length k=m+1k = m+1k=m+1 is a map Fin (m+1) → Θ with equal first and last entries, and its mmm summands are indexed by Fin m. Relations are predicates A → A → Prop. For Propositions 5.3 and 5.8, types form a subset S of Ω → ℝ (resp. Fin n → ℝ) used as a subtype. Lotteries are stdSimplex ℝ Ω, and the subgradient inequality is required only at points of S.

The explicit statements are fixed as follows:

  • Proposition 5.8's conclusion is the exact translation form t′(θ)=t(θ)+τt'(\theta) = t(\theta) + \taut′(θ)=t(θ)+τ for one τ\tauτ and all θ\thetaθ.
  • Proposition 5.9's condition is the single inequality at θ‾\underline\thetaθ​.
  • Boundedness in Proposition 5.6 is Definition 5.9's strict two-sided bound with some c>0c > 0c>0.

Two statements are corrected from the page, each with a counterexample to the literal version recorded in its item:

  • Proposition 5.7 adds Bikhchandani et al.'s requirement that every type's utility respects RRR.
  • Proposition 5.8 adds continuity of u(a,⋅)u(a,\cdot)u(a,⋅) on Θ\ThetaΘ (automatic in the relative interior).

Both directions of Rochet's theorem are required. The necessity half alone, or a version with finite Θ\ThetaΘ, finite AAA or bounded utilities, is a different and much weaker theorem and does not close the goal.

The development needs finite telescoping sums, suprema of sets of reals (sSup with an explicit bounded-above argument), convex functions on sets and one-dimensional convex analysis (Proposition 5.8). The definitions file is reusable for Chapters 6–8 of the series. Contributions of alternative proofs, for example Proposition 5.6 through Rochet's theorem, are welcome.

Selected references

  • T. Börgers, An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015, Chapter 5. https://doi.org/10.1093/acprof:oso/9780199734023.001.0001
  • J.-C. Rochet, "A necessary and sufficient condition for rationalizability in a quasi-linear context," Journal of Mathematical Economics 16 (1987) 191–200. https://doi.org/10.1016/0304-4068(87)90007-3
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970, Theorem 24.8.
  • V. Krishna and E. Maenner, "Convex potentials with an application to mechanism design," Econometrica 69 (2001) 1113–1119. https://doi.org/10.1111/1468-0262.00233
  • S. Bikhchandani, S. Chatterji, R. Lavi, A. Mu'alem, N. Nisan and A. Sen, "Weak monotonicity characterizes deterministic dominant-strategy implementation," Econometrica 74 (2006) 1109–1132. https://doi.org/10.1111/j.1468-0262.2006.00695.x
  • M. Saks and L. Yu, "Weak monotonicity suffices for truthfulness on convex domains," Proceedings of the 6th ACM Conference on Electronic Commerce (2005) 286–293. https://doi.org/10.1145/1064009.1064039
10 thms2 active usersReviewed
🏆Completed
Mechanism DesignOperations Research·Captain: mikedeng1

An Introduction to the Theory of Mechanism Design V: Dominant-Strategy Public Goods Mechanisms for Two Agents Are Fixed Cost SharesTextbook

Motivation

Bayesian mechanism design assumes that the designer knows a common prior from which every agent's beliefs about the others are derived. Chapter 4 of Börgers' An Introduction to the Theory of Mechanism Design (Oxford University Press, 2015, DOI 10.1093/acprof:oso/9780199734023.001.0001) drops that assumption. The designer is unwilling to rely on anything about what agents believe about each other, and therefore requires that truth telling be optimal for every type whatever the other agents report (dominant strategy incentive compatibility) and that participation be worthwhile after all reports are known (ex post individual rationality). The chapter revisits the three examples of Chapter 3 (single unit auctions, public goods, bilateral trade) and asks which mechanisms survive these requirements.

The answer differs sharply between examples. In auctions nothing is lost: an expected-revenue-maximizing auction can be implemented in dominant strategies. With a budget constraint, the class collapses. For a public good shared by two agents, the only dominant-strategy, ex post individually rational mechanisms that exactly balance the budget are fixed cost shares; in bilateral trade they are fixed-price mechanisms. These results go back to the dominant-strategy literature on public goods (Serizawa 1999, Econometrica) and on bilateral trade (Hagerty and Rogerson 1987, Journal of Economic Theory), as the book's §4.5 records (p.93), and they explain why simple posted-price and cost-sharing rules are common in practice.

Setting

Every agent iii has a type θi\theta_iθi​ in an interval. In the auction and the public good examples the interval is [θ‾,θˉ][\underline\theta,\bar\theta][θ​,θˉ] with 0≤θ‾<θˉ0 \le \underline\theta < \bar\theta0≤θ​<θˉ; Θ=[θ‾,θˉ]I\Theta = [\underline\theta,\bar\theta]^IΘ=[θ​,θˉ]I is the set of type vectors, and θ−i\theta_{-i}θ−i​ is θ\thetaθ without its iii-th entry. A direct mechanism asks every agent to report a type and maps the reports to an outcome.

  • Auction (§4.2). A seller has one good. The mechanism consists of allocation probabilities qi(θ)≥0q_i(\theta) \ge 0qi​(θ)≥0 with ∑iqi(θ)≤1\sum_i q_i(\theta) \le 1∑i​qi​(θ)≤1 and payments ti(θ)t_i(\theta)ti​(θ); buyer iii's utility is θiqi(θ)−ti(θ)\theta_i q_i(\theta) - t_i(\theta)θi​qi​(θ)−ti​(θ).
  • Public good (§4.3). A good costing c>0c > 0c>0 is produced (q(θ)=1q(\theta) = 1q(θ)=1) or not (q(θ)=0q(\theta) = 0q(θ)=0); agent iii pays ti(θ)t_i(\theta)ti​(θ) and has utility θiq(θ)−ti(θ)\theta_i q(\theta) - t_i(\theta)θi​q(θ)−ti​(θ). Ex post budget balance is the equality ∑iti(θ)=c q(θ)\sum_i t_i(\theta) = c\,q(\theta)∑i​ti​(θ)=cq(θ) for every θ\thetaθ.
  • Bilateral trade (§4.4). A seller with type θS∈[θ‾S,θˉS]\theta_S \in [\underline\theta_S,\bar\theta_S]θS​∈[θ​S​,θˉS​] and a buyer with type θB∈[θ‾B,θˉB]\theta_B \in [\underline\theta_B,\bar\theta_B]θB​∈[θ​B​,θˉB​]; trade takes place (q(θ)=1q(\theta) = 1q(θ)=1) or not; the seller receives tS(θ)t_S(\theta)tS​(θ) and has utility θS(1−q(θ))+tS(θ)\theta_S(1-q(\theta)) + t_S(\theta)θS​(1−q(θ))+tS​(θ); the buyer pays tB(θ)t_B(\theta)tB​(θ) and has utility θBq(θ)−tB(θ)\theta_B q(\theta) - t_B(\theta)θB​q(θ)−tB​(θ). Ex post exact budget balance is tB=tSt_B = t_StB​=tS​.

A mechanism is dominant strategy incentive-compatible if for every agent, every true type, every false report and every report profile of the others, truthful reporting yields at least as much utility. It is ex post individually rational if every type's utility at every type vector is at least its outside option: 000 for buyers and public good agents, θS\theta_SθS​ (keeping the good) for the seller. A canonical mechanism (Definitions 4.3–4.5) allocates according to strictly increasing continuous scores ψi(θi)\psi_i(\theta_i)ψi​(θi​) and charges each agent the smallest report with which the outcome would have been the same.

Formalization targets

Goal: Proposition 4.8, fixed cost shares

For N=2N = 2N=2 and a decision rule whose production set {θ∈Θ∣q(θ)=1}\{\theta \in \Theta \mid q(\theta) = 1\}{θ∈Θ∣q(θ)=1} is closed, a direct public good mechanism is dominant strategy incentive-compatible, ex post individually rational and ex post budget balanced if and only if there are τ1,τ2∈R\tau_1, \tau_2 \in \mathbb Rτ1​,τ2​∈R with τ1+τ2=c\tau_1 + \tau_2 = cτ1​+τ2​=c and, for all θ∈Θ\theta \in \Thetaθ∈Θ,

q(θ)=1, ti(θ)=τi  if θ1≥τ1 and θ2≥τ2;q(θ)=0, ti(θ)=0  otherwise.q(\theta) = 1,\ t_i(\theta) = \tau_i \ \text{ if } \theta_1 \ge \tau_1 \text{ and } \theta_2 \ge \tau_2; \qquad q(\theta) = 0,\ t_i(\theta) = 0 \ \text{ otherwise.}q(θ)=1, ti​(θ)=τi​  if θ1​≥τ1​ and θ2​≥τ2​;q(θ)=0, ti​(θ)=0  otherwise.

Both directions are part of the goal; the "only if" direction is the content.

Milestones

  • The revelation principle for dominant strategies (Proposition 4.1).
  • Characterizations of dominant strategy incentive compatibility: monotone allocation with the envelope payment formula in auctions (Proposition 4.2), threshold rules with payment jump τ^i−τi=θ^i\hat\tau_i - \tau_i = \hat\theta_iτ^i​−τi​=θ^i​ for public goods (Proposition 4.5) and bilateral trade (Proposition 4.9).
  • Ex post individual rationality reduces to the lowest type, or to the highest seller type (Propositions 4.3, 4.6, 4.10).
  • Canonical mechanisms are dominant strategy incentive-compatible and ex post individually rational, with zero rent for the lowest type (Propositions 4.4, 4.7, 4.11).
  • The bilateral trade analogue of the goal (Proposition 4.12): the only such mechanisms with tB=tSt_B = t_StB​=tS​ and closed trade set are no trade, or trade at a fixed price θ^\hat\thetaθ^ exactly when θS≤θ^≤θB\theta_S \le \hat\theta \le \theta_BθS​≤θ^≤θB​.

Significance

Proposition 4.4 shows that the optimal auctions of Chapter 3 remain available without any assumption on beliefs, while Propositions 4.8 and 4.12 show that under exact budget balance, dominant strategy implementation forces rules that ignore reported valuations except through a yes/no participation decision. Together they mark the boundary between settings where the Bayesian and the belief-free approaches coincide and settings where the belief-free requirement is severe. This contrast motivates the robust mechanism design of Chapter 10.

These results are proved in the book: Propositions 4.5 and 4.8 in full, the others with proofs omitted or "analogous". No machine-checked proof of them appears on the platform or in Mathlib. The platform has a single-parameter characterization in a different model (AGT.single_parameter_characterization: valuation profiles, win sets, normalized losers' payments) and the second-price dominance fact; neither covers public goods, bilateral trade, budget balance or randomized allocations. The mission would add a machine-checked belief-free counterpart of Chapter 3, including the two characterization theorems whose printed proofs leave cases to the reader.

Difficulty

The characterizations (Propositions 4.2, 4.5, 4.9) are standard single-agent arguments applied to every profile of the others. The goal is harder. Proposition 4.5 describes each agent's incentives separately, for each report of the other agent, with thresholds and payments that may vary with that report. Budget balance couples the two agents' payments at every type vector. The step that fails when attempted naively is going from "a threshold for each θ−i\theta_{-i}θ−i​" to "one fixed threshold for each agent": the thresholds may lie outside the type interval, several degenerate configurations occur (an agent whose report never matters, a good that is always or never produced), and the printed proof treats the degenerate cases by assuming θ‾=0\underline\theta = 0θ​=0 and leaves one of them "analogous". The closedness hypothesis is what makes the relevant minimal types exist; without it the boundary of the production set is not determined. Proposition 4.12 has the same structure with the seller's orientation reversed.

Formalization scope

  • Agents are a finite type with decidable equality (auctions, public goods), Fin 2 for the goal, and a pair (θS, θB) : ℝ × ℝ for bilateral trade. A deviation (θi′,θ−i)(\theta_i', \theta_{-i})(θi′​,θ−i​) is Function.update θ i x for θ ∈ Θ; quantifying over θ ∈ Θ quantifies over θ−i\theta_{-i}θ−i​.
  • Decision and trading rules are real-valued and take values in {0,1}\{0,1\}{0,1} on Θ\ThetaΘ; auction allocations lie in Δ\DeltaΔ on Θ\ThetaΘ. Values outside Θ\ThetaΘ play no role.
  • Budget balance in §§4.3–4.4 is the equality ∑iti=c q\sum_i t_i = c\,q∑i​ti​=cq (resp. tB=tSt_B = t_StB​=tS​). The inequality of Definition 3.5 would make the goal false.
  • Explicit formulas stated as in the book: the payment identity of Proposition 4.2, the relation τ^i−τi=θ^i\hat\tau_i - \tau_i = \hat\theta_iτ^i​−τi​=θ^i​ (Propositions 4.5, 4.9), the canonical payments of Definitions 4.3–4.5 (with the 1/n1/n1/n tie-splitting of Definition 4.3), the cost shares with τ1+τ2=c\tau_1 + \tau_2 = cτ1​+τ2​=c (Proposition 4.8) and the fixed price θ^\hat\thetaθ^ with trade iff θS≤θ^≤θB\theta_S \le \hat\theta \le \theta_BθS​≤θ^≤θB​ (Proposition 4.12). Minima and maxima in the canonical payments are written as sInf/sSup of sets that are nonempty and closed whenever they are used.
  • Thresholds θ^i\hat\theta_iθ^i​ range over R\mathbb RR and depend on θ−i\theta_{-i}θ−i​; cost shares τi\tau_iτi​ may be negative; the goal does not assume θ‾=0\underline\theta = 0θ​=0.
  • The general mechanism of Proposition 4.1 has arbitrary message sets and an outcome function to allocation probabilities and expected payments. Stating the revelation principle for a mechanism that is already direct would trivialize it and is ruled out.
  • The goal must not be weakened to one direction, to the existence of some fixed-share mechanism, or to budget balance as an inequality.

Contributions welcome: proofs of the characterization milestones (4.2, 4.5, 4.9), which the goal and Proposition 4.12 use; a proof of the goal covering the degenerate cases the book leaves to the reader; and the three-agent counterexample of p.90 as a separate statement.

Selected references

  • T. Börgers (with D. Krähmer and R. Strausz), An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015, Chapter 4. DOI 10.1093/acprof:oso/9780199734023.001.0001
  • K. M. Hagerty and W. P. Rogerson, Robust trading mechanisms, Journal of Economic Theory 42 (1987) 94–107.
  • S. Serizawa, Strategy-proof and symmetric social choice functions for public good economies, Econometrica 67 (1999) 121–145.
  • D. Mookherjee and S. Reichelstein, Dominant strategy implementation of Bayesian incentive compatible allocation rules, Journal of Economic Theory 56 (1992) 378–399.
15 thms2 active usersReviewed
🏆Completed
Mechanism DesignOperations ResearchProbability·Captain: mikedeng1

An Introduction to the Theory of Mechanism Design IV: The Myerson–Satterthwaite TheoremTextbook

Motivation

Stock exchanges, commodity markets and trading platforms are institutions for trade between parties who each know something the other does not. The simplest version is bilateral trade: one seller, one buyer, one indivisible good, and each side privately knows its own value. The question is whether any trading institution can make the two trade exactly when trade is efficient, with both taking part voluntarily and without a subsidy from outside. Myerson and Satterthwaite (1983) showed that, apart from trivial cases, none can. The result is one of the basic impossibility theorems of economic theory. It explains why bargaining under private information is inefficient, and it is the benchmark every later analysis of double auctions and market design compares against.

This mission formalizes Section 3.4 of Börgers, An Introduction to the Theory of Mechanism Design (Oxford University Press, 2015): the impossibility theorem, the pivot-mechanism argument that proves it, the second-best and profit-maximizing trading mechanisms, and the uniform example.

Timeline. Vickrey (1961) noted the tension between efficiency and budget balance in markets with private values. Chatterjee and Samuelson (1983) studied the sealed-offer double auction and its linear equilibrium for uniform values. Myerson and Satterthwaite (1983) proved the impossibility for general independent distributions with overlapping supports, and computed the second-best mechanism; for uniform values it coincides with the Chatterjee–Samuelson linear equilibrium. Börgers (2015) gives the pivot-mechanism proof formalized here.

Setting

A seller SSS owns one indivisible good; a buyer BBB may buy it. The seller's value θS\theta_SθS​ has distribution FSF_SFS​ with density fS>0f_S > 0fS​>0 on [θ‾S,θ‾S][\underline\theta_S, \overline\theta_S][θ​S​,θS​]; the buyer's value θB\theta_BθB​ has distribution FBF_BFB​ with density fB>0f_B > 0fB​>0 on [θ‾B,θ‾B][\underline\theta_B, \overline\theta_B][θ​B​,θB​]. The two intervals are nondegenerate and may differ, and the values are independent. The seller's utility is ttt if she sells for ttt and θS+t\theta_S + tθS​+t if she keeps the good and receives ttt; the buyer's is θB−t\theta_B - tθB​−t if he buys and pays ttt, and −t-t−t otherwise.

A direct mechanism is a trading rule q:Θ→{0,1}q : \Theta \to \{0,1\}q:Θ→{0,1} on Θ=[θ‾S,θ‾S]×[θ‾B,θ‾B]\Theta = [\underline\theta_S, \overline\theta_S] \times [\underline\theta_B, \overline\theta_B]Θ=[θ​S​,θS​]×[θ​B​,θB​] and transfers tSt_StS​ (received by the seller) and tBt_BtB​ (paid by the buyer). Conditioning on one agent's type gives the interim trade probabilities QS,QBQ_S, Q_BQS​,QB​, the interim transfers TS,TBT_S, T_BTS​,TB​, and the interim utilities US(θS)=TS(θS)+(1−QS(θS))θSU_S(\theta_S) = T_S(\theta_S) + (1 - Q_S(\theta_S))\theta_SUS​(θS​)=TS​(θS​)+(1−QS​(θS​))θS​ and UB(θB)=QB(θB)θB−TB(θB)U_B(\theta_B) = Q_B(\theta_B)\theta_B - T_B(\theta_B)UB​(θB​)=QB​(θB​)θB​−TB​(θB​). The mechanism is incentive-compatible if truthful reporting is a Bayesian equilibrium, individually rational if US(θS)≥θSU_S(\theta_S) \ge \theta_SUS​(θS​)≥θS​ and UB(θB)≥0U_B(\theta_B) \ge 0UB​(θB​)≥0 for all types, ex post budget balanced if tS(θ)=tB(θ)t_S(\theta) = t_B(\theta)tS​(θ)=tB​(θ) for every θ\thetaθ, and ex ante budget balanced if E[tS]=E[tB]\mathbb E[t_S] = \mathbb E[t_B]E[tS​]=E[tB​]. A first-best trading rule trades when θB>θS\theta_B > \theta_SθB​>θS​ and not when θB<θS\theta_B < \theta_SθB​<θS​, with any choice at ties. The seller's virtual cost is ψS=θS+FS/fS\psi_S = \theta_S + F_S/f_SψS​=θS​+FS​/fS​ and the buyer's virtual valuation is ψB=θB−(1−FB)/fB\psi_B = \theta_B - (1 - F_B)/f_BψB​=θB​−(1−FB​)/fB​; the distributions are regular if both are increasing.

Formalization targets

Goal: Proposition 3.12 (Myerson–Satterthwaite)

An incentive-compatible, individually rational and ex post budget balanced direct mechanism with a first-best trading rule exists if and only if

θ‾B≥θ‾Sorθ‾S≥θ‾B.\underline\theta_B \ge \overline\theta_S \quad\text{or}\quad \underline\theta_S \ge \overline\theta_B .θ​B​≥θS​orθ​S​≥θB​.

Milestones

  • Lemmas 3.9–3.11. The pivot mechanism is incentive-compatible and individually rational. Among all such mechanisms that implement a first-best rule, it maximizes E[tB−tS]\mathbb E[t_B - t_S]E[tB​−tS​]. That quantity is negative whenever θ‾B<θ‾S\underline\theta_B < \overline\theta_Sθ​B​<θS​ and θ‾B>θ‾S\overline\theta_B > \underline\theta_SθB​>θ​S​.
  • Proposition 3.13 (second best). With overlapping supports and regular distributions, the welfare-maximizing incentive-compatible, individually rational, ex ante budget balanced mechanisms are characterized by the trading rule
q(θ)=1  ⟺  θB−λ1+λ1−FB(θB)fB(θB)≥θS+λ1+λFS(θS)fS(θS)q(\theta) = 1 \iff \theta_B - \tfrac{\lambda}{1+\lambda}\tfrac{1 - F_B(\theta_B)}{f_B(\theta_B)} \ge \theta_S + \tfrac{\lambda}{1+\lambda}\tfrac{F_S(\theta_S)}{f_S(\theta_S)}q(θ)=1⟺θB​−1+λλ​fB​(θB​)1−FB​(θB​)​≥θS​+1+λλ​fS​(θS​)FS​(θS​)​

for some λ>0\lambda > 0λ>0, exact budget balance ∫q (ψB−ψS) f=θ‾S−∫ψSf\int q\,(\psi_B - \psi_S)\,f = \overline\theta_S - \int \psi_S f∫q(ψB​−ψS​)f=θS​−∫ψS​f, and the incentive-compatible payments with binding participation of θ‾S\overline\theta_SθS​ and θ‾B\underline\theta_Bθ​B​.

  • Proposition 3.14 (profit maximization). Profit E[tB−tS]\mathbb E[t_B - t_S]E[tB​−tS​] is maximized by trading iff ψB(θB)>ψS(θS)\psi_B(\theta_B) > \psi_S(\theta_S)ψB​(θB​)>ψS​(θS​), with the same payment formulas.
  • Propositions 3.15–3.16 (uniform values on [0,1][0,1][0,1]). The second best trades iff θB−θS>1/4\theta_B - \theta_S > 1/4θB​−θS​>1/4; the profit maximizer trades iff θB−θS>1/2\theta_B - \theta_S > 1/2θB​−θS​>1/2.

Significance

The theorem locates the source of inefficiency in bilateral bargaining in private information itself, not in any particular bargaining protocol: no mechanism, however clever, achieves efficient voluntary trade without a subsidy. It is the reason efficiency in markets is studied as a limit (large double auctions approach efficiency as the number of traders grows), and why a trading platform's fee structure is analyzed as a second-best problem. The pivot-mechanism argument is the same one that proves the impossibility of first-best public-goods provision (Proposition 3.7), so the two formalizations share their structure.

All results of this section are classical and proved on paper. None is formalized on Prove2Me, and Mathlib has no mechanism-design library. The platform has the Chatterjee–Samuelson linear equilibrium as an open statement about one particular game; this mission states results about all mechanisms. A complete development yields a reusable one-dimensional envelope/payoff-equivalence library for two agents with differently oriented types (the seller's incentive constraint runs from high types down), and the Lagrangian optimality argument for a linear objective under a single linear constraint.

Difficulty

The obvious attempt to prove impossibility looks for a contradiction between incentive compatibility and budget balance state by state. That fails: incentive compatibility and participation are interim constraints, so any single state admits budget-balanced transfers consistent with them, and the contradiction exists only after integrating over the prior. Two points need care. The seller's orientation is reversed: her trade probability is decreasing and her participation constraint binds at the highest type. And the deficit of the pivot mechanism must be shown to have positive probability, which uses that the supports overlap in a set with nonempty interior. The optimal-mechanism results additionally need that the trading rule implied by a Lagrange multiplier satisfies the monotonicity constraint, which is where regularity enters, and that a multiplier exists which makes the budget constraint bind.

Formalization scope

A type vector is a pair θ : ℝ × ℝ with θ.1 the seller's and θ.2 the buyer's value. The prior is Lebesgue measure on Θ\ThetaΘ with density fS(θS)fB(θB)f_S(\theta_S) f_B(\theta_B)fS​(θS​)fB​(θB​). Densities are measurable, strictly positive on the closed supports and integrate to one; nothing else, such as continuity, is assumed. The trading rule is real-valued with values in {0,1}\{0,1\}{0,1} on Θ\ThetaΘ (deterministic, as in Definition 3.9). The measurability the book omits (Ch. 2 note 2) is built into the admissible class: qqq, tSt_StS​, tBt_BtB​ are measurable with integrable transfers. "Increasing" is weak monotonicity, the book's convention.

Explicit formulas the statements carry: the first-best rule (3.61) with free tie rule, the pivot transfers of Definition 3.10, the rule (3.70) with parameter λ>0\lambda > 0λ>0, the exact budget equation of Proposition 3.13 (ii), the payment formulas TB(θB)=θBQB(θB)−∫θ‾BθBQBT_B(\theta_B) = \theta_B Q_B(\theta_B) - \int_{\underline\theta_B}^{\theta_B} Q_BTB​(θB​)=θB​QB​(θB​)−∫θ​B​θB​​QB​ and TS(θS)=θ‾S−(1−QS(θS))θS−∫θSθ‾S(1−QS)T_S(\theta_S) = \overline\theta_S - (1 - Q_S(\theta_S))\theta_S - \int_{\theta_S}^{\overline\theta_S}(1 - Q_S)TS​(θS​)=θS​−(1−QS​(θS​))θS​−∫θS​θS​​(1−QS​), the profit rule ψB>ψS\psi_B > \psi_SψB​>ψS​, and the thresholds 1/41/41/4 and 1/21/21/2.

The goal quantifies over every first-best trading rule and imposes budget balance as the ex post equality tS=tBt_S = t_BtS​=tB​. Dropping budget balance, weakening it to tS≤tBt_S \le t_BtS​≤tB​, or fixing one tie rule would give a different, and in the first case false, statement. The pointwise "if and only if … for all θ\thetaθ" characterizations of Propositions 3.13–3.16 are stated with necessity almost everywhere, since an optimal trading rule is determined only up to null sets. For Proposition 3.14 necessity is also restricted to {ψB≠ψS}\{\psi_B \ne \psi_S\}{ψB​=ψS​}: under weak regularity that tie set can have positive probability, and profit does not depend on the trading rule there.

Contributions welcome: proofs of the milestones, a two-agent payoff-equivalence lemma for the seller's reversed orientation, and a sorry-free construction of the pivot mechanism's integrability facts.

Selected references

  • R. B. Myerson and M. A. Satterthwaite, Efficient mechanisms for bilateral trading, Journal of Economic Theory 29 (1983) 265–281. https://doi.org/10.1016/0022-0531(83)90048-0
  • K. Chatterjee and W. Samuelson, Bargaining under incomplete information, Operations Research 31 (1983) 835–851. https://doi.org/10.1287/opre.31.5.835
  • W. Vickrey, Counterspeculation, auctions, and competitive sealed tenders, Journal of Finance 16 (1961) 8–37. https://doi.org/10.1111/j.1540-6261.1961.tb02789.x
  • T. Börgers, An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015, §3.4. https://doi.org/10.1093/acprof:oso/9780199734023.001.0001
9 thms2 active usersReviewed
PreviousPage 6 of 8Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me