Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

2,232 missions · 1,108 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open1124Completed1108All2232
🏆Completed
EconomicsInformation TheoryOptimization·Captain: mikedeng1

Human and Machine: The Impact of Machine Input on Decision-Making Under Cognitive Limitations I: The Rationally Inattentive Decision-Maker's Optimal Choice Probability in Closed FormResearch Paper

Motivation

A person using a machine's advice may decide more accurately, but attention is costly. Before asking what a machine changes, the baseline decision has to be understood: how often would the person choose the action associated with a good state without machine input? Boyacı, Canyakmaz, and de Véricourt study this question in a model of a decision maker who can acquire information about an unknown binary state and pays for the expected reduction in uncertainty. Their working paper derives a closed form for the decision maker's choice probability. That baseline is used later in the paper to compare decisions with and without machine input.

The information cost follows the rational inattention approach: a decision maker chooses how much information to process while considering its effect on the final action. In the discrete choice setting, Matějka and McKay (2015) characterize optimal conditional choice probabilities. The paper adopts their equivalent choice probability representation in §4. This mission isolates the first consequence of that representation, Theorem 1, before the paper introduces the machine.

Setting

The unknown state is good, ggg, with prior probability μ\muμ, and bad, bbb, with probability 1−μ1-\mu1−μ. The decision maker selects either yyy (declare good) or nnn (declare bad). A correct action earns one unit, and an incorrect action earns zero. Write pgp_gpg​ for the probability of choosing yyy when the state is ggg, and pbp_bpb​ for the probability of choosing yyy when the state is bbb. A strategy is any pair (pg,pb)∈[0,1]2(p_g,p_b)\in[0,1]^2(pg​,pb​)∈[0,1]2; the pair may lie on the no-information diagonal or on the boundary of the square.

The unconditional choice probability is p=μpg+(1−μ)pbp=\mu p_g+(1-\mu)p_bp=μpg​+(1−μ)pb​. The accuracy is A=μpg+(1−μ)(1−pb)A=\mu p_g+(1-\mu)(1-p_b)A=μpg​+(1−μ)(1−pb​). Binary entropy, measured with the natural logarithm, is H(t)=−tlog⁡t−(1−t)log⁡(1−t)H(t)=-t\log t-(1-t)\log(1-t)H(t)=−tlogt−(1−t)log(1−t), with H(0)=H(1)=0H(0)=H(1)=0H(0)=H(1)=0. Given an information-cost parameter λ>0\lambda>0λ>0, the cognitive cost in the paper's choice probability representation is

C=λ[H(p)−(1−μ)H(pb)−μH(pg)].C=\lambda\bigl[H(p)-(1-\mu)H(p_b)-\mu H(p_g)\bigr].C=λ[H(p)−(1−μ)H(pb​)−μH(pg​)].

The decision maker maximizes net value V=A−CV=A-CV=A−C over the whole square. An optimal pair is one whose value is at least that of every feasible pair. The source originally introduces a general distribution of information signals and a Bayes consistency condition in problem (2). Section 4 and footnote 8 adopt the equivalent conditional choice probability representation used here. The equivalence itself is an input from Matějka and McKay (2015), rather than a claim of this mission.

Formalization targets

Optimal choice probability

For 0<μ<10<\mu<10<μ<1 and λ>0\lambda>0λ>0, define the thresholds

μ‾(λ)=1e1/λ+1,μ‾(λ)=e1/λe1/λ+1.\underline\mu(\lambda)=\frac{1}{e^{1/\lambda}+1},\qquad \overline\mu(\lambda)=\frac{e^{1/\lambda}}{e^{1/\lambda}+1}.μ​(λ)=e1/λ+11​,μ​(λ)=e1/λ+1e1/λ​.

The goal is the paper's Theorem 1: every optimal pair has the same unconditional choice probability,

p⋆(μ)={0,μ≤μ‾,μ1−e−1/λ−1−μe1/λ−1,μ‾<μ<μ‾,1,μ≥μ‾.p^\star(\mu)= \begin{cases} 0,&\mu\le\underline\mu,\\ \displaystyle\frac{\mu}{1-e^{-1/\lambda}}-\frac{1-\mu}{e^{1/\lambda}-1},&\underline\mu<\mu<\overline\mu,\\ 1,&\mu\ge\overline\mu. \end{cases}p⋆(μ)=⎩⎨⎧​0,1−e−1/λμ​−e1/λ−11−μ​,1,​μ≤μ​,μ​<μ<μ​,μ≥μ​.​

The same theorem states μ‾<1/2<μ‾\underline\mu<1/2<\overline\muμ​<1/2<μ​, that p⋆p^\starp⋆ is non-decreasing in the prior, and that the lower threshold increases while the upper threshold decreases as λ\lambdaλ increases. This mission includes all these clauses in its single goal. The intermediate milestones formalize the paper's conditional choice equations, the algebraic interior candidate, its threshold crossings, and its slope and threshold derivatives.

Significance

The formula partitions prior beliefs into three regimes. With a sufficiently low prior, the decision maker always chooses nnn; with a sufficiently high prior, the decision maker always chooses yyy. Between the thresholds, the probability of choosing yyy changes continuously with the prior. The threshold movements describe how a higher information cost changes the region in which information processing affects the choice. In the paper, these probabilities feed into accuracy, error rate, effort, and machine input comparisons.

The paper proves the result mathematically. The statements here are open Lean targets, so compilation of their declarations does not amount to machine-checked proofs. A complete development would verify the optimality characterization and the closed form, then provide reusable binary entropy and constrained optimization lemmas. It would also expose a precise baseline that subsequent missions can import after publication.

Difficulty

Equations (4)–(6) alone do not select the optimum: both p=0p=0p=0 and p=1p=1p=1 satisfy them for every prior. The printed uniqueness phrase in Lemma 1 therefore cannot be carried into a theorem about all solutions of those equations. The formal target says instead that every maximizing strategy satisfies the conditional choice equations, and Theorem 1 identifies the probability selected by maximization. The endpoint strategies, where entropy is evaluated at zero or one, must remain in the feasible set. One must also distinguish the algebraic interior root from the optimizer when that root leaves [0,1][0,1][0,1].

Formalization scope

Lean represents probabilities and costs as real numbers. The strategy space is the full closed square [0,1]2[0,1]^2[0,1]2, and IsOptimal compares net value against every point in that square. The prior in the goal and Lemma 1 lies strictly between zero and one, as in the paper's §4 setting; λ\lambdaλ is strictly positive. Boolean state and action types are unnecessary in this first mission because the paper's §4 representation is already the pair of conditional probabilities. The general-signal distribution of problem (2) is not encoded here.

The entropy function is Mathlib's Real.binEntropy, with natural logarithms and the endpoint values used by the paper. The threshold definitions reproduce Theorem 1 exactly. pBar is the interior algebraic expression from Appendix A, and pClosed is only the right-hand side of equation (11). Neither defines the optimizer. In particular, defining the starred optimal probability by the closed form would remove the theorem's main claim. The goal quantifies over every optimal pair and asserts that its computed choice probability equals that expression.

Contributions to the proof will need results about binary entropy at the boundary, derivatives of the objective in the interior, existence and characterization of maximizers on a compact square, and elementary inequalities for the exponential thresholds. The entropy and compact optimization infrastructure can support later formalizations beyond this paper. The four listed milestones follow the authors' Appendix A argument; alternative proofs of the same faithful statements are welcome.

Selected references

  • Tamer Boyacı, Caner Canyakmaz, and Francis de Véricourt, Human and Machine: The Impact of Machine Input on Decision-Making Under Cognitive Limitations, ESMT Working Paper 20-02, November 30, 2020, §§3–4 and Appendix A. Working paper record.
  • Filip Matějka and Alisdair McKay, Rational Inattention to Discrete Choices: A New Foundation for the Multinomial Logit Model, American Economic Review 105(1), 2015, pp. 272–298. DOI.
6 thms2 active usersReviewed
Algorithmic Game TheoryAnalysisOptimization·Captain: mikedeng1

A Sensitivity Analysis of the Price of Anarchy in Nonatomic Congestion Games 3: The Price of Anarchy Is Locally Lipschitz at Games with Constant Costs or Strictly Increasing C¹ CostsResearch Paper

Motivation

The price of anarchy (PoA) of a nonatomic congestion game is the ratio of the total cost of a Wardrop equilibrium to the minimum total cost. Worst-case bounds on it over whole classes of cost functions are classical (Roughgarden and Tardos, 2002; Correa, Schulz and Stier-Moses, 2004). In practice the demands and cost functions of a traffic model are estimated, never known exactly, so a second question matters as much as the worst case: how much does the PoA of a given game move when its data move?

Wu and Möhring (arXiv:2007.13979v3, published in Mathematics of Operations Research, 2023) answer this with a metric on games that compares demands and cost functions simultaneously. They show that the PoA is continuous, that it is Hölder continuous with exponent 1/21/21/2 near every game whose costs are Lipschitz, and that it is not uniformly Hölder continuous. This mission formalizes their Theorem 12 (§4.3): at two special classes of games, games with constant costs and games with strictly increasing continuously differentiable costs, the exponent improves to 111, so the PoA is locally Lipschitz. The authors motivate the result by the differentiability results of Cominetti, Dose and Scarsini (2020), which suggest Lipschitz behaviour at games whose costs have strictly positive derivatives.

Setting

Fix a finite set AAA of arcs, a finite nonempty set KKK of origin–destination (O/D) pairs, and for each k∈Kk\in Kk∈K a set SkS_kSk​ of at least two paths, each a nonempty set of arcs; every arc lies on some path. A game Γ=(τ,d)\Gamma=(\tau,d)Γ=(τ,d) consists of arc cost functions τa\tau_aτa​, continuous, non-decreasing and non-negative on [0,∞)[0,\infty)[0,∞), and demands dk≥0d_k\ge 0dk​≥0 with total demand T(d)=∑kdk>0T(d)=\sum_k d_k>0T(d)=∑k​dk​>0; moreover τa(x)>0\tau_a(x)>0τa​(x)>0 for x∈(0,T(d)]x\in(0,T(d)]x∈(0,T(d)]. These games form the game space G(G,K,S)\mathcal G(G,K,S)G(G,K,S).

A flow f=(fs)s∈S≥0f=(f_s)_{s\in S}\ge 0f=(fs​)s∈S​≥0 routes each demand, ∑s∈Skfs=dk\sum_{s\in S_k} f_s=d_k∑s∈Sk​​fs​=dk​. The arc flow is fa=∑s∋afsf_a=\sum_{s\ni a} f_sfa​=∑s∋a​fs​, the path cost τs(f)=∑a∈sτa(fa)\tau_s(f)=\sum_{a\in s}\tau_a(f_a)τs​(f)=∑a∈s​τa​(fa​), and the total cost C(Γ,f)=∑afaτa(fa)C(\Gamma,f)=\sum_a f_a\tau_a(f_a)C(Γ,f)=∑a​fa​τa​(fa​). A flow f~\tilde ff~​ is a Wardrop equilibrium (WE) if every used path of a pair is a cheapest path of that pair. The SO cost C∗(Γ)C^*(\Gamma)C∗(Γ) is the minimum total cost, the WE cost C~(Γ)\tilde C(\Gamma)C~(Γ) is the total cost of a WE flow (all WE flows have the same cost), and the PoA is

ρ(Γ)=C~(Γ)C∗(Γ).\rho(\Gamma)=\frac{\tilde C(\Gamma)}{C^*(\Gamma)}.ρ(Γ)=C∗(Γ)C~(Γ)​.

The distance of two games Γ=(τ,d)\Gamma=(\tau,d)Γ=(τ,d) and Γ′=(σ,d′)\Gamma'=(\sigma,d')Γ′=(σ,d′) is

∥Γ−Γ′∥=max⁡{∥d−d′∥∞, max⁡a∈Amax⁡x∈[0,min⁡{T(d),T(d′)}]∣τa(x)−σa(x)∣, ∥τ(T(d))−σ(T(d′))∥∞},\|\Gamma-\Gamma'\|=\max\Big\{\|d-d'\|_\infty,\ \max_{a\in A}\max_{x\in[0,\min\{T(d),T(d')\}]}|\tau_a(x)-\sigma_a(x)|,\ \|\tau(T(d))-\sigma(T(d'))\|_\infty\Big\},∥Γ−Γ′∥=max{∥d−d′∥∞​, a∈Amax​x∈[0,min{T(d),T(d′)}]max​∣τa​(x)−σa​(x)∣, ∥τ(T(d))−σ(T(d′))∥∞​},

which compares cost functions only on the range both games use, plus their values at the respective total demands.

Formalization targets

Goal: Theorem 12

Let Γ=(τ,d)∈G(G,K,S)\Gamma=(\tau,d)\in\mathcal G(G,K,S)Γ=(τ,d)∈G(G,K,S).

  1. If every τa\tau_aτa​ is constant on [0,T(d)][0,T(d)][0,T(d)], or
  2. if every τa\tau_aτa​ is continuously differentiable on [0,T(d)][0,T(d)][0,T(d)] with τa′≥mΓ>0\tau_a'\ge m_\Gamma>0τa′​≥mΓ​>0 there,

then there are ϵΓ>0\epsilon_\Gamma>0ϵΓ​>0 and κΓ>0\kappa_\Gamma>0κΓ​>0 such that

∣ρ(Γ)−ρ(Γ′)∣≤κΓ⋅∥Γ−Γ′∥for all Γ′∈G(G,K,S) with ∥Γ−Γ′∥<ϵΓ.|\rho(\Gamma)-\rho(\Gamma')|\le\kappa_\Gamma\cdot\|\Gamma-\Gamma'\|\qquad\text{for all }\Gamma'\in\mathcal G(G,K,S)\text{ with }\|\Gamma-\Gamma'\|<\epsilon_\Gamma.∣ρ(Γ)−ρ(Γ′)∣≤κΓ​⋅∥Γ−Γ′∥for all Γ′∈G(G,K,S) with ∥Γ−Γ′∥<ϵΓ​.

The goal leaves the constants unspecified; only their existence, depending on Γ\GammaΓ alone, is asserted.

Milestones

  • Proof of Theorem 12a), p. 37. A game whose costs are constant on [0,T(d)][0,T(d)][0,T(d)] has ρ(Γ)=1\rho(\Gamma)=1ρ(Γ)=1.
  • (4.33), p. 37. Near such a game, 0≤ρ(Γ′)−ρ(Γ)≤8 ∣A∣ T(d) (∣K∣+1)C∗(Γ)∥Γ−Γ′∥0\le\rho(\Gamma')-\rho(\Gamma)\le\frac{8\,|A|\,T(d)\,(|K|+1)}{C^*(\Gamma)}\|\Gamma-\Gamma'\|0≤ρ(Γ′)−ρ(Γ)≤C∗(Γ)8∣A∣T(d)(∣K∣+1)​∥Γ−Γ′∥.
  • (4.39), p. 38. For WE flows f~,g~\tilde f,\tilde gf~​,g~​ of two games Γ1=(π1,w)\Gamma_1=(\pi^1,w)Γ1​=(π1,w), Γ2=(π2,w)\Gamma_2=(\pi^2,w)Γ2​=(π2,w) with equal demands,
0≤∑a(πa1(f~a)−πa2(g~a))(g~a−f~a)≤∑a(πa1(g~a)−πa2(f~a))(g~a−f~a)≤2∣A∣ T(w) ∥Γ1−Γ2∥.0\le\sum_a(\pi^1_a(\tilde f_a)-\pi^2_a(\tilde g_a))(\tilde g_a-\tilde f_a)\le\sum_a(\pi^1_a(\tilde g_a)-\pi^2_a(\tilde f_a))(\tilde g_a-\tilde f_a)\le 2|A|\,T(w)\,\|\Gamma_1-\Gamma_2\|.0≤a∑​(πa1​(f~​a​)−πa2​(g~​a​))(g~​a​−f~​a​)≤a∑​(πa1​(g~​a​)−πa2​(f~​a​))(g~​a​−f~​a​)≤2∣A∣T(w)∥Γ1​−Γ2​∥.
  • (4.40), p. 38, first four inequalities. If moreover the costs of Γ1\Gamma_1Γ1​ are C1C^1C1 on [0,T(w)][0,T(w)][0,T(w)] with derivative ≥m>0\ge m>0≥m>0, then
m∑a∣g~a−f~a∣2≤∑a(πa1(g~a)−πa1(f~a))(g~a−f~a)≤∑a(πa1(g~a)−πa2(g~a))(g~a−f~a)≤∥Γ1−Γ2∥∑a∣g~a−f~a∣.m\sum_a|\tilde g_a-\tilde f_a|^2\le\sum_a(\pi^1_a(\tilde g_a)-\pi^1_a(\tilde f_a))(\tilde g_a-\tilde f_a)\le\sum_a(\pi^1_a(\tilde g_a)-\pi^2_a(\tilde g_a))(\tilde g_a-\tilde f_a)\le\|\Gamma_1-\Gamma_2\|\sum_a|\tilde g_a-\tilde f_a|.ma∑​∣g~​a​−f~​a​∣2≤a∑​(πa1​(g~​a​)−πa1​(f~​a​))(g~​a​−f~​a​)≤a∑​(πa1​(g~​a​)−πa2​(g~​a​))(g~​a​−f~​a​)≤∥Γ1​−Γ2​∥a∑​∣g~​a​−f~​a​∣.

Significance

At a general game with Lipschitz costs the PoA is only Hölder continuous with exponent 1/21/21/2 in this metric, and the paper shows that no exponent works uniformly over the game space. Theorem 12 identifies two natural classes of games at which the sensitivity is linear: constant costs (the PoA equals 111 and grows at most linearly under perturbation) and strictly increasing C1C^1C1 costs, which include affine costs with positive slopes. For these games an estimation error of size δ\deltaδ in demands and costs changes the PoA by O(δ)O(\delta)O(δ).

The result is proved in the paper; it is not formalized anywhere. A complete development would also provide machine-checked equilibrium-comparison estimates between two games of one demand slice ((4.39)–(4.40)), which are reusable for any stability analysis of Wardrop equilibria. The paper's explicit constants in (4.41)–(4.46) are off by a factor ∣A∣\sqrt{|A|}∣A∣​ (the last step of (4.40) uses ∑a∣xa∣≤∑axa2\sum_a|x_a|\le\sqrt{\sum_a x_a^2}∑a​∣xa​∣≤∑a​xa2​​); the existential Theorem 12 is unaffected, and a formalization with correct explicit constants is a welcome addition.

Difficulty

The PoA is a ratio of two optimal values, and the perturbed game Γ′\Gamma'Γ′ may change the demand vector and the costs at once, including the costs on (T(d),T(d′)](T(d),T(d')](T(d),T(d′)], which Γ\GammaΓ's hypotheses do not control. A direct comparison of Γ\GammaΓ and Γ′\Gamma'Γ′ therefore fails: the WE flows live in different feasible sets, and the hypotheses on Γ\GammaΓ say nothing beyond T(d)T(d)T(d). The general Hölder-1/21/21/2 argument loses a square root exactly where it bounds the distance between the arc flows of the two equilibria through an approximate-equilibrium estimate; obtaining exponent 111 requires an estimate in which the flow difference enters linearly, and this is where strict monotonicity of the costs is needed. Constant costs are degenerate in the opposite direction: the WE is far from unique, and only costs, not flows, can be compared.

Formalization scope

The model follows §2–§3.2 of the paper and reuses the published definition KellyStochasticNetworks_Wardrop for arc flows, feasibility and the Wardrop condition. Paths are nonempty 0/10/10/1 incidence columns (a generalization of loop-free paths that the proofs do not use); KKK is nonempty and Condition 1 is standing (∣Sk∣≥2|S_k|\ge 2∣Sk​∣≥2, every arc on a path). Costs are functions R→R\mathbb R\to\mathbb RR→R constrained on [0,∞)[0,\infty)[0,∞) only. C∗C^*C∗ is an infimum over all flows, C~\tilde CC~ a supremum over WE flows, ρ=C~/C∗\rho=\tilde C/C^*ρ=C~/C∗; the distance is (3.3) with the sup norm on demand and endpoint vectors and a supremum over the compact set A×[0,min⁡{T(d),T(d′)}]A\times[0,\min\{T(d),T(d')\}]A×[0,min{T(d),T(d′)}]. The derivative in Theorem 12b) is derivWithin on [0,T(d)][0,T(d)][0,T(d)], one-sided at the endpoints, and C1C^1C1 is ContDiffOn ℝ 1 on that interval.

Every statement quantifies over games in the game space only: off it, ρ\rhoρ would be a junk ratio such as 0/0=00/0=00/0=0. The paper prints the conclusions of Theorem 12 and (4.33) with a strict inequality, which fails at Γ′=Γ\Gamma'=\GammaΓ′=Γ; the non-strict form is posed, and no hypothesis Γ′≠Γ\Gamma'\neq\GammaΓ′=Γ is added (distinct games can have distance 000). Milestones (4.39) and (4.40) are posed for two arbitrary games of one demand slice, the general form of the paper's step for its auxiliary game.

A complete development needs existence of SO and WE flows on the game space, the variational characterization of Wardrop equilibria, the mean value theorem on a closed interval with one-sided derivatives, and continuity of C∗C^*C∗ in the metric; contributions of any of these as separate lemmas are welcome. The source is the arXiv preprint v3; the published Mathematics of Operations Research version is not the cited artifact.

Selected references

  • Z. Wu, R. H. Möhring, A sensitivity analysis of the price of anarchy in non-atomic congestion games, Mathematics of Operations Research 48(3), 2023; cited as arXiv:2007.13979v3, 2021. https://arxiv.org/abs/2007.13979v3
  • T. Roughgarden, É. Tardos, How bad is selfish routing?, Journal of the ACM 49(2), 2002. https://doi.org/10.1145/506147.506153
  • J. R. Correa, A. S. Schulz, N. E. Stier-Moses, Selfish routing in capacitated networks, Mathematics of Operations Research 29(4), 2004. https://doi.org/10.1287/moor.1040.0098
  • R. Cominetti, V. Dose, M. Scarsini, The price of anarchy in routing games as a function of the demand, arXiv:1907.10101v2, 2020. https://arxiv.org/abs/1907.10101
  • J. G. Wardrop, Some theoretical aspects of road traffic research, Proceedings of the Institution of Civil Engineers 1(3), 1952. https://doi.org/10.1680/ipeds.1952.11259
8 thms2 active usersReviewed
Algorithmic Game TheoryAnalysisOptimization·Captain: mikedeng1

A Sensitivity Analysis of the Price of Anarchy in Nonatomic Congestion Games 1: The Price of Anarchy Is Hölder Continuous with Exponent 1/2 at Every Game with Costs Lipschitz on [0, T(d)]Research Paper

Motivation

The price of anarchy (PoA) of a nonatomic congestion game is the ratio of the total cost of a Wardrop equilibrium to the minimum possible total cost. It quantifies how much selfish routing loses compared with central coordination, and it has been studied intensively since Koutsoupias and Papadimitriou (1999) and Roughgarden and Tardos (2002), mostly through worst-case bounds over classes of cost functions.

Worst-case bounds say nothing about how the PoA of one particular network behaves when its data change. In transport applications both the cost functions (capacities, tolls, travel-time models) and the demands are estimated, so the PoA is only useful if small errors in the data cause small errors in the PoA. Wu and Möhring (arXiv:2007.13979, published in Mathematics of Operations Research, 2023) study this sensitivity question in a setting where cost functions and demands change simultaneously. Earlier sensitivity results changed only the demands, with the cost functions fixed: Englert, Franke and Olbrich (2010) bounded the growth of the PoA of a single-O/D network with polynomial costs of degree at most β\betaβ by a factor (1+ϵ)β(1+\epsilon)^\beta(1+ϵ)β when the demand grows by a factor 1+ϵ1+\epsilon1+ϵ; Takalloo and Kwon (2020) extended this to several O/D pairs whose demands are scaled together; and Cominetti, Dose and Scarsini (arXiv:1907.10101) studied differentiability of the PoA as a function of the demand of a single O/D pair. The main theorem of the paper, Theorem 9, is the subject of this mission.

Setting

A network consists of a finite set AAA of arcs, a finite non-empty set K\mathcal KK of origin–destination (O/D) pairs, and for every k∈Kk \in \mathcal Kk∈K a non-empty set Sk\mathcal S_kSk​ of paths; each path is a non-empty set of arcs. From §3.1 onward the paper also assumes every arc lies on some path and every Sk\mathcal S_kSk​ has at least two paths (Condition 1).

A game Γ=(τ,d)\Gamma = (\tau, d)Γ=(τ,d) on the network consists of cost functions τa:[0,∞)→[0,∞)\tau_a : [0,\infty) \to [0,\infty)τa​:[0,∞)→[0,∞), one per arc, that are continuous and non-decreasing, and demands dk≥0d_k \ge 0dk​≥0, one per O/D pair. The total demand is T(d)=∑kdkT(d) = \sum_k d_kT(d)=∑k​dk​. The game space G(G,K,S)\mathcal G(G,\mathcal K,\mathcal S)G(G,K,S) consists of the games with T(d)>0T(d) > 0T(d)>0 and τa(x)>0\tau_a(x) > 0τa​(x)>0 for all x∈(0,T(d)]x \in (0, T(d)]x∈(0,T(d)].

A flow f=(fs)f = (f_s)f=(fs​) assigns a non-negative amount to every path, with ∑s∈Skfs=dk\sum_{s\in\mathcal S_k} f_s = d_k∑s∈Sk​​fs​=dk​. Its arc flows are fa=∑s∋afsf_a = \sum_{s \ni a} f_sfa​=∑s∋a​fs​, its path costs τs(f)=∑a∈sτa(fa)\tau_s(f) = \sum_{a\in s}\tau_a(f_a)τs​(f)=∑a∈s​τa​(fa​), and its total cost

C(Γ,f)=∑a∈Afa τa(fa).C(\Gamma, f) = \sum_{a\in A} f_a\,\tau_a(f_a).C(Γ,f)=a∈A∑​fa​τa​(fa​).

A Wardrop equilibrium (WE) is a flow in which every used path of a pair is a cheapest path of that pair. The SO cost C∗(Γ)\mathcal C^*(\Gamma)C∗(Γ) is the minimum total cost over all flows, the WE cost C~(Γ)\tilde{\mathcal C}(\Gamma)C~(Γ) is the total cost of a WE flow (all WE flows have the same cost), and

ρ(Γ)=C~(Γ)C∗(Γ).\rho(\Gamma) = \frac{\tilde{\mathcal C}(\Gamma)}{\mathcal C^*(\Gamma)}.ρ(Γ)=C∗(Γ)C~(Γ)​.

Games are compared by the distance

∥Γ−Γ′∥=max⁡{∥d−d′∥∞, max⁡a∈Amax⁡x∈[0,min⁡{T(d),T(d′)}]∣τa(x)−σa(x)∣, ∥τ(T(d))−σ(T(d′))∥∞}\|\Gamma - \Gamma'\| = \max\Big\{\|d-d'\|_\infty,\ \max_{a\in A}\max_{x\in[0,\min\{T(d),T(d')\}]}|\tau_a(x) - \sigma_a(x)|,\ \|\tau(T(d)) - \sigma(T(d'))\|_\infty\Big\}∥Γ−Γ′∥=max{∥d−d′∥∞​, a∈Amax​x∈[0,min{T(d),T(d′)}]max​∣τa​(x)−σa​(x)∣, ∥τ(T(d))−σ(T(d′))∥∞​}

for Γ=(τ,d)\Gamma = (\tau, d)Γ=(τ,d) and Γ′=(σ,d′)\Gamma' = (\sigma, d')Γ′=(σ,d′). It compares cost functions only on the range of flow values both games can produce, plus the values at the respective total demands. A function hhh is Lipschitz continuous on [0,T][0,T][0,T] with constant MMM if ∣h(x)−h(y)∣≤M∣x−y∣|h(x) - h(y)| \le M|x-y|∣h(x)−h(y)∣≤M∣x−y∣ for all x,y∈[0,T]x, y \in [0,T]x,y∈[0,T].

Formalization targets

Goal: Theorem 9 (p. 26)

Let Γ=(τ,d)\Gamma = (\tau, d)Γ=(τ,d) be a game of the game space whose cost functions are Lipschitz continuous on [0,T(d)][0, T(d)][0,T(d)]. Then there are ϵΓ>0\epsilon_\Gamma > 0ϵΓ​>0 and κΓ>0\kappa_\Gamma > 0κΓ​>0, depending only on Γ\GammaΓ, such that

∣ρ(Γ)−ρ(Γ′)∣≤κΓ ∥Γ−Γ′∥1/2for every game Γ′ of the game space with ∥Γ−Γ′∥<ϵΓ.|\rho(\Gamma) - \rho(\Gamma')| \le \kappa_\Gamma\,\|\Gamma - \Gamma'\|^{1/2}\quad\text{for every game } \Gamma' \text{ of the game space with } \|\Gamma - \Gamma'\| < \epsilon_\Gamma.∣ρ(Γ)−ρ(Γ′)∣≤κΓ​∥Γ−Γ′∥1/2for every game Γ′ of the game space with ∥Γ−Γ′∥<ϵΓ​.

The goal fixes the exponent 1/21/21/2 and leaves the radius and the constant existential, which is the form the paper claims.

Milestones

  1. Lemma 1a)–c) (p. 13): properties of ϵ\epsilonϵ-approximate WE flows, ending with
∣C(Γ,f)−C(Γ,f~)∣≤∣A∣Mϵ T(d)+ϵ|C(\Gamma, f) - C(\Gamma, \tilde f)| \le |A|\sqrt{M\epsilon}\,T(d) + \epsilon∣C(Γ,f)−C(Γ,f~​)∣≤∣A∣Mϵ​T(d)+ϵ

for an ϵ\epsilonϵ-approximate WE flow fff and a WE flow f~\tilde ff~​ when all costs are MMM-Lipschitz on [0,T(d)][0,T(d)][0,T(d)]. 2. Lemma 10a)–d) (p. 27): on a demand slice (games with a common demand vector www), C∗\mathcal C^*C∗ is Lipschitz, WE flows of one game are ∣A∣ T(w) ∥Γ1−Γ2∥|A|\,T(w)\,\|\Gamma_1-\Gamma_2\|∣A∣T(w)∥Γ1​−Γ2​∥-approximate WE flows of the other, and C~\tilde{\mathcal C}C~ and ρ\rhoρ are Hölder with exponent 1/21/21/2 with explicit constants. 3. Lemma 11a)–c) (p. 31): on a cost slice (games with a common cost vector and T(w′)≤T(w)T(w') \le T(w)T(w′)≤T(w)), explicit Hölder bounds of exponent 1/21/21/2 for C~\tilde{\mathcal C}C~ and ρ\rhoρ and a Lipschitz bound for C∗\mathcal C^*C∗.

Significance

Theorem 9 is the first pointwise Hölder continuity result for the PoA on the whole game space, with demands and costs perturbed together. Its hypothesis is mild (Lipschitz costs on a compact interval, which covers polynomial, BPR-type and piecewise linear costs), and such games are dense in the game space. Together with Theorem 8 of the same paper, which shows that no uniform Hölder bound exists, it describes exactly what kind of stability the PoA has: local, with a constant depending on the game, and exponent 1/21/21/2 in general. The explicit constants of Lemmas 10 and 11 give computable error bounds for the PoA of a network whose data are known only approximately.

The result is proved in the paper; no machine-checked proof exists. This mission formalizes the statement and the explicit slice estimates the proof rests on. Lemma 1 is a self-contained statement about approximate Wardrop equilibria that is useful well beyond this paper, for instance for analysing iterative traffic-assignment algorithms, which only ever produce approximate equilibria.

Difficulty

The obvious approach compares an equilibrium of Γ\GammaΓ with an equilibrium of Γ′\Gamma'Γ′ directly. This fails because the two games have different demand vectors, so their flows live in different polytopes: an equilibrium of one game is not even a flow of the other. The paper separates the perturbation into a change of costs at fixed demand and a change of demand at fixed costs, through an auxiliary game, and each half needs its own argument. On a demand slice an equilibrium of one game is only an approximate equilibrium of the other, and the passage from an approximate equilibrium to its cost loses a square root (Lemma 1c), which is tight by Example 2). On a cost slice the demand has to be removed path by path from an equilibrium while keeping it an equilibrium of a shifted game. Finally, the constants of the slice estimates depend on the auxiliary game, and they must be controlled uniformly near Γ\GammaΓ.

Formalization scope

The Lean development fixes the following conventions.

  • The network is a structure with ∣A∣|A|∣A∣ arcs, ∣S∣|\mathcal S|∣S∣ paths and ∣K∣|\mathcal K|∣K∣ O/D pairs, a 0/1 arc–path incidence matrix and the map sending a path to its pair. Lemma 1 uses the §2 model assumptions: 0/1 incidence, non-empty paths, K≠∅\mathcal K \neq \emptysetK=∅, and ∣Sk∣≥1|\mathcal S_k| \ge 1∣Sk​∣≥1. The later results add Condition 1 (every arc on a path, ∣Sk∣≥2|\mathcal S_k| \ge 2∣Sk​∣≥2), as assumed from §3.1. Paths are arbitrary non-empty 0/1 columns, not necessarily loop-free paths of a digraph; the results do not use loop-freeness.
  • Cost functions are maps R→R\mathbb R \to \mathbb RR→R required to be continuous, non-decreasing and non-negative on [0,∞)[0,\infty)[0,∞) only.
  • Arc flows, Wardrop equilibria (2.1) and the potential (2.6) come from the published definition KellyStochasticNetworks_Wardrop. ϵ\epsilonϵ-approximate WE flows follow (2.7) in arc form. The total cost uses the arc form, which equals the path form for 0/1 incidence.
  • C∗\mathcal C^*C∗ is the infimum of costs over flows, C~\tilde{\mathcal C}C~ the supremum of costs over WE flows, ρ\rhoρ their quotient. The middle term of the distance is the supremum of the image of the compact set A×[0,min⁡{T(d),T(d′)}]A\times[0,\min\{T(d),T(d')\}]A×[0,min{T(d),T(d′)}], and ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ is the sup norm.
  • Every statement about ρ\rhoρ, C∗\mathcal C^*C∗ or C~\tilde{\mathcal C}C~ quantifies over games of the game space, where ρ\rhoρ is a genuine ratio of positive numbers. Off the game space Lean's division by zero would give ρ=0\rho = 0ρ=0, so quantifying over all pairs (τ,d)(\tau, d)(τ,d) would trivialize the statements; this is ruled out. In the goal, ϵΓ\epsilon_\GammaϵΓ​ and κΓ\kappa_\GammaκΓ​ are chosen before Γ′\Gamma'Γ′.
  • Several printed strict inequalities are posed as non-strict, because they fail at Γ′=Γ\Gamma' = \GammaΓ′=Γ or are attained in the paper's own Example 2. In Lemma 11 the printed constants are corrected by a factor ∣K∣|\mathcal K|∣K∣ that the paper's own argument needs; each item's Formalization Note quotes the printed form.

A complete development needs: existence of Wardrop equilibria and uniqueness of their cost on the game space, existence of social optima, the integral inequality (2.9) for monotone costs, positivity of C∗\mathcal C^*C∗ on the game space, and the path-by-path demand-reduction construction of Lemma 11. The existence and uniqueness results and Lemma 1 are reusable in any formalization of selfish routing. Proofs of any milestone are welcome, as are the supporting lemmas above.

The source is the arXiv preprint arXiv:2007.13979v3 (23 Aug 2021); all page and theorem numbers refer to it, not to the published version.

Selected references

  • Z. Wu, R. H. Möhring, A sensitivity analysis of the price of anarchy in non-atomic congestion games, arXiv:2007.13979v3, 2021; Mathematics of Operations Research 48(3), 2023. https://arxiv.org/abs/2007.13979, https://doi.org/10.1287/moor.2022.1292
  • T. Roughgarden, É. Tardos, How bad is selfish routing?, Journal of the ACM 49(2), 2002. https://doi.org/10.1145/506147.506153
  • E. Koutsoupias, C. Papadimitriou, Worst-case equilibria, STACS 1999. https://doi.org/10.1007/3-540-49116-3_38
  • J. G. Wardrop, Some theoretical aspects of road traffic research, Proceedings of the Institution of Civil Engineers 1(3), 1952. https://doi.org/10.1680/ipeds.1952.11259
  • M. Englert, T. Franke, L. Olbrich, Sensitivity of Wardrop equilibria, Theory of Computing Systems 47(1):3–14, 2010.
  • M. Takalloo, C. Kwon, Sensitivity of Wardrop equilibria: revisited, Optimization Letters 14(3):781–796, 2020.
  • R. Cominetti, V. Dose, M. Scarsini, The price of anarchy in routing games as a function of the demand, 2020. https://arxiv.org/abs/1907.10101
13 thms2 active usersReviewed
Algorithmic Game TheoryOptimization·Captain: mikedeng1

A Sensitivity Analysis of the Price of Anarchy in Nonatomic Congestion Games 4: The Price of Anarchy Is Not Uniformly Hölder Continuous and No Game Has the Whole Space as a Hölder NeighborhoodResearch Paper

Motivation

The price of anarchy (PoA) of a nonatomic congestion game measures how much total cost is lost when a continuum of selfish users routes traffic instead of a central planner. Worst-case bounds on the PoA over classes of cost functions are classical: 4/34/34/3 for affine costs and Θ(β/ln⁡β)\Theta(\beta/\ln\beta)Θ(β/lnβ) for polynomial costs of degree at most β\betaβ (Roughgarden and Tardos 2002; Roughgarden 2003). Worst-case bounds say nothing about how the PoA of one particular instance reacts when its demands and cost functions are perturbed, which is what matters when traffic data are measured with error or change over time.

Z. Wu and R. H. Möhring (arXiv:2007.13979v3, published in Mathematics of Operations Research, 2023) study this sensitivity through Hölder continuity of the PoA map Γ↦ρ(Γ)\Gamma \mapsto \rho(\Gamma)Γ↦ρ(Γ) on a metric space of games. Earlier work considered changes of the demand alone: Englert et al. (2010), Takalloo and Kwon (2020) and Cominetti et al. (2020), as cited in the paper, fix the cost functions and vary the demand. Wu and Möhring vary both. Their main positive results are local: Hölder continuity with exponent 1/21/21/2 near every game with Lipschitz costs. This mission formalizes their negative result, Theorem 8, which says that no global version of this regularity is possible.

Setting

Fix a network with arcs AAA, a non-empty finite set KKK of origin–destination (O/D) pairs, and for each pair kkk a set SkS_kSk​ of paths, each a non-empty set of arcs, with ∣Sk∣≥2|S_k| \ge 2∣Sk​∣≥2 and every arc on some path (Condition 1). A game Γ=(τ,d)\Gamma = (\tau, d)Γ=(τ,d) consists of cost functions τa\tau_aτa​, continuous, non-decreasing and non-negative on [0,∞)[0,\infty)[0,∞), and demands dk≥0d_k \ge 0dk​≥0 with total demand T(d)=∑kdkT(d) = \sum_k d_kT(d)=∑k​dk​. The game space G(G,K,S)\mathcal G(G,K,S)G(G,K,S) consists of the games with T(d)>0T(d) > 0T(d)>0 and τa(x)>0\tau_a(x) > 0τa​(x)>0 for x∈(0,T(d)]x \in (0, T(d)]x∈(0,T(d)] (Condition 2).

A flow splits each dkd_kdk​ non-negatively over SkS_kSk​; its arc flows are fa=∑s∋afsf_a = \sum_{s \ni a} f_sfa​=∑s∋a​fs​ and its total cost is C(Γ,f)=∑afaτa(fa)C(\Gamma, f) = \sum_a f_a \tau_a(f_a)C(Γ,f)=∑a​fa​τa​(fa​). A Wardrop equilibrium (WE) is a flow in which every used path of a pair has minimal cost among the paths of that pair. With C∗(Γ)C^*(\Gamma)C∗(Γ) the minimum total cost and C~(Γ)\tilde C(\Gamma)C~(Γ) the total cost of a WE flow,

ρ(Γ)=C~(Γ)C∗(Γ).\rho(\Gamma) = \frac{\tilde C(\Gamma)}{C^*(\Gamma)}.ρ(Γ)=C∗(Γ)C~(Γ)​.

The distance of two games Γ=(τ,d)\Gamma = (\tau, d)Γ=(τ,d), Γ′=(σ,d′)\Gamma' = (\sigma, d')Γ′=(σ,d′) is

∥Γ−Γ′∥=max⁡{∥d−d′∥∞, max⁡a, x∈[0,min⁡{T(d),T(d′)}]∣τa(x)−σa(x)∣, ∥τ(T(d))−σ(T(d′))∥∞}.\|\Gamma - \Gamma'\| = \max\Big\{\|d - d'\|_\infty,\ \max_{a,\ x \in [0, \min\{T(d),T(d')\}]} |\tau_a(x) - \sigma_a(x)|,\ \|\tau(T(d)) - \sigma(T(d'))\|_\infty\Big\}.∥Γ−Γ′∥=max{∥d−d′∥∞​, a, x∈[0,min{T(d),T(d′)}]max​∣τa​(x)−σa​(x)∣, ∥τ(T(d))−σ(T(d′))∥∞​}.

The cost normalization Ψυ(τ,d)=(τ/υ,d)\Psi_\upsilon(\tau, d) = (\tau/\upsilon, d)Ψυ​(τ,d)=(τ/υ,d), υ>0\upsilon > 0υ>0, divides all costs by υ\upsilonυ. A γ\gammaγ-neighborhood of Γ\GammaΓ is an open set U∋ΓU \ni \GammaU∋Γ of games on which ∣ρ(Γ)−ρ(Γ′)∣≤ϰΓ∥Γ−Γ′∥γ|\rho(\Gamma) - \rho(\Gamma')| \le \varkappa_\Gamma \|\Gamma - \Gamma'\|^\gamma∣ρ(Γ)−ρ(Γ′)∣≤ϰΓ​∥Γ−Γ′∥γ for some constant ϰΓ>0\varkappa_\Gamma > 0ϰΓ​>0.

Formalization targets

Goal: Theorem 8b)

For every game Γ∈G(G,K,S)\Gamma \in \mathcal G(G,K,S)Γ∈G(G,K,S) and every γ>0\gamma > 0γ>0,

¬ ∃ ϰ>0  ∀Γ′∈G(G,K,S): ∣ρ(Γ)−ρ(Γ′)∣≤ϰ ∥Γ−Γ′∥γ,\neg\,\exists\, \varkappa > 0\ \ \forall \Gamma' \in \mathcal G(G,K,S):\ |\rho(\Gamma) - \rho(\Gamma')| \le \varkappa\, \|\Gamma - \Gamma'\|^\gamma,¬∃ϰ>0  ∀Γ′∈G(G,K,S): ∣ρ(Γ)−ρ(Γ′)∣≤ϰ∥Γ−Γ′∥γ,

that is, the whole game space is never a γ\gammaγ-neighborhood: Hölder continuity of ρ\rhoρ holds at best locally, even with a constant depending on the game.

Milestones

  1. ρ(Ψυ(Γ))=ρ(Γ)\rho(\Psi_\upsilon(\Gamma)) = \rho(\Gamma)ρ(Ψυ​(Γ))=ρ(Γ) for υ>0\upsilon > 0υ>0 (§3.5).
  2. ∥Ψυ(Γ)−Ψυ(Γ′)∥=∥Γ−Γ′∥/υ\|\Psi_\upsilon(\Gamma) - \Psi_\upsilon(\Gamma')\| = \|\Gamma - \Gamma'\|/\upsilon∥Ψυ​(Γ)−Ψυ​(Γ′)∥=∥Γ−Γ′∥/υ when d=d′d = d'd=d′ (3.11).
  3. Some demand vector carries two games with different PoA (p. 24).
  4. Theorem 8a): no γ>0\gamma > 0γ>0, ϰ>0\varkappa > 0ϰ>0 make ρ\rhoρ uniformly Hölder continuous on G(G,K,S)\mathcal G(G,K,S)G(G,K,S).
  5. ρ\rhoρ is unbounded on the demand slice {Γ′:d′=d}\{\Gamma' : d' = d\}{Γ′:d′=d} whenever ddd is supported on a single O/D pair (p. 25, corrected; see below).

Significance

Theorem 8 separates what can be proved about the sensitivity of the PoA from what cannot. Part a) rules out uniform Hölder (in particular Lipschitz) bounds; part b) rules out global bounds even with a game-dependent constant. Together they explain the shape of the paper's positive results (Theorems 9 and 12), which hold on balls around a game with constants that depend on that game.

The result is proved in the paper; no machine-checked version exists. Formalizing it fixes the exact hypotheses under which it holds. Two are not visible on the page: paths must form an antichain (otherwise ρ≡1\rho \equiv 1ρ≡1 is possible), and the unboundedness step of part b) does not hold on every demand slice. The milestones on cost normalizations are reusable for any scale-invariance argument about the PoA.

Difficulty

The invariance and scaling milestones are bookkeeping about suprema and infima. The substance is in the constructions. For 8a), two games with equal demands and different PoA are needed, which requires an explicit game whose Wardrop equilibrium is strictly inefficient on an arbitrary network satisfying Condition 1 and the antichain condition, so the WE cost and the SO cost must be computed or bounded, not just estimated asymptotically.

For 8b), the paper argues that a global Hölder bound makes ρ\rhoρ bounded on the demand slice of Γ\GammaΓ, and that ρ\rhoρ is unbounded there because the slice contains Pigou-like games. The second step fails in general: with several O/D pairs, other pairs can be forced through the arcs that distinguish the paths of every pair, and on such a slice ρ\rhoρ can be bounded (an explicit three-pair network with ρ≤5/2\rho \le 5/2ρ≤5/2 on the slice d=(1,1,1)d = (1,1,1)d=(1,1,1) is recorded in the milestone). The natural repair compares Γ\GammaΓ with games on a different slice, whose demand sits on one pair, and requires bounding the distance between games with different demands as the costs are normalized away.

Formalization scope

Lean represents paths as 0/10/10/1 columns of an arc–path incidence matrix and pairs as a map from paths to pairs, on top of the published KellyStochasticNetworks_Wardrop definitions (arc flows, feasible flows, Wardrop's first principle). The commitments are:

  • the standing assumptions are G1–G2 (non-empty KKK, non-empty paths), 0/10/10/1 incidences and Condition 1;
  • the antichain condition (no path of a pair inside another path of the same pair) is an added hypothesis of every theorem. It holds for loop-free paths of a digraph, which the paper assumes;
  • costs are real functions whose properties are required on [0,∞)[0,\infty)[0,∞) only;
  • C∗C^*C∗ is an infimum over all flows and C~\tilde CC~ a supremum over WE flows. All WE flows have the same cost;
  • the distance uses the sup norm and a supremum over the compact set A×[0,min⁡{T(d),T(d′)}]A \times [0, \min\{T(d),T(d')\}]A×[0,min{T(d),T(d′)}];
  • powers are real powers with γ>0\gamma > 0γ>0.

Every game in every statement ranges over the game space. A formalization quantifying over arbitrary pairs (τ,d)(\tau, d)(τ,d) would be trivial: Lean's 0/0=00/0 = 00/0=0 gives such pairs ρ=0\rho = 0ρ=0, and a junk game next to a real one breaks any Hölder bound for free.

The unboundedness milestone is posed for single-pair demand slices instead of the page's arbitrary slice, because the page's version is false for some multi-pair networks. Its asymptotic rate Θ(β/ln⁡β)\Theta(\beta/\ln\beta)Θ(β/lnβ) is cited by the paper and not posed. Contributions of the two constructions (a strictly inefficient game for 8a, Pigou-type games on one pair for 8b) and of the distance estimates are welcome; related Pigou statements exist as SelfishRouting.Linear.figure_3_pigou (Roughgarden–Tardos).

The source is the arXiv preprint v3; the published MOR version is not the cited artifact.

Selected references

  • Z. Wu, R. H. Möhring, A sensitivity analysis of the price of anarchy in nonatomic congestion games, Mathematics of Operations Research 48(3), 2023; cited as arXiv:2007.13979v3 (2021). https://arxiv.org/abs/2007.13979v3
  • T. Roughgarden, É. Tardos, How bad is selfish routing?, Journal of the ACM 49(2), 2002. https://doi.org/10.1145/506147.506153
  • T. Roughgarden, The price of anarchy is independent of the network topology, Journal of Computer and System Sciences 67(2), 2003. https://doi.org/10.1016/S0022-0000(03)00044-8
8 thms2 active usersReviewed
Algorithmic Game TheoryOptimization·Captain: mikedeng1

A Sensitivity Analysis of the Price of Anarchy in Nonatomic Congestion Games 5: For Small Total Demand the Price of Anarchy Exceeds 1 by at Most an Explicit Multiple of the Total DemandResearch Paper

Motivation

The price of anarchy (PoA) of a nonatomic congestion game is the ratio between the total travel cost at a Wardrop equilibrium, where every traveller uses a cheapest route, and the minimum total cost a central planner could achieve. Worst-case bounds on the PoA are classical (Roughgarden and Tardos, 2002), but traffic studies observe that the empirical PoA is close to 111 both in light and in heavy traffic (Youn, Gastner and Jeong, 2008; O'Hare, Connors and Watling, 2016). This raises the question of how the PoA of a fixed network with fixed cost functions behaves as the demand varies.

For decreasing demand the literature had one convergence result: for polynomial costs, Colini-Baldeschi, Cominetti, Mertikopoulos and Scarsini (2020) show ρ→1\rho \to 1ρ→1 when the total demand tends to 000 with fixed demand proportions, at rate O(T(d))O(T(d))O(T(d)). Wu and Möhring (2021) obtain a rate for arbitrary cost functions that are strictly positive and Lipschitz near 000, with no condition on the demand proportions, as a corollary of their sensitivity analysis of the PoA. This mission formalizes that corollary, Corollary 5.1 of arXiv:2007.13979v3.

Setting

A structure consists of a finite set AAA of arcs, a finite nonempty set K\mathcal KK of origin–destination (O/D) pairs, and for every pair kkk a set Sk\mathcal S_kSk​ of at least two paths, each a nonempty set of arcs; every arc lies on some path. A game Γ=(τ,d)\Gamma = (\tau, d)Γ=(τ,d) is a vector of arc cost functions τa:[0,∞)→[0,∞)\tau_a : [0,\infty) \to [0,\infty)τa​:[0,∞)→[0,∞), continuous and non-decreasing, together with demands dk≥0d_k \ge 0dk​≥0 of total T(d)=∑kdkT(d) = \sum_k d_kT(d)=∑k​dk​. The game space G(G,K,S)\mathcal G(G, \mathcal K, \mathcal S)G(G,K,S) consists of the games with T(d)>0T(d) > 0T(d)>0 and τa(x)>0\tau_a(x) > 0τa​(x)>0 on (0,T(d)](0, T(d)](0,T(d)].

A flow f=(fs)f = (f_s)f=(fs​) routes dkd_kdk​ over Sk\mathcal S_kSk​ with fs≥0f_s \ge 0fs​≥0. Arc flows are fa=∑s∋afsf_a = \sum_{s \ni a} f_sfa​=∑s∋a​fs​ and the total cost is C(Γ,f)=∑afaτa(fa)C(\Gamma, f) = \sum_a f_a \tau_a(f_a)C(Γ,f)=∑a​fa​τa​(fa​). A flow is a Wardrop equilibrium if every used path is a cheapest path of its pair. With C∗(Γ)\mathcal C^*(\Gamma)C∗(Γ) the minimum total cost and C~(Γ)\tilde{\mathcal C}(\Gamma)C~(Γ) the cost of a Wardrop equilibrium (all equilibria have the same cost),

ρ(Γ)=C~(Γ)C∗(Γ)≥1.\rho(\Gamma) = \frac{\tilde{\mathcal C}(\Gamma)}{\mathcal C^*(\Gamma)} \ge 1.ρ(Γ)=C∗(Γ)C~(Γ)​≥1.

Games are compared by the distance (3.3),

∥Γ−Γ′∥=max⁡{∥d−d′∥∞, max⁡a, x∈[0,min⁡{T(d),T(d′)}]∣τa(x)−σa(x)∣, ∥τ(T(d))−σ(T(d′))∥∞},\|\Gamma - \Gamma'\| = \max\Big\{\|d - d'\|_\infty,\ \max_{a,\ x \in [0, \min\{T(d), T(d')\}]} |\tau_a(x) - \sigma_a(x)|,\ \|\tau(T(d)) - \sigma(T(d'))\|_\infty\Big\},∥Γ−Γ′∥=max{∥d−d′∥∞​, a, x∈[0,min{T(d),T(d′)}]max​∣τa​(x)−σa​(x)∣, ∥τ(T(d))−σ(T(d′))∥∞​},

and the demand normalization Λυ(τ,d)=(τ∘υ,d/υ)\Lambda_\upsilon(\tau, d) = (\tau \circ \upsilon, d/\upsilon)Λυ​(τ,d)=(τ∘υ,d/υ), with (τa∘υ)(x)=τa(xυ)(\tau_a \circ \upsilon)(x) = \tau_a(x\upsilon)(τa​∘υ)(x)=τa​(xυ), rescales a game to a different total demand. The cost slice of τ\tauτ is the set of games whose costs agree with τ\tauτ on [0,T(d)][0, T(d)][0,T(d)].

Formalization targets

Goal: Corollary 5.1 (p. 43)

Let the costs τa\tau_aτa​ be strictly positive on [0,∞)[0,\infty)[0,∞) and Lipschitz on [0,b][0, b][0,b] with constant Mτ>0M_\tau > 0Mτ​>0, and let τmin⁡(0)=min⁡aτa(0)\tau_{\min}(0) = \min_a \tau_a(0)τmin​(0)=mina​τa​(0). There is δ>0\delta > 0δ>0 such that for every demand vector d≥0d \ge 0d≥0 with 0<T(d)<δ0 < T(d) < \delta0<T(d)<δ,

ρ(τ,d)≤1+8⋅∣A∣⋅(∣K∣+1)τmin⁡(0)⋅Mτ⋅T(d).\rho(\tau, d) \le 1 + \frac{8 \cdot |A| \cdot (|\mathcal K| + 1)}{\tau_{\min}(0)} \cdot M_\tau \cdot T(d).ρ(τ,d)≤1+τmin​(0)8⋅∣A∣⋅(∣K∣+1)​⋅Mτ​⋅T(d).

Milestones

  1. §3.5, p. 22. Λυ\Lambda_\upsilonΛυ​ preserves the game space, maps WE and SO flows to WE and SO flows (divided by υ\upsilonυ), scales the total cost by 1/υ1/\upsilon1/υ, and leaves ρ\rhoρ unchanged.
  2. p. 43, first display. With σa≡τa(0)\sigma_a \equiv \tau_a(0)σa​≡τa​(0) and Γ′=(σ,d/T(d))\Gamma' = (\sigma, d/T(d))Γ′=(σ,d/T(d)): ∥Γ′−ΛT(d)(τ,d)∥=max⁡a∣τa(T(d))−τa(0)∣≤MτT(d)\|\Gamma' - \Lambda_{T(d)}(\tau, d)\| = \max_a |\tau_a(T(d)) - \tau_a(0)| \le M_\tau T(d)∥Γ′−ΛT(d)​(τ,d)∥=maxa​∣τa​(T(d))−τa​(0)∣≤Mτ​T(d) when T(d)≤bT(d) \le bT(d)≤b.
  3. p. 43. C∗(Γ′)≥τmin⁡(0)\mathcal C^*(\Gamma') \ge \tau_{\min}(0)C∗(Γ′)≥τmin​(0) for every ddd.
  4. p. 43, second display. For T(d)T(d)T(d) below a threshold independent of ddd: ρ(Γ′)=1\rho(\Gamma') = 1ρ(Γ′)=1 and ∣ρ(ΛT(d)(τ,d))−ρ(Γ′)∣≤8∣A∣(∣K∣+1)MτT(d)/τmin⁡(0)|\rho(\Lambda_{T(d)}(\tau,d)) - \rho(\Gamma')| \le 8|A|(|\mathcal K|+1) M_\tau T(d)/\tau_{\min}(0)∣ρ(ΛT(d)​(τ,d))−ρ(Γ′)∣≤8∣A∣(∣K∣+1)Mτ​T(d)/τmin​(0).

Significance

The corollary gives a rate of convergence of the PoA to 111 in light traffic for every cost vector that is strictly positive at 000 and Lipschitz near 000, with an explicit constant depending only on the number of arcs, the number of O/D pairs, the Lipschitz constant and the free-flow costs τa(0)\tau_a(0)τa​(0). It removes the fixed-proportion condition on the demands needed in the earlier polynomial result, and it combines with the heavy-traffic results for regularly varying costs to show that the PoA is bounded on whole cost slices (p. 43).

The result is proved in the paper, in a few lines on top of the local Lipschitz estimate (4.33) of Theorem 12a). To our knowledge it has no machine-checked proof. Formalizing it requires a Lean model of nonatomic congestion games with demand normalizations and the metric (3.3), together with the comparison between a game of total demand 111 and the constant-cost game at the same demand, which is reusable for other light-traffic statements.

Difficulty

A direct bound ρ(τ,d)≤1+c T(d)\rho(\tau, d) \le 1 + c\,T(d)ρ(τ,d)≤1+cT(d) cannot simply be read off as T(d)→0T(d) \to 0T(d)→0: the costs C∗\mathcal C^*C∗ and C~\tilde{\mathcal C}C~ both tend to 000 with the demand, so their ratio is a quotient of two vanishing quantities, and an additive estimate on each cost says nothing about the ratio. The difficulty is to obtain a bound in which neither the threshold on T(d)T(d)T(d) nor the constant depends on the demand vector ddd, including the proportions dk/T(d)d_k/T(d)dk​/T(d), which may vary arbitrarily, and some of which may vanish. Any argument whose constants depend on the particular game near which it works (as a pointwise Hölder constant does) gives only a pointwise statement, not the uniform one asserted here.

Formalization scope

The Lean development lives in the namespace SensitivityPoA.SmallDemand and builds on the published definition KellyStochasticNetworks_Wardrop (flows, arc flows, Wardrop's first principle). Conventions:

  • The structure is a 0/1 arc–route incidence matrix with a map from routes to O/D pairs. Standing assumptions (disclosed): every route contains an arc, K\mathcal KK is nonempty, and Condition 1 (every arc on some route, ∣Sk∣≥2|\mathcal S_k| \ge 2∣Sk​∣≥2). Routes are arbitrary 0/1 columns, a generalization of loop-free paths.
  • Cost functions are functions R→R\mathbb R \to \mathbb RR→R that are continuous, non-decreasing and non-negative on [0,∞)[0,\infty)[0,∞). "Strictly positive" means τa(x)>0\tau_a(x) > 0τa​(x)>0 for all x≥0x \ge 0x≥0. "Lipschitz on [0,b][0,b][0,b] with constant MτM_\tauMτ​" means ∣τa(x)−τa(y)∣≤Mτ∣x−y∣|\tau_a(x) - \tau_a(y)| \le M_\tau |x-y|∣τa​(x)−τa​(y)∣≤Mτ​∣x−y∣ for x,y∈[0,b]x, y \in [0,b]x,y∈[0,b]; nothing is assumed beyond bbb.
  • C∗\mathcal C^*C∗ is the real infimum of the total cost over flows, C~\tilde{\mathcal C}C~ the real supremum over WE flows, ρ\rhoρ their quotient. The maxima in (3.3) are real suprema of images of compact sets and Mathlib's sup norm.
  • The corollary is stated for the game (τ,d)(\tau, d)(τ,d) itself; games of the cost slice agree with it on [0,T(d)][0, T(d)][0,T(d)].
  • Corrected slip. The corollary prints the constant 8⋅Mτ⋅∣A∣⋅(∣K∣+1)/τmin⁡(0)⋅Mτ8 \cdot M_\tau \cdot |A| \cdot (|\mathcal K|+1)/\tau_{\min}(0) \cdot M_\tau8⋅Mτ​⋅∣A∣⋅(∣K∣+1)/τmin​(0)⋅Mτ​, with MτM_\tauMτ​ twice. The display it summarizes has MτM_\tauMτ​ once, which is what is posed; it implies the printed form whenever Mτ≥1M_\tau \ge 1Mτ​≥1.

A trivializing formalization is ruled out: the threshold δ\deltaδ is chosen before ddd (choosing it after ddd makes the statement vacuous), T(d)>0T(d) > 0T(d)>0 is required (at T(d)=0T(d) = 0T(d)=0 Lean's 0/0=00/0 = 00/0=0 would make ρ=0\rho = 0ρ=0), every game considered lies in the game space, and the bounds use ≤\le≤, which holds at equality cases.

Contributions welcome: proofs of the milestones, the comparison of WE costs under pointwise cost perturbation (the variational inequality of Wardrop equilibria), and existence of Wardrop equilibria for costs that are continuous and monotone only on [0,∞)[0,\infty)[0,∞). The source is the arXiv preprint v3; the published version in Mathematics of Operations Research is not the cited artifact.

Selected references

  • Z. Wu, R. H. Möhring, A sensitivity analysis of the PoA in non-atomic congestion games, arXiv:2007.13979v3, 2021; published as A Sensitivity Analysis of the Price of Anarchy in Nonatomic Congestion Games, Mathematics of Operations Research 48(3), 2023. https://arxiv.org/abs/2007.13979 , https://doi.org/10.1287/moor.2022.1292
  • R. Colini-Baldeschi, R. Cominetti, P. Mertikopoulos, M. Scarsini, When is selfish routing bad? The price of anarchy in light and heavy traffic, Operations Research 68(2), 2020. https://doi.org/10.1287/opre.2019.1894
  • T. Roughgarden, É. Tardos, How bad is selfish routing?, Journal of the ACM 49(2), 2002. https://doi.org/10.1145/506147.506153
  • H. Youn, M. T. Gastner, H. Jeong, Price of anarchy in transportation networks: efficiency and optimality control, Physical Review Letters 101, 2008. https://doi.org/10.1103/PhysRevLett.101.128701
  • S. J. O'Hare, R. D. Connors, D. P. Watling, Mechanisms that govern how the price of anarchy varies with travel demand, Transportation Research Part B: Methodological 84:55–80, 2016 (cited in arXiv:2007.13979v3, p. 50).
7 thms2 active usersReviewed
Algorithmic Game TheoryAnalysisOptimization+1·Captain: mikedeng1

A Sensitivity Analysis of the Price of Anarchy in Nonatomic Congestion Games 2: The Social Optimum Cost, the Wardrop Equilibrium Cost and the Price of Anarchy Are Continuous on the Game SpaceResearch Paper

Motivation

Traffic users choose routes for themselves, while a planner may choose routes that minimize everyone's combined travel cost. The price of anarchy measures the cost of the users' equilibrium relative to the planner's optimum. Travel demand and arc latency functions are estimated from data and change over time, so a ratio that changes abruptly under a small input change would be difficult to interpret or use. Wu and Möhring study this sensitivity for nonatomic congestion games, where each individual user has negligible influence on arc flows. Their preprint proves that the optimum cost, equilibrium cost, and their ratio vary continuously over the game space they define. This mission isolates that foundational continuity result. It supplies the qualitative starting point for the paper's later Hölder and Lipschitz estimates.

The cited artifact is arXiv:2007.13979v3, dated 2021. The article subsequently appeared in Mathematics of Operations Research in 2023, but theorem numbers and pages here refer to the preprint.

Setting

Fix finite sets AAA of arcs, SSS of routes, and KKK of origin–destination pairs. Each route sss serves one pair kkk and contains at least one arc. Every arc belongs to some route, and every pair has at least two routes. A game Γ=(τ,d)\Gamma=(\tau,d)Γ=(τ,d) assigns each arc aaa a nonnegative, nondecreasing, continuous latency function τa:[0,∞)→[0,∞)\tau_a:[0,\infty)\to[0,\infty)τa​:[0,∞)→[0,∞) and each pair kkk a nonnegative demand dkd_kdk​. The total demand is T(d)=∑k∈KdkT(d)=\sum_{k\in K}d_kT(d)=∑k∈K​dk​. These are the paper's basic model and standing combinatorial assumptions (pp. 10–11 and 14).

A feasible flow fff puts nonnegative traffic on routes so that the traffic for each pair sums to its demand. The induced arc flow is fa=∑s∋afsf_a=\sum_{s\ni a}f_sfa​=∑s∋a​fs​. Its total cost is

C(Γ,f)=∑a∈Afaτa(fa).C(\Gamma,f)=\sum_{a\in A} f_a\tau_a(f_a).C(Γ,f)=a∈A∑​fa​τa​(fa​).

A social optimum (SO) is a feasible flow minimizing total cost. A Wardrop equilibrium (WE) is a feasible flow in which every route carrying positive traffic has minimum cost among the routes serving the same pair. Write C∗(Γ)C^*(\Gamma)C∗(Γ) for the SO cost and C~(Γ)\widetilde C(\Gamma)C(Γ) for the WE cost. The paper shows that all SO flows have the same cost and all WE flows have the same cost (pp. 11–12 and 18).

A generalized game has the stated nonnegative demands and regular latency functions. The game space G(G,K,S)\mathcal G(G,K,S)G(G,K,S) further requires T(d)>0T(d)>0T(d)>0 and τa(x)>0\tau_a(x)>0τa​(x)>0 for every arc and every 0<x≤T(d)0<x\le T(d)0<x≤T(d), the paper's Condition 2. On this space, the optimum cost is positive and the price of anarchy is defined by

ρ(Γ)=C~(Γ)C∗(Γ).\rho(\Gamma)=\frac{\widetilde C(\Gamma)}{C^*(\Gamma)}.ρ(Γ)=C∗(Γ)C(Γ)​.

For Γ=(τ,d)\Gamma=(\tau,d)Γ=(τ,d) and Γ′=(σ,d′)\Gamma'=(\sigma,d')Γ′=(σ,d′), the paper's distance Dist⁡(Γ,Γ′)\operatorname{Dist}(\Gamma,\Gamma')Dist(Γ,Γ′) is the maximum of three discrepancies: the sup norm of d−d′d-d'd−d′, the largest ∣τa(x)−σa(x)∣|\tau_a(x)-\sigma_a(x)|∣τa​(x)−σa​(x)∣ for a∈Aa\in Aa∈A and 0≤x≤min⁡{T(d),T(d′)}0\le x\le\min\{T(d),T(d')\}0≤x≤min{T(d),T(d′)}, and the sup norm of τ(T(d))−σ(T(d′))\tau(T(d))-\sigma(T(d'))τ(T(d))−σ(T(d′)). The last term compares costs at the two games' respective demand endpoints. Games with equal demands and equal latency functions up to that demand are identified as equivalent (pp. 15–17, (3.1)–(3.3)).

Formalization targets

The supporting milestones establish a positive lower bound for C∗C^*C∗ and an upper bound for ρ\rhoρ (Lemma 3), the distance properties of generalized games (Lemma 4), and behavior of feasible, SO, and WE flows under convergent game sequences (Lemma 5). The goal is the paper's Theorem 6, p. 19: for any sequence Γn∈G(G,K,S)\Gamma_n\in\mathcal G(G,K,S)Γn​∈G(G,K,S) with Dist⁡(Γn,Γ)→0\operatorname{Dist}(\Gamma_n,\Gamma)\to0Dist(Γn​,Γ)→0 and Γ∈G(G,K,S)\Gamma\in\mathcal G(G,K,S)Γ∈G(G,K,S),

C∗(Γn)→C∗(Γ),C~(Γn)→C~(Γ),ρ(Γn)→ρ(Γ).C^*(\Gamma_n)\to C^*(\Gamma),\qquad \widetilde C(\Gamma_n)\to\widetilde C(\Gamma),\qquad \rho(\Gamma_n)\to\rho(\Gamma).C∗(Γn​)→C∗(Γ),C(Γn​)→C(Γ),ρ(Γn​)→ρ(Γ).

Significance

The theorem establishes that sufficiently small changes in both demand and latency data produce small changes in the two total costs and their ratio. It allows the PoA to be treated as a stable observable of a game, including where the identity of an optimum or equilibrium flow changes. The result is qualitative: it does not supply a uniform rate of change. The same paper investigates sharper rates under additional assumptions (§4).

The mathematical result is proved in the paper. In this mission its statements and definitions are compiled Lean drafts, while proofs of Theorem 6 and its milestone lemmas remain open. A completed development would make the game-space metric, limit-of-flow statements, and cost continuity available for later sensitivity results on nonatomic routing.

Difficulty

Pointwise continuity of each τa\tau_aτa​ does not by itself control an optimum or equilibrium when demands change: the feasible-flow sets change with ddd, and a flow for one game need not be feasible for another. A converging sequence of games can also have different optimal or equilibrium flows at every index. The distance compares functions only on demand-relevant intervals, so limits of costs must respect those varying intervals. Finally, continuity of the quotient requires a positive optimum cost throughout the game space; the paper's Condition 2 is what makes that denominator meaningful (pp. 15–19).

Formalization scope

Lean uses finite types for arcs, routes, and pairs; a route is a nonempty 000–111 incidence column and is assigned to one pair. This admits arbitrary route collections rather than insisting on loop-free directed graph paths. The standing network predicate records the nonempty pair set, nonempty routes, every arc's membership in a route, and at least two routes per pair. Costs are total functions on the reals, with continuity, monotonicity, and nonnegativity required only on [0,∞)[0,\infty)[0,∞). Flow feasibility, arc flow, the Wardrop condition, and the potential reuse the published KellyStochasticNetworks_Wardrop definition. The total cost uses the arc formula; C∗C^*C∗ is an infimum over feasible flows and C~\widetilde CC a supremum over WE flows. On valid games these recover the paper's common SO and WE costs.

The distance uses the sup norm on finite vectors and a real supremum over the bounded shared demand interval. Convergence is stated sequentially, following the paper, without imposing a metric-space instance on raw games that may be equivalent. Every theorem involving ρ\rhoρ quantifies over the game space, so a zero denominator or an empty equilibrium set cannot supply a spurious value. The route-count and arc-count factors in Lemma 3 are the actual finite cardinalities. Contributions that establish existence and compactness of relevant flow sets, equivalence of the arc and path cost formulas, and the stated limit properties are useful beyond this theorem.

Selected references

  • Z. Wu and R. H. Möhring, A sensitivity analysis of the PoA in non-atomic congestion games, arXiv:2007.13979v3, 2021. Preprint.
  • Z. Wu and R. H. Möhring, A Sensitivity Analysis of the Price of Anarchy in Nonatomic Congestion Games, Mathematics of Operations Research 48(3), 2023. DOI.
9 thms2 active usersReviewed
🏆Completed
ProbabilityTheoretical Computer Science·Captain: mikedeng1

Selection and Ordering Policies for Hiring Pipelines via Linear Programming 4: For Every τ ∈ (0, 1) Some τ-Bounded Instance Gives No Value-Ordered Policy More Than (β^τ_k + ε) Times the OptimumResearch Paper

Why offer sets with overbooking matter

A firm with kkk open positions often cannot interview and offer sequentially: hiring seasons are short, and offers go out in one batch. Some recipients decline, so the firm overbooks, sending more offers than it has positions, and pays for every hire beyond capacity. The same trade-off appears in airline and hotel overbooking and in university admissions. Epstein and Ma (arXiv:2210.04059v3, Operations Research 2024) study this Simultaneous Offering problem as one of three hiring-pipeline models, and analyse the natural class of value-ordered policies, which offer to the best candidates first. Their Theorem 3 shows that a value-ordered policy built from a linear-programming relaxation guarantees a fraction αkτ\alpha^\tau_kαkτ​ of the optimum when every value is at least τ\tauτ. This mission formalizes the converse, Theorem 4: no value-ordered policy can guarantee more than βkτ\beta^\tau_kβkτ​.

Setting

An instance has k≥1k \ge 1k≥1 positions and n≥kn \ge kn≥k candidates. Candidate iii accepts an offer with probability pi∈[0,1]p_i \in [0,1]pi​∈[0,1], independently of the others, and then adds value vi≥0v_i \ge 0vi​≥0. The firm chooses a set SSS of candidates and sends all offers at once. If A⊆SA \subseteq SA⊆S is the random set of acceptances, the reward is

∑i∈Avi−[ ∣A∣−k ]+,\sum_{i \in A} v_i - [\,|A| - k\,]^+,i∈A∑​vi​−[∣A∣−k]+,

so each hire beyond capacity costs 111 (the paper rescales values so that this cost is 111). Write R(I,S)R(I, S)R(I,S) for the expected reward of offering to SSS, and OPTsim(I)=max⁡SR(I,S)\mathrm{OPT}_{\mathrm{sim}}(I) = \max_S R(I, S)OPTsim​(I)=maxS​R(I,S) for the best expected reward; randomizing over offer sets cannot do better.

Candidates are labelled so that v1≥v2≥⋯≥vnv_1 \ge v_2 \ge \cdots \ge v_nv1​≥v2​≥⋯≥vn​. A value-ordered policy with parameter m∈[n]m \in [n]m∈[n] offers to {1,…,m}\{1, \dots, m\}{1,…,m}. An instance is τ\tauτ-bounded, I∈IsimτI \in \mathcal{I}^\tau_{\mathrm{sim}}I∈Isimτ​, if vi≥τv_i \ge \tauvi​≥τ for all iii. Without such a bound value-ordered policies can be arbitrarily poor (§6.1); τ\tauτ measures how soft the capacity is, from nearly hard (τ\tauτ close to 000) to nearly compensated by any hire (τ\tauτ close to 111), and both theorems take τ∈(0,1)\tau \in (0,1)τ∈(0,1).

For λ≥0\lambda \ge 0λ≥0 let E[min⁡{Pois(λ),k}]\mathbb{E}[\min\{\mathrm{Pois}(\lambda), k\}]E[min{Pois(λ),k}] be the mean of a Poisson variable truncated at kkk, and

fk,τ(s)=s−sτ+E[min⁡{Pois(sk),k}]τk,αkτ=sup⁡0≤s≤1fk,τ(s),βkτ=sup⁡s≥0fk,τ(s).f_{k,\tau}(s) = s - \frac{s}{\tau} + \frac{\mathbb{E}[\min\{\mathrm{Pois}(sk), k\}]}{\tau k}, \qquad \alpha^\tau_k = \sup_{0 \le s \le 1} f_{k,\tau}(s), \qquad \beta^\tau_k = \sup_{s \ge 0} f_{k,\tau}(s).fk,τ​(s)=s−τs​+τkE[min{Pois(sk),k}]​,αkτ​=0≤s≤1sup​fk,τ​(s),βkτ​=s≥0sup​fk,τ​(s).

In Lean these are SimInstance, reward, OPTsim, valueOrdered, TauBounded, expMinPois, ratioObj, alpha and beta in the namespace HiringLP.SimUpper.

Formalization targets

Goal: Theorem 4 (p. 30)

For every k≥1k \ge 1k≥1, ε>0\varepsilon > 0ε>0 and τ∈(0,1)\tau \in (0,1)τ∈(0,1) there is a valid, sorted instance I∈IsimτI \in \mathcal{I}^\tau_{\mathrm{sim}}I∈Isimτ​ with kkk positions such that

R(I,{1,…,m})≤(βkτ+ε) OPTsim(I)for every m∈[n].R(I, \{1, \dots, m\}) \le (\beta^\tau_k + \varepsilon)\,\mathrm{OPT}_{\mathrm{sim}}(I) \quad \text{for every } m \in [n].R(I,{1,…,m})≤(βkτ​+ε)OPTsim​(I)for every m∈[n].

Milestones on the hard instance (App. D.7)

The instance has j2j^2j2 type-1 candidates with pi=k/jp_i = k/jpi​=k/j, vi=τ+δv_i = \tau + \deltavi​=τ+δ, δ=ετ/j\delta = \varepsilon\tau/jδ=ετ/j, and kkk type-2 candidates with pi=1p_i = 1pi​=1, vi=τv_i = \tauvi​=τ. With B∼Bin(m,k/j)B \sim \mathrm{Bin}(m, k/j)B∼Bin(m,k/j) and 0≤m≤j20 \le m \le j^20≤m≤j2:

OPTsim(I)≥kτ,\mathrm{OPT}_{\mathrm{sim}}(I) \ge k\tau,OPTsim​(I)≥kτ, R(I,{1,…,m})=(τ+δ)kmj+E[min⁡{0,k−B}]≤k+kmj(τ+δ−Pr⁡[B>k])(EC.15),R(I, \{1,\dots,m\}) = (\tau + \delta)\frac{km}{j} + \mathbb{E}[\min\{0, k - B\}] \le k + \frac{km}{j}\bigl(\tau + \delta - \Pr[B > k]\bigr) \quad \text{(EC.15)},R(I,{1,…,m})=(τ+δ)jkm​+E[min{0,k−B}]≤k+jkm​(τ+δ−Pr[B>k])(EC.15), R(I,{1,…,m})≤εkτ+kmj(τ−1)+E[min⁡{k,B}](EC.18).R(I, \{1,\dots,m\}) \le \varepsilon k \tau + \frac{km}{j}(\tau - 1) + \mathbb{E}[\min\{k, B\}] \quad \text{(EC.18)}.R(I,{1,…,m})≤εkτ+jkm​(τ−1)+E[min{k,B}](EC.18).

Companions: the maximisers (App. D.8)

Proposition EC.5: optimal sα∗s^*_\alphasα∗​, sβ∗s^*_\betasβ∗​ exist, sα∗=min⁡{sβ∗,1}s^*_\alpha = \min\{s^*_\beta, 1\}sα∗​=min{sβ∗​,1}, and τ=1−e−sβ∗k∑j<k(sβ∗k)j/j!\tau = 1 - e^{-s^*_\beta k}\sum_{j<k} (s^*_\beta k)^j/j!τ=1−e−sβ∗​k∑j<k​(sβ∗​k)j/j!. Proposition EC.6: sα∗=sβ∗s^*_\alpha = s^*_\betasα∗​=sβ∗​ if and only if τ≤1−e−k∑j<kkj/j!\tau \le 1 - e^{-k}\sum_{j<k} k^j/j!τ≤1−e−k∑j<k​kj/j!, which holds whenever τ≤1/2\tau \le 1/2τ≤1/2.

Significance

Theorem 4 bounds what any value-ordered policy can guarantee on τ\tauτ-bounded instances, against the true optimum rather than an LP relaxation. With Theorem 3 it brackets the best guarantee of the class between αkτ\alpha^\tau_kαkτ​ and βkτ\beta^\tau_kβkτ​, and by Proposition EC.6 the two coincide when τ≤Pr⁡[Pois(k)≥k]\tau \le \Pr[\mathrm{Pois}(k) \ge k]τ≤Pr[Pois(k)≥k], in particular for all kkk when τ≤1/2\tau \le 1/2τ≤1/2. In that region the paper's truncated-LP policy is the best value-ordered policy in the worst case. The instance also shows why the restriction to value-ordered policies costs something: the optimum offers to the reliable type-2 candidates, while a value-ordered policy must first exhaust the slightly more valuable unreliable ones.

The results are proved in the paper. None of them has a machine-checked proof; this mission produces a formal version of Theorem 4 and the finite-jjj estimates on which its proof rests, together with a reusable finite-sum encoding of independent acceptances, truncated Poisson and Binomial expectations, and the constants αkτ\alpha^\tau_kαkτ​, βkτ\beta^\tau_kβkτ​.

Difficulty

The milestones are exact identities and inequalities at a fixed jjj; the hard part is the passage to the limit. The page's proof lets j→∞j \to \inftyj→∞ with mj/j→sm_j/j \to smj​/j→s and replaces Bin(mj,k/j)\mathrm{Bin}(m_j, k/j)Bin(mj​,k/j) by Pois(sk)\mathrm{Pois}(sk)Pois(sk). The goal, however, asks for one finite instance on which the bound holds for every mmm simultaneously, including mmm of order j2j^2j2 and the values m>j2m > j^2m>j2 that also offer to type-2 candidates. A pointwise limit for each fixed sss does not give this; the Binomial–Poisson error has to be controlled uniformly in mmm, and the error must fit inside the slack ε\varepsilonε, part of which the term δ\deltaδ already uses. Note also that the comparison runs the wrong way for the obvious argument: min⁡{⋅,k}\min\{\cdot, k\}min{⋅,k} is concave and the Binomial is less spread than the Poisson, so E[min⁡{k,B}]\mathbb{E}[\min\{k, B\}]E[min{k,B}] is at least its Poisson counterpart and a one-sided comparison cannot replace an approximation bound.

Formalization scope

All randomness is finite. The expected reward is an explicit sum over the 2n2^n2n accepting sets with product probabilities; the Binomial pmf, its truncated mean and its tail are finite sums written by hand. The truncated Poisson mean is the series with the Poisson pmf. All quantities are real. Candidates are Fin n, so the paper's candidate iii is index i−1i - 1i−1; sortedness is the hypothesis Antitone v in Valid, which also contains 1≤k≤n1 \le k \le n1≤k≤n, p∈[0,1]np \in [0,1]^np∈[0,1]n and v≥0v \ge 0v≥0. OPTsim\mathrm{OPT}_{\mathrm{sim}}OPTsim​ is the maximum over all offer sets, never over value-ordered ones. βkτ\beta^\tau_kβkτ​ is the supremum over [0,∞)[0, \infty)[0,∞) and αkτ\alpha^\tau_kαkτ​ over [0,1][0, 1][0,1]. The page leaves kkk implicit in βkτ\beta^\tau_kβkτ​; the goal quantifies over every k≥1k \ge 1k≥1 and requires the instance to have exactly kkk positions. The quantifiers are "for all k,ε,τk, \varepsilon, \tauk,ε,τ, there is an instance, for all mmm".

The goal does not fix the hard instance: any instance proves it. A formalization in which the comparison is with the best value-ordered policy, in which βkτ\beta^\tau_kβkτ​ is a free parameter, or in which the reward is defined by the proof's Binomial formula would be a different statement and is ruled out by the definitions above. The definitions are not specialized to the hard instance, which appears only as a separate definition used by the milestones.

A complete development needs: finite sums over subsets with product weights and the reduction to a Binomial count for identical candidates; summability and continuity of the truncated Poisson mean; a Binomial–Poisson approximation bound uniform in the number of trials; concavity of fk,τf_{k,\tau}fk,τ​ in sss. The Poisson and Binomial infrastructure is reusable well beyond this mission. Proofs of the milestones, of the companions, and of auxiliary approximation lemmas are all welcome.

Selected references

  • B. Epstein, W. Ma, Selection and Ordering Policies for Hiring Pipelines via Linear Programming, arXiv:2210.04059v3, 2023; Operations Research, 2024. https://arxiv.org/abs/2210.04059
  • M. Mitzenmacher, E. Upfal, Probability and Computing, 2nd ed., Cambridge University Press, 2017 (Exercise 5.14, cited for Pr⁡[Pois(k)≥k]≥1/2\Pr[\mathrm{Pois}(k) \ge k] \ge 1/2Pr[Pois(k)≥k]≥1/2). https://doi.org/10.1017/9781316651124
  • A. D. Barbour, P. Hall, On the rate of Poisson convergence, Mathematical Proceedings of the Cambridge Philosophical Society 95, 1984. https://doi.org/10.1017/S0305004100061402
11 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryProbability·Captain: mikedeng1

Designing Approximately Optimal Search on Matching Platforms 2: Every Set of Assortments Has a Unique Profile of Thresholds Equal to Expected UtilitiesResearch Paper

Motivation

Online matching platforms for dating, freelancing or ride sharing do not match agents themselves. They decide whom each agent gets to see and how often, and the agents then accept or reject. Immorlica, Lucier, Manshadi and Wei (arXiv:2102.09017, Management Science 2023) model this as directed search. The platform designs assortments, which are rates at which types of agents meet, and the agents play an equilibrium of the induced search game. The platform's design problem only makes sense if every choice of assortments leads to a single, well-defined equilibrium outcome. Otherwise "the welfare of an assortment" is not a function of the assortment. This is not automatic: even for simple asymmetric preferences under random meetings, multiple stationary equilibria can arise (Burdett and Coles 1997).

This mission formalizes that well-posedness result, Proposition 3.1(1) of the paper, together with the fixed-point and iteration lemmas of Appendix A.3 and Appendix B.3 on which its proof rests. It is the companion of the mission on the paper's quarter-approximation theorem (Theorem 4.1), which uses the same model.

The source is the arXiv v2 preprint (18 Aug 2021). The Management Science version may number results differently.

Setting

There are finitely many agent types on each side of the market, a set M\mathcal MM and a set W\mathcal WW, with Θ=M∪W\Theta=\mathcal M\cup\mathcal WΘ=M∪W. Agents of every type leave the market unmatched at a life-event rate δ>0\delta>0δ>0, and type θ\thetaθ arrives at rate αθ>0\alpha_\theta>0αθ​>0. When an agent of type mmm meets an agent of type www, the pair draws one utility u∼Fmwu\sim F_{mw}u∼Fmw​. Valuations are symmetric: both agents receive uuu if they match, and Fwm:=FmwF_{wm}:=F_{mw}Fwm​:=Fmw​. Each FmwF_{mw}Fmw​ is a probability law on R\mathbb RR with no atoms (a "continuous distribution").

An assortment for type θ\thetaθ is a family of rates λθ(θ′)≥0\lambda_\theta(\theta')\ge0λθ​(θ′)≥0 at which type-θ\thetaθ agents meet type-θ′\theta'θ′ agents on the opposite side. Under a threshold strategy with threshold τθ\tau_\thetaτθ​, a type-θ\thetaθ agent accepts a meeting if and only if u≥τθu\ge\tau_\thetau≥τθ​. A meeting turns into a match when both agents accept, i.e. when u≥max⁡(τθ,τθ′)u\ge\max(\tau_\theta,\tau_{\theta'})u≥max(τθ​,τθ′​). If every type plays a threshold strategy, the expected utility of a type-θ\thetaθ agent is (equation (5))

uˉθ(τ)=∑θ′λθ(θ′)∫max⁡(τθ,τθ′)∞u dFθθ′δ+∑θ′λθ(θ′)∫max⁡(τθ,τθ′)∞dFθθ′.\bar u_\theta(\tau)=\frac{\sum_{\theta'}\lambda_\theta(\theta')\int_{\max(\tau_\theta,\tau_{\theta'})}^\infty u\,dF_{\theta\theta'}}{\delta+\sum_{\theta'}\lambda_\theta(\theta')\int_{\max(\tau_\theta,\tau_{\theta'})}^\infty dF_{\theta\theta'}} .uˉθ​(τ)=δ+∑θ′​λθ​(θ′)∫max(τθ​,τθ′​)∞​dFθθ′​∑θ′​λθ​(θ′)∫max(τθ​,τθ′​)∞​udFθθ′​​.

A type's own threshold enters its own utility through max⁡(τθ,τθ′)\max(\tau_\theta,\tau_{\theta'})max(τθ​,τθ′​).

One type's equation. Fix the thresholds τi\tau_iτi​ of the opposite types. Write B(t)B(t)B(t) for the right-hand side of (5) with τθ\tau_\thetaτθ​ replaced by ttt. Lemma A.3 states that t=B(t)t=B(t)t=B(t) has exactly one solution. The best-response map of Appendix A.3 sends a profile τ\tauτ to the profile in which each type's new threshold is that solution, computed against the opposite side's thresholds in τ\tauτ. A best-response sequence starts at the all-zero profile and applies this map repeatedly.

Formalization targets

Goal: Proposition 3.1, item 1 (fixed-point form)

For any fixed assortments there is exactly one threshold profile τ∈RM×RW\tau\in\mathbb R^{\mathcal M}\times\mathbb R^{\mathcal W}τ∈RM×RW with

τθ=uˉθ(τ)for every θ∈Θ.\tau_\theta=\bar u_\theta(\tau)\qquad\text{for every }\theta\in\Theta .τθ​=uˉθ​(τ)for every θ∈Θ.

Uniqueness ranges over all real profiles.

Milestones

  1. Lemma B.1 (p. 40). With λi>0\lambda_i>0λi​>0 and τi≥0\tau_i\ge0τi​≥0, ρ=max⁡t≥0B(t)\rho=\max_{t\ge0}B(t)ρ=maxt≥0​B(t) is attained and satisfies B(ρ)=ρB(\rho)=\rhoB(ρ)=ρ. BBB is weakly increasing on (−∞,ρ](-\infty,\rho](−∞,ρ] and weakly decreasing on [ρ,∞)[\rho,\infty)[ρ,∞).
  2. Lemma A.3 (p. 35). With λi≥0\lambda_i\ge0λi​≥0 and arbitrary τi\tau_iτi​, the equation t=B(t)t=B(t)t=B(t) has exactly one real solution.
  3. §A.3, p. 37, first claim. Along a best-response sequence τ(0)≡0,τ(1),…\tau^{(0)}\equiv0,\tau^{(1)},\dotsτ(0)≡0,τ(1),…, the odd iterates are weakly decreasing and the even iterates are weakly increasing, componentwise.
  4. §A.3, p. 37, second claim. Every odd iterate dominates every even iterate: τ(2j)≤τ(2i+1)\tau^{(2j)}\le\tau^{(2i+1)}τ(2j)≤τ(2i+1).
  5. Proposition A.4 (p. 36). There is a universal CCC such that τ(C∣Θ∣)\tau^{(C|\Theta|)}τ(C∣Θ∣) is a fixed point of the best-response map, and the sequence is constant from that index on.

Significance

Proposition 3.1 is what makes the platform's problem OptimalDirectedSearch well defined. Assortments determine a unique threshold profile. That profile determines the matching rates (Lemma 3.2) and, through stationarity, the population masses. Welfare is then a function of the assortments, and the program (6) used for Theorem 4.1 encodes exactly this fixed point as its incentive constraint (6e). The constructive proof also yields an algorithm: iterate best responses from zero, and the iteration stops after O(∣Θ∣)O(|\Theta|)O(∣Θ∣) rounds.

Formalizing it adds three things beyond the paper. First, a checked version of an argument the paper gives informally, including the odd/even sandwich of the iteration, which the paper proves in a few lines. Second, a reusable fixed-point and unimodality lemma for ratios of tail integrals, B(t)=∫t∞u dG / (δ+∫t∞dG)B(t)=\int_t^\infty u\,dG\,/\,(\delta+\int_t^\infty dG)B(t)=∫t∞​udG/(δ+∫t∞​dG), which recurs in reservation-value arguments in search theory. Third, an exact accounting of the hypotheses: integrable utilities and the reading of the best-response map. To our knowledge none of these results has been machine-checked.

Difficulty

The obvious route to uniqueness, a contraction argument for the map τ↦uˉ(τ)\tau\mapsto\bar u(\tau)τ↦uˉ(τ), fails. That map is neither monotone nor contractive in general, since raising a type's own threshold can raise or lower its utility. Existence by Brouwer's fixed-point theorem gives no uniqueness and no algorithm. The best-response iteration does not converge monotonically either: its odd and even iterates move in opposite directions, so convergence in finitely many rounds is a combinatorial statement about the order of the thresholds, not a limit argument. A formal proof also needs continuity and monotonicity of tail integrals of atomless laws, which Mathlib provides only in pieces.

Formalization scope

The two sides are separate finite types M and W. A threshold profile is a pair of functions (M → ℝ) × (W → ℝ), ordered componentwise. A market records δ\deltaδ, α\alphaα and the laws F m w : Measure ℝ. The standing assumptions are:

  • δ>0\delta>0δ>0;
  • αθ>0\alpha_\theta>0αθ​>0, which is implicit in the paper and stated explicitly;
  • each FmwF_{mw}Fmw​ is a probability measure with no atoms (NullSingletonClass);
  • each FmwF_{mw}Fmw​ has an integrable identity. This is implicit in the paper, which uses ∫u dF\int u\,dF∫udF as a real number, and is stated explicitly.

Tails are ∫a∞dF=F([a,∞))\int_a^\infty dF=F([a,\infty))∫a∞​dF=F([a,∞)) and ∫a∞u dF=∫[a,∞)u dF\int_a^\infty u\,dF=\int_{[a,\infty)}u\,dF∫a∞​udF=∫[a,∞)​udF. Capacity (2), flow balance (3) and stationarity (1) are not hypotheses, because Proposition 3.1 holds for any fixed assortments.

The best-response map is encoded as a relation: each new threshold solves its own equation t=B(t)t=B(t)t=B(t) against the opposite side's input thresholds. This is the paper's reading ("This map is a best response by Lemma A.3"). Evaluating (5) at the old profile, own old threshold included, would be a different map. Under that reading finite convergence and the p. 37 claims are false: with one type per side, λ≡1\lambda\equiv1λ≡1, δ=1\delta=1δ=1 and FFF uniform on [0,1][0,1][0,1], its iterates are rational and converge only in the limit to 2−32-\sqrt32−3​.

Two formalizations would trivialize the goal, and both are ruled out. Uniqueness is over all real profiles, not only nonnegative ones or those reached by the iteration. The tail integrals are not allowed to vanish by default for non-integrable laws, because integrability is a hypothesis. O(∣Θ∣)O(|\Theta|)O(∣Θ∣) is encoded with a constant chosen before the market.

Not formalized: the agents' Markov decision process of Appendix A.1. Consequently "this strategy profile is a Nash equilibrium", item 2 of Proposition 3.1, Lemmas A.1–A.2 and the best-response sentences of Lemma A.3 and Proposition A.4 are out of scope.

Contributions welcome: continuity and monotonicity lemmas for a↦∫[a,∞)u dFa\mapsto\int_{[a,\infty)}u\,dFa↦∫[a,∞)​udF and a↦F([a,∞))a\mapsto F([a,\infty))a↦F([a,∞)) for atomless integrable laws, which are reusable well beyond this mission, and proofs of the milestones in any order.

Selected references

  • N. Immorlica, B. Lucier, V. Manshadi, A. Wei, Designing Approximately Optimal Search on Matching Platforms, Management Science, 2023; preprint arXiv:2102.09017v2, 2021. https://arxiv.org/abs/2102.09017
  • K. Burdett, M. G. Coles, Marriage and Class, Quarterly Journal of Economics 112(1), 1997. https://doi.org/10.1162/003355397555127
8 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryCombinatoricsMechanism Design·Captain: mikedeng1

Combinatorial Auctions with Interdependent Valuations: SOS to the Rescue 3: The k-HL Mechanism Is Ex-Post IC-IR and a (k+3)-Approximation to Welfare with k Signal ValuesResearch Paper

Motivation

In many auctions a bidder's value for what she wins depends on information held by others. The value of an oil lease, a spectrum licence or a piece of art to one bidder depends on survey data, market forecasts or expert opinions that other bidders hold privately. The model of interdependent values (Milgrom and Weber, 1982) captures this: each agent iii holds a private signal sis_isi​, and every agent's value is a publicly known function of the whole signal profile s=(s1,…,sn)\mathbf s=(s_1,\dots,s_n)s=(s1​,…,sn​).

With interdependent values, maximizing welfare in ex-post equilibrium is impossible unless the valuations satisfy the single-crossing condition (Maskin, 1992; Dasgupta and Maskin, 2000), and even single crossing does not suffice beyond single-item auctions with single-dimensional signals. Without any condition, there are valuations for which no deterministic mechanism achieves a bounded approximation ratio and no randomized mechanism does better than a factor nnn (Eden, Feldman, Fiat and Goldner, ACM EC 2018; Examples 1.2–1.3 of the source). Eden, Feldman, Fiat, Goldner and Karlin (arXiv:1903.08384v2, 2019) introduce submodularity over signals (SOS): raising one signal increases a value by less when the other signals are higher. They show that SOS valuations admit constant-factor, or signal-space-dependent, approximations in settings where single crossing fails, including combinatorial auctions. This mission formalizes their Theorem 6.1, the case of combinatorial auctions with single-dimensional signals taking kkk values.

Timeline. Milgrom–Weber (1982) introduce the interdependent values model. Maskin (1992) and Dasgupta–Maskin (2000) show that single crossing makes efficient auctions truthful. Jehiel–Moldovanu (2001) show that efficient implementation fails generically with multidimensional signals. Eden–Feldman–Fiat–Goldner (2018) give approximations under a relaxed, ccc-single-crossing condition, with ratios depending on ccc and nnn. Eden–Feldman–Fiat–Goldner–Karlin (2019; Mathematics of Operations Research, 2024) introduce SOS and prove Theorems 4.1, 5.1, 6.1 and 6.5.

Setting

There are nnn agents and mmm items, and k≥1k\ge1k≥1 signal values. Each agent iii has a signal si∈{0,1,…,k−1}s_i\in\{0,1,\dots,k-1\}si​∈{0,1,…,k−1}, and {0,…,k−1}n\{0,\dots,k-1\}^n{0,…,k−1}n is the grid. Agent iii's value for a bundle T⊆[m]T\subseteq[m]T⊆[m] at the profile s\mathbf ss is viT(s)≥0v_{iT}(\mathbf s)\ge0viT​(s)≥0; the empty bundle is worth 000, and for nonempty TTT, viTv_{iT}viT​ is weakly increasing in every signal and strictly increasing in sis_isi​. We write (s−i,xi)(\mathbf s_{-i},x_i)(s−i​,xi​) for the profile with agent iii's signal replaced by xxx, and (sA,0B)(\mathbf s_A,\mathbf 0_B)(sA​,0B​) for the profile that keeps the signals of the agents in AAA and sets those in BBB to 000.

A function www of the profile is SOS if for every coordinate jjj, all x,δ≥0x,\delta\ge0x,δ≥0 with x+δ≤k−1x+\delta\le k-1x+δ≤k−1, and grid profiles with s−j′≤s−j\mathbf s'_{-j}\le\mathbf s_{-j}s−j′​≤s−j​ coordinatewise,

w(s−j,x+δ)−w(s−j,x)  ≤  w(s−j′,x+δ)−w(s−j′,x).w(\mathbf s_{-j},x+\delta)-w(\mathbf s_{-j},x)\;\le\;w(\mathbf s'_{-j},x+\delta)-w(\mathbf s'_{-j},x).w(s−j​,x+δ)−w(s−j​,x)≤w(s−j′​,x+δ)−w(s−j′​,x).

The setting is SOS when every viTv_{iT}viT​ is.

A feasible allocation gives disjoint bundles T1,…,TnT_1,\dots,T_nT1​,…,Tn​; its welfare at s\mathbf ss is ∑iviTi(s)\sum_i v_{iT_i}(\mathbf s)∑i​viTi​​(s). A deterministic mechanism maps reported profiles to an allocation and payments. Agent iii's utility is her value, at the true profile, for the bundle she receives at the reported profile, minus her payment. The mechanism is ex-post IC if truthful reporting maximizes each agent's utility whenever the others report truthfully, and ex-post IR if that utility is nonnegative. A randomized mechanism is universally ex-post IC-IR if every deterministic mechanism in its support is.

The mechanism k-HL runs, with probability pRT=k−1k+3p_{RT}=\frac{k-1}{k+3}pRT​=k+3k−1​, Random Threshold: choose ℓ\ellℓ uniformly in {1,…,k−1}\{1,\dots,k-1\}{1,…,k−1}, call N≥ℓ={i:si≥ℓ}N_{\ge\ell}=\{i:s_i\ge\ell\}N≥ℓ​={i:si​≥ℓ} the high agents, allocate to them a feasible allocation maximizing ∑i∈N≥ℓviSi(sN<ℓ,ℓN≥ℓ)\sum_{i\in N_{\ge\ell}}v_{iS_i}(\mathbf s_{N_{<\ell}},\ell_{N_{\ge\ell}})∑i∈N≥ℓ​​viSi​​(sN<ℓ​​,ℓN≥ℓ​​), and charge agent iii receiving Tˉi\bar T_iTˉi​ the price viTˉi(s−i,si=ℓ−1)v_{i\bar T_i}(\mathbf s_{-i},s_i=\ell-1)viTˉi​​(s−i​,si​=ℓ−1). Otherwise it runs Random Sampling: split the agents uniformly at random into AAA and BBB, allocate to BBB a feasible allocation maximizing ∑i∈BviSi(sA,0B)\sum_{i\in B}v_{iS_i}(\mathbf s_A,\mathbf 0_B)∑i∈B​viSi​​(sA​,0B​), and charge nothing. In the Lean development (namespace InterdepSOS.KHL) these are rtAlloc, rtPay, rsAlloc and khlWelfare.

Formalization targets

Goal: Theorem 6.1 (p. 20)

For SOS valuations with kkk signal values, every Random Threshold component and every Random Sampling component is ex-post IC and IR, and for every grid profile s\mathbf ss and every feasible allocation T∗T^*T∗,

∑iviTi∗(s)  ≤  (k+3) E[welfare of k-HL at s],\sum_i v_{iT^*_i}(\mathbf s)\;\le\;(k+3)\,\mathbb E\bigl[\text{welfare of k-HL at }\mathbf s\bigr],i∑​viTi∗​​(s)≤(k+3)E[welfare of k-HL at s],

where the expectation is over ℓ\ellℓ, over (A,B)(A,B)(A,B) and over the coin choosing between the two mechanisms, and welfare is measured with true values at the truthful profile.

Milestones

  1. Displays (6)–(7): the welfare of any allocation is at most OTHER+SELF\mathsf{OTHER}+\mathsf{SELF}OTHER+SELF, where OTHER=∑iviTi(s−i,0i)\mathsf{OTHER}=\sum_i v_{iT_i}(\mathbf s_{-i},0_i)OTHER=∑i​viTi​​(s−i​,0i​) and SELF=∑ℓ=1k−1∑i:si=ℓviTi(0−i,si)\mathsf{SELF}=\sum_{\ell=1}^{k-1}\sum_{i:s_i=\ell}v_{iT_i}(\mathbf 0_{-i},s_i)SELF=∑ℓ=1k−1​∑i:si​=ℓ​viTi​​(0−i​,si​).
  2. Random Sampling is ex-post IC-IR for every partition.
  3. Random Threshold is ex-post IC-IR for every threshold.
  4. Lemma 6.2: SELF≤(k−1) E[welfare of Random Threshold]\mathsf{SELF}\le(k-1)\,\mathbb E[\text{welfare of Random Threshold}]SELF≤(k−1)E[welfare of Random Threshold].
  5. Lemma 6.3: OTHER≤4 E[welfare of Random Sampling]\mathsf{OTHER}\le4\,\mathbb E[\text{welfare of Random Sampling}]OTHER≤4E[welfare of Random Sampling].

Significance

Theorem 6.1 is the paper's answer for general combinatorial auctions with single-dimensional signals and arbitrary bundle valuations, a setting where single crossing gives nothing and where the random-sampling technique of the single-parameter case (Theorem 4.1) is not enough on its own: Random Sampling alone covers only the contribution of the other agents' signals. The ratio k+3k+3k+3 depends on the size of the signal space but not on the number of agents or items. The same decomposition, with Random Threshold replaced by a bucketing mechanism, yields the (2log⁡2k+4)(2\log_2k+4)(2log2​k+4)-approximation for strong-SOS valuations (Theorem 6.5), so milestones 1 and 5 are shared by both results.

The result is proved in the paper; no machine-checked version is known to exist. A formalization fixes the incentive argument precisely (which data the allocation may depend on, how ties are broken) and makes the uniform averages over thresholds and partitions explicit. The development reuses the Key Lemma 3.1 of the paper, which is posed in a sibling mission of this series.

Difficulty

Two points resist a direct argument. First, incentive compatibility of Random Threshold requires that a high agent who changes her report within {ℓ,…,k−1}\{\ell,\dots,k-1\}{ℓ,…,k−1} leaves the allocation unchanged, and this is true only if the argmax rule sees the reports through the proxy data (sN<ℓ,ℓN≥ℓ)(\mathbf s_{N_{<\ell}},\ell_{N_{\ge\ell}})(sN<ℓ​​,ℓN≥ℓ​​) alone: an argmax rule that breaks ties using the full report profile can make a high agent's bundle, and hence her utility, depend on her report. The formalization must therefore state precisely what the allocation rule may depend on. Second, the welfare bound for Random Sampling rests on the Key Lemma 3.1 (zeroing a uniformly random half of the other signals keeps, in expectation, half of an SOS value), which here has to hold on the discrete grid {0,…,k−1}n\{0,\dots,k-1\}^n{0,…,k−1}n, with SOS assumed only there; the expectations over partitions and thresholds are finite averages whose bookkeeping (agents in AAA receive nothing, agents outside N≥ℓN_{\ge\ell}N≥ℓ​ receive nothing) must match the mechanism exactly.

Formalization scope

Agents are Fin n, items Fin m, bundles Finset (Fin m), signals natural numbers with the grid condition InGrid k s. All hypotheses on valuations (nonnegativity, monotonicity, strict monotonicity in the own signal, SOS) are imposed on grid profiles only, with the shifted coordinate staying below kkk; a condition on all of Nn\mathbb N^nNn would be stronger than the paper's. The empty bundle is worth 000 and the monotonicity clauses concern nonempty bundles. Allocations are maps Fin n → Finset (Fin m) with pairwise disjoint values; agents outside the eligible set receive ∅\emptyset∅.

The argmax allocations are produced by arbitrary selectors, functions of the threshold (or of BBB) and of the proxy profile, required to return a feasible maximizer of the proxy welfare; the theorems quantify over all such selectors. Expectations are finite uniform averages, 1k−1∑ℓ=1k−1\frac1{k-1}\sum_{\ell=1}^{k-1}k−11​∑ℓ=1k−1​ and 2−n∑B⊆[n]2^{-n}\sum_{B\subseteq[n]}2−n∑B⊆[n]​, never an existential or universal quantifier over ℓ\ellℓ or BBB. The ratio is stated against every feasible allocation, with welfare at true values, never with proxy values and never through a supremum. IC and IR are stated for every component of the mixture, with the paper's explicit payments. Random Sampling zeroes the signals of all of BBB, the agent's own included (the page's "vij(sA,0B)v_{ij}(\mathbf s_A,\mathbf 0_B)vij​(sA​,0B​)" is read as viT(sA,0B)v_{iT}(\mathbf s_A,\mathbf 0_B)viT​(sA​,0B​)). For k=1k=1k=1, pRT=0p_{RT}=0pRT​=0 and the threshold average is the empty sum.

Lemmas 6.2 and 6.3 and displays (6)–(7) are stated for every feasible allocation (every assignment, for (6)–(7)), which is stronger than the paper's statements for a welfare-maximizing T∗T^*T∗.

Needed infrastructure: the Key Lemma 3.1 on the discrete grid, finite averages over subsets, and a lemma that a maximizer over a subfamily of allocations dominates any restriction of a feasible allocation. Contributions of proofs of the milestones in any order are welcome; the IC-IR milestones are independent of the welfare milestones.

The source is the arXiv preprint arXiv:1903.08384v2; the Mathematics of Operations Research (2024) version is not the cited source, and its numbering may differ.

Selected references

  • A. Eden, M. Feldman, A. Fiat, K. Goldner, A. R. Karlin, Combinatorial Auctions with Interdependent Valuations: SOS to the Rescue, arXiv:1903.08384v2, 2019. https://arxiv.org/abs/1903.08384v2
  • A. Eden, M. Feldman, A. Fiat, K. Goldner, Interdependent Values without Single-Crossing, ACM EC 2018 (cited as [Eden et al., 2018] in the source).
  • E. Maskin, Auctions and Privatization, in H. Siebert (ed.), Privatization, 1992 (cited as [Maskin, 1992] in the source).
  • P. Milgrom, R. Weber, A Theory of Auctions and Competitive Bidding, Econometrica 50(5), 1982. https://doi.org/10.2307/1911865
  • P. Dasgupta, E. Maskin, Efficient Auctions, Quarterly Journal of Economics 115(2), 2000. https://doi.org/10.1162/003355300554737
  • P. Jehiel, B. Moldovanu, Efficient Design with Interdependent Valuations, Econometrica 69(5), 2001. https://doi.org/10.1111/1468-0262.00248
9 thms2 active usersReviewed
🏆Completed
EconomicsOptimization·Captain: mikedeng1

Climate Impact Investing 2: With Poisson Climate Uncertainty λ, If the Green Portfolio Is Green Then y*_λ Rises to 1 in λ, So Equilibrium Emissions Rise as Uncertainty GrowsResearch Paper

Motivation

Climate impact investing refers to investors who tilt their portfolios away from companies with large greenhouse-gas emissions. Its stated aim goes beyond aligning portfolios with values: by raising the cost of capital of polluting companies, it is meant to change what those companies do. De Angelis, Tankov and Zerbib (SSRN 3562534, published in Management Science, 2022, doi:10.1287/mnsc.2022.4472) build an equilibrium model in which this mechanism can be computed. Green investors penalize the expected climate externalities of companies. Companies choose emission schedules to maximize their market value net of abatement costs. Prices, portfolios and emissions are determined jointly.

Section 4 of the paper asks what happens when the green investors are uncertain about future climate externalities, for instance because news on climate risk or regulation arrives in rare large shocks. Its answer is that, in the most common market configuration, more uncertainty makes green investors hedge by holding more brown assets, which weakens the incentive to abate, so that equilibrium emissions rise as climate uncertainty grows. This mission formalizes that result and the chain of statements behind it.

Setting

Fix a date ttt in a horizon [0,T][0,T][0,T]; every object below is evaluated at that date, and its subscript is dropped where harmless. There are nnn companies, indexed by iii, with asset covariance matrix Σt\Sigma_tΣt​ (positive definite). Green investors hold wealth share α∈(0,1)\alpha\in(0,1)α∈(0,1), regular investors the rest, with risk aversions γg,γr>0\gamma^g,\gamma^r>0γg,γr>0.

Company iii emits at rate ψti≥0\psi^i_t\ge 0ψti​≥0 and pays the marginal abatement cost cti≥0c^i_t\ge 0cti​≥0. The green investors attach to company iii the climate externality θti(ψ)=κ0,t−κt2ψ2\theta^i_t(\psi)=\kappa_{0,t}-\frac{\kappa_t}{2}\psi^2θti​(ψ)=κ0,t​−2κt​​ψ2, the companies use θtc,i(ψ)=κ0,tc−κtc2ψ2\theta^{c,i}_t(\psi)=\kappa^c_{0,t}-\frac{\kappa^c_t}{2}\psi^2θtc,i​(ψ)=κ0,tc​−2κtc​​ψ2, and all κ\kappaκ's are positive. With a rate of time preference ρ>0\rho>0ρ>0, the time factors are βtc=(e−ρt−e−ρT)/(1−e−ρT)\beta^c_t=(e^{-\rho t}-e^{-\rho T})/(1-e^{-\rho T})βtc​=(e−ρt−e−ρT)/(1−e−ρT) and βt=(1−e−ρt)/(1−e−ρT)\beta_t=(1-e^{-\rho t})/(1-e^{-\rho T})βt​=(1−e−ρt)/(1−e−ρT).

Climate uncertainty is a Poisson process of intensity λ>0\lambda>0λ>0: a smaller λ\lambdaλ means rarer, larger shocks, i.e. more uncertainty. For a fixed externality vector θ\thetaθ, the equilibrium of Proposition 5 is described by a scalar yλ>0y_\lambda>0yλ​>0 solving

yλ=exp⁡{−αγgλ(1⊤θ+yλγrθ⊤Σt−1θ)},y_\lambda=\exp\Big\{-\frac{\alpha\gamma^g}{\lambda}\Big(\mathbf 1^\top\theta+\frac{y_\lambda}{\gamma^r}\theta^\top\Sigma_t^{-1}\theta\Big)\Big\},yλ​=exp{−λαγg​(1⊤θ+γryλ​​θ⊤Σt−1​θ)},

and the green portfolio is Ng,λ=α(1+yλγrΣt−1θ)N^{g,\lambda}=\alpha(\mathbf 1+\frac{y_\lambda}{\gamma^r}\Sigma_t^{-1}\theta)Ng,λ=α(1+γryλ​​Σt−1​θ). Without uncertainty, y=1y=1y=1 and the portfolio is NgN^gNg. When the companies take yyy as given (the large-market assumption), company iii's optimal emission rate is

ψti(y)=ctiαβtκt y+βtcκtc,\psi^i_t(y)=\frac{c^i_t}{\alpha\beta_t\kappa_t\,y+\beta^c_t\kappa^c_t},ψti​(y)=αβt​κt​y+βtc​κtc​cti​​,

and yyy itself must then solve the fixed-point equation y=exp⁡{−αγgλg∗(y)}y=\exp\{-\frac{\alpha\gamma^g}{\lambda}g^*(y)\}y=exp{−λαγg​g∗(y)}, where

g∗(y)=1⊤θt(ψt(y))+yγrθt(ψt(y))⊤Σt−1θt(ψt(y)).g^*(y)=\mathbf 1^\top\theta_t(\psi_t(y))+\frac{y}{\gamma^r}\theta_t(\psi_t(y))^\top\Sigma_t^{-1}\theta_t(\psi_t(y)).g∗(y)=1⊤θt​(ψt​(y))+γry​θt​(ψt​(y))⊤Σt−1​θt​(ψt​(y)).

Its solution is yλ∗y^*_\lambdayλ∗​. Finally, ψt∗,0=ψt(1)\psi^{*,0}_t=\psi_t(1)ψt∗,0​=ψt​(1) is the schedule without uncertainty.

Formalization targets

Goal: Proposition 8(iii)

Assume condition (24) at the date ttt: ∑j(Σt−1)ij y θtj(ψtj(y))≥−γr/2\sum_j(\Sigma_t^{-1})_{ij}\,y\,\theta^j_t(\psi^j_t(y))\ge-\gamma^r/2∑j​(Σt−1​)ij​yθtj​(ψtj​(y))≥−γr/2 for all iii and all y>0y>0y>0. Let λ↦yλ∗\lambda\mapsto y^*_\lambdaλ↦yλ∗​ solve the fixed-point equation. Then the sign of the green portfolio's externality without uncertainty decides the direction of the response:

θt(ψt∗,0)⊤Ntg>0 ⟹ yλ∗↑1 strictly in λ,λ↦ψt∗,i nonincreasing,\theta_t(\psi^{*,0}_t)^\top N^g_t>0\ \Longrightarrow\ y^*_\lambda\uparrow 1\ \text{strictly in }\lambda,\quad \lambda\mapsto\psi^{*,i}_t\ \text{nonincreasing},θt​(ψt∗,0​)⊤Ntg​>0 ⟹ yλ∗​↑1 strictly in λ,λ↦ψt∗,i​ nonincreasing,

the opposite if θt(ψt∗,0)⊤Ntg<0\theta_t(\psi^{*,0}_t)^\top N^g_t<0θt​(ψt∗,0​)⊤Ntg​<0, and yλ∗≡1y^*_\lambda\equiv 1yλ∗​≡1 with unchanged emissions if it is 000.

Milestones

In the order of the attack:

  1. Proposition 7: for fixed y>0y>0y>0, ψti(y)\psi^i_t(y)ψti​(y) is the unique maximizer of the company's pointwise objective.
  2. Proposition 8(i): the fixed-point equation has a positive solution for every λ>0\lambda>0λ>0.
  3. Under (24), g∗g^*g∗ is increasing.
  4. Proposition 8(ii): under (24), the solution is unique.
  5. ψt∗(1)=ψt∗,0\psi^*_t(1)=\psi^{*,0}_tψt∗​(1)=ψt∗,0​, and αg∗(1)=θt(ψt∗,0)⊤Ntg\alpha g^*(1)=\theta_t(\psi^{*,0}_t)^\top N^g_tαg∗(1)=θt​(ψt∗,0​)⊤Ntg​.
  6. Equation (20) has exactly one positive solution yλy_\lambdayλ​.
  7. Proposition 6(ii)–(iv): the same three-way comparative static at a fixed schedule, for yλy_\lambdayλ​, the green portfolio and the expected returns.

Companion statements cover Proposition 6(i) (the green portfolio's market risk increases in λ\lambdaλ), Lemma 1, and the algebraic core of Proposition 5.

Significance

The result. Proposition 8(iii) is the paper's headline claim about uncertainty, and it is quoted in its abstract: uncertainty about future climate externalities, by making green investors hedge, can push companies to increase their emissions. The paper's Lemma 1 shows that the positive case, a green portfolio with positive climate externality, is the common one. The sign condition is therefore not a curiosity. It separates markets where uncertainty undermines impact investing from markets where it strengthens it.

Formalizing it. The proofs in the appendix are short and leave several steps implicit, and in two places the printed formulas do not match their own derivation (see the scope section). A machine-checked version settles the precise hypotheses under which the comparative statics hold. It also provides reusable statements about scalar fixed-point equations of the form −λlog⁡y=G(y)-\lambda\log y=G(y)−λlogy=G(y) with nondecreasing GGG. No part of this paper has been formalized before.

Difficulty

At a fixed schedule, everything follows from the fact that ggg is affine and nondecreasing in yyy. Once the schedule is endogenous, g∗g^*g∗ is nonlinear and in general not monotone, so neither uniqueness nor monotonicity in λ\lambdaλ comes for free. The work lies in turning condition (24) into monotonicity of g∗g^*g∗. That requires differentiating the quadratic form θ(ψ(y))⊤Σ−1θ(ψ(y))\theta(\psi(y))^\top\Sigma^{-1}\theta(\psi(y))θ(ψ(y))⊤Σ−1θ(ψ(y)) through the schedule and controlling its sign company by company. The limit yλ∗→1y^*_\lambda\to 1yλ∗​→1 as λ→∞\lambda\to\inftyλ→∞ needs bounds on g∗g^*g∗ along the solution path rather than the formal Taylor expansion in 1/λ1/\lambda1/λ the paper gives for (20).

Formalization scope

The stochastic layer is not formalized: Brownian cash-flow news, subjective measures built by Girsanov's theorem, CARA utility maximization, the Poisson process of climate shocks, and Propositions 1 and 5 as equilibrium statements. The statements start from the objects the proofs start from: the first-order and market-clearing system (45), and equations (20), (22) and (23). Everything is stated at one fixed date ttt, with vectors in Rn\mathbb R^nRn indexed by Fin n, Σt\Sigma_tΣt​ positive definite and Σt−1\Sigma_t^{-1}Σt−1​ Mathlib's matrix inverse.

The standing assumptions are hypotheses of the statements:

  • ρ,T>0\rho,T>0ρ,T>0 and t∈[0,T]t\in[0,T]t∈[0,T];
  • 0<α<10<\alpha<10<α<1;
  • γr,γg>0\gamma^r,\gamma^g>0γr,γg>0;
  • all κ\kappaκ's positive;
  • cti≥0c^i_t\ge0cti​≥0.

The relation α=γr/(γr+γg)\alpha=\gamma^r/(\gamma^r+\gamma^g)α=γr/(γr+γg) is assumed only where it is used, in the core of Proposition 5. The solution maps λ↦yλ\lambda\mapsto y_\lambdaλ↦yλ​ and λ↦yλ∗\lambda\mapsto y^*_\lambdaλ↦yλ∗​ enter only through the hypothesis that each value solves its equation. A theorem that assumed monotonicity of g∗g^*g∗, uniqueness, or the sign of g∗(1)g^*(1)g∗(1) would trivialize the goal; the goal assumes only condition (24).

Disclosed corrections of the printed text:

  • (23) and g∗g^*g∗. The page prints a factor αy/γr\alpha y/\gamma^rαy/γr in the quadratic term. Footnote 25 derives (23) from (20), which has y/γry/\gamma^ry/γr, and only that version makes the sign test of (iii) agree with the sign of g∗(1)g^*(1)g∗(1). The formalization uses y/γry/\gamma^ry/γr.
  • (24). The derivative of the quadratic form on p. 72 omits the factor 2 that the symmetry of Σ−1\Sigma^{-1}Σ−1 produces. With the corrected g∗g^*g∗, the argument needs the bound −γr/2-\gamma^r/2−γr/2, not −γr/α-\gamma^r/\alpha−γr/α. Whether uniqueness holds under the printed bound is not claimed.
  • Existence at t=Tt=Tt=T. The proof of (i) uses βtc>0\beta^c_t>0βtc​>0, so existence is stated for t∈[0,T)t\in[0,T)t∈[0,T).
  • Asymptotic uniqueness. The last sentence of (ii), uniqueness as λ→∞\lambda\to\inftyλ→∞, has no proof in the paper and is not stated.

Two readings are fixed. "Monotonically increasing" for yλy_\lambdayλ​ is strict. The emission response is weak, because at t=0t=0t=0 the schedule does not depend on yyy. "Reallocate towards brown assets" means that the green portfolio's climate externality θ⊤Ng,λ\theta^\top N^{g,\lambda}θ⊤Ng,λ falls as λ\lambdaλ falls.

The development needs elementary real analysis: the intermediate value theorem on (0,∞)(0,\infty)(0,∞), monotonicity from derivatives, and limits at infinity. It also needs finite-dimensional linear algebra for positive definite matrices. The lemmas about −λlog⁡y=G(y)-\lambda\log y=G(y)−λlogy=G(y) are reusable beyond this mission. Proofs of the companion statements, which are algebraic, are welcome as warm-ups.

Selected references

  • T. De Angelis, P. Tankov, O. D. Zerbib, Climate Impact Investing, SSRN 3562534, version of June 25, 2021. https://ssrn.com/abstract=3562534
  • T. De Angelis, P. Tankov, O. D. Zerbib, Climate Impact Investing, Management Science, 2022. https://doi.org/10.1287/mnsc.2022.4472
  • L. Pástor, R. F. Stambaugh, L. A. Taylor, Sustainable investing in equilibrium, Journal of Financial Economics 142(2), 2021. https://doi.org/10.1016/j.jfineco.2020.12.011
13 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingOptimizationReinforcement Learning·Captain: mikedeng1

A First-Order Approach to Accelerated Value Iteration 4: Safe Accelerated Value Iteration Converges to v* at Rate O(λ′^s) for Every λ′ ∈ [λ, 1)Research Paper

Motivation

Value iteration (VI) is the standard method for computing the optimal value function of a discounted Markov decision process (MDP). It applies the Bellman operator repeatedly, and because that operator is a λ\lambdaλ-contraction in the sup norm, the error after sss steps is at most λs\lambda^sλs times the initial error. When the discount factor λ\lambdaλ is close to 111, as in long-horizon planning, this rate is slow.

Goyal and Grand-Clément (arXiv:1905.09963, Operations Research 2023) read value iteration as a gradient-type method and transfer momentum schemes from convex optimization (Nesterov acceleration, heavy-ball momentum) to the Bellman operator. On reversible policy chains these accelerated schemes provably converge faster than VI. On general MDPs, however, the accelerated iterates need not converge at all: the paper exhibits instances on which Accelerated Value Iteration (A-VI) oscillates or diverges. Section 7 of the paper resolves this tension with Safe Accelerated Value Iteration (S-AVI, Algorithm 1), which tries an accelerated step at every period and keeps it only when it makes enough progress on the Bellman equation v=T(v)v = T(v)v=T(v). This mission formalizes the convergence guarantee of S-AVI, Theorem 7.1.

Setting

Let S\mathbb SS be a finite set of states and A\mathbb AA a nonempty finite set of actions. A discounted MDP is given by a transition kernel PPP, with Piaj≥0P_{iaj}\ge 0Piaj​≥0 the probability of moving from state iii to state jjj under action aaa and ∑jPiaj=1\sum_j P_{iaj} = 1∑j​Piaj​=1; a reward ria∈Rr_{ia}\in\mathbb Rria​∈R for each state-action pair; and a discount factor λ∈(0,1)\lambda \in (0,1)λ∈(0,1). The Bellman operator T:RS→RST : \mathbb R^{\mathbb S} \to \mathbb R^{\mathbb S}T:RS→RS is

T(v)i=max⁡a∈A{ria+λ∑jPiaj vj}.T(v)_i = \max_{a\in\mathbb A}\Big\{ r_{ia} + \lambda \sum_{j} P_{iaj}\, v_j \Big\}.T(v)i​=a∈Amax​{ria​+λj∑​Piaj​vj​}.

The sup norm is ∥v∥∞=max⁡i∣vi∣\|v\|_\infty = \max_i |v_i|∥v∥∞​=maxi​∣vi​∣. The optimal value function v∗v^*v∗ is the unique fixed point of TTT. For a vector vvv, the quantity ∥v−T(v)∥∞\|v - T(v)\|_\infty∥v−T(v)∥∞​ is its Bellman residual.

S-AVI (Algorithm 1) takes a scalar λ′∈[λ,1)\lambda' \in [\lambda, 1)λ′∈[λ,1), step sizes α,γ>0\alpha, \gamma > 0α,γ>0 and any starting vector v0v_0v0​. It sets v1=T(v0)v_1 = T(v_0)v1​=T(v0​), and at each period s≥1s \ge 1s≥1 forms

hs=vs+γ (vs−vs−1),vs+1/2=hs−α (hs−T(hs)).h_s = v_s + \gamma\,(v_s - v_{s-1}), \qquad v_{s+1/2} = h_s - \alpha\,\big(h_s - T(h_s)\big).hs​=vs​+γ(vs​−vs−1​),vs+1/2​=hs​−α(hs​−T(hs​)).

If ∥vs+1/2−T(vs+1/2)∥∞≤λ′ s+1 ∥v0−T(v0)∥∞\|v_{s+1/2} - T(v_{s+1/2})\|_\infty \le \lambda'^{\,s+1}\,\|v_0 - T(v_0)\|_\infty∥vs+1/2​−T(vs+1/2​)∥∞​≤λ′s+1∥v0​−T(v0​)∥∞​, the accelerated candidate is accepted, vs+1=vs+1/2v_{s+1} = v_{s+1/2}vs+1​=vs+1/2​; otherwise the algorithm takes a value-iteration step, vs+1=T(vs)v_{s+1} = T(v_s)vs+1​=T(vs​). In the Lean development the MDP is AccelVI.SafeAVI.MDP with validity predicate MDP.Valid, the operator is bellman M, and the iterates are savi M lam' α γ v0 : ℕ → (S → ℝ).

Formalization targets

Goal: Theorem 7.1

For a valid MDP, any λ′∈[λ,1)\lambda' \in [\lambda, 1)λ′∈[λ,1), any α,γ>0\alpha, \gamma > 0α,γ>0 and any v0v_0v0​, the S-AVI iterates converge to v∗v^*v∗, and

vs=v∗+O(λ′ s),∀s≥0,v_s = v^* + O(\lambda'^{\,s}), \quad \forall s \ge 0,vs​=v∗+O(λ′s),∀s≥0,

that is, there is a constant CCC with ∥vs−v∗∥∞≤C λ′ s\|v_s - v^*\|_\infty \le C\,\lambda'^{\,s}∥vs​−v∗∥∞​≤Cλ′s for every s≥0s \ge 0s≥0. The constant is left unspecified, as in the paper.

Milestones

  1. TTT is a λ\lambdaλ-contraction: ∥T(v)−T(w)∥∞≤λ∥v−w∥∞\|T(v) - T(w)\|_\infty \le \lambda\|v - w\|_\infty∥T(v)−T(w)∥∞​≤λ∥v−w∥∞​ (§2, p. 3).
  2. The first period: ∥v1−T(v1)∥∞≤λ∥v0−T(v0)∥∞≤λ′∥v0−T(v0)∥∞\|v_1 - T(v_1)\|_\infty \le \lambda\|v_0 - T(v_0)\|_\infty \le \lambda'\|v_0 - T(v_0)\|_\infty∥v1​−T(v1​)∥∞​≤λ∥v0​−T(v0​)∥∞​≤λ′∥v0​−T(v0​)∥∞​ (p. 13).
  3. Geometric decay of the residual: ∥vs−T(vs)∥∞≤λ′ s∥v0−T(v0)∥∞\|v_s - T(v_s)\|_\infty \le \lambda'^{\,s}\|v_0 - T(v_0)\|_\infty∥vs​−T(vs​)∥∞​≤λ′s∥v0​−T(v0​)∥∞​ for all sss (p. 14).
  4. The residual controls the error: ∥v−v∗∥∞≤(1−λ)−1∥v−T(v)∥∞\|v - v^*\|_\infty \le (1-\lambda)^{-1}\|v - T(v)\|_\infty∥v−v∗∥∞​≤(1−λ)−1∥v−T(v)∥∞​ for every vvv (p. 14).

Significance

The result. Theorem 7.1 says that the safeguard costs nothing in the worst case: S-AVI converges on every MDP at rate λ′\lambda'λ′, and with λ′=λ\lambda' = \lambdaλ′=λ it matches the rate of value iteration, which Theorem 6.3 of the same paper shows cannot be beaten by any first-order method uniformly over MDPs. At the same time it accepts accelerated steps whenever they reduce the residual fast enough, so it keeps the empirical speed-ups of A-VI. Remark 7.2 of the paper describes the role of λ′\lambda'λ′: values closer to 111 admit more accelerated steps. The guarantee also gives a computable stopping rule, since the residual bounds the distance to v∗v^*v∗.

Formalizing it. The result is proved in the paper; to our knowledge it has not been machine-checked. This mission produces a Lean statement of the finite discounted MDP layer, the Bellman operator and Algorithm 1 itself (including its two-step recursion and its data-dependent branch), and a formal proof that the safeguarded iteration converges. The contraction property of TTT and the residual-to-error bound are reusable for any later value-iteration development on the platform. Three sibling missions of this series pose the paper's other main results: the rate of Accelerated Value Computation on reversible chains (Theorem 5.1), the rate of Momentum Value Computation (Theorem 5.5), and the first-order lower bound (Theorem 6.3).

Difficulty

The accelerated candidate vs+1/2v_{s+1/2}vs+1/2​ is built from two past iterates through a momentum step, and on a general MDP nothing controls it: A-VI is not a descent method, and its iterates may diverge. The natural first attempt, proving that A-VI steps contract the error, therefore fails. The difficulty in the formal setting lies elsewhere: the iterates are defined by a two-step recursion with a branch on a real inequality, so any argument must handle both branches at every period and keep the paper's indexing straight (the threshold at period sss is λ′ s+1\lambda'^{\,s+1}λ′s+1 and it compares with the residual of v0v_0v0​, not of vsv_svs​). Existence and uniqueness of v∗v^*v∗ and the contraction property of a max of affine maps also need to be established for the specific operator, from the stochasticity of PPP.

Formalization scope

States and actions are finite types, [Fintype S], [Fintype A], and [Nonempty A] so that the maximum in TTT exists. Vectors are functions S → ℝ with Mathlib's sup norm, which is ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​. Rewards are arbitrary reals. The discount factor is M.lam with 0<λ<10 < \lambda < 10<λ<1 inside MDP.Valid; the initial distribution p0p_0p0​ of the paper's tuple is omitted because no statement uses it. The optimal value function enters each statement as a vector vstar with bellman M vstar = vstar; this is not vacuous, since a valid MDP has exactly one such vector. The scalar λ′\lambda'λ′ ranges over the closed interval [λ,1)[\lambda, 1)[λ,1), and α,γ>0\alpha, \gamma > 0α,γ>0 as in Algorithm 1, although the convergence argument does not need the step sizes to be positive. The sequence savi is indexed as the paper's vsv_svs​: its recursive case s + 2 is the paper's period s+1s+1s+1, with threshold lam' ^ (s + 2). "vs=v∗+O(λ′s)v_s = v^* + O(\lambda'^s)vs​=v∗+O(λ′s) for all s≥0s \ge 0s≥0" is encoded as a single constant valid for every sss, which is stronger than an eventual big-O.

A formalization that replaced the test by the per-step condition (7.2) of Remark 7.3, used the residual of vsv_svs​ instead of v0v_0v0​, fell back to T(vs+1/2)T(v_{s+1/2})T(vs+1/2​), or allowed λ≥1\lambda \ge 1λ≥1 would be a different theorem; none of these is posed. Remark 7.4's extension to arbitrary contractions is not posed either.

The development needs the contraction property of TTT, the Banach fixed-point bound relating error and residual, and an induction over the iterates. Proofs of the milestones as separate lemmas are welcome, as are general statements about safeguarded fixed-point iterations for λ\lambdaλ-contractions that specialize to this one.

Selected references

  • V. Goyal and J. Grand-Clément, A First-Order Approach to Accelerated Value Iteration, Operations Research, 2023; preprint arXiv:1905.09963v7, 2021. https://arxiv.org/abs/1905.09963
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994, reprinted 2014 (Chapter 6.3, value iteration). https://doi.org/10.1002/9780470316887
  • Y. Nesterov, A method for solving the convex programming problem with convergence rate O(1/k²), Soviet Mathematics Doklady 27, 1983.
8 thms2 active usersReviewed
Algorithmic Game TheoryEconomics·Captain: mikedeng1

Sharing Sequentially Triggered Losses: Automated Conflict Resolution Through Smart Contracts 3: The Midpoint Fixed-Fraction Rule Is the Shapley Value and the Nucleolus of the Liability GameResearch Paper

Motivation

When one breached contract forces the next party to breach its own contract, a single failure travels down a loss chain: agent 1 (the initiator) causes a loss ℓ1\ell_1ℓ1​ to agent 2, which can then no longer honour its agreement with agent 3 and causes it a loss ℓ2\ell_2ℓ2​, and so on until agent nnn causes a loss ℓn\ell_nℓn​ to a final victim. Gudmundsson, Hougaard and Ko (Management Science 70(3), 2024) ask how the total loss should be shared among the agents of the chain, with the aim of encoding the answer in a smart contract that settles such disputes automatically.

Their central rules are the fixed-fraction rules φλ\varphi^\lambdaφλ, under which every agent pays a fixed fraction λ\lambdaλ of the loss it caused and the initiator also pays the remaining fraction 1−λ1-\lambda1−λ of the total. An axiomatic characterization (their Theorem 1) singles out the whole family λ∈[0,1]\lambda\in[0,1]λ∈[0,1] but not a particular member. This mission formalizes the paper's game-theoretic argument for the midpoint λ=1/2\lambda=1/2λ=1/2: the cooperative game that records which coalitions are liable for which losses has the midpoint allocation as both its Shapley value and its nucleolus, the two best-known single-valued solutions of cooperative game theory.

Setting

Agents are N={1,…,n}N=\{1,\dots,n\}N={1,…,n} with n≥1n\ge1n≥1. A loss problem is a vector ℓ=(ℓ1,…,ℓn)∈Ln=R≥0n\ell=(\ell_1,\dots,\ell_n)\in\mathcal L^n=\mathbb R^n_{\ge0}ℓ=(ℓ1​,…,ℓn​)∈Ln=R≥0n​, where ℓi\ell_iℓi​ is the loss agent iii causes to agent i+1i+1i+1; the total loss is L=ℓ1+⋯+ℓnL=\ell_1+\dots+\ell_nL=ℓ1​+⋯+ℓn​. The fixed-fraction rule with parameter λ\lambdaλ assigns

φ1λ(ℓ)=λℓ1+(1−λ)L,φiλ(ℓ)=λℓi (i≥2).\varphi^\lambda_1(\ell)=\lambda\ell_1+(1-\lambda)L,\qquad \varphi^\lambda_i(\ell)=\lambda\ell_i\ (i\ge2).φ1λ​(ℓ)=λℓ1​+(1−λ)L,φiλ​(ℓ)=λℓi​ (i≥2).

A transferable-utility game on NNN is a function vvv assigning a real number to every coalition S⊆NS\subseteq NS⊆N. The liability game of ℓ\ellℓ is

vℓ(S)={∑i∈Sℓiif 1∈S,0otherwise:v_\ell(S)=\begin{cases}\sum_{i\in S}\ell_i&\text{if }1\in S,\\0&\text{otherwise:}\end{cases}vℓ​(S)={∑i∈S​ℓi​0​if 1∈S,otherwise:​

a coalition is liable for the losses its members caused only if it contains the initiator, without whom no loss would have occurred. The contribution of player iii to the grand coalition is Mi(v)=v(N)−v(N∖{i})M_i(v)=v(N)-v(N\setminus\{i\})Mi​(v)=v(N)−v(N∖{i}).

Two solution concepts are compared with φ1/2(ℓ)\varphi^{1/2}(\ell)φ1/2(ℓ).

  • The Shapley value gives player iii
Shi(v)=∑S⊆N∖{i}∣S∣! (n−∣S∣−1)!n!(v(S∪{i})−v(S)).\mathrm{Sh}_i(v)=\sum_{S\subseteq N\setminus\{i\}}\frac{|S|!\,(n-|S|-1)!}{n!}\bigl(v(S\cup\{i\})-v(S)\bigr).Shi​(v)=S⊆N∖{i}∑​n!∣S∣!(n−∣S∣−1)!​(v(S∪{i})−v(S)).
  • An imputation is a vector xxx with ∑i∈Nxi=v(N)\sum_{i\in N}x_i=v(N)∑i∈N​xi​=v(N) and xi≥v({i})x_i\ge v(\{i\})xi​≥v({i}) for all iii. The excess of SSS at xxx is e(S,x)=v(S)−∑i∈Sxie(S,x)=v(S)-\sum_{i\in S}x_ie(S,x)=v(S)−∑i∈S​xi​, and the excess vector θ(x)\theta(x)θ(x) lists the 2n2^n2n excesses in non-increasing order. The nucleolus ν(v)\nu(v)ν(v) (Schmeidler 1969) is the imputation whose excess vector is lexicographically smallest.

A game is convex if v(∅)=0v(\emptyset)=0v(∅)=0 and v(S)+v(T)≤v(S∪T)+v(S∩T)v(S)+v(T)\le v(S\cup T)+v(S\cap T)v(S)+v(T)≤v(S∪T)+v(S∩T) for all S,TS,TS,T.

Formalization targets

Goal: Theorem 3 (p. 15)

For every ℓ∈Ln\ell\in\mathcal L^nℓ∈Ln,

Sh(vℓ)=φ1/2(ℓ)andν(vℓ)=φ1/2(ℓ),\mathrm{Sh}(v_\ell)=\varphi^{1/2}(\ell)\qquad\text{and}\qquad \nu(v_\ell)=\varphi^{1/2}(\ell),Sh(vℓ​)=φ1/2(ℓ)andν(vℓ​)=φ1/2(ℓ),

where the second identity is stated as: φ1/2(ℓ)\varphi^{1/2}(\ell)φ1/2(ℓ) is an imputation of vℓv_\ellvℓ​ with lexicographically minimal sorted excess vector, and every imputation with this property equals φ1/2(ℓ)\varphi^{1/2}(\ell)φ1/2(ℓ).

Milestones (Appendix A, proof of Theorem 3, p. 24)

  1. vℓv_\ellvℓ​ is convex.
  2. (§4.2, p. 15; referenced, already on the platform) the core of a convex game is non-empty and contains its Shapley value, which applies to vℓv_\ellvℓ​ by milestone 1.
  3. M1(vℓ)=LM_1(v_\ell)=LM1​(vℓ​)=L and Mi(vℓ)=ℓiM_i(v_\ell)=\ell_iMi​(vℓ​)=ℓi​ for i≠1i\ne1i=1.
  4. Every nucleolus ν\nuν of vℓv_\ellvℓ​ satisfies νi=Mi(vℓ)/2=ℓi/2=φi1/2(ℓ)\nu_i=M_i(v_\ell)/2=\ell_i/2=\varphi^{1/2}_i(\ell)νi​=Mi​(vℓ​)/2=ℓi​/2=φi1/2​(ℓ) for i≠1i\ne1i=1, and ν1=φ11/2(ℓ)\nu_1=\varphi^{1/2}_1(\ell)ν1​=φ11/2​(ℓ).
  5. The Shapley value of vℓv_\ellvℓ​ is a nucleolus of vℓv_\ellvℓ​.

Significance

The result. Theorem 1 of the paper leaves a one-parameter family of rules, and a designer who writes the rule into a contract must still choose λ\lambdaλ. Theorem 3 gives a reason for λ=1/2\lambda=1/2λ=1/2 that does not depend on the axioms: if losses are treated as the worth of coalitions, two solution concepts that are built on unrelated principles (average marginal contributions on one side, lexicographic minimization of complaints on the other) both return φ1/2(ℓ)\varphi^{1/2}(\ell)φ1/2(ℓ). Together with the paper's Theorem 2 (equidistance from ideal allocations, a separate mission of this series) it makes the midpoint the paper's recommended rule.

Formalizing it. The paper proves Theorem 3 by citing two results of Muto, Nakayama, Potters and Tijs (1988) on big boss games, the nucleolus formula (their Theorem 4.2) and the coincidence of Shapley value and nucleolus for convex big boss games (their Theorem 4.5); the paper itself proves only convexity and the marginal contributions. A formal proof must therefore establish the nucleolus of vℓv_\ellvℓ​ directly from Schmeidler's lexicographic definition. No nucleolus definition exists on the platform (searched 2026-10-14), and this mission introduces one. The Shapley value and convex games are reused from the platform's published definitions, and the core-contains-the-Shapley-value theorem for convex games is already proved there.

Difficulty

Convexity and the marginal contributions are finite case analyses. The Shapley identity is a weighted sum over all coalitions not containing a player and needs the combinatorial identities behind the weights; for vℓv_\ellvℓ​ only the position of the initiator relative to SSS matters.

The substantive part is the nucleolus. Its definition compares sorted vectors of 2n2^n2n excesses, so an argument cannot treat one coalition at a time: showing that a candidate is lexicographically minimal requires controlling how a change of the payoff vector permutes the order of all excesses. The obvious first idea, minimizing only the largest excess (the least core), generally leaves a set of imputations rather than a point, so the comparison must go down the whole sorted list. Coalitions whose excesses tie, which happens for instance when some ℓi=0\ell_i=0ℓi​=0, are where informal arguments about sorted excess vectors are usually loose, and a formal proof has to handle them.

Formalization scope

  • Agents are Fin n with the initiator at index 0; [NeZero n] encodes n≥1n\ge1n≥1, which the paper assumes because 1∈N1\in N1∈N. Loss vectors are Fin n → ℝ with the hypothesis IsLoss ℓ (ℓi≥0\ell_i\ge0ℓi​≥0).
  • A game is Finset (Fin n) → ℝ. The Shapley value is the published Supermodularity.Cooperative.ShapleyValue and convexity the published Supermodularity.Cooperative.IsConvexGame (the supermodular form, equivalent to the increasing-marginal-contribution form used on p. 24).
  • The nucleolus is defined in the mission's Nucleolus file: imputations with efficiency and individual rationality, excess v(S)−∑i∈Sxiv(S)-\sum_{i\in S}x_iv(S)−∑i∈S​xi​ over all 2n2^n2n coalitions including ∅\emptyset∅ and NNN, sorted by ≥ into a list, and compared with List.Lex (· < ·). Including ∅\emptyset∅ and NNN does not change the order, since their excess is 000 at every imputation.
  • The goal states both identities. The nucleolus half is not replaced by membership in the core or by minimality of the largest excess, the minimization runs over imputations and not over all of Rn\mathbb R^nRn, and uniqueness is stated explicitly rather than taken from Schmeidler's theorem.
  • The paper never defines the nucleolus or the Shapley value; the standard definitions (Schmeidler 1969; Shapley 1953) are used.

Contributions welcome: proofs of the milestones; general lemmas on sorted excess vectors (e.g. Kohlberg-type criteria for the nucleolus), which are reusable for every later nucleolus result; Schmeidler's existence and uniqueness theorem; and the general big boss game results of Muto et al. (1988).

Selected references

  • J. Gudmundsson, J. L. Hougaard, C. Y. Ko, Sharing Sequentially Triggered Losses: Automated Conflict Resolution Through Smart Contracts, Management Science 70(3):1773–1786, 2024 (accepted manuscript, 2023). https://doi.org/10.1287/mnsc.2023.4772
  • S. Muto, M. Nakayama, J. Potters, S. Tijs, On big boss games, The Economic Studies Quarterly 39(4):303–321, 1988. https://doi.org/10.11398/economics1986.39.303
  • D. Schmeidler, The nucleolus of a characteristic function game, SIAM Journal on Applied Mathematics 17(6):1163–1170, 1969. https://doi.org/10.1137/0117107
  • L. S. Shapley, A value for n-person games, in Contributions to the Theory of Games II, Annals of Mathematics Studies 28, Princeton University Press, 1953, pp. 307–317. https://doi.org/10.1515/9781400881970-018
  • L. S. Shapley, Cores of convex games, International Journal of Game Theory 1:11–26, 1971. https://doi.org/10.1007/BF01753431
13 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingOptimizationReinforcement Learning·Captain: mikedeng1

A First-Order Approach to Accelerated Value Iteration 3: On the n-State Chain MDP, Every First-Order Method Has ‖v_s − v*‖∞ ≥ λ^s/(1+λ) for s = 1, …, n − 1Research Paper

Motivation

Value iteration (VI) is the basic algorithm for computing the optimal value function of a discounted Markov decision process (MDP). Its error contracts by the discount factor λ\lambdaλ per step, so it needs on the order of (1−λ)−1log⁡(1/ϵ)(1-\lambda)^{-1}\log(1/\epsilon)(1−λ)−1log(1/ϵ) iterations, which is slow when λ\lambdaλ is close to 111, the regime of interest in long-horizon planning and reinforcement learning. Goyal and Grand-Clément (arXiv:1905.09963, Operations Research 2023) read VI as gradient descent on the residual map v↦v−T(v)v \mapsto v - T(v)v↦v−T(v) and import Nesterov's acceleration and heavy-ball momentum from convex optimization. In convex optimization the corresponding lower bounds of Nesterov (2004/2013) show that acceleration is optimal among first-order methods. The question this mission formalizes is the MDP counterpart: can any method that only combines past iterates and their Bellman images beat the rate λ\lambdaλ of plain VI on every MDP? Theorem 6.3 of the paper answers no.

Setting

A finite MDP consists of a state set SSS with ∣S∣=n|S| = n∣S∣=n, a finite nonempty action set AAA, transition probabilities Piaj≥0P_{iaj} \ge 0Piaj​≥0 with ∑jPiaj=1\sum_j P_{iaj} = 1∑j​Piaj​=1, rewards ria∈Rr_{ia} \in \mathbb{R}ria​∈R, and a discount factor λ∈(0,1)\lambda \in (0,1)λ∈(0,1). Its Bellman operator T:Rn→RnT : \mathbb{R}^n \to \mathbb{R}^nT:Rn→Rn is

T(v)i=max⁡a∈A{ria+λ∑jPiajvj},i∈S,T(v)_i = \max_{a \in A}\Big\{ r_{ia} + \lambda \sum_{j} P_{iaj} v_j \Big\}, \qquad i \in S,T(v)i​=a∈Amax​{ria​+λj∑​Piaj​vj​},i∈S,

a λ\lambdaλ-contraction for the sup norm ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​. Its unique fixed point v∗v^*v∗ is the optimal value function.

A sequence (vs)s≥0(v_s)_{s \ge 0}(vs​)s≥0​ in Rn\mathbb{R}^nRn is a first-order sequence for TTT if

v0=0,vs+1∈span⁡{v0,…,vs,T(v0),…,T(vs)},s≥0.v_0 = 0, \qquad v_{s+1} \in \operatorname{span}\{v_0, \dots, v_s, T(v_0), \dots, T(v_s)\}, \quad s \ge 0 .v0​=0,vs+1​∈span{v0​,…,vs​,T(v0​),…,T(vs​)},s≥0.

VI from v0=0v_0 = 0v0​=0 (vs+1=T(vs)v_{s+1} = T(v_s)vs+1​=T(vs​)) and relaxed VI (vs+1=vs−αs(vs−T(vs))v_{s+1} = v_s - \alpha_s(v_s - T(v_s))vs+1​=vs​−αs​(vs​−T(vs​))) from 000 produce such sequences.

The chain MDP of Figure 1 has nnn states and a single action. State 111 is absorbing with reward r1=1r_1 = 1r1​=1; every state i≥2i \ge 2i≥2 moves deterministically to i−1i - 1i−1 and earns nothing. In Lean (namespace AccelVI.LowerBound) the MDP is MDP, validity is MDP.Valid, TTT is bellman, the chain is chainMDP n lam, and the first-order condition is IsFirstOrder T v.

Formalization targets

Goal: Theorem 6.3 (p. 12)

For every nnn, every λ∈(0,1)\lambda \in (0,1)λ∈(0,1), the fixed point v∗v^*v∗ of the Bellman operator TTT of the nnn-state chain, every first-order sequence (vs)(v_s)(vs​) for TTT, and every s∈{1,…,n−1}s \in \{1, \dots, n-1\}s∈{1,…,n−1},

∥vs−v∗∥∞≥λs1+λ.\|v_s - v^*\|_\infty \ge \frac{\lambda^s}{1+\lambda}.∥vs​−v∗∥∞​≥1+λλs​.

Milestones

  1. TTT is a λ\lambdaλ-contraction: ∥T(v)−T(w)∥∞≤λ∥v−w∥∞\|T(v) - T(w)\|_\infty \le \lambda\|v - w\|_\infty∥T(v)−T(w)∥∞​≤λ∥v−w∥∞​ (§2, p. 3).
  2. (3.5): (1−λ)∥v−w∥∞≤∥(I−T)(v)−(I−T)(w)∥∞(1-\lambda)\|v - w\|_\infty \le \|(I-T)(v) - (I-T)(w)\|_\infty(1−λ)∥v−w∥∞​≤∥(I−T)(v)−(I−T)(w)∥∞​ (p. 6).
  3. (3.6): ∥(I−T)(v)−(I−T)(w)∥∞≤(1+λ)∥v−w∥∞\|(I-T)(v) - (I-T)(w)\|_\infty \le (1+\lambda)\|v - w\|_\infty∥(I−T)(v)−(I−T)(w)∥∞​≤(1+λ)∥v−w∥∞​ (p. 6).
  4. On the chain, the value function is vi∗=λi−1/(1−λ)v^*_i = \lambda^{i-1}/(1-\lambda)vi∗​=λi−1/(1−λ), and it is the only fixed point of TTT (p. 12).
  5. On the chain, every first-order sequence satisfies vs,i=0v_{s,i} = 0vs,i​=0 for i≥s+1i \ge s+1i≥s+1 (p. 12).
  6. (6.2)–(6.4): on the chain, ∥vs−T(vs)∥∞≥λs\|v_s - T(v_s)\|_\infty \ge \lambda^s∥vs​−T(vs​)∥∞​≥λs for 1≤s≤n−11 \le s \le n-11≤s≤n−1 (p. 12).

Significance

The result. Theorem 6.3 shows that, measured by the number of Bellman evaluations, no first-order method improves on the worst-case rate λ\lambdaλ of value iteration uniformly over MDPs, as long as the number of steps is below the number of states. In convex optimization the analogous class admits acceleration from 1−μ/L1 - \mu/L1−μ/L to 1−μ/L1 - \sqrt{\mu/L}1−μ/L​; with μ=1−λ\mu = 1-\lambdaμ=1−λ, L=1+λL = 1+\lambdaL=1+λ, the analogue for MDPs would be a rate of about 1−1−λ1 - \sqrt{1-\lambda}1−1−λ​, and this theorem rules it out. It is the reason the paper's accelerated schemes are analysed under extra structure, such as reversible policy-evaluation chains, or are safeguarded.

Formalizing it. The result is proved in the paper; no machine-checked version exists. The mission produces a checked lower bound for fixed-point iterations of Bellman operators, the contraction inequalities (3.5)–(3.6) for a general finite MDP, and an explicit value function for a hard instance. The paper's other main results, Theorems 5.1, 5.5 and 7.1, are posed as the sibling missions 1, 2 and 4.

Difficulty

The obvious argument that the error is at least the contribution of states never reached fails without control of the span: the first-order class allows arbitrary real coefficients, including ones that change with sss and depend on all past iterates, so one has to show that no such combination puts mass on states beyond index sss. The support claim has to be carried through the nonlinear max in TTT, which is benign here only because the chain has a single action. The second ingredient converts a bound on a few coordinates of vs−v∗v_s - v^*vs​−v∗ into a bound in sup norm with the exact constant 1/(1+λ)1/(1+\lambda)1/(1+λ), which requires the two-sided inequalities (3.5)–(3.6) for I−TI - TI−T and the explicit value vs+1∗=λs/(1−λ)v^*_{s+1} = \lambda^s/(1-\lambda)vs+1∗​=λs/(1−λ).

Formalization scope

  • States are Fin n and are 0-based: the paper's state iii is index i−1i - 1i−1, so vi∗=λi−1/(1−λ)v^*_i = \lambda^{i-1}/(1-\lambda)vi∗​=λi−1/(1−λ) is lam ^ k / (1 - lam) at index kkk and "i≥s+1i \ge s+1i≥s+1" is s≤ks \le ks≤k. The action set of the chain is Unit.
  • ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ is Mathlib's sup norm on Fin n → ℝ. "span" is the real linear span Submodule.span ℝ, with both lists running to index sss inclusive.
  • v∗v^*v∗ enters the goal through its defining equation T(v∗)=v∗T(v^*) = v^*T(v∗)=v∗; it is not replaced by the explicit vector. The initial distribution p0p_0p0​ of the paper's MDP tuple is omitted, since no result here uses it.
  • Pinned quantifiers. As printed, Theorem 6.3 asserts that there exists an MDP instance, with nnn its own number of states; read literally, an instance with n=1n = 1n=1 has no admissible sss. The proof fixes an arbitrary nnn and λ∈(0,1)\lambda \in (0,1)λ∈(0,1) and uses the chain. The goal states that claim for every nnn and λ\lambdaλ on the explicit chain, which implies the printed form.
  • n−1n - 1n−1 is natural-number subtraction, so the goal has content exactly when n≥2n \ge 2n≥2.
  • The goal's constant is λs/(1+λ)\lambda^s/(1+\lambda)λs/(1+λ) as printed; the sharper bound λs/(1−λ)\lambda^s/(1-\lambda)λs/(1−λ), which the proof's chain also gives, is not the target.
  • The Bellman operator and the kernel condition are the published platform definitions FoundationsML_ReinforcementLearning_BellmanOperator and FoundationsML_ReinforcementLearning_IsTransitionKernel.
  • A trivializing formalization would take an unsatisfiable fixed-point hypothesis or an empty first-order class. Both are satisfiable: the explicit vector is a fixed point (milestone 4), and VI from 000 is first-order.

Contributions welcome: proofs of the contraction inequalities for general finite MDPs (reusable by every Bellman-operator mission), of the support recursion, and of the final chain of inequalities.

Selected references

  • V. Goyal and J. Grand-Clément, A First-Order Approach to Accelerated Value Iteration, Operations Research 71(2), 2023; preprint arXiv:1905.09963v7, 2021. https://arxiv.org/abs/1905.09963
  • Yu. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, Springer, 2004. https://doi.org/10.1007/978-1-4419-8853-9
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994/2014. https://doi.org/10.1002/9780470316887
10 thms2 active usersReviewed
CombinatoricsProbability·Captain: mikedeng1

Secretary Problems with Biased Evaluations Using Partial Ordinal Information I: ProxyLabel with a Width Estimate ω′ ≥ ω/c Is e^c(ω′+1)/(1−1/k)^{k−1}-CompetitiveResearch Paper

Motivation

In the classical secretary problem, candidates arrive one at a time in uniformly random order, and a decision maker must accept or reject each one irrevocably. The decision maker sees exact scores, or at least a total ranking of the candidates seen so far. In hiring, admissions and procurement the observed scores are often biased: evaluations of candidates from different groups, or produced by different evaluators, cannot be compared reliably, even when comparisons inside a group can. Salem and Gupta (SSRN 3444283; Management Science, 2023, doi:10.1287/mnsc.2023.4926) model this by giving the algorithm only the comparisons it can trust. These form a partial order on the candidates, and the true scores remain hidden.

The question is how much is lost when only partial ordinal information is available. The paper's answer is governed by the width of the partial order, the largest number of mutually incomparable candidates. Width 1 is the classical totally ordered problem. Width NNN means that no comparison is available at all. This mission formalizes the paper's first positive result with explicit constants: an algorithm, ProxyLabel, whose competitive ratio grows linearly in a known estimate of the width.

Setting

A finite set CCC of NNN elements carries a partial order ⪯\preceq⪯. Each element aaa has a hidden true score w(a)≥0w(a) \ge 0w(a)≥0. The scores are pairwise distinct and consistent with the order: a≺ba \prec ba≺b implies w(a)<w(b)w(a) < w(b)w(a)<w(b). The width ω\omegaω of (C,⪯)(C, \preceq)(C,⪯) is the largest size of an antichain, a set of pairwise incomparable elements.

The elements arrive in a uniformly random order. The algorithm knows NNN and a selection capacity k≥1k \ge 1k≥1. At each time it sees the comparisons of ⪯\preceq⪯ among the elements that have arrived. It may select at most kkk elements, and every decision is irrevocable. The offline optimum OPT\mathrm{OPT}OPT is the largest total score of at most kkk elements. An algorithm is ρ\rhoρ-competitive if, on every instance,

E[w(Alg)OPT]≥1ρ,\mathbb E\Big[\frac{w(\mathrm{Alg})}{\mathrm{OPT}}\Big] \ge \frac1\rho,E[OPTw(Alg)​]≥ρ1​,

where w(Alg)w(\mathrm{Alg})w(Alg) is the total score of the selected elements and the expectation is over the arrival order and the algorithm's randomness.

ProxyLabel (Algorithm 1 of the paper) takes a width estimate ω′∈N\omega' \in \mathbb Nω′∈N. It works as follows.

  1. Each element receives a label ℓ(a)∈{1,…,k}\ell(a) \in \{1, \dots, k\}ℓ(a)∈{1,…,k}, uniformly and independently.
  2. It draws m∼Bin(N,ω′/(ω′+1))m \sim \mathrm{Bin}(N, \omega'/(\omega'+1))m∼Bin(N,ω′/(ω′+1)) and lets the sample SSS be the first mmm arrivals. Sampled elements are never selected.
  3. A later element aaa is selected if it is maximal among all previously seen elements with its label, sampled or not, and no element with its label has been selected yet.

Each label class therefore contributes at most one element: the first non-sampled one that beats everything of its label seen before.

Formalization targets

Goal: Proposition 5.2

If ω′≥ω/c\omega' \ge \omega / cω′≥ω/c for some c≥1c \ge 1c≥1, then ProxyLabel has competitive ratio at most

ρ=ec(ω′+1)(1−1k)k−1 ≤ ec+1(ω′+1),\rho = \frac{e^{c}(\omega'+1)}{\big(1 - \frac1k\big)^{k-1}} \ \le\ e^{c+1}(\omega'+1),ρ=(1−k1​)k−1ec(ω′+1)​ ≤ ec+1(ω′+1),

with the convention 00=10^0 = 100=1. That is, E[w(Alg)]≥OPT/ρ\mathbb E[w(\mathrm{Alg})] \ge \mathrm{OPT}/\rhoE[w(Alg)]≥OPT/ρ.

Milestones, from the proof (pp. 16–17)

  1. Under uniform labels, the jjj-th best element is the maximum of its label class with probability (1−1/k)j−1≥(1−1/k)k−1≥1/e(1 - 1/k)^{j-1} \ge (1 - 1/k)^{k-1} \ge 1/e(1−1/k)j−1≥(1−1/k)k−1≥1/e.
  2. Display (3): conditional on that event, it is selected with probability at least 1ω′+1(1−1ω′+1)ω\frac{1}{\omega'+1}\big(1 - \frac{1}{\omega'+1}\big)^{\omega}ω′+11​(1−ω′+11​)ω.
  3. If ω/c≤ω′\omega/c \le \omega'ω/c≤ω′ with c≥1c \ge 1c≥1, this quantity is at least 1/(ec(ω′+1))1/(e^{c}(\omega'+1))1/(ec(ω′+1)).
  4. Hence each of the top kkk elements is selected with probability at least (1−1/k)k−1/(ec(ω′+1))(1 - 1/k)^{k-1}/(e^{c}(\omega'+1))(1−1/k)k−1/(ec(ω′+1)).
  5. E[w(Alg)]≥∑i=1kP(ai∈Alg) w(ai)\mathbb E[w(\mathrm{Alg})] \ge \sum_{i=1}^k \mathbb P(a_i \in \mathrm{Alg})\, w(a_i)E[w(Alg)]≥∑i=1k​P(ai​∈Alg)w(ai​) over the top kkk elements a1,…,aka_1, \dots, a_ka1​,…,ak​.

Companion: Corollary 5.1

With the exact width ω′=ω\omega' = \omegaω′=ω, the ratio is at most e(ω+1)/(1−1/k)k−1≤e2(ω+1)e(\omega+1)/(1 - 1/k)^{k-1} \le e^2(\omega+1)e(ω+1)/(1−1/k)k−1≤e2(ω+1), and it is e(ω+1)e(\omega+1)e(ω+1) for k=1k = 1k=1.

Significance

Proposition 5.2 shows that partial ordinal information costs at most a factor linear in the width, provided a width estimate within a constant factor is available. Proposition 5.1 of the same paper shows that no algorithm beats ratio ω\omegaω, so the bound is order-optimal. ProxyLabel is also the building block of the paper's width-free algorithm PosetLabel (§5.4), which estimates the width from a first sample and then runs ProxyLabel's selection phase.

The result is proved in the paper and has not been machine-checked. A complete development would give a formal model of online selection on a poset under random arrival, with an explicit selection rule and exact finite averages for probabilities. It would also contain a formal use of Dilworth's theorem inside a probabilistic argument, and the elementary inequalities (1−1/k)k−1≥1/e(1 - 1/k)^{k-1} \ge 1/e(1−1/k)k−1≥1/e and (1−1/(ω′+1))ω≥e−c(1 - 1/(\omega'+1))^{\omega} \ge e^{-c}(1−1/(ω′+1))ω≥e−c in the form the proof needs.

Difficulty

The events of the algorithm are tangled. The sample is a prefix of a random order with a random length. Whether an element is selected depends on everything that arrived before it, on the labels, and on whether an earlier element of the same label was already selected. The bound must be proved for every finite poset and every consistent scoring, with exact constants, on the finite probability space of arrival orders, labellings and sample sizes. The width enters only through the structure of a single label class, a subposet whose width is at most ω\omegaω, so the argument has to pass from the global width to an arbitrary random subposet.

A tempting simplification lets every passing unsampled element be selected. That algorithm can select several elements of one label, so its expected score is larger and the bound becomes easier. It is not ProxyLabel.

Formalization scope

  • Elements are a finite type α with a PartialOrder, so NNN is Fintype.card α. The width ω\omegaω is the published definition AppliedComb.Posets.width α, the maximum size of an antichain. Dilworth's theorem is the published, proved theorem AppliedComb.Posets.dilworth.
  • A consistent scoring is w:α→Rw : \alpha \to \mathbb Rw:α→R with w≥0w \ge 0w≥0, www injective, and a<b⇒w(a)<w(b)a < b \Rightarrow w(a) < w(b)a<b⇒w(a)<w(b). These three conditions are the paper's standing assumptions (§3.1, §3.3), not additions.
  • Arrival orders are bijections α ≃ Fin N, and labellings are functions α → Fin k. Labels are independent of the order, which is the same distribution as assigning labels on arrival.
  • Probabilities and expectations are explicit finite averages with weights 1/N!1/N!1/N!, 1/kN1/k^N1/kN and the binomial weights (Nm)pm(1−p)N−m\binom{N}{m}p^m(1-p)^{N-m}(mN​)pm(1−p)N−m with p=ω′/(ω′+1)p = \omega'/(\omega'+1)p=ω′/(ω′+1).
  • The selection rule is encoded exactly. An element is selected iff it is unsampled, no earlier element of its label (sampled or not) is above it, and no earlier unsampled element of its label passed the same test.
  • OPT is the maximum of ∑a∈sw(a)\sum_{a \in s} w(a)∑a∈s​w(a) over sets with ∣s∣≤k|s| \le k∣s∣≤k, so it is the total score when k≥Nk \ge Nk≥N.
  • The competitive ratio is stated as OPT/ρ≤E[w(Alg)]\mathrm{OPT}/\rho \le \mathbb E[w(\mathrm{Alg})]OPT/ρ≤E[w(Alg)]. This agrees with Definition 3.4 when OPT>0\mathrm{OPT} > 0OPT>0; the page's ratio is undefined when OPT=0\mathrm{OPT} = 0OPT=0.
  • (1−1/k)k−1(1 - 1/k)^{k-1}(1−1/k)k−1 has a natural exponent, so k=1k = 1k=1 gives 00=10^0 = 100=1. The width estimate ω′\omega'ω′ is a natural number.
  • The proposition's "interval order" is a slip of the page: the algorithm and the proof concern arbitrary posets, and the goal is stated for every finite poset.
  • The order-optimality clause of Corollary 5.1 refers to Proposition 5.1, the subject of mission II of this series, and is not stated here.
  • The goal is a statement about the full expectation of the selected score over arrival order, labels and sample size. It is not the conditional bound (3). A formalization in which several elements per label can be selected, or in which "previously seen" excludes the sample, proves a statement about a different algorithm.

Contributions are welcome on every milestone. The prefix-of-a-random-order lemma (a binomially sized prefix is an i.i.d. Bernoulli sample) is reusable well beyond this mission.

Selected references

  • J. Salem and S. Gupta, Secretary Problems with Biased Evaluations Using Partial Ordinal Information, SSRN 3444283 (version of 2022-04-17); Management Science, 2023. https://ssrn.com/abstract=3444283, https://doi.org/10.1287/mnsc.2023.4926
  • R. P. Dilworth, A Decomposition Theorem for Partially Ordered Sets, Annals of Mathematics 51(1), 1950, 161–166. https://doi.org/10.2307/1969503
  • R. Kleinberg, A Multiple-Choice Secretary Algorithm with Applications to Online Auctions, SODA 2005. https://dl.acm.org/doi/10.5555/1070432.1070519
9 thms2 active usersReviewed
Number TheoryOptimization·Captain: mikedeng1

Integer Factorization: Why Two-Item Joint Replenishment Is Hard 1: For Odd Composite M, Every Optimal Plan of an Explicit Two-Item Aperiodic JRP Instance Has q₂ = M and 1 < gcd(q₁, M) < MResearch Paper

Motivation

The joint replenishment problem (JRP) is one of the basic models of multi-item inventory control. Each item follows the economic order quantity (EOQ) model of Harris (1913): ordering costs a fixed amount, holding stock costs a rate proportional to the stock, and the classical trade-off between the two determines how often to reorder. In a JRP, items replenished together share part of the fixed cost, so the reorder cycles of the items should be coordinated. The problem has been studied for decades, with a large literature of heuristics and approximation algorithms (see the survey of Khouja and Goyal 2008; Porras and Dekker 2008 compare the two ways of charging joint costs), yet its exact complexity remained unclear even for very few items.

Schulz and Telha (arXiv:2007.09045, 2020; Operations Research, 2024) give a striking answer for the smallest non-trivial case, two items. They show that solving the two-item problem exactly is at least as hard as integer factorization (their Theorem 1), and, assuming the Riemann hypothesis, that the two-item periodic JRP is NP-hard under randomized reductions (Theorem 2). This mission formalizes the mathematical core of Theorem 1(a), for the aperiodic JRP: the paper's Lemma 1.

Timeline. The complexity of both JRP variants was open for a long time. Schulz and Telha announced the reduction from integer factorization to the two-item aperiodic JRP (Theorem 1(a)) in 2011. Cohen-Hillel and Yedidsion (2018) then proved that the aperiodic JRP with an arbitrary number of items is strongly NP-hard (they call it the periodic JRP). The 2020 preprint adds the reduction for the two-item periodic JRP (Theorem 1(b)) and, under the Riemann hypothesis, a randomized reduction from Partition to it (Theorem 2).

Setting

For an item with fixed ordering cost KKK and holding cost rate HHH, replenished every qqq time units, the long-run cost per unit time is

EOQK,H(q)=Kq+Hq.\mathrm{EOQ}_{K,H}(q) = \frac{K}{q} + Hq .EOQK,H​(q)=qK​+Hq.

Reorder cycles are positive integers q∈Z+q \in \mathbb Z^+q∈Z+. In the aperiodic two-item JRP (objective (1) of the paper) items 1 and 2 have data (K1,H1)(K_1,H_1)(K1​,H1​) and (K2,H2)(K_2,H_2)(K2​,H2​), and every joint replenishment earns a discount K0≤K1,K2K_0 \le K_1, K_2K0​≤K1​,K2​. With cycles q1,q2q_1, q_2q1​,q2​, joint replenishments happen every lcm(q1,q2)\mathrm{lcm}(q_1,q_2)lcm(q1​,q2​) time units, so the discount per unit time is DC(q1,q2;K0)=K0/lcm(q1,q2)\mathrm{DC}(q_1,q_2;K_0) = K_0/\mathrm{lcm}(q_1,q_2)DC(q1​,q2​;K0​)=K0​/lcm(q1​,q2​) and the problem is

min⁡{JRP(q1,q2)=EOQK1,H1(q1)+EOQK2,H2(q2)−K0lcm(q1,q2) : q1,q2∈Z+}.\min\left\{\mathrm{JRP}(q_1,q_2) = \mathrm{EOQ}_{K_1,H_1}(q_1) + \mathrm{EOQ}_{K_2,H_2}(q_2) - \frac{K_0}{\mathrm{lcm}(q_1,q_2)} \ :\ q_1,q_2 \in \mathbb Z^+\right\}.min{JRP(q1​,q2​)=EOQK1​,H1​​(q1​)+EOQK2​,H2​​(q2​)−lcm(q1​,q2​)K0​​ : q1​,q2​∈Z+}.

For an integer MMM, the instance of Lemma 1 has

K1=K0=M(M−1),H1=4,K2=M3(M2−1),H2=M(M2−1).K_1 = K_0 = M(M-1),\qquad H_1 = 4,\qquad K_2 = M^3(M^2-1),\qquad H_2 = M(M^2-1).K1​=K0​=M(M−1),H1​=4,K2​=M3(M2−1),H2​=M(M2−1).

Item 2's own EOQ optimum is q2=Mq_2 = Mq2​=M. Fixing q2=Mq_2 = Mq2​=M leaves the one-variable problem (2) with objective

JRPred(q1)=M(M−1)(1q1−1lcm(q1,M))+4q1.\mathrm{JRP}^{\mathrm{red}}(q_1) = M(M-1)\left(\frac{1}{q_1} - \frac{1}{\mathrm{lcm}(q_1,M)}\right) + 4q_1 .JRPred(q1​)=M(M−1)(q1​1​−lcm(q1​,M)1​)+4q1​.

In Lean these are eoq, aperiodicCost, lemma1Cost, eoq2 (item 2's cost) and jrpRed, and an optimal solution (IsOptimal) is a pair of positive integers whose value is no larger than that of any other pair of positive integers.

Formalization targets

Goal: Lemma 1

For every odd composite number MMM, the instance above satisfies K0≤K1K_0 \le K_1K0​≤K1​, K0≤K2K_0 \le K_2K0​≤K2​, has all coefficients at most M5M^5M5, has an optimal solution, and

every optimal (q1,q2) satisfies q2=Mand1<gcd⁡(q1,M)<M.\text{every optimal } (q_1,q_2) \text{ satisfies } \quad q_2 = M \quad\text{and}\quad 1 < \gcd(q_1,M) < M .every optimal (q1​,q2​) satisfies q2​=Mand1<gcd(q1​,M)<M.

So gcd⁡(q1,M)\gcd(q_1, M)gcd(q1​,M) is a non-trivial divisor of MMM.

Milestones (the steps of the paper's proof, pp. 9–10)

  1. EOQK2,H2(M±1)=EOQK2,H2(M)+H2/(M±1)≥EOQK2,H2(M)+K0\mathrm{EOQ}_{K_2,H_2}(M\pm1) = \mathrm{EOQ}_{K_2,H_2}(M) + H_2/(M\pm1) \ge \mathrm{EOQ}_{K_2,H_2}(M) + K_0EOQK2​,H2​​(M±1)=EOQK2​,H2​​(M)+H2​/(M±1)≥EOQK2​,H2​​(M)+K0​.
  2. For q2≠Mq_2 \ne Mq2​=M: JRP(q1,q2)≥EOQK2,H2(M)+K0+4>JRP(1,M)\mathrm{JRP}(q_1,q_2) \ge \mathrm{EOQ}_{K_2,H_2}(M) + K_0 + 4 > \mathrm{JRP}(1,M)JRP(q1​,q2​)≥EOQK2​,H2​​(M)+K0​+4>JRP(1,M).
  3. JRP(q1,M)=EOQK2,H2(M)+JRPred(q1)\mathrm{JRP}(q_1, M) = \mathrm{EOQ}_{K_2,H_2}(M) + \mathrm{JRP}^{\mathrm{red}}(q_1)JRP(q1​,M)=EOQK2​,H2​​(M)+JRPred(q1​).
  4. For q1q_1q1​ coprime with MMM: JRPred(q1)≥4(M−1)\mathrm{JRP}^{\mathrm{red}}(q_1) \ge 4(M-1)JRPred(q1​)≥4(M−1).
  5. For a divisor ppp of MMM with 3≤p<M3 \le p < M3≤p<M and a multiple qqq of ppp: JRPred(q)≤(M−1)(M−p)/q+4q\mathrm{JRP}^{\mathrm{red}}(q) \le (M-1)(M-p)/q + 4qJRPred(q)≤(M−1)(M−p)/q+4q.
  6. Some multiple qqq of ppp in [M−12−p−12,M−12+p−12]\left[\frac{M-1}{2} - \frac{p-1}{2}, \frac{M-1}{2} + \frac{p-1}{2}\right][2M−1​−2p−1​,2M−1​+2p−1​] has JRPred(q)<4(M−1)\mathrm{JRP}^{\mathrm{red}}(q) < 4(M-1)JRPred(q)<4(M−1).
  7. Multiples q1q_1q1​ of MMM have JRPred(q1)=4q1≥4M\mathrm{JRP}^{\mathrm{red}}(q_1) = 4q_1 \ge 4MJRPred(q1​)=4q1​≥4M, while JRPred((M−1)/2)≤4(M−1)\mathrm{JRP}^{\mathrm{red}}((M-1)/2) \le 4(M-1)JRPred((M−1)/2)≤4(M−1).

Significance

The result. Lemma 1 turns any exact algorithm for the two-item aperiodic JRP into a factoring algorithm: solve the instance, read off gcd⁡(q1,M)\gcd(q_1, M)gcd(q1​,M), and recurse on the two factors. Since the instance's coefficients have size O(log⁡M)O(\log M)O(logM), a polynomial-time JRP algorithm would factor integers in polynomial time (Theorem 1(a)). This explains, in a precise sense, why the many exact and approximation methods for the JRP never produced a provably polynomial exact algorithm even for two items, and why the problem's difficulty is number-theoretic rather than combinatorial.

Formalizing it. The lemma has a complete, elementary proof in the paper; it has not been machine-checked. The formalization pins down every quantifier the prose leaves loose: that optimal solutions exist, that the claim is about every optimum, which coefficients are used, and that periods range over positive integers only. The proof steps (the item-2 pin, the coprime bound, the interval argument) are stated as separate milestones so they can be checked individually.

Difficulty

Each step is elementary, but the argument mixes discrete and continuous reasoning. The objective is not convex in q1q_1q1​: the term −K0/lcm(q1,M)-K_0/\mathrm{lcm}(q_1,M)−K0​/lcm(q1​,M) jumps down at every period sharing a factor with MMM. The obvious approach, comparing against the continuous EOQ minimizer, gives the right threshold 4(M−1)4(M-1)4(M−1) for coprime periods but says nothing about where a cheaper non-coprime period sits. The interval step needs the exact size of a window of integers around (M−1)/2(M-1)/2(M−1)/2, that ppp consecutive integers contain a multiple of ppp, and a strict inequality between a quadratic's roots and that window. The existence of an optimum is not stated in the paper and needs a coercivity argument over Z+×Z+\mathbb Z^+ \times \mathbb Z^+Z+×Z+.

Formalization scope

This mission formalizes the correctness of the reduction behind Theorem 1(a); polynomial running time is not formalized, and neither are Theorem 1 as a statement about algorithms, the recursion to a full factorization, nor primality testing.

Conventions: periods are natural numbers, and every quantification over a period requires it to be positive, because Lean evaluates K/0=0K/0 = 0K/0=0, lcm(0,M)=0\mathrm{lcm}(0,M) = 0lcm(0,M)=0 and gcd⁡(0,M)=M\gcd(0,M) = Mgcd(0,M)=M. Costs are real numbers. Coefficients are natural numbers cast to R\mathbb RR. "Odd composite" is Odd M ∧ 1 < M ∧ ¬ M.Prime. "Size at most 5log⁡M5\log M5logM" is stated as "every coefficient is at most M5M^5M5", equivalent in any logarithm base.

Two additions relative to the printed statement are disclosed in the goal's Formalization Note. The goal states the explicit instance of the proof (p. 9) rather than "there is an instance", since an existential instance could be chosen to make the claim easy and loses the polynomial-size construction the reduction needs. The goal also asserts that an optimal solution exists, so that "every optimal solution satisfies …" is not vacuously true. Neither periods equal to zero nor junk values of division can satisfy the optimality predicate.

All objects are defined in one file, JRPHard.Aperiodic.Setting; nothing beyond Mathlib's Nat.gcd, Nat.lcm, Nat.Prime and real arithmetic is needed. Proofs of any milestone, or alternative proofs of the goal, are welcome.

Selected references

  • A. S. Schulz and C. Telha, Integer factorization and Riemann's hypothesis: Why two-item joint replenishment is hard, arXiv:2007.09045v1, 2020; published as Integer Factorization: Why Two-Item Joint Replenishment Is Hard, Operations Research, 2024. https://arxiv.org/abs/2007.09045
  • F. W. Harris, How many parts to make at once, Factory, The Magazine of Management 10(2), 1913; reprinted in Operations Research 38(6), 1990. https://doi.org/10.1287/opre.38.6.947
  • E. Porras and R. Dekker, A solution method for the joint replenishment problem with correction factor, International Journal of Production Economics 113(2), 834–851, 2008. https://doi.org/10.1016/j.ijpe.2007.11.008
  • M. Khouja and S. Goyal, A review of the joint replenishment problem literature: 1989–2005, European Journal of Operational Research 186(1), 2008. https://doi.org/10.1016/j.ejor.2007.03.007
  • M. Cohen-Hillel and L. Yedidsion, The periodic joint replenishment problem is strongly NP-hard, Mathematics of Operations Research 43(4), 2018. https://doi.org/10.1287/moor.2017.0904
9 thms2 active usersReviewed
Algorithmic Game TheoryEconomicsOptimization·Captain: mikedeng1

Marketplace Leakage 3: The Marketplace Bans Buyer–Seller Communication Above Π*/(v − c), Below η_L When q > c/(v − Π*), and Always When q Is Close to OneResearch Paper

Motivation

Online marketplaces match buyers with sellers and charge a fee per transaction. Once a buyer has found a seller on the platform, both have an incentive to complete the sale off the platform and split the fee they save. This leakage (also called disintermediation) is a central concern for service marketplaces such as Upwork, Thumbtack or AngelList, and several of them respond by hiding the identity of the parties and blocking direct messages until a transaction is committed.

A. Hagiu and J. Wright, Marketplace Leakage (Management Science, 2023; doi:10.1287/mnsc.2023.4757), build a model of a marketplace that cannot prevent leakage by contract and study six strategies against it. Section 5.2 studies the bluntest of them: banning buyer–seller communication. A ban stops leakage, but it also prevents buyers from learning whether the product suits them. Proposition 3 says exactly when the marketplace gains from the ban. This mission formalizes that proposition and the lemmas of its proof (Appendix §8.4).

Setting

There is one marketplace MMM, one seller SSS and a unit mass of buyers with unit demand. The product has value vvv for buyers who want it and marginal cost c<vc<vc<v; the outside option is worth 000.

Allowing communication (the baseline). MMM sets a fee fff per transaction. SSS sets the on-platform price pm=vp_m=vpm​=v and a direct price pd≤vp_d\le vpd​≤v. A buyer who buys directly bears a switching cost sss with distribution GGG; with the uniform distribution of the paper,

G(s)=min⁡{max⁡{s/μ,0},1},μ>0.G(s)=\min\{\max\{s/\mu,0\},1\},\qquad \mu>0 .G(s)=min{max{s/μ,0},1},μ>0.

The seller maximizes its profit (1),

π(pd)=(pd−c) G(v−pd)+(v−c−f) (1−G(v−pd)),\pi(p_d)=(p_d-c)\,G(v-p_d)+(v-c-f)\,\bigl(1-G(v-p_d)\bigr),π(pd​)=(pd​−c)G(v−pd​)+(v−c−f)(1−G(v−pd​)),

and MMM earns f (1−G(v−pd))f\,(1-G(v-p_d))f(1−G(v−pd​)), choosing f≤v−cf\le v-cf≤v−c. The equilibrium profit of MMM is Π∗\Pi^*Π∗. With communication allowed, a buyer values the product at vvv only with probability q∈(0,1)q\in(0,1)q∈(0,1), but learns their valuation; every payoff is multiplied by qqq, so MMM earns qΠ∗q\Pi^*qΠ∗.

Banning communication. Under a ban there is no leakage, but a buyer learns their valuation only with probability η∈[0,1]\eta\in[0,1]η∈[0,1]. Facing the fee fff, the seller has two options: the high price pm=vp_m=vpm​=v, selling to the fraction ηq\eta qηq of informed high-value buyers and earning ηq (v−c−f)\eta q\,(v-c-f)ηq(v−c−f); and the low price pm=qvp_m=qvpm​=qv, selling also to the 1−η1-\eta1−η uninformed buyers and earning (1−η+ηq)(qv−c−f)(1-\eta+\eta q)(qv-c-f)(1−η+ηq)(qv−c−f). It takes the better option (ties to the low price) and lists if that option pays at least 000. MMM earns fff per transaction and chooses f∈Rf\in\mathbb Rf∈R. Its maximal revenue is the ban value V(η)V(\eta)V(η). Two closed forms appear:

ΠH(η)=ηq(v−c),ΠL(η)=(1−η+ηq)((1−(2−q)η)qv1−η−c).\Pi_H(\eta)=\eta q(v-c),\qquad \Pi_L(\eta)=(1-\eta+\eta q)\Bigl(\frac{(1-(2-q)\eta)qv}{1-\eta}-c\Bigr).ΠH​(η)=ηq(v−c),ΠL​(η)=(1−η+ηq)(1−η(1−(2−q)η)qv​−c).

MMM prefers to ban if V(η)>qΠ∗V(\eta)>q\Pi^*V(η)>qΠ∗ and prefers to allow if V(η)<qΠ∗V(\eta)<q\Pi^*V(η)<qΠ∗.

Formalization targets

Goal: Proposition 3 (pp. 15–16)

For 0<Π∗<v−c0<\Pi^*<v-c0<Π∗<v−c:

  1. MMM prefers to ban for every η\etaη with Π∗/(v−c)<η≤1\Pi^*/(v-c)<\eta\le 1Π∗/(v−c)<η≤1;
  2. if q>c/(v−Π∗)q>c/(v-\Pi^*)q>c/(v−Π∗), there is a unique ηL∈[0,1)\eta_L\in[0,1)ηL​∈[0,1) with ΠL(ηL)=qΠ∗\Pi_L(\eta_L)=q\Pi^*ΠL​(ηL​)=qΠ∗, it is positive, and MMM prefers to ban for every η∈[0,ηL)\eta\in[0,\eta_L)η∈[0,ηL​);
  3. there is q0<1q_0<1q0​<1 such that for q∈(q0,1)q\in(q_0,1)q∈(q0​,1), MMM prefers to ban for every η∈[0,1]\eta\in[0,1]η∈[0,1];
  4. with uniform switching costs, c≥0c\ge 0c≥0, and Π∗=Π∗(μ)\Pi^*=\Pi^*(\mu)Π∗=Π∗(μ) the baseline equilibrium profit: for each η∈(0,1)\eta\in(0,1)η∈(0,1), MMM prefers to ban for all sufficiently small μ>0\mu>0μ>0 and prefers to allow for all sufficiently large μ\muμ.

Milestones

f>(1−(2−q)η)qv1−η−c  ⟺  the seller prefers the high price(p. 15)f>\frac{(1-(2-q)\eta)qv}{1-\eta}-c\iff \text{the seller prefers the high price}\qquad(\text{p. 15})f>1−η(1−(2−q)η)qv​−c⟺the seller prefers the high price(p. 15) V(η)=max⁡{ΠH(η),ΠL(η)}(p. 15)V(\eta)=\max\{\Pi_H(\eta),\Pi_L(\eta)\}\qquad(\text{p. 15})V(η)=max{ΠH​(η),ΠL​(η)}(p. 15) dΠLdη=−(1−q)qv(1−η)2((2−η)qη+2(1−η)2)+c(1−q)<0  when qv>c(p. 38)\frac{d\Pi_L}{d\eta}=-\frac{(1-q)qv}{(1-\eta)^2}\bigl((2-\eta)q\eta+2(1-\eta)^2\bigr)+c(1-q)<0\ \text{ when } qv>c\qquad(\text{p. 38})dηdΠL​​=−(1−η)2(1−q)qv​((2−η)qη+2(1−η)2)+c(1−q)<0  when qv>c(p. 38) ΠL(η)≤ΠH(η)  ⟺  η≥η∗,η∗=qv(2−q)−c−q(1−q)v(v−c)qv(3(1−q)+q2)−c∈(0,1)(p. 38)\Pi_L(\eta)\le\Pi_H(\eta)\iff\eta\ge\eta^*,\quad \eta^*=\frac{qv(2-q)-c-q\sqrt{(1-q)v(v-c)}}{qv(3(1-q)+q^2)-c}\in(0,1)\qquad(\text{p. 38})ΠL​(η)≤ΠH​(η)⟺η≥η∗,η∗=qv(3(1−q)+q2)−cqv(2−q)−c−q(1−q)v(v−c)​​∈(0,1)(p. 38) lim⁡q→1−η∗=1(p. 38)\lim_{q\to1^-}\eta^*=1\qquad(\text{p. 38})q→1−lim​η∗=1(p. 38)

Significance

The proposition separates three regimes. When information loss is small (η\etaη near 111) a ban costs almost nothing and removes leakage, so the marketplace bans. When information loss is large and buyers are a priori likely to value the product, the marketplace can induce the low price qvqvqv and sell to everyone, so a ban pays again. In between, allowing communication can win. With uniform switching costs, the comparison turns on how much leakage costs: when switching is cheap (small μ\muμ) the baseline profit μ/2\mu/2μ/2 is small and the ban wins; when it is expensive, leakage is rare and allowing communication wins. The result is proved in the paper by an informal appendix argument. No part of it has been machine-checked. A formal version pins down what the paper leaves implicit: the seller's tie-breaking, the domain of η\etaη on which ΠL\Pi_LΠL​ is defined, which endpoints the strict preferences hold at, and the order of the quantifiers in "sufficiently close to zero (sufficiently large)".

Difficulty

The obvious argument compares two closed forms, but the ban value is not a closed form: it is a maximum over a fee that switches the seller's option and its listing decision. Showing that the maximum is max⁡{ΠH,ΠL}\max\{\Pi_H,\Pi_L\}max{ΠH​,ΠL​} requires checking that the threshold fee keeps the seller listing, and that fees above the threshold earn at most ΠH\Pi_HΠH​. The second obstacle is the shape of ΠL\Pi_LΠL​: it is a rational function with a pole at η=1\eta=1η=1, and its monotonicity rests on the sign of the printed derivative. The comparison point η∗\eta^*η∗ involves a square root, so the equivalence ΠL≤ΠH  ⟺  η≥η∗\Pi_L\le\Pi_H\iff\eta\ge\eta^*ΠL​≤ΠH​⟺η≥η∗ is a quadratic-root argument rather than a one-line inequality. Finally, part 4 needs the baseline equilibrium profit Π∗(μ)\Pi^*(\mu)Π∗(μ) from the full baseline game, i.e. a solution of the seller's problem (1) and the marketplace's problem (3) under uniform GGG.

Formalization scope

All objects are real-valued, with the paper's letters: v c μ q η f; PiStar stands for Π∗\Pi^*Π∗. The standing assumptions c<vc<vc<v, 0<q<10<q<10<q<1 and 0≤η≤10\le\eta\le 10≤η≤1 are explicit hypotheses. The statements use the reduced seller problem (1) with pm=vp_m=vpm​=v, as the paper does after its Lemma 1; Lemma 1 itself is not posed. The uniform GGG is the clamped CDF. Seller optimality, the baseline equilibrium and the ban value are optimality predicates (IsGreatest over the fees), never sSup or a chosen maximizer.

Conventions and disclosed additions:

  • In parts 1–3, Π∗\Pi^*Π∗ is any real in (0,v−c)(0,v-c)(0,v−c), a generalization of the paper's Π∗\Pi^*Π∗ for a general "well behaved" GGG; the proof uses nothing else.
  • Part 4 is posed for each fixed η∈(0,1)\eta\in(0,1)η∈(0,1): it fails at η=0\eta=0η=0 (ban) when qv≤cqv\le cqv≤c and at η=1\eta=1η=1 (allow). It adds c≥0c\ge 0c≥0, without which the marketplace bans for every μ\muμ at small η\etaη.
  • The milestones on the ban value, the derivative's sign and η∗\eta^*η∗ add v>0v>0v>0, which the proof uses without stating; each is false for some v≤0v\le 0v≤0.
  • ΠL\Pi_LΠL​ and the threshold divide by 1−η1-\eta1−η and are stated only for η<1\eta<1η<1; the game itself has no division.
  • "Prefers" is strict in both directions.

Trivializing formalizations are ruled out: the ban value is not defined as max⁡{ΠH,ΠL}\max\{\Pi_H,\Pi_L\}max{ΠH​,ΠL​}, the thresholds in μ\muμ are quantified after η\etaη and not before, Π∗\Pi^*Π∗ is constrained to (0,v−c)(0,v-c)(0,v−c), and preferences are strict.

A complete development needs elementary real analysis only: derivatives of rational functions, the intermediate value theorem on [0,1)[0,1)[0,1), limits at 111, and the baseline solution of (1) and (3) under uniform switching costs. That baseline solution is reusable for the other missions of this series. Proofs of individual milestones are welcome independently.

Selected references

  • A. Hagiu, J. Wright, Marketplace Leakage, Management Science, 2023. Authors' manuscript dated March 2023. doi:10.1287/mnsc.2023.4757
  • A. Piolatto, F. Schuett, Information vs Competition: How Platform Design Affects Profits and Surplus, TILEC Discussion Paper DP2022-002, 2022 (cited in footnote 8 of the paper for the idea that limiting information exchange reduces transaction value on a platform).
8 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryEconomicsOptimization·Captain: mikedeng1

Marketplace Leakage 4: The Marketplace Prefers Not to Impose a Price-Parity Clause If and Only If q < 1/2 and μ > (v − c)/2Research Paper

Motivation

Online marketplaces (Amazon, Booking.com, Airbnb, Upwork) charge sellers a fee on every transaction they intermediate. Once a buyer has found a seller on the marketplace, both have an incentive to complete the sale off the platform and split the fee they save. This is leakage (also called disintermediation or showrooming), and it limits the fees a marketplace can sustain. Hagiu and Wright, Marketplace Leakage (Management Science, 2023, doi:10.1287/mnsc.2023.4757), build a minimal model of leakage and compare the strategies a marketplace can use against it.

One of these strategies is contractual: a price-parity clause (PPC), under which the seller must not charge less in its direct channel than on the marketplace, on pain of being delisted. The paper notes that such clauses have been used by hotel-booking platforms, price-comparison platforms and Amazon (p. 22). The paper's Proposition 4 asks when a marketplace that cannot observe how easily buyers switch actually wants such a clause. This mission formalizes that proposition and the profit formulas behind it.

Setting

A marketplace MMM, a seller SSS and a unit mass of buyers with unit demand. Every buyer values SSS's product at vvv; SSS's marginal cost is c<vc<vc<v; the outside option is worth 000. SSS sells on MMM at price pmp_mpm​, paying MMM a fee fff per transaction, or directly at price pdp_dpd​ with no fee. A buyer who buys directly bears a switching cost sss. In the baseline state switching costs are uniform on [0,μ][0,\mu][0,μ], μ>0\mu>0μ>0, with clamped distribution function G(s)=min⁡{max⁡{s/μ,0},1}G(s)=\min\{\max\{s/\mu,0\},1\}G(s)=min{max{s/μ,0},1}. In the no-switching state switching costs are infinite and nobody buys directly. The baseline state occurs with probability qqq. SSS knows the state when it decides; MMM does not when it sets fff.

Without a PPC, SSS always lists, sets pm=vp_m=vpm​=v, and in the baseline state picks pd≤vp_d\le vpd​≤v to maximize

π(f,pd)=(pd−c)G(v−pd)+(v−c−f)(1−G(v−pd)).\pi(f,p_d)=(p_d-c)G(v-p_d)+(v-c-f)\big(1-G(v-p_d)\big).π(f,pd​)=(pd​−c)G(v−pd​)+(v−c−f)(1−G(v−pd​)).

A maximizer is a seller-optimal price pd∗(f)p_d^*(f)pd∗​(f). MMM's value is

Π∗=max⁡f≤v−cf(1−q G(v−pd∗(f))).\Pi^*=\max_{f\le v-c} f\big(1-q\,G(v-p_d^*(f))\big).Π∗=f≤v−cmax​f(1−qG(v−pd∗​(f))).

With a PPC, a listed seller must set pd=pm=vp_d=p_m=vpd​=pm​=v and earns v−c−fv-c-fv−c−f. A seller that delists earns max⁡c≤pd≤v(pd−c)G(v−pd)\max_{c\le p_d\le v}(p_d-c)G(v-p_d)maxc≤pd​≤v​(pd​−c)G(v−pd​) in the baseline state and 000 in the no-switching state. It accepts MMM's offer when listing pays at least as much, so MMM's value ΠPPC∗\Pi^*_{PPC}ΠPPC∗​ is the largest expected revenue f⋅Pr⁡[accept]f\cdot\Pr[\text{accept}]f⋅Pr[accept] over all fees fff.

Formalization targets

Goal: Proposition 4 (p. 23)

For c<vc<vc<v, μ>0\mu>0μ>0 and 0<q≤10<q\le 10<q≤1, both values exist, and

Π∗>ΠPPC∗  ⟺  q<12  and  μ>v−c2,otherwiseΠPPC∗≥Π∗.\Pi^*>\Pi^*_{PPC}\iff q<\tfrac12\ \text{ and }\ \mu>\tfrac{v-c}{2},\qquad\text{otherwise}\quad \Pi^*_{PPC}\ge\Pi^* .Π∗>ΠPPC∗​⟺q<21​  and  μ>2v−c​,otherwiseΠPPC∗​≥Π∗.

The goal states the comparison for any values satisfying the optimality predicates, so it is insensitive to how either value is later computed.

Milestones

  1. ΠPPC∗=max⁡{v−c−D, (1−q)(v−c)}\Pi^*_{PPC}=\max\{v-c-D,\ (1-q)(v-c)\}ΠPPC∗​=max{v−c−D, (1−q)(v−c)}, where D=max⁡c≤pd≤v(pd−c)G(v−pd)D=\max_{c\le p_d\le v}(p_d-c)G(v-p_d)D=maxc≤pd​≤v​(pd​−c)G(v−pd​) (p. 23).
  2. D=(v−c)24μD=\dfrac{(v-c)^2}{4\mu}D=4μ(v−c)2​ if μ≥v−c2\mu\ge\frac{v-c}{2}μ≥2v−c​ and D=v−c−μD=v-c-\muD=v−c−μ otherwise, so ΠPPC∗\Pi^*_{PPC}ΠPPC∗​ has a closed form (p. 39).
  3. For q<12q<\tfrac12q<21​: Π∗=(v−c)(1−qmin⁡{v−c2μ,1})\displaystyle\Pi^*=(v-c)\Big(1-q\min\Big\{\frac{v-c}{2\mu},1\Big\}\Big)Π∗=(v−c)(1−qmin{2μv−c​,1}) (p. 39).

Significance

Proposition 4 identifies a trade-off. A PPC removes leakage entirely, but it also takes away the seller's ability to divert some buyers when the fee turns out to be too high, so the seller may refuse to participate. When the baseline state is unlikely and switching costs in it are high, the marketplace earns more by tolerating leakage and charging the full surplus v−cv-cv−c. In every other case the clause pays. This makes the welfare and competition-policy debate about parity clauses explicit in a two-parameter region. It also contrasts with the case without uncertainty, where a PPC is always better for the marketplace.

The paper's proof (§8.5, pp. 39–40) is a short case comparison between closed forms. It has not been machine-checked. The printed formula for Π∗\Pi^*Π∗ when q≥1/2q\ge 1/2q≥1/2 omits the corner fee f=v−cf=v-cf=v−c and is wrong for small μ\muμ. The conclusion ΠPPC∗≥Π∗\Pi^*_{PPC}\ge\Pi^*ΠPPC∗​≥Π∗ still holds there, but by a different comparison. A formal proof pins down which steps survive.

Difficulty

Two optimizations are nested. The seller's optimal direct price changes regime at f=2μf=2\muf=2μ, where the uniform distribution's kink binds. The marketplace's revenue without a PPC is therefore piecewise in fff, with an interior candidate μ/q\mu/qμ/q that is feasible only when q≥1/2q\ge 1/2q≥1/2. Under a PPC, revenue is discontinuous in fff because acceptance switches on and off. Its maximum is attained only because acceptance is weak. Comparing the two values requires a case split over q≷12q\gtrless\tfrac12q≷21​ and μ\muμ against (v−c)/2(v-c)/2(v−c)/2 and q(v−c)q(v-c)q(v−c), and the boundary cases include genuine ties (Π∗=ΠPPC∗\Pi^*=\Pi^*_{PPC}Π∗=ΠPPC∗​ for q<12q<\tfrac12q<21​, μ≤v−c2\mu\le\frac{v-c}{2}μ≤2v−c​). Reading off a single printed closed form for Π∗\Pi^*Π∗ fails in part of the q≥1/2q\ge 1/2q≥1/2 region.

Formalization scope

All objects are in one definitions file in namespace MarketplaceLeakage.Parity. The parameters are real numbers v c μ q, with standing hypotheses c < v, 0 < μ, 0 < q, q ≤ 1 on every theorem. The paper states v>cv>cv>c (p. 5) and μ>0\mu>0μ>0 (p. 9). q∈(0,1]q\in(0,1]q∈(0,1] is added: qqq is a probability, and at q=0q=0q=0 both values equal v−cv-cv−c, so the "if" direction of the goal fails. q=1q=1q=1 is allowed. The statements use the reduced seller problem (1), as the paper does after its Lemma 1 (p. 7), with pm=vp_m=vpm​=v. Lemma 1 itself is not posed.

Committed conventions:

  • GGG is the clamped uniform CDF.
  • Seller-optimality is a predicate (IsSOpt), not a formula.
  • ΠPPC∗\Pi^*_{PPC}ΠPPC∗​ (IsPPCValue) is the attained maximum of f⋅(q 1[acceptB]+(1−q) 1[acceptN])f\cdot(q\,\mathbf 1[\text{accept}_B]+(1-q)\,\mathbf 1[\text{accept}_N])f⋅(q1[acceptB​]+(1−q)1[acceptN​]) over all f∈Rf\in\mathbb Rf∈R. Acceptance is weak and is stated against every delisting price c≤pd≤vc\le p_d\le vc≤pd​≤v.
  • Π∗\Pi^*Π∗ (IsNoPPCValue) is the attained maximum of f(1−qG(v−pd))f(1-qG(v-p_d))f(1−qG(v−pd​)) over f≤v−cf\le v-cf≤v−c and seller-optimal pdp_dpd​.
  • "Prefers not to impose" is strict; "otherwise prefers to impose" is weak.

These choices rule out the trivializing formalizations. Neither value is defined by its printed max-expression, which would make the milestones definitional. Strict acceptance would leave the PPC optimum unattained. A value given by sSup would be meaningless off its domain. Reading "prefers to impose" strictly would make the statement false at the ties.

No published platform definitions are reused. A complete development needs only elementary real analysis: maximizing piecewise-quadratic functions, attainment on compact intervals, and case analysis over min/max. The lemmas on the seller's best response under the uniform GGG are reusable in the companion missions on Propositions 1–3 of the same paper. Proofs of any milestone are welcome independently.

Selected references

  • A. Hagiu, J. Wright, Marketplace Leakage, Management Science, 2023 (authors' manuscript dated March 2023). https://doi.org/10.1287/mnsc.2023.4757
6 thms2 active usersReviewed
Probability·Captain: mikedeng1

Lightning Network Economics: Channels I: The Expected Discounted Cost of a Bidirectional Payment Channel in Closed FormResearch Paper

Payment channels and the cost of locked capital

Blockchains such as Bitcoin settle every transaction on a public ledger. Each on-chain transaction pays a fee and waits for confirmation, so frequent small payments are expensive. The Lightning Network moves such payments off-chain: two parties lock funds in a shared payment channel and pay each other by updating the channel's balance, touching the blockchain only to open, close or re-fund it. A channel is not free either. The locked funds cannot be used elsewhere, and once one side's balance is exhausted the channel has to be reset on-chain.

Guasoni, Huberman and Shikhelman (Lightning Network Economics: Channels, Management Science, 2023) quantify this trade-off in a stochastic model and compare three ways of settling two opposite streams of payments: on-chain transactions, unidirectional channels, and one bidirectional channel. Their comparisons all rest on a single computation, the expected discounted cost of a channel in closed form (Theorem 1). This mission formalizes that computation.

The model

Two nodes exchange unit payments. Node 1 pays node 2 one unit at each jump of a Poisson process Ntλ1N^{\lambda_1}_tNtλ1​​ with rate λ1\lambda_1λ1​; node 2 pays node 1 one unit at each jump of an independent Poisson process Ntλ2N^{\lambda_2}_tNtλ2​​ with rate λ2\lambda_2λ2​. The paper normalizes λ1≤λ2\lambda_1\le\lambda_2λ1​≤λ2​. The net balance of node 1 is

Xt=Ntλ2−Ntλ1,X0=0.X_t=N^{\lambda_2}_t-N^{\lambda_1}_t,\qquad X_0=0 .Xt​=Ntλ2​​−Ntλ1​​,X0​=0.

In a bidirectional channel node 1 commits l1l_1l1​ units and node 2 commits l2l_2l2​ units. The money is the channel's capacity: the channel works as long as −l1<Xt<l2-l_1<X_t<l_2−l1​<Xt​<l2​. Locked capital has an opportunity cost of r(l1+l2)r(l_1+l_2)r(l1​+l2​) per unit of time, where r>0r>0r>0 is the continuously compounded interest rate, and all costs are discounted at rate rrr. When the balance reaches −l1-l_1−l1​ (node 1 is exhausted) or +l2+l_2+l2​ (node 2 is exhausted), the channel is reset at cost BBB and the balance restarts at 000 with the same commitments.

Let J(n)J(n)J(n) be the expected total future cost when the balance equals nnn. Conditioning on the first payment, which arrives after an exponential time with rate λ1+λ2\lambda_1+\lambda_2λ1​+λ2​, gives the first-step equation (15)

J(n)=(l1+l2)rr+λ2+λ1+J(n+1)λ2r+λ2+λ1+J(n−1)λ1r+λ2+λ1,−l1<n<l2,J(n)=(l_1+l_2)\frac{r}{r+\lambda_2+\lambda_1}+J(n+1)\frac{\lambda_2}{r+\lambda_2+\lambda_1}+J(n-1)\frac{\lambda_1}{r+\lambda_2+\lambda_1},\qquad -l_1<n<l_2,J(n)=(l1​+l2​)r+λ2​+λ1​r​+J(n+1)r+λ2​+λ1​λ2​​+J(n−1)r+λ2​+λ1​λ1​​,−l1​<n<l2​,

with the reset conditions J(−l1)=J(0)+BJ(-l_1)=J(0)+BJ(−l1​)=J(0)+B and J(+l2)=J(0)+BJ(+l_2)=J(0)+BJ(+l2​)=J(0)+B. The cost of the channel is cl1,l2(λ1,λ2)=J(0)c^{l_1,l_2}(\lambda_1,\lambda_2)=J(0)cl1​,l2​(λ1​,λ2​)=J(0).

In a unidirectional channel only node 2 pays (rate λ2\lambda_2λ2​) and only node 2 commits capital (l2l_2l2​ units). The cost satisfies J(n)=l2rr+λ2+J(n+1)λ2r+λ2J(n)=l_2\frac{r}{r+\lambda_2}+J(n+1)\frac{\lambda_2}{r+\lambda_2}J(n)=l2​r+λ2​r​+J(n+1)r+λ2​λ2​​ for 0≤n<l20\le n<l_20≤n<l2​ with J(l2)=J(0)+BJ(l_2)=J(0)+BJ(l2​)=J(0)+B, and c0,l2(0,λ2)=J(0)c^{0,l_2}(0,\lambda_2)=J(0)c0,l2​(0,λ2​)=J(0).

The roots of the characteristic equation λ2α2−(λ1+λ2+r)α+λ1=0\lambda_2\alpha^2-(\lambda_1+\lambda_2+r)\alpha+\lambda_1=0λ2​α2−(λ1​+λ2​+r)α+λ1​=0 are

α±=λ1+λ2+r±(λ2−λ1)2+r2+2r(λ2+λ1)2λ2.(4)\alpha_\pm=\frac{\lambda_1+\lambda_2+r\pm\sqrt{(\lambda_2-\lambda_1)^2+r^2+2r(\lambda_2+\lambda_1)}}{2\lambda_2}. \tag{4}α±​=2λ2​λ1​+λ2​+r±(λ2​−λ1​)2+r2+2r(λ2​+λ1​)​​.(4)

Formalization targets

Goal: Theorem 1 (ii)

For 0<λ1≤λ20<\lambda_1\le\lambda_20<λ1​≤λ2​, r>0r>0r>0, any BBB and natural commitments l1,l2≥1l_1,l_2\ge1l1​,l2​≥1, the bidirectional cost system has a solution, and every solution satisfies

cl1,l2(λ1,λ2)=l1+l2−B α−l1(1−α+l1+l2)−α+l1(1−α−l1+l2)α−l1(1−α+l1+l2)−α+l1(1−α−l1+l2)+α+l1+l2−α−l1+l2.(3)c^{l_1,l_2}(\lambda_1,\lambda_2)=l_1+l_2-B\,\frac{\alpha_-^{l_1}(1-\alpha_+^{l_1+l_2})-\alpha_+^{l_1}(1-\alpha_-^{l_1+l_2})}{\alpha_-^{l_1}(1-\alpha_+^{l_1+l_2})-\alpha_+^{l_1}(1-\alpha_-^{l_1+l_2})+\alpha_+^{l_1+l_2}-\alpha_-^{l_1+l_2}}. \tag{3}cl1​,l2​(λ1​,λ2​)=l1​+l2​−Bα−l1​​(1−α+l1​+l2​​)−α+l1​​(1−α−l1​+l2​​)+α+l1​+l2​​−α−l1​+l2​​α−l1​​(1−α+l1​+l2​​)−α+l1​​(1−α−l1​+l2​​)​.(3)

Milestones

  1. Competing exponential clocks (proof of Theorem 1, p. 10): the minimum τ\tauτ of independent exponential times with rates λ2,λ1\lambda_2,\lambda_1λ2​,λ1​ is exponential with rate λ2+λ1\lambda_2+\lambda_1λ2​+λ1​, and τλ2\tau^{\lambda_2}τλ2​ rings first with probability λ2/(λ2+λ1)\lambda_2/(\lambda_2+\lambda_1)λ2​/(λ2​+λ1​). This is a published, proved platform theorem, reused as is.
  2. The first term (p. 10): E[e−rτ]=(λ2+λ1)/(λ2+λ1+r)E[e^{-r\tau}]=(\lambda_2+\lambda_1)/(\lambda_2+\lambda_1+r)E[e−rτ]=(λ2​+λ1​)/(λ2​+λ1​+r) and E[∫0τe−rsr(l1+l2) ds]=(l1+l2) r/(r+λ2+λ1)E[\int_0^\tau e^{-rs}r(l_1+l_2)\,ds]=(l_1+l_2)\,r/(r+\lambda_2+\lambda_1)E[∫0τ​e−rsr(l1​+l2​)ds]=(l1​+l2​)r/(r+λ2​+λ1​).
  3. The last term (p. 10): E[e−rτJ(Xt+τ)∣Xt=n]=J(n+1)λ2r+λ2+λ1+J(n−1)λ1r+λ2+λ1E[e^{-r\tau}J(X_{t+\tau})\mid X_t=n]=J(n+1)\frac{\lambda_2}{r+\lambda_2+\lambda_1}+J(n-1)\frac{\lambda_1}{r+\lambda_2+\lambda_1}E[e−rτJ(Xt+τ​)∣Xt​=n]=J(n+1)r+λ2​+λ1​λ2​​+J(n−1)r+λ2​+λ1​λ1​​.
  4. General solution of (15) (§5.1): on the lattice −l1≤n≤l2-l_1\le n\le l_2−l1​≤n≤l2​, (15) holds at the interior points if and only if J(n)=l1+l2+k1α−n+k2α+nJ(n)=l_1+l_2+k_1\alpha_-^n+k_2\alpha_+^nJ(n)=l1​+l2​+k1​α−n​+k2​α+n​ for constants k1,k2k_1,k_2k1​,k2​.
  5. The cost function (§5.1): the closed form of J(n)J(n)J(n) at every balance nnn, which gives (3) at n=0n=0n=0.
  6. Theorem 1 (i), (1): c0,l2(0,λ2)=l2+B(((r+λ2)/λ2)l2−1)−1c^{0,l_2}(0,\lambda_2)=l_2+B\big(((r+\lambda_2)/\lambda_2)^{l_2}-1\big)^{-1}c0,l2​(0,λ2​)=l2​+B(((r+λ2​)/λ2​)l2​−1)−1.
  7. Theorem 1 (i), (2): with k=Blog⁡(1+r/λ2)k=B\log(1+r/\lambda_2)k=Blog(1+r/λ2​) and B>0B>0B>0, the minimum of (1) over real sizes is B2k(−k+k(k+4)+2log⁡(12(k+k(k+4)+2)))\frac{B}{2k}\big(-k+\sqrt{k(k+4)}+2\log(\tfrac12(k+\sqrt{k(k+4)}+2))\big)2kB​(−k+k(k+4)​+2log(21​(k+k(k+4)​+2))), attained at l2=Bklog⁡(12(k+k(k+4)+2))l_2=\frac Bk\log(\tfrac12(k+\sqrt{k(k+4)}+2))l2​=kB​log(21​(k+k(k+4)​+2)).

What the closed form gives

Formula (3) is what the rest of the paper works with. Lemma 1 prices on-chain settlement of a stream of rate λ\lambdaλ at Cλ/rC\lambda/rCλ/r. Comparing that price with (1) and (3) yields the paper's thresholds on the on-chain fee below which no channel pays off (Theorem 2), the small-interest-rate asymptotics of the optimal symmetric channel, whose minimal cost scales like 3(2Bλ/r)1/33(2B\lambda/r)^{1/3}3(2Bλ/r)1/3 (Theorem 3), and the long-run number of channel payments per on-chain transaction (Proposition 2). Without an exact expression for the cost these comparisons would rest on simulation.

The paper proves Theorem 1 by a first-step argument and the solution of a linear difference equation. No part of it has been machine-checked. A formal proof would supply what the published argument passes over: that the first-step equation (15) and the reset conditions together have a unique solution on the lattice, that the denominator of (3) does not vanish, and the measure-theoretic computation of the coefficients of (15) from the exponential clocks. The later missions of this series (rate bounds, small-rate asymptotics, the balance walk) build on the same model.

Where the difficulty lies

The algebra of solving a second-order linear recurrence is routine. Two points are not. First, the solution has to be shown to exist and to be unique for every admissible set of parameters. This requires α−≠α+\alpha_-\ne\alpha_+α−​=α+​ and a non-singular 2×22\times 22×2 system for k1,k2k_1,k_2k1​,k2​, whose determinant is the denominator of (3), and the paper does not discuss when that determinant vanishes. Second, the coefficients of (15) come from expectations over exponential times: the joint expectation of the discount factor e−rτe^{-r\tau}e−rτ and the indicator of which clock rang first. The paper factors it as E[e−rτ] P(τ=τλ2)E[e^{-r\tau}]\,P(\tau=\tau^{\lambda_2})E[e−rτ]P(τ=τλ2​), which uses that the minimum is independent of the identity of the first clock, a fact it does not state.

Formalization scope

  • The rates are written lam₁, lam₂; the sizes l1,l2l_1,l_2l1​,l2​ are natural numbers with l1,l2≥1l_1,l_2\ge1l1​,l2​≥1, because payments are of one unit and the balance lives on the lattice {−l1,…,l2}\{-l_1,\dots,l_2\}{−l1​,…,l2​}. The cost function is a map J:Z→RJ:\mathbb Z\to\mathbb RJ:Z→R whose values off the lattice are unconstrained.
  • The cost is defined by its equations, (15) with the reset conditions (IsBiCostFn) and the §5.2 system (IsUniCostFn), never by (3) or (1). Every statement about "the cost" asserts both that a solution exists and that every solution takes the stated value, so it is neither vacuous nor dependent on a choice of solution.
  • The unidirectional system is a separate definition: the bidirectional one at l1=0l_1=0l1​=0 would force B=0B=0B=0. For the same reason the Remark after Theorem 1 ("(1) follows from (3) by substituting λ1=l1=0\lambda_1=l_1=0λ1​=l1​=0") is not posed: with α−=0\alpha_-=0α−​=0 and l1=0l_1=0l1​=0 the denominator of (3) vanishes.
  • Powers are natural powers in (1) and (3), integer powers (zpow) in the general solution and in J(n)J(n)J(n), and real powers (Real.rpow) in the minimization (2), which is over real sizes m>0m>0m>0 as in the paper's proof.
  • The paper prints the exponent in the numerator of the J(n)J(n)J(n) display as l+nl+nl+n; the statement uses l1+nl_1+nl1​+n, which is what the derivation gives and what reduces to (3) at n=0n=0n=0.
  • The probabilistic milestones use Mathlib's expMeasure for the laws (through push-forward measures of measurable random variables) and IndepFun. Integrability is part of what is to be proved.
  • The hypothesis λ1≤λ2\lambda_1\le\lambda_2λ1​≤λ2​ is kept in the goal as printed. No sign of BBB is assumed except B>0B>0B>0 in (2), without which the infimum is not attained.
  • Ruled out as trivializing: defining the cost as its closed form (which turns the goal into a definitional equality), fixing numerical parameters, restricting to λ1=λ2\lambda_1=\lambda_2λ1​=λ2​, and treating the sizes as real numbers in the cost system.

Contributions welcome: proofs of the milestones in any order, and reusable lemmas on linear difference equations with constant coefficients and on Laplace transforms of exponential laws, neither of which Mathlib currently has in this form.

Selected references

  • P. Guasoni, G. Huberman, C. Shikhelman, Lightning Network Economics: Channels, Management Science, Articles in Advance, 2023. https://doi.org/10.1287/mnsc.2022.01664
  • J. Poon, T. Dryja, The Bitcoin Lightning Network: Scalable Off-Chain Instant Payments, technical report, 2015 (as cited by Guasoni et al.). https://lightning.network/lightning-network-paper.pdf
13 thms2 active usersReviewed
Algorithmic Game TheoryEconomicsOptimization·Captain: mikedeng1

Quality Strategies in Network Markets: Under Potential Maximization the Equilibrium Quality Equates Marginal Cost to n Times the Harmonic-Mean Valuation Times the Uniform Average of ∂f(i,q)/∂qResearch Paper

Motivation

A firm that sells a network good (a platform, a communication service, a standard) faces consumers whose benefit from buying grows with the number of other buyers. When these network effects are strong, the buying decisions form a coordination game: everybody buying and nobody buying can both be equilibria at the same price and quality. The firm's choice of quality then depends on which equilibrium it expects consumers to play.

The classical answer, going back to Spence's analysis of monopoly quality (Spence 1975), is that a monopolist sets quality for the marginal consumer. Under the usual equilibrium-selection criteria (Pareto dominance, focality) the network-good monopolist inherits this logic. L. T. Chan, Quality Strategies in Network Markets (Management Science, 2023; SSRN copy 4203818), asks what happens when the firm instead anticipates potential maximization, a generalization of risk dominance to many players introduced through the potential games of Monderer and Shapley (1996). The answer is a different first-order condition for quality, in which every consumer's valuation and every possible number of buyers matter. This mission formalizes that condition, Proposition 5 of the paper, together with the chain of results in §3 that leads to it.

Setting

There are n≥1n\ge 1n≥1 consumers N={1,…,n}N=\{1,\dots,n\}N={1,…,n}. Consumer iii has a valuation vi>0v_i>0vi​>0, labelled so that v1≥⋯≥vnv_1\ge\dots\ge v_nv1​≥⋯≥vn​. The benefit f(k,q)≥0f(k,q)\ge 0f(k,q)≥0 of the good when kkk consumers buy at quality qqq is weakly increasing in kkk and, in qqq, weakly increasing and differentiable. The firm's cost of quality c(q)≥0c(q)\ge 0c(q)≥0 is weakly increasing and differentiable.

In stage 1 the firm chooses a price p≥0p\ge 0p≥0 and a quality q≥0q\ge 0q≥0. In stage 2 consumers simultaneously decide whether to buy. If B⊆NB\subseteq NB⊆N is the set of buyers, consumer iii receives the payoff (7)

ui(B,p,q)=vif(∣B∣,q)−p  if i∈B,ui(B,p,q)=0  if i∉B,u_i(B,p,q)=v_if(|B|,q)-p\ \text{ if } i\in B,\qquad u_i(B,p,q)=0\ \text{ if } i\notin B,ui​(B,p,q)=vi​f(∣B∣,q)−p  if i∈B,ui​(B,p,q)=0  if i∈/B,

and the firm earns ∣B∣p−c(q)|B|p-c(q)∣B∣p−c(q). A buyer set BBB is a Nash equilibrium of stage 2 if no buyer gains by leaving and no non-buyer gains by joining. The market has strong network effects at qqq when vif(i,q)v_if(i,q)vi​f(i,q) is strictly increasing in iii.

The potential (10) of a buyer set is

Φ(B,p,q)=∑i=1∣B∣f(i,q)−p∑i∈B1vi.\Phi(B,p,q)=\sum_{i=1}^{|B|}f(i,q)-p\sum_{i\in B}\frac1{v_i}.Φ(B,p,q)=i=1∑∣B∣​f(i,q)−pi∈B∑​vi​1​.

A potential maximizer is a buyer set maximizing Φ(⋅,p,q)\Phi(\cdot,p,q)Φ(⋅,p,q) over all subsets of NNN. A firm that anticipates potential maximization earns Π(p,q)=np−c(q)\Pi(p,q)=np-c(q)Π(p,q)=np−c(q) when all consumers buying is a potential maximizer, and −c(q)-c(q)−c(q) otherwise. In Lean these objects are Market, Market.Standing, Market.StrongNE, Market.u, Market.IsNash, Market.pot, Market.IsPotMax and Market.profitPM in the namespace NetworkQuality.PotentialMax.

Formalization targets

Goal: Proposition 5 (p. 15)

Assume the standing assumptions and strong network effects at every q≥0q\ge 0q≥0. If (p∗,q∗)(p^*,q^*)(p∗,q∗) maximizes Π\PiΠ over p≥0p\ge 0p≥0, q≥0q\ge 0q≥0 and q∗>0q^*>0q∗>0, then

c′(q∗)=n(1n∑i=1n1vi)−11n∑i=1n∂f(i,q∗)∂q.c'(q^*)=n\Big(\frac1n\sum_{i=1}^n\frac1{v_i}\Big)^{-1}\frac1n\sum_{i=1}^n\frac{\partial f(i,q^*)}{\partial q}.c′(q∗)=n(n1​i=1∑n​vi​1​)−1n1​i=1∑n​∂q∂f(i,q∗)​.

The statement is the necessary first-order condition. It fixes no functional form for fff or ccc.

Milestones

  1. (11), p. 13. For i∉B−ii\notin B_{-i}i∈/B−i​: ui(B−i∪{i})−ui(B−i)=vi[Φ(B−i∪{i})−Φ(B−i)]u_i(B_{-i}\cup\{i\})-u_i(B_{-i})=v_i[\Phi(B_{-i}\cup\{i\})-\Phi(B_{-i})]ui​(B−i​∪{i})−ui​(B−i​)=vi​[Φ(B−i​∪{i})−Φ(B−i​)], so stage 2 is a weighted potential game.
  2. §3.5, p. 14. Every potential maximizer is a Nash equilibrium.
  3. Proposition 1, p. 10. Under strong network effects the equilibria are exactly {N}\{N\}{N} for p<v1f(1,q)p<v_1f(1,q)p<v1​f(1,q), {∅}\{\emptyset\}{∅} for p>vnf(n,q)p>v_nf(n,q)p>vn​f(n,q), and {N,∅}\{N,\emptyset\}{N,∅} in between.
  4. (12), p. 14. Under strong network effects every potential maximizer is NNN or ∅\emptyset∅, and NNN is one iff p≤(1n∑i1vi)−11n∑if(i,q)=:p(q)p\le\big(\frac1n\sum_i\frac1{v_i}\big)^{-1}\frac1n\sum_i f(i,q)=:p(q)p≤(n1​∑i​vi​1​)−1n1​∑i​f(i,q)=:p(q).
  5. (13), p. 14. v1f(1,q)∑i1vi≤∑if(i,q)≤vnf(n,q)∑i1viv_1f(1,q)\sum_i\frac1{v_i}\le\sum_i f(i,q)\le v_nf(n,q)\sum_i\frac1{v_i}v1​f(1,q)∑i​vi​1​≤∑i​f(i,q)≤vn​f(n,q)∑i​vi​1​.
  6. (14), p. 15. At each quality the maximal profit over prices p≥0p\ge0p≥0 is n p(q)−c(q)n\,p(q)-c(q)np(q)−c(q), attained at p(q)p(q)p(q).

Significance

The result. Proposition 5 replaces the Spence condition c′(q)=n vn ∂f(n,q)/∂qc'(q)=n\,v_n\,\partial f(n,q)/\partial qc′(q)=nvn​∂f(n,q)/∂q (Proposition 4 of the paper) by one in which the marginal consumer's valuation vnv_nvn​ is replaced by the harmonic mean of all valuations, and the equilibrium benefit f(n,q)f(n,q)f(n,q) by its uniform average over the number of buyers. Comparing it with the social optimum (Proposition 3, arithmetic mean of valuations) shows that a firm worried about miscoordination underprovides quality relative to the planner, increasingly so as valuations become more dispersed, and that it tends to undersupply (oversupply) quality when the number of buyers and quality are complements (substitutes) in the benefit fff (p. 15).

Formalizing it. The paper's arguments are in the main text (§3.2 and §3.5) and are short; some steps are only sketched: Proposition 1's proof treats only buyer sets of the form {1,…,k}\{1,\dots,k\}{1,…,k}, and (12) is derived only in the price range with two equilibria. A machine-checked development makes these steps complete, fixes the tie-breaking convention of the selection, and isolates exactly which assumptions the first-order condition uses (none of the convexity the paper assumes). No part of this result has a machine-checked proof at the time of writing.

Difficulty

The objects are finite and the algebra is elementary, so the difficulty lies in bookkeeping that the paper leaves implicit. The obvious reading of Proposition 1, "consumers 111 to kkk buy", is not forced when valuations tie; excluding an arbitrary buyer set of intermediate size needs a comparison between its weakest buyer and its strongest non-buyer, using the ordering of valuations and nonnegativity of fff. The characterization (12) is a statement about maximizers over all 2n2^n2n buyer sets, not just about the two candidates the text compares, so it rests on the reduction "potential maximizer ⇒ Nash equilibrium ⇒ NNN or ∅\emptyset∅". Finally the firm optimizes jointly over price and quality against a discontinuous profit function; the first-order condition only appears after the price has been optimized out at each quality, and it needs differentiability at an interior optimum.

Formalization scope

Consumers are Fin n; the paper's consumer iii is Lean index i−1i-1i−1, while the first argument of fff is a number of buyers in ℕ, so ∑i=1nf(i,q)\sum_{i=1}^n f(i,q)∑i=1n​f(i,q) is ∑ i : Fin n, M.f (i.val + 1) q. v1v_1v1​ and vnv_nvn​ are M.v ⟨0, _⟩ and M.v ⟨n - 1, _⟩. fff and ccc are total functions on ℝ.

The standing assumptions (Market.Standing, pp. 4 and 9) are: n≥1n\ge1n≥1; vi>0v_i>0vi​>0 and vvv antitone; for k≥1k\ge1k≥1 and q≥0q\ge0q≥0, f(k,q)≥0f(k,q)\ge0f(k,q)≥0, fff weakly increasing in kkk and in qqq on [0,∞)[0,\infty)[0,∞), f(k,⋅)f(k,\cdot)f(k,⋅) differentiable on (0,∞)(0,\infty)(0,∞); c≥0c\ge0c≥0 on [0,∞)[0,\infty)[0,∞), weakly increasing there and differentiable on (0,∞)(0,\infty)(0,∞). Statements about a single quality add q≥0q\ge0q≥0, the paper's domain.

Added hypotheses, each disclosed in the items: equilibria are pure (buyer sets); the goal assumes an interior quality q∗>0q^*>0q∗>0 and strong network effects at every q≥0q\ge0q≥0; the "sufficiently convex" cost of p. 4 is dropped, so the goal is the necessary condition only. The profit under potential maximization selects "all buy" at the tie Φ(N)=Φ(∅)\Phi(N)=\Phi(\emptyset)Φ(N)=Φ(∅), as the paper's "if and only if p≤…p\le\dotsp≤…" does.

The profit is defined through the selection (IsPotMax over all buyer sets), not as the reduced formula (14), and the goal's optimality hypothesis ranges over price and quality jointly; defining the profit by (14), or restricting maximizers to {N,∅}\{N,\emptyset\}{N,∅}, would trivialize the mission and is ruled out. Derivatives are deriv, and the standing assumptions guarantee they are genuine at q∗>0q^*>0q∗>0.

Everything needed beyond Mathlib (Finset, deriv, IsLocalMax) is in the single definition file. Proofs of the milestones in any order are welcome, as are proofs of the goal that use the milestones as stepping stones.

Selected references

  • L. T. Chan, Quality Strategies in Network Markets, Management Science, 2023. https://doi.org/10.1287/mnsc.2023.4792 (SSRN version of April 2023: https://ssrn.com/abstract=4203818)
  • D. Monderer and L. S. Shapley, Potential Games, Games and Economic Behavior 14 (1996), 124–143. https://doi.org/10.1006/game.1996.0044
  • A. M. Spence, Monopoly, Quality, and Regulation, Bell Journal of Economics 6 (1975), 417–429. https://www.jstor.org/stable/3003302
8 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryEconomicsOptimization·Captain: mikedeng1

Marketplace Leakage 1: With Uniform Switching Costs the Equilibrium Fee Is min{μ, v − c}, Leakage Is Positive but Partial, and the Marketplace's Profit Increases in μResearch Paper

Motivation

Online marketplaces such as Airbnb, Amazon, eBay, Preply or Upwork earn most of their revenue from transaction fees: a seller who sells through the marketplace pays a fee on every sale. Many of these sellers also run their own sales channel, and a buyer who discovers a seller on the marketplace can often complete the purchase directly with that seller, avoiding the fee. This is marketplace leakage (also called disintermediation or showrooming of the platform). Marketplaces respond with measures the paper lists on its first pages: bundling transaction-related services, restricting buyer–seller communication before a transaction, and penalizing sellers caught taking clients off the platform.

Hagiu and Wright (Marketplace Leakage, Management Science, 2023) build a minimal model of this tension. Their baseline analysis answers the first question any of the later strategies depends on: if the marketplace can only choose its fee, what fee does it set, how much leakage remains in equilibrium, and how do these respond when buying directly becomes more costly for buyers? This mission formalizes that baseline result, Proposition 1 of the paper, for uniformly distributed switching costs.

Setting

There is one marketplace MMM, one seller SSS and a unit mass of buyers, each wanting one unit of SSS's product. Every buyer values the product at vvv; SSS's marginal cost is ccc, with c<vc<vc<v; the outside option is worth 000.

SSS can sell through MMM, paying MMM a fee fff per transaction, or through its direct channel, which carries no fee. It sets a price pmp_mpm​ on MMM and a direct price pdp_dpd​. A buyer who buys directly bears a switching cost sss; in this mission sss is uniformly distributed on [0,μ][0,\mu][0,μ] with μ>0\mu>0μ>0, so its CDF is

G(s)=min⁡{max⁡{sμ,0},1}.G(s)=\min\Bigl\{\max\Bigl\{\frac s\mu,0\Bigr\},1\Bigr\}.G(s)=min{max{μs​,0},1}.

The timing is: MMM sets fff; observing fff, SSS sets its prices; buyers then choose. The paper's Lemma 1 lets one fix pm=vp_m=vpm​=v, so SSS only chooses pd≤vp_d\le vpd​≤v. A buyer buys directly iff s≤v−pds\le v-p_ds≤v−pd​, so a share G(v−pd)G(v-p_d)G(v−pd​) of buyers — the leakage — buys directly. SSS's profit at fee fff is

πf(pd)=(pd−c) G(v−pd)+(v−c−f) (1−G(v−pd)),\pi_f(p_d)=(p_d-c)\,G(v-p_d)+(v-c-f)\,\bigl(1-G(v-p_d)\bigr),πf​(pd​)=(pd​−c)G(v−pd​)+(v−c−f)(1−G(v−pd​)),

and MMM earns Π=f (1−G(v−pd))\Pi=f\,(1-G(v-p_d))Π=f(1−G(v−pd​)). A direct price is seller-optimal at fff if it maximizes πf\pi_fπf​ over pd≤vp_d\le vpd​≤v. An equilibrium outcome is a pair (f,pd)(f,p_d)(f,pd​) with f≤v−cf\le v-cf≤v−c, pdp_dpd​ seller-optimal at fff, such that no other fee f′≤v−cf'\le v-cf′≤v−c, followed by a seller-optimal response, gives MMM more.

Formalization targets

Goal: Proposition 1

For every μ>0\mu>0μ>0 an equilibrium outcome exists, and every equilibrium outcome (f∗,pd∗)(f^*,p_d^*)(f∗,pd∗​) satisfies

f∗(μ)=min⁡{μ,v−c},pd∗(μ)=v−min⁡{μ2,v−c2},Π∗(μ)={μ/2μ≤v−c,(v−c)(1−v−c2μ)μ≥v−c,f^*(\mu)=\min\{\mu,v-c\},\qquad p_d^*(\mu)=v-\min\Bigl\{\frac\mu2,\frac{v-c}2\Bigr\},\qquad \Pi^*(\mu)=\begin{cases}\mu/2 & \mu\le v-c,\\ (v-c)\bigl(1-\frac{v-c}{2\mu}\bigr) & \mu\ge v-c,\end{cases}f∗(μ)=min{μ,v−c},pd∗​(μ)=v−min{2μ​,2v−c​},Π∗(μ)={μ/2(v−c)(1−2μv−c​)​μ≤v−c,μ≥v−c,​

with leakage G(v−pd∗)=1μ(v−pd∗)∈(0,1)G(v-p_d^*)=\frac1\mu(v-p_d^*)\in(0,1)G(v−pd∗​)=μ1​(v−pd∗​)∈(0,1). As μ\muμ increases, the fee weakly increases, the direct price and the leakage weakly decrease, and the marketplace's profit strictly increases.

Milestones

  1. (4): for every fee f≥0f\ge0f≥0 the seller's optimal direct price is unique and equals v−f/2v-f/2v−f/2 if f≤2μf\le2\muf≤2μ and v−μv-\muv−μ if f≥2μf\ge2\muf≥2μ.
  2. (5): at such a response the marketplace earns f(1−f/(2μ))f(1-f/(2\mu))f(1−f/(2μ)) if f≤2μf\le 2\muf≤2μ and 000 if f≥2μf\ge2\muf≥2μ.
  3. The optimal fee (proof of Proposition 1): (f,pd)(f,p_d)(f,pd​) is an equilibrium outcome iff f=min⁡{μ,v−c}f=\min\{\mu,v-c\}f=min{μ,v−c} and pdp_dpd​ is seller-optimal at fff.
  4. Equilibrium leakage (proof of Proposition 1): G(v−pd∗)=f∗/(2μ)=min⁡{1/2,(v−c)/(2μ)}G(v-p_d^*)=f^*/(2\mu)=\min\{1/2,(v-c)/(2\mu)\}G(v−pd∗​)=f∗/(2μ)=min{1/2,(v−c)/(2μ)}.

Significance

Proposition 1 is the baseline against which the paper measures every anti-leakage strategy: investment in transaction benefits, communication bans, referral fees and price-parity clauses are each compared with the fee-only outcome Π∗(μ)\Pi^*(\mu)Π∗(μ), and Proposition 3 of the paper uses the closed form (6) directly. The result also has a substantive message: a fee-setting marketplace never eliminates leakage, but never lets it become total, and it gains from higher switching costs even though its own fee response offsets part of their effect on leakage.

The proposition is proved in the paper by elementary calculus. To our knowledge it has no machine-checked proof. Formalizing it produces a checked version of the baseline game, a verified statement of the seller's best response and the marketplace's value as functions of the fee, and a template that the companion missions on this paper reuse.

Difficulty

The seller's problem is not a smooth concave program: the clamped distribution GGG creates a kink at v−pd=μv-p_d=\muv−pd​=μ, below which every buyer switches and the profit is linear in pdp_dpd​. The first-order condition pd=v−f/2p_d=v-f/2pd​=v−f/2 is the optimum only while f≤2μf\le2\muf≤2μ; above that the optimum sits at the kink. The marketplace's objective inherits a kink at f=2μf=2\muf=2μ, and its feasible set f≤v−cf\le v-cf≤v−c adds a corner that binds exactly when μ>v−c\mu>v-cμ>v−c. Negative fees are feasible and must be ruled out. The comparative statics compare equilibrium objects across two parameter values that may lie in different regimes, so the statement cannot be read off one formula.

Formalization scope

All parameters are real numbers, with the standing assumptions c<vc<vc<v and μ>0\mu>0μ>0 as explicit hypotheses. GGG is the clamped uniform CDF above. The statements use the reduced seller problem (1) with pm=vp_m=vpm​=v, as the paper does after Lemma 1; Lemma 1 itself, which concerns the full game in which SSS also chooses pmp_mpm​, is not posed. Seller-optimality is an optimality predicate over pd≤vp_d\le vpd​≤v, and the equilibrium is an optimality predicate over feasible fees f≤v−cf\le v-cf≤v−c (negative fees included); "max" is attained, not a supremum. The displays (4) and (5) are stated for f≥0f\ge0f≥0, which is what they require; the paper's preface "Assuming f≤v−cf\le v-cf≤v−c" is not needed and does not exclude f<0f<0f<0.

Trivializing formalizations are ruled out: the seller's response and the marketplace's profit are not defined by the closed forms (4)–(5), the marketplace's value is not an unattained sSup, the equilibrium fee is not selected by Classical.choose, and the comparative statics are stated about equilibrium outcomes at two values of μ\muμ, not about the formulas alone.

The development needs only Mathlib's real arithmetic, min/max and order lemmas. A proof of the seller's best response for a clamped uniform distribution is reusable in the companion missions on transaction benefits, communication bans and price parity, which restate the same model. Proofs of any milestone are welcome independently.

Selected references

  • A. Hagiu and J. Wright, Marketplace Leakage, Management Science, 2023. https://doi.org/10.1287/mnsc.2023.4757 (formalized from the authors' manuscript dated March 2023; Proposition 1 on pp. 9–10, proof in §8.2, p. 34).
6 thms2 active usersReviewed
Algorithmic Game TheoryEconomics·Captain: mikedeng1

Fair and Consistent Prize Allocation in Competitions 3: Anonymity, Order Preservation, Winner Strict Endowment Monotonicity and Top Consistency Characterize Parametric RulesResearch Paper

Motivation

Rank-order competitions — sports tournaments, poker final tables, golf tours, crowdsourcing contests, sales leagues — end with a ranking of the participants and a pot of prize money that has to be split according to that ranking. Organisers publish prize tables that change with the number of entrants and with the size of the purse, and these tables are usually justified only by tradition. Dietzenbacher and Kondratev (arXiv:2008.08985v2, published in Management Science 2023, doi:10.1287/mnsc.2022.4520) take the axiomatic approach of fair-division theory and ask which prize allocation rules are characterised by natural requirements of fairness and coherence across competitions of different sizes.

Consistency — invariance of a rule under "re-running the allocation" for a subgroup with the money it collectively received — has a long history in axiomatic allocation: bankruptcy problems (Aumann and Maschler 1985), taxation (Young 1987), bargaining (Lensberg 1987, 1988) and cooperative games (Peleg 1986; Hart and Mas-Colell 1989). The paper applies it to competitions. Full consistency together with order preservation and endowment monotonicity yields the interval rules (Theorem 1); weakening consistency to local consistency yields the single-parametric rules (Theorem 2). This mission concerns the weakest version, top consistency, which only constrains the top segment of the ranking and describes real prize schemes such as the golf tournament of Table 1(b) of the paper. It is the third mission of a series on this paper; the first two treat Theorems 1 and 2.

Setting

Fix a countable set UUU of at least three potential competitors. A competition (N,R,E)(N,\mathcal R,E)(N,R,E) consists of a finite nonempty set N⊆UN\subseteq UN⊆U, a ranking R:N→{1,…,∣N∣}\mathcal R:N\to\{1,\dots,|N|\}R:N→{1,…,∣N∣} (a bijection; competitor iii is ranked above jjj when R(i)<R(j)\mathcal R(i)<\mathcal R(j)R(i)<R(j)), and a prize endowment E≥0E\ge0E≥0. For S⊆NS\subseteq NS⊆N the subranking RS:S→{1,…,∣S∣}\mathcal R_S:S\to\{1,\dots,|S|\}RS​:S→{1,…,∣S∣} orders SSS as R\mathcal RR does.

A prize allocation rule φ\varphiφ assigns to each competition a vector φ(N,R,E)∈R+N\varphi(N,\mathcal R,E)\in\mathbb R_+^Nφ(N,R,E)∈R+N​ with ∑i∈Nφi(N,R,E)=E\sum_{i\in N}\varphi_i(N,\mathcal R,E)=E∑i∈N​φi​(N,R,E)=E. The axioms are:

  • anonymity: φi(N,R,E)=φj(N′,R′,E)\varphi_i(N,\mathcal R,E)=\varphi_j(N',\mathcal R',E)φi​(N,R,E)=φj​(N′,R′,E) whenever ∣N∣=∣N′∣|N|=|N'|∣N∣=∣N′∣ and R(i)=R′(j)\mathcal R(i)=\mathcal R'(j)R(i)=R′(j);
  • order preservation: R(i)<R(j)\mathcal R(i)<\mathcal R(j)R(i)<R(j) implies φi≥φj\varphi_i\ge\varphi_jφi​≥φj​;
  • winner strict endowment monotonicity: if E<E′E<E'E<E′ then φi(N,R,E)≤φi(N,R,E′)\varphi_i(N,\mathcal R,E)\le\varphi_i(N,\mathcal R,E')φi​(N,R,E)≤φi​(N,R,E′) for all iii, strictly for the winner R(i)=1\mathcal R(i)=1R(i)=1;
  • top consistency: for each S⊆NS\subseteq NS⊆N with R(i)≤∣S∣\mathcal R(i)\le|S|R(i)≤∣S∣ for every i∈Si\in Si∈S, and each i∈Si\in Si∈S,
φi(N,R,E)=φi(S,RS,∑j∈Sφj(N,R,E)).\varphi_i(N,\mathcal R,E)=\varphi_i\Big(S,\mathcal R_S,\sum_{j\in S}\varphi_j(N,\mathcal R,E)\Big).φi​(N,R,E)=φi​(S,RS​,j∈S∑​φj​(N,R,E)).

A rule is parametric if there are continuous non-decreasing f1,f2,⋯:R+→R+f_1,f_2,\dots:\mathbb R_+\to\mathbb R_+f1​,f2​,⋯:R+​→R+​ with f1(x)=xf_1(x)=xf1​(x)=x and fk+1(x)≤fk(x)f_{k+1}(x)\le f_k(x)fk+1​(x)≤fk​(x) such that φi(N,R,E)=fR(i)(x)\varphi_i(N,\mathcal R,E)=f_{\mathcal R(i)}(x)φi​(N,R,E)=fR(i)​(x), where x≥0x\ge0x≥0 solves ∑k=1∣N∣fk(x)=E\sum_{k=1}^{|N|}f_k(x)=E∑k=1∣N∣​fk​(x)=E. The winner gets xxx and position kkk gets fk(x)f_k(x)fk​(x). Equal Division (fk(x)=xf_k(x)=xfk​(x)=x) and Winner-Takes-All (fk=0f_k=0fk​=0 for k≥2k\ge2k≥2) are parametric.

Formalization targets

Goal: Theorem 3 (p. 22)

φ is anonymous, order preserving, winner strictly endowment monotonic and top consistent  ⟺  φ is a parametric rule.\varphi \text{ is anonymous, order preserving, winner strictly endowment monotonic and top consistent}\iff\varphi\text{ is a parametric rule.}φ is anonymous, order preserving, winner strictly endowment monotonic and top consistent⟺φ is a parametric rule.

Both directions are part of the goal.

Milestones (proof of Theorem 3, pp. 32–33)

  1. Every parametric rule satisfies the four axioms (the "readily checked" direction).
  2. Under order preservation, endowment continuity and winner strict endowment monotonicity, the winner's prize E↦φ1(N,R,E)E\mapsto\varphi_1(N,\mathcal R,E)E↦φ1​(N,R,E) is strictly increasing, continuous and unbounded on R+\mathbb R_+R+​, so each x≥0x\ge0x≥0 is the winner's prize for exactly one EEE.
  3. The induction step: a representation f1,…,fnf_1,\dots,f_nf1​,…,fn​ valid on all competitions with at most nnn competitors extends, by a new continuous non-decreasing fn+1≤fnf_{n+1}\le f_nfn+1​≤fn​, to all competitions with n+1n+1n+1 competitors.

Lemma 1 of the paper (endowment monotonicity implies endowment continuity, p. 10) is used in the proof; it is formalized in the first mission of this series and will be referenced from there.

Companion: Corollary 8 (p. 22)

Replacing winner strict endowment monotonicity by endowment additivity (equivalently scale invariance) characterises the proportional rules φi=λR(i)E/∑k≤∣N∣λk\varphi_i=\lambda_{\mathcal R(i)}E/\sum_{k\le|N|}\lambda_kφi​=λR(i)​E/∑k≤∣N∣​λk​ with λ1>0\lambda_1>0λ1​>0 and λk+1≤λk\lambda_{k+1}\le\lambda_kλk+1​≤λk​.

Significance

Theorem 3 says that the four axioms leave exactly one degree of freedom per position: a monotone function of the winner's prize. This gives organisers a complete menu of prize schemes that are fair in the anonymous, order-preserving sense and that keep the top of the table unchanged when lower-ranked entrants leave — the property that matters when competitors are eliminated one at a time and paid at the moment of elimination. It contains the single-parametric rules of Theorem 2, the Winner-Takes-Surplus rules, the geometric rules and the proportional rules (Corollary 8) as special cases, and the paper shows in a Remark (p. 33) that the four axioms are logically independent.

The theorem is proved in the paper; to our knowledge no part of it has been machine-checked. The formalization adds a reusable layer for variable-population allocation problems — rankings of finite subsets of a fixed universe, subrankings, and consistency axioms restricted to families of subsets — that is not in Mathlib. Formal proofs of both directions, of the milestones, and of Corollary 8 are all welcome.

Difficulty

The "if" direction is a computation, but it requires showing that the parameter xxx is well defined and moves monotonically with EEE, which uses f1(x)=xf_1(x)=xf1​(x)=x and the intermediate value theorem. The "only if" direction must construct the functions fkf_kfk​ from an abstract rule. The natural first idea — define fk(x)f_k(x)fk​(x) as the prize of position kkk when the winner receives xxx — needs the winner's prize to be invertible as a function of EEE, which uses continuity (supplied by Lemma 1, not assumed), strict monotonicity only for the winner, and unboundedness, which comes from order preservation together with exhaustion of the endowment. Top consistency then has to transfer the representation from competitions of size nnn to size n+1n+1n+1, and anonymity has to transfer it from one ranked set to every other one of the same size; the induction over the number of competitors must keep all smaller sizes, since top consistency reduces to every top segment.

Formalization scope

  • A ranked set (N,R)(N,\mathcal R)(N,R) is a duplicate-free nonempty List U, best competitor first; R(i)\mathcal R(i)R(i) is the 1-based index pos l i, and RS\mathcal R_SRS​ is the sublist of entries in SSS. UUU is an arbitrary type with decidable equality; the paper's standing assumptions (countable, at least three elements) are hypotheses of the goal and of Corollary 8, and are omitted from milestones that do not use them.
  • A rule is a function φ : List U → ℝ → U → ℝ; it is required to be a prize allocation rule (nonnegative prizes summing to EEE) on rankings and E≥0E\ge0E≥0, and every axiom quantifies only over that domain. Endowments are reals with E≥0E\ge0E≥0.
  • The representation f1,f2,…f_1,f_2,\dotsf1​,f2​,… is f : ℕ → ℝ → ℝ, indexed from 1 as on the page (f0f_0f0​ unused); continuity, monotonicity, nonnegativity and f1(x)=xf_1(x)=xf1​(x)=x are required on [0,∞)[0,\infty)[0,∞). The parameter xxx is given existentially; it is unique, so this is the page's "where x∈R+x\in\mathbb R_+x∈R+​ is such that".
  • Endowment continuity is coordinatewise continuity on [0,∞)[0,\infty)[0,∞).

Trivializing formalizations are ruled out: rules act on every finite ranked subset of UUU, not on a fixed competitor set; top consistency quantifies over exactly the top segments (full or local consistency would change the theorem — the rule of Example 6 is parametric but not locally consistent); the goal is a biconditional; the parametric family includes f1=idf_1=\mathrm{id}f1​=id, the decreasing chain fk+1≤fkf_{k+1}\le f_kfk+1​≤fk​, and continuity of every fkf_kfk​.

Corollary 7 of the paper is not included: its "only if" parts ("for each kkk") fail as written when UUU is finite, since fkf_kfk​ for k>∣U∣k>|U|k>∣U∣ is not determined by the rule.

Selected references

  • B. J. Dietzenbacher and A. Y. Kondratev, Fair and Consistent Prize Allocation in Competitions, arXiv:2008.08985v2, 2021; Management Science, 2023. https://arxiv.org/abs/2008.08985v2, https://doi.org/10.1287/mnsc.2022.4520
  • R. J. Aumann and M. Maschler, Game theoretic analysis of a bankruptcy problem from the Talmud, Journal of Economic Theory 36(2):195–213, 1985. https://doi.org/10.1016/0022-0531(85)90102-4
  • S. Hart and A. Mas-Colell, Potential, value, and consistency, Econometrica 57(3):589–614, 1989. https://doi.org/10.2307/1911054
8 thms2 active usersReviewed
🏆Completed
EconomicsOptimization·Captain: mikedeng1

Digital Privacy II: Against the Social Optimum, a Business Never Under-Collects While Over-Protecting Data, and a Purely Usage-Driven One Under-Collects and Under-ProtectsResearch Paper

Motivation

Digital businesses (search engines, social networks, marketplaces) record what their users do and decide how well to protect what they record. Both choices affect users: stored data can improve the service, and it can also be accessed by adversaries such as hackers, fraudsters or data brokers, whose activity harms users. Regulation of data collection and data protection (the GDPR, the CCPA, liability rules for breaches) presupposes an answer to a basic question: in which direction does a profit-maximizing business's data strategy deviate from the one a benevolent planner would choose?

I. P. Fainmesser, A. Galeotti and R. Momot, Digital Privacy (Management Science 69(6), 2023; author manuscript SSRN 3459274), answer it in a model where users, adversaries and the business all respond to each other. Their Theorem 2 shows that the deviation is not arbitrary: one combination of errors never occurs, and the sign of the error is pinned down completely for a business whose revenue depends only on usage. This mission formalizes those two claims.

Setting

A data strategy is a pair (ξ,C)(\xi, C)(ξ,C): the share ξ∈[0,1]\xi \in [0,1]ξ∈[0,1] of each user's activity that the business stores, and a protection level C≥0C \ge 0C≥0, which costs ψC\psi CψC. The parameters are real numbers: a network effect β∈[0,1)\beta \in [0,1)β∈[0,1), the users' marginal benefit from stored data ρ∈[0,1)\rho \in [0,1)ρ∈[0,1), the cost ψ\psiψ, the revenue model P∈[0,1]P \in [0,1]P∈[0,1], and the planner's weight α∈[0,1]\alpha \in [0,1]α∈[0,1].

Given (ξ,C)(\xi, C)(ξ,C), a unit mass of identical users choose activity levels and a large population of adversaries decide whether to access the stored data. The resulting equilibrium (Proposition 1 of the paper, display (3)) has average user activity

aˉ∗(ξ,C)=C(1+ρξ)C(1−β)+ξ2,aˉ∗(0,C)=11−β.\bar a^*(\xi, C) = \frac{C(1+\rho\xi)}{C(1-\beta)+\xi^2}, \qquad \bar a^*(0, C) = \frac{1}{1-\beta}.aˉ∗(ξ,C)=C(1−β)+ξ2C(1+ρξ)​,aˉ∗(0,C)=1−β1​.

The value at ξ=0\xi = 0ξ=0 is the activity when nothing is stored, the value the paper uses where (3) reads 0/00/00/0. From aˉ∗\bar a^*aˉ∗ one builds the consumer surplus (4), the business's profit (2) and the planner's objective (7):

CS(ξ,C)=12aˉ∗(ξ,C)2,Π(ξ,C)=(1−P) aˉ∗(ξ,C)+P ξ aˉ∗(ξ,C)−ψC,W(ξ,C)=α CS(ξ,C)+(1−α) Π(ξ,C).\mathrm{CS}(\xi,C) = \tfrac12 \bar a^*(\xi,C)^2, \qquad \Pi(\xi,C) = (1-P)\,\bar a^*(\xi,C) + P\,\xi\,\bar a^*(\xi,C) - \psi C, \qquad W(\xi,C) = \alpha\,\mathrm{CS}(\xi,C) + (1-\alpha)\,\Pi(\xi,C).CS(ξ,C)=21​aˉ∗(ξ,C)2,Π(ξ,C)=(1−P)aˉ∗(ξ,C)+Pξaˉ∗(ξ,C)−ψC,W(ξ,C)=αCS(ξ,C)+(1−α)Π(ξ,C).

The revenue model PPP interpolates between a purely usage-driven business (P=0P = 0P=0, revenue proportional to activity) and a purely data-driven one (P=1P = 1P=1, revenue proportional to stored data ξaˉ∗\xi \bar a^*ξaˉ∗). A business optimum (ξ∗,C∗)(\xi^*, C^*)(ξ∗,C∗) maximizes Π\PiΠ over the feasible set [0,1]×[0,∞)[0,1] \times [0,\infty)[0,1]×[0,∞); a social optimum (ξW,CW)(\xi^W, C^W)(ξW,CW) maximizes WWW over the same set. The business under-collects if ξ∗≤ξW\xi^* \le \xi^Wξ∗≤ξW and over-protects if C∗≥CWC^* \ge C^WC∗≥CW, and so on.

Formalization targets

Goal: Theorem 2, first two sentences

The paper's Theorem 2 (p. 13) reads:

Relative to the socially optimal strategy, the equilibrium data strategy of a purely usage-driven business (P = 0) prescribes under-collection and under-protection of users' data, i.e., ξ* ≤ ξ^W and C* ≤ C^W. The equilibrium data strategy of a business with any data-driven component in its revenue model (P > 0) never prescribes under-collection and over-protection of users' data i.e., it is never the case that ξ* ≤ ξ^W and C* ≥ C^W with at least one of the inequalities being strict. Any other direction in which the optimal business's data strategy deviates from the socially optimal strategy is the outcome for some specification of the business's revenue model and values of other model parameters.

The goal is its first two sentences, for every business optimum and every social optimum:

P=0  ⟹  ξ∗≤ξW and C∗≤CW,P = 0 \;\Longrightarrow\; \xi^* \le \xi^W \text{ and } C^* \le C^W,P=0⟹ξ∗≤ξW and C∗≤CW, P>0  ⟹  ¬(ξ∗≤ξW, C∗≥CW, at least one strict).P > 0 \;\Longrightarrow\; \neg\bigl(\xi^* \le \xi^W,\ C^* \ge C^W,\ \text{at least one strict}\bigr).P>0⟹¬(ξ∗≤ξW, C∗≥CW, at least one strict).

The third sentence is established numerically in the paper (Figure 3) and is not a target.

Milestones

  1. Display (11), p. 34: under ξ∗≤ξW\xi^* \le \xi^Wξ∗≤ξW and C∗≥CWC^* \ge C^WC∗≥CW, the social optimum has weakly higher activity, aˉ∗(ξW,CW)≥aˉ∗(ξ∗,C∗)\bar a^*(\xi^W, C^W) \ge \bar a^*(\xi^*, C^*)aˉ∗(ξW,CW)≥aˉ∗(ξ∗,C∗).
  2. Display (12), p. 34: under the same assumptions, aˉ∗(ξW,CW) ξW≥aˉ∗(ξ∗,C∗) ξ∗\bar a^*(\xi^W,C^W)\,\xi^W \ge \bar a^*(\xi^*,C^*)\,\xi^*aˉ∗(ξW,CW)ξW≥aˉ∗(ξ∗,C∗)ξ∗.
  3. Proposition 5(i), first claim (Online App. p. 8): for fixed CCC and P=0P = 0P=0, a collection level maximizes Π(⋅,C)\Pi(\cdot, C)Π(⋅,C) on [0,1][0,1][0,1] if and only if it maximizes W(⋅,C)W(\cdot, C)W(⋅,C).
  4. The P=0P = 0P=0 step of the proof (App. A.4, p. 34): if P=0P = 0P=0 and ξ∗>ξW\xi^* > \xi^Wξ∗>ξW, then C∗>CWC^* > C^WC∗>CW.

Significance

The result. Theorem 2 identifies the one inefficiency that no revenue model produces: a business never stores too little data while protecting it too much. All other combinations occur for some parameters, so a regulator cannot infer the direction of a business's error without knowing its revenue model; but for a purely usage-driven business the direction is known, and it is too little protection. This underlies the paper's discussion of policy in §6, where the instruments considered (liability for data breaches, taxes on data) are compared by how they move (ξ∗,C∗)(\xi^*, C^*)(ξ∗,C∗) towards (ξW,CW)(\xi^W, C^W)(ξW,CW).

The formalization. The result is proved in the paper (App. A.4, with Proposition 5 in Online App. C.5); it has not been machine-checked. The paper's argument for the purely usage-driven case refers to first-order conditions and does not treat the boundary strategies (ξ=0\xi = 0ξ=0, C=0C = 0C=0) or parameter corners (ρ=0\rho = 0ρ=0) separately; a formal proof has to handle them. A complete development also yields reusable facts about the equilibrium activity aˉ∗\bar a^*aˉ∗: its sign, its behaviour in ξ\xiξ for fixed CCC, and the monotonicity in CCC of the activity-maximizing collection level.

Difficulty

Both optima are defined only implicitly, as maximizers over a non-compact feasible set of a non-concave objective, and neither has a closed form that this mission may use. The comparison must therefore work from the optimality inequalities alone. The tempting approach, comparing first-order conditions, does not give a global statement: Π\PiΠ and WWW may have several local maxima, the maximizers need not be unique (both optima are (0,0)(0,0)(0,0) in a whole region of parameters), and the constraint ξ≤1\xi \le 1ξ≤1 binds for large protection. In the purely usage-driven case the profit and welfare share their maximizers in ξ\xiξ for each fixed CCC, but turning that into a comparison of C∗C^*C∗ with CWC^WCW requires control of how the maximizing ξ\xiξ moves with CCC, including at C=0C = 0C=0.

Formalization scope

All objects are real-valued functions of explicit real parameters β,ρ,ψ,P,α\beta, \rho, \psi, P, \alphaβ,ρ,ψ,P,α and of the strategy (ξ,C)(\xi, C)(ξ,C), in the namespace DigitalPrivacy.Welfare, which imports aˉ∗\bar a^*aˉ∗, CS, the feasible set and the business optimum from the shared module DigitalPrivacy.Strategy.Setting. The equilibrium activity takes the value 1/(1−β)1/(1-\beta)1/(1−β) at ξ=0\xi = 0ξ=0 for every CCC, as in the paper; Lean's default 0/0=00/0 = 00/0=0 is not used. Optima are predicates (IsBusinessOpt, IsSocialOpt): a feasible point at which the objective is at least its value at every feasible point. Theorem 2 quantifies over every pair of optima and asserts neither existence nor uniqueness. The P > 0 clause keeps the "at least one strict" condition; without it the clause is false, because both optima coincide at (0,0)(0,0)(0,0) in part of the parameter space.

The standing assumptions are the paper's ranges 0≤β<10 \le \beta < 10≤β<1, 0≤ρ<10 \le \rho < 10≤ρ<1, 0≤P≤10 \le P \le 10≤P≤1, α≤1\alpha \le 1α≤1, with two disclosed strengthenings: ψ>0\psi > 0ψ>0 (with ψ=0\psi = 0ψ=0, ρ=0\rho = 0ρ=0, P=0P = 0P=0, every (0,C)(0, C)(0,C) is both a business and a social optimum and the P=0P = 0P=0 sentence fails) and α>0\alpha > 0α>0 (with α=0\alpha = 0α=0 the planner's problem is the business's, and step (11) does not hold). Proposition 5(i) is stated with the printed ranges, α=0\alpha = 0α=0 included. No other hypothesis is added, so the hypotheses on the optima cannot be made vacuous by the encoding; a sanity check exhibits parameters at which (0,0)(0,0)(0,0) is both a business and a social optimum.

A complete development needs elementary real analysis of the rational function aˉ∗\bar a^*aˉ∗ on [0,1]×[0,∞)[0,1] \times [0,\infty)[0,1]×[0,∞) and nothing beyond Mathlib. Proofs of the milestones, of lemmas about aˉ∗\bar a^*aˉ∗, and alternative arguments for the goal are all welcome. The paper's proofs are in App. A.4 (pp. 33–35) and Online App. C.5 (Online pp. 8–9).

Selected references

  • I. P. Fainmesser, A. Galeotti, R. Momot, Digital Privacy, Management Science 69(6):3157–3173, 2023. https://doi.org/10.1287/mnsc.2022.4513. Author manuscript, This Draft: April 2022, https://ssrn.com/abstract=3459274 (the version cited for all page and display numbers).
7 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryEconomicsMechanism Design·Captain: mikedeng1

Improving Dispute Resolution in Two-Sided Platforms: The Case of Review Blackmail I: Under Centralized Dispute Resolution the Equilibrium Ransom Is Not Monotonically Decreasing in Efficiency γδResearch Paper

Review blackmail on online platforms

Online marketplaces depend on consumer reviews, and a single negative review can move a seller's future sales. Review blackmail exploits this: a consumer buys a product, posts a negative review, and offers to remove it in exchange for a payment. Platforms such as Amazon, eBay, Taobao and TripAdvisor respond with dispute resolution mechanisms that let sellers contest reviews. Papanastasiou, Yang and Zhang (Management Science 69(10), 2023) build a game-theoretic model of the seller, the blackmailer and the market's belief about product quality, and ask how the design of such a mechanism changes the blackmailer's leverage. Their first finding concerns a centralized mechanism, where the seller reports the review and the platform judges it: making the platform faster or more accurate does not always lower the ransom the blackmailer can extract. This mission formalizes that result together with the equilibrium analysis it rests on.

The model

A monopolist sells a product of unobservable quality q∈{l,h}q\in\{l,h\}q∈{l,h}; the market's prior that quality is high is a∈(0,1)a\in(0,1)a∈(0,1). A buyer of a high-quality product has gross utility vjv_jvj​ with probability θ∈(0,1)\theta\in(0,1)θ∈(0,1) and 000 otherwise, with vjv_jvj​ standard uniform; a low-quality product always gives 000. One consumer arrives.

  • With probability β∈(0,1)\beta\in(0,1)β∈(0,1) he is malicious: he buys, posts a negative review NNN, and demands a ransom rrr for removing it.
  • Otherwise he is regular: at price ppp he buys iff aθvj−p≥0a\theta v_j-p\ge0aθvj​−p≥0, which happens with probability ρ=1−p/(aθ)\rho=1-p/(a\theta)ρ=1−p/(aθ), and posts a truthful review, positive (PPP) or negative (NNN). No purchase means no review, written R=0R=0R=0.

The market sees the review R∈{N,0,P}R\in\{N,0,P\}R∈{N,0,P}, updates its belief to a posterior a′a'a′ by Bayes' rule, and the seller then earns a continuation payoff π(a′)\pi(a')π(a′), with π\piπ nonnegative, convex and strictly increasing on [0,1][0,1][0,1].

Facing a ransom demand the seller can settle (sss: pay rrr, the review disappears), do nothing (nnn: the review stays), or report (ccc) the review to the platform's centralized mechanism at a hassle cost c≥0c\ge0c≥0. The platform investigates immediately with probability γ∈[0,1]\gamma\in[0,1]γ∈[0,1] (timeliness) and identifies a malicious review correctly with probability δ∈[0,1]\delta\in[0,1]δ∈[0,1] (accuracy); the review is removed with probability γδ\gamma\deltaγδ, the mechanism efficiency.

The market cannot observe the seller's interaction with the blackmailer. It holds a belief i∈{s,n,c}i\in\{s,n,c\}i∈{s,n,c} about the seller's response, and this belief determines the posteriors: under belief iii a malicious review stays visible with probability ms=0m_s=0ms​=0, mn=1m_n=1mn​=1 or mc=1−γδm_c=1-\gamma\deltamc​=1−γδ, and aRia^i_RaRi​ is the Bayes posterior computed from the resulting review likelihoods. When the market believes iii and the seller plays jjj, his payoff is π(a0i)−r\pi(a^i_0)-rπ(a0i​)−r (j=sj=sj=s), π(aNi)\pi(a^i_N)π(aNi​) (j=nj=nj=n), or γδ π(a0i)+(1−γδ)π(aNi)−c\gamma\delta\,\pi(a^i_0)+(1-\gamma\delta)\pi(a^i_N)-cγδπ(a0i​)+(1−γδ)π(aNi​)−c (j=cj=cj=c). A response iii is an equilibrium if it is a best response to the belief iii; among several equilibria, the seller-preferred one prevails. The malicious consumer buys iff some ransom r>pr>pr>p is accepted in the prevailing equilibrium, and the equilibrium ransom r∗r^*r∗ is the greatest ransom at which settling prevails.

Formalization targets

Goal: Corollary 1 (p. 14)

If c>0c>0c>0 and p<π(a)−π(aNn)−cp<\pi(a)-\pi(a^n_N)-cp<π(a)−π(aNn​)−c, there are efficiencies 0≤e1<e2≤10\le e_1<e_2\le10≤e1​<e2​≤1 at both of which the malicious consumer purchases, with

r∗(e1)<r∗(e2).r^*(e_1)<r^*(e_2).r∗(e1​)<r∗(e2​).

The equilibrium ransom is not monotonically decreasing in the efficiency γδ\gamma\deltaγδ.

Milestones

  1. Lemma 2 (p. 11): aPi=1a^i_P=1aPi​=1, a0i=aa^i_0=aa0i​=a, aNi∈[0,a]a^i_N\in[0,a]aNi​∈[0,a], and closed forms of aNna^n_NaNn​, aNca^c_NaNc​, aNsa^s_NaNs​.
  2. Ordering (§4.1, p. 11): aNs<aNc<aNna^s_N<a^c_N<a^n_NaNs​<aNc​<aNn​ for 0<γδ<10<\gamma\delta<10<γδ<1.
  3. Proposition 1(1)–(3) (p. 13): the exact conditions under which nnn, sss and ccc are equilibria, e.g.
i=n is an equilibrium  ⟺  π(aNn)≥max⁡{π(a)−r, π(a)−c/γδ}.i=n\ \text{is an equilibrium}\iff \pi(a^n_N)\ge\max\{\pi(a)-r,\ \pi(a)-c/\gamma\delta\}.i=n is an equilibrium⟺π(aNn​)≥max{π(a)−r, π(a)−c/γδ}.
  1. Proposition 2(1)–(2) (p. 13): the equilibrium ransom
r∗={π(a)−π(aNn),c≥γδ(π(a)−π(aNn)),(1−γδ)[π(a)−π(aNc)]+c,c<γδ(π(a)−π(aNn)),r^*=\begin{cases}\pi(a)-\pi(a^n_N), & c\ge\gamma\delta(\pi(a)-\pi(a^n_N)),\\ (1-\gamma\delta)[\pi(a)-\pi(a^c_N)]+c, & c<\gamma\delta(\pi(a)-\pi(a^n_N)),\end{cases}r∗={π(a)−π(aNn​),(1−γδ)[π(a)−π(aNc​)]+c,​c≥γδ(π(a)−π(aNn​)),c<γδ(π(a)−π(aNn​)),​

and the malicious consumer purchases iff p<r∗p<r^*p<r∗.

Significance

Corollary 1 is the paper's headline message about centralized dispute resolution: improving the mechanism's timeliness or accuracy can raise the ransom. Below an efficiency threshold the mechanism is never used and the ransom equals the seller's loss from a visible negative review; just above it, the market expects the seller to report blackmail, which softens how it reads a negative review, and the blackmailer can ask for more. This is the motivation for the paper's second design, semi-decentralized dispute resolution, analysed in a companion mission. Proposition 2 is the complete characterization of the blackmailer's equilibrium behaviour under the centralized mechanism and is used again in the paper's pricing analysis (§4.4).

The results are proved in the paper (Appendix C). No machine-checked version exists. This mission produces Lean statements of the model, of the Bayes posteriors, of the equilibrium conditions, of the seller-preferred selection and of the ransom characterization, all derived from the primitive game rather than from the paper's closed forms.

Difficulty

Each step is elementary, but the chain is long and sign-sensitive. The equilibrium conditions require handling a belief-dependent payoff (the posterior depends on what the market believes, not on what the seller does), so a deviation changes the action without changing the posteriors. The ransom characterization needs a three-way comparison of equilibria and the tie-breaking in favour of settling at the boundary, where two equilibria give the same payoff. The corollary needs the jump at the threshold efficiency c/(π(a)−π(aNn))c/(\pi(a)-\pi(a^n_N))c/(π(a)−π(aNn​)) to be strictly positive and to survive a small increase of the efficiency: the posterior aNca^c_NaNc​ moves with the efficiency, so a continuity argument for π\piπ composed with the posterior is required, and π\piπ is only assumed convex and strictly increasing on [0,1][0,1][0,1]. The natural first idea, comparing the two closed forms of Proposition 2 at a single point, does not suffice, since at the threshold itself the two regimes coincide in value.

Formalization scope

  • Representation. One structure Model with fields a,θ,β,p,ca,\theta,\beta,p,ca,θ,β,p,c and π:R→R\pi:\mathbb R\to\mathbb Rπ:R→R; inductive types for quality, reviews (NNN, Z for R=0R=0R=0, PPP) and responses. The posterior post m R is Bayes' rule over the likelihood table with visibility probability mmm of a malicious review; aRia^i_RaRi​ is post (keep (γ*δ) i) R.
  • Standing assumptions (Standing): a,θ,β∈(0,1)a,\theta,\beta\in(0,1)a,θ,β∈(0,1); π≥0\pi\ge0π≥0, convex and strictly increasing on [0,1][0,1][0,1]; c≥0c\ge0c≥0; and 0<p<aθ0<p<a\theta0<p<aθ. The last is implicit in the paper: it makes the purchase probability 1−p/(aθ)1-p/(a\theta)1−p/(aθ) that of a standard uniform valuation and keeps the event R=0R=0R=0 of positive probability. Every theorem also assumes γ,δ∈[0,1]\gamma,\delta\in[0,1]γ,δ∈[0,1].
  • Added hypotheses. 0<γδ<10<\gamma\delta<10<γδ<1 in the ordering (strictness) and in Proposition 1 (the page divides by γδ\gamma\deltaγδ and 1−γδ1-\gamma\delta1−γδ). c>0c>0c>0 in Corollary 1: at c=0c=0c=0 the corollary is false. Corollary 1's hypothesis, printed with a varying γδ\gamma\deltaγδ, is assumed at the threshold efficiency and required at both exhibited efficiencies.
  • Conventions. "Settling prevails" means settling is an equilibrium and no equilibrium pays the seller strictly more (ties go to settling, as in the paper's proof). r∗r^*r∗ is stated with IsGreatest of the set of ransoms at which settling prevails; purchase means some such ransom exceeds ppp. "Not monotonically decreasing" means not nonincreasing.
  • Ruled out. Defining the posteriors by Lemma 2's closed forms, or r∗r^*r∗ by Proposition 2's formulas, would make the milestones definitional; both are defined from the game instead.
  • Infrastructure. Only Mathlib (ConvexOn, StrictMonoOn, IsGreatest). Proofs of the milestones in order, and reusable lemmas on the monotonicity of the posterior in the visibility probability, are welcome.

Selected references

  • Y. Papanastasiou, S. A. Yang, A. H. Zhang, Improving Dispute Resolution in Two-Sided Platforms: The Case of Review Blackmail, Management Science 69(10):6021–6037, 2023. https://doi.org/10.1287/mnsc.2022.4655 (accepted manuscript: LBS Research Online, eprint 1988, https://lbsresearch.london.edu/id/eprint/1988/)
9 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryEconomicsMechanism Design·Captain: mikedeng1

Improving Dispute Resolution in Two-Sided Platforms: The Case of Review Blackmail II: Under Semi-Decentralized Dispute Resolution with Penalty b the Equilibrium Ransom Has a Two-Regime Closed FormResearch Paper

Motivation

Online marketplaces rely on consumer reviews, and a negative review lowers what future buyers believe about a product. Review blackmail exploits this: a consumer buys, posts a negative review, and offers to remove it for a ransom. Platforms counter with dispute-resolution mechanisms. Papanastasiou, Yang and Zhang (Management Science 69(10), 2023) compare two of them in a Bayesian game between a seller, one consumer and the market. Under the centralized mechanism the seller reports the review and the platform decides whether to remove it. Under the semi-decentralized mechanism the seller removes the review himself, and the platform checks afterwards. If it judges the removal wrongful, it reinstates the review and fines the seller a penalty bbb.

This mission covers the semi-decentralized mechanism. Its main result, Proposition 5, gives the ransom a blackmailer can extract in equilibrium in closed form and says when blackmail pays at all. A platform needs that answer when it chooses the penalty. Mission I of this series treats the centralized mechanism.

Setting

A product has quality q∈{l,h}q\in\{l,h\}q∈{l,h}. The prior that q=hq=hq=h is a∈(0,1)a\in(0,1)a∈(0,1). A buyer of a high-quality product gets a positive experience with probability θ∈(0,1)\theta\in(0,1)θ∈(0,1); a low-quality product never gives one. With probability β∈(0,1)\beta\in(0,1)β∈(0,1) the consumer is malicious. A malicious consumer buys at price ppp, posts a negative review NNN and demands a ransom rrr. Otherwise the consumer is regular. A regular consumer buys with probability ρ=1−p/(aθ)\rho=1-p/(a\theta)ρ=1−p/(aθ) (valuation vjv_jvj​ uniform on [0,1][0,1][0,1]) and reviews truthfully: positive (PPP) or negative (NNN). No purchase means no review, written R=0R=0R=0; a removed review is also seen as R=0R=0R=0.

The market observes R∈{N,0,P}R\in\{N,0,P\}R∈{N,0,P} and forms the posterior a′a'a′ by Bayes' rule. The seller then earns π(a′)\pi(a')π(a′), where π\piπ is nonnegative, convex and strictly increasing on [0,1][0,1][0,1].

Facing a ransom demand, the seller can settle (sss: pay rrr, review removed), do nothing (nnn), or use the mechanism (ddd). Under ddd the platform judges immediately with probability γ∈[0,1]\gamma\in[0,1]γ∈[0,1] (timeliness). It recognises a malicious review with probability δ∈[0,1]\delta\in[0,1]δ∈[0,1] (accuracy). The review is therefore reinstated with probability γ(1−δ)\gamma(1-\delta)γ(1−δ), and the penalty b≥0b\ge0b≥0 is paid with probability 1−δ1-\delta1−δ. Write aRia^i_RaRi​ for the posterior after review RRR when the market believes the seller's response is iii. The payoffs of the three responses are then

π(a0i)−r,π(aNi),(1−γ(1−δ))π(a0i)+γ(1−δ)π(aNi)−(1−δ)b.\pi(a^i_0)-r,\qquad \pi(a^i_N),\qquad (1-\gamma(1-\delta))\pi(a^i_0)+\gamma(1-\delta)\pi(a^i_N)-(1-\delta)b.π(a0i​)−r,π(aNi​),(1−γ(1−δ))π(a0i​)+γ(1−δ)π(aNi​)−(1−δ)b.

The market cannot see the interaction, so iii is an equilibrium at rrr if no response pays more given the belief iii. The equilibrium ransom r∗r^*r∗ is the largest rrr at which settling is an equilibrium and no equilibrium pays the seller more. The malicious consumer buys iff p<r∗p<r^*p<r∗.

A seller could also use the mechanism against genuine negative reviews. Proposition 4 shows that this is deterred exactly when b≥b‾:=(1−γ)[π(a)−π(aNs)]b\ge\underline b:=(1-\gamma)[\pi(a)-\pi(a^s_N)]b≥b​:=(1−γ)[π(a)−π(aNs​)].

Formalization targets

Goal: Proposition 5 (p. 21)

Let δ<1\delta<1δ<1 and T=1−γ(1−δ)1−δ(π(a)−π(aNn))T=\frac{1-\gamma(1-\delta)}{1-\delta}\big(\pi(a)-\pi(a^n_N)\big)T=1−δ1−γ(1−δ)​(π(a)−π(aNn​)).

  1. If b≥T>b‾b\ge T>\underline bb≥T>b​:
r∗=π(a)−π(aNn),and the malicious consumer buys iff p<r∗.r^*=\pi(a)-\pi(a^n_N),\qquad\text{and the malicious consumer buys iff } p<r^*.r∗=π(a)−π(aNn​),and the malicious consumer buys iff p<r∗.
  1. If b‾≤b<T\underline b\le b<Tb​≤b<T:
r∗=(1−δ)(γ(π(a)−π(aNd))+b),and the malicious consumer buys iff p<r∗.r^*=(1-\delta)\big(\gamma(\pi(a)-\pi(a^d_N))+b\big),\qquad\text{and the malicious consumer buys iff } p<r^*.r∗=(1−δ)(γ(π(a)−π(aNd​))+b),and the malicious consumer buys iff p<r∗.

Milestones

  • (5), p. 21: the closed form of aNda^d_NaNd​, together with a0i=aa^i_0=aa0i​=a.
  • §5.1, p. 21: the ordering aNs<aNd<aNna^s_N<a^d_N<a^n_NaNs​<aNd​<aNn​.
  • Proposition 4, p. 20: genuine negative reviews are kept iff b≥b‾b\ge\underline bb≥b​.
  • Proof of Proposition 5, Step 1, pp. 41–42: the conditions under which sss, nnn and ddd are equilibria, one milestone each.

Significance

Proposition 5 has two regimes. If the penalty is high, the mechanism plays no part in blackmail: the seller would never use it, and the ransom equals the one with no mechanism at all. Below the threshold, the ransom is the seller's expected loss from using the mechanism. A lower ransom then means less blackmail, and it pushes the price at which blackmail stops paying downward. The threshold TTT rises with the accuracy δ\deltaδ and falls with the timeliness γ\gammaγ. The paper's later results on pricing and on the platform's penalty build on this characterization.

The result is proved in the paper (Appendix C, pp. 41–43). It has no machine-checked proof. Formalizing it pins down the equilibrium concept, including the selection among multiple equilibria. It also corrects a printed slip in the proof: the simplified condition for the mechanism to be an equilibrium drops a factor 1−δ1-\delta1−δ.

Difficulty

Each individual equilibrium condition is a rearrangement of payoff inequalities. The difficulty lies in selecting among equilibria. Several responses can be equilibria at the same ransom. Settling prevails only if no other equilibrium pays more, and the equilibria themselves depend on rrr. So the set of ransoms at which settling prevails is not given by one inequality. Its greatest element must be found across three scenarios, comparing three thresholds that involve three different posteriors. Those comparisons require the posterior ordering aNs<aNd<aNna^s_N<a^d_N<a^n_NaNs​<aNd​<aNn​, which comes from Bayes' rule and not from the payoff algebra. Reading the equilibrium condition for sss alone as the answer gives the wrong ransom in case 1.

Formalization scope

Everything lives in the namespace ReviewBlackmail.SemiDec, with one structure Model holding a,θ,β,p,γ,δ,ba,\theta,\beta,p,\gamma,\delta,ba,θ,β,p,γ,δ,b and the payoff fut (the paper's π\piπ; Real.pi is never used). The predicate Standing collects the standing assumptions: a,θ,β∈(0,1)a,\theta,\beta\in(0,1)a,θ,β∈(0,1); π\piπ nonnegative, convex and strictly increasing on [0,1][0,1][0,1]; γ,δ∈[0,1]\gamma,\delta\in[0,1]γ,δ∈[0,1]; b≥0b\ge0b≥0; and the disclosed addition 0<p<aθ0<p<a\theta0<p<aθ, which makes the purchase probability ρ\rhoρ lie in (0,1)(0,1)(0,1). Per-statement additions, each disclosed in the item:

  • δ<1\delta<1δ<1 on the goal and on Step 1 for nnn and ddd, which divide by 1−δ1-\delta1−δ;
  • 0<γ(1−δ)<10<\gamma(1-\delta)<10<γ(1−δ)<1 on the strict ordering;
  • 0<γ<10<\gamma<10<γ<1 on the second half of Proposition 4.

Posteriors are defined by Bayes' rule over an explicit likelihood table with two visibility probabilities: mmm for malicious and ggg for genuine negative reviews. Proposition 4 needs beliefs in which genuine reviews are removed. The payoffs of Proposition 5 keep genuine reviews (g=1g=1g=1), the case the paper reduces to via Proposition 4. Ties in the selection rule go to settling.

The posteriors aRia^i_RaRi​ are never defined by their closed forms, and r∗r^*r∗ is never defined by (6) or (7). The goal is stated with IsGreatest on the set of ransoms at which settling prevails, not with sSup, so neither the closed forms nor junk values of a supremum can make the goal trivial.

A complete development needs only Mathlib's ConvexOn, StrictMonoOn and IsGreatest and real-field algebra. The algebra of Bayes posteriors with two-point priors may be reusable. Proofs of the milestones and the goal are welcome, in any order.

Selected references

  • Y. Papanastasiou, S. A. Yang, A. H. Zhang, Improving Dispute Resolution in Two-Sided Platforms: The Case of Review Blackmail, Management Science 69(10):6021–6037, 2023. https://doi.org/10.1287/mnsc.2022.4655 (cited from the accepted manuscript, LBS Research Online eprint 1988, https://lbsresearch.london.edu/id/eprint/1988/).
8 thms2 active usersReviewed
🏆Completed
EconomicsOptimization·Captain: mikedeng1

Accelerability vs. Scalability: R&D Investment Under Financial Constraints and Competition III: Without Accelerability a Financially Constrained Monopoly Invests Less Than an Unconstrained OneResearch Paper

Motivation

Young innovative firms often fund research out of internal cash flow rather than external capital. Whether such financial constraints make firms invest less in research and development (R&D) is a long-standing question in corporate finance and the economics of innovation. Myers (1977) showed that the possibility of default leads to under-investment in growth options. Danmo Lin (Management Science, 2022) separates two ways in which spending more on a project can pay off: it can make the payoff larger (scalability) or make the discovery arrive sooner (accelerability). The paper's Corollary 1 says that the classical under-investment result holds exactly when the project is scalable but not accelerable, while acceleration can reverse it. This mission formalizes the under-investment half of that corollary.

Setting

A firm faces a one-time R&D opportunity. It chooses an investment intensity RRR, a spending rate per unit of time, and pays it until discovery. Discovery is the first arrival of a Poisson process of rate λ(R)\lambda(R)λ(R), and on discovery the firm receives a payoff with mean u(R)u(R)u(R). As in the paper's equation (2),

u(R)=A Rβ,λ(R)=η Rγ,A>0, η>0, β,γ∈[0,1), β+γ<1,u(R)=A\,R^{\beta},\qquad \lambda(R)=\eta\,R^{\gamma},\qquad A>0,\ \eta>0,\ \beta,\gamma\in[0,1),\ \beta+\gamma<1,u(R)=ARβ,λ(R)=ηRγ,A>0, η>0, β,γ∈[0,1), β+γ<1,

and intensities are at least R‾=1\underline R=1R​=1. The project is scalable if u′>0u'>0u′>0 (here β>0\beta>0β>0) and accelerable if λ′>0\lambda'>0λ′>0 (here γ>0\gamma>0γ>0). Future cash is discounted at rate r>0r>0r>0.

An unconstrained (UC) firm can always pay RRR. By the paper's Lemma 1, equation (5), its project value at intensity RRR is the perpetuity

Vuc(R)=u(R)λ(R)−Rλ(R)+r.V_{uc}(R)=\frac{u(R)\lambda(R)-R}{\lambda(R)+r}.Vuc​(R)=λ(R)+ru(R)λ(R)−R​.

A financially constrained (FC) firm pays RRR out of an asset-in-place (AIP) cash flow XtX_tXt​, a geometric Brownian motion with drift μ\muμ and volatility σ\sigmaσ that starts at XXX. It must abandon the project once Xt<RX_t<RXt​<R. Lemma 1, equation (6), gives its project value as

Vfc(R)=u(R)λ(R)−Rλ(R)+r(1−(XR)α),α=12−μσ2−(12−μσ2)2+2(λ(R)+r)σ2.V_{fc}(R)=\frac{u(R)\lambda(R)-R}{\lambda(R)+r}\Big(1-\big(\tfrac{X}{R}\big)^{\alpha}\Big),\qquad \alpha=\tfrac12-\tfrac{\mu}{\sigma^2}-\sqrt{\big(\tfrac12-\tfrac{\mu}{\sigma^2}\big)^2+\tfrac{2(\lambda(R)+r)}{\sigma^2}}.Vfc​(R)=λ(R)+ru(R)λ(R)−R​(1−(RX​)α),α=21​−σ2μ​−(21​−σ2μ​)2+σ22(λ(R)+r)​​.

The ranges of intensities are those of (7): [1,Rˉ][1,\bar R][1,Rˉ] for the UC firm and [1,min⁡{Rˉ,X}][1,\min\{\bar R,X\}][1,min{Rˉ,X}] for the FC firm, with Rˉ=(Aη)1/(1−(β+γ))\bar R=(A\eta)^{1/(1-(\beta+\gamma))}Rˉ=(Aη)1/(1−(β+γ)). The optimal intensities Ruc∗R^*_{uc}Ruc∗​ and Rfc∗R^*_{fc}Rfc∗​ are the sets of maximizers of VucV_{uc}Vuc​ and VfcV_{fc}Vfc​ over these ranges.

Formalization targets

Goal: Corollary 1, first statement (p. 6)

If λ′=0\lambda'=0λ′=0 and u′>0u'>0u′>0, then Rfc∗<Ruc∗R^*_{fc}<R^*_{uc}Rfc∗​<Ruc∗​. Formally: under the standing assumptions, r>0r>0r>0, σ>0\sigma>0σ>0, X≥1X\ge1X≥1, γ=0\gamma=0γ=0, β>0\beta>0β>0 and Aβη>1A\beta\eta>1Aβη>1, both optimal sets are nonempty and

x<yfor every x∈Rfc∗ and every y∈Ruc∗.x<y\qquad\text{for every } x\in R^*_{fc}\text{ and every } y\in R^*_{uc}.x<yfor every x∈Rfc∗​ and every y∈Ruc∗​.

Milestones (Appendix A.4, p. 20)

  1. Without accelerability, every interior FC optimum (1<R<min⁡{Rˉ,X}1<R<\min\{\bar R,X\}1<R<min{Rˉ,X}) satisfies u′(R)λ−1>0u'(R)\lambda-1>0u′(R)λ−1>0. This is the paper's consequence of the first-order condition (A.25).
  2. Without accelerability and with Aβη>1A\beta\eta>1Aβη>1, every UC optimum satisfies u′(R)λ−1=0u'(R)\lambda-1=0u′(R)λ−1=0 (in particular it is interior).

Significance

The statement pins down when the textbook under-investment effect of financing frictions holds: exactly when extra spending scales the prize but cannot speed it up. The paper contrasts it with the possibility of over-investment on accelerable projects (Corollary 1's second statement, supported by numerical exercises). Taken together, the two statements show that the R&D technology, not only the severity of the constraint, decides the direction of the distortion.

The result is proved in the paper (Appendix A.4); it has no machine-checked proof. A formal proof certifies the comparison for every pair of optima, without the paper's tacit assumption that optima are unique. It also makes explicit the interior-optimum condition Aβη>1A\beta\eta>1Aβη>1 under which the inequality is strict. The resulting facts about maximizers of products of a concave power-law profit and a decreasing survival factor are reusable for other real-options models with a survival discount.

Difficulty

The first idea is to compare the two first-order conditions. The UC optimum solves u′λ=1u'\lambda=1u′λ=1, and at an interior FC optimum the derivative of the survival factor pushes u′λ−1u'\lambda-1u′λ−1 to be positive. Concavity of f(R)=u(R)λ−Rf(R)=u(R)\lambda-Rf(R)=u(R)λ−R then orders the two. Turning this into a theorem about sets of maximizers needs more. The FC optimum can sit at a corner, either R=1R=1R=1 or the right end min⁡{Rˉ,X}\min\{\bar R,X\}min{Rˉ,X}, where no first-order condition holds, and the corners must be ruled out or handled separately. The survival factor 1−(X/R)α1-(X/R)^\alpha1−(X/R)α vanishes at R=XR=XR=X. The UC value vanishes at Rˉ\bar RRˉ. When X≤Ruc∗X\le R^*_{uc}X≤Ruc∗​, the comparison is settled by the range rather than by the first-order condition. The strict inequality is false without an interior UC optimum: if Aβη≤1A\beta\eta\le1Aβη≤1, both optimal sets equal {1}\{1\}{1}.

Formalization scope

All objects are in the namespace AccelScal.FCMonopoly, in one definition file. It holds the parameter structure Tech (A,β,η,γ)(A,\beta,\eta,\gamma)(A,β,η,γ), the predicate Standing, uuu, λ\lambdaλ, Rˉ\bar RRˉ, α\alphaα, VucV_{uc}Vuc​ (5), VfcV_{fc}Vfc​ (6), and the maximizer sets RstarUC, RstarFC over the ranges (7). Powers are Real.rpow, and u′u'u′ is Mathlib's deriv.

Committed conventions:

  • The reduced problems are the definitions. The FC firm's original problem (3) is an expectation over a geometric Brownian motion and its first-passage time below RRR. That its value is (6) is the paper's Lemma 1 (Appendix A.12), which needs first-passage machinery absent from Mathlib, and it is not posed. The mission takes (6), and for symmetry (5), as the definitions of the two firms' problems, exactly as the paper's proof of Corollary 1 does. VfcV_{fc}Vfc​ is "the value of problem (3)" only through Lemma 1.
  • The random payoff is replaced by its mean u(R)u(R)u(R), and the AIP term of (3)/(4), which does not depend on RRR, is dropped.
  • Standing assumptions: (2), plus the added condition Aη>1A\eta>1Aη>1 (investment takes place, so Vuc(1)>0V_{uc}(1)>0Vuc​(1)>0). The goal adds Aβη>1A\beta\eta>1Aβη>1, which is necessary for the strict inequality (the UC optimum is interior), and X≥1X\ge1X≥1, which keeps the FC range nonempty. "λ′=0\lambda'=0λ′=0, u′>0u'>0u′>0" is encoded as γ=0\gamma=0γ=0, β>0\beta>0β>0, which is equivalent under (2). No sign condition on μ\muμ is imposed, and σ>0\sigma>0σ>0.
  • The paper's single-valued R∗R^*R∗ is read as a set of maximizers. The inequality is claimed for every pair of optima.

Trivializing formalizations are ruled out. Ruc∗R^*_{uc}Ruc∗​ is never defined by its closed form, and neither optimum is a selected value. The goal asserts that both optimal sets are nonempty. The FC range depends on XXX through min⁡{Rˉ,X}\min\{\bar R,X\}min{Rˉ,X}. The conclusion is the strict "<<<", not "≤\le≤".

The paper's second and third statements of Corollary 1 (over-investment when λ′>0\lambda'>0λ′>0, and when it is "more likely") are numerical or informal and are not posed. Contributions are welcome on both milestones and on the goal. Also welcome: general lemmas on the maximizers of a positive concave function times a decreasing positive factor, and a future formalization of Lemma 1 (6) from a geometric Brownian first-passage Laplace transform.

Selected references

  • D. Lin, Accelerability vs. Scalability: R&D Investment Under Financial Constraints and Competition, Management Science, Articles in Advance, 2022. https://doi.org/10.1287/mnsc.2022.4503
  • S. C. Myers, Determinants of Corporate Borrowing, Journal of Financial Economics 5(2), 147–175, 1977. https://doi.org/10.1016/0304-405X(77)90015-0
4 thms2 active usersReviewed
PreviousPage 29 of 90Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me