Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Probability

1,628 missions · 689 completed

Missions

Open939Completed689All1628
Machine LearningReinforcement LearningStatistics·Captain: mikedeng1

Optimistic Posterior Sampling for Reinforcement Learning: Worst-Case Regret Bounds II: Along Any h, the Empirical Transition Vector Is within 2√(log(n/ρ)Σγᵢcᵢ²/n) + 3D log(2/ρ)/n of the TruthResearch Paper

Motivation

Model-based reinforcement learning algorithms for Markov decision processes estimate each transition distribution Ps,aP_{s,a}Ps,a​ from the transitions they have observed out of the state–action pair (s,a)(s,a)(s,a). Their regret analyses then need to know how far the empirical distribution p^\hat pp^​ can be from the true one ppp. The standard tool is an ℓ1\ell_1ℓ1​ bound on p^−p\hat p-pp^​−p, as in UCRL2 (Jaksch, Ortner and Auer, 2010), which costs a factor of order S\sqrt SS​ in the number of states SSS. What the analysis actually uses, however, is the deviation along one direction: the projection (p^−p)Th(\hat p-p)^Th(p^​−p)Th onto a bias (or value) vector hhh whose entries differ by at most the MDP's diameter DDD.

S. Agrawal and R. Jia (arXiv:1705.07041v3, published in Mathematics of Operations Research, 2023, as Optimistic Posterior Sampling for Reinforcement Learning: Worst-Case Regret Bounds) prove a worst-case regret bound of order O~(DSAT)\tilde O(D\sqrt{SAT})O~(DSAT​) for an optimistic variant of posterior sampling. One ingredient of that analysis is their Proposition 5.2: a Bernstein-type bound on (p^−p)Th(\hat p-p)^Th(p^​−p)Th whose leading term is governed by a variance of hhh under ppp, written in stick-breaking form. This mission formalizes that proposition and the steps of its proof.

Setting

Fix a number of states SSS and order them 1,…,S1,\dots,S1,…,S. A probability vector p∈ΔSp\in\Delta^Sp∈ΔS has pi≥0p_i\ge0pi​≥0 and ∑ipi=1\sum_ip_i=1∑i​pi​=1. A multinoulli trial with parameter ppp is a random state XXX with P(X=i)=pi\mathbb P(X=i)=p_iP(X=i)=pi​. Draw nnn independent trials X1,…,XnX_1,\dots,X_nX1​,…,Xn​ and let

p^i=#{t:Xt=i}n\hat p_i=\frac{\#\{t: X_t=i\}}{n}p^​i​=n#{t:Xt​=i}​

be the empirical probability vector, the average of the one-hot outcomes. For ppp and a vector h∈RSh\in\mathbb R^Sh∈RS define the stick-breaking quantities

γi=pi(pi+1+⋯+pS)pi+⋯+pS,Hi+1=1∑j=i+1Spj∑j=i+1Shjpj,ci=hi−Hi+1.\gamma_i=\frac{p_i(p_{i+1}+\cdots+p_S)}{p_i+\cdots+p_S},\qquad H_{i+1}=\frac{1}{\sum_{j=i+1}^Sp_j}\sum_{j=i+1}^Sh_jp_j,\qquad c_i=h_i-H_{i+1}.γi​=pi​+⋯+pS​pi​(pi+1​+⋯+pS​)​,Hi+1​=∑j=i+1S​pj​1​j=i+1∑S​hj​pj​,ci​=hi​−Hi+1​.

Thus Hi+1H_{i+1}Hi+1​ is the mean of hhh under ppp conditioned on the states after iii, and cic_ici​ compares hih_ihi​ with it. The sum ∑i<Sγici2\sum_{i<S}\gamma_ic_i^2∑i<S​γi​ci2​ equals the variance of h(X)h(X)h(X) for X∼pX\sim pX∼p. In Lean these objects are gammaCoef p i, Hnext p h i, cCoef p h i, phat ω i, the law of one trial is cat p and the law of nnn trials is trialsLaw n p, all in the namespace OptimisticPSRL.Concentration.

Formalization targets

Goal: Proposition 5.2 (p. 9)

Let h∈RSh\in\mathbb R^Sh∈RS satisfy ∣hi−hi′∣≤D|h_i-h_{i'}|\le D∣hi​−hi′​∣≤D for all i,i′i,i'i,i′, let n≥96n\ge96n≥96 and ρ∈(0,1)\rho\in(0,1)ρ∈(0,1). Then, with probability at least 1−ρ1-\rho1−ρ,

∣(p^−p)Th∣≤2log⁡(n/ρ)∑i<Sγici2n+3D log⁡(2/ρ)n.\big|(\hat p-p)^Th\big|\le2\sqrt{\log(n/\rho)\sum_{i<S}\frac{\gamma_ic_i^2}{n}}+3D\,\frac{\log(2/\rho)}{n}.​(p^​−p)Th​≤2log(n/ρ)i<S∑​nγi​ci2​​​+3Dnlog(2/ρ)​.

Milestones

  1. Fact 1 (p. 17), a deterministic identity: for probability vectors p~,pˉ\tilde p,\bar pp~​,pˉ​ with stick-breaking ratios y~i=p~i/(p~i+⋯+p~S)\tilde y_i=\tilde p_i/(\tilde p_i+\cdots+\tilde p_S)y~​i​=p~​i​/(p~​i​+⋯+p~​S​) and yˉi\bar y_iyˉ​i​,
(p~−pˉ)Th=∑i(y~i−yˉi)(hi−H~i+1)(pˉi+⋯+pˉS)=∑i(y~i−yˉi)(hi−Hˉi+1)(p~i+⋯+p~S).(\tilde p-\bar p)^Th=\sum_i(\tilde y_i-\bar y_i)(h_i-\tilde H_{i+1})(\bar p_i+\cdots+\bar p_S)=\sum_i(\tilde y_i-\bar y_i)(h_i-\bar H_{i+1})(\tilde p_i+\cdots+\tilde p_S).(p~​−pˉ​)Th=i∑​(y~​i​−yˉ​i​)(hi​−H~i+1​)(pˉ​i​+⋯+pˉ​S​)=i∑​(y~​i​−yˉ​i​)(hi​−Hˉi+1​)(p~​i​+⋯+p~​S​).
  1. The projection as a sum of martingale differences (proof, p. 21): with Zt,i=ci1(Xt=i)−cipipi+⋯+pS1(Xt≥i)Z_{t,i}=c_i\mathbb 1(X_t=i)-c_i\frac{p_i}{p_i+\cdots+p_S}\mathbb 1(X_t\ge i)Zt,i​=ci​1(Xt​=i)−ci​pi​+⋯+pS​pi​​1(Xt​≥i) and Zt=∑iZt,iZ_t=\sum_iZ_{t,i}Zt​=∑i​Zt,i​,
1n∑t=1nZt=(p^−p)Th,\frac1n\sum_{t=1}^nZ_t=(\hat p-p)^Th,n1​t=1∑n​Zt​=(p^​−p)Th,

together with the two intermediate expressions of the page. 3. Uncorrelated coordinates (proof, p. 21): E[Zt,iZt,j]=0\mathbb E[Z_{t,i}Z_{t,j}]=0E[Zt,i​Zt,j​]=0 for i≠ji\ne ji=j. 4. The predictable variance (proof, p. 21): ∑t=1nE[Zt2]=∑ici2 n γi\sum_{t=1}^n\mathbb E[Z_t^2]=\sum_ic_i^2\,n\,\gamma_i∑t=1n​E[Zt2​]=∑i​ci2​nγi​. 5. Corollary B.1 (p. 26), Bernstein's inequality for bounded martingale differences with random predictable variance VnV_nVn​: for n≥96n\ge96n≥96, δ∈(0,1)\delta\in(0,1)δ∈(0,1), with probability greater than 1−δ1-\delta1−δ,

∣Mn∣≤2Vnln⁡(n/δ)+3Kln⁡(n/δ).|M_n|\le2\sqrt{V_n\ln(n/\delta)}+3K\ln(n/\delta).∣Mn​∣≤2Vn​ln(n/δ)​+3Kln(n/δ).

Significance

The result. Proposition 5.2 is the concentration half of the optimism step of the paper (Lemma 5.3): combined with an anti-concentration bound for Dirichlet samples along the same direction (Proposition 5.1), it shows that some posterior sample is optimistic along hhh with constant probability. Because the bound is stated along a single direction and is weighted by the variance of hhh rather than by DDD alone, it avoids the S\sqrt SS​ loss that an ℓ1\ell_1ℓ1​ bound would incur, which is part of how the paper's regret bound improves on UCRL2's O~(DSAT)\tilde O(DS\sqrt{AT})O~(DSAT​). The stick-breaking form of the variance is what lets the same quantity appear on both sides of the optimism argument, in the Dirichlet bound and in the empirical bound.

Formalizing it. The proposition and its proof steps are proved on paper; none of them has a machine-checked proof. The regret theorem of the paper (Theorem 1) is not posed: its constants are hidden in O(⋅)O(\cdot)O(⋅) and its algorithm's parameters are given as Θ(⋅)\Theta(\cdot)Θ(⋅). Proposition 5.2, by contrast, is fully explicit. Corollary B.1 is a reusable martingale inequality with explicit constants. The predictable-variance identity and Fact 1 are exact identities about stick-breaking coordinates that recur in analyses of Dirichlet and categorical models.

Difficulty

Two steps resist the obvious approach. First, the statement carries the variance in stick-breaking form, not as Varp(h)\mathrm{Var}_p(h)Varp​(h); linking the two needs the decomposition of Fact 1 and the identity for the predictable variance, which are exact algebraic identities whose bookkeeping of tails and empty tails is error-prone. Second, the paper's own route goes through Corollary B.1, a martingale Bernstein inequality with a random variance, which rests on a peeling argument over a grid of variance levels (Seldin et al., 2012); Mathlib has neither this inequality nor a Bernstein inequality with explicit constants for bounded variables.

A known subtlety: the paper's proof, through Corollary B.1, yields the second term 3Dlog⁡(n/ρ)/n3D\log(n/\rho)/n3Dlog(n/ρ)/n, while the statement prints the smaller 3Dlog⁡(2/ρ)/n3D\log(2/\rho)/n3Dlog(2/ρ)/n. The printed statement is still true for nnn iid trials (the classical Bernstein inequality gives a bound below it), so the goal is posed as printed. The paper's own proof therefore does not establish the printed constant.

Formalization scope

  • States are Fin S with its natural order, 0-based; the paper's range i<Si<Si<S is every state but the last (belowLast S). Fact 1 holds for every ordering; the natural order covers this since states are labels.
  • Probability vectors are p : Fin S → ℝ with IsProbVec p (nonnegative, summing to one). Zero entries are allowed. A ratio whose denominator is zero evaluates to 000 (Lean's convention), which gives the values the identities need; no positivity of ppp is assumed.
  • One trial has law cat p =∑ipiδi=\sum_ip_i\delta_i=∑i​pi​δi​; nnn trials have the product law trialsLaw n p === Measure.pi. The empirical vector phat ω is computed from the sample ω : Fin n → Fin S. "With probability 1−ρ1-\rho1−ρ" is ENNReal.ofReal (1 - ρ) ≤ trialsLaw n p {good event}; Corollary B.1's "greater than 1−δ1-\delta1−δ" is strict. log⁡\loglog is Real.log.
  • The proof displays (milestones 2–4) are stated in the iid reading of the proposition: the paper writes them for transitions of an MDP out of a fixed (s,a)(s,a)(s,a), with an indicator 1(st−1=s,at−1=a)\mathbb 1(s_{t-1}=s,a_{t-1}=a)1(st−1​=s,at−1​=a) and a random count τ\tauτ; here the indicator is one and τ=n\tau=nτ=n, and the conditional expectations are expectations under one draw of law ppp. Milestone 2 assumes every drawn state has positive probability (true almost surely), which the page's intermediate sum over i≤S−1i\le S-1i≤S−1 needs.
  • Corollary B.1 is posed for a general filtered probability space, with ZiZ_iZi​ Fi\mathcal F_iFi​-measurable, ∣Zi∣≤K|Z_i|\le K∣Zi​∣≤K almost surely and E[Zi∣Fi−1]=0\mathbb E[Z_i\mid\mathcal F_{i-1}]=0E[Zi​∣Fi−1​]=0.

The goal cannot be satisfied by a degenerate reading: p^\hat pp^​ is built from the sample, the measure is the nnn-fold product of the categorical law ppp, the event is the good event itself (not a complement bound), and the variance term is not identically zero (for S=2S=2S=2, p=(12,12)p=(\tfrac12,\tfrac12)p=(21​,21​) it equals (h1−h2)2/4(h_1-h_2)^2/4(h1​−h2​)2/4).

Needed infrastructure: finite-sum manipulations over tails of Fin S; a Bernstein or Freedman inequality with explicit constants (for iid bounded variables for the goal, for martingale differences for Corollary B.1). Contributions of either inequality are reusable well beyond this mission and are welcome, as are alternative proofs of the goal that bypass Corollary B.1.

Selected references

  • S. Agrawal and R. Jia, Posterior sampling for reinforcement learning: worst-case regret bounds, arXiv:1705.07041v3, 2020; published as Optimistic Posterior Sampling for Reinforcement Learning: Worst-Case Regret Bounds, Mathematics of Operations Research, 2023. https://arxiv.org/abs/1705.07041
  • T. Jaksch, R. Ortner and P. Auer, Near-optimal regret bounds for reinforcement learning, Journal of Machine Learning Research 11, 2010. https://www.jmlr.org/papers/v11/jaksch10a.html
  • Y. Seldin, F. Laviolette, N. Cesa-Bianchi, J. Shawe-Taylor and P. Auer, PAC-Bayesian inequalities for martingales, IEEE Transactions on Information Theory 58(12), 2012. https://doi.org/10.1109/TIT.2012.2211334
7 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

A Faster Cutting Plane Method and its Implications for Combinatorial and Convex Optimization I: The Largest-Coordinate Strategy Keeps the Stochastic Chasing 0 Game within 2(c+R)log(4mk²/p)Research Paper

Motivation

Cutting plane methods minimize a convex function, or find a point in a convex set, using only a separation oracle: a routine that, given a query point, either certifies it is good or returns a halfspace containing the target. Lee, Sidford and Wong (arXiv:1508.04874, FOCS 2015) gave a cutting plane method for a convex set in Rn\mathbb R^nRn inside a box of radius RRR that uses an expected O(nlog⁡(nR/ϵ))O(n\log(nR/\epsilon))O(nlog(nR/ϵ)) oracle calls and O(n3log⁡O(1)(nR/ϵ))O(n^3\log^{O(1)}(nR/\epsilon))O(n3logO(1)(nR/ϵ)) additional time, improving on the O(nω+1log⁡(nR/ϵ))O(n^{\omega+1}\log(nR/\epsilon))O(nω+1log(nR/ϵ)) additional time of Vaidya's method from over 25 years earlier, and derived from it faster algorithms for submodular function minimization, matroid intersection and submodular flow.

The speed-up depends on not recomputing the leverage scores of the current constraint matrix from scratch at every step. The algorithm maintains approximations and refreshes a few of them per step. Section 7.2 of the paper isolates the bookkeeping question this raises as a two-player game, the stochastic chasing 0⃗\vec 00 game, and shows that a simple greedy strategy keeps the accumulated error small. The game is self-contained and has nothing to do with convexity: it is a statement about a random walk in Rm\mathbb R^mRm that is partially reset at every step.

Setting

Fix a dimension m≥1m\ge1m≥1 and constants c>0c>0c>0, R>0R>0R>0. For v⃗∈Rm\vec v\in\mathbb R^mv∈Rm, ∥v⃗∥∞=max⁡i∣vi∣\|\vec v\|_\infty=\max_i|v_i|∥v∥∞​=maxi​∣vi​∣ and ∥v⃗∥2=(∑ivi2)1/2\|\vec v\|_2=(\sum_iv_i^2)^{1/2}∥v∥2​=(∑i​vi2​)1/2.

A point starts at x⃗(1)=0⃗\vec x^{(1)}=\vec 0x(1)=0. Each round k=1,2,…k=1,2,\dotsk=1,2,… runs as follows (Algorithm 4).

  1. A stochastic adversary chooses a probability distribution D(k)\mathcal D^{(k)}D(k) on Rm\mathbb R^mRm with mean 0⃗\vec 00 and ∥Δ⃗∥2≤c\|\vec\Delta\|_2\le c∥Δ∥2​≤c for every Δ⃗\vec\DeltaΔ in its support.
  2. The adversary chooses an observation y⃗(k)\vec y^{(k)}y​(k) with ∥y⃗(k)−x⃗(k)∥∞≤R\|\vec y^{(k)}-\vec x^{(k)}\|_\infty\le R∥y​(k)−x(k)∥∞​≤R.
  3. The player chooses a coordinate i(k)i^{(k)}i(k), knowing only y⃗(k)\vec y^{(k)}y​(k): neither x⃗(k)\vec x^{(k)}x(k), nor D(k)\mathcal D^{(k)}D(k), nor the step.
  4. A step Δ⃗(k)\vec\Delta^{(k)}Δ(k) is drawn from D(k)\mathcal D^{(k)}D(k) and the point moves to
xi(k)(k+1)=0,xj(k+1)=xj(k)+Δj(k)(j≠i(k)).x^{(k+1)}_{i^{(k)}}=0,\qquad x^{(k+1)}_j=x^{(k)}_j+\Delta^{(k)}_j\quad(j\ne i^{(k)}).xi(k)(k+1)​=0,xj(k+1)​=xj(k)​+Δj(k)​(j=i(k)).

The adversary may use everything that has happened so far to make its choices. The player wants to keep x⃗(k)\vec x^{(k)}x(k) near 0⃗\vec 00 in ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​; the adversary wants to push it away. The largest-coordinate strategy is i(k)=argmax⁡i∣yi(k)∣i^{(k)}=\operatorname{argmax}_i|y^{(k)}_i|i(k)=argmaxi​∣yi(k)​∣: reset the coordinate that looks largest.

Formalization targets

Goal: Theorem 34

If the player uses the largest-coordinate strategy, then for every p∈(0,1]p\in(0,1]p∈(0,1], with probability at least 1−p1-p1−p,

∥x⃗(k)∥∞≤2(c+R)log⁡(4mk2/p)for all k≥1.\|\vec x^{(k)}\|_\infty\le2(c+R)\log\big(4mk^2/p\big)\qquad\text{for all }k\ge1.∥x(k)∥∞​≤2(c+R)log(4mk2/p)for all k≥1.

The bound holds simultaneously for all rounds, against every adaptive adversary, and grows only logarithmically in kkk, in mmm and in 1/p1/p1/p.

Milestones

The milestones are the steps that the paper's proof of Theorem 34 (pp. 43–44) displays:

  1. the exponential inequality ex≤1+x+x22e∣x∣e^x\le1+x+\tfrac{x^2}{2}e^{|x|}ex≤1+x+2x2​e∣x∣ and its consequence eαx+αδ≤eαx+αδeαx+12α2δ2eαx+∣α∣ce^{\alpha x+\alpha\delta}\le e^{\alpha x}+\alpha\delta e^{\alpha x}+\tfrac12\alpha^2\delta^2e^{\alpha x+|\alpha|c}eαx+αδ≤eαx+αδeαx+21​α2δ2eαx+∣α∣c for ∣δ∣≤c|\delta|\le c∣δ∣≤c;
  2. the one-step drift bound for the potential Φ(x⃗)=∑ieαxi+∑ie−αxi\Phi(\vec x)=\sum_ie^{\alpha x_i}+\sum_ie^{-\alpha x_i}Φ(x)=∑i​eαxi​+∑i​e−αxi​:
EΔ⃗∼D Φ(x⃗+Δ⃗)≤Φ(x⃗)+α2eαcc2η,η=max⁡(max⁡ieαxi,max⁡ie−αxi);\mathbb E_{\vec\Delta\sim\mathcal D}\,\Phi(\vec x+\vec\Delta)\le\Phi(\vec x)+\alpha^2e^{\alpha c}c^2\eta,\qquad\eta=\max\big(\max_ie^{\alpha x_i},\max_ie^{-\alpha x_i}\big);EΔ∼D​Φ(x+Δ)≤Φ(x)+α2eαcc2η,η=max(imax​eαxi​,imax​e−αxi​);
  1. the choice α=1/(2(c+R))\alpha=1/(2(c+R))α=1/(2(c+R)), for which e2α(c+R)(α(c+R))2≤1e^{2\alpha(c+R)}(\alpha(c+R))^2\le1e2α(c+R)(α(c+R))2≤1 and α2eαcc2≤e−α(R+c)\alpha^2e^{\alpha c}c^2\le e^{-\alpha(R+c)}α2eαcc2≤e−α(R+c);
  2. the union-bound arithmetic 1−∑k≥12m/λk=1−∑k≥1p/(2k2)≥1−p1-\sum_{k\ge1}2m/\lambda_k=1-\sum_{k\ge1}p/(2k^2)\ge1-p1−∑k≥1​2m/λk​=1−∑k≥1​p/(2k2)≥1−p for λk=4mk2/p\lambda_k=4mk^2/pλk​=4mk2/p.

Significance

Within the paper, Theorem 34 is what lets the cutting plane method keep its leverage-score estimates within a bounded multiplicative error while refreshing only one estimate per step; this is one of the ingredients behind the O(n3log⁡O(1)(nR/ϵ))O(n^3\log^{O(1)}(nR/\epsilon))O(n3logO(1)(nR/ϵ)) additional time. The game reappears whenever an algorithm tracks many slowly drifting quantities with noisy observations and can afford to recompute only a few of them exactly per step, which makes the statement useful beyond this paper.

None of the statements in this mission has a machine-checked proof. The theorem is published with a proof. The mission asks for a formal proof of the statement exactly as published, with the constant 444 inside the logarithm. A formal proof of the milestones alone would already give a reusable exponential-potential toolkit for adaptive random processes in Rm\mathbb R^mRm.

Difficulty

The point process is not a martingale: the player's resets depend on a noisy observation, the adversary is adaptive, and the reset can hit a coordinate that is up to 2R2R2R smaller in absolute value than the largest one. Per-coordinate tail bounds do not suffice, because the adversary may concentrate its moves on whichever coordinates the player is not resetting. A bound that holds for all kkk at once, with only logarithmic dependence on kkk, has to control all coordinates jointly. Establishing such joint control, with the specific constant 444 inside the logarithm, against the most adversarial interaction between the observation error RRR and the step size ccc, is where the work lies.

Formalization scope

  • Probability model. The randomness is a probability space (Ω,μ)(\Omega,\mu)(Ω,μ) with a filtration (Fk)k≥0(\mathcal F_k)_{k\ge0}(Fk​)k≥0​. The adversary's adaptive choice of D(k)\mathcal D^{(k)}D(k) is modelled by the conditional law of the step: each coordinate of the step has conditional mean 000 given the past, the step is measurable with respect to the next σ\sigmaσ-algebra, and ∑iΔi2≤c2\sum_i\Delta_i^2\le c^2∑i​Δi2​≤c2 holds everywhere. The observation y⃗(k)\vec y^{(k)}y​(k) is measurable with respect to the current σ\sigmaσ-algebra, so it is fixed before the step is drawn, and ∥y⃗(k)−x⃗(k)∥∞≤R\|\vec y^{(k)}-\vec x^{(k)}\|_\infty\le R∥y​(k)−x(k)∥∞​≤R holds on the actual trajectory.
  • Indexing. Coordinates are Fin m (0-based), with m≥1m\ge1m≥1. Lean round k∈Nk\in\mathbb Nk∈N is the paper's round k+1k+1k+1, so the goal's bound reads log⁡(4m(k+1)2/p)\log(4m(k+1)^2/p)log(4m(k+1)2/p); at Lean round 000 the point is 0⃗\vec 00.
  • Norms. ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ is Lean's sup norm on Fin m → ℝ. The step bound ∥Δ⃗∥2≤c\|\vec\Delta\|_2\le c∥Δ∥2​≤c is written as ∑iΔi2≤c2\sum_i\Delta_i^2\le c^2∑i​Δi2​≤c2, never as a sup-norm bound. The paper's prose once writes ∥Δ⃗∥22≤c\|\vec\Delta\|_2^2\le c∥Δ∥22​≤c; Algorithm 4 and the proof use ∥Δ⃗∥2≤c\|\vec\Delta\|_2\le c∥Δ∥2​≤c, which is what is formalized.
  • Tie rule. argmax⁡i∣yi∣\operatorname{argmax}_i|y_i|argmaxi​∣yi​∣ breaks ties by the least index; the paper's theorem is claimed for any tie rule.
  • Constants. c>0c>0c>0, R>0R>0R>0 (Algorithm 4), 0<p≤10<p\le10<p≤1, natural logarithm. The drift milestone adds α≥0\alpha\ge0α≥0.
  • Not trivial by construction. The hypotheses are satisfiable by genuinely random adversaries (a fair-coin step of size ccc is one), and the conclusion is a probability lower bound on an event, not a statement that holds vacuously; a formalization in which the observation could depend on the step, or in which the step bound were a sup-norm bound, would not be the paper's theorem.
  • Out of scope. Running time, the leverage-score application (Section 7.1, Theorem 31) and the rest of the cutting plane method.
  • Infrastructure. Conditional expectation with respect to a filtration, Markov's inequality and countable union bounds are in Mathlib. Supermartingale lemmas for nonnegative adapted processes, and the passage from a per-step drift inequality to a bound on the expected potential, are reusable well beyond this mission. Proofs of individual milestones are welcome independently of the goal.

Selected references

  • Y. T. Lee, A. Sidford, S. C. Wong, A Faster Cutting Plane Method and its Implications for Combinatorial and Convex Optimization, FOCS 2015; arXiv:1508.04874v2, 2015. https://arxiv.org/abs/1508.04874
  • P. M. Vaidya, A new algorithm for minimizing convex functions over convex sets, FOCS 1989; Mathematical Programming 73 (1996) 291–341. https://doi.org/10.1007/BF02592216
6 thms1 active userReviewed
Operations Research·Captain: mikedeng1

Stall Economy: The Value of Mobility in Retail on Wheels II: Closed-Form Mean and Variance of the Within-Radius Repositioning Trip Length, Increasing in R and Decreasing in rResearch Paper

Motivation

Mobile retail stalls (self-driving or driver-operated vending vehicles that move to customers who order through a phone app) are studied by Cao and Qi in Stall Economy: The Value of Mobility in Retail on Wheels (Operations Research, 2022; the mission cites the authors' SSRN manuscript 3711896). A retailer partitions a city into service zones, one stall per zone, and must decide how densely to deploy stalls. That decision is made by continuous approximation: each zone is modelled as a small queueing system whose service time includes the stall's travel to the next customer. The mean and variance of that travel distance enter the Pollaczek–Khinchine waiting-time formula of an M/G/1 queue (the paper's equations (1a)–(2), p. 18), so closed forms for them are the input of the paper's whole deployment and pricing analysis (§4).

The paper considers two on-demand modes. In the door-to-door mode the stall drives to each customer's doorstep. In the within-radius mode each customer walks up to a distance rrr toward the stall, and the stall only moves until the two are rrr apart. This mission formalizes the travel-distance moments of both modes: Proposition 1 (door-to-door, p. 11) and Proposition 3 (within-radius, p. 18), whose proofs are in the paper's Appendix B (pp. 44–45 and 49–51).

Setting

All distances are Manhattan (ℓ1\ell_1ℓ1​) distances (p. 9): ∣A−B∣=∣a1−b1∣+∣a2−b2∣|A-B| = |a_1-b_1| + |a_2-b_2|∣A−B∣=∣a1​−b1​∣+∣a2​−b2​∣. A service zone is a square rotated by 45∘45^\circ45∘, a diamond, of Euclidean edge length R>0R>0R>0; the paper sets R=R(ρ)=1/ρR = R(\rho) = 1/\sqrt\rhoR=R(ρ)=1/ρ​ for a stall density ρ\rhoρ (p. 11). In Manhattan coordinates centred at the zone's centre,

ZR={(x,y):∣x∣+∣y∣≤R/2},\mathcal Z_R = \{(x,y) : |x|+|y| \le R/\sqrt2\},ZR​={(x,y):∣x∣+∣y∣≤R/2​},

which has area R2R^2R2. Customers arrive uniformly on ZR\mathcal Z_RZR​.

Fix a walking radius 0≤r≤R/20\le r\le R/\sqrt20≤r≤R/2​. The inner diamond IR,r={∣x∣+∣y∣≤R/2−r}\mathcal I_{R,r} = \{|x|+|y|\le R/\sqrt2-r\}IR,r​={∣x∣+∣y∣≤R/2​−r} lies rrr inward from the boundary and has edge length R−2rR-\sqrt2 rR−2​r. The paper's model for the stall's position when a new customer arrives (proof of Proposition 3, p. 49) is: the stall AAA is uniform on IR,r\mathcal I_{R,r}IR,r​, the customer BBB is uniform on ZR\mathcal Z_RZR​, and the two are independent. The repositioning trip length is

Lr=max⁡{∣A−B∣−r, 0},L_r = \max\{|A-B| - r,\ 0\},Lr​=max{∣A−B∣−r, 0},

and L0′=∣A−B∣L_0' = |A-B|L0′​=∣A−B∣ denotes the untruncated distance. In the door-to-door case r=0r=0r=0, both points are uniform on the zone and L0=∣A−B∣L_0 = |A-B|L0​=∣A−B∣. The variance is Var⁡(Lr)=E[Lr2]−E[Lr]2\operatorname{Var}(L_r) = \mathbb E[L_r^2]-\mathbb E[L_r]^2Var(Lr​)=E[Lr2​]−E[Lr​]2.

The uniform law of the stall is the paper's Theorem 1 (the subject of the companion mission I), read in a continuum limit that the paper states informally (p. 17). This mission takes the uniform law as its model and does not depend on that limit.

Formalization targets

Goal: Proposition 3 (p. 18)

For all R>0R>0R>0 and 0≤r≤R/20\le r\le R/\sqrt20≤r≤R/2​,

E[Lr]=72R3−22R2r+22Rr2+12r315R2,\mathbb E[L_r] = \frac{7\sqrt2R^3-22R^2r+2\sqrt2Rr^2+12r^3}{15R^2},E[Lr​]=15R272​R3−22R2r+22​Rr2+12r3​, Var⁡(Lr)=22R6−222R5r−1402R3r3+400R2r4−482Rr5−144r6225R4,\operatorname{Var}(L_r) = \frac{22R^6-22\sqrt2R^5r-140\sqrt2R^3r^3+400R^2r^4-48\sqrt2Rr^5-144r^6}{225R^4},Var(Lr​)=225R422R6−222​R5r−1402​R3r3+400R2r4−482​Rr5−144r6​,

and both are non-decreasing in RRR (on {R:r≤R/2}\{R : r\le R/\sqrt2\}{R:r≤R/2​}) and non-increasing in rrr (on [0,R/2][0,R/\sqrt2][0,R/2​]).

Milestones, in the order of the proof

  1. Proposition 1 (p. 11): E[L0]=72R/15\mathbb E[L_0] = 7\sqrt2R/15E[L0​]=72​R/15 and Var⁡(L0)=22R2/225\operatorname{Var}(L_0) = 22R^2/225Var(L0​)=22R2/225.
  2. E[L0′]=72R15−7r15+22r215R+2r315R2\mathbb E[L_0'] = \tfrac{7\sqrt2R}{15}-\tfrac{7r}{15}+\tfrac{2\sqrt2r^2}{15R}+\tfrac{2r^3}{15R^2}E[L0′​]=1572​R​−157r​+15R22​r2​+15R22r3​ (p. 49).
  3. P(L0′≤r)=2r2/R2\mathbb P(L_0'\le r) = 2r^2/R^2P(L0′​≤r)=2r2/R2 and E[L0′ 1{L0′≤r}]=23r⋅2r2/R2\mathbb E[L_0'\,\mathbf 1\{L_0'\le r\}] = \tfrac23r\cdot 2r^2/R^2E[L0′​1{L0′​≤r}]=32​r⋅2r2/R2 (p. 50).
  4. E[X2]=(R2−2Rr+r2)/6\mathbb E[X^2] = (R^2-\sqrt2Rr+r^2)/6E[X2]=(R2−2​Rr+r2)/6 for the horizontal component XXX of ∣A−B∣|A-B|∣A−B∣ (p. 50).
  5. E[(L0′)2]=(8R4−82R3r+7R2r2+r4)/(15R2)\mathbb E[(L_0')^2] = (8R^4-8\sqrt2R^3r+7R^2r^2+r^4)/(15R^2)E[(L0′​)2]=(8R4−82​R3r+7R2r2+r4)/(15R2) (p. 51).
  6. E[(L0′)2 1{L0′≤r}]=12r2⋅2r2/R2\mathbb E[(L_0')^2\,\mathbf 1\{L_0'\le r\}] = \tfrac12r^2\cdot 2r^2/R^2E[(L0′​)21{L0′​≤r}]=21​r2⋅2r2/R2 (p. 51).
  7. Proposition 3(I) and 8. Proposition 3(II) on their own.

A supporting theorem, E[XY]=(3R4−32R3r+2R2r2+r4)/(30R2)\mathbb E[XY] = (3R^4-3\sqrt2R^3r+2R^2r^2+r^4)/(30R^2)E[XY]=(3R4−32​R3r+2R2r2+r4)/(30R2) (p. 50), is posed as well.

Significance

The result. With Proposition 3 the service time of the within-radius mode has explicit first and second moments, so the M/G/1 waiting time, the stall's daily travel, and the profit density of §4 are explicit functions of (ρ,r)(\rho, r)(ρ,r). Part (III) is the qualitative content the paper calls the first effect of avoiding the "last 100 meters": a longer customer walk shortens the stall's repositioning, and a larger zone lengthens it. Proposition 1 is the r=0r=0r=0 benchmark against which that saving is measured.

Formalizing it. The results are proved in the paper by direct integration; none is machine-checked. The proofs split the domain into several regions by the signs of coordinate differences and assert the values of the resulting polynomial integrals "by calculation". A formal proof checks every one of those integrals, the use of conditional expectations given the event {L0′≤r}\{L_0'\le r\}{L0′​≤r}, and the derivative signs behind part (III), which the paper states without verification on the whole range. The intermediate moments are useful on their own for other models with uniform demand on diamonds under the Manhattan metric.

Difficulty

The obvious route rotates the diamond by 45∘45^\circ45∘, where the ℓ1\ell_1ℓ1​ distance becomes an ℓ∞\ell_\inftyℓ∞​ distance and the zone a square, and then integrates. For r=0r=0r=0 this works cleanly. For r>0r>0r>0 the stall's square is smaller than the customer's, and max⁡{⋅}\max\{\cdot\}max{⋅} of two coordinate differences over two squares of different sizes splits into many polynomial pieces. The paper instead stays in the original coordinates and splits into six regions for E[XY]\mathbb E[XY]E[XY]. Either way, the truncation at rrr is the delicate step: it requires that the whole ℓ1\ell_1ℓ1​ ball of radius rrr around the stall lies in the zone, which is exactly why the stall is confined to the inner diamond. Part (III) is not a consequence of (I) and (II) by inspection: the derivative in RRR of the mean vanishes at the boundary r=R/2r = R/\sqrt2r=R/2​, so the sign argument must be done on the closed range.

Formalization scope

Points are elements of ℝ × ℝ with Lebesgue measure. The definition StallEconomy.TripLength.Setting provides zone R, innerZone R r, the scale factor shrink R r = 1 − √2 r / R, the Manhattan distance l1, the trip length Lr r, the expectation E R r F, meanL R r and varL R r. The stall's uniform law is realised as A=s UA = s\,UA=sU with s=1−2r/R∈[0,1]s = 1-\sqrt2r/R \in [0,1]s=1−2​r/R∈[0,1] and UUU uniform on ZR\mathcal Z_RZR​, which is the uniform law on IR,r\mathcal I_{R,r}IR,r​; it covers the endpoint r=R/2r=R/\sqrt2r=R/2​, where the inner diamond is a single point, without dividing by (R−2r)2(R-\sqrt2r)^2(R−2​r)2. Thus

E[F(A,B)]=R−4∫ZR∫ZRF(s u,b) db du.\mathbb E[F(A,B)] = R^{-4}\int_{\mathcal Z_R}\int_{\mathcal Z_R} F(s\,u, b)\,db\,du.E[F(A,B)]=R−4∫ZR​​∫ZR​​F(su,b)dbdu.

Standing conventions and deviations from the page:

  • every statement assumes R>0R>0R>0, and the within-radius statements 0≤r≤R/20\le r\le R/\sqrt20≤r≤R/2​, the paper's range;
  • RRR is the edge length itself, not 1/ρ1/\sqrt\rho1/ρ​;
  • the conditional expectations given {L0′≤r}\{L_0'\le r\}{L0′​≤r} of pp. 50–51 are stated as truncated expectations E[ ⋅ 1{L0′≤r}]\mathbb E[\,\cdot\,\mathbf 1\{L_0'\le r\}]E[⋅1{L0′​≤r}], since the conditioning event has probability 000 at r=0r=0r=0;
  • the printed slips "P(L0>r)\mathbb P(L_0>r)P(L0​>r)" (p. 50, L0′L_0'L0′​ meant) and the conditioning event "L0′2≤rL_0'^2\le rL0′2​≤r" (p. 51, L0′≤rL_0'\le rL0′​≤r meant) are corrected;
  • "increasing/decreasing" in part (III) is weak monotonicity.

Formalizations that would trivialize the goal are ruled out: meanL and varL are integrals, not the closed forms; part (III) is stated about those integrals, not about the polynomials; and nothing is restricted to r=0r=0r=0 or to a fixed RRR.

A complete development needs iterated set integrals of piecewise polynomials over diamonds in ℝ × ℝ (Fubini on zone R, the change of variables u↦suu\mapsto suu↦su), and elementary calculus for part (III). Contributions of any of the moments, of a reusable lemma computing integrals of polynomials over diamonds, and of the monotonicity of the closed forms are all welcome. Proposition 2 of the paper, which is false as printed, is not claimed here.

Selected references

  • J. Cao and W. Qi, Stall Economy: The Value of Mobility in Retail on Wheels, Operations Research, 2022 (articles in advance). https://doi.org/10.1287/opre.2022.2404 ; manuscript: SSRN 3711896, https://ssrn.com/abstract=3711896
  • G. F. Newell, Dispatching policies for a transportation route, Transportation Science 5(1) 91–105, 1971 (origin of continuous approximation). https://doi.org/10.1287/trsc.5.1.91
10 thms1 active userReviewed
Algorithmic Game TheoryEconomicsOperations Research·Captain: mikedeng1

Economics of Permissioned Blockchain Adoption II: A Self-Financing Consumer Access Fee Sustains Full Blockchain Adoption for Large Horizontal DifferentiationResearch Paper

Motivation

A permissioned blockchain is a shared ledger to which only approved participants may write. In supply chains it is proposed as a way to make product information (origin, quality, which supplier fulfilled an order) verifiable to buyers. Iyengar, Saleh, Sethuraman and Wang (SSRN 3602376; Management Science 2023, doi:10.1287/mnsc.2022.4532) ask who gains from such adoption and who pays for it.

Their first main result (Proposition 4.8, the subject of the companion mission I) identifies an adoption failure: when products differ strongly in how well they match consumers' tastes, full adoption raises total welfare, yet no manufacturer adopts, because price competition leaves manufacturers no profit with which to recover the adoption cost while the information gain accrues to consumers. Their second main result, Proposition 4.9, the goal of this mission, shows that a simple self-financing mechanism removes the failure: charge consumers a fee for access to the blockchain's information and pass the proceeds to the manufacturers.

Setting

There are 4m4m4m manufacturers, m≥2m\ge 2m≥2. Manufacturer iii has a horizontal type qi∈{A,B}q_i\in\{A,B\}qi​∈{A,B} and a vertical type ξi∈{h,l}\xi_i\in\{h,l\}ξi​∈{h,l}; each of the four type classes has exactly mmm members. Joining the blockchain costs manufacturer iii an amount χi>0\chi_i>0χi​>0; ai∈{0,1}a_i\in\{0,1\}ai​∈{0,1} records the decision. A unit mass of consumers values a matching product at HHH and a mismatched one at LLL, with 0≤L<H0\le L<H0≤L<H, plus a vendor quality h>l≥0h>l\ge 0h>l≥0; the high-quality vendor has marginal cost γ>0\gamma>0γ>0. Each consumer kkk also has an outside option ϕk\phi_kϕk​, drawn from a continuous distribution GGG supported on [0,∞)[0,\infty)[0,∞). The parameter of interest is the horizontal differentiation Δ=H−L\Delta=H-LΔ=H−L; LLL is held fixed and H=L+ΔH=L+\DeltaH=L+Δ.

Under full adoption, a consumer who has access to the blockchain's information finds a best product utility Δ+L+h−γ\Delta+L+h-\gammaΔ+L+h−γ; without access, only Δ/2+L+h−γ\Delta/2+L+h-\gammaΔ/2+L+h−γ. A system of transfers (κ,{τi}i∈M)(\kappa,\{\tau_i\}_{i\in M})(κ,{τi​}i∈M​) charges each consumer who wants access a fee κ\kappaκ and pays manufacturer iii an amount τi≥0\tau_i\ge 0τi​≥0. A consumer pays (bk=1b_k=1bk​=1) when

max⁡{Δ+L+h−γ,ϕk}−κ ≥ max⁡{Δ2+L+h−γ,ϕk},\max\{\Delta+L+h-\gamma,\phi_k\}-\kappa\ \ge\ \max\Big\{\tfrac{\Delta}{2}+L+h-\gamma,\phi_k\Big\},max{Δ+L+h−γ,ϕk​}−κ ≥ max{2Δ​+L+h−γ,ϕk​},

and μκ\mu_\kappaμκ​ denotes the mass of paying consumers. The system is self-financing if

κ⋅μκ=∑i∈Mτi.(14)\kappa\cdot\mu_\kappa=\sum_{i\in M}\tau_i. \tag{14}κ⋅μκ​=i∈M∑​τi​.(14)

Manufacturer iii earns Π(ai,a−i)−χiai+τiai\Pi(a_i,a_{-i})-\chi_i a_i+\tau_i a_iΠ(ai​,a−i​)−χi​ai​+τi​ai​ (15), where the gross profit Π\PiΠ is zero because of price competition. The system overcomes adoption failures if full adoption (ai=1a_i=1ai​=1 for all iii) is an equilibrium of this game.

The proof of Proposition 4.9 uses the fee κ=∑iχi/G(ϕ)\kappa=\sum_i\chi_i/G(\phi)κ=∑i​χi​/G(ϕ) and the gain from access

h(ϕk;ϕ)=max⁡{Δ+L+h−γ,ϕk}−∑i∈MχiG(ϕ)−max⁡{Δ2+L+h−γ,ϕk}.h(\phi_k;\phi)=\max\{\Delta+L+h-\gamma,\phi_k\}-\frac{\sum_{i\in M}\chi_i}{G(\phi)}-\max\Big\{\frac{\Delta}{2}+L+h-\gamma,\phi_k\Big\}.h(ϕk​;ϕ)=max{Δ+L+h−γ,ϕk​}−G(ϕ)∑i∈M​χi​​−max{2Δ​+L+h−γ,ϕk​}.

Formalization targets

Goal: Proposition 4.9 (p. 21)

∃ Δ0 ∀ Δ>Δ0 ∃ κ,{τi}:τi≥0,κ⋅μκ=∑i∈Mτi,a≡1 is an equilibrium of (15).\exists\,\Delta_0\ \forall\,\Delta>\Delta_0\ \exists\,\kappa,\{\tau_i\}:\quad \tau_i\ge 0,\quad \kappa\cdot\mu_\kappa=\sum_{i\in M}\tau_i,\quad a\equiv 1\ \text{is an equilibrium of (15)}.∃Δ0​ ∀Δ>Δ0​ ∃κ,{τi​}:τi​≥0,κ⋅μκ​=i∈M∑​τi​,a≡1 is an equilibrium of (15).

The goal asserts the existence of a working scheme, as printed; it does not fix the scheme.

Milestones: Lemma B.1 (p. 38)

(a) For Δ>0\Delta>0Δ>0 and every ϕ\phiϕ, ϕk↦h(ϕk;ϕ)\phi_k\mapsto h(\phi_k;\phi)ϕk​↦h(ϕk​;ϕ) is continuous and weakly decreasing on [0,∞)[0,\infty)[0,∞).

(b) For all sufficiently large Δ\DeltaΔ there is ϕ∗≥0\phi^*\ge 0ϕ∗≥0 with

h(ϕ∗;ϕ∗)=0,h(ϕk;ϕ∗)≥0  ⟺  ϕk≤ϕ∗(ϕk≥0),h(\phi^*;\phi^*)=0,\qquad h(\phi_k;\phi^*)\ge 0\iff \phi_k\le\phi^*\quad(\phi_k\ge 0),h(ϕ∗;ϕ∗)=0,h(ϕk​;ϕ∗)≥0⟺ϕk​≤ϕ∗(ϕk​≥0),

so that at the fee ∑iχi/G(ϕ∗)\sum_i\chi_i/G(\phi^*)∑i​χi​/G(ϕ∗) exactly the consumers with ϕk≤ϕ∗\phi_k\le\phi^*ϕk​≤ϕ∗ pay.

Significance

Proposition 4.9 is the constructive half of the paper's message: an adoption failure driven by the split between who bears the cost and who reaps the benefit can be repaired without outside funding, by a fee on the side that benefits. The paper's scheme (τi=χi\tau_i=\chi_iτi​=χi​, κ=∑iχi/G(ϕ∗)\kappa=\sum_i\chi_i/G(\phi^*)κ=∑i​χi​/G(ϕ∗)) exactly reimburses adoption costs and is financed by a threshold set of consumers; Lemma B.1(b) is the fixed-point statement that makes this calibration consistent.

The result is proved in the paper (App. A.2, pp. 36–38, and App. B, pp. 38–41). It has no machine-checked proof. This mission produces one: a formal model of the access-fee mechanism in the reduced form the paper's proofs use, the threshold lemma, and the main proposition. The goal can be attacked through Lemma B.1(b) as in the paper, or by any other scheme meeting the definition.

Difficulty

The calibration is circular: the fee depends on the mass of paying consumers, and the mass of paying consumers depends on the fee. Lemma B.1(b) resolves this with a one-dimensional fixed point h(ϕ∗;ϕ∗)=0h(\phi^*;\phi^*)=0h(ϕ∗;ϕ∗)=0, and the delicate points are positivity of GGG at the relevant arguments (so that the fee is finite), the three-piece shape of h(⋅;ϕ)h(\cdot;\phi)h(⋅;ϕ), and choosing Δ\DeltaΔ large enough that the sign change happens inside the strictly decreasing piece. For the goal, the point to check is that the self-financing identity uses the actual mass of payers at the chosen fee: a fee too high drives the payers' mass, and with it the revenue, towards zero.

Formalization scope

  • Reduced form. The paper's full model is a signal game with Bertrand pricing whose equilibrium concept is not defined precisely; its proofs work with the closed-form outcome of Proposition A.1. The formalization does the same: consumer utilities are those computed in the proof of 4.9 (Δ+L+h−γ\Delta+L+h-\gammaΔ+L+h−γ with access, Δ/2+L+h−γ\Delta/2+L+h-\gammaΔ/2+L+h−γ without), gross profit Π\PiΠ is the constant 000 in every profile (pp. 37–38, also for a deviating manufacturer), and "equilibrium" is a pure Nash equilibrium over unilateral switches of ai∈{0,1}a_i\in\{0,1\}ai​∈{0,1}. Signal accuracy is α=1/2\alpha=1/2α=1/2, as in the paper's main text.
  • Encoding. Manufacturers are Fin 2 × Bool × Fin m; adoption profiles are Bool-valued. GGG is ProbabilityTheory.cdf μ for a measure μ on ℝ. Δ\DeltaΔ is an argument of every object, with H=L+ΔH=L+\DeltaH=L+Δ.
  • Standing assumptions (one predicate Model.Standing): m≥2m\ge 2m≥2, 0≤L0\le L0≤L, 0≤l<h0\le l<h0≤l<h, γ>0\gamma>0γ>0, χi>0\chi_i>0χi​>0; μ\muμ a probability measure without atoms, μ((−∞,0))=0\mu((-\infty,0))=0μ((−∞,0))=0, and μ((a,b))>0\mu((a,b))>0μ((a,b))>0 for 0≤a<b0\le a<b0≤a<b (support [0,∞)[0,\infty)[0,∞)). No cost function clc_lcl​, no Assumption 1 and no finite mean are needed or assumed. Lemma B.1(a) additionally assumes Δ>0\Delta>0Δ>0, the model's L<HL<HL<H.
  • Ties in the access decision go to paying, as in the proof's "bk=1b_k=1bk​=1 iff h≥0h\ge 0h≥0".
  • Ruled out. μκ\mu_\kappaμκ​ is the μ\muμ-measure of the paying consumers, not a free number in [0,1][0,1][0,1]; the equilibrium predicate and Π\PiΠ are defined, not assumed; transfers are nonnegative; and no statement relies on Lean's value 000 for a division by G(ϕ)=0G(\phi)=0G(ϕ)=0.
  • Not formalized. The non-uniqueness clause of Lemma B.1(b) and Example B.1 (p. 40); the purchase-stage claims of the proof of 4.9 (market shares under transfers); Appendix C's symmetric-cost variant.
  • Infrastructure. Only Mathlib's measure theory and ProbabilityTheory.cdf; no new library is needed. Lemmas on CDFs of atomless, fully supported laws on [0,∞)[0,\infty)[0,∞) are reusable beyond this mission. Proofs of the milestones and of the goal are welcome; the goal may be proved by any route.

Selected references

  • G. Iyengar, F. Saleh, J. Sethuraman, W. Wang, Economics of Permissioned Blockchain Adoption, SSRN 3602376, version of 2022-08-19. https://ssrn.com/abstract=3602376
  • G. Iyengar, F. Saleh, J. Sethuraman, W. Wang, Economics of Permissioned Blockchain Adoption, Management Science, 2023. https://doi.org/10.1287/mnsc.2022.4532
4 thms1 active userReviewed
EconomicsOperations ResearchOptimization·Captain: mikedeng1

Gathering Information before Negotiation II: Under a Uniform Prior and Linear Information Cost, the Seller's Expected Payoff Jumps Down at θs = 1 − θ̃, Up at c = c_l and Down at c = c_hResearch Paper

Motivation

In many trades the buyer does not know how much the good is worth to it, and can find out before negotiating: a firm commissions due diligence before an acquisition, a hospital pilots a device before negotiating its price, a household inspects a house before making an offer. Such information has two effects. It makes the trade decision better informed, which enlarges the total surplus, and it is paid for by the buyer alone, while the surplus it creates is shared through bargaining.

L. Guo, Gathering Information before Negotiation (SSRN 3930651; Management Science, doi:10.1287/mnsc.2022.4360), studies how this interaction shapes the seller's payoff. Its headline is a reversal: a seller with more bargaining power, or with a more valuable outside option, can be worse off, and a seller with a higher production cost can be better off. The reason is that the buyer's information choice reacts to these parameters, and the reaction can outweigh their direct effect. This mission formalizes that reversal for the paper's worked example, the uniform prior with a linear information cost.

Setting

A seller and a buyer negotiate over one unit of a good. The seller's cost is c∈(0,1)c\in(0,1)c∈(0,1). The buyer's value uuu is unknown to both parties; the common prior is the uniform distribution F(u)=uF(u)=uF(u)=u on [0,1][0,1][0,1], with mean u^=1/2\hat u=1/2u^=1/2. The bargaining powers are θb∈(0,1)\theta_b\in(0,1)θb​∈(0,1) for the buyer and θs=1−θb\theta_s=1-\theta_bθs​=1−θb​ for the seller.

Before negotiating, the buyer chooses an informativeness α∈[α‾,αˉ]\alpha\in[\underline\alpha,\bar\alpha]α∈[α​,αˉ], with 0<α‾<αˉ<10<\underline\alpha<\bar\alpha<10<α​<αˉ<1. It then observes a truth-or-noise signal www: with probability α\alphaα it equals uuu, and otherwise it is an independent draw from the prior. The buyer's posterior mean is v=αw+(1−α)u^v=\alpha w+(1-\alpha)\hat uv=αw+(1−α)u^. The information cost is linear,

k(α)=kˉ α−α‾αˉ−α‾,kˉ>0.k(\alpha)=\bar k\,\frac{\alpha-\underline\alpha}{\bar\alpha-\underline\alpha},\qquad \bar k>0 .k(α)=kˉαˉ−α​α−α​​,kˉ>0.

If v>cv>cv>c the parties trade and split the net surplus v−cv-cv−c in the proportions θs:θb\theta_s:\theta_bθs​:θb​; otherwise they do not trade. The total ex ante surplus is

A(α,c)=E[(v−c)+]=∫01max⁡{αw+1−α2−c,  0} dw,A(\alpha,c)=\mathbb E\big[(v-c)^+\big]=\int_0^1\max\Big\{\alpha w+\frac{1-\alpha}{2}-c,\;0\Big\}\,dw ,A(α,c)=E[(v−c)+]=∫01​max{αw+21−α​−c,0}dw,

and the buyer chooses α\alphaα to maximise

Ub(α)=θb A(α,c)−k(α).U_b(\alpha)=\theta_b\,A(\alpha,c)-k(\alpha).Ub​(α)=θb​A(α,c)−k(α).

The optimal set α∗\alpha^*α∗ is the set of maximisers of UbU_bUb​ on [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ]. The seller's equilibrium expected payoff is

Us∗=θs A(α∗,c)(material cost),Vs∗=c+θs A(α∗,c)(opportunity cost).U_s^*=\theta_s\,A(\alpha^*,c)\quad\text{(material cost)},\qquad V_s^*=c+\theta_s\,A(\alpha^*,c)\quad\text{(opportunity cost)}.Us∗​=θs​A(α∗,c)(material cost),Vs∗​=c+θs​A(α∗,c)(opportunity cost).

Write Δ(c)=A(αˉ,c)−A(α‾,c)\Delta(c)=A(\bar\alpha,c)-A(\underline\alpha,c)Δ(c)=A(αˉ,c)−A(α​,c) for the surplus gain of maximal information, and θ~=kˉ/Δ(c)\tilde\theta=\bar k/\Delta(c)θ~=kˉ/Δ(c) when Δ(c)>kˉ\Delta(c)>\bar kΔ(c)>kˉ, θ~=1\tilde\theta=1θ~=1 otherwise. For fixed θb\theta_bθb​, the cost thresholds cl≤1/2≤chc_l\le 1/2\le c_hcl​≤1/2≤ch​ are the endpoints of the set of costs at which θbΔ(c)>kˉ\theta_b\Delta(c)>\bar kθb​Δ(c)>kˉ.

Formalization targets

Goal: Proposition 2 (p. 14), uniform prior

For every selection of optimal information levels:

  1. θs↦Us∗\theta_s\mapsto U_s^*θs​↦Us∗​ and θs↦Vs∗\theta_s\mapsto V_s^*θs​↦Vs∗​ are nondecreasing on (0,1−θ~)(0,1-\tilde\theta)(0,1−θ~) and on (1−θ~,1)(1-\tilde\theta,1)(1−θ~,1), and, if θ~<1\tilde\theta<1θ~<1, drop strictly at θs=1−θ~\theta_s=1-\tilde\thetaθs​=1−θ~;
  2. c↦Us∗c\mapsto U_s^*c↦Us∗​ is nonincreasing on (0,cl)(0,c_l)(0,cl​) and on (cl,1)(c_l,1)(cl​,1), and, if cl<chc_l<c_hcl​<ch​, jumps up strictly at c=clc=c_lc=cl​;
  3. c↦Vs∗c\mapsto V_s^*c↦Vs∗​ is nondecreasing on (0,ch)(0,c_h)(0,ch​) and on (ch,1)(c_h,1)(ch​,1), and, if cl<chc_l<c_hcl​<ch​, drops strictly at c=chc=c_hc=ch​.

A drop at t0t_0t0​ means: for some ε>0\varepsilon>0ε>0, every value just to the right of t0t_0t0​ is strictly below every value just to the left.

Milestones

A(α,c)={max⁡{1/2−c,0},α≤∣1−2c∣,[(1+α)/2−c]2/(2α),α≥∣1−2c∣,A(\alpha,c)=\begin{cases}\max\{1/2-c,0\},&\alpha\le|1-2c|,\\ [(1+\alpha)/2-c]^2/(2\alpha),&\alpha\ge|1-2c|,\end{cases}A(α,c)={max{1/2−c,0},[(1+α)/2−c]2/(2α),​α≤∣1−2c∣,α≥∣1−2c∣,​

the uniform display of p. 13. The proof of Corollary 1 (p. 30) then contributes three steps: A(⋅,c)A(\cdot,c)A(⋅,c) is constant and then increasing, and convex; the optimum is a corner, α∗∈{α‾,αˉ}\alpha^*\in\{\underline\alpha,\bar\alpha\}α∗∈{α​,αˉ}; and Δ\DeltaΔ vanishes for extreme costs, rises and then falls in ccc, and peaks at Δ(1/2)=(αˉ−α‾)/8\Delta(1/2)=(\bar\alpha-\underline\alpha)/8Δ(1/2)=(αˉ−α​)/8. Corollary 1 (p. 13) gives the two threshold rules: (i) α∗=α‾\alpha^*=\underline\alphaα∗=α​ for θb≤θ~\theta_b\le\tilde\thetaθb​≤θ~ and α∗=αˉ\alpha^*=\bar\alphaα∗=αˉ for θb>θ~\theta_b>\tilde\thetaθb​>θ~; (ii) α∗=αˉ\alpha^*=\bar\alphaα∗=αˉ exactly for cl<c<chc_l<c<c_hcl​<c<ch​.

Significance

The result. Without information acquisition, the seller's payoff is increasing in its bargaining power and in its outside option and decreasing in its material cost: these are the direct effects. Proposition 2 shows that each of them can be reversed by a discontinuous jump. The mechanism is that the buyer stops gathering information when its own share of the surplus becomes too small (high θs\theta_sθs​) or the trade decision becomes clear-cut (extreme ccc). The result bears on when a seller should prefer to commit to a weaker bargaining position, and on why cost increases need not hurt a seller facing an uninformed buyer.

Formalizing it. The paper calls Proposition 2 an immediate consequence of Corollary 1. That corollary rests on a short appendix argument whose printed version contains slips: the peak of Δ\DeltaΔ is printed as θb(αˉ−α‾)/8\theta_b(\bar\alpha-\underline\alpha)/8θb​(αˉ−α​)/8, strictness is claimed on a closed interval at whose endpoints Δ=0\Delta=0Δ=0, and "α∗∈{α‾,αˉ}\alpha^*\in\{\underline\alpha,\bar\alpha\}α∗∈{α​,αˉ}" fails at c=1/2c=1/2c=1/2 when the two corners tie. A machine-checked development settles exactly which form of each claim is true. The result has been proved informally in the paper; it has not been formalized before.

Difficulty

The obvious argument treats α∗\alpha^*α∗ as a function and differentiates Us∗U_s^*Us∗​. That does not work here. At the thresholds α∗\alpha^*α∗ is not single-valued, and between them it is constant, so the whole content lies in the jumps. A jump statement must hold whichever optimal level is selected at each parameter, and it must compare values on both sides of a threshold whose location depends on Δ\DeltaΔ. Showing that the thresholds are well placed requires the inverted-U shape of Δ\DeltaΔ, which comes from an explicit but piecewise integral. The corner property needs convexity of AAA across the kink at α=∣1−2c∣\alpha=|1-2c|α=∣1−2c∣, where the two branches of the closed form meet.

Formalization scope

All quantities are real numbers. AAA is the interval integral over the uniform prior after the change of variables v=αw+(1−α)u^v=\alpha w+(1-\alpha)\hat uv=αw+(1−α)u^; no density is assumed. The bargaining stage is not modelled; the payoffs are the paper's reduced forms (6) and θsA(α∗,c)\theta_sA(\alpha^*,c)θs​A(α∗,c). Conventions: c∈(0,1)c\in(0,1)c∈(0,1) (the paper's c∈(u‾,uˉ)c\in(\underline u,\bar u)c∈(u​,uˉ)); θb,θs∈(0,1)\theta_b,\theta_s\in(0,1)θb​,θs​∈(0,1) with θs=1−θb\theta_s=1-\theta_bθs​=1−θb​; [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ] non-degenerate; θ~=1\tilde\theta=1θ~=1 when Δ(c)≤kˉ\Delta(c)\le\bar kΔ(c)≤kˉ, which avoids kˉ/0\bar k/0kˉ/0 and keeps θ~∈(0,1]\tilde\theta\in(0,1]θ~∈(0,1]. Monotonicity is claimed on each side of the jump point, open at that point (and across the other cost threshold), and the jump whenever the threshold is interior. In (ii) and (iii), cl≤1/2≤chc_l\le1/2\le c_hcl​≤1/2≤ch​ are assumed to satisfy "cl<c<chc_l<c<c_hcl​<c<ch​ iff θbΔ(c)>kˉ\theta_b\Delta(c)>\bar kθb​Δ(c)>kˉ" for all c∈(0,1)c\in(0,1)c∈(0,1), which determines them; when the buyer never gathers information this forces cl=ch=1/2c_l=c_h=1/2cl​=ch​=1/2.

The paper states Corollary 1 and Proposition 2 for four focal priors (uniform, exponential, logistic, modified Pareto) but works out only the uniform one. This mission is pinned to the uniform prior and the linear cost.

A trivializing formalization is ruled out: AAA is not defined by its closed form (that closed form is a milestone), α∗\alpha^*α∗ is the set of maximisers of UbU_bUb​ and not a threshold rule, and the goal quantifies over every selection from that set, so neither Corollary 1 nor Proposition 2 holds by definition.

A complete development needs piecewise interval integrals of max⁡{⋅,0}\max\{\cdot,0\}max{⋅,0}, convexity of a function with a C1C^1C1 junction, and the fact that a convex function on a segment attains its maximum at an endpoint. All of these are general facts, reusable beyond this mission. Proofs of the milestones in any order are welcome; Proposition 3 and the other priors are not posed here.

Selected references

  • L. Guo, Gathering Information before Negotiation, SSRN 3930651, manuscript of 15 Feb 2022. https://ssrn.com/abstract=3930651
  • L. Guo, Gathering Information before Negotiation, Management Science (journal version of the manuscript above; its theorem numbering is not used here). https://doi.org/10.1287/mnsc.2022.4360
8 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

Lightning Network Economics: Topology III: With Power-Law Channel-Cost Tails, a Random Lightning Network Is Hermetizable with High ProbabilityResearch Paper

Motivation

The Lightning Network is a payment layer built on top of Bitcoin: pairs of participants lock funds in a bilateral payment channel and then exchange payments off-chain, settling on the blockchain only occasionally. Keeping a channel open costs money, because it ties up capital and needs periodic rebalancing, and Guasoni, Huberman and Shikhelman (Lightning Network Economics: Channels, 2022, cited in the paper as [GHS22]) showed that this recurring cost depends on the channel's net flow and grows less than proportionally with it. Which network topology a population of payers and payees should use is therefore an economic question about subadditive costs on graphs.

Lightning Network Economics: Topology (SSRN 4439190; published version in Management Science, 2024, doi:10.1287/mnsc.2023.03872) answers this question in an axiomatic model. Its §3.2 introduces hermetization, which replaces the channels inside a group of nodes by channels to a new hub, and asks when this reduces cost. Theorem 3.8 gives a deterministic sufficient condition, a large average degree compared with the spread of channel sizes. Theorem 3.9, the subject of this mission, shows that the condition is typical: if channel sizes are random with thin, power-law-bounded cost tails, the network is hermetizable with high probability. The paper reads this as "cost reduction is the norm, not the exception", which is the economic argument for hubs in payment-channel networks.

Setting

Nodes form a finite set VVV. A Lightning Network (LN) is an anti-symmetric real matrix Λ=(λi,j)i,j∈V\Lambda=(\lambda_{i,j})_{i,j\in V}Λ=(λi,j​)i,j∈V​, λi,j=−λj,i\lambda_{i,j}=-\lambda_{j,i}λi,j​=−λj,i​, of net channel flows; λi,j=0\lambda_{i,j}=0λi,j​=0 means there is no channel between iii and jjj. A channel cost is a function c:R→R+c:\mathbb R\to\mathbb R_+c:R→R+​ with

  • (MO) c(x)>c(y)c(x)>c(y)c(x)>c(y) for x>y≥0x>y\ge 0x>y≥0; (SY) c(−x)=c(x)c(-x)=c(x)c(−x)=c(x); (CI) c(0)=0c(0)=0c(0)=0;
  • (SA) c(x+y)<c(x)+c(y)c(x+y)<c(x)+c(y)c(x+y)<c(x)+c(y) for x,y>0x,y>0x,y>0;
  • (SA+) for a strictly increasing g+:R+→R+g_+:\mathbb R_+\to\mathbb R_+g+​:R+​→R+​, c(kx)<kg+(k)c(x)c(kx)<\dfrac{k}{g_+(k)}c(x)c(kx)<g+​(k)k​c(x) for k>1k>1k>1, x>0x>0x>0.

The cost of the network is c(G)=12∑i,jc(λi,j)c(G)=\tfrac12\sum_{i,j}c(\lambda_{i,j})c(G)=21​∑i,j​c(λi,j​). For a node iii, d(i)d(i)d(i) is its number of channels, s(i)s(i)s(i) the smallest and S(i)S(i)S(i) the largest ∣λi,j∣|\lambda_{i,j}|∣λi,j​∣ over its channels.

The hermetization of a set of nodes UUU deletes all channels inside UUU, adds a new node v0v_0v0​, and joins each i∈Ui\in Ui∈U to v0v_0v0​ by a channel carrying ∑j∈Uλi,j\sum_{j\in U}\lambda_{i,j}∑j∈U​λi,j​, its net flow towards the rest of UUU. The set UUU is hermetizable if this strictly lowers the cost, and the LN is hermetizable if some UUU is.

In the random model a simple graph EEE on VVV fixes the channels, so d(i)d(i)d(i) is the degree of iii in EEE and is not random. On a probability space (Ω,P)(\Omega,\mathbb P)(Ω,P), the flows λi,j(ω)\lambda_{i,j}(\omega)λi,j​(ω) are random variables, nonzero exactly on the channels of EEE, and Λ(ω)\Lambda(\omega)Λ(ω) is an LN for every ω\omegaω.

Formalization targets

Goal: Theorem 3.9

Let a>1a>1a>1, b>0b>0b>0, ε>0\varepsilon>0ε>0. There is k>0k>0k>0, depending only on (a,b,ε)(a,b,\varepsilon)(a,b,ε), such that for every finite EEE with at least one channel, every c,g+c,g_+c,g+​ satisfying (MO)–(SA+), and every random LN with, for all channels ij∈Eij\in Eij∈E,

(i)  P(c(λi,j)>x)<b x−a  (x>0),(ii)  P(c(λi,j)>ε)=1,\text{(i)}\ \ \mathbb P\big(c(\lambda_{i,j})>x\big)<b\,x^{-a}\ \ (x>0),\qquad \text{(ii)}\ \ \mathbb P\big(c(\lambda_{i,j})>\varepsilon\big)=1,(i)  P(c(λi,j​)>x)<bx−a  (x>0),(ii)  P(c(λi,j​)>ε)=1,

the LN is hermetizable with probability at least

1−k∑i∈Vd(i) (g+(d(i)))−a.1-k\sum_{i\in V}d(i)\,\big(g_+(d(i))\big)^{-a}.1−ki∈V∑​d(i)(g+​(d(i)))−a.

The constant is not fixed: any kkk uniform in the network and in c,g+c,g_+c,g+​ is a proof of the goal.

Milestones

  1. Lemma B.1. If every iii in a nonempty set UUU has a channel in UUU and g+(dU(i))>2c(SU(i))/c(sU(i))g_+(d_U(i))>2c(S_U(i))/c(s_U(i))g+​(dU​(i))>2c(SU​(i))/c(sU​(i)), with degrees and sizes in the subnetwork induced on UUU, then UUU is hermetizable.
  2. (8)–(10). P(hermetizable)≥1−∑i: d(i)≥1P(g+(d(i))≤2c(S(i))/c(s(i)))\mathbb P(\text{hermetizable})\ge 1-\sum_{i:\,d(i)\ge1}\mathbb P\big(g_+(d(i))\le 2c(S(i))/c(s(i))\big)P(hermetizable)≥1−∑i:d(i)≥1​P(g+​(d(i))≤2c(S(i))/c(s(i))).
  3. (11). Under (ii), P(g+(d(i))≤2c(S(i))/c(s(i)))≤P(ε2g+(d(i))≤c(S(i)))\mathbb P\big(g_+(d(i))\le 2c(S(i))/c(s(i))\big)\le\mathbb P\big(\tfrac{\varepsilon}{2}g_+(d(i))\le c(S(i))\big)P(g+​(d(i))≤2c(S(i))/c(s(i)))≤P(2ε​g+​(d(i))≤c(S(i))) for d(i)≥1d(i)\ge1d(i)≥1.
  4. (12)–(13). Under (i), P(c(S(i))≥x)≤d(i) b x−a\mathbb P\big(c(S(i))\ge x\big)\le d(i)\,b\,x^{-a}P(c(S(i))≥x)≤d(i)bx−a for every x>0x>0x>0.

The paper closes with "for some constant kkk, P(c(S(i))≥ε2g+(d(i)))≤k d(i) (g+(d(i)))−a\mathbb P\big(c(S(i))\ge\tfrac{\varepsilon}{2}g_+(d(i))\big)\le k\,d(i)\,(g_+(d(i)))^{-a}P(c(S(i))≥2ε​g+​(d(i)))≤kd(i)(g+​(d(i)))−a, whence the claim."

Significance

The theorem turns the deterministic criterion of Lemma B.1 into a statement about typical networks. When degrees grow, g+(d)−ag_+(d)^{-a}g+​(d)−a decays, and the probability that no hub can reduce cost vanishes for any law with a power-bounded cost tail and a positive cost floor. This is the paper's evidence that hub-and-spoke structures are the economically stable outcome; the companion results of the paper (Theorem 3.1 on local restructuring, Theorem 3.10 on the star topology) are treated in sibling missions of this series.

The result is proved in the paper, in about half a page. It has no machine-checked proof. Formalizing it makes the quantifier structure explicit, in particular that kkk does not depend on the network, settles the boundary cases the paper leaves implicit, and records corrected forms of two axioms that are unsatisfiable as printed. Lemma B.1 is shared with the mission on Theorem 3.8.

Difficulty

The probabilistic estimates are elementary; the obstacles are in the bookkeeping. Lemma B.1 compares two costs on different node sets (the hermetized network has one more node), and its degrees and channel sizes must be read in the subnetwork induced on UUU; with the degrees of the whole network the lemma is false. To apply it to a random network one must choose UUU: the set of all nodes fails when some node is isolated, because s(i)s(i)s(i) is then undefined. The step from the strict tail P(c>x)\mathbb P(c>x)P(c>x) of (i) to the weak tail P(c≥x)\mathbb P(c\ge x)P(c≥x) used in (12)–(13) is a limit the paper does not write out. The inverse g+−1g_+^{-1}g+−1​ that the paper uses need not exist, since g+g_+g+​ is not assumed onto.

Formalization scope

Nodes are an arbitrary finite type V; the LN is Λ : V → V → ℝ, anti-symmetric; the channel graph is E : SimpleGraph V, with λi,j(ω)≠0  ⟺  ij∈E\lambda_{i,j}(\omega)\ne0\iff ij\in Eλi,j​(ω)=0⟺ij∈E for every ω\omegaω, and d(i)d(i)d(i) is E.degree i. The cost is the 12∑i,j\tfrac12\sum_{i,j}21​∑i,j​ form. The hub v0v_0v0​ of a hermetization is none : Option V. Probabilities are toReal of a probability measure, and events are not assumed measurable. Each λi,j\lambda_{i,j}λi,j​ is assumed measurable in the goal. The conventions committed to:

  • (SA) is used for all x,y>0x,y>0x,y>0: as printed ("for x>y≥0x>y\ge0x>y≥0") it demands c(x)<c(x)c(x)<c(x)c(x)<c(x) at y=0y=0y=0. The corrected range is the one Appendix D verifies.
  • (SA+) is used for k>1k>1k>1, x>0x>0x>0: as printed (k∈R+k\in\mathbb R_+k∈R+​) it fails at x=0x=0x=0, and for k≤1k\le1k≤1 even for the paper's own example.
  • Every condition d>g+−1(y)d>g_+^{-1}(y)d>g+−1​(y) is written g+(d)>yg_+(d)>yg+​(d)>y.
  • In Lemma B.1, ddd, sss, SSS are those of the subnetwork induced on UUU; UUU is nonempty and each i∈Ui\in Ui∈U has a channel in UUU. For a node without a channel, sss and SSS take the junk value 000, which no statement uses.
  • The constants a,b,εa,b,\varepsilona,b,ε are common to all channels. Neither independence nor identical distribution of the flows is assumed: the theorem's hypotheses are only (i) and (ii).
  • The goal assumes at least one channel. With none, the printed bound is 111 but the cost 000 cannot be reduced.

The following formalizations are trivializing and are ruled out: a kkk allowed to depend on VVV, EEE, P\mathbb PP, Λ\LambdaΛ, ccc or g+g_+g+​ (take kkk large enough that the bound is ≤0\le0≤0); a specific law, such as a Pareto law, or a specific cost such as c(x)=∣x∣c(x)=\sqrt{|x|}c(x)=∣x∣​; replacing "the LN is hermetizable" by the event that every node satisfies Lemma B.1's inequality; an empty channel set; and the printed, unsatisfiable (SA) or (SA+), under which every statement is vacuous.

The development needs finite sums over Option V, a min/max over a node's channels, and union bounds for outer measures (Mathlib's measure_biUnion_finset_le). Contributions welcome: proofs of the milestones, a proof that the corrected axioms are satisfiable by c(x)=∣x∣c(x)=\sqrt{|x|}c(x)=∣x∣​, g+(k)=k1/4g_+(k)=k^{1/4}g+​(k)=k1/4, and a reusable statement of Lemma B.1 for the series.

Selected references

  • P. Guasoni, G. Huberman, C. Shikhelman, Lightning Network Economics: Topology, SSRN working paper 4439190, version of February 3, 2023. https://ssrn.com/abstract=4439190 ; published in Management Science, 2024, https://doi.org/10.1287/mnsc.2023.03872
  • P. Guasoni, G. Huberman, C. Shikhelman, Lightning Network Economics: Channels, 2022 (cited in the paper as [GHS22]; reference list, p. 16 of SSRN 4439190).
  • J. Poon, T. Dryja, The Bitcoin Lightning Network: Scalable Off-Chain Instant Payments, 2016. https://lightning.network/lightning-network-paper.pdf
9 thms1 active userReviewed
Random Matrix TheoryStatistics·Captain: mikedeng1

Change-Point Detection in Dynamic Networks with Missing Links III: The Dyadic-Grid Matrix CUSUM Test Detects an Unknown Change Time Above Energy 4(1+ϵ)(6ω_n/T)^{1/2} + C log(4n log₂T/(α∧β))/√TResearch Paper

Detecting a change in a partially observed network

Many networks are recorded as a sequence of snapshots: contact networks in epidemiology, communication graphs, brain connectivity measured over time, trade or transport links. A basic statistical question is whether the law generating the snapshots changed at some point. Two features make the question hard in practice. The networks are often sparse, so each snapshot carries little information. And links are missing: a pair of vertices is observed only with some probability, so an absent edge may mean "no link" or "not sampled".

Enikeeva and Klopp (arXiv:2106.14470, Operations Research, 2025) give minimax bounds for this testing problem. They treat both a known change time (Theorems 1 and 2) and an unknown change time (Theorem 3). This mission formalizes the unknown-time case, where the test scans a dyadic grid of candidate times. Two companion missions formalize the known-time upper bound (Theorem 1) and the lower bound (Theorem 2).

Setting

There are nnn vertices and TTT time points. At time ttt the statistician observes a symmetric matrix Yt∈{0,1}n×nY^t\in\{0,1\}^{n\times n}Yt∈{0,1}n×n with zero diagonal, Yijt=ΩijtAijtY^t_{ij}=\Omega^t_{ij}A^t_{ij}Yijt​=Ωijt​Aijt​. Here AtA^tAt is the adjacency matrix of the network and Ωt\Omega^tΩt records which pairs were sampled. The entries YijtY^t_{ij}Yijt​, i<ji<ji<j, are independent over pairs and times, and

Yijt∼Bernoulli((Π⊙Θt)ij),Y^t_{ij}\sim\mathrm{Bernoulli}\big((\Pi\odot\Theta^t)_{ij}\big),Yijt​∼Bernoulli((Π⊙Θt)ij​),

where Θt∈[0,1]n×n\Theta^t\in[0,1]^{n\times n}Θt∈[0,1]n×n is the connection-probability matrix (symmetric, zero diagonal), Π\PiΠ is the sampling matrix (symmetric, entries in (0,1](0,1](0,1], unit diagonal), and ⊙\odot⊙ is the entrywise product.

The sparsity level ωn\omega_nωn​ bounds the expected observed degree: (Θ,Π)∈Sn(ωn)(\Theta,\Pi)\in\mathcal S_n(\omega_n)(Θ,Π)∈Sn​(ωn​) when ∥Π⊙Θ∥1,∞=max⁡j∑i∣(Π⊙Θ)ij∣≤ωn\|\Pi\odot\Theta\|_{1,\infty}=\max_j\sum_i|(\Pi\odot\Theta)_{ij}|\le\omega_n∥Π⊙Θ∥1,∞​=maxj​∑i​∣(Π⊙Θ)ij​∣≤ωn​.

Under the null hypothesis Θt=Θ0\Theta^t=\Theta^0Θt=Θ0 for all ttt. Under the alternative there is τ∈DT={1,…,T−1}\tau\in\mathcal D_T=\{1,\dots,T-1\}τ∈DT​={1,…,T−1} with Θt=Θ0\Theta^t=\Theta^0Θt=Θ0 for t≤τt\le\taut≤τ and Θt=Θ0+ΔΘτ\Theta^t=\Theta^0+\Delta\Theta^\tauΘt=Θ0+ΔΘτ for t>τt>\taut>τ. Both parameter pairs lie in Sn(ωn)\mathcal S_n(\omega_n)Sn​(ωn​), and the jump has energy at least RRR:

q(τ/T) ∥Π⊙ΔΘτ∥2→2≥R,q(x)=x(1−x),q(\tau/T)\,\|\Pi\odot\Delta\Theta^\tau\|_{2\to2}\ge R,\qquad q(x)=\sqrt{x(1-x)},q(τ/T)∥Π⊙ΔΘτ∥2→2​≥R,q(x)=x(1−x)​,

where ∥⋅∥2→2\|\cdot\|_{2\to2}∥⋅∥2→2​ is the spectral norm. A test ψ\psiψ maps the data to {0,1}\{0,1\}{0,1}. Its type I error α(ψ)\alpha(\psi)α(ψ) is the largest rejection probability over the null class. Its type II error β(ψ,R)\beta(\psi,R)β(ψ,R) is the largest acceptance probability over all τ∈DT\tau\in\mathcal D_Tτ∈DT​ and all alternatives of energy at least RRR.

The Matrix CUSUM at time ttt contrasts the averages before and after ttt:

ZT(t)=t(T−t)T(1t∑s=1tYs−1T−t∑s=t+1TYs),1≤t≤T−1.Z_T(t)=\sqrt{\frac{t(T-t)}{T}}\Big(\frac1t\sum_{s=1}^tY^s-\frac1{T-t}\sum_{s=t+1}^TY^s\Big),\qquad1\le t\le T-1.ZT​(t)=Tt(T−t)​​(t1​s=1∑t​Ys−T−t1​s=t+1∑T​Ys),1≤t≤T−1.

The dyadic grid is T={2k}∪{T−2k}\mathcal T=\{2^k\}\cup\{T-2^k\}T={2k}∪{T−2k}, 0≤k≤⌊log⁡2(T/2)⌋0\le k\le\lfloor\log_2(T/2)\rfloor0≤k≤⌊log2​(T/2)⌋. Fix ϵ∈(0,1/2]\epsilon\in(0,1/2]ϵ∈(0,1/2]. The test (14) of the paper rejects when

max⁡t∈T∥ZT(t)∥2→2>Hα,n,T=22(1+ϵ)ωn+Cϵlog⁡4nlog⁡2(T)α.\max_{t\in\mathcal T}\|Z_T(t)\|_{2\to2}>H_{\alpha,n,T}=2\sqrt2(1+\epsilon)\sqrt{\omega_n}+C_\epsilon\log\frac{4n\log_2(T)}{\alpha}.t∈Tmax​∥ZT​(t)∥2→2​>Hα,n,T​=22​(1+ϵ)ωn​​+Cϵ​logα4nlog2​(T)​.

Formalization targets

Goal: Theorem 3

For every ϵ∈(0,1/2]\epsilon\in(0,1/2]ϵ∈(0,1/2] there are constants Cϵ>0C_\epsilon>0Cϵ​>0 and CCC, depending only on ϵ\epsilonϵ, such that for all n≥1n\ge1n≥1, T≥2T\ge2T≥2, ωn≥0\omega_n\ge0ωn​≥0 and α,β∈(0,1)\alpha,\beta\in(0,1)α,β∈(0,1): if

R ≥ 4(1+ϵ)(6ωnT)1/2+CTlog⁡(4nlog⁡2(T)α∧β),R\ \ge\ 4(1+\epsilon)\Big(\frac{6\omega_n}{T}\Big)^{1/2}+\frac{C}{\sqrt T}\log\Big(\frac{4n\log_2(T)}{\alpha\wedge\beta}\Big),R ≥ 4(1+ϵ)(T6ωn​​)1/2+T​C​log(α∧β4nlog2​(T)​),

then the grid test with threshold Hα,n,TH_{\alpha,n,T}Hα,n,T​ has α(ψn,T)≤α\alpha(\psi_{n,T})\le\alphaα(ψn,T​)≤α and β(ψn,T,R)≤β\beta(\psi_{n,T},R)\le\betaβ(ψn,T​,R)≤β.

Milestones

  • the signal-plus-noise decomposition ZT(t)=−μTτ(t) Π⊙ΔΘτ+ξ(t)Z_T(t)=-\mu^\tau_T(t)\,\Pi\odot\Delta\Theta^\tau+\xi(t)ZT​(t)=−μTτ​(t)Π⊙ΔΘτ+ξ(t) and the maximum μTτ(τ)=T q(τ/T)\mu^\tau_T(\tau)=\sqrt T\,q(\tau/T)μTτ​(τ)=T​q(τ/T), display (7);
  • the grid facts T⊆DT\mathcal T\subseteq\mathcal D_TT⊆DT​ and ∣T∣≤2log⁡2T|\mathcal T|\le2\log_2T∣T∣≤2log2​T;
  • the grid captures signal: for every τ∈DT\tau\in\mathcal D_Tτ∈DT​ some t∈Tt\in\mathcal Tt∈T has μTτ(t)≥T q(τ/T)/3\mu^\tau_T(t)\ge\sqrt T\,q(\tau/T)/\sqrt3μTτ​(t)≥T​q(τ/T)/3​;
  • Proposition 11, the Bandeira–van Handel bound for symmetric random matrices with independent bounded entries;
  • Lemma 12, the noise bound for the CUSUM at a fixed time;
  • Lemma 5 (level) and Lemma 6 (power above 46(1+ϵ)(ωn/T)1/2+3CϵT(log⁡4nlog⁡2Tα+log⁡2nβ)4\sqrt6(1+\epsilon)(\omega_n/T)^{1/2}+\frac{\sqrt3C_\epsilon}{\sqrt T}(\log\frac{4n\log_2T}\alpha+\log\frac{2n}\beta)46​(1+ϵ)(ωn​/T)1/2+T​3​Cϵ​​(logα4nlog2​T​+logβ2n​)).

Significance

Theorem 3 shows that not knowing the change time costs at most a constant factor and a log⁡log⁡T\log\log TloglogT term in the detection energy. Together with the lower bound of Theorem 2, which is of order (ωn/T)1/2(\omega_n/T)^{1/2}(ωn​/T)1/2, this makes the grid test rate-optimal when ωn\omega_nωn​ grows at least polylogarithmically in nnn (Remark 3 of the paper). The statistic depends on the data only through spectral norms of O(log⁡T)O(\log T)O(logT) CUSUM matrices, so it is cheap to compute. The threshold needs only the degree bound ωn\omega_nωn​, which can be estimated from the observed degrees.

The paper's proof is complete on paper apart from one step noted below. No part of it is machine-checked. Formalizing it produces a checked finite model of Bernoulli network data with missing links, a reusable Matrix CUSUM, and a precise statement of a Bandeira–van Handel type bound for symmetric matrices with independent bounded entries. That bound is a standard tool in random-matrix statistics and is not yet available in Mathlib or on the platform.

Difficulty

The level of the test is a union bound over the grid combined with a high-probability bound on ∥ξ(t)∥2→2\|\xi(t)\|_{2\to2}∥ξ(t)∥2→2​ at a fixed time. The hard part is that bound, Lemma 12. A matrix Bernstein inequality gives a leading term σlog⁡(n/δ)\sigma\sqrt{\log(n/\delta)}σlog(n/δ)​, which is too large. The statement needs the sharp form 22(1+ϵ)σ+Cϵlog⁡(2n/δ)2\sqrt2(1+\epsilon)\sigma+C_\epsilon\log(2n/\delta)22​(1+ϵ)σ+Cϵ​log(2n/δ), where the variance proxy σ\sigmaσ enters without a logarithmic factor. Proposition 11 supplies this only for matrices whose entries are bounded by σ∗\sigma_*σ∗​. The entries of ξ(t)\xi(t)ξ(t) are sums over time and are only bounded by about log⁡(n/δ)\sqrt{\log(n/\delta)}log(n/δ)​ with high probability. The paper applies Proposition 11 "given the event" {∥ξ(t)∥∞≤σ∗}\{\|\xi(t)\|_\infty\le\sigma_*\}{∥ξ(t)∥∞​≤σ∗​}, but conditioning on that event destroys centring and independence, so a truncation argument is missing there.

The power analysis is elementary once Lemma 12 is available. Its one subtlety is that the change time ranges over all of DT\mathcal D_TDT​, while the test inspects only the grid.

Formalization scope

  • Data and probability. Only YYY is modelled; the latent At,ΩtA^t,\Omega^tAt,Ωt are integrated out. An observation is a Boolean function of a 0-based time index and of a pair i<ji<ji<j. Probabilities are finite sums of products of Bernoulli weights, so every test is measurable and no measure theory enters the model. Proposition 11 is the only measure-theoretic statement.
  • Classes. The sampling class carries the paper's standing assumptions Πii=1\Pi_{ii}=1Πii​=1, Πij>0\Pi_{ij}>0Πij​>0. The errors are real suprema of sets of probabilities; an empty alternative has type II error 000.
  • Spectral norm. ∥⋅∥2→2\|\cdot\|_{2\to2}∥⋅∥2→2​ is the published HighDimProb.RandomMatrices.matrixOpNorm.
  • Grid and test. ⌊log⁡2(T/2)⌋\lfloor\log_2(T/2)\rfloor⌊log2​(T/2)⌋ is Nat.log 2 (T / 2). "max⁡t∈T∥ZT(t)∥>H\max_{t\in\mathcal T}\|Z_T(t)\|>Hmaxt∈T​∥ZT​(t)∥>H" is "∃t∈T\exists t\in\mathcal T∃t∈T, ∥ZT(t)∥>H\|Z_T(t)\|>H∥ZT​(t)∥>H". The threshold uses the real log⁡2T\log_2Tlog2​T.
  • Constants. CϵC_\epsilonCϵ​ and CCC are quantified existentially before n,T,ωn,α,β,Rn,T,\omega_n,\alpha,\beta,Rn,T,ωn​,α,β,R. A version with the constants chosen after nnn or TTT would be trivial, because huge constants silence the test or empty the alternative. The goal does not assume Lemma 12's conclusion. Lemmas 5 and 6 take it as a hypothesis, and Lemma 12 states that it is satisfiable. The test ranges over all functions of the data, and the alternative over all τ∈DT\tau\in\mathcal D_Tτ∈DT​.
  • Disclosed additions and corrections. The theorems assume n≥1n\ge1n≥1, T≥2T\ge2T≥2 and ωn≥0\omega_n\ge0ωn​≥0, which the paper leaves implicit. Proposition 11 assumes m≥1m\ge1m≥1 and cϵ>0c_\epsilon>0cϵ​>0. Independence in Proposition 11 and Lemma 12 refers to the entries with i≤ji\le ji≤j (i<ji<ji<j) of a symmetric matrix. The grid statement is the inequality ∣T∣≤2log⁡2T|\mathcal T|\le2\log_2T∣T∣≤2log2​T: the printed equality ∣T∣=2+2⌊log⁡2(T/2)⌋|\mathcal T|=2+2\lfloor\log_2(T/2)\rfloor∣T∣=2+2⌊log2​(T/2)⌋ fails when the two halves overlap, as at T=4T=4T=4. Lemma 5 is stated with "≤α\le\alpha≤α", as its proof concludes, rather than the printed "less than α\alphaα". The grid-signal milestone is stated as an existence claim, because the printed choice τ/2≤t∗<τ\tau/2\le t^*<\tauτ/2≤t∗<τ has no solution at τ=1\tau=1τ=1.

Welcome contributions: a proof of Proposition 11, or of any sharp spectral-norm bound that implies it; a rigorous proof of Lemma 12, repairing the conditioning step; and the elementary grid lemmas.

Selected references

  • F. Enikeeva and O. Klopp, Change-point detection in dynamic networks with missing links, Operations Research, 2025; arXiv:2106.14470v2. https://arxiv.org/abs/2106.14470
  • A. S. Bandeira and R. van Handel, Sharp nonasymptotic bounds on the norm of random matrices with independent entries, Annals of Probability 44(4), 2016. https://doi.org/10.1214/15-AOP1025
  • H. Liu, C. Gao and R. J. Samworth, Minimax rates in sparse, high-dimensional change point detection, Annals of Statistics 49(2), 2021. https://doi.org/10.1214/20-AOS1994
12 thms1 active userReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Opinion Dynamics on Directed Complex Networks 3: On a Galton-Watson Limit, the Stationary Opinion with Memory Has Variance at Most That of the Proportional No-Memory RecursionResearch Paper

Motivation

Linear opinion models describe how individuals in a social network revise their views by averaging what their neighbours think, what external media tell them, and what they themselves believed a moment ago. The last ingredient, an autoregressive or memory term, appears in the Friedkin–Johnsen family of models and in its stochastic variants. Fraiman, Lin and Olvera-Cravioto (arXiv:2209.00969, Mathematics of Operations Research, 2025) study such a model on large directed random graphs with vertex attributes and random media signals. They show that the opinion of a typical vertex has a stationary law that is described, in the large-graph limit, by a recursion on a marked Galton–Watson tree.

A natural question is what the memory term does to that stationary law. Simulations in the paper (Section 5.4, Figures 6–7) suggest that memory smooths individual trajectories and makes the stationary opinion less dispersed. Proposition 6 turns this into a theorem: on a Galton–Watson limit, the stationary opinion with memory has variance at most that of a no-memory recursion that keeps the same relative weights of neighbours and media.

Setting

Nodes of the limiting tree are labelled by finite words i=(i1,…,ik)\mathbf i=(i_1,\dots,i_k)i=(i1​,…,ik​), the root being ∅\varnothing∅; (i,j)(\mathbf i,j)(i,j) is the jjj-th child of i\mathbf ii. Each node carries a mark Xi\mathcal X_{\mathbf i}Xi​, from which the model reads an in-degree Ni\mathcal N_{\mathbf i}Ni​, weights C(i,1),C(i,2),⋯∈[0,1]\mathcal C_{(\mathbf i,1)},\mathcal C_{(\mathbf i,2)},\dots\in[0,1]C(i,1)​,C(i,2)​,⋯∈[0,1] summing to ccc when Ni≥1\mathcal N_{\mathbf i}\ge1Ni​≥1, and an internal opinion Qi∈[−1,1]\mathcal Q_{\mathbf i}\in[-1,1]Qi​∈[−1,1]. Parameters satisfy c∈[0,1)c\in[0,1)c∈[0,1), d∈(0,1]d\in(0,1]d∈(0,1], c+d≤1c+d\le1c+d≤1. The tree is a delayed marked Galton–Watson tree: marks are independent, and all non-root marks have the same law.

Each node receives media signals Zi(k)∈[−1,1]\mathcal Z_{\mathbf i}^{(k)}\in[-1,1]Zi(k)​∈[−1,1], k≥0k\ge0k≥0, conditionally i.i.d. given its mark and conditionally independent across nodes, and the external signal

Wi(k)=d Zi(k)+Qi(c−∑j=1NiC(i,j)).\mathcal W_{\mathbf i}^{(k)}=d\,\mathcal Z_{\mathbf i}^{(k)}+\mathcal Q_{\mathbf i}\Big(c-\sum_{j=1}^{\mathcal N_{\mathbf i}}\mathcal C_{(\mathbf i,j)}\Big).Wi(k)​=dZi(k)​+Qi​(c−j=1∑Ni​​C(i,j)​).

The general recursion (8) and the no-memory recursion (9) are

Mi(k+1)=∑j=1NiC(i,j)M(i,j)(k)+Wi(k)+(1−c−d)Mi(k),Ri(k+1)=∑j=1NiC(i,j)c+dR(i,j)(k)+Wi(k)c+d.\mathcal M_{\mathbf i}^{(k+1)}=\sum_{j=1}^{\mathcal N_{\mathbf i}}\mathcal C_{(\mathbf i,j)}\mathcal M_{(\mathbf i,j)}^{(k)}+\mathcal W_{\mathbf i}^{(k)}+(1-c-d)\mathcal M_{\mathbf i}^{(k)},\qquad \mathcal R_{\mathbf i}^{(k+1)}=\sum_{j=1}^{\mathcal N_{\mathbf i}}\frac{\mathcal C_{(\mathbf i,j)}}{c+d}\mathcal R_{(\mathbf i,j)}^{(k)}+\frac{\mathcal W_{\mathbf i}^{(k)}}{c+d}.Mi(k+1)​=j=1∑Ni​​C(i,j)​M(i,j)(k)​+Wi(k)​+(1−c−d)Mi(k)​,Ri(k+1)​=j=1∑Ni​​c+dC(i,j)​​R(i,j)(k)​+c+dWi(k)​​.

Writing Δ\DeltaΔ for the linear map on the right-hand side without the signal, the limiting root opinion is the series ∑s≥0(ΔsW(s))(∅)\sum_{s\ge0}(\Delta^s\mathcal W^{(s)})(\varnothing)∑s≥0​(ΔsW(s))(∅); it is M∗\mathcal M^*M∗ for (8) and R∗\mathcal R^*R∗ for (9). The moments

ρ1∗=E[∑i=1N∅Ci],ρ1=E[∑i=1N1C(1,i)],ρ2∗=E[∑i=1N∅Ci2],ρ2=E[∑i=1N1C(1,i)2]\rho_1^*=E\Big[\sum_{i=1}^{\mathcal N_\varnothing}\mathcal C_i\Big],\quad \rho_1=E\Big[\sum_{i=1}^{\mathcal N_1}\mathcal C_{(1,i)}\Big],\quad \rho_2^*=E\Big[\sum_{i=1}^{\mathcal N_\varnothing}\mathcal C_i^2\Big],\quad \rho_2=E\Big[\sum_{i=1}^{\mathcal N_1}\mathcal C_{(1,i)}^2\Big]ρ1∗​=E[i=1∑N∅​​Ci​],ρ1​=E[i=1∑N1​​C(1,i)​],ρ2∗​=E[i=1∑N∅​​Ci2​],ρ2​=E[i=1∑N1​​C(1,i)2​]

and the series pm=∑s≥0(s+ms)2(1−c−d)2s(c+d)2(m+1)p_m=\sum_{s\ge0}\binom{s+m}{s}^2(1-c-d)^{2s}(c+d)^{2(m+1)}pm​=∑s≥0​(ss+m​)2(1−c−d)2s(c+d)2(m+1) enter every formula below.

Formalization targets

Goal: Proposition 6

If c,d>0c,d>0c,d>0, c+d<1c+d<1c+d<1 and P(N∅>0)=P(N1>0)=1P(\mathcal N_\varnothing>0)=P(\mathcal N_1>0)=1P(N∅​>0)=P(N1​>0)=1, then

Var(M∗)≤Var(R∗).\mathrm{Var}(\mathcal M^*)\le\mathrm{Var}(\mathcal R^*).Var(M∗)≤Var(R∗).

The goal asserts the comparison only, not the closed forms, so it is the weakest statement the paper's computation supports.

Milestones

  1. Theorem 8 (pp. 32–33): closed forms for EEE and Var\mathrm{Var}Var of the limiting opinions of the root and of a neighbour, in terms of ρ1∗,ρ1,ρ2∗,ρ2\rho_1^*,\rho_1,\rho_2^*,\rho_2ρ1∗​,ρ1​,ρ2∗​,ρ2​, Yi=E[Wi∣Xi]\mathcal Y_{\mathbf i}=E[\mathcal W_{\mathbf i}\mid\mathcal X_{\mathbf i}]Yi​=E[Wi​∣Xi​], Vi=Var(Wi∣Xi)\mathcal V_{\mathbf i}=\mathrm{Var}(\mathcal W_{\mathbf i}\mid\mathcal X_{\mathbf i})Vi​=Var(Wi​∣Xi​) and a Geometric expectation of pTp_TpT​.
  2. Remark 10.2 (pp. 33–34): the specialisation to the Section 5.1 signals with N∅,N1>0\mathcal N_\varnothing,\mathcal N_1>0N∅​,N1​>0 a.s.; it expresses Var(M∗)\mathrm{Var}(\mathcal M^*)Var(M∗) through Var(Z)\mathrm{Var}(\mathcal Z)Var(Z) and E[Var(Z∣X)]E[\mathrm{Var}(\mathcal Z\mid\mathcal X)]E[Var(Z∣X)].
  3. (15) (p. 31): Var(R∗)=d2(c+d)2Var(Z∅)+ρ2∗d2(c+d)2((c+d)2−ρ2)Var(Z1)\mathrm{Var}(\mathcal R^*)=\frac{d^2}{(c+d)^2}\mathrm{Var}(\mathcal Z_\varnothing)+\frac{\rho_2^*d^2}{(c+d)^2((c+d)^2-\rho_2)}\mathrm{Var}(\mathcal Z_1)Var(R∗)=(c+d)2d2​Var(Z∅​)+(c+d)2((c+d)2−ρ2​)ρ2∗​d2​Var(Z1​).
  4. Coefficient bound (pp. 31–32): pm∈(0,1)p_m\in(0,1)pm​∈(0,1) and 11−ρ2E[(c+d)−2(T+2)pT+1]≤1(c+d)2((c+d)2−ρ2)\frac{1}{1-\rho_2}E[(c+d)^{-2(T+2)}p_{T+1}]\le\frac{1}{(c+d)^2((c+d)^2-\rho_2)}1−ρ2​1​E[(c+d)−2(T+2)pT+1​]≤(c+d)2((c+d)2−ρ2​)1​, TTT Geometric with success probability 1−ρ21-\rho_21−ρ2​.

Additional item (not a milestone): Lemma 9 (p. 34), the mean and variance of R(k+1)\mathcal R^{(k+1)}R(k+1) for the general recursion with general signals, started from 000, at the root and at non-root nodes; it is the finite-time step behind Theorem 8.

Significance

The proposition isolates the effect of memory on dispersion: with the same proportional influence of neighbours and media, adding inertia never increases the variance of the stationary opinion of a typical individual. In the paper's interpretation, slower updating produces less polarised stationary opinions, which matters when the model is used to compare network interventions or media exposure. Theorem 8 and Lemma 9 go further and give exact first and second moments of the stationary opinion on Galton–Watson limits with possibly stubborn (in-degree zero) vertices and arbitrary mark-dependent signals; such closed forms are rare for models of this kind.

The results are proved in the paper. None of them has a machine-checked proof. Formalizing them produces a Lean development of moment computations for linear recursions on marked Galton–Watson trees (conditioning on independent subtrees, laws of total variance along generations, and negative-binomial series), which is reusable for other smoothing-transform and branching-recursion problems. Two printed slips are corrected along the way (see Formalization scope).

Difficulty

The difficulty is not the comparison itself but the exact variance of M∗\mathcal M^*M∗. With memory, a signal emitted at time sss by a node at depth lll reaches the root with coefficient (sl)(1−c−d)s−l\binom{s}{l}(1-c-d)^{s-l}(ls​)(1−c−d)s−l times the product of weights along the path, so its contributions spread over all later times. The variance then involves the squared coefficients ∑s(sl)2(1−c−d)2(s−l)\sum_s\binom{s}{l}^2(1-c-d)^{2(s-l)}∑s​(ls​)2(1−c−d)2(s−l), which do not factor as the coefficients do in the no-memory case. The obvious route, comparing the two recursions pathwise or coupling them, fails: the two root opinions are not ordered, and only their variances are. The comparison emerges only after the conditional variances of the media signals are separated from the variance of their conditional means, and after the Geometric average of pT+1p_{T+1}pT+1​ is bounded.

Formalization scope

  • Model. The tree is encoded with Ulam–Harris labels List ℕ (0-based children; the paper's node 111 is [0]), and marks are read through measurable maps N\mathcal NN, C\mathcal CC, Q\mathcal QQ on a measurable space MMM. The media signals are ζ(Xi,Ui(k))\zeta(\mathcal X_{\mathbf i},U_{\mathbf i}^{(k)})ζ(Xi​,Ui(k)​) with i.i.d. uniforms independent of the marks. This quantile representation is equivalent in law to the paper's conditional i.i.d. assumption and is the paper's own device (p. 25). The general signals of Theorem 8 and Lemma 9 are ξ(Xi,Ui(k))\xi(\mathcal X_{\mathbf i},U_{\mathbf i}^{(k)})ξ(Xi​,Ui(k)​) with ∣ξ∣≤d+c−∑jC(i,j)|\xi|\le d+c-\sum_j\mathcal C_{(\mathbf i,j)}∣ξ∣≤d+c−∑j​C(i,j)​.
  • Limit tree, not graph sequence. The paper's statements assume "the assumptions of Theorem 2" with the Galton–Watson tree as local limit. Those assumptions only identify the tree's root opinion with the large-graph typical opinion; every claim here is about the tree. All statements are made on the tree under the Section 5 standing assumptions, which is a generalization.
  • Conventions. Limiting opinions are the absolutely summable series ∑s(ΔsW(s))(i)\sum_s(\Delta^s\mathcal W^{(s)})(\mathbf i)∑s​(ΔsW(s))(i); EEE is the Bochner integral, Var/Cov are Mathlib's variance/covariance, conditional moments are condExp/condVar given σ(Xi)\sigma(\mathcal X_{\mathbf i})σ(Xi​); the Geometric expectation is the explicit series ∑kρk(1−ρ)g(k)\sum_k\rho^k(1-\rho)g(k)∑k​ρk(1−ρ)g(k).
  • Corrections. Remark 10.2's printed mean lacks a factor ddd; the corrected mean is stated. Lemma 9's root variance is stated for k≥1k\ge1k≥1 (it fails at k=0k=0k=0) and its root mean under ρ1>0\rho_1>0ρ1​>0. Equation (15) is Proposition 4 applied to recursion (9) after rescaling.
  • No trivialization. Every random variable involved is bounded, so no variance, integral or series takes a junk value; the denominators c+d−ρ1c+d-\rho_1c+d−ρ1​, (c+d)2−ρ2(c+d)^2-\rho_2(c+d)2−ρ2​, 1−ρ21-\rho_21−ρ2​ are positive under the standing assumptions, and the goal's hypotheses are satisfied by, e.g., the path tree (N≡1\mathcal N\equiv1N≡1, C≡c\mathcal C\equiv cC≡c), where both variances are positive.
  • Infrastructure. Useful contributions include: summability and boundedness of the opinion series; independence of subtrees in Ulam–Harris encodings; the law of total variance (integral_condVar_add_variance_condExp in Mathlib); the identities ∑s(sl)xs−l=(1−x)−(l+1)\sum_s\binom{s}{l}x^{s-l}=(1-x)^{-(l+1)}∑s​(ls​)xs−l=(1−x)−(l+1) and the negative-binomial bound pm<1p_m<1pm​<1.

Selected references

  • N. Fraiman, T.-C. Lin, M. Olvera-Cravioto, Opinion dynamics on directed complex networks, arXiv:2209.00969v2, 2024; Mathematics of Operations Research, 2025. https://arxiv.org/abs/2209.00969
  • N. E. Friedkin, E. C. Johnsen, Social influence and opinions, Journal of Mathematical Sociology 15(3–4), 1990. https://doi.org/10.1080/0022250X.1990.9990069
  • M. H. DeGroot, Reaching a consensus, Journal of the American Statistical Association 69(345), 1974. https://doi.org/10.1080/01621459.1974.10480137
7 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes III: Bipartite, Unit-Patience Side: Rounding Then Probing by Weight Earns ≥ (1 − 1/e)·Σ w_e p_e y_eResearch Paper

Motivation

Stochastic matching with patience models kidney exchange, online dating and labour platforms: every edge of a graph is present only with some probability, the only way to learn whether it is present is to probe it, and a probed edge that turns out to be present must be added to the matching. Each vertex vvv also has a patience tvt_vtv​, a limit on how many of its edges may be probed. The goal is a probing strategy whose expected matched weight is a large fraction of what the best adaptive strategy obtains. Since the best strategy is hard to compute, algorithms are compared with the value of a linear program (LP (3) below), which upper-bounds every probing strategy (Bansal, Gupta, Li, Mestre, Nagarajan, Rudra, Algorithmica 2012).

Bansal et al. gave a 1/31/31/3-approximation for stochastic bipartite matching. Brubach, Grammel, Ma, MacRury and Srinivasan (Mathematics of Operations Research, 2025; arXiv:2106.06892v3) single out the case in which one side of the bipartition has unit patience, tu=1t_u=1tu​=1 for every u∈V1u\in V_1u∈V1​. This case contains "Problem A" of Hikima et al. (AAAI 2021), whose approximation ratio transfers to their integrated two-stage problem ISPCB; Hikima et al. obtained 1/31/31/3 from the bound of Bansal et al. For the special case in which one side has arbitrary patience and the other unlimited patience, Borodin and MacRury had already obtained the same (1−1/e)(1-1/e)(1−1/e) guarantee through an online problem.

Setting

Let G=(V1∪V2,E)G=(V_1\cup V_2,E)G=(V1​∪V2​,E) be a finite bipartite graph; δ(x)\delta(x)δ(x) denotes the set of edges at a vertex xxx. Each edge eee has a weight we≥0w_e\ge 0we​≥0 and an activation probability pe∈[0,1]p_e\in[0,1]pe​∈[0,1], independently across edges. Every u∈V1u\in V_1u∈V1​ has patience 111; every v∈V2v\in V_2v∈V2​ has a patience tv∈N∪{∞}t_v\in\mathbb N\cup\{\infty\}tv​∈N∪{∞}.

LP (3). A vector (ye)e∈E(y_e)_{e\in E}(ye​)e∈E​ is feasible when 0≤ye≤10\le y_e\le 10≤ye​≤1 and, for every vertex xxx,

∑e∈δ(x)yepe≤1,∑e∈δ(x)ye≤tx.\sum_{e\in\delta(x)}y_ep_e\le 1,\qquad \sum_{e\in\delta(x)}y_e\le t_x .e∈δ(x)∑​ye​pe​≤1,e∈δ(x)∑​ye​≤tx​.

Write ze=yepez_e=y_ep_eze​=ye​pe​ and OPT(v)=∑e∈δ(v)weze\mathsf{OPT}(v)=\sum_{e\in\delta(v)}w_ez_eOPT(v)=∑e∈δ(v)​we​ze​.

The algorithm. A dependent rounding (Gandhi, Khuller, Parthasarathy, Srinivasan, J. ACM 2006) turns yyy into a random set E^={e:Ye=1}\hat E=\{e:Y_e=1\}E^={e:Ye​=1} of rounded edges with Pr⁡[Ye=1]=ye\Pr[Y_e=1]=y_ePr[Ye​=1]=ye​, at most one rounded edge at each u∈V1u\in V_1u∈V1​, at most tvt_vtv​ at each v∈V2v\in V_2v∈V2​, and the negative correlation property (2): for v∈V2v\in V_2v∈V2​, S⊆δ(v)S\subseteq\delta(v)S⊆δ(v) and b∈{0,1}b\in\{0,1\}b∈{0,1},

Pr⁡[⋂e∈S(Ye=b)]≤∏e∈SPr⁡[Ye=b].\Pr\Big[\bigcap_{e\in S}(Y_e=b)\Big]\le\prod_{e\in S}\Pr[Y_e=b].Pr[e∈S⋂​(Ye​=b)]≤e∈S∏​Pr[Ye​=b].

In the rounded graph every v∈V2v\in V_2v∈V2​ is the centre of a star. Each vvv probes its rounded edges in decreasing order of weight and is matched to the first active one; W(v)W(v)W(v) is the weight of that edge (000 if none), and E[ALG]=E[∑v∈V2W(v)]\mathbb E[\mathsf{ALG}]=\mathbb E[\sum_{v\in V_2}W(v)]E[ALG]=E[∑v∈V2​​W(v)].

Formalization targets

Goal: Theorem 2 (p. 18)

For every feasible yyy, every rounding with the properties above and every decreasing-weight probing order,

E[ALG] ≥ (1−1e)∑v∈V2∑e∈δ(v)wepeye.\mathbb E[\mathsf{ALG}]\ \ge\ \Big(1-\frac1e\Big)\sum_{v\in V_2}\sum_{e\in\delta(v)}w_ep_ey_e .E[ALG] ≥ (1−e1​)v∈V2​∑​e∈δ(v)∑​we​pe​ye​.

Milestones

  1. The proof of Lemma 7 (p. 17) expresses W(v)W(v)W(v) as E[∑iwiYiPi∏j<i(1−YjPj)]\mathbb E[\sum_i w_iY_iP_i\prod_{j<i}(1-Y_jP_j)]E[∑i​wi​Yi​Pi​∏j<i​(1−Yj​Pj​)] and bounds E[∏j≤i(1−YjPj)]≤∏j≤i(1−yjpj)\mathbb E[\prod_{j\le i}(1-Y_jP_j)]\le\prod_{j\le i}(1-y_jp_j)E[∏j≤i​(1−Yj​Pj​)]≤∏j≤i​(1−yj​pj​) using (2).
  2. Lemma 7 (p. 16): E[W(v)]≥∑i=1kwizi∏j=1i−1(1−zj)\mathbb E[W(v)]\ge\sum_{i=1}^k w_iz_i\prod_{j=1}^{i-1}(1-z_j)E[W(v)]≥∑i=1k​wi​zi​∏j=1i−1​(1−zj​) for the edges of δ(v)\delta(v)δ(v) labelled by decreasing weight.
  3. Eq. (29) (p. 18): the bound F(i)≥1−e−F∗(i)≥(1−1/e)F∗(i)F(i)\ge1-e^{-F^*(i)}\ge(1-1/e)F^*(i)F(i)≥1−e−F∗(i)≥(1−1/e)F∗(i). The summation-by-parts identity (27) on the same page is included as a supporting lemma.
  4. Lemma 8 (p. 17): ∑iwizi∏j<i(1−zj)≥(1−1/e)∑iwizi\sum_i w_iz_i\prod_{j<i}(1-z_j)\ge(1-1/e)\sum_iw_iz_i∑i​wi​zi​∏j<i​(1−zj​)≥(1−1/e)∑i​wi​zi​ when zi∈[0,1]z_i\in[0,1]zi​∈[0,1], ∑izi≤1\sum_iz_i\le1∑i​zi​≤1 and w1≥⋯≥wk≥0w_1\ge\cdots\ge w_k\ge0w1​≥⋯≥wk​≥0.
  5. Lemma 9 (p. 18): E[W(v)]≥(1−1/e) OPT(v)\mathbb E[W(v)]\ge(1-1/e)\,\mathsf{OPT}(v)E[W(v)]≥(1−1/e)OPT(v) for every v∈V2v\in V_2v∈V2​.

The paper's proofs are in §4, pp. 16–19.

Significance

Combined with the LP upper bound (Lemma 1 of the paper, from Bansal et al.), Theorem 2 is a (1−1/e)(1-1/e)(1−1/e)-approximation for stochastic matching on bipartite graphs with a unit-patience side, improving and generalizing the 1/31/31/3 guarantee of Hikima et al. for Problem A and, through their reduction, for ISPCB. By the paper's account (§1.1, p. 4), the guarantee rests on a new ingredient, a (1−1/e)(1-1/e)(1−1/e)-balanced ordered contention resolution scheme for rank-1 matroids under negative correlation, in which the algorithm chooses the order: the per-star bound of Lemmas 7 and 9 holds for every rounding satisfying (2), not only for independent activations.

The result is proved in the paper; none of it has been machine-checked. This mission formalizes the per-star analysis and the theorem for an abstract rounding described by its properties, which is reusable for any algorithm that probes stars after a negatively correlated rounding.

Difficulty

If the rounded indicators YeY_eYe​ at a vertex were independent, Lemma 7 would be an equality and the remaining work would be the deterministic inequality of Lemma 8. They are not: the rounding is dependent, and Example 1 (p. 19) shows that this dependence can raise the probability that a particular edge is blocked to 1/21/21/2, so that no correlation-agnostic contention resolution scheme is better than 1/21/21/2-balanced. A per-edge guarantee, of the kind a contention resolution scheme that ignores correlation provides, is therefore unavailable: the bound of Theorem 2 holds only for the total weight collected at each vvv, and the negative correlation property (2) is one-sided, so it can be used only in the direction in which it holds.

Formalization scope

  • All randomness is finite. The rounding is a probability vector μ\muμ on subsets of EEE; the activeness pattern P:E→{0,1}P:E\to\{0,1\}P:E→{0,1} is independent with product weights. Every expectation is an explicit finite sum.
  • The rounding of Gandhi et al. is represented by its properties: μ≥0\mu\ge0μ≥0, ∑μ=1\sum\mu=1∑μ=1, the marginals Pr⁡[Ye=1]=ye\Pr[Y_e=1]=y_ePr[Ye​=1]=ye​, at most one rounded edge at each u∈V1u\in V_1u∈V1​, at most tvt_vtv​ at each v∈V2v\in V_2v∈V2​, and (2) on the rounded indicators for every v∈V2v\in V_2v∈V2​, S⊆δ(v)S\subseteq\delta(v)S⊆δ(v), b∈{0,1}b\in\{0,1\}b∈{0,1}. The goal holds for every such μ\muμ, so it covers the paper's rounding; formalizing the rounding procedure itself is a separate project.
  • W(v)W(v)W(v) is defined from the run (the first active edge in vvv's probe list), not by the formula of Lemma 7; the identity between the two is a milestone.
  • Standing assumptions, disclosed: we≥0w_e\ge0we​≥0 (with a negative weight the bound fails), pe∈[0,1]p_e\in[0,1]pe​∈[0,1], patience ∞\infty∞ is allowed on V2V_2V2​, and parallel edges are allowed. The goal is stated for every feasible yyy, a stronger statement than the paper's "optimal" yyy, since the proof never uses optimality. The phrase "yielding a (1−1/e)(1-1/e)(1−1/e)-approximation" is not formalized: it needs Lemma 1 of Bansal et al.
  • Ruled out: defining W(v)W(v)W(v) as ∑iwiYiPi∏j<i(1−YjPj)\sum_iw_iY_iP_i\prod_{j<i}(1-Y_jP_j)∑i​wi​Yi​Pi​∏j<i​(1−Yj​Pj​), as the best active edge regardless of the rounding, or stating the goal for one specific (independent) rounding or "for some rounding" would each be a different, weaker theorem.
  • Useful infrastructure: finite expectations over product measures, a negative-correlation inequality for products, Abel summation (Finset.sum_range_by_parts), and 1−x≤e−x1-x\le e^{-x}1−x≤e−x. Proofs of any milestone, and of the theorem from the milestones, are welcome.

Selected references

  • B. Brubach, N. Grammel, W. Ma, C. MacRury, A. Srinivasan, Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes, Mathematics of Operations Research, 2025. arXiv:2106.06892v3. https://arxiv.org/abs/2106.06892
  • R. Gandhi, S. Khuller, S. Parthasarathy, A. Srinivasan, Dependent rounding and its applications to approximation algorithms, Journal of the ACM 53(3):324–360, 2006. https://doi.org/10.1145/1147954.1147956
  • N. Bansal, A. Gupta, J. Li, J. Mestre, V. Nagarajan, A. Rudra, When LP is the cure for your matching woes: improved bounds for stochastic matchings, Algorithmica 63(4):733–762, 2012. https://doi.org/10.1007/s00453-011-9511-8
  • Y. Hikima, Y. Akagi, H. Kim, M. Kohjima, T. Kurashima, H. Toda, Integrated optimization of bipartite matching and its stochastic behavior: new formulation and approximation algorithm via min-cost flow optimization, The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI 2021) (reference [28] of the paper; no link).
  • A. Borodin, C. MacRury, Online bipartite matching in the probe-commit model, Mathematical Programming, 2025, pp. 1–54 (reference [9] of the paper; no link).
10 thms1 active userReviewed
Experimental DesignOperations ResearchStatistics·Captain: mikedeng1

Pigeonhole Design: Balancing Sequential Experiments from an Online Matching Perspective 3: For p ≥ 2 Continuous Covariates, Expected Discrepancy O(T^(1−φ) + T^((p−1)φ)), with (log T)^(3/2) at p = 2Research Paper

Motivation

Online platforms run randomized experiments on subjects (users, sessions, orders) that arrive one at a time and must be assigned to a control or a treatment group on arrival, before later subjects are seen. The precision of a treatment-effect estimate depends on how similar the two groups are in their observed covariates. When the groups are badly balanced, the estimator's variance grows, and a large literature on covariate balancing (blocking, rerandomization, matched pairs) addresses this for offline experiments, where all covariates are known in advance.

J. Zhao and Z. Zhou (arXiv:2201.12936, Management Science, 2025) cast the online problem as an online matching problem. The cost of an assignment is the discrepancy, the weight of a minimum-cost perfect matching between the two groups, and they compare three designs against an oblivious adversary that fixes the covariate sequence in advance:

  • the clairvoyant matched-pair design;
  • the completely randomized design;
  • their online pigeonhole design.

For one continuous covariate the pigeonhole design attains O(T1/4(log⁡T)1/2)O(T^{1/4}(\log T)^{1/2})O(T1/4(logT)1/2) against Θ(T1/2)\Theta(T^{1/2})Θ(T1/2) for complete randomization. This mission concerns the multi-dimensional result, Theorem 9.

Setting

TTT subjects arrive in order; TTT is even. Subject ttt carries a covariate vector xtx_txt​ with qqq discrete coordinates, the iii-th in a finite set Si⊆[0,1]S_i\subseteq[0,1]Si​⊆[0,1] of size mim_imi​, and p≥2p\ge2p≥2 continuous coordinates in [0,1][0,1][0,1]. Distances are Euclidean in Rq+p\mathbb R^{q+p}Rq+p. An assignment puts each subject in control (AAA) or treatment (BBB).

The discrepancy of a split with ∣A∣=∣B∣|A|=|B|∣A∣=∣B∣ is

dA,B=min⁡σ:A→B bijective ∑t∈A∥xt−xσ(t)∥2,d_{A,B}=\min_{\sigma:A\to B\text{ bijective}}\ \sum_{t\in A}\lVert x_t-x_{\sigma(t)}\rVert_2 ,dA,B​=σ:A→B bijectivemin​ t∈A∑​∥xt​−xσ(t)​∥2​,

the value of the assignment problem (1) of the paper.

The completely randomized design picks AAA uniformly among the (TT/2)\binom{T}{T/2}(T/2T​) subsets of size T/2T/2T/2; ALGC(x)\mathrm{ALG}^C(x)ALGC(x) is the mean of dA,Bd_{A,B}dA,B​.

A pigeonhole design fixes a partition of the covariate space into pigeonholes. When subject ttt arrives:

  1. if one group already has T/2T/2T/2 subjects, ttt joins the other group;
  2. otherwise ttt joins the group that has fewer subjects in its own pigeonhole, and on a tie a fair coin decides.

Theorem 9 uses the pigeonholes

P(S)=S1×⋯×Sq×{[0,c1/pT−φ), …, [1−c1/pT−φ,1]}p,\mathcal P(\mathcal S)=S_1\times\cdots\times S_q\times\Big\{[0,c^{1/p}T^{-\varphi}),\ \dots,\ [1-c^{1/p}T^{-\varphi},1]\Big\}^p ,P(S)=S1​×⋯×Sq​×{[0,c1/pT−φ), …, [1−c1/pT−φ,1]}p,

uniform cells of edge c1/pT−φc^{1/p}T^{-\varphi}c1/pT−φ on each continuous axis, for parameters φ∈(0,1)\varphi\in(0,1)φ∈(0,1) and c>1c>1c>1. The expected discrepancy is the mean of dA,Bd_{A,B}dA,B​ over the design's coins.

Formalization targets

Goal: Theorem 9 (p. 26)

There are C>0C>0C>0 and T0T_0T0​, depending only on p,q,S1,…,Sq,φ,cp,q,S_1,\dots,S_q,\varphi,cp,q,S1​,…,Sq​,φ,c, such that for every even T≥T0T\ge T_0T≥T0​ and every admissible arrival sequence,

E[dA,B]≤C(T1−φ+T(p−1)φ λp(T)),λ2(T)=(log⁡T)3/2,λp(T)=1 (p≥3).\mathbb E[d_{A,B}]\le C\Big(T^{1-\varphi}+T^{(p-1)\varphi}\,\lambda_p(T)\Big),\qquad \lambda_2(T)=(\log T)^{3/2},\quad \lambda_p(T)=1\ (p\ge3).E[dA,B​]≤C(T1−φ+T(p−1)φλp​(T)),λ2​(T)=(logT)3/2,λp​(T)=1 (p≥3).

Milestones

  1. Lemma EC.1: Hoeffding for a binomial, Pr⁡(∣H(n)−pn∣≤nlog⁡n)≥1−2/n2\Pr(|H(n)-pn|\le\sqrt{n\log n})\ge1-2/n^2Pr(∣H(n)−pn∣≤nlogn​)≥1−2/n2.
  2. Lemma 5, p=2p=2p=2: if T=m2T=m^2T=m2 and the subjects occupy each cell of the m×mm\times mm×m grid exactly once, then ALGC(x)=O(T1/2log⁡T)\mathrm{ALG}^C(x)=O(T^{1/2}\log T)ALGC(x)=O(T1/2logT).
  3. Lemma 5, p≥3p\ge3p≥3: on the full grid of T=mpT=m^pT=mp cells, ALGC(x)=O(T(p−1)/p)\mathrm{ALG}^C(x)=O(T^{(p-1)/p})ALGC(x)=O(T(p−1)/p).
  4. Balance: every run of a pigeonhole design has ∣A∣=∣B∣=T/2|A|=|B|=T/2∣A∣=∣B∣=T/2.
  5. Component 1: the subjects paired within their pigeonhole before the stopping time τ\tauτ contribute at most 12c1/pp T1−φ\tfrac12c^{1/p}\sqrt p\,T^{1-\varphi}21​c1/pp​T1−φ, on every run.
  6. Unmatched subjects: at most one unmatched subject per pigeonhole, Hτ0+Hτ1H^0_\tau+H^1_\tauHτ0​+Hτ1​ at most the number of pigeonholes, and ∣Hτ0−Hτ1∣=T−τ|H^0_\tau-H^1_\tau|=T-\tau∣Hτ0​−Hτ1​∣=T−τ.
  7. Component 2: the remaining subjects contribute O(T(p−1)φλp(T))O(T^{(p-1)\varphi}\lambda_p(T))O(T(p−1)φλp​(T)) in expectation.

Corollary 2 (the case φ=1/p\varphi=1/pφ=1/p) is an extra theorem after the goal.

Significance

At φ=1/p\varphi=1/pφ=1/p Theorem 9 gives O(T(p−1)/p)O(T^{(p-1)/p})O(T(p−1)/p) for p≥3p\ge3p≥3. This is the order Θ(T(p−1)/p)\Theta(T^{(p-1)/p})Θ(T(p−1)/p) of the matched-pair design (Theorem 7), which sees all covariates in advance. An online design that commits to each assignment on arrival therefore loses at most a constant factor in dimension p≥3p\ge3p≥3, and at most a (log⁡T)3/2(\log T)^{3/2}(logT)3/2 factor at p=2p=2p=2. For the completely randomized design no comparable upper bound is known for general sequences (p. 21). Lemma 5 is the paper's bound for complete randomization on the special family of full grids, and is of independent interest as a random-labelling matching estimate.

The results are proved on paper; none of them has a machine-checked proof, and the platform holds no item on them. A formalization would close the gaps of the printed argument:

  • Lemma 5's induction for p=2p=2p=2 ends at T(log⁡T)3/2\sqrt T(\log T)^{3/2}T​(logT)3/2 rather than the stated Tlog⁡T\sqrt T\log TT​logT.
  • Component 2 applies Lemma 5 to unmatched subjects, which occupy distinct cells but do not fill the grid.
  • The case q≥1q\ge1q≥1 is argued per discrete support, although the balancing rule acts across supports.

Every statement in the mission is believed true.

Difficulty

The matched part (Component 1) is deterministic: paired subjects share a pigeonhole of diameter O(T−φ)O(T^{-\varphi})O(T−φ). The difficulty lies in the subjects left over: the unmatched ones and the subjects after τ\tauτ. Their labels come from coins, but which subjects end up unmatched, and when τ\tauτ occurs, depend on the same coins. So the leftover set is not a fixed set with independent fair labels, and the conditional binomial law used on p. ec22 does not hold literally.

A second obstacle is the random-matching estimate itself. Bounding the expected optimal matching between randomly labelled points of a grid at the rates T1/2log⁡TT^{1/2}\log TT1/2logT (p=2p=2p=2) and T(p−1)/pT^{(p-1)/p}T(p−1)/p (p≥3p\ge3p≥3) is a multi-scale problem of Ajtai–Komlós–Tusnády type. A single-scale count of imbalances per cell gives only T1/2T^{1/2}T1/2 times a power of TTT that is too large.

Formalization scope

  • Subjects are indexed 0,…,T−10,\dots,T-10,…,T−1; an assignment is a map to Bool (false = control). The covariate space is EuclideanSpace ℝ (Fin q ⊕ Fin p). Admissible sequences have discrete coordinates in SiS_iSi​ and continuous ones in [0,1][0,1][0,1], with Si⊆[0,1]S_i\subseteq[0,1]Si​⊆[0,1] (the paper's normalisation).
  • Discrepancy: an infimum over bijections between the groups. An unbalanced split has the junk value 000. The designs, the matched set and its complement are balanced on every run, so the junk is never reached.
  • Cells: the printed edge c1/pT−φc^{1/p}T^{-\varphi}c1/pT−φ gives a partition only when c−1/pTφc^{-1/p}T^{\varphi}c−1/pTφ is an integer. The formalization uses m=⌈c−1/pTφ⌉m=\lceil c^{-1/p}T^{\varphi}\rceilm=⌈c−1/pTφ⌉ cells per axis of edge 1/m≤c1/pT−φ1/m\le c^{1/p}T^{-\varphi}1/m≤c1/pT−φ, with the last cell closed. A pigeonhole is keyed by the exact discrete values and the cell index on each axis. The partition is the printed one, not a quantified family.
  • Randomness: the pigeonhole design uses one coin per subject, consulted only on a tie. Its expected discrepancy is the average over all 2T2^T2T coin vectors, which is exactly the paper's law. The completely randomized design averages over all (TT/2)\binom{T}{T/2}(T/2T​) control sets.
  • Asymptotics: O(f(T))O(f(T))O(f(T)) means ∃C>0,∃T0,∀T≥T0\exists C>0,\exists T_0,\forall T\ge T_0∃C>0,∃T0​,∀T≥T0​ even, ∀x\forall x∀x admissible. CCC and T0T_0T0​ are chosen before TTT and xxx and depend only on the fixed parameters. log⁡\loglog is the natural logarithm.
  • Lemma 5's family X\mathcal XX: T=mpT=m^pT=mp subjects in [0,1]p[0,1]^p[0,1]p, one per cell, stated as injectivity of the cell map.
  • Stopping objects: τ\tauτ is the first nnn at which a group holds T/2T/2T/2 subjects. Within a pigeonhole the subjects before τ\tauτ are paired in arrival order, and the last one is unmatched when their number is odd.
  • Corrections to the page: the second cell printed as [T−φ,2c1/pT−φ)[T^{-\varphi},2c^{1/p}T^{-\varphi})[T−φ,2c1/pT−φ) on p. ec21 is read as [c1/pT−φ,2c1/pT−φ)[c^{1/p}T^{-\varphi},2c^{1/p}T^{-\varphi})[c1/pT−φ,2c1/pT−φ). The family's xt′∉Xx'_t\notin\mathbb Xxt′​∈/X is read as xt′∉Xx_{t'}\notin\mathbb Xxt′​∈/X. The bound H≤1cTpφH\le\frac1cT^{p\varphi}H≤c1​Tpφ becomes H≤(∏imi) mpH\le(\prod_i m_i)\,m^pH≤(∏i​mi​)mp under the ceiling and the discrete supports.

The following formalizations would trivialize the mission and are ruled out:

  • a bound on the discrepancy of one run, or of the best run, instead of the average over all coin vectors;
  • constants that depend on TTT or xxx;
  • an unbalanced design that exploits the junk value 000;
  • an arbitrary partition in place of the printed grid.

A complete development needs a binomial Hoeffding bound and an exact analysis of the design's recursion (balance, alternation within a pigeonhole before τ\tauτ). It also needs a multi-scale bound on random bichromatic matchings of grid points. That bound is reusable for Lemma 5 and for matching estimators generally. Contributions on any milestone are welcome, as are proofs of Lemma 5 for arbitrary subsets of grid points, which is what Component 2 needs.

Selected references

  • J. Zhao and Z. Zhou, Pigeonhole Design: Balancing Sequential Experiments from an Online Matching Perspective, Management Science, 2025; arXiv:2201.12936v6, 2024. https://arxiv.org/abs/2201.12936
  • M. Ajtai, J. Komlós and G. Tusnády, On optimal matchings, Combinatorica 4 (1984) 259–264. https://doi.org/10.1007/BF02579135
  • N. Fournier and A. Guillin, On the rate of convergence in Wasserstein distance of the empirical measure, Probability Theory and Related Fields 162 (2015) 707–738. https://doi.org/10.1007/s00440-014-0583-7
  • W. Hoeffding, Probability inequalities for sums of bounded random variables, Journal of the American Statistical Association 58 (1963) 13–30. https://doi.org/10.1080/01621459.1963.10500830
12 thms1 active userReviewed
AnalysisOperations ResearchStatistics·Captain: mikedeng1

Scores for Multivariate Distributions and Level Sets II: The Level Set Score (S′)^Γ Is Consistent for the α Level Set {f_Y ∗ w ≥ α}Research Paper

Motivation

A forecaster who issues a probability distribution for a multivariate quantity, such as the joint demand at several locations or the joint returns of several assets, is often judged not on the whole distribution but on a region it implies: the set of outcomes whose cumulative probability, or smoothed density, exceeds a threshold. Such level sets are the multivariate counterpart of quantiles, and they are used as risk regions and as summaries of joint distributions in management science (Abbas, Budescu and Gu 2010) and in density level set estimation (Cadre 2006). To compare competing level set forecasts against realized data, one needs a consistent scoring function: a loss l(A,y)l(A, y)l(A,y) of a candidate set AAA and an outcome yyy whose expectation under the true distribution is smallest at the true level set. For univariate quantiles the answer is classical (the quantile or pinball loss, Gneiting 2011); for general multivariate level sets, the paper notes, scores had not been studied beyond density level sets and univariate quantiles.

Meng, Taylor, Ben Taieb and Li (Operations Research, 2025) obtain such scores by decomposing their L2L^2L2 scoring rule for multivariate distributions into an integral, over the threshold α\alphaα, of scores for the level sets of a smoothed density. This mission formalizes that construction: Theorem 2 of the paper.

Setting

Write Rd\mathbb R^dRd for ddd-dimensional space with Lebesgue measure Ld\mathcal L^dLd and the componentwise order (z≥yz \ge yz≥y means zj≥yjz_j \ge y_jzj​≥yj​ for all jjj). The unknown distribution of the observation YYY is a probability measure PYP_YPY​ on Rd\mathbb R^dRd; the paper writes fYf_YfY​ for its generalized density. Fix a kernel w:Rd→Rw : \mathbb R^d \to \mathbb Rw:Rd→R and a nonnegative integrable weight hhh. The smoothed density is the convolution

(fY∗w)(z)=∫Rdw(z−s) dPY(s).(f_Y * w)(z) = \int_{\mathbb R^d} w(z - s)\, dP_Y(s).(fY​∗w)(z)=∫Rd​w(z−s)dPY​(s).

For w=u=1{⋅≥0}w = u = \mathbb 1\{\cdot \ge 0\}w=u=1{⋅≥0} (the Heaviside function) it is the multivariate CDF FY(z)=PY{s≤z}F_Y(z) = P_Y\{s \le z\}FY​(z)=PY​{s≤z}.

The α\alphaα level set of a function ggg is (display (9), p. 12)

L(g;α)={z∈Rd:g(z)≥α}.L(g;\alpha) = \{ z \in \mathbb R^d : g(z) \ge \alpha \}.L(g;α)={z∈Rd:g(z)≥α}.

A function l(A,y)l(A, y)l(A,y) of a Borel set A⊆RdA \subseteq \mathbb R^dA⊆Rd and a realization yyy is a consistent scoring function for L(fY∗w;α)L(f_Y * w; \alpha)L(fY​∗w;α) if EPY[l(A,∙)]\mathbb E_{P_Y}[l(A, \bullet)]EPY​​[l(A,∙)] is minimized at A=L(fY∗w;α)A = L(f_Y * w;\alpha)A=L(fY​∗w;α), and strictly consistent if that set is the only minimizer (p. 12). The level set score is (display (11), p. 13)

(S′)Γ(A,y;w,h,α)=∫Rd(α−w(z−y)) 1{z∈A} h(z) dz,(S')^\Gamma(A, y; w, h, \alpha) = \int_{\mathbb R^d} \bigl(\alpha - w(z - y)\bigr)\, \mathbb 1\{z \in A\}\, h(z)\, dz,(S′)Γ(A,y;w,h,α)=∫Rd​(α−w(z−y))1{z∈A}h(z)dz,

and the L2L^2L2 scoring rule of the paper is (display (3), p. 8)

S′(PX,y;w,h)=∫Rd(fX∗w)2(z) h(z) dz−2∫Rd(fX∗w)(z) w(z−y) h(z) dz.S'(P_X, y; w, h) = \int_{\mathbb R^d} (f_X * w)^2(z)\, h(z)\, dz - 2 \int_{\mathbb R^d} (f_X * w)(z)\, w(z - y)\, h(z)\, dz.S′(PX​,y;w,h)=∫Rd​(fX​∗w)2(z)h(z)dz−2∫Rd​(fX​∗w)(z)w(z−y)h(z)dz.

In Lean these are smooth, levelSet, scoreΓ, S', cdf and heaviside in the definition item MultivarScores.LevelSet.Setting.

Formalization targets

The paper's Theorem 2 (p. 13) reads:

Let Vd\mathcal V^dVd, hhh, and www satisfy Assumption 1 in the appendix, and www is nonnegative. Let α>0\alpha > 0α>0, and let A⊆RdA \subseteq \mathbb R^dA⊆Rd be an arbitrary Borel set. Suppose (S′)Γ(A,∙;w,h,α)(S')^\Gamma(A, \bullet; w, h, \alpha)(S′)Γ(A,∙;w,h,α) is finite Ld\mathcal L^dLd-a.e. and (S′)Γ(A,∙;w,h,α)fY(∙)(S')^\Gamma(A, \bullet; w, h, \alpha) f_Y(\bullet)(S′)Γ(A,∙;w,h,α)fY​(∙) is integrable. Then the following expression defines a consistent scoring function for the α\alphaα level set L(fY∗w;α)L(f_Y * w; \alpha)L(fY​∗w;α): (S′)Γ(A,y;w,h,α)=∫Rd(α−w(z−y)) 1{z∈A} h(z) dz(S')^\Gamma(A, y; w, h, \alpha) = \int_{\mathbb R^d} (\alpha - w(z - y))\, \mathbb 1\{z \in A\}\, h(z)\, dz(S′)Γ(A,y;w,h,α)=∫Rd​(α−w(z−y))1{z∈A}h(z)dz. (11) If hhh is nonzero Ld\mathcal L^dLd-a.e. and L(fY∗w;α)L(f_Y * w; \alpha)L(fY​∗w;α) equals the closure of {fY∗w>α}\{f_Y * w > \alpha\}{fY​∗w>α}, it is strictly consistent. Moreover, with A=L(fX∗w;α)A = L(f_X * w; \alpha)A=L(fX​∗w;α), the integral of (11) with respect to α\alphaα is precisely half of the L2L^2L2 score in (3), i.e., 12S′(PX,y;w,h)=∫0∞(S′)Γ(L(fX∗w;α),y;w,h,α) dα\tfrac12 S'(P_X, y; w, h) = \int_0^\infty (S')^\Gamma(L(f_X * w; \alpha), y; w, h, \alpha)\, d\alpha21​S′(PX​,y;w,h)=∫0∞​(S′)Γ(L(fX​∗w;α),y;w,h,α)dα.

Goal: consistency

For every Borel AAA and every α>0\alpha > 0α>0,

EPY[(S′)Γ(L(fY∗w;α),∙;w,h,α)]≤EPY[(S′)Γ(A,∙;w,h,α)].\mathbb E_{P_Y}\bigl[(S')^\Gamma(L(f_Y * w;\alpha), \bullet; w, h, \alpha)\bigr] \le \mathbb E_{P_Y}\bigl[(S')^\Gamma(A, \bullet; w, h, \alpha)\bigr].EPY​​[(S′)Γ(L(fY​∗w;α),∙;w,h,α)]≤EPY​​[(S′)Γ(A,∙;w,h,α)].

This is the part of Theorem 2 that holds exactly as printed, and it is the goal.

Strict consistency (milestone)

If moreover h≠0h \ne 0h=0 a.e., Ld{fY∗w=α}=0\mathcal L^d\{f_Y * w = \alpha\} = 0Ld{fY​∗w=α}=0, and Ld(A △ L(fY∗w;α))≠0\mathcal L^d(A \,\triangle\, L(f_Y * w;\alpha)) \ne 0Ld(A△L(fY​∗w;α))=0, the inequality is strict. The null-set condition replaces the printed closure condition (see Formalization scope).

Layer-cake decomposition (milestone)

12S′(PX,y;w,h)=∫0∞(S′)Γ(L(fX∗w;α),y;w,h,α) dα.\tfrac12 S'(P_X, y; w, h) = \int_0^\infty (S')^\Gamma\bigl(L(f_X * w;\alpha), y; w, h, \alpha\bigr)\, d\alpha.21​S′(PX​,y;w,h)=∫0∞​(S′)Γ(L(fX​∗w;α),y;w,h,α)dα.

The other milestones are the steps of the paper's proof (pp. 33–34): the per-realization difference Δ′′\Delta''Δ′′ (p. 33), the expected difference (19) (p. 34), and two companions: the CDF level set score (13) is consistent for L(FY;α)L(F_Y;\alpha)L(FY​;α) (p. 16), and in dimension one it equals the quantile score up to a term depending only on yyy (Remark 2, p. 17).

Significance

Theorem 2 supplies consistent scoring functions for a whole family of multivariate level sets at once, one for each kernel www: CDF level sets (from w=uw = uw=u), density level sets (from w=δ0w = \delta_0w=δ0​) and lower-partial-moment level sets. It thereby gives a way to rank and compare multivariate region forecasts, and in one dimension recovers the full class of quantile scores (Remark 2). The layer-cake identity explains the relation between a distribution score and its level set scores, generalizing the classical identity CRPS=2∫01(quantile score) dα\mathrm{CRPS} = 2\int_0^1(\text{quantile score})\,d\alphaCRPS=2∫01​(quantile score)dα (display (10)); the paper relates its CDF level set score to the Vorob'ev quantile scores of Fissler, Frongillo, Hlavinová and Rudloff (2021).

The result is proved in the paper's appendix (pp. 33–34). It has no machine-checked proof that this mission is aware of. Formalizing it fixes the exact integrability conditions under which the expectations exist (the paper states them loosely in Assumption 1), and it repairs the strict consistency clause, whose printed sufficient condition does not imply what the proof uses.

Difficulty

The core of consistency is a sign argument, but every quantity in it is an integral over Rd\mathbb R^dRd against hhh or against PYP_YPY​, and none of them is a priori finite: www need not be bounded or integrable, and (S′)Γ(A,y)(S')^\Gamma(A, y)(S′)Γ(A,y) must be integrable in yyy for the true level set as well as for the candidate AAA, although the paper assumes it only for AAA. Exchanging the yyy- and zzz-integrals therefore needs a product-integrability condition, not pointwise finiteness. The layer-cake milestone requires the layer cake formula for two different measures (h dzh\,dzhdz and w(z−y)h(z) dzw(z-y)h(z)\,dzw(z−y)h(z)dz), with powers 222 and 111, followed by an exchange that keeps the sign of the second term; a nonnegative (lower) integral cannot express the difference. The strict clause needs a measure-theoretic condition on the boundary {fY∗w=α}\{f_Y * w = \alpha\}{fY​∗w=α}; a topological condition on closures, as printed, is not enough.

Formalization scope

  • Rd\mathbb R^dRd is Fin d → ℝ with volume and the Pi order; ddd is any natural number. A distribution is a probability measure P : Measure (E d); every integral is a Bochner integral.
  • The kernel www is a measurable function. The paper allows a local Borel measure, so that w=δ0w = \delta_0w=δ0​ gives the density level set score (12); that case is not formalized.
  • Standing assumptions. w≥0w \ge 0w≥0 and α>0\alpha > 0α>0 (Theorem 2), h≥0h \ge 0h≥0 measurable and integrable (Assumption 1(a)), AAA Borel.
  • Integrability. Assumption 1 and Theorem 2's "(S′)Γ(A,∙)(S')^\Gamma(A,\bullet)(S′)Γ(A,∙) finite a.e. and (S′)Γ(A,∙)fY(S')^\Gamma(A,\bullet)f_Y(S′)Γ(A,∙)fY​ integrable" are pinned down as the single hypothesis that (s,z)↦w(z−s)h(z)(s, z) \mapsto w(z - s)h(z)(s,z)↦w(z−s)h(z) is integrable for PY⊗LdP_Y \otimes \mathcal L^dPY​⊗Ld. With w,h≥0w, h \ge 0w,h≥0 it covers every Borel set at once, including L(fY∗w;α)L(f_Y * w;\alpha)L(fY​∗w;α). The layer-cake milestone uses Assumption 1(b)/(c) for the given yyy and the almost-everywhere integrability of w(z−⋅)w(z - \cdot)w(z−⋅) under PXP_XPX​.
  • No class Vd\mathcal V^dVd. The consistency statement is pointwise in PYP_YPY​; its convexity is never used.
  • Strict consistency is stated under Ld{fY∗w=α}=0\mathcal L^d\{f_Y * w = \alpha\} = 0Ld{fY​∗w=α}=0 and h≠0h \ne 0h=0 a.e., and "only minimizer" is read modulo Ld\mathcal L^dLd-null sets. The printed condition "L(fY∗w;α)L(f_Y * w;\alpha)L(fY​∗w;α) equals the closure of {fY∗w>α}\{f_Y * w > \alpha\}{fY​∗w>α}" does not imply the null-set property the proof uses: for d=1d = 1d=1, PY=δ0P_Y = \delta_0PY​=δ0​, w=α+dist(⋅,C)w = \alpha + \mathrm{dist}(\cdot, C)w=α+dist(⋅,C) with CCC a fat Cantor set, the closure condition holds but R∖C\mathbb R \setminus CR∖C scores as well as LLL.
  • Level sets use ≥\ge≥, as in (9). The proof's partition by {fY∗w>α}\{f_Y * w > \alpha\}{fY​∗w>α} is a printed slip; the milestones use A∖LA \setminus LA∖L and L∖AL \setminus AL∖A.
  • Ruled out. Because a Bochner integral of a non-integrable function is 000, dropping the integrability hypotheses, letting AAA range over non-measurable sets, or fixing particular www or hhh would trivialize or change the statements; none of these is done.
  • Infrastructure: Mathlib's layer cake (MeasureTheory.lintegral_comp_eq_lintegral_meas_le_mul and relatives in Mathlib/MeasureTheory/Integral/Layercake.lean) and Fubini–Tonelli (integral_prod). A reusable lemma for ∫ ⁣ ⁣∫g(z)w(z−s)h(z) dz dP(s)=∫g(z)(fP∗w)(z)h(z) dz\int\!\!\int g(z) w(z - s) h(z)\,dz\,dP(s) = \int g(z)(f_P * w)(z)h(z)\,dz∫∫g(z)w(z−s)h(z)dzdP(s)=∫g(z)(fP​∗w)(z)h(z)dz is welcome; it also serves the companion mission on the L2L^2L2 scoring rules.

Selected references

  • X. Meng, J. W. Taylor, S. Ben Taieb, S. Li, Scores for Multivariate Distributions and Level Sets, Operations Research, 2025; preprint arXiv:2002.09578v6, 2023. https://arxiv.org/abs/2002.09578
  • T. Gneiting, A. E. Raftery, Strictly Proper Scoring Rules, Prediction, and Estimation, Journal of the American Statistical Association 102(477), 359–378, 2007. https://doi.org/10.1198/016214506000001437
  • T. Gneiting, Making and Evaluating Point Forecasts, Journal of the American Statistical Association 106(494), 746–762, 2011. https://doi.org/10.1198/jasa.2011.r10138
  • T. Fissler, R. Frongillo, J. Hlavinová, B. Rudloff, Forecast Evaluation of Quantiles, Prediction Intervals, and Other Set-Valued Functionals, Electronic Journal of Statistics 15(1), 1034–1084, 2021. https://doi.org/10.1214/21-EJS1808
  • A. E. Abbas, D. V. Budescu, Y. Gu, Assessing Joint Distributions with Isoprobability Contours, Management Science 56(6), 997–1011, 2010. https://doi.org/10.1287/mnsc.1100.1157
  • E. H. Lieb, M. Loss, Analysis, 2nd ed., Graduate Studies in Mathematics 14, AMS, 2001. https://doi.org/10.1090/gsm/014
9 thms1 active userReviewed
Actuarial ScienceOperations Research·Captain: mikedeng1

Lambda Value-at-Risk under Ambiguity and Risk Sharing III: Comonotonic Risk Sharing of Nonnegative ΛVaRs under Continuous Capacities Gives All the Risk to the Agent with the Smallest ΛVaRResearch Paper

Motivation

Quantile-based risk measures are the regulatory standard in banking and insurance, and Lambda Value-at-Risk (ΛVaR), introduced by Frittelli, Maggis and Peri (2014), generalises Value-at-Risk by letting the confidence level vary with the loss: large losses can be judged at a stricter level than small ones. When several agents (desks of a bank, members of a reinsurance pool, insurer and reinsurer) share one aggregate risk, each measuring their part with their own ΛVaR, the natural question is how the risk should be split to minimise the total measured risk. This is the risk-sharing problem, studied for VaR and Expected Shortfall by Embrechts, Liu and Wang (2018) and for ΛVaR under a common probability by Xia and Hu (2025).

Liu and Schied (2025) treat the same question when the agents disagree about, or are uncertain of, the probability model. Each agent's beliefs are encoded by a capacity, a monotone set function that need not be additive, which covers worst-case and best-case evaluations over a set of probability measures. This mission concerns their Section 6, where allocations are required to be comonotonic: every agent's share increases with the aggregate loss. Comonotonic sharing rules out arrangements in which one agent gains when another loses.

Timeline of the relevant results:

  • 2014: Frittelli, Maggis and Peri define ΛVaR.
  • 2018: Embrechts, Liu and Wang solve risk sharing for VaR and ES under a common probability.
  • 2022: Liu, Mao, Wang and Wei (Theorem 6) find that, for VaR with Wasserstein-ball ambiguity, the optimal comonotonic allocation gives all the risk to one agent.
  • 2025: Xia and Hu treat comonotonic risk sharing of ΛVaR under a single probability P\mathbb PP (their Theorem 11).
  • 2025: Liu and Schied extend it to heterogeneous capacities (Theorem 4, the goal of this mission).

Setting

Let (Ω,F)(\Omega,\mathcal F)(Ω,F) be a measurable space and X\mathcal XX a set of real random variables containing all bounded ones (the paper's examples are the bounded random variables and all random variables). A capacity is a set function w:F→[0,1]w:\mathcal F\to[0,1]w:F→[0,1] that is increasing, with w(∅)=0w(\emptyset)=0w(∅)=0 and w(Ω)=1w(\Omega)=1w(Ω)=1. It is continuous if w(An)→0w(A_n)\to0w(An​)→0 whenever An↓∅A_n\downarrow\emptysetAn​↓∅. It is atomless if some bounded random variable YYY makes x↦w(Y>x)x\mapsto w(Y>x)x↦w(Y>x) continuous. A probability measure is a continuous capacity.

Let HI\mathcal H_IHI​ be the set of increasing functions Λ:R→(0,1)\Lambda:\mathbb R\to(0,1)Λ:R→(0,1). For Λ∈HI\Lambda\in\mathcal H_IΛ∈HI​ and a capacity www,

ΛVaRw(X)=inf⁡{x∈R:w(X>x)≤Λ(x)}∈[−∞,∞],inf⁡∅=∞.\Lambda\mathrm{VaR}^w(X)=\inf\{x\in\mathbb R: w(X>x)\le\Lambda(x)\}\in[-\infty,\infty],\qquad\inf\emptyset=\infty .ΛVaRw(X)=inf{x∈R:w(X>x)≤Λ(x)}∈[−∞,∞],inf∅=∞.

For constant Λ≡p\Lambda\equiv pΛ≡p this is the Choquet quantile VaRpw\mathrm{VaR}^w_pVaRpw​.

There are n≥1n\ge1n≥1 agents. An allocation of XXX is (X1,…,Xn)∈Xn(X_1,\dots,X_n)\in\mathcal X^n(X1​,…,Xn​)∈Xn with X1+⋯+Xn=XX_1+\dots+X_n=XX1​+⋯+Xn​=X. It is comonotonic if there are increasing f1,…,fnf_1,\dots,f_nf1​,…,fn​ with Xi=fi(X1+⋯+Xn)X_i=f_i(X_1+\dots+X_n)Xi​=fi​(X1​+⋯+Xn​), and its components have the same sign if no two of them take strictly opposite signs in any state. Write An+(X)\mathbb A_n^+(X)An+​(X) for these allocations and

⊞i=1nρi(X)=inf⁡{∑i=1nρi(Xi):(X1,…,Xn)∈An+(X)}\boxplus_{i=1}^n\rho_i(X)=\inf\Big\{\sum_{i=1}^n\rho_i(X_i):(X_1,\dots,X_n)\in\mathbb A_n^+(X)\Big\}⊞i=1n​ρi​(X)=inf{i=1∑n​ρi​(Xi​):(X1​,…,Xn​)∈An+​(X)}

for the comonotonic inf-convolution. A minimiser is an optimal allocation.

Formalization targets

Goal: Theorem 4

Let Λi∈HI\Lambda_i\in\mathcal H_IΛi​∈HI​ and let w1,…,wnw_1,\dots,w_nw1​,…,wn​ be continuous capacities.

  1. If ΛiVaRwi(X)≥0\Lambda_i\mathrm{VaR}^{w_i}(X)\ge0Λi​VaRwi​(X)≥0 for all iii, then
⊞i=1nΛiVaRwi(X)=min⁡i∈[n]ΛiVaRwi(X),(11)\boxplus_{i=1}^n\Lambda_i\mathrm{VaR}^{w_i}(X)=\min_{i\in[n]}\Lambda_i\mathrm{VaR}^{w_i}(X),\tag{11}⊞i=1n​Λi​VaRwi​(X)=i∈[n]min​Λi​VaRwi​(X),(11)

and Xi0=XX_{i_0}=XXi0​​=X, Xi=0X_i=0Xi​=0 (i≠i0i\ne i_0i=i0​) is optimal for every i0∈arg⁡min⁡iΛiVaRwi(X)i_0\in\arg\min_i\Lambda_i\mathrm{VaR}^{w_i}(X)i0​∈argmini​Λi​VaRwi​(X). 2. If every Λi\Lambda_iΛi​ is constant on (−∞,0)(-\infty,0)(−∞,0), then (11) holds for all X∈XX\in\mathcal XX∈X. 3. If n≥2n\ge2n≥2, the capacities are equal and atomless and the Λi\Lambda_iΛi​ are equal, then (11) holds for all X∈XX\in\mathcal XX∈X if and only if Λ1\Lambda_1Λ1​ is constant on (−∞,0)(-\infty,0)(−∞,0).

All three parts are posed as one theorem.

Milestones (proof of Theorem 4, Appendix D)

  • Reduction to splits (p. 39): ⊞iΛiVaRwi(X)=inf⁡{∑iΛiVaRwi(fi(X)):(fi)∈Fn}\boxplus_i\Lambda_i\mathrm{VaR}^{w_i}(X)=\inf\{\sum_i\Lambda_i\mathrm{VaR}^{w_i}(f_i(X)):(f_i)\in\mathbb F_n\}⊞i​Λi​VaRwi​(X)=inf{∑i​Λi​VaRwi​(fi​(X)):(fi​)∈Fn​}, where Fn\mathbb F_nFn​ is the set of increasing continuous f1,…,fnf_1,\dots,f_nf1​,…,fn​ with fi(0)=0f_i(0)=0fi​(0)=0 and ∑ifi=id\sum_if_i=\mathrm{id}∑i​fi​=id.
  • Change of variables (p. 39): ΛiVaRwi(fi(X))=fi((Λi∘fi)VaRwi(X))\Lambda_i\mathrm{VaR}^{w_i}(f_i(X))=f_i\big((\Lambda_i\circ f_i)\mathrm{VaR}^{w_i}(X)\big)Λi​VaRwi​(fi​(X))=fi​((Λi​∘fi​)VaRwi​(X)).
  • (14) (p. 40): fi((Λi∘fi)VaRwi(X))≥fi(ΛiVaRwi(X))f_i\big((\Lambda_i\circ f_i)\mathrm{VaR}^{w_i}(X)\big)\ge f_i\big(\Lambda_i\mathrm{VaR}^{w_i}(X)\big)fi​((Λi​∘fi​)VaRwi​(X))≥fi​(Λi​VaRwi​(X)) when ΛiVaRwi(X)≥0\Lambda_i\mathrm{VaR}^{w_i}(X)\ge0Λi​VaRwi​(X)≥0, and for every XXX when Λi\Lambda_iΛi​ is constant on (−∞,0)(-\infty,0)(−∞,0).
  • (15) (p. 40): ∑iΛiVaRwi(fi(X))≥∑ifi(ΛiVaRwi(X))≥min⁡iΛiVaRwi(X)\sum_i\Lambda_i\mathrm{VaR}^{w_i}(f_i(X))\ge\sum_if_i(\Lambda_i\mathrm{VaR}^{w_i}(X))\ge\min_i\Lambda_i\mathrm{VaR}^{w_i}(X)∑i​Λi​VaRwi​(fi​(X))≥∑i​fi​(Λi​VaRwi​(X))≥mini​Λi​VaRwi​(X) when every ΛiVaRwi(X)≥0\Lambda_i\mathrm{VaR}^{w_i}(X)\ge0Λi​VaRwi​(X)≥0, and for every XXX when every Λi\Lambda_iΛi​ is constant on (−∞,0)(-\infty,0)(−∞,0).

Significance

Theorem 4 says that, among comonotonic arrangements, nothing beats handing the whole risk to the agent with the smallest ΛVaR, for any heterogeneous beliefs given by continuous capacities. It extends the single-probability result of Xia and Hu (2025, Theorem 11). The characterisation in part 3 marks the boundary of that conclusion: for risks with negative ΛVaR the one-agent arrangement remains optimal exactly when the confidence level does not vary on the negative half-line. For applications this separates the reinsurance-style problems, where losses are nonnegative and the answer is extreme, from the general case, where it is not.

The result is proved in the preprint and has no machine-checked counterpart. A formal development provides a first Lean treatment of ΛVaR under non-additive set functions and of comonotonic allocations defined through increasing functions of the aggregate, and checks a proof whose printed version has a gap (see Difficulty). The definitions are reusable by the companion missions on the same paper (robust ΛVaR, inf-convolution of ΛVaRs).

Difficulty

The upper bound in (11) is immediate from the one-agent allocation. The lower bound needs the reduction of comonotonic same-sign allocations to splits of the identity, which uses that a family of increasing functions summing to the identity on the range of XXX extends to continuous, 111-Lipschitz functions on R\mathbb RR vanishing at 000. ΛVaR does not commute with fif_ifi​, so the second step is a change of variables that moves fif_ifi​ into the level function. The comparison (Λi∘fi)VaR≥ΛiVaR(\Lambda_i\circ f_i)\mathrm{VaR}\ge\Lambda_i\mathrm{VaR}(Λi​∘fi​)VaR≥Λi​VaR then holds only where Λi∘fi≤Λi\Lambda_i\circ f_i\le\Lambda_iΛi​∘fi​≤Λi​, which depends on the sign of the argument.

For part 2 the printed proof asserts Λi∘fi≤Λi\Lambda_i\circ f_i\le\Lambda_iΛi​∘fi​≤Λi​ whenever Λi\Lambda_iΛi​ is constant on (−∞,0)(-\infty,0)(−∞,0). That fails when Λi\Lambda_iΛi​ jumps at 000 and fif_ifi​ vanishes on part of the negative half-line, so the printed step does not prove the claim. The claim itself survives, and a correct argument must handle that case separately. Part 3 needs an explicit risk built from an atomless capacity at which the inf-convolution falls strictly below the minimum, and capacities are not additive, so the usual distributional constructions are unavailable.

Formalization scope

Lean namespace LambdaVaRAmb.Comono; one definition file and six theorem files. Conventions:

  • Capacities are Set Ω → ℝ with the axioms imposed on measurable sets. ΛVaR, the inf-convolution, sums and minima live in EReal, so inf⁡∅=+∞\inf\emptyset=+\inftyinf∅=+∞ and an unbounded-below set gives −∞-\infty−∞, as in the paper. "Increasing" is Monotone. Agents are Fin n with n≥1n\ge1n≥1, and sums of random variables are pointwise.
  • X\mathcal XX is any set of real functions whose members are measurable, which contains every bounded measurable function, and which is closed under (X−c)1A+d(X-c)\mathbb 1_A+d(X−c)1A​+d and under f(X)f(X)f(X) for increasing 111-Lipschitz fff with f(0)=0f(0)=0f(0)=0. Both of the paper's examples qualify.
  • "sign(Xi)(X_i)(Xi​) are the same" is read as XiXj≥0X_iX_j\ge0Xi​Xj​≥0 pointwise. The literal reading with sign(0)=+1(0)=+1(0)=+1 would make Theorem 4's own optimal allocation inadmissible whenever XXX takes a negative value.
  • Part 3 carries n≥2n\ge2n≥2: for n=1n=1n=1 equation (11) holds for every XXX, and the "necessary" direction fails. "w1=⋯=wnw_1=\dots=w_nw1​=⋯=wn​" is equality on measurable sets.
  • In the milestones, fif_ifi​ at ±∞\pm\infty±∞ means its monotone limit, which is how the page's fi((Λi∘fi)VaRwi(X))f_i\big((\Lambda_i\circ f_i)\mathrm{VaR}^{w_i}(X)\big)fi​((Λi​∘fi​)VaRwi​(X)) is read when that value is infinite.
  • The (14)-and-(15)-for-all-XXX milestone poses only the printed conclusion, not the false intermediate step.

Trivialising encodings are excluded. Infima are taken in EReal, never as a real sInf that collapses to 000. No sum in the statements can meet ⊤+⊥\top+\bot⊤+⊥. The admissible set X\mathcal XX is constrained rather than arbitrary. The hypotheses are satisfiable, since a probability measure is a continuous capacity and constant levels lie in HI\mathcal H_IHI​.

Welcome contributions include the reduction to Fn\mathbb F_nFn​ (a reusable fact about comonotonic decompositions), the ΛVaR change-of-variables identity, and the atomless-capacity construction of part 3.

Selected references

  • P. Liu and A. Schied, Lambda Value-at-Risk under ambiguity and risk sharing, arXiv preprint, 2025. https://arxiv.org/abs/2511.00717
  • M. Frittelli, M. Maggis and I. Peri, Risk measures on 𝒫(ℝ) and Value at Risk with probability/loss function, Mathematical Finance 24(3), 2014. https://doi.org/10.1111/mafi.12004
  • P. Embrechts, H. Liu and R. Wang, Quantile-based risk sharing, Operations Research 66(4), 2018. https://doi.org/10.1287/opre.2017.1716
  • F. Liu, T. Mao, R. Wang and L. Wei, Inf-convolution, optimal allocations, and model uncertainty for tail risk measures, Mathematics of Operations Research 47(3), 2022, pp. 2494–2519.
  • Z. Xia and T. Hu, Optimal risk sharing for lambda value-at-risk, Advances in Applied Probability 57, 2025, pp. 171–203.
  • D. Denneberg, Non-Additive Measure and Integral, Kluwer, 1994. https://doi.org/10.1007/978-94-017-2434-0
9 thms1 active userReviewed
Markov ChainNumerical AnalysisStatistics·Captain: mikedeng1

Multilevel Langevin Pathwise Average for Gibbs Approximation III: C² Strongly Contractive Drift, 𝔞 = 2 — L²-Error ≲ [f]₁ε at Cost ((½+√2)/(√2−1))Υ₂²log(γ₀⁻¹)ε⁻²/(γ₀α)Research Paper

Motivation

Sampling from a Gibbs distribution πU∝e−U dλd\pi_U\propto e^{-U}\,d\lambda_dπU​∝e−Udλd​ on Rd\mathbb R^dRd is a basic task in Bayesian statistics, statistical physics and machine learning. A standard approach simulates the Langevin diffusion dXt=−∇U(Xt) dt+2 dBtdX_t=-\nabla U(X_t)\,dt+\sqrt2\,dB_tdXt​=−∇U(Xt​)dt+2​dBt​, whose invariant distribution is πU\pi_UπU​, through its Euler scheme, and averages a test function fff along one long trajectory. The discretization introduces a bias of the order of the step size, so a single-step-size average with accuracy ε\varepsilonε costs more than ε−2\varepsilon^{-2}ε−2 steps. Dalalyan (arXiv:1412.7392) and Durmus–Moulines (arXiv:1605.01559) quantified this for strongly log-concave targets; for occupation measures of the Euler scheme the best previous bound was of order dε−4d\varepsilon^{-4}dε−4 (Durmus–Moulines, Bernoulli 2019, denoted [DM19] in the paper).

Egéa and Panloup (arXiv:2109.07753, Math. Oper. Res., 2025) combine Giles's multilevel Monte Carlo idea (Oper. Res. 2008) with pathwise averages. Each level is one long trajectory, not many independent samples. This mission formalizes their result for a uniformly strongly contractive, twice differentiable drift. In that case the multilevel occupation measure reaches accuracy ε\varepsilonε at a cost of order dε−2d\varepsilon^{-2}dε−2, the order of an unbiased Monte Carlo method.

Setting

Let b:Rd→Rdb:\mathbb R^d\to\mathbb R^db:Rd→Rd be LLL-Lipschitz and satisfy Assumption (Cα)(\mathbf C_\alpha)(Cα​): ⟨b(y)−b(x),y−x⟩≤−α∣x−y∣2\langle b(y)-b(x),y-x\rangle\le-\alpha|x-y|^2⟨b(y)−b(x),y−x⟩≤−α∣x−y∣2 for all x,yx,yx,y, with α∈(0,L∧1]\alpha\in(0,L\wedge1]α∈(0,L∧1]. Let σ>0\sigma>0σ>0. The additive diffusion is Xtx=x+∫0tb(Xsx) ds+σBtX^x_t=x+\int_0^tb(X^x_s)\,ds+\sigma B_tXtx​=x+∫0t​b(Xsx​)ds+σBt​, driven by a standard ddd-dimensional Brownian motion BBB. Let π\piπ be its invariant distribution. Its Euler scheme with step γ\gammaγ is Xˉ0γ,x=x\bar X^{\gamma,x}_0=xXˉ0γ,x​=x, Xˉ(n+1)γγ,x=Xˉnγγ,x+γb(Xˉnγγ,x)+σ(B(n+1)γ−Bnγ)\bar X^{\gamma,x}_{(n+1)\gamma}=\bar X^{\gamma,x}_{n\gamma}+\gamma b(\bar X^{\gamma,x}_{n\gamma})+\sigma(B_{(n+1)\gamma}-B_{n\gamma})Xˉ(n+1)γγ,x​=Xˉnγγ,x​+γb(Xˉnγγ,x​)+σ(B(n+1)γ​−Bnγ​), with invariant distribution πγ\pi^\gammaπγ. Write s‾η=η⌊s/η⌋\underline s_\eta=\eta\lfloor s/\eta\rfloors​η​=η⌊s/η⌋ and [f]1[f]_1[f]1​ for the Lipschitz constant of fff.

Given a first step γ0\gamma_0γ0​, steps γr=γ02−r\gamma_r=\gamma_02^{-r}γr​=γ0​2−r, horizons T0>⋯>TRT_0>\dots>T_RT0​>⋯>TR​, a warm start τ\tauτ, and independent Brownian motions B(0),…,B(R)B^{(0)},\dots,B^{(R)}B(0),…,B(R), the multilevel occupation measure (7) is

Y(f)=1T0−τ∫τT0f(Xˉs‾γ0γ0)ds+∑r=1R1Tr−τ∫τTr(f(Xˉs‾γr−1γr)−f(Xˉs‾γr−1γr−1))ds,\mathcal Y(f)=\frac1{T_0-\tau}\int_\tau^{T_0}f(\bar X^{\gamma_0}_{\underline s_{\gamma_0}})ds+\sum_{r=1}^R\frac1{T_r-\tau}\int_\tau^{T_r}\big(f(\bar X^{\gamma_r}_{\underline s_{\gamma_{r-1}}})-f(\bar X^{\gamma_{r-1}}_{\underline s_{\gamma_{r-1}}})\big)ds,Y(f)=T0​−τ1​∫τT0​​f(Xˉs​γ0​​γ0​​)ds+r=1∑R​Tr​−τ1​∫τTr​​(f(Xˉs​γr−1​​γr​​)−f(Xˉs​γr−1​​γr−1​​))ds,

where both schemes of level rrr start at x0x_0x0​ and are driven by B(r)B^{(r)}B(r). Its cost is C(Y)=T0/γ0+∑r=1R(Tr/γr+Tr/γr−1)\mathcal C(\mathcal Y)=T_0/\gamma_0+\sum_{r=1}^R(T_r/\gamma_r+T_r/\gamma_{r-1})C(Y)=T0​/γ0​+∑r=1R​(Tr​/γr​+Tr​/γr−1​).

When bbb is C2\mathcal C^2C2 with bounded derivatives, set ∥∇b∥2,∞=sup⁡x∥∇b(x)∥F\|\nabla b\|_{2,\infty}=\sup_x\|\nabla b(x)\|_F∥∇b∥2,∞​=supx​∥∇b(x)∥F​ (Frobenius norm of the Jacobian) and ∥Δb∥2,∞2=sup⁡x∑i∣Δbi(x)∣2\|\Delta b\|^2_{2,\infty}=\sup_x\sum_i|\Delta b_i(x)|^2∥Δb∥2,∞2​=supx​∑i​∣Δbi​(x)∣2. The constant (19) is

Υ22=max⁡(1, ∣b(x0)∣2α2+σαL3∥∇b∥2,∞∣b(x0)∣+σ4L4∥Δb∥2,∞2+σ2αdL3∥∇b∥2,∞+σ2dα).\Upsilon_2^2=\max\Big(1,\ \frac{|b(x_0)|^2}{\alpha^2}+\frac{\sigma\sqrt\alpha}{L^3}\|\nabla b\|_{2,\infty}|b(x_0)|+\frac{\sigma^4}{L^4}\|\Delta b\|^2_{2,\infty}+\frac{\sigma^2\alpha\sqrt d}{L^3}\|\nabla b\|_{2,\infty}+\frac{\sigma^2d}{\alpha}\Big).Υ22​=max(1, α2∣b(x0​)∣2​+L3σα​​∥∇b∥2,∞​∣b(x0​)∣+L4σ4​∥Δb∥2,∞2​+L3σ2αd​​∥∇b∥2,∞​+ασ2d​).

Formalization targets

Goal: Theorem 2.3

Take γ0∈(0,α2L2∧12]\gamma_0\in(0,\frac\alpha{2L^2}\wedge\frac12]γ0​∈(0,2L2α​∧21​], Rε=⌈log⁡2(Υ2/ε)⌉R_\varepsilon=\lceil\log_2(\Upsilon_2/\varepsilon)\rceilRε​=⌈log2​(Υ2​/ε)⌉, Tr=Υ22log⁡(γ0−1)α−1ε−22−3r/2T_r=\Upsilon_2^2\log(\gamma_0^{-1})\alpha^{-1}\varepsilon^{-2}2^{-3r/2}Tr​=Υ22​log(γ0−1​)α−1ε−22−3r/2 and τ=α−1∣log⁡ε∣+(2α)−1log⁡Υ2\tau=\alpha^{-1}|\log\varepsilon|+(2\alpha)^{-1}\log\Upsilon_2τ=α−1∣logε∣+(2α)−1logΥ2​. There is a universal constant C1\mathfrak C_1C1​ such that for every ε∈(0,1)\varepsilon\in(0,1)ε∈(0,1) with 2log⁡(Υ2ε−2)≤log⁡(γ0−1)(Υ2/ε)1/2\sqrt2\log(\Upsilon_2\varepsilon^{-2})\le\log(\gamma_0^{-1})(\Upsilon_2/\varepsilon)^{1/2}2​log(Υ2​ε−2)≤log(γ0−1​)(Υ2​/ε)1/2,

∥Y(f)−π(f)∥2≤C1[f]1ε,C(Y)≤12+22−1 Υ22log⁡(γ0−1)γ0α ε−2.\|\mathcal Y(f)-\pi(f)\|_2\le\mathfrak C_1[f]_1\varepsilon,\qquad\mathcal C(\mathcal Y)\le\frac{\frac12+\sqrt2}{\sqrt2-1}\,\frac{\Upsilon_2^2\log(\gamma_0^{-1})}{\gamma_0\alpha}\,\varepsilon^{-2}.∥Y(f)−π(f)∥2​≤C1​[f]1​ε,C(Y)≤2​−121​+2​​γ0​αΥ22​log(γ0−1​)​ε−2.

The constant C1\mathfrak C_1C1​ is the same for all ddd, bbb, σ\sigmaσ, fff, x0x_0x0​, γ0\gamma_0γ0​ and ε\varepsilonε.

Companion: (22)

Under α/L2≤1\alpha/L^2\le1α/L2≤1, σ2α−1d≥1\sigma^2\alpha^{-1}d\ge1σ2α−1d≥1 and dimension-free bounds on ∣b(x0)∣|b(x_0)|∣b(x0​)∣, ∥∇b∥2,∞\|\nabla b\|_{2,\infty}∥∇b∥2,∞​ and ∥Δb∥2,∞\|\Delta b\|_{2,\infty}∥Δb∥2,∞​, the choice γ0=α/(2L2)\gamma_0=\alpha/(2L^2)γ0​=α/(2L2), Υ~22=σ2α−1d\tilde\Upsilon_2^2=\sigma^2\alpha^{-1}dΥ~22​=σ2α−1d gives C(Y)≤22+12−1σ2L2α3log⁡2L2α dε−2\mathcal C(\mathcal Y)\le\frac{2\sqrt2+1}{\sqrt2-1}\frac{\sigma^2L^2}{\alpha^3}\log\frac{2L^2}{\alpha}\,d\varepsilon^{-2}C(Y)≤2​−122​+1​α3σ2L2​logα2L2​dε−2.

Milestones

The milestones follow the paper's proof in order:

  • Lemma 5.1 (i), (iii): stability of the scheme and the assumptions (H1)(\mathbf H_1)(H1​), (H4)(\mathbf H_4)(H4​).
  • Lemma 5.2 (ii): a one-step error of order γ3\gamma^3γ3.
  • Proposition 5.1 (ii), (iii): a uniform-in-time strong error β2(x)γ2\beta_2(x)\gamma^2β2​(x)γ2 and (H2)(\mathbf H_2)(H2​) with a=2\mathfrak a=2a=2.
  • Proposition 5.2: W1(π,πγ)≤β2(x⋆)γ\mathcal W_1(\pi,\pi^\gamma)\le\sqrt{\beta_2(x^\star)}\gammaW1​(π,πγ)≤β2​(x⋆)​γ.
  • Proposition 2.2: (H2)(\mathbf H_2)(H2​)–(H4)(\mathbf H_4)(H4​) with constants controlled by Υ2\Upsilon_2Υ2​.
  • Remark 4.1: the paper's general complexity theorem, with constants known up to universal factors.

Significance

The result. Theorem 2.3 gives an explicit algorithm whose cost to reach L2L^2L2 accuracy ε\varepsilonε on π(f)\pi(f)π(f) is of order ε−2\varepsilon^{-2}ε−2, uniformly over Lipschitz fff. Under (22) the cost is O(dε−2)O(d\varepsilon^{-2})O(dε−2). Apart from constants depending on α\alphaα and LLL, this is the complexity of a Monte Carlo method without bias, an improvement over the dε−4d\varepsilon^{-4}dε−4 known for single-level occupation measures. Corollary 2.2 of the paper applies it to Gibbs distributions with a C3\mathcal C^3C3 potential.

Formalizing it. The theorem is proved in the paper. A machine-checked version needs a formal multilevel estimator over infinite horizons, uniform-in-time strong error bounds for the Euler scheme, and an application of Itô's formula to b(y+σBt)b(y+\sigma B_t)b(y+σBt​), none of which exists in Lean. Formalizing also checks the paper's constants. For instance, the printed exponential rate in the W2\mathcal W_2W2​ contraction behind (H1)(\mathbf H_1)(H1​) is α\alphaα, while its proof gives α/2\alpha/2α/2, and the milestone states α/2\alpha/2α/2. No part of this result has been machine-checked.

Difficulty

Two steps resist a direct approach. First, the order-one strong error (Lemma 5.2(ii), Proposition 5.1(ii)). Bounding the one-step error by the Lipschitz constant alone gives order γ2\gamma^2γ2 per step, hence order γ1/2\gamma^{1/2}γ1/2 globally; this is Lemma 5.2(i) and the a=1\mathfrak a=1a=1 regime, with an extra log⁡3ε\log^3\varepsilonlog3ε in the cost. The gain to γ3\gamma^3γ3 needs the second-order structure of bbb along the Brownian path, through a martingale term and the Laplacian of bbb. Second, the error must be controlled uniformly over infinite horizons. Every estimate has to combine the contraction (Cα)(\mathbf C_\alpha)(Cα​) with the step-size restriction γ≤α/(2L2)\gamma\le\alpha/(2L^2)γ≤α/(2L2); a Gronwall argument on a finite horizon gives constants that grow with time.

For the goal itself, the cost bound (21) is arithmetic once the parameters are fixed. The content is the error bound with a constant that is universal, not merely independent of ε\varepsilonε.

Formalization scope

  • Rd\mathbb R^dRd is the published EthierKurtz.SDEState d, and Brownian motions are the published EthierKurtz.IsStandardBrownian.
  • The diffusion is a pathwise solution of Xt=x+∫0tb(Xs)ds+σWtX_t=x+\int_0^tb(X_s)ds+\sigma W_tXt​=x+∫0t​b(Xs​)ds+σWt​ with continuous paths. No stochastic integral appears in any statement.
  • π\piπ is a probability measure invariant for the diffusion's transition laws. πγ\pi^\gammaπγ is any probability invariant for the Euler step x↦x+γb(x)+σγZx\mapsto x+\gamma b(x)+\sigma\sqrt\gamma Zx↦x+γb(x)+σγ​Z, with ZZZ standard Gaussian.
  • ∥⋅∥2\|\cdot\|_2∥⋅∥2​ is eLpNorm · 2 P, valued in [0,∞][0,\infty][0,∞]. The schemes are evaluated at grid times, except in (H4)(\mathbf H_4)(H4​) and (47), which use the continuous-time scheme.
  • C2\mathcal C^2C2 with bounded partial derivatives is ContDiff ℝ 2 b plus a uniform bound on the first and second Fréchet derivatives.
  • ∥∇b∥2,∞\|\nabla b\|_{2,\infty}∥∇b∥2,∞​ and ∥Δb∥2,∞2\|\Delta b\|^2_{2,\infty}∥Δb∥2,∞2​ follow pp. 31–32, which correct the misplaced squares of (18).
  • "≲uc\lesssim_{uc}≲uc​" is an existential constant quantified before every datum.
  • The ε0\varepsilon_0ε0​ of Theorem 2.3 is read as membership in its defining set.
  • The cost formula is used for every TrT_rTr​.
  • Added hypotheses: σ>0\sigma>0σ>0 wherever the page leaves it implicit; C2\mathcal C^2C2 regularity in Lemma 5.2(ii) and Propositions 5.1–5.2; γ<1\gamma<1γ<1 in Proposition 5.2; d≥1d\ge1d≥1 in Proposition 5.1(iii); α≤1\alpha\le1α≤1 in Proposition 2.2.

The goal does not assume (H1)(\mathbf H_1)(H1​)–(H4)(\mathbf H_4)(H4​), Proposition 2.2 or any variance or bias estimate. It assumes only (Cα)(\mathbf C_\alpha)(Cα​), Lipschitz and C2\mathcal C^2C2 regularity of bbb, σ>0\sigma>0σ>0, invariance of π\piπ and the parameter choices. Those results appear only as milestones.

Contributions that would be reusable elsewhere: uniform-in-time moment and strong-error bounds for Euler schemes of contractive SDEs, Itô's formula for a C2\mathcal C^2C2 function of Brownian motion, and the general multilevel complexity theorem (Remark 4.1). Proofs of the milestones are welcome independently.

Selected references

  • M. Egéa, F. Panloup, Multilevel-Langevin pathwise average for Gibbs approximation, Math. Oper. Res., 2025; arXiv:2109.07753v2. https://arxiv.org/abs/2109.07753
  • M. B. Giles, Multilevel Monte Carlo path simulation, Oper. Res. 56(3), 2008. https://doi.org/10.1287/opre.1070.0496
  • A. Durmus, É. Moulines, High-dimensional Bayesian inference via the unadjusted Langevin algorithm, Bernoulli 25(4A), 2019. https://doi.org/10.3150/18-BEJ1073
  • A. S. Dalalyan, Theoretical guarantees for approximate sampling from smooth and log-concave densities, J. R. Stat. Soc. B 79(3), 2017. https://arxiv.org/abs/1412.7392
  • A. Durmus, É. Moulines, Nonasymptotic convergence analysis for the unadjusted Langevin algorithm, Ann. Appl. Probab. 27(3), 2017. https://arxiv.org/abs/1507.05021
16 thms1 active userReviewed
Random Matrix TheoryStatistics·Captain: mikedeng1

Change-Point Detection in Dynamic Networks with Missing Links II: At a Known Time the Matrix CUSUM Test Has Level α and Type II Error ≤ β Above Energy 4√2(1+ϵ)(ω_n/T)^{1/2} + C log(n/(α∧β))/√TResearch Paper

Motivation

Networks observed over time, such as communication graphs, contact networks and financial exposure graphs, often change structure abruptly. Change-point detection asks whether the law of the network changed during the observation window. In practice not every pair of nodes is observed at every time: links are missing because of sampling, privacy or measurement failure. Enikeeva and Klopp (arXiv:2106.14470, published in Operations Research, 2025) give the minimax detection boundary for this problem in a sparse inhomogeneous random graph model with missing links, for a change at a known time and at an unknown time.

This mission formalizes the upper bound at a known time (their Theorem 1): a test based on the spectral norm of a matrix-valued CUSUM statistic has level α\alphaα and type II error at most β\betaβ as soon as the change is a constant multiple of (ωn/T)1/2(\omega_n/T)^{1/2}(ωn​/T)1/2 plus a logarithmic term. The companion missions of this series formalize the matching lower bound (Theorem 2) and the unknown-time test (Theorem 3).

Setting

There are nnn vertices and TTT snapshots. At time ttt the network has a symmetric, zero-diagonal connection-probability matrix Θt∈[0,1]n×n\Theta^t\in[0,1]^{n\times n}Θt∈[0,1]n×n, and each pair i<ji<ji<j is sampled independently with probability Πij>0\Pi_{ij}>0Πij​>0, where the sampling matrix Π\PiΠ is symmetric with Πii=1\Pi_{ii}=1Πii​=1. What is observed is Yt∈{0,1}n×nY^t\in\{0,1\}^{n\times n}Yt∈{0,1}n×n, symmetric with zero diagonal, whose entries YijtY^t_{ij}Yijt​, i<ji<ji<j, are independent Bernoulli variables with success probability (Π⊙Θt)ij(\Pi\odot\Theta^t)_{ij}(Π⊙Θt)ij​, independent over ttt; ⊙\odot⊙ is the entrywise product.

The column-wise norm ∥M∥1,∞=max⁡j∑i∣Mij∣\|M\|_{1,\infty}=\max_j\sum_i|M_{ij}|∥M∥1,∞​=maxj​∑i​∣Mij​∣ measures the largest expected observed degree. The null class is

Sn(ωn)={(Θ,Π): Θ∈Cn0, Π∈Cn, ∥Π⊙Θ∥1,∞≤ωn}.\mathcal S_n(\omega_n)=\{(\Theta,\Pi):\ \Theta\in\mathcal C^0_n,\ \Pi\in\mathcal C_n,\ \|\Pi\odot\Theta\|_{1,\infty}\le\omega_n\}.Sn​(ωn​)={(Θ,Π): Θ∈Cn0​, Π∈Cn​, ∥Π⊙Θ∥1,∞​≤ωn​}.

A change at time τ∈{1,…,T−1}\tau\in\{1,\dots,T-1\}τ∈{1,…,T−1} replaces Θb=Θ0\Theta^b=\Theta^0Θb=Θ0 by Θa=Θ0+ΔΘτ\Theta^a=\Theta^0+\Delta\Theta^\tauΘa=Θ0+ΔΘτ after time τ\tauτ. With q(x)=x(1−x)q(x)=\sqrt{x(1-x)}q(x)=x(1−x)​ and the spectral norm ∥⋅∥2→2\|\cdot\|_{2\to2}∥⋅∥2→2​, the change-point energy is q(τ/T)∥Π⊙ΔΘτ∥2→2q(\tau/T)\|\Pi\odot\Delta\Theta^\tau\|_{2\to2}q(τ/T)∥Π⊙ΔΘτ∥2→2​, and the alternative class Wn,Tτ(ωn,r)\mathcal W^\tau_{n,T}(\omega_n,r)Wn,Tτ​(ωn​,r) collects the pairs in Sn(ωn)\mathcal S_n(\omega_n)Sn​(ωn​) whose energy is at least rrr.

A test ψ\psiψ maps the data to {0,1}\{0,1\}{0,1}. Its type I error α(ψ)\alpha(\psi)α(ψ) is the supremum over the null class of the probability of rejecting, and its type II error β(ψ,R)\beta(\psi,R)β(ψ,R) is the supremum over Wn,Tτ(ωn,R)\mathcal W^\tau_{n,T}(\omega_n,R)Wn,Tτ​(ωn​,R) of the probability of accepting.

The Matrix CUSUM is

ZT(t)=t(T−t)T(1t∑s=1tYs−1T−t∑s=t+1TYs),1≤t≤T−1,Z_T(t)=\sqrt{\frac{t(T-t)}{T}}\Big(\frac1t\sum_{s=1}^tY^s-\frac1{T-t}\sum_{s=t+1}^TY^s\Big),\qquad 1\le t\le T-1,ZT​(t)=Tt(T−t)​​(t1​s=1∑t​Ys−T−t1​s=t+1∑T​Ys),1≤t≤T−1,

and the test at the known time τ\tauτ is

ψn,Tτ(Y)=1{∥ZT(τ)∥2→2>Hα,n},Hα,n=22(1+ϵ)ωn+Cϵlog⁡(2n/α),\psi^\tau_{n,T}(Y)=\mathbf 1\big\{\|Z_T(\tau)\|_{2\to2}>H_{\alpha,n}\big\},\qquad H_{\alpha,n}=2\sqrt2(1+\epsilon)\sqrt{\omega_n}+C_\epsilon\log(2n/\alpha),ψn,Tτ​(Y)=1{∥ZT​(τ)∥2→2​>Hα,n​},Hα,n​=22​(1+ϵ)ωn​​+Cϵ​log(2n/α),

with ϵ∈(0,1/2]\epsilon\in(0,1/2]ϵ∈(0,1/2] and CϵC_\epsilonCϵ​ a constant depending only on ϵ\epsilonϵ.

Formalization targets

Goal: Theorem 1

For every ϵ∈(0,1/2]\epsilon\in(0,1/2]ϵ∈(0,1/2] there are constants Cϵ>0C_\epsilon>0Cϵ​>0 and CCC, depending only on ϵ\epsilonϵ, such that for all n≥1n\ge1n≥1, 1≤τ≤T−11\le\tau\le T-11≤τ≤T−1, ωn≥0\omega_n\ge0ωn​≥0 and α,β∈(0,1)\alpha,\beta\in(0,1)α,β∈(0,1): if

Rn,τ≥42(1+ϵ)(ωnT)1/2+CT1/2log⁡(nα∧β),R_{n,\tau}\ge4\sqrt2(1+\epsilon)\Big(\frac{\omega_n}{T}\Big)^{1/2}+\frac{C}{T^{1/2}}\log\Big(\frac{n}{\alpha\wedge\beta}\Big),Rn,τ​≥42​(1+ϵ)(Tωn​​)1/2+T1/2C​log(α∧βn​),

then α(ψn,Tτ)≤α\alpha(\psi^\tau_{n,T})\le\alphaα(ψn,Tτ​)≤α and β(ψn,Tτ,Rn,τ)≤β\beta(\psi^\tau_{n,T},R_{n,\tau})\le\betaβ(ψn,Tτ​,Rn,τ​)≤β. The constants are existential and are not pinned to particular values; the statement asserts the shape of the boundary.

Milestones

  1. Display (7): ZT(t)=−μTτ(t) Π⊙ΔΘτ+ξ(t)Z_T(t)=-\mu^\tau_T(t)\,\Pi\odot\Delta\Theta^\tau+\xi(t)ZT​(t)=−μTτ​(t)Π⊙ΔΘτ+ξ(t), with ξ(t)\xi(t)ξ(t) the CUSUM of the centred observations, and max⁡tμTτ(t)=μTτ(τ)=T q(τ/T)\max_t\mu^\tau_T(t)=\mu^\tau_T(\tau)=\sqrt T\,q(\tau/T)maxt​μTτ​(t)=μTτ​(τ)=T​q(τ/T).
  2. Proposition 11 (Bandeira and van Handel): for a symmetric m×mm\times mm×m matrix WWW with independent centred entries bounded by σ∗\sigma_*σ∗​,
P{∥W∥2→2≥22(1+ϵ)σ+x}≤m e−x2/(cϵσ∗2).\mathbb P\{\|W\|_{2\to2}\ge2\sqrt2(1+\epsilon)\sigma+x\}\le m\,e^{-x^2/(c_\epsilon\sigma_*^2)}.P{∥W∥2→2​≥22​(1+ϵ)σ+x}≤me−x2/(cϵ​σ∗2​).
  1. Lemma 12: with probability larger than 1−δ1-\delta1−δ,
∥ξ(t)∥2→2≤22(1+ϵ)t(T−t)T[1t2∑s≤t∥Bs∥1,∞+1(T−t)2∑s>t∥Bs∥1,∞]1/2+Cϵlog⁡2nδ.\|\xi(t)\|_{2\to2}\le2\sqrt2(1+\epsilon)\sqrt{\tfrac{t(T-t)}{T}}\Big[\tfrac1{t^2}\sum_{s\le t}\|B^s\|_{1,\infty}+\tfrac1{(T-t)^2}\sum_{s>t}\|B^s\|_{1,\infty}\Big]^{1/2}+C_\epsilon\log\tfrac{2n}{\delta}.∥ξ(t)∥2→2​≤22​(1+ϵ)Tt(T−t)​​[t21​s≤t∑​∥Bs∥1,∞​+(T−t)21​s>t∑​∥Bs∥1,∞​]1/2+Cϵ​logδ2n​.
  1. Lemma 3: the test has type I error at most α\alphaα.
  2. Lemma 4: under Rn,τ≥42(1+ϵ)(ωn/T)1/2+CϵT−1/2(log⁡(2n/α)+log⁡(2n/β))R_{n,\tau}\ge4\sqrt2(1+\epsilon)(\omega_n/T)^{1/2}+C_\epsilon T^{-1/2}(\log(2n/\alpha)+\log(2n/\beta))Rn,τ​≥42​(1+ϵ)(ωn​/T)1/2+Cϵ​T−1/2(log(2n/α)+log(2n/β)) the type II error is at most β\betaβ.

Significance

Theorem 1 is the upper half of the minimax detection boundary for a change at a known time. Together with Theorem 2 of the same paper (a lower bound of order (ωn/T)1/2(\omega_n/T)^{1/2}(ωn​/T)1/2) it shows that, up to the logarithmic term, the CUSUM test in spectral norm is rate-optimal, and that missing links enter only through the observed degree bound ωn=max⁡∥Π⊙Θ∥1,∞\omega_n=\max\|\Pi\odot\Theta\|_{1,\infty}ωn​=max∥Π⊙Θ∥1,∞​. The same noise bound (Lemma 12) drives the unknown-time test of Theorem 3.

The result is proved in the paper; no machine-checked version exists. Formalizing it produces a checked finite-sample statement with explicit leading constant 42(1+ϵ)4\sqrt2(1+\epsilon)42​(1+ϵ), a reusable formal Bernoulli network model with missing links, and, through Proposition 11, a formal statement of the Bandeira–van Handel tail bound, which is used well beyond change-point problems. The printed proof of Lemma 12 applies Proposition 11 after conditioning on the event {∥ξ(t)∥∞≤σ∗}\{\|\xi(t)\|_\infty\le\sigma_*\}{∥ξ(t)∥∞​≤σ∗​}, which destroys centring and independence; a complete proof needs a truncation argument that the paper does not give.

Difficulty

Under the null the CUSUM is pure noise, so both errors reduce to a high-probability bound on ∥ξ(t)∥2→2\|\xi(t)\|_{2\to2}∥ξ(t)∥2→2​ whose leading term is exactly 22(1+ϵ)ωn2\sqrt2(1+\epsilon)\sqrt{\omega_n}22​(1+ϵ)ωn​​ after rescaling. Matrix Bernstein inequalities give a bound with an extra log⁡n\sqrt{\log n}logn​ factor on the leading term, which is too weak for the stated threshold; the sharp constant requires the Bandeira–van Handel inequality, whose proof goes through moment comparisons for random matrices with non-identically distributed entries. The entries of ξ(t)\xi(t)ξ(t) are themselves sums over time with coefficients up to order T\sqrt TT​ in aggregate, so the boundedness hypothesis of Proposition 11 does not hold directly and must be recovered with probability bounds. Finally, the level and the power must hold for the same threshold constant CϵC_\epsilonCϵ​, uniformly in nnn, TTT, τ\tauτ and the parameters.

Formalization scope

An observation is a function from the TTT snapshots and the pairs i<ji<ji<j to Booleans; time is 0-based in Lean (snapshot sss is the paper's s+1s+1s+1). The latent adjacency and sampling matrices are integrated out: only YYY is modelled, by its exact product-Bernoulli law, and probabilities are finite sums over the finite observation space, so every test is measurable. Tests are Boolean-valued (true rejects). The sampling class carries the paper's standing assumptions Πii=1\Pi_{ii}=1Πii​=1 and Πij>0\Pi_{ij}>0Πij​>0. Errors are real suprema over sets contained in [0,1][0,1][0,1]; an empty alternative class has type II error 000. The spectral norm is the published HighDimProb.RandomMatrices.matrixOpNorm. Proposition 11 alone uses measure theory, with independence of the entries on and above the diagonal and an added (implicit) m≥1m\ge1m≥1.

Disclosed readings: (24) prints κn\kappa_nκn​, which is read as ωn\omega_nωn​ as in the proof; Lemma 12's matrices are the symmetric, zero-diagonal centred observations of the model; Lemmas 3 and 4 take "CϵC_\epsilonCϵ​ is a constant of Lemma 12" (with Cϵ>0C_\epsilon>0Cϵ​>0) as a hypothesis, stated as a predicate. The goal does not assume that predicate: it asserts the existence of CϵC_\epsilonCϵ​ and CCC, both chosen before nnn, TTT, τ\tauτ, ωn\omega_nωn​, α\alphaα, β\betaβ and RRR, so neither constant can be tuned to the instance, and tests range over all functions of the data. Choosing huge constants does not trivialize the goal, since for large TTT the energy condition is met by nonempty alternatives that the test must detect.

The development needs: the product-Bernoulli law of the network, the Matrix CUSUM algebra, the Bandeira–van Handel inequality, and a truncation argument for Lemma 12. The Setting and Proposition 11 are reusable for the unknown-time test and for spectral methods on random graphs. Proofs of any milestone, and alternative routes to Lemma 12, are welcome.

Selected references

  • F. Enikeeva and O. Klopp, Change-point detection in dynamic networks with missing links, Operations Research, 2025; arXiv:2106.14470v2. https://arxiv.org/abs/2106.14470
  • A. S. Bandeira and R. van Handel, Sharp nonasymptotic bounds on the norm of random matrices with independent entries, Annals of Probability 44(4), 2016. https://doi.org/10.1214/15-AOP1025
  • Yu. I. Ingster and I. A. Suslina, Nonparametric Goodness-of-Fit Testing under Gaussian Models, Springer, 2003. https://doi.org/10.1007/978-0-387-21580-8
9 thms1 active userReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Opinion Dynamics on Directed Complex Networks 2: Without Memory on a Galton-Watson Limit, E[R*] = dE[Z_∅] + cE[Z_1] and Var(R*) = d²Var(Z_∅) + ρ*₂d²Var(Z_1)/(1 − ρ₂)Research Paper

Motivation

Linear opinion models describe each individual's opinion as a weighted average of the opinions of the people they listen to, of an outside signal, and of their own previous opinion. The model goes back to DeGroot (DeGroot 1974) and Friedkin–Johnsen, and its basic questions are when a population reaches consensus and when it polarizes. Fraiman, Lin and Olvera-Cravioto (arXiv:2209.00969v2, Mathematics of Operations Research, 2025) study it on large directed random graphs with vertex attributes, where each vertex also receives a stream of media signals. Their Theorem 2 shows that the opinion of a typical vertex converges, as the graph grows, to a random variable R∗\mathcal R^*R∗ defined on the graph's local limit. When that local limit is a marked Galton–Watson tree, R∗\mathcal R^*R∗ becomes explicit enough that its mean and variance can be written in closed form, and the variance formula is what the paper uses to say when consensus happens.

This mission formalizes those closed-form moments in the no-memory case, where an individual's new opinion does not depend on their own previous opinion.

Setting

The tree. Nodes carry Ulam–Harris labels: the root is ∅\emptyset∅, and the children of a node i\mathbf ii are (i,1),(i,2),…(\mathbf i,1),(\mathbf i,2),\dots(i,1),(i,2),… (in the tree, the children of i\mathbf ii are its inbound neighbours). Each node i\mathbf ii has a mark Xi\boldsymbol{\mathcal X}_{\mathbf i}Xi​, which determines its in-degree Ni\mathcal N_{\mathbf i}Ni​, the weights C(i,1),…,C(i,Ni)∈[0,1]\mathcal C_{(\mathbf i,1)},\dots,\mathcal C_{(\mathbf i,\mathcal N_{\mathbf i})}\in[0,1]C(i,1)​,…,C(i,Ni​)​∈[0,1] it puts on its inbound neighbours, and an internal opinion Qi∈[−1,1]\mathcal Q_{\mathbf i}\in[-1,1]Qi​∈[−1,1]. Two parameters c∈[0,1)c\in[0,1)c∈[0,1), d∈(0,1]d\in(0,1]d∈(0,1] with c+d≤1c+d\le1c+d≤1 fix the proportions: if Ni≥1\mathcal N_{\mathbf i}\ge1Ni​≥1, then ∑jC(i,j)=c\sum_j\mathcal C_{(\mathbf i,j)}=c∑j​C(i,j)​=c. The tree is a delayed marked Galton–Watson tree: the marks are independent, and all marks except the root's are identically distributed.

Signals. Each node receives media signals Zi(k)∈[−1,1]\mathcal Z_{\mathbf i}^{(k)}\in[-1,1]Zi(k)​∈[−1,1], k≥0k\ge0k≥0, conditionally i.i.d. given its mark and conditionally independent across nodes. The external signal is

Wi(k)=d Zi(k)+Qi(c−∑j=1NiC(i,j)),\mathcal W_{\mathbf i}^{(k)}=d\,\mathcal Z_{\mathbf i}^{(k)}+\mathcal Q_{\mathbf i}\Big(c-\sum_{j=1}^{\mathcal N_{\mathbf i}}\mathcal C_{(\mathbf i,j)}\Big),Wi(k)​=dZi(k)​+Qi​(c−j=1∑Ni​​C(i,j)​),

so a vertex with inbound neighbours gives weight ddd to the media and ccc to its neighbours, and a vertex without them falls back on its internal opinion.

Dynamics. Opinions evolve by

Ri(k+1)=∑j=1NiC(i,j)R(i,j)(k)+Wi(k)+(1−c−d)Ri(k).\mathcal R_{\mathbf i}^{(k+1)}=\sum_{j=1}^{\mathcal N_{\mathbf i}}\mathcal C_{(\mathbf i,j)}\mathcal R_{(\mathbf i,j)}^{(k)}+\mathcal W_{\mathbf i}^{(k)}+(1-c-d)\mathcal R_{\mathbf i}^{(k)}.Ri(k+1)​=j=1∑Ni​​C(i,j)​R(i,j)(k)​+Wi(k)​+(1−c−d)Ri(k)​.

With the operator Δf(i)=∑jC(i,j)f((i,j))+(1−c−d)f(i)\Delta f(\mathbf i)=\sum_j\mathcal C_{(\mathbf i,j)}f((\mathbf i,j))+(1-c-d)f(\mathbf i)Δf(i)=∑j​C(i,j)​f((i,j))+(1−c−d)f(i), the stationary root opinion is

R∗=∑s≥0(ΔsW(s))(∅).\mathcal R^*=\sum_{s\ge0}\big(\Delta^s\mathcal W^{(s)}\big)(\emptyset).R∗=s≥0∑​(ΔsW(s))(∅).

The no-memory case is c+d=1c+d=1c+d=1. In that case R∗=∑jCjRj+W∅(0)\mathcal R^*=\sum_{j}\mathcal C_j\mathcal R_j+\mathcal W_\emptyset^{(0)}R∗=∑j​Cj​Rj​+W∅(0)​, where the subtree opinions Rj\mathcal R_jRj​ are i.i.d. copies of the endogenous solution R\mathcal RR of the smoothing transform R=D∑jC(1,j)Rj+W1(1)\mathcal R\overset{\mathcal D}{=}\sum_j\mathcal C_{(1,j)}\mathcal R_j+\mathcal W_1^{(1)}R=D∑j​C(1,j)​Rj​+W1(1)​. The moments are expressed through ρ2=E[∑i=1N1C(1,i)2]\rho_2=E\big[\sum_{i=1}^{\mathcal N_1}\mathcal C_{(1,i)}^2\big]ρ2​=E[∑i=1N1​​C(1,i)2​] (a non-root node) and ρ2∗=E[∑i=1N∅Ci2]\rho_2^*=E\big[\sum_{i=1}^{\mathcal N_\emptyset}\mathcal C_i^2\big]ρ2∗​=E[∑i=1N∅​​Ci2​] (the root).

Formalization targets

Goal: Proposition 4 (p. 11)

If c+d=1c+d=1c+d=1 and P(N∅>0)=P(N1>0)=1P(\mathcal N_\emptyset>0)=P(\mathcal N_1>0)=1P(N∅​>0)=P(N1​>0)=1, then

E[R∗]=d E[Z∅]+c E[Z1],Var⁡(R∗)=d2Var⁡(Z∅)+ρ2∗d21−ρ2Var⁡(Z1).E[\mathcal R^*]=d\,E[\mathcal Z_\emptyset]+c\,E[\mathcal Z_1],\qquad \operatorname{Var}(\mathcal R^*)=d^2\operatorname{Var}(\mathcal Z_\emptyset)+\frac{\rho_2^*d^2}{1-\rho_2}\operatorname{Var}(\mathcal Z_1).E[R∗]=dE[Z∅​]+cE[Z1​],Var(R∗)=d2Var(Z∅​)+1−ρ2​ρ2∗​d2​Var(Z1​).

Milestones, in attack order

  1. The expansion Δsf(i)=∑l≤s∑∣j∣=lΠ(i,j)Πial,sf((i,j))\Delta^sf(\mathbf i)=\sum_{l\le s}\sum_{|\mathbf j|=l}\frac{\Pi_{(\mathbf i,\mathbf j)}}{\Pi_{\mathbf i}}a_{l,s}f((\mathbf i,\mathbf j))Δsf(i)=∑l≤s​∑∣j∣=l​Πi​Π(i,j)​​al,s​f((i,j)) with al,s=(sl)(1−c−d)s−la_{l,s}=\binom sl(1-c-d)^{s-l}al,s​=(ls​)(1−c−d)s−l (proof of Proposition 3, p. 29).
  2. Proposition 3 (pp. 9–10): R∗=∑s∑l≤s∑∣j∣=lΠjal,sWj(s)\mathcal R^*=\sum_s\sum_{l\le s}\sum_{|\mathbf j|=l}\Pi_{\mathbf j}a_{l,s}\mathcal W_{\mathbf j}^{(s)}R∗=∑s​∑l≤s​∑∣j∣=l​Πj​al,s​Wj(s)​.
  3. Remark 6 (p. 10): the decomposition (6)–(7) of R∗\mathcal R^*R∗ without memory, the i.i.d. structure of the Rj\mathcal R_jRj​, and the fixed-point equation.
  4. Display (14) (p. 30): E[R]=E[Z1]E[\mathcal R]=E[\mathcal Z_1]E[R]=E[Z1​] and Var⁡(R)=d21−ρ2Var⁡(Z1)\operatorname{Var}(\mathcal R)=\frac{d^2}{1-\rho_2}\operatorname{Var}(\mathcal Z_1)Var(R)=1−ρ2​d2​Var(Z1​).
  5. Displays (12)–(13) (p. 30): the conditional mean and variance of R∗\mathcal R^*R∗ given X∅\boldsymbol{\mathcal X}_\emptysetX∅​ in terms of R\mathcal RR.
  6. Proposition 5 (p. 14): E[R∗∣X∅]=dE[Z∅∣X∅]+cE[Z1]E[\mathcal R^*\mid\boldsymbol{\mathcal X}_\emptyset]=dE[\mathcal Z_\emptyset\mid\boldsymbol{\mathcal X}_\emptyset]+cE[\mathcal Z_1]E[R∗∣X∅​]=dE[Z∅​∣X∅​]+cE[Z1​] and Var⁡(R∗∣X∅)=d2Var⁡(Z∅∣X∅)+d21−ρ2∑iCi2Var⁡(Z1)\operatorname{Var}(\mathcal R^*\mid\boldsymbol{\mathcal X}_\emptyset)=d^2\operatorname{Var}(\mathcal Z_\emptyset\mid\boldsymbol{\mathcal X}_\emptyset)+\frac{d^2}{1-\rho_2}\sum_{i}\mathcal C_i^2\operatorname{Var}(\mathcal Z_1)Var(R∗∣X∅​)=d2Var(Z∅​∣X∅​)+1−ρ2​d2​∑i​Ci2​Var(Z1​).

Significance

The result. The variance formula identifies consensus with small media variance: the weights enter only through the second moments ρ2,ρ2∗\rho_2,\rho_2^*ρ2​,ρ2∗​, so consensus is possible for any network structure as long as dZd\mathcal ZdZ has small variance. The conditional formulas of Proposition 5 separate the part of the opinion explained by the vertex's own attributes from the part contributed by the network, which is how the paper describes polarization: individuals with similar attributes end with similar opinions when Var⁡(R∗∣X∅)\operatorname{Var}(\mathcal R^*\mid\boldsymbol{\mathcal X}_\emptyset)Var(R∗∣X∅​) is small. The no-memory formulas are also the comparison point for the general case c+d<1c+d<1c+d<1 (Proposition 6 of the paper, a separate mission of this series).

The formalization. The results are proved in the paper; none is machine-checked. A formal development produces a reusable encoding of marked Galton–Watson trees with i.i.d. marks and signals, the expansion of powers of the averaging operator over the generations of a tree, and the moment computation for the endogenous solution of the linear smoothing transform, a fixed-point equation that recurs in the study of branching processes and of ranking algorithms such as PageRank on random graphs.

Difficulty

The moment identities are short once Remark 6 is available. The work is in making Remark 6 precise: the subtree opinions Rj\mathcal R_jRj​ are infinite series over random subtrees, and the proof needs them to be measurable, mutually independent, identically distributed, and independent of the root's mark and signal. That independence comes from the disjointness of the label sets they read, together with the independence of all marks and all uniform variables, and it must be carried through a random in-degree and random weights. The conditional variance step then requires conditional independence given X∅\boldsymbol{\mathcal X}_\emptysetX∅​ of a random number of summands. Simply invoking the law of total variance is not enough: computing Var⁡(R)\operatorname{Var}(\mathcal R)Var(R) from the fixed-point equation needs Var⁡(R)<∞\operatorname{Var}(\mathcal R)<\inftyVar(R)<∞, which here follows from boundedness, ∣R∣≤1/d|\mathcal R|\le 1/d∣R∣≤1/d.

Formalization scope

Labels are List ℕ with 0-based children: the paper's node 111 is [0] and its jjj-th child of i\mathbf ii is i ++ [j-1]. Marks live in an arbitrary measurable space and are read through measurable maps giving N\mathcal NN, C\mathcal CC, Q\mathcal QQ. The signals are written Zi(k)=ζ(Xi,Ui(k))\mathcal Z_{\mathbf i}^{(k)}=\zeta(\boldsymbol{\mathcal X}_{\mathbf i},U_{\mathbf i}^{(k)})Zi(k)​=ζ(Xi​,Ui(k)​) with i.i.d. uniform UUU independent of the marks; this produces exactly the paper's conditional i.i.d. structure (take ζ(x,⋅)\zeta(x,\cdot)ζ(x,⋅) the quantile function), and every statement concerns laws. Signals are indexed by time k≥0k\ge0k≥0; E[Z1]E[\mathcal Z_1]E[Z1​] and Var⁡(Z1)\operatorname{Var}(\mathcal Z_1)Var(Z1​) are taken at k=0k=0k=0, as their laws do not depend on kkk. The relative path weights Π(i,j)/Πi\Pi_{(\mathbf i,\mathbf j)}/\Pi_{\mathbf i}Π(i,j)​/Πi​ are products along the path, never quotients, which removes the paper's convention for Cj=0\mathcal C_j=0Cj​=0.

The paper states Propositions 3–5 under "the assumptions of Theorem 2" with a tree as local limit. Those assumptions only serve to identify R∗\mathcal R^*R∗ with the typical opinion of a large graph; the statements and proofs concern R∗\mathcal R^*R∗ on the limit tree. The Lean statements are therefore made on the tree, under the Section 5 standing assumptions above, without a graph sequence. R∗\mathcal R^*R∗ is the series ∑s(ΔsW(s))(∅)\sum_s(\Delta^s\mathcal W^{(s)})(\emptyset)∑s​(ΔsW(s))(∅).

Conditional expectations and variances given X∅\boldsymbol{\mathcal X}_\emptysetX∅​ are Mathlib's condExp and condVar with respect to the σ-algebra generated by the root's mark, and the conditional statements are equalities almost everywhere, not pointwise. No trivializing reading is available: every series is absolutely summable for every outcome under the standing assumptions, every variable is bounded by 1/d1/d1/d, so Lean's junk values for a non-summable tsum, a non-integrable integral or a non-L2L^2L2 variance never apply, and 1−ρ2≥1−c2>01-\rho_2\ge1-c^2>01−ρ2​≥1−c2>0, so the division is genuine. The standing assumptions are satisfiable together with c+d=1c+d=1c+d=1 and N≥1\mathcal N\ge1N≥1 (a path tree with uniform signals). The hypotheses P(N∅>0)=P(N1>0)=1P(\mathcal N_\emptyset>0)=P(\mathcal N_1>0)=1P(N∅​>0)=P(N1​>0)=1 are used: without them the term cQc\mathcal QcQ enters at vertices with no inbound neighbours and the formulas change.

Needed infrastructure: independence of functions of disjoint blocks of an independent family, measurability of series over random finite generations, conditional variance of conditionally independent sums. Contributions on each milestone, on general lemmas for marked Galton–Watson trees, and alternative proofs are welcome.

Selected references

  • N. Fraiman, T.-C. Lin, M. Olvera-Cravioto, Opinion dynamics on directed complex networks, Mathematics of Operations Research, 2025; arXiv:2209.00969v2. https://arxiv.org/abs/2209.00969
  • M. H. DeGroot, Reaching a consensus, Journal of the American Statistical Association 69 (1974) 118–121. https://doi.org/10.1080/01621459.1974.10480137
  • D. J. Aldous, A. Bandyopadhyay, A survey of max-type recursive distributional equations, Annals of Applied Probability 15 (2005) 1047–1110. https://doi.org/10.1214/105051605000000142
  • G. Alsmeyer, J. D. Biggins, M. Meiners, The functional equation of the smoothing transform, Annals of Probability 40 (2012) 2069–2105. https://doi.org/10.1214/11-AOP670
8 thms1 active userReviewed
EconomicsOperations Research·Captain: mikedeng1

Intersectionality: Affirmative Action with Multidimensional Identities 2: On a Nonempty Open Set of Distributions Some Nonintersectional Policy Achieves Representation along Every Identity DimensionResearch Paper

Motivation

Admissions offices and employers that run affirmative action usually measure representation one identity dimension at a time: the share of women among those admitted, the share of Black applicants, and so on. Applicants, however, belong to intersectional groups (Black women, white men, …), and a policy that looks balanced along every dimension can still leave some intersectional group under-represented. The sociological literature calls this hidden inequality. Carvalho, Pradelski and Williams (hal-04788142v1; published in Management Science 71(5), 2025, doi:10.1287/mnsc.2023.03839) put the question into a threshold-admission model with score adjustments. Their Theorem 1 shows that, for generic score distributions, no nonintersectional policy (one that adjusts each dimension separately and composes the adjustments) makes every intersectional group's share among the accepted equal to its population share.

This mission formalizes the paper's positive counterpart, Proposition 3: for the weaker, per-dimension target that committees actually monitor, nonintersectional policies do succeed on a nonempty open set of distributions. Together the two results explain why reductive monitoring can report success while intersectional groups remain under-represented (the paper's Example 3).

Setting

A decision maker accepts a share α∈(0,1)\alpha \in (0,1)α∈(0,1) of a unit-mass applicant pool. An applicant has a score xxx in an interval X⊂RX \subset \mathbb{R}X⊂R and an identity g∈G={0,1}ng \in G = \{0,1\}^ng∈G={0,1}n with n≥2n \ge 2n≥2. Everyone with gi=1g_i = 1gi​=1 belongs to category iii. The joint law ppp of (score, identity) lies in the space PPP of probability measures on X×GX \times GX×G whose conditional score laws Fg=p(⋅∣g)F_g = p(\cdot \mid g)Fg​=p(⋅∣g) are continuous and have full support on XXX. PPP carries the relative weak topology. Write p(g)p(g)p(g) for the mass of group ggg and p(gi)p(g_i)p(gi​) for the mass of category iii.

A policy assigns to each group a score adjustment qg:X→Xq_g : X \to Xqg​:X→X taken from a family QQQ of strictly increasing bijections that is rich (for all x,y∈Xx, y \in Xx,y∈X some q∈Qq \in Qq∈Q has q(x)=yq(x) = yq(x)=y) and commutative (q∘q′=q′∘qq \circ q' = q' \circ qq∘q′=q′∘q). The additive shifts x↦x+δx \mapsto x + \deltax↦x+δ on X=RX = \mathbb{R}X=R are the leading example. Given a threshold x∗∈Xx^* \in Xx∗∈X, an applicant from group ggg is accepted when qg(x)≥x∗q_g(x) \ge x^*qg​(x)≥x∗, subject to the capacity constraint

∑g∈GPr⁡(qg(x)≥x∗∣g) p(g)=α.\sum_{g \in G} \Pr(q_g(x) \ge x^* \mid g)\, p(g) = \alpha .g∈G∑​Pr(qg​(x)≥x∗∣g)p(g)=α.

The accepted share of group ggg is p^(g)\hat p(g)p^​(g), and the accepted share of category iii is p^(gi)=∑g:gi=1p^(g)\hat p(g_i) = \sum_{g : g_i = 1} \hat p(g)p^​(gi​)=∑g:gi​=1​p^​(g).

  • A policy is nonintersectional if g=g′+g′′g = g' + g''g=g′+g′′ (as integer vectors) implies qg=qg′∘qg′′q_g = q_{g'} \circ q_{g''}qg​=qg′​∘qg′′​.
  • An outcome is reductive representative if p^(gi)=p(gi)\hat p(g_i) = p(g_i)p^​(gi​)=p(gi​) for every dimension iii (Definition 7).

The milestones use the paper's parameterization (Appendix D). Fix x0∈Xx_0 \in Xx0​∈X, let r(⋅∣θ)r(\cdot \mid \theta)r(⋅∣θ) be the map in QQQ sending x0x_0x0​ to θ\thetaθ, and for θ∈Xn\theta \in X^nθ∈Xn let rg(⋅∣θ)r_g(\cdot \mid \theta)rg​(⋅∣θ) compose r(⋅∣θi)r(\cdot \mid \theta_i)r(⋅∣θi​) over the coordinates with gi=1g_i = 1gi​=1. Let Ri(θ,x∗)R_i(\theta, x^*)Ri​(θ,x∗) be the resulting acceptance rate of category iii and S(θ,x∗)S(\theta, x^*)S(θ,x∗) the total acceptance rate, and let t(θ)t(\theta)t(θ) solve S(θ,t(θ))=αS(\theta, t(\theta)) = \alphaS(θ,t(θ))=α. For a,b∈Xna, b \in X^na,b∈Xn, condition (5) reads

Ri(ai,θ−i,t(ai,θ−i))<α<Ri(bi,θ−i,t(bi,θ−i))for all i, θ−i∈×j≠i[aj,bj].R_i(a_i, \theta_{-i}, t(a_i, \theta_{-i})) < \alpha < R_i(b_i, \theta_{-i}, t(b_i, \theta_{-i})) \quad \text{for all } i,\ \theta_{-i} \in \textstyle\times_{j \ne i}[a_j, b_j].Ri​(ai​,θ−i​,t(ai​,θ−i​))<α<Ri​(bi​,θ−i​,t(bi​,θ−i​))for all i, θ−i​∈×j=i​[aj​,bj​].

Formalization targets

Goal: Proposition 3

∃ U⊆P open, U≠∅, ∀p∈U ∃ q nonintersectional, qg∈Q, ∃ x∗∈X: ∑gAg=α and p^(gi)=p(gi) ∀i,\exists\, U \subseteq P \text{ open},\ U \ne \emptyset,\ \forall p \in U\ \exists\, q \text{ nonintersectional},\ q_g \in Q,\ \exists\, x^* \in X:\ \textstyle\sum_g A_g = \alpha \text{ and } \hat p(g_i) = p(g_i)\ \forall i,∃U⊆P open, U=∅, ∀p∈U ∃q nonintersectional, qg​∈Q, ∃x∗∈X: ∑g​Ag​=α and p^​(gi​)=p(gi​) ∀i,

with AgA_gAg​ the accepted mass of group ggg. The policy may be any nonintersectional policy in QQQ. The set UUU is not specified.

Milestones (in the order of Appendix D)

  1. Lemma 1(b): the map in QQQ sending xxx to yyy is unique.
  2. Continuity of the parameterization: θ↦r(x∣θ)\theta \mapsto r(x \mid \theta)θ↦r(x∣θ) is continuous.
  3. The capacity threshold: for p∈Pp \in Pp∈P, S(θ,⋅)=αS(\theta, \cdot) = \alphaS(θ,⋅)=α has exactly one solution t(θ)t(\theta)t(θ).
  4. The Poincaré–Miranda step: (5) with a≤ba \le ba≤b yields θ∗∈[a,b]\theta^* \in [a, b]θ∗∈[a,b] with Ri(θ∗,t(θ∗))=αR_i(\theta^*, t(\theta^*)) = \alphaRi​(θ∗,t(θ∗))=α for all iii, and the policy rg(⋅∣θ∗)r_g(\cdot \mid \theta^*)rg​(⋅∣θ∗) with threshold t(θ∗)t(\theta^*)t(θ∗) is nonintersectional and reductive representative.
  5. Lemma 3: (5) at pˉ\bar ppˉ​ persists on a neighbourhood of pˉ\bar ppˉ​ in PPP.
  6. Lemma 4: some pˉ∈P\bar p \in Ppˉ​∈P satisfies (5) with a≤ba \le ba≤b.

Significance

The result. Proposition 3 shows that the obstruction in Theorem 1 belongs to the intersectional target, not to nonintersectional policies as such. A committee that monitors only per-dimension shares can meet its target with a nonintersectional policy on an open set of distributions, and the paper's Example 3 shows that such a policy can at the same time lower the acceptance rate of an intersectional group (Black men) that receives affirmative action. Taken together, the two results make the case for monitoring representation at the intersectional level.

Formalizing it. The result is proved in the paper; no machine-checked version exists. A complete formalization needs pieces that do not yet exist in Lean. One is the algebraic structure of rich commutative families (Lemma 1: such a QQQ is an abelian group acting simply transitively on XXX). Another is weak-topology continuity of acceptance masses on PPP. A third is a continuity-of-argmax argument (Berge's maximum theorem) for t(θ,p)t(\theta, p)t(θ,p) and for minima over boxes, and the last is the Poincaré–Miranda theorem. Mathlib has neither Poincaré–Miranda nor Brouwer's fixed-point theorem.

Difficulty

A first attempt is to solve Ri(θ,t(θ))=αR_i(\theta, t(\theta)) = \alphaRi​(θ,t(θ))=α one coordinate at a time with the intermediate value theorem. This fails because the coordinates interact through the common threshold: raising θj\theta_jθj​ admits more of category jjj, pushes t(θ)t(\theta)t(θ) up, and lowers every other RiR_iRi​. A genuinely nnn-dimensional fixed-point argument is needed, here Poincaré–Miranda on the box [a,b][a, b][a,b], which in turn needs Ri(θ,t(θ))R_i(\theta, t(\theta))Ri​(θ,t(θ)) to be continuous in θ\thetaθ.

The open-set claim needs more than one good distribution: condition (5) must survive weak perturbations of ppp. That requires continuity of acceptance masses in ppp, which holds only because conditional laws in PPP are atomless (so threshold boundaries carry no mass), and continuity of the implicitly defined threshold t(θ,p)t(\theta, p)t(θ,p) jointly in θ\thetaθ and ppp. Exhibiting the distribution of Lemma 4 is the easy part.

Formalization scope

Scores live in the subtype of an order-connected X⊆RX \subseteq \mathbb{R}X⊆R with at least two points. Identities are Fin n → Bool with 0-based indices, and g=g′+g′′g = g' + g''g=g′+g′′ is coordinatewise addition in N\mathbb{N}N. PPP is a subtype of ProbabilityMeasure on X×GX \times GX×G (product topology, Borel σ-algebra), with Mathlib's weak topology. Membership in PPP asks, for every group with p(g)>0p(g) > 0p(g)>0, that the conditional law have no atoms and charge every nonempty open subinterval. Groups with p(g)=0p(g) = 0p(g)=0 are unconstrained (convention C1; the paper is silent, and Lemma 4's pˉ\bar ppˉ​ has null groups). "Increasing" is read as strictly increasing, which is the same thing for bijections. Accepted masses are measures of sets, and RiR_iRi​ divides by p(gi)p(g_i)p(gi​) (Lean returns 000 when p(gi)=0p(g_i) = 0p(gi​)=0). The objects r(⋅∣θ)r(\cdot \mid \theta)r(⋅∣θ) and t(θ)t(\theta)t(θ) are chosen elements, unique for rich commutative QQQ and p∈Pp \in Pp∈P respectively.

Disclosed additions to the page:

  • XXX has at least two points in the goal and in Lemma 4, since on a one-point XXX the space PPP is empty.
  • a≤ba \le ba≤b is a hypothesis of the Poincaré–Miranda step and part of the conclusion of Lemma 4, because with an empty box condition (5) holds vacuously.

Ruled out:

  • trivial readings: an empty PPP or an unsatisfiable QQQ (the additive family satisfies the hypotheses), and a single distribution in place of an open set;
  • a weaker notion of representation: dropping the capacity constraint, which would turn representation into equal acceptance rates at an arbitrary level;
  • the wrong ambient space: openness taken in all of Δ(X×G)\Delta(X \times G)Δ(X×G) rather than in PPP;
  • unrestricted policies: policies are required to lie in QQQ group by group.

Contributions welcome: the group structure of rich commutative families (shared with the companion mission on Theorem 1), weak continuity of threshold acceptance masses, a Poincaré–Miranda theorem for boxes in Rn\mathbb{R}^nRn, which is reusable well beyond this paper, and Berge's maximum theorem.

Selected references

  • J.-P. Carvalho, B. S. R. Pradelski, C. Williams, Intersectionality: Affirmative Action with Multidimensional Identities, Management Science 71(5), 2025; author manuscript hal-04788142v1. https://hal.science/hal-04788142v1, https://doi.org/10.1287/mnsc.2023.03839
  • A. Fonda, P. Gidoni, Generalizing the Poincaré–Miranda theorem: the avoiding cones condition, Annali di Matematica Pura ed Applicata 195, 2016. https://doi.org/10.1007/s10231-015-0519-7
  • C. D. Aliprantis, K. C. Border, Infinite Dimensional Analysis: A Hitchhiker's Guide, 3rd ed., Springer, 2006 (Theorem 17.31, Berge's maximum theorem). https://doi.org/10.1007/3-540-29587-9
9 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes I: With Patience at Least 2, Attenuated Random-Order Probing Gives Every Edge a(e)·Pr[e Is Free] ≥ β*Research Paper

Motivation

In offline stochastic matching a graph is given in which every edge is present only with some known probability, and the only way to find out is to probe it: a probed edge that turns out to be present must be added to the matching at once. Each vertex may also limit how many of its edges are probed (its patience). The model captures applications in which a proposed match may be refused and an accepted one is binding: organ (kidney) exchange, online dating, advertising, crowdsourcing and ride sharing are the examples the paper lists (pp. 1–2), following Chen, Immorlica, Karlin, Mahdian and Rudra (ICALP 2009) and Bansal, Gupta, Li, Mestre, Nagarajan and Rudra (Algorithmica 2012).

Finding the best probing strategy is computationally hard, so algorithms are compared with a linear-programming relaxation that upper-bounds every strategy (Lemma 1, from Bansal et al.).

Timeline (general graphs with patience, as recorded on p. 2 of the paper).

  • 2012: Bansal et al., a 0.250.250.25-approximation.
  • 2015: Adamczyk, Grandoni and Mukherjee, 0.2690.2690.269.
  • 2018: Baveja, Chavan, Nikiforov, Srinivasan and Xu, 0.310.310.31.
  • 2021–2026: Brubach, Grammel, Ma, MacRury and Srinivasan (arXiv:2106.06892v3; Mathematics of Operations Research, 2025), 0.3820.3820.382 when every patience is at least 222. Their algorithm processes the edges in random order and attenuates each probe with an extra coin flip. Version 3 restricts the result to patience at least 222; earlier versions claimed it for all patience values, and Remark 1 shows why patience 111 fails.
  • Since then Pollner et al. have obtained 0.3950.3950.395 for general graphs (reference [35] of the paper).

This mission formalizes the per-edge bound behind the 0.3820.3820.382 result, Theorem 1 of the paper.

Setting

A finite graph G=(V,E)G = (V, E)G=(V,E) is given. Each edge eee is active independently with probability pe∈[0,1]p_e \in [0,1]pe​∈[0,1], and each vertex vvv has a patience tv∈{1,2,… }∪{∞}t_v \in \{1, 2, \dots\} \cup \{\infty\}tv​∈{1,2,…}∪{∞}, the largest number of probes that may be made to edges incident to vvv. Write δ(v)\delta(v)δ(v) for the edges incident to vvv.

LP (3). A vector (ye)e∈E(y_e)_{e \in E}(ye​)e∈E​ is feasible if

0≤ye≤1,∑e∈δ(v)yepe≤1,∑e∈δ(v)ye≤tv(e∈E, v∈V).0 \le y_e \le 1, \qquad \sum_{e \in \delta(v)} y_e p_e \le 1, \qquad \sum_{e \in \delta(v)} y_e \le t_v \quad (e \in E,\ v \in V).0≤ye​≤1,e∈δ(v)∑​ye​pe​≤1,e∈δ(v)∑​ye​≤tv​(e∈E, v∈V).

Here yey_eye​ is the probability of probing eee.

Attenuation. An attenuation function a~:[0,1]→[0,1]\tilde a : [0,1] \to [0,1]a~:[0,1]→[0,1] assigns to edge eee the probability a(e)=a~(peye)a(e) = \tilde a(p_e y_e)a(e)=a~(pe​ye​). It is effective (Definition 3) if a~(0)=1\tilde a(0) = 1a~(0)=1 and z↦ln⁡(1−xza~(z))z \mapsto \ln(1 - x z \tilde a(z))z↦ln(1−xza~(z)) is convex on [0,1][0,1][0,1] for every x∈(0,1)x \in (0,1)x∈(0,1). The two functions used here are a~exp⁡(z)=e−z/2\tilde a_{\exp}(z) = e^{-z/2}a~exp​(z)=e−z/2 and a~lin(z)=1−z/2\tilde a_{\mathrm{lin}}(z) = 1 - z/2a~lin​(z)=1−z/2 (Definition 4 with α=1/2\alpha = 1/2α=1/2).

Algorithm 1. Draw independent coins Ye∼Bernoulli(ye)Y_e \sim \mathrm{Bernoulli}(y_e)Ye​∼Bernoulli(ye​) and Ae∼Bernoulli(a(e))A_e \sim \mathrm{Bernoulli}(a(e))Ae​∼Bernoulli(a(e)) for every edge, and process the edges in a uniformly random order. When eee is processed it is free if both endpoints are unmatched and have made fewer than their patience in probes. If eee is free and Ye=Ae=1Y_e = A_e = 1Ye​=Ae​=1, probe eee; if it is active (coin Pe∼Bernoulli(pe)P_e \sim \mathrm{Bernoulli}(p_e)Pe​∼Bernoulli(pe​)), match it and both endpoints. Finally

β∗=∫01(e−2x+xe−2x)2 dx≈0.38278.\beta^* = \int_0^1 \bigl(e^{-2x} + x e^{-2x}\bigr)^2\,dx \approx 0.38278.β∗=∫01​(e−2x+xe−2x)2dx≈0.38278.

Formalization targets

Goal: Theorem 1 (p. 9)

If every vertex has patience at least 222, yyy is feasible for LP (3), and a~\tilde aa~ is a~exp⁡\tilde a_{\exp}a~exp​ or a~lin\tilde a_{\mathrm{lin}}a~lin​, then for every edge eee

a(e)⋅Pr⁡[e is free]  ≥  β∗.a(e) \cdot \Pr[e \text{ is free}] \;\ge\; \beta^*.a(e)⋅Pr[e is free]≥β∗.

The probability is over the random order and the coins of Algorithm 1.

Milestones

The milestones are numbered results and displays of the paper, in the order its argument uses them:

  1. a~exp⁡\tilde a_{\exp}a~exp​ and a~lin\tilde a_{\mathrm{lin}}a~lin​ with α=1/2\alpha = 1/2α=1/2 are effective (Definition 4, p. 9).
  2. (7), p. 10: a safe edge (one whose neighbourhood has neither a successful probe nor an exhausted patience before it arrives) is free, so a(e)Pr⁡[e is free]≥a~(peye)Pr⁡[e is safe]a(e)\Pr[e \text{ is free}] \ge \tilde a(p_e y_e)\Pr[e \text{ is safe}]a(e)Pr[e is free]≥a~(pe​ye​)Pr[e is safe].
  3. Lemma 3, p. 11: ∏f∈E1(r)(1−x a(f)yf)≥e−x∑f∈E1(r)yf\prod_{f \in E_1(r)} (1 - x\,a(f) y_f) \ge e^{-x \sum_{f \in E_1(r)} y_f}∏f∈E1​(r)​(1−xa(f)yf​)≥e−x∑f∈E1​(r)​yf​ for an effective attenuation, where E1(r)E_1(r)E1​(r) is the set of edges at rrr other than eee with pf=1p_f = 1pf​=1.
  4. Lemma 4, p. 12 (Baveja et al.): Pr⁡[∑iBi<t]≥Pr⁡[Pois(μ)<t]\Pr[\sum_i B_i < t] \ge \Pr[\mathrm{Pois}(\mu) < t]Pr[∑i​Bi​<t]≥Pr[Pois(μ)<t] for independent Bernoullis with mean sum μ<t−1\mu < t - 1μ<t−1.
  5. Lemma 5, p. 12: the Chernoff bound Pr⁡[∑iBi<(1+ε)μ]≥1−e−ε2μ/(2+ε)\Pr[\sum_i B_i < (1+\varepsilon)\mu] \ge 1 - e^{-\varepsilon^2 \mu/(2+\varepsilon)}Pr[∑i​Bi​<(1+ε)μ]≥1−e−ε2μ/(2+ε).
  6. Proposition 1, p. 14: ∫01λφ≥λ(z∗)∫01φ\int_0^1 \lambda\varphi \ge \lambda(z^*)\int_0^1 \varphi∫01​λφ≥λ(z∗)∫01​φ for λ≥0\lambda \ge 0λ≥0 non-increasing and φ\varphiφ changing sign once, from +++ to −-−, at z∗z^*z∗.
  7. (22), p. 15: a~(ye)∫01(e−x(2−ye)+xe−x(2−ye))2 dx≥β∗\tilde a(y_e)\int_0^1 (e^{-x(2-y_e)} + x e^{-x(2-y_e)})^2\,dx \ge \beta^*a~(ye​)∫01​(e−x(2−ye​)+xe−x(2−ye​))2dx≥β∗ on [0,1][0,1][0,1], with equality at ye=0y_e = 0ye​=0.

Significance

The result. Equation (4) of the paper writes the expected weight of the algorithm's matching as ∑ewepeye a(e)Pr⁡[e is free]\sum_e w_e p_e y_e\, a(e)\Pr[e \text{ is free}]∑e​we​pe​ye​a(e)Pr[e is free]. Theorem 1 therefore gives at least β∗∑ewepeye\beta^* \sum_e w_e p_e y_eβ∗∑e​we​pe​ye​, and with an optimal LP solution and the LP upper bound of Bansal et al. this is a 0.3820.3820.382-approximation for stochastic matching on general graphs with patience at least 222. The bound is per edge, which is the form a random-order contention resolution scheme needs: the same algorithm rounds fractional matchings edge by edge.

Formalizing it. The paper's proof combines a reduction (Lemma 2), the analytic bound of Lemma 3, the tail bounds of Lemmas 4–5, an exchange argument (Lemma 6) resting on a graph construction from another paper, and a case analysis in the patience values that is closed by numerical minimization of explicit integrals over two or three parameters ("we numerically minimize (12)", p. 13; "we numerically verify", p. 15). The margins are thin: the bound 0.38280.38280.3828 in the last case exceeds β∗\beta^*β∗ by about 5⋅10−55 \cdot 10^{-5}5⋅10−5. No part of this argument has a machine-checked proof. A formal proof would certify both the probabilistic reasoning and every numerical step, and would supply a reusable finite model of random-order probing algorithms with patience, of which the platform has none.

Difficulty

The obvious argument bounds Pr⁡[e is free]\Pr[e \text{ is free}]Pr[e is free] by a product over the two endpoints of eee and applies a Poisson approximation to the number of probes at each endpoint. For an endpoint of patience 222 that approximation is only valid for arrival times x<xcx < x_cx<xc​, a threshold that can be 1/21/21/2, and the bound it gives, about 0.3470.3470.347 (display (16)), falls below β∗\beta^*β∗. Closing that case is what requires the exchange argument of Lemma 6. Beyond it, the remaining cases are optimization problems over the LP mass at each endpoint, which the paper settles by computer and a formal proof must settle by rigorous bounds.

Formalization scope

  • The graph is the platform's EdmondsMatching65.Polyhedron.Graph (loopless); the goal adds that the endpoint map is injective, since the paper's edges are pairs {u,v}\{u,v\}{u,v}. Patience is ℕ∞, with ∞\infty∞ allowed; "minimum patience 222" is tv≥2t_v \ge 2tv​≥2 at every vertex.
  • Standing assumptions: pe∈[0,1]p_e \in [0,1]pe​∈[0,1] for every edge; yyy feasible for LP (3) (which includes ye∈[0,1]y_e \in [0,1]ye​∈[0,1]).
  • Every probability is a finite average: over the ∣E∣!|E|!∣E∣! orders of the edges and over the 23∣E∣2^{3|E|}23∣E∣ outcomes of the coins Y,A,PY, A, PY,A,P, each weighted by a product of Bernoulli weights. The paper's continuous arrival times induce exactly this uniform order. Pr⁡[e is free]\Pr[e \text{ is free}]Pr[e is free] is computed from the run of Algorithm 1 (matched vertices and probe counters, step by step), never from the product formulas of p. 11, which would assume the lemmas being proved.
  • The goal is stated for a~exp⁡\tilde a_{\exp}a~exp​ and a~lin\tilde a_{\mathrm{lin}}a~lin​ with α=1/2\alpha = 1/2α=1/2. Theorem 1 cites "Definition 3 where α=1/2\alpha = 1/2α=1/2"; α\alphaα belongs to Definition 4, and an arbitrary effective function would make the statement false. The third function of Definition 4 is not effective (its ln⁡(1−xza~(z))\ln(1 - xz\tilde a(z))ln(1−xza~(z)) is concave near z=0z = 0z=0 for xxx close to 111), so neither the effectiveness milestone nor the goal covers it.
  • Lemma 4 prints e−xμe^{-x\mu}e−xμ in the Poisson sum; the statement uses e−μe^{-\mu}e−μ.
  • A formalization that defines "free" without the patience counters or the matched set, one that bounds Pr⁡[e is safe]\Pr[e \text{ is safe}]Pr[e is safe] or the integral (8) instead of a(e)Pr⁡[e is free]a(e)\Pr[e \text{ is free}]a(e)Pr[e is free], or one stated for "some" attenuation function, is a different theorem and does not count.
  • Not stated: Lemma 2 (a without-loss-of-generality reduction), Lemma 6 (its hypothesis is a graph built in another paper, with property (18) asserted there), the conditional bounds (8)–(17) and (23)–(25), whose objects live inside the proof, and the numerical values of pp. 13–15. Solvers who need them are welcome to state them as their own lemmas. The paper's proofs are in §3.2, pp. 9–15.
  • Reusable beyond this mission: the finite model of Algorithm 1 and its events, Lemma 4 (Bernoulli versus Poisson lower tails), Lemma 5 (a Chernoff bound for independent Bernoullis), and Proposition 1.

Selected references

  • B. Brubach, N. Grammel, W. Ma, C. MacRury, A. Srinivasan, Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes, Mathematics of Operations Research, 2025; arXiv:2106.06892v3 (20 Apr 2026). https://arxiv.org/abs/2106.06892v3
  • N. Bansal, A. Gupta, J. Li, J. Mestre, V. Nagarajan, A. Rudra, When LP is the cure for your matching woes: improved bounds for stochastic matchings, Algorithmica 63(4):733–762, 2012 (reference [7] of the paper).
  • A. Baveja, A. Chavan, A. Nikiforov, A. Srinivasan, P. Xu, Improved bounds in stochastic matching and optimization, Algorithmica 80(11):3225–3252, 2018 (reference [8]; source of Lemma 4).
  • M. Adamczyk, F. Grandoni, J. Mukherjee, Improved approximation algorithms for stochastic matching, ESA 2015, 1–12 (reference [1]).
  • N. Chen, N. Immorlica, A. R. Karlin, M. Mahdian, A. Rudra, Approximating matches made in heaven, ICALP 2009, 266–278 (reference [15]).
10 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes II: With Infinite Patience, Attenuated Random-Order Probing Probes Each Edge w.p. ≥ (1 − e^(−2))y_e/2Research Paper

Motivation

In stochastic matching a platform knows, for every potential pair, the probability that the pair would succeed, but learns whether it does only by trying it, and a successful trial is binding. Kidney exchange, online dating and labour markets are the standard examples: a crossmatch test, a date or an interview is a probe whose outcome is random, and a positive outcome commits both sides. Each participant also tolerates only a limited number of attempts, its patience. The algorithmic question, studied since Chen, Immorlica, Karlin, Mahdian and Rudra (ICALP 2009), is how much of the optimal adaptive strategy's expected weight a simple, non-adaptive rule can secure.

The modern approach solves a linear programming relaxation and rounds its fractional solution online, through a contention resolution scheme: edges are examined one at a time, and an edge is used only when it does not conflict with earlier decisions. Bansal, Gupta, Li, Mestre, Nagarajan and Rudra (Algorithmica 2012) introduced the relaxation (LP (3) below) and showed that it bounds every adaptive probing algorithm. Baveja, Chavan, Nikiforov, Srinivasan and Xu (Algorithmica 2018) analysed processing edges in a uniformly random order. Brubach, Grammel, Ma, MacRury and Srinivasan (Mathematics of Operations Research, 2025; arXiv:2106.06892) add attenuation: an independent coin that sometimes skips an edge on purpose, so that edges likely to block others are probed less often. This mission formalizes their guarantee when patience is unlimited.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite graph. Each edge eee is active independently with known probability pe∈[0,1]p_e\in[0,1]pe​∈[0,1], and each vertex vvv has a patience tv∈N∪{∞}t_v\in\mathbb N\cup\{\infty\}tv​∈N∪{∞}, the maximal number of edges at vvv that may be probed. Write δ(v)\delta(v)δ(v) for the edges incident to vvv. A vector (ye)e∈E(y_e)_{e\in E}(ye​)e∈E​ is feasible for LP (3) when

0≤ye≤1,∑e∈δ(v)yepe≤1,∑e∈δ(v)ye≤tv(e∈E, v∈V);0\le y_e\le 1,\qquad \sum_{e\in\delta(v)}y_ep_e\le 1,\qquad \sum_{e\in\delta(v)}y_e\le t_v\qquad(e\in E,\ v\in V);0≤ye​≤1,e∈δ(v)∑​ye​pe​≤1,e∈δ(v)∑​ye​≤tv​(e∈E, v∈V);

yey_eye​ is read as the probability of probing eee, and ze=yepez_e=y_ep_eze​=ye​pe​ as the probability that eee is matched.

An attenuation function is a map a~:[0,1]→[0,1]\tilde a:[0,1]\to[0,1]a~:[0,1]→[0,1], and the attenuation of an edge is a(e)=a~(peye)a(e)=\tilde a(p_ey_e)a(e)=a~(pe​ye​). The paper's examples (Definition 4) are a~exp⁡(z)=e−αz\tilde a_{\exp}(z)=e^{-\alpha z}a~exp​(z)=e−αz, a~lin(z)=1−αz\tilde a_{\rm lin}(z)=1-\alpha za~lin​(z)=1−αz, and a~(z)=1−z1−e−(1−z)(1−1/e)\tilde a(z)=\frac{1-z}{1-e^{-(1-z)}}(1-1/e)a~(z)=1−e−(1−z)1−z​(1−1/e). A function is effective (Definition 3) when a~(0)=1\tilde a(0)=1a~(0)=1 and z↦ln⁡(1−xza~(z))z\mapsto\ln(1-xz\tilde a(z))z↦ln(1−xza~(z)) is convex on [0,1][0,1][0,1] for every x∈(0,1)x\in(0,1)x∈(0,1).

Algorithm 1 draws independent coins Ye∼Bernoulli(ye)Y_e\sim\mathrm{Bernoulli}(y_e)Ye​∼Bernoulli(ye​) and Ae∼Bernoulli(a(e))A_e\sim\mathrm{Bernoulli}(a(e))Ae​∼Bernoulli(a(e)) and processes the edges in a uniformly random order. When it reaches eee, it probes eee if eee is free (both endpoints unmatched and with remaining patience), Ye=1Y_e=1Ye​=1 and Ae=1A_e=1Ae​=1. A probe uses one unit of patience at both endpoints and reveals the activeness Pe∼Bernoulli(pe)P_e\sim\mathrm{Bernoulli}(p_e)Pe​∼Bernoulli(pe​); if Pe=1P_e=1Pe​=1, both endpoints are matched. The edge e={u,v}e=\{u,v\}e={u,v} is safe when, before eee is processed, each endpoint rrr has received at most tr−1t_r-1tr​−1 probes and no earlier edge f≠ef\neq ef=e at uuu or vvv has AfPfYf=1A_fP_fY_f=1Af​Pf​Yf​=1.

Formalization targets

Goal: Corollary 5 (p. 16)

If every patience is ∞\infty∞, (ye)(y_e)(ye​) is feasible for LP (3), and a~\tilde aa~ is a~exp⁡\tilde a_{\exp}a~exp​ or a~lin\tilde a_{\rm lin}a~lin​ with α=1/2\alpha=1/2α=1/2, then for every edge eee

Pr⁡[Algorithm 1 probes e] ≥ (∫01e−2x dx)ye=12(1−e−2)ye≈0.432 ye.\Pr[\text{Algorithm 1 probes }e]\ \ge\ \Bigl(\int_0^1e^{-2x}\,dx\Bigr)y_e=\tfrac12\bigl(1-e^{-2}\bigr)y_e\approx0.432\,y_e .Pr[Algorithm 1 probes e] ≥ (∫01​e−2xdx)ye​=21​(1−e−2)ye​≈0.432ye​.

Milestones

  1. The exponential and linear functions with α=1/2\alpha=1/2α=1/2 are effective (p. 9).
  2. Equation (4) (p. 9): the expected matched weight is ∑ewepePr⁡[e free]Pr⁡[Ye=1∩Ae=1]=∑ewepeyea(e)Pr⁡[e free]\sum_ew_ep_e\Pr[e\text{ free}]\Pr[Y_e=1\cap A_e=1]=\sum_ew_ep_ey_ea(e)\Pr[e\text{ free}]∑e​we​pe​Pr[e free]Pr[Ye​=1∩Ae​=1]=∑e​we​pe​ye​a(e)Pr[e free].
  3. Equation (7) (p. 10): a(e)Pr⁡[e is free]≥a~(peye)Pr⁡[e is safe]a(e)\Pr[e\text{ is free}]\ge\tilde a(p_ey_e)\Pr[e\text{ is safe}]a(e)Pr[e is free]≥a~(pe​ye​)Pr[e is safe].
  4. Lemma 3 (p. 11): ∏f∈E1(r)(1−xa(f)yf)≥e−x∑f∈E1(r)yf\prod_{f\in E_1(r)}(1-xa(f)y_f)\ge e^{-x\sum_{f\in E_1(r)}y_f}∏f∈E1​(r)​(1−xa(f)yf​)≥e−x∑f∈E1​(r)​yf​ for effective a~\tilde aa~, where E1(r)E_1(r)E1​(r) is the set of edges f≠ef\neq ef=e at rrr with pf=1p_f=1pf​=1.
  5. §3.3 (p. 16): z↦a~(z)∫01e−2x(1−z)dxz\mapsto\tilde a(z)\int_0^1e^{-2x(1-z)}dxz↦a~(z)∫01​e−2x(1−z)dx is minimized on [0,1][0,1][0,1] at z=0z=0z=0.

Companion: Corollary 6 (p. 16)

On a star graph with infinite patience and the third attenuation function, Pr⁡[e is probed]≥(1−1/e) ye\Pr[e\text{ is probed}]\ge(1-1/e)\,y_ePr[e is probed]≥(1−1/e)ye​. It comes with the identity of p. 16 behind it: for the third function, a~(z)∫01e−x(1−z)dx=1−1/e\tilde a(z)\int_0^1e^{-x(1-z)}dx=1-1/ea~(z)∫01​e−x(1−z)dx=1−1/e for all z∈[0,1]z\in[0,1]z∈[0,1]. Both are plain items of the mission, not milestones.

Significance

By (4), Corollary 5 bounds the expected weight of Algorithm 1 by 12(1−e−2)∑ewepeye\frac12(1-e^{-2})\sum_ew_ep_ey_e21​(1−e−2)∑e​we​pe​ye​, and with an optimal yyy and the bound of Bansal et al. this is a 0.4320.4320.432-approximation for stochastic matching without patience constraints. Because the bound holds edge by edge and for every feasible yyy, it also gives a random-order contention resolution scheme for the matching polytope, which is the form reused for other objectives and in online settings. Corollary 6 is the rank-one analogue with the constant 1−1/e1-1/e1−1/e.

None of this is formalized. Stochastic probing, patience, random-order processing and attenuation have no counterpart in Mathlib or on the platform. The mission produces a finite, executable model of a probing algorithm run on random coins and a random order, in which these probabilities are exact finite sums; that model is reusable for the other results of the paper and for related rounding schemes. The paper's results are proved in §3.2 (pp. 9–15) and §3.3 (p. 16); the milestones are the steps used there.

Difficulty

The obvious argument treats the edges at the two endpoints of eee as independent obstacles, each blocking eee with probability proportional to its LP value. That fails because being free is not a product event: whether an earlier edge fff blocks eee depends on whether fff was itself free, which depends on the whole run before fff. A second difficulty is uniformity. The bound must hold for every feasible yyy, and the LP mass at an endpoint can be split among arbitrarily many edges of arbitrary sizes; the quantities involved are not monotone in how that mass is split, and the bound must survive the worst split, including the limit of many tiny edges. The choice of attenuation matters here: the third function of Definition 4 violates the convexity condition of Definition 3, which is why Corollary 6 is not covered by the paper's argument. Finally, the paper reasons with continuous arrival times, while the model has only permutations and finitely many coins.

Formalization scope

  • Model. The graph is the platform's EdmondsMatching65.Polyhedron.Graph (finite, loopless, parallel edges allowed). Probabilities ppp, LP values yyy, weights www and attenuations are real; patience is in ℕ∞, with ⊤=∞\top=\infty⊤=∞. Every probability is a finite average over the ∣E∣!|E|!∣E∣! orders of EEE and over all outcomes of the coins YYY, AAA, PPP, with product weights. The paper's independent uniform arrival times induce exactly this uniform order. The run of Algorithm 1 is computed step by step, with matched vertices and probe counters; free, probed and safe are events of that run.
  • Standing assumptions. 0≤pe≤10\le p_e\le10≤pe​≤1 for every edge (the meaning of "probability of being active"); LP (3) feasibility, which contains 0≤ye≤10\le y_e\le10≤ye​≤1; attenuations with values in [0,1][0,1][0,1] on [0,1][0,1][0,1].
  • Disclosed choices. Corollary 5 is stated for a~exp⁡\tilde a_{\exp}a~exp​ and a~lin\tilde a_{\rm lin}a~lin​ with α=1/2\alpha=1/2α=1/2: the corollary says "the effective attenuation functions from Definition 4", its proof names these two, and the third function fails Definition 3 (g′′(0)<0g''(0)<0g′′(0)<0 for xxx near 1). The effectiveness milestone is stated for these two only. The third function is given its limit 1−1/e1-1/e1−1/e at z=1z=1z=1, where the printed formula is 0/00/00/0. Corollary 6 is a companion item, not a milestone: the paper's argument for it passes through Lemma 3, which does not apply to the third function, so it is supported by numerical checks but its printed proof has a gap.
  • Not stated. The approximation-ratio and "balanced contention resolution scheme" sentences of Corollaries 5 and 6 need a model of all adaptive probing algorithms (Lemma 1 of the paper, from Bansal et al.) and are out of scope; the goals are the displayed probability bounds.
  • Ruled out. Defining Pr⁡[e is free]\Pr[e\text{ is free}]Pr[e is free] or Pr⁡[e is probed]\Pr[e\text{ is probed}]Pr[e is probed] by the product formula of p. 11 instead of from the run, or stating the goal for "some" attenuation function, would make the goal a different and easier theorem; neither is done.
  • Welcome contributions. Proofs of the milestones; a general lemma that an event depending only on the edges before eee is independent of eee's coins; a conditioning-on-arrival-time lemma for uniform permutations; a proof (or a counterexample) for Corollary 6.

Selected references

  • B. Brubach, N. Grammel, W. Ma, C. MacRury, A. Srinivasan, Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes, Mathematics of Operations Research, 2025; arXiv:2106.06892v3. https://arxiv.org/abs/2106.06892
  • N. Bansal, A. Gupta, J. Li, J. Mestre, V. Nagarajan, A. Rudra, When LP Is the Cure for Your Matching Woes: Improved Bounds for Stochastic Matchings, Algorithmica 63(4):733–762, 2012. https://link.springer.com/journal/453/volumes-and-issues/63-4
  • A. Baveja, A. Chavan, A. Nikiforov, A. Srinivasan, P. Xu, Improved Bounds in Stochastic Matching and Optimization, Algorithmica 80(11):3225–3252, 2018. https://link.springer.com/journal/453/volumes-and-issues/80-11
  • N. Chen, N. Immorlica, A. R. Karlin, M. Mahdian, A. Rudra, Approximating Matches Made in Heaven, ICALP 2009, LNCS 5555. https://doi.org/10.1007/978-3-642-02927-1
8 thms1 active userReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Human in the Loop Automation: Ride-Hailing with Remote (Tele-)Drivers 5: In a Large Supply-Rich Market, a Driver-to-Vehicle Ratio of 1/α Asymptotically SufficesResearch Paper

Motivation

Tele-driving separates a ride-hailing driver from the vehicle: a remote driver operates a car over a wireless link, and on finishing a trip can immediately take control of another car anywhere in the service region. Several companies have run pilots of this model; Benjaafar, Wang and Yang cite Vay's car-sharing service operated by tele-drivers and Halo's remotely operated robo-taxi pilot with T-Mobile. A platform with remote drivers can therefore hold more vehicles than drivers. The practical question is how many drivers such a platform needs.

Benjaafar, Wang and Yang (SSRN 4130757; published in Management Science, 2024, doi:10.1287/mnsc.2022.01687) model the system as a loss system with a state-dependent service rate and compare a fleet with nnn remote drivers to one with a driver in every vehicle (n=mn = mn=m). This mission formalizes their answer for large markets that have many vehicles relative to demand (the supply-rich regime): asymptotically, a fraction 1/α1/\alpha1/α of the fleet size suffices, where α>2\alpha > 2α>2 measures how much the fleet exceeds the offered load. All page numbers refer to the SSRN working paper, version of 1 June 2023, which is the source of this mission.

Setting

Customers arrive as a Poisson process of rate λ>0\lambda > 0λ>0. The platform has mmm vehicles and n≤mn \le mn≤m remote drivers. When qqq customers are being served, trips are completed at total rate q μ(m,q)q\,\mu(m,q)qμ(m,q), where the service rate μ(m,q)\mu(m,q)μ(m,q) accounts for the pick-up time (which shrinks as more idle vehicles are available) and the trip time. A customer arriving while all nnn drivers are busy is lost. With

ρ(q)=λq μ(m,q)(1)\rho(q) = \frac{\lambda}{q\,\mu(m,q)} \qquad (1)ρ(q)=qμ(m,q)λ​(1)

the number of customers in service is a birth–death process on {0,…,n}\{0, \dots, n\}{0,…,n} with stationary distribution

πm,n(0)=[1+∑i=1n∏k=1iρ(k)]−1,πm,n(q)=πm,n(0)∏k=1qρ(k),1≤q≤n.(2)–(3)\pi_{m,n}(0) = \Big[1 + \sum_{i=1}^{n}\prod_{k=1}^{i}\rho(k)\Big]^{-1}, \qquad \pi_{m,n}(q) = \pi_{m,n}(0)\prod_{k=1}^{q}\rho(k), \quad 1 \le q \le n. \qquad (2)\text{–}(3)πm,n​(0)=[1+i=1∑n​k=1∏i​ρ(k)]−1,πm,n​(q)=πm,n​(0)k=1∏q​ρ(k),1≤q≤n.(2)–(3)

The service level, the long-run fraction of demand served, is SL(m,n)=1−πm,n(n)SL(m,n) = 1 - \pi_{m,n}(n)SL(m,n)=1−πm,n​(n).

For the asymptotic analysis the paper uses the service rate of Besbes et al.,

μ(m,q)=[sm−q+1+s]−1,(4)\mu(m,q) = \Big[\frac{s}{\sqrt{m-q+1}} + s\Big]^{-1}, \qquad (4)μ(m,q)=[m−q+1​s​+s]−1,(4)

where s>0s > 0s>0 is the mean trip time and s/m−q+1s/\sqrt{m-q+1}s/m−q+1​ the mean pick-up time with m−qm - qm−q idle vehicles. The fleet grows with demand as mλ=⌊αλs⌋m_\lambda = \lfloor \alpha\lambda s\rfloormλ​=⌊αλs⌋ for a constant α>0\alpha > 0α>0; the offered load is λs\lambda sλs, so α\alphaα is the ratio of fleet size to offered load. The supply-rich regime is α>2\alpha > 2α>2.

For the rate (4) and m>2λsm > 2\lambda sm>2λs, the equation ρ(q)=1\rho(q) = 1ρ(q)=1 has a unique root q3q_3q3​ in [λs,m][\lambda s, m][λs,m]; to its left ρ>1\rho > 1ρ>1 (the chain drifts upward), to its right ρ<1\rho < 1ρ<1. For a tolerance ϵ>0\epsilon > 0ϵ>0 the paper defines

nλ∗=min⁡{ n:SL(mλ,mλ)−SL(mλ,n)<ϵ },n^*_\lambda = \min\{\, n : SL(m_\lambda, m_\lambda) - SL(m_\lambda, n) < \epsilon \,\},nλ∗​=min{n:SL(mλ​,mλ​)−SL(mλ​,n)<ϵ},

the smallest number of remote drivers whose service level is within ϵ\epsilonϵ of that of a fleet with one driver per vehicle.

Formalization targets

Goal: Theorem 2.C (p. 22)

For α>2\alpha > 2α>2 and every ϵ>0\epsilon > 0ϵ>0,

lim sup⁡λ→∞nλ∗mλ≤1α.\limsup_{\lambda\to\infty} \frac{n^*_\lambda}{m_\lambda} \le \frac{1}{\alpha}.λ→∞limsup​mλ​nλ∗​​≤α1​.

The bound does not depend on ϵ\epsilonϵ, and since α>2\alpha > 2α>2 it says that a large supply-rich system can be run with at most about half as many drivers as vehicles.

Milestones

  1. App. D, case (iii) (p. 42): for the rate (4) and m>2λsm > 2\lambda sm>2λs, ρ(q)=1\rho(q) = 1ρ(q)=1 has a unique root q∗∈[λs,m]q^* \in [\lambda s, m]q∗∈[λs,m], and on (0,m](0, m](0,m], ρ(q)<1\rho(q) < 1ρ(q)<1 exactly when q>q∗q > q^*q>q∗.
  2. App. D.3 (p. 48): lim⁡λ→∞λs/q3=1\lim_{\lambda\to\infty} \lambda s / q_3 = 1limλ→∞​λs/q3​=1.
  3. Lemma 5 (pp. 47–48): with nϵ=⌊(1+ϵ)q3⌋n_\epsilon = \lfloor (1+\epsilon) q_3\rfloornϵ​=⌊(1+ϵ)q3​⌋ drivers,
lim⁡λ→∞[∑i=⌊(1+ϵ/2)q3⌋nϵπmλ,nϵ(i)+∑i=0⌊(1−ϵ/2)q3⌋πmλ,nϵ(i)]=0.\lim_{\lambda\to\infty}\Big[\sum_{i=\lfloor (1+\epsilon/2)q_3\rfloor}^{n_\epsilon}\pi_{m_\lambda,n_\epsilon}(i) + \sum_{i=0}^{\lfloor(1-\epsilon/2)q_3\rfloor}\pi_{m_\lambda,n_\epsilon}(i)\Big] = 0.λ→∞lim​[i=⌊(1+ϵ/2)q3​⌋∑nϵ​​πmλ​,nϵ​​(i)+i=0∑⌊(1−ϵ/2)q3​⌋​πmλ​,nϵ​​(i)]=0.
  1. Footnote 14 (pp. 22–23): lim⁡λ→∞[SL(mλ,mλ)−SL(mλ,⌊(1+δ)q3⌋)]=0\lim_{\lambda\to\infty}\big[SL(m_\lambda,m_\lambda) - SL(m_\lambda, \lfloor(1+\delta)q_3\rfloor)\big] = 0limλ→∞​[SL(mλ​,mλ​)−SL(mλ​,⌊(1+δ)q3​⌋)]=0.

Significance

The result. Theorem 2.C quantifies the labour saving of tele-driving in markets where vehicles are plentiful. A conventional platform needs one driver per vehicle; a remote-driver platform with mλ≈αλsm_\lambda \approx \alpha\lambda smλ​≈αλs vehicles needs only about λs\lambda sλs drivers, essentially the offered load, while losing at most ϵ\epsilonϵ of service level. Together with Theorems 2.A and 2.B of the same paper (the supply-limited and intermediate regimes), it gives a complete asymptotic picture of when pooling drivers across vehicles pays off: in the supply-rich regime, the gain appears as fewer drivers rather than as a higher service level. Footnote 14 strengthens this: the service level with (1+δ)q3(1+\delta)q_3(1+δ)q3​ drivers matches the full-staffing service level in the limit.

Formalizing it. The result is proved on paper in Appendix D.3; it has no machine-checked proof. The formalization adds a precise reading of the limit statements (the range of the minimum defining nλ∗n^*_\lambdanλ∗​, the meaning of "small ϵ\epsilonϵ") and a verified account of the concentration of a birth–death distribution with a state-dependent rate, in the form of Lemma 5. The same model underlies four sibling missions on this paper.

Difficulty

The obvious first idea, comparing SL(m,n)SL(m,n)SL(m,n) with the Erlang loss formula for a constant service rate, does not apply: under (4) the service rate depends on the state through the pick-up time, so the stationary weights ∏k≤qρ(k)\prod_{k\le q}\rho(k)∏k≤q​ρ(k) are not Poisson probabilities and their tails have no closed form. The quantities that govern the answer are defined only implicitly: the critical point q3q_3q3​ solves ρ(q)=1\rho(q) = 1ρ(q)=1, and its explicit expression (17) involves the arccosine of a cubic's coefficients, which is unusable for estimates. The statements also take a limit λ→∞\lambda\to\inftyλ→∞ in which the number of states, the root q3q_3q3​ and the floors ⌊(1±ϵ/2)q3⌋\lfloor(1\pm\epsilon/2)q_3\rfloor⌊(1±ϵ/2)q3​⌋ all move together, so any bound on the stationary distribution must hold uniformly along this family rather than for a fixed chain. Finally, nλ∗n^*_\lambdanλ∗​ is a minimum over integers of a difference of service levels, and the goal concerns its growth rate relative to mλm_\lambdamλ​, not a single system.

Formalization scope

The Lean development lives in the namespace TeleDriving.AsymRich.

  • Model. rho mu lam m q is (1) with qqq real; piMN mu lam m n q and SL mu lam m n are (2)–(3) and the service level, with q,nq, nq,n natural; muBesbes s is the rate (4); mLam alpha s lam is ⌊αλs⌋\lfloor\alpha\lambda s\rfloor⌊αλs⌋ as a natural-number floor. The shared Model file also contains the paper's Assumptions 1–2, its size restriction, the regime predicates and the maximal service-level ratio, which this mission does not use.
  • Domains. πm,n(q)\pi_{m,n}(q)πm,n​(q) is the paper's only for q≤nq \le nq≤n, SL(m,n)SL(m,n)SL(m,n) only for 1≤n≤m1 \le n \le m1≤n≤m, the rate (4) only for q≤m+1q \le m+1q≤m+1; Lean's junk values outside these ranges are never invoked by the statements.
  • nλ∗n^*_\lambdanλ∗​ (nStar) is the minimum over n∈{1,…,mλ}n \in \{1,\dots,m_\lambda\}n∈{1,…,mλ​}, a set that contains n=mλn = m_\lambdan=mλ​ when mλ≥1m_\lambda \ge 1mλ​≥1 and ϵ>0\epsilon > 0ϵ>0; the paper leaves this range implicit.
  • Limits are written in ε\varepsilonε-form: lim sup⁡f≤c\limsup f \le climsupf≤c as "for every δ>0\delta > 0δ>0, eventually f(λ)≤c+δf(\lambda) \le c + \deltaf(λ)≤c+δ"; plain limits use Filter.Tendsto along atTop on R\mathbb RR.
  • The root q3q_3q3​ is a function of λ\lambdaλ with the hypothesis that, for all sufficiently large λ\lambdaλ, λs≤q3(λ)≤mλ\lambda s \le q_3(\lambda) \le m_\lambdaλs≤q3​(λ)≤mλ​ and ρ(q3(λ))=1\rho(q_3(\lambda)) = 1ρ(q3​(λ))=1. By milestone 1 this determines q3(λ)q_3(\lambda)q3​(λ) uniquely once mλ>2λsm_\lambda > 2\lambda smλ​>2λs, which holds eventually for α>2\alpha > 2α>2. The closed form (17) is not used.
  • "Small ϵ\epsilonϵ" and "any δ>0\delta > 0δ>0" in Lemma 5 and footnote 14 are read as 0<ϵ,δ<α−10 < \epsilon, \delta < \alpha - 10<ϵ,δ<α−1: exactly in this range ⌊(1+ϵ)q3⌋≤mλ\lfloor(1+\epsilon)q_3\rfloor \le m_\lambda⌊(1+ϵ)q3​⌋≤mλ​ for large λ\lambdaλ, so the number of drivers does not exceed the number of vehicles. The goal's tolerance ϵ>0\epsilon > 0ϵ>0 is unrestricted, as printed.
  • The paper uses ϵ\epsilonϵ for both the service-level tolerance of Theorem 2.C and the window of Lemma 5; the Lean statements use distinct names.

The goal carries no hypothesis on π\piπ, SLSLSL, nλ∗n^*_\lambdanλ∗​ or q3q_3q3​: its only assumptions are s>0s > 0s>0, α>2\alpha > 2α>2 and ϵ>0\epsilon > 0ϵ>0, so it cannot be discharged by an assumption that makes the minimum small by fiat. A complete development needs elementary real analysis of the rate (4) (concavity of q/(λs)−1/m−q+1q/(\lambda s) - 1/\sqrt{m-q+1}q/(λs)−1/m−q+1​), estimates for products of ρ\rhoρ along integer ranges, and asymptotics with floors; the concentration estimate for birth–death chains with state-dependent rates is reusable beyond this mission. Proofs of any milestone are welcome, as are alternative arguments for the goal.

Selected references

  • S. Benjaafar, Z. Wang, X. Yang, Human in the Loop Automation: Ride-Hailing with Remote (Tele-)Drivers, SSRN working paper 4130757, version of 1 June 2023. https://ssrn.com/abstract=4130757 ; published in Management Science, 2024. https://doi.org/10.1287/mnsc.2022.01687
  • O. Besbes, F. Castro, I. Lobel, Spatial Capacity Planning, Operations Research 70(2), 2022. https://doi.org/10.1287/opre.2021.2112
7 thms1 active userReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Human in the Loop Automation: Ride-Hailing with Remote (Tele-)Drivers 3: In a Large Supply-Limited Market, Choosing the Number of Remote Drivers Raises Service Level by a Factor of at Least 2 − αResearch Paper

Motivation

Autonomous vehicles that cannot yet drive every trip on their own can be supervised or driven by remote (tele-)drivers who sit in a control center and take over a vehicle only while it serves a customer. Because a remote driver is not tied to one vehicle, a platform may operate more vehicles than drivers. Benjaafar, Wang and Yang ask when this decoupling pays off: given a fleet of mmm vehicles, how many remote drivers n≤mn \le mn≤m should a ride-hailing operator staff, and how much better is the best choice than the conventional one driver per vehicle (n=mn = mn=m)?

The question is sharpened by a feature of ride-hailing that classical loss systems lack. A trip consists of a pick-up leg and a delivery leg, and the pick-up leg is long when few vehicles are idle. Following Besbes, Castro and Lobel (2022), the paper models this through a state-dependent service rate: with qqq customers in service, each trip ends at rate μ(m,q)\mu(m,q)μ(m,q), which falls as qqq approaches mmm. Withholding drivers keeps idle vehicles available, shortens pick-ups and can raise throughput. This mission formalizes the asymptotic size of that gain in the supply-limited regime, where vehicles are scarce relative to demand.

The source is the authors' SSRN working paper (abstract 4130757, version of 1 June 2023); all numbering in this mission is that version's. The paper was published in Management Science in 2024.

Setting

Customers arrive as a Poisson process of rate λ>0\lambda > 0λ>0. A customer who arrives when all nnn remote drivers are busy is lost. The number qqq of customers in service is a birth–death process with birth rate λ\lambdaλ and death rate q μ(m,q)q\,\mu(m,q)qμ(m,q). Its load is

ρ(q)=λq μ(m,q)(1),\rho(q) = \frac{\lambda}{q\,\mu(m,q)} \qquad (1),ρ(q)=qμ(m,q)λ​(1),

and its stationary distribution is

πm,n(q)=∏k=1qρ(k)1+∑i=1n∏k=1iρ(k),0≤q≤n(2)–(3).\pi_{m,n}(q) = \frac{\prod_{k=1}^{q}\rho(k)}{1 + \sum_{i=1}^{n}\prod_{k=1}^{i}\rho(k)}, \qquad 0 \le q \le n \qquad (2)\text{–}(3).πm,n​(q)=1+∑i=1n​∏k=1i​ρ(k)∏k=1q​ρ(k)​,0≤q≤n(2)–(3).

The service level is the long-run fraction of demand served, SL(m,n)=1−πm,n(n)SL(m,n) = 1 - \pi_{m,n}(n)SL(m,n)=1−πm,n​(n).

The mission uses the service rate

μ(m,q)=[sm−q+1+s]−1(4),\mu(m,q) = \Big[\frac{s}{\sqrt{m-q+1}} + s\Big]^{-1} \qquad (4),μ(m,q)=[m−q+1​s​+s]−1(4),

where s>0s > 0s>0 is the expected trip time and s/m−q+1s/\sqrt{m-q+1}s/m−q+1​ is the expected pick-up time when m−qm - qm−q vehicles are idle. Demand and fleet scale together: for a fixed α>0\alpha > 0α>0 the fleet has

mλ=⌊αλs⌋m_\lambda = \lfloor \alpha\lambda s \rfloormλ​=⌊αλs⌋

vehicles. The load at full occupancy is ρ(mλ)=2λs/mλ→2/α\rho(m_\lambda) = 2\lambda s/m_\lambda \to 2/\alphaρ(mλ​)=2λs/mλ​→2/α. The case α∈(0,1)\alpha \in (0,1)α∈(0,1) is the supply-limited regime: there ρ(k)>1/α>1\rho(k) > 1/\alpha > 1ρ(k)>1/α>1 at every occupancy 1≤k≤mλ1 \le k \le m_\lambda1≤k≤mλ​.

In Lean the namespace is TeleDriving.AsymLimited; the functions are rho, piMN, SL, muBesbes (the rate (4)), mLam (mλm_\lambdamλ​) and maxSLRatio (the maximum below).

Formalization targets

Goal: Theorem 2.A (p. 22)

For α∈(0,1)\alpha \in (0,1)α∈(0,1),

lim inf⁡λ→∞ [max⁡n∈{1,…,mλ}SL(mλ,n)SL(mλ,mλ)] ≥ 2−α.\liminf_{\lambda\to\infty}\ \Big[\max_{n\in\{1,\dots,m_\lambda\}}\frac{SL(m_\lambda,n)}{SL(m_\lambda,m_\lambda)}\Big] \ \ge\ 2-\alpha.λ→∞liminf​ [n∈{1,…,mλ​}max​SL(mλ​,mλ​)SL(mλ​,n)​] ≥ 2−α.

The theorem asserts a lower bound on the limiting gain only; it does not assert that 2−α2-\alpha2−α is attained or that the limit exists.

Milestones (Appendix D.1, pp. 44–46)

With a=1/αa = 1/\alphaa=1/α:

  1. ρ(k)>1/α\rho(k) > 1/\alphaρ(k)>1/α for 1≤k≤mλ1 \le k \le m_\lambda1≤k≤mλ​ (p. 44).
  2. The comparison probability π~=1/[1+∑i=0mλ−11/(ρ(mλ)ai)]\tilde\pi = 1/\big[1+\sum_{i=0}^{m_\lambda-1} 1/(\rho(m_\lambda)a^i)\big]π~=1/[1+∑i=0mλ​−1​1/(ρ(mλ​)ai)] of (19) satisfies π~<πmλ,mλ(mλ)\tilde\pi < \pi_{m_\lambda,m_\lambda}(m_\lambda)π~<πmλ​,mλ​​(mλ​) and π~→(2a−2)/(2a−1)\tilde\pi \to (2a-2)/(2a-1)π~→(2a−2)/(2a−1) (p. 44).
  3. For m>4m > 4m>4, H(n)=1/ρ(n)H(n) = 1/\rho(n)H(n)=1/ρ(n) strictly increases and then strictly decreases on [0,m][0,m][0,m], so it has a unique maximizer n∗n^*n∗ (p. 45).
  4. For 0<ϵ<10 < \epsilon < 10<ϵ<1, ∑i=0⌊(1−ϵ)n∗⌋πmλ,⌊n∗⌋(i)→0\sum_{i=0}^{\lfloor(1-\epsilon)n^*\rfloor}\pi_{m_\lambda,\lfloor n^*\rfloor}(i) \to 0∑i=0⌊(1−ϵ)n∗⌋​πmλ​,⌊n∗⌋​(i)→0 (display (21), pp. 45–46).
  5. The comparison probability π^\hat\piπ^ of (22) satisfies π^→1−(1−ϵ)/a\hat\pi \to 1-(1-\epsilon)/aπ^→1−(1−ϵ)/a and π^>πmλ,⌊n∗⌋(⌊n∗⌋)\hat\pi > \pi_{m_\lambda,\lfloor n^*\rfloor}(\lfloor n^*\rfloor)π^>πmλ​,⌊n∗⌋​(⌊n∗⌋) (p. 46).

Significance

Theorem 2.A quantifies the value of decoupling drivers from vehicles when vehicles are scarce. A platform that staffs only enough remote drivers to keep some vehicles idle serves, asymptotically, at least 2−α2-\alpha2−α times the fraction of demand it would serve with one driver per vehicle. The bound decreases in α\alphaα and reaches 111 at α=1\alpha = 1α=1, where the companion Theorem 2.B (intermediate regime, α∈(1,2)\alpha \in (1,2)α∈(1,2)) shows the gain vanishes. Theorems 2.A–2.C together describe how the benefit of remote driving changes from supply-limited to supply-rich markets.

The result is proved in the paper, by explicit comparison distributions. As far as is known it has not been machine-checked; no ride-hailing or state-dependent loss-system result of this kind is formalized in Mathlib or on the platform. A formal proof would establish the asymptotics of a birth–death loss system whose rates depend on the system size in a non-classical way, using only elementary real analysis: geometric series, floors and limits of explicit expressions. The intermediate statements, such as the vanishing of the low-occupancy mass, are reusable for the sibling missions on Theorems 2.B and 2.C.

Difficulty

The obvious argument compares the two blocking probabilities with an Erlang loss system, but the load ρ(q)\rho(q)ρ(q) is not constant: it depends on qqq, on mλm_\lambdamλ​ and on λ\lambdaλ simultaneously, and all three grow together. Neither the stationary distribution with mλm_\lambdamλ​ drivers nor the one with the optimal number of drivers converges to a fixed geometric law. The goal concerns a ratio of two quantities that both tend to explicit nonzero limits only after the distribution has been localized near a moving maximizer n∗n^*n∗ of 1/ρ1/\rho1/ρ. That maximizer has a closed form only through cube roots, and the localization has to hold uniformly as λ→∞\lambda \to \inftyλ→∞. The two bounds also use different comparison distributions, and the floors ⌊n∗⌋\lfloor n^*\rfloor⌊n∗⌋, ⌊(1−ϵ)n∗⌋\lfloor(1-\epsilon)n^*\rfloor⌊(1−ϵ)n∗⌋ and ⌊αλs⌋\lfloor\alpha\lambda s\rfloor⌊αλs⌋ must be controlled at the same time.

Formalization scope

  • Model. μ\muμ is a function ℕ → ℝ → ℝ; the rate (4) is muBesbes s. ρ\rhoρ takes a real occupancy, while πm,n(q)\pi_{m,n}(q)πm,n​(q) and SL(m,n)SL(m,n)SL(m,n) take natural arguments. πm,n\pi_{m,n}πm,n​ is written as one quotient of products; it equals (2)–(3). The objects carry the page's meaning only on the page's domains (1≤q≤m1 \le q \le m1≤q≤m for ρ\rhoρ, 0≤q≤n≤m0 \le q \le n \le m0≤q≤n≤m for π\piπ), because Lean's division by 000 returns 000 and Real.sqrt of a negative number returns 000. Every statement stays inside these domains.
  • Standing hypotheses. s>0s > 0s>0 and α∈(0,1)\alpha \in (0,1)α∈(0,1). Assumptions 1–2 and the size restriction of p. 13 are part of the shared model file but are not hypotheses here: the rate (4) satisfies them, and the size restriction holds for all large λ\lambdaλ.
  • Maximum. max⁡n∈{1,…,m}\max_{n\in\{1,\dots,m\}}maxn∈{1,…,m}​ is a supremum over Fin m with index n↦n+1n \mapsto n+1n↦n+1. It ranges over n∈{1,…,mλ}n \in \{1,\dots,m_\lambda\}n∈{1,…,mλ​} only, and mλ≥1m_\lambda \ge 1mλ​≥1 for large λ\lambdaλ.
  • Limits. lim inf⁡≥c\liminf \ge climinf≥c is stated in ε\varepsilonε-form (for every ε>0\varepsilon > 0ε>0, eventually ≥c−ε\ge c-\varepsilon≥c−ε), and lim⁡\limlim as Filter.Tendsto along atTop on R\mathbb RR. The ε\varepsilonε of the liminf is not the ϵ\epsilonϵ of D.1's cut-off (1−ϵ)n∗(1-\epsilon)n^*(1−ϵ)n∗, which is named eps.
  • The maximizer n∗n^*n∗. It is a function of λ\lambdaλ, characterized by a hypothesis that holds for all large λ\lambdaλ: n∗(λ)∈[0,mλ]n^*(\lambda) \in [0,m_\lambda]n∗(λ)∈[0,mλ​] maximizes HHH there. It is not computed from the closed form (20), whose cube roots of negative numbers Lean's Real.rpow does not represent. The unimodality milestone is stated for every m>4m > 4m>4 and λ>0\lambda > 0λ>0; the page states it for m=mλm = m_\lambdam=mλ​.
  • Eventual inequalities. The strict inequalities π~<π\tilde\pi < \piπ~<π and π^>π\hat\pi > \piπ^>π are stated for large λ\lambdaλ, because they fail in degenerate small cases (mλ=1m_\lambda = 1mλ​=1; ⌊n∗⌋=⌊(1−ϵ)n∗⌋\lfloor n^*\rfloor = \lfloor(1-\epsilon)n^*\rfloor⌊n∗⌋=⌊(1−ϵ)n∗⌋).
  • Ruled out. No hypothesis states a limit of πmλ,mλ(mλ)\pi_{m_\lambda,m_\lambda}(m_\lambda)πmλ​,mλ​​(mλ​) or of any ratio, so the goal cannot be trivialized. The maximum is not taken over all nnn, so values of πm,n\pi_{m,n}πm,n​ outside the page's domain cannot enter.

No external library is needed beyond Mathlib. Proofs of any milestone are welcome, and so are alternative proofs of the goal that bypass them.

Selected references

  • S. Benjaafar, Z. Wang, X. Yang, Human in the Loop Automation: Ride-Hailing with Remote (Tele-)Drivers, SSRN working paper 4130757, version of 1 June 2023. https://ssrn.com/abstract=4130757 ; published in Management Science, 2024, https://doi.org/10.1287/mnsc.2022.01687
  • O. Besbes, F. Castro, I. Lobel, Spatial Capacity Planning, Operations Research 70(2), 2022. https://doi.org/10.1287/opre.2021.2112
8 thms1 active userReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Human in the Loop Automation: Ride-Hailing with Remote (Tele-)Drivers 4: In a Large Intermediate Market, Remote Drivers Bring No Asymptotic Service-Level GainResearch Paper

Why remote drivers in ride-hailing

In a conventional ride-hailing system every vehicle needs its own driver. Tele-driving, in which a vehicle is driven by a remote operator over a network, separates the two: a pool of nnn remote drivers can serve a fleet of m≥nm \ge nm≥n vehicles, each driver taking control of an idle vehicle near the next customer. Fewer drivers mean lower labor cost, but also fewer simultaneous trips; more vehicles mean shorter pick-up legs. Benjaafar, Wang and Yang (SSRN 4130757; published in Management Science, 2024, doi:10.1287/mnsc.2022.01687) model this trade-off as a loss system with a state-dependent service rate and ask when it pays to have fewer drivers than vehicles. This mission takes its asymptotic answer for markets that are neither short of vehicles nor flush with them.

The model

Customers arrive as a Poisson process of rate λ>0\lambda > 0λ>0. With mmm vehicles and qqq customers in service, each customer is served at rate μ(m,q)\mu(m,q)μ(m,q): the more vehicles are busy, the farther the nearest idle vehicle, and the slower a trip completes. A customer who finds all nnn drivers busy is lost. The number of customers in service is then a birth–death process on {0,…,n}\{0,\dots,n\}{0,…,n} with birth rate λ\lambdaλ and death rate qμ(m,q)q\mu(m,q)qμ(m,q). With the load ρ(q)=λ/(qμ(m,q))\rho(q) = \lambda/(q\mu(m,q))ρ(q)=λ/(qμ(m,q)) (equation (1) of the paper), its stationary distribution is

πm,n(q)=∏k=1qρ(k)1+∑i=1n∏k=1iρ(k),0≤q≤n,\pi_{m,n}(q) = \frac{\prod_{k=1}^{q}\rho(k)}{1+\sum_{i=1}^{n}\prod_{k=1}^{i}\rho(k)}, \qquad 0 \le q \le n,πm,n​(q)=1+∑i=1n​∏k=1i​ρ(k)∏k=1q​ρ(k)​,0≤q≤n,

(equations (2)–(3)), and the service level, the long-run fraction of demand served, is SL(m,n)=1−πm,n(n)SL(m,n) = 1 - \pi_{m,n}(n)SL(m,n)=1−πm,n​(n).

The asymptotic results use the service rate of Besbes, Castro and Lobel, equation (4):

μ(m,q)=[sm−q+1+s]−1,\mu(m,q) = \left[\frac{s}{\sqrt{m-q+1}} + s\right]^{-1},μ(m,q)=[m−q+1​s​+s]−1,

where s>0s > 0s>0 is the expected trip time between two uniformly drawn points of the service region and s/m−q+1s/\sqrt{m-q+1}s/m−q+1​ the pick-up time with m−qm-qm−q idle vehicles. The fleet grows in proportion to demand, mλ=⌊αλs⌋m_\lambda = \lfloor \alpha\lambda s\rfloormλ​=⌊αλs⌋ for a fixed α>0\alpha > 0α>0. For this rate the equation ρ(q)=1\rho(q) = 1ρ(q)=1 has, in the intermediate regime λs+3(λs/2)2/3−1<m<2λs\lambda s + 3(\lambda s/2)^{2/3} - 1 < m < 2\lambda sλs+3(λs/2)2/3−1<m<2λs (equation (14)), exactly two roots q1<q2q_1 < q_2q1​<q2​ in [λs,m][\lambda s, m][λs,m], and ρ<1\rho < 1ρ<1 strictly between them. For mλ=⌊αλs⌋m_\lambda = \lfloor\alpha\lambda s\rfloormλ​=⌊αλs⌋ this regime is α∈(1,2)\alpha \in (1,2)α∈(1,2) for large λ\lambdaλ.

Formalization targets

Goal: Theorem 2.B (p. 22)

For α∈(1,2)\alpha \in (1,2)α∈(1,2),

lim⁡λ→∞[max⁡n∈{1,…,mλ}SL(mλ,n)SL(mλ,mλ)]=1.\lim_{\lambda\to\infty}\left[\max_{n\in\{1,\dots,m_\lambda\}} \frac{SL(m_\lambda,n)}{SL(m_\lambda,m_\lambda)}\right] = 1 .λ→∞lim​[n∈{1,…,mλ​}max​SL(mλ​,mλ​)SL(mλ​,n)​]=1.

Milestones (App. D and D.2, pp. 42, 46–47)

  1. App. D, case (ii). For the rate (4) and λs+3(λs/2)2/3−1<m<2λs\lambda s + 3(\lambda s/2)^{2/3} - 1 < m < 2\lambda sλs+3(λs/2)2/3−1<m<2λs (with λs≥2\lambda s \ge 2λs≥2), ρ=1\rho = 1ρ=1 has two roots q1<q2q_1 < q_2q1​<q2​ in [λs,m][\lambda s, m][λs,m], and on (0,m](0,m](0,m], ρ(q)<1\rho(q) < 1ρ(q)<1 exactly for q1<q<q2q_1 < q < q_2q1​<q<q2​.
  2. Step (i). lim sup⁡λ[mλ−⌊q2⌋]<∞\limsup_\lambda [m_\lambda - \lfloor q_2\rfloor] < \inftylimsupλ​[mλ​−⌊q2​⌋]<∞ and lim sup⁡λ∏k=⌊q2⌋+1mλρ(k)<∞\limsup_\lambda \prod_{k=\lfloor q_2\rfloor+1}^{m_\lambda}\rho(k) < \inftylimsupλ​∏k=⌊q2​⌋+1mλ​​ρ(k)<∞.
  3. Step (ii). lim⁡λ∏k=⌊q1⌋+1⌊q2⌋ρ(k)=0\lim_\lambda \prod_{k=\lfloor q_1\rfloor+1}^{\lfloor q_2\rfloor}\rho(k) = 0limλ​∏k=⌊q1​⌋+1⌊q2​⌋​ρ(k)=0.
  4. The reduction. πmλ,mλ(⌊q1⌋)/πmλ,mλ(mλ)→∞\pi_{m_\lambda,m_\lambda}(\lfloor q_1\rfloor)/\pi_{m_\lambda,m_\lambda}(m_\lambda) \to \inftyπmλ​,mλ​​(⌊q1​⌋)/πmλ​,mλ​​(mλ​)→∞, with the paper's product identity for this ratio.

Significance

Theorem 2.B is the middle of the paper's three asymptotic results. In the supply-limited regime α∈(0,1)\alpha \in (0,1)α∈(0,1), Theorem 2.A says that choosing the number of drivers optimally improves the service level by a factor of at least 2−α2-\alpha2−α; in the supply-rich regime α>2\alpha > 2α>2, Theorem 2.C bounds the fraction of drivers needed to keep the full service level. Theorem 2.B closes the gap: in a large intermediate market the system with one driver per vehicle is already asymptotically as good as the best system with fewer drivers, so the benefit of tele-driving there is cost, not service. The mechanism is that the stationary distribution with n=mn = mn=m is bimodal, and the mass of the congested mode at mmm becomes negligible compared with the mode at ⌊q1⌋\lfloor q_1\rfloor⌊q1​⌋.

The result is proved in the paper (App. D.2). It has no machine-checked proof; this mission formalizes the statement and the steps of the published proof, with the root characterization of App. D made explicit.

Difficulty

The ratio of service levels is at least one (take n=mλn = m_\lambdan=mλ​) and at most 1/SL(mλ,mλ)1/SL(m_\lambda, m_\lambda)1/SL(mλ​,mλ​), so everything rests on showing that the loss probability πmλ,mλ(mλ)\pi_{m_\lambda,m_\lambda}(m_\lambda)πmλ​,mλ​​(mλ​) of the full system vanishes. The obvious bound fails: the loads ρ(k)\rho(k)ρ(k) exceed one both below q1q_1q1​ and above q2q_2q2​, so the stationary distribution is not monotone, and the product of loads from the lower mode to mλm_\lambdamλ​ mixes factors above and below one. What is needed is quantitative control of both roots as λ→∞\lambda \to \inftyλ→∞: q2q_2q2​ stays within a bounded distance of mλm_\lambdamλ​, while q2−q1q_2 - q_1q2​−q1​ grows linearly in mλm_\lambdamλ​ with loads bounded away from one in between. The roots have no simple closed form; the paper's expressions (17)–(18) involve a cubic and an arccosine.

Formalization scope

All objects are defined in one definitions module, TeleDriving.AsymIntermediate.Model, shared verbatim (up to the namespace) with the other four missions of the series. The service rate is a function μ:N×R→R\mu : \mathbb N \times \mathbb R \to \mathbb Rμ:N×R→R; ρ\rhoρ is evaluated at real qqq; πm,n\pi_{m,n}πm,n​ and SLSLSL are the closed forms (2)–(3) rather than a stationary-distribution predicate. mλm_\lambdamλ​ is the natural-number floor ⌊αλs⌋\lfloor \alpha\lambda s\rfloor⌊αλs⌋, and λ→∞\lambda \to \inftyλ→∞ along the reals. The maximum over n∈{1,…,m}n \in \{1,\dots,m\}n∈{1,…,m} is a supremum over a finite index set; its value at m=0m = 0m=0 is 000 and irrelevant because mλ→∞m_\lambda \to \inftymλ​→∞. Limits superior below infinity are stated as "bounded for all large λ\lambdaλ"; divergence to infinity as Tendsto … atTop atTop.

Standing hypotheses: s>0s > 0s>0 and 1<α<21 < \alpha < 21<α<2. The roots q1(λ)<q2(λ)q_1(\lambda) < q_2(\lambda)q1​(λ)<q2​(λ) in Steps (i)–(ii) and the reduction are functions of λ\lambdaλ characterized only for all sufficiently large λ\lambdaλ by λs≤q1<q2≤mλ\lambda s \le q_1 < q_2 \le m_\lambdaλs≤q1​<q2​≤mλ​ and ρ(q1)=ρ(q2)=1\rho(q_1) = \rho(q_2) = 1ρ(q1​)=ρ(q2​)=1; by milestone 1 they then coincide with the paper's q1,q2q_1, q_2q1​,q2​. A characterization required for every λ\lambdaλ would be unsatisfiable for small λ\lambdaλ and make those items vacuous; it is ruled out. The goal theorem does not mention the roots and assumes nothing about π\piπ or SLSLSL. Milestone 1 adds the hypothesis λs≥2\lambda s \ge 2λs≥2, which the paper's derivation uses tacitly (it places the maximizer of its auxiliary function inside [λs,m][\lambda s, m][λs,m]) and without which the claim fails for small λs\lambda sλs.

The development needs elementary real analysis: concavity of q/(λs)−(m−q+1)−1/2q/(\lambda s) - (m-q+1)^{-1/2}q/(λs)−(m−q+1)−1/2, asymptotics of ⌊αλs⌋\lfloor\alpha\lambda s\rfloor⌊αλs⌋, and estimates on finite products. No probability theory beyond the closed forms is required. The root analysis of milestone 1 is reusable for the supply-limited and supply-rich missions of the series. Proofs of the milestones, alternative arguments for the goal, and a formal treatment of the closed forms (17)–(18) are welcome. The source is the 2023 SSRN working paper; theorem numbers are those of that version.

Selected references

  • S. Benjaafar, Z. Wang, X. Yang, Human in the Loop Automation: Ride-Hailing with Remote (Tele-)Drivers, SSRN working paper 4130757, version of 1 June 2023. https://ssrn.com/abstract=4130757 ; published in Management Science, 2024. https://doi.org/10.1287/mnsc.2022.01687
  • O. Besbes, F. Castro, I. Lobel, Spatial Capacity Planning, Operations Research 70(2):1271–1291, 2022.
6 thms1 active userReviewed
Algorithmic Game TheoryMechanism DesignOperations Research·Captain: mikedeng1

On the Robustness of Second-Price Auctions in Prior-Independent Mechanism Design III: Against Exchangeable or Arbitrary Joint Valuations the Minimax Regret Is 1/e for Every nResearch Paper

Motivation

A seller with one item faces nnn buyers whose valuations she does not know, not even in distribution. Prior-independent mechanism design asks which selling mechanism performs well against every distribution in a given class, rather than against one known prior. Anunrojwong, Balseiro and Besbes (arXiv:2204.10478v5, Operations Research 2025) measure performance by regret: the expected gap between the highest valuation, which a seller who knew the valuations could extract, and the revenue actually collected. They solve the resulting minimax problem for several classes of joint distributions: i.i.d., exchangeable and affiliated, mixtures of i.i.d., exchangeable, and arbitrary.

This mission formalizes the last two cases. The answer is that the minimax regret against exchangeable or arbitrary joint valuations is 1/e1/e1/e for every number of buyers nnn, so competition among buyers does not help the seller unless Nature's power is restricted.

Timeline. Bergemann and Schlag (2008) solved the one-buyer regret problem: the optimal mechanism is a randomized posted price and the minimax regret is 1/e1/e1/e. Koçyiğit, Kuhn and Rujeerapaiboon (2020; doi:10.1287/ijoc.2022.0275) showed, for several bidders and several items, that with arbitrary joint distributions the minimax regret problem reduces to the one-bidder case, so the value does not improve with nnn. Anunrojwong, Balseiro and Besbes (2022–2024, Proposition 4) recover this within their framework, show that the worst case can be taken exchangeable, and identify the optimal mechanism as a second-price auction with a random reserve.

Setting

There are n≥1n \ge 1n≥1 buyers with valuations v=(v1,…,vn)v = (v_1,\dots,v_n)v=(v1​,…,vn​) in the type cube [0,1]n[0,1]^n[0,1]n. A mechanism m=(x,p)m = (x,p)m=(x,p) maps reported valuations to allocation probabilities xi(v)x_i(v)xi​(v) and payments pi(v)p_i(v)pi​(v). The class M\mathcal MM of DSIC mechanisms consists of those satisfying, on [0,1]n[0,1]^n[0,1]n: individual rationality (IR) vixi(v)−pi(v)≥0v_i x_i(v) - p_i(v) \ge 0vi​xi​(v)−pi​(v)≥0; dominant-strategy incentive compatibility (IC), truthful reporting is optimal for each buyer whatever the others report; and the allocation constraint (AC) ∑ixi(v)≤1\sum_i x_i(v) \le 1∑i​xi​(v)≤1.

Write v(1)v^{(1)}v(1) and v(2)v^{(2)}v(2) for the highest and second-highest valuation. The regret of mmm against a joint law F\mathbf FF on [0,1]n[0,1]^n[0,1]n is

Rn(m,F)=Ev∼F[v(1)−∑i=1npi(v)],R_n(m,\mathbf F) = \mathbb E_{v\sim\mathbf F}\Big[v^{(1)} - \sum_{i=1}^n p_i(v)\Big],Rn​(m,F)=Ev∼F​[v(1)−i=1∑n​pi​(v)],

and the minimax regret over a class F\mathcal FF is Rn∗(F)=inf⁡m∈Msup⁡F∈FRn(m,F)\mathcal R^*_n(\mathcal F) = \inf_{m\in\mathcal M}\sup_{\mathbf F\in\mathcal F} R_n(m,\mathbf F)Rn∗​(F)=infm∈M​supF∈F​Rn​(m,F). Here Fall\mathcal F_{\mathrm{all}}Fall​ is the class of all distributions on [0,1]n[0,1]^n[0,1]n, and Fexc\mathcal F_{\mathrm{exc}}Fexc​ the exchangeable ones, invariant under every permutation of the buyers.

A second-price auction with random reserve SPA(Φ)\mathrm{SPA}(\Phi)SPA(Φ) draws a reserve p∼Φp\sim\Phip∼Φ, gives the item to a highest bidder if her bid is at least ppp, and charges her max⁡(v(2),p)\max(v^{(2)},p)max(v(2),p). Proposition 4 uses the reserve CDF Φ∗(p)=log⁡p+1\Phi^*(p) = \log p + 1Φ∗(p)=logp+1 on [1/e,1][1/e,1][1/e,1] (000 below 1/e1/e1/e), and the isorevenue law on [1/e,1][1/e,1][1/e,1], with CDF 1−1/(et)1 - 1/(e t)1−1/(et) on [1/e,1)[1/e,1)[1/e,1) and an atom of mass 1/e1/e1/e at 111. Nature's candidate F∗\mathbf F^*F∗ picks a buyer kkk uniformly at random, gives her an isorevenue value and gives everyone else value 000.

Formalization targets

Goal: Proposition 4

With m∗=SPA(Φ∗)m^* = \mathrm{SPA}(\Phi^*)m∗=SPA(Φ∗) and F∗=1n∑kF∗,k\mathbf F^* = \frac1n\sum_k \mathbf F^{*,k}F∗=n1​∑k​F∗,k, for every m∈Mm\in\mathcal Mm∈M and F∈Fall\mathbf F\in\mathcal F_{\mathrm{all}}F∈Fall​,

Rn(m∗,F)≤Rn(m∗,F∗)≤Rn(m,F∗),R_n(m^*,\mathbf F) \le R_n(m^*,\mathbf F^*) \le R_n(m,\mathbf F^*),Rn​(m∗,F)≤Rn​(m∗,F∗)≤Rn​(m,F∗),

F∗\mathbf F^*F∗ is exchangeable, and

Rn∗(Fexc)=Rn∗(Fall)=Rn(m∗,F∗)=1e.\mathcal R^*_n(\mathcal F_{\mathrm{exc}}) = \mathcal R^*_n(\mathcal F_{\mathrm{all}}) = R_n(m^*,\mathbf F^*) = \frac1e .Rn∗​(Fexc​)=Rn∗​(Fall​)=Rn​(m∗,F∗)=e1​.

Milestones

  1. SPA(Φ)∈M\mathrm{SPA}(\Phi)\in\mathcal MSPA(Φ)∈M for every reserve distribution Φ\PhiΦ (p. 16).
  2. The pointwise regret of SPA(Φ)\mathrm{SPA}(\Phi)SPA(Φ) for Φ\PhiΦ with a density: v(1)−v(1)Φ(v(1))+∫v(2)v(1)Φ(p) dpv^{(1)} - v^{(1)}\Phi(v^{(1)}) + \int_{v^{(2)}}^{v^{(1)}}\Phi(p)\,dpv(1)−v(1)Φ(v(1))+∫v(2)v(1)​Φ(p)dp (proof of Proposition 1, App-4).
  3. The pointwise regret of SPA(Φ∗)\mathrm{SPA}(\Phi^*)SPA(Φ∗) is at most 1/e1/e1/e, with equality when v(1)≥1/e≥v(2)v^{(1)}\ge 1/e\ge v^{(2)}v(1)≥1/e≥v(2) (Cases 1–3, App-8).
  4. The expected revenue of any m∈Mm\in\mathcal Mm∈M under F∗\mathbf F^*F∗ is at most 1n∑k(r∗xk(ek)−∫0r∗xk(tek) dt)\frac1n\sum_k\big(r^*x_k(e_k) - \int_0^{r^*}x_k(t e_k)\,dt\big)n1​∑k​(r∗xk​(ek​)−∫0r∗​xk​(tek​)dt) with r∗=1/er^* = 1/er∗=1/e, with equality under the normalization pi=0p_i = 0pi​=0 when vi=0v_i = 0vi​=0 (App-8).
  5. F∗\mathbf F^*F∗ is exchangeable (p. 22).

Significance

The result. Proposition 4 gives the exact minimax regret and an explicit saddle point for the two largest distribution classes of the paper. The value 1/e1/e1/e is independent of nnn, in contrast with the i.i.d. class, where the minimax regret decreases in nnn (Theorem 1 of the same paper). Together with the other propositions it shows precisely how much structure Nature must be denied before additional buyers reduce the seller's regret. The worst case being exchangeable shows that symmetry alone does not help.

Formalizing it. The result is proved on paper; it is not formalized anywhere to our knowledge. A formalization produces machine-checked versions of: dominant-strategy incentive compatibility of the second-price auction with random reserve; the pointwise regret identity for that auction; a revenue identity for arbitrary DSIC mechanisms under a mixture of one-buyer laws, which rests on Myerson's payment characterization; and a minimax value computed over all DSIC mechanisms and all distributions. Each of these is reusable by the sister missions on i.i.d., affiliated and fixed-reserve settings.

Difficulty

The minimax problem ranges over all DSIC mechanisms, an infinite-dimensional and unstructured class, and over all joint distributions. The upper bound needs only one mechanism, but the lower bound must hold against every DSIC mechanism, including randomized ones whose allocation is not of auction form; the step from incentive compatibility to an explicit revenue formula along the line {tek}\{t e_k\}{tek​} is where the work lies. Myerson's payment characterization is quoted by the paper without proof and must be established here for mechanisms that are incentive compatible only on [0,1][0,1][0,1]. A second obstacle is measure-theoretic: the regret is an integral of an arbitrary mechanism's payments against an arbitrary law, so its finiteness and the interchange of expectation with the reserve randomization must be justified. The tempting shortcut of restricting Nature to i.i.d. laws gives a different, smaller value.

Formalization scope

Lean represents valuations as Fin n → ℝ and laws as measures on that space; Fall\mathcal F_{\mathrm{all}}Fall​ is the set of probability measures giving the complement of [0,1]n[0,1]^n[0,1]n measure zero, and Fexc\mathcal F_{\mathrm{exc}}Fexc​ those also invariant under v↦v∘σv\mapsto v\circ\sigmav↦v∘σ for every permutation σ\sigmaσ. (IR), (IC), (AC) are imposed on [0,1]n[0,1]^n[0,1]n, with misreports in [0,1][0,1][0,1]. Two hypotheses are added to the class M\mathcal MM and disclosed in every statement: allocation and payment functions are measurable, and payments are bounded on [0,1]n[0,1]^n[0,1]n, so that the regret is a genuine expectation. Ties for the highest bid are broken towards the lowest index (the paper breaks them arbitrarily; revenue does not depend on the rule). v(2)v^{(2)}v(2) is 000 when n=1n = 1n=1. The minimax regret is a real infimum of real suprema; for DSIC mechanisms the regrets lie in a bounded interval and both index sets are nonempty, so these are not junk values. The reserve law Φ∗\Phi^*Φ∗ and the isorevenue law are given through their CDFs, and F∗,k\mathbf F^{*,k}F∗,k as the push-forward of the isorevenue law under t↦t ekt\mapsto t\,e_kt↦tek​; F∗\mathbf F^*F∗ is not a product measure. The page prints Φ∗(p)=log⁡(v)+1\Phi^*(p) = \log(v)+1Φ∗(p)=log(v)+1; the formalization uses log⁡p+1\log p + 1logp+1.

Trivializing formalizations are ruled out: Fall\mathcal F_{\mathrm{all}}Fall​ carries the support condition (without it the regret is unbounded), the regret at F∗\mathbf F^*F∗ is that of the stated reserve law Φ∗\Phi^*Φ∗, and both classes are nonempty.

A complete development needs: Lebesgue–Stieltjes integration by parts for CDFs, Myerson's envelope characterization of DSIC payments, push-forwards and mixtures of measures on Rn\mathbb R^nRn, and conditionally complete lattice reasoning for the minimax value. The DSIC property of SPA(Φ)\mathrm{SPA}(\Phi)SPA(Φ) and the payment characterization are reusable throughout auction theory. Proofs of any milestone, and lemmas towards Myerson's characterization, are welcome.

Selected references

  • J. Anunrojwong, S. R. Balseiro, O. Besbes, On the Robustness of Second-Price Auctions in Prior-Independent Mechanism Design, arXiv:2204.10478v5, 2024; Operations Research, 2025. https://arxiv.org/abs/2204.10478
  • Ç. Koçyiğit, D. Kuhn, N. Rujeerapaiboon, Regret Minimization and Separation in Multi-Bidder Multi-Item Auctions, technical report, 2020 (cited as Koçyiğit et al. [2020] in arXiv:2204.10478v5, p. 6); published in INFORMS Journal on Computing 36(6):1543–1561, 2024. https://doi.org/10.1287/ijoc.2022.0275
  • D. Bergemann, K. Schlag, Pricing without Priors, Journal of the European Economic Association 6(2–3), 2008. https://doi.org/10.1162/JEEA.2008.6.2-3.560
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1), 1981. https://doi.org/10.1287/moor.6.1.58
8 thms1 active userReviewed
Algorithmic Game TheoryMechanism DesignOperations Research·Captain: mikedeng1

On the Robustness of Second-Price Auctions in Prior-Independent Mechanism Design II: Against Exchangeable Affiliated Valuations the Minimax Regret Equals the I.I.D. ValueResearch Paper

Motivation

A seller offers one indivisible item to nnn buyers but does not know the joint distribution of their valuations. The seller knows only that every valuation lies in [0,1][0,1][0,1]. Prior-independent mechanism design asks for a selling mechanism that performs well against every distribution in a class. One measure of performance is the regret: the expected gap between the full surplus max⁡(v)\max(v)max(v), which a seller who knew the valuations could extract, and the revenue actually collected. Anunrojwong, Balseiro and Besbes (arXiv:2204.10478v5, Operations Research 2025) solve the minimax-regret problem over dominant-strategy incentive compatible (DSIC) mechanisms. For i.i.d. valuations the optimum is a second-price auction with a random reserve price (their Theorem 1).

I.i.d. valuations are a strong assumption in auction practice. In common-value and interdependent settings, bidders' values are positively dependent. The standard model of positive dependence in auction theory is affiliation, introduced by Milgrom and Weber (Econometrica 1982). §4.1 of the paper asks whether letting Nature choose an exchangeable affiliated distribution, rather than an i.i.d. one, changes the answer. It does not: the same auction and the same worst-case distribution form a saddle point, and the minimax regret is unchanged.

Setting

There are n≥1n\ge1n≥1 buyers with valuation profile v=(v1,…,vn)∈[0,1]nv=(v_1,\dots,v_n)\in[0,1]^nv=(v1​,…,vn​)∈[0,1]n. A mechanism m=(x,p)m=(x,p)m=(x,p) assigns to each profile allocation probabilities xi(v)∈[0,1]x_i(v)\in[0,1]xi​(v)∈[0,1] and payments pi(v)p_i(v)pi​(v). It is DSIC, m∈Mm\in\mathcal Mm∈M, if it satisfies ex post individual rationality (IR), dominant-strategy incentive compatibility (IC), and the allocation constraint ∑ixi(v)≤1\sum_i x_i(v)\le1∑i​xi​(v)≤1 (AC). The regret of mmm against a joint law FFF on [0,1]n[0,1]^n[0,1]n is

Rn(m,F)=Ev∼F[max⁡(v)−∑i=1npi(v)],R_n(m,F)=\mathbb E_{v\sim F}\Big[\max(v)-\sum_{i=1}^n p_i(v)\Big],Rn​(m,F)=Ev∼F​[max(v)−i=1∑n​pi​(v)],

and the minimax regret of a class F\mathcal FF is Rn∗(F)=inf⁡m∈Msup⁡F∈FRn(m,F)\mathcal R^*_n(\mathcal F)=\inf_{m\in\mathcal M}\sup_{F\in\mathcal F}R_n(m,F)Rn∗​(F)=infm∈M​supF∈F​Rn​(m,F).

Two classes of laws on [0,1]n[0,1]^n[0,1]n appear:

  • Fiid\mathcal F_{\mathrm{iid}}Fiid​: products G⊗nG^{\otimes n}G⊗n of a law GGG on [0,1][0,1][0,1].
  • Faff\mathcal F_{\mathrm{aff}}Faff​: exchangeable and affiliated laws. Exchangeable means invariant under permutations of the coordinates. A set A⊆RnA\subseteq\mathbb R^nA⊆Rn is increasing if its indicator is nondecreasing. A set SSS is a sublattice if it is closed under componentwise min⁡\minmin (∧\wedge∧) and max⁡\maxmax (∨\vee∨). FFF is affiliated if Pr⁡F(A∩B∣S)≥Pr⁡F(A∣S)Pr⁡F(B∣S)\Pr_F(A\cap B\mid S)\ge\Pr_F(A\mid S)\Pr_F(B\mid S)PrF​(A∩B∣S)≥PrF​(A∣S)PrF​(B∣S) for all increasing A,BA,BA,B and every sublattice SSS.

The candidate saddle point comes from Theorem 1. Let rn∗∈(0,1/n)r^*_n\in(0,1/n)rn∗​∈(0,1/n) solve (1−r)n−1+log⁡r+∑k=1n−1(1−r)k/k=0(1-r)^{n-1}+\log r+\sum_{k=1}^{n-1}(1-r)^k/k=0(1−r)n−1+logr+∑k=1n−1​(1−r)k/k=0. The mechanism mn∗=SPA(Φn∗)m^*_n=\mathrm{SPA}(\Phi^*_n)mn∗​=SPA(Φn∗​) draws a reserve qqq from the CDF Φn∗\Phi^*_nΦn∗​ of Theorem 1, sells to the highest bidder if the highest bid is at least qqq, and charges max⁡(v(2),q)\max(v^{(2)},q)max(v(2),q), where v(2)v^{(2)}v(2) is the second-highest bid. The distribution Fn∗F^*_nFn∗​ makes the valuations i.i.d. with the isorevenue CDF: F∗(t)=1−rn∗/tF^*(t)=1-r^*_n/tF∗(t)=1−rn∗​/t on [rn∗,1)[r^*_n,1)[rn∗​,1), with an atom of mass rn∗r^*_nrn∗​ at 111. Order statistics enter through Fk(1)(p)=Pr⁡F(max⁡(v1,…,vk)≤p)F^{(1)}_k(p)=\Pr_F(\max(v_1,\dots,v_k)\le p)Fk(1)​(p)=PrF​(max(v1​,…,vk​)≤p) and Fn(2)(p)=Pr⁡F(v(2)≤p)F^{(2)}_n(p)=\Pr_F(v^{(2)}\le p)Fn(2)​(p)=PrF​(v(2)≤p).

Formalization targets

Goal: Proposition 2 (p. 19)

For every F∈FaffF\in\mathcal F_{\mathrm{aff}}F∈Faff​ and every m∈Mm\in\mathcal Mm∈M,

Rn(mn∗,F) ≤ Rn(mn∗,Fn∗) ≤ Rn(m,Fn∗),henceRn∗(Faff)=Rn∗(Fiid).R_n(m^*_n,F)\ \le\ R_n(m^*_n,F^*_n)\ \le\ R_n(m,F^*_n),\qquad\text{hence}\qquad \mathcal R^*_n(\mathcal F_{\mathrm{aff}})=\mathcal R^*_n(\mathcal F_{\mathrm{iid}}).Rn​(mn∗​,F) ≤ Rn​(mn∗​,Fn∗​) ≤ Rn​(m,Fn∗​),henceRn∗​(Faff​)=Rn∗​(Fiid​).

The second inequality is Step 2 of Theorem 1 and is restated here. The first is new to §4.1.

Milestones (proof of Proposition 2)

  1. Lemma 1 (p. 19): for exchangeable affiliated FFF and n≥2n\ge2n≥2, Fn(1)(p)1/n≥Fn−1(1)(p)1/(n−1)F^{(1)}_n(p)^{1/n}\ge F^{(1)}_{n-1}(p)^{1/(n-1)}Fn(1)​(p)1/n≥Fn−1(1)​(p)1/(n−1) for every ppp.
  2. Order-statistic identity (p. 20, David–Nagaraja 5.3.2): for exchangeable FFF, Fn(2)=nFn−1(1)−(n−1)Fn(1)F^{(2)}_n=nF^{(1)}_{n-1}-(n-1)F^{(1)}_nFn(2)​=nFn−1(1)​−(n−1)Fn(1)​.
  3. Nature's bound (p. 20):
Rn(Φn∗,F)≤rn∗+∫rn∗1((n−1)rn∗p−rn∗−1−(n−1)pp−rn∗Fn(1)(p)+nFn−1(1)(p))Φn∗(p) dp.R_n(\Phi^*_n,F)\le r^*_n+\int_{r^*_n}^1\Big(\tfrac{(n-1)r^*_n}{p-r^*_n}-1-\tfrac{(n-1)p}{p-r^*_n}F^{(1)}_n(p)+nF^{(1)}_{n-1}(p)\Big)\Phi^*_n(p)\,dp.Rn​(Φn∗​,F)≤rn∗​+∫rn∗​1​(p−rn∗​(n−1)rn∗​​−1−p−rn∗​(n−1)p​Fn(1)​(p)+nFn−1(1)​(p))Φn∗​(p)dp.
  1. Pointwise maximization (p. 21): for p∈(rn∗,1)p\in(r^*_n,1)p∈(rn∗​,1), the function z↦(n−1)rn∗p−rn∗−1−(n−1)pp−rn∗z+nz(n−1)/nz\mapsto\frac{(n-1)r^*_n}{p-r^*_n}-1-\frac{(n-1)p}{p-r^*_n}z+nz^{(n-1)/n}z↦p−rn∗​(n−1)rn∗​​−1−p−rn∗​(n−1)p​z+nz(n−1)/n on [0,1][0,1][0,1] is maximized at z=Fn∗(p)nz=F^*_n(p)^nz=Fn∗​(p)n.

Significance

The result. Proposition 2 shows that positive dependence of the affiliated kind gives Nature no advantage against the optimal second-price auction. The minimax regret over Faff\mathcal F_{\mathrm{aff}}Faff​ is the explicit i.i.d. value (1−rn∗)n−1−∫rn∗1(1−rn∗/v)n−1 dv(1-r^*_n)^{n-1}-\int_{r^*_n}^1(1-r^*_n/v)^{n-1}\,dv(1−rn∗​)n−1−∫rn∗​1​(1−rn∗​/v)n−1dv, and the same randomized-reserve auction remains optimal. This contrasts with arbitrary or merely exchangeable dependence, where §4.3 of the paper shows the minimax regret jumps to 1/e1/e1/e for every nnn. Affiliation is therefore the dividing line between the dependence structures that the i.i.d. analysis covers and those it does not. Lemma 1, a comparison between the maximum of nnn and of n−1n-1n−1 affiliated variables, is a self-contained inequality about order statistics under positive dependence.

Formalizing it. The result is proved in the paper. No machine-checked version of any part of it exists. The mission produces: a formal definition of affiliation in the measure-theoretic form of Milgrom and Weber's appendix; the order-statistic identity for exchangeable laws; Lemma 1; and the saddle-point statement. The proof of Lemma 1 quotes Milgrom–Weber Theorem 23 (monotone functions of affiliated variables are affiliated), and the identity is quoted from David and Nagaraja. Neither is proved in the paper, so formalizing them is part of the work.

Difficulty

The obvious route to the first inequality is to show that regret is monotone in dependence. That route fails, because the benchmark E[max⁡(v)]\mathbb E[\max(v)]E[max(v)] moves with dependence as well. With the marginals fixed, stronger positive dependence raises the auction's revenue, since v(2)v^{(2)}v(2) moves toward v(1)v^{(1)}v(1), but it also lowers E[max⁡(v)]\mathbb E[\max(v)]E[max(v)]. Neither effect dominates uniformly, and the comparison must come out exactly at the isorevenue law. Nature's class is also not parametrized by marginals: an affiliated law need not have the marginals of Fn∗F^*_nFn∗​, so no coupling argument with a fixed i.i.d. law is available.

The second difficulty is in Lemma 1. It needs affiliation conditional on sublattices, not merely positive correlation of increasing events. The Harris-type inequality for S=RnS=\mathbb R^nS=Rn alone (association) is a strictly weaker property, and a formalization that keeps only it states a different class. Both the definition and the inequality must be handled for general laws without densities, since Definition 4 does not assume one.

Formalization scope

Valuation profiles are functions Fin n → ℝ, and laws are measures on that space giving full mass to [0,1]n[0,1]^n[0,1]n. (IR), (IC), (AC) and x∈[0,1]nx\in[0,1]^nx∈[0,1]n are imposed on the cube. Mechanisms are additionally required to have measurable allocation and payment rules and bounded payments on the cube, so that (2) is a genuine expectation. Rn∗\mathcal R^*_nRn∗​ is an inf⁡\infinf over DSIC mechanisms of a sup⁡\supsup over the class; both are bounded, so the real-valued inf⁡\infinf/sup⁡\supsup are not default values. Affiliation is stated for measurable AAA, BBB, SSS in the cross-multiplied form F(A∩S)F(B∩S)≤F(A∩B∩S)F(S)F(A\cap S)F(B\cap S)\le F(A\cap B\cap S)F(S)F(A∩S)F(B∩S)≤F(A∩B∩S)F(S). Ties in the auction go to the lowest index, which does not affect revenue. The reserve law and Fn∗F^*_nFn∗​ are given by CDF hypotheses ("CDF equals Φn∗\Phi^*_nΦn∗​", "CDF equals the isorevenue CDF"), and rn∗r^*_nrn∗​ by the hypothesis that it solves the r∗r^*r∗-equation in (0,1/n)(0,1/n)(0,1/n). These restate Theorem 1, which belongs to mission I of this series.

Trivializing encodings are ruled out explicitly. Affiliation quantifies over every measurable sublattice SSS, not only S=RnS=\mathbb R^nS=Rn. Faff\mathcal F_{\mathrm{aff}}Faff​ requires exchangeability; without it Nature can set all but one valuation to zero and the statement is false. The CDF hypotheses are satisfiable, and the sanity file constructs the isorevenue law.

Needed infrastructure: the regret representation of Proposition 1 for a joint law; Myerson-type payment identities for DSIC mechanisms (for the second inequality); Milgrom–Weber Theorem 23 or a direct proof of the pmf inequalities for the indicator vector 1(vk>p)\mathbf 1(v_k>p)1(vk​>p); the order-statistic identity. Affiliation and the order-statistic identity are reusable beyond auctions. Contributions to any milestone, or to these supporting results stated as separate theorems, are welcome.

Selected references

  • J. Anunrojwong, S. R. Balseiro, O. Besbes, On the Robustness of Second-Price Auctions in Prior-Independent Mechanism Design, arXiv:2204.10478v5, 2024; Operations Research, 2025. https://arxiv.org/abs/2204.10478
  • P. R. Milgrom, R. J. Weber, A Theory of Auctions and Competitive Bidding, Econometrica 50(5), 1089–1122, 1982. https://doi.org/10.2307/1911865
  • H. A. David, H. N. Nagaraja, Order Statistics, 3rd ed., Wiley, 2003. https://doi.org/10.1002/0471722162
  • D. Bergemann, K. Schlag, Pricing without Priors, Journal of the European Economic Association 6(2–3), 560–569, 2008. https://doi.org/10.1162/JEEA.2008.6.2-3.560
7 thms1 active userReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Human in the Loop Automation: Ride-Hailing with Remote (Tele-)Drivers 2: With Ample Vehicles, Service Level Strictly Increases in the Number of Drivers, with an Explicit Lower BoundResearch Paper

Motivation

Remote driving, or tele-driving, lets a human operator in a control center drive a vehicle over a wireless link. A ride-hailing platform that adopts it decouples drivers from vehicles: a driver is attached to a vehicle only while that vehicle carries or fetches a customer, and is released the moment the trip ends. Since an idle vehicle needs no driver, the platform can run a fleet of mmm vehicles with n≤mn \le mn≤m drivers. The operational question is how much service is lost by having fewer drivers than vehicles.

Benjaafar, Wang and Yang study this question with a loss queue in which the service rate depends on the number of idle vehicles, capturing the fact that pickups take longer when fewer vehicles are free (SSRN 4130757; published in Management Science, 2024, doi:10.1287/mnsc.2022.01687). The state-dependent rate builds on the spatial capacity model of Besbes, Castro and Lobel (doi:10.1287/opre.2021.2112). Their main finite-system results describe how the service level changes with the number of drivers in three regimes of vehicle supply. This mission formalizes the third regime, where vehicles are ample. The source is the authors' 2023 SSRN working paper; all labels and page numbers below refer to it.

Setting

A fleet of mmm vehicles is operated by n≤mn \le mn≤m remote drivers. Customers request trips according to a Poisson process with rate λ>0\lambda > 0λ>0. A request that arrives when all nnn drivers are busy is lost. When qqq customers are in service, each one completes at rate μ(m,q)\mu(m,q)μ(m,q), so the total completion rate is q μ(m,q)q\,\mu(m,q)qμ(m,q). The rate is defined for real q∈[1,m]q \in [1,m]q∈[1,m]. Let

ρ(q)=λq μ(m,q).\rho(q) = \frac{\lambda}{q\,\mu(m,q)}.ρ(q)=qμ(m,q)λ​.

The number of customers in service is a birth–death chain on {0,…,n}\{0,\dots,n\}{0,…,n}. Its stationary law is

πm,n(q)=∏k=1qρ(k)1+∑i=1n∏k=1iρ(k),0≤q≤n,\pi_{m,n}(q) = \frac{\prod_{k=1}^{q}\rho(k)}{1 + \sum_{i=1}^{n}\prod_{k=1}^{i}\rho(k)}, \qquad 0 \le q \le n,πm,n​(q)=1+∑i=1n​∏k=1i​ρ(k)∏k=1q​ρ(k)​,0≤q≤n,

and the service level is the long-run fraction of demand served, SL(m,n)=1−πm,n(n)SL(m,n) = 1 - \pi_{m,n}(n)SL(m,n)=1−πm,n​(n).

The paper's standing assumptions on the rate are:

  • Assumption 1. μ(m,q)\mu(m,q)μ(m,q) is strictly increasing in mmm, decreasing in qqq, and strictly concave in qqq; μ(m,q)→1/s\mu(m,q) \to 1/sμ(m,q)→1/s as m→∞m \to \inftym→∞, where s>0s > 0s>0 is the expected trip time; and μ(m,m)\mu(m,m)μ(m,m) does not depend on mmm.
  • Assumption 2. There is mˉ>0\bar m > 0mˉ>0 such that, for every m≥mˉm \ge \bar mm≥mˉ, the map q↦q μ(m,q)q \mapsto q\,\mu(m,q)q↦qμ(m,q) first increases and then decreases.
  • Size restriction (p. 13). m≥mˉm \ge \bar mm≥mˉ and λ>max⁡{1/s, max⁡q≤mˉq μ(mˉ,q)}\lambda > \max\{1/s,\ \max_{q \le \bar m} q\,\mu(\bar m,q)\}λ>max{1/s, maxq≤mˉ​qμ(mˉ,q)}.

The supply-rich regime m>γ2(λ)m > \gamma_2(\lambda)m>γ2​(λ) is the case ρ(m)<1\rho(m) < 1ρ(m)<1, that is, λ<m μ(m,m)\lambda < m\,\mu(m,m)λ<mμ(m,m): even with every vehicle busy, the system clears work faster than it arrives. In this regime there is a unique q3∈(1,m)q_3 \in (1,m)q3​∈(1,m) with ρ(q3)=1\rho(q_3) = 1ρ(q3​)=1, and ρ(q)<1\rho(q) < 1ρ(q)<1 exactly when q>q3q > q_3q>q3​.

Formalization targets

Goal: Theorem 1.C (pp. 20–21)

In the supply-rich regime, SL(m,n)SL(m,n)SL(m,n) is strictly increasing in n∈{1,…,m}n \in \{1,\dots,m\}n∈{1,…,m}. For every n∈{1,…,m}n \in \{1,\dots,m\}n∈{1,…,m} with n>q3n > q_3n>q3​,

SL(m,n)>1−1n−⌊q3⌋.SL(m,n) > 1 - \frac{1}{n - \lfloor q_3 \rfloor}.SL(m,n)>1−n−⌊q3​⌋1​.

Milestones

  1. Lemma 3, first sentence: ρ\rhoρ is strictly convex and 1/ρ1/\rho1/ρ is strictly concave on [1,m][1,m][1,m].
  2. Lemma 3(iii): in the supply-rich regime the root q3q_3q3​ exists, with ρ<1\rho < 1ρ<1 exactly to its right.
  3. Lemma 4: πm,n−1(n−1)>πm,n(n)\pi_{m,n-1}(n-1) > \pi_{m,n}(n)πm,n−1​(n−1)>πm,n​(n) holds if and only if πm,n−1(n−1)>(ρ(n)−1)/ρ(n)\pi_{m,n-1}(n-1) > (\rho(n)-1)/\rho(n)πm,n−1​(n−1)>(ρ(n)−1)/ρ(n), and if and only if πm,n(n)>(ρ(n)−1)/ρ(n)\pi_{m,n}(n) > (\rho(n)-1)/\rho(n)πm,n​(n)>(ρ(n)−1)/ρ(n).
  4. App. C.3: πm,n(n)\pi_{m,n}(n)πm,n​(n) is strictly decreasing in n∈{1,…,m}n \in \{1,\dots,m\}n∈{1,…,m}.
  5. App. C.3: πm,n(n)<1/(n−⌊q3⌋)\pi_{m,n}(n) < 1/(n - \lfloor q_3 \rfloor)πm,n​(n)<1/(n−⌊q3​⌋) for q3<n≤mq_3 < n \le mq3​<n≤m.

Significance

The first part of Theorem 1.C says that, when vehicles are ample, every driver removed costs some service. The second part says the cost is small once nnn exceeds q3q_3q3​ by a margin. The bound 1−1/(n−⌊q3⌋)1 - 1/(n - \lfloor q_3 \rfloor)1−1/(n−⌊q3​⌋) is increasing and concave in nnn, so a platform can run noticeably fewer drivers than vehicles at a controlled loss of service. The paper's numerical study (Figure 7) reports reductions of 35–60% in the number of drivers at a service loss below 0.01. The same objects carry over to the paper's asymptotic Theorem 2.C, where the driver-to-vehicle ratio needed in a large supply-rich market tends to 1/α1/\alpha1/α.

The result is proved on paper and has no machine-checked proof. The work this mission adds is formal:

  • statements of the model in which the regimes are explicit and the threshold q3q_3q3​ is pinned by its characterization;
  • a proof of the convexity and root structure of ρ\rhoρ that does not rely on second derivatives, which the paper uses but the assumptions do not supply;
  • the comparison lemma for consecutive blocking probabilities, which the companion missions on this paper also use.

Difficulty

πm,n(n)\pi_{m,n}(n)πm,n​(n) is a ratio whose numerator and denominator both change with nnn. For the drivers beyond q3q_3q3​, monotonicity is immediate, since each additional factor ρ(n)<1\rho(n) < 1ρ(n)<1 shrinks the numerator while the denominator grows. Below q3q_3q3​, ρ(n)≥1\rho(n) \ge 1ρ(n)≥1 and the numerator grows, so that argument fails, and the comparison has to use the shape of ρ\rhoρ on [1,q3][1, q_3][1,q3​]. The shape of ρ\rhoρ (Lemma 3) has to be derived from concavity and monotonicity of μ\muμ alone: the assumptions give no smoothness, although the paper's proof differentiates twice. The page argues the two ranges separately, so the step across q3q_3q3​ also has to be covered. The lower bound needs care at the integer part of q3q_3q3​: the sum in the denominator is taken from ⌊q3⌋\lfloor q_3 \rfloor⌊q3​⌋, which is at least 1 only because q3>1q_3 > 1q3​>1.

Formalization scope

  • The rate is a function μ:N→R→R\mu : \mathbb N \to \mathbb R \to \mathbb Rμ:N→R→R, with mmm natural and qqq real. Assumptions 1–2 are imposed only for q∈[1,m]q \in [1,m]q∈[1,m]. "Decreasing in qqq" is read as non-increasing. Positivity of μ\muμ and s>0s > 0s>0, implicit on the page, are stated. Assumption 2's "first increases then decreases" is a turning point strictly inside (1,m)(1,m)(1,m).
  • Every statement carries Assumptions 1–2 and the size restriction as explicit hypotheses. The regime m>γ2(λ)m > \gamma_2(\lambda)m>γ2​(λ) is stated through its characterization λ<m μ(m,m)\lambda < m\,\mu(m,m)λ<mμ(m,m); γ2\gamma_2γ2​ itself is not defined.
  • q3q_3q3​ is a real variable with its Lemma 3(iii) characterization: q3∈[1,m]q_3 \in [1,m]q3​∈[1,m], ρ(q3)=1\rho(q_3) = 1ρ(q3​)=1, and ρ(q)<1\rho(q) < 1ρ(q)<1 exactly for q>q3q > q_3q>q3​ in [1,m][1,m][1,m]. This determines q3q_3q3​ uniquely, and milestone 2 shows that such a q3q_3q3​ exists. No monotonicity of ρ\rhoρ, π\piπ or SLSLSL is assumed anywhere; such facts are milestones.
  • nnn ranges over {1,…,m}\{1,\dots,m\}{1,…,m}. ⌊q3⌋\lfloor q_3 \rfloor⌊q3​⌋ is the natural-number floor, and n−⌊q3⌋n - \lfloor q_3 \rfloorn−⌊q3​⌋ is computed in R\mathbb RR.
  • "Increasing" and "lower bounded" are stated strictly, as the paper's proof derives them.
  • A statement that assumed πm,n(n)\pi_{m,n}(n)πm,n​(n) decreasing, or left q3q_3q3​ unconstrained, would make the goal trivial or vacuous. Neither is done here.

Needed infrastructure: finite products and sums over Finset.Icc, StrictConvexOn/StrictConcaveOn on intervals, and the intermediate value theorem for a function that is continuous on [1,m)[1,m)[1,m). The model file is shared, up to namespace, with four companion missions on the same paper. Proofs of the general facts used here are reusable beyond this mission and are welcome as separate contributions: the product of a positive increasing linear function and a positive antitone concave function is concave, and the reciprocal of a positive strictly concave function is strictly convex.

Selected references

  • S. Benjaafar, Z. Wang, X. Yang, Human in the Loop Automation: Ride-Hailing with Remote (Tele-)Drivers, SSRN working paper 4130757, version of 1 June 2023. https://ssrn.com/abstract=4130757 . Published in Management Science, 2024. https://doi.org/10.1287/mnsc.2022.01687
  • O. Besbes, F. Castro, I. Lobel, Spatial Capacity Planning, Operations Research 70(2):1271–1291, 2022. https://doi.org/10.1287/opre.2021.2112
7 thms1 active userReviewed
EconomicsOperations Research·Captain: mikedeng1

Source Theory: A Tractable and Positive Ambiguity Theory 4: Two Sources Are Equally Preferred and Insensitive If and Only If Both Are Uniform with Equal Source FunctionsResearch Paper

Motivation

Decision makers facing uncertainty treat different sources of uncertainty differently. The Ellsberg paradox, home bias in investment, and the competence effect all show people preferring bets on one source (a known urn, domestic stocks, a familiar domain) over equally likely bets on another. Ambiguity theories try to describe these differences. Most of them are hard to apply empirically because they work with sets of priors or nonadditive measures on the whole state space.

Baillon, Bleichrodt, Li and Wakker (Management Science 71(10), 2025) propose source theory. Within a source, the agent behaves as if she has a probability measure (probabilistic sophistication). Across sources, she may weight those probabilities differently, through a source function wSw_{\mathcal S}wS​. Two attitude components measure the difference between sources: source preference (ambiguity aversion) and insensitivity (a-insensitivity, the tendency to treat all intermediate likelihoods alike). Their Theorem 4 answers a basic question for this framework. When are two sources at exactly the same level on both components?

Setting

A state space SSS carries an algebra E\mathcal EE of events. An act is a finite-valued map x:S→Γx : S \to \Gammax:S→Γ into an outcome set Γ\GammaΓ whose level sets are events. A weak order ≽\succcurlyeq≽ on acts is represented by biseparable utility: a utility UUU on outcomes and a weighting function WWW on events (W(∅)=0W(\emptyset)=0W(∅)=0, W(S)=1W(S)=1W(S)=1, monotone) evaluate a binary act γEβ\gamma E \betaγEβ with γ≽β\gamma \succcurlyeq \betaγ≽β by W(E)U(γ)+(1−W(E))U(β)W(E)U(\gamma) + (1-W(E))U(\beta)W(E)U(γ)+(1−W(E))U(β). Structural Assumption 1 adds three nonindifferent outcomes, convex rangedness of WWW, strong monotonicity, cumulative dominance and an Archimedean axiom. Events are ranked by WWW: A≽BA \succcurlyeq BA≽B iff W(A)≥W(B)W(A) \ge W(B)W(A)≥W(B).

A source is a subalgebra S⊆E\mathcal S \subseteq \mathcal ES⊆E on which WWW is convex ranged. It is uniform if a finitely additive probability measure PSP_{\mathcal S}PS​ on S\mathcal SS satisfies stochastic dominance for all acts from S\mathcal SS. Then W=wS∘PSW = w_{\mathcal S} \circ P_{\mathcal S}W=wS​∘PS​ on S\mathcal SS for a continuous, strictly increasing wS:[0,1]→[0,1]w_{\mathcal S} : [0,1] \to [0,1]wS​:[0,1]→[0,1], the source function.

For two sources A\mathcal AA and C\mathcal CC:

  • C\mathcal CC is preferred to A\mathcal AA (Definition 2) if for A1∈AA_1 \in \mathcal AA1​∈A, C1∈CC_1 \in \mathcal CC1​∈C, W(A1)=W(C1)W(A_1) = W(C_1)W(A1​)=W(C1​) implies W(A1c)≤W(C1c)W(A_1^c) \le W(C_1^c)W(A1c​)≤W(C1c​).
  • A\mathcal AA is more insensitive than C\mathcal CC with insensitivity region [B,D][B, D][B,D] (Definition 4) if, for matching threefold partitions, the middle cell of A\mathcal AA gains at least as much weight as that of C\mathcal CC when moved from the worst to the middle rank (if the worst cell is large enough, bounded by DDD), and dually at the best rank (if the best cell is at least as likely as BBB).
  • The region [B,D][B, D][B,D] is regular for S\mathcal SS if every fourfold partition of SSS from S\mathcal SS has a cell EjE_jEj​ with Ej≽BE_j \succcurlyeq BEj​≽B and Ejc≼DE_j^c \preccurlyeq DEjc​≼D.
  • Two sources are equally preferred (equally insensitive) if the relation holds in both directions.

Formalization targets

Goal: Theorem 4

Under Assumption 1, sources A\mathcal AA and C\mathcal CC are equally preferred and equally insensitive with a regular insensitivity region if and only if both are uniform and

wA=wC.w_{\mathcal A} = w_{\mathcal C}.wA​=wC​.

Moreover, A\mathcal AA and C\mathcal CC are then equally insensitive with the maximal region [∅,S][\emptyset, S][∅,S].

Milestones

In the order of the proof (p. 8780):

  1. the reversed implication, which the paper calls direct;
  2. transitivity of source preference and insensitivity (Observation 3);
  3. Theorem 1: a source is uniform iff it is equally preferred and insensitive to itself with a regular region;
  4. for a uniform source, a regular region [B,D][B, D][B,D] from the source has P(B)≤14≤34≤P(D)P(B) \le \tfrac14 \le \tfrac34 \le P(D)P(B)≤41​≤43​≤P(D);
  5. for equally preferred uniform sources, the pmatcher φ\varphiφ with wA=wC∘φw_{\mathcal A} = w_{\mathcal C} \circ \varphiwA​=wC​∘φ satisfies φ(p)+φ(1−p)=1\varphi(p) + \varphi(1-p) = 1φ(p)+φ(1−p)=1, so φ(12)=12\varphi(\tfrac12) = \tfrac12φ(21​)=21​;
  6. insensitivity in each direction makes φ\varphiφ and φ−1\varphi^{-1}φ−1 sub-additive on [0,12][0, \tfrac12][0,21​];
  7. these two inequalities and φ(12)=12\varphi(\tfrac12) = \tfrac12φ(21​)=21​ force φ\varphiφ to be linear on [0,12][0, \tfrac12][0,21​];
  8. φ\varphiφ is then the identity on [0,1][0, 1][0,1].

Significance

The theorem says that a comparison of ambiguity attitudes "at the same level" is only possible between uniform sources. Equal preference and equal insensitivity, both observable through bets, already force probabilistic sophistication within each source and identical source functions. With risk as the second source, it characterizes ambiguity neutrality of a source behaviorally (Corollary 1 of the paper). It also shows that both attitude components are needed: the paper's Example 1 exhibits sources that are equally preferred but differ in insensitivity.

The result is proved in the paper, partly by reference. The linearity step defers to an Online Appendix, and Theorem 1's proof relies on a representation theorem of Krantz, Luce, Suppes and Tversky (1971). As far as known, none of the paper's results has a machine-checked proof. A formalization would check the paper's proof, including the deferred functional-equation step and the boundary bookkeeping of insensitivity regions. It would also provide a reusable Lean layer for Savage-style acts, biseparable utility and comparative ambiguity attitudes.

Difficulty

The forward direction is the hard one. The obvious route is to compare the two sources directly through the pmatcher φ\varphiφ. But φ\varphiφ exists only once both sources are known to be uniform, and nothing in the hypotheses says so. The proof first collapses the cross-source conditions into conditions of each source with itself, by transitivity, and then invokes Theorem 1. Theorem 1 in turn needs a qualitative-probability representation theorem.

Once φ\varphiφ exists, the insensitivity conditions give only one-sided inequalities: φ\varphiφ and φ−1\varphi^{-1}φ−1 are sub-additive on [0,12][0, \tfrac12][0,21​]. Sub-additivity of φ−1\varphi^{-1}φ−1 gives super-additivity of φ\varphiφ only where φ(p)+φ(ε)≤12\varphi(p) + \varphi(\varepsilon) \le \tfrac12φ(p)+φ(ε)≤21​. The symmetry φ(12)=12\varphi(\tfrac12) = \tfrac12φ(21​)=21​, which comes from source preference, is what closes the gap. Regularity is used twice: it brings Theorem 1 into play, and it guarantees that the region's upper bound lies above probability 12\tfrac1221​.

Formalization scope

The Lean development works in the sub-namespace SourceTheory.EqualSources, with one definition module holding the whole model:

  • Assumption1 bundles Structural Assumption 1.
  • IsSource is a subalgebra on which WWW is convex ranged.
  • IsUniformWith and IsSourceFunction encode uniformity and (5).
  • IsPreferredTo, IsMoreInsensitive and IsRegularRegion encode Definition 2, Definition 4 and regularity.

Conventions committed to:

  • events form an algebra E\mathcal EE, which the paper allows in its endnote 1;
  • convex rangedness is imposed on E\mathcal EE and on each named source, since the trivial algebra is never convex ranged;
  • event preference is WWW-order;
  • probability measures are finitely additive;
  • twofold partitions are (A1,A1c)(A_1, A_1^c)(A1​,A1c​), and partitions may have empty cells;
  • a "transformation" is a continuous probability weighting function;
  • the pmatcher is a binder with wA=wC∘φw_{\mathcal A} = w_{\mathcal C} \circ \varphiwA​=wC​∘φ on [0,1][0,1][0,1], and its inverse is a binder with two-sided inverse laws, never Function.invFun;
  • the region in Theorem 4 is read as regular for both sources, and "wA=wCw_{\mathcal A} = w_{\mathcal C}wA​=wC​" as a single function that is the source function of both.

The goal deliberately has no Assumption 2: the paper says it is implied by the other conditions, and adding it would weaken the theorem. Neither regularity hypothesis may be dropped either. Without regularity, a degenerate region such as [S,∅][S, \emptyset][S,∅] makes the insensitivity conditions nearly empty, and the left-hand side holds for sources that are not uniform.

A complete development needs:

  • finitely additive probabilities on algebras;
  • a range lemma (convex rangedness makes PSP_{\mathcal S}PS​ onto [0,1][0,1][0,1]);
  • the Krantz et al. representation of qualitative probabilities;
  • an interval version of the Cauchy functional equation.

The last two are reusable beyond this mission. Contributions to any milestone, and to the shared model layer, are welcome.

Selected references

  • A. Baillon, H. Bleichrodt, C. Li, P. P. Wakker, Source Theory: A Tractable and Positive Ambiguity Theory, Management Science 71(10):8767–8782, 2025. https://doi.org/10.1287/mnsc.2023.03307
  • D. H. Krantz, R. D. Luce, P. Suppes, A. Tversky, Foundations of Measurement, Vol. I, Academic Press, 1971.
  • D. Ellsberg, Risk, Ambiguity, and the Savage Axioms, Quarterly Journal of Economics 75(4):643–669, 1961. https://doi.org/10.2307/1884324
  • L. J. Savage, The Foundations of Statistics, Wiley, 1954.
11 thms1 active userReviewed
PreviousPage 14 of 38Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me