Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Probability

1,628 missions · 689 completed

Missions

Open939Completed689All1628
AnalysisOperations ResearchOptimization·Captain: mikedeng1

Sample-Driven Optimal Stopping: From the Secretary Problem to the i.i.d. Prophet Inequality II: The Optimal Competitive Ratio Tends to the i.i.d. Prophet Constant as p Tends to 1Research Paper

Motivation

Optimal stopping with samples sits between two classical problems. In the secretary problem a decision maker sees items in random order, knows nothing about their values, and must stop on one; the best guarantee is 1/e1/e1/e. In the i.i.d. prophet inequality the values are independent draws from a known distribution, and the best guarantee against the expected maximum is the constant α∗≈0.745\alpha^*\approx0.745α∗≈0.745: Hill and Kertz (1982) and Kertz (1986) showed that no stopping rule does better, and Correa, Foncea, Hoeksma, Oosterwijk and Vredeveld (2017) showed that it is achieved. Real decision makers usually have neither nothing nor everything: they have a history of past observations.

Correa, Cristi, Epstein and Soto (arXiv:2011.06516v2) model this as ppp-DOS (sample-driven optimal stopping): each of NNN items is independently placed in a history set with probability ppp, the decision maker sees the history first and then the remaining items online, and must stop on one online item. At p=0p=0p=0 this is the secretary problem; as p→1p\to1p→1 the history reveals the distribution and the problem approaches the i.i.d. prophet setting. This mission formalizes the paper's Theorem 8, which makes the second statement precise: the optimal guarantee tends to α∗\alpha^*α∗.

Timeline. Hill and Kertz (1982) compared stop-rule and supremum expectations for i.i.d. variables; Kertz (1986) completed the comparison, giving the worst-case constant ≈0.745\approx0.745≈0.745 through the integral equation used below; Correa et al. (2017) gave a matching algorithm. Kaplan, Naori and Raz (2020) studied the sample-driven model with a weaker bound for small ppp; Correa, Dütting, Fischer and Schewior (2019) and Rubinstein, Wang and Weinberg (2020) studied i.i.d. values with samples from an unknown distribution. The present paper (2020–2021) gives the exact limit program and Theorem 8.

Setting

Fix p∈(0,1)p\in(0,1)p∈(0,1). A stopping rule is a nonnegative function q(t,ℓ)q(t,\ell)q(t,ℓ) of a time t∈[p,1]t\in[p,1]t∈[p,1] and a rank ℓ≥1\ell\ge1ℓ≥1. For k≥1k\ge1k≥1 let

Fk(q)=∑ℓ=1k∫p1q(t,ℓ)∑j=ℓk(j−1ℓ−1)(1−t)j−ℓtℓ dt.F_k(q)=\sum_{\ell=1}^{k}\int_p^1 q(t,\ell)\sum_{j=\ell}^{k}\binom{j-1}{\ell-1}(1-t)^{j-\ell}t^{\ell}\,dt .Fk​(q)=ℓ=1∑k​∫p1​q(t,ℓ)j=ℓ∑k​(ℓ−1j−1​)(1−t)j−ℓtℓdt.

The limit program SDCLPp_pp​ maximizes α∈[0,1]\alpha\in[0,1]α∈[0,1] over pairs (q,α)(q,\alpha)(q,α) with

t q(t,ℓ)+∫pt∑s≥1q(τ,s) dτ≤1(t∈[p,1], ℓ≥1),α≤Fk(q)1−pk(k≥1).t\,q(t,\ell)+\int_p^t\sum_{s\ge1}q(\tau,s)\,d\tau\le1\quad(t\in[p,1],\ \ell\ge1),\qquad \alpha\le\frac{F_k(q)}{1-p^k}\quad(k\ge1).tq(t,ℓ)+∫pt​s≥1∑​q(τ,s)dτ≤1(t∈[p,1], ℓ≥1),α≤1−pkFk​(q)​(k≥1).

Its optimal value is α(p)\alpha(p)α(p). The paper obtains SDCLPp_pp​ as the limit N→∞N\to\inftyN→∞ of the linear programs that describe the best algorithm for ppp-DOS with adversarial values (§4.1–4.2); Theorem 8 is a statement about the program's value.

Two constants are defined by equations. α~(p)\tilde\alpha(p)α~(p) is the unique root in (0,1)(0,1)(0,1) of

ln⁡p+α~(1−p)2p=∑i=1∞ln⁡(1−α~+α~[(i+1)pi−ipi+1])i(i+1),(19)\ln p+\frac{\tilde\alpha(1-p)^2}{p}=\sum_{i=1}^{\infty}\frac{\ln\bigl(1-\tilde\alpha+\tilde\alpha[(i+1)p^i-ip^{i+1}]\bigr)}{i(i+1)},\qquad(19)lnp+pα~(1−p)2​=i=1∑∞​i(i+1)ln(1−α~+α~[(i+1)pi−ipi+1])​,(19)

and α∗\alpha^*α∗ is the solution of ∫01dyy(1−ln⁡y)+1/α∗−1=1\int_0^1\frac{dy}{y(1-\ln y)+1/\alpha^*-1}=1∫01​y(1−lny)+1/α∗−1dy​=1. A threshold rule (12) is given by times p=t1≤t2≤⋯≤1p=t_1\le t_2\le\cdots\le1p=t1​≤t2​≤⋯≤1 with Ti=∏j≤itjT_i=\prod_{j\le i}t_jTi​=∏j≤i​tj​: on [ti,ti+1)[t_i,t_{i+1})[ti​,ti+1​) it equals Ti/ti+1T_i/t^{i+1}Ti​/ti+1 for ranks ℓ≤i\ell\le iℓ≤i and 000 for larger ranks.

Formalization targets

Goal: Theorem 8

0≤α~(p)≤α(p)≤α∗(p∈(0,1)),lim⁡p→1−α~(p)=lim⁡p→1−α(p)=α∗.0\le\tilde\alpha(p)\le\alpha(p)\le\alpha^*\quad(p\in(0,1)),\qquad \lim_{p\to1^-}\tilde\alpha(p)=\lim_{p\to1^-}\alpha(p)=\alpha^*.0≤α~(p)≤α(p)≤α∗(p∈(0,1)),p→1−lim​α~(p)=p→1−lim​α(p)=α∗.

Milestones, in the order the proof uses them

  1. B.4: ∑ℓ=1j(j−1ℓ−1)(1−t)j−ℓtℓ=t\sum_{\ell=1}^{j}\binom{j-1}{\ell-1}(1-t)^{j-\ell}t^\ell=t∑ℓ=1j​(ℓ−1j−1​)(1−t)j−ℓtℓ=t.
  2. Lemma 4: a maximal α\alphaα satisfies α≥inf⁡k≥111−pk∑j≤k∫p1t q(t,j) dt\alpha\ge\inf_{k\ge1}\frac{1}{1-p^k}\sum_{j\le k}\int_p^1 t\,q(t,j)\,dtα≥infk≥1​1−pk1​∑j≤k​∫p1​tq(t,j)dt when qqq is non-increasing in ℓ\ellℓ.
  3. Lemma 5: for a threshold rule, the system "every term of that infimum equals α\alphaα" is equivalent to explicit equations (15)–(16).
  4. Lemma 6 (i), (ii): the times t1=pt_1=pt1​=p, t2=peα(1−p)2/pt_2=pe^{\alpha(1-p)^2/p}t2​=peα(1−p)2/p, (tk/tk+1)k−1=γk/γk−1(t_k/t_{k+1})^{k-1}=\gamma_k/\gamma_{k-1}(tk​/tk+1​)k−1=γk​/γk−1​ increase, and their limit is at most 111 exactly under condition (18).
  5. B.6: Ti/tii−1=pγi−1T_i/t_i^{i-1}=p\gamma_{i-1}Ti​/tii−1​=pγi−1​ and μk=p(1−α+αpk−2)/(k−2)\mu_k=p(1-\alpha+\alpha p^{k-2})/(k-2)μk​=p(1−α+αpk−2)/(k−2).
  6. Lemma 6 (iii): under (18) the threshold rule is feasible with value α\alphaα.
  7. Lemma 7: (19) has a unique root, continuous in ppp.
  8. B.8: the ratio h(p,η)h(p,\eta)h(p,η) of the two sides of (19) tends to ∫01dyy(1−ln⁡y)+1/η−1\int_0^1\frac{dy}{y(1-\ln y)+1/\eta-1}∫01​y(1−lny)+1/η−1dy​ as p→1p\to1p→1.

Significance

The result. Theorem 8 shows that sample access interpolates continuously between the secretary and prophet worlds and that, with almost full information, no more than the known-distribution guarantee α∗\alpha^*α∗ is lost or gained. The explicit rule behind α~(p)\tilde\alpha(p)α~(p) is a concrete threshold algorithm, and the companion Theorem 9 of the paper (α~(p)≥α∗p\tilde\alpha(p)\ge\alpha^*pα~(p)≥α∗p, a separate mission) turns it into sample-complexity bounds: O(n/ε)O(n/\varepsilon)O(n/ε) samples suffice for α∗−O(ε)\alpha^*-O(\varepsilon)α∗−O(ε).

Formalizing it. The result is proved on paper; no part of it is machine-checked. A formal proof contributes a verified treatment of an infinite-dimensional linear program over L1([p,1]×N)L^1([p,1]\times\mathbb N)L1([p,1]×N), of series defined through implicit equations, and of a Riemann-sum limit obtained by l'Hôpital's rule. One clause, α(p)≤α∗\alpha(p)\le\alpha^*α(p)≤α∗, is not proved in the paper: it is imported from the i.i.d. prophet inequality literature via the interpretation of α(p)\alpha(p)α(p) as a competitive ratio. A formal proof of that clause directly from SDCLPp_pp​ would be new.

Difficulty

The lower bound α~(p)≤α(p)\tilde\alpha(p)\le\alpha(p)α~(p)≤α(p) needs an explicit feasible point of an infinite program; checking feasibility of the threshold rule requires exact telescoping of series with products of the times tkt_ktk​, which are defined recursively through fractional powers. The limit α~(p)→α∗\tilde\alpha(p)\to\alpha^*α~(p)→α∗ is a 0/00/00/0 limit of infinite series whose terms change scale as p→1p\to1p→1: every individual term tends to zero, so termwise passage to the limit gives no information, and the integral in the defining equation of α∗\alpha^*α∗ appears only in an aggregate limit of the whole series. The upper bound α(p)≤α∗\alpha(p)\le\alpha^*α(p)≤α∗ cannot come from evaluating any single solution: it is a statement about every feasible qqq, and the paper obtains it only through an external argument.

Formalization scope

  • A stopping rule is q : ℝ → ℕ → ℝ; ranks are 1-based (values at rank 000 are never used), and constraints are imposed pointwise on [p,1][p,1][p,1] as printed. The integral of the series in (10) is a lower Lebesgue integral of an [0,∞][0,\infty][0,∞]-valued series, so it cannot collapse to a junk value; each q(⋅,ℓ)q(\cdot,\ell)q(⋅,ℓ) is required integrable on [p,1][p,1][p,1].
  • α(p)\alpha(p)α(p) is sSup of the set of feasible α\alphaα; it contains 000 and is bounded by 111, so it is the true supremum (checked in a sorry-free verification file). The program ranges over all feasible qqq, never only threshold rules.
  • (11) is quantified over k≥1k\ge1k≥1 only, so 1−pk≠01-p^k\neq01−pk=0.
  • Threshold rules use the half-open intervals [ti,ti+1)[t_i,t_{i+1})[ti​,ti+1​) of (7); (12) prints closed intervals, which overlap at the tit_iti​.
  • The series in (18), (19), (26) and μk\mu_kμk​ are written with the summation index shifted to start at 000; with p,α∈(0,1)p,\alpha\in(0,1)p,α∈(0,1) every logarithm's argument lies in [1−α,1][1-\alpha,1][1−α,1], so they converge absolutely and tsum is the true sum.
  • Lemma 6's recursion is tk+1=tk(γk−1/γk)1/(k−1)t_{k+1}=t_k(\gamma_{k-1}/\gamma_k)^{1/(k-1)}tk+1​=tk​(γk−1​/γk​)1/(k−1) for k≥2k\ge2k≥2, the unique positive solution of (17).
  • α~\tilde\alphaα~ and α∗\alpha^*α∗ are predicates (IsAlphaTilde, IsAlphaStar), not chosen functions; the goal holds for every root selection. Existence and uniqueness of α∗\alpha^*α∗ (with β=1/α∗\beta=1/\alpha^*β=1/α∗) is already posed as the open item CorreaThreshold.Adaptive.beta_star_existsUnique and is not posed again.
  • "p→1p\to1p→1" is the one-sided filter 𝓝[<] 1.
  • Lemma 6 (iii) carries hypothesis (18), which the paper states in the sentence after the lemma; without it the claim is false.

Trivializing formalizations are ruled out: replacing α(p)\alpha(p)α(p) by α~(p)\tilde\alpha(p)α~(p) or by the value of a truncated program, fixing ppp, restricting qqq to threshold rules in the definition of α(p)\alpha(p)α(p), or replacing α∗\alpha^*α∗ by 0.7450.7450.745 each changes the theorem and is not done.

A complete development needs: binomial identities, interval integrals of t−it^{-i}t−i and of piecewise-defined functions, real powers and logarithms of recursively defined sequences, summability of series in ℓ1\ell^1ℓ1, continuity of the root of a monotone family of equations, and limits of Riemann-type sums on (0,1](0,1](0,1]. The last two are reusable beyond this mission. Proofs of individual milestones are welcome independently of the goal.

Selected references

  • J. Correa, A. Cristi, B. Epstein, J. A. Soto, Sample-Driven Optimal Stopping: From the Secretary Problem to the i.i.d. Prophet Inequality, arXiv:2011.06516v2, 2021. https://arxiv.org/abs/2011.06516v2
  • T. P. Hill, R. P. Kertz, Comparisons of stop rule and supremum expectations of i.i.d. random variables, The Annals of Probability 10(2), 336–345, 1982 (reference [26] of the paper).
  • R. P. Kertz, Stop rule and supremum expectations of i.i.d. random variables: a complete comparison by conjugate duality, Journal of Multivariate Analysis 19, 88–112, 1986 (reference [28]).
  • J. Correa, P. Foncea, R. Hoeksma, T. Oosterwijk, T. Vredeveld, Posted price mechanisms for a random stream of customers, ACM EC 2017 (reference [17]).
  • H. Kaplan, D. Naori, D. Raz, Competitive analysis with a sample and the secretary problem, SODA 2020 (reference [27]).
  • J. Correa, P. Dütting, F. Fischer, K. Schewior, Prophet inequalities for i.i.d. random variables from an unknown distribution, ACM EC 2019 (reference [15]).
  • A. Rubinstein, J. Z. Wang, S. M. Weinberg, Optimal single-choice prophet inequalities from samples, ITCS 2020 (reference [40]).
13 thms1 active userReviewed
Linear OptimizationOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Selection and Ordering Policies for Hiring Pipelines via Linear Programming 1: A Non-Adaptive, Committed LP-Rounding Policy for ProbeTop-k Earns at Least (1 − e^{−k}k^k/k!) Times the LP BoundResearch Paper

Motivation

Hiring is a pipeline: a firm with kkk openings and a large pool of applicants cannot interview everyone, so it must decide whom to interview, in what order, and whether to hire on the spot. The ProbeTop-k problem models this. Each applicant has a random value with a known distribution, an interview reveals the value, at most TTT interviews may be conducted, and at most kkk applicants are hired. The firm maximises the expected total value of its hires.

The same structure appears in stochastic probing, sequential testing and assortment problems, and its benchmark, the best adaptive, non-committed policy (one that may choose the next interview after seeing earlier values and may hire only at the end), is hard to compute. Practical policies are non-adaptive (fix the interview order in advance) and committed (hire or reject right after each interview). Epstein and Ma (arXiv:2210.04059v3, Operations Research 2024) ask how much is lost by restricting to such policies, and answer with an LP-rounding algorithm whose guarantee improves with kkk.

Setting

An instance I=(k,T,n,F)I = (k, T, n, F)I=(k,T,n,F) has 1≤k≤T≤n1 \le k \le T \le n1≤k≤T≤n. Applicant i∈[n]i \in [n]i∈[n] has value ViV_iVi​ supported on finitely many non-negative values r1,…,rJr_1, \dots, r_Jr1​,…,rJ​, with qij=Pr⁡(Vi=rj)q_{ij} = \Pr(V_i = r_j)qij​=Pr(Vi​=rj​); values are independent across applicants.

The linear relaxation LPptk(I)\mathrm{LP}_{ptk}(I)LPptk​(I) has variables yiy_iyi​ (probability of interviewing iii) and xijx_{ij}xij​ (probability of hiring iii when Vi=rjV_i = r_jVi​=rj​):

LPptk(I)=max⁡∑i=1n∑j=1Jrjxijs.t.xij≤yiqij,  ∑iyi≤T,  ∑i,jxij≤k,  xij≥0,  0≤yi≤1.\mathrm{LP}_{ptk}(I) = \max \sum_{i=1}^n \sum_{j=1}^J r_j x_{ij} \quad \text{s.t.}\quad x_{ij} \le y_i q_{ij},\ \ \sum_i y_i \le T,\ \ \sum_{i,j} x_{ij} \le k,\ \ x_{ij} \ge 0,\ \ 0 \le y_i \le 1 .LPptk​(I)=maxi=1∑n​j=1∑J​rj​xij​s.t.xij​≤yi​qij​,  i∑​yi​≤T,  i,j∑​xij​≤k,  xij​≥0,  0≤yi​≤1.

From a solution (x,y)(x, y)(x,y) define

pi=∑jxijyi,vi=∑jrjxij∑jxij,p_i = \frac{\sum_j x_{ij}}{y_i}, \qquad v_i = \frac{\sum_j r_j x_{ij}}{\sum_j x_{ij}},pi​=yi​∑j​xij​​,vi​=∑j​xij​∑j​rj​xij​​,

each 000 when its denominator is 000.

The algorithm ALGptk solves the LP and takes a basic optimal solution (x,y)(x, y)(x,y). It then draws the interview set SSS by the dependent rounding DR: applicants with yi=1y_i = 1yi​=1 are always in SSS; a single fractional yay_aya​ puts aaa in SSS with probability yay_aya​; two fractional ya+yb=1y_a + y_b = 1ya​+yb​=1 put exactly one of them in SSS, aaa with probability yay_aya​. ALGptk interviews SSS in decreasing order of viv_ivi​, and on observing Vi=rjV_i = r_jVi​=rj​ hires iii with probability xij/(yiqij)x_{ij}/(y_i q_{ij})xij​/(yi​qij​) if a position is still open. Its expected reward is RALGptk(I)R_{ALG_{ptk}}(I)RALGptk​​(I).

Formalization targets

Goal: Theorem 1

RALGptk(I)  ≥  (1−e−kkkk!) LPptk(I)for every valid instance I with k positions.R_{ALG_{ptk}}(I) \;\ge\; \Big(1 - \frac{e^{-k}k^k}{k!}\Big)\, \mathrm{LP}_{ptk}(I) \qquad \text{for every valid instance } I \text{ with } k \text{ positions.}RALGptk​​(I)≥(1−k!e−kkk​)LPptk​(I)for every valid instance I with k positions.

The factor is 1−1/e1 - 1/e1−1/e at k=1k = 1k=1 and tends to 111 as k→∞k \to \inftyk→∞.

Milestones

The paper's own steps, in attack order:

  1. Lemma 2 (p. 16): a basic feasible solution has at most two fractional yiy_iyi​, and two fractional ones sum to 111.
  2. (P1), (P2) (p. 17): DR has marginals E(Yi)=yi\mathbb{E}(Y_i) = y_iE(Yi​)=yi​ and never exceeds TTT interviews.
  3. E(Pi)=pi\mathbb{E}(P_i) = p_iE(Pi​)=pi​ (p. 18): the hiring coin has mean pip_ipi​.
  4. Lemma 3 (p. 18): RALGptk(I)=∑ivi E(1{Ni−1<k}Zi)R_{ALG_{ptk}}(I) = \sum_i v_i\, \mathbb{E}(\mathbf 1\{N_{i-1} < k\} Z_i)RALGptk​​(I)=∑i​vi​E(1{Ni−1​<k}Zi​), where Zi=YiPiZ_i = Y_i P_iZi​=Yi​Pi​, the PiP_iPi​ are independent Bernoulli(pip_ipi​) indicators, and Ni−1N_{i-1}Ni−1​ counts the earlier applicants with Zℓ=1Z_\ell = 1Zℓ​=1.
  5. Lemma 4 (p. 18): with two fractional components, this quantity under DR is at least its value under independent rounding of yyy.
  6. LP identity (p. ec8): ∑i,jrjxij=∑iyivipi\sum_{i,j} r_j x_{ij} = \sum_i y_i v_i p_i∑i,j​rj​xij​=∑i​yi​vi​pi​.
  7. Proposition EC.1 (Yan 2011; p. ec2): the weighted rank function of a kkk-uniform matroid has correlation gap at most (1−e−kkk/k!)−1(1 - e^{-k}k^k/k!)^{-1}(1−e−kkk/k!)−1.
  8. Independent version (p. ec8): with independent rounding, the reward is at least (1−e−kkk/k!) LPptk(I)(1 - e^{-k}k^k/k!)\,\mathrm{LP}_{ptk}(I)(1−e−kkk/k!)LPptk​(I).

A companion milestone, Lemma 5 (p. 21), states that for weighted Bernoulli instances the LP has an optimal solution with xi=yiqix_i = y_i q_ixi​=yi​qi​. It does not feed Theorem 1.

Significance

Theorem 1, combined with the fact that LPptk\mathrm{LP}_{ptk}LPptk​ bounds every adaptive, non-committed policy (Lemma 1 of the paper), shows that a policy that is both non-adaptive and committed earns at least a fraction 1−e−kkk/k!1 - e^{-k}k^k/k!1−e−kkk/k! of the optimal adaptive, non-committed reward; the lost fraction e−kkk/k!e^{-k}k^k/k!e−kkk/k! vanishes as kkk grows. The factor is tight for this LP (App. B.6). The theorem also underlies a PTAS for ProbeTop-k (Corollary 1) and, through Lemma 5, the same guarantee for the Sequential Offering problem of Purohit et al. (Corollary 2).

The result is proved in the paper; to our knowledge nothing in it is machine-checked. A formalization would add to the platform:

  • an LP relaxation with basic feasible solutions as extreme points of a polytope;
  • an explicit model of a randomised, committed selection algorithm as a finite expectation;
  • the correlation gap of kkk-uniform weighted rank functions, a tool that recurs across prophet inequalities, posted pricing and stochastic probing.

Proposition EC.1 is a cited result (Yan 2011), not proved in the paper. Formalizing it is part of the work.

Difficulty

The obvious argument compares the algorithm with the LP term by term, Pr⁡(i hired)≥c yipi\Pr(i \text{ hired}) \ge c\, y_i p_iPr(i hired)≥cyi​pi​ for each iii. This fails because hiring is capped at kkk: applicants late in the order are hired only if few earlier ones were. The guarantee must be obtained in aggregate, which is what the correlation gap does.

Two steps carry the weight:

  • Proposition EC.1 is a genuine extremal inequality over all distributions on subsets with given marginals.
  • Lemma 4 must show that the negative correlation DR introduces between the two fractional applicants never hurts a committed, order-dependent selection. It is a case analysis over sample paths that uses the decreasing order of viv_ivi​.

Lemma 3 is a conditional-expectation identity, but in a fully explicit model it requires marginalising out the values and coins of all other applicants.

Formalization scope

Lean namespace HiringLP.ProbeTopK.

Representation.

  • Applicants are Fin n and support points Fin J. All quantities are real.
  • Instances are valid when 1≤k≤T≤n1 \le k \le T \le n1≤k≤T≤n, rj≥0r_j \ge 0rj​≥0, qij≥0q_{ij} \ge 0qij​≥0 and ∑jqij=1\sum_j q_{ij} = 1∑j​qij​=1.
  • Basic feasible solutions are Set.extremePoints ℝ of the feasible set in (x,y)(x, y)(x,y)-space. An optimal solution is feasible and objective-maximal among feasible points, and LPptk(I)\mathrm{LP}_{ptk}(I)LPptk​(I) is the objective at it.

Conventions.

  • pip_ipi​, viv_ivi​ and the hiring probability xij/(yiqij)x_{ij}/(y_i q_{ij})xij​/(yi​qij​) are 000 when their denominators vanish (the paper's footnote 2).
  • The interview order is a permutation required to be non-increasing in viv_ivi​, with ties in any order.
  • DR is an explicit formula for the probability of each interview set.

The expected reward. RALGptk(I)R_{ALG_{ptk}}(I)RALGptk​​(I) is a finite sum over the interview set, the value vector (independent, law qqq) and the vector of hiring coins (independent given the values). Applicant iii is hired exactly when it is interviewed, its coin succeeds, and fewer than kkk earlier interviewed applicants had successful coins. The reward collects the realised values rVir_{V_i}rVi​​.

Ruled out.

  • Defining the reward as ∑ivi E(1{Ni−1<k}Zi)\sum_i v_i\, \mathbb{E}(\mathbf 1\{N_{i-1} < k\} Z_i)∑i​vi​E(1{Ni−1​<k}Zi​). That is Lemma 3, which would make the goal a statement about its own proof.
  • Comparing with the objective at an arbitrary feasible point instead of an optimal one.

Infrastructure and contributions. The weighted rank function, independent rounding and marginals are separate, reusable definitions. Contributions are welcome on each milestone, especially Proposition EC.1. So is general infrastructure: extreme points of polytopes as basic solutions, and finite product distributions.

Selected references

  • B. Epstein, W. Ma, Selection and Ordering Policies for Hiring Pipelines via Linear Programming, Operations Research, 2024; preprint arXiv:2210.04059v3, 2023. https://arxiv.org/abs/2210.04059
  • Q. Yan, Mechanism design via correlation gap, Proceedings of the 22nd ACM-SIAM Symposium on Discrete Algorithms (SODA), 710–719, 2011. Proceedings volume: https://doi.org/10.1137/1.9781611973082
  • S. Agrawal, Y. Ding, A. Saberi, Y. Ye, Correlation robust stochastic optimization, Proceedings of the 21st ACM-SIAM Symposium on Discrete Algorithms (SODA), 1087–1096, 2010. Proceedings volume: https://doi.org/10.1137/1.9781611973075
  • R. Gandhi, S. Khuller, S. Parthasarathy, A. Srinivasan, Dependent rounding and its applications to approximation algorithms, Journal of the ACM 53(3):324–360, 2006. https://doi.org/10.1145/1147954.1147956
  • M. Purohit, S. Gollapudi, M. Raghavan, Hiring under uncertainty, Proceedings of the 36th International Conference on Machine Learning (PMLR 97), 5181–5189, 2019. https://proceedings.mlr.press/v97/purohit19a.html
13 thms1 active userReviewed
Mechanism DesignOperations ResearchOptimization·Captain: mikedeng1

Intertemporal Price Discrimination via Randomized Promotions: A Two-Point Price Distribution Is Optimal for Randomized Pricing with Two Customer SegmentsResearch Paper

Motivation

Retailers that run predictable promotions teach their customers to wait for them. A customer who knows that a discount will come next week has no reason to buy at the list price today. Firms therefore lose margin on exactly the customers who would have paid in full. One response, documented in practice by Moon, Bimpikis and Mendelson (2017), is to randomize promotions: commit to a distribution of prices, draw a fresh price every period, and let customers know only the distribution. A customer cannot time a discount that arrives at random. Whether waiting is worthwhile then depends on how patient the customer is.

The classical deterministic answer to strategic waiting is cyclic pricing: Conlisk, Gerstner and Sobel (1984) showed that a durable-goods monopolist facing a stream of arriving customers lowers its price periodically. Besbes and Lobel (2015) characterized optimal deterministic policies when customers differ in valuation and patience. Randomized prices as a model of sales go back to Varian (1980) in a competitive setting. Chen, Hu and Wu (SSRN 3223844, published in Manufacturing & Service Operations Management, 2023, doi:10.1287/msom.2023.1194) ask the monopoly question directly: which price distribution should a seller commit to when two customer segments differ in both valuation and waiting cost? This mission formalizes their answer for the two-segment base model.

Setting

A monopolist sells one product over an infinite horizon. A fraction α∈(0,1)\alpha\in(0,1)α∈(0,1) of arriving customers are low-valuation customers, who value the product at vLv_LvL​ and pay a waiting cost cLc_LcL​ per period; the remaining 1−α1-\alpha1−α are high-valuation customers, with valuation vH>vLv_H>v_LvH​>vL​ and waiting cost cHc_HcH​. Assumption (S) of the paper is 0<cL<vL0<c_L<v_L0<cL​<vL​ and 0<cH<vH0<c_H<v_H0<cH​<vH​.

The firm announces a price distribution: a random price PPP with finitely many possible values ppp and probabilities f(p)≥0f(p)\ge0f(p)≥0 summing to one. Each period an independent price is drawn from it. Write F(x)=∑p≤xf(p)F(x)=\sum_{p\le x}f(p)F(x)=∑p≤x​f(p) for the distribution function, E[P∣P≤x]\mathbb E[P\mid P\le x]E[P∣P≤x] for the mean price conditional on P≤xP\le xP≤x, and E[(v−P)+]=∑pf(p)max⁡(v−p,0)\mathbb E[(v-P)^+]=\sum_p f(p)\max(v-p,0)E[(v−P)+]=∑p​f(p)max(v−p,0) for the expected one-period surplus of a customer with valuation vvv. The purchase threshold of a customer with waiting cost ccc is

p‾=max⁡{v′∣E[(v′−P)+]≤c}.\underline p=\max\{v'\mid \mathbb E[(v'-P)^+]\le c\}.p​=max{v′∣E[(v′−P)+]≤c}.

A customer whose valuation exceeds her threshold waits and buys at the first price not above it.

The paper reduces the firm's choice to the regime where low-valuation customers wait and high-valuation customers buy on arrival. The firm's long-run profit per arriving customer is then the objective of problem (2):

max⁡F α E[P∣P≤p‾L]+(1−α)F(vH) E[P∣P≤vH]s.t.E[(vL−P)+]>cL,  E[(vH−P)+]≤cH,\max_{F}\ \alpha\,\mathbb E[P\mid P\le \underline p^L]+(1-\alpha)F(v_H)\,\mathbb E[P\mid P\le v_H]\quad\text{s.t.}\quad \mathbb E[(v_L-P)^+]>c_L,\ \ \mathbb E[(v_H-P)^+]\le c_H,Fmax​ αE[P∣P≤p​L]+(1−α)F(vH​)E[P∣P≤vH​]s.t.E[(vL​−P)+]>cL​,  E[(vH​−P)+]≤cH​,

where p‾L\underline p^Lp​L is the low type's threshold. Replacing p‾L\underline p^Lp​L by vLv_LvL​ in the objective gives the relaxation, problem (3). The key constants are

ΔR=αcL(1−α)(vH−vL),U1=αvL+(1−α)vH−(1−α)cL−2(1−α)(vH−vL)ΔR,\Delta_R=\sqrt{\frac{\alpha c_L}{(1-\alpha)(v_H-v_L)}},\qquad U_1=\alpha v_L+(1-\alpha)v_H-(1-\alpha)c_L-2(1-\alpha)(v_H-v_L)\Delta_R,ΔR​=(1−α)(vH​−vL​)αcL​​​,U1​=αvL​+(1−α)vH​−(1−α)cL​−2(1−α)(vH​−vL​)ΔR​, U2=αvL+(1−α)vH−(1−α)cH−αcLvH−vLcH−cL.U_2=\alpha v_L+(1-\alpha)v_H-(1-\alpha)c_H-\alpha c_L\frac{v_H-v_L}{c_H-c_L}.U2​=αvL​+(1−α)vH​−(1−α)cH​−αcL​cH​−cL​vH​−vL​​.

In Lean the parameters are vL vH cL cH α, a law is w : ℝ →₀ ℝ with IsPriceDist w, and the objects above are cdf, condExp, gain, thresh, Feas, obj2, obj3, ΔR, bnd =(cH−cL)/(vH−vL)=(c_H-c_L)/(v_H-v_L)=(cH​−cL​)/(vH​−vL​), U1, U2. Here p‾L\underline p^Lp​L is written p^L in milestone text.

Formalization targets

Goal: Proposition 3 (p. 16)

Assume cL<cHc_L<c_HcL​<cH​ and ΔR<1\Delta_R<1ΔR​<1, and let U=U1U=U_1U=U1​ if ΔR<cH−cLvH−vL\Delta_R<\frac{c_H-c_L}{v_H-v_L}ΔR​<vH​−vL​cH​−cL​​ and U=U2U=U_2U=U2​ otherwise. Then every price distribution feasible for (2) earns at most UUU in (2), and there is η\etaη with η(δ)→0\eta(\delta)\to0η(δ)→0 as δ↘0\delta\searrow0δ↘0 such that the two-point law

f(p)={β∗p=p‾∗,1−β∗p=vH,β∗=min⁡{ΔR,cH−cLvH−vL−δ},p‾∗=vL−cLβ∗−η(δ),f(p)=\begin{cases}\beta^* & p=\underline p^*,\\ 1-\beta^* & p=v_H,\end{cases}\qquad \beta^*=\min\Big\{\Delta_R,\frac{c_H-c_L}{v_H-v_L}-\delta\Big\},\quad \underline p^*=v_L-\frac{c_L}{\beta^*}-\eta(\delta),f(p)={β∗1−β∗​p=p​∗,p=vH​,​β∗=min{ΔR​,vH​−vL​cH​−cL​​−δ},p​∗=vL​−β∗cL​​−η(δ),

is feasible for (2) for all small δ>0\delta>0δ>0 and its profit tends to UUU. This is the ϵ\epsilonϵ-optimality of the paper's Definition 1.

Milestones

  1. §3.2.2: for every law feasible for (2), E[P∣P≤p‾L]≤E[P∣P≤vL]\mathbb E[P\mid P\le\underline p^L]\le\mathbb E[P\mid P\le v_L]E[P∣P≤p​L]≤E[P∣P≤vL​], so (3) relaxes (2).
  2. §3.2.2: every feasible law has F(vL)<cH−cLvH−vLF(v_L)<\frac{c_H-c_L}{v_H-v_L}F(vL​)<vH​−vL​cH​−cL​​.
  3. Lemma 5, in the form its proof establishes: moving all mass above vLv_LvL​ to vHv_HvH​ preserves feasibility and does not lower the objective of (3).
  4. Lemma 6(ii)(a) and (b): every feasible law earns at most U1U_1U1​, respectively U2U_2U2​, in (3).
  5. Lemma 6(i), the complementary regime ΔR≥1\Delta_R\ge1ΔR​≥1: no feasible law beats the static profit max⁡{vL,(1−α)vH}\max\{v_L,(1-\alpha)v_H\}max{vL​,(1−α)vH​}.

Significance

The result says that, in this model, the optimal randomized promotion is the simplest one. The firm posts the regular price vHv_HvH​ most of the time and runs a promotion at p‾∗\underline p^*p​∗ with probability β∗\beta^*β∗. High-valuation customers buy on arrival; low-valuation customers wait for the promotion. The discount below vLv_LvL​, of size cL/β∗c_L/\beta^*cL​/β∗, is the price of keeping low types in the market. The closed forms U1,U2U_1,U_2U1​,U2​ quantify the profit lost relative to perfect discrimination αvL+(1−α)vH\alpha v_L+(1-\alpha)v_HαvL​+(1−α)vH​. The paper uses them to compare randomized with static and cyclic pricing (Propositions 4 and 8) and generalizes the structure to myopic customers and to nnn segments.

The result is proved on paper; no machine-checked version exists. The mission produces a formal statement of the firm's problem over all finitely supported price laws on R\mathbb RR, a verified upper bound on its value, and a verified family that attains it in the limit. It also records three points the printed statements leave implicit (below).

Difficulty

The decision variable is an entire distribution, and the objective of (2) depends on it through the threshold p‾L\underline p^Lp​L, itself defined by a maximization over the distribution. The obvious approach, guessing the two-point law and checking first-order conditions, gives no upper bound over all laws. The upper bound has to hold for laws with arbitrarily many support points, of either sign and above vHv_HvH​, and both incentive constraints enter it. Problem (3) has a strict constraint and no maximizer, so every statement about "the optimal profit" has to be read as a supremum. The attainment half then needs the threshold of the two-point law, computed from its definition, to sit exactly η(δ)\eta(\delta)η(δ) below vLv_LvL​.

Formalization scope

  • Distributions. A price law is w : ℝ →₀ ℝ with nonnegative masses summing to one (finite support, as the paper assumes on p. 9). Prices range over all of R\mathbb RR: p‾∗\underline p^*p​∗ can be negative under the hypotheses, and with prices restricted to [0,∞)[0,\infty)[0,∞) Proposition 3 is false for some admissible parameters.
  • Standing assumptions, hypotheses of every theorem: Assumption (S), vL<vHv_L<v_HvL​<vH​ (printed on p. 9), and 0<α<10<\alpha<10<α<1 (added; ΔR\Delta_RΔR​ divides by 1−α1-\alpha1−α).
  • Added hypothesis of the goal: cL<cHc_L<c_HcL​<cH​. Without it β∗<0\beta^*<0β∗<0 and the two-point law is not a distribution.
  • Conventions. E[P∣P≤x]\mathbb E[P\mid P\le x]E[P∣P≤x] is a quotient that Lean sets to 000 when F(x)=0F(x)=0F(x)=0; this never happens for feasible laws. p‾L\underline p^Lp​L is the real supremum of {v′∣E[(v′−P)+]≤cL}\{v'\mid\mathbb E[(v'-P)^+]\le c_L\}{v′∣E[(v′−P)+]≤cL​}, which is a maximum for every price law. "The optimal expected profit is no more than UUU" is read as a bound on every feasible law. "Optimal" in Proposition 3 is ϵ\epsilonϵ-optimality for (2), stated as the upper bound plus the approaching family, with η\etaη existential.
  • Lemma 5 as printed quantifies over optimal solutions of (3), which do not exist; the milestone states the dominance that its proof (Online Supplement p. 8) establishes.
  • Ruled out. The profit and the threshold of the two-point law are not given in closed form: they are the general obj2 and thresh applied to it. The upper bound ranges over all feasible laws, not two-point laws or laws on [0,vH][0,v_H][0,vH​]. "Optimal" is not read as "beats static pricing" (that is Proposition 4) or as an attained maximum, and η\etaη may not depend on the competing law.
  • Not in the mission. The customer's optimal-stopping model (Lemma 1, Proposition 1, Lemma 2) is the paper's justification of the objective of (2); the mission states problem (2) as printed. Cyclic and Markovian pricing, myopic customers and nnn segments are not posed.
  • Needed infrastructure. Finite sums over Finsupp supports, monotonicity and continuity of v↦E[(v−P)+]v\mapsto\mathbb E[(v-P)^+]v↦E[(v−P)+], and the elementary concavity argument for β↦U(β)\beta\mapsto U(\beta)β↦U(β). A general library of finitely supported real price laws (distribution function, partial expectations, expected surplus) would be reusable for other pricing papers. Proofs of any milestone are welcome.

Selected references

  • H. Chen, M. Hu, J. Wu, Intertemporal Price Discrimination via Randomized Promotions, SSRN preprint 3223844 (revision of 2022-11-16); Manufacturing & Service Operations Management, 2023. https://ssrn.com/abstract=3223844, https://doi.org/10.1287/msom.2023.1194
  • J. Conlisk, E. Gerstner, J. Sobel, Cyclic pricing by a durable goods monopolist, Quarterly Journal of Economics 99(3), 1984. https://doi.org/10.2307/1885961
  • O. Besbes, I. Lobel, Intertemporal price discrimination: Structure and computation of optimal policies, Management Science 61(1), 2015. https://doi.org/10.1287/mnsc.2014.2049
  • H. Varian, A model of sales, American Economic Review 70(4), 1980. https://www.jstor.org/stable/1803562
  • X. Su, Intertemporal pricing with strategic customer behavior, Management Science 53(5), 2007. https://doi.org/10.1287/mnsc.1060.0628
  • K. Moon, K. Bimpikis, H. Mendelson, Randomized markdowns and online monitoring, Management Science, 2017.
8 thms1 active userReviewed
Algorithmic Game TheoryMechanism DesignOperations Research·Captain: mikedeng1

Scaling Blockchains: Can Committee-Based Consensus Help? I: With a Vote-Probability Gap δ, an Honest Committee Is Elected with Probability at Least 1 − 2m²e^{−δ²n/2}Research Paper

Motivation

Many proof-of-stake blockchains do not let every participant produce blocks. Instead, token holders elect a small committee of block producers, and the committee runs a Byzantine agreement protocol among itself. EOS, for example, elects 21 producers by approval voting: each token holder approves a set of candidates, and the 21 candidates with the most approvals form the committee. Byzantine agreement protocols are safe only while a large enough fraction of the committee is honest, typically more than two thirds, so the security of the whole chain rests on a question of social choice: does approval voting, with voters who see only noisy information about the candidates, elect a committee with enough honest members?

Benhaim, Falk and Tsoukalas (arXiv:2110.08673v2, Management Science 2023) model this election and analyse it. Their main result, Theorem 3, shows that whatever strategies the voters use, as long as the honest candidates are approved with probability at least a fixed margin δ\deltaδ above the dishonest ones, the probability of electing an honest committee converges to one exponentially fast in the number of voters. This mission formalizes that result.

Setting

There are nnn voters and mmm candidates (block producers), and a committee of size k≤mk\le mk≤m is to be elected. Each voter iii submits an approval ballot Cvi\mathcal C_{v_i}Cvi​​, a subset of the candidates. The score of candidate jjj is the number of voters approving it,

score⁡(j)=Xj=∣{ i:j∈Cvi}∣.\operatorname{score}(j)=X_j=\bigl|\{\,i : j\in\mathcal C_{v_i}\}\bigr| .score(j)=Xj​=​{i:j∈Cvi​​}​.

The elected committee T\mathbb TT consists of kkk candidates with the highest scores. When several candidates tie at the lowest elected score, or when fewer than kkk candidates have a non-zero score, the paper resolves the choice adversarially. Formally, a set TTT of candidates is an admissible committee if ∣T∣=k|T|=k∣T∣=k and Xb≤XaX_b\le X_aXb​≤Xa​ for every a∈Ta\in Ta∈T and b∉Tb\notin Tb∈/T.

Each candidate is honest or dishonest. Let M\mathcal MM denote the set of dishonest candidates. For a tolerance p∈[0,1]p\in[0,1]p∈[0,1] (for instance p=1/3p=1/3p=1/3), the committee is honest, written T=H\mathbb T=HT=H, if it has at least ⌈(1−p)k⌉\lceil(1-p)k\rceil⌈(1−p)k⌉ honest members. Because ties and filling are adversarial, T=H\mathbb T=HT=H means that every admissible committee has at least ⌈(1−p)k⌉\lceil(1-p)k\rceil⌈(1−p)k⌉ members outside M\mathcal MM.

The ballots are random: they are drawn on a probability space, independently across voters, while the approvals inside a single ballot may depend on each other in any way. The vote probability pij=Pr⁡[j∈Cvi]p_{ij}=\Pr[j\in\mathcal C_{v_i}]pij​=Pr[j∈Cvi​​] is the probability that voter iii approves candidate jjj. The candidates' types are fixed throughout, and all randomness is in the ballots.

Formalization targets

Goal: Theorem 3 (p. 22)

Suppose there are a set H\mathcal HH of honest candidates with ∣H∣≥(1−p)k|\mathcal H|\ge(1-p)k∣H∣≥(1−p)k and a δ>0\delta>0δ>0 with min⁡i, j∈Hpij≥max⁡i, j∈Mpij+δ\min_{i,\,j\in\mathcal H}p_{ij}\ge\max_{i,\,j\in\mathcal M}p_{ij}+\deltamini,j∈H​pij​≥maxi,j∈M​pij​+δ. Then

Pr⁡[T=H] ≥ 1−2m2e−δ2n/2.\Pr[\mathbb T=H]\ \ge\ 1-2m^2e^{-\delta^2 n/2}.Pr[T=H] ≥ 1−2m2e−δ2n/2.

Milestones (in the order the proof on p. 48 uses them)

  1. Opening claim of the proof (p. 48). If every member of H\mathcal HH outscores every member of M\mathcal MM, then T=H\mathbb T=HT=H (deterministic).
  2. Theorem 1 (pp. 15–16). Each vote count is Poisson binomial:
Pr⁡[Xj=x]=∑∣A∣=x ∏i∈Apij∏i∉A(1−pij).\Pr[X_j=x]=\sum_{|A|=x}\ \prod_{i\in A}p_{ij}\prod_{i\notin A}(1-p_{ij}).Pr[Xj​=x]=∣A∣=x∑​ i∈A∏​pij​i∈/A∏​(1−pij​).
  1. Theorem 6 (p. 50). Chernoff–Hoeffding for a Poisson binomial XXX with mean npˉn\bar pnpˉ​: Pr⁡[X>npˉ+t]≤e−2t2/n\Pr[X>n\bar p+t]\le e^{-2t^2/n}Pr[X>npˉ​+t]≤e−2t2/n and Pr⁡[X<npˉ−t]≤e−2t2/n\Pr[X<n\bar p-t]\le e^{-2t^2/n}Pr[X<npˉ​−t]≤e−2t2/n for t>0t>0t>0.
  2. (82). For jh∈Hj_h\in\mathcal Hjh​∈H, jm∈Mj_m\in\mathcal Mjm​∈M: Pr⁡[Xjh≤Xjm]≤2e−δ2n/2\Pr[X_{j_h}\le X_{j_m}]\le 2e^{-\delta^2n/2}Pr[Xjh​​≤Xjm​​]≤2e−δ2n/2.
  3. (83). Pr⁡[Xjm<Xjh ∀jh∈H, jm∈M]≥1−2m2e−δ2n/2\Pr[X_{j_m}<X_{j_h}\ \forall j_h\in\mathcal H,\ j_m\in\mathcal M]\ge1-2m^2e^{-\delta^2n/2}Pr[Xjm​​<Xjh​​ ∀jh​∈H, jm​∈M]≥1−2m2e−δ2n/2.

Significance

The theorem is the paper's answer to its title question. Its bound holds for every voting behaviour, including the threshold and cardinal strategies the paper studies and strategies with arbitrary correlation inside a ballot. So the security guarantee does not depend on voters coordinating or on knowing the signal model. All it needs is that signals are informative by a margin δ\deltaδ. The bound also shows the trade-off quantitatively: the failure probability grows quadratically in the number of candidates mmm and decays exponentially in the number of voters nnn. This is the basis of the paper's Corollaries 1 and 2 on the threshold and cardinal strategies.

The paper proves the result on paper (Appendix B.2, p. 48), using a Chernoff–Hoeffding bound it cites from Dubhashi and Panconesi. As far as the platform's index shows, no machine-checked version of the result or of its committee model exists. The mission contributes the first formal model of kkk-winner approval voting with adversarial tie-breaking on Prove2Me, a formal statement of the Poisson-binomial law of approval counts, and the one-sided Hoeffding bound for sums of independent Bernoulli variables in the e−2t2/ne^{-2t^2/n}e−2t2/n form. The formalization also records three places where the printed text needs correcting (see Formalization scope).

Difficulty

There are two difficulties. The first is the committee predicate. Ties and under-filled committees are resolved by an adversary, so T=H\mathbb T=HT=H is a statement about every admissible committee, not about one top-kkk list. The reduction from honesty to the score-separation event has to handle both the case where all of H\mathcal HH is elected and the case where some member of H\mathcal HH is left out, so that every elected candidate outscores it.

The second is the concentration step. The vote counts of different candidates are not independent, because each voter's ballot ties the approvals together, so no argument that treats the mmm counts as independent variables applies. The paper's own step from the gap to (82), the split (80)/(81), uses strict inequalities and is false when the two thresholds coincide at an attained integer value; the printed Hoeffding bound (Theorem 6) is strict as well, so the printed chain does not close as written at that boundary.

Formalization scope

  • Voters are Fin n and candidates Fin m, both 0-based. A random ballot is a measurable map Ω → (Fin m → Bool) on a probability space (Ω, P). The ballots are mutually independent (iIndepFun), and each voter's ballot law is otherwise arbitrary. This generalises the paper's Gaussian signal model and its strategy classes, which are not formalized, and the paper's per-type probabilities pih,pimp^h_i,p^m_ipih​,pim​ become per-candidate pijp_{ij}pij​. The cap ∣Cv∣≤t|\mathcal C_v|\le t∣Cv​∣≤t of Definition 2 is not imposed. The printed statements are special cases.
  • T=H\mathbb T=HT=H is the predicate "every set TTT with ∣T∣=k|T|=k∣T∣=k and no outsider scoring above a member has ∣T∖M∣≥⌈(1−p)k⌉|T\setminus\mathcal M|\ge\lceil(1-p)k\rceil∣T∖M∣≥⌈(1−p)k⌉", with an integer ceiling. A formalization in which some admissible committee is honest, or in which the committee is chosen by a fixed tie-breaking rule, is a different and weaker theorem. Without the condition ∣T∣=k|T|=k∣T∣=k the predicate would be trivial. An admissible committee exists for every score vector when k≤mk\le mk≤m.
  • Standing assumptions that are made explicit: k≤mk\le mk≤m (p. 9), 0≤p≤10\le p\le10≤p≤1 (ppp is the tolerated fraction, which the paper never bounds; the opening claim of the proof fails for p<0p<0p<0), independence across voters (§5.1.2), and measurability of each ballot.
  • The min/max gap of Theorem 3 is stated pairwise for all voters i,i′i,i'i,i′, all jh∈Hj_h\in\mathcal Hjh​∈H and all jm∈Mj_m\in\mathcal Mjm​∈M. This is equivalent when both sets are nonempty and avoids undefined extrema otherwise.
  • Corrected slips: Theorem 6 is stated for t>0t>0t>0 and n≥1n\ge1n≥1, since it is false for negative ttt and divides by nnn. (80)/(81) are not posed, and (82) is stated as a bound on Pr⁡[Xjh≤Xjm]\Pr[X_{j_h}\le X_{j_m}]Pr[Xjh​​≤Xjm​​].
  • Infrastructure needed: Mathlib's independence, Measure.real, sub-Gaussian concentration for bounded independent variables, and Finset.powersetCard. The committee definitions and the Poisson-binomial law can be reused by later missions on voting and on the companion single-voter result. Proofs of any milestone are welcome, and so are alternative routes to the goal.

Selected references

  • A. Benhaim, B. H. Falk, G. Tsoukalas, Scaling Blockchains: Can Committee-Based Consensus Help?, Management Science, 2023; preprint arXiv:2110.08673v2, 2022. https://arxiv.org/abs/2110.08673v2 (DOI 10.1287/mnsc.2022.03177)
  • D. P. Dubhashi, A. Panconesi, Concentration of Measure for the Analysis of Randomized Algorithms, Cambridge University Press, 2009. https://doi.org/10.1017/CBO9780511581274
  • W. Hoeffding, Probability Inequalities for Sums of Bounded Random Variables, Journal of the American Statistical Association 58(301), 1963. https://doi.org/10.1080/01621459.1963.10500830
8 thms1 active userReviewed
Control TheoryOperations ResearchStochastic Systems·Captain: mikedeng1

An Approximate Analysis of Dynamic Pricing, Outsourcing, and Scheduling Policies for a Multiclass Make-to-Stock Queue in the Heavy Traffic Regime: The Two-Barrier Drift-Rate Control Policy Is OptimalResearch Paper

Motivation

A manufacturer that makes several products to stock for price-sensitive customers controls three levers at once: the prices it posts, which shape demand; outsourcing, which clears a large backlog at a cost; and scheduling, which decides which product the single server makes next. Ata and Barjesteh (Operations Research 71(1), 2023) study this multiclass make-to-stock queue in the heavy-traffic regime, where the queue is nearly saturated and the system is approximated by a Brownian control problem. The approximation collapses to a one-dimensional problem in the workload, the total amount of work in the system. Its solution is a two-barrier policy whose state-dependent drift translates back into a dynamic pricing rule, an outsourcing threshold and a scheduling priority (§7 of the paper).

The one-dimensional problem belongs to the family of drift-rate control problems for Brownian motion under a long-run average cost criterion (Ata, Harrison and Shepp, Ann. Appl. Probab. 2005; Rubino and Ata, Oper. Res. 2009). Problems of this kind are solved by a Bellman equation with free boundaries and a verification argument; the present paper adds two-sided singular control (outsourcing at the bottom, idling at the top) to a quadratic drift cost and a piecewise linear state cost.

Setting

There are K≥1K\ge1K≥1 products with mean production times mk>0m_k>0mk​>0 and holding, backorder and outsourcing cost rates hk,bk,rk>0h_k,b_k,r_k>0hk​,bk​,rk​>0. A symmetric positive definite matrix HHH describes the curvature of the revenue rate. Write a=m′H−1ma=m'H^{-1}ma=m′H−1m and

h⋆=min⁡khkmk,b⋆=min⁡kbkmk,κ=min⁡krkmk.h^\star=\min_k\frac{h_k}{m_k},\qquad b^\star=\min_k\frac{b_k}{m_k},\qquad \kappa=\min_k\frac{r_k}{m_k}.h⋆=kmin​mk​hk​​,b⋆=kmin​mk​bk​​,κ=kmin​mk​rk​​.

The drift cost and the effective holding cost are

c(x)=min⁡{ζ′Hζ: m′ζ=x},h(w)=h⋆w (w≥0),h(w)=−b⋆w (w<0).c(x)=\min\{\zeta'H\zeta:\ m'\zeta=x\},\qquad h(w)=h^\star w\ (w\ge0),\quad h(w)=-b^\star w\ (w<0).c(x)=min{ζ′Hζ: m′ζ=x},h(w)=h⋆w (w≥0),h(w)=−b⋆w (w<0).

Let BBB be a Brownian motion with drift μ≥0\mu\ge0μ≥0 and variance σ2>0\sigma^2>0σ2>0, started at 000, with respect to a filtration F\mathbb FF. An admissible control consists of a progressively measurable drift rate θ\thetaθ and nondecreasing, right-continuous, adapted processes LLL (effective outsourcing) and UUU (idleness) with L(0)=U(0)=0L(0)=U(0)=0L(0)=U(0)=0. The workload is

W(t)=B(t)−∫0tθ(s) ds−U(t)+L(t),W(t)=B(t)-\int_0^t\theta(s)\,ds-U(t)+L(t),W(t)=B(t)−∫0t​θ(s)ds−U(t)+L(t),

and admissibility also requires E∣W(t)∣/t→0\mathbb E|W(t)|/t\to0E∣W(t)∣/t→0. The equivalent workload formulation (EWF) is to minimize

lim sup⁡t→∞1t E[∫0tc(θ(s)) ds+∫0th(W(s)) ds+κL(t)].(29)\limsup_{t\to\infty}\frac1t\,\mathbb E\Big[\int_0^tc(\theta(s))\,ds+\int_0^th(W(s))\,ds+\kappa L(t)\Big]. \tag{29}t→∞limsup​t1​E[∫0t​c(θ(s))ds+∫0t​h(W(s))ds+κL(t)].(29)

A barrier policy with barriers l<ul<ul<u keeps WWW in [l,u][l,u][l,u], increases LLL only when W=lW=lW=l and UUU only when W=uW=uW=u.

For γ≥0\gamma\ge0γ≥0 put lγ=−1b⋆(γ+μκ+a4κ2)l_\gamma=-\frac1{b^\star}(\gamma+\mu\kappa+\frac a4\kappa^2)lγ​=−b⋆1​(γ+μκ+4a​κ2) and uγ=γ/h⋆u_\gamma=\gamma/h^\staruγ​=γ/h⋆. Let vγ−v^-_\gammavγ−​ solve the Riccati equation

v′=a2σ2(v2−κ2)−2μσ2(v+κ)+2(h(lγ)−h(w))σ2 on [lγ,0],v(lγ)=−κ,v'=\frac a{2\sigma^2}(v^2-\kappa^2)-\frac{2\mu}{\sigma^2}(v+\kappa)+\frac{2(h(l_\gamma)-h(w))}{\sigma^2}\ \text{on }[l_\gamma,0],\qquad v(l_\gamma)=-\kappa,v′=2σ2a​(v2−κ2)−σ22μ​(v+κ)+σ22(h(lγ​)−h(w))​ on [lγ​,0],v(lγ​)=−κ,

and vγ+v^+_\gammavγ+​ solve v′=a2σ2v2−2μσ2v+2(h(uγ)−h(w))σ2v'=\frac a{2\sigma^2}v^2-\frac{2\mu}{\sigma^2}v+\frac{2(h(u_\gamma)-h(w))}{\sigma^2}v′=2σ2a​v2−σ22μ​v+σ22(h(uγ​)−h(w))​ on [0,uγ][0,u_\gamma][0,uγ​] with v(uγ)=0v(u_\gamma)=0v(uγ​)=0. The paper's γ⋆\gamma^\starγ⋆ is the unique γ\gammaγ with vγ−(0)=vγ+(0)v^-_{\gamma}(0)=v^+_{\gamma}(0)vγ−​(0)=vγ+​(0); vvv pastes vγ⋆−v^-_{\gamma^\star}vγ⋆−​ and vγ⋆+v^+_{\gamma^\star}vγ⋆+​ at 000, and the candidate drift is θ(w)=a2v(w)\theta(w)=\frac a2v(w)θ(w)=2a​v(w).

Formalization targets

Goal: Theorem 1

For every filtered probability space carrying such a Brownian motion,

lim⁡t→∞Jcand(t)t=γ⋆for every barrier policy at (lγ⋆,uγ⋆) with drift θ(W),lim sup⁡t→∞J(t)t≥γ⋆ for every admissible control,\lim_{t\to\infty}\frac{J_{\text{cand}}(t)}t=\gamma^\star\quad\text{for every barrier policy at }(l_{\gamma^\star},u_{\gamma^\star})\text{ with drift }\theta(W),\qquad \limsup_{t\to\infty}\frac{J(t)}t\ge\gamma^\star\ \text{for every admissible control},t→∞lim​tJcand​(t)​=γ⋆for every barrier policy at (lγ⋆​,uγ⋆​) with drift θ(W),t→∞limsup​tJ(t)​≥γ⋆ for every admissible control,

where JJJ is the expected cumulative cost in (29). The constant γ⋆\gamma^\starγ⋆ is the paper's construction, not a parameter.

Milestones

  1. Lemma 1 and Lemma 2: the closed forms c(x)=x2/ac(x)=x^2/ac(x)=x2/a and its conjugate φ(y)=a4y2\varphi(y)=\frac a4y^2φ(y)=4a​y2, maximized at ψ(y)=a2y\psi(y)=\frac a2yψ(y)=2a​y.
  2. Proposition 2: a barrier policy whose (γ,f)(\gamma,f)(γ,f) solves the ODE (35)–(36) has long-run average cost γ\gammaγ.
  3. Lemma 3: any solution of the Riccati-form Bellman equation (43)–(45) has γ>0\gamma>0γ>0, l=lγ<0l=l_\gamma<0l=lγ​<0, u=uγ>0u=u_\gamma>0u=uγ​>0.
  4. Lemmas 18–20 and Corollary 6: sign and monotonicity of the Riccati solutions.
  5. §6.3 well-posedness, Lemma 4(i)–(ii), Corollary 1: uniqueness of vγ±v^\pm_\gammavγ±​, their monotone dependence on γ\gammaγ, and the unique crossing γ⋆\gamma^\starγ⋆.
  6. Proposition 3 and Corollary 2: (lγ⋆,uγ⋆,γ⋆,v)(l_{\gamma^\star},u_{\gamma^\star},\gamma^\star,v)(lγ⋆​,uγ⋆​,γ⋆,v) is the unique solution of (43)–(45), and f=∫vf=\int vf=∫v solves the Bellman equation (37)–(39), uniquely up to a constant.

Significance

The theorem identifies an explicit optimal policy for a two-sided singular drift-control problem: two barriers and a strictly increasing, non-positive drift, all determined by a scalar root γ⋆\gamma^\starγ⋆ of a monotone equation. In the paper it drives the proposed pricing, outsourcing and scheduling policy (§7) and its asymptotic analysis; the Riccati structure is what makes γ⋆\gamma^\starγ⋆ computable by line search.

The result is proved in the paper; none of it has been machine-checked. Formalizing it gives a checked verification theorem for an average-cost Brownian control problem with singular controls, and checked statements of the Riccati comparison lemmas on which it rests. Several printed statements of the paper are corrected here (see the scope section), so the formal versions are the first fully precise ones.

Difficulty

The optimality half of Theorem 1 is a verification argument: apply Itô's formula to f(W(t))f(W(t))f(W(t)) for an arbitrary admissible control with jumps in LLL and UUU, use the Bellman inequality pointwise, and control Ef(W(t))/t\mathbb E f(W(t))/tEf(W(t))/t with the growth condition (32). Mathlib does not yet have Itô's formula for continuous semimartingales with finite-variation, possibly discontinuous parts, and the candidate's average cost (Proposition 2) needs the same tool plus the fact that a reflected diffusion spends zero time at the barriers.

The deterministic half is not routine either. The obvious reading of the paper, solving each Riccati problem for every γ≥0\gamma\ge0γ≥0 and passing γ→∞\gamma\to\inftyγ→∞, fails: the solutions blow up in finite time, so vγ±v^\pm_\gammavγ±​ exist only for γ\gammaγ in a bounded initial interval, and the crossing argument must be run on that interval. The comparison arguments of Lemmas 18–20 also need second derivatives of solutions whose right-hand side has a kink at w=0w=0w=0.

Formalization scope

Time is indexed by R\mathbb RR and only t≥0t\ge0t≥0 matters. The Brownian motion is defined locally (drift, variance, start at 000, independence of increments from the filtration). Expected costs are computed in [0,∞][0,\infty][0,∞], so a control with infinite cost counts as +∞+\infty+∞. The integrals in (34) are Lebesgue–Stieltjes integrals against the paths of LLL and UUU, jumps included. Derivatives at the barriers are one-sided; C1C^1C1 and C2C^2C2 up to the boundary are ContDiffOn on the closed interval. Minima and maxima (in ccc, (37), (40)) are stated as attained.

Standing assumptions added to every statement, all implicit in the paper: K≥1K\ge1K≥1; mk,hk,bk,rk>0m_k,h_k,b_k,r_k>0mk​,hk​,bk​,rk​>0; HHH symmetric positive definite; μ≥0\mu\ge0μ≥0, σ>0\sigma>0σ>0; BBB starts at 000; L,UL,UL,U right-continuous; θ\thetaθ progressively measurable with locally integrable paths; l<ul<ul<u in the Bellman equations.

Corrected statements. Lemmas 18–20 are printed for solutions on [0,∞)[0,\infty)[0,∞), which do not exist; they are posed on every bounded interval where a solution exists. The §6.3 claim that vγ±v^\pm_\gammavγ±​ exist for every γ≥0\gamma\ge0γ≥0 is replaced by uniqueness, solvability at γ=0\gamma=0γ=0 and order-connectedness of the solvability sets. Lemma 4's limits as γ→∞\gamma\to\inftyγ→∞ become unboundedness on those sets. Theorem 1's comparison class is every admissible control, which the paper's proof treats, and which contains the stationary Markov policies to which §6 restricts attention.

Not posed. The existence of the reflected diffusion realizing the candidate policy is presupposed by the paper and not claimed: the first half of the goal quantifies over all barrier policies with the given data. The second half is a statement about every admissible control and is not vacuous.

γ⋆\gamma^\starγ⋆, vvv, fff and θ\thetaθ are built from the Riccati solutions by choice, exactly as the paper constructs them; taking them as hypotheses-constrained parameters, or defining ccc by its closed form, would trivialize the goal and is ruled out. Contributions are welcome on the Riccati lemmas (pure real analysis, reusable for other drift-control problems), on Itô's formula for semimartingales with finite-variation parts, and on Skorokhod-type existence of reflected diffusions.

Selected references

  • B. Ata and N. Barjesteh, An Approximate Analysis of Dynamic Pricing, Outsourcing, and Scheduling Policies for a Multiclass Make-to-Stock Queue in the Heavy Traffic Regime, Operations Research 71(1):341–357, 2023. https://doi.org/10.1287/opre.2022.2361 (accepted manuscript: https://ssrn.com/abstract=3464763)
  • B. Ata, J. M. Harrison and L. A. Shepp, Drift rate control of a Brownian processing system, Annals of Applied Probability 15(2):1145–1160, 2005. https://doi.org/10.1214/105051604000000855
  • M. Rubino and B. Ata, Dynamic control of a make-to-order, parallel-server system with cancellations, Operations Research 57(1):94–108, 2009. https://doi.org/10.1287/opre.1080.0532
  • J. M. Harrison, Brownian Models of Performance and Control, Cambridge University Press, 2013. https://doi.org/10.1017/CBO9781139087698
18 thms1 active userReviewed
Algorithmic Game TheoryEconomicsOperations Research+1·Captain: mikedeng1

Partial Vertical Ownership, Capacity Investment, and Information Exchange in a Supply Chain II: Truthful Cheap Talk Is an Equilibrium Iff the Ownership Share β Is at Least β̳Research Paper

Motivation

A supplier who must build capacity before a selling season would like to know how large demand will be, and the retailer downstream often knows better. Under a simple wholesale-price contract, however, the retailer gains from overstating demand: more capacity means more sales for her, and the cost of idle capacity falls on the supplier. Since the retailer's message costs nothing and binds nobody, a rational supplier ignores it. That such cheap talk (Crawford and Sobel, 1982) cannot convey information in a one-shot wholesale-price relationship is the benchmark result of Özer, Zheng and Chen (2011), yet firms are observed to share forecasts informally.

Avinadav and Shamir propose an explanation based on partial vertical ownership (PVO): retailers often hold passive equity stakes in their suppliers. A retailer that owns a share β\betaβ of the supplier bears a fraction β\betaβ of the losses her misreport inflicts on him. Their Theorem 2 says exactly how large the stake must be for truthful reporting to be self-enforcing, and how this depends on the gap between the two possible demand levels. This mission formalizes that theorem.

Setting

A retailer sources a component from a supplier. The supplier secures capacity KKK at unit cost ccc; after demand is realized, the retailer orders and pays the wholesale price www per unit and sells at the retail price rrr, with 0<c<w<r0<c<w<r0<c<w<r. Unmet demand is lost, and leftover capacity is worthless.

Demand in market state i∈{L,H}i\in\{L,H\}i∈{L,H} is Di=μi+εD_i=\mu_i+\varepsilonDi​=μi​+ε with 0<μL<μH0<\mu_L<\mu_H0<μL​<μH​, where ε\varepsilonε is a zero-mean random variable with a density, distribution function FFF, and lower support end ε‾<0\underline{\varepsilon}<0ε​<0 satisfying μL+ε‾≥0\mu_L+\underline{\varepsilon}\ge0μL​+ε​≥0. The information gap is Δ=μH−μL\Delta=\mu_H-\mu_LΔ=μH​−μL​. Write F−1(z)=inf⁡{x:F(x)≥z}F^{-1}(z)=\inf\{x: F(x)\ge z\}F−1(z)=inf{x:F(x)≥z} and define the critical fractiles zs=1−c/wz_s=1-c/wzs​=1−c/w and zr=1−w/rz_r=1-w/rzr​=1−w/r.

The retailer may commit to an advance order qadvq^{adv}qadv which the supplier must cover. The supplier's and retailer's expected profits are

πs(K∣μi,qadv)=E[wmin⁡(K,max⁡(μi+ε,qadv))−cK],\pi_s(K\mid\mu_i,q^{adv})=\mathbb E\big[w\min(K,\max(\mu_i+\varepsilon,q^{adv}))-cK\big],πs​(K∣μi​,qadv)=E[wmin(K,max(μi​+ε,qadv))−cK], πr(qadv,K∣μi)=E[(r−w)min⁡(μi+ε,K)−wmax⁡(qadv−μi−ε,0)].\pi_r(q^{adv},K\mid\mu_i)=\mathbb E\big[(r-w)\min(\mu_i+\varepsilon,K)-w\max(q^{adv}-\mu_i-\varepsilon,0)\big].πr​(qadv,K∣μi​)=E[(r−w)min(μi​+ε,K)−wmax(qadv−μi​−ε,0)].

A retailer holding the share β∈[0,1]\beta\in[0,1]β∈[0,1] of the supplier maximizes the accounting payoff vr(qadv,K∣μi)=πr(qadv,K∣μi)+β πs(K∣μi,qadv)v_r(q^{adv},K\mid\mu_i)=\pi_r(q^{adv},K\mid\mu_i)+\beta\,\pi_s(K\mid\mu_i,q^{adv})vr​(qadv,K∣μi​)=πr​(qadv,K∣μi​)+βπs​(K∣μi​,qadv).

Only the retailer observes the state. In the cheap-talk game she places no advance order and announces a state; a supplier who believes the announcement builds the newsvendor capacity KL=μL+F−1(zs)K_L=\mu_L+F^{-1}(z_s)KL​=μL​+F−1(zs​) or KH=μH+F−1(zs)K_H=\mu_H+F^{-1}(z_s)KH​=μH​+F−1(zs​). Truthful reporting requires

(12)vr(0,KH∣μH)≥vr(0,KL∣μH),(13)vr(0,KL∣μL)≥vr(0,KH∣μL).\text{(12)}\quad v_r(0,K_H\mid\mu_H)\ge v_r(0,K_L\mid\mu_H),\qquad\text{(13)}\quad v_r(0,K_L\mid\mu_L)\ge v_r(0,K_H\mid\mu_L).(12)vr​(0,KH​∣μH​)≥vr​(0,KL​∣μH​),(13)vr​(0,KL​∣μL​)≥vr​(0,KH​∣μL​).

Formalization targets

Goal: Theorem 2

Let

β‾‾=πr(0,KH∣μL)−πr(0,KL∣μL)πs(KL∣μL,0)−πs(KH∣μL,0),R(d)=1d∫F−1(zs)d+F−1(zs)F(x) dx(d>0).\underline{\underline{\beta}}=\frac{\pi_r(0,K_H\mid\mu_L)-\pi_r(0,K_L\mid\mu_L)}{\pi_s(K_L\mid\mu_L,0)-\pi_s(K_H\mid\mu_L,0)},\qquad R(d)=\frac1d\int_{F^{-1}(z_s)}^{d+F^{-1}(z_s)}F(x)\,dx\quad(d>0).β​​=πs​(KL​∣μL​,0)−πs​(KH​∣μL​,0)πr​(0,KH​∣μL​)−πr​(0,KL​∣μL​)​,R(d)=d1​∫F−1(zs​)d+F−1(zs​)​F(x)dx(d>0).

The goal asserts: (12) holds for every β∈[0,1]\beta\in[0,1]β∈[0,1]; for every β∈[0,1]\beta\in[0,1]β∈[0,1], (12) and (13) hold if and only if β≥β‾‾\beta\ge\underline{\underline{\beta}}β≥β​​;

β‾‾=zr1−zr(1−zsR(Δ)−zs−1),R(Δ)<1;\underline{\underline{\beta}}=\frac{z_r}{1-z_r}\left(\frac{1-z_s}{R(\Delta)-z_s}-1\right),\qquad R(\Delta)<1;β​​=1−zr​zr​​(R(Δ)−zs​1−zs​​−1),R(Δ)<1;

and for every β∈(0,1]\beta\in(0,1]β∈(0,1] the equation R(d)=zs+1−zs1+β(1/zr−1)R(d)=z_s+\frac{1-z_s}{1+\beta(1/z_r-1)}R(d)=zs​+1+β(1/zr​−1)1−zs​​ has a unique root Δ‾‾>0\underline{\underline{\Delta}}>0Δ​​>0, and truthful cheap talk is possible only if Δ≥Δ‾‾\Delta\ge\underline{\underline{\Delta}}Δ≥Δ​​.

Milestones

In attack order: the closed forms (2) and (3) of the expected profits; condition (12) always holds; (E.1), that (13) is equivalent to β≥β‾‾\beta\ge\underline{\underline{\beta}}β≥β​​ with positive numerator and denominator; (E.2), the closed form of β‾‾\underline{\underline{\beta}}β​​; and the properties of RRR (strictly increasing on (0,∞)(0,\infty)(0,∞), limits zsz_szs​ at 0+0^+0+ and 111 at ∞\infty∞, values in (zs,1)(z_s,1)(zs​,1)). A companion item states Proposition 1: β‾‾<1\underline{\underline{\beta}}<1β​​<1 if and only if the integrated chain earns less with KHK_HKH​ than with KLK_LKL​ in the low state.

Significance

Theorem 2 identifies an ownership channel through which a one-shot wholesale-price relationship can sustain truthful information exchange, in contrast with the impossibility of cheap talk without such links. The threshold β‾‾\underline{\underline{\beta}}β​​ is the ratio of the low-type retailer's operational gain from lying to the supplier's loss from being misled, and part (ii) turns it into a lower bound on the information gap: a sufficiently small gap rules out cheap talk for every stake. Proposition 1 translates feasibility (β‾‾<1\underline{\underline{\beta}}<1β​​<1) into a comparison of the integrated chain's profits. The same comparisons underlie the paper's later analysis of signaling with advance orders, which takes cheap talk as its benchmark.

The result is proved in the source, in Appendix E of the authors' manuscript; it has no machine-checked proof. The mission produces a formal statement in which every profit is an expectation over a general noise distribution, so that the closed forms the paper derives become theorems rather than definitions, together with the supporting analysis of the averaged distribution function RRR.

Difficulty

The algebra after the closed forms is short. The work lies in two places. First, the closed forms (2) and (3) are integration-by-parts identities for expectations of truncated linear functions of ε\varepsilonε, under a general law rather than a density on a compact interval, including the case of an upper support end at +∞+\infty+∞. Second, the properties of RRR: the paper differentiates RRR and applies L'Hôpital's rule, which presumes more regularity than the standing assumptions give; positivity of the numerator and denominator of β‾‾\underline{\underline{\beta}}β​​, the strict bounds zs<R<1z_s<R<1zs​<R<1, and the existence and uniqueness of Δ‾‾\underline{\underline{\Delta}}Δ​​ all rest on continuity and strict increase of FFF near F−1(zs)F^{-1}(z_s)F−1(zs​). The case β=0\beta=0β=0 in part (ii) is degenerate: the argument of R−1R^{-1}R−1 is then 111, which RRR never attains.

Formalization scope

The source is the authors' manuscript of 2022-06-06; theorem numbers, equation numbers and pages are the manuscript's. The model is a structure with real fields c,w,r,μL,μH,ε‾c,w,r,\mu_L,\mu_H,\underline{\varepsilon}c,w,r,μL​,μH​,ε​ and a measure PPP on R\mathbb RR (the law of ε\varepsilonε), with F=F=F= cdf P. Every theorem assumes the standing hypotheses:

  • PPP is a probability measure, absolutely continuous with respect to Lebesgue measure;
  • ε\varepsilonε is integrable with mean zero (integrability is implicit in "zero-mean");
  • ε‾<0\underline{\varepsilon}<0ε​<0, F(ε‾)=0F(\underline{\varepsilon})=0F(ε​)=0, and FFF is strictly increasing on {x≥ε‾:F(x)<1}\{x\ge\underline{\varepsilon}:F(x)<1\}{x≥ε​:F(x)<1} (added: the paper uses F−1F^{-1}F−1 as an inverse);
  • 0<μL<μH0<\mu_L<\mu_H0<μL​<μH​, μL+ε‾≥0\mu_L+\underline{\varepsilon}\ge0μL​+ε​≥0, and c<w<rc<w<rc<w<r together with the added c>0c>0c>0.

The profits πs,πr,vr\pi_s,\pi_r,v_rπs​,πr​,vr​ are Bochner integrals against PPP, β‾‾\underline{\underline{\beta}}β​​ is the plain quotient of profit differences (the first expression of (14)), and conditions (12)–(13) are the payoff comparisons themselves. Defining any of these by the paper's closed forms would make the milestones definitional and is ruled out. RRR is used only at d>0d>0d>0; Δ‾‾\underline{\underline{\Delta}}Δ​​ is characterized as the unique positive root rather than through a junk inverse, and part (ii) is stated for β∈(0,1]\beta\in(0,1]β∈(0,1]. The supply-chain profit πsc\pi_{sc}πsc​ is taken at advance order 000, as in the proof of Proposition 1. The prior over market states and the signaling and pooling equilibria (Theorems 3–4) are outside this mission.

Mathlib provides distribution functions, Bochner and interval integrals and limits. A complete development needs layer-cake identities for E[min⁡(K,⋅)]\mathbb E[\min(K,\cdot)]E[min(K,⋅)] and E[(⋅)+]\mathbb E[(\cdot)^+]E[(⋅)+] in terms of ∫F\int F∫F, continuity of the CDF of an absolutely continuous law, and the monotonicity and limits of interval averages of a monotone function; these are reusable well beyond this model. Proofs of any milestone, or of general lemmas they need, are welcome.

Selected references

  • T. Avinadav and N. Shamir, Partial Vertical Ownership, Capacity Investment, and Information Exchange in a Supply Chain, Management Science, 2023 (authors' manuscript of 2022-06-06). https://doi.org/10.1287/mnsc.2023.4673
  • V. P. Crawford and J. Sobel, Strategic Information Transmission, Econometrica 50(6), 1982. https://doi.org/10.2307/1913390
  • Ö. Özer, Y. Zheng and K.-Y. Chen, Trust in Forecast Information Sharing, Management Science 57(6), 2011. https://doi.org/10.1287/mnsc.1110.1348
8 thms1 active userReviewed
EconomicsOperations ResearchOptimization·Captain: mikedeng1

Partial Vertical Ownership, Capacity Investment, and Information Exchange in a Supply Chain I: Under Complete Information the Retailer Finances the Entire Capacity Iff β ≥ β̲, and β̲ < 1Research Paper

Motivation

Firms in a supply chain often hold equity in one another. A retailer may own a minority stake in a supplier without controlling it: the stake is passive, but it changes what the retailer cares about, because part of the supplier's profit now accrues to her. Avinadav and Shamir (Management Science, 2023) study how such partial vertical ownership (PVO) affects two classic frictions of decentralized supply chains: the supplier's under-investment in capacity, and the retailer's incentive to distort the demand information she shares. This mission formalizes the paper's benchmark result, Theorem 1, which settles the capacity question when both firms know the market state. It is the reference point against which the paper measures every asymmetric-information equilibrium, and a companion mission treats the paper's cheap-talk result (Theorem 2).

The question belongs to the literature on capacity investment with advance orders and on cross-ownership in vertical relations; the paper's Sections 1–2 survey it. The result itself is a threshold statement of a familiar newsvendor type, but in a model where the decision maker's objective mixes her own operating profit with a fraction of her supplier's.

Setting

A supplier builds a capacity KKK at unit cost ccc before the selling season. After demand DDD is realized, the retailer orders min⁡(K,max⁡(qadv,D))\min(K, \max(q^{adv}, D))min(K,max(qadv,D)) at the wholesale price www and sells at the retail price rrr, where r>w>cr > w > cr>w>c. Here qadv≥0q^{adv} \ge 0qadv≥0 is an advance order: a quantity the retailer commits to before the supplier builds capacity, and which the supplier must cover, K≥qadvK \ge q^{adv}K≥qadv. Unmet demand is lost and leftovers have no value.

Demand in market state i∈{L,H}i \in \{L, H\}i∈{L,H} is Di=μi+εD_i = \mu_i + \varepsilonDi​=μi​+ε with 0<μL<μH0 < \mu_L < \mu_H0<μL​<μH​, where the shock ε\varepsilonε has mean zero, cumulative distribution function FFF, a density, and support (ε‾,εˉ)(\underline\varepsilon, \bar\varepsilon)(ε​,εˉ) with μL+ε‾≥0\mu_L + \underline\varepsilon \ge 0μL​+ε​≥0. The expected profits are

πs(K∣μi,qadv)=E[wmin⁡(K,max⁡(μi+ε,qadv))−cK],\pi_s(K \mid \mu_i, q^{adv}) = \mathbb E\big[w\min(K, \max(\mu_i + \varepsilon, q^{adv})) - cK\big],πs​(K∣μi​,qadv)=E[wmin(K,max(μi​+ε,qadv))−cK], πr(qadv,K∣μi)=E[(r−w)min⁡(μi+ε,K)−wmax⁡(qadv−μi−ε,0)].\pi_r(q^{adv}, K \mid \mu_i) = \mathbb E\big[(r - w)\min(\mu_i + \varepsilon, K) - w\max(q^{adv} - \mu_i - \varepsilon, 0)\big].πr​(qadv,K∣μi​)=E[(r−w)min(μi​+ε,K)−wmax(qadv−μi​−ε,0)].

The retailer owns a share β∈[0,1]\beta \in [0, 1]β∈[0,1] of the supplier and maximizes the accounting payoff

vr(qadv,K∣μi)=πr(qadv,K∣μi)+β πs(K∣μi,qadv).v_r(q^{adv}, K \mid \mu_i) = \pi_r(q^{adv}, K \mid \mu_i) + \beta\,\pi_s(K \mid \mu_i, q^{adv}).vr​(qadv,K∣μi​)=πr​(qadv,K∣μi​)+βπs​(K∣μi​,qadv).

The relevant critical fractiles are zs=1−c/wz_s = 1 - c/wzs​=1−c/w (supplier), zr=1−w/rz_r = 1 - w/rzr​=1−w/r (retailer without holdings) and

zr(β)=1−(1−zr)(1−βzs)=zr+βzs(1−zr).z_r(\beta) = 1 - (1 - z_r)(1 - \beta z_s) = z_r + \beta z_s (1 - z_r).zr​(β)=1−(1−zr​)(1−βzs​)=zr​+βzs​(1−zr​).

Under complete information both firms observe iii. The supplier answers qadvq^{adv}qadv with the capacity KiCI(qadv)K_i^{CI}(q^{adv})KiCI​(qadv), equal to μi+F−1(zs)\mu_i + F^{-1}(z_s)μi​+F−1(zs​) if qadv≤μi+F−1(zs)q^{adv} \le \mu_i + F^{-1}(z_s)qadv≤μi​+F−1(zs​) and to qadvq^{adv}qadv otherwise (5). The retailer compares two options: order nothing and accept μi+F−1(zs)\mu_i + F^{-1}(z_s)μi​+F−1(zs​), or order q∗∈arg⁡max⁡qvr(q,q∣μi)q^* \in \arg\max_{q} v_r(q, q \mid \mu_i)q∗∈argmaxq​vr​(q,q∣μi​) and finance the whole capacity (6)–(7).

Formalization targets

Goal: Theorem 1

Let

β‾=min⁡{β∈[0,1]:zr(β)(F−1(zr(β))−F−1(zs))+(zr+β(1−zr))∫ε‾F−1(zs)F−∫ε‾F−1(zr(β))F≥0}.\underline\beta = \min\Big\{\beta \in [0,1] : z_r(\beta)\big(F^{-1}(z_r(\beta)) - F^{-1}(z_s)\big) + \big(z_r + \beta(1 - z_r)\big)\int_{\underline\varepsilon}^{F^{-1}(z_s)} F - \int_{\underline\varepsilon}^{F^{-1}(z_r(\beta))} F \ge 0\Big\}.β​=min{β∈[0,1]:zr​(β)(F−1(zr​(β))−F−1(zs​))+(zr​+β(1−zr​))∫ε​F−1(zs​)​F−∫ε​F−1(zr​(β))​F≥0}.

Then the minimum exists, β‾<1\underline\beta < 1β​<1, and for both market states

(qiCI,KiCI)={(0, μi+F−1(zs))β<β‾,(μi+F−1(zr(β)), μi+F−1(zr(β)))β≥β‾.\big(q_i^{CI}, K_i^{CI}\big) = \begin{cases} \big(0,\ \mu_i + F^{-1}(z_s)\big) & \beta < \underline\beta,\\ \big(\mu_i + F^{-1}(z_r(\beta)),\ \mu_i + F^{-1}(z_r(\beta))\big) & \beta \ge \underline\beta. \end{cases}(qiCI​,KiCI​)={(0, μi​+F−1(zs​))(μi​+F−1(zr​(β)), μi​+F−1(zr​(β)))​β<β​,β≥β​.​

The formal goal adds that the order chosen by (7) maximizes qadv↦vr(qadv,KiCI(qadv)∣μi)q^{adv} \mapsto v_r(q^{adv}, K_i^{CI}(q^{adv}) \mid \mu_i)qadv↦vr​(qadv,KiCI​(qadv)∣μi​) over qadv≥0q^{adv} \ge 0qadv≥0.

Milestones

In the order the proof uses them: the closed form (2) of πs\pi_sπs​; the optimality of (5); the closed form (4) of vrv_rvr​; the §4 observation that ordering a positive quantity up to μi+F−1(zs)\mu_i + F^{-1}(z_s)μi​+F−1(zs​) is weakly dominated by ordering nothing; the closed form, concavity and unique maximizer q∗=μi+F−1(zr(β))q^* = \mu_i + F^{-1}(z_r(\beta))q∗=μi​+F−1(zr​(β)) of q↦vr(q,q∣μi)q \mapsto v_r(q, q \mid \mu_i)q↦vr​(q,q∣μi​) (Appendix E, p. 43); the identity between the payoff gain G(β)=1r(vr(q∗,q∗∣μi)−vr(0,μi+F−1(zs)∣μi))G(\beta) = \tfrac1r\big(v_r(q^*, q^* \mid \mu_i) - v_r(0, \mu_i + F^{-1}(z_s) \mid \mu_i)\big)G(β)=r1​(vr​(q∗,q∗∣μi​)−vr​(0,μi​+F−1(zs​)∣μi​)) and the expression in (9) (pp. 43–44); and Lemma E1, the existence of a unique threshold β‾∈[0,1)\underline\beta \in [0,1)β​∈[0,1) with G(β)≥0  ⟺  β≥β‾G(\beta) \ge 0 \iff \beta \ge \underline\betaG(β)≥0⟺β≥β​ (p. 44).

Significance

Theorem 1 says that a large enough passive stake always makes the retailer finance the entire capacity, and that full ownership is never needed: β‾<1\underline\beta < 1β​<1 for every choice of prices, costs and demand law. The mechanism is visible in zr(β)z_r(\beta)zr​(β): each unit the retailer buys costs her effectively w−β(w−c)w - \beta(w - c)w−β(w−c), so her preferred capacity grows with β\betaβ, and from β‾\underline\betaβ​ on it is worth paying for. The theorem is also the benchmark for the rest of the paper: the cheap-talk, signaling and pooling equilibria of §§5–7 are compared with (qiCI,KiCI)(q_i^{CI}, K_i^{CI})(qiCI​,KiCI​), and the thresholds β‾\underline\betaβ​ and β‾‾\underline{\underline\beta}β​​ jointly delimit the paper's regimes.

The result is proved in the paper (Appendix E, pp. 42–44). It has not been formalized. A formal proof adds two things beyond confirmation. First, it settles a step the paper asserts without argument: that G(β)<0G(\beta) < 0G(β)<0 whenever zr(β)≤zsz_r(\beta) \le z_szr​(β)≤zs​, which is what forces q∗>μi+F−1(zs)q^* > \mu_i + F^{-1}(z_s)q∗>μi​+F−1(zs​) in the second case of (8). Second, it produces reusable lemmas about newsvendor-type expectations under a general demand law with a density: the layer-cake identities behind (2)–(4) and the unique maximization of qz−∫qFq z - \int^{q} Fqz−∫qF at a quantile.

Difficulty

The identities (2)–(4) are integration-by-parts computations, but they must be done for an arbitrary law with a density, with oriented interval integrals and without assuming bounded support. The concavity and the maximizer at F−1(zr(β))F^{-1}(z_r(\beta))F−1(zr​(β)) require that the quantile be a genuine inverse of FFF on (0,1)(0,1)(0,1).

The central difficulty is Lemma E1. The natural argument computes G′(β)G'(\beta)G′(β) and observes it is positive when zr(β)>zsz_r(\beta) > z_szr​(β)>zs​. That does not settle the sign of GGG on the complementary region, where the paper argues informally that the supplier "builds a higher capacity for free". The comparison in GGG, however, uses capacity q∗q^*q∗ even when q∗<μi+F−1(zs)q^* < \mu_i + F^{-1}(z_s)q∗<μi​+F−1(zs​), so that informal argument compares the wrong objects; a separate estimate is needed there. Differentiability of β↦F−1(zr(β))\beta \mapsto F^{-1}(z_r(\beta))β↦F−1(zr​(β)) is also not given: the density need not be continuous or positive at the quantile, so the monotonicity of GGG cannot simply be read off a derivative.

Formalization scope

The primitives c,w,r,μL,μHc, w, r, \mu_L, \mu_Hc,w,r,μL​,μH​, the law PPP of ε\varepsilonε and ε‾\underline\varepsilonε​ form a structure; FFF is Mathlib's ProbabilityTheory.cdf P, and F−1(z)=inf⁡{x:F(x)≥z}F^{-1}(z) = \inf\{x : F(x) \ge z\}F−1(z)=inf{x:F(x)≥z}, applied only at levels in (0,1)(0, 1)(0,1). The payoffs πs,πr,vr\pi_s, \pi_r, v_rπs​,πr​,vr​ are defined as Bochner integrals of the realized profits; the closed forms are milestones, not definitions. The expression of (9) is defined as printed, because Theorem 1 defines β‾\underline\betaβ​ by it, and a milestone ties it to the payoff gain GGG, which is defined with its factor 1/r1/r1/r. The market state is quantified as μ∈{μL,μH}\mu \in \{\mu_L, \mu_H\}μ∈{μL​,μH​} and the share as β∈[0,1]\beta \in [0, 1]β∈[0,1].

The standing assumptions are those of §3: PPP is a probability measure, ε\varepsilonε has mean zero and a density, ε‾<0\underline\varepsilon < 0ε​<0 with F(ε‾)=0F(\underline\varepsilon) = 0F(ε​)=0, 0<μL<μH0 < \mu_L < \mu_H0<μL​<μH​, μL+ε‾≥0\mu_L + \underline\varepsilon \ge 0μL​+ε​≥0, and c<w<rc < w < rc<w<r. Three implicit assumptions are added and disclosed: c>0c > 0c>0 (otherwise zs=1z_s = 1zs​=1 and F−1(zs)F^{-1}(z_s)F−1(zs​) is not defined), integrability of ε\varepsilonε (presupposed by "zero mean"), and strict increase of FFF on the support {x≥ε‾:F(x)<1}\{x \ge \underline\varepsilon : F(x) < 1\}{x≥ε​:F(x)<1} (the paper uses F−1F^{-1}F−1 as an inverse). The advance order ranges over qadv≥0q^{adv} \ge 0qadv≥0, and K≥qadvK \ge q^{adv}K≥qadv is a hypothesis of (2) and (4).

Two trivializations are ruled out. Defining the profits by their closed forms would make the payoff milestones true by definition, so they are expectations. Replacing the rule (7) by "an arg max of q↦vr(q,KiCI(q)∣μi)q \mapsto v_r(q, K_i^{CI}(q) \mid \mu_i)q↦vr​(q,KiCI​(q)∣μi​)" would be ill-posed, because that maximizer is not unique (for β<1\beta < 1β<1 every order up to μi+ε‾\mu_i + \underline\varepsilonμi​+ε​ ties with 000); qCIq^{CI}qCI is the two-option rule as printed, and its optimality is a separate conclusion.

Proofs of any milestone are welcome, as are general lemmas on expectations of min⁡/max⁡\min/\maxmin/max of a shifted random variable, on quantiles of continuous strictly increasing CDFs, and on the continuity of β↦F−1(zr(β))\beta \mapsto F^{-1}(z_r(\beta))β↦F−1(zr​(β)). The source is the authors' manuscript of 2022-06-06; its proofs are in Appendix E.

Selected references

  • T. Avinadav and N. Shamir, Partial Vertical Ownership, Capacity Investment, and Information Exchange in a Supply Chain, Management Science, 2023 (read as the authors' manuscript of 2022-06-06; Theorem 1 on p. 11, proof on pp. 42–44). https://doi.org/10.1287/mnsc.2023.4673
  • G. P. Cachon, Supply Chain Coordination with Contracts, Handbooks in Operations Research and Management Science 11, 2003 (the newsvendor and wholesale-price contract background). https://doi.org/10.1016/S0927-0507(03)11006-7
9 thms1 active userReviewed
Control TheoryDynamic ProgrammingOperations Research·Captain: mikedeng1

A Dynamic Model for Managing Volunteer Engagement II: The Bellman Solution in Closed Form Between Consecutive Engagement ThresholdsResearch Paper

Motivation

Non-profit organizations such as food banks run on volunteer labour. Volunteers sign up for shifts, wait on a sign-up list, work, rest, and may or may not return; the organization can spend money on engagement activities (reminders, recognition events, recruitment drives) that raise the rate at which volunteers come back or arrive. Spending too little leaves shifts unstaffed; spending too much wastes a scarce budget. Ata, Tongarlak, Lee and Field (arXiv:2312.02920, Operations Research, 2024) model this as a multiclass queueing network, pass to a heavy-traffic limit, and obtain a one-dimensional drift-rate control problem: a reflected diffusion for the scaled workload whose drift is chosen, at a cost, from an interval of feasible drifts. The optimal policy they derive is a nested threshold policy: as the workload falls below successive thresholds τ1>τ2>⋯>τL\tau_1>\tau_2>\dots>\tau_Lτ1​>τ2​>⋯>τL​, one more engagement activity is switched on.

To compute that policy one needs the thresholds, and the paper obtains them from a closed-form description of the solution of the Bellman equation between consecutive thresholds. That closed form, Proposition 3 of the paper, is the goal of this mission. A companion mission formalizes Theorem 1, the existence of a solution of the same Bellman equation.

Setting

There are L≥1L\ge1L≥1 engagement activities. The data are a lowest drift θ0<0\theta_0<0θ0​<0, drift increments η1,…,ηL>0\eta_1,\dots,\eta_L>0η1​,…,ηL​>0, per-unit-drift costs 0<c1<c2<⋯<cL<p0<c_1<c_2<\dots<c_L<p0<c1​<c2​<⋯<cL​<p, an idleness cost rate ppp, a mean-reversion rate κ>0\kappa>0κ>0 and a volatility σ>0\sigma>0σ>0. The breakpoints are

θl=θ0+∑i=1lηi,l=0,…,L,\theta_l=\theta_0+\sum_{i=1}^{l}\eta_i,\qquad l=0,\dots,L,θl​=θ0​+i=1∑l​ηi​,l=0,…,L,

and the feasible drifts form the interval A=[θ0,θL]A=[\theta_0,\theta_L]A=[θ0​,θL​]. The engagement cost c:A→R+c:A\to\mathbb R_+c:A→R+​ is the convex, increasing, piecewise linear function with c(θ0)=0c(\theta_0)=0c(θ0​)=0 and slope clc_lcl​ on (θl−1,θl](\theta_{l-1},\theta_l](θl−1​,θl​]:

c(x)=∑i=1l−1ciηi+cl(x−θl−1),θl−1<x≤θl.c(x)=\sum_{i=1}^{l-1}c_i\eta_i+c_l(x-\theta_{l-1}),\qquad \theta_{l-1}<x\le\theta_l .c(x)=i=1∑l−1​ci​ηi​+cl​(x−θl−1​),θl−1​<x≤θl​.

Its convex conjugate is

ϕ(y)=sup⁡x∈A{yx−c(x)},y∈R.\phi(y)=\sup_{x\in A}\{yx-c(x)\},\qquad y\in\mathbb R .ϕ(y)=x∈Asup​{yx−c(x)},y∈R.

The Bellman equation of the drift-rate control problem asks for a constant β>0\beta>0β>0 and a continuously differentiable function vvv on [0,∞)[0,\infty)[0,∞) with

β=12σ2v′(x)+xκ (p−v(x))−ϕ(p−v(x)),x≥0,\beta=\tfrac12\sigma^2v'(x)+x\kappa\,\big(p-v(x)\big)-\phi\big(p-v(x)\big),\qquad x\ge0,β=21​σ2v′(x)+xκ(p−v(x))−ϕ(p−v(x)),x≥0,

such that v(0)=0v(0)=0v(0)=0, vvv is strictly increasing, and v(x)→pv(x)\to pv(x)→p as x→∞x\to\inftyx→∞. Here β\betaβ is the optimal long-run average cost and v=g′v=g'v=g′ is the derivative of the transformed relative value function ggg of the paper's §4 (p. 20).

Put c^l=cl\hat c_l=c_lc^l​=cl​ for l=1,…,Ll=1,\dots,Ll=1,…,L and c^L+1=p\hat c_{L+1}=pc^L+1​=p. Since vvv is strictly increasing from 000 towards ppp, each level p−c^l∈(0,p)p-\hat c_l\in(0,p)p−c^l​∈(0,p) is attained exactly once; the thresholds are

τl=v−1(p−c^l),l=1,…,L,τL+1=0,τ0=∞.\tau_l=v^{-1}(p-\hat c_l),\quad l=1,\dots,L,\qquad \tau_{L+1}=0,\qquad \tau_0=\infty .τl​=v−1(p−c^l​),l=1,…,L,τL+1​=0,τ0​=∞.

With Φ\PhiΦ the standard normal cumulative distribution function, the paper defines for l=1,…,L+1l=1,\dots,L+1l=1,…,L+1

ul(x)=p−c^lexp⁡{−2θl−1(x−τl)+κ(x2−τl2)σ2}+2(β−c(θl−1))πσκexp⁡{(κx−θl−1)2κσ2}[Φ(κx−θl−1σκ/2)−Φ(κτl−θl−1σκ/2)].u_l(x)=p-\hat c_l\exp\Big\{\tfrac{-2\theta_{l-1}(x-\tau_l)+\kappa(x^2-\tau_l^2)}{\sigma^2}\Big\}+\tfrac{2(\beta-c(\theta_{l-1}))\sqrt\pi}{\sigma\sqrt\kappa}\exp\Big\{\tfrac{(\kappa x-\theta_{l-1})^2}{\kappa\sigma^2}\Big\}\Big[\Phi\Big(\tfrac{\kappa x-\theta_{l-1}}{\sigma\sqrt{\kappa/2}}\Big)-\Phi\Big(\tfrac{\kappa\tau_l-\theta_{l-1}}{\sigma\sqrt{\kappa/2}}\Big)\Big].ul​(x)=p−c^l​exp{σ2−2θl−1​(x−τl​)+κ(x2−τl2​)​}+σκ​2(β−c(θl−1​))π​​exp{κσ2(κx−θl−1​)2​}[Φ(σκ/2​κx−θl−1​​)−Φ(σκ/2​κτl​−θl−1​​)].

Formalization targets

Goal: Proposition 3 (p. 25)

For every solution (β,v)(\beta,v)(β,v) of the Bellman equation and every l=1,…,L+1l=1,\dots,L+1l=1,…,L+1,

v(x)=ul(x)for all x∈[τl,τl−1).v(x)=u_l(x)\qquad\text{for all }x\in[\tau_l,\tau_{l-1}).v(x)=ul​(x)for all x∈[τl​,τl−1​).

The statement fixes nothing beyond the model: it holds for any solution, with the thresholds defined from that solution.

Milestones

  1. (E9), Online Supplement p. 13: the conjugate is piecewise linear,
ϕ(y)=θ0y (y≤c1),ϕ(y)=θm−1y−c(θm−1) (cm−1<y≤cm),ϕ(y)=θLy−c(θL) (y>cL).\phi(y)=\theta_0y\ (y\le c_1),\qquad \phi(y)=\theta_{m-1}y-c(\theta_{m-1})\ (c_{m-1}<y\le c_m),\qquad \phi(y)=\theta_Ly-c(\theta_L)\ (y>c_L).ϕ(y)=θ0​y (y≤c1​),ϕ(y)=θm−1​y−c(θm−1​) (cm−1​<y≤cm​),ϕ(y)=θL​y−c(θL​) (y>cL​).
  1. Lemma 2(i), (D1), Online Supplement p. 9: for κ,σ>0\kappa,\sigma>0κ,σ>0,
∫τxe(2θz−κz2)/σ2 dz=σπκeθ2/(κσ2)[Φ(x−θ/κσ/2κ)−Φ(τ−θ/κσ/2κ)].\int_\tau^x e^{(2\theta z-\kappa z^2)/\sigma^2}\,dz=\frac{\sigma\sqrt\pi}{\sqrt\kappa}e^{\theta^2/(\kappa\sigma^2)}\Big[\Phi\Big(\tfrac{x-\theta/\kappa}{\sigma/\sqrt{2\kappa}}\Big)-\Phi\Big(\tfrac{\tau-\theta/\kappa}{\sigma/\sqrt{2\kappa}}\Big)\Big].∫τx​e(2θz−κz2)/σ2dz=κ​σπ​​eθ2/(κσ2)[Φ(σ/2κ​x−θ/κ​)−Φ(σ/2κ​τ−θ/κ​)].
  1. Lemma 2(ii), (D2), Online Supplement p. 9: the companion formula for ∫τxz e(2θz−κz2)/σ2dz\int_\tau^x z\,e^{(2\theta z-\kappa z^2)/\sigma^2}dz∫τx​ze(2θz−κz2)/σ2dz.

Significance

The result. Proposition 3 turns the nested threshold policy into something computable. Evaluating ulu_lul​ at the right end of its interval and inverting gives τl−1\tau_{l-1}τl−1​ from τl\tau_lτl​, so the thresholds τL,τL−1,…,τ1\tau_L,\tau_{L-1},\dots,\tau_1τL​,τL−1​,…,τ1​ follow by a one-dimensional recursion once β\betaβ is known. The paper's simulation study of a food bank (§5) uses these thresholds to set engagement policy. The result also shows that the value-function derivative, although defined through a nonlinear equation involving a supremum, is an explicit combination of Gaussian-type functions on each threshold interval.

Formalizing it. The result is proved in the paper (Online Supplement §D); no machine-checked version of it, of the conjugate formula (E9), or of the truncated Gaussian integrals (D1)–(D2) is known to exist. A formal proof checks the transcription of a long explicit formula with many constants, which is exactly where printed closed forms tend to go wrong, and produces reusable pieces: the conjugate of a convex piecewise linear function and two interval-integral identities for the normal cdf.

Difficulty

The Bellman equation is nonlinear in vvv through ϕ(p−v)\phi(p-v)ϕ(p−v). The obvious approach, solving it directly, fails because ϕ\phiϕ has no single formula. What makes it tractable is that on [τl,τl−1)[\tau_l,\tau_{l-1})[τl​,τl−1​) the argument p−v(x)p-v(x)p−v(x) stays in one linearity interval of ϕ\phiϕ; this is a property of the solution, derived from its monotonicity and the definition of the thresholds, not a hypothesis. A complete proof must therefore combine the piecewise description of a supremum, a uniqueness argument for a linear first-order equation on a half-open interval (with the one-sided derivative at the left end and, for l=1l=1l=1, an unbounded interval), and the evaluation of Gaussian integrals over finite intervals in terms of the normal cdf, matching every constant of the printed formula. The two expressions for the Φ\PhiΦ arguments, (κx−θ)/(σκ/2)(\kappa x-\theta)/(\sigma\sqrt{\kappa/2})(κx−θ)/(σκ/2​) in ulu_lul​ and (x−θ/κ)/(σ/2κ)(x-\theta/\kappa)/(\sigma/\sqrt{2\kappa})(x−θ/κ)/(σ/2κ​) in (D1)–(D2), are equal, but the identification must be made.

Formalization scope

All objects live in the namespace VolunteerEngage.Thresholds, Lean 4 with Mathlib.

  • The parameters form a structure Model; η\etaη and ccc are N\mathbb NN-indexed sequences of which the indices 1,…,L1,\dots,L1,…,L are used. The standing assumptions (L≥1L\ge1L≥1, θ0<0\theta_0<0θ0​<0, ηl>0\eta_l>0ηl​>0, 0<c1<⋯<cL<p0<c_1<\dots<c_L<p0<c1​<⋯<cL​<p, p>0p>0p>0, κ>0\kappa>0κ>0, σ>0\sigma>0σ>0) form the predicate Standing, a hypothesis of every model-level theorem. The paper states them in the model's derivation ((15), (24), (42), (43), (50), p. 18) rather than for the abstract control problem.
  • The cost (52) is written as one sum, equal to (52) on AAA; values off AAA are never used. ϕ\phiϕ is the supremum (66) over AAA, never its closed form, so (E9) is a genuine statement.
  • A solution of the Bellman equation includes β>0\beta>0β>0 and a pair (v,v′)(v,v')(v,v′) with v′v'v′ continuous on [0,∞)[0,\infty)[0,∞) and the one-sided derivative of vvv within [0,∞)[0,\infty)[0,∞) at every point. "Increasing" is strict.
  • The thresholds enter the goal as a sequence τ\tauτ with τL+1=0\tau_{L+1}=0τL+1​=0 and, for l≤Ll\le Ll≤L, τl≥0\tau_l\ge0τl​≥0 and v(τl)=p−c^lv(\tau_l)=p-\hat c_lv(τl​)=p−c^l​; strict monotonicity makes this the definition τl=v−1(p−c^l)\tau_l=v^{-1}(p-\hat c_l)τl​=v−1(p−c^l​), so the proposition's clause "τl=v−1(p−c^l)\tau_l=v^{-1}(p-\hat c_l)τl​=v−1(p−c^l​)", which restates that definition, is not posed separately. τ0=∞\tau_0=\inftyτ0​=∞ is encoded by dropping the upper bound for l=1l=1l=1.
  • The goal is stated for every solution (β,v)(\beta,v)(β,v); β>0\beta>0β>0 is part of the solution predicate, as on p. 21. It is not vacuous: the companion mission's goal (Theorem 1) asserts that a solution exists. A formalization that assumed the closed form of ϕ\phiϕ, that p−vp-vp−v stays in one linearity interval, or that took ulu_lul​ as the definition of vvv would make the goal trivial and is ruled out.
  • Φ\PhiΦ is the published definition Cohen2019.Robust.Phi, which is Mathlib's cdf (gaussianReal 0 1). Integrals in (D1)–(D2) are oriented interval integrals of continuous functions.

The source is the arXiv preprint v2 including its Online Supplement. The queueing network (§2) and the Brownian control problem (§3) motivate the Bellman equation but are not part of any formal statement; the optimality of the threshold policy (Theorem 2) is not formalized here. Proofs of any milestone, of the goal, and general lemmas on conjugates of piecewise linear functions or on Gaussian integrals over intervals are welcome.

Selected references

  • B. Ata, M. H. Tongarlak, D. Lee, J. Field, A Dynamic Model for Managing Volunteer Engagement, arXiv:2312.02920v2, 2023; Operations Research, 2024. https://arxiv.org/abs/2312.02920
6 thms1 active userReviewed
EconomicsOperations Research·Captain: mikedeng1

Operational Risk Management: Optimal Inspection Policy II: The Optimal Hybrid Inspection Policy Strictly Beats the Random Policy and Weakly Beats the Periodic PolicyResearch Paper

Why inspection timing matters

Banks and other financial firms lose money through operational errors: mistyped trades, missed reconciliations, compliance lapses. Regulators require the firm to hold capital against these losses, and internal audit teams spend most of their effort deciding when to inspect. Two inspection schedules are common in practice: a periodic schedule (inspect every month) and a random schedule (surprise audits). A periodic schedule leaves no error undetected for long, but an employee who knows the date can relax right after an inspection and work hard only before the next one. A random schedule removes that back-loading, but leaves some errors undetected for long stretches.

Y. Kim and Y. Xu, Operational Risk Management: Optimal Inspection Policy (SSRN 3491006; published in Management Science, DOI 10.1287/mnsc.2021.00322), model this trade-off as a principal–agent problem with moral hazard. They show that neither pure schedule dominates the other (their Proposition 4, the subject of mission I of this series), and then propose a hybrid schedule that combines them. This mission formalizes their Proposition 5: the best hybrid schedule beats the best random schedule strictly and the best periodic schedule weakly.

The source used throughout is the authors' SSRN preprint, version of July 2023. All labels (Proposition 5, Lemma 5, (EC.55), …) and page numbers are those of that version, not of the published article.

The model

A firm (the principal) employs an agent whose errors arrive as a Poisson process with rate λe−at\lambda e^{-a_t}λe−at​. Here at≥0a_t\ge0at​≥0 is the agent's effort at time ttt since the last inspection, at unit cost ccc. Each undetected error costs the principal LLL per unit of time until an inspection finds it. At each inspection the agent pays a penalty PPP per error found. The principal pays a wage www per unit of time and an inspection cost KKK per inspection, earns base profit μ\muμ, and both parties discount at rate rrr. The agent accepts the job only if his payoff is at least his reservation payoff πˉ\bar\piπˉ. Write μˉ=μ−rπˉ\bar\mu=\mu-r\bar\piμˉ​=μ−rπˉ.

The time τ\tauτ between two inspections is drawn independently in every cycle from a law chosen by the principal, with mean 1/v1/v1/v (the frequency vvv):

  • random policy RRR: τ∼Exp(v)\tau\sim\mathrm{Exp}(v)τ∼Exp(v);
  • periodic policy DDD: τ=1/v\tau=1/vτ=1/v;
  • hybrid policy H(q)H(q)H(q), q∈[0,1]q\in[0,1]q∈[0,1]: inspect at time q/vq/vq/v with probability qqq; otherwise wait a further Exp(v)\mathrm{Exp}(v)Exp(v) time. Its distribution function is (21):
Fτ(t)={1−(1−q)e−v(t−q/v),t>q/v,q,t=q/v,0,t<q/v.F_\tau(t)=\begin{cases}1-(1-q)e^{-v(t-q/v)}, & t>q/v,\\ q, & t=q/v,\\ 0, & t<q/v.\end{cases}Fτ​(t)=⎩⎨⎧​1−(1−q)e−v(t−q/v),q,0,​t>q/v,t=q/v,t<q/v.​

H(1)H(1)H(1) is the periodic policy and H(0)H(0)H(0) the random one.

Given a policy and a strategy (v,P,w)(v,P,w)(v,P,w), the agent chooses an effort path that maximizes his discounted payoff (1). The principal's discounted payoff is (3):

Π(v,P,w)=μ−wr−L E[∫0τNta∗e−rtdt]1−E[e−rτ]+P E[Nτa∗e−rτ]1−E[e−rτ]−Ker/v−1,\Pi(v,P,w)=\frac{\mu-w}{r}-L\,\frac{\mathbb E[\int_0^\tau N^{a^*}_t e^{-rt}dt]}{1-\mathbb E[e^{-r\tau}]}+P\,\frac{\mathbb E[N^{a^*}_\tau e^{-r\tau}]}{1-\mathbb E[e^{-r\tau}]}-\frac{K}{e^{r/v}-1},Π(v,P,w)=rμ−w​−L1−E[e−rτ]E[∫0τ​Nta∗​e−rtdt]​+P1−E[e−rτ]E[Nτa∗​e−rτ]​−er/v−1K​,

where a∗a^*a∗ is the agent's optimal effort and NtaN^{a}_tNta​ is the number of errors made by time ttt in a cycle. The principal maximizes Π\PiΠ over v,P,w≥0v,P,w\ge0v,P,w≥0 subject to participation (4)–(5). Throughout, Assumption 1 holds: c<Lλ/r<μˉc<L\lambda/r<\bar\muc<Lλ/r<μˉ​. The optimal payoff under policy III is written ΠI(SI∗)\Pi_I(S^*_I)ΠI​(SI∗​).

Formalization targets

Goal: Proposition 5 (p. 20)

For every inspection cost K>0K>0K>0 there is a payoff xHx_HxH​ achievable by some hybrid policy such that

xR<xH  for all achievable random payoffs xR,xD≤xH  for all achievable periodic payoffs xD.x_R<x_H\ \text{ for all achievable random payoffs } x_R,\qquad x_D\le x_H\ \text{ for all achievable periodic payoffs } x_D .xR​<xH​  for all achievable random payoffs xR​,xD​≤xH​  for all achievable periodic payoffs xD​.

In the paper's notation, ΠH(q∗)(SH(q∗)∗)>ΠR(SR∗)\Pi_{H(q^*)}(S^*_{H(q^*)})>\Pi_R(S^*_R)ΠH(q∗)​(SH(q∗)∗​)>ΠR​(SR∗​) and ΠH(q∗)(SH(q∗)∗)≥ΠD(SD∗)\Pi_{H(q^*)}(S^*_{H(q^*)})\ge\Pi_D(S^*_D)ΠH(q∗)​(SH(q∗)∗​)≥ΠD​(SD∗​).

Milestones

  1. (6), p. 10. At an optimal strategy the participation constraint binds, and ΠI=VI(v,P)\Pi_I=V_I(v,P)ΠI​=VI​(v,P), the reduced payoff (6).
  2. Lemma 3, p. 13. Under RRR the optimal effort is constant, with e−a∗=min⁡{cPλr+vv,1}e^{-a^*}=\min\{\frac{c}{P\lambda}\frac{r+v}{v},1\}e−a∗=min{Pλc​vr+v​,1}, and it is zero when P≤c/λP\le c/\lambdaP≤c/λ.
  3. Lemma 5(a), pp. 19–20. Under H(q)H(q)H(q) the optimal effort is given by (22): dynamic before q/vq/vq/v, constant after it.
  4. Lemma EC.3, p. ec8. The optimal random strategy is SR1S^1_RSR1​ (effort inducement) or SR0S^0_RSR0​ (error correction).
  5. Proposition 1, p. 14. SR1S^1_RSR1​ is optimal above a threshold KRK_RKR​ and SR0S^0_RSR0​ below it, in closed form with an implicitly defined α\alphaα and vR0v^0_RvR0​.
  6. (EC.55), pp. ec34–ec35. With zero effort, VH(q)0(v)>VR0(v)V^0_{H(q)}(v)>V^0_R(v)VH(q)0​(v)>VR0​(v) if and only if v>vqv>v^qv>vq, where eqr/vq=1+qr/vq+(qr/vq)2e^{qr/v^q}=1+qr/v^q+(qr/v^q)^2eqr/vq=1+qr/vq+(qr/vq)2, and vq<qrv^q<qrvq<qr.

Significance

Proposition 5 says that reducing the randomness of a surprise-audit schedule, in the hybrid way, strictly improves the principal's optimal payoff whatever the inspection cost. Combined with Proposition 4 it yields the paper's Corollary 1: when inspections are expensive, the optimal mix lies strictly between the two pure policies. The comparison is between optima: each policy is evaluated at its own best frequency, penalty and wage, with the agent best-responding.

The result is proved in the paper (pp. ec34–ec35); to our knowledge it has no machine-checked proof. Formalizing it requires a measure-theoretic treatment of renewal-type payoffs against three inspection laws, the agent's optimal control problem under each law, and the closed-form solution of the random policy (Proposition 1). The model layer (laws, payoffs, best response, achievable payoffs) is shared with mission I of this series.

Where the difficulty lies

The weak part is immediate, because the periodic policy is the hybrid policy with q=1q=1q=1. The strict part is not a comparison of two closed forms: the hybrid optimum has no closed form, and the optimal mix q∗q^*q∗ is not computed. The random optimum itself is one of two strategies of different nature (Lemma EC.3), effort-inducing or error-correcting, and the agent's response under H(q)H(q)H(q) has a different shape from his response under RRR (Lemma 5), so the regime boundaries of the two policies do not coincide. The naive claim that H(q)H(q)H(q) beats RRR at every strategy is false: with zero effort, VH(q)0(v)<VR0(v)V^0_{H(q)}(v)<V^0_R(v)VH(q)0​(v)<VR0​(v) whenever v<vqv<v^qv<vq (EC.55), so whether mixing helps depends on the frequency.

Formalization scope

  • Model layer. The M\mathcal MM error classes enter only through λ=∑mλm\lambda=\sum_m\lambda_mλ=∑m​λm​ and L=∑m(λm/λ)LmL=\sum_m(\lambda_m/\lambda)L_mL=∑m​(λm​/λ)Lm​, as in the paper from p. 10 on. The model starts at the reformulated payoffs (1) and (3): the cycle decomposition of EC.4.1 is not formalized, and expected counts are E[Nta]=λ∫0te−asds\mathbb E[N^a_t]=\lambda\int_0^te^{-a_s}dsE[Nta​]=λ∫0t​e−as​ds, independent of τ\tauτ.
  • Standing assumptions. r,c,λ,L,μ,πˉ,K>0r,c,\lambda,L,\mu,\bar\pi,K>0r,c,λ,L,μ,πˉ,K>0 and Assumption 1 (c<Lλ/r<μˉc<L\lambda/r<\bar\muc<Lλ/r<μˉ​).
  • Effort paths are functions of the time since the last inspection, the same in every cycle. They are measurable, nonnegative and bounded; boundedness keeps every integral finite and loses no optimal effort of Lemmas 3–5.
  • Frequencies are v>0v>0v>0, because (6) contains er/ve^{r/v}er/v.
  • Laws. Exp(v)\mathrm{Exp}(v)Exp(v) is Mathlib's ProbabilityTheory.expMeasure v; the periodic law is a Dirac mass at 1/v1/v1/v; the hybrid law is q δq/vq\,\delta_{q/v}qδq/v​ plus (1−q)(1-q)(1−q) times the shifted exponential law.
  • Optima. "Policy AAA's optimum beats policy BBB's" is stated as: some achievable AAA-payoff is larger than every achievable BBB-payoff. No supremum is used, so no junk value of an empty or unbounded set can make a statement true. The argmax q∗q^*q∗ of (25) is not formalized, because the paper does not prove that it exists; one dominating hybrid payoff is exactly what the comparison with ΠH(q∗)\Pi_{H(q^*)}ΠH(q∗)​ asserts.
  • Agent optimality is tested at wage 000; the wage enters (1) only as w/rw/rw/r.
  • Divisions. The effort formulas (11) and (22) divide by PPP; they are stated under P>c/λP>c/\lambdaP>c/λ, with the zero-effort case stated separately.
  • Implicit numbers. α\alphaα, vR0v^0_RvR0​ and vqv^qvq are variables carrying their defining equations and positivity.

The goal cannot be satisfied vacuously: it asserts the existence of an achievable hybrid payoff, so an empty achievable set does not make it true.

Contributions are welcome at every level: the integral identities for the three laws (Fubini for E[∫0τ⋅]\mathbb E[\int_0^\tau\cdot]E[∫0τ​⋅]), the pointwise solution of the agent's problem, the two-variable optimization behind Proposition 1, and the final perturbation argument. The law lemmas and the agent's problem are reusable for any renewal-type inspection model.

Selected references

  • Y. Kim and Y. Xu, Operational Risk Management: Optimal Inspection Policy, SSRN 3491006, version of July 2023. https://ssrn.com/abstract=3491006
  • Y. Kim and Y. Xu, Operational Risk Management: Optimal Inspection Policy, Management Science (published version; not the numbering used here). https://doi.org/10.1287/mnsc.2021.00322
9 thms1 active userReviewed
AnalysisOperations ResearchOptimization·Captain: mikedeng1

Sample-Driven Optimal Stopping: From the Secretary Problem to the i.i.d. Prophet Inequality I: Feasible Solutions of the Continuous Stopping LP Can Be Improved to Threshold FormResearch Paper

Motivation

Two classical online selection problems sit at opposite ends of an information spectrum. In the secretary problem items arrive in uniformly random order, only their relative ranks are observed, and the best possible probability of stopping on the best item tends to 1/e1/e1/e. In the i.i.d. prophet inequality the values are independent draws from a known distribution, and the best guarantee against the expected maximum is the constant ≈0.745\approx 0.745≈0.745 of Hill and Kertz (1982), shown tight by Correa, Foncea, Hoeksma, Oosterwijk and Vredeveld (2017).

Correa, Cristi, Epstein and Soto (arXiv:2011.06516) interpolate between the two with the ppp-sample-driven optimal stopping problem. Each of NNN items is sampled independently with probability ppp; the decision maker observes the relative rankings of the sampled items, then faces the remaining items online, observing relative rankings, and makes irrevocable stop/continue decisions. Stopping on the item of overall rank iii earns a reward YiY_iYi​, with Y1≥Y2≥⋯Y_1\ge Y_2\ge\cdotsY1​≥Y2​≥⋯. At p=0p=0p=0 and Y=(1,0,0,… )Y=(1,0,0,\dots)Y=(1,0,0,…) this is the secretary problem; for adversarial YYY the optimal guarantee tends to 0.7450.7450.745 as p→1p\to1p→1, the i.i.d. prophet constant.

For known YYY, the paper writes a linear program over the stopping probabilities of rank-based algorithms (after Buchbinder, Jain and Singh, 2014) and takes its limit as N→∞N\to\inftyN→∞. The analysis rests on one structural result, Theorem 2: this limiting program can be restricted, without loss, to solutions of an explicit threshold form, so that the optimal algorithm stops on an item of current rank iii after a time tit_iti​. This mission is that theorem.

Setting

Fix p∈[0,1)p\in[0,1)p∈[0,1). Time runs over [p,1][p,1][p,1] (time ttt is the fraction of the NNN items seen so far; the sample accounts for the first fraction ppp in the limit), and ranks ℓ=1,2,…\ell=1,2,\dotsℓ=1,2,… refer to the relative rank of the current item among all items seen so far. A candidate solution is a function q(t,ℓ)q(t,\ell)q(t,ℓ), the density of stopping at time ttt on an item of relative rank ℓ\ellℓ.

The cumulative mass of qqq is Mq(t)=∫pt∑s≥1q(τ,s) dτM_q(t)=\int_p^t\sum_{s\ge1}q(\tau,s)\,d\tauMq​(t)=∫pt​∑s≥1​q(τ,s)dτ. A solution is feasible for the continuous linear program CLPp_pp​ when q(t,ℓ)≥0q(t,\ell)\ge0q(t,ℓ)≥0, each q(⋅,ℓ)q(\cdot,\ell)q(⋅,ℓ) is integrable on [p,1][p,1][p,1], and

t q(t,ℓ)+Mq(t)≤1∀t∈[p,1], ∀ℓ≥1.t\,q(t,\ell)+M_q(t)\le1\qquad\forall t\in[p,1],\ \forall\ell\ge1 .tq(t,ℓ)+Mq​(t)≤1∀t∈[p,1], ∀ℓ≥1.

For k≥1k\ge1k≥1 the negative-binomial term is nbk,ℓ(t)=∑j=ℓk(j−1ℓ−1)(1−t)j−ℓtℓ\mathrm{nb}_{k,\ell}(t)=\sum_{j=\ell}^{k}\binom{j-1}{\ell-1}(1-t)^{j-\ell}t^{\ell}nbk,ℓ​(t)=∑j=ℓk​(ℓ−1j−1​)(1−t)j−ℓtℓ, the probability that a NegativeBinomial(ℓ,t)(\ell,t)(ℓ,t) variable is at most kkk, and

Fk(q)=∑ℓ=1k∫p1q(t,ℓ) nbk,ℓ(t) dt.F_k(q)=\sum_{\ell=1}^{k}\int_p^1 q(t,\ell)\,\mathrm{nb}_{k,\ell}(t)\,dt .Fk​(q)=ℓ=1∑k​∫p1​q(t,ℓ)nbk,ℓ​(t)dt.

Fk(q)F_k(q)Fk​(q) is the limit of the probability that the algorithm stops on an item of overall rank at most kkk. The objective of CLPp_pp​ is Y1−∑k≥1(Yk−Yk+1)(1−Fk(q))Y_1-\sum_{k\ge1}(Y_k-Y_{k+1})(1-F_k(q))Y1​−∑k≥1​(Yk​−Yk+1​)(1−Fk​(q)) for a non-increasing sequence YYY, so any solution that increases every FkF_kFk​ is at least as good.

A threshold sequence is a non-decreasing (ti)i≥0⊆[p,1](t_i)_{i\ge0}\subseteq[p,1](ti​)i≥0​⊆[p,1] with t0=pt_0=pt0​=p; put Ti=∏j=1itjT_i=\prod_{j=1}^{i}t_jTi​=∏j=1i​tj​.

Formalization targets

Goal: Theorem 2 (p. 8)

For every feasible qqq there are a feasible q∗q^*q∗ and a threshold sequence (ti)(t_i)(ti​) with Fk(q∗)≥Fk(q)F_k(q^*)\ge F_k(q)Fk​(q∗)≥Fk​(q) for all k≥1k\ge1k≥1, such that for every ℓ≥1\ell\ge1ℓ≥1 and t∈[p,1)t\in[p,1)t∈[p,1)

t q∗(t,ℓ)+∫pt∑s≥1q∗(τ,s) dτ=1  (t≥tℓ),q∗(t,ℓ)=0  (t<tℓ),(5–6)t\,q^*(t,\ell)+\int_p^t\sum_{s\ge1}q^*(\tau,s)\,d\tau=1\ \ (t\ge t_\ell),\qquad q^*(t,\ell)=0\ \ (t<t_\ell),\tag{5–6}tq∗(t,ℓ)+∫pt​s≥1∑​q∗(τ,s)dτ=1  (t≥tℓ​),q∗(t,ℓ)=0  (t<tℓ​),(5–6) q∗(t,ℓ)={Ti/ti+1t∈[ti,ti+1), ℓ≤i,0else.(7)q^*(t,\ell)=\begin{cases}T_i/t^{i+1}&t\in[t_i,t_{i+1}),\ \ell\le i,\\0&\text{else.}\end{cases}\tag{7}q∗(t,ℓ)={Ti​/ti+10​t∈[ti​,ti+1​), ℓ≤i,else.​(7)

Milestones

  1. Lemma 17 (p. 28): nbk,ℓ\mathrm{nb}_{k,\ell}nbk,ℓ​ is non-decreasing on [0,1][0,1][0,1] for 1≤ℓ≤k1\le\ell\le k1≤ℓ≤k.
  2. Lemma 18 (p. 29): nbk,ℓ(t)\mathrm{nb}_{k,\ell}(t)nbk,ℓ​(t) is non-increasing in ℓ≥1\ell\ge1ℓ≥1 for t∈[0,1]t\in[0,1]t∈[0,1].
  3. (8) (p. 9): one mass-moving step qn−1↦qnq_{n-1}\mapsto q_nqn−1​↦qn​, which pushes each component to the right up to the envelope 1t(1−Mqn−1(t))\frac1t(1-M_{q_{n-1}}(t))t1​(1−Mqn−1​​(t)), keeps each component's mass, satisfies Mqn≤Mqn−1M_{q_n}\le M_{q_{n-1}}Mqn​​≤Mqn−1​​ in the form (8), and preserves feasibility.
  4. Fk(qn−1)≤Fk(qn)F_k(q_{n-1})\le F_k(q_n)Fk​(qn−1​)≤Fk​(qn​) (p. 9) for the same step.
  5. Uniqueness (p. 10): for fixed thresholds, (5)–(6) have at most one feasible solution on [p,1)[p,1)[p,1).
  6. Existence (p. 10): the function (7) satisfies (5)–(6).

Significance

Theorem 2 turns an infinite-dimensional linear program over functions of two variables into the reduced problem RPp_pp​, an optimization over a single non-decreasing sequence of thresholds. Every quantitative result of the paper is read off RPp_pp​: the optimal ratio for each ppp, its limit as p→1p\to1p→1 (Theorem 8, mission II of this series) and the explicit lower bound α∗p\alpha^*pα∗p (Theorem 9, mission III). It also identifies the optimal rank-based algorithms as threshold rules: accept the current item if it is among the iii best seen so far, where iii grows at the times tit_iti​.

The result is proved in the paper. It has not been formalized, and neither has any part of the continuous-LP approach to secretary and prophet problems. The formal development produces a reusable layer: continuous stopping LPs with extended-real cumulative constraints, monotonicity of negative-binomial distribution functions in both parameters, and a rearrangement argument for integrals against monotone weights.

Difficulty

The obvious argument is to improve qqq greedily: push each component's mass as far right as the constraint allows. One step is easy, but the step changes the constraint itself, since the envelope 1t(1−Mq(t))\frac1t(1-M_q(t))t1​(1−Mq​(t)) depends on all components. The proof iterates, needs the thresholds tℓ(n)t_\ell(n)tℓ​(n) to be monotone in nnn, and must pass to a limit q∞q_\inftyq∞​ in L1L^1L1 with a dominating function that exists only because the smallest threshold is bounded away from 000. The limit thresholds need not be monotone in ℓ\ellℓ, and the components must then be reordered using Lemma 18. Finally, (5)–(6) are an integral equation in which each component depends on the sum of all others; identifying their unique solution with (7) needs both a uniqueness argument for a linear ODE and a telescoping computation.

Formalization scope

  • A solution is a function q : ℝ → ℕ → ℝ, a representative of an element of L1([p,1]×N)L^1([p,1]\times\mathbb N)L1([p,1]×N). Ranks, kkk, iii, jjj are 1-based; q(⋅,0)q(\cdot,0)q(⋅,0) is never used. Constraints are imposed pointwise for all ttt, as printed.
  • The cumulative mass Mq(t)M_q(t)Mq​(t) is the lower Lebesgue integral of ∑s≥1q(τ,s)\sum_{s\ge1}q(\tau,s)∑s≥1​q(τ,s) in [0,∞][0,\infty][0,∞], never a Bochner integral of a real series, which Lean would set to 000 on divergent data.
  • Integrability of each q(⋅,ℓ)q(\cdot,\ell)q(⋅,ℓ) is part of feasibility, so FkF_kFk​ is never a junk value.
  • Equations (5)–(7) are imposed on [p,1)[p,1)[p,1), not on [p,1][p,1][p,1]. At the single point t=1t=1t=1 the printed (5) and (7) contradict each other whenever finitely many thresholds are below 111 (already for q=0q=0q=0). Feasibility of q∗q^*q∗ is required on all of [p,1][p,1][p,1].
  • The threshold intervals [ti,ti+1)[t_i,t_{i+1})[ti​,ti+1​) are half-open, as in (7); they are pairwise disjoint because (ti)(t_i)(ti​) is non-decreasing.
  • "Increasing" in Lemma 17 and "decreasing" in Lemma 18 are read as non-decreasing and non-increasing.
  • The mass-moving step (milestones 3–4) takes the thresholds tℓ(n)t_\ell(n)tℓ​(n) as hypotheses satisfying their defining equation, and requires them to be positive (this only matters at p=0p=0p=0, where the paper's equation already forces it).
  • Milestone 6 assumes t1>0t_1>0t1​>0, and claims (5) at ttt when t<tit<t_it<ti​ for some iii or when Tm/tmm→0T_m/t_m^m\to0Tm​/tmm​→0; on the page these conditions are implicit, and without them the claim fails.
  • A statement of Theorem 2 that keeps only "there is a feasible q∗q^*q∗ with Fk(q∗)≥Fk(q)F_k(q^*)\ge F_k(q)Fk​(q∗)≥Fk​(q)" is trivial (q∗=qq^*=qq∗=q); equations (5)–(7) are part of the goal and must not be dropped.
  • Mathlib supplies interval and lower Lebesgue integrals, series in [0,∞][0,\infty][0,∞] and binomial coefficients. Contributions welcome: the negative-binomial lemmas, the rearrangement inequality for monotone weights, and a Grönwall-type uniqueness argument for the integral equation.

Selected references

  • J. Correa, A. Cristi, B. Epstein, J. A. Soto, Sample-Driven Optimal Stopping: From the Secretary Problem to the i.i.d. Prophet Inequality, arXiv:2011.06516v2, 2021. https://arxiv.org/abs/2011.06516
  • T. P. Hill, R. P. Kertz, Comparisons of stop rule and supremum expectations of i.i.d. random variables, Annals of Probability 10(2), 1982. https://doi.org/10.1214/aop/1176993861
  • J. Correa, P. Foncea, R. Hoeksma, T. Oosterwijk, T. Vredeveld, Posted price mechanisms for a random stream of customers, ACM EC 2017. https://doi.org/10.1145/3033274.3085137
  • N. Buchbinder, K. Jain, M. Singh, Secretary problems via linear programming, Mathematics of Operations Research 39(1), 2014. https://doi.org/10.1287/moor.2013.0604
8 thms1 active userReviewed
Operations ResearchOptimizationStochastic Systems·Captain: mikedeng1

Pricing in On-Demand and One-Way Vehicle-Sharing Networks 1: Static Prices Earn at Least K/(N+K−1+Λ/μ) of the Fluid Optimum, via Increasingly Tight Availability BoundsResearch Paper

Why static prices in vehicle sharing

In one-way car sharing, bike sharing and ride hailing, a vehicle that serves a trip from location iii to location jjj ends up at jjj. Prices therefore do two jobs: they collect revenue and they steer the fleet. The best dynamic (state-dependent) pricing policy reacts to where every vehicle is, but computing it is a Markov decision problem over a state space that grows combinatorially with the fleet. A static policy, one fixed price per origin–destination pair, is easy to compute and to post, and the question is how much it gives up.

Waserhole and Jost (2016) bounded the loss when travel times are negligible. Banerjee, Freund and Lykouris (arXiv:1803.07841, Operations Research 2022) gave guarantees for large fleets. Benjaafar and Shen (SSRN 3998297; Operations Research Technical Note, 2023, doi:10.1287/opre.2023.2446) prove a bound valid for every fleet size KKK that accounts for travel times, and then a sequence of progressively tighter bounds. This mission formalizes that chain.

Setting

There is a finite set N\mathcal NN of NNN locations and K≥1K\ge 1K≥1 vehicles. Trip requests from iii to jjj arrive at rate Λij≥0\Lambda_{ij}\ge 0Λij​≥0; the pairs with positive demand form A={(i,j):Λij>0}\mathcal A=\{(i,j):\Lambda_{ij}>0\}A={(i,j):Λij​>0}, and the network (N,A)(\mathcal N,\mathcal A)(N,A) is strongly connected. A trip from iii to jjj lasts on average 1/μij1/\mu_{ij}1/μij​. A quantile policy q=(qij)q=(q_{ij})q=(qij​), qij∈[0,1]q_{ij}\in[0,1]qij​∈[0,1], is the fraction of requests that accept the posted price; the effective rates are λij=qijΛij\lambda_{ij}=q_{ij}\Lambda_{ij}λij​=qij​Λij​ and λi=∑jλij\lambda_i=\sum_j\lambda_{ij}λi​=∑j​λij​. Each served trip earns Iij(qij)I_{ij}(q_{ij})Iij​(qij​), and q↦qIij(q)q\mapsto qI_{ij}(q)q↦qIij​(q) is concave.

The fluid problem (2) is

max⁡q Rs(q)=∑(i,j)∈AΛijqijIij(qij)s.t.∑jΛijqij=∑jΛjiqji ∀i,∑(i,j)∈AΛijqijμij≤Δ,qij∈[0,1],\max_q\ R_s(q)=\sum_{(i,j)\in\mathcal A}\Lambda_{ij}q_{ij}I_{ij}(q_{ij})\quad\text{s.t.}\quad\sum_j\Lambda_{ij}q_{ij}=\sum_j\Lambda_{ji}q_{ji}\ \forall i,\quad \sum_{(i,j)\in\mathcal A}\frac{\Lambda_{ij}q_{ij}}{\mu_{ij}}\le\Delta,\quad q_{ij}\in[0,1],qmax​ Rs​(q)=(i,j)∈A∑​Λij​qij​Iij​(qij​)s.t.j∑​Λij​qij​=j∑​Λji​qji​ ∀i,(i,j)∈A∑​μij​Λij​qij​​≤Δ,qij​∈[0,1],

with Δ≥K\Delta\ge KΔ≥K. Its optimal solution qsq^sqs is the static policy; it is assumed to induce a strongly connected network. The value Rs(qs)R_s(q^s)Rs​(qs) is the fluid optimum.

Under a static policy the fleet moves through a closed queueing network: a single-server pick-up queue at each location, served at rate λi\lambda_iλi​, and an infinite-server transit queue for each pair, with mean time 1/μij1/\mu_{ij}1/μij​. The paper invokes the BCMP theorem for this network; the mission writes its stationary law as the product form. With rrr a positive solution of the traffic equations (9), ri=∑jrjλji/λjr_i=\sum_j r_j\lambda_{ji}/\lambda_jri​=∑j​rj​λji​/λj​, a state xxx (vehicle counts at locations and in transit, total KKK) has weight

w(x)=∏i(riλi)xi∏(i,j)1xij!(riλijλiμij)xij.w(x)=\prod_i\Bigl(\frac{r_i}{\lambda_i}\Bigr)^{x_i}\prod_{(i,j)}\frac{1}{x_{ij}!}\Bigl(\frac{r_i\lambda_{ij}}{\lambda_i\mu_{ij}}\Bigr)^{x_{ij}}.w(x)=i∏​(λi​ri​​)xi​(i,j)∏​xij​!1​(λi​μij​ri​λij​​)xij​.

The availability αi(K)\alpha_i(K)αi​(K) is the weight share of the states with xi≥1x_i\ge 1xi​≥1: the probability that a customer at iii finds a vehicle. The reward rate of the static policy is (3):

R(qs)=∑(i,j)∈Aαi ΛijqijsIij(qijs).R(q^s)=\sum_{(i,j)\in\mathcal A}\alpha_i\,\Lambda_{ij}q^s_{ij}I_{ij}(q^s_{ij}).R(qs)=(i,j)∈A∑​αi​Λij​qijs​Iij​(qijs​).

Finally Λ=∑AΛij\Lambda=\sum_{\mathcal A}\Lambda_{ij}Λ=∑A​Λij​, 1/μ=∑AΛij/(Λμij)1/\mu=\sum_{\mathcal A}\Lambda_{ij}/(\Lambda\mu_{ij})1/μ=∑A​Λij​/(Λμij​), and λ/μ=∑AΛijqijs/μij\lambda/\mu=\sum_{\mathcal A}\Lambda_{ij}q^s_{ij}/\mu_{ij}λ/μ=∑A​Λij​qijs​/μij​.

Formalization targets

Goal: Theorem 2, static half (p. 9)

With B0j(qs)=B0j=0B^j_0(q^s)=B^j_0=0B0j​(qs)=B0j​=0 and, for 1≤i≤K1\le i\le K1≤i≤K,

BiK(qs)=KN+K−1+λμ(1−Bi−1K−1(qs)),BiK=KN+K−1+Λμ(1−Bi−1K−1),B^K_i(q^s)=\frac{K}{N+K-1+\frac{\lambda}{\mu}\bigl(1-B^{K-1}_{i-1}(q^s)\bigr)},\qquad B^K_i=\frac{K}{N+K-1+\frac{\Lambda}{\mu}\bigl(1-B^{K-1}_{i-1}\bigr)},BiK​(qs)=N+K−1+μλ​(1−Bi−1K−1​(qs))K​,BiK​=N+K−1+μΛ​(1−Bi−1K−1​)K​,

the goal is: for every i=1,…,Ki=1,\dots,Ki=1,…,K,

R(qs)Rs(qs) ≥ BiK(qs) ≥ BiK ≥ KN+K−1+Λ/μ,\frac{R(q^s)}{R_s(q^s)}\ \ge\ B^K_i(q^s)\ \ge\ B^K_i\ \ge\ \frac{K}{N+K-1+\Lambda/\mu},Rs​(qs)R(qs)​ ≥ BiK​(qs) ≥ BiK​ ≥ N+K−1+Λ/μK​,

and Bi+1K>BiKB^K_{i+1}>B^K_iBi+1K​>BiK​ for i=1,…,K−1i=1,\dots,K-1i=1,…,K−1.

The paper's Theorem 2 begins with one more inequality, R(qs)/R(q∗)≥R(qs)/Rs(qs)R(q^s)/R(q^*)\ge R(q^s)/R_s(q^s)R(qs)/R(q∗)≥R(qs)/Rs​(qs), where q∗q^*q∗ is the best state-dependent policy. That inequality is Proposition 1 (p. 6). Its proof needs the stationary behaviour of the network under an arbitrary state-dependent policy with matrix-exponential trip times, together with Jensen's inequality and Little's law; that model is not formalized here. Proposition 1 is not part of this mission. The goal is the remaining chain, and it implies the paper's theorem once Proposition 1 is available.

Milestones

  1. Equal availability under balanced flows (p. 7, Appendix p. 23): αi(K)=αj(K)\alpha_i(K)=\alpha_j(K)αi​(K)=αj​(K).
  2. The ratio equals the availability (pp. 7–8): R(qs)/Rs(qs)=αR(q^s)/R_s(q^s)=\alphaR(qs)/Rs​(qs)=α.
  3. Equation (5) (p. 8): α(K)=K/(K+N−1+λμ(1−α(K−1)))\alpha(K)=K/\bigl(K+N-1+\frac{\lambda}{\mu}(1-\alpha(K-1))\bigr)α(K)=K/(K+N−1+μλ​(1−α(K−1))).
  4. Theorem 1, static half (p. 7): R(qs)/Rs(qs)≥K/(K+N−1+Λ/μ)R(q^s)/R_s(q^s)\ge K/(K+N-1+\Lambda/\mu)R(qs)/Rs​(qs)≥K/(K+N−1+Λ/μ).
  5. Equation (6) and 0≤α(K−i)≤(K−i)/(N+K−i−1)0\le\alpha(K-i)\le(K-i)/(N+K-i-1)0≤α(K−i)≤(K−i)/(N+K−i−1) (p. 9).
  6. BKK(qs)=α(K)B^K_K(q^s)=\alpha(K)BKK​(qs)=α(K) (p. 10).
  7. Bi+1K(qs)>BiK(qs)B^K_{i+1}(q^s)>B^K_i(q^s)Bi+1K​(qs)>BiK​(qs) (p. 10).

Significance

The bound K/(N+K−1+Λ/μ)K/(N+K-1+\Lambda/\mu)K/(N+K−1+Λ/μ) holds for every fleet size, tends to 111 at rate O(1/K)O(1/K)O(1/K), and reduces to the Waserhole–Jost bound when travel times vanish. The sequence BiK(qs)B^K_i(q^s)BiK​(qs) gives a computable certificate between that bound and the exact ratio BKK(qs)=α(K)B^K_K(q^s)=\alpha(K)BKK​(qs)=α(K), which an operator can evaluate from NNN, KKK and the fluid solution alone. Equation (5), a one-step recursion in the fleet size for a network mixing single-server and infinite-server stations, is the reusable core: the two sibling missions (the demand-free bound of Theorem 3 and the split-network bound of Theorem 4) rest on the same recursion.

The results are proved in the paper; none is formalized elsewhere as far as a search of the platform shows. The platform has the multiclass BCMP framework and single-server closed Jackson networks, but not availability in networks with infinite-server stations, nor equation (5). This mission adds a product-form availability layer, the equal-availability lemma, the recursion (5), and the bound chain.

Difficulty

The paper derives (5) from the random observer (arrival) theorem and Little's law, and neither is available as a formal tool, so the recursion has to be obtained from the product form itself, as an identity between sums over the state spaces with KKK and K−1K-1K−1 vehicles. Equal availability needs uniqueness, up to scale, of the positive solution of the traffic equations on a strongly connected network (a Perron–Frobenius-type fact for an irreducible stochastic matrix). In the bound chain, BiK(qs)≥BiKB^K_i(q^s)\ge B^K_iBiK​(qs)≥BiK​ needs the recursion map to be monotone in both the workload and the previous value, which holds only once 0≤B≤10\le B\le 10≤B≤1 is established; strict monotonicity in iii is a double induction.

The obvious shortcut, defining α\alphaα by the recursion (5), makes Theorem 1 a one-line consequence of α(K−1)≥0\alpha(K-1)\ge 0α(K−1)≥0 and deletes the content of the first three milestones; the mission rules it out by defining α\alphaα as the product form.

Formalization scope

Locations form a Fintype with Nonempty; NNN is its cardinality. Demand, travel rates, rewards and policies are functions on all ordered pairs, self-pairs included; sums over A\mathcal AA are sums over all pairs, which agree because each summand carries Λij\Lambda_{ij}Λij​. Strong connectivity, of (N,A)(\mathcal N,\mathcal A)(N,A) and of the network induced by qsq^sqs, uses nonempty paths (Relation.TransGen), so every location has positive accepted demand and A≠∅\mathcal A\ne\emptysetA=∅. Every ordered pair has a transit queue; a pair with λij=0\lambda_{ij}=0λij​=0 has load 000 and stays empty (00=10^0=100=1). All arithmetic on KKK, NNN and iii is in R\mathbb RR; B(K,0)=0B(K,0)=0B(K,0)=0 for every K≥0K\ge 0K≥0, including the B00B^0_0B00​ that the paper's definition omits. Rs(qs)>0R_s(q^s)>0Rs​(qs)>0 is a hypothesis of the ratio statements, since otherwise the ratio is 0/00/00/0. The statements keep the paper's hypothesis that qsq^sqs is optimal for (2) with Δ≥K\Delta\ge KΔ≥K; the proofs use only feasibility and balanced flows, and the queueing milestones are stated for every balanced quantile policy inducing a strongly connected network.

The product form is a definition: the mission does not prove that it is the stationary law of the network's Markov chain (the BCMP theorem). The general closed product-form network (single-server and infinite-server stations on an arbitrary finite station set) is a separate definition and is reusable beyond this mission. Contributions welcome: proofs of (5) via normalizing constants, the traffic-equation uniqueness lemma, and the elementary bound-sequence inequalities.

Selected references

  • S. Benjaafar, X. Shen, Pricing in On-Demand (and One-Way) Vehicle Sharing Networks, SSRN abstract 3998297, version of 2023-01-10. https://ssrn.com/abstract=3998297 ; Technical Note, Operations Research, 2023. https://doi.org/10.1287/opre.2023.2446
  • F. Baskett, K. M. Chandy, R. R. Muntz, F. G. Palacios, Open, Closed, and Mixed Networks of Queues with Different Classes of Customers, J. ACM 22(2), 1975. https://doi.org/10.1145/321879.321887
  • S. Banerjee, D. Freund, T. Lykouris, Pricing and Optimization in Shared Vehicle Systems: An Approximation Framework, Operations Research 70(3), 2022. https://arxiv.org/abs/1803.07841
  • A. Waserhole, V. Jost, Pricing in Vehicle Sharing Systems: Optimization in Queuing Networks with Product Forms, EURO J. Transportation and Logistics 5, 2016. https://doi.org/10.1007/s13676-014-0054-4
  • D. K. George, C. H. Xia, Fleet-Sizing and Service Availability for a Vehicle Rental System via Closed Queueing Networks, European J. Operational Research 211(1), 2011. https://doi.org/10.1016/j.ejor.2010.12.015
  • M. Reiser, S. S. Lavenberg, Mean-Value Analysis of Closed Multichain Queuing Networks, J. ACM 27(2), 1980. https://doi.org/10.1145/322186.322195
12 thms1 active userReviewed
Statistics·Captain: mikedeng1

Design and Analysis of Switchback Experiments 2: Under the Optimal Design the Horvitz–Thompson Estimator Is Asymptotically Normal as the Number of Epochs n → ∞Research Paper

Motivation

Online platforms such as ride-hailing, delivery and marketplace companies routinely test a new policy (a pricing rule, a dispatching algorithm) by switching it on and off over time on a single unit, a city or a market, rather than by randomizing over users. These switchback experiments avoid the interference that user-level randomization creates in two-sided markets, but they face a different problem: a treatment administered at one time keeps affecting outcomes for several periods afterwards (carryover effects). Bojinov, Simchi-Levi and Zhao, Design and Analysis of Switchback Experiments (arXiv:2009.00148, Management Science 69(7), 2023), derive the minimax-optimal design when the carryover lasts at most mmm periods, and then ask how to do inference with it. This mission formalizes the inference half: under the optimal design, the Horvitz–Thompson estimator of the lag-mmm effect is asymptotically normal as the number of epochs grows, which is what justifies the paper's normal-approximation test and confidence intervals.

The result is a finite-population central limit theorem: the potential outcomes are fixed, non-random numbers, and all randomness comes from the experimenter's coin flips. It belongs to the line of design-based limit theorems of Li and Ding (2017), Aronow et al. (2017) and Bojinov et al. (2021). Its probabilistic engine is the central limit theorem of Romano and Wolf (2000) for triangular arrays of ϕ\phiϕ-dependent random variables, which goes back to the mmm-dependent central limit theorem of Hoeffding and Robbins (1948).

Setting

There are TTT time periods t∈[T]={1,…,T}t\in[T]=\{1,\dots,T\}t∈[T]={1,…,T}. An assignment path w1:T∈{0,1}Tw_{1:T}\in\{0,1\}^Tw1:T​∈{0,1}T records treatment (wt=1w_t=1wt​=1) or control (wt=0w_t=0wt​=0) in each period. The potential outcomes are real numbers Yt(w1:T)Y_t(w_{1:T})Yt​(w1:T​). They are assumed non-anticipating (Assumption 1: YtY_tYt​ depends only on w1:tw_{1:t}w1:t​) and to have mmm-carryover effects (Assumption 2: for t>mt>mt>m, YtY_tYt​ does not depend on w1:t−m−1w_{1:t-m-1}w1:t−m−1​). Assumption 3 bounds them: ∣Yt(w1:T)∣≤B|Y_t(w_{1:T})|\le B∣Yt​(w1:T​)∣≤B. Write Yt(1m+1)Y_t(\mathbf 1_{m+1})Yt​(1m+1​) and Yt(0m+1)Y_t(\mathbf 0_{m+1})Yt​(0m+1​) for the outcome after m+1m+1m+1 consecutive treatments, respectively controls. The lag-mmm causal effect is

τm=1T−m∑t=m+1T[Yt(1m+1)−Yt(0m+1)].\tau_m=\frac1{T-m}\sum_{t=m+1}^{T}\big[Y_t(\mathbf 1_{m+1})-Y_t(\mathbf 0_{m+1})\big].τm​=T−m1​t=m+1∑T​[Yt​(1m+1​)−Yt​(0m+1​)].

A regular switchback design flips an independent coin with success probability qk∈(0,1)q_k\in(0,1)qk​∈(0,1) at each randomization point t0=1<t1<⋯<tKt_0=1<t_1<\dots<t_Kt0​=1<t1​<⋯<tK​, and every period copies the most recent coin. The Horvitz–Thompson estimator τ^m\hat\tau_mτ^m​ weights the observed outcome at time ttt by the inverse probability that the last m+1m+1m+1 assignments were all treatments (respectively all controls).

In the nnn-replica experiment T=nmT=nmT=nm, and the optimal design of the paper's Theorem 2 uses fair coins at

T∗={1,  2m+1,  3m+1,  …,  (n−2)m+1}.\mathbb T^*=\{1,\;2m+1,\;3m+1,\;\dots,\;(n-2)m+1\}.T∗={1,2m+1,3m+1,…,(n−2)m+1}.

The periods split into n−1n-1n−1 blocks {(k+1)m+1,…,(k+2)m}\{(k+1)m+1,\dots,(k+2)m\}{(k+1)m+1,…,(k+2)m}, k=0,…,n−2k=0,\dots,n-2k=0,…,n−2, with block sums Yˉk(1m+1)\bar Y_k(\mathbf 1_{m+1})Yˉk​(1m+1​), Yˉk(0m+1)\bar Y_k(\mathbf 0_{m+1})Yˉk​(0m+1​) and block errors 1ˉk\bar{\mathbb 1}_k1ˉk​, so that τ^m−τm=(T−m)−1∑k1ˉk\hat\tau_m-\tau_m=(T-m)^{-1}\sum_k\bar{\mathbb 1}_kτ^m​−τm​=(T−m)−1∑k​1ˉk​. Assumption 4 (non-negligible variance) requires Var(τ^m)≥c/n\mathrm{Var}(\hat\tau_m)\ge c/nVar(τ^m​)≥c/n for some c>0c>0c>0 and all large nnn.

Formalization targets

Goal: Theorem 3 (asymptotic normality)

For fixed mmm, under Assumptions 1–2, Assumption 3 with one bound BBB for all nnn, and Assumption 4,

τ^m−τmVar(τ^m)→DN(0,1)(n→∞).\frac{\hat\tau_m-\tau_m}{\sqrt{\mathrm{Var}(\hat\tau_m)}}\xrightarrow{D}\mathcal N(0,1)\qquad(n\to\infty).Var(τ^m​)​τ^m​−τm​​D​N(0,1)(n→∞).

The statement fixes no rate and does not require Var(τ^m)\mathrm{Var}(\hat\tau_m)Var(τ^m​) to converge.

Milestones

  1. Block decomposition (EC.4.1–EC.4.2): τ^m−τm=(T−m)−1∑k=0n−21ˉk\hat\tau_m-\tau_m=(T-m)^{-1}\sum_{k=0}^{n-2}\bar{\mathbb 1}_kτ^m​−τm​=(T−m)−1∑k=0n−2​1ˉk​ with E1ˉk=0\mathbb E\bar{\mathbb 1}_k=0E1ˉk​=0.
  2. 1-dependence (proof of Theorem 3): the block errors 1ˉ0,…,1ˉn−2\bar{\mathbb 1}_0,\dots,\bar{\mathbb 1}_{n-2}1ˉ0​,…,1ˉn−2​ form a 1-dependent sequence.
  3. Lemma 2: the closed form (10) of Var(τ^m)\mathrm{Var}(\hat\tau_m)Var(τ^m​) in terms of the block sums.
  4. Block-variance bound (proof of Theorem 3): Bn,k,a2≤16kB2/(n−1)2B^2_{n,k,a}\le16kB^2/(n-1)^2Bn,k,a2​≤16kB2/(n−1)2 for the scaled partial sums.
  5. Lemma EC.1 (Romano–Wolf): the central limit theorem for ϕ\phiϕ-dependent triangular arrays.

Companions

Corollary 1, the conservative bound Var(τ^m)≤VarU(τ^m)\mathrm{Var}(\hat\tau_m)\le\mathrm{Var}^U(\hat\tau_m)Var(τ^m​)≤VarU(τ^m​) with the unbiased estimator σ^U2\hat\sigma^2_Uσ^U2​, and Corollary 2(i), that (10) still holds when the design is built for an overestimated order p>mp>mp>m.

Significance

Theorem 3 is what turns the optimal design into a usable inferential procedure: together with Corollary 1 it gives the test statistic ∣τ^m∣/σ^U2|\hat\tau_m|/\sqrt{\hat\sigma^2_U}∣τ^m​∣/σ^U2​​ and its normal ppp-value, a conservative large-sample test of the null of no lag-mmm effect that needs no model for the outcomes. Corollary 2 extends the guarantee to a misspecified carryover order p>mp>mp>m. Lemma EC.1 is a general tool, applicable to any statistic that decomposes into a sum of weakly dependent pieces, such as block designs, time-series bootstraps and spatial experiments.

The paper proves these results. None of them is formalized: Mathlib has the central limit theorem for i.i.d. sequences only, and no central limit theorem for dependent arrays exists on the platform. The work here is to formalize the known proof: the exact second-moment computations of the design, the 1-dependence of the blocks, and a proof of the Romano–Wolf theorem itself, which the paper takes from the literature.

Difficulty

The randomness is a finite set of coin flips and the outcomes change with nnn, so no i.i.d. structure is available: the block errors are neither independent nor identically distributed, and the classical Lindeberg–Lévy theorem does not apply. The obvious reduction, treating neighbouring blocks as independent, fails, because adjacent blocks share a coin. This is why the cross terms appear in (10), and why a dependent-array central limit theorem is needed. The variance normalisation is random-design specific and may oscillate in nnn, so the limit theorem has to be proved with a self-normalisation that does not converge. Lemma EC.1 is the main obstacle: a ϕ\phiϕ-dependent central limit theorem for triangular arrays with Lyapunov-type moment conditions, which is not in Mathlib.

Formalization scope

A path is a function ℕ → Bool of which only 1,…,T1,\dots,T1,…,T is read; potential outcomes are ℕ → Path → ℝ. The design law is encoded as independent coins at the randomization points, mapped to paths; in the nnn-replica experiment the probability space is the uniform measure on the coin vectors of T∗\mathbb T^*T∗. Row nnn of the sequence has T=nmT=nmT=nm and potential outcomes Y n. Rows n<4n<4n<4 exist in Lean but are degenerate and irrelevant to the limit. Convergence in distribution is Mathlib's TendstoInDistribution, and the limit is gaussianReal 0 1. Ω(n−1)\Omega(n^{-1})Ω(n−1) and O(1)O(1)O(1) are explicit constants with an eventual threshold. The estimand, estimator and variance in the goal are the model's definitions, not a hand-written formula in the coins.

Three hypotheses are added to the printed statements, each necessary and disclosed in the item's Formalization Note:

  • Theorem 3 assumes Assumption 3 with one BBB for all nnn. The page omits it, the proof uses it, and without it the statement is false.
  • Lemma EC.1 assumes dn→∞d_n\to\inftydn​→∞. This is Romano and Wolf's sixth condition for fixed ϕ\phiϕ, and without it the lemma fails with dn=1d_n=1dn​=1.
  • Lemma EC.1 assumes Ln>0L_n>0Ln​>0, which the ratios in its conditions 4–5 presuppose.

The goal does not assume 1-dependence, the variance formula or any condition of Lemma EC.1; those are milestones, so the goal cannot be discharged by a hypothesis.

A complete development needs:

  • finite-coin product measures and the independence of functions of disjoint coordinates;
  • exact second-moment computations for the design;
  • a ϕ\phiϕ-dependent central limit theorem for triangular arrays.

The last two, Lemma EC.1 and Definition EC.1, are reusable well beyond this mission. Contributions to any milestone, including alternative proofs of Lemma EC.1, are welcome.

Selected references

  • I. Bojinov, D. Simchi-Levi, J. Zhao, Design and Analysis of Switchback Experiments, Management Science 69(7), 2023. https://arxiv.org/abs/2009.00148 (v4)
  • J. P. Romano, M. Wolf, A more general central limit theorem for m-dependent random variables with unbounded m, Statistics & Probability Letters 47, 115–124, 2000.
  • W. Hoeffding, H. Robbins, The central limit theorem for dependent random variables, Duke Mathematical Journal 15(3), 773–780, 1948.
  • X. Li, P. Ding, General forms of finite population central limit theorems with applications to causal inference, Journal of the American Statistical Association 112, 1759–1769, 2017.
  • I. Bojinov, N. Shephard, Time series experiments and causal estimands: exact randomization tests and trading, Journal of the American Statistical Association 114, 1665–1682, 2019.
9 thms1 active userReviewed
Operations ResearchOptimizationStochastic Systems·Captain: mikedeng1

Pricing in On-Demand and One-Way Vehicle-Sharing Networks 2: With Workload Budget K, Static Prices Earn a Demand-Independent 1 − O(1/√K) Fraction of the Fluid OptimumResearch Paper

Motivation

One-way vehicle-sharing systems (car sharing, bike sharing, ride-hailing fleets) set a price for every origin–destination trip. Prices decide which trips are taken, and so they decide where vehicles end up. Pricing that depends on the current position of every vehicle is in principle optimal, but its state space grows combinatorially with the fleet. Practitioners therefore use static prices, which depend only on the origin and destination. The question is how much revenue, throughput or welfare such prices give up.

Benjaafar and Shen (SSRN 3998297; Technical Note, Operations Research, 2023, doi:10.1287/opre.2023.2446) answer this with explicit lower bounds on the performance ratio of the static policy obtained from a fluid relaxation. Banerjee, Freund and Lykouris (arXiv:1611.07624) proved the earlier guarantee, which requires the fleet size KKK to be at least 100100100 and the workload to be at most K−2Kln⁡KK-2\sqrt{K\ln K}K−2KlnK​. Benjaafar and Shen give two bounds that hold for every KKK. The first is K/(N+K−1+Λ/μ)K/(N+K-1+\Lambda/\mu)K/(N+K−1+Λ/μ) (their Theorems 1–2), and it degrades when total demand Λ\LambdaΛ grows with KKK. The second, Theorem 3, does not depend on demand or travel times at all. This mission is about Theorem 3.

Setting

There is a finite set N\mathcal NN of NNN locations and KKK vehicles. Trip requests from iii to jjj arrive as a Poisson process of rate Λij≥0\Lambda_{ij}\ge0Λij​≥0, and A={(i,j):Λij>0}\mathcal A=\{(i,j):\Lambda_{ij}>0\}A={(i,j):Λij​>0} is the set of pairs with demand. The graph (N,A)(\mathcal N,\mathcal A)(N,A) is strongly connected. A trip from iii to jjj lasts a random time with mean 1/μij1/\mu_{ij}1/μij​. A static policy is a matrix q=(qij)q=(q_{ij})q=(qij​) of quantiles: qij∈[0,1]q_{ij}\in[0,1]qij​∈[0,1] is the fraction of (i,j)(i,j)(i,j) customers who accept the posted price. Each accepted trip earns a reward Iij(qij)I_{ij}(q_{ij})Iij​(qij​), and q↦q Iij(q)q\mapsto q\,I_{ij}(q)q↦qIij​(q) is concave. A customer who finds no vehicle at the origin is lost.

Problem (2) is the fluid relaxation, in which vehicles are always available:

max⁡q Rs(q)=∑(i,j)∈AΛijqijIij(qij)s.t.∑jΛijqij=∑jΛjiqji,∑(i,j)∈AΛijqijμij≤Δ,qij∈[0,1].\max_q\ R_s(q)=\sum_{(i,j)\in\mathcal A}\Lambda_{ij}q_{ij}I_{ij}(q_{ij}) \quad\text{s.t.}\quad \sum_j\Lambda_{ij}q_{ij}=\sum_j\Lambda_{ji}q_{ji},\quad \sum_{(i,j)\in\mathcal A}\frac{\Lambda_{ij}q_{ij}}{\mu_{ij}}\le\Delta,\quad q_{ij}\in[0,1].qmax​ Rs​(q)=(i,j)∈A∑​Λij​qij​Iij​(qij​)s.t.j∑​Λij​qij​=j∑​Λji​qji​,(i,j)∈A∑​μij​Λij​qij​​≤Δ,qij​∈[0,1].

The first constraint balances the flows, and the second caps the workload λ/μ=∑Λijqij/μij\lambda/\mu=\sum\Lambda_{ij}q_{ij}/\mu_{ij}λ/μ=∑Λij​qij​/μij​ (the mean number of vehicles in transit) by a budget Δ\DeltaΔ. Let qsq^sqs be an optimal solution that induces a strongly connected network.

Under a static policy the vehicles move in a closed queueing network. Each location has a single-server pick-up queue with service rate λi=∑jΛijqij\lambda_i=\sum_j\Lambda_{ij}q_{ij}λi​=∑j​Λij​qij​. Each pair has an infinite-server transit queue with mean service time 1/μij1/\mu_{ij}1/μij​. This network is of BCMP type, so its stationary law has product form. With rrr a positive solution of the traffic equations (9), a state with xix_ixi​ vehicles at location iii and xijx_{ij}xij​ in transit from iii to jjj has weight ∏i(ri/λi)xi∏(i,j)(riλij/(λiμij))xij/xij!\prod_i(r_i/\lambda_i)^{x_i}\prod_{(i,j)}(r_i\lambda_{ij}/(\lambda_i\mu_{ij}))^{x_{ij}}/x_{ij}!∏i​(ri​/λi​)xi​∏(i,j)​(ri​λij​/(λi​μij​))xij​/xij​!. The availability αi(K)\alpha_i(K)αi​(K) is the stationary probability that location iii holds at least one vehicle. The reward rate of the policy is Equation (3):

R(q)=∑(i,j)∈Aαi ΛijqijIij(qij).R(q)=\sum_{(i,j)\in\mathcal A}\alpha_i\,\Lambda_{ij}q_{ij}I_{ij}(q_{ij}).R(q)=(i,j)∈A∑​αi​Λij​qij​Iij​(qij​).

Formalization targets

Goal: Theorem 3, static half

For K≥1K\ge1K≥1, Δ=K\Delta=KΔ=K, qsq^sqs optimal for (2), inducing a strongly connected network, with Rs(qs)>0R_s(q^s)>0Rs​(qs)>0:

R(qs)Rs(qs) ≥ 1−((N−12K+12(N+K)+1)2−1−(N−12K+12(N+K))).\frac{R(q^s)}{R_s(q^s)}\ \ge\ 1-\left(\sqrt{\Bigl(\tfrac{N-1}{2K}+\tfrac{1}{2(N+K)}+1\Bigr)^2-1}-\Bigl(\tfrac{N-1}{2K}+\tfrac{1}{2(N+K)}\Bigr)\right).Rs​(qs)R(qs)​ ≥ 1−((2KN−1​+2(N+K)1​+1)2−1​−(2KN−1​+2(N+K)1​)).

The paper states the bound for R(qs)/R(q∗)R(q^s)/R(q^*)R(qs)/R(q∗), where q∗q^*q∗ is the optimal dynamic policy. It passes from one ratio to the other with Proposition 1, R(q∗)≤Rs(qs)R(q^*)\le R_s(q^s)R(q∗)≤Rs​(qs) (p. 6), whose proof needs the stationary analysis of arbitrary state-dependent policies. Proposition 1 is not part of this mission. The goal implies the paper's Theorem 3 once Proposition 1 is available.

Milestones

  1. Equal availability (pp. 7, 23): under balanced flows, αi(K)=αj(K)\alpha_i(K)=\alpha_j(K)αi​(K)=αj​(K) for all i,ji,ji,j.
  2. R(qs)/Rs(qs)=αR(q^s)/R_s(q^s)=\alphaR(qs)/Rs​(qs)=α (pp. 7–8).
  3. Equation (5) (p. 8): α(K)=K/(K+N−1+(λ/μ)(1−α(K−1)))\alpha(K)=K/\bigl(K+N-1+(\lambda/\mu)(1-\alpha(K-1))\bigr)α(K)=K/(K+N−1+(λ/μ)(1−α(K−1))).
  4. β(K)=K/(N+K−1+Δ(1−β(K−1)))\beta(K)=K/(N+K-1+\Delta(1-\beta(K-1)))β(K)=K/(N+K−1+Δ(1−β(K−1))), β(0)=0\beta(0)=0β(0)=0, is non-decreasing and concave (p. 10).
  5. α(K)≥β(K)\alpha(K)\ge\beta(K)α(K)≥β(K) for K≥1K\ge1K≥1 when λ/μ≤Δ\lambda/\mu\le\Deltaλ/μ≤Δ (p. 11).
  6. β(K)−β(K−1)≤β(1)=1/(N+Δ)\beta(K)-\beta(K-1)\le\beta(1)=1/(N+\Delta)β(K)−β(K−1)≤β(1)=1/(N+Δ) (p. 11).
  7. β(K)≥(bK−bK2−4KΔ)/(2Δ)\beta(K)\ge\bigl(b_K-\sqrt{b_K^2-4K\Delta}\bigr)/(2\Delta)β(K)≥(bK​−bK2​−4KΔ​)/(2Δ) with bK=N+K−1+Δ+Δ/(N+Δ)b_K=N+K-1+\Delta+\Delta/(N+\Delta)bK​=N+K−1+Δ+Δ/(N+Δ) (p. 11).

Significance

The bound tends to 111 at rate 1−O(1/K)1-O(1/\sqrt K)1−O(1/K​), uniformly in demand rates, travel times and the reward functions. It is the regime-free counterpart of the K/(N+K−1+Λ/μ)K/(N+K-1+\Lambda/\mu)K/(N+K−1+Λ/μ) bound: that bound is better for light demand, this one for heavy demand (Remark 7). Remark 6 reports that it is also numerically tighter than the guarantee of Banerjee et al., and unlike that guarantee it applies to every fleet size.

Formalizing it adds several things to the platform. The first is availability in closed networks of single-server and infinite-server stations, defined from the product form. Two classical facts about this model follow: availability is equal across locations under balanced flows, and it satisfies the mean-value recursion (5). Milestone 4 is a concavity statement about the throughput of a closed network in its population, and for N=1N=1N=1 it contains the concavity of the Erlang-B carried load in the number of servers. The paper does not prove it; it cites George and Xia (2011) and Shanthikumar and Yao (1988). None of these results is formalized anywhere that this mission is aware of, so the mission formalizes a proved result, not an open problem.

Difficulty

The algebra at the end (milestones 6–7 and the substitution Δ=K\Delta=KΔ=K) is elementary. Two steps are not.

Equation (5) is stated as a relation between availabilities, but its content is an identity between normalizing constants G(K−1)/G(K)G(K-1)/G(K)G(K−1)/G(K) of the product form. The paper derives it from the arrival theorem and Little's law, and neither is available. A direct proof has to compute G(K)G(K)G(K) under balanced flows, which takes a counting argument over the state space. Equal availability likewise needs the positive solution of (9) to be unique up to scale on a strongly connected network.

Concavity of β\betaβ is the hard milestone. A natural first attempt is induction on the recursion: if β(K)−β(K−1)\beta(K)-\beta(K-1)β(K)−β(K−1) is non-increasing up to KKK, show that the next increment is no larger. The map β(K−1)↦β(K)\beta(K-1)\mapsto\beta(K)β(K−1)↦β(K) is increasing and convex in its argument, and convexity points the wrong way, so increments do not propagate directly. The published proofs go through the closed-network interpretation, not through the recursion.

Formalization scope

The Lean development lives in VehicleSharePricing.DemandFree. Locations are a Fintype with Nonempty, and NNN is its cardinality. Λ, μ, q are real matrices on all pairs, and entries outside A\mathcal AA enter only multiplied by Λij=0\Lambda_{ij}=0Λij​=0. Strong connectivity is the transitive closure of the positive-flow relation (Relation.TransGen). This guarantees λi>0\lambda_i>0λi​>0 at every location, even for N=1N=1N=1. Availability is the product-form busy probability of the general definition ProductFormNetwork, applied to the induced network. That law is a definition that records the paper's appeal to BCMP (p. 6), not a theorem of this mission. Theorems quantify over every positive solution rrr of (9). R(q)R(q)R(q) is Equation (3) with per-location availabilities. The sequence β\betaβ is defined by its recursion, which is correct because it is a proof device, not the availability of qsq^sqs. All arithmetic is in R\mathbb RR, and K−1K-1K−1 appears only under K≥1K\ge1K≥1.

Two trivializations are ruled out. Defining α\alphaα by the recursion (5) would make milestones 1–3 empty, and defining R(q)R(q)R(q) as αRs(q)\alpha R_s(q)αRs​(q) would make milestone 1 empty. The hypothesis Rs(qs)>0R_s(q^s)>0Rs​(qs)>0 is added because the ratio is otherwise 0/00/00/0.

The proof of the goal uses only feasibility of qsq^sqs and the strong connectivity of the induced network; optimality is kept because it is the paper's hypothesis. Contributions are welcome on any milestone. A library for normalizing constants of closed product-form networks, and the concavity of throughput in the population, would be reusable well beyond this paper.

Selected references

  • S. Benjaafar, X. Shen, Pricing in On-Demand (and One-Way) Vehicle Sharing Networks, SSRN abstract 3998297, version of 2023-01-10; Technical Note, Operations Research, 2023. https://ssrn.com/abstract=3998297, https://doi.org/10.1287/opre.2023.2446
  • S. Banerjee, D. Freund, T. Lykouris, Pricing and Optimization in Shared Vehicle Systems: An Approximation Framework, Operations Research, 2022 (cited by the paper as forthcoming); arXiv:1611.07624. https://arxiv.org/abs/1611.07624
  • F. Baskett, K. M. Chandy, R. R. Muntz, F. G. Palacios, Open, Closed, and Mixed Networks of Queues with Different Classes of Customers, Journal of the ACM 22(2), 1975. https://doi.org/10.1145/321879.321887
  • D. K. George, C. H. Xia, Fleet-Sizing and Service Availability for a Vehicle Rental System via Closed Queueing Networks, European Journal of Operational Research 211(1), 2011. https://doi.org/10.1016/j.ejor.2010.12.015
  • J. G. Shanthikumar, D. D. Yao, Second-Order Properties of the Throughput of a Closed Queueing Network, Mathematics of Operations Research 13(3), 1988. https://doi.org/10.1287/moor.13.3.524
11 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Pricing in On-Demand and One-Way Vehicle-Sharing Networks 3: The K/(N+K−1+Λ/μ) Guarantee Holds When Static Prices Split the Network into ComponentsResearch Paper

Motivation

One-way vehicle-sharing systems (car sharing, bike sharing, on-demand fleets) move a fixed fleet of KKK vehicles among NNN locations. Customers take a vehicle at one location and leave it at another, so prices shape both revenue and where the fleet ends up. The optimal dynamic pricing policy, which reacts to the current position of every vehicle, solves a dynamic program whose state space grows combinatorially in NNN and KKK. Static policies, with one fixed price per origin–destination pair, are simple to compute and to operate, and the question is how much they lose.

Benjaafar and Shen (SSRN 3998297; Operations Research, 2023, doi:10.1287/opre.2023.2446) take the static policy qsq^sqs that solves a fluid relaxation, Problem (2), and bound its performance ratio. When qsq^sqs induces a strongly connected network, Theorem 1 gives the ratio K/(N+K−1+Λ/μ)K/(N+K-1+\Lambda/\mu)K/(N+K−1+Λ/μ). Waserhole and Jost (2016) observed that the best static policy may deliberately disconnect the network: prices that make some trips unattractive can leave two or more separate networks. The fleet then has to be split among the pieces, and Theorem 1 no longer applies. This mission formalizes Theorem 4 of the paper (§6, p. 18), which shows that the same guarantee holds in that case, provided the vehicles are allocated optimally among the networks.

Setting

There are NNN locations and KKK vehicles. Trip requests from location iii to jjj arrive at rate Λij≥0\Lambda_{ij}\ge0Λij​≥0, and A={(i,j):Λij>0}\mathcal A=\{(i,j):\Lambda_{ij}>0\}A={(i,j):Λij​>0} is strongly connected. A trip on (i,j)(i,j)(i,j) lasts on average 1/μij1/\mu_{ij}1/μij​. A static policy is a vector of quantiles qij∈[0,1]q_{ij}\in[0,1]qij​∈[0,1] (the fraction of customers who accept the price), and earns Iij(qij)I_{ij}(q_{ij})Iij​(qij​) per trip, with q↦qIij(q)q\mapsto qI_{ij}(q)q↦qIij​(q) concave.

Problem (2) maximises the fluid reward Rs(q)=∑AΛijqijIij(qij)R_s(q)=\sum_{\mathcal A}\Lambda_{ij}q_{ij}I_{ij}(q_{ij})Rs​(q)=∑A​Λij​qij​Iij​(qij​) over balanced flows (∑jΛijqij=∑jΛjiqji\sum_j\Lambda_{ij}q_{ij}=\sum_j\Lambda_{ji}q_{ji}∑j​Λij​qij​=∑j​Λji​qji​ at every location) with workload ∑AΛijqij/μij≤Δ\sum_{\mathcal A}\Lambda_{ij}q_{ij}/\mu_{ij}\le\Delta∑A​Λij​qij​/μij​≤Δ, where Δ≥K\Delta\ge KΔ≥K. Let qsq^sqs be an optimal solution.

The policy qsq^sqs splits the locations into networks ccc with location sets Nc\mathcal N_cNc​ (Nc=∣Nc∣N_c=|\mathcal N_c|Nc​=∣Nc​∣) and pair sets Ac\mathcal A_cAc​: accepted demand Λijqijs>0\Lambda_{ij}q^s_{ij}>0Λij​qijs​>0 only joins locations of the same network, and within each network it is strongly connected. With KcK_cKc​ vehicles, network ccc is a closed queueing network: a single-server pick-up queue at each location (rate λi=∑jΛijqijs\lambda_i=\sum_j\Lambda_{ij}q^s_{ij}λi​=∑j​Λij​qijs​) and an infinite-server transit queue on each pair. Its stationary law is the BCMP product form, with loads computed from a positive solution rrr of the traffic equations (9). The availability α(qs,Kc,Nc)\alpha(q^s,K_c,N_c)α(qs,Kc​,Nc​) is the stationary probability that a location of network ccc has a vehicle.

An allocation K=(Kc)\mathbf K=(K_c)K=(Kc​) with ∑cKc=K\sum_cK_c=K∑c​Kc​=K earns R(qs,K)=∑AαiΛijqijsIij(qijs)R(q^s,\mathbf K)=\sum_{\mathcal A}\alpha_i\Lambda_{ij}q^s_{ij}I_{ij}(q^s_{ij})R(qs,K)=∑A​αi​Λij​qijs​Iij​(qijs​) (Equation (3)), and Problem (8) chooses K∗\mathbf K^*K∗ to maximise it. Write Mc=∑AcΛijqijs/μijM_c=\sum_{\mathcal A_c}\Lambda_{ij}q^s_{ij}/\mu_{ij}Mc​=∑Ac​​Λij​qijs​/μij​, pcp_cpc​ for network ccc's share of Rs(qs)R_s(q^s)Rs​(qs), Λ=∑AΛij\Lambda=\sum_{\mathcal A}\Lambda_{ij}Λ=∑A​Λij​ and 1/μ=∑AΛij/(Λμij)1/\mu=\sum_{\mathcal A}\Lambda_{ij}/(\Lambda\mu_{ij})1/μ=∑A​Λij​/(Λμij​).

Formalization targets

Goal: Theorem 4, static half (p. 18)

R(qs,K∗)Rs(qs) ≥ KN+K−1+Λ/μ.\frac{R(q^s,\mathbf K^*)}{R_s(q^s)}\ \ge\ \frac{K}{N+K-1+\Lambda/\mu}.Rs​(qs)R(qs,K∗)​ ≥ N+K−1+Λ/μK​.

The paper's Theorem 4 opens with R(qs,K∗)/R(q∗)≥R(qs,K∗)/Rs(qs)R(q^s,\mathbf K^*)/R(q^*)\ge R(q^s,\mathbf K^*)/R_s(q^s)R(qs,K∗)/R(q∗)≥R(qs,K∗)/Rs​(qs), where R(q∗)R(q^*)R(q∗) is the reward of the optimal dynamic policy. That inequality is Proposition 1 (R(q∗)≤Rs(qs)R(q^*)\le R_s(q^s)R(q∗)≤Rs​(qs), p. 6). It needs the stationary distribution of the network under an arbitrary state-dependent policy, a controlled-Markov-chain development that is not part of this mission. The goal is the rest of the chain, and it implies the paper's theorem once Proposition 1 is available.

Milestones (p. 18–19)

  1. The recursion (5) on each network: α(qs,Kc,Nc)=Kc/(Nc+Kc−1+(1−α(qs,Kc−1,Nc))Mc)\alpha(q^s,K_c,N_c)=K_c/(N_c+K_c-1+(1-\alpha(q^s,K_c-1,N_c))M_c)α(qs,Kc​,Nc​)=Kc​/(Nc​+Kc​−1+(1−α(qs,Kc​−1,Nc​))Mc​).
  2. The mixture identity R(qs,K)/Rs(qs)=∑cα(qs,Kc,Nc)pcR(q^s,\mathbf K)/R_s(q^s)=\sum_c\alpha(q^s,K_c,N_c)p_cR(qs,K)/Rs​(qs)=∑c​α(qs,Kc​,Nc​)pc​, with ∑cpc=1\sum_cp_c=1∑c​pc​=1.
  3. The per-network bound pcKc/(Nc+Kc−1+Mc(1−α(qs,Kc−1,Nc)))≥pcKc/(Nc+Kc−1+Mc)p_cK_c/(N_c+K_c-1+M_c(1-\alpha(q^s,K_c-1,N_c)))\ge p_cK_c/(N_c+K_c-1+M_c)pc​Kc​/(Nc​+Kc​−1+Mc​(1−α(qs,Kc​−1,Nc​)))≥pc​Kc​/(Nc​+Kc​−1+Mc​).
  4. The reduction R(qs,K∗)/Rs(qs)≥max⁡∑Kc=K∑cpcKc/(Nc+Kc−1+Mc)R(q^s,\mathbf K^*)/R_s(q^s)\ge\max_{\sum K_c=K}\sum_cp_cK_c/(N_c+K_c-1+M_c)R(qs,K∗)/Rs​(qs)≥max∑Kc​=K​∑c​pc​Kc​/(Nc​+Kc​−1+Mc​).
  5. The Chu–Vandermonde identity ∑K1=0K(K+T−K1−T1−1K−K1)(T1+K1−1K1)=(K+T−1K)\sum_{K_1=0}^K\binom{K+T-K_1-T_1-1}{K-K_1}\binom{T_1+K_1-1}{K_1}=\binom{K+T-1}{K}∑K1​=0K​(K−K1​K+T−K1​−T1​−1​)(K1​T1​+K1​−1​)=(KK+T−1​) for real T1,T2>0T_1,T_2>0T1​,T2​>0.
  6. The reduced inequality for C=2C=2C=2: max⁡K1+K2=K∑i=12piKi/(Ni+Ki−1+Mi)≥K/(N+K−1+M)\max_{K_1+K_2=K}\sum_{i=1}^2p_iK_i/(N_i+K_i-1+M_i)\ge K/(N+K-1+M)maxK1​+K2​=K​∑i=12​pi​Ki​/(Ni​+Ki​−1+Mi​)≥K/(N+K−1+M).
  7. The same for any number of networks, the case C>2C>2C>2.

Significance

The result. Theorem 4 removes the connectivity assumption from Theorem 1. A static policy chosen by the fluid relaxation may disconnect the network, and it then still earns at least K/(N+K−1+Λ/μ)K/(N+K-1+\Lambda/\mu)K/(N+K−1+Λ/μ) of the fluid optimum, uniformly in the demand and reward data. The bound tends to 111 as K→∞K\to\inftyK→∞ for fixed NNN and Λ/μ\Lambda/\muΛ/μ. Milestones 6–7 hold for arbitrary weights, location counts and workloads, so they apply to any separable allocation problem whose pieces satisfy recursion (5).

Formalizing it. The result is proved in the paper; nothing here is open. No part of it is machine-checked so far. The mission adds closed-network availability on a disconnected network, the mixture decomposition of the performance ratio, a real-argument Vandermonde identity in the paper's own notation, and a discrete allocation inequality proved by an averaging argument. The companion missions of this series formalize Theorems 1–3 of the same paper.

Difficulty

The obvious argument applies Theorem 1 to each network: α(qs,Kc,Nc)≥Kc/(Nc+Kc−1+Mc)\alpha(q^s,K_c,N_c)\ge K_c/(N_c+K_c-1+M_c)α(qs,Kc​,Nc​)≥Kc​/(Nc​+Kc​−1+Mc​). This leaves a maximisation over allocations, and no single allocation obviously beats K/(N+K−1+M)K/(N+K-1+M)K/(N+K−1+M). Proportional splitting fails because Nc+Kc−1N_c+K_c-1Nc​+Kc​−1 does not scale with KcK_cKc​, and the best allocation depends on all of pcp_cpc​, NcN_cNc​ and McM_cMc​. The paper does not exhibit a good allocation. It averages the objective against probability weights from the Chu–Vandermonde identity, which needs binomial coefficients with real upper arguments. It then passes from two networks to many by an induction that merges networks. The recursion (5) itself rests on a computation with the normalising constants of a product form that has both single-server and infinite-server stations.

Formalization scope

Locations form a finite type. A\mathcal AA is the set of pairs with Λij>0\Lambda_{ij}>0Λij​>0, and its strong connectivity is a transitive closure. The split is a surjective map from locations onto a finite index type of networks. Every pair with positive accepted demand stays inside one class, and each class is strongly connected under accepted demand, again as a transitive closure. So every location has positive accepted demand. The paper's C>1C>1C>1 is relaxed to C≥1C\ge1C≥1.

Availability is the BCMP product form of each network on its own, with loads ri/λir_i/\lambda_iri​/λi​ (pick-up) and riΛijqij/(λiμij)r_i\Lambda_{ij}q_{ij}/(\lambda_i\mu_{ij})ri​Λij​qij​/(λi​μij​) (transit), and rrr a positive solution of (9). This is a disclosed definition, since the paper invokes the BCMP class without writing it. Availability is defined per location; its equality across a network follows from milestone 1. R(qs,K)R(q^s,\mathbf K)R(qs,K) is Equation (3) with per-location availabilities. Problem (8) is an explicit maximisation over the finite set of allocations. All ratios are real numbers, Rs(qs)>0R_s(q^s)>0Rs​(qs)>0 is assumed so that the ratio is defined, and N+K−1N+K-1N+K−1 is computed in R\mathbb RR.

Defining availability by the recursion (5), or RRR as α⋅Rs\alpha\cdot R_sα⋅Rs​, would make milestones 1–2 trivial and is ruled out.

A complete development needs:

  • the product-form computation behind (5);
  • equal availability within a network;
  • the Vandermonde identity for generalized binomials (Mathlib's Ring.add_choose_eq);
  • the averaging argument and the induction.

The closed-network definitions and milestones 5–7 are reusable beyond this mission. Proofs of any milestone are welcome, and so is a proof of Proposition 1.

Selected references

  • S. Benjaafar, X. Shen, Pricing in On-Demand (and One-Way) Vehicle Sharing Networks, SSRN abstract 3998297, version of 2023-01-10. https://ssrn.com/abstract=3998297 ; published as a Technical Note in Operations Research, 2023. https://doi.org/10.1287/opre.2023.2446
  • F. Baskett, K. M. Chandy, R. R. Muntz, F. G. Palacios, Open, Closed, and Mixed Networks of Queues with Different Classes of Customers, J. ACM 22(2), 1975, 248–260. https://doi.org/10.1145/321879.321887
  • A. Waserhole, V. Jost, Pricing in Vehicle Sharing Systems: Optimization in Queuing Networks with Product Forms, EURO J. Transportation and Logistics 5(3), 2016, 293–320. https://doi.org/10.1007/s13676-014-0054-4
  • D. K. George, C. H. Xia, Fleet-Sizing and Service Availability for a Vehicle Rental System via Closed Queueing Networks, European J. Operational Research 211(1), 2011, 198–207. https://doi.org/10.1016/j.ejor.2010.12.015
11 thms1 active userReviewed
Linear OptimizationMarkov ChainOperations Research+1·Captain: mikedeng1

Dynamic Matching: Characterizing and Achieving Constant Regret I: Under General Position the Exhaustive Resolving Policy Has Regret at Most Γ/ϵ at All TimesResearch Paper

Motivation

Centralized matching markets (kidney exchange, ride hailing, freight and labor platforms) repeatedly decide which waiting participants to match now and which to hold for a better opportunity later. Matching early collects value sooner; waiting lets the platform see more arrivals and avoid matches that later turn out to be wasteful. A natural yardstick is the best set of matches that could have been made with hindsight from all arrivals up to a given time, and the question is how far an online policy, which cannot see the future, must fall behind that yardstick.

Kerimov, Ashlagi and Gurvich (SSRN 3824407, September 2022; Management Science 2023, doi:10.1287/mnsc.2021.01215) answer this for multi-way matching networks with patient agents. They identify a single parameter of the fluid relaxation, the general position gap ϵ\epsilonϵ, and show that the regret against the hindsight benchmark can be kept at order ϵ−1\epsilon^{-1}ϵ−1 at all times, and that no policy does better in order on non-trivial networks. This mission formalizes the upper bound. The paper places itself next to constant-regret results for online packing (Bumpensanti and Wang 2020; Vera and Banerjee 2021), where resolving a linear program at each arrival achieves bounded regret.

Setting

There are nnn agent types and ddd matches. Match mmm is a set A(m)\mathcal A(m)A(m) of at least two types, every type belongs to some match, and the matching matrix M∈{0,1}n×dM\in\{0,1\}^{n\times d}M∈{0,1}n×d has Mim=1M_{im}=1Mim​=1 iff i∈A(m)i\in\mathcal A(m)i∈A(m). Performing match mmm uses one agent of each type in A(m)\mathcal A(m)A(m) and earns rm>0r_m>0rm​>0. Time is discrete; at each time t=1,2,…t=1,2,\dotst=1,2,… one agent arrives, of type iii with probability λi>0\lambda_i>0λi​>0, ∑iλi=1\sum_i\lambda_i=1∑i​λi​=1, independently over time. AitA^t_iAit​ counts the type-iii arrivals by time ttt.

A matching policy records DmtD^t_mDmt​, the number of times match mmm has been performed by time ttt. It is admissible when it is non-anticipative and only matches agents present: MDt≤AtMD^t\le A^tMDt≤At. The pre-match queue is Qt=At−MDt−1Q^t=A^t-MD^{t-1}Qt=At−MDt−1, the value collected is RD,t=E[r⋅Dt]\mathcal R^{D,t}=\mathbb E[r\cdot D^t]RD,t=E[r⋅Dt], and the hindsight benchmark is

R∗,t=E[max⁡{r⋅y:My≤At, y∈Z≥0d}].\mathcal R^{*,t}=\mathbb E\big[\max\{r\cdot y: My\le A^t,\ y\in\mathbb Z^d_{\ge0}\}\big].R∗,t=E[max{r⋅y:My≤At, y∈Z≥0d​}].

The static-planning problem is the linear program

(SPP)max⁡ r⋅zs.t.Mz+s=λ, z≥0, s≥0.\text{(SPP)}\qquad \max\ r\cdot z\quad\text{s.t.}\quad Mz+s=\lambda,\ z\ge0,\ s\ge0.(SPP)max r⋅zs.t.Mz+s=λ, z≥0, s≥0.

For an optimal (z∗,s∗)(z^*,s^*)(z∗,s∗) let M+={m:zm∗>0}\mathcal M_+=\{m:z^*_m>0\}M+​={m:zm∗​>0} (active matches), M0\mathcal M_0M0​ the rest (redundant matches), Q+={j:sj∗>0}\mathcal Q_+=\{j:s^*_j>0\}Q+​={j:sj∗​>0} (under-demanded types) and Q0\mathcal Q_0Q0​ the rest (over-demanded types). The network satisfies general position (GP) if (SPP) has a unique optimal solution and it is non-degenerate, ∣M+∣+∣Q+∣=n|\mathcal M_+|+|\mathcal Q_+|=n∣M+​∣+∣Q+​∣=n. The general position gap is the smallest positive basic value,

ϵ=min⁡m∈M+zm∗ ∧ min⁡j∈Q+sj∗.\epsilon=\min_{m\in\mathcal M_+}z^*_m\ \wedge\ \min_{j\in\mathcal Q_+}s^*_j .ϵ=m∈M+​min​zm∗​ ∧ j∈Q+​min​sj∗​.

The exhaustive resolving policy with inter-action delay τ\tauτ acts only at the epochs tk=kτt_k=k\tautk​=kτ. There it performs an optimal solution of the integer program max⁡{r⋅z:Mz≤Qtk, z∈Z≥0d}\max\{r\cdot z: Mz\le Q^{t_k},\ z\in\mathbb Z^d_{\ge0}\}max{r⋅z:Mz≤Qtk​, z∈Z≥0d​} with the redundant matches removed, and then discards the leftover agents of the under-demanded types.

Formalization targets

Goal: Theorem 3.1 (Upper bound), p. 14

There are constants κ,Γ>0\kappa,\Gamma>0κ,Γ>0 depending only on n,d,M,rn,d,M,rn,d,M,r such that, under GP, the exhaustive resolving policy with τ=⌈κϵ−1⌉\tau=\lceil\kappa\epsilon^{-1}\rceilτ=⌈κϵ−1⌉ (any tie-breaking) is admissible and

R∗,t−RD,t≤Γ ϵ−1for all t≥1.\mathcal R^{*,t}-\mathcal R^{D,t}\le\Gamma\,\epsilon^{-1}\qquad\text{for all }t\ge1 .R∗,t−RD,t≤Γϵ−1for all t≥1.

The constants are not fixed, so the goal survives any improvement of them.

Milestones

  1. §2, p. 8: R∗,t=max⁡DRD,t\mathcal R^{*,t}=\max_{D}\mathcal R^{D,t}R∗,t=maxD​RD,t, attained by the ultimate batching policy.
  2. §4.2, (4), p. 20: under GP the optimal basis B\mathcal BB is invertible, (zM+∗,sQ+∗)=B−1λ(z^*_{\mathcal M_+},s^*_{\mathcal Q_+})=\mathcal B^{-1}\lambda(zM+​∗​,sQ+​∗​)=B−1λ, and the entries of B−1\mathcal B^{-1}B−1 are bounded by a constant of the topology.
  3. §4.2, p. 20: θ=∑m∈M+rmym\theta=\sum_{m\in\mathcal M_+}r_my^mθ=∑m∈M+​​rm​ym is the optimal dual of (SPP), θ≥0\theta\ge0θ≥0, and θi>0\theta_i>0θi​>0 on Q0\mathcal Q_0Q0​.
  4. Lemma 4.1, p. 19 (optimality test): a policy without redundant matches whose over-demanded queues have mean O(ϵ−1)O(\epsilon^{-1})O(ϵ−1) has regret O(ϵ−1)O(\epsilon^{-1})O(ϵ−1).
  5. Lemma 4.2, p. 21: a Foster–Lyapunov drift condition bounds stationary means (Glynn and Zeevi 2008).
  6. (11), p. 23: Eπ[h∗(Q0)]=O(ϵ−1)\mathbb E_\pi[h^*(Q^0)]=O(\epsilon^{-1})Eπ​[h∗(Q0)]=O(ϵ−1) for the stationary law of the epoch chain.
  7. App. D, p. 49: E0[h∗(Qtk)]=O(ϵ−1)\mathbb E_{\mathbf 0}[h^*(Q^{t_k})]=O(\epsilon^{-1})E0​[h∗(Qtk​)]=O(ϵ−1) for all k≥1k\ge1k≥1.

Here h∗(u)h^*(u)h∗(u) is the θ\thetaθ-weighted leftover in Q0\mathcal Q_0Q0​ after an optimal integer matching of uuu (display (7)).

Significance

The upper bound says that, under GP, hindsight-optimal performance up to an additive constant is achievable at every time simultaneously, not just at a known horizon. Long-run average optimality and near-optimality under discounting follow (Remark 2.1). The bound also quantifies the cost of acting often: the delay τ\tauτ and the regret both scale with ϵ−1\epsilon^{-1}ϵ−1, so networks close to degeneracy force batching. Combined with the paper's lower bound, ϵ−1\epsilon^{-1}ϵ−1 is the right order on non-trivial networks.

The result has a printed proof (§4, Appendices B and D) but no machine-checked one. Several intermediate statements of the printed proof do not hold as stated and are not posed here. The goal and the stated displays (11) and App. D are posed as the paper states them, so a formal proof requires a correct argument for the uniform-in-λ\lambdaλ bound on the over-demanded queues. Lemma 4.1, the basis and duality facts and Lemma 4.2 are self-contained and checkable on their own.

Difficulty

The obvious approach compares the policy's realized matches with the fluid optimum t z∗t\,z^*tz∗ and controls the deviation with concentration bounds. That gives errors of order t\sqrt tt​, not a constant. The constant comes from showing that the over-demanded queues stay of order ϵ−1\epsilon^{-1}ϵ−1 uniformly in time and in λ\lambdaλ. Between epochs these queues behave like a multidimensional reflected random walk whose drift toward zero is only of order ϵτ\epsilon\tauϵτ, while its fluctuations over an epoch are of order τ\sqrt\tauτ​. The delay τ≍ϵ−1\tau\asymp\epsilon^{-1}τ≍ϵ−1 balances the two, but the queue state enters through the integer program (3), whose solution changes discontinuously with the queues, and the quantities that measure the drift are signed combinations of arrival counts, to which the usual one-sided concentration bounds for nonnegative sums do not apply. On top of this every constant must be independent of λ\lambdaλ.

Formalization scope

  • Types are Fin n and matches Fin d (0-based); the topology with its two standing assumptions (∣A(m)∣≥2|\mathcal A(m)|\ge2∣A(m)∣≥2, every type in a match) is a structure, and λ>0\lambda>0λ>0 with ∑λi=1\sum\lambda_i=1∑λi​=1 and r>0r>0r>0 are hypotheses.
  • Time is N\mathbb NN; "for all t>0t>0t>0" is t≥1t\ge1t≥1. The arrival at time s+1s+1s+1 is the sss-th entry of a path ω:N→\omega:\mathbb N\toω:N→ Fin n. Expectations at horizon ttt are finite sums over the first ttt arrivals weighted by ∏λωs\prod\lambda_{\omega_s}∏λωs​​, so no expectation is a default value.
  • Admissible policies are non-anticipative cumulative counts with MDt≤AtMD^t\le A^tMDt≤At and no rejections. The resolving policy's removal of under-demanded leftovers acts on its own virtual queue, which agrees with the actual queue on Q0\mathcal Q_0Q0​; its matches are feasible without removals, so it is admissible.
  • (3) is solved with the redundant matches set to zero, and statements quantify over every tie-breaking selection. A selection exists (a sanity file exhibits one), so these statements are not vacuous.
  • GP is a hypothesis on an explicit pair (z∗,s∗)(z^*,s^*)(z∗,s∗); ϵ\epsilonϵ is the minimum of the positive basic values. The basis inverse is never a matrix-inverse function: statements assert the existence of a two-sided inverse.
  • h∗h^*h∗ is defined in the form min⁡{∑Q0θisi:Mz+s=u, zM0=0}\min\{\sum_{\mathcal Q_0}\theta_is_i: Mz+s=u,\ z_{\mathcal M_0}=0\}min{∑Q0​​θi​si​:Mz+s=u, zM0​​=0}, equivalent to (7) under the paper's reduction M0=∅\mathcal M_0=\emptysetM0​=∅; θ\thetaθ is any solution of the complementary-slackness system, which is unique under GP.
  • Every O(⋅)O(\cdot)O(⋅) is an explicit constant, quantified after the topology and rrr and before λ\lambdaλ. Placing it after λ\lambdaλ would turn the theorem into a per-instance boundedness statement and is ruled out.
  • A trivializing formalization (some unspecified policy, a τ\tauτ independent of ϵ\epsilonϵ, or GP replaced by an unsatisfiable condition) is ruled out: the policy is constructed, τ=⌈κ/ϵ⌉\tau=\lceil\kappa/\epsilon\rceilτ=⌈κ/ϵ⌉, and a sanity file proves GP for the Figure 1 network with ϵ=1/5\epsilon=1/5ϵ=1/5.
  • Not posed: the lower bound of Theorem 3.1, Proposition 4.1 (8)–(9), Lemmas B.1–B.2, Proposition B.1 and displays (21)–(22), which do not hold as printed; Theorem 5.2 and §6.

Contributions welcome: proofs of the LP facts (milestones 2–3) and Lemma 4.1, a Mathlib-ready proof of Lemma 4.2, and any correct argument for the epoch bounds.

Selected references

  • S. Kerimov, I. Ashlagi, I. Gurvich, Dynamic Matching: Characterizing and Achieving Constant Regret, SSRN 3824407 (version of Sep 14, 2022); Management Science, 2023. https://ssrn.com/abstract=3824407, https://doi.org/10.1287/mnsc.2021.01215
  • P. W. Glynn, A. Zeevi, Bounding stationary expectations of Markov processes, in Markov Processes and Related Topics, IMS Collections 4, 2008. https://doi.org/10.1214/074921708000000381
  • P. Bumpensanti, H. Wang, A re-solving heuristic with uniformly bounded loss for network revenue management, Management Science 66, 2020. https://doi.org/10.1287/mnsc.2019.3365
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997.
14 thms1 active userReviewed
Machine LearningOperations ResearchStatistics·Captain: mikedeng1

Offline Multi-Action Policy Learning: Generalization and Optimization 1: Cross-Fitted AIPW Policy Learning Has Regret O_p(κ(Π)√(V*/n)) Even with Slowly Converging Nuisance EstimatesResearch Paper

Learning treatment policies from logged data

Many decisions are made by assigning one of several actions to an individual on the basis of observed features: which of ddd drugs to prescribe, which of several promotions to show, which job-training programme to offer. Experimentation is often costly or unethical, while historical records of past assignments and their outcomes are plentiful. Offline policy learning asks for a rule that maps features to actions, chosen from such observational records, whose expected outcome is close to that of the best rule in a prescribed class. The binary-action case was settled by Kitagawa and Tetenov (2018) with known propensities and by Athey and Wager (2021) with estimated ones; Zhou, Athey and Wager extend the doubly robust approach to d≥2d \ge 2d≥2 actions. This mission formalizes the statistical half of that paper: the regret guarantee of its cross-fitted learner.

Timeline. Robins, Rotnitzky and Zhao (1994) introduced augmented inverse-propensity weighting (AIPW). Dudík, Langford and Li (2011) used doubly robust scores for multi-action policy evaluation and optimization. Chernozhukov et al. (2018) showed that cross-fitting removes the bias of flexible nuisance estimates in semiparametric estimation. Athey and Wager proved n\sqrt nn​-rate regret for binary actions with VC classes. Zhou, Athey and Wager (arXiv 2018; Operations Research, 2023) treat ddd actions with a Hamming entropy integral as the complexity measure.

Setting

There are ddd actions, written 1,…,d1,\dots,d1,…,d and identified with the standard basis vectors of Rd\mathbb R^dRd, so that for γ∈Rd\gamma\in\mathbb R^dγ∈Rd the inner product ⟨π(x),γ⟩\langle\pi(x),\gamma\rangle⟨π(x),γ⟩ is the coordinate γπ(x)\gamma_{\pi(x)}γπ(x)​. A draw consists of features X∈XX\in\mathcal XX∈X, potential outcomes (Y(1),…,Y(d))(Y(1),\dots,Y(d))(Y(1),…,Y(d)) and a logged action AAA; only the triple (X,A,Y)(X,A,Y)(X,A,Y) with Y=Y(A)Y=Y(A)Y=Y(A) is observed. The data are nnn iid draws.

The model consists of a law PXP_XPX​ of the features and two conditional laws given X=xX=xX=x: one for the outcome vector, one for the action. Given XXX the two are independent (unconfoundedness). The propensity is ea(x)=P(A=a∣X=x)e_a(x)=P(A=a\mid X=x)ea​(x)=P(A=a∣X=x) and the mean reward is μa(x)=E[Y(a)∣X=x]\mu_a(x)=\mathbb E[Y(a)\mid X=x]μa​(x)=E[Y(a)∣X=x]. A policy is a map π:X→{1,…,d}\pi:\mathcal X\to\{1,\dots,d\}π:X→{1,…,d} from a class Π\PiΠ. Its value is Q(π)=E[Y(π(X))]Q(\pi)=\mathbb E[Y(\pi(X))]Q(π)=E[Y(π(X))] and its regret is R(π)=sup⁡π′∈ΠQ(π′)−Q(π)R(\pi)=\sup_{\pi'\in\Pi}Q(\pi')-Q(\pi)R(π)=supπ′∈Π​Q(π′)−Q(π).

The learner, CAIPWL (Algorithm 1), divides the sample into K≥2K\ge2K≥2 evenly sized folds. For each fold kkk it fits estimators μ^a−k\hat\mu^{-k}_aμ^​a−k​, e^a−k\hat e^{-k}_ae^a−k​ on the observed data outside fold kkk, forms the cross-fitted AIPW score

Γ^i,j=μ^j−k(i)(Xi)+1{Ai=j}Yi−μ^Ai−k(i)(Xi)e^Ai−k(i)(Xi),\hat\Gamma_{i,j}=\hat\mu^{-k(i)}_j(X_i)+\mathbf 1\{A_i=j\}\frac{Y_i-\hat\mu^{-k(i)}_{A_i}(X_i)}{\hat e^{-k(i)}_{A_i}(X_i)},Γ^i,j​=μ^​j−k(i)​(Xi​)+1{Ai​=j}e^Ai​−k(i)​(Xi​)Yi​−μ^​Ai​−k(i)​(Xi​)​,

and returns a maximizer π^CAIPWL\hat\pi_{CAIPWL}π^CAIPWL​ over Π\PiΠ of Q^CAIPWL(π)=1n∑iΓ^i,π(Xi)\hat Q_{CAIPWL}(\pi)=\frac1n\sum_i\hat\Gamma_{i,\pi(X_i)}Q^​CAIPWL​(π)=n1​∑i​Γ^i,π(Xi​)​. The oracle score Γi\Gamma_iΓi​ is the same expression with the true μ\muμ and eee; it gives Q~(π)=1n∑iΓi,π(Xi)\tilde Q(\pi)=\frac1n\sum_i\Gamma_{i,\pi(X_i)}Q~​(π)=n1​∑i​Γi,π(Xi​)​. Write Δ\DeltaΔ, Δ~\tilde\DeltaΔ~, Δ^\hat\DeltaΔ^ for the differences Q(π1)−Q(π2)Q(\pi_1)-Q(\pi_2)Q(π1​)−Q(π2​), Q~(π1)−Q~(π2)\tilde Q(\pi_1)-\tilde Q(\pi_2)Q~​(π1​)−Q~​(π2​), Q^(π1)−Q^(π2)\hat Q(\pi_1)-\hat Q(\pi_2)Q^​(π1​)−Q^​(π2​), and

V∗=sup⁡πa,πb∈ΠE[(Γπa(X)−Γπb(X))2].V_*=\sup_{\pi_a,\pi_b\in\Pi}\mathbb E\big[(\Gamma_{\pi_a(X)}-\Gamma_{\pi_b(X)})^2\big].V∗​=πa​,πb​∈Πsup​E[(Γπa​(X)​−Γπb​(X)​)2].

The complexity of Π\PiΠ is measured through the Hamming distance H(π1,π2)=1m#{j:π1(xj)≠π2(xj)}H(\pi_1,\pi_2)=\frac1m\#\{j:\pi_1(x_j)\ne\pi_2(x_j)\}H(π1​,π2​)=m1​#{j:π1​(xj​)=π2​(xj​)} on points x1,…,xmx_1,\dots,x_mx1​,…,xm​. The covering number NH(ε,Π)N_H(\varepsilon,\Pi)NH​(ε,Π) is the supremum over all finite point sequences of the least number of policies of Π\PiΠ that ε\varepsilonε-cover Π\PiΠ in HHH. The entropy integral is κ(Π)=∫01log⁡NH(ε2,Π) dε\kappa(\Pi)=\int_0^1\sqrt{\log N_H(\varepsilon^2,\Pi)}\,d\varepsilonκ(Π)=∫01​logNH​(ε2,Π)​dε.

The assumptions are: overlap, ea(x)≥η>0e_a(x)\ge\eta>0ea​(x)≥η>0; bounded rewards, ∣Y(a)∣≤B|Y(a)|\le B∣Y(a)∣≤B; Assumption 2, E[(μ^a−k−μa)2]⋅E[(e^a−k−ea)2]=o(1)/n\mathbb E[(\hat\mu^{-k}_a-\mu_a)^2]\cdot\mathbb E[(\hat e^{-k}_a-e_a)^2]=o(1)/nE[(μ^​a−k​−μa​)2]⋅E[(e^a−k​−ea​)2]=o(1)/n; and Assumption 3, NH(ε,Π)≤Cexp⁡(Dε−ω)N_H(\varepsilon,\Pi)\le C\exp(D\varepsilon^{-\omega})NH​(ε,Π)≤Cexp(Dε−ω) with 0<ω<1/20<\omega<1/20<ω<1/2.

Formalization targets

Goal: Theorem 3 in the form of Remark 8, (18), p. 22

R(π^CAIPWL)=Op(κ(Π)V∗n),R(\hat\pi_{CAIPWL})=O_p\Big(\kappa(\Pi)\sqrt{\tfrac{V_*}{n}}\Big),R(π^CAIPWL​)=Op​(κ(Π)nV∗​​​),

read per nnn: for every ε>0\varepsilon>0ε>0 there are M>0M>0M>0 and NNN with P(R(π^CAIPWL)>Mκ(Π)V∗/n)≤ε\mathbb P\big(R(\hat\pi_{CAIPWL})>M\kappa(\Pi)\sqrt{V_*/n}\big)\le\varepsilonP(R(π^CAIPWL​)>Mκ(Π)V∗​/n​)≤ε for all n≥Nn\ge Nn≥N. This is the paper's own "simpler way of stating the regret bound in Theorem 3". It fixes the rate and the dependence on κ(Π)\kappa(\Pi)κ(Π) and V∗V_*V∗​, but no constants.

Milestones

  1. Lemma 1 (1): the inner product distance IΓI_\GammaIΓ​ satisfies the triangle inequality.
  2. (48): E[Q~(π)]=Q(π)\mathbb E[\tilde Q(\pi)]=Q(\pi)E[Q~​(π)]=Q(π).
  3. (17): Δ^−Δ~=∑j(S1j+S2j+S3j)\hat\Delta-\tilde\Delta=\sum_j(S^j_1+S^j_2+S^j_3)Δ^−Δ~=∑j​(S1j​+S2j​+S3j​), the algebraic split into error terms.
  4. Lemma 3 (pinned): sup⁡π1,π2∈Π∣Δ^−Δ~∣=op(n−1/2)\sup_{\pi_1,\pi_2\in\Pi}|\hat\Delta-\tilde\Delta|=o_p(n^{-1/2})supπ1​,π2​∈Π​∣Δ^−Δ~∣=op​(n−1/2).
  5. Oracle concentration (Lemma 2 as used in (18), pinned): sup⁡π1,π2∈Π∣Δ~−Δ∣=Op(n−1/2)\sup_{\pi_1,\pi_2\in\Pi}|\tilde\Delta-\Delta|=O_p(n^{-1/2})supπ1​,π2​∈Π​∣Δ~−Δ∣=Op​(n−1/2).
  6. (18): R(π^)≤sup⁡π1,π2∈Π∣Δ^−Δ∣R(\hat\pi)\le\sup_{\pi_1,\pi_2\in\Pi}|\hat\Delta-\Delta|R(π^)≤supπ1​,π2​∈Π​∣Δ^−Δ∣ for every empirical maximizer.

Printed statements not posed

  • Theorem 3's explicit display, R≤(54.42κ(Π)+435.2+2log⁡(1/δ))V∗/nR\le(54.4\sqrt2\kappa(\Pi)+435.2+\sqrt{2\log(1/\delta)})\sqrt{V_*/n}R≤(54.42​κ(Π)+435.2+2log(1/δ)​)V∗​/n​, together with Theorem 1, Lemma 2 (11) and Theorem 2, is not posed. Lemma 1(2), which the proof of Theorem 1 uses, is false. With three points, d=2d=2d=2, π0≡1\pi_0\equiv1π0​≡1, πk\pi_kπk​ switching to action 2 at the point kkk only, and γi=(1,0)\gamma_i=(1,0)γi​=(1,0), one gets NIΓ(0.7)=4>3≥NH(0.49)N_{I_\Gamma}(0.7)=4>3\ge N_H(0.49)NIΓ​​(0.7)=4>3≥NH​(0.49).
  • The V∗\sqrt{V_*}V∗​​ scaling of Theorem 1 fails for interval-switching classes, where κ(Π)\kappa(\Pi)κ(Π) stays bounded, V∗=2pV_*=2pV∗​=2p, and the Rademacher complexity is of order plog⁡(1/p)\sqrt{p\log(1/p)}plog(1/p)​.
  • 54.42(κ+8)54.4\sqrt2(\kappa+8)54.42​(κ+8) equals 54.42κ+435.2254.4\sqrt2\kappa+435.2\sqrt254.42​κ+435.22​, not 54.42κ+435.254.4\sqrt2\kappa+435.254.42​κ+435.2.
  • The o(1/n)o(1/\sqrt n)o(1/n​) and op(1/n)o_p(1/\sqrt n)op​(1/n​) remainders cannot be absorbed into one explicit constant at a fixed probability.
  • Lemma 1(2) is not posed, being false.

Significance

The theorem shows that a learner can use flexible machine-learning estimates of the propensities and outcome regressions, each converging more slowly than n−1/2n^{-1/2}n−1/2, and still attain the regret rate of an oracle that knows them, provided the product of their errors is o(n−1/2)o(n^{-1/2})o(n−1/2). This doubly robust rate condition is what makes cross-fitted AIPW scores usable for policy learning with random forests, boosting or neural-network nuisances. The dependence on Π\PiΠ only through κ(Π)\kappa(\Pi)κ(Π) covers the multi-action classes the paper uses later, such as depth-LLL decision trees.

On formalization: the result is proved on paper, with explicit constants that are not established as printed. No machine-checked proof of any part of it is known. A complete development would give a checked doubly robust policy-learning guarantee with the hypotheses a correct proof needs, stated explicitly. It would also deliver, as by-products, a checked uniform-entropy bound for empirical processes indexed by policy differences and a cross-fitting lemma with fold-wise conditional independence.

Difficulty

Two parts are hard. The oracle concentration needs a chaining (Dudley-type) bound for the empirical process {Δ~(π1,π2)−Δ(π1,π2)}\{\tilde\Delta(\pi_1,\pi_2)-\Delta(\pi_1,\pi_2)\}{Δ~(π1​,π2​)−Δ(π1​,π2​)}, indexed by pairs of policies, in which the covering numbers are uniform over point sets and the entropy integrand uses ε2\varepsilon^2ε2. Bounding one fixed pair by a central limit theorem is not enough, because the supremum over Π×Π\Pi\times\PiΠ×Π is the whole point. Lemma 3 needs the conditional independence that cross-fitting creates: given the data outside fold kkk, the terms of fold kkk are iid with conditional mean zero in the first two error terms of (17). The uniform op(n−1/2)o_p(n^{-1/2})op​(n−1/2) bound then comes from a localized chaining argument whose radius shrinks with the nuisance errors. A naive argument conditioning on all the data at once loses the mean-zero structure.

Formalization scope

Actions are Fin d; policies are deterministic maps X → Fin d (endnote 3, p. 45), and a class is Pol : Set (X → Fin d). The model is a probability measure PX with two Markov kernels κY, κA, and the joint law is PX ⊗ₘ (κY ×ₖ κA). This builds unconfoundedness into the law. The sample of size nnn is the product measure on Fin n → Draw X d. Estimators of fold kkk are functions of the observed triples indexed by {i // fold n i ≠ k}, so they cannot see fold kkk or unobserved potential outcomes. The regret uses sup⁡π′∈ΠQ(π′)\sup_{\pi'\in\Pi}Q(\pi')supπ′∈Π​Q(π′) in place of Q(π∗)Q(\pi^*)Q(π∗). κ(Π)\kappa(\Pi)κ(Π) is an ℝ≥0∞ lower integral, finite under Assumption 3. OpO_pOp​ and opo_pop​ are read for each nnn separately: Definition 8's "∀n≥N\forall n\ge N∀n≥N with probability 1−ε1-\varepsilon1−ε" presupposes one probability space for all nnn. Bounded support is stated for each xxx under κY x.

Hypotheses added to the printed ones:

  • (i) both mean-squared errors tend to 000 separately, in addition to (3). The proof of Lemma 3 uses separate rates, and with μ^≡0\hat\mu\equiv0μ^​≡0, e^=e\hat e=ee^=e, condition (3) holds while the first term of (17) has exact order n−1/2n^{-1/2}n−1/2.
  • (ii) ∣μ^∣≤B^|\hat\mu|\le\hat B∣μ^​∣≤B^, e^≥η^>0\hat e\ge\hat\eta>0e^≥η^​>0, and both estimators are measurable.
  • (iii) the policies are measurable, and the class is permissible: for each mmm and action pattern, the set of point sequences on which some policy realizes the pattern is measurable.

Without (ii) and (iii), Lean's integrals of non-measurable functions are 000 and Assumption 2 would be vacuous. The hypotheses are satisfiable: the oracle estimators μ^=μ\hat\mu=\muμ^​=μ, e^=e\hat e=ee^=e meet every estimator condition, and a finite class of constant policies meets Assumption 3 and permissibility. The degenerate cases κ(Π)=0\kappa(\Pi)=0κ(Π)=0 or V∗=0V_*=0V∗​=0 force zero regret, so the goal is not trivialized there.

Needed infrastructure: product measures and kernels (Mathlib), and Hamming covering numbers (local, Definition 4). Still to build: uniform-entropy chaining for bounded classes, and Talagrand/Bousquet-type concentration. Contributions are welcome on the chaining bound, the cross-fitting conditional-independence lemma, and the elementary items (48), (17) and Lemma 1(1). These are reusable in any doubly robust estimation mission.

Selected references

  • Z. Zhou, S. Athey, S. Wager, Offline Multi-Action Policy Learning: Generalization and Optimization, arXiv:1810.04778v2, 2018; Operations Research 71(1), 2023. https://arxiv.org/abs/1810.04778
  • S. Athey, S. Wager, Policy Learning with Observational Data, Econometrica 89(1), 2021. https://arxiv.org/abs/1702.02896
  • T. Kitagawa, A. Tetenov, Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice, Econometrica 86(2), 2018. https://doi.org/10.3982/ECTA13288
  • V. Chernozhukov et al., Double/Debiased Machine Learning for Treatment and Structural Parameters, The Econometrics Journal 21(1), 2018. https://arxiv.org/abs/1608.00060
  • M. Dudík, J. Langford, L. Li, Doubly Robust Policy Evaluation and Learning, ICML 2011. https://arxiv.org/abs/1103.4601
  • J. Robins, A. Rotnitzky, L. P. Zhao, Estimation of Regression Coefficients When Some Regressors Are Not Always Observed, JASA 89(427), 1994. https://doi.org/10.1080/01621459.1994.10476818
9 thms1 active userReviewed
EconomicsOperations Research·Captain: mikedeng1

Operational Risk Management: Optimal Inspection Policy I: Periodic Inspection Beats Random Inspection Below an Inspection-Cost Threshold and Loses Above ItResearch Paper

Why inspection timing matters

A firm that relies on employees to process transactions can lose money when errors remain undetected. Inspection catches errors, but each inspection costs money, and employees may change their care when they know when an inspection will occur. These effects make the timing of inspections part of a contract design problem, not just a scheduling choice. Kim and Xu study that problem in a continuous-time principal–agent model of operational risk. Their SSRN preprint proves that the ranking of two common inspection policies changes with the cost of inspection: periodic inspection is better at low cost, while random inspection is better at high cost (Proposition 4, p. 17). This mission targets that result in the authors' July 2023 preprint, whose numbering is used throughout.

The comparison matters because neither inspection policy has an unconditional advantage in the model. A periodic schedule fixes the time until the next inspection; a random schedule makes that time uncertain. The agent responds to the schedule through effort, while the firm pays both for inspections and for errors left unresolved. Choosing a policy by its inspection frequency alone therefore misses a change in the agent's response and in the duration of losses. The paper develops both policies' optimal contracts before comparing their payoffs Kim and Xu, §§3–4.

The model

The principal is a firm and the agent is an employee. The firm earns base profit at rate μ>0\mu>0μ>0. The agent chooses a nonnegative effort path a(t)a(t)a(t), where ttt is time since the last inspection, at unit cost c>0c>0c>0. Errors arrive at aggregate rate λe−a(t)\lambda e^{-a(t)}λe−a(t), with λ>0\lambda>0λ>0. Each unresolved error causes expected loss L>0L>0L>0 per unit time until the next inspection finds and corrects it. The paper begins with several error classes, then uses their aggregate arrival rate λ\lambdaλ and rate-weighted mean loss LLL for the remainder of the analysis (7), p. 10.

The firm chooses an inspection frequency vvv, a penalty PPP charged to the employee per error found, and a wage www. Under the random policy RRR, the time τ\tauτ between inspections is exponentially distributed with rate vvv; under the periodic policy DDD, it equals 1/v1/v1/v. The employee chooses a best response to the announced policy and contract. The employee must receive at least the reservation payoff πˉ>0\bar\pi>0πˉ>0. Both parties discount future payoffs at rate r>0r>0r>0. An inspection costs the firm K>0K>0K>0 per cycle. Equations (1) and (3) specify their discounted payoffs; equation (6) gives the firm's reduced payoff when participation binds §3, pp. 8–10.

The standing Assumption 1 is c<Lλ/rc<L\lambda/rc<Lλ/r and Lλ/r<μˉL\lambda/r<\bar\muLλ/r<μˉ​, with μˉ=μ−rπˉ\bar\mu=\mu-r\bar\piμˉ​=μ−rπˉ. The first inequality excludes the paper's degenerate no-effort regime; the second ensures that the adjusted base profit exceeds the expected operational loss of the uninspected benchmark (7), p. 10. In the formalization, all six parameters r,c,λ,L,μ,πˉr,c,\lambda,L,\mu,\bar\pir,c,λ,L,μ,πˉ are also positive, as stated in §3.

Formalization targets

The goal is Proposition 4. For fixed model parameters there is one inspection-cost threshold KRDK_{RD}KRD​, independent of the particular positive cost KKK, such that

0<K<KRD⟹ΠR(SR∗)<ΠD(SD∗),0<K<K_{RD}\quad\Longrightarrow\quad \Pi_R(S_R^*)<\Pi_D(S_D^*),0<K<KRD​⟹ΠR​(SR∗​)<ΠD​(SD∗​), 0<K and K>KRD⟹ΠD(SD∗)<ΠR(SR∗).0<K\ \text{and}\ K>K_{RD}\quad\Longrightarrow\quad \Pi_D(S_D^*)<\Pi_R(S_R^*).0<K and K>KRD​⟹ΠD​(SD∗​)<ΠR​(SR∗​).

Here SR∗S_R^*SR∗​ and SD∗S_D^*SD∗​ are optimal feasible strategies under the respective inspection laws. The paper does not specify which policy is better at K=KRDK=K_{RD}K=KRD​, and the formal goal does not add an equality claim there Proposition 4, p. 17.

The milestones first connect binding participation to the firm's reduced payoff in (6). Lemma 3 identifies constant optimal effort under random inspections and its threshold v‾R\underline v_Rv​R​; Lemma 4 identifies the time-dependent effort under periodic inspections and its threshold v‾D\underline v_Dv​D​. The two statements in §4.2 then express the firm's reduced payoff through the explicit random branches VˉR,VR0\bar V_R,V_R^0VˉR​,VR0​ of (EC.2) and periodic branches VˉD,V‾D,VD0\bar V_D,\underline V_D,V_D^0VˉD​,V​D​,VD0​ of (EC.4) pp. 10, 13–14 and ec5–ec6. These targets fix the model and its regime changes before solvers address the policy-level optimization.

What the result establishes

The result distinguishes regimes in which a predictable inspection date pays off from regimes in which an uncertain one pays off, after each policy's frequency, penalty, wage and induced effort are optimized. It is a claim about the principal's optimal payoff under complete contracts in the paper's model. It does not assert that either schedule dominates for every fixed frequency or penalty. The strict comparisons matter: they identify a genuine reversal rather than a weak inclusion of one policy's feasible strategies in another's Proposition 4, p. 17.

Kim and Xu proved this proposition in the cited preprint; the open work in this mission is to give its stated model, supporting results and comparison a machine-checked Lean proof. The definitions of inspection laws, achievable payoffs and discounted cycle quantities can also support the paper's separate hybrid-policy comparison and future formal work on continuous-time inspection contracts. The closed-form payoff branches provide testable interfaces between the economic model and the optimization results. The mission does not claim that any of these proofs is already machine checked.

Where the difficulty lies

The direct intuition that unpredictable inspections should always restrain delayed effort fails as a policy comparison. Under a periodic schedule, the employee can increase effort near the known inspection time, but earlier inspection also shortens the time that errors remain costly. The relative effect depends on KKK and on which effort regime is optimal. An argument based only on the employee's response at a fixed (v,P)(v,P)(v,P) cannot determine the ranking of the principal's optimized payoffs. The paper's characterization of each policy includes both effort inducement and error correction modes, with different closed forms and cost thresholds §4.2, pp. 14–15; proof of Proposition 4, pp. ec30–ec33.

Formalization scope

Lean represents an effort path as a real-valued function of time since the last inspection. It is measurable, nonnegative and bounded. The last condition is a disclosed modelling pin: it ensures that the real-valued expected effort and error terms do not acquire Lean's default zero value for a nonintegrable function. The random interval law is Mathlib's exponential measure; the periodic law is a Dirac measure at 1/v1/v1/v. The error classes are aggregated using λ\lambdaλ and LLL, and expected errors are λ∫0te−a(s)ds\lambda\int_0^t e^{-a(s)}dsλ∫0t​e−a(s)ds. This starts at the discounted cycle payoff equations (1) and (3), rather than reconstructing the underlying Poisson and Brownian processes §3 and Appendix EC.4.1.

Feasible principal strategies require v>0v>0v>0, P,w≥0P,w\ge0P,w≥0, a best-responding agent and the participation constraint. This makes the 1/v1/v1/v formulas meaningful. The agent's best-response test sets w=0w=0w=0, because wage enters payoff additively and cannot change which effort is optimal. A policy comparison uses achievable payoffs: it asserts an achievable payoff for the better policy exceeding every achievable payoff of the worse policy. That formulation avoids default values of a real supremum over an empty or unbounded set. It also prevents an empty feasible set from satisfying a comparison vacuously. The threshold KRDK_{RD}KRD​ is quantified before KKK, and the source does not explicitly require it to be positive. Formulas dividing by PPP are invoked only when P>c/λP>c/\lambdaP>c/λ; the zero-penalty case has a separate statement.

This initial mission includes the model, the effort lemmas, the two payoff-regime statements and Proposition 4. Characterizing the globally optimal random and periodic contracts and their comparisons remains welcome solver work; their long closed-form optimization results have not been weakened into easier draft milestones. Reusable contributions include integration facts for the exponential and Dirac laws, best-response characterizations up to almost-everywhere equality, and analytic properties of the payoff branches.

Selected references

  • Y. Kim and Y. Xu, Operational Risk Management: Optimal Inspection Policy, SSRN preprint 3491006, version compiled July 2023, SSRN. Published in Management Science, DOI 10.1287/mnsc.2021.00322. The mission cites the preprint's page and result numbering.
8 thms1 active userReviewed
Graph TheoryInformation TheoryStatistics·Captain: mikedeng1

Partial Recovery in the Graph Alignment Problem I: If D(P‖Q)/α = o(log n/n), No Algorithm Recovers a Fraction α of a Correlated Erdős–Rényi AlignmentResearch Paper

Motivation

Graph alignment asks for the correspondence between the vertices of two graphs that are noisy copies of each other with hidden labels. It arises in the de-anonymization of social networks, where an anonymized friendship graph is matched against a public one (Narayanan–Shmatikov 2009), and in computational biology, where protein–protein interaction networks of related species are aligned. The standard random model is the correlated Erdős–Rényi model of Pedarsani–Grossglauser 2011, for which exact recovery thresholds are known (Cullina–Kiyavash 2016) and almost-exact recovery is known to be impossible when nqs=O(1)nqs=O(1)nqs=O(1) (Cullina–Kiyavash–Mittal–Poor 2018).

Hall and Massoulié (arXiv:2007.00533) study the weaker goal of partial recovery: output a permutation that agrees with the hidden one on a constant fraction α\alphaα of the vertices. This mission formalizes their impossibility theorem; a companion mission (II) formalizes their possibility theorem.

Setting

Fix nnn and scalars 0≤q<s≤10\le q<s\le10≤q<s≤1. A parent graph G∼G(n,q/s)G\sim G(n,q/s)G∼G(n,q/s) is copied twice and each copy keeps every edge independently with probability sss, giving graphs GAG_AGA​ and GB′G_{B'}GB′​ with adjacency matrices AAA and B′B'B′. Every unordered pair {i,j}\{i,j\}{i,j} of distinct vertices independently carries the pair (Aij,Bij′)∈{0,1}2(A_{ij},B'_{ij})\in\{0,1\}^2(Aij​,Bij′​)∈{0,1}2 with law PPP (equation (3)):

p00=1−2q+qs,p01=p10=q(1−s),p11=qs.p_{00}=1-2q+qs,\qquad p_{01}=p_{10}=q(1-s),\qquad p_{11}=qs .p00​=1−2q+qs,p01​=p10​=q(1−s),p11​=qs.

Two independent edges of G(n,q)G(n,q)G(n,q) have law QQQ (equation (4)):

q00=1−2q+q2,q01=q10=q(1−q),q11=q2.q_{00}=1-2q+q^2,\qquad q_{01}=q_{10}=q(1-q),\qquad q_{11}=q^2 .q00​=1−2q+q2,q01​=q10​=q(1−q),q11​=q2.

The Kullback–Leibler divergence is D(P∥Q)=∑x∈{0,1}2P(x)log⁡P(x)Q(x)D(P\|Q)=\sum_{x\in\{0,1\}^2}P(x)\log\frac{P(x)}{Q(x)}D(P∥Q)=∑x∈{0,1}2​P(x)logQ(x)P(x)​.

A hidden permutation π∗\pi^*π∗ of the vertices, drawn uniformly from the n!n!n! permutations, relabels GB′G_{B'}GB′​ into GBG_BGB​: Bπ∗(i)π∗(j)=Bij′B_{\pi^*(i)\pi^*(j)}=B'_{ij}Bπ∗(i)π∗(j)​=Bij′​. An algorithm sees only (A,B)(A,B)(A,B) and returns a permutation π^\hat\piπ^, possibly at random. Its quality is the overlap

β(π^,π∗)=1n∑i=1n1π^(i)=π∗(i).\beta(\hat\pi,\pi^*)=\frac1n\sum_{i=1}^n\mathbf 1_{\hat\pi(i)=\pi^*(i)} .β(π^,π∗)=n1​i=1∑n​1π^(i)=π∗(i)​.

The mutual information I(π∗;(A,B))I(\pi^*;(A,B))I(π∗;(A,B)) is that of the joint law of π∗\pi^*π∗ and the observation, and Mα=max⁡π∗∣{π∣β(π,π∗)≥α}∣M_\alpha=\max_{\pi^*}|\{\pi\mid\beta(\pi,\pi^*)\ge\alpha\}|Mα​=maxπ∗​∣{π∣β(π,π∗)≥α}∣ counts the permutations that are α\alphaα-close to a given one, out of M=n!M=n!M=n!.

Formalization targets

Goal: Theorem 2.1 (p. 8)

Let αn∈(0,1)\alpha_n\in(0,1)αn​∈(0,1), bounded below by a constant c>0c>0c>0 for large nnn. If

D(P∥Q)αn=o(log⁡nn),\frac{D(P\|Q)}{\alpha_n}=o\Big(\frac{\log n}{n}\Big),αn​D(P∥Q)​=o(nlogn​),

then for every sequence of algorithms,

P[β(π^,π∗)<αn]→1(n→∞).\mathbb P\big[\beta(\hat\pi,\pi^*)<\alpha_n\big]\to1\qquad(n\to\infty).P[β(π^,π∗)<αn​]→1(n→∞).

Milestones

  1. Theorem 3.1 (generalized Fano inequality): P[d(Z^,Z)>d]≥1−I(Z;X^)+1log⁡(M/Md)\mathbb P[d(\hat Z,Z)>d]\ge1-\frac{I(Z;\hat X)+1}{\log(M/M_d)}P[d(Z^,Z)>d]≥1−log(M/Md​)I(Z;X^)+1​ for any Markov chain Z→X^→Z^Z\to\hat X\to\hat ZZ→X^→Z^ with ZZZ uniform.
  2. Corollary 3.2: P(β(π^,π∗)<α)≥1−I(π∗;(A,B))+1log⁡(M/Mα)\mathbb P(\beta(\hat\pi,\pi^*)<\alpha)\ge1-\frac{I(\pi^*;(A,B))+1}{\log(M/M_\alpha)}P(β(π^,π∗)<α)≥1−log(M/Mα​)I(π∗;(A,B))+1​.
  3. Proposition 3.3: M/Mα=Ω(⌈nα⌉!)M/M_\alpha=\Omega(\lceil n\alpha\rceil!)M/Mα​=Ω(⌈nα⌉!).
  4. Inequality (8): I(π∗;(A,B))≤Eπ∗[D(P((A,B)=⋅∣π∗) ∥ Q)]I(\pi^*;(A,B))\le\mathbb E_{\pi^*}\big[D(\mathbb P((A,B)=\cdot\mid\pi^*)\,\|\,\mathcal Q)\big]I(π∗;(A,B))≤Eπ∗​[D(P((A,B)=⋅∣π∗)∥Q)], with Q\mathcal QQ the law of two independent G(n,q)G(n,q)G(n,q) graphs.
  5. The display after (8), p. 13: I(π∗;(A,B))≤(n2)D(P∥Q)I(\pi^*;(A,B))\le\binom n2D(P\|Q)I(π∗;(A,B))≤(2n​)D(P∥Q).

Significance

The theorem gives a sufficient condition, in terms of a single per-pair divergence, under which no algorithm (efficient or not) recovers even a fraction α\alphaα of the alignment. Together with the companion possibility result (Theorem 2.3: partial recovery is possible when nqsnqsnqs exceeds an explicit constant under sparsity conditions), it brackets the partial-recovery threshold; the paper's Corollary 2.2 specializes it to nqs=o(1)nqs=o(1)nqs=o(1) in the regime n−k≤q=o(n−1/2)n^{-k}\le q=o(n^{-1/2})n−k≤q=o(n−1/2).

On the formal side, the mission produces a finite, self-contained model of correlated random graphs with a planted permutation, a generalized Fano inequality for finite hypothesis classes with an arbitrary distance, and the bound of mutual information by a product divergence. The Fano inequality and the mutual-information bounds are reusable for other information-theoretic lower bounds (community detection, planted matching, testing). The paper proves the results on paper; none of them is formalized, and no Fano inequality is proved on the platform.

Difficulty

The Fano inequality (Theorem 3.1) is cited from Lemma 20 of Banerjee–Hegde–Massoulié (2012) and not proved in the paper, and the entropy calculus it rests on is not in Mathlib in a finite, real-valued form. The counting step (Proposition 3.3) concerns rencontres numbers; the paper uses the asymptotic Dn,k∼e−1n!/k!D_{n,k}\sim e^{-1}n!/k!Dn,k​∼e−1n!/k!, which is valid only for fixed kkk, while the statement needs control uniform in kkk. Bounding I(π∗;(A,B))I(\pi^*;(A,B))I(π∗;(A,B)) requires relating the conditional law of the observation, a relabelled product law, to the unlabelled reference law Q\mathcal QQ on a space of 4n24^{n^2}4n2 matrix pairs, most of which have probability zero.

A natural first idea for the goal, taking α\alphaα arbitrary as printed, fails: if αn=1/n\alpha_n=1/nαn​=1/n, the identity algorithm succeeds whenever π∗\pi^*π∗ has a fixed point, with probability tending to 1−e−11-e^{-1}1−e−1, even when the divergence condition holds. The argument needs log⁡(M/Mα)\log(M/M_\alpha)log(M/Mα​) to grow like nαnlog⁡nn\alpha_n\log nnαn​logn, which needs αn\alpha_nαn​ bounded below.

Formalization scope

Vertices are Fin n; a vertex pair is an off-diagonal element of Sym2 (Fin n); an edge state is a Bool × Bool with first coordinate AAA, second B′B'B′. The probability of a configuration is the product of PPP over pairs, and BBB is computed through π∗−1\pi^{*-1}π∗−1. Every probability is a finite sum; logarithms are natural. Standing assumptions on the parameters are 0≤q<s≤10\le q<s\le10≤q<s≤1 (pp. 5 and 7); the remark "we assume s<1s<1s<1" of p. 6 is not used and not imposed.

Algorithms are real stochastic kernels from the observed pair (A,B)(A,B)(A,B) to permutations, so randomized algorithms are included and deterministic ones are the 0/1 kernels. The algorithm's argument is the observation only: it does not see π∗\pi^*π∗ or GB′G_{B'}GB′​. Mutual information and Kullback–Leibler divergence are defined as finite sums (Lean's 0⋅log⁡0=00\cdot\log 0=00⋅log0=0).

Hypotheses added relative to the page, each disclosed in the item's note:

  • Theorem 2.1: αn≥c>0\alpha_n\ge c>0αn​≥c>0 for large nnn (the printed statement is false for αn→0\alpha_n\to0αn​→0 fast).
  • Theorem 3.1 and Corollary 3.2: Md<MM_d<MMd​<M (resp. Mα<n!M_\alpha<n!Mα​<n!), without which log⁡(M/Md)=0\log(M/M_d)=0log(M/Md​)=0 and the bound is meaningless.
  • Theorem 3.1: the observation space is finite; no metric axioms on ddd are assumed.

Proposition 3.3 reads (nα)!(n\alpha)!(nα)! as ⌈nα⌉!\lceil n\alpha\rceil!⌈nα⌉!.

Trivializing formalizations are ruled out: the algorithm cannot be given π∗\pi^*π∗ (an oracle wins) or nothing (the statement becomes empty); the little-ooo hypothesis is a limit of a ratio, not an inequality; the configuration law is built from (3) and sums to 1, not chosen by the solver.

Infrastructure a complete development needs: finite entropy and mutual information with the chain rule and data processing; Gibbs' inequality; derangement and rencontres counts (numDerangements in Mathlib); Stirling-type lower bounds on log⁡k!\log k!logk!. Contributions are welcome on each milestone independently; the Fano inequality is the piece with the widest reuse.

The source is the arXiv preprint v5 (13 Jan 2022); its numbering is used throughout.

Selected references

  • G. Hall, L. Massoulié, Partial Recovery in the Graph Alignment Problem, arXiv:2007.00533v5, 2022; Operations Research, 2023. https://arxiv.org/abs/2007.00533
  • P. Pedarsani, M. Grossglauser, On the privacy of anonymized networks, KDD 2011. https://doi.org/10.1145/2020408.2020596
  • D. Cullina, N. Kiyavash, Improved achievability and converse bounds for Erdős–Rényi graph matching, SIGMETRICS 2016. https://arxiv.org/abs/1602.01042
  • D. Cullina, N. Kiyavash, P. Mittal, H. V. Poor, Partial recovery of Erdős–Rényi graph alignment via k-core alignment, arXiv:1809.03553, 2018. https://arxiv.org/abs/1809.03553
  • S. Banerjee, N. Hegde, L. Massoulié, The price of privacy in untrusted recommendation engines, Allerton 2012, pp. 920–927 (Lemma 20: the generalized Fano inequality); cited as [3] in the paper.
  • A. Narayanan, V. Shmatikov, De-anonymizing social networks, IEEE S&P 2009. https://doi.org/10.1109/SP.2009.22
  • T. M. Cover, J. A. Thomas, Elements of Information Theory, 2nd ed., Wiley, 2006. https://doi.org/10.1002/047174882X
8 thms1 active userReviewed
CombinatoricsGraph TheoryStatistics·Captain: mikedeng1

Partial Recovery in the Graph Alignment Problem II: Under Explicit Sparsity Conditions with nqs Above a Constant, Some Algorithm Recovers a Fraction α of the AlignmentResearch Paper

Motivation

Graph alignment asks for the correspondence between the vertex sets of two graphs that are noisy copies of each other. It underlies the de-anonymisation of social networks, where an anonymised graph is matched to a public one (Narayanan, Shmatikov 2009), the comparison of protein–protein interaction networks across species, and matching problems in computer vision. The standard random model for studying when alignment is possible is the correlated Erdős–Rényi model (Pedarsani, Grossglauser 2011).

In that model, exact recovery of the hidden correspondence and almost exact recovery (all but a vanishing fraction of vertices) have sharp thresholds: exact recovery by Cullina, Kiyavash 2016 and 2017; almost exact recovery when nqs=ω(1)nqs = \omega(1)nqs=ω(1) by Cullina, Kiyavash, Mittal and Poor (arXiv:1809.03553). Hall and Massoulié (arXiv:2007.00533v5, Operations Research 2023) study partial recovery, the recovery of a constant fraction α\alphaα of the correspondence, in the sparse regime nqs=Θ(1)nqs = \Theta(1)nqs=Θ(1), where almost exact recovery is impossible. This mission formalizes their possibility result, Theorem 2.3. Its companion mission (Partial Recovery in the Graph Alignment Problem I) formalizes the impossibility result, Theorem 2.1.

Setting

Fix n≥1n \ge 1n≥1 and parameters q,sq, sq,s with 0≤q<s≤10 \le q < s \le 10≤q<s≤1. A parent graph on {1,…,n}\{1, \dots, n\}{1,…,n} includes each edge independently with probability q/sq/sq/s. Two copies are made, and each copy keeps every edge independently with probability sss. The resulting graphs GAG_AGA​ and GB′G_{B'}GB′​ have adjacency matrices AAA and B′B'B′. For each unordered pair {i,j}\{i, j\}{i,j} of distinct vertices, (Aij,Bij′)(A_{ij}, B'_{ij})(Aij​,Bij′​) has the law PPP of display (3):

p00=1−2q+qs,p01=p10=q(1−s),p11=qs,p_{00} = 1 - 2q + qs, \qquad p_{01} = p_{10} = q(1-s), \qquad p_{11} = qs,p00​=1−2q+qs,p01​=p10​=q(1−s),p11​=qs,

independently over the (n2)\binom n2(2n​) pairs. The covariance of AijA_{ij}Aij​ and Bij′B'_{ij}Bij′​ is σ2=q(s−q)\sigma^2 = q(s-q)σ2=q(s−q) (display (2)), which is positive when q>0q > 0q>0.

A planted permutation π∗\pi^*π∗ relabels GB′G_{B'}GB′​ into the observed graph GBG_BGB​: Bπ∗(i)π∗(j)=Bij′B_{\pi^*(i)\pi^*(j)} = B'_{ij}Bπ∗(i)π∗(j)​=Bij′​. An algorithm sees (A,B)(A, B)(A,B) and returns a permutation π^\hat\piπ^. Its quality is the overlap

β(π^,π∗)=1n∑i=1n1{π^(i)=π∗(i)}.\beta(\hat\pi, \pi^*) = \frac1n \sum_{i=1}^n \mathbf 1\{\hat\pi(i) = \pi^*(i)\}.β(π^,π∗)=n1​i=1∑n​1{π^(i)=π∗(i)}.

For 0<α<10 < \alpha < 10<α<1, a permutation π\piπ is good (Definition 2) if at least n(1+α)/2n(1+\alpha)/2n(1+α)/2 vertices iii have degree at least nqs/2nqs/2nqs/2 in the intersection of GAG_AGA​ with GBG_BGB​ relabelled by π\piπ:

∑i=1n1{∑j≠iAijBπ(i)π(j)≥nqs2}≥n⋅1+α2.\sum_{i=1}^n \mathbf 1\Big\{\sum_{j \ne i} A_{ij} B_{\pi(i)\pi(j)} \ge \frac{nqs}{2}\Big\} \ge n\cdot\frac{1+\alpha}{2}.i=1∑n​1{j=i∑​Aij​Bπ(i)π(j)​≥2nqs​}≥n⋅21+α​.

In Lean, these objects are pLaw, Config, cfgProb, prob, A, B', B, overlap, good and Cond6 in GraphAlignment.Possible.

Formalization targets

Goal: Theorem 2.3 (pp. 8–9)

Let 0<α<10 < \alpha < 10<α<1 and let q=qnq = q_nq=qn​, s=sns = s_ns=sn​ be sequences. Suppose there exist β,γ>0\beta, \gamma > 0β,γ>0 such that, for all large nnn,

nqs≥max⁡{20, 84log⁡21−α, 16min⁡(γ,β)(1−α)},s>8q1−α,2q(1−s2)s≤n−β,qs≤n−2γ.(6)nqs \ge \max\Big\{20,\ 84\log\frac{2}{1-\alpha},\ \frac{16}{\min(\gamma,\beta)(1-\alpha)}\Big\}, \quad s > \frac{8q}{1-\alpha}, \quad \frac{2q(1-s^2)}{s} \le n^{-\beta}, \quad qs \le n^{-2\gamma}. \tag{6}nqs≥max{20, 84log1−α2​, min(γ,β)(1−α)16​},s>1−α8q​,s2q(1−s2)​≤n−β,qs≤n−2γ.(6)

Then some algorithm returns π^\hat\piπ^ with

P[β(π^,π∗)≥α]→1(n→∞).\mathbb P\big[\beta(\hat\pi, \pi^*) \ge \alpha\big] \to 1 \qquad (n \to \infty).P[β(π^,π∗)≥α]→1(n→∞).

Milestones

  1. Lemma B.3: Mn=αnM−βIα−β+βnM−αIβ−αM^n = \alpha^n \frac{M - \beta I}{\alpha - \beta} + \beta^n \frac{M - \alpha I}{\beta - \alpha}Mn=αnα−βM−βI​+βnβ−αM−αI​ for a 2×22 \times 22×2 matrix with distinct eigenvalues α,β\alpha, \betaα,β.
  2. Lemma B.2: for n+1n+1n+1 independent pairs with law PPP and W=A0B1+⋯+AnB0W = A_0B_1 + \dots + A_nB_0W=A0​B1​+⋯+An​B0​,
E[etW]=(T+T2−4D2)n+1+(T−T2−4D2)n+1,T=p11(et−1)+1, D=σ2(et−1).\mathbb E[e^{tW}] = \Big(\tfrac{T + \sqrt{T^2 - 4D}}{2}\Big)^{n+1} + \Big(\tfrac{T - \sqrt{T^2 - 4D}}{2}\Big)^{n+1}, \quad T = p_{11}(e^t - 1) + 1,\ D = \sigma^2(e^t - 1).E[etW]=(2T+T2−4D​​)n+1+(2T−T2−4D​​)n+1,T=p11​(et−1)+1, D=σ2(et−1).
  1. Lemma B.1: (αk+βk)n/k≤(α2+β2)n/2(\alpha^k + \beta^k)^{n/k} \le (\alpha^2 + \beta^2)^{n/2}(αk+βk)n/k≤(α2+β2)n/2 for 2≤k≤n2 \le k \le n2≤k≤n and α,β>0\alpha, \beta > 0α,β>0.
  2. Lemma 4.3: min⁡z>0z−τeq2(z2−1)+q1(z−1)≤ζτ\min_{z > 0} z^{-\tau} e^{q_2(z^2-1) + q_1(z-1)} \le \zeta^\tauminz>0​z−τeq2​(z2−1)+q1​(z−1)≤ζτ, with ζ=max⁡{2eq1/τ, 4e(q2/τ)1/2}\zeta = \max\{\sqrt2 e q_1/\tau,\ 4e(q_2/\tau)^{1/2}\}ζ=max{2​eq1​/τ, 4e(q2​/τ)1/2}, and the minimizer satisfies z∗2=(τ−q1z∗)/(2q2)≤τ/(2q2)z^{*2} = (\tau - q_1 z^*)/(2q_2) \le \tau/(2q_2)z∗2=(τ−q1​z∗)/(2q2​)≤τ/(2q2​).
  3. Display (10): for a permutation ppp with a fraction ϵ\epsilonϵ of fixed points, ∣S21∣≤n(1−ϵ)|S^1_2| \le n(1-\epsilon)∣S21​∣≤n(1−ϵ) and ∣Sˉ22∣≤(n2)−(nϵ2)≤n22(1−ϵ2)|\bar S^2_2| \le \binom n2 - \binom{n\epsilon}2 \le \frac{n^2}2(1-\epsilon^2)∣Sˉ22​∣≤(2n​)−(2nϵ​)≤2n2​(1−ϵ2).
  4. Lemma A.2, in particular: P(Po(2λ/3)≥λ/2−1)≥0.7\mathbb P(\mathrm{Po}(2\lambda/3) \ge \lambda/2 - 1) \ge 0.7P(Po(2λ/3)≥λ/2−1)≥0.7 for λ≥20\lambda \ge 20λ≥20.
  5. Proposition 4.2: under (6), π∗\pi^*π∗ is good with probability tending to 1.
  6. Proposition 4.4: under (6), P(∀π, [π good⇒β(π,π∗)>α])→1\mathbb P(\forall \pi,\ [\pi \text{ good} \Rightarrow \beta(\pi, \pi^*) > \alpha]) \to 1P(∀π, [π good⇒β(π,π∗)>α])→1.

Significance

The result. Theorem 2.3 shows that partial alignment is information-theoretically achievable in the sparse regime nqs=Θ(1)nqs = \Theta(1)nqs=Θ(1), provided nqsnqsnqs is above an explicit constant depending on α\alphaα. Together with Theorem 2.1, it locates partial recovery between a necessary condition stated through the divergence D(P∥Q)D(P\|Q)D(P∥Q) and a sufficient condition stated through nqsnqsnqs. It complements the almost-exact-recovery results for nqs=ω(1)nqs = \omega(1)nqs=ω(1), which do not apply when nqsnqsnqs stays bounded. The moment generating function computation of Lemma B.2 and the inequality of Lemma B.1 were reused for the sharp exact-recovery threshold by Wu, Xu, Yu (p. 9 of the source).

Formalizing it. The theorem is proved on paper; no part of it is machine-checked. The paper's route to Proposition 4.2 applies a kkk-core theorem for G(n,λ/n)G(n, \lambda/n)G(n,λ/n) with λ\lambdaλ fixed and kkk an integer, at λ=nqs\lambda = nqsλ=nqs and k=nqs/2k = nqs/2k=nqs/2, which vary with nnn and need not be integers. The statement of Proposition 4.2 remains true, but a formal proof needs a different argument. Proposition 4.4's union bound contains two repairable gaps: an infimum taken over z>0z > 0z>0 instead of z>1z > 1z>1, and the bound n!≤nlog⁡nn! \le n^{\log n}n!≤nlogn. A formal development would settle the theorem under exactly the conditions (6).

Difficulty

The natural first step is to compute P(π good)\mathbb P(\pi \text{ good})P(π good) for a fixed wrong permutation π\piπ and take a union bound over all n!n!n! permutations. The difficulty is that for π≠π∗\pi \ne \pi^*π=π∗ the terms AijBp(i)p(j)′A_{ij} B'_{p(i)p(j)}Aij​Bp(i)p(j)′​ are not independent: an edge variable enters several terms along the cycles that ppp induces on vertex pairs. A Chernoff bound therefore needs the moment generating function of a sum over each cycle of pairs. That is a transfer-matrix computation, and the per-cycle bounds must then be recombined uniformly in the cycle lengths. The resulting exponent must beat log⁡n!≈nlog⁡n\log n! \approx n \log nlogn!≈nlogn. This is where the sparsity conditions 2q(1−s2)/s≤n−β2q(1-s^2)/s \le n^{-\beta}2q(1−s2)/s≤n−β and qs≤n−2γqs \le n^{-2\gamma}qs≤n−2γ, and the constant 16/(min⁡(γ,β)(1−α))16/(\min(\gamma,\beta)(1-\alpha))16/(min(γ,β)(1−α)), enter. Proposition 4.2 is a concentration statement for the number of vertices of degree at least nqs/2nqs/2nqs/2 in the intersection graph, an Erdős–Rényi graph G(n,qs)G(n, qs)G(n,qs), when nqsnqsnqs is only a large constant.

Formalization scope

Everything is finite. Vertices are Fin n and permutations are Equiv.Perm (Fin n). A configuration assigns (Aij,Bij′)∈(A_{ij}, B'_{ij}) \in(Aij​,Bij′​)∈ Bool × Bool to each non-diagonal element of Sym2 (Fin n), and probabilities are finite sums of the product weights. They are not taken against a free measure, so the model is a genuine probability space whenever 0≤q<s≤10 \le q < s \le 10≤q<s≤1. The standing assumptions 0≤qn<sn≤10 \le q_n < s_n \le 10≤qn​<sn​≤1 for every nnn (p. 5 and the running assumption s>qs > qs>q on p. 7) are hypotheses of the asymptotic statements. The paper's remark "we assume s<1s < 1s<1" (p. 6) is used by neither result and is not imposed. Logarithms are natural, "→1\to 1→1" is a limit along n→∞n \to \inftyn→∞, and the thresholds nqs/2nqs/2nqs/2 and n(1+α)/2n(1+\alpha)/2n(1+α)/2 are real numbers, not floored.

In the goal, an algorithm is a family of maps from the observed pair (A,B)(A, B)(A,B) to a permutation. It is chosen before the planted permutations and may depend on nnn, qnq_nqn​, sns_nsn​, α\alphaα, but never on π∗\pi^*π∗. This rules out the trivial algorithm "output π∗\pi^*π∗". The theorem does not say how π∗\pi^*π∗ is drawn, so the limit is required for every sequence of planted permutations, which covers the uniform case. "Exponential time" is not formalized.

Three statements are posed in a corrected reading, each disclosed in its Formalization Note. In Lemma 4.3, τ,q2>0\tau, q_2 > 0τ,q2​>0 and z>0z > 0z>0: the paper allows τ=q2=0\tau = q_2 = 0τ=q2​=0 and z=0z = 0z=0, where ζ\zetaζ and (13) are undefined, and Lean's convention 0−τ=00^{-\tau} = 00−τ=0 would make the bound trivial. Display (10) is stated for an arbitrary permutation ppp. Only the "in particular" clause of Lemma A.2 is stated, because the paper's proof of the general normal-approximation bound does not hold as written. Lemma 4.1 (a kkk-core theorem of Pittel, Spencer and Wormald) is not posed.

A complete development needs: Chernoff bounds for finite sums of dependent Bernoulli variables via the transfer-matrix formula, binomial and Poisson tail estimates, and the cycle decomposition of the action of a permutation on unordered pairs. Lemmas B.1, B.3 and 4.3 are general-purpose and reusable. Proofs of any milestone, and alternative proofs of Proposition 4.2 that avoid kkk-cores, are welcome.

The source is the arXiv preprint v5, whose appendices contain the proofs that the main text defers to an electronic companion.

Selected references

  • G. Hall, L. Massoulié, Partial Recovery in the Graph Alignment Problem, Operations Research, 2023; preprint arXiv:2007.00533v5, 2022. https://arxiv.org/abs/2007.00533
  • D. Cullina, N. Kiyavash, P. Mittal, H. V. Poor, Partial Recovery of Erdős–Rényi Graph Alignment via k-Core Alignment, arXiv preprint, 2018. https://arxiv.org/abs/1809.03553
  • D. Cullina, N. Kiyavash, Exact Alignment Recovery for Correlated Erdős–Rényi Graphs, arXiv preprint, 2017. https://arxiv.org/abs/1711.06783
  • D. Cullina, N. Kiyavash, Improved Achievability and Converse Bounds for Erdős–Rényi Graph Matching, SIGMETRICS, 2016. https://arxiv.org/abs/1602.01042
  • B. Pittel, J. Spencer, N. Wormald, Sudden Emergence of a Giant k-Core in a Random Graph, J. Combin. Theory Ser. B, 1996. https://doi.org/10.1006/jctb.1996.0036
  • Y. Wu, J. Xu, S. H. Yu, Settling the Sharp Reconstruction Thresholds of Random Graph Matching, arXiv preprint, 2021. https://arxiv.org/abs/2102.00082
  • A. Narayanan, V. Shmatikov, De-anonymizing Social Networks, IEEE Symposium on Security and Privacy, 2009. https://doi.org/10.1109/SP.2009.22
  • P. Pedarsani, M. Grossglauser, On the Privacy of Anonymized Networks, KDD, 2011. https://doi.org/10.1145/2020408.2020596
12 thms1 active userReviewed
Linear OptimizationOperations Research·Captain: mikedeng1

Secretaries with Advice 1: Under Non-Filtering and History-Irrelevance, an Optimal Stopping Policy Is MemorylessResearch Paper

Motivation

In the classical secretary problem, nnn candidates arrive one at a time in random order; at each arrival the decision maker sees only how the current candidate compares with the earlier ones, and must irrevocably hire or pass. The goal is to hire the best candidate, and the optimal rule (wait for about n/en/en/e arrivals, then take the first candidate better than all before) succeeds with probability about 1/e1/e1/e.

In many applications the decision maker also receives advice about each candidate: a noisy score, a prediction from a machine-learned classifier, or samples from the same distribution. Dütting, Lattanzi, Paes Leme and Vassilvitskii (arXiv:2011.06726, Mathematics of Operations Research, 2024) propose a single model covering these cases: each secretary carries a signal, ranks and signals have an arbitrary known joint distribution, and the question is which policies are optimal. Their first structural result says that, under two natural conditions on the distribution, the optimal policy can ignore almost all of the history: it needs only the current signal and whether the current secretary is the best so far. Such memoryless policies are simpler, store less, and are relevant where data retention is restricted.

Timeline. Dynkin (1963) gave the 1/e1/e1/e rule for the advice-free problem. Gilbert and Mosteller (1966) studied the full-information version, where the advice is the candidate's value drawn from a known distribution. Buchbinder, Jain and Singh (2014) wrote secretary problems as linear programs. Dütting et al. (arXiv 2020) extended this LP to general advice and proved Theorem 8, the result of this mission.

Setting

There are nnn secretaries, arriving in the order 1,…,n1,\dots,n1,…,n, and a finite signal space S\mathcal SS. An outcome consists of ranks r1,…,rn∈[n]r_1,\dots,r_n\in[n]r1​,…,rn​∈[n] (ties allowed) and signals s1,…,sn∈Ss_1,\dots,s_n\in\mathcal Ss1​,…,sn​∈S. A signaling structure is a known probability distribution P\mathbb PP over outcomes such that, almost surely, some secretary has the top rank ri=nr_i=nri​=n.

At round iii the algorithm sees the information (⪯1..i,s1,…,si)(\preceq_{1..i},s_1,\dots,s_i)(⪯1..i​,s1​,…,si​): the relative order of the first iii arrivals and their signals, not the ranks themselves. A policy qqq assigns to every round iii and every information value a stopping probability in [0,1][0,1][0,1]. The policy stops at iii with probability qi∏j<i(1−qj)q_i\prod_{j<i}(1-q_j)qi​∏j<i​(1−qj​), and its winning probability is the probability that it stops at some iii with ri=nr_i=nri​=n.

The best-so-far event is Ti={ri≥rj ∀j<i}T_i=\{r_i\ge r_j\ \forall j<i\}Ti​={ri​≥rj​ ∀j<i}. A policy is memoryless if its stopping probability at round iii depends only on iii, on whether TiT_iTi​ holds, and on sis_isi​.

Two properties of P\mathbb PP are assumed. Non-Filtering (NF): for j<ij<ij<i, the conditional law of (⪯1..j,s1,…,sj)(\preceq_{1..j},s_1,\dots,s_j)(⪯1..j​,s1​,…,sj​) given (Tj,sj)(T_j,s_j)(Tj​,sj​) is unchanged by additionally conditioning on (Ti,si)(T_i,s_i)(Ti​,si​). History-Irrelevance (HI): conditioned on (Ti,si)(T_i,s_i)(Ti​,si​), the information at round iii is independent of the event ri=nr_i=nri​=n.

For i∈[n]i\in[n]i∈[n], s,s′∈Ss,s'\in\mathcal Ss,s′∈S and j<ij<ij<i let a(i,s)=P[ri=n, si=s]a(i,s)=\mathbb P[r_i=n,\,s_i=s]a(i,s)=P[ri​=n,si​=s] and c(i,s,j,s′)=P[Tj, sj=s′∣Ti, si=s]c(i,s,j,s')=\mathbb P[T_j,\,s_j=s'\mid T_i,\,s_i=s]c(i,s,j,s′)=P[Tj​,sj​=s′∣Ti​,si​=s]. The LP of §3 has variables z(i,s)≥0z(i,s)\ge0z(i,s)≥0, constraint

z(i,s)≤1−∑j<i∑s′∈Sz(j,s′) c(i,s,j,s′),(4)z(i,s)\le 1-\sum_{j<i}\sum_{s'\in\mathcal S}z(j,s')\,c(i,s,j,s'),\tag{4}z(i,s)≤1−j<i∑​s′∈S∑​z(j,s′)c(i,s,j,s′),(4)

and objective Obj=∑i∑sz(i,s) a(i,s)\mathsf{Obj}=\sum_i\sum_s z(i,s)\,a(i,s)Obj=∑i​∑s​z(i,s)a(i,s) (5).

Formalization targets

Goal: Theorem 8

If P\mathbb PP satisfies NF and HI, then there is a memoryless policy mmm with

P[m wins] ≥ P[q wins]for every policy q.\mathbb P[m\text{ wins}]\ \ge\ \mathbb P[q\text{ wins}]\qquad\text{for every policy } q.P[m wins] ≥ P[q wins]for every policy q.

Milestones

  1. Best-so-far reduction (§2, p. 6): every policy is dominated by one that stops only on best-so-far rounds.
  2. Equation (2) (p. 8): under HI, P[ri=n∣≺1..i,s1,…,si]=P[ri=n∣Ti,si]\mathbb P[r_i=n\mid\prec_{1..i},s_1,\dots,s_i]=\mathbb P[r_i=n\mid T_i,s_i]P[ri​=n∣≺1..i​,s1​,…,si​]=P[ri​=n∣Ti​,si​].
  3. Equation (3) (p. 9): under HI, P[X∣si,ri=n]=P[X∣Ti,si]\mathbb P[X\mid s_i,r_i=n]=\mathbb P[X\mid T_i,s_i]P[X∣si​,ri​=n]=P[X∣Ti​,si​] for every event XXX of the round-iii information.
  4. Proposition 9 (p. 10): under NF and HI, every policy yields z≥0z\ge0z≥0 satisfying (4) whose objective (5) is its winning probability.
  5. Reconstruction claim (proof of Proposition 10, p. 11): for feasible zzz, the policy (6) satisfies P[i is picked∣Ti,si=s]=z(i,s)\mathbb P[i\text{ is picked}\mid T_i,s_i=s]=z(i,s)P[i is picked∣Ti​,si​=s]=z(i,s).
  6. Proposition 10 (p. 10): under NF and HI, every feasible zzz is realized by a memoryless policy with winning probability Obj\mathsf{Obj}Obj.

Significance

Theorem 8 reduces the search for an optimal policy from functions of the entire history, whose number grows exponentially in nnn, to n⋅2⋅∣S∣n\cdot 2\cdot|\mathcal S|n⋅2⋅∣S∣ numbers, and with Propositions 9 and 10 it turns the problem into a linear program of polynomial size. The later sections of the paper build on it: threshold policies (§4), secretaries with samples (§5) and binary-classifier advice (§6) are all analysed through this LP. The examples satisfying NF and HI include the classical problem, the full-information problem, samples, and noisy classifier advice.

The paper gives a complete proof. As far as is known, none of it has been machine-checked, and Prove2Me has no formal model of secretary problems with advice. A formal development makes precise the parts the paper's argument leaves informal: the handling of conditioning on null events, of randomized policies, and of the existence of an optimum.

Difficulty

The obvious argument replaces a general policy by its conditional stopping probability given (Ti,si)(T_i,s_i)(Ti​,si​). This fails directly: the probability of reaching round iii depends on the whole history, so averaging the decision at round iii changes the distribution of the earlier stopping events, and the winning probability with it. The paper therefore goes through the LP. The variables z(i,s)z(i,s)z(i,s) summarize a policy, NF is what makes constraint (4) depend only on the distribution and not on the policy, and HI is what makes the objective linear in zzz. The reverse direction, Proposition 10, rebuilds a policy from zzz through an induction over rounds in which the survival probability must be tracked exactly.

Formalization scope

  • Finite outcome space. Secretaries and ranks are Fin n, 0-based: Lean secretary iii is the paper's i+1i+1i+1, and Lean rank n−1n-1n−1 is the paper's top rank nnn. The signal space SSS is a finite type, so every probability is a finite sum. Continuous signals (the paper's Example 2, S=R\mathcal S=\mathbb RS=R) and the non-NF Example 11 are out of scope. Ties are allowed, as in §2.
  • Information and policies. The information at round iii is the comparison table ra≤rbr_a\le r_bra​≤rb​ for a,b≤ia,b\le ia,b≤i together with the signals s0,…,sis_0,\dots,s_is0​,…,si​. A policy is a function of this information only and never sees the outcome. Policies are randomized, with values in [0,1][0,1][0,1]; the competitors in Theorem 8 range over all of them.
  • Conditioning. NF, HI, (2), (3) and the reconstruction claim are written cross-multiplied, so a null conditioning event imposes nothing. c(i,s,j,s′)c(i,s,j,s')c(i,s,j,s′) is a quotient that Lean sets to 000 when P[Ti,si=s]=0\mathbb P[T_i,s_i=s]=0P[Ti​,si​=s]=0; there a(i,s)=0a(i,s)=0a(i,s)=0, so the objective is unaffected.
  • Optimality is stated as existence of a valid memoryless policy that beats every valid policy, not as a supremum. The paper presupposes that an optimum exists; with SSS finite it does.
  • Departures from the page. Proposition 10 additionally asserts that the realizing policy is memoryless; this is the proof of Theorem 8's own observation about the policy (6). Proposition 9 is stated for every policy, as printed.
  • Not trivial. A Memoryless predicate that allowed dependence on the whole information, or a winning probability without the survival product, would make the goal empty. Neither is used here: a memoryless policy is a function of (i,1Ti,si)(i,\mathbf 1_{T_i},s_i)(i,1Ti​​,si​) only, and the winning probability includes ∏j<i(1−qj)\prod_{j<i}(1-q_j)∏j<i​(1−qj​).
  • Welcome contributions. Lemmas on the finite probability calculus (prob, expectOn, cross-multiplied conditioning) and the identity ∏j<i(1−qj)=1−∑j<iqj∏k<j(1−qk)\prod_{j<i}(1-q_j)=1-\sum_{j<i}q_j\prod_{k<j}(1-q_k)∏j<i​(1−qj​)=1−∑j<i​qj​∏k<j​(1−qk​) are reusable well beyond this mission. Proving the milestones in the order listed follows the paper's proof. The running time of the LP and the paper's plots are out of scope.

Selected references

  • P. Dütting, S. Lattanzi, R. Paes Leme, S. Vassilvitskii, Secretaries with Advice, arXiv:2011.06726v1, 2020; Mathematics of Operations Research, 2024. https://arxiv.org/abs/2011.06726
  • E. B. Dynkin, The optimum choice of the instant for stopping a Markov process, Soviet Mathematics Doklady 4, 1963.
  • J. P. Gilbert, F. Mosteller, Recognizing the maximum of a sequence, Journal of the American Statistical Association 61, 1966. https://doi.org/10.1080/01621459.1966.10502008
  • N. Buchbinder, K. Jain, M. Singh, Secretary problems via linear programming, Mathematics of Operations Research 39(1), 2014. https://doi.org/10.1287/moor.2013.0604
9 thms1 active userReviewed
Linear OptimizationOperations Research·Captain: mikedeng1

Secretaries with Advice 4: With Advice from a Binary Classifier, a Threshold Policy Is OptimalResearch Paper

Why binary advice matters

The classical secretary problem asks a decision maker to choose the best of nnn candidates arriving in random order. A decision must be made when each candidate arrives, before later candidates are seen. In the classical model the decision maker sees only comparisons with earlier candidates. In hiring and selection, a prediction system may also classify an arriving candidate as promising or unpromising. The question is then whether the entire history of comparisons and predictions must be retained to make an optimal decision. Dütting, Lattanzi, Paes Leme, and Vassilvitskii study this question for several advice models in Secretaries with Advice. This mission concerns their binary-classifier model and the structural conclusion of Theorem 19: two signal-dependent time thresholds suffice.

The no-information secretary problem is a special case in which the signal says YYY and NNN with equal probability regardless of candidate quality. A separate classical cutoff-rule problem on Prove2Me addresses a deterministic rule for that special case; the present target covers informative and uninformative classifiers and compares with randomized policies that may use all observed history. The result is known mathematically in the cited paper. The task here is to give its probability model and the structural theorem precise, checkable statements in Lean.

Setting

There are n≥1n\geq1n≥1 candidates. Their ranks are a uniformly random permutation of {1,…,n}\{1,\ldots,n\}{1,…,n}, with rank nnn uniquely best. At round iii, the decision maker learns how candidate iii compares with all earlier candidates and receives a binary signal si∈{Y,N}s_i\in\{Y,N\}si​∈{Y,N}. The classifier has recall ppp: the best candidate receives YYY with probability ppp. It has specificity p′p'p′: every other candidate receives NNN with probability p′p'p′. Both parameters lie in [1/2,1][1/2,1][1/2,1]. Conditional on the ranks, signals across candidates are independent, as used by the paper's calculation of the signal-history distribution in Example 5 and Section 2.2. The decision maker never observes absolute ranks.

A policy assigns a stopping probability between zero and one to every possible information state at every round. Its information consists of all relative comparisons among candidates seen so far and all signals seen so far. Once it stops, it cannot act again. It wins if it stops at the unique candidate of rank nnn. The winning probability therefore includes the probability of continuing through all earlier rounds. A candidate is best so far when its rank is at least that of every previously seen candidate.

A threshold policy chooses two rounds tY,tN∈{1,…,n}t_Y,t_N\in\{1,\ldots,n\}tY​,tN​∈{1,…,n}. It accepts the first best-so-far candidate arriving at or after tYt_YtY​ if the current signal is YYY, or at or after tNt_NtN​ if it is NNN. A policy can finish without selecting anyone; that outcome loses. Thresholds govern when a signal becomes acceptable, while the best-so-far condition still depends on the observed comparisons.

Formalization targets

The goal is Theorem 19. For every positive nnn and every p,p′∈[1/2,1]p,p'\in[1/2,1]p,p′∈[1/2,1], there are thresholds tY,tNt_Y,t_NtY​,tN​ such that, for every valid randomized history-dependent policy qqq,

\Pr(\text{win under }q) \leq \Pr(\text{win under threshold}$t_Y,t_N$).

The thresholds are chosen once for the model, before the competing policy qqq. Their order is not constrained by this theorem. The later asymptotic result, Theorem 20, studies the positions and relative order of thresholds and belongs to a separate mission.

The supporting targets follow the paper's route to this conclusion. Section 2.2 computes the chance that the current candidate is globally best after an observed information state. Section 6 identifies the binary model's factor-revealing linear program. Appendix C asserts that its backward-defined dual vector is monotone in time and optimal among dual-feasible vectors. Proposition 12 converts those dual properties into an optimal threshold policy. Each statement concerns the same (n,p,p′)(n,p,p')(n,p,p′) model fixed above.

What the result supplies

The theorem reduces an optimization over policies that can use every past comparison and signal to a search over two time thresholds. It says that remembering the earlier signals and relative-order pattern cannot increase the achievable chance of selecting the best candidate once the two thresholds are chosen. This is a structural result about policy form; it does not give the numerical values of the best thresholds or their large-nnn performance. The paper treats those questions separately in Theorem 20.

A formal development would also give reusable finite objects: a joint rank-and-signal probability model, the information available to an online policy, an exact winning-probability expression, and the primal and dual programs for binary advice. The target theorems in this proposal are open Lean statements with sorry; compilation checks their types, not their proofs. The paper supplies mathematical arguments, while the machine-checked proofs remain work for solvers. The local published uniform-average definition for rank permutations is relevant prior art, but this model uses its own weighted outcome sum because it also averages over the dependent signal law.

Where the difficulty lies

The available history is much larger than a pair of thresholds: it includes all earlier classifier outputs and the complete relative order observed so far. A direct comparison of a given policy with a threshold policy must account for the chance that the policy would already have stopped at an earlier round. Simply comparing the current stopping probabilities does not preserve the winning probability. The paper organizes those reach probabilities through a finite linear program and examines a dual vector defined backward from the last round. The remaining difficulty is to connect the properties of that vector to a policy with the claimed stopping behavior, including parameter values where some constraints are tight at equality.

Formalization scope

Lean uses Fin n for rounds and ranks. Its index zero is the paper's round one; formulas containing (1/i) use a natural round number in {1,…,n}\{1,\ldots,n\}{1,…,n}. Bool.true represents YYY. Every rank order is a permutation, so there are no ties. Each outcome weight is (1/n!) times the product of the conditional signal likelihoods. All expectations and event masses are finite sums, and conditional-probability claims are stated by cross-multiplying event masses, including at information states of zero probability. The LP is indexed only by positive rounds, so its divisions by iii and nnn have the intended values.

The universal competitor in Theorem 19 is a randomized policy whose input contains only observed comparisons and signals. Its winning probability has an explicit product of continuation probabilities over earlier rounds. This restriction and product prevent the result from becoming trivial by allowing the policy to see the future, identify the global best rank, or stop more than once. The parameter interval and n≥1n\geq1n≥1 are explicit hypotheses. The printed conditional-probability fractions in Section 2.2 omit a factor of the current round iii; the formal milestone uses the corrected value and records the discrepancy. The classifier's ppp is recall as defined in Example 5, despite a later use of the word “precision” in Section 6.

The scope includes the finite probability model, its LP coefficients, the greedy dual vector, and the optimality bridge. Solvers can contribute proofs of the event identities, dual feasibility and optimality, and the threshold conclusion. Running-time claims for an LP algorithm, plots, and Theorem 20's asymptotic limit are outside this mission.

Selected references

  • Paul Dütting, Silvio Lattanzi, Renato Paes Leme, and Sergei Vassilvitskii, Secretaries with Advice, arXiv preprint arXiv:2011.06726v1, 2020; later published in Mathematics of Operations Research, 2024. Pinned preprint.
7 thms1 active userReviewed
Bandit AlgorithmsOperations ResearchStatistics·Captain: mikedeng1

Balancing Optimal Large Deviations in Ranking and Selection: The BOLD Allocation Learns the Large Deviations Optimality Conditions With Probability OneResearch Paper

Motivation

Ranking and selection asks which of MMM simulated alternatives has the largest mean, when each simulation run returns one noisy sample and the simulation budget is limited. A large literature allocates the budget using the large-deviations analysis of Glynn and Juneja (2004): for a static allocation in which alternative xxx receives a fixed fraction αx\alpha_xαx​ of the samples, the probability of incorrect selection decays exponentially, and the allocation that maximizes the decay rate is characterized by a system of nonlinear optimality conditions. Those conditions depend on the unknown means, so practical procedures plug in estimates and solve the system repeatedly, which is costly and comes with few guarantees.

Chen and Ryzhov (Proc. 2019 Winter Simulation Conference) propose Balancing Optimal Large Deviations (BOLD), a sequential rule that never solves the optimality conditions: at each step it evaluates the two sides of one condition at plug-in estimates and samples whichever alternative appears to be falling behind. It has no tuning parameters and applies to any sampling distribution whose rate function can be evaluated. The paper states that BOLD learns the optimality conditions with probability 1; the full proofs are in the companion article (Chen and Ryzhov, Management Science, 2023).

Setting

There are M>2M > 2M>2 alternatives with distinct means μ1,…,μM\mu_1,\dots,\mu_Mμ1​,…,μM​; the best is x∗=arg⁡max⁡xμxx^* = \arg\max_x \mu_xx∗=argmaxx​μx​. Alternative xxx produces independent samples from a law FxF_xFx​ with mean μx\mu_xμx​, a member of a distributional family {Fx(θ)}\{F_x(\theta)\}{Fx​(θ)} indexed by its mean θ\thetaθ. The families may differ between alternatives.

The rate function of the member with mean θ\thetaθ is the Fenchel–Legendre transform of its log-moment generating function,

Ix(u;θ)=sup⁡γ(γu−log⁡E eγW),W∼Fx(θ),I_x(u;\theta) = \sup_{\gamma}\big(\gamma u - \log \mathbb E\,e^{\gamma W}\big),\qquad W \sim F_x(\theta),Ix​(u;θ)=γsup​(γu−logEeγW),W∼Fx​(θ),

with values in [0,∞][0,\infty][0,∞], and Dx(u;θ)=∂Ix(u;θ)/∂uD_x(u;\theta) = \partial I_x(u;\theta)/\partial uDx​(u;θ)=∂Ix​(u;θ)/∂u. For a normal law with variance λx2\lambda_x^2λx2​, Ix(u;θ)=(u−θ)2/(2λx2)I_x(u;\theta) = (u-\theta)^2/(2\lambda_x^2)Ix​(u;θ)=(u−θ)2/(2λx2​).

An allocation chooses alternative xnx^nxn at stage n=0,1,…n = 0,1,\dotsn=0,1,…. Write NxnN^n_xNxn​ for the number of samples of xxx among stages 0,…,n−10,\dots,n-10,…,n−1 and θxn\theta^n_xθxn​ for their mean (an arbitrary θx0\theta^0_xθx0​ while Nxn=0N^n_x = 0Nxn​=0). The plug-in rate is Ixn(⋅)=Ix(⋅;θxn)I^n_x(\cdot) = I_x(\cdot;\theta^n_x)Ixn​(⋅)=Ix​(⋅;θxn​), likewise DxnD^n_xDxn​. For x≠yx \ne yx=y, ux,ynu^n_{x,y}ux,yn​ is the solution of

NxnDxn(u)+NynDyn(u)=0(10)N^n_x D^n_x(u) + N^n_y D^n_y(u) = 0 \qquad (10)Nxn​Dxn​(u)+Nyn​Dyn​(u)=0(10)

and Γx,yn=NxnIxn(ux,yn)+NynIyn(ux,yn)\Gamma^n_{x,y} = N^n_x I^n_x(u^n_{x,y}) + N^n_y I^n_y(u^n_{x,y})Γx,yn​=Nxn​Ixn​(ux,yn​)+Nyn​Iyn​(ux,yn​) (11).

BOLD (Figure 1 of the paper): let x∗,nx^{*,n}x∗,n be the leader, an alternative with the largest θxn\theta^n_xθxn​. If the leader is not unique, sample the tied leader with the fewest samples. Otherwise sample the leader if

∑x≠x∗,nIx∗,nn(ux∗,n,xn)Ixn(ux∗,n,xn)>1,(12)\sum_{x\ne x^{*,n}} \frac{I^n_{x^{*,n}}(u^n_{x^{*,n},x})}{I^n_x(u^n_{x^{*,n},x})} > 1, \qquad (12)x=x∗,n∑​Ixn​(ux∗,n,xn​)Ix∗,nn​(ux∗,n,xn​)​>1,(12)

and if not, sample the x≠x∗,nx \ne x^{*,n}x=x∗,n minimizing Γx∗,n,xn\Gamma^n_{x^{*,n},x}Γx∗,n,xn​ (13). Remaining ties are broken arbitrarily.

Formalization targets

Goal: BOLD learns the optimality conditions

Under Assumptions 1–4 of the paper, with probability 1,

lim⁡n→∞∑x≠x∗Ix∗n(ux∗,xn)Ixn(ux∗,xn)=1andlim⁡n→∞Γx∗,ynΓx∗,zn=1  for all y,z≠x∗.\lim_{n\to\infty}\sum_{x\ne x^*}\frac{I^n_{x^*}(u^n_{x^*,x})}{I^n_x(u^n_{x^*,x})} = 1 \quad\text{and}\quad \lim_{n\to\infty}\frac{\Gamma^n_{x^*,y}}{\Gamma^n_{x^*,z}} = 1 \ \text{ for all } y,z\ne x^*.n→∞lim​x=x∗∑​Ixn​(ux∗,xn​)Ix∗n​(ux∗,xn​)​=1andn→∞lim​Γx∗,zn​Γx∗,yn​​=1  for all y,z=x∗.

These are the plug-in forms of the total balance condition (5) and the individual balance conditions (6), which together characterize the optimal static allocation. The paper states them as Theorems 3 and 4; the goal is their conjunction.

Milestones

  1. Theorem 1 (consistency). Under Assumptions 1–3, Nxn→∞N^n_x \to \inftyNxn​→∞ for every xxx, almost surely.
  2. Theorem 2. Under Assumptions 1–3, lim sup⁡nNxn/Nyn<∞\limsup_n N^n_x/N^n_y < \inftylimsupn​Nxn​/Nyn​<∞ for all x,yx, yx,y, almost surely.
  3. Theorem 3. The total balance limit above.
  4. Theorem 4. The individual balance limit above.

Significance

The result. Convergence of BOLD to the optimality conditions shows that the static optimum of Glynn and Juneja can be learned by a cheap sequential rule without knowing the proportion of the budget the best alternative should receive. Top-two methods require that proportion as an input. The paper claims the guarantee for any sampling distributions satisfying four regularity assumptions, not only normal ones. As the paper notes, convergence to the static optimum does not by itself transfer the static exponential rate to the adaptive procedure; the result concerns learning the conditions.

The formalization. The WSC paper gives proof outlines only, and the complete argument lives in a long journal article. No part of it has been machine-checked. A formal proof would check a strong-law argument for an adaptive procedure with two interleaved decision criteria and would yield a reusable formal model of sequential sampling for ranking and selection with general rate functions.

Difficulty

The obvious argument is "sample means converge, hence the plug-in conditions converge". It fails because the sample means converge only if every alternative is sampled infinitely often, and BOLD gives no forced exploration: an alternative is sampled only when (12) or (13) selects it. Consistency must therefore come from the structure of the rule itself. Even with consistency, the limits in Theorems 3–4 are not continuity statements: the plug-in quantities depend on the sample sizes as well as the sample means, and they oscillate around the level 1 as (12) alternately holds and fails, so convergence requires quantitative control of how long the rule can neglect any one alternative. Discrete sampling laws add ties among sample means and a sample mean that can coincide with another alternative's true mean (Assumption 3).

Formalization scope

  • Model. Alternatives are Fin M with 2 < M (indexed from 0). The family is Fam : Fin M → ℝ → Measure ℝ of probability measures, with true law Fam x (μ x). Samples form an observation array W x k (the (k+1)(k+1)(k+1)-th sample of xxx), mutually independent, with W x k ∼ Fam x (μ x); this gives the same law of the sample path as the paper's sequential sampling.
  • Rate function. Ix(u;θ)I_x(u;\theta)Ix​(u;θ) is the extended-real Legendre transform of the extended-real log-MGF, from the published BellWilliams2001.ThresholdPolicy.LargeDeviation, so +∞+\infty+∞ is a genuine value. DxD_xDx​ is the derivative of its real part. Conditions on DxD_xDx​ are imposed on the effective domain Dx\mathcal D_xDx​, where IxI_xIx​ is finite nearby.
  • Parameter space. For each xxx there is an open interval Θx⊇Hx\Theta_x \supseteq H_xΘx​⊇Hx​ that contains the samples almost surely, on which Fx(θ)F_x(\theta)Fx​(θ) has mean θ\thetaθ and Ix(⋅;θ)I_x(\cdot;\theta)Ix​(⋅;θ) is finite between any two parameters. The initial means lie in Θx\Theta_xΘx​. These conditions are not printed, but without them the plug-in rule can starve an alternative forever: a law with Ix(⋅;θ)=+∞I_x(\cdot;\theta) = +\inftyIx​(⋅;θ)=+∞ off one point gives Γ=+∞\Gamma = +\inftyΓ=+∞. Bernoulli laws, whose sample means reach 000 or 111, fall outside this convention, although the paper says they are covered.
  • Assumptions. The interval HHH of Assumptions 1–2 is one fixed interval Hx=[ax,bx]H_x = [a_x,b_x]Hx​=[ax​,bx​] per alternative with μx\mu_xμx​ in its interior. Assumption 3 is written without division. Assumption 4 is joint C1C^1C1 on Dx\mathcal D_xDx​.
  • Algorithm. BOLD is a predicate IsBOLD on allocation sequences, so every tie-breaking rule is covered. The initial means θ0\theta^0θ0 are arbitrary. The solution of (10) is a chosen solution between the two sample means; its uniqueness is the paper's claim, not a hypothesis.
  • Conventions. Ratios and Γ\GammaΓ are in [0,∞][0,\infty][0,∞], with a/0=∞a/0 = \inftya/0=∞ for a>0a > 0a>0, so a never-sampled leader triggers (12) as in the paper. Theorem 2's limsup is taken in [0,∞][0,\infty][0,∞]. Every theorem is an almost-sure statement, with "probability 1" taken from §4.
  • Ruled out. The theorems are not vacuous: a BOLD run exists on every realization (a local check proves this). The rate function is the Legendre transform of the actual family, not an unconstrained function. The family is not fixed to the normal or any single parametric case.

The development needs strong laws of large numbers along adaptively chosen sample counts, properties of Legendre transforms of log-moment generating functions (convexity, a unique zero at the mean), and law-of-the-iterated-logarithm-type rates for sample means. Lemmas on Legendre transforms of log-MGFs and the observation-array model are reusable for other large-deviations allocation rules. Contributions toward any milestone are welcome. Statements specialized to normal families are not substitutes for the general milestones.

Selected references

  • Y. Chen and I. O. Ryzhov, Balancing Optimal Large Deviations in Ranking and Selection, Proc. 2019 Winter Simulation Conference, pp. 3368–3379, IEEE.
  • Y. Chen and I. O. Ryzhov, Balancing Optimal Large Deviations in Sequential Selection, Management Science, 2023. https://doi.org/10.1287/mnsc.2022.4527
  • P. Glynn and S. Juneja, A Large Deviations Perspective on Ordinal Optimization, Proc. 2004 Winter Simulation Conference, pp. 577–585, IEEE.
  • A. Dembo and O. Zeitouni, Large Deviations Techniques and Applications, 2nd ed., Springer, 2009. https://doi.org/10.1007/978-3-642-03311-7
9 thms1 active userReviewed
Linear OptimizationOperations Research·Captain: mikedeng1

Secretaries with Advice 2: With k Samples, a Threshold Policy Is Optimal for Selecting the Best of n SecretariesResearch Paper

Motivation

In the classical secretary problem, nnn candidates with distinct qualities arrive in uniformly random order; after each arrival one sees only how the current candidate compares with those already seen, and must irrevocably accept or reject. The goal is to accept the best candidate. Dynkin's rule (skip roughly n/en/en/e candidates, then accept the first one better than all before it) succeeds with probability about 1/e1/e1/e, and nothing does better.

A natural question in online decision-making with data is how much prior samples help. Kaplan, Naori and Raz (SODA 2020) introduced a model in which an adversary writes down n+kn+kn+k numbers, a uniformly random kkk of them are revealed in advance as samples, and the remaining nnn arrive online in random order. Correa et al. (SODA 2021) studied the probability of selecting the maximum in a related independent-sampling model. Dütting, Lattanzi, Paes Leme and Vassilvitskii (arXiv:2011.06726, Mathematics of Operations Research 2024) place this model inside a general framework of secretaries with advice, where each arrival carries a signal, and prove that with kkk samples the optimal policy has a simple threshold form.

Timeline:

  • 1963: Dynkin, optimal rule for the classical problem (the case k=0k=0k=0).
  • 1966: Gilbert and Mosteller (JASA), full-information variants and threshold rules depending on the observed value.
  • 2014: Buchbinder, Jain and Singh (Math. Oper. Res.), a linear program whose value is the optimal success probability of secretary problems.
  • 2020: Kaplan, Naori and Raz, the sample model used here; Dütting et al., Theorem 16: threshold policies are optimal for every nnn and kkk.

Setting

Fix integers n≥1n\ge1n≥1 and k≥0k\ge0k≥0. Only the relative order of the n+kn+kn+k numbers matters, so an outcome is a uniformly random permutation σ\sigmaσ of k+nk+nk+n positions, read as position ↦\mapsto↦ value rank. The first kkk positions are the samples; position k+ik+ik+i holds the secretary of round iii.

  • The signal si∈S={0,1,…,k}s_i\in\mathcal S=\{0,1,\dots,k\}si​∈S={0,1,…,k} is the number of samples worse than secretary iii.
  • The best-so-far event TiT_iTi​ says that secretary iii beats every earlier secretary.
  • The event ri=nr_i=nri​=n says that secretary iii is the best of the nnn secretaries (samples do not count).
  • The information at round iii is the relative order of the samples and secretaries 1,…,i1,\dots,i1,…,i.
  • A policy qqq gives, in each round, a stopping probability qi(x)∈[0,1]q_i(x)\in[0,1]qi​(x)∈[0,1] that is a function of the information xxx only. Its winning probability is
win(q)=E[∑i=1n1[ri=n] qi(xi)∏j<i(1−qj(xj))].\mathrm{win}(q)=\mathbb E\Big[\sum_{i=1}^n \mathbf 1[r_i=n]\,q_i(x_i)\prod_{j<i}\big(1-q_j(x_j)\big)\Big].win(q)=E[i=1∑n​1[ri​=n]qi​(xi​)j<i∏​(1−qj​(xj​))].
  • A threshold policy is given by t:S→[n]t:\mathcal S\to[n]t:S→[n]: stop at τ=min⁡{i:Ti and i≥t(si)}\tau=\min\{i: T_i \text{ and } i\ge t(s_i)\}τ=min{i:Ti​ and i≥t(si​)}.

The proof passes through a linear program with variables z(i,s)z(i,s)z(i,s) and coefficients

a(i,s)=1k+1∏t=1n−1s+tk+t+1,c(i,s,j,s′)=1s+1∏t=1j−1s′+ts+t+1  (s′≤s),a(i,s)=\frac{1}{k+1}\prod_{t=1}^{n-1}\frac{s+t}{k+t+1},\qquad c(i,s,j,s')=\frac{1}{s+1}\prod_{t=1}^{j-1}\frac{s'+t}{s+t+1}\ \ (s'\le s),a(i,s)=k+11​t=1∏n−1​k+t+1s+t​,c(i,s,j,s′)=s+11​t=1∏j−1​s+t+1s′+t​  (s′≤s),

its dual with variables u(i,s)u(i,s)u(i,s), and the greedy dual solution (8), computed backwards from u(n,s)=a(n,s)u(n,s)=a(n,s)u(n,s)=a(n,s).

Formalization targets

Goal: Theorem 16

∀n≥1, ∀k,∃ t:{0,…,k}→[n],∀q valid,win(q)≤win(τt).\forall n\ge1,\ \forall k,\quad \exists\, t:\{0,\dots,k\}\to[n],\quad \forall q\ \text{valid},\quad \mathrm{win}(q)\le \mathrm{win}(\tau_t).∀n≥1, ∀k,∃t:{0,…,k}→[n],∀q valid,win(q)≤win(τt​).

The goal asserts only the shape of the optimal policy, not the thresholds' values or the optimal winning probability. The milestones follow the paper's proof:

  1. The samples model satisfies Non-Filtering and History-Irrelevance (Definitions 6–7), and the LP coefficients aaa and ccc have the closed forms above (§5).
  2. Policies and LP solutions correspond (Propositions 9 and 10 for this model, together with the remark that only best-so-far stops matter).
  3. Lemma 15, a discrete integration identity for rising products.
  4. Claims (i) and (ii) of the proof of Theorem 16 about the perturbation Δ\DeltaΔ and its cumulative effect RiR_iRi​.
  5. The greedy dual solution is optimal and non-decreasing in iii.
  6. Proposition 12 for the samples LP: these two facts give a primal optimum of threshold shape.

Significance

The result. Theorem 16 reduces an optimal stopping problem over all history-dependent randomized policies, whose information is a full relative order of up to n+kn+kn+k items, to choosing k+1k+1k+1 integers. The greedy dual recursion computes them in polynomial time, which makes the optimal success probability computable for every nnn and kkk and underlies the numerical curves of the paper. For k=0k=0k=0 the theorem recovers the optimality of Dynkin-type cutoff rules.

Formalizing it. The theorem is proved in the paper (main text plus Appendix A), but no machine-checked version exists. A formalization produces a verified LP characterization of a secretary problem with signals, a reusable discrete-integration lemma, and a checked instance of the general principle "greedy dual optimal and monotone implies threshold optimal". The classical special case is posed separately on the platform as the open item ClassicalSecretary.exists_optimal_cutoffRule (deterministic rank-only rules, k=0k=0k=0). This mission does not restate it.

Difficulty

The obvious approach is backward induction over information states: compute the value of continuing and compare it with the probability that the current secretary is best. The difficulty is that the information is a relative order of the samples and all secretaries seen so far, and showing that the stop region is an upper set in iii for each signal requires controlling continuation values across exponentially many states. The paper avoids this through a linear program. The hard steps are the exact probability computations behind aaa and ccc (and behind Non-Filtering and History-Irrelevance) and the optimality of the greedy dual. The perturbation argument for that optimality needs the closed form of Δ\DeltaΔ and a telescoping sum (Lemma 15). Monotonicity of the greedy solution does not follow from monotonicity of the coefficients alone, because the recursion subtracts a sum over later rounds.

Formalization scope

  • Outcomes are permutations Equiv.Perm (Fin (k + n)), read as position ↦ value rank, with the uniform distribution. Probabilities are finite counts divided by (k+n)!(k+n)!(k+n)!, never integrals. The adversary's numbers are taken distinct.
  • Rounds are 0-based in Lean (Fin n): Lean round iii is the paper's round i+1i+1i+1. The LP and its objects use 1-based natural indices i∈[1,n]i\in[1,n]i∈[1,n] and signals s∈{0,…,k}s\in\{0,\dots,k\}s∈{0,…,k}, as printed.
  • Information at round iii is the full table of comparisons among the first k+i+1k+i+1k+i+1 positions. Policies are typed on it, not on the outcome. A policy that could read the outcome could stop at the maximum and would trivialize the goal.
  • Policies are randomized (values in [0,1][0,1][0,1]) and history-dependent. Competitors are not restricted to deterministic or memoryless rules; the threshold function satisfies 1≤t(s)≤n1\le t(s)\le n1≤t(s)≤n.
  • Winning probability includes the survival product ∏j<i(1−qj)\prod_{j<i}(1-q_j)∏j<i​(1−qj​), so stopping happens at most once.
  • Conditional probabilities (Non-Filtering, History-Irrelevance, ccc) are stated cross-multiplied, so no quotient by a null probability occurs.
  • Disclosed additions: n≥1n\ge1n≥1 in Theorem 16 and Proposition 12; i∗≥2i^*\ge2i∗≥2 and δ≥0\delta\ge0δ≥0 in claim (ii); in Proposition 9, the policy stops only on best-so-far rounds, which the separate reduction item shows is without loss. Proposition 10 carries a second part: a threshold-shaped LP solution is achieved by the threshold policy itself.
  • Out of scope: the polynomial-time algorithm remark (p. 17), Figure 2, Corollary 18, and the explicit dual solution of Theorem 17, which is a separate mission of this series.
  • The definitions needed are elementary: permutations, finite sums and products, well-founded recursion for the greedy solution and for Δ\DeltaΔ. Lemma 15 and the LP-level claims are reusable beyond this mission. Contributions to any milestone are welcome. The LP-level milestones (Lemma 15, claims (i)–(ii), greedy optimality and monotonicity) do not depend on the probabilistic model.

Selected references

  • P. Dütting, S. Lattanzi, R. Paes Leme, S. Vassilvitskii, Secretaries with Advice, arXiv:2011.06726v1, 2020; Mathematics of Operations Research, 2024. https://arxiv.org/abs/2011.06726
  • H. Kaplan, D. Naori, D. Raz, Competitive Analysis with a Sample and the Secretary Problem, SODA 2020. https://arxiv.org/abs/1907.05350
  • J. Correa, A. Cristi, L. Feuilloley, T. Oosterwijk, A. Tsigonias-Dimitriadis, The Secretary Problem with Independent Sampling, SODA 2021. https://arxiv.org/abs/2011.07869
  • N. Buchbinder, K. Jain, M. Singh, Secretary Problems via Linear Programming, Mathematics of Operations Research 39(1):190–206, 2014. https://doi.org/10.1287/moor.2013.0604
  • J. P. Gilbert, F. Mosteller, Recognizing the Maximum of a Sequence, Journal of the American Statistical Association 61:35–73, 1966. https://doi.org/10.1080/01621459.1966.10502008
16 thms1 active userReviewed
Algorithmic Game TheoryConvex Optimization·Captain: mikedeng1

Persuading Risk-Conscious Agents: A Geometric Approach I: The Sender's Persuasion Problem Is Solved by a Convex Program over Conv(P_a ∪ {0})Research Paper

Motivation

Bayesian persuasion studies a sender who observes a state of the world and commits in advance to a randomized disclosure rule, in order to influence the action of a receiver who updates her belief by Bayes' rule. Since Kamenica and Gentzkow (2011) the model has been applied to platform design, recommendation systems, queue information and rating systems. Almost all of this theory assumes the receiver is an expected-utility maximizer, so that her payoff from each action is linear in her belief.

Many receivers are not. A customer who joins a queue only if the mean of her waiting time plus a multiple of its standard deviation is below a threshold has a utility that is nonlinear in her belief. Anunrojwong, Iyer and Lingenbrink (2023) call such receivers risk-conscious and show that, for them, the standard revelation-principle reduction to action recommendations fails. Their first main result replaces it with a convex program over the joint distribution of state and action. This mission formalizes that result and the lemmas leading to it.

Setting

Let Ω\OmegaΩ be a finite set of states and Δ(Ω)⊆RΩ\Delta(\Omega) \subseteq \mathbb{R}^{\Omega}Δ(Ω)⊆RΩ the simplex of beliefs, with the Euclidean topology. Sender and receiver share a prior μ∗∈Δ(Ω)\mu^* \in \Delta(\Omega)μ∗∈Δ(Ω). The receiver chooses an action from a finite nonempty set AAA. Her utility is an arbitrary function ρ:Δ(Ω)×A→R\rho : \Delta(\Omega) \times A \to \mathbb{R}ρ:Δ(Ω)×A→R; the sender's utility is v:Ω×A→Rv : \Omega \times A \to \mathbb{R}v:Ω×A→R.

For each action aaa, the beliefs at which aaa is optimal for the receiver form the set

Pa={μ∈Δ(Ω):a∈arg⁡max⁡a′∈Aρ(μ,a′)}.P_a = \{\mu \in \Delta(\Omega) : a \in \arg\max_{a' \in A} \rho(\mu, a')\}.Pa​={μ∈Δ(Ω):a∈arga′∈Amax​ρ(μ,a′)}.

The paper assumes throughout (Assumption 1) that every PaP_aPa​ is closed.

A signaling scheme consists of a measurable signal space SSS and a probability measure π\piπ on Ω×S\Omega \times SΩ×S whose Ω\OmegaΩ-marginal is μ∗\mu^*μ∗. After signal sss the receiver holds the posterior μs∈Δ(Ω)\mu_s \in \Delta(\Omega)μs​∈Δ(Ω) given by Bayes' rule, and plays an optimal strategy a(⋅)a(\cdot)a(⋅), with a(s)∈arg⁡max⁡aρ(μs,a)a(s) \in \arg\max_a \rho(\mu_s, a)a(s)∈argmaxa​ρ(μs​,a), that is μs∈Pa(s)\mu_s \in P_{a(s)}μs​∈Pa(s)​. The sender's persuasion problem (3) is to maximize Eπ[v(ωˉ,a(sˉ))]\mathbb{E}_\pi[v(\bar\omega, a(\bar s))]Eπ​[v(ωˉ,a(sˉ))] over signal spaces, schemes and optimal receiver strategies; when the receiver is indifferent, the sender picks the strategy she prefers.

A probability measure η\etaη on Δ(Ω)\Delta(\Omega)Δ(Ω) is Bayes-plausible if its mean is the prior: Eη[sˉ]=μ∗\mathbb{E}_\eta[\bar s] = \mu^*Eη​[sˉ]=μ∗.

Formalization targets

Goal: Theorem 1

The sender's problem (3) can be optimized by solving the convex program

max⁡{ta:a∈A}∑ω∈Ω∑a∈Ata(ω) v(ω,a)s.t.∑a∈Ata(ω)=μ∗(ω) (ω∈Ω),ta∈Conv⁡(Pa∪{0}) (a∈A).(7)\max_{\{t_a : a \in A\}} \sum_{\omega \in \Omega} \sum_{a \in A} t_a(\omega)\, v(\omega,a) \quad \text{s.t.} \quad \sum_{a \in A} t_a(\omega) = \mu^*(\omega)\ (\omega \in \Omega), \qquad t_a \in \operatorname{Conv}(P_a \cup \{0\})\ (a \in A). \qquad (7){ta​:a∈A}max​ω∈Ω∑​a∈A∑​ta​(ω)v(ω,a)s.t.a∈A∑​ta​(ω)=μ∗(ω) (ω∈Ω),ta​∈Conv(Pa​∪{0}) (a∈A).(7)

It is formalized as an equality of sets: the values achievable in (3) are exactly the objective values of feasible points of (7). This says that every scheme yields a feasible point of (7) with the same value, and every feasible point is realized by a scheme. In particular the supremum of (3) equals the maximum of (7), and an optimal solution of (7) gives an optimal scheme.

Milestones

  1. Lemma 1 (Aumann–Maschler, Kamenica–Gentzkow): schemes whose signals are beliefs and satisfy μs=s\mu_s = sμs​=s correspond to Bayes-plausible measures.
  2. Lemma 5: the belief-recommendation problem (4) is equivalent to problem (14) over Bayes-plausible measures.
  3. Lemma 2: a Bayes-plausible measure and an optimal strategy give action probabilities ba∈[0,1]b_a \in [0,1]ba​∈[0,1] and mean-posteriors ma∈Conv⁡(Pa)m_a \in \operatorname{Conv}(P_a)ma​∈Conv(Pa​) with ∑abama=μ∗\sum_a b_a m_a = \mu^*∑a​ba​ma​=μ∗ and the same sender value; the converse also holds.

Further result: Theorem 2

Let Υa\Upsilon_aΥa​ be the states at which aaa is sender-optimal, assume these sets partition Ω\OmegaΩ, and set ta∗=μ∗1Υat^*_a = \mu^* \mathbb{1}_{\Upsilon_a}ta∗​=μ∗1Υa​​. Then the sender can fully persuade the receiver (almost surely, the receiver takes a sender-optimal action) if and only if t∗t^*t∗ is feasible for (7), i.e. ta∗∈Conv⁡(Pa∪{0})t^*_a \in \operatorname{Conv}(P_a \cup \{0\})ta∗​∈Conv(Pa​∪{0}) for all aaa.

Significance

The result. Problem (3) optimizes over arbitrary signal spaces and joint distributions, so it is not finite-dimensional. Program (7) has ∣A∣|A|∣A∣ vector variables in RΩ\mathbb{R}^{\Omega}RΩ, each in a convex set that depends only on the receiver's utility. Its variable ta(ω)t_a(\omega)ta​(ω) is the joint probability of state ω\omegaω and action aaa. The program gives the paper's bound on the number of signals needed (Proposition 1), its characterization of when persuasion helps (Proposition 2), the full-persuasion criterion (Theorem 2) and, after replacing Conv⁡(Pa∪{0})\operatorname{Conv}(P_a \cup \{0\})Conv(Pa​∪{0}) by a polytope, the linear program for binary persuasion (Theorem 3, the companion mission). For expected-utility receivers each PaP_aPa​ is convex, and (7) reduces to the familiar obedience-constrained linear program.

Formalizing it. The results are proved in the paper; none is formalized. A formal development fixes what "can be optimized by solving" means as a set equality and handles general measurable signal spaces with posteriors defined only almost everywhere. It also exposes two places where the printed lemmas need correction (see the scope section).

Difficulty

The usual revelation-principle shortcut would merge all signals that lead to the same action. For a risk-conscious receiver this can change the response: averaging posteriors in PaP_aPa​ can produce a belief outside PaP_aPa​, since PaP_aPa​ need not be convex. The central geometric difficulty is relating a distribution of posteriors supported on a closed, potentially nonconvex PaP_aPa​ to a finite-dimensional variable in Conv⁡(Pa∪{0})\operatorname{Conv}(P_a \cup \{0\})Conv(Pa​∪{0}). The converse must preserve both Bayes plausibility and receiver optimality. With general signal spaces, the posterior is determined only almost everywhere, while the stated strategy condition applies at every signal.

Formalization scope

  • Representation. Ω\OmegaΩ and AAA are Fintypes, AAA nonempty, and Ω\OmegaΩ carries a measurable space in which singletons are measurable. Beliefs are functions Ω→R\Omega \to \mathbb{R}Ω→R in stdSimplex ℝ Ω, Belief Ω is the simplex as a subtype, Conv⁡\operatorname{Conv}Conv is convexHull ℝ, and 000 is the zero function. ρ\rhoρ is a function on RΩ\mathbb{R}^{\Omega}RΩ, used only on the simplex.
  • Signal spaces in (3) range over all measurable types. A scheme is a probability measure on Ω×S\Omega \times SΩ×S with π({ω}×S)=μ∗(ω)\pi(\{\omega\} \times S) = \mu^*(\omega)π({ω}×S)=μ∗(ω).
  • Posteriors are any version of Bayes' rule: simplex-valued for every signal, measurable, and satisfying π({ω}×B)=∫Bμs(ω) πS(ds)\pi(\{\omega\} \times B) = \int_B \mu_s(\omega)\,\pi_S(ds)π({ω}×B)=∫B​μs​(ω)πS​(ds). Quotients π(ω,s)/∑ω′π(ω′,s)\pi(\omega,s)/\sum_{\omega'} \pi(\omega',s)π(ω,s)/∑ω′​π(ω′,s) with Lean's x/0=0x/0 = 0x/0=0 are not used. "μs=s\mu_s = sμs​=s" (Lemmas 1 and 5) means the identity is such a version, an almost-sure statement; the paper's "for all sss" in Lemma 1's converse is proved only almost surely.
  • Strategies are measurable (each event {a(sˉ)=b}\{a(\bar s) = b\}{a(sˉ)=b} is measurable) and optimal at every signal. The sender's value is not computed with a fixed tie-breaking rule, so sender-preferred selection is kept.
  • Assumption 1 is a hypothesis of every statement that involves ρ\rhoρ.
  • Corrections to Lemma 2. If some PaP_aPa​ is empty, Conv⁡(Pa)\operatorname{Conv}(P_a)Conv(Pa​) is empty and the printed forward direction fails, so mam_ama​ is left free there; then ba=0b_a = 0ba​=0 necessarily. The printed converse fails for pure strategies when two actions must share a posterior, so it is stated for optimal mixed strategies, which the paper allows on p. 11.
  • Ruled out: quantifying (3) only over belief signals with μs=s\mu_s = sμs​=s would turn Theorem 1 into Lemmas 5 and 2 and drop the coalescence step. The goal therefore quantifies over arbitrary signal spaces. Stating only "the optimal values are equal" through a real supremum would also be weaker, and is not done.
  • Infrastructure needed: means of probability measures on compact sets in Rn\mathbb{R}^nRn lying in the convex hull (Convex.integral_mem, compactness of convex hulls of compact sets), Carathéodory's theorem (convexHull_eq_union), finite discrete measures on Ω×S\Omega \times SΩ×S, and conditional densities with respect to the signal marginal. The Bayes-plausibility and splitting lemmas are reusable in any persuasion development. Proofs of the milestones, of the goal, and of Theorem 2 are all welcome.

Selected references

  • J. Anunrojwong, K. Iyer, D. Lingenbrink, Persuading Risk-Conscious Agents: A Geometric Approach, arXiv:2208.03758v3, 2023; Operations Research, 2024. https://arxiv.org/abs/2208.03758v3
  • E. Kamenica, M. Gentzkow, Bayesian Persuasion, American Economic Review 101(6), 2011. https://doi.org/10.1257/aer.101.6.2590
  • D. Bergemann, S. Morris, Bayes Correlated Equilibrium and the Comparison of Information Structures in Games, Theoretical Economics 11(2), 2016. https://doi.org/10.3982/TE1808
7 thms1 active userReviewed
EconomicsOperations ResearchStochastic Systems·Captain: mikedeng1

Providing Data Samples for Free: Free Samples Strictly Beat Selling in One Round When the Seller-Side Drift of the Buyer's Bayes Risk Is Initially PositiveResearch Paper

Why give data away

Firms that own data increasingly sell it as a product: market research panels, consulting reports, datasets for training demand models. A common commercial practice is to hand out a free sample of the data before quoting a price for the rest. Under standard Bayesian reasoning this practice looks self-defeating. Every free data point reduces the buyer's uncertainty, which reduces what the remaining data are worth to her. This is a holdup problem: once information is revealed, it cannot be sold.

Drakopoulos and Makhdoumi (Providing Data Samples for Free, SSRN 3611003; Management Science, 2022, doi:10.1287/mnsc.2022.4534) identify when free samples nevertheless raise the seller's revenue. The mechanism is disagreement about the prior. When the seller believes the buyer's initial estimate is biased, she expects the free data to move the buyer's belief toward states in which the buyer values the remaining data more. The paper calls this the persuasion benefit, and it can outweigh the holdup cost. This mission formalizes the paper's main theorem, Theorem 1(a), together with the lemmas its proof rests on.

The model

An unknown real parameter θ\thetaθ determines a buyer's payoff u(a,θ)u(a,\theta)u(a,θ) from an action a∈Ra\in\mathbb Ra∈R. The Buyer holds the prior N(θ0,σ02)\mathcal N(\theta_0,\sigma_0^2)N(θ0​,σ02​) with σ02>0\sigma_0^2>0σ02​>0. The Seller believes θ0\theta_0θ0​ is a biased estimate, with bias distributed as N(μb,σb2)\mathcal N(\mu_b,\sigma_b^2)N(μb​,σb2​) and σb2≥0\sigma_b^2\ge0σb2​≥0. Her prior is N(θ0+μb,σs2)\mathcal N(\theta_0+\mu_b,\sigma_s^2)N(θ0​+μb​,σs2​) with σs2=σ02+σb2\sigma_s^2=\sigma_0^2+\sigma_b^2σs2​=σ02​+σb2​, and it is taken to be the correct one.

Data arrive continuously. The first t≥0t\ge0t≥0 samples are equivalent to the signal

Yt=θt+σBt,Y_t=\theta t+\sigma B_t,Yt​=θt+σBt​,

where BBB is a standard Brownian motion independent of θ\thetaθ and σ2>0\sigma^2>0σ2>0 is the noise variance. Both parties agree on this law of the data given θ\thetaθ (they are concordant) and disagree only on the prior. The information after ttt samples is Ft=σ(Ys:s≤t)\mathcal F_t=\sigma(Y_s:s\le t)Ft​=σ(Ys​:s≤t).

The Buyer's posterior after ttt samples is N(θt,σt2)\mathcal N(\theta_t,\sigma_t^2)N(θt​,σt2​), with σt2=σ02σ2/(σ02t+σ2)\sigma_t^2=\sigma_0^2\sigma^2/(\sigma_0^2t+\sigma^2)σt2​=σ02​σ2/(σ02​t+σ2) and θt=(σt2/σ02)θ0+(σt2/σ2)Yt\theta_t=(\sigma_t^2/\sigma_0^2)\theta_0+(\sigma_t^2/\sigma^2)Y_tθt​=(σt2​/σ02​)θ0​+(σt2​/σ2)Yt​. The Seller's posterior N(θ~t,σ~t2)\mathcal N(\tilde\theta_t,\tilde\sigma_t^2)N(θ~t​,σ~t2​) is given by the same formulas from her own prior. The Seller's estimate of the Buyer's error is gt=θ~t−θtg_t=\tilde\theta_t-\theta_tgt​=θ~t​−θt​, and g0=μbg_0=\mu_bg0​=μb​.

With belief N(θ,v)\mathcal N(\theta,v)N(θ,v), the Buyer's best expected utility is U(θ,v)=max⁡aEN(θ,v)[u(a,⋅)]U(\theta,v)=\max_a\mathbb E_{\mathcal N(\theta,v)}[u(a,\cdot)]U(θ,v)=maxa​EN(θ,v)​[u(a,⋅)]. Her Bayes risk

BR(θ,v)=EN(θ,v)[max⁡au(a,⋅)]−U(θ,v)BR(\theta,v)=\mathbb E_{\mathcal N(\theta,v)}\big[\max_a u(a,\cdot)\big]-U(\theta,v)BR(θ,v)=EN(θ,v)​[amax​u(a,⋅)]−U(θ,v)

is the value to her of learning θ\thetaθ exactly. Its second argument is a variance, and BRθBR_\thetaBRθ​, BRθθBR_{\theta\theta}BRθθ​ and BRσ2BR_{\sigma^2}BRσ2​ denote its partial derivatives.

A free-sample policy gives data for free up to a stopping amount TTT, a stopping time of (Ft)(\mathcal F_t)(Ft​), and then sells the remainder. Once the free samples stop, the best price for the remainder is BR(θT,σT2)BR(\theta_T,\sigma_T^2)BR(θT​,σT2​) (Lemma 3). The Seller's expected revenue is therefore E0S[BR(θT,σT2)]\mathbb E^S_0[BR(\theta_T,\sigma_T^2)]E0S​[BR(θT​,σT2​)], computed under her prior. Selling in one round is T=0T=0T=0, with revenue BR(θ0,σ02)BR(\theta_0,\sigma_0^2)BR(θ0​,σ02​).

Formalization targets

Goal: Theorem 1(a)

If the Seller-side drift of the Bayes risk is positive at the start,

12BRθθ(θ0,σ02)−BRσ2(θ0,σ02)+μbσ02BRθ(θ0,σ02)>0,(4)\tfrac12 BR_{\theta\theta}(\theta_0,\sigma_0^2)-BR_{\sigma^2}(\theta_0,\sigma_0^2)+\frac{\mu_b}{\sigma_0^2}BR_\theta(\theta_0,\sigma_0^2)>0, \tag{4}21​BRθθ​(θ0​,σ02​)−BRσ2​(θ0​,σ02​)+σ02​μb​​BRθ​(θ0​,σ02​)>0,(4)

then some free-sample policy TTT satisfies

E0S[BR(θT,σT2)]>BR(θ0,σ02).\mathbb E^S_0\big[BR(\theta_T,\sigma_T^2)\big]>BR(\theta_0,\sigma_0^2).E0S​[BR(θT​,σT2​)]>BR(θ0​,σ02​).

The goal has no constants. It asserts only that the optimal free-sample policy strictly beats every one-round policy.

Milestones

  • Proposition 1 (p. 13): the posteriors given the whole data path are the Gaussians above.
  • Lemma 1(i)–(iii) (p. 14): the posterior variance decreases at rate σt4/σ2\sigma_t^4/\sigma^2σt4​/σ2. The Buyer's estimate has drift 000 for the Buyer and gtσt2/σ2g_t\sigma_t^2/\sigma^2gt​σt2​/σ2 for the Seller. Its squared increment is σt4/σ2 dt+O(dt3/2)\sigma_t^4/\sigma^2\,dt+O(dt^{3/2})σt4​/σ2dt+O(dt3/2).
  • Lemma 3 (p. 16): the Buyer pays at most BRBRBR for any partial release, and exactly BRBRBR for full release.
  • Lemma 4(b) (p. 17): from the Seller's perspective, ES[BR(θh,σh2)]\mathbb E^S[BR(\theta_h,\sigma_h^2)]ES[BR(θh​,σh2​)] has initial slope (12BRθθ−BRσ2+μbσ02BRθ)σ04/σ2\big(\tfrac12BR_{\theta\theta}-BR_{\sigma^2}+\tfrac{\mu_b}{\sigma_0^2}BR_\theta\big)\sigma_0^4/\sigma^2(21​BRθθ​−BRσ2​+σ02​μb​​BRθ​)σ04​/σ2.
  • Lemma 4(a) (p. 17): from the Buyer's perspective, the same with μb\mu_bμb​ replaced by 000.
  • Theorem 1(b) (p. 18): if the Seller-side drift is non-positive for every posterior mean, misspecification, and positive variance, then no free-sample policy beats selling in one round.

Significance

Theorem 1 splits the drift of the Bayes risk from the Seller's viewpoint into a holdup cost, 12BRθθ−BRσ2\tfrac12BR_{\theta\theta}-BR_{\sigma^2}21​BRθθ​−BRσ2​, which is the drift the Buyer herself expects, and a persuasion benefit, (gt/σt2)BRθ(g_t/\sigma_t^2)BR_\theta(gt​/σt2​)BRθ​. Part (a) turns the sign of this drift at the start into a revenue comparison. In the paper's pricing example (unknown demand elasticity, BR(θ,v)=14e−θ(ev/2−e−v/2)BR(\theta,v)=\tfrac14e^{-\theta}(e^{v/2}-e^{-v/2})BR(θ,v)=41​e−θ(ev/2−e−v/2)), condition (4) reduces to μb<σ02/(1−eσ02)\mu_b<\sigma_0^2/(1-e^{\sigma_0^2})μb​<σ02​/(1−eσ02​): a sufficiently biased Buyer should be given free data. In the estimation example (BR=σt2BR=\sigma_t^2BR=σt2​) part (b) applies and one-round selling is optimal. The theorem is the basis of the paper's later results on myopic stopping rules and on the comparison with dynamic pricing.

The theorem is proved in the paper, in dtdtdt-notation and through Itô's lemma and the optional stopping theorem. It has not been machine-checked. A formal proof requires Gaussian conjugacy with respect to a Brownian filtration, moment computations for the posterior mean, an Itô-type expansion for a C2C^2C2 function of the belief, and control of the integrability of the stopped Bayes risk. Each of these is reusable for other continuous-time Bayesian learning models.

Difficulty

The informal argument reads off Lemma 4 that BR(θt,σt2)BR(\theta_t,\sigma_t^2)BR(θt​,σt2​) is a Seller-submartingale near the start, and then stops it. The dtdtdt-identities of Lemmas 1 and 4 are statements about conditional expectations at every time. Made rigorous, they require integrability of the Bayes risk and its derivatives along the belief path, and an exchange of differentiation and expectation. Neither is given by the paper's hypotheses on uuu. The Gaussian conjugacy itself must also be established for conditioning on the whole path (Ys)s≤t(Y_s)_{s\le t}(Ys​)s≤t​, not only on YtY_tYt​.

Formalization scope

All objects are defined in one file, FreeSamples.Revenue.Setting, on top of Mathlib's gaussianReal, IsBrownianReal, Filtration.natural and IsStoppingTime. Committed conventions:

  • Variances are real numbers, and N(m,v)\mathcal N(m,v)N(m,v) is gaussianReal m v.toNNReal. BRBRBR and UUU take the variance, not the standard deviation, as their second argument.
  • A model with prior N(m,v)\mathcal N(m,v)N(m,v) is a probability space carrying measurable θ∼N(m,v)\theta\sim\mathcal N(m,v)θ∼N(m,v) and a Brownian motion BBB independent of θ\thetaθ. The Seller's and the Buyer's measures are the two instances, which makes concordance hold by construction. Every revenue is an expectation under the Seller's measure.
  • The filtration is the natural filtration of YYY without augmentation. Free-sample policies are bounded stopping times. The paper requires only measurability of TTT, but its own construction is bounded by a large constant MMM.
  • Standing hypotheses on uuu, all disclosed pins: the maxima in UUU and BRBRBR exist and are attained, with all expectations integrable (HasMax); Assumption 1 is read as U,BR∈C2(R×(0,∞))U,BR\in C^2(\mathbb R\times(0,\infty))U,BR∈C2(R×(0,∞)); and BRBRBR and its partial derivatives grow at most like Cec∣θ∣Ce^{c|\theta|}Cec∣θ∣ for variances in (0,σ02](0,\sigma_0^2](0,σ02​].
  • The dtdtdt-statements of Lemmas 1 and 4 are posed as one-sided derivatives at time 000 of plain expectations, for arbitrary parameters. The time-ttt versions follow by restarting from the posterior state and are not posed.
  • Lemma 4's printed factor σt4/σ02\sigma_t^4/\sigma_0^2σt4​/σ02​ is formalized as σt4/σ2\sigma_t^4/\sigma^2σt4​/σ2, as Lemma 1 gives. Condition (5) of Theorem 1(b) keeps the page's universal quantifiers over the posterior mean, misspecification and positive variance. Quantification over all gtg_tgt​ forces BRθ≡0BR_\theta\equiv0BRθ​≡0; the paper's application on p. 33 checks only the realized gtg_tgt​, so it does not establish the printed condition for that example.

Trivializing formalizations are ruled out. Every revenue in a conclusion is asserted integrable, so a junk-zero integral cannot satisfy it. The maxima in UUU and BRBRBR are assumed attained, so no real supremum takes its junk value. The goal is stated for the Gaussian–Brownian model and its posterior map, not for an arbitrary process with a postulated drift. Its conclusion exhibits a policy instead of comparing a supremum over policies.

Not posed: the stochastic differential equation of Lemma 1, Lemma 2, Proposition 2 (its free boundary is part of the hypothesis), Corollaries 1–3, and Appendix B. Contributions are welcome on the conjugacy computation (Proposition 1), on the Gaussian moment estimates (Lemma 1), and on a reusable Itô-type expansion of h↦E[F(mh,vh)]h\mapsto\mathbb E[F(m_h,v_h)]h↦E[F(mh​,vh​)] for C2C^2C2 functions of exponential growth.

Selected references

  • K. Drakopoulos and A. Makhdoumi, Providing Data Samples for Free, SSRN 3611003; Management Science, 2022. https://ssrn.com/abstract=3611003, https://doi.org/10.1287/mnsc.2022.4534
  • S. Morris, Trade with Heterogeneous Prior Beliefs and Asymmetric Information, Econometrica 62(6), 1994. https://doi.org/10.2307/2951755
  • R. J. Aumann, Agreeing to Disagree, Annals of Statistics 4(6), 1976. https://doi.org/10.1214/aos/1176343654
  • J. M. Steele, Stochastic Calculus and Financial Applications, Springer, 2001. https://doi.org/10.1007/978-1-4684-9305-4
10 thms1 active userReviewed
PreviousPage 13 of 38Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me