Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Probability

1,628 missions · 683 completed

Missions

Open945Completed683All1628
Machine LearningOperations ResearchOptimization·Captain: mikedeng1

Stochastic First- and Zeroth-Order Methods for Nonconvex Stochastic Programming 2: The Randomized Stochastic Gradient-Free Method with Gaussian Smoothing Bounds (1/L)E‖∇f(x_R)‖² for Nonconvex fResearch Paper

Motivation

Many optimization problems in simulation-based design, reinforcement learning and machine learning can be evaluated but not differentiated. Their objective is an expectation f(x)=E[F(x,ξ)]f(x) = \mathbb E[F(x,\xi)]f(x)=E[F(x,ξ)] that can only be sampled through noisy function values F(x,ξ)F(x,\xi)F(x,ξ). Gradients may be unavailable because the model is a black box, a simulator, or a legacy code. Methods for this setting are called zeroth-order or derivative-free stochastic methods. The objective fff is often nonconvex, so the realistic target is an approximately stationary point, ∥∇f(x)∥2≤ϵ\|\nabla f(x)\|^2 \le \epsilon∥∇f(x)∥2≤ϵ, not a global minimizer.

Ghadimi and Lan (arXiv:1309.5549; SIAM J. Optim. 23(4), 2013) gave the first complexity bounds for stochastic zeroth-order methods on nonconvex problems. Their randomized stochastic gradient free (RSGF) method combines two ingredients. The first is the Gaussian smoothing and random finite-difference estimator of Nesterov and Spokoiny (Found. Comput. Math. 17, 2017; preprint 2011). The second is a randomized stopping rule that outputs an iterate chosen at random along the trajectory. The resulting bound has become the standard reference point for derivative-free nonconvex stochastic optimization.

Timeline:

  • 1952: Kiefer and Wolfowitz introduce finite-difference stochastic approximation.
  • 2011: Nesterov and Spokoiny analyze Gaussian random gradient-free oracles for convex and deterministic nonconvex problems.
  • 2013: Ghadimi and Lan prove the nonconvex stochastic rate of the RSGF method (Theorem 3.2) and its O(n/ϵ2)O(n/\epsilon^2)O(n/ϵ2) complexity (Corollary 3.3).

Setting

Let Rn\mathbb R^nRn be Euclidean space and let ξ\xiξ be a random vector with distribution PPP on a measurable space Ξ\XiΞ. The problem is

f∗:=inf⁡x∈Rn{f(x):=∫ΞF(x,ξ) dP(ξ)}.(3.1)f^* := \inf_{x\in\mathbb R^n}\Big\{ f(x) := \int_\Xi F(x,\xi)\,dP(\xi) \Big\}. \tag{3.1}f∗:=x∈Rninf​{f(x):=∫Ξ​F(x,ξ)dP(ξ)}.(3.1)

The sample functions F(⋅,ξ)F(\cdot,\xi)F(⋅,ξ) lie in CL1,1(Rn)\mathcal C^{1,1}_L(\mathbb R^n)CL1,1​(Rn) almost surely: they are differentiable, and their gradients are LLL-Lipschitz. Two assumptions describe the noise. Assumption A1 concerns the first-order oracle G(x,ξ)=∇xF(x,ξ)G(x,\xi) = \nabla_x F(x,\xi)G(x,ξ)=∇x​F(x,ξ): it is unbiased, E[G(x,ξ)]=∇f(x)\mathbb E[G(x,\xi)] = \nabla f(x)E[G(x,ξ)]=∇f(x), and has variance at most σ2\sigma^2σ2. Assumption A3 says the zeroth-order oracle is unbiased, E[F(x,ξ)]=f(x)\mathbb E[F(x,\xi)] = f(x)E[F(x,ξ)]=f(x).

For a smoothing parameter μ>0\mu > 0μ>0 and an nnn-dimensional standard Gaussian vector uuu, the Gaussian smoothing of fff is fμ(x)=Eu[f(x+μu)]f_\mu(x) = \mathbb E_u[f(x+\mu u)]fμ​(x)=Eu​[f(x+μu)] (3.3). The RSGF method starts from x1x_1x1​ and uses stepsizes γk\gamma_kγk​. At step kkk it draws a fresh sample ξk\xi_kξk​ and a fresh Gaussian direction uku_kuk​, forms the zeroth-order estimator

Gμ(xk,ξk,uk)=F(xk+μuk,ξk)−F(xk,ξk)μ uk,(3.12)G_\mu(x_k,\xi_k,u_k) = \frac{F(x_k+\mu u_k,\xi_k) - F(x_k,\xi_k)}{\mu}\,u_k, \tag{3.12}Gμ​(xk​,ξk​,uk​)=μF(xk​+μuk​,ξk​)−F(xk​,ξk​)​uk​,(3.12)

and sets xk+1=xk−γkGμ(xk,ξk,uk)x_{k+1} = x_k - \gamma_k G_\mu(x_k,\xi_k,u_k)xk+1​=xk​−γk​Gμ​(xk​,ξk​,uk​) (3.13). The output is xRx_RxR​, where the random iteration count R∈{1,…,N}R \in \{1,\dots,N\}R∈{1,…,N} has the probability mass function

PR(k)=γk−2L(n+4)γk2∑j=1N[γj−2L(n+4)γj2].(3.15)P_R(k) = \frac{\gamma_k - 2L(n+4)\gamma_k^2}{\sum_{j=1}^N[\gamma_j - 2L(n+4)\gamma_j^2]}. \tag{3.15}PR​(k)=∑j=1N​[γj​−2L(n+4)γj2​]γk​−2L(n+4)γk2​​.(3.15)

In the Lean development, fff is objective P F, GμG_\muGμ​ is szoGrad (the published RandomGradFree.Shared.oracle applied to F(⋅,ξ)F(\cdot,\xi)F(⋅,ξ)), and fμf_\mufμ​ is the published RandomGradFree.Shared.smoothing. The smoothing parameter is μs, because μ names the probability measure.

Formalization targets

Goal: Theorem 3.2 a)

Let 0<γk<1/[2(n+4)L]0 < \gamma_k < 1/[2(n+4)L]0<γk​<1/[2(n+4)L] for k=1,…,Nk = 1,\dots,Nk=1,…,N, with N≥1N \ge 1N≥1, and let Df2=2(f(x1)−f∗)/LD_f^2 = 2(f(x_1)-f^*)/LDf2​=2(f(x1​)−f∗)/L. Then

1L E∥∇f(xR)∥2≤Df2+2μ2(n+4)(1+L(n+4)2∑k=1N(γk4+Lγk2))+2(n+4)σ2∑k=1Nγk2∑k=1N[γk−2L(n+4)γk2].(3.16)\frac1L\,\mathbb E\|\nabla f(x_R)\|^2 \le \frac{D_f^2 + 2\mu^2(n+4)\big(1 + L(n+4)^2\sum_{k=1}^N(\frac{\gamma_k}{4} + L\gamma_k^2)\big) + 2(n+4)\sigma^2\sum_{k=1}^N\gamma_k^2}{\sum_{k=1}^N[\gamma_k - 2L(n+4)\gamma_k^2]}. \tag{3.16}L1​E∥∇f(xR​)∥2≤∑k=1N​[γk​−2L(n+4)γk2​]Df2​+2μ2(n+4)(1+L(n+4)2∑k=1N​(4γk​​+Lγk2​))+2(n+4)σ2∑k=1N​γk2​​.(3.16)

The stepsizes are left free, so every stepsize policy specializes the goal.

Companions

  • Theorem 3.2 b), (3.17): for convex fff with a minimizer x∗x^*x∗, the bound on E[f(xR)−f∗]\mathbb E[f(x_R) - f^*]E[f(xR​)−f∗].
  • Corollary 3.3, (3.26): for the constant stepsizes (3.24) and μ≤Df/((n+4)2N)\mu \le D_f/((n+4)\sqrt{2N})μ≤Df​/((n+4)2N​),
1L E∥∇f(xR)∥2≤12(n+4)LDf2N+4σn+4N(D~+Df2D~).\frac1L\,\mathbb E\|\nabla f(x_R)\|^2 \le \frac{12(n+4)LD_f^2}{N} + \frac{4\sigma\sqrt{n+4}}{\sqrt N}\Big(\tilde D + \frac{D_f^2}{\tilde D}\Big).L1​E∥∇f(xR​)∥2≤N12(n+4)LDf2​​+N​4σn+4​​(D~+D~Df2​​).

Milestones

The milestones follow the paper's proof.

  • Properties of the smoothing. These are Theorem 3.1 a)–c): fμf_\mufμ​ has an LLL-Lipschitz gradient given by (3.4), ∣fμ−f∣≤μ22Ln|f_\mu - f| \le \frac{\mu^2}{2}Ln∣fμ​−f∣≤2μ2​Ln (3.5), the gradient bound (3.6), and the second-moment bound (3.7). Three of these are already on the platform and are referenced. Two consequences follow, (3.9) and (3.11).
  • Unbiasedness, (3.14): the estimator GμG_\muGμ​ is unbiased for ∇fμ\nabla f_\mu∇fμ​.
  • The proof chain of Theorem 3.2. The pathwise descent inequality (3.19), the martingale identity (3.20) and the conditional second-moment bound (3.21) combine into the weighted bound (3.23). The RRR-weighting identity converts (3.23) into (3.16).

Significance

The theorem shows that function values alone suffice to find approximately stationary points of nonconvex stochastic programs. The price is a factor of the dimension nnn: with constant stepsizes the RSGF method needs O(n/ϵ2)O(n/\epsilon^2)O(n/ϵ2) iterations, against O(1/ϵ2)O(1/\epsilon^2)O(1/ϵ2) for the first-order RSG method. The randomized output rule and the analysis through fμf_\mufμ​ are reused in later zeroth-order methods, including two-phase variants, mirror-descent variants and variance-reduced schemes.

The result is proved in the paper. It is not formalized anywhere known to this mission. The platform already holds parts of the Gaussian-smoothing theory from the Nesterov–Spokoiny series, but only for convex problems with exact function values. This mission adds:

  • the nonconvex form of the second-moment bound (3.7);
  • the gradient-approximation bound (3.6);
  • the stochastic sampling model with conditional expectations;
  • the first machine-checkable statement of a nonconvex stochastic zeroth-order rate.

Difficulty

The first idea is to treat the RSGF method as the first-order RSG method run on fμf_\mufμ​ with the unbiased estimator GμG_\muGμ​, and to quote the RSG bound. This fails, because the variance E∥Gμ−∇fμ∥2\mathbb E\|G_\mu - \nabla f_\mu\|^2E∥Gμ​−∇fμ​∥2 has no uniform bound: by (3.7) it grows with ∥∇f(xk)∥2\|\nabla f(x_k)\|^2∥∇f(xk​)∥2 at the random iterate. The analysis has to carry that term along and absorb it into the left side, which is where the weights γk−2L(n+4)γk2\gamma_k - 2L(n+4)\gamma_k^2γk​−2L(n+4)γk2​ come from. It must also move between ∇fμ\nabla f_\mu∇fμ​ and ∇f\nabla f∇f through (3.6) at a cost polynomial in nnn.

On the formal side, three obstacles stand out.

  • The Gaussian moment estimates behind (3.6) and (3.7) need bounds on E∥u∥p\mathbb E\|u\|^pE∥u∥p up to p=6p = 6p=6 for a standard Gaussian vector.
  • Conditional expectations with respect to σ(ζ[k−1])\sigma(\zeta_{[k-1]})σ(ζ[k−1]​) are taken at random iterates that depend on the past, so independence of the fresh samples must be used carefully.
  • Integrability must be established for every quantity before expectations can be manipulated.

Formalization scope

  • Space. Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n). The constants (n+3)(n+3)(n+3), (n+4)(n+4)(n+4), (n+6)(n+6)(n+6) use the same natural number nnn. The Gaussian is Mathlib's stdGaussian.
  • Iterates. They are indexed from 111, and RRR takes values in {1,…,N}\{1,\dots,N\}{1,…,N}.
  • Optimal values. f∗f^*f∗ is the infimum of fff (IsGLB), with fff bounded below. The paper's fμ∗:=min⁡fμf^*_\mu := \min f_\mufμ∗​:=minfμ​ (3.10) is read as an infimum, since the minimum need not be attained.
  • Smoothness. F(⋅,ξ)∈CL1,1F(\cdot,\xi) \in \mathcal C^{1,1}_LF(⋅,ξ)∈CL1,1​ is required for PPP-almost every ξ\xiξ, as on the page.
  • Assumption A1 is stated at every point xxx for G=∇xFG = \nabla_x FG=∇x​F.
  • Assumption A3 is the definition of fff, with F(x,⋅)F(x,\cdot)F(x,⋅) integrable.

The following are explicit additions; the paper leaves them implicit.

  • Sampling. The samples ξk∼P\xi_k \sim Pξk​∼P and uk∼N(0,In)u_k \sim \mathcal N(0,I_n)uk​∼N(0,In​) are measurable and mutually independent, and RRR is independent of all of them.
  • Measurability and integrability. FFF is jointly measurable, and ∇xF(x,⋅)\nabla_x F(x,\cdot)∇x​F(x,⋅) is integrable.
  • Stepsizes are positive.
  • Corollary 3.3 assumes σ>0\sigma > 0σ>0.

Every conclusion about an expectation also asserts the integrability of its integrand. A non-integrable function has Lean integral 000, so a bound without this conjunct could hold for the wrong reason.

The goal is stated about the objects of the method only: FFF, PPP, fff, the run (3.12)–(3.13), RRR and the constants. It does not mention fμf_\mufμ​, Δk\Delta_kΔk​ or the filtration, so it cannot be discharged by choosing an auxiliary object.

A complete development needs:

  • Gaussian moment bounds and differentiation under the Gaussian integral;
  • conditional expectation with respect to the natural filtration of an independent sequence;
  • the descent lemma for CL1,1\mathcal C^{1,1}_LCL1,1​ functions.

The Gaussian-smoothing lemmas (3.6), (3.7) and (3.9) are reusable by any zeroth-order mission. Contributions of proofs of individual milestones are welcome, as are alternative proofs of (3.7) without Nesterov's bound.

Selected references

  • S. Ghadimi and G. Lan, Stochastic first- and zeroth-order methods for nonconvex stochastic programming, SIAM J. Optim. 23(4):2341–2368, 2013. Preprint arXiv:1309.5549v1, the version cited here. https://arxiv.org/abs/1309.5549
  • Y. Nesterov and V. Spokoiny, Random gradient-free minimization of convex functions, Found. Comput. Math. 17:527–566, 2017. https://doi.org/10.1007/s10208-015-9296-2
  • J. Kiefer and J. Wolfowitz, Stochastic estimation of the maximum of a regression function, Ann. Math. Statist. 23(3):462–466, 1952. https://doi.org/10.1214/aoms/1177729392
18 thms3 active usersReviewed
Machine LearningTheoretical Computer Science·Captain: mikedeng1

What Can We Learn Privately? II: Parity Functions Are Privately PAC Learnable from O(d log(1/β)/(εα)) ExamplesResearch Paper

Learning parities under differential privacy

Differential privacy (Dwork, McSherry, Nissim and Smith, 2006) requires a randomized algorithm's output distribution to change little when one individual's record is changed. PAC learning asks an algorithm to output, from i.i.d. labeled examples, a hypothesis whose error is small with high probability. Kasiviswanathan, Lee, Nissim, Raskhodnikova and Smith (arXiv:0803.0924v3; SIAM J. Comput. 40(3) (2011) 793–826, DOI 10.1137/090756090) asked which concept classes can be learned under both requirements at once. All theorem, page and display numbers in this mission are those of the arXiv v3.

Their generic learner (§3, the subject of mission I of this series) learns every finite class privately with a polynomial number of examples, but its running time is exponential in the representation size for classes such as parity. Parity functions are the standard example of a class that is learnable efficiently by linear algebra and not learnable with statistical queries (Kearns, 1998; Blum et al., 1994), a model that was then the main known source of efficient private learners (Blum, Dwork, McSherry and Nissim, 2005). Section 4 of the paper gives an efficient private PAC learner for parity. The result separates efficient private learning from statistical-query learning, and the local (randomized-response) model from the centralized one (missions III–V).

Setting

For d≥1d \ge 1d≥1 and r∈{0,1}dr \in \{0,1\}^dr∈{0,1}d, the parity function cr(x)=r⊙xc_r(x) = r \odot xcr​(x)=r⊙x is the inner product of rrr and xxx modulo 2; PARITY is {cr:r∈{0,1}d}\{c_r : r \in \{0,1\}^d\}{cr​:r∈{0,1}d}. A database is z=(z1,…,zn)z = (z_1,\dots,z_n)z=(z1​,…,zn​) with zi=(xi,yi)∈{0,1}d×{0,1}z_i = (x_i, y_i) \in \{0,1\}^d \times \{0,1\}zi​=(xi​,yi​)∈{0,1}d×{0,1}. Two databases are neighbors if they differ in exactly one entry. A randomized algorithm AAA, identified with the law A(z)A(z)A(z) of its output, is ε\varepsilonε-differentially private if Pr⁡[A(z)∈S]≤eεPr⁡[A(z′)∈S]\Pr[A(z) \in S] \le e^{\varepsilon}\Pr[A(z') \in S]Pr[A(z)∈S]≤eεPr[A(z′)∈S] for all neighbors z,z′z, z'z,z′ and all sets SSS of outputs. Lap(s)\mathrm{Lap}(s)Lap(s) is the Laplace distribution with density 12se−∣x∣/s\frac{1}{2s}e^{-|x|/s}2s1​e−∣x∣/s.

For S⊆[n]S \subseteq [n]S⊆[n], VS⊆Z2dV_S \subseteq \mathbb Z_2^dVS​⊆Z2d​ is the solution space of the linear system {xi⊙r=yi:i∈S}\{x_i \odot r = y_i : i \in S\}{xi​⊙r=yi​:i∈S}. The basic learner A(z,ε)\mathcal A(z,\varepsilon)A(z,ε) outputs ⊥\bot⊥ with probability 1/21/21/2; otherwise it puts each i∈[n]i \in [n]i∈[n] into SSS independently with probability p=ε/4p = \varepsilon/4p=ε/4 and outputs cr∗c_{r^*}cr∗​ for r∗r^*r∗ uniform in VSV_SVS​, or ⊥\bot⊥ if VS=∅V_S = \emptysetVS​=∅.

The amplified learner A∗(z,ε,α,β)\mathcal A^*(z,\varepsilon,\alpha,\beta)A∗(z,ε,α,β) sets β′=β/2\beta' = \beta/2β′=β/2, α′=α/5\alpha' = \alpha/5α′=α/5, k=⌈log⁡4/3(1/β′)⌉k = \lceil\log_{4/3}(1/\beta')\rceilk=⌈log4/3​(1/β′)⌉, n′=⌈cd/(εα′)⌉n' = \lceil cd/(\varepsilon\alpha')\rceiln′=⌈cd/(εα′)⌉, s=⌈(c′k/(α′ε))log⁡2(k/β′)⌉s = \lceil (c'k/(\alpha'\varepsilon))\log_2(k/\beta')\rceils=⌈(c′k/(α′ε))log2​(k/β′)⌉ for constants c,c′c, c'c,c′. If n≤kn′+sn \le kn' + sn≤kn′+s it returns "insufficient samples". Otherwise it runs A\mathcal AA on kkk disjoint blocks of n′n'n′ examples, obtaining h1,…,hkh_1,\dots,h_kh1​,…,hk​. It perturbs each training error on the next sss examples by independent Lap(k/(sε))\mathrm{Lap}(k/(s\varepsilon))Lap(k/(sε)) noise and outputs the hjh_jhj​ with the least perturbed error.

For a distribution X\mathcal XX on {0,1}d\{0,1\}^d{0,1}d and a target crc_rcr​, the error of cr′c_{r'}cr′​ is err(cr′)=Pr⁡x∼X[cr′(x)≠cr(x)]\mathrm{err}(c_{r'}) = \Pr_{x\sim\mathcal X}[c_{r'}(x) \ne c_r(x)]err(cr′​)=Prx∼X​[cr′​(x)=cr​(x)], and probabilities of the learner's success are over x1,…,xn∼Xx_1,\dots,x_n \sim \mathcal Xx1​,…,xn​∼X i.i.d., zi=(xi,cr(xi))z_i = (x_i, c_r(x_i))zi​=(xi​,cr​(xi​)), and the learner's coins.

Formalization targets

Goal: Theorem 4.4

There are constants c,c′,C>0c, c', C > 0c,c′,C>0 such that for all d≥1d \ge 1d≥1, 0<ε≤1/20 < \varepsilon \le 1/20<ε≤1/2, α,β∈(0,1/2)\alpha, \beta \in (0,1/2)α,β∈(0,1/2): A∗(⋅,ε,α,β)\mathcal A^*(\cdot,\varepsilon,\alpha,\beta)A∗(⋅,ε,α,β) is ε\varepsilonε-differentially private on databases of every size, and

n≥C (d+log⁡2(1/β))log⁡2(1/β)εα  ⟹  Pr⁡[A∗ outputs h∗ with err(h∗)≤α]≥1−βn \ge C\,\frac{(d + \log_2(1/\beta))\log_2(1/\beta)}{\varepsilon\alpha} \implies \Pr\big[\mathcal A^* \text{ outputs } h^* \text{ with } \mathrm{err}(h^*) \le \alpha\big] \ge 1-\betan≥Cεα(d+log2​(1/β))log2​(1/β)​⟹Pr[A∗ outputs h∗ with err(h∗)≤α]≥1−β

for every distribution X\mathcal XX and every target crc_rcr​. When log⁡2(1/β)≤d\log_2(1/\beta) \le dlog2​(1/β)≤d the bound is the paper's O(dlog⁡(1/β)/(εα))O(d\log(1/\beta)/(\varepsilon\alpha))O(dlog(1/β)/(εα)). The constants are fixed before all other parameters. The goal is literally the conjunction of Lemma 4.5 and Lemma 4.6.

Milestones

Thm 2.3 (Laplace mechanism),Claim 2.2 (composition),Thm A.1 (Chernoff),Occam’s razor for ∣H∣=2d,\text{Thm 2.3 (Laplace mechanism)},\quad \text{Claim 2.2 (composition)},\quad \text{Thm A.1 (Chernoff)},\quad \text{Occam's razor for } |H| = 2^d,Thm 2.3 (Laplace mechanism),Claim 2.2 (composition),Thm A.1 (Chernoff),Occam’s razor for ∣H∣=2d, Lemma 4.1: n≥8εα(dln⁡2+ln⁡4)⇒Pr⁡[A(z,ε)=h, err(h)≤α]≥14,\text{Lemma 4.1: } n \ge \tfrac{8}{\varepsilon\alpha}(d\ln 2 + \ln 4) \Rightarrow \Pr[\mathcal A(z,\varepsilon) = h,\ \mathrm{err}(h)\le\alpha] \ge \tfrac14,Lemma 4.1: n≥εα8​(dln2+ln4)⇒Pr[A(z,ε)=h, err(h)≤α]≥41​, ∣VT∣≤2∣VT∪{i}∣ if VT∪{i}≠∅,Claim 4.3,Lemma 4.2 (A private),Lemma 4.5 (A∗ private),Lemma 4.6 (A∗ learns).|V_T| \le 2|V_{T\cup\{i\}}| \text{ if } V_{T\cup\{i\}} \ne \emptyset,\quad \text{Claim 4.3},\quad \text{Lemma 4.2 (}\mathcal A\text{ private)},\quad \text{Lemma 4.5 (}\mathcal A^*\text{ private)},\quad \text{Lemma 4.6 (}\mathcal A^*\text{ learns)}.∣VT​∣≤2∣VT∪{i}​∣ if VT∪{i}​=∅,Claim 4.3,Lemma 4.2 (A private),Lemma 4.5 (A∗ private),Lemma 4.6 (A∗ learns).

Significance

The theorem shows that the restriction to private algorithms does not separate efficient learnability from statistical-query learnability: parity is efficiently and privately PAC learnable, yet not SQ learnable. Its sample complexity exceeds the non-private O((d+ln⁡(1/β))/α)O((d + \ln(1/\beta))/\alpha)O((d+ln(1/β))/α) by a factor O(ln⁡(1/β)/ε)O(\ln(1/\beta)/\varepsilon)O(ln(1/β)/ε) (remark, p. 18). The private amplification step (private model selection with Laplace-perturbed test errors) is a general technique that converts any private learner with constant success probability into a private PAC learner.

The result is proved in the paper; none of it is machine-checked as far as we know. The mission produces a formal library of the basic privacy calculus (Laplace mechanism, composition and post-processing), the Z2\mathbb Z_2Z2​ solution-space estimate behind the privacy of A\mathcal AA, and the analysis of both learners. Formalizing it also repairs the paper's statement: the printed sample bound fails when log⁡(1/β)\log(1/\beta)log(1/β) is large compared with ddd (see the scope section), and the base of the logarithm defining kkk is misprinted.

Difficulty

The obvious private learner, "solve the linear system on all examples and output a random solution", is not private. One changed example can make the system inconsistent and turn every hypothesis output into failure, so the output law on neighboring databases differs by an unbounded factor. Two devices restore privacy: subsampling each example with probability ε/4\varepsilon/4ε/4, and failing with probability 1/21/21/2 unconditionally. The privacy proof then needs a quantitative fact about Z2\mathbb Z_2Z2​: adding one consistent equation at most halves the solution space. The proof must also handle databases labeled by no parity at all, where solution spaces are empty.

Utility has its own difficulty. The amplified learner selects among candidates through noisy test errors, so three failure events (no good candidate, unrepresentative test set, large Laplace noise) must be bounded together. The sizes kkk, n′n'n′, sss must also be shown to fit inside the claimed sample bound.

Formalization scope

  • Bits are ZMod 2; {0,1}d\{0,1\}^d{0,1}d is Fin d → ZMod 2; cr(x)c_r(x)cr​(x) is dotProduct r x. Databases are Fin n → (Fin d → ZMod 2) × ZMod 2, with 0-based indices.
  • An algorithm is the law of its output. A\mathcal AA's output is Option (Fin d → ZMod 2) (none = ⊥\bot⊥). A∗\mathcal A^*A∗'s output is "insufficient samples", ⊥\bot⊥, or a hypothesis crc_rcr​. Every set of outputs is measurable, and differential privacy is required for all measurable sets.
  • The distribution X\mathcal XX is a PMF on the finite set {0,1}d\{0,1\}^d{0,1}d. The probability over the examples is a finite sum weighted by ∏iX(xi)\prod_i \mathcal X(x_i)∏i​X(xi​), and ⊥\bot⊥ has error 1.
  • Corrections and explicit hypotheses. (1) k=⌈log⁡4/3(1/β′)⌉k = \lceil\log_{4/3}(1/\beta')\rceilk=⌈log4/3​(1/β′)⌉: the printed base 3/43/43/4 gives k≤0k \le 0k≤0, and the proof needs (3/4)k≤β′(3/4)^k \le \beta'(3/4)k≤β′. (2) Sizes are ceilings; log⁡\loglog is base 2 and ln⁡\lnln is natural, as on p. 8. (3) Privacy is stated for 0<ε≤1/20 < \varepsilon \le 1/20<ε≤1/2: the proof of Lemma 4.2 uses ε≤1/2\varepsilon \le 1/2ε≤1/2, and its step 2p/(1−p)+1≤ε+12p/(1-p) + 1 \le \varepsilon + 12p/(1−p)+1≤ε+1 fails beyond that. Utility statements need only 0<ε≤40 < \varepsilon \le 40<ε≤4, so that p=ε/4p = \varepsilon/4p=ε/4 is a probability. (4) The printed bound O(dlog⁡(1/β)/(εα))O(d\log(1/\beta)/(\varepsilon\alpha))O(dlog(1/β)/(εα)) is false when log⁡(1/β)≫d\log(1/\beta) \gg dlog(1/β)≫d, because A∗\mathcal A^*A∗ refuses unless n>kn′+sn > kn' + sn>kn′+s and sss grows like log⁡2(1/β)/(εα)\log^2(1/\beta)/(\varepsilon\alpha)log2(1/β)/(εα). Utility is therefore stated with the bound C(d+log⁡2(1/β))log⁡2(1/β)/(εα)C(d + \log_2(1/\beta))\log_2(1/\beta)/(\varepsilon\alpha)C(d+log2​(1/β))log2​(1/β)/(εα), the order of kn′+skn' + skn′+s, which equals the printed order whenever log⁡2(1/β)≤d\log_2(1/\beta) \le dlog2​(1/β)≤d. The privacy conjunct does not depend on the sample bound. (5) A ⊥\bot⊥ candidate does not take part in the argmin, and ties go to the least index. (6) Lemma 4.1 assumes α≤1/2\alpha \le 1/2α≤1/2, which its proof uses. (7) Claim 4.3 is stated in product form (no division). (8) Theorem 2.3 takes any positive bound Δ\DeltaΔ on the global sensitivity.
  • "Efficiently" (polynomial running time) is not modelled.
  • Ruling out trivial readings. The constants c,c′,Cc, c', Cc,c′,C are existentially quantified once, outside every other quantifier. A constant chosen after ddd, ε\varepsilonε, α\alphaα, β\betaβ would make the utility claim trivial. Success requires an actual hypothesis output, so "insufficient samples" and ⊥\bot⊥ are failures. Privacy quantifies over all databases, not only consistently labeled ones.
  • Reused results: ComputationalLearning.chernoff_bounds (Theorem A.1) and ComputationalLearning.occam_cardinality (Occam's razor), both proved on the platform.
  • Contributions welcome: proofs of the privacy calculus (Theorem 2.3, Claim 2.2) for general use, the Z2\mathbb Z_2Z2​ halving lemma, and the utility analysis. The first two are reusable well beyond this mission.

Selected references

  • S. P. Kasiviswanathan, H. K. Lee, K. Nissim, S. Raskhodnikova, A. Smith, What Can We Learn Privately?, SIAM J. Comput. 40(3) (2011) 793–826. arXiv:0803.0924v3, DOI 10.1137/090756090
  • C. Dwork, F. McSherry, K. Nissim, A. Smith, Calibrating Noise to Sensitivity in Private Data Analysis, TCC 2006. DOI 10.1007/11681878_14
  • A. Blum, C. Dwork, F. McSherry, K. Nissim, Practical Privacy: The SuLQ Framework, PODS 2005. DOI 10.1145/1065167.1065184
  • M. Kearns, Efficient Noise-Tolerant Learning from Statistical Queries, J. ACM 45(6) (1998) 983–1006. DOI 10.1145/293347.293351
  • A. Blum, M. Furst, J. Jackson, M. Kearns, Y. Mansour, S. Rudich, Weakly Learning DNF and Characterizing Statistical Query Learning Using Fourier Analysis, STOC 1994. DOI 10.1145/195058.195147
  • M. Kearns, U. Vazirani, An Introduction to Computational Learning Theory, MIT Press, 1994. DOI 10.7551/mitpress/3897.001.0001
14 thms3 active usersReviewed
🏆Completed
Combinatorics·Captain: marwahaha

A strict four-row permanent inequality and permutation momentsOpen Problem

Motivation

An inequality involving only four rows can feed into a recursion for a much larger permutation shuffle. The source seeks an exponent strictly below two that survives a small perturbation of the uniform permutation law. The source is OpenAI's September 2026 manuscript.

Setting

A permanent expectation averages the product of four selected entries, one from each row and each column, over a probability law on the 24 permutations. Uniform marginals require every row to choose each column with probability 1/41/41/4.

Formalization targets

∃p0∈(4/3,2), ε>0:∑π∈S4ν(π)∏ifi(π(i))≤∏i(14∑jfi(j)p0)1/p0.\exists p_0\in(4/3,2),\ \varepsilon>0:\quad\sum_{\pi\in S_4}\nu(\pi)\prod_i f_i(\pi(i))\le\prod_i\left(\frac14\sum_j f_i(j)^{p_0}\right)^{1/p_0}.∃p0​∈(4/3,2), ε>0:π∈S4​∑​ν(π)i∏​fi​(π(i))≤i∏​(41​j∑​fi​(j)p0​)1/p0​.

The theorem is stated as admitted, not proved here. Sites are Fin 4, and a law is a real-valued mass function ν on the 24 permutations of the four sites. It states that there exist a real exponent p₀ with 4/3 < p₀ < 2 and a real ε > 0 such that the following holds for every law ν that is a probability law (all masses nonnegative and summing to 1), has total variation distance from the uniform law less than ε (total variation being half the sum over permutations π of |ν(π) − 1/24|), and has uniform marginals (for every pair of sites i and j, the total mass of permutations with π(i)=j equals 1/4). For every 4-by-4 array f of real numbers with all entries f(i,j) ≥ 0, the permanent expectation Σ_π ν(π) ∏_i f(i, π(i)) is at most the product over the four rows i of the normalized ℓ^{p₀} norm of row i, where the norm of a row g is ((Σ_j g(j)^{p₀})/4)^{1/p₀}, using the uniform counting normalization with division by 4.

The goal is OAI.FourRow.robust_permanent. Supporting targets are listed below; they retain their individual hypotheses and are separate statements.

  • remaining main.

Significance

The goal is uniform over all nonnegative arrays and all probability laws within the chosen total-variation neighborhood that have exactly uniform marginals. The shared Thorp bundle is included as a separate supporting target. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

Near-uniformity alone does not enforce the marginal identities. The exponent improvement must hold even for highly uneven nonnegative row entries.

Formalization scope

The law has nonnegative real masses summing to one. Its distance from the uniform 1/241/241/24 law is strictly less than the selected ε\varepsilonε, and row norms use division by four. No explicit value for the existential exponent or radius is imposed.

The shared definitions are supplied by FourRowPermanent, ThorpRemaining. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, A strict four-row permanent inequality and permutation moments, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
9 thms3 active usersReviewed
Information Theory·Captain: wurtle

Sharp binary-information contraction on the discrete cubeResearch Paper

Motivation

Draw nnn independent fair bits XXX, compute a one-bit summary f(X)f(X)f(X), and send the bits through independent binary symmetric channels with crossover probability ε\varepsilonε, producing YYY. Which summary tells the receiver the most about YYY? Kumar and Courtade conjectured that a single coordinate, f(X)=X1f(X)=X_1f(X)=X1​, is optimal: I(f(X);Y)≤1−h2(ε)I(f(X);Y)\le 1-h_2(\varepsilon)I(f(X);Y)≤1−h2​(ε) bits for every Boolean fff, in every dimension and at every noise level (ISIT 2013; IEEE Trans. Inf. Theory 2014). The Courtade–Kumar (most informative Boolean function) conjecture is a basic question about how noise destroys information on the discrete cube, connecting information theory with Boolean Fourier analysis and hypercontractivity.

This mission asks for a formal proof of a sharp contraction theorem for arbitrary randomized binary summaries, whose Boolean case is the Courtade–Kumar conjecture, as stated in an OpenAI preprint dated September 24, 2026 (source). The preprint has not been peer reviewed and its claims have not been independently verified; on the platform the Lean goal is open.

Background

  • 1970–1976 — Hypercontractivity on the cube (Bonami, Ann. Inst. Fourier 1970; Gross, Amer. J. Math. 1975; Beckner, Annals 1975); Mrs. Gerber's lemma (Wyner–Ziv, IEEE TIT 1973).
  • 2013–2014 — Kumar and Courtade pose the conjecture and prove a coordinatewise sum bound.
  • 2016 — High-noise results: Ordentlich, Shayevitz and Weinstein for balanced functions (ISIT 2016); Samorodnitsky for all Boolean functions in a dimension-independent high-noise range (IEEE TIT 2016).
  • 2018 — Pichler, Piantanida and Matz prove coordinate optimality when the observation is also reduced to one bit (Ann. Appl. Probab. 2018).
  • 2020–2023 — Barnes–Özgür's symmetrized reformulation (ISIT 2020); Li–Médard on fixed-mean optimizers (IEEE TIT 2021); Yu's Φ\PhiΦ-stability (PTRF 2023).
  • 2025–2026 — Chen, Gohari and Nair's differential (entropy-production) approach; independent preprints announcing proofs by Chen, Gohari, Javanmard, Lin, Mirrokni, Nair and Woodruff (arXiv:2609.24931), Ky and Tran (arXiv:2609.24184), Mahdavifar and Beirami (arXiv:2609.26444), and a bias-retaining finite-noise bound by Kramer and Saglam.
  • September 2026 — The OpenAI preprint (Theorems 1.1 and 1.3, Corollary 1.2, pp. 1–4).

Setting

Let Ωn={−1,1}n\Omega_n=\{-1,1\}^nΩn​={−1,1}n with uniform measure; information is in nats unless stated. For r∈[−1,1]r\in[-1,1]r∈[−1,1] put

L=log⁡2,H(r)=−1+r2log⁡1+r2−1−r2log⁡1−r2,ψ(r)=L−H(r),L=\log2,\quad H(r)=-\tfrac{1+r}2\log\tfrac{1+r}2-\tfrac{1-r}2\log\tfrac{1-r}2,\quad \psi(r)=L-H(r),L=log2,H(r)=−21+r​log21+r​−21−r​log21−r​,ψ(r)=L−H(r),

with 0log⁡0=00\log0=00log0=0; ψ−1\psi^{-1}ψ−1 is the increasing branch [0,L]→[0,1][0,L]\to[0,1][0,L]→[0,1]. A soft channel is u:Ωn→[−1,1]u:\Omega_n\to[-1,1]u:Ωn​→[−1,1], the conditional mean of an auxiliary sign UUU given XXX; its information is I(u)=H(Eu)−EH(u)=I(U;X)I(u)=H(\mathbb Eu)-\mathbb EH(u)=I(U;X)I(u)=H(Eu)−EH(u)=I(U;X). For ρ∈[−1,1]\rho\in[-1,1]ρ∈[−1,1] let Yi=XiZiY_i=X_iZ_iYi​=Xi​Zi​ with independent signs EZi=ρ\mathbb EZ_i=\rhoEZi​=ρ, and let Tρu(y)=E[u(X)∣Y=y]T_\rho u(y)=\mathbb E[u(X)\mid Y=y]Tρ​u(y)=E[u(X)∣Y=y], so I(Tρu)=I(U;Y)I(T_\rho u)=I(U;Y)I(Tρ​u)=I(U;Y). For an interior field g:Ωn→(−1,1)g:\Omega_n\to(-1,1)g:Ωn​→(−1,1) with m=Egm=\mathbb Egm=Eg, the production is D(g)=E[atanh⁡(g) Ng]D(g)=\mathbb E[\operatorname{atanh}(g)\,Ng]D(g)=E[atanh(g)Ng] with Ng=12∑i(g−g∘flipi)Ng=\frac12\sum_i(g-g\circ\mathrm{flip}_i)Ng=21​∑i​(g−g∘flipi​); the rate FFF is defined by F(ψ(r))=ratanh⁡rF(\psi(r))=r\operatorname{atanh}rF(ψ(r))=ratanhr; S(I)=F(I)−2IS(I)=F(I)-2IS(I)=F(I)−2I (zero for I<0I<0I<0); Bm(I)=2I+(1−m2)S(L−H(m)−I1−m2)B_m(I)=2I+(1-m^2)S\bigl(L-\frac{H(m)-I}{1-m^2}\bigr)Bm​(I)=2I+(1−m2)S(L−1−m2H(m)−I​).

Formalization targets

Milestone: Courtade–Kumar inequality in bits (Corollary 1.2, p. 2)

For n≥1n\ge1n≥1, 0≤ε≤120\le\varepsilon\le\frac120≤ε≤21​ and every Boolean fff on {0,1}n\{0,1\}^n{0,1}n,

I2(f(X);Y)≤1−h2(ε),I_2(f(X);Y)\le 1-h_2(\varepsilon),I2​(f(X);Y)≤1−h2​(ε),

with equality for every coordinate x↦xix\mapsto x_ix↦xi​ and its complement.

Goal: the soft contraction package (Theorem 1.1, p. 1; Corollary 1.2, p. 2; Theorem 1.3, p. 4)

The goal OAI.SoftChannel204.fullMain is the conjunction of:

  1. Theorem 1.1. For all nnn, u:Ωn→[−1,1]u:\Omega_n\to[-1,1]u:Ωn​→[−1,1], ρ∈[−1,1]\rho\in[-1,1]ρ∈[−1,1]:
I(Tρu)≤ψ(∣ρ∣ ψ−1(I(u))),I(T_\rho u)\le\psi\bigl(|\rho|\,\psi^{-1}(I(u))\bigr),I(Tρ​u)≤ψ(∣ρ∣ψ−1(I(u))),

with equality for every soft coordinate u(x)=axiu(x)=a x_iu(x)=axi​, ∣a∣≤1|a|\le1∣a∣≤1; and I(U;Y)=I(Tρu)I(U;Y)=I(T_\rho u)I(U;Y)=I(Tρ​u) for the joint law of (U,Y)(U,Y)(U,Y). 2. Corollary 1.2. For Boolean fff with m=Efm=\mathbb Efm=Ef and rm=ψ−1(H(m))r_m=\psi^{-1}(H(m))rm​=ψ−1(H(m)): I(f(X);Y)≤ψ(∣ρ∣rm)≤ψ(∣ρ∣)I(f(X);Y)\le\psi(|\rho|r_m)\le\psi(|\rho|)I(f(X);Y)≤ψ(∣ρ∣rm​)≤ψ(∣ρ∣), strictly below ψ(∣ρ∣)\psi(|\rho|)ψ(∣ρ∣) when 0<∣m∣<10<|m|<10<∣m∣<1 and 0<∣ρ∣0<|\rho|0<∣ρ∣; coordinates and their negations attain ψ(∣ρ∣)\psi(|\rho|)ψ(∣ρ∣); and the bits conversion ψ(1−2ε)/L=1−h2(ε)\psi(1-2\varepsilon)/L=1-h_2(\varepsilon)ψ(1−2ε)/L=1−h2​(ε). 3. Theorem 1.3. For every interior ggg: D(g)≥max⁡{Bm(I(g)),F(I(g))}≥F(I(g))D(g)\ge\max\{B_m(I(g)),F(I(g))\}\ge F(I(g))D(g)≥max{Bm​(I(g)),F(I(g))}≥F(I(g)).

Significance

The result itself. It settles the Courtade–Kumar conjecture and strengthens it in two directions: to randomized summaries at fixed initial information, and to a bias-dependent bound that is strictly better for nonconstant biased outputs. Theorem 1.3 is a mean-dependent entropy-production inequality, stronger than the scalar rate needed for Theorem 1.1. Several independent proofs of the Boolean conjecture were announced in the same period; the preprint compares its production profile with that of Chen et al. in Section 8.

Formalizing it. All objects are finite sums over {−1,1}n\{-1,1\}^n{−1,1}n, so the statements are elementary to state in Lean. The proof requires an explicit three-point optimizer for a joining problem, convexity facts about FFF and SSS (Lemmas 2.2–2.4, pp. 5–6), dimension induction and integration along the noise semigroup. A formal proof would give a checked solution of a conjecture with several competing announced proofs, some computer-assisted.

Difficulty

The local-to-global method of Chen, Gohari and Nair needs a local inequality to pass from the two halves of the cube to the whole. The natural information-only profile Φm(I)=F(I)\Phi_m(I)=F(I)Φm​(I)=F(I) fails the corresponding local comparison for some coupled pair laws, so the induction must carry the mean mmm as well. The preprint uses the maximum of two profiles, BmB_mBm​ and FFF; it must solve the minimization of the joining cost exactly (Section 3), pay the interior pair with a variance-refined one-bit inequality (Lemma 4.1, p. 12), and control the common-output corners by a thinning argument (Theorem 6.1, p. 17). The linear bound D(g)≥2I(g)D(g)\ge2I(g)D(g)≥2I(g) from the log-Sobolev inequality does not suffice; the nonlinear surplus above 2I2I2I is where the difficulty lies.

Formalization scope

  • Cube n = Fin n → Bool, averages are finite sums divided by 2n2^n2n, logs are natural; sign maps Bool to ±1\pm1±1.
  • psiInv is Function.invFunOn psi (Icc 0 1); since ψ\psiψ is strictly increasing on [0,1][0,1][0,1] and I(u)∈[0,L]I(u)\in[0,L]I(u)∈[0,L], this is the paper's branch.
  • noise ρ u y = ∑ x, kernel ρ y x * u x with kernel the product of (1±ρ)/2(1\pm\rho)/2(1±ρ)/2, which is TρT_\rhoTρ​. Mutual information is the finite sum over the joint table, with terms omitted where the joint probability is 000.
  • F is stated as psiInv s * artanh (psiInv s) and is only used on [0,L)[0,L)[0,L); for interior ggg, ∣m∣<1|m|<1∣m∣<1 and 0≤I(g)<H(m)≤L0\le I(g)<H(m)\le L0≤I(g)<H(m)≤L, so reserve and hybrid are evaluated in their source domain.
  • All results hold for every n≥0n\ge0n≥0; the attainment statements quantify over i : Fin n. The milestone (separate definition file) uses the crossover form with bits.

Selected references

  • OpenAI, Sharp binary-information contraction on the discrete cube, OpenAI Math Release preprint, September 24, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Sharp-binary-information-contraction-on-the-discrete-cube-September-24-2026/main.pdf
  • T. A. Courtade, G. R. Kumar, Which Boolean functions maximize mutual information on noisy inputs?, IEEE Trans. Inf. Theory 60 (2014). https://doi.org/10.1109/TIT.2014.2326877
  • G. R. Kumar, T. A. Courtade, Which Boolean functions are most informative?, ISIT 2013. https://doi.org/10.1109/ISIT.2013.6620221
  • A. Samorodnitsky, On the entropy of a noisy function, IEEE Trans. Inf. Theory (2016). https://doi.org/10.1109/TIT.2016.2584625
  • O. Ordentlich, O. Shayevitz, O. Weinstein, An improved upper bound for the most informative Boolean function conjecture, ISIT 2016. https://doi.org/10.1109/ISIT.2016.7541349
  • G. Pichler, P. Piantanida, G. Matz, Dictator functions maximize mutual information, Ann. Appl. Probab. (2018). https://doi.org/10.1214/18-AAP1384
  • L. Yu, On the Φ\PhiΦ-stability and related conjectures, Probab. Theory Relat. Fields (2023). https://doi.org/10.1007/s00440-023-01209-5
  • A. Gohari, C. Nair, Outer bounds for multiuser settings: the auxiliary receiver approach, IEEE Trans. Inf. Theory (2022). https://doi.org/10.1109/TIT.2021.3128136
  • Z. Chen, A. Gohari, A. Javanmard, et al., A proof of the most informative Boolean function conjecture, arXiv:2609.24931 (2026). https://arxiv.org/abs/2609.24931
  • V. K. Ky, T. Tran, Dictators are most informative, arXiv:2609.24184 (2026). https://arxiv.org/abs/2609.24184
  • H. Mahdavifar, A. Beirami, The most informative bit and beyond, arXiv:2609.26444 (2026). https://arxiv.org/abs/2609.26444
  • S. G. Bobkov, P. Tetali, Modified logarithmic Sobolev inequalities in discrete settings, J. Theoret. Probab. (2006). https://doi.org/10.1007/s10959-006-0016-3
6 thms3 active usersReviewed
Machine LearningTheoretical Computer Science·Captain: mikedeng1

What Can We Learn Privately? I: The Exponential Mechanism Privately Agnostically Learns Any Finite Concept Class from O((ln|C| + ln(1/β))·max{1/(εα), 1/α²}) ExamplesResearch Paper

Motivation

Many learning tasks run on data about people: medical records, purchase histories, survey answers. A learner whose output reveals too much about any one training example is unusable on such data, however accurate it is. Differential privacy (Dwork, McSherry, Nissim and Smith, 2006) makes "reveals too much" precise: changing one individual's record may change the probability of any outcome of the algorithm by at most a factor eεe^{\varepsilon}eε.

Kasiviswanathan, Lee, Nissim, Raskhodnikova and Smith asked which concept classes can be learned under this constraint, and at what cost in examples. This mission formalizes their first answer (§3 of the paper): every finite concept class can be learned privately in the agnostic model, with a sample size that grows only logarithmically in the size of the class. The result is the private counterpart of the cardinality version of Occam's razor (Kearns and Vazirani, An Introduction to Computational Learning Theory, 1994, p. 35). The paper appeared in SIAM J. Comput. 40(3) (2011) 793–826, DOI 10.1137/090756090; all indices below are those of arXiv:0803.0924v3.

The learner is an instance of the exponential mechanism of McSherry and Talwar (FOCS 2007), which selects an output with probability exponentially weighted by a quality score.

Setting

A database of size nnn over a domain DDD is a vector z=(z1,…,zn)∈Dnz=(z_1,\dots,z_n)\in D^nz=(z1​,…,zn​)∈Dn. Databases z,z′z,z'z,z′ are neighbors if they differ in exactly one entry. A randomized algorithm AAA is described by the law A(z)A(z)A(z) of its output on each input. It is ε\varepsilonε-differentially private (Definition 2.1) if

Pr⁡[A(z)∈S]≤eεPr⁡[A(z′)∈S]\Pr[A(z)\in S]\le e^{\varepsilon}\Pr[A(z')\in S]Pr[A(z)∈S]≤eεPr[A(z′)∈S]

for all neighbors z,z′z,z'z,z′ and all measurable sets SSS of outputs.

Learning uses a finite set XXX of examples and labels {0,1}\{0,1\}{0,1}. A hypothesis is a map h:X→{0,1}h:X\to\{0,1\}h:X→{0,1}, and HHH is a finite nonempty class of hypotheses; in the theorem H=CdH=C_dH=Cd​, the concept class itself. Data are drawn i.i.d. from an arbitrary probability distribution PPP on X×{0,1}X\times\{0,1\}X×{0,1} (the agnostic setting, Definition 2.5). The error of hhh is err(h)=Pr⁡(x,y)∼P[h(x)≠y]\mathrm{err}(h)=\Pr_{(x,y)\sim P}[h(x)\neq y]err(h)=Pr(x,y)∼P​[h(x)=y], and OPT=min⁡f∈Herr(f)\mathrm{OPT}=\min_{f\in H}\mathrm{err}(f)OPT=minf∈H​err(f). On a database z=((xi,yi))i≤nz=((x_i,y_i))_{i\le n}z=((xi​,yi​))i≤n​ the score is q(z,h)=−∣{i:yi≠h(xi)}∣q(z,h)=-|\{i:y_i\neq h(x_i)\}|q(z,h)=−∣{i:yi​=h(xi​)}∣ and the training error is errT(h)=−q(z,h)/n\mathrm{err}_T(h)=-q(z,h)/nerrT​(h)=−q(z,h)/n.

The exponential mechanism Aqε\mathcal A^{\varepsilon}_qAqε​ outputs h∈Hh\in Hh∈H with probability proportional to exp⁡(εq(z,h)/2)\exp(\varepsilon q(z,h)/2)exp(εq(z,h)/2). In Lean these objects are IsDP, err, OPT, score, errT and expMech in the namespace PrivLearn.Generic.

Formalization targets

Goal: Theorem 3.4 (generic private learner)

There is an absolute constant C>0C>0C>0 such that for every finite XXX, every finite nonempty HHH, every ε>0\varepsilon>0ε>0 and all α,β∈(0,1/2)\alpha,\beta\in(0,1/2)α,β∈(0,1/2):

  1. Aqε\mathcal A^{\varepsilon}_qAqε​ is ε\varepsilonε-differentially private on databases of every size;
  2. for every distribution PPP on X×{0,1}X\times\{0,1\}X×{0,1} and every
n ≥ C(ln⁡∣H∣+ln⁡1β)max⁡{1εα,1α2},n\ \ge\ C\Big(\ln|H|+\ln\tfrac1\beta\Big)\max\Big\{\tfrac1{\varepsilon\alpha},\tfrac1{\alpha^2}\Big\},n ≥ C(ln∣H∣+lnβ1​)max{εα1​,α21​},

the mechanism run on nnn i.i.d. samples from PPP satisfies

Pr⁡[err(Aqε(z))>OPT+α]≤β.\Pr\big[\mathrm{err}(\mathcal A^{\varepsilon}_q(z))>\mathrm{OPT}+\alpha\big]\le\beta .Pr[err(Aqε​(z))>OPT+α]≤β.

The constant is left unspecified, as the paper's O(⋅)O(\cdot)O(⋅) leaves it. The qualitative first sentence of Theorem 3.4 (classes of size exp⁡(poly(d))\exp(\mathrm{poly}(d))exp(poly(d)) are privately agnostically learnable) follows at once, because then ln⁡∣H∣\ln|H|ln∣H∣ is polynomial in ddd.

Milestones

  • Lemma 3.3: Aqε\mathcal A^{\varepsilon}_qAqε​ is ε\varepsilonε-differentially private.
  • Theorem A.2: for i.i.d. Xi∈[a,b]X_i\in[a,b]Xi​∈[a,b] with mean μ\muμ, Pr⁡[∣1n∑iXi−μ∣≥δ]≤2exp⁡(−2δ2n/(b−a)2)\Pr[|\frac1n\sum_iX_i-\mu|\ge\delta]\le2\exp(-2\delta^2n/(b-a)^2)Pr[∣n1​∑i​Xi​−μ∣≥δ]≤2exp(−2δ2n/(b−a)2).
  • Uniform convergence (proof of Theorem 3.4, p. 11): Pr⁡[∃h∈H: ∣err(h)−errT(h)∣≥ρ]≤2∣H∣e−2nρ2\Pr[\exists h\in H:\ |\mathrm{err}(h)-\mathrm{err}_T(h)|\ge\rho]\le2|H|e^{-2n\rho^2}Pr[∃h∈H: ∣err(h)−errT​(h)∣≥ρ]≤2∣H∣e−2nρ2.
  • Exponential weights (proof of Theorem 3.4, p. 12): if ∣err(h)−errT(h)∣<ρ|\mathrm{err}(h)-\mathrm{err}_T(h)|<\rho∣err(h)−errT​(h)∣<ρ for all h∈Hh\in Hh∈H, then Aqε(z)\mathcal A^{\varepsilon}_q(z)Aqε​(z) outputs some hhh with errT(h)≥OPT+2ρ\mathrm{err}_T(h)\ge\mathrm{OPT}+2\rhoerrT​(h)≥OPT+2ρ with probability at most ∣H∣e−εnρ/2|H|e^{-\varepsilon n\rho/2}∣H∣e−εnρ/2.
  • Corollary 3.6: the same guarantee with ln⁡∣H∣\ln|H|ln∣H∣ replaced by VCDIM(Cd)⋅ln⁡∣X∣\mathrm{VCDIM}(C_d)\cdot\ln|X|VCDIM(Cd​)⋅ln∣X∣.

Significance

Theorem 3.4 shows that privacy costs little in sample complexity when computation is unconstrained. Any class that some learner with polynomially long output can learn is learnable privately from polynomially many examples. The non-private agnostic bound is O((log⁡∣Cd∣+log⁡(1/β))/α2)O((\log|C_d|+\log(1/\beta))/\alpha^2)O((log∣Cd​∣+log(1/β))/α2); the private one is larger by a factor O(α/ε)O(\alpha/\varepsilon)O(α/ε) when α>ε\alpha>\varepsilonα>ε, and is the same otherwise (Remark, p. 12). The theorem is the baseline the rest of the paper refines: an efficient private learner for parity (§4) and the equivalence of local privacy with statistical query learning (§5). It also underlies later work on the sample complexity of private learning, such as Beimel, Kasiviswanathan and Nissim (TCC 2010).

The result is proved in the paper; to our knowledge it has not been machine-checked. The mission produces a checked statement of the exponential mechanism's privacy and of its learning guarantee with an explicit dependence on ∣H∣|H|∣H∣, ε\varepsilonε, α\alphaα and β\betaβ. It also provides a reusable bounded i.i.d. Hoeffding inequality (Theorem A.2) in the form learning theory uses. Formalizing the proof with any explicit constant is welcome. The constant 666 printed at the end of the proof does not, by itself, make the last inequality close (the two error terms add to more than β\betaβ), so a correct constant is a genuine contribution.

Difficulty

Privacy and accuracy pull in opposite directions. Empirical risk minimization, the obvious learner, is not private: replacing one example can change which hypothesis minimizes the training error, and the output then changes with probability one. Smoothing the choice must not destroy accuracy, and the accuracy argument must hold simultaneously for every hypothesis in the class, with the mechanism's randomness and the sample's randomness combined into one failure probability. In Lean the measure-theoretic bookkeeping is non-trivial: the output is a measure on a function space, the failure probability integrates the mechanism's law against the product measure PnP^nPn, and the privacy bound must hold for every measurable event, not only for single hypotheses.

Formalization scope

  • Databases are vectors Fin n → X × Bool, indexed from 000; neighbors differ in exactly one coordinate.
  • Algorithms are output laws: Aqε(z)\mathcal A^{\varepsilon}_q(z)Aqε​(z) is the measure ∑h∈Hpz(h) δh\sum_{h\in H}p_z(h)\,\delta_h∑h∈H​pz​(h)δh​ on X → Bool with the product σ-algebra. It is a probability measure because HHH is nonempty and all weights are positive; the theorems assume HHH nonempty, and the definition does not build normalization in.
  • Privacy is required on every measurable set of outputs and for every database size nnn, with no assumption on how the data arise.
  • The example domain is a finite type with the discrete σ-algebra (the paper's XdX_dXd​ has representations of size at most ddd). The goal quantifies it over Type so that the absolute constant can precede it.
  • Labels are Bool, standing for {0,1}\{0,1\}{0,1}. Logarithms are natural (Real.log), as in the paper's ln⁡\lnln.
  • Parameters are ε>0\varepsilon>0ε>0 and α,β∈(0,1/2)\alpha,\beta\in(0,1/2)α,β∈(0,1/2) as in Definitions 2.4 and 3.1. The failure event is the strict err(h)>OPT+α\mathrm{err}(h)>\mathrm{OPT}+\alphaerr(h)>OPT+α, as on p. 11, and OPT is the minimum over H=CdH=C_dH=Cd​.
  • O(⋅)O(\cdot)O(⋅) is formalized as one absolute constant C>0C>0C>0 quantified before the domain, the class, the distribution and all parameters. A constant chosen after them would make the statement trivially true.
  • Theorem A.2 assumes measurable, mutually independent, pairwise identically distributed variables with values in [a,b][a,b][a,b] at every point. It makes no assumption n≥1n\ge1n≥1 or a<ba<ba<b; in those cases the right side is 222 by Lean's division conventions.
  • Corollary 3.6 uses the platform's VC dimension ComputationalLearning.vcDim (Kearns–Vazirani's Definition 9, the same notion as the paper's Definition 3.5) and references the platform's proved Sauer lemma.

Contributions welcome: proofs of any milestone, a measurable-structure library for finite output laws, and a general exponential-mechanism privacy theorem from which Lemma 3.3 follows.

Selected references

  • S. P. Kasiviswanathan, H. K. Lee, K. Nissim, S. Raskhodnikova, A. Smith, What Can We Learn Privately?, SIAM J. Comput. 40(3) (2011) 793–826. arXiv:0803.0924v3, DOI 10.1137/090756090
  • C. Dwork, F. McSherry, K. Nissim, A. Smith, Calibrating Noise to Sensitivity in Private Data Analysis, TCC 2006. DOI 10.1007/11681878_14
  • F. McSherry, K. Talwar, Mechanism Design via Differential Privacy, FOCS 2007. DOI 10.1109/FOCS.2007.66
  • W. Hoeffding, Probability Inequalities for Sums of Bounded Random Variables, J. Amer. Statist. Assoc. 58 (1963) 13–30. DOI 10.1080/01621459.1963.10500830
  • M. Kearns, U. Vazirani, An Introduction to Computational Learning Theory, MIT Press, 1994. DOI 10.7551/mitpress/3897.001.0001
  • A. Beimel, S. P. Kasiviswanathan, K. Nissim, Bounds on the Sample Complexity for Private Learning and Private Data Release, TCC 2010. DOI 10.1007/978-3-642-11799-2_26
10 thms3 active usersReviewed
Algorithmic Game TheoryOperations ResearchOptimization·Captain: mikedeng1

Consumer Returns Policies and Supply Chain Performance 2: Under Consumer Returns, the Differentiated Buy-Back with b − l = s Coordinates the Supply Chain and Gives the Retailer a Share φResearch Paper

Motivation

Retailers in many categories accept returns of products that are not defective: a consumer buys, learns whether the product suits them, and may send it back for a refund. Returns of this kind are a large cost item in retailing, and the refund a retailer offers is an operational decision on a par with its price and its stocking quantity. Xuanming Su, Consumer Returns Policies and Supply Chain Performance (SSRN 1020451, version of August 2008; published in Manufacturing & Service Operations Management 11(4), 2009, doi:10.1287/msom.1080.0240), studies this decision first for a single seller and then in a supply chain.

This mission formalizes the supply chain part, Section 5 of the paper. A classical result of supply chain contracting is that a manufacturer can align a retailer's ordering decision with the interest of the whole chain by a buy-back contract, which pays the retailer a credit for unsold units (Cachon, Supply Chain Coordination with Contracts, 2003). Su shows that once the retailer also sets a consumer returns policy, the standard buy-back no longer coordinates, and identifies three contracts that do. The companion mission (mission 1 of this series) formalizes the single-seller results of Sections 3–4, in particular Proposition 2, which gives the supply chain optimum used here.

Setting

A consumer who buys at price ppp learns a valuation VVV, drawn independently from a law ν\nuν with finite mean μ=EV\mu = EVμ=EV, and then either keeps the product or returns it for the refund rrr. Keeping is optimal when V≥rV \ge rV≥r. Write

Gˉ(r)=P(V≥r),G(r)=P(V<r),\bar G(r) = \mathbb P(V \ge r), \qquad G(r) = \mathbb P(V < r),Gˉ(r)=P(V≥r),G(r)=P(V<r),

for the probabilities of keeping and returning. A consumer's expected utility from buying is Emax⁡(V,r)E\max(V,r)Emax(V,r), which is therefore the reservation price: all consumers buy if p≤Emax⁡(V,r)p \le E\max(V,r)p≤Emax(V,r) and none buys otherwise (the demand rule (6)). Market demand X≥0X \ge 0X≥0 has distribution function FFF and Fˉ=1−F\bar F = 1 - FFˉ=1−F; a stock q≥0q \ge 0q≥0 sells Emin⁡(X,q)E\min(X,q)Emin(X,q) in expectation when consumers buy, and nothing when they do not. Write S(p,q,r)S(p,q,r)S(p,q,r) for these expected sales. The production cost is ccc, leftover and returned units are salvaged at sss, and 0≤s<c<μ0 \le s < c < \mu0≤s<c<μ.

The total supply chain profit is

ΠT(p,q,r)=[(p−s)Gˉ(r)+(p−r)G(r)] S(p,q,r)−(c−s)q.(15)\Pi_T(p,q,r) = [(p-s)\bar G(r) + (p-r)G(r)]\,S(p,q,r) - (c-s)q. \tag{15}ΠT​(p,q,r)=[(p−s)Gˉ(r)+(p−r)G(r)]S(p,q,r)−(c−s)q.(15)

A manufacturer sells to a retailer, who sets ppp, qqq and (except in Proposition 4) rrr. The contracts are:

  • standard buy-back (w,b)(w,b)(w,b): wholesale price www, credit bbb per leftover unit; the retailer earns (14);
  • differentiated buy-back (w,b,l)(w,b,l)(w,b,l): credit bbb per unsold unit and b−lb-lb−l per returned unit; the retailer earns
ΠR(p,q,r)=[(p−b)Gˉ(r)+(p−r−l)G(r)] S(p,q,r)−(w−b)q;(31)\Pi_R(p,q,r) = [(p-b)\bar G(r) + (p-r-l)G(r)]\,S(p,q,r) - (w-b)q; \tag{31}ΠR​(p,q,r)=[(p−b)Gˉ(r)+(p−r−l)G(r)]S(p,q,r)−(w−b)q;(31)
  • direct-to-manufacturer returns with a buy-back (w,b)(w,b)(w,b): consumers return to the manufacturer, who sets rrr; the profits are (19) and (21);
  • sales rebate (w,u)(w,u)(w,u): a rebate uuu per unit sold, returned or not; the retailer earns (25).

The supply chain optimum, from Proposition 2 of the paper, is

pSC=Emax⁡(V,s),Fˉ(qSC)=c−sEmax⁡(V,s)−s,rSC=s.p^{SC} = E\max(V,s), \qquad \bar F(q^{SC}) = \frac{c-s}{E\max(V,s)-s}, \qquad r^{SC} = s.pSC=Emax(V,s),Fˉ(qSC)=Emax(V,s)−sc−s​,rSC=s.

Formalization targets

Goal: Proposition 3 (p. 16)

For ϕ∈[0,1]\phi \in [0,1]ϕ∈[0,1] and ϕˉ=1−ϕ\bar\phi = 1-\phiϕˉ​=1−ϕ, the differentiated buy-back

w=ϕc+ϕˉ Emax⁡(V,s),b=ϕs+ϕˉ Emax⁡(V,s),b−l=sw = \phi c + \bar\phi\,E\max(V,s), \qquad b = \phi s + \bar\phi\,E\max(V,s), \qquad b - l = sw=ϕc+ϕˉ​Emax(V,s),b=ϕs+ϕˉ​Emax(V,s),b−l=s

makes the supply chain optimum a retailer optimum and gives the retailer the share ϕ\phiϕ:

ΠR(p,q,r)≤ΠR(pSC,qSC,rSC)  ∀p,r, q≥0,ΠR(pSC,qSC,rSC)=ϕ ΠT(pSC,qSC,rSC),\Pi_R(p,q,r) \le \Pi_R(p^{SC},q^{SC},r^{SC}) \ \ \forall p, r,\ q \ge 0, \qquad \Pi_R(p^{SC},q^{SC},r^{SC}) = \phi\,\Pi_T(p^{SC},q^{SC},r^{SC}),ΠR​(p,q,r)≤ΠR​(pSC,qSC,rSC)  ∀p,r, q≥0,ΠR​(pSC,qSC,rSC)=ϕΠT​(pSC,qSC,rSC),

and the contract is implementable: w≥bw \ge bw≥b, l≥0l \ge 0l≥0, b−l≥sb - l \ge sb−l≥s.

Milestones

  1. Under a standard buy-back the retailer's optimal refund is r∗=br^* = br∗=b (Sec. 5.1, p. 15).
  2. Under (31) the retailer's optimum is p∗=Emax⁡(V,b−l)p^* = E\max(V,b-l)p∗=Emax(V,b−l), Fˉ(q∗)=(w−b)/(Emax⁡(V,b−l)−b)\bar F(q^*) = (w-b)/(E\max(V,b-l)-b)Fˉ(q∗)=(w−b)/(Emax(V,b−l)−b), r∗=b−lr^* = b-lr∗=b−l (proof of Proposition 3, p. 27).
  3. Under (16)–(18), w−b=ϕ(c−s)w - b = \phi(c-s)w−b=ϕ(c−s) and Emax⁡(V,b−l)−b=ϕ[Emax⁡(V,s)−s]E\max(V,b-l) - b = \phi[E\max(V,s)-s]Emax(V,b−l)−b=ϕ[Emax(V,s)−s] ((32)–(33)).
  4. At (Emax⁡(V,s),q,s)(E\max(V,s), q, s)(Emax(V,s),q,s) the retailer earns ϕ ΠT\phi\,\Pi_TϕΠT​ ((34)–(39)).
  5. Retailer plus manufacturer profit under direct returns is ΠT\Pi_TΠT​ (Sec. 5.3, p. 17).
  6. Proposition 4: with direct-to-manufacturer returns and the buy-back (22)–(23), the chain optimum is a Nash equilibrium between retailer and manufacturer, with retailer share ϕ\phiϕ.
  7. Proposition 5: the sales rebate u=Emax⁡(V,s)−sc−s(w−c)u = \frac{E\max(V,s)-s}{c-s}(w-c)u=c−sEmax(V,s)−s​(w−c) makes the chain optimum a retailer optimum.
  8. With a rebate paid on kept units only, the retailer's optimal refund is r∗=s−u<sr^* = s - u < sr∗=s−u<s (Sec. 5.4, p. 19).

Significance

The results separate what a contract must observe in order to coordinate a chain with consumer returns: either the manufacturer distinguishes returned from unsold units (Propositions 3 and 4), or it observes sales (Proposition 5). The negative results (milestones 1 and 8) show why the standard buy-back and a kept-only rebate fail: each distorts the retailer's refund away from the salvage value. These statements are proved in the paper by short arguments; none of them has, to the knowledge of this mission, a machine-checked proof. Formalizing them yields a reusable model of a newsvendor with an endogenous price and refund under valuation uncertainty, and a checked account of the coordination conditions, including the boundary cases (ϕ=0\phi = 0ϕ=0, atoms in the valuation law) that the paper does not discuss.

Difficulty

Each result combines two optimizations, and neither is routine at the generality of the formal statements. The first is over price and refund jointly: the demand rule makes every profit discontinuous in ppp and rrr, and the refund problem must be solved for an arbitrary valuation law, where atoms make the tie rule at V=rV = rV=r matter. The second is a newsvendor problem in qqq for an arbitrary demand law: the paper writes the optimal stock as Fˉ−1\bar F^{-1}Fˉ−1 of a fractile, which presumes a continuous, strictly increasing FFF, whereas here FFF may jump or be flat and the optimal stock is any solution of the fractile equation. The obvious reduction, "the retailer's profit is ϕ ΠT\phi\,\Pi_TϕΠT​, so its maximizer is the chain's", is not available: that identity holds only at the chain's price and refund, and away from them the retailer's profit is not proportional to ΠT\Pi_TΠT​. In Proposition 4 the manufacturer's deviation to a refund below sss acts on the consumers' purchase decision, and the paper's remark that no one then buys is false when V≥sV \ge sV≥s almost surely, so that case needs its own argument.

Formalization scope

Prices, refunds, costs, quantities and profits are real numbers. The valuation law ν\nuν is a probability measure on R\mathbb RR with integrable identity (a strict generalization of the paper's density ggg); Gˉ(r)=ν([r,∞))\bar G(r) = \nu([r,\infty))Gˉ(r)=ν([r,∞)) and G(r)=ν((−∞,r))G(r) = \nu((-\infty,r))G(r)=ν((−∞,r)), matching the rule "keep iff V≥rV \ge rV≥r". The demand law DDD is a probability measure on R\mathbb RR with D((−∞,0))=0D((-\infty,0)) = 0D((−∞,0))=0, and Emin⁡(X,q)E\min(X,q)Emin(X,q) is SupplyChainTheory.expSales from the published module SupplyChainTheory_contracts. Every profit includes the demand rule (6): without it, (15) and (31) are unbounded in ppp. Optimization is over all real ppp and rrr and all q≥0q \ge 0q≥0, nonnegative stocks and demand being the paper's setting; with negative stocks the profits are unbounded. Optimality of the paper's closed-form triple is claimed, never uniqueness, and "induces the retailer to maximize supply chain profit" is stated as "the chain-optimal triple is a retailer optimum"; that the triple maximizes ΠT\Pi_TΠT​ is Proposition 2, formalized in mission 1, and not restated. The optimal stock is any solution of the fractile equation, and no continuity of DDD is assumed. The Nash equilibrium of Proposition 4 is written as the two best-response inequalities. Proposition 5 adds the hypothesis w≥sw \ge sw≥s, implied by the paper's range w≥cw \ge cw≥c (p. 19) and necessary: for w<sw < sw<s the retailer's profit is unbounded. The kept-only rebate of Sec. 5.4 has no printed formula; its profit is (24) with the rebate removed from the returned-units term. Printed page numbers equal PDF page numbers throughout the source. A formalization in which the retailer's profit is defined as ϕ ΠT\phi\,\Pi_TϕΠT​, or in which the optimization is restricted to r=sr = sr=s, would make the goal trivial and is excluded: (31) is stated with free www, bbb, lll, and the contract enters only through hypotheses.

The model module (SuReturns.Coordination.Model) restates the single-seller objects of mission 1 in this sub-namespace. Contributions welcome: proofs of the two optimization steps as reusable lemmas (the refund step for a general valuation law and the newsvendor step for an arbitrary demand law), which serve every milestone here.

Selected references

  • X. Su, Consumer Returns Policies and Supply Chain Performance, SSRN working paper 1020451, version of August 2008. https://ssrn.com/abstract=1020451 ; published in Manufacturing & Service Operations Management 11(4), 2009. https://doi.org/10.1287/msom.1080.0240
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in Operations Research and Management Science, vol. 11, 2003. https://doi.org/10.1016/S0927-0507(03)11006-7
  • B. A. Pasternack, Optimal Pricing and Return Policies for Perishable Commodities (the buy-back contract), Marketing Science 4(2), 1985. https://doi.org/10.1287/mksc.4.2.166
12 thms3 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization·Captain: mikedeng1

Convex Quadratic and Semidefinite Programming Relaxations in Scheduling I: Randomized Rounding of the Convex Quadratic Relaxation (CQP′) Is Within 3/2 for R | | Σ wⱼCⱼResearch Paper

Motivation

Scheduling jobs on unrelated parallel machines to minimize the total weighted completion time, the problem written R ∣ ∣∑wjCjR\,|\,|\sum w_jC_jR∣∣∑wj​Cj​ in the three-field notation, is one of the basic NP-hard models of machine scheduling. Each job may take a different time on each machine, as when heterogeneous processors, plants or crews serve the same pool of tasks, and the objective rewards finishing important jobs early. For a single machine the problem is solved exactly by Smith's ratio rule (Smith, 1956). With several unrelated machines the problem is strongly NP-hard and the question is how close to the optimum a polynomial-time algorithm can come.

Timeline of the guarantees for R ∣ ∣∑wjCjR\,|\,|\sum w_jC_jR∣∣∑wj​Cj​:

  • Lenstra, Shmoys and Tardos (1990) gave an LP-based 2-approximation for the makespan on unrelated machines; their assignment variables aija_{ij}aij​ are the ones used here.
  • Hall, Schulz, Shmoys and Wein (1997) gave constant-factor approximations for ∑wjCj\sum w_jC_j∑wj​Cj​ on unrelated machines via time-indexed and interval-indexed LP relaxations.
  • Schulz and Skutella (conference version 1999, journal 2002) obtained 3/2+ε3/2+\varepsilon3/2+ε by randomized rounding of a time-indexed LP.
  • Skutella (J. ACM 2001), the paper of this mission, gave a convex quadratic relaxation in assignment variables alone and a 3/23/23/2-approximation by randomized rounding, with a short analysis.
  • Bansal, Srinivasan and Svensson (2016) improved 3/23/23/2 to 3/2−ε3/2-\varepsilon3/2−ε for a small constant ε>0\varepsilon>0ε>0; later work lowered the constant further.

Setting

There are nnn jobs j∈Jj\in Jj∈J and mmm machines iii. Job jjj has a weight wj≥0w_j\ge 0wj​≥0 and a processing time pij>0p_{ij}>0pij​>0 on machine iii. A schedule assigns each job to one machine and orders the jobs on every machine; the completion time CjC_jCj​ of a job is the time at which it finishes when each machine works without idle time.

For a fixed assignment, Smith's ratio rule orders each machine optimally. Fix for each machine iii the total order j≺ikj\prec_i kj≺i​k iff wj/pij>wk/pikw_j/p_{ij}>w_k/p_{ik}wj​/pij​>wk​/pik​, ties broken by index. Under an assignment σ\sigmaσ the completion time of jjj is

Cj(σ)=pσ(j)j+∑k≺σ(j)j, σ(k)=σ(j)pσ(j)k,C_j(\sigma)=p_{\sigma(j)j}+\sum_{k\prec_{\sigma(j)}j,\ \sigma(k)=\sigma(j)}p_{\sigma(j)k},Cj​(σ)=pσ(j)j​+k≺σ(j)​j, σ(k)=σ(j)∑​pσ(j)k​,

and the problem is to minimize val(σ)=∑jwjCj(σ)\mathrm{val}(\sigma)=\sum_jw_jC_j(\sigma)val(σ)=∑j​wj​Cj​(σ) over all assignments.

With aij∈{0,1}a_{ij}\in\{0,1\}aij​∈{0,1} indicating that jjj runs on iii, the problem is the integer quadratic program (IQP) with objective

ZQP(a)=cTa+12aTDa,cij=wjpij,Z_{QP}(a)=c^Ta+\tfrac12a^TDa,\qquad c_{ij}=w_jp_{ij},ZQP​(a)=cTa+21​aTDa,cij​=wj​pij​,

where DDD is symmetric with entry wjpikw_jp_{ik}wj​pik​ at ((i,j),(i,k))((i,j),(i,k))((i,j),(i,k)) for k≺ijk\prec_ijk≺i​j and zero across machines and on the diagonal. Relaxing aij∈{0,1}a_{ij}\in\{0,1\}aij​∈{0,1} to a≥0a\ge 0a≥0 with ∑iaij=1\sum_ia_{ij}=1∑i​aij​=1 gives (QP). Raising the diagonal gives the convex program (CQP), with objective ZCQP(a)=12cTa+12aT(D+diag⁡(c))aZ_{CQP}(a)=\tfrac12c^Ta+\tfrac12a^T(D+\operatorname{diag}(c))aZCQP​(a)=21​cTa+21​aT(D+diag(c))a. Adding the lower bound cTac^TacTa gives (CQP′):

min⁡Zs.t.∑iaij=1,  a≥0,  Z≥ZCQP(a),  Z≥cTa.\min Z\quad\text{s.t.}\quad \textstyle\sum_ia_{ij}=1,\ \ a\ge 0,\ \ Z\ge Z_{CQP}(a),\ \ Z\ge c^Ta .minZs.t.∑i​aij​=1,  a≥0,  Z≥ZCQP​(a),  Z≥cTa.

Randomized rounding of a fractional aˉ\bar aaˉ sends job jjj to machine iii with probability aˉij\bar a_{ij}aˉij​, the choices being pairwise independent across jobs, and then orders every machine by ≺i\prec_i≺i​.

Formalization targets

Goal: (CQP′) is a relaxation, and rounding loses at most 3/2

For every instance with p>0p>0p>0, w≥0w\ge 0w≥0:

∀σ: (aσ, val(σ)) is feasible for (CQP′),\forall\sigma:\ (a^\sigma,\ \mathrm{val}(\sigma))\ \text{is feasible for (CQP′)},∀σ: (aσ, val(σ)) is feasible for (CQP′), ∀(aˉ,Z) feasible for (CQP′):E[∑jwjCj]≤32Z.\forall(\bar a,Z)\ \text{feasible for (CQP′)}:\quad \mathbb E\Bigl[\sum_jw_jC_j\Bigr]\le\tfrac32 Z .∀(aˉ,Z) feasible for (CQP′):E[j∑​wj​Cj​]≤23​Z.

The first part makes ZCQP′∗Z^*_{CQP'}ZCQP′∗​ a lower bound on the optimum. The second is Lemma 2.8. Together they are Corollary 2.9 and the value guarantee of the 3/23/23/2-approximation.

Milestones

In attack order:

  • Lemma 2.2: E[Cj]=∑i(Pr⁡[j↦i]pij+∑k≺ijPr⁡[j,k↦i]pik)\mathbb E[C_j]=\sum_i(\Pr[j\mapsto i]p_{ij}+\sum_{k\prec_ij}\Pr[j,k\mapsto i]p_{ik})E[Cj​]=∑i​(Pr[j↦i]pij​+∑k≺i​j​Pr[j,k↦i]pik​) for any random assignment.
  • Theorem 2.1: rounding a feasible aˉ\bar aaˉ has expected value exactly ZQP(aˉ)Z_{QP}(\bar a)ZQP​(aˉ).
  • Corollary 2.3: (IQP) and (QP) have the same optimum.
  • The positive semidefiniteness of D+diag⁡(c)D+\operatorname{diag}(c)D+diag(c) and Lemma 2.4: a↦(1−γ)cTa+12aT(D+2γdiag⁡(c))aa\mapsto(1-\gamma)c^Ta+\tfrac12a^T(D+2\gamma\operatorname{diag}(c))aa↦(1−γ)cTa+21​aT(D+2γdiag(c))a is convex for all instances iff γ≥12\gamma\ge\tfrac12γ≥21​.
  • The identity ZQP=ZCQP+12(cTa−aTdiag⁡(c)a)Z_{QP}=Z_{CQP}+\tfrac12(c^Ta-a^T\operatorname{diag}(c)a)ZQP​=ZCQP​+21​(cTa−aTdiag(c)a) and Theorem 2.6 a), the factor 222 for (CQP).
  • Lemma 2.8, the integrality step of Theorem 2.10, and Corollary 2.11, the bound (1+cTaˉ/(2Z))Z(1+c^T\bar a/(2Z))Z(1+cTaˉ/(2Z))Z.

Significance

The result gives a 3/23/23/2-approximation for R ∣ ∣∑wjCjR\,|\,|\sum w_jC_jR∣∣∑wj​Cj​ from a relaxation with only mnmnmn variables, without time indexing, so its size does not depend on the processing times. The same convexification, adapted to time slots, yields the factor 2 with release dates (§3 of the paper). The equality of Theorem 2.1 makes the analysis exact: the loss of rounding is exactly the gap between ZQPZ_{QP}ZQP​ and the convex objective. The relaxation also bounds the power of preemption (§4), and for identical machines it connects scheduling to Max-kkk-Cut (§6).

All these results are proved in the paper; none is known to be formalized. A formal development adds:

  • a checked model of Smith-sequenced assignment schedules;
  • the expectation calculus for pairwise independent rounding;
  • the positive-semidefiniteness argument of Lemma 2.4;
  • a precise statement of what the 3/23/23/2 guarantee says when complexity is set aside.

Difficulty

Two steps resist the obvious approach.

Positive semidefiniteness. DDD alone is indefinite: two jobs with unit data give the block (0110)\left(\begin{smallmatrix}0&1\\1&0\end{smallmatrix}\right)(01​10​). Positive semidefiniteness of D+diag⁡(c)D+\operatorname{diag}(c)D+diag(c) holds only because the jobs on each machine are ordered by Smith's ratio. A generic matrix argument that ignores this ordering fails, and the "only if" half of Lemma 2.4 needs a specific family of instances.

Exact expectations under pairwise independence. Theorem 2.1 is an equality that uses only the one- and two-job marginals. A proof that silently assumes full independence of the choices proves a different statement. A proof that drops the product condition on pairs is false: with correlated choices the expected value differs from ZQPZ_{QP}ZQP​.

Formalization scope

Jobs and machines are Fin n and Fin m; vectors in Rmn\mathbb R^{mn}Rmn are functions on Fin m × Fin n and DDD is a Matrix over that type. The order ≺i\prec_i≺i​ is cross-multiplied (wjpik>wkpijw_jp_{ik}>w_kp_{ij}wj​pik​>wk​pij​, or equality and j<kj<kj<k), which equals the page's ratio definition because p>0p>0p>0.

Standing assumptions of p. 2 are hypotheses of every theorem: pij>0p_{ij}>0pij​>0 and wj≥0w_j\ge0wj​≥0. Hypotheses added relative to the page:

  • Corollary 2.11 assumes Z>0Z>0Z>0, which its fraction presupposes;
  • the integrality step of Theorem 2.10 assumes integral ppp and www, as the page's proof does.

Optimum. The scheduling optimum Z∗Z^*Z∗ is the minimum of val\mathrm{val}val over assignments, by Smith's rule (p. 7, cited by the paper, not reproved). "Within a factor α\alphaα of the optimum" is stated as a bound against the value of every assignment, so no optimum is presupposed.

Rounding. Randomized rounding is any nonnegative weight μ\muμ of total mass 1 on assignments, with Pr⁡μ[j↦i]=aˉij\Pr_\mu[j\mapsto i]=\bar a_{ij}Prμ​[j↦i]=aˉij​ and Pr⁡μ[j↦i, k↦h]=aˉijaˉhk\Pr_\mu[j\mapsto i,\,k\mapsto h]=\bar a_{ij}\bar a_{hk}Prμ​[j↦i,k↦h]=aˉij​aˉhk​ for j≠kj\ne kj=k. The product weight satisfies this.

Not formalized. Polynomial running time, solvability of (CQP′) within additive error ε\varepsilonε (ellipsoid method), and derandomization by conditional probabilities. Theorem 2.10 is formalized as the existence of an outcome in the support of the rounding with the 3/23/23/2 guarantee.

Trivializing formalization ruled out. A bound E≤32Z\mathbb E\le\tfrac32ZE≤23​Z for an arbitrary number ZZZ says nothing about schedules. The goal therefore also states that every schedule is feasible for (CQP′) at its own value, so ZZZ is a genuine lower bound on the optimum.

Contributions welcome. A complete development needs:

  • linearity of expectation over a finite weight on assignments;
  • the computation of Lemma 2.2;
  • a positive-semidefiniteness criterion via principal minors or a direct sum-of-squares decomposition of aT(D+diag⁡(c))aa^T(D+\operatorname{diag}(c))aaT(D+diag(c))a;
  • convexity of quadratic forms with PSD matrices.

The rounding calculus and the PSD lemma are reusable for §§3–4 of the same paper. Alternative proofs of Lemma 2.4 are welcome.

Selected references

  • M. Skutella, Convex quadratic and semidefinite programming relaxations in scheduling, Journal of the ACM 48(2), 2001. https://doi.org/10.1145/375827.375840
  • W. E. Smith, Various optimizers for single-stage production, Naval Research Logistics Quarterly 3, 1956. https://doi.org/10.1002/nav.3800030106
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Mathematical Programming 46, 1990. https://doi.org/10.1007/BF01585745
  • L. A. Hall, A. S. Schulz, D. B. Shmoys, J. Wein, Scheduling to minimize average completion time: off-line and on-line approximation algorithms, Mathematics of Operations Research 22(3), 1997. https://doi.org/10.1287/moor.22.3.513
  • A. S. Schulz, M. Skutella, Scheduling unrelated machines by randomized rounding, SIAM Journal on Discrete Mathematics 15(4), 2002. https://doi.org/10.1137/S0895480199357078
  • N. Bansal, A. Srinivasan, O. Svensson, Lift-and-round to improve weighted completion time on unrelated machines, STOC 2016. https://doi.org/10.1145/2897518.2897572
12 thms3 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

Conditional Value-at-Risk for General Loss Distributions: β-CVaR Is min_α F_β(x, α), Attained on the Interval from β-VaR to Upper β-VaRResearch Paper

Motivation

Financial institutions, insurers and engineers who manage the risk of a decision describe it by a statistic of the loss distribution that the decision induces. The value-at-risk (VaR) at confidence level β\betaβ, the β\betaβ-quantile of the loss, became an industry and regulatory standard in the 1990s, but it is not subadditive and behaves erratically as a function of the decision when the loss distribution has atoms, as it always does in scenario-based models. The conditional value-at-risk (CVaR), roughly the average of the losses beyond VaR, was proposed as a replacement that is coherent in the sense of Artzner, Delbaen, Eber and Heath and that can be optimized.

In an earlier paper (Rockafellar and Uryasev, 2000) the same authors showed, for loss distributions with continuous distribution functions, that CVaR is the minimum value of an explicit convex function of one real variable, and that VaR is a minimizer. That formula turned CVaR minimization over a portfolio into a linear program and is the reason CVaR is used in practice. The paper formalized here (Rockafellar and Uryasev, Research Report #2001-5, 2001, published in J. Banking & Finance 2002) defines CVaR for general loss distributions, discrete ones included, and proves that the minimization formula survives.

Timeline.

  • 1997–1999: Artzner, Delbaen, Eber and Heath introduce coherent risk measures; VaR fails subadditivity.
  • 2000: Rockafellar and Uryasev prove the minimization formula for continuous loss distributions.
  • 2001–2002: the present paper, Theorem 10: the formula holds for every integrable loss once CVaR is defined as the mean of the β\betaβ-tail distribution. Acerbi and Tasche (2002) give an equivalent "expected shortfall" formulation.

Setting

A decision xxx lies in a set X⊆RnX\subseteq\mathbb R^nX⊆Rn; an uncertain outcome y∈Rmy\in\mathbb R^my∈Rm has a Borel probability law PPP that does not depend on xxx. The loss is z=f(x,y)z=f(x,y)z=f(x,y), where fff is continuous in xxx on XXX, measurable in yyy, and E{∣f(x,y)∣}<∞E\{|f(x,y)|\}<\inftyE{∣f(x,y)∣}<∞ for each x∈Xx\in Xx∈X. A confidence level β∈(0,1)\beta\in(0,1)β∈(0,1) is fixed.

  • The distribution function of the loss is Ψ(x,α)=P{y∣f(x,y)≤α}\Psi(x,\alpha)=P\{y\mid f(x,y)\le\alpha\}Ψ(x,α)=P{y∣f(x,y)≤α}, with left limit Ψ(x,α−)=P{y∣f(x,y)<α}\Psi(x,\alpha^-)=P\{y\mid f(x,y)<\alpha\}Ψ(x,α−)=P{y∣f(x,y)<α}.
  • The β\betaβ-VaR is αβ(x)=min⁡{α∣Ψ(x,α)≥β}\alpha_\beta(x)=\min\{\alpha\mid\Psi(x,\alpha)\ge\beta\}αβ​(x)=min{α∣Ψ(x,α)≥β} and the upper β\betaβ-VaR is αβ+(x)=inf⁡{α∣Ψ(x,α)>β}\alpha^+_\beta(x)=\inf\{\alpha\mid\Psi(x,\alpha)>\beta\}αβ+​(x)=inf{α∣Ψ(x,α)>β}.
  • The β\betaβ-tail distribution is the probability measure on R\mathbb RR with distribution function
Ψβ(x,α)={0,α<αβ(x),Ψ(x,α)−β1−β,α≥αβ(x).\Psi_\beta(x,\alpha)=\begin{cases}0,&\alpha<\alpha_\beta(x),\\ \dfrac{\Psi(x,\alpha)-\beta}{1-\beta},&\alpha\ge\alpha_\beta(x).\end{cases}Ψβ​(x,α)=⎩⎨⎧​0,1−βΨ(x,α)−β​,​α<αβ​(x),α≥αβ​(x).​
  • The β\betaβ-CVaR ϕβ(x)\phi_\beta(x)ϕβ​(x) is the mean of the β\betaβ-tail distribution.
  • The upper β\betaβ-CVaR is ϕβ+(x)=E{f(x,y)∣f(x,y)>αβ(x)}\phi^+_\beta(x)=E\{f(x,y)\mid f(x,y)>\alpha_\beta(x)\}ϕβ+​(x)=E{f(x,y)∣f(x,y)>αβ​(x)}, defined when Ψ(x,αβ(x))<1\Psi(x,\alpha_\beta(x))<1Ψ(x,αβ​(x))<1, and λβ(x)=[Ψ(x,αβ(x))−β]/[1−β]\lambda_\beta(x)=[\Psi(x,\alpha_\beta(x))-\beta]/[1-\beta]λβ​(x)=[Ψ(x,αβ​(x))−β]/[1−β].
  • Finally
Fβ(x,α)=α+11−β E{[f(x,y)−α]+},[t]+=max⁡{0,t}.F_\beta(x,\alpha)=\alpha+\frac{1}{1-\beta}\,E\big\{[f(x,y)-\alpha]^+\big\},\qquad[t]^+=\max\{0,t\}.Fβ​(x,α)=α+1−β1​E{[f(x,y)−α]+},[t]+=max{0,t}.

When Ψ(x,⋅)\Psi(x,\cdot)Ψ(x,⋅) jumps across β\betaβ at αβ(x)\alpha_\beta(x)αβ​(x), the tail distribution keeps only the part λβ(x)\lambda_\beta(x)λβ​(x) of that atom needed to give the tail total mass one: the atom is split.

Formalization targets

Goal: Theorem 10 (fundamental minimization formula)

For each x∈Xx\in Xx∈X: Fβ(x,⋅)F_\beta(x,\cdot)Fβ​(x,⋅) is finite and convex (hence continuous), and

ϕβ(x)=min⁡α∈RFβ(x,α),argmin⁡αFβ(x,α)=[αβ(x),αβ+(x)],\phi_\beta(x)=\min_{\alpha\in\mathbb R}F_\beta(x,\alpha),\qquad \operatorname{argmin}_\alpha F_\beta(x,\alpha)=[\alpha_\beta(x),\alpha^+_\beta(x)],ϕβ​(x)=α∈Rmin​Fβ​(x,α),argminα​Fβ​(x,α)=[αβ​(x),αβ+​(x)],

the minimum being attained and the argmin a nonempty closed bounded interval; in particular ϕβ(x)=Fβ(x,αβ(x))\phi_\beta(x)=F_\beta(x,\alpha_\beta(x))ϕβ​(x)=Fβ​(x,αβ​(x)).

Milestones, in attack order

  1. The note after Definition 3: Ψβ(x,⋅)\Psi_\beta(x,\cdot)Ψβ​(x,⋅) is a distribution function, so the β\betaβ-tail distribution exists; its mean is finite.
  2. Proposition 6: ϕβ(x)=λβ(x)αβ(x)+[1−λβ(x)]ϕβ+(x)\phi_\beta(x)=\lambda_\beta(x)\alpha_\beta(x)+[1-\lambda_\beta(x)]\phi^+_\beta(x)ϕβ​(x)=λβ​(x)αβ​(x)+[1−λβ​(x)]ϕβ+​(x) when Ψ(x,αβ(x))<1\Psi(x,\alpha_\beta(x))<1Ψ(x,αβ​(x))<1, and ϕβ(x)=αβ(x)\phi_\beta(x)=\alpha_\beta(x)ϕβ​(x)=αβ​(x) otherwise.
  3. Fβ(x,⋅)F_\beta(x,\cdot)Fβ​(x,⋅) is finite and convex.
  4. The one-sided derivatives (31): ∂+Fβ/∂α=[Ψ(x,α)−β]/(1−β)\partial^+F_\beta/\partial\alpha=[\Psi(x,\alpha)-\beta]/(1-\beta)∂+Fβ​/∂α=[Ψ(x,α)−β]/(1−β) and ∂−Fβ/∂α=[Ψ(x,α−)−β]/(1−β)\partial^-F_\beta/\partial\alpha=[\Psi(x,\alpha^-)-\beta]/(1-\beta)∂−Fβ​/∂α=[Ψ(x,α−)−β]/(1−β).
  5. Bounded level sets, and argmin⁡αFβ(x,α)={α∣Ψ(x,α−)≤β≤Ψ(x,α)}\operatorname{argmin}_\alpha F_\beta(x,\alpha)=\{\alpha\mid\Psi(x,\alpha^-)\le\beta\le\Psi(x,\alpha)\}argminα​Fβ​(x,α)={α∣Ψ(x,α−)≤β≤Ψ(x,α)}, a nonempty closed bounded interval.
  6. The least element of that set is αβ(x)\alpha_\beta(x)αβ​(x) and the greatest is αβ+(x)\alpha^+_\beta(x)αβ+​(x).

A companion item states Corollary 7: ϕβ(x)≥αβ(x)\phi_\beta(x)\ge\alpha_\beta(x)ϕβ​(x)≥αβ​(x), strictly when Ψ(x,αβ(x))<1\Psi(x,\alpha_\beta(x))<1Ψ(x,αβ​(x))<1.

Significance

Theorem 10 is what makes CVaR computable and optimizable. Since ϕβ(x)=min⁡αFβ(x,α)\phi_\beta(x)=\min_\alpha F_\beta(x,\alpha)ϕβ​(x)=minα​Fβ​(x,α), minimizing CVaR over x∈Xx\in Xx∈X is the joint minimization of Fβ(x,α)F_\beta(x,\alpha)Fβ​(x,α) over (x,α)(x,\alpha)(x,α); with a finite scenario set and a loss linear in xxx, that is a linear program, and VaR comes out as a by-product. The convexity and sublinearity of CVaR in xxx (Corollary 11), its coherence (Corollary 12) and the equivalence of CVaR-constrained and CVaR-penalized problems (Theorem 14) are all derived from it. The formula is the basis of CVaR portfolio optimization software and of a large literature on risk-averse stochastic programming.

The result has been proved since 2001 and is not open. To our knowledge it has no machine-checked proof with CVaR defined independently: the CVaR items already on Prove2Me take min⁡αFβ\min_\alpha F_\betaminα​Fβ​ as the definition of CVaR, which makes (28) true by definition. This mission produces a formal proof that the tail-mean definition, with its atom splitting, agrees with the minimization formula for every integrable loss, together with reusable facts about one-sided derivatives of α↦E[f−α]+\alpha\mapsto E[f-\alpha]^+α↦E[f−α]+ and the argmin of the Rockafellar–Uryasev function.

Difficulty

The minimization side is elementary convex analysis in one variable once the one-sided derivatives are known; computing them requires passing a limit under the expectation, with the jumps of Ψ(x,⋅)\Psi(x,\cdot)Ψ(x,⋅) handled separately for right and left limits. The step that does not follow from that analysis is the identification of the minimum value with ϕβ(x)\phi_\beta(x)ϕβ​(x). When the loss has an atom at αβ(x)\alpha_\beta(x)αβ​(x) that straddles level β\betaβ, neither E{f∣f≥αβ(x)}E\{f\mid f\ge\alpha_\beta(x)\}E{f∣f≥αβ​(x)} nor E{f∣f>αβ(x)}E\{f\mid f>\alpha_\beta(x)\}E{f∣f>αβ​(x)} equals the minimum value; only the mean of the distribution with the split atom does. The obvious approach, proving the formula for continuous laws and passing to a limit, does not deliver the identity at the level of the defined objects; the identity has to be proved directly from the definition of the tail distribution, through Proposition 6.

Formalization scope

  • The outcome space is Rm\mathbb R^mRm (Fin m → ℝ) with its Borel σ-algebra and a probability measure P. The paper's support set Y⊆RmY\subseteq\mathbb R^mY⊆Rm is not modelled: a law on YYY is a law on Rm\mathbb R^mRm concentrated on YYY, and no statement uses YYY.
  • Probabilities are real numbers (P.real). Ψ(x,α−)\Psi(x,\alpha^-)Ψ(x,α−) is P{f(x,⋅)<α}P\{f(x,\cdot)<\alpha\}P{f(x,⋅)<α}, as the paper defines it in (2).
  • αβ(x)\alpha_\beta(x)αβ​(x) is the published MultistageStochastic.valueAtRisk P (f x) β (a real infimum, referenced, not redefined); αβ+(x)\alpha^+_\beta(x)αβ+​(x) is a real infimum. Both are meaningful because PPP is a probability measure and 0<β<10<\beta<10<β<1, and those hypotheses are carried wherever they appear.
  • The β\betaβ-tail distribution is a probability measure on R\mathbb RR whose distribution function is Ψβ(x,⋅)\Psi_\beta(x,\cdot)Ψβ​(x,⋅), chosen when one exists (it is then unique); ϕβ(x)\phi_\beta(x)ϕβ​(x) is its mean. Milestone 1 establishes existence and integrability.
  • "Minimum" is attainment: ϕβ(x)\phi_\beta(x)ϕβ​(x) is the least element of the range of Fβ(x,⋅)F_\beta(x,\cdot)Fβ​(x,⋅). The argmin is the set of global minimizers. "Finite" is integrability of [f(x,⋅)−α]+[f(x,\cdot)-\alpha]^+[f(x,⋅)−α]+ for each α\alphaα.
  • One-sided derivatives are derivatives within [α,∞)[\alpha,\infty)[α,∞) and (−∞,α](-\infty,\alpha](−∞,α]. The display (31) as printed on p. 14 has αβ(x)\alpha_\beta(x)αβ​(x) in place of α\alphaα; the formalization follows the derivation on p. 15.
  • The goal and Corollary 7 carry all standing assumptions of §2; milestones assume only what they use (integrability, measurability of the single loss f(x,⋅)f(x,\cdot)f(x,⋅)), which makes them stronger.

Defining CVaR as min⁡αFβ(x,α)\min_\alpha F_\beta(x,\alpha)minα​Fβ​(x,α), or as the quantile average, or by formula (21), would make the goal or a milestone true by definition; CVaR is defined here as the mean of the β\betaβ-tail distribution, and any such redefinition is ruled out.

A complete development needs: right-continuity and limits of distribution functions, dominated convergence for the difference quotients of α↦E[f−α]+\alpha\mapsto E[f-\alpha]^+α↦E[f−α]+, the uniqueness of a probability measure on R\mathbb RR with given distribution function, and one-variable convex analysis linking one-sided derivatives to minimizers. The derivative and argmin lemmas are reusable for any Rockafellar–Uryasev-type objective. Proofs of any milestone, and Lean lemmas that bridge valueAtRisk (stated with ENNReal) and P.real, are welcome.

Selected references

  • R. T. Rockafellar and S. Uryasev, Conditional value-at-risk for general loss distributions, Research Report #2001-5, ISE Dept., University of Florida, April 2001; published in Journal of Banking & Finance 26 (2002) 1443–1471. https://doi.org/10.1016/S0378-4266(02)00271-6
  • R. T. Rockafellar and S. Uryasev, Optimization of conditional value-at-risk, Journal of Risk 2 (2000) 21–41. https://doi.org/10.21314/JOR.2000.038
  • P. Artzner, F. Delbaen, J.-M. Eber and D. Heath, Coherent measures of risk, Mathematical Finance 9 (1999) 203–228. https://doi.org/10.1111/1467-9965.00068
  • C. Acerbi and D. Tasche, On the coherence of expected shortfall, Journal of Banking & Finance 26 (2002) 1487–1503. https://doi.org/10.1016/S0378-4266(02)00283-2
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970. https://doi.org/10.1515/9781400873173
9 thms3 active usersReviewed
Markov ChainStochastic Systems·Captain: mikedeng1

The Two-Parameter Poisson–Dirichlet Distribution Derived from a Stable Subordinator 5: PD(α, θ) Is a Y_1^θ-Tilt of Independent beta(θ + nα, 1) Ratios, and (Y_n) Is a Markov ChainResearch Paper

Motivation

The two-parameter Poisson–Dirichlet distribution PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) is a law on decreasing sequences V1≥V2≥⋯>0V_1 \ge V_2 \ge \cdots > 0V1​≥V2​≥⋯>0 with ∑nVn=1\sum_n V_n = 1∑n​Vn​=1. It describes the ranked frequencies of species in Bayesian nonparametric models (the Pitman–Yor process), the ranked lengths of excursions of Bessel processes and bridges, and the ranked cycle or block sizes in random combinatorial structures. The case α=0\alpha = 0α=0 is Kingman's one-parameter family PD(θ)\mathrm{PD}(\theta)PD(θ), the law of the ranked frequencies in the Ewens sampling formula.

For PD(0,θ)\mathrm{PD}(0,\theta)PD(0,θ), Vershik and Shmidt ([67]) and Ignatov ([34]) found a Markov description: the residual fractions Yn=Vn/(Vn+Vn+1+⋯ )Y_n = V_n/(V_n + V_{n+1} + \cdots)Yn​=Vn​/(Vn​+Vn+1​+⋯) form a homogeneous Markov chain, and the law is the Y1θY_1^\thetaY1θ​-tilt of a stationary chain built from independent beta(θ,1)\mathrm{beta}(\theta,1)beta(θ,1) ratios. For PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0), Proposition 8 of Pitman and Yor shows that the ratios Rn=Vn+1/VnR_n = V_{n+1}/V_nRn​=Vn+1​/Vn​ themselves are independent beta(nα,1)\mathrm{beta}(n\alpha,1)beta(nα,1) variables. Theorem 38 of Pitman and Yor (Ann. Probab. 25 (1997) 855–900) unifies both descriptions for the whole two-parameter family.

Timeline. Vershik and Shmidt (1977, 1978, [66, 67]) and Ignatov (1982, [34]) described the size-ordered PD(0,θ)\mathrm{PD}(0,\theta)PD(0,θ) frequencies through the Markov chain (Yn)(Y_n)(Yn​); Ignatov showed that results of Vervaat and Watterson give the normalizing constant K0,θ=Γ(θ+1)eθγK_{0,\theta} = \Gamma(\theta+1)e^{\theta\gamma}K0,θ​=Γ(θ+1)eθγ (132). Much of this was known earlier for θ=1\theta = 1θ=1, the case arising in combinatorics and number theory. Perman, Pitman and Yor (1992, [51]) proved the absolute continuity of PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) with respect to PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) (Proposition 14 here). Pitman and Yor (1997) announced the two-parameter Markov description as Theorem 15 and proved it as Theorem 38 for 0<α<10<\alpha<10<α<1, quoting the case α=0\alpha = 0α=0 (Remark 40).

Setting

Fix 0<α<10 < \alpha < 10<α<1 and θ>−α\theta > -\alphaθ>−α. The beta distribution beta(a,b)\mathrm{beta}(a,b)beta(a,b) (a,b>0a,b>0a,b>0) has density Γ(a+b)Γ(a)Γ(b)xa−1(1−x)b−1\frac{\Gamma(a+b)}{\Gamma(a)\Gamma(b)}x^{a-1}(1-x)^{b-1}Γ(a)Γ(b)Γ(a+b)​xa−1(1−x)b−1 on (0,1)(0,1)(0,1). Let Y~1,Y~2,…\tilde Y_1, \tilde Y_2, \dotsY~1​,Y~2​,… be independent with Y~n∼beta(1−α,θ+nα)\tilde Y_n \sim \mathrm{beta}(1-\alpha, \theta+n\alpha)Y~n​∼beta(1−α,θ+nα), and put V~1=Y~1\tilde V_1 = \tilde Y_1V~1​=Y~1​, V~n=(1−Y~1)⋯(1−Y~n−1)Y~n\tilde V_n = (1-\tilde Y_1)\cdots(1-\tilde Y_{n-1})\tilde Y_nV~n​=(1−Y~1​)⋯(1−Y~n−1​)Y~n​. The ranked values V1≥V2≥⋯V_1 \ge V_2 \ge \cdotsV1​≥V2​≥⋯ of (V~n)(\tilde V_n)(V~n​) have, by Definition 1, the law PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ); Pα,θP_{\alpha,\theta}Pα,θ​ denotes a probability under which (Vn)(V_n)(Vn​) has this law, and Eα,θE_{\alpha,\theta}Eα,θ​ its expectation.

From (Vn)(V_n)(Vn​) define the ratios Rn=Vn+1/VnR_n = V_{n+1}/V_nRn​=Vn+1​/Vn​ (21), the residual fractions Yn=Vn/(Vn+Vn+1+⋯ )Y_n = V_n/(V_n+V_{n+1}+\cdots)Yn​=Vn​/(Vn​+Vn+1​+⋯) (45), and Σ1=(1−V1)/V1\Sigma_1 = (1-V_1)/V_1Σ1​=(1−V1​)/V1​. Conversely, from ratios define

Yn=(1+Rn+RnRn+1+⋯ )−1(125).Y_n = (1 + R_n + R_nR_{n+1} + \cdots)^{-1} \qquad (125).Yn​=(1+Rn​+Rn​Rn+1​+⋯)−1(125).

The local time is L=lim⁡n→∞nVnαL = \lim_{n\to\infty} nV_n^\alphaL=limn→∞​nVnα​ (24).

The comparison law Pα,θ∗P^*_{\alpha,\theta}Pα,θ∗​ makes R1,R2,…R_1, R_2, \dotsR1​,R2​,… independent with Rn∼beta(θ+nα,1)R_n \sim \mathrm{beta}(\theta+n\alpha,1)Rn​∼beta(θ+nα,1), and YnY_nYn​ is then defined by (125). Constants and functions:

Kα,θ=Γ(θ+1)Γ(1−α)θ/α,Cα,θ=Kα,θΓ(θ/α+1),ψα(λ)=1+α∫01(1−e−λx)x−α−1dx.K_{\alpha,\theta} = \Gamma(\theta+1)\Gamma(1-\alpha)^{\theta/\alpha}, \qquad C_{\alpha,\theta} = \frac{K_{\alpha,\theta}}{\Gamma(\theta/\alpha+1)}, \qquad \psi_\alpha(\lambda) = 1 + \alpha\int_0^1(1-e^{-\lambda x})x^{-\alpha-1}dx.Kα,θ​=Γ(θ+1)Γ(1−α)θ/α,Cα,θ​=Γ(θ/α+1)Kα,θ​​,ψα​(λ)=1+α∫01​(1−e−λx)x−α−1dx.

Formalization targets

Goal: Theorem 38 for 0<α<10<\alpha<10<α<1

Eα,θ[f(Y1,Y2,… )]=Kα,θ Eα,θ∗[Y1θf(Y1,Y2,… )](137)E_{\alpha,\theta}[f(Y_1,Y_2,\dots)] = K_{\alpha,\theta}\,E^*_{\alpha,\theta}[Y_1^\theta f(Y_1,Y_2,\dots)] \qquad (137)Eα,θ​[f(Y1​,Y2​,…)]=Kα,θ​Eα,θ∗​[Y1θ​f(Y1​,Y2​,…)](137)

for every nonnegative product measurable fff; under both Pα,θP_{\alpha,\theta}Pα,θ​ and Pα,θ∗P^*_{\alpha,\theta}Pα,θ∗​ the sequence (Yn)(Y_n)(Yn​) is a Markov chain with the same forward transition probabilities, with density

P(Yn+1∈dyn+1∣Yn=yn)dyn+1=α yn−α−1(1−yn)nα+θ−1r(α,θ+nα,yn+1)r(α,θ+nα−α,yn)(139)\frac{P(Y_{n+1}\in dy_{n+1}\mid Y_n = y_n)}{dy_{n+1}} = \alpha\,y_n^{-\alpha-1}(1-y_n)^{n\alpha+\theta-1}\frac{r(\alpha,\theta+n\alpha,y_{n+1})}{r(\alpha,\theta+n\alpha-\alpha,y_n)} \qquad (139)dyn+1​P(Yn+1​∈dyn+1​∣Yn​=yn​)​=αyn−α−1​(1−yn​)nα+θ−1r(α,θ+nα−α,yn​)r(α,θ+nα,yn+1​)​(139)

on 0<yn<10<y_n<10<yn​<1, 0<yn+1<yn/(1−yn)0<y_{n+1}<y_n/(1-y_n)0<yn+1​<yn​/(1−yn​), where r(α,θ,y) dy=Γ(θ/α+1)yθPα,θ∗(Y1∈dy)=Cα,θ−1Pα,θ(V1∈dy)r(\alpha,\theta,y)\,dy = \Gamma(\theta/\alpha+1)y^\theta P^*_{\alpha,\theta}(Y_1\in dy) = C^{-1}_{\alpha,\theta}P_{\alpha,\theta}(V_1\in dy)r(α,θ,y)dy=Γ(θ/α+1)yθPα,θ∗​(Y1​∈dy)=Cα,θ−1​Pα,θ​(V1​∈dy) (140); and the Pα,θ∗P^*_{\alpha,\theta}Pα,θ∗​ law of Σ1\Sigma_1Σ1​ is infinitely divisible with

Eα,θ∗[e−λΣ1]=ψα(λ)−(θ/α+1)(141).E^*_{\alpha,\theta}[e^{-\lambda\Sigma_1}] = \psi_\alpha(\lambda)^{-(\theta/\alpha+1)} \qquad (141).Eα,θ∗​[e−λΣ1​]=ψα​(λ)−(θ/α+1)(141).

Milestones

Proposition 8 (Pα,0=Pα,0∗P_{\alpha,0} = P^*_{\alpha,0}Pα,0​=Pα,0∗​ on the ratios), Proposition 14 (the density Cα,θLθ/αC_{\alpha,\theta}L^{\theta/\alpha}Cα,θ​Lθ/α of PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) relative to PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0)), the moments (30) of LLL, the representation (143) of LLL through the ratios, the finite-dimensional change of measure (144), its limit (145), Proposition 37 (independent ratios give a Markov chain (Yn)(Y_n)(Yn​), with co-transition density (128)), the parameter shift (146), and the conditional Laplace transform of Σ1\Sigma_1Σ1​ given X1=LV1−αX_1 = LV_1^{-\alpha}X1​=LV1−α​.

Significance

The result. Theorem 38 reduces the size-ordered PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) frequencies to a product of independent beta variables, up to a density Kα,θY1θK_{\alpha,\theta}Y_1^\thetaKα,θ​Y1θ​ that depends on Y1Y_1Y1​ alone. Any functional of the ranked frequencies can therefore be computed under a product measure. The Markov property gives the joint density of Y1,…,YnY_1,\dots,Y_nY1​,…,Yn​ (Corollary 41), the laws of individual VnV_nVn​ (148), and the asymptotics of YnY_nYn​ and Σn\Sigma_nΣn​ in §7.3 of the paper. Part (iii) identifies the law of (1−V1)/V1(1-V_1)/V_1(1−V1​)/V1​ under Pα,θ∗P^*_{\alpha,\theta}Pα,θ∗​, which determines the density of the largest frequency V1V_1V1​ under PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ).

The formalization. The result has been proved since 1997; none of it is machine-checked. The mission formalizes the paper's own route: absolute continuity (Proposition 14), the beta product structure (Proposition 8), and a limit of finite-dimensional density ratios. It produces reusable statements about real-valued Markov chains defined through conditional laws, and about changes of measure between infinite products. Note that the printed (139) omits the factor α\alphaα; the formal statement includes it (see Formalization scope).

Difficulty

The finite-dimensional change of measure (144) is an exact computation, but its density (R1⋯Rn)θ(R_1\cdots R_n)^\theta(R1​⋯Rn​)θ degenerates as n→∞n\to\inftyn→∞. Passing to the limit (145) requires identifying the limit of the rescaled densities nθ/α(R1⋯Rn)θn^{\theta/\alpha}(R_1\cdots R_n)^\thetanθ/α(R1​⋯Rn​)θ with Lθ/αY1−θL^{\theta/\alpha}Y_1^{-\theta}Lθ/αY1−θ​, and an almost sure limit of densities does not by itself give the identity of expectations. A second obstacle is that the Markov property of (Yn)(Y_n)(Yn​) under Pα,θP_{\alpha,\theta}Pα,θ​ does not follow from any independence under Pα,θP_{\alpha,\theta}Pα,θ​ itself; it is transported from Pα,θ∗P^*_{\alpha,\theta}Pα,θ∗​ through a density that is a function of Y1Y_1Y1​ only, and the transported kernels must be shown to be the same. Part (iii) needs the Laplace transform of 1/V11/V_11/V1​ conditioned on X1X_1X1​, which comes from the Poisson structure of PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0).

Formalization scope

Sequences are ℕ → ℝ, 0-based: V ω k is Vk+1V_{k+1}Vk+1​, Yseq v k and YofR r k are Yk+1Y_{k+1}Yk+1​. "(Vn)(V_n)(Vn​) has PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) law" (HasPD) means that measures of preimages of measurable sets agree with those of the ranked stick-breaking map under an independent beta product (IsStickLaw); ranking counts exceedances with Set.encard. Pα,θ∗P^*_{\alpha,\theta}Pα,θ∗​ is any probability measure on ℕ → ℝ with independent coordinates of the stated beta laws (IsStarLaw); it is defined directly as a product, never through Pα,θP_{\alpha,\theta}Pα,θ​. The local time LLL is a random variable given with its defining almost sure limit (24). A Markov chain with forward kernels κn\kappa_nκn​ (IsMarkovWith) is stated through the defining identity E[g(Y1..Yn)h(Yn+1)]=E[g(Y1..Yn)∫h dκn(Yn)]E[g(Y_1..Y_n)h(Y_{n+1})] = E[g(Y_1..Y_n)\int h\,d\kappa_n(Y_n)]E[g(Y1​..Yn​)h(Yn+1​)]=E[g(Y1​..Yn​)∫hdκn​(Yn​)]; Theorem 38 (ii) asks for one family of Markov kernels serving both laws. The function rrr of (140) is a hypothesis: any function giving the density of Y1Y_1Y1​ under each Pα,θ+kα∗P^*_{\alpha,\theta+k\alpha}Pα,θ+kα∗​.

Committed deviations: the goal is the case 0<α<10<\alpha<10<α<1, the case the paper proves (the case α=0\alpha=0α=0 is quoted from [67], [34]); (139) carries the factor α\alphaα that Bayes' rule from (128), (146) and the beta densities produces, and that Corollary 41's αn−1\alpha^{n-1}αn−1 confirms; (30) omits its middle expression CpE(Σ−αp)C^pE(\Sigma^{-\alpha p})CpE(Σ−αp). Every expectation of a nonnegative quantity is a lower Lebesgue integral, so no identity can hold through the junk value of a non-integrable Bochner integral; no law is written as Measure.map of a possibly non-measurable function; no limit is taken with limUnder; and the parameter range 0<α<10<\alpha<10<α<1, θ>−α\theta>-\alphaθ>−α is a hypothesis of every statement that uses it.

Contributions welcome: the product-measure and beta-density computations behind (144) and (146), the limit passage (145), the Markov property of functions of independent sequences (Proposition 37), and the transfer of a Markov property through a density depending on the first coordinate.

Selected references

  • J. Pitman and M. Yor, The two-parameter Poisson–Dirichlet distribution derived from a stable subordinator, Ann. Probab. 25(2) (1997), 855–900. https://doi.org/10.1214/aop/1024404422
  • A. M. Vershik and A. A. Shmidt, Limit measures arising in the theory of groups, I, Theory Probab. Appl. 22 (1977), 79–85; II, Theory Probab. Appl. 23 (1978), 36–49 (references [66], [67] of the paper; no link verified).
  • Ts. Ignatov, On a constant arising in the theory of symmetric groups and on Poisson–Dirichlet measures, Theory Probab. Appl. 27 (1982), 136–147 (reference [34] of the paper; no link verified).
  • M. Perman, J. Pitman and M. Yor, Size-biased sampling of Poisson point processes and excursions, Probab. Theory Related Fields 92 (1992), 21–39. https://doi.org/10.1007/BF01205234
15 thms3 active usersReviewed
🏆Completed
Captain: mikedeng1

Large Deviations of Sums of Independent Random Variables 2: For g with Positive Nondecreasing g′, P(S_n ≥ x) ≤ Π(b_j(x/n) + b_gj)exp{−ng(x/n)}Research Paper

Motivation

Bounds on the upper tail P(Sn≥x)P(S_n\ge x)P(Sn​≥x) of a sum Sn=X1+⋯+XnS_n=X_1+\dots+X_nSn​=X1​+⋯+Xn​ of independent random variables are used throughout probability, statistics, queueing and risk theory: they control ruin probabilities, the error of empirical averages, and the size of the largest deviations of random walks. The classical exponential inequalities (Bernstein, Hoeffding, Bennett) require the summands to be bounded or to have finite exponential moments of a fixed order. The polynomial bounds of Fuk and Nagaev only require finite power moments, at the price of a power-law rate.

Between these two regimes lie summands whose right tails decay like e−g(u)e^{-g(u)}e−g(u) for a function ggg growing faster than a logarithm — Weibull-type and other subexponential or superexponential tails. For such summands the natural size parameter is not a power moment but a generalized moment bgj=E[eg(Xj);Xj≥0]b_{gj}=E[e^{g(X_j)};X_j\ge 0]bgj​=E[eg(Xj​);Xj​≥0]. Section 2 of S. V. Nagaev's survey Large deviations of sums of independent random variables (Ann. Probab. 7, 1979, doi:10.1214/aop/1176994938) develops bounds on P(Sn≥x)P(S_n\ge x)P(Sn​≥x) in terms of these quantities. Theorem 2.5 of that section, attributed to S. K. Sakoyan and Nagaev, treats the case where ggg has a positive nondecreasing derivative — the case lim inf⁡x→∞g(x)/x>0\liminf_{x\to\infty}g(x)/x>0liminfx→∞​g(x)/x>0 of the paper — and gives a bound in product form whose exponential order is e−ng(x/n)e^{-ng(x/n)}e−ng(x/n).

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) be a probability space and X1,…,XnX_1,\dots,X_nX1​,…,Xn​ independent real random variables with distribution functions Fj(u)=P(Xj<u)F_j(u)=P(X_j<u)Fj​(u)=P(Xj​<u). Write

Sn=X1+⋯+Xn.S_n=X_1+\dots+X_n .Sn​=X1​+⋯+Xn​.

Let g:R→Rg:\mathbb R\to\mathbb Rg:R→R be differentiable with a derivative g′g'g′ that is positive and nondecreasing; in particular ggg is convex and increasing, and g(u)→∞g(u)\to\inftyg(u)→∞ as u→∞u\to\inftyu→∞.

For each summand define the generalized moment

bgj=∫u≥0eg(u) dFj(u)=E[eg(Xj); Xj≥0],b_{gj}=\int_{u\ge 0}e^{g(u)}\,dF_j(u)=E\big[e^{g(X_j)};\,X_j\ge 0\big],bgj​=∫u≥0​eg(u)dFj​(u)=E[eg(Xj​);Xj​≥0],

and, for a real sss, the negative-part factor

bj(s)=eg(0)∫u<0eg′(s)u dFj(u)=eg(0)E[eg′(s)Xj; Xj<0].b_j(s)=e^{g(0)}\int_{u<0}e^{g'(s)u}\,dF_j(u)=e^{g(0)}E\big[e^{g'(s)X_j};\,X_j<0\big].bj​(s)=eg(0)∫u<0​eg′(s)udFj​(u)=eg(0)E[eg′(s)Xj​;Xj​<0].

The factor bj(s)b_j(s)bj​(s) is always finite, since its integrand lies in (0,1](0,1](0,1]; bgjb_{gj}bgj​ may be infinite, and the theorem is meaningful only when every bgjb_{gj}bgj​ is finite. In Lean these objects are S n X, bg P X g j and bj P X g g' j s in the namespace NagaevLD.GenMoment.

Formalization targets

Goal: Theorem 2.5, (2.44), p. 767

For every x>0x>0x>0,

P(Sn≥x) ≤ ∏j=1n(bj(x/n)+bgj)exp⁡{−ng(x/n)}.P(S_n\ge x)\ \le\ \prod_{j=1}^n\big(b_j(x/n)+b_{gj}\big)\exp\{-ng(x/n)\}.P(Sn​≥x) ≤ j=1∏n​(bj​(x/n)+bgj​)exp{−ng(x/n)}.

The statement holds for every nnn, every distribution of the summands with finite bgjb_{gj}bgj​, and every admissible ggg; no constant is hidden.

Milestones

The proof of the paper passes through the following displays, all on pp. 767–768, with h=g′(x/n)h=g'(x/n)h=g′(x/n) where indicated:

  1. (2.45) the exponential Chebyshev bound P(Sn≥x)≤e−hx∏jEehXjP(S_n\ge x)\le e^{-hx}\prod_{j}Ee^{hX_j}P(Sn​≥x)≤e−hx∏j​EehXj​ for h≥0h\ge 0h≥0;
  2. (2.46) the exact split of EehXjEe^{hX_j}EehXj​ at zero and the bound EehXj≤∫u<0ehu dFj(u)+bgjsup⁡u≥0ehu−g(u)Ee^{hX_j}\le\int_{u<0}e^{hu}\,dF_j(u)+b_{gj}\sup_{u\ge 0}e^{hu-g(u)}EehXj​≤∫u<0​ehudFj​(u)+bgj​supu≥0​ehu−g(u);
  3. (2.47) for h=g′(x/n)h=g'(x/n)h=g′(x/n), sup⁡u≥0ehu−g(u)=ehx/n−g(x/n)\sup_{u\ge 0}e^{hu-g(u)}=e^{hx/n-g(x/n)}supu≥0​ehu−g(u)=ehx/n−g(x/n);
  4. the convexity step g′(x/n)x/n≥g(x/n)−g(0)g'(x/n)x/n\ge g(x/n)-g(0)g′(x/n)x/n≥g(x/n)−g(0), hence ehx/n−g(x/n)≥e−g(0)e^{hx/n-g(x/n)}\ge e^{-g(0)}ehx/n−g(x/n)≥e−g(0);
  5. (2.48) ∫u<0ehu dFj(u)≤exp⁡{g(0)+hx/n−g(x/n)}∫u<0ehu dFj(u)\int_{u<0}e^{hu}\,dF_j(u)\le\exp\{g(0)+hx/n-g(x/n)\}\int_{u<0}e^{hu}\,dF_j(u)∫u<0​ehudFj​(u)≤exp{g(0)+hx/n−g(x/n)}∫u<0​ehudFj​(u);
  6. the per-factor bound EehXj≤(bj(x/n)+bgj)exp⁡{hx/n−g(x/n)}Ee^{hX_j}\le(b_j(x/n)+b_{gj})\exp\{hx/n-g(x/n)\}EehXj​≤(bj​(x/n)+bgj​)exp{hx/n−g(x/n)}.

Significance

The bound separates the tail of SnS_nSn​ into a product of one-summand quantities. For fixed nnn and x→∞x\to\inftyx→∞ one has ∏j(bj(x/n)+bgj)→∏jbgj\prod_j(b_j(x/n)+b_{gj})\to\prod_j b_{gj}∏j​(bj​(x/n)+bgj​)→∏j​bgj​, so P(Sn≥x)<(1+ε)∏jbgj e−ng(x/n)P(S_n\ge x)<(1+\varepsilon)\prod_j b_{gj}\,e^{-ng(x/n)}P(Sn​≥x)<(1+ε)∏j​bgj​e−ng(x/n) for large xxx (the paper's (2.49)); compared with the elementary lower bound P(Sn≥x)≥∏jP(Xj≥x/n)P(S_n\ge x)\ge\prod_j P(X_j\ge x/n)P(Sn​≥x)≥∏j​P(Xj​≥x/n) (2.50), this shows the exponential order e−ng(x/n)e^{-ng(x/n)}e−ng(x/n) is the right one when the right tails of the summands are of order bgje−gb_{gj}e^{-g}bgj​e−g. The only case where the right side does not depend on nnn is g(u)=Tug(u)=Tug(u)=Tu, the classical Chernoff regime, of which the theorem is a generalization.

The result is a published theorem with a complete half-page proof; it is not open. As far as a search of the Prove2Me catalogue shows, no part of it has been machine-checked: the catalogue contains single-variable Chernoff bounds (Mathlib's measure_ge_le_exp_mul_mgf) but no bound in terms of generalized moments. The mission produces a formal proof of the theorem and, along the way, reusable statements about tilted truncated moments of independent sums.

Difficulty

Each step of the argument is short; the work is in carrying it through real-valued measure theory. The exponential Chebyshev step requires the moment generating function of a sum of independent variables to factor, which needs the integrability of every ehXje^{hX_j}ehXj​ — a fact that here must be derived from the finiteness of bgjb_{gj}bgj​ and the bound on ehu−g(u)e^{hu-g(u)}ehu−g(u), not assumed. The supremum in (2.46) has to be identified as a maximum attained at x/nx/nx/n, which rests on the convexity of ggg on [0,∞)[0,\infty)[0,∞) obtained from a monotone derivative. Finally the split of EehXjEe^{hX_j}EehXj​ at 000 must match the definition of bgjb_{gj}bgj​ exactly: a mismatch at the single point u=0u=0u=0 breaks the theorem.

Formalization scope

The summands are X : Fin n → Ω → ℝ on a probability space, each measurable and jointly independent (iIndepFun); index jjj in Lean is the paper's j+1j+1j+1. Integrals ∫⋅ dFj(u)\int\cdot\,dF_j(u)∫⋅dFj​(u) over a set of uuu are written as expectations restricted to the corresponding event, so no distribution functions appear. Probabilities are P.real, and P(Sn≥x)P(S_n\ge x)P(Sn​≥x) is P.real {ω | x ≤ S n X ω}.

Committed conventions and disclosed additions:

  • bgjb_{gj}bgj​ over u≥0u\ge 0u≥0. The paper defines bgi=∫0+∞eg(u) dFi(u)b_{gi}=\int_{0+}^{\infty}e^{g(u)}\,dF_i(u)bgi​=∫0+∞​eg(u)dFi​(u) (p. 759), over u>0u>0u>0. The proof splits at 0−0-0− and bounds the whole part on u≥0u\ge 0u≥0 by bgjb_{gj}bgj​; with the u>0u>0u>0 reading the theorem is false (two summands with P(Xj=1)=0.1P(X_j=1)=0.1P(Xj​=1)=0.1, P(Xj=0)=0.9P(X_j=0)=0.9P(Xj​=0)=0.9, g(u)=ug(u)=ug(u)=u, x=1x=1x=1 give P(S2≥1)=0.19P(S_2\ge 1)=0.19P(S2​≥1)=0.19 against a bound of about 0.0270.0270.027). The formalization integrates over u≥0u\ge 0u≥0.
  • Finiteness of bgjb_{gj}bgj​ is an explicit integrability hypothesis. The paper treats bgjb_{gj}bgj​ as a finite factor; Lean's integral of a non-integrable function is 000, which would turn the bound into a false statement rather than a trivial one. This rules out the trivializing reading in which a junk bgj=0b_{gj}=0bgj​=0 is used.
  • Hypotheses on ggg — differentiability, g′>0g'>0g′>0, g′g'g′ nondecreasing — are imposed on [0,∞)[0,\infty)[0,∞) only, the region where ggg and g′g'g′ are evaluated; the paper's global hypothesis implies them. They also give §2's standing assumption that ggg is nondecreasing with g(u)→∞g(u)\to\inftyg(u)→∞, which is therefore not stated separately.
  • Suprema in (2.46)–(2.47) are never real sSup: (2.46) is stated for every upper bound MMM of ehu−g(u)e^{hu-g(u)}ehu−g(u) on u≥0u\ge 0u≥0, and (2.47) as IsGreatest.
  • The convexity step is stated with "≥\ge≥"; the page prints ">>>", which fails for g(u)=Tug(u)=Tug(u)=Tu.
  • n≥1n\ge1n≥1 is explicit in the theorem statements, matching the paper's sum X1+⋯+XnX_1+\dots+X_nX1​+⋯+Xn​ and avoiding Lean's x/0=0x/0=0x/0=0 value.
  • (2.45) assumes the finiteness of each EehXjEe^{hX_j}EehXj​, which the page takes for granted.
  • (2.46) assumes h≥0h\ge0h≥0, as used in the proof, so its negative-part expectation is finite; the finite bgjb_{gj}bgj​ and an upper bound on ehu−g(u)e^{hu-g(u)}ehu−g(u) make its positive part finite.

A complete development needs the factorization of exponential moments of independent sums (available in Mathlib as iIndepFun.mgf_sum), Markov's inequality, splitting a Bochner integral over an event and its complement, and the tangent-line inequality for a function with monotone derivative. Proofs of the milestones, alternative arguments, and lemmas on truncated exponential moments are all welcome.

Selected references

  • S. V. Nagaev, Large deviations of sums of independent random variables, Annals of Probability 7(5), 745–789, 1979. doi:10.1214/aop/1176994938
  • D. Kh. Fuk and S. V. Nagaev, Probability inequalities for sums of independent random variables, Theory of Probability and Its Applications 16(4), 643–660, 1971. doi:10.1137/1116071
  • H. Chernoff, A measure of asymptotic efficiency for tests of a hypothesis based on the sum of observations, Annals of Mathematical Statistics 23(4), 493–507, 1952. doi:10.1214/aoms/1177729330
9 thms3 active usersReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Implicit Renewal Theory and Tails of Solutions of Random Equations 2: Kesten's Theorem for R = Q + MR — Unique Stationary Law, Power Tails with Explicit C±, and C₊ + C₋ > 0 iff Q ≢ (1 − M)cResearch Paper

Motivation

The random difference equation

R=LQ+MR,R independent of (Q,M),R \overset{\mathcal L}{=} Q + MR,\qquad R \text{ independent of } (Q,M),R=LQ+MR,R independent of (Q,M),

describes the stationary state of the affine recursion Rn=Qn+MnRn−1R_n = Q_n + M_n R_{n-1}Rn​=Qn​+Mn​Rn−1​ driven by independent copies of a random pair (Q,M)(Q,M)(Q,M). It appears wherever a quantity is multiplied by a random factor and then receives a random increment: the discounted value of a stream of random cash flows (a perpetuity), the stationary volatility of ARCH and GARCH models in financial econometrics (de Haan, Resnick, Rootzén and de Vries 1989), random walks in random environment, and the stationary laws of random coefficient autoregressions. In all of these, the question that matters for risk is the size of the tail P(R>t)P(R>t)P(R>t).

Timeline:

  • 1973. Kesten proves, in a multivariate setting, that the stationary solution has power-law tails, P(R>t)∼C+t−κP(R>t)\sim C_+t^{-\kappa}P(R>t)∼C+​t−κ, where κ\kappaκ solves E∣M∣κ=1\mathbf E|M|^\kappa=1E∣M∣κ=1; the constants are not identified, and the proof of the key renewal step (his Theorem 4) runs to nine pages.
  • 1979. Vervaat gives a full account of existence, uniqueness and moments of the solution in dimension one.
  • 1980–1981. Grincevičius proves a maximal inequality of Lévy type for the partial sums of the recursion.
  • 1986. Letac formulates a general principle for existence and uniqueness of solutions of random equations R=LΨ(R)R\overset{\mathcal L}{=}\Psi(R)R=LΨ(R).
  • 1991. Goldie proves an implicit renewal theorem (Theorem 2.3, the subject of the first mission of this series) and deduces from it a new proof of Kesten's one-dimensional theorem, with explicit formulas for the constants C±C_\pmC±​ and a necessary and sufficient condition for them not to vanish (Theorem 4.1).
  • 2016. Buraczewski, Damek and Mikosch survey the theory, in which Kesten's theorem in Goldie's form is the central result.

Setting

Let (Q,M)(Q,M)(Q,M) be a pair of real random variables with joint law μ\muμ on R2\mathbb R^2R2. No independence between QQQ and MMM and no sign condition on either is assumed. A probability law ρ\rhoρ on R\mathbb RR is a law for RRR satisfying (1.1) if the law of Q+MRQ+MRQ+MR equals ρ\rhoρ when RRR has law ρ\rhoρ and is independent of (Q,M)(Q,M)(Q,M).

A law on R\mathbb RR is arithmetic if it is concentrated on a lattice {nλ:n∈Z}\{n\lambda:n\in\mathbb Z\}{nλ:n∈Z} for some λ>0\lambda>0λ>0, and nonarithmetic otherwise. For κ>0\kappa>0κ>0, the conditions of Lemma 2.2 on MMM are

E∣M∣κ=1,E∣M∣κlog⁡+∣M∣<∞,\mathbf E|M|^\kappa = 1,\qquad \mathbf E|M|^\kappa\log^+|M|<\infty,E∣M∣κ=1,E∣M∣κlog+∣M∣<∞,

and that the conditional law of log⁡∣M∣\log|M|log∣M∣ given M≠0M\ne0M=0 is nonarithmetic. Under them

m:=E∣M∣κlog⁡∣M∣∈(0,∞).m := \mathbf E|M|^\kappa\log|M| \in (0,\infty).m:=E∣M∣κlog∣M∣∈(0,∞).

With x+=x∨0x^+=x\vee0x+=x∨0 and x−=(−x)∨0x^-=(-x)\vee0x−=(−x)∨0, the constants of Theorem 4.1 are, when M≥0M\ge0M≥0 a.s.,

C±=E(((Q+MR)±)κ−((MR)±)κ)κm,C_\pm = \frac{\mathbf E\big(((Q+MR)^\pm)^\kappa-((MR)^\pm)^\kappa\big)}{\kappa m},C±​=κmE(((Q+MR)±)κ−((MR)±)κ)​,

and otherwise C+=C−=12κmE(∣Q+MR∣κ−∣MR∣κ)C_+=C_-=\frac{1}{2\kappa m}\mathbf E\big(|Q+MR|^\kappa-|MR|^\kappa\big)C+​=C−​=2κm1​E(∣Q+MR∣κ−∣MR∣κ), where RRR has the stationary law and is independent of (Q,M)(Q,M)(Q,M).

Formalization targets

Goal: Theorem 4.1

Assume the conditions of Lemma 2.2 and E∣Q∣κ<∞\mathbf E|Q|^\kappa<\inftyE∣Q∣κ<∞. Then there is a unique law ρ\rhoρ for RRR satisfying (1.1); the expectations defining C±C_\pmC±​ are finite; and

lim⁡t→∞tκP(R>t)=C+,lim⁡t→∞tκP(R<−t)=C−,\lim_{t\to\infty} t^\kappa P(R>t) = C_+,\qquad \lim_{t\to\infty} t^\kappa P(R<-t) = C_-,t→∞lim​tκP(R>t)=C+​,t→∞lim​tκP(R<−t)=C−​,

with C±C_\pmC±​ as above. Finally

C++C−>0  ⟺  P(Q=(1−M)c)<1  for each fixed c∈R.C_++C_->0 \iff P\big(Q=(1-M)c\big)<1 \ \text{ for each fixed } c\in\mathbb R.C+​+C−​>0⟺P(Q=(1−M)c)<1  for each fixed c∈R.

Milestones

In the order the proof uses them:

  1. Corollary 2.4: the implicit renewal theorem with the moment conditions (2.16)–(2.17) and constants (2.18)–(2.20), for a general random function Ψ\PsiΨ in place of t↦Q+Mtt\mapsto Q+Mtt↦Q+Mt.
  2. Lemma 9.4: tail-difference integrals against tκ−1dtt^{\kappa-1}dttκ−1dt versus moment differences.
  3. The elementary inequalities (9.26)–(9.27).
  4. (4.8): for κ>1\kappa>1κ>1, E∣R∣κ−1<∞\mathbf E|R|^{\kappa-1}<\inftyE∣R∣κ−1<∞ with an explicit bound.
  5. (2.16)–(2.17) for Ψ(t)=Q+Mt\Psi(t)=Q+MtΨ(t)=Q+Mt: the moment differences are integrable.
  6. Proposition 4.2 (Grincevičius's maximal inequality) and its consequence (4.6).
  7. The lower bound P(∣Πn∣>et for some n)≥δe−κtP(|\Pi_n|>e^t\text{ for some }n)\ge\delta e^{-\kappa t}P(∣Πn​∣>et for some n)≥δe−κt for the products Πn=M1⋯Mn\Pi_n=M_1\cdots M_nΠn​=M1​⋯Mn​.
  8. Under the condition P(Q=(1−M)c)<1P(Q=(1-M)c)<1P(Q=(1−M)c)<1 for each ccc, tκP(∣R∣>t)t^\kappa P(|R|>t)tκP(∣R∣>t) stays bounded away from 000.

Significance

The result. Theorem 4.1 identifies the tail exponent of the stationary solution as the root κ\kappaκ of E∣M∣κ=1\mathbf E|M|^\kappa=1E∣M∣κ=1, which depends on MMM alone, and expresses the tail constants as expectations under the stationary law. The constants yield the bounds of Corollary 4.3 and closed forms when κ\kappaκ is an integer (Corollaries 4.4, 4.5). The dichotomy between M≥0M\ge0M≥0 a.s. (different left and right constants) and P(M<0)>0P(M<0)>0P(M<0)>0 (equal constants) is visible only through these formulas. The positivity criterion tells when the power tail is really there: it fails exactly when the recursion has a deterministic fixed point ccc. Tail estimates for GARCH processes, perpetuities in insurance mathematics and random walks in random environment are applications of this statement.

Formalizing it. The theorem has been proved since 1973 and in the present form since 1991; it is open only as a formalization. No machine-checked proof of Kesten's theorem, of the implicit renewal theorem, or of the underlying nonarithmetic key renewal theorem on the whole line is known to this mission. The work consists of formalizing Goldie's proof, which assembles the implicit renewal theorem with moment estimates, a maximal inequality and a Cramér–Lundberg-type lower bound for a random walk with negative drift.

Difficulty

The obvious argument is to write R=∑k≥1Πk−1QkR=\sum_{k\ge1}\Pi_{k-1}Q_kR=∑k≥1​Πk−1​Qk​ and estimate the tail of each term. It fails because E∣M∣κ=1\mathbf E|M|^\kappa=1E∣M∣κ=1 makes every term contribute tails of the same order t−κt^{-\kappa}t−κ, and the sum of infinitely many such contributions is exactly what has to be computed; termwise bounds give the right exponent at best, not the limit or the constant. A second natural idea, applying the renewal theorem directly to P(R>t)P(R>t)P(R>t), needs integrability of a tail difference that is not evident, because E∣R∣κ\mathbf E|R|^\kappaE∣R∣κ is infinite whenever C++C−>0C_++C_->0C+​+C−​>0; the moment differences ((Q+MR)+)κ−((MR)+)κ((Q+MR)^+)^\kappa-((MR)^+)^\kappa((Q+MR)+)κ−((MR)+)κ must be controlled without either term being integrable. The positivity half is a separate problem: the formula for C±C_\pmC±​ is a difference of two infinite-looking quantities, and showing it is positive requires a lower bound on the tail that does not come from the formula.

Formalization scope

Everything is stated in terms of laws. The joint law of (Q,M)(Q,M)(Q,M) is a probability measure μ\muμ on R×R\mathbb R\times\mathbb RR×R (first coordinate QQQ, second MMM); a law for RRR satisfying (1.1) is a probability measure ρ\rhoρ on R\mathbb RR that equals the image of μ⊗ρ\mu\otimes\rhoμ⊗ρ under ((q,m),r)↦q+mr((q,m),r)\mapsto q+mr((q,m),r)↦q+mr, and uniqueness is among all probability measures on R\mathbb RR, with no moment restriction. Expectations involving RRR and (Q,M)(Q,M)(Q,M) are integrals against μ⊗ρ\mu\otimes\rhoμ⊗ρ, which is what makes RRR independent of (Q,M)(Q,M)(Q,M). The conditions of Lemma 2.2 are stated for the law of MMM, with E∣M∣κ\mathbf E|M|^\kappaE∣M∣κ and E∣M∣κlog⁡+∣M∣\mathbf E|M|^\kappa\log^+|M|E∣M∣κlog+∣M∣ as lower Lebesgue integrals and the conditional law of log⁡∣M∣\log|M|log∣M∣ taken given M≠0M\neq0M=0. "P(R>t)∼C+t−κP(R>t)\sim C_+t^{-\kappa}P(R>t)∼C+​t−κ" is the limit statement tκP(R>t)→C+t^\kappa P(R>t)\to C_+tκP(R>t)→C+​, which the paper prescribes and which includes C+=0C_+=0C+​=0. Milestones on sequences use independent copies (Qn,Mn)(Q_n,M_n)(Qn​,Mn​) on an arbitrary probability space carrying them, stored 0-based.

The statement does not reduce to a trivial one: the ratio form P(R>t)/(C+t−κ)→1P(R>t)/(C_+t^{-\kappa})\to1P(R>t)/(C+​t−κ)→1 (undefined when C+=0C_+=0C+​=0), existence of some fixed point without uniqueness, the positivity criterion as a one-way implication, and tail limits asserted for an arbitrary random variable rather than for the stationary law are all excluded. One correction to the source is built in: Lemma 9.4's (9.17) is printed as an equality, which fails for independent identically distributed non-degenerate XXX, YYY; the inequality the proof establishes is stated.

A complete development needs: convolution and image measures of products on R2×R\mathbb R^2\times\mathbb RR2×R; the key renewal theorem on the whole line for nonarithmetic laws with positive mean (the content of the first mission of this series); existence and uniqueness for contractive random affine maps; Lévy-type maximal inequalities; and ladder-height estimates for random walks with negative drift whose steps may equal −∞-\infty−∞. The renewal-theoretic and random-walk components are reusable well beyond this mission. Contributions of any milestone, and of supporting lemmas such as the moment bounds for perpetuities, are welcome.

Selected references

  • C. M. Goldie, Implicit renewal theory and tails of solutions of random equations, Annals of Applied Probability 1(1):126–166, 1991. https://doi.org/10.1214/aoap/1177005985
  • H. Kesten, Random difference equations and renewal theory for products of random matrices, Acta Mathematica 131:207–248, 1973. https://doi.org/10.1007/BF02392040
  • W. Vervaat, On a stochastic difference equation and a representation of non-negative infinitely divisible random variables, Advances in Applied Probability 11(4):750–783, 1979. https://doi.org/10.2307/1426858
  • L. de Haan, S. I. Resnick, H. Rootzén and C. G. de Vries, Extremal behaviour of solutions to a stochastic difference equation with applications to ARCH processes, Stochastic Processes and their Applications 32(2):213–224, 1989. https://doi.org/10.1016/0304-4149(89)90076-8
  • D. Buraczewski, E. Damek and T. Mikosch, Stochastic Models with Power-Law Tails: The Equation X = AX + B, Springer, 2016. https://doi.org/10.1007/978-3-319-29679-1
13 thms3 active usersReviewed
🏆Completed
Graph TheoryMarkov Chain·Captain: mikedeng1

Geometric Bounds for Eigenvalues of Markov Chains 2: Odd Closed Paths Bound the Smallest Eigenvalue, β_min ≥ −1 + 2/ιResearch Paper

Motivation

The speed at which a finite reversible Markov chain approaches its stationary distribution is controlled by its eigenvalues. For a chain with eigenvalues 1=β0>β1≥⋯≥βm−1≥−11=\beta_0>\beta_1\ge\dots\ge\beta_{m-1}\ge-11=β0​>β1​≥⋯≥βm−1​≥−1, the distance to stationarity after nnn steps is governed by β∗ n\beta_*^{\,n}β∗n​, where β∗=max⁡(β1,∣βm−1∣)\beta_*=\max(\beta_1,|\beta_{m-1}|)β∗​=max(β1​,∣βm−1​∣) (Diaconis and Stroock 1991, Proposition 3). Upper bounds on the second eigenvalue β1\beta_1β1​ are the familiar half of this picture, and they are what Cheeger-type and Poincaré inequalities provide. The other half is the smallest eigenvalue βmin⁡=βm−1\beta_{\min}=\beta_{m-1}βmin​=βm−1​: a chain whose smallest eigenvalue is close to −1-1−1 oscillates almost periodically and mixes slowly whatever β1\beta_1β1​ is. A chain is aperiodic exactly when βmin⁡>−1\beta_{\min}>-1βmin​>−1, but that qualitative fact gives no rate.

Diaconis and Stroock's paper gives geometric bounds for both ends of the spectrum, expressed through systems of paths in the graph of the chain. Their bound on βmin⁡\beta_{\min}βmin​ uses closed paths with an odd number of edges, the combinatorial witnesses of aperiodicity. The paper has been a standard reference for path (canonical-path, multicommodity-flow) methods in the analysis of Markov chain Monte Carlo since its publication.

Timeline:

  • 1988–1989, Jerrum and Sinclair: conductance (Cheeger-type) bounds on β1\beta_1β1​ for chains on combinatorial structures.
  • 1991, Diaconis and Stroock: path bounds for β1\beta_1β1​ (Proposition 1, the Poincaré inequality β1≤1−1/κ\beta_1\le1-1/\kappaβ1​≤1−1/κ) and for βmin⁡\beta_{\min}βmin​ (Proposition 2, this mission), with the specializations to random walks on graphs (Corollaries 1 and 2).

Setting

Let XXX be a finite set and P(x,y)P(x,y)P(x,y) the transition matrix of an irreducible Markov chain on XXX, reversible with respect to a probability distribution π\piπ:

Q(x,y)=π(x)P(x,y)=π(y)P(y,x)(x,y∈X).Q(x,y)=\pi(x)P(x,y)=\pi(y)P(y,x)\qquad(x,y\in X).Q(x,y)=π(x)P(x,y)=π(y)P(y,x)(x,y∈X).

The operator (Pφ)(x)=∑yP(x,y)φ(y)(P\varphi)(x)=\sum_yP(x,y)\varphi(y)(Pφ)(x)=∑y​P(x,y)φ(y) is self-adjoint on L2(π)L^2(\pi)L2(π), with inner product ⟨φ,ψ⟩L2(π)=∑xφ(x)ψ(x)π(x)\langle\varphi,\psi\rangle_{L^2(\pi)}=\sum_x\varphi(x)\psi(x)\pi(x)⟨φ,ψ⟩L2(π)​=∑x​φ(x)ψ(x)π(x), so its eigenvalues are real. Write E(φ2)=∑xφ(x)2π(x)E(\varphi^2)=\sum_x\varphi(x)^2\pi(x)E(φ2)=∑x​φ(x)2π(x) and let βmin⁡\beta_{\min}βmin​ be the smallest eigenvalue of PPP.

The graph of the chain has vertex set XXX, an edge from xxx to yyy when Q(x,y)>0Q(x,y)>0Q(x,y)>0, and a self-loop at xxx when Q(x,x)>0Q(x,x)>0Q(x,x)>0. An odd closed path σx\sigma_xσx​ at xxx is a sequence of edges from xxx back to xxx, with an odd number of edges, in which no directed edge is traversed twice. Its length is

∣σx∣Q=∑e∈σxQ(e)−1.|\sigma_x|_Q=\sum_{e\in\sigma_x}Q(e)^{-1}.∣σx​∣Q​=e∈σx​∑​Q(e)−1.

A system of odd paths Σ=(σx)x∈X\Sigma=(\sigma_x)_{x\in X}Σ=(σx​)x∈X​ chooses one such path for every point, and its load is

ι=ι(Σ)=max⁡e∑σx∋e∣σx∣Q π(x),\iota=\iota(\Sigma)=\max_e\sum_{\sigma_x\ni e}|\sigma_x|_Q\,\pi(x),ι=ι(Σ)=emax​σx​∋e∑​∣σx​∣Q​π(x),

the maximum over directed edges eee of the weighted length of the paths through eee (display (1.7) of the paper).

For the random walk on a graph G=(X,E)G=(X,E)G=(X,E), P(x,y)=1/d(x)P(x,y)=1/d(x)P(x,y)=1/d(x) when {x,y}∈E\{x,y\}\in E{x,y}∈E, with d(x)d(x)d(x) the degree, and π(x)=d(x)/2∣E∣\pi(x)=d(x)/2|E|π(x)=d(x)/2∣E∣. There d∗d_*d∗​ is the maximum degree, σ∗\sigma_*σ∗​ the largest number of edges of a path in Σ\SigmaΣ, and b∗=max⁡e♯{σ∈Σ:e∈σ}b_*=\max_e\sharp\{\sigma\in\Sigma:e\in\sigma\}b∗​=maxe​♯{σ∈Σ:e∈σ}.

Formalization targets

Goal: Proposition 2

For an irreducible, aperiodic, reversible chain and every system Σ\SigmaΣ of odd closed paths,

βmin⁡≥−1+2ι(Σ).\beta_{\min}\ge-1+\frac{2}{\iota(\Sigma)}.βmin​≥−1+ι(Σ)2​.

Milestones (the steps of the paper's proof)

  1. The identity (1.8): 12∑x,y(φ(x)+φ(y))2Q(x,y)=E(φ2)+⟨φ,Pφ⟩L2(π)\tfrac12\sum_{x,y}(\varphi(x)+\varphi(y))^2Q(x,y)=E(\varphi^2)+\langle\varphi,P\varphi\rangle_{L^2(\pi)}21​∑x,y​(φ(x)+φ(y))2Q(x,y)=E(φ2)+⟨φ,Pφ⟩L2(π)​.
  2. Along an odd closed path x,y,w,…,z,xx,y,w,\dots,z,xx,y,w,…,z,x: φ(x)=12{(φ(x)+φ(y))−(φ(y)+φ(w))+⋯+(φ(z)+φ(x))}\varphi(x)=\tfrac12\{(\varphi(x)+\varphi(y))-(\varphi(y)+\varphi(w))+\dots+(\varphi(z)+\varphi(x))\}φ(x)=21​{(φ(x)+φ(y))−(φ(y)+φ(w))+⋯+(φ(z)+φ(x))}.
  3. For every φ\varphiφ: E(φ2)≤ι2(E(φ2)+⟨φ,Pφ⟩L2(π))E(\varphi^2)\le\frac{\iota}{2}\big(E(\varphi^2)+\langle\varphi,P\varphi\rangle_{L^2(\pi)}\big)E(φ2)≤2ι​(E(φ2)+⟨φ,Pφ⟩L2(π)​).
  4. Every eigenvalue β\betaβ of PPP satisfies β≥−1+2/ι\beta\ge-1+2/\iotaβ≥−1+2/ι.

Companions

  • Corollary 2. For the random walk on a connected, non-bipartite graph and any system Σ\SigmaΣ of odd paths, βmin⁡≥−1+2d∗σ∗b∗\beta_{\min}\ge-1+\dfrac{2}{d_*\sigma_*b_*}βmin​≥−1+d∗​σ∗​b∗​2​.
  • Remark 1.3. With odd paths σxy\sigma_{xy}σxy​ for every ordered pair and ι~=max⁡e∑σxy∋e∣σxy∣Qπ(x)π(y)\tilde\iota=\max_e\sum_{\sigma_{xy}\ni e}|\sigma_{xy}|_Q\pi(x)\pi(y)ι~=maxe​∑σxy​∋e​∣σxy​∣Q​π(x)π(y): βmin⁡≥−1+1/ι~\beta_{\min}\ge-1+1/\tilde\iotaβmin​≥−1+1/ι~.

Significance

Proposition 2 turns aperiodicity into a number. With Proposition 1, which bounds β1≤1−1/κ\beta_1\le1-1/\kappaβ1​≤1−1/κ through paths between pairs of points, it bounds the absolute spectral gap 1−β∗1-\beta_*1−β∗​ entirely in terms of path geometry, and so bounds the variation distance to stationarity through Proposition 3. Corollary 2 is the form most often applied: for a random walk on a non-bipartite graph, a choice of short odd cycles that do not crowd any single edge certifies that the walk does not oscillate.

Proposition 2 and its corollary are proved in the paper. As far as a search of the platform shows, no machine-checked proof exists. The platform already has the vocabulary (stochastic matrices, stationarity, reversibility, eigenvalues and the L2(π)L^2(\pi)L2(π) inner product, from the published Levin–Peres–Wilmer layer) and the qualitative fact that −1-1−1 is not an eigenvalue of an irreducible aperiodic chain. This mission adds the quantitative bound, the identity (1.8), and the path inequality, all reusable for other path-based eigenvalue estimates.

Difficulty

Each step is elementary, but the bookkeeping is where a proof can go wrong. The Cauchy–Schwarz step is applied along each path separately, and the resulting double sum over points and over the edges of their paths must be exchanged into a sum over edges. That exchange is exact only if each path traverses each directed edge at most once. A path that crosses an edge twice contributes twice, while ι\iotaι counts it once. Self-loops are edges here, and the sum over directed edges in the last step must match the sum over ordered pairs (x,y)(x,y)(x,y), including x=yx=yx=y, in the identity (1.8). The alternating signs work only because the number of edges is odd; an even closed path cancels φ(x)\varphi(x)φ(x) instead of doubling it.

The bound is also only as good as the chosen paths: short odd cycles that spread their load over many edges give a small ι\iotaι, and the choice of Σ\SigmaΣ is part of every application.

Formalization scope

The chain is a real matrix P : Matrix V V ℝ on a Fintype V, with the published predicates IsStochastic, Irreducible, Aperiodic, IsStationary (which includes that π\piπ is a probability vector) and DetailedBalance. QQQ is edgeMeasure, the inner product innerPi, eigenvalues IsEigenvalue (a real eigenvalue with a nonzero real eigenfunction). βmin⁡\beta_{\min}βmin​ is the infimum of the real eigenvalues of PPP, a minimum for a stochastic matrix on a nonempty set.

Paths are vertex lists. A path traverses the directed edges between consecutive vertices, each with Q>0Q>0Q>0. The paper defines ∣σx∣Q|\sigma_x|_Q∣σx​∣Q​ "by analogy with (1.4)", whose paths may not repeat an edge. For the directed edges of §1C this rule is read as "no directed edge twice". Under the unordered reading a vertex of degree one would have no odd closed path, contradicting the page's remark that such paths always exist for irreducible aperiodic chains. ι\iotaι is a real supremum over the finite set of directed edges with Q>0Q>0Q>0, and it is 000 only when there is no edge. A system of odd paths on a nonempty set excludes that case, so the bound is never reduced to βmin⁡≥−1\beta_{\min}\ge-1βmin​≥−1 by 2/0=02/0=02/0=0. The system Σ\SigmaΣ is a universally quantified hypothesis of every statement, never an existential one. No milestone assumes the inequality of milestone 3 or the identity (1.8) as a hypothesis. No assumption ∣X∣≥2|X|\ge2∣X∣≥2 is made.

Milestones 3 and 4 do not assume aperiodicity: the existence of an odd path system implies it. The identity (1.8) assumes only stochasticity and stationarity. Corollary 2 assumes only that the graph is connected and not 2-colorable; the chain properties follow from these. In Corollary 2, b∗b_*b∗​ counts paths through a directed edge, which is at most the count through the unordered edge, so the stated bound implies the one with the unordered count. Only the first half of Remark 1.3 is stated; its second half needs Proposition 1's quantity, which belongs to another mission of the series.

Contributions welcome: proofs of the milestones in order, a general Cauchy–Schwarz-along-paths lemma shared with the Poincaré inequality, and the existence of odd path systems for irreducible aperiodic chains.

Selected references

  • P. Diaconis and D. Stroock, Geometric bounds for eigenvalues of Markov chains, Ann. Appl. Probab. 1(1):36–61, 1991. https://doi.org/10.1214/aoap/1177005980
  • A. Sinclair and M. Jerrum, Approximate counting, uniform generation and rapidly mixing Markov chains, Inform. and Comput. 82(1):93–133, 1989. https://doi.org/10.1016/0890-5401(89)90067-9
  • D. A. Levin, Y. Peres and E. L. Wilmer, Markov Chains and Mixing Times, American Mathematical Society, 2009 (2nd ed. 2017). https://doi.org/10.1090/mbk/107
12 thms3 active usersReviewed
Machine LearningOptimizationStatistics·Captain: mikedeng1

Learning Models with Uniform Performance via Distributionally Robust Optimization 2: A Minimax Lower Bound of Order n^(−1/2) ∨ n^(−1/k*) for Estimating the Cressie–Read Robust Risk (Theorem 3)Research Paper

Motivation

Distributionally robust optimization replaces the expected loss EP0[ℓ(θ;X)]\mathbb E_{P_0}[\ell(\theta; X)]EP0​​[ℓ(θ;X)] of a statistical model by its worst case over all distributions QQQ close to the data distribution P0P_0P0​. When closeness is measured by an fff-divergence ball {Q:Df(Q∥P0)≤ρ}\{Q : D_f(Q\|P_0) \le \rho\}{Q:Df​(Q∥P0​)≤ρ} of fixed radius ρ>0\rho > 0ρ>0, the robust risk upper-bounds the risk of every subpopulation of P0P_0P0​ that has sufficiently large probability, so a model with small robust risk performs uniformly well across latent subgroups. This is the program of J. C. Duchi and H. Namkoong, Learning Models with Uniform Performance via Distributionally Robust Optimization (arXiv:1810.08750; Ann. Statist. 49 (2021), doi:10.1214/20-AOS2004).

The robust risk is itself a statistical functional. It is estimated by plugging in the empirical distribution, and the paper shows (its Theorem 2) that for the Cressie–Read family of divergences with parameter kkk the plug-in estimate concentrates at rate n−1/(k∗∨2)n^{-1/(k_* \vee 2)}n−1/(k∗​∨2), with k∗=k/(k−1)k_* = k/(k-1)k∗​=k/(k−1). For small kkk (heavy protection against distribution shift) k∗k_*k∗​ is large and this rate is far slower than the parametric n−1/2n^{-1/2}n−1/2. This mission formalizes the paper's answer to whether the slow rate is an artefact of the plug-in estimator or intrinsic: its Theorem 3, a minimax lower bound valid for every estimator.

Setting

Fix k∈(1,∞)k \in (1,\infty)k∈(1,∞) and write k∗=k/(k−1)k_* = k/(k-1)k∗​=k/(k−1). The Cressie–Read function is

fk(t)=tk−kt+k−1k(k−1)(t≥0),fk(t)=+∞(t<0).f_k(t) = \frac{t^k - kt + k - 1}{k(k-1)} \quad (t \ge 0), \qquad f_k(t) = +\infty \quad (t < 0).fk​(t)=k(k−1)tk−kt+k−1​(t≥0),fk​(t)=+∞(t<0).

For a probability measure PPP, a real random variable ZZZ and a radius ρ>0\rho > 0ρ>0, the robust risk is

Rk(Z)=sup⁡{EP[LZ]:L≥0, EP[L]=1, EP[fk(L)]≤ρ},\mathcal R_k(Z) = \sup\Bigl\{ \mathbb E_P[LZ] : L \ge 0,\ \mathbb E_P[L] = 1,\ \mathbb E_P[f_k(L)] \le \rho \Bigr\},Rk​(Z)=sup{EP​[LZ]:L≥0, EP​[L]=1, EP​[fk​(L)]≤ρ},

the supremum of EQ[Z]\mathbb E_Q[Z]EQ​[Z] over distributions Q≪PQ \ll PQ≪P with likelihood ratio L=dQ/dPL = dQ/dPL=dQ/dP and Cressie–Read divergence Dfk(Q∥P)=EP[fk(L)]D_{f_k}(Q\|P) = \mathbb E_P[f_k(L)]Dfk​​(Q∥P)=EP​[fk​(L)] at most ρ\rhoρ.

Write

ck(ρ)=(1+k(k−1)ρ)1/k,pk=(1+k(k−1)ρ)−1/(k−1),βk=k(k−1)ρ2(1+k(k−1)ρ).c_k(\rho) = (1 + k(k-1)\rho)^{1/k}, \qquad p_k = (1 + k(k-1)\rho)^{-1/(k-1)}, \qquad \beta_k = \frac{k(k-1)\rho}{2(1+k(k-1)\rho)} .ck​(ρ)=(1+k(k−1)ρ)1/k,pk​=(1+k(k−1)ρ)−1/(k−1),βk​=2(1+k(k−1)ρ)k(k−1)ρ​.

Fix M>0M > 0M>0 and let P\mathcal PP be the set of all distributions on the two points {0,M}\{0, M\}{0,M}; each is determined by its mass p∈[0,1]p \in [0,1]p∈[0,1] at MMM. An estimator is any function R^:{0,M}n→R\widehat R : \{0, M\}^n \to \mathbb RR:{0,M}n→R of a sample Z1n=(Z1,…,Zn)Z_1^n = (Z_1, \dots, Z_n)Z1n​=(Z1​,…,Zn​) drawn i.i.d. from P0∈PP_0 \in \mathcal PP0​∈P. The minimax risk of estimating the robust risk is

Mn(P,fk)=inf⁡R^ sup⁡P0∈P EP0n∣R^(Z1n)−Rk(Z)∣,Z∼P0.(16)\mathfrak M_n(\mathcal P, f_k) = \inf_{\widehat R}\ \sup_{P_0 \in \mathcal P}\ \mathbb E_{P_0^n}\bigl|\widehat R(Z_1^n) - \mathcal R_k(Z)\bigr|, \qquad Z \sim P_0. \qquad (16)Mn​(P,fk​)=Rinf​ P0​∈Psup​ EP0n​​​R(Z1n​)−Rk​(Z)​,Z∼P0​.(16)

The total variation distance between two product laws Pn,P′nP^n, P'^nPn,P′n on the finite set {0,M}n\{0,M\}^n{0,M}n is ∥Pn−P′n∥TV=12∑z∣Pn{z}−P′n{z}∣\|P^n - P'^n\|_{\mathrm{TV}} = \tfrac12\sum_z |P^n\{z\} - P'^n\{z\}|∥Pn−P′n∥TV​=21​∑z​∣Pn{z}−P′n{z}∣, and DklD_{\mathrm{kl}}Dkl​ denotes the Kullback–Leibler divergence.

Formalization targets

Goal: Theorem 3

For every n≥1n \ge 1n≥1,

Mn(P,fk)≥Mmax⁡{18k∗pk(pk(1−pk)16n∧12(1−pk)∧pk),  18βk1/kck(ρ)(14n∧pk∧(1−(1−βk)1−k∗pk))1/k∗}.\mathfrak M_n(\mathcal P, f_k) \ge M \max\Biggl\{ \frac{1}{8 k_* p_k}\Bigl( \sqrt{\frac{p_k(1-p_k)}{16 n}} \wedge \tfrac12(1-p_k) \wedge p_k \Bigr),\ \ \frac18 \beta_k^{1/k} c_k(\rho) \Bigl( \frac{1}{4n} \wedge p_k \wedge \bigl(1 - (1-\beta_k)^{1-k_*} p_k\bigr) \Bigr)^{1/k_*} \Biggr\}.Mn​(P,fk​)≥Mmax{8k∗​pk​1​(16npk​(1−pk​)​​∧21​(1−pk​)∧pk​),  81​βk1/k​ck​(ρ)(4n1​∧pk​∧(1−(1−βk​)1−k∗​pk​))1/k∗​}.

The first branch is of order n−1/2n^{-1/2}n−1/2, the second of order n−1/k∗n^{-1/k_*}n−1/k∗​. The page prints 8n8n8n in the first branch; the target uses 16n16n16n (see Formalization scope).

Milestones

  1. Lemma 12 (three claims): for ZZZ equal to z0≤z1z_0 \le z_1z0​≤z1​ with probabilities 1−p1-p1−p, ppp: if p≥pkp \ge p_kp≥pk​ then Rk(Z)=z1\mathcal R_k(Z) = z_1Rk​(Z)=z1​; if p≤pkp \le p_kp≤pk​ then Rk(Z)≤ckp1/k∗z1+(1−ckp1/k∗)z0\mathcal R_k(Z) \le c_k p^{1/k_*} z_1 + (1 - c_k p^{1/k_*}) z_0Rk​(Z)≤ck​p1/k∗​z1​+(1−ck​p1/k∗​)z0​; and if p≤pk∧(1−(1−β)1−k∗pk)p \le p_k \wedge (1 - (1-\beta)^{1-k_*} p_k)p≤pk​∧(1−(1−β)1−k∗​pk​) for some β∈(0,1)\beta \in (0,1)β∈(0,1) then Rk(Z)≥β1/kckp1/k∗z1+(1−β1/kckp1/k∗)z0\mathcal R_k(Z) \ge \beta^{1/k} c_k p^{1/k_*} z_1 + (1 - \beta^{1/k} c_k p^{1/k_*}) z_0Rk​(Z)≥β1/kck​p1/k∗​z1​+(1−β1/kck​p1/k∗​)z0​.
  2. The primal two-point formula (p. 47): for p∈(0,1)p \in (0,1)p∈(0,1),
Rk(Z)=z0+(z1−z0)sup⁡{q∈[0,1]:(1−p)1−k(1−q)k+p1−kqk≤ckk}.\mathcal R_k(Z) = z_0 + (z_1 - z_0)\sup\{q \in [0,1] : (1-p)^{1-k}(1-q)^k + p^{1-k}q^k \le c_k^k\}.Rk​(Z)=z0​+(z1​−z0​)sup{q∈[0,1]:(1−p)1−k(1−q)k+p1−kqk≤ckk​}.
  1. Le Cam's reduction (37): if ∣Rk(P0)−Rk(P1)∣≥2δ>0|\mathcal R_k(P_0) - \mathcal R_k(P_1)| \ge 2\delta > 0∣Rk​(P0​)−Rk​(P1​)∣≥2δ>0 then Mn≥δ2(1−∥P0n−P1n∥TV)\mathfrak M_n \ge \frac\delta2(1 - \|P_0^n - P_1^n\|_{\mathrm{TV}})Mn​≥2δ​(1−∥P0n​−P1n​∥TV​).
  2. The Taylor display ck(pk−δ)1/k∗≤1−1k∗ckk∗δc_k(p_k - \delta)^{1/k_*} \le 1 - \frac{1}{k_*}c_k^{k_*}\deltack​(pk​−δ)1/k∗​≤1−k∗​1​ckk∗​​δ for 0<δ≤pk0 < \delta \le p_k0<δ≤pk​.
  3. The KL display Dkl(P2∥P1)≤8δ2/(pk(1−pk))D_{\mathrm{kl}}(P_2\|P_1) \le 8\delta^2/(p_k(1-p_k))Dkl​(P2​∥P1​)≤8δ2/(pk​(1−pk​)) for the laws with masses pk∓δp_k \mp \deltapk​∓δ at MMM.
  4. Pinsker for products ∥P1n−P2n∥TV2≤n2Dkl(P2∥P1)\|P_1^n - P_2^n\|_{\mathrm{TV}}^2 \le \frac n2 D_{\mathrm{kl}}(P_2\|P_1)∥P1n​−P2n​∥TV2​≤2n​Dkl​(P2​∥P1​).
  5. The second-branch KL display −log⁡(1−δ)≤δ/(1−δ)≤2δ-\log(1-\delta) \le \delta/(1-\delta) \le 2\delta−log(1−δ)≤δ/(1−δ)≤2δ for δ≤12\delta \le \frac12δ≤21​.

Significance

Theorem 3 shows that the rate n−1/(k∗∨2)n^{-1/(k_* \vee 2)}n−1/(k∗​∨2) of the paper's concentration bound for the plug-in robust risk cannot be improved by any estimator, even when the data take only two values. For k<2k < 2k<2 the robust risk is therefore intrinsically harder to estimate than a mean: its value depends on how much mass P0P_0P0​ puts on rare large values, and rare events are observed rarely. The same phenomenon drives the paper's lower bounds for minimizing the robust risk (its Section 5.2), which are not part of this mission.

The result is proved in the paper; no machine-checked version of it or of Lemma 12 is known. Formalizing it produces a verified two-point analysis of the Cressie–Read robust risk (Lemma 12 and its primal formula), which is reusable for any lower bound or worked example involving fff-divergence balls, and a verified finite-sample Le Cam two-point bound for estimating a functional of a distribution on two points. It also corrects a constant in the first branch of the printed statement.

Difficulty

The lower bound needs two distributions on {0,M}\{0,M\}{0,M} that are statistically close yet have well-separated robust risks. Both requirements must be quantitative and must hold simultaneously at the stated constants. The robust risk is a supremum over an infinite-dimensional set of likelihood ratios, so the separation needs exact control of that supremum for two-point laws: an exact value above the threshold pkp_kpk​, and matching upper and lower bounds below it. For mass near pkp_kpk​ the separation is linear in δ\deltaδ, while for small mass it is of order δ1/k∗\delta^{1/k_*}δ1/k∗​, which is where the slow rate comes from. Closeness requires the KL divergence of each pair to be at most 1/(2n)1/(2n)1/(2n), and the two branches need different perturbations. A naive bound on the robust risk by max⁡(z0,z1)\max(z_0, z_1)max(z0​,z1​) or by the mean gives no separation at all.

Formalization scope

The Lean development lives in the namespace UniformDRO.LowerBound. Its conventions are:

  • k>1k > 1k>1, ρ>0\rho > 0ρ>0, M>0M > 0M>0 (all on the page); n≥1n \ge 1n≥1 in the goal (implicit on the page, since the bound contains 1/n1/n1/n).
  • The robust risk is the real supremum in the likelihood-ratio form above, with the divergence constraint written as a lower Lebesgue integral of fk(L)≥0f_k(L) \ge 0fk​(L)≥0. Absolute continuity Q≪PQ \ll PQ≪P is built in. For a two-point law the feasible values lie between the two points, so the supremum is genuine.
  • Laws on {0,M}\{0,M\}{0,M} are (1−p)δ0+p δM(1-p)\delta_0 + p\,\delta_M(1−p)δ0​+pδM​, p∈[0,1]p \in [0,1]p∈[0,1]. Expectations under P0nP_0^nP0n​ are finite sums over {0,M}n\{0,M\}^n{0,M}n. The minimax risk takes values in [0,∞][0,\infty][0,∞], with the infimum over all real functions of the sample taken outside the supremum over ppp. For these laws it agrees with the platform's general HighDimStat.Minimax.minimaxRisk.
  • DklD_{\mathrm{kl}}Dkl​ between two-point laws is the platform's BanditAlgorithm.bernoulliRelativeEntropy, always evaluated with a second argument in (0,1)(0,1)(0,1), where it is the true divergence.
  • Real powers are Real.rpow. The primal formula is stated for p∈(0,1)p \in (0,1)p∈(0,1), where its negative powers are finite.
  • Correction of the print. In Theorem 3 the page has pk(1−pk)/(8n)\sqrt{p_k(1-p_k)/(8n)}pk​(1−pk​)/(8n)​. The paper's argument with that choice gives Dkl≤1/nD_{\mathrm{kl}} \le 1/nDkl​≤1/n and, by Pinsker, total variation at most 1/21/\sqrt21/2​, which does not yield the printed constant 1/(8k∗pk)1/(8k_*p_k)1/(8k∗​pk​). The target uses 16n16n16n, for which the same argument gives total variation at most 12\tfrac1221​ and exactly the printed constant. The second branch is as printed. The milestone quotes keep the page's text.

The goal is the lower bound on the minimax risk (16) over all estimators and all laws on {0,M}\{0,M\}{0,M}. It does not mention the two hypotheses, δ\deltaδ, total variation or KL divergence, so it cannot be satisfied by a statement about a particular pair of laws or a particular estimator.

Contributions are welcome at every level: proofs of Lemma 12 through the primal formula or through the dual representation of the robust risk, a general finite-space Le Cam lemma, and tensorization of KL and Pinsker for finite products, which are reusable beyond this mission.

Selected references

  • J. C. Duchi and H. Namkoong, Learning Models with Uniform Performance via Distributionally Robust Optimization, Ann. Statist. 49(3), 2021; arXiv:1810.08750v6. https://arxiv.org/abs/1810.08750, https://doi.org/10.1214/20-AOS2004
  • L. Le Cam, Asymptotic Methods in Statistical Decision Theory, Springer, 1986. https://doi.org/10.1007/978-1-4612-4946-7
  • B. Yu, Assouad, Fano, and Le Cam, in Festschrift for Lucien Le Cam, Springer, 1997, 423–435. https://doi.org/10.1007/978-1-4612-1880-7_29
  • A. B. Tsybakov, Introduction to Nonparametric Estimation, Springer, 2009. https://doi.org/10.1007/b13794
  • N. Cressie and T. R. C. Read, Multinomial goodness-of-fit tests, J. R. Stat. Soc. B 46(3), 1984, 440–464. https://doi.org/10.1111/j.2517-6161.1984.tb01318.x
13 thms3 active usersReviewed
🏆Completed
Functional AnalysisMarkov Chain·Captain: mikedeng1

Logarithmic Sobolev Inequalities for Finite Markov Chains 2: Entropy Decay Ent_π(μH_t) ≤ e^{−2αt} Ent_π(μ), Improved to e^{−4αt} for Reversible ChainsResearch Paper

Motivation

How fast a finite Markov chain forgets its starting point is the central quantitative question in the analysis of Monte Carlo algorithms, card shuffling and random walks on groups. The classical tool is the spectral gap λ\lambdaλ, which controls convergence in ℓ2(π)\ell^2(\pi)ℓ2(π) but loses a factor 1/π(x)1/\pi(x)1/π(x) when converted into a bound for a chain started at a point. Diaconis and Saloff-Coste (Ann. Appl. Probab. 6 (1996) 695–750) brought the logarithmic Sobolev constant α\alphaα, introduced by Gross for Gaussian measures (Amer. J. Math. 97 (1975)), into the study of finite chains, and showed that it gives sharper mixing bounds in many examples.

The entropy route to ergodicity is the cleanest consequence of a log-Sobolev inequality: the relative entropy of the chain's law with respect to stationarity decays exponentially at rate 2α2\alpha2α, and at rate 4α4\alpha4α for reversible chains. The paper notes that the reversible case is contained in Bakry's Saint-Flour lectures (Lecture Notes in Math. 1581, 1994) and Stroock's notes on Gibbs states (Lecture Notes in Math. 1563, 1993), and that Miclo (preprint, 1995) treated the nonreversible case.

Setting

Let X\mathcal XX be a finite set and KKK a Markov kernel: K(x,y)≥0K(x,y)\ge0K(x,y)≥0 and ∑yK(x,y)=1\sum_y K(x,y)=1∑y​K(x,y)=1. Let π\piπ be an invariant probability, ∑xπ(x)K(x,y)=π(y)\sum_x\pi(x)K(x,y)=\pi(y)∑x​π(x)K(x,y)=π(y), with π(x)>0\pi(x)>0π(x)>0 for every xxx. Functions act on the right, Kf(x)=∑yK(x,y)f(y)Kf(x)=\sum_yK(x,y)f(y)Kf(x)=∑y​K(x,y)f(y), and ⟨f,g⟩=∑xf(x)g(x)π(x)\langle f,g\rangle=\sum_xf(x)g(x)\pi(x)⟨f,g⟩=∑x​f(x)g(x)π(x) is the inner product of ℓ2(π)\ell^2(\pi)ℓ2(π), with norms ∥f∥p=(∑x∣f(x)∣pπ(x))1/p\|f\|_p=(\sum_x|f(x)|^p\pi(x))^{1/p}∥f∥p​=(∑x​∣f(x)∣pπ(x))1/p. The chain is reversible if π(x)K(x,y)=π(y)K(y,x)\pi(x)K(x,y)=\pi(y)K(y,x)π(x)K(x,y)=π(y)K(y,x) for all x,yx,yx,y.

The continuous-time heat semigroup is

Ht=e−t(I−K)=e−t∑n≥0tnn!Kn,H_t=e^{-t(I-K)}=e^{-t}\sum_{n\ge0}\frac{t^n}{n!}K^n,Ht​=e−t(I−K)=e−tn≥0∑​n!tn​Kn,

acting on functions by Htf(x)=∑yHt(x,y)f(y)H_tf(x)=\sum_yH_t(x,y)f(y)Ht​f(x)=∑y​Ht​(x,y)f(y) and on probability measures by μHt(y)=∑xHt(x,y)μ(x)\mu H_t(y)=\sum_xH_t(x,y)\mu(x)μHt​(y)=∑x​Ht​(x,y)μ(x). The row Htx=Ht(x,⋅)H_t^x=H_t(x,\cdot)Htx​=Ht​(x,⋅) is the law at time ttt of the chain started at xxx.

The Dirichlet form is E(f,g)=⟨(I−K)f,g⟩\mathcal E(f,g)=\langle (I-K)f,g\rangleE(f,g)=⟨(I−K)f,g⟩; it is bilinear but not symmetric unless the chain is reversible. With

L(f)=∑x∣f(x)∣2log⁡∣f(x)∣2∥f∥22 π(x),\mathcal L(f)=\sum_x|f(x)|^2\log\frac{|f(x)|^2}{\|f\|_2^2}\,\pi(x),L(f)=x∑​∣f(x)∣2log∥f∥22​∣f(x)∣2​π(x),

the log-Sobolev constant is

α=inf⁡{E(f,f)L(f):L(f)≠0}.\alpha=\inf\Big\{\frac{\mathcal E(f,f)}{\mathcal L(f)}:\mathcal L(f)\ne0\Big\}.α=inf{L(f)E(f,f)​:L(f)=0}.

The relative entropy of a probability μ\muμ is Entπ(μ)=∑xμ(x)log⁡μ(x)π(x)\mathrm{Ent}_\pi(\mu)=\sum_x\mu(x)\log\frac{\mu(x)}{\pi(x)}Entπ​(μ)=∑x​μ(x)logπ(x)μ(x)​, and the total variation distance is ∥μ−π∥TV=sup⁡A⊂X∣μ(A)−π(A)∣\|\mu-\pi\|_{TV}=\sup_{A\subset\mathcal X}|\mu(A)-\pi(A)|∥μ−π∥TV​=supA⊂X​∣μ(A)−π(A)∣.

Formalization targets

Goal: Theorem 3.6 (p. 722)

For every probability measure μ\muμ on X\mathcal XX,

Entπ(μHt)≤Entπ(μ) e−2αt,t>0,\mathrm{Ent}_\pi(\mu H_t)\le\mathrm{Ent}_\pi(\mu)\,e^{-2\alpha t},\qquad t>0,Entπ​(μHt​)≤Entπ​(μ)e−2αt,t>0,

and, if (K,π)(K,\pi)(K,π) is reversible,

Entπ(μHt)≤Entπ(μ) e−4αt,t>0.\mathrm{Ent}_\pi(\mu H_t)\le\mathrm{Ent}_\pi(\mu)\,e^{-4\alpha t},\qquad t>0.Entπ​(μHt​)≤Entπ​(μ)e−4αt,t>0.

Milestones

  1. §2.1, Remarks (ii), p. 702: if μ=fπ\mu=f\piμ=fπ then μHt\mu H_tμHt​ has density Ht∗fH_t^*fHt∗​f, where Ht∗H_t^*Ht∗​ is the semigroup of the adjoint kernel K∗(x,y)=K(y,x)π(y)/π(x)K^*(x,y)=K(y,x)\pi(y)/\pi(x)K∗(x,y)=K(y,x)π(y)/π(x).
  2. Lemma 2.5, second part, p. 707: ∂t Entπ(Htf)∣t=0=−E(f,log⁡f)\partial_t\,\mathrm{Ent}_\pi(H_tf)|_{t=0}=-\mathcal E(f,\log f)∂t​Entπ​(Ht​f)∣t=0​=−E(f,logf).
  3. Lemma 2.7, p. 708: E(log⁡f,f)≥2 E(f,f)\mathcal E(\log f,f)\ge2\,\mathcal E(\sqrt f,\sqrt f)E(logf,f)≥2E(f​,f​), and ≥4 E(f,f)\ge4\,\mathcal E(\sqrt f,\sqrt f)≥4E(f​,f​) for reversible chains.
  4. §3.3, p. 722: for f≥0f\ge0f≥0 with ∥f∥2=1\|f\|_2=1∥f∥2​=1 and μ=f2π\mu=f^2\piμ=f2π, L(f)=Entπ(μ)\mathcal L(f)=\mathrm{Ent}_\pi(\mu)L(f)=Entπ​(μ).
  5. (2.8), p. 710: 2∥μ−π∥TV2≤Entπ(μ)≤∥μ−π∥TV+12∥μ/π−1∥π,222\|\mu-\pi\|_{TV}^2\le\mathrm{Ent}_\pi(\mu)\le\|\mu-\pi\|_{TV}+\tfrac12\|\mu/\pi-1\|_{\pi,2}^22∥μ−π∥TV2​≤Entπ​(μ)≤∥μ−π∥TV​+21​∥μ/π−1∥π,22​.

Companion: (3.3) (p. 723)

For an irreducible chain, every xxx and t>0t>0t>0,

2∥Htx−π∥TV2≤(log⁡1π(x))e−2αt,2\|H_t^x-\pi\|_{TV}^2\le\Big(\log\frac1{\pi(x)}\Big)e^{-2\alpha t},2∥Htx​−π∥TV2​≤(logπ(x)1​)e−2αt,

with 2α2\alpha2α replaced by 4α4\alpha4α for reversible chains.

Significance

Theorem 3.6 turns a single functional inequality into a convergence statement valid for every initial law, with no spectral assumption and no reversibility in the first half. Through Pinsker's inequality it gives (3.3), whose prefactor log⁡(1/π(x))\log(1/\pi(x))log(1/π(x)) replaces the factor 1/π(x)1/\pi(x)1/π(x) of the spectral bound 4∥Htx−π∥TV2≤π(x)−1e−2λt4\|H_t^x-\pi\|_{TV}^2\le\pi(x)^{-1}e^{-2\lambda t}4∥Htx​−π∥TV2​≤π(x)−1e−2λt. When π(x)\pi(x)π(x) is exponentially small in the size of the problem, as for random walks on large groups or product spaces, log⁡(1/π(x))\log(1/\pi(x))log(1/π(x)) is polynomial where 1/π(x)1/\pi(x)1/π(x) is exponential, and the time needed to make the bound small drops accordingly. This is the mechanism behind the sharp mixing bounds the paper derives from α\alphaα.

The results are proved in the paper and are classical; they are not, to our knowledge, formalized. The platform has measure-theoretic statements of Pinsker's inequality and the published finite Markov chain vocabulary of Levin–Peres–Wilmer (stochastic matrices, stationarity, total variation, the heat kernel), but nothing about log-Sobolev constants of finite chains, the entropy derivative along a Markov semigroup, or entropy decay. A formal development provides the entropy layer of the finite-chain theory: the adjoint semigroup, the dissipation identity, the comparison of E(log⁡f,f)\mathcal E(\log f,f)E(logf,f) with E(f,f)\mathcal E(\sqrt f,\sqrt f)E(f​,f​), and Pinsker's inequality in the encoding used by the mixing-time library.

Difficulty

The statement is about measures, while the natural quantities to differentiate are densities with respect to π\piπ, and for a nonreversible chain the density of μHt\mu H_tμHt​ evolves under the adjoint semigroup, not under HtH_tHt​. The Dirichlet form is not symmetric, so the order of its arguments matters at every step, and the improvement from 2α2\alpha2α to 4α4\alpha4α holds only under reversibility.

The obvious first idea, differentiating Entπ(μHt)\mathrm{Ent}_\pi(\mu H_t)Entπ​(μHt​) term by term, meets log⁡0\log 0log0 wherever the density vanishes. The initial law may be a point mass, and for a reducible chain the density can stay zero at positive times. The argument must therefore handle the boundary t=0t=0t=0 and the degenerate laws separately from the smooth interior. The constant α\alphaα is defined as an infimum over all functions, with no claim that it is attained or positive.

Formalization scope

The state space is a Fintype with decidable equality, KKK is a real matrix with the published predicate MarkovMixing.IsStochastic, π\piπ satisfies MarkovMixing.IsStationary K π and π(x)>0\pi(x)>0π(x)>0 for all xxx, and reversibility is MarkovMixing.DetailedBalance K π. HtH_tHt​ is the published MarkovMixing.heatKernel K t (the Poisson series), the adjoint kernel is MarkovMixing.timeReversal K π, and total variation is MarkovMixing.tvDist. Time is real, and the decay statements are for t>0t>0t>0.

The local definitions are E(f,g)=∑x(f(x)−Kf(x))g(x)π(x)\mathcal E(f,g)=\sum_x(f(x)-Kf(x))g(x)\pi(x)E(f,g)=∑x​(f(x)−Kf(x))g(x)π(x), the norms ∥f∥p\|f\|_p∥f∥p​, L\mathcal LL, α\alphaα as a real infimum over the ratios with L(f)≠0\mathcal L(f)\ne0L(f)=0, Entπ(μ)\mathrm{Ent}_\pi(\mu)Entπ​(μ), and μHt\mu H_tμHt​ as the row vector μ Ht\mu\,H_tμHt​. Lean's Real.log 0 = 0 implements 0log⁡0=00\log0=00log0=0. The goal does not assume irreducibility: it is true for every stochastic KKK with a positive invariant probability, and a reducible chain has α=0\alpha=0α=0. The companion (3.3) keeps irreducibility, the standing assumption of Section 3. In Lemmas 2.5 and 2.7 the paper's f≥0f\ge0f≥0 is strengthened to f>0f>0f>0, because log⁡f\log flogf is −∞-\infty−∞ at a zero of fff on the page and 000 in Lean.

Several encodings would make the goal trivially true and are ruled out. α\alphaα is not assumed positive. μ\muμ is a probability, since for μ=2π\mu=2\piμ=2π the entropy is a positive constant in ttt. π\piπ is invariant and positive, so μ/π\mu/\piμ/π is meaningful. The eigenvalue-based MarkovMixing.spectralGap is not used. Applying HtH_tHt​ to μ\muμ as a function, HtμH_t\muHt​μ, is not the same as μHt\mu H_tμHt​ for a nonreversible chain.

A complete development needs: termwise differentiation of the heat-kernel series and the semigroup property ∂tHt=(K−I)Ht\partial_tH_t=(K-I)H_t∂t​Ht​=(K−I)Ht​; the adjoint identity for HtH_tHt​; elementary convexity inequalities for log⁡\loglog and ⋅\sqrt{\cdot}⋅​; the symmetric form of E\mathcal EE for reversible chains; Pinsker's inequality on a finite set; and a scalar Grönwall lemma. The heat-kernel calculus and Pinsker's inequality in the MarkovMixing.tvDist encoding are reusable by the other missions of this series and by any mixing-time development. Proofs of individual milestones are welcome independently of the goal.

Selected references

  • P. Diaconis and L. Saloff-Coste, Logarithmic Sobolev inequalities for finite Markov chains, Ann. Appl. Probab. 6 (1996), 695–750. https://doi.org/10.1214/aoap/1034968224
  • L. Gross, Logarithmic Sobolev inequalities, Amer. J. Math. 97 (1975), 1061–1083. https://doi.org/10.2307/2373688
  • D. A. Levin, Y. Peres and E. L. Wilmer, Markov Chains and Mixing Times, 2nd ed., American Mathematical Society, 2017. https://doi.org/10.1090/mbk/107
14 thms3 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

Bounded Rationality in Newsvendor Models V: If σ_T ≤ Σσ_i and σ_T ≥ σ_i, Pooling Strictly Lowers the Expected Cost of Logit Newsvendors with Normal DemandsResearch Paper

Motivation

Inventory pooling lets several locations serve their combined demand from one stock of goods. Classical newsvendor analysis predicts lower optimal cost when pooling reduces demand variation, but the reduction can vanish when demands are perfectly correlated. Xuanming Su asks whether that conclusion survives when managers make noisy stocking decisions rather than always choose the optimum. In the published 2008 article, Bounded Rationality in Newsvendor Models, the decision noise follows a continuous logit model, in which better quantities are chosen more often. Proposition 7 gives conditions under which pooling strictly lowers expected cost, including a case where classical pooling has no cost gain. Su, 2008

The question matters for multilocation inventory systems because an order quantity is a decision as well as a response to demand. Pooling changes both the distribution of demand faced by the system and the number of independently chosen orders. A comparison based only on optimal costs leaves the second change out. This mission isolates the paper's mathematical claim about the combined effect of demand and decision variation. Su, 2008, §9

Setting

There are nnn locations. Demand at location iii is normally distributed with mean μi\mu_iμi​ and standard deviation σi\sigma_iσi​. The total demand has normal law with mean μT=∑iμi\mu_T=\sum_i\mu_iμT​=∑i​μi​ and standard deviation σT\sigma_TσT​. An order of xxx against a realized demand DDD incurs holding cost h(x−D)+h(x-D)^+h(x−D)+ for unsold units and backlog cost b(D−x)+b(D-x)^+b(D−x)+ for unmet demand. Its expected cost is γ(x)\gamma(x)γ(x). The decentralized system incurs one such cost at each location; the pooled system orders once for total demand. The published InventoryControl_newsboy definition supplies this Gaussian expected cost, with the same orientation of holding and backlog penalties as Su's equations (29) and (31). Su, 2008, p. 584

For an expected profit function π\piπ on a decision set SSS, the logit choice density is proportional to eπ(x)/βe^{\pi(x)/\beta}eπ(x)/β on SSS, where β>0\beta>0β>0 is a common bounded-rationality parameter. Larger β\betaβ spreads choices more widely; smaller positive β\betaβ concentrates them near high-profit choices. For normal demand, the decision domain is all of R\mathbb RR. With p=h+bp=h+bp=h+b and c=hc=hc=h, expected profit differs from minus expected cost by a constant independent of the order. The same logit law is therefore obtained from utility −γ(x)-\gamma(x)−γ(x). The random behavioral order is denoted XibX_i^bXib​ at location iii and XTbX_T^bXTb​ for the pool. Su, 2008, pp. 571–572, 584

Formalization targets

Strict pooling reduction

The goal is Proposition 7. Under positive holding and backlog costs, one common positive β\betaβ, at least two locations, positive individual standard deviations, and

σT≤∑i=1nσi,σT≥σifor every i,\sigma_T\leq\sum_{i=1}^{n}\sigma_i, \qquad \sigma_T\geq\sigma_i\quad\text{for every }i,σT​≤i=1∑n​σi​,σT​≥σi​for every i,

the claim is

E[γT(XTb)]<∑i=1nE[γi(Xib)].\mathbb E\bigl[\gamma_T(X_T^b)\bigr] <\sum_{i=1}^{n}\mathbb E\bigl[\gamma_i(X_i^b)\bigr].E[γT​(XTb​)]<i=1∑n​E[γi​(Xib​)].

The first standard-deviation inequality is automatic for the sum of jointly normal demands. The second excludes a total demand whose standard deviation is smaller than an individual location's. The result still includes perfect positive correlation, where the first inequality is an equality. Su, 2008, Proposition 7, p. 585

Supporting statements

Five milestones record the source's route to that comparison: invariance of the choice distribution under an order-preserving affine change of quantity (Lemma 1), invariance under an additive shift in utility (Lemma 2), standardization of the Gaussian newsvendor objective (equation (63)), the optimum of the canonical standard-normal newsvendor and the nonpositivity of its profit, and the comparison of its expected values at different positive scales. The milestone text preserves the wording of the printed article; the precise Lean conditions and corrections are stated with the items. Su, 2008, pp. 572, 587–588

Significance

The strict inequality separates two mechanisms of pooling. Demand aggregation can reduce variability, while a single pooled order also avoids accumulating the costs of several noisy decisions. Proposition 7 shows that the latter mechanism can make the cost reduction strict even when perfect correlation removes the usual variance benefit. It provides a condition that can be checked from individual and total standard deviations, rather than requiring an explicit covariance matrix in the final comparison. Su, 2008, pp. 584–585

The result is proved in the paper; the remaining task is a machine-checked formalization of its definitions and argument. The Gaussian expected-cost object is already published on Prove2Me, while the continuous logit law and this behavioral pooling theorem are new to this mission. The invariance statements and canonical profit comparison are reusable wherever a continuous logit rule acts on a transformed one-dimensional objective.

Difficulty

The usual pooling comparison evaluates cost at an optimal order. Here each system draws its order from a different continuous probability law, and the cost to compare is averaged over those choices. Comparing σT\sigma_TσT​ with ∑iσi\sum_i\sigma_i∑i​σi​ alone does not compare the logit distributions; in particular, it gives equality under perfect positive correlation while the target is strict. A formal development must also show that the normalizing integrals and the resulting cost expectations are genuine finite integrals for every set of parameters covered by the theorem.

Formalization scope

The Lean model uses Mathlib's real Gaussian law with variance σ2\sigma^2σ2 and the published InventoryControl_newsboy.newsboyCost for equations (29) and (31). It records the choice density, CDF, expectation, canonical profit, and behavioral expected cost as separate definitions. The behavioral density uses e−γ/βe^{-\gamma/\beta}e−γ/β on R\mathbb RR; the utility shift from profit is covered by Lemma 2. The theorem specifies normal marginals and a normal total with mean ∑iμi\sum_i\mu_i∑i​μi​ and standard deviation σT\sigma_TσT​. Every jointly normal demand vector in the paper yields these laws, and the final comparison uses no further feature of its joint distribution.

The conditions h>0h>0h>0, b>0b>0b>0, and β>0\beta>0β>0 are standing readings needed for the continuous choice law on the unbounded domain. Proposition 7 additionally states n≥2n\geq2n≥2 and σi>0\sigma_i>0σi​>0: for one location the alleged strict comparison becomes equality, while zero variance makes the paper's continuous density on a point support undefined. Lemma 1 requires positive affine scale because a negative scale reverses CDF order, and its two invariance lemmas require a finite positive normalizer. Equation (66) is read with min⁡(Z,z)\min(Z,z)min(Z,z), as dictated by the surrounding formulas; the printed display drops the word “min.” These corrections and the cost-based choice convention are recorded item by item in the moderation notes.

No optimizer is supplied as a free variable, and no zero normalizer is allowed to turn a logit expectation into a trivial zero. Useful solver contributions include proofs that the cost-based logit normalizer and expected cost are integrable, Gaussian change-of-variables lemmas, and the strict scale comparison. These analytic facts can serve other continuous-choice models.

Selected references

  • Xuanming Su, Bounded Rationality in Newsvendor Models, Manufacturing & Service Operations Management 10(4):566–589, 2008. DOI: 10.1287/msom.1070.0200.
9 thms3 active usersReviewed
🏆Completed
Bandit AlgorithmsDynamic ProgrammingOperations Research·Captain: mikedeng1

A Short Proof of the Gittins Index Theorem: For Finite-State Semi-Markov Bandits, Every Priority Policy Ordering States by the Index Algorithm's Indices Is OptimalResearch Paper

Motivation

The multi-armed bandit problem with discounted rewards asks how to allocate effort among nnn independent projects, only one of which can be worked on at a time, when the project worked on evolves randomly and the others stay frozen. It models job scheduling, research planning, search, and sequential clinical experimentation. Gittins and Jones showed in 1974 that the problem has an index solution: each state of each project has a number, computed from that project alone, and it is optimal always to work on the project whose current state has the largest number. The result turns an nnn-dimensional dynamic program into nnn one-dimensional computations.

Several proofs followed, each with its own model and its own definition of the index:

  • Gittins and Jones (1974) and Gittins (1979): the original interchange proofs, with the index as a supremum over stopping times of a reward-to-time ratio.
  • Whittle (1980): a proof through the retirement option and the dynamic-programming equation of the multi-armed problem.
  • Varaiya, Walrand and Buyukkoc (1985): the largest-remaining-index algorithm for finite-state Markov bandits, which computes the indices by removing states one at a time.
  • Weber (1992): the "prevailing charge" proof.
  • Tsitsiklis (1994): the short proof formalized here, for semi-Markov bandits with finite state spaces, by induction on the total number of states, with the indices produced by an index algorithm of the largest-remaining-index type.

Setting

There are n≥1n\ge1n≥1 bandit processes. Bandit iii has a finite nonempty state space Xi\mathcal X_iXi​, and X=X1∪⋯∪Xn\mathcal X=\mathcal X_1\cup\cdots\cup\mathcal X_nX=X1​∪⋯∪Xn​ is their disjoint union. When bandit iii at state x∈Xix\in\mathcal X_ix∈Xi​ is played, a random reward R(x)R(x)R(x) is received, the bandit is busy for a random time T(x)≥0T(x)\ge0T(x)≥0, and it then moves to a random state Y(x)∈XiY(x)\in\mathcal X_iY(x)∈Xi​; the other bandits do not move. The joint law of (T(x),R(x),Y(x))(T(x),R(x),Y(x))(T(x),R(x),Y(x)) depends only on xxx, and different plays are independent.

A policy is a map π:X1×⋯×Xn→{1,…,n}\pi:\mathcal X_1\times\cdots\times\mathcal X_n\to\{1,\dots,n\}π:X1​×⋯×Xn​→{1,…,n}: at time zero and at every play completion time it chooses the bandit to play from the current states. With tit_iti​ the start time and RiR_iRi​ the reward of the iii-th play and a discount rate β>0\beta>0β>0, the expected discounted reward from the initial joint state zzz is

Jπ(z)=E[∑i=1∞Rie−βti].J_\pi(z)=\mathbb E\Big[\sum_{i=1}^{\infty}R_i e^{-\beta t_i}\Big].Jπ​(z)=E[i=1∑∞​Ri​e−βti​].

A policy is optimal if it maximizes Jπ(z)J_\pi(z)Jπ​(z) for every initial state zzz. A priority rule is a policy for which some ordering of X\mathcal XX makes it always play the bandit whose current state is ordered highest.

The reward rate of a state is

r(x)=E[R(x)]E[∫0T(x)e−βt dt].(2.1)r(x)=\frac{\mathbb E[R(x)]}{\mathbb E\big[\int_0^{T(x)}e^{-\beta t}\,dt\big]}. \tag{2.1}r(x)=E[∫0T(x)​e−βtdt]E[R(x)]​.(2.1)

Reducing bandit i∗i^*i∗ by removing a state s∗s^*s∗ merges every play that ends in s∗s^*s∗ with the following run of plays at s∗s^*s∗ into one composite play, whose reward rate is r^(x)\hat r(x)r^(x) of (2.3). The index algorithm repeatedly picks a state s∗s^*s∗ of maximal current rate, sets its index γ(s∗)\gamma(s^*)γ(s∗) to that rate, and reduces its bandit by removing s∗s^*s∗ (or removes the bandit if s∗s^*s∗ was its last state).

Formalization targets

Goal: Theorem 2.2

Let γ\gammaγ be the indices of a run of the index algorithm. Then every priority rule whose ordering satisfies

γ(y)<γ(x) ⟹ y is ordered below x\gamma(y)<\gamma(x)\ \Longrightarrow\ y \text{ is ordered below } xγ(y)<γ(x) ⟹ y is ordered below x

is optimal. Ties in γ\gammaγ may be ordered either way, and the run may break ties in its own choices arbitrarily.

Milestones, in the order the proof uses them

  1. (2.2), the interchange inequality E[(1−e−βτ)∫0T(s∗)r(s∗)e−βtdt]≥E[(1−e−βT(s∗))∫0τrˉ(t)e−βtdt]\mathbb E\big[(1-e^{-\beta\tau})\int_0^{T(s^*)}r(s^*)e^{-\beta t}dt\big]\ge\mathbb E\big[(1-e^{-\beta T(s^*)})\int_0^{\tau}\bar r(t)e^{-\beta t}dt\big]E[(1−e−βτ)∫0T(s∗)​r(s∗)e−βtdt]≥E[(1−e−βT(s∗))∫0τ​rˉ(t)e−βtdt] when rˉ≤r(s∗)\bar r\le r(s^*)rˉ≤r(s∗).
  2. Lemma 2.1: if r(s∗)=max⁡xr(x)r(s^*)=\max_{x}r(x)r(s∗)=maxx​r(x), some optimal policy always plays bandit i∗i^*i∗ when it is at s∗s^*s∗.
  3. Reduction step: optimizing within the policies giving s∗s^*s∗ top priority is a bandit problem with one state fewer, the reduced bandit with rates (2.3).
  4. Theorem 2.1: some priority rule is optimal.
  5. Pick-order optimality: a priority rule that orders the states as a run of the index algorithm picks them is optimal.
  6. Index monotonicity: along a run, γ(s∗)≥γ(q∗)\gamma(s^*)\ge\gamma(q^*)γ(s∗)≥γ(q∗) for consecutive picks s∗,q∗s^*,q^*s∗,q∗.
  7. Picked-before characterization: xxx can be picked before yyy (in a run with the same indices) if and only if γ(x)≥γ(y)\gamma(x)\ge\gamma(y)γ(x)≥γ(y).

Significance

The theorem shows that the optimal priority order is determined by numbers that, by the reduction formulas, depend only on the statistics of each bandit separately. It is the basis of index policies in scheduling (the cμc\mucμ rule and its semi-Markov generalizations), of Klimov's problem and of branching bandits, which the paper's Section 3 obtains by modifying the same argument.

The result has been proved many times, but not in this generality on Prove2Me. The platform has a discrete-time Gittins index theorem for arms sharing one transition kernel and one reward function, with the index defined as a stopping-time supremum. This mission adds semi-Markov dynamics with random play durations and continuous discounting, heterogeneous finite bandits, priority rules, and the index algorithm as the definition of the index. A complete development would also give a machine-checked proof of correctness of a state-elimination algorithm for computing Gittins indices.

Difficulty

Lemma 2.1 compares an optimal stationary policy with a modified policy that is not stationary, and closes the gap by the optimality of stationary policies, which itself requires the dynamic-programming theory of discounted semi-Markov decision problems with finite state spaces. The reduction step requires an exact identification of the values of all top-priority policies with values in a different problem whose plays are composite and may never end. Theorem 2.1 is an induction over a family of problems with shrinking state spaces that are no longer raw semi-Markov bandits. Theorem 2.2 adds ties: a priority order compatible with the indices need not be the order of the given run, and one needs another run with the same indices.

Formalization scope

  • Bandits are indexed by Fin n (0,…,n−10,\dots,n-10,…,n−1), with n≥1n\ge1n≥1 and each state type finite and nonempty. X\mathcal XX is the sigma type Σ i, X i, disjoint by construction.
  • The law of (T(x),R(x),Y(x))(T(x),R(x),Y(x))(T(x),R(x),Y(x)) is a probability measure on R×R×Xi\mathbb R\times\mathbb R\times\mathcal X_iR×R×Xi​ with T≥0T\ge0T≥0 almost surely and RRR integrable. The model also assumes P(T(x)>0)>0\mathbb P(T(x)>0)>0P(T(x)>0)>0, which the page leaves implicit: it makes the denominator of (2.1) nonzero.
  • JπJ_\piJπ​ is computed from the moments E[R(x)]\mathbb E[R(x)]E[R(x)] and D(x,y)=E[e−βT(x);Y(x)=y]D(x,y)=\mathbb E[e^{-\beta T(x)};Y(x)=y]D(x,y)=E[e−βT(x);Y(x)=y]: it is the limit of the expected discounted reward of the first kkk plays, given by the first-step recursion. No path space is constructed. The row sums of DDD are below 111, so the limit exists; it never mentions rates, indices or reductions.
  • Policies are the paper's stationary deterministic maps of the current joint state, and optimality is within that class, for every initial state. An ordering of X\mathcal XX is an injective ranking into N\mathbb NN.
  • The reduced bandit is given by explicit formulas for its expected discounted reward, discounted duration and discounted transition data. These make the page's "transition probabilities are suitably modified" concrete, and the reduced rate is (2.3). Removing a bandit is the reduction of its last state.
  • The index is that of any run of the index algorithm, with arbitrary tie choices.

A formalization in which the value of a policy is defined through rates or indices, or in which γ\gammaγ is any function compatible with some order rather than the output of the algorithm, would make the goal trivial or empty; both are excluded by the definitions above.

Needed infrastructure: the convergence of the kkk-play values and the first-step (Bellman) equation for JπJ_\piJπ​; existence of an optimal stationary policy for finite discounted semi-Markov problems; the value identity for composite plays. The last two are reusable for any finite semi-Markov decision problem. Proofs of individual milestones, alternative arguments (Weber's prevailing charge, the retirement formulation), and the separability statement of p. 198 ("the index algorithm can be carried out separately for each different bandit") are welcome.

Selected references

  • J. N. Tsitsiklis, A Short Proof of the Gittins Index Theorem, Annals of Applied Probability 4(1) (1994), 194–199.
  • J. C. Gittins and D. M. Jones, A dynamic allocation index for the sequential design of experiments, in Progress in Statistics (J. Gani et al., eds.), North-Holland, 1974, 241–266.
  • J. C. Gittins, Bandit processes and dynamic allocation indices, J. Roy. Statist. Soc. Ser. B 41 (1979), 148–177. https://doi.org/10.1111/j.2517-6161.1979.tb01068.x
  • P. Whittle, Multi-armed bandits and the Gittins index, J. Roy. Statist. Soc. Ser. B 42 (1980), 143–149. https://doi.org/10.1111/j.2517-6161.1980.tb01111.x
  • P. P. Varaiya, J. C. Walrand and C. Buyukkoc, Extensions of the multiarmed bandit problem: the discounted case, IEEE Trans. Automat. Control 30 (1985), 426–439. https://doi.org/10.1109/TAC.1985.1103989
  • R. Weber, On the Gittins index for multiarmed bandits, Annals of Applied Probability 2(4) (1992), 1024–1033. https://doi.org/10.1214/aoap/1177005588
11 thms3 active usersReviewed
Dynamic ProgrammingOperations Research·Captain: mikedeng1

Optimal Ordering and Rationing Policies in a Nonstationary Dynamic Inventory Model with n Demand Classes IV: Critical-Level Ordering at Nondecreasing Myopic Levels ȳₘ Is OptimalResearch Paper

Motivation

A firm with one product may face several customer classes in each selling interval. When stock is scarce, it must decide which outstanding demands to satisfy and how much inventory to carry into later intervals. When new stock can be bought at several dates, the rationing choice also changes the value of future purchasing opportunities. Topkis studied these linked decisions in a nonstationary model with class-dependent shortage penalties and a finite number of ordering periods. His Theorem 4 identifies conditions under which a policy computed from each period's myopic cost is optimal in the full multiperiod problem Topkis 1968.

The result belongs to a line of work on critical-level policies: choose a stock target and order up to it if current stock is lower. Here the target can be computed one period at a time despite the possibility of future purchases and the separate question of how to ration stock among demand classes. The paper attributes a related myopic policy result to Veinott and explains that its own setting allows a more general rationing policy than the special zero-rationing-level case discussed there Topkis 1968, pp. 175–176. This mission formalizes Topkis's multiperiod statement, including its ordering and rationing conclusions.

Setting

There are NNN ordering periods, numbered 111 through NNN. Period mmm has a unit purchase cost cmc_mcm​. It contains kmk_mkm​ selling intervals, numbered backward: interval kmk_mkm​ is first and interval 111 is last. Within an interval, a random nonnegative demand vector has one component for each of nnn customer classes. The vectors in distinct intervals and periods are independent and each class has a finite mean. At the start of an interval the demand is observed. A decision then selects how much of each class's outstanding demand to leave unsatisfied. The remaining physical stock incurs a holding cost, and each unsatisfied unit incurs a class-specific penalty. Unsatisfied demand is either carried entirely to the next interval or lost entirely, according to the interval. Penalties are nonnegative and rise with class index, so class nnn has the highest shortage penalty Topkis 1968, pp. 162–163, 174.

Let www be net stock before ordering at the start of period mmm: physical stock minus outstanding backlogs. The order must clear the backlog, so the post-order stock zzz satisfies z≥w+=max⁡(w,0)z\ge w^+=\max(w,0)z≥w+=max(w,0). After period NNN, a further unit can be purchased for cN+1≥0c_{N+1}\ge0cN+1​≥0, while unused stock can be salvaged for revenue v≤cN+1v\le c_{N+1}v≤cN+1​. The terminal cost is CN+1(w)=(cN+1−v)w+C_{N+1}(w)=(c_{N+1}-v)w^+CN+1​(w)=(cN+1​−v)w+. Working backward, Cm(w)C_m(w)Cm​(w) is the optimal continuation cost, including the period-mmm ordering decision. The actual period cost g~m(z)\widetilde g^m(z)g​m(z) includes the later continuation value Cm+1C_{m+1}Cm+1​, and equation (19) reads

Cm(w)=inf⁡z≥w+g~m(z).C_m(w)=\inf_{z\ge w^+}\widetilde g^m(z).Cm​(w)=z≥w+inf​g​m(z).

The single-period cost gm(z)g^m(z)gm(z) uses the same demand, holding costs and rationing choices in period mmm, but replaces the later continuation value by the linear terminal charge −cm+1y-c_{m+1}y−cm+1​y. A myopic level yˉm\bar y_myˉ​m​ is any minimum of gmg^mgm on [0,∞)[0,\infty)[0,∞); it is +∞+\infty+∞ if no such minimum exists. Thus the level need not be the smallest minimum when several stock levels tie Topkis 1968, pp. 174–175.

Formalization targets

Theorem 4: myopic ordering and rationing

Suppose v=cN+1v=c_{N+1}v=cN+1​ and the selected myopic levels are nondecreasing from period mmm onward:

yˉm≤yˉm+1≤⋯≤yˉN.\bar y_m\le\bar y_{m+1}\le\cdots\le\bar y_N.yˉ​m​≤yˉ​m+1​≤⋯≤yˉ​N​.

Then yˉm<+∞\bar y_m<+\inftyyˉ​m​<+∞, and ordering to w∨yˉmw\vee\bar y_mw∨yˉ​m​ minimizes g~m\widetilde g^mg​m over all feasible post-order levels z≥w+z\ge w^+z≥w+. If m<Nm<Nm<N and the stock at the start of period mmm is at most yˉm+1\bar y_{m+1}yˉ​m+1​, the optimal rationing policy during that period is the optimal policy for its single-period problem, calculated with terminal costs v1≡0v_1\equiv0v1​≡0 and v2(y)=−cm+1yv_2(y)=-c_{m+1}yv2​(y)=−cm+1​y Topkis 1968, Theorem 4.

The milestones are the paper's regularity claim for CmC_mCm​ and g~m\widetilde g^mg​m, existence of an actual optimal order-up-to level, finiteness of yˉN\bar y_Nyˉ​N​, the shape of CmC_mCm​ around an optimal level, and the comparison in equation (20). Together these specify the route from the general dynamic program to the myopic target.

Significance

Theorem 4 gives a checkable sufficient condition for replacing a multiperiod ordering computation with a sequence of single-period cost minimizations. It also identifies when the rationing decisions can be obtained from the same single-period model. The stock bound in its rationing clause matters: outside that range, future costs may alter which class demands should be filled now. The result therefore describes both the simplification and its operational domain Topkis 1968, pp. 175–176.

Topkis proved the theorem in 1968; the task here is to produce machine-checked definitions and proofs of that known result. The definitions of feasible rationing, backward value functions, myopic costs and order-up-to levels will also support comparisons with other finite-horizon inventory models. The §1 model is duplicated locally while the four missions for this paper are drafted in parallel, then intended for consolidation into a shared interface.

Difficulty

Convexity alone gives an order-up-to form for the actual cost g~m\widetilde g^mg​m, but it does not identify its minimizing level with a minimum of the simpler cost gmg^mgm. The continuation value Cm+1C_{m+1}Cm+1​ depends on all later ordering and rationing decisions. When some unsatisfied demand is lost, the end-of-period net stock can depend on the within-period rationing choice as well. The core issue is therefore to control the difference between the actual and myopic objectives in the stock range relevant to period mmm Topkis 1968, pp. 174–176. A statement restricted to a preselected rationing rule would miss the theorem's claim about optimality among all feasible decisions.

Formalization scope

Classes are indexed by Fin n; the largest index is the highest penalty class. Intervals and ordering periods use natural numbers with explicit bounds, and intervals retain the paper's backward numbering. Stock, penalties and costs are real. A period's demand vector has a probability law on real vectors supported on the nonnegative orthant, with every coordinate integrable. The §1 dynamic program uses real infima for feasible rationing choices and Bochner integrals for demand expectations. The multiperiod value CmC_mCm​ uses the nonnegative post-order domain z≥w+z\ge w^+z≥w+ in (19). Its defining infimum is intended to be finite under the paper's assumptions; the regularity and attainment milestones expose the facts that rule out Lean's default value for an unbounded infimum. These functions are used only at 1≤m≤N+11\le m\le N+11≤m≤N+1, with period costs at 1≤m≤N1\le m\le N1≤m≤N.

The multiperiod standing assumptions require n>0n>0n>0, N>0N>0N>0, and at least one interval per period, matching the paper’s positive counts.

Holding costs and the appropriate terminal costs satisfy the convexity and continuity assumptions of §1. Within each period, backlog multipliers equal 000 or 111. The terminal procurement cost is nonnegative and salvage revenue does not exceed it. Assumption (D′) is encoded as an eventually positive lower bound on the extended-real right derivative of cmw+∑i=mN∑tht,i(w)−vwc_mw+\sum_{i=m}^N\sum_t h_{t,i}(w)-vwcm​w+∑i=mN​∑t​ht,i​(w)−vw. The §1 terminal functions used in the period assumptions are the linear functions required by the single-period comparison; their regularity adds no independent restriction. Independence across intervals and periods is built into successive expectations. The goal separately assumes v=cN+1v=c_{N+1}v=cN+1​ and monotonicity of the selected myopic levels only from mmm through NNN.

The formal target compares the actual and single-period sets of optimal rationing decisions at every interval and at every nonnegative state with stock at most yˉm+1\bar y_{m+1}yˉ​m+1​. The stock bound and the full feasible set prevent the claim from becoming a result about a handpicked policy. Contributions to the backward recursion, convexity and attainment facts, and the comparison of these two decision sets are all part of this mission.

Selected references

  • Donald M. Topkis, Optimal Ordering and Rationing Policies in a Nonstationary Dynamic Inventory Model with n Demand Classes, Management Science 15(3), 160–176, 1968. DOI: 10.1287/mnsc.15.3.160.
9 thms3 active usersReviewed
CombinatoricsOperations Research·Captain: mikedeng1

Concentration of Measure and Isoperimetric Inequalities in Product Spaces XI: The Random Assignment Problem — Fluctuations of the Optimal Cost of Order (log N)²/(√N log log N)Textbook

Motivation

The assignment problem asks for a one-to-one matching of NNN agents to NNN tasks that minimizes the total cost. It is one of the basic problems of combinatorial optimization and is solved in polynomial time by the Hungarian method. Its random version, in which the N2N^2N2 costs are independent random variables, is a standard model for the typical behavior of optimization problems on random inputs, and it has been studied in probability, operations research and statistical physics.

Timeline:

  • Walkup (1979) showed that the expected optimal cost E(LN)E(L_N)E(LN​) of the random assignment problem with independent uniform [0,1][0,1][0,1] costs stays bounded as N→∞N \to \inftyN→∞ (doi:10.1137/0208036).
  • Karp (1987) proved E(LN)≤2E(L_N) \le 2E(LN​)≤2.
  • Talagrand (1995), in the article this mission formalizes, bounded the fluctuations of LNL_NLN​ around its median by K(log⁡N)2/(Nlog⁡log⁡N)K(\log N)^2/(\sqrt N \log\log N)K(logN)2/(N​loglogN), as a showcase of his concentration inequality for product measures (doi:10.1007/BF02699376).
  • Aldous (2001) proved the limit E(LN)→π2/6E(L_N) \to \pi^2/6E(LN​)→π2/6, the value predicted by Mézard and Parisi (doi:10.1002/rsa.1015).

This mission is Chapter 10 of Talagrand's article.

Setting

Fix NNN and two sets III and JJJ of cardinal NNN. An assignment is a one-to-one map τ\tauτ from III onto JJJ. Given a cost matrix a=(ai,j)i∈I,j∈Ja = (a_{i,j})_{i \in I, j \in J}a=(ai,j​)i∈I,j∈J​, the cost of τ\tauτ is ∑i∈Iai,τ(i)\sum_{i \in I} a_{i,\tau(i)}∑i∈I​ai,τ(i)​. In the random problem the costs are Xi,jX_{i,j}Xi,j​, independent and uniformly distributed on [0,1][0,1][0,1], and the optimal cost is the random variable

LN=min⁡{∑i∈IXi,τ(i)  ;  τ assignment}.L_N = \min\Big\{ \sum_{i \in I} X_{i,\tau(i)} \;;\; \tau \text{ assignment} \Big\}.LN​=min{i∈I∑​Xi,τ(i)​;τ assignment}.

A median of LNL_NLN​ is any real MMM with P(LN≤M)≥1/2P(L_N \le M) \ge 1/2P(LN​≤M)≥1/2 and P(LN≥M)≥1/2P(L_N \ge M) \ge 1/2P(LN​≥M)≥1/2.

The argument uses digraphs. A digraph is a subset D⊆I×JD \subseteq I \times JD⊆I×J, and for S⊆IS \subseteq IS⊆I the set of neighbors is D(S)={j∈J; ∃i∈S, (i,j)∈D}D(S) = \{ j \in J ;\ \exists i \in S,\ (i,j) \in D \}D(S)={j∈J; ∃i∈S, (i,j)∈D}. For α≥2\alpha \ge 2α≥2, DDD is α\alphaα-expanding if for every S⊆IS \subseteq IS⊆I

card⁡S≤N2⇒card⁡D(S)≥min⁡(αcard⁡S,N2),card⁡S≥N2⇒card⁡D(S)≥N−1α(N−card⁡S).\operatorname{card} S \le \tfrac N2 \Rightarrow \operatorname{card} D(S) \ge \min\big(\alpha \operatorname{card} S, \tfrac N2\big), \qquad \operatorname{card} S \ge \tfrac N2 \Rightarrow \operatorname{card} D(S) \ge N - \tfrac 1\alpha (N - \operatorname{card} S).cardS≤2N​⇒cardD(S)≥min(αcardS,2N​),cardS≥2N​⇒cardD(S)≥N−α1​(N−cardS).

For u>0u > 0u>0 the threshold digraph is Du={(i,j); Xi,j≤2uN−1log⁡N}D_u = \{(i,j) ;\ X_{i,j} \le 2uN^{-1}\log N\}Du​={(i,j); Xi,j​≤2uN−1logN}: it keeps only the cheap edges.

Formalization targets

Goal: Theorem 10.5

There is a universal constant KKK such that for N≥3N \ge 3N≥3, every median MMM of LNL_NLN​ and every t≥0t \ge 0t≥0,

t≤log⁡N⇒P(∣LN−M∣≥Kt(log⁡N)2Nlog⁡log⁡N)≤2e−t2,t \le \sqrt{\log N} \Rightarrow P\Big(|L_N - M| \ge \frac{K t (\log N)^2}{\sqrt N \log\log N}\Big) \le 2 e^{-t^2},t≤logN​⇒P(∣LN​−M∣≥N​loglogNKt(logN)2​)≤2e−t2, t≥log⁡N⇒P(∣LN−M∣≥Kt3log⁡NNlog⁡t2)≤2e−t2.t \ge \sqrt{\log N} \Rightarrow P\Big(|L_N - M| \ge \frac{K t^3 \log N}{\sqrt N \log t^2}\Big) \le 2 e^{-t^2}.t≥logN​⇒P(∣LN​−M∣≥N​logt2Kt3logN​)≤2e−t2.

The constant KKK is left unspecified, as in the paper.

Milestones, in attack order

  1. Lemma 10.1 (deterministic): in an α\alphaα-expanding digraph with αm≥N/2\alpha^m \ge N/2αm≥N/2, every i∈Ii \in Ii∈I lies on a cycle i=i1,…,in+1=ii = i_1, \dots, i_{n+1} = ii=i1​,…,in+1​=i of distinct points, n≤2mn \le 2mn≤2m, with (iℓ,τ(iℓ+1))∈D(i_\ell, \tau(i_{\ell+1})) \in D(iℓ​,τ(iℓ+1​))∈D.
  2. Corollary 10.2 (deterministic in the costs): if DuD_uDu​ is α\alphaα-expanding and αm≥N/2\alpha^m \ge N/2αm≥N/2, every optimal assignment satisfies Xi,τ(i)≤4muN−1log⁡NX_{i,\tau(i)} \le 4muN^{-1}\log NXi,τ(i)​≤4muN−1logN.
  3. Lemma 10.4: for independent events of probability ppp, fewer than δpN\delta p NδpN occur with probability at most exp⁡(−Np/K(δ))\exp(-Np/K(\delta))exp(−Np/K(δ)).
  4. Proposition 10.3: for a universal KKK and u>Ku > Ku>K with ulog⁡N≤Nu \log N \le NulogN≤N, DuD_uDu​ is ulog⁡Nu\log NulogN-expanding with probability at least 1−N−u/K1 - N^{-u/K}1−N−u/K.

Significance

The expected value of LNL_NLN​ is of the same order as a single cost, yet LNL_NLN​ is a function of N2N^2N2 independent variables. A generic bounded-difference bound in all N2N^2N2 coordinates gives no useful concentration at this scale. Theorem 10.5 shows that the fluctuations are at most of order (log⁡N)2/(Nlog⁡log⁡N)(\log N)^2/(\sqrt N \log\log N)(logN)2/(N​loglogN), and by the remark after the theorem, so is the standard deviation of LNL_NLN​. The chapter is a worked example of how a concentration inequality in product spaces is combined with a combinatorial localization argument, the reduction to small costs, and that pattern recurs in the study of random combinatorial optimization problems.

Status: the theorem and its lemmas are proved in the paper. As far as a search of the platform shows, none of them has a machine-checked proof. The two posed statements of Theorem 4.1.1 on the platform (finite-alphabet form) are the concentration inequality the proof calls on; formalizing this chapter adds the combinatorics of expanding digraphs, the random-graph estimate Proposition 10.3 and the final assembly.

Difficulty

The naive approach applies a concentration inequality directly to LNL_NLN​ as a function of the N2N^2N2 costs, each of which can change LNL_NLN​ by up to 111. That loses all control, because the variance proxy grows with the number of coordinates. The central step is to show that, with high probability, an optimal assignment only uses costs of order N−1(log⁡N)2N^{-1}(\log N)^2N−1(logN)2. This requires the cycle structure of Lemma 10.1, and it requires showing that the sparse random digraph DuD_uDu​ has expansion uniformly over all subsets SSS of III, whose number is exponential in NNN. Proposition 10.3 has to beat that union bound, and its proof covers only one of the two expansion conditions in detail; the condition (10.2) for large sets is "left to the reader". The final step combines the truncation with Theorem 4.1.1 and a careful choice of parameters for the two ranges of ttt.

Formalization scope

The Lean development lives in the namespace TalagrandConc.Assignment and commits to the following conventions:

  • I=J=I = J = I=J= Fin N, assignments are Equiv.Perm (Fin N), and LNL_NLN​ is optCost, a Finset.inf' over all permutations (no junk value).
  • The probability space is the cost matrices Fin N × Fin N → ℝ with costLaw N, the product of Lebesgue measure restricted to [0,1][0,1][0,1]. The coordinates are the Xi,jX_{i,j}Xi,j​.
  • Cardinalities of subsets are Set.ncard on the finite type Fin N. α\alphaα-expansion includes α≥2\alpha \ge 2α≥2 as part of the definition.
  • Probabilities are in ℝ≥0∞, and 1−N−u/K1 - N^{-u/K}1−N−u/K is truncated subtraction there.
  • Universal constants are existentially quantified before every object they are uniform over. K(δ)K(\delta)K(δ) in Lemma 10.4 is chosen after δ\deltaδ and before everything else.
  • Implicit side conditions of the paper are stated: m≥1m \ge 1m≥1 in Lemma 10.1 and Corollary 10.2, n≥1n \ge 1n≥1 for the cycle, N≥1N \ge 1N≥1 in Proposition 10.3, t≥0t \ge 0t≥0 in Theorem 10.5.

A cycle of length n=0n = 0n=0 would satisfy Lemma 10.1 vacuously. The formal statement therefore requires n≥1n \ge 1n≥1, which rules out that trivializing reading. Similarly, Theorem 10.5 fixes one constant KKK for all NNN; a KKK depending on NNN would make the bound empty.

Infrastructure: the product of uniform laws on a finite index set, iterated expansion arguments for bipartite digraphs, a lower-tail Chernoff bound for independent events, and the union bound over subsets are reusable beyond this mission. Theorem 4.1.1 of the paper is posed elsewhere on the platform and is not restated here. The bound (8.1.1) used in Step 2 of the proof belongs to another chapter of the series. Contributions of proofs of any milestone, or of intermediate displayed estimates such as (10.5), (10.6) and (10.9), are welcome.

Selected references

  • M. Talagrand, Concentration of measure and isoperimetric inequalities in product spaces, Publ. Math. IHÉS 81 (1995), 73–205. doi:10.1007/BF02699376
  • D. W. Walkup, On the expected value of a random assignment problem, SIAM J. Comput. 8 (1979), 440–442. doi:10.1137/0208036
  • R. M. Karp, An upper bound on the expected cost of an optimal assignment, in Discrete Algorithms and Complexity, Academic Press (1987), 1–4.
  • J. M. Steele, Probability Theory and Combinatorial Optimization, SIAM (1997). doi:10.1137/1.9781611970029
  • D. J. Aldous, The ζ(2) limit in the random assignment problem, Random Structures Algorithms 18 (2001), 381–418. doi:10.1002/rsa.1015
7 thms3 active usersReviewed
🏆Completed
Functional Analysis·Captain: mikedeng1

Concentration of Measure and Isoperimetric Inequalities in Product Spaces IX: Suprema of Linear Forms in Bounded Independent Variables — P(|Z − M| ≥ u) ≤ 4 exp(−u²/(4σ²))Textbook

Why linear suprema arise

A family of linear forms turns independent observations into a single random maximum. Examples include the largest value of a collection of statistical scores and the norm of a random vector sum, which can itself be expressed through the continuous dual of a normed space. A bound for each form separately does not automatically control the supremum over an infinite family. Talagrand's 1995 paper gives a concentration inequality in which the coefficient scale, rather than the number of forms, controls the deviation Talagrand 1995, §8.1. The Banach-space consequence in Chapter 13 applies the same principle to norms of vector sums Talagrand 1995, Theorem 13.2.

The two results have a direct relationship: the norm of a vector is the supremum of its evaluations by continuous linear functionals of norm at most one. The formalization therefore gives a setting in which a general real-valued supremum theorem and a vector-valued corollary can be audited together. It also tests whether the concentration statement remains faithful when the family of forms is infinite and the coordinate laws differ.

The random supremum and its scale

Fix a finite number NNN of coordinates and a nonempty family F⊆RN\mathcal F\subseteq\mathbb R^NF⊆RN of coefficient vectors α=(αi)i=1N\alpha=(\alpha_i)_{i=1}^Nα=(αi​)i=1N​. The coefficients may have either sign. Write ∥α∥2=(∑iαi2)1/2\|\alpha\|_2=(\sum_i\alpha_i^2)^{1/2}∥α∥2​=(∑i​αi2​)1/2, and let σ=sup⁡α∈F∥α∥2\sigma=\sup_{\alpha\in\mathcal F}\|\alpha\|_2σ=supα∈F​∥α∥2​. The mission treats the case in which this coefficient scale is finite and positive. Let XiX_iXi​ be independent real random variables, with an individual interval [ri,ri+1][r_i,r_i+1][ri​,ri​+1] containing each XiX_iXi​ almost surely. The center rir_iri​ and the law of XiX_iXi​ may vary with iii. The object of interest is

Z=sup⁡α∈F∑i=1NαiXi.Z=\sup_{\alpha\in\mathcal F}\sum_{i=1}^N\alpha_iX_i.Z=α∈Fsup​i=1∑N​αi​Xi​.

A median MMM of ZZZ means that both P(Z≤M)P(Z\le M)P(Z≤M) and P(Z≥M)P(Z\ge M)P(Z≥M) are at least 1/21/21/2. This definition permits more than one median and makes no choice among them. With a bounded coefficient family and bounded coordinates, the supremum is finite for each input. The mission also assumes that ZZZ is measurable, because an uncountable supremum of measurable functions need not be measurable automatically. These are the mathematical conditions needed to give the displayed probability its ordinary meaning.

The supporting observation uses Talagrand's convex-hull distance. For a set AAA of coordinate tuples and a point xxx, form the binary vectors sss for which there is some y∈Ay\in Ay∈A such that every coordinate with si=0s_i=0si​=0 agrees between xxx and yyy. Let VA(x)V_A(x)VA​(x) be their convex hull in RN\mathbb R^NRN. The distance fc(A,x)f_c(A,x)fc​(A,x) is the Euclidean distance from zero to VA(x)V_A(x)VA​(x). If AAA is empty, this distance is +∞+\infty+∞. This convention preserves the intended meaning of a distance to an empty target Talagrand 1995, §4.1.

Formalization targets

For x∈[0,1]Nx\in[0,1]^Nx∈[0,1]N, put Zr(x)=sup⁡α∈F∑iαi(ri+xi)Z_r(x)=\sup_{\alpha\in\mathcal F}\sum_i\alpha_i(r_i+x_i)Zr​(x)=supα∈F​∑i​αi​(ri​+xi​) and A(a)={y∈[0,1]N:Zr(y)≤a}A(a)=\{y\in[0,1]^N:Z_r(y)\le a\}A(a)={y∈[0,1]N:Zr​(y)≤a}. The first milestone is Eq. (8.1.3): if A(a)A(a)A(a) is nonempty, then for every α∈F\alpha\in\mathcal Fα∈F some y∈A(a)y\in A(a)y∈A(a) has disagreement set I={i:yi≠xi}I=\{i:y_i\ne x_i\}I={i:yi​=xi​} with

∑i∈I∣αi∣≤∥α∥2 fc(A(a),x)≤σfc(A(a),x).\sum_{i\in I}|\alpha_i|\le\|\alpha\|_2\,f_c(A(a),x)\le\sigma f_c(A(a),x).i∈I∑​∣αi​∣≤∥α∥2​fc​(A(a),x)≤σfc​(A(a),x).

The second milestone is the deterministic observation in Eq. (8.1.2):

Zr(x)≤a+σfc(A(a),x).Z_r(x)\le a+\sigma f_c(A(a),x).Zr​(x)≤a+σfc​(A(a),x).

The goal, Theorem 8.1.1, asserts that every median MMM of ZZZ and every u>0u>0u>0 satisfy

P(∣Z−M∣≥u)≤4exp⁡ ⁣(−u24σ2).P(|Z-M|\ge u)\le 4\exp\!\left(-\frac{u^2}{4\sigma^2}\right).P(∣Z−M∣≥u)≤4exp(−4σ2u2​).

The third milestone is Theorem 13.2. For vectors viv_ivi​ in a real Banach space WWW, define the weak variance scale σW=(sup⁡w∗∈W∗, ∥w∗∥≤1∑iw∗(vi)2)1/2\sigma_W=(\sup_{w^*\in W^*,\,\|w^*\|\le1}\sum_i w^*(v_i)^2)^{1/2}σW​=(supw∗∈W∗,∥w∗∥≤1​∑i​w∗(vi​)2)1/2. If the independent real variables YiY_iYi​ satisfy ∣Yi∣≤1|Y_i|\le1∣Yi​∣≤1, the theorem bounds deviations of S=∥∑iYivi∥S=\|\sum_iY_iv_i\|S=∥∑i​Yi​vi​∥ from any median MMM:

P(∣S−M∣≥tσW)≤4exp⁡(−t2/16),t>0.P(|S-M|\ge t\sigma_W)\le4\exp(-t^2/16),\qquad t>0.P(∣S−M∣≥tσW​)≤4exp(−t2/16),t>0.

The statement is made for σW>0\sigma_W>0σW​>0. With σW=0\sigma_W=0σW​=0, the displayed event has threshold zero and probability one, while the right side falls below one for large ttt; the printed inequality therefore needs that qualification Talagrand 1995, p. 198.

What the results provide

Theorem 8.1.1 controls a supremum using only the largest Euclidean norm of its coefficient vectors. Its statement does not charge a factor for the cardinality of F\mathcal FF, so it applies equally to a finite collection and to an infinite measurable supremum. The coordinatewise interval condition allows different distributions and different centers. Theorem 13.2 converts the same concentration scale into a statement about Banach-space vector sums, where the dual unit ball supplies the coefficient family Talagrand 1995, pp. 156, 198.

Both results are proved in the paper. The work here is to formalize their exact statements and the distance interface used between them. The reusable pieces are the median convention, an extended-valued convex distance on arbitrary product spaces, a measurable supremum over a general set of coefficient vectors, and the weak variance scale for Banach-space vectors. None of the two claimed concentration inequalities is treated as already machine checked by this mission.

The difficult point

For a single fixed vector α\alphaα, bounded-coordinate concentration gives information about ∑iαiXi\sum_i\alpha_iX_i∑i​αi​Xi​. Applying that estimate to every member of F\mathcal FF and taking a union would introduce a dependence on the number of vectors. It would also give no useful bound for a genuinely infinite family without additional covering information. Talagrand's target avoids a cardinality term, so a direct collection of fixed-form estimates does not establish the stated result Talagrand 1995, §8.1.

The deterministic distance statement presents a second issue for formalization. Its set A(a)A(a)A(a) can be empty, and the paper's distance then has value +∞+\infty+∞. A real-valued infimum with a default value at the empty set would erase that distinction. The exact Euclidean norm also matters: the usual norm on a Lean function space need not be the paper's ℓ2\ell^2ℓ2 norm. These choices affect the mathematical meaning of the milestone before any concentration argument begins.

Formalization scope

Coordinates are indexed by Fin N, corresponding to the paper's indices 1,…,N1,\ldots,N1,…,N. The independent observations live on the canonical product of their individual real-valued laws. Each law gives probability one to its own interval [ri,ri+1][r_i,r_i+1][ri​,ri​+1]; identical distribution is not assumed. The coefficient family is a set, not a finite list. Its nonemptiness, finite norm supremum and positive scale are explicit. Measurability of the real supremum is also explicit, following the paper's convention of ignoring measurability questions Talagrand 1995, pp. 81–82.

The mismatch vectors and their convex hull are defined over the whole underlying product type. The distance is an extended nonnegative real infimum of Euclidean lengths, so an empty target has distance +∞+\infty+∞. Eq. (8.1.2) uses extended arithmetic for the positive part of Zr(x)−aZ_r(x)-aZr​(x)−a, which keeps the empty-sublevel case meaningful. The probability bounds retain the paper's constants 444, 4σ24\sigma^24σ2, and 161616. A zero coefficient scale cannot be used to make the goal a vacuous division-by-zero statement; the Banach result likewise requires a positive weak variance scale.

The mission welcomes proofs of the two concentration statements, the deterministic distance observation, and supporting facts about the supremum's finiteness and measurability. General lemmas about product measures, medians, extended distances, and dual norms would be useful beyond this chapter. The statements do not restrict F\mathcal FF to a finite or countable subset, so a proof must address the general family under the explicit measurability assumption.

Selected references

  • Michel Talagrand, Concentration of measure and isoperimetric inequalities in product spaces, Publications Mathématiques de l'IHÉS 81 (1995), 73–205. DOI: 10.1007/BF02699376.
7 thms3 active usersReviewed
🏆Completed
Combinatorics·Captain: mikedeng1

Concentration of Measure and Isoperimetric Inequalities in Product Spaces VIII: The Longest Increasing Subsequence — Gaussian Concentration of L_N around Its Median MTextbook

Why the longest increasing subsequence

Pick NNN independent points X1,…,XNX_1, \dots, X_NX1​,…,XN​ uniformly in [0,1][0,1][0,1] and let LNL_NLN​ be the length of the longest increasing subsequence. Because the points are almost surely distinct, LNL_NLN​ has the law of the longest increasing subsequence of a uniform random permutation of {1,…,N}\{1, \dots, N\}{1,…,N}. This is Ulam's problem, one of the most studied random combinatorial quantities. Hammersley (1972) showed ELN/N\mathbb E L_N / \sqrt NELN​/N​ converges, and Vershik–Kerov and Logan–Shepp (1977) identified the limit as 222. That leaves the size of the fluctuations of LNL_NLN​ around its typical value.

Timeline.

  • Frieze (1991, [F] in the paper) and Bollobás–Brightwell (1992, [B-B]) proved concentration of LNL_NLN​ around its mean with martingale methods, on deviation scales larger than N1/4N^{1/4}N1/4.
  • Talagrand (1995), Section 7.1, derived from his convex hull inequality a two-sided Gaussian-type bound around the median on the scale MN≍N1/4\sqrt{M_N} \asymp N^{1/4}MN​​≍N1/4, with explicit constants and no logarithmic loss. This is the target of the mission.
  • Baik, Deift and Johansson (1999) showed that the true fluctuations are of order N1/6N^{1/6}N1/6, with Tracy–Widom limit law, so Talagrand's scale is not sharp. Its value is that it comes from a short, general principle.

Section 7.2 of the same paper applies the same idea to the longest common subsequence of two random words, a quantity tied to the edit distance used in genetics and speech recognition.

Setting

Let Ω=[0,1]\Omega = [0,1]Ω=[0,1] and N≥0N \ge 0N≥0. For x=(x1,…,xN)∈ΩNx = (x_1, \dots, x_N) \in \Omega^Nx=(x1​,…,xN​)∈ΩN, LN(x)L_N(x)LN​(x) is the largest integer ppp for which there are indices i1<⋯<ipi_1 < \dots < i_pi1​<⋯<ip​ with xi1≤⋯≤xipx_{i_1} \le \dots \le x_{i_p}xi1​​≤⋯≤xip​​. For a>0a > 0a>0, the level set is A(a)={x∈ΩN; LN(x)≤a}A(a) = \{x \in \Omega^N ;\ L_N(x) \le a\}A(a)={x∈ΩN; LN​(x)≤a}.

Fix a probability μ\muμ on [0,1][0,1][0,1] without atoms (Lebesgue measure, for instance) and let P=μ⊗NP = \mu^{\otimes N}P=μ⊗N be the product probability on ΩN\Omega^NΩN; the coordinates are the random points XiX_iXi​. A median of LNL_NLN​ is a number MMM with P(LN≤M)≥1/2P(L_N \le M) \ge 1/2P(LN​≤M)≥1/2 and P(LN≥M)≥1/2P(L_N \ge M) \ge 1/2P(LN​≥M)≥1/2.

The tool is Talagrand's convex hull distance. For A⊆ΩNA \subseteq \Omega^NA⊆ΩN and x∈ΩNx \in \Omega^Nx∈ΩN, let UA(x)U_A(x)UA​(x) be the set of s∈{0,1}Ns \in \{0,1\}^Ns∈{0,1}N for which some y∈Ay \in Ay∈A agrees with xxx at every coordinate iii with si=0s_i = 0si​=0; let VA(x)V_A(x)VA​(x) be its convex hull in RN\mathbb R^NRN; and let fc(A,x)f_c(A,x)fc​(A,x) be the Euclidean distance from 000 to VA(x)V_A(x)VA​(x) (with fc(A,x)=+∞f_c(A,x) = +\inftyfc​(A,x)=+∞ if A=∅A = \emptysetA=∅).

A function LN:ΩN→NL_N : \Omega^N \to \mathbb NLN​:ΩN→N on an arbitrary probability space (Ω,μ)(\Omega, \mu)(Ω,μ) is a configuration function if, for every xxx, some set JJJ of exactly LN(x)L_N(x)LN​(x) coordinates satisfies LN(y)≥card⁡{i∈J; yi=xi}L_N(y) \ge \operatorname{card}\{i \in J ;\ y_i = x_i\}LN​(y)≥card{i∈J; yi​=xi​} for all yyy.

For two sequences x=(x1,…,xN)x = (x_1, \dots, x_N)x=(x1​,…,xN​) and y=(y1,…,yN′)y = (y_1, \dots, y_{N'})y=(y1​,…,yN′​), LN,N′(x;y)L_{N,N'}(x;y)LN,N′​(x;y) is the largest ppp with i1<⋯<ipi_1 < \dots < i_pi1​<⋯<ip​, j1<⋯<jpj_1 < \dots < j_pj1​<⋯<jp​ and xiℓ=yjℓx_{i_\ell} = y_{j_\ell}xiℓ​​=yjℓ​​ for all ℓ≤p\ell \le pℓ≤p.

Formalization targets

Goal: Theorem 7.1.2 (p. 153)

For every median MMM of LNL_NLN​ and every u>0u > 0u>0,

P(LN≥M+u)≤2exp⁡(−u24(M+u)),P(LN≤M−u)≤2exp⁡(−u24M).P(L_N \ge M + u) \le 2\exp\Big(-\frac{u^2}{4(M+u)}\Big), \qquad P(L_N \le M - u) \le 2\exp\Big(-\frac{u^2}{4M}\Big).P(LN​≥M+u)≤2exp(−4(M+u)u2​),P(LN​≤M−u)≤2exp(−4Mu2​).

Milestones

  1. Lemma 7.1.1 (p. 153). For a>0a > 0a>0 and every xxx, a≥LN(x)−fc(A(a),x)LN(x)a \ge L_N(x) - f_c(A(a),x)\sqrt{L_N(x)}a≥LN​(x)−fc​(A(a),x)LN​(x)​; in particular LN(x)≥a+vL_N(x) \ge a + vLN​(x)≥a+v implies fc(A(a),x)≥v/a+vf_c(A(a),x) \ge v/\sqrt{a+v}fc​(A(a),x)≥v/a+v​.
  2. Theorem 7.1.3 (p. 154). The two bounds of the goal hold for every configuration function on any product probability space.
  3. Eq. (7.2.3) (p. 155). For the longest common subsequence L(x)L(x)L(x) of the two halves of x∈[0,1]N+N′x \in [0,1]^{N+N'}x∈[0,1]N+N′: a≥L(x)−22 fc(A(a),x)L(x)a \ge L(x) - 2\sqrt2\, f_c(A(a),x)\sqrt{L(x)}a≥L(x)−22​fc​(A(a),x)L(x)​.
  4. Theorem 7.2.1 (p. 154). For two independent i.i.d. sequences with common real law and a median MMM of LN,N′L_{N,N'}LN,N′​:
P(LN,N′≥M+u)≤2exp⁡(−u232(M+u)),P(LN,N′≤M−u)≤2exp⁡(−u232M).P(L_{N,N'} \ge M + u) \le 2\exp\Big(-\frac{u^2}{32(M+u)}\Big), \qquad P(L_{N,N'} \le M - u) \le 2\exp\Big(-\frac{u^2}{32M}\Big).P(LN,N′​≥M+u)≤2exp(−32(M+u)u2​),P(LN,N′​≤M−u)≤2exp(−32Mu2​).

Significance

The result. Since MNM_NMN​ is of order N\sqrt NN​, the goal confines LNL_NLN​ to a window of width of order N1/4N^{1/4}N1/4 around its median with Gaussian-type tails. For uuu much larger than MMM the upper bound becomes exponential in uuu, the natural tail of a quantity bounded by the size of a witnessing configuration. Theorem 7.1.3 isolates what is used: every integer quantity certified by a configuration of exactly its own size has the same concentration. This abstraction became the notion of certifiable functions used widely in random graph theory and probabilistic combinatorics (see the treatment of Talagrand's inequality in Alon–Spencer, The Probabilistic Method). For the longest common subsequence, the bound is useful when the alphabet is large and M≪NM \ll NM≪N, where it improves on Azuma's inequality.

Formalizing it. All four results are proved in the paper; none is formalized in Lean as far as a search of the Prove2Me corpus shows. A finite-alphabet certifiable-function inequality (Talagrand.certifiable_concentration) has been posed on the platform as an open statement; it uses a Lipschitz hypothesis and no median, so it is a relative of Theorem 7.1.3, not the same statement. The mission produces a general-Ω\OmegaΩ formalization of the configuration-function principle, its application to the continuous Ulam problem, and the common-subsequence variant.

Difficulty

The deterministic inequalities (Lemma 7.1.1, Eq. (7.2.3)) relate the Euclidean distance fcf_cfc​, defined through a convex hull in RN\mathbb R^NRN, to purely combinatorial counts of disagreeing coordinates; this needs the infimum defining fcf_cfc​ to be attained and a duality between the convex hull and its extreme points. The probabilistic step rests on Talagrand's convex hull inequality (Theorem 4.1.1, Eq. (4.1.2)), ∫exp⁡(fc2(A,x)/4) dP(x)≤1/P(A)\int \exp(f_c^2(A,x)/4)\, dP(x) \le 1/P(A)∫exp(fc2​(A,x)/4)dP(x)≤1/P(A), for a general product probability; that inequality is not in Mathlib. A bounded-difference (Azuma or McDiarmid) argument does not suffice: changing one point changes LNL_NLN​ by at most 111, which gives deviations of order N\sqrt NN​, not M\sqrt MM​. The point of the configuration property is that only the LN(x)L_N(x)LN​(x) coordinates of a witness matter.

Formalization scope

  • Product space. ΩN\Omega^NΩN is Fin N → Ω (0-based), and PPP is Measure.pi (fun _ => μ). For the goal, Ω\OmegaΩ is unitInterval and μ\muμ is any probability measure on it with μ{t}=0\mu\{t\} = 0μ{t}=0 for all ttt. Theorem 7.2.1 uses the product of Measure.pi measures on (Fin N → ℝ) × (Fin N' → ℝ) for a probability μ\muμ on R\mathbb RR. Eq. (7.2.3) lives on Fin (N + N') → unitInterval, with the first NNN coordinates forming the first sequence.
  • Increasing means weakly increasing (≤\le≤), as printed. Index sequences are strictly increasing maps Fin p → Fin N. LNL_NLN​ and LN,N′L_{N,N'}LN,N′​ take values in ℕ.
  • Convex hull distance. fcf_cfc​ takes values in ℝ≥0∞, with the Euclidean norm written out as ∑isi2\sqrt{\sum_i s_i^2}∑i​si2​​. Mathlib's default norm on Fin N → ℝ is the sup norm and would give a different, much weaker statement. The deterministic inequalities are stated in the rearranged form L≤a+c fcLL \le a + c\, f_c \sqrt LL≤a+cfc​L​ in [0,+∞][0, +\infty][0,+∞].
  • Median: P(Z≤M)≥1/2P(Z \le M) \ge 1/2P(Z≤M)≥1/2 and P(Z≥M)≥1/2P(Z \ge M) \ge 1/2P(Z≥M)≥1/2; the statements hold for every median.
  • Measurability. The paper treats all functions as measurable. In Theorem 7.1.3 this convention is the explicit hypothesis that the configuration function is measurable. The concrete LNL_NLN​ and LN,N′L_{N,N'}LN,N′​ carry no hypothesis.
  • Degenerate corner. When M=0M = 0M=0, Lean's division gives u2/(4M)=0u^2/(4M) = 0u2/(4M)=0, so the lower-tail bound reads "≤2\le 2≤2". The event {L≤−u}\{L \le -u\}{L≤−u} is then empty, so no content is lost.
  • No trivialization. Using the sup norm in fcf_cfc​, using a real-valued infimum (which is 000 on an empty A(a)A(a)A(a)), or putting the conclusion of Theorem 4.1.1 among the hypotheses would each make a statement trivial or empty. None of these is done.

The mission uses the shared definition of the convex hull distance from Section 4.1. A general-Ω\OmegaΩ proof of Eq. (4.1.2) and of the attainment of fcf_cfc​ would be reusable for every Part II chapter of the paper. Contributions are welcome in particular for the deterministic Lemma 7.1.1 and Eq. (7.2.3), the measurability of LNL_NLN​ and LN,N′L_{N,N'}LN,N′​, and the reduction of Theorem 7.1.2 to Theorem 7.1.3.

Selected references

  • M. Talagrand, Concentration of measure and isoperimetric inequalities in product spaces, Publ. Math. IHÉS 81 (1995), 73–205. https://doi.org/10.1007/BF02699376
  • A. Frieze, On the length of the longest monotone subsequence in a random permutation, Ann. Appl. Probab. 1 (1991), 301–305. https://doi.org/10.1214/aoap/1177005939
  • B. Bollobás, G. Brightwell, The height of a random partial order: concentration of measure, Ann. Appl. Probab. 2 (1992), 1009–1018. https://projecteuclid.org/journals/annals-of-applied-probability/volume-2/issue-4
  • A. M. Vershik, S. V. Kerov, Asymptotics of the Plancherel measure of the symmetric group and the limiting form of Young tables, Soviet Math. Dokl. 18 (1977), 527–531.
  • J. Baik, P. Deift, K. Johansson, On the distribution of the length of the longest increasing subsequence of random permutations, J. Amer. Math. Soc. 12 (1999), 1119–1178. https://doi.org/10.1090/S0894-0347-99-00307-0
  • N. Alon, J. H. Spencer, The Probabilistic Method, 4th ed., Wiley, 2016. https://doi.org/10.1002/9781119062042
8 thms3 active usersReviewed
🏆Completed
Combinatorics·Captain: mikedeng1

Concentration of Measure and Isoperimetric Inequalities in Product Spaces II: The Two-Point Space — an N-Free Exponential Bound for the One-Sided Hamming Distance under a Second MeasureTextbook

Motivation

The concentration of measure phenomenon says that in a product probability space a set of probability not too small is "large" in the sense that most points lie within a small distance of it. M. Talagrand's 1995 memoir Concentration of measure and isoperimetric inequalities in product spaces develops this phenomenon through exponential moment bounds for distances to sets. Its Section 2.1 treats the Hamming distance on an arbitrary product space and recovers the bounds obtainable by martingale methods (McDiarmid, On the method of bounded differences, 1989).

Section 2.3, the subject of this mission, specialises to the two-point space {0,1}N\{0,1\}^N{0,1}N with biased coordinates. This is the setting of the binomial law, of random subsets of a finite set, and of monotone properties of random graphs. Two things happen there that do not happen in general. First, the bias ppp of the coordinates enters the bound through the variance p(1−p)p(1-p)p(1−p), which gives sharper tails when ppp is close to 000 or 111. Second, when one counts only the coordinates where xxx has a 111 and the point of AAA has a 000, and measures AAA under a second, more heavily biased product measure, the exponential moment bound becomes independent of the dimension NNN. The paper calls this the first of its results that "apparently cannot be obtained via martingales". Bounds of this one-sided kind are the natural tool for upper tails of increasing functions on the biased cube, the regime of the binomial law near Np1Np_1Np1​ when samples are drawn at rate p<p1p<p_1p<p1​.

Setting

Let Ω={0,1}\Omega=\{0,1\}Ω={0,1}. For p∈[0,1]p\in[0,1]p∈[0,1] let μ\muμ be the probability on Ω\OmegaΩ with μ({1})=p\mu(\{1\})=pμ({1})=p, μ({0})=1−p\mu(\{0\})=1-pμ({0})=1−p, and let P=μNP=\mu^NP=μN be the product probability on ΩN\Omega^NΩN, whose points are written x=(x1,…,xN)x=(x_1,\dots,x_N)x=(x1​,…,xN​). For a set A⊆ΩNA\subseteq\Omega^NA⊆ΩN and a point x∈ΩNx\in\Omega^Nx∈ΩN, the Hamming distance from xxx to AAA is

f(A,x)=min⁡{card⁡{i≤N: xi≠yi}: y∈A},f(A,x)=\min\big\{\operatorname{card}\{i\le N:\ x_i\neq y_i\}:\ y\in A\big\},f(A,x)=min{card{i≤N: xi​=yi​}: y∈A},

the least number of coordinates of xxx that must be changed to land in AAA. The one-sided distance counts only changes from 111 to 000:

f+(A,x)=min⁡{card⁡{i≤N: xi=1, yi=0}: y∈A}.f^{+}(A,x)=\min\big\{\operatorname{card}\{i\le N:\ x_i=1,\ y_i=0\}:\ y\in A\big\}.f+(A,x)=min{card{i≤N: xi​=1, yi​=0}: y∈A}.

Both are +∞+\infty+∞ when AAA is empty. A second probability μ1\mu_1μ1​ on Ω\OmegaΩ has p1=μ1({1})p_1=\mu_1(\{1\})p1​=μ1​({1}), and P1=μ1NP_1=\mu_1^NP1​=μ1N​. For α>0\alpha>0α>0 and t≥0t\ge 0t≥0 the paper uses two constants,

b(α,t,p)=((1−p)et+p)(p+(1−p)e−t/α)α(p≥12),b(α,t,p)=b(α,t,1−p)(p≤12),b(\alpha,t,p)=((1-p)e^{t}+p)(p+(1-p)e^{-t/\alpha})^{\alpha}\quad(p\ge \tfrac12),\qquad b(\alpha,t,p)=b(\alpha,t,1-p)\quad(p\le\tfrac12),b(α,t,p)=((1−p)et+p)(p+(1−p)e−t/α)α(p≥21​),b(α,t,p)=b(α,t,1−p)(p≤21​), a(α,t)=max⁡(1, (1−p+pet)(p1e−t/α+1−p1)α).a(\alpha,t)=\max\Big(1,\ (1-p+pe^{t})(p_1e^{-t/\alpha}+1-p_1)^{\alpha}\Big).a(α,t)=max(1, (1−p+pet)(p1​e−t/α+1−p1​)α).

In the Lean development these are hammingDistToSet, oneSidedDistToSet, bConst, aConst, the measure productMeasure N p, and the integrand expMul t z =etz=e^{tz}=etz.

Formalization targets

Goal: Theorem 2.3.4

If p1>pp_1>pp1​>p, then for every NNN, every A⊆ΩNA\subseteq\Omega^NA⊆ΩN, every α>0\alpha>0α>0 and every t≥0t\ge 0t≥0,

∫etf+(A,x) dP(x)≤a(α,t)NP1(A)α.\int e^{t f^{+}(A,x)}\,dP(x)\le\frac{a(\alpha,t)^N}{P_1(A)^{\alpha}}.∫etf+(A,x)dP(x)≤P1​(A)αa(α,t)N​.

For small ttt one has a(α,t)=1a(\alpha,t)=1a(α,t)=1. When 0<p<p1<10<p<p_1<10<p<p1​<1 and α=1\alpha=1α=1, the paper's explicit threshold is et≤p1(1−p)/(p(1−p1))e^{t}\le p_1(1-p)/(p(1-p_1))et≤p1​(1−p)/(p(1−p1​)). At equality, the bound becomes ∫(p1(1−p)/(p(1−p1)))f+(A,x)dP≤1/P1(A)\int (p_1(1-p)/(p(1-p_1)))^{f^{+}(A,x)}dP\le 1/P_1(A)∫(p1​(1−p)/(p(1−p1​)))f+(A,x)dP≤1/P1​(A), with no dependence on NNN. The main theorem also includes the endpoint cases p=0p=0p=0 and p1=1p_1=1p1​=1 without using this ratio.

Milestones

  1. Proposition 2.3.1. For t≥0t\ge0t≥0, α≥1\alpha\ge1α≥1: ∫etf(A,x) dP(x)≤b(α,t,p)NP(A)α\displaystyle\int e^{tf(A,x)}\,dP(x)\le \frac{b(\alpha,t,p)^N}{P(A)^\alpha}∫etf(A,x)dP(x)≤P(A)αb(α,t,p)N​.
  2. Corollary 2.3.2, Eq. (2.3.4). There is a universal KKK such that for α≥1\alpha\ge1α≥1, 0≤t≤10\le t\le10≤t≤1:
∫etf(A,x) dP(x)≤1P(A)αexp⁡N[p(1−p)(1+1α)t22+Kt3].\int e^{tf(A,x)}\,dP(x)\le\frac{1}{P(A)^\alpha}\exp N\Big[p(1-p)\Big(1+\frac1\alpha\Big)\frac{t^2}{2}+Kt^3\Big].∫etf(A,x)dP(x)≤P(A)α1​expN[p(1−p)(1+α1​)2t2​+Kt3].
  1. Corollary 2.3.2, Eq. (2.3.5). There is a universal KKK such that for (4p(1−p)Nlog⁡1P(A))1/2≤k≤p(1−p)N(4p(1-p)N\log\frac1{P(A)})^{1/2}\le k\le p(1-p)N(4p(1−p)NlogP(A)1​)1/2≤k≤p(1−p)N:
P({f(A,x)≥k})≤exp⁡(−12p(1−p)N(k−2p(1−p)Nlog⁡1P(A))2+Kk3(p(1−p))3N2).P(\{f(A,x)\ge k\})\le\exp\Big(-\frac{1}{2p(1-p)N}\Big(k-\sqrt{2p(1-p)N\log\tfrac{1}{P(A)}}\Big)^2+\frac{Kk^3}{(p(1-p))^3N^2}\Big).P({f(A,x)≥k})≤exp(−2p(1−p)N1​(k−2p(1−p)NlogP(A)1​​)2+(p(1−p))3N2Kk3​).
  1. Lemma 2.3.5. If a≤b≤1a\le b\le 1a≤b≤1, then
1−pbα+pmin⁡(1aα,etbα)≤a(α,t)(ap1+b(1−p1))α.\frac{1-p}{b^{\alpha}}+p\min\Big(\frac{1}{a^{\alpha}},\frac{e^{t}}{b^{\alpha}}\Big)\le\frac{a(\alpha,t)}{(ap_1+b(1-p_1))^{\alpha}}.bα1−p​+pmin(aα1​,bαet​)≤(ap1​+b(1−p1​))αa(α,t)​.

Milestones 1–3 concern the two-sided Hamming distance; milestone 4 is the one-coordinate inequality behind the goal.

Significance

The results. Proposition 2.3.1 and Corollary 2.3.2 give, for every set AAA in the biased cube, a tail bound for the Hamming distance whose Gaussian part has the variance p(1−p)Np(1-p)Np(1−p)N of the binomial law, not the worst case N/4N/4N/4. The paper notes that this matches the quality of the optimal isoperimetric inequalities that are known only for hereditary (monotone) sets. Theorem 2.3.4 is a statement with no dimension in it: it controls how many 111s of a μN\mu^NμN-sample must be switched off to reach a set AAA that is not small under the more biased μ1N\mu_1^Nμ1N​.

Formalizing it. These results are proved in the paper; the local Prove2Me index contains no machine-checked proof of these statements. Mathlib has the Bernoulli measure, finite products of measures and lower Lebesgue integrals, but no exponential moment bound for these distances to sets. A complete development would add reusable facts about biased Boolean products, their distance functions and exponential moments, and the uniform cubic error term in Corollary 2.3.2.

Difficulty

The obvious route to a Hamming-distance tail bound is a martingale (bounded differences) argument. It yields e−2k2/Ne^{-2k^2/N}e−2k2/N-type bounds that do not see the bias ppp, and its variance proxy grows with NNN, so it gives no bound independent of NNN; the paper states that Theorem 2.3.4 apparently cannot be obtained this way. Theorem 2.3.4 measures AAA under P1P_1P1​ while the integral is under PPP, so a one-coordinate estimate must account for two different probabilities and keep the factor a(α,t)a(\alpha,t)a(α,t) exactly equal to 111 for small ttt. Lemma 2.3.5 must handle a=0a=0a=0 as well as interior values. Corollary 2.3.2 requires a cubic error bound uniform in p∈[0,1]p\in[0,1]p∈[0,1] and α≥1\alpha\ge1α≥1.

Formalization scope

  • Ω\OmegaΩ is Bool with 111 = true; PPP reuses the published TalagrandCore.bernPi Bernoulli product measure with p : unitInterval converted to a nonnegative real, over Fin N (0-based coordinates). Every subset of {0,1}N\{0,1\}^N{0,1}N is measurable, so the paper's convention of ignoring measurability costs nothing here.
  • Distances take values in ℝ≥0∞, with f(∅,x)=+∞f(\emptyset,x)=+\inftyf(∅,x)=+∞; integrals are lower Lebesgue integrals ∫⁻ in [0,∞][0,\infty][0,∞]; P(A)−αP(A)^{-\alpha}P(A)−α is computed in [0,∞][0,\infty][0,∞], so P(A)=0P(A)=0P(A)=0 gives +∞+\infty+∞.
  • Theorem 2.3.4 and Lemma 2.3.5 are stated for α>0\alpha>0α>0, the range under which Section 2.2 introduces the exponent α\alphaα (the theorem's page does not restate it). Proposition 2.3.1 and Corollary 2.3.2 keep the page's α≥1\alpha\ge 1α≥1. The standing hypothesis p1>pp_1>pp1​>p appears as a binder.
  • The universal constants of Corollary 2.3.2 are quantified before ppp, NNN, AAA, α\alphaα, ttt, kkk. In Eq. (2.3.5), 0<p<10<p<10<p<1, N≥1N\ge1N≥1 and P(A)>0P(A)>0P(A)>0 are assumed, which is where the displayed formula is defined.
  • A trivializing formalization is ruled out: the integrals are not Bochner integrals (which vanish on non-integrable functions), the empty set and P1(A)=0P_1(A)=0P1​(A)=0 are handled through +∞+\infty+∞, not junk zeros, and the two different distances of the section carry different names.

The mission also imports the published TalagrandCore.bernPi definition for the Boolean product law. Reusable pieces include evaluation of ∫\int∫ over {0,1}\{0,1\}{0,1} under a Bernoulli measure and facts about product measures over Fin N. Contributions to any of the four milestones or the goal are welcome.

Selected references

  • M. Talagrand, Concentration of measure and isoperimetric inequalities in product spaces, Publ. Math. IHÉS 81 (1995), 73–205. https://doi.org/10.1007/bf02699376
  • C. McDiarmid, On the method of bounded differences, Surveys in Combinatorics, LMS Lecture Note Series 141 (1989), 148–188. https://doi.org/10.1017/CBO9781107359949.008
  • M. Ledoux, The Concentration of Measure Phenomenon, AMS Mathematical Surveys and Monographs 89 (2001). https://doi.org/10.1090/surv/089
8 thms3 active usersReviewed
🏆Completed
CombinatoricsNumber TheoryTheoretical Computer Science·Captain: mikedeng1

A New Class of Random Number Generators 2: For Prime m = bʳ − bˢ + 1, Every Nontrivial Subtract-with-Borrow Sequence Is Periodic After r Steps, with Period the Order of b mod mResearch Paper

Motivation

A pseudorandom number generator replaces repeated random sampling with a deterministic update of a small state. Its useful lifetime depends on the length and structure of the resulting orbit. In Marsaglia and Zaman’s 1991 paper, the subtract-with-borrow generators use only digit subtraction and a one-bit borrow while attaining cycles that can be almost as long as the whole set of digit tuples. The mathematical question is exact: which fraction encodes an output sequence, when does an arbitrary seed enter a cycle, and how long is that cycle?

This mission concerns the paper’s first subtract-with-borrow rule, called Method 1 in §4.5. The paper also studies a second rule that reverses the order of the two subtracted digits. Its modulus and period analysis differ. The distinction matters because the same state format supports both rules while their arithmetic claims are different.

Setting

Choose an integer base b≥2b\ge2b≥2 and lags 0<s<r0<s<r0<s<r. A state is a row of rrr digits and one borrow bit, (x1,…,xr,c)(x_1,\ldots,x_r,c)(x1​,…,xr​,c), where each xix_ixi​ is in {0,…,b−1}\{0,\ldots,b-1\}{0,…,b−1} and c∈{0,1}c\in\{0,1\}c∈{0,1}. The leftmost digit x1x_1x1​ is the oldest. One update discards it, shifts the remaining digits left, and appends a new digit. Put t=xr+1−s−x1−ct=x_{r+1-s}-x_1-ct=xr+1−s​−x1​−c. If t≥0t\ge0t≥0, the appended digit is ttt and the new borrow is zero. If t<0t<0t<0, the appended digit is t+bt+bt+b and the new borrow is one. Write this deterministic map as fff.

The digits emitted after the seed obey xn=xn−s−xn−r−cx_n=x_{n-s}-x_{n-r}-cxn​=xn−s​−xn−r​−c modulo bbb, with ccc updated at each step. The associated modulus is m=br−bs+1m=b^r-b^s+1m=br−bs+1. For 0≤k<m0\le k<m0≤k<m, write dj(k/m)d_j(k/m)dj​(k/m) for the jjjth digit after the point in the base-bbb expansion of k/mk/mk/m, with j≥1j\ge1j≥1. The digit stream is read in reverse order when it is matched to an expansion: the latest generated digit in a finite block is the first fractional digit. A state is strictly periodic when it is already on a cycle under fff; otherwise it may pass through a transient before reaching one.

Two states have period one: (0,…,0,0)(0,\ldots,0,0)(0,…,0,0) and (b−1,…,b−1,1)(b-1,\ldots,b-1,1)(b−1,…,b−1,1). These are the trivial seeds. They are exceptions to the order-of-base period formula. A third useful object is the multiplicative order ord⁡m(b)\operatorname{ord}_m(b)ordm​(b), the least positive ppp for which bp≡1(modm)b^p\equiv1\pmod mbp≡1(modm). Since m≡1(modb)m\equiv1\pmod bm≡1(modb), the base is coprime to this modulus.

Formalization targets

Exact cycle period

For prime m=br−bs+1m=b^r-b^s+1m=br−bs+1 and any nontrivial seed zzz, the goal identifies the minimal state period after the transient:

period⁡f(fr(z))=ord⁡m(b).\operatorname{period}_f\bigl(f^r(z)\bigr)=\operatorname{ord}_m(b).periodf​(fr(z))=ordm​(b).

The assertion includes both that fr(z)f^r(z)fr(z) is on a cycle and that its period is exactly the order. It makes no primitive-root assumption. If bbb is a primitive root modulo mmm, the right side specializes to m−1=br−bsm-1=b^r-b^sm−1=br−bs, the full period discussed in §3 of the paper.

Supporting results

The milestones state that the fractional digits of k/mk/mk/m have least period ord⁡m(b)\operatorname{ord}_m(b)ordm​(b) when kkk and bbb are coprime to mmm; that a primitive root yields digit period m−1m-1m−1; that the two trivial seeds are precisely the fixed points; and that every seed reaches a cycle after at most rrr updates. They also formalize the reverse-digit relation for every finite generated block and the paper’s Method 1 inequalities that classify nontrivial seeds already on a cycle. These targets use the paper’s own claims in §§4.1, 4.3, and 4.5 rather than an arbitrary decomposition of the goal.

Significance

The result converts the orbit-length problem of a digit-and-borrow machine into a multiplicative-order calculation in a finite residue ring. A prime modulus and a primitive base produce a nontrivial cycle of length m−1m-1m−1; a nonprimitive base still has the exact order-of-base period. The seed classification separates states already on that cycle from states with an initial transient. These statements are what allow a proposed numerical parameter set to be assessed mathematically before the generator is used.

Marsaglia and Zaman proved these results in the cited paper. This mission asks for machine-checked Lean proofs of the statements, starting from an explicit finite-state update. The reusable output includes exact base-bbb digit arithmetic, links between digit periods and multiplicative order, and methods for reasoning about the eventual cycles of finite-state digit generators. The present proposal consists of compiled statements and definitions; the theorem bodies are open proof targets.

Difficulty

Finiteness alone shows that every state eventually repeats, but it gives neither the bound of rrr steps nor the exact cycle length. Likewise, observing that a generated digit block matches a prefix of some fraction does not by itself identify one period for the whole state orbit. The proof must keep track of the borrow bit and the direction in which the digit block is read. It must also show that a nontrivial seed does not collapse to one of the two fixed states. The source’s integer tableaux explain the arithmetic link, but turning their finite strings into a statement uniform over every seed and every block length is the main formalization challenge.

Formalization scope

Lean represents digits by Fin b, the borrow by Fin 2, and the row by a function on Fin r. Lean index zero is x1x_1x1​, so the digit used in the update, xr+1−sx_{r+1-s}xr+1−s​, has index r−sr-sr−s. The update branches on an ordinary integer comparison before any natural-number subtraction can truncate a negative value. The modulus is a natural number, and 0<s<r0<s<r0<s<r with b≥2b\ge2b≥2 makes br−bsb^r-b^sbr−bs an exact subtraction. The jjjth fractional digit is computed by an exact quotient and remainder; only j≥1j\ge1j≥1 has the mathematical meaning used in the theorems. The generated stream is one-based, and the first digit beyond the seed is xr+1x_{r+1}xr+1​.

The paper’s “after a few iterations” is pinned to its stated upper bound “at most rrr.” Its “period” is the minimal positive state period of fr(z)f^r(z)fr(z), not a mere period divisor or the period of an arbitrarily selected digit window. “Appropriately chosen” parameters mean a prime mmm for the goal and exclusion of the two named fixed seeds. The reverse-digit milestone permits the numerator kkk to depend on the finite endpoint, as the tableau argument does. No seed is excluded from the at-most-rrr milestone.

The discussion on pp. 473–474 prints the Method 1 seed inequalities in the opposite direction from the Method 1 listing on p. 472. The Lean seed-classification milestone uses the p. 472 directions, which agree with the step map on p. 466 and with direct finite checks. The §5 claim that every five-tuple except the 100100100 patterns xyxyxxyxyxxyxyx appears once in the special b=10,r=5,s=2b=10,r=5,s=2b=10,r=5,s=2 full cycle is left for a later extension. The other subtraction order, its modulus br−bs−1b^r-b^s-1br−bs−1, and the paper’s large parameter certificates are outside this mission.

An encoding that merely asserts the existence of some period, allows an impossible seed hypothesis, or replaces the update by a different subtraction order would make the goal vacuous or change the result. The intended development needs Mathlib’s ZMod, multiplicative order, finite iterations, periodic points, and natural-number quotient and remainder. Contributions proving the numbered milestones, strengthening their arithmetic interfaces, or closing the goal are in scope.

Selected references

  • G. Marsaglia and A. Zaman, A new class of random number generators, The Annals of Applied Probability 1(3), 462–480 (1991). DOI: 10.1214/aoap/1177005878.
17 thms3 active usersReviewed
Machine LearningOperations ResearchOptimization·Captain: mikedeng1

A Nonparametric Asymptotic Analysis of Inventory Planning with Censored Demand 1: AIM's Average Expected Cost Is Within O(1/√T) of the Newsvendor Cost, Perishable and Non-PerishableResearch Paper

Motivation

A retailer who restocks a product every period must choose an order-up-to level without knowing the demand distribution, and in most retail settings it observes only sales, the minimum of demand and stock. Demand above the stock is lost and never recorded. This is censored demand: the data needed to estimate the distribution are truncated exactly at the decision. Classical inventory theory assumes the distribution is known, and then the optimal policy in the stationary case is to order up to the newsvendor quantity in every period.

Huh and Rusmevichientong (Math. Oper. Res. 34(1), 2009) give a nonparametric policy that learns from censored sales alone, the Adaptive Inventory Management (AIM) algorithm, and prove that its average expected cost approaches the newsvendor cost at rate 1/T1/\sqrt T1/T​. The perishable case reduces to online convex optimization in the sense of Zinkevich (2003) and Flaxman, Kalai and McMahan (2005). The non-perishable case is new: leftover stock constrains the next decision, and the paper controls this constraint through a single-server queue.

Setting

Demands D1,D2,⋯≥0D_1, D_2, \dots \ge 0D1​,D2​,⋯≥0 are independent and identically distributed with an unknown law of finite mean; DDD denotes a generic demand and FFF its distribution function. A holding cost h>0h > 0h>0 is paid per unit left over and a penalty b>0b > 0b>0 per unit of lost demand. The newsvendor cost of a level y≥0y \ge 0y≥0 is

Q(y)=h E[y−D]++b E[D−y]+,Q(y) = h\,E[y-D]^+ + b\,E[D-y]^+ ,Q(y)=hE[y−D]++bE[D−y]+,

and the newsvendor quantity is yNV=inf⁡{y≥0∣F(y)≥b/(b+h)}y^{NV} = \inf\{y \ge 0 \mid F(y) \ge b/(b+h)\}yNV=inf{y≥0∣F(y)≥b/(b+h)}.

In period ttt the manager holds xt≥0x_t \ge 0xt​≥0 units (x1=0x_1 = 0x1​=0), raises the stock to yt≥xty_t \ge x_tyt​≥xt​, and observes min⁡{Dt,yt}\min\{D_t, y_t\}min{Dt​,yt​}. Excess inventory is either perishable (xt+1=0x_{t+1} = 0xt+1​=0) or non-perishable (xt+1=[yt−Dt]+x_{t+1} = [y_t - D_t]^+xt+1​=[yt​−Dt​]+).

Assumption 1 gives the manager a bound yˉ≥yNV\bar y \ge y^{NV}yˉ​≥yNV, and in the non-perishable case a bound ρ\rhoρ with 0<ρ<E[D1]0 < \rho < E[D_1]0<ρ<E[D1​]. AIM keeps a target y^t\hat y_ty^​t​ and an implemented level yty_tyt​: y1=y^1∈[0,yˉ]y_1 = \hat y_1 \in [0, \bar y]y1​=y^​1​∈[0,yˉ​], and for t≥1t \ge 1t≥1

y^t+1=P[0,yˉ](y^t−ϵtHt(y^t)),yt+1=max⁡{y^t+1,xt+1},\hat y_{t+1} = P_{[0,\bar y]}\big(\hat y_t - \epsilon_t H_t(\hat y_t)\big), \qquad y_{t+1} = \max\{\hat y_{t+1}, x_{t+1}\},y^​t+1​=P[0,yˉ​]​(y^​t​−ϵt​Ht​(y^​t​)),yt+1​=max{y^​t+1​,xt+1​},

with the projection P[0,yˉ](z)=max⁡{min⁡{z,yˉ},0}P_{[0,\bar y]}(z) = \max\{\min\{z,\bar y\},0\}P[0,yˉ​]​(z)=max{min{z,yˉ​},0}, steps ϵt=γyˉ/(max⁡{b,h}t)\epsilon_t = \gamma\bar y/(\max\{b,h\}\sqrt t)ϵt​=γyˉ​/(max{b,h}t​) for a scale γ>0\gamma > 0γ>0, and the censored gradient estimate Ht(y^t)=hH_t(\hat y_t) = hHt​(y^​t​)=h if Dt<y^tD_t < \hat y_tDt​<y^​t​ and −b-b−b if Dt≥y^tD_t \ge \hat y_tDt​≥y^​t​. The manager can compute HtH_tHt​ from the observed sales.

For θ>0\theta > 0θ>0 the waiting times W1(θ)=0W_1(\theta) = 0W1​(θ)=0, Wt+1(θ)=[Wt(θ)+θ−Dt]+W_{t+1}(\theta) = [W_t(\theta) + \theta - D_t]^+Wt+1​(θ)=[Wt​(θ)+θ−Dt​]+ describe a GI/D/1 queue with inter-arrival times DtD_tDt​ and service time θ\thetaθ. Its busy periods Ji(θ)J_i(\theta)Ji​(θ) are the stretches between successive returns to 000. The auxiliary queue Z1(θ)=0Z_1(\theta) = 0Z1​(θ)=0, Zt+1(θ)=[Zt(θ)+θ/t−Dt]+Z_{t+1}(\theta) = [Z_t(\theta) + \theta/\sqrt t - D_t]^+Zt+1​(θ)=[Zt​(θ)+θ/t​−Dt​]+ has shrinking service times.

Formalization targets

Goal: Theorem 2

For every T≥1T \ge 1T≥1, in the perishable case

E[1T∑t=1TQ(yt)]−Q(yNV)≤(γ+1γ)yˉmax⁡{b,h}T,E\Big[\frac1T\sum_{t=1}^T Q(y_t)\Big] - Q(y^{NV}) \le \Big(\gamma + \frac1\gamma\Big)\frac{\bar y\max\{b,h\}}{\sqrt T},E[T1​t=1∑T​Q(yt​)]−Q(yNV)≤(γ+γ1​)T​yˉ​max{b,h}​,

and in the non-perishable case, if E[D16]<∞E[D_1^6] < \inftyE[D16​]<∞ and γ≤ρmax⁡{b,h}/(hyˉ)\gamma \le \rho\max\{b,h\}/(h\bar y)γ≤ρmax{b,h}/(hyˉ​), there is a constant CCC, independent of TTT, with

E[1T∑t=1TQ(yt)]−Q(yNV)≤CT.E\Big[\frac1T\sum_{t=1}^T Q(y_t)\Big] - Q(y^{NV}) \le \frac{C}{\sqrt T}.E[T1​t=1∑T​Q(yt​)]−Q(yNV)≤T​C​.

The non-perishable bullet asserts only the existence of CCC, because the paper's explicit formula (9) depends on Proposition 4 (i), which is false as printed.

Milestones

  • §2.4: QQQ is convex with left derivative hP{D<y}−bP{D≥y}h P\{D<y\} - bP\{D\ge y\}hP{D<y}−bP{D≥y}, and E[Ht∣y^t]E[H_t \mid \hat y_t]E[Ht​∣y^​t​] equals it.
  • Lemma 3: projected stochastic subgradient descent with steps γdiam⁡(S)/(Bˉt)\gamma\operatorname{diam}(S)/(\bar B\sqrt t)γdiam(S)/(Bˉt​) has average error at most (γ+1/γ)diam⁡(S)Bˉ/T(\gamma + 1/\gamma)\operatorname{diam}(S)\bar B/\sqrt T(γ+1/γ)diam(S)Bˉ/T​.
  • §2.4: Q(y)−Q(y^)≤h(y−y^)Q(y) - Q(\hat y) \le h(y - \hat y)Q(y)−Q(y^​)≤h(y−y^​) for 0≤y^≤y0 \le \hat y \le y0≤y^​≤y.
  • Theorem 6: if γ≤ρmax⁡{b,h}/(hyˉ)\gamma \le \rho\max\{b,h\}/(h\bar y)γ≤ρmax{b,h}/(hyˉ​), then yt−y^t≤Zt(ρ)y_t - \hat y_t \le Z_t(\rho)yt​−y^​t​≤Zt​(ρ).
  • Lemma 13: E∣Ji(θ,t)(θ)∣≤E[∣J1(θ)∣2]E|J_{i(\theta,t)}(\theta)| \le E[|J_1(\theta)|^2]E∣Ji(θ,t)​(θ)∣≤E[∣J1​(θ)∣2].
  • Lemma 5: E[∑t=1TZt(θ)]≤2θE[∣J1(θ)∣2]TE[\sum_{t=1}^T Z_t(\theta)] \le 2\theta E[|J_1(\theta)|^2]\sqrt TE[∑t=1T​Zt​(θ)]≤2θE[∣J1​(θ)∣2]T​.
  • Lemma 12: E[(∑i≤nXi)6]≤21n3EX16E[(\sum_{i\le n} X_i)^6] \le 21 n^3 E X_1^6E[(∑i≤n​Xi​)6]≤21n3EX16​ for i.i.d. mean-zero XiX_iXi​ (and the fourth-moment analogue).
  • Proposition 4 (i), corrected: E[∣J1(θ)∣2]≤1+21π22E[(D1−ED1)6]/(ED1−θ)6E[|J_1(\theta)|^2] \le 1 + \tfrac{21\pi^2}{2}E[(D_1 - ED_1)^6]/(ED_1 - \theta)^6E[∣J1​(θ)∣2]≤1+221π2​E[(D1​−ED1​)6]/(ED1​−θ)6 for 0<θ<E[D1]0 < \theta < E[D_1]0<θ<E[D1​].

Significance

Theorem 2 shows that a manager who never observes lost sales can still reach the cost of a manager who knows the distribution, at a dimension-free rate, under only a sixth-moment condition in the non-perishable case. The example of §2.5 of the paper shows that the rate 1/T1/\sqrt T1/T​ cannot be improved in general for AIM. Theorem 6, the coupling of the excess inventory yt−y^ty_t - \hat y_tyt​−y^​t​ with a queue, is the step that handles decisions constrained by past decisions, and the same paper reuses it when ρ\rhoρ is unknown (§3.2).

The results are proved in the paper, and none of them is formalized as far as is known. This mission formalizes them and also corrects them: Proposition 4 (i) fails for deterministic demand, its explicit constant has to be replaced, and Eq. (2) labels a right derivative as a left one. Lemma 3 for decreasing steps and Lemma 12 are standard tools that are not in Mathlib.

Difficulty

The perishable case is a stochastic subgradient method, but its estimates are conditionally unbiased only given the current iterate, and QQQ is merely convex, not differentiable, so the textbook smooth argument does not apply directly. In the non-perishable case the implemented levels yty_tyt​ are not the gradient iterates, and yt−y^ty_t - \hat y_tyt​−y^​t​ is not small along a path: carried-over stock can keep yty_tyt​ above the target for many periods. A bound on E[yt−y^t]E[y_t - \hat y_t]E[yt​−y^​t​] for each ttt does not follow from a bound on one period. The queue Zt(ρ)Z_t(\rho)Zt​(ρ) dominates the whole excess process, but it is non-stationary. Its sum has to be compared with the stationary queue Wt(ρ)W_t(\rho)Wt​(ρ), whose busy period covering a fixed time is length-biased, so second moments of busy periods enter.

Formalization scope

All declarations are in the namespace AIMInventory.Known. The demand law and the i.i.d. path measure are the published CappedBaseStock.DemandLaw and demandPathLaw, whose law has finite and strictly positive mean. QQQ and yNVy^{NV}yNV are the published backorderCost and newsvendorLevel of LostSalesOrderUpTo.Asymptotic.Backorder. The optimality of yNVy^{NV}yNV is the already posed LostSalesOrderUpTo.Asymptotic.newsvendor_optimal and is included as a reference.

Conventions:

  • The demand path is zero-based (DtD_tDt​ is d (t - 1)), and all paper indices t≥1t \ge 1t≥1 are kept.
  • The AIM run, WWW, ZZZ, the renewal epochs and the busy periods are functions of the demand path, defined by recursion exactly as printed.
  • The queue indexing is W1=Z1=0W_1 = Z_1 = 0W1​=Z1​=0 and τ0=1\tau_0 = 1τ0​=1 (the paper's W0W_0W0​, Z0Z_0Z0​ need an undefined D0D_0D0​ and θ/0\theta/\sqrt 0θ/0​). Period 111 lies in no busy period, so Lemma 13 is stated for t≥2t \ge 2t≥2.
  • Busy-period lengths are ℕ∞-valued. Every expectation that can be infinite is a lower Lebesgue integral in [0,∞][0,\infty][0,∞]. The expectations in Theorem 2 have bounded integrands.
  • Readings of loose phrases:
    • "for some γ>0\gamma > 0γ>0" means for every γ>0\gamma > 0γ>0;
    • "any value in [0,yˉ][0,\bar y][0,yˉ​]" means for every y^1∈[0,yˉ]\hat y_1 \in [0, \bar y]y^​1​∈[0,yˉ​];
    • "with probability one" in Theorem 6 means for every demand path;
    • "There is a constant CCC" means ∃C, ∀T≥1\exists C,\ \forall T \ge 1∃C, ∀T≥1.
  • The implicit positivity of hhh, bbb, yˉ\bar yyˉ​ (they appear in denominators) is added as hypotheses.
  • Lemma 3 is stated on Rn\mathbb R^nRn for every comparator u∈Su \in Su∈S, with E[H(z)∣z]E[H(z)\mid z]E[H(z)∣z] read as conditioning on the σ-algebra of the current iterate.
  • Proposition 4 (ii) and the explicit constant (9) are not stated.

The mission does not accept a formalization that sums over arbitrary sequences with yt≥y^ty_t \ge \hat y_tyt​≥y^​t​ instead of the AIM run, uses an uncensored gradient, or lets a non-integrable expectation default to 000.

Contributions toward a stochastic subgradient method with anytime steps, moment bounds for i.i.d. sums, and busy periods of Lindley's recursion are reusable beyond this mission.

Selected references

  • W. T. Huh, P. Rusmevichientong, A Nonparametric Asymptotic Analysis of Inventory Planning with Censored Demand, Mathematics of Operations Research 34(1), 2009. https://doi.org/10.1287/moor.1080.0355
  • M. Zinkevich, Online Convex Programming and Generalized Infinitesimal Gradient Ascent, ICML 2003. https://dl.acm.org/doi/10.5555/3041838.3041955
  • A. Flaxman, A. T. Kalai, H. B. McMahan, Online Convex Optimization in the Bandit Setting: Gradient Descent without a Gradient, SODA 2005. https://arxiv.org/abs/cs/0408007
  • E. Hazan, A. Agarwal, S. Kale, Logarithmic Regret Algorithms for Online Convex Optimization, Machine Learning 69, 2007. https://doi.org/10.1007/s10994-007-5016-8
15 thms3 active usersReviewed
Machine LearningOperations ResearchOptimization·Captain: mikedeng1

A Nonparametric Asymptotic Analysis of Inventory Planning with Censored Demand 3: For Any Step Scale γ, Non-Perishable AIM's Excess Cost Λ₂(T) Is Bounded by a Hitting Time and a Busy PeriodResearch Paper

Motivation

A retailer who stocks a perishable or storable product each period must choose an order-up-to level without knowing the demand distribution. Worse, demand is censored: when the shelf empties, the retailer observes sales, not demand. Huh and Rusmevichientong (Math. Oper. Res. 34(1), 2009) proposed the Adaptive Inventory Management (AIM) algorithm, a projected stochastic subgradient method that uses only the censored observation "was there stock left at the end of the period?". They proved that its average expected cost converges to the cost of the optimal newsvendor level at rate O(1/T)O(1/\sqrt T)O(1/T​), with no parametric assumption on demand.

In the non-perishable case, where leftover stock carries over, the main convergence theorem (Theorem 2, p. 7) requires the step-size scale γ\gammaγ to satisfy γ≤ρmax⁡{b,h}/(hyˉ)\gamma\le\rho\max\{b,h\}/(h\bar y)γ≤ρmax{b,h}/(hyˉ​), where ρ\rhoρ is a known lower bound on mean demand. Section 3.2 of the paper removes this requirement. Its Theorem 8 bounds the excess cost of AIM for every step scale γ>0\gamma>0γ>0, at the price of a hitting time and a busy period in the bound. This mission formalizes Theorem 8 and the steps of its proof.

Setting

Demands D1,D2,…D_1,D_2,\dotsD1​,D2​,… are independent, nonnegative, identically distributed, with finite positive mean E[D1]E[D_1]E[D1​] and otherwise unknown law. The holding cost is h>0h>0h>0 per unit left over and the penalty is b>0b>0b>0 per unit of unmet demand. The newsvendor cost of stocking up to y≥0y\ge0y≥0 is

Q(y)=h E[y−D1]++b E[D1−y]+,Q(y)=h\,E[y-D_1]^+ + b\,E[D_1-y]^+ ,Q(y)=hE[y−D1​]++bE[D1​−y]+,

and the newsvendor quantity is yNV=inf⁡{y≥0:P(D1≤y)≥b/(b+h)}y^{NV}=\inf\{y\ge0: P(D_1\le y)\ge b/(b+h)\}yNV=inf{y≥0:P(D1​≤y)≥b/(b+h)}. The manager knows an upper bound yˉ≥yNV\bar y\ge y^{NV}yˉ​≥yNV.

AIM, non-perishable case. Fix γ>0\gamma>0γ>0 and a starting target y^1∈[0,yˉ]\hat y_1\in[0,\bar y]y^​1​∈[0,yˉ​]. Put y1=y^1y_1=\hat y_1y1​=y^​1​, x1=0x_1=0x1​=0. In period t≥1t\ge1t≥1 the step is ϵt=γyˉ/(max⁡{b,h}t)\epsilon_t=\gamma\bar y/(\max\{b,h\}\sqrt t)ϵt​=γyˉ​/(max{b,h}t​), the observed slope is Ht=hH_t=hHt​=h if Dt<y^tD_t<\hat y_tDt​<y^​t​ and Ht=−bH_t=-bHt​=−b otherwise, and

y^t+1=max⁡{min⁡{y^t−ϵtHt,yˉ},0},xt+1=[yt−Dt]+,yt+1=max⁡{y^t+1,xt+1}.\hat y_{t+1}=\max\{\min\{\hat y_t-\epsilon_tH_t,\bar y\},0\},\qquad x_{t+1}=[y_t-D_t]^+,\qquad y_{t+1}=\max\{\hat y_{t+1},x_{t+1}\}.y^​t+1​=max{min{y^​t​−ϵt​Ht​,yˉ​},0},xt+1​=[yt​−Dt​]+,yt+1​=max{y^​t+1​,xt+1​}.

The target y^t\hat y_ty^​t​ follows the gradient step. The implemented level yty_tyt​ can exceed it because stock that has already been bought cannot be returned. The excess-cost term is

Λ2(T)=E[1T∑t=1T(Q(yt)−Q(y^t))].\Lambda_2(T)=E\Big[\frac1T\sum_{t=1}^T\big(Q(y_t)-Q(\hat y_t)\big)\Big].Λ2​(T)=E[T1​t=1∑T​(Q(yt​)−Q(y^​t​))].

Auxiliary processes. Let m=hγyˉ/max⁡{b,h}m=h\gamma\bar y/\max\{b,h\}m=hγyˉ​/max{b,h}. For a real θ\thetaθ:

  • W1(θ)=0W_1(\theta)=0W1​(θ)=0, Wt+1(θ)=[Wt(θ)+θ−Dt]+W_{t+1}(\theta)=[W_t(\theta)+\theta-D_t]^+Wt+1​(θ)=[Wt​(θ)+θ−Dt​]+ is a queue with constant inflow. Its first busy period has length ∣J1(θ)∣=inf⁡{t>1:Wt(θ)=0}−1|J_1(\theta)|=\inf\{t>1:W_t(\theta)=0\}-1∣J1​(θ)∣=inf{t>1:Wt​(θ)=0}−1.
  • Z1(θ)=0Z_1(\theta)=0Z1​(θ)=0, Zt+1(θ)=[Zt(θ)+θ/t−Dt]+Z_{t+1}(\theta)=[Z_t(\theta)+\theta/\sqrt t-D_t]^+Zt+1​(θ)=[Zt​(θ)+θ/t​−Dt​]+ is a queue with decreasing inflow.
  • K(θ,z)=min⁡{t≥0:z+∑s=1t(θ−Ds)≤0}K(\theta,z)=\min\{t\ge0: z+\sum_{s=1}^t(\theta-D_s)\le0\}K(θ,z)=min{t≥0:z+∑s=1t​(θ−Ds​)≤0} is the hitting time of (−∞,0](-\infty,0](−∞,0] by the random walk started at zzz.

For 0<ρ′<m0<\rho'<m0<ρ′<m, the proof uses T~=⌈(m/ρ′)2⌉\tilde T=\lceil(m/\rho')^2\rceilT~=⌈(m/ρ′)2⌉ and K~=min⁡{t>T~:Zt(m)=0}\tilde K=\min\{t>\tilde T:Z_t(m)=0\}K~=min{t>T~:Zt​(m)=0}.

Formalization targets

Goal: Theorem 8 (p. 13)

For every T≥1T\ge1T≥1 and every ρ′\rho'ρ′ with 0<ρ′<min⁡{m,E[D1]}0<\rho'<\min\{m,E[D_1]\}0<ρ′<min{m,E[D1​]},

Λ2(T)≤max⁡{b,h} yˉT{⌈(m/ρ′)2⌉+E[K(ρ′,22 m2ρ′)]}+2hm E[∣J1(ρ′)∣2]T.\Lambda_2(T)\le\frac{\max\{b,h\}\,\bar y}{T}\Big\{\big\lceil(m/\rho')^2\big\rceil+E\Big[K\Big(\rho',\frac{2\sqrt2\,m^2}{\rho'}\Big)\Big]\Big\}+\frac{2hm\,E\big[|J_1(\rho')|^2\big]}{\sqrt T}.Λ2​(T)≤Tmax{b,h}yˉ​​{⌈(m/ρ′)2⌉+E[K(ρ′,ρ′22​m2​)]}+T​2hmE[∣J1​(ρ′)∣2]​.

The statement makes no moment assumption on demand. It is stated with the paper's explicit constants, and both expectations on the right may be infinite.

Milestones

  1. Coupling (proof of Theorem 8, p. 13). For every demand path and every t≥1t\ge1t≥1, yt−y^t≤Zt(m)y_t-\hat y_t\le Z_t(m)yt​−y^​t​≤Zt​(m).
  2. Restart bound (p. 14). For 0<ρ′<m0<\rho'<m0<ρ′<m, E[K~]≤⌈(m/ρ′)2⌉+E[K(ρ′,22m2/ρ′)]E[\tilde K]\le\lceil(m/\rho')^2\rceil+E[K(\rho',2\sqrt2m^2/\rho')]E[K~]≤⌈(m/ρ′)2⌉+E[K(ρ′,22​m2/ρ′)].
  3. Claim (14) (p. 14, proved in Appendix E). For 0<ρ′<min⁡{m,E[D1]}0<\rho'<\min\{m,E[D_1]\}0<ρ′<min{m,E[D1​]}, hTE[∑t=K~+1TZt(m)]≤2hm E[∣J1(ρ′)∣2]/T\frac hT E\big[\sum_{t=\tilde K+1}^T Z_t(m)\big]\le 2hm\,E[|J_1(\rho')|^2]/\sqrt TTh​E[∑t=K~+1T​Zt​(m)]≤2hmE[∣J1​(ρ′)∣2]/T​.
  4. Lemma 9, corrected (p. 13). If θ<E[D1]\theta<E[D_1]θ<E[D1​], E[D14]<∞E[D_1^4]<\inftyE[D14​]<∞ and z>0z>0z>0, then E[K(θ,z)]≤1+2zE[D1]−θ+8π2E[(D1−E[D1])4](E[D1]−θ)4E[K(\theta,z)]\le1+\frac{2z}{E[D_1]-\theta}+\frac{8\pi^2E[(D_1-E[D_1])^4]}{(E[D_1]-\theta)^4}E[K(θ,z)]≤1+E[D1​]−θ2z​+(E[D1​]−θ)48π2E[(D1​−E[D1​])4]​.

Significance

The result. The cost of AIM relative to the newsvendor benchmark splits as Λ1(T)+Λ2(T)\Lambda_1(T)+\Lambda_2(T)Λ1​(T)+Λ2​(T). Stochastic subgradient descent controls Λ1(T)\Lambda_1(T)Λ1​(T) for every γ\gammaγ, so Theorem 8 is the remaining step in showing that AIM converges at rate O(1/T)O(1/\sqrt T)O(1/T​) without any knowledge of a lower bound on mean demand. The first term of the bound is O(1/T)O(1/T)O(1/T) whenever E[K]E[K]E[K] is finite, and Lemma 9 gives that under a finite fourth moment. The second term is O(1/T)O(1/\sqrt T)O(1/T​) whenever E[∣J1∣2]E[|J_1|^2]E[∣J1​∣2] is finite, and the paper's Proposition 4 gives that under a finite sixth moment. The result therefore removes the one piece of prior information about demand, other than yˉ\bar yyˉ​, that the non-perishable analysis needed.

Formalizing it. The paper's proof is complete and short, but it moves between expectations of random indices, pathwise couplings and renewal arguments, and the statements of Theorem 8 and Lemma 9 contain the slips recorded below. None of these results has a machine-checked proof. The mission produces a checked AIM recursion, a pathwise domination of excess inventory by a queue, and hitting-time and busy-period bounds for random walks with nonnegative i.i.d. decrements.

Difficulty

The argument behind Theorem 2 dominates yt−y^ty_t-\hat y_tyt​−y^​t​ by a queue whose inflow ρ/t\rho/\sqrt tρ/t​ is below the mean demand. For large γ\gammaγ the inflow m/tm/\sqrt tm/t​ exceeds E[D1]E[D_1]E[D1​] in early periods, so the queue Z(m)Z(m)Z(m) is unstable at first and its busy periods are not controlled by a stationary queue. A direct bound on E[∑tZt(m)]E[\sum_t Z_t(m)]E[∑t​Zt​(m)] through busy periods of W(m)W(m)W(m) fails, because W(m)W(m)W(m) may never empty when m≥E[D1]m\ge E[D_1]m≥E[D1​]. The proof therefore separates a random initial stretch, which ends at the first time after T~\tilde TT~ that Z(m)Z(m)Z(m) empties, from the remainder. The two parts are bounded by different processes. The random index K~\tilde KK~ sits inside the sums, so the expectations have to be handled with that dependence.

Formalization scope

  • Demand uses the published definition CappedBaseStock_Model (DemandLaw, the i.i.d. path measure demandPathLaw). Its law has finite and strictly positive mean. The cost QQQ and yNVy^{NV}yNV are the published backorderCost and newsvendorLevel of LostSalesOrderUpTo.Asymptotic.Backorder. Both are reused, not redefined.
  • The demand path is zero-based: the paper's DtD_tDt​ is d (t-1). AIM is a deterministic recursion on the path, and y^t,yt,xt\hat y_t,y_t,x_ty^​t​,yt​,xt​ depend on D1,…,Dt−1D_1,\dots,D_{t-1}D1​,…,Dt−1​ only. Levels are real numbers, and QQQ is evaluated at nonnegative levels.
  • The conventions are Z1=W1=0Z_1=W_1=0Z1​=W1​=0 and τ0=1\tau_0=1τ0​=1. The paper's own indexing (Z0=0Z_0=0Z0​=0 in (7)) is undefined at t=0t=0t=0, and these are the conventions its proofs use.
  • KKK, ∣J1∣|J_1|∣J1​∣ and K~\tilde KK~ take values in [0,∞][0,\infty][0,∞], and E[K]E[K]E[K], E[∣J1∣2]E[|J_1|^2]E[∣J1​∣2], E[K~]E[\tilde K]E[K~] are Lebesgue integrals in [0,∞][0,\infty][0,∞]. Theorem 8 and Claim (14) are stated in [0,∞][0,\infty][0,∞]. A divergent expectation therefore makes a bound trivially true. It can never make a bound false or vacuous through a junk value 000. Λ2(T)\Lambda_2(T)Λ2​(T) is a real expectation of a bounded integrand.
  • Explicit readings of loose phrases: "for any choice of the parameter γ\gammaγ" means every γ>0\gamma>0γ>0. "Set y1=y^1y_1=\hat y_1y1​=y^​1​ to any value in [0,yˉ][0,\bar y][0,yˉ​]" means the statements hold for every such start. "With probability one" in the coupling is stated pathwise. 0<ρ′0<\rho'0<ρ′ is added (the bound divides by ρ′\rho'ρ′), as are h,b,yˉ>0h,b,\bar y>0h,b,yˉ​>0. In Claim (14) the random lower limit K~\tilde KK~ is read inside the expectation, as in (13) and Appendix E.
  • Lemma 9 is false as printed: for D≡1D\equiv1D≡1, θ=0\theta=0θ=0, z=1/4z=1/4z=1/4 one has K=1K=1K=1 while the printed bound is 1/21/21/2. The mission states it with an additive 111, which is what the printed proof gives once the integers below 2z/(E[D1]−θ)2z/(E[D_1]-\theta)2z/(E[D1​]−θ) are counted correctly.
  • Ruled out: stating the goal about an arbitrary sequence of levels instead of the AIM recursion, taking E[K]E[K]E[K] or E[∣J1∣2]E[|J_1|^2]E[∣J1​∣2] as real Bochner integrals (which are 000 when the expectation diverges and would make the bound false), and dropping the newsvendor bound yNV≤yˉy^{NV}\le\bar yyNV≤yˉ​ from the goal.
  • Welcome contributions: a reusable Lindley-recursion (see Asmussen 2003, Ch. III) and busy-period library (the inspection-paradox bound E∣Ji(θ,s)(θ)∣≤E∣J1(θ)∣2E|J_{i(\theta,s)}(\theta)|\le E|J_1(\theta)|^2E∣Ji(θ,s)​(θ)∣≤E∣J1​(θ)∣2, Lemma 13 of the paper), fourth-moment Markov bounds for sums of i.i.d. centred variables, and shift invariance of the i.i.d. path measure.

Selected references

  • W. T. Huh and P. Rusmevichientong, A Nonparametric Asymptotic Analysis of Inventory Planning with Censored Demand, Mathematics of Operations Research 34(1):103–123, 2009. https://doi.org/10.1287/moor.1080.0355
  • S. Asmussen, Applied Probability and Queues, 2nd ed., Springer, 2003. https://doi.org/10.1007/b97236
8 thms3 active usersReviewed
🏆Completed
Markov ChainOperations ResearchStochastic Systems·Captain: mikedeng1

Contact Interactions on a Lattice II: If λₖ/μ < k/(2d − 1), the Expected Size of a Contact Process Is Integrable in TimeResearch Paper

Motivation

The contact process is the basic model of an infection spreading on a graph: infected sites recover at a constant rate, and healthy sites are infected at a rate that depends on how many of their neighbours are infected. T. E. Harris introduced it in Contact Interactions on a Lattice (Ann. Probab. 2, 1974, doi:10.1214/aop/1176996493), and it became one of the central examples of the theory of interacting particle systems (Liggett, Interacting Particle Systems, 1985, Ch. VI; Liggett, Stochastic Interacting Systems, 1999, Part I). Its questions are those of epidemiology and population dynamics on a spatial grid: does a finite infection die out, and how large does it get on the way?

Harris's paper gives the first rigorous subcritical bounds. Section 7 treats two quantities for a process started from a finite set: the probability p∞(ξ)p_\infty(\xi)p∞​(ξ) of surviving forever, and the expected size mt(ξ)m_t(\xi)mt​(ξ) at time ttt. This mission formalizes the second, Theorem 7.6: under an explicit condition on the rates, the expected size is integrable in time. The companion mission (Contact Interactions on a Lattice I) formalizes Theorem 7.1, extinction under the same condition.

A short timeline. Harris (1974) defined the process, proved monotonicity, subadditivity and submodularity by coupling, and gave the bounds of §7 and a survival result for large rates (§9). Holley and Liggett (Ann. Probab. 3, 1975) developed duality for such systems. Holley and Liggett's paper also proves, for a discrete-time branching process with interference, the analogue PF(An≠∅)≤EF∣An∣≤λn∣F∣P_F(A_n\ne\varnothing)\le E_F|A_n|\le\lambda^n|F|PF​(An​=∅)≤EF​∣An​∣≤λn∣F∣ of the size bounds studied here; it is a different process, related but not reused.

Setting

Fix d≥1d \ge 1d≥1 and the lattice ZdZ_dZd​ of integer points x=(x1,…,xd)x = (x^1, \dots, x^d)x=(x1,…,xd). Sites x,yx, yx,y are neighbours, x∼yx \sim yx∼y, if ∑i∣xi−yi∣=1\sum_i |x^i - y^i| = 1∑i​∣xi−yi∣=1; NxN_xNx​ is the set of the 2d2d2d neighbours of xxx. A configuration is a finite set ξ⊂Zd\xi \subset Z_dξ⊂Zd​ (the set Ξ0\Xi_0Ξ0​); ∣ξ∣|\xi|∣ξ∣ is its number of points, ξ(Nx)\xi(N_x)ξ(Nx​) is the number of neighbours of xxx in ξ\xiξ, and x∼ξx \sim \xix∼ξ means x∉ξx \notin \xix∈/ξ and xxx has a neighbour in ξ\xiξ.

The parameters are a death rate μ≥0\mu \ge 0μ≥0 and birth rates λ0=0,λ1,…,λ2d≥0\lambda_0 = 0, \lambda_1, \dots, \lambda_{2d} \ge 0λ0​=0,λ1​,…,λ2d​≥0. The contact process is the continuous-time Markov chain on finite configurations that, from ξ\xiξ, removes a point x∈ξx \in \xix∈ξ at rate μ\muμ and adds a site x∼ξx \sim \xix∼ξ at rate λξ(Nx)\lambda_{\xi(N_x)}λξ(Nx​)​. Its total jump rate is

qξ=μ∣ξ∣+∑x∼ξλξ(Nx).q_\xi = \mu|\xi| + \sum_{x \sim \xi} \lambda_{\xi(N_x)} .qξ​=μ∣ξ∣+x∼ξ∑​λξ(Nx​)​.

The empty configuration is absorbing. Pt(ξ,η)P_t(\xi, \eta)Pt​(ξ,η) is its transition function, r(ξ,η)=qξη/qξr(\xi,\eta) = q_{\xi\eta}/q_\xir(ξ,η)=qξη​/qξ​ the transition matrix of its jump chain, and

mt(ξ)=Eξ ∣ξt∣=∑ηPt(ξ,η) ∣η∣m_t(\xi) = \mathscr E_\xi\, |\xi_t| = \sum_{\eta} P_t(\xi, \eta)\, |\eta|mt​(ξ)=Eξ​∣ξt​∣=η∑​Pt​(ξ,η)∣η∣

the expected size at time ttt. In the Lean development these are trans μ lam t ξ η, jump μ lam ξ η and meanSize μ lam t ξ, where lam k is λk\lambda_kλk​.

Formalization targets

Goal: Theorem 7.6 (p. 982)

If μ>0\mu > 0μ>0 and

λkμ<k2d−1,k=1,…,2d,\frac{\lambda_k}{\mu} < \frac{k}{2d-1}, \qquad k = 1, \dots, 2d,μλk​​<2d−1k​,k=1,…,2d,

then for every finite ξ\xiξ,

∫0∞mt(ξ) dt<∞.\int_0^\infty m_t(\xi)\, dt < \infty .∫0∞​mt​(ξ)dt<∞.

Milestones

In the paper's proof order:

  1. Lemma 4.7: mt(ξ)≤∣ξ∣ e(2dΛ−μ)tm_t(\xi) \le |\xi|\, e^{(2d\Lambda - \mu)t}mt​(ξ)≤∣ξ∣e(2dΛ−μ)t with Λ=max⁡iλi\Lambda = \max_i \lambda_iΛ=maxi​λi​.
  2. Lemma 5.8, its mtm_tmt​ half: λk≤min⁡j≥kλj′\lambda_k \le \min_{j \ge k} \lambda'_jλk​≤minj≥k​λj′​ implies mt≤mt′m_t \le m'_tmt​≤mt′​.
  3. The change of time scale: multiplying all rates by ccc replaces mtm_tmt​ by mctm_{ct}mct​.
  4. Remark 5.5, three times. mtm_tmt​ is increasing in ξ\xiξ when λk↑\lambda_k \uparrowλk​↑; it is subadditive when also λk/k↓\lambda_k / k \downarrowλk​/k↓; and it is submodular when λ\lambdaλ is concave and non-decreasing.
  5. The first-jump equation (7.7) for a pair of neighbours, with K=2+(4d−2)λK = 2 + (4d-2)\lambdaK=2+(4d−2)λ.
  6. The bound after (7.11): M2(T)−M1(T)≤1/(1−(2d−1)λ)M_2(T) - M_1(T) \le 1/(1 - (2d-1)\lambda)M2​(T)−M1​(T)≤1/(1−(2d−1)λ).
  7. Lemma 7.5: if ∫0∞mt({x}) dt=∞\int_0^\infty m_t(\{x\})\,dt = \infty∫0∞​mt​({x})dt=∞, then ∫0∞(mt(ξ)−mt({x})) dt=∞\int_0^\infty (m_t(\xi) - m_t(\{x\}))\,dt = \infty∫0∞​(mt​(ξ)−mt​({x}))dt=∞ for ∣ξ∣≥2|\xi| \ge 2∣ξ∣≥2.

After the goal come two consequences: Lemma 4.11, mt+h(ξ)≥e−μhmt(ξ)m_{t+h}(\xi) \ge e^{-\mu h} m_t(\xi)mt+h​(ξ)≥e−μhmt​(ξ), and Remark 7.12, mt(ξ)→0m_t(\xi) \to 0mt​(ξ)→0.

Significance

The theorem says that the total expected infection time, summed over all sites, is finite. That is stronger than extinction (Theorem 7.1), and it quantifies how fast the process dies out on average. With Lemma 4.11 it gives mt(ξ)→0m_t(\xi) \to 0mt​(ξ)→0. Bounds on the expected size are the standard route to subcritical estimates for spatial epidemics and branching systems with interference. The milestones are also the paper's general tools. Monotonicity, subadditivity and submodularity of mtm_tmt​, comparison of rate sequences, and time scaling hold for every contact process and are reusable beyond this mission.

The theorem has been known since 1974, and the formalization of the contact process is new work: the platform has no machine-checked development of an interacting particle system on ZdZ_dZd​, nor of a continuous-time chain with unbounded rates. The mission produces a formal model of the contact process from a finite set, a Lean proof of the subcritical bound, and the coupling inequalities (stated here for mtm_tmt​) that any further work on the process will need.

Difficulty

The obvious argument fails. One would bound the growth rate of ∣ξt∣|\xi_t|∣ξt​∣ by its worst case: a site is born at rate at most λk\lambda_kλk​ for each of at most 2d∣ξ∣2d|\xi|2d∣ξ∣ boundary sites. This gives only Lemma 4.7, an exponential bound whose exponent 2dΛ−μ2d\Lambda - \mu2dΛ−μ is positive in most of the regime of the theorem. The factor 2d−12d - 12d−1 instead of 2d2d2d comes from correlations: a newly born site always has an occupied neighbour, so it adds at most 2d−12d - 12d−1 new boundary sites. Capturing this needs the comparison between a single site and a pair of neighbours in (7.7)–(7.11), together with submodularity, which is a coupling statement about the whole process. Lemma 7.5 then has to turn a bound on the difference M2−M1M_2 - M_1M2​−M1​ into a bound on M1M_1M1​, and the paper omits its proof.

In the formal setting the chain has unbounded rates (since qξq_\xiqξ​ grows with ∣ξ∣|\xi|∣ξ∣), so its transition function is not a matrix exponential. Uniformization does not apply either, and every statement goes through the minimal solution of the backward equations.

Formalization scope

  • The chain model. The process is the countable-state chain on finite configurations that the paper itself uses from §4 on. Theorems 4.1 and 4.3 show that the infinite-volume process started in Ξ0\Xi_0Ξ0​ is this chain. No process on infinite configurations and no probability space is constructed, and PξP_\xiPξ​, Eξ\mathscr E_\xiEξ​ enter only through PtP_tPt​.
  • The transition function. PtP_tPt​ is the minimal transition function of the rates (4.4)–(4.5), Pt=sup⁡nPt(n)P_t = \sup_n P^{(n)}_tPt​=supn​Pt(n)​, where Pt(n)P^{(n)}_tPt(n)​ is defined by Feller's backward recursion over at most nnn jumps.
  • Finite initial sets. Statements the paper makes for all ξ∈Ξ\xi \in \Xiξ∈Ξ (Lemmas 4.11 and 5.8, Remark 5.5) are drafted for finite ξ\xiξ.
  • Values. PtP_tPt​, ptp_tpt​ and mtm_tmt​ take values in [0,∞][0, \infty][0,∞]. Integrals of mtm_tmt​ are Lebesgue integrals of [0,∞][0,\infty][0,∞]-valued functions.
  • Lattice. Sites are Fin d → ℤ with the ℓ1\ell^1ℓ1 adjacency of the paper.
  • Standing hypotheses. Every statement carries d≥1d \ge 1d≥1, μ≥0\mu \ge 0μ≥0, λ0=0\lambda_0 = 0λ0​=0 and λk≥0\lambda_k \ge 0λk​≥0 for k≤2dk \le 2dk≤2d. Conditions on λ\lambdaλ range over k≤2dk \le 2dk≤2d only, since λk\lambda_kλk​ for k>2dk > 2dk>2d never enters the model. The goal adds μ>0\mu > 0μ>0, which the paper's ratio λk/μ\lambda_k/\muλk​/μ presupposes.

Several trivializing formalizations are excluded:

  • mtm_tmt​ is not a real tsum, which would be 000 when the series diverges;
  • the integral is not a real Bochner integral, which would be 000 for a non-integrable function;
  • the rate condition does not range over all k∈Nk \in \mathbb Nk∈N;
  • μ>0\mu > 0μ>0 is not left implicit: in Lean λk/0=0\lambda_k / 0 = 0λk​/0=0, and at μ=0\mu = 0μ=0 the conclusion is false;
  • the goal is not stated for singletons only.

A complete development needs the backward equation and non-explosion for PtP_tPt​ (Theorem 4.3, formalized in the companion mission), Fubini–Tonelli for ∑\sum∑ and ∫\int∫ in [0,∞][0,\infty][0,∞], and couplings of contact processes. The couplings are the paper's auxiliary multi-type processes (§§5–6), or an equivalent argument on the generator. Contributions are welcome at every level. The coupling lemmas and the backward and forward equations for minimal chains are the parts most reusable beyond this mission.

Selected references

  • T. E. Harris, Contact interactions on a lattice, Ann. Probab. 2(6), 969–988, 1974. https://doi.org/10.1214/aop/1176996493
  • R. Holley, T. M. Liggett, Ergodic theorems for weakly interacting infinite systems and the voter model, Ann. Probab. 3(4), 643–663, 1975. https://doi.org/10.1214/aop/1176996306
  • T. M. Liggett, Interacting Particle Systems, Springer, 1985. https://doi.org/10.1007/978-1-4613-8542-4
  • W. Feller, On the integro-differential equations of purely discontinuous Markoff processes, Trans. Amer. Math. Soc. 48, 488–515, 1940. https://doi.org/10.1090/S0002-9947-1940-0002697-3
  • J. R. Norris, Markov Chains, Cambridge University Press, 1997, §2.8. https://doi.org/10.1017/CBO9780511810633
13 thms3 active usersReviewed
PreviousPage 7 of 66Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me