Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

2,210 missions · 1,089 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open1121Completed1089All2210
AnalysisProbabilityStochastic Systems·Captain: mikedeng1

Implicit Renewal Theory and Tails of Solutions of Random Equations 3: Rate of Approach — t^κP(R > t) Equals C₊ Minus a Contour Integral Plus O(t^{−β/2})Research Paper

Motivation

Random equations of the form R=LΨ(R)R \overset{\mathcal L}{=} \Psi(R)R=LΨ(R), with Ψ\PsiΨ a random function independent of RRR, describe the stationary laws of many stochastic recursions: perpetuities in insurance and finance, the stationary law of ARCH-type volatility models, random difference equations R=Q+MRR = Q + MRR=Q+MR, and the stationary workload of certain queueing and storage models. When Ψ(t)\Psi(t)Ψ(t) acts like multiplication by a random variable MMM for large ∣t∣|t|∣t∣, and E∣M∣κ=1\mathbf E|M|^\kappa = 1E∣M∣κ=1 for some κ>0\kappa > 0κ>0, the solution has power-law tails: P(R>t)∼C+t−κP(R > t) \sim C_+ t^{-\kappa}P(R>t)∼C+​t−κ. This is the implicit renewal theorem of Goldie (Ann. Appl. Probab. 1991, Theorem 2.3), which recovers and extends Kesten's 1973 theorem on random difference equations.

A tail asymptotic alone says nothing about how fast tκP(R>t)t^\kappa P(R > t)tκP(R>t) approaches C+C_+C+​. For tail estimation, for the accuracy of extreme-quantile approximations used in risk management, and for second-order regular variation, the rate matters. Section 3 of the same paper answers this: under an exponential moment condition slightly beyond the Cramér condition, the error has an explicit second-order term determined by the zeros of 1−η^1 - \hat\eta1−η^​, where η\etaη is a tilted law of log⁡M\log MlogM, plus a remainder O(t−β/2)O(t^{-\beta/2})O(t−β/2).

Timeline: Kesten (1973) proved power tails for random difference equations; Grincevičius (1975) developed an implicit-renewal approach; Stone (1966) decomposed exponentially decaying renewal measures into an absolutely continuous part with explicit asymptotics and a finite part; Ganelius (1962) proved the Tauberian remainder theorem used to unsmooth; Goldie (1991) combined these into the rate result formalized here.

Setting

Let (Ω,A,P)(\Omega, \mathcal A, P)(Ω,A,P) be a probability space carrying independent real random variables M≥0M \ge 0M≥0 and RRR. Fix κ>0\kappa > 0κ>0 with EMκ=1\mathbf E M^\kappa = 1EMκ=1 (the Cramér condition, (2.3)) and β>0\beta > 0β>0 with EMκ+β<∞\mathbf E M^{\kappa+\beta} < \inftyEMκ+β<∞ (3.3).

The tilted law of MMM is the probability measure η(dx)=eκxP(log⁡M∈dx)\eta(dx) = e^{\kappa x} P(\log M \in dx)η(dx)=eκxP(logM∈dx) on R\mathbb RR, computed on {M>0}\{M > 0\}{M>0}. Its transforms are η~(β)=∫eβtη(dt)\tilde\eta(\beta) = \int e^{\beta t}\eta(dt)η~​(β)=∫eβtη(dt) for real β\betaβ and η^(θ)=∫eiθtη(dt)\hat\eta(\theta) = \int e^{i\theta t}\eta(dt)η^​(θ)=∫eiθtη(dt) for complex θ\thetaθ; for a function fff, f^(θ)=∫eiθtf(t) dt\hat f(\theta) = \int e^{i\theta t} f(t)\,dtf^​(θ)=∫eiθtf(t)dt. Convolution powers are η(0)=δ0\eta^{(0)} = \delta_0η(0)=δ0​, η(n+1)=η(n)∗η\eta^{(n+1)} = \eta^{(n)} * \etaη(n+1)=η(n)∗η, and the renewal measure is ν=∑n≥0η(n)\nu = \sum_{n \ge 0}\eta^{(n)}ν=∑n≥0​η(n). A law is spread out when some convolution power has a nonzero absolutely continuous component; (3.4) asks this of the conditional law of log⁡M\log MlogM given M≠0M \ne 0M=0.

Set m=EMκlog⁡Mm = \mathbf E M^\kappa \log Mm=EMκlogM and

g1(t)=eκt(P(R>et)−P(MR>et)),C+=1m∫0∞(P(R>t)−P(MR>t))tκ−1 dt,g_1(t) = e^{\kappa t}\big(P(R > e^t) - P(MR > e^t)\big), \qquad C_+ = \frac1m\int_0^\infty \big(P(R > t) - P(MR > t)\big) t^{\kappa - 1}\,dt,g1​(t)=eκt(P(R>et)−P(MR>et)),C+​=m1​∫0∞​(P(R>t)−P(MR>t))tκ−1dt,

with g−1g_{-1}g−1​ and C−C_-C−​ defined the same way for the lower tail. The strip is D={θ:−β<ℑθ<0}D = \{\theta : -\beta < \Im\theta < 0\}D={θ:−β<ℑθ<0}, and C\mathscr CC denotes a positively oriented closed contour in DDD enclosing every zero of 1−η^1 - \hat\eta1−η^​ in DDD.

Formalization targets

Goal: Theorem 3.2

If, in addition, η(n0)=(1−δ)φ0+δφ1\eta^{(n_0)} = (1 - \delta)\varphi_0 + \delta\varphi_1η(n0​)=(1−δ)φ0​+δφ1​ for some n0n_0n0​, with δ∈[0,1)\delta \in [0, 1)δ∈[0,1), φ0\varphi_0φ0​ absolutely continuous and δφ~1(β)<1\delta\tilde\varphi_1(\beta) < 1δφ~​1​(β)<1, and η^≠1\hat\eta \ne 1η^​=1 on ℑθ=−β\Im\theta = -\betaℑθ=−β, then ∫0∞∣P(R>t)−P(MR>t)∣ tκ+β−1dt<∞\int_0^\infty |P(R > t) - P(MR > t)|\,t^{\kappa+\beta-1}dt < \infty∫0∞​∣P(R>t)−P(MR>t)∣tκ+β−1dt<∞ implies

tκP(R>t)=C+−12π ℜ∮Ce−iθlog⁡t g^1(θ)1−η^(θ) dθ+O(t−β/2),t→∞,t^\kappa P(R > t) = C_+ - \frac1{2\pi}\,\Re\oint_{\mathscr C} e^{-i\theta\log t}\,\frac{\hat g_1(\theta)}{1 - \hat\eta(\theta)}\,d\theta + O(t^{-\beta/2}), \qquad t \to \infty,tκP(R>t)=C+​−2π1​ℜ∮C​e−iθlogt1−η^​(θ)g^​1​(θ)​dθ+O(t−β/2),t→∞,

with the analogous statement for P(R<−t)P(R < -t)P(R<−t); and if R=LΨ(R)R \overset{\mathcal L}{=} \Psi(R)R=LΨ(R) with RRR independent of (M,Ψ)(M, \Psi)(M,Ψ), the integrability hypotheses may be replaced by E∣(Ψ(R)±)κ+β−((MR)±)κ+β∣<∞\mathbf E|(\Psi(R)^\pm)^{\kappa+\beta} - ((MR)^\pm)^{\kappa+\beta}| < \inftyE∣(Ψ(R)±)κ+β−((MR)±)κ+β∣<∞. The theorem also asserts that η\etaη is a spread-out probability measure.

Milestones

  1. Lemma 9.5: Stone's inversion formula for the density of ∑nχ∗μ(n)\sum_n \chi * \mu^{(n)}∑n​χ∗μ(n).
  2. Theorem 3.1: the renewal measure splits as ν=ν0+ν1\nu = \nu_0 + \nu_1ν=ν0​+ν1​, ν1\nu_1ν1​ finite with ν~1(β)<∞\tilde\nu_1(\beta) < \inftyν~1​(β)<∞, ν0\nu_0ν0​ with continuous bounded density
p(t)=1m−12π∮Ce−iθtdθ1−η^(θ)+o(e−βt).p(t) = \frac1m - \frac1{2\pi}\oint_{\mathscr C} e^{-i\theta t}\frac{d\theta}{1 - \hat\eta(\theta)} + o(e^{-\beta t}).p(t)=m1​−2π1​∮C​e−iθt1−η^​(θ)dθ​+o(e−βt).
  1. (9.23) and (9.24): the smoothed identity and the smoothed rate K∗ℜr1(t)=o(e−βt)K * \Re r_1(t) = o(e^{-\beta t})K∗ℜr1​(t)=o(e−βt) for the kernel K(t)=be−bt1t>0K(t) = be^{-bt}\mathbf 1_{t>0}K(t)=be−bt1t>0​.
  2. Theorem 9.6: the Beurling–Ganelius Tauberian remainder theorem.

Significance

Theorem 3.2 turns the first-order tail asymptotic of the implicit renewal theorem into an expansion: the second-order terms are finitely many terms of the form (log⁡t)j−1tℑθl(\log t)^{j-1}t^{\Im\theta_l}(logt)j−1tℑθl​ times oscillating factors, one family for each zero θl\theta_lθl​ of 1−η^1 - \hat\eta1−η^​ with 0<−ℑθl≤β/20 < -\Im\theta_l \le \beta/20<−ℑθl​≤β/2, and their form does not depend on the unknown law of RRR. It applies to every random equation covered by the implicit renewal theorem once the stronger moment condition holds, including perpetuities and the random difference equation. Theorem 3.1 is of independent use: it is an explicit-rate version of Stone's decomposition of renewal measures with exponential moments.

The results are proved in the paper; none is formalized. Mathlib has the Fourier transform on the real line, convolution of measures, and rectangle Cauchy theorems, but no renewal theory, no Stone decomposition, and no Tauberian remainder theorem. Formalizing the mission produces a machine-checked renewal density expansion and a checked Beurling–Ganelius theorem, both reusable outside this paper.

Difficulty

The first-order theorem follows from the key renewal theorem applied to r(t)=eκtP(R>et)r(t) = e^{\kappa t}P(R > e^t)r(t)=eκtP(R>et). That route gives no rate: the key renewal theorem has no remainder, and the integrability hypothesis yields eβtg1∈L1e^{\beta t}g_1 \in L^1eβtg1​∈L1 but not eβtg1(t)=o(1)e^{\beta t}g_1(t) = o(1)eβtg1​(t)=o(1), so a remainder cannot be read off directly even with a spread-out step law. The proof therefore works with a smoothed version of rrr, where Stone's decomposition with the contour expansion of the renewal density gives an o(e−βt)o(e^{-\beta t})o(e−βt) remainder, and has to unsmooth. Unsmoothing is the Tauberian step: it requires a one-sided regularity condition on the unsmoothed function, verified for rrr and for the contour term, and costs half the exponent. The contour expansion itself requires showing that 1−η^1 - \hat\eta1−η^​ has finitely many zeros in the strip and handling their orders through residues.

Formalization scope

All objects live in the namespace GoldieRenewal.Rates. Random variables are measurable maps Ω→R\Omega \to \mathbb RΩ→R on a probability space; M≥0M \ge 0M≥0 almost surely; independence is IndepFun. Tail probabilities are real numbers P.real {ω | t < R ω}. Moments such as EMκ+β\mathbf E M^{\kappa+\beta}EMκ+β and μ~(β)\tilde\mu(\beta)μ~​(β) are lower Lebesgue integrals in [0,∞][0, \infty][0,∞]. The transforms μ^\hat\muμ^​ and f^\hat ff^​ are Bochner integrals at complex arguments with the +i+i+i sign of the paper. Asymptotic statements use Asymptotics.IsBigO and IsLittleO along atTop.

The contour. A contour C\mathscr CC is the positively oriented boundary of an axis-parallel rectangle whose closure lies in DDD and whose interior contains every zero of 1−η^1 - \hat\eta1−η^​ in DDD; the contour integral is the sum of the four edge integrals (RectangleIntegral, from the published ResidueCalcOnRectangles_defs). Expansions are stated for every such rectangle.

The variable in (3.8) and (3.10). The paper prints e−iθte^{-i\theta t}e−iθt in the contour term, but its proof establishes the expansion in the logarithmic variable s=log⁡ts = \log ts=logt. The targets are stated with e−iθlog⁡te^{-i\theta\log t}e−iθlogt, which is what the proof gives. With the printed e−iθte^{-i\theta t}e−iθt the contour term would decay exponentially and the statement would claim tκP(R>t)=C++O(t−β/2)t^\kappa P(R > t) = C_+ + O(t^{-\beta/2})tκP(R>t)=C+​+O(t−β/2), which is not what is proved. Hypothesis (3.7) is printed with P(R>−t)P(R > -t)P(R>−t) and is read with P(R>t)P(R > t)P(R>t).

Excluded trivializations. The contour term may not be dropped; the hypotheses do not exclude zeros of 1−η^1 - \hat\eta1−η^​ in DDD; and the contour must enclose all zeros in the strip, not a chosen subset.

Theorem 9.6 is stated for a complex-valued kernel and a finite strip width aaa; the application with a=∞a = \inftya=∞ follows by restricting to a finite strip. Lemma 9.5 carries an added hypothesis that the density of χ\chiχ has compact support, which the proof uses and the application provides.

Contributions welcome: renewal-measure infrastructure (convolution powers, Blackwell-type limits), Fourier analysis of measures at complex arguments, residue computations on rectangles, and Tauberian remainder theory. Each is reusable well beyond this paper.

Selected references

  • C. M. Goldie, Implicit renewal theory and tails of solutions of random equations, Ann. Appl. Probab. 1(1):126–166, 1991. https://doi.org/10.1214/aoap/1177005985
  • H. Kesten, Random difference equations and renewal theory for products of random matrices, Acta Math. 131:207–248, 1973. https://doi.org/10.1007/BF02392040
  • C. Stone, On absolutely continuous components and renewal theory, Ann. Math. Statist. 37(1):271–275, 1966. https://doi.org/10.1214/aoms/1177699617
  • T. H. Ganelius, The remainder in Wiener's Tauberian theorem, Acta Univ. Gothoburgensis, Mathematica Gothoburgensia 1, 1962 (cited in Goldie 1991).
  • A. K. Grincevičius, One limit distribution for a random walk on the line, Lithuanian Math. J. 15:580–589, 1975 (cited in Goldie 1991).
12 thms2 active usersReviewed
Control TheoryProbabilityStochastic Systems·Captain: mikedeng1

Reflected Solutions of Backward SDE's, and Related Obstacle Problems for PDE's 2: With a Concave Coefficient, the Reflected BSDE Is the Value of a Minimax Optimal Stopping–Control ProblemResearch Paper

Motivation

A backward stochastic differential equation (BSDE) prescribes the terminal value of an adapted process instead of its initial value. Pardoux and Peng (1990) proved existence and uniqueness for Lipschitz coefficients, and BSDEs have since become a standard tool in stochastic control, mathematical finance and the probabilistic treatment of semilinear PDEs. El Karoui, Kapoudjian, Pardoux, Peng and Quenez (1997) introduced the reflected BSDE, whose solution is constrained to stay above a given obstacle process. Reflected BSDEs describe the price of American options in nonlinear markets (El Karoui, Pardoux and Quenez 1997), Dynkin games (Cvitanić and Karatzas 1996), and obstacle problems for parabolic PDEs.

In §7 of the 1997 paper the coefficient is assumed concave. Then the solution of the reflected BSDE is the value of a game: one player chooses a stopping time, the other chooses a control that sets the discount rate and the change of measure, and the value does not depend on which player moves first. This mission formalizes that statement (Theorem 7.2) and the results its proof uses.

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) carry a ddd-dimensional standard Brownian motion BBB, fix a horizon T≥0T\ge0T≥0, and let Ft\mathcal F_tFt​ be the natural filtration of BBB augmented by the PPP-null sets. Write L2\mathbb L^2L2 for the square-integrable FT\mathcal F_TFT​-measurable random variables, H2\mathbb H^2H2 for the progressively measurable processes φ\varphiφ with E∫0T∣φt∣2dt<∞E\int_0^T|\varphi_t|^2dt<\inftyE∫0T​∣φt​∣2dt<∞, and S2\mathcal S^2S2 for those with Esup⁡t≤T∣φt∣2<∞E\sup_{t\le T}|\varphi_t|^2<\inftyEsupt≤T​∣φt​∣2<∞.

The data are a terminal value ξ∈L2\xi\in\mathbb L^2ξ∈L2; a coefficient f(ω,t,y,z)f(\omega,t,y,z)f(ω,t,y,z), y∈Ry\in\mathbb Ry∈R, z∈Rdz\in\mathbb R^dz∈Rd, with f(⋅,y,z)∈H2f(\cdot,y,z)\in\mathbb H^2f(⋅,y,z)∈H2 for every (y,z)(y,z)(y,z) and Lipschitz in (y,z)(y,z)(y,z) with a constant KKK; and a continuous progressively measurable obstacle SSS with Esup⁡t(St+)2<∞E\sup_t(S_t^+)^2<\inftyEsupt​(St+​)2<∞ and ST≤ξS_T\le\xiST​≤ξ. A solution of the reflected BSDE is a triple (Y,Z,K)(Y,Z,K)(Y,Z,K) of progressively measurable processes with Z∈H2Z\in\mathbb H^2Z∈H2, Y∈S2Y\in\mathcal S^2Y∈S2, KT∈L2K_T\in\mathbb L^2KT​∈L2, and

Yt=ξ+∫tTf(s,Ys,Zs) ds+KT−Kt−∫tT(Zs,dBs),Yt≥St,Y_t=\xi+\int_t^Tf(s,Y_s,Z_s)\,ds+K_T-K_t-\int_t^T(Z_s,dB_s),\qquad Y_t\ge S_t,Yt​=ξ+∫tT​f(s,Ys​,Zs​)ds+KT​−Kt​−∫tT​(Zs​,dBs​),Yt​≥St​,

where KKK is continuous, nondecreasing, K0=0K_0=0K0​=0 and ∫0T(Yt−St) dKt=0\int_0^T(Y_t-S_t)\,dK_t=0∫0T​(Yt​−St​)dKt​=0: KKK pushes YYY up only when YYY touches SSS.

For t≤Tt\le Tt≤T, Tt\mathcal T_tTt​ is the set of stopping times vvv with t≤v≤Tt\le v\le Tt≤v≤T. When f(ω,t,⋅,⋅)f(\omega,t,\cdot,\cdot)f(ω,t,⋅,⋅) is concave, its conjugate is

F(ω,t,β,γ)=sup⁡(y,z)[f(ω,t,y,z)−βy−⟨γ,z⟩]∈(−∞,+∞].F(\omega,t,\beta,\gamma)=\sup_{(y,z)}\big[f(\omega,t,y,z)-\beta y-\langle\gamma,z\rangle\big]\in(-\infty,+\infty].F(ω,t,β,γ)=(y,z)sup​[f(ω,t,y,z)−βy−⟨γ,z⟩]∈(−∞,+∞].

The admissible controls A\mathcal AA are the bounded progressively measurable (βt,γt)(\beta_t,\gamma_t)(βt​,γt​) with E∫0TF(t,βt,γt)2dt<∞E\int_0^TF(t,\beta_t,\gamma_t)^2dt<\inftyE∫0T​F(t,βt​,γt​)2dt<∞. Each (β,γ)∈A(\beta,\gamma)\in\mathcal A(β,γ)∈A gives the affine coefficient fβ,γ(t,y,z)=F(t,βt,γt)+βty+⟨γt,z⟩f^{\beta,\gamma}(t,y,z)=F(t,\beta_t,\gamma_t)+\beta_ty+\langle\gamma_t,z\ranglefβ,γ(t,y,z)=F(t,βt​,γt​)+βt​y+⟨γt​,z⟩, its reflected BSDE solution Yβ,γY^{\beta,\gamma}Yβ,γ, the process Γt,sβ,γ\Gamma^{\beta,\gamma}_{t,s}Γt,sβ,γ​ solving dΓt,s=Γt,s(βsds+(γs,dBs))d\Gamma_{t,s}=\Gamma_{t,s}(\beta_sds+(\gamma_s,dB_s))dΓt,s​=Γt,s​(βs​ds+(γs​,dBs​)), Γt,t=1\Gamma_{t,t}=1Γt,t​=1, and the payoff

Φ(t,v,β,γ)=Γt,vβ,γ[Sv1{v<T}+ξ1{v=T}]+∫tvΓt,sβ,γF(s,βs,γs) ds.\Phi(t,v,\beta,\gamma)=\Gamma^{\beta,\gamma}_{t,v}\big[S_v1_{\{v<T\}}+\xi1_{\{v=T\}}\big]+\int_t^v\Gamma^{\beta,\gamma}_{t,s}F(s,\beta_s,\gamma_s)\,ds.Φ(t,v,β,γ)=Γt,vβ,γ​[Sv​1{v<T}​+ξ1{v=T}​]+∫tv​Γt,sβ,γ​F(s,βs​,γs​)ds.

Formalization targets

Goal: Theorem 7.2 (p. 725)

For every t∈[0,T]t\in[0,T]t∈[0,T] and (β,γ)∈A(\beta,\gamma)\in\mathcal A(β,γ)∈A, Ytβ,γ=ess sup⁡v∈TtE[Φ(t,v,β,γ)∣Ft]Y^{\beta,\gamma}_t=\operatorname{ess\,sup}_{v\in\mathcal T_t}E[\Phi(t,v,\beta,\gamma)\mid\mathcal F_t]Ytβ,γ​=esssupv∈Tt​​E[Φ(t,v,β,γ)∣Ft​], and

Yt=ess inf⁡AYtβ,γ=ess inf⁡Aess sup⁡v∈TtE[Φ∣Ft]=ess sup⁡v∈Ttess inf⁡AE[Φ∣Ft].Y_t=\operatorname*{ess\,inf}_{\mathcal A}Y^{\beta,\gamma}_t=\operatorname*{ess\,inf}_{\mathcal A}\operatorname*{ess\,sup}_{v\in\mathcal T_t}E[\Phi\mid\mathcal F_t]=\operatorname*{ess\,sup}_{v\in\mathcal T_t}\operatorname*{ess\,inf}_{\mathcal A}E[\Phi\mid\mathcal F_t].Yt​=Aessinf​Ytβ,γ​=Aessinf​v∈Tt​esssup​E[Φ∣Ft​]=v∈Tt​esssup​Aessinf​E[Φ∣Ft​].

The last equality, the interchange of the two essential extrema, is the minimax content.

Milestones

  1. Theorem 4.1 (p. 712): comparison. If ξ≤ξ′\xi\le\xi'ξ≤ξ′, f≤f′f\le f'f≤f′ and S≤S′S\le S'S≤S′, and one of f,f′f,f'f,f′ is Lipschitz, then Y≤Y′Y\le Y'Y≤Y′.
  2. §7 conjugacy (p. 724): a concave Lipschitz fff equals min⁡(β,γ)∈DtF{F(t,β,γ)+βy+⟨γ,z⟩}\min_{(\beta,\gamma)\in D^F_t}\{F(t,\beta,\gamma)+\beta y+\langle\gamma,z\rangle\}min(β,γ)∈DtF​​{F(t,β,γ)+βy+⟨γ,z⟩}, the minimum is attained, and the domain DtFD^F_tDtF​ of FFF is a.s. bounded.
  3. Proposition 7.1 (p. 724): for an affine coefficient δt+βty+⟨γt,z⟩\delta_t+\beta_ty+\langle\gamma_t,z\rangleδt​+βt​y+⟨γt​,z⟩, ΓtYt=ess sup⁡v∈TtE[Γvξ1{v=T}+ΓvSv1{v<T}+∫tvΓsδsds∣Ft]\Gamma_tY_t=\operatorname{ess\,sup}_{v\in\mathcal T_t}E[\Gamma_v\xi1_{\{v=T\}}+\Gamma_vS_v1_{\{v<T\}}+\int_t^v\Gamma_s\delta_sds\mid\mathcal F_t]Γt​Yt​=esssupv∈Tt​​E[Γv​ξ1{v=T}​+Γv​Sv​1{v<T}​+∫tv​Γs​δs​ds∣Ft​].
  4. §7 optimal control (p. 725): some (β∗,γ∗)∈A(\beta^*,\gamma^*)\in\mathcal A(β∗,γ∗)∈A satisfies f(t,Yt,Zt)=F(t,βt∗,γt∗)+βt∗Yt+⟨γt∗,Zt⟩f(t,Y_t,Z_t)=F(t,\beta^*_t,\gamma^*_t)+\beta^*_tY_t+\langle\gamma^*_t,Z_t\ranglef(t,Yt​,Zt​)=F(t,βt∗​,γt∗​)+βt∗​Yt​+⟨γt∗​,Zt​⟩ dt×dPdt\times dPdt×dP-a.e., so (Y,Z,K)(Y,Z,K)(Y,Z,K) solves the reflected BSDE with coefficient fβ∗,γ∗f^{\beta^*,\gamma^*}fβ∗,γ∗.

Significance

Theorem 7.2 identifies the solution of a nonlinear reflected BSDE with the value of a zero-sum game between a stopper and a controller. In finance, with fff the driver of a pricing rule under constraints or ambiguity, it says that the nonlinear price of an American claim is the worst case, over a family of discount rates and changes of measure, of linear American prices; and the stopper may announce the stopping rule first without changing the value. Concave drivers include the hedging equations with different borrowing and lending rates. The representation reduces questions about the nonlinear equation to a family of linear ones, which is how monotonicity, convexity and stability properties of nonlinear American prices are usually derived.

All four results and the goal are proved in the paper, with references to standard convex analysis and a measurable section theorem for two steps. None of them has a machine-checked proof. Mathlib has Brownian motion, filtrations, stopping times and conditional expectation, but no stochastic integral; the mission uses the Itô integral of the published Peng1990.SMP.Stochastic layer. A formal proof would give, beyond the theorem, a reusable comparison theorem for reflected BSDEs, a Snell-envelope representation for linear reflected BSDEs, and a measurable selection of supergradients along a process.

Difficulty

The inequality Yt≤Ytβ,γY_t\le Y^{\beta,\gamma}_tYt​≤Ytβ,γ​ for each control is a direct consequence of comparison, since f≤fβ,γf\le f^{\beta,\gamma}f≤fβ,γ. The difficulty is the reverse inequality, which needs a single admissible control that attains the conjugate representation along the solution (Y,Z)(Y,Z)(Y,Z) for almost every (t,ω)(t,\omega)(t,ω). Choosing a supergradient pointwise is easy; choosing it progressively measurable, bounded, and with F(t,βt∗,γt∗)F(t,\beta^*_t,\gamma^*_t)F(t,βt∗​,γt∗​) square integrable is a measurable-selection problem. The interchange of ess inf and ess sup does not follow from a general minimax theorem: the family A\mathcal AA is not compact and the payoff is not convex–concave in any usable topology. It uses a specific stopping time, the first time YYY touches SSS, together with comparison on the random interval before it. Proposition 7.1 requires the linear change of variables ΓtYt\Gamma_tY_tΓt​Yt​, whose transformed equation lacks the square integrability of the original one, so the Snell-envelope argument has to be rerun with weaker moments.

Formalization scope

  • Time and spaces. Time is R≥0\mathbb R_{\ge0}R≥0​ with T:R≥0T:\mathbb R_{\ge0}T:R≥0​, and time integrals run over [t,T]⊂R[t,T]\subset\mathbb R[t,T]⊂R. H2\mathbb H^2H2 is the published L2F (progressive in place of predictable); S2\mathcal S^2S2 and the obstacle condition are lower Lebesgue integrals in [0,∞][0,\infty][0,∞].
  • Filtration. The natural filtration of BBB joined with the σ-algebra of PPP-null sets.
  • Norms. ∣z∣|z|∣z∣ is the Euclidean norm and ⟨γ,z⟩=∑jγjzj\langle\gamma,z\rangle=\sum_j\gamma_jz_j⟨γ,z⟩=∑j​γj​zj​.
  • Lipschitz condition. Read as: almost surely, for all t≤Tt\le Tt≤T and all y,y′,z,z′y,y',z,z'y,y′,z,z′.
  • Solutions. Solutions are in the square-integrable class (v)–(viii). YYY has continuous paths. Equation (vi) holds for each ttt almost surely, and Y≥SY\ge SY≥S holds almost surely for all ttt. KKK is continuous and nondecreasing on every path. ∫0T(Y−S) dK=0\int_0^T(Y-S)\,dK=0∫0T​(Y−S)dK=0 is taken against the Lebesgue–Stieltjes measure of the path of KKK.
  • Extended values. FFF takes values in the extended reals. F2F^2F2 in the definition of A\mathcal AA is taken in [0,∞][0,\infty][0,∞], so admissibility forces F<∞F<\inftyF<∞ almost everywhere along the control.
  • Stochastic exponential. Γt,sβ,γ\Gamma^{\beta,\gamma}_{t,s}Γt,sβ,γ​ is the Doléans-Dade exponential, built from Itô integrals of γ\gammaγ with continuous paths.
  • Essential extrema. They are predicates relative to Ft\mathcal F_tFt​, real valued: the essential infimum is the published MultiperiodRisk.Bellman.EssInf, and the essential supremum is its mirror image.
  • Added hypothesis. S∈S2S\in\mathcal S^2S∈S2 is assumed wherever a conditional expectation of the payoff appears (Remark 3.2: without loss of generality). Otherwise the payoff may fail to be integrable, and Lean's conditional expectation of a non-integrable function is 000.
  • Hypothesized families. The solutions Yβ,γY^{\beta,\gamma}Yβ,γ and the Itô integrals defining Γβ,γ\Gamma^{\beta,\gamma}Γβ,γ are hypotheses indexed by A\mathcal AA. They exist by the existence theorem of the first mission of this series and by continuity of Itô integrals.

Several formalizations of the goal would make it trivial, and each is ruled out. The conjugate is not a real-valued supremum, which takes a junk value when unbounded. The essential infimum over A\mathcal AA is not a pointwise infimum. The interchange of ess inf and ess sup is not dropped. The coefficient is a random field f(ω,t,y,z)f(\omega,t,y,z)f(ω,t,y,z), not a deterministic or Markovian one.

The closing gloss of Theorem 7.2, that the triple (β∗,γ∗,Dt)(\beta^*,\gamma^*,D_t)(β∗,γ∗,Dt​) is optimal, is not stated separately; milestone 4 is its control half. Contributions are welcome on a continuous version of the Itô integral, Itô's formula for products with Γ\GammaΓ, the Snell envelope in continuous time, and measurable selection of supergradients; all of these are reusable beyond this mission.

Selected references

  • N. El Karoui, C. Kapoudjian, É. Pardoux, S. Peng, M.-C. Quenez, Reflected solutions of backward SDE's, and related obstacle problems for PDE's, Ann. Probab. 25(2), 1997, 702–737. https://doi.org/10.1214/aop/1024404416
  • É. Pardoux, S. Peng, Adapted solution of a backward stochastic differential equation, Systems Control Lett. 14, 1990, 55–61. https://doi.org/10.1016/0167-6911(90)90082-6
  • N. El Karoui, S. Peng, M.-C. Quenez, Backward stochastic differential equations in finance, Math. Finance 7(1), 1997, 1–71. https://doi.org/10.1111/1467-9965.00022
  • J. Cvitanić, I. Karatzas, Backward stochastic differential equations with reflection and Dynkin games, Ann. Probab. 24(4), 1996, 2024–2056. https://doi.org/10.1214/aop/1041903216
  • S. Peng, A general stochastic maximum principle for optimal control problems, SIAM J. Control Optim. 28(4), 1990, 966–979. https://doi.org/10.1137/0328054
10 thms2 active usersReviewed
Complexity TheoryLinear OptimizationOptimization·Captain: mikedeng1

An O(√nL)-Iteration Homogeneous and Self-Dual Linear Programming Algorithm 1: In O(√nL) Predictor-Corrector Iterations It Finds LP and Dual Optima or Detects InfeasibilityResearch Paper

Motivation

Interior-point methods solve linear programs in polynomially many iterations, but the classical analyses assume something about the instance before the algorithm starts: a known strictly feasible primal–dual pair, a nonempty interior, or a big-MMM bound on the feasible region of order 2L2^L2L, where LLL is the bit length of the data. In practice none of this is known in advance, and an infeasible or unbounded instance should be reported rather than assumed away.

Ye, Todd and Mizuno (1994) removed these assumptions. They embed a standard-form linear program and its dual into a single homogeneous and self-dual artificial program (HLP), which always has a known interior starting point, and apply the Mizuno–Todd–Ye predictor–corrector method to it. The resulting algorithm needs no regularity assumption, no big-MMM parameter, and an O(nL)O(\sqrt n L)O(n​L) iteration bound, the best known for interior-point methods. Self-dual embeddings of this kind are now the standard initialization in interior-point solvers for linear and conic programs.

Timeline. Karmarkar (1984) gave the first polynomial interior-point method on a homogeneous canonical form. Mizuno, Todd and Ye (1990) introduced the predictor–corrector method with O(nL)O(\sqrt nL)O(n​L) iterations under a known interior start. Kojima, Mizuno and Yoshise (1993) built a self-dual big-MMM artificial problem. Ye, Todd and Mizuno (1994) combined homogeneity and self-duality without big MMM, obtaining the result formalized here.

Setting

Given A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n, b∈Rmb\in\mathbb R^mb∈Rm, c∈Rnc\in\mathbb R^nc∈Rn, the primal problem is (LP) min⁡{cTx:Ax=b, x≥0}\min\{c^Tx : Ax=b,\ x\ge0\}min{cTx:Ax=b, x≥0} and its dual is (LD) max⁡{bTy:ATy≤c}\max\{b^Ty : A^Ty\le c\}max{bTy:ATy≤c}, with dual slacks s=c−ATys=c-A^Tys=c−ATy.

Fix x0>0x^0>0x0>0, s0>0s^0>0s0>0, y0y^0y0 and put bˉ=b−Ax0\bar b=b-Ax^0bˉ=b−Ax0, cˉ=c−ATy0−s0\bar c=c-A^Ty^0-s^0cˉ=c−ATy0−s0, zˉ=cTx0+1−bTy0\bar z=c^Tx^0+1-b^Ty^0zˉ=cTx0+1−bTy0. The homogeneous self-dual program (HLP) in the variables (y,x,τ,θ,s,κ)(y,x,\tau,\theta,s,\kappa)(y,x,τ,θ,s,κ) is

min⁡ ((x0)Ts0+1) θs.t. Ax−bτ+bˉθ=0,s=−ATy+cτ−cˉθ≥0,κ=bTy−cTx+zˉθ≥0,−bˉTy+cˉTx−zˉτ=−(x0)Ts0−1,x≥0, τ≥0.\begin{aligned} \min\ & ((x^0)^Ts^0+1)\,\theta\\ \text{s.t. } & Ax-b\tau+\bar b\theta=0,\qquad s=-A^Ty+c\tau-\bar c\theta\ge0,\qquad \kappa=b^Ty-c^Tx+\bar z\theta\ge0,\\ & -\bar b^Ty+\bar c^Tx-\bar z\tau=-(x^0)^Ts^0-1,\qquad x\ge0,\ \tau\ge0 . \end{aligned}min s.t. ​((x0)Ts0+1)θAx−bτ+bˉθ=0,s=−ATy+cτ−cˉθ≥0,κ=bTy−cTx+zˉθ≥0,−bˉTy+cˉTx−zˉτ=−(x0)Ts0−1,x≥0, τ≥0.​

Its feasible set is Fh\mathcal F_hFh​, and Fh0\mathcal F_h^0Fh0​ is the subset with (x,τ,s,κ)>0(x,\tau,s,\kappa)>0(x,τ,s,κ)>0. A strictly self-complementary solution is an optimal solution with θ=0\theta=0θ=0 and (x+s;τ+κ)>0(x+s;\tau+\kappa)>0(x+s;τ+κ)>0. The paper then fixes y0=0y^0=0y0=0, x0=s0=ex^0=s^0=ex0=s0=e, so the objective is (n+1)θ(n+1)\theta(n+1)θ and (0,e,1,1,e,1)∈Fh0(0,e,1,1,e,1)\in\mathcal F_h^0(0,e,1,1,e,1)∈Fh0​.

With μ=(xTs+τκ)/(n+1)\mu=(x^Ts+\tau\kappa)/(n+1)μ=(xTs+τκ)/(n+1), the neighborhood of the central path is N(β)={z∈Fh0:∥(Xs;τκ)−μe∥≤βμ}\mathcal N(\beta)=\{z\in\mathcal F_h^0 : \|(Xs;\tau\kappa)-\mu e\|\le\beta\mu\}N(β)={z∈Fh0​:∥(Xs;τκ)−μe∥≤βμ} (Euclidean norm). The predictor–corrector algorithm starts at (0,e,1,1,e,1)(0,e,1,1,e,1)(0,e,1,1,e,1). At even steps it solves a Newton system with centering parameter γ=0\gamma=0γ=0 and moves by the largest step keeping the iterate in N(1/2)\mathcal N(1/2)N(1/2). At odd steps it takes a full Newton step with γ=1\gamma=1γ=1. A termination projection then solves a least-squares problem on the columns where xjk≥sjkx_j^k\ge s_j^kxjk​≥sjk​ and produces a candidate exact solution.

Formalization targets

Goal: Corollary 7

For integer data with bit length LLL and n≥1n\ge1n≥1, there is an absolute constant CCC and a finite predictor–corrector run that reaches, within

k≤Cn Lk\le C\sqrt n\,Lk≤Cn​L

iterations, an iterate whose termination output u=(y∗,x∗,τ∗,θ∗,s∗,κ∗)u=(y^*,x^*,\tau^*,\theta^*,s^*,\kappa^*)u=(y∗,x∗,τ∗,θ∗,s∗,κ∗) either has τ∗>0\tau^*>0τ∗>0 with x∗/τ∗x^*/\tau^*x∗/τ∗ optimal for (LP) and (y∗/τ∗,s∗/τ∗)(y^*/\tau^*,s^*/\tau^*)(y∗/τ∗,s∗/τ∗) optimal for (LD), or has τ∗=0\tau^*=0τ∗=0 with cTx∗<0c^Tx^*<0cTx∗<0 and (LD) infeasible, or −bTy∗<0-b^Ty^*<0−bTy∗<0 and (LP) infeasible.

Theorem 6

The same bound, with the conclusion that the termination output, rescaled to the normalization eTx+eTs+τ+κ−(n+1)θ=n+1e^Tx+e^Ts+\tau+\kappa-(n+1)\theta=n+1eTx+eTs+τ+κ−(n+1)θ=n+1, is a strictly self-complementary solution of (HLP).

Milestones

Proposition 1 (self-duality of skew-symmetric programs), Theorem 2 (ii), (iv), (v), Theorem 5 (ii), the two Mizuno–Todd–Ye estimates in the proof of Theorem 6, the predictor-step and corrector-step claims, the termination claim, the integrality and O(L)O(L)O(L) size of the (HLP) data, and Theorem 3 (i), (ii).

Significance

The result. Corollary 7 gives a single polynomial algorithm that decides the status of an arbitrary linear program. It returns optimal primal and dual solutions when they exist and an infeasibility certificate otherwise. It needs no Phase I, no big-MMM constant and no interior assumption, and its O(nL)O(\sqrt nL)O(n​L) iteration count matches the best bound known under those assumptions. Theorem 3 is the bridge: an exact strictly self-complementary solution of (HLP) determines the status of (LP) and (LD).

Formalizing it. The paper's result is proved; no machine-checked proof of it is known. The mission produces a formal account of the self-dual embedding, the central-path neighborhood analysis for (HLP), an exact finite-termination step from an approximate iterate, and the reading of a bit-length complexity bound with explicit quantifier order. The neighborhood estimates and the bit-length machinery are reusable for other interior-point and complexity results.

Difficulty

The per-step estimates are short calculations once the orthogonality dxTds+dτdκ=0d_x^Td_s+d_\tau d_\kappa=0dxT​ds​+dτ​dκ​=0 is available. The step that resists is termination. Geometric decrease of the gap reaches 2−O(L)2^{-O(L)}2−O(L) in O(nL)O(\sqrt nL)O(n​L) iterations, but turning such an iterate into an exact strictly self-complementary solution requires a quantitative separation: on N(1/2)\mathcal N(1/2)N(1/2), once the gap is below 2−O(L)2^{-O(L)}2−O(L), the comparison xj≥sjx_j\ge s_jxj​≥sj​ must identify the optimal partition and the least-squares projection must land in the positive orthant. That separation bound rests on determinant estimates for integer matrices (Hadamard-type bounds in terms of LLL) and on the strict complementarity of (HLP), neither of which comes from the iteration analysis itself. A second subtlety is that the algorithm is not a function: without a rank assumption the Newton system leaves dyd_ydy​ undetermined.

Formalization scope

  • Data for the complexity statements are integer matrices and vectors, cast to R\mathbb RR; all optimization objects are real. LLL is Schrijver's encoding size, ∑(1+⌈log⁡2(∣v∣+1)⌉)\sum(1+\lceil\log_2(|v|+1)\rceil)∑(1+⌈log2​(∣v∣+1)⌉) over the entries plus the dimensions, so L≥1L\ge1L≥1 whenever n≥1n\ge1n≥1.
  • Every O(⋅)O(\cdot)O(⋅) is pinned with an absolute constant chosen before mmm, nnn and the data: O(nL)O(\sqrt nL)O(n​L) as Cn LC\sqrt n\,LCn​L, 2−O(L)2^{-O(L)}2−O(L) as 2−C′L2^{-C'L}2−C′L, and O(L)O(L)O(L) as C⋅LC\cdot LC⋅L. The hypothesis n≥1n\ge1n≥1, implicit in the paper, is explicit.
  • The algorithm is a relation on finite runs: any solution of the Newton system may be used, and each predictor step taken before termination must attain the maximum in (13). The conclusion asserts a successful run and its output. Stopping at the successful iterate avoids requiring a later step whose maximum may not exist.
  • The termination projection is defined relationally (an output is built from a minimizer) and its existence is part of the conclusion. Theorem 6 is stated for the output rescaled to the normalization (9): the projection imposes only homogeneous constraints, so the unscaled output need not be feasible for (HLP).
  • "(LP) has a solution (feasible and bounded)" is read as "(LP) has an optimal solution". "An indication that (LP) or (LD) is infeasible" is the negative sign of cTx∗c^Tx^*cTx∗ or −bTy∗-b^Ty^*−bTy∗ together with the infeasibility it certifies, not the bare disjunction "one of them is infeasible".
  • "Optimal for (HLP)" means minimizing the objective over Fh\mathcal F_hFh​. It is not defined as θ=0\theta=0θ=0, which would make Theorem 2 (iv) definitional.
  • Norms are Euclidean and written out explicitly, since Lean's default norm on Rn\mathbb R^nRn is the sup norm.
  • (LP) and (LD) are built on the published general-form LP definitions (LinearOptimization_DualLP). The self-dual objects of the Vanderbei and Matoušek series are different embeddings and are not reused.

A complete development needs: skew-symmetric LP duality and strict complementarity (Goldman–Tucker) for (HLP), the Mizuno–Todd–Ye neighborhood calculus, and Hadamard-type bounds on integer determinants. Contributions to any milestone, or to these supporting libraries, are welcome.

Selected references

  • Y. Ye, M. J. Todd, S. Mizuno, An O(nL)O(\sqrt nL)O(n​L)-iteration homogeneous and self-dual linear programming algorithm, Mathematics of Operations Research 19(1), 53–67, 1994. https://doi.org/10.1287/moor.19.1.53
  • S. Mizuno, M. J. Todd, Y. Ye, On adaptive-step primal-dual interior-point algorithms for linear programming, Mathematics of Operations Research 18(4), 964–981, 1993. https://doi.org/10.1287/moor.18.4.964
  • S. Mehrotra, Y. Ye, Finding an interior point in the optimal face of linear programs, Mathematical Programming 62, 497–515, 1993. https://doi.org/10.1007/BF01585180
  • M. Kojima, S. Mizuno, A. Yoshise, A little theorem of the big M in interior point algorithms, Mathematical Programming 59, 361–375, 1993. https://doi.org/10.1007/BF01581253
  • N. Karmarkar, A new polynomial-time algorithm for linear programming, Combinatorica 4, 373–395, 1984. https://doi.org/10.1007/BF02579150
  • A. Schrijver, Theory of Linear and Integer Programming, Wiley, 1986.
22 thms2 active usersReviewed
Linear OptimizationOptimization·Captain: mikedeng1

An O(√nL)-Iteration Homogeneous and Self-Dual Linear Programming Algorithm 3: If (LP) and (LD) Have Interior Feasible Points, Every Self-Complementary Solution of (HLP) Has τ* > 0Research Paper

Motivation

Linear programming algorithms often compute a solution to an auxiliary problem before extracting a solution to the original primal and dual pair. For a homogeneous self-dual formulation, the extraction requires a positive scaling coordinate. If that coordinate vanishes, the same auxiliary solution may instead describe infeasibility or unboundedness. Ye, Todd, and Mizuno introduced a homogeneous self-dual linear program that can start from arbitrary positive primal and dual slack vectors, even when the original programs have no known feasible point (Ye–Todd–Mizuno 1994).

Their Theorem 3 concerns strictly self-complementary optimal solutions of the auxiliary program. Theorem 9 addresses a different question: under a regularity assumption on the original programs, does a general optimal solution of the auxiliary program still have a positive scaling coordinate? The distinction matters because optimality alone does not require every complementary pair to have a positive member. This mission formalizes the statement of Theorem 9 and the numbered identities that frame it.

Setting

Fix a real matrix A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n, a right-hand side b∈Rmb\in\mathbb R^mb∈Rm, and a cost vector c∈Rnc\in\mathbb R^nc∈Rn. The primal linear program (LP) minimizes cTxc^TxcTx subject to Ax=bAx=bAx=b and x≥0x\ge0x≥0. Its dual (LD) maximizes bTyb^TybTy subject to ATy≤cA^Ty\le cATy≤c; y∈Rmy\in\mathbb R^my∈Rm is unrestricted. The dual slack is s=c−ATys=c-A^Tys=c−ATy.

An interior feasible point of (LP) is an xxx with Ax=bAx=bAx=b and every xj>0x_j>0xj​>0. An interior feasible point of (LD) is a yyy with every component of c−ATyc-A^Tyc−ATy positive. “Interior” here is the paper's strict coordinatewise feasibility condition, not the topological interior of an equality-constrained set in ambient space. The existence of such a point implies ordinary feasibility for the corresponding program.

The paper builds an auxiliary program (HLP) from initial vectors x0>0x^0>0x0>0, s0>0s^0>0s0>0, and y0y^0y0. It uses the derived data

bˉ=b−Ax0,cˉ=c−ATy0−s0,zˉ=cTx0+1−bTy0.\bar b=b-Ax^0,\qquad \bar c=c-A^Ty^0-s^0,\qquad \bar z=c^Tx^0+1-b^Ty^0.bˉ=b−Ax0,cˉ=c−ATy0−s0,zˉ=cTx0+1−bTy0.

A point is a tuple (y,x,τ,θ,s,κ)(y,x,\tau,\theta,s,\kappa)(y,x,τ,θ,s,κ) with x,s,τ,κ≥0x,s,\tau,\kappa\ge0x,s,τ,κ≥0 and free y,θy,\thetay,θ. Its equality constraints are

Ax−bτ+bˉθ=0,s=−ATy+cτ−cˉθ,κ=bTy−cTx+zˉθ,−bˉTy+cˉTx−zˉτ=−(x0)Ts0−1.\begin{aligned} Ax-b\tau+\bar b\theta&=0,\\ s&=-A^Ty+c\tau-\bar c\theta,\\ \kappa&=b^Ty-c^Tx+\bar z\theta,\\ -\bar b^Ty+\bar c^Tx-\bar z\tau&=-(x^0)^Ts^0-1. \end{aligned}Ax−bτ+bˉθsκ−bˉTy+cˉTx−zˉτ​=0,=−ATy+cτ−cˉθ,=bTy−cTx+zˉθ,=−(x0)Ts0−1.​

The objective is to minimize ((x0)Ts0+1)θ((x^0)^Ts^0+1)\theta((x0)Ts0+1)θ. A feasible point is optimal when no feasible point has a smaller objective. The paper calls an optimal point self-complementary, whether or not its complementary pairs satisfy strict inequalities (p. 57, after Theorem 2(v)). After introducing the general construction, the paper fixes y0=0y^0=0y0=0 and x0=s0=ex^0=s^0=ex0=s0=e, the all-ones vector. That is the instance used in Theorem 9.

Formalization targets

Goal: Theorem 9

If both (LP) and (LD) have interior feasible points, then every self-complementary solution w∗=(y∗,x∗,τ∗,θ∗,s∗,κ∗)w^*=(y^*,x^*,\tau^*,\theta^*,s^*,\kappa^*)w∗=(y∗,x∗,τ∗,θ∗,s∗,κ∗) of this fixed (HLP) satisfies

τ∗>0.\tau^*>0.τ∗>0.

The theorem quantifies over every optimal point, including those that are not strictly self-complementary. The printed tuple writes θ∗=0\theta^*=0θ∗=0; Theorem 2(iv) entails that fact from optimality, so it is not an extra hypothesis in the goal (Theorem 9, p. 64).

Supporting targets

Theorem 2(iv) states that (HLP) has zero optimal value and, for every feasible point under arbitrary positive initial x0,s0x^0,s^0x0,s0, satisfies

((x0)Ts0+1)θ=xTs+τκ.((x^0)^Ts^0+1)\theta=x^Ts+\tau\kappa.((x0)Ts0+1)θ=xTs+τκ.

Corollary 4 states that a positive κ\kappaκ at an optimum under the fixed initialization entails infeasibility of (LP) or (LD). Equation (9) states the corresponding normalization identity

eTx+eTs+τ+κ−(n+1)θ=n+1.e^Tx+e^Ts+\tau+\kappa-(n+1)\theta=n+1.eTx+eTs+τ+κ−(n+1)θ=n+1.

These are separate milestone statements, each tied to its index and page in the paper (Theorem 2(iv), p. 57; equation (9), p. 58; Corollary 4, p. 59).

Significance

Theorem 9 says that the auxiliary model does not lose its positive scale at any optimum when the primal and dual programs are both strictly feasible. With τ∗>0\tau^*>0τ∗>0, the homogeneous primal and dual variables can be divided by τ∗\tau^*τ∗ to recover solutions in the original scale. The result applies even when the auxiliary optimum lacks strict complementarity; that is the additional coverage beyond the strictly self-complementary case of Theorem 3 (Ye–Todd–Mizuno 1994, pp. 58 and 64).

The mathematical result was proved in 1994. This mission's remaining work is a machine-checked proof of the stated regularity result and its supporting claims in the paper's specific (HLP) model. The definitions of the homogeneous feasible set, its slacks, and its optimality relation are reusable for the other results in the same paper. The full algorithm and complexity estimate belong to the other missions in this series.

Difficulty

The optimality condition controls the objective, and Theorem 2(iv) identifies that objective with a sum of complementarity terms. Those facts alone permit τ∗=0\tau^*=0τ∗=0; they do not force the scaling coordinate to be positive. Theorem 3's assertion for a strictly self-complementary point cannot be applied to an arbitrary optimal point, because its strict support condition may fail. The challenge is to use interior feasibility of both original programs to exclude all zero-scale optima while retaining the full set of HLP optima in the quantifier.

Formalization scope

The Lean model uses finite-dimensional real vectors indexed by Fin m and Fin n, a real matrix AAA, and a six-field HLP point in the paper's order (y,x,τ,θ,s,κ)(y,x,\tau,\theta,s,\kappa)(y,x,τ,θ,s,κ). The standard-form primal and dual feasible sets are reused from a published LP definition with the same minimization and maximization orientation. Paper-specific interior predicates and the homogeneous program are defined locally. Slack fields in an HLP point are constrained to equal their formulas, so they cannot be chosen independently to make a statement true.

The model first defines (HLP) for general x0,y0,s0x^0,y^0,s^0x0,y0,s0 and then substitutes the paper's choice (7). It treats self-complementarity as objective minimization over the whole feasible set. Defining it by θ=0\theta=0θ=0 or by a complementarity equation would erase the content of Theorem 2(iv). The objective and normalization constants are exact, including the n+1n+1n+1 in the fixed instance. No real supremum or infimum is used to define optimality; it is a direct comparison against every feasible point.

The dimensions m,nm,nm,n may be zero. Empty coordinatewise inequalities then have their usual vacuous meaning, but the equations remain in force. In particular the prescribed point (0,e,1,1,e,1)(0,e,1,1,e,1)(0,e,1,1,e,1) is strictly feasible for every A,b,cA,b,cA,b,c, as a separate sorry-free local verification checks. This excludes an empty-feasible-set reading of the HLP definitions. Contributions proving the three numbered milestones, the goal, or reusable finite-dimensional LP lemmas are within scope.

Selected references

  • Yinyu Ye, Michael J. Todd, and Shinji Mizuno, An O(nL)O(\sqrt nL)O(n​L)-Iteration Homogeneous and Self-Dual Linear Programming Algorithm, Mathematics of Operations Research 19(1), 53–67, 1994. DOI 10.1287/moor.19.1.53.
7 thms2 active usersReviewed
Dynamic ProgrammingOptimizationProbability·Captain: mikedeng1

Negative Dynamic Programming II: With Non-Positive Rewards on Borel Spaces, the Optimal Return Satisfies the Optimality EquationResearch Paper

Motivation

Negative dynamic programming is the study of infinite-horizon sequential decision problems in which every one-stage reward is non-positive and nothing is discounted. Equivalently, a non-negative cost accumulates forever and the controller minimizes its expected total. Stochastic shortest-path problems, optimal stopping with a cost per step, and inventory or replacement models without discounting all have this form. The total cost of a policy can be infinite, and none of the contraction arguments of discounted dynamic programming apply.

Blackwell settled the discounted case on Borel state and action spaces (Blackwell 1965). There the optimal return is Borel measurable and is the unique bounded solution of the optimality equation. Strauch's paper (Strauch 1966) treats the negative case on the same Borel model. One of its main results is that the optimal return still satisfies the optimality equation, even though it need not be Borel measurable.

Timeline. Blackwell (1965): discounted case, Borel spaces. Blackwell (1967, Positive dynamic programming): positive bounded case. Strauch (1966): negative case on Borel spaces. The optimal return is absolutely measurable, (p,ε)(p,\varepsilon)(p,ε)-optimal Markov policies exist, and the optimality equation holds. Bertsekas and Shreve (1978, Stochastic Optimal Control: The Discrete-Time Case) later recast the theory with universally measurable policies, a lower semianalytic optimal cost, and Bellman's equation J∗=T(J∗)J^* = T(J^*)J∗=T(J∗) under (P), (N) and (D).

Setting

The states SSS and actions AAA are non-empty Borel sets. A law of motion q(⋅∣s,a)q(\cdot\mid s,a)q(⋅∣s,a) is a probability kernel from S×AS\times AS×A to SSS. The return r(s,a,t)r(s,a,t)r(s,a,t) is a Borel function with −∞<r≤0-\infty < r \le 0−∞<r≤0 whose expectation ∫r(s,a,t) dq(t∣s,a)\int r(s,a,t)\,dq(t\mid s,a)∫r(s,a,t)dq(t∣s,a) is finite for every (s,a)(s,a)(s,a). A policy π=(π1,π2,… )\pi = (\pi_1,\pi_2,\dots)π=(π1​,π2​,…) draws the nnnth action from a kernel πn(⋅∣s1,a1,…,sn)\pi_n(\cdot\mid s_1,a_1,\dots,s_n)πn​(⋅∣s1​,a1​,…,sn​) that may depend on the whole history. A Markov policy (f1,f2,… )(f_1,f_2,\dots)(f1​,f2​,…) uses measurable maps fn:S→Af_n:S\to Afn​:S→A, and a stationary policy f(∞)f^{(\infty)}f(∞) uses one map at every stage. The expected return from the initial state sss is

I(π)(s)=∑n≥1Esπ r(sn,an,sn+1)∈[−∞,0],I(\pi)(s) = \sum_{n\ge1} E^\pi_s\, r(s_n,a_n,s_{n+1}) \in [-\infty,0],I(π)(s)=n≥1∑​Esπ​r(sn​,an​,sn+1​)∈[−∞,0],

and the optimal return is

v∗(s)=sup⁡πI(π)(s),v^*(s) = \sup_\pi I(\pi)(s),v∗(s)=πsup​I(π)(s),

the supremum over all policies. Write M(S)M(S)M(S) for the non-positive, extended real-valued Borel functions on SSS. For u∈M(S)u\in M(S)u∈M(S) and an action aaa,

Tau(s)=∫[r(s,a,t)+u(t)] dq(t∣s,a).T_a u(s) = \int \big[r(s,a,t) + u(t)\big]\,dq(t\mid s,a).Ta​u(s)=∫[r(s,a,t)+u(t)]dq(t∣s,a).

TTT denotes the same operator for a measurable rule fff in place of aaa, and U=sup⁡nTnU = \sup_n T_nU=supn​Tn​ for a Markov policy (f1,f2,… )(f_1,f_2,\dots)(f1​,f2​,…). A policy π∗\pi^*π∗ is (p,ε)(p,\varepsilon)(p,ε)-optimal, for a probability ppp on SSS, if p{I(π∗)≥v∗−ε}=1p\{I(\pi^*) \ge v^* - \varepsilon\} = 1p{I(π∗)≥v∗−ε}=1. The Lean development uses the same names: Problem, I, In, vstar, T, Ta, U, IsPEOptimal, Conserves.

Formalization targets

Goal: the optimality equation (Theorem 8.2, negative case)

v∗(s)=sup⁡a∈ATav∗(s)for all s∈S.v^*(s) = \sup_{a\in A} T_a v^*(s) \qquad\text{for all } s\in S.v∗(s)=a∈Asup​Ta​v∗(s)for all s∈S.

The equation involves no constants and no regularity hypotheses on v∗v^*v∗.

Milestones

  1. Theorem 5.2 (a)–(g): monotonicity, translation, sup-, limit- and selection properties of UUU.
  2. Theorem 6.1: if Uv≥vUv\ge vUv≥v for v∈M(S)v\in M(S)v∈M(S), some Markov policy generated from π^\hat\piπ^ has I(π)≥v−εI(\pi)\ge v-\varepsilonI(π)≥v−ε.
  3. Lemma 6.2: UUU conserves sup⁡nI(nπ)\sup_n I({}^n\pi)supn​I(nπ) and lim⁡nUnsup⁡nI(nπ)\lim_n U^n \sup_n I({}^n\pi)limn​Unsupn​I(nπ).
  4. Theorem 6.2: one Markov policy comes within ε\varepsilonε of the supremum of the returns of countably many Markov policies.
  5. Lemma 7.1, Lemma 7.2: measurability of (s,ν)↦∫u(s,x) dν(x)(s,\nu)\mapsto\int u(s,x)\,d\nu(x)(s,ν)↦∫u(s,x)dν(x), and Borel measurability of the set of pairs (s,eπ(s))(s, e_\pi(s))(s,eπ​(s)), where eπ(s)e_\pi(s)eπ​(s) is the law of the future under π\piπ.
  6. Theorem 7.1: v∗v^*v∗ is absolutely measurable.
  7. Theorem 8.1: for every ppp and ε>0\varepsilon>0ε>0 a (p,ε)(p,\varepsilon)(p,ε)-optimal Markov policy exists.

Optional extras: Corollary 6.1 and Theorems 6.3, 6.4, 6.5 and 8.4 (bounds and characterizations for Markov policies).

Significance

The result. The optimality equation is the entry point to every structural statement about optimal policies in the negative case. With it, a stationary policy whose rule attains the supremum in sup⁡aTav∗\sup_a T_a v^*supa​Ta​v∗ can be tested for optimality. Value iteration and policy improvement can be compared with v∗v^*v∗. The gap between the negative case and the discounted and positive cases can be located precisely: in the negative case v∗v^*v∗ satisfies the equation, but it need not be its unique or extremal solution. Along the way the paper proves that v∗v^*v∗ is absolutely measurable and that nearly optimal Markov policies exist for every initial distribution. These two facts are used repeatedly in later Borel-space dynamic programming.

Formalizing it. The results are proved; none is machine-checked. A formal development would contain the first Lean treatment of a total-reward Markov decision process on Borel spaces with possibly infinite returns. It would include the policy-dependent law of the future via Ionescu-Tulcea, the measurability of the optimal return over all randomized history-dependent policies, and the Bellman equation for a non-measurable value function. Bertsekas–Shreve's version of the optimality equation (universally measurable policies) appears on the platform as a separate open statement. It concerns a different policy class and is not the statement posed here.

Difficulty

Two steps of the obvious argument fail. First, the classical proof of the optimality equation picks, at each next state ttt, a policy that is ε\varepsilonε-optimal from ttt and concatenates. Without measurable selection this concatenation is not a policy. The set of ttt where a given policy is ε\varepsilonε-optimal need not be Borel, and v∗v^*v∗ itself need not be Borel measurable, so even ∫v∗ dq\int v^*\,dq∫v∗dq needs justification. Second, the contraction argument of the discounted case is unavailable. UUU does not contract, it conserves v+cv+cv+c along with vvv, and value iteration from 000 can converge to a function strictly above v∗v^*v∗. The paper's Example 6.1 shows that the limit of Un0U^n0Un0, the best return of generated Markov policies, and the best stationary return can all differ. Any argument has to work with policies that are only nearly optimal, and only outside sets of measure zero that depend on the initial distribution.

Formalization scope

  • States and actions are non-empty standard Borel types. Policies are the published Blackwell plans (DiscountedDP.Stationary.Plan): randomized and history-dependent, one Markov kernel per decision, with decisions numbered from 000 (Lean's π.κ n is the paper's πn+1\pi_{n+1}πn+1​). Markov policies are MarkovPlan; "π\piπ-generated" and G(π^)G(\hat\pi)G(π^) are the published IsGenerated and IsGeneratedPlan.
  • Only the negative case is formalized: r≤0r\le0r≤0 real-valued, qrqrqr integrable, β=1\beta=1β=1. The discounted and positive parts of Theorems 5.2, 7.1, 8.1 and 8.2, including the uniqueness and minimality clauses of Theorem 8.2, are not stated.
  • Returns take values in EReal and are computed as minus a lower Lebesgue integral (lintegral) of the non-negative loss. A Bochner integral is never used for a return: it would map −∞-\infty−∞ to 000 and make the goal false or vacuous.
  • v∗v^*v∗ is the supremum over all plans. It is not assumed measurable and is never replaced by a measurable modification. Tav∗T_a v^*Ta​v∗ is a lintegral of a possibly non-measurable function, which equals the completion integral because v∗v^*v∗ is absolutely measurable (Theorem 7.1).
  • Explicit readings of the page: the hypothesis u∈M(S)u\in M(S)u∈M(S) of each operator statement is IsNegM u. Theorem 5.2(b) assumes u+c∈M(S)u+c\in M(S)u+c∈M(S). "UUU conserves vvv" includes v∈M(S)v\in M(S)v∈M(S). Lemma 6.2 asserts that the limit defining vπv_\pivπ​ exists. Theorem 6.2 states ≥\ge≥ everywhere and >>> where sup⁡jI(πj)>−∞\sup_j I(\pi^j) > -\inftysupj​I(πj)>−∞ (the printed >>> fails where the supremum is −∞-\infty−∞). (p,ε)(p,\varepsilon)(p,ε)-optimality is "ppp-almost everywhere". Absolute measurability is NullMeasurable for every probability measure. P(X)P(X)P(X) carries the Giry σ-field. The extra Theorem 8.4 reads the printed "I(π)<uI(\pi) < uI(π)<u" as "≤\le≤" (the strict reading is false).
  • Reusable infrastructure: the negative model, the Ionescu-Tulcea law of the future (futureLaw), and the measurability lemmas for integrals against random measures. Contributions of measurable-selection and analytic-set results (projections of Borel sets are universally measurable; von Neumann selection) are welcome and needed.

Selected references

  • R. E. Strauch, Negative Dynamic Programming, Ann. Math. Statist. 37(4) (1966) 871–890. https://doi.org/10.1214/aoms/1177699369
  • D. Blackwell, Discounted Dynamic Programming, Ann. Math. Statist. 36(1) (1965) 226–235. https://doi.org/10.1214/aoms/1177700285
  • D. Blackwell, Positive Dynamic Programming, Proc. Fifth Berkeley Symp. Math. Statist. Probab. 1 (1967) 415–418. https://projecteuclid.org/euclid.bsmsp/1200512999
  • L. E. Dubins and L. J. Savage, How to Gamble If You Must, McGraw-Hill, 1965.
  • D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978. https://web.mit.edu/dimitrib/www/soc.html
21 thms2 active usersReviewed
ProbabilityStochastic Systems·Captain: mikedeng1

Understanding the Efficiency of Multi-Server Service Systems I: With Poisson Arrivals and Finitely Many Service-Time Values of Mean 1, the Number of Busy Servers in M/G/∞ Is Poisson(λ)Research Paper

Motivation

Call centers, hospital wards, telephone exchanges and server farms all face the same staffing question: given an arrival rate λ\lambdaλ, how many servers sss are needed to keep congestion at a fixed level? A widely used answer is the square-root staffing rule

s=λ+γλ,s = \lambda + \gamma\sqrt{\lambda},s=λ+γλ​,

where the grade of service γ>0\gamma > 0γ>0 sets the congestion level. It says that the safety capacity above the offered load grows like the square root of the load, which is the quantitative form of the economy of scale of large service systems.

Whitt (Management Science 38(5), 1992, pp. 708–723) explains the rule through an associated infinite-server (IS) model, in which every customer starts service immediately on arrival. If the number of busy servers NNN in the IS model is Poisson with mean λ\lambdaλ, its mean and variance are both λ\lambdaλ, so the event "more than sss servers busy" has roughly constant probability when s−λs - \lambdas−λ is a fixed multiple of λ\sqrt\lambdaλ​. The Poisson law of NNN is therefore the probabilistic fact on which the heuristic rests. This mission formalizes that fact as proved in §2.4–§2.5 of the paper: first for deterministic unit service times (M/D/∞), then for service times taking finitely many values with mean 111 (M/G/∞ with finite support).

Timeline:

  • The stationary number in system of M/G/∞ is classically known to be Poisson with mean λ⋅E[S]\lambda \cdot E[S]λ⋅E[S] for general service-time laws (Palm's theorem; see Gross et al., Fundamentals of Queueing Theory).
  • Halfin and Whitt (Operations Research 29, 1981) proved the heavy-traffic limit theorem that justifies square-root staffing for GI/M/s queues.
  • Whitt (1992) gave the elementary IS derivation formalized here, with the finite-support M/G/∞ case argued through splitting a Poisson stream into independent class streams.

Setting

Time is measured in units of the mean service time. Let T0,T1,T2,…T_0, T_1, T_2, \dotsT0​,T1​,T2​,… be i.i.d. exponential random variables with rate λ>0\lambda > 0λ>0, the interarrival times, and let τn=T0+⋯+Tn−1\tau_n = T_0 + \cdots + T_{n-1}τn​=T0​+⋯+Tn−1​ be the nnn-th arrival epoch. The arrival counting process A(t)A(t)A(t) is the number of n≥1n \ge 1n≥1 with τn≤t\tau_n \le tτn​≤t, the number of arrivals in (0,t](0, t](0,t]. This is a Poisson process of rate λ\lambdaλ.

Customers are numbered k=0,1,2,…k = 0, 1, 2, \dotsk=0,1,2,…; customer kkk arrives at τk+1\tau_{k+1}τk+1​, is served at once, and has service time DkD_kDk​. Following the paper (proof of Proposition 2.3, p. 712), an arrival at time ttt is counted and a departure at time ttt is not, so customer kkk is present at ttt iff τk+1≤t<τk+1+Dk\tau_{k+1} \le t < \tau_{k+1} + D_kτk+1​≤t<τk+1​+Dk​. The number of busy servers is

N(t)=#{k:τk+1≤t<τk+1+Dk}.N(t) = \#\{k : \tau_{k+1} \le t < \tau_{k+1} + D_k\}.N(t)=#{k:τk+1​≤t<τk+1​+Dk​}.

For the M/G/∞ case fix m≥1m \ge 1m≥1 classes with probabilities p1,…,pmp_1, \dots, p_mp1​,…,pm​ and values d1,…,dm≥0d_1, \dots, d_m \ge 0d1​,…,dm​≥0. Each customer carries a class label JkJ_kJk​, the labels are i.i.d. with P(Jk=i)=piP(J_k = i) = p_iP(Jk​=i)=pi​ and independent of the interarrival times, and Dk=dJkD_k = d_{J_k}Dk​=dJk​​. The class-iii busy count is Ni(t)=#{k:Jk=i, τk+1≤t<τk+1+di}N_i(t) = \#\{k : J_k = i,\ \tau_{k+1} \le t < \tau_{k+1} + d_i\}Ni​(t)=#{k:Jk​=i, τk+1​≤t<τk+1​+di​}.

Formalization targets

Goal: the M/G/∞ claim (§2.5, p. 713)

If ∑i=1mpidi=1\sum_{i=1}^m p_i d_i = 1∑i=1m​pi​di​=1 and t>max⁡idit > \max_i d_it>maxi​di​, then

P(N(t)=k)=e−λλkk!,k=0,1,2,…P\big(N(t) = k\big) = e^{-\lambda}\frac{\lambda^k}{k!}, \qquad k = 0, 1, 2, \dotsP(N(t)=k)=e−λk!λk​,k=0,1,2,…

The law depends on the service-time distribution only through its mean.

Milestones

  1. Proposition 2.3 (p. 712): with unit service times, N(t)=A(t)−A(t−1)N(t) = A(t) - A(t-1)N(t)=A(t)−A(t−1), pathwise.
  2. Proof of Proposition 2.4 (p. 712): for t≥1t \ge 1t≥1, A(t)−A(t−1)A(t) - A(t-1)A(t)−A(t−1) has the same law as A(1)A(1)A(1).
  3. Proposition 2.4 (p. 712): in M/D/∞ with unit service times, N(t)∼Poisson(λ)N(t) \sim \mathrm{Poisson}(\lambda)N(t)∼Poisson(λ) for each t>1t > 1t>1.
  4. §2.5, splitting (p. 713): the class-iii arrivals form independent Poisson streams of rates λpi\lambda p_iλpi​; stated as independence and Poisson laws of the class counts in one window (ai,bi](a_i, b_i](ai​,bi​] per class.
  5. §2.5, "Hence" (p. 713): for t>max⁡idit > \max_i d_it>maxi​di​, the Ni(t)N_i(t)Ni​(t) are independent, Ni(t)∼Poisson(λpidi)N_i(t) \sim \mathrm{Poisson}(\lambda p_i d_i)Ni​(t)∼Poisson(λpi​di​), and N(t)=∑iNi(t)N(t) = \sum_i N_i(t)N(t)=∑i​Ni​(t) almost surely.

A companion item, Proposition 2.1 (p. 710), states that (2) implies λ=s+γ2/2−γs+γ2/4\lambda = s + \gamma^2/2 - \gamma\sqrt{s + \gamma^2/4}λ=s+γ2/2−γs+γ2/4​ and s−γs≤λ≤s−γs+γ2/2s - \gamma\sqrt s \le \lambda \le s - \gamma\sqrt s + \gamma^2/2s−γs​≤λ≤s−γs​+γ2/2, connecting (2) to the utilization equation λ=s−γs\lambda = s - \gamma\sqrt sλ=s−γs​.

Significance

The goal is the step that turns the IS heuristic from a special case into a statement about general service: since N(t)N(t)N(t) is Poisson with mean λ\lambdaλ whatever the finite service-time law of mean 111, the square-root rule derived from M/D/∞ applies unchanged to M/G/∞, and the paper uses this to argue that sss-server congestion is nearly insensitive to the service distribution beyond its mean when sss is large.

The results are classical and proved; none has a machine-checked proof on Prove2Me. Formalizing them adds:

  • a Poisson process built from exponential interarrival times, with the stationary-increment property derived rather than assumed;
  • Poisson splitting (thinning by i.i.d. labels) with independence of the class streams, a tool reused throughout queueing and inventory theory;
  • the M/G/∞ Poisson law for discrete service times, complementing the open platform items ServiceParts.Palm.units_in_resupply_poisson_finite_time and ServiceParts.Palm.palm_theorem, which treat service times with a density.

The open item QueueingFundamentals.Foundations.poisson_count_cdf (the marginal law A(t)∼Poisson(λt)A(t) \sim \mathrm{Poisson}(\lambda t)A(t)∼Poisson(λt)) is related but distinct from milestone 2, which concerns the increment over (t−1,t](t-1, t](t−1,t].

Difficulty

The paper's arguments are short, but each hides a probabilistic fact that is not elementary from the definitions. The increment law of milestone 2 requires the memoryless property at the deterministic time t−1t - 1t−1: the residual time to the next arrival after t−1t-1t−1 must be shown exponential and independent of the past, which is a statement about a random index (the number of arrivals by t−1t-1t−1), not about a fixed interarrival time. Splitting (milestone 4) requires a joint computation over all classes at once: the class counts are built from the same arrival epochs, so their independence is a genuine property of Poisson processes, false for general renewal arrivals, and cannot be obtained one class at a time. The overlapping windows (t−di,t](t - d_i, t](t−di​,t] of different classes make this unavoidable.

Formalization scope

  • The arrival process is the published definition QueueingFundamentals.Foundations.ArrivalProcess: IsExpInterarrivals μ lam T (measurable, mutually independent, exponential with rate lam), arrivalTime, countingProcess. The Poisson process is not postulated through an increment-law axiom; a definition with such a field would make milestones 2 and 3 a projection and is ruled out.
  • The model IsMarkedPoisson adds measurable, i.i.d. class labels J : ℕ → Ω → Fin m with P(J k = i) = p i, independent of the interarrival sequence. Service time of customer k is d (J k). Labels, not values, distinguish classes, so equal d i are not merged.
  • Counts are Set.ncard, which is 000 on an infinite set. Milestone 1 carries the hypothesis that only finitely many arrivals occur by ttt, and the decomposition N(t)=∑iNi(t)N(t) = \sum_i N_i(t)N(t)=∑i​Ni​(t) is stated almost surely. Poisson laws are stated pointwise, P(X=k)=e−cck/k!P(X = k) = e^{-c}c^k/k!P(X=k)=e−cck/k!, avoiding pushforwards of possibly non-measurable maps.
  • Standing conventions: service rate 111; the system starts empty at time 000; arrival counted at ttt, departure not; "steady state" means the law at each fixed t>max⁡idit > \max_i d_it>maxi​di​, with no limit t→∞t \to \inftyt→∞; the paper's 1≤i≤n1 \le i \le n1≤i≤n is Fin m. The constraint ∑ipidi=1\sum_i p_i d_i = 1∑i​pi​di​=1 forces m≥1m \ge 1m≥1, and the label law forces pi≥0p_i \ge 0pi​≥0 and ∑ipi=1\sum_i p_i = 1∑i​pi​=1. Added hypotheses: di≥0d_i \ge 0di​≥0 (service times are nonnegative) and, in Proposition 2.1, γ>0\gamma > 0γ>0 (the paper's grade of service).
  • Infrastructure welcome: memorylessness of the Poisson process at a fixed time, Poisson thinning with independent marks, and the finite-sum version of Mathlib's IndepFun.hasLaw_add_poissonMeasure. These are reusable well beyond this mission.

Selected references

  • W. Whitt, Understanding the efficiency of multi-server service systems, Management Science 38(5):708–723, 1992. https://doi.org/10.1287/mnsc.38.5.708
  • S. Halfin and W. Whitt, Heavy-traffic limits for queues with many exponential servers, Operations Research 29(3):567–588, 1981. https://doi.org/10.1287/opre.29.3.567
  • W. Feller, An Introduction to Probability Theory and Its Applications, Vol. I, 3rd ed., Wiley, 1968.
  • D. Gross, J. F. Shortle, J. M. Thompson and C. M. Harris, Fundamentals of Queueing Theory, 4th ed., Wiley, 2008. https://doi.org/10.1002/9781118625651
8 thms2 active usersReviewed
AnalysisStochastic Systems·Captain: mikedeng1

The G/GI/N Queue in the Halfin–Whitt Regime 1: The Regulator Equation z(t) = x(t) + ∫₀ᵗ (z(t−s)+a)⁺ dB(s) Has a Unique Càdlàg Solution, Lipschitz on Bounded Intervals and Measurable in xResearch Paper

Motivation

The G/GI/NG/GI/NG/GI/N queue has NNN identical servers, a general arrival process, and independent service times with a common distribution FFF. In the Halfin–Whitt regime the number of servers and the offered load grow together, so that the fraction of delayed customers stays strictly between 000 and 111. This is the standard asymptotic model of large call centers and service systems (Halfin and Whitt, Operations Research 29, 1981, doi:10.1287/opre.29.3.567). For exponential service times the diffusion limit has been known since 1981; for general service distributions the queue length is no longer Markov, and its limit requires a different device.

Reed (Annals of Applied Probability 19, 2009, arXiv:0912.2837) supplied that device. The number in system QQQ satisfies a nonlinear convolution equation, (2.8) on p. 9 of the paper, in which the only nonlinearity is the term ∫0t(Q(t−s)−N)+ dF(s)\int_0^t (Q(t-s)-N)^+\,dF(s)∫0t​(Q(t−s)−N)+dF(s). Section 3 of the paper isolates that equation as a deterministic regulator map: a map that takes an input path to the unique solution of the equation. Its fluid limit (Theorem 4.1) and diffusion limit (Theorem 5.1) are both obtained by applying this map, through the continuous mapping theorem, to the limits of simpler free processes. The regulator map plays here the role that the one-sided reflection map plays in conventional heavy-traffic theory.

Timeline:

  • 1981. Halfin and Whitt: the diffusion limit for exponential service times.
  • 2000. Puhalskii and Reiman: the GI/PH/NGI/PH/NGI/PH/N case, with phase-type service (MR1778580).
  • 2004. Jelenković, Mandelbaum and Momčilović: deterministic service times (MR2074672).
  • 2009. Reed: general service times, via the regulator map of Proposition 3.1. This mission covers that proposition.

Setting

A path is a function x:[0,∞)→Rx:[0,\infty)\to\mathbb Rx:[0,∞)→R. It is càdlàg if it is right continuous everywhere and has a finite left limit at every t>0t>0t>0. D[0,∞)D[0,\infty)D[0,∞) is the set of càdlàg paths. For T≥0T\ge0T≥0 the supremum metric on [0,T][0,T][0,T] is ∥x∥T=sup⁡0≤t≤T∣x(t)∣\|x\|_T=\sup_{0\le t\le T}|x(t)|∥x∥T​=sup0≤t≤T​∣x(t)∣.

Let BBB be a cumulative distribution function on R\mathbb RR, that is, B(t)=μ((−∞,t])B(t)=\mu((-\infty,t])B(t)=μ((−∞,t]) for a probability measure μ\muμ, and let a∈Ra\in\mathbb Ra∈R. Write y+=max⁡(y,0)y^+=\max(y,0)y+=max(y,0). For an input x∈D[0,∞)x\in D[0,\infty)x∈D[0,∞), the regulator equation (3.1) asks for a path z∈D[0,∞)z\in D[0,\infty)z∈D[0,∞) with

z(t)=x(t)+∫[0,t](z(t−s)+a)+ dB(s),t≥0.z(t)=x(t)+\int_{[0,t]}\big(z(t-s)+a\big)^+\,dB(s),\qquad t\ge0 .z(t)=x(t)+∫[0,t]​(z(t−s)+a)+dB(s),t≥0.

The integral runs over the closed interval [0,t][0,t][0,t], so an atom of BBB at 000 counts. The regulator map φBa\varphi^a_BφBa​ sends xxx to the solution zzz. The paper applies it with B=FB=FB=F, the service-time distribution: a=−1a=-1a=−1 for the fluid-scaled queue and a=0a=0a=0 for the diffusion-scaled one.

The proof works with the operator ΨBa(u)(t)=∫[0,t](u(t−s)+a)+ dB(s)\Psi^a_B(u)(t)=\int_{[0,t]}(u(t-s)+a)^+\,dB(s)ΨBa​(u)(t)=∫[0,t]​(u(t−s)+a)+dB(s) and the successive approximations u0=0u_0=0u0​=0, un+1=x+ΨBa(un)u_{n+1}=x+\Psi^a_B(u_n)un+1​=x+ΨBa​(un​) of (A.3).

D[0,∞)D[0,\infty)D[0,∞) carries the Kolmogorov σ-algebra, the one generated by the evaluations x↦x(t)x\mapsto x(t)x↦x(t), t≥0t\ge0t≥0. In the Lean development the objects are IsCadlag, supNorm, Dpath, SolvesRegulator, psi and picard.

Formalization targets

Goal: Proposition 3.1

Assume μ({0})<1\mu(\{0\})<1μ({0})<1. Then there is a map φBa:D[0,∞)→D[0,∞)\varphi^a_B:D[0,\infty)\to D[0,\infty)φBa​:D[0,∞)→D[0,∞) with the following properties:

  • φBa(x)\varphi^a_B(x)φBa​(x) solves (3.1) for every xxx;
  • every càdlàg solution of (3.1) agrees with φBa(x)\varphi^a_B(x)φBa​(x) on [0,∞)[0,\infty)[0,∞);
  • for each T≥0T\ge0T≥0 there is a constant CTC_TCT​ with
∥φBa(x1)−φBa(x2)∥T≤CT ∥x1−x2∥Tfor all x1,x2∈D[0,∞);\|\varphi^a_B(x_1)-\varphi^a_B(x_2)\|_T\le C_T\,\|x_1-x_2\|_T\quad\text{for all } x_1,x_2\in D[0,\infty);∥φBa​(x1​)−φBa​(x2​)∥T​≤CT​∥x1​−x2​∥T​for all x1​,x2​∈D[0,∞);
  • φBa\varphi^a_BφBa​ is measurable for the Kolmogorov σ-algebra.

The constant CTC_TCT​ is not fixed. The proof gives (1−ε)−⌈T/δ⌉(1-\varepsilon)^{-\lceil T/\delta\rceil}(1−ε)−⌈T/δ⌉, but the goal asserts only its existence.

Milestones, in the order of the paper's proof

  1. Point mass at c>0c>0c>0, (A.1)–(A.2). Equation (3.1) is the recursion z=xz=xz=x on [0,c)[0,c)[0,c) and z(t)=x(t)+(z(t−c)+a)+z(t)=x(t)+(z(t-c)+a)^+z(t)=x(t)+(z(t−c)+a)+ for t≥ct\ge ct≥c. Its solution is unique, and ∥z1−z2∥t≤k∥x1−x2∥t\|z_1-z_2\|_t\le k\|x_1-x_2\|_t∥z1​−z2​∥t​≤k∥x1​−x2​∥t​ for (k−1)c≤t<kc(k-1)c\le t<kc(k−1)c≤t<kc.
  2. Uniqueness. Assume B(y+δ)−B(y)<ε<1B(y+\delta)-B(y)<\varepsilon<1B(y+δ)−B(y)<ε<1 for all y≥0y\ge0y≥0 and μ([0,δ])<ε\mu([0,\delta])<\varepsilonμ([0,δ])<ε. Then two càdlàg solutions agree on [0,∞)[0,\infty)[0,∞).
  3. Lipschitz continuity. Under the same assumption, ∥z2−z1∥kδ≤(1−ε)−k∥x2−x1∥kδ\|z_2-z_1\|_{k\delta}\le(1-\varepsilon)^{-k}\|x_2-x_1\|_{k\delta}∥z2​−z1​∥kδ​≤(1−ε)−k∥x2​−x1​∥kδ​ for every k≥1k\ge1k≥1.
  4. Existence. Under the same assumption, the successive approximations converge uniformly on every [0,T][0,T][0,T] to a càdlàg solution.
  5. Measurability of ΨBa\Psi^a_BΨBa​. ΨBa\Psi^a_BΨBa​ maps càdlàg paths to càdlàg paths, and u↦ΨBa(u)(t)u\mapsto\Psi^a_B(u)(t)u↦ΨBa​(u)(t) is measurable for each t≥0t\ge0t≥0.
  6. Example 1. For unit deterministic service times, the fluid equation (4.7) has the unique solution Qˉ(t)=1+t−⌊t⌋\bar Q(t)=1+t-\lfloor t\rfloorQˉ​(t)=1+t−⌊t⌋.
  7. Proof of Corollary 5.1. Take equilibrium initial conditions. The input of (4.7) is then identically 111, and Qˉ≡1\bar Q\equiv1Qˉ​≡1 is the unique solution.

Significance

Proposition 3.1 is the deterministic core of the paper. Uniqueness makes the queue length a well-defined function of its free process. Lipschitz continuity in the topology of uniform convergence on compacts carries convergence of the inputs over to convergence of the outputs. Measurability is needed because the inputs are random: it makes the output a random element of D[0,∞)D[0,\infty)D[0,∞), so that the continuous mapping theorem applies. Without the proposition neither Theorem 4.1 nor Theorem 5.1 can be stated in the form the paper gives. Example 1 and Corollary 5.1 are the two explicit solutions the paper extracts from it: a periodic, discontinuous sawtooth, and a constant.

The proposition is proved in the paper's Appendix (pp. 32–36). As far as the platform's records show, none of it has been formalized. The mission produces a machine-checked version with every convention fixed. It also corrects the statement: as printed, the proposition fails when BBB is the unit mass at 000, because the equation then reads z(t)=x(t)+(z(t)+a)+z(t)=x(t)+(z(t)+a)^+z(t)=x(t)+(z(t)+a)+. With a=0a=0a=0 and x≡1x\equiv1x≡1 this has no solution. The goal therefore carries the hypothesis μ({0})<1\mu(\{0\})<1μ({0})<1. That hypothesis holds for every service distribution of mean 111 on [0,∞)[0,\infty)[0,∞), which is the only case the paper uses. It also covers the mixed cases that fall between the two cases of the printed proof, such as an atom at 000 together with mass elsewhere.

Theorems 4.1 and 5.1 themselves, which are weak convergence in D[0,∞)D[0,\infty)D[0,∞) with the Skorohod J1J_1J1​ topology, are not part of this mission.

Difficulty

The equation is a Volterra equation with a nonlinear but 111-Lipschitz integrand. The first idea is to treat it as a contraction in ∥⋅∥T\|\cdot\|_T∥⋅∥T​. That fails: the kernel BBB has total mass 111, so on [0,T][0,T][0,T] the operator ΨBa\Psi^a_BΨBa​ is only nonexpansive, not contractive. The contraction has to be recovered locally, from windows of length δ\deltaδ on which BBB puts mass less than 111. This works only if such windows exist, and they do not exist when BBB is a point mass at 000.

Atoms are the second difficulty. With atoms, t↦ΨBa(u)(t)t\mapsto\Psi^a_B(u)(t)t↦ΨBa​(u)(t) is càdlàg but not continuous, and the closed-interval convention matters at every step. The third is measurability. The map u↦∫(u(t−s)+a)+ dB(s)u\mapsto\int(u(t-s)+a)^+\,dB(s)u↦∫(u(t−s)+a)+dB(s) is not continuous in uuu for the Skorohod topology when BBB has atoms, so the paper splits BBB into its continuous and discrete parts.

Formalization scope

  • Paths. A path is ℝ → ℝ, and only its values on [0,∞)[0,\infty)[0,∞) are constrained or read. Every equation is asserted for t≥0t\ge0t≥0, and every uniqueness claim is equality on [0,∞)[0,\infty)[0,∞) (Set.EqOn … (Set.Ici 0)). D[0,∞)D[0,\infty)D[0,∞) is the structure Dpath of càdlàg paths.
  • Integrals. BBB is a probability measure μ\muμ on R\mathbb RR. ∫0t⋯dB(s)\int_0^t\cdots dB(s)∫0t​⋯dB(s) is the integral over the closed interval Set.Icc 0 t, so it includes an atom at 000, and mass on (−∞,0)(-\infty,0)(−∞,0) never enters.
  • Explicit readings of the paper's phrases.
    • "Unique solution in D[0,∞)D[0,\infty)D[0,∞)" means unique among càdlàg paths, up to equality on [0,∞)[0,\infty)[0,∞).
    • "Lipschitz continuous in the topology of uniform convergence over bounded intervals" means ∀T ∃CT ∀x1,x2\forall T\ \exists C_T\ \forall x_1,x_2∀T ∃CT​ ∀x1​,x2​. The constant is chosen before the inputs.
    • "Measurable with respect to the Borel σ-field generated by the Skorohod J1J_1J1​ topology" means measurable for the Kolmogorov σ-algebra generated by the evaluations at times t≥0t\ge0t≥0. The paper uses this identification on p. 35, and it is Theorem 16.6 of Billingsley (1999). J1J_1J1​ is not defined.
    • "Uniform convergence" in the existence proof means ∥un−u⋆∥T→0\|u_n-u^\star\|_T\to0∥un​−u⋆∥T​→0 for every TTT.
  • Added hypothesis in the goal: μ({0})<1\mu(\{0\})<1μ({0})<1 (see Significance).
  • Window conditions in milestones 2–4. These are the paper's B(y+δ)−B(y)<εB(y+\delta)-B(y)<\varepsilonB(y+δ)−B(y)<ε for y≥0y\ge0y≥0, plus μ([0,δ])<ε\mu([0,\delta])<\varepsilonμ([0,δ])<ε for the first window, which the proof uses as "B(δ)<εB(\delta)<\varepsilonB(δ)<ε".
  • Junk values. The real supremum ∥⋅∥T\|\cdot\|_T∥⋅∥T​ and the Bochner integral take junk values (zero) on unbounded or non-integrable data. Every statement applies them only to càdlàg paths, which are bounded and measurable on [0,T][0,T][0,T]. This is also why solutions are required to be càdlàg: a solution taken among arbitrary functions could exploit the zero value of a non-integrable integral. Likewise, the goal cannot be satisfied by a φ\varphiφ whose values solve (3.1) only vacuously, and cannot be satisfied by dropping the càdlàg requirement on the output.
  • Printed slips corrected in the Lean and disclosed in the items:
    • (A.2)'s step "k<t≤(k+1)ck<t\le(k+1)ck<t≤(k+1)c" means kc≤t<(k+1)ckc\le t<(k+1)ckc≤t<(k+1)c;
    • (A.3) "for n≥1n\ge1n≥1" starts at n=0n=0n=0;
    • (4.18) has Qˉ(t)\bar Q(t)Qˉ​(t) on the right where (4.7) gives Qˉ(t−1)\bar Q(t-1)Qˉ​(t−1);
    • Corollary 5.1 cites "Theorem 5.1 of Section 4", meaning Theorem 4.1.

Infrastructure. A complete development needs the following, all reusable beyond this mission:

  • càdlàg paths on a half-line and their boundedness on compacts;
  • Lebesgue–Stieltjes convolution integrals of càdlàg paths against a probability measure;
  • the Kolmogorov σ-algebra on path space.

The related platform objects are of other shapes:

  • ChenWhitt93.Reflection.Basic (IsCadlagOn, vector-valued paths on [0,T][0,T][0,T]) and EthierKurtz_HasCadlagPaths (processes indexed by R≥0\mathbb R_{\ge0}R≥0​) define càdlàg paths in other settings.
  • BellmanDP.Inventory.renewal_equation_exists_unique is a linear renewal equation with a density kernel of mass below 111.

Contributions are welcome on any milestone, in any order. The windowed estimates (milestones 2–4) and the measurability step (milestone 5) are independent of each other.

Selected references

  • J. Reed, The G/GI/N queue in the Halfin–Whitt regime, Annals of Applied Probability 19(6), 2009, 2211–2269. arXiv:0912.2837v1, doi:10.1214/09-AAP609
  • S. Halfin, W. Whitt, Heavy-traffic limits for queues with many exponential servers, Operations Research 29(3), 1981, 567–588. doi:10.1287/opre.29.3.567
  • A. A. Puhalskii, M. I. Reiman, The multiclass GI/PH/N queue in the Halfin–Whitt regime, Advances in Applied Probability 32, 2000, 564–595. MR1778580
  • P. Jelenković, A. Mandelbaum, P. Momčilović, Heavy traffic limits for queues with many deterministic servers, Queueing Systems 47, 2004, 53–69. MR2074672
  • P. Billingsley, Convergence of Probability Measures, 2nd ed., Wiley, 1999, Chapter 16. doi:10.1002/9780470316962
13 thms2 active usersReviewed
Linear OptimizationOptimizationTheoretical Computer Science·Captain: mikedeng1

Fast Approximation Algorithms for Fractional Packing and Covering Problems 2: An ε-Relaxed Decision Procedure for Fractional Covering Using O(m + ρ log² m + ε⁻²ρ log(m/ε)) Oracle CallsResearch Paper

Motivation

Many linear programs that arise in combinatorial optimization ask only whether a convex set contains a point satisfying a family of nonnegative linear constraints. In the fractional covering problem the constraints have the form Ax≥bAx\ge bAx≥b with A≥0A\ge 0A≥0: the fractional relaxation of set cover, the Held–Karp lower bound for the travelling salesman problem, and the cutting-stock relaxation all have this shape. General-purpose LP methods solve such problems exactly but slowly. Plotkin, Shmoys and Tardos showed that when a fast subroutine can optimize a linear function over the convex set, a Lagrangean-relaxation scheme with an exponential potential finds an approximate solution with a number of subroutine calls that depends on a width parameter and on the accuracy, not on the dimension of the set (Plotkin, Shmoys, Tardos, Cornell ORIE TR 999, 1992; journal version Math. Oper. Res. 20(2), 1995).

The covering half of that paper (§3) is the object of this mission. It is the template for later covering and mixed packing–covering solvers, including those of Garg and Könemann (SIAM J. Comput. 2007) and Young (FOCS 2001).

Setting

Fix integers m≥1m\ge1m≥1, nnn. Let AAA be a real m×nm\times nm×n matrix with nonnegative entries and rows a1,…,ama_1,\dots,a_ma1​,…,am​, write aix=∑jAijxja_ix=\sum_j A_{ij}x_jai​x=∑j​Aij​xj​, let b∈Rmb\in\mathbb R^mb∈Rm with b>0b>0b>0, and let P⊆RnP\subseteq\mathbb R^nP⊆Rn be a nonempty convex set contained in the nonnegative orthant.

  • COVERING asks whether there is x∈Px\in Px∈P with Ax≥bAx\ge bAx≥b; such an xxx is an exact solution. For ε>0\varepsilon>0ε>0, an ε\varepsilonε-approximate solution is x∈Px\in Px∈P with Ax≥(1−ε)bAx\ge(1-\varepsilon)bAx≥(1−ε)b.
  • For x∈Rnx\in\mathbb R^nx∈Rn, λ(x)=min⁡iaix/bi\lambda(x)=\min_i a_ix/b_iλ(x)=mini​ai​x/bi​ is the largest λ\lambdaλ with Ax≥λbAx\ge\lambda bAx≥λb, and λ∗=max⁡{λ(x):x∈P}\lambda^*=\max\{\lambda(x):x\in P\}λ∗=max{λ(x):x∈P}. A point x∈Px\in Px∈P is ε\varepsilonε-optimal when λ(x)≥(1−ε)λ∗\lambda(x)\ge(1-\varepsilon)\lambda^*λ(x)≥(1−ε)λ∗.
  • The width is max⁡imax⁡x∈Paix/bi\max_i\max_{x\in P}a_ix/b_imaxi​maxx∈P​ai​x/bi​; a number ρ>0\rho>0ρ>0 with aix≤ρ bia_ix\le\rho\,b_iai​x≤ρbi​ for all x∈Px\in Px∈P and all iii is a width bound.
  • Subroutine (7) receives y∈Rmy\in\mathbb R^my∈Rm, y≥0y\ge0y≥0, and returns x~∈P\tilde x\in Px~∈P maximizing ytAxy^tAxytAx over PPP; CC(y)C_{\mathcal C}(y)CC​(y) is that maximum.
  • For α>0\alpha>0α>0, the dual solution corresponding to xxx is yi=1bie−αaix/biy_i=\frac1{b_i}e^{-\alpha a_ix/b_i}yi​=bi​1​e−αai​x/bi​, and the potential is Φ=ytb=∑ie−αaix/bi\Phi=y^tb=\sum_ie^{-\alpha a_ix/b_i}Φ=ytb=∑i​e−αai​x/bi​.
  • The relaxed optimality conditions are (C1)(\mathcal C1)(C1): (1+ε)λ ytb≥ytAx(1+\varepsilon)\lambda\,y^tb\ge y^tAx(1+ε)λytb≥ytAx, and (C2)(\mathcal C2)(C2): CC(y)−ytAx≤ε (CC(y)+ytb)C_{\mathcal C}(y)-y^tAx\le\varepsilon\,(C_{\mathcal C}(y)+y^tb)CC​(y)−ytAx≤ε(CC​(y)+ytb).
  • IMPROVE-COVER(x,ε)(x,\varepsilon)(x,ε) (Figure 3) sets λ0=λ(x)\lambda_0=\lambda(x)λ0​=λ(x), α=4λ0−1ε−1ln⁡(4mε−1)\alpha=4\lambda_0^{-1}\varepsilon^{-1}\ln(4m\varepsilon^{-1})α=4λ0−1​ε−1ln(4mε−1) and σ=ε/(4αρ)\sigma=\varepsilon/(4\alpha\rho)σ=ε/(4αρ); while λ(x)≤2λ0\lambda(x)\le2\lambda_0λ(x)≤2λ0​ and C2\mathcal C2C2 fails, it moves xxx to (1−σ)x+σx~(1-\sigma)x+\sigma\tilde x(1−σ)x+σx~, x~\tilde xx~ the subroutine's answer for the current dual solution.
  • The covering algorithm obtains a start with Ax≥1mbAx\ge\frac1mbAx≥m1​b from mmm subroutine calls, calls IMPROVE-COVER with ε=1/6\varepsilon=1/6ε=1/6 until C2\mathcal C2C2 holds or an exact solution appears, then halves ε\varepsilonε phase by phase.

The Lean names match: rowVal, lam, WidthBound, IsMaxOracle, C1, C2, dualY, potential, improveCover, initCover, coverAlgorithm, in the namespace FracPackCover.Covering.

Formalization targets

Goal: Theorem 3.7 (p. 21)

For every instance as above, every width bound ρ\rhoρ, every exact maximization oracle and every 0<ε0<10<\varepsilon_0<10<ε0​<1, the covering algorithm stops after at most

N=m+(⌈log⁡2m⌉+1)(2+4320 ρln⁡(24m))+2⌈log⁡2ε0−1⌉+9408 ρ ε0−2ln⁡24mε0N=m+\big(\lceil\log_2m\rceil+1\big)\big(2+4320\,\rho\ln(24m)\big)+2\lceil\log_2\varepsilon_0^{-1}\rceil+9408\,\rho\,\varepsilon_0^{-2}\ln\frac{24m}{\varepsilon_0}N=m+(⌈log2​m⌉+1)(2+4320ρln(24m))+2⌈log2​ε0−1​⌉+9408ρε0−2​lnε0​24m​

calls to subroutine (7), and either returns x∈Px\in Px∈P with Ax≥(1−ε0)bAx\ge(1-\varepsilon_0)bAx≥(1−ε0​)b, or reports that no x∈Px\in Px∈P has Ax≥bAx\ge bAx≥b, correctly. This is the paper's O(m+ρlog⁡2m+ε−2ρlog⁡(mε−1))O(m+\rho\log^2m+\varepsilon^{-2}\rho\log(m\varepsilon^{-1}))O(m+ρlog2m+ε−2ρlog(mε−1)) with the constants of its proof.

Milestones

In the order the proof uses them:

  • Lemma 3.1: C1\mathcal C1C1 and C2\mathcal C2C2 imply that no exact solution exists if λ≤1−3ε\lambda\le1-3\varepsilonλ≤1−3ε, and that xxx is 3ε3\varepsilon3ε-optimal if λ≥1−3ε\lambda\ge1-3\varepsilonλ≥1−3ε.
  • Lemma 3.2: if α≥2λ−1ε−1ln⁡(4mε−1)\alpha\ge2\lambda^{-1}\varepsilon^{-1}\ln(4m\varepsilon^{-1})α≥2λ−1ε−1ln(4mε−1), the dual solution corresponding to xxx satisfies C1\mathcal C1C1.
  • Lemma 3.3: while C2\mathcal C2C2 fails, a step of size σ≤ε/(4αρ)\sigma\le\varepsilon/(4\alpha\rho)σ≤ε/(4αρ) lowers the potential: Φ−Φ^≥εασΦ\Phi-\hat\Phi\ge\varepsilon\alpha\sigma\PhiΦ−Φ^≥εασΦ.
  • Lemma 3.4: during IMPROVE-COVER, λ≥34λ0\lambda\ge\frac34\lambda_0λ≥43​λ0​.
  • Theorem 3.5: one call of IMPROVE-COVER makes at most 2+20ρε−3ln⁡(4m/ε)2+20\rho\varepsilon^{-3}\ln(4m/\varepsilon)2+20ρε−3ln(4m/ε) oracle calls, and at most 2+196ρε−2ln⁡(4m/ε)2+196\rho\varepsilon^{-2}\ln(4m/\varepsilon)2+196ρε−2ln(4m/ε) from a 6ε6\varepsilon6ε-optimal start with ε≤1/12\varepsilon\le1/12ε≤1/12.
  • Lemma 3.6: mmm oracle calls give x∈Px\in Px∈P with Ax≥1mbAx\ge\frac1mbAx≥m1​b, or prove that no exact solution exists.

Significance

Theorem 3.7 says that approximate fractional covering is no harder, in subroutine calls, than about ρε−2log⁡(m/ε)\rho\varepsilon^{-2}\log(m/\varepsilon)ρε−2log(m/ε) linear optimizations over PPP, plus lower-order terms in mmm. In §6 of the paper this yields fast approximation algorithms for covering-type relaxations such as the Held–Karp bound and the bin-packing and cutting-stock relaxations, where PPP is a product of simple sets and the subroutine is a minimum-spanning-tree or knapsack computation. The result also certifies infeasibility: when the algorithm reports that no exact solution exists, the dual vector at hand proves it.

The result has been proved since 1991 and has been reproved in several later frameworks. As far as is known, it has not been machine-checked. A formal development contributes the explicit constants and a precise statement of the driver, which the paper gives only in prose. It also provides a reusable Lean account of exponential-potential methods with an optimization oracle.

Difficulty

The obvious argument tracks the potential Φ\PhiΦ and stops when it is small. This does not work directly, because α\alphaα is tied to λ0\lambda_0λ0​, and the guarantee C1\mathcal C1C1 depends on λ\lambdaλ staying close to λ0\lambda_0λ0​ throughout. Lemma 3.4 controls that, and it is a statement about the reachable states of a while loop, not about an arbitrary point. Two further points are delicate. Unlike packing, condition C2\mathcal C2C2 is not scaled by λ\lambdaλ, so C1\mathcal C1C1 and C2\mathcal C2C2 give ε\varepsilonε-optimality only when λ\lambdaλ is near 111; the first phase must first raise λ\lambdaλ from 1/m1/m1/m by repeated doubling. And the cost of ε\varepsilonε-scaling is bounded only because each phase starts from a 6ε6\varepsilon6ε-optimal point, which requires carrying Lemma 3.1 across phase boundaries. The bookkeeping that turns per-call bounds into a single explicit NNN, over a fuel-bounded run, is substantial.

Formalization scope

Rows are Fin m with [NeZero m], coordinates Fin n; AAA is a Matrix (Fin m) (Fin n) ℝ; PPP is a Set (Fin n → ℝ), convex, nonempty and in the nonnegative orthant. λ(x)\lambda(x)λ(x) is a Finset.inf' over the rows. Conventions committed to:

  • Width. ρ\rhoρ is any upper bound with ρ>0\rho>0ρ>0, not a supremum; the theorems hold for every such bound, the exact width included.
  • Oracle. Subroutine (7) is a function that, for every y≥0y\ge0y≥0, returns a maximizer of ytAxy^tAxytAx over PPP; every theorem quantifies over all such functions. Box (7) of the report prints "min", but every use maximizes; the maximizer reading is adopted.
  • Optimality without λ∗\lambda^*λ∗. "xxx is cεc\varepsiloncε-optimal" is stated as (1−cε)λ(x′)≤λ(x)(1-c\varepsilon)\lambda(x')\le\lambda(x)(1−cε)λ(x′)≤λ(x) for every x′∈Px'\in Px′∈P.
  • Runs. IMPROVE-COVER and the driver are fuel-bounded functions returning some (result, oracle calls) when they stop within the fuel. Each while-test that reaches the C2\mathcal C2C2 check costs one oracle call; the loop body reuses that answer. The goal asserts that the run with fuel ⌈N⌉\lceil N\rceil⌈N⌉ stops; it does not assume termination.
  • Driver. The prose of pp. 20–21 is written down as initCover, firstPhase and scalingPhases with εk=162−k\varepsilon_k=\frac16 2^{-k}εk​=61​2−k.
  • Constants replacing O(⋅)O(\cdot)O(⋅). Theorem 3.5: 2+20ρε−3ln⁡(4m/ε)2+20\rho\varepsilon^{-3}\ln(4m/\varepsilon)2+20ρε−3ln(4m/ε) and 2+196ρε−2ln⁡(4m/ε)2+196\rho\varepsilon^{-2}\ln(4m/\varepsilon)2+196ρε−2ln(4m/ε) oracle calls. Theorem 3.7: the NNN above.
  • Implicit hypotheses made explicit. y≠0y\ne0y=0 and ε<13\varepsilon<\frac13ε<31​ in Lemma 3.1; λ>0\lambda>0λ>0 in Lemmas 3.2–3.4 and Theorem 3.5; σ≥0\sigma\ge0σ≥0 in Lemma 3.3.
  • Misprint. Theorem 3.5's second sentence names IMPROVE-PACKING; it is stated for IMPROVE-COVER.

A trivializing formalization is ruled out: the goal requires the run to return an outcome within the stated number of oracle calls, for every exact oracle and every width bound, and each outcome must be correct.

A complete development needs elementary real analysis (the second-order bound ex+δ≤ex+δex+ε2∣δ∣exe^{x+\delta}\le e^x+\delta e^x+\frac\varepsilon2|\delta|e^xex+δ≤ex+δex+2ε​∣δ∣ex for ∣δ∣≤ε/4|\delta|\le\varepsilon/4∣δ∣≤ε/4), geometric-decay counting arguments, and induction over fuel-bounded loops. The potential-decrease and termination lemmas are reusable for the packing and general missions of the same paper. Proofs of any milestone, and alternative arguments with better constants, are welcome.

Selected references

  • S. A. Plotkin, D. B. Shmoys, É. Tardos, Fast Approximation Algorithms for Fractional Packing and Covering Problems, Cornell University School of ORIE Technical Report No. 999, February 1992. https://core.ac.uk/download/79020349.pdf
  • S. A. Plotkin, D. B. Shmoys, É. Tardos, Fast Approximation Algorithms for Fractional Packing and Covering Problems, Mathematics of Operations Research 20(2), 257–301, 1995. https://doi.org/10.1287/moor.20.2.257
  • N. Garg, J. Könemann, Faster and Simpler Algorithms for Multicommodity Flow and Other Fractional Packing Problems, SIAM Journal on Computing 37(2), 630–652, 2007. https://doi.org/10.1137/S0097539704446232
  • N. E. Young, Sequential and Parallel Algorithms for Mixed Packing and Covering, Proc. 42nd IEEE FOCS, 538–546, 2001. https://arxiv.org/abs/cs/0110040
10 thms2 active usersReviewed
Convex OptimizationOptimization·Captain: mikedeng1

A Dual Approach to Solving Nonlinear Programming Problems by Unconstrained Optimization 2: For a Normal Convex Program and Any Dual Optimal ȳ, x̄ Is Optimal iff x̄ Minimizes L_r(·, ȳ)Research Paper

Motivation

Lagrangian duality turns a constrained minimization problem into the maximization of a dual function over multipliers. For convex programs the duality is clean: under mild conditions the dual optimal value equals the primal one, and an optimal multiplier vector yˉ\bar yyˉ​ exists. Computationally, however, the ordinary Lagrangian has a well-known defect. Knowing an optimal yˉ\bar yyˉ​ does not tell where the primal optimum is, because the minimizers of x↦L0(x,yˉ)x \mapsto L_0(x, \bar y)x↦L0​(x,yˉ​) over XXX typically include points that are not optimal and not even feasible. A linear program is the extreme case: L0(⋅,yˉ)L_0(\cdot, \bar y)L0​(⋅,yˉ​) is then often constant.

The penalty Lagrangian (also called the augmented Lagrangian) of Hestenes, Powell and Rockafellar repairs this defect. R. T. Rockafellar's 1973 paper Math. Programming 5, 354–373 develops its duality theory for convex programs in an arbitrary real vector space. This mission formalizes the "exactness" part of that theory, §3 of the paper: for r>0r > 0r>0, minimizing the penalty Lagrangian at an optimal multiplier gives exactly the optimal solutions of the original problem. The paper puts it as "a strong property whose well-known absence for L0L_0L0​ has been a serious impediment to computational approaches based on duality" (p. 362). Together with the smoothness of the dual function (Theorem 3.2, another mission of this series), this property is what justifies the method of multipliers as an algorithm for constrained optimization.

Timeline. Hestenes (1969) and Powell (1969) proposed the multiplier method for equality constraints. Rockafellar (1973, this paper) gave the inequality-constrained penalty Lagrangian LrL_rLr​ below and its convex duality theory. Bertsekas's monograph Constrained Optimization and Lagrange Multiplier Methods (1982) systematized the theory.

Setting

Let EEE be a real vector space, X⊆EX \subseteq EX⊆E a nonempty convex set, and f0,f1,…,fm:X→Rf_0, f_1, \dots, f_m : X \to \mathbb Rf0​,f1​,…,fm​:X→R convex functions. The problem is

(P)minimize f0(x) over x∈Xsubject to fi(x)≤0, i=1,…,m.\text{(P)}\qquad \text{minimize } f_0(x) \text{ over } x \in X \quad\text{subject to } f_i(x) \le 0,\ i = 1, \dots, m.(P)minimize f0​(x) over x∈Xsubject to fi​(x)≤0, i=1,…,m.

A point is feasible if it lies in XXX and satisfies the constraints. The optimal value "inf in (P)" is the infimum of f0f_0f0​ over the feasible points, an element of [−∞,+∞][-\infty, +\infty][−∞,+∞]. An optimal solution is a feasible xˉ\bar xxˉ with f0(xˉ)≤f0(x)f_0(\bar x) \le f_0(x)f0​(xˉ)≤f0​(x) for every feasible xxx.

For y∈Rmy \in \mathbb R^my∈Rm (no sign restriction), θ(t)=max⁡{0,t}\theta(t) = \max\{0, t\}θ(t)=max{0,t} and r>0r > 0r>0, the penalty Lagrangian is

Lr(x,y)=f0(x)+14r∑i=1m[θ(yi+2rfi(x))2−yi2].L_r(x, y) = f_0(x) + \frac{1}{4r}\sum_{i=1}^m \big[\theta(y_i + 2 r f_i(x))^2 - y_i^2\big].Lr​(x,y)=f0​(x)+4r1​i=1∑m​[θ(yi​+2rfi​(x))2−yi2​].

The ordinary Lagrangian is L0(x,y)=f0(x)+∑iyifi(x)L_0(x, y) = f_0(x) + \sum_i y_i f_i(x)L0​(x,y)=f0​(x)+∑i​yi​fi​(x) for y≥0y \ge 0y≥0, and −∞-\infty−∞ otherwise. The dual objectives are gr(y)=inf⁡x∈XLr(x,y)g_r(y) = \inf_{x \in X} L_r(x, y)gr​(y)=infx∈X​Lr​(x,y) and g0(y)=inf⁡x∈XL0(x,y)g_0(y) = \inf_{x \in X} L_0(x, y)g0​(y)=infx∈X​L0​(x,y). Problem (Dr)(D_r)(Dr​) maximizes grg_rgr​ over Rm\mathbb R^mRm.

  • A dual optimal solution is a maximizer yˉ\bar yyˉ​ of grg_rgr​ with gr(yˉ)>−∞g_r(\bar y) > -\inftygr​(yˉ​)>−∞.
  • (P) is normal if the dual optimal value sup⁡g0\sup g_0supg0​ equals the optimal value of (P).
  • yˉ\bar yyˉ​ is a Kuhn–Tucker vector relative to LrL_rLr​ if −∞<inf⁡x∈XLr(x,yˉ)=inf⁡-\infty < \inf_{x \in X} L_r(x, \bar y) = \inf−∞<infx∈X​Lr​(x,yˉ​)=inf in (P).
  • (xˉ,yˉ)(\bar x, \bar y)(xˉ,yˉ​) is a saddle point of LrL_rLr​ if xˉ∈X\bar x \in Xxˉ∈X and Lr(xˉ,y)≤Lr(xˉ,yˉ)≤Lr(x,yˉ)L_r(\bar x, y) \le L_r(\bar x, \bar y) \le L_r(x, \bar y)Lr​(xˉ,y)≤Lr​(xˉ,yˉ​)≤Lr​(x,yˉ​) for all x∈Xx \in Xx∈X, y∈Rmy \in \mathbb R^my∈Rm.

In Lean these are Lr, L0, gr, g0, primalValue, dualValue, IsNormal, IsDualOptimal, IsKTVector, IsSaddle, IsOptimal and KuhnTuckerConditions, in the namespace PenaltyLag.Exact.

Formalization targets

Goal: Theorem 3.5 (p. 362)

Assume (P) is normal, yˉ\bar yyˉ​ is a dual optimal solution, and r>0r > 0r>0. Then for every xˉ∈E\bar x \in Exˉ∈E

xˉ is optimal for (P)  ⟺  xˉ∈X and Lr(xˉ,yˉ)≤Lr(x,yˉ)  ∀x∈X.\bar x \text{ is optimal for (P)} \iff \bar x \in X \text{ and } L_r(\bar x, \bar y) \le L_r(x, \bar y) \ \ \forall x \in X.xˉ is optimal for (P)⟺xˉ∈X and Lr​(xˉ,yˉ​)≤Lr​(x,yˉ​)  ∀x∈X.

Milestones (attack order)

  1. §3 after (3.17), pp. 361–362: for r>0r > 0r>0, yˉ\bar yyˉ​ is a Kuhn–Tucker vector relative to LrL_rLr​ iff yˉ\bar yyˉ​ is optimal for (Dr)(D_r)(Dr​) and (P) is normal.
  2. §3, p. 362: for r>0r > 0r>0, (xˉ,yˉ)(\bar x, \bar y)(xˉ,yˉ​) is a saddle point of LrL_rLr​ iff xˉ\bar xxˉ is optimal for (P) and yˉ\bar yyˉ​ is a Kuhn–Tucker vector.
  3. Corollary 3.4, r>0r > 0r>0 (p. 362): LrL_rLr​ and L0L_0L0​ have the same Kuhn–Tucker vectors and the same saddle points, and the saddle points of LrL_rLr​ are exactly the pairs satisfying the ordinary Kuhn–Tucker conditions
yˉi≥0, fi(xˉ)≤0, yˉifi(xˉ)=0 (∀i),xˉ∈argmin⁡X(f0+∑iyˉifi).\bar y_i \ge 0,\ f_i(\bar x) \le 0,\ \bar y_i f_i(\bar x) = 0\ (\forall i), \qquad \bar x \in \operatorname{argmin}_X \Big(f_0 + \sum_i \bar y_i f_i\Big).yˉ​i​≥0, fi​(xˉ)≤0, yˉ​i​fi​(xˉ)=0 (∀i),xˉ∈argminX​(f0​+i∑​yˉ​i​fi​).
  1. Corollary 3.4, r=0r = 0r=0: the saddle points of L0L_0L0​ are exactly the pairs satisfying the ordinary Kuhn–Tucker conditions.
  2. Proof of Theorem 3.5, pp. 362–363: if yˉ\bar yyˉ​ is optimal for (Dr)(D_r)(Dr​) and xˉ∈X\bar x \in Xxˉ∈X minimizes Lr(⋅,yˉ)L_r(\cdot, \bar y)Lr​(⋅,yˉ​) over XXX, then ∇yLr(xˉ,yˉ)=0\nabla_y L_r(\bar x, \bar y) = 0∇y​Lr​(xˉ,yˉ​)=0 and yˉ\bar yyˉ​ maximizes Lr(xˉ,⋅)L_r(\bar x, \cdot)Lr​(xˉ,⋅) over Rm\mathbb R^mRm.

Significance

The result. Theorem 3.5 turns a constrained problem into an unconstrained one with no loss of exactness. Once an optimal multiplier is known, every minimizer of Lr(⋅,yˉ)L_r(\cdot, \bar y)Lr​(⋅,yˉ​) over XXX solves (P), and conversely. Section 4 of the paper builds the computational scheme on this: maximize the smooth concave function grg_rgr​ over Rm\mathbb R^mRm, then minimize Lr(⋅,yˉ)L_r(\cdot, \bar y)Lr​(⋅,yˉ​) over XXX. For the ordinary Lagrangian the corresponding statement is false (p. 363), so the theorem marks precisely what the quadratic penalty term adds. Corollary 3.4 records the other half of the picture: in Kuhn–Tucker vectors and saddle points, LrL_rLr​ behaves exactly like L0L_0L0​.

Formalizing it. All results are proved in the paper, partly by citation of Rockafellar's Convex Analysis (§§28–30, 36). On the Prove2Me platform, saddle-point characterizations exist only for the ordinary Lagrangian on Rn\mathbb R^nRn (for instance ConvexOptimization.lagrangian_saddle_iff_strong_duality, and Beck's Theorem 2.7 as FirstOrderOpt.ConvexTheory.saddle_point_sufficient / saddle_point_necessary). This mission adds the penalty Lagrangian, convex sets in an arbitrary real vector space, extended-real dual values, and the exactness theorem itself. None of these statements is known to us to be machine-checked elsewhere.

Difficulty

The "if" direction is the substantive one. A minimizer xˉ\bar xxˉ of Lr(⋅,yˉ)L_r(\cdot, \bar y)Lr​(⋅,yˉ​) is not known to be feasible; feasibility must come from maximality of yˉ\bar yyˉ​ in the dual. The natural argument for L0L_0L0​ breaks at exactly this point: L0(xˉ,⋅)L_0(\bar x, \cdot)L0​(xˉ,⋅) is affine on the orthant, and minimality in xxx gives no information about ∇y\nabla_y∇y​. For LrL_rLr​ the link is the differentiability of the dual function grg_rgr​ with ∇gr(yˉ)=∇yLr(xˉ,yˉ)\nabla g_r(\bar y) = \nabla_y L_r(\bar x, \bar y)∇gr​(yˉ​)=∇y​Lr​(xˉ,yˉ​) (Theorem 3.2), which is posed in another mission of this series and is not available as a platform result. Every statement involves extended-real dual values on a vector space with no topology, so ±∞\pm\infty±∞ must be handled at each step.

Formalization scope

  • EEE is a bare real vector space (AddCommGroup E, Module ℝ E), as in the paper; no norm or topology is used.
  • XXX is a Set E. Each statement assumes the paper's standing hypothesis (p. 358): XXX convex and nonempty, f0,…,fmf_0, \dots, f_mf0​,…,fm​ convex on XXX.
  • The fif_ifi​ are total functions E → ℝ, and only their values on XXX enter. Constraint indices are Fin m (0-based), with f0f_0f0​ a separate argument.
  • Rm\mathbb R^mRm is EuclideanSpace ℝ (Fin m).
  • grg_rgr​, g0g_0g0​, L0L_0L0​, the optimal value of (P) and the dual optimal value are EReal-valued. An infeasible (P) has value +∞+\infty+∞, and g0=−∞g_0 = -\inftyg0​=−∞ off y≥0y \ge 0y≥0.
  • r>0r > 0r>0 is an explicit hypothesis wherever the paper has it. Theorem 3.5 is false for r=0r = 0r=0 (p. 363), and the Lean expression Lr at r=0r = 0r=0 is not L0L_0L0​.
  • "Dual optimal solution" in Theorem 3.5 is read as optimal for (Dr)(D_r)(Dr​) with the same rrr, with gr(yˉ)>−∞g_r(\bar y) > -\inftygr​(yˉ​)>−∞ (the convention of p. 361). The paper's reading, optimal for (D0)(D_0)(D0​), is equivalent by Theorem 3.2, which is posed in mission 1 of this series.
  • "xˉ\bar xxˉ minimizes Lr(⋅,yˉ)L_r(\cdot, \bar y)Lr​(⋅,yˉ​) over XXX" includes xˉ∈X\bar x \in Xxˉ∈X. The equivalence is stated for every xˉ∈E\bar x \in Exˉ∈E. No sign condition is imposed on yˉ\bar yyˉ​: nonnegativity is a consequence of dual optimality, not a hypothesis.
  • Saddle points are taken over X×RmX \times \mathbb R^mX×Rm (Rockafellar's Convex Analysis, §36). For L0L_0L0​ they are taken in the extended reals.
  • Trivializing readings ruled out: normality is neither dropped nor replaced by existence of an optimal solution or by Slater's condition, and the minimization on the right of Theorem 3.5 is never over a set containing points outside XXX.

The solver needs the representation Lr(x,y)=min⁡u{Fr(x,u)+u⋅y}L_r(x, y) = \min_u\{F_r(x, u) + u \cdot y\}Lr​(x,y)=minu​{Fr​(x,u)+u⋅y}, weak duality, the envelope formula and differentiability of grg_rgr​ (Theorem 3.2), and a convex-duality fact for normal programs. Those parts are reusable beyond this mission, and proofs of the paper's Theorem 3.2 in this setting are welcome as auxiliary results.

Selected references

  • R. T. Rockafellar, A dual approach to solving nonlinear programming problems by unconstrained optimization, Mathematical Programming 5 (1973) 354–373. https://doi.org/10.1007/BF01580138
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970. https://doi.org/10.1515/9781400873173
  • M. R. Hestenes, Multiplier and gradient methods, Journal of Optimization Theory and Applications 4 (1969) 303–320. https://doi.org/10.1007/BF00927673
  • M. J. D. Powell, A method for nonlinear constraints in minimization problems, in R. Fletcher (ed.), Optimization, Academic Press, 1969, 283–298.
  • D. P. Bertsekas, Constrained Optimization and Lagrange Multiplier Methods, Academic Press, 1982.
8 thms2 active usersReviewed
Markov ChainStochastic Systems·Captain: mikedeng1

Stability Properties of Constrained Queueing Systems and Scheduling Policies for Maximum Throughput in Multihop Radio Networks I: Policy π₀ Is Throughput-Optimal, C′ ⊂ C_π₀ ⊂ C ⊂ C̄′Research Paper

Motivation

In a wireless multihop network, a switch, or a parallel computer, transmissions interfere: two links that share a receiver, or two crossbar paths that share a port, cannot be active in the same time slot. The scheduler must choose, slot by slot, a set of links that may operate together and decide which traffic each one carries. The basic question is which arrival rates a network can sustain at all, and whether a single scheduling rule sustains every one of them without knowing the rates.

Tassiulas and Ephremides answered both questions in 1992 for a general slotted model with interference constraints, multihop routing and several traffic classes (IEEE Trans. Automat. Control 37(12):1936–1948). Their policy, here called π0\pi_0π0​, weighs each link by the largest queue-length difference it can reduce and activates a maximum-weight feasible set. It is the origin of the max-weight and back-pressure scheduling rules that later became standard in switch scheduling (McKeown, Mekkittikul, Anantharam and Walrand, 1999) and in stochastic network optimization (Georgiadis, Neely and Tassiulas, 2006).

Setting

A constrained queueing network has LLL nodes, NNN servers (links) and JJJ customer classes. Server iii moves customers from its origin node q(i)q(i)q(i) to its destination node h(i)h(i)h(i). Class jjj leaves the network on reaching a node of its destination set VjV_jVj​; at every other node lll it has a queue (l,j)(l,j)(l,j), whose length at the end of slot ttt is Xlj(t)∈NX_{lj}(t)\in\mathbb NXlj​(t)∈N.

The constraint set SSS is the family of sets of servers that may be active in the same slot. Assumption C.1 says that every subset of an activation set is an activation set. In each slot a stationary policy, given the state x=X(t−1)x=X(t-1)x=X(t−1), chooses a set of servers in SSS and the class each active server serves; an activation rule never activates more servers of queue (l,j)(l,j)(l,j) than there are customers xljx_{lj}xlj​. The class of all such rules is HHH. An activated server iii completes its service with probability mim_imi​, independently. New arrivals Alj(t)A_{lj}(t)Alj​(t) are i.i.d. over slots, independent across queues and of the services, with finite second moments and means alja_{lj}alj​. Under a stationary rule the vector X(t)X(t)X(t) is a Markov chain on N{queues}\mathbb N^{\{\text{queues}\}}N{queues}.

The chain is stable (Definition 3.1) if, from every transient state, it enters a closed communicating class with probability one, and every state of a closed communicating class is positive recurrent. The stability region CπC_\piCπ​ of a policy is the set of rate vectors aaa for which the system is stable under π\piπ; the stability region of the system is C=⋃π∈HCπC=\bigcup_{\pi\in H}C_\piC=⋃π∈H​Cπ​.

A family f=(fij)≥0f=(f_{ij})\ge0f=(fij​)≥0 is an aaa-admissible flow if it satisfies flow conservation, alj=∑q(i)=lfij−∑h(i)=lfija_{lj}=\sum_{q(i)=l}f_{ij}-\sum_{h(i)=l}f_{ij}alj​=∑q(i)=l​fij​−∑h(i)=l​fij​ at every queue; f^i=∑jfij\hat f_i=\sum_jf_{ij}f^​i​=∑j​fij​ is its total flow through server iii. With co(S)\mathrm{co}(S)co(S) the convex hull of the indicator vectors of the activation sets,

C′={a≥0: ∃f∈Fa, c∈co(S), mi−1f^i<ci if f^i>0, f^i=0 if ci=0}.C'=\{a\ge0:\ \exists f\in F_a,\ c\in\mathrm{co}(S),\ m_i^{-1}\hat f_i<c_i\text{ if }\hat f_i>0,\ \hat f_i=0\text{ if }c_i=0\}.C′={a≥0: ∃f∈Fa​, c∈co(S), mi−1​f^​i​<ci​ if f^​i​>0, f^​i​=0 if ci​=0}.

Formalization targets

Goal: Theorem 3.2

C′⊂C⊂Cˉ′,C′⊂Cπ0⊂C⊂Cˉπ0.C'\subset C\subset\bar C',\qquad C'\subset C_{\pi_0}\subset C\subset\bar C_{\pi_0}.C′⊂C⊂Cˉ′,C′⊂Cπ0​​⊂C⊂Cˉπ0​​.

The system stability region is pinned between C′C'C′ and its closure, and policy π0\pi_0π0​, whatever its tie-breaking, stabilizes every rate vector in C′C'C′. Inclusions are not strict.

Milestones

  1. Lemma A.1: co(S)\mathrm{co}(S)co(S) is closed under 0≤a≤c0\le a\le c0≤a≤c (under C.1).
  2. Lemma 3.1: Cˉ′={a:∃f∈Fa, c∈co(S), M−1f^≤c}\bar C'=\{a:\exists f\in F_a,\ c\in\mathrm{co}(S),\ M^{-1}\hat f\le c\}Cˉ′={a:∃f∈Fa​, c∈co(S), M−1f^​≤c}.
  3. Theorem 3.1: a function bounded below with drift ≤−ϵ\le-\epsilon≤−ϵ outside a finite set, and finite conditional expectation on it, makes a countable chain stable in the sense of Definition 3.1.
  4. (A.6)–(A.7): for V(x)=∑l,jxlj2V(x)=\sum_{l,j}x_{lj}^2V(x)=∑l,j​xlj2​, the one-step drift under π0\pi_0π0​ is finite everywhere and below −ϵ-\epsilon−ϵ once V(x)≥bV(x)\ge bV(x)≥b.
  5. Lemma 3.2: C′⊂Cπ0C'\subset C_{\pi_0}C′⊂Cπ0​​.
  6. Lemma 3.3: for a∉Cˉ′a\notin\bar C'a∈/Cˉ′, the system is unstable under every policy in HHH.

An optional item states the claim of Remark 1: if a∈Cˉ′∖C′a\in\bar C'\setminus C'a∈Cˉ′∖C′, then δa∉Cˉ′\delta a\notin\bar C'δa∈/Cˉ′ for every δ>1\delta>1δ>1.

Significance

Theorem 3.2 shows that a throughput-optimal stationary policy exists, which is not obvious: stability regions of different policies need not be nested, so a policy whose region contains all the others has to be exhibited. It also describes the system stability region by a deterministic flow condition, C′C'C′, which can be checked without simulating any policy. The same drift argument underlies the stability proofs of max-weight switch schedulers, back-pressure routing and the drift-plus-penalty method.

The result is proved in the paper, with a proof sketched in places (Theorem 3.1 is called "a trivial extension of Foster's criteria", Lemma A.1 is omitted, Lemma 3.3 is argued by ergodicity in a paragraph). As far as a search of the platform shows, none of these statements has a machine-checked proof: Foster's criterion is posed on the platform only for irreducible chains on N\mathbb NN, and the back-pressure results already posed concern fluid models of other networks. A complete formal development would supply the reducible-chain Foster criterion, the convex-geometry lemma on co(S)\mathrm{co}(S)co(S), the quadratic drift computation and the ergodic converse.

Difficulty

The obvious argument is a quadratic Lyapunov drift bound, but it does not go through as is in three places. First, the drift bound needs a direction of decrease from every large state: the largest queue must be connected to a destination through servers that can actually be activated, which is where assumption C.2 and the topology of SSS enter (A.21)–(A.24). Second, stage 3 of π0\pi_0π0​ defers some activations to respect the rule "no service for nonexisting customers", so the chosen schedule is not exactly maximum-weight and the loss has to be bounded uniformly. Third, the chain is in general reducible, so Foster's criterion for irreducible chains does not apply; the extension must show that every closed class meets the finite exceptional set and that transient states are left almost surely. The converse, Lemma 3.3, needs a law-of-large-numbers argument for an arbitrary stationary rule on a positive recurrent class, together with compactness of acyclic flows (Lemma 3.1).

Formalization scope

Nodes, servers and classes are Fin L, Fin N, Fin J (0-based). SSS is a Set (Finset (Fin N)); a queue is a pair (l,j)(l,j)(l,j) with l∉Vjl\notin V_jl∈/Vj​, and a state is a function from queues to N\mathbb NN. A multiclass activation vector assigns to each server an optional class. The transition matrix of the queue-length chain is written out explicitly as a sum over arrival vectors and Bernoulli service outcomes; Definition 3.1 is stated through this matrix (first-entry probabilities, essential states, positive recurrence), with values in [0,∞][0,\infty][0,∞].

Conventions committed to, and hypotheses added relative to the page:

  • Standing assumptions of the goal: C.1; ∅∈S\emptyset\in S∅∈S (the idle schedule is always allowed); 0<mi≤10<m_i\le10<mi​≤1; and C.2 in a topological form, a chain of servers from every non-destination node of class jjj to VjV_jVj​ (stronger than the printed sentence, which covers only nodes that class jjj can reach).
  • Every single server is an activation set, {i}∈S\{i\}\in S{i}∈S. The proof of Lemma 3.2 uses this at (A.24) without stating it; without it a server that can never be activated breaks the drift bound and Lemma 3.2.
  • Stability regions quantify over laws. CπC_\piCπ​ is the set of nonnegative rate vectors for which the chain is stable for every arrival law with finite second moments and those means. C′C'C′ is intersected with a≥0a\ge0a≥0.
  • π0\pi_0π0​ is a family. Statements hold for every rule satisfying the three stages, with arbitrary tie-breaking.
  • Expectations of unbounded functions are real series with explicit summability, so a divergent expectation is never read as 000.

A formalization in which CπC_\piCπ​ asks for stability under one convenient arrival law, or in which negative rates are admitted, or in which π0\pi_0π0​ is one fixed tie-break, would be a different theorem; the definitions rule each of these out.

Infrastructure needed: hitting probabilities and positive recurrence for countable chains (reusable beyond this mission), convex hulls of finite point sets, a cycle-cancelling bound for multicommodity flows, and the ergodic theorem for positive recurrent chains. Proofs of any milestone, and reusable lemmas on countable Markov chains, are welcome.

Selected references

  • L. Tassiulas and A. Ephremides, Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks, IEEE Trans. Automat. Control 37(12):1936–1948, 1992. https://doi.org/10.1109/9.182479
  • F. G. Foster, On the stochastic matrices associated with certain queuing processes, Ann. Math. Statist. 24(3):355–360, 1953. https://doi.org/10.1214/aoms/1177728976
  • N. McKeown, A. Mekkittikul, V. Anantharam and J. Walrand, Achieving 100% throughput in an input-queued switch, IEEE Trans. Commun. 47(8):1260–1267, 1999. https://doi.org/10.1109/26.780463
  • L. Georgiadis, M. J. Neely and L. Tassiulas, Resource allocation and cross-layer control in wireless networks, Found. Trends Netw. 1(1):1–144, 2006. https://doi.org/10.1561/1300000001
9 thms2 active usersReviewed
ProbabilityStochastic Systems·Captain: mikedeng1

Regenerative Stochastic Processes 4: Cumulative Processes on the Same Regeneration Points Are Jointly Asymptotically NormalResearch Paper

Motivation

Many quantities in queueing, inventory and reliability models are additive functionals of a regenerative process: the total work processed by a server up to time ttt, the cost accumulated by an inventory policy, the time a machine spends broken. Each such quantity grows by independent, identically distributed amounts over the cycles between successive regeneration points. W. L. Smith called these cumulative processes in Regenerative stochastic processes (Proc. R. Soc. Lond. A, 1955), the paper that introduced the term "regenerative process" and laid out its limit theory. Long-run averages of such quantities are estimated by simulation and by statistical observation of real systems. Confidence intervals for these estimates, and the regenerative method of simulation output analysis, rest on the central limit theorem for cumulative processes. When several quantities are estimated at once (a ratio of two rewards, a vector of costs), they rest on its joint version for several cumulative processes driven by the same regenerations.

Timeline:

  • 1949. Feller proves the central limit theorem for the renewal counting process.
  • 1952. Anscombe proves that a central limit theorem survives replacing the number of summands by a random index mtm_tmt​ with mt/ψ(t)→1m_t/\psi(t)\to 1mt​/ψ(t)→1 in probability, without independence between the index and the summands (Anscombe, Proc. Camb. Phil. Soc. 48, 1952).
  • 1955. Smith extends Anscombe's theorem to random vectors and deduces the univariate (Theorem 9, Corollary 9·1) and multivariate (Theorem 10) central limit theorems for cumulative processes (Smith 1955).

Setting

On a probability space (Ω,P)(\Omega, P)(Ω,P), let t1,t2,…t_1, t_2, \dotst1​,t2​,… be independent, identically distributed, non-negative random variables with P{t1=0}<1P\{t_1 = 0\} < 1P{t1​=0}<1 (a renewal process), and t0=0t_0 = 0t0​=0. The regeneration epochs are Tk=t0+t1+⋯+tkT_k = t_0 + t_1 + \dots + t_kTk​=t0​+t1​+⋯+tk​ (k≥0k \ge 0k≥0), and ntn_tnt​ is the number of epochs in [0,t][0,t][0,t] (in Smith's words, the greatest kkk with Tk−1≤tT_{k-1} \le tTk−1​≤t, where T−1=0T_{-1} = 0T−1​=0). Write μr=Et1r\mu_r = E t_1^rμr​=Et1r​.

A real process wtw_twt​ with w0=0w_0 = 0w0​=0 is a cumulative process if (C1) its cycle increments yn=Δnwt=wTn−wTn−1y_n = \Delta_n w_t = w_{T_n} - w_{T_{n-1}}yn​=Δn​wt​=wTn​​−wTn−1​​, n≥1n \ge 1n≥1, are i.i.d., and (C2) with probability one its paths have bounded variation on every finite interval. The variation process w~t=∫0t∣dwt∣\tilde w_t = \int_0^t |\mathrm d w_t|w~t​=∫0t​∣dwt​∣ has increments y~n=Δnw~t\tilde y_n = \Delta_n \tilde w_ty~​n​=Δn​w~t​. Moments are written κr=Eynr\kappa_r = E y_n^rκr​=Eynr​ and κ~r=Ey~n r\tilde\kappa_r = E \tilde y_n^{\,r}κ~r​=Ey~​nr​.

MMM cumulative processes wt(1),…,wt(M)w^{(1)}_t, \dots, w^{(M)}_twt(1)​,…,wt(M)​ are based on the same sequence of regeneration points when the cycle vectors (tn,yn(1),…,yn(M),y~n(1),…,y~n(M))(t_n, y^{(1)}_n, \dots, y^{(M)}_n, \tilde y^{(1)}_n, \dots, \tilde y^{(M)}_n)(tn​,yn(1)​,…,yn(M)​,y~​n(1)​,…,y~​n(M)​) are i.i.d. in nnn. Put κ1(i)=Ey1(i)\kappa^{(i)}_1 = E y^{(i)}_1κ1(i)​=Ey1(i)​. The covariance matrices are

akl=cov⁡(y1(k),y1(l)),bkl=cov⁡(y1(k)−κ1(k)μ1t1,  y1(l)−κ1(l)μ1t1).a_{kl} = \operatorname{cov}(y^{(k)}_1, y^{(l)}_1), \qquad b_{kl} = \operatorname{cov}\Big(y^{(k)}_1 - \tfrac{\kappa^{(k)}_1}{\mu_1} t_1,\; y^{(l)}_1 - \tfrac{\kappa^{(l)}_1}{\mu_1} t_1\Big).akl​=cov(y1(k)​,y1(l)​),bkl​=cov(y1(k)​−μ1​κ1(k)​​t1​,y1(l)​−μ1​κ1(l)​​t1​).

Formalization targets

Goal: Theorem 10

If μ1<∞\mu_1 < \inftyμ1​<∞ and E(y~1(i))2<∞E(\tilde y^{(i)}_1)^2 < \inftyE(y~​1(i)​)2<∞ for every iii, then as t→∞t \to \inftyt→∞

(wt(i)−κ1(i)nt(t/μ1)1/2)i=1M→ d N(0,a),\left(\frac{w^{(i)}_t - \kappa^{(i)}_1 n_t}{(t/\mu_1)^{1/2}}\right)_{i=1}^M \xrightarrow{\ d\ } \mathcal N(0, a),((t/μ1​)1/2wt(i)​−κ1(i)​nt​​)i=1M​ d ​N(0,a),

and if in addition μ2<∞\mu_2 < \inftyμ2​<∞,

(wt(i)−(κ1(i)/μ1) t(t/μ1)1/2)i=1M→ d N(0,b).\left(\frac{w^{(i)}_t - (\kappa^{(i)}_1/\mu_1)\,t}{(t/\mu_1)^{1/2}}\right)_{i=1}^M \xrightarrow{\ d\ } \mathcal N(0, b).((t/μ1​)1/2wt(i)​−(κ1(i)​/μ1​)t​)i=1M​ d ​N(0,b).

Milestones

  • The renewal strong law nt/t→1/μ1n_t/t \to 1/\mu_1nt​/t→1/μ1​ almost surely (§5·3).
  • Lemma 8: if μ1<∞\mu_1 < \inftyμ1​<∞ and κ~p<∞\tilde\kappa_p < \inftyκ~p​<∞, then (wt+Zt−wt)/t1/p→0(w_{t+Z_t} - w_t)/t^{1/p} \to 0(wt+Zt​​−wt​)/t1/p→0 almost surely, where Zt=∑1nt+1ti−tZ_t = \sum_1^{n_t+1} t_i - tZt​=∑1nt​+1​ti​−t.
  • Theorem B (Anscombe): P{∑1mtyi/(σψ(t)1/2)≤α}→Φ(α)P\{\sum_1^{m_t} y_i/(\sigma\psi(t)^{1/2}) \le \alpha\} \to \Phi(\alpha)P{∑1mt​​yi​/(σψ(t)1/2)≤α}→Φ(α) for i.i.d. centred yiy_iyi​ with variance σ2>0\sigma^2 > 0σ2>0 and mt/ψ(t)→1m_t/\psi(t) \to 1mt​/ψ(t)→1 in probability.
  • Its MMM-dimensional form (§5·4): ψ(t)−1/2∑1mtyj→dN(0,a)\psi(t)^{-1/2}\sum_1^{m_t} \mathbf y_j \xrightarrow{d} \mathcal N(0, a)ψ(t)−1/2∑1mt​​yj​d​N(0,a) for i.i.d. centred random vectors.
  • Theorem 9: if Ey1=0E y_1 = 0Ey1​=0 and var⁡y1=σ2>0\operatorname{var} y_1 = \sigma^2 > 0vary1​=σ2>0, then P{wt/(σ(t/μ1)1/2)≤α}→Φ(α)P\{w_t/(\sigma(t/\mu_1)^{1/2}) \le \alpha\} \to \Phi(\alpha)P{wt​/(σ(t/μ1​)1/2)≤α}→Φ(α).
  • Corollary 9·1: the univariate forms of both assertions of the goal, with normalisations σ=(κ2−κ12)1/2\sigma = (\kappa_2 - \kappa_1^2)^{1/2}σ=(κ2​−κ12​)1/2 and γ=var⁡(y1−(κ1/μ1)t1)\gamma = \operatorname{var}(y_1 - (\kappa_1/\mu_1)t_1)γ=var(y1​−(κ1​/μ1​)t1​).

Significance

Theorem 10 is the multivariate central limit theorem for regenerative processes. Its second assertion with M=2M = 2M=2 and the delta method gives the asymptotic normality of ratio estimators wt(1)/wt(2)w^{(1)}_t / w^{(2)}_twt(1)​/wt(2)​, the basis of the regenerative method of simulation output analysis. With wt=ntw_t = n_twt​=nt​, Corollary 9·1 recovers Feller's central limit theorem for renewal processes, which Smith points out (p. 9). The first assertion, with the random centring κ1nt\kappa_1 n_tκ1​nt​, needs only μ1<∞\mu_1 < \inftyμ1​<∞, which matters for heavy-tailed cycle lengths.

The results are classical and proved, and none of them is formalized. Mathlib has the central limit theorem for i.i.d. real sums with a deterministic number of terms and multivariate Gaussian laws, but no random-index central limit theorem, no renewal counting process and no regenerative process. A formal development would supply Anscombe's theorem (useful well beyond renewal theory, for sequential analysis and random sums), the renewal strong law and a reusable model of cumulative processes.

Difficulty

The obvious argument writes wtw_twt​ as the sum of the first ntn_tnt​ cycle increments plus a remainder and applies the classical central limit theorem. This fails at two points. First, the number of summands ntn_tnt​ is random and depends on the summands themselves (cycle lengths and rewards are typically dependent), so the classical theorem with a deterministic index does not apply and conditioning on ntn_tnt​ destroys the i.i.d. structure. Anscombe's theorem is needed exactly for this; it requires control of the partial sums uniformly over a window of indices around t/μ1t/\mu_1t/μ1​, not at a single index. Second, the remainder over the incomplete cycle at time ttt must be shown negligible on the scale t\sqrt tt​ using only a second moment of the cycle variation; Lemma 8 does this almost surely. For the vector statement, the scalar theorem must be lifted to convergence in distribution in RM\mathbb R^MRM with a possibly degenerate covariance matrix, where the scalar theorem's hypothesis σ>0\sigma > 0σ>0 can fail along some directions.

Formalization scope

  • Time is real; every limit is along t→∞t \to \inftyt→∞ in R\mathbb RR. Processes are functions w:R→Ω→Rw : \mathbb R \to \Omega \to \mathbb Rw:R→Ω→R (or a family indexed by Fin M); cycle lengths are a sequence N→Ω→R\mathbb N \to \Omega \to \mathbb RN→Ω→R with t0=0t_0 = 0t0​=0.
  • ntn_tnt​ is a natural number, the number of epochs Tj≤tT_j \le tTj​≤t; on the null event where infinitely many epochs are ≤t\le t≤t it is 000. Finiteness is never assumed.
  • w~t\tilde w_tw~t​ is the total variation (eVariationOn) of the path on [0,t][0,t][0,t], set to 000 for all ttt on paths of infinite variation, as Smith allows.
  • Condition (C1) is read for the whole cycle vector (tn,yn,y~n)(t_n, y_n, \tilde y_n)(tn​,yn​,y~​n​). No independence between components is assumed. Assuming the cycle length independent of the rewards, or the components independent, would make aaa diagonal or force bbb into a special form; that trivialization is ruled out.
  • "Jointly normally distributed with covariance matrix aaa" is TendstoInDistribution to multivariateGaussian 0 a on EuclideanSpace ℝ (Fin M). The matrices aaa and bbb are defined as covariance matrices, hence positive semidefinite, so the limit is a genuine (possibly degenerate) Gaussian law and not Mathlib's Dirac fallback for non-PSD input.
  • The scalar statements keep the paper's form: convergence of P{⋅≤α}P\{\cdot \le \alpha\}P{⋅≤α} to Φ(α)=\Phi(\alpha) =Φ(α)= cdf (gaussianReal 0 1) α for every real α\alphaα. The paper's implicit σ>0\sigma > 0σ>0 and γ>0\gamma > 0γ>0 are explicit hypotheses; without them the quotients are 000 in Lean and the statements would be false.
  • μ1<∞\mu_1 < \inftyμ1​<∞, μ2<∞\mu_2 < \inftyμ2​<∞ and Ey~2<∞E\tilde y^2 < \inftyEy~​2<∞ are Integrable hypotheses, never encoded through the value of an integral.

Contributions welcome: a proof of Anscombe's theorem from Mathlib's central limit theorem; the renewal strong law from strong_law_ae; measurability lemmas for ntn_tnt​ and w~t\tilde w_tw~t​; the Cramér–Wold step.

Selected references

  • W. L. Smith, Regenerative stochastic processes, Proc. R. Soc. Lond. A 232(1188):6–31, 1955. https://doi.org/10.1098/rspa.1955.0198
  • F. J. Anscombe, Large-sample theory of sequential estimation, Proc. Cambridge Philos. Soc. 48, 600, 1952 (cited in Smith 1955, p. 31).
  • W. Feller, Fluctuation theory of recurrent events, Trans. Amer. Math. Soc. 67, 98, 1949 (cited in Smith 1955, p. 31).
  • J. L. Doob, Renewal theory from the point of view of the theory of probability, Trans. Amer. Math. Soc. 63, 422, 1948 (cited in Smith 1955, p. 31).
9 thms2 active usersReviewed
Convex OptimizationNumerical AnalysisOptimization·Captain: mikedeng1

Fixed Point and Bregman Iterative Methods for Matrix Rank Minimization: The Matrix Shrinkage Fixed Point Iteration Converges to an Optimal Solution of the Nuclear Norm Regularized ProblemResearch Paper

Motivation

Many estimation problems ask for a matrix of low rank that is consistent with a small number of linear measurements: completing a partially observed ratings matrix, identifying a low-order linear system, or embedding points from a few pairwise distances. Rank minimization under linear constraints is NP-hard, and the standard convex surrogate replaces the rank by the nuclear norm, the sum of the singular values (Recht, Fazel and Parrilo, 2010). Under incoherence assumptions the surrogate recovers the low-rank matrix exactly (Candès and Recht, 2009).

The surrogate is a semidefinite program, and interior point methods for it do not scale past matrices of a few hundred rows. Ma, Goldfarb and Chen (2009) proposed a first-order method for the regularized form of the problem: a gradient step on the data-fit term followed by singular value shrinkage. Their algorithms FPC and FPCA are built on this two-line iteration, and the paper's one convergence theorem says that the iteration, run with a fixed step size, converges to a minimizer. This mission formalizes that theorem and the lemmas used to prove it.

Timeline of the closest results:

  • 2005: Combettes and Wajs prove convergence of forward–backward splitting for the sum of a convex function and a convex function with Lipschitz gradient in a Hilbert space.
  • 2008: Hale, Yin and Zhang analyse the fixed point continuation (FPC) method for ℓ1\ell_1ℓ1​-regularized least squares, with vector shrinkage in place of matrix shrinkage.
  • 2008–2010: Cai, Candès and Shen introduce singular value thresholding (SVT) for matrix completion, prove that the shrinkage is the proximal map of the nuclear norm, and prove convergence of a different iteration (Uzawa's method on a strongly convex problem with equality constraints).
  • 2009: Ma, Goldfarb and Chen state and prove convergence of the matrix shrinkage fixed point iteration for the nuclear norm regularized least squares problem (1.8), following Hale, Yin and Zhang's argument.

Setting

Fix natural numbers m,n,pm,n,pm,n,p. Matrices X∈Rm×nX\in\mathbb R^{m\times n}X∈Rm×n carry the Frobenius norm ∥X∥F=(∑ijXij2)1/2\|X\|_F=(\sum_{ij}X_{ij}^2)^{1/2}∥X∥F​=(∑ij​Xij2​)1/2 and the nuclear norm ∥X∥∗=∑iσi(X)\|X\|_*=\sum_i\sigma_i(X)∥X∥∗​=∑i​σi​(X). A linear map A:Rm×n→Rp\mathcal A:\mathbb R^{m\times n}\to\mathbb R^pA:Rm×n→Rp is given by matrices A0,…,Ap−1A_0,\dots,A_{p-1}A0​,…,Ap−1​ through A(X)i=⟨Ai,X⟩\mathcal A(X)_i=\langle A_i,X\rangleA(X)i​=⟨Ai​,X⟩; equivalently AX=A vec(X)\mathcal AX=A\,\mathrm{vec}(X)AX=Avec(X) for a matrix A∈Rp×mnA\in\mathbb R^{p\times mn}A∈Rp×mn. Its adjoint is A∗\mathcal A^*A∗, and λmax⁡(A⊤A)=∥A∥22\lambda_{\max}(A^\top A)=\|\mathcal A\|_2^2λmax​(A⊤A)=∥A∥22​, the square of its spectral norm. Fix b∈Rpb\in\mathbb R^pb∈Rp and μ>0\mu>0μ>0.

Problem (1.8) is

min⁡X∈Rm×n μ∥X∥∗+12∥A(X)−b∥22,\min_{X\in\mathbb R^{m\times n}}\ \mu\|X\|_*+\tfrac12\|\mathcal A(X)-b\|_2^2 ,X∈Rm×nmin​ μ∥X∥∗​+21​∥A(X)−b∥22​,

and X∗\mathcal X^*X∗ denotes its set of optimal solutions. Write g(X)=A∗(A(X)−b)g(X)=\mathcal A^*(\mathcal A(X)-b)g(X)=A∗(A(X)−b) for the gradient of the data-fit term and h(X)=X−τg(X)h(X)=X-\tau g(X)h(X)=X−τg(X) for a gradient step of size τ>0\tau>0τ>0.

For ν>0\nu>0ν>0, the matrix shrinkage operator SνS_\nuSν​ takes a singular value decomposition Y=U Diag(σ)V⊤Y=U\,\mathrm{Diag}(\sigma)V^\topY=UDiag(σ)V⊤ to Sν(Y)=U Diag(σˉ)V⊤S_\nu(Y)=U\,\mathrm{Diag}(\bar\sigma)V^\topSν​(Y)=UDiag(σˉ)V⊤, where σˉi=max⁡(σi−ν,0)\bar\sigma_i=\max(\sigma_i-\nu,0)σˉi​=max(σi​−ν,0). The fixed point iterations (2.1) start from an arbitrary X0X^0X0 and repeat

Yk=Xk−τg(Xk),Xk+1=Sτμ(Yk).Y^k=X^k-\tau g(X^k),\qquad X^{k+1}=S_{\tau\mu}(Y^k).Yk=Xk−τg(Xk),Xk+1=Sτμ​(Yk).

Formalization targets

Goal: Theorem 4

For τ∈(0,2/λmax⁡(A⊤A))\tau\in(0,2/\lambda_{\max}(A^\top A))τ∈(0,2/λmax​(A⊤A)) and every starting point, there is X∗∈X∗X^*\in\mathcal X^*X∗∈X∗ with

lim⁡k→∞∥Xk−X∗∥F=0.\lim_{k\to\infty}\|X^k-X^*\|_F=0 .k→∞lim​∥Xk−X∗∥F​=0.

The goal fixes no rate and no particular limit: it asserts convergence of the whole sequence to some minimizer.

Milestones, in attack order

  1. Theorem 3. Sν(Y)S_\nu(Y)Sν​(Y) is an optimal solution of min⁡Xν∥X∥∗+12∥X−Y∥F2\min_X\nu\|X\|_*+\tfrac12\|X-Y\|_F^2minX​ν∥X∥∗​+21​∥X−Y∥F2​. This is already posed on the platform as Cai, Candès and Shen's Theorem 2.1 (which adds uniqueness) and is referenced, not restated.
  2. Corollary 1. For every τ>0\tau>0τ>0: X∗∈X∗X^*\in\mathcal X^*X∗∈X∗ if and only if X∗=Sτμ(h(X∗))X^*=S_{\tau\mu}(h(X^*))X∗=Sτμ​(h(X∗)).
  3. Lemma 1. ∥Sν(Y1)−Sν(Y2)∥F≤∥Y1−Y2∥F\|S_\nu(Y_1)-S_\nu(Y_2)\|_F\le\|Y_1-Y_2\|_F∥Sν​(Y1​)−Sν​(Y2​)∥F​≤∥Y1​−Y2​∥F​, with equality if and only if Y1−Y2=Sν(Y1)−Sν(Y2)Y_1-Y_2=S_\nu(Y_1)-S_\nu(Y_2)Y1​−Y2​=Sν​(Y1​)−Sν​(Y2​).
  4. Lemma 2. For τ\tauτ in the step range, ∥h(X)−h(X′)∥F≤∥X−X′∥F\|h(X)-h(X')\|_F\le\|X-X'\|_F∥h(X)−h(X′)∥F​≤∥X−X′∥F​, and h(X)−h(X′)=X−X′h(X)-h(X')=X-X'h(X)−h(X′)=X−X′ if and only if equality holds.
  5. Lemma 3. If X∗∈X∗X^*\in\mathcal X^*X∗∈X∗, then X∈X∗X\in\mathcal X^*X∈X∗ if and only if ∥Sτμ(h(X))−X∗∥F=∥X−X∗∥F\|S_{\tau\mu}(h(X))-X^*\|_F=\|X-X^*\|_F∥Sτμ​(h(X))−X∗∥F​=∥X−X∗∥F​.

The mission also contains the paper's Theorem 2, the optimality condition for (1.8) written with a reduced singular value decomposition X=U Diag(σ)V⊤X=U\,\mathrm{Diag}(\sigma)V^\topX=UDiag(σ)V⊤: X∈X∗X\in\mathcal X^*X∈X∗ if and only if some WWW satisfies μ(UV⊤+W)+g(X)=0\mu(UV^\top+W)+g(X)=0μ(UV⊤+W)+g(X)=0, U⊤W=0U^\top W=0U⊤W=0, WV=0WV=0WV=0 and ∥W∥2≤1\|W\|_2\le1∥W∥2​≤1. The chain to Theorem 4 does not use it.

Significance

Theorem 4 is the correctness guarantee for FPC and FPCA, which were among the first algorithms to solve nuclear norm regularized problems with matrices in the thousands of rows. It certifies that the output of the plain iteration is an exact minimizer in the limit, for every starting point and every step below 2/λmax⁡(A⊤A)2/\lambda_{\max}(A^\top A)2/λmax​(A⊤A). Lemmas 1–3 are the reusable part: non-expansiveness of the matrix shrinkage with a precise equality case, and the fixed point characterization of the optimal set, are the ingredients of every proximal gradient analysis with nuclear norm regularization.

Status: the theorem is proved on paper, and it is also a special case of the general convergence of forward–backward splitting. No machine-checked proof of it is known. The platform holds general forward–backward and inertial forward–backward convergence statements in Hilbert space (for example NesterovFB.Weak.theorem_3, InertialFB.IFB.theorem1_convergence) and the nonexpansiveness of abstract proximal maps (MoreauProx.Characterization.prox_nonexpansive). None is stated for the nuclear norm, for matrix shrinkage defined through the SVD, or with Ma, Goldfarb and Chen's equality cases. Formalizing this mission connects Mathlib's singular values to these operator-theoretic statements.

Difficulty

The obvious route goes through Fejér monotonicity: every step brings the iterate no farther from any minimizer, so the iterates are bounded and have a limit point. Two steps of this route do not come for free. First, the argument presupposes a minimizer; nothing in the hypotheses provides one, so the existence of an optimal solution of (1.8) has to be established from the data. Second, a limit point must be shown to be optimal, which requires the equality cases of Lemmas 1 and 2, not just the inequalities. Lemma 1's equality case concerns the singular value decompositions of two unrelated matrices whose singular vectors need not be aligned; non-expansiveness alone does not deliver it. Nonexpansive maps in general need not have convergent iterates (a rotation is nonexpansive), so continuity plus boundedness is not enough.

Formalization scope

  • Matrices are Matrix (Fin m) (Fin n) ℝ. The Frobenius norm, the nuclear norm (the sum of Mathlib's LinearMap.singularValues), the linear map A\mathcal AA as ppp matrices Aop, its adjoint and spectral norm, and the shrinkage relation IsShrink are reused from the published Cai–Candès–Shen definitions.
  • SνS_\nuSν​ is a relation, IsShrink ν Y X: XXX is the shrinkage of YYY for some reduced SVD (orthonormal columns, positive singular values). Every statement takes the shrinkage output as a variable with an IsShrink hypothesis. The paper's Definition 4 also allows zero singular values, which shrink to zero and change nothing.
  • The step range τ∈(0,2/λmax⁡(A⊤A))\tau\in(0,2/\lambda_{\max}(A^\top A))τ∈(0,2/λmax​(A⊤A)) is written 0<τ0<\tau0<τ and τ∥A∥22<2\tau\|\mathcal A\|_2^2<2τ∥A∥22​<2, without division. For A=0\mathcal A=0A=0 this is the range (0,∞)(0,\infty)(0,∞), as on paper, rather than the empty range that Lean's 2/0=02/0=02/0=0 would give.
  • μ>0\mu>0μ>0 is an explicit hypothesis, and so is ν>0\nu>0ν>0 in Lemma 1; in Corollary 1, τ>0\tau>0τ>0 is the only condition on the step, as on the page ("for any τ>0\tau>0τ>0"). ν=τμ\nu=\tau\muν=τμ is built into the statements.
  • The run of (2.1) is a predicate on the whole sequence with an arbitrary X0X^0X0; it is not the continuation scheme FPC and does not fix X0=0X^0=0X0=0.
  • Convergence is in the Frobenius norm to some minimizer chosen after the run. Neither X∗≠∅\mathcal X^*\neq\emptysetX∗=∅ nor boundedness of the iterates is a hypothesis; a statement that assumes either is a different, weaker theorem and is ruled out.
  • No statement assumes m≤nm\le nm≤n; the paper's "without loss of generality" belongs to its proofs.

A complete development needs the SVD of real matrices in terms of Mathlib's singular values, the subdifferential of the nuclear norm, and a Fejér-monotone convergence argument in finite dimension. The first two are reusable for any nuclear norm or spectral function result, and contributions of general lemmas about singular value shrinkage (functionality of IsShrink, its proximal characterization) are welcome.

Selected references

  • S. Ma, D. Goldfarb, L. Chen, Fixed point and Bregman iterative methods for matrix rank minimization, Math. Program. 128 (2011); preprint arXiv:0905.1643v2, 2009. https://arxiv.org/abs/0905.1643
  • J.-F. Cai, E. J. Candès, Z. Shen, A singular value thresholding algorithm for matrix completion, SIAM J. Optim. 20(4), 2010. https://arxiv.org/abs/0810.3286
  • E. T. Hale, W. Yin, Y. Zhang, Fixed-point continuation for ℓ1-minimization: methodology and convergence, SIAM J. Optim. 19(3), 2008. https://doi.org/10.1137/070698920
  • P. L. Combettes, V. R. Wajs, Signal recovery by proximal forward-backward splitting, Multiscale Model. Simul. 4(4), 2005. https://doi.org/10.1137/050626090
  • B. Recht, M. Fazel, P. A. Parrilo, Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization, SIAM Review 52(3), 2010. https://arxiv.org/abs/0706.4138
  • E. J. Candès, B. Recht, Exact matrix completion via convex optimization, Found. Comput. Math. 9, 2009. https://arxiv.org/abs/0805.4471
10 thms2 active usersReviewed
Algorithmic Game TheoryMechanism Design·Captain: mikedeng1

Job Matching, Coalition Formation, and Gross Substitutes 3: A Coalition Technology Satisfying Gross Substitutes for m + 1 Identical Firms Has a Strict Core AllocationResearch Paper

Why a one-sided market can have a core

Workers can form groups and produce an output that they divide through salaries. A group may object to a proposed allocation when it can pay all of its members at least as much and one member more. The central question is whether any allocation survives every such objection. Kelso and Crawford's 1982 paper gives a sufficient condition based on how an imaginary firm would demand workers as their salaries change. This is useful when production depends on combinations of workers, yet there is no actual employer side to the market.

The one-sided result belongs to a seven-mission series: 1, the salary-adjustment process; 2, continuous-salary core existence; 3, this one-sided theorem; 4, firm-optimality; 5, comparative statics; 6, returns to workers; and 7, the no-core example. Each mission can be read independently. None of Kelso and Crawford's results was on Prove2Me before this series. The paper itself notes that Theorem 3 is similar in spirit to Shapley's core-existence result but logically independent: Shapley's convex-game condition concerns second differences of a characteristic function, whereas this theorem uses a condition on input demand. Kelso and Crawford, footnote 3.

The market and its allocations

Let WWW be a finite set of workers, with m=∣W∣m=|W|m=∣W∣. A coalition technology vvv assigns a real output v(C)v(C)v(C) to each worker set C⊆WC\subseteq WC⊆W. A one-sided allocation consists of a partition P=(Cz)P=(C_z)P=(Cz​) of all workers and one real salary sis_isi​ for each worker. The parts of PPP are disjoint and cover WWW. Each worker has a utility μi(si)\mu^i(s_i)μi(si​) that is continuous and strictly increasing in salary, so salary comparisons express the same preferences as utility comparisons.

The paper's individual rationality condition D1′ asks for nonnegative salaries and one aggregate resource constraint:

si≥0(i∈W),∑i∈Wsi≤∑C∈Pv(C).s_i\ge 0\quad(i\in W),\qquad \sum_{i\in W}s_i\le\sum_{C\in P}v(C).si​≥0(i∈W),i∈W∑​si​≤C∈P∑​v(C).

It does not require each partition block to finance its own salaries. An improving coalition is a worker set CCC with salaries ri≥sir_i\ge s_iri​≥si​ for every i∈Ci\in Ci∈C, a strict inequality for at least one member, and ∑i∈Cri≤v(C)\sum_{i\in C}r_i\le v(C)∑i∈C​ri​≤v(C). A D1′ allocation is in the strict core D2′ when no improving coalition exists. The empty coalition cannot improve because it contains no member whose salary could rise. These are equations (12)–(15) on pages 1492–1493 of the source paper.

To state gross substitutes (GS), imagine m+1m+1m+1 identical firms, each with production vvv. At a salary vector s:W→Rs:W\to\mathbb Rs:W→R, a firm's profit from employing CCC is π(C;s)=v(C)−∑i∈Csi\pi(C;s)=v(C)-\sum_{i\in C}s_iπ(C;s)=v(C)−∑i∈C​si​; a demanded set maximizes this profit over all worker subsets. GS says that if salaries rise coordinatewise from sss to s′s's′, then for every demanded set at sss there is a demanded set at s′s's′ containing all workers of the old set whose salaries stayed unchanged. The requirement is over all real salary vectors, as in the continuous market of Section 2.

Formalization targets

Goal: Theorem 3

Assume nonnegative marginal production (MP′), no free lunch (NFL), and GS for the identical fictitious firms:

v(C∪{i})−v(C)≥0,v(∅)=0,GS⁡(v).v(C\cup\{i\})-v(C)\ge 0,\qquad v(\varnothing)=0,\qquad \operatorname{GS}(v).v(C∪{i})−v(C)≥0,v(∅)=0,GS(v).

The goal is the exact existence statement

∃(P,s),(P,s) is a one-sided strict-core allocation for v.\exists (P,s),\quad (P,s)\text{ is a one-sided strict-core allocation for }v.∃(P,s),(P,s) is a one-sided strict-core allocation for v.

Theorem 3 appears on page 1493 of Kelso and Crawford. Its two milestones are claims from the proof: every dummy firm has zero profit at a fictitious-market strict-core allocation, and that allocation induces a one-sided strict-core allocation. Mission 2 targets the paper's Theorem 2, which supplies existence of the fictitious-market allocation; this mission does not pose a duplicate specialized version of it.

What the result gives

The theorem ensures that workers can be partitioned and paid without any group being able to make at least one of its members strictly better off while preserving every member's prior salary. It turns a condition on a firm's reactions to wage increases into stability of a market containing no firms. The result also identifies a concrete boundary for the core-existence argument: the paper later constructs a market without GS that has no core allocation in its two-sided setting. Kelso and Crawford, Section 6.

The theorem is proved in the 1982 paper; this mission asks for machine-checked statements and proofs of its one-sided definitions, the two transfer claims, and Theorem 3. The local Lean files compile as open statements, and a concrete one-worker instance checks that MP′, NFL and GS can hold together. That local check is not a proof of Theorem 3. The definition of GS for a finite demand problem can be reused beyond this mission, but the dummy-firm construction and the one-sided D1′–D2′ predicates follow this paper's conventions.

Why the transfer is delicate

A strict-core allocation of a two-sided market controls coalitions containing a firm, while D2′ is expressed entirely through worker coalitions. The fictitious market has more firms than workers, which forces at least one firm to employ nobody. The proof must connect that observation to every firm's profit and then translate a one-sided improving coalition into a two-sided improvement. Individual rationality also has to preserve the paper's aggregate budget condition. Merely assigning each worker to a firm or showing nonnegative firm profits would leave these links unproved.

Formalization scope

Workers form an arbitrary finite type; the empty case is included. The fictitious firms have type Fin (m + 1), so their count is strictly greater than the worker count even when m=0m=0m=0. Salaries and output are real. In the fictitious market, every firm uses the same vvv, each worker's utility at every firm is μi(s)\mu^i(s)μi(s), and reservation salary is zero, matching unemployment utility μi(0)\mu^i(0)μi(0). The milestones retain arbitrary strictly increasing continuous functions μi\mu^iμi; Theorem 3 does not quantify over them because D1′ and D2′ compare salaries directly. Theorem 3's GS condition ranges over all real salary vectors, not a discrete salary grid.

Mathlib finite partitions contain nonempty parts. The paper permits empty indexed groups, but NFL makes them contribute zero output. The allocation model assigns every worker to one firm, and strict blocking allows any worker coalition, including the empty set, although strict improvement excludes that case. D1′ uses one total salary bound; a per-group bound would change the theorem. D2′ requires a strict gain in a worker's salary, not merely slack in the production budget. No vacuous regularity condition, fixed special technology, or restriction to a single worker is part of the mission goal.

Contributions are welcome on the finite partition interface, properties of profit-maximizing demand under GS, the zero-profit claim, and the transfer from fictitious firms to worker coalitions. The shared market and demand definitions are kept in their own module so they can be consolidated with the other missions of this paper.

Selected references

  • A. S. Kelso, Jr. and V. P. Crawford, Job matching, coalition formation, and gross substitutes, Econometrica 50(6), 1982, pp. 1483–1504. DOI: 10.2307/1913392.
  • L. S. Shapley, Cores of convex games, International Journal of Game Theory 1, 1971, pp. 11–26. DOI: 10.1007/BF01753431.
6 thms2 active usersReviewed
Algorithmic Game TheoryMechanism Design·Captain: mikedeng1

Job Matching, Coalition Formation, and Gross Substitutes 4: Without Ties the Salary-Adjustment Process Reaches the Firm-Optimal Discrete Strict Core AllocationResearch Paper

Motivation

Labor markets match heterogeneous workers to heterogeneous firms, and the terms of each match — the salary — are negotiated. Kelso and Crawford (Econometrica 50 (1982)) studied such a market in which a firm may hire many workers, its output depends on the whole set it hires, and salaries are set worker by worker. Their model contains the marriage problem of Gale and Shapley (1962) and the assignment game of Shapley and Shubik (1971) as special cases, and its gross substitutes condition later became the central hypothesis of the theory of matching with contracts and of ascending auctions for indivisible goods (Hatfield and Milgrom, AER 2005; Gul and Stacchetti, JET 1999).

Markets of this kind usually have many stable outcomes, so which one arises depends on how the market is organized. Gale and Shapley showed that their deferred-acceptance procedure picks the stable matching that is best for the proposing side. Crawford and Knoer (Econometrica 1981) proved the analogue for one-to-one matching with money. Theorem 4 of Kelso and Crawford extends it to firms that hire many workers, under gross substitutes: the paper's salary-adjustment process, in which firms make offers, ends at the end of the strict core that favors the firms.

Setting

There are finitely many workers i∈Wi \in Wi∈W and firms j∈Fj \in Fj∈F. Worker iii values working for firm jjj at salary sss by ui(j;s)u^i(j; s)ui(j;s), strictly increasing and continuous in sss. Firm jjj produces yj(C)y^j(C)yj(C) when it hires the set CCC of workers and earns the profit πj(C;sj)=yj(C)−∑i∈Csij\pi^j(C; s^j) = y^j(C) - \sum_{i\in C} s_{ij}πj(C;sj)=yj(C)−∑i∈C​sij​ at the salary vector sjs^jsj. The number σij\sigma_{ij}σij​ is the starting permitted salary for iii at jjj; Section 2 initially defines it as a reservation salary, and Section 5 permits it to be perturbed. The paper's standing assumptions are (MP), yj(C∪{i})−yj(C)−σij≥0y^j(C\cup\{i\}) - y^j(C) - \sigma_{ij} \ge 0yj(C∪{i})−yj(C)−σij​≥0 for i∉Ci \notin Ci∈/C; (NFL), yj(∅)=0y^j(\varnothing) = 0yj(∅)=0; and (GS): if CCC maximizes firm jjj's profit at sjs^jsj and salaries rise weakly to s~j\tilde s^js~j, some profit-maximizing set at s~j\tilde s^js~j still contains every worker of CCC whose salary did not change.

In a discrete market with unit δ>0\delta > 0δ>0, firm jjj may offer worker iii only the salaries σij+kδ\sigma_{ij} + k\deltaσij​+kδ, k∈Nk \in \mathbb{N}k∈N. An allocation assigns every worker iii to a firm f(i)f(i)f(i) at a salary; CjC^jCj is the set hired by jjj. It is individually rational if every worker gets at least σif(i)\sigma_{if(i)}σif(i)​ and every firm a nonnegative profit. A firm and a set of workers at permitted salaries improve upon it if all of them are weakly better off and one of them strictly; they strictly improve upon it if all are strictly better off. Discrete strict core allocations (D2) admit no improving coalition, discrete core allocations (D3) no strictly improving one.

The salary-adjustment process (R1–R5) starts with permitted salaries sij(0)=σijs_{ij}(0) = \sigma_{ij}sij​(0)=σij​ and offers from every firm to every worker. In each round, each firm offers jobs to a profit-maximizing set at its current permitted salaries, repeating unrejected offers; each worker holds a favorite offer and rejects the others; a rejected firm's permitted salary for that worker rises by δ\deltaδ. The process stops in a round with no rejections. A worker is (strictly) sss-possible for firm jjj if some discrete (strict) core allocation assigns him or her to jjj at salary sss. The no-ties conditions are (NTW): a worker who is sijs_{ij}sij​-possible for jjj is never indifferent between (j,sij)(j, s_{ij})(j,sij​) and any permitted salary at another firm; and (NTF): a firm is never indifferent between its profit in a discrete core allocation and the profit from another nonempty set of workers at permitted salaries.

Formalization targets

Goal: Theorem 4 (p. 1495)

Under regularity, (MP), (NFL), (GS) on the permitted salary vectors, (NTW) and (NTF): every run of the process stops at some round, and at every stopping round TTT the resulting allocation ϕ\phiϕ is a discrete strict core allocation with

πj(CA′j;s′j)≤πj(Cϕj;sj(T))for every firm j and every discrete strict core allocation A′.\pi^j(C^j_{A'}; s'^j) \le \pi^j(C^j_\phi; s^j(T)) \qquad \text{for every firm } j \text{ and every discrete strict core allocation } A'.πj(CA′j​;s′j)≤πj(Cϕj​;sj(T))for every firm j and every discrete strict core allocation A′.

Milestones (proof of Theorem 4, p. 1495)

  1. Every equilibrium of the process is a discrete strict core allocation.
  2. No worker ever rejects a firm at a salary sss at which he or she is strictly sss-possible for it.
  3. For every strict core allocation (f;s′)(f; s')(f;s′), every round ttt and every worker iii: sif(i)(t)≤sif(i)′s_{if(i)}(t) \le s'_{if(i)}sif(i)​(t)≤sif(i)′​.

Significance

Theorem 4 says that the outcome of a decentralized ascending process, in which firms make the offers, is not an arbitrary stable outcome but the one best for every firm simultaneously. This existence of a firm-optimal point of the strict core is itself a consequence. Its Corollary (uniqueness of the equilibrium, mission 5 of this series) and Theorem 5 (an entering firm helps every worker, a departing worker hurts every firm, also mission 5) are both proved from it.

The result has been proved on paper since 1982, and nothing of this paper was on Prove2Me before this series. The mission produces a machine-checked version of the paper's model, of the salary-adjustment process for every tie-breaking rule, and of the firm-optimality argument. The no-money analogue, Gale and Shapley's optimality theorem for college admissions, has a proved formalization on the platform (GS62CollegeAdmissions.PaperInterface.theorem2_applicant_optimality); it does not involve salaries and is credited, not reused.

The series has seven missions: 1 (Theorem 1, convergence to a discrete core allocation), 2 (Theorem 2, the continuous strict core), 3 (Theorem 3, one-sided markets), 4 (this mission), 5 (comparative statics, Theorem 5), 6 (Theorem 6, gross substitutes and returns to workers), 7 (the no-core example of Section 6). This mission does not depend on the others: it states its own copy of the model.

Difficulty

The process is defined for every tie-breaking rule of firms and workers, so the claim concerns an entire family of executions, each indexed by rounds and carrying offers, tentative acceptances and salaries. The firm-optimality statement compares the process outcome with every strict core allocation, objects defined by a nonexistence condition over all coalitions and permitted salaries. The step that does not follow from Theorem 1 alone is that rejections never occur at a strictly possible salary. That claim is about the entire history of a run, not about its final round, and it ties a property of the core to every intermediate rejection. Without the no-ties hypotheses the paper guarantees only that the process stops at a discrete core allocation (D3, Theorem 1).

Formalization scope

Workers and firms are arbitrary finite types, with at least one firm; salaries are real numbers; larger utility is better. A discrete market is given by the unit δ>0\delta > 0δ>0, and the permitted salaries are σij+δN\sigma_{ij} + \delta\mathbb{N}σij​+δN (the paper's unit is 1; Theorem 2 lets it shrink, so it is kept general). The starting salaries σij\sigma_{ij}σij​ are data; the relation ui(j;σij)=ui(0;0)u^i(j;\sigma_{ij}) = u^i(0;0)ui(j;σij​)=ui(0;0) is not assumed, because Section 5 perturbs σij\sigma_{ij}σij​ independently of ui(0;0)u^i(0;0)ui(0;0) to obtain (NTW), and under that relation (NTW) typically fails in round 0. Allocations assign every worker to a firm. (GS) is imposed on the permitted salary vectors of the discrete market only.

Explicit readings of the paper's phrases:

  • "converges to" means: every run stops at some round, and every stopping round yields the stated allocation;
  • "any other strict core allocation" means any discrete strict core allocation of the same discrete market;
  • "at least as good for every firm" is a weak profit inequality at every firm;
  • (NTW) and (NTF) are about discrete core allocations (D3), as printed, and "any other non-empty set of workers" in (NTF) is read as a nonempty set different from CjC^jCj;
  • a run of R1–R5 is any sequence of salaries, offers and tentative acceptances obeying the rules, with all ties broken arbitrarily; the statements cover every run.

Statements that quantify over runs would be empty if no run existed, and (NTW), (NTF) are hypotheses about the core that could in principle be contradictory; a sorry-free local check confirms all hypotheses on a market with one firm and one worker and exhibits a run that stops at a strict core allocation, so the goal is not vacuous. Trivializing readings — comparing with continuous strict core allocations, imposing (NTW)/(NTF) only on strict core allocations, or comparing a single firm — are excluded by the statement.

Infrastructure needed: the model, the run encoding, and lemmas about runs (salaries are monotone and stay on the grid, every worker always holds an offer, every run stops — Theorem 1). These are reusable for missions 1 and 5. Contributions to any milestone, and alternative proofs, are welcome.

Selected references

  • A. S. Kelso, Jr. and V. P. Crawford, Job matching, coalition formation, and gross substitutes, Econometrica 50(6), 1982, 1483–1504. https://doi.org/10.2307/1913392
  • V. P. Crawford and E. M. Knoer, Job matching with heterogeneous firms and workers, Econometrica 49(2), 1981, 437–450. https://doi.org/10.2307/1912758
  • D. Gale and L. S. Shapley, College admissions and the stability of marriage, American Mathematical Monthly 69(1), 1962, 9–15. https://doi.org/10.2307/2312726
  • L. S. Shapley and M. Shubik, The assignment game I: The core, International Journal of Game Theory 1, 1971, 111–130. https://doi.org/10.1007/BF01753437
  • J. W. Hatfield and P. R. Milgrom, Matching with contracts, American Economic Review 95(4), 2005, 913–935. https://doi.org/10.1257/0002828054825466
  • F. Gul and E. Stacchetti, Walrasian equilibrium with gross substitutes, Journal of Economic Theory 87(1), 1999, 95–124. https://doi.org/10.1006/jeth.1999.2531
8 thms2 active usersReviewed
Convex OptimizationOptimization·Captain: mikedeng1

Primal-Dual Interior-Point Methods for Self-Scaled Cones I: After One Short Step from N(β), λ₂(x₊, s₊) ≤ (2 + δ − κ)(ϵ + κ)²/((1 − δ)²(1 − κ)³)Research Paper

Motivation

Linear programming, second-order cone programming and semidefinite programming are all instances of conic linear programming: minimize a linear function over the intersection of an affine subspace with a closed convex cone. Primal-dual interior-point methods solve these problems in polynomially many iterations and are the algorithms behind most conic solvers in practical use. Nesterov and Todd showed that the primal-dual path-following analysis known for linear programming extends verbatim to every cone that admits a self-scaled barrier, a class containing the nonnegative orthant, the second-order cone, the cone of positive semidefinite matrices, and their products (Nesterov & Todd 1997; Nesterov & Todd 1998).

Timeline. Kojima, Mizuno and Yoshise (1989) and Monteiro and Adler (1989) gave short-step primal-dual path-following methods for linear programming with an O(nln⁡(1/ε))O(\sqrt n \ln(1/\varepsilon))O(n​ln(1/ε)) iteration bound. Mizuno, Todd and Ye (1993) added the predictor-corrector variant. Nesterov and Nemirovskii (1994) developed the general theory of self-concordant barriers. Nesterov and Todd (1997) introduced self-scaled barriers and scaling points; the 1998 paper analysed the short-step, adaptive-step and predictor-corrector methods for them. Güler (1996) identified self-scaled cones with symmetric (homogeneous self-dual) cones.

Setting

Let E=RnE = \mathbb R^nE=Rn with inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩, and let K⊆EK \subseteq EK⊆E be a closed convex cone that is pointed and has nonempty interior; K∗={s:⟨s,x⟩≥0 ∀x∈K}K^* = \{s : \langle s, x\rangle \ge 0\ \forall x \in K\}K∗={s:⟨s,x⟩≥0 ∀x∈K} is its dual cone. A linear map A:Rn→RmA : \mathbb R^n \to \mathbb R^mA:Rn→Rm (surjective), b∈Rmb \in \mathbb R^mb∈Rm and c∈Rnc \in \mathbb R^nc∈Rn define the primal problem min⁡{⟨c,x⟩:Ax=b, x∈K}\min\{\langle c, x\rangle : Ax = b,\ x \in K\}min{⟨c,x⟩:Ax=b, x∈K} and its dual max⁡{⟨b,y⟩:A∗y+s=c, s∈K∗}\max\{\langle b, y\rangle : A^*y + s = c,\ s \in K^*\}max{⟨b,y⟩:A∗y+s=c, s∈K∗}. Strictly feasible points are x∈S0(P)x \in S^0(P)x∈S0(P) (x∈int⁡Kx \in \operatorname{int} Kx∈intK, Ax=bAx = bAx=b) and (y,s)∈S0(D)(y, s) \in S^0(D)(y,s)∈S0(D) (s∈int⁡K∗s \in \operatorname{int}K^*s∈intK∗, A∗y+s=cA^*y + s = cA∗y+s=c).

A ν\nuν-self-concordant logarithmically homogeneous barrier FFF for KKK is a self-concordant convex function on int⁡K\operatorname{int} KintK that tends to +∞+\infty+∞ at the boundary, satisfies (⟨F′(x),h⟩)2≤ν⟨F′′(x)h,h⟩(\langle F'(x), h\rangle)^2 \le \nu\langle F''(x)h, h\rangle(⟨F′(x),h⟩)2≤ν⟨F′′(x)h,h⟩ and F(τx)=F(x)−νln⁡τF(\tau x) = F(x) - \nu\ln\tauF(τx)=F(x)−νlnτ. Its conjugate is F∗(s)=sup⁡x∈int⁡K{−⟨s,x⟩−F(x)}F_*(s) = \sup_{x \in \operatorname{int}K}\{-\langle s, x\rangle - F(x)\}F∗​(s)=supx∈intK​{−⟨s,x⟩−F(x)}. The barrier is self-scaled if F′′(w)x∈int⁡K∗F''(w)x \in \operatorname{int}K^*F′′(w)x∈intK∗ and F∗(F′′(w)x)=F(x)−2F(w)−νF_*(F''(w)x) = F(x) - 2F(w) - \nuF∗​(F′′(w)x)=F(x)−2F(w)−ν for all w,x∈int⁡Kw, x \in \operatorname{int}Kw,x∈intK. For x∈int⁡Kx \in \operatorname{int}Kx∈intK and s∈int⁡K∗s \in \operatorname{int}K^*s∈intK∗ the scaling point is the w∈int⁡Kw \in \operatorname{int}Kw∈intK with F′′(w)x=sF''(w)x = sF′′(w)x=s.

Local norms at x∈int⁡Kx \in \operatorname{int}Kx∈intK are ∥v∥x=⟨F′′(x)v,v⟩1/2\|v\|_x = \langle F''(x)v, v\rangle^{1/2}∥v∥x​=⟨F′′(x)v,v⟩1/2 for primal vectors and ∥u∥x=⟨[F′′(x)]−1u,u⟩1/2\|u\|_x = \langle [F''(x)]^{-1}u, u\rangle^{1/2}∥u∥x​=⟨[F′′(x)]−1u,u⟩1/2 for dual vectors; ∣u∣x|u|_x∣u∣x​ is the cone-induced (max-type) norm. With μ(x,s)=⟨s,x⟩/ν\mu(x, s) = \langle s, x\rangle/\nuμ(x,s)=⟨s,x⟩/ν the proximity measures are

λ2(x,s)=∥sμ(x,s)+F′(x)∥x,λ∞(x,s)=∣sμ(x,s)+F′(x)∣x,\lambda_2(x, s) = \Big\|\frac{s}{\mu(x,s)} + F'(x)\Big\|_x,\qquad \lambda_\infty(x, s) = \Big|\frac{s}{\mu(x,s)} + F'(x)\Big|_x,λ2​(x,s)=​μ(x,s)s​+F′(x)​x​,λ∞​(x,s)=​μ(x,s)s​+F′(x)​x​,

and λˉ2(x,s,μ)=∥s/μ+F′(x)∥x\bar\lambda_2(x, s, \mu) = \|s/\mu + F'(x)\|_xλˉ2​(x,s,μ)=∥s/μ+F′(x)∥x​. The narrow neighbourhood is N(β)={(x,y,s)∈S0(P)×S0(D):λ2(x,s)≤β}N(\beta) = \{(x,y,s) \in S^0(P)\times S^0(D) : \lambda_2(x, s) \le \beta\}N(β)={(x,y,s)∈S0(P)×S0(D):λ2​(x,s)≤β}.

The short step from (x,y,s)∈N(β)(x, y, s) \in N(\beta)(x,y,s)∈N(β) targets μ+=(1−κ/ν)μ(x,s)\mu_+ = (1 - \kappa/\sqrt\nu)\mu(x,s)μ+​=(1−κ/ν​)μ(x,s) and solves

F′′(w)qx+qs=s+μ+F′(x),Aqx=0,A∗qy+qs=0,F''(w)q_x + q_s = s + \mu_+F'(x),\qquad Aq_x = 0,\qquad A^*q_y + q_s = 0,F′′(w)qx​+qs​=s+μ+​F′(x),Aqx​=0,A∗qy​+qs​=0,

then sets (x+,y+,s+)=(x−qx,y−qy,s−qs)(x_+, y_+, s_+) = (x - q_x, y - q_y, s - q_s)(x+​,y+​,s+​)=(x−qx​,y−qy​,s−qs​).

Formalization targets

Goal: Theorem 6.4

With δ=λ∞(x,s)\delta = \lambda_\infty(x,s)δ=λ∞​(x,s), ϵ=λ2(x,s)\epsilon = \lambda_2(x,s)ϵ=λ2​(x,s), ϵ+=λˉ2(x,s,μ+)\epsilon_+ = \bar\lambda_2(x, s, \mu_+)ϵ+​=λˉ2​(x,s,μ+​) and η=ϵ+/(1−δ)<1\eta = \epsilon_+/(1-\delta) < 1η=ϵ+​/(1−δ)<1:

x+∈int⁡K,s+∈int⁡K∗,μ(x+,s+)=μ+,λ2(x+,s+)=λˉ2(x+,s+,μ+)≤(2+δ−κ)(ϵ+κ)2(1−δ)2(1−κ)3.x_+ \in \operatorname{int}K,\quad s_+ \in \operatorname{int}K^*,\quad \mu(x_+, s_+) = \mu_+,\quad \lambda_2(x_+, s_+) = \bar\lambda_2(x_+, s_+, \mu_+) \le \frac{(2 + \delta - \kappa)(\epsilon + \kappa)^2}{(1-\delta)^2(1-\kappa)^3}.x+​∈intK,s+​∈intK∗,μ(x+​,s+​)=μ+​,λ2​(x+​,s+​)=λˉ2​(x+​,s+​,μ+​)≤(1−δ)2(1−κ)3(2+δ−κ)(ϵ+κ)2​.

The constant κ∈(0,1)\kappa \in (0,1)κ∈(0,1) and β∈(0,1)\beta \in (0,1)β∈(0,1) are free; no numerical choice is hard-coded.

Milestones

Theorem 3.6 (norms at neighbouring points), Lemma 3.13 and Corollary 3.14 (scaling-point Hessian versus the Hessians at xxx and sss), Lemma 6.2 (effect of decreasing μ\muμ), (6.10) (the gap after the step), and Lemma 6.3 (size of the step, feasibility, norms at x+x_+x+​).

Companion results

The Algorithm 6.1 invariant (β=1/10\beta = 1/10β=1/10, κ=1/15\kappa = 1/15κ=1/15: iterates stay in N(1/10)N(1/10)N(1/10) while μ\muμ shrinks by 1−(15ν)−11 - (15\sqrt\nu)^{-1}1−(15ν​)−1), Theorem 6.5 (the predictor step length α∗≥(10ν)−1\alpha^* \ge (10\sqrt\nu)^{-1}α∗≥(10ν​)−1), and Lemma 6.1.

Significance

Theorem 6.4 is the one-step estimate behind the O(νln⁡(⟨s0,x0⟩/ζ))O(\sqrt\nu\ln(\langle s_0, x_0\rangle/\zeta))O(ν​ln(⟨s0​,x0​⟩/ζ)) iteration bound of the short-step method on every symmetric cone, and with it of the most widely used complexity bounds for semidefinite and second-order cone programming. The same estimate, with κ=0\kappa = 0κ=0, certifies the corrector step of the predictor-corrector method (Algorithm 6.3).

The results are proved in the paper; none is formalized. A Lean development would provide a machine-checked core of conic interior-point theory: the local-norm calculus of self-scaled barriers (Theorem 3.6, Lemma 3.13), which is reused across all the methods of the paper, and a verified complexity statement for an algorithm family used in practice. The companion mission on the functional-proximity method (Theorem 7.1 of the same paper) shares the setting.

Difficulty

The obvious argument expands s++μ+F′(x+)s_+ + \mu_+F'(x_+)s+​+μ+​F′(x+​) and bounds each term by self-concordance. Generic self-concordance controls norms at a new point only under ∥x+−x∥x<1\|x_+ - x\|_x < 1∥x+​−x∥x​<1 and gives constants that do not close the recursion with β=1/10\beta = 1/10β=1/10; it also says nothing about the dual side. The proof needs properties special to self-scaled barriers: the scaling point www and the two-sided comparison of F′′(w)/μF''(w)/\muF′′(w)/μ with F′′(x)F''(x)F′′(x) (Lemma 3.13), norm comparisons under the weaker hypothesis ∣x+−x∣x<1|x_+ - x|_x < 1∣x+​−x∣x​<1 (Theorem 3.6), and a third-derivative bound from Nesterov–Todd 1997. In Lean, none of the self-scaled barrier theory, conjugate barriers on cones, or local norms exists in Mathlib.

Formalization scope

EEE is EuclideanSpace ℝ (Fin n) and E∗E^*E∗ is identified with EEE through the inner product. Because the paper distinguishes primal and dual norms by the space of the argument, the formalization names them: lnorm G v u (same space as vvv) and dnorm G v u (other space, through the inverse Hessian), for G=FG = FG=F or G=F∗G = F_*G=F∗​; sigma C c u and absn C c u take the cone and the centre explicitly. The conjugate is a real supremum over int⁡K\operatorname{int}KintK and is only evaluated in int⁡K∗\operatorname{int}K^*intK∗. λ2\lambda_2λ2​, λ∞\lambda_\inftyλ∞​ use the first of their two printed forms.

Standing assumptions carried by every statement: KKK proper, FFF a ν\nuν-self-scaled barrier, and ν≥1\nu \ge 1ν≥1 (a consequence of pointedness that the paper derives). The barrier definition adds positive definiteness of F′′F''F′′ on int⁡K\operatorname{int}KintK, implied by the other conditions for a pointed cone. Theorem 6.4 adds 0<κ<10 < \kappa < 10<κ<1 (the paper's "some fixed constant", forced by its proof) and the conclusion x+∈int⁡Kx_+ \in \operatorname{int}Kx+​∈intK, s+∈int⁡K∗s_+ \in \operatorname{int}K^*s+​∈intK∗ from Lemma 6.3. Assumptions (2.4)–(2.5) are implied by the strictly feasible starting point. In Theorem 3.6 the middle factors of (3.12) are corrected to (1−p+)(1 - p_+)(1−p+​) and (1+p−)(1 + p_-)(1+p−​); the printed ones fail for the half-line.

Search directions are any solution of their linear systems; their existence is not assumed. The goal assumes no bound from Lemmas 6.2–6.3 and no value of μ(x+,s+)\mu(x_+, s_+)μ(x+​,s+​), so it cannot be discharged by restating its hypotheses.

Needed infrastructure: derivatives of logarithmically homogeneous functions ((2.7)–(2.10)), properties of the conjugate barrier ((2.12)–(2.16)), the existence and properties of scaling points (Nesterov–Todd 1997), and the local norm inequalities of self-concordant functions. These are reusable for any interior-point formalization; contributions of such lemmas are welcome.

Selected references

  • Yu. E. Nesterov and M. J. Todd, Primal-dual interior-point methods for self-scaled cones, SIAM J. Optim. 8 (1998) 324–364. https://doi.org/10.1137/S1052623495290209
  • Yu. E. Nesterov and M. J. Todd, Self-scaled barriers and interior-point methods for convex programming, Math. Oper. Res. 22 (1997) 1–42. https://doi.org/10.1287/moor.22.1.1
  • Yu. Nesterov and A. Nemirovskii, Interior-Point Polynomial Algorithms in Convex Programming, SIAM, 1994. https://doi.org/10.1137/1.9781611970791
  • O. Güler, Barrier functions in interior point methods, Math. Oper. Res. 21 (1996) 860–885. https://doi.org/10.1287/moor.21.4.860
  • M. Kojima, S. Mizuno and A. Yoshise, A primal-dual interior point algorithm for linear programming, in Progress in Mathematical Programming, Springer, 1989, 29–47. https://doi.org/10.1007/978-1-4613-9617-8_2
  • S. Mizuno, M. J. Todd and Y. Ye, On adaptive-step primal-dual interior-point algorithms for linear programming, Math. Oper. Res. 18 (1993) 964–981. https://doi.org/10.1287/moor.18.4.964
11 thms2 active usersReviewed
Algorithmic Game TheoryMechanism Design·Captain: mikedeng1

Job Matching, Coalition Formation, and Gross Substitutes 2: Under Gross Substitutes Every Job-Matching Market with Continuous Salaries Has a Strict Core AllocationResearch Paper

Motivation

Labour markets match workers to firms that hire teams: a firm's output depends on the whole set of workers it employs, while each worker holds one job. A salary agreement is stable when no firm and group of workers can renegotiate among themselves to the benefit of all of them. Shapley and Shubik (1971) showed that such stable outcomes exist when each firm hires at most one worker and utility is transferable; Crawford and Knoer (1981) extended this to general utilities, still one-to-one. Kelso and Crawford (1982) let firm size be endogenous and identified the condition under which existence survives: workers must be gross substitutes for every firm. Their condition later became the standard assumption for existence of Walrasian equilibrium with indivisible goods (Gul and Stacchetti, 1999) and the basis of matching with contracts (Hatfield and Milgrom, 2005).

This mission is the second of a seven-mission series on the paper: 1, the salary-adjustment process; 2, existence of a strict core with continuous salaries (this mission); 3, one-sided coalition formation; 4, the firm-optimal allocation; 5, comparative statics; 6, gross substitutes versus nonincreasing returns; 7, a market with no core. Each mission is self-contained. Nothing of this paper was on Prove2Me before this series.

Setting

There is a finite set WWW of mmm workers and a nonempty finite set FFF of firms. Worker iii's utility of working for firm jjj at salary s∈Rs\in\mathbb Rs∈R is ui(j;s)u^i(j;s)ui(j;s), strictly increasing and continuous in sss. Firm jjj's gross product when it hires the set C⊆WC\subseteq WC⊆W is yj(C)y^j(C)yj(C), and its profit at the salary vector sj=(sij)i∈Ws^j=(s_{ij})_{i\in W}sj=(sij​)i∈W​ is

πj(C;sj)=yj(C)−∑i∈Csij.\pi^j(C;s^j)=y^j(C)-\sum_{i\in C}s_{ij}.πj(C;sj)=yj(C)−i∈C∑​sij​.

The reservation salary σij\sigma_{ij}σij​ is defined by ui(j;σij)=ui(0;0)u^i(j;\sigma_{ij})=u^i(0;0)ui(j;σij​)=ui(0;0), worker iii's utility of unemployment. Section 2 of the paper assumes, for every firm jjj:

  • (MP) yj(C∪{i})−yj(C)−σij≥0y^j(C\cup\{i\})-y^j(C)-\sigma_{ij}\ge0yj(C∪{i})−yj(C)−σij​≥0 whenever i∉Ci\notin Ci∈/C;
  • (NFL) yj(∅)=0y^j(\emptyset)=0yj(∅)=0;
  • (GS) if CCC maximizes πj(⋅ ;sj)\pi^j(\cdot\,;s^j)πj(⋅;sj) and s~j≥sj\tilde s^j\ge s^js~j≥sj componentwise, then some maximizer C~\tilde CC~ of πj(⋅ ;s~j)\pi^j(\cdot\,;\tilde s^j)πj(⋅;s~j) contains every i∈Ci\in Ci∈C with s~ij=sij\tilde s_{ij}=s_{ij}s~ij​=sij​.

An allocation assigns each worker iii to a firm f(i)f(i)f(i) at salary sif(i)s_{if(i)}sif(i)​; firm jjj hires Cj={i:f(i)=j}C^j=\{i:f(i)=j\}Cj={i:f(i)=j}. It is individually rational (D1) if sif(i)≥σif(i)s_{if(i)}\ge\sigma_{if(i)}sif(i)​≥σif(i)​ and πj(Cj;sj)≥0\pi^j(C^j;s^j)\ge0πj(Cj;sj)≥0 for all i,ji,ji,j. A firm jjj, a set CCC and salaries rijr_{ij}rij​ improve upon it if ui(j;rij)≥ui(f(i);sif(i))u^i(j;r_{ij})\ge u^i(f(i);s_{if(i)})ui(j;rij​)≥ui(f(i);sif(i)​) for i∈Ci\in Ci∈C and πj(C;rj)≥πj(Cj;sj)\pi^j(C;r^j)\ge\pi^j(C^j;s^j)πj(C;rj)≥πj(Cj;sj), with at least one inequality strict; they strictly improve upon it if all are strict. A strict core allocation (D2) is an individually rational allocation no coalition improves upon; a core allocation (D3) is one no coalition strictly improves upon. In the continuous market coalitions may use any real salaries; in the discrete market of unit δ>0\delta>0δ>0 all salaries lie on the grids σij+δN\sigma_{ij}+\delta\mathbb Nσij​+δN.

Formalization targets

Goal: Theorem 2

Under regular utilities, (MP), (NFL), the reservation-salary relation and (GS) on all real salary vectors,

∃ (f;s) individually rational that no firm–worker coalition can improve upon (D2).\exists\,(f;s)\ \text{individually rational that no firm–worker coalition can improve upon (D2).}∃(f;s) individually rational that no firm–worker coalition can improve upon (D2).

The goal fixes no grid, no constant and no particular technology.

Milestones, in the order of the paper's proof

  1. Every discrete market has a core (p. 1490): for every δ>0\delta>0δ>0, if (GS) holds on grid salary vectors, a discrete core allocation (D3) exists.
  2. The gains are bounded above zero (p. 1491, eqs. (8)–(11)): if the continuous market has no strict core allocation, there is H>0H>0H>0 such that every individually rational allocation admits a coalition that leaves its workers no worse off and raises its firm's profit by at least HHH.
  3. A fine grid inherits the improvement (pp. 1491–1492): with such an HHH, every individually rational grid allocation of unit 0<δ<H/(m+1)0<\delta<H/(m+1)0<δ<H/(m+1) can be strictly improved upon in the discrete market.

Significance

Theorem 2 gives existence of a stable assignment of workers to firms with salaries, for arbitrary technologies under which workers are gross substitutes, without any convexity or divisibility of labour. Because the core and the competitive equilibrium coincide in this model when salaries are divisible (p. 1487), it is also an existence theorem for competitive equilibrium in a market with indivisible workers; the example of mission 7 shows that it fails without (GS). The Shapley–Shubik assignment game is the special case ui(j;s)=aij+su^i(j;s)=a_{ij}+sui(j;s)=aij​+s, yj(C)=∑i∈Cbijy^j(C)=\sum_{i\in C}b_{ij}yj(C)=∑i∈C​bij​ with at most one worker per firm.

The result has been proved since 1982; it has not been machine-checked. Prove2Me holds a formalization of the Shapley–Shubik assignment game (AssignmentGame.CoreLP), whose core-existence theorem is a different model and is not yet proved, and Murota's gross-substitutes axioms for demand on Zn\mathbb Z^nZn, which concern one price per good rather than firm-specific salary vectors over sets of workers. Neither supplies this market or Theorem 2.

Difficulty

Discrete core allocations exist at every unit δ\deltaδ, so the natural first idea is to take a sequence of them as δ→0\delta\to0δ→0 and pass to a limit. A limit of discrete core allocations need only be a core allocation of the continuous market in the weak sense D3, and a coalition that improves upon the limit may need salaries off every grid; nothing in the discrete statements controls how much a coalition gains, so the blocking coalitions of the continuous market may vanish on the grids. The required control has to be uniform over all individually rational allocations, which form an infinite set, while each blocking comparison involves the utilities of several workers and a nonadditive technology. A second obstacle is in the paper's notation: the gain (8) uses the salary ρij\rho_{ij}ρij​ with ui(j;ρij)=ui[f(i);sif(i)]u^i(j;\rho_{ij})=u^i[f(i);s_{if(i)}]ui(j;ρij​)=ui[f(i);sif(i)​], which need not exist when ui(j;⋅)u^i(j;\cdot)ui(j;⋅) is bounded.

Formalization scope

Workers and firms are arbitrary finite types; every theorem assumes at least one firm (the paper's n≥1n\ge1n≥1), since with no firm and some worker no allocation exists. Salaries, utilities, outputs and profits are real numbers. An allocation has no unemployment, as in D1. The reservation salaries σ\sigmaσ are data, and the paper's definition of σij\sigma_{ij}σij​ enters as the hypothesis ui(j;σij)=ui(k;σik)u^i(j;\sigma_{ij})=u^i(k;\sigma_{ik})ui(j;σij​)=ui(k;σik​); it is assumed on the goal and on milestones 2 and 3, where the discretization step needs every improving salary to be at least σij\sigma_{ij}σij​. Milestone 1 assumes neither this relation nor continuous (GS). The standing assumptions of p. 1486, which Theorem 2's sentence does not repeat, are hypotheses of the goal.

Explicit readings of the paper's phrases: "continuous market" means coalitions may use any real salary; "bounded above zero" is one H>0H>0H>0 valid for every individually rational allocation, stated without ρij\rho_{ij}ρij​ by quantifying over admissible coalition salaries; "the unit of measurement smaller than H/(m+1)H/(m+1)H/(m+1)" is 0<δ<H/(m+1)0<\delta<H/(m+1)0<δ<H/(m+1) with m=∣W∣m=|W|m=∣W∣ and the division in R\mathbb RR; the discrete market's salaries are σij+δk\sigma_{ij}+\delta kσij​+δk, k∈Nk\in\mathbb Nk∈N, the paper's integer salaries starting at σij\sigma_{ij}σij​ (R1, R4) with a general unit.

Trivializing formalizations are ruled out: the goal assumes (GS) on all real vectors rather than on one grid (a stronger theorem the paper does not prove), its conclusion is the strict core D2 rather than the weaker core D3, and its hypotheses are satisfiable (a one-worker, one-firm market satisfies all of them).

A complete development needs finite optimization over sets of workers, a compactness argument over the individually rational salary schedules of each assignment, and the existence of discrete core allocations (the existence form of Theorem 1, mission 1). Proofs of the milestones, of the equivalence of D2 and D3 in the continuous market, and lemmas on finite demand correspondences reusable across the series are welcome.

Selected references

  • A. S. Kelso, Jr. and V. P. Crawford, Job Matching, Coalition Formation, and Gross Substitutes, Econometrica 50(6), 1982, 1483–1504. https://doi.org/10.2307/1913392
  • V. P. Crawford and E. M. Knoer, Job Matching with Heterogeneous Firms and Workers, Econometrica 49(2), 1981, 437–450. https://doi.org/10.2307/1912751
  • L. S. Shapley and M. Shubik, The Assignment Game I: The Core, International Journal of Game Theory 1, 1971, 111–130. https://doi.org/10.1007/BF01753437
  • F. Gul and E. Stacchetti, Walrasian Equilibrium with Gross Substitutes, Journal of Economic Theory 87(1), 1999, 95–124. https://doi.org/10.1006/jeth.1999.2531
  • J. W. Hatfield and P. R. Milgrom, Matching with Contracts, American Economic Review 95(4), 2005, 913–935. https://doi.org/10.1257/0002828054825466
6 thms2 active usersReviewed
Machine LearningOptimizationProbability·Captain: mikedeng1

A Nonparametric Asymptotic Analysis of Inventory Planning with Censored Demand 2: Without a Bound on y^NV, Expanding-Projection AIM Has Regret ≤ max{b,h}(T^{δ−1/2} + T^{−1/2} + (y^NV)^{1+2/δ}/T)Research Paper

Motivation

A retailer who restocks a product every period must pick an order-up-to level without knowing the demand distribution. When a period ends with an empty shelf, the retailer records only its sales, so the true demand above the stock level is censored. The classical newsvendor solution, the critical fractile of the demand distribution, cannot be computed. Huh and Rusmevichientong (Math. Oper. Res., 2009) treat this as an online convex optimization problem: the expected one-period cost is convex in the stock level, and its derivative can be estimated without bias from the censored observation alone. Their Adaptive Inventory Management (AIM) algorithm is a projected stochastic subgradient method in the style of Zinkevich (2003) and Flaxman, Kalai and McMahan (2005). Its average expected cost converges to the newsvendor cost at rate O(1/T)O(1/\sqrt T)O(1/T​).

That analysis assumes that the manager knows an upper bound yˉ\bar yyˉ​ on the newsvendor quantity, and the algorithm projects onto [0,yˉ][0,\bar y][0,yˉ​]. This mission formalizes §3.1 of the paper, which removes the assumption. The projection interval grows with time, and the regret bound is explicit in the unknown newsvendor quantity. Earlier adaptive schemes for censored newsvendor problems include Godfrey and Powell (2001) and Burnetas and Smith (2000).

Setting

Periods are t=1,2,…t = 1, 2, \dotst=1,2,…. Demands D1,D2,…D_1, D_2, \dotsD1​,D2​,… are i.i.d. copies of a nonnegative random variable DDD with finite mean and distribution function FFF. Inventory is perishable: every period starts empty, so the stock level is exactly the order-up-to level. With holding cost h>0h > 0h>0 per unit left over and shortage cost b>0b > 0b>0 per unit of unmet demand, the expected one-period cost at level y≥0y \ge 0y≥0 is

Q(y)=h E[y−D]++b E[D−y]+.Q(y) = h\,E[y-D]^+ + b\,E[D-y]^+ .Q(y)=hE[y−D]++bE[D−y]+.

The newsvendor quantity is yNV=inf⁡{y≥0:F(y)≥b/(b+h)}y^{NV} = \inf\{y \ge 0 : F(y) \ge b/(b+h)\}yNV=inf{y≥0:F(y)≥b/(b+h)}, the minimizer of QQQ.

Write Bˉ=max⁡{b,h}\bar B = \max\{b,h\}Bˉ=max{b,h} and P[0,a](z)=max⁡{min⁡{z,a},0}P_{[0,a]}(z) = \max\{\min\{z,a\},0\}P[0,a]​(z)=max{min{z,a},0}. After period ttt, the manager observes whether demand fell short of the stock level and forms the signal

Ht(y)={h,Dt<y,−b,Dt≥y.H_t(y) = \begin{cases} h, & D_t < y,\\ -b, & D_t \ge y.\end{cases}Ht​(y)={h,−b,​Dt​<y,Dt​≥y.​

Fix δ∈(0,1/2)\delta \in (0, 1/2)δ∈(0,1/2). The modified AIM algorithm starts from a level y^1δ∈[0,1]\hat y^\delta_1 \in [0,1]y^​1δ​∈[0,1] and updates

y^t+1δ=P[0, tδ/2] ⁣(y^tδ−ϵtHt(y^tδ)),ϵt=1Bˉt.\hat y^\delta_{t+1} = P_{[0,\,t^{\delta/2}]}\!\left(\hat y^\delta_t - \epsilon_t H_t(\hat y^\delta_t)\right), \qquad \epsilon_t = \frac{1}{\bar B\sqrt t}.y^​t+1δ​=P[0,tδ/2]​(y^​tδ​−ϵt​Ht​(y^​tδ​)),ϵt​=Bˉt​1​.

Neither the step size nor the projection interval uses any bound on yNVy^{NV}yNV. The level y^tδ\hat y^\delta_ty^​tδ​ depends only on D1,…,Dt−1D_1, \dots, D_{t-1}D1​,…,Dt−1​, and only through the censored observations.

Formalization targets

Goal: Theorem 7 (p. 11)

For every δ∈(0,1/2)\delta \in (0, 1/2)δ∈(0,1/2) and every T≥1T \ge 1T≥1,

E[1T∑t=1TQ(y^tδ)]−Q(yNV)≤max⁡{b,h}[1T0.5−δ+1T0.5+(yNV)1+2/δT].E\left[\frac1T\sum_{t=1}^T Q(\hat y^\delta_t)\right] - Q(y^{NV}) \le \max\{b,h\}\left[\frac{1}{T^{0.5-\delta}} + \frac{1}{T^{0.5}} + \frac{(y^{NV})^{1+2/\delta}}{T}\right].E[T1​t=1∑T​Q(y^​tδ​)]−Q(yNV)≤max{b,h}[T0.5−δ1​+T0.51​+T(yNV)1+2/δ​].

The bound holds uniformly over all demand laws with finite mean. The price of not knowing yˉ\bar yyˉ​ is the slower rate Tδ−1/2T^{\delta - 1/2}Tδ−1/2 and a transient term in which yNVy^{NV}yNV enters polynomially.

Milestones (proof of Theorem 7, p. 12)

  1. One-step inequality, the instance of Eq. (15) (Appendix A, p. 16) used in the proof. For each ttt with yNV≤tδ/2y^{NV} \le t^{\delta/2}yNV≤tδ/2,
E[Q(y^tδ)−Q(yNV)]≤E∣y^tδ−yNV∣22ϵt−E∣y^t+1δ−yNV∣22ϵt+ϵt2E∣Ht(y^tδ)∣2.E[Q(\hat y^\delta_t) - Q(y^{NV})] \le \frac{E|\hat y^\delta_t - y^{NV}|^2}{2\epsilon_t} - \frac{E|\hat y^\delta_{t+1} - y^{NV}|^2}{2\epsilon_t} + \frac{\epsilon_t}{2} E|H_t(\hat y^\delta_t)|^2 .E[Q(y^​tδ​)−Q(yNV)]≤2ϵt​E∣y^​tδ​−yNV∣2​−2ϵt​E∣y^​t+1δ​−yNV∣2​+2ϵt​​E∣Ht​(y^​tδ​)∣2.
  1. Eq. (10): early rounds, where the projection interval has not yet reached yNVy^{NV}yNV:
E[∑1≤t≤T, t<(yNV)2/δ{Q(y^tδ)−Q(yNV)}]≤Bˉ (yNV)1+2/δ.E\Big[\sum_{1 \le t \le T,\ t < (y^{NV})^{2/\delta}} \{Q(\hat y^\delta_t) - Q(y^{NV})\}\Big] \le \bar B\,(y^{NV})^{1+2/\delta}.E[1≤t≤T, t<(yNV)2/δ∑​{Q(y^​tδ​)−Q(yNV)}]≤Bˉ(yNV)1+2/δ.
  1. Eq. (11): late rounds:
E[∑1≤t≤T, t≥(yNV)2/δ{Q(y^tδ)−Q(yNV)}]≤Bˉ T0.5+δ+Bˉ T0.5.E\Big[\sum_{1 \le t \le T,\ t \ge (y^{NV})^{2/\delta}} \{Q(\hat y^\delta_t) - Q(y^{NV})\}\Big] \le \bar B\, T^{0.5+\delta} + \bar B\, T^{0.5}.E[1≤t≤T, t≥(yNV)2/δ∑​{Q(y^​tδ​)−Q(yNV)}]≤BˉT0.5+δ+BˉT0.5.

Significance

The result. Theorem 7 shows that a distribution-free, censored-data policy can be asymptotically optimal without any prior bound on the optimal stock level. The only inputs are bbb, hhh and the tuning parameter δ\deltaδ. The explicit constant separates two effects. A transient cost grows with yNVy^{NV}yNV and vanishes like 1/T1/T1/T. A steady-state rate Tδ−1/2T^{\delta-1/2}Tδ−1/2 approaches the known-bound rate T−1/2T^{-1/2}T−1/2 as δ→0\delta \to 0δ→0, at the cost of a larger transient. The expanding-projection device applies to other stochastic subgradient methods whose feasible region is unbounded.

Formalizing it. The theorem is proved in the paper, but as far as is known it has no machine-checked proof. The mission produces the modified algorithm as an explicit function of the demand path, the per-step stochastic gradient inequality with a time-varying projection, and the two-phase regret decomposition. The per-step inequality with a varying domain is reusable for other growing-domain online methods.

Difficulty

The standard projected-gradient analysis compares every iterate with a fixed minimizer in a fixed compact set, and it bounds the telescoping distance terms by the diameter of that set. Neither applies here. In the early rounds the projection interval does not contain yNVy^{NV}yNV, so the distance to yNVy^{NV}yNV can grow from step to step. Once the interval contains yNVy^{NV}yNV, the diameter that controls the telescoping sum grows with ttt. The step sizes and the growing radii must be traded against each other through Abel summation. The bound on E[Ht(y^tδ)(y^tδ−yNV)]E[H_t(\hat y^\delta_t)(\hat y^\delta_t - y^{NV})]E[Ht​(y^​tδ​)(y^​tδ​−yNV)] needs the conditional-expectation argument that HtH_tHt​ is an unbiased subgradient of QQQ at a random point independent of DtD_tDt​. Applying the known-bound theorem with yˉ\bar yyˉ​ replaced by Tδ/2T^{\delta/2}Tδ/2 does not work, because the algorithm is not given TTT and the projection radius changes at every step.

Formalization scope

  • Demand: CappedBaseStock.DemandLaw (a probability law on R≥0\mathbb R_{\ge 0}R≥0​ with finite and strictly positive mean) and the i.i.d. path demandPathLaw (Measure.infinitePi), from the published definition CappedBaseStock_Model. The path is zero-based: the paper's DtD_tDt​ is coordinate t−1t-1t−1. The positive-mean field is not needed by Theorem 7. It excludes only D=0D = 0D=0 almost surely.
  • QQQ and yNVy^{NV}yNV: backorderCost and newsvendorLevel from the published definition LostSalesOrderUpTo.Asymptotic.Backorder. Real levels are passed through Real.toNNReal, and the levels involved are always nonnegative.
  • The algorithm modAimTarget δ b h ŷ₁ d t is a deterministic recursion on the demand path, and expectations are Bochner integrals over the path measure. All integrands are bounded and measurable, so no non-integrability default enters.
  • Explicit readings of the paper's loose phrases:
    • the first level, which the paper leaves unspecified, is assumed to satisfy y^1δ∈[0,1]\hat y^\delta_1 \in [0,1]y^​1δ​∈[0,1]; the theorem fails without it;
    • 0<b0 < b0<b and 0<h0 < h0<h are assumed;
    • the sums in (10) and (11) are restricted to 1≤t≤T1 \le t \le T1≤t≤T;
    • when yNV=0y^{NV} = 0yNV=0, the sum in (11) starts at t=1t = 1t=1;
    • all powers are real powers, with 0p=00^p = 00p=0 for p>0p > 0p>0;
    • "the manager does not know any upper bound" is not a hypothesis, because the algorithm uses none.
  • Trivializing formalizations are ruled out. The statements concern the algorithm's own iterates, not an arbitrary sequence of levels. The constants are the printed ones. The hypotheses are satisfiable, for example with y^1δ=0\hat y^\delta_1 = 0y^​1δ​=0.
  • Useful contributions:
    • convexity and Lipschitz continuity of QQQ with constant max⁡{b,h}\max\{b,h\}max{b,h};
    • the subgradient identity E[Ht(y)]=(b+h)F(y−)−bE[H_t(y)] = (b+h)F(y^-) - bE[Ht​(y)]=(b+h)F(y−)−b;
    • measurability and boundedness of the iterates;
    • independence of DtD_tDt​ from y^tδ\hat y^\delta_ty^​tδ​ under the product measure;
    • the projected-step inequality.

Selected references

  • W. T. Huh and P. Rusmevichientong, A Nonparametric Asymptotic Analysis of Inventory Planning with Censored Demand, Mathematics of Operations Research 34(1), 2009. https://doi.org/10.1287/moor.1080.0355
  • M. Zinkevich, Online Convex Programming and Generalized Infinitesimal Gradient Ascent, ICML 2003. https://www.aaai.org/Papers/ICML/2003/ICML03-120.pdf
  • A. D. Flaxman, A. T. Kalai and H. B. McMahan, Online Convex Optimization in the Bandit Setting: Gradient Descent without a Gradient, SODA 2005. https://arxiv.org/abs/cs/0408007
  • G. A. Godfrey and W. B. Powell, An Adaptive, Distribution-Free Algorithm for the Newsvendor Problem with Censored Demands, Management Science 47(8), 2001. https://doi.org/10.1287/mnsc.47.8.1101.10231
  • A. N. Burnetas and C. E. Smith, Adaptive Ordering and Pricing for Perishable Products, Operations Research 48(3), 2000. https://doi.org/10.1287/opre.48.3.436.12437
7 thms2 active usersReviewed
ProbabilityStochastic Systems·Captain: mikedeng1

Shock Models and Wear Processes II: If the Probabilities of Surviving k Shocks Have Decreasing Successive Ratios, the Poisson Shock Life Distribution Is IHRResearch Paper

Motivation

A component may be exposed to shocks that arrive at random times. Its chance of lasting for a given time depends both on how often shocks arrive and on how likely it is to survive successive shocks. Reliability calculations often begin with the latter, discrete sequence, while replacement and life-testing questions concern the resulting lifetime distribution. Esary, Marshall, and Proschan study how a property imposed on the shock sequence appears in the continuous lifetime law. Their Theorem 3.1 gives several such inheritance results; this mission targets its increasing-hazard-rate assertion (Esary, Marshall, and Proschan 1973, Theorem 3.1).

An increasing hazard rate (IHR) means that the remaining life of a component that has survived to age ttt becomes stochastically shorter as ttt increases. This is a concrete way to express wear-out. The paper treats “increasing” as weakly increasing throughout, so a constant hazard rate is included (Esary, Marshall, and Proschan 1973, pp. 628, 631).

Setting

Shocks arrive according to a homogeneous Poisson process with rate λ>0\lambda>0λ>0. Let Pˉk\bar P_kPˉk​ be the probability that the component survives the first kkk shocks. The sequence starts at k=0k=0k=0 and satisfies 1=Pˉ0≥Pˉ1≥⋯≥01=\bar P_0\geq\bar P_1\geq\cdots\geq01=Pˉ0​≥Pˉ1​≥⋯≥0 for the target theorem. The probability of failure on the (k+1)(k+1)(k+1)st shock is pk+1=Pˉk−Pˉk+1p_{k+1}=\bar P_k-\bar P_{k+1}pk+1​=Pˉk​−Pˉk+1​. At a nonnegative time ttt, the chance of exactly kkk shock arrivals is wk(t)=e−λt(λt)k/k!w_k(t)=e^{-\lambda t}(\lambda t)^k/k!wk​(t)=e−λt(λt)k/k!. The survival function of the component is therefore the Poisson mixture

Hˉ(t)=∑k=0∞Pˉkwk(t),t≥0,\bar H(t)=\sum_{k=0}^{\infty}\bar P_k w_k(t),\qquad t\geq0,Hˉ(t)=k=0∑∞​Pˉk​wk​(t),t≥0,

and the paper sets Hˉ(t)=1\bar H(t)=1Hˉ(t)=1 for t<0t<0t<0. At positive times its density is h(t)=λ∑k≥0pk+1wk(t)h(t)=\lambda\sum_{k\geq0}p_{k+1}w_k(t)h(t)=λ∑k≥0​pk+1​wk​(t). The failure-on-shock sequence and the positive-time density are both part of the mission because the paper compares their shape as well (Esary, Marshall, and Proschan 1973, (2.1)–(2.3)).

A nonnegative sequence is PF₂ here when its successive ratios decrease weakly, wherever those ratios are defined. For the survival probabilities this says θk=Pˉk/Pˉk−1\theta_k=\bar P_k/\bar P_{k-1}θk​=Pˉk​/Pˉk−1​ decreases with k≥1k\geq1k≥1. A survival function is IHR when, for each x>0x>0x>0, the survival ratio Hˉ(t+x)/Hˉ(t)\bar H(t+x)/\bar H(t)Hˉ(t+x)/Hˉ(t) decreases with age ttt wherever it is defined. These are the discrete and continuous conditions connected by the target (Esary, Marshall, and Proschan 1973, Definition 2.3 and p. 631).

Formalization targets

Increasing hazard rate from PF₂ shock survival

The goal is Theorem 3.1(3.2):

(Pˉk)k≥0 is PF2⟹Hˉ is IHR.(\bar P_k)_{k\geq0}\text{ is PF}_2 \quad\Longrightarrow\quad \bar H\text{ is IHR}.(Pˉk​)k≥0​ is PF2​⟹Hˉ is IHR.

It covers any nonnegative, weakly decreasing shock-survival sequence with Pˉ0=1\bar P_0=1Pˉ0​=1 and a positive Poisson rate. It does not fix a finite number of shocks or a special survival law (Esary, Marshall, and Proschan 1973, p. 632).

Density and hazard estimates

The milestone list includes the positive-time density formula (2.3), the upper bound h(t)/Hˉ(t)≤λh(t)/\bar H(t)\leq\lambdah(t)/Hˉ(t)≤λ in (2.5), the derivative estimate h′(t)≥−λh(t)h'(t)\geq-\lambda h(t)h′(t)≥−λh(t) from the proof of (3.1), and that proof's sign-change claim for h(t)−ce−θth(t)-ce^{-\theta t}h(t)−ce−θt. It culminates in Theorem 3.1(3.1), which says that PF₂ failure-on-shock probabilities give a PF₂ positive-time density. These are statements made explicitly by the authors and form the neighboring shape result and the estimates cited in the proof of the IHR goal (Esary, Marshall, and Proschan 1973, pp. 628–629, 632–633).

Further results of the paper

The mission also poses, outside the milestone list, the other inheritance results of the same section and of §6 whose formulation uses the same objects:

∑j≥kPˉj/Pˉk decreasing ⇒ H DMRL(3.3),Pˉk∑j≥0Pˉj≥∑j≥kPˉj ⇒ H NBUE(3.6),Pˉk/Pˉk−1 increasing ⇒ H DHR(Theorem 3.2 (3.8)),Sk≥0 ⇒ Hˉ IHR(Theorem 3.3),\begin{aligned} &\textstyle\sum_{j\ge k}\bar P_j/\bar P_k\ \text{decreasing}\ \Rightarrow\ H\ \text{DMRL}\quad(3.3),\qquad \bar P_k\sum_{j\ge0}\bar P_j\ge\sum_{j\ge k}\bar P_j\ \Rightarrow\ H\ \text{NBUE}\quad(3.6),\\ &\bar P_k/\bar P_{k-1}\ \text{increasing}\ \Rightarrow\ H\ \text{DHR}\quad\text{(Theorem 3.2 (3.8))},\qquad S_k\ge0\ \Rightarrow\ \bar H\ \text{IHR}\quad\text{(Theorem 3.3)}, \end{aligned}​∑j≥k​Pˉj​/Pˉk​ decreasing ⇒ H DMRL(3.3),Pˉk​∑j≥0​Pˉj​≥∑j≥k​Pˉj​ ⇒ H NBUE(3.6),Pˉk​/Pˉk−1​ increasing ⇒ H DHR(Theorem 3.2 (3.8)),Sk​≥0 ⇒ Hˉ IHR(Theorem 3.3),​

where Sk=∑j=0k(kj)[Pˉj+1Pˉk−j+1−PˉjPˉk−j+2]S_k=\sum_{j=0}^k\binom kj[\bar P_{j+1}\bar P_{k-j+1}-\bar P_j\bar P_{k-j+2}]Sk​=∑j=0k​(jk​)[Pˉj+1​Pˉk−j+1​−Pˉj​Pˉk−j+2​] is the condition of Murthy and Lientz, strictly weaker than PF₂. Theorem 6.1 specializes to independent shock magnitudes, Pˉk=∏i=1kFi(x)\bar P_k=\prod_{i=1}^kF_i(x)Pˉk​=∏i=1k​Fi​(x) (exponential, IHR or DHR as Fi(x)F_i(x)Fi​(x) is constant, decreasing or increasing in iii), and Theorem 6.2 shows that a random threshold, Pˉk=∫0∞[F(x)]k dG(x)\bar P_k=\int_0^\infty[F(x)]^k\,dG(x)Pˉk​=∫0∞​[F(x)]kdG(x), always gives a logarithmically convex density on (0,∞)(0,\infty)(0,∞) (Esary, Marshall, and Proschan 1973, pp. 632, 634, 647).

Significance

The target makes a discrete reliability assumption useful for continuous-time decisions. One may model or estimate the sequence Pˉk\bar P_kPˉk​ from how the component responds to successive shocks and then infer an ageing property of its lifetime under Poisson arrivals. The conclusion is about residual lifetime at every age, not just its mean or one tail probability. The companion PF₂-density statement shows that the same transfer applies to failure-on-shock probabilities and the resulting continuous density (Esary, Marshall, and Proschan 1973, Theorem 3.1).

The 1973 results are proved in the paper. In this mission the Lean statements compile as open theorems; their mathematical proofs are still to be formalized. A completed development would make the Poisson-series model, its density, and the discrete-to-continuous shape claims reusable in later formalizations of shock and wear models. The other missions in this paper's series consider cumulative damage, first passage under wear, and random thresholds using related ideas.

Difficulty

The survival function mixes infinitely many shock counts. Each count has its own time-dependent Poisson weight, so a decreasing ratio of adjacent Pˉk\bar P_kPˉk​ terms does not give the desired comparison of survival ratios by a termwise inequality. The paper invokes a variation-diminishing property of a totally positive Poisson kernel for the corresponding shape arguments (Esary, Marshall, and Proschan 1973, p. 633). A formal proof must also justify differentiation and rearrangement of the infinite series, including sequences that reach zero after finitely many shocks.

Formalization scope

The Lean model uses real-valued functions for Pˉk\bar P_kPˉk​, Hˉ\bar HHˉ, and hhh, with the shock count indexed from zero. The Poisson mixture is the definition of Hˉ\bar HHˉ; no random lifetime is introduced in place of it. The value Hˉ(t)=1\bar H(t)=1Hˉ(t)=1 for negative time follows (2.1). IHR is expressed for all real ages s≤ts\leq ts≤t by cross-multiplying the survival-ratio comparison. With Pˉ0=1\bar P_0=1Pˉ0​=1, this includes the boundary at zero without an atom there. PF₂ sequence and density conditions are also cross-multiplied. This gives the paper's ratio statements wherever denominators are positive and retains the natural zero-survival cases without using real division by zero.

The source treats Pˉk\bar P_kPˉk​ as probabilities, takes λ>0\lambda>0λ>0, and restricts variables to avoid zero denominators; Lean states the rate, nonnegativity, weak monotonicity, and the ratio convention explicitly. Formula (2.3) is represented by the derivative identity Hˉ′=−h\bar H'=-hHˉ′=−h at positive time. The bound (2.5) is h≤λHˉh\leq\lambda\bar Hh≤λHˉ, equivalent to the hazard-rate statement wherever survival is positive. The sign-change milestone excludes a strict positive–negative–positive pattern at increasing positive times, matching the authors' “at most two, in the order negative, positive, negative” wording. These conventions prevent an empty IHR statement or a trivial result caused by totalized division.

A complete proof needs reusable facts about convergence and differentiation of Poisson-weighted series and about preservation of sign patterns under the Poisson kernel. Contributions to that infrastructure, the density and hazard estimates, and the PF₂ transfer are in scope, as are the further results above. For those, the reversed classes are stated on the life-distribution domain: DHR compares ages 0≤s≤t0\le s\le t0≤s≤t only, because Theorem 3.2 allows Pˉ0<1\bar P_0<1Pˉ0​<1, an atom at the origin; a logarithmically convex density is the reversed cross-multiplied PF₂ inequality for hhh on (0,∞)(0,\infty)(0,∞). Mean residual lives and mean lives are computed in [0,∞][0,\infty][0,∞] (they are infinite when ∑kPˉk=∞\sum_k\bar P_k=\infty∑k​Pˉk​=∞), and their ratios are taken only where Hˉ(t)>0\bar H(t)>0Hˉ(t)>0. In Theorem 6.1 only the numbers Fi(x)∈[0,1]F_i(x)\in[0,1]Fi​(x)∈[0,1] enter, and "exponential" includes the rate 000; in Theorem 6.2 the shock and threshold laws are probability measures on R\mathbb RR with no mass on (−∞,0)(-\infty,0)(−∞,0). The paper's further remark that a survival function needs Pˉk→0\bar P_k\to0Pˉk​→0 is not imposed: none of the theorems uses it.

Selected references

  • J. D. Esary, A. W. Marshall, and F. Proschan, Shock Models and Wear Processes, The Annals of Probability 1(4), 627–649, 1973. DOI: 10.1214/aop/1176996891.
  • S. Karlin, Total Positivity, Vol. I, Stanford University Press, 1968 (the variation-diminishing property cited on p. 633 of the paper).
  • R. E. Barlow and F. Proschan, Mathematical Theory of Reliability, Wiley, 1965 (IHR and DHR distributions in reliability).
8 thms2 active usersReviewed
Control TheoryDynamical Systems·Captain: mikedeng1

Dynamic Instabilities and Stabilization Methods in Distributed Real-Time Scheduling of Manufacturing Systems 3: Clear-a-Fraction Policies Are Stable From Every Initial State When ρ′ₘ < 1Research Paper

Motivation

A flexible manufacturing system processes several part types on shared machines, and a machine that switches from one part type to another pays a set-up time. Real-time, distributed scheduling rules for such systems decide locally, at each machine, when to switch and to which buffer. The simplest such rules are clearing policies: a machine keeps working on its current buffer until that buffer is empty, then switches. Perkins and Kumar (IEEE TAC 34, 1989; reference [18] of Kumar–Seidman 1990) showed that every clear-a-fraction (CAF) policy, a clearing policy that always switches to a buffer holding at least a fixed fraction of the machine's work, keeps all buffers bounded in every acyclic system whenever each machine's load is below one.

Kumar and Seidman (IEEE TAC 1990) showed that acyclicity cannot simply be dropped. In §III of the paper, a two-machine re-entrant line and a two-part-type system, both with every machine loaded below capacity, have clearing trajectories whose buffer levels grow without bound. This mission formalizes the paper's positive result for non-acyclic systems: Theorem 1, a stronger capacity condition under which every CAF policy is stable from every initial state.

Setting

There are PPP part types and MMM machines. Part type ppp enters at rate dp>0d_p>0dp​>0 and visits the machines μp,1,…,μp,np\mu_{p,1},\dots,\mu_{p,n_p}μp,1​,…,μp,np​​ in turn; revisits are allowed. At its iii-th stage a part waits in buffer bp,ib_{p,i}bp,i​ and needs processing time τp,i>0\tau_{p,i}>0τp,i​>0. Machine mmm serves Bm={bp,i:μp,i=m}B_m=\{b_{p,i}:\mu_{p,i}=m\}Bm​={bp,i​:μp,i​=m}, and switching from bbb to b′∈Bmb'\in B_mb′∈Bm​ costs δb,b′≥0\delta_{b,b'}\ge0δb,b′​≥0. Flows are fluid. The level xb(t)≥0x_b(t)\ge0xb​(t)≥0 satisfies xb(t)=xb(0)+ub(t)−yb(t)x_b(t)=x_b(0)+u_b(t)-y_b(t)xb​(t)=xb​(0)+ub​(t)−yb​(t), where yby_byb​ is the cumulative output and ubu_bub​ the cumulative input: dptd_p tdp​t for the first buffer of a route, the output of the previous buffer otherwise. Each machine works through runs. A run is a set-up for a buffer, during which nothing is processed, followed by processing of that buffer at rate at most 1/τb1/\tau_b1/τb​, and at exactly that rate while the buffer is nonempty.

A trajectory is clearing (Definition 1) if each machine leaves its buffer exactly at the first time the buffer is empty while another of its buffers is nonempty, and then sets up for such a buffer. It is CAF with constants εm>0\varepsilon_m>0εm​>0, KmK_mKm​ (Definition 2) if every set-up commenced at time ttt is for a buffer with

xp,i(t) ≥ εm∑(q,j): μq,j=mxq,j(t)−Km.x_{p,i}(t)\ \ge\ \varepsilon_m\sum_{(q,j):\,\mu_{q,j}=m}x_{q,j}(t)-K_m .xp,i​(t) ≥ εm​(q,j):μq,j​=m∑​xq,j​(t)−Km​.

A trajectory is stable if sup⁡t≥0xp,i(t)<∞\sup_{t\ge0}x_{p,i}(t)<\inftysupt≥0​xp,i​(t)<∞ for every buffer.

The graph on machines has an arc m→m′m\to m'm→m′ when m≠m′m\ne m'm=m′ and some part type visits m′m'm′ right after mmm. Machines are diconnected, m↔m′m\leftrightarrow m'm↔m′, when each is reachable from the other. For each buffer, λp,i\lambda_{p,i}λp,i​ is the last earlier stage at a different machine, if any, and πp,i\pi_{p,i}πp,i​ is that stage's machine, the prior machine. The modified input rate is dp,i′=1/τp,λp,id'_{p,i}=1/\tau_{p,\lambda_{p,i}}dp,i′​=1/τp,λp,i​​ if πp,i↔μp,i\pi_{p,i}\leftrightarrow\mu_{p,i}πp,i​↔μp,i​, and dp,i′=dpd'_{p,i}=d_pdp,i′​=dp​ otherwise (11)–(13).

Formalization targets

Goal: Theorem 1 (p. 294)

If

ρm′:=∑(p,i): μp,i=mdp,i′ τp,i<1for all m,(14)\rho'_m:=\sum_{(p,i):\,\mu_{p,i}=m}d'_{p,i}\,\tau_{p,i}<1\qquad\text{for all } m, \tag{14}ρm′​:=(p,i):μp,i​=m∑​dp,i′​τp,i​<1for all m,(14)

then for all ε>0\varepsilon>0ε>0, all KKK, every CAF trajectory from every initial state is stable. The bound on each buffer may depend on the trajectory.

Milestones (the proof's own steps, p. 295)

For a machine mmm in a minimal class, Vm(t)=∑μp,i=mxp,i(t)[τp,i+⋯+τp,i+ηp,i−1]V_m(t)=\sum_{\mu_{p,i}=m}x_{p,i}(t)[\tau_{p,i}+\dots+\tau_{p,i+\eta_{p,i}-1}]Vm​(t)=∑μp,i​=m​xp,i​(t)[τp,i​+⋯+τp,i+ηp,i​−1​] is the work at mmm (15), and Tn,Tn+1T_n, T_{n+1}Tn​,Tn+1​ are consecutive set-up commencements:

  1. (18): Vm(Tn+1)≤max⁡[0,Vm(Tn)−(1−ρm′)(Tn+1−Tn)+δˉ]V_m(T_{n+1})\le\max[0,V_m(T_n)-(1-\rho'_m)(T_{n+1}-T_n)+\bar\delta]Vm​(Tn+1​)≤max[0,Vm​(Tn​)−(1−ρm′​)(Tn+1​−Tn​)+δˉ].
  2. (20): xpn∗,in∗(Tn)≥2δˉ/((1−ρm′)τpn∗,in∗)⇒Tn+1−Tn≥2δˉ/(1−ρm′)x_{p^*_n,i^*_n}(T_n)\ge 2\bar\delta/((1-\rho'_m)\tau_{p^*_n,i^*_n})\Rightarrow T_{n+1}-T_n\ge2\bar\delta/(1-\rho'_m)xpn∗​,in∗​​(Tn​)≥2δˉ/((1−ρm′​)τpn∗​,in∗​​)⇒Tn+1​−Tn​≥2δˉ/(1−ρm′​).
  3. Vm(Tn)≥Γm⇒Vm(Tn+1)≤Vm(Tn)−δˉV_m(T_n)\ge\Gamma_m\Rightarrow V_m(T_{n+1})\le V_m(T_n)-\bar\deltaVm​(Tn​)≥Γm​⇒Vm​(Tn+1​)≤Vm​(Tn​)−δˉ, with the explicit Γm\Gamma_mΓm​ of p. 295.
  4. Every buffer of every machine in a minimal class is bounded.
  5. The induction step: with upstream classes bounded, Vm(Tn+1)≤max⁡{Γˉ,Vm(Tn)−(1−ρm′)(Tn+1−Tn)+δˉ+Γˉ}V_m(T_{n+1})\le\max\{\bar\Gamma,V_m(T_n)-(1-\rho'_m)(T_{n+1}-T_n)+\bar\delta+\bar\Gamma\}Vm​(Tn+1​)≤max{Γˉ,Vm​(Tn​)−(1−ρm′​)(Tn+1​−Tn​)+δˉ+Γˉ}.

Significance

The result. Theorem 1 is a sufficient condition for stability that holds for every system topology and every CAF policy, with no restriction to acyclic flows. It separates two kinds of upstream supply. A machine that is not in a common cycle with its supplier needs capacity only for the average rate dpd_pdp​. A machine that is in such a cycle must budget for the supplier's peak rate. The paper's examples show that some strengthening of ρm<1\rho_m<1ρm​<1 is needed for clearing policies on cyclic systems: they are unstable under ρm<1\rho_m<1ρm​<1 alone. Section V of the paper builds on this gap, with a supervisory mechanism that restores stability under ρm<1\rho_m<1ρm​<1 alone.

Formalizing it. The theorem is proved in the paper; no machine-checked proof exists. A formalization must turn a two-page argument with a set-up/processing run structure, a starvation case analysis and an induction over the condensation of a directed graph into rigorous statements. The result is a reusable fluid model of scheduling with set-up times. It also makes explicit the conventions of the clearing rule, which the paper leaves informal.

Difficulty

A natural first attempt bounds the total work VmV_mVm​ at each machine separately, using only the average arrival rates. This fails on cyclic systems. A machine downstream in a cycle can receive parts in bursts at the upstream machine's full processing rate 1/τ1/\tau1/τ, far above dpd_pdp​; Example 1 of the paper builds exactly such a positive feedback. The proof therefore has to (a) bound the inflow into a machine of a minimal class by the peak rates in (14); (b) handle starvation inside a run, where the machine works below its maximal rate; (c) control the set-up overhead, which the CAF rule amortizes by forcing long runs once VmV_mVm​ is large; and (d) push boundedness down the partial order of classes, where the bounded upstream buffers enter as an additive constant Γˉ\bar\GammaΓˉ. Step (d) needs a bound on the total content upstream, not one per buffer.

Formalization scope

  • Model. System P M holds the data. Part types, machines and stages are 0-based (paper stage iii is Lean stage i−1i-1i−1). Trajectory S holds levels, cumulative outputs and runs, with N m : ℕ∞ runs per machine. Time is real, with explicit t≥0t\ge0t≥0. Run starts are nondecreasing and, if infinitely many, tend to infinity. Machines never idle outside runs: idling on an empty buffer is processing at the inflow rate.
  • Processing law. The output is bounded by 1/τb1/\tau_b1/τb​ times the Lebesgue measure of the time spent processing bbb, with equality on intervals of processing of a nonempty buffer.
  • Clearing. "Nonempty" in Definition 1 for the buffer switched to is read as nonempty or with inflow starting now. Under this reading the paper's example trajectories are clearing trajectories; read literally, "the first time" would not exist. The emptiness test on the current buffer is literal. The no-early-exit condition holds on the open processing interval.
  • Set-ups. Set-ups occur only between distinct buffers. δˉ\bar\deltaδˉ is the largest set-up time between distinct buffers of mmm, or 000 if there are none. Zero set-up times are allowed; δˉ>0\bar\delta>0δˉ>0 is not assumed.
  • Constants. Γm\Gamma_mΓm​, τˉ\bar\tauτˉ, τ‾\underline\tauτ​, Γˉ\bar\GammaΓˉ are explicit definitions, never existentials. Every denominator is positive under the hypotheses.
  • Trivializations ruled out. The trajectory class is not empty: a sorry-free witness (one machine, one buffer, dτ<1d\tau<1dτ<1, any initial level) satisfies every predicate, together with (14). The goal quantifies over every system, every ε>0\varepsilon>0ε>0 and KKK, and every CAF trajectory. It does not fix a selection rule, an acyclic topology, routes without revisits or positive set-ups.
  • Infrastructure. Continuity of the levels (from the rate cap), restarting a trajectory at a run start, inflow bounds via conservation along routes, and the condensation of the machine graph. These are reusable for the related Kumar–Seidman missions on instability and supervisory stabilization. Proofs of the milestones in any order are welcome.

Selected references

  • P. R. Kumar and T. I. Seidman, Dynamic instabilities and stabilization methods in distributed real-time scheduling of manufacturing systems, IEEE Transactions on Automatic Control 35(3), 289–298, 1990. https://doi.org/10.1109/9.50339
  • J. R. Perkins and P. R. Kumar, Stable, distributed, real-time scheduling of flexible manufacturing/assembly/disassembly systems, IEEE Transactions on Automatic Control 34, 139–148, February 1989 (cited as [18] in Kumar–Seidman 1990; the CAF stability result for acyclic systems).
10 thms2 active usersReviewed
Dynamical SystemsProbabilityRandom Matrix Theory·Captain: mikedeng1

Subadditive Ergodic Theory 5: For a Stationary Sequence in a Banach Algebra with E(log‖Y₁‖)⁺ < ∞, n⁻¹ log‖Y₁⋯Y_n‖ Converges in [−∞, ∞)Research Paper

Motivation

Products of random linear operators appear wherever a system evolves by repeated application of randomly chosen linear maps: linear recursions with random coefficients, products of random matrices in statistical physics, the growth of random dynamical systems, and population models in random environments. The basic question is the exponential growth rate of the product Y1Y2⋯YnY_1Y_2\cdots Y_nY1​Y2​⋯Yn​. For square matrices, Furstenberg and Kesten (Ann. Math. Statist. 31, 1960) proved that n−1log⁡∥Y1⋯Yn∥n^{-1}\log\|Y_1\cdots Y_n\|n−1log∥Y1​⋯Yn​∥ converges for stationary sequences with a logarithmic moment condition.

Kingman (Subadditive ergodic theory, Ann. Probab. 1(6):883–899, 1973) showed that this limit theorem is an instance of the subadditive ergodic theorem, and that the instance needs nothing of matrices beyond the norm inequality ∥AB∥≤∥A∥ ∥B∥\|AB\|\le\|A\|\,\|B\|∥AB∥≤∥A∥∥B∥. His Theorem 6 therefore holds in an arbitrary real or complex Banach algebra, including infinite-dimensional ones such as infinite matrices with finite ℓ1\ell_1ℓ1​ norm. It is the source of what later became known as the top Lyapunov exponent of a stationary random operator product.

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) be a probability space. A two-parameter family is a collection x=(xst)x=(x_{st})x=(xst​) of random variables indexed by nonnegative integers s<ts<ts<t. Kingman's conditions (§1.1–1.2) are:

  • S₁: xsu≤xst+xtux_{su}\le x_{st}+x_{tu}xsu​≤xst​+xtu​ whenever s<t<us<t<us<t<u;
  • S₂: the joint distributions of (xs+1,t+1)(x_{s+1,t+1})(xs+1,t+1​) are the same as those of (xst)(x_{st})(xst​);
  • S₃: gt=E(x0t)g_t=E(x_{0t})gt​=E(x0t​) is finite for every t≥1t\ge1t≥1 and gt≥−Atg_t\ge -Atgt​≥−At for some constant AAA;
  • S₃′: E(x01+)<∞E(x_{01}^+)<\inftyE(x01+​)<∞, where x+=max⁡(x,0)x^+=\max(x,0)x+=max(x,0).

A family of real random variables satisfying S₁, S₂ and S₃ is a subadditive process. Kingman's Theorem 1 (the goal of the first mission of this series) says that for a subadditive process x0t/tx_{0t}/tx0t​/t converges almost surely and in mean to a finite random variable ξ\xiξ with E(ξ)=γ=inf⁡t≥1gt/tE(\xi)=\gamma=\inf_{t\ge1}g_t/tE(ξ)=γ=inft≥1​gt​/t.

A Banach algebra B\mathfrak BB is a complete normed algebra over R\mathbb RR or C\mathbb CC whose norm satisfies ∥AB∥≤∥A∥ ∥B∥\|AB\|\le\|A\|\,\|B\|∥AB∥≤∥A∥∥B∥. A sequence (Yn)n≥1(Y_n)_{n\ge1}(Yn​)n≥1​ of B\mathfrak BB-valued random elements is stationary if (Yn+1)n≥1(Y_{n+1})_{n\ge1}(Yn+1​)n≥1​ and (Yn)n≥1(Y_n)_{n\ge1}(Yn​)n≥1​ have the same joint law. The log-norm process is

xst=log⁡∥Ys+1Ys+2⋯Yt∥∈[−∞,∞),s<t,x_{st}=\log\|Y_{s+1}Y_{s+2}\cdots Y_t\|\in[-\infty,\infty),\qquad s<t,xst​=log∥Ys+1​Ys+2​⋯Yt​∥∈[−∞,∞),s<t,

with log⁡0=−∞\log 0=-\inftylog0=−∞. Expectations of [−∞,∞)[-\infty,\infty)[−∞,∞)-valued variables are extended expectations E(f)=∫f+ dP−∫f− dPE(f)=\int f^+\,dP-\int f^-\,dPE(f)=∫f+dP−∫f−dP, defined when ∫f+ dP<∞\int f^+\,dP<\infty∫f+dP<∞ and possibly equal to −∞-\infty−∞.

Formalization targets

Goal: Theorem 6 (p. 893)

If (Yn)(Y_n)(Yn​) is a stationary sequence in a real or complex Banach algebra and E{(log⁡∥Y1∥)+}<∞E\{(\log\|Y_1\|)^+\}<\inftyE{(log∥Y1​∥)+}<∞, then

ξ=lim⁡n→∞n−1log⁡∥Y1Y2⋯Yn∥\xi=\lim_{n\to\infty}n^{-1}\log\|Y_1Y_2\cdots Y_n\|ξ=n→∞lim​n−1log∥Y1​Y2​⋯Yn​∥

exists in −∞≤ξ<∞-\infty\le\xi<\infty−∞≤ξ<∞ with probability one, and

E(ξ)=lim⁡n→∞n−1E{log⁡∥Y1Y2⋯Yn∥}.E(\xi)=\lim_{n\to\infty}n^{-1}E\{\log\|Y_1Y_2\cdots Y_n\|\}.E(ξ)=n→∞lim​n−1E{log∥Y1​Y2​⋯Yn​∥}.

The goal fixes no constant and no ergodicity assumption: ξ\xiξ is in general a non-degenerate random variable.

Milestones

  1. (1.2.7), p. 885: under S₁, S₂ and S₃′, E(xst+)<∞E(x_{st}^+)<\inftyE(xst+​)<∞ for all s<ts<ts<t.
  2. Proof of Theorem 2, p. 886: the truncation xst(N)=max⁡(xst,−N(t−s))x^{(N)}_{st}=\max(x_{st},-N(t-s))xst(N)​=max(xst​,−N(t−s)) is a subadditive process for every positive integer NNN.
  3. Theorem 2, p. 885: if xxx satisfies S₁, S₂ and S₃′ but not S₃, then ξ=lim⁡x0t/t\xi=\lim x_{0t}/tξ=limx0t​/t exists with probability one in [−∞,∞)[-\infty,\infty)[−∞,∞) and E(ξ)=−∞E(\xi)=-\inftyE(ξ)=−∞.
  4. Proof of Theorem 6, p. 893: the log-norm process satisfies S₁, S₂ and S₃′.

Significance

Theorem 6 defines a stochastic spectral radius: if every YnY_nYn​ equals a fixed element yyy, then eξe^\xieξ is the spectral radius of yyy by Gelfand's formula, and for independent YnY_nYn​ with common law π\piπ the limit is a constant ρ(π)\rho(\pi)ρ(π) depending only on π\piπ. For k×kk\times kk×k matrices the theorem reduces to the Furstenberg–Kesten theorem. Theorem 2, the extension of the subadditive ergodic theorem from S₃ to S₃′, is the form needed whenever a process can have mean growth rate −∞-\infty−∞, as happens for products that can vanish or contract superlinearly; it is used well beyond random products.

All results here are proved on paper (Kingman 1973, building on his 1968 paper). None of them is machine-checked: Mathlib has no subadditive ergodic theorem, no Furstenberg–Kesten theorem and no random-product limit in normed algebras. The platform poses an ergodic, constant-limit form of Kingman's theorem (PalmQueueing.Ergodic.kingman_subadditive, open); this mission's Theorem 2 is a different statement (non-ergodic, conclusion E(ξ)=−∞E(\xi)=-\inftyE(ξ)=−∞ under failure of S₃). A complete development would give the first formal proof of the Furstenberg–Kesten limit, in the generality of Banach algebras.

Difficulty

Theorem 6 is short given Theorems 1 and 2, but the obvious one-line reduction to Theorem 1 fails in two places. First, the log-norm process can take the value −∞-\infty−∞ and its means gtg_tgt​ can be −∞-\infty−∞ or decrease superlinearly, so condition S₃ fails and Theorem 1 does not apply; the case E(ξ)=−∞E(\xi)=-\inftyE(ξ)=−∞ is a separate theorem (Theorem 2), whose proof must exchange a limit in ttt with a limit in an auxiliary parameter. Second, stationarity of the log-norm process (S₂) is a statement about joint laws on a path space; in a non-separable Banach algebra, multiplication need not be measurable for the product σ\sigmaσ-algebra on B×B\mathfrak B\times\mathfrak BB×B, so it is not automatic that the law of (Yn)(Y_n)(Yn​) determines the joint law of the products Ys+1⋯YtY_{s+1}\cdots Y_tYs+1​⋯Yt​. The main dependency, Theorem 1 itself, is the subject of a separate mission and is not restated here.

Formalization scope

The Lean development fixes these conventions:

  • Families are functions x : ℕ → ℕ → Ω → β; only pairs s<ts<ts<t enter any condition. S₁ is required almost surely for each triple (the weaker hypothesis); the log-norm milestone proves it at every sample point.
  • S₂ and stationarity are equalities of laws of the whole path (Measure.map) on the product σ\sigmaσ-algebra, not equality of one-dimensional marginals.
  • S₃′ and all positive parts are lower Lebesgue integrals; expectations that may be −∞-\infty−∞ are computed as ∫f+−∫f−\int f^+ - \int f^-∫f+−∫f− in EReal, never as Bochner integrals (which return 000 for non-integrable functions).
  • log⁡∥⋅∥\log\|\cdot\|log∥⋅∥ is ENNReal.log of the norm, so log⁡∥0∥=−∞\log\|0\|=-\inftylog∥0∥=−∞; Real.log 0 = 0 would replace a vanishing product's growth rate −∞-\infty−∞ by 000, and is ruled out.
  • B\mathfrak BB is a complete unital NormedRing with NormedAlgebra 𝕜 𝔅, RCLike 𝕜. Each YnY_nYn​ is strongly measurable; B\mathfrak BB is not assumed separable.
  • Limits are Filter.atTop on ℕ in the topology of EReal; the conclusions assert ξ<∞\xi<\inftyξ<∞ almost surely, E(ξ+)<∞E(\xi^+)<\inftyE(ξ+)<∞, and, for (2.3.5), both the existence of the limit of means and its value.

A formalization that replaces the extended logarithm by Real.log, or the extended expectation by a Bochner integral, makes the statement false or trivially different, and is excluded.

Reusable infrastructure: extended expectations of EReal-valued random variables, joint-law stationarity of sequences and two-parameter families, and the truncation lemma for S₃′ processes. Contributions toward Theorem 1 (mission 1 of this series), toward measurability of products of strongly measurable random elements, and toward the milestones in any order are welcome.

Selected references

  • J. F. C. Kingman, Subadditive ergodic theory, Ann. Probab. 1(6):883–899, 1973. https://doi.org/10.1214/aop/1176996798
  • J. F. C. Kingman, The ergodic theory of subadditive stochastic processes, J. Roy. Statist. Soc. Ser. B 30:499–510, 1968. https://doi.org/10.1111/j.2517-6161.1968.tb00749.x
  • H. Furstenberg and H. Kesten, Products of random matrices, Ann. Math. Statist. 31:457–469, 1960. https://doi.org/10.1214/aoms/1177705909
8 thms2 active usersReviewed
Dynamic ProgrammingOptimization·Captain: mikedeng1

Dynamic Pricing and Inventory Control of Substitute Products 1: Under Multinomial Logit Choice the Optimal Dynamic Prices Equalize Marginal RevenuesResearch Paper

Motivation

Retailers selling several related products can change prices as inventory runs down. A sale of one product changes the stock available in later periods, while changing its price also shifts demand toward or away from the other products. Dong, Kouvelis, and Tian study these linked decisions for substitute product variates under a multinomial logit customer choice model. Their 2009 article gives an exact characterization of the optimal dynamic price vector when each in-stock variate can have its own price. The characterization separates a product's inventory opportunity cost from a margin shared across all products, which makes the result more informative than an opaque Bellman maximization.

The mission isolates Theorem 1 of that article. The paper also studies restricted policies that require a unified price or fixed prices for some variates; those results are separate missions in this series. The present target concerns the fully flexible dynamic policy of §3.1, with the model and conventions of §2.

Setting

There are nnn product variates, indexed by iii, with finite quality parameters aia_iai​. Time ttt is the number of periods remaining, so it counts down to zero. The inventory state x=(xi)x=(x_i)x=(xi​) has nonnegative integer coordinates, and S(x)={i:xi>0}S(x)=\{i:x_i>0\}S(x)={i:xi​>0} is the set of variates still in stock. At most one customer arrives during a period, with probability λ\lambdaλ satisfying 0<λ≤10<\lambda\leq10<λ≤1. Inventory is not replenished. The retailer chooses a finite, nonnegative price rir_iri​ for each in-stock variate. An out-of-stock variate receives the paper's null price and contributes no demand.

An arriving customer chooses among the in-stock variates and the no-purchase option. The multinomial logit model assigns deterministic utility ai−ria_i-r_iai​−ri​ to variate iii and utility u0u_0u0​ to no purchase, with positive scale μ\muμ. Its probabilities are

Pi(x,r)=exp⁡((ai−ri)/μ)∑j∈S(x)exp⁡((aj−rj)/μ)+exp⁡(u0/μ),P0(x,r)=exp⁡(u0/μ)∑j∈S(x)exp⁡((aj−rj)/μ)+exp⁡(u0/μ).P_i(x,r)=\frac{\exp((a_i-r_i)/\mu)}{\sum_{j\in S(x)}\exp((a_j-r_j)/\mu)+\exp(u_0/\mu)},\qquad P_0(x,r)=\frac{\exp(u_0/\mu)}{\sum_{j\in S(x)}\exp((a_j-r_j)/\mu)+\exp(u_0/\mu)}.Pi​(x,r)=∑j∈S(x)​exp((aj​−rj​)/μ)+exp(u0​/μ)exp((ai​−ri​)/μ)​,P0​(x,r)=∑j∈S(x)​exp((aj​−rj​)/μ)+exp(u0​/μ)exp(u0​/μ)​.

Let πt(x)\pi_t(x)πt​(x) be the maximum expected revenue from state xxx with ttt periods remaining and zero terminal value π0(x)=0\pi_0(x)=0π0​(x)=0. A sale of variate iii moves the inventory to x−eix-e^ix−ei. Its marginal inventory value is Δiπt(x)=πt(x)−πt(x−ei)\Delta^i\pi_t(x)=\pi_t(x)-\pi_t(x-e^i)Δiπt​(x)=πt​(x)−πt​(x−ei) when i∈S(x)i\in S(x)i∈S(x). For a continuation value VVV, the one-period objective is current expected sales revenue plus the expected continuation revenue after a sale or no sale. The Bellman value takes its supremum over all finite nonnegative price vectors. Equation (5) rewrites that objective as ξV(x,r)+V(x)\xi_V(x,r)+V(x)ξV​(x,r)+V(x), where ξV\xi_VξV​ is the probability-weighted marginal revenue.

Formalization targets

Optimal dynamic prices

Theorem 1 asks for a unique common margin mt(x)m_t(x)mt​(x) satisfying

(mt(x)μ−1)exp⁡(mt(x)+u0μ)=∑i∈S(x)exp⁡(ai−Δiπt−1(x)μ).\left(\frac{m_t(x)}{\mu}-1\right)\exp\left(\frac{m_t(x)+u_0}{\mu}\right) =\sum_{i\in S(x)}\exp\left(\frac{a_i-\Delta^i\pi_{t-1}(x)}{\mu}\right).(μmt​(x)​−1)exp(μmt​(x)+u0​​)=i∈S(x)∑​exp(μai​−Δiπt−1​(x)​).

For every in-stock variate, the price ri∗=Δiπt−1(x)+mt(x)r_i^*=\Delta^i\pi_{t-1}(x)+m_t(x)ri∗​=Δiπt−1​(x)+mt​(x) must be feasible and attain the Bellman maximum. The margin also satisfies mt(x)P0(x,r∗)=μm_t(x)P_0(x,r^*)=\mumt​(x)P0​(x,r∗)=μ. These claims hold for every inventory state, including an empty in-stock set. They are the main target of Theorem 1, equations (9)–(10).

Total expected revenue

For each s=1,…,ts=1,\ldots,ts=1,…,t, let ms(x)m_s(x)ms​(x) be the unique margin equation root at the same inventory state xxx, with sss periods remaining. The remaining clause of Theorem 1 states

πt(x)=λ∑s=1t[ms(x)−μ].\pi_t(x)=\lambda\sum_{s=1}^{t}\bigl[m_s(x)-\mu\bigr].πt​(x)=λs=1∑t​[ms​(x)−μ].

The milestones track the paper's equation (5) and Steps 1–5 of its Appendix A argument: marginal inventory value, the mapping between prices and choice probabilities, concavity in probability coordinates, existence of the margin, optimal choice probabilities, and the one-period value identity.

Significance

The result turns a coupled dynamic program into a precise pricing characterization. It says that differences in optimal prices across products reflect differences in their marginal inventory values; the remaining margin is common. The value identity quantifies the expected revenue earned over the remaining horizon, and the explicit maximizer removes ambiguity about whether the Bellman supremum is attained. These conclusions support the paper's comparisons with restricted pricing policies and its later discussion of how quality and inventory scarcity affect prices Dong, Kouvelis, and Tian (2009).

The result is proved in the article. This mission contributes a Lean statement of the full theorem, its model, and seven named intermediate targets. The draft declarations compile against the pinned Mathlib environment; their proofs remain open. A complete formalization would provide reusable finite MNL choice probabilities, inverse price and probability identities, and a Bellman model for substitute-product inventory. The paper's economic conclusions should be recovered from those formal statements, rather than from a weakened existence claim.

Difficulty

The direct one-period objective in the price vector is not quasiconcave, as the paper notes on p. 323, so a local condition on prices alone does not establish global optimality. The price vector also ranges over an unbounded set, and a supremum could conceal a boundary or attainment issue. Finally, one extra unit of stock changes future probabilities across all products, not just the revenue of that product. These interactions make nonnegative marginal inventory value and the global optimality assertion substantive parts of the result. The probability-space objective is concave on its positive domain, but the printed Appendix A claim of strict concavity on the full domain is stronger than that function permits; uniqueness concerns the normalized choice-probability slice.

Formalization scope

Lean represents products by Fin n, inventories by functions Fin n → ℕ, and time by a natural number counting remaining periods. The model assumes μ>0\mu>0μ>0 and 0<λ≤10<\lambda\leq10<λ≤1. The set S(x)S(x)S(x) filters positive inventory coordinates; an out-of-stock variate is removed from every choice-probability sum, so its null price need not be encoded as a finite real. The objective's no-sale continuation term is counted once, following equations (5) and (22), despite the ambiguous bracket placement in printed equation (3). In-stock prices are finite and nonnegative. Off-stock coordinates of the displayed candidate vector are set to zero and do not affect demand.

Lean's natural-number subtraction in x−eix-e^ix−ei is used only for i∈S(x)i\in S(x)i∈S(x), where it subtracts exactly one unit. The Bellman value uses a real sSup, whose default on a badly bounded set could otherwise obscure the theorem. The goal and final milestone therefore require an explicit maximizing price vector and equality between the value and its objective. The margin root is stated as unique and every root is covered; it is not hidden behind a choice operator. Equation (11) quantifies over all roots for s=1,…,ts=1,\ldots,ts=1,…,t at one fixed xxx, not along a sample path. No assumption that n>0n>0n>0 or S(x)S(x)S(x) is nonempty is added to the goal. The price–probability mapping and interior optimality milestones assume S(x)S(x)S(x) nonempty where the paper's positive-simplex argument requires it.

A complete development needs finite-sum algebra, real exponential and logarithm facts, concavity on products of real function spaces, and boundedness and attainment facts for the Bellman objective. The MNL probability and inverse-map facts can serve later pricing models; the dynamic value and marginal-stock lemmas serve inventory-control formalizations. Contributions that prove these statements or isolate reusable analytic lemmas are within scope. The statement must retain both the Bellman maximizer and the value identity, so a default sSup value cannot turn the goal into a trivial equality.

Selected references

  • Lingxiu Dong, Panos Kouvelis, and Zhongjun Tian, Dynamic Pricing and Inventory Control of Substitute Products, Manufacturing & Service Operations Management 11(2), 317–339, 2009. DOI: 10.1287/msom.1080.0221.
10 thms2 active usersReviewed
Dynamic ProgrammingOptimization·Captain: mikedeng1

Dynamic Pricing and Inventory Control of Substitute Products 2: The Optimal Unified Dynamic Price under Multinomial Logit ChoiceResearch Paper

Motivation

Retailers often sell several variates of one product (colours, sizes or flavours of an otherwise identical item) from a fixed stock over a short season, with no replenishment. Customers substitute among the variates and the no-purchase option, so the price of one variate changes the demand for all of them, and the stock of each variate changes the value of selling the others. Dong, Kouvelis and Tian (M&SOM 2009) model this joint pricing and inventory problem with multinomial logit (MNL) choice and characterize optimal dynamic prices in closed form up to a scalar equation.

Many sellers do not price variates individually: apparel, sporting goods and airline examples are cited in the paper (Liu and Milner 2006) of unified dynamic pricing, where one price is charged for all variates and changed over time. Proposition 1 of the paper gives the optimal unified price and the optimal revenue in the same form as the paper's main result for variate-specific prices. Comparing the two quantifies how much revenue is lost by restricting to a common price, which is the purpose of the paper's §5.

Setting

There are nnn variates, n={1,…,n}\mathfrak n=\{1,\dots,n\}n={1,…,n}. Variate iii has quality index ai∈Ra_i\in\mathbb Rai​∈R, the no-purchase option has utility u0∈Ru_0\in\mathbb Ru0​∈R, μ>0\mu>0μ>0 is the MNL scale parameter, and in each period one customer arrives with probability λ∈(0,1]\lambda\in(0,1]λ∈(0,1]. Time ttt counts the remaining periods, so the season runs t=T,T−1,…,1t=T,T-1,\dots,1t=T,T−1,…,1 and ends at t=0t=0t=0.

An inventory level is x∈Nnx\in\mathbb N^nx∈Nn. The in-stock set is S(x)={i:xi>0}S(x)=\{i:x^i>0\}S(x)={i:xi>0}, and x−eix-e^ix−ei is the inventory after one sale of variate i∈S(x)i\in S(x)i∈S(x). Out-of-stock variates are not offered. At the price vector rrr, an arriving customer buys variate i∈S(x)i\in S(x)i∈S(x) or nothing with the MNL probabilities

Pi(r)=e(ai−ri)/μ∑j∈S(x)e(aj−rj)/μ+eu0/μ,P0(r)=eu0/μ∑j∈S(x)e(aj−rj)/μ+eu0/μ.P^i(r)=\frac{e^{(a_i-r^i)/\mu}}{\sum_{j\in S(x)}e^{(a_j-r^j)/\mu}+e^{u_0/\mu}},\qquad P^0(r)=\frac{e^{u_0/\mu}}{\sum_{j\in S(x)}e^{(a_j-r^j)/\mu}+e^{u_0/\mu}}.Pi(r)=∑j∈S(x)​e(aj​−rj)/μ+eu0​/μe(ai​−ri)/μ​,P0(r)=∑j∈S(x)​e(aj​−rj)/μ+eu0​/μeu0​/μ​.

Under unified pricing the decision in each period is one price r≥0r\ge0r≥0 charged for every in-stock variate. The unified value function πt(x)\pi_t(x)πt​(x), the maximal expected revenue from ttt remaining periods, satisfies π0≡0\pi_0\equiv0π0​≡0 and

πt(x)=max⁡r≥0{λ∑i∈S(x)rPi+λ∑i∈S(x)Piπt−1(x−ei)+(λP0+1−λ)πt−1(x)},\pi_t(x)=\max_{r\ge0}\Bigl\{\lambda\sum_{i\in S(x)}rP^i+\lambda\sum_{i\in S(x)}P^i\pi_{t-1}(x-e^i)+(\lambda P^0+1-\lambda)\pi_{t-1}(x)\Bigr\},πt​(x)=r≥0max​{λi∈S(x)∑​rPi+λi∈S(x)∑​Piπt−1​(x−ei)+(λP0+1−λ)πt−1​(x)},

with Pi,P0P^i,P^0Pi,P0 evaluated at (r,…,r)(r,\dots,r)(r,…,r). Write Δiπt−1(x)=πt−1(x)−πt−1(x−ei)\Delta^i\pi_{t-1}(x)=\pi_{t-1}(x)-\pi_{t-1}(x-e^i)Δiπt−1​(x)=πt−1​(x)−πt−1​(x−ei) for the marginal value of a unit of variate iii, and

Δwπt−1(x)=∑i∈S(x)eai/μΔiπt−1(x)∑i∈S(x)eai/μ,aw=μln⁡∑i∈S(x)eai/μ.\Delta^w\pi_{t-1}(x)=\frac{\sum_{i\in S(x)}e^{a_i/\mu}\Delta^i\pi_{t-1}(x)}{\sum_{i\in S(x)}e^{a_i/\mu}},\qquad a_w=\mu\ln\sum_{i\in S(x)}e^{a_i/\mu}.Δwπt−1​(x)=∑i∈S(x)​eai​/μ∑i∈S(x)​eai​/μΔiπt−1​(x)​,aw​=μlni∈S(x)∑​eai​/μ.

Formalization targets

Goal: Proposition 1

For t≥1t\ge1t≥1 and S(x)≠∅S(x)\neq\emptysetS(x)=∅, the equation

(mμ−1)exp⁡(m+u0μ)=exp⁡(aw−Δwπt−1(x)μ)\Bigl(\frac{m}{\mu}-1\Bigr)\exp\Bigl(\frac{m+u_0}{\mu}\Bigr)=\exp\Bigl(\frac{a_w-\Delta^w\pi_{t-1}(x)}{\mu}\Bigr)(μm​−1)exp(μm+u0​​)=exp(μaw​−Δwπt−1​(x)​)

has a unique solution mt(x)m_t(x)mt​(x); the price

rt∗(x)=Δwπt−1(x)+mt(x)r^*_t(x)=\Delta^w\pi_{t-1}(x)+m_t(x)rt∗​(x)=Δwπt−1​(x)+mt​(x)

is nonnegative and optimal, with mt(x)P0(rt∗)=μm_t(x)P^0(r^*_t)=\mumt​(x)P0(rt∗​)=μ; and

πt(x)=λ∑s=1t[ms(x)−μ],\pi_t(x)=\lambda\sum_{s=1}^{t}\bigl[m_s(x)-\mu\bigr],πt​(x)=λs=1∑t​[ms​(x)−μ],

where ms(x)m_s(x)ms​(x) solves the equation of period sss at the same inventory xxx. The statement asserts attainment of the maximum, not only a value for πt\pi_tπt​.

Milestones

The proof in Appendix A proceeds through a one-variable problem. For marginal values δi\delta_iδi​ let ξ(r)=∑i∈S(x)λPi(r)(r−δi)\xi(r)=\sum_{i\in S(x)}\lambda P^i(r)(r-\delta_i)ξ(r)=∑i∈S(x)​λPi(r)(r−δi​). The milestones are: the rewriting (23)–(24) of the optimality equation as an attained max⁡r≥0ξtu+πt−1(x)\max_{r\ge0}\xi^u_t+\pi_{t-1}(x)maxr≥0​ξtu​+πt−1​(x); the derivatives of PiP^iPi, P0P^0P0 and ξ\xiξ in the common price; the first-order conditions (25)–(26) with ξ>0\xi>0ξ>0 and 0<P0<10<P^0<10<P0<1 at a stationary point; the second-order condition, giving exactly one stationary point, which is the global maximizer of ξ\xiξ on R\mathbb RR; the formula r=δw+mr=\delta_w+mr=δw​+m with m=μ/P0m=\mu/P^0m=μ/P0 and the equation for mmm; uniqueness of the root of the margin equation, with root >μ>\mu>μ; and the displayed revenue sum πt(x)=λ∑s=1t[ms(x)−μ]\pi_t(x)=\lambda\sum_{s=1}^{t}[m_s(x)-\mu]πt​(x)=λ∑s=1t​[ms​(x)−μ] at the same inventory.

Significance

Proposition 1 reduces a dynamic program over a high-dimensional inventory state to a scalar root-finding problem per state and period, and gives the optimal revenue as a sum of margins. It shows that the full dynamic pricing result (Theorem 1 of the paper) survives the restriction to a common price, with the individual marginal values Δiπt−1\Delta^i\pi_{t-1}Δiπt−1​ replaced by their quality-weighted average Δwπt−1\Delta^w\pi_{t-1}Δwπt−1​, and the qualities replaced by the aggregate awa_waw​. This is what makes the paper's numerical comparison of unified, static and full dynamic pricing in §5 computable.

The result is proved in the paper; it has not been formalized. A formalization produces a checked version of the MNL derivative calculus, of the quasiconcavity argument for the common-price objective, and of the backward induction, and it closes a step the printed proof leaves implicit: that the maximizer over all real prices is nonnegative, so that it is feasible for the constrained problem.

Difficulty

The one-period objective is not concave in the price, so neither a concavity argument nor a direct appeal to a compactness theorem gives a unique maximizer. Negativity of the second derivative at stationary points is a local statement; the existence of a stationary point and its being the global maximum on all of R\mathbb RR do not follow from it alone.

The second difficulty is the constraint r≥0r\ge0r≥0. The paper solves the unconstrained problem. Showing that Δwπt−1(x)+mt(x)≥0\Delta^w\pi_{t-1}(x)+m_t(x)\ge0Δwπt−1​(x)+mt​(x)≥0 needs a property of the unified value function, nonnegativity of the weighted marginal value, which the paper does not state. The obvious argument, πt−1\pi_{t-1}πt−1​ increasing in inventory term by term, does not apply verbatim when a variate leaves the in-stock set, because the choice set itself changes.

Finally, a supremum in Lean is a real number even when not attained; the value identity is only meaningful together with attainment, which the goal states explicitly.

Formalization scope

The model is one definition file, SubstitutePricing.Unified.Model: a structure with nnn, a:Fin n→Ra:\mathrm{Fin}\,n\to\mathbb Ra:Finn→R, u0u_0u0​, μ\muμ, λ\lambdaλ; assumptions μ>0\mu>0μ>0, 0<λ≤10<\lambda\le10<λ≤1; inventories x:Fin n→Nx:\mathrm{Fin}\,n\to\mathbb Nx:Finn→N; the in-stock set as a Finset; MNL probabilities with sums over S(x)S(x)S(x) only (the paper's null price ri=∞r^i=\inftyri=∞ is modelled by removal from the choice set); and the unified value function by recursion on ttt, as a real sSup over r∈[0,∞)r\in[0,\infty)r∈[0,∞). The equation (3) is read with the no-purchase term outside the sum over variates, as the paper's (5) and (22) use it.

Committed conventions and restrictions:

  • t≥1t\ge1t≥1 in Proposition 1 (the printed "t=T,…,0t=T,\dots,0t=T,…,0" includes t=0t=0t=0, where πt−1\pi_{t-1}πt−1​ does not exist).
  • S(x)≠∅S(x)\neq\emptysetS(x)=∅ in every statement of the dynamic program and in the static milestones that use it: for an empty in-stock set awa_waw​ and Δwπ\Delta^w\piΔwπ involve ln⁡0\ln0ln0 and 0/00/00/0, and the revenue formula fails.
  • The optimal margin is quantified as the unique root of its equation, and the revenue formula takes the roots of all periods s≤ts\le ts≤t at the same inventory xxx.
  • The goal asserts nonnegativity of rt∗r^*_trt∗​; the paper's proof uses but does not prove it.
  • The paper's intermediate display (27) is misprinted and is not formalized; its correct consequences are.
  • Milestones 2–6 concern a static objective with arbitrary marginal values δ\deltaδ; only the goal and the recursion milestone refer to the value function.

A statement about πt\pi_tπt​ alone, without the attainment and feasibility of rt∗r^*_trt∗​, would be trivially satisfiable by a junk supremum and is ruled out by the goal's form.

Infrastructure needed: derivatives of MNL probabilities, a quasiconcavity or unique-critical-point lemma for one-variable functions, a root lemma for (m/μ−1)e(m+u0)/μ(m/\mu-1)e^{(m+u_0)/\mu}(m/μ−1)e(m+u0​)/μ, and a monotonicity property of the unified value function. The MNL derivative calculus and the root lemma are reusable for the companion missions on full dynamic pricing and mixed pricing from the same paper. Contributions on any milestone, and on the nonnegativity of Δwπt−1\Delta^w\pi_{t-1}Δwπt−1​, are welcome.

Selected references

  • L. Dong, P. Kouvelis, Z. Tian, Dynamic Pricing and Inventory Control of Substitute Products, Manufacturing & Service Operations Management 11(2), 317–339, 2009. https://doi.org/10.1287/msom.1080.0221
  • G. Gallego, G. van Ryzin, A Multiproduct Dynamic Pricing Problem and Its Applications to Network Yield Management, Operations Research 45(1), 24–41, 1997. https://doi.org/10.1287/opre.45.1.24
  • Q. Liu, J. Milner, Multiple-item dynamic pricing under a common pricing constraint, working paper, University of Toronto, 2006 (cited in the source as the motivation for unified pricing).
  • S. P. Anderson, A. de Palma, J.-F. Thisse, Discrete Choice Theory of Product Differentiation, MIT Press, 1992.
9 thms2 active usersReviewed
Dynamical SystemsProbabilityRandom Matrix Theory·Captain: mikedeng1

Subadditive Ergodic Theory 4: Furstenberg–Kesten — for Stationary Positive Random Matrices, n⁻¹ log [Y₁⋯Y_n]_ij Converges, Independently of i and jResearch Paper

Products of random matrices

Many systems evolve by repeated multiplication by a random linear map: the state of a linear system with randomly varying coefficients, population vectors in a random environment (Leslie models whose rates change from year to year), the transfer matrices of a disordered one-dimensional medium, and the transition operators of a Markov chain in a random environment. In each case the object of interest is the product Xn=Y1Y2⋯YnX_n = Y_1 Y_2 \cdots Y_nXn​=Y1​Y2​⋯Yn​ of random matrices and its growth as n→∞n\to\inftyn→∞.

The basic answer is due to Furstenberg and Kesten (Products of random matrices, Ann. Math. Statist. 31 (1960)): under a logarithmic moment condition and stationarity, n−1log⁡n^{-1}\logn−1log of the size of XnX_nXn​ converges. Their proof was a substantial piece of analysis. In his 1973 IMS Special Invited Paper (Kingman, Subadditive ergodic theory, Ann. Probab. 1 (1973)), J. F. C. Kingman showed that for matrices with strictly positive entries the result is a short corollary of his subadditive ergodic theorem (Theorem 1 of that paper, 1968). This mission formalizes that application: Theorem 5 of the 1973 paper, §2.2, pp. 891–892.

Timeline:

  • 1960: Furstenberg and Kesten prove convergence of n−1log⁡∥Xn∥n^{-1}\log\|X_n\|n−1log∥Xn​∥ and, for positive matrices, of n−1log⁡[Xn]ijn^{-1}\log[X_n]_{ij}n−1log[Xn​]ij​.
  • 1968: Kingman proves the subadditive ergodic theorem (J. Roy. Statist. Soc. B 30).
  • 1973: Kingman's survey deduces the positive-matrix theorem (Theorem 5) and the general Banach-algebra version (Theorem 6) from it.

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) be a probability space, k≥1k\ge1k≥1, and let Y1,Y2,…Y_1, Y_2,\dotsY1​,Y2​,… be random k×kk\times kk×k real matrices. Write [A]ij[A]_{ij}[A]ij​ for the (i,j)(i,j)(i,j)th entry of a matrix AAA, and

Xn=Y1Y2⋯Yn(2.2.1),X_n = Y_1 Y_2\cdots Y_n \qquad (2.2.1),Xn​=Y1​Y2​⋯Yn​(2.2.1),

the product taken left to right. The sequence (Yn)(Y_n)(Yn​) is stationary if the joint law of (Y2,Y3,… )(Y_2, Y_3, \dots)(Y2​,Y3​,…) equals the joint law of (Y1,Y2,… )(Y_1, Y_2, \dots)(Y1​,Y2​,…); this is a statement about all finite-dimensional distributions at once, and it includes the case of independent identically distributed matrices.

The proof works with the diagonal process

zst=[Ys+1Ys+2⋯Yt]11,xst=−log⁡zst(s<t),z_{st} = [Y_{s+1}Y_{s+2}\cdots Y_t]_{11},\qquad x_{st} = -\log z_{st}\qquad (s<t),zst​=[Ys+1​Ys+2​⋯Yt​]11​,xst​=−logzst​(s<t),

and with the ℓ1\ell_1ℓ1​-norm ∥A∥=max⁡i∑j∣[A]ij∣\|A\| = \max_i \sum_j |[A]_{ij}|∥A∥=maxi​∑j​∣[A]ij​∣. A family (xst)s<t(x_{st})_{s<t}(xst​)s<t​ is a subadditive process (§1.1) if S₁: xsu≤xst+xtux_{su}\le x_{st}+x_{tu}xsu​≤xst​+xtu​ for s<t<us<t<us<t<u; S₂: the joint distributions of (xs+1,t+1)(x_{s+1,t+1})(xs+1,t+1​) equal those of (xst)(x_{st})(xst​); S₃: gt=E(x0t)g_t=E(x_{0t})gt​=E(x0t​) exists and gt≥−Atg_t\ge -Atgt​≥−At for some constant AAA.

Formalization targets

Goal: Theorem 5

Suppose the elements of the matrices YnY_nYn​ are strictly positive, E∣log⁡[Yn]ij∣<∞E|\log[Y_n]_{ij}|<\inftyE∣log[Yn​]ij​∣<∞ for every nnn and every i,ji,ji,j, and (Yn)(Y_n)(Yn​) is stationary. Then there is one finite random variable λ\lambdaλ such that for every (i,j)(i,j)(i,j)

λ=lim⁡n→∞n−1log⁡[Xn]ij(2.2.2)\lambda = \lim_{n\to\infty} n^{-1}\log [X_n]_{ij} \qquad (2.2.2)λ=n→∞lim​n−1log[Xn​]ij​(2.2.2)

with probability one and in mean. The limit is random in general (it is constant when (Yn)(Y_n)(Yn​) is ergodic); the theorem asserts its existence, its finiteness and its independence of (i,j)(i,j)(i,j), and nothing about its value.

Milestones, in the order of the paper's proof

  1. (2.3.1): [AB]11≥[A]11[B]11[AB]_{11}\ge[A]_{11}[B]_{11}[AB]11​≥[A]11​[B]11​ for matrices with strictly positive entries.
  2. xst=−log⁡zstx_{st}=-\log z_{st}xst​=−logzst​ satisfies S₁ and S₂, and each xstx_{st}xst​ has finite expectation gt−sg_{t-s}gt−s​.
  3. E{log⁡∥Y1∥}<∞E\{\log\|Y_1\|\}<\inftyE{log∥Y1​∥}<∞ and gn/n≥−E{log⁡∥Y1∥}g_n/n\ge -E\{\log\|Y_1\|\}gn​/n≥−E{log∥Y1​∥} for all n≥1n\ge1n≥1, so S₃ holds.
  4. The limit (2.2.2) exists, with probability one and in mean, for i=j=1i=j=1i=j=1.
  5. (2.2.3): for every (i,j)(i,j)(i,j), P{lim inf⁡n−1log⁡[Xn]ij≥λ}=1P\{\liminf n^{-1}\log[X_n]_{ij}\ge\lambda\}=1P{liminfn−1log[Xn​]ij​≥λ}=1.
  6. For every (i,j)(i,j)(i,j), P{lim sup⁡n−1log⁡[Xn]ij≤λ}=1P\{\limsup n^{-1}\log[X_n]_{ij}\le\lambda\}=1P{limsupn−1log[Xn​]ij​≤λ}=1.

Significance

The limit λ\lambdaλ is the top Lyapunov exponent of the random product: it is the almost-sure exponential growth rate of every entry, and hence of every norm, of XnX_nXn​. It governs the stability of random linear recursions vn=vn−1Ynv_{n}=v_{n-1}Y_nvn​=vn−1​Yn​, the long-run growth rate of populations in random environments, and localization in one-dimensional disordered systems. Theorem 5 is the existence statement on which all of these quantitative questions rest.

The theorem has been proved since 1960, and Kingman's derivation is a classical model application of subadditive ergodic theory. To our knowledge it has no machine-checked proof: Mathlib has neither Kingman's subadditive ergodic theorem nor any limit theorem for random matrix products. This mission produces a formal statement of the result together with the formal decomposition of the proof into the steps Kingman writes down; its milestone 4 is exactly where the subadditive ergodic theorem (the goal of the companion mission Subadditive Ergodic Theory 1) is applied.

Difficulty

Milestones 1–3 are deterministic matrix inequalities plus integrability bookkeeping; the substance is elsewhere. First, milestone 4 needs the full subadditive ergodic theorem, almost-sure and in mean, for a non-ergodic stationary process: the classical Birkhoff theorem does not apply, because log⁡[Xn]11\log[X_n]_{11}log[Xn​]11​ is not a sum of stationary increments. Second, passing from the diagonal entry to all entries requires controlling n−1log⁡[Yn]1jn^{-1}\log[Y_n]_{1j}n−1log[Yn​]1j​ along a stationary sequence with only a first-moment hypothesis, and transporting an almost-sure statement about Xn′=Y2⋯Yn+1X_n'=Y_2\cdots Y_{n+1}Xn′​=Y2​⋯Yn+1​ back to XnX_nXn​ by stationarity, where the limit λ\lambdaλ is itself random. The natural shortcut — treating λ\lambdaλ as a constant — is only valid under ergodicity, which is not assumed.

Formalization scope

  • Matrices are Matrix (Fin k) (Fin k) ℝ with NeZero k; the paper's index 111 is 0 : Fin k. The sequence is Y : ℕ → Ω → Matrix …, read only for n≥1n\ge1n≥1; Y 0 plays no role.
  • Products are ordered: Ys+1⋯YtY_{s+1}\cdots Y_tYs+1​⋯Yt​ is the List.prod of [Y (s+1), …, Y t]; X0X_0X0​ is the identity.
  • Stationarity is equality of the laws of (Yn+2)n≥0(Y_{n+2})_{n\ge0}(Yn+2​)n≥0​ and (Yn+1)n≥0(Y_{n+1})_{n\ge0}(Yn+1​)n≥0​ on ℕ → Fin k → Fin k → ℝ with the product σ-algebra. Independence is not assumed.
  • Positivity holds for every outcome; "their logarithms have finite expectations" is integrability of every log⁡[Yn]ij\log[Y_n]_{ij}log[Yn​]ij​, n≥1n\ge1n≥1.
  • "Finite limit" is a real-valued lam : Ω → ℝ; "in mean" is E∣n−1log⁡[Xn]ij−λ∣→0E|n^{-1}\log[X_n]_{ij}-\lambda|\to0E∣n−1log[Xn​]ij​−λ∣→0 with λ\lambdaλ integrable; time is n∈Nn\in\mathbb Nn∈N with Filter.atTop. One lam serves all (i,j)(i,j)(i,j).
  • Lim inf and lim sup inequalities are stated with ε\varepsilonε: almost surely, for every ε>0\varepsilon>0ε>0, eventually n−1log⁡[Xn]ij≥λ−εn^{-1}\log[X_n]_{ij}\ge\lambda-\varepsilonn−1log[Xn​]ij​≥λ−ε (respectively ≤λ+ε\le\lambda+\varepsilon≤λ+ε), which avoids the junk value of a real liminf on unbounded sequences.
  • Real.log 0 = 0 in Lean; the statements apply log only to entries that are strictly positive under the hypotheses, so no junk value enters. Dropping the positivity hypothesis would change the theorem, and is not an acceptable shortcut.
  • The S₁/S₂ vocabulary of §1.1 comes from the group's shared process module; this mission defines gtg_tgt​ locally. The general subadditive ergodic theorem is not restated here, and milestone 4 is the object-specific statement the paper writes.

Welcome contributions: proofs of the matrix inequalities, the integrability and stationarity transfer lemmas, a formal subadditive ergodic theorem (shared with the companion mission).

Selected references

  • J. F. C. Kingman, Subadditive ergodic theory, Ann. Probab. 1(6):883–899, 1973. https://doi.org/10.1214/aop/1176996798
  • H. Furstenberg and H. Kesten, Products of random matrices, Ann. Math. Statist. 31(2):457–469, 1960. https://doi.org/10.1214/aoms/1177705909
  • J. F. C. Kingman, The ergodic theory of subadditive stochastic processes, J. Roy. Statist. Soc. Ser. B 30(3):499–510, 1968. https://doi.org/10.1111/j.2517-6161.1968.tb00749.x
9 thms2 active usersReviewed
Dynamic ProgrammingLinear OptimizationMarkov Chain·Captain: mikedeng1

Linear Programming and Markov Decision Chains 2: Representatives of Average Optimal Stationary Policies Are Optimal Dual Solutions, and Every Optimal Dual Solution Gives an Average Optimal PolicyResearch Paper

Motivation

A finite Markov decision process may have several recurrent classes under one policy. In that setting, its long-run reward depends on the initial state, and a single stationary distribution does not describe the whole decision problem. Hordijk and Kallenberg developed a linear program with two families of variables to handle this multichain case. Their Theorem 8 relates policies to feasible points of that program in both directions: optimal stationary policies give optimal dual solutions, and every optimal dual solution gives an average optimal stationary policy. This relationship explains why the dual program represents the original sequential decision problem rather than merely bounding its value. Hordijk and Kallenberg (1979)

An earlier frequency formulation associated stationary randomized policies with one family of occupation variables in a more restricted Markov-chain setting. The present theorem uses both xxx and yyy variables, and its policy comparison covers history-dependent randomized decisions. The corresponding formalization therefore addresses the finite multichain model of the 1979 paper, with its own dual equations and representative map. Hordijk and Kallenberg (1979), §§1 and 3.3

Setting

Let EEE be a nonempty finite set of states. At state iii, an action aaa is chosen from a nonempty finite set A(i)A(i)A(i). It earns a real reward riar_{ia}ria​ and moves to state jjj with probability piajp_{iaj}piaj​. The transition probabilities are nonnegative and sum to one over jjj. A general policy RRR may randomize and use the complete past history. Its average reward ϕi(R)\phi_i(R)ϕi​(R) is the liminf, as the horizon grows, of expected total reward divided by the horizon when the initial state is iii. The optimal value ϕi\phi_iϕi​ is the supremum of ϕi(R)\phi_i(R)ϕi​(R) over all such policies. A policy is average optimal when it attains that value at every state. These are the conventions of §2.1 of the paper. Hordijk and Kallenberg (1979), p. 353

A stationary randomized policy π∞\pi^\inftyπ∞ chooses each admissible action aaa at state iii with a fixed probability πia\pi_{ia}πia​, independently of the epoch and history. Its transition matrix is P(π)ij=∑a∈A(i)πiapiajP(\pi)_{ij}=\sum_{a\in A(i)}\pi_{ia}p_{iaj}P(π)ij​=∑a∈A(i)​πia​piaj​, and its reward vector is r(π)i=∑a∈A(i)πiariar(\pi)_i=\sum_{a\in A(i)}\pi_{ia}r_{ia}r(π)i​=∑a∈A(i)​πia​ria​. The Cesàro limit matrix P∗(π)P^*(\pi)P∗(π) and deviation matrix D(π)D(\pi)D(π) describe the recurrent and transient behavior of this finite chain. In particular, ϕ(π∞)=P∗(π)r(π)\phi(\pi^\infty)=P^*(\pi)r(\pi)ϕ(π∞)=P∗(π)r(π). Hordijk and Kallenberg (1979), p. 359

Fix positive state weights βj\beta_jβj​ summing to one. The primal linear program minimizes ∑jβjϕ~j\sum_j\beta_j\widetilde\phi_j∑j​βj​ϕ​j​ over pairs (ϕ~,u~)(\widetilde\phi,\widetilde u)(ϕ​,u) that are superharmonic: for every iii and a∈A(i)a\in A(i)a∈A(i), the first vector dominates its one-step expected continuation, and the sum of the two vectors dominates one-step reward plus the continuation of the second. The dual linear program maximizes ∑i,ariaxia\sum_{i,a}r_{ia}x_{ia}∑i,a​ria​xia​ over nonnegative xiax_{ia}xia​ and yiay_{ia}yia​ satisfying the two flow equations (3) and (4). Variables are present only for admissible state-action pairs. The set ExE_xEx​ consists of states where ∑axia>0\sum_a x_{ia}>0∑a​xia​>0. Hordijk and Kallenberg (1979), pp. 356–357

For a feasible dual point (x,y)(x,y)(x,y), the associated policy π(x,y)\pi(x,y)π(x,y) normalizes the xxx row at states in ExE_xEx​ and the yyy row at other states. Conversely, equation (6) constructs a representative (x(π),y(π))(x(\pi),y(\pi))(x(π),y(π)) of a stationary randomized policy. Its xxx coordinates use βTP∗(π)\beta^TP^*(\pi)βTP∗(π). Its yyy coordinates use βTD(π)+γTP∗(π)\beta^TD(\pi)+\gamma^TP^*(\pi)βTD(π)+γTP∗(π), where γ\gammaγ is zero at transient states and is chosen separately on each recurrent class by a maximum formula. The formalization restricts that formula's denominator to the recurrent class, as required by the subsequent nonnegativity calculation; the printed unrestricted denominator has a two-state counterexample. Hordijk and Kallenberg (1979), pp. 359–360

Formalization targets

Optimality correspondence

The goal is Theorem 8, with both directions in one statement:

π∞ average optimal ⟹ (x(π),y(π)) dual optimal,(x,y) dual optimal ⟹ π∞(x,y) average optimal.\pi^\infty\text{ average optimal}\ \Longrightarrow\ (x(\pi),y(\pi))\text{ dual optimal}, \qquad (x,y)\text{ dual optimal}\ \Longrightarrow\ \pi^\infty(x,y)\text{ average optimal}.π∞ average optimal ⟹ (x(π),y(π)) dual optimal,(x,y) dual optimal ⟹ π∞(x,y) average optimal.

The second implication applies to every optimal dual point. It produces the stationary randomized policy given by the printed normalization rule, including its existence as a valid policy. The first implication uses the particular representative defined by equation (6). Neither direction imposes an extreme-point condition. Hordijk and Kallenberg (1979), Theorem 8, p. 360

Supporting results

The milestones state the least-superharmonic characterization of ϕ\phiϕ; the positivity that makes the dual-to-policy normalization meaningful; the stationary gain identity; feasibility and objective value of the representative; and Propositions 4 and 5, which describe tight actions and identify ExE_xEx​ with the recurrent states of P(π(x,y))P(\pi(x,y))P(π(x,y)). Each is a statement about the same finite model and the same primal–dual pair. Hordijk and Kallenberg (1979), pp. 356–361

Significance

The theorem establishes an exact relation between two ways of expressing average optimality. The LP direction turns an optimal stationary policy into a dual optimum with a concrete state-action representation. The converse says an arbitrary optimal dual point can be read as an average optimal policy, even when its xxx coordinates vanish at some states. Proposition 5 specifies what those vanishing coordinates mean for the induced chain: those states are transient. These statements permit optimization over a finite LP while preserving the policy interpretation of its solutions. Hordijk and Kallenberg (1979), Theorem 8 and Proposition 5

The result was proved in 1979; this mission asks for a machine-checked proof of its precise finite-state statement. The shared MDP model and the limit and deviation matrix definitions already exist as published formal objects. The new work is the correspondence for Hordijk and Kallenberg's dual equations, with the representative, its class-wise correction, and the connection to liminf average reward. The definitions of stationary policy mixtures, admissible-pair LP coordinates, and finite-chain recurrence can support later results about average-reward optimization.

Difficulty

Normalizing xxx alone does not define a policy at every state: its row sum can be zero. The dual program's second variable yyy supplies the action weights there, and the feasibility equations must ensure its row sum is positive. In the other direction, the natural βTD(π)\beta^TD(\pi)βTD(π) term in y(π)y(\pi)y(π) need not be nonnegative. The correction γ\gammaγ is chosen by a maximum over each recurrent class, while transient states require a different case. These issues remain in a multichain process even though the state and action sets are finite. Hordijk and Kallenberg (1979), pp. 359–361

Formalization scope

Lean uses finite types for states and actions, a nonempty state type, and a nonempty admissible action set at every state. The published StationaryMDP definition provides real rewards and stochastic transition rows. General policies are its history-dependent randomized AvgHRPolicy values; average reward is its liminf reward, and optimal gain is the supremum over that entire policy class. The mission defines its own average-optimality predicate because the published Puterman predicate uses a stronger limsup comparison. For finite rewards, the liminf gains and their supremum are bounded real numbers.

Stationary randomized weights are nonnegative, sum to one on each A(i)A(i)A(i), and vanish outside A(i)A(i)A(i). The dual variables are functions on the subtype of admissible state-action pairs. The primal and dual optima mean feasible points attaining the relevant objective against every other feasible point. The paper's positive, normalized β\betaβ remains explicit. The raw formula for π(x,y)\pi(x,y)π(x,y) is used only with a feasible dual point, and the policy-well-definedness milestone supplies its nonzero denominators. The representative uses a maximum over the ergodic class of each recurrent state, with the class-restricted denominator needed by the paper's proof; replacing γ\gammaγ by zero or by one global maximum would change the target.

The known matrix objects P∗P^*P∗ and DDD are imported from the published Blackwell development. Their convergence and identities are theorem obligations, not assumptions hidden in definitions. Contributions proving the finite-chain identities, representative feasibility, complementary slackness, and the final policy comparison are within scope. A statement restricted to a unichain model, an extreme dual point, or a pure selected action would not establish this theorem.

Selected references

  • A. Hordijk and L. C. M. Kallenberg, Linear Programming and Markov Decision Chains, Management Science 25(4):352–362, 1979. DOI: 10.1287/mnsc.25.4.352.
13 thms2 active usersReviewed
CombinatoricsGraph Theory·Captain: mikedeng1

Paths, Trees, and Flowers II: Invariance of the Dual — the Outer Vertices O(G) Are Exactly the Vertices Left Exposed by Some Maximum MatchingResearch Paper

Motivation

A maximum matching of a graph is a largest set of edges no two of which share a vertex. Maximum matchings are rarely unique, and a basic question is which features of them are forced by the graph. J. Edmonds' paper Paths, trees, and flowers (Canad. J. Math. 17 (1965), 449–467) gave the first polynomial-time algorithm for maximum matching in general graphs. Its Section 6, Invariance of the dual, uses the output of that algorithm to answer this question. The vertices that some maximum matching leaves uncovered, their neighbours, and the rest form a decomposition of the graph that does not depend on the matching chosen or on any choice made by the algorithm.

This decomposition is now called the Gallai–Edmonds structure theorem. T. Gallai obtained it independently (Gallai 1963, 1964; see Selected references). It is a standard tool in matching theory (Lovász–Plummer, Matching Theory, 1986): it determines the minimum odd-set cover of Section 5 of the same paper canonically (6.7), and it underlies the Tutte–Berge formula and the analysis of factor-critical graphs.

Timeline. Berge (1957) characterized maximum matchings by the absence of augmenting paths. Gallai (1963–1964) and Edmonds (1965, §6) proved the structure theorem; Edmonds' proof goes through the trees and shrunken blossoms of his algorithm. Witzgall's argument, reported in 6.6, simplifies the converse half.

Setting

A graph GGG has a finite set of vertices and a finite set of edges, each edge meeting exactly two distinct vertices; parallel edges are allowed. A vertex is exposed for a set of edges MMM if no edge of MMM meets it.

An alternating tree JJJ is a tree (a connected graph with one more vertex than edges) whose vertices are split into inner and outer vertices, so that every edge joins an inner vertex to an outer one and every inner vertex meets exactly two edges of JJJ. A planted tree for MMM with root rrr is an alternating tree such that M∩JM \cap JM∩J is a maximum matching of JJJ and rrr, the vertex of JJJ left exposed by M∩JM \cap JM∩J, is exposed for MMM.

Shrinking a vertex set UUU replaces UUU by a single pseudovertex. Edges inside UUU disappear; edges leaving UUU keep their identity and now meet the pseudovertex. The set UUU is the pseudovertex's complete expansion. A blossom for MMM is an odd circuit BBB for which M∩BM \cap BM∩B is a maximum matching of BBB. Shrinking blossoms repeatedly, inside graphs already shrunk, gives the graph G∗=G/PG^* = G/\mathcal PG∗=G/P, where P\mathcal PP is a partition of the vertices into blossom sets.

Construction 6.0. Let MMM be a maximum matching. Run the matching algorithm on (G,M)(G, M)(G,M) without augmenting. It grows planted trees J1,…,JnJ_1, \dots, J_nJ1​,…,Jn​ in G∗G^*G∗, one from each exposed vertex, and shrinks blossoms as they appear. The output satisfies:

  1. the trees are disjoint and planted for M∗=M/PM^* = M/\mathcal PM∗=M/P;
  2. every exposed vertex of G∗G^*G∗ lies in some tree;
  3. JiJ_iJi​ is Hungarian in G∗−J1−⋯−Ji−1G^* - J_1 - \dots - J_{i-1}G∗−J1​−⋯−Ji−1​: its outer vertices are joined only to its own inner vertices or to earlier trees;
  4. every pseudovertex is an outer vertex of some JiJ_iJi​.

The outer vertices O(G)O(G)O(G) are the vertices whose part is a one-vertex outer vertex of some JiJ_iJi​, together with all vertices of pseudovertex expansions. The inner vertices I(G)I(G)I(G) are the vertices whose part is an inner vertex of some JiJ_iJi​.

Formalization targets

Goal: Theorem 6.2 (a)–(c)

For every maximum matching MMM and every output of construction 6.0:

(a)v∈O(G)  ⟺  ∃ M′ maximum matching of G with v exposed for M′,\text{(a)}\quad v \in O(G) \iff \exists\, M' \text{ maximum matching of } G \text{ with } v \text{ exposed for } M',(a)v∈O(G)⟺∃M′ maximum matching of G with v exposed for M′, (b)v∈I(G)  ⟺  v∉O(G) and v is adjacent to a vertex of O(G),\text{(b)}\quad v \in I(G) \iff v \notin O(G) \text{ and } v \text{ is adjacent to a vertex of } O(G),(b)v∈I(G)⟺v∈/O(G) and v is adjacent to a vertex of O(G), (c)u,v in the same part of P  ⟺  u=v or u,v in the same component of O(G)+,\text{(c)}\quad u,v \text{ in the same part of } \mathcal P \iff u = v \text{ or } u, v \text{ in the same component of } O(G)^+,(c)u,v in the same part of P⟺u=v or u,v in the same component of O(G)+,

where O(G)+O(G)^+O(G)+ is the subgraph induced on O(G)O(G)O(G).

Milestones

  • 4.1–4.2: the maximum matchings of an alternating tree.
  • 4.14: lifting a matching through the complete expansion of a pseudovertex, with a free choice of the exposed vertex.
  • 4.15, extension, in the forest form of 4.20.
  • 6.4: adjacency of outer and inner vertices.
  • 6.2 (b) and 6.2 (c) separately.
  • 6.5: every outer vertex is exposable.
  • 6.6: for non-outer vvv meeting e∈Me \in Me∈M, M−eM - eM−e is maximum in G−vG - vG−v.
  • 6.6: only outer vertices are ever exposed.

A companion item states that construction 6.0 succeeds for every maximum matching.

Significance

The result. Part (a) characterizes, without reference to any algorithm, the vertices that a maximum matching can miss. Parts (b) and (c) then make I(G)I(G)I(G) and G∗G^*G∗ invariants of GGG, as 6.1 announces: "the graph G∗G^*G∗ is uniquely determined by GGG alone". Several consequences rest on this invariance: the unique preferred minimum odd-set cover (6.7), the Tutte–Berge deficiency formula read off from ∣I(G)∣|I(G)|∣I(G)∣ and the components of O(G)+O(G)^+O(G)+, and the classification of graphs into those with and without perfect matchings in terms of a canonical barrier.

Formalizing it. The theorem has been proved since 1964, but the proof in this paper has not been machine-checked. A formalization requires the paper's own objects: multigraphs with edge identity preserved under contraction, nested blossom shrinking, and alternating and planted trees. These are the objects of Edmonds' blossom algorithm, and they are reusable for any formal treatment of it. Mathlib contains Tutte's theorem for simple graphs but neither shrinking nor the Gallai–Edmonds decomposition.

Difficulty

The statement is about one particular output of a nondeterministic process. The partition into trees depends on the order in which they were grown, and the non-matching tree edges and the blossoms chosen are arbitrary (6.1). An outer vertex of a later tree may be joined to an inner vertex of an earlier one, so the individual trees are not Hungarian in G∗G^*G∗. The tempting argument "each tree is Hungarian, so apply the tree lemma tree by tree" therefore fails. Only the ordered condition, applied in both directions as in 6.4, shows that the outer vertices of all trees together are adjacent only to inner vertices. Moving between GGG and G∗G^*G∗ requires lifting matchings through nested blossoms, which means an induction over the nesting rather than over a single odd circuit.

Formalization scope

Graphs are the published EdmondsMatching65.Polyhedron.Graph V E: finite vertex and edge types, an unordered pair of distinct ends for each edge, parallel edges allowed. Matchings are its IsMatching, and "maximum" means maximum cardinality. A matching of a subgraph is a matching of GGG contained in the subgraph's edges. Paths are not needed.

Shrinking is contraction along a Finpartition of the vertex set. The vertices of G∗G^*G∗ are the parts, and the edges of G∗G^*G∗ are the edges of GGG joining different parts. Blossom sets are an inductive predicate recording the nested odd circuits directly; there is no tower of types.

The output of 6.0 is the structure Config60. It records exactly the invariants the construction establishes and nothing more, and the goal is stated for every such configuration. The configuration must not be weakened. Dropping density, the ordered Hungarian condition, the outerness of pseudovertices or the blossom condition on the parts makes (a) or (b) false. Taking the JiJ_iJi​ to be arbitrary trees, or P\mathcal PP an arbitrary partition, would state a different and false theorem. The goal is not vacuous: exists_config_6_0 asserts that a configuration exists for every maximum matching. Shrinking is defined in 4.9 only for connected sets, so the forest form of 4.15 assumes connected parts.

Welcome contributions: the general theory of alternating trees and Hungarian forests (4.2, 4.17 and their forest forms), the lifting lemma 4.14 for nested odd circuits, and a proof of exists_config_6_0.

Selected references

  • J. Edmonds, Paths, trees, and flowers, Canadian Journal of Mathematics 17 (1965), 449–467. https://doi.org/10.4153/CJM-1965-045-4
  • C. Berge, Two theorems in graph theory, Proceedings of the National Academy of Sciences USA 43 (1957), 842–844. https://doi.org/10.1073/pnas.43.9.842
  • T. Gallai, Kritische Graphen II, Publ. Math. Inst. Hungar. Acad. Sci. 8 (1963), 373–395; Maximale Systeme unabhängiger Kanten, ibid. 9 (1964), 401–413.
  • L. Lovász and M. D. Plummer, Matching Theory, North-Holland, 1986 (reprinted AMS Chelsea, 2009). https://doi.org/10.1090/chel/367
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer, 2003, Chapter 24.
16 thms2 active usersReviewed
PreviousPage 10 of 45Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me