Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Probability

1,641 missions · 709 completed

Missions

Open932Completed709All1641
Linear algebraRandom Matrix Theory·Captain: mikedeng1

Random Matrices: Universality of ESDs and the Circular Law 2: The ESD of A_n/√n Converges to μ iff the Normalized Log-Determinants of A_n/√n − zI Converge to μ's Log-Potential for a.e. zResearch Paper

Motivation

The eigenvalues of a large non-Hermitian random matrix are hard to study directly. For Hermitian matrices, the empirical spectral distribution (ESD) is controlled by the resolvent and the Stieltjes transform, both stable under small perturbations. For non-Hermitian matrices no such tool exists: eigenvalues can move a long way under tiny perturbations, and the moment method fails because moments do not determine a measure on C\mathbb CC. The route that works, going back to Girko (1984) and used by Bai (1997), Götze–Tikhomirov (2007), Pan–Zhou (2007) and Tao–Vu (2008), passes through logarithmic determinants. The identity 1nlog⁡∣det⁡(A−zI)∣=∫log⁡∣w−z∣ dμA(w)\frac1n\log|\det(A-zI)|=\int\log|w-z|\,d\mu_A(w)n1​log∣det(A−zI)∣=∫log∣w−z∣dμA​(w) links the ESD μA\mu_AμA​ to a scalar quantity. That scalar is computable from the singular values of A−zIA-zIA−zI, which are eigenvalues of a Hermitian matrix.

Tao and Vu, with an appendix by Krishnapur (Ann. Probab. 38 (2010) 2023–2065), turn this link into an exact criterion. Theorem 1.15 of that paper states that the ESD of a normalized i.i.d. random matrix converges to a measure μ\muμ if and only if the normalized log-determinants converge to the logarithmic potential of μ\muμ for almost every zzz. The same holds for a regularized version built from the singular values. This mission formalizes Theorem 1.15 and the main steps of its proof (§8 and Appendix A of the published article).

Setting

Let xxx be a complex random variable with Ex=0\mathbf E x=0Ex=0 and E∣x∣2=1\mathbf E|x|^2=1E∣x∣2=1, and let (xij)i,j≥1(x_{ij})_{i,j\ge1}(xij​)i,j≥1​ be independent copies of xxx on a probability space (Ω,P)(\Omega,\mathbf P)(Ω,P). For each nnn, Xn=(xij)1≤i,j≤nX_n=(x_{ij})_{1\le i,j\le n}Xn​=(xij​)1≤i,j≤n​. Let MnM_nMn​ be deterministic n×nn\times nn×n complex matrices with

(1.3)sup⁡n1n2∥Mn∥22<∞,∥M∥22=∑i,j∣mij∣2,\text{(1.3)}\qquad\sup_n\frac1{n^2}\|M_n\|_2^2<\infty,\qquad\|M\|_2^2=\sum_{i,j}|m_{ij}|^2,(1.3)nsup​n21​∥Mn​∥22​<∞,∥M∥22​=i,j∑​∣mij​∣2,

and put An=Mn+XnA_n=M_n+X_nAn​=Mn​+Xn​.

For A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) with eigenvalues λ1,…,λn\lambda_1,\dots,\lambda_nλ1​,…,λn​, counted with algebraic multiplicity, the ESD is μA=1n∑iδλi\mu_A=\frac1n\sum_i\delta_{\lambda_i}μA​=n1​∑i​δλi​​. Its singular values are σ1(A)≥⋯≥σn(A)≥0\sigma_1(A)\ge\dots\ge\sigma_n(A)\ge0σ1​(A)≥⋯≥σn​(A)≥0. A sequence of random measures μn\mu_nμn​ converges in probability to a deterministic μ\muμ if, for every continuous compactly supported f:C→Rf:\mathbb C\to\mathbb Rf:C→R, ∫f dμn−∫f dμ\int f\,d\mu_n-\int f\,d\mu∫fdμn​−∫fdμ tends to 000 in probability. It converges almost surely if, with probability one, ∫f dμn→∫f dμ\int f\,d\mu_n\to\int f\,d\mu∫fdμn​→∫fdμ for all such fff at once. The logarithmic potential of a measure μ\muμ is z↦∫log⁡∣w−z∣ dμ(w)z\mapsto\int\log|w-z|\,d\mu(w)z↦∫log∣w−z∣dμ(w).

Hypothesis (1.4) states that, for almost every zzz, the ESDs of the deterministic matrices (1nMn−zI)(1nMn−zI)∗(\frac1{\sqrt n}M_n-zI)(\frac1{\sqrt n}M_n-zI)^*(n​1​Mn​−zI)(n​1​Mn​−zI)∗ converge to a limit.

In Lean everything lives in the namespace UnivESD.LogDet. The ESD is esd, the one-based singular value is sv, logPotential is the logarithmic potential, and ConvInProb/ConvAS/ESDConvInProb/ESDConvAS are the modes of convergence. IIDArray is the entry model, HSBound is (1.3), shiftA M xs z n ω is 1nAn−zI\frac1{\sqrt n}A_n-zIn​1​An​−zI, and Cond14 is (1.4).

Formalization targets

Goal: Theorem 1.15

Let μ\muμ be a probability measure on C\mathbb CC with ∫∣z∣2 dμ<∞\int|z|^2\,d\mu<\infty∫∣z∣2dμ<∞. The following are equivalent:

  1. μ1nAn→μ\mu_{\frac1{\sqrt n}A_n}\to\muμn​1​An​​→μ in probability;
  2. for a.e. zzz, 1nlog⁡∣det⁡(1nAn−zI)∣→∫Clog⁡∣w−z∣ dμ(w)\displaystyle\frac1n\log\Big|\det\big(\tfrac1{\sqrt n}A_n-zI\big)\Big|\to\int_{\mathbb C}\log|w-z|\,d\mu(w)n1​log​det(n​1​An​−zI)​→∫C​log∣w−z∣dμ(w) in probability;
  3. for a.e. zzz there are εn>0\varepsilon_n>0εn​>0, εn→0\varepsilon_n\to0εn​→0, with
1nlog⁡det⁡((1nAn−zI)(1nAn−zI)∗+εnI)→2∫Clog⁡∣w−z∣ dμ(w)\frac1n\log\det\Big(\big(\tfrac1{\sqrt n}A_n-zI\big)\big(\tfrac1{\sqrt n}A_n-zI\big)^*+\varepsilon_nI\Big)\to2\int_{\mathbb C}\log|w-z|\,d\mu(w)n1​logdet((n​1​An​−zI)(n​1​An​−zI)∗+εn​I)→2∫C​log∣w−z∣dμ(w)

in probability.

Under (1.4) the same equivalence holds with almost sure convergence throughout.

Milestones, in the order the proof uses them

  • (8.1): for a.e. zzz, w↦log⁡∣w−z∣w\mapsto\log|w-z|w↦log∣w−z∣ is μ\muμ-integrable.
  • Lemma A.3 (Weyl's comparison for products): ∏j≤J∣λj∣≤∏j≤Jσj(A)\prod_{j\le J}|\lambda_j|\le\prod_{j\le J}\sigma_j(A)∏j≤J​∣λj​∣≤∏j≤J​σj​(A) and ∏j≥Jσj(A)≤∏j≥J∣λj∣\prod_{j\ge J}\sigma_j(A)\le\prod_{j\ge J}|\lambda_j|∏j≥J​σj​(A)≤∏j≥J​∣λj​∣.
  • (8.3): P(σn−i≤ci/n)=O(exp⁡(−n0.01))\mathbf P(\sigma_{n-i}\le ci/n)=O(\exp(-n^{0.01}))P(σn−i​≤ci/n)=O(exp(−n0.01)) for 2n0.99≤i≤n−12n^{0.99}\le i\le n-12n0.99≤i≤n−1.
  • (8.2): 1n∑i=1n(log⁡σi2+εn−log⁡σi)→0\frac1n\sum_{i=1}^n\big(\log\sqrt{\sigma_i^2+\varepsilon_n}-\log\sigma_i\big)\to0n1​∑i=1n​(logσi2​+εn​​−logσi​)→0 almost surely.
  • p. 2057: almost surely, eventually, 1n∑(1−κ)n<i≤nlog⁡1σi≤O(κlog⁡1κ)\frac1n\sum_{(1-\kappa)n<i\le n}\log\frac1{\sigma_i}\le O(\kappa\log\frac1\kappa)n1​∑(1−κ)n<i≤n​logσi​1​≤O(κlogκ1​), and the same bound for log⁡1∣λi∣\log\frac1{|\lambda_i|}log∣λi​∣1​.

Significance

Theorem 1.15 reduces convergence of a non-Hermitian ESD to a family of scalar limit statements. Each of these can be attacked through Hermitian tools, because the regularized log-determinant in (iii) is a smooth functional of the singular values. Corollary 1.16 of the paper derives from it a practical criterion: the ESD converges to μ\muμ once the singular value distributions of 1nAn−zI\frac1{\sqrt n}A_n-zIn​1​An​−zI converge for a.e. zzz to laws ηz\eta_zηz​ with ∫log⁡t dηz=2∫log⁡∣w−z∣ dμ\int\log t\,d\eta_z=2\int\log|w-z|\,d\mu∫logtdηz​=2∫log∣w−z∣dμ. With the universality principle (Theorem 1.5, the companion mission) and Mehta's computation for complex Gaussian matrices, this yields the circular law for i.i.d. matrices with finite variance.

The theorem is proved in the source. To our knowledge neither it nor any of its milestones has a machine-checked proof. Mathlib has the ingredients for the objects (characteristic polynomials and their roots, LinearMap.singularValues, the strong law of large numbers) but not the results. A formal proof would give the platform its first verified bridge between eigenvalue and singular value asymptotics. Lemma A.3 alone, Weyl's multiplicative majorization, is a standard linear-algebra fact absent from Mathlib.

Difficulty

Two things make the obvious argument fail. First, log⁡\loglog is unbounded at 000. Vague convergence of μ1nAn\mu_{\frac1{\sqrt n}A_n}μn​1​An​​ controls ∫f dμn\int f\,d\mu_n∫fdμn​ only for continuous compactly supported fff, while log⁡∣w−z∣\log|w-z|log∣w−z∣ has a singularity at w=zw=zw=z and grows at infinity. Passing between (i) and (ii) therefore requires uniform control of the eigenvalues (and singular values) near 000 after the shift: the contribution of the smallest ones must vanish. Second, eigenvalues are not stable under perturbation, so this control cannot be read off the eigenvalues. It has to come from the singular values, through a lower-tail bound on σn−i\sigma_{n-i}σn−i​ that is exponentially small in a power of nnn, and through a deterministic inequality transferring bounds from singular values to eigenvalues. The smallest singular values (iii below n0.99n^{0.99}n0.99) need a separate polynomial lower bound (the paper's Lemma 4.1, posed in the companion mission). The tail bound in its printed form is false at that end of the range.

Formalization scope

Conventions committed to in Lean:

  • The ESD is n−1n^{-1}n−1 times the sum of Dirac masses over the root multiset of the characteristic polynomial, so multiplicities are kept. Test functions are real-valued, continuous and compactly supported. Almost sure ESD convergence uses one null set for all test functions.
  • The matrices XnX_nXn​ are the top-left corners of one infinite i.i.d. array. In-probability statements do not depend on how the XnX_nXn​ are coupled across nnn, but almost-sure statements do, and the paper's proof applies the strong law to this array. The limit in (1.4) is required to be a probability measure, which is equivalent under (1.3).
  • The second-moment condition on μ\muμ is Integrable (‖w‖²) μ. The logarithmic potential is a Bochner integral, which is 000 when not integrable; by (8.1) this happens only for a null set of zzz, which "for a.e. zzz" ignores.
  • Real.log 0 = 0. In (ii), a singular matrix would contribute 000 instead of −∞-\infty−∞; for this model the determinant is almost surely nonzero eventually. Every milestone with log⁡σi\log\sigma_ilogσi​ or log⁡∣λi∣\log|\lambda_i|log∣λi​∣ carries positivity of those quantities in its conclusion.
  • Singular values are one-based (sv A i is Mathlib's singularValues (i-1)). Eigenvalue enumerations are Fin n-indexed, and the paper's λi\lambda_iλi​ is index i−1i-1i−1.
  • The paper's O(⋅)O(\cdot)O(⋅) constants are existential and fixed before nnn. In the κlog⁡(1/κ)\kappa\log(1/\kappa)κlog(1/κ) bounds the constant is fixed before κ\kappaκ; a κ\kappaκ-dependent constant would make the bounds empty.

Disclosed corrections to the printed text:

  1. (iii)'s matrix. Theorem 1.15 prints a mis-bracketed product, and (1.8) prints (C+εnI)(C∗+εnI)(C+\varepsilon_nI)(C^*+\varepsilon_nI)(C+εn​I)(C∗+εn​I). The Lean uses CC∗+εnICC^*+\varepsilon_nICC∗+εn​I with C=1nAn−zIC=\frac1{\sqrt n}A_n-zIC=n​1​An​−zI, the matrix of (8.2) and of the proof of Corollary 1.16.
  2. (8.3)'s range. It is printed for 1≤i≤n−n0.991\le i\le n-n^{0.99}1≤i≤n−n0.99, which is false for small iii: for Gaussian entries and Mn=0M_n=0Mn​=0, nσn−1n\sigma_{n-1}nσn−1​ has a non-degenerate limit law. It is posed on 2n0.99≤i≤n−12n^{0.99}\le i\le n-12n0.99≤i≤n−1, the range the proof covers and the use needs.
  3. Lemma A.3, second inequality. It is posed for 1≤J≤n1\le J\le n1≤J≤n, since σ0\sigma_0σ0​ is undefined. The eigenvalues are ordered ∣λ1∣≥⋯≥∣λn∣|\lambda_1|\ge\dots\ge|\lambda_n|∣λ1​∣≥⋯≥∣λn​∣, not ∣λ1∣≤⋯≤∣λn∣|\lambda_1|\le\dots\le|\lambda_n|∣λ1​∣≤⋯≤∣λn​∣ as printed: the printed order is a slip. With it, both inequalities are weaker than Weyl's and cannot support the use on p. 2057, which orders the eigenvalues decreasingly. The decreasing order implies the printed form.
  4. (8.2) and (8.1). (8.2) is stated for every deterministic εn>0\varepsilon_n>0εn​>0 with εn→0\varepsilon_n\to0εn​→0; the proof uses nothing else. (8.1) is stated as μ\muμ-integrability plus local integrability of z↦∫∣log⁡∣w−z∣∣ dμ(w)z\mapsto\int|\log|w-z||\,d\mu(w)z↦∫∣log∣w−z∣∣dμ(w).

A trivializing formalization is ruled out by construction. The goal mentions only AnA_nAn​ and μ\muμ. The proof's comparison ensemble Bn=n diag(λi)B_n=\sqrt n\,\mathrm{diag}(\lambda_i)Bn​=n​diag(λi​) is not a hypothesis. No statement takes a log-potential or a log-determinant as an input that could be fixed to make it hold.

The companion mission (Theorem 1.5, universality) poses Theorem 2.1 (the replacement principle), Lemma 1.7 (tightness) and Lemma 4.1 (least singular value), which the proof here also uses. They are not restated here. Once that mission is published they belong here as references. Contributions are welcome on the linear-algebra layer (Lemma A.3, multiplicative Weyl majorization), the Fubini argument of (8.1), and the singular-value tail bound (8.3). These are reusable well beyond this paper.

Selected references

  • T. Tao, V. Vu (appendix by M. Krishnapur), Random matrices: Universality of ESDs and the circular law, Ann. Probab. 38(5) (2010) 2023–2065. https://doi.org/10.1214/10-AOP534 (source of this mission; published version).
  • V. L. Girko, The circular law, Teor. Veroyatnost. i Primenen. 29 (1984) 669–679. https://doi.org/10.1137/1129095
  • Z. D. Bai, Circular law, Ann. Probab. 25(1) (1997) 494–529. https://doi.org/10.1214/aop/1024404298
  • F. Götze, A. Tikhomirov, The circular law for random matrices, Ann. Probab. 38(4) (2010) 1444–1491. https://doi.org/10.1214/09-AOP522
  • T. Tao, V. Vu, Random matrices: the circular law, Commun. Contemp. Math. 10(2) (2008) 261–307. https://doi.org/10.1142/S0219199708002788
  • H. Weyl, Inequalities between the two kinds of eigenvalues of a linear transformation, Proc. Natl. Acad. Sci. USA 35 (1949) 408–411. https://doi.org/10.1073/pnas.35.7.408
10 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

Mitigating Supply Risk: Dual Sourcing or Process Improvement? 2: With No Committed Cost, Expected Profit Is Concave in the Supplier's Reliability Index, with an Explicit First-Order ConditionResearch Paper

Motivation

Supply disruptions — fires, quality failures, capacity shortfalls at a supplier — are a first-order risk in manufacturing supply chains. A buying firm has two broad responses. It can dual source, splitting orders between suppliers so that one supplier's shortfall is partly covered by the other, or it can invest in process improvement at a single supplier (kaizen events, supplier development programmes) to make that supplier more reliable. Wang, Gilland and Tomlin, Mitigating Supply Risk: Dual Sourcing or Process Improvement? (M&SOM 12(3):489–510, 2010), build a two-stage newsvendor model that captures both levers and compare them analytically.

This mission formalizes the paper's analysis of the improvement lever on its own: the firm commits early to one supplier, decides how much effort to spend improving it, and then orders. The paper's Theorem 3 shows that, without committed costs, this improvement problem is a concave program with an explicit first-order condition, and its Corollary 2 derives how the optimal effort responds to costs, revenue and the chance that improvement succeeds. These are the facts the paper's later comparisons between improvement and dual sourcing rest on.

Setting

A firm sells one product over one season at unit revenue rrr, salvage value vvv and unit penalty ppp for unmet demand. Demand X≥0X \ge 0X≥0 has distribution function FFF and finite mean. The firm orders q≥0q \ge 0q≥0 units from a supplier with design capacity K>0K > 0K>0, unit cost ccc and committed cost η∈[0,1]\eta \in [0,1]η∈[0,1]: the firm pays (ηq+(1−η)y)c(\eta q + (1-\eta)y)c(ηq+(1−η)y)c when yyy units are delivered.

The supplier suffers a random capacity loss ξ≥0\xi \ge 0ξ≥0 and delivers y=min⁡{q,(K−ξ)+}y = \min\{q, (K-\xi)^+\}y=min{q,(K−ξ)+}. The law of ξ\xiξ has a continuous distribution function G(⋅,a)G(\cdot, a)G(⋅,a) that depends on the supplier's reliability index aaa; a larger index means a stochastically smaller loss, G(⋅,a)≤G(⋅,a′)G(\cdot, a) \le G(\cdot, a')G(⋅,a)≤G(⋅,a′) for a≤a′a \le a'a≤a′. Demand and losses are independent.

With ψ=−ηc/(r+p−v)\psi = -\eta c/(r+p-v)ψ=−ηc/(r+p−v) and φ=(r+p−(1−η)c)/(r+p−v)\varphi = (r+p-(1-\eta)c)/(r+p-v)φ=(r+p−(1−η)c)/(r+p−v), the second-stage expected profit at index aaa is

Π2(q;a)=(r+p−v)(ψq+φ E[y]−E[(y−X)+])−p E[X],\Pi_2(q; a) = (r+p-v)\big(\psi q + \varphi\,\mathsf E[y] - \mathsf E[(y-X)^+]\big) - p\,\mathsf E[X],Π2​(q;a)=(r+p−v)(ψq+φE[y]−E[(y−X)+])−pE[X],

and Π2∗(a)=sup⁡q≥0Π2(q;a)\Pi_2^*(a) = \sup_{q \ge 0}\Pi_2(q; a)Π2∗​(a)=supq≥0​Π2​(q;a) is its optimal value.

In the first stage the firm may improve the supplier from its initial index a0a^0a0. The paper reparametrizes effort by the target index: reaching index a≥a0a \ge a^0a≥a0 needs effort z(a)z(a)z(a), where zzz is convex and nondecreasing with z(a0)=0z(a^0) = 0z(a0)=0. Effort costs mmm per unit and succeeds with probability θ\thetaθ. The first-stage profit of early commitment is Eq. (7):

Π1(a)=−m z(a)+θ Π2∗(a)+(1−θ) Π2∗(a0),a≥a0.\Pi_1(a) = -m\,z(a) + \theta\,\Pi_2^*(a) + (1-\theta)\,\Pi_2^*(a^0), \qquad a \ge a^0 .Π1​(a)=−mz(a)+θΠ2∗​(a)+(1−θ)Π2∗​(a0),a≥a0.

Formalization targets

Goal: Theorem 3

Assume η=0\eta = 0η=0 and that a↦G(ξ,a)a \mapsto G(\xi, a)a↦G(ξ,a) is concave on [a0,∞)[a^0,\infty)[a0,∞) for every ξ\xiξ (decreasing marginal reliability improvement). Then Π1\Pi_1Π1​ is concave on [a0,∞)[a^0, \infty)[a0,∞), and an optimal index a∗>a0a^* > a^0a∗>a0, with an optimal order q∗q^*q∗ at a∗a^*a∗, satisfies

mθ z′(a∗)=(r+p−v)∫K−q∗K(φ−F(K−ξ)) ∂G(ξ,a∗)∂a dξ.(8)\frac{m}{\theta}\,z'(a^*) = (r+p-v)\int_{K-q^*}^{K}\big(\varphi - F(K-\xi)\big)\,\frac{\partial G(\xi, a^*)}{\partial a}\,d\xi. \tag{8}θm​z′(a∗)=(r+p−v)∫K−q∗K​(φ−F(K−ξ))∂a∂G(ξ,a∗)​dξ.(8)

Milestones

  1. Eq. (6), single-supplier instance with η=0\eta = 0η=0. For 0<φ<10 < \varphi < 10<φ<1 the critical fractile q^=inf⁡{t:F(t)≥φ}\hat q = \inf\{t : F(t) \ge \varphi\}q^​=inf{t:F(t)≥φ} maximizes Π2(⋅ ;a)\Pi_2(\cdot\,; a)Π2​(⋅;a) for every index aaa, and (with atomless demand) every positive optimal order satisfies the η=0\eta = 0η=0 instance of (6), G(K−q∗,a)(φ−F(q∗))=0G(K-q^*,a)(\varphi - F(q^*)) = 0G(K−q∗,a)(φ−F(q∗))=0.
  2. Lemma 2(b), single-supplier instance. Π2∗(a)\Pi_2^*(a)Π2∗​(a) is increasing in aaa.
  3. Corollary 2 (a), (b), (c), (e). The optimal reliability index, and so the optimal effort z∗=z(a∗)z^* = z(a^*)z∗=z(a∗), is decreasing in mmm, increasing in θ\thetaθ, decreasing in ccc and increasing in rrr, each in the strong set order on the set of maximizers.

Significance

Theorem 3 turns the firm's improvement decision into a one-dimensional concave program, so that the first-order condition (8) characterizes the optimum and comparative statics are available. Corollary 2 is the managerial content: cheaper or more reliable improvement, a cheaper supplier and a more valuable product all justify more improvement effort. The paper's later results — when late commitment beats early commitment (§4.2.2) and when single sourcing with improvement beats dual sourcing (§5) — compare the optimal values these results describe.

The results are proved in the paper's online appendix; none of them has a machine-checked proof. A complete development provides formal proofs of the layer-cake representation of the random-capacity newsvendor profit, of its critical-fractile solution, and of the concavity and envelope arguments on top of it.

Difficulty

Π2∗\Pi_2^*Π2∗​ is an optimal value, a supremum over order quantities, and suprema of concave functions are not concave in general. The obvious route — "Π2(q;a)\Pi_2(q; a)Π2​(q;a) is concave in aaa for each qqq, hence so is the supremum" — fails, because Π2(q;a)\Pi_2(q;a)Π2​(q;a) is not concave in aaa for a fixed qqq beyond the critical fractile. Any argument has to control how the optimal order moves with aaa under random capacity, where the delivered quantity is a minimum of the order and a random effective capacity. The first-order condition then requires differentiating an expectation of a non-smooth function of (ξ,X)(\xi, X)(ξ,X) in the parameter of ξ\xiξ's law. Corollary 2 must be argued on the set of maximizers, since Π1\Pi_1Π1​ is concave but not strictly concave.

Formalization scope

The Lean development lives in the namespace MitigateSupplyRisk.Improvement. Model bundles r,v,p,c,η,Kr, v, p, c, \eta, Kr,v,p,c,η,K, a demand law μ\muμ and the family ν(a)\nu(a)ν(a) of loss laws; FFF and G(⋅,a)G(\cdot,a)G(⋅,a) are their cdf. Expectations are Bochner integrals over ν(a)\nu(a)ν(a) and over the product ν(a)⊗μ\nu(a)\otimes\muν(a)⊗μ. Model.Assumptions collects the standing assumptions of §3: 0≤η≤10 \le \eta \le 10≤η≤1, K>0K > 0K>0, v<r+pv < r+pv<r+p (implicit in the paper's division by r+p−vr+p-vr+p−v), a nonnegative integrable demand, nonnegative atomless losses, and the stochastic order in aaa. Demand needs no density. Effort bundles θ,m,a0,z\theta, m, a^0, zθ,m,a0,z with θ∈[0,1]\theta \in [0,1]θ∈[0,1], m≥0m \ge 0m≥0 and zzz convex, nondecreasing on [a0,∞)[a^0,\infty)[a0,∞), z(a0)=0z(a^0) = 0z(a0)=0; taking zzz as primitive assumes every index a≥a0a \ge a^0a≥a0 is reachable. Π2∗\Pi_2^*Π2∗​ is a real supremum and Π1\Pi_1Π1​ is built from it, never from the critical fractile. Every statement about Π2∗\Pi_2^*Π2∗​ carries η=0\eta = 0η=0 or c≥0c \ge 0c≥0, which makes the supremum finite. "Optimal" always means a maximizer over the whole feasible set, and "increasing" is weak throughout, as on p. 492 of the paper.

The paper's proofs are in an online appendix that was not used here. Deviations from the page, each disclosed in the item's Formalization Note:

  • Eq. (8) omits the factor r+p−vr+p-vr+p−v on its right side; it is correct as printed only when r+p−v=1r+p-v = 1r+p−v=1, which holds in all of the paper's numerical examples. The goal states the corrected identity, multiplied by θ\thetaθ.
  • ∂2G/∂a2≤0\partial^2 G/\partial a^2 \le 0∂2G/∂a2≤0 is read as concavity of G(ξ,⋅)G(\xi,\cdot)G(ξ,⋅) on [a0,∞)[a^0,\infty)[a0,∞).
  • (8) is the first-order condition at an interior optimum a∗>a0a^* > a^0a∗>a0; differentiability of zzz and of G(ξ,⋅)G(\xi,\cdot)G(ξ,⋅) at a∗a^*a∗ is assumed explicitly.
  • Corollary 2 is stated in the strong set order on the argmax, (c) and (e) in the setting η=0\eta = 0η=0 of Theorem 3, and (b) with c≥0c \ge 0c≥0. Corollary 2(d), on the committed cost η\etaη, is not stated, because Theorem 3's setting fixes η=0\eta = 0η=0.
  • Lemma 2(b) and Eq. (6) are the single-supplier instances of the paper's dual-sourcing statements, which the paper applies to single sourcing on p. 496.

A trivializing formalization is ruled out: Π1\Pi_1Π1​ is built from the supremum Π2∗\Pi_2^*Π2∗​ (not from Π2\Pi_2Π2​ at a fixed order), the supremum is finite under the stated hypotheses, and every expectation is of an integrable function, so no statement holds through a junk value.

Reusable beyond this mission: the random-capacity newsvendor objects (delivered quantity, expected profit, layer-cake representation) and a Topkis-type monotone comparative statics lemma on a chain. Contributions of either, and proofs of the milestones in any order, are welcome.

Selected references

  • Y. Wang, W. Gilland, B. Tomlin, Mitigating Supply Risk: Dual Sourcing or Process Improvement?, Manufacturing & Service Operations Management 12(3):489–510, 2010. https://doi.org/10.1287/msom.1090.0279
  • D. M. Topkis, Supermodularity and Complementarity, Princeton University Press, 1998. https://doi.org/10.1515/9781400822539
  • R. B. Handfield, D. R. Krause, T. V. Scannell, R. M. Monczka, Avoid the Pitfalls in Supplier Development, Sloan Management Review 41(2):37–49, 2000.
9 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

Mitigating Supply Risk: Dual Sourcing or Process Improvement? 1: Region-by-Region Optimal Dual-Sourcing Quantities under Random Capacity, Including the Quantity HedgeResearch Paper

Motivation

Firms that buy from unreliable suppliers face two broad remedies: spread orders across several suppliers (dual sourcing), or invest in making a supplier more reliable (process improvement). Wang, Gilland and Tomlin, Mitigating Supply Risk: Dual Sourcing or Process Improvement? (M&SOM 12(3):489–510, 2010), compare the two in a single newsvendor model in which suppliers deliver less than ordered because of random capacity losses. This mission covers the first half of that comparison: the pure dual-sourcing strategy, in which the firm improves nobody and only chooses how much to order from each of two suppliers.

A single-supplier random-capacity model was studied by Ciarallo, Akella and Morton (Management Science 40(3), 1994); in that model, as the paper notes, the firm never orders more than demand to hedge against capacity shortfall. Dada, Petruzzi and Schwarz (M&SOM 9(1), 2007) studied several unreliable suppliers but gave only necessary conditions for optimal orders. The paper states necessary and sufficient conditions for two suppliers (its Theorem 1) and, for deterministic demand, a closed-form optimal order in each of six demand regions (Theorem 2). Its proofs are in an online appendix.

Setting

A product sells at unit revenue rrr, is salvaged at vvv, and unmet demand costs ppp per unit, with v<r+pv < r + pv<r+p. Two suppliers i=1,2i = 1, 2i=1,2 have unit cost ci≥0c_i \ge 0ci​≥0, committed-cost fraction ηi∈[0,1]\eta_i \in [0, 1]ηi​∈[0,1] and design capacity Ki>0K_i > 0Ki​>0. Supplier iii suffers a random capacity loss ξi≥0\xi_i \ge 0ξi​≥0 whose continuous distribution function Gi(t,ai)G_i(t, a_i)Gi​(t,ai​) depends on a reliability index aia_iai​: a larger index makes the loss stochastically smaller, Gi(⋅,a)≤Gi(⋅,a^)G_i(\cdot, a) \le G_i(\cdot, \hat a)Gi​(⋅,a)≤Gi​(⋅,a^) for a≤a^a \le \hat aa≤a^. The losses are independent of each other and of demand X≥0X \ge 0X≥0, which has distribution function FFF.

For an order vector q=(q1,q2)≥0q = (q_1, q_2) \ge 0q=(q1​,q2​)≥0, supplier iii delivers yi=min⁡{qi,(Ki−ξi)+}y_i = \min\{q_i, (K_i - \xi_i)^+\}yi​=min{qi​,(Ki​−ξi​)+} and is paid (ηiqi+(1−ηi)yi)ci(\eta_i q_i + (1 - \eta_i) y_i) c_i(ηi​qi​+(1−ηi​)yi​)ci​. The realized profit is

π(q)=−∑i(ηiqi+(1−ηi)yi)ci+rmin⁡{x,∑iyi}+v(∑iyi−x)+−p(x−∑iyi)+,\pi(q) = -\sum_i (\eta_i q_i + (1-\eta_i) y_i) c_i + r \min\Big\{x, \sum_i y_i\Big\} + v\Big(\sum_i y_i - x\Big)^+ - p\Big(x - \sum_i y_i\Big)^+,π(q)=−i∑​(ηi​qi​+(1−ηi​)yi​)ci​+rmin{x,i∑​yi​}+v(i∑​yi​−x)+−p(x−i∑​yi​)+,

and the second-stage expected profit is Π2(q;a)=Eξ(a),X[π(q)]\Pi_2(q; a) = \mathbb E_{\xi(a), X}[\pi(q)]Π2​(q;a)=Eξ(a),X​[π(q)]. With ψi=−ηici/(r+p−v)\psi_i = -\eta_i c_i/(r+p-v)ψi​=−ηi​ci​/(r+p−v) and ϕi=(r+p−(1−ηi)ci)/(r+p−v)\phi_i = (r + p - (1-\eta_i)c_i)/(r+p-v)ϕi​=(r+p−(1−ηi​)ci​)/(r+p−v) this is the paper's Eq. (3). The optimal value is Π2∗(a)=sup⁡q≥0Π2(q;a)\Pi_2^*(a) = \sup_{q \ge 0} \Pi_2(q; a)Π2∗​(a)=supq≥0​Π2​(q;a), and an optimal procurement vector is a q≥0q \ge 0q≥0 attaining it.

Formalization targets

Goal: Theorem 2 (corrected)

Let demand be deterministic, X=x≥0X = x \ge 0X=x≥0, let η=0\eta = 0η=0, let 0<ϕi<10 < \phi_i < 10<ϕi​<1, let each GiG_iGi​ be strictly increasing on a support [0,bi][0, b_i][0,bi​] with bi≤Kib_i \le K_ibi​≤Ki​, and let ϕ1G1(K1)≥ϕ2G2(K2)\phi_1 G_1(K_1) \ge \phi_2 G_2(K_2)ϕ1​G1​(K1​)≥ϕ2​G2​(K2​). With A1=G1−1(ϕ2)A_1 = G_1^{-1}(\phi_2)A1​=G1−1​(ϕ2​), A2=G2−1(ϕ1)A_2 = G_2^{-1}(\phi_1)A2​=G2−1​(ϕ1​), B=G1−1(ϕ2ϕ1G2(K2))B = G_1^{-1}(\tfrac{\phi_2}{\phi_1}G_2(K_2))B=G1−1​(ϕ1​ϕ2​​G2​(K2​)) and S=K1+K2S = K_1 + K_2S=K1​+K2​, an optimal vector is

q∗={(x,0)0≤x≤K1−B(Ω1)(x−q2∗,q2∗), ϕ1G1(K1−x+q2∗)=ϕ2G2(K2−q2∗)x≤S−(A1+A2)(Ω2)(x−K2+A2, x−K1+A1)x≤S−max⁡(A1,A2)(Ω3)(x−K2+A2,K2) if A1≥A2, else (K1,x−K1+A1)x≤S−min⁡(A1,A2)(Ω4)(K1,K2)otherwise(Ω5∪Ω6).q^* = \begin{cases} (x, 0) & 0 \le x \le K_1 - B \quad (\Omega_1)\\ (x - q_2^*, q_2^*),\ \phi_1 G_1(K_1 - x + q_2^*) = \phi_2 G_2(K_2 - q_2^*) & x \le S - (A_1 + A_2) \quad (\Omega_2)\\ (x - K_2 + A_2,\ x - K_1 + A_1) & x \le S - \max(A_1, A_2) \quad (\Omega_3)\\ (x - K_2 + A_2, K_2) \text{ if } A_1 \ge A_2, \text{ else } (K_1, x - K_1 + A_1) & x \le S - \min(A_1, A_2) \quad (\Omega_4)\\ (K_1, K_2) & \text{otherwise} \quad (\Omega_5 \cup \Omega_6).\end{cases}q∗=⎩⎨⎧​(x,0)(x−q2∗​,q2∗​), ϕ1​G1​(K1​−x+q2∗​)=ϕ2​G2​(K2​−q2∗​)(x−K2​+A2​, x−K1​+A1​)(x−K2​+A2​,K2​) if A1​≥A2​, else (K1​,x−K1​+A1​)(K1​,K2​)​0≤x≤K1​−B(Ω1​)x≤S−(A1​+A2​)(Ω2​)x≤S−max(A1​,A2​)(Ω3​)x≤S−min(A1​,A2​)(Ω4​)otherwise(Ω5​∪Ω6​).​

In Ω3\Omega_3Ω3​–Ω5\Omega_5Ω5​ the firm orders more in total than demand: the quantity hedge.

Milestones

  1. Lemma 1: Π2(q;a)\Pi_2(q; a)Π2​(q;a) is submodular in qqq, Π2(q∨q′)+Π2(q∧q′)≤Π2(q)+Π2(q′)\Pi_2(q \vee q') + \Pi_2(q \wedge q') \le \Pi_2(q) + \Pi_2(q')Π2​(q∨q′)+Π2​(q∧q′)≤Π2​(q)+Π2​(q′).
  2. Theorem 1: with a demand density, some optimal q∗q^*q∗ has, for each iii, qi∗∈{0,Ki}q_i^* \in \{0, K_i\}qi∗​∈{0,Ki​} or ∇qiΠ2(q∗;a)=0\nabla_{q_i}\Pi_2(q^*; a) = 0∇qi​​Π2​(q∗;a)=0.
  3. Eq. (6): for 0<qi<Ki0 < q_i < K_i0<qi​<Ki​, ∇qiΠ2=(r+p−v)(ψi+Gi(Ki−qi)(ϕi−E[F(qi+yj)]))\nabla_{q_i}\Pi_2 = (r+p-v)\big(\psi_i + G_i(K_i - q_i)(\phi_i - \mathbb E[F(q_i + y_j)])\big)∇qi​​Π2​=(r+p−v)(ψi​+Gi​(Ki​−qi​)(ϕi​−E[F(qi​+yj​)])), which vanishes at an optimal qqq.
  4. Lemma 2(b): Π2∗(a)\Pi_2^*(a)Π2∗​(a) is increasing in each aia_iai​.
  5. Corollary 1 (after the goal): as either index increases, the hedge region Ω3∪Ω4∪Ω5\Omega_3 \cup \Omega_4 \cup \Omega_5Ω3​∪Ω4​∪Ω5​ and the hedge size [q1∗+q2∗−x]+[q_1^* + q_2^* - x]^+[q1∗​+q2∗​−x]+ shrink; Ω1\Omega_1Ω1​ expands in a1a_1a1​ and contracts in a2a_2a2​.

Significance

Theorem 2 is the paper's explicit description of how a buyer splits orders between two unreliable suppliers: single sourcing when capacity is ample, dual sourcing at total order equal to demand, then deliberate over-ordering, and finally ordering full capacity. The quantity hedge is the paper's main qualitative finding for dual sourcing, since, as the paper notes, over-ordering of this kind does not occur with one random-capacity supplier. Corollary 1 says how this hedge responds to reliability, which is the comparison with process improvement that the rest of the paper builds on; Lemma 2(b) is the value of reliability used there.

None of these results has a machine-checked proof, and the paper's proofs are in an online appendix not used here. A formalization would also settle the printed statement, which contains a slip (below) that a formal proof must avoid.

Difficulty

Π2\Pi_2Π2​ is submodular but not jointly concave in qqq, so the usual route (concavity plus first-order conditions) is not available, and the paper invokes unimodality instead. Under deterministic demand Π2\Pi_2Π2​ is not differentiable on the line q1+q2=xq_1 + q_2 = xq1​+q2​=x, where the Ω1\Omega_1Ω1​ and Ω2\Omega_2Ω2​ optima sit, so Theorem 1 cannot simply be specialized to Theorem 2: optimality there needs one-sided arguments. In every region the claim is global optimality over all q≥0q \ge 0q≥0, including orders above the design capacities, and the feasible set is unbounded.

Formalization scope

Suppliers are indexed by Fin 2 (index 0 is supplier 1). The capacity losses are a family of probability measures νi(a)\nu_i(a)νi​(a) on R\mathbb RR without atoms and with νi(a)((−∞,0))=0\nu_i(a)((-\infty, 0)) = 0νi​(a)((−∞,0))=0, and Gi(t,a)G_i(t, a)Gi​(t,a) is their distribution function. Π2\Pi_2Π2​ is the Bochner integral of π\piπ against ν1(a1)⊗ν2(a2)⊗μ\nu_1(a_1) \otimes \nu_2(a_2) \otimes \muν1​(a1​)⊗ν2​(a2​)⊗μ for a demand law μ\muμ. Every theorem assumes μ\muμ is a probability measure on [0,∞)[0, \infty)[0,∞) with finite mean. Deterministic demand is μ=δx\mu = \delta_xμ=δx​. Theorem 1 and Eq. (6) add μ≪\mu \llμ≪ Lebesgue (the paper's density). "Optimal" means a global maximizer over q≥0q \ge 0q≥0, and "increasing" is weak, as the paper declares. Added standing hypotheses: Ki>0K_i > 0Ki​>0, v<r+pv < r + pv<r+p, and r,p,ci≥0r, p, c_i \ge 0r,p,ci​≥0, which bound π\piπ above so that Π2∗\Pi_2^*Π2∗​ is a genuine supremum. Gi−1G_i^{-1}Gi−1​ is the generalized inverse inf⁡{t≥0:Gi(t)≥u}\inf\{t \ge 0 : G_i(t) \ge u\}inf{t≥0:Gi​(t)≥u}.

Corrections to the printed Theorem 2, each disclosed in its item:

  • the min⁡\minmin and max⁡\maxmax in the bounds of Ω3\Omega_3Ω3​, Ω4\Omega_4Ω4​, Ω5\Omega_5Ω5​ are swapped back (as printed, Ω4\Omega_4Ω4​ is empty and the Ω3\Omega_3Ω3​ formula can exceed K1K_1K1​);
  • Gi(Ki)=1G_i(K_i) = 1Gi​(Ki​)=1 is added, through the support hypothesis (without it the Ω1\Omega_1Ω1​ claim is false);
  • 0<ϕi<10 < \phi_i < 10<ϕi​<1 and strict increase of GiG_iGi​ on its support are added.

Theorem 1's "qi∗=Kq_i^* = Kqi∗​=K" is read as KiK_iKi​. Lemma 2(a) is not formalized: optimal orders are not unique and no reading of "qi∗q_i^*qi∗​ is increasing" was found that is both faithful and safely true.

Stating Theorem 2 as "q∗q^*q∗ satisfies the first-order conditions", or optimality only within a region's face, would trivialize it; the statement requires Π2(q;a)≤Π2(q∗;a)\Pi_2(q; a) \le \Pi_2(q^*; a)Π2​(q;a)≤Π2​(q∗;a) for every q≥0q \ge 0q≥0. Proofs need integrals of piecewise-linear functions of independent variables, differentiation under the integral sign, and facts about generalized inverses of continuous distribution functions. Lemma 1 and the generalized-inverse facts are reusable beyond this mission; proofs of any milestone are welcome.

Selected references

  • Y. Wang, W. Gilland, B. Tomlin, Mitigating Supply Risk: Dual Sourcing or Process Improvement?, Manufacturing & Service Operations Management 12(3):489–510, 2010. https://doi.org/10.1287/msom.1090.0279
  • F. W. Ciarallo, R. Akella, T. E. Morton, A Periodic Review, Production Planning Model with Uncertain Capacity and Uncertain Demand — Optimality of Extended Myopic Policies, Management Science 40(3):320–332, 1994. https://doi.org/10.1287/mnsc.40.3.320
  • M. Dada, N. C. Petruzzi, L. B. Schwarz, A Newsvendor's Procurement Problem when Suppliers Are Unreliable, Manufacturing & Service Operations Management 9(1):9–32, 2007. https://doi.org/10.1287/msom.1060.0126
8 thms1 active userReviewed
Bandit AlgorithmsOperations Research·Captain: mikedeng1

Linearly Parameterized Bandits 3: For Any Compact Set of Arms, the Uncertainty Ellipsoid Policy Has Regret at Most a₄r‖z‖ + a₅r√T log^{3/2} TResearch Paper

Motivation

In a linearly parameterized bandit a decision maker repeatedly chooses an arm uuu from a set Ur⊂Rr\mathcal U_r \subset \mathbb R^rUr​⊂Rr and observes a noisy reward whose mean is linear in an unknown vector ZZZ. The model covers problems in which many arms share a few underlying features: products described by a handful of characteristics, prices, or routes whose costs depend on a few parameters. Because the arms are correlated through ZZZ, a good policy can learn about every arm from the rewards of any arm, and its regret can be made to depend on the dimension rrr instead of on the number of arms, which may be infinite.

Rusmevichientong and Tsitsiklis (arXiv:0812.3465v2, published in Mathematics of Operations Research, 2010) prove an Ω(rT)\Omega(r\sqrt T)Ω(rT​) lower bound on the regret when the arms form the unit sphere, give a matching phase-based policy for strongly convex arm sets, and propose the Uncertainty Ellipsoid (UE) policy for arbitrary compact arm sets. The UE policy is close to the algorithms of Auer (2002) and Dani, Hayes and Kakade (2008), with two differences: it does not need to know the horizon TTT, and it allows ZZZ and the noise to be unbounded. This mission formalizes its regret bound for general compact arm sets, Theorem 4.1 of the paper.

Setting

Fix r≥2r \ge 2r≥2 and a compact set of arms Ur⊂Rr\mathcal U_r \subset \mathbb R^rUr​⊂Rr, with the Euclidean norm ∥v∥=v′v\|v\| = \sqrt{v'v}∥v∥=v′v​. Playing arm uuu in period ttt yields

Xtu=u′Z+Wtu,X^u_t = u'Z + W^u_t,Xtu​=u′Z+Wtu​,

where the noises WtuW^u_tWtu​ are independent of each other and of ZZZ, identically distributed in ttt for each arm, and have mean zero. A policy chooses the arm Ut+1U_{t+1}Ut+1​ of period t+1t+1t+1 as a function of the history (U1,X1,…,Ut,Xt)(U_1, X_1, \dots, U_t, X_t)(U1​,X1​,…,Ut​,Xt​). The regret given Z=zZ = zZ=z and the Bayes risk are

Regret(z,T,ψ)=∑t=1TE[max⁡v∈Urv′z−Ut′z ∣ Z=z],Risk(T,ψ)=E[Regret(Z,T,ψ)].\mathrm{Regret}(z, T, \psi) = \sum_{t=1}^T \mathbb E\Big[\max_{v \in \mathcal U_r} v'z - U_t'z \,\Big|\, Z = z\Big], \qquad \mathrm{Risk}(T, \psi) = \mathbb E\big[\mathrm{Regret}(Z, T, \psi)\big].Regret(z,T,ψ)=t=1∑T​E[v∈Ur​max​v′z−Ut′​z​Z=z],Risk(T,ψ)=E[Regret(Z,T,ψ)].

Assumption 1 (p. 13) fixes constants σ0,uˉ,λ0>0\sigma_0, \bar u, \lambda_0 > 0σ0​,uˉ,λ0​>0 such that, for every r≥2r \ge 2r≥2: (a) E[exWtu]≤ex2σ02/2\mathbb E[e^{xW^u_t}] \le e^{x^2\sigma_0^2/2}E[exWtu​]≤ex2σ02​/2 for every arm and every x∈Rx \in \mathbb Rx∈R; (b) every arm has ∥u∥≤uˉ\|u\| \le \bar u∥u∥≤uˉ, and Ur\mathcal U_rUr​ contains linearly independent arms b1,…,brb_1, \dots, b_rb1​,…,br​ with λmin⁡(∑kbkbk′)≥λ0\lambda_{\min}(\sum_k b_kb_k') \ge \lambda_0λmin​(∑k​bk​bk′​)≥λ0​.

The UE policy keeps the ordinary least squares estimate Z^t=Ct∑s≤tUsXs\widehat Z_t = C_t\sum_{s \le t}U_sX_sZt​=Ct​∑s≤t​Us​Xs​, where Ct=(∑s≤tUsUs′)−1C_t = (\sum_{s \le t}U_sU_s')^{-1}Ct​=(∑s≤t​Us​Us′​)−1, and, with κ0=21+log⁡(1+36uˉ2/λ0)\kappa_0 = 2\sqrt{1 + \log(1 + 36\bar u^2/\lambda_0)}κ0​=21+log(1+36uˉ2/λ0​)​ and α=4σ0κ02\alpha = 4\sigma_0\kappa_0^2α=4σ0​κ02​, the uncertainty radius

Rtu=αlog⁡t min⁡{rlog⁡t,∣Ur∣}  ∥u∥Ct,∥u∥C=u′Cu.R^u_t = \alpha\sqrt{\log t}\,\sqrt{\min\{r\log t, |\mathcal U_r|\}}\;\|u\|_{C_t}, \qquad \|u\|_{C} = \sqrt{u'Cu}.Rtu​=αlogt​min{rlogt,∣Ur​∣}​∥u∥Ct​​,∥u∥C​=u′Cu​.

It plays b1,…,brb_1, \dots, b_rb1​,…,br​ in the first rrr periods and then, in each period t+1t+1t+1, an arm maximizing v′Z^t+Rtvv'\widehat Z_t + R^v_tv′Zt​+Rtv​ over Ur\mathcal U_rUr​, with ties broken arbitrarily.

Formalization targets

Goal: Theorem 4.1

There are constants a4,a5>0a_4, a_5 > 0a4​,a5​>0 depending only on σ0,uˉ,λ0\sigma_0, \bar u, \lambda_0σ0​,uˉ,λ0​ such that for every r≥2r \ge 2r≥2, every compact arm set satisfying Assumption 1, every run of the UE policy, all T≥r+1T \ge r+1T≥r+1 and all z∈Rrz \in \mathbb R^rz∈Rr,

Regret(z,T,UE)≤a4 r∥z∥+a5 rTlog⁡3/2T,Risk(T,UE)≤a4 r E∥Z∥+a5 rTlog⁡3/2T.\mathrm{Regret}(z, T, \mathrm{UE}) \le a_4\,r\|z\| + a_5\,r\sqrt T\log^{3/2}T, \qquad \mathrm{Risk}(T, \mathrm{UE}) \le a_4\,r\,\mathbb E\|Z\| + a_5\,r\sqrt T\log^{3/2}T.Regret(z,T,UE)≤a4​r∥z∥+a5​rT​log3/2T,Risk(T,UE)≤a4​rE∥Z∥+a5​rT​log3/2T.

The constants are not fixed: any positive values that work suffice.

Milestones

The proof in Appendix B proceeds through large deviation inequalities for adaptive least squares (Theorem B.1 for finitely many arms; Lemmas B.3, B.4, B.5 leading to Theorem B.2 for infinitely many), the radius bound Pr⁡{u′(Z^t−z)>Rtu∣Z=z}≤1/t2\Pr\{u'(\widehat Z_t - z) > R^u_t \mid Z = z\} \le 1/t^2Pr{u′(Zt​−z)>Rtu​∣Z=z}≤1/t2 (Lemma B.6), the instantaneous regret bound (Lemma B.7), the regret decomposition

Regret(z,T,UE)≤2uˉ(r+2)∥z∥+2αr(log⁡T)T  E[∑t=rT−1∥Ut+1∥Ct2  ∣  Z=z]\mathrm{Regret}(z, T, \mathrm{UE}) \le 2\bar u(r+2)\|z\| + 2\alpha\sqrt r(\log T)\sqrt T\;\mathbb E\Big[\sqrt{\textstyle\sum_{t=r}^{T-1}\|U_{t+1}\|^2_{C_t}} \;\Big|\; Z = z\Big]Regret(z,T,UE)≤2uˉ(r+2)∥z∥+2αr​(logT)T​E[∑t=rT−1​∥Ut+1​∥Ct​2​​​Z=z]

(Lemma B.8), and the deterministic Lemmas B.9–B.11, which bound ∑t=rT−1∥Ut+1∥Ct2\sum_{t=r}^{T-1}\|U_{t+1}\|^2_{C_t}∑t=rT−1​∥Ut+1​∥Ct​2​ by the value V∗(uˉ2/λ0,T−r)V^*(\bar u^2/\lambda_0, T-r)V∗(uˉ2/λ0​,T−r) of an optimization problem and that value by O(rlog⁡T)O(r\log T)O(rlogT).

Significance

Theorem 4.1 shows that one policy achieves regret within a factor log⁡3/2T\log^{3/2}Tlog3/2T of the Ω(rT)\Omega(r\sqrt T)Ω(rT​) lower bound for every compact arm set, finite or infinite, with sub-Gaussian unbounded noise and without knowledge of TTT. The dependence on the problem is only through rrr and the three constants of Assumption 1; the number of arms does not appear. The large deviation inequalities of Appendix B.1 are also the input of the paper's Theorem 4.2 for finitely many arms.

The result is proved on paper; no machine-checked proof of it is known. A formal development would produce reusable components that are currently absent from Mathlib: a Chernoff-type bound for least squares estimates built from adaptively chosen regressors, the self-normalized inequality of De la Peña, Klass and Lai in the form of Lemma B.3, the determinant recursion behind Lemma B.9, and the law of a bandit history driven by a policy and an arm-dependent noise kernel.

Difficulty

The arms UsU_sUs​ depend on past noise, so Z^t−z=CtMt\widehat Z_t - z = C_tM_tZt​−z=Ct​Mt​ with Mt=∑sUsWsM_t = \sum_s U_sW_sMt​=∑s​Us​Ws​ is not a sum of independent terms with fixed weights, and the classical Chernoff bound does not apply. For finitely many arms a union bound over the possible pull counts suffices (Theorem B.1), but its bound grows like t5∣Ur∣t^{5|\mathcal U_r|}t5∣Ur​∣ and is useless for infinite arm sets. Theorem B.2 instead needs a self-normalized martingale inequality and a covering argument over directions to compare MtMt′M_tM_t'Mt​Mt′​ with Ct−1C_t^{-1}Ct−1​ in the Loewner order. A second difficulty is that the sum ∑t∥Ut+1∥Ct\sum_t\|U_{t+1}\|_{C_t}∑t​∥Ut+1​∥Ct​​ of the radii played is not bounded term by term: each term can be as large as uˉ2/λ0\bar u^2/\lambda_0uˉ2/λ0​, and only the multiplicative recursion of Lemma B.9 shows that large terms are rare.

Formalization scope

Rr\mathbb R^rRr is EuclideanSpace ℝ (Fin r), so norms are Euclidean. The constants uˉ,λ0\bar u, \lambda_0uˉ,λ0​ are written ubar, lam0. Policies are deterministic, history-dependent and measurable (measurability is implicit in the paper). The noise is a Markov kernel ν\nuν giving the law of WtuW^u_tWtu​ for each arm; the history given Z=zZ = zZ=z is built period by period with fresh independent noise, which is the law of the paper's history. Assumption 1(a) is a bound on a lower Lebesgue integral, so it also asserts finiteness; λmin⁡(∑kbkbk′)≥λ0\lambda_{\min}(\sum_k b_kb_k') \ge \lambda_0λmin​(∑k​bk​bk′​)≥λ0​ is x′(∑kbkbk′)x≥λ0∥x∥2x'(\sum_k b_kb_k')x \ge \lambda_0\|x\|^2x′(∑k​bk​bk′​)x≥λ0​∥x∥2. The standing assumptions of Sec. 1.1 (compact Ur\mathcal U_rUr​, r≥2r \ge 2r≥2, independent mean-zero noise identically distributed in ttt) are hypotheses. min⁡{rlog⁡t,∣Ur∣}\min\{r\log t, |\mathcal U_r|\}min{rlogt,∣Ur​∣} equals rlog⁡tr\log trlogt for an infinite arm set. A UE run is any measurable policy that plays b1,…,brb_1, \dots, b_rb1​,…,br​ first and then a maximizer of v′Z^t+Rtvv'\widehat Z_t + R^v_tv′Zt​+Rtv​ after every history that starts with b1,…,brb_1, \dots, b_rb1​,…,br​; on those histories CtC_tCt​ is a genuine inverse.

Deviations from the page, all disclosed in the items: Lemma B.4 is printed for t≥1t \ge 1t≥1 but its proof needs t≥rt \ge rt≥r, and at t=1t = 1t=1 the printed claim fails; it is stated for t≥rt \ge rt≥r. Lemmas B.4 and B.5 are printed without "∣Z=z\mid Z = z∣Z=z" and are stated for each fixed zzz, the form in which the paper uses them. Lemmas B.9 and B.10 ("with probability one") are stated for every arm sequence that starts with b1,…,brb_1, \dots, b_rb1​,…,br​ and stays in the ball of radius uˉ\bar uuˉ, which is stronger. Theorem B.1 carries the hypothesis that Ur\mathcal U_rUr​ is finite.

The regret is Tmax⁡vv′zT\max_v v'zTmaxv​v′z minus the expected total reward, whose integrand is bounded, so it is never a junk value; the risk bound asserts integrability of the regret in zzz and assumes E∥Z∥<∞\mathbb E\|Z\| < \inftyE∥Z∥<∞. The constants a4,a5a_4, a_5a4​,a5​ are chosen before rrr, the arm set and the instance, so a formalization in which they depend on rrr or on Ur\mathcal U_rUr​ does not prove the goal.

Welcome contributions include proofs of any milestone, in particular the deterministic Lemmas B.9–B.11, and reusable lemmas on matrix determinants, self-normalized bounds and bandit history measures. The source is arXiv:0812.3465v2; its printed page numbers equal the PDF page numbers.

Selected references

  • P. Rusmevichientong and J. N. Tsitsiklis, Linearly Parameterized Bandits, Mathematics of Operations Research 35(2), 2010; preprint arXiv:0812.3465v2. https://arxiv.org/abs/0812.3465
  • V. H. de la Peña, M. J. Klass and T. L. Lai, Self-normalized processes: exponential inequalities, moment bounds and iterated logarithm laws, Annals of Probability 32(3A), 2004. https://doi.org/10.1214/009117904000000397
  • P. Auer, Using confidence bounds for exploitation-exploration trade-offs, Journal of Machine Learning Research 3, 2002. https://www.jmlr.org/papers/v3/auer02a.html
  • V. Dani, T. P. Hayes and S. M. Kakade, Stochastic linear optimization under bandit feedback, COLT 2008. https://www.learningtheory.org/colt2008/papers/80-Dani.pdf
  • T. L. Lai and H. Robbins, Asymptotically efficient adaptive allocation rules, Advances in Applied Mathematics 6, 1985. https://doi.org/10.1016/0196-8858(85)90002-8
15 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

Centralized and Competitive Inventory Models with Demand Substitution 2: At Least One Product Is Stocked No Less Under Competition Than Under Centralized ManagementResearch Paper

Motivation

A retailer that carries several substitutable products, such as brands of the same item, loses part of a customer's demand when the preferred product is out of stock, but not all of it: some customers buy another product instead. How much of each product to stock then depends on the stocking levels of the others. When all products are managed by one company, the stocking problem is a joint optimization; when each product is managed by a separate firm, it is a game, and each firm ignores the effect of its stock-outs on its competitors.

A common view in the inventory literature is that competition drives inventories up for every product. Mahajan and van Ryzin and Lippman and McCardle demonstrated it in special cases (Lippman & McCardle, Operations Research 1997; Mahajan & van Ryzin, Columbia working paper 1999, published in Operations Research 2001). Netessine and Rudi (SSRN 303779, 2002, later published in Operations Research, 2003) study the general model with nnn products, an arbitrary continuous joint demand distribution, and arbitrary substitution fractions. They show that the common view fails in general: some products may be stocked more under centralized management (Proposition 6(i)), but at least one product is always stocked no less under competition (Proposition 6(ii)). This mission formalizes Proposition 6(ii) and the centralized first-order analysis on which it rests.

Setting

There are n≥1n \ge 1n≥1 products, indexed i=1,…,ni = 1,\dots,ni=1,…,n, sold in a single period. Product iii is stocked at Qi≥0Q_i \ge 0Qi​≥0 units at unit cost cic_ici​, sold at unit price rir_iri​, and salvaged at unit value sis_isi​, with ri>ci>si>0r_i > c_i > s_i > 0ri​>ci​>si​>0. Write ui=ri−ciu_i = r_i - c_iui​=ri​−ci​ (the underage cost) and oi=ci−sio_i = c_i - s_ioi​=ci​−si​ (the overage cost).

The first-choice demand vector D=(D1,…,Dn)D = (D_1,\dots,D_n)D=(D1​,…,Dn​) is random, with a known continuous joint law on the positive orthant. A fraction aij∈[0,1]a_{ij} \in [0,1]aij​∈[0,1] of the unmet demand for product iii switches to product jjj, with aii=0a_{ii} = 0aii​=0 and ∑jaij<1\sum_j a_{ij} < 1∑j​aij​<1; a customer whose second choice is also out of stock is lost. The effective demand for product iii is

Dis=Di+∑j≠iaji (Dj−Qj)+,x+=max⁡(0,x).D^s_i = D_i + \sum_{j \ne i} a_{ji}\,(D_j - Q_j)^+, \qquad x^+ = \max(0,x).Dis​=Di​+j=i∑​aji​(Dj​−Qj​)+,x+=max(0,x).

Under centralized management a single company maximizes the expected profit

π(Q)=E∑i[rimin⁡(Dis,Qi)−ciQi+si(Qi−Dis)+]\pi(Q) = \mathbb E \sum_i \Big[r_i \min(D^s_i, Q_i) - c_i Q_i + s_i (Q_i - D^s_i)^+\Big]π(Q)=Ei∑​[ri​min(Dis​,Qi​)−ci​Qi​+si​(Qi​−Dis​)+]

over all Q≥0Q \ge 0Q≥0; a maximizer is written QcQ^cQc. Under competition firm iii chooses Qi≥0Q_i \ge 0Qi​≥0 to maximize

πi(Q)=E[uiDis−ui(Dis−Qi)+−oi(Qi−Dis)+],\pi_i(Q) = \mathbb E\big[u_i D^s_i - u_i (D^s_i - Q_i)^+ - o_i (Q_i - D^s_i)^+\big],πi​(Q)=E[ui​Dis​−ui​(Dis​−Qi​)+−oi​(Qi​−Dis​)+],

given the other firms' quantities; a Nash equilibrium Qd≥0Q^d \ge 0Qd≥0 is a vector at which no firm gains by changing its own quantity. In the Lean development these objects are Model, Ds, centralProfit, IsCentralOptimal, firmProfit, IsBestResponse and IsNash in the namespace DemandSubstitution.Comparison.

Formalization targets

Goal: Proposition 6(ii)

For every optimal centralized stocking vector QcQ^cQc and every Nash equilibrium QdQ^dQd,

∃ i:Qic≤Qid.\exists\, i:\quad Q^c_i \le Q^d_i .∃i:Qic​≤Qid​.

The statement quantifies over all optima and all equilibria; it asserts neither existence nor uniqueness of either.

Milestones

  1. The underage/overage form (1): π=E∑i[uiDis−ui(Dis−Qi)+−oi(Qi−Dis)+]\pi = \mathbb E\sum_i [u_i D^s_i - u_i (D^s_i - Q_i)^+ - o_i (Q_i - D^s_i)^+]π=E∑i​[ui​Dis​−ui​(Dis​−Qi​)+−oi​(Qi​−Dis​)+].
  2. The derivative of one substitution term: for j≠ij \ne ij=i, ∂ E(Djs−Qj)+/∂Qi=−aijPr⁡(Djs>Qj,Di>Qi)\partial\,\mathbb E(D^s_j - Q_j)^+/\partial Q_i = -a_{ij}\Pr(D^s_j > Q_j, D_i > Q_i)∂E(Djs​−Qj​)+/∂Qi​=−aij​Pr(Djs​>Qj​,Di​>Qi​).
  3. The partial derivative (8) of π\piπ with respect to QiQ_iQi​.
  4. Proposition 1, the centralized optimality condition (7):
Pr⁡(Di<Qic)−Pr⁡(Di<Qic<Dis)+∑j≠iuj+ojui+oi aijPr⁡(Djs<Qjc,Di>Qic)=uiui+oi.\Pr(D_i < Q^c_i) - \Pr(D_i < Q^c_i < D^s_i) + \sum_{j\ne i}\frac{u_j+o_j}{u_i+o_i}\,a_{ij}\Pr(D^s_j < Q^c_j, D_i > Q^c_i) = \frac{u_i}{u_i+o_i}.Pr(Di​<Qic​)−Pr(Di​<Qic​<Dis​)+j=i∑​ui​+oi​uj​+oj​​aij​Pr(Djs​<Qjc​,Di​>Qic​)=ui​+oi​ui​​.
  1. The comparison Pr⁡(Disc<Qic)≤Pr⁡(Disd<Qid)\Pr(D^{sc}_i < Q^c_i) \le \Pr(D^{sd}_i < Q^d_i)Pr(Disc​<Qic​)≤Pr(Disd​<Qid​), where DscD^{sc}Dsc and DsdD^{sd}Dsd are the effective demands at QcQ^cQc and QdQ^dQd.

Significance

Proposition 6(ii) bounds how far competition can depart from the centralized solution in the downward direction: it can never make every product understocked. Together with Proposition 6(i), it shows that neither "competition overstocks everything" nor its opposite holds in general, and it is the step from which the symmetric case, Proposition 6(iii) (every product is stocked at least as much under competition), follows. The centralized condition (7) and the derivative (8) are of independent use: they give the first-order conditions of the multi-product newsvendor with stock-out substitution for an arbitrary number of products and an arbitrary continuous demand law, obtained without Leibniz-rule integration over polyhedral regions.

The results are proved in the paper; none of them has a machine-checked proof. A formal proof requires differentiating an expectation of piecewise-linear functions of the demand under the integral sign, and handling the measure-zero boundaries where those functions have kinks. That machinery is reusable for other multi-product newsvendor models.

Difficulty

The centralized profit is not concave in general for three or more products (the paper's own example, pp. 3–5), so the optimum cannot be characterized as the unique solution of first-order conditions: the argument must work with an arbitrary maximizer and use only the necessary condition at an interior coordinate. The derivative (8) must be justified as a two-sided derivative of an integral whose integrand is not differentiable on hyperplanes in demand space; the paper's difference quotient argument leaves the boundary terms implicit. Finally, the obvious comparison of the two first-order conditions yields only an inequality between probabilities; turning it into an inequality between stocking levels requires the distribution function of DisD^s_iDis​ to be strictly increasing, and an optimal QicQ^c_iQic​ may be zero, where (7) does not hold.

Formalization scope

Products are Fin n (0-based). The model data and the standing assumptions ri>ci>si>0r_i > c_i > s_i > 0ri​>ci​>si​>0, aij∈[0,1]a_{ij} \in [0,1]aij​∈[0,1], aii=0a_{ii} = 0aii​=0, ∑jaij<1\sum_j a_{ij} < 1∑j​aij​<1 are fields of a structure Model n. The demand law is a probability measure μ\muμ on Rn\mathbb R^nRn that is absolutely continuous with respect to Lebesgue measure, is concentrated on the open positive orthant, and has integrable coordinates (IsDemandLaw). Expectations are Bochner integrals and probabilities are μ.real of sets with the strict and weak inequalities exactly as printed. Derivatives are two-sided HasDerivAt in one coordinate, the others held fixed through Function.update.

Three hypotheses are pinned relative to the page and disclosed in the statements:

  • NeZero n in the goal: for n=0n = 0n=0 "at least one iii" is false.
  • HasPositiveDensity μ in the goal: a Lebesgue density strictly positive on the open positive orthant. The paper's last step uses strict monotonicity of the distribution function of DisD^s_iDis​ without stating it.
  • Qic>0Q^c_i > 0Qic​>0 in Proposition 1 and in the probability comparison: (7) is an equality only at an interior coordinate. The goal carries no such hypothesis.

The centralized optimum is a maximizer of π\piπ over nonnegative vectors and the Nash equilibrium is the no-profitable-deviation property over nonnegative quantities. Defining either by its first-order condition ((7) or (10)) would turn the propositions into definitions and is ruled out. Stating the goal for one chosen optimum or equilibrium is ruled out as well: it holds for every pair.

Contributions welcome: differentiation of expectations of piecewise-linear functions under absolutely continuous laws; null-set lemmas for {Djs=Qj}\{D^s_j = Q_j\}{Djs​=Qj​}; Fermat's rule at a coordinate-wise interior maximizer; the Nash condition (10) of the competitive game, which milestone 5 needs and which is also posed in the companion mission on equilibrium existence.

Selected references

  • S. Netessine and N. Rudi, Centralized and Competitive Inventory Models with Demand Substitution, Simon School Working Paper OP 02-01, University of Rochester, April 2002, SSRN 303779. https://doi.org/10.2139/ssrn.303779 (journal version: Operations Research 51(2), 2003; this mission cites the working paper's numbering)
  • S. A. Lippman and K. F. McCardle, The competitive newsboy, Operations Research 45(1), 54–65, 1997.
  • S. Mahajan and G. van Ryzin, Inventory competition under dynamic consumer choice, Columbia University working paper, 1999 (cited by Netessine & Rudi as [8]); published in Operations Research, 2001.
8 thms1 active userReviewed
CombinatoricsGraph Theory·Captain: mikedeng1

The Diameter of a Scale-Free Random Graph: For m ≥ 2, Almost Every G_mⁿ Is Connected with Diameter Between (1−ε) log n/log log n and (1+ε) log n/log log nResearch Paper

Motivation

Barabási and Albert (Science 1999) proposed preferential attachment as a mechanism behind the heavy-tailed degree distributions observed in the web graph and other networks: vertices arrive one at a time and attach to existing vertices with probability proportional to their degree. Empirical work on such networks reported that typical distances are very small compared with their size. The original description left the model underdetermined (the joint law of the mmm edges of a new vertex was not specified), so its distances could not be analysed as stated.

Bollobás and Riordan (Combinatorica 2004) fixed a precise version of the model, the LCD model, and determined its diameter: for m≥2m\ge2m≥2 edges per vertex it is asymptotically log⁡n/log⁡log⁡n\log n/\log\log nlogn/loglogn. For m=1m=1m=1 the graph is a forest (with loops), and a result of Pittel states essentially that its diameter is of order log⁡n\log nlogn. Together with the degree-sequence analysis of Bollobás, Riordan, Spencer and Tusnády (Random Struct. Alg. 2001), the paper is one of the first rigorous results on a scale-free random graph model.

Setting

The process G1NG_1^NG1N​. Vertices are 1,…,N1,\dots,N1,…,N. Vertex ttt sends a single edge to a vertex gt∈{1,…,t}g_t\in\{1,\dots,t\}gt​∈{1,…,t}, chosen given the past with

P(gt=i)=dG1t−1(i)2t−1 (i<t),P(gt=t)=12t−1,\mathbb P(g_t=i)=\frac{d_{G_1^{t-1}}(i)}{2t-1}\ (i<t),\qquad \mathbb P(g_t=t)=\frac1{2t-1},P(gt​=i)=2t−1dG1t−1​​(i)​ (i<t),P(gt​=t)=2t−11​,

where dG1t−1(i)d_{G_1^{t-1}}(i)dG1t−1​​(i) is the degree of iii in the graph built so far (a loop counts twice). Loops (gt=tg_t=tgt​=t) are allowed.

The graph GmnG_m^nGmn​. Run G1mnG_1^{mn}G1mn​ and identify the vertices (k−1)m+1,…,km(k-1)m+1,\dots,km(k−1)m+1,…,km into a single vertex kkk, for k=1,…,nk=1,\dots,nk=1,…,n. The resulting random graph on [n][n][n] is Gmn∈GmnG_m^n\in\mathcal G_m^nGmn​∈Gmn​. The paper's graph has loops and multiple edges; its diameter is the largest graph distance between two vertices of the underlying simple graph.

Almost every. For fixed mmm, a.e. GmnG_m^nGmn​ has a property if its probability tends to 111 as n→∞n\to\inftyn→∞. All logarithms are natural.

The endpoint model (for the upper bound). Let r1,…,rmnr_1,\dots,r_{mn}r1​,…,rmn​ be independent with density 2x2x2x on (0,1)(0,1)(0,1) (M2(0,1)M_2(0,1)M2​(0,1)), R1≤⋯≤RmnR_1\le\dots\le R_{mn}R1​≤⋯≤Rmn​ their sorted values, Wi=RmiW_i=R_{mi}Wi​=Rmi​, W0=0W_0=0W0​=0, wi=Wi−Wi−1w_i=W_i-W_{i-1}wi​=Wi​−Wi−1​. Given 0<W1<⋯<Wn<10<W_1<\dots<W_n<10<W1​<⋯<Wn​<1, the random graph G(W1,…,Wn)G(W_1,\dots,W_n)G(W1​,…,Wn​) joins each vertex iii to li,1l_{i,1}li,1​ and li,2l_{i,2}li,2​, independent with PL(li,j=k)=wk/Wi\mathbb P_L(l_{i,j}=k)=w_k/W_iPL​(li,j​=k)=wk​/Wi​ for k≤ik\le ik≤i. The events E1,…,E5E_1,\dots,E_5E1​,…,E5​ (Lemma 7) say that the WiW_iWi​ follow the profile i/n\sqrt{i/n}i/n​ and that the spacings wiw_iwi​ are neither too small nor too large in specified ranges.

Formalization targets

Goal: Theorem 1

For fixed m≥2m\ge2m≥2 and ε>0\varepsilon>0ε>0, a.e. GmnG_m^nGmn​ is connected and

(1−ε)log⁡nlog⁡log⁡n≤diam⁡(Gmn)≤(1+ε)log⁡nlog⁡log⁡n.(1-\varepsilon)\frac{\log n}{\log\log n}\le\operatorname{diam}(G_m^n)\le(1+\varepsilon)\frac{\log n}{\log\log n}.(1−ε)loglognlogn​≤diam(Gmn​)≤(1+ε)loglognlogn​.

Lower bound (§4)

  • Lemma 2: P(gj=i)=O((ij)−1/2)\mathbb P(g_j=i)=O((ij)^{-1/2})P(gj​=i)=O((ij)−1/2) and P(gj=i,gk=i)=O(i−1(jk)−1/2)\mathbb P(g_j=i,g_k=i)=O(i^{-1}(jk)^{-1/2})P(gj​=i,gk​=i)=O(i−1(jk)−1/2) with absolute constants.
  • Lemma 3: events ⋂{gjs=is}\bigcap\{g_{j_s}=i_s\}⋂{gjs​​=is​} with disjoint sets of targets are negatively correlated.
  • Lemma 4: P(S⊂G1N)≤Ce(S)∏ij∈E(S)1/ij\mathbb P(S\subset G_1^N)\le C^{e(S)}\prod_{ij\in E(S)}1/\sqrt{ij}P(S⊂G1N​)≤Ce(S)∏ij∈E(S)​1/ij​ for graphs SSS with at most one earlier and two later neighbours per vertex.
  • Theorem 5: for every m≥1m\ge1m≥1, a.e. GmnG_m^nGmn​ has diam⁡(Gmn)>log⁡n/log⁡(3Cm2log⁡n)\operatorname{diam}(G_m^n)>\log n/\log(3Cm^2\log n)diam(Gmn​)>logn/log(3Cm2logn), CCC the constant of Lemma 4.

Upper bound (§§5–8)

  • Lemma 6: Chernoff–Janson tails for sums of independent Bernoulli variables.
  • Lemma 7: P(Er)→1\mathbb P(E_r)\to1P(Er​)→1 for r=1,…,5r=1,\dots,5r=1,…,5.
  • The coupling of §6: G(W)G(W)G(W) with Wi=RmiW_i=R_{mi}Wi​=Rmi​ is stochastically dominated by GmnG_m^nGmn​ in the subgraph order, i.e. P(G(W)∈P)≤P(Gmn∈P)\mathbb P(G(W)\in\mathcal P)\le\mathbb P(G_m^n\in\mathcal P)P(G(W)∈P)≤P(Gmn​∈P) for every property P\mathcal PP preserved under adding edges.
  • Lemma 10 and Lemma 8: under E1,…,E5E_1,\dots,E_5E1​,…,E5​, every vertex reaches a useful vertex (i≤n/(log⁡n)5i\le n/(\log n)^5i≤n/(logn)5, wi≥(log⁡n)2/nw_i\ge(\log n)^2/nwi​≥(logn)2/n) by a descending path of length at most 8log⁡log⁡n8\log\log n8loglogn, with probability 1−o(1)1-o(1)1−o(1).
  • Lemma 12 (a deterministic growth estimate) and Lemma 11: a useful vertex is joined to vertex 111 by a path of length at most (1/2+ε)log⁡n/log⁡log⁡n(1/2+\varepsilon)\log n/\log\log n(1/2+ε)logn/loglogn with probability 1−o(n−1)1-o(n^{-1})1−o(n−1).
  • The display of p. 29: under E1,…,E5E_1,\dots,E_5E1​,…,E5​, PL(diam⁡G(W)>(1+ε/2)log⁡n/log⁡log⁡n+16log⁡log⁡n)=o(1)\mathbb P_L\big(\operatorname{diam}G(W)>(1+\varepsilon/2)\log n/\log\log n+16\log\log n\big)=o(1)PL​(diamG(W)>(1+ε/2)logn/loglogn+16loglogn)=o(1).

Significance

The theorem shows that the diameter of this scale-free graph is smaller by a factor log⁡log⁡n\log\log nloglogn than that of a classical random graph with the same constant average degree, and identifies m=1m=1m=1 versus m≥2m\ge2m≥2 as the dividing line. It made the "small world" claims about the Barabási–Albert model precise for one exact version of it, and the LCD representation and the endpoint model introduced here were used in later work on preferential attachment.

The result is proved in the paper; nothing here is open. The work of the mission is formalizing the known proof. As far as is known, no machine-checked development of preferential-attachment graphs exists in Mathlib or elsewhere. A complete development would supply a reusable probability space for the attachment process, a Chernoff–Janson inequality for heterogeneous Bernoulli sums, a negative-correlation lemma for the process, and order-statistic estimates for i.i.d. samples, each of independent use.

Difficulty

The lower bound is a first-moment count of short paths, but the edges of G1NG_1^NG1N​ are not independent: an earlier edge into a vertex raises the chance of later ones. Lemmas 2–4 show that small subgraphs still appear with probability comparable to an independent model with edge probabilities C/ijC/\sqrt{ij}C/ij​; Lemma 3 requires a description of the process in which the needed independence is visible.

The upper bound is the hard half. A naive breadth-first expansion from a vertex fails: the weight of the next neighbourhood has the right mean but a very skewed distribution, and vertices near the end of the ordering have few early neighbours. The paper replaces the process by a conditionally independent model given the sorted endpoints WiW_iWi​, controls the WiW_iWi​ globally (Lemma 7), handles late vertices separately (Lemmas 8–10), and runs a weighted expansion with a growing blow-up factor (Lemmas 11–12). Each step needs uniformity in WWW: every o(⋅)o(\cdot)o(⋅) must depend on nnn only.

Formalization scope

Vertices are stored as Fin N (0-based) and statements read 1-based labels through the accessors tgt and lab. A sequence (gt)(g_t)(gt​) is a dependent function (t : Fin N) → Fin (t+1), its probability is the product of the exact conditional factors (1+#{s<t:gs=gt})/(2t−1)(1+\#\{s<t: g_s=g_t\})/(2t-1)(1+#{s<t:gs​=gt​})/(2t−1), and probabilities are finite weighted sums. G1NG_1^NG1N​, GmnG_m^nGmn​ and G(W)G(W)G(W) are Mathlib simple graphs: loops and multiple edges are dropped, which does not change connectivity or distances. The model is the paper's: not uniform attachment, not mmm independent choices per vertex, and with the self-loop term.

diam⁡\operatorname{diam}diam in the goal is SimpleGraph.diam, which is 000 on a disconnected graph; the goal therefore keeps connectivity explicit, as the page does. Every other diameter bound uses "every two vertices are joined by a walk of length ≤x\le x≤x", and lower bounds use its negation, so a disconnected graph never satisfies an upper bound by default. Hidden constants follow the paper's quantifier order: the constants of Lemmas 2 and 4 come before every index; each o(⋅)o(\cdot)o(⋅) of §§7–8 is a function δ(n)→0\delta(n)\to0δ(n)→0 chosen before WWW (a bound chosen after WWW would make these statements nearly empty); "for nnn sufficiently large" is ∃N0\exists N_0∃N0​ before WWW or fff. Theorem 5 assumes the bound of Lemma 4 for its constant CCC. Every statement about G(W)G(W)G(W) assumes 0=W0<W1<⋯<Wn<10=W_0<W_1<\dots<W_n<10=W0​<W1​<⋯<Wn​<1. Lemma 7 is stated as "the probability of the complement tends to 000" under the product law of M2(0,1)M_2(0,1)M2​(0,1); the coupling is stated as the equivalent stochastic-domination inequality for every property preserved under adding edges.

Not formalized: Lemma 9 (a conditional bound given the history of a breadth-first exploration), the LCD representation of G1nG_1^nG1n​ (§2), and Theorem 13 (m=1m=1m=1), which the paper states without proof.

Contributions welcome: proofs of any milestone, the identity P(gj=i)=μj−1,i/(2j−1)\mathbb P(g_j=i)=\mu_{j-1,i}/(2j-1)P(gj​=i)=μj−1,i​/(2j−1) with μt,i=∏s=it(1+1/(2s−1))\mu_{t,i}=\prod_{s=i}^t(1+1/(2s-1))μt,i​=∏s=it​(1+1/(2s−1)), the LCD representation, and general lemmas about the attachment process and Bernoulli tails.

Selected references

  • B. Bollobás and O. Riordan, The diameter of a scale-free random graph, Combinatorica 24(1):5–34, 2004. https://doi.org/10.1007/s00493-004-0002-2
  • A.-L. Barabási and R. Albert, Emergence of scaling in random networks, Science 286:509–512, 1999. https://doi.org/10.1126/science.286.5439.509
  • B. Bollobás, O. Riordan, J. Spencer and G. Tusnády, The degree sequence of a scale-free random graph process, Random Structures & Algorithms 18(3):279–290, 2001. https://doi.org/10.1002/rsa.1009
  • S. Janson, T. Łuczak and A. Ruciński, Random Graphs, Wiley, 2000. https://doi.org/10.1002/9781118032718
15 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

Supply Chain Coordination Under Channel Rebates with Sales Effort Effects III: Returns Alone, Linear Rebates Alone or Target Rebates Alone Cannot Coordinate Effort and QuantityResearch Paper

Motivation

Manufacturers of computer hardware, software and automobiles routinely pay channel rebates to their retailers: a payment for each unit the retailer sells to end customers, either for every unit (a linear rebate) or only for units beyond a target (a target rebate). In the same industries manufacturers also accept returns, crediting the retailer for unsold stock. Both instruments are meant to make the retailer act in the interest of the whole supply chain. When the retailer's sales effort drives demand and cannot be written into a contract, the question is which of these instruments, alone or combined, can make the retailer choose the effort and the stock that maximize total chain profit.

T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8) (2002) (DOI 10.1287/mnsc.48.8.992.168), answers this in a newsvendor model with multiplicative effort. Its Theorem 2 shows that a target rebate combined with returns can coordinate. This mission formalizes the complementary negative result, the paper's Proposition 2: no single instrument suffices. It is related to the impossibility shown by Cachon and Lariviere for revenue sharing with retailer effort (Management Science 51(1), 2005), but concerns different instruments.

Setting

A retailer orders a quantity Q≥0Q \ge 0Q≥0 and exerts a sales effort e≥0e \ge 0e≥0 before demand is observed. Demand is eξe\xieξ, where ξ\xiξ is a random variable with a density φ\varphiφ on R\mathbb RR that vanishes on (−∞,0)(-\infty, 0)(−∞,0) and is strictly positive on [0,∞)[0, \infty)[0,∞) (Assumption A4), with finite mean. Write

Φ(Q)=∫0Qφ(ξ) dξ,Γ(Q)=∫0Qξ dΦ(ξ).\Phi(Q) = \int_0^Q \varphi(\xi)\,d\xi, \qquad \Gamma(Q) = \int_0^Q \xi\,d\Phi(\xi).Φ(Q)=∫0Q​φ(ξ)dξ,Γ(Q)=∫0Q​ξdΦ(ξ).

Effort costs V(e)V(e)V(e), where V(0)=0V(0) = 0V(0)=0 and VVV is strictly increasing and strictly convex on [0,∞)[0, \infty)[0,∞) (Assumption A5; the paper declares all such properties strict). The retail price ppp, the manufacturer's unit cost ccc, the wholesale price www and the salvage value sss satisfy 0<c<w<p0 < c < w < p0<c<w<p and s<cs < cs<c (Assumption A1); sss may be negative.

The integrated channel earns

Π(Q,e)=−cQ+pEmin⁡(Q,eξ)+sE(Q−eξ)+−V(e),\Pi(Q, e) = -cQ + pE\min(Q, e\xi) + sE(Q - e\xi)^+ - V(e),Π(Q,e)=−cQ+pEmin(Q,eξ)+sE(Q−eξ)+−V(e),

and (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ) denotes a maximizer of Π\PiΠ over Q≥0Q \ge 0Q≥0, e≥0e \ge 0e≥0. Under a contract with wholesale price www, rebate uuu per unit sold beyond the target TTT, and return credit bbb per unsold unit, the retailer earns

R(Q,e∣T)=−wQ+pEmin⁡(Q,eξ)+uE(min⁡(Q,eξ)−T)++bE(Q−eξ)+−V(e).R(Q, e \mid T) = -wQ + pE\min(Q, e\xi) + uE(\min(Q, e\xi) - T)^+ + bE(Q - e\xi)^+ - V(e).R(Q,e∣T)=−wQ+pEmin(Q,eξ)+uE(min(Q,eξ)−T)++bE(Q−eξ)+−V(e).

Returns alone is u=0u = 0u=0 with b∈[s,w)b \in [s, w)b∈[s,w); a target rebate alone is u>0u > 0u>0, T≥0T \ge 0T≥0 with no returns, b=sb = sb=s (the retailer salvages leftovers herself); a linear rebate alone is the case T=0T = 0T=0 of the latter. Channel coordination means that the retailer's optimal decisions under the contract are the integrated channel's (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ).

Formalization targets

Goal: Proposition 2 (p. 1003)

For every b∈[s,w)b \in [s, w)b∈[s,w), every u>0u > 0u>0 and every T≥0T \ge 0T≥0,

(Qˉ,eˉ)∉arg⁡max⁡Q,e≥0R(⋅,⋅∣T)  under (u,b,T)=(0,b,0), (u,s,0), (u,s,T).(\bar Q, \bar e) \notin \arg\max_{Q, e \ge 0} R(\cdot, \cdot \mid T)\ \text{ under } (u, b, T) = (0, b, 0),\ (u, s, 0),\ (u, s, T).(Qˉ​,eˉ)∈/argQ,e≥0max​R(⋅,⋅∣T)  under (u,b,T)=(0,b,0), (u,s,0), (u,s,T).

The three clauses are returns alone, a linear rebate alone, and a target rebate alone. The statement asserts that (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ) is not among the retailer's maximizers at all, which is stronger than saying that the retailer's optimum is not exactly {(Qˉ,eˉ)}\{(\bar Q, \bar e)\}{(Qˉ​,eˉ)}.

Milestones

  1. §4.1, p. 999. An integrated optimum with eˉ>0\bar e > 0eˉ>0 satisfies Qˉ=eˉ Qˉ0\bar Q = \bar e\,\bar Q_0Qˉ​=eˉQˉ​0​ with Φ(Qˉ0)=(p−c)/(p−s)\Phi(\bar Q_0) = (p - c)/(p - s)Φ(Qˉ​0​)=(p−c)/(p−s), V′(eˉ)=(p−s)Γ(Qˉ0)V'(\bar e) = (p - s)\Gamma(\bar Q_0)V′(eˉ)=(p−s)Γ(Qˉ​0​), and Π(Qˉ,eˉ)=eˉV′(eˉ)−V(eˉ)\Pi(\bar Q, \bar e) = \bar e V'(\bar e) - V(\bar e)Π(Qˉ​,eˉ)=eˉV′(eˉ)−V(eˉ).
  2. Lemma 2, p. 1000. For every effort e≥0e \ge 0e≥0, the retailer's optimal orders under (w,u,b,T)(w, u, b, T)(w,u,b,T) are {eQ‾0}\{e\underline Q_0\}{eQ​0​}, {eQ‾1}\{e\underline Q_1\}{eQ​1​} or {eQ‾0,eQ‾1}\{e\underline Q_0, e\underline Q_1\}{eQ​0​,eQ​1​} as e<,>,=T/τe <, >, = T/\taue<,>,=T/τ, where Φ(Q‾0)=(p−w)/(p−b)\Phi(\underline Q_0) = (p - w)/(p - b)Φ(Q​0​)=(p−w)/(p−b), Φ(Q‾1)=(p+u−w)/(p+u−b)\Phi(\underline Q_1) = (p + u - w)/(p + u - b)Φ(Q​1​)=(p+u−w)/(p+u−b) and τ\tauτ is the indifference target of the quantity-only problem.
  3. §4.3, p. 1001. For T>0T > 0T>0, no optimal pair of the retailer has effort exactly T/τT/\tauT/τ.

Significance

Proposition 2 is the converse half of the paper's main message. Together with Theorem 2 it says that the combination of a target rebate with returns is the minimal coordinating scheme among those considered: each ingredient alone fails, under general demand and general effort cost, not only in a parametric example. The proposition also frames the paper's remark that a linear rebate combined with returns coordinates only at u=w−cu = w - cu=w−c and b=s+w−cb = s + w - cb=s+w−c, which leaves the manufacturer no profit.

The result is proved in the paper; nothing in this mission is open mathematics. No part of it has been machine-checked before. The formal development adds a precise account of what the paper's argument needs: the existence and interiority of the integrated optimum, the differentiability of the effort cost, and a full characterization of the retailer's optimal order for a general positive density, which the paper states but proves only for the quantity-only case.

Difficulty

The obvious route compares first-order conditions, but neither problem is globally smooth. The retailer's profit in QQQ has an upward kink at Q=TQ = TQ=T, so it is concave only piecewise and its maximizer is decided by a comparison of two local maxima, not by a first-order condition. Consequently the retailer's value as a function of effort, A(e∣T)=max⁡QR(Q,e∣T)A(e \mid T) = \max_Q R(Q, e \mid T)A(e∣T)=maxQ​R(Q,e∣T), switches branch at e=T/τe = T/\taue=T/τ and is neither concave nor differentiable there. Showing that (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ) is not a retailer optimum therefore requires the global order characterization (Lemma 2) in place of a local condition, a separate argument for the knife-edge effort T/τT/\tauT/τ, and differentiability of expectations such as Emin⁡(Q,eξ)E\min(Q, e\xi)Emin(Q,eξ) in the effort level under only a finite-mean assumption. The paper's own proof cites Lemma 1 where Lemma 2 with b=sb = sb=s is needed.

Formalization scope

The density form of A4 is literal: a measurable φ\varphiφ, zero on negatives, positive on [0,∞)[0, \infty)[0,∞), integrating to one, with ξφ(ξ)\xi\varphi(\xi)ξφ(ξ) integrable. The law of ξ\xiξ is Lebesgue measure with density φ\varphiφ; the law of eξe\xieξ is its image under x↦exx \mapsto exx↦ex. The expectations Emin⁡(Q,eξ)E\min(Q, e\xi)Emin(Q,eξ) and E(Q−eξ)+E(Q - e\xi)^+E(Q−eξ)+ are the published CachonCoord.Newsvendor.expSales and expLeftover of that image law; the rebate term is the integral of max⁡(min⁡(Q,x)−T,0)\max(\min(Q, x) - T, 0)max(min(Q,x)−T,0). Critical fractiles Φ−1(⋅)\Phi^{-1}(\cdot)Φ−1(⋅) and the threshold τ\tauτ are stated by their defining equations, never as inverse functions. "Optimal" means a maximizer over Q≥0Q \ge 0Q≥0 (and e≥0e \ge 0e≥0).

Two hypotheses are pinned relative to the page and disclosed in each statement. The effort cost carries a derivative V′V'V′ with VVV differentiable at every e>0e > 0e>0: the paper writes (∂/∂e)V(\partial/\partial e)V(∂/∂e)V in every first-order condition without stating it, and without it a kink of VVV at eˉ\bar eeˉ could let both the channel and the retailer stop at eˉ\bar eeˉ. The integrated optimum is a hypothesis, as the paper assumes its existence in words, and it is required to have eˉ>0\bar e > 0eˉ>0, as the paper's optimum is interior. Without eˉ>0\bar e > 0eˉ>0 the channel would sell nothing, and a degenerate statement would follow.

A trivializing reading is ruled out: the goal does not say that the retailer's first-order conditions fail at (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ), nor that her optimum is not unique; it says that (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ) is not a retailer maximizer.

Needed infrastructure: differentiation under the integral of Emin⁡(Q,eξ)E\min(Q, e\xi)Emin(Q,eξ) and E(min⁡(Q,eξ)−T)+E(\min(Q, e\xi) - T)^+E(min(Q,eξ)−T)+ in eee, strict monotonicity of Φ\PhiΦ and Γ\GammaΓ on [0,∞)[0, \infty)[0,∞), and the piecewise-concavity analysis of the newsvendor with a target rebate. These pieces are reusable for the sibling missions of this paper and for other effort-dependent newsvendor models. Proofs of the milestones and of supporting lemmas on these expectations are welcome.

Selected references

  • T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8):992–1007, 2002. https://doi.org/10.1287/mnsc.48.8.992.168
  • G. P. Cachon, M. A. Lariviere, Supply Chain Coordination with Revenue-Sharing Contracts: Strengths and Limitations, Management Science 51(1):30–44, 2005. https://doi.org/10.1287/mnsc.1040.0215
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in Operations Research and Management Science 11, 2003. https://doi.org/10.1016/S0927-0507(03)11006-7
7 thms1 active userReviewed
Linear algebraRandom Matrix Theory·Captain: mikedeng1

Random Matrices: Universality of ESDs and the Circular Law 1: For i.i.d. Zero-Mean Unit-Variance Entries, the ESD of (M_n + X_n)/√n Does Not Depend on the Entry Distribution in the LimitResearch Paper

Motivation

The eigenvalues of a large random matrix with independent entries follow deterministic limiting laws. For non-Hermitian matrices with i.i.d. entries of mean zero and variance one, the circular law asserts that the eigenvalues of 1nXn\frac1{\sqrt n}X_nn​1​Xn​ become uniformly distributed on the unit disk. These laws are used across statistics (covariance and signal-plus-noise models), numerical analysis (spectra of perturbed matrices), mathematical physics and the theory of neural networks; what makes them usable is universality: the limit depends only on the mean and variance of the entries, not on their distribution.

Timeline of the circular law and its universality:

  • 1965: Ginibre computes the joint eigenvalue density for complex Gaussian entries; Mehta (1967) derives the circular law in that case.
  • 1984: Girko proposes a general approach via log-determinants; his argument has gaps.
  • 1997: Bai gives the first rigorous proof for continuous entries with finite (2+η)(2+\eta)(2+η)-th moment and bounded density.
  • 2007–2008: Götze–Tikhomirov, Pan–Zhou and Tao–Vu remove the density assumption under extra moment conditions, using lower bounds on the least singular value.
  • 2010: Tao and Vu (Ann. Probab. 38 (2010) 2023–2065) prove universality under the minimal assumption of finite variance, and with a deterministic shift MnM_nMn​; the circular law in full generality follows.

This mission formalizes the main universality theorem of that paper (Theorem 1.5) together with the lemmas its proof rests on.

Setting

Let AAA be an n×nn\times nn×n complex matrix with eigenvalues λ1,…,λn\lambda_1,\dots,\lambda_nλ1​,…,λn​, counted with algebraic multiplicity. Its empirical spectral distribution (ESD) is the probability measure

μA=1n∑i=1nδλi\mu_A=\frac1n\sum_{i=1}^n\delta_{\lambda_i}μA​=n1​i=1∑n​δλi​​

on C\mathbb CC. The Hilbert–Schmidt norm is ∥A∥22=trace(AA∗)=∑i,j∣aij∣2\|A\|_2^2=\mathrm{trace}(AA^*)=\sum_{i,j}|a_{ij}|^2∥A∥22​=trace(AA∗)=∑i,j​∣aij​∣2.

A complex random variable xxx has zero mean and unit variance if Ex=0\mathbf E x=0Ex=0 and E∣x∣2=1\mathbf E|x|^2=1E∣x∣2=1. Given such xxx and yyy, let Xn=(xij)1≤i,j≤nX_n=(x_{ij})_{1\le i,j\le n}Xn​=(xij​)1≤i,j≤n​ and Yn=(yij)1≤i,j≤nY_n=(y_{ij})_{1\le i,j\le n}Yn​=(yij​)1≤i,j≤n​ have entries that are i.i.d. copies of xxx, resp. yyy. Let MnM_nMn​ be deterministic n×nn\times nn×n matrices with

sup⁡n1n2∥Mn∥22<∞,(1.3)\sup_n\frac1{n^2}\|M_n\|_2^2<\infty,\qquad(1.3)nsup​n21​∥Mn​∥22​<∞,(1.3)

and set An=Mn+XnA_n=M_n+X_nAn​=Mn​+Xn​, Bn=Mn+YnB_n=M_n+Y_nBn​=Mn​+Yn​.

Measures on C\mathbb CC carry the vague topology: test functions are continuous compactly supported f:C→Rf:\mathbb C\to\mathbb Rf:C→R. The random measures μ1nAn−μ1nBn\mu_{\frac1{\sqrt n}A_n}-\mu_{\frac1{\sqrt n}B_n}μn​1​An​​−μn​1​Bn​​ converge to zero in probability if, for every test function fff and ε>0\varepsilon>0ε>0,

P(∣∫f dμ1nAn−∫f dμ1nBn∣≥ε)→0,\mathbf P\Bigl(\Bigl|\int f\,d\mu_{\frac1{\sqrt n}A_n}-\int f\,d\mu_{\frac1{\sqrt n}B_n}\Bigr|\ge\varepsilon\Bigr)\to0,P(​∫fdμn​1​An​​−∫fdμn​1​Bn​​​≥ε)→0,

and almost surely if, with probability one, the difference of integrals tends to zero for every test function. The additional hypothesis

(1.4)μ(1nMn−zI)(1nMn−zI)∗ converges for almost every z∈C(1.4)\qquad \mu_{(\frac1{\sqrt n}M_n-zI)(\frac1{\sqrt n}M_n-zI)^*}\ \text{converges for almost every } z\in\mathbb C(1.4)μ(n​1​Mn​−zI)(n​1​Mn​−zI)∗​ converges for almost every z∈C

concerns only the deterministic shift.

Formalization targets

Goal: Theorem 1.5 (universality principle)

μ1nAn−μ1nBn⟶0 in probability;(1.4) ⟹ μ1nAn−μ1nBn⟶0 almost surely.\mu_{\frac1{\sqrt n}A_n}-\mu_{\frac1{\sqrt n}B_n}\longrightarrow0\ \text{in probability};\qquad (1.4)\ \Longrightarrow\ \mu_{\frac1{\sqrt n}A_n}-\mu_{\frac1{\sqrt n}B_n}\longrightarrow0\ \text{almost surely}.μn​1​An​​−μn​1​Bn​​⟶0 in probability;(1.4) ⟹ μn​1​An​​−μn​1​Bn​​⟶0 almost surely.

The statement involves no limiting law: it compares two ensembles, so it holds whether or not μ1nAn\mu_{\frac1{\sqrt n}A_n}μn​1​An​​ itself converges.

Milestones

The proof combines three results, each a milestone:

  • Theorem 2.1 (replacement principle), in probability and almost surely: if 1n2(∥An∥22+∥Bn∥22)\frac1{n^2}(\|A_n\|_2^2+\|B_n\|_2^2)n21​(∥An​∥22​+∥Bn​∥22​) is bounded and, for almost every zzz, 1nlog⁡∣det⁡(1nAn−zI)∣−1nlog⁡∣det⁡(1nBn−zI)∣→0\frac1n\log|\det(\frac1{\sqrt n}A_n-zI)|-\frac1n\log|\det(\frac1{\sqrt n}B_n-zI)|\to0n1​log∣det(n​1​An​−zI)∣−n1​log∣det(n​1​Bn​−zI)∣→0, then μ1nAn−μ1nBn→0\mu_{\frac1{\sqrt n}A_n}-\mu_{\frac1{\sqrt n}B_n}\to0μn​1​An​​−μn​1​Bn​​→0.
  • Lemma 1.7 (tightness): 1n2∥An∥22\frac1{n^2}\|A_n\|_2^2n21​∥An​∥22​ and ∫∣z∣2 dμ1nAn\int|z|^2\,d\mu_{\frac1{\sqrt n}A_n}∫∣z∣2dμn​1​An​​ are almost surely bounded.
  • Proposition 2.2 (converging determinant): for every zzz, the log-determinant difference (2.2) tends to zero in probability, and almost surely if (1.4) holds at zzz.

Supporting milestones: the linear-algebra Lemmas A.1 (interlacing), A.2 (Weyl's second-moment inequality) and A.4 (negative second moment); the probabilistic dominated convergence Lemma 3.1; Girko's identity (Lemma 3.3); the least singular value bound (Lemma 4.1); the lower tail bound for distances to subspaces (Proposition 5.1); and the high- and low-dimensional row contributions (Lemmas 4.2 and 4.3).

Significance

The result. Theorem 1.5 with Mn=0M_n=0Mn​=0 and yyy complex Gaussian transfers Mehta's computation for the Ginibre ensemble to every zero-mean unit-variance entry distribution: this is the circular law under the optimal moment assumption (Theorem 1.10 of the paper). With nonzero MnM_nMn​ it gives universality for perturbed and non-centred matrices, including results with entries of nonzero mean. The replacement principle (Theorem 2.1) is a general tool: it reduces vague convergence of non-Hermitian ESDs to convergence of log-determinants and applies to ensembles without independent entries.

Formalizing it. The theorem is proved in the paper; no part of it, and no ESD of a non-Hermitian matrix, has been formalized. The mission produces a machine-checked statement of universality in the vague topology and a library of reusable pieces: ESDs of complex matrices, convergence of random measures in probability and almost surely, interlacing and Weyl-type inequalities for singular values, and Girko's identity. Lemmas 4.1 and 5.1 rest on results the paper cites (Tao–Vu's least singular value bound, Talagrand's concentration inequality); formalizing those is part of the work.

Difficulty

The ESD of a non-Hermitian matrix is not stable under small perturbations: eigenvalues of a nearly singular matrix can move a long way, so the moment method and the Stieltjes transform method that settle the Hermitian case do not apply. The log-determinant 1nlog⁡∣det⁡(1nAn−zI)∣\frac1n\log|\det(\frac1{\sqrt n}A_n-zI)|n1​log∣det(n​1​An​−zI)∣ is a stable proxy only if the small singular values of 1nAn−zI\frac1{\sqrt n}A_n-zIn​1​An​−zI are controlled, and with only a second moment on the entries the entries can be unbounded, which defeats standard concentration arguments. The obvious approach, comparing AnA_nAn​ and BnB_nBn​ by swapping entries one at a time, needs smooth bounded statistics of the matrix, and the log-determinant is neither: it is unbounded near singular matrices.

Formalization scope

Matrices are Matrix (Fin n) (Fin n) ℂ; eigenvalues are the roots of the characteristic polynomial as a multiset, so the ESD counts algebraic multiplicity; for n=0n=0n=0 the ESD is the zero measure, harmless because every statement is asymptotic. The Hilbert–Schmidt norm is written as an explicit sum, not Mathlib's default (sup) matrix norm. Singular values are Mathlib's zero-indexed LinearMap.singularValues, shifted so that σ1\sigma_1σ1​ is the largest.

Conventions committed to:

  • Coupling. XnX_nXn​ is the top-left n×nn\times nn×n corner of one infinite i.i.d. array; the almost-sure statements depend on this choice, the in-probability ones do not. No relation between the xxx- and yyy-arrays is assumed.
  • (1.4) asks for a probability measure as the vague limit; under (1.3) any vague limit of these ESDs is one.
  • Almost sure convergence of ESDs uses one null set for all test functions.
  • Junk values. Lean has log⁡0=0\log 0=0log0=0 and 1/0=01/0=01/0=0. Theorem 2.1 therefore states its "determinants are nonzero" clause explicitly, and Proposition 2.2 concludes it (the paper's (2.2) is −∞-\infty−∞ at a vanishing determinant, so its convergence includes nonvanishing); Lemmas 4.2 and 4.3 assert positivity of the row distances they take logarithms of; Lemma 3.1's (1+δ)(1+\delta)(1+δ)-moment is a lower integral with values in [0,∞][0,\infty][0,∞], since a Bochner integral would vanish for non-integrable functions and make the hypothesis vacuous.
  • O(⋅)O(\cdot)O(⋅) constants are existential and fixed before the quantities they must not depend on: before ε\varepsilonε in Lemmas 4.2 and 4.3, before the sample point in Lemma 4.1, after ccc and before n,d,Wn,d,Wn,d,W and the row shift in Proposition 5.1.
  • Section 4 setting. Lemmas 4.2 and 4.3 carry the standing reductions of §4 as hypotheses: z=0z=0z=0, the row bound (4.2) ∥Zi∥=O(n)\|Z_i\|=O(\sqrt n)∥Zi​∥=O(n​) for n/2≤i≤nn/2\le i\le nn/2≤i≤n (which the paper obtains by permuting rows), and, for Lemma 4.3, convergence of μ1nMnMn∗\mu_{\frac1nM_nM_n^*}μn1​Mn​Mn∗​​. Proposition 5.1 quantifies over every deterministic row shift.
  • Printed slip. On p. 2045 the YiY_iYi​ are called "the rows of 1nBn\frac1{\sqrt n}B_nn​1​Bn​" and then normalized again; here YiY_iYi​ are the rows of BnB_nBn​, matching XiX_iXi​.

A trivializing formalization is excluded: the goal mentions only ESDs, i.i.d. entries, (1.3) and (1.4) — no log-determinant or singular value hypothesis — and its in-probability half holds without (1.4). Lemmas 6.3 and 6.4 and the internal Lemmas 3.2, 3.4, 5.3, 6.1, 6.6, 6.7 and Theorems 5.2, B.1 are not posed. Contributions are welcome on any milestone, and particularly on the deterministic Lemmas A.1, A.2, A.4 and 3.3, which are reusable well beyond this mission.

Selected references

  • T. Tao, V. Vu (appendix by M. Krishnapur), Random matrices: universality of ESDs and the circular law, The Annals of Probability 38(5) (2010) 2023–2065. https://doi.org/10.1214/10-AOP534 (the source; the published article is the citation basis)
  • J. Ginibre, Statistical ensembles of complex, quaternion, and real matrices, J. Math. Phys. 6 (1965) 440–449. https://doi.org/10.1063/1.1704292
  • V. L. Girko, The circular law, Teor. Veroyatnost. i Primenen. 29 (1984) 669–679; English translation Theory Probab. Appl. 29 (1985) 694–706. https://doi.org/10.1137/1129095
  • Z. D. Bai, Circular law, Ann. Probab. 25 (1997) 494–529. https://doi.org/10.1214/aop/1024404298
  • T. Tao, V. Vu, Random matrices: the circular law, Commun. Contemp. Math. 10 (2008) 261–307. https://doi.org/10.1142/S0219199708002788
  • R. B. Dozier, J. W. Silverstein, On the empirical distribution of eigenvalues of large dimensional information-plus-noise-type matrices, J. Multivariate Anal. 98 (2007) 678–694. https://doi.org/10.1016/j.jmva.2006.09.006
17 thms1 active userReviewed
Machine LearningStatistics·Captain: mikedeng1

Robust Regression and Lasso 4: ‖b − Ax‖₂ + √n c‖x‖₁ + √n c Equals the Worst Case of √(n·E_μ[(b′ − r′ᵀx)²]) over Box-Constrained Distribution ClassesResearch Paper

Motivation

The Lasso fits a linear model to data (b,A)(b, A)(b,A) by penalizing the ℓ1\ell_1ℓ1​ norm of the coefficient vector. Xu, Caramanis and Mannor (arXiv:0811.1790) showed that ℓ1\ell_1ℓ1​-regularized regression is exactly a robust regression problem: it minimizes the worst-case residual when every feature column may be disturbed within a norm ball. That reading explains Lasso through what it protects against, not through a prior or a sparsity heuristic.

The paper's Section V turns the same identity into a statistical statement. For a fixed coefficient vector xxx, the robust loss on the training data equals a worst-case expected loss: the largest expected squared prediction error over a class of probability distributions built around the samples. One of these distributions is a kernel density estimator of the data, and from this the authors derive the consistency of Lasso using robustness alone. This mission formalizes that bridge, Corollary 3 of the paper, together with the steps of its proof in Appendix D.

The same authors later generalized the underlying equivalence (Proposition 1 here) to weighted, possibly overlapping uncertainty sets in A distributional interpretation of robust optimization (Math. Oper. Res. 2012).

Setting

There are n≥1n\ge1n≥1 samples and mmm features. The data are a response vector b∈Rnb\in\mathbb R^nb∈Rn and an observation matrix A=(aij)∈Rn×mA=(a_{ij})\in\mathbb R^{n\times m}A=(aij​)∈Rn×m; its iii-th row ri⊤r_i^\topri⊤​ is the feature vector of sample iii. A coefficient vector is x∈Rmx\in\mathbb R^mx∈Rm, and c≥0c\ge0c≥0 is a fixed budget (the paper writes cnc_ncn​ because its later consistency argument lets it depend on nnn). Norms are ∥v∥2=∑ivi2\|v\|_2=\sqrt{\sum_i v_i^2}∥v∥2​=∑i​vi2​​ and ∥x∥1=∑j∣xj∣\|x\|_1=\sum_j|x_j|∥x∥1​=∑j​∣xj​∣.

A pair (σ,Δ)(\sigma,\Delta)(σ,Δ), with σ∈Rn\sigma\in\mathbb R^nσ∈Rn and Δ=(δij)∈Rn×m\Delta=(\delta_{ij})\in\mathbb R^{n\times m}Δ=(δij​)∈Rn×m with columns δ1,…,δm\delta_1,\dots,\delta_mδ1​,…,δm​, is admissible if ∥σ∥2≤n c\|\sigma\|_2\le\sqrt n\,c∥σ∥2​≤n​c and ∥δj∥2≤n c\|\delta_j\|_2\le\sqrt n\,c∥δj​∥2​≤n​c for every column jjj. Each admissible pair defines one box per sample,

Zi=[bi−σi, bi+σi]×∏j=1m[aij−δij, aij+δij]⊆Rm+1,\mathcal Z_i=[b_i-\sigma_i,\,b_i+\sigma_i]\times\prod_{j=1}^m[a_{ij}-\delta_{ij},\,a_{ij}+\delta_{ij}]\subseteq\mathbb R^{m+1},Zi​=[bi​−σi​,bi​+σi​]×j=1∏m​[aij​−δij​,aij​+δij​]⊆Rm+1,

a rectangle around the observed pair (bi,ri)(b_i, r_i)(bi​,ri​) in the joint response–feature space. The box-constrained class Pn(A,Δ,b,σ)\mathcal P_n(A,\Delta,b,\sigma)Pn​(A,Δ,b,σ) is the set of Borel probability measures μ\muμ on Rm+1\mathbb R^{m+1}Rm+1 such that

μ(⋃i∈SZi)≥∣S∣nfor every S⊆{1,…,n}.\mu\Big(\bigcup_{i\in S}\mathcal Z_i\Big)\ge\frac{|S|}{n}\qquad\text{for every }S\subseteq\{1,\dots,n\}.μ(i∈S⋃​Zi​)≥n∣S∣​for every S⊆{1,…,n}.

The empirical distribution of the samples belongs to it, and so does any distribution that spreads the mass 1/n1/n1/n of each sample over its box. Finally P^(n)\hat{\mathcal P}(n)P^(n) is the union of these classes over all admissible (σ,Δ)(\sigma,\Delta)(σ,Δ).

Formalization targets

Goal: Corollary 3, Eq. (8)

∥b−Ax∥2+n c ∥x∥1+n c=sup⁡μ∈P^(n) n∫Rm+1(b′−r′⊤x)2 dμ(r′,b′) for every x∈Rm.\|b-Ax\|_2+\sqrt n\,c\,\|x\|_1+\sqrt n\,c=\sup_{\mu\in\hat{\mathcal P}(n)}\sqrt{\,n\int_{\mathbb R^{m+1}}(b'-r'^\top x)^2\,d\mu(r',b')\,}\qquad\text{for every }x\in\mathbb R^m.∥b−Ax∥2​+n​c∥x∥1​+n​c=μ∈P^(n)sup​n∫Rm+1​(b′−r′⊤x)2dμ(r′,b′)​for every x∈Rm.

The equation holds for every data set: there is no assumption on how (b,A)(b,A)(b,A) was generated (Remark 1 of the paper).

Milestones (Appendix D)

  1. The robust identity with the response perturbed (first display): the worst case of ∥b+σ−(A+Δ)x∥2\|b+\sigma-(A+\Delta)x\|_2∥b+σ−(A+Δ)x∥2​ over admissible (σ,Δ)(\sigma,\Delta)(σ,Δ) is attained and equals the left-hand side of (8).
  2. The box decomposition (second and third displays): that worst case equals
sup⁡(σ,Δ) sup⁡(b^i,r^i)∈Zi∑i(b^i−r^i⊤x)2=sup⁡(σ,Δ)∑isup⁡Zi(b^i−r^i⊤x)2.\sup_{(\sigma,\Delta)}\ \sup_{(\hat b_i,\hat r_i)\in\mathcal Z_i}\sqrt{\textstyle\sum_i(\hat b_i-\hat r_i^\top x)^2}=\sup_{(\sigma,\Delta)}\sqrt{\textstyle\sum_i\sup_{\mathcal Z_i}(\hat b_i-\hat r_i^\top x)^2}.(σ,Δ)sup​ (b^i​,r^i​)∈Zi​sup​∑i​(b^i​−r^i⊤​x)2​=(σ,Δ)sup​∑i​supZi​​(b^i​−r^i⊤​x)2​.

The remaining step of the proof applies Proposition 1 of the paper: for Borel sets Z1,…,Zn\mathcal Z_1,\dots,\mathcal Z_nZ1​,…,Zn​, 1n∑isup⁡Zih=sup⁡μ∈Pn∫h dμ\frac1n\sum_i\sup_{\mathcal Z_i}h=\sup_{\mu\in\mathcal P_n}\int h\,d\mun1​∑i​supZi​​h=supμ∈Pn​​∫hdμ. Its general weighted form is already posed on the platform as DistInterpRO.Equivalence.theorem_2_1 (inf form, weights ci>0c_i>0ci​>0 summing to one; take ci=1/nc_i=1/nci​=1/n and f=−hf=-hf=−h), and the one-set case (Lemma 2) as DistInterpRO.Equivalence.corollary_2_1. They are credited here and not posed again.

Significance

The result. Corollary 3 gives Lasso a distributional reading: minimizing ∥b−Ax∥2+n c ∥x∥1\|b-Ax\|_2+\sqrt n\,c\,\|x\|_1∥b−Ax∥2​+n​c∥x∥1​ is, up to the additive constant n c\sqrt n\,cn​c, minimizing the worst-case root mean squared error over all distributions that stay, sample by sample, inside boxes of controlled size around the data. Because a box kernel density estimator lies in P^(n)\hat{\mathcal P}(n)P^(n), the paper's Theorem 7 derives the consistency of Lasso from this identity when cn→0c_n\to0cn​→0 suitably. Without the corollary that argument has no starting point.

Formalizing it. The result is proved in the paper but has no machine-checked proof. A formal development yields three reusable pieces: the robust-regression identity with a perturbed response, the decomposition of a worst case over a product of boxes into per-sample worst cases, and the finite-dimensional instance of Proposition 1 with uniform weights. Together they are the deterministic half of a formal consistency proof for Lasso.

Difficulty

The left-hand side of (8) is a worst case over perturbations of the data; the right-hand side is a worst case over probability measures. Bounding the right-hand side above requires controlling ∫h dμ\int h\,d\mu∫hdμ for every μ\muμ in the class, and the constraint on μ\muμ is not that each box receives mass 1/n1/n1/n: the boxes may overlap, and a measure may concentrate mass on intersections. The natural argument of moving each sample's mass to the worst point of its box therefore does not apply to a general member of the class. A second, smaller difficulty is the order of the suprema: P^(n)\hat{\mathcal P}(n)P^(n) is a union over (σ,Δ)(\sigma,\Delta)(σ,Δ), and the square root must be exchanged with a supremum over measures.

Formalization scope

  • Rm+1\mathbb R^{m+1}Rm+1 is Fin (m+1) → ℝ with its product (= Borel) σ-algebra, response first: z0=b′z_0=b'z0​=b′, zj+1=rj′z_{j+1}=r'_jzj+1​=rj′​. This matches the boxes; the paper's dμ(r′,b′)d\mu(r',b')dμ(r′,b′) ordering is notation only. AAA is a Matrix (Fin n) (Fin m) ℝ, indices are Fin n, Fin m.
  • Readings of sup, max and the integral. The supremum in (8) is taken in [0,∞][0,\infty][0,∞] and stated as a least upper bound (IsLUB), with no claim that it is attained. The integral is the Lebesgue integral of the nonnegative integrand with values in [0,∞][0,\infty][0,∞], never a Bochner integral. The "max" of the first display is an attained maximum (IsGreatest). The equalities of suprema in the second and third displays are stated as "the same real number is the least upper bound of each set". The inner supremum over a nonempty compact box is encoded as the greatest value of the loss on it.
  • Standing hypotheses. n≥1n\ge1n≥1 and c≥0c\ge0c≥0 are implicit on the page and are explicit here. ccc is one constant, not a sequence. σ\sigmaσ and Δ\DeltaΔ carry no sign condition, as printed. A negative entry makes some box empty, and then Pn(A,Δ,b,σ)\mathcal P_n(A,\Delta,b,\sigma)Pn​(A,Δ,b,σ) is empty, so such pairs contribute nothing.
  • Ruled out. Neither side of (8) is defined by the other's closed form. No real sSup with a junk value 000 and no Bochner integral that could silently vanish appear in any statement. The class keeps the constraint for every SSS, including S={1,…,n}S=\{1,\dots,n\}S={1,…,n}, which forces each measure onto ⋃iZi\bigcup_i\mathcal Z_i⋃i​Zi​; dropping it would make the supremum infinite.
  • Infrastructure. The development needs empirical (finite Dirac) measures, and the Lebesgue integral of bounded functions on compact sets. Proposition 1 in the generality of DistInterpRO.Equivalence.theorem_2_1 is reusable well beyond this mission. Proofs of either milestone, of the uniform-weight Proposition 1 for boxes, and of the goal are all welcome.

Selected references

  • H. Xu, C. Caramanis, S. Mannor, Robust Regression and Lasso, arXiv:0811.1790v1, 2008; IEEE Transactions on Information Theory 56(7), 2010. https://arxiv.org/abs/0811.1790 , https://doi.org/10.1109/TIT.2010.2048503
  • H. Xu, C. Caramanis, S. Mannor, A distributional interpretation of robust optimization, Mathematics of Operations Research 37(1), 2012. https://doi.org/10.1287/moor.1110.0531
  • R. Tibshirani, Regression shrinkage and selection via the lasso, Journal of the Royal Statistical Society B 58(1), 1996. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
  • L. Devroye, L. Györfi, Nonparametric Density Estimation: The L1 View, Wiley, 1985.
4 thms1 active userReviewed
Convex OptimizationOperations ResearchOptimization·Captain: mikedeng1

Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion 4: With Random Right-Hand Side and Known Dual Extreme Points, a Distribution in 𝒫 Attains Ẑ(x) = Ẑ_DD(x)Research Paper

Motivation

Two-stage stochastic linear programs model decisions taken before uncertainty is revealed (a first-stage plan xxx) followed by a corrective recourse action once it is. The classical model needs the full probability distribution of the uncertain data. In practice usually only estimates of a few moments are available, and the computed plan can be sensitive to the distribution that is assumed. The minimax (distributionally robust) approach replaces the single distribution by a class of distributions sharing given moments and optimizes against the worst member of the class. Bertsimas, Doan, Natarajan and Teo (Math. Oper. Res. 35(3), 2010) combine this with risk aversion, through a piecewise-linear disutility of the second-stage cost, and show which instances become semidefinite programs.

Besides the optimal value, the worst-case distribution itself is of practical interest: the paper proposes it as a natural distribution for stress-testing a first-stage solution (§4). This mission concerns the case where the right-hand side of the second stage is random, and formalizes the paper's construction of a worst-case distribution that is a genuine member of the moment class.

Setting

A first-stage decision x∈Rnx\in\mathbb R^nx∈Rn is feasible if x∈X={x:Ax=b, x≥0}x\in X=\{x : Ax=b,\ x\ge 0\}x∈X={x:Ax=b, x≥0}. Given a recourse matrix W∈Rr×dW\in\mathbb R^{r\times d}W∈Rr×d, a technology matrix T∈Rr×nT\in\mathbb R^{r\times n}T∈Rr×n, a constant cost vector q∈Rdq\in\mathbb R^dq∈Rd and a realized right-hand side h∈Rrh\in\mathbb R^rh∈Rr, the second-stage cost is the optimal value of the dual of the recourse linear program,

Q(h,x)=max⁡p (h−Tx)′ps.t.W′p≤q.\mathcal Q(h,x)=\max_{p}\ (h-Tx)'p\quad\text{s.t.}\quad W'p\le q .Q(h,x)=pmax​ (h−Tx)′ps.t.W′p≤q.

Risk aversion enters through the disutility U(t)=max⁡k=1,…,K(αkt+βk)\mathbb U(t)=\max_{k=1,\dots,K}(\alpha_k t+\beta_k)U(t)=maxk=1,…,K​(αk​t+βk​) with αk≥0\alpha_k\ge 0αk​≥0. The right-hand side h~\tilde hh~ is random; its distribution is only known to lie in the moment class

P={P:EP[h~]=μ, EP[h~h~′]=Q},\mathcal P=\{P : \mathbb E_P[\tilde h]=\mu,\ \mathbb E_P[\tilde h\tilde h']=Q\},P={P:EP​[h~]=μ, EP​[h~h~′]=Q},

and the worst-case expected disutility is Z^(x)=sup⁡P∈PEP[U(Q(h~,x))]\hat Z(x)=\sup_{P\in\mathcal P}\mathbb E_P[\mathbb U(\mathcal Q(\tilde h,x))]Z^(x)=supP∈P​EP​[U(Q(h~,x))].

The standing assumptions are: complete recourse, {Ww:w≥0}=Rr\{Ww : w\ge 0\}=\mathbb R^r{Ww:w≥0}=Rr; a nonempty dual polyhedron {p:W′p≤q}\{p : W'p\le q\}{p:W′p≤q}; Q≻μμ′Q\succ\mu\mu'Q≻μμ′; and (Assumption 5) the extreme points p1,…,pNp_1,\dots,p_Np1​,…,pN​ of the dual polyhedron are known. Under these, the paper introduces the semidefinite program (16): over symmetric blocks indexed by pairs (k,i)(k,i)(k,i),

Z^DD(x)=max⁡ ∑k=1K∑i=1N(αkpi′vki+vk0i(βk−αkpi′Tx))  s.t.  ∑k,i(Vkivki(vki)′vk0i)=(Qμμ′1),  (Vkivki(vki)′vk0i)⪰0.\hat Z_{DD}(x)=\max\ \sum_{k=1}^K\sum_{i=1}^N\big(\alpha_k p_i'v_k^i+v_{k0}^i(\beta_k-\alpha_k p_i'Tx)\big) \ \ \text{s.t.}\ \ \sum_{k,i}\begin{pmatrix}V_k^i & v_k^i\\ (v_k^i)' & v_{k0}^i\end{pmatrix}=\begin{pmatrix}Q&\mu\\ \mu'&1\end{pmatrix},\ \ \begin{pmatrix}V_k^i & v_k^i\\ (v_k^i)' & v_{k0}^i\end{pmatrix}\succeq 0 .Z^DD​(x)=max k=1∑K​i=1∑N​(αk​pi′​vki​+vk0i​(βk​−αk​pi′​Tx))  s.t.  k,i∑​(Vki​(vki​)′​vki​vk0i​​)=(Qμ′​μ1​),  (Vki​(vki​)′​vki​vk0i​​)⪰0.

From a point of (16) the paper builds the mixed distribution Pm(x)P_m(x)Pm​(x), which with probability vk0iv_{k0}^ivk0i​ draws a normal vector with mean vki/vk0iv_k^i/v_{k0}^ivki​/vk0i​ and covariance (Vkivk0i−vki(vki)′)/(vk0i)2(V_k^iv_{k0}^i-v_k^i(v_k^i)')/(v_{k0}^i)^2(Vki​vk0i​−vki​(vki​)′)/(vk0i​)2.

Formalization targets

Goal: Theorem 3.3 (p. 590)

For every x∈Xx\in Xx∈X there is P∈PP\in\mathcal PP∈P with

EP′[U(Q(h~,x))]≤EP[U(Q(h~,x))]=Z^(x)=Z^DD(x)∀P′∈P,\mathbb E_{P'}\big[\mathbb U(\mathcal Q(\tilde h,x))\big]\le \mathbb E_{P}\big[\mathbb U(\mathcal Q(\tilde h,x))\big]=\hat Z(x)=\hat Z_{DD}(x)\qquad\forall P'\in\mathcal P,EP′​[U(Q(h~,x))]≤EP​[U(Q(h~,x))]=Z^(x)=Z^DD​(x)∀P′∈P,

where the common value is the attained maximum of (16), and the expected disutility is integrable under every member of P\mathcal PP.

Milestones (proof of Theorem 3.3, pp. 590–591)

  1. U(Q(h,x))=max⁡k,i(αk(h−Tx)′pi+βk)\mathbb U(\mathcal Q(h,x))=\max_{k,i}\big(\alpha_k(h-Tx)'p_i+\beta_k\big)U(Q(h,x))=maxk,i​(αk​(h−Tx)′pi​+βk​) for every hhh.
  2. Every P∈PP\in\mathcal PP∈P yields a feasible point of (16) of equal value; hence Z^(x)≤Z^DD(x)\hat Z(x)\le\hat Z_{DD}(x)Z^(x)≤Z^DD​(x).
  3. (16) has an optimal solution whose blocks have vk0i>0v_{k0}^i>0vk0i​>0 or vanish.
  4. For such a feasible point, Pm(x)∈PP_m(x)\in\mathcal PPm​(x)∈P.
  5. EPm(x)[U(Q(h~,x))]\mathbb E_{P_m(x)}[\mathbb U(\mathcal Q(\tilde h,x))]EPm​(x)​[U(Q(h~,x))] is at least the objective value of (16) at that point.

Significance

The result. Theorem 3.3 shows that, once the dual extreme points are known, the worst case over the moment class is attained, and by an explicit finite mixture of normal distributions read off an optimal solution of a semidefinite program. This contrasts with the random-objective case of the same paper (Theorem 2.2), where the bound is in general only approached by a sequence of distributions. The extremal distribution gives a concrete stress-test scenario for a candidate first-stage plan, and the identity Z^(x)=Z^DD(x)\hat Z(x)=\hat Z_{DD}(x)Z^(x)=Z^DD​(x) certifies the value of the inner worst-case problem without appeal to strong duality for the moment problem.

Formalizing it. The result is proved in the paper; to our knowledge no machine-checked version exists. A formal proof needs a measure-theoretic treatment of conditional moments on the cells of a piecewise-linear maximum, the existence of optima of a bounded semidefinite program, and moment computations for multivariate normal mixtures. These pieces are reusable well beyond this paper, for instance in other moment-based distributionally robust models.

Difficulty

The obvious route goes through moment-problem duality: dualize sup⁡P∈P\sup_{P\in\mathcal P}supP∈P​, reformulate the semi-infinite constraint as linear matrix inequalities, and dualize again. That route only gives the inequality chain up to a duality gap and says nothing about attainment over P\mathcal PP. The proof here avoids strong duality, but it must show two separate things: every distribution in P\mathcal PP maps to a feasible point of (16) without loss of value (this needs a measurable choice of the maximizing pair and the conditional moments on each cell), and the optimal point of (16) maps back to a distribution in P\mathcal PP whose value is at least the optimum. The second step fails on blocks with zero weight vk0i=0v_{k0}^i=0vk0i​=0, where no normal component can be formed; those blocks have to be removed from an optimal solution first.

Formalization scope

The Lean development works on Rr\mathbb R^rRr as Fin r → ℝ, with measures in place of the paper's densities. The moment class reuses the published definitions MomentDRO.Conf.HasSecondMoments, meanVec and secondMomentAbout P 0 (uncentred second moment). Q(h,x)\mathcal Q(h,x)Q(h,x), Z^(x)\hat Z(x)Z^(x) and Z^DD(x)\hat Z_{DD}(x)Z^DD​(x) are real sSups; every theorem that uses them states the relevant maximum or bound explicitly, so no statement depends on the junk value of an empty or unbounded supremum. Bordered matrices are Matrix.fromBlocks over Fin r ⊕ Fin 1 and ⪰0\succeq 0⪰0 is Matrix.PosSemidef. The normal components are Mathlib's multivariateGaussian, transported from EuclideanSpace ℝ (Fin r); the mixture weights are ENNReal.ofReal vk0iv_{k0}^ivk0i​.

Readings of the page:

  • As printed, Assumption 2 (complete recourse) and Assumption 3 "for all qqq" are mutually inconsistent when r≥1r\ge 1r≥1. The formalization uses complete recourse and nonemptiness of {p:W′p≤q}\{p : W'p\le q\}{p:W′p≤q} at the one constant qqq of §3.
  • Assumption 1 is not used and is dropped; x∈Xx\in Xx∈X is kept as in the statement.
  • "Without loss of generality vk0i>0v_{k0}^i>0vk0i​>0" is read as: some optimal solution has every block either with vk0i>0v_{k0}^i>0vk0i​>0 or zero.
  • The printed "Vkivk0V_k^iv_{k0}Vki​vk0​", "vk02v_{k0}^2vk02​" and "with probability vk0v_{k0}vk0​" are read with the superscript iii.

The goal asserts that a maximizer over P\mathcal PP exists, not only an equation between suprema: an equation such as EP[⋅]=Z^(x)\mathbb E_P[\cdot]=\hat Z(x)EP​[⋅]=Z^(x) alone could hold through a junk value and is ruled out as the target. No strong-duality hypothesis is assumed, since the proof does not need one. Contributions welcome: the measurable argmax selection, compactness of the feasible set of (16), and second-moment computations for Gaussian mixtures.

Selected references

  • D. Bertsimas, X. V. Doan, K. Natarajan, C.-P. Teo, Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion, Mathematics of Operations Research 35(3):580–602, 2010. https://doi.org/10.1287/moor.1100.0445
  • E. Delage, Y. Ye, Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems, Operations Research 58(3):595–612, 2010. https://doi.org/10.1287/opre.1090.0741
  • J. Dupačová, The minimax approach to stochastic programming and an illustrative application, Stochastics 20(1):73–88, 1987. https://doi.org/10.1080/17442508708833436
10 thms1 active userReviewed
Linear algebraOptimizationRandom Matrix Theory·Captain: mikedeng1

Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization 2: Nearly Isometric Random Maps Have δ_r ≤ δ with Probability 1 − e^(−c₁p) Once p ≥ c₀r(m+n)log(mn)Research Paper

Motivation

Many problems in system identification, collaborative filtering, low-dimensional embedding and model reduction ask for the matrix of least rank in an affine space. Affine rank minimization — given a linear map A:Rm×n→Rp\mathcal A:\mathbb R^{m\times n}\to\mathbb R^pA:Rm×n→Rp and b∈Rpb\in\mathbb R^pb∈Rp, find a matrix of minimum rank with A(X)=b\mathcal A(X)=bA(X)=b — is NP-hard in general. Recht, Fazel and Parrilo (arXiv:0706.4138; SIAM Review 52(3), 2010, doi:10.1137/070697835) showed that the convex relaxation which minimizes the nuclear norm ∥X∥∗\|X\|_*∥X∥∗​ (the sum of the singular values) instead of the rank recovers the minimum-rank solution exactly whenever A\mathcal AA satisfies a restricted isometry property on low-rank matrices. That deterministic theorem is the subject of the companion mission in this series.

A deterministic condition is only useful if maps satisfying it exist and are common. This mission formalizes the paper's second main result: random linear maps from a broad class — including Gaussian, symmetric Bernoulli and sparse random matrices — satisfy the restricted isometry property with overwhelming probability once the number of measurements ppp is of order r(m+n)log⁡(mn)r(m+n)\log(mn)r(m+n)log(mn). This parallels the role of random matrices in compressed sensing (Candès–Tao 2005; Baraniuk, Davenport, DeVore and Wakin 2008), where the vector restricted isometry property is established for random measurement matrices by a concentration and covering argument.

Setting

Write ⟨X,Y⟩=Tr⁡(X⊤Y)\langle X,Y\rangle=\operatorname{Tr}(X^\top Y)⟨X,Y⟩=Tr(X⊤Y) for the trace inner product on Rm×n\mathbb R^{m\times n}Rm×n and ∥X∥F\|X\|_F∥X∥F​ for the Frobenius norm. A linear map A:Rm×n→Rp\mathcal A:\mathbb R^{m\times n}\to\mathbb R^pA:Rm×n→Rp is given by ppp measurement matrices X1,…,XpX_1,\dots,X_pX1​,…,Xp​ through A(X)i=⟨Xi,X⟩\mathcal A(X)_i=\langle X_i,X\rangleA(X)i​=⟨Xi​,X⟩; ∥A(X)∥\|\mathcal A(X)\|∥A(X)∥ is the Euclidean norm in Rp\mathbb R^pRp, and ∥A∥=sup⁡{∥A(X)∥:∥X∥F≤1}\|\mathcal A\|=\sup\{\|\mathcal A(X)\|:\|X\|_F\le1\}∥A∥=sup{∥A(X)∥:∥X∥F​≤1} is the operator norm.

The rrr-restricted isometry constant δr(A)\delta_r(\mathcal A)δr​(A) (Definition 3.1) is the smallest δ≥0\delta\ge0δ≥0 such that

(1−δ)∥X∥F≤∥A(X)∥≤(1+δ)∥X∥Ffor all X with rank⁡X≤r.(1-\delta)\|X\|_F\le\|\mathcal A(X)\|\le(1+\delta)\|X\|_F\qquad\text{for all }X\text{ with }\operatorname{rank}X\le r.(1−δ)∥X∥F​≤∥A(X)∥≤(1+δ)∥X∥F​for all X with rankX≤r.

A random linear map A\mathcal AA is nearly isometrically distributed (Definition 4.1) if for every XXX, E∥A(X)∥2=∥X∥F2\mathbb E\|\mathcal A(X)\|^2=\|X\|_F^2E∥A(X)∥2=∥X∥F2​; for every X≠0X\ne0X=0 and 0<ϵ<10<\epsilon<10<ϵ<1,

P(∣∥A(X)∥2−∥X∥F2∣≥ϵ∥X∥F2)≤2exp⁡(−p2(ϵ2/2−ϵ3/3));\mathbb P\big(\big|\|\mathcal A(X)\|^2-\|X\|_F^2\big|\ge\epsilon\|X\|_F^2\big)\le2\exp\Big(-\frac p2\big(\epsilon^2/2-\epsilon^3/3\big)\Big);P(​∥A(X)∥2−∥X∥F2​​≥ϵ∥X∥F2​)≤2exp(−2p​(ϵ2/2−ϵ3/3));

and for some γ>0\gamma>0γ>0 and all t>0t>0t>0, P(∥A∥≥1+mn/p+t)≤exp⁡(−γpt2)\mathbb P(\|\mathcal A\|\ge1+\sqrt{mn/p}+t)\le\exp(-\gamma pt^2)P(∥A∥≥1+mn/p​+t)≤exp(−γpt2).

For subspaces T1,T2T_1,T_2T1​,T2​ of a Euclidean space, the projection distance is ρ(T1,T2)=∥PT1−PT2∥\rho(T_1,T_2)=\|P_{T_1}-P_{T_2}\|ρ(T1​,T2​)=∥PT1​​−PT2​​∥, the operator norm of the difference of the orthogonal projections (4.10). For subspaces V⊆RmV\subseteq\mathbb R^mV⊆Rm, W⊆RnW\subseteq\mathbb R^nW⊆Rn, the subspace Σ(V,W)⊆Rm×n\Sigma(V,W)\subseteq\mathbb R^{m\times n}Σ(V,W)⊆Rm×n consists of the matrices whose column space lies in VVV and whose row space lies in WWW.

Formalization targets

Goal: Theorem 4.2

Fix 0<δ<10<\delta<10<δ<1. There are c0,c1>0c_0,c_1>0c0​,c1​>0 depending only on δ\deltaδ such that for all 1≤r≤m≤n1\le r\le m\le n1≤r≤m≤n with mn≥2mn\ge2mn≥2, all p≥c0 r(m+n)log⁡(mn)p\ge c_0\,r(m+n)\log(mn)p≥c0​r(m+n)log(mn), and every nearly isometric random map A:Rm×n→Rp\mathcal A:\mathbb R^{m\times n}\to\mathbb R^pA:Rm×n→Rp,

P(δr(A)>δ)≤e−c1p.\mathbb P\big(\delta_r(\mathcal A)>\delta\big)\le e^{-c_1p}.P(δr​(A)>δ)≤e−c1​p.

Milestones

  • Lemma 4.3. For a fixed subspace UUU with d=dim⁡U≤pd=\dim U\le pd=dimU≤p and 0<δ<10<\delta<10<δ<1, the map is a δ\deltaδ-isometry on all of UUU except with probability at most 2(12/δ)dexp⁡(−p2(δ2/8−δ3/24))2(12/\delta)^d\exp(-\frac p2(\delta^2/8-\delta^3/24))2(12/δ)dexp(−2p​(δ2/8−δ3/24)).
  • Lemma 4.4. If A\mathcal AA is a δ\deltaδ-isometry on a ddd-dimensional U1U_1U1​, it is a δ′\delta'δ′-isometry on any ddd-dimensional U2U_2U2​, with δ′=δ+(1+∥A∥)ρ(U1,U2)\delta'=\delta+(1+\|\mathcal A\|)\rho(U_1,U_2)δ′=δ+(1+∥A∥)ρ(U1​,U2​).
  • (4.17). ρ(Σ(V1,W1),Σ(V2,W2))≤ρ(V1,V2)+ρ(W1,W2)\rho(\Sigma(V_1,W_1),\Sigma(V_2,W_2))\le\rho(V_1,V_2)+\rho(W_1,W_2)ρ(Σ(V1​,W1​),Σ(V2​,W2​))≤ρ(V1​,V2​)+ρ(W1​,W2​).
  • Lemma 4.5. For 0<ϵ≤10<\epsilon\le10<ϵ≤1, the family {Σ(V,W):dim⁡V=dim⁡W=r}\{\Sigma(V,W):\dim V=\dim W=r\}{Σ(V,W):dimV=dimW=r} has an ϵ\epsilonϵ-net in ρ\rhoρ of size at most (2C0/ϵ)r(m+n−2r)(2C_0/\epsilon)^{r(m+n-2r)}(2C0​/ϵ)r(m+n−2r), with C0C_0C0​ absolute.

Significance

The theorem supplies the hypothesis of the paper's recovery theorem for random measurements: with δ=1/10\delta=1/10δ=1/10 and rank 5r5r5r, it shows that O(r(m+n)log⁡(mn))O(r(m+n)\log(mn))O(r(m+n)log(mn)) random linear measurements suffice for nuclear norm minimization to recover every matrix of rank at most rrr exactly. Since a rank-rrr matrix has r(m+n−r)r(m+n-r)r(m+n−r) degrees of freedom, this is within a logarithmic factor of the information-theoretic count. The result made the nuclear norm heuristic a guaranteed method and seeded the theory of low-rank matrix recovery, including matrix completion.

The result is proved in the paper, though Lemma 4.5 rests on Szarek's covering estimates for the Grassmannian, cited without proof. To the best of the curators' search of the platform, none of these statements is machine-checked: there is no formal treatment of the matrix restricted isometry property, of nets on Grassmannians in the projection metric, or of nearly isometric random maps. A formalization would supply the probabilistic half of a fully verified low-rank recovery guarantee, together with reusable pieces — the projection distance, the stability of near isometry under subspace perturbation, and a covering bound for Grassmannians.

Difficulty

The set of matrices of rank at most rrr is not a subspace, so concentration for one matrix and a union bound over a single net in Rm×n\mathbb R^{m\times n}Rm×n do not suffice: a net of the unit ball of all matrices has size exponential in mnmnmn, which would require ppp of order mnmnmn. The set must instead be covered by finitely many r2r^2r2-dimensional subspaces, which requires a quantitative covering of the Grassmannians G(m,r)G(m,r)G(m,r) and G(n,r)G(n,r)G(n,r) in the projection distance — the content of Lemma 4.5, whose source in the literature (Szarek) does not give the constant explicitly. A second subtlety is that the event "A\mathcal AA is a near-isometry on all of a subspace" involves an uncountable family of matrices, and the bound for the supremum of ∥A(X)∥\|\mathcal A(X)\|∥A(X)∥ over a unit sphere has to be controlled from the finitely many points of a net.

Formalization scope

All statements live in the namespace MinRankRecovery.RandomRIP. Matrices are Matrix (Fin m) (Fin n) ℝ; the Frobenius norm and the trace inner product come from the published module HighDimStat_MatrixRank_Core. A linear map is represented by its ppp measurement matrices Xs : Fin p → Matrix (Fin m) (Fin n) ℝ, which loses no generality. A random map is Xs : Ω → Fin p → Matrix … on a probability space (Ω, μ), with measurable entries.

Conventions committed to:

  • δr\delta_rδr​ is the infimum of the admissible δ≥0\delta\ge0δ≥0 and is defined for every rrr; the paper's 1≤r≤m≤n1\le r\le m\le n1≤r≤m≤n appears as hypotheses of the goal.
  • ∥A∥\|\mathcal A\|∥A∥ is a supremum over the nonempty, bounded Frobenius unit ball.
  • (4.1) includes integrability. (4.2) is imposed for X≠0X\ne0X=0 only, since at X=0X=0X=0 the printed inequality fails for large ppp. γ\gammaγ in (4.3) may depend on the distribution and dimensions.
  • Probability statements bound the (outer) measure of the failure event, since events quantified over all matrices need not be measurable.
  • For ρ\rhoρ and Σ(V,W)\Sigma(V,W)Σ(V,W), matrices are vectorized into EuclideanSpace ℝ (Fin m × Fin n), which carries the Frobenius inner product. Lemma 4.4 is stated on EuclideanSpace ℝ ι for any finite index type.
  • Real.log is the natural logarithm.

Two printed statements are corrected. Theorem 4.2 assumes mn≥2mn\ge2mn≥2: at m=n=r=1m=n=r=1m=n=r=1, log⁡(mn)=0\log(mn)=0log(mn)=0 and a two-point random scalar map is nearly isometric while violating the conclusion. Lemma 4.5 is posed for 0<ϵ≤10<\epsilon\le10<ϵ≤1, since for large ϵ\epsilonϵ the right side drops below 111.

The constants c0,c1c_0,c_1c0​,c1​ of the goal are quantified before the dimensions, the distribution and γ\gammaγ; a formalization in which they may depend on m,n,p,rm,n,p,rm,n,p,r or on the distribution, or in which the near-isometry hypothesis is unsatisfiable, would be trivial and is ruled out by these choices.

A complete development needs: orthogonal projections and operator norms on finite-dimensional inner product spaces (Mathlib), volumetric ϵ\epsilonϵ-nets of spheres in subspaces, covering bounds for real Grassmannians in the projection metric, and the measure-theoretic union bound. The Grassmannian covering bound and the stability lemma are reusable beyond this mission. Contributions of any milestone, including Lemma 4.5 on its own, are welcome.

Selected references

  • B. Recht, M. Fazel, P. A. Parrilo, Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization, SIAM Review 52(3):471–501, 2010. Preprint arXiv:0706.4138v1. https://arxiv.org/abs/0706.4138
  • E. J. Candès, T. Tao, Decoding by Linear Programming, IEEE Trans. Inform. Theory 51(12), 2005. https://doi.org/10.1109/TIT.2005.858979
  • R. Baraniuk, M. Davenport, R. DeVore, M. Wakin, A Simple Proof of the Restricted Isometry Property for Random Matrices, Constructive Approximation 28(3), 2008. https://doi.org/10.1007/s00365-007-9003-x
  • S. J. Szarek, Metric entropy of homogeneous spaces, in Quantum Probability, Banach Center Publ. 43, 1998. https://arxiv.org/abs/math/9701213
  • E. J. Candès, Y. Plan, Tight Oracle Inequalities for Low-Rank Matrix Recovery From a Minimal Number of Noisy Random Measurements, IEEE Trans. Inform. Theory 57(4), 2011. https://arxiv.org/abs/1001.0339
9 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

On the Rate of Convergence of Optimal Solutions of Monte Carlo Approximations of Stochastic Programs 3: For Finite Polyhedral Problems the SAA Optimal Set Fails to Be a Face Exponentially RarelyResearch Paper

Motivation

Stochastic programs of the form min⁡x∈ΘEP h(x,ω)\min_{x\in\Theta}\mathbb E_P\,h(x,\omega)minx∈Θ​EP​h(x,ω) are rarely solvable exactly, because the expectation is an integral over a large or continuous scenario space. The standard remedy is sample average approximation (SAA), also called the Monte Carlo or sample path method: draw an i.i.d. sample ω1,…,ωN\omega^1,\dots,\omega^Nω1,…,ωN from PPP and minimize the sample average instead. Two-stage linear programs with recourse are the main case in practice. There each h(⋅,ω)h(\cdot,\omega)h(⋅,ω) is the value of a second-stage linear program, hence piecewise linear and convex, and the scenario distribution is often discrete with an astronomically large but finite support.

Shapiro and Homem-de-Mello (SIAM J. Optim. 11(1), 2000) observed that in this discrete, piecewise linear regime SAA does far better than the usual N−1/2N^{-1/2}N−1/2 statistical rate suggests: the SAA problem often returns an exactly optimal solution of the true problem. In their median example, a sample of N=120N=120N=120 solves a problem with 32003^{200}3200 scenarios exactly with probability about 0.950.950.95. This mission formalizes the version of that phenomenon that allows the true problem to have many optimal solutions.

Timeline. In 2000, Shapiro and Homem-de-Mello proved almost-sure exactness of SAA under a sharp-minimum condition (Theorem 2.1) and for finite piecewise linear problems with possibly non-unique optima (Theorem 2.3). They then showed that both events fail with exponentially small probability (Theorems 3.1 and 3.2). In 2002, Kleywegt, Shapiro and Homem-de-Mello extended exponential rates to SAA for discrete stochastic optimization. In 2002, Shapiro, Homem-de-Mello and Kim related the exponential constant for convex piecewise linear programs to a conditioning measure of the problem.

Setting

Let Θ⊆Rm\Theta\subseteq\mathbb R^mΘ⊆Rm be the feasible set, Ω\OmegaΩ a finite set of scenarios with a probability measure PPP, and h:Rm×Ω→Rh:\mathbb R^m\times\Omega\to\mathbb Rh:Rm×Ω→R. The true problem (1.1) and the SAA problem (1.2) are

min⁡x∈Θf(x):=EP h(x,ω),min⁡x∈Θf^N(x):=1N∑j=1Nh(x,ωj),\min_{x\in\Theta} f(x):=\mathbb E_P\,h(x,\omega),\qquad \min_{x\in\Theta}\hat f_N(x):=\frac1N\sum_{j=1}^N h(x,\omega^j),x∈Θmin​f(x):=EP​h(x,ω),x∈Θmin​f^​N​(x):=N1​j=1∑N​h(x,ωj),

where ω1,ω2,…\omega^1,\omega^2,\dotsω1,ω2,… is one i.i.d. sequence with law PPP, defined on an auxiliary probability space (S,Q)(S,Q)(S,Q). Write AAA for the set of optimal solutions of the true problem and ANA_NAN​ for that of the SAA problem. ANA_NAN​ depends on the sample path, and either set may be empty.

The standing assumptions of Theorem 2.3 are:

  1. Ω\OmegaΩ is finite;
  2. every h(⋅,ω)h(\cdot,\omega)h(⋅,ω) is piecewise linear and convex, i.e. a maximum of finitely many affine functions;
  3. Θ\ThetaΘ is closed, convex and polyhedral, i.e. a finite intersection of closed half-spaces;
  4. AAA is nonempty and bounded.

A subset FFF of a convex set AAA is a face of AAA if FFF is convex and every open segment of AAA that meets FFF lies in FFF. The event of interest is

MN:={ AN is nonempty and forms a face of A }.(3.16)\mathcal M_N:=\{\,A_N\text{ is nonempty and forms a face of }A\,\}.\tag{3.16}MN​:={AN​ is nonempty and forms a face of A}.(3.16)

Formalization targets

Goal: Theorem 3.2

Under assumptions 1–4 there is β>0\beta>0β>0 with

lim sup⁡N→∞1Nlog⁡Q(MNc)≤−β.(3.17)\limsup_{N\to\infty}\frac1N\log Q(\mathcal M_N^c)\le-\beta .\tag{3.17}N→∞limsup​N1​logQ(MNc​)≤−β.(3.17)

The constant β\betaβ is not specified; the goal asserts only that the failure probability decays exponentially.

Companion: Theorem 2.3

Under the same assumptions, AAA is compact, convex and polyhedral, and with probability one ANA_NAN​ is a nonempty face of AAA for all NNN large enough.

Milestones

The milestones are the three parts of Lemma 2.4 (p. 6) and the two steps of the proof of Theorem 3.2 (pp. 12–13).

  1. (a) Finitely many points carry all subdifferentials of fff and of f^N\hat f_Nf^​N​.
  2. (b) The subdifferentials ∂f^N(x)\partial\hat f_N(x)∂f^​N​(x) converge to ∂f(x)\partial f(x)∂f(x) uniformly in xxx, almost surely.
  3. (c) There are finitely many sample-independent points x1,…,xqx_1,\dots,x_qx1​,…,xq​, the first ℓ\ellℓ being the extreme points of AAA, such that f^N(xi)<f^N(xj)\hat f_N(x_i)<\hat f_N(x_j)f^​N​(xi​)<f^​N​(xj​) for all i≤ℓ<ji\le\ell<ji≤ℓ<j forces MN\mathcal M_NMN​.
  4. Union bound. Q(MNc)Q(\mathcal M_N^c)Q(MNc​) is at most a finite sum of one-point deviation probabilities.
  5. One-point deviations. Each such probability decays exponentially.

Significance

The result explains the observed behaviour of SAA on two-stage linear programs with discrete distributions. For a fixed problem, the sample size needed to recover an optimal face of the true problem with a prescribed probability grows only logarithmically in the inverse failure probability. When the true optimum is not unique, the theorem still gives a structural guarantee: every SAA optimal solution is optimal for the true problem, and every vertex of ANA_NAN​ is a vertex of AAA. Theorem 2.3 is the almost-sure consequence, by Borel–Cantelli.

The results are proved in the paper; none of them has a machine-checked proof that we know of. Formalizing them requires a library of polyhedral convex analysis that Mathlib lacks: the cell decomposition of a piecewise linear function, faces of polyhedra, and finiteness of the set of extreme points. It also requires one-dimensional exponential tail bounds for empirical means of finite-valued variables. The mission makes precise one point the paper leaves implicit. The paper first reduces to the unconstrained case by an exact penalty, and the strict gap f(xi)<f(xj)f(x_i)<f(x_j)f(xi​)<f(xj​) recalled on p. 12 holds for the penalized function. For the original fff the lemma is stated with ℓ≤q\ell\le qℓ≤q instead of the printed ℓ<q\ell<qℓ<q.

Difficulty

The probabilistic part is routine. Once Lemma 2.4 (c) is available, the event MNc\mathcal M_N^cMNc​ lies in a finite union of events, each a deviation of one real sample mean from its expectation, and each of those decays exponentially. The difficulty is the deterministic Lemma 2.4 (c). Its points x1,…,xqx_1,\dots,x_qx1​,…,xq​ must be independent of the sample. The argument that all h(⋅,ω)h(\cdot,\omega)h(⋅,ω), and hence every f^N\hat f_Nf^​N​, are affine wherever fff is affine needs every scenario to have positive mass. Passing from local information near AAA to global optimality of ANA_NAN​ uses convexity on a polyhedral neighbourhood of AAA built from finitely many cells. The natural first idea, uniform convergence of f^N\hat f_Nf^​N​ to fff on a compact set, gives only that ANA_NAN​ approaches AAA, not that AN⊆AA_N\subseteq AAN​⊆A, and certainly not that ANA_NAN​ is a face.

Formalization scope

  • Rm\mathbb R^mRm is EuclideanSpace ℝ (Fin m), and Ω\OmegaΩ is a Fintype with measurable singletons.
  • The sample is one sequence ω : ℕ → S → Ω of measurable, independent maps with law PPP; ω1,…,ωN\omega^1,\dots,\omega^Nω1,…,ωN are its first NNN terms. At N=0N=0N=0 the sample average is the junk value 000.
  • Optimal sets are defined directly as sets of minimizers, with no infimum.
  • Disclosed encodings:
    • "piecewise linear and convex" is a maximum of k+1≥1k+1\ge1k+1≥1 affine functions;
    • "polyhedral" is a finite intersection of closed half-spaces;
    • "face" is Convex ℝ F ∧ IsExtreme ℝ A F;
    • "the points form the set of extreme points of AAA" is an equality with Mathlib's Set.extremePoints.
  • Paper indices {1,…,ℓ}\{1,\dots,\ell\}{1,…,ℓ} and {ℓ+1,…,q}\{\ell+1,\dots,q\}{ℓ+1,…,q} become i.val < ℓ and ℓ ≤ j.val in Fin q.
  • Rates are stated in the form: for every δ>0\delta>0δ>0, eventually Q(⋅)≤e−(β−δ)NQ(\cdot)\le e^{-(\beta-\delta)N}Q(⋅)≤e−(β−δ)N. This is equivalent to the lim sup⁡\limsuplimsup form and avoids log⁡0\log 0log0. Failure events are measured by the outer measure QQQ.
  • Lemma 2.4 (a) and (c) assume P{ω}>0P\{\omega\}>0P{ω}>0 for every scenario, as p. 3 takes Ω\OmegaΩ to be the support. Theorems 2.3 and 3.2 do not need this.

The empty set is a face of every set, and so is AAA itself. MN\mathcal M_NMN​ therefore carries nonemptiness explicitly, and "face" is not weakened to AN⊆AA_N\subseteq AAN​⊆A. Lemma 2.4 (c) also carries the gap f(xi)<f(xj)f(x_i)<f(x_j)f(xi​)<f(xj​): without it, repeating an extreme point among the xjx_jxj​ would make (2.13) unsatisfiable and the lemma empty.

The subdifferential is the published ShorNonsmooth.Subdiff.subdifferential with domain Rm\mathbb R^mRm. Contributions are welcome in three areas: polyhedral convex analysis (cells of a piecewise linear convex function, faces and extreme points of polytopes, exact penalties); Hoeffding or Cramér bounds for i.i.d. bounded means; and proofs of the milestones in any order. The polyhedral lemmas are reusable well beyond this mission.

Selected references

  • A. Shapiro and T. Homem-de-Mello, On the rate of convergence of optimal solutions of Monte Carlo approximations of stochastic programs, SIAM J. Optim. 11(1):70–86, 2000. https://doi.org/10.1137/S1052623498349541
  • A. J. Kleywegt, A. Shapiro and T. Homem-de-Mello, The sample average approximation method for stochastic discrete optimization, SIAM J. Optim. 12(2):479–502, 2002. https://doi.org/10.1137/S1052623499363220
  • A. Shapiro, T. Homem-de-Mello and J. Kim, Conditioning of convex piecewise linear stochastic programs, Math. Program. 94:1–19, 2002. https://doi.org/10.1007/s10107-002-0313-4
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970. https://doi.org/10.1515/9781400873173
  • A. Dembo and O. Zeitouni, Large Deviations Techniques and Applications, 2nd ed., Springer, 1998. https://doi.org/10.1007/978-1-4612-5320-4
10 thms1 active userReviewed
Markov ChainReinforcement LearningStochastic Systems·Captain: mikedeng1

On Actor-Critic Algorithms: Convergence of Actor-Critic Algorithms with TD(1) and TD(λ) Critics on Finite MDPsResearch Paper

Motivation

Reinforcement-learning methods for Markov decision processes split into critic-only methods, which learn an approximate value function and act greedily with respect to it, and actor-only methods, which adjust a parameterized policy along a simulated estimate of the gradient of its performance. Critic-only methods with function approximation can fail to converge; actor-only gradient estimates have high variance. Actor–critic methods combine the two: a critic learns, by temporal-difference (TD) learning, just enough about the value function to give the actor a low-variance gradient direction.

Konda and Tsitsiklis (SIAM J. Control Optim. 42 (2003)) gave the first convergence proof for actor–critic algorithms whose critic uses linear function approximation. Their key observation, found independently by Sutton, McAllester, Singh and Mansour (NIPS 1999), is that the critic need not approximate the value function: it suffices to compute its projection onto a low-dimensional subspace spanned by features determined by the policy parameterization. Earlier convergence results (Konda and Borkar, 1999) covered lookup-table representations only. Actor–critic algorithms, in many later variants, are now a standard tool of reinforcement learning, and this paper is the reference for their asymptotic analysis in the average-cost setting.

Setting

A finite cost MDP consists of finite sets X\mathbb XX (states) and U\mathbb UU (actions), transition probabilities p(y∣x,u)p(y\mid x,u)p(y∣x,u) and a one-stage cost c(x,u)∈Rc(x,u)\in\mathbb Rc(x,u)∈R. A randomized stationary policy with parameter θ∈Rn\theta\in\mathbb R^nθ∈Rn chooses action uuu in state xxx with probability μθ(u∣x)\mu_\theta(u\mid x)μθ​(u∣x). Under the policy θ\thetaθ, the states {Xk}\{X_k\}{Xk​} form a Markov chain with transition matrix P(θ)xy=∑uμθ(u∣x)p(y∣x,u)P(\theta)_{xy}=\sum_u\mu_\theta(u\mid x)p(y\mid x,u)P(θ)xy​=∑u​μθ​(u∣x)p(y∣x,u), and the pairs {Xk,Uk}\{X_k,U_k\}{Xk​,Uk​} a chain with matrix PθP_\thetaPθ​. When these chains are irreducible and aperiodic, πθ\pi_\thetaπθ​ denotes the stationary law of {Xk}\{X_k\}{Xk​}, ηθ(x,u)=πθ(x)μθ(u∣x)\eta_\theta(x,u)=\pi_\theta(x)\mu_\theta(u\mid x)ηθ​(x,u)=πθ​(x)μθ​(u∣x), and the average cost is

αˉ(θ)=∑x,uc(x,u) ηθ(x,u).\bar\alpha(\theta)=\sum_{x,u}c(x,u)\,\eta_\theta(x,u).αˉ(θ)=x,u∑​c(x,u)ηθ​(x,u).

The score is ψθ(x,u)=∇ln⁡μθ(u∣x)∈Rn\psi_\theta(x,u)=\nabla\ln\mu_\theta(u\mid x)\in\mathbb R^nψθ​(x,u)=∇lnμθ​(u∣x)∈Rn, and ⟨f,g⟩θ=∑x,uηθ(x,u)f(x,u)g(x,u)\langle f,g\rangle_\theta=\sum_{x,u}\eta_\theta(x,u)f(x,u)g(x,u)⟨f,g⟩θ​=∑x,u​ηθ​(x,u)f(x,u)g(x,u).

The critic approximates Q-values by r′ϕθ(x,u)r'\phi_\theta(x,u)r′ϕθ​(x,u) with features ϕθ(x,u)∈Rm\phi_\theta(x,u)\in\mathbb R^mϕθ​(x,u)∈Rm whose span contains the components of ψθ\psi_\thetaψθ​. Along one simulated trajectory (X^k,U^k)(\hat X_k,\hat U_k)(X^k​,U^k​), where U^k+1\hat U_{k+1}U^k+1​ is drawn from μθk(⋅∣X^k+1)\mu_{\theta_k}(\cdot\mid\hat X_{k+1})μθk​​(⋅∣X^k+1​), the algorithm updates an average-cost estimate αk\alpha_kαk​, the critic parameter rkr_krk​ and an eligibility trace Z^k\hat Z_kZ^k​ at step size γk\gamma_kγk​ (equation (3.1)), and the actor parameter by

θk+1=θk−βkΓ(rk) rk′ϕθk(X^k+1,U^k+1) ψθk(X^k+1,U^k+1)(3.2)\theta_{k+1}=\theta_k-\beta_k\Gamma(r_k)\,r_k'\phi_{\theta_k}(\hat X_{k+1},\hat U_{k+1})\,\psi_{\theta_k}(\hat X_{k+1},\hat U_{k+1})\qquad(3.2)θk+1​=θk​−βk​Γ(rk​)rk′​ϕθk​​(X^k+1​,U^k+1​)ψθk​​(X^k+1​,U^k+1​)(3.2)

at a slower step size βk\beta_kβk​. The TD(1) critic resets its trace when the state x∗x^*x∗ is entered; the TD(λ\lambdaλ) critic discounts it by λ∈(0,1)\lambda\in(0,1)λ∈(0,1).

Formalization targets

Goal: Theorem 3.4

Under Assumptions 2.1 (positive, smooth policies; irreducible aperiodic chains; uniform reachability of x∗x^*x∗), 3.1–3.2 (bounded smooth features spanning the scores, uniformly nondegenerate) and 3.3 (two-time-scale step sizes and the scaling Γ\GammaΓ),

(a) TD(1):  lim inf⁡k∣∇αˉ(θk)∣=0  w.p.1;(b) ∀ϵ>0 ∃λˉ<1 ∀λ∈[λˉ,1): lim inf⁡k∣∇αˉ(θk)∣<ϵ  w.p.1.\text{(a) TD(1): }\ \liminf_k|\nabla\bar\alpha(\theta_k)|=0\ \text{ w.p.1};\qquad \text{(b) }\forall\epsilon>0\ \exists\bar\lambda<1\ \forall\lambda\in[\bar\lambda,1):\ \liminf_k|\nabla\bar\alpha(\theta_k)|<\epsilon\ \text{ w.p.1}.(a) TD(1):  kliminf​∣∇αˉ(θk​)∣=0  w.p.1;(b) ∀ϵ>0 ∃λˉ<1 ∀λ∈[λˉ,1): kliminf​∣∇αˉ(θk​)∣<ϵ  w.p.1.

The statement leaves the initial parameters and the initial state–action law arbitrary.

Milestones

In attack order: the gradient formula ∇αˉ(θ)=⟨ψθ,Qθ⟩θ\nabla\bar\alpha(\theta)=\langle\psi_\theta,Q_\theta\rangle_\theta∇αˉ(θ)=⟨ψθ​,Qθ​⟩θ​ for every Poisson solution, with bounded Hessian (Theorem 4.6); boundedness of the regenerative quantities (Lemma 5.1) and of the trace moments (Lemma 5.2); uniform positive definiteness of the critic's mean matrix Gˉ(θ)\bar G(\theta)Gˉ(θ) for TD(1) and TD(λ\lambdaλ) (Lemmas 5.3, 5.6); critic tracking, ∣Gˉ(θk)Rk−hˉ(θk)∣→0|\bar G(\theta_k)R_k-\bar h(\theta_k)|\to0∣Gˉ(θk​)Rk​−hˉ(θk​)∣→0 (Theorem 5.7); the bias of the actor direction, sup⁡θ∣f(θ)−∇αˉ(θ)∣≤C(1−λ)\sup_\theta|f(\theta)-\nabla\bar\alpha(\theta)|\le C(1-\lambda)supθ​∣f(θ)−∇αˉ(θ)∣≤C(1−λ) (Lemma 6.1); the descent inequality (6.1); and the convergence of the noise terms (Lemma 6.2).

Significance

The theorem says that a policy-gradient method whose gradient is estimated by a linearly parameterized TD critic, rather than by Monte Carlo returns, still converges to a stationary point of the average cost (exactly for TD(1), approximately for TD(λ\lambdaλ)). It justifies the compatible features principle (the critic's features must span the score functions), the two-time-scale step-size design, and the trade-off in λ\lambdaλ between variance and bias of the actor direction. The intermediate results are of independent use: Theorem 4.6 is the average-cost policy-gradient theorem for arbitrary Poisson solutions, and Theorem 5.7 is a tracking result for linear stochastic approximation driven by a Markov chain whose kernel changes slowly.

The result is proved in the paper, but the proofs of Theorem 4.6, of parts of the verification of the stochastic-approximation hypotheses and of Theorem 6.3 are given as outlines, with details deferred to a separate appendix and to Theorem A.7, recalled from another paper. No machine-checked proof of the theorem, or of the convergence of any actor–critic method, is known. The mission asks for a formal proof of the finite-case theorem and its milestones, which fills in the outlined steps. The finite-case gradient formula of §2 (Theorem 2.2, recalled from Marbach and Tsitsiklis) is posed, unproved, elsewhere on the platform in a reward-MDP form; it is a special case of milestone Theorem 4.6.

Difficulty

The obvious argument treats the actor as a stochastic gradient method with a noisy gradient estimate. It fails at the first step: the critic's estimate rk′ϕθkr_k'\phi_{\theta_k}rk′​ϕθk​​ is biased at every finite time, and the bias does not vanish unless the critic converges, while the critic's target rˉ(θk)\bar r(\theta_k)rˉ(θk​) moves with the actor. The noise is Markovian, generated by a chain whose transition kernel depends on the current parameter, not a martingale difference sequence. Making the two time scales interact correctly requires a Poisson-equation decomposition of the Markov noise that is uniform in θ\thetaθ, together with moment bounds for the eligibility trace, which for TD(1) is an unbounded sum over a regeneration cycle. Uniformity in θ\thetaθ is essential, because the actor iterates θk\theta_kθk​ are not assumed to stay in a bounded set.

Formalization scope

State and action sets are finite types; parameters live in EuclideanSpace ℝ (Fin n) and EuclideanSpace ℝ (Fin m), so ∣⋅∣|\cdot|∣⋅∣ is the Euclidean norm and Mathlib's gradient is ∇\nabla∇. The transition probability p(y∣x,u)p(y\mid x,u)p(y∣x,u) is stored as p x u y. πθ\pi_\thetaπθ​ is a stationary probability vector of P(θ)P(\theta)P(θ), unique under Assumption 2.1(c). The law of the simulated path is built on (X×U)N(\mathbb X\times\mathbb U)^{\mathbb N}(X×U)N by the Ionescu-Tulcea construction (Kernel.trajMeasure), with the next action drawn under the actor parameter that the recursion computes from the history; nothing about the critic or the actor's behaviour is assumed.

Readings and corrections, each also recorded in the affected items:

  • Assumption 3.3(b) is corrected. The printed ∣r∣Γ(r)∈[C1,C2]|r|\Gamma(r)\in[C_1,C_2]∣r∣Γ(r)∈[C1​,C2​] for all rrr is unsatisfiable at r=0r=0r=0 and would make the theorem vacuous; it is formalized as (1+∣r∣)Γ(r)∈[C1,C2](1+|r|)\Gamma(r)\in[C_1,C_2](1+∣r∣)Γ(r)∈[C1​,C2​], which Γ(r)=1/(1+∣r∣)\Gamma(r)=1/(1+|r|)Γ(r)=1/(1+∣r∣) satisfies. The second inequality of (3.3) is quantified over Rm\mathbb R^mRm, the domain of Γ\GammaΓ, not the printed Rn\mathbb R^nRn.
  • Assumption 4.9 (the features have zero mean under μθ(⋅∣x∗)\mu_\theta(\cdot\mid x^*)μθ​(⋅∣x∗)) is added to part (a), and to the TD(1) cases of Theorem 5.7 and Lemma 6.2: the TD(1) analysis uses it and Theorem 6.3 assumes it, though Theorem 3.4 does not list it.
  • "λ\lambdaλ sufficiently close to 1" means: some λˉ<1\bar\lambda<1λˉ<1 such that all λ∈[λˉ,1)\lambda\in[\bar\lambda,1)λ∈[λˉ,1) work.
  • The α\alphaα-update of (3.1) uses c(X^k+1,U^k+1)c(\hat X_{k+1},\hat U_{k+1})c(X^k+1​,U^k+1​) as printed.
  • In (6.1), Γ(rˉ(θ))\Gamma(\bar r(\theta))Γ(rˉ(θ)) is read as Γ(rˉ(θk))\Gamma(\bar r(\theta_k))Γ(rˉ(θk​)).
  • The matrix ⟨Pθk+1ϕθ,ϕθ′⟩θ\langle P_\theta^{k+1}\phi_\theta,\phi_\theta'\rangle_\theta⟨Pθk+1​ϕθ​,ϕθ′​⟩θ​ in the TD(λ\lambdaλ) Gˉ1\bar G_1Gˉ1​ is oriented so that Gˉ1\bar G_1Gˉ1​ is the steady-state mean of the critic's update matrix.
  • Results stated in the paper for Polish spaces (Theorems 4.6, 5.7) are stated under the finite assumptions that the paper says imply them; "w.p.1" in Theorem 5.7 is made explicit.

The lim inf⁡\liminfliminf is taken in [0,∞][0,\infty][0,∞], so a sequence with ∣∇αˉ(θk)∣→∞|\nabla\bar\alpha(\theta_k)|\to\infty∣∇αˉ(θk​)∣→∞ cannot satisfy the conclusion through a junk value, and differentiability of αˉ\bar\alphaαˉ is part of the conclusion, so the statement cannot hold because Lean's gradient returns 000 at non-differentiable points. Series (tsum) and matrix inverses in the milestone objects converge, respectively are invertible, under the assumptions. The hypotheses are satisfiable: Γ(r)=1/(1+∣r∣)\Gamma(r)=1/(1+|r|)Γ(r)=1/(1+∣r∣), βk=(k+1)−1\beta_k=(k+1)^{-1}βk​=(k+1)−1, γk=(k+1)−2/3\gamma_k=(k+1)^{-2/3}γk​=(k+1)−2/3 and the features ϕθ=ψθ\phi_\theta=\psi_\thetaϕθ​=ψθ​ (which satisfy Assumption 4.9 at every state) meet the parts that could be in doubt.

A complete development needs finite Markov-chain theory uniform in a parameter (existence, uniqueness and smooth dependence of stationary laws; geometric ergodicity; Poisson equations; regeneration), differentiation of θ↦πθ\theta\mapsto\pi_\thetaθ↦πθ​, almost-sure convergence of linear stochastic approximation with Markov noise, and martingale convergence. The Markov-chain and stochastic-approximation parts are reusable well beyond this mission. Contributions of proofs of any milestone, of auxiliary lemmas on parameterized finite Markov chains, and of the general two-time-scale tracking theorem (the paper's Theorem A.7) are welcome.

Selected references

  • V. R. Konda and J. N. Tsitsiklis, On Actor-Critic Algorithms, SIAM J. Control Optim. 42(4), 1143–1166, 2003. https://doi.org/10.1137/S0363012901385691
  • R. S. Sutton, D. McAllester, S. Singh and Y. Mansour, Policy Gradient Methods for Reinforcement Learning with Function Approximation, NIPS 12, 2000. https://papers.nips.cc/paper/1713-policy-gradient-methods-for-reinforcement-learning-with-function-approximation
  • V. R. Konda and V. S. Borkar, Actor-Critic–Type Learning Algorithms for Markov Decision Processes, SIAM J. Control Optim. 38(1), 94–123, 1999. https://doi.org/10.1137/S036301299731669X
  • J. N. Tsitsiklis and B. Van Roy, Average Cost Temporal-Difference Learning, Automatica 35(11), 1799–1808, 1999. https://doi.org/10.1016/S0005-1098(99)00099-0
  • P. Marbach and J. N. Tsitsiklis, Simulation-Based Optimization of Markov Reward Processes, IEEE Trans. Automat. Control 46(2), 191–209, 2001. https://doi.org/10.1109/9.905687
14 thms1 active userReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Is Network Traffic Approximated by Stable Lévy Motion or Fractional Brownian Motion? 2: Superposed ON/OFF Input Under Slow Growth Converges (fidi) to α-Stable Lévy MotionResearch Paper

Motivation

Measurements of Ethernet and Web traffic in the 1990s showed burstiness at every time scale, long-range dependence, and file sizes and transmission times with tails like x−αx^{-\alpha}x−α, 1<α<21<\alpha<21<α<2 (Leland, Taqqu, Willinger and Wilson, 1994; Crovella and Bestavros, 1997). The standard explanation models each user as an ON/OFF source that alternates between transmitting at unit rate and staying silent, with heavy-tailed period lengths. Many such sources are superposed and time is rescaled. Taqqu, Willinger and Sherman (1997) showed that the limit is fractional Brownian motion when the number of sources is sent to infinity first. That limit is the basis of Gaussian queueing models of network buffers.

Mikosch, Resnick, Rootzén and Stegeman (2002) asked what happens when the number of sources MMM and the time scale TTT grow together. The answer depends on how fast M=M(T)M=M(T)M=M(T) grows. Under fast growth the limit is fractional Brownian motion; this is Theorem 4 of the paper and a separate mission. Under slow growth the limit is an α-stable Lévy motion: it has independent increments and infinite variance, and its sample paths jump. This mission formalizes the slow growth result, Theorem 2. The two answers lead to different buffer and dimensioning models, so the dichotomy matters for traffic engineering.

Setting

Period laws. ON-periods have law FonF_{\mathrm{on}}Fon​ and OFF-periods have law FoffF_{\mathrm{off}}Foff​; both are laws of non-negative random variables. Their means are μon\mu_{\mathrm{on}}μon​ and μoff\mu_{\mathrm{off}}μoff​, and μ=μon+μoff\mu=\mu_{\mathrm{on}}+\mu_{\mathrm{off}}μ=μon​+μoff​. Their right tails Fˉ=1−F\bar F=1-FFˉ=1−F satisfy (2.1)–(2.2):

Fˉon(x)=x−αLon(x),Fˉoff(x)=x−αoffLoff(x),1<α<αoff<2,\bar F_{\mathrm{on}}(x)=x^{-\alpha}L_{\mathrm{on}}(x),\qquad \bar F_{\mathrm{off}}(x)=x^{-\alpha_{\mathrm{off}}}L_{\mathrm{off}}(x),\qquad 1<\alpha<\alpha_{\mathrm{off}}<2,Fˉon​(x)=x−αLon​(x),Fˉoff​(x)=x−αoff​Loff​(x),1<α<αoff​<2,

where LonL_{\mathrm{on}}Lon​ and LoffL_{\mathrm{off}}Loff​ are slowly varying: L(cx)/L(x)→1L(cx)/L(x)\to1L(cx)/L(x)→1 for every c>0c>0c>0. The ON-periods therefore have the heavier tail.

One source. Let X1,X2,…X_1,X_2,\dotsX1​,X2​,… be iid FonF_{\mathrm{on}}Fon​ and Yoff,Y1,Y2,…Y_{\mathrm{off}},Y_1,Y_2,\dotsYoff​,Y1​,Y2​,… iid FoffF_{\mathrm{off}}Foff​. Let BBB be Bernoulli with P(B=1)=μon/μP(B=1)=\mu_{\mathrm{on}}/\muP(B=1)=μon​/μ. Let Xon(0)X^{(0)}_{\mathrm{on}}Xon(0)​ and Yoff(0)Y^{(0)}_{\mathrm{off}}Yoff(0)​ have the integrated-tail laws F(0)(x)=μF−1∫0xFˉ(s) dsF^{(0)}(x)=\mu_F^{-1}\int_0^x\bar F(s)\,dsF(0)(x)=μF−1​∫0x​Fˉ(s)ds. All of these variables are independent. Put Zi=Xi+YiZ_i=X_i+Y_iZi​=Xi​+Yi​. The delay is T0=B(Xon(0)+Yoff)+(1−B)Yoff(0)T_0=B(X^{(0)}_{\mathrm{on}}+Y_{\mathrm{off}})+(1-B)Y^{(0)}_{\mathrm{off}}T0​=B(Xon(0)​+Yoff​)+(1−B)Yoff(0)​, and the renewal epochs are Tn=T0+∑i=1nZiT_n=T_0+\sum_{i=1}^nZ_iTn​=T0​+∑i=1n​Zi​. The source is ON at time ttt when

Wt=B 1[0,Xon(0))(t)+∑n≥01[Tn,Tn+Xn+1)(t)=1.W_t=B\,\mathbf 1_{[0,X^{(0)}_{\mathrm{on}})}(t)+\sum_{n\ge0}\mathbf 1_{[T_n,T_n+X_{n+1})}(t)=1 .Wt​=B1[0,Xon(0)​)​(t)+n≥0∑​1[Tn​,Tn​+Xn+1​)​(t)=1.

This construction makes WWW stationary.

Superposition. MMM iid sources W(1),…,W(M)W^{(1)},\dots,W^{(M)}W(1),…,W(M) feed a server. N(t)=∑mWt(m)N(t)=\sum_mW^{(m)}_tN(t)=∑m​Wt(m)​ is the number of active sources, and A(t)=∫0tN(s) dsA(t)=\int_0^tN(s)\,dsA(t)=∫0t​N(s)ds is the cumulative input; its mean is EA(t)=Mμ−1μontEA(t)=M\mu^{-1}\mu_{\mathrm{on}}tEA(t)=Mμ−1μon​t.

Growth. b(t)=(1/Fˉon)←(t)b(t)=(1/\bar F_{\mathrm{on}})^{\leftarrow}(t)b(t)=(1/Fˉon​)←(t) is the quantile function (2.9). M=M(T)M=M(T)M=M(T) is integer valued, non-decreasing and tends to infinity. Slow Growth Condition 1 is b(MT)/T→0b(MT)/T\to0b(MT)/T→0.

Stable laws. Sα(σ,β,μ)S_\alpha(\sigma,\beta,\mu)Sα​(σ,β,μ) is the law with characteristic function exp⁡{−σα∣θ∣α(1−iβ sign(θ)tan⁡πα2)+iμθ}\exp\{-\sigma^\alpha|\theta|^\alpha(1-i\beta\,\mathrm{sign}(\theta)\tan\frac{\pi\alpha}2)+i\mu\theta\}exp{−σα∣θ∣α(1−iβsign(θ)tan2πα​)+iμθ} for α≠1\alpha\neq1α=1. The α-stable Lévy motion Xα,σ,βX_{\alpha,\sigma,\beta}Xα,σ,β​ has independent stationary increments, and X(t)∼Sα(σt1/α,β,0)X(t)\sim S_\alpha(\sigma t^{1/\alpha},\beta,0)X(t)∼Sα​(σt1/α,β,0).

Formalization targets

Goal: Theorem 2 (p. 40)

With Cα=1−αΓ(2−α)cos⁡(πα/2)C_\alpha=\dfrac{1-\alpha}{\Gamma(2-\alpha)\cos(\pi\alpha/2)}Cα​=Γ(2−α)cos(πα/2)1−α​, σ=Cα−1/α\sigma=C_\alpha^{-1/\alpha}σ=Cα−1/α​ and c=μoff/μ1+1/αc=\mu_{\mathrm{off}}/\mu^{1+1/\alpha}c=μoff​/μ1+1/α, under Condition 1

A(T⋅)−TMμ−1μon(⋅)b(MT)→ fidi c Xα,σ,1(⋅).\frac{A(T\cdot)-TM\mu^{-1}\mu_{\mathrm{on}}(\cdot)}{b(MT)}\xrightarrow{\ fidi\ }c\,X_{\alpha,\sigma,1}(\cdot).b(MT)A(T⋅)−TMμ−1μon​(⋅)​ fidi ​cXα,σ,1​(⋅).

Every constant is stated as printed. The normalisation is the paper's b(MT)b(MT)b(MT) and the limit is the totally skewed (β=1\beta=1β=1) Lévy motion.

Milestones (§5, in the order of the proof)

  • Lemmas 3 and 6: the initial ON-periods (A1A_1A1​) and the overshoots beyond TTT (A3A_3A3​) are negligible at scale b(MT)b(MT)b(MT).
  • Lemmas 4 and 5: the per-source renewal count ξT\xi_TξT​ concentrates around μT=T/μ\mu_T=T/\muμT​=T/μ with probability 1−o(1/M)1-o(1/M)1−o(1/M), plus a truncated-overshoot bound.
  • Lemmas 7, 8 and 9: the left tails of the centred sums Sn=∑k≤nJkS_n=\sum_{k\le n}J_kSn​=∑k≤n​Jk​ are negligible, and replacing ξT\xi_TξT​ by [μT][\mu_T][μT​] is harmless. Here Jk=ron(Xk−μon)−roff(Yk−μoff)J_k=r_{\mathrm{on}}(X_k-\mu_{\mathrm{on}})-r_{\mathrm{off}}(Y_k-\mu_{\mathrm{off}})Jk​=ron​(Xk​−μon​)−roff​(Yk​−μoff​).
  • Lemma 10: [b(MT)]−1A21→cXα,σ,1(1)[b(MT)]^{-1}A_{21}\to cX_{\alpha,\sigma,1}(1)[b(MT)]−1A21​→cXα,σ,1​(1) in distribution.
  • Lemmas 11 and 12: tails of linear combinations of increments, and the two-dimensional limit.

Significance

Theorem 2 identifies the limit regime where the Gaussian heavy-traffic picture fails for ON/OFF traffic. When few sources are observed over long horizons, the aggregate input has infinite-variance, independent-increment fluctuations of size b(MT)≈(MT)1/αb(MT)\approx(MT)^{1/\alpha}b(MT)≈(MT)1/α. Read together with Theorem 4, the result says the growth rate of MMM relative to TTT decides between the two classical models of network input. The proof turns the ON/OFF superposition into row-wise iid random sums and uses a heavy-tailed large-deviation estimate for random walks (Cline and Hsing). That technique carries over to other renewal-reward processes with regularly varying rewards.

The result is proved in the paper. No machine-checked version exists, either of the theorem or of the probabilistic substrate it rests on. Formalization would produce:

  • a stationary alternating renewal process in Lean;
  • a usable notion of regular variation with the quantile function bbb;
  • stable laws given by characteristic functions;
  • the infinitely divisible convergence criterion (Petrov's conditions (A)–(C)) that the proof cites for row-wise iid sums.

Correction. Lemma 12 as printed omits the normalisation [b(MT)]−1[b(MT)]^{-1}[b(MT)]−1 on its left-hand side. Its proof and its use in Theorem 2 both have it, and without it the claim fails because the left-hand side grows. The mission states Lemma 12 with the normalisation. Lemma 11's upper summation limits μTt\mu_{Tt}μTt​ are read as integer parts, as elsewhere in §5.

Difficulty

The natural first idea is to treat A(T)A(T)A(T) as a sum of MMM iid terms and apply the stable central limit theorem for triangular arrays. This fails as stated: each source's contribution A(m)(T)A^{(m)}(T)A(m)(T) is itself a random sum ∑k≤ξTXk\sum_{k\le\xi_T}X_k∑k≤ξT​​Xk​, and its count ξT\xi_TξT​ depends strongly on the XkX_kXk​. Moreover, MMM grows too slowly for a law-of-large-numbers smoothing across sources. The count must be replaced by its mean simultaneously for all MMM sources, with an error probability o(1/M)o(1/M)o(1/M), uniformly as T→∞T\to\inftyT→∞. This requires the two-sided large-deviation estimate of Lemma 4. Its lower tail rests on the Cline–Hsing asymptotics P(Sn>x)∼nFˉ(x)P(S_n>x)\sim n\bar F(x)P(Sn​>x)∼nFˉ(x) for heavy-tailed random walks; its upper tail rests on a Cramér bound. Then Petrov's conditions must be checked at the exact scale b(MT)b(MT)b(MT). That needs Potter bounds for the slowly varying factors and a non-uniform Berry–Esseen estimate for the truncated sums. None of these tools is in Mathlib.

Formalization scope

All declarations are in the namespace NetTraffic.OnOffStable, in one definitions file.

Conventions.

  • Each time scale TTT has its own probability space (ΩT,PT)(\Omega_T,P_T)(ΩT​,PT​), which carries M(T)M(T)M(T) independent sources indexed 0,…,M(T)−10,\dots,M(T)-10,…,M(T)−1. Only laws matter, and the statements quantify over every such family.
  • Lean's X n and Y n are the paper's Xn+1X_{n+1}Xn+1​ and Yn+1Y_{n+1}Yn+1​.
  • ξT\xi_TξT​ is a Set.ncard (junk 000 on a null event). WWW is a tsum of indicators, and AAA is an interval integral.
  • b(t)=inf⁡{x>0:tFˉon(x)≤1}b(t)=\inf\{x>0:t\bar F_{\mathrm{on}}(x)\le1\}b(t)=inf{x>0:tFˉon​(x)≤1}. This set is non-empty for t>0t>0t>0, so bbb is never the junk value 000, and b(MT)/T→0b(MT)/T\to0b(MT)/T→0 is a real condition.
  • Lon(x)=xαFˉon(x)L_{\mathrm{on}}(x)=x^\alpha\bar F_{\mathrm{on}}(x)Lon​(x)=xαFˉon​(x) is assumed slowly varying, which is equivalent to (2.1).
  • Fidi convergence is stated with sorted times: for each kkk there is a probability measure on EuclideanSpace ℝ (Fin k) whose characteristic function is that of c(X(t1),…,X(tk))c(X(t_1),\dots,X(t_k))c(X(t1​),…,X(tk​)), and the laws of the normalised input vectors converge weakly to it. The characteristic function pins the limit down. Its existence is part of the claim, because Mathlib has no stable laws.
  • Convergence in probability means PT(∣YT∣>η)→0P_T(|Y_T|>\eta)\to0PT​(∣YT​∣>η)→0 for every η>0\eta>0η>0.
  • The lemmas that use EA3EA_3EA3​ and EXξT1[⋅]E X_{\xi_T}\mathbf 1[\cdot]EXξT​​1[⋅] also assert integrability, so Bochner junk values cannot trivialise them.

Ruled out. None of the following is acceptable: an encoding in which bbb, NNN or AAA collapses to a junk value; a model hypothesis that no family satisfies (the period laws must be genuine probability laws with finite means, which holds because α>1\alpha>1α>1); a limit "law" not pinned by its characteristic function; or convergence of one-dimensional laws only.

Needed infrastructure.

  • Regular variation: Karamata's theorem and Potter bounds (Proposition 2, App. B).
  • Large deviations for heavy-tailed random walks (Corollary 1, App. A).
  • Renewal theory for delayed alternating renewal processes.
  • Stable laws and the convergence criterion for row-wise iid sums.

The regular-variation and stable-law layers are reusable well beyond this mission. Formalizations of any milestone, of those general tools, or of alternative proofs of the one-dimensional limit are welcome.

Selected references

  • T. Mikosch, S. Resnick, H. Rootzén and A. Stegeman, Is network traffic approximated by stable Lévy motion or fractional Brownian motion?, Ann. Appl. Probab. 12(1):23–68, 2002. https://doi.org/10.1214/aoap/1015961155
  • M. S. Taqqu, W. Willinger and R. Sherman, Proof of a fundamental result in self-similar traffic modeling, Computer Communication Review 27:5–23, 1997. https://doi.org/10.1145/251007.251012
  • W. E. Leland, M. S. Taqqu, W. Willinger and D. V. Wilson, On the self-similar nature of Ethernet traffic (extended version), IEEE/ACM Trans. Networking 2(1):1–15, 1994. https://doi.org/10.1109/90.282603
  • M. E. Crovella and A. Bestavros, Self-similarity in World Wide Web traffic: evidence and possible causes, IEEE/ACM Trans. Networking 5(6):835–846, 1997. https://doi.org/10.1109/90.650143
  • D. B. H. Cline and T. Hsing, Large deviation probabilities for sums of random variables with heavy or subexponential tails, Technical report, Texas A&M University, 1991.
  • G. Samorodnitsky and M. S. Taqqu, Stable Non-Gaussian Random Processes, Chapman and Hall, 1994. https://doi.org/10.1201/9780203738818
13 thms1 active userReviewed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Centralized and Competitive Inventory Models with Demand Substitution 1: The Competitive Substitution Game Has a Nash Equilibrium, Unique and Globally Stable When Substitution Rates Sum Below OneResearch Paper

Motivation

A retailer that carries several substitutable products, such as brands of the same item or sizes of the same garment, must choose stock levels before demand is known. When a product runs out, some of its customers buy another product instead. Inventory models with this demand substitution go back to McGillivray and Silver (1978, INFOR 16(1)) and Parlar and Goyal (1984). When the products are run by different firms, each firm's stock affects the demand its competitors see, and stocking becomes a game. Parlar (1988) proved existence and uniqueness of the equilibrium for two products; Lippman and McCardle (1997) treated a symmetric version of the game with an arbitrary number of firms.

Netessine and Rudi (SSRN 303779, working paper 2002; journal version in Operations Research 51(2), 2003) treat nnn products with a general joint demand distribution and general prices and costs, under both centralized and competitive management. This mission formalizes their analysis of the competitive game (§2.2): the first-order characterization of its Nash equilibria (Proposition 3) and the existence, uniqueness and global stability of the equilibrium (Proposition 4).

Setting

There are nnn products, indexed i=1,…,ni=1,\dots,ni=1,…,n, sold in a single period. Product iii is stocked at Qi≥0Q_i\ge0Qi​≥0 units at unit cost cic_ici​, sold at unit price rir_iri​, and leftovers are salvaged at sis_isi​, with ri>ci>si>0r_i>c_i>s_i>0ri​>ci​>si​>0. Write ui=ri−ciu_i=r_i-c_iui​=ri​−ci​ (underage cost) and oi=ci−sio_i=c_i-s_ioi​=ci​−si​ (overage cost).

The first-choice demand D=(D1,…,Dn)D=(D_1,\dots,D_n)D=(D1​,…,Dn​) is a random vector with a known continuous joint distribution with positive support. A fraction aij∈[0,1]a_{ij}\in[0,1]aij​∈[0,1] of the customers who want product iii and find it out of stock buy product jjj instead, with aii=0a_{ii}=0aii​=0 and ∑jaij<1\sum_{j}a_{ij}<1∑j​aij​<1 for every iii; a customer whose second choice is also out of stock is lost. The effective demand for product iii is

Dis=Di+∑j≠iaji (Dj−Qj)+,D^s_i = D_i + \sum_{j\neq i} a_{ji}\,(D_j-Q_j)^+ ,Dis​=Di​+j=i∑​aji​(Dj​−Qj​)+,

which depends on the other products' stocks Q−iQ_{-i}Q−i​ but not on QiQ_iQi​.

In the competitive model, firm iii chooses QiQ_iQi​ and earns the expected profit

πi(Qi,Q−i)=E[uiDis−ui(Dis−Qi)+−oi(Qi−Dis)+].(9)\pi_i(Q_i,Q_{-i}) = E\big[u_iD^s_i - u_i(D^s_i-Q_i)^+ - o_i(Q_i-D^s_i)^+\big]. \tag{9}πi​(Qi​,Q−i​)=E[ui​Dis​−ui​(Dis​−Qi​)+−oi​(Qi​−Dis​)+].(9)

A best response of firm iii to Q−iQ_{-i}Q−i​ is a stock Qi≥0Q_i\ge0Qi​≥0 maximizing πi(⋅,Q−i)\pi_i(\cdot,Q_{-i})πi​(⋅,Q−i​), and a Nash equilibrium is a stock vector from which no firm gains by deviating.

Formalization targets

Goal: Proposition 4

A Nash equilibrium exists, the equilibria are exactly the nonnegative solutions of the first-order conditions

Pr⁡(Di<Qi)−Pr⁡(Di<Qi<Dis)=uiui+oi,i=1,…,n,(10)\Pr(D_i<Q_i) - \Pr(D_i<Q_i<D^s_i) = \frac{u_i}{u_i+o_i},\qquad i=1,\dots,n, \tag{10}Pr(Di​<Qi​)−Pr(Di​<Qi​<Dis​)=ui​+oi​ui​​,i=1,…,n,(10)

and if either ∑iaij<1\sum_{i}a_{ij}<1∑i​aij​<1 for all jjj or ∑jaij<1\sum_{j}a_{ij}<1∑j​aij​<1 for all iii, the equilibrium QdQ^dQd is unique and globally stable: every sequence of simultaneous best responses started at any nonnegative stock vector converges to QdQ^dQd.

Milestones

  1. The derivative ∂πi/∂Qi=ui−(ui+oi)Pr⁡(Dis<Qi)\partial\pi_i/\partial Q_i = u_i-(u_i+o_i)\Pr(D^s_i<Q_i)∂πi​/∂Qi​=ui​−(ui​+oi​)Pr(Dis​<Qi​) (p. 8).
  2. Concavity of πi\pi_iπi​ in QiQ_iQi​ (p. 8).
  3. Proposition 3: a nonnegative stock vector is a Nash equilibrium if and only if it satisfies (10) (p. 8).
  4. Each best response is unique and is characterized by (10) (proof of Proposition 4, p. 9).
  5. The best response of firm iii is nonincreasing in the rivals' stocks, with slope in QjQ_jQj​ at most ajia_{ji}aji​ in absolute value (p. 9).
  6. The simultaneous best-response map is Lipschitz with constant max⁡j∑iaji\max_j\sum_i a_{ji}maxj​∑i​aji​ in the one-norm and max⁡i∑jaji\max_i\sum_j a_{ji}maxi​∑j​aji​ in the infinity-norm (p. 9).

Significance

Proposition 4 makes the competitive equilibrium a well-defined object: a single stock vector, characterized by (10), which can be compared with the centralized optimum (the paper's Proposition 6) and which best-response adjustment reaches from any starting point. Without uniqueness, comparative statements about "the" competitive stocking level would be about an arbitrary selection.

The paper's argument has two gaps that this mission makes explicit. The proof asserts that best responses are single-valued because each profit is concave, and differentiates the best response using a density of DisD^s_iDis​; the bound on the Jacobian is then stated in derivative form. The formal statements replace the derivative bounds by difference (Lipschitz) bounds, which need no differentiability, and state the positivity of the density on which single-valuedness rests. The paper also proves existence by citation to Lippman and McCardle; here existence is part of the goal. No machine-checked proof of these results is known.

Difficulty

The obvious route differentiates the best response implicitly, as the paper does. That requires DisD^s_iDis​ to have a continuous, positive density at the equilibrium quantile, which is not a consequence of a continuous joint law: DisD^s_iDis​ is a piecewise-linear function of DDD, and its distribution function may have kinks. A second point is that concavity of πi\pi_iπi​ alone does not make the best response unique: a demand law whose support has a gap gives πi\pi_iπi​ a flat stretch and an interval of maximizers. Global stability must hold for every sequence of best responses, not for the iterates of one selected best-response function. Finally, the probabilities in (10) use strict inequalities, and their identification with Pr⁡(Dis≤Qi)\Pr(D^s_i\le Q_i)Pr(Dis​≤Qi​) uses that DisD^s_iDis​ has no atoms, which needs a measure-theoretic argument about Dis=Di+g(D−i)D^s_i=D_i+g(D_{-i})Dis​=Di​+g(D−i​) under an absolutely continuous law.

Formalization scope

Products are indexed by Fin n (0-based). The model data and the standing assumptions ri>ci>si>0r_i>c_i>s_i>0ri​>ci​>si​>0, aij∈[0,1]a_{ij}\in[0,1]aij​∈[0,1], aii=0a_{ii}=0aii​=0 and ∑jaij<1\sum_j a_{ij}<1∑j​aij​<1 are fields of a structure Model n. a i j is the share of iii's unmet demand going to jjj, so DisD^s_iDis​ uses a j i. The demand law is a probability measure μ\muμ on Rn\mathbb R^nRn that is absolutely continuous with respect to Lebesgue measure, gives every coordinate a positive value almost surely, and has integrable coordinates; this is the reading of "a known continuous multivariate demand distribution with positive support". Expectations are Bochner integrals and probabilities are μ.real of events, with the strict and weak inequalities as printed.

The stocks range over [0,∞)n[0,\infty)^n[0,∞)n, with no upper bound. A best response maximizes over [0,∞)[0,\infty)[0,∞); a Nash equilibrium is defined by the absence of a profitable deviation, not by (10). Defining equilibria by (10) would make Proposition 3 and half of Proposition 4 true by definition, and is ruled out.

One hypothesis is added beyond the page and disclosed in every statement that uses it: μ\muμ has a Lebesgue density that is strictly positive on the open positive orthant. It is used for single-valued best responses, the slope and contraction bounds, and the goal; the derivative, concavity and Proposition 3 do not use it. In the goal, the second branch of the uniqueness condition, ∑jaij<1\sum_j a_{ij}<1∑j​aij​<1 for all iii, coincides with the standing assumption of §2, so uniqueness always applies within the model; the disjunction is kept as printed. The paper's proof attaches the one-norm bound max⁡j∑iaji\max_j\sum_i a_{ji}maxj​∑i​aji​ to the first branch, which is a column-sum condition on aaa; both branches are true, with the one-norm used for row sums and the infinity-norm for column sums.

A complete development needs: differentiation under the integral sign for piecewise-linear integrands, the absence of atoms of Di+g(D−i)D_i+g(D_{-i})Di​+g(D−i​) under an absolutely continuous law, quantiles of strictly increasing continuous distribution functions, and the Banach fixed-point theorem on the closed nonnegative orthant (Mathlib's ContractingWith). The first two are reusable for every newsvendor model with substitution. Proofs of the milestones in any order are welcome.

Selected references

  • S. Netessine and N. Rudi, Centralized and Competitive Inventory Models with Demand Substitution, Simon School Working Paper OP 02-01, University of Rochester, April 2002, SSRN 303779. https://doi.org/10.2139/ssrn.303779
  • S. Netessine and N. Rudi, Centralized and Competitive Inventory Models with Demand Substitution, Operations Research 51(2):329–335, 2003. https://doi.org/10.1287/opre.51.2.329.12788
  • S. A. Lippman and K. F. McCardle, The Competitive Newsboy, Operations Research 45(1):54–65, 1997. https://doi.org/10.1287/opre.45.1.54
  • M. Parlar, Game Theoretic Analysis of the Substitutable Product Inventory Problem with Random Demands, Naval Research Logistics 35(3):397–409, 1988.
  • A. R. McGillivray and E. A. Silver, Some Concepts for Inventory Control under Substitutable Demand, INFOR 16(1):47–63, 1978.
  • M. Parlar and S. K. Goyal, Optimal Ordering Decisions for Two Substitutable Products with Stochastic Demand, OPSEARCH 21(1):1–15, 1984.
  • R. A. Horn and C. R. Johnson, Matrix Analysis, Cambridge University Press, 1985 (Theorem 5.6.9).
8 thms1 active userReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Is Network Traffic Approximated by Stable Lévy Motion or Fractional Brownian Motion? 3: Infinite Source Poisson Input Under Fast Growth Converges in (D[0,∞), J₁) to Fractional Brownian MotionResearch Paper

Why heavy-tailed input matters

Measurements of Ethernet and Internet traffic in the 1990s showed that cumulative traffic is self-similar and long-range dependent: correlations of the input rate decay so slowly that they are not summable, and fluctuations at large time scales do not average out the way Poisson-type models predict. A widely accepted explanation is that the lengths of individual transmissions (file sizes, session durations) are heavy tailed, with infinite variance. Queueing and capacity-planning calculations then depend on which stochastic process approximates the cumulative input over long horizons.

Two candidate approximations had been proposed: fractional Brownian motion, a Gaussian self-similar process with dependent increments (Taqqu, Willinger and Sherman, 1997; Leland, Taqqu, Willinger and Wilson, 1994), and α-stable Lévy motion, a heavy-tailed process with independent increments. Mikosch, Resnick, Rootzén and Stegeman (Ann. Appl. Probab. 12 (2002) 23–68) showed that both arise from the same model, and that the answer depends on how fast the connection rate grows relative to the time scale. This mission formalizes their Gaussian answer for the infinite source Poisson model: Theorem 3.

  • 1994–1997: Leland et al. measure self-similarity in Ethernet traffic; Willinger, Taqqu, Sherman and Wilson derive fractional Brownian motion from ON/OFF sources with heavy-tailed periods, in an iterated limit (first the number of sources, then time).
  • 2002: Mikosch, Resnick, Rootzén and Stegeman take both limits simultaneously and identify a slow-growth regime (stable Lévy limit) and a fast-growth regime (fractional Brownian limit), for both the ON/OFF and the infinite source Poisson model.

The infinite source Poisson model

Connections start at the points (Γk)k∈Z(\Gamma_k)_{k\in\mathbb Z}(Γk​)k∈Z​ of a homogeneous Poisson process on R\mathbb RR with rate λ\lambdaλ, labelled so that Γ0<0<Γ1\Gamma_0<0<\Gamma_1Γ0​<0<Γ1​; equivalently, −Γ0-\Gamma_0−Γ0​, Γ1\Gamma_1Γ1​ and Γk+1−Γk\Gamma_{k+1}-\Gamma_kΓk+1​−Γk​ (k≠0k\neq0k=0) are iid exponential with parameter λ\lambdaλ. Connection kkk transmits at unit rate for a length XkX_kXk​; the XkX_kXk​ are iid with law FonF_{\mathrm{on}}Fon​ on [0,∞)[0,\infty)[0,∞) and independent of (Γk)(\Gamma_k)(Γk​). The tail Fˉon(x)=P(Xk>x)\bar F_{\mathrm{on}}(x)=P(X_k>x)Fˉon​(x)=P(Xk​>x) is regularly varying:

Fˉon(x)=x−αL(x),x>0,1<α<2,(2.8)\bar F_{\mathrm{on}}(x)=x^{-\alpha}L(x),\qquad x>0,\quad 1<\alpha<2,\tag{2.8}Fˉon​(x)=x−αL(x),x>0,1<α<2,(2.8)

with LLL slowly varying (L(cx)/L(x)→1L(cx)/L(x)\to1L(cx)/L(x)→1 for every c>0c>0c>0). The mean μon\mu_{\mathrm{on}}μon​ is finite and the variance infinite. The number of active connections and the cumulative input are

N(t)=∑k1[Γk≤t<Γk+Xk],A(t)=∫0tN(s) ds.N(t)=\sum_k\mathbf 1[\Gamma_k\le t<\Gamma_k+X_k],\qquad A(t)=\int_0^tN(s)\,ds .N(t)=k∑​1[Γk​≤t<Γk​+Xk​],A(t)=∫0t​N(s)ds.

The model is indexed by a time scale T→∞T\to\inftyT→∞, with a connection rate λ=λ(T)\lambda=\lambda(T)λ=λ(T) that is non-decreasing in TTT. With the quantile function b(t)=(1/Fˉon)←(t)=inf⁡{x>0:1/Fˉon(x)≥t}b(t)=(1/\bar F_{\mathrm{on}})^{\leftarrow}(t)=\inf\{x>0:1/\bar F_{\mathrm{on}}(x)\ge t\}b(t)=(1/Fˉon​)←(t)=inf{x>0:1/Fˉon​(x)≥t}, the fast growth Condition 2 is

lim⁡T→∞b(λT)T=∞,\lim_{T\to\infty}\frac{b(\lambda T)}{T}=\infty ,T→∞lim​Tb(λT)​=∞,

equivalently λTFˉon(T)→∞\lambda T\bar F_{\mathrm{on}}(T)\to\inftyλTFˉon​(T)→∞: many transmissions longer than the observation window start in it. With σT2(1)=λT3Fˉon(T)\sigma_T^2(1)=\lambda T^3\bar F_{\mathrm{on}}(T)σT2​(1)=λT3Fˉon​(T) the normalised input is

GT(t)=A(Tt)−λμonTt[σT2(1) σ2]1/2,t≥0.G_T(t)=\frac{A(Tt)-\lambda\mu_{\mathrm{on}}Tt}{[\sigma_T^2(1)\,\sigma^2]^{1/2}},\qquad t\ge0 .GT​(t)=[σT2​(1)σ2]1/2A(Tt)−λμon​Tt​,t≥0.

Standard fractional Brownian motion BHB_HBH​ with Hurst index H∈(0,1)H\in(0,1)H∈(0,1) is a mean-zero Gaussian process on [0,∞)[0,\infty)[0,∞) with a.s. continuous paths and Cov(BH(t),BH(s))=12(t2H+s2H−∣t−s∣2H)\mathrm{Cov}(B_H(t),B_H(s))=\tfrac12\big(t^{2H}+s^{2H}-|t-s|^{2H}\big)Cov(BH​(t),BH​(s))=21​(t2H+s2H−∣t−s∣2H).

Formalization targets

Goal: Theorem 3 (corrected)

Under (2.8), λ\lambdaλ non-decreasing and Condition 2,

GT(⋅)→dBH(⋅)in (D[0,∞),J1),H=3−α2,σ2=2(α−1)(2−α)(3−α).G_T(\cdot)\xrightarrow{d}B_H(\cdot)\quad\text{in }(\mathbb D[0,\infty),J_1),\qquad H=\frac{3-\alpha}2,\qquad \sigma^2=\frac{2}{(\alpha-1)(2-\alpha)(3-\alpha)} .GT​(⋅)d​BH​(⋅)in (D[0,∞),J1​),H=23−α​,σ2=(α−1)(2−α)(3−α)2​.

On the constant. The paper takes σ2\sigma^2σ2 from its display (6.6), σ2=13−α[α2−α+2μon]\sigma^2=\frac1{3-\alpha}\big[\frac{\alpha}{2-\alpha}+\frac2{\mu_{\mathrm{on}}}\big]σ2=3−α1​[2−αα​+μon​2​]. With that value the theorem is false. Two terms are lost in the variance bookkeeping of the proof: (6.4) omits the factor λm2∼λm3∼λμon\lambda m_2\sim\lambda m_3\sim\lambda\mu_{\mathrm{on}}λm2​∼λm3​∼λμon​ in the variances of the second and third regional sums, each of which contributes 1/(3−α)1/(3-\alpha)1/(3−α), and (6.2) discards (P4−EP4)T(P_4-EP_4)T(P4​−EP4​)T by an argument valid only under slow growth; under Condition 2 its variance is ∼λT3Fˉon(T)/(α−1)\sim\lambda T^3\bar F_{\mathrm{on}}(T)/(\alpha-1)∼λT3Fˉon​(T)/(α−1). The sum α(2−α)(3−α)+23−α+1α−1\frac{\alpha}{(2-\alpha)(3-\alpha)}+\frac2{3-\alpha}+\frac1{\alpha-1}(2−α)(3−α)α​+3−α2​+α−11​ equals 2(α−1)(2−α)(3−α)\frac2{(\alpha-1)(2-\alpha)(3-\alpha)}(α−1)(2−α)(3−α)2​, which is also what VarA(T)=2∫0T(T−h) λ∫h∞Fˉon(v) dv dh\mathrm{Var}A(T)=2\int_0^T(T-h)\,\lambda\int_h^\infty\bar F_{\mathrm{on}}(v)\,dv\,dhVarA(T)=2∫0T​(T−h)λ∫h∞​Fˉon​(v)dvdh and Karamata's theorem give. Since VarBH(1)=1\mathrm{Var}B_H(1)=1VarBH​(1)=1, only this value makes the limit standard. All other constants are those of the paper.

Intermediate targets

The milestones follow the proof: Lemma 1 (Condition 2 ⇔ λTFˉon(T)→∞\lambda T\bar F_{\mathrm{on}}(T)\to\inftyλTFˉon​(T)→∞ ⇔ Cov(NT(0),NT(T))→∞\mathrm{Cov}(N_T(0),N_T(T))\to\inftyCov(NT​(0),NT​(T))→∞), Lemma 2 (fast part), the covariance identity (2.14), the moment asymptotics (4.9) and (4.14), the central limit theorem (6.3) for the first regional sum, the one-dimensional limit (6.5) with the corrected variance, stationarity of the increments of GTG_TGT​, and the fourth-moment bounds (6.8) and E(GT(t+u)−GT(t))4≤cu2E(G_T(t+u)-G_T(t))^4\le cu^2E(GT​(t+u)−GT​(t))4≤cu2 that give tightness.

Significance

The theorem identifies the fast-growth regime of the infinite source Poisson model (the M/G/∞ input model) with fractional Brownian motion, so that Gaussian long-range-dependent models of network traffic are limits of a mechanistic model, not postulates; together with Theorem 1 it shows that the choice between Gaussian and stable approximations is decided by a single growth condition, b(λT)/T→0b(\lambda T)/T\to0b(λT)/T→0 or →∞\to\infty→∞. Queueing analyses of fluid queues fed by fractional Brownian motion inherit their justification from limits of this kind.

The result is proved in the paper, apart from the constant discussed above; it is not formalized anywhere. A formalization adds a machine-checked statement with the correct normalisation and a reusable development of regularly varying tails, Poisson marked point processes on R×[0,∞)\mathbb R\times[0,\infty)R×[0,∞), fractional Brownian motion, and Skorokhod's J1J_1J1​ topology on D[0,∞)\mathbb D[0,\infty)D[0,∞).

Difficulty

The obvious argument is a central limit theorem for A(T)A(T)A(T), but A(T)A(T)A(T) is not a sum of independent terms of bounded variance: transmissions that straddle the window are long and heavy tailed, and their contribution is of the same order as the bulk. The proof splits the points into four regions according to where a transmission starts and ends, and each region needs its own moment asymptotics through Karamata's theorem; the bookkeeping is exactly where the printed constant goes wrong. The functional statement then needs tightness in D[0,∞)\mathbb D[0,\infty)D[0,∞): a fourth-moment bound on increments that is uniform in TTT and in the position of the increment, which requires Potter-type bounds on Fˉon(uT)/Fˉon(T)\bar F_{\mathrm{on}}(uT)/\bar F_{\mathrm{on}}(T)Fˉon​(uT)/Fˉon​(T) for small uuu. Convergence of finite-dimensional distributions alone does not give the theorem.

Formalization scope

  • Time and models. T→∞T\to\inftyT→∞ along atTop on R\mathbb RR. Each model TTT has its own probability space; the theorems hold for every family of models with the stated rate and length law. Time in GTG_TGT​ runs over R≥0\mathbb R_{\ge0}R≥0​.
  • Standing hypotheses. FonF_{\mathrm{on}}Fon​ is a probability measure with Fon((−∞,0))=0F_{\mathrm{on}}((-\infty,0))=0Fon​((−∞,0))=0 (lengths are non-negative, implicit on the page); (2.8) is stated as "x↦xαFˉon(x)x\mapsto x^\alpha\bar F_{\mathrm{on}}(x)x↦xαFˉon​(x) is slowly varying", 1<α<21<\alpha<21<α<2; λ(T)>0\lambda(T)>0λ(T)>0 and λ\lambdaλ is non-decreasing (§3.1); Condition 2. No other hypothesis is added.
  • Junk values ruled out. bbb is an infimum over {x>0:tFˉon(x)≤1}\{x>0:t\bar F_{\mathrm{on}}(x)\le1\}{x>0:tFˉon​(x)≤1}, never a division by zero; NNN is a cardinality and A1A_1A1​ a sum of non-negative terms, whose junk values (000 on an infinite set) occur only on null events; fourth moments are asserted together with integrability; equalities of laws are asserted together with measurability. The limit is pinned completely: Gaussian, mean zero, the covariance above with σH=1\sigma_H=1σH​=1, H=(3−α)/2H=(3-\alpha)/2H=(3−α)/2, continuous paths. Fidi convergence in place of the functional limit, a free scale in the limit, or a limit identified only by its marginals would each be a different, weaker theorem.
  • Weak convergence is stated in coupling form: for every sequence Tn→∞T_n\to\inftyTn​→∞ there is one probability space with copies YnY_nYn​ of the laws of GTnG_{T_n}GTn​​ (all finite-dimensional distributions) and a standard fractional Brownian motion Y′Y'Y′ such that Yn→Y′Y_n\to Y'Yn​→Y′ in J1J_1J1​ almost surely, càdlàg paths included. On the Polish space D[0,∞)\mathbb D[0,\infty)D[0,∞) this is equivalent to weak convergence. Because A(T⋅)A(T\cdot)A(T⋅) and BHB_HBH​ have continuous paths, J1J_1J1​ convergence here coincides with locally uniform convergence.
  • Infrastructure needed: Karamata's theorem and Potter bounds for regularly varying functions; the Poisson random measure of the marked points and its restriction to disjoint regions; a Lyapunov central limit theorem for Poisson sums; fractional Brownian motion and its existence; Billingsley's moment criterion for tightness in D[0,K]\mathbb D[0,K]D[0,K]. The regular-variation and Skorokhod-space material is reusable well beyond this mission; contributions of any of these pieces, and of any milestone, are welcome.

Selected references

  • T. Mikosch, S. Resnick, H. Rootzén and A. Stegeman, Is network traffic approximated by stable Lévy motion or fractional Brownian motion?, Ann. Appl. Probab. 12(1) (2002), 23–68. https://doi.org/10.1214/aoap/1015961155
  • W. E. Leland, M. S. Taqqu, W. Willinger and D. V. Wilson, On the self-similar nature of Ethernet traffic (extended version), IEEE/ACM Trans. Networking 2 (1994), 1–15. https://doi.org/10.1109/90.282603
  • W. Willinger, M. S. Taqqu, R. Sherman and D. V. Wilson, Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level, IEEE/ACM Trans. Networking 5 (1997), 71–86. https://doi.org/10.1109/90.554723
  • N. H. Bingham, C. M. Goldie and J. L. Teugels, Regular Variation, Cambridge University Press, 1987. https://doi.org/10.1017/CBO9780511721434
  • P. Billingsley, Convergence of Probability Measures, Wiley, 1968 (Theorem 12.3, moment criterion for tightness).
13 thms1 active userReviewed
StatisticsStochastic Systems·Captain: mikedeng1

Do Price and Volatility Jump Together?: The Observable Jump–Volatility Statistics U(F, kₙ) Converge in Probability to U(F) in the Skorokhod TopologyResearch Paper

Motivation

Asset prices observed at high frequency show two kinds of discontinuity: jumps in the price itself and abrupt changes in its volatility. Whether the two occur at the same times matters for modelling. Many stochastic volatility models used in option pricing let the price and the volatility jump together (for example the affine jump-diffusion models of Duffie, Pan and Singleton, Econometrica 2000), while others make them jump independently or not at all, and the choice affects pricing, hedging and risk management. Jean Jacod and Viktor Todorov (Do price and volatility jump together?, Ann. Appl. Probab. 20 (2010)) built statistical tests of this question that use only discretely observed prices. The tests rest on a law of large numbers, Theorem 3.1 of the paper, and this mission formalizes it.

Setting

The price is an Itô semimartingale XXX on a filtered probability space (Ω,F,(Ft)t≥0,P)(\Omega,\mathcal F,(\mathcal F_t)_{t\ge0},\mathbb P)(Ω,F,(Ft​)t≥0​,P):

Xt=X0+∫0tbs ds+∫0tσs dWs+∫0t ⁣ ⁣∫Eδ(s,z)1{∣δ(s,z)∣≤1}(μ−ν)(ds,dz)+∫0t ⁣ ⁣∫Eδ(s,z)1{∣δ(s,z)∣>1}μ(ds,dz),X_t=X_0+\int_0^t b_s\,ds+\int_0^t\sigma_s\,dW_s+\int_0^t\!\!\int_E\delta(s,z)1_{\{|\delta(s,z)|\le1\}}(\mu-\nu)(ds,dz)+\int_0^t\!\!\int_E\delta(s,z)1_{\{|\delta(s,z)|>1\}}\mu(ds,dz),Xt​=X0​+∫0t​bs​ds+∫0t​σs​dWs​+∫0t​∫E​δ(s,z)1{∣δ(s,z)∣≤1}​(μ−ν)(ds,dz)+∫0t​∫E​δ(s,z)1{∣δ(s,z)∣>1}​μ(ds,dz),

where WWW is a Brownian motion, μ\muμ is a Poisson random measure on R+×E\mathbb R_+\times ER+​×E with compensator ν(ds,dz)=ds⊗λ(dz)\nu(ds,dz)=ds\otimes\lambda(dz)ν(ds,dz)=ds⊗λ(dz), and δ(ω,s,z)\delta(\omega,s,z)δ(ω,s,z) is the jump size produced by an atom (s,z)(s,z)(s,z) of μ\muμ. The volatility is ct=σt2c_t=\sigma_t^2ct​=σt2​, and ΔXs=Xs−Xs−\Delta X_s=X_s-X_{s-}ΔXs​=Xs​−Xs−​ is the jump of XXX at time sss.

Two assumptions are imposed. (H-rrr), 0≤r<20\le r<20≤r<2: the drift bbb is locally bounded, σ\sigmaσ is càdlàg with σt≠0\sigma_t\ne0σt​=0 and σt−≠0\sigma_{t-}\ne0σt−​=0, and ∣δ(ω,t,z)∣≤Γt(ω)γ(z)|\delta(\omega,t,z)|\le\Gamma_t(\omega)\gamma(z)∣δ(ω,t,z)∣≤Γt​(ω)γ(z) with Γ\GammaΓ locally bounded and ∫E(γr∧1) dλ<∞\int_E(\gamma^r\wedge1)\,d\lambda<\infty∫E​(γr∧1)dλ<∞; smaller rrr means fewer small jumps, and r=0r=0r=0 means finitely many jumps on bounded intervals. (K-vvv), 0<v≤10<v\le10<v≤1: σt=Σ(Zt,Z‾t)\sigma_t=\Sigma(Z_t,\overline Z_t)σt​=Σ(Zt​,Zt​) for a C1C^1C1 function Σ\SigmaΣ, where ZZZ is itself an Itô semimartingale with controlled jumps and Z‾\overline ZZ is Hölder of order vvv in the sense ∣Z‾t+s−Z‾t∣≤Γt+s′sv|\overline Z_{t+s}-\overline Z_t|\le\Gamma'_{t+s}s^v∣Zt+s​−Zt​∣≤Γt+s′​sv for 0<s≤10<s\le10<s≤1.

For a test function F(x,y,z)F(x,y,z)F(x,y,z), the unobservable target is the jump functional

U(F)t=∑s≤tF(ΔXs,cs−,cs) 1{ΔXs≠0},U(F)_t=\sum_{s\le t}F(\Delta X_s,c_{s-},c_s)\,1_{\{\Delta X_s\ne0\}},U(F)t​=s≤t∑​F(ΔXs​,cs−​,cs​)1{ΔXs​=0}​,

which compares, at each price jump, the volatility just before and just after it. The data are the values XiΔnX_{i\Delta_n}XiΔn​​ on a grid of mesh Δn→0\Delta_n\to0Δn​→0, with increments ΔinX=XiΔn−X(i−1)Δn\Delta^n_iX=X_{i\Delta_n}-X_{(i-1)\Delta_n}Δin​X=XiΔn​​−X(i−1)Δn​​. With a truncation level unu_nun​ and a window size knk_nkn​, the local volatility estimator is

c^(kn)i=1knΔn∑j=1kn∣Δi+jnX∣2 1{∣Δi+jnX∣≤un},\widehat c(k_n)_i=\frac1{k_n\Delta_n}\sum_{j=1}^{k_n}|\Delta^n_{i+j}X|^2\,1_{\{|\Delta^n_{i+j}X|\le u_n\}},c(kn​)i​=kn​Δn​1​j=1∑kn​​∣Δi+jn​X∣21{∣Δi+jn​X∣≤un​}​,

and the observable statistic is

U(F,kn)t=∑i=kn+1[t/Δn]−knF(ΔinX,c^(kn)i−kn−1,c^(kn)i) 1{∣ΔinX∣>un}.U(F,k_n)_t=\sum_{i=k_n+1}^{[t/\Delta_n]-k_n}F\big(\Delta^n_iX,\widehat c(k_n)_{i-k_n-1},\widehat c(k_n)_i\big)\,1_{\{|\Delta^n_iX|>u_n\}}.U(F,kn​)t​=i=kn​+1∑[t/Δn​]−kn​​F(Δin​X,c(kn​)i−kn​−1​,c(kn​)i​)1{∣Δin​X∣>un​}​.

The tuning (3.3) is un≍Δnϖu_n\asymp\Delta_n^{\varpi}un​≍Δnϖ​ and kn≍Δn−ρk_n\asymp\Delta_n^{-\rho}kn​≍Δn−ρ​ with 0<ϖ<120<\varpi<\tfrac120<ϖ<21​ and 0<ρ<10<\rho<10<ρ<1. Finally, R\mathcal RR is the family of open sets R⊆RR\subseteq\mathbb RR⊆R with finite complement that contain every value xxx with P(∃s>0:ΔXs=x)>0\mathbb P(\exists s>0:\Delta X_s=x)>0P(∃s>0:ΔXs​=x)>0.

Formalization targets

Goal: Theorem 3.1

Let FFF be Borel, continuous at each point of R×(0,∞)2R\times(0,\infty)^2R×(0,∞)2 for some R∈RR\in\mathcal RR∈R, and assume one of (a) F(x,y,z)=0F(x,y,z)=0F(x,y,z)=0 for ∣x∣≤ε|x|\le\varepsilon∣x∣≤ε; (b) r=0r=0r=0; (c) ∣F(x,y,z)∣≤K∣x∣r(1+y+z)|F(x,y,z)|\le K|x|^r(1+y+z)∣F(x,y,z)∣≤K∣x∣r(1+y+z) for ∣x∣≤ε|x|\le\varepsilon∣x∣≤ε. Then U(F)U(F)U(F) is a.s. well defined and

U(F,kn)→ P U(F)for the Skorokhod topology.U(F,k_n)\xrightarrow{\ \mathbb P\ }U(F)\qquad\text{for the Skorokhod topology}.U(F,kn​) P ​U(F)for the Skorokhod topology.

Milestones

They follow the proof of §8, in which the coefficients are bounded by a constant (the localized bound (8.3)):

  • (8.4): with probability tending to one, the big jumps up to time ttt lie in distinct sampling windows;
  • (8.11) and (8.14): E(∣ΔinX∣2∣F(i−1)Δn)≤KΔn\mathbb E(|\Delta^n_iX|^2\mid\mathcal F_{(i-1)\Delta_n})\le K\Delta_nE(∣Δin​X∣2∣F(i−1)Δn​​)≤KΔn​ and E(c^(kn)i∣FiΔn)≤K\mathbb E(\widehat c(k_n)_i\mid\mathcal F_{i\Delta_n})\le KE(c(kn​)i​∣FiΔn​​)≤K, with KKK uniform;
  • Lemma 8.1, (8.18): c^(kn)i→cS\widehat c(k_n)_i\to c_Sc(kn​)i​→cS​ and c^(kn)i−kn−1→cS−\widehat c(k_n)_{i-k_n-1}\to c_{S-}c(kn​)i−kn​−1​→cS−​ in probability on the events where no big jump falls in the corresponding window;
  • (8.27): the part of U(F,kn)U(F,k_n)U(F,kn​) carried by the big jumps converges to the corresponding part of U(F)U(F)U(F);
  • (8.29): the remainder driven by the small jumps vanishes in mean, uniformly in nnn, as the jump threshold goes to zero;
  • Theorem 3.1 under the localized bound (8.3), which §8.4 proves directly.

Significance

Theorem 3.1 makes U(F,kn)TU(F,k_n)_TU(F,kn​)T​ a consistent estimator of U(F)TU(F)_TU(F)T​. Choosing FFF nonnegative with F(x,y,y)=0F(x,y,y)=0F(x,y,y)=0 makes U(F)T>0U(F)_T>0U(F)T​>0 exactly when XXX and ccc jump together on [0,T][0,T][0,T], and the tests of §4 of the paper (Theorems 4.1–4.5), together with the central limit theorems 3.2 and 3.3, are built on this. The same truncated local volatility estimators appear throughout high-frequency econometrics, so their consistency (Lemma 8.1) is reusable on its own.

The result is proved in the paper. No machine-checked proof of it, or of any of its steps, is known to exist. A formal development would also produce a reusable layer for Itô semimartingales with Poisson jumps: the representation (2.1), compensated jump integrals, and convergence in probability in the Skorokhod space. None of these is currently available in Mathlib.

Difficulty

The obvious argument treats each increment ΔinX\Delta^n_iXΔin​X and replaces the estimators c^(kn)i\widehat c(k_n)_ic(kn​)i​ by c(i−1)Δnc_{(i-1)\Delta_n}c(i−1)Δn​​. This fails in two places. First, U(F,kn)U(F,k_n)U(F,kn​) has about t/Δnt/\Delta_nt/Δn​ summands, so errors of each summand that vanish in probability need not sum to something small. The infinitely many small jumps must be controlled in mean, through the moment bounds of §8.2 and the growth condition of case (c), and the cutoff unu_nun​ must separate jumps from Brownian increments. Second, the estimators look at windows of knk_nkn​ increments that may contain a jump of XXX or of ccc. Consistency holds only away from the big jumps, and the jump times are random, so conditioning has to be done with respect to the enlarged filtrations Ft(m)\mathcal F^{(m)}_tFt(m)​ that know the big jumps in advance. Finally, the limit is in the Skorokhod topology: the jumps of U(F,kn)U(F,k_n)U(F,kn​) occur at grid times close to, but not equal to, those of U(F)U(F)U(F), so uniform convergence fails.

Formalization scope

Time is R≥0\mathbb R_{\ge0}R≥0​ and processes are functions ℝ≥0 → Ω → ℝ. The Poisson random measure is given by its atoms N(ω)⊆R+×EN(\omega)\subseteq\mathbb R_+\times EN(ω)⊆R+​×E, with at most one atom at each time. The Brownian integrals use the published EthierKurtz.HasBrownianItoIntegral. The compensated jump integral is characterized by the Lévy–Itô limit of compensated truncated sums. Càdlàg paths and Skorokhod convergence are the published KurtzProtter91.Integrals definitions. Convergence in probability for the Skorokhod topology is the subsequence criterion: every subsequence has a further subsequence converging almost surely. The identity (2.1) and the path properties hold almost surely, for each ttt.

The conventions are the following.

  • Following §8.1, ZZZ is written with the same Poisson measure as XXX and a second Brownian motion W′W'W′ independent of WWW.
  • Clause (b) of (H-·) is not imposed on ZZZ.
  • γ0\gamma^0γ0 means 1{γ>0}1_{\{\gamma>0\}}1{γ>0}​.
  • Increments have integer indices, with ΔinX=0\Delta^n_iX=0Δin​X=0 for i≤0i\le0i≤0.
  • A0=EA_0=EA0​=E.
  • Δn→0\Delta_n\to0Δn​→0 is added to (3.3), as the paper's standing regime.
  • The localized bound (8.3) omits the term ∣Xt∣|X_t|∣Xt​∣: together with the other bounds it cannot hold for all ttt, and keeping it would make the §8 statements vacuous.

The conclusion of Theorem 3.1 includes the a.s. summability of U(F)tU(F)_tU(F)t​. A formalization in which the infinite sum takes a default value, the expectations are junk values of non-integrable variables, or the hypotheses cannot be met is ruled out: X=WX=WX=W with σ≡1\sigma\equiv1σ≡1 and no jumps satisfies every hypothesis with r=0r=0r=0 and v=1v=1v=1.

A complete development needs stochastic integration against Brownian motion and compensated Poisson measures, Burkholder-type moment bounds, and the Skorokhod topology on D[0,∞)D[0,\infty)D[0,∞). These are reusable well beyond this mission. Contributions to any of them, and proofs of individual milestones, are welcome.

Selected references

  • J. Jacod, V. Todorov, Do price and volatility jump together?, Ann. Appl. Probab. 20(4) (2010) 1425–1469. arXiv:1010.4990, doi:10.1214/09-AAP654
  • J. Jacod, A. N. Shiryaev, Limit Theorems for Stochastic Processes, 2nd ed., Springer, 2003. doi:10.1007/978-3-662-05265-5
  • D. Duffie, J. Pan, K. Singleton, Transform analysis and asset pricing for affine jump-diffusions, Econometrica 68 (2000) 1343–1376. doi:10.1111/1468-0262.00164
  • T. G. Kurtz, P. Protter, Weak limit theorems for stochastic integrals and stochastic differential equations, Ann. Probab. 19 (1991) 1035–1070. doi:10.1214/aop/1176990334
14 thms1 active userReviewed
Graph TheoryMathematical Physics·Captain: mikedeng1

Ising Models on Locally Tree-Like Graphs 2: With a Positive Field, Belief Propagation Converges Exponentially Fast from Every Positive Initial ConditionResearch Paper

Motivation

Belief propagation (BP) is the message-passing algorithm used throughout artificial intelligence, coding theory and statistical physics to approximate marginals of graphical models. On graphs with cycles it is a heuristic: it may fail to converge, and when it converges its output need not be the true marginal. Rigorous guarantees had mostly been confined to the high-temperature regime, as a consequence of a uniform decay of correlations (spatial mixing) under which any boundary condition is forgotten; see the works cited as [3, 23, 26] in §1 of the paper.

Dembo and Montanari (arXiv:0804.4726v3, Ann. Appl. Probab. 20 (2010)) proved that for the ferromagnetic Ising model with a positive external field, BP converges exponentially fast on every graph of bounded degree, at every temperature, and that on locally tree-like graphs its fixed point computes local marginals accurately. The low-temperature regime, where the Gibbs measure on the limiting infinite tree is not unique, is the point: the field breaks the ±\pm± symmetry, and monotonicity replaces spatial mixing.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite graph in which every vertex has at most Δ\DeltaΔ neighbours, β≥0\beta\ge0β≥0 an inverse temperature and BBB a magnetic field. The Ising model on GGG is the distribution on spin configurations x‾∈{+1,−1}V\underline x\in\{+1,-1\}^Vx​∈{+1,−1}V

μ(x‾)=1Z(β,B)exp⁡{β∑(i,j)∈Exixj+B∑i∈Vxi}.\mu(\underline x)=\frac1{Z(\beta,B)}\exp\Big\{\beta\sum_{(i,j)\in E}x_ix_j+B\sum_{i\in V}x_i\Big\}.μ(x​)=Z(β,B)1​exp{β(i,j)∈E∑​xi​xj​+Bi∈V∑​xi​}.

More generally one allows a field BiB_iBi​ at each vertex, and Bi=+∞B_i=+\inftyBi​=+∞ (a vertex pinned to +1+1+1).

A message νi→j\nu_{i\to j}νi→j​ is a distribution on xi∈{+1,−1}x_i\in\{+1,-1\}xi​∈{+1,−1} attached to the directed edge i→ji\to ji→j. The BP iteration is

νi→j(t+1)(xi)=1zi→j(t) eBxi∏l∈∂i∖j ∑xleβxixl νl→i(t)(xl),\nu^{(t+1)}_{i\to j}(x_i)=\frac1{z^{(t)}_{i\to j}}\,e^{Bx_i}\prod_{l\in\partial i\setminus j}\ \sum_{x_l}e^{\beta x_ix_l}\,\nu^{(t)}_{l\to i}(x_l),νi→j(t+1)​(xi​)=zi→j(t)​1​eBxi​l∈∂i∖j∏​ xl​∑​eβxi​xl​νl→i(t)​(xl​),

with ∂i\partial i∂i the neighbours of iii and zi→j(t)z^{(t)}_{i\to j}zi→j(t)​ a normalization. An initial condition is positive if νi→j(0)(+1)≥νi→j(0)(−1)\nu^{(0)}_{i\to j}(+1)\ge\nu^{(0)}_{i\to j}(-1)νi→j(0)​(+1)≥νi→j(0)​(−1) on every directed edge. Distances between distributions are in total variation, ∥p−q∥TV=12∑x∣p(x)−q(x)∣\|p-q\|_{\mathrm{TV}}=\tfrac12\sum_x|p(x)-q(x)|∥p−q∥TV​=21​∑x​∣p(x)−q(x)∣.

For i∗∈Vi_*\in Vi∗​∈V, U=Bi∗(r)U=\mathsf B_{i_*}(r)U=Bi∗​​(r) is the ball of radius rrr, ∂U\partial U∂U its vertices at distance exactly rrr, and j(i)j(i)j(i) a neighbour in UUU of each i∈∂Ui\in\partial Ui∈∂U. Given a BP fixed point ν∗\nu^*ν∗, the BP estimate of the marginal on UUU is

νU(x‾U)=1zUexp⁡{β∑(i,j)∈EUxixj+B∑i∈U∖∂Uxi}∏i∈∂Uνi→j(i)∗(xi).\nu_U(\underline x_U)=\frac1{z_U}\exp\Big\{\beta\sum_{(i,j)\in E_U}x_ix_j+B\sum_{i\in U\setminus\partial U}x_i\Big\}\prod_{i\in\partial U}\nu^*_{i\to j(i)}(x_i).νU​(x​U​)=zU​1​exp{β(i,j)∈EU​∑​xi​xj​+Bi∈U∖∂U∑​xi​}i∈∂U∏​νi→j(i)∗​(xi​).

The proofs run through Ising models on rooted trees T\mathsf TT: T(ℓ)\mathsf T(\ell)T(ℓ) is the tree of the first ℓ\ellℓ generations, ∂T(ℓ)\partial\mathsf T(\ell)∂T(ℓ) the ℓ\ellℓ-th generation, and μℓ,0\mu^{\ell,0}μℓ,0, μℓ,+\mu^{\ell,+}μℓ,+ the Ising models on T(ℓ)\mathsf T(\ell)T(ℓ) with free and plus boundary conditions (the latter pins ∂T(ℓ)\partial\mathsf T(\ell)∂T(ℓ) to +1+1+1). A random tree is conditionally independent with average offspring bounded by Δ\DeltaΔ if, given the first kkk generations, the offspring numbers of generation kkk are independent with conditional means at most Δ\DeltaΔ (Definition 2.5).

Formalization targets

Goal: Theorem 2.6

For β≥0\beta\ge0β≥0, B>0B>0B>0 and Δ\DeltaΔ, there are A<∞A<\inftyA<∞ and λ>0\lambda>0λ>0 depending only on (β,B,Δ)(\beta,B,\Delta)(β,B,Δ) such that every finite graph of maximal degree Δ\DeltaΔ has a BP fixed point ν∗\nu^*ν∗ with

sup⁡(i,j)∈E∥νi→j(t)−νi→j∗∥TV≤Aexp⁡(−λt)\sup_{(i,j)\in E}\big\|\nu^{(t)}_{i\to j}-\nu^*_{i\to j}\big\|_{\mathrm{TV}}\le A\exp(-\lambda t)(i,j)∈Esup​​νi→j(t)​−νi→j∗​​TV​≤Aexp(−λt)

for every positive initial condition and every t≥0t\ge0t≥0. The constants are uniform over graphs; this uniformity is the content of the theorem.

Companion: Theorem 2.7

With c=c(β,B,Δ)c=c(\beta,B,\Delta)c=c(β,B,Δ) and λ>0\lambda>0λ>0: if Bi∗(t)\mathsf B_{i_*}(t)Bi∗​​(t) is a tree, then ∥μU−νU∥TV≤exp⁡{cr+1−λ(t−r)}\|\mu_U-\nu_U\|_{\mathrm{TV}}\le\exp\{c^{r+1}-\lambda(t-r)\}∥μU​−νU​∥TV​≤exp{cr+1−λ(t−r)}.

Milestones

The tree estimates of §3–§4, in the order the proofs use them: Griffiths' inequality (Theorem 3.1); the GHS inequality (Theorem 3.2); the reweighting bound in total variation (Lemma 3.3); marginals on subtrees (Lemma 4.1); the M/ℓM/\ellM/ℓ bound E{mℓ,+−mℓ,0}≤M/ℓ\mathbb E\{m^{\ell,+}-m^{\ell,0}\}\le M/\ellE{mℓ,+−mℓ,0}≤M/ℓ on root magnetizations (Lemma 4.3); its extension to marginals near the root (Theorem 4.2); a Simon-type factorization of tree correlations (Lemma 4.4); and Corollary 4.5: exponential decay of correlations (4.13), Theorem 4.2 with rate Ae−λtAe^{-\lambda t}Ae−λt, and the root-magnetization bound E{mℓ,+−mℓ,0}≤Ae−λℓ\mathbb E\{m^{\ell,+}-m^{\ell,0}\}\le Ae^{-\lambda\ell}E{mℓ,+−mℓ,0}≤Ae−λℓ.

Significance

The theorem gives an unconditional convergence guarantee for BP on a nontrivial class of models with cycles, valid deep in the low-temperature phase, with a rate independent of the number of vertices. Theorem 2.7 adds that the fixed point is accurate on locally tree-like graphs such as random regular graphs and sparse Erdős–Rényi graphs, so BP is a polynomial-time algorithm for local marginals there. The tree estimates of §4, in particular the insensitivity of the root to plus versus free boundary conditions on conditionally independent trees, are also the engine of the free-entropy theorem of the same paper (mission 1 of this series).

The results are proved in the paper; none of them, nor Griffiths' or the GHS inequality, has a machine-checked proof known to this mission. Formalizing them produces a reusable library for ferromagnetic Ising models on finite graphs and trees (correlation inequalities, pinned boundary conditions, marginals on subtrees) and a formal account of BP as an operator on message families.

Difficulty

The obvious argument is a contraction: show that one BP step shrinks the distance between message families, uniformly over the graph. At low temperature this fails: the BP map is not a contraction, the infinite-tree Ising model has several Gibbs measures, and without a field BP has several fixed points. Uniform decay of correlations, the tool behind high-temperature results, is false in this regime. What has to be controlled instead is a single, weaker quantity: how much the root of a tree of depth ttt feels a plus boundary condition compared with a free one, with a bound that is uniform over all trees of bounded average offspring and over all depths. The difficulty is concentrated in that estimate (Lemma 4.3), and in upgrading its 1/ℓ1/\ell1/ℓ rate to an exponential one (Corollary 4.5), which is where the positive field enters quantitatively.

Formalization scope

Spins are Booleans (true =+1=+1=+1); the edge sum counts each unordered edge once; a field +∞+\infty+∞ is a pinned vertex, never a large real number. Graphs are finite (Fintype V) with all degrees at most Δ\DeltaΔ. Messages are functions on ordered vertex pairs whose values on directed edges are distributions on {+1,−1}\{+1,-1\}{+1,−1}; the BP iterates are computed from the update, not posited. Total variation is 12ℓ1\tfrac12\ell^121​ℓ1. Trees are encoded by offspring functions on finite words (Ulam–Harris), random trees by probability measures on offspring functions with the product σ\sigmaσ-algebra; conditional independence uses Mathlib's iCondIndepFun, with integrable offspring numbers. Fields on trees are nonrandom functions of the vertex. Expectations that may be infinite, such as E{C∣T(r)∣}\mathbb E\{C^{|\mathsf T(r)|}\}E{C∣T(r)∣}, are lower Lebesgue integrals in [0,∞][0,\infty][0,∞], and every expectation of a tree functional comes with a measurability conclusion, so that no integral can take a junk value. Constants are quantified before the graph, the tree law and the field, and, where the paper names their dependence (Theorem 4.2's M(βmax⁡,Bmin⁡,Δ)M(\beta_{\max},B_{\min},\Delta)M(βmax​,Bmin​,Δ) and C(βmax⁡,Bmax⁡)C(\beta_{\max},B_{\max})C(βmax​,Bmax​)), as functions of exactly those parameters.

Two readings are fixed explicitly. Theorem 2.7 is stated for every positive BP fixed point, which by Theorem 2.6 is the paper's fixed point. Corollary 4.5's clause (4.13) carries the hypotheses of Theorem 4.2 (Bi≤Bmax⁡B_i\le B_{\max}Bi​≤Bmax​ on T(r−1)\mathsf T(r-1)T(r−1)). A fixed point that is not a family of distributions, a "zero message" family, or a bound that holds only because an integral defaults to 000 does not satisfy these statements.

The computation tree of §5, through which the paper derives Theorems 2.6–2.7 from Corollary 4.5, is a proof device and is not part of any statement; building it is welcome as supporting work. Proofs of the classical inequalities (Griffiths, GHS) are independently reusable.

Selected references

  • A. Dembo, A. Montanari, Ising models on locally tree-like graphs, Ann. Appl. Probab. 20(2) (2010) 565–592. arXiv:0804.4726v3, doi:10.1214/09-AAP627
  • R. B. Griffiths, C. A. Hurst, S. Sherman, Concavity of magnetization of an Ising ferromagnet in a positive external field, J. Math. Phys. 11 (1970) 790–795. MR0266507
  • T. M. Liggett, Interacting Particle Systems, Grundlehren 276, Springer, 1985 (Theorem IV.1.21, Griffiths' inequality). MR776231
  • B. Simon, Correlation inequalities and the decay of correlations in ferromagnets, Comm. Math. Phys. 77 (1980) 111–126. MR589426
21 thms1 active userReviewed
Bandit AlgorithmsOperations Research·Captain: mikedeng1

Linearly Parameterized Bandits 1: On the Unit Sphere with a Gaussian Prior, Every Policy Has Bayes Risk at Least 0.006·r√TResearch Paper

Motivation

In a linearly parameterized bandit, a decision maker repeatedly chooses an arm uuu from a set Ur⊂Rr\mathcal U_r \subset \mathbb R^rUr​⊂Rr and observes a noisy reward whose mean is the inner product u′Zu'Zu′Z with an unknown parameter vector ZZZ. The model covers pricing, assortment and recommendation problems in which arms are described by feature vectors and the number of arms is large or infinite, so that learning arm by arm is hopeless and information must be shared through the common parameter.

Rusmevichientong and Tsitsiklis (arXiv:0812.3465v2, published in Mathematics of Operations Research, 2010) give matching lower and upper bounds of order rTr\sqrt TrT​ for this problem when the arm set is the unit sphere. This mission is the lower bound, Theorem 2.1. It says that the dimension enters the regret linearly and that no policy can do better than rTr\sqrt TrT​, which makes the phased exploration policy of the paper's Section 3 optimal up to a constant.

Timeline. For r=1r = 1r=1, Mersereau, Rusmevichientong and Tsitsiklis (2009) showed regret Θ(T)\Theta(\sqrt T)Θ(T​) and Bayes risk Θ(log⁡T)\Theta(\log T)Θ(logT). Dani, Hayes and Kakade (2008) proved an Ω(rT)\Omega(r\sqrt T)Ω(rT​) minimax lower bound for a compact arm set built from products of circles. Rusmevichientong and Tsitsiklis (2010) proved the Ω(rT)\Omega(r\sqrt T)Ω(rT​) lower bound for the sphere itself, both for the regret and for the Bayes risk under a Gaussian prior, with the explicit constant 0.0060.0060.006.

Setting

Fix a dimension r≥2r \ge 2r≥2. The arms are the unit sphere Ur={u∈Rr:∥u∥=1}\mathcal U_r = \{u \in \mathbb R^r : \|u\| = 1\}Ur​={u∈Rr:∥u∥=1}, with the Euclidean norm ∥⋅∥\|\cdot\|∥⋅∥. The unknown parameter ZZZ is drawn from the prior N(0,Ir/r)N(0, I_r/r)N(0,Ir​/r): each coordinate is an independent normal with mean 000 and variance 1/r1/r1/r, so E∥Z∥2=1\mathbb E\|Z\|^2 = 1E∥Z∥2=1. Playing arm uuu in period ttt yields the reward

Xt=u′Z+Wt,X_t = u'Z + W_t,Xt​=u′Z+Wt​,

where the noise variables WtW_tWt​ are independent standard normals, independent of ZZZ.

A history Ht=(U1,X1,…,Ut,Xt)H_t = (U_1, X_1, \dots, U_t, X_t)Ht​=(U1​,X1​,…,Ut​,Xt​) lists the arms played and rewards observed up to period ttt. A policy ψ=(ψ1,ψ2,… )\psi = (\psi_1, \psi_2, \dots)ψ=(ψ1​,ψ2​,…) chooses the arm Ut=ψt(Ht−1)∈UrU_t = \psi_t(H_{t-1}) \in \mathcal U_rUt​=ψt​(Ht−1​)∈Ur​ of period ttt from the history. Since max⁡v∈Urv′z=∥z∥\max_{v \in \mathcal U_r} v'z = \|z\|maxv∈Ur​​v′z=∥z∥, the regret of ψ\psiψ given Z=zZ = zZ=z and the Bayes risk of ψ\psiψ over TTT periods are

Regret(z,T,ψ)=∑t=1TE[∥z∥−Ut′z ∣ Z=z],Risk(T,ψ)=E[Regret(Z,T,ψ)].\mathrm{Regret}(z, T, \psi) = \sum_{t=1}^T \mathbb E\big[\|z\| - U_t'z \,\big|\, Z = z\big], \qquad \mathrm{Risk}(T, \psi) = \mathbb E\big[\mathrm{Regret}(Z, T, \psi)\big].Regret(z,T,ψ)=t=1∑T​E[∥z∥−Ut′​z​Z=z],Risk(T,ψ)=E[Regret(Z,T,ψ)].

The milestones use the least mean squares estimator Z^T=E[Z∣HT]\widehat Z_T = \mathbb E[Z \mid H_T]ZT​=E[Z∣HT​] and orthonormal vectors ST1,…,STr−1S^1_T, \dots, S^{r-1}_TST1​,…,STr−1​ that are orthogonal to Z^T\widehat Z_TZT​ and are functions of HTH_THT​.

Formalization targets

Goal: Theorem 2.1 (p. 8)

For every policy ψ\psiψ and every T≥r2T \ge r^2T≥r2,

Risk(T,ψ)≥0.006 rT,and there is z∈Rr with Regret(z,T,ψ)≥0.006 rT.\mathrm{Risk}(T, \psi) \ge 0.006\, r\sqrt T, \qquad\text{and there is } z \in \mathbb R^r \text{ with } \mathrm{Regret}(z, T, \psi) \ge 0.006\, r\sqrt T.Risk(T,ψ)≥0.006rT​,and there is z∈Rr with Regret(z,T,ψ)≥0.006rT​.

The constant 0.0060.0060.006 is absolute; the parameter zzz may depend on ψ\psiψ.

Milestones

  1. Lemma 2.2 (p. 9), risk decomposition:
Risk(T,ψ)≥12∑k=1r−1E[∥Z∥∑t=1T(Ut′STk)2+T∥Z∥{(Z−Z^T)′STk}2].\mathrm{Risk}(T, \psi) \ge \frac12 \sum_{k=1}^{r-1} \mathbb E\Big[\|Z\| \sum_{t=1}^T (U_t'S^k_T)^2 + \frac{T}{\|Z\|}\big\{(Z - \widehat Z_T)'S^k_T\big\}^2\Big].Risk(T,ψ)≥21​k=1∑r−1​E[∥Z∥t=1∑T​(Ut′​STk​)2+∥Z∥T​{(Z−ZT​)′STk​}2].
  1. Lemma 2.3 (p. 10): almost surely, E[{(Z−Z^T)′STk}2∣HT]≥1/(r+∑t=1T(Ut′STk)2)\mathbb E\big[\{(Z - \widehat Z_T)'S^k_T\}^2 \mid H_T\big] \ge 1/\big(r + \sum_{t=1}^T (U_t'S^k_T)^2\big)E[{(Z−ZT​)′STk​}2∣HT​]≥1/(r+∑t=1T​(Ut′​STk​)2).
  2. Lemma 2.4 (p. 11): for θ≤1/2\theta \le 1/2θ≤1/2 and β>0\beta > 0β>0, Pr⁡{θ≤∥Z∥≤β}≥1−4θ2−1/β2\Pr\{\theta \le \|Z\| \le \beta\} \ge 1 - 4\theta^2 - 1/\beta^2Pr{θ≤∥Z∥≤β}≥1−4θ2−1/β2.
  3. Lemma 2.5 (p. 11): for each kkk and T≥r2T \ge r^2T≥r2, the expectation of the kkk-th summand of Lemma 2.2 is at least 0.027T0.027\sqrt T0.027T​.

Significance

The result. Theorem 2.1 shows that the regret and Bayes risk of linearly parameterized bandits grow at least linearly in the dimension, even when the arm set is as regular as a sphere and the noise is Gaussian. Together with the paper's Theorem 3.1 it pins the optimal order at rTr\sqrt TrT​ on the sphere, and it shows that the log⁡T\log TlogT Bayes risk achievable in dimension one does not survive in dimension two or more. Since the sphere is one compact arm set, the theorem also shows that the paper's upper bounds of order rTlog⁡3/2Tr\sqrt T \log^{3/2} TrT​log3/2T for general compact arm sets (Section 4) cannot be improved beyond logarithmic factors in that generality (Table 1, p. 8).

Formalizing it. The theorem is proved in the paper; to our knowledge it has not been machine-checked. The platform has a minimax lower bound for the unit ball with a fixed-norm parameter (Lattimore and Szepesvári, Theorem 24.2), which is a different statement: a frequentist bound over a finite family of parameters, not a Bayes risk under a continuous Gaussian prior. Formalizing Theorem 2.1 requires Gaussian posterior computations with an adaptively chosen design, a piece of Bayesian linear regression that is reusable well beyond bandits.

Difficulty

The obvious argument fixes the parameter's norm and treats the problem as a Gaussian estimation problem in each direction orthogonal to the current estimate. That fails because ∥Z∥\|Z\|∥Z∥ is random under the prior: the risk per direction trades off exploration, weighted by ∥Z∥\|Z\|∥Z∥, against estimation error, weighted by T/∥Z∥T/\|Z\|T/∥Z∥, and neither weight is bounded. The proof has to localise ∥Z∥\|Z\|∥Z∥ to an interval with positive probability uniformly in rrr, which is the content of Lemma 2.4 and the reason the lemma needs r≥2r \ge 2r≥2.

The second obstacle is that the design is adaptive: the arms UtU_tUt​ depend on past rewards, so the posterior of ZZZ given HTH_THT​ must be identified as Gaussian with covariance (rIr+∑tUtUt′)−1(rI_r + \sum_t U_tU_t')^{-1}(rIr​+∑t​Ut​Ut′​)−1 even though the regressors are random and history-dependent. Lemma 2.3 rests on this identification and on a matrix inequality for diagonal entries of an inverse.

Formalization scope

The source is arXiv:0812.3465v2; its printed page numbers equal the PDF's. All declarations live in the namespace LinParamBandits.LowerBound.

  • Rr\mathbb R^rRr is EuclideanSpace ℝ (Fin r), so norms are Euclidean and inner is u′zu'zu′z. Every theorem carries 2≤r2 \le r2≤r, the paper's standing assumption.
  • The prior is the law of Y/rY/\sqrt rY/r​ with YYY a standard Gaussian vector (Mathlib's stdGaussian); the noise is an i.i.d. standard normal sequence (Measure.infinitePi), independent of ZZZ.
  • The paper has one noise variable WtuW^u_tWtu​ for every arm and period. Only WtUtW^{U_t}_tWtUt​​ is observed and UtU_tUt​ depends on the past only, so the history has the same law with a single sequence; that is what is modelled.
  • Policies are deterministic and history-dependent, as in the paper, and each selection rule is required to be measurable, which the paper's expectations use implicitly.
  • Periods are 0-based in Lean: arm ψ z η t is the paper's Ut+1U_{t+1}Ut+1​.
  • Regret and risk are lower Lebesgue integrals of the nonnegative per-period gaps, with values in [0,∞][0, \infty][0,∞], and the regret given Z=zZ = zZ=z is computed with the parameter fixed to zzz. The tempting encoding Tmax⁡vv′z−∫∑tUt′zT\max_v v'z - \int \sum_t U_t'zTmaxv​v′z−∫∑t​Ut′​z is ruled out: there a non-integrable integrand would return 000 and make the regret equal to T∥z∥T\|z\|T∥z∥, so the lower bound would hold trivially.
  • Z^T\widehat Z_TZT​ is Mathlib's conditional expectation with respect to the σ\sigmaσ-algebra generated by HTH_THT​. The vectors STkS^k_TSTk​ are hypotheses of the lemmas: measurable functions of the history, orthonormal, and almost surely orthogonal to Z^T\widehat Z_TZT​.
  • No printed slip was found; no hypothesis beyond measurability of policies is added. The footnote on p. 8 (covariance IrI_rIr​) is not stated.

A complete development needs: measurability of the trajectory map, the Gaussian posterior for a sequentially chosen design, the inequality [(A)−1]kk≥1/Akk[(A)^{-1}]_{kk} \ge 1/A_{kk}[(A)−1]kk​≥1/Akk​ for positive definite AAA, a chi-square lower-tail bound, and Gaussian tail values. The posterior computation and the chi-square bound are reusable; contributions of either, or of a proof of any single milestone, are welcome.

Selected references

  • P. Rusmevichientong, J. N. Tsitsiklis, Linearly Parameterized Bandits, Mathematics of Operations Research 35(2), 2010; preprint arXiv:0812.3465v2. https://arxiv.org/abs/0812.3465
  • A. J. Mersereau, P. Rusmevichientong, J. N. Tsitsiklis, A Structured Multiarmed Bandit Problem and the Greedy Policy, IEEE Transactions on Automatic Control 54(12), 2009. https://doi.org/10.1109/TAC.2009.2031725
  • V. Dani, T. P. Hayes, S. M. Kakade, Stochastic Linear Optimization under Bandit Feedback, COLT 2008. https://www.learningtheory.org/colt2008/papers/80-Dani.pdf
  • T. Lattimore, C. Szepesvári, Bandit Algorithms, Cambridge University Press, 2020. https://doi.org/10.1017/9781108571401
6 thms1 active userReviewed
Convex OptimizationOperations ResearchOptimization·Captain: mikedeng1

Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion 2: With Random Objective, Z(x) = Z_D(x) = Z_DD(x) and Moment-Matching Distributions Attain Z(x) AsymptoticallyResearch Paper

Motivation

Two-stage stochastic linear programming chooses a first-stage decision xxx before a random parameter is revealed and pays an optimal second-stage (recourse) cost afterwards. The classical model fixes the distribution of the random parameter. In practice it is rarely known beyond a few moments, and a decision maker who is averse to risk does not evaluate the recourse cost by its plain expectation. Bertsimas, Doan, Natarajan and Teo (Math. Oper. Res. 35(3), 2010) take both points seriously: the distribution is only known to belong to the class of all distributions with given mean and second-moment matrix, the cost is passed through a convex piecewise-linear disutility, and the decision is evaluated against the worst distribution in the class.

Moment-based worst-case bounds go back to Scarf's newsvendor and to the Chebyshev-type bounds of the moment problem (Isii 1962; Bertsimas and Popescu 2005). Delage and Ye (Oper. Res. 58(3), 2010) showed that a broad class of such minimax problems is solvable in polynomial time by the ellipsoid method. For the case in which the uncertainty sits in the objective of the second-stage linear program, this paper gives a single semidefinite program (its Theorem 2.1, the subject of a companion mission) and, in §2.2, identifies the distributions that come arbitrarily close to the worst case. This mission is about the second result.

Setting

The first-stage region is X={x∈Rn:Ax=b, x≥0}X=\{x\in\mathbb R^n : Ax=b,\ x\ge0\}X={x∈Rn:Ax=b, x≥0}. For x∈Xx\in Xx∈X the recourse set is X(x)={w∈Rd:Ww=h−Tx, w≥0}X(x)=\{w\in\mathbb R^d : Ww=h-Tx,\ w\ge0\}X(x)={w∈Rd:Ww=h−Tx, w≥0} and the second-stage cost of an objective vector q∈Rdq\in\mathbb R^dq∈Rd is

Q(q,x)=min⁡w∈X(x)q′w.\mathcal Q(q,x)=\min_{w\in X(x)} q'w .Q(q,x)=w∈X(x)min​q′w.

The disutility is U(t)=max⁡k=1,…,K(αkt+βk)\mathbb U(t)=\max_{k=1,\dots,K}(\alpha_k t+\beta_k)U(t)=maxk=1,…,K​(αk​t+βk​) with αk≥0\alpha_k\ge0αk​≥0. The moment class P\mathcal PP consists of the distributions PPP of a random vector q~∈Rd\tilde q\in\mathbb R^dq~​∈Rd with EP[q~]=μ\mathbb E_P[\tilde q]=\muEP​[q~​]=μ and EP[q~q~′]=Q\mathbb E_P[\tilde q\tilde q']=QEP​[q~​q~​′]=Q. The worst-case value at xxx is

Z(x)=sup⁡P∈PEP[U(Q(q~,x))].Z(x)=\sup_{P\in\mathcal P}\mathbb E_P\big[\mathbb U(\mathcal Q(\tilde q,x))\big].Z(x)=P∈Psup​EP​[U(Q(q~​,x))].

Its dual (6) is

ZD(x)=min⁡Y,y,y0 Q⋅Y+μ′y+y0s.t.q′Yq+q′y+y0≥U(Q(q,x))  ∀q∈Rd,Z_D(x)=\min_{Y,y,y_0}\ Q\cdot Y+\mu'y+y_0\quad\text{s.t.}\quad q'Yq+q'y+y_0\ge\mathbb U(\mathcal Q(q,x))\ \ \forall q\in\mathbb R^d ,ZD​(x)=Y,y,y0​min​ Q⋅Y+μ′y+y0​s.t.q′Yq+q′y+y0​≥U(Q(q,x))  ∀q∈Rd,

with YYY symmetric and Q⋅Y=∑ijQijYijQ\cdot Y=\sum_{ij}Q_{ij}Y_{ij}Q⋅Y=∑ij​Qij​Yij​. Its semidefinite reformulation (8) has the dual (9):

ZDD(x)=max⁡ ∑k=1K(h−Tx)′pk+βkvk0s.t.∑k=1K(Vkvkvk′vk0)=(Qμμ′1), (Vkvkvk′vk0)⪰0, W′pk≤αkvk.Z_{DD}(x)=\max\ \sum_{k=1}^K (h-Tx)'p_k+\beta_kv_{k0}\quad\text{s.t.}\quad \sum_{k=1}^K\begin{pmatrix}V_k&v_k\\ v_k'&v_{k0}\end{pmatrix}=\begin{pmatrix}Q&\mu\\ \mu'&1\end{pmatrix},\ \begin{pmatrix}V_k&v_k\\ v_k'&v_{k0}\end{pmatrix}\succeq0,\ W'p_k\le\alpha_kv_k .ZDD​(x)=max k=1∑K​(h−Tx)′pk​+βk​vk0​s.t.k=1∑K​(Vk​vk′​​vk​vk0​​)=(Qμ′​μ1​), (Vk​vk′​​vk​vk0​​)⪰0, W′pk​≤αk​vk​.

Its variables are scaled conditional moments: vk0v_{k0}vk0​ is the probability that the kkkth piece of U\mathbb UU is active, and vkv_kvk​, VkV_kVk​ are the first and second moments of q~\tilde qq~​ on that event, multiplied by vk0v_{k0}vk0​.

The standing assumptions are Assumption 3, {p∈Rr:W′p≤q}≠∅\{p\in\mathbb R^r : W'p\le q\}\ne\emptyset{p∈Rr:W′p≤q}=∅ for every qqq, so that Q(q,x)\mathcal Q(q,x)Q(q,x) is finite, and Assumption 4, Q−μμ′≻0Q-\mu\mu'\succ0Q−μμ′≻0. Recourse sets are assumed nonempty.

Formalization targets

Goal: Theorem 2.2

For every x∈Xx\in Xx∈X there is a sequence Pj∈PP_j\in\mathcal PPj​∈P with EPj[U(Q(q~,x))]→Z(x)\mathbb E_{P_j}[\mathbb U(\mathcal Q(\tilde q,x))]\to Z(x)EPj​​[U(Q(q~​,x))]→Z(x), and

Z(x)=ZD(x)=ZDD(x),Z(x)=Z_D(x)=Z_{DD}(x),Z(x)=ZD​(x)=ZDD​(x),

where all three are finite optimal values: a supremum over a nonempty bounded-above set, an infimum over a nonempty bounded-below set, and a supremum over a nonempty bounded-above set.

Milestones

  1. Lemma 2.1: ZDD(x)≥Z(x)Z_{DD}(x)\ge Z(x)ZDD​(x)≥Z(x), in the form "each P∈PP\in\mathcal PP∈P gives a feasible point of (9) whose objective equals EP[U(Q)]\mathbb E_P[\mathbb U(\mathcal Q)]EP​[U(Q)]".
  2. (9) has an optimal solution.
  3. Q(⋅,x)\mathcal Q(\cdot,x)Q(⋅,x) is positively homogeneous and superadditive.
  4. If W′p≤αvW'p\le\alpha vW′p≤αv with α≥0\alpha\ge0α≥0 then αQ(v,x)≥(h−Tx)′p\alpha\mathcal Q(v,x)\ge(h-Tx)'pαQ(v,x)≥(h−Tx)′p.
  5. Jensen: E[Q(r~,x)]≤Q(Er~,x)\mathbb E[\mathcal Q(\tilde r,x)]\le\mathcal Q(\mathbb E\tilde r,x)E[Q(r~,x)]≤Q(Er~,x), with Q(r~,x)\mathcal Q(\tilde r,x)Q(r~,x) integrable.
  6. An optimal solution of (9) can be chosen so that every block has vk0>0v_{k0}>0vk0​>0 or vanishes.
  7. Strong duality Z(x)=ZD(x)Z(x)=Z_D(x)Z(x)=ZD​(x) (§2.1).

Significance

Theorem 2.2 says that the semidefinite bound is tight and that the worst case is approached by explicit mixtures. With probability vk0v_{k0}vk0​ the cost vector sits at the conditional mean vk/vk0v_k/v_{k0}vk​/vk0​, and with a small probability it is perturbed by a large Gaussian. The construction tells which scenarios a minimax solution guards against. The paper's numerical section uses it to stress-test solutions computed under other distributional assumptions. For the risk-neutral case (K=1K=1K=1) the bound collapses to Jensen's bound min⁡w∈X(x)μ′w\min_{w\in X(x)}\mu'wminw∈X(x)​μ′w. For K>1K>1K>1 it is a combination of Jensen bounds, one per piece of the disutility.

Theorem 2.2 is proved in the paper; no part of it, nor the strong duality of the moment problem that it relies on, is formalized on the platform or, to our knowledge, elsewhere. The mission asks for machine-checked proofs of the identity Z=ZD=ZDDZ=Z_D=Z_{DD}Z=ZD​=ZDD​ and of the steps of the extremal construction. Several of these are reusable beyond this paper: weak and strong duality of moment problems, the existence of optimal solutions of moment-type semidefinite programs, and Jensen's inequality for the value function of a linear program.

Difficulty

Most of the argument is linear programming and bookkeeping. The step Z(x)=ZD(x)Z(x)=Z_D(x)Z(x)=ZD​(x) is a strong-duality theorem for an infinite-dimensional linear program over measures. The paper cites it from Isii's theory of the moment problem, and none of that theory exists in Mathlib. The construction of near-extremal distributions also needs care. A single distribution in P\mathcal PP generally cannot attain Z(x)Z(x)Z(x), so the bound is reached only along a family whose second moments are matched by rare, large perturbations. Lemma 2.1 needs measurable selections of an active piece of U\mathbb UU and of a dual optimal solution of the second-stage program as functions of qqq. When the optimal solution of (9) has zero-weight blocks, the mixture is undefined until the solution is first rearranged.

Formalization scope

Vectors are Fin d → ℝ, matrices Matrix (Fin r) (Fin d) ℝ, and distributions are probability measures on Fin d → ℝ with square-integrable coordinates. They are not densities as in the paper's (5). The moment class uses the published MomentDRO.Conf definitions, and E[q~q~′]\mathbb E[\tilde q\tilde q']E[q~​q~​′] is the uncentred second moment. The paper writes ppp both for the dimension of qqq and for dual vectors. Here the dimension is ddd and dual vectors are named π. Indices kkk are zero-based. Bordered matrices are Matrix.fromBlocks on Fin d ⊕ Fin 1 and ⪰0\succeq0⪰0 is Matrix.PosSemidef. Q\mathcal QQ is a real infimum and the optimal values are real sSup/sInf of value sets. Every statement that uses an optimal value also asserts IsLUB/IsGLB, so junk values cannot make a statement true.

As printed, Assumption 2 (complete recourse) and Assumption 3 for all qqq contradict each other whenever WWW has a row. The formalization keeps Assumption 3 for all qqq and replaces complete recourse by nonemptiness of X(x)X(x)X(x), which is what §2's proofs use. Assumption 1 is not used and is omitted. The hypotheses are jointly satisfiable, for example by W=IW=IW=I, T=0T=0T=0, h=0h=0h=0, μ=0\mu=0μ=0 and Q=IQ=IQ=I.

The sequence clause of Theorem 2.2 alone holds for every finite supremum, so it does not capture the theorem. The goal therefore also asserts the equalities Z=ZD=ZDDZ=Z_D=Z_{DD}Z=ZD​=ZDD​, with all three values genuine, and these carry the content. A formalization that drops them, or states them only through junk values, is ruled out.

A complete development needs the duality theory of the moment problem, Jensen's inequality for concave functions on Rd\mathbb R^dRd, compactness arguments for semidefinite feasible sets, and multivariate Gaussian mixtures (ProbabilityTheory.multivariateGaussian in Mathlib). Proofs of individual milestones are welcome. So is a general moment-problem duality theorem from which strong_duality follows.

Selected references

  • D. Bertsimas, X. V. Doan, K. Natarajan, C.-P. Teo, Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion, Mathematics of Operations Research 35(3):580–602, 2010. https://doi.org/10.1287/moor.1100.0445
  • E. Delage, Y. Ye, Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems, Operations Research 58(3):595–612, 2010. https://doi.org/10.1287/opre.1090.0741
  • K. Isii, On sharpness of Tchebycheff-type inequalities, Annals of the Institute of Statistical Mathematics 14:185–197, 1962. https://doi.org/10.1007/BF02868641
  • D. Bertsimas, I. Popescu, Optimal Inequalities in Probability Theory: A Convex Optimization Approach, SIAM Journal on Optimization 15(3):780–804, 2005. https://doi.org/10.1137/S1052623401399903
11 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

Inventory Management of a Fast-Fashion Retail Network 2: The Tangent-Envelope Approximation of Expected Sales Is an Upper BoundResearch Paper

Motivation

Zara ships inventory from a central warehouse to each of its stores every week, and for a short-lived fashion item the warehouse holds a limited amount of each size. Deciding how many units of each size to ship to each store is therefore a constrained allocation problem whose objective is the expected sales a store will realize from a given inventory. Caro and Gallien (working paper, 2007; published in Operations Research, 2010) built such a model, embedded it in a weekly shipment optimization, and tested it in a field experiment in Zara's store network. The store-level sales model has one unusual feature, taken from Zara's practice: as soon as one of the major sizes of an item runs out, the whole item is removed from display, so stock-outs of different sizes interact.

The expected sales under that policy have no closed form usable inside a mixed integer program. The paper replaces them by an explicit piecewise-linear function and asserts that this replacement is an upper bound. This mission formalizes that claim, the chain of identities and inequalities that lead to it, and the paper's statement that its shipment program represents the approximation exactly.

Setting

A reference is offered in a finite set of sizes S=S+∪S−\mathcal S = \mathcal S^+ \cup \mathcal S^-S=S+∪S−, with major sizes S+\mathcal S^+S+ and minor sizes S−=S∖S+\mathcal S^- = \mathcal S \setminus \mathcal S^+S−=S∖S+. Sale opportunities for size sss follow a Poisson process Ns(t)N_s(t)Ns​(t) with rate λs>0\lambda_s > 0λs​>0, independent across sizes, where ttt is the time since the last replenishment and T>0T > 0T>0 is the time between replenishments.

Given an inventory vector q∈NSq \in \mathbb N^{\mathcal S}q∈NS, the virtual stockout time of size sss is τs(qs)=inf⁡{t≥0:Ns(t)=qs}\tau_s(q_s) = \inf\{t \ge 0 : N_s(t) = q_s\}τs​(qs​)=inf{t≥0:Ns​(t)=qs​}, and τA=min⁡s∈Aτs(qs)\tau_{\mathcal A} = \min_{s \in \mathcal A}\tau_s(q_s)τA​=mins∈A​τs​(qs​) for a set of sizes A\mathcal AA. Writing a∧b=min⁡(a,b)a \wedge b = \min(a,b)a∧b=min(a,b), the number of sales in one period is

G(q)=∑s∈S+Ns(τS+∧T)+∑s∈S−Ns(τS+∪{s}∧T),G(q) = \sum_{s \in \mathcal S^+} N_s(\tau_{\mathcal S^+} \wedge T) + \sum_{s \in \mathcal S^-} N_s(\tau_{\mathcal S^+ \cup \{s\}} \wedge T),G(q)=s∈S+∑​Ns​(τS+​∧T)+s∈S−∑​Ns​(τS+∪{s}​∧T),

since every size stops selling when the first major size runs out, and a minor size also stops when it runs out itself. The expected sales function is gλ(q)=E[G(q)]g_\lambda(q) = \mathbb E[G(q)]gλ​(q)=E[G(q)].

For the approximation, let γ(a,b)=∫0bva−1e−v dv\gamma(a,b) = \int_0^b v^{a-1}e^{-v}\,dvγ(a,b)=∫0b​va−1e−vdv be the lower incomplete Gamma function, and define the tangent coefficients

ak(λ)=γ(k+1,λT)λ k!,bi(λ)=∑k=0i−1ak(λ),a_k(\lambda) = \frac{\gamma(k+1, \lambda T)}{\lambda\, k!}, \qquad b_i(\lambda) = \sum_{k=0}^{i-1} a_k(\lambda),ak​(λ)=λk!γ(k+1,λT)​,bi​(λ)=k=0∑i−1​ak​(λ),

with the tangent at i=∞i = \inftyi=∞ equal to the constant TTT. For each size choose a nonempty finite set N(λs)⊆N∪{∞}\mathcal N(\lambda_s) \subseteq \mathbb N \cup \{\infty\}N(λs​)⊆N∪{∞} of tangent indices. The approximate expected sales function is

g~λ(q)=λS+min⁡s∈S+min⁡i∈N(λs){ai(λs)(qs−i)+bi(λs)}+∑s∈S−λsmin⁡s′∈S+∪{s}min⁡i∈N(λs′){ai(λs′)(qs′−i)+bi(λs′)},\tilde g_\lambda(q) = \lambda_{\mathcal S^+} \min_{s \in \mathcal S^+} \min_{i \in \mathcal N(\lambda_s)} \{a_i(\lambda_s)(q_s - i) + b_i(\lambda_s)\} + \sum_{s \in \mathcal S^-} \lambda_s \min_{s' \in \mathcal S^+ \cup \{s\}} \min_{i \in \mathcal N(\lambda_{s'})} \{a_i(\lambda_{s'})(q_{s'} - i) + b_i(\lambda_{s'})\},g~​λ​(q)=λS+​s∈S+min​i∈N(λs​)min​{ai​(λs​)(qs​−i)+bi​(λs​)}+s∈S−∑​λs​s′∈S+∪{s}min​i∈N(λs′​)min​{ai​(λs′​)(qs′​−i)+bi​(λs′​)},

with λS+=∑s∈S+λs\lambda_{\mathcal S^+} = \sum_{s\in\mathcal S^+}\lambda_sλS+​=∑s∈S+​λs​. In Lean the objects are expectedSales, hA (E[τA∧T]\mathbb E[\tau_{\mathcal A}\wedge T]E[τA​∧T]), a, b, tangent and gTilde in the namespace FastFashion.Approx.

Formalization targets

Goal: the approximation is an upper bound

For every independent Poisson family with positive rates, every T>0T > 0T>0, every nonempty S+\mathcal S^+S+, every choice of nonempty finite tangent sets, and every q∈NSq \in \mathbb N^{\mathcal S}q∈NS,

gλ(q)≤g~λ(q).g_\lambda(q) \le \tilde g_\lambda(q).gλ​(q)≤g~​λ​(q).

The statement fixes no tangent set, so it covers the paper's numerical choice (7) and every refinement of it.

Milestones

  1. Eq. (2): gλ(q)=λS+E[τS+∧T]+∑s∈S−λsE[τS+∪{s}∧T]g_\lambda(q) = \lambda_{\mathcal S^+}\mathbb E[\tau_{\mathcal S^+}\wedge T] + \sum_{s\in\mathcal S^-}\lambda_s\mathbb E[\tau_{\mathcal S^+\cup\{s\}}\wedge T]gλ​(q)=λS+​E[τS+​∧T]+∑s∈S−​λs​E[τS+∪{s}​∧T].
  2. Eq. (3): E[τD∧T]≤min⁡s∈DE[τs∧T]\mathbb E[\tau_{\mathcal D}\wedge T] \le \min_{s\in\mathcal D}\mathbb E[\tau_s\wedge T]E[τD​∧T]≤mins∈D​E[τs​∧T] for nonempty D\mathcal DD.
  3. Eqs. (4)–(5): E[τs∧T]=1λs∑k=1qsP(Ns(T)≥k)=∑k=1qsγ(k,λsT)λsΓ(k)\mathbb E[\tau_s\wedge T] = \frac1{\lambda_s}\sum_{k=1}^{q_s}\mathbb P(N_s(T)\ge k) = \sum_{k=1}^{q_s}\frac{\gamma(k,\lambda_sT)}{\lambda_s\Gamma(k)}E[τs​∧T]=λs​1​∑k=1qs​​P(Ns​(T)≥k)=∑k=1qs​​λs​Γ(k)γ(k,λs​T)​.
  4. The terms ak(λ)a_k(\lambda)ak​(λ) are positive and strictly decreasing in kkk.
  5. Eq. (6): E[τs∧T]=min⁡i∈N∪{∞}{ai(λs)(qs−i)+bi(λs)}\mathbb E[\tau_s\wedge T] = \min_{i\in\mathbb N\cup\{\infty\}}\{a_i(\lambda_s)(q_s-i)+b_i(\lambda_s)\}E[τs​∧T]=mini∈N∪{∞}​{ai​(λs​)(qs​−i)+bi​(λs​)}, the minimum attained.

Further result: the MIP represents the approximation

In the shipment program (MIP) (13)–(19) of §3.2, with positive prices, every optimal solution has zj=g~λj(xj+Ij)z_j = \tilde g_{\lambda_j}(x_j + I_j)zj​=g~​λj​​(xj​+Ij​) at every store jjj.

Significance

The upper bound is what makes the paper's optimization coherent: the MIP maximizes ∑jPjg~λj\sum_j P_j \tilde g_{\lambda_j}∑j​Pj​g~​λj​​, and the bound guarantees that this objective never underestimates the expected revenue of a shipment plan, with an error controlled by the number of tangents. Identity (6) exhibits E[τs∧T]\mathbb E[\tau_s \wedge T]E[τs​∧T] as a concave function of qsq_sqs​ with explicit Erlang-type slopes; (2) is a standard optional-sampling identity for compensated Poisson processes stopped at a bounded stopping time; and the MIP statement is the step that turns a minimum of affine functions into linear constraints.

The paper proves none of these in detail: (2), (4) and (5) are justified by a reference to the optional sampling theorem, (6) by a sentence on discrete concavity, and the upper bound and the MIP claim by one sentence each. None of the statements has a machine-checked proof. A formalization produces a checked chain from the Poisson model to the deterministic program, fixes the indexing error in the printed coefficients of (6), and isolates the exact hypotheses (nonempty major sizes, nonempty tangent sets, positive prices) under which the claims hold.

Difficulty

The deterministic parts — (3) given pathwise monotonicity, the envelope inequality given concavity, and the MIP argument — are short. The probabilistic identities are not. Equation (2) needs the optional sampling theorem for the compensated process Ns(t)−λstN_s(t) - \lambda_s tNs​(t)−λs​t in continuous time, applied at τA∧T\tau_{\mathcal A} \wedge TτA​∧T (the paper cites Karatzas and Shreve 1991), which requires showing that τA\tau_{\mathcal A}τA​ is a stopping time for the joint filtration of the family and that NsN_sNs​ is still a martingale with respect to that larger filtration; this is where independence across sizes enters. Equation (4) needs the distribution of τs(qs)\tau_s(q_s)τs​(qs​), the qsq_sqs​-th arrival time, which is Erlang; the statement in the model is about first hitting times of a counting process, not about sums of exponential inter-arrival times, so the link between the two descriptions has to be built. Equation (5) needs the identity P(N(T)≥k)=γ(k,λT)/Γ(k)\mathbb P(N(T) \ge k) = \gamma(k, \lambda T)/\Gamma(k)P(N(T)≥k)=γ(k,λT)/Γ(k) between Poisson tails and the incomplete Gamma function.

A tempting shortcut is to define gλg_\lambdagλ​ directly by formula (2), or E[τs∧T]\mathbb E[\tau_s\wedge T]E[τs​∧T] by formula (4); both make the corresponding milestones definitional and the goal a statement about formulas rather than about sales. The formalization defines gλg_\lambdagλ​ from GGG and hAh^{\mathcal A}hA from the stopping times.

Formalization scope

  • Model. Sizes form a finite type; the major sizes are a Finset and the minor sizes its complement. The demand is a structure IsPoissonFamily λ N P: each NsN_sNs​ is a counting process with Ns(0)=0N_s(0)=0Ns​(0)=0, non-decreasing right-continuous paths with unit jumps, Poisson increments of mean λs(t−u)\lambda_s(t-u)λs​(t−u), independent increments, and the processes are independent across sizes. PPP is a probability measure.
  • Stockout times take values in R∪{+∞}\mathbb R \cup \{+\infty\}R∪{+∞} (WithTop ℝ), so the infimum of an empty set is +∞+\infty+∞, never 000; τA∧T\tau_{\mathcal A}\wedge TτA​∧T is a real number in [0,T][0,T][0,T].
  • Expectations are Bochner integrals. They are not junk: 0≤G(q)≤∑sNs(T)0 \le G(q) \le \sum_s N_s(T)0≤G(q)≤∑s​Ns​(T), which is integrable, and τA∧T∈[0,T]\tau_{\mathcal A}\wedge T \in [0,T]τA​∧T∈[0,T].
  • Corrected coefficients. As printed, ak=γ(k,λT)/(λΓ(k))a_k = \gamma(k,\lambda T)/(\lambda\Gamma(k))ak​=γ(k,λT)/(λΓ(k)) and b1=a0b_1 = a_0b1​=a0​ involves Γ(0)\Gamma(0)Γ(0); the formalization uses ak=γ(k+1,λT)/(λ k!)a_k = \gamma(k+1,\lambda T)/(\lambda\,k!)ak​=γ(k+1,λT)/(λk!), matching the paper's description of aka_kak​ as the probability that the (k+1)(k+1)(k+1)-th unit sells.
  • Tangent sets. The rule (7), "bi(λs)≈0,0.3T,0.6T,0.8T,0.9T,Tb_i(\lambda_s) \approx 0, 0.3T, 0.6T, 0.8T, 0.9T, Tbi​(λs​)≈0,0.3T,0.6T,0.8T,0.9T,T", is approximate and is replaced by an arbitrary nonempty finite set N(λs)⊆N∪{∞}\mathcal N(\lambda_s) \subseteq \mathbb N\cup\{\infty\}N(λs​)⊆N∪{∞}.
  • Added hypotheses. S+≠∅\mathcal S^+ \ne \emptysetS+=∅ (for (8) and the goal), nonempty D\mathcal DD in (3), and Pj>0P_j > 0Pj​>0 in the MIP statement.
  • MIP. Optimality is defined as feasibility plus an objective at least that of every feasible point; existence of an optimum is not asserted.

The paper's further remark that g~λ\tilde g_\lambdag~​λ​ inherits the qualitative properties of Proposition 1, and the multicolor extension of Appendix §5.2, are not included. Contributions of general infrastructure are welcome: optional sampling for continuous-time counting processes, Erlang hitting-time laws for Poisson processes, and the Poisson-tail/incomplete-Gamma identity are all reusable well beyond this mission.

Selected references

  • F. Caro, J. Gallien, Inventory Management of a Fast-Fashion Retail Network, working paper (August 2, 2007); published in Operations Research 58(2), 2010. https://doi.org/10.1287/opre.1090.0698
  • I. Karatzas, S. E. Shreve, Brownian Motion and Stochastic Calculus, 2nd ed., Springer, 1991. https://doi.org/10.1007/978-1-4612-0949-2
10 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

Supply Chain Coordination Under Channel Rebates with Sales Effort Effects IV: A Larger Return Credit Strictly Increases the Retailer's Sales EffortResearch Paper

Returns and the retailer's incentive for sales effort

A manufacturer that sells through a retailer can accept returns: it pays a return credit bbb for every unit the retailer has not sold at the end of the season. Returns policies are common in publishing, software and computer hardware, and since Pasternack (Marketing Science, 1985) they have been studied as a way to make the retailer order more. Retailers also raise demand through sales effort: merchandising, shelf space, point-of-sale advertising. A recurring view in the marketing and operations literature is that returns weaken this incentive. Padmanabhan and Png (1995, p. 70) write that "by reducing the risk of losses due to excess inventory, a returns policy lessens some of the retailer's incentive to invest in such efforts", and Kandel (1996, p. 348) makes the same argument for consignment.

T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects (Management Science 48(8), 2002), studies a newsvendor retailer who chooses an order quantity and a sales effort level before demand is observed. Its Proposition 4 shows that in this model the conventional view is reversed: a larger return credit makes the retailer exert strictly more effort. This mission formalizes that proposition and the solution of the retailer's problem it rests on.

Setting

Prices satisfy 0<c<w<p0<c<w<p0<c<w<p and s<cs<cs<c (Assumption A1): ppp is the retail price, www the wholesale price, ccc the manufacturing cost and sss the salvage value, which may be negative. A demand factor ξ≥0\xi\ge 0ξ≥0 has a density φ\varphiφ with φ(ξ)>0\varphi(\xi)>0φ(ξ)>0 for every ξ≥0\xi\ge0ξ≥0 (Assumption A4), distribution function Φ(Q)=∫0Qφ\Phi(Q)=\int_0^Q\varphiΦ(Q)=∫0Q​φ and partial mean Γ(Q)=∫0Qξ dΦ(ξ)\Gamma(Q)=\int_0^Q\xi\,d\Phi(\xi)Γ(Q)=∫0Q​ξdΦ(ξ).

The retailer chooses an effort level e≥0e\ge0e≥0, and demand is eξe\xieξ. Effort costs V(e)V(e)V(e), where VVV is strictly convex and strictly increasing with V(0)=0V(0)=0V(0)=0 (Assumption A5; the paper declares every convexity and monotonicity statement strict). Write Λ(γ)=γV′(γ)−V(γ)\Lambda(\gamma)=\gamma V'(\gamma)-V(\gamma)Λ(γ)=γV′(γ)−V(γ).

Under a returns-only contract (w,b)(w,b)(w,b) with b∈[s,w)b\in[s,w)b∈[s,w), the retailer orders Q≥0Q\ge0Q≥0, exerts effort e≥0e\ge 0e≥0, and earns the expected profit

R‾b(Q,e)=−wQ+p Emin⁡(Q,eξ)+b E(Q−eξ)+−V(e).\underline R_b(Q,e)=-wQ+p\,E\min(Q,e\xi)+b\,E(Q-e\xi)^+-V(e).R​b​(Q,e)=−wQ+pEmin(Q,eξ)+bE(Q−eξ)+−V(e).

This is the integrated channel's profit Π(Q,e)=−cQ+pEmin⁡(Q,eξ)+sE(Q−eξ)+−V(e)\Pi(Q,e)=-cQ+pE\min(Q,e\xi)+sE(Q-e\xi)^+-V(e)Π(Q,e)=−cQ+pEmin(Q,eξ)+sE(Q−eξ)+−V(e) with www in place of ccc and bbb in place of sss. An optimal pair is a maximizer of R‾b\underline R_bR​b​ over Q≥0Q\ge0Q≥0, e≥0e\ge0e≥0. The paper's e‾\underline ee​ is the effort of such a pair, and Q‾0\underline Q_0Q​0​ is the critical fractile Φ(Q‾0)=(p−w)/(p−b)\Phi(\underline Q_0)=(p-w)/(p-b)Φ(Q​0​)=(p−w)/(p−b).

Formalization targets

Goal: Proposition 4 (p. 1004)

If s≤b2<b1<ws\le b_2<b_1<ws≤b2​<b1​<w, (Q1,e1)(Q_1,e_1)(Q1​,e1​) is an optimal pair under the credit b1b_1b1​, (Q2,e2)(Q_2,e_2)(Q2​,e2​) is an optimal pair under b2b_2b2​, and e2>0e_2>0e2​>0, then

e2<e1.e_2<e_1 .e2​<e1​.

The paper writes this as ∂e‾/∂b>0\partial\underline e/\partial b>0∂e​/∂b>0. Its proof shows strict monotonicity, and that is the statement here.

Milestone 1: the order for a given effort (§4.2, p. 1000)

For a fixed e>0e>0e>0, the unique maximizer of Q↦R‾b(Q,e)Q\mapsto\underline R_b(Q,e)Q↦R​b​(Q,e) over Q≥0Q\ge0Q≥0 is Q2=e Q‾0Q_2=e\,\underline Q_0Q2​=eQ​0​, and

max⁡Q≥0R‾b(Q,e)=e (p−b) Γ(Q‾0)−V(e).\max_{Q\ge0}\underline R_b(Q,e)=e\,(p-b)\,\Gamma(\underline Q_0)-V(e).Q≥0max​R​b​(Q,e)=e(p−b)Γ(Q​0​)−V(e).

Milestone 2: the optimal effort (§4.2, p. 1000)

An optimal pair (Q,e‾)(Q,\underline e)(Q,e​) with e‾>0\underline e>0e​>0 satisfies

V′(e‾)=(p−b) Γ(Q‾0),Q=e‾ Q‾0,R‾b(Q,e‾)=Λ(e‾),V'(\underline e)=(p-b)\,\Gamma(\underline Q_0),\qquad Q=\underline e\,\underline Q_0,\qquad \underline R_b(Q,\underline e)=\Lambda(\underline e),V′(e​)=(p−b)Γ(Q​0​),Q=e​Q​0​,R​b​(Q,e​)=Λ(e​),

and conversely every e>0e>0e>0 solving this first-order condition gives the optimal pair (eQ‾0,e)(e\underline Q_0,e)(eQ​0​,e).

Significance

The result. Proposition 4 separates two effects of a return credit. For a fixed order quantity, a larger credit lowers the marginal value of effort: it pays the retailer for unsold units, and effort only matters through sold units. This is the fixed-quantity comparison on which the conventional view rests; Cachon's survey states it for buy-backs as Eq. (19) (on Prove2Me as CachonCoord.EffortNewsvendor.sec_6_4_1_effort_coordination, clause 1). Once the order quantity is chosen together with the effort, the larger credit raises the order, and the effort follows. For the multiplicative demand model the net effect is unambiguous for every demand density and every convex effort cost. A manufacturer that wants more retailer effort can therefore use the return credit as a lever, and a model that ignores the quantity response gets the sign wrong.

Formalizing it. The result is proved in the paper, in a four-line appendix argument that relies on the §4.2 solution of the retailer's problem; neither is machine-checked anywhere. The mission produces a checked newsvendor-with-effort solution (the scaling Q2=eQ‾0Q_2=e\underline Q_0Q2​=eQ​0​ and the profit Λ(e‾)\Lambda(\underline e)Λ(e​)), which the other missions of this series and any multiplicative-effort supply-chain model can reuse, and a checked statement of the comparative statics in the return credit.

Difficulty

The obvious argument differentiates the retailer's first-order condition in bbb with the order held fixed, and it gives the wrong sign; the order quantity must be re-optimized. The correct comparison runs through the reduced problem in the effort alone, and it needs the §4.2 solution in full: the scaling of the optimal order with the effort, which turns Emin⁡(Q,eξ)E\min(Q,e\xi)Emin(Q,eξ) and E(Q−eξ)+E(Q-e\xi)^+E(Q−eξ)+ into newsvendor expectations of ξ\xiξ at Q/eQ/eQ/e; the value of the optimal order as a function of eee; and the first-order characterization of the optimal effort. The comparison across credits then involves two objects: the function Λ\LambdaΛ, and the retailer's reduced profits under the two credits at a common effort level. The statement compares maximizers of two different optimization problems, not roots of an equation, so a formal proof must connect optimality of the pair to the first-order condition, which uses the strict convexity of VVV and the positivity of the density.

Formalization scope

Everything lives in the namespace ChannelRebate.ReturnsEffort. The definitions file holds:

  • Demand: a measurable density φ\varphiφ, zero on (−∞,0)(-\infty,0)(−∞,0), positive on [0,∞)[0,\infty)[0,∞), integrating to 111, with finite mean;
  • the law of ξ\xiξ;
  • Φ\PhiΦ and Γ\GammaΓ as interval integrals;
  • EffortCost: A5 with strict convexity and strict monotonicity on [0,∞)[0,\infty)[0,∞) and V(0)=0V(0)=0V(0)=0;
  • Λ\LambdaΛ;
  • the retailer's profit returnsProfit;
  • optimal orders and optimal pairs as maximizers over Q≥0Q\ge0Q≥0 (and e≥0e\ge0e≥0).

The expectations are the published CachonCoord.Newsvendor.expSales and expLeftover applied to the law of eξe\xieξ (the image of the law of ξ\xiξ under x↦exx\mapsto exx↦ex).

The formalization makes the following commitments, each recorded on its item:

  • Φ−1\Phi^{-1}Φ−1 is never an inverse function: Q‾0\underline Q_0Q​0​ is a positive solution of Φ(Q‾0)=(p−w)/(p−b)\Phi(\underline Q_0)=(p-w)/(p-b)Φ(Q​0​)=(p−w)/(p−b).
  • The paper writes (∂/∂e)V(\partial/\partial e)V(∂/∂e)V without stating that VVV is differentiable. Differentiability on (0,∞)(0,\infty)(0,∞), with derivative V′V'V′, is a hypothesis.
  • The paper restricts attention to strictly positive effort (p. 1000). The goal therefore assumes e2>0e_2>0e2​>0; without it both optimal efforts could be 000 when V′(0+)V'(0^+)V′(0+) is large, and the strict inequality would fail.
  • Existence of optimal pairs is a hypothesis, as on p. 999 ("assume the cost of effort function and demand distribution are chosen such that the existence of an optimal solution is assured").
  • The credit satisfies b<wb<wb<w strictly; at b=wb=wb=w the critical fractile is undefined.

The goal is about optimal pairs of the joint problem. Defining e‾\underline ee​ as the root of the first-order condition, or fixing the order quantity and varying bbb, would give a different and, in the second case, false statement; neither is the target.

Contributions are welcome:

  • a proof of the scaling identity Emin⁡(Q,eξ)=e Emin⁡(Q/e,ξ)E\min(Q,e\xi)=e\,E\min(Q/e,\xi)Emin(Q,eξ)=eEmin(Q/e,ξ);
  • a proof of the newsvendor value identity (p−b)Emin⁡(q,ξ)−(w−b)q=(p−b)Γ(q)(p-b)E\min(q,\xi)-(w-b)q=(p-b)\Gamma(q)(p−b)Emin(q,ξ)−(w−b)q=(p−b)Γ(q) at the critical fractile, reusable for any newsvendor with a density;
  • proofs of the two milestones;
  • the goal theorem.

The two facts the paper's proof uses — that Λ\LambdaΛ is strictly increasing on (0,∞)(0,\infty)(0,∞), and that the retailer's reduced profit at a fixed effort increases with the credit — may be posted as supporting theorems.

Selected references

  • T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8):992–1007, 2002. https://doi.org/10.1287/mnsc.48.8.992.168
  • B. A. Pasternack, Optimal Pricing and Return Policies for Perishable Commodities, Marketing Science 4(2):166–176, 1985. https://doi.org/10.1287/mksc.4.2.166
  • V. Padmanabhan, I. P. L. Png, Returns Policies: Make Money by Making Good, Sloan Management Review 37(1):65–72, 1995.
  • E. Kandel, The Right to Return, Journal of Law and Economics 39(1):329–356, 1996. https://doi.org/10.1086/467352
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in OR & MS 11, Elsevier, 2003, §6.4.1. https://doi.org/10.1016/S0927-0507(03)11006-7
5 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

Supply Chain Coordination Under Channel Rebates with Sales Effort Effects II: A Target Rebate and Returns Contract Coordinates Effort and Quantity Under Uniform DemandResearch Paper

Motivation

Manufacturers of computer hardware, software and automobiles routinely pay their retailers channel rebates: a payment per unit the retailer sells to end customers. A target rebate pays only for units sold beyond a target level. These industries also commonly offer returns: a credit for each unsold unit. Both instruments are used to change the retailer's behaviour, and the retailer controls two things that matter to the manufacturer: how much stock she orders, and how much sales effort she exerts to raise demand. Effort cannot be observed or written into a contract, but sales can.

T. A. Taylor's paper (Management Science 48(8), 2002) asks whether a contract built on sales and returns can make an independent retailer choose the effort level and the order quantity that maximize the profit of the whole supply chain, while splitting that profit in any desired proportion. Its Proposition 2 shows that returns alone, linear rebates alone, or target rebates alone cannot do this. Its Theorem 2, the goal of this mission, shows that a target rebate combined with returns can, when demand is uniform and effort cost is quadratic.

Setting

A manufacturer with unit production cost ccc sells to a retailer at wholesale price www; the retailer sells at the fixed retail price ppp, and unsold units have salvage value sss. The standing assumption is 0<c<w<p0<c<w<p0<c<w<p and s<cs<cs<c (sss may be negative). Before demand is seen, the retailer chooses an order quantity Q≥0Q\ge0Q≥0 and an effort level e≥0e\ge0e≥0. Demand is eξe\xieξ, where ξ\xiξ is uniform on [0,1][0,1][0,1], with distribution function Φ\PhiΦ and Γ(x)=∫0xξ dΦ(ξ)\Gamma(x)=\int_0^x\xi\,d\Phi(\xi)Γ(x)=∫0x​ξdΦ(ξ). Effort costs V(e)=ae2/2V(e)=ae^2/2V(e)=ae2/2, a>0a>0a>0.

The integrated channel, which owns both firms, earns

Π(Q,e)=−cQ+pEmin⁡(Q,eξ)+sE(Q−eξ)+−V(e).\Pi(Q,e)=-cQ+pE\min(Q,e\xi)+sE(Q-e\xi)^+-V(e).Π(Q,e)=−cQ+pEmin(Q,eξ)+sE(Q−eξ)+−V(e).

Its optimum uses the critical fractile Qˉ0\bar Q_0Qˉ​0​, defined by Φ(Qˉ0)=(p−c)/(p−s)\Phi(\bar Q_0)=(p-c)/(p-s)Φ(Qˉ​0​)=(p−c)/(p−s), the effort eˉ=(p−s)Γ(Qˉ0)/a\bar e=(p-s)\Gamma(\bar Q_0)/aeˉ=(p−s)Γ(Qˉ​0​)/a and the order Qˉ=eˉQˉ0\bar Q=\bar e\bar Q_0Qˉ​=eˉQˉ​0​. Its optimal profit is Π=Λ(eˉ)\Pi=\Lambda(\bar e)Π=Λ(eˉ), where Λ(γ)=γV′(γ)−V(γ)\Lambda(\gamma)=\gamma V'(\gamma)-V(\gamma)Λ(γ)=γV′(γ)−V(γ).

A target rebate and returns contract (w,u,b,T)(w,u,b,T)(w,u,b,T) pays the retailer u>0u>0u>0 for every unit sold beyond the target TTT, and credits her b∈[s,w)b\in[s,w)b∈[s,w) for every unsold unit. Her profit is

R(Q,e∣T)=−wQ+pEmin⁡(Q,eξ)+uE(min⁡(Q,eξ)−T)++bE(Q−eξ)+−V(e).R(Q,e\mid T)=-wQ+pE\min(Q,e\xi)+uE(\min(Q,e\xi)-T)^+ +bE(Q-e\xi)^+-V(e).R(Q,e∣T)=−wQ+pEmin(Q,eξ)+uE(min(Q,eξ)−T)++bE(Q−eξ)+−V(e).

The manufacturer earns M(Q,e∣T)=(w−c)Q−uE(min⁡(Q,eξ)−T)+−(b−s)E(Q−eξ)+M(Q,e\mid T)=(w-c)Q-uE(\min(Q,e\xi)-T)^+-(b-s)E(Q-e\xi)^+M(Q,e∣T)=(w−c)Q−uE(min(Q,eξ)−T)+−(b−s)E(Q−eξ)+. The other quantities the statements use are:

  • the fractiles Q‾0\underline Q_0Q​0​ and Q‾1\underline Q_1Q​1​, with Φ(Q‾0)=(p−w)/(p−b)\Phi(\underline Q_0)=(p-w)/(p-b)Φ(Q​0​)=(p−w)/(p−b) and Φ(Q‾1)=(p+u−w)/(p+u−b)\Phi(\underline Q_1)=(p+u-w)/(p+u-b)Φ(Q​1​)=(p+u−w)/(p+u−b);
  • the returns-only effort e‾=(p−b)Γ(Q‾0)/a\underline e=(p-b)\Gamma(\underline Q_0)/ae​=(p−b)Γ(Q​0​)/a;
  • a threshold τ∈[Q‾0,Q‾1]\tau\in[\underline Q_0,\underline Q_1]τ∈[Q​0​,Q​1​] that separates the retailer's low and high orders;
  • the retailer's best profit at effort eee, A(e∣T)=max⁡Q≥0R(Q,e∣T)A(e\mid T)=\max_{Q\ge0}R(Q,e\mid T)A(e∣T)=maxQ≥0​R(Q,e∣T).

Contract terms of Theorem 2. Put ζ(T)=4a2(p−s)3T2\zeta(T)=4a^2(p-s)^3T^2ζ(T)=4a2(p−s)3T2 and

u(T)=(w−c)(p−c)5(p−c)5−ζ(T),b(T)=s+(w−c)(p−c)6−(p−s)ζ(T)(p−c)6−(p−c)ζ(T),T3=(p−c)32a(p−s)2.u(T)=(w-c)\frac{(p-c)^5}{(p-c)^5-\zeta(T)},\qquad b(T)=s+(w-c)\frac{(p-c)^6-(p-s)\zeta(T)}{(p-c)^6-(p-c)\zeta(T)},\qquad T_3=\frac{(p-c)^3}{2a(p-s)^2}.u(T)=(w−c)(p−c)5−ζ(T)(p−c)5​,b(T)=s+(w−c)(p−c)6−(p−c)ζ(T)(p−c)6−(p−s)ζ(T)​,T3​=2a(p−s)2(p−c)3​.

T1T_1T1​ and T2T_2T2​ are the fixed points on [0,T3][0,T_3][0,T3​] of T↦e‾τT\mapsto\underline e\tauT↦e​τ and T↦eˉτT\mapsto\bar e\tauT↦eˉτ, with e‾\underline ee​ and τ\tauτ evaluated at u(T)u(T)u(T), b(T)b(T)b(T). L‾(T,w)\underline L(T,w)L​(T,w) and Lˉ(T)\bar L(T)Lˉ(T) are the retailer's profits at effort e‾\underline ee​ and at effort eˉ\bar eeˉ.

Formalization targets

Goal: Theorem 2 (p. 1002)

For every κ∈(0,Π)\kappa\in(0,\Pi)κ∈(0,Π) there is ε0>0\varepsilon_0>0ε0​>0 such that for every ε∈(0,min⁡(κ,ε0))\varepsilon\in(0,\min(\kappa,\varepsilon_0))ε∈(0,min(κ,ε0​)) the following holds. Pairs (w∗,T∗)(w^*,T^*)(w∗,T∗) with

w∗∈(c,p),T∗∈(T1,T2),L‾(T∗,w∗)=κ−ε,Lˉ(T∗)=κw^*\in(c,p),\qquad T^*\in(T_1,T_2),\qquad \underline L(T^*,w^*)=\kappa-\varepsilon,\qquad \bar L(T^*)=\kappaw∗∈(c,p),T∗∈(T1​,T2​),L​(T∗,w∗)=κ−ε,Lˉ(T∗)=κ

exist. Every such pair gives u∗=u(T∗)>0u^*=u(T^*)>0u∗=u(T∗)>0, b∗=b(T∗)∈(s,w∗)b^*=b(T^*)\in(s,w^*)b∗=b(T∗)∈(s,w∗) and T∗>0T^*>0T∗>0. The pair (Qˉ,eˉ)(\bar Q,\bar e)(Qˉ​,eˉ) is the retailer's unique optimum under (w∗,u∗,b∗,T∗)(w^*,u^*,b^*,T^*)(w∗,u∗,b∗,T∗), and

R(Qˉ,eˉ∣T∗)=κ,M(Qˉ,eˉ∣T∗)=Π−κ.R(\bar Q,\bar e\mid T^*)=\kappa,\qquad M(\bar Q,\bar e\mid T^*)=\Pi-\kappa.R(Qˉ​,eˉ∣T∗)=κ,M(Qˉ​,eˉ∣T∗)=Π−κ.

Milestones

  1. §4.1: (Qˉ,eˉ)(\bar Q,\bar e)(Qˉ​,eˉ) is the unique maximizer of Π\PiΠ, with value Λ(eˉ)\Lambda(\bar e)Λ(eˉ).
  2. §4.2: under returns alone, (e‾ Q‾0,e‾)(\underline e\,\underline Q_0,\underline e)(e​Q​0​,e​) is the retailer's unique optimum, with value Λ(e‾)\Lambda(\underline e)Λ(e​).
  3. Lemma 2: at effort eee the retailer orders eQ‾0e\underline Q_0eQ​0​ if e<T/τe<T/\taue<T/τ, eQ‾1e\underline Q_1eQ​1​ if e>T/τe>T/\taue>T/τ, and either if e=T/τe=T/\taue=T/τ.
  4. The two-branch formula for A(e∣T)A(e\mid T)A(e∣T). Its derivative jumps up at T/τT/\tauT/τ, so T/τT/\tauT/τ is never optimal.
  5. Lemma 3: A(⋅∣T)A(\cdot\mid T)A(⋅∣T) is concave on [0,T/τ)[0,T/\tau)[0,T/τ), and either convex then concave, or concave, on (T/τ,∞)(T/\tau,\infty)(T/τ,∞).
  6. Lemma 4: a unique threshold Υ\UpsilonΥ decides whether the optimal effort lies above T/τT/\tauT/τ (at e^\hat ee^) or equals e‾\underline ee​.
  7. Lemma 5: the retailer's optimal (Q,e)(Q,e)(Q,e) in the three cases T<ΥT<\UpsilonT<Υ, T>ΥT>\UpsilonT>Υ, T=ΥT=\UpsilonT=Υ.
  8. Lemma 6: T1T_1T1​ and T2T_2T2​ exist, are unique, and 0<T1<T2<T30<T_1<T_2<T_30<T1​<T2​<T3​.

Significance

The result. Theorem 2 shows that two contractible instruments can align two decisions, one of them not contractible. The rebate pushes effort and quantity up when sales are high, and the return credit raises both when demand is low. Together they reproduce the integrated channel's optimum (Qˉ,eˉ)(\bar Q,\bar e)(Qˉ​,eˉ), and the free parameter κ\kappaκ allocates the profit Π\PiΠ between the firms in any proportion. Proposition 2 of the same paper rules out each instrument alone. This makes Theorem 2 the basis for the paper's recommendation that rebates and returns be used together. The uniform instance is the only one in which the paper proves this; for normal demand it gives only numerical evidence.

Formalizing it. The theorem is proved in the paper; it has not been formalized. The printed proof treats the wholesale price as fixed while it varies: u(T)u(T)u(T) and b(T)b(T)b(T) contain www, so T1T_1T1​, T2T_2T2​ and Lˉ\bar LLˉ move with w∗w^*w∗. A machine-checked proof therefore has to repair the argument, not only transcribe it. A numerical check (p = 10, c = 4, s = 1, a = 1; for example κ = 1.2, ε = 0.012 gives w* ≈ 4.889, T* ≈ 1.095) found the statement itself consistent.

Difficulty

The retailer's problem is not concave. For fixed effort, R(⋅,e∣T)R(\cdot,e\mid T)R(⋅,e∣T) has a kink at Q=TQ=TQ=T, and the optimal order jumps from eQ‾0e\underline Q_0eQ​0​ to eQ‾1e\underline Q_1eQ​1​ at e=T/τe=T/\taue=T/τ. After the order is optimized out, the profit in effort, A(⋅∣T)A(\cdot\mid T)A(⋅∣T), has an upward kink at T/τT/\tauT/τ and can be convex and then concave beyond it. Checking the first-order condition at eˉ\bar eeˉ is therefore not enough. Coordination is a statement about the global maximum of a kinked, non-concave function, and comparing the two local candidates is what the threshold Υ\UpsilonΥ and the profits L‾\underline LL​, Lˉ\bar LLˉ do. The contract is then pinned down by two equations in (w,T)(w,T)(w,T) whose coefficients themselves depend on www through u(T)u(T)u(T) and b(T)b(T)b(T).

Formalization scope

Everything is stated for ξ∼Uniform(0,1)\xi\sim\mathrm{Uniform}(0,1)ξ∼Uniform(0,1), taken as Lebesgue measure on [0,1][0,1][0,1], and for V(e)=ae2/2V(e)=ae^2/2V(e)=ae2/2, as in all of Lemmas 3–6 and Theorem 2. Lemma 2 and the §4.1–4.2 solutions, which the paper states for general demand, are specialised to this instance. The uniform law has bounded support, so the paper's Assumption A4 (positive density on [0,∞)[0,\infty)[0,∞)) is not imposed; the paper allows that relaxation on p. 995.

The expectations use the published expSales and expLeftover (Cachon's newsvendor definitions) of the image law of ξ\xiξ under x↦exx\mapsto exx↦ex. Φ\PhiΦ and Γ\GammaΓ are integrals of the uniform density, not hard-coded closed forms. Every inverse (Qˉ0\bar Q_0Qˉ​0​, Q‾0\underline Q_0Q​0​, Q‾1\underline Q_1Q​1​), the threshold τ\tauτ, the function jjj and its root Υ\UpsilonΥ, the fixed points T1T_1T1​, T2T_2T2​ and the profits L‾\underline LL​, Lˉ\bar LLˉ are stated by their defining equations, never by a choice function. "Optimal" means a maximizer over Q≥0Q\ge0Q≥0, e≥0e\ge0e≥0. Channel coordination means that the retailer's set of maximizers is exactly {(Qˉ,eˉ)}\{(\bar Q,\bar e)\}{(Qˉ​,eˉ)}. The manufacturer's profit MMM, which the paper does not display, is written from the contract's cash flows: units bought back at bbb are salvaged at sss.

A trivializing formalization is ruled out: coordination is global optimality of (Qˉ,eˉ)(\bar Q,\bar e)(Qˉ​,eˉ), not a first-order condition at eˉ\bar eeˉ. ε0\varepsilon_0ε0​ may depend on κ\kappaκ but not on ε\varepsilonε. T1T_1T1​ and T2T_2T2​ are tied to their fixed-point equations and are not free variables.

A complete development needs:

  • the closed forms of Φ\PhiΦ, Γ\GammaΓ and the three expectations under the uniform law;
  • scaling identities in eee;
  • maximization of piecewise concave functions with a kink;
  • one-dimensional intermediate value arguments, with the monotonicity needed to repair the proof of Theorem 2.

The uniform newsvendor identities and the kinked-maximization lemmas are reusable beyond this mission. Contributions to any milestone, and alternative proofs of the existence part of Theorem 2, are welcome.

Selected references

  • T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8):992–1007, 2002. https://doi.org/10.1287/mnsc.48.8.992.168
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in Operations Research and Management Science, Vol. 11, 2003. https://doi.org/10.1016/S0927-0507(03)11006-7
  • B. A. Pasternack, Optimal Pricing and Return Policies for Perishable Commodities, Marketing Science 4(2):166–176, 1985. https://doi.org/10.1287/mksc.4.2.166
11 thms1 active userReviewed
Control TheoryOperations ResearchStochastic Systems·Captain: mikedeng1

On Minimizing the Ruin Probability by Investment and Reinsurance I: An Increasing Solution f of the HJB Equation Is Bounded, δ(u) = f(u)/f(∞), and the Feedback Strategy A*, b* Is OptimalResearch Paper

Motivation

An insurance company that collects premiums and pays random claims is ruined when its surplus becomes negative. The probability of ultimate ruin is the classical solvency criterion of risk theory, going back to Lundberg and Cramér. Real insurers have two levers on this probability: they can invest part of the surplus in a risky asset, and they can cede part of every claim to a reinsurer, at a price. The question of how to use both levers dynamically, as a function of the current surplus, so as to make the probability of ruin as small as possible, is a stochastic control problem for a jump-diffusion.

H. Schmidli, On minimizing the ruin probability by investment and reinsurance, Ann. Appl. Probab. 12 (2002), solves this problem for the Cramér–Lundberg model with proportional reinsurance and investment in a Black–Scholes asset. The main results are a verification theorem (Theorem 1, the subject of this mission) and an existence theorem for the associated integral equation (Theorem 2, the companion mission).

Timeline. Hipp and Plum (2000) treated investment in the Cramér–Lundberg model through the Hamilton–Jacobi–Bellman equation, assuming a bounded solution. Schmidli (2001) treated optimal proportional reinsurance alone. The 2002 paper combines investment and reinsurance, and proves the verification theorem without assuming the solution to be bounded.

Setting

Claims arrive at the jumps T1<T2<…T_1<T_2<\dotsT1​<T2​<… of a Poisson process NNN with rate λ>0\lambda>0λ>0; the claim sizes Y1,Y2,…Y_1,Y_2,\dotsY1​,Y2​,… are i.i.d. with continuous distribution function GGG, G(0)=0G(0)=0G(0)=0, independent of NNN. The insurer receives premiums at rate c>0c>0c>0. A risky asset Zt=exp⁡{σWt+(μ−12σ2)t}Z_t=\exp\{\sigma W_t+(\mu-\frac12\sigma^2)t\}Zt​=exp{σWt​+(μ−21​σ2)t}, with μ,σ>0\mu,\sigma>0μ,σ>0 and WWW a standard Brownian motion independent of the claims, is available.

A strategy is a pair of processes (At,bt)(A_t,b_t)(At​,bt​), predictable for the smallest right-continuous filtration generated by the claims and WWW: At∈RA_t\in\mathbb RAt​∈R is the amount invested in the risky asset (locally bounded), and bt∈[0,1]b_t\in[0,1]bt​∈[0,1] is the retention level, meaning the insurer pays btYb_tYbt​Y of a claim YYY occurring at time ttt, at a reinsurance premium rate c(bt)c(b_t)c(bt​). The surplus X=XAbX=X^{Ab}X=XAb starting from u≥0u\ge0u≥0 solves

dXt=(c−c(bt)+μAt) dt+σAt dWt−bt dSt,X0=u,dX_t=\big(c-c(b_t)+\mu A_t\big)\,dt+\sigma A_t\,dW_t-b_t\,dS_t,\qquad X_0=u,dXt​=(c−c(bt​)+μAt​)dt+σAt​dWt​−bt​dSt​,X0​=u,

where St=∑i≤NtYiS_t=\sum_{i\le N_t}Y_iSt​=∑i≤Nt​​Yi​ is the aggregate claims process. The ruin time is τ=inf⁡{t≥0:Xt<0}\tau=\inf\{t\ge0:X_t<0\}τ=inf{t≥0:Xt​<0}, the survival probability is δAb(u)=P[τ=∞]\delta^{Ab}(u)=\mathbb P[\tau=\infty]δAb(u)=P[τ=∞], and the value function is δ(u)=sup⁡A,bδAb(u)\delta(u)=\sup_{A,b}\delta^{Ab}(u)δ(u)=supA,b​δAb(u).

The premium function c(b)c(b)c(b) is decreasing and continuous on [0,1][0,1][0,1], c(1)=0c(1)=0c(1)=0, lim inf⁡b↑1c(b)/(1−b)>0\liminf_{b\uparrow1}c(b)/(1-b)>0liminfb↑1​c(b)/(1−b)>0, and there is b‾>0\underline b>0b​>0 with c(b)>cc(b)>cc(b)>c for b<b‾b<\underline bb<b​ and c(b)≤cc(b)\le cc(b)≤c for b≥b‾b\ge\underline bb≥b​ (full reinsurance is too expensive).

The Hamilton–Jacobi–Bellman equation for δ\deltaδ is, with the convention f(u)=0f(u)=0f(u)=0 for u<0u<0u<0,

sup⁡b∈[0,1]sup⁡A≥0[12σ2A2f′′(u)+(c−c(b)+μA)f′(u)+λ(E[f(u−bY)]−f(u))]=0.(1)\sup_{b\in[0,1]}\sup_{A\ge0}\Big[\tfrac12\sigma^2A^2f''(u)+\big(c-c(b)+\mu A\big)f'(u)+\lambda\big(\mathbb E[f(u-bY)]-f(u)\big)\Big]=0.\tag{1}b∈[0,1]sup​A≥0sup​[21​σ2A2f′′(u)+(c−c(b)+μA)f′(u)+λ(E[f(u−bY)]−f(u))]=0.(1)

For strictly concave fff the maximum over AAA is attained at A∗(u)=−μf′(u)/(σ2f′′(u))A^*(u)=-\mu f'(u)/(\sigma^2f''(u))A∗(u)=−μf′(u)/(σ2f′′(u)) (equation (2)); b∗(u)b^*(u)b∗(u) denotes a measurable maximiser in bbb.

Formalization targets

Goal: Theorem 1 (p. 896)

Let fff be strictly increasing and nonnegative on [0,∞)[0,\infty)[0,∞), continuous there, twice continuously differentiable on (0,∞)(0,\infty)(0,∞), zero on (−∞,0)(-\infty,0)(−∞,0), and a solution of (1) at every u>0u>0u>0. Then fff is bounded, f(∞)=lim⁡x→∞f(x)∈(0,∞)f(\infty)=\lim_{x\to\infty}f(x)\in(0,\infty)f(∞)=limx→∞​f(x)∈(0,∞),

δ(u)=f(u)f(∞)(u≥0),\delta(u)=\frac{f(u)}{f(\infty)}\qquad(u\ge0),δ(u)=f(∞)f(u)​(u≥0),

and every surplus process from u>0u>0u>0 following At=A∗(Xt−)A_t=A^*(X_{t-})At​=A∗(Xt−​), bt=b∗(Xt−)b_t=b^*(X_{t-})bt​=b∗(Xt−​) has survival probability δ(u)\delta(u)δ(u).

Milestones

The proof of Theorem 1 runs through: Lemma 3 (for small surplus the optimal retention is b∗=1b^*=1b∗=1); the identity E[f(Xτ∗∧t∗)]=f(u)\mathbb E[f(X^*_{\tau^*\wedge t})]=f(u)E[f(Xτ∗∧t∗​)]=f(u) along the feedback strategy; the inequality E[f(Xt∧τ)]≤f(u)\mathbb E[f(X_{t\wedge\tau})]\le f(u)E[f(Xt∧τ​)]≤f(u) for every strategy; Lemma 1 (almost surely, either ruin occurs or Xt→∞X_t\to\inftyXt​→∞); the existence of a strategy with P[τ=∞]>0\mathbb P[\tau=\infty]>0P[τ=∞]>0; the comparison δAb(u)≤f(u)/f(∞)\delta^{Ab}(u)\le f(u)/f(\infty)δAb(u)≤f(u)/f(∞) with equality for the feedback strategy; and the absence of ruin by creeping, P[τ∗<∞,Xτ∗∗=0]=0\mathbb P[\tau^*<\infty,X^*_{\tau^*}=0]=0P[τ∗<∞,Xτ∗∗​=0]=0.

Companion statements

The second sentence of Theorem 1 (that f(x)=1+∫0xg(z) dzf(x)=1+\int_0^xg(z)\,dzf(x)=1+∫0x​g(z)dz satisfies the hypotheses whenever ggg is a decreasing solution of the integral equation (5)) and its last sentence (at most one such solution of (1) with f(0)=1f(0)=1f(0)=1) are separate items.

Significance

Theorem 1 reduces a control problem over all predictable strategies to an analytic question: find one increasing smooth solution of (1). Combined with Theorem 2 (existence of a solution of (5)), it shows that the optimal survival probability is f(u)/f(∞)f(u)/f(\infty)f(u)/f(∞) and that the optimal strategy is a Markov feedback rule in the current surplus. It also yields that this solution is bounded, which Hipp and Plum (2000) had to assume, and closes the gap they left open on ruin by creeping (Remark (iii), p. 897). Numerical procedures for the optimal strategy (§5 of the paper) rest on this identification.

The theorem is proved in the paper; nothing in it is formalized. The mission produces a machine-checked verification theorem for a controlled jump-diffusion with an Itô integral against Brownian motion, a Poisson claim stream and a predictable control, together with a formal model of the Cramér–Lundberg process with investment and reinsurance that later results in risk theory can reuse.

Difficulty

The standard verification argument applies Itô's formula to f(Xt)f(X_t)f(Xt​) and uses (1) to show that f(Xt∧τ)f(X_{t\wedge\tau})f(Xt∧τ​) is a supermartingale, and a martingale under the feedback strategy. Here fff is not C2C^2C2 at 000 (f′′(0+)=−∞f''(0+)=-\inftyf′′(0+)=−∞), is discontinuous at 000 after the extension by 000, and is not assumed bounded, so the stochastic integral is only a local martingale and the passage t→∞t\to\inftyt→∞ needs both Lemma 1 and a separate argument that the feedback process does not creep through 000. Lemma 1 itself is only sketched in the paper ("We will just describe the argument"). The optimality part needs a surplus process following the feedback rule; its existence is not proved in the paper.

Formalization scope

The model is formalized on a measurable space with a probability measure: i.i.d. exponential interarrival times (realising the Poisson process), i.i.d. claim sizes with law ν\nuν, and a real Brownian motion (IsBrownianReal), the three families mutually independent. Independence of WWW from the claims is not printed in the paper but is used by (1) and its proof; it is a disclosed standing assumption. The filtration is Ft=⋂s>tσ(Sr,Wr:r≤s)\mathcal F_t=\bigcap_{s>t}\sigma(S_r,W_r:r\le s)Ft​=⋂s>t​σ(Sr​,Wr​:r≤s), not completed. The Itô integral is the published relation EthierKurtz.HasBrownianItoIntegral, and its paths are required to be continuous, so that the pathwise ruin event is well defined. The surplus equation holds for every ttt and every sample point.

Conventions: the premium c(b)c(b)c(b) is real valued (so c(0)<∞c(0)<\inftyc(0)<∞, which the paper allows to fail when E[Y]<∞\mathbb E[Y]<\inftyE[Y]<∞); the supremum in (1) is stated as a least upper bound equal to 000, so an unbounded family never counts as a solution; fff is C2C^2C2 on (0,∞)(0,\infty)(0,∞) and (1) is required for u>0u>0u>0; δ\deltaδ is a supremum over all admissible triples (strategy and surplus process); the controls of the feedback rule at non-positive pre-jump surplus are left free, and optimality is stated for u>0u>0u>0. Expectations of f(Xt∧τ)f(X_{t\wedge\tau})f(Xt∧τ​) are lower Lebesgue integrals of nonnegative functions, so no default value of a non-integrable expectation satisfies an inequality. The optimality clause is stated for every process following the feedback rule; it would be vacuous if no such process existed, and its existence is not part of the target.

Infrastructure needed: Itô's formula for a semimartingale with Brownian and compound-Poisson parts, the compensator of the compound Poisson random measure, localisation, and optional stopping. The model definitions, the HJB predicate and the comparison lemmas are reusable for other ruin-minimisation and dividend problems. Contributions to any milestone, and to general stochastic-calculus lemmas they need, are welcome.

Selected references

  • H. Schmidli, On minimizing the ruin probability by investment and reinsurance, Ann. Appl. Probab. 12(3) (2002), 890–907. https://doi.org/10.1214/aoap/1031863173
  • C. Hipp, M. Plum, Optimal investment for insurers, Insurance Math. Econom. 27 (2000), 215–228. https://doi.org/10.1016/S0167-6687(00)00049-4
  • H. Schmidli, Optimal proportional reinsurance policies in a dynamic setting, Scand. Actuar. J. (2001), 55–68. https://doi.org/10.1080/034612301750077338
  • P. Brémaud, Point Processes and Queues: Martingale Dynamics, Springer (1981). https://doi.org/10.1007/978-1-4684-9477-8
11 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

Supply Chain Coordination Under Channel Rebates with Sales Effort Effects I: A Target Rebate Coordinates the Newsvendor Channel and Splits Its Profit in Any ProportionResearch Paper

Motivation

Manufacturers in computer hardware, software and automobiles routinely pay channel rebates to their retailers: a payment per unit the retailer sells to end consumers, as opposed to per unit the retailer buys. A target rebate pays only for units sold beyond a target level, a linear rebate pays for every unit sold. T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8) (2002), doi:10.1287/mnsc.48.8.992.168, asks whether such payments can make an independent retailer act in the interest of the whole supply chain.

The question belongs to the supply-chain contracting literature built on the newsvendor model. A wholesale price above cost makes the retailer under-order relative to the integrated channel (double marginalization, Spengler 1950). Returns contracts (Pasternack 1985) and revenue sharing (Pasternack 1999; Cachon and Lariviere 2000, as cited by Taylor) are known remedies. Cachon's survey, Supply Chain Coordination with Contracts (Handbooks in OR & MS 11, 2003), discusses sales-rebate contracts through a first-order condition. Taylor's Theorem 1 is the global statement for the target rebate, with an explicit contract and an arbitrary profit split, and without any lump-sum side payment.

This mission covers §3 of the paper, the model without sales effort. Missions II–IV of the series cover §4, where the retailer's effort also affects demand.

Setting

A manufacturer sells to a retailer who places one order of size Q≥0Q \ge 0Q≥0 before observing demand ξ\xiξ. Demand has a density φ\varphiφ with φ(x)=0\varphi(x) = 0φ(x)=0 for x<0x < 0x<0 and φ(x)>0\varphi(x) > 0φ(x)>0 for every x≥0x \ge 0x≥0 (Assumption A4), and a finite mean. Write

Φ(Q)=∫0Qφ(x) dx,Γ(Q)=∫0Qx φ(x) dx.\Phi(Q) = \int_0^Q \varphi(x)\,dx, \qquad \Gamma(Q) = \int_0^Q x\,\varphi(x)\,dx .Φ(Q)=∫0Q​φ(x)dx,Γ(Q)=∫0Q​xφ(x)dx.

The retail price ppp, the production cost ccc and the salvage value sss are fixed with 0<c<p0 < c < p0<c<p and s<cs < cs<c; sss may be negative. A contract specifies a wholesale price www, a rebate u>0u > 0u>0 and a target T≥0T \ge 0T≥0 (Assumption A1: 0<c<w<p0 < c < w < p0<c<w<p, s<cs < cs<c, u>0u > 0u>0, T≥0T \ge 0T≥0). No other transfer is allowed (Assumption A3).

  • The integrated channel earns π(Q)=−cQ+pEmin⁡(Q,ξ)+sE(Q−ξ)+\pi(Q) = -cQ + pE\min(Q,\xi) + sE(Q-\xi)^+π(Q)=−cQ+pEmin(Q,ξ)+sE(Q−ξ)+. Its optimal order Qˉ0\bar Q_0Qˉ​0​ solves Φ(Qˉ0)=(p−c)/(p−s)\Phi(\bar Q_0) = (p-c)/(p-s)Φ(Qˉ​0​)=(p−c)/(p−s), and its optimal profit is π=(p−s)Γ(Qˉ0)\pi = (p-s)\Gamma(\bar Q_0)π=(p−s)Γ(Qˉ​0​).
  • Under the target rebate (w,u,T)(w,u,T)(w,u,T) the retailer earns
r(Q∣T)=−wQ+pEmin⁡(Q,ξ)+sE(Q−ξ)++uE(min⁡(Q,ξ)−T)+,r(Q\mid T) = -wQ + pE\min(Q,\xi) + sE(Q-\xi)^+ + uE(\min(Q,\xi)-T)^+,r(Q∣T)=−wQ+pEmin(Q,ξ)+sE(Q−ξ)++uE(min(Q,ξ)−T)+,

and the manufacturer earns m(Q∣T)=(w−c)Q−uE(min⁡(Q,ξ)−T)+m(Q\mid T) = (w-c)Q - uE(\min(Q,\xi)-T)^+m(Q∣T)=(w−c)Q−uE(min(Q,ξ)−T)+.

  • Under the wholesale price-only contract (u=0u = 0u=0) the retailer orders Q0Q_0Q0​ with Φ(Q0)=(p−w)/(p−s)\Phi(Q_0) = (p-w)/(p-s)Φ(Q0​)=(p−w)/(p−s) and earns r‾=(p−s)Γ(Q0)\underline r = (p-s)\Gamma(Q_0)r​=(p−s)Γ(Q0​).

The contract coordinates the channel when Qˉ0\bar Q_0Qˉ​0​ is the retailer's unique optimal order. Finally u^(w)=(w−c)(p−s)/(c−s)\hat u(w) = (w-c)(p-s)/(c-s)u^(w)=(w−c)(p−s)/(c−s).

Formalization targets

Goal: Theorem 1 (p. 996)

Fix κ∈(0,π)\kappa \in (0,\pi)κ∈(0,π). For every sufficiently small ε∈(0,κ)\varepsilon \in (0,\kappa)ε∈(0,κ) there is exactly one triple (w∗,u∗,T∗)(w^*,u^*,T^*)(w∗,u∗,T∗) with r‾(w∗)=κ−ε\underline r(w^*) = \kappa-\varepsilonr​(w∗)=κ−ε, u∗=u^(w∗)u^* = \hat u(w^*)u∗=u^(w∗), T∗≥0T^* \ge 0T∗≥0 and

(p+u∗−s)Γ(Qˉ0)−u∗(Γ(T∗)+T∗[1−Φ(T∗)])=κ,(1)(p+u^*-s)\Gamma(\bar Q_0) - u^*\big(\Gamma(T^*) + T^*[1-\Phi(T^*)]\big) = \kappa, \qquad (1)(p+u∗−s)Γ(Qˉ​0​)−u∗(Γ(T∗)+T∗[1−Φ(T∗)])=κ,(1)

and this triple has w∗∈(c,p)w^* \in (c,p)w∗∈(c,p), u∗>0u^*>0u∗>0, T∗>0T^*>0T∗>0, coordinates the channel, and gives the retailer r∗=κr^* = \kappar∗=κ and the manufacturer m∗=π−κm^* = \pi-\kappam∗=π−κ.

Milestones

  1. §3.1, p. 995. The newsvendor solutions: Qˉ0\bar Q_0Qˉ​0​ and Q0Q_0Q0​ are the unique optimal orders, with values (p−s)Γ(Qˉ0)(p-s)\Gamma(\bar Q_0)(p−s)Γ(Qˉ​0​) and (p−s)Γ(Q0)(p-s)\Gamma(Q_0)(p−s)Γ(Q0​), and Q0<Qˉ0Q_0 < \bar Q_0Q0​<Qˉ​0​.
  2. §3.2, p. 995. The piecewise form of r(⋅∣T)r(\cdot\mid T)r(⋅∣T), its derivative p−w−(p−s)Φ(Q)p-w-(p-s)\Phi(Q)p−w−(p−s)Φ(Q) below TTT and p+u−w−(p+u−s)Φ(Q)p+u-w-(p+u-s)\Phi(Q)p+u−w−(p+u−s)Φ(Q) above, strict concavity on [0,T)[0,T)[0,T) and (T,∞)(T,\infty)(T,∞), and an upward kink of the derivative at TTT.
  3. Lemma 1, p. 995. With Φ(Q1)=(p+u−w)/(p+u−s)\Phi(Q_1) = (p+u-w)/(p+u-s)Φ(Q1​)=(p+u−w)/(p+u−s), the equation r(Q0∣τ0)=r(Q1∣τ0)r(Q_0\mid\tau_0) = r(Q_1\mid\tau_0)r(Q0​∣τ0​)=r(Q1​∣τ0​) has exactly one root τ0∈[Q0,Q1]\tau_0 \in [Q_0,Q_1]τ0​∈[Q0​,Q1​], lying in (Q0,Q1)(Q_0,Q_1)(Q0​,Q1​); the retailer's optimal order set is {Q1}\{Q_1\}{Q1​} for T<τ0T<\tau_0T<τ0​, {Q0}\{Q_0\}{Q0​} for T>τ0T>\tau_0T>τ0​, and {Q0,Q1}\{Q_0,Q_1\}{Q0​,Q1​} for T=τ0T=\tau_0T=τ0​.
  4. §3.2, p. 996. The retailer's optimal profit is (p+u−s)Γ(Q1)−u(Γ(T)+T[1−Φ(T)])(p+u-s)\Gamma(Q_1) - u(\Gamma(T)+T[1-\Phi(T)])(p+u−s)Γ(Q1​)−u(Γ(T)+T[1−Φ(T)]) if T<τ0T<\tau_0T<τ0​ and (p−s)Γ(Q0)(p-s)\Gamma(Q_0)(p−s)Γ(Q0​) if T≥τ0T \ge \tau_0T≥τ0​.
  5. Proposition 1, p. 996. If T=0T = 0T=0, channel coordination requires m∗<0m^* < 0m∗<0.

Significance

Theorem 1 shows that a single sales-based instrument, a target rebate, achieves what a wholesale price alone cannot: the retailer orders the channel-optimal quantity, and the channel profit π\piπ is split in any proportion κ:π−κ\kappa : \pi-\kappaκ:π−κ. The parameter κ\kappaκ can be set to the retailer's opportunity cost, so a manufacturer with all the bargaining power extracts the rest of the channel profit without a side payment. Proposition 1 explains why the target is needed: a linear rebate that coordinates the channel leaves the manufacturer with a loss. The quantity-only analysis is also the base case of §4, where the paper shows that a target rebate combined with returns coordinates effort and quantity as well.

The results are proved in the paper (Appendix, p. 1005). No machine-checked proof of any of them is known to exist. The mission produces a Lean statement of the model and of each result, and invites formal proofs of the newsvendor solution, the shape of the kinked profit, the threshold lemma and the coordination theorem.

Difficulty

The retailer's profit r(⋅∣T)r(\cdot\mid T)r(⋅∣T) is not concave: its derivative jumps up at the target. The usual newsvendor argument, a stationary point of a concave function is a global maximum, therefore fails. A first-order condition at Qˉ0\bar Q_0Qˉ​0​ shows only that Qˉ0\bar Q_0Qˉ​0​ is a local candidate on (T,∞)(T,\infty)(T,∞). The retailer may still prefer the smaller candidate Q0Q_0Q0​ on [0,T][0,T][0,T], and coordination fails exactly when she does. Theorem 1(b) requires comparing the two branches globally, through the threshold τ0\tau_0τ0​ of Lemma 1, and then showing that the contract's target lies strictly below τ0\tau_0τ0​.

The contract itself is defined implicitly. w∗w^*w∗ solves an equation involving the critical fractile Q0(w)Q_0(w)Q0​(w), and T∗T^*T∗ solves (1). Existence and uniqueness of both, and the placement of T∗T^*T∗ relative to τ0\tau_0τ0​, are part of the claim.

Formalization scope

All definitions are in ChannelRebate.Quantity.Setting. Demand is a structure Demand carrying the density φ\varphiφ with the properties listed under Setting; its law is Lebesgue measure with density φ\varphiφ. Emin⁡(Q,ξ)E\min(Q,\xi)Emin(Q,ξ) and E(Q−ξ)+E(Q-\xi)^+E(Q−ξ)+ are expSales and expLeftover of the published definition CachonCoord_Newsvendor_Contracts, applied to this law. E(min⁡(Q,ξ)−T)+E(\min(Q,\xi)-T)^+E(min(Q,ξ)−T)+ is the local rebateUnits. Φ\PhiΦ and Γ\GammaΓ are interval integrals from 000.

Conventions:

  • Φ−1\Phi^{-1}Φ−1 is never a function. Each critical fractile (Qˉ0\bar Q_0Qˉ​0​, Q0Q_0Q0​, Q1Q_1Q1​) is a hypothesis giving its defining equation, and τ0\tau_0τ0​ is any solution of f0(τ0)=0f_0(\tau_0) = 0f0​(τ0​)=0 in [Q0,Q1][Q_0,Q_1][Q0​,Q1​].
  • An optimal order maximizes over Q≥0Q \ge 0Q≥0. "Coordination" and the order sets of Lemma 1 are equalities of the set of maximizers, so a tie with Q0Q_0Q0​ does not count as coordination.
  • "For ε\varepsilonε sufficiently small" is "there exists ε0>0\varepsilon_0 > 0ε0​>0 such that for all ε∈(0,min⁡(ε0,κ))\varepsilon \in (0,\min(\varepsilon_0,\kappa))ε∈(0,min(ε0​,κ))".
  • In Theorem 1 the uniqueness ranges over all real triples satisfying the specification, with www unrestricted; w∗∈(c,p)w^* \in (c,p)w∗∈(c,p) is a conclusion.
  • The manufacturer's profit is its own formula, never channel profit minus retailer profit; m∗=π−κm^* = \pi-\kappam∗=π−κ is a conclusion.
  • The standing assumptions A1, A3 and A4 appear as hypotheses or in Demand; no continuity of φ\varphiφ is assumed.

A formalization that reads coordination as the first-order condition at Qˉ0\bar Q_0Qˉ​0​, or that defines T∗T^*T∗ or w∗w^*w∗ by a choice function, would make Theorem 1 vacuous or weaker, and is ruled out by the statements above.

A complete development needs the newsvendor calculus for a density (derivatives of Emin⁡(Q,ξ)E\min(Q,\xi)Emin(Q,ξ) and E(Q−ξ)+E(Q-\xi)^+E(Q−ξ)+ in QQQ, strict monotonicity of Φ\PhiΦ on [0,∞)[0,\infty)[0,∞)), the intermediate value theorem for the two implicit equations, and the global comparison of the two concave branches. The newsvendor calculus is reusable for missions II–IV of this series and for other newsvendor contracts. Proofs of the milestones in any order are welcome.

Selected references

  • T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8):992–1007, 2002. doi:10.1287/mnsc.48.8.992.168
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in Operations Research and Management Science 11, 2003. doi:10.1016/S0927-0507(03)11006-7
  • B. A. Pasternack, Optimal Pricing and Return Policies for Perishable Commodities, Marketing Science 4(2):166–176, 1985. doi:10.1287/mksc.4.2.166
  • J. J. Spengler, Vertical Integration and Antitrust Policy, Journal of Political Economy 58(4):347–352, 1950. doi:10.1086/256964
8 thms1 active userReviewed
PreviousPage 31 of 38Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me