Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Probability

1,641 missions · 708 completed

Missions

Open933Completed708All1641
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Matroid Prophet Inequalities 1: Against Any Online Weight-Adaptive Adversary, the 2-Balanced Threshold Algorithm Earns at Least Half the Expected Max-Weight BasisResearch Paper

Motivation

The prophet inequality of optimal stopping compares a gambler, who sees independent non-negative random values X1,…,XnX_1, \dots, X_nX1​,…,Xn​ one at a time and must accept or reject each on arrival, with a prophet who sees them all in advance. Krengel, Sucheston and Garling showed that the gambler can secure E[Xτ]≥12 E[max⁡iXi]\mathbb E[X_\tau] \ge \tfrac12\,\mathbb E[\max_i X_i]E[Xτ​]≥21​E[maxi​Xi​], and Samuel-Cahn showed that a single threshold suffices. Since Hajiaghayi, Kleinberg and Sandholm (2007) and Chawla, Hartline, Malec and Sivan (2010), prophet inequalities have served as the approximation guarantees of sequential posted-price mechanisms: an online selection rule with a prophet guarantee turns into a truthful mechanism with a revenue guarantee.

The natural multi-choice generalization lets the gambler accept a set of elements, subject to a feasibility constraint. Kleinberg and Weinberg, Matroid Prophet Inequalities (STOC 2012, arXiv:1201.4764), proved that when the feasible sets are the independent sets of a matroid, the factor 12\tfrac1221​ is still achievable, by an explicit threshold rule, and even when the order of arrival is chosen adaptively by an adversary.

Timeline:

  • 1977–78: Krengel and Sucheston, with Garling: the single-choice prophet inequality with factor 12\tfrac1221​, which is tight.
  • 1984: Samuel-Cahn: a single fixed threshold attains 12\tfrac1221​.
  • 2007: Hajiaghayi, Kleinberg, Sandholm: prophet inequalities read as truthful online auctions, with multi-choice prophet inequalities.
  • 2010: Chawla, Hartline, Malec, Sivan: posted-price mechanisms via prophet inequalities, and factor 12\tfrac1221​ for matroids when the algorithm may choose the order of arrival.
  • 2012: Kleinberg–Weinberg: factor 12\tfrac1221​ for every matroid against an online weight-adaptive adversary, and 14p−2\tfrac1{4p-2}4p−21​ for intersections of ppp matroids.

Setting

Let U\mathcal UU be a finite ground set and M=(U,I)\mathcal M = (\mathcal U, \mathcal I)M=(U,I) a matroid; I\mathcal II is its family of independent sets. For each x∈Ux \in \mathcal Ux∈U a distribution FxF_xFx​ on [0,∞)[0,\infty)[0,∞) is given; the weights w(x)w(x)w(x) are independent with w(x)∼Fxw(x) \sim F_xw(x)∼Fx​, and w(A)=∑x∈Aw(x)w(A) = \sum_{x \in A} w(x)w(A)=∑x∈A​w(x). Let OPT(w)=max⁡{w(S):S∈I}\mathrm{OPT}(w) = \max\{w(S) : S \in \mathcal I\}OPT(w)=max{w(S):S∈I} and OPT=E[OPT(w)]\mathrm{OPT} = \mathbb E[\mathrm{OPT}(w)]OPT=E[OPT(w)].

An online weight-adaptive adversary reveals the elements one at a time: it picks xix_ixi​ knowing w(x1),…,w(xi−1)w(x_1), \dots, w(x_{i-1})w(x1​),…,w(xi−1​) but not w(xi)w(x_i)w(xi​). An online algorithm maintains a selected set Ai−1∈IA_{i-1} \in \mathcal IAi−1​∈I and, when xix_ixi​ arrives with its weight, irrevocably accepts or rejects it, keeping AiA_iAi​ independent. A threshold rule offers xix_ixi​ a threshold TiT_iTi​ computed from the revealed prefix (and Ti=∞T_i = \inftyTi​=∞ when Ai−1∪{xi}∉IA_{i-1} \cup \{x_i\} \notin \mathcal IAi−1​∪{xi​}∈/I) and accepts iff w(xi)≥Tiw(x_i) \ge T_iw(xi​)≥Ti​.

The algorithm of the paper uses a ghost sample: an independent copy w′w'w′ of the weights. Let BBB be a w′w'w′-maximum-weight basis. For an independent set AAA, among the partitions B=C⊔RB = C \sqcup RB=C⊔R with R∩A=∅R \cap A = \emptysetR∩A=∅ and A∪RA \cup RA∪R a basis, R(A)R(A)R(A), C(A)C(A)C(A) denote one maximizing w′(R)w'(R)w′(R). The algorithm (9) sets

Ti=12 Ew′[w′(R(Ai−1))−w′(R(Ai−1∪{xi}))].T_i = \tfrac12\,\mathbb E_{w'}\big[w'(R(A_{i-1})) - w'(R(A_{i-1}\cup\{x_i\}))\big].Ti​=21​Ew′​[w′(R(Ai−1​))−w′(R(Ai−1​∪{xi​}))].

Formalization targets

Goal: the matroid prophet inequality

For every matroid on a finite ground set, every family of distributions FxF_xFx​ on [0,∞)[0,\infty)[0,∞) with finite means, and every online weight-adaptive adversary, the set AAA selected by the algorithm (9) satisfies

E[w(A)]  ≥  12 OPT.\mathbb E[w(A)] \;\ge\; \tfrac12\,\mathrm{OPT}.E[w(A)]≥21​OPT.

The goal is stated for the paper's own algorithm, which is stronger than the existence statement of §3.

Milestones

  1. Proposition 1 (with Definition 1): any threshold rule with α\alphaα-balanced thresholds,
∑xi∈ATi≥1α E[w′(C(A))],∑xi∈VTi≤(1−1α) E[w′(R(A))],\sum_{x_i\in A} T_i \ge \tfrac1\alpha\,\mathbb E[w'(C(A))], \qquad \sum_{x_i\in V} T_i \le \big(1-\tfrac1\alpha\big)\,\mathbb E[w'(R(A))],xi​∈A∑​Ti​≥α1​E[w′(C(A))],xi​∈V∑​Ti​≤(1−α1​)E[w′(R(A))],

earns E[w(A)]≥1α OPT\mathbb E[w(A)] \ge \tfrac1\alpha\,\mathrm{OPT}E[w(A)]≥α1​OPT. 2. The identity behind (9) = (10), and the telescoping identity ∑xi∈ATi=12 E[w′(C(A))]\sum_{x_i \in A} T_i = \tfrac12\,\mathbb E[w'(C(A))]∑xi​∈A​Ti​=21​E[w′(C(A))] (Property (2) for α=2\alpha = 2α=2). 3. Lemma 1 (bijective basis exchange, and its weighted form), Lemma 2 (R(A)R(A)R(A) is a maximum-weight basis of the contraction M/A\mathcal M/AM/A), Lemma 3 (S↦w′(R(S))S \mapsto w'(R(S))S↦w′(R(S)) is submodular on subsets of an independent set). 4. Inequalities (11) and (12), and Proposition 2:

∑xi∈V[w′(R(Ai−1))−w′(R(Ai−1∪{xi}))]≤w′(R(A)),\sum_{x_i \in V}\big[w'(R(A_{i-1})) - w'(R(A_{i-1}\cup\{x_i\}))\big] \le w'(R(A)),xi​∈V∑​[w′(R(Ai−1​))−w′(R(Ai−1​∪{xi​}))]≤w′(R(A)),

pointwise in w′≥0w' \ge 0w′≥0; then Property (3) with α=2\alpha = 2α=2 for the thresholds (9).

Significance

The theorem gives the optimal constant: already for a rank-one matroid (choose one element) no online algorithm beats 12\tfrac1221​. It covers every matroid with one algorithm, including uniform, partition, graphic and transversal matroids, which model capacity, unit-demand and spanning-tree constraints. Through the reduction of Chawla et al., the paper derives from it order-oblivious posted-price mechanisms that are 2-approximations to the optimal revenue in single-parameter settings with matroid feasibility and, through the adaptive adversary, in multi-dimensional unit-demand settings (§6 of the paper). The decomposition through α\alphaα-balanced thresholds is reused in the paper for intersections of ppp matroids, with factor 14p−2\tfrac1{4p-2}4p−21​.

The result has been proved since 2012; it has not been formalized. The mission produces a machine-checked development of the model (online adaptive adversaries, threshold rules, the ghost-sample expectations), of the general reduction (Proposition 1), and of the matroid facts the algorithm relies on, notably the bijective exchange lemma (Schrijver, Corollary 39.12a), which is not in Mathlib.

Difficulty

The obvious argument fixes the order of arrival and compares the algorithm with the prophet item by item. It fails here because the order is chosen adaptively from the revealed weights, so the set of elements still to come is random and correlated with the past. The proof must instead compare the algorithm's realized selection with a ghost optimum BBB built from an independent sample, and bound the value the algorithm forgoes by the value the ghost optimum could still add, E[w′(R(A))]\mathbb E[w'(R(A))]E[w′(R(A))]. The step that needs matroid structure is Property (3): the total threshold offered to any set VVV that could still be added must be at most half of E[w′(R(A))]\mathbb E[w'(R(A))]E[w′(R(A))]. The thresholds were computed along the history A0⊆A1⊆…A_0 \subseteq A_1 \subseteq \dotsA0​⊆A1​⊆…, not at the final AAA, so the bound requires the submodularity of S↦w′(R(S))S \mapsto w'(R(S))S↦w′(R(S)) (Lemma 3) and a weight-dominating exchange between VVV and R(A)R(A)R(A) in the contraction M/A\mathcal M/AM/A. Neither holds for general downward-closed families.

Formalization scope

  • The ground set is a Fintype α; the matroid is Mathlib's Matroid α with ground set Set.univ; sets are Finset α; contraction is Matroid.contract.
  • The distributions are F : α → Measure ℝ, probability measures with F x (Set.Iio 0) = 0 (support in [0,∞)[0,\infty)[0,∞)) and Integrable id (F x) (finite means). The weight law is Measure.pi F, and every expectation is a Bochner integral over it. Finite means make OPT(w)\mathrm{OPT}(w)OPT(w), w(A)w(A)w(A) and the integrands of the thresholds integrable, so no expectation is a junk value.
  • OPT(w)\mathrm{OPT}(w)OPT(w) is a maximum over the nonempty finset of independent sets. The maximum-weight basis B(w′)B(w')B(w′) and the maximizer R(A)R(A)R(A) are fixed by choice when weights tie; Lemma 2 shows w′(R(A))w'(R(A))w′(R(A)) does not depend on the choice. R(A)R(A)R(A) is required to be disjoint from AAA, as Lemma 2's placement of R(A)R(A)R(A) in M/A\mathcal M/AM/A needs.
  • A threshold rule is a real-valued function of the current selection, the revealed list, the weights and the arriving element, non-negative, depending on the weights only through revealed ones, measurably; the value ∞\infty∞ on infeasible steps is an independence guard in the acceptance test. "Monotone algorithm" in Proposition 1 means such a rule.
  • An adversary is a deterministic map from the revealed list and the weights to the next unrevealed element, depending only on revealed weights and measurable. Randomized adversaries are mixtures of these.
  • Lemma 1, part 2 is stated for disjoint VVV and RRR: as printed it fails when they overlap, and the paper uses it only for disjoint sets.

The goal fixes the thresholds by (9) through BBB, R(⋅)R(\cdot)R(⋅) and the ghost expectation; a statement in which the thresholds are free parameters assumed to satisfy (2)–(3) would be Proposition 1 and is not the goal.

Contributions are welcome at every level: the measurability of the online run, the exchange lemma for Mathlib matroids, the greedy characterization of maximum-weight bases of a contraction, and the probabilistic core (7) of Proposition 1. The matroid lemmas are reusable beyond this mission, in particular by the matroid-intersection mission of the same paper.

Selected references

  • R. Kleinberg, S. M. Weinberg, Matroid Prophet Inequalities, STOC 2012; arXiv:1201.4764v1. https://arxiv.org/abs/1201.4764 , https://doi.org/10.1145/2213977.2213991
  • U. Krengel, L. Sucheston, Semiamarts and finite values, Bull. Amer. Math. Soc. 83, 745–747, 1977.
  • U. Krengel, L. Sucheston, On semiamarts, amarts, and processes with finite value, Advances in Probability and Related Topics 4, 197–266, 1978.
  • E. Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Annals of Probability 12(4), 1213–1216, 1984.
  • M. T. Hajiaghayi, R. Kleinberg, T. Sandholm, Automated mechanism design and prophet inequalities, AAAI 2007, pp. 58–65.
  • S. Chawla, J. Hartline, D. Malec, B. Sivan, Multi-parameter mechanism design and sequential posted pricing, STOC 2010, pp. 311–320.
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer, 2003 (Corollary 39.12a).
16 thms1 active userReviewed
AnalysisOperations ResearchStochastic Systems·Captain: mikedeng1

Some Useful Functions for Functional Limit Theorems 1: Composition Preserves J₁ Convergence When the Outer Path Is Continuous or the Inner Path Is Continuous and Strictly IncreasingResearch Paper

Motivation

Random time changes occur when a process is observed on an operational clock rather than calendar time. In queueing models, for example, an arrival-count path may be evaluated at an evolving service clock. A functional limit theorem for the outer path and another for the clock are useful together only when evaluating one path at the times supplied by the other preserves convergence. Ward Whitt's 1980 paper studies several path operations with this question in mind; composition is its first main operation. The issue is specific to paths with jumps, because a small shift of the clock can move an evaluation across a jump.

Setting

Let T1,T2,T3T_1,T_2,T_3T1​,T2​,T3​ be nonempty intervals of real time, with T2⊆T3T_2\subseteq T_3T2​⊆T3​, and let (S,m)(S,m)(S,m) be a complete separable metric space. The càdlàg path space D(T,S)D(T,S)D(T,S) consists of paths that are right continuous and have left limits on TTT. Its subspace C(T,S)C(T,S)C(T,S) contains the continuous paths. The nondecreasing clock space D0(T1,T2)D_0(T_1,T_2)D0​(T1​,T2​) consists of càdlàg real-valued paths on T1T_1T1​ that are nondecreasing and take their values in T2T_2T2​. Its subspace C0(T1,T2)C_0(T_1,T_2)C0​(T1​,T2​) contains the continuous, strictly increasing clocks. For x∈D(T3,S)x\in D(T_3,S)x∈D(T3​,S) and y∈D0(T1,T2)y\in D_0(T_1,T_2)y∈D0​(T1​,T2​), composition is the path (x∘y)(t)=x(y(t))(x\circ y)(t)=x(y(t))(x∘y)(t)=x(y(t)) on T1T_1T1​.

Convergence uses the Skorohod J1J_1J1​ topology. On a compact interval [a,b][a,b][a,b], let Λ[a,b]\Lambda_{[a,b]}Λ[a,b]​ be the increasing homeomorphisms of [a,b][a,b][a,b] and let e(t)=te(t)=te(t)=t. With ρ[a,b]\rho_{[a,b]}ρ[a,b]​ denoting uniform distance, Whitt's metric is

d[a,b](u,v)=inf⁡λ∈Λ[a,b]max⁡{ρ[a,b](λ,e),ρ[a,b](u,v∘λ)}.d_{[a,b]}(u,v)=\inf_{\lambda\in\Lambda_{[a,b]}} \max\{\rho_{[a,b]}(\lambda,e),\rho_{[a,b]}(u,v\circ\lambda)\}.d[a,b]​(u,v)=λ∈Λ[a,b]​inf​max{ρ[a,b]​(λ,e),ρ[a,b]​(u,v∘λ)}.

Thus close paths may have nearby jumps at different times, provided an increasing time change aligns them. On a general interval, convergence is checked on compact subintervals whose endpoints are continuity points of the limit or endpoints of the full interval. Whitt gives this definition in §2, then gives CCC, C0C_0C0​, and D0D_0D0​ in §3. All subsets carry relative topologies and products carry product topologies.

Formalization targets

Composition at a continuous outer path

For xn→xx_n\to xxn​→x in D(T3,S)D(T_3,S)D(T3​,S) and yn→yy_n\to yyn​→y in D0(T1,T2)D_0(T_1,T_2)D0​(T1​,T2​), the first milestone states

x∈C(T3,S)⟹xn∘yn→x∘y in D(T1,S).x\in C(T_3,S)\quad\Longrightarrow\quad x_n\circ y_n\to x\circ y\text{ in }D(T_1,S).x∈C(T3​,S)⟹xn​∘yn​→x∘y in D(T1​,S).

The path-space definition and the two preparatory milestones are a small-oscillation partition for a càdlàg path, cited by Whitt from Billingsley, and Whitt's Lemma 2.2, which relates convergence on a compact interval to convergence on the two pieces made by splitting it at a continuity point.

Composition at a strictly increasing clock

The second case, and the combined goal, also allow the outer limit path to jump. Let ∂TT1\partial_T T_1∂T​T1​ mean the endpoints of T1T_1T1​ that belong to T1T_1T1​. The corrected target is

[x∈C(T3,S)or(y∈C0(T1,T2) andx is continuous at y(t) for every t∈∂TT1)]⟹xn∘yn→x∘y in D(T1,S).\left[x\in C(T_3,S)\quad\text{or}\quad \bigl(y\in C_0(T_1,T_2)\ \text{and} x\text{ is continuous at }y(t)\text{ for every }t\in\partial_T T_1\bigr)\right] \Longrightarrow x_n\circ y_n\to x\circ y\text{ in }D(T_1,S).[x∈C(T3​,S)or(y∈C0​(T1​,T2​) andx is continuous at y(t) for every t∈∂T​T1​)]⟹xn​∘yn​→x∘y in D(T1​,S).

The goal includes both cases for simultaneously varying xnx_nxn​ and yny_nyn​. The endpoint condition is vacuous for an endpoint excluded from T1T_1T1​. It is part of the strictly increasing clock case only; it imposes no extra restriction when the outer limit path is continuous.

Significance

This theorem supplies a precise condition for carrying two path limits through a random time transformation. In particular, the assertion includes convergence of the composed paths as elements of a càdlàg space, not merely convergence of their values at individual times. The distinction matters at jumps: pointwise convergence does not control the placement or ordering of nearby jumps. The result is a deterministic continuity statement that can be paired with probabilistic mapping theorems when the corresponding random paths are available.

Whitt proved the composition theorem in 1980, subject to the endpoint issue described below. The formalization work here is to construct its path-space interface in Lean, state the corrected continuity theorem with every domain condition visible, and eventually replace the open sorry proofs with checked proofs. The interface can also support the paper's later results on reflection, first passage, and time reversal; those results are separate missions. No proof of this mission's goal is claimed yet.

Difficulty

The tempting argument is to use separate continuity of xn→xx_n\to xxn​→x and yn→yy_n\to yyn​→y and then substitute yn(t)y_n(t)yn​(t) into the first convergence. That argument loses control of evaluations near a jump of xxx. A J1J_1J1​ time change may align a jump of xnx_nxn​ with the corresponding jump of xxx, while the clock yny_nyn​ may cross those times differently. Continuity of the outer limit path removes that difficulty in one case; in the other, the clock must be continuous and strictly increasing. The source explicitly shows that composition is not continuous on all of D×D0D\times D_0D×D0​ (§3, p. 75).

The endpoints impose a further obstruction because increasing homeomorphisms of a closed time interval fix its endpoints. Bauer's Remark on p. 75 observes a failure at the right endpoint. There is a symmetric failure at the left endpoint, so the statement here includes both. This is a correction to the printed theorem, not a new claim that the uncorrected theorem is true.

Formalization scope

Paths are represented as total functions R→S\mathbb R\to SR→S, with only values on the named interval used. The domain assumptions OrdConnected and Nonempty express nonempty real intervals. The outer interval T3T_3T3​ is also required to have nonempty interior: the formal convergence predicate checks only compact intervals [a,b][a,b][a,b] with a<ba<ba<b, so on a one-point T3T_3T3​ it imposes nothing, and the C×D0C\times D_0C×D0​ case would fail for constant outer paths with different values. A clock's range condition is explicit, as is nondecreasingness for every prelimit clock. Membership of all paths in the relevant càdlàg spaces is part of the convergence predicates. The output predicate likewise requires every composition and its limit to be càdlàg. This rules out the trivialization in which one merely proves convergence of selected point evaluations or assumes the compositions already have the conclusion's path-space properties.

The compact uniform distance and the infimum over time changes take values in [0,∞][0,\infty][0,∞]. They use the actual metric on SSS, not a real supremum with a default value on an unbounded set. A time change is a total function whose restriction to the compact interval is continuous, strictly increasing, and onto. Continuity at a time means continuity relative to the path's interval. The general-interval convergence predicate checks the compact intervals specified by Whitt and requires each sequence member to belong to DDD. The theorem is written as sequential continuity; Whitt's J1J_1J1​ spaces are metrizable, making that equivalent to topological continuity. The real-valued clock space uses the relative topology inherited from real-valued càdlàg paths.

The endpoint correction is exact in the Lean statement. At the right endpoint, take T1=T2=T3=[0,1]T_1=T_2=T_3=[0,1]T1​=T2​=T3​=[0,1], y(t)=ty(t)=ty(t)=t, yn(t)=(1−1/n)ty_n(t)=(1-1/n)tyn​(t)=(1−1/n)t for n≥2n\ge2n≥2, and x=1{1}x=1_{\{1\}}x=1{1}​. Then x∘ynx\circ y_nx∘yn​ is zero while (x∘y)(1)=1(x\circ y)(1)=1(x∘y)(1)=1. At the left endpoint, take T1=T2=[0,1]T_1=T_2=[0,1]T1​=T2​=[0,1], T3=[−1,2]T_3=[-1,2]T3​=[−1,2], yn=y=ey_n=y=eyn​=y=e, x=1[0,2]x=1_{[0,2]}x=1[0,2]​, and xn=1[1/n,2]x_n=1_{[1/n,2]}xn​=1[1/n,2]​. The outer paths converge in J1J_1J1​ on T3T_3T3​, but the compositions disagree at 000. Both examples show why continuity of xxx at the image of every included endpoint is required in the D×C0D\times C_0D×C0​ case.

The development needs the càdlàg definition, J1J_1J1​ metric and convergence predicates, compact restriction lemma, and the finite oscillation partition. Their definitions and lemmas are reusable for other functionals on path spaces. Contributions that prove the milestones and goal under the stated hypotheses are welcome. This mission does not formalize the Borel measurability or probability-measure machinery discussed elsewhere in Whitt's paper; Theorem 3.1 itself is a deterministic continuity claim.

Selected references

  • Ward Whitt, Some Useful Functions for Functional Limit Theorems, Mathematics of Operations Research 5(1), 67–85, 1980. DOI: 10.1287/moor.5.1.67.
6 thms1 active userReviewed
Control TheoryOperations ResearchStochastic Systems·Captain: mikedeng1

Time-Inconsistent Stochastic Linear–Quadratic Control I: A Flow of Forward–Backward SDEs Gives a Sufficient Condition for Open-Loop Equilibrium ControlsResearch Paper

Motivation

Dynamic programming rests on time consistency: a control that is optimal when viewed from time 000 stays optimal when viewed from any later time. Many problems of mathematical finance lack this property. The continuous-time mean–variance portfolio problem (Zhou–Li 2000) contains a variance, that is, a nonlinear function of an expectation, and state-dependent risk aversion (Björk–Murgoci–Zhou) lets the criterion itself depend on the current state. For such problems an optimal control computed today is abandoned tomorrow, and the HJB equation is not available.

One response, going back to the game-theoretic view of non-commitment (Ekeland–Lazrak, arXiv:math/0604264; Björk–Murgoci, SSRN 1694759), is to replace optimality by equilibrium: a control that no "future self" can improve by deviating on an infinitesimally short interval. Those works consider feedback (Markov) controls. Hu, Jin and Zhou (arXiv:1111.0818v1) define equilibrium within open-loop controls for a general stochastic linear–quadratic (LQ) problem with random coefficients, and characterize it by a flow of forward–backward SDEs, in the spirit of the stochastic maximum principle (Peng 1990). This mission formalizes that characterization: §2 and §3 of the paper, up to Theorem 3.2. The other two missions of the series build on it. Mission II treats a scalar state with deterministic coefficients (Theorem 4.4), and Mission III treats mean–variance portfolio selection (Theorem 5.4).

Setting

Let W=(W1,…,Wd)W=(W^1,\dots,W^d)W=(W1,…,Wd) be a standard ddd-dimensional Brownian motion on (Ω,F,P)(\Omega,\mathcal F,\mathbb P)(Ω,F,P) with its filtration (Ft)(\mathcal F_t)(Ft​), and let T>0T>0T>0. A control is a process u∈LF2(0,T;Rl)u\in L^2_{\mathcal F}(0,T;\mathbb R^l)u∈LF2​(0,T;Rl), that is, progressively measurable with E∫0T∣us∣2ds<∞\mathbb E\int_0^T|u_s|^2ds<\inftyE∫0T​∣us​∣2ds<∞. Its state XXX solves the linear SDE

dXs=[AsXs+Bs′us+bs] ds+∑j=1d[CsjXs+Dsjus+σsj] dWsj,X0=x0.dX_s=[A_sX_s+B_s'u_s+b_s]\,ds+\sum_{j=1}^d[C^j_sX_s+D^j_su_s+\sigma^j_s]\,dW^j_s,\qquad X_0=x_0.dXs​=[As​Xs​+Bs′​us​+bs​]ds+j=1∑d​[Csj​Xs​+Dsj​us​+σsj​]dWsj​,X0​=x0​.

Here AAA is a bounded deterministic n×nn\times nn×n matrix function. BBB (l×nl\times nl×n), CjC^jCj (n×nn\times nn×n) and DjD^jDj (n×ln\times ln×l) are essentially bounded progressive processes, and b,σj∈LF2(0,T;Rn)b,\sigma^j\in L^2_{\mathcal F}(0,T;\mathbb R^n)b,σj∈LF2​(0,T;Rn). At time ttt, with state xtx_txt​ and Et=E[⋅∣Ft]\mathbb E_t=\mathbb E[\cdot\mid\mathcal F_t]Et​=E[⋅∣Ft​], the cost is

J(t,xt;u)=12Et ⁣∫tT ⁣[⟨QsXs,Xs⟩+⟨Rsus,us⟩]ds+12Et⟨GXT,XT⟩−12⟨h EtXT,EtXT⟩−⟨μ1xt+μ2,EtXT⟩.J(t,x_t;u)=\tfrac12\mathbb E_t\!\int_t^T\!\big[\langle Q_sX_s,X_s\rangle+\langle R_su_s,u_s\rangle\big]ds+\tfrac12\mathbb E_t\langle GX_T,X_T\rangle-\tfrac12\langle h\,\mathbb E_tX_T,\mathbb E_tX_T\rangle-\langle\mu_1x_t+\mu_2,\mathbb E_tX_T\rangle.J(t,xt​;u)=21​Et​∫tT​[⟨Qs​Xs​,Xs​⟩+⟨Rs​us​,us​⟩]ds+21​Et​⟨GXT​,XT​⟩−21​⟨hEt​XT​,Et​XT​⟩−⟨μ1​xt​+μ2​,Et​XT​⟩.

Q,RQ,RQ,R are bounded symmetric processes with Q,R⪰0Q,R\succeq0Q,R⪰0, and G,hG,hG,h are symmetric with G⪰0G\succeq0G⪰0. The last two terms make the problem time-inconsistent. Given u∗u^*u∗ with state X∗X^*X∗, the spike variation at ttt is ust,ε,v=us∗+v1[t,t+ε)(s)u^{t,\varepsilon,v}_s=u^*_s+v\mathbf 1_{[t,t+\varepsilon)}(s)ust,ε,v​=us∗​+v1[t,t+ε)​(s) for v∈LFt2(Ω;Rl)v\in L^2_{\mathcal F_t}(\Omega;\mathbb R^l)v∈LFt​2​(Ω;Rl). The control u∗u^*u∗ is an equilibrium (Definition 2.1) if for every t∈[0,T)t\in[0,T)t∈[0,T) and every such vvv, almost surely

lim inf⁡ε↓0J(t,Xt∗;ut,ε,v)−J(t,Xt∗;u∗)ε≥0.\liminf_{\varepsilon\downarrow0}\frac{J(t,X^*_t;u^{t,\varepsilon,v})-J(t,X^*_t;u^*)}{\varepsilon}\ge0.ε↓0liminf​εJ(t,Xt∗​;ut,ε,v)−J(t,Xt∗​;u∗)​≥0.

For each ttt, the first adjoint process (p(⋅;t),k(⋅;t))(p(\cdot;t),k(\cdot;t))(p(⋅;t),k(⋅;t)) solves on [t,T][t,T][t,T] the BSDE (3.1) with driver A′p+∑j(Cj)′kj+QX∗A'p+\sum_j(C^j)'k^j+QX^*A′p+∑j​(Cj)′kj+QX∗ and terminal value GXT∗−h EtXT∗−μ1Xt∗−μ2GX^*_T-h\,\mathbb E_tX^*_T-\mu_1X^*_t-\mu_2GXT∗​−hEt​XT∗​−μ1​Xt∗​−μ2​. The second adjoint process (P(⋅;t),K(⋅;t))(P(\cdot;t),K(\cdot;t))(P(⋅;t),K(⋅;t)) solves the matrix BSDE (3.2) with terminal value GGG. With these, define

Λ(s;t)=Bsp(s;t)+∑j(Dsj)′kj(s;t)+Rsus∗,H(s;t)=Rs+∑j(Dsj)′P(s;t)Dsj.\Lambda(s;t)=B_sp(s;t)+\sum_j(D^j_s)'k^j(s;t)+R_su^*_s,\qquad H(s;t)=R_s+\sum_j(D^j_s)'P(s;t)D^j_s.Λ(s;t)=Bs​p(s;t)+j∑​(Dsj​)′kj(s;t)+Rs​us∗​,H(s;t)=Rs​+j∑​(Dsj​)′P(s;t)Dsj​.

Formalization targets

Goal: Theorem 3.2 (p. 7)

Suppose u∗∈LF2u^*\in L^2_{\mathcal F}u∗∈LF2​, its state X∗X^*X∗, and for every t∈[0,T)t\in[0,T)t∈[0,T) a solution (p(⋅;t),k(⋅;t))(p(\cdot;t),k(\cdot;t))(p(⋅;t),k(⋅;t)) of (3.1) are given, and suppose Λ\LambdaΛ satisfies condition (3.4):

Et ⁣∫tT∣Λ(s;t)∣ ds<+∞,lim⁡s↓tEt[Λ(s;t)]=0a.s., for all t∈[0,T).\mathbb E_t\!\int_t^T|\Lambda(s;t)|\,ds<+\infty,\qquad\lim_{s\downarrow t}\mathbb E_t[\Lambda(s;t)]=0\quad\text{a.s., for all }t\in[0,T).Et​∫tT​∣Λ(s;t)∣ds<+∞,s↓tlim​Et​[Λ(s;t)]=0a.s., for all t∈[0,T).

Then u∗u^*u∗ is an equilibrium control.

Milestones

  1. P(s;t)⪰0P(s;t)\succeq0P(s;t)⪰0 (§3, p. 5).
  2. The perturbation decomposition Xt,ε,v=X∗+Y+ZX^{t,\varepsilon,v}=X^*+Y+ZXt,ε,v=X∗+Y+Z, with Et[Ys]=0\mathbb E_t[Y_s]=0Et​[Ys​]=0, Etsup⁡∣Y∣2=O(ε)\mathbb E_t\sup|Y|^2=O(\varepsilon)Et​sup∣Y∣2=O(ε) and Etsup⁡∣Z∣2=O(ε2)\mathbb E_t\sup|Z|^2=O(\varepsilon^2)Et​sup∣Z∣2=O(ε2) (proof of Proposition 3.1, p. 5).
  3. Proposition 3.1, the expansion
J(t,Xt∗;ut,ε,v)−J(t,Xt∗;u∗)=Et ⁣∫tt+ε ⁣{⟨Λ(s;t),v⟩+12⟨H(s;t)v,v⟩}ds+o(ε).J(t,X^*_t;u^{t,\varepsilon,v})-J(t,X^*_t;u^*)=\mathbb E_t\!\int_t^{t+\varepsilon}\!\Big\{\langle\Lambda(s;t),v\rangle+\tfrac12\langle H(s;t)v,v\rangle\Big\}ds+o(\varepsilon).J(t,Xt∗​;ut,ε,v)−J(t,Xt∗​;u∗)=Et​∫tt+ε​{⟨Λ(s;t),v⟩+21​⟨H(s;t)v,v⟩}ds+o(ε).

Significance

Theorem 3.2 is the paper's general tool. Its two explicit results are applications of it. With a scalar state and deterministic coefficients, a pair of coupled Riccati-type equations gives a linear feedback equilibrium (Theorem 4.4). In mean–variance portfolio selection with state-dependent risk aversion and a possibly random risk premium, the equilibrium strategy is found through a quadratic BSDE (Theorem 5.4). Each is proved by exhibiting a solution of the flow (3.6) and checking (3.4). The theorem therefore separates the existence question (solving a flow of FBSDEs) from the equilibrium question. The paper notes that the general existence question remains open.

The results are proved in the paper and have no machine-checked proof. The mission produces a precise statement of open-loop equilibrium for a stochastic LQ problem with random coefficients, together with Lean statements of the spike expansion and of the adjoint flows. Mission II and Mission III restate the same model, and their final steps apply this theorem. Formal proofs of the milestones exercise Itô calculus for linear SDEs and BSDEs with bounded coefficients: product rules, conditional L2L^2L2 estimates, and uniqueness and sign properties of linear BSDEs. This is infrastructure that Mathlib does not yet have.

Difficulty

The obvious argument is a first-order expansion of JJJ in ε\varepsilonε. It fails because the spike changes the control by vvv, which is not small, on a set of small measure. The state's deviation is then of order ε\sqrt\varepsilonε​ in L2L^2L2, its square contributes at order ε\varepsilonε, and a second-order term H(s;t)H(s;t)H(s;t) appears that a first-order adjoint cannot capture. Two features are absent from the classical maximum principle. The adjoint equations form a whole flow indexed by ttt, because the terminal value of (3.1) contains EtXT∗\mathbb E_t X^*_TEt​XT∗​ and Xt∗X^*_tXt∗​. And every statement is conditional on Ft\mathcal F_tFt​, so the expansion has to hold almost surely at the level of conditional expectations. That rules out arguments based on unconditional expectations.

Formalization scope

Brownian motion, LF2L^2_{\mathcal F}LF2​, Itô integrals and SDE solutions come from the published definition Peng1990_SMP_Stochastic. The formalization commits to the following conventions.

  • The filtration is the natural, uncompleted filtration of WWW. This changes no statement.
  • The state from time ttt (2.2) is the full-horizon state of the control that equals u∗u^*u∗ before ttt.
  • The spike is additive on [t,t+ε)[t,t+\varepsilon)[t,t+ε).
  • Definition 2.1 uses the lower limit, in R‾\overline{\mathbb R}R, along every sequence εk↓0\varepsilon_k\downarrow0εk​↓0, almost surely for each sequence, for every state of u∗u^*u∗ and of each perturbed control. The page writes "lim". That limit need not exist for merely bounded measurable RRR, and the proof of Theorem 3.2 only bounds the quotient from below.
  • Each adjoint BSDE lives on [t,T][t,T][t,T], not on [0,T][0,T][0,T]. Equation (3.2) is read entrywise, with symmetric values.
  • Condition (3.4) is encoded version-robustly. Part (a) is the generalized conditional expectation, via Ft\mathcal F_tFt​-sets of full union. Part (b) requires a jointly measurable process that is, for almost every sss, a version of Et[Λ(s;t)]\mathbb E_t[\Lambda(s;t)]Et​[Λ(s;t)] and that tends to 000 as s↓ts\downarrow ts↓t.
  • The O(⋅)O(\cdot)O(⋅) estimates carry an explicit constant times ∣v∣2|v|^2∣v∣2, and suprema are taken over rational times.
  • "Essentially bounded" and "a.s., a.e." mean ds⊗dPds\otimes d\mathbb Pds⊗dP-almost everywhere.

The conclusion of the goal is Definition 2.1 itself. It mentions neither Λ\LambdaΛ nor the adjoint processes, so the goal cannot be closed by unfolding. A definition of equilibrium in terms of (3.4) or (3.5) would make Theorem 3.2 trivially true and is ruled out. Condition (3.5) of p. 6 is not a hypothesis of any statement. A degenerate, noise-free example checks that the hypotheses of the goal can hold together.

Contributions are welcome as follows. Proofs of the three milestones are reusable for Missions II and III and for any spike-variation argument. So are general lemmas on linear SDEs and BSDEs over Peng's Itô integral: uniqueness, conditional moment bounds, the Itô product rule, and positivity of linear matrix BSDEs.

Selected references

  • Y. Hu, H. Jin, X. Y. Zhou, Time-Inconsistent Stochastic Linear–Quadratic Control, arXiv:1111.0818v1, 2011; SIAM J. Control Optim. 50(3), 2012. https://arxiv.org/abs/1111.0818 , https://doi.org/10.1137/110853960
  • S. Peng, A general stochastic maximum principle for optimal control problems, SIAM J. Control Optim. 28 (1990), 966–979. https://doi.org/10.1137/0328054
  • J. Yong, X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations, Springer, 1999. https://doi.org/10.1007/978-1-4612-1466-3
  • T. Björk, A. Murgoci, A general theory of Markovian time inconsistent stochastic control problems, SSRN 1694759, 2010. https://ssrn.com/abstract=1694759
  • I. Ekeland, A. Lazrak, Being serious about non-commitment: subgame perfect equilibrium in continuous time, arXiv:math/0604264, 2006. https://arxiv.org/abs/math/0604264
  • T. Björk, A. Murgoci, X. Y. Zhou, Mean–variance portfolio optimization with state-dependent risk aversion, Math. Finance 24(1) (2014), 1–24. https://doi.org/10.1111/j.1467-9965.2011.00515.x
  • X. Y. Zhou, D. Li, Continuous-time mean-variance portfolio selection: a stochastic LQ framework, Appl. Math. Optim. 42 (2000), 19–33. https://doi.org/10.1007/s002450010003
  • Companion missions: Time-Inconsistent Stochastic Linear–Quadratic Control II (Theorem 4.4) and III (Theorem 5.4), same source.
7 thms1 active userReviewed
Harmonic AnalysisTheoretical Computer Science·Captain: mikedeng1

Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs? 3: Low-Influence Functions Have Level-One Fourier Weight at Most 2/π + CδResearch Paper

Motivation

Fourier analysis of functions on the discrete cube {−1,1}n\{-1,1\}^n{−1,1}n is the main tool behind tight inapproximability results under the Unique Games Conjecture. In the MAX-CUT reduction of Khot, Kindler, Mossel and O'Donnell (SIAM J. Comput. 2007), soundness rests on the Majority Is Stablest theorem: among bounded functions in which no coordinate has large influence, the majority function is asymptotically the most noise stable. That theorem was a conjecture when the paper was written and was proved by Mossel, O'Donnell and Oleszkiewicz (Annals of Math. 2010) using an invariance principle.

Section 6.2 of the paper records special cases of Majority Is Stablest that have short, self-contained proofs. Theorem 6 is the case where the noise parameter ρ\rhoρ tends to 000. There the noise stability is dominated by the Fourier weight at level 1, and the statement says that a bounded function with small influences has level-one weight at most 2/π2/\pi2/π, up to an explicit error linear in the largest influence. Bounds on the level-one weight also appear in Talagrand's work on correlation of monotone sets (Combinatorica 1996), which the paper compares against (its Theorem 18), and the level-one inequality is a standard chapter of the analysis of Boolean functions (O'Donnell 2014).

Setting

Points of the discrete cube {−1,1}n\{-1,1\}^n{−1,1}n are sign vectors x=(x1,…,xn)x=(x_1,\dots,x_n)x=(x1​,…,xn​); following the paper, the bit TRUE is read as −1-1−1 and FALSE as 111. The cube carries the uniform probability measure, so E[g]=2−n∑xg(x)\mathbf E[g]=2^{-n}\sum_x g(x)E[g]=2−n∑x​g(x), and real functions form an inner product space with ⟨f,g⟩=E[fg]\langle f,g\rangle=\mathbf E[fg]⟨f,g⟩=E[fg].

For S⊆[n]S\subseteq[n]S⊆[n] the parity χS(x)=∏i∈Sxi\chi_S(x)=\prod_{i\in S}x_iχS​(x)=∏i∈S​xi​; the parities form an orthonormal basis, and the Fourier coefficient of fff at SSS is f^(S)=⟨f,χS⟩\hat f(S)=\langle f,\chi_S\ranglef^​(S)=⟨f,χS​⟩. The weight of fff at level 1 is

W1(f)=∑∣S∣=1f^(S)2=∑i=1nf^({i})2.W^1(f)=\sum_{|S|=1}\hat f(S)^2=\sum_{i=1}^n\hat f(\{i\})^2 .W1(f)=∣S∣=1∑​f^​(S)2=i=1∑n​f^​({i})2.

The influence of coordinate iii on fff (Definition 2) is

Infi(f)=Ex1,…,xi−1,xi+1,…,xn[Varxi[f]],\mathrm{Inf}_i(f)=\mathop{\mathbf E}_{x_1,\dots,x_{i-1},x_{i+1},\dots,x_n}\big[\mathrm{Var}_{x_i}[f]\big],Infi​(f)=Ex1​,…,xi−1​,xi+1​,…,xn​​[Varxi​​[f]],

the expected variance of fff when all coordinates but xix_ixi​ are fixed at random and xix_ixi​ is a uniform sign. The linear part of fff is ℓ(x)=∑if^({i})xi\ell(x)=\sum_i\hat f(\{i\})x_iℓ(x)=∑i​f^​({i})xi​, and ∥g∥1=E∣g∣\|g\|_1=\mathbf E|g|∥g∥1​=E∣g∣, ∥g∥2=E[g2]\|g\|_2=\sqrt{\mathbf E[g^2]}∥g∥2​=E[g2]​, ∥g∥∞=max⁡x∣g(x)∣\|g\|_\infty=\max_x|g(x)|∥g∥∞​=maxx​∣g(x)∣.

Throughout, C=2(1−2/π)≈0.404C=2\big(1-\sqrt{2/\pi}\big)\approx 0.404C=2(1−2/π​)≈0.404.

Formalization targets

Goal: Theorem 6 (p. 12)

For every nnn, every f:{−1,1}n→[−1,1]f:\{-1,1\}^n\to[-1,1]f:{−1,1}n→[−1,1] and every δ≥0\delta\ge 0δ≥0 with Infi(f)≤δ\mathrm{Inf}_i(f)\le\deltaInfi​(f)≤δ for all iii,

∑∣S∣=1f^(S)2  ≤  2π+Cδ.\sum_{|S|=1}\hat f(S)^2\;\le\;\frac{2}{\pi}+C\delta .∣S∣=1∑​f^​(S)2≤π2​+Cδ.

The constant CCC is explicit, and the goal states it exactly as printed.

Milestones (proof of Theorem 6, p. 25, and Proposition 7.2, p. 16)

  1. For fff with values in [−1,1][-1,1][−1,1]: ∑∣S∣=1f^(S)2=∥ℓ∥22=⟨f,ℓ⟩≤∥f∥∞∥ℓ∥1≤∥ℓ∥1\sum_{|S|=1}\hat f(S)^2=\|\ell\|_2^2=\langle f,\ell\rangle\le\|f\|_\infty\|\ell\|_1\le\|\ell\|_1∑∣S∣=1​f^​(S)2=∥ℓ∥22​=⟨f,ℓ⟩≤∥f∥∞​∥ℓ∥1​≤∥ℓ∥1​.
  2. The König–Schütt–Tomczak-Jaegermann bound: if ∣ai∣≤δ|a_i|\le\delta∣ai​∣≤δ for all iii and ℓ=∑iaixi\ell=\sum_i a_ix_iℓ=∑i​ai​xi​, then
∥ℓ∥1≤2/π ∥ℓ∥2+C2 δ.\|\ell\|_1\le\sqrt{2/\pi}\,\|\ell\|_2+\tfrac C2\,\delta .∥ℓ∥1​≤2/π​∥ℓ∥2​+2C​δ.
  1. The quadratic step: for X,δ≥0X,\delta\ge0X,δ≥0, X2≤2/π X+C2δX^2\le\sqrt{2/\pi}\,X+\tfrac C2\deltaX2≤2/π​X+2C​δ implies X≤1/2π+1/2π+Cδ/2X\le\sqrt{1/2\pi}+\sqrt{1/2\pi+C\delta/2}X≤1/2π​+1/2π+Cδ/2​ and X2≤2/π+CδX^2\le 2/\pi+C\deltaX2≤2/π+Cδ.
  2. Proposition 7.2: Infi(f)=∑S∋if^(S)2\mathrm{Inf}_i(f)=\sum_{S\ni i}\hat f(S)^2Infi​(f)=∑S∋i​f^​(S)2.

Significance

The result. The constant 2/π2/\pi2/π is sharp: majority on nnn variables has influences of order n−1/2n^{-1/2}n−1/2 and level-one weight tending to 2/π2/\pi2/π, which is (E∣Z∣)2(\mathbf E|Z|)^2(E∣Z∣)2 for a standard Gaussian ZZZ. Theorem 6 thus identifies the extremal level-one weight of low-influence bounded functions and gives a rate linear in the maximal influence. It is the ρ→0\rho\to0ρ→0 instance of Majority Is Stablest, obtained without the invariance principle, and level-one bounds of this type are used in hardness reductions and in the study of noise sensitivity.

Formalizing it. The milestones together give a complete formal route from bounded functions to the stated bound, except for one step discussed below. They also produce a reusable layer of Boolean Fourier analysis: Fourier coefficients, level weights, influences in their variance form and the Fourier formula for influences. Mathlib contains no development of influences or level weights on the cube, and the platform has none either; the König–Schütt–Tomczak-Jaegermann inequality, a sharp quantitative central limit bound for Rademacher sums (J. Reine Angew. Math. 1999), has no machine-checked proof.

Status. The published proof's first step, ∣f^({i})∣≤Infi(f)|\hat f(\{i\})|\le\mathrm{Inf}_i(f)∣f^​({i})∣≤Infi​(f), is valid for Boolean-valued fff but not for [−1,1][-1,1][−1,1]-valued fff; for [−1,1][-1,1][−1,1]-valued fff the statement is posed as printed. For f=c x1f=c\,x_1f=cx1​ with 0<c<10<c<10<c<1 one has f^({1})=c>c2=Inf1(f)\hat f(\{1\})=c>c^2=\mathrm{Inf}_1(f)f^​({1})=c>c2=Inf1​(f), and the argument as written then yields only 2/π+Cδ2/\pi+C\sqrt\delta2/π+Cδ​. Numerical search over small cubes has found no function violating the printed bound. A proof of the goal for bounded fff, or a counterexample, is therefore a genuine contribution.

Difficulty

The obvious argument replaces ℓ\ellℓ by a Gaussian with the same variance and uses E∣Z∣=2/π\mathbf E|Z|=\sqrt{2/\pi}E∣Z∣=2/π​. A central limit theorem with an error term is needed, and generic Berry–Esseen bounds give an additive error with a constant far from C/2C/2C/2; the exact constant 1−2/π1-\sqrt{2/\pi}1−2/π​ requires the sharp Rademacher-sum inequality, whose proof is a delicate analysis of E∣∑iaixi∣\mathbf E|\sum_ia_ix_i|E∣∑i​ai​xi​∣ as a function of the coefficients. The second obstacle is the passage from influences to coefficients. For bounded fff only f^({i})2≤Infi(f)\hat f(\{i\})^2\le\mathrm{Inf}_i(f)f^​({i})2≤Infi​(f) holds, so a bound on influences controls coefficients only at scale δ\sqrt\deltaδ​; feeding that into the chain loses the linear dependence on δ\deltaδ. Recovering the printed rate for non-Boolean fff needs an idea beyond the published proof.

Formalization scope

A point of the cube is Fin n → Bool, mapped to a sign by pm with pm true = -1 and pm false = 1. Expectations are normalised finite sums, so no measure theory is involved. A function f:{−1,1}n→[−1,1]f:\{-1,1\}^n\to[-1,1]f:{−1,1}n→[−1,1] is a real function with the hypothesis ∀ x, |f x| ≤ 1. The influence is defined as on the page, as the average over the cube of ((f(xi←1)−f(xi←−1))/2)2\big((f(x^{i\leftarrow1})-f(x^{i\leftarrow-1}))/2\big)^2((f(xi←1)−f(xi←−1))/2)2, which is the variance in xix_ixi​; it is not defined by its Fourier formula, which is a milestone. The level-one weight is ∑if^({i})2\sum_i\hat f(\{i\})^2∑i​f^​({i})2. The constant CCC is written out as 2 * (1 - Real.sqrt (2 / Real.pi)); an existentially quantified constant would be a weaker theorem. The case n=0n=0n=0 is allowed.

Two hypotheses are added and disclosed: δ≥0\delta\ge0δ≥0 in Theorem 6 and in the König–Schütt–Tomczak-Jaegermann bound. For n≥1n\ge1n≥1 each follows from the other hypotheses; for n=0n=0n=0 the influence (resp. coefficient) hypothesis is empty and δ≥0\delta\ge0δ≥0 is what the page assumes.

A trivializing formalization would drop the range hypothesis (then scaled dictators refute the bound and the statement is false), define influence through Fourier coefficients (which makes Proposition 7.2 definitional), or weaken the hypothesis of the goal to a bound on the coefficients ∣f^({i})∣≤δ|\hat f(\{i\})|\le\delta∣f^​({i})∣≤δ; none of these is used here. In particular, the goal is not strengthened to Boolean-valued fff, where the published proof applies verbatim.

Contributions welcome: proofs of Parseval-type identities for the linear part, of Proposition 7.2, of the elementary quadratic step, of the König–Schütt–Tomczak-Jaegermann inequality, and of the goal itself. The cube layer is reusable for any later formalization of Boolean function analysis.

Selected references

  • S. Khot, G. Kindler, E. Mossel, R. O'Donnell, Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs?, SIAM J. Comput. 37(1), 2007. https://doi.org/10.1137/S0097539705447372
  • E. Mossel, R. O'Donnell, K. Oleszkiewicz, Noise stability of functions with low influences: invariance and optimality, Annals of Mathematics 171(1), 2010. https://doi.org/10.4007/annals.2010.171.295
  • H. König, C. Schütt, N. Tomczak-Jaegermann, Projection constants of symmetric spaces and variants of Khintchine's inequality, J. Reine Angew. Math. 511, 1999. https://doi.org/10.1515/crll.1999.511.1
  • M. Talagrand, How much are increasing sets positively correlated?, Combinatorica 16(2), 1996. https://doi.org/10.1007/BF01844850
  • R. O'Donnell, Analysis of Boolean Functions, Cambridge University Press, 2014. https://arxiv.org/abs/2105.10386
7 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

The Quantity Flexibility Contract and Supplier-Customer Incentives II: With a Perfect Demand Signal the Transfer Price c̄(ψ) Makes the Quantity Flexibility Contract System-EfficientResearch Paper

Motivation

A manufacturer must commit to production before its retail customer knows what the market will demand, while the customer would rather postpone its purchase until better information arrives. Left uncoordinated, each firm protects itself: the customer inflates forecasts it is not bound by, and the manufacturer, discounting those forecasts, builds less than the supply chain as a whole should. Quantity flexibility (QF) contracts, used in practice in the electronics and computer industries (Sun Microsystems, Solectron, Nippon Otis and others are cited in the paper), address this by tying the customer's forecast to a band: the manufacturer guarantees supply up to a percentage above the forecast, and the customer promises to buy at least a percentage below it.

Tsay (1999) gives a two-stage model of such a contract with a demand signal that arrives between production and purchase, shows that a supply chain without commitment underproduces, and characterizes when a QF contract restores efficiency. This mission formalizes the efficiency result for the case in which the signal predicts demand perfectly (Proposition 6(a)), together with the steps of the equilibrium that it rests on.

Setting

A manufacturer (EM) produces at unit cost mmm and sells to a retailer at unit transfer price ccc; the retailer sells at price ppp, unsold units are salvaged at uuu at either site, and each unit of unmet demand costs a goodwill loss sss. The standing assumptions are p>m>0p > m > 0p>m>0, u<mu < mu<m and s≥0s \ge 0s≥0.

Before production, the retailer states a forecast q≥0q \ge 0q≥0. A QF contract {c,(α,ω)}\{c,(\alpha,\omega)\}{c,(α,ω)} with ω∈[0,1]\omega\in[0,1]ω∈[0,1] and α≥−ω\alpha\ge-\omegaα≥−ω obliges the EM to make up to q(1+α)q(1+\alpha)q(1+α) available and the retailer to buy at least q(1−ω)q(1-\omega)q(1−ω). The EM then builds QQQ. A demand signal μ\muμ with distribution function Θ\ThetaΘ is observed, the retailer buys rrr, and market demand is filled from the retailer's stock. In this mission the signal is perfect (σε=0\sigma_\varepsilon = 0σε​=0): market demand equals μ\muμ, so its distribution FFF equals Θ\ThetaΘ.

Given μ\muμ, the retailer's profit from buying rrr is

G(r∣μ)=pmin⁡[μ,r]−c r−s[μ−r]++u[r−μ]+,G(r\mid\mu) = p\min[\mu,r] - c\,r - s[\mu-r]^+ + u[r-\mu]^+,G(r∣μ)=pmin[μ,r]−cr−s[μ−r]++u[r−μ]+,

and it buys rQF∗=μ⊥[q(1−ω),Q]r^*_{QF} = \mu\perp[q(1-\omega),Q]rQF∗​=μ⊥[q(1−ω),Q], the point of the interval closest to μ\muμ. The EM's expected profit (2) is πEM,QF(Q;q)=(c−u)Eμ{rQF∗}−(m−u)Q\pi_{EM,QF}(Q;q) = (c-u)E_\mu\{r^*_{QF}\} - (m-u)QπEM,QF​(Q;q)=(c−u)Eμ​{rQF∗​}−(m−u)Q. The retailer's forecast problem maximizes πR,QF(q)=Eμ{G(rQF∗∣μ)}\pi_{R,QF}(q) = E_\mu\{G(r^*_{QF}\mid\mu)\}πR,QF​(q)=Eμ​{G(rQF∗​∣μ)} with the EM building q(1+α)q(1+\alpha)q(1+α). A central planner earns ΠCC(Q)=Eμ{pmin⁡[μ,Q]−s[μ−Q]++u[Q−μ]+}−mQ\Pi_{CC}(Q) = E_\mu\{p\min[\mu,Q]-s[\mu-Q]^+ + u[Q-\mu]^+\} - mQΠCC​(Q)=Eμ​{pmin[μ,Q]−s[μ−Q]++u[Q−μ]+}−mQ, maximized at

QCC∗=F−1 ⁣(p+s−mp+s−u).Q^*_{CC} = F^{-1}\!\left(\frac{p+s-m}{p+s-u}\right).QCC∗​=F−1(p+s−up+s−m​).

The total flexibility of the contract is ψ=(1+α)/(1−ω)\psi = (1+\alpha)/(1-\omega)ψ=(1+α)/(1−ω).

Formalization targets

Goal: Proposition 6(a)

With σε=0\sigma_\varepsilon = 0σε​=0, the QF contract with flexibility ψ\psiψ and transfer price

cˉ(ψ)=u+m−u1ψF ⁣(1ψF−1 ⁣(p+s−mp+s−u))+m−up+s−u(4)\bar c(\psi) = u + \frac{m-u}{\dfrac1\psi F\!\left(\dfrac1\psi F^{-1}\!\left(\dfrac{p+s-m}{p+s-u}\right)\right) + \dfrac{m-u}{p+s-u}} \tag{4}cˉ(ψ)=u+ψ1​F(ψ1​F−1(p+s−up+s−m​))+p+s−um−u​m−u​(4)

is system-efficient: the retailer's unique optimal forecast is q^=QCC∗/(1+α)\hat q = Q^*_{CC}/(1+\alpha)q^​=QCC∗​/(1+α), the EM's unique optimal production given q^\hat qq^​ is q^(1+α)=QCC∗\hat q(1+\alpha) = Q^*_{CC}q^​(1+α)=QCC∗​, and the resulting expected system profit equals max⁡QΠCC(Q)\max_Q \Pi_{CC}(Q)maxQ​ΠCC​(Q).

Milestones

  1. §4: QCC∗Q^*_{CC}QCC∗​ exists and is the unique maximizer of ΠCC\Pi_{CC}ΠCC​.
  2. §6.1: given μ\muμ, the retailer's unique optimal purchase in [a,b][a,b][a,b] is μ⊥[a,b]\mu\perp[a,b]μ⊥[a,b].
  3. Proposition 3(a): for ω<1\omega<1ω<1, the optimal forecast qQF∗q^*_{QF}qQF∗​ is strictly positive, finite, and the unique solution of the first-order condition (3).
  4. §7: for any forecast q≥0q\ge0q≥0, expected system profit equals ΠCC(q(1+α))\Pi_{CC}(q(1+\alpha))ΠCC​(q(1+α)); hence it is maximal when the production level q(1+α)q(1+\alpha)q(1+α) matches QCC∗Q^*_{CC}QCC∗​.

Significance

The result shows that one contract form, by choosing the transfer price as a function of the flexibility, yields a whole menu of contracts each of which coordinates the supply chain, so that the two firms can trade price against flexibility without losing system profit. Its corollaries in the paper, that any split of expected profit is achievable by some efficient contract and that more flexibility shifts profit to the manufacturer, rest on (4).

The paper prints no proofs ("All proofs are omitted due to space limitations", p. 1341). A machine-checked development supplies them, makes explicit the regularity the argument needs (finite variance, a continuous and strictly increasing Θ\ThetaΘ, a positive efficient quantity), and gives reusable statements about newsvendor objectives with a clipped purchase. To our knowledge none of these results has been formalized before; the platform's quantity-flexibility theorems in other models (no manufacturer production stage, α=0\alpha = 0α=0, retailer side only) do not cover them.

Difficulty

Each firm optimizes its own objective, and the efficient price must work for both at once. Making the retailer's first-order condition hold at q^\hat qq^​ pins down ccc, so nothing is left to adjust for the EM, whose incentive to build more than the contracted q(1+α)q(1+\alpha)q(1+α) has to be ruled out separately at that same price. The retailer's objective is an expectation of a non-smooth function of a clipped purchase, so its derivative must be computed through the distribution of μ\muμ on two moving thresholds q(1+α)q(1+\alpha)q(1+α) and q(1−ω)q(1-\omega)q(1−ω), and strict concavity must come from the strict increase of Θ\ThetaΘ rather than from a density.

Formalization scope

All objects live in the namespace TsayQF.EffQF. The law of μ\muμ is a probability measure ν\nuν on R\mathbb RR with μ∈L2(ν)\mu\in L^2(\nu)μ∈L2(ν), whose distribution function cdf ν is differentiable and strictly increasing on R\mathbb RR (the paper's "differentiable and invertible"). Expectations are Bochner integrals; finite variance makes every integrand integrable. Inverse distribution functions are not used: QCC∗Q^*_{CC}QCC∗​ enters as a real number with the hypothesis F(QCC∗)=κSF(Q^*_{CC}) = \kappa_SF(QCC∗​)=κS​, which determines it uniquely, and (4) is defined in its printed shape. Optimality is IsMaxOn over the decision's natural set: forecasts in [0,∞)[0,\infty)[0,∞), the EM's production in [q(1+α),∞)[q(1+\alpha),\infty)[q(1+α),∞), purchases in [q(1−ω),Q][q(1-\omega),Q][q(1−ω),Q], central production in R\mathbb RR.

Hypotheses made explicit: QCC∗>0Q^*_{CC} > 0QCC∗​>0 in the goal and a positive marginal value of the forecast at q=0q=0q=0 in Proposition 3(a), both standing for the paper's presumption that demand is almost certainly nonnegative; ω<1\omega<1ω<1 (Proposition 3's case). The transfer price is only required to satisfy u<c<p+su<c<p+su<c<p+s rather than m<c<pm<c<pm<c<p, because cˉ(ψ)\bar c(\psi)cˉ(ψ) can exceed ppp when s>0s>0s>0. The milestones are the σε=0\sigma_\varepsilon = 0σε​=0 instances of the paper's general statements.

Two modelling choices are fixed. The retailer's forecast objective takes the EM's production to be q(1+α)q(1+\alpha)q(1+α), as §6.1 does after Proposition 2; the full game in which the retailer anticipates other EM responses is not modelled, and the goal instead verifies that the EM's unique best response at cˉ(ψ)\bar c(\psi)cˉ(ψ) is exactly q(1+α)q(1+\alpha)q(1+α). The efficient price is the explicit formula (4), not "a price that makes QCC∗Q^*_{CC}QCC∗​ optimal", which would make the goal a tautology; likewise system efficiency is stated as an inequality against ΠCC\Pi_{CC}ΠCC​ at every production level, not by definition.

Needed infrastructure: derivatives of expectations of piecewise-linear functions of a clipped variable, and the newsvendor fractile characterization. Both are reusable for other contract models. Proofs of any milestone, and of the goal from the milestones, are welcome.

Selected references

  • A. A. Tsay, The Quantity Flexibility Contract and Supplier-Customer Incentives, Management Science 45(10):1339–1358, 1999. https://doi.org/10.1287/mnsc.45.10.1339
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in OR & MS vol. 11, 2003, §6.2.5. https://doi.org/10.1016/S0927-0507(03)11006-7
  • L. V. Snyder and Z.-J. M. Shen, Fundamentals of Supply Chain Theory, Wiley, 2nd ed. 2019, Ch. 14. https://doi.org/10.1002/9781119584445
6 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

The Quantity Flexibility Contract and Supplier-Customer Incentives I: Without Commitment the Manufacturer Underproduces for Every Transfer Price and the Supply Chain Is InefficientResearch Paper

Motivation

A manufacturer must commit to production before a retailer knows how much it will buy. In practice the retailer sends a forecast first, and the manufacturer plans against it. When the forecast binds neither party, the retailer has no reason to report it honestly, and the manufacturer has no reason to plan for the market rather than for its own margin. Purchasing managers have described this to Tsay directly, and Lee, Padmanabhan and Whang (1997) document such "phantom ordering" in several case studies.

A. A. Tsay, The Quantity Flexibility Contract and Supplier-Customer Incentives (Management Science, 1999), models the situation as a two-stage newsvendor game with a demand-information update between production and purchase. Its first result, Proposition 1, is the benchmark the rest of the paper builds on. Even when both parties share the same beliefs about demand, a linear transfer price alone leaves the manufacturer underproducing relative to a central planner, and the supply chain loses expected profit, for every transfer price. That inefficiency motivates the quantity flexibility (QF) contract studied in the remainder of the paper and in the companion mission of this series.

Setting

Costs. The retail price is ppp and the unit transfer price paid by the retailer to the manufacturer (the EM) is ccc. The unit production cost is mmm, the unit salvage value is uuu (the same for either party), and the unit goodwill loss on unmet demand is sss. The paper's standing assumptions (§3.1, p. 1344) are

p>c>m>0,u<m,s≥0.p > c > m > 0,\qquad u < m,\qquad s \ge 0 .p>c>m>0,u<m,s≥0.

Three critical fractiles recur:

κR=p+s−cp+s−u,κEM=c−mc−u,κS=p+s−mp+s−u.\kappa_R = \frac{p+s-c}{p+s-u},\qquad \kappa_{EM} = \frac{c-m}{c-u},\qquad \kappa_S = \frac{p+s-m}{p+s-u}.κR​=p+s−up+s−c​,κEM​=c−uc−m​,κS​=p+s−up+s−m​.

Demand (§3.3). Market demand is X=μ+εX = \mu + \varepsilonX=μ+ε. The signal μ\muμ has distribution function Θ\ThetaΘ, which is differentiable and strictly increasing, and finite variance. The error ε∼N(0,σε2)\varepsilon \sim N(0,\sigma_\varepsilon^2)ε∼N(0,σε2​) is independent of μ\muμ. FFF is the distribution function of XXX, Φ\PhiΦ is the standard normal distribution function, and zε=Φ−1(κR)z_\varepsilon = \Phi^{-1}(\kappa_R)zε​=Φ−1(κR​).

Timing (§3.2). The EM produces QQQ knowing only the prior. Then μ\muμ is observed and the retailer buys r≤Qr \le Qr≤Q. Then XXX is realized, and both parties salvage their surplus. Given μ\muμ, the retailer's expected profit from purchase rrr is

G(r∣μ)=EX∣μ{pmin⁡[X,r]−c r−s[X−r]++u[r−X]+}.(1)G(r\mid\mu) = E_{X\mid\mu}\{p\min[X,r] - c\,r - s[X-r]^+ + u[r-X]^+\}. \tag{1}G(r∣μ)=EX∣μ​{pmin[X,r]−cr−s[X−r]++u[r−X]+}.(1)

Without commitment the retailer buys rNC∗(Q,μ)=min⁡[μ+zεσε,Q]r^*_{NC}(Q,\mu) = \min[\mu + z_\varepsilon\sigma_\varepsilon, Q]rNC∗​(Q,μ)=min[μ+zε​σε​,Q]. The EM's expected profit is

πEM,NC(Q)=(c−u) Eμ rNC∗(Q,μ)−(m−u) Q,\pi_{EM,NC}(Q) = (c-u)\,E_\mu\, r^*_{NC}(Q,\mu) - (m-u)\,Q,πEM,NC​(Q)=(c−u)Eμ​rNC∗​(Q,μ)−(m−u)Q,

and the retailer's is πR,NC(Q)=Eμ G(rNC∗(Q,μ)∣μ)\pi_{R,NC}(Q) = E_\mu\, G(r^*_{NC}(Q,\mu)\mid\mu)πR,NC​(Q)=Eμ​G(rNC∗​(Q,μ)∣μ). A central planner producing QQQ before the signal earns

ΠCC(Q)=EX{pmin⁡[X,Q]−s[X−Q]++u[Q−X]+}−mQ.\Pi_{CC}(Q) = E_X\{p\min[X,Q] - s[X-Q]^+ + u[Q-X]^+\} - mQ .ΠCC​(Q)=EX​{pmin[X,Q]−s[X−Q]++u[Q−X]+}−mQ.

Formalization targets

Goal: Proposition 1 (p. 1347)

Let QNC∗Q^*_{NC}QNC∗​ maximize πEM,NC\pi_{EM,NC}πEM,NC​ and QCC∗Q^*_{CC}QCC∗​ maximize ΠCC\Pi_{CC}ΠCC​. Then, for every transfer price ccc admitted by the standing assumptions,

QNC∗<QCC∗andπR,NC(QNC∗)+πEM,NC(QNC∗)<ΠCC(QCC∗).Q^*_{NC} < Q^*_{CC}\qquad\text{and}\qquad \pi_{R,NC}(Q^*_{NC}) + \pi_{EM,NC}(Q^*_{NC}) < \Pi_{CC}(Q^*_{CC}).QNC∗​<QCC∗​andπR,NC​(QNC∗​)+πEM,NC​(QNC∗​)<ΠCC​(QCC∗​).

Milestones

  1. §4, p. 1345. The centralized optimum exists and is unique:
QCC∗=F−1 ⁣(p+s−mp+s−u).Q^*_{CC} = F^{-1}\!\left(\frac{p+s-m}{p+s-u}\right).QCC∗​=F−1(p+s−up+s−m​).
  1. §5.1, (1), p. 1346. The closed form
G(r∣μ)=(p+s−c)r−sμ−(p+s−u)EX∣μ[r−X]+,G(r\mid\mu) = (p+s-c)r - s\mu - (p+s-u)E_{X\mid\mu}[r-X]^+ ,G(r∣μ)=(p+s−c)r−sμ−(p+s−u)EX∣μ​[r−X]+,

and the retailer's optimal purchase under r≤Qr \le Qr≤Q is min⁡[μ+zεσε,Q]\min[\mu + z_\varepsilon\sigma_\varepsilon, Q]min[μ+zε​σε​,Q]. 3. §5.2, p. 1347. The EM's optimal production exists and is unique:

QNC∗=Θ−1 ⁣(c−mc−u)+zεσε.Q^*_{NC} = \Theta^{-1}\!\left(\frac{c-m}{c-u}\right) + z_\varepsilon\sigma_\varepsilon .QNC∗​=Θ−1(c−uc−m​)+zε​σε​.

Significance

Proposition 1 shows that sharing demand information does not remove inefficiency. Under common beliefs and with no commitment, no linear transfer price makes the decentralized chain efficient. Adjusting ccc moves profit between the parties but cannot recover the planner's expected profit. This is the reason the paper studies richer contracts, and the efficiency result for the QF contract (the paper's Proposition 6) is measured against the benchmark QCC∗Q^*_{CC}QCC∗​ defined here.

The paper prints no proofs ("All proofs are omitted due to space limitations", p. 1341). A machine-checked development therefore supplies arguments the published record does not contain. It also exhibits the exact hypotheses the result needs. In particular it covers the degenerate case σε=0\sigma_\varepsilon = 0σε​=0, where the signal is perfect. No part of this mission has a prior formal proof. Newsvendor critical-fractile results exist on Prove2Me for single-decision models, but without the production stage and information update used here.

Difficulty

The EM and the planner solve newsvendor problems against different demand laws. The EM faces the retailer's purchase μ+zεσε\mu + z_\varepsilon\sigma_\varepsilonμ+zε​σε​, while the planner faces X=μ+εX = \mu + \varepsilonX=μ+ε. Their fractiles are κEM\kappa_{EM}κEM​ and κS\kappa_SκS​. The obvious comparison, κEM<κS\kappa_{EM} < \kappa_SκEM​<κS​, settles the case σε=0\sigma_\varepsilon = 0σε​=0 only. For σε>0\sigma_\varepsilon > 0σε​>0 the two quantities are inverse distribution functions of different random variables. zεz_\varepsilonzε​ may be negative, and the planner's distribution is a convolution. A comparison of fractiles alone therefore does not order QNC∗Q^*_{NC}QNC∗​ and QCC∗Q^*_{CC}QCC∗​. The strict profit gap also needs more than optimality of QCC∗Q^*_{CC}QCC∗​: it requires comparing the decentralized system profit at QNC∗Q^*_{NC}QNC∗​ with the planner's profit at the same production, and then using uniqueness of the planner's optimum.

The analytic infrastructure is also substantial. It includes differentiating expectations of piecewise-linear functions under a Gaussian law and under a general prior, continuity and strict monotonicity of a convolution's distribution function, and existence of a root of F(Q)=κSF(Q) = \kappa_SF(Q)=κS​.

Formalization scope

All objects live in the namespace TsayQF.NoCommit, in one definitions file Model.

  • Costs are a structure Data with fields p,c,m,u,s∈Rp, c, m, u, s \in \mathbb Rp,c,m,u,s∈R and the standing assumptions (i)–(iii) as fields. "For any ccc" is quantification over all Data. No sign is imposed on uuu.
  • The prior is a probability measure ν on ℝ; Θ\ThetaΘ is cdf ν. "Differentiable and invertible" is Differentiable ℝ (cdf ν) together with StrictMono (cdf ν), and "mean and variance" is MemLp id 2 ν.
  • The error variance is v : ℝ≥0, so σε=v\sigma_\varepsilon = \sqrt vσε​=v​ and v = 0 is allowed. The law of XXX is the pushforward of ν.prod (gaussianReal 0 v) under addition, and given μ\muμ demand has law gaussianReal μ v.
  • Inverse distribution functions are not Lean functions here. zεz_\varepsilonzε​ is a real z with hypothesis cdf (gaussianReal 0 1) z = kR D. The milestones state existence of a solution of each fractile equation and characterize the maximizers by it.
  • Expectations are Bochner integrals. Finite variance of μ\muμ makes every integrand integrable, so no expectation silently defaults to zero.
  • Optimality is IsMaxOn over Set.univ for productions and over Set.Iic Q for the purchase. Productions range over R\mathbb RR; the paper's presumption that μ\muμ and XXX are almost certainly nonnegative is not imposed, because no result here needs it.
  • The goal quantifies over arbitrary maximizers. Milestones 1 and 3 show that maximizers exist, so the goal is not vacuous. A sorry-free sanity file checks the paper's §8 data (p,c,m,u,s)=(15,10,6,3,0)(p,c,m,u,s) = (15,10,6,3,0)(p,c,m,u,s)=(15,10,6,3,0) and shows that a normal prior satisfies the hypotheses on Θ\ThetaΘ.

The goal must not be weakened to non-strict inequalities, and the EM's demand must remain the retailer's purchase min⁡[μ+zεσε,Q]\min[\mu + z_\varepsilon\sigma_\varepsilon, Q]min[μ+zε​σε​,Q], not market demand. Either change trivializes the result or changes it. Reusable pieces are the newsvendor critical-fractile characterization for a general continuous strictly increasing distribution, and monotonicity and continuity of the distribution function of a sum of independent variables with one Gaussian summand. Proofs of the milestones as standalone lemmas are welcome.

Selected references

  • A. A. Tsay, The Quantity Flexibility Contract and Supplier-Customer Incentives, Management Science 45(10):1339–1358, 1999. https://doi.org/10.1287/mnsc.45.10.1339
  • H. L. Lee, V. Padmanabhan, S. Whang, The Bullwhip Effect in Supply Chains, Sloan Management Review 38(3):93–102, 1997. https://sloanreview.mit.edu/article/the-bullwhip-effect-in-supply-chains/
  • A. V. Iyer, M. E. Bergen, Quick Response in Manufacturer-Retailer Channels, Management Science 43(4):559–570, 1997. https://doi.org/10.1287/mnsc.43.4.559
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in Operations Research and Management Science 11, 2003. https://doi.org/10.1016/S0927-0507(03)11006-7
5 thms1 active userReviewed
Numerical AnalysisStochastic Systems·Captain: mikedeng1

Strong Convergence of an Explicit Numerical Method for SDEs with Nonglobally Lipschitz Continuous Coefficients: The Tamed Euler Scheme Converges to the SDE Solution in Uniform Lp with Order 1/2Research Paper

Motivation

Stochastic differential equations (SDEs) are simulated almost always by time-stepping schemes, and the cheapest and most widely used is the explicit Euler (Euler–Maruyama) scheme. Its strong convergence with order 12\tfrac1221​ is classical when the coefficients are globally Lipschitz. Many models in applications are not: Langevin dynamics with confining potentials, stochastic Ginzburg–Landau equations, and population or volatility models have drifts such as μ(x)=x−x3\mu(x)=x-x^3μ(x)=x−x3 that grow superlinearly.

For such drifts the explicit Euler scheme fails. Hutzenthaler, Jentzen and Kloeden showed in 2011 (Proc. R. Soc. A 467) that its absolute moments diverge to infinity whenever the drift or the diffusion grows superlinearly, so it does not converge in LpL^pLp. Implicit schemes do converge (Higham, Mao and Stuart, SIAM J. Numer. Anal. 40, 2002), but each step requires solving a nonlinear equation.

The paper of this mission (Hutzenthaler, Jentzen and Kloeden, Ann. Appl. Probab. 22(4), 2012) introduces a tamed Euler scheme: an explicit method that costs the same as the Euler scheme, modified by a second-order term in the drift. It proves strong convergence with order 12\tfrac1221​ under a one-sided Lipschitz drift whose derivative grows at most polynomially. The scheme started a line of work on tamed and truncated methods, among them Sabanis's schemes that tame drift and diffusion together for superlinearly growing diffusion coefficients (Ann. Appl. Probab. 26(4), 2016), formalized on this platform in the series "Euler Approximations with Varying Coefficients".

Setting

Fix T∈(0,∞)T\in(0,\infty)T∈(0,∞) and d,m∈N={1,2,… }d,m\in\mathbb N=\{1,2,\dots\}d,m∈N={1,2,…}. Let (Ω,F,P)(\Omega,\mathcal F,\mathbb P)(Ω,F,P) be a probability space with a filtration (Ft)(\mathcal F_t)(Ft​), and let WWW be an mmm-dimensional standard (Ft)(\mathcal F_t)(Ft​)-Brownian motion. On Rk\mathbb R^kRk, ∥v∥\|v\|∥v∥ is the Euclidean norm and ⟨v,w⟩\langle v,w\rangle⟨v,w⟩ the inner product. For a matrix AAA, ∥A∥=sup⁡∥v∥≤1∥Av∥\|A\|=\sup_{\|v\|\le1}\|Av\|∥A∥=sup∥v∥≤1​∥Av∥ is the operator norm.

The initial value ξ:Ω→Rd\xi:\Omega\to\mathbb R^dξ:Ω→Rd is F0\mathcal F_0F0​-measurable with E∥ξ∥p<∞\mathbb E\|\xi\|^p<\inftyE∥ξ∥p<∞ for every p≥1p\ge1p≥1. The drift μ:Rd→Rd\mu:\mathbb R^d\to\mathbb R^dμ:Rd→Rd is continuously differentiable and the diffusion is σ:Rd→Rd×m\sigma:\mathbb R^d\to\mathbb R^{d\times m}σ:Rd→Rd×m. There is one constant c>0c>0c>0 with

∥μ′(x)∥≤c(1+∥x∥c),∥σ(x)−σ(y)∥≤c∥x−y∥,⟨x−y,μ(x)−μ(y)⟩≤c∥x−y∥2\|\mu'(x)\|\le c(1+\|x\|^c),\qquad \|\sigma(x)-\sigma(y)\|\le c\|x-y\|,\qquad \langle x-y,\mu(x)-\mu(y)\rangle\le c\|x-y\|^2∥μ′(x)∥≤c(1+∥x∥c),∥σ(x)−σ(y)∥≤c∥x−y∥,⟨x−y,μ(x)−μ(y)⟩≤c∥x−y∥2

for all x,yx,yx,y. The exact solution XXX is an adapted process with continuous paths and

Xt=ξ+∫0tμ(Xs) ds+∫0tσ(Xs) dWs,t∈[0,T], P-a.s.X_t=\xi+\int_0^t\mu(X_s)\,ds+\int_0^t\sigma(X_s)\,dW_s,\qquad t\in[0,T],\ \mathbb P\text{-a.s.}Xt​=ξ+∫0t​μ(Xs​)ds+∫0t​σ(Xs​)dWs​,t∈[0,T], P-a.s.

For N∈NN\in\mathbb NN∈N, let ΔWnN=W(n+1)T/N−WnT/N\Delta W^N_n=W_{(n+1)T/N}-W_{nT/N}ΔWnN​=W(n+1)T/N​−WnT/N​. The tamed Euler scheme is Y0N=ξY^N_0=\xiY0N​=ξ and

Yn+1N=YnN+TN μ(YnN)1+TN∥μ(YnN)∥+σ(YnN) ΔWnN,n∈{0,…,N−1}.Y^N_{n+1}=Y^N_n+\frac{\tfrac TN\,\mu(Y^N_n)}{1+\tfrac TN\|\mu(Y^N_n)\|}+\sigma(Y^N_n)\,\Delta W^N_n,\qquad n\in\{0,\dots,N-1\}.Yn+1N​=YnN​+1+NT​∥μ(YnN​)∥NT​μ(YnN​)​+σ(YnN​)ΔWnN​,n∈{0,…,N−1}.

On t∈[nT/N,(n+1)T/N]t\in[nT/N,(n+1)T/N]t∈[nT/N,(n+1)T/N] its interpolation is

YˉtN=YnN+(t−nT/N) μ(YnN)1+TN∥μ(YnN)∥+σ(YnN)(Wt−WnT/N).\bar Y^N_t=Y^N_n+\frac{(t-nT/N)\,\mu(Y^N_n)}{1+\tfrac TN\|\mu(Y^N_n)\|}+\sigma(Y^N_n)(W_t-W_{nT/N}).YˉtN​=YnN​+1+NT​∥μ(YnN​)∥(t−nT/N)μ(YnN​)​+σ(YnN​)(Wt​−WnT/N​).

In Lean, states live in EthierKurtz.SDEState d, σ\sigmaσ takes values in Matrix (Fin d) (Fin m) ℝ, the standing hypotheses are the structures Coefficients and Setting, and the scheme is Y, Ybar, all in the namespace TamedEuler.Convergence.

Formalization targets

Goal: Theorem 1.1

There is a family Cp∈[0,∞)C_p\in[0,\infty)Cp​∈[0,∞), p∈[1,∞)p\in[1,\infty)p∈[1,∞), such that for every solution XXX

(E[sup⁡t∈[0,T]∥Xt−YˉtN∥p])1/p≤Cp N−1/2for all N∈N, p∈[1,∞).\Big(\mathbb E\Big[\sup_{t\in[0,T]}\|X_t-\bar Y^N_t\|^p\Big]\Big)^{1/p}\le C_p\,N^{-1/2}\qquad\text{for all }N\in\mathbb N,\ p\in[1,\infty).(E[t∈[0,T]sup​∥Xt​−YˉtN​∥p])1/p≤Cp​N−1/2for all N∈N, p∈[1,∞).

The constants are left unspecified; only the order 12\tfrac1221​ is asserted.

Milestones: Lemmas 3.1–3.10

These are the ten lemmas the proof rests on, in the paper's order:

  1. the pathwise dominator lemma 1ΩnN∥YnN∥≤DnN\mathbb 1_{\Omega^N_n}\|Y^N_n\|\le D^N_n1ΩnN​​∥YnN​∥≤DnN​ (3.1);
  2. Gaussian and Brownian exponential moments (3.2, 3.3, 3.4);
  3. moments of the dominating processes DnND^N_nDnN​ (3.5);
  4. the decay of P[(ΩNN)c]\mathbb P[(\Omega^N_N)^c]P[(ΩNN​)c] faster than every power of NNN (3.6);
  5. continuous- and discrete-time Burkholder–Davis–Gundy inequalities with constant ppp (3.7, 3.8);
  6. the uniform moment bounds sup⁡Nsup⁡n≤NE∥YnN∥p<∞\sup_N\sup_{n\le N}\mathbb E\|Y^N_n\|^p<\inftysupN​supn≤N​E∥YnN​∥p<∞ (3.9), and the same for μ(YnN)\mu(Y^N_n)μ(YnN​) and σ(YnN)\sigma(Y^N_n)σ(YnN​) (3.10).

Significance

The theorem gives an explicit scheme whose cost per step is the Euler cost and whose strong error is O(N−1/2)O(N^{-1/2})O(N−1/2) in every LpL^pLp, uniformly in time, for the superlinear drifts on which the explicit Euler scheme diverges. Strong error bounds of this kind are what multilevel Monte Carlo (Giles 2008) needs, as the paper notes on p. 3: its complexity analysis requires strong convergence of the coarse and fine levels, and the explicit Euler scheme supplies none for these equations. The moment bound of Lemma 3.9 answers, for the tamed scheme, the open problem Higham, Mao and Stuart formulated in 2002 on when moment bounds hold for explicit methods (quoted on p. 8).

The result is proved in the paper; it has not been formalized. The mission formalizes the statement, its ten lemmas and the scheme. The dominator construction (13)–(14) is a pathwise argument that can be checked independently of the probability. The two Burkholder–Davis–Gundy inequalities with the explicit constant ppp are reusable tools for any numerical analysis of SDEs.

Difficulty

Once the moments of YnNY^N_nYnN​ are bounded uniformly in NNN, the convergence proof follows the globally Lipschitz pattern: an Itô or Gronwall argument on X−YˉNX-\bar Y^NX−YˉN. The difficulty is the moment bound itself. The obvious approach is a Gronwall recursion for E∥Yn+1N∥p\mathbb E\|Y^N_{n+1}\|^pE∥Yn+1N​∥p in terms of E∥YnN∥p\mathbb E\|Y^N_n\|^pE∥YnN​∥p. For superlinear μ\muμ it does not close: the term ∥μ(YnN)∥2(T/N)2\|\mu(Y^N_n)\|^2(T/N)^2∥μ(YnN​)∥2(T/N)2 grows faster than ∥YnN∥2\|Y^N_n\|^2∥YnN​∥2, and for the untamed scheme the moments do in fact diverge. A newcomer's first idea, using the one-sided Lipschitz bound in expectation, fails for the same reason. The paper instead dominates the scheme pathwise on events ΩnN\Omega^N_nΩnN​ and controls the rare complement separately (Lemmas 3.1, 3.5, 3.6).

Formalization scope

The Lean development commits to the following conventions.

  • Normal filtration. Read as a right-continuous filtration (ℱ.IsRightContinuous) together with adaptedness to its P\mathbb PP-completion, which is how the published SabanisEuler.Shared.IsSolution treats completeness.
  • Brownian motion. SabanisEuler.Shared.IsWienerMartingale, defined on [0,∞)[0,\infty)[0,∞) rather than [0,T][0,T][0,T]; this is the usual extension. Time is ℝ≥0.
  • The solution XXX. Any process satisfying the published IsSolution relation, whose stochastic integral is the Ethier–Kurtz Brownian Itô-integral relation. Existence and uniqueness are cited by the paper, not claimed. σ\sigmaσ enters IsSolution entrywise through toDiffusion. Every norm of σ\sigmaσ in a hypothesis or conclusion is the operator norm opNorm.
  • The constant ccc. One real c>0c>0c>0 is both constant and exponent; ∥x∥c\|x\|^c∥x∥c and N1/(2c)N^{1/(2c)}N1/(2c) are real powers.
  • Indices. N={1,2,… }\mathbb N=\{1,2,\dots\}N={1,2,…}: every statement has N≥1N\ge1N≥1 and n≤Nn\le Nn≤N, and d,m≥1d,m\ge1d,m≥1.
  • Interpolation cell. In (10), ttt uses the cell n=min⁡(⌊tN/T⌋,N−1)n=\min(\lfloor tN/T\rfloor,N-1)n=min(⌊tN/T⌋,N−1), so t=Tt=Tt=T uses the last cell.
  • (13) and (14). The supremum over uuu in (13) is a finite maximum. The suprema in (14) are written "for all k<nk<nk<n", so Ω0N=Ω\Omega^N_0=\OmegaΩ0N​=Ω.
  • Moments. Every expectation, LpL^pLp norm and "<∞<\infty<∞" is stated in [0,∞][0,\infty][0,∞] with lintegral or eLpNorm, never as a Bochner integral that could default to 000.
  • Lemma 3.1. Stated pathwise for every ω\omegaω and an arbitrary path WWW.
  • Lemma 3.7. The published Itô relation demands pathwise square-integrability of the integrand. This is stronger than the printed almost-sure condition, and the deviation is disclosed.

A trivializing formalization is ruled out: the scheme is (8) exactly, with only the drift tamed and the step size T/NT/NT/N. The error is taken against the same Brownian path that drives XXX. The setting is satisfiable for the paper's example μ(x)=x−x3\mu(x)=x-x^3μ(x)=x−x3, σ(x)=x\sigma(x)=xσ(x)=x with c=3c=3c=3 (checked in a sorry-free verification file, given any Brownian motion). Replacing the Itô integral by a postulated operator or a pathwise integral is not admitted.

A complete development needs:

  • Gaussian exponential moments;
  • discrete and continuous BDG inequalities with explicit constants for the Ethier–Kurtz Itô integral;
  • an Itô-type or Gronwall argument for X−YˉNX-\bar Y^NX−YˉN.

The BDG inequalities and the Gaussian moment identity are reusable beyond this mission. Contributions to any lemma, or to the stochastic-calculus infrastructure underneath, are welcome.

Selected references

  • M. Hutzenthaler, A. Jentzen, P. E. Kloeden, Strong convergence of an explicit numerical method for SDEs with nonglobally Lipschitz continuous coefficients, Ann. Appl. Probab. 22(4), 1611–1641, 2012. https://arxiv.org/abs/1010.3756 (DOI 10.1214/11-AAP803)
  • M. Hutzenthaler, A. Jentzen, P. E. Kloeden, Strong and weak divergence in finite time of Euler's method for stochastic differential equations with non-globally Lipschitz continuous coefficients, Proc. R. Soc. A 467, 1563–1576, 2011. https://doi.org/10.1098/rspa.2010.0348
  • D. J. Higham, X. Mao, A. M. Stuart, Strong convergence of Euler-type methods for nonlinear stochastic differential equations, SIAM J. Numer. Anal. 40(3), 1041–1063, 2002. https://doi.org/10.1137/S0036142901389530
  • S. Sabanis, Euler approximations with varying coefficients: the case of superlinearly growing diffusion coefficients, Ann. Appl. Probab. 26(4), 2083–2105, 2016. https://arxiv.org/abs/1308.1796
  • X. Mao, Stochastic Differential Equations and Their Applications, Horwood, 1997 (Theorem 2.4.1: existence and uniqueness, cited on p. 2). https://mathscinet.ams.org/mathscinet-getitem?mr=1475218
  • M. B. Giles, Multilevel Monte Carlo path simulation, Oper. Res. 56, 607–617, 2008. https://doi.org/10.1287/opre.1070.0496
18 thms1 active userReviewed
Operations Research·Captain: mikedeng1

A Single-Item Inventory Model for a Nonstationary Demand Process: With Adaptive Base-Stock Control at Two Stages, Upstream Inventory Is N(y₀, σ²∑_{i<K}(1+(L+i)α)²)Research Paper

Motivation

Classical safety-stock formulas assume that demand is stationary: independent and identically distributed around a fixed mean. Many products do not behave that way. Their demand level drifts, and the forecast has to follow it. Graves (A single-item inventory model for a nonstationary demand process, Manuf. Serv. Oper. Manag. 1(1):50–61, 1999) works out what such drift costs in inventory when it is modelled by the simplest nonstationary time series used in forecasting practice. The model is the integrated moving average process of order (0,1,1)(0,1,1)(0,1,1), for which the exponentially weighted moving average is the optimal forecast (Muth, 1960; Box, Jenkins and Reinsel, 1994).

The paper answers two questions. For one stage under an adaptive base-stock policy, it gives the exact distribution of the inventory, and hence the safety stock. For two stages in series, it shows that the order stream the downstream stage passes upstream is again of the same type, amplified. This is an explicit instance of the bullwhip effect of Lee, Padmanabhan and Whang (1997). The paper then gives the distribution of the upstream inventory. That last distribution, equation (16), is the goal of this mission.

Setting

Time is indexed by periods t∈Zt\in\mathbb Zt∈Z; operation starts in period 111. Fix a mean level μ∈R\mu\in\mathbb Rμ∈R, a parameter α\alphaα with 0≤α≤10\le\alpha\le10≤α≤1, a downstream lead time L∈NL\in\mathbb NL∈N and an upstream lead time K∈NK\in\mathbb NK∈N. The shocks ε1,ε2,…\varepsilon_1,\varepsilon_2,\dotsε1​,ε2​,… are independent random variables, each normal with mean 000 and variance σ2\sigma^2σ2.

Downstream stage (§2). The demand dtd_tdt​ is the IMA(0,1,1) process

d1=μ+ε1,dt=dt−1−(1−α)εt−1+εt(t≥2).(1)d_1=\mu+\varepsilon_1,\qquad d_t=d_{t-1}-(1-\alpha)\varepsilon_{t-1}+\varepsilon_t\quad(t\ge2).\tag{1}d1​=μ+ε1​,dt​=dt−1​−(1−α)εt−1​+εt​(t≥2).(1)

The forecast Ft+1F_{t+1}Ft+1​, made after observing dtd_tdt​, is the exponentially weighted moving average

F1=μ,Ft+1=αdt+(1−α)Ft(t≥1).(3)F_1=\mu,\qquad F_{t+1}=\alpha d_t+(1-\alpha)F_t\quad(t\ge1).\tag{3}F1​=μ,Ft+1​=αdt​+(1−α)Ft​(t≥1).(3)

The order qtq_tqt​, placed in period ttt and delivered in period t+Lt+Lt+L, follows the adaptive base-stock policy

qt=dt+L(Ft+1−Ft)(t≥1),qt=μ(t≤0).(7)q_t=d_t+L(F_{t+1}-F_t)\quad(t\ge1),\qquad q_t=\mu\quad(t\le0).\tag{7}qt​=dt​+L(Ft+1​−Ft​)(t≥1),qt​=μ(t≤0).(7)

The inventory xtx_txt​ at the end of period ttt (negative values are backorders) obeys

xt=xt−1−dt+qt−L(t≥1),(6)x_t=x_{t-1}-d_t+q_{t-L}\quad(t\ge1),\tag{6}xt​=xt−1​−dt​+qt−L​(t≥1),(6)

where x0x_0x0​ is an initial inventory chosen by the planner. Orders may be negative.

Upstream stage (§3). It sees the orders qtq_tqt​ as its demand. It forecasts them with smoothing constant β=α/(1+Lα)\beta=\alpha/(1+L\alpha)β=α/(1+Lα),

G1=μ,Gt+1=βqt+(1−β)Gt(t≥1),(11)G_1=\mu,\qquad G_{t+1}=\beta q_t+(1-\beta)G_t\quad(t\ge1),\tag{11}G1​=μ,Gt+1​=βqt​+(1−β)Gt​(t≥1),(11)

orders pt=qt+K(Gt+1−Gt)p_t=q_t+K(G_{t+1}-G_t)pt​=qt​+K(Gt+1​−Gt​) for t≥1t\ge1t≥1 and pt=μp_t=\mupt​=μ for t≤0t\le0t≤0 (15), and holds inventory

yt=yt−1−qt+pt−K(t≥1),(14)y_t=y_{t-1}-q_t+p_{t-K}\quad(t\ge1),\tag{14}yt​=yt−1​−qt​+pt−K​(t≥1),(14)

with initial inventory y0y_0y0​.

In Lean, IsStage μ α L ε d F q x is the conjunction of (1), (3), (6), (7) and the boundary condition. IsUpstream μ β K q G p y is (11), (14), (15) and its boundary condition. upBeta α L is β\betaβ, and IsTwoStage is the conjunction of the two stages.

Formalization targets

Goal: the upstream inventory distribution (16)

For every period t≥Kt\ge Kt≥K (and t≥1t\ge1t≥1), the upstream inventory yty_tyt​ is normally distributed with

E[yt]=y0,Std⁡[yt]=σ∑i=0K−1(1+(L+i)α)2.\mathbb E[y_t]=y_0,\qquad \operatorname{Std}[y_t]=\sigma\sqrt{\sum_{i=0}^{K-1}\bigl(1+(L+i)\alpha\bigr)^2}.E[yt​]=y0​,Std[yt​]=σi=0∑K−1​(1+(L+i)α)2​.

Milestones, in the paper's order

  1. The closed form of demand (2): dt=εt+α∑j<tεj+μd_t=\varepsilon_t+\alpha\sum_{j<t}\varepsilon_j+\mudt​=εt​+α∑j<t​εj​+μ.
  2. The forecast error (4): dt−Ft=εtd_t-F_t=\varepsilon_tdt​−Ft​=εt​.
  3. The forecast update (5): Ft+1=Ft+αεt=α∑j≤tεj+μF_{t+1}=F_t+\alpha\varepsilon_t=\alpha\sum_{j\le t}\varepsilon_j+\muFt+1​=Ft​+αεt​=α∑j≤t​εj​+μ.
  4. The lead-time form of the inventory (proof of P1): xt=x0−∑j=t+1−Ltdj+LFt+1−Lx_t=x_0-\sum_{j=t+1-L}^{t}d_j+LF_{t+1-L}xt​=x0​−∑j=t+1−Lt​dj​+LFt+1−L​ for t≥Lt\ge Lt≥L.
  5. Property P1: xt=x0−∑i=0L−1εt−i(1+iα)x_t=x_0-\sum_{i=0}^{L-1}\varepsilon_{t-i}(1+i\alpha)xt​=x0​−∑i=0L−1​εt−i​(1+iα), with εt=0\varepsilon_t=0εt​=0 for t≤0t\le0t≤0.
  6. The downstream inventory distribution (8): xt∼N(x0, σ2∑i<L(1+iα)2)x_t\sim N\bigl(x_0,\ \sigma^2\sum_{i<L}(1+i\alpha)^2\bigr)xt​∼N(x0​, σ2∑i<L​(1+iα)2) for t≥Lt\ge Lt≥L, and ∑i<L(1+iα)2=L(1+α(L−1)+α2(L−1)(2L−1)/6)\sum_{i<L}(1+i\alpha)^2=L\bigl(1+\alpha(L-1)+\alpha^2(L-1)(2L-1)/6\bigr)∑i<L​(1+iα)2=L(1+α(L−1)+α2(L−1)(2L−1)/6).
  7. The orders in closed form (9): qt=(1+Lα)εt+α∑j<tεj+μq_t=(1+L\alpha)\varepsilon_t+\alpha\sum_{j<t}\varepsilon_j+\muqt​=(1+Lα)εt​+α∑j<t​εj​+μ.
  8. The orders are IMA(0,1,1) (10), with shocks ζt=(1+Lα)εt\zeta_t=(1+L\alpha)\varepsilon_tζt​=(1+Lα)εt​ and parameter β\betaβ, and 0≤β≤α0\le\beta\le\alpha0≤β≤α.
  9. The upstream forecast equals the downstream one: qt=Gt+ζtq_t=G_t+\zeta_tqt​=Gt​+ζt​, qt=Ft+(1+Lα)εtq_t=F_t+(1+L\alpha)\varepsilon_tqt​=Ft​+(1+Lα)εt​, Gt=FtG_t=F_tGt​=Ft​.
  10. Property P2: yt=y0−∑i=0K−1εt−i(1+(L+i)α)y_t=y_0-\sum_{i=0}^{K-1}\varepsilon_{t-i}\bigl(1+(L+i)\alpha\bigr)yt​=y0​−∑i=0K−1​εt−i​(1+(L+i)α), with εt=0\varepsilon_t=0εt​=0 for t≤0t\le0t≤0.

Two further statements of the paper are included as plain theorems: the order amplification Std⁡[qt∣Ft]=(1+Lα)σ=(1+Lα)Std⁡[dt∣Ft]\operatorname{Std}[q_t\mid F_t]=(1+L\alpha)\sigma=(1+L\alpha)\operatorname{Std}[d_t\mid F_t]Std[qt​∣Ft​]=(1+Lα)σ=(1+Lα)Std[dt​∣Ft​] (p. 55), stated as: qt−Ftq_t-F_tqt​−Ft​ and dt−Ftd_t-F_tdt​−Ft​ are independent of FtF_tFt​ with laws N(0,(1+Lα)2σ2)N(0,(1+L\alpha)^2\sigma^2)N(0,(1+Lα)2σ2) and N(0,σ2)N(0,\sigma^2)N(0,σ2), and the critical-fractile rule (p. 54). Under that rule, setting x0=z Std⁡[xt]x_0=z\,\operatorname{Std}[x_t]x0​=zStd[xt​] gives P(xt≥0)=Φ(z)P(x_t\ge0)=\Phi(z)P(xt​≥0)=Φ(z).

Significance

Equation (8) is a closed-form safety-stock formula for nonstationary demand. For α>0\alpha>0α>0 the standard deviation of the inventory grows faster than L\sqrt LL​, so the textbook square-root law understates the safety stock. Equation (16) carries the formula one stage up a supply chain. With α>0\alpha>0α>0, the upstream safety stock depends on the downstream lead time LLL, not only on the upstream lead time KKK. The paper concludes that shortening the downstream lead time can matter more than shortening the upstream one. P1 and P2 underlie these conclusions: they write each inventory as a fixed linear combination of a bounded window of shocks.

All results here are proved in the paper. None of them, and none of the model's objects, is formalized on Prove2Me or, as far as is known, anywhere else. The mission produces machine-checked versions of the closed forms and distributions. It also produces a reusable statement that a finite linear combination of independent Gaussian shocks is Gaussian, which Mathlib has only for two summands.

Difficulty

The pathwise milestones are inductions on the period, but they are not uniform. The inventory recursion (6) reads orders LLL periods back, so P1 has two regimes: t≥Lt\ge Lt≥L, where every order read is a policy order, and 1≤t<L1\le t<L1≤t<L, where some are the boundary orders qs=μq_s=\muqs​=μ. The paper treats the second regime only by "direct substitution", and a single statement has to cover both.

P2 is not a second copy of P1. The upstream stage is defined by its own recursions (11), (14), (15). It becomes an instance of the single-stage model only after (10) and the forecast identity Gt=FtG_t=F_tGt​=Ft​ have been proved, and P1 must then be applied with parameter β\betaβ and shocks ζt\zeta_tζt​. The distributional statements (8) and (16) need the law of a finite weighted sum of independent normal variables. Mathlib provides the two-variable case; the finite-sum version, with a Z\mathbb ZZ-indexed window of shocks, has to be built from it.

Formalization scope

All sequences are functions Z→R\mathbb Z\to\mathbb RZ→R; lead times are natural numbers, cast to Z\mathbb ZZ in indices and to R\mathbb RR in coefficients, so no truncated subtraction occurs. The model is a predicate on sequences, and the objects d,F,q,x,G,p,yd,F,q,x,G,p,yd,F,q,x,G,p,y are constrained only by the paper's recursions (1), (3), (6), (7), (11), (14), (15) and the boundary conditions qt=pt=μq_t=p_t=\muqt​=pt​=μ for t≤0t\le0t≤0. None of the closed forms (2), (5), (9), (10), P1 or P2 is built into a definition. In particular the upstream stage is not defined as an instance of the downstream one, which would assume (10). The paper's convention εt=0\varepsilon_t=0εt​=0 for t≤0t\le0t≤0 is implemented by a masked sequence masked ε in P1 and P2, not by a hypothesis. The standing assumption 0≤α≤10\le\alpha\le10≤α≤1 is a hypothesis of every theorem.

In (8) and (16) the shocks live on a probability space (Ω,P)(\Omega,P)(Ω,P). They are measurable and mutually independent over periods t≥1t\ge1t≥1 (iIndepFun over {s:Z∣1≤s}\{s:\mathbb Z\mid 1\le s\}{s:Z∣1≤s}), each with law gaussianReal 0 (σ²). The system equations hold for every outcome, and the initial inventory is a constant. "Normally distributed with mean mmm and standard deviation sss" is the law equality P.map (y t) = gaussianReal m (s²). A statement only about the variance would be weaker than the paper's claim and does not count. The critical-fractile theorem adds σ>0\sigma>0σ>0 and L≥1L\ge1L≥1; without them the inventory is constant and the claim fails.

Contributions are welcome on the finite Gaussian-sum lemma, which is independent of this paper, and on any milestone in any order.

Selected references

  • S. C. Graves, A single-item inventory model for a nonstationary demand process, Manufacturing & Service Operations Management 1(1):50–61, 1999. https://doi.org/10.1287/msom.1.1.50
  • J. F. Muth, Optimal properties of exponentially weighted forecasts, Journal of the American Statistical Association 55(290):299–306, 1960. https://doi.org/10.1080/01621459.1960.10482056
  • G. E. P. Box, G. M. Jenkins, G. C. Reinsel, Time Series Analysis: Forecasting and Control, 3rd ed., Prentice Hall, 1994 (book; no DOI for this edition).
  • H. L. Lee, V. Padmanabhan, S. Whang, Information distortion in a supply chain: the bullwhip effect, Management Science 43(4):546–558, 1997. https://doi.org/10.1287/mnsc.43.4.546
12 thms1 active userReviewed
Complexity TheoryTheoretical Computer Science·Captain: mikedeng1

New Techniques for Noninteractive Zero-Knowledge 2: On a Perfectly Hiding Key the Circuit-SAT Proof from a Homomorphic Proof Commitment Is Perfect Zero-KnowledgeResearch Paper

Motivation

A non-interactive zero-knowledge (NIZK) proof lets a prover convince a verifier that a statement is true by sending a single message, computed from a common reference string σ\sigmaσ that both parties share, without revealing anything beyond the truth of the statement. NIZK proofs were introduced by Blum, Feldman and Micali (STOC 1988) and are a building block of chosen-ciphertext secure encryption, signatures and secure multi-party computation. For a long time every NIZK proof for all of NP was zero-knowledge only computationally: a simulator produced proofs that no efficient adversary could tell apart from real ones.

Groth, Ostrovsky and Sahai (J. ACM 59(3), 2012; conference versions at Eurocrypt 2006 and Crypto 2006) gave the first NIZK argument for all of NP whose zero-knowledge is perfect: real and simulated proofs have exactly the same distribution, so even an unbounded adversary learns nothing. The construction is the Circuit SAT proof of their Figure 3, run on a perfectly hiding key of a homomorphic proof commitment scheme. Its zero-knowledge is Lemma 8 of the paper, and it is the zero-knowledge half of their Theorem 11.

Setting

A homomorphic proof commitment scheme has a message space MMM (a finite cyclic group with generator 111, here Z/N\mathbb Z/NZ/N), a randomizer space RRR and a commitment space CCC, all finite abelian groups, and a commitment function comck(m;r)\mathrm{com}_{ck}(m; r)comck​(m;r). A hiding key generator KhidingK_{\mathrm{hiding}}Khiding​ outputs a commitment key ckckck together with a trapdoor tktktk. The scheme is assumed to have:

  1. the homomorphic property, com(m1+m2;r1+r2)=com(m1;r1) com(m2;r2)\mathrm{com}(m_1+m_2; r_1+r_2) = \mathrm{com}(m_1; r_1)\,\mathrm{com}(m_2; r_2)com(m1​+m2​;r1​+r2​)=com(m1​;r1​)com(m2​;r2​);
  2. perfect trapdoor opening: Topentk(m1,r1,m2)\mathrm{Topen}_{tk}(m_1, r_1, m_2)Topentk​(m1​,r1​,m2​) returns r2r_2r2​ with com(m2;r2)=com(m1;r1)\mathrm{com}(m_2; r_2) = \mathrm{com}(m_1; r_1)com(m2​;r2​)=com(m1​;r1​);
  3. perfect trapdoor opening indistinguishability: for uniform r1r_1r1​, the opening Topentk(m1,r1,m2)\mathrm{Topen}_{tk}(m_1, r_1, m_2)Topentk​(m1​,r1​,m2​) is distributed, jointly with ckckck, as a fresh uniform randomizer;
  4. perfect witness indistinguishability of a proof P01(ck,m,r;ρ)P_{01}(ck, m, r; \rho)P01​(ck,m,r;ρ) that a commitment contains 000 or 111: if com(0;r0)=com(1;r1)\mathrm{com}(0; r_0) = \mathrm{com}(1; r_1)com(0;r0​)=com(1;r1​), the proofs made from (0,r0)(0, r_0)(0,r0​) and from (1,r1)(1, r_1)(1,r1​) have the same law.

A NAND circuit on nnn wires is a list of gates (i,j,k)(i, j, k)(i,j,k) and an output wire out\mathrm{out}out; a witness w∈{0,1}nw \in \{0,1\}^nw∈{0,1}n satisfies it, C(w)=1C(w) = 1C(w)=1, if wk=¬(wi∧wj)w_k = \neg(w_i \wedge w_j)wk​=¬(wi​∧wj​) for every gate and wout=1w_{\mathrm{out}} = 1wout​=1. The prover P(σ,C,w)P(\sigma, C, w)P(σ,C,w) of Figure 3, with σ=ck\sigma = ckσ=ck, commits to every wire, ci=com(wi;ri)c_i = \mathrm{com}(w_i; r_i)ci​=com(wi​;ri​) with cout=com(1;0)c_{\mathrm{out}} = \mathrm{com}(1; 0)cout​=com(1;0), proves that each commitment contains 000 or 111, and for each gate proves that cicjck2 com(−2;0)c_i c_j c_k^2\,\mathrm{com}(-2; 0)ci​cj​ck2​com(−2;0) contains 000 or 111.

The simulator is S1=KhidingS_1 = K_{\mathrm{hiding}}S1​=Khiding​, returning σ=ck\sigma = ckσ=ck and τ=tk\tau = tkτ=tk, and S2(σ,τ,C)S_2(\sigma, \tau, C)S2​(σ,τ,C), which commits to 000 on every wire except the output wire, and makes all the 0/1 proofs from openings it knows or obtains with the trapdoor. In the zero-knowledge game an adaptive adversary AAA reads σ\sigmaσ, submits pairs (C,w)(C, w)(C,w) to an oracle one at a time, sees each answer before choosing the next, and outputs a bit. The real oracle answers with P(σ,C,w)P(\sigma, C, w)P(σ,C,w), the simulation oracle with S2(σ,τ,C)S_2(\sigma, \tau, C)S2​(σ,τ,C); both answer failure when C(w)≠1C(w) \neq 1C(w)=1.

Formalization targets

Goal: Lemma 8, perfect zero-knowledge

For every adaptive adversary AAA,

Pr⁡[σ←Sσ:AP(σ,⋅,⋅)(σ)=1]=Pr⁡[(σ,τ)←S1:AS(σ,τ,⋅,⋅)(σ)=1],\Pr\big[\sigma \leftarrow S_\sigma : A^{P(\sigma,\cdot,\cdot)}(\sigma) = 1\big] = \Pr\big[(\sigma, \tau) \leftarrow S_1 : A^{S(\sigma,\tau,\cdot,\cdot)}(\sigma) = 1\big],Pr[σ←Sσ​:AP(σ,⋅,⋅)(σ)=1]=Pr[(σ,τ)←S1​:AS(σ,τ,⋅,⋅)(σ)=1],

where SσS_\sigmaSσ​ is KhidingK_{\mathrm{hiding}}Khiding​ restricted to its first output.

Milestones, in the order the proof uses them

  1. Gate witness (proof of Lemma 8, p. 15): with ci,cj,ckc_i, c_j, c_kci​,cj​,ck​ commitments to 000 and rk′=Topentk(0,rk,1)r'_k = \mathrm{Topen}_{tk}(0, r_k, 1)rk′​=Topentk​(0,rk​,1),
cicjck2 com(−2;0)=com(0;ri+rj+2rk′).c_i c_j c_k^2\,\mathrm{com}(-2; 0) = \mathrm{com}(0; r_i + r_j + 2r'_k).ci​cj​ck2​com(−2;0)=com(0;ri​+rj​+2rk′​).
  1. Trapdoor-opened wires: com(wi;Topentk(0,ri,wi))=com(0;ri)\mathrm{com}(w_i; \mathrm{Topen}_{tk}(0, r_i, w_i)) = \mathrm{com}(0; r_i)com(wi​;Topentk​(0,ri​,wi​))=com(0;ri​), and the simulated commitments (com(0;ri))i(\mathrm{com}(0; r_i))_i(com(0;ri​))i​ have the law of the honest commitments (com(wi;ri))i(\mathrm{com}(w_i; r_i))_i(com(wi​;ri​))i​.
  2. Witness indistinguishability for two 0/1 openings: 0/1 proofs made from any two openings (m,r)(m, r)(m,r), (m′,r′)(m', r')(m′,r′) of the same commitment, m,m′∈{0,1}m, m' \in \{0,1\}m,m′∈{0,1}, have the same law.
  3. One query: for every hiding key and every (C,w)(C, w)(C,w) with C(w)=1C(w) = 1C(w)=1, P(ck,C,w)=dS2(ck,tk,C)P(ck, C, w) \overset{d}{=} S_2(ck, tk, C)P(ck,C,w)=dS2​(ck,tk,C).

Significance

Lemma 8 makes the Circuit SAT argument of Section 7 the first perfect NIZK argument for every language in NP. Combined with the computational indistinguishability of binding and hiding keys it also gives the computational zero-knowledge of the proof of Figure 3 (Theorem 6), and it is the template for the perfect zero-knowledge of the universally composable NIZK of the paper's Section 8. The same simulation pattern, commit to 000 everywhere and use the trapdoor where an opening is needed, recurs in later pairing-based proof systems such as Groth–Sahai proofs.

The result is proved in the paper; to our knowledge it has not been machine-checked. A formal proof fixes the simulator completely, including the cases the paper leaves to the reader, and makes the adaptive multi-query argument explicit: the paper's proof treats one proof at a time and does not spell out why answering many adaptively chosen queries preserves equality of distributions.

Difficulty

The real and simulated proofs never use the same randomizers, so the proof cannot compare outputs value by value; it must compare laws. Two gaps in the printed argument need to be closed. First, witness indistinguishability is assumed only for one opening to 000 against one opening to 111, while comparing a simulated gate proof with a real one compares two openings that may carry the same message; the trapdoor supplies the missing intermediate opening. Second, the printed gate recipe gives the gate commitment the message 000 only when no input of the gate is the output wire; when the output wire is an input, the message is 111 or 222, and 222 has no 0/1 opening, so the simulator must open the gate commitment itself with the trapdoor. The adaptive adversary adds a third point: equality of laws must survive an arbitrary interaction in which later queries depend on earlier answers.

Formalization scope

  • The message space is ZMod N with N≥4N \ge 4N≥4 (the paper describes Figure 3 for order at least 4, p. 14); RRR and RproofR_{\mathrm{proof}}Rproof​ are finite nonempty types, CCC a commutative group. Key generators and the 0/1 prover's randomness are probability mass functions; the coins are uniform.
  • Probability-one properties are stated for every key in the support of KhidingK_{\mathrm{hiding}}Khiding​; equalities of probabilities for all adversaries are stated as equalities of laws. Trapdoor opening indistinguishability is the joint law with ckckck, since the adversary does not see tktktk.
  • The adversary is a well-founded tree of fair coin tosses and adaptive oracle queries that reads σ\sigmaσ. Quantifying over all such trees is stronger than quantifying over polynomial-time adversaries. No running-time bound is imposed on the simulator.
  • The simulator is the specific S2S_2S2​ defined in the mission, a function of ckckck, tktktk, the circuit and fresh coins. A "simulator" that runs the honest prover on the witness would make the statement trivial and is ruled out by this definition. Each gate commitment is opened to 000 with Topentk\mathrm{Topen}_{tk}Topentk​, which covers the output-wire case.
  • Out of scope: key indistinguishability and every computational statement (computational soundness of Theorem 11, adaptive culpable soundness, the UC results); the second sentence of Lemma 8 (perfect non-erasure zero-knowledge); the verifier of Figure 3, which zero-knowledge does not involve.
  • Reusable beyond this mission: the query-tree adversary with its output law, and the abstract homomorphic proof commitment with its perfect properties. Contributions welcome: proofs of the milestones, and a general lemma that oracles with equal laws give equal output laws to every adaptive adversary.

Selected references

  • J. Groth, R. Ostrovsky, A. Sahai, New Techniques for Noninteractive Zero-Knowledge, Journal of the ACM 59(3), Article 11, 2012. https://doi.org/10.1145/2220357.2220358
  • J. Groth, R. Ostrovsky, A. Sahai, Perfect Non-interactive Zero Knowledge for NP, EUROCRYPT 2006, LNCS 4004. https://doi.org/10.1007/11761679_21
  • J. Groth, R. Ostrovsky, A. Sahai, Non-interactive Zaps and New Techniques for NIZK, CRYPTO 2006, LNCS 4117. https://doi.org/10.1007/11818175_6
  • M. Blum, P. Feldman, S. Micali, Non-Interactive Zero-Knowledge and Its Applications, STOC 1988. https://doi.org/10.1145/62212.62222
  • U. Feige, D. Lapidot, A. Shamir, Multiple NonInteractive Zero Knowledge Proofs Under General Assumptions, SIAM J. Comput. 29(1), 1999. https://doi.org/10.1137/S0097539792230010
  • J. Groth, A. Sahai, Efficient Non-interactive Proof Systems for Bilinear Groups, EUROCRYPT 2008, LNCS 4965. https://doi.org/10.1007/978-3-540-78967-3_24
10 thms1 active userReviewed
Graph TheoryLinear algebraTheoretical Computer Science·Captain: mikedeng1

Spectral Sparsification of Graphs 1: Sampling Each Edge of a High-Conductance Graph with Probability min(1, Υ/min(dᵢ, dⱼ)) Gives a (1+ε)-Spectral Approximation with Few EdgesResearch Paper

Motivation

A spectral sparsifier of a graph is a much sparser weighted graph whose Laplacian quadratic form is within a factor σ\sigmaσ of the original on every vector. Spielman and Teng introduced the notion in Spectral Sparsification of Graphs as a strengthening of the cut sparsifiers of Benczúr and Karger: a spectral sparsifier preserves every cut, and in addition every quantity determined by the Laplacian quadratic form, such as effective resistances, eigenvalues and the behaviour of random walks. Sparsifiers are the reason linear systems in graph Laplacians can be solved in nearly linear time: one preconditions with a sparsifier and solves the sparse system instead (Spielman–Teng, arXiv:cs/0607105).

The construction in the paper has two halves: decompose the graph into pieces of high conductance, then sparsify each piece by random sampling. This mission is the second half, Theorem 6.1 of §6: in a graph whose normalized Laplacian has a spectral gap, keeping each edge independently with probability inversely proportional to the smaller degree of its endpoints, and reweighting kept edges by the inverse probability, produces a (1+ϵ)(1+\epsilon)(1+ϵ)-spectral approximation with few edges, with high probability.

Timeline. Benczúr and Karger (1996) sampled edges with probabilities depending on edge strength and preserved cuts. Achlioptas and McSherry (2001) analysed random sampling of matrices through the random-matrix norm bound of Füredi and Komlós (1981), corrected by Vu (2007). Spielman and Teng (arXiv 2008, SIAM J. Comput. 2011) proved Theorem 6.1 by refining the Füredi–Komlós trace method for downsampling graphs that may already be sparse. Spielman and Srivastava (2008) later replaced conductance-based probabilities by effective resistances.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be an unweighted graph on a finite vertex set VVV, n=∣V∣n=|V|n=∣V∣, with degrees did_idi​, adjacency matrix AAA, diagonal degree matrix DDD and Laplacian LG=D−AL_G=D-ALG​=D−A. Its quadratic form is

xTLGx=∑{u,v}∈E(x(u)−x(v))2,x∈RV.x^TL_Gx=\sum_{\{u,v\}\in E}(x(u)-x(v))^2,\qquad x\in\mathbb R^V .xTLG​x={u,v}∈E∑​(x(u)−x(v))2,x∈RV.

A weighted graph G~\widetilde GG on VVV with weights w(u,v)≥0w(u,v)\ge0w(u,v)≥0 has the form xTLG~x=∑{u,v}w(u,v)(x(u)−x(v))2x^TL_{\widetilde G}x=\sum_{\{u,v\}}w(u,v)(x(u)-x(v))^2xTLG​x=∑{u,v}​w(u,v)(x(u)−x(v))2. G~\widetilde GG is a σ\sigmaσ-approximation of GGG if for all xxx

1σ xTLG~x≤xTLGx≤σ xTLG~x.\tfrac1\sigma\,x^TL_{\widetilde G}x\le x^TL_Gx\le\sigma\,x^TL_{\widetilde G}x .σ1​xTLG​x≤xTLG​x≤σxTLG​x.

When every degree is positive, the normalized Laplacian is LG=D−1/2LGD−1/2\mathcal L_G=D^{-1/2}L_GD^{-1/2}LG​=D−1/2LG​D−1/2; its eigenvalues lie in [0,2][0,2][0,2], and a lower bound λ\lambdaλ on its smallest non-zero eigenvalue measures how well connected each component of GGG is (by Cheeger's inequality it is equivalent to high conductance up to squaring).

Sampling. For a parameter Υ>1\Upsilon>1Υ>1, edge (i,j)(i,j)(i,j) is assigned

pi,j=min⁡(1,Υmin⁡(di,dj)),p_{i,j}=\min\Big(1,\frac{\Upsilon}{\min(d_i,d_j)}\Big),pi,j​=min(1,min(di​,dj​)Υ​),

each edge is kept independently with probability pi,jp_{i,j}pi,j​, and a kept edge gets weight 1/pi,j1/p_{i,j}1/pi,j​. The sampled adjacency matrix A~\widetilde AA then has E[A~]=A\mathbf E[\widetilde A]=AE[A]=A; D~\widetilde DD is the diagonal matrix of weighted degrees of the sampled graph.

The procedure. In Theorem 6.1 sampling is applied only to the edges FFF of an induced subgraph G(S)G(S)G(S), S⊆VS\subseteq VS⊆V; the other edges H=E−FH=E-FH=E−F are kept with weight 1. Sample((S,F),ϵ,p,λ)\mathtt{Sample}((S,F),\epsilon,p,\lambda)Sample((S,F),ϵ,p,λ) sets Υ=(12k/(ϵλ))2\Upsilon=(12k/(\epsilon\lambda))^2Υ=(12k/(ϵλ))2 and uses the degrees did_idi​ of G(S)G(S)G(S); the paper takes k=max⁡(log⁡2(3/p),log⁡2∣S∣)k=\max(\log_2(3/p),\log_2|S|)k=max(log2​(3/p),log2​∣S∣).

Formalization targets

Goal: Theorem 6.1 (p. 8)

For ϵ,p∈(0,1/2)\epsilon,p\in(0,1/2)ϵ,p∈(0,1/2), GGG without isolated vertices whose smallest non-zero normalized Laplacian eigenvalue is at least λ>0\lambda>0λ>0, S⊆VS\subseteq VS⊆V, and an even integer k≥max⁡(log⁡2(3/p),log⁡2∣S∣)k\ge\max(\log_2(3/p),\log_2|S|)k≥max(log2​(3/p),log2​∣S∣): with probability at least 1−p1-p1−p, simultaneously

(S.1)  G~=(V,F~∪H) is a (1+ϵ)-approximation of G,(S.2)  ∣F~∣≤288 k2(ϵλ)2 ∣S∣.\text{(S.1)}\ \ \widetilde G=(V,\widetilde F\cup H)\ \text{is a }(1+\epsilon)\text{-approximation of }G,\qquad \text{(S.2)}\ \ |\widetilde F|\le\frac{288\,k^2}{(\epsilon\lambda)^2}\,|S| .(S.1)  G=(V,F∪H) is a (1+ϵ)-approximation of G,(S.2)  ∣F∣≤(ϵλ)2288k2​∣S∣.

Milestones, in the order the proof uses them

  • Lemma 6.2 (p. 8): if λ2(D−1/2LD−1/2)≥λ\lambda_2(D^{-1/2}LD^{-1/2})\ge\lambdaλ2​(D−1/2LD−1/2)≥λ and ∥D−1/2(L−L~)D−1/2∥≤ϵ<λ\|D^{-1/2}(L-\widetilde L)D^{-1/2}\|\le\epsilon<\lambda∥D−1/2(L−L)D−1/2∥≤ϵ<λ, then G~\widetilde GG is a λ/(λ−ϵ)\lambda/(\lambda-\epsilon)λ/(λ−ϵ)-approximation of a connected GGG.
  • Claim 6.5 (p. 13): ∣Δi,j∣≤1/Υ|\Delta_{i,j}|\le1/\Upsilon∣Δi,j​∣≤1/Υ for Δ=D−1(A~−A)\Delta=D^{-1}(\widetilde A-A)Δ=D−1(A−A), on every outcome of positive probability.
  • Lemma 6.6 (p. 13): E[Δr,tkΔt,rl]≤Υ−(k+l−1)dr−1\mathbf E[\Delta_{r,t}^k\Delta_{t,r}^l]\le\Upsilon^{-(k+l-1)}d_r^{-1}E[Δr,tk​Δt,rl​]≤Υ−(k+l−1)dr−1​ for every edge, k≥1k\ge1k≥1, l≥0l\ge0l≥0.
  • Lemma 6.4 (p. 10): E[Tr⁡(Δk)]≤nkk/Υk/2\mathbf E[\operatorname{Tr}(\Delta^k)]\le nk^k/\Upsilon^{k/2}E[Tr(Δk)]≤nkk/Υk/2 for even kkk.
  • Lemma 6.3 (p. 9): Pr⁡[∥D−1/2(A~−A)D−1/2∥≥2kn1/k/Υ]≤2−k\Pr[\|D^{-1/2}(\widetilde A-A)D^{-1/2}\|\ge 2kn^{1/k}/\sqrt\Upsilon]\le2^{-k}Pr[∥D−1/2(A−A)D−1/2∥≥2kn1/k/Υ​]≤2−k for even k>0k>0k>0.
  • Theorem 6.8 (p. 15, Chernoff bound, cited from Raghavan 1988).
  • Lemma 6.7 (p. 14): Pr⁡[∥D−1/2(D−D~)D−1/2∥≥ϵ]≤2ne−Υϵ2/3\Pr[\|D^{-1/2}(D-\widetilde D)D^{-1/2}\|\ge\epsilon]\le2ne^{-\Upsilon\epsilon^2/3}Pr[∥D−1/2(D−D)D−1/2∥≥ϵ]≤2ne−Υϵ2/3 for 0<ϵ<10<\epsilon<10<ϵ<1.

Significance

Theorem 6.1 is the sampling engine of the first nearly-linear-time spectral sparsification algorithm: combined with a decomposition of an arbitrary graph into high-conductance pieces (§7–§10 of the paper), it yields sparsifiers with O(nlog⁡cn/ϵ2)O(n\log^c n/\epsilon^2)O(nlogcn/ϵ2) edges, which in turn give the nearly-linear-time Laplacian solvers that underlie fast algorithms for electrical flows, maximum flow approximation and graph partitioning. Lemma 6.3 is a self-contained random-matrix result: a norm bound for the normalized deviation of a downsampled graph that does not assume the original graph is dense.

The result is proved in the paper. As far as is known, none of it is formalized in Lean or Mathlib: Mathlib has the graph Laplacian (SimpleGraph.lapMatrix) and the spectral theorem for Hermitian matrices, but no normalized Laplacian, no spectral approximation and no trace-method bounds for random matrices. A complete formalization would be the first machine-checked proof of a spectral sparsification theorem, and the milestones (the trace-method moment bound, Chernoff for weighted two-point sums) are reusable on their own.

Difficulty

The obvious argument — bound each entry of A~−A\widetilde A-AA−A and apply a matrix concentration inequality — needs either a matrix Chernoff bound (not in the paper, and not in Mathlib) or the Füredi–Komlós trace method, which assumes every edge can appear and so fails when the graph is already sparse: a vertex of small degree has no room for its entries to average out. The paper's sampling probabilities keep every edge at a vertex of degree at most Υ\UpsilonΥ, and the trace computation has to exploit exactly this through the moment bound of Lemma 6.6 and a combinatorial count of closed walks. Formally, the obstacles are the walk-counting argument of Lemma 6.4, the passage from a trace bound to an eigenvalue bound for the non-symmetric Δ\DeltaΔ (similar to a symmetric matrix), and Lemma 6.2's restriction to the orthogonal complement of the kernel, which must handle disconnected GGG in the goal.

Formalization scope

  • Vertex sets are finite types V; graphs are SimpleGraph V with decidable adjacency; weighted graphs are weight functions V → V → ℝ (symmetric, nonnegative, loopless). The quadratic form is 12∑u,vw(u,v)(x(u)−x(v))2\frac12\sum_{u,v}w(u,v)(x(u)-x(v))^221​∑u,v​w(u,v)(x(u)−x(v))2; a σ\sigmaσ-approximation keeps both inequalities of (2).
  • The probability space is explicit: an outcome is the set TTT of kept edges, with probability ∏e∈Tpe∏e∉T(1−pe)\prod_{e\in T}p_e\prod_{e\notin T}(1-p_e)∏e∈T​pe​∏e∈/T​(1−pe​); probabilities and expectations are finite sums. The goal is a probability bound over this law, not the existence of a good set of edges, which would be a much weaker statement.
  • Eigenvalue conditions are stated with real eigenpairs: "smallest non-zero eigenvalue ≥λ\ge\lambda≥λ" means every eigenvalue μ≠0\mu\ne0μ=0 satisfies μ≥λ\mu\ge\lambdaμ≥λ; "∥M∥≤t\|M\|\le t∥M∥≤t" ("≥t\ge t≥t") for symmetric MMM means every (some) eigenvalue has absolute value ≤t\le t≤t (≥t\ge t≥t).
  • Hypotheses made explicit (the paper leaves them implicit): in Theorem 6.1, kkk is an even integer with k≥log⁡2(3/p)k\ge\log_2(3/p)k≥log2​(3/p), k≥log⁡2∣S∣k\ge\log_2|S|k≥log2​∣S∣ (the proof applies Lemma 6.3 with Sample's kkk, which the paper defines as a real maximum; the printed statement is the case where that maximum is an even integer), every vertex has degree ≥1\ge1≥1, and λ>0\lambda>0λ>0; in Lemma 6.2, 0≤ϵ<λ0\le\epsilon<\lambda0≤ϵ<λ; in Lemma 6.7, 0<ϵ<10<\epsilon<10<ϵ<1 (without it the printed bound is false for large ϵ\epsilonϵ); in Lemmas 6.3–6.7 and Claim 6.5, positive degrees; in Lemma 6.3, k>0k>0k>0; in Theorem 6.8, β>0\beta>0β>0, ϵ>0\epsilon>0ϵ>0, pi∈[0,1]p_i\in[0,1]pi​∈[0,1]. GGG is not assumed connected in Theorem 6.1.
  • In Theorem 6.1 the probabilities use the degrees of G(S)G(S)G(S) (the input of Sample\mathtt{Sample}Sample), while λ\lambdaλ refers to GGG; nnn in Sample\mathtt{Sample}Sample is ∣S∣|S|∣S∣.
  • Trivializing readings ruled out: a one-sided "approximation", a goal that chooses the kept edges existentially, and a spectral hypothesis with λ≤0\lambda\le0λ≤0 or without positive degrees are all excluded by the statements.
  • Out of scope: running times, the decomposition algorithms of §7–§10, Cheeger's inequality (Theorem 4.1, cited and not used here), the weighted generalization remarked on p. 10, and the use of Theorem 6.1 in Lemma 9.1.
  • Contributions welcome: proofs of any milestone; a Loewner-order formulation equivalence; a general matrix Chernoff or trace-method library from which Lemma 6.3 follows.

Selected references

  • D. A. Spielman, S.-H. Teng, Spectral Sparsification of Graphs, arXiv:0808.4134v3, 2010; SIAM J. Comput. 40(4), 2011. https://arxiv.org/abs/0808.4134
  • A. A. Benczúr, D. R. Karger, Approximating s-t minimum cuts in Õ(n²) time, STOC 1996. https://doi.org/10.1145/237814.237827
  • D. Achlioptas, F. McSherry, Fast computation of low rank matrix approximations, STOC 2001. https://doi.org/10.1145/380752.380858
  • Z. Füredi, J. Komlós, The eigenvalues of random symmetric matrices, Combinatorica 1(3), 1981. https://doi.org/10.1007/BF02579329
  • V. H. Vu, Spectral norm of random matrices, Combinatorica 27(6), 2007. https://doi.org/10.1007/s00493-007-2190-z
  • P. Raghavan, Probabilistic construction of deterministic algorithms: approximating packing integer programs, J. Comput. Syst. Sci. 37(2), 1988. https://doi.org/10.1016/0022-0000(88)90003-7
  • D. A. Spielman, N. Srivastava, Graph sparsification by effective resistances, STOC 2008; arXiv:0803.0929. https://arxiv.org/abs/0803.0929
13 thms1 active userReviewed
Operations Research·Captain: mikedeng1

A Note on Probability Distributions with Increasing Generalized Failure Rates II: For IGFR X with Support (α, ∞) and g(ξ) → κ, E[Xⁿ] Is Finite iff κ > nResearch Paper

Motivation

Many models in operations management and economics need the demand or valuation distribution to be regular in some way, so that an optimal price, order quantity or contract is unique. Pricing a service to one customer whose valuation XXX has survival function Φˉ\bar\PhiΦˉ is a typical example. The seller maximizes p Φˉ(p)p\,\bar\Phi(p)pΦˉ(p). The first-order condition is Φˉ(p)(1−g(p))=0\bar\Phi(p)(1-g(p))=0Φˉ(p)(1−g(p))=0, where g(ξ)=ξh(ξ)g(\xi)=\xi h(\xi)g(ξ)=ξh(ξ) is the generalized failure rate and hhh is the ordinary failure rate. When ggg is increasing (the IGFR property, introduced by Lariviere and Porteus 2001), the optimal price is unique and solves g(p∗)=1g(p^*)=1g(p∗)=1.

The best-known regularity class is the class of IFR laws, those with increasing failure rate. Every IFR law has finite moments of all orders (Barlow and Proschan 1965). IGFR laws are a larger class that includes heavy-tailed laws, and Lariviere (2006) identifies exactly which of their moments are finite. The answer is given by one number, the limit of the generalized failure rate. A consequence used in pricing models is that a valuation law with a finite mean has g>1g>1g>1 eventually, so the pricing problem has a finite solution.

Setting

Let XXX be a nonnegative random variable with distribution function Φ(ξ)=P(X≤ξ)\Phi(\xi)=\mathbb P(X\le\xi)Φ(ξ)=P(X≤ξ) and survival function Φˉ(ξ)=1−Φ(ξ)\bar\Phi(\xi)=1-\Phi(\xi)Φˉ(ξ)=1−Φ(ξ). Assume Φ\PhiΦ has a density ϕ\phiϕ. The failure rate is

h(ξ)=ϕ(ξ)Φˉ(ξ),h(\xi)=\frac{\phi(\xi)}{\bar\Phi(\xi)},h(ξ)=Φˉ(ξ)ϕ(ξ)​,

and the generalized failure rate is g(ξ)=ξh(ξ)g(\xi)=\xi h(\xi)g(ξ)=ξh(ξ). XXX is IGFR if ggg is weakly increasing on {ξ:Φ(ξ)<1}\{\xi:\Phi(\xi)<1\}{ξ:Φ(ξ)<1}. XXX has support (α,∞)(\alpha,\infty)(α,∞), with α≥0\alpha\ge 0α≥0, if Φ(ξ)=0\Phi(\xi)=0Φ(ξ)=0 exactly for ξ≤α\xi\le\alphaξ≤α and Φ(ξ)<1\Phi(\xi)<1Φ(ξ)<1 for every ξ\xiξ. For a real n>0n>0n>0, the nnn-th moment is E[Xn]=∫xn dΦ(x)∈[0,∞]\mathbb E[X^n]=\int x^n\,d\Phi(x)\in[0,\infty]E[Xn]=∫xndΦ(x)∈[0,∞].

The comparison law is the Pareto law with scale S>0S>0S>0 and parameter k>0k>0k>0, which has density ϕ(ξ)=kSkξ−k−1\phi(\xi)=kS^k\xi^{-k-1}ϕ(ξ)=kSkξ−k−1 for ξ≥S\xi\ge Sξ≥S. Its generalized failure rate is identically kkk on [S,∞)[S,\infty)[S,∞), and its nnn-th moment is finite exactly when k>nk>nk>n. For a level yyy with Φˉ(y)>0\bar\Phi(y)>0Φˉ(y)>0, write XyX_yXy​ for XXX conditional on X>yX>yX>y. A random variable AAA is stochastically smaller than BBB if P(A>x)≤P(B>x)\mathbb P(A>x)\le\mathbb P(B>x)P(A>x)≤P(B>x) for all real xxx.

In Lean, XXX is its law μ : Measure ℝ, Φ\PhiΦ is cdf μ, Φˉ\bar\PhiΦˉ is survival μ, hhh is failureRate μ φ, ggg is genFailureRate μ φ, and E[Xn]\mathbb E[X^n]E[Xn] is nthMoment μ n.

Formalization targets

Goal: Theorem 2 (p. 603)

Suppose XXX is IGFR with support (α,∞)(\alpha,\infty)(α,∞) and lim⁡ξ→∞g(ξ)=κ\lim_{\xi\to\infty}g(\xi)=\kappalimξ→∞​g(ξ)=κ, where κ∈[0,∞]\kappa\in[0,\infty]κ∈[0,∞] may be infinite. Then for every real n>0n>0n>0,

E[Xn]<∞  ⟺  κ>n.\mathbb E[X^n]<\infty\iff\kappa>n .E[Xn]<∞⟺κ>n.

The statement fixes no constants. It covers κ=∞\kappa=\inftyκ=∞ (all moments finite) and the boundary case n=κn=\kappan=κ (infinite moment).

Milestones

The two Pareto facts of the §3 preamble come first:

gPareto(S,k)(ξ)=k  (ξ≥S),E[Xkn]<∞  ⟺  k>n.g_{\mathrm{Pareto}(S,k)}(\xi)=k\ \ (\xi\ge S),\qquad \mathbb E[X_k^n]<\infty\iff k>n .gPareto(S,k)​(ξ)=k  (ξ≥S),E[Xkn​]<∞⟺k>n.

Six claims from the proof follow:

  1. E[Xn]<∞\mathbb E[X^n]<\inftyE[Xn]<∞ iff the part of the integral over {X>y}\{X>y\}{X>y} is finite.
  2. hy=hh_y=hhy​=h on (y,∞)(y,\infty)(y,∞).
  3. Φˉ(ξ)=exp⁡[−∫0ξh]\bar\Phi(\xi)=\exp[-\int_0^\xi h]Φˉ(ξ)=exp[−∫0ξ​h].
  4. If h(ξ)>c/ξh(\xi)>c/\xih(ξ)>c/ξ beyond yyy, then XyX_yXy​ is stochastically smaller than Pareto(y,c)\mathrm{Pareto}(y,c)Pareto(y,c).
  5. The usual stochastic order between nonnegative variables orders their nnn-th moments.
  6. If h(ξ)≤c/ξh(\xi)\le c/\xih(ξ)≤c/ξ beyond zzz, then Pareto(z,c)\mathrm{Pareto}(z,c)Pareto(z,c) is stochastically smaller than XzX_zXz​.

Two consequences stated after the theorem are included as further targets. First, an IGFR law with support (α,∞)(\alpha,\infty)(α,∞) and a finite mean has g>1g>1g>1 beyond some finite point. Second, a strictly IGFR law with a finite (n+1)(n+1)(n+1)-st moment satisfies the two conditions of Van Mieghem and Dada (1999): h(ξ)−(n+1)/ξh(\xi)-(n+1)/\xih(ξ)−(n+1)/ξ has at most one zero, and lim⁡ξ↓0ξh(ξ)<n+1\lim_{\xi\downarrow0}\xi h(\xi)<n+1limξ↓0​ξh(ξ)<n+1.

Significance

The theorem gives a complete moment criterion for IGFR laws in terms of the single number κ\kappaκ. Among IGFR laws, finiteness of the mean, the variance or any higher moment can therefore be read off the tail of ggg. One consequence is that a finite mean is enough for the IGFR pricing problem to have a finite solution, which replaces the separate condition "ggg exceeds one at a finite point". The theorem generalizes Lemma 2 of Lariviere and Porteus (2001), and the paper uses it to connect IGFR laws to the Van Mieghem–Dada condition.

The result is proved on paper but has not been formalized. Formalizing it adds three things:

  • a machine-checked proof of the boundary case n=κn=\kappan=κ, which the printed argument (with 0<ε<n−κ0<\varepsilon<n-\kappa0<ε<n−κ) does not treat;
  • the Pareto moment and hazard identities, which Mathlib's Pareto.lean lacks;
  • a reusable link between failure-rate bounds and the usual stochastic order, through the representation Φˉ=exp⁡(−∫h)\bar\Phi=\exp(-\int h)Φˉ=exp(−∫h).

Difficulty

The core of the proof is a comparison: a pointwise bound h(ξ)≷c/ξh(\xi)\gtrless c/\xih(ξ)≷c/ξ beyond a level becomes a stochastic order against a Pareto tail. This needs the representation Φˉ(ξ)=exp⁡[−∫0ξh]\bar\Phi(\xi)=\exp[-\int_0^\xi h]Φˉ(ξ)=exp[−∫0ξ​h], which uses the fundamental theorem of calculus for log⁡Φˉ\log\bar\PhilogΦˉ across the left end of the support, where Φ\PhiΦ may have a kink. It also needs to be stated for the conditional law, whose density is a rescaled restriction.

An obvious first attempt is to bound E[Xn]\mathbb E[X^n]E[Xn] directly by ∫xnϕ(x) dx\int x^n\phi(x)\,dx∫xnϕ(x)dx with the given bound on ggg. That bound controls ϕ/Φˉ\phi/\bar\Phiϕ/Φˉ, not ϕ\phiϕ, so it says nothing directly. The survival representation is what converts it.

A second obstacle is the boundary case n=κn=\kappan=κ, with κ\kappaκ finite. A strict margin ε\varepsilonε is no longer available there. It needs the non-strict bound g≤κg\le\kappag≤κ, which follows from monotonicity, and a Pareto law with parameter exactly κ\kappaκ.

Formalization scope

  • Laws, not random variables. Every statement is about distributions, so XXX is represented by a probability measure μ on ℝ with μ (Set.Iio 0) = 0. In the goal, nonnegativity also follows from the support hypothesis, and the separate hypothesis is kept for uniformity with the other items.

  • The density version is pinned. hhh and ggg read ϕ\phiϕ pointwise, while "Φ has density φ" determines ϕ\phiϕ only up to a null set. The predicate IsRegDensity requires ϕ≥0\phi\ge0ϕ≥0 and μ=ϕ⋅Lebesgue\mu=\phi\cdot\text{Lebesgue}μ=ϕ⋅Lebesgue. It also requires ϕ(ξ)\phi(\xi)ϕ(ξ) to be the right derivative of Φ\PhiΦ at every point ξ\xiξ of {0<Φ<1}\{0<\Phi<1\}{0<Φ<1} and ϕ=0\phi=0ϕ=0 wherever Φ=0\Phi=0Φ=0. The exponential law with ϕ(0)=0\phi(0)=0ϕ(0)=0 satisfies all hypotheses of the goal, with κ=∞\kappa=\inftyκ=∞.

  • IGFR is weak monotonicity of ggg on {Φ<1}\{\Phi<1\}{Φ<1}, as printed. On this set Φˉ>0\bar\Phi>0Φˉ>0, so Lean's convention x/0=0x/0=0x/0=0 never enters.

  • κ\kappaκ is an extended nonnegative real. The limit hypothesis is Tendsto (fun ξ => ENNReal.ofReal (g ξ)) atTop (𝓝 κ) with κ : ℝ≥0∞. A real-valued κ\kappaκ would silently drop the case κ=∞\kappa=\inftyκ=∞.

  • Moments are lower Lebesgue integrals ∫⁻ x, ENNReal.ofReal (x ^ n) ∂μ with a real exponent. The Bochner integral would make "finite" automatic, because it returns 000 for a non-integrable function, so it is not used.

  • Conditioning and Pareto. XyX_yXy​ is Mathlib's ProbabilityTheory.cond μ (Set.Ioi y), always with Φˉ(y)>0\bar\Phi(y)>0Φˉ(y)>0. The Pareto law is Mathlib's paretoMeasure S k. "Stochastically smaller" is the published definition StochasticOrders.Usual.UsualOrder applied with the identity map.

  • Trivialization is ruled out. The goal is a full equivalence with a possibly infinite κ\kappaκ and an infinite-valued moment. It is not the weaker "κ>n\kappa>nκ>n implies finite", and the hypotheses are jointly satisfiable.

  • Recorded deviations. The printed bound "E[Xn∣X≤y]<yn+1\mathbb E[X^n\mid X\le y]<y^{n+1}E[Xn∣X≤y]<yn+1" is a slip (it fails for y<1y<1y<1). Only the finiteness it is used for is formalized. The Pareto moment fact is stated as an equivalence, which contains the printed "only if".

  • Infrastructure. A complete development needs:

    • the Pareto moment integral;
    • the FTC argument for log⁡Φˉ\log\bar\PhilogΦˉ;
    • the layer-cake formula for moments under the usual order;
    • basic facts about cond and cdf.

    The survival representation and the failure-rate/Pareto comparisons are reusable for any heavy-tail result stated through hazard rates. Contributions are welcome at every level, including partial results such as the Pareto lemmas alone.

Selected references

  • M. A. Lariviere, A note on probability distributions with increasing generalized failure rates, Operations Research 54(3):602–604, 2006. https://doi.org/10.1287/opre.1060.0282
  • M. A. Lariviere and E. L. Porteus, Selling to a newsvendor: an analysis of price-only contracts, Manufacturing & Service Operations Management 3(4):293–305, 2001. https://doi.org/10.1287/msom.3.4.293.9971
  • R. E. Barlow and F. Proschan, Mathematical Theory of Reliability, Wiley, 1965 (SIAM Classics reprint 1996). https://doi.org/10.1137/1.9781611971194
  • J. A. Van Mieghem and M. Dada, Price versus production postponement: capacity and competition, Management Science 45(12):1631–1649, 1999. https://doi.org/10.1287/mnsc.45.12.1631
  • S. M. Ross, Stochastic Processes, Wiley, 1983.
14 thms1 active userReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Martingale Proofs of Many-Server Heavy-Traffic Limits for Markovian Queues 1: The Centered and √n-Scaled M/M/∞ Queue Converges in D to an Ornstein–Uhlenbeck ProcessResearch Paper

Motivation

Large service systems (call centers, hospital wards, cloud server pools) run with many servers, and for many of them no exact formula describes how the number of busy servers moves over time. Heavy-traffic limits replace such a system by a diffusion process that is easier to analyze. The many-server regime, in which the number of servers and the arrival rate grow together, goes back to Halfin and Whitt (1981) and is the basis of square-root staffing rules in call-center practice.

The simplest many-server model is the M/M/∞M/M/\inftyM/M/∞ queue. Its stationary number in system is Poisson with mean λ/μ\lambda/\muλ/μ, so the centered and n\sqrt nn​-scaled stationary count is asymptotically normal when λn=nμ\lambda_n = n\muλn​=nμ. The question here is about the whole process: does the scaled number in system converge, as a random path, to a diffusion? The classical answer, the Ornstein–Uhlenbeck limit, was first established by Iglehart (1965) with Stone's theorem for birth-and-death processes, and was revisited by strong approximation (Mandelbaum, Massey and Reiman 1998) and, for general service times, by Krichagina and Puhalskii (1997).

Pang, Talreja and Whitt (2007) is a tutorial survey that proves this limit, and its finite-waiting-room extension, with martingale methods. The authors present the argument as a template for non-Markovian and network models (Reed 2009; Dai and Tezcan; Gurvich and Whitt). This mission formalizes the M/M/∞M/M/\inftyM/M/∞ result and the steps of the paper's proof.

Setting

Fix a service rate μ>0\mu > 0μ>0. For each n≥1n \ge 1n≥1, the nnn-th system has arrival rate λn=nμ\lambda_n = n\muλn​=nμ. Let AnA_nAn​ and SnS_nSn​ be independent Poisson processes of rate 111, and let Qn(0)Q_n(0)Qn​(0) be a random initial number of customers, independent of AnA_nAn​ and SnS_nSn​. The number in system Qn(t)Q_n(t)Qn​(t) is the N\mathbb NN-valued process with right-continuous paths having left limits that satisfies, almost surely,

Qn(t)=Qn(0)+An(λnt)−Sn(μ∫0tQn(s) ds),t≥0.(12)Q_n(t) = Q_n(0) + A_n(\lambda_n t) - S_n\Big(\mu \int_0^t Q_n(s)\,ds\Big), \qquad t \ge 0. \qquad (12)Qn​(t)=Qn​(0)+An​(λn​t)−Sn​(μ∫0t​Qn​(s)ds),t≥0.(12)

The departure term is a random time change: each of the Qn(s)Q_n(s)Qn​(s) customers in service completes service at rate μ\muμ. The diffusion-scaled process is Xn(t)=(Qn(t)−n)/nX_n(t) = (Q_n(t) - n)/\sqrt nXn​(t)=(Qn​(t)−n)/n​, the paper's (3). The space DDD consists of paths on [0,∞)[0,\infty)[0,∞) that are right-continuous with left limits, and ⇒\Rightarrow⇒ denotes convergence in distribution.

The limit is the Ornstein–Uhlenbeck (OU) process XXX, driven by a standard Brownian motion BBB, with X(0)X(0)X(0) independent of BBB:

X(t)=X(0)+2μ B(t)−μ∫0tX(s) ds,t≥0.(5)X(t) = X(0) + \sqrt{2\mu}\,B(t) - \mu \int_0^t X(s)\,ds, \qquad t \ge 0. \qquad (5)X(t)=X(0)+2μ​B(t)−μ∫0t​X(s)ds,t≥0.(5)

The proof also uses the scaled martingales Mn,1(t)=(An(λnt)−λnt)/nM_{n,1}(t) = (A_n(\lambda_n t) - \lambda_n t)/\sqrt nMn,1​(t)=(An​(λn​t)−λn​t)/n​ and Mn,2(t)=(Sn(μ∫0tQn)−μ∫0tQn)/nM_{n,2}(t) = \big(S_n(\mu\int_0^t Q_n) - \mu\int_0^t Q_n\big)/\sqrt nMn,2​(t)=(Sn​(μ∫0t​Qn​)−μ∫0t​Qn​)/n​, the fluid processes ΨS,n=Qn/n\Psi_{S,n} = Q_n/nΨS,n​=Qn​/n and ΦS,n(t)=μn∫0tQn(s) ds\Phi_{S,n}(t) = \frac{\mu}{n}\int_0^t Q_n(s)\,dsΦS,n​(t)=nμ​∫0t​Qn​(s)ds, and stochastic boundedness. A sequence of real random variables is stochastically bounded if it is tight, and a sequence of processes is stochastically bounded in DDD if sup⁡0≤t≤T∣Xn(t)∣\sup_{0\le t\le T}|X_n(t)|sup0≤t≤T​∣Xn​(t)∣ is, for every T>0T > 0T>0.

Formalization targets

Goal: Theorem 1.1

If Xn(0)⇒X(0)X_n(0) \Rightarrow X(0)Xn​(0)⇒X(0) in R\mathbb RR, with an arbitrary limit law ν\nuν, then

Xn⇒Xin D as n→∞,X_n \Rightarrow X \quad \text{in } D \text{ as } n \to \infty,Xn​⇒Xin D as n→∞,

where XXX is the OU process (5) with X(0)∼νX(0) \sim \nuX(0)∼ν. The goal fixes no initial distribution and assumes no moment condition on Qn(0)Q_n(0)Qn​(0).

Milestones, in the order of the proof

  1. Lemma 2.1, that (12) defines QQQ, and Lemma 3.3, the crude bound Q(t)≤Q(0)+A(λt)Q(t) \le Q(0) + A(\lambda t)Q(t)≤Q(0)+A(λt).
  2. Lemmas 3.1 and 3.2, which identify ⟨M⟩\langle M \rangle⟨M⟩ for compensated counting processes and for random time changes of a Poisson process. Then Theorem 3.4, the martingale representation Xn=Xn(0)+Mn,1−Mn,2−μ∫0⋅XnX_n = X_n(0) + M_{n,1} - M_{n,2} - \mu\int_0^\cdot X_nXn​=Xn​(0)+Mn,1​−Mn,2​−μ∫0⋅​Xn​, with ⟨Mn,1⟩(t)=μt\langle M_{n,1}\rangle(t) = \mu t⟨Mn,1​⟩(t)=μt and ⟨Mn,2⟩=ΦS,n\langle M_{n,2}\rangle = \Phi_{S,n}⟨Mn,2​⟩=ΦS,n​.
  3. Theorem 4.1(i), the continuity of the integral representation; Lemma 4.1, Gronwall's inequality; and Theorem 4.2, the Poisson FCLT.
  4. Lemmas 5.9, 5.5, 5.8 and 6.2, the stochastic-boundedness route to the fluid limit.
  5. Lemmas 4.3 and 4.2, the fluid limits Qn/n⇒1Q_n/n \Rightarrow 1Qn​/n⇒1 and ΦS,n⇒μe\Phi_{S,n} \Rightarrow \mu eΦS,n​⇒μe; then Lemma 4.4, (Mn,1,Mn,2)⇒(μB1,μB2)(M_{n,1}, M_{n,2}) \Rightarrow (\sqrt\mu B_1, \sqrt\mu B_2)(Mn,1​,Mn,2​)⇒(μ​B1​,μ​B2​).

Significance

Theorem 1.1 describes the transient behavior of a large infinite-server system, not only its stationary law: fluctuations of order n\sqrt nn​ around the offered load nnn form a Gaussian Markov process that relaxes at rate μ\muμ. It is the reference case for the Halfin–Whitt regime, whose finite-server version, Theorem 1.2 of the same paper (the M/M/n/mn+MM/M/n/m_n+MM/M/n/mn​+M queue), is the subject of the companion mission. The milestones are general tools reused well beyond queueing: Gronwall's inequality, the Lipschitz integral map, the Poisson FCLT, stochastic boundedness via Lenglart's inequality, and the fluid limit from stochastic boundedness.

The theorem is proved and classical; no machine-checked proof of it, or of the milestones below, is known. No formal library currently has the Poisson functional central limit theorem in DDD, compensators of counting processes, or random time changes of martingales. Formalizing the paper's proof would produce these, plus a template for the martingale method of heavy-traffic analysis. Alternative proofs, such as the paper's §4.3 route without martingales, are equally welcome as solutions.

Difficulty

Equation (12) is a fixed-point equation: QnQ_nQn​ appears inside the argument of SnS_nSn​. The integral map of Theorem 4.1 is continuous, so the obvious argument is to apply the continuous-mapping theorem to the martingale representation. That reduces the goal to the joint convergence of (Mn,1,Mn,2)(M_{n,1}, M_{n,2})(Mn,1​,Mn,2​). But Mn,2M_{n,2}Mn,2​ is a Poisson martingale evaluated at the random time ΦS,n(t)\Phi_{S,n}(t)ΦS,n​(t), and its limit is identified only after the fluid limit ΦS,n⇒μe\Phi_{S,n} \Rightarrow \mu eΦS,n​⇒μe is known. The fluid limit is itself a statement about the whole sequence QnQ_nQn​, and it needs a separate argument, either Gronwall at fluid scale or stochastic boundedness. Lemma 3.2 requires optional stopping at the continuum of stopping times I(t)I(t)I(t), and the moment conditions (22) must be checked through the crude bound. Removing E[Qn(0)]<∞E[Q_n(0)] < \inftyE[Qn​(0)]<∞ needs a truncation of the initial conditions (§6.3).

Formalization scope

  • Time. Paths are functions R→R\mathbb R \to \mathbb RR→R and every condition is for t≥0t \ge 0t≥0. Brownian motions and filtrations are indexed by R≥0\mathbb R_{\ge 0}R≥0​.
  • Probability space. All systems live on one probability space. Each nnn has its own pair of Poisson processes; the paper's single pair is a special case, and weak convergence depends only on laws. Sequences start at n=1n = 1n=1.
  • Weak convergence in DDD to a continuous limit is stated in coupling form (CouplingConverges): a Skorokhod representation with almost-sure uniform convergence on compact intervals. Convergence to a deterministic path is uniform convergence on compacts in probability (UocInProb). Xn(0)⇒νX_n(0) \Rightarrow \nuXn​(0)⇒ν is stated with bounded continuous test functions.
  • The OU process is the published Erlang-A diffusion with β=0\beta = 0β=0 and θ=μ\theta = \muθ=μ, whose drift is −μx-\mu x−μx. A solution has X(0)∼νX(0) \sim \nuX(0)∼ν independent of BBB and is adapted to σ(X(0))∨σ(B(s):s≤t)\sigma(X(0)) \vee \sigma(B(s) : s \le t)σ(X(0))∨σ(B(s):s≤t). The goal asserts existence and that every solution is a limit, which carries uniqueness in law. The limit space is in universe Type.
  • Predictable quadratic variation is a property, since Mathlib has no Doob–Meyer theorem: MMM is square integrable, VVV is adapted, continuous (the paper's "predictable", p. 208), nondecreasing and integrable, and M2−VM^2 - VM2−V is a martingale. Optional quadratic variations [M][M][M] are not stated.
  • Filtrations. The filtration of Theorem 3.4 is the generated history augmented by the measurable null sets.
  • Norms and suprema. The norm on Rk\mathbb R^kRk is ℓ1\ell^1ℓ1, and suprema of paths are taken in [0,∞][0, \infty][0,∞].
  • Added hypotheses. The statements add three things the printed versions need: Mn(0)=0M_n(0) = 0Mn​(0)=0 in Lemma 5.8 (without it the lemma is false), SSS an F\mathbf FF-Poisson process and I(0)=0I(0) = 0I(0)=0 in Lemma 3.2, and integrability of ggg in Lemma 4.1.
  • Not formalized. Theorem 4.1(ii) (J1J_1J1​ continuity) and the birth-and-death clause of Lemma 2.1.

A formalization that fixes Qn(0)=nQ_n(0) = nQn​(0)=n, assumes Xn(0)X_n(0)Xn​(0) converges almost surely, adds E[Qn(0)]<∞E[Q_n(0)] < \inftyE[Qn​(0)]<∞ to the goal, or replaces convergence in DDD by convergence of finite-dimensional distributions proves a weaker theorem and does not close the goal.

Contributions are welcome at every level. The Poisson FCLT, Lenglart's inequality and the composition map are reusable library results, independent of queueing.

Selected references

  • G. Pang, R. Talreja, W. Whitt, Martingale Proofs of Many-Server Heavy-Traffic Limits for Markovian Queues, Probability Surveys 4 (2007) 193–267. https://arxiv.org/abs/0712.4211 (doi:10.1214/06-PS091)
  • D. L. Iglehart, Limit diffusion approximations for the many server queue and the repairman problem, J. Appl. Prob. 2 (1965) 429–441. https://mathscinet.ams.org/mathscinet-getitem?mr=0184302
  • S. Halfin, W. Whitt, Heavy-traffic limits for queues with many exponential servers, Oper. Res. 29 (1981) 567–588. https://mathscinet.ams.org/mathscinet-getitem?mr=0629195
  • A. Mandelbaum, W. A. Massey, M. I. Reiman, Strong approximations for Markovian service networks, Queueing Systems 30 (1998) 149–201. https://mathscinet.ams.org/mathscinet-getitem?mr=1663767
  • E. V. Krichagina, A. A. Puhalskii, A heavy-traffic analysis of a closed queueing system with a GI/∞ service center, Queueing Systems 25 (1997) 235–280. https://mathscinet.ams.org/mathscinet-getitem?mr=1458591
  • S. N. Ethier, T. G. Kurtz, Markov Processes: Characterization and Convergence, Wiley, 1986. https://mathscinet.ams.org/mathscinet-getitem?mr=0838085
23 thms1 active userReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Martingale Proofs of Many-Server Heavy-Traffic Limits for Markovian Queues 2: In the QED Regime the Scaled M/M/n/mₙ+M Queue Converges to a Diffusion Reflected at the Upper Barrier κResearch Paper

Motivation

Large service systems such as call centers, hospital wards and cloud server pools have many parallel servers, finite buffers and customers who leave when they wait too long. Their performance is usually analysed through heavy-traffic diffusion limits: the number of customers in the system, centred and rescaled, converges as the system grows to a diffusion process whose law is computable. The quality-and-efficiency-driven (QED) regime of Halfin and Whitt (Oper. Res. 29, 1981) is the scaling in which the number of servers nnn and the arrival rate grow together so that the probability of delay stays strictly between 000 and 111. Garnett, Mandelbaum and Reiman (M&SOM 4, 2002) proved the QED limit for the Erlang-A model with unlimited waiting room. Whitt (Math. Oper. Res. 30, 2005) added finite waiting rooms of size of order n\sqrt nn​, which produce a reflecting upper barrier in the limit.

Pang, Talreja and Whitt (Probab. Surveys 4, 2007) give a self-contained martingale proof of these limits. Theorem 1.2 of that paper, the target of this mission, covers the M/M/n/mn+MM/M/n/m_n+MM/M/n/mn​+M model with finite waiting room and abandonment. It contains the Erlang-B (loss) model (mn=0m_n=0mn​=0) and finite-buffer Erlang-C models (θ=0\theta=0θ=0) as special cases.

Setting

Fix a service rate μ>0\mu>0μ>0, an abandonment rate θ≥0\theta\ge 0θ≥0, a constant β∈R\beta\in\mathbb Rβ∈R and a barrier κ≥0\kappa\ge 0κ≥0. For n≥1n\ge 1n≥1, model nnn is an M/M/n/mn+MM/M/n/m_n+MM/M/n/mn​+M queue: nnn servers, a waiting room of mn∈{0,1,2,… }m_n\in\{0,1,2,\dots\}mn​∈{0,1,2,…} places, Poisson arrivals of rate λn\lambda_nλn​, exponential services of rate μ\muμ, first-come first-served service, and an exponential patience of rate θ\thetaθ for each waiting customer. An arrival that finds all n+mnn+m_nn+mn​ places occupied is blocked and lost.

The number in system Qn(t)Q_n(t)Qn​(t) is constructed from independent rate-1 Poisson processes AAA, SSS, RRR and an independent initial value Qn(0)≤n+mnQ_n(0)\le n+m_nQn​(0)≤n+mn​ by

Qn(t)=Qn(0)+A(λnt)−S(μ ⁣∫0t(Qn(s)∧n) ds)−R(θ ⁣∫0t(Qn(s)−n)+ds)−Un(t),Q_n(t)=Q_n(0)+A(\lambda_n t)-S\Big(\mu\!\int_0^t (Q_n(s)\wedge n)\,ds\Big)-R\Big(\theta\!\int_0^t (Q_n(s)-n)^+ds\Big)-U_n(t),Qn​(t)=Qn​(0)+A(λn​t)−S(μ∫0t​(Qn​(s)∧n)ds)−R(θ∫0t​(Qn​(s)−n)+ds)−Un​(t),

where Un(t)=∫(0,t]1{Qn(s−)=n+mn} dA(λns)U_n(t)=\int_{(0,t]}\mathbf 1\{Q_n(s-)=n+m_n\}\,dA(\lambda_n s)Un​(t)=∫(0,t]​1{Qn​(s−)=n+mn​}dA(λn​s) counts blocked arrivals. The QED scaling is

nμ−λnn→βμ,mnn→κ,\frac{n\mu-\lambda_n}{\sqrt n}\to\beta\mu,\qquad \frac{m_n}{\sqrt n}\to\kappa,n​nμ−λn​​→βμ,n​mn​​→κ,

and the scaled process is Xn(t)=(Qn(t)−n)/nX_n(t)=(Q_n(t)-n)/\sqrt nXn​(t)=(Qn​(t)−n)/n​.

The limit is a reflected diffusion: a pair (X,U)(X,U)(X,U) of processes with right-continuous paths with left limits, X≤κX\le\kappaX≤κ, UUU nondecreasing and nonnegative, a standard Brownian motion BBB independent of X(0)X(0)X(0), and

X(t)=X(0)−βμt+2μ B(t)−∫0t[μ(X(s)∧0)+θ(X(s)∨0)]ds−U(t),∫0∞1{X(t)<κ} dU(t)=0.X(t)=X(0)-\beta\mu t+\sqrt{2\mu}\,B(t)-\int_0^t\big[\mu(X(s)\wedge0)+\theta(X(s)\vee0)\big]ds-U(t),\qquad \int_0^\infty\mathbf 1\{X(t)<\kappa\}\,dU(t)=0 .X(t)=X(0)−βμt+2μ​B(t)−∫0t​[μ(X(s)∧0)+θ(X(s)∨0)]ds−U(t),∫0∞​1{X(t)<κ}dU(t)=0.

The regulator UUU increases only when XXX sits at κ\kappaκ.

Formalization targets

Goal: Theorem 1.2

If Xn(0)⇒νX_n(0)\Rightarrow\nuXn​(0)⇒ν in R\mathbb RR, then Xn⇒XX_n\Rightarrow XXn​⇒X in DDD, where XXX solves the reflected equation above with X(0)∼νX(0)\sim\nuX(0)∼ν, and every solution with initial law ν\nuν has the same law:

Xn⇒Xin D[0,∞)(n→∞).X_n\Rightarrow X\quad\text{in } D[0,\infty)\qquad (n\to\infty).Xn​⇒Xin D[0,∞)(n→∞).

The goal fixes no rate of convergence and no stationary quantity; it asserts the process limit and its characterization by (9)–(10).

Milestones

  1. Theorem 7.4: the martingale representation of XnX_nXn​ as Xn(0)X_n(0)Xn​(0) plus scaled Poisson martingales Mn,iM_{n,i}Mn,i​, a drift term, a Lipschitz feedback term and the scaled blocking process Vn=Un/nV_n=U_n/\sqrt nVn​=Un​/n​, with the predictable quadratic variations of the Mn,iM_{n,i}Mn,i​.
  2. (110): the limit noise B1(μt)−B2(μt)−B3(0)B_1(\mu t)-B_2(\mu t)-B_3(0)B1​(μt)−B2​(μt)−B3​(0) of three independent Brownian motions has the law of 2μ B\sqrt{2\mu}\,B2μ​B.
  3. Theorem 7.3 (i): the deterministic reflected integral equation x=b+y+∫0⋅h(x) ds−ux=b+y+\int_0^\cdot h(x)\,ds-ux=b+y+∫0⋅​h(x)ds−u with barrier κ\kappaκ and Lipschitz hhh has a unique solution, depending continuously on (y,b)(y,b)(y,b) for uniform convergence on bounded intervals, and continuous when yyy is.

Significance

The theorem supplies the diffusion approximation behind square-root staffing rules for systems with finite buffers: it says that buffers of order n\sqrt nn​ are visible in the limit as a barrier at κ\kappaκ, and that the limit for κ=0\kappa=0κ=0 (Erlang-B with or without abandonment) is a reflected Ornstein–Uhlenbeck-type process. Stationary blocking and delay probabilities of the limit then approximate those of the large finite system.

The result is proved in the literature (Whitt 2005; Pang, Talreja and Whitt 2007, whose proof of Theorem 1.2 is a sketch built on §7.1). It is not formalized anywhere. A formal proof would supply a checked martingale representation for a birth–death queue with blocking, a checked reflection map with state-dependent drift, and the continuous-mapping step through it. The unlimited-waiting-room case is posed separately on the platform as the Erlang-A limit of Garnett, Mandelbaum and Reiman and is not part of this mission.

Difficulty

The obvious route is the one used for the Erlang-A model: write XnX_nXn​ as a continuous function of the scaled Poisson noise and apply the continuous-mapping theorem. With a finite waiting room this fails as stated, because the blocking process UnU_nUn​ is not a function of the noise alone. It depends on the path of QnQ_nQn​ through the times the system is full. The proof must instead identify (Xn,Vn)(X_n,V_n)(Xn​,Vn​) as the image of the noise under a reflection map with a drift inside it, prove that this map is well defined and continuous, and control the martingale terms through random time changes whose limits are deterministic. The barrier in model nnn is mn/nm_n/\sqrt nmn​/n​, not κ\kappaκ, so the continuous-mapping step has to handle a moving barrier as well.

Formalization scope

  • Paths. Time is real; every path is a function on R\mathbb RR of which only the values at t≥0t\ge0t≥0 are used. "In DDD" is BellWilliams2001.ThresholdPolicy.IsCadlag. Brownian motion is ErlangA.Diffusion.IsStandardBM, indexed by R≥0\mathbb R_{\ge0}R≥0​; martingales are Mathlib Martingales indexed by R≥0\mathbb R_{\ge0}R≥0​.
  • Model. All systems live on one probability space with their own primitives An,Sn,RnA_n,S_n,R_nAn​,Sn​,Rn​; Poisson processes are ManyServerQED.Scheduling.IsPoissonProcess. Qn(0)Q_n(0)Qn​(0) is independent of the primitives and Qn(t)≤n+mnQ_n(t)\le n+m_nQn​(t)≤n+mn​ for all t≥0t\ge0t≥0. Blocked arrivals are counted with the left limit Qn(s−)Q_n(s-)Qn​(s−), correcting (114) as printed. θ=0\theta=0θ=0 and κ=0\kappa=0κ=0 are allowed.
  • Weak convergence. Xn(0)⇒νX_n(0)\Rightarrow\nuXn​(0)⇒ν is convergence of expectations of bounded continuous functions. Xn⇒XX_n\Rightarrow XXn​⇒X in DDD is BellWilliams2001.ThresholdPolicy.CouplingConverges (Skorohod coupling with almost sure uniform convergence on compacts), equivalent to J1J_1J1​ weak convergence for a continuous limit. Uniform distances use supDist on R1\mathbb R^1R1.
  • Limit. The drift is ErlangA.Diffusion.drift; X(0)X(0)X(0) is independent of BBB; XXX and UUU are adapted to the filtration of X(0)X(0)X(0) and BBB; condition (10) is "the Lebesgue–Stieltjes measure of UUU, extended by 000 to negative times, gives zero mass to {t≥0:X(t)<κ}\{t\ge0: X(t)<\kappa\}{t≥0:X(t)<κ}". Uniqueness is uniqueness in law of XXX. The limit space lives in Type.
  • Martingales. "Predictable quadratic variation VVV" means: VVV adapted with continuous, nondecreasing, nonnegative paths and M2−VM^2-VM2−V a martingale. The filtration (118) is augmented by the measurable null sets, as the paper states.
  • Ruled out. Convergence of finite-dimensional distributions, a deterministic or almost surely convergent initial condition, a fixed barrier κ\kappaκ inside the prelimit model, or a solution concept that drops X≤κX\le\kappaX≤κ or the barrier condition (10) would each make the statement weaker or vacuous; none is used.
  • Not in scope. The Skorohod J1J_1J1​ continuity in Theorem 7.3 (ii), the Erlang-A Theorem 7.1, and the non-Markovian arrivals of §7.3.

Contributions welcome: Stieltjes-integral and counting-process lemmas for UnU_nUn​, a reflection map with Lipschitz drift on D[0,∞)D[0,\infty)D[0,∞), the Poisson functional central limit theorem, and martingale facts for randomly time-changed Poisson processes. The last three are reusable well beyond this mission.

Selected references

  • G. Pang, R. Talreja, W. Whitt, Martingale proofs of many-server heavy-traffic limits for Markovian queues, Probability Surveys 4 (2007) 193–267. https://arxiv.org/abs/0712.4211 (v1), https://doi.org/10.1214/06-PS091
  • S. Halfin, W. Whitt, Heavy-traffic limits for queues with many exponential servers, Operations Research 29 (1981) 567–588. https://doi.org/10.1287/opre.29.3.567
  • O. Garnett, A. Mandelbaum, M. Reiman, Designing a call center with impatient customers, Manufacturing & Service Operations Management 4 (2002) 208–227. https://doi.org/10.1287/msom.4.3.208.7753
  • W. Whitt, Heavy-traffic limits for the G/H2∗/n/mG/H_2^*/n/mG/H2∗​/n/m queue, Mathematics of Operations Research 30 (2005) 1–27. https://mathscinet.ams.org/mathscinet-getitem?mr=2125135
  • W. Whitt, Stochastic-Process Limits, Springer, 2002. https://doi.org/10.1007/b97479
11 thms1 active userReviewed
Linear OptimizationOperations Research·Captain: mikedeng1

A Re-Solving Heuristic with Bounded Revenue Loss for Network Revenue Management with Customer Choice: Mid-Point PAC Has Constant Revenue Loss Against the DLP, Uniformly in the Problem Size kResearch Paper

Motivation

Network revenue management decides, over a finite selling horizon, which products to offer to arriving customers when the products share limited resources: seats on flight legs, hotel room-nights, rental capacity. The exact dynamic program is intractable for realistic networks, so practice relies on heuristics built from a deterministic linear program (DLP), the fluid relaxation that replaces random demand by its mean. Its value is an upper bound on the revenue of every policy, and the quality of a heuristic is measured by its revenue loss against it.

For the fluid-based heuristics, the loss grows with the size of the system: a static policy derived from one DLP solution loses order k\sqrt{k}k​ when capacities and demand rates are both scaled by kkk (Gallego and van Ryzin, 1997; Talluri and van Ryzin, 1998). Re-solving the DLP during the horizon is common practice, but for a long time it was unclear whether re-solving helps asymptotically; Cooper (2002) showed that naive re-solving can even hurt. Jasin and Kumar (Math. Oper. Res. 37(2), 2012, doi:10.1287/moor.1120.0537) proved that a re-solving heuristic with probabilistic allocation control (PAC) has a loss bounded by a constant independent of kkk, in a model that also covers customer choice through random resource consumption. Later work (Bumpensanti and Wang, 2020, arXiv:1802.06192) removed the nondegeneracy assumption with a different re-solving rule.

Setting

The horizon is [0,1][0,1][0,1]. Customer types qqq arrive as independent Poisson processes of rates λq≥0\lambda_q \ge 0λq​≥0. Each of the nnn offers jjj belongs to one type q(j)q(j)q(j); Pq,j=1P_{q,j} = 1Pq,j​=1 iff q=q(j)q = q(j)q=q(j), and Sq={j:q(j)=q}S_q = \{j : q(j) = q\}Sq​={j:q(j)=q}. Presenting offer jjj consumes a random vector Aj≥0A^j \ge 0Aj≥0 of the mmm resources, i.i.d. across presentations, and earns revenue rj(Aj)r_j(A^j)rj​(Aj), with rj(0)=0r_j(0) = 0rj​(0)=0; Aj=0A^j = 0Aj=0 models a customer who buys nothing. Resource iii starts with capacity CiC_iCi​, and ξj\xi_jξj​ bounds every AijA_{ij}Aij​. Write Aˉ=E[A]\bar A = \mathbb E[A]Aˉ=E[A] and rˉj=E[rj(Aj)]\bar r_j = \mathbb E[r_j(A^j)]rˉj​=E[rj​(Aj)]. The DLP is

DLP[C,λ]:max⁡ rˉ⊤xs.t.Aˉx≤C, Px≤λ, x≥0.\mathrm{DLP}[C,\lambda]:\quad \max\ \bar r^\top x\quad\text{s.t.}\quad \bar A x \le C,\ Px \le \lambda,\ x \ge 0.DLP[C,λ]:max rˉ⊤xs.t.Aˉx≤C, Px≤λ, x≥0.

Assumption 2.1 requires DLP[C,λ]\mathrm{DLP}[C,\lambda]DLP[C,λ] to be nondegenerate with a unique optimal solution YYY; Assumption 2.2 requires that every optimum zzz of the LP without capacity constraints violates Aˉz≤C\bar A z \le CAˉz≤C.

PAC re-solves at times 0=t0<t1<⋯<tM<10 = t_0 < t_1 < \dots < t_M < 10=t0​<t1​<⋯<tM​<1. At tℓt_\elltℓ​ it solves DLP[C(tℓ),(1−tℓ)λ]\mathrm{DLP}[C(t_\ell), (1-t_\ell)\lambda]DLP[C(tℓ​),(1−tℓ​)λ] with the remaining capacity, obtaining Y(tℓ)Y(t_\ell)Y(tℓ​); until tℓ+1t_{\ell+1}tℓ+1​ it picks offer j∈Sqj \in S_qj∈Sq​ for an arriving type-qqq customer with probability Yj(tℓ)/((1−tℓ)λq)Y_j(t_\ell)/((1-t_\ell)\lambda_q)Yj​(tℓ​)/((1−tℓ​)λq​) and presents it only if the remaining capacity is at least ξj\xi_jξj​ on every resource. In the kkk-th system capacities are kCkCkC and rates kλk\lambdakλ; VDLPkV^k_{\mathrm{DLP}}VDLPk​ is the DLP value and RPACkR^k_{\mathrm{PAC}}RPACk​ the revenue of PAC. Mid-point PAC re-solves at tl=1−2−lt_l = 1 - 2^{-l}tl​=1−2−l, l=1,…,Mkl = 1,\dots,M^kl=1,…,Mk, with MkM^kMk the smallest integer such that 2−Mk≤1/k2^{-M^k} \le 1/k2−Mk≤1/k: about log⁡2k\log_2 klog2​k re-solves.

Formalization targets

Goal: Theorem 5.2

There is ρ>0\rho > 0ρ>0, independent of kkk, such that mid-point PAC satisfies

VDLPk−E[RPACk]≤ρfor all k≥1.V^k_{\mathrm{DLP}} - \mathbb E[R^k_{\mathrm{PAC}}] \le \rho \quad\text{for all } k \ge 1.VDLPk​−E[RPACk​]≤ρfor all k≥1.

The goal fixes no constant: it asserts only that the loss is bounded uniformly in kkk.

Milestones

  • Observations B.1 and B.2: the fractional part JyJ_yJy​ of YYY is nonempty, and the augmented matrix W=[AˉB,y;PB2,y]W = [\bar A_{B,y}; P_{B_2,y}]W=[AˉB,y​;PB2​,y​] is square and invertible.
  • App. B.2: the perturbed point YΔ=Y−HΔBY_\Delta = Y - H\Delta_BYΔ​=Y−HΔB​ is the unique optimum of DLP[C−Δ,λ]\mathrm{DLP}[C-\Delta,\lambda]DLP[C−Δ,λ] under explicit feasibility conditions.
  • Lemma C.4: the window deviation of the consumption has a sub-Gaussian exponential moment, E[erΔ~i]≤ekφ(t−s)r2\mathbb E[e^{r\tilde\Delta_i}] \le e^{k\varphi(t-s)r^2}E[erΔ~i​]≤ekφ(t−s)r2 for ∣rξmax⁡∣≤1|r\xi_{\max}| \le 1∣rξmax​∣≤1.
  • Theorem 5.3, the general bound for any schedule:
VDLPk−E[RPACk]≤ρ+ρ^k∫01min⁡{1,ρ′F(k,t)} dt.V^k_{\mathrm{DLP}} - \mathbb E[R^k_{\mathrm{PAC}}] \le \rho + \hat\rho k\int_0^1 \min\{1, \rho' F(k,t)\}\,dt.VDLPk​−E[RPACk​]≤ρ+ρ^​k∫01​min{1,ρ′F(k,t)}dt.
  • App. C.6: for mid-point re-solving, G(k,t)≤4(1−t)G(k,t) \le 4(1-t)G(k,t)≤4(1−t) before the last re-solve.
  • Further consequences: Theorem 5.1 (periodic PAC, loss ≤ρ+ρ^kh\le \rho + \hat\rho\sqrt{kh}≤ρ+ρ^​kh​) and Corollary 5.1 (any schedule, loss ≤ρ+ρ^k\le \rho + \hat\rho\sqrt k≤ρ+ρ^​k​).

Significance

The result shows that O(log⁡k)O(\log k)O(logk) re-solves suffice for a loss that does not grow with the size of the system, against an upper bound that is valid for every policy; so PAC is within a constant of the optimal policy, and the DLP bound, the optimal value and PAC are asymptotically equivalent to order O(1)O(1)O(1). Theorem 5.3 makes the trade-off between re-solving frequency and loss explicit for any schedule, and Corollary 5.1 guarantees that re-solving in this form never worsens the static O(k)O(\sqrt k)O(k​) bound.

The result is proved on paper. No part of it is formalized: the mission produces a machine-checked model of a Poisson network with random consumption and a re-solving policy, a statement of LP perturbation theory for nondegenerate programs, and compound-Poisson moment bounds, each reusable for other re-solving and fluid-approximation results in revenue management.

Difficulty

The obvious argument compares PAC with its fluid path and bounds the deviation of the remaining capacity by a martingale estimate over the whole horizon. That gives only O(k)O(\sqrt k)O(k​): deviations late in the horizon cannot be corrected. A constant bound needs re-solving to correct earlier deviations, which in turn needs the re-solved DLP solution to depend linearly and stably on the capacity deviation (the perturbation analysis of App. B) and a hitting-time estimate for when that linear regime fails. The capacity check and the coupling between the re-solved solutions and the random consumption make the process non-Markovian in the obvious state variables.

Formalization scope

Types are Fin NT, offers Fin n, resources Fin m. The model is a structure holding q(j)q(j)q(j), λ\lambdaλ, CCC, the consumption laws DjD_jDj​ (measures on Rm\mathbb R^mRm), ξ\xiξ and the revenue functions. Standing readings (IsValid): λ≥0\lambda \ge 0λ≥0 and C≥0C \ge 0C≥0; each DjD_jDj​ is a probability measure with 0≤Aij≤ξj0 \le A_{ij} \le \xi_j0≤Aij​≤ξj​ almost surely (the page has ξj≥Aij\xi_j \ge A_{ij}ξj​≥Aij​ on p. 317 and Aij<ξjA_{ij} < \xi_jAij​<ξj​ on p. 327; the weaker one is used); revenue functions are measurable, vanish at 000, and are nonnegative and bounded by a common constant (implicit on the page). rˉj=E[rj(Aj)]\bar r_j = \mathbb E[r_j(A^j)]rˉj​=E[rj​(Aj)] is a reading fixed by App. A.1.

E[RPACk]\mathbb E[R^k_{\mathrm{PAC}}]E[RPACk​] is a backward recursion over the windows between re-solves. Each window holds a Poisson(kΛℓ)(k\Lambda\ell)(kΛℓ) number of arrivals with i.i.d. types (superposition and marking), and the expected value is computed arrival by arrival with the capacity check on every resource. PAC is quantified over every DLP selector that returns an optimal solution and is measurable in the capacity, since the page leaves ties open after time 0. All constants are chosen after the instance and before kkk, the selector, the schedule, vvv and hhh. Nondegeneracy follows Bertsimas–Tsitsiklis: every basic feasible solution has exactly nnn active constraints.

Disclosed deviations from the page:

  • Theorem 5.3 adds integrability of vvv in ttt (stated in Lemma C.1) and writes v≤1/ξmax⁡v \le 1/\xi_{\max}v≤1/ξmax​ as v ξmax⁡≤1v\,\xi_{\max} \le 1vξmax​≤1.
  • The C.6 bound G(k,t)≤4(1−t)G(k,t) \le 4(1-t)G(k,t)≤4(1−t) is stated for t<tMkt < t_{M^k}t<tMk​; the page's "for all t∈[0,1]t \in [0,1]t∈[0,1]" is false after the last re-solve.
  • Theorem 5.1's constants are chosen before hhh, which is what (6) requires.
  • The goal is stated as printed, although the printed proof uses v=1/ξmax⁡v = 1/\xi_{\max}v=1/ξmax​, admissible only when ξmax⁡≥1\xi_{\max} \ge 1ξmax​≥1. Measuring every resource in a common smaller unit multiplies AAA, CCC and ξ\xiξ by the same factor and changes neither VDLPkV^k_{\mathrm{DLP}}VDLPk​ nor E[RPACk]\mathbb E[R^k_{\mathrm{PAC}}]E[RPACk​], so this assumption costs no generality.

A formalization in which PAC does not check capacity, or stops checking after a hitting time, earns exactly VDLPV_{\mathrm{DLP}}VDLP​ and would make the goal trivial; the model here applies the check at every arrival. A constant chosen after kkk would also be trivial, since the loss is at most k∑qλqk\sum_q\lambda_qk∑q​λq​ times the revenue bound.

The source is the published Math. Oper. Res. version; printed page = PDF page + 311. Sample-path lemmas (B.2–B.4, C.1–C.3) are not stated. Contributions are welcome on the LP perturbation lemma, the compound-Poisson moment bound and the measurability of the PAC recursion, each of which stands alone.

Selected references

  • S. Jasin, S. Kumar, A Re-Solving Heuristic with Bounded Revenue Loss for Network Revenue Management with Customer Choice, Mathematics of Operations Research 37(2):313–345, 2012. https://doi.org/10.1287/moor.1120.0537
  • G. Gallego, G. van Ryzin, A Multiproduct Dynamic Pricing Problem and Its Applications to Network Yield Management, Operations Research 45(1):24–41, 1997. https://doi.org/10.1287/opre.45.1.24
  • K. Talluri, G. van Ryzin, An Analysis of Bid-Price Controls for Network Revenue Management, Management Science 44(11):1577–1593, 1998. https://doi.org/10.1287/mnsc.44.11.1577
  • W. L. Cooper, Asymptotic Behavior of an Allocation Policy for Revenue Management, Operations Research 50(4):720–727, 2002. https://doi.org/10.1287/opre.50.4.720.2861
  • P. Bumpensanti, H. Wang, A Re-Solving Heuristic with Uniformly Bounded Loss for Network Revenue Management, Management Science 66(7), 2020. https://arxiv.org/abs/1802.06192
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997.
13 thms1 active userReviewed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

AdWords and Generalized On-line Matching II: No Randomized Online Algorithm for b-Matching Has Competitive Ratio Better Than 1 − 1/e, for Every Budget bResearch Paper

Motivation

Search engines sell advertising slots query by query. Each advertiser states a bid per keyword and a daily budget; queries arrive one at a time, and the engine must assign each to an advertiser immediately, without knowing which queries will come later. Mehta, Saberi, Vazirani and Vazirani (J. ACM 2007) called this the adwords problem and gave a deterministic online algorithm whose competitive ratio, the worst-case ratio of its revenue to the best offline revenue, tends to 1−1/e1-1/e1−1/e when bids are small compared to budgets. Section 7 of the same paper shows that this ratio cannot be beaten, even by randomized algorithms and even under the small-bids assumption. That lower bound is the subject of this mission.

Timeline of the special cases:

  • 1990. Karp, Vazirani and Vazirani (STOC 1990) proved that no randomized online algorithm for online bipartite matching (unit bids, unit budgets) has competitive ratio better than 1−1/e1-1/e1−1/e, and that their algorithm RANKING attains it.
  • 2000. Kalyanasundaram and Pruhs (Theoret. Comput. Sci. 2000) studied online b-matching: budgets of bbb units and 0/10/10/1 bids. Their deterministic algorithm BALANCE has competitive ratio tending to 1−1/e1-1/e1−1/e as b→∞b\to\inftyb→∞, and they proved that no deterministic algorithm does better. Whether randomization helps for large bbb was left open (Kalyanasundaram–Pruhs 1998).
  • 2007. Mehta, Saberi, Vazirani and Vazirani (Theorem 9) closed that question: no randomized online algorithm beats 1−1/e1-1/e1−1/e for b-matching, for large bbb.

Setting

An instance of online b-matching has NNN bidders and a sequence of queries t=0,1,…,M−1t = 0,1,\dots,M-1t=0,1,…,M−1. Every bidder has the same integer budget B≥1B\ge1B≥1. Each query ttt comes with the set I(t)I(t)I(t) of bidders that bid 111 on it; the others bid 000.

A deterministic online algorithm aaa processes the queries in order. When query ttt arrives it sees the bid sets I(0),…,I(t)I(0),\dots,I(t)I(0),…,I(t) and nothing later, and it either proposes a bidder or leaves the query unallocated. The proposal succeeds if the bidder bids on the query and has won fewer than BBB queries so far; the bidder then pays 111. The algorithm is not required to be greedy. Its revenue ALGa(I)\mathrm{ALG}_a(I)ALGa​(I) is the number of queries won. A randomized online algorithm AAA is a probability distribution over deterministic online algorithms, fixed before the instance is chosen; its expected revenue is EA[ALG(I)]=∑aA(a) ALGa(I)\mathbb E_A[\mathrm{ALG}(I)]=\sum_a A(a)\,\mathrm{ALG}_a(I)EA​[ALG(I)]=∑a​A(a)ALGa​(I).

An offline allocation τ\tauτ assigns each query to a bidder or to nobody, with full knowledge of III. Its revenue is revB(I,τ)=∑rmin⁡{B, ∣{t:τ(t)=r, r∈I(t)}∣}\mathrm{rev}_B(I,\tau)=\sum_r\min\{B,\ |\{t:\tau(t)=r,\ r\in I(t)\}|\}revB​(I,τ)=∑r​min{B, ∣{t:τ(t)=r, r∈I(t)}∣}: each bidder pays for the queries it bids on, up to its budget.

The permuted round instances of the proof are as follows. For a permutation π\piπ of the bidders, the instance IπI_\piIπ​ consists of NNN rounds Q1,…,QNQ_1,\dots,Q_NQ1​,…,QN​ of BBB queries each, and bidders π(i),π(i+1),…,π(N)\pi(i),\pi(i+1),\dots,\pi(N)π(i),π(i+1),…,π(N) bid on the queries of round QiQ_iQi​. The distribution D\mathcal DD is the uniform distribution over these N!N!N! instances, and Eπ\mathbb E_\piEπ​ denotes the average over it. The paper writes this instance with budget 111, bids ϵ\epsilonϵ and 1/ϵ1/\epsilon1/ϵ queries per round; the Lean development uses the same instance scaled by B=1/ϵB=1/\epsilonB=1/ϵ.

Formalization targets

Goal: Theorem 9

For every δ>0\delta>0δ>0 there is N0N_0N0​ such that for all N≥N0N\ge N_0N≥N0​, all B≥1B\ge1B≥1 and every randomized online algorithm AAA for NNN bidders and NBNBNB queries, there are an instance III and an allocation τ\tauτ with

revB(I,τ)=NBandEA[ALG(I)]≤(1−1e+δ)NB.\mathrm{rev}_B(I,\tau)=NB\qquad\text{and}\qquad \mathbb E_A[\mathrm{ALG}(I)]\le\Big(1-\frac1e+\delta\Big)NB.revB​(I,τ)=NBandEA​[ALG(I)]≤(1−e1​+δ)NB.

The constant 1−1/e1-1/e1−1/e is the paper's. The slack δ\deltaδ is not a weakening of the paper's claim: a competitive ratio better than 1−1/e1-1/e1−1/e would mean a ratio 1−1/e+δ′1-1/e+\delta'1−1/e+δ′ for some δ′>0\delta'>0δ′>0 on every instance. The threshold N0N_0N0​ is independent of the budget, which is how "for large bbb" is rendered.

Milestones (proof of Theorem 9, p. 15)

  1. Yao step. If every deterministic algorithm aaa has Eπ[ALGa(Iπ)]≤V\mathbb E_\pi[\mathrm{ALG}_a(I_\pi)]\le VEπ​[ALGa​(Iπ​)]≤V, then every randomized AAA has some π\piπ with EA[ALG(Iπ)]≤V\mathbb E_A[\mathrm{ALG}(I_\pi)]\le VEA​[ALG(Iπ​)]≤V.
  2. The optimum. revB(Iπ,τπ)=NB\mathrm{rev}_B(I_\pi,\tau_\pi)=NBrevB​(Iπ​,τπ​)=NB for the allocation τπ:Qi↦π(i)\tau_\pi:Q_i\mapsto\pi(i)τπ​:Qi​↦π(i), and no allocation earns more.
  3. The display. For a deterministic aaa, with qij(π)q_{ij}(\pi)qij​(π) the fraction of QiQ_iQi​ won by π(j)\pi(j)π(j),
Eπ[qij]≤1N−i+1 (j≥i),Eπ[qij]=0 (j<i).\mathbb E_\pi[q_{ij}]\le\frac1{N-i+1}\ (j\ge i),\qquad \mathbb E_\pi[q_{ij}]=0\ (j<i).Eπ​[qij​]≤N−i+11​ (j≥i),Eπ​[qij​]=0 (j<i).
  1. Per-bidder bound. Eπ[La(π(j))/B]≤min⁡{1,∑i=1j1N−i+1}\mathbb E_\pi\big[L^a(\pi(j))/B\big]\le\min\{1,\sum_{i=1}^{j}\frac1{N-i+1}\}Eπ​[La(π(j))/B]≤min{1,∑i=1j​N−i+11​}, where La(r)L^a(r)La(r) is the number of queries bidder rrr wins.
  2. Summed bound. ∑j=1Nmin⁡{1,∑i=1j1N−i+1}≤(1−1/e+δ)N\sum_{j=1}^{N}\min\{1,\sum_{i=1}^{j}\frac1{N-i+1}\}\le(1-1/e+\delta)N∑j=1N​min{1,∑i=1j​N−i+11​}≤(1−1/e+δ)N for N≥N0(δ)N\ge N_0(\delta)N≥N0​(δ).
  3. Average revenue. Eπ[ALGa(Iπ)]≤(1−1/e+δ)NB\mathbb E_\pi[\mathrm{ALG}_a(I_\pi)]\le(1-1/e+\delta)NBEπ​[ALGa​(Iπ​)]≤(1−1/e+δ)NB for N≥N0(δ)N\ge N_0(\delta)N≥N0​(δ), every B≥1B\ge1B≥1 and every deterministic aaa.

Significance

The result. Theorem 9 shows that the 1−1/e1-1/e1−1/e ratio attained by BALANCE for large budgets, and by the paper's tradeoff algorithm for adwords with small bids, is optimal among all online algorithms, randomized or not. Since b-matching is a special case of adwords with small bids, the same bound applies to adwords. It also answers the question of Kalyanasundaram and Pruhs on whether randomization helps for b-matching. With B=1B=1B=1 it contains the bipartite matching lower bound of Karp, Vazirani and Vazirani.

Formalizing it. The result has been proved since 2007; to our knowledge it has no machine-checked proof. The b = 1 case is posed on the platform as KVVMatching.UpperBound.theorem_2 (Karp–Vazirani–Vazirani), with columns arriving in reverse index order and an analysis of the algorithm RANDOM; this mission poses the budget-uniform statement in its own model. A formalization yields a reusable model of online algorithms with budgets (histories that hide the future, randomized algorithms as mixtures of deterministic rules) and a formal instance of Yao's principle for online problems.

Difficulty

The bound must hold for every deterministic online algorithm, including ones that are not greedy, waste proposals, or base each decision on the entire revealed history. A tempting argument fixes the algorithm's behaviour per round and treats it as oblivious to earlier rounds; that only covers a subclass. The history of the permuted instance reveals, before round iii, exactly which bidders dropped out in earlier rounds, so the information available to the algorithm grows round by round, and the bound on Eπ[qij]\mathbb E_\pi[q_{ij}]Eπ​[qij​] has to hold conditionally on everything revealed. Budgets interact across rounds: whether a proposal in round iii succeeds depends on wins in earlier rounds. Finally, the printed "at most N(1−1/e)N(1-1/e)N(1−1/e)" is false at every finite NNN: the sum in milestone 5 exceeds N(1−1/e)N(1-1/e)N(1−1/e) by a bounded amount (about 0.3160.3160.316 for large NNN), so the analytic step is genuinely asymptotic.

Formalization scope

  • Representation. Bidders are Fin N and query positions Fin M, both zero-based. An instance is Fin M → Finset (Fin N). A history is Fin M → Option (Finset (Fin N)) with unrevealed entries none. A deterministic algorithm is Fin M → History N M → Option (Fin N), a randomized one is a PMF over deterministic algorithms, and expected revenue is a finite sum.
  • Conventions. Budgets are a common integer BBB and bids are 0/10/10/1; the paper's budget-111, bid-ϵ\epsilonϵ instance is the same instance scaled by B=1/ϵB=1/\epsilonB=1/ϵ. A query in position ttt belongs to round ⌊t/B⌋+1\lfloor t/B\rfloor+1⌊t/B⌋+1. Rounds iii and positions jjj in milestones 3–4 are 1-based, as in the paper. "Bidder jjj" in the proof means the bidder π(j)\pi(j)π(j) in position jjj of the permutation. The j<ij<ij<i case of the display is an equality. The comparator in the goal is an explicit allocation of revenue NBNBNB, which is the maximum possible.
  • Ruled out. The algorithm sees only the revealed history, never III or π\piπ, and the randomized algorithm is chosen before the instance. An algorithm that could see the instance would trivially earn NBNBNB, and choosing the instance first would make the goal the averaging statement of milestone 6, not Theorem 9.
  • Infrastructure. Needed: finite sums over permutations, the exchange of the average over π\piπ and over the algorithm, invariance of a run under permutations that fix the revealed information, and estimates of harmonic sums HN−HN−jH_N-H_{N-j}HN​−HN−j​ against log⁡\loglog. The online-algorithm model and the Yao step are reusable for other online lower bounds. Contributions to any milestone are welcome; milestone 5 is pure real analysis and independent of the model.

Selected references

  • A. Mehta, A. Saberi, U. Vazirani, V. Vazirani, AdWords and generalized on-line matching, J. ACM 54(5), 2007. https://doi.org/10.1145/1284320.1284321
  • R. M. Karp, U. V. Vazirani, V. V. Vazirani, An optimal algorithm for on-line bipartite matching, STOC 1990. https://doi.org/10.1145/100216.100262
  • B. Kalyanasundaram, K. R. Pruhs, An optimal deterministic algorithm for online b-matching, Theoret. Comput. Sci. 233, 2000. https://doi.org/10.1016/S0304-3975(99)00140-1
  • A. C.-C. Yao, Probabilistic computations: toward a unified measure of complexity, FOCS 1977. https://doi.org/10.1109/SFCS.1977.24
8 thms1 active userReviewed
Analysis·Captain: mikedeng1

Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs? 4: The Correlated Gaussian Orthant Probability Satisfies Λρ(μ) ≤ (1 + ρ)·φ(t)/t·N(t√((1 − ρ)/(1 + ρ)))Research Paper

Motivation

Khot, Kindler, Mossel and O'Donnell, Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs? (SIAM J. Comput. 37(1), 2007), prove that, assuming the Unique Games Conjecture, the Goemans–Williamson approximation ratio for MAX-CUT is optimal, and they extend the method to MAX-q-CUT and to Γ-MAX-2LIN(q). For the q-ary problems the key analytic input is the theorem of Mossel, O'Donnell and Oleszkiewicz (arXiv:math/0503503), the MOO theorem. It bounds the noise stability of a low-influence function with mean µ by a Gaussian quantity, the correlated Gaussian orthant probability Λ_ρ(µ): the probability that two ρ-correlated standard Gaussians both exceed the threshold t at which a single one has tail mass µ.

The hardness bounds of the paper for Γ-MAX-2LIN(q) are stated in terms of Λ_ρ(1/q). They are explicit only after Λ_ρ(µ) is estimated. Proposition 6.1 of the paper gives such an estimate in closed form, by slightly improving a bound from the proof of Lemma 11.1 of de Klerk, Pasechnik and Warners (Approximate graph colouring and MAX-k-CUT algorithms based on the theta function, J. Combin. Optim., 2004). The same quantity at µ = 1/2 is Sheppard's orthant probability (Phil. Trans. R. Soc. A 192, 1899), the source of the arccos formulas used throughout the MAX-CUT part of the paper.

This mission formalizes Proposition 6.1 and the steps of its printed proof.

Setting

Let φ be the standard Gaussian density and N the Gaussian tail probability function:

ϕ(x)=12πe−x2/2,N(x)=∫x∞ϕ(s) ds.\phi(x)=\frac{1}{\sqrt{2\pi}}e^{-x^2/2},\qquad N(x)=\int_x^\infty \phi(s)\,ds .ϕ(x)=2π​1​e−x2/2,N(x)=∫x∞​ϕ(s)ds.

So N(x) = Pr[X ≥ x] for a standard Gaussian X. N is strictly decreasing from 1 to 0, and N(0) = 1/2.

Let X and Y be independent standard Gaussian random variables. For ρ ∈ [0, 1] put

X′=ρX+1−ρ2 Y.X'=\rho X+\sqrt{1-\rho^2}\,Y .X′=ρX+1−ρ2​Y.

Then (X, X′) is a centred normal pair with unit variances and covariance ρ, the pair of Definition 8 of the paper. For 0 < µ < 1 let t be the unique real number with Pr[X ≥ t] = µ, and define

Λρ(μ)=Pr⁡[X≥t and X′≥t].\Lambda_\rho(\mu)=\Pr[X\ge t\ \text{and}\ X'\ge t].Λρ​(μ)=Pr[X≥t and X′≥t].

The threshold t is positive exactly when µ < 1/2. Λ_ρ(µ) is the noise stability, in Gaussian space, of the indicator of a half-line of measure µ.

The proof uses two exponents. For u, v ∈ ℝ, with ρ < 1 and t > 0,

g(u,v)=u+v1+ρ+(u−v)2+2(1−ρ)uv2(1−ρ2)t2,h(u,v)=u+v1+ρ+(u−v)22(1−ρ2)t2.g(u,v)=\frac{u+v}{1+\rho}+\frac{(u-v)^2+2(1-\rho)uv}{2(1-\rho^2)t^2},\qquad h(u,v)=\frac{u+v}{1+\rho}+\frac{(u-v)^2}{2(1-\rho^2)t^2}.g(u,v)=1+ρu+v​+2(1−ρ2)t2(u−v)2+2(1−ρ)uv​,h(u,v)=1+ρu+v​+2(1−ρ2)t2(u−v)2​.

In Lean these are phi, tailN, orthantProb ρ t, Lambda ρ μ, gExp ρ t u v and hExp ρ t u v in the namespace OptInapprox.Orthant.

Formalization targets

Goal: Proposition 6.1 (p. 14)

For any 0 ≤ µ < 1/2, let t > 0 be the number with N(t) = µ. Then for all 0 ≤ ρ ≤ 1,

Λρ(μ) ≤ (1+ρ)⋅ϕ(t)t⋅N ⁣(t1−ρ1+ρ).(4)\Lambda_\rho(\mu)\ \le\ (1+\rho)\cdot\frac{\phi(t)}{t}\cdot N\!\Big(t\sqrt{\tfrac{1-\rho}{1+\rho}}\Big).\tag{4}Λρ​(μ) ≤ (1+ρ)⋅tϕ(t)​⋅N(t1+ρ1−ρ​​).(4)

The endpoint ρ = 1 is part of the goal. There X′ = X, Λ₁(µ) = µ, and (4) becomes the classical Mills-ratio inequality N(t) ≤ φ(t)/t.

Milestones (proof of Proposition 6.1, pp. 30–31)

  1. (18). For 0 ≤ ρ < 1, t > 0 and µ = N(t),
Λρ(μ)=12π1−ρ2⋅t2exp⁡(−t21+ρ)∫0∞ ⁣ ⁣∫0∞e−g(u,v) du dv.\Lambda_\rho(\mu)=\frac{1}{2\pi\sqrt{1-\rho^2}\cdot t^2}\exp\Big(-\frac{t^2}{1+\rho}\Big)\int_0^\infty\!\!\int_0^\infty e^{-g(u,v)}\,du\,dv .Λρ​(μ)=2π1−ρ2​⋅t21​exp(−1+ρt2​)∫0∞​∫0∞​e−g(u,v)dudv.
  1. g ≥ h on u, v ≥ 0.
  2. (19)–(20).
∫0∞ ⁣ ⁣∫0∞e−g≤∫0∞ ⁣ ⁣∫0∞e−h=2π(1+ρ)1−ρ2⋅t⋅exp⁡(1−ρ1+ρ⋅t22)⋅N(t1−ρ1+ρ).\int_0^\infty\!\!\int_0^\infty e^{-g}\le\int_0^\infty\!\!\int_0^\infty e^{-h}=\sqrt{2\pi}(1+\rho)\sqrt{1-\rho^2}\cdot t\cdot\exp\Big(\frac{1-\rho}{1+\rho}\cdot\frac{t^2}{2}\Big)\cdot N\Big(t\sqrt{\tfrac{1-\rho}{1+\rho}}\Big).∫0∞​∫0∞​e−g≤∫0∞​∫0∞​e−h=2π​(1+ρ)1−ρ2​⋅t⋅exp(1+ρ1−ρ​⋅2t2​)⋅N(t1+ρ1−ρ​​).
  1. Lower bound (side note in the proof of Corollary 10, p. 31):
μ⋅N(t1−ρ1+ρ)≤Λρ(μ).\mu\cdot N\Big(t\sqrt{\tfrac{1-\rho}{1+\rho}}\Big)\le\Lambda_\rho(\mu).μ⋅N(t1+ρ1−ρ​​)≤Λρ​(μ).

Significance

Proposition 6.1 makes the MOO theorem quantitative for thresholds. With the lower bound of milestone 4 it determines Λ_ρ(µ) up to the factor 1 + ρ, and up to 1 + o(1) as µ → 0, since φ(t)/t ∼ N(t) as t → ∞ (Corollary 10, part 1). Through Corollary 10 it yields the asymptotics of qΛ_ρ(1/q) used in the paper's hardness results for MAX-q-CUT and Γ-MAX-2LIN(q). These quantities also appear in later work on q-ary noise stability and on the approximability of 2-CSPs.

The proposition is proved in the paper; nothing here is open. Mathlib (at the pinned revision) contains no proof of it, of the bivariate-normal integral representation (18), or of the Mills-ratio inequality N(t) ≤ φ(t)/t. On the platform, Mills' inequality appears only as an open statement in the two-sided form Pr[|X| > z] ≤ √(2/π)·e^{−z²/2}/z (KLTNuclear.Lasso.gaussian_tail), and there is no item for orthant probabilities. A complete development provides:

  • the substitution x = t + u/t, y = t + v/t in the bivariate normal density;
  • a closed-form quadrant integral after the rotation r = u + v, s = u − v;
  • the identification of a probability under a product Gaussian measure with an explicit double integral.

Each of these is reusable for Gaussian tail and orthant estimates.

Difficulty

The inequality itself is elementary once (18) and (20) are available. The work lies in the two integral identities and in their measure-theoretic glue.

For (18), the orthant probability is defined as a measure of a set under the product of two one-dimensional Gaussian laws. Writing it as a double integral of the bivariate density is a linear change of variables with Jacobian √(1 − ρ²). The shift and scaling by t then has Jacobian 1/t², and the quadratic form has to be expanded exactly.

For (20), the region u, v ≥ 0 becomes the wedge |s| ≤ r after the rotation, so the inner integral is a truncated Gaussian integral rather than a full one. The closed form appears only after an integration by parts in r, or an equivalent completion of the square.

The endpoint ρ = 1 is not covered by the printed argument, because (18) divides by √(1 − ρ²). It needs Mills' inequality separately. A proof that only treats ρ < 1 does not close the goal.

Formalization scope

  • Gaussian law. Λ_ρ(µ) is a genuine probability. stdGaussPair is the product of two copies of Mathlib's gaussianReal 0 1 on ℝ × ℝ. orthantProb ρ t is the real-valued measure of {X ≥ t, ρX + √(1 − ρ²)Y ≥ t}, which is the representation the paper itself uses on p. 31.
  • Choice of t. Lambda ρ μ chooses a t with Pr[X ≥ t] = µ, where the probability is taken under gaussianReal 0 1. Such a t is unique, so the choice does not matter. For µ ∉ (0, 1) no such t exists and the value is a placeholder 0 that no statement uses.
  • Hypotheses of the statements. Every theorem takes t > 0 and N(t) = µ as hypotheses, as Proposition 6.1 does; the redundant 0 ≤ µ < 1/2 is kept as printed.
  • Functions. φ is written out explicitly and N is the Bochner integral of φ over (x, ∞).
  • Integrals. The double integrals of (18)–(20) are iterated integrals over (0, ∞), inner variable u, as printed. Milestone 3 also asserts that e^{−h} is integrable on the quadrant, so (19) cannot hold through a junk zero integral.
  • Range of ρ. The goal and milestone 4 take 0 ≤ ρ ≤ 1, as on the page. Milestones 1–3 take 0 ≤ ρ < 1, because their constants divide by √(1 − ρ²) or 1 − ρ², and the printed proof uses them only there. This is the only hypothesis added relative to the page.
  • Trivializing formalizations, ruled out.
    • Defining Λ_ρ(µ) by the right-hand side of (18) would make milestone 1 a tautology and the goal a calculus exercise about a formula unrelated to Gaussians. The definition here is a measure of a set.
    • Allowing t = 0 would put the junk value φ(0)/0 = 0 on the right of (4). The statements require t > 0.

The two remarks printed right after Proposition 6.1 (on Λ_ρ(1/2) and on removing the factor 1 + ρ) are not part of this mission.

Contributions are welcome on all four milestones, on the case ρ = 1 of the goal (Mills' inequality), and on general lemmas: N as Pr[X ≥ x], monotonicity and positivity of N, and the law of (X, ρX + √(1 − ρ²)Y) as a bivariate normal.

Selected references

  • S. Khot, G. Kindler, E. Mossel, R. O'Donnell, Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs?, SIAM J. Comput. 37(1), 2007 (authors' version of February 7, 2007). https://doi.org/10.1137/S0097539705447372
  • E. Mossel, R. O'Donnell, K. Oleszkiewicz, Noise stability of functions with low influences: invariance and optimality, FOCS 2005; Annals of Mathematics 171, 2010. https://arxiv.org/abs/math/0503503
  • E. de Klerk, D. Pasechnik, J. Warners, Approximate graph colouring and MAX-k-CUT algorithms based on the theta function, Journal of Combinatorial Optimization 8, 2004 (Lemma 11.1).
  • W. F. Sheppard, On the application of the theory of error to cases of normal distribution and normal correlation, Phil. Trans. R. Soc. London A 192, 101–168, 1899. https://doi.org/10.1098/rsta.1899.0003
6 thms1 active userReviewed
Convex OptimizationMachine LearningOptimization·Captain: mikedeng1

Sample Size Selection in Optimization Methods for Machine Learning 1: With Batch Sizes n_k ≥ a^k, Dynamic Batch Steepest Descent Converges Linearly in Expectation, E[J(w_k) − J(w*)] ≤ Cρ^kResearch Paper

Motivation

Training a model in machine learning means minimizing an expected loss over a data distribution, using a finite sample from it. Two families of methods dominate. Stochastic gradient methods step along the gradient of the loss at one data point: each step is cheap, but the noise forces small steps and many sequential iterations. Batch methods average the gradient over a large set of points: each step is accurate and parallelizes well, but costs a pass over the data. Bottou and Bousquet (The tradeoffs of large scale learning, NIPS 2007) compared the two by the total work needed to reach accuracy ϵ\epsilonϵ and concluded that stochastic gradient descent is preferable in large-scale learning.

Byrd, Chin, Nocedal and Wu (Sample size selection in optimization methods for machine learning, Math. Program. 2012) analyse a third option: a dynamic batch method, which takes gradient steps on mini-batches whose size grows over the run. A small batch makes early progress cheap; a large batch later makes the steps accurate. Their Theorem 4.2 shows that when the batch size grows geometrically, steepest descent with a fixed step converges linearly in expectation, and their Corollary 4.3 derives from it a total work bound of the same order as stochastic gradient descent. The analysis underlies a line of work on adaptive sampling and variance-controlled batch methods (for example Friedlander and Schmidt, Hybrid deterministic-stochastic methods for data fitting, SIAM J. Sci. Comput. 2012; Bottou, Curtis and Nocedal, Optimization methods for large-scale machine learning, SIAM Review 2018, §5.2).

Setting

Let (Z,P)(Z,P)(Z,P) be a probability space of data points zzz; in the paper z=(x,y)z=(x,y)z=(x,y) is an input–output pair with distribution P(x,y)P(x,y)P(x,y). The parameter is w∈Rmw\in\mathbb R^mw∈Rm (mmm is the number of variables). A per-sample loss ℓ(w;z)\ell(w;z)ℓ(w;z) is given with gradient ∇ℓ(w;z)\nabla\ell(w;z)∇ℓ(w;z) in www, and the objective is the expected loss (2.1)

J(w)=∫ℓ(w;z) dP(z).J(w)=\int\ell(w;z)\,dP(z).J(w)=∫ℓ(w;z)dP(z).

The gradient of the objective is the expected per-sample gradient, ∇J(w)=∫∇ℓ(w;z) dP(z)\nabla J(w)=\int\nabla\ell(w;z)\,dP(z)∇J(w)=∫∇ℓ(w;z)dP(z).

Uniform convexity (4.2): JJJ is twice continuously differentiable and there are constants 0<λ<L0<\lambda<L0<λ<L with

λ∥d∥22≤dT∇2J(w) d≤L∥d∥22for all w,d.\lambda\|d\|_2^2\le d^T\nabla^2J(w)\,d\le L\|d\|_2^2\qquad\text{for all } w,d .λ∥d∥22​≤dT∇2J(w)d≤L∥d∥22​for all w,d.

Then JJJ has a unique minimizer w∗w^*w∗.

For a random vector X∈RmX\in\mathbb R^mX∈Rm, ∥Var(X)∥1=E∥X−EX∥22\|\mathrm{Var}(X)\|_1=\mathbb E\|X-\mathbb EX\|_2^2∥Var(X)∥1​=E∥X−EX∥22​ is the sum of its componentwise variances. The variance bound (4.22) asks for a constant ω\omegaω with

∥Var(∇ℓ(w;⋅))∥1≤ωfor all w.\|\mathrm{Var}(\nabla\ell(w;\cdot))\|_1\le\omega\qquad\text{for all } w .∥Var(∇ℓ(w;⋅))∥1​≤ωfor all w.

The algorithm. Fix sample sizes nk≥1n_k\ge1nk​≥1 and a starting point w0w_0w0​. At iteration kkk draw a batch SkS_kSk​ of nkn_knk​ points, independently with law PPP and independently of earlier batches, form the batch gradient (4.19)

gk=1nk∑i∈Sk∇ℓ(wk;i),g_k=\frac1{n_k}\sum_{i\in S_k}\nabla\ell(w_k;i),gk​=nk​1​i∈Sk​∑​∇ℓ(wk​;i),

and take the dynamic batch steepest descent step (4.24)

wk+1=wk−1L gk.w_{k+1}=w_k-\frac1L\,g_k .wk+1​=wk​−L1​gk​.

The iterates wkw_kwk​ are random, and expectations below are over all batches.

Formalization targets

Goal: Theorem 4.2

If nk≥akn_k\ge a^knk​≥ak for all kkk, for some a>1a>1a>1, and (4.22) holds, then

E[J(wk)−J(w∗)]≤Cρkfor all k,ρ=max⁡{1−λ/(4L), 1/a}<1,C=max⁡{J(w0)−J(w∗), 2ω/λ}.\mathbb E[J(w_k)-J(w^*)]\le C\rho^k\quad\text{for all }k,\qquad \rho=\max\{1-\lambda/(4L),\,1/a\}<1,\quad C=\max\{J(w_0)-J(w^*),\,2\omega/\lambda\}.E[J(wk​)−J(w∗)]≤Cρkfor all k,ρ=max{1−λ/(4L),1/a}<1,C=max{J(w0​)−J(w∗),2ω/λ}.

The constants are the paper's. The goal also asserts that J(wk)J(w_k)J(wk​) is integrable for every kkk.

Milestones, in the order the proof uses them

  1. (4.5), p. 8: ∇J(w)T∇J(w)≥λ[J(w)−J(w∗)]\nabla J(w)^T\nabla J(w)\ge\lambda[J(w)-J(w^*)]∇J(w)T∇J(w)≥λ[J(w)−J(w∗)] for every www.
  2. Taylor bound, p. 11: J(w−1Lg)≤J(w)−1L∇J(w)Tg+12L∥g∥2J(w-\frac1Lg)\le J(w)-\frac1L\nabla J(w)^Tg+\frac1{2L}\|g\|^2J(w−L1​g)≤J(w)−L1​∇J(w)Tg+2L1​∥g∥2 for every www and ggg.
  3. (4.25), p. 11: at a fixed point www, with ggg the batch gradient of nnn i.i.d. draws,
E[J(w−1Lg)]≤J(w)−1L∥∇J(w)∥2+12LE∥g∥2,E∥g∥2=∥∇J(w)∥2+∥Var(g)∥1.\mathbb E[J(w-\tfrac1Lg)]\le J(w)-\tfrac1L\|\nabla J(w)\|^2+\tfrac1{2L}\mathbb E\|g\|^2,\qquad \mathbb E\|g\|^2=\|\nabla J(w)\|^2+\|\mathrm{Var}(g)\|_1 .E[J(w−L1​g)]≤J(w)−L1​∥∇J(w)∥2+2L1​E∥g∥2,E∥g∥2=∥∇J(w)∥2+∥Var(g)∥1​.
  1. Variance of the batch gradient, p. 12: ∥Var(g)∥1≤∥Var(∇ℓ(w;⋅))∥1/n\|\mathrm{Var}(g)\|_1\le\|\mathrm{Var}(\nabla\ell(w;\cdot))\|_1/n∥Var(g)∥1​≤∥Var(∇ℓ(w;⋅))∥1​/n.
  2. (4.26), p. 12: E[J(w−1Lg)]≤J(w)−12L∥∇J(w)∥2+12Ln∥Var(∇ℓ(w;⋅))∥1\mathbb E[J(w-\tfrac1Lg)]\le J(w)-\tfrac1{2L}\|\nabla J(w)\|^2+\tfrac1{2Ln}\|\mathrm{Var}(\nabla\ell(w;\cdot))\|_1E[J(w−L1​g)]≤J(w)−2L1​∥∇J(w)∥2+2Ln1​∥Var(∇ℓ(w;⋅))∥1​.
  3. (4.27), p. 12: E[J(w−1Lg)−J(w∗)]≤(1−λ2L)(J(w)−J(w∗))+ω2Ln\mathbb E[J(w-\tfrac1Lg)-J(w^*)]\le(1-\tfrac{\lambda}{2L})(J(w)-J(w^*))+\tfrac{\omega}{2Ln}E[J(w−L1​g)−J(w∗)]≤(1−2Lλ​)(J(w)−J(w∗))+2Lnω​.

Milestones 3–6 are the paper's conditional expectations given wkw_kwk​, stated at a fixed point www with the batch drawn afresh.

Significance

Theorem 4.2 is the convergence guarantee of the dynamic sampling strategy: it says that the noise of a mini-batch gradient does not destroy the linear rate of steepest descent, provided the batch grows geometrically. The rate ρ\rhoρ makes the trade-off explicit: the optimization contracts by 1−λ/(4L)1-\lambda/(4L)1−λ/(4L) per step, the noise by 1/a1/a1/a, and the slower of the two governs. From it the paper's Corollary 4.3 bounds the total number of sample-gradient evaluations to reach E[J(wk)−J(w∗)]≤ϵ\mathbb E[J(w_k)-J(w^*)]\le\epsilonE[J(wk​)−J(w∗)]≤ϵ by O(L/(λϵ))O(L/(\lambda\epsilon))O(L/(λϵ)), which places dynamic batch methods on the same footing as stochastic gradient descent in the Bottou–Bousquet comparison, while keeping the parallelism of batch methods.

The result is proved in the paper; to our knowledge no machine-checked proof exists. A formalization produces a reusable account of the one-iteration analysis of a mini-batch gradient step (descent lemma, variance of an i.i.d. sample mean of random vectors, conditional expectation over a fresh batch), and of the passage from a conditional one-step recursion to an unconditional bound over a run driven by an infinite i.i.d. array. Corollary 4.3 is not part of this mission: it involves O(⋅)O(\cdot)O(⋅) bounds, a cost model for gradient evaluations and an iteration count treated as a real number.

Difficulty

The arithmetic of the induction on p. 12 is short. The difficulty is in making the probability rigorous. The iterate wkw_kwk​ is random, and the paper's one-step bound (4.27) is a conditional expectation given wkw_kwk​, with J(wk)J(w_k)J(wk​) on the right-hand side. Turning it into an unconditional recursion requires that the batch of iteration kkk be independent of wkw_kwk​, that wkw_kwk​ be a measurable function of the earlier batches, and that J(wk)J(w_k)J(wk​) and ∥gk∥2\|g_k\|^2∥gk​∥2 be integrable at every step, none of which is automatic for a run driven by an infinite array of draws. A naive formalization that treats wkw_kwk​ as a fixed point, or gkg_kgk​ as an abstract random vector with a postulated variance bound, skips exactly this content.

The variance identity for a sample mean of random vectors in Rm\mathbb R^mRm and the bound ∥∇J(w)∥≤L∥w−w∗∥\|\nabla J(w)\|\le L\|w-w^*\|∥∇J(w)∥≤L∥w−w∗∥ from (4.2) are standard but not packaged in this form in Mathlib.

Formalization scope

  • The space is EuclideanSpace ℝ (Fin m). The paper's λ\lambdaλ is written lam (λ is a Lean keyword). (4.2) is ContDiff ℝ 2 J, 0 < lam < L, and the two-sided bound on fderiv ℝ (fderiv ℝ J) w d d.
  • JJJ is defined as the Bochner integral ∫ℓ(w;z) dP(z)\int\ell(w;z)\,dP(z)∫ℓ(w;z)dP(z) for a general per-sample loss ℓ\ellℓ; the paper's linear predictor f(w;x)=wTxf(w;x)=w^Txf(w;x)=wTx and convex loss lll are not used by the theorem and are not assumed. The model assumes: ℓ(w;⋅)\ell(w;\cdot)ℓ(w;⋅) integrable; ∇ℓ(w;z)\nabla\ell(w;z)∇ℓ(w;z) the gradient of ℓ(⋅;z)\ell(\cdot;z)ℓ(⋅;z) at www; (w,z)↦∇ℓ(w;z)(w,z)\mapsto\nabla\ell(w;z)(w,z)↦∇ℓ(w;z) jointly measurable; ∇ℓ(w;⋅)\nabla\ell(w;\cdot)∇ℓ(w;⋅) square-integrable; and ∇J(w)=∫∇ℓ(w;z) dP(z)\nabla J(w)=\int\nabla\ell(w;z)\,dP(z)∇J(w)=∫∇ℓ(w;z)dP(z) (differentiation under the integral, which the paper uses without proof).
  • Sampling with replacement. The paper's (3.5) is sampling without replacement from NNN points; it takes N→∞N\to\inftyN→∞ on p. 5, which "also corresponds to the case of sampling with replacement". The formalization draws every point i.i.d. from PPP: draw iii of iteration kkk is ξk,i\xi_{k,i}ξk,i​ and the law of the whole array is Measure.infinitePi over N×N\mathbb N\times\mathbb NN×N. The finite-population factor (N−nk)/(N−1)(N-n_k)/(N-1)(N−nk​)/(N−1) is not modelled.
  • w∗w^*w∗ is a given minimizer of JJJ; nkn_knk​ are natural numbers with ak≤nka^k\le n_kak≤nk​ (real powers of a real a>1a>1a>1); ω\omegaω is a real number.
  • The goal asserts integrability of J(wk)J(w_k)J(wk​) together with the bound, so the inequality cannot be met by the Bochner integral's value 000 on a non-integrable function. The batch gradient is the mean over nkn_knk​ draws at the current iterate, and wkw_kwk​ is the random run: a goal with an abstract random gkg_kgk​ satisfying a postulated variance bound, or with wkw_kwk​ a deterministic sequence, would not be this theorem.
  • Welcome contributions: the variance of an i.i.d. mean of Rm\mathbb R^mRm-valued random vectors; the descent lemma and gradient-dominance inequality from Hessian bounds; measurability and independence lemmas for processes driven by Measure.infinitePi. All three are reusable beyond this mission.

Selected references

  • R. H. Byrd, G. M. Chin, J. Nocedal, Y. Wu, Sample size selection in optimization methods for machine learning, Mathematical Programming 134 (2012) 127–155. https://doi.org/10.1007/s10107-012-0572-5
  • L. Bottou, O. Bousquet, The tradeoffs of large scale learning, NIPS 2007. https://papers.nips.cc/paper/3323-the-tradeoffs-of-large-scale-learning
  • M. P. Friedlander, M. Schmidt, Hybrid deterministic-stochastic methods for data fitting, SIAM J. Sci. Comput. 34 (2012) A1380–A1405. https://doi.org/10.1137/110830629
  • L. Bottou, F. E. Curtis, J. Nocedal, Optimization methods for large-scale machine learning, SIAM Review 60 (2018) 223–311. https://doi.org/10.1137/16M1080173
10 thms1 active userReviewed
Complexity TheoryTheoretical Computer Science·Captain: mikedeng1

On the (Im)possibility of Obfuscating Programs 3: A Random Injection G : [K] → [L], L ≥ K², Fools Every K^δ-Query Distinguisher with Oracle G up to 1/K^δ, Except with Probability 2^(−K^δ)Research Paper

Motivation

Barak, Goldreich, Impagliazzo, Rudich, Sahai, Vadhan and Yang proved that general-purpose program obfuscation in the virtual black-box sense is impossible (J. ACM 59(2), 2012). A natural question is whether the impossibility proof relativizes, that is, whether it survives when every party gets access to the same oracle. Proposition 4.14 of the paper shows that it does not: there is an oracle relative to which efficient circuit obfuscators exist. This is evidence that the impossibility results are not formal consequences of black-box reasoning, and a further example that relativization is a poor guide to what can be proved.

The construction obfuscates a circuit CCC by publishing a random image Ok(C,r)O_k(C,r)Ok​(C,r), and its security comes down to one information-theoretic statement, Claim 4.14.2, restated and proved in Appendix B as Lemma B.1. A random injective function is a pseudorandom generator even against distinguishers that may query the function itself. The proof is a counting (compression) argument in the style of Gennaro and Trevisan's proof that a random permutation is one-way against nonuniform adversaries (FOCS 2000). Arguments of this kind recur in lower bounds for black-box constructions and in the theory of random oracles.

Setting

Fix natural numbers KKK and LLL and finite sets [K][K][K], [L][L][L] of these sizes. A distinguisher DDD receives an element y∈[L]y\in[L]y∈[L] and may ask an oracle G:[K]→[L]G:[K]\to[L]G:[K]→[L] for values G(z)G(z)G(z), choosing each query point adaptively from the input and the answers so far; finally it outputs a bit. Formally DDD is a family (Dy)y∈[L](D_y)_{y\in[L]}(Dy​)y∈[L]​ of query trees: a leaf carries an output bit, and an internal node carries a query point z∈[K]z\in[K]z∈[K] and one subtree for each possible answer in [L][L][L]. Running DyD_yDy​ against GGG follows the branch labelled G(z)G(z)G(z) at each node; DG(y)D^G(y)DG(y) is the bit at the leaf reached. The query complexity of DDD is the largest depth of its trees. Nothing restricts the computation between queries.

Let GGG be uniformly random among the injective functions [K]→[L][K]\to[L][K]→[L]. For a distinguisher DDD the two acceptance probabilities are

pX(D,G)=Pr⁡x∈[K][DG(G(x))=1],pY(D,G)=Pr⁡y∈[L][DG(y)=1],p_X(D,G)=\Pr_{x\in[K]}\big[D^G(G(x))=1\big],\qquad p_Y(D,G)=\Pr_{y\in[L]}\big[D^G(y)=1\big],pX​(D,G)=x∈[K]Pr​[DG(G(x))=1],pY​(D,G)=y∈[L]Pr​[DG(y)=1],

where xxx and yyy are uniform. DDD tries to tell the output G(x)G(x)G(x) of a random seed from a uniform element of [L][L][L] while it may query GGG.

Formalization targets

Goal: Lemma B.1 (Claim 4.14.2)

There is a constant δ>0\delta>0δ>0 such that for all sufficiently large KKK, all L≥K2L\ge K^2L≥K2, and every DDD making at most KδK^\deltaKδ oracle queries,

Pr⁡G[ ∣pX(D,G)−pY(D,G)∣≤1Kδ] ≥ 1−2−Kδ.\Pr_G\Big[\,\big|p_X(D,G)-p_Y(D,G)\big|\le \tfrac{1}{K^\delta}\Big]\ \ge\ 1-2^{-K^\delta}.GPr​[​pX​(D,G)−pY​(D,G)​≤Kδ1​] ≥ 1−2−Kδ.

The constant δ\deltaδ is left unspecified, as in the paper; the threshold for KKK may depend on δ\deltaδ only.

Milestones

The milestones follow the proof on pp. A:43–A:45, for small δ\deltaδ and γ=K−3δ\gamma=K^{-3\delta}γ=K−3δ:

  1. an averaging bound: for most sets S⊆[K]S\subseteq[K]S⊆[K] of size K1−5δK^{1-5\delta}K1−5δ, few runs DG(G(x))D^G(G(x))DG(G(x)), x∈Sx\in Sx∈S, query S∖{x}S\setminus\{x\}S∖{x};
  2. a sampling bound: a random such SSS estimates pXp_XpX​ within 14Kδ\frac1{4K^\delta}4Kδ1​;
  3. the triangle-inequality chain that turns a violation of the goal into a gap >12Kδ>\frac1{2K^\delta}>2Kδ1​ between SGS_GSG​ and LG=[L]∖G([K]∖SG)L_G=[L]\setminus G([K]\setminus S_G)LG​=[L]∖G([K]∖SG​);
  4. inequality (8): a simulator MMM that reads GGG only off SGS_GSG​ keeps that gap;
  5. the Chernoff count of subsets TTT that overestimate a Boolean average;
  6. Claim B.1.2 in counting form: the GGG admitting a good SGS_GSG​ inside a fixed SSS number at most B⋅2−cK1−7δB\cdot2^{-cK^{1-7\delta}}B⋅2−cK1−7δ, where BBB is the number of injections;
  7. the closing density bound: the bad GGG have density below K−δK^{-\delta}K−δ.

Significance

Lemma B.1 is the step that makes Proposition 4.14 work. Once the oracle is fixed everywhere except at the values Ok(C,⋅)O_k(C,\cdot)Ok​(C,⋅), the simulator's only dependence on the remaining randomness is through queries to GGG, and Lemma B.1 says that such a simulator cannot distinguish GGG's outputs from uniform except with probability 2−Kδ2^{-K^\delta}2−Kδ over the oracle. A union bound over circuits and adversaries of bounded description then yields the obfuscator relative to the oracle. More broadly, the lemma is a clean instance of the principle that a random function is pseudorandom against adversaries with few queries to it, which is used in random-oracle and black-box separation arguments.

The paper gives only a sketch, and formalizing it adds more than a check. The sketch proves the density bound K−δK^{-\delta}K−δ but asserts 2−Kδ2^{-K^\delta}2−Kδ; the counting bound supports the stronger statement, but the step is not written. More seriously, Property 2 of Claim B.1.1 as printed (no query of DG(G(x))D^G(G(x))DG(G(x)) lands in SGS_GSG​, including at xxx itself) cannot be met: a one-query distinguisher that inverts GGG makes every bad GGG violate it, so Claim B.1.1 is false as stated and the proof needs repair. As far as the platform's records show, no part of the argument has been machine-checked.

Difficulty

The naive attempt is a union bound: fix DDD, compute the expected gap over GGG, and apply a concentration inequality over GGG. This fails because DDD queries GGG, so the events "DG(G(x))=1D^G(G(x))=1DG(G(x))=1" for different xxx are correlated through GGG in ways that depend on DDD's adaptive strategy. Neither independence nor a bounded-differences argument applies directly, since changing one value of GGG can change many runs.

The compression argument avoids this, but each of its steps needs care. The set on which DDD's runs are "independent" must be chosen from a fixed SSS so that it is cheap to describe. The simulator must answer queries without the part of GGG being described. The saving from the Chernoff count must exceed the cost of describing SGS_GSG​ inside SSS. Queries a run makes at its own preimage xxx must be handled separately, which is where the printed argument breaks.

Formalization scope

The query trees are an inductive type QTree K L with constructors out : Bool → QTree K L and query : Fin K → (Fin L → QTree K L) → QTree K L, and [K][K][K], [L][L][L] are Fin K, Fin L. A distinguisher is D : Fin L → QTree K L, and "at most KδK^\deltaKδ queries" means every D y has depth at most KδK^\deltaKδ (a real power). Distinguishers are deterministic: the probabilities in the goal are over xxx, yyy and GGG only. Randomized distinguishers, averaged over their coins, are not covered, and the paper's application fixes the simulator's coins.

Every probability is a counting fraction over a finite uniform sample space: Fin K, Fin L, the embeddings Fin K ↪ Fin L, or the subsets of a given size (Finset.powersetCard). Sizes the paper writes as non-integers are floors or inequalities: ∣S∣=⌊K1−5δ⌋|S|=\lfloor K^{1-5\delta}\rfloor∣S∣=⌊K1−5δ⌋ and ∣SG∣≥(1−γ)∣S∣|S_G|\ge(1-\gamma)|S|∣SG​∣≥(1−γ)∣S∣. Each Ω(⋅)\Omega(\cdot)Ω(⋅) is an explicit constant c>0c>0c>0 that depends only on δ\deltaδ. "Sufficiently small δ\deltaδ" is either an explicit range 0<δ≤1/1000<\delta\le1/1000<δ≤1/100 (for the elementary steps) or an existential δ0>0\delta_0>0δ0​>0 (for the counting steps), and "sufficiently large KKK" is an explicit threshold K0K_0K0​.

The goal quantifies ∃δ>0 ∃K0 ∀K≥K0 ∀L≥K2 ∀D\exists\delta>0\ \exists K_0\ \forall K\ge K_0\ \forall L\ge K^2\ \forall D∃δ>0 ∃K0​ ∀K≥K0​ ∀L≥K2 ∀D, so δ\deltaδ cannot depend on KKK or DDD. The probability over GGG is taken outside the absolute value: averaging the gap over GGG would give a much weaker statement and is ruled out. Non-adaptive distinguishers or a fixed query set would also weaken the goal and are not used.

Milestone 1 is stated in a corrected form: it excludes the query at xxx itself and reads the misprint 4/K−4δ4/K^{-4\delta}4/K−4δ as 4K−4δ4K^{-4\delta}4K−4δ. Claim B.1.1 is not a milestone because it is false as printed. Milestones 4 and 6 use the printed Property 2. Contributions repairing the link between the corrected averaging step and the compression step are welcome, as are sorry-free proofs of the generic concentration milestones (2 and 5), which are reusable beyond this mission.

Selected references

  • B. Barak, O. Goldreich, R. Impagliazzo, S. Rudich, A. Sahai, S. Vadhan, K. Yang, On the (Im)possibility of Obfuscating Programs, Journal of the ACM 59(2), 2012. https://doi.org/10.1145/2160158.2160159
  • R. Gennaro, L. Trevisan, Lower bounds on the efficiency of generic cryptographic constructions, FOCS 2000. https://doi.org/10.1109/SFCS.2000.892119
  • W. Hoeffding, Probability inequalities for sums of bounded random variables, Journal of the American Statistical Association 58(301), 1963. https://doi.org/10.1080/01621459.1963.10500830
9 thms1 active userReviewed
Dynamic ProgrammingLinear OptimizationOperations Research·Captain: mikedeng1

Analysis of Stochastic Dual Dynamic Programming Method: SDDP with Independently Subsampled Scenarios Finds an Optimal Policy of the SAA Problem in Finitely Many Iterations Almost SurelyResearch Paper

Motivation

Multistage stochastic linear programs model sequential decisions under uncertainty: capacity and reservoir planning, hydro-thermal scheduling, inventory and asset–liability management. When the data process is stagewise independent, the problem decomposes by dynamic programming into one linear program per stage, coupled through expected cost-to-go functions. These functions are convex and piecewise linear, and the stochastic dual dynamic programming (SDDP) method of Pereira and Pinto (1991) approximates them from below by cutting planes. SDDP is the standard solution method in the long-term planning of hydro-dominated power systems, and its convergence theory determines what the bounds it reports actually mean.

Shapiro's paper (Optimization Online 2009/12/2509; European J. Oper. Res. 209(1), 2011, doi:10.1016/j.ejor.2010.08.007) analyses SDDP applied to a sample average approximation (SAA) of the true problem, with all of the data (ct,At,Bt,bt)(c_t, A_t, B_t, b_t)(ct​,At​,Bt​,bt​) random. Its convergence result, Proposition 3.1, asserts finite convergence with probability one when the forward scenarios are subsampled independently. A related almost-sure finite convergence theorem for a different algorithm (DOASA, with randomness only in the right-hand sides and cut sharing across outcomes) is due to Philpott and Guan (2008); it is posed as a separate mission on this platform and is not restated here.

Setting

There are T≥2T\ge 2T≥2 stages. The decision xt∈Rntx_t\in\mathbb R^{n_t}xt​∈Rnt​ satisfies xt≥0x_t\ge 0xt​≥0 and, at the first stage, A1x1=b1A_1x_1=b_1A1​x1​=b1​ with deterministic data (c1,A1,b1)(c_1,A_1,b_1)(c1​,A1​,b1​). For t=2,…,Tt=2,\dots,Tt=2,…,T the data are replaced by a sample ξ~tj=(c~tj,A~tj,B~tj,b~tj)\tilde\xi_t^j=(\tilde c_{tj},\tilde A_{tj},\tilde B_{tj},\tilde b_{tj})ξ~​tj​=(c~tj​,A~tj​,B~tj​,b~tj​), j=1,…,Ntj=1,\dots,N_tj=1,…,Nt​, each with probability 1/Nt1/N_t1/Nt​, independently across stages, and the stage-ttt constraint is B~tjxt−1+A~tjxt=b~tj\tilde B_{tj}x_{t-1}+\tilde A_{tj}x_t=\tilde b_{tj}B~tj​xt−1​+A~tj​xt​=b~tj​. The SAA cost-to-go functions are defined backwards from Q~T+1≡0\widetilde{\mathcal Q}_{T+1}\equiv 0Q​T+1​≡0:

Q~tj(xt−1)=inf⁡xt≥0{c~tj⊤xt+Q~t+1(xt):B~tjxt−1+A~tjxt=b~tj},Q~t=1Nt∑j=1NtQ~tj.\widetilde Q_{tj}(x_{t-1})=\inf_{x_t\ge0}\big\{\tilde c_{tj}^\top x_t+\widetilde{\mathcal Q}_{t+1}(x_t):\tilde B_{tj}x_{t-1}+\tilde A_{tj}x_t=\tilde b_{tj}\big\},\qquad \widetilde{\mathcal Q}_t=\frac1{N_t}\sum_{j=1}^{N_t}\widetilde Q_{tj}.Q​tj​(xt−1​)=xt​≥0inf​{c~tj⊤​xt​+Q​t+1​(xt​):B~tj​xt−1​+A~tj​xt​=b~tj​},Q​t​=Nt​1​j=1∑Nt​​Q​tj​.

A scenario is a choice (j2,…,jT)(j_2,\dots,j_T)(j2​,…,jT​); there are N=∏tNtN=\prod_t N_tN=∏t​Nt​ of them, each of probability 1/N1/N1/N. A policy xˉt=xˉt(ξ~[t])\bar x_t=\bar x_t(\tilde\xi_{[t]})xˉt​=xˉt​(ξ~​[t]​) depends only on the outcomes up to stage ttt; it is optimal for the SAA problem if it is feasible on every scenario and its expected cost 1N∑scenarios∑tc~t⊤xˉt\frac1N\sum_{\text{scenarios}}\sum_t\tilde c_t^\top\bar x_tN1​∑scenarios​∑t​c~t⊤​xˉt​ is minimal.

SDDP keeps, for each stage, a finite set of cuts α+β⊤x\alpha+\beta^\top xα+β⊤x whose maximum Qt+1\mathfrak Q_{t+1}Qt+1​ lies below Q~t+1\widetilde{\mathcal Q}_{t+1}Q​t+1​. An iteration has a forward step: MMM scenarios are sampled, and along each of them the decisions xˉt\bar x_txˉt​ solve the stage problems with Qt+1\mathfrak Q_{t+1}Qt+1​ in place of Q~t+1\widetilde{\mathcal Q}_{t+1}Q​t+1​, (3.13)–(3.14). It also has a backward step: from t=T−1t=T-1t=T−1 down to 111, at each trial point xˉt\bar x_txˉt​ the stage-(t+1)(t+1)(t+1) problems with the current cuts are solved for all Nt+1N_{t+1}Nt+1​ outcomes, and the cut (3.17) ℓ(x)=Q~‾t+1(xˉt)+g~⊤(x−xˉt)\ell(x)=\underline{\widetilde{\mathcal Q}}_{t+1}(\bar x_t)+\tilde g^\top(x-\bar x_t)ℓ(x)=Q​​t+1​(xˉt​)+g~​⊤(x−xˉt​) is added, where g~\tilde gg~​ averages −B~⊤π-\tilde B^\top\pi−B~⊤π over basic optimal (extreme-point) dual solutions π\piπ.

Formalization targets

Goal: Proposition 3.1

Suppose the forward scenarios are drawn independently and uniformly from the SAA scenarios, (A1) holds ((3.13) and (3.14) have finite optimal values for every scenario at every iteration), and the backward steps use basic optimal dual solutions. Then

P(∃K ∀k≥K: the forward policy defined by Q2k,…,QTk is optimal for the SAA problem)=1.P\Big(\exists K\ \forall k\ge K:\ \text{the forward policy defined by }\mathfrak Q^k_2,\dots,\mathfrak Q^k_{T}\text{ is optimal for the SAA problem}\Big)=1 .P(∃K ∀k≥K: the forward policy defined by Q2k​,…,QTk​ is optimal for the SAA problem)=1.

The goal fixes no iteration count, no rate and no number of forward scenarios M≥1M\ge1M≥1.

Milestones, in attack order

  1. Attainment: an LP of the form (3.13)/(3.14) with finite optimal value has an optimal solution.
  2. Cut validity: every cut lies below Q~t+1\widetilde{\mathcal Q}_{t+1}Q​t+1​ on reachable decisions, and Q~‾tj≤Q~tj\underline{\widetilde Q}_{tj}\le\widetilde Q_{tj}Q​​tj​≤Q​tj​.
  3. Lower bound: the optimal value ϑ‾k\underline\vartheta_kϑ​k​ of (3.13) is at most the SAA optimal value.
  4. Finitely many cutting planes (3.17) for a fixed next-stage cut set, uniformly in the trial point.
  5. Finitely many realizations of the Qt\mathfrak Q_tQt​ and of first-stage solutions; along each run the cut sets are eventually constant.
  6. A policy is optimal for the SAA problem if and only if it satisfies the dynamic programming conditions (3.18) on every scenario.
  7. With probability one every SAA scenario is drawn at infinitely many iterations.

Significance

The result separates SDDP's sampling from its convergence: on a finite scenario tree, independent subsampling of forward paths suffices for the method to stop at an optimal policy, without ever enumerating the tree. It explains why the lower bound ϑ‾k\underline\vartheta_kϑ​k​ eventually equals the SAA optimal value, which is what makes the gap-based stopping rules of the paper (§3, Remarks 4–6) meaningful. The paper's closing remark stresses that without independence of the forward scenarios there is no guarantee of convergence.

The proposition is proved in the paper. No machine-checked proof of it, or of any SDDP convergence theorem, exists to our knowledge. Formalizing it requires a precise account of what the method is: which dual solutions, which forward solutions, which order of updates. Several of these points are left implicit on the page.

Difficulty

Finiteness of the cut universe (milestones 4–5) is a statement about extreme points of dual polyhedra whose dimension grows with the cut sets of the next stage, so it must be organized stage by stage from TTT down. The central difficulty is the last step of the argument. Once the approximations have stopped changing, one must show that the stable cuts are exact where the forward policy goes, so that the forward policy satisfies (3.18). The obvious argument, "if (3.18) fails at the last stage where it fails, the next cut there increases Q\mathfrak QQ", does not work as printed: (3.18) holding at later stages does not by itself make the next-stage approximation exact at the trial point. Closing this step is where the conventions on forward solutions and on sampling listed below become essential.

Formalization scope

The Lean development is in the namespace ShapiroSDDP.Convergence. Stages are numbered 1,…,T1,\dots,T1,…,T; the data of stage t+1t+1t+1 are stored under index ttt (the coupling matrix is indexed by the decision it multiplies); V t is Q~t+1\widetilde{\mathcal Q}_{t+1}Q​t+1​, with V t ≡ 0 for t≥Tt\ge Tt≥T. Cost-to-go values are real infima, used only on reachable decisions. The explicit readings are:

  • cost-to-go functions finite valued on reachable decisions (the paper: everywhere; weaker);
  • initial cut sets: a parameter, nonempty and valid on reachable decisions, with {(0,0)}\{(0,0)\}{(0,0)} at stage TTT;
  • forward solutions from a deterministic oracle that reads the cut set and returns an optimal solution whenever one exists; the goal holds for every such oracle;
  • basic optimal duals: extreme points of the dual feasible region, chosen arbitrarily; the goal holds for every run;
  • (A1) as a hypothesis on the run; M≥1M\ge1M≥1 forward scenarios per iteration, i.i.d. uniform (independence via iIndepFun);
  • forward step before backward step within an iteration, with cuts at that iteration's trial points.

Optimality of a policy is defined by expected cost, never by (3.18), so that milestone 6 is not definitional. Sampling is stated as i.i.d. uniform draws, not as "every scenario recurs", which is milestone 7. All of c,A,B,bc,A,B,bc,A,B,b depend on the outcome. If some A~tj\tilde A_{tj}A~tj​ lacks full row rank, no basic dual solution exists and no run exists; a sorry-free witness instance shows that all hypotheses of the goal can hold together.

Useful infrastructure: LP weak and strong duality (LinearOptimization.lp_weak_duality, LinearOptimization.lp_strong_duality exist on the platform in their own encoding), finiteness of extreme points of polyhedra, attainment for polyhedral objectives, and the second Borel–Cantelli lemma (ProbabilityTheory.measure_limsup_eq_one). Proofs of any milestone, and reusable lemmas on LPs with cut epigraphs, are welcome.

Selected references

  • A. Shapiro, Analysis of Stochastic Dual Dynamic Programming Method, Optimization Online preprint 2009/12/2509; European Journal of Operational Research 209(1):63–72, 2011. https://optimization-online.org/2009/12/2509/ · https://doi.org/10.1016/j.ejor.2010.08.007
  • M. V. F. Pereira, L. M. V. G. Pinto, Multi-stage stochastic optimization applied to energy planning, Mathematical Programming 52:359–375, 1991. https://doi.org/10.1007/BF01582895
  • A. B. Philpott, Z. Guan, On the convergence of stochastic dual dynamic programming and related methods, Operations Research Letters 36(4):450–455, 2008. https://doi.org/10.1016/j.orl.2008.01.013
  • J. E. Kelley, The cutting-plane method for solving convex programs, J. SIAM 8(4):703–712, 1960. https://doi.org/10.1137/0108053
  • A. Shapiro, D. Dentcheva, A. Ruszczyński, Lectures on Stochastic Programming: Modeling and Theory, SIAM, 2009. https://doi.org/10.1137/1.9780898718751
11 thms1 active userReviewed
Graph TheoryLinear algebraRandom Matrix Theory+1·Captain: mikedeng1

Graph Sparsification by Effective Resistances 1: Sampling O(n log n/ε²) Edges by Effective Resistance Yields a (1±ε) Spectral Sparsifier with Probability 1/2Research Paper

Motivation

Many graph algorithms run in time proportional to the number of edges. A sparsifier of a weighted graph GGG is a graph HHH on the same vertices with far fewer edges that approximates GGG for the purpose at hand, so that the algorithm can be run on HHH instead. Benczúr and Karger (1996) showed that every graph has a sparsifier with O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges preserving the weight of every cut up to a factor 1±ε1\pm\varepsilon1±ε. Spielman and Teng (2004) introduced the stronger spectral notion, in which the Laplacian quadratic form is preserved for every real vector, not only for cut indicators; their sparsifiers had O(nlog⁡cn)O(n\log^c n)O(nlogcn) edges for a large constant ccc and were the first step of their nearly-linear-time solvers for symmetric diagonally dominant linear systems.

Spielman and Srivastava (arXiv:0803.0929, STOC 2008, SIAM J. Comput. 2011) proved that independent sampling of O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges, each edge with probability proportional to its weight times its effective resistance, yields a spectral sparsifier. The result improved both earlier bounds, replaced a recursive partitioning construction by a one-line sampling rule, and made effective resistance a standard tool in graph algorithms. Batson, Spielman and Srivastava (arXiv:0808.0163) later obtained O(n/ε2)O(n/\varepsilon^2)O(n/ε2) edges deterministically, by a slower method built on the same matrix Π\PiΠ.

Setting

Let G=(V,E,w)G=(V,E,w)G=(V,E,w) be a connected weighted undirected graph with n=∣V∣n=|V|n=∣V∣ vertices, m=∣E∣m=|E|m=∣E∣ edges and weights we>0w_e>0we​>0. Orient every edge arbitrarily, so that it has a head and a tail (distinct vertices).

  • The incidence matrix B∈Rm×nB\in\mathbb R^{m\times n}B∈Rm×n has B(e,v)=1B(e,v)=1B(e,v)=1 if vvv is the head of eee, −1-1−1 if vvv is its tail, and 000 otherwise; beb_ebe​ denotes its row for eee. WWW is the diagonal m×mm\times mm×m matrix with W(e,e)=weW(e,e)=w_eW(e,e)=we​.
  • The Laplacian is L=BTWBL=B^{\mathsf T}WBL=BTWB, with quadratic form xTLx=∑ewe (x(head e)−x(tail e))2x^{\mathsf T}Lx=\sum_e w_e\,(x(\mathrm{head}\,e)-x(\mathrm{tail}\,e))^2xTLx=∑e​we​(x(heade)−x(taile))2.
  • L+L^{+}L+ is the Moore–Penrose pseudoinverse of LLL: if L=∑i=1n−1λiuiuiTL=\sum_{i=1}^{n-1}\lambda_iu_iu_i^{\mathsf T}L=∑i=1n−1​λi​ui​uiT​ over its nonzero eigenvalues, then L+=∑i=1n−1λi−1uiuiTL^{+}=\sum_{i=1}^{n-1}\lambda_i^{-1}u_iu_i^{\mathsf T}L+=∑i=1n−1​λi−1​ui​uiT​.
  • The effective resistance of the edge eee is Re=beL+beTR_e=b_eL^{+}b_e^{\mathsf T}Re​=be​L+beT​: the potential difference across eee when a unit current enters at one end and leaves at the other, the edges being resistors of conductance wew_ewe​.
  • Π=W1/2BL+BTW1/2\Pi=W^{1/2}BL^{+}B^{\mathsf T}W^{1/2}Π=W1/2BL+BTW1/2 is an m×mm\times mm×m matrix with Π(e,e)=weRe\Pi(e,e)=w_eR_eΠ(e,e)=we​Re​.
  • Sparsify(G,q)(G,q)(G,q) draws qqq edges independently with replacement, the edge eee with probability pe=weRe/∑fwfRfp_e=w_eR_e/\sum_f w_fR_fpe​=we​Re​/∑f​wf​Rf​, and gives eee the weight we/(qpe)w_e/(qp_e)we​/(qpe​) for each time it is drawn. Its output HHH has Laplacian L~=BTW1/2SW1/2B\tilde L=B^{\mathsf T}W^{1/2}SW^{1/2}BL~=BTW1/2SW1/2B, where SSS is the random diagonal matrix with S(e,e)=#{draws of e}/(qpe)S(e,e)=\#\{\text{draws of }e\}/(qp_e)S(e,e)=#{draws of e}/(qpe​).

Formalization targets

Goal: Theorem 1

There are an absolute constant CCC and a threshold N0N_0N0​ such that, for every n≥N0n\ge N_0n≥N0​, every connected weighted graph on nnn vertices and every 1/n<ε≤11/\sqrt n<\varepsilon\le11/n​<ε≤1, with q=⌈9C2nlog⁡n/ε2⌉q=\lceil 9C^2n\log n/\varepsilon^2\rceilq=⌈9C2nlogn/ε2⌉, with probability at least 1/21/21/2

∀x∈Rn:(1−ε) xTLx  ≤  xTL~x  ≤  (1+ε) xTLx.\forall x\in\mathbb R^n:\qquad (1-\varepsilon)\,x^{\mathsf T}Lx\;\le\;x^{\mathsf T}\tilde Lx\;\le\;(1+\varepsilon)\,x^{\mathsf T}Lx .∀x∈Rn:(1−ε)xTLx≤xTL~x≤(1+ε)xTLx.

The constant CCC is left unfixed; the statement asserts the shape q=O(nlog⁡n/ε2)q=O(n\log n/\varepsilon^2)q=O(nlogn/ε2) with the paper's explicit dependence on CCC.

Milestones

  1. Lemma 3 (four parts): Π\PiΠ is an orthogonal projection; im⁡Π=im⁡W1/2B\operatorname{im}\Pi=\operatorname{im}W^{1/2}BimΠ=imW1/2B; the eigenvalues of Π\PiΠ are 111 with multiplicity n−1n-1n−1 and 000 with multiplicity m−n+1m-n+1m−n+1; Π(e,e)=∥Π(⋅,e)∥2\Pi(e,e)=\|\Pi(\cdot,e)\|^2Π(e,e)=∥Π(⋅,e)∥2.
  2. Lemma 4: for a nonnegative diagonal SSS, ∥ΠSΠ−ΠΠ∥2≤ε\|\Pi S\Pi-\Pi\Pi\|_2\le\varepsilon∥ΠSΠ−ΠΠ∥2​≤ε implies (1−ε)xTLx≤xTBTW1/2SW1/2Bx≤(1+ε)xTLx(1-\varepsilon)x^{\mathsf T}Lx\le x^{\mathsf T}B^{\mathsf T}W^{1/2}SW^{1/2}Bx\le(1+\varepsilon)x^{\mathsf T}Lx(1−ε)xTLx≤xTBTW1/2SW1/2Bx≤(1+ε)xTLx for all xxx.
  3. Lemma 5 (Rudelson–Vershynin): for independent samples y1,…,yqy_1,\dots,y_qy1​,…,yq​ of a random vector with ∥y∥2≤M\|y\|_2\le M∥y∥2​≤M and ∥E yyT∥2≤1\|\mathbb E\,yy^{\mathsf T}\|_2\le1∥EyyT∥2​≤1, and q≥2q\ge2q≥2,
E∥1q∑j=1qyjyjT−E yyT∥2≤CMlog⁡qqwhenever the right side is <1.\mathbb E\Big\|\frac1q\sum_{j=1}^q y_jy_j^{\mathsf T}-\mathbb E\,yy^{\mathsf T}\Big\|_2\le CM\sqrt{\frac{\log q}{q}}\quad\text{whenever the right side is }<1.E​q1​j=1∑q​yj​yjT​−EyyT​2​≤CMqlogq​​whenever the right side is <1.

Significance

Theorem 1 says that every weighted graph is spectrally approximated by a reweighted subgraph with O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges. A spectral approximation preserves cut weights, the eigenvalues of the Laplacian up to 1±ε1\pm\varepsilon1±ε, effective resistances, and the condition number of LLL as a preconditioner, so any algorithm whose output depends on these quantities can run on HHH. Combined with fast approximate computation of effective resistances (the second mission of this series), it gives a nearly-linear-time construction, and it is the sampling step used in Laplacian solvers, in sparsification of sums of rank-one matrices, and in leverage-score sampling for regression, where weRew_eR_ewe​Re​ is exactly the statistical leverage of a row.

The result is proved in the paper; to our knowledge no machine-checked proof exists. This mission formalizes the statement and the paper's proof structure: the linear algebra of Π\PiΠ (Lemma 3), the deterministic reduction from quadratic forms to a spectral-norm bound (Lemma 4), and the matrix concentration inequality (Lemma 5), which is the substantive analytic input and is itself a reusable result about sums of independent rank-one matrices.

Difficulty

The deterministic part is linear algebra over the pseudoinverse. The obstacle is concentration: the expected Laplacian of HHH equals LLL, but bounding the deviation uniformly over all x∈Rnx\in\mathbb R^nx∈Rn is a statement about the spectral norm of a random matrix, and a union bound over a net of directions costs a factor of nnn in the sample count rather than log⁡n\log nlogn. Scalar Chernoff bounds per cut, which suffice for cut sparsifiers, do not give the spectral statement. Lemma 5 is the matrix inequality that removes this loss, and no inequality of this kind (a concentration bound for the spectral norm of a sum of independent random matrices) is in Mathlib.

Formalization scope

All declarations sit in the namespace EffResSparsify.Sampling.

  • Graphs. A structure WGraph V E with orientation maps head, tail : E → V, weights w : E → ℝ, and the fields head e ≠ tail e (no loops) and 0 < w e. Parallel edges are allowed; nothing in §3 uses simplicity. Connectivity is a separate hypothesis on the underlying simple graph and includes V≠∅V\ne\emptysetV=∅. In Theorem 1 the vertex type is Fin n; the edge type is an arbitrary finite type.
  • Pseudoinverse. L+L^{+}L+ is the matrix of the published Moore–Penrose pseudoinverse HarmonicGames.Decomposition.pinv of x↦Lxx\mapsto Lxx↦Lx on Euclidean RV\mathbb R^VRV; it equals the spectral formula above and is the gauge-fixed inverse, never "some solution of Lx=yLx=yLx=y".
  • Sampling. pep_epe​ is defined as weRe/∑fwfRfw_eR_e/\sum_f w_fR_fwe​Re​/∑f​wf​Rf​; the identity ∑fwfRf=n−1\sum_f w_fR_f=n-1∑f​wf​Rf​=n−1 is part of the proof. An outcome of Sparsify is a sequence in EqE^qEq with probability ∏ipsi\prod_i p_{s_i}∏i​psi​​, and probabilities and expectations are finite sums over EqE^qEq, with no measure theory.
  • Norms and logarithms. ∥⋅∥2\|\cdot\|_2∥⋅∥2​ is the ℓ2\ell_2ℓ2​ operator norm on matrices (Matrix.Norms.L2Operator); vector norms in Lemma 5 are Euclidean; log⁡\loglog is natural (the base is absorbed into CCC).
  • Constants. In Theorem 1, ∃C>0, ∃N0, ∀n≥N0\exists C>0,\ \exists N_0,\ \forall n\ge N_0∃C>0, ∃N0​, ∀n≥N0​ precede the graph and ε\varepsilonε; the sample count is ⌈9C2nlog⁡n/ε2⌉\lceil 9C^2n\log n/\varepsilon^2\rceil⌈9C2nlogn/ε2⌉, rounded up because the printed value is not an integer. In Lemma 5, ∃C>0\exists C>0∃C>0 precedes the dimension, the distribution, MMM and qqq.
  • Corrected statement. Lemma 5 as printed, with right side min⁡(CMlog⁡q/q,1)\min(CM\sqrt{\log q/q},1)min(CMlogq/q​,1), is false (at q=1q=1q=1 the bound is 000). The formal milestone is Rudelson and Vershynin's own Theorem 3.1: q≥2q\ge2q≥2, and the bound a=CMlog⁡q/qa=CM\sqrt{\log q/q}a=CMlogq/q​ holds when a<1a<1a<1. It is stated for finitely supported distributions, which is all Theorem 1 uses. Theorem 1 applies it with a≤ε/2a\le\varepsilon/2a≤ε/2, so the correction does not affect the goal.
  • Not a trivialization. Theorem 1 does not take Lemma 5, a bound on E∥ΠSΠ−Π∥2\mathbb E\|\Pi S\Pi-\Pi\|_2E∥ΠSΠ−Π∥2​, or a free sample count as a hypothesis; a statement with any of these, or with "∃q\exists q∃q" in place of ⌈9C2nlog⁡n/ε2⌉\lceil 9C^2n\log n/\varepsilon^2\rceil⌈9C2nlogn/ε2⌉, is a different theorem.

Reusable beyond this mission: the weighted Laplacian with its pseudoinverse and effective resistances, and Lemma 5, which applies to any sampling scheme for sums of rank-one matrices (leverage-score sampling, column subset selection). Contributions toward a matrix Chernoff or Rudelson-type inequality in Mathlib are welcome.

Selected references

  • D. A. Spielman, N. Srivastava, Graph Sparsification by Effective Resistances, arXiv:0803.0929v4, 2009; SIAM J. Comput. 40(6), 2011. https://arxiv.org/abs/0803.0929, https://doi.org/10.1137/080734029
  • M. Rudelson, R. Vershynin, Sampling from large matrices: an approach through geometric functional analysis, J. ACM 54(4), 2007. https://doi.org/10.1145/1255443.1255449
  • M. Rudelson, Random vectors in the isotropic position, J. Funct. Anal. 164(1), 1999. https://doi.org/10.1006/jfan.1998.3384
  • A. A. Benczúr, D. R. Karger, Approximating s-t minimum cuts in Õ(n²) time, STOC 1996. https://doi.org/10.1145/237814.237827
  • D. A. Spielman, S.-H. Teng, Spectral sparsification of graphs, SIAM J. Comput. 40(4), 2011 (arXiv:0808.4134). https://arxiv.org/abs/0808.4134
  • J. Batson, D. A. Spielman, N. Srivastava, Twice-Ramanujan sparsifiers, SIAM J. Comput. 41(6), 2012 (arXiv:0808.0163). https://arxiv.org/abs/0808.0163
9 thms1 active userReviewed
Dynamic ProgrammingOperations ResearchOptimization·Captain: mikedeng1

Robust Dynamic Programming 2: The Discounted Robust Value Function Is the Unique Fixed Point of the Robust Bellman OperatorResearch Paper

Motivation

Markov decision processes model sequential decisions under uncertainty, and their optimal policies are computed from transition probabilities that in practice are estimated from data. Optimal policies can be sensitive to estimation error in those probabilities. Robust dynamic programming replaces each transition law by a set of plausible laws and evaluates a policy by its worst-case expected reward over that set. Garud Iyengar's Robust dynamic programming (CORC Tech Report TR-2002-07, 2002, rev. 2004; Mathematics of Operations Research 30(2), 2005) set up this theory for countable state spaces and history-dependent policies. It isolated the Rectangularity assumption under which the robust problem keeps a Bellman equation. In the same period, Nilim and El Ghaoui studied robust control of Markov decision processes with finite state spaces.

Timeline:

  • 1968, 1973. Satia (PhD thesis) and Satia and Lave (Operations Research 21) treat finite-state, finite-action Markov decision processes with uncertain transition probabilities. They state the max–min optimality equation and the optimality of stationary policies, assuming convex uncertainty sets, and do not prove that the solution of the equation is the robust value function.
  • 2001. Bagnell, Ng and Schneider analyse robust policies when the decision maker is restricted to stationary policies.
  • 2002–2005. Iyengar (this paper) and Nilim and El Ghaoui (Operations Research 53, 2005) give the rectangular theory. Iyengar proves the discounted robust Bellman equation for countable state spaces, against history-dependent randomized policies and an adversary that may change the law at every visit.

Setting

A discounted ambiguous Markov decision process has a countable state set S\mathcal SS, for each state sss a nonempty set A(s)\mathcal A(s)A(s) of admissible actions, for each admissible pair (s,a)(s,a)(s,a) a nonempty set P(s,a)\mathcal P(s,a)P(s,a) of probability measures on S\mathcal SS (the ambiguity set), a bounded reward r(s,a,s′)r(s,a,s')r(s,a,s′) and a discount factor λ∈(0,1)\lambda\in(0,1)λ∈(0,1). Decisions are made at epochs t=0,1,2,…t=0,1,2,\dotst=0,1,2,….

A policy π=(d0,d1,… )\pi=(d_0,d_1,\dots)π=(d0​,d1​,…) maps each history ht=(s0,a0,…,st)h_t=(s_0,a_0,\dots,s_t)ht​=(s0​,a0​,…,st​) to a probability measure on A(st)\mathcal A(s_t)A(st​). Π\PiΠ is the set of all such policies. A deterministic Markov policy plays dt(st)d_t(s_t)dt​(st​) for maps dt:S→Ad_t:\mathcal S\to\mathcal Adt​:S→A with dt(s)∈A(s)d_t(s)\in\mathcal A(s)dt​(s)∈A(s). A stationary policy uses one such rule ddd at every epoch.

Under Rectangularity, the adversary picks a law p∈P(st,at)p\in\mathcal P(s_t,a_t)p∈P(st​,at​) separately at every epoch and history, and may pick a different law each time a state–action pair recurs. This is the dynamic model, and the set of path measures it generates is Tπ\mathcal T^\piTπ. In the static model the adversary fixes one pˉsa∈P(s,a)\bar p_{sa}\in\mathcal P(s,a)pˉ​sa​∈P(s,a) per pair. The robust value of a policy and the robust value function are

Vλπ(s)=inf⁡P∈TπEP[∑t=0∞λtr(st,dt(ht),st+1)],Vλ∗(s)=sup⁡π∈ΠVλπ(s).V^\pi_\lambda(s)=\inf_{\mathbf P\in\mathcal T^\pi}\mathbf E^{\mathbf P}\Big[\sum_{t=0}^\infty\lambda^t r(s_t,d_t(h_t),s_{t+1})\Big],\qquad V^*_\lambda(s)=\sup_{\pi\in\Pi}V^\pi_\lambda(s).Vλπ​(s)=P∈Tπinf​EP[t=0∑∞​λtr(st​,dt​(ht​),st+1​)],Vλ∗​(s)=π∈Πsup​Vλπ​(s).

Let V\mathbf VV be the bounded functions on S\mathcal SS with ∥V∥=sup⁡s∣V(s)∣\|V\|=\sup_s|V(s)|∥V∥=sups​∣V(s)∣. For a set D\mathcal DD of deterministic Markov rules, the robust Bellman operator is

LDV(s)=sup⁡d∈D inf⁡p∈P(s,d(s))Ep[r(s,d(s),s′)+λV(s′)].\mathcal L_{\mathcal D}V(s)=\sup_{d\in\mathcal D}\ \inf_{p\in\mathcal P(s,d(s))}\mathbf E^p\big[r(s,d(s),s')+\lambda V(s')\big].LD​V(s)=d∈Dsup​ p∈P(s,d(s))inf​Ep[r(s,d(s),s′)+λV(s′)].

Formalization targets

Goal: Corollary 2(b)

Vλ∗(s)=sup⁡a∈A(s) inf⁡p∈P(s,a)Ep[r(s,a,s′)+λVλ∗(s′)],s∈S,V^*_\lambda(s)=\sup_{a\in\mathcal A(s)}\ \inf_{p\in\mathcal P(s,a)}\mathbf E^p\big[r(s,a,s')+\lambda V^*_\lambda(s')\big],\qquad s\in\mathcal S,Vλ∗​(s)=a∈A(s)sup​ p∈P(s,a)inf​Ep[r(s,a,s′)+λVλ∗​(s′)],s∈S,

Vλ∗V^*_\lambdaVλ∗​ is the only bounded solution of this equation, and for every ϵ>0\epsilon>0ϵ>0 some stationary deterministic policy πϵ\pi^\epsilonπϵ has Vλπϵ≥Vλ∗−ϵV^{\pi^\epsilon}_\lambda\ge V^*_\lambda-\epsilonVλπϵ​≥Vλ∗​−ϵ.

Milestones

  1. Theorem 5(a). LD\mathcal L_{\mathcal D}LD​ maps V\mathbf VV to V\mathbf VV and ∥LDU−LDV∥≤λ∥U−V∥\|\mathcal L_{\mathcal D}U-\mathcal L_{\mathcal D}V\|\le\lambda\|U-V\|∥LD​U−LD​V∥≤λ∥U−V∥.
  2. Theorem 5(b). For D=∏sD(s)\mathcal D=\prod_s\mathcal D(s)D=∏s​D(s), the equation LDV=V\mathcal L_{\mathcal D}V=VLD​V=V has a unique bounded solution, equal to the robust value over deterministic Markov policies with rules in D\mathcal DD.
  3. Corollary 2(a). The robust value of a stationary policy (d,d,… )(d,d,\dots)(d,d,…) is the unique bounded solution of V(s)=inf⁡p∈P(s,d(s))Ep[r(s,d(s),s′)+λV(s′)]V(s)=\inf_{p\in\mathcal P(s,d(s))}\mathbf E^p[r(s,d(s),s')+\lambda V(s')]V(s)=infp∈P(s,d(s))​Ep[r(s,d(s),s′)+λV(s′)].
  4. Theorem 4. Vλ∗(s)=sup⁡π∈ΠMDVλπ(s)V^*_\lambda(s)=\sup_{\pi\in\Pi_{MD}}V^\pi_\lambda(s)Vλ∗​(s)=supπ∈ΠMD​​Vλπ​(s).
  5. Lemma 3. For a stationary policy, the dynamic and static models give the same value.
  6. Lemma 2. The value of a stationary policy is the optimal solution of the robust program (31).
  7. Lemma 1, first claim. The output of robust value iteration is within ϵ/4\epsilon/4ϵ/4 of Vλ∗V^*_\lambdaVλ∗​.

Significance

Corollary 2(b) justifies computing the robust value function by solving a state-wise max–min equation. Value iteration, policy iteration and their approximations all rely on that equation. It also shows that a decision maker facing a history-dependent adversary loses at most ϵ\epsilonϵ by committing to a stationary deterministic rule. Corollary 2(a) and Lemma 2 make robust policy evaluation a fixed point problem and a robust optimization problem. Lemma 3 shows that, for stationary policies, the dynamic model costs nothing relative to the static model, in which the true transition law is fixed but unknown.

The results are proved on paper. The page proves Theorem 4 only by citation to Puterman's non-robust arguments. No machine-checked proof of any of them is known. The platform has finite-state analogues posed by the Nilim–El Ghaoui and Satia–Lave missions, which compare only stationary or Markov controllers. This mission poses the countable, history-dependent version, and proving it would establish them in this generality.

Difficulty

The contraction property is a state-by-state ϵ\epsilonϵ-argument. The hard step is to identify the fixed point with the value of the game against all history-dependent randomized policies. The adversary's choices at different epochs interact only through Rectangularity, so splitting the infimum over path measures into a first-step infimum and a continuation infimum must be justified for an infinite horizon, uncountably many adversary strategies and no attainment of the infima. The ambiguity sets need not be convex or closed. The naive route, "take the minimizing law at each state", is unavailable, and every bound must be carried with an ϵ\epsilonϵ slack. Truncating the infinite sum needs the uniform reward bound. Theorem 4 needs a separate argument that randomization and history dependence do not help the decision maker against the dynamic adversary.

Formalization scope

States and actions are countable Lean types; A(s)\mathcal A(s)A(s) and P(s,a)\mathcal P(s,a)P(s,a) are sets, assumed nonempty, with no convexity or closedness. Laws are PMFs and Ep[f]=∑xp(x)f(x)\mathbf E^p[f]=\sum_x p(x)f(x)Ep[f]=∑x​p(x)f(x) as a tsum. The rewards satisfy ∣r(s,a,s′)∣≤R|r(s,a,s')|\le R∣r(s,a,s′)∣≤R on admissible actions. This is the reading of the page's "sup⁡r=R<∞\sup r=R<\inftysupr=R<∞", which its bounds ±R/(1−λ)\pm R/(1-\lambda)±R/(1−λ) require. The discount factor satisfies 0<λ<10<\lambda<10<λ<1. Epochs start at 000, so the first reward is undiscounted.

A policy maps (n,hn)(n, h_n)(n,hn​) to a PMF supported on A(sn)\mathcal A(s_n)A(sn​). The dynamic adversary maps (n,hn,a)(n,h_n,a)(n,hn​,a) to a law in P(sn,a)\mathcal P(s_n,a)P(sn​,a). The path law is built by PMF.bind, and the discounted reward is ∑tλtE[r(st,at,st+1)]\sum_t\lambda^t\mathbf E[r(s_t,a_t,s_{t+1})]∑t​λtE[r(st​,at​,st+1​)], which converges absolutely. Values are real infima and suprema over nonempty families bounded by R/(1−λ)R/(1-\lambda)R/(1−λ), so no junk value arises. V\mathbf VV is the predicate "bounded", and ∥⋅∥\|\cdot\|∥⋅∥ is a supremum (the page writes max). All uniqueness claims are uniqueness among bounded functions.

Vλ∗V^*_\lambdaVλ∗​ is a supremum over all history-dependent randomized policies. Defining it over deterministic Markov or stationary policies would make Theorem 4 trivial and weaken the goal, so it is ruled out. The adversary in VλπV^\pi_\lambdaVλπ​ is the dynamic one; the static adversary appears only in Lemma 3.

The mission deviates from the page in three places:

  • Theorem 5(b) is stated for product sets D=∏sD(s)\mathcal D=\prod_s\mathcal D(s)D=∏s​D(s). For an arbitrary D\mathcal DD the printed statement fails, because its proof pastes ϵ\epsilonϵ-greedy actions state by state. Both uses in Corollary 2 are products.
  • Lemma 3 is stated for randomized Markov rules, which is the page's "any decision rule". The page proves it for deterministic rules.
  • Lemma 2 adds ∑sα(s)<∞\sum_s\alpha(s)<\infty∑s​α(s)<∞ and restricts the program to bounded VVV.

Only the first claim of Lemma 1 is posed. Its second claim, that an ϵ/2\epsilon/2ϵ/2-greedy rule is ϵ\epsilonϵ-optimal, is false as printed.

A complete development needs a general toolkit that is reusable beyond this mission: path laws of countable controlled processes with history-dependent policies, a uniform ϵ\epsilonϵ-optimal selection argument for real infima over arbitrary sets, and the Banach fixed point theorem on bounded functions (Mathlib's ContractingWith). Proofs of individual milestones are welcome in any order. Theorem 5(a) is the natural entry point.

Selected references

  • G. Iyengar, Robust dynamic programming, CORC Tech Report TR-2002-07, Columbia University, 2002 (rev. May 4, 2004); published in Mathematics of Operations Research 30(2):257–280, 2005. https://doi.org/10.1287/moor.1040.0129
  • A. Nilim and L. El Ghaoui, Robust control of Markov decision processes with uncertain transition matrices, Operations Research 53(5):780–798, 2005. https://doi.org/10.1287/opre.1050.0216
  • J. K. Satia and R. E. Lave, Markovian decision processes with uncertain transition probabilities, Operations Research 21(3):728–740, 1973. https://doi.org/10.1287/opre.21.3.728
  • J. A. Bagnell, A. Y. Ng and J. Schneider, Solving uncertain Markov decision problems, Tech. Report CMU-RI-TR-01-25, Carnegie Mellon University, 2001. https://www.ri.cmu.edu/publications/solving-uncertain-markov-decision-problems/
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994. https://doi.org/10.1002/9780470316887
12 thms1 active userReviewed
Machine Learning·Captain: mikedeng1

Efficient Algorithms for Online Decision Problems 3: Follow the Lazy Leader (FLL, FLL*) Matches FPL, FPL* in Expectation Each Period and Updates with Probability at Most εAResearch Paper

Motivation

In an online linear decision problem a decision maker chooses, on each period t=1,2,…t = 1, 2, \dotst=1,2,…, a decision dtd_tdt​ from a set D⊂Rn\mathcal D \subset \mathbb R^nD⊂Rn, and only then learns a state vector st∈S⊂Rns_t \in \mathcal S \subset \mathbb R^nst​∈S⊂Rn and pays the cost dt⋅std_t \cdot s_tdt​⋅st​. The online shortest path problem, the experts problem, online binary search trees and list update are all of this form. Kalai and Vempala showed that a single offline optimisation oracle M(s)=arg min⁡d∈Dd⋅sM(s) = \operatorname{arg\,min}_{d \in \mathcal D} d \cdot sM(s)=argmind∈D​d⋅s is enough to compete with the best fixed decision in hindsight: Follow the Perturbed Leader plays the leader of a randomly perturbed history (Kalai & Vempala 2005; the idea goes back to Hannan 1957).

Each period of FPL calls the oracle once and may change the decision. When an oracle call is expensive, or when switching decisions carries a cost (rotating a search tree, re-routing traffic), this is wasteful. The same paper introduces Follow the Lazy Leader: versions FLL and FLL* of FPL and FPL* that correlate the perturbations across periods so that the decision rarely changes, while each single period is distributed exactly as before. Lemma 1.2 of the paper is the statement that this works, and it is the result of this mission.

Setting

Vectors are elements of Rn\mathbb R^nRn; ∣x∣1=∑i∣xi∣|x|_1 = \sum_i |x_i|∣x∣1​=∑i​∣xi​∣, and s1:t=s1+⋯+sts_{1:t} = s_1 + \dots + s_ts1:t​=s1​+⋯+st​ with s1:0=0s_{1:0} = 0s1:0​=0.

  • An argmin oracle for D\mathcal DD is a map MMM with M(x)∈DM(x) \in \mathcal DM(x)∈D and M(x)⋅x≤d⋅xM(x) \cdot x \le d \cdot xM(x)⋅x≤d⋅x for all d∈Dd \in \mathcal Dd∈D. The decisions are assumed to have L1L^1L1 diameter at most DDD, and the states satisfy ∣s∣1≤A|s|_1 \le A∣s∣1​≤A for s∈Ss \in \mathcal Ss∈S.
  • The states s1,s2,⋯∈Ss_1, s_2, \dots \in \mathcal Ss1​,s2​,⋯∈S form a fixed sequence (an oblivious adversary).
  • For ε>0\varepsilon > 0ε>0, UUU is the uniform law on the cube [0,1/ε]n[0, 1/\varepsilon]^n[0,1/ε]n and μ\muμ is the Laplace law with density dμ(x)=(ε/2)ne−ε∣x∣1d\mu(x) = (\varepsilon/2)^n e^{-\varepsilon |x|_1}dμ(x)=(ε/2)ne−ε∣x∣1​.

The four algorithms, period ttt:

  1. FPL(ε\varepsilonε) plays M(s1:t−1+p)M(s_{1:t-1} + p)M(s1:t−1​+p) with p∼Up \sim Up∼U; FPL*(ε\varepsilonε) does the same with p∼μp \sim \mup∼μ.
  2. FLL(ε\varepsilonε) draws one offset p∼Up \sim Up∼U at the start, which fixes the grid G={p+1εz:z∈Zn}G = \{p + \tfrac1\varepsilon z : z \in \mathbb Z^n\}G={p+ε1​z:z∈Zn}, and plays M(gt−1)M(g_{t-1})M(gt−1​), where the grid point gt−1=g(s1:t−1,p)g_{t-1} = g(s_{1:t-1}, p)gt−1​=g(s1:t−1​,p) is the unique point of GGG in s1:t−1+[0,1/ε)ns_{1:t-1} + [0, 1/\varepsilon)^ns1:t−1​+[0,1/ε)n.
  3. FLL*(ε\varepsilonε) draws p1∼μp_1 \sim \mup1​∼μ, plays M(s1:t−1+pt)M(s_{1:t-1} + p_t)M(s1:t−1​+pt​), and then sets pt+1=pt−stp_{t+1} = p_t - s_tpt+1​=pt​−st​ with probability min⁡{1,dμ(pt−st)/dμ(pt)}\min\{1, d\mu(p_t - s_t)/d\mu(p_t)\}min{1,dμ(pt​−st​)/dμ(pt​)} and pt+1=−ptp_{t+1} = -p_tpt+1​=−pt​ otherwise. Accepting keeps the evaluation point fixed: s1:t+pt+1=s1:t−1+pts_{1:t} + p_{t+1} = s_{1:t-1} + p_ts1:t​+pt+1​=s1:t−1​+pt​. The law of ptp_tpt​ is written νt\nu_tνt​.

Formalization targets

Goal: Lemma 1.2 (p. 295)

For every period t≥1t \ge 1t≥1:

Ep∼U[st⋅M(g(s1:t−1,p))]=Ep∼U[st⋅M(s1:t−1+p)],Pr⁡p∼U[gt−1≠gt]≤εA,\mathbb E_{p\sim U}\big[s_t \cdot M(g(s_{1:t-1}, p))\big] = \mathbb E_{p\sim U}\big[s_t \cdot M(s_{1:t-1} + p)\big], \qquad \Pr_{p\sim U}[g_{t-1} \ne g_t] \le \varepsilon A,Ep∼U​[st​⋅M(g(s1:t−1​,p))]=Ep∼U​[st​⋅M(s1:t−1​+p)],p∼UPr​[gt−1​=gt​]≤εA, Ept∼νt[st⋅M(s1:t−1+pt)]=Ep∼μ[st⋅M(s1:t−1+p)],Pr⁡[s1:t+pt+1≠s1:t−1+pt]≤εA.\mathbb E_{p_t\sim \nu_t}\big[s_t \cdot M(s_{1:t-1} + p_t)\big] = \mathbb E_{p\sim \mu}\big[s_t \cdot M(s_{1:t-1} + p)\big], \qquad \Pr\big[s_{1:t} + p_{t+1} \ne s_{1:t-1} + p_t\big] \le \varepsilon A .Ept​∼νt​​[st​⋅M(s1:t−1​+pt​)]=Ep∼μ​[st​⋅M(s1:t−1​+p)],Pr[s1:t​+pt+1​=s1:t−1​+pt​]≤εA.

The first line is the FLL half, the second the FLL* half. The constant εA\varepsilon AεA is the paper's.

Milestones

  1. Lemma 3.2 (p. 300): U({x:x−v∈[0,1/ε]n})≥1−ε∣v∣1U(\{x : x - v \in [0,1/\varepsilon]^n\}) \ge 1 - \varepsilon |v|_1U({x:x−v∈[0,1/ε]n})≥1−ε∣v∣1​.
  2. The grid point is uniform (pp. 302–303): g(x,p)g(x, p)g(x,p) with p∼Up \sim Up∼U has the law of x+px + px+p.
  3. FLL update bound (p. 303): Pr⁡p∼U[g(x,p)≠g(x+v,p)]≤ε∣v∣1\Pr_{p\sim U}[g(x,p) \ne g(x+v,p)] \le \varepsilon |v|_1Prp∼U​[g(x,p)=g(x+v,p)]≤ε∣v∣1​.
  4. Display (8) (p. 304): one FLL* update maps μ\muμ to μ\muμ.
  5. Induction (p. 304): νt=μ\nu_t = \muνt​=μ for every t≥1t \ge 1t≥1.
  6. Switching bound (p. 304): for any law of ptp_tpt​, Pr⁡[pt+1≠pt−v]≤ε∣v∣1\Pr[p_{t+1} \ne p_t - v] \le \varepsilon |v|_1Pr[pt+1​=pt​−v]≤ε∣v∣1​.

Significance

Lemma 1.2 transfers every guarantee proved for FPL and FPL* to FLL and FLL*: Theorem 1.1 of the paper bounds expected costs period by period, so equal per-period expectations give the same additive bound min-costT+εRAT+D/ε\text{min-cost}_T + \varepsilon RAT + D/\varepsilonmin-costT​+εRAT+D/ε and the same multiplicative bound for the lazy algorithms. In addition, the expected number of oracle calls and decision changes over TTT periods is at most εAT\varepsilon A TεAT, which is O(T)O(\sqrt T)O(T​) at the usual tuning ε∼1/T\varepsilon \sim 1/\sqrt Tε∼1/T​. The paper uses this for online binary search trees with few rotations.

The result is proved in the paper. As far as is known there is no machine-checked proof of it. This mission produces a Lean statement of all four claims and of the six steps of the proof, against explicit Lean definitions of the grid point, the FLL* step and the law sequence νt\nu_tνt​. The uniformity of a random-grid point and the invariance of a Laplace law under a Metropolis-type step are reusable facts beyond online learning.

Difficulty

The FLL half asks for the exact law of the grid point g(x,p)g(x, p)g(x,p), a piecewise translation of ppp whose pieces depend on xxx. The page settles it in one line ("by symmetry"); in Lean it is an equality of push-forward measures, and the obvious attempt, a single change of variables p↦p+cp \mapsto p + cp↦p+c, fails because the shift ccc is different on different pieces of the cube.

The FLL* half is a statement about measures on Rn×Rn\mathbb R^n \times \mathbb R^nRn×Rn given as a mixture of point masses. The page argues with densities, pointwise in xxx; the formal statement is an equality of measures, with the update written as a Measure.bind against a kernel whose two branches move mass in different directions. The density computation of display (8) does not by itself give this equality.

Formalization scope

  • Vectors are Fin n → ℝ, d⋅sd \cdot sd⋅s is dotProduct, ∣x∣1|x|_1∣x∣1​ is written out as ∑ i, |x i|. States are indexed from 1; s 0 is unused.
  • s1:ts_{1:t}s1:t​ is prefixSum and UUU is perturbLaw n ε from the published definition OracleRO.ApproxFPL.FPL. The oracle is the predicate IsArgminOracle Dset M, and every statement holds for every such MMM.
  • The Laplace law laplaceLaw n ε carries its normalising constant (ε/2)n(\varepsilon/2)^n(ε/2)n, so it is a probability measure for ε>0\varepsilon > 0ε>0.
  • The grid point fllGridPoint ε x p is the explicit formula pi+⌈ε(xi−pi)⌉/εp_i + \lceil \varepsilon(x_i - p_i) \rceil / \varepsilonpi​+⌈ε(xi​−pi​)⌉/ε. It is the unique grid point in the half-open cube for ε>0\varepsilon > 0ε>0, and it is measurable. The half-open and closed cubes differ by a null set, and the closed-cube law is used throughout.
  • The FLL* update is the joint law fllStarJoint ε v ν of (pt,pt+1)(p_t, p_{t+1})(pt​,pt+1​), built with Measure.bind and Measure.dirac. The acceptance probability is min⁡{1,e−ε(∣p−v∣1−∣p∣1)}\min\{1, e^{-\varepsilon(|p-v|_1 - |p|_1)}\}min{1,e−ε(∣p−v∣1​−∣p∣1​)}. The law fllStarLaw ε s t is the recursion started at μ\muμ, not μ\muμ itself.
  • "Performing an update" on period ttt means gt−1≠gtg_{t-1} \ne g_tgt−1​=gt​ for FLL and s1:t+pt+1≠s1:t−1+pts_{1:t} + p_{t+1} \ne s_{1:t-1} + p_ts1:t​+pt+1​=s1:t−1​+pt​ for FLL*.
  • Hypotheses not on the page: measurability of MMM and ε>0\varepsilon > 0ε>0.

The formalization rules out the following trivializations:

  • the grid point is not a Classical.choose;
  • the integrands are bounded and measurable, because MMM maps into a set of finite diameter, so the expectations are not the junk value 000 of a non-integrable function;
  • νt\nu_tνt​ is defined by the chain and not as μ\muμ, so claim 3 does not compare a law with itself;
  • FLL's grid point is compared with FPL's point s1:t−1+ps_{1:t-1} + ps1:t−1​+p, not with itself.

Welcome contributions:

  • the uniformity of x+((p−x) mod L)x + ((p - x) \bmod L)x+((p−x)modL) under the uniform law on a box;
  • Measure.bind lemmas for finite mixtures of Dirac kernels;
  • the change of variables for the Laplace density under reflection and shift.

Selected references

  • A. Kalai, S. Vempala, Efficient algorithms for online decision problems, Journal of Computer and System Sciences 71(3):291–307, 2005. https://doi.org/10.1016/j.jcss.2004.10.016
  • J. Hannan, Approximation to Bayes risk in repeated play, Contributions to the Theory of Games III, Annals of Mathematics Studies 39, 97–139, 1957. https://doi.org/10.1515/9781400882151-005
  • A. Ben-Tal, E. Hazan, T. Koren, S. Mannor, Oracle-based robust optimization via online learning, Operations Research 63(3):628–638, 2015. https://doi.org/10.1287/opre.2015.1374
11 thms1 active userReviewed
Control TheoryStochastic Systems·Captain: mikedeng1

Utility Maximization in Incomplete Markets II: Under Closed Constraints, the Power-Utility Value Is x^γ exp(Y₀)/γ for the Quadratic BSDE (15), and an Optimal Strategy Exists (Theorem 14)Research Paper

Motivation

An investor who trades continuously in a market driven by Brownian motion, and who may only hold portfolios in a prescribed set, wants to maximize the expected utility of terminal wealth. With power utility Uγ(x)=1γxγU_\gamma(x)=\frac1\gamma x^\gammaUγ​(x)=γ1​xγ, γ∈(0,1)\gamma\in(0,1)γ∈(0,1), this is the constant-relative-risk-aversion problem that goes back to Merton (Merton 1971). When there are fewer stocks than sources of noise the market is incomplete, and when portfolio proportions are restricted (no short sales, bounded positions, a fixed allocation) the problem is constrained.

For convex constraints, duality methods settle the problem (Cvitanić–Karatzas 1992; Kramkov–Schachermayer 1999). They do not apply when the constraint set is closed but not convex, as for integer-lot or "all-or-nothing" restrictions. Hu, Imkeller and Müller (2005, arXiv:math/0508448) treat that case by a martingale optimality principle: they build a process that is a supermartingale for every admissible strategy and a martingale for one, and obtain it from a backward stochastic differential equation (BSDE) with a driver that grows quadratically in zzz. The existence theory for such equations is due to Kobylanski (2000).

This mission formalizes the power-utility result, Theorem 14 of the paper. A companion mission treats the exponential-utility result, Theorem 7.

Setting

Fix a horizon T>0T>0T>0 and a probability space (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) carrying an mmm-dimensional Brownian motion WWW; F\mathbb FF is the augmentation of its natural filtration. ∣⋅∣|\cdot|∣⋅∣ is the Euclidean norm, and λ\lambdaλ is Lebesgue measure on [0,T][0,T][0,T].

Market. There is a bond with zero interest and d≤md\le md≤m stocks with prices dSti/Sti=bti dt+σti dWtdS^i_t/S^i_t=b^i_t\,dt+\sigma^i_t\,dW_tdSti​/Sti​=bti​dt+σti​dWt​. The rates bt∈Rdb_t\in\mathbb R^dbt​∈Rd and the volatility σt∈Rd×m\sigma_t\in\mathbb R^{d\times m}σt​∈Rd×m are predictable and uniformly bounded, and KId≥σtσttr≥εIdKI_d\ge\sigma_t\sigma_t^{\mathrm{tr}}\ge\varepsilon I_dKId​≥σt​σttr​≥εId​ for constants K>ε>0K>\varepsilon>0K>ε>0. The market price of risk is θt=σttr(σtσttr)−1bt∈Rm\theta_t=\sigma_t^{\mathrm{tr}}(\sigma_t\sigma_t^{\mathrm{tr}})^{-1}b_t\in\mathbb R^mθt​=σttr​(σt​σttr​)−1bt​∈Rm.

Constraints. A closed set C~⊆R1×d\tilde C\subseteq\mathbb R^{1\times d}C~⊆R1×d of row vectors constrains the proportions ρ~t\tilde\rho_tρ~​t​ of wealth held in the stocks. In the variable ρt=ρ~tσt∈R1×m\rho_t=\tilde\rho_t\sigma_t\in\mathbb R^{1\times m}ρt​=ρ~​t​σt​∈R1×m the constraint reads ρt∈Ct(ω)=C~σt(ω)\rho_t\in C_t(\omega)=\tilde C\sigma_t(\omega)ρt​∈Ct​(ω)=C~σt​(ω). For a closed C⊆RmC\subseteq\mathbb R^mC⊆Rm, dist⁡C(a)=min⁡b∈C∣a−b∣\operatorname{dist}_C(a)=\min_{b\in C}|a-b|distC​(a)=minb∈C​∣a−b∣, and ΠC(a)={b∈C:∣a−b∣=dist⁡C(a)}\Pi_C(a)=\{b\in C:|a-b|=\operatorname{dist}_C(a)\}ΠC​(a)={b∈C:∣a−b∣=distC​(a)} is the (possibly multi-valued) projection.

Wealth and admissible strategies. From initial capital x>0x>0x>0 the wealth (11) is

Xt(ρ)=xexp⁡(∫0tρs dWs+∫0tρsθs ds−12∫0t∣ρs∣2 ds).X^{(\rho)}_t=x\exp\Big(\int_0^t\rho_s\,dW_s+\int_0^t\rho_s\theta_s\,ds-\tfrac12\int_0^t|\rho_s|^2\,ds\Big).Xt(ρ)​=xexp(∫0t​ρs​dWs​+∫0t​ρs​θs​ds−21​∫0t​∣ρs​∣2ds).

The admissible class A~\tilde{\mathcal A}A~ (Definition 13) consists of predictable ρ\rhoρ with ρt∈Ct\rho_t\in C_tρt​∈Ct​ for λ⊗P\lambda\otimes Pλ⊗P-a.e. (t,ω)(t,\omega)(t,ω) and ∫0T∣ρs∣2 ds<∞\int_0^T|\rho_s|^2\,ds<\infty∫0T​∣ρs​∣2ds<∞ a.s. The value is (12), Vˉ(x)=sup⁡ρ∈A~E[Uγ(XT(ρ))]\bar V(x)=\sup_{\rho\in\tilde{\mathcal A}}E[U_\gamma(X^{(\rho)}_T)]Vˉ(x)=supρ∈A~​E[Uγ​(XT(ρ)​)].

The BSDE. H∞(R)\mathcal H^\infty(\mathbb R)H∞(R) is the class of predictable, λ⊗P\lambda\otimes Pλ⊗P-a.e. bounded processes and H2(Rm)\mathcal H^2(\mathbb R^m)H2(Rm) that of predictable ZZZ with E∫0T∣Zt∣2 dt<∞E\int_0^T|Z_t|^2\,dt<\inftyE∫0T​∣Zt​∣2dt<∞. The BSDE (15) is

Yt=0−∫tTZs dWs−∫tTf(s,Zs) ds,f(t,z)=γ(1−γ)2dist⁡2(z+θt1−γ,Ct)−γ∣z+θt∣22(1−γ)−12∣z∣2.Y_t=0-\int_t^TZ_s\,dW_s-\int_t^Tf(s,Z_s)\,ds,\qquad f(t,z)=\frac{\gamma(1-\gamma)}2\operatorname{dist}^2\Big(\frac{z+\theta_t}{1-\gamma},C_t\Big)-\frac{\gamma|z+\theta_t|^2}{2(1-\gamma)}-\frac12|z|^2 .Yt​=0−∫tT​Zs​dWs​−∫tT​f(s,Zs​)ds,f(t,z)=2γ(1−γ)​dist2(1−γz+θt​​,Ct​)−2(1−γ)γ∣z+θt​∣2​−21​∣z∣2.

A BMO martingale ∫0⋅ξ dW\int_0^\cdot\xi\,dW∫0⋅​ξdW is one with sup⁡τ∥E[∫τT∣ξs∣2ds∣Fτ]∥∞<∞\sup_\tau\|E[\int_\tau^T|\xi_s|^2ds\mid\mathcal F_\tau]\|_\infty<\inftysupτ​∥E[∫τT​∣ξs​∣2ds∣Fτ​]∥∞​<∞ over stopping times τ≤T\tau\le Tτ≤T (equation (2)).

Formalization targets

Goal: Theorem 14

(15) has a unique solution (Y,Z)∈H∞(R)×H2(Rm)(Y,Z)\in\mathcal H^\infty(\mathbb R)\times\mathcal H^2(\mathbb R^m)(Y,Z)∈H∞(R)×H2(Rm), and for x>0x>0x>0

Vˉ(x)=1γ xγexp⁡(Y0),\bar V(x)=\frac1\gamma\,x^\gamma\exp(Y_0),Vˉ(x)=γ1​xγexp(Y0​),

attained by some ρ∗∈A~\rho^*\in\tilde{\mathcal A}ρ∗∈A~ with

ρt∗∈ΠCt(ω)(11−γ(Zt+θt)).(16)\rho^*_t\in\Pi_{C_t(\omega)}\Big(\frac1{1-\gamma}(Z_t+\theta_t)\Big).\qquad(16)ρt∗​∈ΠCt​(ω)​(1−γ1​(Zt​+θt​)).(16)

The page prints V(x)=xγexp⁡(Y0)V(x)=x^\gamma\exp(Y_0)V(x)=xγexp(Y0​); its proof measures utility by xγx^\gammaxγ, so the value of (12) with Uγ=1γxγU_\gamma=\frac1\gamma x^\gammaUγ​=γ1​xγ carries the factor 1γ\frac1\gammaγ1​ (see Formalization scope).

Milestones

  1. (14), p. 17: for ρ∈C\rho\in Cρ∈C, γρθ−12γ∣ρ∣2+f(z)≤−12∣γρ+z∣2\gamma\rho\theta-\frac12\gamma|\rho|^2+f(z)\le-\frac12|\gamma\rho+z|^2γρθ−21​γ∣ρ∣2+f(z)≤−21​∣γρ+z∣2, with equality on ΠC(z+θ1−γ)\Pi_C\big(\frac{z+\theta}{1-\gamma}\big)ΠC​(1−γz+θ​).
  2. (H1), p. 18: ∣f(t,z)∣≤c0+c1∣z∣2|f(t,z)|\le c_0+c_1|z|^2∣f(t,z)∣≤c0​+c1​∣z∣2.
  3. Existence and 4. uniqueness for (15), p. 18.
  4. Lemma 17, p. 20: ∫Z dW\int Z\,dW∫ZdW and ∫ρ∗dW\int\rho^*dW∫ρ∗dW are BMO martingales.
  5. Optimality of ρ∗\rho^*ρ∗, p. 18: ρ∗∈A~\rho^*\in\tilde{\mathcal A}ρ∗∈A~ and E[(XT(ρ∗))γ]=xγexp⁡(Y0)E[(X^{(\rho^*)}_T)^\gamma]=x^\gamma\exp(Y_0)E[(XT(ρ∗)​)γ]=xγexp(Y0​).
  6. Comparison, p. 18: E[(XT(ρ))γ]≤xγexp⁡(Y0)E[(X^{(\rho)}_T)^\gamma]\le x^\gamma\exp(Y_0)E[(XT(ρ)​)γ]≤xγexp(Y0​) for every ρ∈A~\rho\in\tilde{\mathcal A}ρ∈A~.

Significance

The theorem gives the value of a constrained power-utility problem in closed form through one scalar, Y0Y_0Y0​, of a BSDE, and identifies an optimal strategy as a measurable selection of a projection onto the constraint set. Convexity of the constraint is not needed; when C~\tilde CC~ is a convex cone the result recovers the strategy obtained by other methods (Remark 16 of the paper). The same scheme handles exponential and logarithmic utility in the paper's other sections, and the dynamic programming principle of Proposition 15 follows from it.

The result is proved in the paper. As far as the platform's records show, none of it is formalized: there is no quadratic BSDE, no BMO martingale and no continuous-time utility-maximization statement on the platform. A complete formalization would add an existence and uniqueness theory for BSDEs with quadratic growth, the BMO criterion for stochastic exponentials, and a verification theorem for constrained portfolio problems, each reusable well beyond this paper.

Difficulty

The verification argument is short on paper; its inputs are not. Existence for (15) rests on Kobylanski's existence theorem for drivers of quadratic growth, which is not in Mathlib; the Lipschitz theory does not cover a driver growing like ∣z∣2|z|^2∣z∣2. Uniqueness needs a comparison principle for such drivers. Lemma 17 and the martingale property of R~(ρ∗)\tilde R^{(\rho^*)}R~(ρ∗) need the theory of BMO martingales and of their stochastic exponentials, also absent. The comparison milestone concerns processes that are only local supermartingales. A naive attempt that treats R~(ρ)\tilde R^{(\rho)}R~(ρ) as a martingale for every admissible ρ\rhoρ fails: for a general ρ∈A~\rho\in\tilde{\mathcal A}ρ∈A~, which is only locally square integrable, it is merely a local supermartingale.

Formalization scope

All declarations live in HuImkellerMuller.Power. Time is ℝ≥0; vectors of R1×m\mathbb R^{1\times m}R1×m are EuclideanSpace ℝ (Fin m), with products zθz\thetazθ as inner products; C~\tilde CC~ is a Set (Fin d → ℝ). The Brownian motion, the augmented filtration, the measure λ⊗P\lambda\otimes Pλ⊗P and the Itô-integral operator I are reused from published definitions (EthierKurtz_IsStandardBrownian, CvitanicKaratzas92_Optimality_Market). The wealth is constructed from I, ρ\rhoρ and θ\thetaθ; θ\thetaθ is computed from bbb and σ\sigmaσ.

Conventions and disclosed readings:

  • The factor 1γ\frac1\gammaγ1​. The goal states Vˉ(x)=1γxγexp⁡(Y0)\bar V(x)=\frac1\gamma x^\gamma\exp(Y_0)Vˉ(x)=γ1​xγexp(Y0​) for (12) with UγU_\gammaUγ​; milestones 6–7 state E[(XT)γ]E[(X_T)^\gamma]E[(XT​)γ] against xγexp⁡(Y0)x^\gamma\exp(Y_0)xγexp(Y0​), as the proof does.
  • Added hypothesis C~≠∅\tilde C\neq\emptysetC~=∅ (needed for (4) and for ΠCt≠∅\Pi_{C_t}\neq\emptysetΠCt​​=∅).
  • Strategies are written in ρ=ρ~σ∈Rm\rho=\tilde\rho\sigma\in\mathbb R^mρ=ρ~​σ∈Rm (Definition 13 says "ddd-dimensional"); §3's "Cˉ2⊆Rd\bar C_2\subseteq\mathbb R^dCˉ2​⊆Rd" and C~\tilde CC~ are one closed set.
  • (16) and the constraint hold λ⊗P\lambda\otimes Pλ⊗P-a.e.; "ρ∗\rho^*ρ∗ given by (16)" means any predictable selection.
  • Y0Y_0Y0​ is a.s. constant; the value identity holds for PPP-a.e. ω\omegaω.
  • Uniqueness means Yt1=Yt2Y^1_t=Y^2_tYt1​=Yt2​ a.s. for every ttt and Z1=Z2Z^1=Z^2Z1=Z2 λ⊗P\lambda\otimes Pλ⊗P-a.e.
  • Expectations of nonnegative quantities are lower integrals in [0,∞][0,\infty][0,∞]; the value is a supremum in [0,∞][0,\infty][0,∞].
  • Ellipticity holds for PPP-a.e. ω\omegaω and every t≤Tt\le Tt≤T; boundedness of bbb, σ\sigmaσ holds everywhere.

The value is a supremum of lower integrals, never of Bochner integrals: a Bochner expectation of a non-integrable Uγ(XT)U_\gamma(X_T)Uγ​(XT​) is 000 and would make the supremum meaningless. The goal asserts existence of a solution of (15) and does not take one as a hypothesis, so it cannot hold vacuously.

Contributions welcome: a theory of BSDEs with quadratic growth (Kobylanski), BMO martingales and Kazamaki's criterion, measurable selection of metric projections, and proofs of the deterministic milestone (14) and the growth bound (H1).

Selected references

  • Y. Hu, P. Imkeller, M. Müller, Utility maximization in incomplete markets, Ann. Appl. Probab. 15(3), 2005, 1691–1712. https://doi.org/10.1214/105051605000000188 (arXiv:math/0508448v1, https://arxiv.org/abs/math/0508448)
  • M. Kobylanski, Backward stochastic differential equations and partial differential equations with quadratic growth, Ann. Probab. 28(2), 2000, 558–602. https://doi.org/10.1214/aop/1019160253
  • N. Kazamaki, Continuous Exponential Martingales and BMO, Lecture Notes in Math. 1579, Springer, 1994. https://doi.org/10.1007/BFb0073585
  • J. Cvitanić, I. Karatzas, Convex duality in constrained portfolio optimization, Ann. Appl. Probab. 2(4), 1992, 767–818. https://doi.org/10.1214/aoap/1177005576
  • D. Kramkov, W. Schachermayer, The asymptotic elasticity of utility functions and optimal investment in incomplete markets, Ann. Appl. Probab. 9(3), 1999, 904–950. https://doi.org/10.1214/aoap/1029962818
  • R. C. Merton, Optimum consumption and portfolio rules in a continuous-time model, J. Econom. Theory 3, 1971, 373–413. https://doi.org/10.1016/0022-0531(71)90038-X
16 thms1 active userReviewed
Linear OptimizationOperations Research·Captain: mikedeng1

Stochastic Machine Scheduling with Precedence Constraints 2: LP-Based Graham List Scheduling Is a (2 − 1/m + max{1, (m − 1)Δ/m})-Approximation for P|in-forest|E[Σ w_j C_j]Research Paper

Motivation

Scheduling jobs whose durations are uncertain is the normal situation in project management, manufacturing and computing: a job's processing time becomes known only when the job finishes, but a distribution for it is available in advance. Stochastic machine scheduling models this by random, independent processing times PjP_jPj​ and asks for a scheduling policy, a rule that decides online which jobs to start, using only the information observed so far, that minimizes the expected total weighted completion time E[∑jwjCj]\mathrm E[\sum_j w_jC_j]E[∑j​wj​Cj​]. Optimal policies are known only in a few special cases, and they can depend on the full conditional distributions of the remaining processing times, so the research focus has been on simple policies with provable performance guarantees.

Skutella and Uetz (SIAM J. Comput. 34(4), 2005) gave the first constant-factor guarantees for stochastic parallel-machine scheduling with precedence constraints. Their policies are list scheduling policies whose priority list comes from an optimal solution of a linear program built on the load inequalities of Möhring, Schulz and Uetz (J. ACM 46(6), 1999). This mission formalizes their second main result: for in-forest precedence constraints and no release dates, plain Graham list scheduling in LP order is a (2−1m+max⁡{1,m−1mΔ})(2-\tfrac1m+\max\{1,\tfrac{m-1}{m}\Delta\})(2−m1​+max{1,mm−1​Δ})-approximation.

Timeline.

  • 1966/1969: Graham shows list scheduling is a (2−1/m)(2-1/m)(2−1/m)-approximation for the makespan with precedence constraints, for any list.
  • 1999: Möhring, Schulz and Uetz prove the load inequalities for nonanticipatory policies and obtain constant guarantees for P ∣ rj ∣ E[∑wjCj]P\,|\,r_j\,|\,\mathrm E[\sum w_jC_j]P∣rj​∣E[∑wj​Cj​] without precedence constraints.
  • 2001: Chekuri, Motwani, Natarajan and Stein give, among other results, a 2-approximation for deterministic in-tree scheduling by list scheduling (their Lemma 4.16 contains the deterministic counterpart of Lemma 4.3 below).
  • 2005: Skutella and Uetz extend these ideas to stochastic processing times with precedence constraints (Theorem 4.1, general precedence; Theorem 4.5, in-forests).

Setting

There are a finite set VVV of jobs, m≥1m\ge1m≥1 identical parallel machines, and nonnegative weights wjw_jwj​. Jobs are processed nonpreemptively; each machine handles one job at a time. Precedence constraints form an acyclic digraph (V,A)(V,A)(V,A): an arc (i,j)(i,j)(i,j) means jjj starts only after iii completes. The constraints form an in-forest if each job has at most one successor. There are no release dates.

The processing times Pj≥0P_j\ge0Pj​≥0 are independent random variables. A realization is a vector ppp; a schedule assigns start times SjS_jSj​, with completion times Cj=Sj+pjC_j=S_j+p_jCj​=Sj​+pj​; it is feasible if it respects precedence and at most mmm jobs are in process at any time. A policy Π\PiΠ maps each realization to a feasible schedule, and it is nonanticipatory if what it has started by time ttt depends only on what has been observed by ttt (the processing times of completed jobs and which jobs are still running).

With μj=E[Pj]\mu_j=\mathrm E[P_j]μj​=E[Pj​] and Δ≥0\Delta\ge0Δ≥0 a common bound with Var⁡[Pj]≤Δμj2\operatorname{Var}[P_j]\le\Delta\mu_j^2Var[Pj​]≤Δμj2​ (i.e. CV[Pj]≤Δ\mathrm{CV}[P_j]\le\sqrt\DeltaCV[Pj​]≤Δ​), define

f(W)=12m((∑j∈Wμj)2+∑j∈Wμj2)−(m−1)(Δ−1)2m∑j∈Wμj2.f(W)=\frac1{2m}\Big(\Big(\sum_{j\in W}\mu_j\Big)^2+\sum_{j\in W}\mu_j^2\Big)-\frac{(m-1)(\Delta-1)}{2m}\sum_{j\in W}\mu_j^2 .f(W)=2m1​((j∈W∑​μj​)2+j∈W∑​μj2​)−2m(m−1)(Δ−1)​j∈W∑​μj2​.

The LP-relaxation minimizes ∑jwjCjLP\sum_jw_jC^{\mathrm{LP}}_j∑j​wj​CjLP​ subject to ∑j∈WμjCjLP≥f(W)\sum_{j\in W}\mu_jC^{\mathrm{LP}}_j\ge f(W)∑j∈W​μj​CjLP​≥f(W) for all W⊆VW\subseteq VW⊆V, CjLP≥CiLP+μjC^{\mathrm{LP}}_j\ge C^{\mathrm{LP}}_i+\mu_jCjLP​≥CiLP​+μj​ for arcs (i,j)(i,j)(i,j), and CjLP≥μjC^{\mathrm{LP}}_j\ge\mu_jCjLP​≥μj​. A priority list LLL sorts the jobs by nondecreasing CjLPC^{\mathrm{LP}}_jCjLP​; BjB_jBj​ is the set of jobs up to and including jjj in LLL, and AjA_jAj​ the jobs after jjj.

Graham's list scheduling starts, at every decision time, as many available jobs as possible in the order of LLL. For a schedule, a critical predecessor of jjj is a predecessor that completes last among jjj's predecessors, at a positive time; following critical predecessors backwards gives the critical chain of jjj, whose total processing time is ℓj(p)\ell_j(p)ℓj​(p).

Formalization targets

Goal: Theorem 4.5

For every feasible nonanticipatory policy Π\PiΠ,

E[∑jwjCjGraham(P)] ≤ (2−1m+max⁡{1,m−1mΔ}) E[∑jwjCjΠ(P)].\mathrm E\Big[\sum_jw_jC^{\mathrm{Graham}}_j(P)\Big]\ \le\ \Big(2-\frac1m+\max\Big\{1,\frac{m-1}m\Delta\Big\}\Big)\,\mathrm E\Big[\sum_jw_jC^\Pi_j(P)\Big].E[j∑​wj​CjGraham​(P)] ≤ (2−m1​+max{1,mm−1​Δ})E[j∑​wj​CjΠ​(P)].

Milestones

  • Lemma 4.3: in Graham's schedule for an in-forest, no job of AjA_jAj​ is processed during [rj(p),Sj(p)[[r_j(p),S_j(p)[[rj​(p),Sj​(p)[.
  • Lemma 4.4: E[Cj(P)]≤m−1mE[ℓj(P)]+1m∑i∈BjE[Pi]\mathrm E[C_j(P)]\le\frac{m-1}m\mathrm E[\ell_j(P)]+\frac1m\sum_{i\in B_j}\mathrm E[P_i]E[Cj​(P)]≤mm−1​E[ℓj​(P)]+m1​∑i∈Bj​​E[Pi​], together with its per-realization form.
  • Theorem 3.1: the load inequalities ∑j∈WE[Pj]E[CjΠ(P)]≥f(W)\sum_{j\in W}\mathrm E[P_j]\mathrm E[C^\Pi_j(P)]\ge f(W)∑j∈W​E[Pj​]E[CjΠ​(P)]≥f(W) for every nonanticipatory Π\PiΠ.
  • §3 LP-relaxation: the expected completion times of any policy are LP-feasible.
  • Lemma 3.3: 1m∑k∈Bjμk≤(1+max⁡{1,m−1mΔ})CjLP\frac1m\sum_{k\in B_j}\mu_k\le(1+\max\{1,\frac{m-1}m\Delta\})C^{\mathrm{LP}}_jm1​∑k∈Bj​​μk​≤(1+max{1,mm−1​Δ})CjLP​.
  • Critical-chain lower bound (§4, p. 798): ℓj(p)≤Cj(p)\ell_j(p)\le C_j(p)ℓj​(p)≤Cj​(p) in every feasible schedule.

Significance

The theorem gives a constant performance guarantee for stochastic in-forest scheduling, uniform in the distributions once their coefficients of variation are bounded. For NBUE distributions (exponential, uniform, Erlang, …), where Δ=1\Delta=1Δ=1, the guarantee is 3−1/m3-1/m3−1/m, compared with 3+223+2\sqrt23+22​ for general precedence constraints and release dates with Algorithm CMNS (Table 1, p. 792). The analysis shows that for in-forests, deliberate idle time is unnecessary: Lemma 4.3 replaces it.

The result is proved in the paper, partly by reference: Theorem 3.1 and Lemma 3.3 are cited from Möhring, Schulz and Uetz. To our knowledge none of these results has a machine-checked proof. A complete formalization requires the load inequalities of stochastic scheduling, which are of independent use for every LP-based stochastic scheduling result, and a reusable treatment of list schedules, critical chains and nonanticipatory policies.

Difficulty

Two parts carry the weight. The first is the load inequalities (Theorem 3.1): they hold for nonanticipatory policies only, because a policy's start time of job jjj must be independent of PjP_jPj​; turning the informal "dynamic view" of policies into a statement that yields this independence, and then the variance bookkeeping, is the probabilistic core. The second is Lemma 4.3: the naive argument "a waiting job of high priority blocks lower-priority jobs" fails for general precedence constraints, where Graham's algorithm can be arbitrarily bad; the in-forest structure is used through a counting argument at time rj(p)r_j(p)rj​(p), in which the critical predecessors of the jobs started at that time must be distinct.

Formalization scope

Lean represents jobs by a Fintype V, precedence by a relation A : V → V → Prop with acyclic transitive closure, and in-forests by "at most one outgoing arc". Schedules are start-time vectors in ℝ, with machine capacity by counting jobs in process on half-open intervals. Policies are maps from realizations to start times with an explicit nonanticipation condition. Graham's list scheduling is characterized by rules (feasibility, greedy, list order, decision times); critical chains are taken for every admissible tie-breaking selector. The CV bound includes E[Pj2]<∞\mathrm E[P_j^2]<\inftyE[Pj2​]<∞ and E[Pj]>0\mathrm E[P_j]>0E[Pj​]>0. Zero processing times are allowed.

Standing assumptions and disclosed additions: processing times are independent and nonnegative; the comparator policies have integrable completion times; the completion times and critical-chain lengths of Graham's schedule are assumed almost-everywhere measurable (the paper asserts measurability in §5 without proof); "α\alphaα-approximation" is stated against every comparator policy rather than an optimal one.

A trivializing formalization is ruled out: the comparator ranges over every feasible nonanticipatory policy with integrable completion times, CLPC^{\mathrm{LP}}CLP is optimal over all load inequalities W⊆VW\subseteq VW⊆V, and the Graham family must satisfy the rules for every nonnegative realization.

Welcome contributions: the load inequalities, existence and measurability of Graham schedules, and general lemmas on list schedules.

Selected references

  • M. Skutella and M. Uetz, Stochastic machine scheduling with precedence constraints, SIAM J. Comput. 34(4) (2005) 788–802. https://doi.org/10.1137/S0097539702415007
  • R. H. Möhring, A. S. Schulz and M. Uetz, Approximation in stochastic scheduling: the power of LP-based priority policies, J. ACM 46(6) (1999) 924–942. https://doi.org/10.1145/331524.331530
  • C. Chekuri, R. Motwani, B. Natarajan and C. Stein, Approximation techniques for average completion time scheduling, SIAM J. Comput. 31(1) (2001) 146–166. https://doi.org/10.1137/S0097539797327180
  • R. L. Graham, Bounds on multiprocessing timing anomalies, SIAM J. Appl. Math. 17(2) (1969) 416–429. https://doi.org/10.1137/0117039
  • R. H. Möhring, F. J. Radermacher and G. Weiss, Stochastic scheduling problems I: General strategies, Z. Oper. Res. 28 (1984) 193–260. https://doi.org/10.1007/BF01919323
11 thms1 active userReviewed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

Primal and Dual Linear Decision Rules in Stochastic and Robust Optimization 3: In Multistage Programs, the Primal and Dual Linear Decision Rule Problems Equal the LPs (4.2) and (4.6)Research Paper

Motivation

A linear multistage stochastic program chooses decisions over TTT stages while a random vector is revealed one piece at a time; each decision may depend only on what has been observed so far. Such programs model production planning, capacity expansion, hydro scheduling and portfolio problems. Computing their optimal value exactly is intractable in general: Shapiro and Nemirovski argue that even medium-accuracy solutions are out of reach when the number of stages grows (Shapiro–Nemirovski 2005), and already the one-stage problem is #P-hard (Dyer–Stougie 2006, Theorem 3.2, as cited by the paper).

Linear decision rules restrict every decision to be an affine function of the observations. Introduced for robust optimization by Ben-Tal, Goryashko, Guslitzer and Nemirovski (2004) and carried into stochastic programming by Shapiro and Nemirovski and by Chen, Sim, Sun and Zhang (2008), they turn the problem into a finite one whose optimal value is an upper bound. Kuhn, Wiesemann and Georghiou (Optimization Online 2009/02/2218; Math. Program. 130, 2011) apply the same restriction to the dual problem, which yields a lower bound. They show that, for polyhedral supports, both bounds are values of explicit linear programs. This mission formalizes the multistage version of that statement, Theorem 3 of the preprint.

Setting

Stages are t∈T={1,…,T}t \in \mathbb T = \{1,\dots,T\}t∈T={1,…,T}. The uncertainty is ξ=(ξ1,…,ξT)∈Rk\xi = (\xi_1,\dots,\xi_T) \in \mathbb R^kξ=(ξ1​,…,ξT​)∈Rk with ξt∈Rkt\xi_t \in \mathbb R^{k_t}ξt​∈Rkt​ and k=∑tktk = \sum_t k_tk=∑t​kt​; by convention k1=1k_1 = 1k1​=1 and ξ1=1\xi_1 = 1ξ1​=1. The history at stage ttt is ξt=(ξ1,…,ξt)∈Rkt\xi^t = (\xi_1,\dots,\xi_t) \in \mathbb R^{k^t}ξt=(ξ1​,…,ξt​)∈Rkt, kt=∑s≤tksk^t = \sum_{s\le t} k_skt=∑s≤t​ks​, and the truncation operator Pt=[ I  0 ]∈Rkt×kP_t = [\,I\ \ 0\,] \in \mathbb R^{k^t\times k}Pt​=[I  0]∈Rkt×k maps ξ\xiξ to ξt\xi^tξt. The law P\mathbb PP of ξ\xiξ has support Ξ={ξ:Wξ≥h}\Xi = \{\xi : W\xi \ge h\}Ξ={ξ:Wξ≥h}, a nonempty bounded polyhedron spanning Rk\mathbb R^kRk, whose first two constraints encode ξ1=1\xi_1 = 1ξ1​=1. Et\mathbb E_tEt​ denotes conditional expectation given ξt\xi^tξt, and M=E(ξξ⊤)M = \mathbb E(\xi\xi^\top)M=E(ξξ⊤) is the second-order moment matrix.

A stage-ttt decision is a square-integrable Borel function xtx_txt​ of ξt\xi^tξt (written xt∈Lkt,nt2x_t \in \mathcal L^2_{k^t,n_t}xt​∈Lkt,nt​2​). The program MSP\mathcal{MSP}MSP minimizes

E(∑t=1Tct(ξt)⊤xt(ξt))subject toEt(∑s=1TAtsxs(ξs))≤bt(ξt)  P-a.s., t∈T,\mathbb E\Big(\sum_{t=1}^T c_t(\xi^t)^\top x_t(\xi^t)\Big) \quad\text{subject to}\quad \mathbb E_t\Big(\sum_{s=1}^T A_{ts}x_s(\xi^s)\Big) \le b_t(\xi^t)\ \ \mathbb P\text{-a.s.},\ t\in\mathbb T,E(t=1∑T​ct​(ξt)⊤xt​(ξt))subject toEt​(s=1∑T​Ats​xs​(ξs))≤bt​(ξt)  P-a.s., t∈T,

with deterministic matrices AtsA_{ts}Ats​, ct(ξt)=CtPtξc_t(\xi^t) = C_tP_t\xict​(ξt)=Ct​Pt​ξ and bt(ξt)=BtPtξb_t(\xi^t) = B_tP_t\xibt​(ξt)=Bt​Pt​ξ. The linear conditional mean assumption requires Et(ξ)=MtPtξ\mathbb E_t(\xi) = M_tP_t\xiEt​(ξ)=Mt​Pt​ξ almost surely for some Mt∈Rk×ktM_t \in \mathbb R^{k\times k^t}Mt​∈Rk×kt; it holds, for example, for stagewise independent data.

The primal approximation MSPu\mathcal{MSP}^uMSPu sets xt(ξt)=XtPtξx_t(\xi^t) = X_tP_t\xixt​(ξt)=Xt​Pt​ξ and slacks st(ξt)=StPtξs_t(\xi^t) = S_tP_t\xist​(ξt)=St​Pt​ξ. The dual approximation MSPl\mathcal{MSP}^lMSPl keeps general rules xt,stx_t, s_txt​,st​ but imposes the slack equations only in the weak form E([∑sAtsxs+st−bt][Ptξ]⊤)=0\mathbb E([\sum_s A_{ts}x_s + s_t - b_t][P_t\xi]^\top) = 0E([∑s​Ats​xs​+st​−bt​][Pt​ξ]⊤)=0. The linear programs (4.2) and (4.6) are written in the matrices XtX_tXt​, multipliers Λt\Lambda_tΛt​ and slack matrices StS_tSt​, with Nt=MPt⊤(PtMPt⊤)−1N_t = MP_t^\top(P_tMP_t^\top)^{-1}Nt​=MPt⊤​(Pt​MPt⊤​)−1.

Formalization targets

Goal: Theorem 3 (p. 22)

Under the standing assumptions, the linear conditional mean assumption, and strict feasibility of MSP\mathcal{MSP}MSP,

val(MSPu)=val(4.2)and, if k≥2 or W^≠0,val(MSPl)=val(4.6),\mathrm{val}(\mathcal{MSP}^u) = \mathrm{val}(4.2) \qquad\text{and, if } k \ge 2 \text{ or } \hat W \ne 0,\qquad \mathrm{val}(\mathcal{MSP}^l) = \mathrm{val}(4.6),val(MSPu)=val(4.2)and, if k≥2 or W^=0,val(MSPl)=val(4.6),

as extended-real optimal values. Both equalities are part of the goal.

Milestones

  1. Lemma 2 (p. 20): for every xt∈Lkt,nt2x_t \in \mathcal L^2_{k^t,n_t}xt​∈Lkt,nt​2​ there is a unique XtX_tXt​ with XtPtM=E(xt(ξt)ξ⊤)X_tP_tM = \mathbb E(x_t(\xi^t)\xi^\top)Xt​Pt​M=E(xt​(ξt)ξ⊤), and likewise for slacks.
  2. Lemma 3 (p. 21): a moment condition StPtM=E(s(⋅)ξ⊤)S_tP_tM = \mathbb E(s(\cdot)\xi^\top)St​Pt​M=E(s(⋅)ξ⊤) with s≥0s \ge 0s≥0 can be met by a non-anticipative slack st(ξt)s_t(\xi^t)st​(ξt) iff it can be met by a slack depending on the full ξ\xiξ.
  3. §4, (4.7) (p. 21): through (4.3), the equality constraints of MSPl\mathcal{MSP}^lMSPl are equivalent to ∑sAtsXsPsNtPt+StPt=BtPt\sum_s A_{ts}X_sP_sN_tP_t + S_tP_t = B_tP_t∑s​Ats​Xs​Ps​Nt​Pt​+St​Pt​=Bt​Pt​.

Significance

The theorem makes both linear-decision-rule bounds on a multistage stochastic program computable by linear programming, with size polynomial in kkk, lll, ∑tmt\sum_t m_t∑t​mt​ and ∑tnt\sum_t n_t∑t​nt​ and hence typically linear in the number of stages. The gap between the two values measures the suboptimality of the primal linear rule. These results underlie later work on piecewise-linear and lifted decision rules and on multistage robust and distributionally robust optimization.

The preprint omits the proof of Theorem 3 ("it widely parallels the argumentation in Section 2"), so a formal proof has to supply the multistage details: the conditional-expectation bookkeeping, the truncation operators and the transfer of the one-stage cone description to non-anticipative slacks. No part of this paper has been machine-checked before; the companion mission of this series formalizes the one-stage Theorem 1.

Difficulty

The obvious route repeats the one-stage argument stage by stage, and it breaks at the slack constraints of MSPl\mathcal{MSP}^lMSPl. A slack sts_tst​ must be a function of ξt\xi^tξt alone, while the one-stage cone characterization of moment vectors E(s(ξ)ξ)\mathbb E(s(\xi)\xi)E(s(ξ)ξ) concerns functions of the full ξ\xiξ; Lemma 3 bridges them only through the linear conditional mean assumption and conditional expectations. A second difficulty is the closure gap between that cone and its polyhedral outer description: the equality of val(MSPl)\mathrm{val}(\mathcal{MSP}^l)val(MSPl) and val(4.6)\mathrm{val}(4.6)val(4.6) relies on strict feasibility, and a proof that ignores it is wrong. On the primal side, the passage from almost sure constraints to identities of matrices needs both that every point of Ξ\XiΞ is charged by P\mathbb PP and that Ξ\XiΞ spans Rk\mathbb R^kRk.

Formalization scope

Vectors are functions Fin d → ℝ; stage ttt is the Fin T index t−1t-1t−1 and coordinate 111 is index 0. The history dimension is kbar kk t, the truncation is the restriction to the first ktk^tkt coordinates, and PtP_tPt​ is also given as a 0/10/10/1 matrix. Et\mathbb E_tEt​ is Mathlib's condExp with respect to the σ-algebra generated by PtP_tPt​. "Ξ\XiΞ is the support of P\mathbb PP" means: Ξ\XiΞ closed, P(Ξc)=0\mathbb P(\Xi^c) = 0P(Ξc)=0, and every ball around a point of Ξ\XiΞ has positive mass. Decision rules are Borel functions of the history whose composition with PtP_tPt​ is in L2(P)L^2(\mathbb P)L2(P). Optimal values are infima in EReal (+∞+\infty+∞ if infeasible, −∞-\infty−∞ if unbounded), and "equivalent" means equal optimal values. The matrices MtM_tMt​ are data, with the conditional-mean identity as a hypothesis.

Three conventions are fixed where the page is silent or misprinted. Strict feasibility of MSP\mathcal{MSP}MSP, not defined in §4, is the analogue of (2.9) for the standard form (4.1): slacks at least ε>0\varepsilon > 0ε>0 almost surely. The equality constraint of MSPl\mathcal{MSP}^lMSPl is printed with st−bts_t - b_tst​−bt​ inside ∑s\sum_s∑s​; the formalization follows (4.7), where the sum covers only AtsxsA_{ts}x_sAts​xs​. The sign condition in (4.5c) is printed as s~t(ξt)≥0\tilde s_t(\xi^t) \ge 0s~t​(ξt)≥0 for a function of ξ\xiξ, and is read as s~t(ξ)≥0\tilde s_t(\xi) \ge 0s~t​(ξ)≥0. The theorem's last sentence (polynomial size, efficient solvability) is informal and not formalized. One hypothesis is added: the goal's second equality assumes k≥2k \ge 2k≥2 or that some row of W^\hat WW^ (the rows of WWW below (2.1b)) is nonzero (the first equality is stated without it). For k=1k = 1k=1 the support is the single point {1}\{1\}{1}, and if WWW has no nonzero row beyond (2.1b) the cone of Proposition 3 is all of R\mathbb RR; the printed second equality then fails (a strictly feasible one-stage instance has val(MSPl)=0\mathrm{val}(\mathcal{MSP}^l) = 0val(MSPl)=0 while (4.6) is unbounded below). The added hypothesis excludes exactly this case.

Expectations are Bochner integrals, which vanish on non-integrable functions; under the standing assumptions ξ\xiξ is bounded almost surely, so all integrands involving square-integrable rules are integrable and no constraint is satisfied vacuously. Matrix.inv returns 000 on singular matrices, but PtMPt⊤P_tMP_t^\topPt​MPt⊤​ is positive definite under the standing assumptions. The linear conditional mean hypothesis cannot be dropped from Lemmas 2 and 3: without it XtX_tXt​ need not exist.

A complete development needs the support and moment facts of §2 (M≻0M \succ 0M≻0, almost sure constraints extend to Ξ\XiΞ), Farkas-type duality for the polyhedron Ξ\XiΞ, the tower property of conditional expectation, and the cone results of Propositions 3 and 4 of the preprint. These are reusable across the series. Proofs of the milestones, or of these supporting facts as separate lemmas, are welcome.

Selected references

  • D. Kuhn, W. Wiesemann, A. Georghiou, Primal and dual linear decision rules in stochastic and robust optimization, Optimization Online preprint 2009/02/2218, 2009; Math. Program. 130:177–209, 2011. https://optimization-online.org/2009/02/2218/ ; https://doi.org/10.1007/s10107-009-0331-4
  • A. Ben-Tal, A. Goryashko, E. Guslitzer, A. Nemirovski, Adjustable robust solutions of uncertain linear programs, Math. Program. 99:351–376, 2004. https://doi.org/10.1007/s10107-003-0454-y
  • A. Shapiro, A. Nemirovski, On complexity of stochastic programming problems, in Continuous Optimization, Springer, 2005. https://doi.org/10.1007/0-387-26771-9_4
  • X. Chen, M. Sim, P. Sun, J. Zhang, A linear decision-based approximation approach to stochastic programming, Oper. Res. 56(2):344–357, 2008. https://doi.org/10.1287/opre.1070.0441
  • M. Dyer, L. Stougie, Computational complexity of stochastic programming problems, Math. Program. 106:423–432, 2006. https://doi.org/10.1007/s10107-005-0597-0
8 thms1 active userReviewed
PreviousPage 27 of 38Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me