Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Optimization

1,681 missions · 908 completed

Missions

Open773Completed908All1681
🏆Completed
Linear OptimizationOperations Research·Captain: mikedeng1

On the Power of Robust Solutions in Two-Stage Stochastic and Adaptive Optimization Problems 4: For Symmetric Cost and Right-Hand-Side Uncertainty, the Adaptability Gap Is at Most FourResearch Paper

Motivation

Two-stage optimization separates a decision made before uncertainty is observed from one made after a scenario is known. A fully adaptive policy can choose a different second-stage decision in each scenario, while a static robust solution commits to a single second-stage decision that works in every scenario. Static solutions can be simpler to implement, but their worst-case cost may be higher. Bertsimas and Goyal ask how large this cost difference can be when both the right-hand sides of the constraints and the second-stage prices vary. Their Theorem 5.1 gives a factor of four when the paired uncertainty set is symmetric and nonnegative, even when both stages contain integer variables.

The distinction matters in planning problems where one policy is fixed in advance and another could respond to realized demand or prices. A uniform bound lets a planner assess the cost of the static restriction without solving every adaptive policy exactly. The source is the authors' manuscript; all page and result numbers in this mission refer to that manuscript, not to the journal pagination.

Setting

Fix matrices A∈Rm×n1A\in\mathbb R^{m\times n_1}A∈Rm×n1​ and B∈Rm×n2B\in\mathbb R^{m\times n_2}B∈Rm×n2​. A scenario ω∈Ω\omega\in\Omegaω∈Ω supplies a right-hand side b(ω)∈R+mb(\omega)\in\mathbb R_+^mb(ω)∈R+m​ and a second-stage cost vector d(ω)∈R+n2d(\omega)\in\mathbb R_+^{n_2}d(ω)∈R+n2​​. The first-stage cost vector is c∈R+n1c\in\mathbb R_+^{n_1}c∈R+n1​​. For a set III of designated integer coordinates, write DID_IDI​ for the nonnegative real vectors whose coordinates in III are integers. After relabelling, this is the paper's R+n−p×Z+p\mathbb R_+^{n-p}\times\mathbb Z_+^pR+n−p​×Z+p​.

In the robust problem ΠRob(b,d)\Pi_{\mathrm{Rob}}(b,d)ΠRob​(b,d), one first-stage decision x∈DI1x\in D_{I_1}x∈DI1​​ and one second-stage decision y∈DI2y\in D_{I_2}y∈DI2​​ must satisfy Ax+By≥b(ω)Ax+By\ge b(\omega)Ax+By≥b(ω) for every scenario. Their cost is cTx+sup⁡ω∈Ωd(ω)Tyc^Tx+\sup_{\omega\in\Omega}d(\omega)^TycTx+supω∈Ω​d(ω)Ty. In the adaptive problem ΠAdapt(b,d)\Pi_{\mathrm{Adapt}}(b,d)ΠAdapt​(b,d), xxx is still chosen once, but y(ω)∈DI2y(\omega)\in D_{I_2}y(ω)∈DI2​​ may depend on the scenario. Its constraints are Ax+By(ω)≥b(ω)Ax+By(\omega)\ge b(\omega)Ax+By(ω)≥b(ω) for every ω\omegaω, and its cost is cTx+sup⁡ω∈Ωd(ω)Ty(ω)c^Tx+\sup_{\omega\in\Omega}d(\omega)^Ty(\omega)cTx+supω∈Ω​d(ω)Ty(ω). The optimal values zRob(b,d)z_{\mathrm{Rob}}(b,d)zRob​(b,d) and zAdapt(b,d)z_{\mathrm{Adapt}}(b,d)zAdapt​(b,d) are infima over feasible decisions in these respective problems; these are models (1.5)–(1.6).

The paired uncertainty set is I(b,d)(Ω)={(b(ω),d(ω)):ω∈Ω}I_{(b,d)}(\Omega)=\{(b(\omega),d(\omega)): \omega\in\Omega\}I(b,d)​(Ω)={(b(ω),d(ω)):ω∈Ω}. It is symmetric when it contains a point u0u^0u0 such that u0+zu^0+zu0+z belongs to the set exactly when u0−zu^0-zu0−z does, for every displacement zzz. The point u0u^0u0 is itself a scenario realization. The smallest coordinatewise bounding hypercube has lower and upper corners (bl,dl)(b^l,d^l)(bl,dl) and (bh,dh)(b^h,d^h)(bh,dh); its center is ((bl+bh)/2,(dl+dh)/2)((b^l+b^h)/2,(d^l+d^h)/2)((bl+bh)/2,(dl+dh)/2). These are Definition 1.2 and displays (2.5)–(2.7).

Formalization targets

The adaptability gap

The goal is Theorem 5.1:

zRob(b,d)≤4zAdapt(b,d).z_{\mathrm{Rob}}(b,d)\le 4z_{\mathrm{Adapt}}(b,d).zRob​(b,d)≤4zAdapt​(b,d).

The factor applies to every nonnegative symmetric paired uncertainty set and to both continuous and mixed-integer decisions. The theorem does not require an optimal adaptive policy to attain its infimum. The milestones record the source's geometric Lemma 2.3 and the estimates labelled (5.1)–(5.4), which supply the center-scenario cost and feasibility statements with the explicit factor four. They are stated for arbitrary feasible adaptive policies so the conclusion also covers nonattained infima.

Significance

The result bounds the price of committing to a single second-stage decision, despite uncertainty in both the constraints and the objective. In this setting the comparison is independent of the number of scenarios and of the dimensions m,n1,n2m,n_1,n_2m,n1​,n2​. The paper also considers right-hand-side-only uncertainty, positive sets, and hypercubes; this mission isolates its symmetric paired-uncertainty result §5.1.

The theorem is proved in the paper. The remaining formalization work is a machine-checked development of the model, the bounding-hypercube geometry, the cost inequalities, and the passage from arbitrary feasible policies to the optimal values. The resulting definitions of mixed-integer domains, robust and adaptive feasibility, and extended-real optimal values can also support the other results in this paper's mission series. The theorem statements here are open proof targets, with no machine-checked proofs claimed.

Difficulty

The worst-case maximizer of d(ω)Ty(ω)d(\omega)^Ty(\omega)d(ω)Ty(ω) can vary with ω\omegaω, and an adaptive policy can choose a different integer vector in every scenario. Selecting one of those vectors as a static decision therefore gives no immediate cost or feasibility guarantee. The point of symmetry is a realizable scenario, but it must control both components of every other paired scenario. Without nonnegative data, doubling the center-scenario decision may fail to cover a positive right-hand side, and the cost comparison can fail as well. Integer coordinates also constrain which scalings preserve the decision domain; the exact factor in the theorem is compatible with doubling, unlike arbitrary fractional rescalings.

Formalization scope

Vectors are real functions on finite index types, matrices use Mathlib's matrix-vector product, and inequalities are componentwise. The scenario set is the range of ω↦(b(ω),d(ω))\omega\mapsto(b(\omega),d(\omega))ω↦(b(ω),d(ω)), with a product-space symmetry predicate. No probability measure or measurability structure is used in these worst-case problems. Both stages may have integer coordinates designated by sets I1,I2I_1,I_2I1​,I2​; no continuous-only second-stage restriction is imposed.

Optimal values and worst-case costs use extended real numbers. An infeasible problem has value +∞+\infty+∞; a real infimum over an empty feasible set would incorrectly return a default zero. Symmetry includes a center belonging to the scenario range, so the scenario set is nonempty. Combined with nonnegative coordinates, symmetry bounds every scenario coordinate and makes the bounding-hypercube endpoints meaningful. The hypotheses retain c≥0c\ge0c≥0, b(ω)≥0b(\omega)\ge0b(ω)≥0, and d(ω)≥0d(\omega)\ge0d(ω)≥0, which the source uses in its factor-four estimate. A statement restricted to continuous recourse, an assumed optimal adaptive policy, or a zero-valued infeasible problem would not express this target.

The source prints Z+n2\mathbb Z_+^{n_2}Z+n2​​ in (1.5)–(1.6), although the model's second-stage integer count is p2p_2p2​; the domain here follows the surrounding p2p_2p2​ convention. Lemma 2.3 is stated here for nonnegative sets, the regime needed for its second inequality. Its coordinatewise suprema and infima agree with the printed maxima and minima in this bounded symmetric setting. Contributions to the shared domain and geometry lemmas, the mixed-integer scaling fact, and the optimal-value comparison are all useful to the goal.

Selected references

  • Dimitris Bertsimas and Vineet Goyal, On the Power of Robust Solutions in Two-Stage Stochastic and Adaptive Optimization Problems, authors' manuscript of Mathematics of Operations Research, 2010. DOI: 10.1287/moor.1090.0440.
9 thms2 active usersReviewed
🏆Completed
Algebraic GeometryDifferential GeometryLinear Optimization+1·Captain: mikedeng1

Log-Barrier Interior Point Methods Are Not Strongly Polynomial 2: The Total Curvature of the Central Path of LW_r(t) Exceeds (2^(r−2) − 1)π/2 − ε for All Large tResearch Paper

Motivation: curvature of the central path as a complexity measure

Path-following interior point methods solve a linear program by tracking its central path, a smooth curve that runs through the interior of the feasible set and ends at an optimal solution. Their number of iterations is polynomial in the bit size of the input, and whether some interior point method is strongly polynomial (bounded by a polynomial in the number of variables and constraints alone) is open. Bayer and Lagarias called the central path "a fundamental mathematical object underlying Karmarkar's algorithm". Dedieu and Shub proposed its total curvature as an informal complexity measure: a path that turns little should be easy to follow with straight steps. Several results bound that curvature:

  • 2005. Dedieu and Shub conjecture that the total curvature of the central path is bounded linearly in the dimension. Dedieu, Malajovich and Shub prove an O(n)O(n)O(n) bound on average over the regions of a hyperplane arrangement. De Loera, Sturmfels and Vinzant later obtain the same averaged bound with matroid methods (arXiv:1012.3978).
  • 2008–2009. Deza, Terlaky and Zinchenko build redundant Klee–Minty cubes and "snakes" with curvature Ω(m)\Omega(m)Ω(m) for mmm inequalities, which refutes the dimension version. They then conjecture the continuous analogue of the Hirsch conjecture: the total curvature is bounded linearly in the number of constraints.
  • 2014–2017. Allamigeon, Benchimol, Gaubert and Joswig disprove that conjecture with a family of linear programs whose central paths have curvature exponential in the number of constraints. The bound first appeared in arXiv:1405.4161 and was given an elementary tropical proof in arXiv:1708.01544v2, Theorem 25, which is the result of this mission.

Setting

A linear program in slack form has a real m×nm\times nm×n matrix AAA, b∈Rmb\in\mathbb R^mb∈Rm, c∈Rnc\in\mathbb R^nc∈Rn and N:=n+mN:=n+mN:=n+m:

LP(A,b,c): min⁡ ⟨c,x⟩  s.t. Ax+w=b, (x,w)≥0,DualLP(A,b,c): s−A⊤y=c, (s,y)≥0.\mathrm{LP}(A,b,c):\ \min\ \langle c,x\rangle\ \text{ s.t. } Ax+w=b,\ (x,w)\ge0,\qquad \mathrm{DualLP}(A,b,c):\ s-A^\top y=c,\ (s,y)\ge0 .LP(A,b,c): min ⟨c,x⟩  s.t. Ax+w=b, (x,w)≥0,DualLP(A,b,c): s−A⊤y=c, (s,y)≥0.

For μ>0\mu>0μ>0 the point of the central path (xμ,wμ,sμ,yμ)∈R2N(x^\mu,w^\mu,s^\mu,y^\mu)\in\mathbb R^{2N}(xμ,wμ,sμ,yμ)∈R2N is the unique solution of

Ax+w=b,s−A⊤y=c,xjsj=μ,wiyi=μ,x,w,s,y>0.(1)Ax+w=b,\quad s-A^\top y=c,\quad x_js_j=\mu,\quad w_iy_i=\mu,\quad x,w,s,y>0. \tag{1}Ax+w=b,s−A⊤y=c,xj​sj​=μ,wi​yi​=μ,x,w,s,y>0.(1)

The primal central path is μ↦(xμ,wμ)∈RN\mu\mapsto(x^\mu,w^\mu)\in\mathbb R^Nμ↦(xμ,wμ)∈RN.

For r≥1r\ge1r≥1 and t>0t>0t>0, the program LWr(t)\mathbf{LW}_r(t)LWr​(t) minimizes x1x_1x1​ over x∈R2rx\in\mathbb R^{2r}x∈R2r subject to

x1≤t2,x2≤t,x2j+1≤t x2j−1,x2j+1≤t x2j,x2j+2≤t1−1/2j(x2j−1+x2j)  (1≤j<r),x≥0.x_1\le t^2,\quad x_2\le t,\quad x_{2j+1}\le t\,x_{2j-1},\quad x_{2j+1}\le t\,x_{2j},\quad x_{2j+2}\le t^{1-1/2^j}(x_{2j-1}+x_{2j})\ \ (1\le j<r),\quad x\ge0 .x1​≤t2,x2​≤t,x2j+1​≤tx2j−1​,x2j+1​≤tx2j​,x2j+2​≤t1−1/2j(x2j−1​+x2j​)  (1≤j<r),x≥0.

With slacks w1,…,w3r−1w_1,\dots,w_{3r-1}w1​,…,w3r−1​ it becomes LWr=(t)=LP(A,b,c)\mathbf{LW}^=_r(t)=\mathrm{LP}(A,b,c)LWr=​(t)=LP(A,b,c) with n=2rn=2rn=2r, m=3r−1m=3r-1m=3r−1, N=5r−1N=5r-1N=5r−1.

For points U,V,WU,V,WU,V,W of Euclidean space with U≠V≠WU\ne V\ne WU=V=W, the turning angle ∠UVW∈[0,π]\angle UVW\in[0,\pi]∠UVW∈[0,π] is the angle between the vectors V−UV-UV−U and W−VW-VW−V. For a curve σ\sigmaσ parameterized over I⊆RI\subseteq\mathbb RI⊆R, the total curvature is

κ(σ,I)=sup⁡{∑k=1p−1∠ σ(μk−1)σ(μk)σ(μk+1) : μ0<⋯<μp in I}∈[0,+∞].\kappa(\sigma,I)=\sup\Big\{\sum_{k=1}^{p-1}\angle\,\sigma(\mu_{k-1})\sigma(\mu_k)\sigma(\mu_{k+1})\ :\ \mu_0<\dots<\mu_p\ \text{in } I\Big\}\in[0,+\infty].κ(σ,I)=sup{k=1∑p−1​∠σ(μk−1​)σ(μk​)σ(μk+1​) : μ0​<⋯<μp​ in I}∈[0,+∞].

The milestones also use the field K\mathbb KK of absolutely convergent generalized real Puiseux series ∑α∈Raαtα\sum_{\alpha\in\mathbb R}a_\alpha t^\alpha∑α∈R​aα​tα. Such a series can be evaluated at large real ttt, and it has a valuation val∈T=R∪{−∞}\mathrm{val}\in\mathbb T=\mathbb R\cup\{-\infty\}val∈T=R∪{−∞}, its leading exponent. Read over K\mathbb KK, LWr\mathbf{LW}_rLWr​ is one linear program. The valuation of its central path at μ=tλ\mu=t^\lambdaμ=tλ is the tropical central path Ctrop(λ)∈R2N\mathcal C^{\mathrm{trop}}(\lambda)\in\mathbb R^{2N}Ctrop(λ)∈R2N, a piecewise-linear curve with an explicit recursive description (Propositions 20–21 of the paper).

Formalization targets

Goal: Theorem 25

For every r≥1r\ge1r≥1 and ϵ>0\epsilon>0ϵ>0 there is t0t_0t0​ such that for all t>t0t>t_0t>t0​,

κ(μ↦(xμ,wμ),(0,∞))>(2r−2−1)π2−ϵandκ(μ↦(xμ,wμ,sμ,yμ),(0,∞))>(2r−2−1)π2−ϵ\kappa\big(\mu\mapsto(x^\mu,w^\mu),(0,\infty)\big)>\big(2^{r-2}-1\big)\tfrac\pi2-\epsilon\quad\text{and}\quad\kappa\big(\mu\mapsto(x^\mu,w^\mu,s^\mu,y^\mu),(0,\infty)\big)>\big(2^{r-2}-1\big)\tfrac\pi2-\epsilonκ(μ↦(xμ,wμ),(0,∞))>(2r−2−1)2π​−ϵandκ(μ↦(xμ,wμ,sμ,yμ),(0,∞))>(2r−2−1)2π​−ϵ

for the central path of LWr=(t)\mathbf{LW}^=_r(t)LWr=​(t). Here t0t_0t0​ may depend on rrr and ϵ\epsilonϵ. Both the primal and the primal-dual curves are part of the goal, as in the paper.

Milestones, in the order of the paper's argument

  1. Lemma 22: for non-null x,y∈Kd\mathbf x,\mathbf y\in\mathbb K^dx,y∈Kd, the angle ∠x(t)y(t)\angle\mathbf x(t)\mathbf y(t)∠x(t)y(t) has a limit, which is π/2\pi/2π/2 when the arg maxes of val x\mathrm{val}\,\mathbf xvalx and val y\mathrm{val}\,\mathbf yvaly are disjoint.
  2. Lemma 23: the turning angle ∠U(t)V(t)W(t)→π/2\angle\mathbf U(t)\mathbf V(t)\mathbf W(t)\to\pi/2∠U(t)V(t)W(t)→π/2 when max⁡val U<max⁡val V<max⁡val W\max\mathrm{val}\,\mathbf U<\max\mathrm{val}\,\mathbf V<\max\mathrm{val}\,\mathbf WmaxvalU<maxvalV<maxvalW and the arg maxes of val V\mathrm{val}\,\mathbf VvalV and val W\mathrm{val}\,\mathbf WvalW are disjoint.
  3. Proposition 24: lim inf⁡tκ(Ct,[tλ0,tλp])≥∑k=1p−1∠∗Ctrop(λk−1)Ctrop(λk)Ctrop(λk+1)\liminf_{t}\kappa(\mathcal C_t,[t^{\lambda_0},t^{\lambda_p}])\ge\sum_{k=1}^{p-1}\angle^*\mathcal C^{\mathrm{trop}}(\lambda_{k-1})\mathcal C^{\mathrm{trop}}(\lambda_k)\mathcal C^{\mathrm{trop}}(\lambda_{k+1})liminft​κ(Ct​,[tλ0​,tλp​])≥∑k=1p−1​∠∗Ctrop(λk−1​)Ctrop(λk​)Ctrop(λk+1​), where ∠∗\angle^*∠∗ is the weak tropical angle (π/2\pi/2π/2 under the conditions of Lemma 23, else 000).
  4. Table 1: the coordinates of the tropical central path of LWr\mathbf{LW}_rLWr​ at λ=(4k+2c)/2j\lambda=(4k+2c)/2^jλ=(4k+2c)/2j.
  5. Claims in the proof of Theorem 25 (p. 23): on [0,2][0,2][0,2] the dual coordinates of Ctrop\mathcal C^{\mathrm{trop}}Ctrop are at most max⁡(0,λ−1)\max(0,\lambda-1)max(0,λ−1). At λk=4k/2r−1\lambda_k=4k/2^{r-1}λk​=4k/2r−1 the largest coordinate is r−1+(2k+2)/2r−1r-1+(2k+2)/2^{r-1}r−1+(2k+2)/2r−1, attained only by w3(r−1)w_{3(r-1)}w3(r−1)​ or w3(r−1)+1w_{3(r-1)+1}w3(r−1)+1​. Hence ∠∗=π/2\angle^*=\pi/2∠∗=π/2 at each interior subdivision point.

Significance

The theorem shows that the total curvature of the central path is not bounded by any polynomial in the number of constraints: LWr\mathbf{LW}_rLWr​ has 3r+13r+13r+1 constraints and curvature at least about 2r−2π/22^{r-2}\pi/22r−2π/2. This settles the conjecture of Deza, Terlaky and Zinchenko in the negative. It also shows that the averaged upper bounds of Dedieu–Malajovich–Shub and De Loera–Sturmfels–Vinzant cannot hold for every region. A companion mission of this series formalizes the paper's second main result, an exponential lower bound on the number of iterations of log-barrier path-following methods on the same family.

The result is proved on paper. As far as is known, it has not been formalized in any proof assistant, and Mathlib has no notion of the total curvature of a curve, of Puiseux-series evaluation and valuation, or of the tropical central path. Formalizing the theorem would give a machine-checked reference point for a much-cited negative result in interior point theory. The Lean definitions of total curvature and of the turning angle are general and reusable.

Difficulty

The total curvature is a supremum over inscribed polygons, and a lower bound needs explicit polygons whose angles can be estimated for every large ttt. The central path of LWr=(t)\mathbf{LW}^=_r(t)LWr=​(t) has no closed form, so its points cannot be written down at given parameters μ\muμ. Numerical evidence at a fixed ttt says nothing uniform in rrr. The natural first idea, to compute the path's angles directly from system (1) for a fixed instance, gives no handle on how the number of turns grows with rrr. What is needed is control of the path's geometry uniformly over the whole scale of ttt, with 2r−22^{r-2}2r−2 turns located at once, and the threshold t0t_0t0​ is not explicit.

Formalization scope

Vectors in which angles are measured are EuclideanSpace ℝ (Fin d). The turning angle is InnerProductGeometry.angle (V - U) (W - V), not Mathlib's vertex angle ∠ U V W, which is π\piπ minus it. A degenerate triple (U=VU=VU=V or V=WV=WV=W) contributes angle 000. Total curvature is an EReal-valued supremum over strictly increasing parameter sequences in the parameter set, and the goal uses the set (0,∞)(0,\infty)(0,∞). The primal and primal-dual curves are the vectors (x,w)∈R5r−1(x,w)\in\mathbb R^{5r-1}(x,w)∈R5r−1 and (x,w,s,y)∈R2(5r−1)(x,w,s,y)\in\mathbb R^{2(5r-1)}(x,w,s,y)∈R2(5r−1). System (1) is the published Vanderbei central-path system with objective −c-c−c. The goal quantifies over every curve solving (1) for all μ>0\mu>0μ>0. Existence and uniqueness of that curve is the referenced platform statement VanderbeiLP.CentralPath.central_path_exists_unique and is not posed again. Indices are the paper's, 1-based, mapped to Fin by subtracting one. Powers 2r−22^{r-2}2r−2 use integer exponents of the real number 222.

A trivializing formalization is ruled out explicitly: the curvature is a supremum in EReal (a real sSup of an unbounded set would be 000), the turning angle is not the vertex angle, and degenerate polygons cannot add spurious right angles.

Lemmas 22–24 are stated over a model of K\mathbb KK by coefficient functions with the paper's support and absolute-convergence conditions. Equalities, products and order in K\mathbb KK are expressed through evaluation at all sufficiently large ttt, which is how the paper characterizes them. Table 1 and the claims of the proof are stated for the explicit tropical central path of LWr\mathbf{LW}_rLWr​ given by Propositions 20–21 (milestones of the companion mission), written as a definition here. One repair: the paper's "uniquely attained" claim fails at r=2r=2r=2, k=0k=0k=0, where w1=w4=2w_1=w_4=2w1​=w4​=2. It is stated with that case excluded, which the proof does not use.

Welcome contributions: a general theory of total curvature of curves (monotonicity under refinement, behaviour under limits), asymptotics of evaluated Puiseux series, and the comparison between the central path over K\mathbb KK and its real specializations.

Selected references

  • X. Allamigeon, P. Benchimol, S. Gaubert, M. Joswig, Log-Barrier Interior Point Methods Are Not Strongly Polynomial, SIAM J. Appl. Algebra Geom. 2(1), 2018; preprint v2 (cited throughout) arXiv:1708.01544, doi:10.1137/17M1142132.
  • X. Allamigeon, P. Benchimol, S. Gaubert, M. Joswig, Long and winding central paths, preprint, 2014. arXiv:1405.4161
  • J. A. De Loera, B. Sturmfels, C. Vinzant, The central curve in linear programming, Found. Comput. Math. 12(4), 2012. arXiv:1012.3978
  • J.-P. Dedieu, G. Malajovich, M. Shub, On the curvature of the central path of linear programming theory, Found. Comput. Math. 5(2), 2005.
  • J.-P. Dedieu, M. Shub, Newton flow and interior point methods in linear programming, Int. J. Bifurcation and Chaos 15(3), 2005.
  • A. Deza, T. Terlaky, Y. Zinchenko, Central path curvature and iteration-complexity for redundant Klee–Minty cubes, in Advances in Applied Mathematics and Global Optimization, Springer, 2009.
  • L. van den Dries, P. Speissegger, The real field with convergent generalized power series, Trans. Amer. Math. Soc. 350(11), 1998.
18 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

Assortment Optimization under Variants of the Nested Logit Model 3: With Fully-Captured Nests, the Nested-by-Revenue LP Optimum Scaled by the Factor (6) Is Feasible for the Full LPResearch Paper

Motivation

Assortment optimization asks a retailer which products to offer when customers substitute among them. The nested logit model groups products into nests and is one of the most used choice models in revenue management, because it relaxes the independence of irrelevant alternatives of the plain multinomial logit model while keeping choice probabilities in closed form. Davis, Gallego and Topaloglu (Oper. Res. 62(2), 2014) study how the tractability of the assortment problem under this model depends on two features: whether the dissimilarity parameters of the nests are at most one, and whether a customer who selects a nest always buys there (fully-captured nests).

When the dissimilarity parameters are at most one and the nests are fully captured, offering the jjj highest-revenue products in every nest is optimal (Theorem 4 of the paper). This mission concerns what survives when a dissimilarity parameter exceeds one, the regime the paper calls possibly synergistic products. Then the problem is NP-hard (Theorem 5), and the paper shows that the same nested-by-revenue assortments still achieve an explicit, data-dependent fraction of the optimal expected revenue.

Setting

There are nests i∈Mi \in Mi∈M and products j∈N={1,…,n}j \in N = \{1, \dots, n\}j∈N={1,…,n} in every nest. Product jjj of nest iii has a revenue rijr_{ij}rij​ and a preference weight vij>0v_{ij} > 0vij​>0, ordered so that ri1≥ri2≥⋯≥rinr_{i1} \ge r_{i2} \ge \dots \ge r_{in}ri1​≥ri2​≥⋯≥rin​. Nest iii has a dissimilarity parameter γi>0\gamma_i > 0γi​>0, and v0≥0v_0 \ge 0v0​≥0 is the weight of leaving without choosing a nest. Throughout this mission the nests are fully captured: the within-nest no-purchase weights vi0v_{i0}vi0​ are zero. For an assortment Si⊆NS_i \subseteq NSi​⊆N in nest iii,

Vi(Si)=∑j∈Sivij,Ri(Si)=∑j∈SirijvijVi(Si),Ri(∅)=0,V_i(S_i) = \sum_{j \in S_i} v_{ij}, \qquad R_i(S_i) = \frac{\sum_{j \in S_i} r_{ij} v_{ij}}{V_i(S_i)}, \quad R_i(\emptyset) = 0,Vi​(Si​)=j∈Si​∑​vij​,Ri​(Si​)=Vi​(Si​)∑j∈Si​​rij​vij​​,Ri​(∅)=0,

and the expected revenue of (S1,…,Sm)(S_1, \dots, S_m)(S1​,…,Sm​) is

Π(S1,…,Sm)=∑i∈MVi(Si)γiRi(Si)v0+∑i∈MVi(Si)γi.\Pi(S_1, \dots, S_m) = \frac{\sum_{i \in M} V_i(S_i)^{\gamma_i} R_i(S_i)}{v_0 + \sum_{i \in M} V_i(S_i)^{\gamma_i}}.Π(S1​,…,Sm​)=v0​+∑i∈M​Vi​(Si​)γi​∑i∈M​Vi​(Si​)γi​Ri​(Si​)​.

Problem (2) maximizes Π\PiΠ; its optimal value is Z∗Z^*Z∗. The nested-by-revenue assortment Nij={1,…,j}N_{ij} = \{1, \dots, j\}Nij​={1,…,j} collects the jjj highest-revenue products of nest iii, with Ni0=∅N_{i0} = \emptysetNi0​=∅ and N+={0,1,…,n}N_+ = \{0, 1, \dots, n\}N+​={0,1,…,n}.

Problem (2) is equivalent to the linear program (3): minimize xxx subject to v0x≥∑iyiv_0 x \ge \sum_i y_iv0​x≥∑i​yi​ and yi≥Vi(Si)γi(Ri(Si)−x)y_i \ge V_i(S_i)^{\gamma_i}(R_i(S_i) - x)yi​≥Vi​(Si​)γi​(Ri​(Si​)−x) for every nest iii and every Si⊆NS_i \subseteq NSi​⊆N. Problem (4) keeps the second family of constraints only for candidate assortments; here the candidates are {Nij:j∈N+}\{N_{ij} : j \in N_+\}{Nij​:j∈N+​}, which gives a linear program with 1+m1 + m1+m variables and 1+m(1+n)1 + m(1 + n)1+m(1+n) constraints. The performance factor of the nested-by-revenue assortments is

α=max⁡i∈M, j=2,…,n{Ri(Ni,j−1)Ri(Nij)∧(Ri(Nij)Ri(Ni,j−1) Vi(Nij)γiVi(Ni,j−1)γi)},a∧b=min⁡{a,b}.(6)\alpha = \max_{i \in M,\ j = 2, \dots, n} \left\{ \frac{R_i(N_{i,j-1})}{R_i(N_{ij})} \wedge \left(\frac{R_i(N_{ij})}{R_i(N_{i,j-1})}\, \frac{V_i(N_{ij})^{\gamma_i}}{V_i(N_{i,j-1})^{\gamma_i}}\right) \right\}, \qquad a \wedge b = \min\{a, b\}. \tag{6}α=i∈M, j=2,…,nmax​{Ri​(Nij​)Ri​(Ni,j−1​)​∧(Ri​(Ni,j−1​)Ri​(Nij​)​Vi​(Ni,j−1​)γi​Vi​(Nij​)γi​​)},a∧b=min{a,b}.(6)

Formalization targets

Goal: Theorem 7

Assume vi0=0v_{i0} = 0vi0​=0 for every nest, γi>1\gamma_i > 1γi​>1 for some nest, positive revenues and n≥2n \ge 2n≥2. If (x^,y^)(\hat x, \hat y)(x^,y^​) is an optimal solution of (4) over the nested-by-revenue assortments, then

(αx^,αy^) is feasible for (3).(\alpha \hat x, \alpha \hat y) \ \text{is feasible for (3)}.(αx^,αy^​) is feasible for (3).

Combined with Theorem 1 of the paper this yields Z∗≤α Π(S^)Z^* \le \alpha\, \Pi(\hat S)Z∗≤αΠ(S^) for the assortment S^\hat SS^ read off the small linear program; that consequence is a companion item.

Milestones

  1. Problem (3) is a relaxation of the fractional problem (7), in which yiy_iyi​ dominates (∑jvijzij)γi[∑jrijvijzij/∑jvijzij−x]\big(\sum_j v_{ij} z_{ij}\big)^{\gamma_i}\big[\sum_j r_{ij} v_{ij} z_{ij} / \sum_j v_{ij} z_{ij} - x\big](∑j​vij​zij​)γi​[∑j​rij​vij​zij​/∑j​vij​zij​−x] for all zi∈[0,1]nz_i \in [0,1]^nzi​∈[0,1]n.
  2. Lemma 6: the inner maximization (8) of (7) has a solution of the form zi1=⋯=zi,k−1=1z_{i1} = \dots = z_{i,k-1} = 1zi1​=⋯=zi,k−1​=1, zik∈[0,1]z_{ik} \in [0,1]zik​∈[0,1], zi,k+1=⋯=zin=0z_{i,k+1} = \dots = z_{in} = 0zi,k+1​=⋯=zin​=0.
  3. y^i≥0\hat y_i \ge 0y^​i​≥0 and x^≥0\hat x \ge 0x^≥0.
  4. The inequalities (20) and (22) with the coefficients αik1=Ri(Ni,k−1)/Ri(Nik)\alpha^1_{ik} = R_i(N_{i,k-1})/R_i(N_{ik})αik1​=Ri​(Ni,k−1​)/Ri​(Nik​) and 1∨αik21 \vee \alpha^2_{ik}1∨αik2​.
  5. Ri(Nij)≤Ri(Ni,j−1)R_i(N_{ij}) \le R_i(N_{i,j-1})Ri​(Nij​)≤Ri​(Ni,j−1​), and Lemma 14: α≥1\alpha \ge 1α≥1 when some γi>1\gamma_i > 1γi​>1.
  6. The inequalities (24) and (25): αy^i\alpha \hat y_iαy^​i​ dominates the objective of (8) at αx^\alpha \hat xαx^ for every vector of Lemma 6's shape.

Two companion statements follow the goal: the bounds α≤ρ\alpha \le \rhoα≤ρ and α≤2κ\alpha \le 2\kappaα≤2κ when revenues, respectively preference weights, within each nest differ by at most the factors ρ\rhoρ, κ\kappaκ; and the guarantee Z∗≤α Π(S^)Z^* \le \alpha\, \Pi(\hat S)Z∗≤αΠ(S^).

Significance

Because problem (2) is NP-hard once a dissimilarity parameter exceeds one (Theorem 5 of the paper), an exact polynomial algorithm is not expected, and a guarantee for a polynomial-size candidate family is the natural substitute. Theorem 7 gives one with an explicit factor computed from the data: α≤ρ\alpha \le \rhoα≤ρ when revenues within each nest are balanced, α≤2κ\alpha \le 2\kappaα≤2κ when preference weights within each nest are balanced, and the nests may differ arbitrarily from one another. The same linear-programming argument (Theorem 1) is reused for partially-captured nests in §6 of the paper.

The result is proved in the paper (Appendix A.1); no machine-checked version is known. A formalization verifies an appendix argument that is stated with little detail, and fixes the conventions that the page leaves implicit, such as the value of the objective of (8) at zi=0z_i = 0zi​=0 and the role of the standing assumption that some γi\gamma_iγi​ exceeds one.

Difficulty

Theorem 7 is a feasibility statement for the exponentially many constraints of (3), one per subset of every nest, while optimality of (x^,y^)(\hat x, \hat y)(x^,y^​) only controls the n+1n + 1n+1 nested-by-revenue constraints per nest. The obvious approach, comparing each subset directly with a nested-by-revenue assortment, fails: when γi>1\gamma_i > 1γi​>1 the nested-by-revenue assortments are not optimal within a nest, and the example of §4.1 shows that they can lose an unbounded factor. The constant α\alphaα must absorb the gap between a fractional assortment and its two neighbouring nested-by-revenue assortments, which the dual-style solution (x^,y^)(\hat x, \hat y)(x^,y^​) of the small program does not see.

Formalization scope

Lean 4 with Mathlib. Nests form a finite type ι; products are Fin n, indexed from 000, so NijN_{ij}Nij​ is nbr n j = {k | k < j} and product kkk of the page is ⟨k - 1, _⟩. Powers are real powers (Real.rpow), and division is total (x/0=0x / 0 = 0x/0=0), which gives Ri(∅)=0R_i(\emptyset) = 0Ri​(∅)=0 and value 000 for the objective of (8) at zi=0z_i = 0zi​=0.

Standing assumptions in every statement: v0≥0v_0 \ge 0v0​≥0, vi0≥0v_{i0} \ge 0vi0​≥0, vij>0v_{ij} > 0vij​>0, rij≥0r_{ij} \ge 0rij​≥0, γi>0\gamma_i > 0γi​>0, revenues ordered within each nest (§1); vi0=0v_{i0} = 0vi0​=0 for every nest and γi>1\gamma_i > 1γi​>1 for some nest (§4, p. 16). Added and disclosed: rij>0r_{ij} > 0rij​>0 wherever (6) appears, so that no denominator of (6) vanishes; n≥2n \ge 2n≥2, the nonempty range of (6); v0>0v_0 > 0v0​>0 only in the guarantee Z∗≤α Π(S^)Z^* \le \alpha\,\Pi(\hat S)Z∗≤αΠ(S^), inherited from Theorem 1. The factor α\alphaα enters as a real number with the hypothesis that it is the greatest element of the set of terms of (6). An optimal solution of (4) is a feasible pair whose xxx is minimal among feasible pairs.

A trivializing formalization is ruled out: α\alphaα is the maximum of (6), not an arbitrary upper bound, and the goal states feasibility for the full program (3) over every subset of every nest, not for (7) or for the candidate collection.

Needed infrastructure: maximization of a continuous function on [0,1]n[0,1]^n[0,1]n, the greedy solution of a continuous knapsack, monotonicity of weighted averages and elementary real-power calculus. These are reusable beyond this mission. Proofs of any milestone, of the companions, and of the §4.1 example are welcome.

Selected references

  • J. M. Davis, G. Gallego, H. Topaloglu, Assortment optimization under variants of the nested logit model, Operations Research 62(2), 2014. https://doi.org/10.1287/opre.2014.1256 (formalized from the revised manuscript of June 18, 2013).
  • K. Talluri, G. van Ryzin, Revenue management under a general discrete choice model of consumer behavior, Management Science 50(1), 2004. https://doi.org/10.1287/mnsc.1030.0147
14 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems 2: Worst-Case Distribution with Largest Covariance for Piecewise-Linear PortfoliosResearch Paper

Motivation

A portfolio manager who maximizes expected utility needs the distribution of asset returns, but in practice only estimates of its first two moments are available, and these estimates are themselves noisy. Distributionally robust optimization handles this by optimizing against the worst distribution in a set of plausible ones. Delage and Ye (Operations Research 58(3), 2010) proposed a set of distributions defined by confidence bounds on the mean and on the second-moment matrix, showed that the resulting problems are solvable in polynomial time for a large class of costs, and applied the framework to portfolio selection.

The set contains an upper bound on the covariance but no lower bound. Remark 1 of the paper says a lower bound "leads to important computational difficulties" and argues it should be unnecessary: for a concave utility, a less predictable market can only reduce expected utility, so the worst distribution should already have the largest covariance allowed. Proposition 3 in §5.2 turns this argument into a theorem for piecewise-linear concave utilities and unconstrained support. This mission formalizes Proposition 3 and the steps of its proof.

Setting

Let nnn assets have a random return vector ξ∈Rn\xi\in\mathbb R^nξ∈Rn, and let x∈Rnx\in\mathbb R^nx∈Rn be a portfolio, so the return is ξTx\xi^{\mathsf T}xξTx. A distribution of ξ\xiξ is a Borel probability measure on Rn\mathbb R^nRn with finite second moments. For symmetric matrices, A⪯BA\preceq BA⪯B (the Loewner order) means B−AB-AB−A is positive semidefinite.

Given a support set SSS, a centre μ0\mu_0μ0​, a positive definite matrix Σ0≻0\Sigma_0\succ0Σ0​≻0 and γ1≥0\gamma_1\ge0γ1​≥0, γ2>0\gamma_2>0γ2​>0, the distributional set of Assumption 3 is

D1(S,μ0,Σ0,γ1,γ2)={P : P(ξ∈S)=1, (E[ξ]−μ0)TΣ0−1(E[ξ]−μ0)≤γ1, E[(ξ−μ0)(ξ−μ0)T]⪯γ2Σ0}.\mathcal D_1(S,\mu_0,\Sigma_0,\gamma_1,\gamma_2)=\Big\{P\ :\ P(\xi\in S)=1,\ (\mathbb E[\xi]-\mu_0)^{\mathsf T}\Sigma_0^{-1}(\mathbb E[\xi]-\mu_0)\le\gamma_1,\ \mathbb E[(\xi-\mu_0)(\xi-\mu_0)^{\mathsf T}]\preceq\gamma_2\Sigma_0\Big\}.D1​(S,μ0​,Σ0​,γ1​,γ2​)={P : P(ξ∈S)=1, (E[ξ]−μ0​)TΣ0−1​(E[ξ]−μ0​)≤γ1​, E[(ξ−μ0​)(ξ−μ0​)T]⪯γ2​Σ0​}.

The second constraint, (1b), is the covariance constraint.

The utility is piecewise linear concave, u(y)=min⁡k∈{1,…,K}aky+bku(y)=\min_{k\in\{1,\dots,K\}}a_ky+b_ku(y)=mink∈{1,…,K}​ak​y+bk​ with K≥1K\ge1K≥1 pieces, and the cost of a return is −u-u−u:

h(x,ξ)=max⁡k (−ak ξTx−bk).h(x,\xi)=\max_{k}\ \big(-a_k\,\xi^{\mathsf T}x-b_k\big).h(x,ξ)=kmax​ (−ak​ξTx−bk​).

With estimates μ^\hat\muμ^​, Σ^≻0\hat\Sigma\succ0Σ^≻0 of the mean and covariance, the inner problem of the robust portfolio problem with unconstrained support and an exactly known mean (γ1=0\gamma_1=0γ1​=0) is

max⁡P∈D1(Rn,μ^,Σ^,0,γ2) EP[h(x,ξ)].(18)\max_{P\in\mathcal D_1(\mathbb R^n,\hat\mu,\hat\Sigma,0,\gamma_2)}\ \mathbb E_P\big[h(x,\xi)\big].\tag{18}P∈D1​(Rn,μ^​,Σ^,0,γ2​)max​ EP​[h(x,ξ)].(18)

The proof relates (18) to a semidefinite program in variables Λk∈Rn×n\Lambda_k\in\mathbb R^{n\times n}Λk​∈Rn×n, λk∈Rn\lambda_k\in\mathbb R^nλk​∈Rn, νk∈R\nu_k\in\mathbb Rνk​∈R:

max⁡ ∑k(−ak xTλk−bkνk)s.t.∑kΛk⪯γ2Σ^+μ^μ^T,  ∑kλk=μ^,  ∑kνk=1,  [ΛkλkλkTνk]⪰0.(19)\max\ \sum_k\big(-a_k\,x^{\mathsf T}\lambda_k-b_k\nu_k\big)\quad\text{s.t.}\quad \sum_k\Lambda_k\preceq\gamma_2\hat\Sigma+\hat\mu\hat\mu^{\mathsf T},\ \ \sum_k\lambda_k=\hat\mu,\ \ \sum_k\nu_k=1,\ \ \begin{bmatrix}\Lambda_k&\lambda_k\\\lambda_k^{\mathsf T}&\nu_k\end{bmatrix}\succeq0.\tag{19}max k∑​(−ak​xTλk​−bk​νk​)s.t.k∑​Λk​⪯γ2​Σ^+μ^​μ^​T,  k∑​λk​=μ^​,  k∑​νk​=1,  [Λk​λkT​​λk​νk​​]⪰0.(19)

Formalization targets

Goal: Proposition 3

For every γ1≥0\gamma_1\ge0γ1​≥0 (the mean-uncertainty radius of the robust portfolio problem (16); (18) is the case γ1=0\gamma_1=0γ1​=0),

∃ P∗∈D1(Rn,μ^,Σ^,γ1,γ2):EP∗[(ξ−μ^)(ξ−μ^)T]=γ2Σ^andEQ[h(x,ξ)]≤EP∗[h(x,ξ)]  ∀ Q∈D1(Rn,μ^,Σ^,γ1,γ2).\exists\,P^*\in\mathcal D_1(\mathbb R^n,\hat\mu,\hat\Sigma,\gamma_1,\gamma_2):\quad \mathbb E_{P^*}\big[(\xi-\hat\mu)(\xi-\hat\mu)^{\mathsf T}\big]=\gamma_2\hat\Sigma\quad\text{and}\quad \mathbb E_Q[h(x,\xi)]\le\mathbb E_{P^*}[h(x,\xi)]\ \ \forall\,Q\in\mathcal D_1(\mathbb R^n,\hat\mu,\hat\Sigma,\gamma_1,\gamma_2).∃P∗∈D1​(Rn,μ^​,Σ^,γ1​,γ2​):EP∗​[(ξ−μ^​)(ξ−μ^​)T]=γ2​Σ^andEQ​[h(x,ξ)]≤EP∗​[h(x,ξ)]  ∀Q∈D1​(Rn,μ^​,Σ^,γ1​,γ2​).

The worst-case expectation is attained, and at a distribution for which the covariance constraint holds with equality. The statement holds for every portfolio xxx, every K≥1K\ge1K≥1, every a,ba,ba,b, every μ^\hat\muμ^​, every Σ^≻0\hat\Sigma\succ0Σ^≻0, every γ1≥0\gamma_1\ge0γ1​≥0 and every γ2>0\gamma_2>0γ2​>0.

Milestones

  1. Every value of (18) is dominated by the value of a feasible point of (19).
  2. (19) has an optimal solution at which ∑kΛk=γ2Σ^+μ^μ^T\sum_k\Lambda_k=\gamma_2\hat\Sigma+\hat\mu\hat\mu^{\mathsf T}∑k​Λk​=γ2​Σ^+μ^​μ^​T.
  3. If [ΛλλTν]⪰0\begin{bmatrix}\Lambda&\lambda\\\lambda^{\mathsf T}&\nu\end{bmatrix}\succeq0[ΛλT​λν​]⪰0 and ν>0\nu>0ν>0, a random vector with mean λ/ν\lambda/\nuλ/ν and second moment Λ/ν\Lambda/\nuΛ/ν exists.
  4. The mixture ∑kνkPk\sum_k\nu_kP_k∑k​νk​Pk​ of such vectors, built from a tight feasible point with all νk>0\nu_k>0νk​>0, lies in D1\mathcal D_1D1​ and has second moment γ2Σ^\gamma_2\hat\Sigmaγ2​Σ^ about μ^\hat\muμ^​.
  5. The expected cost under that mixture is at least the objective value of (19) at the point.
  6. (18) and (19) have the same attained optimal value.

Significance

The proposition justifies a modelling decision of the whole paper: for portfolio problems with piecewise-linear concave utility, adding a lower bound γ3Σ0⪯E[(ξ−μ0)(ξ−μ0)T]\gamma_3\Sigma_0\preceq\mathbb E[(\xi-\mu_0)(\xi-\mu_0)^{\mathsf T}]γ3​Σ0​⪯E[(ξ−μ0​)(ξ−μ0​)T] (display (2)) to the distributional set cannot change the robust decision, so the computational difficulty that lower bound would cause is avoided at no loss. It also shows that, under these assumptions and with γ2=1\gamma_2=1γ2​=1, the paper's semidefinite formulation solves the known-moment portfolio problem of Popescu (2007) in polynomial time (Remark 4). The worst case is explicit: a finite mixture of distributions with prescribed first and second moments, read off an optimal solution of (19).

The result is proved in the paper; no machine-checked version is known. Formalizing it requires a moment-problem argument (from a distribution to a feasible point of an SDP) and its converse (from an SDP solution to a distribution), both of which are reusable for other moment-based distributionally robust results. The proposition concerns the robust portfolio problem with D1(Rn,μ^,Σ^,γ1,γ2)\mathcal D_1(\mathbb R^n,\hat\mu,\hat\Sigma,\gamma_1,\gamma_2)D1​(Rn,μ^​,Σ^,γ1​,γ2​); the paper's proof writes out only γ1=0\gamma_1=0γ1​=0 "for simplicity of our derivations". The goal states the proposition for every γ1≥0\gamma_1\ge0γ1​≥0; the milestones follow the written proof and are stated for γ1=0\gamma_1=0γ1​=0.

Difficulty

The obvious argument, "a concave utility prefers less spread, so the adversary maximizes spread", does not prove anything by itself: increasing the second-moment matrix of a given distribution in the Loewner order does not determine its law, and the expected cost depends on the whole law, not on the moments. The proof goes through the semidefinite program (19). Two steps carry the weight. First, every distribution in D1\mathcal D_1D1​ must be mapped to a feasible point of (19) with no smaller value, although the cost is only piecewise affine in ξ\xiξ. Second, an optimal point of (19) must be turned back into a distribution in D1\mathcal D_1D1​; this needs the existence of random vectors with prescribed first and second moments, and care with blocks where νk=0\nu_k=0νk​=0, which the paper sets aside "without loss of generality" although such a block can carry a nonzero Λk\Lambda_kΛk​ that the mixture would lose.

Formalization scope

  • Vectors are Fin n → ℝ; all Euclidean quantities are dot products, never the sup norm. Matrices are Matrix (Fin n) (Fin n) ℝ; A⪯BA\preceq BA⪯B is (B - A).PosSemidef; Σ0−1\Sigma_0^{-1}Σ0−1​ is Mathlib's matrix inverse, used only with Σ0≻0\Sigma_0\succ0Σ0​≻0.
  • A distribution is a Measure (Fin n → ℝ) that is a probability measure and whose coordinates are in L2L^2L2 (MemLp _ 2). This makes every mean, second moment and expected cost a genuine integral; without it a non-integrable expectation would evaluate to 000.
  • P(ξ∈S)=1P(\xi\in S)=1P(ξ∈S)=1 is an almost-everywhere statement; the goal uses S=RnS=\mathbb R^nS=Rn ("infinite support constraint"). The convexity of SSS, μ0∈int⁡S\mu_0\in\operatorname{int}Sμ0​∈intS and the separation oracle of Assumption 3 concern the paper's algorithms and are not part of the set.
  • The maximum of (18) is never a real supremum: the goal asserts a maximizer that dominates every member of the set. The cost uses a finite maximum over K≥1K\ge1K≥1 pieces ([NeZero K]).
  • Standing hypotheses: Σ^≻0\hat\Sigma\succ0Σ^≻0 (Assumption 3's Σ0≻0\Sigma_0\succ0Σ0​≻0, and endnote 1), γ2>0\gamma_2>0γ2​>0 (§3), γ1≥0\gamma_1\ge0γ1​≥0 (Assumption 3) in the goal; the milestones fix γ1=0\gamma_1=0γ1​=0 as the proof does. The portfolio xxx ranges over all of Rn\mathbb R^nRn; the simplex constraint (16b) plays no role in the inner problem, so dropping it only strengthens the statements.
  • The objective of (19) has the sign of the proof's final computation (p. 21), ∑k(−akxTλk−bkνk)\sum_k(-a_kx^{\mathsf T}\lambda_k-b_k\nu_k)∑k​(−ak​xTλk​−bk​νk​); display (19a) on p. 19 prints the opposite signs, a misprint.
  • Ruling out trivial readings: the goal requires both membership in D1\mathcal D_1D1​ with tight covariance and domination of every member of D1\mathcal D_1D1​. A distribution with covariance γ2Σ^\gamma_2\hat\Sigmaγ2​Σ^ alone, or a maximizer alone, would not suffice. The goal does not claim that every maximizer is tight; for K=1K=1K=1 the cost is linear and every member of D1\mathcal D_1D1​ is a maximizer.
  • Infrastructure needed: existence of distributions with prescribed mean and covariance (for instance multivariate Gaussians, or degenerate laws on a subspace), finite mixtures of measures and their moments, Schur complements of positive semidefinite block matrices, and compactness of the feasible set of (19). Proofs of the milestones in any order are welcome.

The source is the authors' draft of 20 February 2008 of the Operations Research paper; every page, display and label in this mission refers to that draft.

Selected references

  • E. Delage and Y. Ye, Distributionally robust optimization under moment uncertainty with application to data-driven problems, Operations Research 58(3):595–612, 2010 (authors' draft of 20 February 2008 used here). https://doi.org/10.1287/opre.1090.0741
  • I. Popescu, Robust mean-covariance solutions for stochastic optimization, Operations Research 55(1):98–112, 2007. https://doi.org/10.1287/opre.1060.0353
  • Y. Nesterov and A. Nemirovski, Interior-Point Polynomial Algorithms in Convex Programming, SIAM, 1994. https://doi.org/10.1137/1.9781611970791
9 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchProbability·Captain: mikedeng1

Optimality and Duality Theory for Stochastic Optimization Problems with Nonlinear Dominance Constraints 2: With Finite Scenarios and Slater's Condition, Piecewise-Linear Utilities Are MultipliersResearch Paper

Motivation

Second-order stochastic dominance constraints let a decision maker require that a random outcome of a decision be preferred to a fixed benchmark outcome by every risk-averse expected-utility maximizer, without choosing a utility function in advance. Dentcheva and Ruszczyński introduced optimization under such constraints in Optimization with stochastic dominance constraints (SIAM J. Optim., 2003), for the case where the decision enters the outcome linearly (the pure-dominance case). Their follow-up paper, Optimality and duality theory for stochastic optimization problems with nonlinear dominance constraints (Math. Program., 2004), allows the decision to affect many random outcomes in a nonlinear, concave way, and derives optimality and duality theory in which the Lagrange multipliers of the dominance constraints are utility functions.

In applications (portfolio selection against a benchmark index is the paper's own example in §6) the probability space is a finite set of scenarios. Section 5 of the paper specialises the theory to that case. This mission formalizes that section: the reduction of the dominance constraints to finitely many inequalities, and the optimality and duality theorems (Theorems 6 and 7) in which the multipliers become piecewise-linear concave utilities.

Setting

There are nnn scenarios ω1,…,ωn\omega_1,\dots,\omega_nω1​,…,ωn​ with probabilities pj≥0p_j \ge 0pj​≥0, ∑jpj=1\sum_j p_j = 1∑j​pj​=1, and mmm benchmark constraints, indexed by i∈I={1,…,m}i \in I = \{1,\dots,m\}i∈I={1,…,m}; J={1,…,n}J = \{1,\dots,n\}J={1,…,n}. A decision zzz ranges over a convex set Z⊆RNZ \subseteq \mathbb R^NZ⊆RN. For each scenario jjj, hj:RN→Rh_j:\mathbb R^N\to\mathbb Rhj​:RN→R is the objective contribution and gij:RN→Rg_{ij}:\mathbb R^N\to\mathbb Rgij​:RN→R the iiith outcome, all concave. The benchmark YiY_iYi​ has realizations yijy_{ij}yij​. Write (t)+=max⁡(t,0)(t)_+=\max(t,0)(t)+​=max(t,0).

The second-order dominance of a finitely distributed XiX_iXi​ (realizations xijx_{ij}xij​) over YiY_iYi​ on an interval [ai,bi][a_i,b_i][ai​,bi​] reads

∑jpj(η−xij)+≤∑jpj(η−yij)+for all η∈[ai,bi].(36)\sum_{j} p_j(\eta - x_{ij})_+ \le \sum_j p_j(\eta-y_{ij})_+ \quad\text{for all } \eta\in[a_i,b_i]. \tag{36}j∑​pj​(η−xij​)+​≤j∑​pj​(η−yij​)+​for all η∈[ai​,bi​].(36)

The split-variable problem (38)–(41) is

max⁡∑j=1npjhj(z)s.t.∑jpj(yik−xij)+≤∑jpj(yik−yij)+,xik≤gik(z),z∈Z,\max \sum_{j=1}^n p_j h_j(z)\quad\text{s.t.}\quad \sum_{j} p_j(y_{ik}-x_{ij})_+ \le \sum_j p_j(y_{ik}-y_{ij})_+,\quad x_{ik}\le g_{ik}(z),\quad z\in Z,maxj=1∑n​pj​hj​(z)s.t.j∑​pj​(yik​−xij​)+​≤j∑​pj​(yik​−yij​)+​,xik​≤gik​(z),z∈Z,

for all i∈Ii\in Ii∈I, k∈Jk\in Jk∈J, over zzz and X=(xij)∈RmnX=(x_{ij})\in\mathbb R^{mn}X=(xij​)∈Rmn. The Slater condition asks for z~∈relint⁡Z\tilde z \in \operatorname{relint} Zz~∈relintZ and X~\tilde XX~ satisfying the dominance constraints (39) with x~ik<gik(z~)\tilde x_{ik} < g_{ik}(\tilde z)x~ik​<gik​(z~) for all i,ki,ki,k.

The utility set ViV_iVi​ consists of the functions u:R→Ru:\mathbb R\to\mathbb Ru:R→R that are concave, nondecreasing, piecewise linear with break points only at the yiky_{ik}yik​, and zero on [max⁡kyik,∞)[\max_k y_{ik},\infty)[maxk​yik​,∞). With θij≥0\theta_{ij}\ge 0θij​≥0 multipliers for the splitting constraints xij≤gij(z)x_{ij}\le g_{ij}(z)xij​≤gij​(z), the Lagrangian is

L(z,X,u,θ)=∑j=1npj[hj(z)+∑i=1mθijgij(z)]+∑i=1m∑j=1npj[ui(xij)−ui(yij)−θijxij].(42)L(z,X,u,\theta) = \sum_{j=1}^n p_j\Big[h_j(z)+\sum_{i=1}^m\theta_{ij}g_{ij}(z)\Big]+\sum_{i=1}^m\sum_{j=1}^n p_j\big[u_i(x_{ij})-u_i(y_{ij})-\theta_{ij}x_{ij}\big]. \tag{42}L(z,X,u,θ)=j=1∑n​pj​[hj​(z)+i=1∑m​θij​gij​(z)]+i=1∑m​j=1∑n​pj​[ui​(xij​)−ui​(yij​)−θij​xij​].(42)

Multipliers μik\mu_{ik}μik​ of the inequalities (39) generate the utility ui(t)=−∑kμik(yik−t)+u_i(t)=-\sum_k\mu_{ik}(y_{ik}-t)_+ui​(t)=−∑k​μik​(yik​−t)+​ (46). The dual functional is D(u,θ)=sup⁡z∈Z, XL(z,X,u,θ)D(u,\theta)=\sup_{z\in Z,\,X}L(z,X,u,\theta)D(u,θ)=supz∈Z,X​L(z,X,u,θ) (47).

Formalization targets

Goal: Theorem 6

Under the Slater condition, (z^,X^)(\hat z,\hat X)(z^,X^) optimal for (38)–(41) implies that there are u^i∈Vi\hat u_i\in V_iu^i​∈Vi​ and θ^≥0\hat\theta\ge 0θ^≥0 with

L(z^,X^,u^,θ^)=max⁡(z,X)∈Z×RmnL(z,X,u^,θ^),∑jpj[u^i(x^ij)−u^i(yij)]=0,θ^ij(x^ij−gij(z^))=0;L(\hat z,\hat X,\hat u,\hat\theta)=\max_{(z,X)\in Z\times\mathbb R^{mn}}L(z,X,\hat u,\hat\theta),\qquad \sum_j p_j[\hat u_i(\hat x_{ij})-\hat u_i(y_{ij})]=0,\qquad \hat\theta_{ij}(\hat x_{ij}-g_{ij}(\hat z))=0;L(z^,X^,u^,θ^)=(z,X)∈Z×Rmnmax​L(z,X,u^,θ^),j∑​pj​[u^i​(x^ij​)−u^i​(yij​)]=0,θ^ij​(x^ij​−gij​(z^))=0;

conversely, these conditions together with feasibility imply optimality.

Milestones

  1. Lemma 2 (p. 15): if ai≤yij≤bia_i\le y_{ij}\le b_iai​≤yij​≤bi​, then (36) is equivalent to the mnmnmn inequalities (37) at the realizations η=yik\eta=y_{ik}η=yik​, and also to (36) on the whole line.
  2. Eq. (46) (p. 17): for any μ\muμ, the standard Lagrangian Λ(z,X,μ,θ)\Lambda(z,X,\mu,\theta)Λ(z,X,μ,θ) equals L(z,X,u,θ)L(z,X,u,\theta)L(z,X,u,θ) with uuu given by (46).
  3. p. 18: for μi≥0\mu_i\ge0μi​≥0, the utility (46) lies in ViV_iVi​.
  4. pp. 16–17: under Slater, an optimal solution admits Kuhn–Tucker multipliers μ≥0\mu\ge0μ≥0, θ≥0\theta\ge0θ≥0 for (38)–(41) with complementarity.
  5. p. 18: every v∈Viv\in V_iv∈Vi​ is of the form (46) with μi≥0\mu_i\ge0μi​≥0.
  6. Theorem 7 (p. 18), after the goal: the dual problem min⁡{D(u,θ):u∈V1×⋯×Vm, θ≥0}\min\{D(u,\theta): u\in V_1\times\dots\times V_m,\ \theta\ge0\}min{D(u,θ):u∈V1​×⋯×Vm​, θ≥0} has a solution and no duality gap.

Significance

Theorem 6 says that, for finitely many scenarios, the infinite-dimensional multiplier of the general theory (a concave utility in a cone of functions, Theorem 2 of the paper) can always be taken piecewise linear with kinks exactly at the benchmark's realizations. The multiplier space becomes finite-dimensional, ViV_iVi​ is a polyhedral cone, and the dual problem of Theorem 7 is a finite-dimensional convex program. The paper's decomposition (49)–(51) of the dual functional and its numerical method in §6 rest on this. Lemma 2 is the standard reduction that makes dominance against a finitely distributed benchmark a finite set of polyhedral constraints, used throughout the later literature on dominance-constrained portfolio optimization.

The results are proved in the paper; none of them is formalized. The mission produces machine-checked statements of the finite-scenario theory, a Lean model of the utility set ViV_iVi​ and of the correspondence between nonnegative multipliers and piecewise-linear utilities, and a Kuhn–Tucker theorem for concave programs with polyhedral constraints and a relative-interior Slater point.

Difficulty

The obvious route to Theorem 6 is to invoke a Kuhn–Tucker theorem. The available formal versions require every inequality constraint to hold strictly at the Slater point and range over all of RN\mathbb R^NRN. Neither fits: the dominance constraint at the smallest realization yi,[1]y_{i,[1]}yi,[1]​ has right-hand side 000 and a nonnegative left-hand side, so it can never hold strictly, and ZZZ may be lower-dimensional (a simplex), so only its relative interior is available. The polyhedral structure of (39) must be used, as in Rockafellar's Theorem 28.2. The second obstacle is the converse direction of the multiplier–utility correspondence: a utility in ViV_iVi​ must be written as a nonnegative combination of the kinks (yik−t)+(y_{ik}-t)_+(yik​−t)+​, which requires handling repeated realizations and the one-sided slopes at each break point.

Formalization scope

  • RN\mathbb R^NRN is Fin N → ℝ; XXX, θ\thetaθ, μ\muμ are Fin m → Fin n → ℝ; expectations are finite sums and positive parts are max t 0. No measure theory is used.
  • Probabilities satisfy pj≥0p_j\ge0pj​≥0, ∑jpj=1\sum_jp_j=1∑j​pj​=1; pj=0p_j=0pj​=0 is allowed, as on the page.
  • Standing assumptions of p. 2 are explicit hypotheses: ZZZ convex and hjh_jhj​, gijg_{ij}gij​ concave on RN\mathbb R^NRN. Continuity is not stated, since finite concave functions on RN\mathbb R^NRN are continuous.
  • The relative interior is intrinsicInterior ℝ Z, not the topological interior. In the Slater condition only the splitting constraints are strict; the dominance constraints hold non-strictly.
  • ViV_iVi​ is defined by concavity, monotonicity, affinity on every interval whose interior contains no yiky_{ik}yik​, and u=0u=0u=0 on [max⁡kyik,∞)[\max_ky_{ik},\infty)[maxk​yik​,∞). This last clause is the page's u(yi,[n])=0u(y_{i,[n]})=0u(yi,[n]​)=0 combined with Vi⊂U1([ai,bi])V_i\subset\mathcal U_1([a_i,b_i])Vi​⊂U1​([ai​,bi​]). No positive slope is required, because the printed "c>0c>0c>0" in U1\mathcal U_1U1​ is a misprint for c≥0c\ge0c≥0.
  • "max" in (43) is an attained maximum over all of Z×RmnZ\times\mathbb R^{mn}Z×Rmn, with no constraints on XXX. The dual functional (47) is an EReal supremum.
  • Theorem 6 keeps the Slater condition as a hypothesis of the whole statement, as printed, although its converse part does not use it.
  • A trivializing formalization is ruled out. ViV_iVi​ is not defined as the set of functions of the form (46), which would make milestones 3 and 5 true by definition. Slater does not require strict dominance constraints, which would make it unsatisfiable. A sorry-free check confirms that the goal's hypotheses hold on an instance (n=2n=2n=2, Z=[0,1]Z=[0,1]Z=[0,1]).
  • Reusable beyond this mission: the Kuhn–Tucker theorem with polyhedral constraints and relative-interior Slater point (milestone 4), and Lemma 2. Proofs of any item, and alternative proofs of the goal that avoid milestone 4, are welcome.
  • The pure-dominance case is the earlier paper of Dentcheva–Ruszczyński (2003). The function F2F_2F2​ and its expected-shortfall form are due to Ogryczak–Ruszczyński. The general Lagrange duality on the platform (ConvexOptimization.slater_strong_duality, Boyd–Vandenberghe §5.3.2) assumes a strict Slater point for every constraint and no set constraint, so it does not cover milestone 4.

Selected references

  • D. Dentcheva, A. Ruszczyński, Optimality and duality theory for stochastic optimization problems with nonlinear dominance constraints, Math. Program., 2004 (cited here from the authors' revised manuscript, April 2003). https://doi.org/10.1007/s10107-003-0453-z
  • D. Dentcheva, A. Ruszczyński, Optimization with stochastic dominance constraints, SIAM J. Optim. 14 (2003) 548–566. https://doi.org/10.1137/S1052623402420528
  • W. Ogryczak, A. Ruszczyński, Dual stochastic dominance and related mean-risk models, SIAM J. Optim. 13 (2002) 60–78. https://doi.org/10.1137/S1052623400375075
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970, §28. https://doi.org/10.1515/9781400873173
8 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Purchasing, Pricing, and Quick Response in the Presence of Strategic Consumers: Under Condition (6), Quick Response Is More Valuable with Strategic Consumers than with Only Myopic OnesResearch Paper

Motivation

Fashion and consumer-electronics retailers sell a product at full price early in a season and mark down what is left. Consumers learn the pattern, and some of them wait for the markdown. Such strategic consumers lower the revenue of the full-price period, and the retailer's stocking decision affects how deep the markdown is expected to be. Quick response — a second, more expensive replenishment placed after demand is observed — is usually valued as a way to match supply with exogenous demand (Fisher and Raman 1996; Cachon and Terwiesch, Matching Supply with Demand, 2005). Cachon and Swinney ask how strategic waiting changes that value.

The source is the authors' working paper of April 2007, revised November 25, 2007, not the 2009 Management Science version, whose numbering and wording may differ. Its answer: with strategic consumers the retailer stocks less (Theorem 1), and under an explicit cost condition, quick response is worth more to a retailer facing strategic consumers than to one facing only myopic consumers (Theorem 3).

Setting

A retailer sells over two periods. It sells at the exogenous full price ppp in period 1 and at a markdown price s∈[0,p]s\in[0,p]s∈[0,p] chosen at the start of period 2. Leftover units are worth 000. First-period demand D≥0D\ge0D≥0 has density fff and distribution function FFF, and fff satisfies the monotone scaled likelihood ratio (MSLR) property: for every λ∈(0,1]\lambda\in(0,1]λ∈(0,1], x↦f(λx)/f(x)x\mapsto f(\lambda x)/f(x)x↦f(λx)/f(x) is monotonic on the support of fff.

The market has three segments:

  • myopic consumers, (1−α)D(1-\alpha)D(1−α)D of them, with value vMv_MvM​, who only buy in period 1;
  • strategic consumers, αD\alpha DαD of them, with value vMv_MvM​ in period 1 and second-period values uniform on [v‾,vˉ][\underline v,\bar v][v​,vˉ];
  • an unlimited pool of bargain hunters with value vBv_BvB​, who only buy on sale.

The standing assumptions are vˉ≤p\bar v\le pvˉ≤p and v‾≥vM−p+vB\underline v\ge v_M-p+v_Bv​≥vM​−p+vB​. Let Gˉ(s)\bar G(s)Gˉ(s) be the fraction of strategic values above sss.

By a threshold argument (Lemma 1), strategic consumers with value below some v^\hat vv^ buy at ppp and the rest wait. A fraction ξ=1−Gˉ(v^)α\xi=1-\bar G(\hat v)\alphaξ=1−Gˉ(v^)α of demand then buys in period 1, and the inventory left for period 2 is I=(q−ξD)+I=(q-\xi D)^+I=(q−ξD)+. The period-2 revenue R(s,I)R(s,I)R(s,I) counts the waiting strategic consumers with value at least sss and, if s≤vBs\le v_Bs≤vB​, the bargain hunters, up to the inventory III. The retailer's expected profit at unit cost ccc is

π(q,v^)=E[pmin⁡(q,ξD)−cq+sup⁡0≤s≤pR(s,I)].\pi(q,\hat v)=\mathbb E\Big[p\min(q,\xi D)-cq+\sup_{0\le s\le p}R(s,I)\Big].π(q,v^)=E[pmin(q,ξD)−cq+0≤s≤psup​R(s,I)].

With quick response, units ordered before the season cost c1c_1c1​ and units ordered after observing DDD cost c2c_2c2​, with c1≤c2≤pc_1\le c_2\le pc1​≤c2​≤p. The second order covers all first-period demand and may add stock for the sale. The resulting profit is πr(q,v^)\pi_r(q,\hat v)πr​(q,v^).

In the sale period, waiting strategic consumers are rationed: they effectively face the inventory θI\theta IθI, where θ∈[0,1]\theta\in[0,1]θ∈[0,1] measures their place in the queue. A strategic consumer with value v^\hat vv^ who waits gains, in expectation,

ψ(v^)=(v^−vB)Pr⁡(D<Dl and a unit is received),\psi(\hat v)=(\hat v-v_B)\Pr(D<D_l\text{ and a unit is received}),ψ(v^)=(v^−vB​)Pr(D<Dl​ and a unit is received),

where DlD_lDl​ is the demand level below which the retailer clears stock at sl=vBs_l=v_Bsl​=vB​. A rational expectations equilibrium (q∗,v∗)(q^*,v^*)(q∗,v∗) is a pair in which q∗q^*q∗ maximizes π(⋅,v∗)\pi(\cdot,v^*)π(⋅,v∗) and v∗v^*v∗ is a best response of consumers who correctly expect q∗q^*q∗. The superscript mmm denotes the benchmark with only myopic consumers (α=0\alpha=0α=0): πm\pi^mπm and πrm\pi^m_rπrm​ are the optimal myopic profits without and with quick response.

Formalization targets

Goal: Theorem 3

Assume MSLR and no rationing, 0<α≤10<\alpha\le10<α≤1, vB<c1<pv_B<c_1<pvB​<c1​<p, c1≤c2≤pc_1\le c_2\le pc1​≤c2​≤p, and condition (6):

vM−pvˉ−vB ≥ c2−c1c2−vB.\frac{v_M-p}{\bar v-v_B}\ \ge\ \frac{c_2-c_1}{c_2-v_B}.vˉ−vB​vM​−p​ ≥ c2​−vB​c2​−c1​​.

Let (q∗,v∗)(q^*,v^*)(q∗,v∗) be any equilibrium without quick response, (qr∗,vr∗)(q_r^*,v_r^*)(qr∗​,vr∗​) any equilibrium with it, and πm\pi^mπm, πrm\pi_r^mπrm​ the myopic optima. Then

πr(qr∗,vr∗)−π(q∗,v∗) ≥ πrm−πm.\pi_r(q_r^*,v_r^*)-\pi(q^*,v^*)\ \ge\ \pi_r^m-\pi^m .πr​(qr∗​,vr∗​)−π(q∗,v∗) ≥ πrm​−πm.

Milestones

The milestones follow the paper's path:

  • the threshold structure (Lemma 1);
  • the optimal sale price (Lemma 2) and quasi-concavity of π\piπ with first-order condition (2) (Lemma 3);
  • the fill probability and the limits of the best response (Lemma 4);
  • existence and the comparison q∗≤qmq^*\le q^mq∗≤qm, π∗≤πm\pi^*\le\pi^mπ∗≤πm (Theorem 1), with the myopic newsvendor F(qm)=(p−c)/(p−vB)F(q^m)=(p-c)/(p-v_B)F(qm)=(p−c)/(p−vB​);
  • the quick-response analogues (Lemma 5, Theorem 2 (i)), with the myopic fractile F(qrm)=(c2−c1)/(c2−vB)F(q^m_r)=(c_2-c_1)/(c_2-v_B)F(qrm​)=(c2​−c1​)/(c2​−vB​);
  • the statement that under (6) every equilibrium with quick response has vr∗=vˉv^*_r=\bar vvr∗​=vˉ (Theorem 2, last sentence).

Corollary 1 is the percentage form, Δ/π∗≥Δm/πm\Delta/\pi^*\ge\Delta_m/\pi^mΔ/π∗≥Δm​/πm.

Significance

Theorem 3 identifies a second channel through which quick response creates value. Beyond matching supply to demand, it lets the retailer keep its initial stock low enough that a deep markdown becomes unlikely, so strategic consumers buy at full price. Under (6), all of them do. Quick response thus reduces strategic waiting without withholding availability, unlike the inventory-signalling remedies in the literature, and the theorem quantifies when this effect dominates.

The results are proved in the working paper, partly in a technical appendix. No machine-checked version of them, or of the underlying markdown game, is known. A formalization pins down several statements that the paper states loosely:

  • the uniqueness claims of Lemmas 2 and 5;
  • the case condition of Lemma 4 (i), which is false as printed;
  • the sign in display (5);
  • the boundary cases of the threshold lemma.

It also produces reusable components: the newsvendor with salvage and the reactive-capacity fractile under a general density, and a rational-expectations equilibrium predicate for a retailer–consumer game.

Difficulty

The profit π(⋅,v^)\pi(\cdot,\hat v)π(⋅,v^) is not concave: with strategic consumers it is concave–convex (Figure 4 of the paper). The newsvendor argument therefore does not give a unique optimal order, and Lemma 3's quasi-concavity rests on MSLR in a short appendix step.

Existence (Theorem 1) needs a fixed point of the map q↦q\mapstoq↦ best response, but the consumer best response is a correspondence, not a function, so the printed intermediate-value argument does not apply directly. Theorem 3 needs a statement about every equilibrium with quick response, while Theorem 2's proof only exhibits one. Ruling out an equilibrium with vr∗<vˉv_r^*<\bar vvr∗​<vˉ requires comparing the derivative (4) of πr\pi_rπr​ with the myopic derivative along the whole demand distribution.

Formalization scope

Lean represents prices, quantities and valuations as reals, demand by a density f:R→Rf:\mathbb R\to\mathbb Rf:R→R on [0,∞)[0,\infty)[0,∞), and expectations as Lebesgue integrals against fff. The model carries the standing assumptions of §3 as fields, plus the following additions and corrections, each disclosed in the item notes:

  • vB>0v_B>0vB​>0: DlD_lDl​ divides by sl=vBs_l=v_Bsl​=vB​.
  • p<vMp<v_Mp<vM​, strengthening vM≥pv_M\ge pvM​≥p: Lemma 4 (ii) and Theorem 2's last claim need it.
  • A finite mean: πr\pi_rπr​ contains E[pξD]\mathbb E[p\xi D]E[pξD].
  • The paper's "θc≤θ\theta_c\le\thetaθc​≤θ" (p. 15) is replaced by the no-rationing condition slGˉ(v^)≤θsmGˉ(sm)s_l\bar G(\hat v)\le\theta s_m\bar G(s_m)sl​Gˉ(v^)≤θsm​Gˉ(sm​) for every belief, which is exactly Dl≤DθD_l\le D_\thetaDl​≤Dθ​. The printed condition agrees with it only when sm=v^s_m=\hat vsm​=v^.
  • Lemma 4 (i) is stated with the corrected case split.
  • Lemmas 2 and 5 claim uniqueness only off the tie points.
  • c<pc<pc<p is the reading of the "p−c>0p-c>0p−c>0" step in the proof of Theorem 1.
  • In the quick-response profit, ξD\xi DξD replaces the DDD that the proof of Theorem 2 prints.

Optimal revenues are suprema over all prices s∈[0,p]s\in[0,p]s∈[0,p] (and q2≥0q_2\ge0q2​≥0 with quick response). "Optimal order" means a maximizer over all q≥0q\ge0q≥0, never a stationary point, and the myopic benchmarks are the same functions at α=0\alpha=0α=0. Defining the optimal revenue by Lemma 2's closed form would make Lemma 2 and the first-order conditions definitional; it is not done.

The fill rate is min⁡{(1−ξ)x,θI}/((1−ξ)x)\min\{(1-\xi)x,\theta I\}/((1-\xi)x)min{(1−ξ)x,θI}/((1−ξ)x), set to 111 when no strategic consumer waits. With Lean's 0/0=00/0=00/0=0 instead, vˉ\bar vvˉ would be a best response to every order and Theorem 2's last claim would be trivial.

A complete development needs:

  • differentiation under the integral for piecewise-smooth integrands;
  • quasi-concavity from a single-crossing derivative;
  • a fixed-point argument for the equilibrium correspondence;
  • the newsvendor and reactive-capacity fractiles.

The last two are reusable beyond this mission. Proofs of any milestone, alternative existence arguments, and sorry-free proofs of the newsvendor items are welcome. The comparison "qr∗≤q∗q_r^*\le q^*qr∗​≤q∗, πr∗≥π∗\pi_r^*\ge\pi^*πr∗​≥π∗" of Theorem 2 and §8's numerical study are outside the scope.

Selected references

  • G. P. Cachon, R. Swinney, Purchasing, Pricing, and Quick Response in the Presence of Strategic Consumers, working paper, revised November 25, 2007; published in Management Science 55(3), 2009. https://doi.org/10.1287/mnsc.1080.0948
  • M. L. Fisher, A. Raman, Reducing the Cost of Demand Uncertainty Through Accurate Response to Early Sales, Operations Research 44(1), 1996. https://doi.org/10.1287/opre.44.1.87
  • J. F. Muth, Rational Expectations and the Theory of Price Movements, Econometrica 29(3), 1961. https://doi.org/10.2307/1909635
19 thms2 active usersReviewed
🏆Completed
Convex OptimizationNumerical Analysis·Captain: mikedeng1

Convex Optimization: Algorithms and Complexity XIII: Newton's Method Converges Quadratically, ‖x_{k+1} − x*‖ ≤ (M/μ)‖x_k − x*‖², from ‖x₀ − x*‖ ≤ μ/(2M)Textbook

Motivation

Newton's method is the basic second-order method of continuous optimization: at the current point it replaces the objective by its second-order Taylor model and jumps to the stationary point of that model. Its defining property is speed near a nondegenerate minimum, where the error is squared at every step, so that the number of correct digits roughly doubles per iteration. This local behaviour is what makes Newton's method the inner engine of interior point methods, the polynomial-time algorithms for linear, conic and general convex programming (Nesterov and Nemirovski, 1994). In S. Bubeck's monograph Convex Optimization: Algorithms and Complexity (Foundations and Trends in Machine Learning, 2015; arXiv:1405.4980v2), §5.3.2 recalls the traditional local analysis of Newton's method, Theorem 5.3, before turning to the affine-invariant self-concordance analysis used for interior point methods. This mission formalizes that theorem and the four steps of its proof.

Setting

Let Rn\mathbb R^nRn carry the Euclidean norm ∥⋅∥\|\cdot\|∥⋅∥, and write ∥A∥\|A\|∥A∥ for the operator norm of a linear map A:Rn→RnA:\mathbb R^n\to\mathbb R^nA:Rn→Rn, so that ∥Ax∥≤∥A∥ ∥x∥\|Ax\|\le\|A\|\,\|x\|∥Ax∥≤∥A∥∥x∥. Let f:Rn→Rf:\mathbb R^n\to\mathbb Rf:Rn→R be a C2C^2C2 function, with gradient ∇f(x)∈Rn\nabla f(x)\in\mathbb R^n∇f(x)∈Rn and Hessian ∇2f(x)\nabla^2 f(x)∇2f(x), a linear map Rn→Rn\mathbb R^n\to\mathbb R^nRn→Rn (the derivative of the gradient map). For a real number ccc, A⪰cInA\succeq cI_nA⪰cIn​ means ⟨Av,v⟩≥c∥v∥2\langle Av,v\rangle\ge c\|v\|^2⟨Av,v⟩≥c∥v∥2 for all v∈Rnv\in\mathbb R^nv∈Rn.

The Hessian is MMM-Lipschitz if ∥∇2f(x)−∇2f(y)∥≤M∥x−y∥\|\nabla^2 f(x)-\nabla^2 f(y)\|\le M\|x-y\|∥∇2f(x)−∇2f(y)∥≤M∥x−y∥ for all x,y∈Rnx,y\in\mathbb R^nx,y∈Rn.

Newton's method starts at x0∈Rnx_0\in\mathbb R^nx0​∈Rn and iterates, for k≥0k\ge0k≥0,

xk+1=xk−[∇2f(xk)]−1∇f(xk).x_{k+1}=x_k-[\nabla^2 f(x_k)]^{-1}\nabla f(x_k).xk+1​=xk​−[∇2f(xk​)]−1∇f(xk​).

A point x∗x^*x∗ is a local minimum of fff if f(x∗)≤f(x)f(x^*)\le f(x)f(x∗)≤f(x) for all xxx in a neighbourhood of x∗x^*x∗; it has strictly positive Hessian if ∇2f(x∗)⪰μIn\nabla^2 f(x^*)\succeq\mu I_n∇2f(x∗)⪰μIn​ for some μ>0\mu>0μ>0.

Formalization targets

Goal: Theorem 5.3 (p. 320)

Assume the Hessian of fff is MMM-Lipschitz, M>0M>0M>0, and x∗x^*x∗ is a local minimum with ∇2f(x∗)⪰μIn\nabla^2 f(x^*)\succeq\mu I_n∇2f(x∗)⪰μIn​, μ>0\mu>0μ>0. If ∥x0−x∗∥≤μ/(2M)\|x_0-x^*\|\le\mu/(2M)∥x0​−x∗∥≤μ/(2M), then Newton's method from x0x_0x0​ is well defined (every Hessian along the iterates is invertible, so the sequence exists and is unique) and

∥xk+1−x∗∥≤Mμ ∥xk−x∗∥2(k≥0),xk→x∗.\|x_{k+1}-x^*\|\le\frac M\mu\,\|x_k-x^*\|^2\quad(k\ge0),\qquad x_k\to x^*.∥xk+1​−x∗∥≤μM​∥xk​−x∗∥2(k≥0),xk​→x∗.

Milestones (p. 321, the steps of the proof)

  1. The integral formula ∫01∇2f(x+sh) h ds=∇f(x+h)−∇f(x)\int_0^1\nabla^2 f(x+sh)\,h\,ds=\nabla f(x+h)-\nabla f(x)∫01​∇2f(x+sh)hds=∇f(x+h)−∇f(x).
  2. The error representation of one Newton step, xk+1−x∗=[∇2f(xk)]−1∫01[∇2f(xk)−∇2f(x∗+s(xk−x∗))](xk−x∗) dsx_{k+1}-x^*=[\nabla^2 f(x_k)]^{-1}\int_0^1[\nabla^2 f(x_k)-\nabla^2 f(x^*+s(x_k-x^*))](x_k-x^*)\,dsxk+1​−x∗=[∇2f(xk​)]−1∫01​[∇2f(xk​)−∇2f(x∗+s(xk​−x∗))](xk​−x∗)ds.
  3. The Lipschitz bound ∫01∥∇2f(xk)−∇2f(x∗+s(xk−x∗))∥ ds≤M2∥xk−x∗∥\int_0^1\|\nabla^2 f(x_k)-\nabla^2 f(x^*+s(x_k-x^*))\|\,ds\le\frac M2\|x_k-x^*\|∫01​∥∇2f(xk​)−∇2f(x∗+s(xk​−x∗))∥ds≤2M​∥xk​−x∗∥.
  4. The Hessian lower bound ∇2f(xk)⪰(μ−M∥xk−x∗∥)In⪰μ2In\nabla^2 f(x_k)\succeq(\mu-M\|x_k-x^*\|)I_n\succeq\frac\mu2I_n∇2f(xk​)⪰(μ−M∥xk​−x∗∥)In​⪰2μ​In​ when ∥xk−x∗∥≤μ/(2M)\|x_k-x^*\|\le\mu/(2M)∥xk​−x∗∥≤μ/(2M).

Significance

The theorem gives a quantitative basin of quadratic convergence: an explicit radius μ/(2M)\mu/(2M)μ/(2M), depending only on the curvature at the minimum and the Lipschitz constant of the Hessian, inside which Newton's method needs only O(log⁡log⁡(1/ε))O(\log\log(1/\varepsilon))O(loglog(1/ε)) iterations to reach accuracy ε\varepsilonε. It is the classical statement whose shortcomings (dependence on a choice of norm, constants that change under linear changes of variables) motivate the self-concordance theory of the following subsections, and it is the local convergence result invoked whenever a damped or globalized Newton scheme is shown to enter its quadratic phase.

On the formal side, Mathlib has the calculus this needs (Fréchet derivatives, interval integrals of vector-valued maps, operator norms) but no convergence theorem for multivariate Newton's method for minimization. A formal proof produces reusable pieces: the integral form of the mean value theorem for gradients, the stability of a positive-definite lower bound under Lipschitz perturbations, and an inverse-operator norm bound from a quadratic-form lower bound. The result itself is classical and fully proved in the literature; what is open here is its machine-checked proof in this form.

Difficulty

The individual inequalities are short, but the argument is an induction in which well-definedness and the rate are proved together: the Hessian at xkx_kxk​ is invertible only because xkx_kxk​ is still in the ball of radius μ/(2M)\mu/(2M)μ/(2M), and xk+1x_{k+1}xk+1​ stays in that ball only because of the rate. A proof that first assumes the sequence exists and then bounds it is circular. The proof also passes between two kinds of control on the Hessian, a lower bound on its quadratic form and an operator-norm bound on its inverse, and the second is only meaningful once invertibility is established. Finally, the integral manipulations need integrability of the maps s↦∇2f(x∗+s(xk−x∗))(xk−x∗)s\mapsto\nabla^2 f(x^*+s(x_k-x^*))(x_k-x^*)s↦∇2f(x∗+s(xk​−x∗))(xk​−x∗), which comes from the continuity of the Hessian.

Formalization scope

Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n). The gradient and Hessian are explicit maps g:Rn→Rng:\mathbb R^n\to\mathbb R^ng:Rn→Rn and H:Rn→(Rn→LRn)H:\mathbb R^n\to(\mathbb R^n\to_L\mathbb R^n)H:Rn→(Rn→L​Rn) with ContDiff ℝ 2 f, HasGradientAt f (g x) x and HasFDerivAt g (H x) x at every point; the norm on H(x)H(x)H(x) is Mathlib's operator norm, as on the page. A⪰cInA\succeq cI_nA⪰cIn​ is the quadratic-form inequality. A Newton run is a sequence x:N→Rnx:\mathbb N\to\mathbb R^nx:N→Rn indexed from 000 satisfying the linear system ∇2f(xk)(xk−xk+1)=∇f(xk)\nabla^2 f(x_k)(x_k-x_{k+1})=\nabla f(x_k)∇2f(xk​)(xk​−xk+1​)=∇f(xk​); no inverse of a possibly singular operator appears in any hypothesis, and "well defined" is a conclusion: a unique run exists from x0x_0x0​ and every Hessian along it is bijective. The rate and xk→x∗x_k\to x^*xk​→x∗ are asserted for every run. The error representation is stated with both sides multiplied by ∇2f(xk)\nabla^2 f(x_k)∇2f(xk​), which is equivalent to the printed form once the Hessian is invertible. Milestones 3 and 4 use only the Lipschitz property and are stated for any Lipschitz map HHH.

Added hypothesis: M>0M>0M>0 (the radius μ/(2M)\mu/(2M)μ/(2M) divides by MMM; with M=0M=0M=0, Lean's convention μ/0=0\mu/0=0μ/0=0 would collapse the hypothesis to x0=x∗x_0=x^*x0​=x∗). Convexity of fff is not assumed, as on the page; x∗x^*x∗ is a local minimum and ∇f(x∗)=0\nabla f(x^*)=0∇f(x∗)=0 is derived, not assumed. Encoding the Newton step with Lean's inverse (which returns 000 on singular maps), or replacing ∇2f(x∗)⪰μIn\nabla^2 f(x^*)\succeq\mu I_n∇2f(x∗)⪰μIn​ by mere invertibility, would change the theorem and is ruled out.

A complete development needs the fundamental theorem of calculus for C1C^1C1 vector-valued maps along segments, Hessian-based quadratic-form estimates, and operator-norm bounds for inverses; all are reusable for the analysis of damped Newton, cubic regularization and interior point methods. Proofs of the milestones independently of the goal are welcome.

Selected references

  • S. Bubeck, Convex Optimization: Algorithms and Complexity, Foundations and Trends in Machine Learning 8(3–4):231–358, 2015. arXiv:1405.4980v2, §5.3.2, Theorem 5.3, pp. 320–321.
  • Yu. Nesterov and A. Nemirovski, Interior-Point Polynomial Algorithms in Convex Programming, SIAM Studies in Applied Mathematics 13, 1994. doi:10.1137/1.9781611970791
  • Yu. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, Kluwer, 2004, Theorem 1.2.5. doi:10.1007/978-1-4419-8853-9
6 thms2 active usersReviewed
🏆Completed
Convex OptimizationMachine Learning·Captain: mikedeng1

Convex Optimization: Algorithms and Complexity X: Nesterov's Accelerated Gradient Descent on a β-Smooth α-Strongly Convex Function Has Rate ((α + β)/2)‖x₁ − x*‖² exp(−(t − 1)/√κ)Textbook

Why accelerated rates matter

First-order methods, which query only function values and gradients, are the workhorse of large-scale optimization in machine learning, signal processing and operations research, because each step costs little more than one gradient evaluation. For a function that is both strongly convex and smooth, plain gradient descent converges geometrically, but the number of steps needed to reach accuracy ε\varepsilonε scales with the condition number κ\kappaκ of the problem. In 1983 Nesterov showed that a gradient method with a carefully chosen momentum term needs a number of steps proportional to κ\sqrt\kappaκ​ instead, and that this is optimal for black-box first-order methods. On ill-conditioned problems, where κ\kappaκ is in the thousands or millions, the difference between κ\kappaκ and κ\sqrt\kappaκ​ is the difference between practical and impractical.

This mission is the tenth of a series formalizing S. Bubeck's monograph Convex Optimization: Algorithms and Complexity (Foundations and Trends in Machine Learning, 2015; arXiv:1405.4980v2). It covers §3.7.1, the smooth and strongly convex case of Nesterov's accelerated gradient descent, and its main result, Theorem 3.18.

Setting

Work in Rn\mathbb R^nRn with the Euclidean inner product x⊤yx^\top yx⊤y and norm ∥⋅∥\|\cdot\|∥⋅∥. Let f:Rn→Rf:\mathbb R^n\to\mathbb Rf:Rn→R be differentiable with gradient ∇f\nabla f∇f.

  • fff is β\betaβ-smooth if its gradient is β\betaβ-Lipschitz: ∥∇f(x)−∇f(y)∥≤β∥x−y∥\|\nabla f(x)-\nabla f(y)\|\le\beta\|x-y\|∥∇f(x)−∇f(y)∥≤β∥x−y∥ for all x,yx,yx,y.
  • fff is α\alphaα-strongly convex (α>0\alpha>0α>0) if for all x,yx,yx,y
f(y)≥f(x)+∇f(x)⊤(y−x)+α2∥y−x∥2.f(y)\ge f(x)+\nabla f(x)^\top(y-x)+\frac\alpha2\|y-x\|^2 .f(y)≥f(x)+∇f(x)⊤(y−x)+2α​∥y−x∥2.
  • The condition number is κ=β/α\kappa=\beta/\alphaκ=β/α; for n≥1n\ge1n≥1 one always has κ≥1\kappa\ge1κ≥1.
  • x∗x^*x∗ denotes a minimizer of fff on Rn\mathbb R^nRn.

Nesterov's accelerated gradient descent starts at an arbitrary point x1=y1x_1=y_1x1​=y1​ and iterates, for t≥1t\ge1t≥1,

yt+1=xt−1β∇f(xt),xt+1=(1+κ−1κ+1)yt+1−κ−1κ+1 yt.y_{t+1}=x_t-\frac1\beta\nabla f(x_t),\qquad x_{t+1}=\Big(1+\frac{\sqrt\kappa-1}{\sqrt\kappa+1}\Big)y_{t+1}-\frac{\sqrt\kappa-1}{\sqrt\kappa+1}\,y_t .yt+1​=xt​−β1​∇f(xt​),xt+1​=(1+κ​+1κ​−1​)yt+1​−κ​+1κ​−1​yt​.

The point yt+1y_{t+1}yt+1​ is a gradient step from xtx_txt​, and xt+1x_{t+1}xt+1​ moves beyond yt+1y_{t+1}yt+1​ in the direction yt+1−yty_{t+1}-y_tyt+1​−yt​ by the fixed momentum factor (κ−1)/(κ+1)(\sqrt\kappa-1)/(\sqrt\kappa+1)(κ​−1)/(κ​+1).

The analysis in the book uses auxiliary quadratic functions Φs\Phi_sΦs​ (an estimate sequence), defined from the points xsx_sxs​ by

Φ1(x)=f(x1)+α2∥x−x1∥2,Φs+1(x)=(1−1κ)Φs(x)+1κ(f(xs)+∇f(xs)⊤(x−xs)+α2∥x−xs∥2),\Phi_1(x)=f(x_1)+\frac\alpha2\|x-x_1\|^2,\qquad \Phi_{s+1}(x)=\Big(1-\frac1{\sqrt\kappa}\Big)\Phi_s(x)+\frac1{\sqrt\kappa}\Big(f(x_s)+\nabla f(x_s)^\top(x-x_s)+\frac\alpha2\|x-x_s\|^2\Big),Φ1​(x)=f(x1​)+2α​∥x−x1​∥2,Φs+1​(x)=(1−κ​1​)Φs​(x)+κ​1​(f(xs​)+∇f(xs​)⊤(x−xs​)+2α​∥x−xs​∥2),

together with their centres vsv_svs​ (with v1=x1v_1=x_1v1​=x1​ and the recursion (3.21) of the book) and their minimum values Φs∗\Phi^*_sΦs∗​.

Formalization targets

Goal: Theorem 3.18

For every run of the method and every t≥1t\ge1t≥1,

f(yt)−f(x∗)≤α+β2 ∥x1−x∗∥2exp⁡(−t−1κ).f(y_t)-f(x^*)\le\frac{\alpha+\beta}2\,\|x_1-x^*\|^2\exp\Big(-\frac{t-1}{\sqrt\kappa}\Big).f(yt​)−f(x∗)≤2α+β​∥x1​−x∗∥2exp(−κ​t−1​).

Milestones, from the book's proof

  1. (3.18): Φs+1(x)≤f(x)+(1−1/κ)s(Φ1(x)−f(x))\Phi_{s+1}(x)\le f(x)+(1-1/\sqrt\kappa)^s(\Phi_1(x)-f(x))Φs+1​(x)≤f(x)+(1−1/κ​)s(Φ1​(x)−f(x)) for all xxx.
  2. (3.19): f(ys)≤min⁡x∈RnΦs(x)f(y_s)\le\min_{x\in\mathbb R^n}\Phi_s(x)f(ys​)≤minx∈Rn​Φs​(x).
  3. The geometric rate: f(yt)−f(x∗)≤α+β2∥x1−x∗∥2(1−1/κ)t−1f(y_t)-f(x^*)\le\frac{\alpha+\beta}2\|x_1-x^*\|^2(1-1/\sqrt\kappa)^{t-1}f(yt​)−f(x∗)≤2α+β​∥x1​−x∗∥2(1−1/κ​)t−1.
  4. The form Φs(x)=Φs∗+α2∥x−vs∥2\Phi_s(x)=\Phi^*_s+\frac\alpha2\|x-v_s\|^2Φs​(x)=Φs∗​+2α​∥x−vs​∥2 with vsv_svs​ given by (3.21).
  5. The identity (3.22) for Φs+1∗\Phi^*_{s+1}Φs+1∗​.
  6. The inequality (3.20), the inductive step of (3.19).
  7. The coupling vs−xs=κ (xs−ys)v_s-x_s=\sqrt\kappa\,(x_s-y_s)vs​−xs​=κ​(xs​−ys​).

The geometric form in milestone 3 is slightly stronger than the goal, which follows from 1−u≤e−u1-u\le e^{-u}1−u≤e−u.

Significance

Theorem 3.18 gives ε\varepsilonε-accuracy after O(κlog⁡(1/ε))O(\sqrt\kappa\log(1/\varepsilon))O(κ​log(1/ε)) gradient evaluations. Projected gradient descent with step 1/β1/\beta1/β on the same class contracts only at the rate exp⁡(−t/κ)\exp(-t/\kappa)exp(−t/κ) (Theorem 3.10 of the book). The lower bound of Theorem 3.15 shows that no black-box first-order method can do better than ((κ−1)/(κ+1))2(t−1)((\sqrt\kappa-1)/(\sqrt\kappa+1))^{2(t-1)}((κ​−1)/(κ​+1))2(t−1), so the accelerated rate is optimal up to constants. The estimate-sequence argument is the template for many later accelerated methods: proximal, stochastic and variance-reduced variants such as Katyusha, and accelerated coordinate descent.

The result is classical and fully proved on paper. No machine-checked proof of the accelerated rate for strongly convex smooth functions is known to exist in Lean's Mathlib. This mission produces one, with the estimate sequence Φs\Phi_sΦs​, its centres and its minimum values as reusable objects, and with every algebraic identity of the book's proof stated separately.

Difficulty

The algorithm is two lines, but its analysis is not a one-step contraction: neither ∥xt−x∗∥\|x_t-x^*\|∥xt​−x∗∥ nor f(yt)−f(x∗)f(y_t)-f(x^*)f(yt​)−f(x∗) decreases by the factor 1−1/κ1-1/\sqrt\kappa1−1/κ​ at every step. A Lyapunov argument for gradient descent, applied directly to yty_tyt​, gives only the rate 1−1/κ1-1/\kappa1−1/κ. The book obtains the rate through the auxiliary functions Φs\Phi_sΦs​. The inequality (3.18) is easy, but (3.19), that the minimum of Φs\Phi_sΦs​ never drops below f(ys)f(y_s)f(ys​), depends on the exact choice of the momentum factor. It holds only through the identity vs−xs=κ(xs−ys)v_s-x_s=\sqrt\kappa(x_s-y_s)vs​−xs​=κ​(xs​−ys​), which ties the centre of Φs\Phi_sΦs​ to the iterates. Formally, the obstacles are the bookkeeping of the recursive quadratics on Rn\mathbb R^nRn and the algebra in κ\sqrt\kappaκ​, 1/κ1/\sqrt\kappa1/κ​ and 1/(ακ)=κ/β1/(\alpha\sqrt\kappa)=\sqrt\kappa/\beta1/(ακ​)=κ​/β.

Formalization scope

  • Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n). The gradient is an explicit map g with HasGradientAt f (g x) x at every point, which is part of the smoothness predicate IsBetaSmooth f g β. Strong convexity is the published definition OnlineConvexOpt.ConvexBasics.StronglyConvexOn Set.univ f g α, which is the book's (3.13).
  • A run of the method is a predicate IsNesterovSCRun g α β x y on two sequences indexed from 111, with x1=y1x_1=y_1x1​=y1​ arbitrary. Every theorem holds for every run, that is, every starting point.
  • κ\kappaκ is kappa α β = β / α. All theorems assume α>0\alpha>0α>0 and β>0\beta>0β>0. The second is implied by the other hypotheses for n≥1n\ge1n≥1; no hypothesis α≤β\alpha\le\betaα≤β is added.
  • The existence of a minimizer x∗x^*x∗ is the book's standing assumption, written as a hypothesis.
  • Φs\Phi_sΦs​, vsv_svs​ and Φs∗=Φs(vs)\Phi^*_s=\Phi_s(v_s)Φs∗​=Φs​(vs​) are explicit recursive definitions. The book's Φs∗=min⁡Φs\Phi^*_s=\min\Phi_sΦs∗​=minΦs​ is recovered by milestone 4, and no real infimum is used. The minimum in (3.19) is stated as f(ys)≤Φs(x)f(y_s)\le\Phi_s(x)f(ys​)≤Φs​(x) for every xxx.
  • The identities of milestones 4, 5 and 7 are algebraic and are stated without convexity or smoothness, for arbitrary sequences or runs.
  • Ruled out as trivializing: a run predicate that drops x1=y1x_1=y_1x1​=y1​ breaks (3.19) at s=1s=1s=1 and is not used. A minimum value Φs∗\Phi^*_sΦs∗​ defined through (3.22) would make that identity a tautology, so Φs∗\Phi^*_sΦs∗​ is defined as a value of Φs\Phi_sΦs​.
  • The definitions are local to the namespace ConvexOptAlg.NesterovStrong. β-smoothness duplicates the predicate of other missions of the series and will be merged afterwards. Contributions welcome: proofs of the milestones, and general lemmas on quadratics z↦c+α2∥z−v∥2z\mapsto c+\frac\alpha2\|z-v\|^2z↦c+2α​∥z−v∥2 that the algebraic milestones need.

Selected references

  • S. Bubeck, Convex Optimization: Algorithms and Complexity, Foundations and Trends in Machine Learning 8(3–4):231–358, 2015. arXiv:1405.4980v2, §3.7.1, Theorem 3.18, pp. 290–293.
  • Y. Nesterov, A method of solving a convex programming problem with convergence rate O(1/k²), Soviet Mathematics Doklady 27:372–376, 1983.
  • Y. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, Kluwer, 2004. doi:10.1007/978-1-4419-8853-9
10 thms2 active usersReviewed
🏆Completed
Machine LearningOptimal TransportStatistics·Captain: mikedeng1

Robust Wasserstein Profile Inference and Applications to Machine Learning 2: ℓp-Regularized Logistic Regression and the Hinge-Loss SVM Are Wasserstein DRO under a Label-Preserving Transport CostResearch Paper

Motivation

Regularized logistic regression and the support vector machine (SVM) are two of the most widely used linear classifiers. Both are usually introduced as empirical risk minimization plus a norm penalty ∥β∥p\|\beta\|_p∥β∥p​ whose size is tuned by cross-validation, with the penalty justified heuristically as a guard against overfitting. Distributionally robust optimization (DRO) offers a different reading: instead of minimizing the average loss on the training sample, minimize the worst average loss over all distributions close to the empirical one. Blanchet, Kang and Murthy (arXiv:1610.05627v4; J. Appl. Probab. 56(3), 2019) show that, for a suitable notion of closeness based on optimal transport, the robust problem and the penalized problem coincide exactly. The penalty is then the price of robustness against perturbations of the predictors, and the regularization parameter becomes the radius of an uncertainty set, which the same paper later chooses by a statistical criterion (the robust Wasserstein profile).

Related earlier work: Shafieezadeh-Abadeh, Mohajerin Esfahani and Kuhn (NIPS 2015) studied Wasserstein-robust logistic regression with a metric that charges a finite price κ\kappaκ for flipping a label, and obtained regularized logistic regression only in the limit κ→∞\kappa \to \inftyκ→∞. The result formalized here is the exact statement at κ=∞\kappa = \inftyκ=∞, together with the analogous statement for the hinge loss.

Setting

Training data are pairs (X1,Y1),…,(Xn,Yn)(X_1,Y_1),\dots,(X_n,Y_n)(X1​,Y1​),…,(Xn​,Yn​) with predictors Xi∈RdX_i \in \mathbb R^dXi​∈Rd and labels Yi∈{−1,+1}Y_i \in \{-1,+1\}Yi​∈{−1,+1}, n≥1n \ge 1n≥1. Their empirical distribution is Pn=1n∑i=1nδ(Xi,Yi)P_n = \frac1n\sum_{i=1}^n \delta_{(X_i,Y_i)}Pn​=n1​∑i=1n​δ(Xi​,Yi​)​, a probability measure on Z=Rd×RZ = \mathbb R^d \times \mathbb RZ=Rd×R.

For a cost c:Z×Z→[0,∞]c : Z \times Z \to [0,\infty]c:Z×Z→[0,∞], the optimal transport cost between probability measures PPP and QQQ on ZZZ is

Dc(P,Q)=inf⁡{Eπ[c(U,W)]:π a probability measure on Z×Z, πU=P, πW=Q}.D_c(P,Q) = \inf\big\{\mathbb E_\pi[c(U,W)] : \pi \text{ a probability measure on } Z\times Z,\ \pi_U = P,\ \pi_W = Q\big\}.Dc​(P,Q)=inf{Eπ​[c(U,W)]:π a probability measure on Z×Z, πU​=P, πW​=Q}.

The cost used here is the label-preserving cost: for q∈[1,∞]q \in [1,\infty]q∈[1,∞],

Nq((x,y),(u,v))=∥x−u∥q if y=v,+∞ otherwise.N_q\big((x,y),(u,v)\big) = \|x - u\|_q \text{ if } y = v, \qquad +\infty \text{ otherwise}.Nq​((x,y),(u,v))=∥x−u∥q​ if y=v,+∞ otherwise.

Every distribution PPP with DNq(P,Pn)<∞D_{N_q}(P,P_n) < \inftyDNq​​(P,Pn​)<∞ has the same label distribution as PnP_nPn​; only the predictors are perturbed. The exponent ppp is the conjugate of qqq, 1/p+1/q=11/p + 1/q = 11/p+1/q=1.

The losses are the log-exponential loss log⁡(1+e−yβTx)\log(1 + e^{-y\beta^T x})log(1+e−yβTx) and the hinge loss (1−yβTx)+(1 - y\beta^T x)^+(1−yβTx)+, for a coefficient vector β∈Rd\beta \in \mathbb R^dβ∈Rd. The worst-case expected loss at radius δ≥0\delta \ge 0δ≥0 is sup⁡{EP[l]:DNq(P,Pn)≤δ}\sup\{\mathbb E_P[l] : D_{N_q}(P,P_n) \le \delta\}sup{EP​[l]:DNq​​(P,Pn​)≤δ}, the supremum over probability measures PPP on ZZZ.

Formalization targets

Goal: Theorem 2 (p. 11)

For every δ≥0\delta \ge 0δ≥0 and every β∈Rd\beta \in \mathbb R^dβ∈Rd,

sup⁡P: DNq(P,Pn)≤δEP[log⁡(1+e−YβTX)]=1n∑i=1nlog⁡(1+e−YiβTXi)+δ∥β∥p,\sup_{P:\ D_{N_q}(P,P_n)\le\delta} \mathbb E_P\big[\log(1 + e^{-Y\beta^T X})\big] = \frac1n\sum_{i=1}^n \log(1 + e^{-Y_i\beta^T X_i}) + \delta\|\beta\|_p,P: DNq​​(P,Pn​)≤δsup​EP​[log(1+e−YβTX)]=n1​i=1∑n​log(1+e−Yi​βTXi​)+δ∥β∥p​, sup⁡P: DNq(P,Pn)≤δEP[(1−YβTX)+]=1n∑i=1n(1−YiβTXi)++δ∥β∥p,\sup_{P:\ D_{N_q}(P,P_n)\le\delta} \mathbb E_P\big[(1 - Y\beta^T X)^+\big] = \frac1n\sum_{i=1}^n (1 - Y_i\beta^T X_i)^+ + \delta\|\beta\|_p,P: DNq​​(P,Pn​)≤δsup​EP​[(1−YβTX)+]=n1​i=1∑n​(1−Yi​βTXi​)++δ∥β∥p​,

and consequently the two identities obtained by taking inf⁡β\inf_{\beta}infβ​ on both sides, which is how the paper prints the theorem.

Milestones

  1. Proposition 1 (p. 10): strong duality, sup⁡P:Dc(P,Pn)≤δEP[l]=min⁡γ≥0{γδ+1n∑iφγ(Xi,Yi)}\sup_{P: D_c(P,P_n)\le\delta}\mathbb E_P[l] = \min_{\gamma\ge0}\{\gamma\delta + \frac1n\sum_i\varphi_\gamma(X_i,Y_i)\}supP:Dc​(P,Pn​)≤δ​EP​[l]=minγ≥0​{γδ+n1​∑i​φγ​(Xi​,Yi​)} with φγ(z0)=sup⁡z{l(z)−γc(z,z0)}\varphi_\gamma(z_0) = \sup_z\{l(z) - \gamma c(z,z_0)\}φγ​(z0​)=supz​{l(z)−γc(z,z0​)}, for a lower semicontinuous cost vanishing on the diagonal, an upper semicontinuous loss and δ>0\delta > 0δ>0.
  2. Logistic inner supremum (proof of Theorem 2, p. 30): sup⁡x{log⁡(1+e−y0βTx)−λ∥x−x0∥q}\sup_x\{\log(1+e^{-y_0\beta^T x}) - \lambda\|x - x_0\|_q\}supx​{log(1+e−y0​βTx)−λ∥x−x0​∥q​} equals the loss at x0x_0x0​ if ∥β∥p≤λ\|\beta\|_p \le \lambda∥β∥p​≤λ and +∞+\infty+∞ otherwise.
  3. Logistic outer minimisation (p. 30): the infimum over λ≥0\lambda \ge 0λ≥0 of δλ\delta\lambdaδλ plus the average of these suprema equals the regularized empirical loss.
  4. Hinge inner supremum (pp. 30–31) and 5. hinge outer minimisation (p. 31): the same two steps for the hinge loss.

Significance

The theorem identifies two standard estimators as exact solutions of a robust decision problem. Consequences: the penalty δ∥β∥p\delta\|\beta\|_pδ∥β∥p​ has a quantitative meaning (the adversary's transport budget), the regularization parameter can be chosen by the paper's robust Wasserstein profile instead of cross-validation, and the norm of the penalty is tied to the geometry of the perturbations (perturbations measured in ℓ∞\ell_\inftyℓ∞​ give an ℓ1\ell_1ℓ1​ penalty). The same identity is the input of the paper's coverage bound (Proposition 6) for ρ=1\rho = 1ρ=1.

The result is proved on paper; no machine-checked version is known. The formalization adds a precise statement of the objects involved (couplings with both marginals fixed, an infinite cost across labels, expectations of nonnegative losses with values in [0,∞][0,\infty][0,∞]), a checked version of the duality step specialised to this cost, and the treatment of boundary cases (δ=0\delta = 0δ=0, β=0\beta = 0β=0, q∈{1,∞}q \in \{1,\infty\}q∈{1,∞}) that the paper does not discuss.

Difficulty

The identities are short once Proposition 1 is available, so the weight of the mission lies in two places. First, Proposition 1 itself is a strong duality theorem for optimal transport over all probability measures on Rd+1\mathbb R^{d+1}Rd+1, with a cost that takes the value +∞+\infty+∞ and an unbounded loss, and with attainment of the dual minimum; it is quoted from Blanchet and Murthy (Math. Oper. Res. 2019) and not proved in this paper. The weak-duality inequality is routine; the reverse inequality requires constructing near-optimal distributions from the dual, which needs measurable selection of near-maximizers and does not follow from finite-dimensional convex duality. Second, the inner suprema require an exact Hölder-attainment argument for the pair of conjugate norms ℓp\ell_pℓp​ and ℓq\ell_qℓq​, including q=1q = 1q=1 and q=∞q = \inftyq=∞, and for the hinge loss a minimax exchange over α∈[0,1]\alpha \in [0,1]α∈[0,1]. Bypassing duality by a direct construction of the worst distribution is possible for the upper value but not obviously for the lower bound at the boundary λ=∥β∥p\lambda = \|\beta\|_pλ=∥β∥p​.

Formalization scope

  • Predictors are Fin d → ℝ, a data point is (Fin d → ℝ) × ℝ with the product Borel σ-algebra, and samples are indexed by Fin n with 0 < n. Labels are real numbers with the hypothesis Yi∈{−1,+1}Y_i \in \{-1,+1\}Yi​∈{−1,+1}, which Theorem 2 inherits from Example 2; the cost NqN_qNq​ is defined on all of Rd×R\mathbb R^d\times\mathbb RRd×R.
  • The ℓq\ell_qℓq​ norm is the norm of PiLp q, with q p : ℝ≥0∞ and p.HolderConjugate q; q=1q = 1q=1 and q=∞q = \inftyq=∞ are included, and no further restriction on qqq is imposed.
  • The transport cost is an infimum in [0,∞][0,\infty][0,∞] over probability measures on Z×ZZ\times ZZ×Z with both marginals fixed. Expectations are lower Lebesgue integrals of the nonnegative losses, and the worst case is a supremum in [0,∞][0,\infty][0,∞] over probability measures. The empirical distribution is the published platform definition WassersteinDRO.Regularization.empiricalDistribution.
  • Readings. The paper prints the SVM identity without inf⁡β\inf_\betainfβ​ on the right; the goal states the per-β\betaβ identities (what the proof establishes) and the identities of infima with inf⁡β\inf_\betainfβ​ on both sides. The proof's displays write the transport norm as ∥⋅∥p\|\cdot\|_p∥⋅∥p​ and the penalty as ∥β∥q\|\beta\|_q∥β∥q​, the reverse of the theorem; milestones use the theorem's convention. The logistic chain's printed indicators 1{λ>∥β∥}\mathbf 1_{\{\lambda>\|\beta\|\}}1{λ>∥β∥}​, ∞1{λ≤∥β∥}\infty\mathbf 1_{\{\lambda\le\|\beta\|\}}∞1{λ≤∥β∥}​ should read ≥\ge≥ and <<<; the stated end-to-end identity is unaffected. Proposition 1 is stated with a fixed nonnegative loss and δ>0\delta > 0δ>0.
  • A trivializing formalization is ruled out: a cost infimum over sub-probability couplings or with one marginal free, or a Bochner expectation that vanishes on non-integrable laws, would make the worst case +∞+\infty+∞ or 000; the definitions here fix both marginals, use probability measures only and integrate in [0,∞][0,\infty][0,∞]. At δ=0\delta = 0δ=0 the ball is {Pn}\{P_n\}{Pn​} and both sides reduce to the empirical loss.
  • Infrastructure needed: optimal-transport duality with extended-valued lower semicontinuous costs (reusable well beyond this mission), Hölder equality cases for PiLp, and calculus for the logistic function. Contributions to any of these are welcome, as are proofs of the inner suprema, which are independent of Proposition 1.

Selected references

  • J. Blanchet, Y. Kang, K. Murthy, Robust Wasserstein Profile Inference and Applications to Machine Learning, J. Appl. Probab. 56(3), 2019; arXiv:1610.05627v4. https://arxiv.org/abs/1610.05627
  • J. Blanchet, K. Murthy, Quantifying Distributional Model Risk via Optimal Transport, Math. Oper. Res. 44(2), 2019. https://doi.org/10.1287/moor.2018.0936
  • S. Shafieezadeh-Abadeh, P. Mohajerin Esfahani, D. Kuhn, Distributionally Robust Logistic Regression, NIPS 2015. https://arxiv.org/abs/1509.09259
12 thms2 active usersReviewed
🏆Completed
Convex OptimizationMachine Learning·Captain: mikedeng1

Convex Optimization: Algorithms and Complexity VIII: No Black-Box Method Beats 3β‖x₁ − x*‖²/(32(t + 1)²) on β-Smooth Convex FunctionsTextbook

Why lower bounds for first-order methods

Upper bounds for an optimization method say how fast it converges; oracle complexity lower bounds say how fast any method of a given kind can possibly converge. Chapter 3 of S. Bubeck, Convex Optimization: Algorithms and Complexity (Foundations and Trends in Machine Learning 8(3–4), 2015, arXiv:1405.4980) proves upper bounds for subgradient descent on Lipschitz functions and for gradient methods on smooth functions. Section 3.5 (Lower bounds, pp. 279–283) shows that these rates cannot be improved by more than a numerical constant, as long as the number of queries is smaller than the dimension. For smooth convex functions the matching lower bound is what identifies Nesterov's accelerated gradient descent, with its 1/t21/t^21/t2 rate, as an optimal method.

Timeline. The lower bounds first appeared in A. Nemirovski and D. Yudin, Problem Complexity and Method Efficiency in Optimization (Wiley, 1983). The presentation followed by the book, with an explicit tridiagonal quadratic as the hard instance and the "span of past gradients" restriction on the method, is that of Y. Nesterov, Introductory Lectures on Convex Optimization (Kluwer, 2004), §2.1.2. Nesterov's accelerated method (1983) attains the matching upper bound.

Setting

Work in Rn\mathbb R^nRn with the Euclidean inner product x⊤yx^\top yx⊤y, coordinates x(1),…,x(n)x(1),\dots,x(n)x(1),…,x(n), canonical basis e1,…,ene_1,\dots,e_ne1​,…,en​ and balls B2(R)={x:∥x∥≤R}\mathrm B_2(R)=\{x:\|x\|\le R\}B2​(R)={x:∥x∥≤R}. A first-order oracle for fff answers a query xxx with a subgradient g∈∂f(x)g\in\partial f(x)g∈∂f(x) (the gradient when fff is differentiable). A black-box procedure maps the history (x1,g1,…,xt,gt)(x_1,g_1,\dots,x_t,g_t)(x1​,g1​,…,xt​,gt​) to the next query xt+1x_{t+1}xt+1​. Section 3.5 restricts attention to procedures with

x1=0,xt+1∈Span(g1,…,gt)(t≥0),(3.15)x_1=0,\qquad x_{t+1}\in\mathrm{Span}(g_1,\dots,g_t)\quad(t\ge0), \tag{3.15}x1​=0,xt+1​∈Span(g1​,…,gt​)(t≥0),(3.15)

which covers gradient descent, its accelerated variants and conjugate gradient. A function is β\betaβ-smooth if its gradient is β\betaβ-Lipschitz; LLL-Lipschitz on X\mathcal XX if every subgradient at every point of X\mathcal XX has norm at most LLL; α\alphaα-strongly convex if x↦f(x)−α2∥x∥2x\mapsto f(x)-\frac\alpha2\|x\|^2x↦f(x)−2α​∥x∥2 is convex.

The hard smooth instance uses, for k≤nk\le nk≤n, the symmetric tridiagonal matrix AkA_kAk​ with entries 222 on the first kkk diagonal positions and −1-1−1 on the neighbouring off-diagonal positions of the leading k×kk\times kk×k block, zero elsewhere, and the quadratics

fk(x)=β8x⊤Akx−β4x⊤e1,fk∗=inf⁡x∈Rnfk(x).f_k(x)=\frac\beta8x^\top A_kx-\frac\beta4x^\top e_1 ,\qquad f_k^*=\inf_{x\in\mathbb R^n}f_k(x).fk​(x)=8β​x⊤Ak​x−4β​x⊤e1​,fk∗​=x∈Rninf​fk​(x).

Formalization targets

Goal: Theorem 3.14 (p. 282)

For 1≤t≤n−121\le t\le\frac{n-1}21≤t≤2n−1​ and β>0\beta>0β>0 there are a β\betaβ-smooth convex fff and a minimizer x∗x^*x∗ such that every procedure satisfying (3.15) has

min⁡1≤s≤tf(xs)−f(x∗) ≥ 3β32 ∥x1−x∗∥2(t+1)2.\min_{1\le s\le t}f(x_s)-f(x^*)\ \ge\ \frac{3\beta}{32}\,\frac{\|x_1-x^*\|^2}{(t+1)^2}.1≤s≤tmin​f(xs​)−f(x∗) ≥ 323β​(t+1)2∥x1​−x∗∥2​.

The constant 3/323/323/32 is the book's.

Milestones (proof of Theorem 3.14, pp. 282–283)

  1. 0⪯Ak⪯4In0\preceq A_k\preceq4I_n0⪯Ak​⪯4In​, through x⊤Akx=x(1)2+x(k)2+∑i=1k−1(x(i)−x(i+1))2x^\top A_kx=x(1)^2+x(k)^2+\sum_{i=1}^{k-1}(x(i)-x(i+1))^2x⊤Ak​x=x(1)2+x(k)2+∑i=1k−1​(x(i)−x(i+1))2.
  2. For f=f2t+1f=f_{2t+1}f=f2t+1​ and any procedure satisfying (3.15), xs∈Span(e1,…,es−1)x_s\in\mathrm{Span}(e_1,\dots,e_{s-1})xs​∈Span(e1​,…,es−1​); hence f(xs)=fs(xs)f(x_s)=f_s(x_s)f(xs​)=fs​(xs​) for s≤ts\le ts≤t.
  3. xk∗(i)=1−ik+1x_k^*(i)=1-\frac i{k+1}xk∗​(i)=1−k+1i​ solves Akx=e1A_kx=e_1Ak​x=e1​, minimizes fkf_kfk​, and fk∗=−β8(1−1k+1)f_k^*=-\frac\beta8\bigl(1-\frac1{k+1}\bigr)fk∗​=−8β​(1−k+11​).
  4. ∥xk∗∥2≤k+13\|x_k^*\|^2\le\frac{k+1}3∥xk∗​∥2≤3k+1​.
  5. ft∗−f2t+1∗=β8(1t+1−12t+2)≥3β32∥x2t+1∗∥2(t+1)2f_t^*-f_{2t+1}^*=\frac\beta8\bigl(\frac1{t+1}-\frac1{2t+2}\bigr)\ge\frac{3\beta}{32}\frac{\|x^*_{2t+1}\|^2}{(t+1)^2}ft∗​−f2t+1∗​=8β​(t+11​−2t+21​)≥323β​(t+1)2∥x2t+1∗​∥2​.

Companion: Theorem 3.13 (p. 280)

For 1≤t≤n1\le t\le n1≤t≤n and L,R>0L,R>0L,R>0 there are a convex fff, LLL-Lipschitz on B2(R)\mathrm B_2(R)B2​(R), and a first-order oracle for it such that every procedure satisfying (3.15) has min⁡s≤tf(xs)−min⁡B2(R)f≥RL2(1+t)\min_{s\le t}f(x_s)-\min_{\mathrm B_2(R)}f\ge\frac{RL}{2(1+\sqrt t)}mins≤t​f(xs​)−minB2​(R)​f≥2(1+t​)RL​; and for α>0\alpha>0α>0 there are an α\alphaα-strongly convex fff, LLL-Lipschitz on B2(L2α)\mathrm B_2(\frac L{2\alpha})B2​(2αL​), and an oracle with gap at least L28αt\frac{L^2}{8\alpha t}8αtL2​ over that ball.

Significance

The upper bounds of Chapter 3 (projected subgradient descent at rate RL/tRL/\sqrt tRL/t​, accelerated gradient descent at rate β∥x1−x∗∥2/t2\beta\|x_1-x^*\|^2/t^2β∥x1​−x∗∥2/t2) become optimal statements only through these lower bounds: no method in the class (3.15) can be faster by more than a constant factor while ttt is below the dimension. The restriction to t≲nt\lesssim nt≲n is necessary, since Chapter 2's cutting-plane methods converge exponentially once the number of queries exceeds the dimension.

The results are classical and proved. Formalizing them yields machine-checked versions of the quadratic-form computation for the tridiagonal matrix, of the Krylov-type support argument under (3.15), and of the explicit minimizer of fkf_kfk​, each reusable in other lower-bound arguments (Theorem 3.15 in ℓ2\ell_2ℓ2​, lower bounds for strongly convex smooth functions, conjugate gradient analyses). The platform held no formal statement of these oracle lower bounds when this mission was drafted.

Difficulty

Each analytic step is elementary; the difficulty is in the bookkeeping. The span argument is an induction that must track, at each step, that the gradient of a tridiagonal quadratic at a vector supported on the first s−1s-1s−1 coordinates is supported on the first sss, and that the span hypothesis transfers this to the next query. The minimizer computation requires solving Akx=e1A_kx=e_1Ak​x=e1​ on the leading block and showing that the coordinates beyond kkk do not affect fkf_kfk​. A natural first attempt, choosing the hard function after seeing the procedure, proves a much weaker statement and is excluded by the quantifier order: the function is fixed first and must defeat every procedure.

Formalization scope

Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n). Coordinates in Lean are 0-based; the definitions provide the book's 1-based coordinate coord x i and basis vector basisVec n i, and the matrix tridiag n k translates book index iii to Fin n index i−1i-1i−1. The query sequence starts at index 111. The oracle is a fixed map ggg, so (3.15) reads xt+1∈Span(g(x1),…,g(xt))x_{t+1}\in\mathrm{Span}(g(x_1),\dots,g(x_t))xt+1​∈Span(g(x1​),…,g(xt​)) with x1=0x_1=0x1​=0. In Theorem 3.14 the oracle is the gradient, given as a map with HasGradientAt everywhere; β\betaβ-smoothness is the Lipschitz bound on that map. In Theorem 3.13 the oracle is part of what is constructed, because the book's proof uses a specific "resisting" subgradient selection and the claim fails for an arbitrary one.

Committed conventions, each stated in the item's Formalization Note: the minimum over 1≤s≤t1\le s\le t1≤s≤t is the bound for every such sss, and t≥1t\ge1t≥1 is required; t≤(n−1)/2t\le(n-1)/2t≤(n−1)/2 is 2t+1≤n2t+1\le n2t+1≤n; the minimizer x∗x^*x∗ is existentially chosen together with fff (the hard function has many minimizers when 2t+1<n2t+1<n2t+1<n, and the bound is false for some of them); the minimum over a ball is the bound against every point of the ball; fk∗f_k^*fk∗​ is the real infimum, asserted to be attained.

A formalization that let the function depend on the procedure, dropped x1=0x_1=0x1​=0, or took the span over gradients at points other than the queries would state a different and weaker theorem; the statements here keep fff (and the oracle) before the universally quantified procedure.

Infrastructure needed: quadratic forms of explicit matrices on EuclideanSpace, gradients of quadratics, and span/support lemmas for EuclideanSpace.single-type vectors. Contributions of proofs for any milestone, and of the strongly convex ℓ2\ell_2ℓ2​ lower bound (Theorem 3.15, not included here), are welcome.

Selected references

  • S. Bubeck, Convex Optimization: Algorithms and Complexity, Foundations and Trends in Machine Learning 8(3–4):231–358, 2015. https://arxiv.org/abs/1405.4980
  • A. Nemirovski and D. Yudin, Problem Complexity and Method Efficiency in Optimization, Wiley, 1983.
  • Y. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, Kluwer, 2004. https://doi.org/10.1007/978-1-4419-8853-9
8 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

On the Power of Robust Solutions in Two-Stage Stochastic and Adaptive Optimization Problems 1: For Symmetric Right-Hand-Side Uncertainty, the Robust Optimum Is at Most Twice the Stochastic OptimumResearch Paper

Motivation

Many planning problems are made in two stages: a first decision xxx (capacity, inventory, a network design) is fixed before an uncertain demand is revealed, and a second decision yyy (recourse, routing, overtime) is taken afterwards. Two-stage stochastic optimization models the demand as random and minimizes expected cost; its second stage is a whole policy ω↦y(ω)\omega\mapsto y(\omega)ω↦y(ω), and the problem is intractable in general, especially with integer variables (Dyer and Stougie, 2006). Robust optimization instead picks one static pair (x,y)(x,y)(x,y) that is feasible for every possible demand and minimizes its worst-case cost; it is a single deterministic mixed-integer program and needs no knowledge of the distribution (Ben-Tal and Nemirovski, 2002; Bertsimas and Sim, 2004).

The question this mission addresses is how much is lost by solving the robust problem in place of the stochastic one. Bertsimas and Goyal (Math. Oper. Res. 2010) show that when only the right-hand side is uncertain, the uncertainty set is symmetric and the distribution is centred at its point of symmetry, the loss is at most a factor of two, and that this factor is tight.

Setting

Fix A∈Rm×n1A\in\mathbb R^{m\times n_1}A∈Rm×n1​, B∈Rm×n2B\in\mathbb R^{m\times n_2}B∈Rm×n2​ and nonnegative costs c∈R+n1c\in\mathbb R^{n_1}_+c∈R+n1​​, d∈R+n2d\in\mathbb R^{n_2}_+d∈R+n2​​. A set Ω\OmegaΩ of scenarios carries a probability measure μ\muμ, and each scenario ω\omegaω has a right-hand side b(ω)∈R+mb(\omega)\in\mathbb R^m_+b(ω)∈R+m​. The uncertainty set is Ib(Ω)={b(ω):ω∈Ω}\mathcal I_b(\Omega)=\{b(\omega):\omega\in\Omega\}Ib​(Ω)={b(ω):ω∈Ω}. First-stage variables are nonnegative, with integer values on a designated set of coordinates; second-stage variables are nonnegative reals (p2=0p_2=0p2​=0).

The stochastic problem ΠStoch(b)\Pi_{\mathrm{Stoch}}(b)ΠStoch​(b), (1.1), chooses xxx and a policy y(⋅)y(\cdot)y(⋅):

zStoch(b)=inf⁡ cTx+Eμ[dTy(ω)]s.t.Ax+By(ω)≥b(ω)  ∀ω∈Ω.z_{\mathrm{Stoch}}(b)=\inf\ c^Tx+\mathbb E_\mu[d^Ty(\omega)]\quad\text{s.t.}\quad Ax+By(\omega)\ge b(\omega)\ \ \forall\omega\in\Omega .zStoch​(b)=inf cTx+Eμ​[dTy(ω)]s.t.Ax+By(ω)≥b(ω)  ∀ω∈Ω.

The robust problem ΠRob(b)\Pi_{\mathrm{Rob}}(b)ΠRob​(b), (1.2), chooses one yyy for all scenarios:

zRob(b)=inf⁡ cTx+dTys.t.Ax+By≥b(ω)  ∀ω∈Ω.z_{\mathrm{Rob}}(b)=\inf\ c^Tx+d^Ty\quad\text{s.t.}\quad Ax+By\ge b(\omega)\ \ \forall\omega\in\Omega .zRob​(b)=inf cTx+dTys.t.Ax+By≥b(ω)  ∀ω∈Ω.

A set PPP is symmetric (Definition 1.2) if there is u0∈Pu^0\in Pu0∈P with u0+z∈P  ⟺  u0−z∈Pu^0+z\in P\iff u^0-z\in Pu0+z∈P⟺u0−z∈P for all zzz; u0u^0u0 is its point of symmetry. Hypercubes, ellipsoids and norm balls are symmetric. A probability measure on a symmetric set is symmetric (Definition 1.4) if it gives a set and its reflection {2u0−x}\{2u^0-x\}{2u0−x} the same mass.

Formalization targets

Goal: Theorem 2.1 (p. 10)

If Ib(Ω)\mathcal I_b(\Omega)Ib​(Ω) is symmetric with point of symmetry b(ω0)b(\omega^0)b(ω0), p2=0p_2=0p2​=0, and μ\muμ satisfies

Eμ[b(ω)] ≥ b(ω0)(2.1)\mathbb E_\mu[b(\omega)]\ \ge\ b(\omega^0)\qquad(2.1)Eμ​[b(ω)] ≥ b(ω0)(2.1)

then

zRob(b) ≤ 2⋅zStoch(b).z_{\mathrm{Rob}}(b)\ \le\ 2\cdot z_{\mathrm{Stoch}}(b).zRob​(b) ≤ 2⋅zStoch​(b).

Milestones on the way

  • Lemma 2.2 (p. 12): the coordinatewise bounding box HHH of a symmetric set SSS is the smallest hypercube containing SSS.
  • Lemma 2.3 (p. 12): the centre x0x^0x0 of HHH is the point of symmetry of SSS, and x≤2x0x\le 2x^0x≤2x0 on SSS when S⊆R+nS\subseteq\mathbb R^n_+S⊆R+n​.
  • Eqs. (2.9)–(2.10) (p. 13): if (x,y)(x,y)(x,y) covers b(ω0)b(\omega^0)b(ω0) then (2x,2y)(2x,2y)(2x,2y) covers every b(ω)b(\omega)b(ω), so it is robust feasible.
  • p. 14 display: under (2.1), the mean second-stage decision Eμ[y(ω)]\mathbb E_\mu[y(\omega)]Eμ​[y(ω)] covers b(ω0)b(\omega^0)b(ω0).
  • Lemma 2.1 (p. 11): a symmetric probability measure has mean u0u^0u0, so it satisfies (2.1).
  • Theorem 2.7 (p. 21): the same bound zRob(b)≤2 zStoch(b)z_{\mathrm{Rob}}(b)\le 2\,z_{\mathrm{Stoch}}(b)zRob​(b)≤2zStoch​(b) when Ib(Ω)\mathcal I_b(\Omega)Ib​(Ω) is convex and positive (contained in a symmetric subset of R+m\mathbb R^m_+R+m​ whose centre lies in Ib(Ω)\mathcal I_b(\Omega)Ib​(Ω)).

Significance

The result. The robust problem is one mixed-integer program, independent of μ\muμ; the stochastic problem optimizes over policies and requires the distribution. Theorem 2.1 says that under symmetry the static robust solution (x,y)(x,y)(x,y) used in every scenario is a 2-approximation of the optimal expected cost, for every centred distribution at once. The companion results of the paper show the hypotheses matter: the bound is tight for symmetric sets, the gap is unbounded (at least n+1n+1n+1) on the non-symmetric simplex (Theorem 2.6), and unbounded when costs are uncertain as well (Theorem 3.1). The theorem also underlies later work on the power of static and affine policies in adaptive optimization (Bertsimas and Goyal, 2012).

Formalizing it. The theorem and its proof are published; nothing in this mission is open mathematics. To our knowledge none of these statements has a machine-checked proof. The mission produces a reusable Lean model of two-stage stochastic and robust mixed-integer covering problems with arbitrary scenario spaces, extended-real optimal values and genuine expectations, together with the elementary geometry of point-symmetric sets. The same objects are used by the other missions of this series (the simplex and cost-uncertainty gaps, and the adaptability gap).

Difficulty

Each step of the published argument is short; the difficulty is in stating it at the right generality. The paper begins "consider an optimal solution" of ΠStoch(b)\Pi_{\mathrm{Stoch}}(b)ΠStoch​(b); optimal policies need not exist for an arbitrary scenario space, so the statement is about infima and every step must work for an arbitrary feasible pair. Passing from "Ax+By(ω)≥b(ω)Ax+By(\omega)\ge b(\omega)Ax+By(ω)≥b(ω) for all ω\omegaω" to "Ax+B Eμ[y]≥Eμ[b]Ax+B\,\mathbb E_\mu[y]\ge\mathbb E_\mu[b]Ax+BEμ​[y]≥Eμ​[b]" needs integrability of the policy and of bbb and linearity of the Bochner integral through a matrix. The bound b(ω)≤2b(ω0)b(\omega)\le 2b(\omega^0)b(ω)≤2b(ω0) uses symmetry together with nonnegativity of the uncertainty set; symmetry alone does not give it. Integrality of the second stage breaks the argument, since Eμ[y(ω)]\mathbb E_\mu[y(\omega)]Eμ​[y(ω)] need not be integral.

Formalization scope

  • Vectors are Fin k → ℝ with the componentwise order, products A *ᵥ x and inner products c ⬝ᵥ x. The mixed-integer domain is "nonnegative with integer values on a set III of coordinates", which is the paper's R+n−p×Z+p\mathbb R^{n-p}_+\times\mathbb Z^p_+R+n−p​×Z+p​ up to relabelling.
  • Ω\OmegaΩ is an arbitrary measurable space with a probability measure; Ib(Ω)\mathcal I_b(\Omega)Ib​(Ω) is Set.range b. Constraints hold for every scenario, not almost surely.
  • Second-stage policies are μ\muμ-integrable, and bbb is μ\muμ-integrable in every statement that uses (2.1). Without these, Lean's integral of a non-integrable function is 000 and (2.1) would degenerate.
  • zStochz_{\mathrm{Stoch}}zStoch​ and zRobz_{\mathrm{Rob}}zRob​ are infima in EReal, equal to +∞+\infty+∞ when infeasible; no attainment is assumed. A real-valued infimum would return 000 on an infeasible robust problem and make the goal trivial; that formalization is ruled out.
  • The bounding box of (2.5)–(2.7) uses suprema and infima, with boundedness assumed where needed.
  • Corrections to the page: Lemma 2.3's inequality x≤2x0x\le 2x^0x≤2x0 is stated under S⊆R+nS\subseteq\mathbb R^n_+S⊆R+n​, which its proof uses and which holds in every application; Lemma 2.1 assumes the measure has a mean; Theorem 2.7 carries the standing assumption p2=0p_2=0p2​=0 of §2.

Contributions welcome: proofs of the milestones and the goal, and general lemmas on point-symmetric sets and on interchanging Bochner integrals with matrix–vector products, both reusable outside this mission.

Selected references

  • D. Bertsimas, V. Goyal, On the power of robust solutions in two-stage stochastic and adaptive optimization problems, Mathematics of Operations Research 35(2), 2010. https://doi.org/10.1287/moor.1090.0440 (cited from the authors' manuscript, MIT DSpace)
  • A. Ben-Tal, A. Nemirovski, Robust optimization — methodology and applications, Mathematical Programming 92, 2002. https://doi.org/10.1007/s101070100286
  • D. Bertsimas, M. Sim, The price of robustness, Operations Research 52(1), 2004. https://doi.org/10.1287/opre.1030.0065
  • M. Dyer, L. Stougie, Computational complexity of stochastic programming problems, Mathematical Programming 106, 2006. https://doi.org/10.1007/s10107-005-0578-0
  • D. Bertsimas, V. Goyal, On the power and limitations of affine policies in two-stage adaptive optimization, Mathematical Programming 134, 2012. https://doi.org/10.1007/s10107-011-0444-4
10 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations Research·Captain: mikedeng1

A Robust Optimization Approach to Inventory Theory: The Optimal Robust Policy Is the Optimal Nominal Policy for an Explicit Modified Demand, at Extra Cost (2ph/(p+h))·ΣA_kResearch Paper

Motivation

Classical inventory theory chooses order quantities against a probability distribution of demand. The resulting dynamic programs are optimal in expectation but need the distribution, and they become intractable once several installations, capacities or fixed costs interact. Robust optimization replaces the distribution by an uncertainty set and asks for the order sequence whose worst-case cost over that set is smallest. Bertsimas and Thiele (Operations Research 54(1), 2006) applied the budget-of-uncertainty approach of Bertsimas and Sim (The Price of Robustness, Operations Research 52(1), 2004) to finite-horizon inventory control. Their main structural result says that robustness does not destroy the structure of the classical problem. The robust problem is a deterministic (nominal) inventory problem with an explicitly modified demand, and the price of robustness is an explicit constant.

Setting

A single item is ordered at a single installation over periods k=0,…,T−1k = 0, \dots, T-1k=0,…,T−1. The stock at the beginning of the horizon is x0x_0x0​. Orders uk≥0u_k \ge 0uk​≥0 arrive immediately, demand wkw_kwk​ is subtracted, and excess demand is backlogged, so the stock at the end of period kkk is

xk+1=x0+∑i=0k(ui−wi).x_{k+1} = x_0 + \sum_{i=0}^{k} (u_i - w_i).xk+1​=x0​+i=0∑k​(ui​−wi​).

The demand of period kkk is uncertain: wk=wˉk+w^kzkw_k = \bar w_k + \hat w_k z_kwk​=wˉk​+w^k​zk​ with a nominal demand wˉk\bar w_kwˉk​, a maximal deviation w^k≥0\hat w_k \ge 0w^k​≥0 and a scaled deviation zk∈[−1,1]z_k \in [-1, 1]zk​∈[−1,1]. A budget of uncertainty Γk\Gamma_kΓk​ limits the total scaled deviation up to period kkk. The budgets satisfy 0≤Γ00 \le \Gamma_00≤Γ0​ and Γk≤Γk+1≤Γk+1\Gamma_k \le \Gamma_{k+1} \le \Gamma_k + 1Γk​≤Γk+1​≤Γk​+1.

Each period costs C(uk)+R(xk+1)C(u_k) + R(x_{k+1})C(uk​)+R(xk+1​). The purchasing cost is C(u)=K+cuC(u) = K + cuC(u)=K+cu for u>0u > 0u>0 and C(0)=0C(0) = 0C(0)=0, with c>0c > 0c>0 and K≥0K \ge 0K≥0. The holding/shortage cost is R(x)=max⁡(hx,−px)R(x) = \max(hx, -px)R(x)=max(hx,−px), with h≥0h \ge 0h≥0 and p>cp > cp>c. The nominal problem with demand www minimizes ∑k<T(C(uk)+R(xk+1))\sum_{k<T} (C(u_k) + R(x_{k+1}))∑k<T​(C(uk​)+R(xk+1​)) over u≥0u \ge 0u≥0 for a fixed demand sequence www.

For each kkk, AkA_kAk​ is the optimal value of the linear program

Ak=max⁡{∑i=0kw^izi  :  ∑i=0kzi≤Γk, 0≤zi≤1}(13)A_k = \max\Big\{\sum_{i=0}^{k} \hat w_i z_i \;:\; \sum_{i=0}^{k} z_i \le \Gamma_k,\ 0 \le z_i \le 1\Big\} \qquad (13)Ak​=max{i=0∑k​w^i​zi​:i=0∑k​zi​≤Γk​, 0≤zi​≤1}(13)

It is the worst-case deviation of the cumulative demand up to kkk from its nominal value, with A−1=0A_{-1} = 0A−1​=0. Write xˉk+1=x0+∑i≤k(ui−wˉi)\bar x_{k+1} = x_0 + \sum_{i\le k}(u_i - \bar w_i)xˉk+1​=x0​+∑i≤k​(ui​−wˉi​) for the nominal stock. The robust formulation (14) minimizes ∑k<T(C(uk)+yk)\sum_{k<T} (C(u_k) + y_k)∑k<T​(C(uk​)+yk​) over (u,y,q,r)(u, y, q, r)(u,y,q,r) subject to the following constraints for every k<Tk < Tk<T:

  • uk≥0u_k \ge 0uk​≥0, qk≥0q_k \ge 0qk​≥0, and rik≥0r_{ik} \ge 0rik​≥0, qk+rik≥w^iq_k + r_{ik} \ge \hat w_iqk​+rik​≥w^i​ for i≤ki \le ki≤k;
  • yk≥h(xˉk+1+qkΓk+∑i≤krik)y_k \ge h(\bar x_{k+1} + q_k\Gamma_k + \sum_{i\le k} r_{ik})yk​≥h(xˉk+1​+qk​Γk​+∑i≤k​rik​);
  • yk≥p(−xˉk+1+qkΓk+∑i≤krik)y_k \ge p(-\bar x_{k+1} + q_k\Gamma_k + \sum_{i\le k} r_{ik})yk​≥p(−xˉk+1​+qk​Γk​+∑i≤k​rik​).

The variables q,rq, rq,r are the dual of (13). Formulation (14) is equivalent to requiring the holding and shortage constraints of period kkk for every demand whose scaled deviations satisfy ∣zi∣≤1|z_i| \le 1∣zi​∣≤1 and ∑i≤k∣zi∣≤Γk\sum_{i \le k}|z_i| \le \Gamma_k∑i≤k​∣zi​∣≤Γk​.

Formalization targets

Goal: Theorem 3.2 (a), (b), (d)

Let the modified demand be

wk′=wˉk+p−hp+h (Ak−Ak−1).(20)w'_k = \bar w_k + \frac{p-h}{p+h}\,(A_k - A_{k-1}). \qquad (20)wk′​=wˉk​+p+hp−h​(Ak​−Ak−1​).(20)

Write Nw′(u)N_{w'}(u)Nw′​(u) for the nominal cost of uuu under demand w′w'w′. Then:

  1. For every u≥0u \ge 0u≥0, the minimum of the objective of (14) over the feasible (y,q,r)(y, q, r)(y,q,r) is attained and equals
Nw′(u)+2php+h∑k=0T−1Ak.N_{w'}(u) + \frac{2ph}{p+h}\sum_{k=0}^{T-1} A_k.Nw′​(u)+p+h2ph​k=0∑T−1​Ak​.
  1. uuu is the order part of an optimal solution of (14) if and only if uuu is optimal for the nominal problem with demand w′w'w′.
  2. The optimal cost of (14) is the optimal nominal cost under w′w'w′ plus 2php+h∑kAk\frac{2ph}{p+h}\sum_k A_kp+h2ph​∑k​Ak​.
  3. If K=0K = 0K=0 and wk′≥0w'_k \ge 0wk′​≥0, the order-up-to policy with levels Sk=wk′S_k = w'_kSk​=wk′​ is robust-optimal.

Milestones

The milestones are the steps of the paper's proof, in order:

  • LP (13) and its dual are attained with the common value AkA_kAk​.
  • The constraints of (14) are the robust counterpart of the kkk-th holding/shortage pair (10)–(11).
  • For fixed orders, the value of (14) is the sum (21).
  • The modified stock (22) satisfies xk+1′=xˉk+1−p−hp+hAkx'_{k+1} = \bar x_{k+1} - \frac{p-h}{p+h}A_kxk+1′​=xˉk+1​−p+hp−h​Ak​.
  • The max identity (23): max⁡(h(xˉ+A),p(−xˉ+A))=max⁡(hx′,−px′)+2php+hA\max(h(\bar x+A), p(-\bar x+A)) = \max(hx', -px') + \frac{2ph}{p+h}Amax(h(xˉ+A),p(−xˉ+A))=max(hx′,−px′)+p+h2ph​A.
  • Lemma 3.1(b): for nonnegative demand, the nominal problem without fixed cost is solved by ordering up to Sk=wkS_k = w_kSk​=wk​.
  • Remark 1: Ak−1≤AkA_{k-1} \le A_kAk−1​≤Ak​, so wk′≥wˉkw'_k \ge \bar w_kwk′​≥wˉk​ when p≥hp \ge hp≥h.
  • Remark 3: under i.i.d. demand, Ak=w^ΓkA_k = \hat w\Gamma_kAk​=w^Γk​, which gives the closed-form thresholds.

Significance

The theorem reduces robust inventory control to nominal inventory control. Every structural fact known for the deterministic problem then transfers to the robust one. These include the optimality of base-stock policies without fixed cost and the threshold structure with a fixed cost. The robust base-stock levels are explicit: they shift the nominal levels by p−hp+h(Ak−Ak−1)\frac{p-h}{p+h}(A_k - A_{k-1})p+hp−h​(Ak​−Ak−1​), upward when shortage is more expensive than holding. The extra cost 2php+h∑kAk\frac{2ph}{p+h}\sum_k A_kp+h2ph​∑k​Ak​ quantifies the price of protection as a function of the budgets. The paper uses the same reduction for capacitated orders (Theorem 3.3) and for supply networks (§4).

The result has been proved since 2006, and no machine-checked proof of it, or of any budgeted robust counterpart, is known to exist. This mission provides several formalizations for reuse:

  • the budgeted robust counterpart of a pair of piecewise-linear constraints;
  • the duality of the fractional knapsack LP (13);
  • the optimality of base-stock orders for a deterministic backlogged inventory problem.

Difficulty

The algebraic core, identity (23), is elementary. The work is in the reductions around it. The first is that (14) really is the worst case of (10)–(11): this needs strong duality for (13), together with attainment on both sides, and the observation that the minimizing and maximizing deviations of a constraint pair differ. The second is that the minimum of (14) over the auxiliary variables, for fixed orders, is (21). This requires the dual optimum to be attained with the value of (13), and h,p≥0h, p \ge 0h,p≥0 so that the cost is monotone in AkA_kAk​. The third is the base-stock part, which needs Lemma 3.1(b), a global optimality statement for a TTT-period problem with backlogging. The paper proves that lemma by an explicit dual certificate. An argument through first-order conditions in each period is not enough, because orders in one period affect every later stock level.

Formalization scope

All data are real numbers and sequences are ℕ → ℝ; only indices k<Tk < Tk<T matter. stock w u k denotes xk+1x_{k+1}xk+1​, the stock at the end of period kkk. The standing assumptions of §3.1 are fields of the model:

  • c>0c > 0c>0, K≥0K \ge 0K≥0, h≥0h \ge 0h≥0, p>cp > cp>c;
  • w^k≥0\hat w_k \ge 0w^k​≥0;
  • Γ0≥0\Gamma_0 \ge 0Γ0​≥0 and Γk≤Γk+1≤Γk+1\Gamma_k \le \Gamma_{k+1} \le \Gamma_k + 1Γk​≤Γk+1​≤Γk​+1.

The conventions and corrections are:

  • Fixed cost. The paper writes it with binary variables and a big-MMM constraint. Here it is the indicator C(uk)C(u_k)C(uk​) in the objective, as in the paper's own (21).
  • "Optimal". It always means minimality over all feasible points.
  • The policy. It is the order sequence chosen at time 0.
  • AkA_kAk​. It is the value of (13), as in Remark 1 after the theorem, not "the optimal q∗,r∗q^*, r^*q∗,r∗ of (14)", which need not be unique.
  • The robust formulation. (14) is formalized as printed: the kkk-th constraint pair is protected by the budget Γk\Gamma_kΓk​ alone, not by the intersection of all budgets up to kkk.
  • Sign slip. The page's xk+1=xˉk+1+∑w^izix_{k+1} = \bar x_{k+1} + \sum \hat w_i z_ixk+1​=xˉk+1​+∑w^i​zi​ is a sign slip for xˉk+1−∑w^izi\bar x_{k+1} - \sum \hat w_i z_ixˉk+1​−∑w^i​zi​. The formal statements use the correct sign; the result is unaffected because the deviation set is symmetric.
  • Part (b). It is stated under wk′≥0w'_k \ge 0wk′​≥0. As printed it fails when p<hp < hp<h makes w′w'w′ negative, for example T=2T = 2T=2, wˉ=w^=(10,0)\bar w = \hat w = (10, 0)wˉ=w^=(10,0), Γ=(0,1)\Gamma = (0, 1)Γ=(0,1), c=1c = 1c=1, h=4h = 4h=4, p=2p = 2p=2, x0=0x_0 = 0x0​=0. Lemma 3.1(b) carries the matching hypothesis of nonnegative demand.
  • Remark 3. It adds Γ0≤1\Gamma_0 \le 1Γ0​≤1.
  • Remark 1. Its inequalities are weak.
  • Not stated. The (s, S) clause of (a) and part (c) are excluded. They rest on a stochastic theorem cited from Bertsekas (1995) and on thresholds stated through the optimal ordering times.

A trivializing formalization is ruled out: the robust cost is formulation (14) with its variables y,q,ry, q, ry,q,r, and AkA_kAk​ is the value of LP (13). Neither is the closed-form objective (21) nor an arbitrary sequence. Contributions are welcome on the LP duality of (13) (a fractional knapsack), on the robust counterpart milestone, and on Lemma 3.1(b), each of which is independent of the others.

Selected references

  • D. Bertsimas, A. Thiele, A Robust Optimization Approach to Inventory Theory, Operations Research 54(1):150–168, 2006. https://doi.org/10.1287/opre.1050.0238
  • D. Bertsimas, M. Sim, The Price of Robustness, Operations Research 52(1):35–53, 2004. https://doi.org/10.1287/opre.1030.0065
  • A. Ben-Tal, A. Nemirovski, Robust solutions of uncertain linear programs, Operations Research Letters 25(1):1–13, 1999. https://doi.org/10.1016/S0167-6377(99)00016-4
  • D. P. Bertsekas, Dynamic Programming and Optimal Control, Vol. 1, Athena Scientific, 1995.
12 thms2 active usersReviewed
🏆Completed
Convex OptimizationMachine Learning·Captain: mikedeng1

Convex Optimization: Algorithms and Complexity VII: Conditional Gradient Descent (Frank–Wolfe) with γ_s = 2/(s + 1) Has Rate 2βR²/(t + 1) in Any NormTextbook

Motivation

Many constrained optimization problems in machine learning and statistics have a feasible set X\mathcal XX over which a linear function is cheap to minimize but a Euclidean projection is expensive: the ℓ1\ell_1ℓ1​-ball, the simplex, the nuclear-norm ball, the convex hull of a combinatorial family. Projected gradient descent needs a projection at every step. Conditional gradient descent, introduced by Frank and Wolfe in 1956 for quadratic programming, replaces the projection by a call to a linear minimization oracle over X\mathcal XX, and its iterates are convex combinations of oracle outputs, which makes them sparse when X\mathcal XX is a polytope.

This mission is the seventh of a series formalizing S. Bubeck's monograph Convex Optimization: Algorithms and Complexity (Foundations and Trends in Machine Learning, 2015, arXiv:1405.4980v2). It covers Section 3.3, whose main result, Theorem 3.8, is the O(1/t)O(1/t)O(1/t) rate of the method in the form given by Jaggi (2013), going back to Dunn and Harshbarger (1978).

Setting

Let EEE be a finite-dimensional real vector space with an arbitrary norm ∥⋅∥\|\cdot\|∥⋅∥. For a linear form ggg on EEE, written v↦g⊤vv\mapsto g^\top vv↦g⊤v, the dual norm is ∥g∥∗=sup⁡∥v∥≤1g⊤v\|g\|_*=\sup_{\|v\|\le1}g^\top v∥g∥∗​=sup∥v∥≤1​g⊤v. Let X⊆E\mathcal X\subseteq EX⊆E be nonempty, compact and convex, with diameter R=sup⁡x,y∈X∥x−y∥R=\sup_{x,y\in\mathcal X}\|x-y\|R=supx,y∈X​∥x−y∥.

Let f:E→Rf:E\to\mathbb Rf:E→R be differentiable with gradient ∇f(x)\nabla f(x)∇f(x), a linear form on EEE. For β≥0\beta\ge0β≥0, fff is β-smooth with respect to ∥⋅∥\|\cdot\|∥⋅∥ on X\mathcal XX if

∥∇f(x)−∇f(y)∥∗≤β∥x−y∥(x,y∈X).\|\nabla f(x)-\nabla f(y)\|_*\le\beta\|x-y\|\qquad(x,y\in\mathcal X).∥∇f(x)−∇f(y)∥∗​≤β∥x−y∥(x,y∈X).

A point x∗∈Xx^*\in\mathcal Xx∗∈X with f(x∗)=min⁡x∈Xf(x)f(x^*)=\min_{x\in\mathcal X}f(x)f(x∗)=minx∈X​f(x) is fixed throughout, and δt=f(xt)−f(x∗)\delta_t=f(x_t)-f(x^*)δt​=f(xt​)−f(x∗).

Given step sizes (γs)s≥1(\gamma_s)_{s\ge1}(γs​)s≥1​, a run of conditional gradient descent is a pair of sequences with x1∈Xx_1\in\mathcal Xx1​∈X and, for every t≥1t\ge1t≥1,

yt∈argmin⁡y∈X∇f(xt)⊤y(3.8),xt+1=(1−γt)xt+γtyt(3.9).y_t\in\operatorname*{argmin}_{y\in\mathcal X}\nabla f(x_t)^\top y\quad(3.8),\qquad x_{t+1}=(1-\gamma_t)x_t+\gamma_ty_t\quad(3.9).yt​∈y∈Xargmin​∇f(xt​)⊤y(3.8),xt+1​=(1−γt​)xt​+γt​yt​(3.9).

The minimizer yty_tyt​ need not be unique; any choice is allowed.

Formalization targets

Goal: Theorem 3.8 (p. 272)

If fff is convex and β\betaβ-smooth with respect to ∥⋅∥\|\cdot\|∥⋅∥ and γs=2s+1\gamma_s=\frac{2}{s+1}γs​=s+12​ for s≥1s\ge1s≥1, then every run satisfies, for every t≥2t\ge2t≥2,

f(xt)−f(x∗)≤2βR2t+1.f(x_t)-f(x^*)\le\frac{2\beta R^2}{t+1}.f(xt​)−f(x∗)≤t+12βR2​.

Milestones

  1. Inequality (3.4) in an arbitrary norm (p. 267, used on p. 272): for x,y∈Xx,y\in\mathcal Xx,y∈X, 0≤f(x)−f(y)−∇f(y)⊤(x−y)≤β2∥x−y∥20\le f(x)-f(y)-\nabla f(y)^\top(x-y)\le\frac{\beta}{2}\|x-y\|^20≤f(x)−f(y)−∇f(y)⊤(x−y)≤2β​∥x−y∥2.
  2. The one-step recursion (pp. 272–273): for any run with γs∈[0,1]\gamma_s\in[0,1]γs​∈[0,1],
δs+1≤(1−γs)δs+β2γs2R2.\delta_{s+1}\le(1-\gamma_s)\delta_s+\frac{\beta}{2}\gamma_s^2R^2 .δs+1​≤(1−γs​)δs​+2β​γs2​R2.
  1. Initialization (p. 273): if γ1=1\gamma_1=1γ1​=1, then δ2≤β2R2\delta_2\le\frac{\beta}{2}R^2δ2​≤2β​R2.
  2. The induction (p. 273): a real sequence with δ2≤β2R2\delta_2\le\frac{\beta}{2}R^2δ2​≤2β​R2 and the recursion of milestone 2 with γs=2s+1\gamma_s=\frac{2}{s+1}γs​=s+12​ for s≥2s\ge2s≥2 satisfies δt≤2βR2t+1\delta_t\le\frac{2\beta R^2}{t+1}δt​≤t+12βR2​ for t≥2t\ge2t≥2.

Significance

Theorem 3.8 is the basic guarantee for projection-free first-order optimization. Its rate does not depend on the dimension, and it depends on the geometry only through the product βR2\beta R^2βR2, both measured in the same norm, which may be chosen to fit X\mathcal XX: for the ℓ1\ell_1ℓ1​-ball, smoothness in ∥⋅∥1\|\cdot\|_1∥⋅∥1​ with dual norm ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ gives much better constants than the Euclidean analysis. The book applies it this way to a LASSO-type problem (Section 3.3, pp. 274–276), and the same bound underlies the sparse-approximation corollary on the simplex (p. 273) and the many later variants of the method (away steps, stochastic and online conditional gradient).

The result is classical and proved in the book. What this mission adds is a machine-checked statement and proof in an arbitrary finite-dimensional normed space, with the dual norm as the operator norm on linear forms, and a reusable encoding of norm-smoothness and of conditional gradient runs. On Prove2Me a related result is already proved: Lan's Theorem 7.1 (First-order and Stochastic Optimization Methods), which bounds f(yk)−f∗f(y_k)-f^*f(yk​)−f∗ by 2Lk(k+1)∑i≤k∥xi−yi−1∥2\frac{2L}{k(k+1)}\sum_{i\le k}\|x_i-y_{i-1}\|^2k(k+1)2L​∑i≤k​∥xi​−yi−1​∥2 with a different indexing; after the diameter bound it yields 2βR2/t2\beta R^2/t2βR2/t at Bubeck's iterate xtx_txt​, which is weaker than Theorem 3.8 by one step.

Difficulty

The difficulty is in the bookkeeping of norms and indices, not in a deep idea. Inequality (3.4) is proved in the book only for the Euclidean norm, where ∇f(x)∈Rn\nabla f(x)\in\mathbb R^n∇f(x)∈Rn and the Cauchy–Schwarz inequality is used; in a general norm it needs the pairing between a linear form and a vector and the bound ∣g⊤v∣≤∥g∥∗∥v∥|g^\top v|\le\|g\|_*\|v\|∣g⊤v∣≤∥g∥∗​∥v∥. The rate 2βR2/(t+1)2\beta R^2/(t+1)2βR2/(t+1) is attained only by starting the induction at t=2t=2t=2, where the step γ1=1\gamma_1=1γ1​=1 erases the dependence on the starting point; at t=1t=1t=1 the bound can fail, since δ1\delta_1δ1​ is arbitrary. A first attempt that runs the induction from t=1t=1t=1 with an arbitrary δ1\delta_1δ1​ does not give the stated constant.

Formalization scope

EEE is a type with [NormedAddCommGroup E] [NormedSpace ℝ E] [FiniteDimensional ℝ E]; nothing is specialised to the Euclidean norm. The gradient is an explicit derivative map f' : E → (E →L[ℝ] ℝ) with HasFDerivAt f (f' x) x for every x; ∇f(x)⊤v\nabla f(x)^\top v∇f(x)⊤v is f' x v, and ∥⋅∥∗\|\cdot\|_*∥⋅∥∗​ is the operator norm, which equals sup⁡∥v∥≤1g⊤v\sup_{\|v\|\le1}g^\top vsup∥v∥≤1​g⊤v. RRR is Metric.diam X, which equals the supremum of ∥x−y∥\|x-y\|∥x−y∥ over X\mathcal XX because X\mathcal XX is compact. Sequences are indexed by ℕ with the first iterate at index 1.

Committed conventions: X\mathcal XX compact, convex and containing x∗x^*x∗ (hence nonempty); convexity of fff and the Lipschitz bound on the gradient are assumed on X\mathcal XX only, which is weaker than the book's global assumptions; β≥0\beta\ge0β≥0; the existence of the minimizer x∗x^*x∗ is the book's standing assumption (p. 242); the conclusion is stated for t≥2t\ge2t≥2, as in the book. Runs are predicates: yty_tyt​ is any minimizer of the linear form over X\mathcal XX and yt∈Xy_t\in\mathcal Xyt​∈X is required, so the goal quantifies over every run with γs=2/(s+1)\gamma_s=2/(s+1)γs​=2/(s+1). A formalization in which yty_tyt​ need not lie in X\mathcal XX, or in which smoothness is assumed only along the iterates, states a different theorem and is excluded.

A complete development needs the descent inequality (3.4) for Fréchet derivatives in a normed space (reusable for every smooth method in the series and beyond), the fact that the iterates stay in X\mathcal XX, and a scalar induction. Proofs of the milestones are welcome independently; milestone 4 is a statement about real sequences only.

Selected references

  • S. Bubeck, Convex Optimization: Algorithms and Complexity, Foundations and Trends in Machine Learning 8(3–4):231–358, 2015. https://arxiv.org/abs/1405.4980
  • M. Frank and P. Wolfe, An algorithm for quadratic programming, Naval Research Logistics Quarterly 3(1–2):95–110, 1956. https://doi.org/10.1002/nav.3800030109
  • J. C. Dunn and S. Harshbarger, Conditional gradient algorithms with open loop step size rules, Journal of Mathematical Analysis and Applications 62(2):432–444, 1978. https://doi.org/10.1016/0022-247X(78)90137-3
  • M. Jaggi, Revisiting Frank–Wolfe: projection-free sparse convex optimization, Proceedings of ICML 2013, PMLR 28(1):427–435. https://proceedings.mlr.press/v28/jaggi13.html
  • G. Lan, First-order and Stochastic Optimization Methods for Machine Learning, Springer, 2020, Theorem 7.1. https://doi.org/10.1007/978-3-030-39568-1
6 thms2 active usersReviewed
🏆Completed
Convex OptimizationMachine Learning·Captain: mikedeng1

Convex Optimization: Algorithms and Complexity VI: Gradient Descent with η = 2/(α + β) on a β-Smooth α-Strongly Convex Function Has Rate (β/2)exp(−4t/(κ + 1))‖x₁ − x*‖²Textbook

Motivation

Gradient descent is a basic method for minimizing a differentiable function when evaluating its gradient is practical but solving the optimization problem directly is not. The rate at which its iterates approach an optimizer depends on the assumptions about the function. For a convex function with a Lipschitz gradient, the value error decreases at a sublinear rate. Adding strong convexity changes the behavior: the distance from the optimizer contracts at each step, giving an exponential bound on the value error. This section of Bubeck's monograph identifies a fixed step size that uses both the smoothness and curvature constants and gives the corresponding rate.

The result matters when a high-accuracy answer is needed. A sublinear bound makes each extra digit progressively more expensive; an exponential bound says that a fixed number of additional gradient evaluations reduces the error by a fixed factor. The theorem is a textbook result, already proved mathematically. This mission asks for its precise machine-checked statement and the source's supporting inequalities, rather than for a new optimization method.

Setting

Work in Euclidean space Rn\mathbb R^nRn with n≥1n\ge1n≥1, equipped with its usual inner product and norm. A differentiable function f:Rn→Rf:\mathbb R^n\to\mathbb Rf:Rn→R has gradient g(x)=∇f(x)g(x)=\nabla f(x)g(x)=∇f(x). It is β\betaβ-smooth when its gradient is β\betaβ-Lipschitz: ∥g(x)−g(y)∥≤β∥x−y∥\|g(x)-g(y)\|\le\beta\|x-y\|∥g(x)−g(y)∥≤β∥x−y∥ for every x,yx,yx,y. It is α\alphaα-strongly convex when, for every x,yx,yx,y,

f(y)≥f(x)+⟨g(x),y−x⟩+α2∥y−x∥2.f(y)\ge f(x)+\langle g(x),y-x\rangle+\frac\alpha2\|y-x\|^2.f(y)≥f(x)+⟨g(x),y−x⟩+2α​∥y−x∥2.

The first condition limits how rapidly the gradient changes. The second gives a quadratic lower bound on the function around any point. Here α>0\alpha>0α>0 and β≥0\beta\ge0β≥0. In positive dimension, the two conditions together entail β≥α\beta\ge\alphaβ≥α, so the condition number κ=β/α\kappa=\beta/\alphaκ=β/α is at least one. The case α=β\alpha=\betaα=β remains part of the target.

A point x∗x^*x∗ is a global minimizer when f(x∗)≤f(y)f(x^*)\le f(y)f(x∗)≤f(y) for every yyy. The book assumes such a point exists as a standing convention. A gradient descent run is a sequence (xt)t≥1(x_t)_{t\ge1}(xt​)t≥1​ satisfying xt+1=xt−ηg(xt)x_{t+1}=x_t-\eta g(x_t)xt+1​=xt​−ηg(xt​) at each positive index. Its first iterate x1x_1x1​ is arbitrary. The step size in this mission is fixed at η=2/(α+β)\eta=2/(\alpha+\beta)η=2/(α+β), rather than chosen by line search or adapted along the run.

Formalization targets

The central target is Theorem 3.12 of Bubeck, p. 279. For every integer t≥0t\ge0t≥0, the gradient descent run satisfies

f(xt+1)−f(x∗)≤β2exp⁡ ⁣(−4tκ+1)∥x1−x∗∥2.f(x_{t+1})-f(x^*)\le \frac\beta2\exp\!\left(-\frac{4t}{\kappa+1}\right)\|x_1-x^*\|^2.f(xt+1​)−f(x∗)≤2β​exp(−κ+14t​)∥x1​−x∗∥2.

At t=0t=0t=0 this is a smoothness bound on the initial value gap. For subsequent iterations it gives a linear convergence rate with the explicit exponential factor stated in the book. No initial-radius bound or bounded domain is imposed: the actual squared distance ∥x1−x∗∥2\|x_1-x^*\|^2∥x1​−x∗∥2 appears in the conclusion.

The milestones trace the mathematical claims stated in the source. Equation (3.6) is the co-coercivity inequality for gradients of convex smooth functions. The proof of Lemma 3.11 introduces ϕ(z)=f(z)−(α/2)∥z∥2\phi(z)=f(z)-(\alpha/2)\|z\|^2ϕ(z)=f(z)−(α/2)∥z∥2, and identifies it as convex and (β−α)(\beta-\alpha)(β−α)-smooth. Lemma 3.11 combines curvature and smoothness into a sharper inequality for two gradients. The proof of Theorem 3.12 then gives a value-gap bound, a one-step distance contraction, and its iterated exponential form. These statements are separately useful: the co-coercivity and contraction bounds can be reused in analyses of related first-order methods.

Significance

The theorem states a complete guarantee for the algorithm: an explicit rule, the hypotheses on the objective, and a bound valid for every iteration count. It makes the role of κ\kappaκ visible. When κ\kappaκ is close to one, the contraction is strong; when the smoothness constant is much larger than the curvature constant, more iterations are needed for the same error reduction. The stated dependence supports comparisons with projected and accelerated gradient methods elsewhere in the same monograph.

Formalizing the result requires a common interface for actual gradients, smoothness, strong convexity, and algorithm runs. The strong-convexity predicate is an existing published definition, while the local smoothness and run definitions use Bubeck's conventions. Once these interfaces and the inequalities are proved, later missions can use the resulting declarations to compare rates without translating between informal meanings of “smooth” or changing the iterate index. The source provides a mathematical proof; these draft Lean theorems carry sorry and do not yet constitute machine-checked proofs.

Difficulty

The main issue is getting the sharp contraction factor from two assumptions that control different parts of the gradient step. A direct Lipschitz estimate on the update map does not by itself express the mixed inner-product term with the constants needed for the stated factor. Lemma 3.11 is the source's precise bridge between the gradient difference, the point displacement, and their inner product. The case α=β\alpha=\betaα=β also needs to remain valid: a proof route that divides by β−α\beta-\alphaβ−α cannot cover that boundary by the same calculation.

The last display in the proof of Theorem 3.12 joins a one-step inequality involving xtx_txt​ to an exponential inequality involving x1x_1x1​. The latter is the cumulative statement after ttt steps. Keeping these as separate milestones makes each quantified claim explicit while preserving the theorem's bound.

Formalization scope

Lean represents Rn\mathbb R^nRn as EuclideanSpace ℝ (Fin n), with n>0n>0n>0. The gradient is an explicit map ggg required to be the actual gradient of fff at every point. Smoothness is the gradient Lipschitz condition, not a quadratic upper bound used as a definition. Strong convexity uses the published OnlineConvexOpt.ConvexBasics.StronglyConvexOn predicate on the whole space; its formula is the book's (3.13). Iterates are indexed from one, and index zero imposes no condition. The norm, inner product, constants, and real exponential follow the printed formulas.

The added explicit conditions are n>0n>0n>0, α>0\alpha>0α>0, and β>0\beta>0β>0 where Equation (3.6) divides by β\betaβ. Positive dimension excludes a degenerate space where curvature imposes no restriction on smoothness. The positivity of α\alphaα makes κ\kappaκ meaningful; the source treats it as a positive strong-convexity parameter. The minimizer hypothesis is the book's standing convention. There is no assumption that g(x∗)=0g(x^*)=0g(x∗)=0: that property follows from global minimality and differentiability. A gradient map unrelated to fff would trivialize the model, so the smoothness definition includes the gradient identity.

The local development needs Euclidean inner-product identities, convexity, differentiability, Lipschitz gradient bounds, and real exponential estimates. The auxiliary function and the two co-coercivity inequalities are reusable outside this chapter. Contributions should prove the exact milestone statements and the final theorem, including t=0t=0t=0 and α=β\alpha=\betaα=β, without weakening constants or substituting another gradient descent step.

Selected references

  • Sébastien Bubeck, Convex Optimization: Algorithms and Complexity, Foundations and Trends in Machine Learning 8(3–4):231–358, 2015. arXiv:1405.4980v2; DOI:10.1561/2200000050.
9 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingMarkov ChainOperations Research·Captain: mikedeng1

An Analysis of Stochastic Shortest Path Problems: If Every Improper Policy Has Infinite Cost, the Optimal Cost Is the Unique Fixed Point of Bellman's Operator and Value Iteration Converges to ItResearch Paper

Motivation

A shortest path problem asks how to reach a destination at minimum cost. In a stochastic shortest path problem, a decision at a state selects a probability distribution over successor states, so both the route and its total cost are random. Costs may have either sign. This makes the problem relevant to finite-state control models where rewards and expenses occur before eventual termination. Bertsekas and Tsitsiklis analyze this setting without requiring all one-stage costs to be nonnegative or all to be nonpositive. Their condition instead rules out an improper stationary policy whose costs stay finite from every initial state. Bertsekas and Tsitsiklis (1991), pp. 580–583.

Earlier treatments established Bellman-equation and algorithmic conclusions under positive or nonnegative costs. The 1991 paper traces the finite-control development from Eaton and Zadeh and the compact-control extension from Kushner, then removes the sign restriction while retaining finite state space. It also explains why the Bellman mapping need not contract when an improper policy is available. Bertsekas and Tsitsiklis (1991), pp. 581, 585. A separate, proved Prove2Me theorem from Bertsekas's textbook treats the special case in which every policy is proper and controls are finite; the result here permits improper policies and compact control spaces.

Setting

There are n≥1n\ge1n≥1 states. State 111 is the destination. At state iii, a control u∈U(i)u\in U(i)u∈U(i) incurs a real cost ci(u)c_i(u)ci​(u) and moves the process to state jjj with probability pij(u)p_{ij}(u)pij​(u). A selector μ\muμ chooses one control μ(i)\mu(i)μ(i) at every state. A policy π=(μ0,μ1,…)\pi=(\mu_0,\mu_1,\ldots)π=(μ0​,μ1​,…) may change selectors over time; a stationary policy repeats one selector. The matrix P(μ)P(\mu)P(μ) has entries pij(μ(i))p_{ij}(\mu(i))pij​(μ(i)), and c(μ)c(\mu)c(μ) is the vector of one-stage costs. Bertsekas and Tsitsiklis (1991), p. 582.

The cost vector x(π)x(\pi)x(π) is the coordinatewise limit inferior of expected partial costs, including the possibility of infinite values. The optimal cost xi∗x_i^*xi∗​ is the infimum of xi(π)x_i(\pi)xi​(π) over all policies, including nonstationary ones. Optimality of a policy means it attains that infimum from every initial state. The fixed-selector operator is Tμ(x)=c(μ)+P(μ)xT_\mu(x)=c(\mu)+P(\mu)xTμ​(x)=c(μ)+P(μ)x; the Bellman operator TTT takes the coordinatewise infimum of these vectors over selectors. Bertsekas and Tsitsiklis (1991), pp. 582–583, equations (2)–(6).

A stationary policy is proper when its probability of reaching state 111 tends to one from every starting state. Assumption 1 says state 111 is absorbing and cost-free, at least one proper stationary policy exists, and every improper stationary policy has a partial-cost coordinate tending to +∞+\infty+∞. Assumption 2 makes each control space compact, each cost function lower semicontinuous, and each transition-probability coordinate continuous. Work takes place in X={x∈Rn:x1=0}X=\{x\in\mathbb R^n:x_1=0\}X={x∈Rn:x1​=0}. Bertsekas and Tsitsiklis (1991), pp. 583–584.

Formalization targets

Proposition 2: Bellman's equation and value iteration

Under Assumptions 1 and 2, the optimal cost is finite and is the unique fixed point of TTT in XXX. Every initial x∈Xx\in Xx∈X has

lim⁡t→∞Tt(x)=x∗.\lim_{t\to\infty}T^t(x)=x^*.t→∞lim​Tt(x)=x∗.

A stationary selector μ\muμ is optimal exactly when Tμ(x∗)=T(x∗)T_\mu(x^*)=T(x^*)Tμ​(x∗)=T(x∗); an optimal proper stationary selector exists. These are all clauses of Proposition 2, rather than separate targets selected from it. Bertsekas and Tsitsiklis (1991), p. 586, Proposition 2.

Supporting results

The milestone list follows the source's Proposition 1, Lemmas 1–3, and the numbered equations used by their proof. Proposition 1 supplies a weighted maximum-norm contraction when every stationary policy is proper. Lemma 1 describes fixed costs of a proper policy and characterizes properness through a Bellman inequality. Lemma 2 gives continuity of TTT. Lemma 3 controls limits of proper policies; its second part detects a limit that becomes improper through diverging costs. Appendix equations (22) and (24), and the policy-improvement equation (15), provide the paper's intermediate targets. Bertsekas and Tsitsiklis (1991), pp. 585–587, 591–592.

Significance

Proposition 2 identifies the cost of the best policy by a finite-dimensional Bellman equation even though the definition of optimal cost ranges over all, possibly nonstationary, policies. Its convergence clause justifies value iteration from any vector whose destination coordinate is zero. Its policy criterion and existence clause connect a fixed point to an implementable stationary decision rule. The paper applies these conclusions to successive approximation and policy iteration in §4. Bertsekas and Tsitsiklis (1991), pp. 586, 590–591.

The paper proves these statements. This mission seeks machine-checked proofs of their exact finite-state formulation and of the listed intermediate results. The resulting finite stochastic-matrix, hitting, and policy-cost infrastructure can also support other undiscounted control problems. The related proved Prove2Me result for the all-proper finite-control case does not settle this mission's compact-control or improper-policy cases.

Difficulty

When every stationary policy is proper, a common weighted maximum norm makes the Bellman mapping contract. An improper policy can destroy this route: Figure 2 has an absorbing destination and satisfies both assumptions, yet T(0,x2)=(0,min⁡{1+x2,2})T(0,x_2)=(0,\min\{1+x_2,2\})T(0,x2​)=(0,min{1+x2​,2}) is not a contraction in any norm on XXX. The main result therefore needs a way to retain fixed-point uniqueness and convergence without a uniform contraction rate. Compactness matters because a sequence of proper selectors may converge to an improper selector; Lemma 3 explains the associated cost behavior. Bertsekas and Tsitsiklis (1991), pp. 585–586, 591–595.

Formalization scope

States are Fin n, with the paper's state 111 represented by 0; the model requires n≥1n\ge1n≥1. A control set U(i)U(i)U(i) is a type with a metric, with compactness asserted for its whole carrier. Transition rows explicitly have nonnegative entries summing to one. These are the probability-vector conditions implicit in the word “probability.” Assumption 1 supplies a selector and therefore nonempty control sets. The paper writes T:Rn→RnT:\mathbb R^n\to\mathbb R^nT:Rn→Rn; where a theorem uses only Assumption 1, finite real Bellman infima are made explicit through TRealValued. Under Assumption 2, compactness and lower semicontinuity give real attained minima. Bertsekas and Tsitsiklis (1991), pp. 582–584.

Policy costs and their infimum use extended reals so that an improper policy's +∞+\infty+∞ cost is represented without a default finite value. Proposition 2 concludes, rather than assumes, that x∗x^*x∗ has real coordinates. Its policy infimum ranges over every sequence of selectors. Matrix products use the identity at time zero; T0T^0T0 is the identity. The destination-zero restriction is retained in every fixed-point and iteration claim. Defining optimal cost as a Bellman fixed point, or restricting the infimum to stationary policies, would remove the result the paper proves. Solvers can contribute the finite-chain, matrix-inverse, semicontinuity, and convergence arguments needed by these targets.

Selected references

  • Dimitri P. Bertsekas and John N. Tsitsiklis, An Analysis of Stochastic Shortest Path Problems, Mathematics of Operations Research 16(3), 580–595, 1991. DOI.
11 thms2 active usersReviewed
🏆Completed
Convex OptimizationMachine Learning·Captain: mikedeng1

Convex Optimization: Algorithms and Complexity IV: Gradient Descent on a Convex β-Smooth Function Has Rate 2β‖x₁ − x*‖²/(t − 1)Textbook

Motivation

Gradient descent goes back to Cauchy (1847). It is the simplest method for minimizing a differentiable function, and most of the first-order methods in large-scale optimization and machine learning are variants of it. Its appeal in high dimension is that its oracle complexity, the number of gradient evaluations needed to reach a given accuracy, can be bounded independently of the dimension. For a merely Lipschitz convex function the projected subgradient method needs on the order of 1/ε21/\varepsilon^21/ε2 steps to reach accuracy ε\varepsilonε (Theorem 3.2 of the book). Under a smoothness assumption gradient descent does much better, because the gradients shrink near the optimum and the steps adapt automatically.

This mission formalizes the basic result of that kind: Theorem 3.3 of S. Bubeck, Convex Optimization: Algorithms and Complexity (Foundations and Trends in Machine Learning 8(3–4), 2015; arXiv:1405.4980v2). It states that gradient descent with step size 1/β1/\beta1/β on a convex β\betaβ-smooth function on Rn\mathbb R^nRn has optimality gap O(1/t)O(1/t)O(1/t) after ttt steps. The result and its proof are standard; versions appear in Nesterov's Introductory Lectures on Convex Optimization (2004, §2.1.5). It is the fourth mission in a series that formalizes the capstone results of Bubeck's monograph.

Setting

Write Rn\mathbb R^nRn for Euclidean space with inner product x⊤yx^\top yx⊤y and norm ∥⋅∥\|\cdot\|∥⋅∥. Let f:Rn→Rf:\mathbb R^n\to\mathbb Rf:Rn→R be differentiable with gradient ∇f\nabla f∇f.

  • fff is convex if f((1−λ)x+λy)≤(1−λ)f(x)+λf(y)f((1-\lambda)x+\lambda y)\le(1-\lambda)f(x)+\lambda f(y)f((1−λ)x+λy)≤(1−λ)f(x)+λf(y) for all x,yx,yx,y and λ∈[0,1]\lambda\in[0,1]λ∈[0,1].
  • For β≥0\beta\ge0β≥0, fff is β\betaβ-smooth if its gradient is β\betaβ-Lipschitz:
∥∇f(x)−∇f(y)∥≤β∥x−y∥for all x,y∈Rn.\|\nabla f(x)-\nabla f(y)\|\le\beta\|x-y\|\qquad\text{for all }x,y\in\mathbb R^n.∥∇f(x)−∇f(y)∥≤β∥x−y∥for all x,y∈Rn.
  • A minimizer is a point x∗x^*x∗ with f(x∗)≤f(y)f(x^*)\le f(y)f(x∗)≤f(y) for every yyy. Throughout the book a minimizer is assumed to exist.
  • Gradient descent with step size η>0\eta>0η>0, started at x1∈Rnx_1\in\mathbb R^nx1​∈Rn, is the sequence
xt+1=xt−η∇f(xt),t≥1.(3.1)x_{t+1}=x_t-\eta\nabla f(x_t),\qquad t\ge1. \tag{3.1}xt+1​=xt​−η∇f(xt​),t≥1.(3.1)

The optimality gaps are δs=f(xs)−f(x∗)≥0\delta_s=f(x_s)-f(x^*)\ge0δs​=f(xs​)−f(x∗)≥0.

Formalization targets

Goal: Theorem 3.3 (p. 267)

If fff is convex and β\betaβ-smooth with β>0\beta>0β>0, x∗x^*x∗ is a minimizer, and (xt)(x_t)(xt​) is gradient descent with η=1/β\eta=1/\betaη=1/β, then for every t≥2t\ge2t≥2

f(xt)−f(x∗)≤2β∥x1−x∗∥2t−1.f(x_t)-f(x^*)\le\frac{2\beta\|x_1-x^*\|^2}{t-1}.f(xt​)−f(x∗)≤t−12β∥x1​−x∗∥2​.

Milestones

These are the statements the book's proof uses, in the book's order:

  1. Lemma 3.4 (p. 267). For any β\betaβ-smooth fff, with no convexity: ∣f(x)−f(y)−∇f(y)⊤(x−y)∣≤β2∥x−y∥2|f(x)-f(y)-\nabla f(y)^\top(x-y)|\le\frac\beta2\|x-y\|^2∣f(x)−f(y)−∇f(y)⊤(x−y)∣≤2β​∥x−y∥2.
  2. (3.4) (p. 267). For convex β\betaβ-smooth fff: 0≤f(x)−f(y)−∇f(y)⊤(x−y)≤β2∥x−y∥20\le f(x)-f(y)-\nabla f(y)^\top(x-y)\le\frac\beta2\|x-y\|^20≤f(x)−f(y)−∇f(y)⊤(x−y)≤2β​∥x−y∥2.
  3. (3.5) (p. 267). For convex fff, one step of length 1/β1/\beta1/β decreases fff by at least 12β∥∇f(x)∥2\frac1{2\beta}\|\nabla f(x)\|^22β1​∥∇f(x)∥2.
  4. Lemma 3.5 (p. 268). If (3.4) holds, then f(x)−f(y)≤∇f(x)⊤(x−y)−12β∥∇f(x)−∇f(y)∥2f(x)-f(y)\le\nabla f(x)^\top(x-y)-\frac1{2\beta}\|\nabla f(x)-\nabla f(y)\|^2f(x)−f(y)≤∇f(x)⊤(x−y)−2β1​∥∇f(x)−∇f(y)∥2.
  5. (3.6) (p. 269). Co-coercivity: (∇f(x)−∇f(y))⊤(x−y)≥1β∥∇f(x)−∇f(y)∥2(\nabla f(x)-\nabla f(y))^\top(x-y)\ge\frac1\beta\|\nabla f(x)-\nabla f(y)\|^2(∇f(x)−∇f(y))⊤(x−y)≥β1​∥∇f(x)−∇f(y)∥2.
  6. Distances decrease (proof of Theorem 3.3, p. 269). ∥xs+1−x∗∥≤∥xs−x∗∥\|x_{s+1}-x^*\|\le\|x_s-x^*\|∥xs+1​−x∗∥≤∥xs​−x∗∥ for every s≥1s\ge1s≥1.
  7. The recursion (p. 268). δs+1≤δs−12β∥x1−x∗∥2δs2\delta_{s+1}\le\delta_s-\frac{1}{2\beta\|x_1-x^*\|^2}\delta_s^2δs+1​≤δs​−2β∥x1​−x∗∥21​δs2​.
  8. From the recursion to the rate (p. 269). For ω>0\omega>0ω>0 and non-negative reals, ωδs2+δs+1≤δs\omega\delta_s^2+\delta_{s+1}\le\delta_sωδs2​+δs+1​≤δs​ for all s≥1s\ge 1s≥1 implies 1/δt≥ω(t−1)1/\delta_t\ge\omega(t-1)1/δt​≥ω(t−1).

Stronger companion: footnote 4 (p. 269)

Under the same hypotheses, f(xt)−f(x∗)≤2β∥x1−x∗∥2/(t+3)f(x_t)-f(x^*)\le 2\beta\|x_1-x^*\|^2/(t+3)f(xt​)−f(x∗)≤2β∥x1​−x∗∥2/(t+3) for every t≥1t\ge1t≥1.

Significance

Theorem 3.3 is the reference rate for first-order methods on smooth convex problems. Several later results in the book are measured against it. Nesterov's accelerated gradient descent (§3.7) improves 1/t1/t1/t to 1/t21/t^21/t2, the lower bounds of §3.5 show that 1/t21/t^21/t2 cannot be beaten by any black-box first-order method, and adding strong convexity (§3.4) upgrades 1/t1/t1/t to a linear rate. Its ingredients are reused throughout the book and the optimization literature: the descent lemma (Lemma 3.4), the one-step improvement (3.5) and co-coercivity (3.6). Co-coercivity is the finite-dimensional case of the Baillon–Haddad theorem.

The result is classical and fully proved on paper. To our knowledge Mathlib does not contain this rate for gradient descent on convex smooth functions, and no published Prove2Me theorem states it. The mission provides it, together with Lemma 3.4 and co-coercivity as reusable statements on EuclideanSpace ℝ (Fin n). These are the facts that later missions of the series on projected gradient descent, strong convexity and acceleration need. Formalizing the improved constant of footnote 4 is a welcome addition.

Difficulty

Two steps are not routine. The first is Lemma 3.4, where the book integrates the gradient along a segment. In Lean this needs a mean-value or fundamental-theorem-of-calculus argument for a function on a Euclidean space, together with a Cauchy–Schwarz estimate, and Mathlib's HasGradientAt interface has to be connected to one-variable derivatives along lines.

The second is the monotonicity of ∥xs−x∗∥\|x_s-x^*\|∥xs​−x∗∥. The natural first attempt is to telescope the one-step improvement (3.5) together with the convexity bound δs≤∥xs−x∗∥∥∇f(xs)∥\delta_s\le\|x_s-x^*\|\|\nabla f(x_s)\|δs​≤∥xs​−x∗∥∥∇f(xs​)∥. That gives a recursion involving ∥xs−x∗∥\|x_s-x^*\|∥xs​−x∗∥, which is not controlled by ∥x1−x∗∥\|x_1-x^*\|∥x1​−x∗∥ without further work. Making the recursion uniform requires co-coercivity (3.6), which comes from Lemma 3.5. That lemma's hypothesis is the two-sided inequality (3.4), not smoothness directly. The final numerical step divides by the gaps δs\delta_sδs​, so zero gaps need separate handling.

Formalization scope

  • Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n), and x⊤yx^\top yx⊤y is ⟪x, y⟫_ℝ.
  • The gradient is an explicit map g:Rn→Rng:\mathbb R^n\to\mathbb R^ng:Rn→Rn with the hypothesis ∀ x, HasGradientAt f (g x) x.
  • β\betaβ-smoothness (IsBetaSmooth f g β) is the book's definition: β≥0\beta\ge0β≥0, the gradient-existence hypothesis, and the Lipschitz bound ∥g(x)−g(y)∥≤β∥x−y∥\|g(x)-g(y)\|\le\beta\|x-y\|∥g(x)−g(y)∥≤β∥x−y∥. The book's "continuously differentiable" follows from it.
  • Convexity is Mathlib's ConvexOn ℝ Set.univ f. A minimizer is a point xstar with ∀ y, f xstar ≤ f y; its existence is the book's standing assumption, and ∇f(x∗)=0\nabla f(x^*)=0∇f(x∗)=0 is derived, not assumed.
  • A gradient-descent run (IsGDRun g η x) is a sequence x : ℕ → ℝⁿ with η>0\eta>0η>0 and xt+1=xt−ηg(xt)x_{t+1}=x_t-\eta g(x_t)xt+1​=xt​−ηg(xt​) for every t≥1t\ge1t≥1. The book's x1x_1x1​ is x 1, and index 000 is unused. Every theorem quantifies over all runs with η=1/β\eta=1/\betaη=1/β.

Disclosed side conditions:

  • β>0\beta>0β>0 wherever the page divides by β\betaβ. Convexity is retained for (3.5), as in its source context.
  • t≥2t\ge2t≥2 in the goal, where the page's bound has denominator t−1t-1t−1.
  • Statements in which the page divides by δs\delta_sδs​ or by ∥x1−x∗∥2\|x_1-x^*\|^2∥x1​−x∗∥2 are multiplied through, so that they stay true and meaningful when those quantities vanish.

A trivializing formalization is ruled out. Smoothness is the Lipschitz condition on the gradient, so Lemma 3.4 and (3.4) are not restatements of the definition, as they would be if the quadratic upper bound (3.4) were taken as the definition of smoothness. The run predicate also fixes the step size 1/β1/\beta1/β.

A complete development needs:

  • the segment integral or mean-value estimate for HasGradientAt functions;
  • first-order characterizations of convexity for differentiable functions;
  • elementary inner-product algebra.

Lemma 3.4, Lemma 3.5 and (3.6) are reusable well beyond this mission. Proofs of any milestone are welcome independently.

Selected references

  • S. Bubeck, Convex Optimization: Algorithms and Complexity, Foundations and Trends in Machine Learning 8(3–4):231–357, 2015. arXiv:1405.4980v2; §3.2, pp. 266–269.
  • A. Cauchy, Méthode générale pour la résolution des systèmes d'équations simultanées, C. R. Acad. Sci. Paris 25:536–538, 1847.
  • Y. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, Kluwer, 2004. doi:10.1007/978-1-4419-8853-9
  • J.-B. Baillon and G. Haddad, Quelques propriétés des opérateurs angle-bornés et n-cycliquement monotones, Israel J. Math. 26:137–150, 1977. doi:10.1007/BF03007664
10 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingGraph TheoryOperations Research·Captain: mikedeng1

On a Routing Problem: Successive Approximations from the Direct-Route Policy Decrease to the Unique Solution of the Routing Equation Within N − 1 IterationsResearch Paper

Motivation

Finding the quickest route between two points of a road network is among the oldest problems of operations research. It is the subproblem inside vehicle routing, network flow and many dynamic programs. Richard Bellman's four-page note On a routing problem (Quarterly of Applied Mathematics, 1958) treats it as a dynamic program. The minimal travel times satisfy a nonlinear system of equations, and that system can be solved by successive approximations that terminate after a number of steps bounded in advance. The iteration is now known as the Bellman–Ford method. A footnote added in proof records that Max Woodbury and George Dantzig had obtained the same scheme independently, and Ford's RAND report of 1956 describes a closely related labelling procedure.

Timeline.

  • 1956. L. R. Ford Jr., Network flow theory (RAND P-923): a label-improving procedure for shortest paths.
  • 1957. Bellman's Dynamic Programming (Princeton) states the principle of optimality used here.
  • 1958. Bellman's note: the routing equation, its uniqueness, approximation in policy space with an (N − 1)-step bound, and a second, monotone increasing scheme.
  • 1959. Dijkstra gives a label-setting method for nonnegative lengths.
  • 1962. Floyd's Algorithm 97 computes all pairs of shortest distances.

Setting

There are NNN cities, numbered 1,…,N1, \dots, N1,…,N. Every two of them are linked by a direct road, and city NNN is the destination. The travel time from iii to jjj is a real number tijt_{ij}tij​; the matrix T=(tij)T = (t_{ij})T=(tij​) need not be symmetric. Throughout, tij>0t_{ij} > 0tij​>0 for i≠ji \ne ji=j.

A route from iii to NNN is a sequence of cities i=c0,c1,…,cm=Ni = c_0, c_1, \dots, c_m = Ni=c0​,c1​,…,cm​=N in which consecutive cities differ. Its stops are c1,…,cm−1c_1, \dots, c_{m-1}c1​,…,cm−1​, and its time is ∑r<mtcrcr+1\sum_{r<m} t_{c_r c_{r+1}}∑r<m​tcr​cr+1​​. The minimal time fif_ifi​ (3.1) is the least time of a route from iii to NNN, and fN=0f_N = 0fN​=0.

The routing equation (3.2) is the system

Fi=min⁡j≠i [tij+Fj](i=1,…,N−1),FN=0.F_i = \min_{j \ne i}\,[t_{ij} + F_j]\quad (i = 1, \dots, N-1), \qquad F_N = 0 .Fi​=j=imin​[tij​+Fj​](i=1,…,N−1),FN​=0.

Approximation in policy space (§5) starts from the direct-route policy (5.2), fi(0)=tiNf_i^{(0)} = t_{iN}fi(0)​=tiN​, and iterates (5.1):

fi(k+1)=min⁡j≠i [tij+fj(k)](i≠N),fN(k+1)=0.f_i^{(k+1)} = \min_{j \ne i}\,[t_{ij} + f_j^{(k)}]\quad (i \ne N), \qquad f_N^{(k+1)} = 0 .fi(k+1)​=j=imin​[tij​+fj(k)​](i=N),fN(k+1)​=0.

The second scheme (§7, (7.1)) starts instead from f‾i(0)=min⁡j≠itij\underline f_i^{(0)} = \min_{j\ne i} t_{ij}f​i(0)​=minj=i​tij​ and uses the same step.

Formalization targets

Goal: convergence within N−1N - 1N−1 iterations

For every k≥N−1k \ge N - 1k≥N−1 the following hold. Each fi(k)f_i^{(k)}fi(k)​ is the minimal time from iii to NNN, attained by a route. The vector f(k)f^{(k)}f(k) solves (3.2). Every real solution of (3.2) equals f(k)f^{(k)}f(k):

k≥N−1  ⟹  f(k)=f=the unique solution of (3.2).k \ge N-1 \;\Longrightarrow\; f^{(k)} = f = \text{the unique solution of (3.2)}.k≥N−1⟹f(k)=f=the unique solution of (3.2).

This is the claim of the Summary ("converges after at most (N−1)(N-1)(N−1) iterations") and of the last sentence of §5. The paper's bound N−1N - 1N−1 is kept, although N−2N - 2N−2 also suffices.

Milestones

  1. (3.2): the minimal times exist and satisfy the routing equation.
  2. §4: (3.2) has at most one solution.
  3. (5.4): f(1)≤f(0)f^{(1)} \le f^{(0)}f(1)≤f(0).
  4. §5, the sentence after (5.4): fi(k)f_i^{(k)}fi(k)​ is the minimal time over routes with at most kkk stops.
  5. (5.5): f(k+1)≤f(k)f^{(k+1)} \le f^{(k)}f(k+1)≤f(k) for all kkk.
  6. §7: the scheme (7.1) increases, stays below the solution of (3.2) (7.2), and equals it from some index on.

Significance

The result. The note turns an enumeration over exponentially many paths into N−1N - 1N−1 rounds of NNN minimisations each, with a bound fixed before the computation starts. The uniqueness theorem makes the routing equation a characterisation of the minimal times, not merely a property of them. This is the template for later correctness proofs of shortest-path and value-iteration algorithms. The monotone decrease (5.5) is the first instance of policy improvement: every iterate is the value of an actual routing policy.

Formalizing it. The results are classical and proved. What this mission adds is a machine-checked development against the paper's own objects. Routes, their times and minimal times are defined from scratch. The iteration is stated exactly as printed, apart from the corrected initial value at the destination. The (N − 1)-step termination is asserted as an equality, not a limit. Related platform items treat other methods and do not cover these statements. One is the label-correcting method (BertsekasDP.label_correcting_correctness_of_nonneg_arcs, BertsekasDP.label_correcting_terminates). Another is the stochastic shortest path problem under a termination assumption that fails for deterministic routing (BertsekasDP.ssp_main_theorem). There are also the generic candidate-list algorithm (BertsekasNetwork.generic_shortest_path_algorithm), Floyd's Algorithm 97 and Dijkstra's method.

Difficulty

The minimum in (3.2) may be attained at a jjj whose own optimal route passes back through iii. The routing equation is a fixed-point equation for an operator that is monotone but not a contraction in any fixed norm. The standard contraction argument for discounted dynamic programs therefore does not apply. Uniqueness has to use tij>0t_{ij} > 0tij​>0 to exclude zero-time cycles: with t12=t21=0t_{12} = t_{21} = 0t12​=t21​=0, the system (3.2) has infinitely many solutions. The N−1N - 1N−1 bound depends on the at-most-kkk-stops reading of f(k)f^{(k)}f(k) and on the fact that an optimal route never needs to revisit a city. Neither is visible from the recursion alone. For the scheme of §7, the page gives no bound on the number of iterations, and none holds uniformly in ttt.

Formalization scope

Cities are Fin (n + 1), so N=n+1N = n + 1N=n+1, with standing hypothesis n≥1n \ge 1n≥1. City NNN is Fin.last n, and travel times are t : Fin (n + 1) → Fin (n + 1) → ℝ with tij>0t_{ij} > 0tij​>0 for i≠ji \ne ji=j. Diagonal entries are unconstrained and never used. No symmetry, triangle inequality or integrality is assumed. A route is a list of cities with distinct consecutive entries ending at NNN. Repeated cities are allowed; with positive times this changes no minimum. Minimal times are attained minima over routes (IsMinTime, IsMinTimeWithin), not real infima. The minimum in (3.2) is a Finset.inf' over all j≠ij \ne ij=i, the destination included.

The paper's loose phrases are made explicit as follows.

  • "Using an optimal policy" (3.1) becomes a minimum attained by a route and below every route.
  • "Represents the minimum time for a path with at most one stop" becomes, for every kkk, a minimum over routes with at most k+1k + 1k+1 roads.
  • "Converges after at most (N−1)(N - 1)(N−1) iterations" becomes f(k)=ff^{(k)} = ff(k)=f for every k≥N−1k \ge N - 1k≥N−1.
  • "Only a finite number of iterations will be required" (§7) becomes ∃K,∀k≥K\exists K, \forall k \ge K∃K,∀k≥K, f‾(k)=f\underline f^{(k)} = ff​(k)=f.
  • "The solution of (3.2)" in §7 becomes an arbitrary solution of (3.2), which milestones 1–2 show is the vector of minimal times.

Two printed slips are corrected. (5.2) is printed for i=1,…,Ni = 1, \dots, Ni=1,…,N, which would set fN(0)=tNNf_N^{(0)} = t_{NN}fN(0)​=tNN​, and with tNN>0t_{NN} > 0tNN​>0 statements (5.4), (5.5) and the goal would be false. The formalization uses fN(0)=0f_N^{(0)} = 0fN(0)​=0, the value the paper's own justification needs. (7.1) prints "N=1N = 1N=1" for N−1N - 1N−1. Section 6 (computational aspects) and the closing expectation of §7 that the first method converges faster are not formalized.

The goal cannot be satisfied trivially. The minimal times are defined from routes, not as a solution of (3.2) or as a limit of the iteration, so the goal connects the recursion to the routing problem itself.

The development needs only finite minima, lists and induction; nothing beyond core Mathlib. The route and minimal-time layer is reusable for other deterministic shortest-path results. Proofs of any milestone are welcome, as are proofs of the sharper bound N−2N - 2N−2.

Selected references

  • R. Bellman, On a routing problem, Quarterly of Applied Mathematics 16(1) (1958), 87–90. https://doi.org/10.1090/qam/102435
  • R. Bellman, Dynamic Programming, Princeton University Press, 1957.
  • R. Bellman, The theory of dynamic programming, Bull. Amer. Math. Soc. 60 (1954), 503–515. https://doi.org/10.1090/S0002-9904-1954-09848-8
  • L. R. Ford Jr., Network flow theory, RAND Corporation P-923, 1956. https://www.rand.org/pubs/papers/P923.html
  • E. W. Dijkstra, A note on two problems in connexion with graphs, Numerische Mathematik 1 (1959), 269–271. https://doi.org/10.1007/BF01386390
  • R. W. Floyd, Algorithm 97: Shortest path, Communications of the ACM 5(6) (1962), 345. https://doi.org/10.1145/367766.368168
8 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Airline Seat Allocation with Multiple Nested Fare Classes 1: Protection Levels Solving f₁Pr[X₁ > p₁ ∩ … ∩ X₁ + … + X_k > p_k] = f_{k+1} Maximize Expected RevenueResearch Paper

Motivation

An airline sells the seats of one flight leg at several fares. Cheaper fares are booked earlier, so the airline must decide, while low-fare requests arrive, how many seats to hold back for later and more valuable passengers. In nested booking control a seat that could be sold at a low fare is always available to a higher fare. The airline therefore chooses protection levels: pkp_kpk​ seats are reserved for the kkk most expensive classes together, and a request of class k+1k+1k+1 is accepted only while more than pkp_kpk​ seats remain.

For two classes the optimal protection level was found by Littlewood (1972): protect p1p_1p1​ seats, where f1Pr⁡[X1>p1]=f2f_1 \Pr[X_1 > p_1] = f_2f1​Pr[X1​>p1​]=f2​. For more classes the industry used the EMSRa heuristic of Belobaba (1987, 1989), which applies Littlewood's rule to each pair of classes separately and adds the results. Brumelle and McGill (1993) gave the exact optimality conditions for any number of nested classes and showed that EMSRa is in general not optimal. Their conditions are part of the standard theory of single-leg revenue management, as presented in Talluri and van Ryzin (2004).

Setting

There are fare classes k=1,2,…k = 1, 2, \dotsk=1,2,…, numbered from the highest fare. Class kkk has fare fkf_kfk​ and random demand Xk≥0X_k \ge 0Xk​≥0. The standing assumptions (pp. 128–129) are: the demands are mutually independent random variables on a probability space (Ω,F,P)(\Omega, \mathcal F, P)(Ω,F,P), and the fares are strictly decreasing, f1>f2>⋯f_1 > f_2 > \cdotsf1​>f2​>⋯. Demands arrive in order of increasing fare: all of class k+1k+1k+1 before any of class kkk. There are no cancellations or no-shows, and the decision to close a class depends only on the number of current bookings.

A protection-level policy is a vector p=(p1,p2,… )p = (p_1, p_2, \dots)p=(p1​,p2​,…) with pk≥0p_k \ge 0pk​≥0; the dummy p0=0p_0 = 0p0​=0. The revenue Rk[s;p;x]R_k[s; p; x]Rk​[s;p;x] of the kkk highest classes with sss seats available and demand vector xxx is defined recursively by (8)–(9), p. 130:

R1[s;p;x]=f1min⁡(s,x1),R_1[s; p; x] = f_1 \min(s, x_1),R1​[s;p;x]=f1​min(s,x1​), Rk+1[s;p;x]={Rk[s;p;x]0≤s<pk,(s−pk)fk+1+Rk[pk;p;x]pk≤s<pk+xk+1,xk+1fk+1+Rk[s−xk+1;p;x]pk+xk+1≤s.R_{k+1}[s; p; x] = \begin{cases} R_k[s; p; x] & 0 \le s < p_k, \\ (s - p_k) f_{k+1} + R_k[p_k; p; x] & p_k \le s < p_k + x_{k+1}, \\ x_{k+1} f_{k+1} + R_k[s - x_{k+1}; p; x] & p_k + x_{k+1} \le s. \end{cases}Rk+1​[s;p;x]=⎩⎨⎧​Rk​[s;p;x](s−pk​)fk+1​+Rk​[pk​;p;x]xk+1​fk+1​+Rk​[s−xk+1​;p;x]​0≤s<pk​,pk​≤s<pk​+xk+1​,pk​+xk+1​≤s.​

The expected revenue is ERk[s;p;X]=E Rk[s;p;X]ER_k[s; p; X] = E\,R_k[s; p; X]ERk​[s;p;X]=ERk​[s;p;X]. A policy ppp is optimal if ERk[s;q;X]≤ERk[s;p;X]ER_k[s; q; X] \le ER_k[s; p; X]ERk​[s;q;X]≤ERk​[s;p;X] for every policy qqq, every k≥1k \ge 1k≥1 and every s≥0s \ge 0s≥0.

For g:R→Rg : \mathbb R \to \mathbb Rg:R→R, δ+g[s]\delta_+ g[s]δ+​g[s] and δ−g[s]\delta_- g[s]δ−​g[s] denote the right and left derivatives, and the subdifferential δg[s]\delta g[s]δg[s] is the interval [δ+g[s],δ−g[s]][\delta_+ g[s], \delta_- g[s]][δ+​g[s],δ−​g[s]], with δ−g[0]=+∞\delta_- g[0] = +\inftyδ−​g[0]=+∞ (p. 131).

Formalization targets

Goal: Theorem 3 (p. 134)

If the protection levels satisfy

f1Pr⁡[X1>p1∩X1+X2>p2∩⋯∩X1+⋯+Xk>pk]=fk+1for all k≥1,(31)f_1 \Pr[X_1 > p_1 \cap X_1 + X_2 > p_2 \cap \dots \cap X_1 + \dots + X_k > p_k] = f_{k+1} \quad \text{for all } k \ge 1, \tag{31}f1​Pr[X1​>p1​∩X1​+X2​>p2​∩⋯∩X1​+⋯+Xk​>pk​]=fk+1​for all k≥1,(31)

then ppp is optimal.

Milestones

  1. (27), p. 132: ER1ER_1ER1​ is concave, and δER1[s;p;X]=[f1Pr⁡[X1>s],f1Pr⁡[X1≥s]]\delta ER_1[s; p; X] = [f_1 \Pr[X_1 > s], f_1 \Pr[X_1 \ge s]]δER1​[s;p;X]=[f1​Pr[X1​>s],f1​Pr[X1​≥s]].
  2. Lemma 1, p. 131: if ERk[ ⋅ ;p;X]ER_k[\,\cdot\,; p; X]ERk​[⋅;p;X] is concave on s≥0s \ge 0s≥0 and fk+1∈δERk[pk;p;X]f_{k+1} \in \delta ER_k[p_k; p; X]fk+1​∈δERk​[pk​;p;X], then E{Rk+1[s;p;X]∣Xk+1}E\{R_{k+1}[s; p; X] \mid X_{k+1}\}E{Rk+1​[s;p;X]∣Xk+1​} is concave in sss.
  3. Corollary 1, p. 131: under the same conditions ERk+1[ ⋅ ;p;X]ER_{k+1}[\,\cdot\,; p; X]ERk+1​[⋅;p;X] is concave on s≥0s \ge 0s≥0.
  4. Theorem 1, p. 131: if fk+1∈δERk[pk;p;X]f_{k+1} \in \delta ER_k[p_k; p; X]fk+1​∈δERk​[pk​;p;X] for every kkk (condition (20)), then ppp is optimal.
  5. Lemma 2, p. 134: under (31), for s≥pks \ge p_ks≥pk​,
δ+E{Rk+1[s;p;X]∣Xk+1}=f1Pr⁡[X1>p1∩⋯∩X1+⋯+Xk>pk∩X1+⋯+Xk+1>s∣Xk+1].\delta_+ E\{R_{k+1}[s; p; X] \mid X_{k+1}\} = f_1 \Pr[X_1 > p_1 \cap \dots \cap X_1 + \dots + X_k > p_k \cap X_1 + \dots + X_{k+1} > s \mid X_{k+1}].δ+​E{Rk+1​[s;p;X]∣Xk+1​}=f1​Pr[X1​>p1​∩⋯∩X1​+⋯+Xk​>pk​∩X1​+⋯+Xk+1​>s∣Xk+1​].
  1. Corollary 2, p. 134: the unconditional version (37) of Lemma 2 for δ+ERk+1[s;p;X]\delta_+ ER_{k+1}[s; p; X]δ+​ERk+1​[s;p;X].

Significance

Theorem 3 turns the optimal nested protection levels into a sequence of equations in the joint distribution of the cumulative demands X1+⋯+XjX_1 + \dots + X_jX1​+⋯+Xj​. For k=1k = 1k=1 it is Littlewood's rule. For k≥2k \ge 2k≥2 it identifies exactly what EMSRa approximates: EMSRa replaces the joint event in (31) by separate pairwise comparisons, and the paper shows (§4) that EMSRa can both over- and underestimate the optimal protection levels. The conditions are also the input of numerical methods: given demand forecasts, the levels p1,p2,…p_1, p_2, \dotsp1​,p2​,… are found one after another by solving (31), and §3.3 notes that a continuous joint demand distribution guarantees a solution exists.

The results are proved in the paper. As far as is known they have no machine-checked proof. Related platform items cover the two-class, integer-seat case from Belobaba (1987) (SeatInventory.Nested.emsr_protection_level_optimal) and the integer marginal-seat-revenue analogue of (27). They use a different model: two classes, natural-number seats and first differences. This mission formalizes the multi-class statement with real-valued seats and one-sided derivatives. A sister mission of the series proves the existence of optimal integer policies for integer-valued demand (Theorem 2).

Difficulty

The expected revenue is not differentiable: for discrete demand it is piecewise linear, so first-order conditions must be stated with one-sided derivatives and subdifferentials. The natural approach, to optimize each protection level separately with the others fixed, fails without concavity, and concavity of ERk+1ER_{k+1}ERk+1​ in sss is not automatic. It holds only when the lower protection levels already satisfy the first-order conditions. Concavity and optimality must therefore be carried through one joint induction over the classes. Passing from (31) to (20) requires computing the right derivative of the expected revenue in closed form for every s≥pks \ge p_ks≥pk​. This involves exchanging differentiation with expectation and conditioning on one class's demand at a time.

Formalization scope

  • Classes are indexed by N\mathbb NN from 111; fares, demands and protection levels are sequences N→R\mathbb N \to \mathbb RN→R, with no bound on the number of classes. Seats and protection levels are real numbers.
  • Expectation is the Bochner integral on a probability space. The standing assumptions are a single predicate: probability measure, measurable nonnegative demands, mutual independence (iIndepFun), strictly decreasing fares.
  • E{⋅∣Xk}E\{\cdot \mid X_k\}E{⋅∣Xk​} evaluated at Xk=yX_k = yXk​=y is the integral with the kkk-th demand frozen at yyy. Because the demands are independent this is a version of the conditional expectation, and "with probability 1" becomes "for every y≥0y \ge 0y≥0", which is stronger.
  • One-sided derivatives are HasDerivWithinAt on half-lines and must exist; derivWithin, which returns 000 where no derivative exists, is not used. δ−g[0]=+∞\delta_- g[0] = +\inftyδ−​g[0]=+∞ is encoded as a disjunct.
  • Optimality is global: ppp beats every policy qqq at every level kkk and every s≥0s \ge 0s≥0. The page's proof of Theorem 1 shows coordinatewise optimality of pkp_kpk​, and the global form follows by induction on kkk.
  • Fares are not assumed positive in the model: under (20) or (31) with strictly decreasing fares, f1>0f_1 > 0f1​>0 follows. The milestone (27), stated with only the hypotheses on X1X_1X1​ that it needs, assumes X1≥0X_1 \ge 0X1​≥0 and f1≥0f_1 \ge 0f1​≥0, without which ER1ER_1ER1​ is not concave.
  • No continuity of the demand distribution is assumed. Theorem 3 is conditional on a solution of (31).
  • The page's hypothesis of Lemma 1 has the misprint "(p0,…,pk+1)(p_0, \dots, p_{k+1})(p0​,…,pk+1​)" for (p0,…,pk−1)(p_0, \dots, p_{k-1})(p0​,…,pk−1​). The formal statement uses the latter.

The goal assumes only the standing assumptions, p≥0p \ge 0p≥0, and (31). It does not assume concavity, condition (20) or any derivative formula: those are milestones. A formalization that quantified optimality over one level, one value of sss, or policies differing from ppp in one coordinate would be weaker than the paper and is excluded.

A complete development needs one-sided derivatives of integrals of piecewise-linear functions (dominated convergence for difference quotients), concavity of piecewise functions glued at points where the slopes decrease, and the independence calculus that turns E[E{⋅∣Xk+1}]E[E\{\cdot \mid X_{k+1}\}]E[E{⋅∣Xk+1​}] into an iterated integral. These pieces are reusable for other newsvendor-type and revenue-management models. Proofs of any milestone, and alternative arguments for Theorem 1, are welcome.

Selected references

  • S. L. Brumelle and J. I. McGill, Airline Seat Allocation with Multiple Nested Fare Classes, Operations Research 41(1), 127–137, 1993. https://doi.org/10.1287/opre.41.1.127
  • K. Littlewood, Forecasting and Control of Passenger Bookings, AGIFORS Symposium Proceedings 12, 95–117, 1972; reprinted in Journal of Revenue and Pricing Management 4(2), 2005. https://doi.org/10.1057/palgrave.rpm.5170134
  • P. P. Belobaba, Air Travel Demand and Airline Seat Inventory Management, PhD thesis, MIT, 1987. http://hdl.handle.net/1721.1/68077
  • P. P. Belobaba, Application of a Probabilistic Decision Model to Airline Seat Inventory Control, Operations Research 37(2), 183–197, 1989. https://doi.org/10.1287/opre.37.2.183
  • K. T. Talluri and G. J. van Ryzin, The Theory and Practice of Revenue Management, Springer, 2004. https://doi.org/10.1007/b139000
8 thms2 active usersReviewed
🏆Completed
Algebraic GeometryComplexity TheoryLinear Optimization+1·Captain: mikedeng1

Log-Barrier Interior Point Methods Are Not Strongly Polynomial 1: Every Polygonal Curve in the Wide Neighborhood of the Central Path of LW_r(t) from μ̄ ≤ 1 to μ̄ ≥ t² Has at Least 2^(r−1) SegmentsResearch Paper

Motivation

Interior point methods solve linear programs in a number of arithmetic operations polynomial in the bit length of the input (Karmarkar 1984). Whether linear programming admits a strongly polynomial algorithm, one whose number of arithmetic operations is bounded by a polynomial in the number of variables and constraints alone, is open; it is the ninth of Smale's problems for the next century (Smale 1998/2000, see the references). A natural question is whether some interior point method is strongly polynomial. Primal-dual path-following methods follow the central path of a log-barrier problem and are the methods used in practice.

Allamigeon, Benchimol, Gaubert and Joswig (arXiv:1708.01544, SIAM J. Appl. Algebra Geom. 2018) gave such a family. For linear programs LWr(t)\mathbf{LW}_r(t)LWr​(t) with 2r2r2r variables and 3r+13r+13r+1 constraints, every path-following method that stays in the wide neighborhood of the central path needs at least 2r−12^{r-1}2r−1 iterations once ttt is large enough. The same family disproves the "continuous Hirsch conjecture" of Deza, Terlaky and Zinchenko (DTZ09, see the references) on the total curvature of the central path. That curvature result is the subject of a separate mission. This mission formalizes the iteration bound.

Setting

For a real m×nm\times nm×n matrix AAA, b∈Rmb\in\mathbb R^mb∈Rm, c∈Rnc\in\mathbb R^nc∈Rn and N:=n+mN:=n+mN:=n+m, the paper considers the linear program in slack form and its dual,

LP(A,b,c): min⁡ ⟨c,x⟩  s.t.  Ax+w=b, (x,w)≥0,DualLP(A,b,c): s−A⊤y=c, (s,y)≥0.\mathrm{LP}(A,b,c):\ \min\ \langle c,x\rangle\ \text{ s.t. }\ Ax+w=b,\ (x,w)\ge0,\qquad \mathrm{DualLP}(A,b,c):\ s-A^\top y=c,\ (s,y)\ge0 .LP(A,b,c): min ⟨c,x⟩  s.t.  Ax+w=b, (x,w)≥0,DualLP(A,b,c): s−A⊤y=c, (s,y)≥0.

A primal-dual point is z=(x,w,s,y)∈R2Nz=(x,w,s,y)\in\mathbb R^{2N}z=(x,w,s,y)∈R2N. The set F∘\mathcal F^\circF∘ of strictly feasible points consists of the zzz with all 2N2N2N coordinates positive that satisfy both equality systems. The duality measure is

μˉ(z)=1N(⟨x,s⟩+⟨w,y⟩),\bar\mu(z)=\frac1N\big(\langle x,s\rangle+\langle w,y\rangle\big),μˉ​(z)=N1​(⟨x,s⟩+⟨w,y⟩),

and for 0<θ<10<\theta<10<θ<1 the wide neighborhood of the central path is

Nθ−∞={z∈F∘: xjsj≥(1−θ)μˉ(z) ∀j,  wiyi≥(1−θ)μˉ(z) ∀i}.\mathcal N^{-\infty}_\theta=\Big\{z\in\mathcal F^\circ:\ x_js_j\ge(1-\theta)\bar\mu(z)\ \forall j,\ \ w_iy_i\ge(1-\theta)\bar\mu(z)\ \forall i\Big\}.Nθ−∞​={z∈F∘: xj​sj​≥(1−θ)μˉ​(z) ∀j,  wi​yi​≥(1−θ)μˉ​(z) ∀i}.

The central path itself is the set of points where all products xjsjx_js_jxj​sj​, wiyiw_iy_iwi​yi​ are equal. The neighborhood bounds the products only from below. It contains the ℓ2\ell_2ℓ2​ and ℓ∞\ell_\inftyℓ∞​ neighborhoods used by short-step, long-step and predictor-corrector methods.

The instance is LWr(t)\mathbf{LW}_r(t)LWr​(t), for r≥1r\ge1r≥1 and t>0t>0t>0:

min⁡ x1  s.t.  x1≤t2, x2≤t, x2j+1≤t x2j−1, x2j+1≤t x2j, x2j+2≤t1−1/2j(x2j−1+x2j) (1≤j<r), x2r−1,x2r≥0.\min\ x_1\ \text{ s.t. }\ x_1\le t^2,\ x_2\le t,\ x_{2j+1}\le t\,x_{2j-1},\ x_{2j+1}\le t\,x_{2j},\ x_{2j+2}\le t^{1-1/2^j}(x_{2j-1}+x_{2j})\ (1\le j<r),\ x_{2r-1},x_{2r}\ge0 .min x1​  s.t.  x1​≤t2, x2​≤t, x2j+1​≤tx2j−1​, x2j+1​≤tx2j​, x2j+2​≤t1−1/2j(x2j−1​+x2j​) (1≤j<r), x2r−1​,x2r​≥0.

With slacks w1,…,w3r−1w_1,\dots,w_{3r-1}w1​,…,w3r−1​ it becomes LWr=(t)=LP(A,b,c)\mathbf{LW}^=_r(t)=\mathrm{LP}(A,b,c)LWr=​(t)=LP(A,b,c) with n=2rn=2rn=2r, m=3r−1m=3r-1m=3r−1, N=5r−1N=5r-1N=5r−1. Its wide neighborhood is written Nθ,t−∞\mathcal N^{-\infty}_{\theta,t}Nθ,t−∞​. A polygonal curve is a union [z0,z1]∪⋯∪[zp−1,zp][z^0,z^1]\cup\dots\cup[z^{p-1},z^p][z0,z1]∪⋯∪[zp−1,zp] of ppp segments, and it is contained in the neighborhood when every point of every segment is.

The milestones use the tropical semifield T=R∪{−∞}\mathbb T=\mathbb R\cup\{-\infty\}T=R∪{−∞} with a⊕b=max⁡(a,b)a\oplus b=\max(a,b)a⊕b=max(a,b) and a⊙b=a+ba\odot b=a+ba⊙b=a+b. The tropical segment tsegm(u,v)\mathsf{tsegm}(u,v)tsegm(u,v) is the set of points λ⊙u⊕μ⊙v\lambda\odot u\oplus\mu\odot vλ⊙u⊕μ⊙v with λ⊕μ=0\lambda\oplus\mu=0λ⊕μ=0. The Funk metric is δF(x,y)=max⁡(0,max⁡k(yk−xk))\delta_F(x,y)=\max(0,\max_k(y_k-x_k))δF​(x,y)=max(0,maxk​(yk​−xk​)), with d∞(x,y)=max⁡(δF(x,y),δF(y,x))d_\infty(x,y)=\max(\delta_F(x,y),\delta_F(y,x))d∞​(x,y)=max(δF​(x,y),δF​(y,x)) and the directed Hausdorff distance d∞(X,Y)=sup⁡x∈Xinf⁡y∈Yd∞(x,y)d_\infty(X,Y)=\sup_{x\in X}\inf_{y\in Y}d_\infty(x,y)d∞​(X,Y)=supx∈X​infy∈Y​d∞​(x,y). Finally, log⁡t\log_tlogt​ is applied coordinatewise, with log⁡t0=−∞\log_t0=-\inftylogt​0=−∞.

Formalization targets

Goal: Theorem 30 (p. 27)

Let r≥1r\ge1r≥1 and 0<θ<10<\theta<10<θ<1, and suppose that

t>(max⁡((10r−2)!, ((10r−1)!)24(1−θ)3))2r−1.(36)t>\Big(\max\Big((10r-2)!,\ \frac{((10r-1)!)^{24}}{(1-\theta)^3}\Big)\Big)^{2^{r-1}} .\tag{36}t>(max((10r−2)!, (1−θ)3((10r−1)!)24​))2r−1.(36)

If a polygonal curve [z0,z1]∪⋯∪[zp−1,zp][z^0,z^1]\cup\dots\cup[z^{p-1},z^p][z0,z1]∪⋯∪[zp−1,zp] is contained in Nθ,t−∞\mathcal N^{-\infty}_{\theta,t}Nθ,t−∞​ with μˉ(z0)≤1\bar\mu(z^0)\le1μˉ​(z0)≤1 and μˉ(zp)≥t2\bar\mu(z^p)\ge t^2μˉ​(zp)≥t2, then

p≥2r−1.p\ge2^{r-1}.p≥2r−1.

The threshold (36) is the paper's own explicit constant. Corollary 31 (Theorem B of the introduction) restates the result for algorithms. Any method whose iterates and the segments joining them stay in the wide neighborhood performs at least 2r−12^{r-1}2r−1 iterations to reduce the duality measure from t2t^2t2 to 111.

Milestones

  1. Proposition 1 (p. 5). On the primal-dual feasible set, μˉ((1−α)z+αz′)=(1−α)μˉ(z)+αμˉ(z′)\bar\mu((1-\alpha)z+\alpha z')=(1-\alpha)\bar\mu(z)+\alpha\bar\mu(z')μˉ​((1−α)z+αz′)=(1−α)μˉ​(z)+αμˉ​(z′) for all α∈R\alpha\in\mathbb Rα∈R.
  2. Lemma 5 (p. 10). For u≤vu\le vu≤v in Td\mathbb T^dTd, tsegm(u,v)\mathsf{tsegm}(u,v)tsegm(u,v) is a polygonal curve whose segments, oriented from uuu to vvv, have directions eK1,…,eKℓe^{K_1},\dots,e^{K_\ell}eK1​,…,eKℓ​ with K1⊊⋯⊊KℓK_1\subsetneq\dots\subsetneq K_\ellK1​⊊⋯⊊Kℓ​ and ℓ≤d\ell\le dℓ≤d.
  3. Lemma 8 (p. 11). For a segment S=[u,v]S=[u,v]S=[u,v] in R+d\mathbb R^d_+R+d​ and t>1t>1t>1,
d∞(tsegm(log⁡tu,log⁡tv), log⁡tS)≤log⁡t2.d_\infty\big(\mathsf{tsegm}(\log_tu,\log_tv),\ \log_tS\big)\le\log_t2 .d∞​(tsegm(logt​u,logt​v), logt​S)≤logt​2.
  1. Lemma 11 (p. 13). For a d×dd\times dd×d matrix M\mathbf MM with monomial entries ±tαij\pm t^{\alpha_{ij}}±tαij​ and t>1t>1t>1, log⁡t∣det⁡M(t)∣\log_t|\det\mathbf M(t)|logt​∣detM(t)∣ and val⁡(det⁡M)\operatorname{val}(\det\mathbf M)val(detM) differ by at most log⁡td!\log_td!logt​d!; the lower bound holds once t≥(d!)1/η(M)t\ge(d!)^{1/\eta(\mathbf M)}t≥(d!)1/η(M).
  2. Proposition 20 (p. 19). The explicit recursion for xλx^\lambdaxλ gives the greatest point of the tropical polyhedron {x∈P′:x1≤λ}\{x\in\mathcal P':x_1\le\lambda\}{x∈P′:x1​≤λ}, where P′⊆T2r\mathcal P'\subseteq\mathbb T^{2r}P′⊆T2r is cut out by the tropicalized constraints (26) of LWr\mathbf{LW}_rLWr​.

Significance

The theorem shows that the iteration count of a large class of primal-dual log-barrier interior point methods cannot be bounded by any function of rrr that grows more slowly than 2r−12^{r-1}2r−1, uniformly in the data. The class includes the methods of Kojima–Mizuno–Yoshise, Monteiro–Adler and Mizuno–Todd–Ye. No such method is strongly polynomial. The constraint matrix of LWr(t)\mathbf{LW}_r(t)LWr​(t) is fixed by rrr and ttt alone, so the bound concerns the combinatorial dimension, not the bit length. The only property of the method used is that its trajectory stays in Nθ,t−∞\mathcal N^{-\infty}_{\theta,t}Nθ,t−∞​. The lower bound therefore applies to every method with that property, whatever rule chooses its steps.

The result is proved in the paper; no machine-checked proof of it or of its tropical ingredients is known. A formalization would check the explicit threshold (36), which the paper derives in a few lines from bounds on Puiseux polyhedra. It would also produce reusable statements about tropical segments, the Funk and Hilbert metrics on Td\mathbb T^dTd, and determinants of monomial matrices.

Difficulty

Following the central path is not hard in principle: the obvious argument tracks the duality measure, which decreases by a constant factor per iteration in a neighborhood of the path. That argument gives only upper bounds. The lower bound requires showing that the neighborhood itself, for large ttt, is too thin to be crossed in a few straight steps, uniformly over every possible trajectory. The paper does this by passing to the limit t→∞t\to\inftyt→∞ on logarithmic scale. The image of Nθ,t−∞\mathcal N^{-\infty}_{\theta,t}Nθ,t−∞​ under log⁡t\log_tlogt​ collapses onto a piecewise-linear tropical central path, and a segment of R2N\mathbb R^{2N}R2N becomes, up to log⁡t2\log_t2logt​2, a tropical segment. The tropical central path of LWr\mathbf{LW}_rLWr​ then has to be shown to need 2r−12^{r-1}2r−1 tropical segments. The limit argument has to be made quantitative at a finite, explicit ttt. That is where the Puiseux-series machinery (Theorems 12, 15 and 19 of the paper) and the explicit constant enter.

Formalization scope

Everything is stated over R\mathbb RR and T\mathbb TT; the goal typechecks without the field of Puiseux series. A primal-dual point is an element of Rn×Rm×Rn×Rm\mathbb R^n\times\mathbb R^m\times\mathbb R^n\times\mathbb R^mRn×Rm×Rn×Rm. The dual equation is s−A⊤y=cs-A^\top y=cs−A⊤y=c with Mathlib's transpose, μˉ\bar\muμˉ​ divides by N=n+mN=n+mN=n+m (equal to 5r−15r-15r−1 for LWr=\mathbf{LW}^=_rLWr=​), and the wide neighborhood is one-sided. The instance matrix is generated from the paper's 1-based row and column numbers; Lean indices are 0-based. A polygonal curve is a map z:{0,…,p}→R2Nz:\{0,\dots,p\}\to\mathbb R^{2N}z:{0,…,p}→R2N with segment ℝ (z i) (z (i+1)) ⊆ N. The power 2r−12^{r-1}2r−1 in (36) is a natural-number power and the factorials are natural-number factorials. T\mathbb TT is WithBot ℝ, and distances that can be infinite take values in EReal, with the convention −∞+(+∞)=−∞-\infty+(+\infty)=-\infty−∞+(+∞)=−∞ encoded explicitly.

Two statements are repaired or restated. Lemma 11 is printed for all t>0t>0t>0, but its first inequality fails for 0<t<10<t<10<t<1 (for M=(t111)\mathbf M=\begin{pmatrix}t&1\\1&1\end{pmatrix}M=(t1​11​) at t=1/2t=1/2t=1/2), so it is stated for t>1t>1t>1. Lemma 8 makes explicit its implicit hypotheses t>1t>1t>1 and u,v≥0u,v\ge0u,v≥0. Proposition 20 is stated in the form its proof establishes, as the greatest point of a tropical polyhedron. Its identification with the valuation of the Puiseux central path is not part of the item. Monomial matrices are given by sign and exponent matrices, and the valuation of the determinant is computed from the permutation expansion.

A trivializing formalization is ruled out: Nθ,t−∞\mathcal N^{-\infty}_{\theta,t}Nθ,t−∞​ is not empty, since the build includes a sorry-free proof that it contains an explicit point for r=1r=1r=1, t=2t=2t=2, θ=1/2\theta=1/2θ=1/2. A curve with p=0p=0p=0 cannot satisfy both duality-measure conditions, since t2>1t^2>1t2>1.

The paper's Puiseux-series results are not posed: Theorems 12, 15, 19 and 29, Propositions 14, 16, 21 and 28, Corollary 17, and the count γ([0,2])≥2r−1\gamma([0,2])\ge2^{r-1}γ([0,2])≥2r−1 of §6.2. They need a faithful model of the field of absolutely convergent generalized Puiseux series and of the tropical central path. Contributions of that infrastructure, and of these statements as further milestones, are welcome. So are proofs of the five milestones, which need no Puiseux series. Proposition 1, Lemma 5 and Proposition 20 are elementary, and Lemma 8 and Lemma 11 are estimates with explicit constants.

Selected references

  • X. Allamigeon, P. Benchimol, S. Gaubert, M. Joswig, Log-barrier interior point methods are not strongly polynomial, SIAM J. Appl. Algebra Geom. 2(1), 2018; arXiv:1708.01544v2. https://arxiv.org/abs/1708.01544
  • A. Deza, T. Terlaky, Y. Zinchenko, Central path curvature and iteration-complexity for redundant Klee–Minty cubes, in Advances in Applied Mathematics and Global Optimization, Adv. Mech. Math. 17, Springer, 2009, pp. 223–256. https://doi.org/10.1007/978-0-387-75714-8
  • S. Smale, Mathematical problems for the next century, Math. Intelligencer 20(2), 1998, 7–15; reprinted in Mathematics: Frontiers and Perspectives, AMS, 2000. https://doi.org/10.1007/BF03025291
  • M. Develin, B. Sturmfels, Tropical convexity, Doc. Math. 9, 2004. https://arxiv.org/abs/math/0308254
  • S. J. Wright, Primal-Dual Interior-Point Methods, SIAM, 1997. https://doi.org/10.1137/1.9781611971453
  • X. Allamigeon, S. Gaubert, M. Skomra, Tropical spectrahedra, Discrete Comput. Geom. 63, 2020; arXiv:1610.06746. https://arxiv.org/abs/1610.06746
12 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations Research·Captain: mikedeng1

On the Power and Limitations of Affine Policies in Two-Stage Adaptive Optimization V: The Optimal First Stage over a Dominating Simplex Is a 4√m-ApproximationResearch Paper

Motivation

Two-stage adaptive optimization models decisions taken in two steps: a first-stage decision xxx is fixed before an uncertain right-hand side bbb is revealed, and a second-stage decision y(b)y(b)y(b) is chosen afterwards, with the worst case over an uncertainty set U\mathcal UU to be minimized. Problems of this form arise in capacity planning, network design and inventory control, where the first stage is an investment and the second stage a recourse. Computing the fully adaptable optimum is hard in general, so tractable restrictions are used in practice, most prominently affine policies y(b)=Pb+qy(b)=Pb+qy(b)=Pb+q (Ben-Tal, Goryashko, Guslitzer, Nemirovski, Math. Program. 2004).

Bertsimas and Goyal (Math. Program. Ser. A, DOI 10.1007/s10107-011-0444-4) characterize how well affine policies perform. Their Section 5 shows a factor O(m)O(\sqrt m)O(m​) when the first-stage matrix satisfies A≥0A\ge 0A≥0. Section 6, the subject of this mission, drops the sign condition on AAA: it constructs, from U\mathcal UU, a polytope U0\mathcal U^0U0 with at most m+1m+1m+1 vertices that dominates U\mathcal UU, and shows that an optimal first stage for U0\mathcal U^0U0 is a 4m4\sqrt m4m​-approximate first stage for the original problem.

Timeline. Ben-Tal et al. (2004) introduced affinely adjustable robust counterparts. Bertsimas, Iancu and Parrilo (Math. Oper. Res. 2010) proved optimality of affine policies for one-dimensional multistage problems. Bertsimas and Goyal (Math. Oper. Res. 2010) analysed static robust solutions for two-stage problems. The present paper (received 2009, published 2011) gives the Θ(m1/2)\Theta(m^{1/2})Θ(m1/2) picture for affine policies and the general-case first-stage approximation formalized here.

Setting

Fix matrices A∈Rm×n1A\in\mathbb R^{m\times n_1}A∈Rm×n1​, B∈Rm×n2B\in\mathbb R^{m\times n_2}B∈Rm×n2​ and cost vectors c∈R+n1c\in\mathbb R^{n_1}_+c∈R+n1​​, d∈R+n2d\in\mathbb R^{n_2}_+d∈R+n2​​. The uncertainty set U⊆R+m\mathcal U\subseteq\mathbb R^m_+U⊆R+m​ is convex, compact and full-dimensional. A feasible solution of ΠAdapt(U)\Pi_{Adapt}(\mathcal U)ΠAdapt​(U) is a pair (x,y)(x,y)(x,y) with x≥0x\ge0x≥0 and, for every b∈Ub\in\mathcal Ub∈U, y(b)≥0y(b)\ge0y(b)≥0 and Ax+By(b)≥bAx+By(b)\ge bAx+By(b)≥b, componentwise. Its worst-case cost is sup⁡b∈U cTx+dTy(b)\sup_{b\in\mathcal U}\, c^Tx+d^Ty(b)supb∈U​cTx+dTy(b), and the fully adaptable optimum is

zAdapt(U)=inf⁡(x,y) feasible sup⁡b∈U cTx+dTy(b).z_{Adapt}(\mathcal U)=\inf_{(x,y)\ \text{feasible}}\ \sup_{b\in\mathcal U}\ c^Tx+d^Ty(b).zAdapt​(U)=(x,y) feasibleinf​ b∈Usup​ cTx+dTy(b).

An optimal solution attains this value.

For j=1,…,mj=1,\dots,mj=1,…,m let μj=max⁡{bj:b∈U}\mu_j=\max\{b_j: b\in\mathcal U\}μj​=max{bj​:b∈U} and let βj∈U\beta^j\in\mathcal Uβj∈U be a maximizer, βjj=μj\beta^j_j=\mu_jβjj​=μj​ (display (38)). Algorithm A\mathcal AA (Fig. 1 of the paper) starts with the index set J1={1,…,m}J_1=\{1,\dots,m\}J1​={1,…,m}; while some b∈Ub\in\mathcal Ub∈U has ∑j∈J1bj/μj>m\sum_{j\in J_1}b_j/\mu_j>\sqrt m∑j∈J1​​bj​/μj​>m​, it picks a maximizer uku^kuk of that scaled sum over U\mathcal UU, adds uku^kuk to a running total on the coordinates of J1J_1J1​, and removes from J1J_1J1​ every coordinate whose total has reached μj\mu_jμj​. It stops after KKK iterations and returns β=u1+⋯+uK\beta=u^1+\dots+u^Kβ=u1+⋯+uK. The dominating set is

U0=conv⁡{2m⋅β1,…,2m⋅βm, 2β}.(66)\mathcal U^0=\operatorname{conv}\{2\sqrt m\cdot\beta^1,\dots,2\sqrt m\cdot\beta^m,\ 2\beta\}.\tag{66}U0=conv{2m​⋅β1,…,2m​⋅βm, 2β}.(66)

Formalization targets

Goal: Theorem 6

For every run of Algorithm A\mathcal AA, every choice of the maximizers βj\beta^jβj, and every optimal solution (x~,y~)(\tilde x,\tilde y)(x~,y~​) of ΠAdapt(U0)\Pi_{Adapt}(\mathcal U^0)ΠAdapt​(U0),

∀b∈U  ∃y≥0:Ax~+By≥b,cTx~+dTy≤4m⋅zAdapt(U).\forall b\in\mathcal U\ \ \exists y\ge 0:\quad A\tilde x+By\ge b,\qquad c^T\tilde x+d^Ty\le 4\sqrt m\cdot z_{Adapt}(\mathcal U).∀b∈U  ∃y≥0:Ax~+By≥b,cTx~+dTy≤4m​⋅zAdapt​(U).

The page states the factor as O(m)O(\sqrt m)O(m​); 4m4\sqrt m4m​ is the constant its proof establishes.

Milestones

  1. Lemma 12. U0\mathcal U^0U0 dominates U\mathcal UU: every b∈Ub\in\mathcal Ub∈U has some b′∈U0b'\in\mathcal U^0b′∈U0 with b≤b′b\le b'b≤b′.
  2. Lemma 13 (inequality). ΠAdapt(U0)\Pi_{Adapt}(\mathcal U^0)ΠAdapt​(U0) is feasible with finite worst-case cost, and
zAdapt(U0)≤4m⋅zAdapt(U).z_{Adapt}(\mathcal U^0)\le 4\sqrt m\cdot z_{Adapt}(\mathcal U).zAdapt​(U0)≤4m​⋅zAdapt​(U).
  1. The domination claim in the proof of Theorem 6. If VVV dominates WWW and (x~,y~)(\tilde x,\tilde y)(x~,y~​) is optimal for ΠAdapt(V)\Pi_{Adapt}(V)ΠAdapt​(V) with finite worst-case cost, then every b∈Wb\in Wb∈W can be served from x~\tilde xx~ at cost at most zAdapt(V)z_{Adapt}(V)zAdapt​(V).

Significance

The result gives a first-stage decision with a guarantee of order m\sqrt mm​ for two-stage problems with an arbitrary first-stage matrix, a setting where the affine-policy analysis of Section 5 does not apply. The decision is obtained from a problem whose uncertainty set has at most m+1m+1m+1 extreme points, so it reduces an adaptive problem over a general convex set to one over a polytope with few vertices. Together with the paper's lower bounds (Theorems 2 and 3, Ω(m1/2−δ)\Omega(m^{1/2-\delta})Ω(m1/2−δ) for affine policies), it places the general-case approximability of the first stage at the same order as the affine-policy gap.

The result is proved in the paper. It has no machine-checked proof that we know of. The formalization produces, beyond the theorem itself, an encoding of model (1) with values that are honest infima, a relational encoding of Algorithm A\mathcal AA usable for its termination and output properties, and a reusable domination lemma for two-stage problems. Mission IV of this series (the case A≥0A\ge0A≥0) formalizes Lemmas 9 and 10 on Algorithm A\mathcal AA, which the proofs here use.

Difficulty

The obvious argument replaces U\mathcal UU by a simple set that contains or dominates it, such as the box ∏j[0,μj]\prod_j[0,\mu_j]∏j​[0,μj​], and solves over that set. This loses a factor mmm, not m\sqrt mm​: for U=conv⁡{0,e1,…,em}\mathcal U=\operatorname{conv}\{0,e_1,\dots,e_m\}U=conv{0,e1​,…,em​} with A=0A=0A=0, B=IB=IB=I, c=0c=0c=0, d=ed=ed=e, the optimum over U\mathcal UU is 111 while the optimum over the box is mmm. A dominating set with few vertices whose cost is only O(m)O(\sqrt m)O(m​) times the original optimum has to be built from U\mathcal UU itself, and controlling the cost of its vertex 2β2\beta2β depends on the number KKK of iterations of Algorithm A\mathcal AA, which is bounded only through the potential argument of Lemma 10 in the paper.

A second difficulty is that zAdaptz_{Adapt}zAdapt​ is an infimum, not an attained minimum, over second-stage rules that are arbitrary functions; the cost comparison must work from near-optimal solutions of ΠAdapt(U)\Pi_{Adapt}(\mathcal U)ΠAdapt​(U).

Formalization scope

Vectors are functions on Fin m, matrices are Matrix (Fin m) (Fin n) ℝ, and inequalities between vectors are componentwise. The paper's coordinate jjj is Fin index j−1j-1j−1. zAdapt(U)z_{Adapt}(\mathcal U)zAdapt​(U) is the infimum of the set of bounds ttt such that some feasible (x,y)(x,y)(x,y) satisfies cTx+dTy(b)≤tc^Tx+d^Ty(b)\le tcTx+dTy(b)≤t for all b∈Ub\in\mathcal Ub∈U; this avoids a real supremum of a possibly unbounded worst case. An optimal solution is a feasible one that achieves every achievable bound. μ\muμ and the maximizers βj\beta^jβj enter the theorems as data with their defining properties. Algorithm A\mathcal AA is a relation on a choice sequence u1,u2,…u^1,u^2,\dotsu1,u2,…: the theorems hold for every run and every choice of maximizers, never for "some simplex dominating U\mathcal UU".

Standing assumptions of (1) carried by the goal and Lemma 13: c≥0c\ge0c≥0, d≥0d\ge0d≥0, U⊆R+m\mathcal U\subseteq\mathbb R^m_+U⊆R+m​ convex, compact and with nonempty interior, and (1) feasible. There is no sign condition on AAA. Lemma 12 keeps only nonnegativity and full-dimensionality of U\mathcal UU; the domination claim is stated for arbitrary scenario sets VVV and WWW with VVV dominating WWW and assumes that the optimal solution over VVV has a finite worst-case cost.

The printed Lemma 13 also asserts zAff(U0)=zAdapt(U0)z_{Aff}(\mathcal U^0)=z_{Adapt}(\mathcal U^0)zAff​(U0)=zAdapt​(U0) on the grounds that U0\mathcal U^0U0 is a simplex. Its m+1m+1m+1 generators need not be affinely independent, so this equality is not part of the mission; Theorem 6 does not use it.

A bound on zAdapt(U0)z_{Adapt}(\mathcal U^0)zAdapt​(U0) alone is not the goal: the goal requires, for each scenario of the original set U\mathcal UU, a feasible second stage completing the fixed first stage x~\tilde xx~ at the stated cost. Lemma 13 also asserts feasibility over U0\mathcal U^0U0 with a finite bound, so its inequality cannot hold through the value of an infimum over an empty set.

A complete development needs elementary facts about convex hulls of finitely many points (representation by convex weights), the properties of Algorithm A\mathcal AA (its output bound and termination, Lemmas 9 and 10 of the paper), and ε\varepsilonε-approximation arguments for infima. The encoding of model (1) and of Algorithm A\mathcal AA is shared with the other missions of this series. Contributions of these supporting lemmas are welcome.

Selected references

  • D. Bertsimas, V. Goyal, On the power and limitations of affine policies in two-stage adaptive optimization, Math. Program. Ser. A, 2011. https://doi.org/10.1007/s10107-011-0444-4
  • A. Ben-Tal, A. Goryashko, E. Guslitzer, A. Nemirovski, Adjustable robust solutions of uncertain linear programs, Math. Program. 99, 2004. https://doi.org/10.1007/s10107-003-0454-y
  • D. Bertsimas, D. A. Iancu, P. A. Parrilo, Optimality of affine policies in multistage robust optimization, Math. Oper. Res. 35, 2010. https://doi.org/10.1287/moor.1100.0444
  • D. Bertsimas, V. Goyal, On the power of robust solutions in two-stage stochastic and adaptive optimization problems, Math. Oper. Res. 35, 2010. https://doi.org/10.1287/moor.1090.0440
7 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations Research·Captain: mikedeng1

On the Power and Limitations of Affine Policies in Two-Stage Adaptive Optimization III: The Best Affine Policy Can Cost More Than m^(1/2−δ)/4 Times the Fully Adaptable OptimumResearch Paper

Motivation

Two-stage adaptive optimization models decisions taken in two steps: a first-stage decision xxx is fixed before an uncertain right-hand side bbb is revealed, and a second-stage recourse y(b)y(b)y(b) is chosen afterwards, with the worst case over an uncertainty set U\mathcal UU to be minimized. The fully-adaptable problem, in which yyy may be an arbitrary function of bbb, is intractable in general. The standard tractable restriction, introduced by Ben-Tal, Goryashko, Guslitzer and Nemirovski (2004), requires yyy to be an affine policy y(b)=Pb+qy(b)=Pb+qy(b)=Pb+q; it turns the problem into a single convex program and is used throughout robust inventory, network design and energy planning.

How much is lost by this restriction? Bertsimas and Goyal (Math. Program. 2012) answer the question for problems with a nonnegative constraint matrix. On one side, affine policies are optimal when U\mathcal UU is a simplex, and are within a factor O(m)O(\sqrt m)O(m​) of the optimum on every instance of the class, where mmm is the number of constraints. On the other side, the bound is nearly tight: Section 4 of the paper constructs an instance on which the best affine policy costs Ω(m1/2−δ)\Omega(m^{1/2-\delta})Ω(m1/2−δ) times the fully-adaptable optimum, for any δ>0\delta>0δ>0. This mission formalizes that lower bound.

Timeline: Ben-Tal et al. (2004) propose affinely adjustable robust counterparts; Bertsimas, Iancu and Parrilo (2010) prove optimality of affine policies for one-dimensional multistage problems; Bertsimas and Goyal (2012) give the O(m)O(\sqrt m)O(m​) upper bound and the matching lower-bound example formalized here.

Setting

The two-stage problem ΠAdapt(U)\Pi_{\mathrm{Adapt}}(\mathcal U)ΠAdapt​(U) has data A∈Rm×n1A\in\mathbb R^{m\times n_1}A∈Rm×n1​, B∈Rm×n2B\in\mathbb R^{m\times n_2}B∈Rm×n2​, c∈R+n1c\in\mathbb R^{n_1}_+c∈R+n1​​, d∈R+n2d\in\mathbb R^{n_2}_+d∈R+n2​​ and U⊆R+m\mathcal U\subseteq\mathbb R^m_+U⊆R+m​:

zAdapt(U)=min⁡x, y(⋅) c⊤x+max⁡b∈Ud⊤y(b)s.t.Ax+By(b)≥b, x≥0, y(b)≥0  ∀b∈U.z_{\mathrm{Adapt}}(\mathcal U)=\min_{x,\,y(\cdot)}\ c^\top x+\max_{b\in\mathcal U}d^\top y(b)\quad\text{s.t.}\quad Ax+By(b)\ge b,\ x\ge0,\ y(b)\ge0\ \ \forall b\in\mathcal U .zAdapt​(U)=x,y(⋅)min​ c⊤x+b∈Umax​d⊤y(b)s.t.Ax+By(b)≥b, x≥0, y(b)≥0  ∀b∈U.

The value zAff(U)z_{\mathrm{Aff}}(\mathcal U)zAff​(U) is the same minimum over policies of the form y(b)=Pb+qy(b)=Pb+qy(b)=Pb+q; such a policy must be nonnegative on all of U\mathcal UU.

The large-gap instance I\mathcal II of display (19) has n1=n2=mn_1=n_2=mn1​=n2​=m, a parameter δ>0\delta>0δ>0 with mδ>200m^\delta>200mδ>200 (condition (18)), and

θ0=1m(1−δ)/2,r=⌈m1−δ⌉,\theta_0=\frac{1}{m^{(1-\delta)/2}},\qquad r=\lceil m^{1-\delta}\rceil,θ0​=m(1−δ)/21​,r=⌈m1−δ⌉, c=0,d=e=(1,…,1)⊤,A=0,Bij={1,i=j,θ0,i≠j,c=0,\quad d=e=(1,\dots,1)^\top,\quad A=0,\quad B_{ij}=\begin{cases}1,&i=j,\\ \theta_0,&i\ne j,\end{cases}c=0,d=e=(1,…,1)⊤,A=0,Bij​={1,θ0​,​i=j,i=j,​ U=conv⁡({0, e1,…,em, 1me}∪{θ01S: ∣S∣=r}),\mathcal U=\operatorname{conv}\Bigl(\{0,\ e_1,\dots,e_m,\ \tfrac{1}{\sqrt m}e\}\cup\{\theta_0\mathbf 1_S:\ |S|=r\}\Bigr),U=conv({0, e1​,…,em​, m​1​e}∪{θ0​1S​: ∣S∣=r}),

where eje_jej​ are the unit vectors and 1S\mathbf 1_S1S​ is the indicator vector of a set SSS of coordinates. A permutation σ\sigmaσ of the coordinates acts on vectors by bσ=(bσ(1),…,bσ(m))b^\sigma=(b_{\sigma(1)},\dots,b_{\sigma(m)})bσ=(bσ(1)​,…,bσ(m)​) and on matrices by Pijσ=Pσ(i),σ(j)P^\sigma_{ij}=P_{\sigma(i),\sigma(j)}Pijσ​=Pσ(i),σ(j)​.

Formalization targets

Goal: Theorem 3, explicit form

zAff(U)>m1/2−δ4⋅zAdapt(U)for all δ>0 and m with mδ>200.z_{\mathrm{Aff}}(\mathcal U)>\frac{m^{1/2-\delta}}{4}\cdot z_{\mathrm{Adapt}}(\mathcal U)\qquad\text{for all }\delta>0\text{ and }m\text{ with }m^\delta>200 .zAff​(U)>4m1/2−δ​⋅zAdapt​(U)for all δ>0 and m with mδ>200.

The paper writes zAff(U)=Ω(m1/2−δ)⋅zAdapt(U)z_{\mathrm{Aff}}(\mathcal U)=\Omega(m^{1/2-\delta})\cdot z_{\mathrm{Adapt}}(\mathcal U)zAff​(U)=Ω(m1/2−δ)⋅zAdapt​(U); the constant 1/41/41/4 is the one the proof establishes, so the explicit statement is the stronger one.

Milestones

  1. Lemma 4: zAdapt(U)≤1z_{\mathrm{Adapt}}(\mathcal U)\le1zAdapt​(U)≤1, with a feasible solution attaining cost at most 111.
  2. Lemma 5: U\mathcal UU is permutation-invariant under every σ∈Sm\sigma\in S^mσ∈Sm.
  3. Lemma 6: the permuted instance I(σ)\mathcal I(\sigma)I(σ) of (22) equals I\mathcal II.
  4. Lemma 7: if y(b)=Pb+qy(b)=Pb+qy(b)=Pb+q is an optimal affine solution, so is yσ(b)=Pσb+qσy^\sigma(b)=P^\sigma b+q^\sigmayσ(b)=Pσb+qσ.
  5. Lemma 8: some optimal affine solution has P^ij=μ\hat P_{ij}=\muP^ij​=μ (i≠ji\ne ji=j), P^jj=θ\hat P_{jj}=\thetaP^jj​=θ, q^j=λ\hat q_j=\lambdaq^​j​=λ.
  6. The three Claims of the proof of Theorem 3: for a symmetric feasible affine policy with worst-case cost at most m1/2−δ/4m^{1/2-\delta}/4m1/2−δ/4, one has 0≤λ≤m−1/2−δ0\le\lambda\le m^{-1/2-\delta}0≤λ≤m−1/2−δ, θ≥1/3\theta\ge1/3θ≥1/3, and −m−1−δ/2≤μ<0-m^{-1-\delta/2}\le\mu<0−m−1−δ/2≤μ<0.

Significance

The result shows that the O(m)O(\sqrt m)O(m​) approximation guarantee for affine policies on problems with A≥0A\ge0A≥0 (Theorem 4 of the same paper) cannot be improved beyond a factor mδm^{\delta}mδ, so the uncertainty set that looks like a portion of the unit sphere in the nonnegative orthant is essentially the worst case for affine recourse. It also explains why later work moved to piecewise-affine and finitely adaptable policies to close the gap. The example satisfies c,d≥0c,d\ge0c,d≥0, A,B≥0A,B\ge0A,B≥0 and U⊆R+m\mathcal U\subseteq\mathbb R^m_+U⊆R+m​, so the lower bound applies to every larger problem class.

The theorem is proved in the paper; to our knowledge no machine-checked version exists. A formalization adds checked statements of the symmetrization argument (an optimal affine policy may be taken invariant under the symmetry group of the instance), which applies to any symmetric robust linear program, and a checked derivation of the explicit constant.

Difficulty

The upper bound zAdapt≤1z_{\mathrm{Adapt}}\le1zAdapt​≤1 is a direct construction. The difficulty lies in the lower bound on zAffz_{\mathrm{Aff}}zAff​, which must hold for every affine policy, a family with m2+mm^2+mm2+m free parameters. Bounding the cost of a policy at a few chosen points of U\mathcal UU does not suffice without first reducing the parameters, and the reduction requires that an optimal affine solution exists (attainment of the minimum over an unbounded parameter set) and that averaging over the symmetric group preserves both feasibility and optimality. The remaining argument balances three different generators of U\mathcal UU against each other, and the exponents of mmm must be tracked exactly through ceilings and real powers.

Formalization scope

Vectors are Fin m → ℝ with the componentwise order and 0-based indices; matrices are Matrix (Fin m) (Fin m) ℝ. The values zAdaptz_{\mathrm{Adapt}}zAdapt​ and zAffz_{\mathrm{Aff}}zAff​ are infima of the sets of worst-case cost bounds achieved by feasible solutions (epigraph form), so they do not rely on a supremum of a possibly unbounded function. Affine policies must be nonnegative on U\mathcal UU. Optimal solutions are defined as feasible solutions whose worst-case cost is bounded by every achievable bound, so Lemma 8 asserts attainment. Powers mam^{a}ma are real powers; θ0=1/m(1−δ)/2\theta_0=1/m^{(1-\delta)/2}θ0​=1/m(1−δ)/2 and r=⌈m1−δ⌉r=\lceil m^{1-\delta}\rceilr=⌈m1−δ⌉ exactly as on the page. U\mathcal UU is the convex hull of its listed generators; the generator count NNN printed in (19) plays no role.

The parameter δ\deltaδ is not restricted beyond δ>0\delta>0δ>0 and mδ>200m^\delta>200mδ>200, as in the paper. Lemma 4's proof on the page uses δ≤1\delta\le1δ≤1; the statement is kept for all δ>0\delta>0δ>0, where it remains true with a different witness. The Claims are stated for any symmetric feasible affine policy with cost at most m1/2−δ/4m^{1/2-\delta}/4m1/2−δ/4; their hypotheses are jointly unsatisfiable by Theorem 3, which is inherent in steps of a proof by contradiction.

A trivializing formalization is excluded: the goal mentions only the instance data and the two optimal values, not the symmetric parameters μ,θ,λ\mu,\theta,\lambdaμ,θ,λ, and the nonemptiness of the feasible sets is established by Lemma 4 and by the existence of a feasible affine policy, so neither value is a junk infimum of an empty set.

A complete development needs: convex hulls of finite point sets in Rm\mathbb R^mRm and their extreme points; the action of SmS^mSm by coordinate permutation; averaging over the finite group SmS^mSm; and existence of minimizers for linear programs over a polytope. The symmetrization lemmas (5–8) are reusable for other symmetric robust problems. Proofs of any milestone, including partial infrastructure for linear-programming attainment, are welcome.

Selected references

  • D. Bertsimas, V. Goyal, On the power and limitations of affine policies in two-stage adaptive optimization, Mathematical Programming Ser. A 134 (2012) 491–531. https://doi.org/10.1007/s10107-011-0444-4
  • A. Ben-Tal, A. Goryashko, E. Guslitzer, A. Nemirovski, Adjustable robust solutions of uncertain linear programs, Mathematical Programming 99 (2004) 351–376. https://doi.org/10.1007/s10107-003-0454-y
  • D. Bertsimas, D. A. Iancu, P. A. Parrilo, Optimality of affine policies in multistage robust optimization, Mathematics of Operations Research 35 (2010) 363–394. https://doi.org/10.1287/moor.1100.0444
12 thms2 active usersReviewed
🏆Completed
Control TheoryDynamic ProgrammingOperations Research·Captain: mikedeng1

Optimality of Affine Policies in Multistage Robust Optimization: In One-Dimensional Constrained Min-Max Control, Disturbance-Affine Policies with Affine Stage Costs Attain the Optimal ValueResearch Paper

Motivation

Multistage robust optimization chooses decisions over time while an adversary picks the uncertain data from a known set; every later decision may react to what has been observed. The exact problem is a nested min-max over functions of the past, and is intractable in general. The standard workaround, proposed by Ben-Tal, Goryashko, Guslitzer and Nemirovski (Math. Program. 2004), restricts every decision to an affine function of the observed disturbances. The restricted problem is a single convex (often linear) program, which is why disturbance-affine policies are used throughout robust control, inventory management and model predictive control. The price is suboptimality, and before this paper there was no nontrivial multistage problem in which that price was known to be zero.

Bertsimas, Iancu and Parrilo (arXiv:0904.3986, 2009; Math. Oper. Res. 35(2), 2010) proved that for one-dimensional linear dynamics with box constraints on controls and disturbances, linear control costs and convex state costs, disturbance-affine policies are exactly optimal. Their companion paper (Bertsimas & Goyal, Math. Program. 2012) shows how poorly affine policies can perform in other settings, so the one-dimensional result marks one side of the boundary between models where affine policies are exact and models where they are not.

Setting

Fix a horizon TTT and an initial state x1∈Rx_1\in\mathbb Rx1​∈R. For each stage k=1,…,Tk=1,\dots,Tk=1,…,T there are a per-unit control cost ck≥0c_k\ge0ck​≥0, control bounds Lk≤UkL_k\le U_kLk​≤Uk​, disturbance bounds w‾k≤w‾k\underline w_k\le\overline w_kw​k​≤wk​, and a state cost hk:R→Rh_k:\mathbb R\to\mathbb Rhk​:R→R that is convex and coercive. The state evolves as

xk+1=xk+uk+wk,uk∈[Lk,Uk],wk∈Wk=[w‾k,w‾k].x_{k+1}=x_k+u_k+w_k,\qquad u_k\in[L_k,U_k],\qquad w_k\in\mathcal W_k=[\underline w_k,\overline w_k].xk+1​=xk​+uk​+wk​,uk​∈[Lk​,Uk​],wk​∈Wk​=[w​k​,wk​].

The controller chooses uku_kuk​ after seeing xkx_kxk​; the adversary then chooses wkw_kwk​. The min-max value JmMJ_{mM}JmM​ is the value of the nested problem min⁡u1[c1u1+max⁡w1[h1(x2)+min⁡u2[⋯ ]]]\min_{u_1}[c_1u_1+\max_{w_1}[h_1(x_2)+\min_{u_2}[\cdots]]]minu1​​[c1​u1​+maxw1​​[h1​(x2​)+minu2​​[⋯]]], computed by the Bellman recursion with JT+1∗≡0J^*_{T+1}\equiv0JT+1∗​≡0:

gk(y)=max⁡w∈Wk[hk(y+w)+Jk+1∗(y+w)],Jk∗(x)=min⁡Lk≤u≤Uk[cku+gk(x+u)],JmM=J1∗(x1).g_k(y)=\max_{w\in\mathcal W_k}\big[h_k(y+w)+J^*_{k+1}(y+w)\big],\qquad J^*_k(x)=\min_{L_k\le u\le U_k}\big[c_ku+g_k(x+u)\big],\qquad J_{mM}=J^*_1(x_1).gk​(y)=w∈Wk​max​[hk​(y+w)+Jk+1∗​(y+w)],Jk∗​(x)=Lk​≤u≤Uk​min​[ck​u+gk​(x+u)],JmM​=J1∗​(x1​).

An affine control policy and an affine running cost at stage kkk are

qk(w)=qk,0+∑t=1k−1qk,twt,zk(w)=zk,0+∑t=1kzk,twt,q_k(w)=q_{k,0}+\sum_{t=1}^{k-1}q_{k,t}w_t,\qquad z_k(w)=z_{k,0}+\sum_{t=1}^{k}z_{k,t}w_t,qk​(w)=qk,0​+t=1∑k−1​qk,t​wt​,zk​(w)=zk,0​+t=1∑k​zk,t​wt​,

so qkq_kqk​ sees the disturbances before stage kkk and zkz_kzk​ those up to stage kkk. Under these policies the state after stage kkk is x1+∑t≤k(qt(w)+wt)x_1+\sum_{t\le k}(q_t(w)+w_t)x1​+∑t≤k​(qt​(w)+wt​).

Formalization targets

Goal: Theorem 3.1

There exist affine policies qkq_kqk​ and affine costs zkz_kzk​ such that, for every k=1,…,Tk=1,\dots,Tk=1,…,T,

Lk≤qk(w)≤Uk∀w∈W1×⋯×Wk−1,L_k\le q_k(w)\le U_k\quad\forall w\in\mathcal W_1\times\dots\times\mathcal W_{k-1},Lk​≤qk​(w)≤Uk​∀w∈W1​×⋯×Wk−1​, zk(w)≥hk(x1+∑t=1k(qt(w)+wt))∀w∈W1×⋯×Wk,z_k(w)\ge h_k\Big(x_1+\sum_{t=1}^k(q_t(w)+w_t)\Big)\quad\forall w\in\mathcal W_1\times\dots\times\mathcal W_k,zk​(w)≥hk​(x1​+t=1∑k​(qt​(w)+wt​))∀w∈W1​×⋯×Wk​, JmM=max⁡w1,…,wk[∑t=1k(ctqt(w)+zt(w))+Jk+1∗(x1+∑t=1k(qt(w)+wt))].J_{mM}=\max_{w_1,\dots,w_k}\Big[\sum_{t=1}^k\big(c_tq_t(w)+z_t(w)\big)+J^*_{k+1}\Big(x_1+\sum_{t=1}^k(q_t(w)+w_t)\Big)\Big].JmM​=w1​,…,wk​max​[t=1∑k​(ct​qt​(w)+zt​(w))+Jk+1∗​(x1​+t=1∑k​(qt​(w)+wt​))].

At k=Tk=Tk=T this says that affine policies are robustly feasible and attain the min-max value.

Milestones

  1. Lemma 7.1 (with (8)–(9), P2): Jk∗J^*_kJk∗​ and gkg_kgk​ are convex, and the optimal control is the clamp max⁡(Lk,min⁡(Uk,y∗−x))\max(L_k,\min(U_k,y^*-x))max(Lk​,min(Uk​,y∗−x)) for a minimizer y∗y^*y∗ of cky+gk(y)c_ky+g_k(y)ck​y+gk​(y).
  2. P3: the clamp is non-increasing and 1-Lipschitz.
  3. Lemma 4.1: the maximum of θ1+f(θ2)\theta_1+f(\theta_2)θ1​+f(θ2​), fff convex, over a planar zonogon Θ=π([0,1]k)\Theta=\pi([0,1]^k)Θ=π([0,1]k) is attained at one of the k+1k+1k+1 vertices on its right side.
  4. Corollary 4.1: the maximum of θ1+f(θ2)\theta_1+f(\theta_2)θ1​+f(θ2​) is unchanged when a polygon is replaced by its convex hull, its vertex set, its right side, or the zonogon hull of its vertices.
  5. Lemma 4.2: after the optimal control is applied, the worst case is reached on the right side of conv⁡{v~0,…,v~k}\operatorname{conv}\{\tilde v_0,\dots,\tilde v_k\}conv{v~0​,…,v~k​}.
  6. Lemma 4.4: the matching-and-alignment system (37) defining the affine controller is feasible, and its solutions satisfy −bi≤qi≤0-b_i\le q_i\le0−bi​≤qi​≤0 and L≤q(w)≤UL\le q(w)\le UL≤q(w)≤U.
  7. Lemma 4.8 and Lemma 4.9: the affine cost defined by system (51)–(53) dominates the convex cost, first at the hypercube vertices, then on the whole hypercube.

Significance

The theorem is one of the few exact optimality results for affine policies in multistage robust optimization. Combined with linear programming duality it has a computational corollary: when the hkh_khk​ are piecewise affine, an optimal policy for the full min-max problem is obtained from a single linear program (the affinely adjustable robust counterpart, p. 5), instead of a dynamic program over a continuous state. The construction also shows what is special about one dimension: the relevant uncertainty enters only through a planar zonogon, whose right side has at most k+1k+1k+1 vertices, matching the k+1k+1k+1 coefficients of an affine policy.

The result is proved in the literature, not formalized; no machine-checked proof of it, or of the zonogon lemmas it uses, is known. The formalization adds a checked proof of the main theorem and of the planar convexity facts (Lemma 4.1, Corollary 4.1) that are reusable for other zonotope arguments. It also closes the gaps the preprint leaves to the reader: Assumption 2 is removed by an infinitesimal perturbation argument, footnote 4 assumes a unique minimizer of cky+gk(y)c_ky+g_k(y)ck​y+gk​(y), and Lemma 4.3 is proved in one sub-case only.

Difficulty

Dynamic programming gives the optimal control as a function of the current state, uk∗(xk)u^*_k(x_k)uk∗​(xk​), which is piecewise affine in xkx_kxk​ with up to three pieces. Since xkx_kxk​ is affine in past disturbances, the obvious idea is to substitute; but the composition is piecewise affine, not affine, in the disturbances, and no single affine function reproduces it. An affine policy is necessarily suboptimal at some disturbance sequences. The theorem asserts only that it is never suboptimal at the worst case, and that the excess cost it causes can be absorbed into an affine cost zkz_kzk​ that still dominates hkh_khk​. Establishing this requires controlling where a convex objective is maximized over a zonogon, and showing that the affine controller and the affine cost can be chosen to reproduce exactly the right-side vertices that matter, at every stage, while staying feasible. A naive matching of all 2k2^k2k vertices of the disturbance box is overdetermined.

Formalization scope

Stages are indexed by Fin T (0-based). The model is the reduced form (DP) of §2, with dynamics coefficients equal to 1; the paper notes that this is without loss of generality. The standing hypotheses are those of Problem 1.1 (ck≥0c_k\ge0ck​≥0, hkh_khk​ convex and coercive) plus two disclosed additions, Lk≤UkL_k\le U_kLk​≤Uk​ and w‾k≤w‾k\underline w_k\le\overline w_kw​k​≤wk​: the page writes both as intervals but does not say they are nonempty. Jk∗J^*_kJk∗​ is defined by the Bellman recursion with sSup/sInf over images of nonempty compact intervals of continuous functions, so the values are attained maxima and minima. The max in (14) is stated with IsGreatest, which asserts attainment.

The goal carries none of the proof's normalizations (Assumptions 1–3 of p. 10, the unique minimizer of footnote 4). The milestones of §4 are stated in the paper's simplified notation: the unit hypercube, generators ordered as in (32) (cross-multiplied), the clamp form of the optimal control law (the printed (8) has misprinted thresholds), and, where the paper divides by bib_ibi​, the hypothesis bi>0b_i>0bi​>0. Lemma 4.4 takes Lemma 4.3's conclusions as hypotheses; Lemmas 4.8–4.9 take system (51)–(53) (with two misprints of (53) corrected) as hypotheses instead of "computed by Algorithm 2". Every fraction in a system is cross-multiplied.

Trivializing formalizations are ruled out. (14) uses a maximum over a nonempty box of a continuous function, with the true Jk+1∗J^*_{k+1}Jk+1∗​. The policies read only past disturbances (sums over t<kt<kt<k, resp. t≤kt\le kt≤k). JmMJ_{mM}JmM​ is the Bellman value over all state-feedback controls, not the value of the affine problem.

The development needs convexity of value functions under partial minimization and maximization, extreme points of planar polygons, and maxima of convex functions over polytopes. Contributions of independent planar-geometry lemmas are welcome, as are proofs of Lemma 4.3 (not stated here) and of the remaining construction lemmas 4.5–4.7.

Selected references

  • D. Bertsimas, D. A. Iancu, P. A. Parrilo, Optimality of Affine Policies in Multi-stage Robust Optimization, arXiv:0904.3986v1, 2009; Mathematics of Operations Research 35(2):363–394, 2010. https://arxiv.org/abs/0904.3986, https://doi.org/10.1287/moor.1100.0444
  • A. Ben-Tal, A. Goryashko, E. Guslitzer, A. Nemirovski, Adjustable robust solutions of uncertain linear programs, Mathematical Programming 99(2):351–376, 2004. https://doi.org/10.1007/s10107-003-0454-y
  • D. Bertsimas, V. Goyal, On the power and limitations of affine policies in two-stage adaptive optimization, Mathematical Programming 134(2):491–531, 2012. https://doi.org/10.1007/s10107-011-0444-4
  • G. M. Ziegler, Lectures on Polytopes, Springer GTM 152, 1995 (Chapter 7, zonotopes). https://doi.org/10.1007/978-1-4613-8431-1
11 thms2 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments I: Revenue-Ordered Assortments Earn OPT/(1 + ln(r_k/r_1)) Under Any Regular Choice ModelResearch Paper

Motivation

A retailer, an airline or an online platform decides which products to show a customer. Showing more is not always better: a customer who would have bought an expensive product may switch to a cheap one once it is offered. The assortment problem asks for the set of products that maximises expected revenue, given a model of how customers choose. It is a central problem of revenue management (Talluri and van Ryzin, 2004), and it is NP-hard even for mixtures of two multinomial logit models (Rusmevichientong, Shmoys, Tong and Topaloglu, 2014).

The standard heuristic in practice is revenue-ordered assortments: sort the products by price and only consider the sets consisting of the most expensive products down to some threshold. It is optimal under the multinomial logit model (Talluri and van Ryzin, 2004), but not in general. Berbeglia and Joret (arXiv:1606.01371) ask how much revenue the heuristic can lose under every reasonable choice model, and answer with guarantees that depend only on the prices.

Timeline:

  • 2004: Talluri and van Ryzin prove revenue-ordered assortments optimal under the multinomial logit model.
  • 2014: Rusmevichientong et al. show NP-hardness of the assortment problem for mixtures of logits, and prove that revenue-ordered assortments earn at least OPT/(e(1+ln⁡(rk/r1)))\mathrm{OPT}/(e(1+\ln(r_k/r_1)))OPT/(e(1+ln(rk​/r1​))) under mixed logit models.
  • 2016–2019: Berbeglia and Joret prove the guarantees 1/k1/k1/k and 1/(1+ln⁡(rk/r1))1/(1+\ln(r_k/r_1))1/(1+ln(rk​/r1​)) under any regular choice model and show them tight (arXiv v1 2016, v3 2019; Algorithmica 2020). Aouad, Farias, Levi and Segev (2018) show that under random utility models no efficient algorithm does essentially better than these ratios.

Setting

There is a finite nonempty set C\mathcal CC of products. For a choice set S⊆CS\subseteq\mathcal CS⊆C, P(x,S)\mathcal P(x,S)P(x,S) is the probability that a customer offered SSS buys product xxx, and P(0,S)=1−∑x∈SP(x,S)\mathcal P(0,S)=1-\sum_{x\in S}\mathcal P(x,S)P(0,S)=1−∑x∈S​P(x,S) is the probability that the customer buys nothing. The system P\mathcal PP is a regular discrete choice model if

  1. P(x,S)≥0\mathcal P(x,S)\ge0P(x,S)≥0 for every x∈C∪{0}x\in\mathcal C\cup\{0\}x∈C∪{0};
  2. P(x,S)=0\mathcal P(x,S)=0P(x,S)=0 whenever x∉Sx\notin Sx∈/S;
  3. ∑x∈SP(x,S)≤1\sum_{x\in S}\mathcal P(x,S)\le1∑x∈S​P(x,S)≤1;
  4. P(x,S)≥P(x,S′)\mathcal P(x,S)\ge\mathcal P(x,S')P(x,S)≥P(x,S′) whenever S⊆S′S\subseteq S'S⊆S′ and x∈S∪{0}x\in S\cup\{0\}x∈S∪{0}.

Axiom 4, regularity, says that adding products never makes a given product, or leaving without buying, more likely. Every random utility model is regular.

Each product has a positive price r(x)>0r(x)>0r(x)>0. The revenue of SSS is rev⁡(S)=∑x∈SP(x,S) r(x)\operatorname{rev}(S)=\sum_{x\in S}\mathcal P(x,S)\,r(x)rev(S)=∑x∈S​P(x,S)r(x), and OPT=max⁡S⊆Crev⁡(S)\mathrm{OPT}=\max_{S\subseteq\mathcal C}\operatorname{rev}(S)OPT=maxS⊆C​rev(S). Let 0<r1<⋯<rk0<r_1<\cdots<r_k0<r1​<⋯<rk​ be the distinct prices, so kkk counts price levels and not products, and set r0=0r_0=0r0​=0. The revenue-ordered assortments are Si={x∈C:r(x)≥ri}S_i=\{x\in\mathcal C : r(x)\ge r_i\}Si​={x∈C:r(x)≥ri​}, i=1,…,ki=1,\dots,ki=1,…,k, and the heuristic earns

RO=max⁡1≤i≤krev⁡(Si).\mathrm{RO}=\max_{1\le i\le k}\operatorname{rev}(S_i).RO=1≤i≤kmax​rev(Si​).

Formalization targets

Goal: Theorem 3.2

OPT  ≤  (∑i=1kri−ri−1ri) ROand∑i=1kri−ri−1ri  ≤  1+ln⁡rkr1.\mathrm{OPT}\;\le\;\Big(\sum_{i=1}^{k}\frac{r_i-r_{i-1}}{r_i}\Big)\,\mathrm{RO} \qquad\text{and}\qquad \sum_{i=1}^{k}\frac{r_i-r_{i-1}}{r_i}\;\le\;1+\ln\frac{r_k}{r_1}.OPT≤(i=1∑k​ri​ri​−ri−1​​)ROandi=1∑k​ri​ri​−ri−1​​≤1+lnr1​rk​​.

The goal fixes no constant beyond the paper's own quantities. Both parts are required: the sum form is the sharper bound, and the paper shows it is attained (Theorem 3.4, a later mission of this series).

Milestones

  • Lemma 2.1: ∑x∈SP(x,S)≤∑x∈S′P(x,S′)\sum_{x\in S}\mathcal P(x,S)\le\sum_{x\in S'}\mathcal P(x,S')∑x∈S​P(x,S)≤∑x∈S′​P(x,S′) for S⊆S′S\subseteq S'S⊆S′.
  • Inequality (5): rev⁡(Si)≥ri∑x∈S∗∩SiP(x,S∗)\operatorname{rev}(S_i)\ge r_i\sum_{x\in S^*\cap S_i}\mathcal P(x,S^*)rev(Si​)≥ri​∑x∈S∗∩Si​​P(x,S∗) for every S∗S^*S∗ and i∈[k]i\in[k]i∈[k].
  • Theorem 3.1: OPT≤k⋅RO\mathrm{OPT}\le k\cdot\mathrm{RO}OPT≤k⋅RO.
  • Rearrangement (proof of Theorem 3.2): rev⁡(S∗)=∑ℓ(rℓ−rℓ−1)∑x∈S∗∩SℓP(x,S∗)\operatorname{rev}(S^*)=\sum_{\ell}(r_\ell-r_{\ell-1})\sum_{x\in S^*\cap S_\ell}\mathcal P(x,S^*)rev(S∗)=∑ℓ​(rℓ​−rℓ−1​)∑x∈S∗∩Sℓ​​P(x,S∗), and rev⁡(S∗)≤∑ℓrℓ−rℓ−1rℓrev⁡(Sℓ)\operatorname{rev}(S^*)\le\sum_\ell\frac{r_\ell-r_{\ell-1}}{r_\ell}\operatorname{rev}(S_\ell)rev(S∗)≤∑ℓ​rℓ​rℓ​−rℓ−1​​rev(Sℓ​).
  • Logarithmic bound: ∑ℓ=1kaℓ−aℓ−1aℓ≤1+ln⁡(ak/a1)\sum_{\ell=1}^k\frac{a_\ell-a_{\ell-1}}{a_\ell}\le1+\ln(a_k/a_1)∑ℓ=1k​aℓ​aℓ​−aℓ−1​​≤1+ln(ak​/a1​) for 0=a0<a1<⋯<ak0=a_0<a_1<\cdots<a_k0=a0​<a1​<⋯<ak​.

Significance

The theorem shows that a pricing-only quantity controls the loss of the most common heuristic in revenue management, uniformly over all regular choice models, including every random utility model, mixtures of logits and Markov chain models. Combined with the hardness result of Aouad et al., it shows that revenue-ordered assortments achieve essentially the best ratio, as a function of kkk or of rk/r1r_k/r_1rk​/r1​, that an efficient algorithm can achieve. The same analysis transfers to the envy-free pricing and Stackelberg problems studied in the later sections of the paper.

The result is proved in the paper; to our knowledge it has no machine-checked proof. This mission produces a Lean formalization of regular choice models, the revenue-ordered heuristic and its two guarantees, on which the paper's tightness examples, the purchase-probability bound (Theorem 3.3) and the applications to pricing can build.

Difficulty

The argument is short, but two points are easy to get wrong. First, revenues of SiS_iSi​ and of an optimal S∗S^*S∗ involve choice probabilities evaluated at different sets, so the comparison must pass through S∗∩SiS^*\cap S_iS∗∩Si​, using regularity once for products and once for the no-purchase option. A model that only assumes regularity for products does not satisfy the theorem. Second, the bound runs over distinct price levels, not products, and the first summand uses the convention r0=0r_0=0r0​=0; indexing by products or dropping r0r_0r0​ gives a different quantity. The comparison of the sum with ln⁡(rk/r1)\ln(r_k/r_1)ln(rk​/r1​) is a Riemann-sum estimate for ∫dt/t\int dt/t∫dt/t and needs a real-analysis lemma not phrased this way in Mathlib.

Formalization scope

  • Products are a finite nonempty type C with decidable equality; choice sets are Finset C. The choice probabilities are P : C → Finset C → ℝ, defined on all pairs. The no-purchase option is not a product: P(0,S)\mathcal P(0,S)P(0,S) is the derived quantity noPurchase P S = 1 - ∑ x ∈ S, P x S.
  • IsRegular P carries axioms (i)–(iv), with (i) and (iv) each split into a product case and a no-purchase case. The no-purchase case of (i) is redundant with (iii) and is kept to match the page.
  • r : C → ℝ with the hypothesis ∀ x, 0 < r x. revenue P r S is rev⁡(S)\operatorname{rev}(S)rev(S) and opt P r is the maximum over all Finset C (Finset.sup'), including the empty set.
  • Price levels are 1-based: level r i is rir_iri​ for 1≤i≤k1\le i\le k1≤i≤k and level r 0 = 0; numVals r is kkk, the number of distinct values. roSet r i is SiS_iSi​; roValue P r is the maximum over i∈{1,…,k}i\in\{1,\dots,k\}i∈{1,…,k} only.
  • Approximation guarantees are stated in product form, OPT≤D⋅RO\mathrm{OPT}\le D\cdot\mathrm{RO}OPT≤D⋅RO, never as a ratio. ln⁡\lnln is Real.log, applied to rk/r1≥1r_k/r_1\ge1rk​/r1​≥1.
  • Ruled out: a maximum over all subsets in place of RO\mathrm{RO}RO (which makes the bound trivial), a regularity axiom without its no-purchase case, the logarithmic form alone in place of the sum form, and any specific choice model (logit, Markov chain, random utility) in place of an arbitrary regular P\mathcal PP.

Needed infrastructure: finite sums over price levels and summation by parts, the comparison of (b−a)/b(b-a)/b(b−a)/b with ln⁡(b/a)\ln(b/a)ln(b/a), and the sorted enumeration of a finite set of reals (Finset.orderEmbOfFin). The regular model and the revenue-ordered sets are shared with the other missions of this series. Contributions of any milestone, alternative proofs of the logarithmic bound, and proofs that specific choice models are regular are welcome.

Selected references

  • G. Berbeglia and G. Joret, Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments, arXiv:1606.01371v3, 2019; Algorithmica 82, 2020. https://arxiv.org/abs/1606.01371
  • K. Talluri and G. van Ryzin, Revenue Management Under a General Discrete Choice Model of Consumer Behavior, Management Science 50(1), 2004. https://doi.org/10.1287/mnsc.1030.0147
  • A. Aouad, V. Farias, R. Levi and D. Segev, The Approximability of Assortment Optimization Under Ranking Preferences, Operations Research 66(6), 2018. https://doi.org/10.1287/opre.2018.1724
  • P. Rusmevichientong, D. Shmoys, C. Tong and H. Topaloglu, Assortment Optimization under the Multinomial Logit Model with Random Choice Parameters, Production and Operations Management 23(11), 2014. https://doi.org/10.1111/poms.12191
9 thms2 active usersReviewed
🏆Completed
Control TheoryOperations Research·Captain: mikedeng1

Optimal Dynamic Pricing of Inventories with Stochastic Demand over Finite Horizons 2: The Optimal Revenue Is Strictly Concave in Stock and Time; the Optimal Price Falls with Stock, Rises with TimeResearch Paper

Why the shape of the optimal pricing policy matters

A retailer holding a fixed stock of a perishable or seasonal good (fashion items, airline seats, hotel rooms, concert tickets) must sell it before a deadline, after which unsold units are worthless. Demand is random and depends on the posted price, and the firm may change its price at any time. Dynamic pricing asks how the price should depend on the remaining stock and the remaining time.

Gallego and van Ryzin (Management Science 40(8), 1994) posed this problem as a continuous-time intensity control problem and established its basic structure. Their Theorem 1 says that the optimal expected revenue is strictly increasing and strictly concave in both the stock and the time remaining, and that the optimal price falls as stock grows and rises with the time left to sell. The paper is a standard reference of revenue management; the structural result is the continuous-time counterpart of the monotonicity of marginal values in discrete-time models (Talluri and van Ryzin, The Theory and Practice of Revenue Management, 2004, Proposition 5.2), and it is what makes the optimal policy computable by restricting attention to monotone policies. The paper credits a slightly weaker version to Kincaid and Darling (1963). The source formalized here is the published 1994 article.

The model and the Hamilton–Jacobi system

The firm chooses a demand rate λ\lambdaλ from a set Λ⊆[0,∞)\Lambda \subseteq [0,\infty)Λ⊆[0,∞) of allowable rates, an interval containing 000; the market then sets the price p(λ)p(\lambda)p(λ), where ppp is the inverse demand function, strictly decreasing and nonnegative on the positive rates. The rate 000 corresponds to the null price at which nothing sells. The revenue rate is

r(λ)=λ p(λ),r(0)=0.r(\lambda) = \lambda\,p(\lambda), \qquad r(0) = 0.r(λ)=λp(λ),r(0)=0.

The demand function is regular when rrr is continuous, bounded and concave on Λ\LambdaΛ and has a least maximizer λ∗=min⁡{λ:r(λ)=max⁡μ∈Λr(μ)}\lambda^* = \min\{\lambda : r(\lambda) = \max_{\mu\in\Lambda} r(\mu)\}λ∗=min{λ:r(λ)=maxμ∈Λ​r(μ)}. The exponential demand λ(p)=ae−p\lambda(p) = ae^{-p}λ(p)=ae−p, with Λ=[0,a]\Lambda=[0,a]Λ=[0,a], p(λ)=log⁡(a/λ)p(\lambda)=\log(a/\lambda)p(λ)=log(a/λ) and λ∗=a/e\lambda^*=a/eλ∗=a/e, is the running example.

With nnn units in stock and time remaining ttt, write J(n,t)J(n,t)J(n,t) for the optimal expected revenue. The paper derives the Hamilton–Jacobi system

∂J(n,t)∂t=sup⁡λ∈Λ[r(λ)−λ(J(n,t)−J(n−1,t))],n≥1, t>0,(8)\frac{\partial J(n,t)}{\partial t} = \sup_{\lambda\in\Lambda}\big[r(\lambda) - \lambda\big(J(n,t)-J(n-1,t)\big)\big], \qquad n\ge1,\ t>0, \tag{8}∂t∂J(n,t)​=λ∈Λsup​[r(λ)−λ(J(n,t)−J(n−1,t))],n≥1, t>0,(8)

with J(n,0)=0J(n,0)=0J(n,0)=0 and J(0,t)=0J(0,t)=0J(0,t)=0. The difference J(n,t)−J(n−1,t)J(n,t)-J(n-1,t)J(n,t)−J(n−1,t) is the marginal value of an item; a rate attaining the supremum is an optimal intensity λ∗(n,t)\lambda^*(n,t)λ∗(n,t), and p(λ∗(n,t))p(\lambda^*(n,t))p(λ∗(n,t)) is the optimal price p∗(n,t)p^*(n,t)p∗(n,t).

Formalization targets

Goal: Theorem 1 (p. 1005)

For the solution JJJ of (8), with rrr strictly concave, differentiable on the interior of Λ\LambdaΛ, and λ∗\lambda^*λ∗ interior:

J(n,t) strictly increasing in n (t>0) and in t (n≥1);J(n+1,t)−J(n,t)<J(n,t)−J(n−1,t);J(n,t)\ \text{strictly increasing in } n\ (t>0)\ \text{and in } t\ (n\ge1);\qquad J(n+1,t)-J(n,t) < J(n,t)-J(n-1,t);J(n,t) strictly increasing in n (t>0) and in t (n≥1);J(n+1,t)−J(n,t)<J(n,t)−J(n−1,t); t↦J(n,t) strictly concave;∃ λ∗(n,t): λ∗ ⁣↑n, λ∗ ⁣↓t,p∗ ⁣↓n, p∗ ⁣↑t (strictly).t\mapsto J(n,t)\ \text{strictly concave};\qquad \exists\,\lambda^*(n,t):\ \lambda^*\!\uparrow_n,\ \lambda^*\!\downarrow_t,\quad p^*\!\downarrow_n,\ p^*\!\uparrow_t\ \text{(strictly)}.t↦J(n,t) strictly concave;∃λ∗(n,t): λ∗↑n​, λ∗↓t​,p∗↓n​, p∗↑t​ (strictly).

Milestones

  1. The supremum in (8) is a maximum over [0,λ∗][0,\lambda^*][0,λ∗] whenever the marginal value is nonnegative (proof of Proposition 1).
  2. Proposition 1: (8) has a unique solution, and λ∗(n,s)≤λ∗\lambda^*(n,s)\le\lambda^*λ∗(n,s)≤λ∗.
  3. Eq. (26): J(n,t)−J(n−1,t)=r′(λ∗(n,t))>0J(n,t)-J(n-1,t) = r'(\lambda^*(n,t)) > 0J(n,t)−J(n−1,t)=r′(λ∗(n,t))>0 for t>0t>0t>0.
  4. The case n=1n=1n=1 of Theorem 1: λ∗(1,t)\lambda^*(1,t)λ∗(1,t) strictly decreasing and J(1,t)J(1,t)J(1,t) strictly concave in ttt.
  5. λ∗(n,0+)=λ∗\lambda^*(n,0^+) = \lambda^*λ∗(n,0+)=λ∗.
  6. Eqs. (9)–(10), exponential demand: J(n,t)=log⁡∑i=0n(λ∗t)i/i!J(n,t) = \log\sum_{i=0}^n(\lambda^*t)^i/i!J(n,t)=log∑i=0n​(λ∗t)i/i! and p∗(n,t)=J(n,t)−J(n−1,t)+1p^*(n,t) = J(n,t)-J(n-1,t)+1p∗(n,t)=J(n,t)−J(n−1,t)+1.
  7. Proposition 3, exponential demand: λ∗(n,t)≤λD(n,t)=min⁡{λ∗,n/t}\lambda^*(n,t)\le\lambda^D(n,t)=\min\{\lambda^*,n/t\}λ∗(n,t)≤λD(n,t)=min{λ∗,n/t} and p∗(n,t)≥p(λD(n,t))p^*(n,t)\ge p(\lambda^D(n,t))p∗(n,t)≥p(λD(n,t)).

Significance

Theorem 1 is the qualitative backbone of single-product dynamic pricing. Concavity of JJJ in nnn means that each additional unit is worth less than the previous one, which is the basis of bid-price and marginal-value reasoning in revenue management; the monotone price path justifies markdown practice as the deadline approaches and reduces the policy search to monotone policies. Proposition 3 answers, for exponential demand, a question raised by Mills (1959): the stochastic optimal price is never below the deterministic one. The closed form (9)–(10) is one of the few exactly solvable intensity control problems in pricing.

The results are proved in the paper; none of them has a machine-checked proof. Formalizing them requires the comparison and monotonicity theory of a countable system of coupled ordinary differential equations whose right-hand side is a convex conjugate, a theory that Mathlib does not package. A complete development would also certify the corrected hypotheses of Theorem 1 described below.

Difficulty

The value functions are defined only implicitly by (8), a triangular infinite system of ODEs in which each J(n,⋅)J(n,\cdot)J(n,⋅) is driven by J(n−1,⋅)J(n-1,\cdot)J(n−1,⋅) through the nonsmooth map Δ↦sup⁡λ[r(λ)−λΔ]\Delta\mapsto\sup_\lambda[r(\lambda)-\lambda\Delta]Δ↦supλ​[r(λ)−λΔ]. Monotonicity of the optimal intensity in ttt is a statement about the time derivative of a marginal value, and the paper establishes it by an induction on nnn combined with an argument by contradiction on the first interval where monotonicity could fail. The obvious approach of differentiating (8) twice in ttt needs second derivatives of rrr and of JJJ that the hypotheses do not provide, and the paper's own proof of Proposition 1 assumes that JJJ is nondecreasing in nnn, which is only established in Theorem 1; a rigorous development must break this circularity.

Formalization scope

A regular demand function is a Lean structure (GVRPricing.Structure.Model) holding Λ\LambdaΛ, ppp and λ∗\lambda^*λ∗ with the paper's standing assumptions of §2.1: 0∈Λ⊆[0,∞)0\in\Lambda\subseteq[0,\infty)0∈Λ⊆[0,∞) an interval, ppp strictly decreasing and nonnegative on Λ∖{0}\Lambda\setminus\{0\}Λ∖{0}, r(λ)=λp(λ)r(\lambda)=\lambda p(\lambda)r(λ)=λp(λ) continuous, concave and bounded on Λ\LambdaΛ, and λ∗\lambda^*λ∗ the least maximizer. The definition IsHJBSolution encodes (8) for J:N→R→RJ:\mathbb N\to\mathbb R\to\mathbb RJ:N→R→R, with the second argument the time remaining, the two-sided derivative at each t>0t>0t>0, continuity on [0,∞)[0,\infty)[0,∞), the boundary conditions, and the requirement that the set inside the supremum be bounded above, so that the real supremum is never a default value. An optimal intensity at (n,t)(n,t)(n,t) is any ℓ∈Λ\ell\in\Lambdaℓ∈Λ maximizing λ↦r(λ)−λ(J(n,t)−J(n−1,t))\lambda\mapsto r(\lambda)-\lambda(J(n,t)-J(n-1,t))λ↦r(λ)−λ(J(n,t)−J(n−1,t)) over Λ\LambdaΛ.

All theorems are about solutions of (8), on which the paper's proofs operate. The identification of the solution of (8) with the supremum of expected revenue over non-anticipating pricing policies is Brémaud's verification theorem, which the paper cites and does not prove; it is not part of this mission.

Added hypotheses and corrected statements.

  • As printed, Theorem 1 assumes only a regular demand function and is false: for r(λ)=λr(\lambda)=\sqrt\lambdar(λ)=λ​ on [0,1][0,1][0,1] and r=1r=1r=1 beyond, λ∗(1,t)=1\lambda^*(1,t)=1λ∗(1,t)=1 for all t∈(0,ln⁡2]t\in(0,\ln2]t∈(0,ln2]; for r(λ)=λ−λ2/4r(\lambda)=\lambda-\lambda^2/4r(λ)=λ−λ2/4 on Λ=[0,1]\Lambda=[0,1]Λ=[0,1], λ∗=1\lambda^*=1λ∗=1 is on the boundary and λ∗(1,t)=1\lambda^*(1,t)=1λ∗(1,t)=1 for small ttt. The goal, eq. (26) and the case n=1n=1n=1 therefore assume that rrr is strictly concave, differentiable on the interior of Λ\LambdaΛ, and that λ∗\lambda^*λ∗ is interior; the appendix proof uses all three. Proposition 1, the restriction lemma and λ∗(n,0+)=λ∗\lambda^*(n,0^+)=\lambda^*λ∗(n,0+)=λ∗ use only the printed assumptions.
  • Strict claims in nnn are made for t>0t>0t>0, since J(n,0)=0J(n,0)=0J(n,0)=0 for all nnn; optimal intensities are considered for n≥1n\ge1n≥1, t>0t>0t>0.
  • Proposition 1's bound "λ∗(n,s)≤λ∗\lambda^*(n,s)\le\lambda^*λ∗(n,s)≤λ∗ for 0≤s0\le s0≤s" is read at s=0s=0s=0 as "λ∗\lambda^*λ∗ is optimal", since every maximizer of rrr is optimal there.
  • Proposition 3 is stated for n≥1n\ge1n≥1, t>0t>0t>0 (the page says n≥0n\ge0n≥0, t≥0t\ge0t≥0, where n/tn/tn/t or the optimal intensity is undefined).
  • The exponential results use the paper's normalization α=1\alpha=1α=1 of λ(p)=ae−αp\lambda(p)=ae^{-\alpha p}λ(p)=ae−αp.
  • The case n=1n=1n=1 omits the displayed identities involving r′′r''r′′ and λ∗′\lambda^{*\prime}λ∗′, which presuppose second derivatives; its conclusions are stated.

A formalization that defines JJJ by a formula, or postulates a monotone function as the optimal intensity, would trivialize the goal: the goal quantifies over every solution of (8), and the optimal intensity it asserts must maximize the right-hand side of (8) at every (n,t)(n,t)(n,t).

A complete development needs comparison principles for scalar ODEs with Lipschitz right-hand sides, properties of the concave conjugate Δ↦sup⁡λ[r(λ)−λΔ]\Delta\mapsto\sup_\lambda[r(\lambda)-\lambda\Delta]Δ↦supλ​[r(λ)−λΔ] (monotonicity, Lipschitz continuity, envelope theorem), and monotone comparative statics of maximizers. These are reusable well beyond this mission; contributions of any of them, or of the milestones in any order, are welcome.

Selected references

  • G. Gallego, G. van Ryzin, Optimal Dynamic Pricing of Inventories with Stochastic Demand over Finite Horizons, Management Science 40(8), 999–1020, 1994. https://doi.org/10.1287/mnsc.40.8.999
  • P. Brémaud, Point Processes and Queues: Martingale Dynamics, Springer, 1981. https://doi.org/10.1007/978-1-4684-9477-8
  • W. M. Kincaid, D. A. Darling, An Inventory Pricing Problem, Journal of Mathematical Analysis and Applications 7, 183–208, 1963. https://doi.org/10.1016/0022-247X(63)90047-7
  • K. T. Talluri, G. J. van Ryzin, The Theory and Practice of Revenue Management, Springer, 2004. https://doi.org/10.1007/b139000
10 thms2 active usersReviewed
🏆Completed
Machine LearningProbabilityStatistics·Captain: mikedeng1

Non-Strongly-Convex Smooth Stochastic Approximation with Convergence Rate O(1/n): Averaged Constant-Step-Size LMS Has Expected Excess Risk at Most (1/2n)[σ√d/(1−√(γR²)) + R‖θ₀−θ*‖/√(γR²)]²Research Paper

Motivation

Least-squares regression fitted by stochastic gradient descent — the least-mean-square (LMS) algorithm — is the basic large-scale learning procedure: each observation is touched once, at a cost linear in the dimension. Classical analyses of stochastic approximation give the rate O(1/n)O(1/\sqrt n)O(1/n​) for non-strongly-convex objectives, and O(1/(μn))O(1/(\mu n))O(1/(μn)) when the objective is μ\muμ-strongly convex. For least squares, μ\muμ is the smallest eigenvalue of the input covariance, which in high-dimensional problems is close to zero, so the strongly convex rate is often worse than the non-strongly-convex one.

F. Bach and E. Moulines (arXiv:1306.2119, NeurIPS 2013) showed that for the square loss this dichotomy disappears: averaged LMS with a constant step size reaches the rate O(1/n)O(1/n)O(1/n) with no strong-convexity assumption, and with a constant that does not involve the smallest eigenvalue. Averaging of stochastic approximation iterates goes back to Polyak and Juditsky (SIAM J. Control Optim. 1992), whose guarantees are asymptotic and use decreasing step sizes. The proof technique for the expansion of the noise process is adapted from Aguech, Moulines and Priouret (SIAM J. Control Optim. 2000). This mission formalizes the non-asymptotic bound in expectation (Theorem 1 of the paper) and the chain of lemmas of its Appendix A.

Setting

Let H=Rd\mathcal H=\mathbb R^dH=Rd with d≥1d\ge1d≥1, inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ and norm ∥⋅∥\|\cdot\|∥⋅∥. For a∈Ha\in\mathcal Ha∈H, a⊗aa\otimes aa⊗a is the operator b↦⟨a,b⟩ab\mapsto\langle a,b\rangle ab↦⟨a,b⟩a. For self-adjoint operators, A≼BA\preccurlyeq BA≼B means that B−AB-AB−A is positive semi-definite.

The data are independent and identically distributed pairs (xn,zn)∈H×H(x_n,z_n)\in\mathcal H\times\mathcal H(xn​,zn​)∈H×H, n≥1n\ge1n≥1, with finite second moments. The covariance operator is H=E[xn⊗xn]H=\mathbb E[x_n\otimes x_n]H=E[xn​⊗xn​], assumed invertible (its eigenvalues may be arbitrarily small). The least-squares objective

f(θ)=12 E[⟨θ,xn⟩2−2⟨θ,zn⟩]f(\theta)=\tfrac12\,\mathbb E\big[\langle\theta,x_n\rangle^2-2\langle\theta,z_n\rangle\big]f(θ)=21​E[⟨θ,xn​⟩2−2⟨θ,zn​⟩]

attains its global minimum at θ∗\theta^*θ∗, and ξn=zn−⟨θ∗,xn⟩xn\xi_n=z_n-\langle\theta^*,x_n\rangle x_nξn​=zn​−⟨θ∗,xn​⟩xn​ is the residual. The model need not be well specified: E[ξn∣xn]\mathbb E[\xi_n\mid x_n]E[ξn​∣xn​] need not vanish. Two constants R,σ>0R,\sigma>0R,σ>0 satisfy

E[ξn⊗ξn]≼σ2H,E[∥xn∥2xn⊗xn]≼R2H.\mathbb E[\xi_n\otimes\xi_n]\preccurlyeq\sigma^2H,\qquad \mathbb E\big[\|x_n\|^2x_n\otimes x_n\big]\preccurlyeq R^2H .E[ξn​⊗ξn​]≼σ2H,E[∥xn​∥2xn​⊗xn​]≼R2H.

These are assumptions (A1)–(A6) of §2.1. The LMS recursion with constant step size γ\gammaγ, started at θ0∈H\theta_0\in\mathcal Hθ0​∈H, is

θn=θn−1−γ(⟨θn−1,xn⟩xn−zn)=(I−γxn⊗xn)θn−1+γzn,\theta_n=\theta_{n-1}-\gamma\big(\langle\theta_{n-1},x_n\rangle x_n-z_n\big)=(I-\gamma x_n\otimes x_n)\theta_{n-1}+\gamma z_n ,θn​=θn−1​−γ(⟨θn−1​,xn​⟩xn​−zn​)=(I−γxn​⊗xn​)θn−1​+γzn​,

and its average is θˉn−1=n−1∑k=0n−1θk\bar\theta_{n-1}=n^{-1}\sum_{k=0}^{n-1}\theta_kθˉn−1​=n−1∑k=0n−1​θk​.

Formalization targets

Goal: Theorem 1, Eq. (2)

For every step size 0<γ<1/R20<\gamma<1/R^20<γ<1/R2 and every n≥1n\ge1n≥1,

E[f(θˉn−1)−f(θ∗)]≤12n[σd1−γR2+R∥θ0−θ∗∥1γR2]2.\mathbb E\big[f(\bar\theta_{n-1})-f(\theta^*)\big]\le\frac{1}{2n}\left[\frac{\sigma\sqrt d}{1-\sqrt{\gamma R^2}}+R\|\theta_0-\theta^*\|\frac{1}{\sqrt{\gamma R^2}}\right]^2 .E[f(θˉn−1​)−f(θ∗)]≤2n1​[1−γR2​σd​​+R∥θ0​−θ∗∥γR2​1​]2.

The constants are the paper's. A companion item states the case γ=1/(4R2)\gamma=1/(4R^2)γ=1/(4R2), where the bound reads 2n[σd+R∥θ0−θ∗∥]2\frac2n\big[\sigma\sqrt d+R\|\theta_0-\theta^*\|\big]^2n2​[σd​+R∥θ0​−θ∗∥]2.

Milestones (Appendix A)

  1. The excess risk is a quadratic form: f(θ)−f(θ∗)=12⟨θ−θ∗,H(θ−θ∗)⟩f(\theta)-f(\theta^*)=\tfrac12\langle\theta-\theta^*,H(\theta-\theta^*)\ranglef(θ)−f(θ∗)=21​⟨θ−θ∗,H(θ−θ∗)⟩.
  2. Consequences of (A6): E∥xn∥2≤R2\mathbb E\|x_n\|^2\le R^2E∥xn​∥2≤R2, tr⁡H≤R2\operatorname{tr}H\le R^2trH≤R2, H≼R2IH\preccurlyeq R^2IH≼R2I, and γH≼I\gamma H\preccurlyeq IγH≼I for γ≤1/R2\gamma\le1/R^2γ≤1/R2.
  3. Lemma 1: for a recursion αn=(I−γxn⊗xn)αn−1+γξn\alpha_n=(I-\gamma x_n\otimes x_n)\alpha_{n-1}+\gamma\xi_nαn​=(I−γxn​⊗xn​)αn−1​+γξn​ with martingale-difference noise and γR2≤1\gamma R^2\le1γR2≤1,
(1−γR2) E⟨αˉn−1,Hαˉn−1⟩+12nγE∥αn∥2≤12nγ∥α0∥2+γn∑k=1nE∥ξk∥2.(1-\gamma R^2)\,\mathbb E\langle\bar\alpha_{n-1},H\bar\alpha_{n-1}\rangle+\tfrac{1}{2n\gamma}\mathbb E\|\alpha_n\|^2\le\tfrac{1}{2n\gamma}\|\alpha_0\|^2+\tfrac{\gamma}{n}\textstyle\sum_{k=1}^{n}\mathbb E\|\xi_k\|^2 .(1−γR2)E⟨αˉn−1​,Hαˉn−1​⟩+2nγ1​E∥αn​∥2≤2nγ1​∥α0​∥2+nγ​∑k=1n​E∥ξk​∥2.
  1. Lemma 3: (1−(1−u)n)2≤nu(1-(1-u)^n)^2\le nu(1−(1−u)n)2≤nu for u∈[0,1]u\in[0,1]u∈[0,1] and n>0n>0n>0.
  2. Lemma 2: for αn=(I−γH)αn−1+γξn\alpha_n=(I-\gamma H)\alpha_{n-1}+\gamma\xi_nαn​=(I−γH)αn−1​+γξn​ with E[ξn⊗ξn]≼C\mathbb E[\xi_n\otimes\xi_n]\preccurlyeq CE[ξn​⊗ξn​]≼C, the second-moment bound (13) and
E⟨αˉn−1,Hαˉn−1⟩≤1nγ∥α0∥2+1ntr⁡(CH−1).\mathbb E\langle\bar\alpha_{n-1},H\bar\alpha_{n-1}\rangle\le\tfrac{1}{n\gamma}\|\alpha_0\|^2+\tfrac1n\operatorname{tr}(CH^{-1}).E⟨αˉn−1​,Hαˉn−1​⟩≤nγ1​∥α0​∥2+n1​tr(CH−1).
  1. The pathwise decomposition θn−θ∗=M1n(θ0−θ∗)+γ∑k=1nMk+1nξk\theta_n-\theta^*=M^n_1(\theta_0-\theta^*)+\gamma\sum_{k=1}^nM^n_{k+1}\xi_kθn​−θ∗=M1n​(θ0​−θ∗)+γ∑k=1n​Mk+1n​ξk​ (A.2).
  2. The initial-condition bound E⟨ηˉn−1,Hηˉn−1⟩≤∥η0∥2/(nγ)\mathbb E\langle\bar\eta_{n-1},H\bar\eta_{n-1}\rangle\le\|\eta_0\|^2/(n\gamma)E⟨ηˉ​n−1​,Hηˉ​n−1​⟩≤∥η0​∥2/(nγ) for the noise-free process (A.3).
  3. The expansion of the noise process (A.4): the remainder recursion (16), the covariance bound (17) E[ηn−1r⊗ηn−1r]≼γr+1R2rσ2I\mathbb E[\eta^r_{n-1}\otimes\eta^r_{n-1}]\preccurlyeq\gamma^{r+1}R^{2r}\sigma^2IE[ηn−1r​⊗ηn−1r​]≼γr+1R2rσ2I, the order-rrr bound 1nγrR2rdσ2\frac1n\gamma^rR^{2r}d\sigma^2n1​γrR2rdσ2, the remainder bound γr+2σ2R2r+41−γR2\frac{\gamma^{r+2}\sigma^2R^{2r+4}}{1-\gamma R^2}1−γR2γr+2σ2R2r+4​, and the noise bound
(E⟨ηˉn−1,Hηˉn−1⟩)1/2≤σdn⋅11−γR2(η0=0, γR2<1).\big(\mathbb E\langle\bar\eta_{n-1},H\bar\eta_{n-1}\rangle\big)^{1/2}\le\frac{\sigma\sqrt d}{\sqrt n}\cdot\frac{1}{1-\sqrt{\gamma R^2}}\quad(\eta_0=0,\ \gamma R^2<1).(E⟨ηˉ​n−1​,Hηˉ​n−1​⟩)1/2≤n​σd​​⋅1−γR2​1​(η0​=0, γR2<1).

Significance

The result. Theorem 1 gives a finite-sample, dimension-explicit bound with two terms: a variance term σ2d/n\sigma^2d/nσ2d/n, which matches the minimax rate for least-squares regression, and a bias term R2∥θ0−θ∗∥2/(γn)R^2\|\theta_0-\theta^*\|^2/(\gamma n)R2∥θ0​−θ∗∥2/(γn). Neither involves the smallest eigenvalue of HHH, so the guarantee survives ill-conditioning, which is the regime of high-dimensional learning. The bound is the basis for the paper's later results: the high-probability bound (Theorem 2) and the constant-step algorithm for logistic regression (Theorem 3), whose analysis invokes Theorem 1 for the quadratic approximations.

Formalizing it. The result is proved in the paper; nothing here is open. To our knowledge no part of it has been machine-checked. A formalization yields a reusable layer for linear stochastic approximation in finite dimension: martingale-difference noise in Rd\mathbb R^dRd, second-moment bounds for linear recursions driven by random operators, Loewner-order arguments, and averaging. The lemmas are stated for an abstract filtration and an abstract operator HHH, so they apply beyond this model. The mission also records the corrections the appendix needs (an "===" that should be "≼\preccurlyeq≼" in (13), an index in (16), and the exponent of ∥η0∥\|\eta_0\|∥η0​∥ in A.5).

Difficulty

Two steps resist the naive approach. First, the obvious one-step analysis — expand ∥θn−θ∗∥2\|\theta_n-\theta^*\|^2∥θn​−θ∗∥2 and take expectations — yields the bias part and Lemma 1, but on the noise it gives only γ∑kE∥ξk∥2/n\gamma\sum_k\mathbb E\|\xi_k\|^2/nγ∑k​E∥ξk​∥2/n, which does not decrease with nnn. The σ2d/n\sigma^2d/nσ2d/n rate requires averaging to cancel the noise, and this cancellation is visible only for the recursion with xn⊗xnx_n\otimes x_nxn​⊗xn​ replaced by its mean HHH. The random recursion is therefore expanded in powers of γ\gammaγ around the mean recursion, and each term ηr\eta^rηr needs its own covariance bound, by induction on rrr, using the independence of xnx_nxn​ from ηn−1r\eta^{r}_{n-1}ηn−1r​. Second, the induction relies on Loewner-order bookkeeping: sums of (I−γH)2kH(I-\gamma H)^{2k}H(I−γH)2kH must be bounded uniformly in nnn without dividing by small eigenvalues.

Formalization scope

The space H\mathcal HH is EuclideanSpace ℝ (Fin d). Operators are continuous linear maps, and H−1H^{-1}H−1 is an explicit two-sided inverse. Observations are indexed from 111. Averages are pˉn−1=n−1∑k=0n−1pk\bar p_{n-1}=n^{-1}\sum_{k=0}^{n-1}p_kpˉ​n−1​=n−1∑k=0n−1​pk​, with n≥1n\ge1n≥1 in every statement that uses them. The covariance operator is defined by its bilinear form, ⟨v,Hw⟩=E[⟨x1,v⟩⟨x1,w⟩]\langle v,Hw\rangle=\mathbb E[\langle x_1,v\rangle\langle x_1,w\rangle]⟨v,Hw⟩=E[⟨x1​,v⟩⟨x1​,w⟩]. Every Loewner inequality whose sides are expectations is an inequality of quadratic forms (for example E⟨ξ1,v⟩2≤σ2⟨v,Hv⟩\mathbb E\langle\xi_1,v\rangle^2\le\sigma^2\langle v,Hv\rangleE⟨ξ1​,v⟩2≤σ2⟨v,Hv⟩ for all vvv), which is the same order for self-adjoint operators.

Lean's Bochner integral is 000 on non-integrable functions, so every moment assumption carries the integrability of its integrand, and every bounded expectation in a conclusion is paired with an integrability conjunct. Without these, a heavy-tailed xnx_nxn​ would satisfy (A6) vacuously and a conclusion could hold through the value 000; neither formalization is acceptable. Independence is of the pairs (xn,zn)(x_n,z_n)(xn​,zn​), not of xnx_nxn​ and znz_nzn​ separately. (A4) is attainment of the minimum, not a gradient condition.

The following hypotheses are added to the page and disclosed in each item:

  • γ>0\gamma>0γ>0 (a step size, and γR2\sqrt{\gamma R^2}γR2​ is a denominator);
  • n≥1n\ge1n≥1;
  • the positivity and self-adjointness of HHH in Lemma 2;
  • γR2<1\gamma R^2<1γR2<1 instead of ≤1\le1≤1 in the remainder bound, which divides by 1−γR21-\gamma R^21−γR2.

A complete development needs:

  • conditional expectations of Rd\mathbb R^dRd-valued martingale differences, and the orthogonality of their sums;
  • independence of a fresh observation from the past iterates;
  • spectral calculus for (I−γH)k(I-\gamma H)^k(I−γH)k;
  • Minkowski's inequality in L2L^2L2.

All of these are reusable for other stochastic-approximation missions. Proofs of any milestone are welcome, as are alternative arguments for the noise bound that avoid the expansion.

Selected references

  • F. Bach and E. Moulines, Non-strongly-convex smooth stochastic approximation with convergence rate O(1/n), Advances in Neural Information Processing Systems 26, 2013. https://arxiv.org/abs/1306.2119
  • B. T. Polyak and A. B. Juditsky, Acceleration of stochastic approximation by averaging, SIAM Journal on Control and Optimization 30(4), 1992. https://doi.org/10.1137/0330046
  • R. Aguech, E. Moulines and P. Priouret, On a perturbation approach for the analysis of stochastic tracking algorithms, SIAM Journal on Control and Optimization 39(3), 2000. https://doi.org/10.1137/S0363012997331639
  • F. Bach and E. Moulines, Non-asymptotic analysis of stochastic approximation algorithms for machine learning, Advances in Neural Information Processing Systems 24, 2011. https://hal.science/hal-00608041
15 thms2 active usersReviewed
PreviousPage 27 of 37Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me