Every full-dimensional convex body is sandwiched between an ellipsoid and its n-fold dilation: shrinking the minimum-volume covering (Löwner–John) ellipsoid E about its centre x0 by the factor 1/n lands inside the body,
x0+n1(E−x0)⊆C⊆E,
and the factor n is tight on simplices. This rounding theorem underlies the ellipsoid method, John's theorem on the Banach–Mazur distance to the Euclidean ball, and much of modern convex geometry. The mission formalizes §8.4 of Boyd & Vandenberghe for polytopes C=conv{x1,…,xm}, exactly as the book proves it: existence and uniqueness of the extremal ellipsoid, the KKT identities at the normalized optimum (∑iλixixiT=I, ∑iλixi=0, ∑iλi=n), the convex-combination step that produces the 1/n ball, and affine invariance.
Infinite-Dimensional Fisher Markets and Tractable Fair Division 2: For Linear Valuations on [0,1] the Feasible Utility Set Is a Projection of Linear and Parabolic ConstraintsResearch Paper
Motivation
A Fisher market divides a supply of goods among buyers with different values and budgets. In many fair division models, the goods form a continuum: pieces of time, land, or a divisible resource can be allocated in arbitrarily small amounts. A direct description of all possible buyer utilities then appears to require one allocation function for every buyer. Gao and Kroer show that when values vary linearly along an interval, the same utility set has a finite description using linear constraints and a parabolic cone. This makes the utility possibilities visible to convex optimization methods even though the underlying allocation space is infinite dimensional. Gao and Kroer, §§2 and 4.
The result is a characterization of a set, rather than a claim about one selected market equilibrium. It includes every feasible utility vector, including vectors below the Pareto frontier and cases in which adjacent buyers have identical valuations. The article proves the characterization as Theorem 4 and extends it to arbitrary subintervals and piecewise linear valuations in Theorems 5 and 6. Gao and Kroer, Theorems 4–6.
Setting
There are n buyers and one unit interval of items, Θ=[0,1], with Lebesgue measure. Buyer i values item θ at vi(θ)=ciθ+di. An allocation assigns a nonnegative, essentially bounded share xi(θ) to each buyer, with ∑ixi(θ)≤1 almost everywhere. Its utility vector has coordinates ui=∫01vi(θ)xi(θ)dθ. The feasible utility setU(v,[0,1]) contains all vectors obtained this way, including utilities from allocations that leave some supply unused. Gao and Kroer, (1), p. 8.
The goal assumes normalized valuations, ci/2+di=1, and intercepts 2≥d1≥⋯≥dn≥0. These bounds ensure that each valuation is nonnegative on the item interval. The ordering can contain ties. For each adjacent pair of buyers, the result introduces four real auxiliary variables (zi,wi,si,ti). The pair (si,ti) lies in the parabolic coneC={(s,t):s2≤t}, and a 2×2 matrix Gi maps it to (zi,wi). Gao and Kroer, Theorem 4, pp. 15–16.
For the supporting welfare statement, the item space is instead a compact subset of Euclidean space. A buyer's valuation is integrable and nonnegative, prices are integrable and nonnegative, and a market equilibrium gives each buyer a utility maximizing bundle within budget while clearing all positively priced supply. A Pareto optimal allocation admits no feasible allocation that weakly improves every buyer and strictly improves one. These notions are used in Lemma 6 and the path to the interval result. Gao and Kroer, §§2 and 4.1.
Formalization targets
The main target is the full equivalence of Theorem 4:
u∈U(v,[0,1])⟺u≥0 and there exist z,w,s,t satisfying Theorem 4’s linear and parabolic constraints.
The constraints include u1≤z1, ui≤zi+wi−1 for interior buyers, un≤1+wn−1, Gi(si,ti)=(zi,wi), si2≤ti, 0≤zi≤1, −1≤wi≤0, and zi+wi≥0 for each adjacent pair. The representation quantifies over real auxiliary variables; it does not assume a market equilibrium or a partition into intervals. Gao and Kroer, Theorem 4, pp. 15–16.
The milestones are the paper's continuum second welfare theorem (Lemma 6), the ordered interval structure of equilibrium under Assumption 1 (Lemma 5), the ordered interval domination of feasible utilities (Lemma 7), the breakpoint description in the proof of Theorem 4, and the two buyer region identity in that proof. Theorem 5 is a companion target: it identifies utilities on [l,h] with scaled, permuted utilities for normalized valuations on [0,1]. Gao and Kroer, pp. 14–19 and a10–a13.
Significance
Theorem 4 turns an infinite dimensional feasibility question into membership in a projection of a finite convex set. This lets the interval utility set enter a conic optimization model without choosing a discretization of the item space. Theorem 5 transfers that description to other intervals, and the paper uses these results for piecewise linear fair division. Gao and Kroer, §§4.2–4.3.
The mathematical results are proved in the article. The formalization work here records the precise objects and open Lean theorem statements; machine checked proofs of these new statements remain to be supplied. The generic allocation, demand, equilibrium, and feasible utility definitions can also support later results about continuum Fisher markets and Eisenberg–Gale optimality.
Difficulty
A feasible utility vector may come from a fractional allocation that varies arbitrarily along the interval. The geometric statement, however, describes it with only one adjacent pair of auxiliary variables per buyer boundary. The link must preserve the entire feasible set, including vectors below the Pareto frontier and valuations with equal intercepts. A characterization proved only for equilibrium utilities, or only for distinct valuations, would miss those vectors. Lemma 6 also works over general compact Euclidean item spaces, so its assertion cannot be reduced to the interval case. Gao and Kroer, Lemmas 5–7 and Theorem 4.
Formalization scope
Lean represents allocations and valuations as real functions modulo almost everywhere equality in the statements, rather than as quotient Lp elements. Bundles must belong to L∞ and prices and valuations to L1; their integral pairings are then meaningful. The feasible utility set is defined from allocations and Lebesgue measure restricted to the relevant interval. Buyers are indexed from zero in Lean and from one in the paper. Natural number indices for the auxiliary sequences follow the same shift. The goal requires n≥2 because its first and last adjacent pair constraints do not exist for smaller n; Lemmas 5 and 7 require n≥1 for their endpoint lists.
The goal includes ties among intercepts. The printed further claim that all feasible auxiliary si,ti lie in [0,1] fails with a tie, so its companion statement assumes the relevant adjacent intercepts are strictly ordered. Theorem 5 reads the valuation as ciθ+di: that agrees with its normalization and interval integral, while the displayed ciθ/2+di on p. 18 is inconsistent with those formulas. These readings are recorded with concrete checks in the moderation notes. Gao and Kroer, Theorems 4–5, pp. 16 and 18.
A complete proof will need reusable measure theoretic facts about allocations, interval integrals of linear functions, Pareto optimal utilities, and the image of the parabolic cone under a linear map. Contributions to those foundations and to the listed theorem statements are within scope. The target cannot be met by assuming a breakpoint partition or an equilibrium for the utility vector: it must characterize U(v,[0,1]) directly.
Selected references
Yuan Gao and Christian Kroer, Infinite-Dimensional Fisher Markets and Tractable Fair Division, Operations Research, 2023. arXiv:2010.03025v5.
Stochastic Dual Dynamic Integer Programming 3: The Convex Lower Envelope of a Function on {0,1}^n Is Piecewise Linear and Agrees with It at Every Binary PointResearch Paper
Motivation
Multistage stochastic integer programs model sequential decisions under uncertainty in which some decisions are discrete: unit commitment in power systems, capacity expansion, production planning with setups. The standard decomposition methods for multistage stochastic linear programs, nested Benders decomposition and stochastic dual dynamic programming (SDDP), approximate each stage's expected cost-to-go function from below by finitely many affine cuts. This works because those functions are convex and polyhedral. With integer variables the cost-to-go functions are in general nonconvex, and no family of affine cuts can be exact at every evaluated state.
Zou, Ahmed and Sun (Math. Program. 175 (2019) 461–502) observe that the obstruction disappears when the state variables passed between stages are binary. Their Theorem 1 (p. 467) states that every real function of binary variables is represented exactly, at all binary points, by a convex polyhedral function on the unit cube. This is the structural fact on which their stochastic dual dynamic integer programming (SDDiP) algorithm rests: the cost-to-go function only ever needs to be evaluated at binary states, and there a convex piecewise linear under-approximation can be tight. Mixed integer states are reduced to binary ones by binary expansion (§5 of the paper).
Setting
Let n≥0 and write {0,1}n⊆Rn for the binary points, the vectors each of whose coordinates is 0 or 1, and Cn=[0,1]n for the unit cube. Let f be a real valued function defined on {0,1}n.
For a set X in a real vector space and f:X→R, a convex underestimator of f is a function h that is convex on the convex hull conv(X) and satisfies h(x)≤f(x) for every x∈X (Definition 3, p. 496). The largest convex underestimator of f on conv(X), that is, a convex underestimator e with h≤e on conv(X) for every convex underestimator h, is the convex lower envelope of f. In this mission X={0,1}n.
A function e is convex piecewise linear with finitely many linear pieces on Cn if there are α1,…,αK∈Rn and β1,…,βK∈R with e(x)=maxk(αk⊤x+βk) for all x∈Cn.
The proof works with the polyhedron of affine minorants of f,
Π={(α,β)∈Rn×R:α⊤x+β≤f(x) for all x∈{0,1}n},
the function g(x)=max(α,β)∈Π{α⊤x+β}, and the linear program (P) defining g(x) together with its dual
(D)mini=1∑Nf(x^i)λis.t.X^λ=x,e⊤λ=1,λ≥0,
where X^=[x^1,…,x^N] lists the N=2n binary vectors.
Formalization targets
Goal: Theorem 1 (p. 467)
f has a convex lower envelope, and every convex lower envelope e of f satisfies
e is convex on [0,1]n,e(x)=k=1,…,Kmax(αk⊤x+βk)(x∈[0,1]n),e(x)=f(x)(x∈{0,1}n)
for some finite family of affine functions.
Milestones (proof of Theorem 1, p. 496)
conv({0,1}n)=[0,1]n.
For x∈[0,1]n, (P) and (D) both attain their optima, with common value g(x); in particular g(x)<∞.
g(x)=f(x) for every x∈{0,1}n.
g is convex on [0,1]n and is there the maximum of finitely many affine functions whose coefficients are extreme points of Π.
h(x)≤g(x) for every x∈[0,1]n and every convex underestimator h of f.
Significance
The result. Theorem 1 is what makes exact cutting-plane approximation possible for nonconvex value functions of binary states. In SDDiP, the expected cost-to-go function of each node is approximated from below by affine cuts; Theorem 1 guarantees that a convex polyhedral function exists that agrees with the true value function at every binary state, so a finite collection of valid cuts can be tight at every state the algorithm visits. Without it, the finite convergence of SDDiP to an optimal policy (Theorem 2 of the paper, with Lagrangian cuts from Theorem 3) would have no target to converge to. The statement fails for general finite sets in place of {0,1}n: on {0,1,2}⊆R with f(1)>(f(0)+f(2))/2, no convex underestimator reaches f(1).
Formalizing it. The result is proved in the paper; to our knowledge it has no machine-checked proof. A formalization produces the identity conv({0,1}n)=[0,1]n, a finite-dimensional LP duality statement for the pair (P)–(D), and a characterization of the convex lower envelope on the cube, each of independent use for later formalizations of binary and mixed integer programming (Lagrangian relaxations, convex closures, extended formulations).
Difficulty
Two steps carry the weight. The first is that the maximum defining g is attained, with finitely many pieces coming from extreme points of the unbounded polyhedron Π: this needs LP duality and the existence of an optimal vertex for a pointed polyhedron, neither of which is a one-line consequence of Mathlib's convexity library. The second is the domination step. The printed argument handles interior points of the cube by writing a convex underestimator as a supremum of affine minorants, and binary points separately; the remaining boundary points of [0,1]n (for example (1/2,0) when n=2) are covered by the paper's conclusion but not by those two cases, and require an argument that works on all of conv({0,1}n). Exactness at binary points uses that a binary point is not a nontrivial convex combination of other points of the cube.
Formalization scope
Points of Rn are Fin n → ℝ with the componentwise order; Cn is Set.Icc 0 1, the binary points are the vectors with every coordinate 0 or 1, and α⊤x is the dot product. f is a total function on Rn of which only the values at binary points enter any statement. Convexity of an underestimator is required on conv({0,1}n), exactly as in Definition 3, not on all of Rn; the identification of this hull with [0,1]n is milestone 1, not a definition. The value n=0 is allowed and no hypothesis on n is added.
The readings of informal words are: "the convex lower envelope" is a predicate (largest convex underestimator on conv(X)), so Theorem 1 asserts its existence and then its properties for every function satisfying it; "convex piecewise linear with a finite number of linear pieces" is "the maximum of finitely many affine functions on the cube"; "max" over Π is an attained maximum, stated with IsGreatest; "min" in (D) is stated with IsLeast. The proof's function g is a real supremum, used only after its attainment is proved.
The convex lower envelope is not defined as g (or as the value of (D)): under that definition convexity and piecewise linearity would be unfoldings, and Theorem 1's content, that the largest convex underestimator of Definition 3 has this form and is exact at binary points, would be lost.
A complete development needs: convex hulls of finite sets in Rn, LP duality for a finite system of inequalities, extreme points of polyhedra and attainment of linear maxima at them, and Jensen's inequality for finite convex combinations. The cube identity and the LP duality milestone are reusable beyond this mission. Proofs of individual milestones, alternative proofs of Theorem 1 that bypass LP duality, and generalizations of the definitions are welcome.
Selected references
J. Zou, S. Ahmed, X. A. Sun, Stochastic dual dynamic integer programming, Mathematical Programming, Ser. A 175 (2019) 461–502. https://doi.org/10.1007/s10107-018-1249-5
M. V. F. Pereira, L. M. V. G. Pinto, Multi-stage stochastic optimization applied to energy planning, Mathematical Programming 52 (1991) 359–375. https://doi.org/10.1007/BF01582895
Shortest Paths in Graphs of Convex Sets II: For Compact 𝒳 the Set-Based Relaxation 𝒮′ of Z = xyᵀ Is Exact at Every Extreme Point of a Polytope 𝒴Research Paper
Motivation
The shortest-path problem in a graph of convex sets (SPP in GCS), introduced by Marcucci, Umenberger, Parrilo and Tedrake (arXiv:2101.11565, SIAM J. Optim. 2024), asks for a path through a directed graph whose vertices carry convex sets, together with a point in each visited set, minimizing a sum of convex edge lengths. It models motion planning around obstacles, hybrid-system control and other problems that mix a discrete choice with continuous positions. The paper formulates it as a mixed-integer convex program whose only nonconvexity, before relaxation, is a family of bilinear equalities Z=xy⊤ that couple the continuous positions x with the flow variables y.
Section 7 of the paper studies the convex relaxation used for these bilinear equalities in isolation. Products of valid inequalities linearized by Z=xy⊤ are the idea behind the McCormick envelope (McCormick 1976) and the Reformulation-Linearization Technique of Sherali and Adams. This mission formalizes the paper's result that the relaxation is exact at every extreme point of the polytope Y, which is the property that makes the mixed-integer formulation exact at binary flows.
Setting
Fix X⊆Rn and Y⊆Rm. Points of Rn×Rm×Rn×m are written (x,y,Z).
The perspective of X (Definition 4.1) is X~:=cl{(x,λ):λ≥0,x∈λX}⊆Rn×R.
The cone of valid inequalities (Definition 4.8) is X∘:={(a,b):a⊤x+b≥0 for all x∈X}.
The dual cone of K⊆Rn×R is K∗:={(a,b):a⊤x+bλ≥0 for all (x,λ)∈K}.
The bilinear set (7.1) is S:={(x,y,Z):x∈X,y∈Y,Z=xy⊤}.
The set-based relaxation (7.2) multiplies every valid inequality of X by every valid inequality of Y and replaces xy⊤ by Z:
S′:={(x,y,Z):a⊤Zc+da⊤x+bc⊤y+bd≥0 for all (a,b)∈X∘,(c,d)∈Y∘}.
A polytope is a bounded set Y={y:ci⊤y+di≥0 for all i∈I} with I finite. Its asymmetric relaxation (7.3) is {(x,y,Z):(Zci+dix,ci⊤y+di)∈X~ for all i∈I}.
Always S⊆S′, and S′ is convex.
Formalization targets
Goal: Lemma 7.4 (p. 13)
Let X be compact and convex, let Y be a polytope and let y^ be an extreme point of Y. Then for all x and Z,
(x,y^,Z)∈S⟺(x,y^,Z)∈S′.
Milestones
(7.2), p. 12: S⊆S′ for arbitrary sets.
The sentence after (7.2), p. 12: for closed convex X,Y, every point of S′ has x∈X and y∈Y.
Lemma 4.9, p. 6: for nonempty closed convex X, (X~)∗=X∘ and (X∘)∗=X~.
Proposition 7.1, inclusion ⊆, p. 12: S′ is contained in the asymmetric relaxation (7.3), for every family of halfspaces.
Remark 4.2, p. 5: for compact convex X, X~={(x,λ):λ≥0,x∈λX}, without closure.
Proof of Lemma 7.4, p. 13: at an extreme point of a polyhedron with finitely many inequalities, m linearly independent inequalities are active.
Proposition 7.1, p. 12: S′ equals (7.3), when the trivial inequality 1≥0 is a nonnegative combination of the defining inequalities.
Remark 7.5, p. 14: if Y⊆[0,1]m, every point of Y∩{0,1}m is an extreme point of Y.
(7.4), p. 13: for compact convex X and Y=conv{y^j}j∈J, convS={∑j(xj,λjy^j,xjy^j⊤):∑jλj=1,(xj,λj)∈X~}.
Significance
The result. In the paper's mixed-integer program each vertex v contributes a bilinear set Sv in which X is the convex set at v and Y is the polytope of flows on the edges at v. Binary flows corresponding to a path are extreme points of these polytopes, so Lemma 7.4 says that replacing Sv by Sv′ loses nothing at the integer points of the program. This gives the paper's second, geometric proof that its mixed-integer convex formulation is exact (Theorem 5.7). By Remark 7.5 the lemma also extends a known property of the first-level Reformulation-Linearization Technique for bilinear programs with binary variables from polytopes X to compact convex sets X. Proposition 7.1 is what makes the relaxation finite: it replaces the infinitely many inequalities of S′ by one perspective-cone constraint per facet of Y.
Formalizing it. The results are proved on paper; none of them has a machine-checked proof. The formalization also settles the exact hypotheses. Three statements of this section are false as printed (see Formalization scope), and the corrected versions are posed here with the counterexamples recorded. The perspective cone, the cone of valid inequalities and their duality (Lemma 4.9) are general convex-analysis facts that recur across conic and disjunctive programming.
Difficulty
The direction S⊆S′ is one line, since (a⊤x+b)(c⊤y+d)≥0. The converse at y^ needs three ingredients that are each standard and none of which is in Mathlib in this form.
The duality between X~ and X∘ is a bipolar theorem for the closed cone generated by X×{1}, in the product Rn×R with the pairing a⊤x+bλ. The cone needs care at λ=0.
The active-constraint characterization of extreme points of a polyhedron in halfspace form has to be proved directly.
The step "(u,0)∈X~ implies u=0" is where boundedness enters. For unbounded X the slice λ=0 of X~ is the recession cone, and the argument, and the lemma, fail.
Proposition 7.1 as an equality needs an affine Farkas lemma, and its printed proof skips the case of the valid inequality (0,1).
Formalization scope
Rn is Fin n → ℝ, inner products are dotProduct, Zc is Z *ᵥ c and xy⊤ is Matrix.vecMulVec x y. Triples are (x, y, Z) in (Fin n → ℝ) × (Fin m → ℝ) × Matrix (Fin n) (Fin m) ℝ. A polytope is given by a finite family (c i, d i) over a Fintype index and the hypothesis Bornology.IsBounded; extreme points are Mathlib's Set.extremePoints ℝ, never a predicate defined through active constraints. The dual cone uses the pairing a⊤x+bλ on the product, not an inner product.
Hypotheses added relative to the page, each with a counterexample to the printed form:
Lemma 7.4 and (7.4): X compact. Section 7.1 only asks X to be closed and convex. For X=[0,∞), Y=[0,1] and y^=0, the point (1,0,21) is in S′ but not in S. Compactness is the standing assumption of Section 2 on the sets Xv that X stands for.
Lemma 4.9: X nonempty. For X=∅, X~=∅ but (X∘)∗={0}.
Proposition 7.1 (equality): 1≥0 is a nonnegative combination of the rows. For Y={0} written as {y≥0,−y≥0} and X=[0,1], the point (5,0,0) satisfies (7.3) but not (7.2). The hypothesis holds for every polytope with an interior point and for the flow polytopes of the paper.
Several hypotheses are dropped where they are not needed, which strengthens the statements: nonemptiness of X throughout, and boundedness and finiteness in the inclusion of Proposition 7.1 and in the active-constraint milestone.
Trivializing formalizations ruled out: S′ quantifies over all of X∘×Y∘ and is not replaced by (7.3) in the goal; X is never allowed to be merely closed in the goal; the hypotheses of the goal are satisfiable (X=Y=[0,1], y^=0 is checked in Lean).
A complete development needs the bipolar theorem for closed convex cones in Rn×R, the closedness of the cone over a compact convex set, the active-constraint characterization of extreme points, and a finite affine Farkas lemma. All of these are reusable well beyond this mission and are welcome as separate contributions.
G. P. McCormick, Computability of global solutions to factorable nonconvex programs: Part I — Convex underestimating problems, Math. Program. 10, 1976. https://doi.org/10.1007/BF01580665
H. D. Sherali, W. P. Adams, A Reformulation-Linearization Technique for Solving Discrete and Continuous Nonconvex Problems, Kluwer, 1999. https://doi.org/10.1007/978-1-4757-4388-3
On the tightness of SDP relaxations of QCQPs 5: The Multiplicity Bound k ≥ aff dim{b(γ) : γ ∈ F} + 1 Cannot Be Lowered by OneResearch Paper
Motivation
A quadratically constrained quadratic program (QCQP) minimizes a quadratic function subject to quadratic inequality and equality constraints. QCQPs contain max-cut, binary programming, the trust-region subproblem and many problems from signal processing and control, and are NP-hard in general. The standard convex approach is the Shor semidefinite relaxation, which lifts x to the matrix Y=(1xx⊤xx⊤) and relaxes xx⊤ to an arbitrary positive semidefinite completion. Two questions decide how useful the relaxation is for a given QCQP: is its optimal value equal to the QCQP's (SDP exactness), and does its projected epigraph equal the convex hull of the QCQP's epigraph (convex hull exactness)?
A. L. Wang and F. Kılınç-Karzan (arXiv:1911.09195v3, Math. Program. 2021) give sufficient conditions for both, in terms of the faces of a dual set Γ and a symmetry parameter k, the quadratic eigenvalue multiplicity. Their Theorems 1 and 2 require Γ to be polyhedral and k≥affdim{b(γ):γ∈F}+1 on every semidefinite face F. This mission formalizes §4.3 of the paper, which shows that neither hypothesis can be weakened on its own.
Timeline. Fujie and Kojima (1997) recorded the dual description of the SDP value used here. Ye and Zhang (2003) and Beck and Eldar (2006) gave sufficient conditions under which the trust-region subproblem with one additional quadratic inequality has a tight SDP relaxation; Locatelli (2016) gave an exactness condition for a variant of the trust-region subproblem, and Burer and Ye (2019) for diagonal QCQPs. Wang and Kılınç-Karzan (2020) unified these conditions through the facial structure of Γ, and showed in their Propositions 2 and 3 that their own hypotheses are sharp.
Setting
A QCQP in N variables with m≥1 constraints, mI of them inequalities, is
with qi(x)=x⊤Aix+2bi⊤x+ci, Ai∈SN. Its epigraph is D={(x,t):q0(x)≤2t,x feasible}. With Qi=(cibibi⊤Ai) and Y=(1xx⊤X), the SDP relaxation minimizes ⟨Q0,Y⟩ subject to ⟨Qi,Y⟩≤0 or =0 and Y⪰0; its value is OptSDP, and DSDP is the set of (x,t) for which some feasible X has ⟨Q0,Y⟩≤2t.
For γ∈Rm write A(γ)=A0+∑iγiAi, b(γ)=b0+∑iγibi and q(γ,x)=q0(x)+∑iγiqi(x). The dual set is
Γ={γ∈Rm:A(γ)⪰0,γi≥0∀i∈[[mI]]}.
Assumption 1: the QCQP is feasible and A(γ∗)≻0 for some γ∗ with γi∗≥0 on the inequalities. Assumption 2: supγ∈Γq(γ,x) is attained whenever it is finite. Assumption 3: Γ is polyhedral. A faceF of Γ is definite if some γ∈F has A(γ)≻0, and semidefinite otherwise. The quadratic eigenvalue multiplicity is the largest k such that every Ai equals Ik⊗Ai for some Ai∈Sn, N=kn.
The Lean development uses the same names: QCQP N m, Opt, OptSDP, D, DSDP, Gamma, bγ, qγ, Assumption1–Assumption3, IsSemidefiniteFace, IsQuadEigMult, affdim.
The milestones pin the paper's witness, the QCQP (13): min{−x12−xn+12−⋯−x(k−1)n+12:∥x∥2≤1,x(j−1)n+1=0∀j}.
Lemma 1: under Assumption 1, DSDP={(x,t):supγ∈Γq(γ,x)≤2t} and OptSDP=minxsupγ∈Γq(γ,x).
Assumption 1 holds for (13).
For (13), Γ={γ:γ1≥1}, so Assumption 3 holds.
For (13), affdim{b(γ):γ1=1}=k.
For (13), OptSDP≤supγ∈Γq(γ,0)=−1 and Opt=0.
Companion: Proposition 3
There is a QCQP in N=2 variables with m=2 constraints satisfying Assumptions 1 and 2, with multiplicity k=1 and k≥affdim{b(γ):γ∈F}+1 on every semidefinite face, but with Opt=OptSDP. The companion items about its witness (14) state Γ=B(0,2−1/2), supγ∈Γq(γ,x^)=q0(x^)+∥x^∥2, OptSDP=1/2 and Opt=1.
Significance
The result. Theorems 1 and 2 of the paper are the general sufficient conditions behind many earlier exactness results for SDP relaxations. Propositions 2 and 3 show that the two hypotheses are each necessary in the sense that relaxing either one by the smallest possible amount produces a counterexample: lowering the multiplicity bound by one, or replacing polyhedrality by mere attainment of the dual supremum. Anyone trying to extend the theorems therefore has to change the form of the conditions, not just their constants.
Formalizing it. Both propositions are proved in the paper; none of this has been machine-checked. A formal proof requires Lemma 1, a strong-duality statement for a parametric SDP that is reusable across the whole paper, and explicit computations of faces, affine dimensions and multiplicities for two concrete families. The multiplicity claim in particular ("the largest k") is asserted but not argued on the page, and a formal proof must supply it.
Difficulty
The concrete computations for (13) and (14) are elementary in isolation; the work lies in three places. First, Lemma 1 is a conic duality statement, including attainment of the outer minimum, that depends on Assumption 1; it is the bridge from the SDP to the dual set, and Mathlib has no semidefinite duality theory to build on. Second, the face structure: one must show that the hyperplane {γ1=1} is the only semidefinite face of the halfspace Γ of (13), and that every face of the disk Γ of (14) gives a single point b(γ)=b0. Third, "the multiplicity is k" requires ruling out every larger block structure Ik′⊗Ai, not only exhibiting one of size k. A naive witness with only Ai=Ik⊗Ai shown would establish a lower bound on the multiplicity, which is not the statement.
Formalization scope
Points of RN are Fin N → ℝ; the paper's constraint i is index i−1 of Fin m, and constraint i is an inequality exactly when its index is below mI. Opt and OptSDP are infima in EReal, so infeasible and unbounded programs take the values ±∞ rather than a junk real. A supremum bound supγ∈Γq(γ,x)≤2t is written as q(γ,x)≤2t for every γ∈Γ. Faces are nonempty convex extreme subsets of Γ. The quadratic eigenvalue multiplicity is the greatest k admitting a block form, under the identification of block j, entry s with coordinate s+nj. Proposition 3 says "n=2 variables"; the construction lives in R2, so the formal statement uses N=2.
The goal is existential, as on the page, and a solver may exhibit any witness; it cannot be met trivially, because the multiplicity must equal k exactly, the dimensions N=nk, m=k+1 are fixed by the type, and both Opt=OptSDP and conv(D)=DSDP are required.
The QCQP (13) is given in full: the page states only the matrices Ai, and the linear terms encode the constraints x(j−1)n+1=0 as qj+1(x)=x(j−1)n+1. Lemma 1 is the reusable piece, and proofs of it are welcome independently of this mission; so are general lemmas on faces of halfspaces and balls and on Kronecker block structure.
T. Fujie, M. Kojima, Semidefinite programming relaxation for nonconvex quadratic programs, Journal of Global Optimization 10 (1997) 367–380. https://doi.org/10.1023/A:1008282830093
S. Burer, Y. Ye, Exact semidefinite formulations for a class of (random and non-random) nonconvex quadratic programs, Mathematical Programming 181 (2019) 1–17. https://doi.org/10.1007/s10107-019-01367-2
M. Locatelli, Exactness conditions for an SDP relaxation of the extended trust region problem, Optimization Letters 10(6) (2016) 1141–1151. https://doi.org/10.1007/s11590-016-1001-0
A. Beck, Y. C. Eldar, Strong duality in nonconvex quadratic optimization with two quadratic constraints, SIAM Journal on Optimization 17(3) (2006) 844–860. https://doi.org/10.1137/050644471
On the tightness of SDP relaxations of QCQPs 2: Polyhedral Γ with 0 ∉ Proj_V(F){b(γ) : γ ∈ F} on Every Semidefinite Face Makes Every SDP Optimizer FeasibleResearch Paper
Why SDP exactness for QCQPs matters
A quadratically constrained quadratic program (QCQP) minimizes a quadratic function subject to quadratic inequality and equality constraints. The class contains nonconvex problems such as max-cut, Boolean least squares, the trust-region subproblem and its generalizations, and robust least squares, and it is NP-hard in general. The standard convex approach is the Shor semidefinite relaxation: lift x to the matrix Y=(1xx⊤X)⪰0 and linearize. The relaxation always gives a lower bound OptSDP≤Opt. When the bound is exact, the nonconvex problem is solved by one semidefinite program, and an optimizer of the QCQP can be read off the SDP solution.
Earlier exactness results cover special structure: problems with a single constraint (the S-lemma), diagonal QCQPs under sign conditions (Burer–Ye 2019), and the extended trust-region problem under a perturbation condition (Locatelli 2016). A. L. Wang and F. Kılınç-Karzan (arXiv:1911.09195, Math. Program. 2021) give a single framework that produces sufficient conditions for both exactness (Opt=OptSDP) and the stronger convex-hull property (conv(D)=DSDP). Both kinds of condition are stated through the faces of a dual object Γ. This mission formalizes the exactness result for polyhedral Γ, Theorem 3 of §5.
Setting
Fix N≥0 variables and m≥1 constraints, of which the first mI are inequalities and the remaining mE=m−mI equalities. For i=0,…,m let qi(x)=x⊤Aix+2bi⊤x+ci with Ai symmetric. The QCQP is
and its epigraph is D={(x,t):q0(x)≤2t,x feasible}. With Qi=(cibibi⊤Ai), the SDP relaxation minimizes ⟨Q0,Y⟩ over Y=(1xx⊤X)⪰0 with ⟨Qi,Y⟩≤0 or =0. Its value is OptSDP, and its projected epigraphDSDP is the set of (x,t) for which some X is feasible with ⟨Q0,Y⟩≤2t.
For multipliers γ∈Rm put A(γ)=A0+∑iγiAi, b(γ)=b0+∑iγibi, and the Lagrangian q(γ,x)=q0(x)+∑iγiqi(x). The dual object is
Γ={γ∈Rm:A(γ)⪰0,γi≥0(i≤mI)}.
A faceF of Γ is definite if some γ∈F has A(γ)≻0, and semidefinite otherwise. A semidefinite face has the shared zero eigenspaceV(F)={v:A(γ)v=0∀γ∈F}. For x^∈RN, F(x^)=argmaxγ∈Γq(γ,x^).
The standing hypotheses are Assumption 1 (the QCQP is feasible and some γ∗ with γi∗≥0 for i≤mI has A(γ∗)≻0) and Assumption 3 (Γ is polyhedral). ProjV denotes the orthogonal projection onto a subspace V.
Formalization targets
Goal: Theorem 3 (p. 23)
Under Assumptions 1 and 3, suppose that every semidefinite face F of Γ satisfies
0∈/ProjV(F){b(γ):γ∈F}.
Then every (x∗,t∗)∈argmin(x,t)∈DSDP2t lies in D, and in particular
Opt=OptSDP.
Milestones
Lemma 1 (p. 7): under Assumption 1, DSDP={(x,t):supγ∈Γq(γ,x)≤2t} and OptSDP=minxsupγ∈Γq(γ,x).
Lemma 2 (p. 9): a semidefinite face has a unit vector in V(F).
Lemma 3 (p. 9): under Assumptions 1 and 2, a point of DSDP whose face F(x^) is definite lies in D.
Lemma 8 (p. 13): for polyhedral Γ, Γ=Γe+cone(Γr) with polytopes Γe,Γr, and F(x^)=Fe(x^)+cone(Fr(x^)).
Separation step of the proof of Theorem 3 (p. 24): on a semidefinite face satisfying the hypothesis, some nonzero v∈V(F) and ϵ>0 have v⊤b(γ)≤−ϵ for all γ∈F.
Companion: Theorem 4 (p. 25)
If a sequence hj→0 in RN has 0∈/ProjV(F){b(γ)+hj:γ∈F} for every semidefinite face and every j, then Opt=OptSDP.
Significance
Theorem 3 gives exactness without the convex-hull property, and the paper uses it to recover known exactness results: Proposition 5 (p. 28) shows that the hypotheses of the Burer–Ye theorem for diagonal QCQPs imply those of Theorem 3, and Proposition 4 (p. 27) shows that Locatelli's hypotheses for the extended trust-region problem imply those of Theorem 4. The conclusion is also algorithmic: the x-block of any optimal lifted matrix of the SDP is optimal for the QCQP, so no rounding is needed. Theorem 4 extends exactness to limits of problems satisfying the condition; Example 4 is a problem where the SDP is exact but conv(D)=DSDP.
The results are proved in the paper; none of them has a machine-checked proof. A formalization adds a checked version of the Lagrangian description of the Shor relaxation (Lemma 1), which every SDP-exactness argument for QCQPs uses, and a reusable Minkowski–Weyl decomposition of the faces of a polyhedral dual set (Lemma 8).
Difficulty
The natural attempt is to show directly that an SDP optimizer (x∗,t∗) is feasible for the QCQP. This works when the face F(x∗) is definite (Lemma 3), but nothing in the SDP forces that. When the face is semidefinite, the multipliers on it give no curvature in the directions of V(F). The difficulty is to rule out a semidefinite optimal face using only first-order information about b(γ) on that face. The argument must also control every multiplier off the face uniformly, which is where polyhedrality enters, through the finitely many extreme points and rays of Lemma 8. The paper's argument for Theorem 3 uses polyhedrality at exactly this point.
Lemma 1 itself needs conic duality with attainment: strict feasibility of the dual SDP from Assumption 1, and a minimax step to identify the value.
Formalization scope
A QCQP is a structure QCQP N m with symmetric A₀, A i, vectors b₀, b i, scalars c₀, c i, and mI ≤ m. Constraint i : Fin m is the paper's constraint i+1 and is an inequality iff i < mI. The paper's standing assumption m≥1 (p. 1) is a hypothesis of the goal and of Theorem 4.
Opt and OptSDP are infima in EReal, so infeasibility and unboundedness are representable and no default value enters. "supγ∈Γq(γ,x)≤2t" is written as a bound for every γ∈Γ.
Faces are nonempty convex extreme subsets of Γ. The empty face plays no role in the paper.
The projection is the orthogonal projection in EuclideanSpace ℝ (Fin N), because Fin N → ℝ carries the sup norm.
"Any optimizer of 2t over DSDP" is a point of DSDP with 2t∗≤2t for all points of DSDP. Existence of an optimizer is not assumed, and Opt=OptSDP is stated as a separate conclusion.
Lemma 8 formalizes Fr(x^) as a subset of Γr. The page prints Γe, a slip that the proof and its uses correct.
The goal assumes neither that F(x∗) is definite nor any separating vector. Those are milestones, so the goal cannot be closed by restating a hypothesis.
A complete development needs conic (SDP) strong duality with attainment, a Minkowski–Weyl theorem for polyhedra in Rm, faces of convex sets, strict separation of a point from a closed convex set, and closedness of linear images of polyhedra. All of these are reusable beyond this mission. Proofs of the milestones, of these general tools, and of the optional comparisons with Burer–Ye and Locatelli (Propositions 4, 5) are welcome.
T. Fujie, M. Kojima, Semidefinite programming relaxation for nonconvex quadratic programs, Journal of Global Optimization 10(4) (1997) 367–380.
S. Burer, Y. Ye, Exact semidefinite formulations for a class of (random and non-random) nonconvex quadratic programs, Mathematical Programming 181 (2019) 1–17.
M. Locatelli, Exactness conditions for an SDP relaxation of the extended trust region problem, Optimization Letters 10(6) (2016) 1141–1151.
On the tightness of SDP relaxations of QCQPs 3: Quadratic Eigenvalue Multiplicity k ≥ m + 2 Gives conv(D) = D_SDP Without PolyhedralityResearch Paper
Motivation
A quadratically constrained quadratic program (QCQP) minimizes a quadratic function subject to quadratic inequality and equality constraints. The class contains nonconvex problems such as binary programs, max-cut, the trust-region subproblem and many problems in signal processing and control. A standard convex approximation is the Shor semidefinite programming (SDP) relaxation, which replaces the rank-one matrix xx⊤ by a positive semidefinite matrix X⪰xx⊤. The relaxation always gives a lower bound; the question studied by Wang and Kılınç-Karzan (arXiv:1911.09195v3, Math. Program. 2020, doi:10.1007/s10107-020-01589-9) is when it is tight, either in the sense of objective values or in the stronger sense that the relaxation describes the convex hull of the problem's epigraph.
Earlier exactness results are of two kinds. One kind concerns special structure: one constraint (the S-lemma, the trust-region subproblem), or two constraints under extra conditions. The other kind, due to Beck (Quadratic matrix programming, SIAM J. Optim. 2007, Corollary 4.4), exploits block symmetry: if every quadratic form is of the form Ik⊗Ai with k≥m, the SDP bound equals the optimal value. The paper under formalization recasts both kinds in one framework. Its convex hull results (Theorems 1 and 2) assume that a certain dual set Γ is polyhedral, and its Proposition 3 shows that without polyhedrality the convex hull result can fail. This mission is about Theorem 7, which removes the polyhedrality assumption at the price of a larger symmetry parameter.
Setting
Fix N≥1 variables and m=mI+mE≥1 constraints. For i∈[[0,m]] let qi(x)=x⊤Aix+2bi⊤x+ci with Ai a symmetric N×N matrix, bi∈RN and ci∈R. The QCQP is
Its epigraph is D={(x,t)∈RN×R:q0(x)≤2t,x feasible for (1)}. With Qi=(cibibi⊤Ai) and Y=(1xx⊤X), the Shor relaxation imposes Y⪰0, ⟨Qi,Y⟩≤0 for inequalities and ⟨Qi,Y⟩=0 for equalities; its projected epigraphDSDP is the set of (x,t) for which some symmetric X satisfies these constraints and ⟨Q0,Y⟩≤2t. Always conv(D)⊆DSDP.
For γ∈Rm write A(γ)=A0+∑iγiAi and q(γ,x)=q0(x)+∑iγiqi(x), and let Γ={γ:A(γ)⪰0,γi≥0∀i∈[[mI]]}. Assumption 1 asks that (1) be feasible and that A(γ∗)≻0 for some γ∗ that is nonnegative on the inequality indices.
The quadratic eigenvalue multiplicity (Definition 3) is the largest integer k such that N=kn and, for every i∈[[0,m]], Ai=Ik⊗Ai for some symmetric n×n matrix Ai. Here Ik⊗A is block diagonal with k copies of A, and for y∈Rk, z∈Rn the vector y⊗z∈RN has j-th block yjz. Every QCQP has multiplicity at least 1.
Formalization targets
Goal: Theorem 7 (p. 29)
Assumption 1 and k≥m+2⟹conv(D)=DSDP.
Milestones (in the order of the proof)
Lemma 1 (p. 7): under Assumption 1, DSDP={(x,t):supγ∈Γq(γ,x)≤2t} and OptSDP=minxsupγ∈Γq(γ,x).
A(γ)⪰0⟺A(γ)=A0+∑iγiAi⪰0 (p. 29).
Under Assumption 1, every (x^,t^)∈DSDP admits Z∈Sn with Z⪰0, q0(x^)+⟨A0,Z⟩≤2t^, qi(x^)+⟨Ai,Z⟩≤0 on inequalities and =0 on equalities: the system (17), p. 29.
If k≥m+2, for any x^ and z there is a unit y∈Rk with ⟨Aix^+bi,y⊗z⟩=0 for all i∈[[0,m]]: the system (18), p. 30.
If k≥m+2, every (x^,t^,Z) satisfying (17) has (x^,t^)∈conv(D) (pp. 29–30).
A supporting item (not a milestone) states the expansion used in the induction step: for A=Ik⊗A with A symmetric and unit y, q(x^±y⊗z)=q(x^)±2⟨Ax^+b,y⊗z⟩+⟨A,zz⊤⟩ (p. 30).
Significance
The result. Theorem 7 is the convex hull counterpart of Beck's value-exactness result: under Assumption 1 and enough block symmetry, the Shor relaxation does not merely give the right optimal value but describes conv(D) exactly, so every linear objective in (x,t) over the relaxation is exact. It needs neither the polyhedrality of Γ nor the attainment Assumption 2 used elsewhere in the paper. Problems with this structure include quadratic matrix programs (Beck 2007), in which the variable is a matrix X∈Rn×k and every quadratic form is a trace tr(X⊤AiX). The companion Theorem 8 (a separate mission of this series) relaxes k≥m+2 to k≥m+1 at the price of intersecting with the optimal hyperplane, and Remark 14 records that the authors conjecture these thresholds are sharp.
The formalization. Theorem 7 is proved in the paper; no machine-checked proof of it, or of the Shor relaxation's convex hull results in general, is known. The milestones isolate the three ingredients of the proof as reusable statements: the dual description of DSDP (Lemma 1, shared with the polyhedral results of the paper), conic duality applied to a Kronecker-structured SDP, and a rank-reduction argument for Kronecker-structured quadratic forms.
Difficulty
The inclusion conv(D)⊆DSDP is immediate; the content is the reverse inclusion. A point of DSDP comes with a matrix X⪰xx⊤, and the naive idea is to decompose X−xx⊤ into rank-one pieces and move x along them. In RN this fails in general: moving along an arbitrary direction changes each constraint by a first-order term that cannot be controlled, and Proposition 3 of the paper exhibits a QCQP with conv(D)=DSDP. The theorem therefore depends on the Kronecker structure and on the count k≥m+2 in an essential way, and on an exact dual certificate, whose existence needs the strict feasibility of Assumption 1 and a dual attainment theorem for SDPs that is not yet in Mathlib.
Formalization scope
All objects are defined locally in the namespace QCQPTightness.MultHull.
Variables live in Fin N → ℝ; constraints are indexed by Fin m, the paper's constraint i+1 being index i, and index i is an inequality iff i<mI. The standing assumption m≥1 (p. 1) is a hypothesis of the goal.
Opt, OptSDP and supγ∈Γq(γ,x) are taken in EReal, so an empty or unbounded set never produces the junk value of a real infimum. "supγ∈Γq(γ,x)≤2t" is stated as q(γ,x)≤2t for all γ∈Γ.
⟨Q,Y⟩ is tr(QY); ⪰0 and ≻0 are Mathlib's PosSemidef and PosDef; conv is convexHull ℝ in RN×R.
Ik⊗A is Mathlib's Kronecker product, transported to Fin N by (j,s)↦s+nj; y⊗z uses the same map.
The goal uses the largest k (IsQuadEigMult k) exactly as Definition 3. The milestones are stated for an arbitrary explicit representation Ai=Ik⊗Ai, which makes them at least as strong. Milestone 2 carries k≥1, which the paper notes always holds.
The goal does not assume the existence of a certificate Z for (17): that existence is milestone 3 and is where Assumption 1 is used. A formalization that assumes it, or that drops Assumption 1, states a different theorem.
A complete development needs: SDP strong duality with dual attainment under a Slater condition (the platform's ConvexOptimization.sdp_strong_duality states a related form), the spectral decomposition of a positive semidefinite matrix into rank-one terms, Kronecker product identities for block-diagonal matrices, and the existence of nonzero solutions of underdetermined homogeneous linear systems. The duality and Kronecker lemmas are reusable beyond this mission; proofs of any milestone are welcome.
A. Beck, Quadratic matrix programming, SIAM Journal on Optimization 17(4):1224–1238, 2007 (reference [5] of the paper).
T. Fujie, M. Kojima, Semidefinite programming relaxation for nonconvex quadratic programs, Journal of Global Optimization 10(4):367–380, 1997 (reference [26] of the paper).
N. Z. Shor, Dual quadratic estimates in polynomial and boolean programming, Annals of Operations Research 25:163–168, 1990 (reference [47] of the paper).
On the tightness of SDP relaxations of QCQPs 4: Quadratic Eigenvalue Multiplicity k ≥ m + 1 Gives conv(D ∩ H) = D_SDP ∩ H and Opt = Opt_SDPResearch Paper
Motivation
A quadratically constrained quadratic program (QCQP) minimizes a quadratic function subject to quadratic inequality and equality constraints. QCQPs model trust-region subproblems, max-cut and other binary programs, phase retrieval, and many problems in signal processing and control; in general they are NP-hard. The standard tool for bounding and solving them is the Shor semidefinite relaxation (Shor 1990), which lifts the variable x to a matrix Y=(1xx⊤X)⪰0 and replaces every quadratic term by a linear function of Y. The relaxation is a convex program, so it can be solved efficiently, but it is only useful when one knows that it is tight: that its optimal value equals that of the QCQP, or, more strongly, that it describes the convex hull of the QCQP's epigraph.
Wang and Kılınç-Karzan (arXiv:1911.09195v3, Math. Program. 2021) give sufficient conditions for tightness. Section 6 of the paper concerns QCQPs with symmetry: when every quadratic form is k identical copies of one smaller form, Ai=Ik⊗Ai. Such problems arise as quadratic matrix programs in the sense of Beck 2007, where the variable is a matrix and the objective and constraints are traces of quadratic matrix expressions. Beck showed (Corollary 4.4) that k≥m gives value exactness under a regularity assumption; Theorem 7 of the paper gives the convex-hull result for k≥m+2; this mission's Theorem 8 covers k≥m+1.
Setting
Fix N≥1 variables and m=mI+mE≥1 constraints. For i∈[[0,m]] let qi(x)=x⊤Aix+2bi⊤x+ci with Ai∈SN symmetric, bi∈RN, ci∈R. The QCQP is
and its projected epigraphDSDP is the set of (x,t) for which some X satisfies the constraints with ⟨Q0,Y⟩≤2t. Always conv(D)⊆DSDP and Opt≥OptSDP.
For γ∈Rm write A(γ)=A0+∑iγiAi and q(γ,x)=q0(x)+∑iγiqi(x), and let Γ={γ:A(γ)⪰0,γi≥0∀i∈[[mI]]}. Assumption 1 requires that the QCQP be feasible and that some γ∗ with γi∗≥0 on the inequalities have A(γ∗)≻0.
The quadratic eigenvalue multiplicity (Definition 3) is the largest integer k such that N=kn and every Ai, i∈[[0,m]], equals Ik⊗Ai for some Ai∈Sn. Finally,
H={(x,t)∈RN+1:2t=OptSDP}
is the hyperplane on which the SDP relaxation attains its value.
Formalization targets
Goal: Theorem 8 (p. 30)
Under Assumption 1, if k≥m+1, then
conv(D∩H)=DSDP∩HandOpt=OptSDP.
Milestones (App. B, pp. 35–36)
Lemma 1 (p. 7): DSDP={(x,t):supγ∈Γq(γ,x)≤2t} and OptSDP=minxsupγ∈Γq(γ,x).
Dual attainment: every (x^,t^)∈DSDP∩H has Z∈Sn with
Feasibility of (20): if k≥m+1, some unit y∈Rk has ⟨Aix^+bi,y⊗z⟩=0 for all i∈[[m]].
The objective direction vanishes: on DSDP∩H, with Z=zz⊤+Z′, Z′⪰0, and y as in (20), ⟨A0x^+b0,y⊗z⟩=0.
Rank induction: if k≥m+1, every (x^,t^)∈H with some Z satisfying (19) lies in conv(D∩H).
Significance
Theorem 8 says that one copy of symmetry fewer than Theorem 7 requires still makes the SDP relaxation exact in value, and identifies the relaxation's optimal set: every optimal point of the relaxation, projected to (x,t), is a convex combination of optimal epigraph points of the QCQP. In particular the relaxation's optimal points can be decomposed into QCQP optima, which is what makes the relaxation a solution method and not only a bound. Remark 14 of the paper places the result between Beck's k≥m (only D∩H=∅) and Theorem 7's k≥m+2 (the full convex hull), and records the conjecture that all three thresholds are sharp.
The theorem is proved in the paper (Appendix B). No machine-checked proof of it, or of the multiplicity results of Section 6, is known to exist. A formal proof needs a Lean development of the Shor relaxation, its Lagrangian dual, conic strong duality with dual attainment for an SDP with sign-constrained multipliers, and the Kronecker structure of the data.
Difficulty
The inclusion conv(D∩H)⊆DSDP∩H is routine. The converse needs, for an SDP-optimal point, a decomposition into feasible QCQP points that are themselves optimal. A rank-one decomposition of the SDP matrix X−xx⊤ does not suffice in general: its terms leave the feasible set unless the perturbation directions are orthogonal to all the linear parts Aix^+bi, including the objective's. With multiplicity k≥m+2 there is room for all m+1 orthogonality conditions; with k≥m+1 only the m constraint conditions can be imposed, and the objective condition has to come from elsewhere. The difficulty sits in that last condition and in the conic duality step, whose dual must attain its value under Assumption 1 alone (no polyhedrality of Γ, no attainment assumption).
Formalization scope
The Lean development lives in the namespace QCQPTightness.MultTight. The data are a structure QCQP N m with symmetric Ai, constraints indexed by Fin m, and constraint i an inequality exactly when (i : ℕ) < mI (the paper's inequalities come first). Vectors are Fin N → ℝ; points of RN+1 are pairs (x, t). Opt and OptSDP are infima in EReal, and H is defined from that EReal value; this is why the goal states Opt=OptSDP as a separate conjunct: if OptSDP were ±∞, H would be empty and the first conjunct trivial. ⟨Q,Y⟩ is (Q * Y).trace; Y⪰0 is PosSemidef; Sk−1 is y ⬝ᵥ y = 1. The identification Rk⊗Rn≅RN sends block j, entry s to coordinate s + n * j.
Standing assumptions: the goal carries m≥1 (p. 1) and Assumption 1. The multiplicity is the largest k (IsGreatest), as on the page. The milestones take an explicit representation Ai=Ik⊗Ai instead, which makes them apply to every representation, and drop m≥1 and Assumption 1 where the step does not use them. The rank-induction milestone carries (x^,t^)∈H, which the page's sentence omits but its proof uses ("by minimality of t^"); without it the claim is false.
A trivializing formalization would assume system (19), or the vanishing of ⟨A0x^+b0,y⊗z⟩, in the goal; the goal assumes neither, and both are milestones to be proved.
Reusable infrastructure: the QCQP and Shor-relaxation definitions are shared with the other missions of this series, and a general SDP strong-duality statement exists on the platform (ConvexOptimization.sdp_strong_duality) in a different form (a minimization without sign-constrained variables). Contributions welcome: proofs of the milestones, a conic duality lemma with sign-constrained multipliers, and Kronecker-product lemmas such as (Ik⊗A)(y⊗z)=y⊗Az.
Bridging Bayesian and Minimax Mean Square Error Estimation via Wasserstein Distributionally Robust Optimization 2: The Fully Adaptive Frank-Wolfe Algorithm Converges LinearlyResearch Paper
Motivation
The Frank-Wolfe algorithm (also called the conditional gradient method) minimizes a smooth convex function over a compact convex set using only a linear minimization oracle in place of a projection. Each step solves a linearized problem over the feasible set and moves toward its solution. This makes it the method of choice when projections are expensive but linear subproblems are cheap or have closed-form solutions: nuclear-norm balls, polytopes, and the semidefinite feasible sets that come up in distributionally robust estimation.
Nguyen, Shafieezadeh-Abadeh, Kuhn and Mohajerin Esfahani (arXiv:1911.03539v2, Math. Oper. Res. 48(1), 2023) need such a method for a nonlinear semidefinite program that computes Wasserstein minimax mean square error estimators. Its feasible set is not strongly convex in the traditional sense, and the linear subproblems can only be solved approximately. Section 6.1 of the paper analyses a fully adaptive Frank-Wolfe algorithm under these conditions: it uses an inexact oracle, a backtracking estimate of the smoothness constant, and a weakened, gradient-dependent notion of strong convexity of the feasible set. The section proves a linear convergence rate. This mission formalizes that rate and the lemmas of its proof.
Timeline. Frank and Wolfe (1956) introduced the method for quadratic programs. Levitin and Polyak (1966) proved linear convergence over strongly convex sets when the gradient is bounded away from zero, with the adaptive stepsize (6.4); Garber and Hazan (2015) revisited this regime. Pedregosa, Négiar, Askari and Jaggi (2020) introduced the backtracking line search with adaptive smoothness parameters β_t used here, and proved its sublinear O(1/t) rate. Section 6.1 combines that line search with inexact oracles and blockwise strong convexity with respect to f.
Setting
The decision variable is s=(s[1],…,s[K]) with blocks s[k]∈Rdk, and Rd1×⋯×RdK carries the Euclidean norm ∥s∥2=∑k∥s[k]∥2. The problem is
f⋆=s∈Sminf(s),
where S=×k=1KS[k] is a product of convex compact sets and f is convex and differentiable on S. The partial gradient with respect to block k is ∇[k]f(s).
An inexact oracle with precisionδ∈[0,1] is a map F:S→S with
(F(s)−s)⊤∇f(s)≤δz∈Smin(z−s)⊤∇f(s).
For δ=1 it returns an exact solution of the linearized problem. At a point s the search direction is d=F(s)−s and the surrogate duality gap is g=−d⊤∇f(s)≥0.
Assumption 6.1 consists of three conditions:
β-smoothness: ∥∇f(s)−∇f(sˉ)∥≤β∥s−sˉ∥ on S;
α-strong convexity of the blocks with respect tof: for all s,sˉ∈S, θ∈[0,1] and k,
Algorithm 1 starts from s0∈S with parameters β−1>0, τ>1 and ζ>1. At iteration t it sets dt=F(st)−st and gt=−dt⊤∇f(st). It then picks βt as the smallest element of (βt−1/ζ)⋅{1,τ,τ2,…} that passes the sufficient-decrease test
The result. Theorem 6.2 gives a linear rate for a Frank-Wolfe method that never needs the global smoothness constant β, that tolerates approximate linear subproblems, and that works on feasible sets which are strongly convex only in the weak, gradient-dependent sense of Assumption 6.1 (ii). In the paper it justifies the algorithm used to compute Nash equilibria of Wasserstein minimax MMSE estimation problems at dimensions where interior-point SDP solvers run out of memory. The analysis is generic and applies to any problem meeting Assumption 6.1.
Formalizing it. The result is proved in the paper, but the printed constant is wrong. In Lemma 6.3 (ii) the factor δθ(1−θ)/(1−δθ) is maximized at θ⋆=(1−1−δ)/δ, where it equals (1−1−δ)2/δ; the page drops the square. Lemma 6.3 (ii), (6.12) and Theorem 6.2 are therefore false as printed for δ∈(0,1). A two-dimensional instance (unit disk, linear objective, δ=0.19) violates the printed rate after one step. The printed and corrected rates agree for an exact oracle (δ=1). The mission states the corrected constant throughout and quotes the printed text in the milestones. No machine-checked proof of a linear rate for Frank-Wolfe with adaptive line search is known to us.
Difficulty
The obvious argument, "β-smoothness plus a contraction per step", does not go through directly. The line search may pick βt far below β, so the contraction factor in case (ii) is controlled by βt and needs the separate fact that βt never exceeds max{τβ,β−1}. That fact depends on βt being the smallest accepted trial value, and it fails for an arbitrary accepted one. The lower bound of Lemma 6.3 (ii) comes from testing the oracle inequality against a point built from Assumption 6.1 (ii). That point is assembled block by block, and the step back to ∥dt∥2 uses the Euclidean (not the sup) norm on the product space. The constant then comes from an explicit one-variable optimization, which is where the printed proof errs.
Formalization scope
The space is PiLp 2 (fun k : Fin K => EuclideanSpace ℝ (Fin (d k))), so ‖·‖ is Euclidean and ∇[k]f(s) is the block gradient f s k. Conventions:
f is a function on the whole space, convex on S and differentiable at every point of S;
f⋆ is a real number that is the least element of f(S);
the minimum in (6.2) is written as "≤ δ (z − s)ᵀ∇f(s) for all z ∈ 𝒮", which is equivalent on the compact set 𝒮;
each of β,α,ε is positive and δ∈[0,1];
the run of Algorithm 1 is infinite (no stopping criterion), and "smallest element" is encoded as an index j that passes with all i<j failing;
at dt=0, where the page's stepsize is undefined, Lean's 0/0=0 gives ηt=0.
Disclosed changes relative to the page:
the square in (1−1−δ)2 in Lemma 6.3 (ii), (6.12) and Theorem 6.2;
δ>0 in Lemma 6.3 (ii), and δθ<1 in (6.8), where the page divides by these quantities;
nonzero partial gradients at the point in (6.8) and Lemma 6.3 (ii), so the normalization of Assumption 6.1 (ii) is defined;
(6.10) is stated with −ηtgt, which is what (6.5) gives (the printed −gt is valid only when ηt=1);
the inner-loop iteration count, which contains a typo, is replaced by termination;
minima over k are expressed through an arbitrary lower bound m of all ∥∇[k]f(s)∥.
Trivializing readings are excluded. A sorry-free companion file exhibits, for every δ∈[0,1], an instance (interval [−1,1], linear objective, exact oracle) satisfying every hypothesis of the goal, together with an explicit infinite run whose initial suboptimality is positive. The run predicate forces the smallest accepted βt, and the norm is Euclidean.
Everything needed is in Mathlib: gradients in Hilbert spaces, convexity, PiLp. The descent lemma along a segment for a function with Lipschitz gradient on a convex set, used for (6.9), is reusable beyond this mission. Contributions welcome: proofs of the milestones, and a Lean proof that the printed constant fails on the disk instance.
Selected references
V. A. Nguyen, S. Shafieezadeh-Abadeh, D. Kuhn, P. Mohajerin Esfahani, Bridging Bayesian and Minimax Mean Square Error Estimation via Wasserstein Distributionally Robust Optimization, Math. Oper. Res. 48(1), 2023. arXiv:1911.03539v2, doi:10.1287/moor.2021.1176
M. Frank, P. Wolfe, An algorithm for quadratic programming, Naval Res. Logist. Q. 3, 1956. doi:10.1002/nav.3800030109
E. S. Levitin, B. T. Polyak, Constrained minimization methods, USSR Comput. Math. Math. Phys. 6(5), 1966. doi:10.1016/0041-5553(66)90114-5
D. Garber, E. Hazan, Faster rates for the Frank-Wolfe method over strongly-convex sets, ICML 2015. arXiv:1406.1305
F. Pedregosa, G. Négiar, A. Askari, M. Jaggi, Linearly convergent Frank-Wolfe with backtracking line-search, AISTATS 2020. arXiv:1806.05123
On the tightness of SDP relaxations of QCQPs 1: Polyhedral Γ and Large Shared Zero Eigenspaces on Semidefinite Faces Give conv(D) = D_SDP and Opt = Opt_SDPResearch Paper
Motivation
Quadratically constrained quadratic programs (QCQPs) minimize a quadratic function subject to quadratic inequality and equality constraints. They model facility location, pooling, max-cut, trust-region steps and robust optimization problems, and every {0,1} integer program can be written as one; in general they are NP-hard. The standard tractable approach is the Shor semidefinite relaxation, which lifts x to the matrix xx⊤ and relaxes the rank-one condition to positive semidefiniteness. A recurring question is when this relaxation loses nothing: when its optimal value equals that of the QCQP (SDP tightness), and, more strongly, when its projected epigraph equals the convex hull of the QCQP's epigraph (convex hull exactness). The second property also describes the convex hull of the nonconvex feasible set's epigraph, which is useful in branch-and-bound and cutting-plane methods.
Timeline. The S-lemma (Yakubovich, 1971) gives SDP tightness for one inequality constraint, and Fujie and Kojima (1997) recorded the dual description of the SDP value used below. For the trust-region subproblem and its generalization, convex hull descriptions of the epigraph were given by Ho-Nguyen and Kılınç-Karzan (2017) and by Wang and Kılınç-Karzan (arXiv:1907.08843, 2019). Beck (2007) and Beck, Drori and Teboulle (2012) gave SDP tightness results for quadratic matrix programs. Wang and Kılınç-Karzan, On the tightness of SDP relaxations of QCQPs (arXiv:1911.09195v3, Math. Program. 2021), introduced a general framework based on the faces of a dual set Γ and proved convex hull and tightness results for polyhedral Γ and for QCQPs with large quadratic eigenvalue multiplicity. This mission formalizes the paper's first convex hull theorem (Theorem 1, p. 13) and the framework it rests on.
Setting
Fix N variables and m≥1 constraints, the first mI inequalities and the remaining mE=m−mI equalities. Each function is
The QCQP (1) is Opt=inf{q0(x):qi(x)≤0(i≤mI),qi(x)=0(i>mI)}, and its epigraph is D={(x,t):x feasible,q0(x)≤2t}.
With Qi=(cibibi⊤Ai) and Y=(1xx⊤X), the SDP relaxation (3) minimizes ⟨Q0,Y⟩ over X∈SN with Y⪰0 and the constraints ⟨Qi,Y⟩≤0 or =0; its value is OptSDP and its projected epigraph is DSDP={(x,t):∃X,(x,X) feasible,⟨Q0,Y⟩≤2t} (4). Always conv(D)⊆DSDP and Opt≥OptSDP.
For γ∈Rm let A(γ)=A0+∑iγiAi, and similarly b(γ), c(γ) and the Lagrangian q(γ,x)=q0(x)+∑iγiqi(x). The dual object is
Γ={γ∈Rm:A(γ)⪰0,γi≥0for i≤mI}.
Assumption 1: the QCQP is feasible and some γ∗ with γi∗≥0 for i≤mI has A(γ∗)≻0. Assumption 3: Γ is polyhedral. For x^∈RN, F(x^)=argmaxγ∈Γq(γ,x^). A faceF of Γ is definite if some γ∈F has A(γ)≻0 and semidefinite otherwise, with shared zero eigenspaceV(F)={v:A(γ)v=0∀γ∈F}. Finally affdim denotes affine dimension.
Formalization targets
Goal: Theorem 1 (p. 13)
Under Assumptions 1 and 3, if every semidefinite face F of Γ satisfies dimV(F)≥affdim{b(γ):γ∈F}+1, then
conv(D)=DSDPandOpt=OptSDP.
Milestones
Lemma 1 (p. 7): under Assumption 1, DSDP={(x,t):supγ∈Γq(γ,x)≤2t} and OptSDP=minxsupγ∈Γq(γ,x).
Lemma 2 (p. 9): a semidefinite face has a unit vector in V(F).
Lemma 3 (p. 9): under Assumptions 1 and 2, a point of DSDP with definite F(x^) lies in D.
Observation 1 (p. 10): under Assumption 1, a face of affine dimension m is definite.
Lemma 4 (p. 10): under Assumptions 1, 2 and the decomposition condition (7), the two conclusions of Theorem 1 hold.
Lemma 8 (p. 13): under Assumption 3, Γ=Γe+cone(Γr) with polytopes Γe,Γr, and F(x^)=Fe(x^)+cone(Fr(x^)) when the supremum is finite.
Lemma 7 (p. 13): under the hypotheses of Theorem 1, condition (7) holds.
Companions
Lemma 6 (p. 11: dimV(F)≥k for the quadratic eigenvalue multiplicity k), Theorem 2 (p. 15: the hypothesis of Theorem 1 with k in place of dimV(F)), and Corollaries 1–4 (pp. 16–18: convex quadratic programs, one constraint, bi=0, scalar quadratic forms with m≤N).
Significance
The result. Theorem 1 gives a checkable sufficient condition, stated on the faces of a polyhedral dual set, under which the Shor relaxation is exact in the strongest sense: it describes conv(D), so the SDP value equals the QCQP value and, by Remark 7, conv(D) is second-order cone representable. Through Lemma 6 it becomes Theorem 2, the symmetry condition k≥affdim{b(γ)}+1; its corollaries recover the convex hull results for the trust-region subproblem and its generalization and give new ones for simultaneously diagonalizable and "Swiss cheese" problems. The sharpness of the bound is shown in §4.3 of the paper.
Formalizing it. The theorem is proved in the paper; nothing in it is machine-checked. A formal proof needs strong conic duality for the SDP in Lemma 1, the Minkowski–Weyl decomposition in Lemma 8, and the face-by-face decomposition argument of Lemma 7. These pieces are shared with the paper's SDP tightness result (Theorem 3), which uses Lemmas 1–3 and 8 again.
Difficulty
The obvious attempt is to take (x^,t^)∈DSDP, recover a rank-one solution of the SDP, and read off a point of D. This fails because an optimal Y need not have rank one, and a rank-reduction step can leave the feasible set of a nonconvex constraint. The paper instead moves (x^,t^) along a direction v in the shared zero eigenspace of the face F(x^), and must show that both endpoints of the move stay in DSDP while the face strictly grows in affine dimension. Controlling the endpoints needs finiteness of the relevant family of quadratic functions, which is where polyhedrality enters; without it (§4.3) the argument and the theorem fail. Lemma 1 also needs a strong duality theorem for semidefinite programs with a minimax step, neither of which is elementary in Lean.
Formalization scope
The Lean development lives in the namespace QCQPTightness.ConvHull. A QCQP is a structure with symmetric A0,Ai, vectors b0,bi, scalars c0,ci and a count mI≤m; constraints are indexed by Fin m, constraint i being an inequality exactly when i<mI. Conventions:
Opt and OptSDP are infima in EReal, never real infima; points of RN+1 are pairs (x,t), and conv is convexHull ℝ.
Faces of Γ are nonempty convex extreme subsets; the page's convention affdim∅=−1 makes the empty face irrelevant, while Lean's affine dimension of ∅ would be 0.
"supγ∈Γq(γ,x)≤2t" is written ∀γ∈Γ,q(γ,x)≤2t; "a convex combination of points with property P" is membership in the convex hull of the set of such points; the unit sphere is v⊤v=1.
The goal carries exactly the paper's hypotheses plus its standing assumption m≥1 (p. 1); Assumption 2 is not assumed because Assumption 3 implies it.
Lemma 8 is printed with "Fr(x^) is the face of Γe"; it is formalized with Γr, as the proof and Lemma 7 use it.
A trivializing formalization would assume condition (7), the decomposition of Lemma 8, or any property of F(x^) in the goal; the goal assumes none of these, and the dimension hypothesis is satisfiable with semidefinite faces present (for q0=−x2, q1=x2−1, the face {γ1=1} is semidefinite with dimV=1).
Infrastructure needed: SDP strong duality (the platform has ConvexOptimization.sdp_strong_duality), the Minkowski–Weyl theorem for polyhedra, faces of convex sets and affine dimension. Proofs of any milestone, of the companions, and reusable lemmas about faces of spectrahedra are welcome.
T. Fujie, M. Kojima, Semidefinite programming relaxation for nonconvex quadratic programs, J. Global Optim. 10 (1997) 367–380. https://doi.org/10.1023/A:1008282830093
N. Ho-Nguyen, F. Kılınç-Karzan, A second-order cone based approach for solving the trust-region subproblem and its variants, SIAM J. Optim. 27 (2017) 1485–1512. https://doi.org/10.1137/16M1065197
A. L. Wang, F. Kılınç-Karzan, The generalized trust region subproblem: solution complexity and convex hull results, arXiv:1907.08843 (2019). https://arxiv.org/abs/1907.08843
Understanding the Acceleration Phenomenon via High-Resolution Differential Equations V: Along the High-Resolution ODE of NAG-C, inf ‖∇f(X(u))‖² ≤ (12 + 9sL)‖x₀ − x⋆‖²/(2√s(t³ − t₀³))Research Paper
Motivation
Nesterov's accelerated gradient method for smooth convex functions, called NAG-C in the source paper, minimizes an L-smooth convex function f with function values decreasing at the rate O(L/k2). That rate is optimal among first-order methods (Nesterov, 1983). A line of work starting with Su, Boyd & Candès (2016) studies such methods through ordinary differential equations obtained in the limit of vanishing step size. Their low-resolution ODEX¨+t3X˙+∇f(X)=0 reproduces the O(1/t2) function-value rate. The same ODE also models the heavy-ball method, so it cannot explain why Nesterov's method behaves differently from heavy-ball.
Shi, Du, Jordan & Su (arXiv:1810.08907v3) keep the O(s) terms of the limit, where s is the step size. The resulting high-resolution ODEs contain a gradient-correction term s∇2f(X)X˙, which is absent from the heavy-ball ODE. This mission formalizes the paper's analysis of the high-resolution ODE of NAG-C (Section 4.1, pp. 21–24). Along this ODE the smallest squared gradient norm up to time t decays like 1/t3, while the low-resolution ODE gives only 1/t2. Small gradients are the natural stopping criterion in practice and the natural target in nonconvex and dual problems, which is why the squared gradient norm is studied separately from function values (Nesterov, 2012).
Setting
Let f:Rn→R have gradient ∇f and Hessian ∇2f. For L>0, the class FL1(Rn) consists of the differentiable f with
With s=0 it reduces to the Lyapunov function of Su, Boyd and Candès.
Formalization targets
Goal: Theorem 5 (p. 21)
For every f∈FL2(Rn), every step size s>0, and every solution X of (1.12),
t0≤u≤tinf∥∇f(X(u))∥2≤2s(t3−t03)(12+9sL)∥x0−x⋆∥2for all t>t0.
With s=1/L this is O(L/t3). The infimum cannot be dropped, because the gradient norm need not decrease along the trajectory.
Milestones (pp. 22–23)
The exact derivative of E along (1.12) (first display of the proof of Lemma 4.1, p. 23).
Lemma 4.1, (4.2): dtdE≤−[st2+(L1+2s)t+2Ls]∥∇f(X)∥2 for t≥t0.
The integrated form: ∫t0t[su2+(L1+2s)u+2Ls]∥∇f(X(u))∥2du≤E(t0)−E(t)≤E(t0).
(4.3): the infimum is at most E(t0) divided by s(t3−t03)/3+(L1+2s)(t2−t02)/2+2Ls(t−t0).
E(t0)≤3s⋅2L∥x0−x⋆∥2+2∥x0−x⋆∥2, from the initial conditions.
(4.4): the same bound as (4.3) with numerator (2+1.5sL)∥x0−x⋆∥2. Keeping only the cubic term of the denominator gives Theorem 5.
A companion item states Corollary 4.2 (p. 24): f(X(t))−f(x⋆)≤t(2t+s)(4+3sL)∥x0−x⋆∥2 for t>t0.
Significance
Theorem 5 is the continuous-time model of the paper's Theorem 6, which shows that NAG-C itself, without modification, drives mini≤k∥∇f(xi)∥2 to zero at the rate O(L2/k3). Combining the O(1/t2) function-value rate with ∥∇f∥2≤2L(f−f⋆) gives only O(L/t2). Previously known O(L2/k3) rates required modified methods (Ghadimi & Lan, 2016). The proof attributes the improvement to the gradient-correction term: the factor ∥∇f(X)∥2 in Lemma 4.1 comes from the term ts∇f(X) in (4.1), which exists only because of the Hessian term in (1.12). The authors conjecture that the low-resolution ODE does not achieve the 1/t3 rate (p. 23).
The results of Section 4.1 are proved in the paper; no machine-checked version of them is known. Formalizing them produces a checked Lyapunov analysis of a second-order ODE with Hessian damping and explicit constants. It also gives a template that the discrete analysis of NAG-C (a separate mission in this series) mirrors step by step. Related Hessian-damped systems are analysed in Attouch, Chbani, Fadili & Riahi (2020), with qualitative integrability conclusions instead of an explicit bound on the infimum.
Difficulty
The obvious route goes through the function-value rate and the inequality ∥∇f∥2≤2L(f−f⋆). It loses a factor of t and yields only 1/t2. The cubic rate needs a Lyapunov function whose derivative contains a term proportional to t2∥∇f(X)∥2. Proving the derivative identity requires differentiating t↦∇f(X(t)) through the chain rule with the Hessian, and then cancelling that derivative against the gradient-correction term of the ODE. The derivative bound also uses the co-coercivity inequality f(x⋆)≥f(X)+⟨∇f(X),x⋆−X⟩+2L1∥∇f(X)∥2 of L-smooth convex functions. The remaining steps are measure-theoretic: integrate a one-sided derivative bound on [t0,t], and compare an infimum with a weighted average.
Formalization scope
Rn is EuclideanSpace ℝ (Fin n), ∇f is Mathlib's gradient, and ∇2f(x)v is the Fréchet derivative of the gradient map applied to v.
The classes FL1 and FL2 are stated in the first-order form printed on p. 8. The Hessian's Lipschitz constant is existential, since the paper fixes none.
The minimizer x⋆ is a hypothesis f(x⋆)≤f(z) for all z. The paper presupposes it exists.
The step size is any s>0; there is no condition s≤1/L.
A solution of (1.12) is a pair (X,V) with X(t0)=x0 and V(t0)=−s∇f(x0). For every t≥t0, X has derivative V(t) and V has the derivative prescribed by (1.12), both relative to [t0,∞).
Every statement quantifies over all solutions. Existence and uniqueness (the paper's Proposition 2.2) are not assumed.
The infimum inft0≤u≤t ranges over the points of the interval [t0,t]. Statements involving it hold for t>t0, as on the page.
Derivative bounds assert that the derivative exists.
The integral bound asserts integrability of its integrand.
Ruled out. A formalization would hold for junk reasons in any of these cases: the infimum is written as a bounded infimum over all reals (in Lean this is ≤0); the velocity is not tied to X˙; the goal is stated at t=t0 (where Lean divides by 0); or derivatives are written with deriv, which is 0 where a function is not differentiable. The statements here avoid all of these.
Infrastructure. A complete development needs:
the chain rule for ∇f∘X along a path;
the co-coercivity inequality for L-smooth convex functions;
the fundamental theorem of calculus for one-sided derivatives on [t0,t];
the mean-value comparison of an infimum with a weighted average.
The co-coercivity inequality and the interval-integral comparison are reusable beyond this mission. Proofs of the milestones in any order are welcome, as are independent proofs of the goal.
Selected references
B. Shi, S. S. Du, M. I. Jordan, W. J. Su, Understanding the Acceleration Phenomenon via High-Resolution Differential Equations, arXiv:1810.08907v3, 2018; Math. Program. (2021), DOI 10.1007/s10107-021-01681-8. https://arxiv.org/abs/1810.08907
W. Su, S. Boyd, E. J. Candès, A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights, J. Mach. Learn. Res. 17(153), 2016. https://arxiv.org/abs/1503.01243
Y. Nesterov, A method of solving a convex programming problem with convergence rate O(1/k²), Soviet Math. Dokl. 27, 1983. https://www.mathnet.ru/eng/dan46009
S. Ghadimi, G. Lan, Accelerated gradient methods for nonconvex nonlinear and stochastic programming, Math. Program. 156, 2016. https://arxiv.org/abs/1310.3787
H. Attouch, Z. Chbani, J. Fadili, H. Riahi, First-order optimization algorithms via inertial systems with Hessian driven damping, Math. Program., 2020. https://arxiv.org/abs/1907.10536
Understanding the Acceleration Phenomenon via High-Resolution Differential Equations IV: The High-Resolution Heavy-Ball ODE Satisfies f(X(t)) − f(x⋆) ≤ 7‖x₀ − x⋆‖² e^(−√μ t/4)/(2s)Research Paper
Why a high-resolution ODE for the heavy-ball method
Polyak's heavy-ball method and Nesterov's accelerated gradient method for strongly convex functions (NAG-SC) are the two classical momentum methods of smooth convex optimization. With step size s and momentum α=(1−μs)/(1+μs) they differ only by a gradient-correction term, yet NAG-SC is accelerated for every μ-strongly convex, L-smooth objective while the heavy-ball method can fail to converge outside the quadratic case (Lessard, Recht & Packard 2016). The classical continuous-time limit cannot see this difference: as s→0 both methods converge to the same low-resolution ODEX¨+2μX˙+∇f(X)=0 (Su, Boyd & Candès 2016 treat the convex analogue).
Shi, Du, Jordan & Su (2018/2021) keep the O(s) terms of the limit and obtain high-resolution ODEs, one per method, which do distinguish the two algorithms. This mission formalizes their convergence theorem for the high-resolution ODE of the heavy-ball method (Theorem 2 of arXiv:1810.08907v3). A companion mission in the same series treats the high-resolution ODE of NAG-SC (Theorem 1), whose only difference is a Hessian-driven damping term s∇2f(X)X˙.
Setting
Work in Rn with the standard inner product ⟨⋅,⋅⟩ and Euclidean norm ∥⋅∥. A function f:Rn→R belongs to FL1(Rn) if L>0, f is differentiable and convex in the form f(y)≥f(x)+⟨∇f(x),y−x⟩, and ∥∇f(x)−∇f(y)∥≤L∥x−y∥ for all x,y. It belongs to Sμ,L1(Rn) if moreover 0<μ≤L and
f(y)≥f(x)+⟨∇f(x),y−x⟩+2μ∥y−x∥2for all x,y,
and to Sμ,L2(Rn) if in addition f is twice continuously differentiable with a Lipschitz-continuous Hessian. Write x⋆ for the minimizer of f.
Given a step size s>0 and an initial point x0, the high-resolution ODE of the heavy-ball method is
The coefficient inequality, p. 14: for 0<μs≤1, the bracket above is <7/2.
Significance
The result. Theorem 2 gives a linear rate e−μt/4 for the heavy-ball ODE with an explicit constant, valid for every Sμ,L2 objective and every step size up to 1/L. Read next to Theorem 1 (rate e−μt/4, constant 2/s for the NAG-SC ODE), it shows that at the continuous level both high-resolution ODEs converge at the accelerated rate; the paper locates the difference between the two discrete methods in the discretization, where only the gradient correction of NAG-SC lets the Lyapunov argument survive (its Theorems 3 and 4 and §3.3). The Lyapunov function (3.3) is the NAG-SC function (2.4) with the s∇f(X) term removed, and the two coincide at s=0.
Formalizing it. The result is proved in the paper; to our knowledge no machine-checked proof exists. The mission produces a checked chain from the ODE to the rate: a one-sided derivative computation along a trajectory in Rn, a differential inequality, a Grönwall-type integration, and a closed-form estimate of E(0) from the initial conditions and L-smoothness. The derivative computation and the Grönwall step reuse directly in the companion missions on the NAG-SC and NAG-C high-resolution ODEs.
Difficulty
The algebra is short; the formal difficulty is analytic. The derivative of t↦f(X(t)) must be obtained by the chain rule from a one-sided derivative of X at t=0 and f's differentiability, and the derivative of the two squared norms from those of X and V=X˙. Passing from Lemma 3.2 to E(t)≤e−μt/4E(0) is a comparison argument for a function known only to have one-sided derivatives on [0,∞); the naive route through dtd(eμt/4E)≤0 requires a monotonicity theorem for functions with derivatives within a half-line. Finally, the estimate of E(0) needs f(x0)−f(x⋆)≤2L∥x0−x⋆∥2 and ∥∇f(x0)∥≤L∥x0−x⋆∥, both consequences of L-smoothness and ∇f(x⋆)=0 that must be derived from the class definition, and the constant 7/2 needs a one-variable inequality in μs∈(0,1].
Formalization scope
Rn is EuclideanSpace ℝ (Fin n), ∇f is Mathlib's gradient, and ∇2f(x) is fderiv ℝ (gradient f) x. The classes FL1, Sμ,L1, Sμ,L2 are structures carrying the paper's first-order inequalities (§1.4, p. 8), with 0<μ≤L; the Lipschitz constant of the Hessian is existential, as the paper fixes none. The minimizer is a point x⋆ with f(x⋆)≤f(z) for all z.
A solution of (1.10) is a pair of curves X,V:R→Rn with X(0)=x0, V(0)=−2s∇f(x0)/(1+μs), V(t) the derivative of X and −2μV(t)−(1+μs)∇f(X(t)) the derivative of V at every t≥0, both taken within [0,∞); values for t<0 play no role. The theorems quantify over every such solution. Existence and uniqueness (the paper's Propositions 2.1–2.2) are not assumed, and no a priori bound on X or V is added. Derivative claims assert that the derivative exists and has the stated value or bound, so a statement cannot hold merely because a derivative is undefined. The goal states the decay of f(X(t))−f(x⋆) with the printed constant 7/(2s); it does not assume any decay of E, and an ODE predicate in which V is not the derivative of X would be a different, trivial statement.
All drafts live in the namespace HighResODE.HeavyBallODE, with one definitions file (classes, ODE, Lyapunov function). Contributions are welcome at every milestone; a general lemma "φ′≤−cφ within [0,∞) implies φ(t)≤e−ctφ(0)" and the L-smoothness estimates around a minimizer are reusable well beyond this mission.
Selected references
B. Shi, S. S. Du, M. I. Jordan, W. J. Su, Understanding the Acceleration Phenomenon via High-Resolution Differential Equations, Mathematical Programming (2021); cited here in its preprint version arXiv:1810.08907v3. https://arxiv.org/abs/1810.08907
W. Su, S. Boyd, E. J. Candès, A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights, Journal of Machine Learning Research 17 (2016). https://arxiv.org/abs/1503.01243
L. Lessard, B. Recht, A. Packard, Analysis and Design of Optimization Algorithms via Integral Quadratic Constraints, SIAM Journal on Optimization 26 (2016). https://arxiv.org/abs/1408.3595
B. T. Polyak, Some methods of speeding up the convergence of iteration methods, USSR Computational Mathematics and Mathematical Physics 4 (1964). https://doi.org/10.1016/0041-5553(64)90137-5
From Differential Equation Solvers to Accelerated First-Order Methods for Convex Optimization 6: Nesterov's Method Has ℒ_k ≤ ℒ₀·min{4L/(√γ₀k + 2√L)², (1 − √(min{γ₁, μ}/L))^k}Research Paper
Motivation
Nesterov's accelerated gradient method minimises a smooth convex function f to accuracy ε in O(L/ε) gradient evaluations, and a μ-strongly convex one in O(L/μlog(1/ε)); both counts match the lower bounds for first-order methods. Nesterov's own analysis (Y. Nesterov, Introductory Lectures on Convex Optimization, 2004, Ch. 2) proceeds by estimate sequences, an algebraic device that certifies the rate but says little about where the method comes from. Since Su, Boyd and Candès (arXiv:1503.01243), accelerated methods have been read as discretisations of ordinary differential equations, with convergence proved by discrete Lyapunov functions.
H. Luo and L. Chen, From differential equation solvers to accelerated first-order methods for convex optimization (arXiv:1909.03145, Math. Program. 2022), introduce the NAG flow, a first-order system in a position x, an auxiliary variable v and a scaling parameter γ whose Lyapunov function decays exponentially for every μ≥0. In §6 they show that Nesterov's general scheme of optimal method (Algorithm 1) is itself a corrected semi-implicit discretisation of this flow, and they reprove its rates with one Lyapunov function that covers μ=0 and μ>0 at once. This mission formalises that analysis, Theorem 6.1.
Setting
Let V be a real Hilbert space with inner product ⟨⋅,⋅⟩ and norm ∥⋅∥. A function f:V→R with gradient map ∇f belongs to Sμ1 (μ≥0) if it is continuously differentiable and μ-convex,
f(x)−f(y)−⟨∇f(y),x−y⟩≥2μ∥x−y∥2∀x,y∈V,
and to Sμ,L1,1 if moreover ∇f is L-Lipschitz, with 0≤μ≤L<∞. A point x∗ minimises f globally.
Algorithm 1 (Nesterov accelerated gradient method) takes x0,v0∈V and γ0>0. For k=0,1,… it computes the positive root αk of Lαk2=(1−αk)γk+μαk, sets γk+1=(1−αk)γk+μαk and
yk=γk+μαkαkγkvk+γk+1xk,
chooses any xk+1 with the sufficient decreasef(xk+1)≤f(yk)−2L1∥∇f(yk)∥2 (for instance the gradient step xk+1=yk−L1∇f(yk)), and sets
vk+1=γk+11[(1−αk)γkvk+αk(μyk−∇f(yk))].
The Lyapunov function is
Lk=f(xk)−f(x∗)+2γk∥vk−x∗∥2,(74)
and Cγ0,L=γ0L(f(x0)−f(x∗))+2L∥v0−x∗∥2 (89).
Formalization targets
Goal: Theorem 6.1
For f∈Sμ,L1,1, every run of Algorithm 1 has 0<αk≤1 and
All four conclusions are part of the goal: (98) alone does not carry a rate.
Milestones
The equivalent form (96)–(97) (p. 24): Algorithm 1 is the scheme αkγk+1−γk=μ−γk, αkyk−xk=γk+1γk(vk−yk), αkvk+1−vk=γk+1μ(yk−vk)−γk+11∇f(yk) with the decrease step (97) and Lαk2=γk+1.
The formulas for vk and vk+1 in terms of yk, xk, ∇f(yk) (p. 24).
The direct-computation identity for 2γk+1∥vk+1−x∗∥2−2γk(1−αk)∥vk−x∗∥2 (p. 24).
Its μ-convexity bound (p. 25).
The one-step boundLk+1−(1−αk)Lk≤f(xk+1)−f(yk)+2γk+1αk2∥∇f(yk)∥2 (p. 25).
Lemma B.1 (p. 37): for Lkαk2=γk+1, γk+1=(1−αk)γk+μαk, positivity, αk≤1, αk≥min{γ1,μ}/L, and the bounds (129)–(130) on ∏i<k(1−αi).
A companion item states (103) of Remark 6.3 for Algorithm 1: with μ=0, γ0=L, v0=x0, f(xk)−f(x∗)≤k24L∥x0−x∗∥2.
Significance
Theorem 6.1 recovers, by a Lyapunov argument, the optimal rates of Nesterov's method in both regimes: O(L/(γ0k2)) for convex f and (1−μ/L)k for strongly convex f once γ1≥μ, with the parameter γk moving between them automatically. It covers every sufficient-decrease choice of xk+1, not only the gradient step, and it places Nesterov's method in the same family as the predictor–corrector and gradient-corrected schemes of §5, whose analyses share the Lyapunov function (74) and the rate lemmas of Appendix B. Comparing (99) with the rate (1+μ/L)−k of those schemes shows that Nesterov's method is slightly faster per step, with the same complexity.
The result is proved in the paper; the proof of (100) is omitted as similar to that of (88). Nesterov's rates for related parameterisations have been stated on this platform (Bubeck's monograph, Theorems 3.18–3.19), but not for Algorithm 1 with the adaptive parameter γk, and no machine-checked proof of Theorem 6.1 or Lemma B.1 is known. A formalisation checks the omitted step, pins down where αk≤1 is used, and adds a discrete Lyapunov toolkit for accelerated methods in Hilbert space.
Difficulty
Reading Algorithm 1 directly gives a three-sequence recursion with no visible monotone quantity: f(xk) itself need not decrease. The contraction (98) holds only for the specific combination (74), and only after the cross terms in ∇f(yk) produced by the v-update are matched exactly against the sufficient-decrease step; any slack in the step rule Lαk2=γk+1 leaves a positive gradient term. A second difficulty is uniformity in μ: when μ=0 the linear factor 1−min{γ1,μ}/L equals 1, so the O(1/k2) rate must come from a separate estimate of ∏i<k(1−αi) in terms of the step sizes, which are defined only implicitly by a quadratic equation.
Formalization scope
V is a real Hilbert space (NormedAddCommGroup, InnerProductSpace ℝ, CompleteSpace); the paper's duality pairing and dual norm are the inner product and the norm (Riesz identification).
The gradient is an explicit map gradf : V → V with HasGradientAt f (gradf x) x at every point; Mathlib's gradient is not used.
The classes are structures IsS1 and IsS11; Sμ,L1,1 includes 0<L and μ≤L, and the upper bound (4) is a consequence, not an assumption.
A run of Algorithm 1 is a structure IsNAGRun of hypotheses on given sequences, one per step. Step 2 records only αk>0 (the page writes αk∈(0,1), but αk=1 occurs when μ=L, and αk≤1 is a conclusion of the theorem). Step 5 is an inequality, not the gradient step. The step sizes are not replaced by a closed form.
x∗ is a global minimiser of f (the paper's standing assumption, p. 2); γ1 is the value produced by the run.
Indices start at 0; (1−s)k and (1−s)k−1 are natural powers, with (100) stated for k≥1; (99) is stated for all k≥0.
Milestones 2 and 3 are stated for one step of (96) with αk,γk,γk+1>0; milestones 4 and 5 along runs of Algorithm 1 under the hypotheses of Theorem 6.1.
In Lemma B.1, L:=supkLk is replaced by an arbitrary real upper bound L; the conclusions involving L weaken as L grows, so this is equivalent when the supremum is finite.
A statement that assumes the contraction (98) for arbitrary sequences, or fixes xk+1 to the gradient step, or states only (98), would not be Theorem 6.1 and is ruled out: the goal quantifies over all runs of Algorithm 1 and states all four conclusions.
Contributions welcome: proofs of Lemma B.1 (a self-contained statement about real sequences), the algebraic milestones 1–3, and the convexity steps 4–5. The definitions are local to this mission and duplicate those of the other missions of the series, to be merged later.
Selected references
H. Luo, L. Chen, From differential equation solvers to accelerated first-order methods for convex optimization, Math. Program. 195 (2022); arXiv:1909.03145v4. https://arxiv.org/abs/1909.03145
W. Su, S. Boyd, E. J. Candès, A differential equation for modeling Nesterov's accelerated gradient method: theory and insights, J. Mach. Learn. Res. 17 (2016); arXiv:1503.01243. https://arxiv.org/abs/1503.01243
S. Bubeck, Convex Optimization: Algorithms and Complexity, Found. Trends Mach. Learn. 8 (2015); arXiv:1405.4980. https://arxiv.org/abs/1405.4980
From Differential Equation Solvers to Accelerated First-Order Methods for Convex Optimization 4: The Predictor–Corrector Scheme Has ℒ_k ≤ ℒ₀·min{4L/(√γ₀k + 2√L)², (1 + √(min{γ₀, μ}/L))^(−k)}Research Paper
Motivation
Nesterov's accelerated gradient method minimises a smooth convex function f to accuracy ε in O(1/ε) gradient evaluations, and a μ-strongly convex one in O(L/μlog(1/ε)), which is optimal for first-order methods. The method's original derivation by estimate sequences gives little insight into why it accelerates. Since Su, Boyd and Candès (arXiv:1503.01243) a large literature reads accelerated methods as discretisations of second-order ordinary differential equations and proves their rates with Lyapunov functions transported from the continuous to the discrete setting.
H. Luo and L. Chen, From differential equation solvers to accelerated first-order methods for convex optimization (arXiv:1909.03145, Math. Program. 2022), introduce the NAG flow, a first-order system in a position variable x, a velocity-like variable v and a scaling parameter γ, whose Lyapunov function decays exponentially for every μ≥0. They then show that standard ODE-solver constructions applied to this flow (implicit Euler, Gauss–Seidel splitting, predictor–corrector, gradient correction) produce explicit methods with accelerated rates, and that Nesterov's method is one of them. This mission formalises the paper's analysis of the predictor–corrector scheme of §5.2, its first explicit accelerated method.
Setting
Let V be a real Hilbert space with inner product ⟨⋅,⋅⟩ and norm ∥⋅∥. A function f:V→R with gradient map ∇f belongs to Sμ1 (with μ≥0) if it is continuously differentiable and μ-convex:
f(x)−f(y)−⟨∇f(y),x−y⟩≥2μ∥x−y∥2∀x,y∈V.
It belongs to Sμ,L1,1 if moreover ∇f is L-Lipschitz with 0≤μ≤L<∞. The value μ=0 (plain convexity) is allowed throughout. A point x∗ minimises f globally.
The method keeps two iterates xk,vk, a step size αk>0 and a parameter γk>0 that evolves by the implicit parameter equation
αkγk+1−γk=μ−γk+1,γ0>0.(73)
The predictor–corrector scheme computes a predictor yk, then vk+1, then the corrector xk+1:
with Cγ0,L=γ0L(f(x0)−f(x∗))+2L∥v0−x∗∥2. All three conclusions are part of the goal; (86) alone would not carry the rate.
Milestones
Lemma 5.1 (p. 19): for one Gauss–Seidel step (80) with any αk>0 and f∈Sμ1, the estimates (81) and (82) on Lk+1−Lk.
The bound on Lk (p. 20), where Lk=f(yk)−f(x∗)+2γk+1∥vk+1−x∗∥2 (84).
The corrector relation (p. 20): xk+1−yk=1+αkαk(vk+1−vk).
Inequality (85) (p. 21): Lk+1≤1+αkLk+(2(1+αk)2Lαk2−2(1+αk)γk)∥vk+1−vk∥2 for any αk>0.
Lemma B.2 (pp. 38–39): positivity of γk, the lower bound αk≥min{γ0,μ}/L, and two-sided bounds on ∏i<k(1+αi)−1.
The α0 bound (p. 21): 1+α01≤γ0L when Lα02=γ0(1+α0).
Significance
Theorem 5.1 gives a single explicit method, with one gradient call per step and no restart, whose rate is O(L/(γ0k2)) when μ=0 and O((1+μ/L)−k) when μ>0 and γ0≥μ; the parameter γk interpolates between the two regimes automatically. Both rates are the optimal ones for first-order methods. The same Lyapunov argument, with Lemma B.2 as its rate engine, is reused in the paper for the gradient-corrected scheme (Theorem 5.2), Nesterov's method (Theorem 6.1) and the composite methods of §7, so the milestones of this mission are the shared core of the series.
The result is proved in the paper, with the proof of Lemma B.2 omitted as similar to that of Lemma B.1. No machine-checked proof of Theorem 5.1, Lemma 5.1 or Lemma B.2 is known. A formalisation checks the omitted proof, fixes the exact hypotheses of each step (which estimate needs only μ-convexity and which needs the Lipschitz gradient), and supplies a reusable discrete Lyapunov toolkit for accelerated methods in Hilbert space.
Difficulty
The obvious approach, imitating the continuous argument with the Gauss–Seidel splitting (80), fails: Lemma 5.1 leaves the cross term −αk⟨∇f(xk+1),vk+1−vk⟩, which has no sign, and bounding it by Cauchy–Schwarz as in (82) produces a positive gradient term that destroys the contraction. The predictor–corrector scheme is designed so that this cross term cancels exactly against the descent inequality for f between yk and xk+1, and the remaining square vanishes only under the precise step rule Lαk2=γk(1+αk). Turning the contraction into the rates (87)–(88) requires lower bounds on αk that hold uniformly in μ≥0, which is the content of Lemma B.2. When μ=0 the linear-rate bound is vacuous, so the O(1/k2) rate must come from a separate estimate.
Formalization scope
V is a real Hilbert space (NormedAddCommGroup, InnerProductSpace ℝ, CompleteSpace); the paper's duality pairing and dual norm are the inner product and the norm, by the Riesz identification.
The gradient is an explicit map gradf : V → V with HasGradientAt f (gradf x) x at every point; Mathlib's gradient, which is 0 at non-differentiable points, is not used.
The classes are structures IsS1 and IsS11. The class Sμ,L1,1 includes 0<L and μ≤L; the upper quadratic bound (4) is a consequence, not an assumption.
The scheme (83), the Gauss–Seidel step (80) and the parameter equation (73) are hypotheses on given sequences, each line in the paper's difference-quotient form. Implicit lines are kept as equations. The step sizes are any positive sequence satisfying Lαk2=γk(1+αk); no closed form is substituted.
x∗ is a global minimiser of f (the paper's standing assumption on p. 2).
Indices start at 0; the powers (1+s)−k and (1+s)1−k are integer powers; (88) is stated for k≥1, (87) for all k≥0.
Lemma 5.1 is stated for a single step with γk>0 given, which is the form in which §5.2 applies it to the predictor yk.
In Lemma B.2, the paper's L:=supkLk is replaced by an arbitrary real upper bound L of (Lk); both conclusions involving L weaken as L grows, so this is equivalent when the supremum is finite.
A statement that assumed Lk+1≤Lk/(1+αk) and derived only the rates, or that quantified over arbitrary sequences rather than runs of (83), would be Lemma B.2's corollary and not Theorem 5.1; the goal quantifies over runs of the scheme.
The development needs elementary Hilbert-space identities, the descent inequality (4) for functions with Lipschitz gradient, and real-sequence estimates for products and square roots. The same definitions and Lemma B.2 recur in the series' missions on Theorems 5.2, 7.2 and 7.3. Proofs of any milestone, and of (4) as an auxiliary lemma, are welcome.
Selected references
H. Luo and L. Chen, From differential equation solvers to accelerated first-order methods for convex optimization, Mathematical Programming, 2022. Preprint arXiv:1909.03145v4. https://arxiv.org/abs/1909.03145
W. Su, S. Boyd and E. J. Candès, A differential equation for modeling Nesterov's accelerated gradient method: theory and insights, Journal of Machine Learning Research 17(153), 2016. https://arxiv.org/abs/1503.01243
From Differential Equation Solvers to Accelerated First-Order Methods for Convex Optimization 3: The Implicit Scheme Gives ℒ_{k+1} ≤ ℒ_k/(1 + α_k) for Every μ-Convex f and Every Step α_k > 0Research Paper
Motivation
Accelerated first-order methods, beginning with Nesterov's 1983 scheme, reach the optimal iteration complexity among gradient methods for smooth convex minimization, but their classical derivations ("estimate sequences") give little insight into why acceleration works. A line of work started by Su, Boyd and Candès (arXiv:1503.01243) reads accelerated methods as discretizations of second-order ordinary differential equations and proves their rates with Lyapunov functions: a quantity that decreases along the continuous trajectory and, after discretization, along the iterates.
Luo and Chen (arXiv:1909.03145, Math. Program. 2022) introduce the NAG flow, a first-order system in two variables (x,v) with a time-varying parameter γ, and derive several accelerated methods from it as numerical ODE solvers. Their §4 treats the simplest discretization, the fully implicit (backward Euler) scheme. It is not a practical method by itself, since each step solves a nonlinear equation, but it is the case in which the continuous Lyapunov argument transfers to the discrete level almost word for word, and it is the benchmark for the semi-implicit and explicit schemes of §§5–7. This mission formalizes its convergence theorem, Theorem 4.1.
Setting
Let V be a real Hilbert space with inner product (⋅,⋅) and norm ∥⋅∥; the duality pairing ⟨⋅,⋅⟩ is identified with the inner product. Let f:V→R and μ≥0. The function f belongs to the class Sμ1 if it is continuously differentiable with gradient ∇f and satisfies the μ-convexity inequality
f(x)−f(y)−⟨∇f(y),x−y⟩≥2μ∥x−y∥2∀x,y∈V.
For μ=0 this is convexity, for μ>0 strong convexity. A global minimiser x∗ of f is fixed throughout.
Given positive step sizes αk>0 and γ0>0, the implicit scheme (72)–(73) relates consecutive iterates (xk,vk,γk) and (xk+1,vk+1,γk+1) by
The last-term identity γk(vk+1−vk,2vk+1+vk−x∗)=γk(vk+1−vk,vk+1−x∗)−2γk∥vk+1−vk∥2.
The substitution of the second line of (72) into γk(vk+1−vk,vk+1−x∗).
The split of the gradient term by the first line of (72).
The one-step inequality (75): Lk+1−Lk≤−αkLk+1.
A companion item states (76): each step of (72) is a proximal point step xk+1=proxηkf(yk) with explicit ηk, yk and γk+1=(γk+μαk)/(1+αk).
Significance
Theorem 4.1 gives a linear rate Lk≤L0∏i<k(1+αi)−1 for every convex f, not only strongly convex ones, as long as αk≥α>0; larger steps give faster decay. It is the exact discrete counterpart of the exponential decay L(t)≤e−tL(0) of the NAG flow (Lemma 3.2 of the paper), and the semi-implicit and explicit schemes of §§5–7 are analysed by comparison with it: their proofs follow the same difference computation and must control the extra terms that the implicit scheme does not produce. Through (76), the implicit scheme is an extrapolated proximal point method, close to Güler's accelerated proximal point algorithm when μ=0.
The result is proved on paper. To the knowledge of this mission it has no machine-checked proof. Formalizing it fixes the exact hypotheses of the discrete Lyapunov argument (in particular that γk>0 and μ≥0 are what make the dropped squares nonpositive) and provides the algebraic identities reused by the later schemes of the paper.
Difficulty
The argument is algebraic, but the bookkeeping is where it can fail. The difference Lk+1−Lk produces terms in ∥vk+1−x∗∥2, ∥xk+1−x∗∥2, ∥xk+1−vk+1∥2, ∥vk+1−vk∥2 and ∥xk+1−xk∥2, which must cancel or carry the right sign exactly. The naive attempt, to bound Lk+1−Lk by −αkLk as in an explicit Euler analysis, fails: the implicit scheme controls the decrease by the new value Lk+1, and the contraction factor 1/(1+αk) comes from solving for it. The γ-terms close only because (73) is also discretized implicitly, so that γk+1, not γk, multiplies ∥vk+1−x∗∥2.
Formalization scope
V is a type with NormedAddCommGroup, InnerProductSpace ℝ V and CompleteSpace V. The gradient is an explicit map gradf : V → V with HasGradientAt f (gradf x) x at every point, and continuity of gradf encodes "continuously differentiable". The class Sμ1, the Lyapunov function, one step of (72)–(73), and a run are definitions; the scheme's equations are kept in the page's difference-quotient form, as hypotheses on given sequences. Nothing asserts that the implicit system has a solution, and iterates are not defined by choice. Sequences are indexed from 0.
Conventions committed to: x∗ is a global minimiser (the paper's standing assumption that argminf is nonempty); γ0>0 and αk>0 as on p. 16; the one-step milestones that divide by γk assume γk>0, which along a run follows from (73). The prox in (76) is stated as membership in the argmin through the published predicate GoldenRatioVI.Shared.IsProxPoint.
A trivializing formalization is ruled out: the goal is stated for sequences satisfying the scheme (72)–(73) itself, never for sequences assumed to satisfy (75), and no Lipschitz-gradient class or step-size rule from later sections is imported.
The definitions of Sμ1 and Lk are shared with the other missions of this series and will be consolidated. Contributions welcome: proofs of the identities, of (75), of the goal, and of (76).
Selected references
H. Luo, L. Chen, From differential equation solvers to accelerated first-order methods for convex optimization, Math. Program., 2022; arXiv:1909.03145v4. https://arxiv.org/abs/1909.03145
W. Su, S. Boyd, E. J. Candès, A differential equation for modeling Nesterov's accelerated gradient method: theory and insights, J. Mach. Learn. Res. 17, 2016. https://arxiv.org/abs/1503.01243
O. Güler, New proximal point algorithms for convex minimization, SIAM J. Optim. 2(4), 649–664, 1992. https://doi.org/10.1137/0802032
R. T. Rockafellar, Monotone operators and the proximal point algorithm, SIAM J. Control Optim. 14(5), 877–898, 1976. https://doi.org/10.1137/0314056
Y. Nesterov, A method for solving the convex programming problem with convergence rate O(1/k²), Soviet Math. Dokl. 27, 372–376, 1983.
From Differential Equation Solvers to Accelerated First-Order Methods for Convex Optimization 5: The Gradient-Corrected Scheme Contracts ℒ_k by 1/(1 + α_k) and Has the Rate of Theorem 5.1Research Paper
Motivation
Nesterov's accelerated gradient method minimises a smooth convex function f to accuracy ε in O(1/ε) gradient evaluations, against O(1/ε) for plain gradient descent, and this rate is optimal for first-order methods (Nesterov 2018). The method is usually presented through estimate sequences, which certify the rate but say little about where the iteration comes from. A line of work starting with Su, Boyd and Candès (2016) and Wibisono, Wilson and Jordan (2016) reads accelerated methods as discretisations of ordinary differential equations, with a Lyapunov function carrying the convergence proof from continuous to discrete time.
Luo and Chen introduce the NAG flow, a first-order system in a position variable x, a velocity-like variable v and a damping parameter γ, which covers the convex case (μ=0) and the strongly convex case (μ>0) in one equation. They then examine which numerical schemes for this flow keep its exponential Lyapunov decay. The implicit scheme does (Theorem 4.1), but needs a proximal step. The explicit Gauss–Seidel splitting (80) does not: its one-step estimate leaves a positive term 2γkαk2∥∇f(xk+1)∥2 (Lemma 5.1). Section 5 repairs it in two ways. This mission formalises the second one, from §5.3: a gradient correction step appended to the splitting.
Setting
Let V be a real Hilbert space with inner product ⟨⋅,⋅⟩ and norm ∥⋅∥. A differentiable function f:V→R with gradient ∇f belongs to Sμ1 (μ≥0) if
f(x)−f(y)−⟨∇f(y),x−y⟩≥2μ∥x−y∥2∀x,y,
and ∇f is continuous. It belongs to Sμ,L1,1 if moreover ∇f is L-Lipschitz with 0<L<∞, and 0≤μ≤L. A global minimiser x∗ of f is assumed to exist.
The scheme carries a step sizeαk>0 and a damping parameterγk governed by the implicit recursion
αkγk+1−γk=μ−γk+1,γ0>0.(73)
Given (xk,vk), the gradient-corrected scheme (91) computes
The first two lines are the Gauss–Seidel splitting (80) with output yk. Both can be solved explicitly, so one step costs one gradient evaluation, at yk. The third line is a gradient descent step from yk.
The discrete Lyapunov function is
Lk=f(xk)−f(x∗)+2γk∥vk−x∗∥2,(74)
and the proof also uses the intermediate value Lk=f(yk)−f(x∗)+2γk+1∥vk+1−x∗∥2 (84).
Formalization targets
Goal: Theorem 5.2
If f∈Sμ,L1,1 and the step sizes satisfy Lαk2=γk(1+αk), then every run of (91) together with (73) satisfies
with Cγ0,L=γ0L(f(x0)−f(x∗))+2L∥v0−x∗∥2 (89). The paper states (87) and (88) by reference to Theorem 5.1; the goal writes them out.
Milestones
Lemma 5.1 (p. 19): the one-step estimates (81) and (82) for one Gauss–Seidel step and f∈Sμ1.
(93) (p. 22): (82) applied to the first two lines of (91), Lk−Lk≤−αkLk+2γkαk2∥∇f(yk)∥2.
(94) (p. 22): the descent inequality f(xk+1)−f(yk)≤−2L1∥∇f(yk)∥2.
Lk+1≤Lk−2L1∥∇f(yk)∥2 (p. 22).
The combined estimate (p. 22): Lk+1−Lk≤−αkLk+1+2Lγk1(Lαk2−γk(1+αk))∥∇f(yk)∥2 for arbitrary αk>0.
Lemma B.2 (pp. 38–39): positivity of γk, the lower bound αk≥min{γ0,μ}/L, and two-sided bounds on ∏i<k(1+αi)−1.
The bound on 1/(1+α0) (proof of Theorem 5.1, p. 21): 1+α01≤γ0L, which yields the constant (89).
Significance
Theorem 5.2 gives an explicit, one-gradient-per-step method with the accelerated rate O(1/k2) for convex f and the accelerated linear rate (1+min{γ0,μ}/L)−k for strongly convex f. The convex and strongly convex cases are covered by a single Lyapunov argument, with no restart and no prior knowledge of whether μ>0 beyond its value in (73). The analysis is modular: (92) holds for any correction step with the decay property (94). Section 7 of the paper reuses it for composite problems, replacing the gradient step by a proximal gradient step.
This result is proved in the paper; nothing here is open. To our knowledge none of these statements has been machine-checked. A completed mission gives a checked Lyapunov proof of an accelerated method on a general Hilbert space, with the step sizes left as arbitrary roots of Lαk2=γk(1+αk) rather than fixed by a closed formula. The paper omits the proof of Lemma B.2 ("Similarly, …"), so formalising it supplies a missing argument.
Difficulty
The naive analysis of the Gauss–Seidel splitting fails. The term 2γkαk2∥∇f∥2 in (82) is positive, so this estimate yields no contraction of Lk for any step size; the paper notes that the splitting (80) "does not lead to the contraction property" (p. 19). The correction works only because Lk+1 and Lk share vk+1 and γk+1, and differ only in the f-value at xk+1 against yk. The step-size rule then has to cancel the two gradient-norm terms exactly. The rates (87)–(88) need a second, independent argument: a discrete comparison for the product ∏i<k(1+αi)−1 under the coupled recursions for αk and γk (Lemma B.2). The descent inequality (94) requires the quadratic upper bound (4), which the formalization does not assume. It must be derived from the Lipschitz continuity of ∇f on a Hilbert space.
Formalization scope
All statements live in the namespace NAGFlow.GradCorr, with one definitions file NAGFlow.GradCorr.Setting. The conventions are as follows.
V is a real Hilbert space: [NormedAddCommGroup V] [InnerProductSpace ℝ V] [CompleteSpace V]. The paper's duality pairing and dual norm ∥⋅∥∗ are the inner product and the norm (Riesz).
∇f is an explicit map gradf : V → V with HasGradientAt f (gradf x) x at every point, never Mathlib's gradient. The classes are the structures IsS1 and IsS11. IsS11 contains 0<L and μ≤L; inequality (4) is not assumed.
x∗ is any point with f(x∗)≤f(y) for all y.
The scheme (91) and the recursion (73) are hypotheses on given sequences (IsGCRun, IsGammaRun), indexed from 0. The two implicit lines are kept as equations. γ0>0 and αk>0 are part of IsGammaRun.
The step sizes are any positive sequence with Lαk2=γk(1+αk), not a closed formula.
μ=0 is allowed throughout, so min{γ0,μ} may be 0.
Negative powers are integer powers (zpow), and (88) is stated for k≥1.
In Lemma B.2, L:=supkLk is encoded as an arbitrary real upper bound of (Lk). The conclusions involving L weaken as L grows.
The goal quantifies over runs of the scheme (91) itself. A version that assumes the contraction (92), or that fixes αk by a formula that makes (91) degenerate, would not be this theorem.
The development needs the quadratic upper bound for L-smooth functions on a Hilbert space, a one-step Lyapunov estimate for the splitting, and the scalar sequence analysis of Lemma B.2. The last two are shared with the predictor–corrector and composite missions of this series. Lemma B.2 and the α0 bound are statements about real sequences only and can be reused independently. Contributions to any milestone are welcome.
Selected references
H. Luo and L. Chen, From differential equation solvers to accelerated first-order methods for convex optimization, Mathematical Programming, 2022. Preprint arXiv:1909.03145v4. https://arxiv.org/abs/1909.03145
W. Su, S. Boyd and E. J. Candès, A differential equation for modeling Nesterov's accelerated gradient method: theory and insights, Journal of Machine Learning Research 17(153), 2016. https://arxiv.org/abs/1503.01243
A. Wibisono, A. C. Wilson and M. I. Jordan, A variational perspective on accelerated methods in optimization, Proceedings of the National Academy of Sciences 113(47), 2016. https://arxiv.org/abs/1603.04245
From Differential Equation Solvers to Accelerated First-Order Methods for Convex Optimization 7: Semi-APGM for min h + g Contracts ℒ_k by 1/(1 + α_k) and Has the Rate of Theorem 5.1Research Paper
Motivation
Many problems in signal processing, statistics and control are posed as composite convex minimisation: minimise f=h+g, where h is smooth and g is convex but possibly nonsmooth or extended-valued (an ℓ1 penalty, a nuclear norm, the indicator of a constraint set). Proximal gradient methods handle g through its proximal operator and h through its gradient. Their accelerated versions, Nesterov's composite method (Nesterov 2013) and FISTA (Beck–Teboulle 2009), reach the optimal O(L/k2) rate for convex problems, and separate variants exist for the strongly convex case.
Luo and Chen (arXiv:1909.03145, Math. Program. 2022) derive accelerated methods as discretisations of a single ODE, the NAG flow, and analyse every scheme with one discrete Lyapunov function. Section 7.2 extends their corrected semi-implicit scheme from smooth f to f=h+g by replacing ∇f with the composite gradient mapping. The result is Algorithm 2 (Semi-APGM). It calls the proximal operator once per iteration, and Theorem 7.2 shows that it has the same rate as the smooth methods, in the convex and the strongly convex case at once.
Setting
V is a real Hilbert space with inner product ⟨⋅,⋅⟩ and norm ∥⋅∥. The smooth part h:V→R has gradient ∇h and lies in the class Sμ,L1,1, with 0≤μ≤L<∞ and L>0. That is, h is μ-convex,
h(x)−h(y)−⟨∇h(y),x−y⟩≥2μ∥x−y∥2,
and ∇h is L-Lipschitz. The nonsmooth part g:V→R∪{+∞} is proper, closed and convex, with effective domain D=domg. The subdifferential is ∂g(x)={p:g(y)≥g(x)+⟨p,y−x⟩∀y}. The proximal operator is
proxηg(z)=argminy∈V{g(y)+2η1∥y−z∥2}.
With step η=1/L, set Sf(x)=proxg/L(x−∇h(x)/L) and Gf(x)=L(x−Sf(x)), the composite gradient mapping. Fix a minimiser x∗ of f.
Algorithm 2 starts from x0,v0∈V and γ0>0. For k=0,1,… it chooses αk>0 with Lαk2=γk(1+αk) and sets
Algorithm 2 is a run of the semi-implicit scheme (115).
The proximal optimality condition (112).
The inclusion Gf(x)−∇h(x)∈∂g(Sf(x)) (113).
Lemma 7.1, the quadratic lower bound (114) for f built from Gf.
The one-step estimate (117) for (115) with arbitrary αk>0.
The bound 1/(1+α0)≤L/γ0.
Lemma B.2, which turns the contraction factors ∏1/(1+αi) into explicit rates.
Significance
The theorem gives a single accelerated proximal gradient method whose rate interpolates between O(L/k2) for μ=0 and the linear rate (1+μ/L)−k for μ>0 (when γ0≥μ). Neither the method nor its parameters change between the two regimes. Lemma 7.1 is the only property of g that the proof uses, so the same analysis covers constraints (an indicator g), sparsity penalties and any other proximable term.
The result is proved on paper; this mission formalizes it. The paper's argument is short because it reuses the smooth case: "proceed as the proof of Lemma 5.1 and use Lemma 7.1". A machine-checked version has to carry out that reuse explicitly. It also has to supply the proximal facts the paper cites as well known ((112)) and the proof of Lemma B.2, which the paper omits. None of these statements is known to be formalized in Lean.
Difficulty
There is no single hard step. The work is in three places.
Algebra on the run. Equation (117) needs the difference identity for 2γ∥v−x∗∥2, the v-update of (115) and two applications of Lemma 7.1, at y=x∗ and at y=xk. The cross terms must cancel exactly.
The extended-valued function. The predictor yk may lie outside domg, where the page's f(yk) is +∞. An argument that evaluates f at yk is invalid unless the terms involving f(yk) cancel.
Lemma B.2. The product bound for ∏1/(1+αi) requires a telescoping estimate on 1/ρk whose proof the paper does not give.
Reading Algorithm 2 as a gradient method on f does not work, because f is not differentiable. All smoothness has to come from h through Lemma 7.1.
Formalization scope
Space.V is a real Hilbert space, and the paper's duality pairing and dual norm are the inner product and the norm (Riesz).
Gradient.∇h is an explicit map with a gradient at every point.
Encoding of g. The extended-valued g is a pair: its domain D and a real-valued function whose values off D are never used.
"Proper" means D=∅.
"Convex" means convex on the convex set D.
"Closed" means the epigraph {(x,t):x∈D,g(x)≤t} is closed. This does not force D to be closed.
x∗ minimises h+g over D.
Named outputs. The proximal operator and Sf are predicates on a named output (a minimiser over D). Existence and uniqueness are theorems, not assumptions.
Added hypotheses.
L>0, γ0>0 and αk>0, from the paper's class and algorithm.
x0∈domg. Without it the page's L0 is +∞ and the theorem is void.
Corrected slip. The page's "(110) f∈Sμ,L1,1" is read as h∈Sμ,L1,1, as in (104) and Lemma 7.1.
Lemma B.2.L:=supkLk is replaced by any real upper bound of (Lk).
Ruled out. A finite-valued g on all of V, without a domain, would drop the constrained and indicator cases and is not a faithful formalization. So is a statement with hypotheses that force Lk to be trivially controlled.
All objects are defined locally under NAGFlow.APGM. A complete development needs elementary convex analysis in Hilbert space (prox optimality, the descent lemma (4) from the Lipschitz gradient) and the scalar recursion of Lemma B.2. The proximal facts and Lemma B.2 can be reused by the other missions of this series (Theorems 5.1, 5.2 and 7.3) and by any accelerated-method formalization. Contributions are welcome on any milestone, in any order.
Selected references
H. Luo, L. Chen, From differential equation solvers to accelerated first-order methods for convex optimization, Math. Program. 195 (2022) 735–781. arXiv:1909.03145v4. https://arxiv.org/abs/1909.03145
A. Beck, M. Teboulle, A fast iterative shrinkage-thresholding algorithm for linear inverse problems, SIAM J. Imaging Sci. 2 (2009) 183–202. https://doi.org/10.1137/080716542
Understanding the Acceleration Phenomenon via High-Resolution Differential Equations III: The High-Resolution ODE of NAG-SC Satisfies f(X(t)) − f(x⋆) ≤ 2‖x₀ − x⋆‖² e^(−√μ t/4)/sResearch Paper
Motivation
Nesterov's accelerated gradient method for μ-strongly convex, L-smooth functions (NAG-SC) reaches accuracy ε in O(L/μlog(1/ε)) gradient steps, against O((L/μ)log(1/ε)) for gradient descent (Nesterov, 1983; Nesterov, 2004). Polyak's heavy-ball method has the same accelerated behaviour on quadratics but not in general, and the two methods share the same classical continuous-time limit, the ODE X¨+2μX˙+∇f(X)=0. That limit therefore cannot explain why one method accelerates and the other does not.
Shi, Du, Jordan and Su (arXiv:1810.08907v3, 2018; Math. Program. 2021) keep the O(s) terms of the step size s when passing to the limit. The resulting high-resolution ODEs differ between the two methods: the one for NAG-SC contains a gradient corrections∇2f(X)X˙, a Hessian-driven damping term absent from the heavy-ball ODE. Their Theorem 1 shows that the high-resolution ODE of NAG-SC converges linearly at the accelerated rate μ, with an explicit constant tied to the step size.
Timeline. Polyak (1964) introduces the heavy-ball method; Nesterov (1983) the accelerated gradient method. Su, Boyd and Candès (2016) derive the low-resolution ODE of Nesterov's method for convex functions. Alvarez, Attouch, Bolte and Redont (2002) study inertial systems with Hessian-driven damping. Shi, Du, Jordan and Su (2018) obtain the high-resolution ODEs and the rates of their Theorems 1–6. Attouch, Chbani, Fadili and Riahi (2020) treat the closely related dynamics x¨+2μx˙+β∇2f(x)x˙+∇f(x)=0.
Setting
Let Rn carry the Euclidean inner product ⟨⋅,⋅⟩ and norm ∥⋅∥. For L>0, FL1(Rn) is the class of differentiable convex functions f, in the sense f(y)≥f(x)+⟨∇f(x),y−x⟩ for all x,y, whose gradient is L-Lipschitz. FL2 adds that f is C2 with a Lipschitz-continuous Hessian ∇2f. For 0<μ≤L, Sμ,L2(Rn) is the subclass of FL2 of μ-strongly convex functions:
f(y)≥f(x)+⟨∇f(x),y−x⟩+2μ∥y−x∥2for all x,y.
Write x⋆ for the minimizer of f.
Fix a step size s>0 and a starting point x0. The high-resolution ODE of NAG-SC, (1.11), is
In Lean these are IsS2 f μ L, IsNAGSCODE f μ s x0 X V (with V the velocity X˙) and lyap f μ s xs X V t, in the namespace HighResODE.NAGSCODE.
Formalization targets
Goal: Theorem 1 (p. 13)
For f∈Sμ,L2, 0<s≤1/L and every solution X of (1.11), for all t≥0,
f(X(t))−f(x⋆)≤s2∥x0−x⋆∥2e−μt/4.
Milestones, in attack order
(3.4), p. 15. The derivative of E along (1.11), its closed form −μ(∥X˙∥2+(1+μs)⟨∇f(X),X−x⋆⟩+2s∥∇f(X)∥2)−2s[∥∇f(X)∥2+X˙⊤∇2f(X)X˙], and the bound that drops the bracket.
(3.5), p. 15.E˙≤−μ(21+μs(f(X)−f(x⋆))+∥X˙∥2+43μ∥X−x⋆∥2+2s∥∇f(X)∥2).
(3.6), p. 15.E(t)≤(1+μs)(f(X)−f(x⋆))+∥X˙∥2+3μ∥X−x⋆∥2+43s∥∇f(X)∥2.
Lemma 3.1, p. 13. For every s>0, E˙(t)≤−4μE(t)−2s[∥∇f(X)∥2+X˙⊤∇2f(X)X˙].
(3.2), p. 13.E(t)≤e−μt/4E(0).
Coefficient bound, p. 14. For 0<μs≤1: 21+2(1+μs)33−2μs+μs+1+μs2μs<2.
Milestones 1–5 hold for every step size s>0. The restriction s≤1/L enters only the goal and, through μs≤1, milestone 6.
Significance
Theorem 1 is the continuous-time half of the paper's explanation of acceleration. With s=1/L it gives f(X(t))−f(x⋆)≤2L∥x0−x⋆∥2e−μt/4, a linear rate at the accelerated exponent μ. The Lyapunov function (2.4) is the template from which the paper builds the discrete Lyapunov function (2.6) for NAG-SC itself, and the bracket ∥∇f(X)∥2+X˙⊤∇2f(X)X˙ in Lemma 3.1 is what that discretization uses (Remark 3.3). The heavy-ball ODE (1.10) lacks this term (Lemma 3.2), and that difference is the paper's account of why NAG-SC accelerates and heavy ball does not.
The result is proved in the paper; no machine-checked version is known. A formal proof needs a one-sided differential inequality along a C2 trajectory in Rn, a Grönwall-type integration, and an elementary but delicate rational inequality in μs. The milestones isolate each of these steps. The Lyapunov computation is also reusable for the sibling missions of this series on the heavy-ball and NAG-C ODEs.
Difficulty
The algebra in (3.4) is routine once the derivative exists. The work is in making that derivative rigorous. Differentiating E needs the chain rule for f∘X and for ∇f∘X. The second uses f∈C2: the time derivative of ∇f(X(t)) is ∇2f(X(t))X˙(t). All derivatives are one-sided at t=0. Passing from E˙≤−4μE to (3.2) needs a comparison argument on [0,∞), not just a pointwise derivative bound. The constant 2 of the goal rests on the coefficient inequality of milestone 6, and that inequality is tight: its left side tends to 2 as μs→0, so no crude estimate closes it.
Formalization scope
Rn is EuclideanSpace ℝ (Fin n), ∇f is Mathlib's gradient f, and ∇2f(x)v is fderiv ℝ (gradient f) x v. The classes are structures in the first-order form of p. 8. Sμ,L2 requires ContDiff ℝ 2 f and an existential Lipschitz constant for the Hessian, because the page fixes none. The minimizer x⋆ is a point with f(x⋆)≤f(z) for all z.
A solution of (1.11) is a pair of curves (X,V) with these properties:
X(0)=x0, and V(0) is the prescribed initial velocity;
for every t≥0, X has derivative V(t) within [0,∞);
for every t≥0, V has derivative within [0,∞) equal to the right-hand side of (1.11).
Values for t<0 are irrelevant. Existence and uniqueness of the solution (the paper's Proposition 2.1) are not assumed: every statement quantifies over every solution. Derivative claims are stated as the existence of a one-sided derivative with the claimed value or bound, never through deriv, which returns 0 where no derivative exists. The ODE predicate fixes V as the derivative of X, so V cannot be chosen freely. The goal assumes only the ODE and the class, never the Lyapunov decay. The initial velocity uses ∇f(x0) as in (1.11); footnote 4 (p. 5) drops the ∇, a printed slip.
All six milestones are stated. Solvers are welcome to work on any of them. A general one-sided Grönwall lemma on [0,∞) and the chain rule for ∇f∘X would serve the other ODE missions of this series as well.
Yu. Nesterov, A method of solving a convex programming problem with convergence rate O(1/k²), Soviet Math. Dokl. 27 (1983). https://www.mathnet.ru/eng/dan46009
W. Su, S. Boyd, E. J. Candès, A differential equation for modeling Nesterov's accelerated gradient method: theory and insights, JMLR 17 (2016). https://jmlr.org/papers/v17/15-084.html
F. Alvarez, H. Attouch, J. Bolte, P. Redont, A second-order gradient-like dissipative dynamical system with Hessian-driven damping, J. Math. Pures Appl. 81 (2002). https://doi.org/10.1016/S0021-7824(01)01253-3
H. Attouch, Z. Chbani, J. Fadili, H. Riahi, First-order optimization algorithms via inertial systems with Hessian driven damping, Math. Program. (2020). https://doi.org/10.1007/s10107-020-01591-1
From Differential Equation Solvers to Accelerated First-Order Methods for Convex Optimization 1: Gauss–Seidel Splitting of the HB and NAG Transforms Has ρ(E(α, G)) ≤ 1/√(1 + 2α) If 0 < α ≤ 2/√κ(A)Research Paper
Motivation
Accelerated first-order methods, the heavy-ball method of Polyak and Nesterov's accelerated gradient (NAG) method, reach an error ε on a μ-strongly convex, L-smooth problem in O(κlog(1/ε)) gradient steps, κ=L/μ, against O(κlog(1/ε)) for plain gradient descent. A long line of work has tried to explain where this square root comes from by reading the methods as discretizations of ordinary differential equations: Su, Boyd and Candès (arXiv:1503.01243), Wibisono, Wilson and Jordan (arXiv:1603.04245), and others.
Luo and Chen (arXiv:1909.03145, Math. Program. 2022) take the view from numerical analysis. Section 2 of their paper treats the quadratic case: the gradient flow x′=−Ax is stiff, and an explicit scheme for it needs step size O(1/κ(A)). They embed A in a 2×2 block matrix G whose spectrum lies in the left half-plane with condition number κ(A), and they show that an explicit Gauss–Seidel splitting scheme for y′=Gy is stable with step size of order 1/κ(A). This is the linear-algebra core of the paper's argument. The later sections build the nonlinear schemes (missions 2–8 of this series) on it.
Setting
Let A be a real symmetric d×d matrix. Its eigenvalues are real, and we assume
0<μ=λmin(A)≤λ≤λmax(A)=Lfor all λ∈σ(A),
with condition numberκ(A)=L/μ. For any real square matrix M, the spectrumσ(M) is the set of its eigenvalues, which are complex in general, and the spectral radius is ρ(M)=maxλ∈σ(M)∣λ∣.
The two transformations (39) of the paper are the 2d×2d block matrices
GHB=(0−A/μI−2I),GNAG=(−II−A/μI−I).
For the linear system y′=Gy, write G=M+N, where M is the block lower triangular part of G (the two diagonal blocks and the lower-left block) and N=G−M. The Gauss–Seidel splitting scheme (41) with step size α>0 is
The matrix I−αM is block lower triangular with diagonal blocks that are multiples of I, so the scheme is explicit and never inverts A. A one-step scheme is A-stable if ρ(E(α,G))<1.
Appendix A works with the scalar modelR=(−a−bc−d), where a,b,c,d≥0 and trR<0<detR, and with its Gauss–Seidel matrix E(α,R), defined in the same way from the lower triangular part of R.
Formalization targets
Goal: Theorem 2.1 (p. 10)
For G=GHB or G=GNAG, if 0<α≤2/κ(A), then the scheme is A-stable and
ρ(E(α,G))≤1+2α1.
Milestones (Appendix A, pp. 35–36)
(124): the closed form of E(α,R), and 0<detE(α,R)=1/(1+∣trR∣α+adα2)<1.
Lemma A.1: if ∣trR∣−2detR≤bcα≤∣trR∣+2detR, then ρ(E(α,R))=1/1+∣trR∣α+adα2<1.
The heavy-ball reduction: a closed block form of E(α,GHB), and σ(E(α,GHB))=⋃λ∈σ(A)σ(E(α,R(λ))) with R(λ)=(0−λ/μ1−2).
Heavy-ball spectral radius: under (127), ρ(E(α,GHB))=1/1+2α.
NAG spectral radius: under (127), ρ(E(α,GNAG))=1/1+2α+α2≤1/1+2α.
Companion statements
Proposition 2.1 (p. 9):Reλ<0 on σ(G) and κ(GHB)=κ(GNAG)=κ(A).
The choice α=2/κ(A) (p. 36):ρ(E(α,G))≤1/1+4/κ(A)≤1/(1+1/κ(A)).
The goal is the weakest of these statements. Milestones 4 and 5 show that it is attained for heavy ball and strict for NAG.
Significance
The result. Theorem 2.1 gives a contraction factor 1/(1+1/κ(A)) per step for an explicit, matrix-free scheme. Applied to f(x)=21x⊤Ax, that is the accelerated linear rate. Eliminating v from y=(x,v) shows that both transformations discretize the same second-order ODE μx′′+2μx′+∇f(x)=0. The theorem therefore explains acceleration as a stability property of an ODE solver, not as an algebraic trick. The paper's nonlinear schemes (predictor–corrector, gradient correction, Nesterov's method, the proximal variants) are built from this splitting. Their Lyapunov analyses generalize the spectral computation formalized here.
Formalizing it. The result is proved in the paper; to our knowledge no machine-checked proof exists. A formalization has to make the paper's "it is clear that" spectral reduction rigorous: the block diagonalisation through A=UΛU⊤ and the identification of the spectrum of a structured 2d×2d non-symmetric matrix with a union of 2×2 spectra. It also has to treat spectra of real matrices over C. Both are reusable well beyond this paper, since every spectral analysis of a momentum method (heavy ball, NAG, their discretizations) runs through the same reduction.
Difficulty
The obvious route bounds a norm of E(α,G). It fails: E(α,G) is not normal, and the paper stresses that ∥E∥2 is not controlled by ρ(E). The bound concerns eigenvalues only, and the eigenvalues are complex.
A second naive route applies a Gershgorin or field-of-values estimate to G directly. It loses the square root, because the off-diagonal blocks A/μ have norm κ(A). The real content is that for each eigenvalue λ of A, the 2×2 Gauss–Seidel matrix has a negative discriminant exactly when the step-size condition holds. Its eigenvalues are then a conjugate pair on the circle of radius detE, and detE does not depend on λ. Reaching this needs three things: the reduction of the block spectrum to scalar spectra, the explicit inverse of I−αM, and a careful equivalence of the discriminant condition with (126).
Formalization scope
Matrices are Matrix (Fin d) (Fin d) ℝ, and the block matrices live on Fin d ⊕ Fin d, built with Matrix.fromBlocks.
The splitting. It is blockwise: M takes the two diagonal blocks and the lower-left block of G. That is how the paper's own formula for E(α,GHB) reads it; the entrywise lower triangle would split A itself.
Spectra. The spectrum of a real matrix is spectrum ℂ of its complexification. "ρ(M)=r" is IsGreatest of the set of eigenvalue moduli. "ρ(M)≤r" and "ρ(M)<1" are stated eigenvalue by eigenvalue, so no junk supremum over an empty set can make a bound vacuous.
The model matrix.μ=λmin(A) and L=λmax(A) are encoded as hypotheses: both are eigenvalues of A and bound every eigenvalue. κ(A) is the number L/μ. Every statement assumes μ>0, the case of §2.3 where GHB and GNAG are defined.
Step size and inverse. The step size satisfies α>0, which the paper leaves implicit in (124). The matrix inverse in E is Mathlib's. It is genuine here, because I−αM is invertible for α>0.
Two trivializations are ruled out explicitly. A spectral radius defined as sSup over a possibly empty spectrum would make every bound hold vacuously at d=0. A spectrum taken over R would miss the complex eigenvalues, which are all of them here.
A complete development needs:
block-diagonalisation of the structured block matrices by diag(U,U) and a permutation;
the spectrum of a block-diagonal matrix of 2×2 blocks;
the eigenvalues of a real 2×2 matrix with negative discriminant;
explicit 2×2 and block-triangular inverses.
Lemmas of this kind, stated for general symmetric A, are welcome as separate theorems.
Selected references
H. Luo, L. Chen, From differential equation solvers to accelerated first-order methods for convex optimization, Math. Program. 195 (2022); arXiv:1909.03145v4. https://arxiv.org/abs/1909.03145
W. Su, S. Boyd, E. J. Candès, A differential equation for modeling Nesterov's accelerated gradient method: theory and insights, JMLR 17 (2016). https://arxiv.org/abs/1503.01243
A. Wibisono, A. C. Wilson, M. I. Jordan, A variational perspective on accelerated methods in optimization, PNAS 113 (2016). https://arxiv.org/abs/1603.04245
Operator Splitting for a Homogeneous Embedding of the Linear Complementarity Problem: The Embedding Operator Q = F ∪ I of a Monotone LCP Is Maximal MonotoneResearch Paper
Motivation
Many problems in optimization reduce to a linear complementarity problem over a cone: convex quadratic programs, linear and second-order cone programs, and more generally the KKT systems of convex quadratic cone programs (QCPs). First-order solvers for these problems, such as SCS (O'Donoghue–Chu–Parikh–Boyd 2016), must return either a solution or a certificate that none exists, and must do so reliably at scale; in branch-and-bound methods for mixed-integer quadratic programs, for example, fast and robust infeasibility certificates decide which branches are pruned. O'Donoghue (arXiv:2004.02177v4) embeds a monotone linear complementarity problem into a single homogeneous problem that always has a solution, from which either an answer or a certificate of infeasibility can be read off, and solves the embedded problem by Douglas–Rachford (DR) splitting. This is the algorithm behind SCS 3.0.
DR splitting converges for the sum of two maximal monotone operators. The mission formalizes the result that makes the method applicable: the paper's embedding operator is maximal monotone.
Setting
Write Rd+1=Rd×R with points u=(z,τ) and inner product (z,τ)⊤(w,κ)=z⊤w+τκ. An operator on Rd×R is identified with its graph, a set of pairs (point, value). It is monotone if (u−v)⊤(x−y)≥0 for all pairs (x,u),(y,v) in it, and maximal monotone if it is monotone and not strictly contained in another monotone operator.
Fix M∈Rd×d and q∈Rd. The matrix M is monotone if M+M⊤⪰0 (3.4); M need not be symmetric. For a nonempty closed convex cone C⊆Rd with dual cone C∗, the problem LCP(M,q,C) asks for z with
C∋z⊥(Mz+q)∈C∗.
The paper introduces three operators on Rd×R:
the Andersen–Ye feasibility embedding (4.1), defined for τ>0 only:
F(z,τ)=(Mz+qτ,−z⊤Mz/τ−z⊤q);
the infeasibility embedding (4.7), defined on {(z,0)∣z⊤Mz=0}:
I(z,0)={(Mz,κ)∣κ≤−z⊤q};
their union Q=F∪I.
The embedded problem is 0∈Q(u)+NC×R+(u). Its solutions with τ>0 give solutions z/τ of the LCP, and its solutions with κ>0 give certificates of infeasibility.
Formalization targets
Goal: Lemma 4.4
For every monotone M and every q,
Q=F∪I is maximal monotone on Rd×R.
Milestones
In the order the proof of Lemma 4.4 uses them:
(3.6): for monotone M, z⊤Mz=0⟺(M+M⊤)z=0.
Lemma 4.1: F is monotone.
Lemma 4.3: I is monotone.
Q is monotone (first paragraph of the proof of Lemma 4.4).
If pτ>0 and (p,r) is monotonically related to every pair of F, then r=F(p).
(4.11)–(4.13): if pτ=0 and (p,r) is monotonically related to every pair of F, then pz⊤Mpz=0, Mpz=rz and rτ≤−pz⊤q, that is, (p,r)∈I.
Companion results
The mission also states the following results of the same construction:
F alone is not maximal monotone (p. 7).
Lemma 4.2 in certificate form: λ satisfies (4.4) iff λ⊤q<0 and C∋λ⊥Mλ∈C∗ (p. 8).
The weak alternatives between LCP(M,q,C) and its certificate system (p. 8).
The decoding of solutions of the embedded problem, Table 1 (p. 10).
The closed-form resolvent of Q, (5.3)–(5.5) (pp. 12–13).
Lemma 5.1: DR iterates do not collapse to the trivial solution (p. 14).
Significance
Lemma 4.4 is the hinge of the paper. NC×R+ is maximal monotone, so once Q is too, DR splitting applied to the embedded inclusion converges for every LCP with monotone M, feasible or not. This holds whether the problem has a solution or a certificate, without the strict feasibility or strong duality an interior-point homogeneous model relies on. The closed-form resolvent and Lemma 5.1 then turn this into Algorithm 5.1: one cached linear solve with I+M and one scalar quadratic per iteration.
The result is proved in the paper. The DR convergence theorem itself and the extension theorem used for maximality are cited from Bauschke–Combettes. To our knowledge none of the results here has been machine-checked. A formal proof supplies two pieces of value. First, an argument for maximality that does not rest on the Zorn-based extension theorem the paper invokes. Second, a checked statement of the operator underlying a widely used solver, with its exact domains.
Difficulty
Monotonicity of F, of I and of their union is matrix algebra plus (3.6). The difficulty is maximality: given a pair (p,r) that is monotonically related to every pair of Q, one must show it already lies in Q. There are three regimes, according to the sign of pτ.
pτ>0. The pair lies in the open domain of a continuous operator.
pτ=0. The paper's limit argument as τ→0 yields (4.11)–(4.13).
pτ<0. The paper rules this case out through a general theorem on maximal monotone extensions with domain in the closed convex hull of the original domain [Bauschke–Combettes, Thm 21.9]. That theorem is not available in Mathlib.
The naive route, "F is continuous and monotone, so it is maximal", fails because domF is open and not the whole space. Indeed F alone is not maximal. The boundary behaviour is carried entirely by I, whose domain condition z⊤Mz=0 is exactly what monotonicity forces in the limit.
Formalization scope
Points of Rd+1 are pairs in (Fin d → ℝ) × ℝ, and the inner product is z⊤w+τκ written with dotProduct. Operators are Sets of (point, value) pairs. Maximal monotonicity is the containment form over all monotone operators on this space.
The standing assumption "M is monotone" is the explicit hypothesis (M + Mᵀ).PosSemidef in every theorem that involves M (all but Lemma 5.1). It is not M⪰0 (which would force symmetry), and the lemmas' sentences do not repeat it. The cone C does not enter Q and is not a hypothesis of the goal. Where a companion uses it, it is a nonempty, closed, convex cone, as on p. 4. The supremum in (4.4) is written pointwise. The dimension d=0 is allowed; the goal is true there.
The domain conditions are part of the graphs: τ>0 in F, and τ=0 together with z⊤Mz=0 in I. Each of the following trivializing or falsifying formalizations is ruled out:
F without τ>0: Lean's x/0=0 would add spurious pairs and make Lemma 4.4 false.
I without z⊤Mz=0: this breaks the monotonicity of Q.
A "maximality" that is only monotonicity, or maximality among single-valued operators only.
A pairing of points with values in place of differences.
Lemma 4.2 is stated in the certificate form its proof establishes. The distance-based notion of strong infeasibility is not formalized.
The development needs only finite-dimensional linear algebra from Mathlib: Matrix.mulVec, dotProduct, Matrix.PosSemidef, matrix inverse, and EuclideanSpace for Lemma 5.1. The definitions of monotone and maximal monotone graphs on Rd×R are reusable. Welcome contributions include:
a direct proof of the case pτ<0 that avoids the cited extension theorem [7, Thm 21.9];
a general lemma that a continuous monotone map on an open set admits no extension pair inside it;
H. H. Bauschke and P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, 2nd ed., Springer, 2017. https://doi.org/10.1007/978-3-319-48311-5
E. D. Andersen and Y. Ye, On a homogeneous algorithm for the monotone complementarity problem, Math. Program. 84, 1999 (reference [2] of https://arxiv.org/abs/2004.02177).
B. O'Donoghue, E. Chu, N. Parikh, S. Boyd, Conic optimization via operator splitting and homogeneous self-dual embedding, J. Optim. Theory Appl. 169, 2016. https://doi.org/10.1007/s10957-016-0892-3
From Differential Equation Solvers to Accelerated First-Order Methods for Convex Optimization 8: Semi-AFB for min over Q of h + g Contracts ℒ_k by 1/(1 + α_k) and Has the Rate of Theorem 5.1Research Paper
Motivation
Many convex problems in signal processing, statistics and control have the composite form "smooth loss plus nonsmooth regulariser, subject to a simple constraint": a least-squares or entropy term h, a sparsity or total-variation penalty g, and a feasible set Q such as a box, a simplex or a cone. Accelerated proximal gradient methods (FISTA, Beck and Teboulle 2009; Nesterov's composite gradient methods) reach the optimal O(1/k2) rate for such problems when Q=V. When a constraint is present, the standard schemes evaluate ∇h at extrapolated points that may leave Q; for an h such as the entropy on Q=[0,∞), that gradient does not exist.
Luo and Chen (arXiv:1909.03145v4, Math. Program. 2022) derive accelerated first-order methods as discretisations of a single ODE, the NAG flow, and analyse every scheme with one discrete Lyapunov function. Their Section 7.3 turns the predictor–corrector discretisation into a forward–backward splitting, the semi-implicit accelerated forward–backward method (Semi-AFB), whose iterates stay in Q by construction, and proves for it the same rate as for the unconstrained smooth case.
Timeline. Tseng (2008) gave an accelerated proximal gradient method with rate O(L/k2) for this problem with μ=0. Nesterov (Math. Program. 2013, "Gradient methods for minimizing composite functions") treated the same problem with hL-smooth on Q and gμ-strongly convex, μ≥0, and obtained the rate O(min{L/k2,(1+μ/L)−k}) with estimate sequences, at the cost of two proximal computations over Q per iteration. Luo and Chen's Theorem 7.3 (2019, revised 2022) gives the same type of rate with one proximal computation per iteration and a Lyapunov proof.
Setting
V is a real Hilbert space with inner product ⟨⋅,⋅⟩ and norm ∥⋅∥. For a set Ω⊆V, a function h is in Sμ1(Ω) if it is continuously differentiable on Ω, with gradient map ∇h, and
h(x)−h(y)−⟨∇h(y),x−y⟩≥2μ∥x−y∥2∀x,y∈Ω,μ≥0.
It is in Sμ,L1,1(Ω) if moreover ∇h is L-Lipschitz on Ω, 0<L<∞.
The problem (104) is
x∈Qminf(x),f=h+g,
with Q closed and convex, h∈Sμ,L1,1(Q), 0≤μ≤L, and g:V→R∪{+∞} proper, closed and convex, with Q∩domg=∅. Let x∗ be a minimiser.
Algorithm 4 (Semi-AFB). Given x0,v0∈Q and γ0>0, for k=0,1,…: choose αk>0 with Lαk2=γk(1+αk); set γk+1=(γk+μαk)/(1+αk), yk=(xk+αkvk)/(1+αk) and wk=(γkvk+μαkyk)/(γk+μαk); let
with Cγ0,L=γ0L(f(x0)−f(x∗))+2L∥v0−x∗∥2 (89). The contraction (121) is the core; (87) and (88) are its consequences through Lemma B.2.
Milestones
(120): under the optimality variational inequality for vk+1, the inner-product bound for γk⟨vk+1−vk,vk+1−x⟩.
The difference identity for Lk+1−Lk (p. 33).
The one-step estimate (123) (p. 34).
The h-term bound: xk+1−yk=1+αkαk(vk+1−vk) and the h-terms of (123) are ≤0 (pp. 34–35).
The g-term bound: the g-terms of (123) are ≤0 (p. 35).
The bound 1/(1+α0)≤L/γ0 (p. 21).
Lemma B.2: positivity of γk, the lower bound on αk, and the decay of ∏i<k(1+αi)−1 (pp. 38–39).
Significance
The result. Theorem 7.3 shows that one explicit gradient step on h and one proximal step on g restricted to Q per iteration suffice for acceleration, uniformly in μ≥0: it gives the rate O(L/k2) for convex h and the linear rate (1+min{γ0,μ}/L)−k for strongly convex h in one statement, and γ0 need not know μ. All iterates xk,yk,vk remain in Q, so the method applies when ∇h exists only on Q.
Formalizing it. The theorem is proved on paper, with a short Lyapunov argument; no machine-checked version is known to exist. A formal proof checks the bookkeeping of the argument, including the role of the domain of g, and makes the Lyapunov inequality available as a reusable step for other accelerated splitting schemes. The scalar Lemma B.2 is shared with the paper's other schemes (Theorems 5.1, 5.2 and 7.2).
Difficulty
The first-order condition that the paper uses for vk+1, a variational inequality with some pk+1∈∂g(vk+1), needs the subdifferential sum rule ∂(g+iQ)=∂g+NQ, which requires a constraint qualification that (104) does not impose. It fails, for example, when Q and domg meet in a single boundary point. A proof of the goal therefore cannot simply take such a pk+1 for granted. The second difficulty is bookkeeping: (2) and (4) hold for h on Q only, so each of the points xk,yk,vk+1,xk+1,x∗ at which they are applied must be shown to lie in Q, and the convexity of g is used at points that must lie in domg. Finally, (87) and (88) require the scalar recursion of Lemma B.2 for the product ∏i<k(1+αi)−1, whose square-root estimates are not routine.
Formalization scope
V is a real Hilbert space (InnerProductSpace ℝ V, CompleteSpace V); V∗ is identified with V by Riesz. The gradient of h is an explicit map gradh with a gradient of h within Q at every point of Q (HasGradientWithinAt). Nothing is assumed about h off Q, and (4) is not assumed. The extended-valued g is encoded by its effective domain D and its real values g : V → ℝ on D. Convexity is ConvexOn ℝ D g, closedness is a closed epigraph, and step 5's argmin over Q is a minimiser over Q∩D. The scheme is a hypothesis on sequences (IsAFBRun), with αk any positive solution of the step relation. Integer powers are used for (⋅)−k and (⋅)1−k. Lemma B.2's L:=supkLk is encoded as any real upper bound of (Lk).
Standing and added hypotheses: x∗ minimises f over Q∩domg (the paper assumes argmin f=∅). γ0>0, αk>0 and L>0 are inputs of Algorithm 4. The hypothesis x0∈domg is added to the page's x0∈Q, because otherwise L0=Cγ0,L=+∞. The goal makes no subgradient or variational-inequality assumption. Milestone (120) carries the variational inequality as an explicit premise. A trivializing formalization would quantify over sequences assumed to satisfy (121), or replace the argmin of step 5 by an arbitrary point of Q; the goal quantifies over genuine runs of Algorithm 4, with a genuine minimisation predicate.
A complete development needs elementary Hilbert-space identities, the minimiser inequality for a strongly convex function over a convex set, the descent inequality (4) on a convex set from (3), and the scalar recursion of Lemma B.2. The last two are reusable across the whole series. Contributions to any milestone are welcome.
Selected references
H. Luo and L. Chen, From differential equation solvers to accelerated first-order methods for convex optimization, Math. Program. (2022); arXiv:1909.03145v4. https://arxiv.org/abs/1909.03145
A. Beck and M. Teboulle, A fast iterative shrinkage-thresholding algorithm for linear inverse problems, SIAM J. Imaging Sci. 2 (2009) 183–202. https://doi.org/10.1137/080716542
P. Tseng, On accelerated proximal gradient methods for convex-concave optimization, technical report, University of Washington, 2008.
Linear Convergence of First Order Methods for Non-Strongly Convex Optimization IV: Projected Gradient on a Quasi-Strongly Convex f Has dist²(x^k, X*) ≤ ((1 − μ)/(1 + μ))^k dist²(x^0, X*)Research Paper
Motivation
The projected gradient method is the basic algorithm for minimising a smooth convex function over a closed convex set. For an objective with an Lf-Lipschitz gradient it converges at the sublinear rate f(xk)−f∗≤Lf∥x0−x∗∥2/(2k), and the classical way to obtain a linear (geometric) rate is to assume strong convexity. Many objectives that arise in practice are not strongly convex: least squares with a rank-deficient matrix, the dual of a linearly constrained problem, or g(Ax) with g strongly convex and A singular. Such problems have a whole set of minimisers rather than a single one, yet the projected gradient method is observed to converge linearly on them.
Necoara, Nesterov and Glineur (arXiv:1504.06298, v4 2016; Math. Program. 175 (2019)) introduce a hierarchy of relaxations of strong convexity, measured relative to the optimal set instead of between arbitrary pairs of points, and prove linear convergence of several first order methods under each of them. This mission formalizes the first such result: linear convergence of the projected gradient method on quasi-strongly convex objectives (Theorem 11 of the preprint).
Related conditions have a longer history: the error bounds of Luo and Tseng (1993) for feasible descent methods and the Polyak–Łojasiewicz inequality (Polyak 1963). Karimi, Nutini and Schmidt (2016) compare several of these in the unconstrained case.
Setting
Let X⊆Rn be a closed convex set, with the Euclidean inner product ⟨u,v⟩=u⊤v and norm ∥⋅∥. Let f be a convex function on X, differentiable at every point of X, whose gradient is Lipschitz on X:
∥∇f(x)−∇f(y)∥≤Lf∥x−y∥∀x,y∈X,Lf>0.
Problem (P) is f∗=minx∈Xf(x), with optimal setX∗=argminx∈Xf(x), assumed nonempty.
The projection of u onto a closed convex set S is [u]S=argminz∈S∥z−u∥. For x∈X write xˉ=[x]X∗ for the point of X∗ nearest to x; then ∥x−xˉ∥ is the distance from x to the optimal set.
f is quasi-strongly convex with constant κf>0 if, for every x∈X,
f∗≥f(x)+⟨∇f(x),xˉ−x⟩+2κf∥x−xˉ∥2.(10)
This is the strong convexity inequality with the second point fixed to xˉ. It does not force a unique minimiser. The class of convex functions with Lf-Lipschitz gradient satisfying (10) is denoted qSLf,κf(X), and μf=κf/Lf is the condition number.
The projected gradient method (GM) starts from x0∈X and iterates
xk+1=[xk−αk∇f(xk)]X,k≥0,
with step sizes αk≤1/Lf.
Formalization targets
Goal: Theorem 11
For f∈qSLf,κf(X) and (GM) with αk=1/Lf, for every k≥0,
Theorem 11 gives a geometric rate for the distance to the optimal set on a class strictly larger than the strongly convex functions. The rate (1−μf)/(1+μf) depends only on the ratio κf/Lf, exactly as in the strongly convex case with κf in place of the strong convexity constant. Through (49) the rate passes to function values, and (50) interpolates between the linear rate and the classical O(1/k) rate as μf→0. The paper's later sections show that the class contains, for example, g(Ax) over a polyhedron with g strongly convex, which covers dual and least-squares problems with singular data.
The result is proved in the paper; it is not known to be formalized. The mission produces a machine-checked statement of the class (10), the projected gradient iteration with a non-unique optimal set, and the rate (45), together with the intermediate inequalities of the proof. The definitions of the optimal set, the nearest-point projection and the (GM) run are reusable for the companion missions of this series (fast gradient, feasible descent methods) and for other projection-based methods.
Difficulty
The standard proof for strongly convex f compares xk+1 with the unique minimiser x∗ and uses strong convexity between xk and x∗. Here the minimiser is not unique, and the comparison point xˉk changes with k: the inequality at step k is written relative to xˉk, and the bound at step k+1 must be relative to xˉk+1. The two are linked only through the nearest-point property ∥xk+1−xˉk+1∥≤∥xk+1−xˉk∥. In addition, (10) controls only the direction toward xˉ, so to absorb the term f(xk+1)−f∗ the proof needs quadratic functional growth at xk+1, which is not part of the hypothesis and requires the separate implication (10) ⇒ (22). That implication uses convexity of f essentially; (10) alone does not imply it with the same constant by a one-line argument.
In Lean, the work includes the descent lemma on a convex set from a gradient that is Lipschitz only on X, the variational inequality of the Euclidean projection, and the implication (10) ⇒ (22) with the same constant.
Formalization scope
The space is EuclideanSpace ℝ (Fin n). f is a function on the whole space, convex on X (ConvexOn ℝ X f) and differentiable at every point of X, with ∇f = gradient f; the Lipschitz bound (1) is required on X with Lf>0.
X is closed and convex; "simple" (cheap projection) is not a mathematical hypothesis and is dropped. X∗ is nonempty through a named minimiser; f∗ is f(xˉ) for xˉ∈X∗, never an infimum.
The projection is the predicate "p∈S and ∥u−p∥≤∥u−z∥ for all z∈S", not a choice function. A (GM) run is any sequence whose steps are nearest points, starting at k=0 (the page's "for k≥1" is a slip). Statements hold for every nearest point xˉk; on a nonempty closed convex set it is unique.
The class hypothesis is (10) with constant κf>0, kept separate from convexity and (1). No hypothesis κf≤Lf is added: if κf>Lf then (10) and the descent inequality force X⊆X∗ and the claims hold with both sides zero.
Companion (50) adds κf<Lf, since at μf=1 its right-hand side divides by zero.
Trivializing formalizations are ruled out: the projection is not a choice that could be junk, X∗ cannot be empty, the gradient is only queried at points of X where f is differentiable, and f∗ is attained.
Contributions welcome: proofs of the milestones, in particular the descent lemma on a convex set and the variational inequality for nearest points, which are reusable beyond this mission.
Selected references
I. Necoara, Yu. Nesterov, F. Glineur, Linear convergence of first order methods for non-strongly convex optimization, arXiv:1504.06298v4, 2016; Math. Program. 175 (2019) 69–107. https://arxiv.org/abs/1504.06298
Z.-Q. Luo, P. Tseng, Error bounds and convergence analysis of feasible descent methods: a general approach, Annals of Operations Research 46 (1993) 157–178. https://doi.org/10.1007/BF02096261
H. Karimi, J. Nutini, M. Schmidt, Linear convergence of gradient and proximal-gradient methods under the Polyak–Łojasiewicz condition, ECML PKDD 2016. https://arxiv.org/abs/1608.04636
Linear Convergence of First Order Methods for Non-Strongly Convex Optimization III: Projected Gradient Contracts dist(·, X*) at Every Feasible Point If and Only If f Has Quadratic Functional GrowthResearch Paper
Motivation
Linear convergence of first order methods is classically tied to strong convexity. Many problems in data fitting, machine learning and control are not strongly convex, yet gradient methods are observed to converge linearly on them: least squares with a rank-deficient matrix, the dual of a linearly constrained quadratic program, f(x)=g(Ax) with g strongly convex and A singular. Their optimal sets are not single points, so strong convexity fails, and some weaker property of f has to explain the observed rates.
I. Necoara, Yu. Nesterov and F. Glineur (arXiv:1504.06298v4, 2016; Math. Program. 175 (2019)) introduce a chain of relaxations of strong convexity — quasi-strong convexity, quadratic under-approximation, quadratic gradient growth, quadratic functional growth — and prove linear rates for several first order methods under each. Among these results, Theorem 13 singles out one condition: for the projected gradient method with constant step size, linear convergence (in the sense made precise below) holds if and only iff has quadratic functional growth. This mission formalizes that equivalence and the two results it rests on, Theorem 5 and Theorem 12.
Related conditions appear in Łojasiewicz's gradient inequality, in Luo and Tseng's error bounds (1993), in the Polyak–Łojasiewicz condition studied by Karimi, Nutini and Schmidt (2016), and in Drusvyatskiy and Lewis's equivalence of quadratic growth and error bounds (2018).
Setting
Work in Rn with the Euclidean inner product ⟨u,v⟩=u⊤v and norm ∥⋅∥. Problem (P) is
f∗=x∈Xminf(x),
with X⊆Rn closed and convex and f convex, with gradient Lipschitz on X with constant Lf>0:
∥∇f(x)−∇f(y)∥≤Lf∥x−y∥∀x,y∈X.(1)
The optimal setX∗={x∈X:f(x)≤f(y)∀y∈X} is assumed nonempty. The projection[u]S of u onto a nonempty closed convex set S is the nearest point of S to u. For x∈X write xˉ=[x]X∗.
The projected gradient step from x is x+=[x−Lf1∇f(x)]X, and xˉ+=[x+]X∗. The projected gradient method (GM) starts at x0∈X and iterates xk+1=[xk−αk∇f(xk)]X for k≥0.
f has quadratic functional growth with constant κf>0, written f∈FLf,κf, when
f(x)−f∗≥2κf∥x−xˉ∥2∀x∈X.(22)
The condition number is μf=κf/Lf.
Formalization targets
Goal: Theorem 13 (p. 23)
Under the standing assumptions of (P):
if f satisfies (22) with constant κf>0, then for every x∈X
∥x+−xˉ+∥2≤1+μf1∥x−xˉ∥2;
if for some 0<β<1 the step contracts the distance to the optimal set,
∥x+−xˉ+∥≤β∥x−xˉ∥∀x∈X,
then f satisfies (22) with constant Lf(1−β)2.
Together these say that a uniform one-step contraction of dist(⋅,X∗) by the gradient step with step size 1/Lf is equivalent to quadratic functional growth.
Milestones
(28): f(x+)≤f(x)−2Lf∥x+−x∥2;
(26): under the contraction hypothesis, (1−β)∥x−xˉ∥≤∥x−x+∥;
Theorem 5: contraction implies (22) with κf=Lf(1−β)2;
the one-step inequality ∥xk+1−x∥2≤∥xk−x∥2−2αk(f(xk+1)−f(x)) for 0<αk≤1/Lf and all x∈X;
(52): under (22), ∥xk+1−xˉk+1∥2≤1+κfαk1∥xk−xˉk∥2;
Theorem 12: along (GM) with αk=1/Lf, ∥xk−xˉk∥2≤(1+μf)−k∥x0−xˉ0∥2.
A companion item states the function-value rate (53), f(xk)−f∗≤2Lf∥x0−xˉ0∥2(1+μf)−(k−1) for k≥1.
Significance
The result. Theorem 13 identifies quadratic functional growth as the exact condition, in the paper's hierarchy, for linear convergence of projected gradient: every stronger class (strong, quasi-strong convexity, quadratic gradient growth, quadratic under-approximation) gives linear convergence through it, and no condition weaker than (22) can. It also gives explicit constants in both directions: rate (1+μf)−1 per step from growth, and growth constant Lf(1−β)2 from contraction factor β.
Formalizing it. The results are proved in the paper; to the knowledge of this mission none of them has a machine-checked proof. The work is to formalize the known proofs: the descent inequality (28) and the variational inequality of the projection onto a closed convex set, the one-step inequality of the projected gradient method, and the two directions of Theorem 13. The projection lemmas and the one-step inequality are reusable for any analysis of projected gradient on convex sets.
Difficulty
The ⇒ direction is a contraction argument along one step; its difficulty is the projection calculus: the variational inequality characterizing [u]X, applied with u=xk−αk∇f(xk), and the descent lemma (2), which must be derived from (1) on the convex set X only, since f need not be smooth off X. The nearest point xˉk+1 of xk+1 differs from xˉk; the argument must compare distances to two different optimal points.
The ⇐ direction is not a statement about one run of the method: it needs the contraction hypothesis at every feasible point. A version with a multi-step rate along runs (dist(xk,X∗)≤Cqk) is not what the paper proves, and the one-step hypothesis cannot be recovered from it without extra work.
Formalization scope
Lean represents Rn as EuclideanSpace ℝ (Fin n) and ∇f as gradient f. f is a function on all of Rn that is differentiable at every point of X; only its values and gradients on X enter. The standing assumptions of p. 3 are explicit hypotheses of every theorem: X closed and convex, f convex on X, (1) with Lf>0, and a named minimiser x⋆∈X∗; the paper's "simple" (cheap projection) is not a mathematical hypothesis and is dropped, and "closed" for f is implied by continuity on X. The optimal value is f(x⋆), or f(xˉ), never an infimum. Projections are predicates (IsNearest), never chosen points, and every statement quantifies over all nearest points; they exist and are unique on nonempty closed convex sets. Iterates are indexed from k=0. The page prints "for k≥1" in (GM); this slip is not copied. Theorem 12's "converges linearly to some optimal point" is formalized as the rate (51) only, since convergence of the iterates themselves is not proved on the page. In the goal, part 1 is stated in the squared form of (52).
The formalization does not define the projection by a choice function, does not allow an empty optimal set (which would make every growth inequality vacuous), and does not read the gradient off the set where f is assumed differentiable.
Needed infrastructure: the variational characterization of the Euclidean projection onto a closed convex set, the descent lemma on a convex set, closedness and convexity of X∗, and existence of nearest points. Contributions of these lemmas, of the milestones in any order, and of the goal are welcome.
Selected references
I. Necoara, Yu. Nesterov, F. Glineur, Linear convergence of first order methods for non-strongly convex optimization, arXiv:1504.06298v4, 2016; Math. Program. 175 (2019) 69–107. https://arxiv.org/abs/1504.06298
Z.-Q. Luo, P. Tseng, Error bounds and convergence analysis of feasible descent methods: a general approach, Ann. Oper. Res. 46 (1993) 157–178. https://doi.org/10.1007/BF02096261
H. Karimi, J. Nutini, M. Schmidt, Linear convergence of gradient and proximal-gradient methods under the Polyak–Łojasiewicz condition, ECML PKDD 2016. https://arxiv.org/abs/1608.04636
D. Drusvyatskiy, A. S. Lewis, Error bounds, quadratic growth, and linear convergence of proximal methods, Math. Oper. Res. 43 (2018) 919–948. https://arxiv.org/abs/1602.06661
Linear Convergence of First Order Methods for Non-Strongly Convex Optimization VI: Feasible Descent Methods Converge Linearly in Function Values under Quadratic Functional GrowthResearch Paper
Motivation
Many first order methods used in large-scale convex optimization do not take an exact projected gradient step. Proximal point iterations, random or cyclic coordinate descent, extragradient methods and matrix splitting methods all produce iterates that behave like a projected gradient step corrupted by an error which is small relative to the step itself. Luo and Tseng (Ann. Oper. Res. 1993) grouped these schemes under the name feasible descent methods and proved that they converge linearly when the problem satisfies an error bound, a condition relating the distance to the optimal set to the size of the projected gradient residual. Wang and Lin (JMLR 2014) gave global iteration complexity bounds for the same family under the same kind of error bound.
Necoara, Nesterov and Glineur (arXiv:1504.06298v4, published in Math. Program. 2019) study a chain of conditions weaker than strong convexity under which first order methods still converge linearly. The weakest of them that the paper uses for algorithms is quadratic functional growth: the objective grows at least quadratically in the distance to the optimal set. Their Theorem 15 shows that the whole feasible descent family converges linearly in function values under quadratic functional growth alone. This mission formalizes that theorem and the steps of its proof.
Setting
Let Rn carry the Euclidean inner product ⟨u,v⟩=u⊤v and the norm ∥u∥. For a set S and a point u, a nearest pointp=[u]S is a point p∈S with ∥u−p∥≤∥u−z∥ for every z∈S.
Problem (P) is f∗=minx∈Xf(x), where
X⊆Rn is closed and convex;
f is convex on X and differentiable at every point of X, with gradient ∇f Lipschitz on X with constant Lf>0: ∥∇f(x)−∇f(y)∥≤Lf∥x−y∥ for all x,y∈X (inequality (1) of the paper);
the optimal set X∗={x∈X:f(x)≤f(y)∀y∈X} is nonempty; f∗ is the value of f on X∗.
The function f has quadratic functional growth with constant κf>0 (Definition 4, inequality (22)) if, for every x∈X and its nearest point xˉ=[x]X∗,
f(x)−f∗≥2κf∥x−xˉ∥2.
The class FLf,κf(X) consists of the convex functions satisfying (1) and (22).
A run of the feasible descent method (FDM) with constants β,L,Lˉf>0 consists of stepsizes αk, error vectors ek and iterates xk (k≥0) with x0∈X and, for every k,
The errors are part of the run: any vectors meeting the two conditions are allowed. With αk=1/Lf, ek=0 and L=Lf a run is the projected gradient method (GM) of the paper.
Formalization targets
Goal: Theorem 15
For f∈FLf,κf(X) and every run of (FDM), for all k≥0,
The one-step contraction: f(xk+1)−f∗≤(1+4(Lf+Lˉf+βLˉf)2Lκf)−1(f(xk)−f∗).
Significance
Theorem 15 replaces the error bound assumption of Luo–Tseng and Wang–Lin by quadratic functional growth, a condition stated purely in terms of function values. Since the paper shows (Theorems 6 and 7) that, for convex f with Lipschitz gradient, the error bound and quadratic functional growth are equivalent up to constants, the theorem gives a direct route to linear convergence for every scheme known to be a feasible descent method, with an explicit rate in the three constants L, Lf, Lˉf and the error ratio β. The paper also notes (p. 30) that linear convergence of xk to a point of X∗ follows from the function-value rate and (22).
The result is proved in the paper. No machine-checked version is known to exist: the prior-art search found no formalization of feasible descent methods, of the Luo–Tseng framework, or of linear convergence under quadratic functional growth on a constrained set. A formal proof would make the general feasible descent template available for instantiation by concrete methods (coordinate descent, proximal point), each of which then needs only to verify the two run conditions.
Difficulty
The obvious argument for projected gradient methods compares xk+1 with a fixed minimizer and uses strong convexity to contract the distance; here neither is available. There is no strong convexity, X∗ need not be a singleton, and there is no upper bound on the stepsize, so the usual sufficient decrease estimate of the gradient method cannot be derived and is instead an assumption of the run. The error ek is only controlled relative to the step xk+1−xk, not absolutely, and the stepsize is only bounded below, so any estimate has to be uniform in αk and has to measure progress against the moving nearest point xˉk+1 of the optimal set rather than a fixed minimizer.
Formalization scope
The ambient space is EuclideanSpace ℝ (Fin n); f is a function on all of Rn, and only its values and gradients (Mathlib's gradient) at points of X enter. The nearest point [u]S is the predicate IsNearest S u p, never a choice function, so a run of (FDM) is any pair of sequences (xk), (ek) with stepsizes (αk) satisfying the predicate IsFDMRun. Statements about xˉk+1 hold for every nearest point; since X∗ is closed and convex the nearest point is unique. The optimal set is nonempty because a minimizer x∗ is a hypothesis, and f∗ is f(x∗), not an infimum. Sequences are indexed from 0.
Standing assumptions of p. 3 are hypotheses: X closed and convex, f convex on X, differentiable on X, (1) with Lf>0, X∗ nonempty. The word "simple" (projection is cheap) is not a mathematical condition and is dropped; closedness of f follows from continuity on X. The class hypothesis f∈FLf,κf is unbundled into convexity, (1) and (22) with κf>0. The constants satisfy β,L,Lˉf>0, as on the page, and no upper bound on αk is imposed. The milestone (65) drops every hypothesis it does not need (it uses only convexity of X), and the chain after (65) does not assume (22).
Trivializing formalizations are ruled out: the projection is not a choice that could return a junk point, X∗ is never empty, gradients are only evaluated at points of X where f is differentiable, and the run conditions are satisfiable by non-stationary sequences (for f(x)=21∥x∥2 on X=Rn, αk=21, ek=0, xk=2−kx0).
A complete development needs the variational characterization of Euclidean projections onto convex sets, the first order characterization of convexity for a function differentiable on a convex set, existence of nearest points in closed convex nonempty sets of Rn, and an induction on the one-step contraction. The first three are reusable well beyond this mission. Proofs of the milestones, and of instances of (FDM) for concrete methods, are welcome.
Z.-Q. Luo, P. Tseng, Error bounds and convergence analysis of feasible descent methods: a general approach, Annals of Operations Research 46 (1993) 157–178. https://doi.org/10.1007/BF02096261
P.-W. Wang, C.-J. Lin, Iteration complexity of feasible descent methods for convex optimization, Journal of Machine Learning Research 15 (2014) 1523–1548. https://jmlr.org/papers/v15/wang14a.html
Multistage Distributionally Robust Mixed-Integer Programming with Decision-Dependent Moment-Based Ambiguity Sets III: Under Slater, the Delage–Ye-Type Stage Bellman Equation Is One SDP MinimizationResearch Paper
Motivation
In many multistage decision problems the probability law of the next uncertainty depends on the decision taken now: opening a facility changes the demand it attracts, a price changes the distribution of sales, maintenance changes failure rates. Distributionally robust optimization (DRO) handles an imperfectly known law by optimizing against the worst distribution in an ambiguity set. When that set itself moves with the decision, the model is decision-dependent, and the classical reformulations, which treat the ambiguity set as fixed, do not apply directly.
X. Yu and S. Shen (arXiv:2002.12518v3, 2020; Math. Program., DOI 10.1007/s10107-020-01580-4) study multistage mixed-integer DRO with binary state variables and decision-dependent moment-based ambiguity sets over a finite support. Their Theorems 1–3 turn each stage's min–max Bellman equation into a single minimization, which is the input to a stochastic dual dynamic integer programming (SDDiP) algorithm. This mission covers their main result, Theorem 3, for the most general of their three sets: a Delage–Ye-type set in which the mean lies in an ellipsoid around a decision-dependent estimate and the centred second-moment matrix is bounded by a decision-dependent matrix.
Timeline. Delage and Ye (Oper. Res., 2010, DOI 10.1287/opre.1090.0741) introduced the ellipsoid-plus-second-moment set for a decision-independent law and gave a semidefinite reformulation. Luo and Mehrotra (Optim. Lett., 2020) derived duality-based reformulations for decision-dependent moment sets in a single stage. Yu and Shen (2020) carry these into the multistage mixed-integer setting with binary states.
Setting
Fix one stage t. The data are:
a stage feasible set S⊆{0,1}I×RI×J of pairs (x,y) (state and stage variable) and a stage cost g(x,y);
a finite support ξ1,…,ξK∈RJ of the next-stage random vector (the same for every decision);
next-stage values Qk(x)=Qt+1(x,ξk);
a decision-dependent mean estimate μ(x)∈RJ, a matrix Σ(x)∈RJ×J (written Sig in Lean), and size parameters γ,η∈R.
For weights p∈RK write Mk(x)=(ξk−μ(x))(ξk−μ(x))⊤ and ξˉ(p)=∑kpkξk. The Type 3 ambiguity set (14) is
Assume that for every feasible (x,y)∈S, Σ(x)≻0, and that Slater's condition holds: some probability vector p satisfies the ellipsoid constraint strictly and ∑kpkMk(x)≺ηΣ(x). Then the minimum of the Bellman equation exists exactly when the minimum of the mixed-integer semidefinite program (15) exists, and the two are equal:
subject to s−2z2⊤ξk+Mk(x)∙Y≥Qk(x) for all k, Z=(z1z2⊤z2z3)⪰0, Y⪰0, and (x,y)∈S.
Milestones (proof of Theorem 3, pp. 37–39)
The ellipsoid constraint (C-20d) is equivalent to (Σ(x)(τ−μ(x))⊤τ−μ(x)γ)⪰0.
The Lagrangian identity (C-21).
The dual function: maximizing the Lagrangian over p≥0, τ∈RJ gives the stated objective under the stated constraints, and +∞ otherwise.
Weak duality: every p∈PD3(x) is bounded by every dual-feasible objective value.
Strong duality (C-22) under Slater, with both sides attained.
A companion statement from §4.2.2 (p. 15) is also included: the cones DD(U) built from diagonally dominant matrices consist of positive semidefinite matrices.
Significance
The result. Theorem 3 replaces a min–max problem, whose inner maximum ranges over a set that moves with x, by one minimization in which x enters only through the data μ(x), Σ(x). With affine μ, Σ and binary x, the bilinear terms can then be linearized, giving the mixed-integer SDP (16)–(17) to which the paper applies SDDiP-type cutting planes. Without the reformulation there is no single-level stage problem to generate cuts from.
Formalizing it. The result is proved on paper; it has no machine-checked proof that we know of. The proof in the paper is brief: it cites convexity and Slater for strong duality and does not check that the domain p≥0, the Schur-complement rewrite and the strict inequalities fit the conic duality theorem it relies on. A formal proof checks these points, and the per-stage duality lemmas (milestones 4 and 5) can be reused by any moment-based DRO model over a finite support.
Difficulty
Weak duality and the regrouping of the Lagrangian are routine. The difficulty is strong duality with dual attainment (milestone 5): the inner problem has an inverse-matrix constraint and a semidefinite constraint, and the duality theorem must be applied to the conic form after the Schur rewrite, with a Slater point of that form. The paper states Slater for "a vector p". A Slater point with negative entries does not lie in the domain p≥0, so it gives no interior point there. Passing from per-state duality to the equality of the two outer minima also needs care: the Bellman minimum is over pairs at which the inner maximum is attained, and the reformulated minimum is a joint minimization over (x,y) and the dual variables.
Formalization scope
Indices are 0-based (Fin I, Fin J, Fin K). States are Fin I → ℝ, the support is ξ : Fin K → Fin J → ℝ, and Σ, Z, Y are Mathlib matrices. ⪰ and ≻ are PosSemidef/PosDef of the difference (both include symmetry). The block Z is indexed by Fin J ⊕ Unit, with the same z2 in both off-diagonal blocks.
Minima and maxima are IsLeast/IsGreatest on sets of values, so attainment is part of every claim. The goal reads: for all q, q is the least stage value iff q is the least value of (15).
Added hypotheses, disclosed:Σ(x)≻0 at feasible x (implicit on the page, which writes Σ(x)−1; Mathlib's inverse of a singular matrix is 0). p≥0 in the ambiguity set ((C-20f); Assumption 3 calls p a probability). The Slater point is a probability vector (Theorem A.3 says "a probability measure").
Dropped hypotheses, disclosed generalization: linearity of g and compactness and polyhedrality of S are not used. μ and Σ are arbitrary functions of x; the affine form (12) is imposed only later in the paper. Qk is an arbitrary real function, because the stage theorem uses nothing about the recursion. Binary states are kept as a hypothesis.
Printed text not copied: the Slater clause of Theorem 3 is cut at the right margin of p. 12 and is restored from Theorem B.6 (p. 36). "u∈Rd" on p. 38 is read as u∈RJ.
No trivializing reading: the strict inequalities of Slater are kept, since non-strict ones would make the theorem false. No sSup/sInf values are used, so there are no junk values. An empty S makes both sides empty, so the equivalence carries no content there. A sorry-free check confirms that the hypotheses are satisfiable on a two-point instance with value 3.
Needed infrastructure: Schur complements for positive definite blocks (in Mathlib), the trace inequality for products of PSD matrices, and a conic strong-duality theorem with dual attainment under Slater for semidefinite constraints. Contributions of the last as a reusable lemma are welcome.
Selected references
X. Yu, S. Shen, Multistage distributionally robust mixed-integer programming with decision-dependent moment-based ambiguity sets, arXiv:2002.12518v3, 2020; Math. Program., 2020. https://arxiv.org/abs/2002.12518
E. Delage, Y. Ye, Distributionally robust optimization under moment uncertainty with application to data-driven problems, Oper. Res. 58(3), 2010. https://doi.org/10.1287/opre.1090.0741
F. Luo, S. Mehrotra, Distributionally robust optimization with decision dependent ambiguity sets, Optimization Letters, 2020, pp. 1–30 (as cited by Yu & Shen).
A. A. Ahmadi, G. Hall, Sum of squares basis pursuit with linear and second order cone programming, Algebraic and Geometric Methods in Discrete Mathematics, Contemp. Math. 685, 27–53, 2017 (as cited by Yu & Shen).