Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Linear Optimization

330 missions · 199 completed

Missions

Open131Completed199All330
🏆Completed
CombinatoricsOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming XVI: Unions of Upper Monotone Polytopes and PolymatroidsTextbook

Motivation

This mission is the sixteenth and last of the Disjunctive Programming series, and its goal theorem is the book's own closing result. The chapter's arc closes a loop opened at the very start of the book: Theorem 2.1 (02a-convex-hull) gave the convex hull of a union of polyhedra in the same space via lifting; this chapter's Theorem 13.13 (not drafted in this mission — see below) gives the dominant of a union of polytopes in different spaces, and the chapter's final result specializes that machinery to the case where the two polytopes are polymatroids — obtaining a fully explicit, closed-form convex hull in the original variable space, with no lifting at all. Polymatroids are among the most heavily studied objects in combinatorial optimization, from Edmonds's foundational greedy-algorithm characterization onward (J. Edmonds, Submodular functions, matroids, and certain polyhedra, in Combinatorial Structures and Their Applications, Gordon and Breach, 1970, 69–87), and a disjunction of two polymatroids — "satisfy one covering system or the other" — arises naturally whenever two competing combinatorial resource constraints interact.

Setting

Fix a ground set N={1,…,n}N = \{1,\dots,n\}N={1,…,n}. A set function r:2N→Rr : 2^N \to \mathbb{R}r:2N→R is a polymatroid rank function if r(∅)=0r(\emptyset)=0r(∅)=0, rrr is nondecreasing, and rrr is submodular: r(A)+r(B)≥r(A∪B)+r(A∩B)r(A)+r(B) \ge r(A\cup B)+r(A\cap B)r(A)+r(B)≥r(A∪B)+r(A∩B) for all A,B⊆NA,B\subseteq NA,B⊆N. (A related but distinct condition, used earlier in the chapter for "Application 1," additionally requires r(A)≤∣A∣r(A)\le|A|r(A)≤∣A∣ on every proper subset — matroid rank functions satisfy both.) The associated polymatroid is

P(r):={x∈R+n:∑j∈Axj≤r(A) for all A⊆N}.P(r) := \Big\{x \in \mathbb{R}^n_+ : \textstyle\sum_{j\in A} x_j \le r(A) \text{ for all } A \subseteq N\Big\}.P(r):={x∈R+n​:∑j∈A​xj​≤r(A) for all A⊆N}.

For two ground sets M,NM,NM,N and set functions r1,r2r_1,r_2r1​,r2​, the disjoint-space union is Z(r1,r2):={(x,y)∈[0,1]m×[0,1]n:x∈P(r1) or y∈P(r2)}Z(r_1,r_2) := \{(x,y)\in[0,1]^m\times[0,1]^n : x\in P(r_1) \text{ or } y\in P(r_2)\}Z(r1​,r2​):={(x,y)∈[0,1]m×[0,1]n:x∈P(r1​) or y∈P(r2​)}. For polymatroid rank functions r1,r2r_1,r_2r1​,r2​ on the same ground set NNN, Π:={π≥0:πx≤1 for x∈P(r1)∪P(r2)}\Pi := \{\pi \ge 0 : \pi x \le 1 \text{ for } x \in P(r_1)\cup P(r_2)\}Π:={π≥0:πx≤1 for x∈P(r1​)∪P(r2​)} and U:={u≥0:∑AuAri(A)≤1, i=1,2}U := \{u \ge 0 : \sum_A u_A r_i(A) \le 1,\ i=1,2\}U:={u≥0:∑A​uA​ri​(A)≤1, i=1,2} (indexed by all subsets A⊆NA \subseteq NA⊆N) are the auxiliary polytopes the final proof reduces to.

Formalization targets

Proposition 13.16. For set functions r1,r2r_1,r_2r1​,r2​ satisfying the Application-1 conditions,

conv(Z(r1,r2))={(x,y):∣A∣−x(A)∣A∣−r1(A)+∣B∣−y(B)∣B∣−r2(B)≥1 ∀A⊆M,B⊆N with r1(A)<∣A∣, r2(B)<∣B∣}.\mathrm{conv}(Z(r_1,r_2)) = \Big\{(x,y) : \frac{|A|-x(A)}{|A|-r_1(A)} + \frac{|B|-y(B)}{|B|-r_2(B)} \ge 1 \ \forall A\subseteq M, B\subseteq N \text{ with } r_1(A)<|A|,\ r_2(B)<|B|\Big\}.conv(Z(r1​,r2​))={(x,y):∣A∣−r1​(A)∣A∣−x(A)​+∣B∣−r2​(B)∣B∣−y(B)​≥1 ∀A⊆M,B⊆N with r1​(A)<∣A∣, r2​(B)<∣B∣}.

Corollary 13.21. The same-space specialization: conv(P(r1)∪P(r2))={w∈[0,1]n:w=x+y,[the same displayed inequality, A,B⊆N]}\mathrm{conv}(P(r_1)\cup P(r_2)) = \{w\in[0,1]^n : w=x+y, \text{[the same displayed inequality, } A,B\subseteq N\text{]}\}conv(P(r1​)∪P(r2​))={w∈[0,1]n:w=x+y,[the same displayed inequality, A,B⊆N]}.

Proposition 13.22. Π\PiΠ is exactly the projection, onto π\piπ, of {πj≤∑A∋juA (j∈N), ∑AuAri(A)≤1 (i=1,2), π,u≥0}\{\pi_j \le \sum_{A\ni j} u_A\ (j\in N),\ \sum_A u_A r_i(A)\le1\ (i=1,2),\ \pi,u\ge0\}{πj​≤∑A∋j​uA​ (j∈N), ∑A​uA​ri​(A)≤1 (i=1,2), π,u≥0}.

Proposition 13.23. Every extreme point of Π\PiΠ arises from an extreme point of UUU via πj=∑A∋juA\pi_j = \sum_{A\ni j} u_Aπj​=∑A∋j​uA​.

Theorem 13.24 (goal, the book's closing theorem). For polymatroid rank functions r1,r2r_1,r_2r1​,r2​,

conv(P(r1)∪P(r2))={x≥0:x(A)≤max⁡{r1(A),r2(A)} ∀A⊆N;  r2(B)−r1(B)r1(A)r2(B)−r1(B)r2(A)x(A)+r1(A)−r2(A)r1(A)r2(B)−r1(B)r2(A)x(B)≤1\mathrm{conv}(P(r_1)\cup P(r_2)) = \Big\{x\ge0 : x(A)\le\max\{r_1(A),r_2(A)\}\ \forall A\subseteq N;\ \ \frac{r_2(B)-r_1(B)}{r_1(A)r_2(B)-r_1(B)r_2(A)}x(A) + \frac{r_1(A)-r_2(A)}{r_1(A)r_2(B)-r_1(B)r_2(A)}x(B) \le 1conv(P(r1​)∪P(r2​))={x≥0:x(A)≤max{r1​(A),r2​(A)} ∀A⊆N;  r1​(A)r2​(B)−r1​(B)r2​(A)r2​(B)−r1​(B)​x(A)+r1​(A)r2​(B)−r1​(B)r2​(A)r1​(A)−r2​(A)​x(B)≤1  ∀A,B⊆N with (r1(A)−r2(A))(r1(B)−r2(B))<0}.\ \forall A,B\subseteq N \text{ with } (r_1(A)-r_2(A))(r_1(B)-r_2(B))<0\Big\}. ∀A,B⊆N with (r1​(A)−r2​(A))(r1​(B)−r2​(B))<0}.

The targets trace the book's own tower: the disjoint-space specialization (13.16) and its same-space corollary (13.21) establish the lifted description; Propositions 13.22-13.23 build the blocker/projection machinery; Theorem 13.24 collapses everything into the unlifted, original-variable-space closed form that is the book's final word.

Significance

Theorem 13.24 is a genuinely rare achievement in polyhedral combinatorics: a complete, explicit, non-lifted facet description for the union of two polymatroids — objects whose individual facet structure is already exponential and only tractable via the greedy algorithm and submodular minimization. That the union of two such objects still admits a closed form, stated purely in terms of the two rank functions evaluated at pairs of subsets, is the payoff the entire chapter's machinery (dominants, blockers, upper monotonicity, disjoint-space unions) was built toward. The result strictly generalizes an earlier theorem restricted to matroid polyhedra, obtained there by different techniques specific to matroids; this proof works because polymatroid optimization (Edmonds's greedy algorithm) survives in the more general submodular, non-0/1-truncated setting.

Both directions are proved in the source (Balas's own chapter, building on Edmonds's polymatroid theory and the disjoint-union machinery developed earlier in the same chapter) but have no counterpart on this platform: nothing existing treats polymatroids, polymatroid rank functions, or a closed-form union of two polymatroids. Mathlib's Combinatorics/Matroid/* covers matroids and their rank functions but not this strictly more general polymatroid object (an integer- or real-valued submodular monotone set function, not a matroid's 0/1-truncated rank). This mission produces the first Lean statements of all five targets.

Difficulty

The obvious shortcut for Theorem 13.24 is to state only the "single active subset" family of inequalities (x(A)≤max⁡{r1(A),r2(A)}x(A)\le\max\{r_1(A),r_2(A)\}x(A)≤max{r1​(A),r2​(A)}) and treat the two-subset family as a minor addendum — but the two-subset inequalities are not optional refinements, they are half of the facet system, arising from the genuinely two-dimensional case of the underlying linear program (a basic feasible solution of UUU with two nonzero components). Dropping them, or stating them only for a special case of A,BA,BA,B, would produce a strictly weaker (and generally invalid, since it would omit real facets) description.

The condition (r1(A)−r2(A))(r1(B)−r2(B))<0(r_1(A)-r_2(A))(r_1(B)-r_2(B))<0(r1​(A)−r2​(A))(r1​(B)−r2​(B))<0 is easy to state but not to motivate without the underlying linear algebra: it is exactly the condition under which the 2×22\times22×2 system uAr1(A)+uBr1(B)=1u_Ar_1(A)+u_Br_1(B)=1uA​r1​(A)+uB​r1​(B)=1, uAr2(A)+uBr2(B)=1u_Ar_2(A)+u_Br_2(B)=1uA​r2​(A)+uB​r2​(B)=1 has a solution with both uA,uB>0u_A,u_B>0uA​,uB​>0 — a fact the book verifies by direct computation (Cramer's rule) rather than a structural argument, which is why this mission states the condition exactly as derived rather than paraphrasing it into a more "intuitive" but unfaithful form.

Formalization scope

The ambient space is Fin n → ℝ throughout (or Fin m → ℝ / Fin n → ℝ separately for Proposition 13.16's disjoint spaces), matching the series default; subsets A,B⊆NA,B\subseteq NA,B⊆N are Finset (Fin n), and the auxiliary variable uuu of Propositions 13.22-13.23 is indexed by Finset (Fin n) itself (a genuine Fintype for fixed n), matching "uAu_AuA​ for all A⊆NA\subseteq NA⊆N" directly. IsApp1SetFunction and IsPolymatroidRankFunction are kept as two distinct predicates — the goal theorem uses the latter, Proposition 13.16/Corollary 13.21 the former — matching BRIEF.md's explicit warning to locate and preserve the book's own exact numbered conditions rather than infer a single merged notion. A trivializing formalization to rule out explicitly: stating Theorem 13.24 with only the single-subset inequality family, which would omit the two-subset facets that are half of the theorem's actual content.

This mission depends on no other chunk's Lean definitions; it restates 13a-dominants's dominant/blocker/upper-monotone vocabulary only informally (the underlying object, not any specific Lean declaration), per the series convention, since no chunk in this series can import another's draft module. Theorem 13.13 (the general dominant of a disjoint-space union) and Theorem 13.18 (the general same-space reduction) — the two results whose specializations Proposition 13.16 and Corollary 13.21 respectively are — were not drafted this pass; see HARD.md. As the last mission of the whole book, this chunk's items.yaml closes the series begun in 01-intro-duality: sixteen missions, one book, spanning from the founding disjunctive Farkas lemma to this closed-form union of two polymatroids.

Selected references

  • J. Edmonds, Submodular functions, matroids, and certain polyhedra, in Combinatorial Structures and Their Applications, Gordon and Breach, 1970, 69–87 (reprinted in Combinatorial Optimization — Eureka, You Shrink!, LNCS 2570, Springer, 2003, 11–26, https://doi.org/10.1007/3-540-36478-1_2).
  • E. Balas, A. Bockmayr, N. Pisaruk, and L. Wolsey, On unions and dominants of polytopes, Mathematical Programming A 99 (2004), 223–239. https://doi.org/10.1007/s10107-003-0432-4
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 13, §13.2.1–13.8 (the book's final chapter). https://doi.org/10.1007/978-3-030-00148-3
9 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming XI: The Cut-Generating LP Under a Ray NormalizationTextbook

Motivation

Lift-and-project (L&P) cuts strengthen the linear relaxation of a mixed 0-1 program by separating a fractional point from the convex hull of a disjunction such as xk≤0∨xk≥1x_k \le 0 \lor x_k \ge 1xk​≤0∨xk​≥1. Generating an optimal L&P cut means solving the cut-generating linear program (CGLP), a linear program lifted to a space with one new pair of variables per constraint of the original tableau — considerably larger than the tableau itself. Balas and Bonami showed that this higher-dimensional LP need not be solved explicitly at all: an optimal (or near-optimal) L&P cut can instead be produced by ordinary simplex pivots in the original LP tableau, each such pivot implicitly performing an entire block of pivots in the CGLP (E. Balas and P. Bonami, Generating lift-and-project cuts from the LP simplex tableau: open source implementation and testing of new variants, Mathematical Programming Computation 1 (2009), 165–199, https://doi.org/10.1007/s12532-009-0006-4). This correspondence is what made L&P cuts practical in commercial solvers: Perregaard's implementation in XPRESS needed only 5% of the iterations and 1.5% of the time of solving the CGLP explicitly, and Bonami's public implementation in COIN-OR put the method within reach of any solver.

A second, independent line of work asks how the CGLP's feasible region should be normalized. The textbook normalization (fixing the sum of the CGLP multipliers to 111) is scale-dependent — rescaling one constraint of the original system changes which cut the CGLP returns — so Balas and Perregaard proposed the ray normalization αy=1\alpha y = 1αy=1 instead (E. Balas and M. Perregaard, Lift-and-project for mixed 0-1 programming: recent progress, Discrete Applied Mathematics 123 (2002), 129–154, https://doi.org/10.1016/S0166-218X(01)00340-7). Under this normalization the CGLP's optimal value has a clean geometric meaning: it is exactly the distance, measured along a fixed ray from the point being separated, to the convex hull of the disjunctive set. This mission formalizes both results: the pivot correspondence (Theorem 10.1) and the optimal-value characterization under the ray normalization (Theorem 10.2, Theorem 10.3, and Corollary 10.4).

Setting

Fix a finite index set MMM for the rows of a simplex tableau over nnn variables, a matrix A∈RM×nA \in \mathbb R^{M \times n}A∈RM×n, and a right-hand side b:M→Rb : M \to \mathbb Rb:M→R, so that the tableau reads Ax≥bA x \ge bAx≥b (a "tilde" is dropped from the informal A~,b~\tilde A, \tilde bA~,b~ notation for the optimal-basis tableau of the linear relaxation). A basis is an injection ι:Fin n→M\iota : \mathrm{Fin}\, n \to Mι:Finn→M picking out nnn of the rows; write A^\hat AA^ for the n×nn \times nn×n submatrix A^ij=Aι(i),j\hat A_{ij} = A_{\iota(i), j}A^ij​=Aι(i),j​ and b^\hat bb^ for the corresponding subvector. From these, the standard tableau quantities are read off: aˉk0:=ekA^−1b^\bar a_{k0} := e_k \hat A^{-1} \hat baˉk0​:=ek​A^−1b^, aˉkj:=−(A^−1)kj\bar a_{kj} := -(\hat A^{-1})_{kj}aˉkj​:=−(A^−1)kj​, and the surplus of row i∈Mi \in Mi∈M at a point xxx, Surplusi(x):=(Ax−b)i\mathrm{Surplus}_i(x) := (Ax - b)_iSurplusi​(x):=(Ax−b)i​.

Fix a distinguished row kkk with a fractional basic variable, and a candidate pivot row i≠ki \ne ki=k. For ℓ\ellℓ ranging over the nonbasic columns JJJ, set γℓ:=−aˉkℓ/aˉiℓ\gamma_\ell := -\bar a_{k\ell}/\bar a_{i\ell}γℓ​:=−aˉkℓ​/aˉiℓ​; this is the value of a parameter γ\gammaγ at which the combined source row

xk+γxi+∑j∈J(aˉkj+γaˉij)xj=aˉk0+γaˉi0(10.1γ)x_k + \gamma x_i + \sum_{j \in J} (\bar a_{kj} + \gamma \bar a_{ij}) x_j = \bar a_{k0} + \gamma \bar a_{i0} \tag{10.1$_\gamma$}xk​+γxi​+j∈J∑​(aˉkj​+γaˉij​)xj​=aˉk0​+γaˉi0​(10.1γ​)

has its jjj-th coefficient pass through 000. The simple disjunctive cut obtained by applying the split disjunction z≤0∨z≥1z \le 0 \lor z \ge 1z≤0∨z≥1 (where zzz is the left side of (10.1γ_\gammaγ​)) to this row is the object CombinedCutSet.

On the CGLP side, (CGLP)k(\mathrm{CGLP})_k(CGLP)k​ is the cut-generating LP associated with the disjunction −xk≥0∨xk≥1-x_k \ge 0 \lor x_k \ge 1−xk​≥0∨xk​≥1 from Chapter 8: it has one pair of nonnegative multiplier variables (uρ,vρ)(u_\rho, v_\rho)(uρ​,vρ​) per row ρ∈M\rho \in Mρ∈M, plus u0,v0≥0u_0, v_0 \ge 0u0​,v0​≥0, tied together by the normalization ∑ρuρ+u0+∑ρvρ+v0=1\sum_\rho u_\rho + u_0 + \sum_\rho v_\rho + v_0 = 1∑ρ​uρ​+u0​+∑ρ​vρ​+v0​=1, and its feasible solutions (α,u,u0,v,v0,β)(\alpha, u, u_0, v, v_0, \beta)(α,u,u0​,v,v0​,β) correspond exactly to valid cuts αx≥β\alpha x \ge \betaαx≥β for the disjunction. A basic feasible solution to (CGLP)k(\mathrm{CGLP})_k(CGLP)k​ is described by a valid partition (M1,M2)(M_1, M_2)(M1​,M2​) of the nonbasic rows, with uρ=0u_\rho = 0uρ​=0 off M1M_1M1​ and vρ=0v_\rho = 0vρ​=0 off M2M_2M2​.

Separately, fix a disjunctive set and write PD⊆RnP_D \subseteq \mathbb R^nPD​⊆Rn for its convex hull — the object every cut ultimately wants to separate a point from. For a fixed direction y∈Rny \in \mathbb R^ny∈Rn and point xˉ∈Rn\bar x \in \mathbb R^nxˉ∈Rn, (CGLP)y(\mathrm{CGLP})_y(CGLP)y​ is the cut-generating LP under the ray normalization: pairs (α,β)(\alpha, \beta)(α,β) with αx≥β\alpha x \ge \betaαx≥β valid for every x∈PDx \in P_Dx∈PD​ and αy=1\alpha y = 1αy=1, minimizing the objective αxˉ−β\alpha \bar x - \betaαxˉ−β.

Formalization targets

Theorem 10.1. For a genuine ordered pivot chain j1,…,jtj_1, \dots, j_tj1​,…,jt​ inside JJJ (no repeats, each consecutive pair flipping the sign of aˉk,⋅\bar a_{k,\cdot}aˉk,⋅​ as γ\gammaγ increases — rule (b) of the theorem), the simple disjunctive cut from the combined row at γ=γjt\gamma = \gamma_{j_t}γ=γjt​​ equals the lift-and-project cut {x:β≤αx}\{x : \beta \le \alpha x\}{x:β≤αx} associated with a basic feasible solution to (CGLP)k(\mathrm{CGLP})_k(CGLP)k​ for the resulting basis J′:=(J∪{i})∖{jt}J' := (J \cup \{i\}) \setminus \{j_t\}J′:=(J∪{i})∖{jt​}:

CombinedCutSet(k,i,J,γjt)={x:β≤αx}.\mathrm{CombinedCutSet}(k, i, J, \gamma_{j_t}) = \{x : \beta \le \alpha x\}.CombinedCutSet(k,i,J,γjt​​)={x:β≤αx}.

Theorem 10.2. If (CGLP)y(\mathrm{CGLP})_y(CGLP)y​ is feasible, it has a finite minimum if and only if the ray meets the disjunctive hull:

finite min  ⟺  ∃ λ∈R, xˉ+λy∈PD.\text{finite min} \iff \exists\, \lambda \in \mathbb R,\ \bar x + \lambda y \in P_D.finite min⟺∃λ∈R, xˉ+λy∈PD​.

Theorem 10.3 (goal). If (CGLP)y(\mathrm{CGLP})_y(CGLP)y​ has an optimal solution (α~,β~)(\tilde\alpha, \tilde\beta)(α~,β~​), its optimal value is exactly the signed distance to PDP_DPD​ along the ray, and the corresponding boundary point lies exactly on the optimal hyperplane:

xˉTα~−β~=λ∗:=min⁡{λ:xˉ+λy∈PD},(xˉ+λ∗y)Tα~=β~.\bar x^{\mathsf T} \tilde\alpha - \tilde\beta = \lambda^* := \min\{\lambda : \bar x + \lambda y \in P_D\}, \qquad (\bar x + \lambda^* y)^{\mathsf T} \tilde\alpha = \tilde\beta.xˉTα~−β~​=λ∗:=min{λ:xˉ+λy∈PD​},(xˉ+λ∗y)Tα~=β~​.

Corollary 10.4. Taking y:=x∗−xˉy := x^* - \bar xy:=x∗−xˉ for a point x∗x^*x∗ in the lifted polyhedron PQP_QPQ​ gives an optimal solution whose hyperplane separates xˉ\bar xxˉ and meets the segment (xˉ,x∗](\bar x, x^*](xˉ,x∗] at the point closest to x∗x^*x∗.

The targets are ordered from the purely combinatorial pivot correspondence (10.1, independent of the ray normalization) through the abstract feasibility/boundedness dichotomy (10.2) to the concrete value formula that is this mission's goal (10.3), with the geometric illustration (10.4) as a companion result using the same machinery with a specific choice of ray.

Significance

Theorem 10.1 is the theoretical justification for every commercial L&P-cut implementation cited above: it says the pivot correspondence is not an approximation or a heuristic shortcut but an exact identity between a single LP pivot and a specific, describable sequence of CGLP pivots, which is what lets a solver generate an (quasi-)optimal L&P cut at the cost of ordinary simplex pivots instead of solving a much larger LP. Theorem 10.3 gives the ray-normalized CGLP an exact geometric meaning — its value is a distance, not merely a linear-programming optimum — which is what makes the ray normalization the more robust alternative to the scale-dependent constant-sum normalization used elsewhere in the book (§9), and is the basis for the geometric picture (Corollary 10.4, Fig. 10.3) of how a lift-and-project cut relates to the lifted polyhedron PQP_QPQ​.

Both directions are proved in the source text (Balas and Bonami 2009 for Theorem 10.1; Balas and Perregaard 2002 for Theorems 10.2/10.3 and Corollary 10.4) but have no formalized counterpart on this platform: no existing item treats cut-generating LPs, ray normalizations of a projection cone, or the correspondence between two different pivoting processes. This mission produces the first Lean statements of both.

Difficulty

The obvious temptation for Theorem 10.1 is to existentially weaken "the sequence of ttt pivots defined as follows" to "there exists some sequence of pivots realizing the same cut" — which would be true but not what the theorem says, and would erase the entire content that makes the result useful (an algorithm, not just an existence claim). The formalization instead carries the explicit ordered chain j1 :: middle ++ [jt] as data, with the three-part construction (rules (a), (b), (c)) encoded as hypotheses on that specific list via List.IsChain, so the theorem proved is the constructive one the book states, not a weaker existential shadow of it.

For Theorem 10.3, the proof pattern in the book resists a shortcut: showing λ0=λ∗\lambda_0 = \lambda^*λ0​=λ∗ requires deriving a contradiction from each strict inequality (λ0>λ∗\lambda_0 > \lambda^*λ0​>λ∗ violates optimality of the point on PDP_DPD​'s boundary; λ0<λ∗\lambda_0 < \lambda^*λ0​<λ∗ contradicts optimality of (α~,β~)(\tilde\alpha, \tilde\beta)(α~,β~​) for (CGLP)y(\mathrm{CGLP})_y(CGLP)y​ via a competing separating hyperplane), so there is no way to avoid formalizing both directions of the boundedness dichotomy already needed for Theorem 10.2 first.

Formalization scope

The ambient space is Fin n→R\mathrm{Fin}\ n \to \mathbb RFin n→R throughout, matching the rest of the series. (CGLP)y(\mathrm{CGLP})_y(CGLP)y​'s feasibility (IsCGLPYFeasible) is stated directly as validity of (α,β)(\alpha, \beta)(α,β) for PDP_DPD​ under αy=1\alpha y = 1αy=1, not through an explicit representation of the projection cone's extreme rays — this matches how the book's own Theorems 10.2/10.3 and Corollary 10.4 are phrased purely in terms of (α,β)(\alpha,\beta)(α,β)-validity for PDP_DPD​, never in terms of a specific disjunction's multipliers, so this is not a weakening relative to the source. PDP_DPD​ (the disjunctive hull that (CGLP)y(\mathrm{CGLP})_y(CGLP)y​ is defined against) and PQP_QPQ​ (the lifted polyhedron whose supporting hyperplane Corollary 10.4 describes) are kept as two independent Set (Fin n → ℝ) parameters with no assumed relationship between them, matching the book's own text, which never states one; conflating them would be a trivializing formalization that this mission explicitly avoids. "The point closest to x∗x^*x∗" on the segment (xˉ,x∗](\bar x, x^*](xˉ,x∗] is formalized via IsGreatest on the parameter t∈(0,1]t \in (0, 1]t∈(0,1] at which the optimal hyperplane meets the segment, rather than via an unformalized Euclidean-distance minimization, since that is what "closest" means for points colinear with xˉ\bar xxˉ and x∗x^*x∗ on a single ray.

Corollary 10.4 corrects a typo in the printed text: the corollary as printed reads "let y:=xˉy := \bar xy:=xˉ for some x∗∈PQx^* \in P_Qx∗∈PQ​", omitting "x∗−x^* -x∗−" before xˉ\bar xxˉ; the very next line's figure caption gives the intended formula unambiguously as y=x∗−xˉy = x^* - \bar xy=x∗−xˉ, and the formalization uses the corrected formula (see MODERATION_NOTES.md).

This mission depends on no other chunk's Lean definitions — the CGLP and tableau apparatus needed here (originally introduced in Chapters 8 and 9) is restated locally, per the series' convention against importing another draft mission's definitions across chunks that are being drafted concurrently. A complete development needs: Farkas-type separation for the boundedness dichotomy in Theorem 10.2, and careful bookkeeping of finite index sets and their images under the basis maps ι,ι′\iota, \iota'ι,ι′ for Theorem 10.1. The tableau infrastructure (Ahat, Bhat, Abar0, Abar, GammaOf) is reusable by any later mission touching the simplex-tableau side of lift-and-project cuts.

Selected references

  • E. Balas and P. Bonami, Generating lift-and-project cuts from the LP simplex tableau: open source implementation and testing of new variants, Mathematical Programming Computation 1 (2009), 165–199. https://doi.org/10.1007/s12532-009-0006-4
  • E. Balas and M. Perregaard, Lift-and-project for mixed 0-1 programming: recent progress, Discrete Applied Mathematics 123 (2002), 129–154. https://doi.org/10.1016/S0166-218X(01)00340-7
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 10, §10.1 and §10.6. https://doi.org/10.1007/978-3-030-00148-3
8 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming X: Solving the Cut-Generating LP on the Simplex TableauTextbook

Motivation

Chapter 8 established an exact correspondence between lift-and-project cuts and simple disjunctive cuts, but its practical payoff is what this chapter develops: the cut-generating LP (CGLP)_k never needs to be formulated or solved on its own. Every pivot of (CGLP)_k can instead be mimicked directly on the much smaller simplex tableau of the original LP relaxation — replacing a large auxiliary linear program with bookkeeping on a tableau the solver already has. This chapter works out that correspondence at the level of individual pivots: which tableau pivot improves the resulting cut, and by how much, answered entirely in terms of ordinary tableau coefficients and two closed-form evaluation functions.

Setting

S:={1,…,m+p} and N:={m+p+1,…,m+p+n} index the surplus and structural variables of (LP) respectively — giving a direct correspondence between (LP)'s own variables and the surplus variables of Ãx≥b̃. For a basic solution with nonbasic set J (row set M1∪M2 from Chapter 8), Â:=Ã_J is the resulting nonsingular submatrix, and row k of the tableau reads x_k+ Σ_{j∈J}ā_{kj}s_j=ā_{k0}. Adding γ times row i to row k gives the composite row (9.10), x_k+γx_i+Σ_{j∈J}(ā_{kj}+γā_{ij})s_j=ā_{k0}+γā_{i0}, from which a new simple disjunctive cut can be read off whenever 0<ā_{k0}+γā_{i0}<1.

Formalization targets

Theorem 9.3 (goal) — the most-improving pivot column

The pivot column in row i most improving the cut from row k is indexed by l*∈J minimizing f⁺(γ_l) (if ā_{kl}ā_{il}<0) or f⁻(γ_l) (if ā_{kl}ā_{il}>0), over all l∈J with -ā_{k0}/ā_{i0}<γ_l<(1-ā_{k0})/ā_{i0}, γ_l:=-ā_{kl}/ā_{il}.

The chain of results building toward it

Lemma 9.1 (the tableau coefficients' closed form, eq. (9.4)-(9.5)) and Theorem 9.2 (the reduced costs of the CGLP columns u_i,v_i in terms of tableau coefficients, eq. (9.6)) are the two milestones the goal's own machinery is built from. Proposition 9.4, a bridge to Chapters 10-11's general split disjunctions, is included as a genuine milestone despite its payoff lying mostly outside this chapter.

Significance

The results themselves. This chapter is what makes lift-and-project cuts practical: instead of solving an (m+p+n)-row auxiliary LP from scratch for every candidate cut, a single pivot on the (LP)'s own tableau — guided by reduced costs that are themselves closed-form functions of tableau entries — identifies whether an improving cut exists and which one it is. Theorem 9.3's evaluation functions f⁺,f⁻ are exactly the tool a cutting-plane implementation would compute at every candidate pivot.

Formalizing it. No object in this mission exists on the platform prior to it or in Mathlib. This mission restates 08-cut-correspondence's (CGLP)_k apparatus locally, per the series convention and BRIEF.md's explicit instruction, and extends it with this chapter's own generalization to an arbitrary tableau row (needed since Lemma 9.1/Theorem 9.2 concern every basic variable's row, not only the disjunction row k).

Difficulty

Lemma 9.1's book proof is a four-case block-matrix verification (structural/surplus, basic/nonbasic); this mission instead states its content as the identity it is actually for — that the closed-form coefficients express every row's slack as an affine function of the nonbasic rows' slacks, for every point x — which follows tautologically from x=Â⁻¹b̂+Â⁻¹s_J's own definition once stated this way, without needing to reconstruct the block-matrix case analysis. Theorem 9.2's difficulty is that "reduced cost" is not already available as a formalized LP concept in this mission's apparatus; rather than build a generic LP reduced-cost theory, this mission follows the book's own derivation directly — explicitly constructing the pivoted-out extension of a basic solution (eq. (9.7)-(9.9)) and asserting that its objective value decomposes with r_{u_i},r_{v_i} as coefficients, which is genuine, non-circular content matching the proof's own final step ("we can then read the reduced costs... as the coefficients").

Formalization scope

This chapter makes the row/variable identification of Chapters 6-8 fully explicit (N directly indexes the structural variables), but no theorem's own displayed formula in this chunk needs that correspondence beyond what SurplusM's row-general treatment (this chunk's own generalization of 08-cut-correspondence's Surplus) already provides — see MODERATION_NOTES.md for why the S/N/B/R/P/Q block structure is proof machinery, not part of the stated content, throughout.

Theorem 9.3's range condition on γ_l, truncated in BRIEF.md's own excerpt, was completed by reading the PDF directly (confirmed identical to the range derived earlier in the same section): -ā_{k0}/ā_{i0}<γ_l<(1-ā_{k0})/ā_{i0}.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 9.
  • E. Balas, M. Perregaard, A precise correspondence between lift-and-project cuts, simple disjunctive cuts, and mixed integer Gomory cuts for 0-1 programming, Mathematical Programming B 94 (2003), 221–245 (cited in the text as [33], the origin of the tableau-pivoting procedure this chapter derives Lemma 9.1 and Theorem 9.2 from).
9 thms3 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming VI: Extended Formulations for Perfectly Matchable Subgraph PolytopesTextbook

Motivation

Many polytopes that arise from combinatorial optimization problems have no small facet description in their natural variable space, yet become describable by a compact linear system once lifted to a higher-dimensional space of auxiliary variables and projected back down — Chapter 2's own extended formulation of the convex hull of a disjunctive set is one instance of this phenomenon. This chapter turns the idea around: rather than using projection to build a compact formulation, it uses projection to prove integrality of a formulation that is already compact but whose integrality is not obvious from any standard sufficient condition (total unimodularity, balancedness, etc.). The technique is illustrated on three closely related combinatorial polytopes built from perfectly matchable, assignable, and path-decomposable vertex subsets of a graph or digraph — each proved integral by lifting to an edge- or arc-variable space where total unimodularity is easy to check, then projecting.

Setting

For a finite vertex set VVV, the incidence vector of W⊆VW \subseteq VW⊆V is 111 on WWW, 000 elsewhere, and x(S):=∑i∈Sxix(S) := \sum_{i \in S} x_ix(S):=∑i∈S​xi​. A graph G(W)G(W)G(W) has a perfect matching if there is a fixed-point-free involution on WWW respecting adjacency. The PMS (Perfectly Matchable Subgraph) polytope of GGG is conv(X)\mathrm{conv}(X)conv(X) where XXX is the set of incidence vectors of such WWW; N(S):={j∉S:(i,j)∈E for some i∈S}N(S) := \{j \notin S : (i,j) \in E \text{ for some } i \in S\}N(S):={j∈/S:(i,j)∈E for some i∈S}.

For a digraph (V,A)(V,A)(V,A): G(W)G(W)G(W) is assignable if it admits a cycle decomposition (a permutation of WWW respecting arcs), giving the Assignable Subgraph Polytope. For an acyclic digraph with distinguished nodes s,ts,ts,t: G(W∪{s,t})G(W \cup \{s,t\})G(W∪{s,t}) admits an sss-ttt path decomposition if a collection of interior-node-disjoint sss-ttt paths covers it, giving the sss-ttt Path Decomposable Subgraph Polytope over W⊆V∖{s,t}W \subseteq V \setminus \{s,t\}W⊆V∖{s,t}. Γ(S)\Gamma(S)Γ(S) and Γ∗(S)\Gamma^*(S)Γ∗(S) are the corresponding out-neighborhood operators. For an arbitrary graph, c(S)c(S)c(S) counts the connected components of the induced subgraph G(S)G(S)G(S).

Formalization targets

Theorem 5.1 (goal) — the PMS polytope of a bipartite graph

0≤xi≤1 (i∈V),x(V1)−x(V2)=0,x(S)−x(N(S))≤0  (S⊆V1).0 \le x_i \le 1\ (i \in V), \qquad x(V_1) - x(V_2) = 0, \qquad x(S) - x(N(S)) \le 0\ \ (S \subseteq V_1).0≤xi​≤1 (i∈V),x(V1​)−x(V2​)=0,x(S)−x(N(S))≤0  (S⊆V1​).

Theorem 5.2 — the Assignable Subgraph Polytope

0≤xi≤1 (i∈V),x(S∖Γ(S))−x(Γ(S)∖S)≤0(S⊆V).0 \le x_i \le 1\ (i \in V), \qquad x(S \setminus \Gamma(S)) - x(\Gamma(S) \setminus S) \le 0 \quad (S \subseteq V).0≤xi​≤1 (i∈V),x(S∖Γ(S))−x(Γ(S)∖S)≤0(S⊆V).

Theorem 5.3 — the sss-ttt Path Decomposable Subgraph Polytope

0≤xi≤1 (i∈V),x(S∖Γ∗(S))−x(Γ∗(S)∖S)≤0(S⊆V∖{s,t}).0 \le x_i \le 1\ (i \in V), \qquad x(S \setminus \Gamma^*(S)) - x(\Gamma^*(S) \setminus S) \le 0 \quad (S \subseteq V \setminus \{s,t\}).0≤xi​≤1 (i∈V),x(S∖Γ∗(S))−x(Γ∗(S)∖S)≤0(S⊆V∖{s,t}).

Theorem 5.4 — the PMS polytope of an arbitrary graph

0≤xi≤1 (i∈V),x(S)−x(N(S))≤∣S∣−c(S)0 \le x_i \le 1\ (i \in V), \qquad x(S) - x(N(S)) \le |S| - c(S)0≤xi​≤1 (i∈V),x(S)−x(N(S))≤∣S∣−c(S)

for every SSS all of whose components are single nodes or nonbipartite with odd order — the weakest faithful statement, since dropping the side condition would assert the inequality for subsets it does not hold for.

Significance

The results themselves. Each theorem gives an explicit, checkable linear system defining a polytope that arises naturally from a combinatorial covering/decomposition property, turning "does G(W)G(W)G(W) have property XXX" into a linear-programming feasibility question. Theorem 5.1 is the one the book proves in full and the template for the other three: bipartite matching, digraph assignment, and acyclic-digraph path decomposition are structurally parallel problems (all reduce to checking a König–Hall-type combinatorial condition), and the same lift-and-project technique handles all three uniformly. Theorem 5.4 extends the idea to arbitrary (non-bipartite) graphs at the cost of a sharper right-hand side and a component-based side condition, connecting to Edmonds' classical matching-polytope theory while remaining a genuinely different object (a polytope of coverable vertex sets, not of matchings themselves).

Formalizing it. No object in this mission — the PMS, Assignable, or Path Decomposable Subgraph polytopes, or their defining neighbor operators — exists on the platform prior to this mission. The closest platform result, MetricTSP.pm_polytope_decomposition (Edmonds' perfect matching polytope theorem, in edge-variable space over a fixed vertex set requiring every vertex matched), is a genuinely different object from Theorem 5.4's PMS polytope (vertex-variable space, vertices may be left unmatched by design) and is not reused as a kind: reference item; it is noted here as related, not equivalent.

Difficulty

The natural first attempt tries to verify each polytope's integrality directly, by checking a known sufficient condition (total unimodularity, balancedness) on the displayed vertex-space system itself. This fails: the book states explicitly that (5.5)'s coefficient matrix is not totally unimodular, which is exactly why the lift-to-edge-variables step is necessary at all. The real content of each theorem is the two-part argument: (1) the lifted system in edge/arc variables is totally unimodular (checkable directly), so its polyhedron is integral; and (2) the vertex- space system is exactly the projection of the lifted one — a nontrivial fact requiring Chapter 2's projection machinery, not merely an unfolding of definitions. Theorem 5.4's extra difficulty, flagged explicitly in the text, is that its projection cone is not pointed, so the proof must work with a finite generating set rather than extreme rays, and it suffices to find a subset of generators producing every facet rather than a complete generating set — a genuinely harder argument the book itself outsources to a citation.

Formalization scope

Undirected graphs use Mathlib's SimpleGraph; digraphs use a bare relation A : V → V → Prop (not required symmetric or irreflexive, matching the book's unrestricted notion). Bipartition is recorded via part : V → Bool (decidable by construction) rather than two Set V halves, keeping the sums x(V_1), x(V_2) computable over Finsets throughout. IsAssignable uses Equiv.Perm on the vertex-set subtype, since a cycle decomposition is exactly a permutation. IsComponentOf and IsBipartiteOn (Theorem 5.4) are built directly from reachability and 2-colorability rather than Mathlib's induced-subgraph/ConnectedComponent API, matching the "maximal connected subset" reading of "component" the book's own prose intends.

IsPathDecomposable (Theorem 5.3) encodes "admits an sss-ttt path decomposition" via a degree-constrained arc set (every interior node has exactly one incoming and one outgoing chosen arc, none entering sss or leaving ttt, at least one leaving sss) rather than an explicit list of vertex-disjoint paths — provably equivalent by the standard fact that an acyclic arc set with this degree pattern always decomposes into such a path family, and considerably lighter to state and reason about than constructing Path objects directly.

A trivializing formalization is ruled out explicitly: every theorem keeps the fractional box constraint 0≤xi≤10 \le x_i \le 10≤xi​≤1 rather than the integral xi∈{0,1}x_i \in \{0,1\}xi​∈{0,1} (per BRIEF.md's own warning, dropping the relaxation collapses the claim to a restatement of the combinatorial definition), and Theorem 5.1 is stated only for bipartite graphs — never generalized to subsume Theorem 5.4's genuinely different inequality system and side condition.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 5, §5.2.
  • M. O. Ball, U. Derigs, An analysis of alternate strategies for implementing matching algorithms, Networks 13 (1983) (cited in the text as [13], the origin of Theorems 5.2 and 5.3).
  • W. R. Pulleyblank, J. Edmonds, Facets of 1-matching polyhedra, in Hypergraph Seminar, Springer Lecture Notes in Mathematics 411 (1974) — the origin of the perfectly matchable subgraph polytope literature (cited in the text as [34], the origin of Theorem 5.1).
  • L. Lovász, M. D. Plummer, Matching Theory, Elsevier, 1986 (cited in the text as [35], the origin of Theorem 5.4).
7 thms3 active usersReviewed
🏆Completed
Numerical AnalysisOptimization·Captain: mikedeng1

The Relaxation Method for Linear Inequalities II: For a Lower-Dimensional Solution Polytope Infinite Reflexions Settle on a Sphere with Axis L_rResearch Paper

Motivation

Finding a point that satisfies a finite system of linear inequalities is the feasibility half of linear programming, and it is the problem that iterative projection methods were designed for. In 1954 S. Agmon (The relaxation method for linear inequalities, Canad. J. Math. 6, 382–392) and T. S. Motzkin and I. J. Schoenberg (The relaxation method for linear inequalities, Canad. J. Math. 6, 393–404) analysed the simplest such method: from a point that violates the system, move towards the most violated half-space. The method is a precursor of the perceptron algorithm and of projection and reflection algorithms for convex feasibility problems.

The paper distinguishes whether the solution set is full-dimensional or not. This mission covers the case in which it is not (Theorem 2 of the paper); the full-dimensional case is a separate mission of the same series.

Timeline.

  • 1922. L. Fejér observes that the points "closest" to a set, in a point-wise sense, form its convex hull (cited on p. 393).
  • 1954. Agmon proves that for a parameter 0<λ<20 < \lambda < 20<λ<2 an infinite relaxation sequence converges to a point of the solution set.
  • 1954. Motzkin and Schoenberg reprove Agmon's result and treat the extreme parameter λ=2\lambda = 2λ=2, the reflexion method: it always terminates when the solution set is full-dimensional (Theorem 1), and when it is not, an infinite reflexion sequence ends on a sphere around the affine hull of the solution set (Theorem 2, Case 2).

Setting

Let EnE_nEn​ be nnn-dimensional Euclidean space with distance ∣x−y∣|x - y|∣x−y∣. A system of mmm linear inequalities

∑j=1naijxj+bi⩾0(i=1,…,m)\sum_{j=1}^n a_{ij}x_j + b_i \geqslant 0 \qquad (i = 1, \dots, m)j=1∑n​aij​xj​+bi​⩾0(i=1,…,m)

is given by vectors ai∈Ena_i \in E_nai​∈En​ and numbers bib_ibi​. Each inequality defines a closed half-space Hi={x:⟨ai,x⟩+bi⩾0}H_i = \{x : \langle a_i, x\rangle + b_i \geqslant 0\}Hi​={x:⟨ai​,x⟩+bi​⩾0}, and the solution set is the polytope A=⋂iHiA = \bigcap_i H_iA=⋂i​Hi​, assumed nonempty. Its affine hull is an rrr-dimensional flat LrL_rLr​; this mission assumes r<nr < nr<n, that is, Lr≠EnL_r \neq E_nLr​=En​.

A relaxation step with parameter λ\lambdaλ from a point p∉Ap \notin Ap∈/A chooses a half-space HjH_jHj​ at maximal distance from ppp, the point q∈Hjq \in H_jq∈Hj​ nearest to ppp, and moves to

p1=p+λ(q−p).p_1 = p + \lambda (q - p).p1​=p+λ(q−p).

For λ=2\lambda = 2λ=2 the new point is the mirror image of ppp in the boundary hyperplane πj\pi_jπj​ of HjH_jHj​. A run is a sequence p0,p1,…p_0, p_1, \dotsp0​,p1​,… in which every point outside AAA is followed by a relaxation step. The run terminates if some pN∈Ap_N \in ApN​∈A; otherwise it is an infinite sequence.

A sequence q0,q1,…q_0, q_1, \dotsq0​,q1​,… outside AAA is Fejér-monotone with respect to AAA if qν≠qν+1q_\nu \neq q_{\nu+1}qν​=qν+1​ and ∣qν+1−a∣⩽∣qν−a∣|q_{\nu+1} - a| \leqslant |q_\nu - a|∣qν+1​−a∣⩽∣qν​−a∣ for all a∈Aa \in Aa∈A and all ν\nuν.

For a flat LLL and a point c∉Lc \notin Lc∈/L, the locus

X(L,c)={x:∣x−a∣=∣c−a∣ for all a∈L}X(L, c) = \{x : |x - a| = |c - a| \text{ for all } a \in L\}X(L,c)={x:∣x−a∣=∣c−a∣ for all a∈L}

is a sphere of dimension n−r−1n - r - 1n−r−1 centred at the orthogonal projection of ccc onto LLL and lying in the flat through that centre normal to LLL. The paper calls it a spherical surface having LLL as its axis. For r=n−1r = n - 1r=n−1 it consists of two points symmetric with respect to the hyperplane LLL.

Formalization targets

Goal: Theorem 2

Assume AAA is nonempty and Lr≠EnL_r \neq E_nLr​=En​.

Case 1 (0<λ<20 < \lambda < 20<λ<2). Every run either terminates or converges to a point of AAA:

(∃N, pN∈A) ∨ (∃ l∈A, pν→l).(\exists N,\ p_N \in A) \ \lor\ (\exists\, l \in A,\ p_\nu \to l).(∃N, pN​∈A) ∨ (∃l∈A, pν​→l).

Case 2 (λ=2\lambda = 2λ=2). Every run either terminates or ends on one sphere with axis LrL_rLr​:

(∃N, pN∈A) ∨ (∃ ν0, ∃ c∉Lr, ∀ν⩾ν0, pν∈X(Lr,c)).(\exists N,\ p_N \in A) \ \lor\ \big(\exists\, \nu_0,\ \exists\, c \notin L_r,\ \forall \nu \geqslant \nu_0,\ p_\nu \in X(L_r, c)\big).(∃N, pN​∈A) ∨ (∃ν0​, ∃c∈/Lr​, ∀ν⩾ν0​, pν​∈X(Lr​,c)).

Case 1 is Agmon's theorem; Case 2 is the paper's own contribution.

Milestones (the paper's own intermediate claims)

  1. §2, (1.10): X(L,p)X(L, p)X(L,p) is the sphere of the normal flat at the projection bbb of ppp, centred at bbb through ppp, and LLL is exactly the set of points equidistant from all points of that sphere.
  2. §1: an infinite run with 0<λ⩽20 < \lambda \leqslant 20<λ⩽2 is Fejér-monotone with respect to AAA.
  3. Lemma 1, Case 2: if r<nr < nr<n, a Fejér-monotone sequence either converges or all its limit points lie on one sphere X(Lr,c)X(L_r, c)X(Lr​,c) with c∉Lrc \notin L_rc∈/Lr​.
  4. §5: the limit of a convergent infinite run lies in AAA, on its boundary.
  5. (3.2)/(3.7): if r<nr < nr<n and an infinite run does not converge, then inf⁡ν∣pν+1−pν∣>0\inf_\nu |p_{\nu+1} - p_\nu| > 0infν​∣pν+1​−pν​∣>0.
  6. §8: an infinite reflexion run (λ=2\lambda = 2λ=2) does not converge.

An additional item, Corollary 1, states that for r<nr < nr<n and an infinite reflexion run, the hyperplanes πjν\pi_{j_\nu}πjν​​ used for ν>ν0\nu > \nu_0ν>ν0​ all contain AAA and hence LrL_rLr​.

Significance

The result. Theorem 2 completes the description of the reflexion method. Combined with Theorem 1 (termination when r=nr = nr=n), it says that the reflexion method either finds a solution or, when the solution set is flat, falls into a motion on a sphere about LrL_rLr​ that reveals the flat: by Corollary 1 the hyperplanes used from some point on contain LrL_rLr​. The paper notes that such hyperplanes can be used to reduce the problem to a lower dimension. Case 1 is the convergence theorem for under- and over-relaxation.

The formalization. The results are proved and classical, and no machine-checked proof of either theorem is known. This mission produces a Lean statement and, eventually, a proof of the convergence theory of the relaxation method for linear inequalities. Reusable pieces: Fejér monotonicity and its limit-point structure (Lemma 1), and the geometry of spheres with an affine axis. Proofs of individual milestones and of Corollary 1 are welcome contributions.

Difficulty

Fejér monotonicity alone gives boundedness and convergence of every distance ∣pν−a∣|p_\nu - a|∣pν​−a∣, a∈Aa \in Aa∈A, but not convergence of the sequence. When AAA lies in a proper flat, those distances fix a point only up to a sphere about LrL_rLr​, so the naive argument "the distances converge, hence the points converge" fails exactly in this mission's case. Lemma 1, Case 2 replaces convergence by the weaker statement that limit points lie on one sphere. For 0<λ<20 < \lambda < 20<λ<2 the obstacle is to exclude an oscillation on that sphere. For λ=2\lambda = 2λ=2 oscillation does happen, and the claim is that the run eventually lies on the sphere exactly, not just near it. That requires the finiteness of the family of half-spaces, not only compactness.

Formalization scope

  • Space and data. EuclideanSpace ℝ (Fin n); the system is a : Fin m → EuclideanSpace ℝ (Fin n), b : Fin m → ℝ, with ∑jaijxj=\sum_j a_{ij}x_j = ∑j​aij​xj​= inner ℝ (a i) x. Half-spaces are closed (⩾\geqslant⩾). Distances to half-spaces are Metric.infDist.
  • Standing hypotheses. The polytope is nonempty ((polytope a b).Nonempty), as the paper assumes from the outset. LrL_rLr​ is affineSpan ℝ (polytope a b), so "A⊂LrA \subset L_rA⊂Lr​" holds by construction, and "r<nr < nr<n" is affineSpan ℝ (polytope a b) ≠ ⊤. No separate natural number rrr is introduced.
  • The step is a relation. The paper makes FλF_\lambdaFλ​ single-valued by an unspecified pre-assigned rule for ties in (1.5). Here a step may use any maximizing index jjj, and every theorem quantifies over all runs, so each statement holds for every tie-breaking rule. The parameter λ\lambdaλ is named lam.
  • Runs. A run is any sequence p : ℕ → E with a relaxation step after every point outside AAA. Termination is ∃ N, p N ∈ A; an infinite sequence is ∀ ν, p ν ∉ A.
  • Spheres. axisSphere L c is the locus (1.10). Every statement that uses it as a sphere requires c ∉ L, which rules out the degenerate one-point locus. Without that requirement, Case 2 of Theorem 2 and Case 2 of Lemma 1 would be weaker than the paper's.
  • Limit points are cluster points of the sequence (MapClusterPt x atTop q), not points of the closure of its range. Boundary is the topological frontier.
  • Explicit choices recorded against the page.
    1. Lemma 1, Case 2 is stated for an arbitrary nonempty set AAA rather than for the polytope. This is stronger, and the proof uses only that AAA spans LrL_rLr​.
    2. The Fejér property (§1), the §5 limit claim and (3.2) are stated for 0<λ⩽20 < \lambda \leqslant 20<λ⩽2, because the paper proves them for λ<2\lambda < 2λ<2 and reuses them for λ=2\lambda = 2λ=2 in §§6–8. The §5 claim is also stated without a dimension hypothesis.
    3. The §8 non-convergence claim is stated without the section's assumption r<nr < nr<n, which its argument (§§5–6) does not use.
    4. Corollary 1 records the index used at each step (IsRelaxStepVia), which the relation hides. Its last sentence, on reducing the dimension, is commentary and is not formalized.
  • Ruled out. A formalization that fixes a tie-breaking rule, that asserts the statements only for some run, or that allows the sphere's point ccc to lie in LrL_rLr​ does not state Theorem 2.

Selected references

  • T. S. Motzkin and I. J. Schoenberg, The relaxation method for linear inequalities, Canadian Journal of Mathematics 6 (1954), 393–404. doi:10.4153/CJM-1954-038-x
  • S. Agmon, The relaxation method for linear inequalities, Canadian Journal of Mathematics 6 (1954), 382–392. doi:10.4153/CJM-1954-037-2
  • L. Fejér, Ueber die Lage der Nullstellen von Polynomen, die aus Minimumforderungen gewisser Arten entspringen, Mathematische Annalen 85 (1922), 41–48 (reference 2 of the paper).
10 thms3 active usersReviewed
🏆Completed
Numerical AnalysisOptimization·Captain: mikedeng1

The Relaxation Method for Linear Inequalities I: For a Full-Dimensional Solution Polytope the Relaxation Converges and the Reflexion Method TerminatesResearch Paper

Motivation

Finding a point that satisfies a finite system of linear inequalities is the feasibility problem underlying linear programming, and it is also the basic step of many methods in signal and image reconstruction, where the system is too large to be solved by elimination. The relaxation method attacks it one inequality at a time: from the current point, move towards the half-space that is violated the most. Each step costs one pass over the rows and no factorization, which is why this family of iterations (with its relatives: Kaczmarz's method for equations, the projection methods for convex feasibility, and the perceptron algorithm) has been studied continuously since the early 1950s.

Timeline:

  • 1922. Fejér observes that the set of points of EnE_nEn​ that no other point dominates in distance to a closed set AAA is the convex hull of AAA (Motzkin and Schoenberg 1954, p. 393). This idea of moving to a point that is closer to every point of AAA drives the method.
  • 1954. Agmon (Canad. J. Math. 6, 382–392) proves that for a relaxation parameter 0<λ<20 < \lambda < 20<λ<2 the iterates either reach the solution set or converge to a point on its boundary.
  • 1954. Motzkin and Schoenberg (Canad. J. Math. 6, 393–404) reprove Agmon's theorem from a single lemma about Fejér-monotone sequences and treat the extreme case λ=2\lambda = 2λ=2, the reflexion method. When the solution set has full dimension, reflexion always stops after finitely many steps; no parameter 0<λ<20 < \lambda < 20<λ<2 has this property.

This mission is the first of three built on the Motzkin–Schoenberg paper: it covers the full-dimensional case, Theorem 1.

Setting

Let EnE_nEn​ be nnn-dimensional Euclidean space. A system of mmm linear inequalities

∑j=1naijxj+bi≥0(i=1,…,m)\sum_{j=1}^n a_{ij}x_j + b_i \ge 0 \qquad (i = 1, \dots, m)j=1∑n​aij​xj​+bi​≥0(i=1,…,m)

is given by rows ai∈Ena_i \in E_nai​∈En​ and constants bi∈Rb_i \in \mathbb Rbi​∈R. The iii-th inequality defines the closed half-space Hi={x:⟨ai,x⟩+bi≥0}H_i = \{x : \langle a_i, x\rangle + b_i \ge 0\}Hi​={x:⟨ai​,x⟩+bi​≥0}, and the set of solutions is the polytope A=⋂i=1mHiA = \bigcap_{i=1}^m H_iA=⋂i=1m​Hi​. The system is assumed consistent, so AAA is nonempty. The dimension rrr of AAA is the dimension of its affine hull; r=nr = nr=n means that AAA is not contained in any hyperplane.

Fix a relaxation parameter λ\lambdaλ with 0<λ≤20 < \lambda \le 20<λ≤2. From a point p∉Ap \notin Ap∈/A one relaxation step is:

  1. choose jjj with dist⁡(p,Hj)=max⁡idist⁡(p,Hi)\operatorname{dist}(p, H_j) = \max_i \operatorname{dist}(p, H_i)dist(p,Hj​)=maxi​dist(p,Hi​), a farthest half-space;
  2. let q∈Hjq \in H_jq∈Hj​ be the point with ∣p−q∣=dist⁡(p,Hj)|p - q| = \operatorname{dist}(p, H_j)∣p−q∣=dist(p,Hj​);
  3. set p1=p+λ(q−p)p_1 = p + \lambda (q - p)p1​=p+λ(q−p).

For λ=2\lambda = 2λ=2, p1p_1p1​ is the mirror image of ppp in the boundary hyperplane of HjH_jHj​. Iterating from a starting point p0p_0p0​ gives a sequence p0,p1,p2,…p_0, p_1, p_2, \dotsp0​,p1​,p2​,…; the process terminates when some pN∈Ap_N \in ApN​∈A, and otherwise produces an infinite sequence of points outside AAA.

A sequence q0,q1,…q_0, q_1, \dotsq0​,q1​,… of points outside AAA is Fejér-monotone with respect to AAA if qi≠qi+1q_i \ne q_{i+1}qi​=qi+1​ and ∣qi+1−a∣≤∣qi−a∣|q_{i+1} - a| \le |q_i - a|∣qi+1​−a∣≤∣qi​−a∣ for all a∈Aa \in Aa∈A and all iii.

Formalization targets

Goal: Theorem 1 (p. 395)

Assume A≠∅A \ne \emptysetA=∅ and r=nr = nr=n. For every starting point and every choice of farthest half-space at every step:

Case 1: 0<λ<2  ⟹  (∃N, pN∈A) ∨ (pν→l for some l∈∂A),\text{Case 1: } 0 < \lambda < 2 \implies \big(\exists N,\ p_N \in A\big) \ \lor\ \big(p_\nu \to l \text{ for some } l \in \partial A\big),Case 1: 0<λ<2⟹(∃N, pN​∈A) ∨ (pν​→l for some l∈∂A), Case 2: λ=2  ⟹  ∃N, pN∈A.\text{Case 2: } \lambda = 2 \implies \exists N,\ p_N \in A .Case 2: λ=2⟹∃N, pN​∈A.

The goal is the paper's theorem as stated, both cases in one statement. It fixes no constants and no rates.

Milestones

  1. §1, pp. 393–394. For p∉Hjp \notin H_jp∈/Hj​, qqq the point of HjH_jHj​ nearest to ppp and p1=p+λ(q−p)p_1 = p + \lambda(q - p)p1​=p+λ(q−p) with 0<λ≤20 < \lambda \le 20<λ≤2: p1≠pp_1 \ne pp1​=p and ∣p1−a∣≤∣p−a∣|p_1 - a| \le |p - a|∣p1​−a∣≤∣p−a∣ for all a∈Aa \in Aa∈A, strictly when λ<2\lambda < 2λ<2; for λ=2\lambda = 2λ=2 equality holds exactly at the points of AAA on the boundary πj\pi_jπj​ of HjH_jHj​. Stated for any violated half-space, as on the page, so it covers every relaxation step.
  2. §5, p. 398. An infinite relaxation sequence is Fejér-monotone with respect to AAA.
  3. Lemma 1, Case 1, p. 397. If AAA has dimension nnn, every Fejér-monotone sequence converges to a point.
  4. §5, p. 399. The limit of a convergent infinite relaxation sequence lies on the boundary of AAA.

Significance

The result. Case 1 guarantees that the relaxation method never diverges or oscillates: it either solves the system or converges to a boundary solution. Case 2 gives more: for full-dimensional solution sets the reflexion method is a finite algorithm for linear feasibility. Remark 3(b) of the paper shows that this is special to λ=2\lambda = 2λ=2: for each 0<λ<20 < \lambda < 20<λ<2 there are planar examples where the iteration never stops. The companion missions of this series treat r<nr < nr<n (Theorem 2, where reflexion may settle on a sphere around the affine hull of AAA) and reflexion in a general bounded convex set (Theorem 3).

Formalizing it. Both cases are proved in the paper; to our knowledge none is formalized in Lean or Mathlib. The mission produces a reusable model of relaxation for linear inequalities and a Lean proof of a general convergence statement for Fejér-monotone sequences, which also applies to other projection methods. Formalizing the proof in the order of the paper (Lemma 1, then §§5–6) is the intended route; alternative proofs are welcome.

Difficulty

The first idea is that monotone distances to every point of AAA force convergence. They do not in general: Fejér-monotonicity only bounds the sequence and makes each distance ∣qν−a∣|q_\nu - a|∣qν​−a∣ converge, and when AAA lies in a hyperplane a Fejér-monotone sequence can keep oscillating between two mirror-image points. Convergence genuinely needs the full dimension of AAA, and the formal argument has to use that hypothesis in an essential way.

For Case 2, the difficulty is that a reflexion step does not shrink the distance to points of AAA on the reflecting hyperplane, so there is no uniform decrease to count. Termination must also use that the system has finitely many inequalities: for the infinite family of supporting half-spaces of a convex body, treated in the third mission of this series, reflexion need not terminate. A proof that works for a single step, or one that uses a fixed tie-breaking rule, does not cover the statement.

Formalization scope

  • The space is EuclideanSpace ℝ (Fin n); the rows are vectors a i, and ∑jaijxj\sum_j a_{ij} x_j∑j​aij​xj​ is inner ℝ (a i) x. Half-spaces are closed. Distances to sets are Metric.infDist.
  • The relaxation step is a relation IsRelaxStep a b lam p p', and any maximizing index jjj is allowed at every step. The paper makes the step single-valued by "some pre-assigned rule"; quantifying over all runs of the relation covers every such rule, so each theorem is at least as strong as the paper's.
  • A run is a sequence p : ℕ → E in which each point outside AAA is followed by a relaxation step (IsRelaxRun). Termination is ∃ N, p N ∈ A; an infinite sequence is ∀ ν, p ν ∉ A. Every theorem is stated for every run, never for one run.
  • The parameter λ\lambdaλ is named lam, because λ is a Lean keyword.
  • Nonemptiness of AAA ("assumed from the outset not to be void") is an explicit hypothesis. r=nr = nr=n is affineSpan ℝ A = ⊤, following the paper's own gloss "AAA is not contained in any hyperplane". "Boundary" is frontier A, and convergence is Tendsto p atTop (𝓝 l).
  • Lemma 1, Case 1 is stated for an arbitrary set AAA with affineSpan ℝ A = ⊤, which includes the paper's polytope.
  • The milestones of §5 (Fejér-monotonicity of the sequence, the limit on the boundary) are stated for 0<λ≤20 < \lambda \le 20<λ≤2 and without the dimension hypothesis. The paper proves them in §5 for 0<λ<20 < \lambda < 20<λ<2 and reuses the same argument in §6 for λ=2\lambda = 2λ=2.
  • Rows with ai=0a_i = 0ai​=0 are allowed (they give Hi=EnH_i = E_nHi​=En​ once A≠∅A \ne \emptysetA=∅); no nondegeneracy hypothesis is imposed.
  • Ruled out: a formalization of Case 2 that asserts termination for some starting point or some choice of indices, or one whose run hypothesis cannot be satisfied, would be vacuous. A relaxation step exists from every point outside a nonempty AAA, so the statement constrains every sequence the method can produce.

Useful infrastructure: the closed form dist⁡(p,H)=max⁡(0,−(⟨u,p⟩+c))/∣u∣\operatorname{dist}(p, H) = \max(0, -(\langle u, p\rangle + c))/|u|dist(p,H)=max(0,−(⟨u,p⟩+c))/∣u∣ for u≠0u \ne 0u=0 and the nearest point in a half-space; the characterization of affineSpan⁡=⊤\operatorname{affineSpan} = \topaffineSpan=⊤ via a nonempty interior for convex sets. The Fejér-monotone convergence lemma and the half-space projection lemmas are reusable beyond this mission.

Selected references

  • T. S. Motzkin and I. J. Schoenberg, The relaxation method for linear inequalities, Canadian Journal of Mathematics 6 (1954), 393–404. https://doi.org/10.4153/CJM-1954-038-x
  • S. Agmon, The relaxation method for linear inequalities, Canadian Journal of Mathematics 6 (1954), 382–392. https://doi.org/10.4153/CJM-1954-037-2
  • H. H. Bauschke and J. M. Borwein, On projection algorithms for solving convex feasibility problems, SIAM Review 38 (1996), 367–426. https://doi.org/10.1137/S0036144593251710
7 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming II: The Convex Hull of a Disjunctive Set via Lifting and ProjectionTextbook

Motivation

Convexity is what makes optimization tractable: a linear program's feasible region is convex, and this single fact underwrites the simplex method, LP duality, and everything built on top of them. Integer and disjunctive programs have no such luck — their feasible regions are unions of polyhedra, and a union of convex sets is generally not convex. If the convex hull of such a union could always be described compactly, integer programming would reduce to linear programming: optimize the same linear objective over the hull instead of the union, and any optimal vertex of the hull is automatically integral. The obstacle has always been that the convex hull of a union of polyhedra in Rn\mathbb{R}^nRn, described directly by its facets in Rn\mathbb{R}^nRn, typically needs exponentially many inequalities.

Balas's Theorem 2.1, proved in the 1970s and presented here as Chapter 2 of Disjunctive Programming (Balas, Springer 2018), breaks this exponential barrier by changing where the description lives. Rather than writing down the hull's facets in Rn\mathbb{R}^nRn, Theorem 2.1 lifts the problem to a higher-dimensional space — one auxiliary copy of Rn\mathbb{R}^nRn per polyhedron in the union — where the hull becomes the projection of a single, explicitly given polyhedron whose size grows only linearly with the number of polyhedra. This "extended formulation" technique, born here, became one of the central tools of modern integer programming and combinatorial optimization: representing a hard polytope as the projection of an easy one in higher dimension underlies, for instance, the polynomial-size extended formulations known for many combinatorial polytopes.

Setting

Fix a finite index set QQQ. For h∈Qh \in Qh∈Q, let AhA_hAh​ be a real matrix and bhb_hbh​ a vector of matching row dimension, and set Ph:={x∈Rn:Ahx≥bh}P_h := \{x \in \mathbb{R}^n : A_h x \ge b_h\}Ph​:={x∈Rn:Ah​x≥bh​}. The union F:=⋃h∈QPhF := \bigcup_{h \in Q} P_hF:=⋃h∈Q​Ph​ is the disjunctive set. Write Q∗:={h∈Q:Ph≠∅}Q^* := \{h \in Q : P_h \ne \emptyset\}Q∗:={h∈Q:Ph​=∅} for the feasible disjuncts.

The recession cone of a nonempty polyhedron PhP_hPh​ is Ch:={y:Ahy≥0}C_h := \{y : A_h y \ge 0\}Ch​:={y:Ah​y≥0}: the set of directions along which one can travel indefinitely from any point of PhP_hPh​ while remaining in PhP_hPh​. For a subset M⊆QM \subseteq QM⊆Q and sets ShS_hSh​ (h∈Mh \in Mh∈M), the (finite) Minkowski sum ∑h∈MSh\sum_{h \in M} S_h∑h∈M​Sh​ is {x:x=∑h∈Myh for some yh∈Sh}\{x : x = \sum_{h \in M} y^h \text{ for some } y^h \in S_h\}{x:x=∑h∈M​yh for some yh∈Sh​}. The maximal indices Q∗∗⊆Q∗Q^{**} \subseteq Q^*Q∗∗⊆Q∗ are the feasible disjuncts whose polyhedron is not contained in any other feasible disjunct's polyhedron.

Given a set S⊆Rn×βS \subseteq \mathbb{R}^n \times \betaS⊆Rn×β, its projection onto xxx is Projx(S):={x:∃ y∈β, (x,y)∈S}\mathrm{Proj}_x(S) := \{x : \exists\, y \in \beta,\ (x,y) \in S\}Projx​(S):={x:∃y∈β, (x,y)∈S}.

Formalization targets

Theorem 2.1 (goal) — the convex hull of a disjunctive set

cl conv(F)=Projx(P),P:={(x,{yh}h∈Q∗,{y0h}h∈Q∗):x= ⁣ ⁣∑h∈Q∗ ⁣ ⁣yh, Ahyh−bhy0h≥0, y0h≥0,  ⁣ ⁣∑h∈Q∗ ⁣ ⁣y0h=1}.\mathrm{cl}\,\mathrm{conv}(F) = \mathrm{Proj}_x(P), \qquad P := \Big\{(x, \{y^h\}_{h \in Q^*}, \{y^h_0\}_{h \in Q^*}) : x = \!\!\sum_{h \in Q^*}\!\! y^h,\ A_h y^h - b_h y^h_0 \ge 0,\ y^h_0 \ge 0,\ \!\!\sum_{h \in Q^*}\!\! y^h_0 = 1 \Big\}.clconv(F)=Projx​(P),P:={(x,{yh}h∈Q∗​,{y0h​}h∈Q∗​):x=h∈Q∗∑​yh, Ah​yh−bh​y0h​≥0, y0h​≥0, h∈Q∗∑​y0h​=1}.

This is the weakest correct statement: it claims only that the closed convex hull equals the projection of this specific lifted polyhedron PPP, not any stronger uniqueness or minimality claim about lifted representations in general (that refinement is Theorem 2.1's own follow-up discussion, not part of the theorem itself).

Corollary 2.2 — the extreme-point correspondence

Extreme points of cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) correspond bijectively to the extreme points of PPP that place all of their mass on a single disjunct's coordinates.

Theorem 2.3 — tightness of the lifted representation

PQ=P  ⟺  Ck⊆∑h∈Q∗Ch∀ k∈Q∖Q∗,P_Q = P \iff C_k \subseteq \sum_{h \in Q^*} C_h \quad \forall\, k \in Q \setminus Q^*,PQ​=P⟺Ck​⊆h∈Q∗∑​Ch​∀k∈Q∖Q∗,

where PQP_QPQ​ is the variant of PPP indexed by all of QQQ rather than only Q∗Q^*Q∗.

Theorem 2.4 — from the convex hull to the union itself

Under two recession-cone conditions on Q∗∗Q^{**}Q∗∗, restricting PQP_QPQ​'s y0hy^h_0y0h​ variables to {0,1}\{0,1\}{0,1} makes its xxx-projection recover FFF itself, not merely cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F).

Significance

The result itself. Theorem 2.1 is the founding extended-formulation result of integer programming: it shows that every union of finitely many polyhedra — hence every mixed-integer program's feasible region, once expressed in disjunctive normal form — has a lifted description of size linear in the number of disjuncts, in stark contrast to the union's own facet description, which is generally exponential. Corollary 2.2 shows this lifting is not merely an upper bound with extraneous points: its extreme points correspond exactly, one-to-one, with the extreme points of the object it represents. Theorems 2.3 and 2.4 sharpen the picture: 2.3 tells you exactly when you can avoid knowing in advance which disjuncts are nonempty, and 2.4 tells you exactly when the same family of lifted systems, restricted to integral y0hy^h_0y0h​, describes the union FFF exactly rather than only its convex hull — this is Jeroslow and Lowe's characterization of when a disjunctive set is representable as the feasible region of an integer program at all.

Formalizing it. No object in this mission — the disjunctive set FFF, its lifted polyhedron PPP, recession cones of a union's components, or the extreme-point correspondence between a polytope and its lift — exists on the platform prior to this mission or anywhere in Mathlib (substrate.md records zero LP/polyhedron modules in Mathlib as of this writing). This mission is a from-scratch formalization of the book's central construction, restating (rather than importing) the disjunctive-set vocabulary introduced by the companion IntroDuality mission, per the series' convention that a draft mission cannot import another draft mission's definitions.

Difficulty

The natural first attempt at Theorem 2.1 tries to prove the two inclusions cl conv(F)⊆Projx(P)\mathrm{cl}\,\mathrm{conv}(F) \subseteq \mathrm{Proj}_x(P)clconv(F)⊆Projx​(P) and Projx(P)⊆cl conv(F)\mathrm{Proj}_x(P) \subseteq \mathrm{cl}\,\mathrm{conv}(F)Projx​(P)⊆clconv(F) by a direct facet-by-facet or vertex-by-vertex argument in Rn\mathbb{R}^nRn — exactly the exponential-size approach the theorem exists to avoid. The book's own first proof instead works entirely with convex combinations: an arbitrary point of cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) is a combination of at most ∣Q∗∣|Q^*|∣Q∗∣ points, one from each polyhedron in the union (Carathéodory-style), which converts directly into a point of PPP by splitting the combination's weight across the lifted coordinates — and conversely, a point of PPP decomposes, disjunct by disjunct, into a convex combination of that disjunct's own vertices and extreme rays. Neither direction ever needs to enumerate facets of cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) in Rn\mathbb{R}^nRn. The second proof (via projection and the polar cone WWW of the lifted system) shows the projected inequalities coincide with exactly the valid-inequality characterization of Theorem 1.2 (disjunctive Farkas), which is a different, complementary way of seeing why no facet of cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) is missed.

Formalization scope

All theorems are stated over a finite index set Q : Type* with [Fintype Q], matrices Matrix (Fin (m h)) (Fin n) ℝ with m : Q → ℕ allowed to depend on h, and vectors in Fin n → ℝ. DisjunctiveSet, FeasibleIndices, MaximalIndices, RecessionCone, and MinkowskiSumOver fix the chapter's vocabulary; ProjX, LiftedPolyhedron, and IntegerRestricted fix the lifted system and its variants. cl conv F is Mathlib's closure (convexHull ℝ ·); extreme points use Mathlib's Set.extremePoints.

LiftedPolyhedron ranges its auxiliary vectors {yh}\{y^h\}{yh}, {y0h}\{y^h_0\}{y0h​} over all of QQQ rather than only the index subset Qidx the book restricts to, forcing the components outside Qidx to zero. This is an equivalent, Finset/decidability-free encoding — appending zero terms changes neither the defining sums nor the constraints — documented as a convention, not a weakening, in MODERATION_NOTES.md; the same definition instantiates both the (2.1)(2.1)(2.1) system (Qidx = Q^*) and the (2.1)Q(2.1)_Q(2.1)Q​ variant (Qidx = Q) that Theorem 2.3 compares.

A trivializing formalization is ruled out explicitly: taking ∣Q∗∣=1|Q^*| = 1∣Q∗∣=1 collapses the lifted system to x=y1x = y^1x=y1, y01=1y^1_0 = 1y01​=1, a vacuous restatement of x∈P1x \in P_1x∈P1​ that proves nothing about unions. Every theorem here is stated for a generic finite Q, never specialized to a fixed small size. Contributions beyond this mission's statements would need genuine polyhedral machinery (vertex/extreme-ray decomposition of a polyhedron, Carathéodory's theorem for cones) that is itself absent from Mathlib and would be welcome as a separate, reusable definitions layer.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 2, §2.1.
  • E. Balas, Disjunctive programming: Properties of the convex hull of feasible points, Discrete Applied Mathematics 89 (1998), 3–44 (reprint of a 1974 MSRR, cited in the text as [6], the origin of Theorem 2.1).
  • M. Conforti, M. Di Summa, Y. Faenza, On the size of extended formulations for polytopes associated with unions of polyhedra, SIAM Journal on Discrete Mathematics, cited in the text as [59] — establishes the tightness (minimum additional-variable count) of Theorem 2.1's lifted representation.
  • R. G. Jeroslow, J. K. Lowe, Modelling with integer variables, Mathematical Programming Study 22 (1984), 167–184 (cited in the text as [86]; the characterization behind Theorem 2.4's significance).
8 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming I: Intersection Cuts and Duality for Disjunctive ProgramsTextbook

Motivation

Linear programming duality is one of the load-bearing facts of optimization: every feasible linear program has a dual whose value matches the primal's, and this correspondence drives the simplex method's stopping criterion, sensitivity analysis, and most complexity results for polyhedral problems. Integer and mixed-integer programs have no such duality theorem in general — the feasible region of a mixed-integer program is not convex, and the entire apparatus of linear programming duality is built on convexity.

Disjunctive programming, introduced by Egon Balas in the early 1970s, closes part of this gap. A disjunctive set is a union of finitely many polyhedra rather than a single polyhedron — the natural convex-analytic shadow of the "either/or" logical structure that integer variables encode (an integer variable's feasible region is a finite union of half-open pieces, hence a disjunction of the linear constraints that pin it to each value). Balas's insight was that disjunctive programs — linear programs whose feasible region is such a union — admit a strong duality theorem of their own, generalizing the linear-programming case rather than replacing it. This mission formalizes that theorem (Theorem 1.5 of Balas, Disjunctive Programming, Springer 2018) together with the two results the same chapter builds around it: the founding construction of the field, the intersection cut (Theorem 1.1, circa 1970), and the disjunctive generalization of Farkas' Lemma (Theorem 1.2), which characterizes every valid inequality — hence every cutting plane — for a disjunctive set.

Setting

Fix a finite index set QQQ. For each h∈Qh \in Qh∈Q, let AhA_hAh​ be a real mh×nm_h \times nmh​×n matrix and bh∈Rmhb_h \in \mathbb{R}^{m_h}bh​∈Rmh​, and set Ph:={x∈Rn:Ahx≥bh}P_h := \{x \in \mathbb{R}^n : A_h x \ge b_h\}Ph​:={x∈Rn:Ah​x≥bh​}. The union F:=⋃h∈QPhF := \bigcup_{h \in Q} P_hF:=⋃h∈Q​Ph​ is a disjunctive set: any (linear) system of inequalities combined with the logical connectives "and", "or", "not" reduces, via its disjunctive normal form, to a set of exactly this shape. Because a union of convex sets need not be convex, FFF is generally nonconvex even though each PhP_hPh​ is a polyhedron.

A disjunctive program minimizes a linear objective over such a union:

(DP)z0=min⁡{cx:x∈⋃h∈QXh},Xh:={x:Ahx≥bh, x≥0}.(DP)\qquad z_0 = \min\Big\{ c x : x \in \textstyle\bigcup_{h \in Q} X_h \Big\}, \qquad X_h := \{x : A_h x \ge b_h,\ x \ge 0\}.(DP)z0​=min{cx:x∈⋃h∈Q​Xh​},Xh​:={x:Ah​x≥bh​, x≥0}.

Its dual (DD)(DD)(DD) pairs a scalar www with one dual multiplier vector uhu_huh​ per disjunct, requiring w≤uhbhw \le u_h b_hw≤uh​bh​ and uhAh≤cu_h A_h \le cuh​Ah​≤c, uh≥0u_h \ge 0uh​≥0, simultaneously for every h∈Qh \in Qh∈Q, and maximizes www. Write Q∗:={h∈Q:Xh≠∅}Q^* := \{h \in Q : X_h \ne \emptyset\}Q∗:={h∈Q:Xh​=∅} for the disjuncts whose primal system is feasible, and Q∗∗:={h∈Q:Uh≠∅}Q^{**} := \{h \in Q : U_h \ne \emptyset\}Q∗∗:={h∈Q:Uh​=∅} (with Uh:={uh≥0:uhAh≤c}U_h := \{u_h \ge 0 : u_h A_h \le c\}Uh​:={uh​≥0:uh​Ah​≤c}) for those whose dual system is feasible.

The theorems below also use two objects from the origin of the subject (§1.2): given a basic solution xˉ\bar xxˉ of a linear program's optimal simplex tableau, with basic index set III and nonbasic index set JJJ, the tableau's coefficients aˉij\bar a_{ij}aˉij​ (i∈Ii \in Ii∈I, j∈Jj \in Jj∈J) determine, for each nonbasic jjj, an extreme ray direction rjr^jrj of the associated LP cone. A convex set SSS is PIP_IPI​-free at xˉ\bar xxˉ if xˉ\bar xxˉ lies in the interior of SSS and that interior contains no point of the mixed-integer feasible set PIP_IPI​.

Formalization targets

Theorem 1.1 — the intersection cut

λj∗:=max⁡{λj≥0:xˉ+λjrj∈S},∑j∈J1λj∗ xj≥1.\lambda^*_j := \max\{\lambda_j \ge 0 : \bar x + \lambda_j r^j \in S\}, \qquad \sum_{j \in J} \frac{1}{\lambda^*_j}\, x_j \ge 1.λj∗​:=max{λj​≥0:xˉ+λj​rj∈S},j∈J∑​λj∗​1​xj​≥1.

The displayed inequality cuts off xˉ\bar xxˉ but excludes no point of PIP_IPI​, for any PIP_IPI​-free convex set SSS containing xˉ\bar xxˉ in its interior.

Theorem 1.2 — Farkas' Lemma for Disjunctive Sets

(∀x∈F, αx≥α0)  ⟺  (∀h∈Q∗, ∃ uh≥0, uhAh=α, α0≤uhbh).\big(\forall x \in F,\ \alpha x \ge \alpha_0\big) \iff \big(\forall h \in Q^*,\ \exists\, u_h \ge 0,\ u_h A_h = \alpha,\ \alpha_0 \le u_h b_h\big).(∀x∈F, αx≥α0​)⟺(∀h∈Q∗, ∃uh​≥0, uh​Ah​=α, α0​≤uh​bh​).

Theorem 1.5 (goal) — duality for disjunctive programs

Under the Regularity Condition — (Q∗≠∅(Q^* \ne \emptyset(Q∗=∅ and Q∖Q∗∗≠∅)⇒Q∗∖Q∗∗≠∅Q \setminus Q^{**} \ne \emptyset) \Rightarrow Q^* \setminus Q^{**} \ne \emptysetQ∖Q∗∗=∅)⇒Q∗∖Q∗∗=∅ — exactly one of:

  1. both (DP)(DP)(DP) and (DD)(DD)(DD) are feasible, each attains an optimum, and z0=w0z_0 = w_0z0​=w0​; or
  2. one of the two is infeasible, and the other is infeasible or has no finite optimum.

This is the weakest faithful statement of the theorem: it asserts only the shape of the dichotomy established by Balas, not any strengthened or specialized form of it.

Corollary 1.6 — necessity of the Regularity Condition

If the Regularity Condition fails, (DP)(DP)(DP) is feasible, and (DD)(DD)(DD) is infeasible, then (DP)(DP)(DP) still has a finite minimum — exhibiting the duality gap that opens up once the condition is dropped.

Significance

The results themselves. Theorem 1.5 is the mission-critical fact that makes disjunctive programming a genuine extension of linear programming rather than an unrelated combinatorial device: every LP-duality-based algorithmic tool (bounding, sensitivity, complementary-slackness optimality certificates) has a disjunctive-programming counterpart because of this theorem. Theorem 1.1's intersection cut is the historical seed of an entire branch of integer-programming algorithms — lift-and-project cuts, mixed-integer Gomory cuts, and the split closure (later missions of this series) all specialize or generalize it. Theorem 1.2 is the structural fact that makes cutting-plane generation for disjunctive sets tractable at all: every valid inequality decomposes into per-disjunct Farkas certificates.

Formalizing it. None of these results, nor the union-of-polyhedra machinery they are stated over, exist on the platform prior to this mission: the platform's existing Farkas' Lemma and linear-programming strong duality theorems (SmaleNinth.farkas_lemma, SmaleNinth.lp_strong_duality) are the ordinary single-polyhedron statements, which is exactly the special case ∣Q∣=1|Q|=1∣Q∣=1 of the theorems formalized here — genuinely different statements, not restatements. This mission is a from-scratch formalization of the disjunctive generalization, including the vocabulary (disjunctive sets, the paired primal/dual index sets Q∗,Q∗∗Q^*, Q^{**}Q∗,Q∗∗, the Regularity Condition) that the rest of the fifteen-mission Balas series builds on.

Difficulty

The obvious first attempt collapses the disjunctive dual (DD)(DD)(DD) to ∣Q∣|Q|∣Q∣ separate ordinary LP duals, one per disjunct, and tries to combine their individual strong-duality statements. This fails: (DD)(DD)(DD) couples all disjuncts through the single shared scalar www, which must simultaneously satisfy w≤uhbhw \le u_h b_hw≤uh​bh​ for every h∈Qh \in Qh∈Q at once, not disjunct-by-disjunct. The Regularity Condition exists precisely because this coupling can break down — Balas's own example (a two-term disjunctive program with an infeasible dual but a feasible, bounded primal) shows that without the condition, situation (2) of the dichotomy can fail: the primal can have a finite optimum with no matching dual optimum. Any formalization that omits the Regularity Condition, or weakens it to an informal restriction like "nondegenerate", either proves a false statement or proves nothing (a vacuous hypothesis), which Corollary 1.6 exists specifically to rule out.

Formalization scope

All three theorems are stated over a finite index set Q : Type* with [Fintype Q], real matrices Matrix (Fin (m h)) (Fin n) ℝ with row-dimension m : Q → ℕ allowed to depend on h (the book never assumes a common row count across disjuncts), and vectors in Fin n → ℝ. Poly, PolyNonneg, and DualPoly are the plain, nonnegative-orthant, and dual polyhedral systems respectively; FeasibleIndices and RegularityCondition pin Q∗Q^*Q∗/Q∗∗Q^{**}Q∗∗ and the Regularity Condition exactly as stated on p. 13. "No finite optimum" is formalized via UnboundedBelowOn / UnboundedAboveOn: nonempty (feasible) together with no finite bound on the objective, matching Balas's case (2), which explicitly distinguishes infeasibility from unboundedness.

A trivializing formalization is ruled out explicitly: fixing ∣Q∣=1|Q| = 1∣Q∣=1 collapses Theorem 1.5 to ordinary LP duality (already on the platform) and Theorem 1.2 to ordinary Farkas' Lemma, so both theorems are stated for a generic finite Q, never specialized. Theorem 1.5's "exactly one of" dichotomy is formalized as a logical Xor of the two situations, not a weaker Or, since the book asserts mutual exclusivity, not merely that one holds.

The intersection-cut theorem (1.1) is formalized over a generic finite index type ι standing for the full set of structural and surplus variables, with I J : Finset ι the basic/nonbasic partition; a complete development would additionally need the simplex-tableau apparatus connecting ι, I, J, and abar to an actual linear program, which lies outside this mission and belongs instead to the tableau-focused later missions of the series (SimplexTableau, RayCGLP). The extremeRay and PIFree definitions introduced here are local to this mission and are restated, not imported, by later missions that need related vocabulary — per the series' convention that a draft mission cannot import another draft mission's definitions.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 1.
  • E. Balas, Intersection cuts — a new type of cutting planes for integer programming, Operations Research 19 (1971), 19–39. (Theorem 1.1's origin, cited in the text as [4].)
  • E. Balas, Disjunctive programming, Annals of Discrete Mathematics 5 (1979), 3–51. (Cited in the text as [9], the origin of Theorem 1.5.)
9 thms3 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization·Captain: mikedeng1

Cones of Matrices and Set-Functions and 0–1 Optimization I: n Rounds of the Lovász–Schrijver N Operator Give the 0–1 HullResearch Paper

Motivation

A 0–1 integer program asks for the best 0–1 vector satisfying a system of linear inequalities. Its linear relaxation is easy to optimize over, but the relaxation is usually much larger than the convex hull of the 0–1 solutions. Lift-and-project methods close this gap systematically: they lift the relaxation to a higher-dimensional space, add constraints that every 0–1 point satisfies there, and project back, obtaining a tighter relaxation that still contains every 0–1 solution.

L. Lovász and A. Schrijver introduced one of the two standard lift-and-project hierarchies in Cones of matrices and set-functions and 0–1 optimization (SIAM J. Optim., 1991). Their operators NNN and N+N_+N+​ represent a 0–1 point xxx by the matrix xxTxx^{\mathsf T}xxT, impose linear (and for N+N_+N+​ semidefinite) constraints on such matrices, and project back to Rn+1\mathbb R^{n+1}Rn+1. The same paper applies the operators to the stable set polytope, where one round already produces the odd hole, odd wheel, clique and odd antihole constraints. The Lovász–Schrijver hierarchy, the Sherali–Adams hierarchy (1990) and Lasserre's semidefinite hierarchy (2001) are the three reference lift-and-project methods; their rank lower bounds are a standard tool for proving that a relaxation cannot solve a combinatorial problem in few rounds.

This mission formalizes the first structural fact about the operator NNN: iterating it nnn times on any relaxation in nnn variables yields exactly the 0–1 hull (Theorem 1.4 of the paper).

Setting

Vectors live in Rn+1\mathbb R^{n+1}Rn+1 with coordinates x0,x1,…,xnx_0, x_1, \dots, x_nx0​,x1​,…,xn​; the space Rn\mathbb R^nRn of the original problem is the hyperplane x0=1x_0 = 1x0​=1, and polytopes are replaced by the convex cones they generate.

  • A convex cone is a nonempty set closed under addition and nonnegative scaling. For a set SSS, cone⁡(S)\operatorname{cone}(S)cone(S) is the set of nonnegative combinations of finitely many vectors of SSS.
  • The polar cone of KKK is K∗={u:uTx≥0 for all x∈K}K^* = \{u : u^{\mathsf T}x \ge 0 \text{ for all } x \in K\}K∗={u:uTx≥0 for all x∈K}.
  • A 0–1 vector has every coordinate, x0x_0x0​ included, equal to 000 or 111. The cube cone QQQ is the cone spanned by the 0–1 vectors with x0=1x_0 = 1x0​=1; it is the cone over the unit cube.
  • For a convex cone KKK, K∘K^\circK∘ is the cone spanned by the 0–1 vectors in KKK. For K⊆QK \subseteq QK⊆Q this is the cone over the convex hull of the 0–1 points of the relaxation.

For convex cones K1,K2⊆QK_1, K_2 \subseteq QK1​,K2​⊆Q, the matrix cone M(K1,K2)M(K_1, K_2)M(K1​,K2​) consists of the (n+1)×(n+1)(n+1)\times(n+1)(n+1)×(n+1) real matrices Y=(yij)Y = (y_{ij})Y=(yij​) such that

  1. YYY is symmetric;
  2. yii=y0iy_{ii} = y_{0i}yii​=y0i​ for 1≤i≤n1 \le i \le n1≤i≤n (the diagonal equals the 0th column);
  3. uTYv≥0u^{\mathsf T} Y v \ge 0uTYv≥0 for every u∈K1∗u \in K_1^*u∈K1∗​ and v∈K2∗v \in K_2^*v∈K2∗​.

M+(K1,K2)M_+(K_1, K_2)M+​(K1​,K2​) adds the condition that YYY is positive semidefinite. The projections are N(K1,K2)={Ye0:Y∈M(K1,K2)}N(K_1, K_2) = \{Ye_0 : Y \in M(K_1, K_2)\}N(K1​,K2​)={Ye0​:Y∈M(K1​,K2​)} and N+(K1,K2)={Ye0:Y∈M+(K1,K2)}N_+(K_1, K_2) = \{Ye_0 : Y \in M_+(K_1, K_2)\}N+​(K1​,K2​)={Ye0​:Y∈M+​(K1​,K2​)}, where e0e_0e0​ is the 0th unit vector. The cut operator is N(K)=N(K,Q)N(K) = N(K, Q)N(K)=N(K,Q), and its iterates are N0(K)=KN^0(K) = KN0(K)=K, Nt(K)=N(Nt−1(K))N^t(K) = N(N^{t-1}(K))Nt(K)=N(Nt−1(K)).

Two families of hyperplanes appear in the proofs: Hi={x:xi=0}H_i = \{x : x_i = 0\}Hi​={x:xi​=0} and Gi={x:xi=x0}G_i = \{x : x_i = x_0\}Gi​={x:xi​=x0​}, the hyperplanes through the two opposite facets of QQQ in direction iii.

Formalization targets

Goal: Theorem 1.4

For every closed convex cone K⊆QK \subseteq QK⊆Q,

Nn(K)=K∘.N^n(K) = K^\circ .Nn(K)=K∘.

The statement is uniform in nnn and in KKK: no polyhedrality, no bound on the number of constraints, and no assumption that KKK contains a 0–1 point.

Milestones

  1. Condition (iii″). For a closed convex cone K⊆QK \subseteq QK⊆Q and a symmetric YYY with yii=y0iy_{ii} = y_{0i}yii​=y0i​: Y∈M(K,Q)Y \in M(K, Q)Y∈M(K,Q) if and only if every column of YYY is in KKK and the difference of the first column and any other column is in KKK.
  2. Lemma 1.1. For closed convex cones K1,K2⊆QK_1, K_2 \subseteq QK1​,K2​⊆Q,
(K1∩K2)∘⊆N+(K1,K2)⊆N(K1,K2)⊆K1∩K2.(K_1 \cap K_2)^\circ \subseteq N_+(K_1, K_2) \subseteq N(K_1, K_2) \subseteq K_1 \cap K_2 .(K1​∩K2​)∘⊆N+​(K1​,K2​)⊆N(K1​,K2​)⊆K1​∩K2​.
  1. Lemma 1.3. For a closed convex cone K⊆QK \subseteq QK⊆Q and every 1≤i≤n1 \le i \le n1≤i≤n,
N(K)⊆(K∩Hi)+(K∩Gi).N(K) \subseteq (K \cap H_i) + (K \cap G_i).N(K)⊆(K∩Hi​)+(K∩Gi​).
  1. Claim (4) in the proof of Theorem 1.4. For every set TTT of t≥1t \ge 1t≥1 coordinates, with Fˉ\bar FFˉ the union of the faces of the unit cube that fix the coordinates in TTT to 000 or 111,
Nt(K)⊆cone⁡(K∩Fˉ).N^t(K) \subseteq \operatorname{cone}(K \cap \bar F).Nt(K)⊆cone(K∩Fˉ).
  1. The remark after Lemma 1.1. N(K1∩K2,K1∩K2)⊆N(K1,K2)⊆N(K1∩K2,Q)N(K_1 \cap K_2, K_1 \cap K_2) \subseteq N(K_1, K_2) \subseteq N(K_1 \cap K_2, Q)N(K1​∩K2​,K1​∩K2​)⊆N(K1​,K2​)⊆N(K1​∩K2​,Q).

Significance

Theorem 1.4 is what makes NNN a hierarchy rather than a single cut: the relaxations K⊇N(K)⊇N2(K)⊇…K \supseteq N(K) \supseteq N^2(K) \supseteq \dotsK⊇N(K)⊇N2(K)⊇… reach the 0–1 hull after at most nnn rounds, so the NNN-rank of a valid inequality (the least ttt with the inequality valid for Nt(K)N^t(K)Nt(K)) is a well-defined number between 000 and nnn. The rest of the paper measures combinatorial constraints by this rank: odd hole constraints have rank one on the stable set polytope, and the rank of a stable set inequality is bounded by its defect. Rank lower bounds for lift-and-project hierarchies, in the literature that followed, all presuppose this finite convergence.

The theorem is proved in the paper; to the best of available knowledge none of the Lovász–Schrijver operators has been formalized in a proof assistant. A formalization provides machine-checked definitions of the matrix cones and the cut operators that later missions in this series (odd holes, the defect bound, the N+N_+N+​ constraints) state their results against, and a checked proof of the column characterization (iii″) that all of those proofs use.

Difficulty

The inclusion K∘⊆Nn(K)K^\circ \subseteq N^n(K)K∘⊆Nn(K) follows from Lemma 1.1 once each Nt(K)N^t(K)Nt(K) is known to be a convex cone. The reverse inclusion is the content. A first attempt shows that one round of NNN forces one coordinate to be integral, and then iterates; but N(K)N(K)N(K) is not contained in the union of K∩HiK \cap H_iK∩Hi​ and K∩GiK \cap G_iK∩Gi​, only in their Minkowski sum (Lemma 1.3), so a point of N(K)N(K)N(K) is not itself integral in any coordinate. The induction must carry a statement about cones spanned by intersections with unions of cube faces, and it needs each iterate Nt(K)N^t(K)Nt(K) to again be a closed convex cone inside QQQ so that Lemma 1.3 can be reapplied. Closedness of the projection N(K)N(K)N(K) is not automatic: a linear image of a closed cone need not be closed.

Formalization scope

  • Coordinates of Rn+1\mathbb R^{n+1}Rn+1 are indexed by Option ι for a finite type ι; none is x0x_0x0​ and some i is xix_ixi​, and nnn is the cardinality of ι, which may be 000.
  • cone⁡(S)\operatorname{cone}(S)cone(S) is Mathlib's PointedCone.hull ℝ S; QQQ and K∘K^\circK∘ are defined as spans of 0–1 vectors, as on the page, not by the inequality description 0≤xi≤x00 \le x_i \le x_00≤xi​≤x0​.
  • M(K1,K2)M(K_1, K_2)M(K1​,K2​) is defined by condition (iii) through the polar cones; the column form (iii″) is a milestone, not the definition.
  • The operators NNN, N+N_+N+​ and the iterates are defined on arbitrary sets; the hypotheses (convex cone, contained in QQQ, closed) are carried by the theorems.
  • Closedness. The paper tacitly takes its cones closed (they are polyhedral in all its applications), and the rewriting (iii′) on p. 169 needs it. Every statement here assumes the cones closed. Without this the goal is false: for K={x:0<x1<x0}∪{0}K = \{x : 0 < x_1 < x_0\} \cup \{0\}K={x:0<x1​<x0​}∪{0} in R2\mathbb R^2R2, K∘={0}K^\circ = \{0\}K∘={0} while N(K)=QN(K) = QN(K)=Q.
  • In the proof of Theorem 1.4 the page places the cube Q′Q'Q′ in the hyperplane "x0=0x_0 = 0x0​=0"; this is a misprint for x0=1x_0 = 1x0​=1, and claim (4) is formalized with x0=1x_0 = 1x0​=1.
  • Not formalized in this mission: Lemma 1.2 (the dual description of N(K)∗N(K)^*N(K)∗), Lemma 1.5 (the N+N_+N+​ analogue of Lemma 1.3, part of a later mission), and the algorithmic results of Section 1.c.

Contributions welcome: proofs that N(K)N(K)N(K) is a closed convex cone contained in QQQ whenever KKK is, a proof of Q∗=cone⁡{ei,e0−ei}Q^* = \operatorname{cone}\{e_i, e_0 - e_i\}Q∗=cone{ei​,e0​−ei​}, and lemmas on cones spanned by the intersection of a generating set with a supporting hyperplane; these are reusable by the other missions of the series.

Selected references

  • L. Lovász and A. Schrijver, Cones of matrices and set-functions and 0–1 optimization, SIAM Journal on Optimization 1(2) (1991) 166–190. https://doi.org/10.1137/0801013
  • H. D. Sherali and W. P. Adams, A hierarchy of relaxations between the continuous and convex hull representations for zero-one programming problems, SIAM Journal on Discrete Mathematics 3(3) (1990) 411–430. https://doi.org/10.1137/0403036
  • J. B. Lasserre, Global optimization with polynomials and the problem of moments, SIAM Journal on Optimization 11(3) (2001) 796–817. https://doi.org/10.1137/S1052623400366802
  • M. Laurent, A comparison of the Sherali–Adams, Lovász–Schrijver, and Lasserre relaxations for 0–1 programming, Mathematics of Operations Research 28(3) (2003) 470–496. https://doi.org/10.1287/moor.28.3.470.16391
8 thms3 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Validation of Subgradient Optimization II: A Unique Optimal Assignment Makes the Dual Optimal Set Full-DimensionalResearch Paper

Why the assignment dual matters

The subgradient method maximizes a concave, piecewise-linear function w(π)=min⁡k{ck+π⋅vk}w(\pi)=\min_k\{c_k+\pi\cdot v_k\}w(π)=mink​{ck​+π⋅vk​} by moving along a subgradient vkv_kvk​ of an active piece with a prescribed step. Held, Wolfe and Crowder's 1974 paper Validation of subgradient optimization tested the method on three families of Lagrangean duals from combinatorial optimization — the assignment problem, a relaxation of the travelling salesman problem in the style of Held and Karp, and multicommodity flows — and gave the first systematic account of when the method works in practice.

On randomly generated assignment problems of order n≤30n\le 30n≤30 the authors observed that the method usually did not merely converge: it stopped, after finitely many steps, at an iterate whose subgradient was exactly zero. Their explanation is a structural fact about the assignment dual, Theorem 3.1 of the paper: when the optimal assignment is unique — the typical case for random integer costs — the set of optimal dual prices has full dimension nnn, so a sequence of steps of decreasing length can land inside it. This mission formalizes that theorem and the steps of its proof.

Setting

There are nnn men and nnn jobs, and a real n×nn\times nn×n cost matrix A=(air)A=(a_{ir})A=(air​): aira_{ir}air​ is the cost for which man iii does job rrr. A one-to-one assignment is a permutation σ\sigmaσ of {1,…,n}\{1,\dots,n\}{1,…,n}, where σ(r)\sigma(r)σ(r) is the man doing job rrr; its cost is ∑raσ(r) r\sum_r a_{\sigma(r)\,r}∑r​aσ(r)r​. The assignment problem (3.1) asks for a permutation of minimal cost; the assignment is unique if exactly one permutation attains that minimum.

The linear relaxation of (3.1), over doubly stochastic matrices x=(xir)x=(x_{ir})x=(xir​), has the dual linear program (3.2), max⁡{∑iπi+∑rρr:πi+ρr≤air}\max\{\sum_i\pi_i+\sum_r\rho_r : \pi_i+\rho_r\le a_{ir}\}max{∑i​πi​+∑r​ρr​:πi​+ρr​≤air​}. For fixed prices π∈Rn\pi\in\mathbb R^nπ∈Rn on the men the best ρ\rhoρ is ρr=min⁡s[asr−πs]\rho_r=\min_s[a_{sr}-\pi_s]ρr​=mins​[asr​−πs​], which leaves the dual function (3.3)

w(π)=∑i=1nπi+∑r=1nmin⁡s [asr−πs],w(\pi)=\sum_{i=1}^n\pi_i+\sum_{r=1}^n\min_s\,[a_{sr}-\pi_s],w(π)=i=1∑n​πi​+r=1∑n​smin​[asr​−πs​],

the inner minimum being over the men sss for each job rrr. The optimal set is Ω={π:w(π′)≤w(π) for all π′}\Omega=\{\pi : w(\pi')\le w(\pi)\ \text{for all }\pi'\}Ω={π:w(π′)≤w(π) for all π′}.

To put www in the form min⁡k{ck+π⋅vk}\min_k\{c_k+\pi\cdot v_k\}mink​{ck​+π⋅vk​} the paper uses assignments in a weaker sense: arbitrary functions A:{1,…,n}→{1,…,n}A:\{1,\dots,n\}\to\{1,\dots,n\}A:{1,…,n}→{1,…,n}, nnn^nnn of them, with cost cA=∑raA(r) rc_A=\sum_r a_{A(r)\,r}cA​=∑r​aA(r)r​ and vector (vA)i=1−#{r:A(r)=i}(v_A)_i=1-\#\{r:A(r)=i\}(vA​)i​=1−#{r:A(r)=i} (3.4). The subgradient step raises the price of a man assigned no job and lowers the price of a man assigned several; vA=0v_A=0vA​=0 exactly when AAA is a permutation.

In the Lean development these are assignCost, assignVec, IsOptimalAssignment, w and optSet in the namespace HeldWolfeCrowder.Assignment.

Formalization targets

Goal: Theorem 3.1 (p. 70)

If the assignment problem has a unique optimal permutation, then

dim⁡aff⁡ Ω=n.\dim\operatorname{aff}\,\Omega=n .dimaffΩ=n.

The hypothesis is uniqueness among permutations; the conclusion is the dimension of the affine hull of the optimal set.

Milestones, in the order the proof uses them

  1. Eq. (3.4): w(π)=min⁡A{cA+∑iπi(vA)i}w(\pi)=\min_A\{c_A+\sum_i\pi_i(v_A)_i\}w(π)=minA​{cA​+∑i​πi​(vA​)i​} over all nnn^nnn assignments AAA.
  2. §3, Eqs. (3.1)–(3.3): www attains its maximum, and max⁡w\max wmaxw equals the cost of an optimal permutation.
  3. Eq. (3.5): if σ\sigmaσ is the unique optimal permutation, some maximizer πˉ\bar\piπˉ of www has, for every job rrr, the minimum min⁡s[asr−πˉs]\min_s[a_{sr}-\bar\pi_s]mins​[asr​−πˉs​] attained only at s=σ(r)s=\sigma(r)s=σ(r).
  4. Eq. (3.6): for an optimal permutation σ\sigmaσ, the set Π={π:air−πi>aσ(r) r−πσ(r) for all r, i≠σ(r)}\Pi=\{\pi : a_{ir}-\pi_i>a_{\sigma(r)\,r}-\pi_{\sigma(r)}\ \text{for all } r,\ i\ne\sigma(r)\}Π={π:air​−πi​>aσ(r)r​−πσ(r)​ for all r, i=σ(r)} is convex and open, v=0v=0v=0 on it, and Π⊆Ω\Pi\subseteq\OmegaΠ⊆Ω.

Significance

The theorem turns an empirical observation into a statement about the problem: finite termination of the subgradient method on assignment problems is a property of the dual, not luck. Since www is unchanged by adding the same constant to every price, Ω\OmegaΩ always contains a line; Theorem 3.1 says that, under uniqueness, it is as large as it can be. The paper (p. 70) cites the argument of its Section 2 that, with a full-dimensional optimal set, termination of the method is "nearly certain".

The result is proved in the paper; none of it is known to be machine-checked. What the formalization adds is a checked link between three classical ingredients: the integrality of the assignment polytope (Birkhoff–von Neumann, which Mathlib has as doublyStochastic_eq_convexHull_permMatrix), linear-programming duality, and strict complementary slackness, which neither Mathlib nor the platform has in the form needed. The piecewise-linear representation (3.4) is reusable wherever the assignment dual appears as a Lagrangean subproblem.

Difficulty

The inclusion Π⊆Ω\Pi\subseteq\OmegaΠ⊆Ω is elementary; the substance is that Π\PiΠ is nonempty. The obvious candidate — any optimal dual solution — fails: an optimal π\piπ may leave ties asr−πs=aσ(r) r−πσ(r)a_{sr}-\pi_s=a_{\sigma(r)\,r}-\pi_{\sigma(r)}asr​−πs​=aσ(r)r​−πσ(r)​ for some s≠σ(r)s\ne\sigma(r)s=σ(r), so it sits on the boundary of Ω\OmegaΩ and shows nothing about dimension. What is needed is an optimal price vector with all these inequalities strict at once, and uniqueness of the optimal permutation is a statement about the primal side only; transferring it to the dual side goes through the linear relaxation (3.1), whose uniqueness is not the hypothesis, and through a strict complementarity property that is not available in Mathlib or on the platform.

Formalization scope

Men and jobs are both Fin n; the costs are a : Matrix (Fin n) (Fin n) ℝ with a i r the cost of man i on job r; prices are π : Fin n → ℝ (no inner product or norm is needed, so no EuclideanSpace). The inner minimum of (3.3) is Finset.univ.inf' over the men, well defined for every n. One-to-one assignments are Equiv.Perm (Fin n) with σ r the man doing job r, so the orientation of the matrix matches (3.3); arbitrary assignments are functions Fin n → Fin n. "Of dimension nnn" is Module.finrank ℝ (vectorSpan ℝ (optSet a)) = n. The page prints the index condition of (3.6) as "i≠ri\ne ri=r"; the formalization uses i≠σ(r)i\ne\sigma(r)i=σ(r), which is what the argument requires. The case n=0n=0n=0 is allowed and trivial.

A statement asserting only that Ω\OmegaΩ is nonempty, or that it has dimension at least one, is not this theorem: both hold for every cost matrix, the second because Ω\OmegaΩ is invariant under adding a constant to all prices. The goal requires the full value nnn, and its hypothesis is uniqueness of the optimal permutation, not of the optimal linear-programming solution.

A complete development needs: the assignment linear program and its integrality (Mathlib's Birkhoff–von Neumann theorem), weak and strong duality between (3.1) and (3.2) or directly max⁡w=min⁡σcσ\max w=\min_\sigma c_\sigmamaxw=minσ​cσ​, and a strict complementarity statement for this primal–dual pair; the last two are reusable beyond this mission. Contributions of any of these, and of alternative arguments for (3.5) that avoid strict complementary slackness, are welcome.

Selected references

  • M. Held, P. Wolfe, H. P. Crowder, Validation of subgradient optimization, Mathematical Programming 6 (1974) 62–88. https://doi.org/10.1007/BF01580223
  • M. Held, R. M. Karp, The traveling-salesman problem and minimum spanning trees: Part II, Mathematical Programming 1 (1971) 6–25. https://doi.org/10.1007/BF01584070
  • H. W. Kuhn, The Hungarian method for the assignment problem, Naval Research Logistics Quarterly 2 (1955) 83–97. https://doi.org/10.1002/nav.3800020109
  • A. J. Goldman, A. W. Tucker, Theory of linear programming, in H. W. Kuhn, A. W. Tucker (eds.), Linear Inequalities and Related Systems, Annals of Mathematics Studies 38, Princeton University Press, 1956, 53–97.
  • Mathlib, Mathlib/Analysis/Convex/Birkhoff.lean (Birkhoff–von Neumann theorem, doublyStochastic_eq_convexHull_permMatrix). https://github.com/leanprover-community/mathlib4/blob/master/Mathlib/Analysis/Convex/Birkhoff.lean
6 thms3 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Proximity Results and Faster Algorithms for Integer Programming Using the Steinitz Lemma: ℓ1-Proximity of Integer and LP OptimaResearch Paper

Motivation

Integer programs are routinely solved by first solving their linear programming (LP) relaxation and then searching for an integer optimum near the fractional one. How near an integer optimum must be is the subject of proximity theorems. They bound the search region of branch-and-bound and of dynamic programming, and they turn a fractional optimum into a starting point for exact algorithms.

The classical bound is due to Cook, Gerards, Schrijver and Tardos (Math. Programming 34, 1986): for an integer program in inequality form max⁡{cTx:Ax≤b, x∈Zn}\max\{c^Tx : Ax\le b,\ x\in\mathbb Z^n\}max{cTx:Ax≤b, x∈Zn} that is feasible and bounded, every optimal LP solution x∗x^*x∗ has an optimal integer solution z∗z^*z∗ with ∥x∗−z∗∥∞≤n⋅δ\|x^*-z^*\|_\infty\le n\cdot\delta∥x∗−z∗∥∞​≤n⋅δ, where δ\deltaδ is the largest absolute value of a subdeterminant of AAA. For programs in standard form Ax=bAx=bAx=b with mmm rows this gives, via the Hadamard bound, ∥z∗−x∗∥1≤n2⋅mm/2Δm\|z^*-x^*\|_1\le n^2\cdot m^{m/2}\Delta^m∥z∗−x∗∥1​≤n2⋅mm/2Δm, which grows with the number of variables nnn.

Eisenbrand and Weismantel (ACM Trans. Algorithms 16(1), Article 5, 2019; conference version SODA 2018) removed the dependence on nnn altogether, using the Steinitz lemma on rearranging vectors so that all partial sums stay short. Their bound depends only on mmm and on the largest absolute value Δ\DeltaΔ of an entry of AAA, and it is the basis of their faster algorithms for integer programs with few constraints.

Setting

Fix natural numbers mmm (rows) and nnn (variables). The data are a matrix A∈Zm×nA\in\mathbb Z^{m\times n}A∈Zm×n, a right-hand side b∈Zmb\in\mathbb Z^mb∈Zm, an objective c∈Znc\in\mathbb Z^nc∈Zn and upper bounds u∈Nnu\in\mathbb N^nu∈Nn. A natural number Δ\DeltaΔ bounds the entries: ∣aij∣≤Δ|a_{ij}|\le\Delta∣aij​∣≤Δ for all i,ji,ji,j. The integer program (10) is

max⁡{cTx:Ax=b, 0≤x≤u, x∈Zn},\max\{c^Tx : Ax=b,\ 0\le x\le u,\ x\in\mathbb Z^n\},max{cTx:Ax=b, 0≤x≤u, x∈Zn},

and its LP relaxation is the same problem over x∈Rnx\in\mathbb R^nx∈Rn. Its feasible region P={x∈Rn:Ax=b, 0≤x≤u}P=\{x\in\mathbb R^n: Ax=b,\ 0\le x\le u\}P={x∈Rn:Ax=b, 0≤x≤u} is a polytope, lpPolytope A b u. An optimal vertex solution is an optimal solution of the LP relaxation (IsLPOptimal) that is an extreme point of PPP. An optimal integer solution is IsIPOptimal. Both are maxima.

Distances are measured in the ℓ1\ell_1ℓ1​-norm ∥z−x∥1=∑i∣zi−xi∣\|z-x\|_1=\sum_i|z_i-x_i|∥z−x∥1​=∑i​∣zi​−xi​∣.

A vector y∈Zny\in\mathbb Z^ny∈Zn is a cycle of z∗−x∗z^*-x^*z∗−x∗ (Eq. (14)) if Ay=0Ay=0Ay=0 and, for every iii, ∣yi∣≤∣(z∗−x∗)i∣|y_i|\le|(z^*-x^*)_i|∣yi​∣≤∣(z∗−x∗)i​∣ and yi(z∗−x∗)i≥0y_i(z^*-x^*)_i\ge0yi​(z∗−x∗)i​≥0: an integer kernel vector that is sign-compatible with z∗−x∗z^*-x^*z∗−x∗ and dominated by it (IsCycle).

The Steinitz lemma (Theorem 1.1) concerns vectors x1,…,xnx_1,\dots,x_nx1​,…,xn​ in an mmm-dimensional normed space with ∑ixi=0\sum_i x_i=0∑i​xi​=0 and ∥xi∥≤1\|x_i\|\le1∥xi​∥≤1. It asserts a permutation π\piπ with ∥∑j≤kxπ(j)∥≤c(m)\|\sum_{j\le k}x_{\pi(j)}\|\le c(m)∥∑j≤k​xπ(j)​∥≤c(m) for all kkk, and the paper uses Sevast'anov's constant c(m)=mc(m)=mc(m)=m.

Formalization targets

Goal: Theorem 3.3 (p. 5:8)

If (10) has an integer feasible point and x∗x^*x∗ is an optimal vertex solution of its LP relaxation, then there is an optimal solution z∗z^*z∗ of (10) with

∥z∗−x∗∥1 ≤ m⋅(2mΔ+1)m.\|z^*-x^*\|_1\ \le\ m\cdot(2m\Delta+1)^m .∥z∗−x∗∥1​ ≤ m⋅(2mΔ+1)m.

The constant is the paper's. The goal holds for all mmm, nnn, bbb, ccc and uuu; only mmm and Δ\DeltaΔ enter the bound.

Milestones, in the order the proof uses them

  1. Lemma 3.1 (p. 5:8): for an LP optimum x∗x^*x∗, an integer optimum z∗z^*z∗ and a cycle yyy of z∗−x∗z^*-x^*z∗−x∗, the vector z∗−yz^*-yz∗−y is integer feasible, x∗+yx^*+yx∗+y is LP feasible, and cTy≤0c^Ty\le0cTy≤0.
  2. Lemma 3.2 (p. 5:8): if z∗z^*z∗ minimizes ∥z∗−x∗∥1\|z^*-x^*\|_1∥z∗−x∗∥1​ among the optimal integer solutions, then z∗−x∗z^*-x^*z∗−x∗ has no nonzero cycle.
  3. Theorem 1.1 with c(m)=mc(m)=mc(m)=m (p. 5:4): the Steinitz lemma in any mmm-dimensional real normed space.
  4. Proof of Theorem 3.3 (pp. 5:8–5:9): round a vertex x∗x^*x∗ towards an integer vector and write {x∗}\{x^*\}{x∗} for the remainder. Then ∥−A{x∗}∥∞≤Δm\|-A\{x^*\}\|_\infty\le\Delta m∥−A{x∗}∥∞​≤Δm and −A{x∗}=w1+⋯+wm-A\{x^*\}=w_1+\dots+w_m−A{x∗}=w1​+⋯+wm​ with integer wjw_jwj​, ∥wj∥∞≤Δ\|w_j\|_\infty\le\Delta∥wj​∥∞​≤Δ.
  5. Proof of Theorem 3.3, Eq. (20) (p. 5:9): a sequence of integer vectors of ℓ∞\ell_\inftyℓ∞​-norm at most mΔm\DeltamΔ in which no value repeats m+1m+1m+1 times has length at most m(2mΔ+1)mm(2m\Delta+1)^mm(2mΔ+1)m.
  6. Eq. (21) (p. 5:9), a consequence: cT(x∗−z∗)≤∥c∥∞⋅m(2mΔ+1)mc^T(x^*-z^*)\le\|c\|_\infty\cdot m(2m\Delta+1)^mcT(x∗−z∗)≤∥c∥∞​⋅m(2mΔ+1)m for every optimal integer solution z∗z^*z∗.

Significance

The bound is independent of the number of variables. Combined with the paper's dynamic program, it gives the paper's running-time results for integer programs with upper bounds: an optimal LP vertex is computed, and the integer optimum is searched for within an ℓ1\ell_1ℓ1​-ball of radius m(2mΔ+1)mm(2m\Delta+1)^mm(2mΔ+1)m around it. Eq. (21) bounds the absolute integrality gap by the same quantity, scaled by ∥c∥∞\|c\|_\infty∥c∥∞​. The Steinitz lemma with constant mmm is a general tool in discrepancy theory and in scheduling algorithms.

All of these results have published proofs. No machine-checked proof of Theorem 3.3 or of the Steinitz lemma is known to this mission, and Mathlib has no Steinitz lemma. The mission asks for complete Lean proofs of the milestones and of the goal. A proof of the Steinitz lemma with constant mmm for arbitrary norms is reusable well beyond integer programming.

Difficulty

Lemmas 3.1 and 3.2 and the counting step are elementary. The substance lies in two places. The first is the Steinitz lemma with the linear constant mmm for an arbitrary norm: the bound must hold uniformly in the number nnn of vectors, and the constant must be exactly mmm, because the goal's constant (2mΔ+1)m(2m\Delta+1)^m(2mΔ+1)m counts integer points of ℓ∞\ell_\inftyℓ∞​-norm at most mΔm\DeltamΔ. The second is the passage from a vertex to at most mmm fractional coordinates. The paper argues this in one sentence ("x∗x^*x∗ has at most mmm positive entries"), which is not literally true for (10) with upper bounds: coordinates at their upper bound ui>0u_i>0ui​>0 are positive. The correct fact concerns coordinates strictly between 000 and uiu_iui​, and it has to be derived from the extreme-point property of PPP.

Formalization scope

  • All declarations live in the namespace IPProximity.Eisenbrand. The data are integral: A : Matrix (Fin m) (Fin n) ℤ, b : Fin m → ℤ, c : Fin n → ℤ, u : Fin n → ℕ (entries ui=0u_i=0ui​=0 allowed), Δ : ℕ. They are cast to ℝ once, inside the LP definitions. m=0m=0m=0 and n=0n=0n=0 are allowed.
  • "Vertex" is Mathlib's Set.extremePoints ℝ (lpPolytope A b u). It is not defined through bases or by counting fractional coordinates.
  • The ℓ1\ell_1ℓ1​-distance is the explicit sum ∑ i, |(z i : ℝ) - x i|. Mathlib's norm on Fin n → ℝ is the sup norm, and it is used only where the paper has ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ (the ∥c∥∞\|c\|_\infty∥c∥∞​ of Eq. (21)).
  • The goal adds one hypothesis the paper leaves implicit: (10) has an integer feasible point. The paper's proof begins with "Let z∗z^*z∗ be an optimal integer solution"; without this hypothesis the conclusion is false.
  • Eq. (14) is formalized literally, so y=0y=0y=0 is a cycle, and Lemma 3.2 is stated for nonzero cycles, which is what its proof establishes. Dropping the vertex hypothesis would make the goal false, so the goal keeps it. The constant is exactly m(2mΔ+1)mm(2m\Delta+1)^mm(2mΔ+1)m, with no hidden existential constant.
  • The Steinitz milestone is stated for any finite-dimensional real normed space of dimension mmm with the explicit constant mmm. The goal needs only the ℓ∞\ell_\inftyℓ∞​ case on Rm\mathbb R^mRm.
  • Out of scope: the dynamic program and the running-time theorems of Sections 2 and 4, and the refinement ∥z∗−x∗∥1≤2Δ\|z^*-x^*\|_1\le2\Delta∥z∗−x∗∥1​≤2Δ for m=1m=1m=1.

Contributions welcome: proofs of any milestone, in particular the Steinitz lemma, and a proof of the goal from the milestones.

Selected references

  • F. Eisenbrand, R. Weismantel, Proximity Results and Faster Algorithms for Integer Programming Using the Steinitz Lemma, ACM Transactions on Algorithms 16(1), Article 5, 2019. https://doi.org/10.1145/3340322
  • W. Cook, A. M. H. Gerards, A. Schrijver, É. Tardos, Sensitivity theorems in integer linear programming, Mathematical Programming 34, 251–264, 1986. https://doi.org/10.1007/BF01582230
  • E. Steinitz, Bedingt konvergente Reihen und konvexe Systeme, Journal für die reine und angewandte Mathematik 143, 128–176, 1913. https://doi.org/10.1515/crll.1913.143.128
  • S. Sevast'janov, Approximate solution of some problems of scheduling theory (in Russian), Metody Diskretnogo Analiza 32, 66–75, 1978 (reference [31] of the paper).
  • V. S. Grinberg, S. V. Sevast'yanov, Value of the Steinitz constant, Functional Analysis and Its Applications 14(2), 125–126, 1980 (reference [16] of the paper).
12 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

Optimum Branchings: The Vertices of the Branching Polyhedron Are Exactly the BranchingsResearch Paper

Motivation

A branching in a directed graph is a set of edges that contains no cycle (even ignoring directions) and in which no two edges point to the same node; a connected branching is an arborescence, a tree rooted at one node with all edges directed away from the root. The optimum branching problem asks, for real weights on the edges, for a branching of maximum total weight. It contains the minimum-cost spanning arborescence problem (the directed analogue of the minimum spanning tree), which appears in network design, in the analysis of broadcast and routing structures, in phylogenetics, and in dependency parsing in computational linguistics, where maximum spanning arborescences are the standard decoding step of graph-based parsers.

J. Edmonds solved the problem in Optimum branchings (J. Res. Nat. Bur. Standards 71B (1967) 233–240). The paper gives an algorithm (the shrinking algorithm usually attributed to Chu–Liu and Edmonds) and, proved together with it, a polyhedral theorem: the linear system that every branching obviously satisfies has no other vertices. This was one of the first integral polyhedron theorems beyond bipartite matching and network flows, and together with Edmonds' matching polytope (1965) it set the pattern of polyhedral combinatorics: describe the convex hull of the combinatorial objects by linear inequalities, and prove optimality by a linear programming dual.

Timeline:

  • 1965: Y. J. Chu and T. H. Liu describe the shrinking algorithm for the maximum arborescence.
  • 1965: Edmonds, Paths, trees, and flowers and Maximum matching and a polyhedron with 0,1-vertices: the matching polytope.
  • 1967: Edmonds, Optimum branchings: the algorithm, Theorem 2 (vertices of the branching polyhedron), and the dual certificate built along the algorithm.
  • 1970–1971: Edmonds' matroid intersection theorem, which contains the branching polyhedron theorem as the intersection of a graphic matroid and a partition matroid.
  • 1977–1986: faster implementations (Tarjan; Gabow, Galil, Spencer and Tarjan).

Setting

A graph GGG consists of a finite set VVV of nodes and a finite set EEE of edges. Each edge eee is directed toward a node front(e)\mathrm{front}(e)front(e), its front end, and away from a different node rear(e)\mathrm{rear}(e)rear(e), its rear end. Parallel edges are allowed; loops are not.

For F⊆EF\subseteq EF⊆E, a node vvv meets kkk edges of FFF if #{e∈F:front(e)=v}+#{e∈F:rear(e)=v}=k\#\{e\in F:\mathrm{front}(e)=v\}+\#\{e\in F:\mathrm{rear}(e)=v\}=k#{e∈F:front(e)=v}+#{e∈F:rear(e)=v}=k. A set B⊆EB\subseteq EB⊆E is a forest if it contains no polygon, i.e. no nonempty F⊆BF\subseteq BF⊆B in which every node meets zero or two edges of FFF; it is a branching if in addition distinct edges of BBB have distinct front ends. The incidence vector xB∈REx^B\in\mathbb R^ExB∈RE of BBB has xeB=1x^B_e=1xeB​=1 for e∈Be\in Be∈B and 000 otherwise.

The branching polyhedron PG⊆REP_G\subseteq\mathbb R^EPG​⊆RE is the set of xxx with

  • (L1)(L_1)(L1​) xe≥0x_e\ge0xe​≥0 for every edge eee;
  • (L2)(L_2)(L2​) ∑e: front(e)=vxe≤1\sum_{e:\,\mathrm{front}(e)=v}x_e\le1∑e:front(e)=v​xe​≤1 for every node vvv;
  • (L3)(L_3)(L3​) ∑e: front(e),rear(e)∈Sxe≤∣S∣−1\sum_{e:\,\mathrm{front}(e),\mathrm{rear}(e)\in S}x_e\le|S|-1∑e:front(e),rear(e)∈S​xe​≤∣S∣−1 for every set SSS of two or more nodes.

A vertex of a set P⊆REP\subseteq\mathbb R^EP⊆RE is a point of PPP that is the unique maximizer over PPP of some linear function x↦∑ecexex\mapsto\sum_e c_ex_ex↦∑e​ce​xe​.

For weights c∈REc\in\mathbb R^Ec∈RE, the dual variables are yhy_hyh​ for each node vhv_hvh​ and ySy_SyS​ for each SSS with ∣S∣≥2|S|\ge2∣S∣≥2; write we=∑S∋front(e),rear(e)ySw_e=\sum_{S\ni\mathrm{front}(e),\mathrm{rear}(e)}y_Swe​=∑S∋front(e),rear(e)​yS​ and (b,y)=∑hyh+∑S(∣S∣−1)yS(b,y)=\sum_hy_h+\sum_S(|S|-1)y_S(b,y)=∑h​yh​+∑S​(∣S∣−1)yS​. Edmonds' conditions are (15) yh≥0y_h\ge0yh​≥0, (16) yS≥0y_S\ge0yS​≥0, (17) yfront(e)+we≥cey_{\mathrm{front}(e)}+w_e\ge c_eyfront(e)​+we​≥ce​ for every edge, and, for a branching BBB, (18) yh≠0⇒y_h\ne0\Rightarrowyh​=0⇒ some edge of BBB enters vhv_hvh​, (19) yS≠0⇒y_S\ne0\RightarrowyS​=0⇒ exactly ∣S∣−1|S|-1∣S∣−1 edges of BBB lie inside SSS, (20) yfront(e)+we=cey_{\mathrm{front}(e)}+w_e=c_eyfront(e)​+we​=ce​ for e∈Be\in Be∈B.

Formalization targets

Goal: Theorem 2 (p. 235)

{x: x is a vertex of PG}  =  {xB: B is a branching of G}.\{x:\ x\text{ is a vertex of }P_G\}\;=\;\{x^B:\ B\text{ is a branching of }G\}.{x: x is a vertex of PG​}={xB: B is a branching of G}.

Both inclusions, for every finite loopless directed multigraph.

Milestones

  1. §5, p. 236: for every branching BBB, xB∈PGx^B\in P_GxB∈PG​.
  2. §5, p. 236: for every branching BBB, xBx^BxB is a vertex of PGP_GPG​.
  3. §6, (12)–(14): if BBB is a branching and yyy satisfies (15)–(20), then (c,xB)=(b,y)(c,x^B)=(b,y)(c,xB)=(b,y), xBx^BxB maximizes (c,x)(c,x)(c,x) over PGP_GPG​, and yyy minimizes (b,y)(b,y)(b,y) subject to (15)–(17).
  4. §7, p. 237: for every c∈REc\in\mathbb R^Ec∈RE there are a branching BBB and a yyy satisfying (15)–(20).
  5. Lemma 1, p. 236: for every c∈REc\in\mathbb R^Ec∈RE some branching vector lies in PGP_GPG​ and maximizes ∑ecexe\sum_ec_ex_e∑e​ce​xe​ over PGP_GPG​.

Significance

Theorem 2 says that the linear program max⁡{(c,x):x∈PG}\max\{(c,x):x\in P_G\}max{(c,x):x∈PG​} always has an optimal solution that is a branching, and that every vertex of PGP_GPG​ is one. Consequently optimum branchings, and after the reductions of the paper's §2 optimum spanning and rooted arborescences, can be computed by linear programming, and their optimality is certified by a dual vector satisfying (15)–(20). The same statement underlies the separation-based treatment of arborescence constraints in integer programming formulations of network design and of the asymmetric travelling salesman problem. The integrality of the dual for integer weights (the paper's §8) yields min–max theorems of König type for branchings.

The result is proved and classical; no machine-checked proof of it in a proof assistant is known. The mission asks for the paper's own proof chain: branching vectors are points and vertices of PGP_GPG​, linear programming optimality from complementary slackness, existence of a dual certificate for every weight vector, and the deduction of Theorem 2. Proofs through matroid intersection or total dual integrality would also establish the goal and are welcome as alternative routes.

Difficulty

The inclusion "branching vectors are vertices" and the certificate criterion are short. The substance is Milestone 4: for arbitrary real weights, a branching and a dual vector satisfying the complementary slackness conditions must exist simultaneously. Finiteness gives an optimum branching at once, but that says nothing about optimality over the fractional points of PGP_GPG​; the difficulty is the dual. The natural attempt, taking yS=0y_S=0yS​=0 for all sets and yhy_hyh​ the largest positive weight entering vhv_hvh​, violates (20) as soon as the greedy choice closes a circuit: the (L3)(L_3)(L3​) duals of nested node sets, arising from repeatedly shrinking circuits, are needed, and they must be kept nonnegative through weight changes of the form c3+c0−c4c_3+c_0-c_4c3​+c0​−c4​ on edges entering a shrunk circuit.

Formalization scope

A graph is a structure Graph V E with front rear : E → V and a proof that front e ≠ rear e; V and E carry Fintype and DecidableEq. Edge sets are Finset E; vectors are E → ℝ; the linear function with weights c is ∑ e, c e * x e. A branching is defined combinatorially (no nonempty edge subset in which every node meets zero or two edges, and distinct front ends), never by counting edges inside node sets, and PGP_GPG​ is the solution set of (L1)(L_1)(L1​)–(L3)(L_3)(L3​), never a convex hull; either shortcut would make half of Theorem 2 true by definition. A vertex is a unique maximizer of a linear function, as on p. 236 (Mathlib's Set.exposedPoints has the same content); the set variables of the dual are a function Finset V → ℝ whose values on sets of fewer than two nodes are ignored. The right side of (L3)(L_3)(L3​) is the real number ∣S∣−1|S|-1∣S∣−1.

Implicit conventions made explicit: the no-loop condition is part of the graph (with a loop eee, the vector of {e}\{e\}{e} is a vertex of PGP_GPG​ but not a branching); parallel edges are allowed; weights have arbitrary sign and the empty branching is allowed. The mission does not model the algorithm of §4 or Theorem 1's notion of a "good" algorithm; Milestone 4 states only the existence of a certificate, which is what Lemma 1 uses.

Useful reusable infrastructure: finite directed multigraphs with an edge type, forests via polygons, and a finite LP duality lemma for max⁡{c⊤x:x≥0, Ax≤b}\max\{c^\top x: x\ge0,\ Ax\le b\}max{c⊤x:x≥0, Ax≤b}; contributions of either are welcome.

Selected references

  • J. Edmonds, Optimum branchings, J. Res. Nat. Bur. Standards Sect. B 71B (1967), 233–240. https://doi.org/10.6028/jres.071b.032
  • Y. J. Chu and T. H. Liu, On the shortest arborescence of a directed graph, Scientia Sinica 14 (1965), 1396–1400.
  • J. Edmonds, Maximum matching and a polyhedron with 0,1-vertices, J. Res. Nat. Bur. Standards 69B (1965), 125–130. https://doi.org/10.6028/jres.069B.013
  • R. E. Tarjan, Finding optimum branchings, Networks 7 (1977), 25–35. https://doi.org/10.1002/net.3230070103
  • H. N. Gabow, Z. Galil, T. Spencer and R. E. Tarjan, Efficient algorithms for finding minimum spanning trees in undirected and directed graphs, Combinatorica 6 (1986), 109–122. https://doi.org/10.1007/BF02579168
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer (2003), Chapter 52.
9 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimal Transport·Captain: mikedeng1

Scenario Reduction in Stochastic Programming: The Optimal Redistribution Rule and the Explicit Kantorovich Distance of a Reduced MeasureResearch Paper

Motivation

Stochastic programs are solved in practice on a finite set of scenarios: a discrete probability distribution P=∑i=1NpiδωiP=\sum_{i=1}^N p_i\delta_{\omega_i}P=∑i=1N​pi​δωi​​ that approximates the true distribution of the uncertain data. The size of the resulting deterministic problem grows with NNN, and for multistage models it grows very fast, so NNN is often reduced before solving. The question is which scenarios to delete and how to reweight the remaining ones so that the optimal value and solutions of the stochastic program change as little as possible.

Dupačová, Gröwe-Kuska and Römisch (Math. Program. Ser. A 95 (2003) 493–511) answered this with probability metrics. Stability results for stochastic programs bound the change of the optimal value by a Fortet–Mourier type distance, which is in turn bounded by a Kantorovich functional μ^c\hat\mu_cμ^​c​ (an optimal transport cost). Scenario reduction then becomes: find a measure QQQ supported on a subset of the scenarios with μ^c(P,Q)\hat\mu_c(P,Q)μ^​c​(P,Q) small. Section 3 of the paper solves the weight part of this problem in closed form. That result, together with the heuristics built on it (backward reduction and forward selection), became the standard scenario-reduction method, implemented for example in the GAMS tool SCENRED.

Setting

Let Ω\OmegaΩ be a set and c:Ω×Ω→R+c:\Omega\times\Omega\to\mathbb R_+c:Ω×Ω→R+​ a cost function with c(ω,ω~)=0c(\omega,\tilde\omega)=0c(ω,ω~)=0 if and only if ω=ω~\omega=\tilde\omegaω=ω~, and c(ω,ω~)=c(ω~,ω)c(\omega,\tilde\omega)=c(\tilde\omega,\omega)c(ω,ω~)=c(ω~,ω) (conditions (C1)–(C2), p. 498). The original distribution has scenarios ω1,…,ωN∈Ω\omega_1,\dots,\omega_N\in\Omegaω1​,…,ωN​∈Ω with weights pi>0p_i>0pi​>0 and ∑ipi=1\sum_i p_i=1∑i​pi​=1. Write cij=c(ωi,ωj)c_{ij}=c(\omega_i,\omega_j)cij​=c(ωi​,ωj​).

A set J⊂{1,…,N}J\subset\{1,\dots,N\}J⊂{1,…,N} of scenarios is deleted. The reduced measure is Q=∑j∉JqjδωjQ=\sum_{j\notin J}q_j\delta_{\omega_j}Q=∑j∈/J​qj​δωj​​ with reduced weights qj≥0q_j\ge0qj​≥0, ∑j∉Jqj=1\sum_{j\notin J}q_j=1∑j∈/J​qj​=1. A transport plan from PPP to QQQ is a nonnegative matrix (ηij)i≤N, j∉J(\eta_{ij})_{i\le N,\,j\notin J}(ηij​)i≤N,j∈/J​ with row sums ∑j∉Jηij=pi\sum_{j\notin J}\eta_{ij}=p_i∑j∈/J​ηij​=pi​ and column sums ∑iηij=qj\sum_i\eta_{ij}=q_j∑i​ηij​=qj​. The Kantorovich functional (10) is the value of this transportation problem,

D(J;q)=min⁡{∑i∑j∉Jcijηij: η a transport plan from P to Q},D(J;q)=\min\Big\{\sum_{i}\sum_{j\notin J}c_{ij}\eta_{ij}:\ \eta\ \text{a transport plan from }P\text{ to }Q\Big\},D(J;q)=min{i∑​j∈/J∑​cij​ηij​: η a transport plan from P to Q},

and DJ=min⁡{D(J;q):q reduced weights}D_J=\min\{D(J;q): q\ \text{reduced weights}\}DJ​=min{D(J;q):q reduced weights} is the best distance achievable once JJJ is fixed. The optimal deletion problem (13) asks for min⁡{DJ:#J=k}\min\{D_J:\#J=k\}min{DJ​:#J=k} for a given 1≤k<N1\le k<N1≤k<N.

In the Lean development these objects are IsReducedWeight, IsTransportPlan, transportCost, transportValue (D(J;q)D(J;q)D(J;q)), optWeightsValue (DJD_JDJ​) and optimalDeletionValue (the value of (13)), all in the namespace ScenarioReduction.Redistribution.

Formalization targets

Goal: Theorem 2 (optimal weights), p. 500

For every J≠{1,…,N}J\neq\{1,\dots,N\}J={1,…,N},

DJ=min⁡{D(J;q):qj≥0, ∑j∉Jqj=1}=∑i∈Jpimin⁡j∉Jc(ωi,ωj),D_J=\min\Big\{D(J;q): q_j\ge0,\ \sum_{j\notin J}q_j=1\Big\}=\sum_{i\in J}p_i\min_{j\notin J}c(\omega_i,\omega_j),DJ​=min{D(J;q):qj​≥0, j∈/J∑​qj​=1}=i∈J∑​pi​j∈/Jmin​c(ωi​,ωj​),

and the minimum is attained at the optimal redistribution rule qˉj=pj+∑i∈Jjpi\bar q_j=p_j+\sum_{i\in J_j}p_iqˉ​j​=pj​+∑i∈Jj​​pi​, where Jj={i∈J:j(i)=j}J_j=\{i\in J: j(i)=j\}Jj​={i∈J:j(i)=j} and j(i)∈arg⁡min⁡j∉Jc(ωi,ωj)j(i)\in\arg\min_{j\notin J}c(\omega_i,\omega_j)j(i)∈argminj∈/J​c(ωi​,ωj​), for every such choice of j(⋅)j(\cdot)j(⋅).

Milestones

  1. Primal–dual representation of D(J;q)D(J;q)D(J;q) (first display of the proof, p. 501): the transportation problem and its linear-programming dual both attain D(J;q)D(J;q)D(J;q).
  2. Lower bound (p. 501): ∑i∈Jpimin⁡k∉Jcik≤D(J;q)\sum_{i\in J}p_i\min_{k\notin J}c_{ik}\le D(J;q)∑i∈J​pi​mink∈/J​cik​≤D(J;q) for every feasible qqq.
  3. Upper bound at qˉ\bar qqˉ​ (p. 501): qˉ\bar qqˉ​ is feasible and D(J;qˉ)≤∑i∈Jpimin⁡j∉JcijD(J;\bar q)\le\sum_{i\in J}p_i\min_{j\notin J}c_{ij}D(J;qˉ​)≤∑i∈J​pi​minj∈/J​cij​.
  4. Theorem 3 (p. 501): for weights prescribed by qj=pj+λjpJq_j=p_j+\lambda_jp_Jqj​=pj​+λj​pJ​, D(J;q)≤∑i∈Jpi∑j∉Jλjc(ωi,ωj)D(J;q)\le\sum_{i\in J}p_i\sum_{j\notin J}\lambda_jc(\omega_i,\omega_j)D(J;q)≤∑i∈J​pi​∑j∈/J​λj​c(ωi​,ωj​), with equality if #J=1\#J=1#J=1 and ccc satisfies the triangle inequality.
  5. Theorem 4 (p. 503): the greedy recursions (16) and (17) give a lower and an upper bound for min⁡{DJ:#J=k}\min\{D_J:\#J=k\}min{DJ​:#J=k}, and the backward set {l1,…,lk}\{l_1,\dots,l_k\}{l1​,…,lk​} is optimal under a nonemptiness condition.

Significance

Theorem 2 reduces the continuous part of scenario reduction to a formula: once the set of kept scenarios is chosen, the best reweighting is to move the mass of every deleted scenario to a nearest kept scenario, and the resulting distance is an explicit sum. This leaves only the combinatorial choice of JJJ, which Theorem 4 brackets by two greedy procedures; these are the backward-reduction and forward-selection algorithms of the paper and of later work by Heitsch and Römisch. Theorem 3 covers the case in which the reduced weights are fixed by the modeller, for instance to keep a uniform distribution uniform.

The results are proved in the paper by elementary linear-programming arguments. As far as is known, none of them has a machine-checked proof. Formalizing them produces a verified finite transportation-problem layer with a general (not necessarily metric) cost and a deleted index set, and verified correctness certificates for the two standard scenario-reduction heuristics.

Difficulty

The upper bound of Theorem 2 is a direct construction. The content lies in the lower bound, which must hold for every reweighting qqq simultaneously; this needs the dual side of the transportation problem, and the full primal–dual representation (Milestone 1) requires strong duality for a transportation problem with only the kept columns, which Mathlib does not provide in this form. A naive argument that bounds each plan row by row gives the lower bound directly for plans, but relating it to D(J;q)D(J;q)D(J;q) as an infimum also requires that plans exist and that the infimum is attained. In Theorem 4, the recursions (16) and (17) are greedy and do not in general produce optimal sets; the lower bound works only because its inner minimum ranges over all j≠lj\neq lj=l, not over the kept scenarios.

Formalization scope

Scenarios are indexed by Fin N (0-based), scenarios are a function ω : Fin N → Ω into an arbitrary type Ω, the cost is c : Ω → Ω → ℝ, and weights, plans and dual variables are real-valued functions on Fin N and Fin N × Fin N. Only the entries at kept indices j∉Jj\notin Jj∈/J enter any constraint, cost or objective. No measure theory is used: the index-level transportation problem is the paper's own representation of μ^c\hat\mu_cμ^​c​ for discrete measures (p. 495). Every theorem carries the standing assumptions of Section 3: c≥0c\ge0c≥0, (C1), (C2), pi>0p_i>0pi​>0 and ∑ipi=1\sum_ip_i=1∑i​pi​=1. Measurability of ccc and conditions (C3) and (C4) concern Ω⊂Rs\Omega\subset\mathbb R^sΩ⊂Rs and play no role for finitely supported measures; they are dropped, so the statements are more general than the page. The hypothesis J≠{1,…,N}J\neq\{1,\dots,N\}J={1,…,N}, implicit in Theorem 2, is stated explicitly; in Theorem 4, 1≤k<N1\le k<N1≤k<N plays this role.

D(J;q)D(J;q)D(J;q) and DJD_JDJ​ are real infima (sInf) of transport costs and are only asserted about where the underlying sets are nonempty and bounded below; "min" is stated as attainment (IsLeast), not as an equality of infima. D(J;q)D(J;q)D(J;q) is defined as the transportation problem and is not defined by the closed form ∑i∈Jpimin⁡j∉Jcij\sum_{i\in J}p_i\min_{j\notin J}c_{ij}∑i∈J​pi​minj∈/J​cij​; under that definition Theorem 2 would be trivial, and it is ruled out here. Likewise the reduced-weight constraint does not force q=qˉq=\bar qq=qˉ​.

Needed infrastructure: finite transportation problems with nonnegativity and marginal constraints, existence of optimal plans (compactness of the feasible polytope), and LP duality for transportation problems. The transportation-problem layer is reusable beyond this mission. Contributions welcome: proofs of the milestones, a general strong-duality result for finite transportation problems, and the examples of p. 502 (single scenario deletion, keeping one scenario).

Selected references

  • J. Dupačová, N. Gröwe-Kuska, W. Römisch, Scenario reduction in stochastic programming: An approach using probability metrics, Math. Program. Ser. A 95 (2003) 493–511. https://doi.org/10.1007/s10107-002-0331-0
  • S. T. Rachev, Probability Metrics and the Stability of Stochastic Models, Wiley, 1991.
  • H. Heitsch, W. Römisch, Scenario reduction algorithms in stochastic programming, Comput. Optim. Appl. 24 (2003) 187–206. https://doi.org/10.1023/A:1021805924152
  • W. Römisch, R. Schultz, Stability analysis for stochastic programs, Ann. Oper. Res. 30 (1991) 241–266. https://doi.org/10.1007/BF02204819
7 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

On Certain Polytopes Associated with Graphs V: Zero-One Optima of the Odd-Cycle Relaxation on Series-Parallel GraphsResearch Paper

Motivation

The stable set problem asks for a largest set of pairwise non-adjacent vertices in a graph; its size is the stability number α(G)\alpha(G)α(G). It is NP-hard in general, and a standard way to attack it in integer programming is to write down linear inequalities valid for all stable sets and solve the resulting linear program. The weakest such relaxation uses only the edge inequalities xv+xw≤1x_v+x_w\le 1xv​+xw​≤1; its optimum can be as large as ∣V∣/2|V|/2∣V∣/2 on graphs with small α(G)\alpha(G)α(G). Adding, for every odd circuit CCC, the inequality ∑u∈Cxu≤12(∣C∣−1)\sum_{u\in C}x_u\le\frac12(|C|-1)∑u∈C​xu​≤21​(∣C∣−1) gives the odd-cycle relaxation, the first strengthening that cuts off the fractional point x≡12x\equiv\frac12x≡21​ on odd cycles.

Section 7 of V. Chvátal, On certain polytopes associated with graphs (J. Combin. Theory Ser. B 18 (1975) 138–154, doi:10.1016/0095-8956(75)90041-6) identifies a graph class on which this relaxation is exact for the all-ones objective, with an integral certificate on the dual side: the series-parallel networks. The paper conjectures (Conjecture 7.3) that for these graphs the odd-cycle inequalities describe the whole stable set polytope; graphs with that property were later called t-perfect.

Timeline:

  • 1960: G. A. Dirac, in "In abstrakten Graphen vorhandene vollständige 4-Graphen und ihre Unterteilungen" (Math. Nachr. 22), proves that graphs containing no subdivided K4K_4K4​ have at least two vertices of degree at most two.
  • 1975: Chvátal introduces the system (7.1) and proves Theorem 7.1 (this mission): on series-parallel networks, max⁡∑uxu\max\sum_u x_umax∑u​xu​ subject to (7.1) and its dual both have zero–one optima. He conjectures the full polyhedral statement.
  • 1979: M. Boulala and J.-P. Uhry, "Polytope des indépendants d'un graphe série-parallèle" (Discrete Math. 27), prove the conjecture: (7.1) defines the stable set polytope of every series-parallel graph.
  • 1986: A. M. H. Gerards and A. Schrijver, "Matrices with the Edmonds–Johnson property" (Combinatorica 6), extend this to graphs with no odd-K4K_4K4​ subdivision.

Setting

All graphs G=(V,E)G=(V,E)G=(V,E) are finite, undirected and loopless, with no parallel edges. A stable set is a set of vertices no two of which are adjacent. We write d(u)d(u)d(u) for the degree of uuu.

A set C⊆VC\subseteq VC⊆V induces an odd circuit if the induced subgraph G[C]G[C]G[C] is a cycle of length 2k+12k+12k+1 with k≥1k\ge1k≥1; triangles count, and such a cycle has no chords. Z(G)Z(G)Z(G) is the set of all such CCC. The odd-cycle system of GGG is

0≤xu≤1(u∈V),xv+xw≤1(vw∈E),∑u∈Cxu≤12(∣C∣−1)(C∈Z(G)).(7.1)\begin{aligned} 0\le x_u&\le 1 && (u\in V),\\ x_v+x_w&\le 1 && (vw\in E),\\ \textstyle\sum_{u\in C}x_u&\le \tfrac12(|C|-1) && (C\in Z(G)). \end{aligned}\tag{7.1}0≤xu​xv​+xw​∑u∈C​xu​​≤1≤1≤21​(∣C∣−1)​​(u∈V),(vw∈E),(C∈Z(G)).​(7.1)

Its linear programming dual for the objective ∑uxu\sum_u x_u∑u​xu​, with x≥0x\ge0x≥0 read as sign constraints, has variables yu≥0y_u\ge0yu​≥0, ze≥0z_e\ge0ze​≥0, wC≥0w_C\ge0wC​≥0 and reads

min⁡ ∑uyu+∑eze+∑C∈Z(G)12(∣C∣−1) wCs.t.yu+∑e∋uze+∑C∋uwC≥1  (u∈V).\min\ \sum_{u}y_u+\sum_{e}z_e+\sum_{C\in Z(G)}\tfrac12(|C|-1)\,w_C\quad\text{s.t.}\quad y_u+\sum_{e\ni u}z_e+\sum_{C\ni u}w_C\ge 1\ \ (u\in V).min u∑​yu​+e∑​ze​+C∈Z(G)∑​21​(∣C∣−1)wC​s.t.yu​+e∋u∑​ze​+C∋u∑​wC​≥1  (u∈V).

A homeomorph of K4K_4K4​ is a graph obtained from K4K_4K4​ by subdividing its edges into paths through new vertices of degree two. GGG is a series-parallel network if no subgraph of GGG is a homeomorph of K4K_4K4​.

Formalization targets

Goal: Theorem 7.1

For every series-parallel network GGG,

∃ x∈{0,1}V feasible for (7.1):  ∑uxu=max⁡{∑uxu′:x′∈RV satisfies (7.1)},\exists\,x\in\{0,1\}^V\ \text{feasible for (7.1)}:\ \ \sum_u x_u=\max\Big\{\sum_u x'_u : x'\in\mathbb R^V\text{ satisfies (7.1)}\Big\},∃x∈{0,1}V feasible for (7.1):  u∑​xu​=max{u∑​xu′​:x′∈RV satisfies (7.1)},

and there is a zero–one dual feasible (y,z,w)(y,z,w)(y,z,w) whose dual objective equals the minimum over all real dual feasible points. Both optimality claims are against real points. Chvátal's statement has no constants to improve; the formal goal is his theorem as printed.

Milestones

  1. Dirac's theorem (§7, p. 150): a series-parallel network with at least two vertices has two distinct vertices of degree at most two.
  2. Case 4 closure (p. 151): if d(u)=2d(u)=2d(u)=2 and the neighbours v,wv,wv,w of uuu are non-adjacent, deleting uuu and identifying vvv with www yields a series-parallel network.
  3. The combinatorial core (p. 151, (i)–(ii)): there are a stable set SSS and a spanning subgraph F≤GF\le GF≤G whose components are isolated vertices, isolated edges and odd circuits, such that with aaa isolated vertices, bbb isolated edges and ckc_kck​ circuits of length 2k+12k+12k+1,
a+b+∑kk ck=∣S∣.a+b+\sum_k k\,c_k=|S|.a+b+k∑​kck​=∣S∣.

Significance

The result. Theorem 7.1 says that on series-parallel networks the odd-cycle relaxation computes α(G)\alpha(G)α(G) exactly, and that the optimum is certified by a covering of the vertex set by single vertices, edges and chordless odd circuits whose total weight equals ∣S∣|S|∣S∣. This is a min–max theorem of König type for a non-bipartite, non-perfect class: odd cycles of length at least five are series-parallel and not perfect, so the clique inequalities of the perfect-graph theory (mission I of this series) do not suffice here. The statement is the unweighted case of the later polyhedral results of Boulala–Uhry and Gerards–Schrijver, and the combinatorial core (milestone 3) is the basis of a polynomial algorithm for α(G)\alpha(G)α(G) on this class, as the paper remarks.

Formalizing it. The theorem has been proved since 1975; neither Mathlib nor the Prove2Me library contains a formal proof of it. A formal proof needs a working notion of graph subdivision (topological minor), which Mathlib does not have, Dirac's degree theorem, the induction of the paper with its four cases, and the passage from the combinatorial core to a pair of LP optima through weak duality. Each of these is reusable: topological minors and the K4K_4K4​-subdivision-free class appear throughout structural graph theory.

Difficulty

The combinatorial core is proved by induction on ∣V∣|V|∣V∣ removing a vertex of degree at most two, and three of the four cases are routine. The obstacle is Case 4 (d(u)=2d(u)=2d(u)=2, neighbours non-adjacent): deleting uuu alone loses the information needed to recover SSS and FFF, so the proof identifies the two neighbours. That requires the class to be closed under this identification, a statement about subdivisions that is not a local edge count, and a lifting of (S′,F′)(S',F')(S′,F′) from the reduced graph with a case split on the component of F′F'F′ containing the merged vertex. A second gap is between FFF and the dual: an odd-circuit component of FFF may have chords in GGG and so need not lie in Z(G)Z(G)Z(G), and the zero–one dual solution must be extracted from it. Finally, Dirac's theorem itself is the one place where the absence of K4K_4K4​ subdivisions is used positively, and it is not a consequence of a degree-counting argument.

Formalization scope

Graphs are SimpleGraph V on a Fintype V with decidable equality and decidable adjacency. Z(G)Z(G)Z(G) is a Finset (Finset V) whose members induce a subgraph isomorphic to Mathlib's cycleGraph (2k+1), k≥1k\ge1k≥1. The dual variables are indexed by V, by the edge set G.edgeSet, and by the subtype of Z(G)Z(G)Z(G); x≥0x\ge0x≥0 is a sign constraint with no dual variable. "Contains a homeomorph of K4K_4K4​" is encoded by four distinct branch vertices and six paths (Walk.IsPath) that avoid other branch vertices and meet only at common endpoints; it is not the K4K_4K4​-minor notion and not the series–parallel composition notion, whose equivalence with it is not part of the paper.

Conventions and implicit hypotheses made explicit:

  • Dirac's theorem is stated with ∣V∣≥2|V|\ge 2∣V∣≥2; as printed it fails for graphs with fewer than two vertices.
  • In Case 4 the identified graph has vertex set V∖{u,w}V\setminus\{u,w\}V∖{u,w}, with vvv representing v≡wv\equiv wv≡w; parallel edges merge.
  • Optimality in the goal is against every real feasible point of each program. A statement comparing the zero–one points only with other zero–one points would reduce the primal half to α(G)≤α(G)\alpha(G)\le\alpha(G)α(G)≤α(G) and is ruled out.
  • In milestone 3 the sum a+b+∑kkcka+b+\sum_k k c_ka+b+∑k​kck​ is written as a sum over the connected components of FFF of 111 (one or two vertices) or (n−1)/2(n-1)/2(n−1)/2 (n≥3n\ge3n≥3 vertices).

Corollary 7.2 (stated without proof) and Conjecture 7.3 are not part of this mission. Contributions welcome: a general topological-minor library, Dirac's theorem, and a proof of the combinatorial core.

Selected references

  • V. Chvátal, On certain polytopes associated with graphs, J. Combin. Theory Ser. B 18 (1975) 138–154. https://doi.org/10.1016/0095-8956(75)90041-6
  • G. A. Dirac, In abstrakten Graphen vorhandene vollständige 4-Graphen und ihre Unterteilungen, Math. Nachr. 22 (1960) 61–85 (reference [6], Satz 5, of the paper).
  • R. J. Duffin, Topology of series-parallel networks, J. Math. Anal. Appl. 10 (1965) 303–318 (reference [7] of the paper).
  • M. Boulala, J.-P. Uhry, Polytope des indépendants d'un graphe série-parallèle, Discrete Math. 27 (1979) 225–243.
  • A. M. H. Gerards, A. Schrijver, Matrices with the Edmonds–Johnson property, Combinatorica 6 (1986) 365–379.
8 thms3 active usersReviewed
🏆Completed
Bandit AlgorithmsOperations ResearchOptimization+1·Captain: naimengye

Multi-armed Bandit Allocation Indices IV: The Achievable Region, Generalized Conservation Laws and the Adaptive Greedy AlgorithmTextbook

Motivation

Chapter 5 of Gittins, Glazebrook and Weber, Multi-armed Bandit Allocation Indices (2nd ed., doi:10.1002/9780470980033), presents the achievable region methodology of Tsoucas, Bertsimas and Niño-Mora, Glazebrook and Garbe, and Dacre, Glazebrook and Niño-Mora: instead of arguing about policies, one argues about the set of performance vectors they can produce. For a multi-armed bandit the natural performance of a policy is the vector of discounted numbers of times each state is continued; the expected return is linear in it; and the set of achievable performances turns out to be a polytope cut out by conservation laws, one inequality per subset of states, with equality exactly for the priority policies that put that subset last. Optimizing a linear objective over a polytope is a linear program, its dual is solved by an adaptive greedy algorithm, and the primal solution is the performance of a priority policy whose priorities are the algorithm's outputs, the Gittins indices. This gives yet another proof of the index theorem (Section 5.3) and, more importantly, a definition, generalized conservation laws (Section 5.4), of the class of systems for which the same argument works: branching bandits, multi-class queues, job scheduling with discounted rewards, systems with imposed priority classes. The chapter's main result, Theorem 5.5, is the statement that every such system is solved by an index policy.

Setting

There are NNN job types E={1,…,N}E = \{1, \dots, N\}E={1,…,N}. A policy π\piπ has a performance xπ∈R+Nx^\pi \in \mathbb{R}^N_+xπ∈R+N​, a vector of expectations; a permutation σ\sigmaσ of EEE defines the permutation policy giving σN\sigma_NσN​ highest and σ1\sigma_1σ1​ lowest priority, and Sk={σ1,…,σk}S_k = \{\sigma_1, \dots, \sigma_k\}Sk​={σ1​,…,σk​} is the set of the kkk lowest-priority types. The system satisfies GCL(1) if there are a base function b:2E→R+b : 2^E \to \mathbb{R}_+b:2E→R+​ and a matrix A=(AiS)A = (A_i^S)A=(AiS​), positive on SSS and zero off it, such that for every policy

∑i∈SAiSxiπ≥b(S)(S⊆E),∑i∈EAiExiπ=b(E),\sum_{i \in S} A_i^S x_i^\pi \ge b(S) \quad (S \subseteq E), \qquad \sum_{i \in E} A_i^E x_i^\pi = b(E),i∈S∑​AiS​xiπ​≥b(S)(S⊆E),i∈E∑​AiE​xiπ​=b(E),

with equality in the first for every permutation policy whose ∣S∣|S|∣S∣ lowest-priority types are SSS. GCL(2) reverses the inequality. The adaptive greedy algorithm AG(A,r)AG(A, r)AG(A,r) picks iNi_NiN​ maximizing ri/AiEr_i/A_i^Eri​/AiE​, sets yˉE\bar y_Eyˉ​E​ to the maximum, removes iNi_NiN​, and repeats with the adjusted rewards ri−∑j≥kAiSjyˉSjr_i - \sum_{j \ge k} A_i^{S_j}\bar y_{S_j}ri​−∑j≥k​AiSj​​yˉ​Sj​​ divided by AiSk−1A_i^{S_{k-1}}AiSk−1​​; its outputs are the order i1,…,iNi_1, \dots, i_Ni1​,…,iN​, the dual variables yˉSk\bar y_{S_k}yˉ​Sk​​ and the indices νik=∑j≥kyˉSj\nu_{i_k} = \sum_{j \ge k} \bar y_{S_j}νik​​=∑j≥k​yˉ​Sj​​.

For the SFABP of Section 5.3, nnn identical bandit processes on EEE with kernel PPP and discount factor aaa in the model of the Bandit Algorithms series, xiπ=Eπ∑tatIi(t)x_i^\pi = \mathbb{E}^\pi \sum_t a^t I_i(t)xiπ​=Eπ∑t​atIi​(t) is the discounted number of continuations of a bandit in state iii, AiS=E[1+a+⋯+aTiS−1]A_i^S = \mathbb{E}[1 + a + \cdots + a^{T_i^S - 1}]AiS​=E[1+a+⋯+aTiS​−1] is the discounted return time to SSS from i∈Si \in Si∈S, and b(S)b(S)b(S) is the minimal cost ∑i∈SAiSxiπ\sum_{i \in S} A_i^S x_i^\pi∑i∈S​AiS​xiπ​, namely (1−a)−1E[aτ](1-a)^{-1}\mathbb{E}[a^\tau](1−a)−1E[aτ] with τ\tauτ the number of continuations needed to bring every bandit into SSS.

Formalization targets

Goal: Theorem 5.5

For a GCL(1) system whose achievable region is convex, and any reward vector rrr: the achievable region is the polytope

P(A,b)={x∈R+N:∑i∈SAiSxi≥b(S), S⊂E, ∑i∈EAiExi=b(E)};P(A, b) = \Big\{x \in \mathbb{R}_+^N : \sum_{i \in S} A_i^S x_i \ge b(S),\ S \subset E,\ \sum_{i \in E} A_i^E x_i = b(E)\Big\};P(A,b)={x∈R+N​:i∈S∑​AiS​xi​≥b(S), S⊂E, i∈E∑​AiE​xi​=b(E)};

its extreme points are performances of permutation policies; AG(A,r)AG(A, r)AG(A,r) has an output; and for every output the permutation policy in the order it finds, the Gittins index policy, maximizes ∑irixiπ\sum_i r_i x_i^\pi∑i​ri​xiπ​ over all policies.

Milestones

Lemma 5.1 (the SFABP satisfies the conservation laws, with equality for policies giving priority to states outside SSS); the identification on p. 123 of the adaptive greedy indices of a SFABP with the Gittins indices, together with their monotonicity along the order found; Theorem 5.10, the GCL(2) counterpart of the goal for cost minimization.

Significance

Theorem 5.5 is the index theorem in its most general form of this kind: it says nothing about Markov chains, only that performances are expectations, objectives are linear and conservation laws hold, and it delivers both the optimal policy and the algorithm that computes its priorities in polynomial time in the number of job types. It is the theorem behind the index results for branching bandits and Klimov's multi-class queue and behind the suboptimality bounds of Sections 5.5 and 5.7, all of which are calculations on the polytope. Lemma 5.1 and the p. 123 identification are what tie the abstract theorem to the Gittins index: they show that the multi-armed bandit is a GCL(1) system and that the priorities the algorithm produces are the same indices as Chapters 2 to 4 define through stopping times.

None of these is machine-checked. Formalizing Theorem 5.5 puts an LP-duality index theorem on the platform in a form any system can instantiate by verifying its conservation laws; formalizing Lemma 5.1 relates the Bandit Algorithms run law to the single-chain return times, which is the first conservation law on that model; and the p. 123 theorem gives an algorithmic characterization of the Gittins index on finite chains, distinct from the restart and largest-remaining-index characterizations of Chapter 2.

Difficulty

The goal's optimality clause is weak LP duality once one shows that the greedy dual variables are nonpositive except yˉE\bar y_Eyˉ​E​ and satisfy the dual constraints with equality, which is a finite induction on the stages; the extreme-point clause needs that every vertex of a polyhedron is the unique maximizer of some linear functional, and the region clause that a compact convex set is the convex hull of its extreme points (Krein–Milman in finite dimension, or the polyhedral fact directly). None of this is in Mathlib in the required form. Lemma 5.1 is probabilistic: the lower bound requires the strong Markov property of the continued bandit under an arbitrary past-measurable policy, a pathwise accounting of the discounted periods paid for by each continuation from SSS, and the observation that at most τ\tauτ slots can be spent on bandits that have never been in SSS; the equality for priority policies requires that these policies use exactly those slots first and then tile the future with return excursions, and the product form of b(S)b(S)b(S) requires independence of the bandits' process-time trajectories under the run law, which is built decision time by decision time rather than as a product. The p. 123 theorem is the computation (5.13) to (5.14) combined with the optimal-stopping characterization of Chapter 2 for the stop sets {i1,…,ik−2}\{i_1, \dots, i_{k-2}\}{i1​,…,ik−2​}, which lie between {ν<ν(ik−1)}\{\nu < \nu(i_{k-1})\}{ν<ν(ik−1​)} and {ν≤ν(ik−1)}\{\nu \le \nu(i_{k-1})\}{ν≤ν(ik−1​)}; ties make the induction delicate, and the statement is claimed for every tie-breaking.

Formalization scope

GCL(1) and GCL(2) systems are structures over an arbitrary policy type: performance, base function, matrix, permutation policies and the three laws are fields, so the theorems are statements about finite-dimensional data and the platform's proof needs no probability. The adaptive greedy algorithm is specified relationally, as the set of its possible outputs with arbitrary tie-breaking, and the conclusion holds for each of them; existence of an output is asserted separately. The optimality clause is stated as a comparison with every policy rather than as a real supremum. The hypothesis that the achievable region is convex is explicit: the book's argument from extreme points to the whole polytope uses randomization of policies, and without it the region of a system with only its permutation policies is finite. The SFABP items use nnn identical bandits on Fin N in the Bandit Algorithms model, the coefficients AiSA_i^SAiS​ through Mission I's stoppedTime at the return time, and b(S)b(S)b(S) in the product form (1−a)−1∏j:kj∉SE[aTkjS](1-a)^{-1}\prod_{j : k_j \notin S}\mathbb{E}[a^{T^S_{k_j}}](1−a)−1∏j:kj​∈/S​E[aTkj​S​], which is the minimal cost the argument on p. 120 establishes; the book prints a sum, which is 000 when all bandits start in SSS where the minimal cost is 1/(1−a)1/(1-a)1/(1−a). Discount factors are in (0,1)(0, 1)(0,1) throughout.

Trivializing readings are excluded: AiS>0A_i^S > 0AiS​>0 for i∈Si \in Si∈S is part of the structure and of Lemma 5.1's conclusion, the polytope equations are over all subsets, and the index clause quantifies over every greedy output. Welcome contributions: the nonpositivity and dual feasibility of the greedy variables, the vertex-exposure lemma for polyhedra, and the product decomposition of the run law of identical bandits.

Selected references

  • J. Gittins, K. Glazebrook, R. Weber, Multi-armed Bandit Allocation Indices, 2nd ed., Wiley, 2011, Chapter 5. doi:10.1002/9780470980033
  • D. Bertsimas, J. Niño-Mora, Conservation laws, extended polymatroids and multiarmed bandit problems; a polyhedral approach to indexable systems, Mathematics of Operations Research 21(2), 1996. doi:10.1287/moor.21.2.257
  • P. Tsoucas, The region of achievable performance in a model of Klimov, IBM Research Report RC16543, 1991.
  • E. G. Coffman, I. Mitrani, A characterization of waiting time performance realizable by single-server queues, Operations Research 28(3), 1980. doi:10.1287/opre.28.3.810
  • K. D. Glazebrook, R. Garbe, Almost optimal policies for stochastic systems which almost satisfy conservation laws, Annals of Operations Research 92, 1999. doi:10.1023/A:1018992306696
  • T. Lattimore, C. Szepesvári, Bandit Algorithms, Cambridge University Press, 2020, Chapter 35. doi:10.1017/9781108571401
8 thms3 active usersReviewed
🏆Completed
Control TheoryOperations ResearchOptimization+1·Captain: mikedeng1

Resource Allocation and Cross-Layer Control in Wireless Networks I: The Network Layer Capacity RegionTextbook

Motivation

Every wireless network control algorithm — routing, scheduling, power control, admission control — is ultimately judged against one question: which traffic loads can it keep stable? Answering that question requires a precise, algorithm-independent notion of queueing stability under random arrivals and a randomly time-varying, possibly non-ergodic-looking channel. Tassiulas & Ephremides (1992) and Neely, Modiano & Rohrs (2005) developed the framework used throughout Georgiadis, Neely & Tassiulas's survey Resource Allocation and Cross-Layer Control in Wireless Networks (Foundations and Trends in Networking, 2006): "strong stability" of a queue backlog process, defined purely through the time-averaged expected backlog, with no assumption that the arrival or service process is stationary, Markov, or even has a well-defined long-run average. The present mission formalizes the chapter's foundational single-queue results — the two structural facts every later network-wide capacity and control result in the book is built from.

Setting

A queue is described by three processes on slots t=0,1,2,…t=0,1,2,\dotst=0,1,2,…: an arrival process A(t)A(t)A(t) (new bits admitted at the end of slot ttt), a service process svc(t)\mathrm{svc}(t)svc(t) (the transmission rate offered during slot ttt), and the backlog U(t)U(t)U(t), evolving by the queueing law

U(t+1)=max⁡[U(t)−svc(t),0]+A(t).U(t+1)=\max[U(t)-\mathrm{svc}(t),0]+A(t).U(t+1)=max[U(t)−svc(t),0]+A(t).

The queue is strongly stable if its expected backlog has a bounded time average, lim sup⁡t→∞1t∑τ=0t−1E{U(τ)}<∞\limsup_{t\to\infty}\frac1t\sum_{\tau=0}^{t-1}\mathbb E\{U(\tau)\}<\inftylimsupt→∞​t1​∑τ=0t−1​E{U(τ)}<∞. An arrival process is admissible with rate λ\lambdaλ if (i) its time-average expected rate is λ\lambdaλ, (ii) its second moment conditioned on the history is uniformly bounded, and (iii) for every δ>0\delta>0δ>0 there is an averaging window over which the conditional average rate exceeds λ\lambdaλ by at most δ\deltaδ, uniformly in the starting time — a robust substitute for "the rate is exactly λ\lambdaλ" that holds for i.i.d., Markov-modulated, and burstiness-constrained arrivals alike. A service process is admissible with rate μ\muμ analogously, with a deterministic pointwise upper bound in place of the second-moment condition. Both notions are formalized here on a filtered probability space (Ω,P,F)(\Omega,P,\mathcal F)(Ω,P,F), with F(t)\mathcal F(t)F(t) the history of slots 0,…,t−10,\dots,t-10,…,t−1 exactly as the book's own H(t)\mathcal H(t)H(t).

Formalization targets

Goal — Lemma 3.6 (Stability Conditions under Admissibility)

(a) λ≤μ is necessary for strong stability;(b) λ<μ is sufficient for it.\text{(a) } \lambda\le\mu \text{ is necessary for strong stability;}\qquad \text{(b) } \lambda<\mu \text{ is sufficient for it.}(a) λ≤μ is necessary for strong stability;(b) λ<μ is sufficient for it.

This is the chapter's central single-queue result: it converts the purely structural notion of strong stability into the one comparison — arrival rate versus service rate — that every later capacity-region and control-algorithm argument in the book reduces to.

Milestone — Lemma 3.3 (Necessary Condition for Strong Stability)

if U is strongly stable and E{A(t)}≤Amax⁡ ∀t (or E{svc(t)−A(t)}≤Dmax⁡ ∀t), then lim⁡t→∞E{U(t)}/t=0.\text{if } U \text{ is strongly stable and } \mathbb E\{A(t)\}\le A_{\max}\ \forall t \text{ (or } \mathbb E\{\mathrm{svc}(t)-A(t)\}\le D_{\max}\ \forall t\text{), then } \lim_{t\to\infty}\mathbb E\{U(t)\}/t=0.if U is strongly stable and E{A(t)}≤Amax​ ∀t (or E{svc(t)−A(t)}≤Dmax​ ∀t), then t→∞lim​E{U(t)}/t=0.

This is the elementary real-analysis fact — no admissibility, no probability beyond an already-given expectation sequence — that underlies the necessity half of Lemma 3.6's proof.

Significance

Strong stability and the admissibility framework are the load-bearing definitions of the entire book: every later chapter's algorithm-performance theorem (Chapter 4's backpressure throughput optimality, Chapter 5's utility-optimal Lyapunov drift bound, Chapter 6's energy-constrained control) is a theorem about when its induced queues are strongly stable, and every one of those proofs cites Lemma 3.6 (or its network generalization, Theorem 3.8's capacity region) as the final step converting a drift bound into a stability conclusion. Formalizing it fixes, once for the whole series, the precise real-analysis and conditional-expectation content of "arrival rate below service rate implies stability" that a Prove2Me solver would otherwise have to reconstruct from scratch for each downstream chapter.

Formalizing it. No result in this mission has a machine-checked proof anywhere; nothing adjacent exists on the platform (searched for strong stability, admissible arrival process, Lyapunov drift, network capacity region — the one hit, a Foster–Lyapunov hitting-time bound for a finite-state MDP, is a scalar drift-to-a-target-state object, not a queue-backlog vector with no absorbing state, and is not reused). This mission is the first formalization of either result.

Difficulty

The obvious first idea for the sufficiency half (b) is to try to bound E{U(t)}\mathbb E\{U(t)\}E{U(t)} directly by unrolling the queueing recursion and taking expectations termwise. This fails immediately: expectation does not commute with max⁡(⋅,0)\max(\cdot,0)max(⋅,0), so E{U(t+1)}≠max⁡[E{U(t)}−E{svc(t)},0]+E{A(t)}\mathbb E\{U(t+1)\}\ne\max[\mathbb E\{U(t)\}-\mathbb E\{\mathrm{svc}(t)\},0]+\mathbb E\{A(t)\}E{U(t+1)}=max[E{U(t)}−E{svc(t)},0]+E{A(t)} in general — the whole reason admissibility's second-moment and TTT-slot averaging clauses exist is to control exactly this gap between the pathwise recursion and its expectation, via a genuine (non-elementary) drift argument. The necessity half (a) has the opposite trap: it is tempting to prove λ≤μ\lambda\le\muλ≤μ from a single-slot expectation inequality, but a queue can be strongly stable while E{U(t)}\mathbb E\{U(t)\}E{U(t)} oscillates on any finite window, so the argument has to go through the time-averaged (Lemma 3.3) quantity, not a slot-by-slot one.

Formalization scope

Admissibility's conditional-expectation clauses are stated with Mathlib's Filtration ℕ and condExp (P[f | 𝓕 t]), following this platform's established idiom for martingale-difference hypotheses. Every conditional or plain expectation in a defining clause carries an explicit Integrable guard, because Mathlib's Bochner integral and condExp both silently default to 0 on a non-integrable function — without the guard, a process with an undefined or infinite second moment would satisfy admissibility vacuously, which is not the book's assumption (the book assumes these moments are finite; it never derives it). Lemma 3.3 is formalized directly on the real sequences representing E{U(t)}\mathbb E\{U(t)\}E{U(t)}, E{A(t)}\mathbb E\{A(t)\}E{A(t)}, E{svc(t)}\mathbb E\{\mathrm{svc}(t)\}E{svc(t)} — exactly the content the book's own statement and proof use, with no further probabilistic structure, since the lemma's hypotheses and conclusion never mention anything but these expectations. Out of scope for this mission: the network-wide capacity region (Definition 3.7, Theorem 3.8, Corollaries 3.9-3.10) and the graph-family construction Γ\GammaΓ/Cl{Γ}\mathrm{Cl}\{\Gamma\}Cl{Γ} of §3.2-3.3. Faithfully formalizing "λ\lambdaλ is stably supportable by the network" requires embedding admissible-process realizations into a full multi-queue routing model, which is substantially heavier than either result formalized here and was left out entirely — per this series' faithfulness-over-coverage rule — rather than approximated by, e.g., dropping the second-moment or TTT-slot clauses of admissibility, which would silently change what "admissible" means. A trivializing formalization to rule out: defining AdmissibleArrival/AdmissibleService without the Integrable guards above would make Lemma 3.6 provable by choosing a non-integrable process, which is not the book's theorem.

Selected references

  • Georgiadis, Neely & Tassiulas, Resource Allocation and Cross-Layer Control in Wireless Networks, Foundations and Trends in Networking, Vol. 1, No. 1 (2006), pp. 1-144. https://doi.org/10.1561/1300000001
  • Tassiulas & Ephremides, "Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks", IEEE Transactions on Automatic Control, 37(12), 1992. https://doi.org/10.1109/9.182479
  • Neely, Modiano & Rohrs, "Dynamic power allocation and routing for time-varying wireless networks", IEEE Journal on Selected Areas in Communications, 23(1), 2005. https://doi.org/10.1109/JSAC.2004.837349
8 thms3 active users
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

The Design of Competitive Online Algorithms via a Primal-Dual Approach II: The Online Set-Cover ProblemTextbook

Motivation

Section 4 of this survey derives a simple randomized O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn)-competitive algorithm for the online set-cover problem, by rounding the fractional solution the online packing-covering framework produces. An intriguing question the survey poses next: can the same guarantee be achieved deterministically? The standard tool for removing randomness, the method of conditional expectations, requires finding a pessimistic estimator — a potential function whose value the algorithm can track and whose behavior certifies the randomized algorithm's guarantee step by step. Chapter 5 constructs exactly this potential function for the weighted online set-cover problem, and shows that greedily minimizing it online reproduces the randomized algorithm's competitive ratio with no randomness at all. This mission formalizes that construction: the potential function itself (Lemma 5.1) and the correctness guarantee it buys (Theorem 5.2).

Setting

Fix a finite universe of elements EEE and a finite family of sets TTT with positive costs csc_scs​, both known to the algorithm in advance (only which elements will actually need covering, and in what order, is unknown). A monotonically increasing assignment w:T→Rw : T \to \mathbb{R}w:T→R of fractional weights to sets is produced online by a fractional subroutine (any O(log⁡m)O(\log m)O(logm)- competitive online fractional algorithm — the survey's own Section 4.2 supplies one). An element's weight is we:=∑s∣e∈swsw_e := \sum_{s \mid e \in s} w_swe​:=∑s∣e∈s​ws​. Given a target α≥c(COPT)\alpha \ge c(C_{OPT})α≥c(COPT​) (a guessed upper bound on the optimal integral cover's cost — the survey handles an unknown optimum by doubling this guess across phases, outside this chapter's own scope), the algorithm maintains a chosen cover C⊆TC \subseteq TC⊆T and the potential

Φ  =  ∑e∉Cˉn2we  +  n⋅exp⁡ ⁣(12α∑s(csχC(s)−3wscslog⁡n)),\Phi \;=\; \sum_{e \notin \bar C} n^{2w_e} \;+\; n \cdot \exp\!\Big(\tfrac{1}{2\alpha} \sum_{s} \big(c_s \chi_C(s) - 3 w_s c_s \log n\big)\Big),Φ=e∈/Cˉ∑​n2we​+n⋅exp(2α1​s∑​(cs​χC​(s)−3ws​cs​logn)),

where n=∣E∣n = |E|n=∣E∣ and χC\chi_CχC​ is CCC's characteristic function. Whenever a set sss's weight increases, the algorithm computes Φ\PhiΦ both with and without adding sss to CCC and chooses whichever keeps Φ\PhiΦ from exceeding its value before the step (failing only if neither does, which Lemma 5.1 shows cannot happen when α≥c(COPT)\alpha \ge c(C_{OPT})α≥c(COPT​)).

Formalization targets

Theorem 5.2 (goal, p. 139): given the invariant Φ<n2\Phi < n^2Φ<n2 that Lemma 5.1 maintains throughout a run, (i) every element of weight ≥1\ge 1≥1 is covered, and (ii) the chosen cover costs at most α⋅O(log⁡mlog⁡n)\alpha \cdot O(\log m \log n)α⋅O(logmlogn).

Lemma 5.1 (milestone, p. 137): the potential function never increases in expectation across a weight-augmenting step, under the algorithm's own randomized choice of whether to add the augmented set to the cover (the internal argument — via the method of conditional expectations — that certifies the deterministic algorithm's choice rule never fails).

Significance

This chapter answers, for the online set-cover problem specifically, a question that recurs throughout online algorithm design: when can a randomized guarantee be derandomized online? The potential-function technique here is the survey's own template for the answer (it recurs, per the chapter's Notes section, in the routing algorithm of Chapter 9 and the ad-auctions algorithm of Chapter 10, both formalized as separate missions in this series) — a self-contained, reusable instance of "derandomization via an explicit pessimistic estimator" in the online setting, distinct from the offline set-cover primal-dual and dual-fitting algorithms of this book's own Chapter 2, already on the platform (PrimalDualOnline.SetCover.*, checked below: a static instance with no arrival order and no potential function, a genuinely different model).

Difficulty

The central formalization challenge is that Lemma 5.1's own statement, "Φend≤Φstart\Phi_{end} \le \Phi_{start}Φend​≤Φstart​", denotes the potential's value in expectation under the algorithm's randomized choice — not a single deterministic before/after pair — since the lemma is proved via a probabilistic argument (adding sss to the cover with probability 1−n−2δs1 - n^{-2\delta_s}1−n−2δs​) whose role is purely internal to justifying the deterministic algorithm's rule (choose whichever of the two options controls Φ\PhiΦ). Stating the lemma as a bare inequality between two potential values, without the mixture, would either be false (the "add sss" branch alone can increase Φ\PhiΦ) or would silently smuggle in the derandomized choice as a hypothesis rather than proving it is always available. This mission states the expectation explicitly as a probability-weighted average of the two branch potentials, matching the actual analytic content of the book's proof (equations 5.1-5.6) rather than its final one-line restatement.

Formalization scope

SetCoverInstance E T bundles elemSets : E → Finset T (the sets containing an element) and positive costs c. elementWeight and coveredBy are literal transcriptions of wew_ewe​ and "e∈Cˉe \in \bar Ce∈Cˉ". potential transcribes Φ\PhiΦ's displayed formula verbatim, with n cast from Fintype.card E. potential_nonincreasing (Lemma 5.1) is the expectation inequality described above. algorithm_correctness (Theorem 5.2) takes the potential invariant Φ < n² as a hypothesis (the state Lemma 5.1, applied repeatedly from the initial value Φ<n2\Phi < n^2Φ<n2, is what the book's own proof shows every reachable state satisfies) together with an explicit ratio β standing for "the fractional solution is O(log m)-competitive" (∑ wₛcₛ ≤ βα) — the book imports this fact from Section 4 as a black-box subroutine rather than re-deriving a specific numeric constant in this chapter, and this mission does the same rather than re-deriving Chapter 4's own constant under the (different) d→md \to md→m substitution the book's prose glosses over. The conclusion is then the fully explicit α · log n · (3β + 2), matching the book's own derivation (displayed inequality, p. 139-140) with O(log m) replaced by the parameter β. This correctly rules out the trivializing formalization in which the O(log m log n) bound is left as an unquantified existential constant, or in which Φ's invariant is assumed directly as an unmotivated free hypothesis rather than the fact Lemma 5.1 is what actually establishes. Reals throughout; Real.log, Real.exp, Real.rpow (via the ^ notation on reals) for the book's own log, exp and n^{2w_e}. Nothing here is reused from 04-framework (concurrent draft; per this series' own rule, drafts do not import drafts) even though this chapter's fractional subroutine is conceptually the same online covering framework — restated here only as the abstract ratio β, not as a Lean dependency. Welcome contributions: completing the two sorrys, and formalizing the doubling-across-phases wrapper (Section 5.1's "Obtaining a Deterministic Algorithm" discussion) that removes the need to know α ≥ c(C_OPT) in advance.

Selected references

  • N. Buchbinder, J. Naor. The Design of Competitive Online Algorithms via a Primal-Dual Approach. Foundations and Trends in Theoretical Computer Science, 3(2-3):93-263, 2009. https://doi.org/10.1561/0400000024
  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor. The online set cover problem. STOC 2003 / SIAM J. Comput. 39(2), 2009 (cited by this book's Chapter 5 Notes as [3]).
7 thms3 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Introduction to Stochastic Programming III: The L-Shaped Method and Its Finite ConvergenceTextbook

Motivation

Two-stage stochastic programs with recourse — choose a first-stage decision xxx now, observe a random outcome ξ\xiξ, then choose a second-stage recourse decision y(ξ)y(\xi)y(ξ) to repair whatever xxx left infeasible or suboptimal — are the workhorse model of the field, used for capacity planning, inventory and financial portfolio problems since the 1950s (Dantzig 1955; Beale 1955). When ξ\xiξ ranges over a finite set of scenarios, the recourse function QQQ that averages the second-stage cost over scenarios is piecewise linear and convex in xxx, so the overall problem is itself a large linear program — but one whose constraint matrix has a scenario for every column block and can be far too large to hand to a general-purpose LP solver directly. Van Slyke and Wets' L-shaped method (1969), the subject of this mission, is the algorithm that made two-stage recourse problems with finite scenario sets practically solvable: it is Benders decomposition specialized to this block structure, alternating between a small master program over xxx (and a scalar θ\thetaθ approximating the recourse cost) and, at each candidate xxx, a batch of second-stage linear programs that either certify xxx's second-stage feasibility or supply a linear underestimate — a cut — of QQQ around xxx. Birge & Louveaux's Introduction to Stochastic Programming (2nd ed., Springer 2011), Chapter 5 §5.1, gives the algorithm and proves its two central guarantees: a shortcut feasibility test for a special case (Theorem 1) and the algorithm's finite convergence in general (Theorem 2), which is this mission's goal.

Setting

A two-stage recourse instance consists of a first-stage feasible region K1={x∣Ax=b, x≥0}K_1 = \{x \mid Ax = b,\ x \ge 0\}K1​={x∣Ax=b, x≥0} for x∈Rn1x \in \mathbb{R}^{n_1}x∈Rn1​, and, for each of KKK finite scenarios k=1,…,Kk = 1, \dots, Kk=1,…,K (occurring with probability pkp_kpk​), second-stage data (qk,hk,Tk)(q_k, h_k, T_k)(qk​,hk​,Tk​) defining the recourse subproblem

Q(x,ξk)=min⁡y≥0{qk⊤y∣Wy=hk−Tkx},Q(x, \xi_k) = \min_{y \ge 0} \{ q_k^\top y \mid W y = h_k - T_k x \},Q(x,ξk​)=y≥0min​{qk⊤​y∣Wy=hk​−Tk​x},

where the recourse matrix WWW is fixed — the same across every scenario, the case this chapter treats. K2={x∣Q(x,ξk)<∞ for all k}K_2 = \{x \mid Q(x,\xi_k) < \infty \text{ for all } k\}K2​={x∣Q(x,ξk​)<∞ for all k} is the set of xxx for which every scenario's subproblem is feasible, and the two-stage problem is

min⁡x c⊤x+Q(x)s.t.x∈K1∩K2,Q(x)=∑k=1Kpk Q(x,ξk).\min_{x} \ c^\top x + Q(x) \quad \text{s.t.} \quad x \in K_1 \cap K_2, \qquad Q(x) = \sum_{k=1}^K p_k\, Q(x, \xi_k).xmin​ c⊤x+Q(x)s.t.x∈K1​∩K2​,Q(x)=k=1∑K​pk​Q(x,ξk​).

A basis of the recourse subproblem is an injective choice of m2m_2m2​ of WWW's columns (where m2m_2m2​ is WWW's row count); each basis bbb determines a simplex multiplier π=(Wb⊤)−1qb\pi = (W_b^\top)^{-1} q_bπ=(Wb⊤​)−1qb​, and when bbb attains the true optimum of Q(x,ξk)Q(x,\xi_k)Q(x,ξk​), LP duality gives Q(x,ξk)=π⊤(hk−Tkx)Q(x,\xi_k) = \pi^\top(h_k - T_k x)Q(x,ξk​)=π⊤(hk​−Tk​x) — the mechanism that turns a batch of second-stage LP solves into linear cuts on xxx.

Formalization targets

The L-shaped algorithm proceeds in three steps, repeated until neither applies:

  • Step 1 solves the current master program (the K1K_1K1​-feasible xxx, plus θ\thetaθ once at least one optimality cut exists, minimizing c⊤x+θc^\top x + \thetac⊤x+θ subject to every cut recorded so far — or just c⊤xc^\top xc⊤x over K1K_1K1​ before the first optimality cut, matching the book's convention that θ\thetaθ "is set equal to −∞-\infty−∞ and is not considered" until then).
  • Step 2 tests each scenario's second-stage feasibility at the Step-1 optimum via an auxiliary LP; if some scenario fails (the LP's optimal value is positive), its optimal basis yields a feasibility cut and the algorithm returns to Step 1.
  • Step 3, once every scenario is feasible, checks whether θ\thetaθ already dominates the true recourse cost at xxx (using each scenario's optimal basis via LP duality); if not, an optimality cut is added and the algorithm returns to Step 1; if so, xxx is optimal and the algorithm stops.

Goal — Chapter 5, Theorem 2 (p. 198)

When ξ is a finite random variable, the L-shaped algorithm finitely converges to\text{When } \xi \text{ is a finite random variable, the L-shaped algorithm finitely converges to}When ξ is a finite random variable, the L-shaped algorithm finitely converges to an optimal solution when it exists, or proves K1∩K2=∅.\text{an optimal solution when it exists, or proves } K_1 \cap K_2 = \varnothing.an optimal solution when it exists, or proves K1​∩K2​=∅.

Formalized as: starting from the empty cut set, there is a finite-length run of the algorithm's Step-1/2/3 transition relation, of length bounded by the total number of distinct feasibility- and optimality-cut witnesses available, ending at a state admitting no further step — at which point either the master program has become infeasible (certifying K1∩K2=∅K_1 \cap K_2 = \varnothingK1​∩K2​=∅) or its optimum is second-stage feasible, passes every fresh Step-3 test, and is optimal for the two-stage problem.

Milestone — Chapter 5, Theorem 1 (p. 194)

If T is deterministic, W is such that every t≥0 lies in pos W,\text{If } T \text{ is deterministic, } W \text{ is such that every } t \ge 0 \text{ lies in } \mathrm{pos}\,W,If T is deterministic, W is such that every t≥0 lies in posW, and a=min⁡khk (componentwise) is attained by some scenario hℓ,\text{and } a = \min_k h_k \text{ (componentwise) is attained by some scenario } h_\ell,and a=kmin​hk​ (componentwise) is attained by some scenario hℓ​, then x∈K2  ⟺  ∃ y≥0, Wy=a−Tx.\text{then } x \in K_2 \iff \exists\, y \ge 0,\ Wy = a - Tx.then x∈K2​⟺∃y≥0, Wy=a−Tx.

A shortcut avoiding KKK separate feasibility LPs at Step 2: under these structural assumptions on WWW, checking feasibility at the single componentwise-worst right-hand side certifies feasibility at every scenario simultaneously.

Significance

Van Slyke and Wets' method (and Benders decomposition more generally, of which it is the recourse-problem specialization) underlies essentially every large-scale two-stage stochastic program solved in practice, and its finite-convergence guarantee — not merely that an optimum exists, but that this specific cutting-plane procedure reaches it in finitely many outer iterations — is what makes the method a decision procedure rather than a heuristic. The proof's content is an explicit finiteness argument (the number of distinct simplex bases of the recourse subproblem and the feasibility-test LP is finite, so the algorithm cannot generate infinitely many distinct cuts before either exhausting the feasible region or converging), not a general compactness or fixed-point argument; formalizing it means formalizing the cutting-plane mechanism itself as a transition system and proving termination combinatorially, over the finite type of available bases, rather than proving only that some optimal xxx exists.

Difficulty

The natural shortcut — state only "an optimal xxx exists, or K1∩K2=∅K_1 \cap K_2 = \varnothingK1​∩K2​=∅" — is not Theorem 2's actual content and is not what this mission targets: that weaker claim would already follow from K1∩K2K_1 \cap K_2K1​∩K2​ being a nonempty polyhedron (or empty), with no reference to the algorithm at all, and would not require the finiteness-of-bases argument the book's proof turns on. The genuine difficulty is representing Steps 1-3 faithfully as a relation on accumulating cut sets, and pinning the termination bound to the actual combinatorial object the book cites (the finite set of bases of the two LPs the algorithm solves at each iteration) rather than to a numeral or an abstract compactness bound. A second, quieter difficulty is Step 1's own optimum: once optimality cuts exist, the master program optimizes c⊤x+θc^\top x + \thetac⊤x+θ jointly, but before the first one it optimizes c⊤xc^\top xc⊤x alone; conflating the two (e.g. always requiring θ\thetaθ to be part of the optimum) does not match Step 1 as the book states it.

Formalization scope

First-stage and second-stage vectors are Fin n1 → ℝ / Fin n2 → ℝ; the finite scenario set is Fin K with probability vector p. A basis is {b : Fin m2 → Fin n2 // Function.Injective b} (m2 = the recourse matrix's row count), matching "an injective choice of m2m_2m2​ columns of WWW"; its finiteness is definitional, from Fin m2 → Fin n2 being finite. Simplex multipliers use Matrix.inv, whose junk value 0 on a singular matrix is never reachable in a proof because multipliers are only ever used through an IsOptimalAt/IsFeasBasisOptimalAt hypothesis that pins the basis to one genuinely attaining the LP's true optimum. The recourse value Q(x,ξk)Q(x,\xi_k)Q(x,ξk​) is EReal-valued (reusing this series' Instance/QVal convention from Chunk 03), so an optimality-cut witness's claimed value is compared to it by an explicit EReal cast, never by EReal arithmetic. The algorithm's state is a pair of finite sets of witnesses recorded so far (Finset (Fin K × FeasBasis n2 m2) × Finset (Fin K → Basis n2 m2)); Step is an inductive relation with one constructor per Step-2 and Step-3 branch, each requiring its witness not already recorded, and the goal states a bounded-length Step-path from the empty state to a state admitting no further Step. This mission does not restate Chapter 3's polyhedrality fact about K2K_2K2​ as a separate lemma: the finiteness fact it is invoked for is already exposed directly and structurally by the finite Fintype bound on the number of bases, so no additional axiom stands in for it (see MODERATION_NOTES.md). Lemmas 3-9 and Theorem 10 of §5.2 (Regularized Decomposition, a different algorithm) are out of scope. The trivializing formalization this mission rules out is exactly the one named under Difficulty above: a bare existence-of-optimal-or- infeasible-xxx statement with no reference to Steps 1-3 or to a finite bound on the number of iterations — such a statement would be true of any nonempty polyhedron and would not be Theorem 2.

Selected references

  • R. Van Slyke and R. Wets, L-Shaped Linear Programs with Applications to Optimal Control and Stochastic Programming, SIAM Journal on Applied Mathematics, 17(4), 1969, pp. 638-663. https://doi.org/10.1137/0117061
  • J. Birge and F. Louveaux, Introduction to Stochastic Programming, 2nd ed., Springer, 2011, Chapter 5. https://doi.org/10.1007/978-1-4614-0237-4
  • G. Dantzig, Linear Programming under Uncertainty, Management Science, 1(3-4), 1955, pp. 197-206. https://doi.org/10.1287/mnsc.1.3-4.197
6 thms3 active users
🏆Completed
Operations ResearchOptimization·Captain: Shuze Chen

Introduction to Linear Optimization XII: Interior Point Methods and Path FollowingTextbook

Interior point methods solve linear programs by moving through the interior of the feasible set instead of along its edges — the approach that turned Karmarkar's 1984 breakthrough into today's practical large-scale solvers. This mission formalizes the primal path following algorithm of Chapter 9 of Bertsimas–Tsitsiklis. For μ>0\mu > 0μ>0 the logarithmic barrier

Bμ(x)=c′x−μ∑j=1nlog⁡xjB_\mu(\mathbf{x}) = \mathbf{c}'\mathbf{x} - \mu\sum_{j=1}^n \log x_jBμ​(x)=c′x−μj=1∑n​logxj​

replaces the constraint x≥0\mathbf{x} \ge \mathbf{0}x≥0; the minimizers x(μ)\mathbf{x}(\mu)x(μ) of BμB_\muBμ​ over {Ax=b}\{A\mathbf{x} = \mathbf{b}\}{Ax=b} trace the central path, characterized by the KKT conditions (9.17): Ax=bA\mathbf{x} = \mathbf{b}Ax=b, x≥0\mathbf{x} \ge \mathbf{0}x≥0, A′p+s=cA'\mathbf{p} + \mathbf{s} = \mathbf{c}A′p+s=c, s≥0\mathbf{s} \ge \mathbf{0}s≥0, XSe=μeXS\mathbf{e} = \mu\mathbf{e}XSe=μe (Lemma 9.5). The algorithm follows the path with one Newton step of the barrier problem per shrink μk+1=αμk\mu^{k+1} = \alpha\mu^kμk+1=αμk, maintaining the proximity invariant

∥1μXSe−e∥≤β\|\frac{1}{\mu}XS\mathbf{e} - \mathbf{e}\| \le \beta∥μ1​XSe−e∥≤β

. The goal theorem is Theorem 9.7: with α=1−β−ββ+n\alpha = 1 - \frac{\sqrt{\beta}-\beta}{\sqrt{\beta}+\sqrt{n}}α=1−β​+n​β​−β​ and a β\betaβ-close start, after K=⌈β+nβ−β log⁡(s0)′x0(1+β)ε(1−β)⌉K = \Big\lceil \frac{\sqrt{\beta}+\sqrt{n}}{\sqrt{\beta}-\beta}\,\log\frac{(\mathbf{s}^0)'\mathbf{x}^0(1+\beta)}{\varepsilon(1-\beta)} \Big\rceilK=⌈β​−ββ​+n​​logε(1−β)(s0)′x0(1+β)​⌉ iterations the algorithm reaches primal and dual feasible solutions with duality gap (sK)′xK≤ε(\mathbf{s}^K)'\mathbf{x}^K \le \varepsilon(sK)′xK≤ε — the explicit form of the celebrated O(nlog⁡(1/ε))O(\sqrt{n}\log(1/\varepsilon))O(n​log(1/ε)) iteration bound. Alongside it we formalize the generic potential-reduction scheme (Theorem 9.4): any algorithm cutting G(x,s)=qlog⁡s′x−∑jlog⁡xj−∑jlog⁡sjG(\mathbf{x},\mathbf{s}) = q\log\mathbf{s}'\mathbf{x} - \sum_j \log x_j - \sum_j \log s_jG(x,s)=qlogs′x−∑j​logxj​−∑j​logsj​ by δ\deltaδ per step reaches gap ε\varepsilonε within an explicit KKK.

9 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: Shuze Chen

Introduction to Linear Optimization XI: The Ellipsoid MethodTextbook

Can the feasibility of a system of linear inequalities be decided in a provably small number of iterations? The ellipsoid method — the algorithm with which Khachiyan showed in 1979 that linear programming is polynomially solvable — answers this with pure convex geometry. This mission formalizes Chapter 8 of Bertsimas–Tsitsiklis. An ellipsoid is

E(z,D)={x∈Rn∣(x−z)′D−1(x−z)≤1}E(\mathbf{z}, D) = \{\mathbf{x} \in \mathbb{R}^n \mid (\mathbf{x}-\mathbf{z})'D^{-1}(\mathbf{x}-\mathbf{z}) \le 1\}E(z,D)={x∈Rn∣(x−z)′D−1(x−z)≤1}

with DDD symmetric positive definite. The geometric engine is Theorem 8.1: the half-ellipsoid E∩{x∣a′x≥a′z}E \cap \{\mathbf{x} \mid \mathbf{a}'\mathbf{x} \ge \mathbf{a}'\mathbf{z}\}E∩{x∣a′x≥a′z} is contained in the explicitly constructed ellipsoid E′=E(zˉ,Dˉ)E' = E(\bar{\mathbf{z}}, \bar{D})E′=E(zˉ,Dˉ),

zˉ=z+1n+1Daa′Da,\bar{\mathbf{z}} = \mathbf{z} + \frac{1}{n+1}\frac{D\mathbf{a}}{\sqrt{\mathbf{a}'D\mathbf{a}}},zˉ=z+n+11​a′Da​Da​, Dˉ=n2n2−1(D−2n+1Daa′Da′Da),\bar{D} = \frac{n^2}{n^2-1}\big(D - \frac{2}{n+1}\frac{D\mathbf{a}\mathbf{a}'D}{\mathbf{a}'D\mathbf{a}}\big),Dˉ=n2−1n2​(D−n+12​a′DaDaa′D​),

and the volume contracts:

Vol(E′)<e−1/(2(n+1)) Vol(E)\mathrm{Vol}(E') < e^{-1/(2(n+1))}\,\mathrm{Vol}(E)Vol(E′)<e−1/(2(n+1))Vol(E)

. Two integer-data estimates make the contraction decisive: every extreme point of P={x∣Ax≥b}P = \{\mathbf{x} \mid A\mathbf{x} \ge \mathbf{b}\}P={x∣Ax≥b} with entries bounded by UUU has coordinates in [−(nU)n,(nU)n][-(nU)^n, (nU)^n][−(nU)n,(nU)n] (Lemma 8.2), and a full-dimensional bounded such polyhedron has Vol(P)>n−n(nU)−n2(n+1)\mathrm{Vol}(P) > n^{-n}(nU)^{-n^2(n+1)}Vol(P)>n−n(nU)−n2(n+1) (Lemma 8.4). The goal theorem is Theorem 8.2: started on a ball E(x0,r2I)E(\mathbf{x}_0, r^2 I)E(x0​,r2I) of volume at most VVV containing PPP, with vvv a lower bound on Vol(P)\mathrm{Vol}(P)Vol(P) when PPP is nonempty, the ellipsoid method correctly decides whether PPP is empty within t∗=⌈2(n+1)log⁡(V/v)⌉t^* = \lceil 2(n+1)\log(V/v) \rceilt∗=⌈2(n+1)log(V/v)⌉ iterations — the explicit iteration count behind the polynomial-time headline.

14 thms3 active usersReviewed
🏆Completed
Optimization·Captain: Shuze Chen

Introduction to Linear Optimization IX: Network Flow IntegralityTextbook

Why do network linear programs return integer answers for free? This mission formalizes the structural theory of the minimum cost network flow problem of Chapter 7 of Bertsimas & Tsitsiklis: a directed graph G=(N,A)G=(\mathcal{N},\mathcal{A})G=(N,A) with external supplies bib_ibi​, arc costs cijc_{ij}cij​, and the node-arc incidence matrix A\mathbf{A}A — an n×mn\times mn×m matrix in which every column has exactly one +1+1+1 (start node) and one −1-1−1 (end node) — so that flow conservation reads Af=b\mathbf{A}\mathbf{f}=\mathbf{b}Af=b, forcing the standing assumption ∑i∈Nbi=0\sum_{i\in\mathcal{N}} b_i=0∑i∈N​bi​=0. Because the rows of A\mathbf{A}A sum to zero, the book works with the truncated matrix A~\tilde{\mathbf{A}}A~ of the first n−1n-1n−1 rows. The combinatorial heart is the correspondence between algebra and graph structure: a set TTT of n−1n-1n−1 arcs forming a tree determines a unique tree solution of A~f=b~\tilde{\mathbf{A}}\mathbf{f}=\tilde{\mathbf{b}}A~f=b~, fij=0f_{ij}=0fij​=0 off TTT (Theorem 7.3); connectedness makes A~\tilde{\mathbf{A}}A~ full-rank (Corollary 7.1); and a flow vector is a basic solution if and only if it is a tree solution (Theorem 7.4). The goal theorem is the integrality theorem (Theorem 7.5): for the uncapacitated problem on a connected graph, every basis matrix B\mathbf{B}B has an integer inverse B−1\mathbf{B}^{-1}B−1 (its determinant is ±1\pm 1±1 by the tree/lower-triangular argument), integer supplies make every basic solution integer, and integer costs make every dual basic solution integer — whence integer optimal primal and dual solutions exist whenever the optimal cost is finite (Corollary 7.2). This is the fountainhead of combinatorial integrality in linear optimization, feeding the max-flow min-cut mission that follows.

18 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: Shuze Chen

Introduction to Linear Optimization VIII: Sensitivity Analysis and Subgradients of the Optimal CostTextbook

How does the optimal cost of a linear program respond when the problem data change? Chapter 5 of Bertsimas-Tsitsiklis studies the standard form problem min⁡{c′x∣Ax=b, x≥0}\min\{c'x \mid Ax = b,\ x \ge 0\}min{c′x∣Ax=b, x≥0} (rows of AAA linearly independent) as the requirement vector bbb and the cost vector ccc vary. On the convex set S={b∣P(b)≠∅}S = \{b \mid P(b) \neq \emptyset\}S={b∣P(b)=∅} of feasible right-hand sides, and under the standing assumption that the dual feasible set is nonempty, the optimal cost F(b)F(b)F(b) is finite and convex (Theorem 5.1) — indeed F(b)=max⁡i(pi)′bF(b) = \max_{i} (p^i)'bF(b)=maxi​(pi)′b over the extreme points p1,…,pNp^1, \dots, p^Np1,…,pN of the dual feasible set, a piecewise linear convex function whose breakpoints are exactly where the dual optimum is non-unique. The capstone (Theorem 5.2) identifies the generalized gradients of FFF: if the primal at b∗b^*b∗ is feasible with finite optimal cost, then ppp is an optimal solution of the dual if and only if ppp is a subgradient of FFF at b∗b^*b∗ (Definition 5.1: F(b∗)+p′(b−b∗)≤F(b)F(b^*) + p'(b - b^*) \le F(b)F(b∗)+p′(b−b∗)≤F(b) for all b∈Sb \in Sb∈S) — the precise sense in which dual variables are marginal costs. Dually (Theorem 5.3), the set TTT of cost vectors with finite optimal cost is convex, the optimal cost G(c)G(c)G(c) is concave on TTT, and near any ccc with a unique primal optimum x∗x^*x∗, GGG is linear with gradient x∗x^*x∗. Local ranging (Section 5.1) and parametric programming (Section 5.5) are the procedural companions, folded into the design notes.

11 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: Shuze Chen

Introduction to Linear Optimization V: Duality TheoryTextbook

Every linear programming problem has a shadow. To the primal min⁡c′x\min c'xminc′x we associate the dual max⁡p′b\max p'bmaxp′b, whose variables price the primal constraints: one dual variable per primal constraint and one dual constraint per primal variable, with signs governed by the correspondence of Table 4.1. This mission formalizes §4.1–4.5 of Bertsimas–Tsitsiklis: the dual of a general-form linear program, the involution "the dual of the dual is the primal" (Theorem 4.1), and weak duality p′b≤c′xp'b \le c'xp′b≤c′x for any primal-feasible xxx and dual-feasible ppp (Theorem 4.3) with its two corollaries — an unbounded primal forces an infeasible dual (Corollary 4.1), and feasible x,px, px,p with p′b=c′xp'b = c'xp′b=c′x are automatically both optimal (Corollary 4.2). The goal theorem is strong duality (Theorem 4.4): if a linear programming problem has an optimal solution, so does its dual, and the respective optimal costs are equal — proved in the book by running the simplex method with the lexicographic pivoting rule of Mission IV on a standard-form transform. The statement is deliberately the book's attainment form: by Table 4.2 the primal and the dual can be simultaneously infeasible (Example 4.5), so an unguarded equality of optimal values is false. The mission closes with complementary slackness (Theorem 4.5): feasible xxx and ppp are simultaneously optimal if and only if pi(ai′x−bi)=0p_i(a_i'x - b_i) = 0pi​(ai′​x−bi​)=0 for all iii and (cj−p′Aj)xj=0(c_j - p'A_j)x_j = 0(cj​−p′Aj​)xj​=0 for all jjj — the certificate structure behind the dual simplex method and every LP optimality check.

12 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: Shuze Chen

Introduction to Linear Optimization IV: The Simplex MethodTextbook

How does one actually solve a linear program? Chapter 2 showed that if a standard-form problem min⁡c′x\min c'xminc′x subject to Ax=bAx = bAx=b, x≥0x \ge 0x≥0 has an optimal solution, it has an optimal basic feasible solution; the simplex method searches among basic feasible solutions, moving along edges of the feasible set in cost-reducing directions. This mission formalizes the mathematics of Chapter 3 of Bertsimas–Tsitsiklis: feasible directions, the reduced costs

cˉj=cj−cB′B−1Aj\bar{c}_j = c_j - c_B'B^{-1}A_jcˉj​=cj​−cB′​B−1Aj​

measuring the cost rate along the basic directions, the optimality conditions of Theorem 3.1 (cˉ≥0\bar{c} \ge 0cˉ≥0 implies optimality, and conversely at nondegenerate optima), the basis change of Theorem 3.2, and the pivot iteration itself — encoded as a predicate relating a basis/BFS pair to its successor, so that every theorem covers every pivoting rule. The goal theorem is Theorem 3.3: if the feasible set is nonempty and every basic feasible solution is nondegenerate, the simplex method terminates after a finite number of iterations, ending either with an optimal basis and an associated optimal basic feasible solution, or with a direction ddd satisfying Ad=0Ad = 0Ad=0, d≥0d \ge 0d≥0, c′d<0c'd < 0c′d<0 certifying optimal cost −∞-\infty−∞. The secondary capstone, Theorem 3.4, removes the nondegeneracy assumption: under the lexicographic pivoting rule every tableau row other than the zeroth stays lexicographically positive, the zeroth row strictly increases lexicographically, and the simplex method terminates on every problem — the anticycling guarantee that also supplies the optimal-basis existence used by the strong duality theorem of Mission V.

16 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: Shuze Chen

Introduction to Linear Optimization I: Polyhedra and Basic Feasible SolutionsTextbook

Every linear programming problem asks to minimize a linear cost c′xc'xc′x over a polyhedron — a set of the form P={x∈Rn∣Ax≥b}P = \{x \in \mathbb{R}^n \mid Ax \ge b\}P={x∈Rn∣Ax≥b}, or in standard form {x∣Ax=b, x≥0}\{x \mid Ax = b,\ x \ge 0\}{x∣Ax=b, x≥0}. Chapter 2 of Bertsimas–Tsitsiklis develops the geometry of these feasible sets, and its central achievement is making the intuitive notion of a "corner point" rigorous. There are three natural candidates: the extreme point — a point of PPP that cannot be written as a convex combination of two other points of PPP (purely geometric, representation-independent); the vertex — the unique minimizer of some linear cost c′yc'yc′y over PPP (geometric, via supporting hyperplanes); and the basic feasible solution — a feasible point at which nnn linearly independent constraints are active (algebraic, the object the simplex method actually computes with). This mission formalizes polyhedra, active constraints, vertices and basic (feasible) solutions, and proves the fundamental Theorem 2.3: for a nonempty polyhedron all three notions coincide. Around the capstone sit the supporting pillars: polyhedra are convex (Theorem 2.1), the characterization of points pinned down by nnn linearly independent active constraints (Theorem 2.2), finiteness of the set of basic solutions (Corollary 2.1), and the basis-column characterization of basic solutions in standard form (Theorem 2.4) — the combinatorial engine behind the simplex method of Chapter 3 and the root of the entire series.

9 thms3 active usersReviewed
PreviousPage 4 of 8Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me