Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

1094 missions

Missions

321–340 of 1094
OpenCompletedAll
CombinatoricsGraph TheoryLinear Optimization+1·Captain: mikedeng1

Cones of Matrices and Set-Functions and 0–1 Optimization III: The Defect of a Stable Set Inequality Bounds Its N-IndexResearch Paper

Motivation

Many 0–1 optimization problems can be written as linear programs over the convex hull of the 0–1 points of a polytope, but that hull usually has no manageable description by inequalities. Lift-and-project methods approximate it by a sequence of convex sets. Each set comes from a linear or semidefinite system in more variables, followed by a projection. Lovász and Schrijver introduced the operator NNN in Cones of matrices and set-functions and 0–1 optimization (SIAM J. Optim. 1(2), 1991). For any polytope KKK in the unit cube, nnn rounds of NNN reach the 0–1 hull (their Theorem 1.4), and each round keeps linear optimization tractable.

The stable set problem is the paper's main test case, and the question is quantitative: how many rounds does a given valid inequality need? Section 2.c answers it with a single number read off a linear program. Later work on the rank of lift-and-project hierarchies uses this measure: Balas, Ceria and Cornuéjols's lift-and-project cuts (1993), the Sherali–Adams and Lasserre comparisons of Laurent (2003), and the rank lower bounds for stable set relaxations in the decades since.

Setting

Let G=(V,E)G = (V, E)G=(V,E) be a finite graph with no isolated nodes, which is the paper's standing assumption for Section 2. For A⊆VA \subseteq VA⊆V let χA∈RV\chi^A \in \mathbb R^VχA∈RV be its incidence vector.

  • The stable set polytope is STAB(G)=conv⁡{χA:A stable}\mathrm{STAB}(G) = \operatorname{conv}\{\chi^A : A \text{ stable}\}STAB(G)=conv{χA:A stable}.
  • The fractional stable set polytope FRAC(G)\mathrm{FRAC}(G)FRAC(G) is the solution set of xi≥0x_i \ge 0xi​≥0 (i∈Vi \in Vi∈V) and xi+xj≤1x_i + x_j \le 1xi​+xj​≤1 (ij∈Eij \in Eij∈E).

Homogenize with a new coordinate x0x_0x0​. Let Q⊆RV∪{0}Q \subseteq \mathbb R^{V \cup\{0\}}Q⊆RV∪{0} be the cone spanned by the 0–1 vectors with x0=1x_0 = 1x0​=1, and let FR(G)\mathrm{FR}(G)FR(G) be the cone given by xi≥0x_i \ge 0xi​≥0 and xi+xj≤x0x_i + x_j \le x_0xi​+xj​≤x0​. For a convex cone KKK with polar cone K∗={u:uTx≥0 ∀x∈K}K^* = \{u : u^{\mathsf T}x \ge 0 \ \forall x \in K\}K∗={u:uTx≥0 ∀x∈K}, the matrix cone M(K)M(K)M(K) is the set of symmetric matrices YYY that satisfy two conditions:

  • yii=y0iy_{ii} = y_{0i}yii​=y0i​ for every iii;
  • uTYv≥0u^{\mathsf T} Y v \ge 0uTYv≥0 for all u∈K∗u \in K^*u∈K∗ and v∈Q∗v \in Q^*v∈Q∗.

The operator is N(K)={Ye0:Y∈M(K)}N(K) = \{Y e_0 : Y \in M(K)\}N(K)={Ye0​:Y∈M(K)}. Its iterates are N0(K)=KN^0(K) = KN0(K)=K and Nt(K)=N(Nt−1(K))N^t(K) = N(N^{t-1}(K))Nt(K)=N(Nt−1(K)). On the graph side, Nt(G)={x:(1x)∈Nt(FR(G))}N^t(G) = \{x : \binom1x \in N^t(\mathrm{FR}(G))\}Nt(G)={x:(x1​)∈Nt(FR(G))}, so N0(G)=FRAC(G)N^0(G) = \mathrm{FRAC}(G)N0(G)=FRAC(G) and STAB(G)⊆Nt(G)\mathrm{STAB}(G) \subseteq N^t(G)STAB(G)⊆Nt(G) for every ttt.

Let aTx≤ba^{\mathsf T}x \le baTx≤b be valid for STAB(G)\mathrm{STAB}(G)STAB(G), with a∈Z+Va \in \mathbb Z_+^Va∈Z+V​ and b∈Z+b \in \mathbb Z_+b∈Z+​. Two numbers are attached to it:

  • its N-index kkk is the least ttt such that aTx≤ba^{\mathsf T}x \le baTx≤b is valid for Nt(G)N^t(G)Nt(G);
  • its defect is r=2max⁡{aTx−b:x∈FRAC(G)}r = 2\max\{a^{\mathsf T}x - b : x \in \mathrm{FRAC}(G)\}r=2max{aTx−b:x∈FRAC(G)}, which is an integer.

For a node vvv with neighbourhood Γ(v)\Gamma(v)Γ(v), the deletion of vvv zeroes ava_vav​. The contraction of vvv zeroes aaa on {v}∪Γ(v)\{v\}\cup\Gamma(v){v}∪Γ(v) and lowers the right-hand side to b−avb - a_vb−av​.

Formalization targets

Goal: Theorem 2.13

For every such inequality with defect r≥0r \ge 0r≥0 and N-index kkk,

rb  ≤  k  ≤  r,\frac{r}{b} \;\le\; k \;\le\; r,br​≤k≤r,

formalized as r≤k br \le k\,br≤kb and k≤rk \le rk≤r. The goal holds for every graph without isolated nodes and every valid inequality with nonnegative integer coefficients and nonnegative defect.

Milestones

  1. Lemma 2.11. Let a≥0a \ge 0a≥0 and max⁡STABaTx<max⁡FRACaTx\max_{\mathrm{STAB}} a^{\mathsf T}x < \max_{\mathrm{FRAC}} a^{\mathsf T}xmaxSTAB​aTx<maxFRAC​aTx. Then the edges ijijij with yi+yj=1y_i + y_j = 1yi​+yj​=1 at every FRAC-maximizer yyy form a nonbipartite graph.
  2. Lemma 2.12. Under the same hypothesis, some node iii has yi=12y_i = \tfrac12yi​=21​ at every FRAC-maximizer yyy.
  3. The defect-decrease claim (proof of Theorem 2.13). For such a node iii, the deletion and the contraction of iii both have defect smaller than rrr.
  4. Lemma 2.2. If the deletion and the contraction of some node are valid for KKK, where K⊆FR(G)K \subseteq \mathrm{FR}(G)K⊆FR(G) is a closed convex cone, then aTx≤ba^{\mathsf T}x \le baTx≤b is valid for N(K)N(K)N(K).
  5. Lemma 2.7. 1k+21∈Nk(G)\frac{1}{k+2}\mathbb 1 \in N^k(G)k+21​1∈Nk(G) for every k≥0k \ge 0k≥0.

Further result

Corollary 2.8. Let GGG have nnn nodes, stability number α\alphaα and graph N-index kkk. Then

nα−2≤k≤n−α−1.\frac n\alpha - 2 \le k \le n - \alpha - 1.αn​−2≤k≤n−α−1.

Significance

Theorem 2.13 turns the N-index, which is defined through an infinite family of matrix-cone projections, into a quantity computable by one linear program over FRAC(G)\mathrm{FRAC}(G)FRAC(G). Some consequences:

  • Odd hole constraints have defect 1 and hence N-index 1.
  • An odd antihole on 2k+12k+12k+1 nodes has index exactly kkk; the paper notes that the lower bound is tight for odd antihole constraints.
  • Inequalities of large defect relative to their right-hand side need many rounds. With Lemma 2.7 this yields Corollary 2.8 and the unboundedness of the N-index of line graphs, the stable set side of Yannakakis's matching-polytope question.

The result is proved in the paper; the mission's work is to formalize it. Nothing on Prove2Me or in Mathlib covers stable set polytopes, the Lovász–Schrijver operator or its index, and no machine-checked version of Theorem 2.13 is known. A formal proof would give the first verified rank bound for a lift-and-project hierarchy. It would also build a reusable library for STAB\mathrm{STAB}STAB, FRAC\mathrm{FRAC}FRAC, half-integrality of FRAC\mathrm{FRAC}FRAC vertices, and the NNN operator.

Difficulty

The upper bound is an induction on the defect, and it needs several facts about FRAC(G)\mathrm{FRAC}(G)FRAC(G):

  • its vertices are half-integral;
  • the defect is therefore an integer;
  • a node 12\tfrac1221​ at every optimum exists, which is a statement about the whole optimal face and not about one optimal vertex.

The last is the heart of Lemmas 2.11 and 2.12. The induction also climbs through Nt(FR(G))N^t(\mathrm{FR}(G))Nt(FR(G)) for every ttt, so Lemma 2.2 must hold for an arbitrary closed convex cone inside FR(G)\mathrm{FR}(G)FR(G), not only for polytopes given by inequalities.

The lower bound is where the obvious argument fails. The printed proof tests aTx≤ba^{\mathsf T}x \le baTx≤b at 1k+21\frac1{k+2}\mathbb 1k+21​1 and obtains k≥aT1/b−2k \ge a^{\mathsf T}\mathbb 1/b - 2k≥aT1/b−2. That equals r/br/br/b only when r=aT1−2br = a^{\mathsf T}\mathbb 1 - 2br=aT1−2b, which Lemma 2.10 gives for facets alone. For a general valid inequality rrr can exceed aT1−2ba^{\mathsf T}\mathbb 1 - 2baT1−2b, so the uniform vector does not suffice. The theorem is stated, as printed, for every valid inequality, and a complete proof must supply the missing step.

Formalization scope

  • Coordinates of RV∪{0}\mathbb R^{V\cup\{0\}}RV∪{0} are indexed by Option V, with none as x0x_0x0​. Graphs are finite SimpleGraphs with the hypothesis that every node has a neighbour.
  • FR(G)\mathrm{FR}(G)FR(G) is defined by its two constraint families. This equals the cone over FRAC(G)\mathrm{FRAC}(G)FRAC(G) because there are no isolated nodes.
  • MMM is defined by condition (iii) itself.
  • The defect and the N-index are never suprema or infima. They are values rrr, kkk with IsGreatest and IsLeast hypotheses, so no default value such as sup⁡∅=0\sup\emptyset = 0sup∅=0 can make a statement vacuous.
  • Coefficients are natural numbers cast to R\mathbb RR. Lemmas 2.11–2.12 take real a≥0a \ge 0a≥0, as printed.
  • Deletion and contraction are zero-extended coefficient vectors on the same graph GGG, with defects taken over FRAC(G)\mathrm{FRAC}(G)FRAC(G). Subgraphs with isolated nodes never arise.
  • The goal adds the hypothesis r≥0r \ge 0r≥0. Without it the upper bound is false: for x1≤2x_1 \le 2x1​≤2 on one edge, r=−2r = -2r=−2 but k=0k = 0k=0. The paper's proof presumes it.
  • The lower bound is stated as r≤kbr \le kbr≤kb, which avoids Lean's r/0=0r/0 = 0r/0=0 convention.
  • Lemma 2.2 is stated for a closed convex cone K⊆FR(G)K \subseteq \mathrm{FR}(G)K⊆FR(G). The paper tacitly takes KKK closed, and the Section 1 lemma it rests on is false for non-closed cones. Its hypothesis "KKK contains STAB(G)\mathrm{STAB}(G)STAB(G)" is dropped, which makes the lemma stronger.
  • Corollary 2.8 uses the least kkk with Nk(G)=STAB(G)N^k(G) = \mathrm{STAB}(G)Nk(G)=STAB(G). This is equivalent to the paper's "largest N-index of a facet" and avoids a facet notion.
  • The goal is the two-sided bound for all graphs and inequalities. A version for one fixed graph, a version with a facet hypothesis, or "valid for Nr(G)N^r(G)Nr(G)" alone would each be a different, weaker theorem.
  • Not formalized: Lemma 2.10 (facets), Corollaries 2.6 and 2.9 (graph index via facets), and the polynomial-time results.

The work needs half-integrality of FRAC(G)\mathrm{FRAC}(G)FRAC(G), Lemma 1.3 of the paper (N(K)⊆(K∩Hi)+(K∩Gi)N(K) \subseteq (K\cap H_i) + (K \cap G_i)N(K)⊆(K∩Hi​)+(K∩Gi​)) and monotonicity of NNN. Each of these is reusable and welcome as a separate contribution.

Selected references

  • L. Lovász, A. Schrijver, Cones of matrices and set-functions and 0–1 optimization, SIAM Journal on Optimization 1(2) (1991) 166–190. https://doi.org/10.1137/0801013
  • M. Grötschel, L. Lovász, A. Schrijver, Geometric Algorithms and Combinatorial Optimization, Springer, 1988. https://doi.org/10.1007/978-3-642-97881-4
  • E. Balas, S. Ceria, G. Cornuéjols, A lift-and-project cutting plane algorithm for mixed 0–1 programs, Mathematical Programming 58 (1993) 295–324. https://doi.org/10.1007/BF01581273
  • M. Laurent, A comparison of the Sherali–Adams, Lovász–Schrijver, and Lasserre relaxations for 0–1 programming, Mathematics of Operations Research 28(3) (2003) 470–496. https://doi.org/10.1287/moor.28.3.470.16391
  • M. Yannakakis, Expressing combinatorial optimization problems by linear programs, Journal of Computer and System Sciences 43 (1991) 441–466. https://doi.org/10.1016/0022-0000(91)90024-Y
10 thms2 active usersReviewed
🏆Completed
CombinatoricsConvex OptimizationGraph Theory+1·Captain: mikedeng1

Cones of Matrices and Set-Functions and 0–1 Optimization IV: Clique, Odd Hole, Odd Wheel and Odd Antihole Constraints Hold after One Round of N₊Research Paper

Motivation

The stable set problem (find a largest, or maximum-weight, set of pairwise non-adjacent nodes in a graph) is NP-hard, and its linear programming relaxations have been studied since the 1970s as a test bed for polyhedral combinatorics. Lovász and Schrijver (SIAM J. Optim. 1991) introduced a general lift-and-project procedure for 0–1 programs: lift a relaxation to a cone of (n+1)×(n+1)(n+1)\times(n+1)(n+1)×(n+1) matrices, impose conditions every 0–1 solution satisfies, and project back. Its semidefinite version, the operator N+N_+N+​, is one of the first systematic uses of positive semidefinite constraints in combinatorial optimization, and it is the ancestor of the Sherali–Adams, Lasserre and sum-of-squares hierarchies used today in approximation algorithms and proof complexity.

For the stable set problem the paper measures the strength of the operators by an index: how many rounds are needed before a given valid inequality is implied. This mission formalizes the paper's result that one round of N+N_+N+​ already implies four of the classical families of facets of the stable set polytope.

Timeline:

  • 1975: Chvátal shows that the rank constraint of a connected α-critical graph defines a facet of its stable set polytope (Chvátal 1975); clique, odd hole and odd antihole constraints are special rank constraints.
  • 1981–88: Grötschel, Lovász and Schrijver show that the weighted stable set problem is solvable in polynomial time for perfect and hhh-perfect graphs, through the theta body TH(G)\mathrm{TH}(G)TH(G) (Grötschel, Lovász, Schrijver 1988).
  • 1991: Lovász and Schrijver define the operators NNN and N+N_+N+​ and prove Corollary 2.15: clique, odd hole, odd wheel and odd antihole constraints have N+N_+N+​-index 1.

Setting

Vectors live in Rn+1\mathbb R^{n+1}Rn+1 with coordinates x0,x1,…,xnx_0, x_1, \dots, x_nx0​,x1​,…,xn​. The polar cone of KKK is K∗={u:uTx≥0 ∀x∈K}K^* = \{u : u^{\mathsf T}x \ge 0 \ \forall x \in K\}K∗={u:uTx≥0 ∀x∈K}. Let QQQ be the cone spanned by the 0–1 vectors with x0=1x_0 = 1x0​=1. For a convex cone K⊆QK \subseteq QK⊆Q, the matrix cone M+(K)M_+(K)M+​(K) consists of the symmetric positive semidefinite matrices Y=(yij)Y = (y_{ij})Y=(yij​) with yii=y0iy_{ii} = y_{0i}yii​=y0i​ for 1≤i≤n1 \le i \le n1≤i≤n and uTYv≥0u^{\mathsf T}Yv \ge 0uTYv≥0 for all u∈K∗u \in K^*u∈K∗, v∈Q∗v \in Q^*v∈Q∗. The operator is

N+(K)={Ye0:Y∈M+(K)},N_+(K) = \{Ye_0 : Y \in M_+(K)\},N+​(K)={Ye0​:Y∈M+​(K)},

and N+0(K)=KN_+^0(K) = KN+0​(K)=K, N+t(K)=N+(N+t−1(K))N_+^t(K) = N_+(N_+^{t-1}(K))N+t​(K)=N+​(N+t−1​(K)).

Let G=(V,E)G = (V, E)G=(V,E) be a finite graph with no isolated nodes (the paper's standing assumption for Section 2). STAB(G)\mathrm{STAB}(G)STAB(G) is the convex hull of incidence vectors χA\chi^AχA of stable sets AAA. FRAC(G)\mathrm{FRAC}(G)FRAC(G) is the polytope given by xi≥0x_i \ge 0xi​≥0 and xi+xj≤1x_i + x_j \le 1xi​+xj​≤1 for ij∈Eij \in Eij∈E. FR(G)⊆RV∪{0}\mathrm{FR}(G) \subseteq \mathbb R^{V\cup\{0\}}FR(G)⊆RV∪{0} is the cone xi≥0x_i \ge 0xi​≥0, xi+xj≤x0x_i + x_j \le x_0xi​+xj​≤x0​. The relaxations are

N+r(G)={x∈RV:(1,x)∈N+r(FR(G))},N_+^r(G) = \{x \in \mathbb R^V : (1, x) \in N_+^r(\mathrm{FR}(G))\},N+r​(G)={x∈RV:(1,x)∈N+r​(FR(G))},

so N+0(G)=FRAC(G)⊇N+1(G)⊇⋯⊇STAB(G)N_+^0(G) = \mathrm{FRAC}(G) \supseteq N_+^1(G) \supseteq \dots \supseteq \mathrm{STAB}(G)N+0​(G)=FRAC(G)⊇N+1​(G)⊇⋯⊇STAB(G). The N+N_+N+​-index of an inequality aTx≤ba^{\mathsf T}x \le baTx≤b valid for STAB(G)\mathrm{STAB}(G)STAB(G) is the least rrr with aTx≤ba^{\mathsf T}x \le baTx≤b valid for N+r(G)N_+^r(G)N+r​(G).

The four constraint families are:

  • clique: ∑i∈Bxi≤1\sum_{i\in B} x_i \le 1∑i∈B​xi​≤1 for a clique BBB;
  • odd hole: ∑i∈Cxi≤12(∣C∣−1)\sum_{i\in C} x_i \le \frac12(|C|-1)∑i∈C​xi​≤21​(∣C∣−1) for CCC inducing a chordless odd cycle;
  • odd wheel: ∑i∈U∖{u0}xi+∣U∣−22xu0≤∣U∣−22\sum_{i\in U\setminus\{u_0\}} x_i + \frac{|U|-2}{2}x_{u_0} \le \frac{|U|-2}{2}∑i∈U∖{u0​}​xi​+2∣U∣−2​xu0​​≤2∣U∣−2​ for UUU inducing an odd wheel with center u0u_0u0​ (an odd hole plus a node adjacent to all of it);
  • odd antihole: ∑i∈Dxi≤2\sum_{i\in D} x_i \le 2∑i∈D​xi​≤2 for DDD inducing a chordless odd cycle in the complement of GGG.

The contraction of a node vvv turns aTx≤ba^{\mathsf T}x \le baTx≤b into the inequality with the coefficients of vvv and its neighbours removed and right-hand side b−avb - a_vb−av​.

Formalization targets

Goal: Corollary 2.15

For every graph GGG without isolated nodes, each clique constraint (clique of size at least 3), odd hole constraint, odd wheel constraint and odd antihole constraint has N+N_+N+​-index exactly 1:

aTx≤b holds on N+1(G)and fails somewhere on FRAC(G).a^{\mathsf T}x \le b \text{ holds on } N_+^1(G) \quad\text{and fails somewhere on } \mathrm{FRAC}(G).aTx≤b holds on N+1​(G)and fails somewhere on FRAC(G).

Milestones

  1. Lemma 1.5: for a closed convex cone K⊆QK \subseteq QK⊆Q and aaa with ai≤0a_i \le 0ai​≤0 (i≥1i \ge 1i≥1), a0≥0a_0 \ge 0a0​≥0, if aTx≥0a^{\mathsf T}x \ge 0aTx≥0 holds on K∩GiK \cap G_iK∩Gi​ (where Gi={xi=x0}G_i = \{x_i = x_0\}Gi​={xi​=x0​}) for every iii with ai<0a_i < 0ai​<0, then it holds on N+(K)N_+(K)N+​(K).
  2. Lemma 2.14: if aTx≤ba^{\mathsf T}x \le baTx≤b is valid for STAB(G)\mathrm{STAB}(G)STAB(G), and the contraction of every node with positive coefficient is valid for N+r(G)N_+^r(G)N+r​(G), then aTx≤ba^{\mathsf T}x \le baTx≤b is valid for N+r+1(G)N_+^{r+1}(G)N+r+1​(G).
  3. Bipartite support (Section 2.c): an inequality valid for STAB(G)\mathrm{STAB}(G)STAB(G) whose nonzero-coefficient nodes induce a bipartite graph is valid for FRAC(G)\mathrm{FRAC}(G)FRAC(G).
  4. Contraction property (Section 2.d): contracting a node with positive coefficient in any of the four constraints leaves positive-coefficient nodes that induce a bipartite subgraph.

Further result

Corollary 2.19 (first sentence): the N+N_+N+​-index of a STAB(G)\mathrm{STAB}(G)STAB(G)-valid inequality aTx≤ba^{\mathsf T}x \le baTx≤b is at most the independence number of the subgraph induced by the nodes with positive coefficient.

Significance

Corollary 2.15 shows that a single round of N+N_+N+​, a relaxation over which one can optimize in polynomial time for each fixed number of rounds (the paper's Theorem 2.1), captures all clique, odd hole, odd wheel and odd antihole inequalities at once. Consequently N+(G)=STAB(G)N_+(G) = \mathrm{STAB}(G)N+​(G)=STAB(G) for every hhh-perfect graph, in particular for perfect and ttt-perfect graphs. The result is a standard reference point when comparing lift-and-project hierarchies, and the lemmas behind it (Lemma 1.5 and Lemma 2.14) are the paper's general tools for bounding N+N_+N+​-ranks.

The theorem was proved in 1991. To our knowledge it has not been machine-checked: this mission would produce the first formal development of the Lovász–Schrijver N+N_+N+​ operator, its iterates, and the stable set relaxations STAB\mathrm{STAB}STAB, FRAC\mathrm{FRAC}FRAC, FR\mathrm{FR}FR in Lean.

Difficulty

The lower bound (each constraint fails on FRAC(G)\mathrm{FRAC}(G)FRAC(G)) is a direct computation; the upper bound is where the work lies. The obvious approach, deriving each constraint from the linear conditions on the lifted matrix YYY alone, cannot succeed: those conditions define the linear operator NNN, and the goal is specifically about what positive semidefiniteness adds. The general lemmas are stated for arbitrary cones and require a working theory of polar cones and closedness in Rn+1\mathbb R^{n+1}Rn+1, including closedness of the iterates N+r(FR(G))N_+^r(\mathrm{FR}(G))N+r​(FR(G)), which the paper uses without comment. The graph-theoretic steps require facts about the stable set and fractional stable set polytopes of bipartite graphs and a careful case analysis of chordless odd cycles in a graph and in its complement, none of which is in Mathlib.

Formalization scope

  • Coordinates of Rn+1\mathbb R^{n+1}Rn+1 are indexed by Option ι, with none the special coordinate x0x_0x0​. For graphs, ι := V.
  • MMM is defined by condition (iii) with polar cones, not by its reformulations. Only M+M_+M+​, N+N_+N+​ and their iterates are defined; the linear operator NNN is not used.
  • Lemma 1.5 carries the hypothesis that KKK is closed. The paper takes it tacitly (all its cones are polyhedral); without it the lemma fails, since N+(K)N_+(K)N+​(K) depends only on the closure of KKK.
  • FR(G)\mathrm{FR}(G)FR(G) is defined by its constraints, which agree with the paper's "cone spanned by the vectors (1,x)(1,x)(1,x), x∈FRAC(G)x \in \mathrm{FRAC}(G)x∈FRAC(G)" because GGG has no isolated nodes. Every graph statement carries the no-isolated-nodes hypothesis.
  • Contraction is written on the same graph GGG as a zeroed coefficient vector, rather than on the subgraph G−Γ(v)−vG - \Gamma(v) - vG−Γ(v)−v.
  • Odd holes include triangles; odd antiholes have at least 5 nodes (a 3-node "antihole" is a stable set, for which the constraint is false); odd wheels are an odd hole plus a center adjacent to all its nodes.
  • Clique constraints in the goal are restricted to cliques with at least 3 nodes: cliques of size 1 or 2 give inequalities already valid on FRAC(G)\mathrm{FRAC}(G)FRAC(G), of index 0.
  • "N+N_+N+​-index at most rrr" is stated as validity on N+r(G)N_+^r(G)N+r​(G); the index itself is stated with IsLeast, never with an infimum that would default to 0 on an empty set.

A formalization asserting only validity on N+1(G)N_+^1(G)N+1​(G), or only for one fixed graph, would be weaker than the paper's statement and is ruled out: the goal states the exact index for all graphs without isolated nodes and all four families.

Not formalized: the linear operator NNN and its results, the polynomial-time separation results (Theorem 2.1, Corollaries 2.20–2.21), the theta-body results (Lemma 2.17, Corollary 2.18), graph indices (Corollary 2.16), and the second sentence of Corollary 2.19.

Reusable infrastructure includes the polar cone, the matrix cone M+M_+M+​ and the N+N_+N+​ operator (usable for any 0–1 program), the polytopes STAB\mathrm{STAB}STAB and FRAC\mathrm{FRAC}FRAC, and odd holes, antiholes and wheels as finite-set predicates. Contributions proving closedness of the iterates, the integrality of FRAC\mathrm{FRAC}FRAC for bipartite graphs, or the MMM-cone reformulations (iii′)–(iii″) are welcome.

Selected references

  • L. Lovász and A. Schrijver, Cones of matrices and set-functions and 0–1 optimization, SIAM Journal on Optimization 1(2), 1991, 166–190. https://doi.org/10.1137/0801013
  • M. Grötschel, L. Lovász and A. Schrijver, Geometric Algorithms and Combinatorial Optimization, Springer, 1988 (2nd ed. 1993). https://doi.org/10.1007/978-3-642-78240-4
  • V. Chvátal, On certain polytopes associated with graphs, Journal of Combinatorial Theory B 18, 1975, 138–154. https://doi.org/10.1016/0095-8956(75)90041-6
8 thms2 active usersReviewed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

Graph Minors. V. Excluding a Planar Graph: Bounded Tree-Width without a Planar MinorResearch Paper

Motivation

Tree-width measures how closely a graph resembles a tree. Graphs of bounded tree-width admit dynamic-programming algorithms for problems that are NP-hard in general (colouring, Hamiltonicity, and every property expressible in monadic second-order logic, by Courcelle's theorem), which is why the parameter is central to parameterized complexity and to combinatorial optimization on sparse networks. The question this mission addresses is structural: which excluded substructures force bounded tree-width?

The answer is the Excluded Grid Theorem of Robertson and Seymour: excluding a fixed graph HHH as a minor bounds the tree-width if and only if HHH is planar. The "only if" direction is easy, since grids are planar and have unbounded tree-width. The "if" direction is the content of Graph Minors. V. Excluding a Planar Graph (J. Combin. Theory Ser. B 41 (1986) 92–114). It is a cornerstone of the Graph Minors series that culminates in the Robertson–Seymour theorem (graphs are well-quasi-ordered by the minor relation), and it underlies polynomial-time minor testing for planar HHH (Graph Minors XIII) and the Erdős–Pósa-type results of Sect. 8 of the same paper.

Timeline. Robertson and Seymour, Graph Minors V (1986): tree-width at most an explicit, iterated-exponential function of the grid size. Robertson, Seymour and Thomas, Quickly excluding a planar graph (JCTB 62, 1994): bound 2O(θ5)2^{O(\theta^5)}2O(θ5) for the θ\thetaθ-grid. Chekuri and Chuzhoy (J. ACM 2016): the first polynomial bound. Chuzhoy and Tan (JCTB 2021): O(θ9 polylog θ)O(\theta^9\,\mathrm{polylog}\,\theta)O(θ9polylogθ).

Setting

Graphs are finite. A graph HHH is a minor of GGG if HHH can be obtained by contraction from a subgraph of GGG; equivalently, there are nonempty, pairwise disjoint vertex sets β(w)⊆V(G)\beta(w)\subseteq V(G)β(w)⊆V(G), one per vertex www of HHH, each inducing a connected subgraph, such that every edge ababab of HHH is matched by an edge of GGG between β(a)\beta(a)β(a) and β(b)\beta(b)β(b).

A tree-decomposition of GGG is a tree TTT together with bags Xt⊆V(G)X_t\subseteq V(G)Xt​⊆V(G) (t∈V(T)t\in V(T)t∈V(T)) such that every vertex lies in some bag, both ends of every edge lie in a common bag, and Xt∩Xt′′⊆Xt′X_t\cap X_{t''}\subseteq X_{t'}Xt​∩Xt′′​⊆Xt′​ whenever t′t't′ lies on the path of TTT between ttt and t′′t''t′′. Its width is max⁡t(∣Xt∣−1)\max_t(|X_t|-1)maxt​(∣Xt​∣−1), and the tree-width tw(G)\mathrm{tw}(G)tw(G) is the least width of a tree-decomposition of GGG.

The θ\thetaθ-grid has vertex set {vij:1≤i,j≤θ}\{v_{ij}: 1\le i,j\le\theta\}{vij​:1≤i,j≤θ}, with vijv_{ij}vij​ adjacent to vi′j′v_{i'j'}vi′j′​ exactly when ∣i−i′∣+∣j−j′∣=1|i-i'|+|j-j'|=1∣i−i′∣+∣j−j′∣=1. For even θ≥6\theta\ge 6θ≥6, Fθ\mathcal F_\thetaFθ​ is the class of graphs with no minor isomorphic to the θ\thetaθ-grid. Every planar graph HHH is a minor of some even grid of size at least 6; θ(H)\theta(H)θ(H) denotes the least such size.

The paper fixes explicit parameters. For k≥2k\ge 2k≥2: α(2,n)=n+1\alpha(2,n)=n+1α(2,n)=n+1 and α(k,n)=2nθ4+α(k−1,2nθ4+n+1)\alpha(k,n)=2^{n\theta^4}+\alpha(k-1,2^{n\theta^4}+n+1)α(k,n)=2nθ4+α(k−1,2nθ4+n+1). Then θ1=2α(θ2/2,θ2/2)\theta_1=2\alpha(\theta^2/2,\theta^2/2)θ1​=2α(θ2/2,θ2/2); ϕθ1=θ2/2\phi_{\theta_1}=\theta^2/2ϕθ1​​=θ2/2 and ϕk=ϕk+12ϕk+1θ2\phi_k=\phi_{k+1}2^{\phi_{k+1}\theta^2}ϕk​=ϕk+1​2ϕk+1​θ2; θ2=ϕ0+2ϕ1+⋯+2ϕθ1−1+ϕθ1\theta_2=\phi_0+2\phi_1+\dots+2\phi_{\theta_1-1}+\phi_{\theta_1}θ2​=ϕ0​+2ϕ1​+⋯+2ϕθ1​−1​+ϕθ1​​; θ3=(θ2/2)θ2−1\theta_3=(\theta^2/2)^{\theta_2-1}θ3​=(θ2/2)θ2​−1; θ4=θ2(θ3θ2)+12θ2(θ3θ2/2)\theta_4=\theta_2\binom{\theta_3}{\theta_2}+\tfrac12\theta^2\binom{\theta_3}{\theta^2/2}θ4​=θ2​(θ2​θ3​​)+21​θ2(θ2/2θ3​​); θ5=(θ2/2)θ4−1\theta_5=(\theta^2/2)^{\theta_4-1}θ5​=(θ2/2)θ4​−1; θ6=θ3(θ5θ4)+12θ2(θ5θ2/2)\theta_6=\theta_3\binom{\theta_5}{\theta_4}+\tfrac12\theta^2\binom{\theta_5}{\theta^2/2}θ6​=θ3​(θ4​θ5​​)+21​θ2(θ2/2θ5​​); θ7=α(θ5,θ6)\theta_7=\alpha(\theta_5,\theta_6)θ7​=α(θ5​,θ6​); θ8=3θ5(3θ5−1)/4\theta_8=3\theta_5(3^{\theta_5}-1)/4θ8​=3θ5​(3θ5​−1)/4; θ9=θ7(θ8+1)+1\theta_9=\theta_7(\theta_8+1)+1θ9​=θ7​(θ8​+1)+1.

Two auxiliary structures carry the argument. An (m,n)(m,n)(m,n)-web is a pair of families of paths (A1,…,Am)(A_1,\dots,A_m)(A1​,…,Am​), (B1,…,Bn)(B_1,\dots,B_n)(B1​,…,Bn​), each family vertex-disjoint, every AiA_iAi​ meeting every BjB_jBj​, and all m+nm+nm+n paths pairwise edge-disjoint. An (m,n)(m,n)(m,n)-mesh is the same with arbitrary connected subgraphs in place of paths and without edge-disjointness.

Formalization targets

Goal: (2.1)

For every finite planar graph HHH and every finite graph GGG,

H⪯̸G  ⟹  tw(G)≤θ9(θ(H)).H \not\preceq G \;\Longrightarrow\; \mathrm{tw}(G)\le\theta_9\bigl(\theta(H)\bigr).H⪯G⟹tw(G)≤θ9​(θ(H)).

Principal theorem: (7.3)

For even θ≥6\theta\ge 6θ≥6 and G∈FθG\in\mathcal F_\thetaG∈Fθ​,

tw(G)≤θ9.\mathrm{tw}(G)\le\theta_9.tw(G)≤θ9​.

Intermediate targets

  • Sect. 2: every planar graph is a minor of some even θ\thetaθ-grid, θ≥6\theta\ge 6θ≥6.
  • (3.2): nnn disjoint connected subgraphs meeting each of V1,…,VkV_1,\dots,V_kV1​,…,Vk​, or a hitting set of size <α(k,n)<\alpha(k,n)<α(k,n).
  • (4.1), (4.2), (4.4), (4.5), (4.6): no (θ2,θ2)(\theta_2,\theta_2)(θ2​,θ2​)-web in G∈FθG\in\mathcal F_\thetaG∈Fθ​.
  • (5.1), (5.2), (5.3): no (θ5,θ6)(\theta_5,\theta_6)(θ5​,θ6​)-mesh in G∈FθG\in\mathcal F_\thetaG∈Fθ​.
  • (6.2), (6.3), (6.4): weighted and unweighted balanced-cut lemmas valid for all graphs.
  • (7.1), (7.2): separations of order ≤θ7\le\theta_7≤θ7​ splitting V(G)V(G)V(G), or any X⊆V(G)X\subseteq V(G)X⊆V(G), in ratio 1−θ8−11-\theta_8^{-1}1−θ8−1​.

Significance

The theorem converts a qualitative exclusion (no HHH minor) into a quantitative width bound, and it is the entry point of the structure theory of minor-closed classes: every minor-closed class excluding a planar graph has bounded tree-width, and hence all MSO-definable problems on it are solvable in linear time. It is used in the proof of the graph minor theorem, in minor testing, and in the Erdős–Pósa property for planar minors (Sect. 8 of the paper).

The result is proved and classical; to our knowledge it has not been machine-checked in any proof assistant, and Mathlib has no graph minors, tree-decompositions or Menger's theorem. A formalization produces reusable definitions (branch-set minors, tree-decompositions, separations, grids) and a checked proof of the paper's explicit bound. The goal is stated with the paper's constant θ9\theta_9θ9​, not an optimized one; later improvements are stronger variants, not replacements.

Difficulty

The obvious attempt, building a tree-decomposition greedily from small separations, fails because nothing forces small balanced separations to exist. The whole argument supplies them: a graph without a large grid minor has no large mesh (5.3), and a graph with no large mesh has a balanced separation of bounded order (7.1). The step from no grid to no mesh goes through webs and spiders (Sect. 4) and relies on two results from Graph Minors I ((3.1) and (4.3) of the paper, cited without proof), which themselves depend on Menger's theorem. The balanced-cut lemmas (6.2)–(6.4) rest on Tutte's ordering of 2-connected graphs. None of this infrastructure exists in Mathlib.

Formalization scope

Graphs are Mathlib SimpleGraphs on finite types (Fintype V, DecidableEq V). The paper allows loops and multiple edges; for GGG this changes nothing, since every notion used depends only on adjacency, and for HHH in the goal it specializes the theorem to simple planar graphs. Minors use the branch-set model (IsMinor); planarity (IsPlanar) is the existence of a crossing-free drawing in R2\mathbb R^2R2, mirroring the platform's FourColor.IsPlanar. Tree-width is not defined as an infimum; "tree-width at most www" (TreewidthLE) is the existence of a tree-decomposition with all bags of size ≤w+1\le w+1≤w+1 over a finite tree. θ(H)\theta(H)θ(H) enters the goal as a hypothesis IsLeast {t | Even t ∧ 6 ≤ t ∧ IsMinor H (grid t)} θ, which is satisfiable for every planar HHH by the Sect. 2 milestone, so the goal is not vacuous. Every statement of Sects. 3–7 that mentions θ\thetaθ carries the standing assumption "θ\thetaθ even, θ≥6\theta\ge 6θ≥6" as hypotheses. Rational bounds such as (1−θ8−1)∣V(G)∣(1-\theta_8^{-1})|V(G)|(1−θ8−1​)∣V(G)∣ and 2(3k−1)−1∣V(G)∣2(3^k-1)^{-1}|V(G)|2(3k−1)−1∣V(G)∣ are compared in Q\mathbb QQ.

Two printed statements are corrected. (4.5) is printed for 0≤k<θ20\le k<\theta_20≤k<θ2​ and is stated for 0≤k<θ10\le k<\theta_10≤k<θ1​, the only range on which ϕk+1,ψk+1\phi_{k+1},\psi_{k+1}ϕk+1​,ψk+1​ are defined. (5.1) is false as printed for p=1p=1p=1, q≥1q\ge 1q≥1, so it carries the hypothesis "p=1p=1p=1 implies q=0q=0q=0"; the paper uses it only with p=θ2/2p=\theta^2/2p=θ2/2.

Needed infrastructure, reusable well beyond this mission: Menger's theorem, the Graph Minors I linkage results, Tutte's ordering of 2-connected graphs, and a library of lemmas for minors and tree-decompositions. Proofs of any milestone, of the cited results as separate theorems, and of basic API for the definitions are welcome.

Selected references

  • N. Robertson, P. D. Seymour, Graph Minors. V. Excluding a Planar Graph, J. Combin. Theory Ser. B 41 (1986) 92–114. https://doi.org/10.1016/0095-8956(86)90030-4
  • N. Robertson, P. D. Seymour, Graph Minors. I. Excluding a Forest, J. Combin. Theory Ser. B 35 (1983) 39–61. https://doi.org/10.1016/0095-8956(83)90079-5
  • N. Robertson, P. D. Seymour, R. Thomas, Quickly Excluding a Planar Graph, J. Combin. Theory Ser. B 62 (1994) 323–348. https://doi.org/10.1006/jctb.1994.1073
  • C. Chekuri, J. Chuzhoy, Polynomial Bounds for the Grid-Minor Theorem, J. ACM 63 (2016), Art. 40. https://doi.org/10.1145/2820609
  • J. Chuzhoy, Z. Tan, Towards Tight(er) Bounds for the Excluded Grid Theorem, J. Combin. Theory Ser. B 146 (2021) 219–265. https://doi.org/10.1016/j.jctb.2020.09.010
  • B. Courcelle, The Monadic Second-Order Logic of Graphs. I. Recognizable Sets of Finite Graphs, Information and Computation 85 (1990) 12–75. https://doi.org/10.1016/0890-5401(90)90043-H
28 thms1 active userReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming I: Intersection Cuts and Duality for Disjunctive ProgramsTextbook

Motivation

Linear programming duality is one of the load-bearing facts of optimization: every feasible linear program has a dual whose value matches the primal's, and this correspondence drives the simplex method's stopping criterion, sensitivity analysis, and most complexity results for polyhedral problems. Integer and mixed-integer programs have no such duality theorem in general — the feasible region of a mixed-integer program is not convex, and the entire apparatus of linear programming duality is built on convexity.

Disjunctive programming, introduced by Egon Balas in the early 1970s, closes part of this gap. A disjunctive set is a union of finitely many polyhedra rather than a single polyhedron — the natural convex-analytic shadow of the "either/or" logical structure that integer variables encode (an integer variable's feasible region is a finite union of half-open pieces, hence a disjunction of the linear constraints that pin it to each value). Balas's insight was that disjunctive programs — linear programs whose feasible region is such a union — admit a strong duality theorem of their own, generalizing the linear-programming case rather than replacing it. This mission formalizes that theorem (Theorem 1.5 of Balas, Disjunctive Programming, Springer 2018) together with the two results the same chapter builds around it: the founding construction of the field, the intersection cut (Theorem 1.1, circa 1970), and the disjunctive generalization of Farkas' Lemma (Theorem 1.2), which characterizes every valid inequality — hence every cutting plane — for a disjunctive set.

Setting

Fix a finite index set QQQ. For each h∈Qh \in Qh∈Q, let AhA_hAh​ be a real mh×nm_h \times nmh​×n matrix and bh∈Rmhb_h \in \mathbb{R}^{m_h}bh​∈Rmh​, and set Ph:={x∈Rn:Ahx≥bh}P_h := \{x \in \mathbb{R}^n : A_h x \ge b_h\}Ph​:={x∈Rn:Ah​x≥bh​}. The union F:=⋃h∈QPhF := \bigcup_{h \in Q} P_hF:=⋃h∈Q​Ph​ is a disjunctive set: any (linear) system of inequalities combined with the logical connectives "and", "or", "not" reduces, via its disjunctive normal form, to a set of exactly this shape. Because a union of convex sets need not be convex, FFF is generally nonconvex even though each PhP_hPh​ is a polyhedron.

A disjunctive program minimizes a linear objective over such a union:

(DP)z0=min⁡{cx:x∈⋃h∈QXh},Xh:={x:Ahx≥bh, x≥0}.(DP)\qquad z_0 = \min\Big\{ c x : x \in \textstyle\bigcup_{h \in Q} X_h \Big\}, \qquad X_h := \{x : A_h x \ge b_h,\ x \ge 0\}.(DP)z0​=min{cx:x∈⋃h∈Q​Xh​},Xh​:={x:Ah​x≥bh​, x≥0}.

Its dual (DD)(DD)(DD) pairs a scalar www with one dual multiplier vector uhu_huh​ per disjunct, requiring w≤uhbhw \le u_h b_hw≤uh​bh​ and uhAh≤cu_h A_h \le cuh​Ah​≤c, uh≥0u_h \ge 0uh​≥0, simultaneously for every h∈Qh \in Qh∈Q, and maximizes www. Write Q∗:={h∈Q:Xh≠∅}Q^* := \{h \in Q : X_h \ne \emptyset\}Q∗:={h∈Q:Xh​=∅} for the disjuncts whose primal system is feasible, and Q∗∗:={h∈Q:Uh≠∅}Q^{**} := \{h \in Q : U_h \ne \emptyset\}Q∗∗:={h∈Q:Uh​=∅} (with Uh:={uh≥0:uhAh≤c}U_h := \{u_h \ge 0 : u_h A_h \le c\}Uh​:={uh​≥0:uh​Ah​≤c}) for those whose dual system is feasible.

The theorems below also use two objects from the origin of the subject (§1.2): given a basic solution xˉ\bar xxˉ of a linear program's optimal simplex tableau, with basic index set III and nonbasic index set JJJ, the tableau's coefficients aˉij\bar a_{ij}aˉij​ (i∈Ii \in Ii∈I, j∈Jj \in Jj∈J) determine, for each nonbasic jjj, an extreme ray direction rjr^jrj of the associated LP cone. A convex set SSS is PIP_IPI​-free at xˉ\bar xxˉ if xˉ\bar xxˉ lies in the interior of SSS and that interior contains no point of the mixed-integer feasible set PIP_IPI​.

Formalization targets

Theorem 1.1 — the intersection cut

λj∗:=max⁡{λj≥0:xˉ+λjrj∈S},∑j∈J1λj∗ xj≥1.\lambda^*_j := \max\{\lambda_j \ge 0 : \bar x + \lambda_j r^j \in S\}, \qquad \sum_{j \in J} \frac{1}{\lambda^*_j}\, x_j \ge 1.λj∗​:=max{λj​≥0:xˉ+λj​rj∈S},j∈J∑​λj∗​1​xj​≥1.

The displayed inequality cuts off xˉ\bar xxˉ but excludes no point of PIP_IPI​, for any PIP_IPI​-free convex set SSS containing xˉ\bar xxˉ in its interior.

Theorem 1.2 — Farkas' Lemma for Disjunctive Sets

(∀x∈F, αx≥α0)  ⟺  (∀h∈Q∗, ∃ uh≥0, uhAh=α, α0≤uhbh).\big(\forall x \in F,\ \alpha x \ge \alpha_0\big) \iff \big(\forall h \in Q^*,\ \exists\, u_h \ge 0,\ u_h A_h = \alpha,\ \alpha_0 \le u_h b_h\big).(∀x∈F, αx≥α0​)⟺(∀h∈Q∗, ∃uh​≥0, uh​Ah​=α, α0​≤uh​bh​).

Theorem 1.5 (goal) — duality for disjunctive programs

Under the Regularity Condition — (Q∗≠∅(Q^* \ne \emptyset(Q∗=∅ and Q∖Q∗∗≠∅)⇒Q∗∖Q∗∗≠∅Q \setminus Q^{**} \ne \emptyset) \Rightarrow Q^* \setminus Q^{**} \ne \emptysetQ∖Q∗∗=∅)⇒Q∗∖Q∗∗=∅ — exactly one of:

  1. both (DP)(DP)(DP) and (DD)(DD)(DD) are feasible, each attains an optimum, and z0=w0z_0 = w_0z0​=w0​; or
  2. one of the two is infeasible, and the other is infeasible or has no finite optimum.

This is the weakest faithful statement of the theorem: it asserts only the shape of the dichotomy established by Balas, not any strengthened or specialized form of it.

Corollary 1.6 — necessity of the Regularity Condition

If the Regularity Condition fails, (DP)(DP)(DP) is feasible, and (DD)(DD)(DD) is infeasible, then (DP)(DP)(DP) still has a finite minimum — exhibiting the duality gap that opens up once the condition is dropped.

Significance

The results themselves. Theorem 1.5 is the mission-critical fact that makes disjunctive programming a genuine extension of linear programming rather than an unrelated combinatorial device: every LP-duality-based algorithmic tool (bounding, sensitivity, complementary-slackness optimality certificates) has a disjunctive-programming counterpart because of this theorem. Theorem 1.1's intersection cut is the historical seed of an entire branch of integer-programming algorithms — lift-and-project cuts, mixed-integer Gomory cuts, and the split closure (later missions of this series) all specialize or generalize it. Theorem 1.2 is the structural fact that makes cutting-plane generation for disjunctive sets tractable at all: every valid inequality decomposes into per-disjunct Farkas certificates.

Formalizing it. None of these results, nor the union-of-polyhedra machinery they are stated over, exist on the platform prior to this mission: the platform's existing Farkas' Lemma and linear-programming strong duality theorems (SmaleNinth.farkas_lemma, SmaleNinth.lp_strong_duality) are the ordinary single-polyhedron statements, which is exactly the special case ∣Q∣=1|Q|=1∣Q∣=1 of the theorems formalized here — genuinely different statements, not restatements. This mission is a from-scratch formalization of the disjunctive generalization, including the vocabulary (disjunctive sets, the paired primal/dual index sets Q∗,Q∗∗Q^*, Q^{**}Q∗,Q∗∗, the Regularity Condition) that the rest of the fifteen-mission Balas series builds on.

Difficulty

The obvious first attempt collapses the disjunctive dual (DD)(DD)(DD) to ∣Q∣|Q|∣Q∣ separate ordinary LP duals, one per disjunct, and tries to combine their individual strong-duality statements. This fails: (DD)(DD)(DD) couples all disjuncts through the single shared scalar www, which must simultaneously satisfy w≤uhbhw \le u_h b_hw≤uh​bh​ for every h∈Qh \in Qh∈Q at once, not disjunct-by-disjunct. The Regularity Condition exists precisely because this coupling can break down — Balas's own example (a two-term disjunctive program with an infeasible dual but a feasible, bounded primal) shows that without the condition, situation (2) of the dichotomy can fail: the primal can have a finite optimum with no matching dual optimum. Any formalization that omits the Regularity Condition, or weakens it to an informal restriction like "nondegenerate", either proves a false statement or proves nothing (a vacuous hypothesis), which Corollary 1.6 exists specifically to rule out.

Formalization scope

All three theorems are stated over a finite index set Q : Type* with [Fintype Q], real matrices Matrix (Fin (m h)) (Fin n) ℝ with row-dimension m : Q → ℕ allowed to depend on h (the book never assumes a common row count across disjuncts), and vectors in Fin n → ℝ. Poly, PolyNonneg, and DualPoly are the plain, nonnegative-orthant, and dual polyhedral systems respectively; FeasibleIndices and RegularityCondition pin Q∗Q^*Q∗/Q∗∗Q^{**}Q∗∗ and the Regularity Condition exactly as stated on p. 13. "No finite optimum" is formalized via UnboundedBelowOn / UnboundedAboveOn: nonempty (feasible) together with no finite bound on the objective, matching Balas's case (2), which explicitly distinguishes infeasibility from unboundedness.

A trivializing formalization is ruled out explicitly: fixing ∣Q∣=1|Q| = 1∣Q∣=1 collapses Theorem 1.5 to ordinary LP duality (already on the platform) and Theorem 1.2 to ordinary Farkas' Lemma, so both theorems are stated for a generic finite Q, never specialized. Theorem 1.5's "exactly one of" dichotomy is formalized as a logical Xor of the two situations, not a weaker Or, since the book asserts mutual exclusivity, not merely that one holds.

The intersection-cut theorem (1.1) is formalized over a generic finite index type ι standing for the full set of structural and surplus variables, with I J : Finset ι the basic/nonbasic partition; a complete development would additionally need the simplex-tableau apparatus connecting ι, I, J, and abar to an actual linear program, which lies outside this mission and belongs instead to the tableau-focused later missions of the series (SimplexTableau, RayCGLP). The extremeRay and PIFree definitions introduced here are local to this mission and are restated, not imported, by later missions that need related vocabulary — per the series' convention that a draft mission cannot import another draft mission's definitions.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 1.
  • E. Balas, Intersection cuts — a new type of cutting planes for integer programming, Operations Research 19 (1971), 19–39. (Theorem 1.1's origin, cited in the text as [4].)
  • E. Balas, Disjunctive programming, Annals of Discrete Mathematics 5 (1979), 3–51. (Cited in the text as [9], the origin of Theorem 1.5.)
9 thms3 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming II: The Convex Hull of a Disjunctive Set via Lifting and ProjectionTextbook

Motivation

Convexity is what makes optimization tractable: a linear program's feasible region is convex, and this single fact underwrites the simplex method, LP duality, and everything built on top of them. Integer and disjunctive programs have no such luck — their feasible regions are unions of polyhedra, and a union of convex sets is generally not convex. If the convex hull of such a union could always be described compactly, integer programming would reduce to linear programming: optimize the same linear objective over the hull instead of the union, and any optimal vertex of the hull is automatically integral. The obstacle has always been that the convex hull of a union of polyhedra in Rn\mathbb{R}^nRn, described directly by its facets in Rn\mathbb{R}^nRn, typically needs exponentially many inequalities.

Balas's Theorem 2.1, proved in the 1970s and presented here as Chapter 2 of Disjunctive Programming (Balas, Springer 2018), breaks this exponential barrier by changing where the description lives. Rather than writing down the hull's facets in Rn\mathbb{R}^nRn, Theorem 2.1 lifts the problem to a higher-dimensional space — one auxiliary copy of Rn\mathbb{R}^nRn per polyhedron in the union — where the hull becomes the projection of a single, explicitly given polyhedron whose size grows only linearly with the number of polyhedra. This "extended formulation" technique, born here, became one of the central tools of modern integer programming and combinatorial optimization: representing a hard polytope as the projection of an easy one in higher dimension underlies, for instance, the polynomial-size extended formulations known for many combinatorial polytopes.

Setting

Fix a finite index set QQQ. For h∈Qh \in Qh∈Q, let AhA_hAh​ be a real matrix and bhb_hbh​ a vector of matching row dimension, and set Ph:={x∈Rn:Ahx≥bh}P_h := \{x \in \mathbb{R}^n : A_h x \ge b_h\}Ph​:={x∈Rn:Ah​x≥bh​}. The union F:=⋃h∈QPhF := \bigcup_{h \in Q} P_hF:=⋃h∈Q​Ph​ is the disjunctive set. Write Q∗:={h∈Q:Ph≠∅}Q^* := \{h \in Q : P_h \ne \emptyset\}Q∗:={h∈Q:Ph​=∅} for the feasible disjuncts.

The recession cone of a nonempty polyhedron PhP_hPh​ is Ch:={y:Ahy≥0}C_h := \{y : A_h y \ge 0\}Ch​:={y:Ah​y≥0}: the set of directions along which one can travel indefinitely from any point of PhP_hPh​ while remaining in PhP_hPh​. For a subset M⊆QM \subseteq QM⊆Q and sets ShS_hSh​ (h∈Mh \in Mh∈M), the (finite) Minkowski sum ∑h∈MSh\sum_{h \in M} S_h∑h∈M​Sh​ is {x:x=∑h∈Myh for some yh∈Sh}\{x : x = \sum_{h \in M} y^h \text{ for some } y^h \in S_h\}{x:x=∑h∈M​yh for some yh∈Sh​}. The maximal indices Q∗∗⊆Q∗Q^{**} \subseteq Q^*Q∗∗⊆Q∗ are the feasible disjuncts whose polyhedron is not contained in any other feasible disjunct's polyhedron.

Given a set S⊆Rn×βS \subseteq \mathbb{R}^n \times \betaS⊆Rn×β, its projection onto xxx is Projx(S):={x:∃ y∈β, (x,y)∈S}\mathrm{Proj}_x(S) := \{x : \exists\, y \in \beta,\ (x,y) \in S\}Projx​(S):={x:∃y∈β, (x,y)∈S}.

Formalization targets

Theorem 2.1 (goal) — the convex hull of a disjunctive set

cl conv(F)=Projx(P),P:={(x,{yh}h∈Q∗,{y0h}h∈Q∗):x= ⁣ ⁣∑h∈Q∗ ⁣ ⁣yh, Ahyh−bhy0h≥0, y0h≥0,  ⁣ ⁣∑h∈Q∗ ⁣ ⁣y0h=1}.\mathrm{cl}\,\mathrm{conv}(F) = \mathrm{Proj}_x(P), \qquad P := \Big\{(x, \{y^h\}_{h \in Q^*}, \{y^h_0\}_{h \in Q^*}) : x = \!\!\sum_{h \in Q^*}\!\! y^h,\ A_h y^h - b_h y^h_0 \ge 0,\ y^h_0 \ge 0,\ \!\!\sum_{h \in Q^*}\!\! y^h_0 = 1 \Big\}.clconv(F)=Projx​(P),P:={(x,{yh}h∈Q∗​,{y0h​}h∈Q∗​):x=h∈Q∗∑​yh, Ah​yh−bh​y0h​≥0, y0h​≥0, h∈Q∗∑​y0h​=1}.

This is the weakest correct statement: it claims only that the closed convex hull equals the projection of this specific lifted polyhedron PPP, not any stronger uniqueness or minimality claim about lifted representations in general (that refinement is Theorem 2.1's own follow-up discussion, not part of the theorem itself).

Corollary 2.2 — the extreme-point correspondence

Extreme points of cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) correspond bijectively to the extreme points of PPP that place all of their mass on a single disjunct's coordinates.

Theorem 2.3 — tightness of the lifted representation

PQ=P  ⟺  Ck⊆∑h∈Q∗Ch∀ k∈Q∖Q∗,P_Q = P \iff C_k \subseteq \sum_{h \in Q^*} C_h \quad \forall\, k \in Q \setminus Q^*,PQ​=P⟺Ck​⊆h∈Q∗∑​Ch​∀k∈Q∖Q∗,

where PQP_QPQ​ is the variant of PPP indexed by all of QQQ rather than only Q∗Q^*Q∗.

Theorem 2.4 — from the convex hull to the union itself

Under two recession-cone conditions on Q∗∗Q^{**}Q∗∗, restricting PQP_QPQ​'s y0hy^h_0y0h​ variables to {0,1}\{0,1\}{0,1} makes its xxx-projection recover FFF itself, not merely cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F).

Significance

The result itself. Theorem 2.1 is the founding extended-formulation result of integer programming: it shows that every union of finitely many polyhedra — hence every mixed-integer program's feasible region, once expressed in disjunctive normal form — has a lifted description of size linear in the number of disjuncts, in stark contrast to the union's own facet description, which is generally exponential. Corollary 2.2 shows this lifting is not merely an upper bound with extraneous points: its extreme points correspond exactly, one-to-one, with the extreme points of the object it represents. Theorems 2.3 and 2.4 sharpen the picture: 2.3 tells you exactly when you can avoid knowing in advance which disjuncts are nonempty, and 2.4 tells you exactly when the same family of lifted systems, restricted to integral y0hy^h_0y0h​, describes the union FFF exactly rather than only its convex hull — this is Jeroslow and Lowe's characterization of when a disjunctive set is representable as the feasible region of an integer program at all.

Formalizing it. No object in this mission — the disjunctive set FFF, its lifted polyhedron PPP, recession cones of a union's components, or the extreme-point correspondence between a polytope and its lift — exists on the platform prior to this mission or anywhere in Mathlib (substrate.md records zero LP/polyhedron modules in Mathlib as of this writing). This mission is a from-scratch formalization of the book's central construction, restating (rather than importing) the disjunctive-set vocabulary introduced by the companion IntroDuality mission, per the series' convention that a draft mission cannot import another draft mission's definitions.

Difficulty

The natural first attempt at Theorem 2.1 tries to prove the two inclusions cl conv(F)⊆Projx(P)\mathrm{cl}\,\mathrm{conv}(F) \subseteq \mathrm{Proj}_x(P)clconv(F)⊆Projx​(P) and Projx(P)⊆cl conv(F)\mathrm{Proj}_x(P) \subseteq \mathrm{cl}\,\mathrm{conv}(F)Projx​(P)⊆clconv(F) by a direct facet-by-facet or vertex-by-vertex argument in Rn\mathbb{R}^nRn — exactly the exponential-size approach the theorem exists to avoid. The book's own first proof instead works entirely with convex combinations: an arbitrary point of cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) is a combination of at most ∣Q∗∣|Q^*|∣Q∗∣ points, one from each polyhedron in the union (Carathéodory-style), which converts directly into a point of PPP by splitting the combination's weight across the lifted coordinates — and conversely, a point of PPP decomposes, disjunct by disjunct, into a convex combination of that disjunct's own vertices and extreme rays. Neither direction ever needs to enumerate facets of cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) in Rn\mathbb{R}^nRn. The second proof (via projection and the polar cone WWW of the lifted system) shows the projected inequalities coincide with exactly the valid-inequality characterization of Theorem 1.2 (disjunctive Farkas), which is a different, complementary way of seeing why no facet of cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) is missed.

Formalization scope

All theorems are stated over a finite index set Q : Type* with [Fintype Q], matrices Matrix (Fin (m h)) (Fin n) ℝ with m : Q → ℕ allowed to depend on h, and vectors in Fin n → ℝ. DisjunctiveSet, FeasibleIndices, MaximalIndices, RecessionCone, and MinkowskiSumOver fix the chapter's vocabulary; ProjX, LiftedPolyhedron, and IntegerRestricted fix the lifted system and its variants. cl conv F is Mathlib's closure (convexHull ℝ ·); extreme points use Mathlib's Set.extremePoints.

LiftedPolyhedron ranges its auxiliary vectors {yh}\{y^h\}{yh}, {y0h}\{y^h_0\}{y0h​} over all of QQQ rather than only the index subset Qidx the book restricts to, forcing the components outside Qidx to zero. This is an equivalent, Finset/decidability-free encoding — appending zero terms changes neither the defining sums nor the constraints — documented as a convention, not a weakening, in MODERATION_NOTES.md; the same definition instantiates both the (2.1)(2.1)(2.1) system (Qidx = Q^*) and the (2.1)Q(2.1)_Q(2.1)Q​ variant (Qidx = Q) that Theorem 2.3 compares.

A trivializing formalization is ruled out explicitly: taking ∣Q∗∣=1|Q^*| = 1∣Q∗∣=1 collapses the lifted system to x=y1x = y^1x=y1, y01=1y^1_0 = 1y01​=1, a vacuous restatement of x∈P1x \in P_1x∈P1​ that proves nothing about unions. Every theorem here is stated for a generic finite Q, never specialized to a fixed small size. Contributions beyond this mission's statements would need genuine polyhedral machinery (vertex/extreme-ray decomposition of a polyhedron, Carathéodory's theorem for cones) that is itself absent from Mathlib and would be welcome as a separate, reusable definitions layer.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 2, §2.1.
  • E. Balas, Disjunctive programming: Properties of the convex hull of feasible points, Discrete Applied Mathematics 89 (1998), 3–44 (reprint of a 1974 MSRR, cited in the text as [6], the origin of Theorem 2.1).
  • M. Conforti, M. Di Summa, Y. Faenza, On the size of extended formulations for polytopes associated with unions of polyhedra, SIAM Journal on Discrete Mathematics, cited in the text as [59] — establishes the tightness (minimum additional-variable count) of Theorem 2.1's lifted representation.
  • R. G. Jeroslow, J. K. Lowe, Modelling with integer variables, Mathematical Programming Study 22 (1984), 167–184 (cited in the text as [86]; the characterization behind Theorem 2.4's significance).
8 thms3 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

A Branch and Bound Algorithm for the Generalized Assignment Problem: The Knapsack Penalty Bound Equals the Lagrangean Bound at Second-Smallest CostsResearch Paper

Motivation

The generalized assignment problem (GAP) asks for the cheapest way to give each of nnn tasks to exactly one of mmm agents when every agent has a limited amount of a resource and different agents consume different amounts of it for the same task. It models assigning jobs to machines or computers, software tasks to programmers, commercials to time slots, and customers to single-source plants in capacitated facility location. The problem is NP-hard, so exact methods rely on lower bounds that are cheap to compute and strong enough to prune a branch and bound tree.

G. Terry Ross and Richard M. Soland (Mathematical Programming 8, 1975) gave such a bound. The relaxation that ignores the resource limits is solved by giving every task to its cheapest agent; the overloaded agents are then repaired by one small binary knapsack problem each, whose optimal values are added as penalties. Their paper then shows that this repaired bound is not an ad hoc heuristic: it is exactly the value of a Lagrangean relaxation of the GAP at an explicit choice of multipliers. This identity made the Ross–Soland bound the reference point for the later Lagrangean and column-generation methods for the GAP (for example Fisher, Jaikumar and Van Wassenhove, Management Science 1986 and Savelsbergh, Operations Research 1997).

Setting

Agents are I={1,…,m}I=\{1,\dots,m\}I={1,…,m} and tasks J={1,…,n}J=\{1,\dots,n\}J={1,…,n}. Giving task jjj to agent iii costs cijc_{ij}cij​ and uses rij≥0r_{ij}\ge 0rij​≥0 units of agent iii's resource; agent iii has bi>0b_i>0bi​>0 units. The problem is

(P)min⁡ ∑i∈I∑j∈Jcijxijs.t.∑j∈Jrijxij≤bi (i∈I),∑i∈Ixij=1 (j∈J),xij∈{0,1}.\text{(P)}\qquad \min\ \sum_{i\in I}\sum_{j\in J}c_{ij}x_{ij}\quad\text{s.t.}\quad\sum_{j\in J}r_{ij}x_{ij}\le b_i\ (i\in I),\quad\sum_{i\in I}x_{ij}=1\ (j\in J),\quad x_{ij}\in\{0,1\}.(P)min i∈I∑​j∈J∑​cij​xij​s.t.j∈J∑​rij​xij​≤bi​ (i∈I),i∈I∑​xij​=1 (j∈J),xij​∈{0,1}.

Dropping the resource constraints gives the relaxation (PR). It is solved by choosing, for each task jjj, a cheapest agent iji_jij​ with cijj=min⁡icijc_{i_jj}=\min_{i}c_{ij}cij​j​=mini​cij​ and setting xijj=1x_{i_jj}=1xij​j​=1; its value is Z=∑jcijjZ=\sum_jc_{i_jj}Z=∑j​cij​j​. Let Ji={j:ij=i}J_i=\{j: i_j=i\}Ji​={j:ij​=i} be the tasks this solution gives to agent iii, I′={i:∑j∈Jirij>bi}I'=\{i:\sum_{j\in J_i}r_{ij}>b_i\}I′={i:∑j∈Ji​​rij​>bi​} the overloaded agents, and di=∑j∈Jirij−bid_i=\sum_{j\in J_i}r_{ij}-b_idi​=∑j∈Ji​​rij​−bi​ the excess of agent iii. The penalty of moving task jjj away from iji_jij​ is pj=min⁡k≠ij(ckj−cijj)p_j=\min_{k\ne i_j}(c_{kj}-c_{i_jj})pj​=mink=ij​​(ckj​−cij​j​). For i∈I′i\in I'i∈I′ the binary knapsack problem

(PKi)min⁡ zi=∑j∈Jipjyijs.t.∑j∈Jirijyij≥di,yij∈{0,1}\text{(PK}_i)\qquad\min\ z_i=\sum_{j\in J_i}p_jy_{ij}\quad\text{s.t.}\quad\sum_{j\in J_i}r_{ij}y_{ij}\ge d_i,\quad y_{ij}\in\{0,1\}(PKi​)min zi​=j∈Ji​∑​pj​yij​s.t.j∈Ji​∑​rij​yij​≥di​,yij​∈{0,1}

chooses the cheapest set of tasks to move off agent iii; call its optimal value zi∗z^*_izi∗​. The knapsack bound is

LB=Z+∑i∈I′zi∗.\mathrm{LB}=Z+\sum_{i\in I'}z^*_i .LB=Z+i∈I′∑​zi∗​.

Dualizing the assignment constraints with multipliers λj\lambda_jλj​ gives the Lagrangean relaxation

(PRλ)min⁡ ∑i∈I∑j∈Jcijxij+∑j∈Jλj(1−∑i∈Ixij)s.t.∑j∈Jrijxij≤bi (i∈I),xij∈{0,1}.\text{(PR}_\lambda)\qquad\min\ \sum_{i\in I}\sum_{j\in J}c_{ij}x_{ij}+\sum_{j\in J}\lambda_j\Bigl(1-\sum_{i\in I}x_{ij}\Bigr)\quad\text{s.t.}\quad\sum_{j\in J}r_{ij}x_{ij}\le b_i\ (i\in I),\quad x_{ij}\in\{0,1\}.(PRλ​)min i∈I∑​j∈J∑​cij​xij​+j∈J∑​λj​(1−i∈I∑​xij​)s.t.j∈J∑​rij​xij​≤bi​ (i∈I),xij​∈{0,1}.

Finally c1jc_{1j}c1j​ and c2jc_{2j}c2j​ are the smallest and second smallest of c1j,…,cmjc_{1j},\dots,c_{mj}c1j​,…,cmj​, counted with multiplicity.

Formalization targets

Goal: the knapsack bound is the Lagrangean bound at λ=c2\lambda=c_2λ=c2​

For every cheapest-agent choice j↦ijj\mapsto i_jj↦ij​ and every choice of optimal knapsack solutions,

LB=min⁡{∑i∑jcijxij+∑jc2j(1−∑ixij) : x feasible for (PRλ)},\mathrm{LB}=\min\Bigl\{\sum_{i}\sum_{j}c_{ij}x_{ij}+\sum_{j}c_{2j}\Bigl(1-\sum_{i}x_{ij}\Bigr)\ :\ x\ \text{feasible for (PR}_\lambda)\Bigr\},LB=min{i∑​j∑​cij​xij​+j∑​c2j​(1−i∑​xij​) : x feasible for (PRλ​)},

the minimum being attained, and consequently LB≤∑i∑jcijxij\mathrm{LB}\le\sum_i\sum_jc_{ij}x_{ij}LB≤∑i​∑j​cij​xij​ for every xxx feasible for (P). This is the paper's "principal result of this Lagrangean analysis" (§2, p. 96). It has no constants to improve; it is an identity between two optimization problems.

Milestones

In the paper's order of use: (PR) is solved by the cheapest agents (pp. 93–94); every lower bound on (PRλ_\lambdaλ​) is a lower bound on (P) (p. 95); (PRλ_\lambdaλ​) separates into one binary knapsack per agent (p. 95); at λ=c2\lambda=c_2λ=c2​ the variables that are zero in the (PR) solution can be fixed at zero, the substitution yij=1−xijy_{ij}=1-x_{ij}yij​=1−xij​ turns agent iii's part into (PKi_ii​), pj=c2j−c1jp_j=c_{2j}-c_{1j}pj​=c2j​−c1j​, and agent iii's part has value −∑j∈Jipj+zi∗-\sum_{j\in J_i}p_j+z^*_i−∑j∈Ji​​pj​+zi∗​ (p. 96). Two side results close the section: the solution obtained by moving the tasks the knapsacks select has cost exactly LB, so it is optimal whenever it is feasible (pp. 94–95); and the optimal dual multipliers of the bounded-variable linear program (PRL_LL​) are exactly the vectors with c1j≤λj≤c2jc_{1j}\le\lambda_j\le c_{2j}c1j​≤λj​≤c2j​ (pp. 95–96).

Significance

The identity says that a bound computed from one sorting pass and a handful of small knapsacks equals a Lagrangean dual bound at a closed-form multiplier. Validity of LB for (P) then follows from weak Lagrangean duality alone, and the multiplier c2c_2c2​ is the upper end of the range of optimal dual multipliers of the linear program (PRL_LL​), which the paper singles out as a suitable choice of multipliers. The rebuilt solution gives the algorithm a feasible incumbent at no extra cost whenever the knapsack repairs happen to respect all budgets.

The result is proved in the paper, in one sentence. The mission turns that sentence into checked statements: the separation of (PRλ_\lambdaλ​), the reduction of each agent's subproblem to (PKi_ii​), the handling of ties among cheapest agents, and the role of nonnegative resources. As far as a search of the platform shows, nothing about the generalized assignment problem or its Lagrangean bounds has been formalized; the definitions here (assignment relaxations, per-agent knapsacks, bounded-variable duals) are reusable for other GAP and facility-location missions.

Difficulty

The Lagrangean relaxation at λ=c2\lambda=c_2λ=c2​ is a larger problem than the knapsack bound suggests: a feasible xxx may give a task to several agents or to none, and may use any agent, not only the cheapest one. The knapsack bound, by contrast, only looks at the tasks each agent receives in the (PR) solution. The paper bridges the two in one sentence of three observations, and each observation depends on a condition the sentence does not state: the sign of the resource coefficients, the treatment of agents that are not overloaded (for which no knapsack is solved), and ties among cheapest agents, which make some penalties zero and require the statement to hold for every tie-break. An inequality in one direction only (LB is a valid bound) is not the claim; the equality needs a feasible point of (PRλ_\lambdaλ​) whose value is exactly LB.

Formalization scope

Agents are Fin m and tasks Fin n, indexed from 0. Costs, resources, budgets, multipliers and variables are real numbers; a 0-1 variable is a real equal to 0 or 1, so the paper's sums are literal. The cheapest-agent selection is an arbitrary function a : Fin n → Fin m with IsCheapest c a, so every statement holds for every tie-break. pjp_jpj​ and c2jc_{2j}c2j​ are minima over the other agents, which requires m≥2m\ge2m≥2 (hm : 1 < m); c2jc_{2j}c2j​ is proved to be the second smallest cost with multiplicity. Optimal values are never encoded as sInf: zi∗z^*_izi∗​ is the objective of a given optimal knapsack solution, and "the bound provided by (PRλ_\lambdaλ​)" is stated as a lower bound over all feasible points that is attained.

Standing hypotheses: bi>0b_i>0bi​>0 (printed on p. 92), rij≥0r_{ij}\ge0rij​≥0 (implicit in "the resource required", and necessary: with a negative rijr_{ij}rij​ both (PRλ_\lambdaλ​) and (P) can fall below LB), and m≥2m\ge2m≥2. All costs are finite; the "not permissible" pairs of the paper's numerical example are outside the model.

A formalization that states only LB≤\mathrm{LB}\leLB≤ every (PRλ_\lambdaλ​) value, or that restricts the (PRλ_\lambdaλ​) competitors to the (PR) support or to at most one agent per task, would be a weaker theorem and does not meet the goal. The (PRL_LL​) dual is written out explicitly with multipliers uij≥0u_{ij}\ge0uij​≥0 for the bounds xij≤1x_{ij}\le1xij​≤1; "each optimal dual multiplier lies anywhere in the range c1j≤λj≤c2jc_{1j}\le\lambda_j\le c_{2j}c1j​≤λj​≤c2j​" is read as "the optimal multipliers are exactly this box".

Needed infrastructure is only finite sums over Fin and Finset.inf'. Proofs of the milestones, and lemmas on separable binary programs that could serve other Lagrangean-relaxation missions, are welcome.

Selected references

  • G. T. Ross and R. M. Soland, A branch and bound algorithm for the generalized assignment problem, Mathematical Programming 8 (1975) 91–103. https://doi.org/10.1007/BF01580430
  • A. M. Geoffrion, Lagrangean relaxation for integer programming, Mathematical Programming Study 2 (1974) 82–114. https://doi.org/10.1007/BFb0120690
  • M. L. Fisher, R. Jaikumar and L. N. Van Wassenhove, A multiplier adjustment method for the generalized assignment problem, Management Science 32 (1986) 1095–1103. https://doi.org/10.1287/mnsc.32.9.1095
  • M. Savelsbergh, A branch-and-price algorithm for the generalized assignment problem, Operations Research 45 (1997) 831–841. https://doi.org/10.1287/opre.45.6.831
10 thms4 active usersReviewed
🏆Completed
Convex OptimizationFunctional AnalysisOperations Research·Captain: mikedeng1

Proximité et dualité dans un espace hilbertien I: Moreau's Decomposition into Proximal Points of a Function and Its DualResearch Paper

Motivation

Proximal maps are the basic building block of first-order methods for nonsmooth convex optimization: the proximal point algorithm, forward–backward splitting (ISTA/FISTA), Douglas–Rachford splitting and ADMM all proceed by evaluating maps of the form z↦argmin⁡u[12∥u−z∥2+f(u)]z \mapsto \operatorname{argmin}_u \big[\tfrac12\|u - z\|^2 + f(u)\big]z↦argminu​[21​∥u−z∥2+f(u)]. The notion and its name come from J.-J. Moreau, who introduced proximal points in two 1962 notes in the Comptes rendus and gave the systematic theory in Proximité et dualité dans un espace hilbertien (Bull. Soc. Math. France 93 (1965), 273–299).

The central result of that paper, which Moreau calls the key proposition, links proximal maps to conjugate duality: every point of a Hilbert space splits uniquely into the proximal point of zzz relative to a convex function plus the proximal point relative to its dual function. The identity z=proxfz+proxf∗zz = \mathrm{prox}_f z + \mathrm{prox}_{f^*} zz=proxf​z+proxf∗​z is used throughout modern optimization, for example to compute the proximal map of a norm from the projection onto the dual-norm ball, and in the analysis of primal–dual splitting methods.

Timeline. Moreau (1962) announces proximal points and the decomposition along mutually polar cones. Moreau (1965) proves the general decomposition theorem for Γ0(H)\Gamma_0(H)Γ0​(H) and derives from it the characterization of proximal maps and the maximal monotonicity of subdifferentials in Hilbert space. Rockafellar (Pacific J. Math. 33 (1970)) extends maximal monotonicity of subdifferentials to Banach spaces.

Setting

Let HHH be a real Hilbert space with inner product (x∣y)(x \mid y)(x∣y) and norm ∥x∥\|x\|∥x∥. Functions take values in the extended real line [−∞,+∞][-\infty, +\infty][−∞,+∞].

The class Γ0(H)\Gamma_0(H)Γ0​(H) consists of the functions f:H→ ]−∞,+∞]f : H \to\ ]-\infty, +\infty]f:H→ ]−∞,+∞] that are convex (their epigraph {(x,r):f(x)≤r}\{(x, r) : f(x) \le r\}{(x,r):f(x)≤r} is convex in H×RH \times \mathbb RH×R), lower semicontinuous, and not identically +∞+\infty+∞.

The dual function of fff is

f∗(y)=sup⁡x∈H [(x∣y)−f(x)].f^{*}(y) = \sup_{x \in H}\,\big[(x \mid y) - f(x)\big].f∗(y)=x∈Hsup​[(x∣y)−f(x)].

Two points xxx and yyy are conjugate with respect to fff and g=f∗g = f^*g=f∗ when f(x)+g(y)=(x∣y)f(x) + g(y) = (x \mid y)f(x)+g(y)=(x∣y); the set of such yyy is the subdifferential ∂f(x)\partial f(x)∂f(x).

For f∈Γ0(H)f \in \Gamma_0(H)f∈Γ0​(H) and z∈Hz \in Hz∈H, the proximal point proxfz\mathrm{prox}_f zproxf​z is the unique minimizer of

Φ(u)=12∥u−z∥2+f(u).\Phi(u) = \tfrac12\|u - z\|^2 + f(u).Φ(u)=21​∥u−z∥2+f(u).

When fff is the indicator function of a nonempty closed convex set CCC (zero on CCC, +∞+\infty+∞ outside), proxfz\mathrm{prox}_f zproxf​z is the nearest-point projection projCz\mathrm{proj}_C zprojC​z.

Formalization targets

Goal: Proposition 4.a (Moreau's decomposition)

Let f∈Γ0(H)f \in \Gamma_0(H)f∈Γ0​(H) and g=f∗g = f^*g=f∗. For all x,y,z∈Hx, y, z \in Hx,y,z∈H,

(z=x+y  and  f(x)+g(y)=(x∣y))  ⟺  (x=proxfz  and  y=proxgz).\Big(z = x + y \ \text{ and } \ f(x) + g(y) = (x \mid y)\Big) \iff \Big(x = \mathrm{prox}_f z \ \text{ and } \ y = \mathrm{prox}_g z\Big).(z=x+y  and  f(x)+g(y)=(x∣y))⟺(x=proxf​z  and  y=proxg​z).

Milestones

  1. (2.3), the Fenchel–Young inequality: f(x)+f∗(y)≥(x∣y)f(x) + f^*(y) \ge (x \mid y)f(x)+f∗(y)≥(x∣y) for all x,yx, yx,y.
  2. §2.b, biconjugation: f∗∈Γ0(H)f^* \in \Gamma_0(H)f∗∈Γ0​(H) and f∗∗=ff^{**} = ff∗∗=f for f∈Γ0(H)f \in \Gamma_0(H)f∈Γ0​(H).
  3. Proposition 3.a: Φ(u)=12∥u−z∥2+f(u)\Phi(u) = \tfrac12\|u - z\|^2 + f(u)Φ(u)=21​∥u−z∥2+f(u) has a strict minimum, so proxfz\mathrm{prox}_f zproxf​z is well defined.

Companions

  • Corollaire 4.b: for a closed convex cone PPP and its polar cone Q={y:(x∣y)≤0 ∀x∈P}Q = \{y : (x \mid y) \le 0\ \forall x \in P\}Q={y:(x∣y)≤0 ∀x∈P}, z=x+yz = x + yz=x+y with x∈Px \in Px∈P, y∈Qy \in Qy∈Q, (x∣y)=0(x \mid y) = 0(x∣y)=0 iff x=projPzx = \mathrm{proj}_P zx=projP​z and y=projQzy = \mathrm{proj}_Q zy=projQ​z.
  • (5.1): the conjugacy relation is monotone, (x−x′∣y−y′)≥0(x - x' \mid y - y') \ge 0(x−x′∣y−y′)≥0.
  • Proposition 12.b: the relation y∈∂f(x)y \in \partial f(x)y∈∂f(x) is maximal monotone.

Significance

The decomposition theorem gives, for every zzz, a unique splitting into a pair of conjugate points, and conversely identifies every conjugate pair summing to zzz with the two proximal points. Special cases are the orthogonal decomposition along a closed subspace and its complement, and the decomposition along a pair of mutually polar cones (Corollaire 4.b). In the rest of Moreau's paper it yields that proximal maps are nonexpansive, that the Moreau envelopes of fff and f∗f^*f∗ add up to 12∥z∥2\tfrac12\|z\|^221​∥z∥2, and that the subdifferential of a function in Γ0(H)\Gamma_0(H)Γ0​(H) is maximal monotone (Proposition 12.b). In algorithms it lets one evaluate proxf∗\mathrm{prox}_{f^*}proxf∗​ from proxf\mathrm{prox}_fproxf​ at no extra cost, which is the basis of dual and primal–dual proximal methods.

All results in this mission are classical and proved (Moreau 1965; see also Bauschke–Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, 2nd ed., 2017, Thm. 14.3). What the mission adds is a machine-checked development. Mathlib contains convex functions, lower semicontinuity and Hilbert-space projections onto closed convex sets, but as of this mission's environment it has no Legendre–Fenchel conjugate for extended-valued functions on a Hilbert space, no proximal map and no maximal monotone operators. The Hilbert projection theorem is on the platform as FamousTheorems.hilbert_projection_theorem; it is the special case of Proposition 3.a for indicator functions.

Difficulty

The two directions of the goal are unequal. That conjugate points summing to zzz are the two proximal points needs only the definition of the dual function. The converse must produce the conjugacy identity f(x)+f∗(z−x)=(x∣z−x)f(x) + f^*(z - x) = (x \mid z - x)f(x)+f∗(z−x)=(x∣z−x) from the bare fact that xxx minimizes 12∥u−z∥2+f(u)\tfrac12\|u - z\|^2 + f(u)21​∥u−z∥2+f(u), and a pointwise first-order argument is unavailable because fff need be neither finite nor differentiable anywhere.

The milestones carry the analytic weight. Proposition 3.a needs existence of a minimizer of a function that is neither continuous nor coercive by itself on an infinite-dimensional space, so compactness arguments in the norm topology fail. Biconjugation (§2.b) is the Fenchel–Moreau theorem, which requires a separation theorem in H×RH \times \mathbb RH×R applied to a closed convex epigraph whose values may be +∞+\infty+∞.

Formalization scope

Everything lives in the namespace MoreauProx.Decomposition, over {H : Type*} [NormedAddCommGroup H] [InnerProductSpace ℝ H] [CompleteSpace H]; the paper's (x∣y)(x \mid y)(x∣y) is ⟪x, y⟫_ℝ. The following conventions are committed to:

  • Functions are H → EReal. Γ0(H)\Gamma_0(H)Γ0​(H) (GammaZero) is the structure: never ⊥, not everywhere ⊤, convex epigraph in H × ℝ, and LowerSemicontinuous in the norm topology. The paper defines Γ0(H)\Gamma_0(H)Γ0​(H) as suprema of nonempty families of continuous affine functions, other than +∞+\infty+∞, and states the equivalence with this description (§2.a); the second description is the one formalized. Weak and strong lower semicontinuity agree for convex functions, as the paper remarks, so no weak topology appears.
  • The dual function is conj f y = ⨆ x, ⟪x, y⟫_ℝ - f x in EReal; since a - ⊤ = ⊥, this matches both lines of (2.2).
  • "x=proxfzx = \mathrm{prox}_f zx=proxf​z" is the predicate IsProx f z x: xxx minimizes proxObjective f z u = ‖u - z‖ ^ 2 / 2 + f u. With Proposition 3.a it is equivalent to the paper's notation; no choice function is used.
  • The goal assumes GammaZero f and g = conj f; the paper's "f,g∈Γ0(H)f, g \in \Gamma_0(H)f,g∈Γ0​(H) dual to each other" follows from this by §2.b, so the goal is not weaker than the paper's.
  • The polar cone uses ≤0\le 0≤0 (the negative of Mathlib's innerDual), and projCz\mathrm{proj}_C zprojC​z is the predicate IsProj C z x (nearest point).
  • Maximal monotonicity is the paper's definition: monotone, and contained in no strictly larger monotone relation.

A formalization that drops the requirement that fff be not identically +∞+\infty+∞, drops the factor 12\tfrac1221​, replaces the duality hypothesis by unrelated f,gf, gf,g, or reads values through EReal.toReal would make the statement false or vacuous; the definitions above rule these out.

Contributions welcome: proofs of the three milestones and of the goal; reusable infrastructure for extended-valued convex analysis on Hilbert spaces (conjugates, subdifferentials, proximal maps), which the companion mission Proximité et dualité dans un espace hilbertien II builds on.

Selected references

  • J.-J. Moreau, Proximité et dualité dans un espace hilbertien, Bull. Soc. Math. France 93 (1965), 273–299. https://doi.org/10.24033/bsmf.1625
  • J.-J. Moreau, Fonctions convexes duales et points proximaux dans un espace hilbertien, C. R. Acad. Sci. Paris 255 (1962), 2897–2899.
  • R. T. Rockafellar, On the maximal monotonicity of subdifferential mappings, Pacific J. Math. 33 (1970), 209–216. https://doi.org/10.2140/pjm.1970.33.209
  • H. H. Bauschke and P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, 2nd ed., Springer, 2017. https://doi.org/10.1007/978-3-319-48311-5
7 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming III: Projecting Polyhedra and the Convex Hull via PolarityTextbook

Motivation

Theorem 2.1 (the previous mission in this series) shows that the closed convex hull of a union of polyhedra has a compact description after lifting to a higher-dimensional space. That description comes in two dual flavors: a primal one, as the projection of an explicit lifted polyhedron, and a polar one, characterizing the hull's facets directly via a cone built from the disjuncts' own data. Both flavors matter in practice: a cutting-plane algorithm needs to know exactly which inequalities are facet-defining (so as not to waste effort generating redundant cuts), and the two routes — projection and polarity — offer complementary tools for deciding this. This mission formalizes both routes and the machinery connecting them, closing out Chapter 2 of Balas, Disjunctive Programming (Springer, 2018).

The projection route (§2.2–2.3) develops general facts about projecting an arbitrary polyhedron that predate and underlie the disjunctive-programming application: the classical projection formula via extreme rays of a projection cone, how dimension and facet structure behave under projection, and a refinement (via a coordinate transformation) that eliminates the redundant inequalities the plain projection formula can produce. The polarity route (§2.4) develops the reverse polar, an object introduced by Balas specifically for this purpose, whose iterated application recovers the closed convex hull of a disjunctive set directly, culminating in an exact characterization of when an inequality is facet-defining purely in terms of extreme rays of an explicit cone W0W_0W0​.

Setting

For a matrix system (A,B,b)(A,B,b)(A,B,b) with mmm rows, let Q:={(u,x)∈Rp×Rq:Au+Bx≤b}Q := \{(u,x) \in \mathbb{R}^p \times \mathbb{R}^q : Au+Bx \le b\}Q:={(u,x)∈Rp×Rq:Au+Bx≤b}, and let Projx(Q):={x:∃ u, (u,x)∈Q}\mathrm{Proj}_x(Q) := \{x : \exists\, u,\ (u,x) \in Q\}Projx​(Q):={x:∃u, (u,x)∈Q} be its projection onto the xxx-space. The projection cone is W:={v:vA=0, v≥0}W := \{v : vA=0,\ v \ge 0\}W:={v:vA=0, v≥0}. A vector vvv is an extreme ray of a cone WWW if v≠0v \ne 0v=0, v∈Wv \in Wv∈W, and the ray it generates is an extreme subset of WWW. The dimension dim⁡(P)\dim(P)dim(P) of a polyhedron is the dimension of its affine hull, and a set FFF is a facet of PPP if it is a proper face of PPP of dimension dim⁡(P)−1\dim(P)-1dim(P)−1. Partitioning (A,B,b)(A,B,b)(A,B,b)'s rows into those tight throughout QQQ (the equality subsystem) and the rest, rrr and r∗r^*r∗ denote the rank of the tight rows' combined and AAA-only submatrices, respectively.

For S⊆RnS \subseteq \mathbb{R}^nS⊆Rn, the polar is S0:={x:xy≤1 ∀y∈S}S^0 := \{x : xy \le 1\ \forall y \in S\}S0:={x:xy≤1 ∀y∈S} and the reverse polar is S#:={x:xy≥1 ∀y∈S}S^\# := \{x : xy \ge 1\ \forall y \in S\}S#:={x:xy≥1 ∀y∈S}; more generally the scaled polar at level α0\alpha_0α0​ is F(α0):={y:xy≥α0 ∀x∈F}F_{(\alpha_0)} := \{y : xy \ge \alpha_0\ \forall x \in F\}F(α0​)​:={y:xy≥α0​ ∀x∈F}. For a disjunctive set F=⋃h∈QPhF = \bigcup_{h \in Q} P_hF=⋃h∈Q​Ph​ with Ph:={x:Ahx≥bh}P_h := \{x : A_h x \ge b_h\}Ph​:={x:Ah​x≥bh​} and Q∗:={h:Ph≠∅}Q^* := \{h : P_h \ne \emptyset\}Q∗:={h:Ph​=∅}, the cone W0:={(α,α0):∃ (uh)h∈Q∗, ∀h, uhAh=α, α0≤uhbh, uh≥0}W_0 := \{(\alpha,\alpha_0) : \exists\, (u_h)_{h \in Q^*},\ \forall h,\ u_h A_h = \alpha,\ \alpha_0 \le u_h b_h,\ u_h \ge 0\}W0​:={(α,α0​):∃(uh​)h∈Q∗​, ∀h, uh​Ah​=α, α0​≤uh​bh​, uh​≥0}.

Formalization targets

Theorem 2.18 (goal) — facet characterization via polarity

For a full-dimensional disjunctive set FFF (dim⁡(F)=n\dim(F)=ndim(F)=n) and α0≠0\alpha_0 \ne 0α0​=0:

αx≥α0 defines a facet of cl conv(F)  ⟺  (α,α0) is an extreme ray of W0.\alpha x \ge \alpha_0 \text{ defines a facet of } \mathrm{cl\,conv}(F) \iff (\alpha,\alpha_0) \text{ is an extreme ray of } W_0.αx≥α0​ defines a facet of clconv(F)⟺(α,α0​) is an extreme ray of W0​.

The polarity chain feeding the goal

Proposition 2.13 (0∈cl conv(S)  ⟺  S#=∅  ⟺  S#0 \in \mathrm{cl\,conv}(S) \iff S^\# = \emptyset \iff S^\#0∈clconv(S)⟺S#=∅⟺S# bounded), Theorem 2.14 (S##=cl conv(S)+cl cone(S)S^{\#\#} = \mathrm{cl\,conv}(S) + \mathrm{cl\,cone}(S)S##=clconv(S)+clcone(S) when 0∉cl conv(S)0 \notin \mathrm{cl\,conv}(S)0∈/clconv(S)), Corollary 2.15 (cl conv(S)=S00∩S##\mathrm{cl\,conv}(S) = S^{00} \cap S^{\#\#}clconv(S)=S00∩S##), Theorem 2.16 (the scaled polar stabilizes: F(α0)###=F(α0)#F_{(\alpha_0)}^{\#\#\#} = F_{(\alpha_0)}^{\#}F(α0​)###​=F(α0​)#​), and Corollary 2.17 (F(α0)={α:(α,α0)∈W0}F_{(\alpha_0)} = \{\alpha : (\alpha,\alpha_0) \in W_0\}F(α0​)​={α:(α,α0​)∈W0​}) — each the weakest statement needed for the next.

The projection track (independent of the goal's direct proof, sharing its definitions)

Theorem 2.5 (Projx(Q)={x:(vB)x≤vb, v∈extr(W)}\mathrm{Proj}_x(Q) = \{x : (vB)x \le vb,\ v \in \mathrm{extr}(W)\}Projx​(Q)={x:(vB)x≤vb, v∈extr(W)}), Proposition 2.6 (projection preserves integrality), Theorem 2.7 (dim⁡(Projx(Q))=dim⁡(Q)−p+r∗\dim(\mathrm{Proj}_x(Q)) = \dim(Q)-p+r^*dim(Projx​(Q))=dim(Q)−p+r∗), Corollaries 2.8–2.10 (facet/face behavior under projection), and Proposition 2.11 / Corollary 2.12 (sharper facet characterizations via a coordinate-transformed projection cone).

Significance

The results themselves. Theorem 2.18 is the practical payoff of the entire polarity apparatus: it turns "is this inequality facet-defining for the convex hull of a union of polyhedra" from a geometric question into an algebraic one about extreme rays of an explicit, finitely-generated cone built directly from the disjuncts' own constraint data — exactly the kind of question a cutting-plane algorithm needs answered to avoid generating redundant cuts. The projection track is foundational general polyhedral theory in its own right (Theorem 2.5's formula underlies Benders decomposition and classical Fourier-Motzkin elimination as special cases, per the book's own remarks), independently useful beyond the disjunctive setting.

Formalizing it. No object in this mission — polars, reverse polars, projection cones, extreme rays of a cone, or the dimension/facet apparatus of a polyhedron — exists on the platform prior to this mission or in Mathlib (a q=polar search returns only an unrelated cyclic-polytope construction from the Hirsch-conjecture series, with different conventions and object). This mission restates the disjunctive-set vocabulary of the companion ConvexHull mission locally (per the series convention that a draft mission cannot import another draft mission's definitions) and builds the polarity apparatus from scratch on top of it.

Difficulty

The natural first attempt at Theorem 2.18 tries to characterize facets of cl conv(F)\mathrm{cl\,conv}(F)clconv(F) directly from the lifted-polyhedron representation of Theorem 2.1, projecting facet by facet. This misses the point of the polarity route entirely: Theorem 2.18's proof instead goes through F(α0)F_{(\alpha_0)}F(α0​)​, showing a vertex of F(α0)F_{(\alpha_0)}F(α0​)​ corresponds to a nonhomogeneous subset of rank nnn of F(α0)F_{(\alpha_0)}F(α0​)​'s own defining system being tight — algebra entirely in the dual space of multipliers, never touching the lifted polyhedron's facets directly. The two obstacles Theorem 2.14 and Proposition 2.13 exist to clear are, respectively: reverse polars do not satisfy the ordinary polar's clean involution property (an extra cl cone(S)\mathrm{cl\,cone}(S)clcone(S) summand appears, capturing recession directions the reverse-polar construction alone cannot see), and reverse polars are either empty or automatically unbounded (never merely "small"), which is why the apparatus needs the normalization 0∉cl conv(F)0 \notin \mathrm{cl\,conv}(F)0∈/clconv(F) throughout.

Formalization scope

All results are stated over finite index sets and matrices Matrix (Fin (m h)) (Fin n) ℝ (disjunctive-set data, m : Q → ℕ dependent) or Matrix (Fin m) (Fin p) ℝ / Matrix (Fin m) (Fin q) ℝ (projection-track data). PolyDim and IsFacet are stated generically over any real vector space (via Module.finrank of vectorSpan and Mathlib's IsExtreme), so the same definitions serve both Poly2-shaped pairs and cl conv F ⊆ Fin n → ℝ directly in Theorem 2.18. IsExtremeRay is likewise stated generically, reused for cones in plain vector space, (v,v0)-space, and the triple (v,w,v0)-space Proposition 2.11 needs.

Two results (Proposition 2.11, Corollary 2.12) build on a coordinate-transformed polyhedron Q̃/cone W̃ that the book itself only cites from [14] rather than constructing; consistent with the book's own treatment, this mission takes W̃ (or its (v,v0)-projection) as given data together with its defining relationship to Proj_x(Q), rather than re-deriving the transformation — a choice recorded in MODERATION_NOTES.md, not a weakening of either statement's content. Proposition 2.11's complexity remark ("O(max{m,q}³)") is a proof aside about the transformation's cost, not part of either result's mathematical claim, and is out of scope per the book-wide disposition (triage.json).

A trivializing formalization is ruled out explicitly: the projection-track results are stated for generic m, p, q, never fixed at small values, and Theorem 2.18 is stated for a generic finite disjunctive index set Q, not specialized to |Q| = 1 (which would collapse W_0 to ordinary LP polarity and prove nothing about unions).

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 2, §2.2–2.4.
  • E. Balas, Disjunctive programming: Properties of the convex hull of feasible points, Discrete Applied Mathematics 89 (1998), 3–44 (cited in the text as [6], the origin of the reverse-polar apparatus alongside [10]).
  • Balas, Pordli (cited as [14] in the text) — the coordinate-transformation construction behind Proposition 2.11 and Corollary 2.12.
  • Balas, Portugal (cited as [30] in the text) — the source of the dimensional results of §2.2.2.
19 thms4 active users
🏆Completed
Convex OptimizationFunctional AnalysisOperations Research·Captain: mikedeng1

Proximité et dualité dans un espace hilbertien II: Proximal Maps Are the Nonexpansive Subgradient Selections of Convex FunctionsResearch Paper

Motivation

The proximal map of a convex function is the basic building block of proximal-point, forward–backward, Douglas–Rachford and ADMM methods, which are used throughout large-scale convex optimization, signal processing and operator splitting. All of these methods treat prox⁡g\operatorname{prox}_gproxg​ as a nonexpansive operator and use the fact that it is a gradient. The questions this mission formalizes go back to the paper that introduced the map: J.-J. Moreau, Proximité et dualité dans un espace hilbertien, Bull. Soc. Math. France 93 (1965), 273–299 (DOI 10.24033/bsmf.1625). Which maps p:H→Hp : H \to Hp:H→H are proximal maps, and how can a function be recognized as the "potential" of one?

Moreau's answer (Corollaire 10.c) is intrinsic. A map is a proximal map exactly when it is nonexpansive and selects, at every point, a subgradient of some convex function. This characterization is the Hilbert-space origin of later results on firmly nonexpansive operators and on resolvents of maximal monotone operators (Minty 1962; Rockafellar 1970). It is still how one checks that a given nonexpansive operator is a proximal map.

Setting

Throughout, HHH is a real Hilbert space with inner product (x∣y)(x \mid y)(x∣y) and norm ∥x∥\|x\|∥x∥.

  • Γ0(H)\Gamma_0(H)Γ0​(H) is the class of functions f:H→ ]−∞,+∞]f : H \to \,]-\infty, +\infty]f:H→]−∞,+∞] that are convex (convex epigraph), lower semicontinuous and not identically +∞+\infty+∞.
  • The dual function of fff is g(y)=sup⁡x∈H[(x∣y)−f(x)]g(y) = \sup_{x \in H}[(x \mid y) - f(x)]g(y)=supx∈H​[(x∣y)−f(x)]. For f∈Γ0(H)f \in \Gamma_0(H)f∈Γ0​(H), g∈Γ0(H)g \in \Gamma_0(H)g∈Γ0​(H) and fff is the dual of ggg.
  • A vector yyy is a subgradient of φ\varphiφ at zzz, written y∈∂φ(z)y \in \partial\varphi(z)y∈∂φ(z), when φ(z)\varphi(z)φ(z) is finite and φ(z)+(u−z∣y)≤φ(u)\varphi(z) + (u - z \mid y) \le \varphi(u)φ(z)+(u−z∣y)≤φ(u) for all uuu. For f∈Γ0(H)f \in \Gamma_0(H)f∈Γ0​(H) this is the paper's condition f(z)+g(y)=(z∣y)f(z) + g(y) = (z \mid y)f(z)+g(y)=(z∣y), i.e. zzz and yyy are conjugate points.
  • For f∈Γ0(H)f \in \Gamma_0(H)f∈Γ0​(H) and z∈Hz \in Hz∈H, the function u↦12∥u−z∥2+f(u)u \mapsto \tfrac12\|u - z\|^2 + f(u)u↦21​∥u−z∥2+f(u) has a unique minimizer, the proximal point prox⁡fz\operatorname{prox}_f zproxf​z. A map p:H→Hp : H \to Hp:H→H is a prox map when p=prox⁡gp = \operatorname{prox}_gp=proxg​ for some g∈Γ0(H)g \in \Gamma_0(H)g∈Γ0​(H).
  • A multivalued map z↦Pz⊆Hz \mapsto Pz \subseteq Hz↦Pz⊆H contracts distances when x∈Pzx \in Pzx∈Pz, x′∈Pz′x' \in Pz'x′∈Pz′ imply ∥x−x′∥≤∥z−z′∥\|x - x'\| \le \|z - z'\|∥x−x′∥≤∥z−z′∥.
  • For dual functions f,gf, gf,g, the primitive of prox⁡g\operatorname{prox}_gproxg​ is φ(z)=12∥prox⁡gz∥2+f(prox⁡fz)\varphi(z) = \tfrac12\|\operatorname{prox}_g z\|^2 + f(\operatorname{prox}_f z)φ(z)=21​∥proxg​z∥2+f(proxf​z). With Q(z)=12∥z∥2\mathcal{Q}(z) = \tfrac12\|z\|^2Q(z)=21​∥z∥2, a function φ\varphiφ is less convex than Q\mathcal{Q}Q when φ+γ=Q\varphi + \gamma = \mathcal{Q}φ+γ=Q for a convex γ\gammaγ, and θ\thetaθ is more convex than Q\mathcal{Q}Q when θ=Q+γ\theta = \mathcal{Q} + \gammaθ=Q+γ for a convex γ\gammaγ with values in ]−∞,+∞]]-\infty, +\infty]]−∞,+∞].

The Lean names are GammaZero, conj, subgrad, IsProx, prox, IsProxMap, ContractsDistances, primitive, LessConvexThanQ, MoreConvexThanQ and IsProxPrimitive, all in the namespace MoreauProx.Characterization.

Formalization targets

Goal: Corollaire 10.c

For every map p:H→Hp : H \to Hp:H→H,

p is a prox map  ⟺  (∥p(z)−p(z′)∥≤∥z−z′∥  ∀z,z′) ∧ ∃φ convex, ∀z∈H, p(z)∈∂φ(z).p \text{ is a prox map} \iff \Big(\|p(z) - p(z')\| \le \|z - z'\| \ \ \forall z, z'\Big) \ \wedge\ \exists \varphi \text{ convex},\ \forall z \in H,\ p(z) \in \partial\varphi(z).p is a prox map⟺(∥p(z)−p(z′)∥≤∥z−z′∥  ∀z,z′) ∧ ∃φ convex, ∀z∈H, p(z)∈∂φ(z).

Nothing is assumed of φ\varphiφ beyond convexity.

Milestones, in the order of the paper

  1. Proposition 3.a. For f∈Γ0(H)f \in \Gamma_0(H)f∈Γ0​(H), u↦12∥u−z∥2+f(u)u \mapsto \tfrac12\|u - z\|^2 + f(u)u↦21​∥u−z∥2+f(u) has a strict minimum.
  2. Proposition 4.a (Moreau decomposition). For f∈Γ0(H)f \in \Gamma_0(H)f∈Γ0​(H) with dual ggg: z=x+yz = x + yz=x+y and f(x)+g(y)=(x∣y)f(x) + g(y) = (x \mid y)f(x)+g(y)=(x∣y) if and only if x=prox⁡fzx = \operatorname{prox}_f zx=proxf​z and y=prox⁡gzy = \operatorname{prox}_g zy=proxg​z.
  3. (5.1). Conjugate pairs are monotone: (x−x′∣y−y′)≥0(x - x' \mid y - y') \ge 0(x−x′∣y−y′)≥0.
  4. Proposition 5.b. ∥prox⁡fz−prox⁡fz′∥≤∥z−z′∥\|\operatorname{prox}_f z - \operatorname{prox}_f z'\| \le \|z - z'\|∥proxf​z−proxf​z′∥≤∥z−z′∥, so prox⁡f\operatorname{prox}_fproxf​ is continuous.
  5. Proposition 7.b. The primitive φ\varphiφ of prox⁡g\operatorname{prox}_gproxg​ lies in Γ0(H)\Gamma_0(H)Γ0​(H), and its dual is g+12∥⋅∥2g + \tfrac12\|\cdot\|^2g+21​∥⋅∥2.
  6. Proposition 7.d. φ\varphiφ is Fréchet differentiable with ∇φ(z)=prox⁡gz\nabla\varphi(z) = \operatorname{prox}_g z∇φ(z)=proxg​z.
  7. Proposition 9.b. For φ\varphiφ: (φ∈Γ0(H)\varphi \in \Gamma_0(H)φ∈Γ0​(H) less convex than Q\mathcal{Q}Q)   ⟺  \iff⟺ (φ∈Γ0(H)\varphi \in \Gamma_0(H)φ∈Γ0​(H) with dual more convex than Q\mathcal{Q}Q)   ⟺  \iff⟺ (φ\varphiφ is the primitive of a prox map).
  8. Proposition 10.b. Each of these is equivalent to: φ∈Γ0(H)\varphi \in \Gamma_0(H)φ∈Γ0​(H) and z↦∂φ(z)z \mapsto \partial\varphi(z)z↦∂φ(z) contracts distances.

Three further results of the paper are included as unmilestoned companions: Proposition 8.a (prox⁡g=prox⁡g′\operatorname{prox}_g = \operatorname{prox}_{g'}proxg​=proxg′​ implies g′=g+Kg' = g + Kg′=g+K), Proposition 9.a (Q\mathcal{Q}Q is the only function equal to its dual) and Proposition 9.d (nonnegative combinations ∑αipi\sum \alpha_i p_i∑αi​pi​ of prox maps with ∑αi≤1\sum \alpha_i \le 1∑αi​≤1 are prox maps).

Significance

The result. Corollary 10.c turns "is a prox map" into two checkable properties of ppp, one metric and one variational, with no need to exhibit ggg. Proposition 9.d is one consequence: closure of prox maps under subconvex combinations. Proposition 10.b gives the dual picture, which recognizes primitives of prox maps among the functions of Γ0(H)\Gamma_0(H)Γ0​(H) by a Lipschitz condition on their subdifferential. The intermediate results are the standard toolkit of proximal analysis. They include the Moreau decomposition, the nonexpansiveness of prox⁡f\operatorname{prox}_fproxf​, and the smoothness of the Moreau envelope φ(z)=inf⁡u[12∥u−z∥2+f(u)]\varphi(z) = \inf_u[\tfrac12\|u - z\|^2 + f(u)]φ(z)=infu​[21​∥u−z∥2+f(u)] (Remark 7.c) with gradient z−prox⁡fz=prox⁡gzz - \operatorname{prox}_f z = \operatorname{prox}_g zz−proxf​z=proxg​z.

Formalizing it. All statements were proved in 1965 and are textbook material (Bauschke–Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, 2nd ed., 2017, Ch. 12–14 and 24). None of them has a machine-checked proof in Mathlib, which has no Γ0(H)\Gamma_0(H)Γ0​(H) class, no extended-valued Fenchel conjugate and no proximal map on a Hilbert space. A complete development here would give reusable infrastructure: the conjugate of extended-valued functions with the Fenchel–Moreau theorem, the proximal map and its nonexpansiveness, and the differentiability of the Moreau envelope. Downstream convergence proofs of proximal algorithms need this layer.

Difficulty

The necessity half of 10.c follows quickly from 5.b and 7.d once those are available. The sufficiency half is the hard one. Given only a nonexpansive ppp and a convex φ\varphiφ with p(z)∈∂φ(z)p(z) \in \partial\varphi(z)p(z)∈∂φ(z), one must produce g∈Γ0(H)g \in \Gamma_0(H)g∈Γ0​(H) with p=prox⁡gp = \operatorname{prox}_gp=proxg​. The obvious move is to take ggg to be something built from φ\varphiφ directly. This fails because the candidate is only defined through a duality that needs φ∈Γ0(H)\varphi \in \Gamma_0(H)φ∈Γ0​(H) and a precise convexity comparison with Q\mathcal{Q}Q. Neither is given, and neither follows from a pointwise argument. The intermediate milestones involve biconjugation of extended-valued functions, upper envelopes of affine functions in infinite dimension, and lower semicontinuity of functions taking +∞+\infty+∞. These are the places where finite-dimensional or finite-valued shortcuts do not apply.

Formalization scope

Conventions committed to in Lean:

  • HHH is [NormedAddCommGroup H] [InnerProductSpace ℝ H] [CompleteSpace H]. Functions with values in ]−∞,+∞]]-\infty, +\infty]]−∞,+∞] are H → EReal.
  • Γ0(H)\Gamma_0(H)Γ0​(H): never −∞-\infty−∞, somewhere finite, convex epigraph in H×RH \times \mathbb{R}H×R, lower semicontinuous in the norm topology. The paper defines Γ0(H)\Gamma_0(H)Γ0​(H) via upper envelopes of continuous affine functions and states this equivalent description on the same page.
  • The dual function is ⨆ x, (⟪x, y⟫ : EReal) - f x, computed in EReal (a complete lattice).
  • Subgradients use the affine-minorant form, which requires φ(z)\varphi(z)φ(z) finite. It agrees with the paper's (2.4) on Γ0(H)\Gamma_0(H)Γ0​(H) and is meaningful for the merely convex φ\varphiφ of the goal.
  • IsProx f z x says that xxx minimizes 12∥u−z∥2+f(u)\tfrac12\|u - z\|^2 + f(u)21​∥u−z∥2+f(u). The function prox f picks such a minimizer by choice (junk value 000 if none exists). Every theorem using prox assumes f∈Γ0(H)f \in \Gamma_0(H)f∈Γ0​(H). A prox map is ∃ g, GammaZero g ∧ ∀ z, IsProx g z (p z).
  • The primitive is real-valued and built from the pair (f,g)(f, g)(f,g) as in Définition 7.a. Theorems about it assume f∈Γ0(H)f \in \Gamma_0(H)f∈Γ0​(H) and ggg equal to the dual of fff (the paper's "duales l'une de l'autre", which this implies).
  • In the goal, φ\varphiφ is taken real-valued and convex (ConvexOn ℝ Set.univ). This is equivalent to the paper's ]−∞,+∞]]-\infty, +\infty]]−∞,+∞]-valued φ\varphiφ, because a subgradient at every point forces φ\varphiφ finite everywhere. The contraction condition is §10.a applied to z↦{p(z)}z \mapsto \{p(z)\}z↦{p(z)}.
  • In 9.b and 10.b the auxiliary convex γ\gammaγ may take +∞+\infty+∞. Property (III) does not assume φ∈Γ0(H)\varphi \in \Gamma_0(H)φ∈Γ0​(H).

Trivializing formalizations are ruled out. The goal's φ\varphiφ is required to be convex and to have p(z)p(z)p(z) as a genuine subgradient at every point, with φ(z)\varphi(z)φ(z) finite. Γ0(H)\Gamma_0(H)Γ0​(H) excludes the constant +∞+\infty+∞, under which every point would minimize the proximal objective. No theorem applies prox outside Γ0(H)\Gamma_0(H)Γ0​(H), where its junk value would make statements vacuous.

Needed infrastructure: Fenchel–Moreau biconjugation for EReal-valued functions on a Hilbert space, existence of minimizers of coercive lsc convex functions (weak compactness of balls), and a Fréchet-derivative argument for the envelope. Contributions are welcome at every milestone. Also welcome are helper lemmas on EReal arithmetic for convex functions, and alternative proofs of 10.c via Minty's theorem on firmly nonexpansive maps.

Selected references

  • J.-J. Moreau, Proximité et dualité dans un espace hilbertien, Bull. Soc. Math. France 93 (1965), 273–299. https://doi.org/10.24033/bsmf.1625
  • J.-J. Moreau, Fonctions convexes duales et points proximaux dans un espace hilbertien, C. R. Acad. Sci. Paris 255 (1962), 2897–2899.
  • G. J. Minty, Monotone (nonlinear) operators in Hilbert space, Duke Math. J. 29 (1962), 341–346. https://doi.org/10.1215/S0012-7094-62-02933-2
  • R. T. Rockafellar, On the maximal monotonicity of subdifferential mappings, Pacific J. Math. 33 (1970), 209–216. https://doi.org/10.2140/pjm.1970.33.209
  • H. H. Bauschke and P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, 2nd ed., Springer, 2017. https://doi.org/10.1007/978-3-319-48311-5
12 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming IV: Sequential Convexification of Disjunctive SetsTextbook

Motivation

Computing the convex hull of a disjunctive set — a union of finitely many polyhedra — is generally hard in direct proportion to how many polyhedra are in the union: Chapter 2's Theorem 2.1 gives a compact lifted description, but working with it still means reasoning about all the disjunctions of the program simultaneously. A natural question, with obvious practical consequences for integer and combinatorial optimization, is whether the convex hull can instead be built up incrementally: impose one disjunction, take the convex hull of what results, then impose the next disjunction on that, and so on. If this "sequential convexification" procedure always reached the true convex hull, computing facets of a hard disjunctive set would reduce to a sequence of much easier single-disjunction computations. Balas shows the answer is negative in general — a two-variable integer program is a standard counterexample — but identifies an important class of disjunctive programs, the facial ones, for which sequential convexification always works. This class includes 0-1 programming (pure or mixed), nonconvex quadratic programming, separable programming, and the linear complementarity problem, though not general integer programming.

Setting

Let F0:={x∈Rn:Ax≥b, x≥0}F_0 := \{x \in \mathbb{R}^n : Ax \ge b,\ x \ge 0\}F0​:={x∈Rn:Ax≥b, x≥0}. A disjunctive program in conjunctive normal form has constraint set

F:={x∈F0:∀j∈S, ∃ i∈Qj, dix≥di0},F := \Big\{x \in F_0 : \forall j \in S,\ \exists\, i \in Q_j,\ d_i x \ge d_{i0}\Big\},F:={x∈F0​:∀j∈S, ∃i∈Qj​, di​x≥di0​},

for a finite set SSS and, for each j∈Sj \in Sj∈S, a finite set QjQ_jQj​ of halfspace data (di,di0)i∈Qj(d_i, d_{i0})_{i \in Q_j}(di​,di0​)i∈Qj​​ — one elementary disjunction per j∈Sj \in Sj∈S. The program is facial if every inequality dix≥di0d_i x \ge d_{i0}di​x≥di0​ appearing in some disjunction defines a face of F0F_0F0​, i.e. F0∩{x:dix≥di0}F_0 \cap \{x : d_i x \ge d_{i0}\}F0​∩{x:di​x≥di0​} is an extreme subset of F0F_0F0​ for every such iii. Fixing an ordering σ\sigmaσ of SSS, the sequential-convexification recursion sets F0F_0F0​ (step zero) to be the base polyhedron and, for each subsequent step, imposes the next disjunction and reconvexifies: Fk+1:=conv[⋃i∈Qσ(k)(Fk∩{x:dix≥di0})]F_{k+1} := \mathrm{conv}\big[\bigcup_{i \in Q_{\sigma(k)}} (F_k \cap \{x : d_i x \ge d_{i0}\})\big]Fk+1​:=conv[⋃i∈Qσ(k)​​(Fk​∩{x:di​x≥di0​})].

For the necessity direction, write Dj:=⋁i∈Qj(dix≥di0)D_j := \bigvee_{i \in Q_j}(d_i x \ge d_{i0})Dj​:=⋁i∈Qj​​(di​x≥di0​) and, reversing every inequality, Dˉj:=⋁i∈Qj(dix≤di0)\bar D_j := \bigvee_{i \in Q_j}(d_i x \le d_{i0})Dˉj​:=⋁i∈Qj​​(di​x≤di0​).

Formalization targets

Theorem 3.1 (goal) — faciality is sufficient

F facial  ⟹  F∣S∣=conv(F),for every ordering σ of S.F \text{ facial} \implies F_{|S|} = \mathrm{conv}(F), \quad \text{for every ordering } \sigma \text{ of } S.F facial⟹F∣S∣​=conv(F),for every ordering σ of S.

This is the weakest correct statement of the recursion's endpoint: it asserts the sequential procedure reaches exactly conv(F)\mathrm{conv}(F)conv(F) (not, say, some fixed superset), and — since σ\sigmaσ is universally quantified — that this holds regardless of the order in which disjunctions are imposed.

Lemma 3.2 — the halfspace-intersection lemma

P⊆H+  ⟹  H−∩conv(P)=conv(H−∩P),P \subseteq H^+ \implies H^- \cap \mathrm{conv}(P) = \mathrm{conv}(H^- \cap P),P⊆H+⟹H−∩conv(P)=conv(H−∩P),

for a union PPP of finitely many polyhedra and opposite halfspaces H+,H−H^+, H^-H+,H−.

Theorem 3.3 — the exact necessary-and-sufficient condition

conv[(conv Fj−1)∩Dj]=conv(Fj−1∩Dj)  ⟺  the constraint boundary condition holds for Fj−1,Dj.\mathrm{conv}\big[(\mathrm{conv}\,F_{j-1}) \cap D_j\big] = \mathrm{conv}(F_{j-1} \cap D_j) \iff \text{the constraint boundary condition holds for } F_{j-1}, D_j.conv[(convFj−1​)∩Dj​]=conv(Fj−1​∩Dj​)⟺the constraint boundary condition holds for Fj−1​,Dj​.

Significance

The results themselves. Theorem 3.1 is what makes sequential convexification a practical tool rather than a theoretical curiosity: for a 0-1 program with nnn binary variables, it lets the convex hull be built in nnn stages, each requiring only the facets of a two-term disjunction — tractable, in contrast to generating facets of the full integer hull directly. Theorem 3.3 puts the boundary of applicability on rigorous footing: faciality is sufficient but not necessary, and Theorem 3.3 pins down the exact condition, showing precisely why sequential convexification is a genuinely restrictive property (holding for 0-1 programs but not general integer programs) rather than a universal fact about unions of polyhedra.

Formalizing it. No object in this mission — faciality, the sequential-convexification recursion, or the relative-boundary constraint condition — exists on the platform prior to this mission or in Mathlib. This mission restates the disjunctive-set vocabulary of the earlier missions in this series locally (per the series convention that a draft mission cannot import another draft mission's definitions) and is otherwise self-contained.

Difficulty

The natural first guess is that sequential convexification should always work, since at each step the procedure only discards points excluded by a valid disjunction. The book's own two-variable integer-programming example (imposing integrality on x1x_1x1​, then on x2x_2x2​) refutes this directly: the resulting set strictly contains the true integer hull. The reason faciality repairs this is subtle and is exactly what Lemma 3.2 isolates: the recursion's correctness at each step needs the previous partial hull, intersected with the new disjunction's halfspace, to already equal the convex hull of the intersection taken before convexifying — and this commutation of convex hull and halfspace intersection is exactly what fails when the halfspace does not respect a face of the underlying polyhedron. Theorem 3.3 shows this is not merely Lemma 3.2's specific route to a sufficient condition, but the precise dividing line: the "if" direction says checking the boundary condition only for segments between two points already suffices, which is what makes facial sufficiency provable by induction in the first place.

Formalization scope

All results are stated over Fin n → ℝ with matrices Matrix (Fin m) (Fin n) ℝ. The disjunction structure uses a finite index type S with a dependent family of finite index types Qidx : S → Type*, matching the book's S, Q_j. Faciality (Facial) uses Mathlib's IsExtreme directly, matching the book's own primary definition of "defines a face" rather than its immediate "clearly equivalent" restatement (F₀ ⊆ {d_i x ≤ d_{i0}}). The relative boundary in Theorem 3.3 ("the boundary of Dˉj\bar D_jDˉj​ in the affine space spanned by Dˉj\bar D_jDˉj​") is Mathlib's intrinsicFrontier, the standard formalization of a set's boundary relative to its own affine hull. The book's own "∈\in∈" in the constraint boundary condition's conclusion (rather than "⊆\subseteq⊆", which set-membership syntax would require for a set on the left) is read as set inclusion, the only mathematically sound reading, and is transcribed as ⊆ in the Lean statement while the milestone's verbatim text preserves the book's own "∈\in∈" unchanged, per the verbatim-quotation convention.

A trivializing formalization is ruled out explicitly: Theorem 3.1 is stated for an arbitrary finite S and Qidx, not fixed at a small size (e.g. |S| = 1, which would make the recursion's endpoint trivially equal to a single step and prove nothing about sequencing), and the recursion's ordering σ is universally quantified rather than fixed to a canonical choice, matching the theorem's own order-independence claim.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 3.
  • E. Balas, Disjunctive programming: Properties of the convex hull of feasible points, Discrete Applied Mathematics 89 (1998), 3–44 (cited in the text as [6], the origin of Theorem 3.1).
  • R. Stubbs, S. Mehrotra, A branch-and-cut method for 0-1 mixed convex programming, Mathematical Programming 86 (1999), 515–532 (cited in the text as [116], extending sequential convexifiability to convex mixed 0-1 programs).
6 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming V: Moving Between Conjunctive and Disjunctive Normal FormsTextbook

Motivation

Chapter 2 gives a compact lifted description of the closed convex hull of a disjunctive set once it is written as a union of polyhedra (its disjunctive normal form, DNF). But most discrete optimization problems present their feasible region the opposite way: as a conjunction of many small disjunctions (the conjunctive normal form, CNF) — "linear constraints, and x1∈{0,1}x_1 \in \{0,1\}x1​∈{0,1}, and x2∈{0,1}x_2 \in \{0,1\}x2​∈{0,1}, and so on" — each easy to reason about on its own but expensive to convert to DNF directly, since converting a CNF with ttt conjuncts of q1,…,qtq_1,\dots,q_tq1​,…,qt​ terms each can blow the DNF up to as many as q1×⋯×qtq_1 \times \cdots \times q_tq1​×⋯×qt​ polyhedra. Chapter 4 develops the machinery for moving between these two extremes without paying that combinatorial cost all at once: the basic step, which merges two conjuncts into one, and the hull-relaxation, an intermediate polyhedral relaxation that tightens monotonically with every basic step performed, converging exactly to the true convex hull once the disjunctive set reaches DNF.

Setting

A disjunctive set is in regular form (RF) if F=⋂j∈TSjF = \bigcap_{j \in T} S_jF=⋂j∈T​Sj​ with each Sj=⋃i∈QjPiS_j = \bigcup_{i \in Q_j} P_iSj​=⋃i∈Qj​​Pi​ a union of polyhedra. SjS_jSj​ is elementary if every PiP_iPi​ is a halfspace (the RF is then the CNF), and improper if SjS_jSj​ literally equals a single polyhedron PiP_iPi​. Writing T∗T^*T∗ for the improper indices, P0:=⋂j∈T∗SjP_0 := \bigcap_{j \in T^*} S_jP0​:=⋂j∈T∗​Sj​ is FFF's polyhedral part. The hull-relaxation of a regular form is

h-rel(F):=⋂j∈Tcl conv(Sj),h\text{-}\mathrm{rel}(F) := \bigcap_{j \in T} \mathrm{cl}\,\mathrm{conv}(S_j),h-rel(F):=j∈T⋂​clconv(Sj​),

a relaxation of FFF distinct from cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) itself: it convexifies each conjunct before intersecting, which is generally weaker. A basic step replaces two conjuncts Sk,SlS_k, S_lSk​,Sl​ (k≠lk \ne lk=l) of a regular form by their intersection Sk∩SlS_k \cap S_lSk​∩Sl​ (itself brought to DNF via distributivity), reducing the number of conjuncts by one; repeating this ∣T∣−1|T|-1∣T∣−1 times brings any regular form to DNF. For a convex set SSS, its extreme direction vectors are the extreme rays of its recession cone.

Formalization targets

Theorem 4.7 (goal) — the hull-relaxation hierarchy

For a sequence of regular forms F0,…,FtF_0, \dots, F_tF0​,…,Ft​ of the same disjunctive set, with F0F_0F0​ in CNF, FtF_tFt​ in DNF, and each FiF_iFi​ obtained from Fi−1F_{i-1}Fi−1​ by a basic step:

P0=h-rel(F0)⊇h-rel(F1)⊇⋯⊇h-rel(Ft)=cl conv(Ft).P_0 = h\text{-}\mathrm{rel}(F_0) \supseteq h\text{-}\mathrm{rel}(F_1) \supseteq \cdots \supseteq h\text{-}\mathrm{rel}(F_t) = \mathrm{cl}\,\mathrm{conv}(F_t).P0​=h-rel(F0​)⊇h-rel(F1​)⊇⋯⊇h-rel(Ft​)=clconv(Ft​).

The chain of lemmas the goal is built from

Theorem 4.1 (Sk∩Sl=⋃(i,j)(Pi∩Pj)S_k \cap S_l = \bigcup_{(i,j)}(P_i \cap P_j)Sk​∩Sl​=⋃(i,j)​(Pi​∩Pj​), the basic-step identity), Theorem 4.4 (the hull of a union of halfspaces is Rn\mathbb{R}^nRn or the halfspace itself), Lemma 4.5 (h-rel(F0)=P0h\text{-}\mathrm{rel}(F_0) = P_0h-rel(F0​)=P0​ for a CNF F0F_0F0​), and Lemma 4.6 (cl conv(S1∩S2)⊆cl conv(S1)∩cl conv(S2)\mathrm{cl}\,\mathrm{conv}(S_1 \cap S_2) \subseteq \mathrm{cl}\,\mathrm{conv}(S_1) \cap \mathrm{cl}\,\mathrm{conv}(S_2)clconv(S1​∩S2​)⊆clconv(S1​)∩clconv(S2​), driving each inclusion of the chain).

The sharpening and payoff results

Theorem 4.8 (an exact extreme-point/extreme-direction criterion for when Lemma 4.6 is equality), Corollary 4.9 (a worked case where merging "0-1" disjunctions brings no gain), and Theorem 4.10 (any regular form is the projection of a mixed 0-1 program using no more binary variables than the original CNF).

Significance

The results themselves. Theorem 4.7 turns the exponential CNF-to-DNF blowup into a controllable, monotone process: rather than converting all at once, a solver can perform basic steps selectively — wherever Theorem 4.8's criterion promises a genuine tightening — and always have a valid, improving polyhedral relaxation available at every intermediate stage. Theorem 4.10 is what makes this practical for integer programming specifically: it shows the number of 0-1 variables needed never has to grow, no matter how many basic steps are performed, only the number of continuous lifted variables does.

Formalizing it. No object in this mission — regular form, the hull-relaxation operator, basic steps, or extreme direction vectors — exists on the platform prior to this mission or in Mathlib. This mission restates the disjunctive-set and convex-hull vocabulary of the earlier missions in this series locally (per the series convention that a draft mission cannot import another draft mission's definitions).

Difficulty

The obvious first attempt collapses h-rel to cl conv throughout, reasoning that since the chain ends at cl conv(Ft)\mathrm{cl}\,\mathrm{conv}(F_t)clconv(Ft​), the intermediate terms should behave the same way. This is exactly backwards: h-rel is always at least as large as the true convex hull at every intermediate stage (Lemma 4.6 gives containment, not equality, in general), and the chapter's own Example 1 exhibits a CNF whose hull-relaxation strictly exceeds cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) until enough basic steps have been performed. The real difficulty Theorem 4.8 isolates is recognizing which basic steps actually tighten the relaxation: merging conjuncts whose extreme points and directions already coincide with those of the pairwise intersections gains nothing (Corollary 4.9's worked case), while merging conjuncts that interact more intricately can produce a strictly tighter bound — and no general rule beyond Theorem 4.8's own extreme-point criterion identifies which case holds.

Formalization scope

All results are stated over Fin n → ℝ with matrices Matrix (Fin m) (Fin n) ℝ. A regular form's conjuncts are represented as an arbitrary function T → Set (Fin n → ℝ) (rather than requiring every conjunct's internal polyhedral structure to be uniformly tracked through the whole chapter), with IsDisjunctiveUnion/IsElementaryDisjunction as existential well-formedness predicates asserting each conjunct genuinely is a union of polyhedra/halfspaces where that matters. IsBasicStepOf states a basic step abstractly via an index-type equivalence, since its mathematical content is which two conjuncts merge and into what, not any particular relabeling scheme; Theorem 4.7's own sequence of regular forms is a dependent family T : Fin (t+1) → Type* precisely because each basic step genuinely changes the index type (one fewer conjunct).

Theorem 4.7's three-part conclusion (initial equality, step-by-step containments, final equality) is stated as a conjunction rather than a single chained relation, since Lean has no native mixed equality/containment chain notation; this preserves the chapter's own warning that only the last hull-relaxation in the chain is asserted equal to the true convex hull. Theorem 4.10's index set MiM_iMi​ (which term of each original disjunction a given conjunct's disjunct picked) is taken as given structural data satisfying the book's own defining relationship, matching the source's own treatment of MiM_iMi​ as a named auxiliary index set rather than a from-scratch construction. Chapter 4's §4.5–4.6 (a machine-sequencing application with its own bespoke scheduling objects, Theorems 4.11–4.12) is out of scope for this mission — it introduces application-specific vocabulary not shared by the chapter's general hull-relaxation theory, not because it is difficult.

A trivializing formalization is ruled out explicitly: every theorem is stated for generic finite index types, never fixed at a small size that would collapse a union or intersection to a single term, and the chapter's own propositional-logic DNF/CNF conversion (informal narrative via truth tables in §1.3) is not itself a formalization target — this mission works entirely at the polyhedral-set level the chapter's own numbered results occupy.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 4, §4.1–4.4.
  • V. Chvátal, Linear Programming, W. H. Freeman, 1983 (cited in the text as [12], the origin of Theorem 4.1's basic step).
  • E. Balas, Disjunctive programming: Properties of the convex hull of feasible points, Discrete Applied Mathematics 89 (1998), 3–44 (the origin of the hull-relaxation hierarchy).
11 thms4 active usersReviewed
🏆Completed
CombinatoricsLinear OptimizationOperations Research+1·Captain: Shuze Chen

Disjunctive Programming VI: Extended Formulations for Perfectly Matchable Subgraph PolytopesTextbook

Motivation

Many polytopes that arise from combinatorial optimization problems have no small facet description in their natural variable space, yet become describable by a compact linear system once lifted to a higher-dimensional space of auxiliary variables and projected back down — Chapter 2's own extended formulation of the convex hull of a disjunctive set is one instance of this phenomenon. This chapter turns the idea around: rather than using projection to build a compact formulation, it uses projection to prove integrality of a formulation that is already compact but whose integrality is not obvious from any standard sufficient condition (total unimodularity, balancedness, etc.). The technique is illustrated on three closely related combinatorial polytopes built from perfectly matchable, assignable, and path-decomposable vertex subsets of a graph or digraph — each proved integral by lifting to an edge- or arc-variable space where total unimodularity is easy to check, then projecting.

Setting

For a finite vertex set VVV, the incidence vector of W⊆VW \subseteq VW⊆V is 111 on WWW, 000 elsewhere, and x(S):=∑i∈Sxix(S) := \sum_{i \in S} x_ix(S):=∑i∈S​xi​. A graph G(W)G(W)G(W) has a perfect matching if there is a fixed-point-free involution on WWW respecting adjacency. The PMS (Perfectly Matchable Subgraph) polytope of GGG is conv(X)\mathrm{conv}(X)conv(X) where XXX is the set of incidence vectors of such WWW; N(S):={j∉S:(i,j)∈E for some i∈S}N(S) := \{j \notin S : (i,j) \in E \text{ for some } i \in S\}N(S):={j∈/S:(i,j)∈E for some i∈S}.

For a digraph (V,A)(V,A)(V,A): G(W)G(W)G(W) is assignable if it admits a cycle decomposition (a permutation of WWW respecting arcs), giving the Assignable Subgraph Polytope. For an acyclic digraph with distinguished nodes s,ts,ts,t: G(W∪{s,t})G(W \cup \{s,t\})G(W∪{s,t}) admits an sss-ttt path decomposition if a collection of interior-node-disjoint sss-ttt paths covers it, giving the sss-ttt Path Decomposable Subgraph Polytope over W⊆V∖{s,t}W \subseteq V \setminus \{s,t\}W⊆V∖{s,t}. Γ(S)\Gamma(S)Γ(S) and Γ∗(S)\Gamma^*(S)Γ∗(S) are the corresponding out-neighborhood operators. For an arbitrary graph, c(S)c(S)c(S) counts the connected components of the induced subgraph G(S)G(S)G(S).

Formalization targets

Theorem 5.1 (goal) — the PMS polytope of a bipartite graph

0≤xi≤1 (i∈V),x(V1)−x(V2)=0,x(S)−x(N(S))≤0  (S⊆V1).0 \le x_i \le 1\ (i \in V), \qquad x(V_1) - x(V_2) = 0, \qquad x(S) - x(N(S)) \le 0\ \ (S \subseteq V_1).0≤xi​≤1 (i∈V),x(V1​)−x(V2​)=0,x(S)−x(N(S))≤0  (S⊆V1​).

Theorem 5.2 — the Assignable Subgraph Polytope

0≤xi≤1 (i∈V),x(S∖Γ(S))−x(Γ(S)∖S)≤0(S⊆V).0 \le x_i \le 1\ (i \in V), \qquad x(S \setminus \Gamma(S)) - x(\Gamma(S) \setminus S) \le 0 \quad (S \subseteq V).0≤xi​≤1 (i∈V),x(S∖Γ(S))−x(Γ(S)∖S)≤0(S⊆V).

Theorem 5.3 — the sss-ttt Path Decomposable Subgraph Polytope

0≤xi≤1 (i∈V),x(S∖Γ∗(S))−x(Γ∗(S)∖S)≤0(S⊆V∖{s,t}).0 \le x_i \le 1\ (i \in V), \qquad x(S \setminus \Gamma^*(S)) - x(\Gamma^*(S) \setminus S) \le 0 \quad (S \subseteq V \setminus \{s,t\}).0≤xi​≤1 (i∈V),x(S∖Γ∗(S))−x(Γ∗(S)∖S)≤0(S⊆V∖{s,t}).

Theorem 5.4 — the PMS polytope of an arbitrary graph

0≤xi≤1 (i∈V),x(S)−x(N(S))≤∣S∣−c(S)0 \le x_i \le 1\ (i \in V), \qquad x(S) - x(N(S)) \le |S| - c(S)0≤xi​≤1 (i∈V),x(S)−x(N(S))≤∣S∣−c(S)

for every SSS all of whose components are single nodes or nonbipartite with odd order — the weakest faithful statement, since dropping the side condition would assert the inequality for subsets it does not hold for.

Significance

The results themselves. Each theorem gives an explicit, checkable linear system defining a polytope that arises naturally from a combinatorial covering/decomposition property, turning "does G(W)G(W)G(W) have property XXX" into a linear-programming feasibility question. Theorem 5.1 is the one the book proves in full and the template for the other three: bipartite matching, digraph assignment, and acyclic-digraph path decomposition are structurally parallel problems (all reduce to checking a König–Hall-type combinatorial condition), and the same lift-and-project technique handles all three uniformly. Theorem 5.4 extends the idea to arbitrary (non-bipartite) graphs at the cost of a sharper right-hand side and a component-based side condition, connecting to Edmonds' classical matching-polytope theory while remaining a genuinely different object (a polytope of coverable vertex sets, not of matchings themselves).

Formalizing it. No object in this mission — the PMS, Assignable, or Path Decomposable Subgraph polytopes, or their defining neighbor operators — exists on the platform prior to this mission. The closest platform result, MetricTSP.pm_polytope_decomposition (Edmonds' perfect matching polytope theorem, in edge-variable space over a fixed vertex set requiring every vertex matched), is a genuinely different object from Theorem 5.4's PMS polytope (vertex-variable space, vertices may be left unmatched by design) and is not reused as a kind: reference item; it is noted here as related, not equivalent.

Difficulty

The natural first attempt tries to verify each polytope's integrality directly, by checking a known sufficient condition (total unimodularity, balancedness) on the displayed vertex-space system itself. This fails: the book states explicitly that (5.5)'s coefficient matrix is not totally unimodular, which is exactly why the lift-to-edge-variables step is necessary at all. The real content of each theorem is the two-part argument: (1) the lifted system in edge/arc variables is totally unimodular (checkable directly), so its polyhedron is integral; and (2) the vertex- space system is exactly the projection of the lifted one — a nontrivial fact requiring Chapter 2's projection machinery, not merely an unfolding of definitions. Theorem 5.4's extra difficulty, flagged explicitly in the text, is that its projection cone is not pointed, so the proof must work with a finite generating set rather than extreme rays, and it suffices to find a subset of generators producing every facet rather than a complete generating set — a genuinely harder argument the book itself outsources to a citation.

Formalization scope

Undirected graphs use Mathlib's SimpleGraph; digraphs use a bare relation A : V → V → Prop (not required symmetric or irreflexive, matching the book's unrestricted notion). Bipartition is recorded via part : V → Bool (decidable by construction) rather than two Set V halves, keeping the sums x(V_1), x(V_2) computable over Finsets throughout. IsAssignable uses Equiv.Perm on the vertex-set subtype, since a cycle decomposition is exactly a permutation. IsComponentOf and IsBipartiteOn (Theorem 5.4) are built directly from reachability and 2-colorability rather than Mathlib's induced-subgraph/ConnectedComponent API, matching the "maximal connected subset" reading of "component" the book's own prose intends.

IsPathDecomposable (Theorem 5.3) encodes "admits an sss-ttt path decomposition" via a degree-constrained arc set (every interior node has exactly one incoming and one outgoing chosen arc, none entering sss or leaving ttt, at least one leaving sss) rather than an explicit list of vertex-disjoint paths — provably equivalent by the standard fact that an acyclic arc set with this degree pattern always decomposes into such a path family, and considerably lighter to state and reason about than constructing Path objects directly.

A trivializing formalization is ruled out explicitly: every theorem keeps the fractional box constraint 0≤xi≤10 \le x_i \le 10≤xi​≤1 rather than the integral xi∈{0,1}x_i \in \{0,1\}xi​∈{0,1} (per BRIEF.md's own warning, dropping the relaxation collapses the claim to a restatement of the combinatorial definition), and Theorem 5.1 is stated only for bipartite graphs — never generalized to subsume Theorem 5.4's genuinely different inequality system and side condition.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 5, §5.2.
  • M. O. Ball, U. Derigs, An analysis of alternate strategies for implementing matching algorithms, Networks 13 (1983) (cited in the text as [13], the origin of Theorems 5.2 and 5.3).
  • W. R. Pulleyblank, J. Edmonds, Facets of 1-matching polyhedra, in Hypergraph Seminar, Springer Lecture Notes in Mathematics 411 (1974) — the origin of the perfectly matchable subgraph polytope literature (cited in the text as [34], the origin of Theorem 5.1).
  • L. Lovász, M. D. Plummer, Matching Theory, Elsevier, 1986 (cited in the text as [35], the origin of Theorem 5.4).
7 thms3 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming VII: Lift-and-Project Cuts for Mixed 0-1 ProgramsTextbook

Motivation

A mixed 0-1 program's feasible region is a disjunctive set built from the split disjunctions xj≤0∨xj≥1x_j \le 0 \lor x_j \ge 1xj​≤0∨xj​≥1, one per binary variable — a special case general enough that Chapter 2's convex-hull machinery applies directly, yet structured enough to produce closed-form cutting planes efficiently. The resulting lift-and-project (L&P) cuts, generated by solving a small auxiliary linear program (the cut-generating LP, CGLP) rather than by hand-derived combinatorial argument, were part of a cluster of ideas that drove a dramatic improvement in commercial mixed-integer solvers' practical performance from the mid-1990s onward. This chapter develops the theory that makes L&P cuts computationally practical: how to bound how many rounds of cutting are needed (disjunctive rank), what can and cannot be guaranteed about intermediate fractional solutions during sequential convexification, how to generate a cut cheaply by solving the CGLP only over the LP relaxation's active variables and lift the result back to the full variable space in closed form, and how to strengthen a single-disjunction cut into one valid for the whole integer program using the integrality of the other 0-1 variables.

Setting

For the mixed 0-1 program min⁡{cx:Ax≥b, x≥0, xj∈{0,1}, j=1,…,p}\min\{cx : Ax \ge b,\ x \ge 0,\ x_j \in \{0,1\},\ j=1,\dots,p\}min{cx:Ax≥b, x≥0, xj​∈{0,1}, j=1,…,p}, let PPP be its LP relaxation (written {x:A~x≥b~}\{x : \tilde A x \ge \tilde b\}{x:A~x≥b~} after folding in the bound constraints) and D:={x∈P:xj≤0∨xj≥1, j=1,…,p}D := \{x \in P : x_j \le 0 \lor x_j \ge 1,\ j=1,\dots,p\}D:={x∈P:xj​≤0∨xj​≥1, j=1,…,p} its disjunctive feasible set. Sequential convexification produces P1:=conv(P∩{x1∈{0,1}})P_1 := \mathrm{conv}(P \cap \{x_1 \in \{0,1\}\})P1​:=conv(P∩{x1​∈{0,1}}), then P1j:=conv(P1∩{xj∈{0,1}})P_{1j} := \mathrm{conv}(P_1 \cap \{x_j \in \{0,1\}\})P1j​:=conv(P1​∩{xj​∈{0,1}}), and so on. The cut-generating LP (CGLP) for the disjunction on coordinate jjj asks for (α,β)(\alpha,\beta)(α,β) and multipliers u,v≥0u,v \ge 0u,v≥0, scalars u0,v0u_0,v_0u0​,v0​, satisfying α−uA~+u0ej=0\alpha - u\tilde A + u_0 e_j = 0α−uA~+u0​ej​=0, $\alpha

  • v\tilde A - v_0 e_j = 0,, ,\beta - u\tilde b = 0,, ,\beta - v\tilde b - v_0 = 0.Solving‘(CGLP)‘onlyovera∗∗restricted∗∗setofactiverows/columns. Solving `(CGLP)` only over a **restricted** set of active rows/columns .Solving‘(CGLP)‘onlyovera∗∗restricted∗∗setofactiverows/columnsM_R, R$ gives (CGLP)^R, whose solution can be lifted back to a solution of the full (CGLP) in closed form.

Formalization targets

Theorem 6.4 (goal) — the general mixed-integer cut-lifting formula

γk=min⁡{αk1+u0⌈mˉk⌉, αk2−v0⌊mˉk⌋} (k∈N′),γk=αk (k∉N′),mˉk=αk2−αk1u0+v0,\gamma_k = \min\{\alpha^1_k + u_0\lceil \bar m_k\rceil,\ \alpha^2_k - v_0\lfloor \bar m_k\rfloor\} \ (k \in N'), \qquad \gamma_k = \alpha_k\ (k \notin N'), \qquad \bar m_k = \frac{\alpha^2_k - \alpha^1_k}{u_0+v_0},γk​=min{αk1​+u0​⌈mˉk​⌉, αk2​−v0​⌊mˉk​⌋} (k∈N′),γk​=αk​ (k∈/N′),mˉk​=u0​+v0​αk2​−αk1​​,

with γx≥β\gamma x \ge \betaγx≥β valid for the whole mixed 0-1 program, strengthening a cut αx≥β\alpha x \ge \betaαx≥β valid only for the single disjunction on jjj.

The chain of results building toward it

Theorem 6.1 (an extreme point of P1P_1P1​ cut off at a facet of P1jP_{1j}P1j​ cannot be fractional in x1x_1x1​ without being fractional in xjx_jxj​ too), Theorem 6.2 (an explicit closed-form extension of a restricted CGLP solution to the full CGLP), and Corollary 6.3 (the same fact, stated transparently via a max⁡{α1,α2}\max\{\alpha^1,\alpha^2\}max{α1,α2} formula and asserted feasible for the full CGLP).

Significance

The results themselves. Theorem 6.4 is what turns lift-and-project cuts from "valid for one binary variable's split" into genuine cuts for the whole mixed-integer program, using no information beyond the integrality of the other 0-1 variables — this strengthening step is part of why L&P cuts became practically competitive with other cutting-plane families. Theorem 6.2 and Corollary 6.3's cut-lifting property is, independently, what makes generating L&P cuts affordable at industrial scale: solving the CGLP only over a problem's few hundred active variables rather than its hundreds of thousands of total variables, then reading off the remaining coefficients in closed form.

Formalizing it. No object in this mission — the cut-generating LP, its restricted version, or the mixed-integer cut-lifting formula — exists on the platform prior to this mission or in Mathlib. This mission restates the disjunctive-set and convex-hull vocabulary of the earlier missions in this series locally (per the series convention that a draft mission cannot import another draft mission's definitions), applied specifically to the split disjunction on a single 0-1 variable.

Difficulty

The natural first attempt at Theorem 6.1 assumes that once x1x_1x1​ has been "locked in" by sequential convexification, every subsequent cut generated while processing later variables respects that integrality — the book's own Figures 6.1-6.2 refute this directly, exhibiting facet- defining cuts that cut through the interior of an edge at a point fractional in every coordinate. Theorem 6.1's genuine content is the narrower but still useful fact that extreme points of the right intersection cannot exhibit this failure. The difficulty in Theorem 6.4 is recognizing that naively substituting xj−mx≤0∨xj−mx≥1x_j - mx \le 0 \lor x_j - mx \ge 1xj​−mx≤0∨xj​−mx≥1 for varying integer vectors mmm gives a family of valid cuts, not a single one — the theorem's content is the closed-form choice of mmm (via rounding mˉk\bar m_kmˉk​ up or down, whichever yields the smaller coefficient) that is provably optimal within this family, not merely one valid choice among many.

Formalization scope

All results are stated over Fin n → ℝ with the CGLP's row space left as an abstract finite type M (rather than fixing the exact m+p+n-row block structure the book's own augmented matrix à has), since the substantive content of every theorem in this chapter depends only on dot products against columns of Ã, never on which literal row a given bound constraint occupies. Alpha1/Alpha2 (Corollary 6.3's row-restricted dot products) and Alpha1_64/Alpha2_64 (Theorem 6.4's eq.-(6.4) values, which add or subtract u0u_0u0​/v0v_0v0​ at the disjunction coordinate) are kept as separate definitions throughout, per BRIEF.md's explicit warning that the two chapters' "α1,α2\alpha^1,\alpha^2α1,α2" notation refers to different formulas despite the shared symbol.

Theorem 6.2's closed-form extension is formalized via the values it assigns (matching every printed formula for ū_{m+i}, v̄_{m+i}, ᾱ_i), without committing to the book's own literal row-block indexing (m+i vs. m+n+i) for the fresh rows a full reading of the source does not fully disambiguate for variables outside the 0-1 index set — Corollary 6.3, the chapter's own "more transparent" restatement of the same fact, is instead formalized with an explicit fresh-row construction (AtilExt, BtilExt) verifying genuine feasibility for the extended (CGLP). In Theorem 6.4, u0,v0>0u_0, v_0 > 0u0​,v0​>0 is stated as an explicit hypothesis, matching BRIEF.md's flag that this positivity (needed for mˉk\bar m_kmˉk​'s division) is implicit in the CGLP feasibility setup rather than a free-standing assumption of the printed theorem.

A trivializing formalization is ruled out explicitly: Theorem 6.4's conclusion is stated as genuine validity for the full MIPDisjunctiveSet (imposing 0/10/10/1 simultaneously on every k∈N′k \in N'k∈N′), not merely as the closed-form formula for γ\gammaγ with no accompanying validity claim, which would omit the theorem's actual mathematical content.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 6.
  • E. Balas, S. Ceria, G. Cornuéjols, A lift-and-project cutting plane algorithm for mixed 0-1 programs, Mathematical Programming 58 (1993), 295–324 (cited in the text as [19], the origin of Theorems 6.2 and the CGLP construction).
  • E. Balas, M. Perregaard, A precise correspondence between lift-and-project cuts, simple disjunctive cuts, and mixed integer Gomory cuts for 0-1 programming, Mathematical Programming 94 (2003) (cited in the text as [20], the origin of Corollary 6.3).
8 thms4 active users
🏆Completed
Convex OptimizationMachine LearningOperations Research+2·Captain: mikedeng1

Distributionally Robust Logistic Regression I: The Worst-Case Expected Logloss over a Wasserstein Ball Is a Tractable Convex ProgramResearch Paper

Motivation

Logistic regression is among the most widely used classification methods in statistics and machine learning. Its maximum-likelihood estimator minimizes the average logloss on the training data and is known to overfit when data are scarce; practitioners respond with ad hoc regularization, typically a norm penalty on the weight vector. Shafieezadeh-Abadeh, Mohajerin Esfahani and Kuhn (NIPS 2015, arXiv:1509.09259) replace the empirical average by a worst case over all distributions within a Wasserstein ball around the empirical distribution. The resulting model has a finite convex reformulation, contains classical and norm-regularized logistic regression as special cases, and comes with out-of-sample guarantees. It is one of the early instances of Wasserstein distributionally robust optimization in learning, building on the duality theory of Mohajerin Esfahani and Kuhn (Math. Program. 2018, arXiv:1505.05116); the regularization interpretation was later extended to general losses by Shafieezadeh-Abadeh, Kuhn and Mohajerin Esfahani (JMLR 2019, arXiv:1710.10016).

Setting

Let VVV be the feature space Rn\mathbb R^nRn with an arbitrary norm ∥⋅∥\|\cdot\|∥⋅∥, and let ∥β∥∗=sup⁡∥x∥≤1⟨β,x⟩\|\beta\|_* = \sup_{\|x\|\le1}\langle\beta,x\rangle∥β∥∗​=sup∥x∥≤1​⟨β,x⟩ be the dual norm of a weight vector β\betaβ. Labels are y∈{−1,+1}y\in\{-1,+1\}y∈{−1,+1}, and the feature-label space is Ξ=V×{−1,+1}\Xi = V\times\{-1,+1\}Ξ=V×{−1,+1}. The logloss of β\betaβ at (x,y)(x,y)(x,y) is

lβ(x,y)=log⁡(1+exp⁡(−y⟨β,x⟩)).l_\beta(x,y) = \log\big(1+\exp(-y\langle\beta,x\rangle)\big).lβ​(x,y)=log(1+exp(−y⟨β,x⟩)).

For a label weight κ>0\kappa>0κ>0, the metric of Definition 2 on Ξ\XiΞ is

d((x,y),(x′,y′))=∥x−x′∥+κ ∣y−y′∣/2,d\big((x,y),(x',y')\big) = \|x-x'\| + \kappa\,|y-y'|/2 ,d((x,y),(x′,y′))=∥x−x′∥+κ∣y−y′∣/2,

so that changing a label costs κ\kappaκ. The Wasserstein distance W(Q,P)W(\mathbb Q,\mathbb P)W(Q,P) between probability distributions on Ξ\XiΞ (Definition 1) is the infimum of ∫d(ξ,ξ′) Π(dξ,dξ′)\int d(\xi,\xi')\,\Pi(d\xi,d\xi')∫d(ξ,ξ′)Π(dξ,dξ′) over all couplings Π\PiΠ of Q\mathbb QQ and P\mathbb PP, and Bε(P)={Q:W(Q,P)≤ε}\mathbb B_\varepsilon(\mathbb P) = \{\mathbb Q : W(\mathbb Q,\mathbb P)\le\varepsilon\}Bε​(P)={Q:W(Q,P)≤ε}. Given training samples (x^i,y^i)i=1N(\hat x_i,\hat y_i)_{i=1}^N(x^i​,y^​i​)i=1N​, the empirical distribution is P^N=1N∑iδ(x^i,y^i)\hat{\mathbb P}_N = \frac1N\sum_i\delta_{(\hat x_i,\hat y_i)}P^N​=N1​∑i​δ(x^i​,y^​i​)​, and the distributionally robust logistic regression problem (6) is

J^=inf⁡β sup⁡Q∈Bε(P^N)EQ[lβ(x,y)].\hat J = \inf_\beta\ \sup_{\mathbb Q\in\mathbb B_\varepsilon(\hat{\mathbb P}_N)} \mathbb E^{\mathbb Q}\big[l_\beta(x,y)\big].J^=βinf​ Q∈Bε​(P^N​)sup​EQ[lβ​(x,y)].

Program (7) has variables β\betaβ, λ∈R\lambda\in\mathbb Rλ∈R, s∈RNs\in\mathbb R^Ns∈RN, objective λε+1N∑isi\lambda\varepsilon + \frac1N\sum_i s_iλε+N1​∑i​si​, and constraints lβ(x^i,y^i)≤sil_\beta(\hat x_i,\hat y_i)\le s_ilβ​(x^i​,y^​i​)≤si​, lβ(x^i,−y^i)−λκ≤sil_\beta(\hat x_i,-\hat y_i)-\lambda\kappa\le s_ilβ​(x^i​,−y^​i​)−λκ≤si​ for all iii, and ∥β∥∗≤λ\|\beta\|_*\le\lambda∥β∥∗​≤λ.

Formalization targets

Goal: Theorem 1 (tractable reformulation)

For every ε≥0\varepsilon\ge0ε≥0, κ>0\kappa>0κ>0, N≥1N\ge1N≥1 and every norm on the feature space,

inf⁡β sup⁡Q∈Bε(P^N)EQ[lβ]  =  inf⁡{λε+1N∑isi:(β,λ,s) feasible for (7)},\inf_\beta\ \sup_{\mathbb Q\in\mathbb B_\varepsilon(\hat{\mathbb P}_N)}\mathbb E^{\mathbb Q}[l_\beta] \;=\; \inf\Big\{\lambda\varepsilon+\tfrac1N\textstyle\sum_i s_i : (\beta,\lambda,s)\text{ feasible for (7)}\Big\},βinf​ Q∈Bε​(P^N​)sup​EQ[lβ​]=inf{λε+N1​∑i​si​:(β,λ,s) feasible for (7)},

and for ε>0\varepsilon>0ε>0 the infimum of (7) is attained.

Milestones

  1. §3.1 — the feasible set of (7) is convex.
  2. §2 — for ε=0\varepsilon=0ε=0 the worst-case expected logloss is the empirical average logloss, so (6) reduces to classical logistic regression (2).
  3. Theorem 1 for fixed β\betaβ — sup⁡Q∈Bε(P^N)EQ[lβ]\sup_{\mathbb Q\in\mathbb B_\varepsilon(\hat{\mathbb P}_N)}\mathbb E^{\mathbb Q}[l_\beta]supQ∈Bε​(P^N​)​EQ[lβ​] equals the attained minimum of (7) over (λ,s)(\lambda,s)(λ,s) with β\betaβ fixed.
  4. Remark 2, eq. (9) — at an optimal solution (β^,λ^,s^)(\hat\beta,\hat\lambda,\hat s)(β^​,λ^,s^),
J^=λ^ε+EP^N[lβ^]+1N∑imax⁡{0,y^i⟨β^,x^i⟩−λ^κ}.\hat J = \hat\lambda\varepsilon + \mathbb E^{\hat{\mathbb P}_N}[l_{\hat\beta}] + \tfrac1N\textstyle\sum_i\max\{0,\hat y_i\langle\hat\beta,\hat x_i\rangle-\hat\lambda\kappa\}.J^=λ^ε+EP^N​[lβ^​​]+N1​∑i​max{0,y^​i​⟨β^​,x^i​⟩−λ^κ}.
  1. Remark 1 — as κ→∞\kappa\to\inftyκ→∞ the optimal value of (7) converges to inf⁡βε∥β∥∗+1N∑ilβ(x^i,y^i)\inf_\beta \varepsilon\|\beta\|_* + \frac1N\sum_i l_\beta(\hat x_i,\hat y_i)infβ​ε∥β∥∗​+N1​∑i​lβ​(x^i​,y^​i​).
  2. Theorem 2, implication — if PN{P∈Bε(P^N)}≥1−η\mathbb P^N\{\mathbb P\in\mathbb B_\varepsilon(\hat{\mathbb P}_N)\}\ge1-\etaPN{P∈Bε​(P^N​)}≥1−η, then PN{EP[lβ^]≤J^}≥1−η\mathbb P^N\{\mathbb E^{\mathbb P}[l_{\hat\beta}]\le\hat J\}\ge1-\etaPN{EP[lβ^​​]≤J^}≥1−η.

Significance

Theorem 1 turns a minimax problem over an infinite-dimensional family of distributions into a finite convex program whose size grows linearly in NNN; with the ℓ1\ell_1ℓ1​, ℓ2\ell_2ℓ2​ or ℓ∞\ell_\inftyℓ∞​ norm it is a standard exponential-cone or conic program. Remark 1 explains norm-regularized logistic regression as a distributionally robust model: the regularizer is the dual norm of the transport cost on features, and the regularization weight is the radius of the ambiguity set. Remark 2 exposes an additional term that accounts for label noise and vanishes as label changes become prohibitively expensive. Theorem 2 makes the optimal value J^\hat JJ^ a certificate on the out-of-sample logloss whenever the ball contains the true distribution.

The paper's proofs are in a technical appendix and have not been machine-checked. Mathlib contains no Wasserstein distributionally robust duality. This mission produces a formal statement of the reformulation with an arbitrary norm and a label-dependent cost, together with formal versions of the paper's printed consequences of it (Remarks 1 and 2, the ε=0\varepsilon=0ε=0 reduction, and the implication in Theorem 2).

Difficulty

The worst-case expectation ranges over every Borel probability distribution within transport distance ε\varepsilonε of the empirical distribution, including distributions with unbounded support and distributions that move mass across labels. Exhibiting good distributions in the ball shows only that the robust value is at least the value of (7); the reverse inequality must control every distribution in the ball at once, and nothing in the definition of the ball bounds its elements' supports. The obvious simplification, restricting attention to distributions supported on finitely many points, again yields only a one-sided bound unless the supremum is shown to be approached by such distributions. The label term of the metric couples the two label classes, so results for a pure norm cost on the features do not apply directly, and the dual norm enters through an arbitrary norm rather than the Euclidean one.

Formalization scope

  • The feature space is an abstract finite-dimensional real normed space V standing for (Rn,∥⋅∥)(\mathbb R^n,\|\cdot\|)(Rn,∥⋅∥) with an arbitrary norm; weights are continuous linear functionals V →L[ℝ] ℝ, and ∥β∥∗\|\beta\|_*∥β∥∗​ is their operator norm, which is exactly the dual norm. Labels are Bool, embedded as ±1\pm1±1; the label −y-y−y is Boolean negation. The metric of Definition 2 is written literally.
  • The Wasserstein distance is of type 1, valued in [0,∞][0,\infty][0,∞], with couplings ranging over all probability measures on Ξ×Ξ\Xi\times\XiΞ×Ξ with the two prescribed marginals. The ball consists of probability measures.
  • Expectations of the positive logloss are lower Lebesgue integrals in [0,∞][0,\infty][0,∞], and the supremum over the ball is taken there; the optimal value of (7) is the infimum of its (nonnegative) objective over the feasible set, also in [0,∞][0,\infty][0,∞]. A Bochner integral, which vanishes on non-integrable functions, would make the worst case trivially finite and is not used.
  • The standing hypotheses are κ>0\kappa>0κ>0, ε≥0\varepsilon\ge0ε≥0, N≥1N\ge1N≥1.
  • Correction. The paper prints "min" in (7) for all ε≥0\varepsilon\ge0ε≥0. At ε=0\varepsilon=0ε=0 the minimum can fail to be attained (V=RV=\mathbb RV=R, N=1N=1N=1, x^1=1\hat x_1=1x^1​=1, y^1=+1\hat y_1=+1y^​1​=+1: the value is 000 but every feasible point has positive objective). The goal states the value identity for ε≥0\varepsilon\ge0ε≥0 and attainment for ε>0\varepsilon>0ε>0.
  • Remark 1 is formalized as convergence of optimal values as κ→∞\kappa\to\inftyκ→∞; a metric with κ=∞\kappa=\inftyκ=∞ is not formalized. Only convexity, not tractability, of (7) is stated. The first claim of Theorem 2 (the radius (8) and the light-tail assumption) is not formalized; the confidence of the ball event is a hypothesis of milestone 6.
  • A formalization in which the ball is taken only over distributions supported on the training samples, or in which the label term of the metric is dropped, trivializes the second constraint group of (7) and is ruled out: the ball here contains every Borel probability distribution on Ξ\XiΞ within the prescribed distance.
  • Infrastructure needed and reusable beyond this mission: type-1 optimal transport on product spaces with a label component, couplings and their marginals, and elementary properties of the logloss as a function of β\betaβ. Contributions of such supporting lemmas as independent theorems are welcome.

Selected references

  • S. Shafieezadeh-Abadeh, P. Mohajerin Esfahani, D. Kuhn, Distributionally Robust Logistic Regression, Advances in Neural Information Processing Systems 28 (NIPS 2015). https://arxiv.org/abs/1509.09259
  • P. Mohajerin Esfahani, D. Kuhn, Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations, Mathematical Programming 171 (2018). https://arxiv.org/abs/1505.05116
  • N. Fournier, A. Guillin, On the rate of convergence in Wasserstein distance of the empirical measure, Probability Theory and Related Fields 162 (2015). https://arxiv.org/abs/1312.2128
  • S. Shafieezadeh-Abadeh, D. Kuhn, P. Mohajerin Esfahani, Regularization via Mass Transportation, Journal of Machine Learning Research 20 (2019). https://arxiv.org/abs/1710.10016
9 thms2 active usersReviewed
🏆Completed
Linear OptimizationMachine LearningOperations Research+3·Captain: mikedeng1

Distributionally Robust Logistic Regression II: Worst- and Best-Case Misclassification Risks over a Wasserstein Ball Are Linear ProgramsResearch Paper

Motivation

A logistic regression model is fitted on finitely many samples, and the quantity a practitioner cares about is the misclassification risk of the fitted classifier on new data. Its empirical counterpart, the training error, is biased downwards, and classical generalization bounds give it an additive margin that depends on a complexity measure of the model class rather than on the data at hand.

Shafieezadeh-Abadeh, Mohajerin Esfahani and Kuhn (NIPS 2015) take a distributionally robust route. They surround the empirical distribution of the training data by a ball of distributions in the Wasserstein metric and, for a given weight vector, compute the largest and the smallest misclassification probability over that ball. Their Theorem 3 shows that both extremes are optimal values of explicit linear programs. Combined with a measure-concentration result for the empirical distribution in the Wasserstein metric (Fournier and Guillin, PTRF 2015), the two values bracket the true risk with a prescribed confidence. The same Wasserstein-ball construction underlies the data-driven optimization framework of Mohajerin Esfahani and Kuhn (Math. Program. 2018).

Setting

Let VVV be the feature space Rn\mathbb R^nRn with an arbitrary norm ∥⋅∥\|\cdot\|∥⋅∥, and let labels take the values y∈{−1,+1}y\in\{-1,+1\}y∈{−1,+1}. The feature-label space is Ξ=V×{−1,+1}\Xi = V\times\{-1,+1\}Ξ=V×{−1,+1} with points ξ=(x,y)\xi=(x,y)ξ=(x,y). A weight vector β\betaβ acts on features by x↦⟨β,x⟩x\mapsto\langle\beta,x\ranglex↦⟨β,x⟩; its dual norm is ∥β∥∗=sup⁡∥x∥≤1⟨β,x⟩\|\beta\|_* = \sup_{\|x\|\le1}\langle\beta,x\rangle∥β∥∗​=sup∥x∥≤1​⟨β,x⟩.

Metric (Definition 2). For a weight κ>0\kappa>0κ>0,

d((x,y),(x′,y′))=∥x−x′∥+κ ∣y−y′∣/2.d\big((x,y),(x',y')\big) = \|x-x'\| + \kappa\,|y-y'|/2 .d((x,y),(x′,y′))=∥x−x′∥+κ∣y−y′∣/2.

Changing a label costs κ\kappaκ; moving a feature costs its norm distance.

Wasserstein distance (Definition 1). For distributions Q,P\mathbb Q,\mathbb PQ,P on Ξ\XiΞ, W(Q,P)W(\mathbb Q,\mathbb P)W(Q,P) is the infimum of ∫d(ξ,ξ′) Π(dξ,dξ′)\int d(\xi,\xi')\,\Pi(d\xi,d\xi')∫d(ξ,ξ′)Π(dξ,dξ′) over all couplings Π\PiΠ of Q\mathbb QQ and P\mathbb PP. The Wasserstein ball of radius ε≥0\varepsilon\ge0ε≥0 is Bε(P)={Q:W(Q,P)≤ε}\mathbb B_\varepsilon(\mathbb P) = \{\mathbb Q : W(\mathbb Q,\mathbb P)\le\varepsilon\}Bε​(P)={Q:W(Q,P)≤ε}.

Data. Training samples (x^i,y^i)(\hat x_i,\hat y_i)(x^i​,y^​i​), i=1,…,Ni=1,\dots,Ni=1,…,N, define the empirical distribution P^N=1N∑i=1Nδ(x^i,y^i)\hat{\mathbb P}_N = \frac1N\sum_{i=1}^N\delta_{(\hat x_i,\hat y_i)}P^N​=N1​∑i=1N​δ(x^i​,y^​i​)​.

Classifier and risk. Logistic regression models Prob⁡(y∣x)=[1+exp⁡(−y⟨β,x⟩)]−1\operatorname{Prob}(y\mid x) = [1+\exp(-y\langle\beta,x\rangle)]^{-1}Prob(y∣x)=[1+exp(−y⟨β,x⟩)]−1 (eq. (1)). The classifier is fβ(x)=+1f_\beta(x)=+1fβ​(x)=+1 if Prob⁡(+1∣x)>0.5\operatorname{Prob}(+1\mid x)>0.5Prob(+1∣x)>0.5 and −1-1−1 otherwise, and its risk under the data-generating distribution P\mathbb PP is R(β)=P[y≠fβ(x)]\mathfrak R(\beta) = \mathbb P[y\ne f_\beta(x)]R(β)=P[y=fβ​(x)].

Worst- and best-case risks.

Rmax⁡(β)=sup⁡Q∈Bε(P^N)EQ[1{y⟨β,x⟩≤0}],Rmin⁡(β)=inf⁡Q∈Bε(P^N)EQ[1{y⟨β,x⟩<0}].\mathfrak R_{\max}(\beta) = \sup_{\mathbb Q\in\mathbb B_\varepsilon(\hat{\mathbb P}_N)}\mathbb E^{\mathbb Q}\big[\mathbb 1_{\{y\langle\beta,x\rangle\le0\}}\big],\qquad \mathfrak R_{\min}(\beta) = \inf_{\mathbb Q\in\mathbb B_\varepsilon(\hat{\mathbb P}_N)}\mathbb E^{\mathbb Q}\big[\mathbb 1_{\{y\langle\beta,x\rangle<0\}}\big].Rmax​(β)=Q∈Bε​(P^N​)sup​EQ[1{y⟨β,x⟩≤0}​],Rmin​(β)=Q∈Bε​(P^N​)inf​EQ[1{y⟨β,x⟩<0}​].

The worst case counts a nonpositive margin, the best case a strictly negative one.

The linear programs. For data (x^i,y^i)(\hat x_i,\hat y_i)(x^i​,y^​i​), a weight vector β^\hat\betaβ^​ and variables λ∈R\lambda\in\mathbb Rλ∈R, s,r,t∈RNs,r,t\in\mathbb R^Ns,r,t∈RN, program (10a) minimizes λε+1N∑isi\lambda\varepsilon + \frac1N\sum_i s_iλε+N1​∑i​si​ subject to, for every iii,

1−riy^i⟨β^,x^i⟩≤si,1+tiy^i⟨β^,x^i⟩−λκ≤si,ri∥β^∥∗≤λ,ti∥β^∥∗≤λ,ri,ti,si≥0.1 - r_i\hat y_i\langle\hat\beta,\hat x_i\rangle\le s_i,\quad 1 + t_i\hat y_i\langle\hat\beta,\hat x_i\rangle - \lambda\kappa\le s_i,\quad r_i\|\hat\beta\|_*\le\lambda,\quad t_i\|\hat\beta\|_*\le\lambda,\quad r_i,t_i,s_i\ge0 .1−ri​y^​i​⟨β^​,x^i​⟩≤si​,1+ti​y^​i​⟨β^​,x^i​⟩−λκ≤si​,ri​∥β^​∥∗​≤λ,ti​∥β^​∥∗​≤λ,ri​,ti​,si​≥0.

Program (10b) has the same objective and bounds, with the signs of the two margin terms exchanged.

Formalization targets

Goal: Theorem 3 (i)–(ii)

For every κ>0\kappa>0κ>0, ε≥0\varepsilon\ge0ε≥0, N≥1N\ge1N≥1, all samples and every weight vector β^\hat\betaβ^​, both programs attain their minima vvv and www, and

Rmax⁡(β^)=v,Rmin⁡(β^)=1−w.\mathfrak R_{\max}(\hat\beta) = v,\qquad \mathfrak R_{\min}(\hat\beta) = 1-w .Rmax​(β^​)=v,Rmin​(β^​)=1−w.

The identities hold for each fixed β^\hat\betaβ^​, so they apply to any β^\hat\betaβ^​ computed from the data.

Milestone: Theorem 3(i) alone

Rmax⁡(β^)\mathfrak R_{\max}(\hat\beta)Rmax​(β^​) equals the minimum of (10a).

Milestones: the confidence clauses

If the training samples are i.i.d. from P\mathbb PP and the radius is such that PN{P∈Bε(P^N)}≥1−η\mathbb P^N\{\mathbb P\in\mathbb B_\varepsilon(\hat{\mathbb P}_N)\}\ge1-\etaPN{P∈Bε​(P^N​)}≥1−η, then for any sample-dependent β^\hat\betaβ^​

PN{R(β^)≤Rmax⁡(β^)}≥1−η,PN{Rmin⁡(β^)≤R(β^)}≥1−η,\mathbb P^N\{\mathfrak R(\hat\beta)\le\mathfrak R_{\max}(\hat\beta)\}\ge1-\eta,\qquad \mathbb P^N\{\mathfrak R_{\min}(\hat\beta)\le\mathfrak R(\hat\beta)\}\ge1-\eta,PN{R(β^​)≤Rmax​(β^​)}≥1−η,PN{Rmin​(β^​)≤R(β^​)}≥1−η, PN{Rmin⁡(β^)≤R(β^)≤Rmax⁡(β^)}≥1−2η.\mathbb P^N\{\mathfrak R_{\min}(\hat\beta)\le\mathfrak R(\hat\beta)\le\mathfrak R_{\max}(\hat\beta)\}\ge1-2\eta .PN{Rmin​(β^​)≤R(β^​)≤Rmax​(β^​)}≥1−2η.

Significance

The result. Theorem 3 replaces an optimization over an infinite-dimensional set of distributions by a linear program with 3N+13N+13N+1 variables and 4N4N4N constraints plus sign constraints. That makes the worst- and best-case misclassification probabilities computable at the scale of the training set, for any norm on the features whose dual norm can be evaluated. With the confidence clauses, the two values are data-driven upper and lower confidence bounds on the out-of-sample risk of the classifier actually deployed, including one fitted on the same data.

Formalizing it. The paper states Theorem 3 without proof in the main text; the argument is deferred to a technical appendix. No part of it is machine-checked. A formal proof needs the evaluation of a worst-case probability of a closed set over a type-1 Wasserstein ball around a discrete distribution, and the analogous best-case probability of an open set. Both are reusable in any Wasserstein-robust treatment of chance constraints or classification error.

Difficulty

The objective 1{y⟨β,x⟩≤0}\mathbf 1_{\{y\langle\beta,x\rangle\le0\}}1{y⟨β,x⟩≤0}​ is neither continuous nor concave, so the duality theorems for Wasserstein balls stated for continuous or Lipschitz losses do not apply directly. Upper semicontinuity of the indicator of a closed set is what matters, and the strict inequality in Rmin⁡\mathfrak R_{\min}Rmin​ has to be handled as the complement of a closed set. The transport cost couples a norm on the features with a discrete label-flip cost, so a sample can reach the misclassification region either by moving its feature to the hyperplane ⟨β^,x⟩=0\langle\hat\beta,x\rangle=0⟨β^​,x⟩=0 or by flipping its label, and the two options interact through the shared budget ε\varepsilonε. Distances to the hyperplane are measured in the given norm and produce the dual norm ∥β^∥∗\|\hat\beta\|_*∥β^​∥∗​. The degenerate weight β^=0\hat\beta=0β^​=0 (every point on the hyperplane) must come out correctly without any division by ∥β^∥∗\|\hat\beta\|_*∥β^​∥∗​.

Formalization scope

The feature space is a finite-dimensional real normed space V with an arbitrary norm, standing for (Rn,∥⋅∥)(\mathbb R^n,\|\cdot\|)(Rn,∥⋅∥); the Euclidean norm is not assumed. A weight vector is a continuous linear functional V →L[ℝ] ℝ, and ∥β^∥∗\|\hat\beta\|_*∥β^​∥∗​ is its operator norm, which is exactly the dual norm. Labels are Bool with an explicit embedding true↦+1\text{true}\mapsto+1true↦+1, false↦−1\text{false}\mapsto-1false↦−1; the metric of Definition 2 is written literally. The Wasserstein distance is ℝ≥0∞-valued, probabilities and expectations of indicators are measure values in [0,∞][0,\infty][0,∞], and suprema and infima range exactly over the probability measures in the ball. "min" in (10a)/(10b) is formalized as attainment (IsLeast) of the objective over the feasible set. Samples are indexed by Fin N with N≥1N\ge1N≥1.

The following choices differ from a literal reading of the page:

  • The paper says the risk "can be expressed as" EP[1{y⟨β,x⟩≤0}]\mathbb E^{\mathbb P}[\mathbb 1_{\{y\langle\beta,x\rangle\le0\}}]EP[1{y⟨β,x⟩≤0}​]. This fails on the hyperplane ⟨β,x⟩=0\langle\beta,x\rangle=0⟨β,x⟩=0, where fβ(x)=−1f_\beta(x)=-1fβ​(x)=−1 is correct for y=−1y=-1y=−1. The mission defines R(β)=P[y≠fβ(x)]\mathfrak R(\beta)=\mathbb P[y\ne f_\beta(x)]R(β)=P[y=fβ​(x)] from (1) and includes the true statement EP[1{y⟨β,x⟩<0}]≤R(β)≤EP[1{y⟨β,x⟩≤0}]\mathbb E^{\mathbb P}[\mathbb 1_{\{y\langle\beta,x\rangle<0\}}]\le\mathfrak R(\beta)\le\mathbb E^{\mathbb P}[\mathbb 1_{\{y\langle\beta,x\rangle\le0\}}]EP[1{y⟨β,x⟩<0}​]≤R(β)≤EP[1{y⟨β,x⟩≤0}​] as a helper item.
  • The choice ε=εN(η)\varepsilon=\varepsilon_N(\eta)ε=εN​(η) of (8) and the measure-concentration theorem behind it (Theorem 2) are not formalized. The confidence clauses take their conclusion, PN{P∈Bε(P^N)}≥1−η\mathbb P^N\{\mathbb P\in\mathbb B_\varepsilon(\hat{\mathbb P}_N)\}\ge1-\etaPN{P∈Bε​(P^N​)}≥1−η, as a hypothesis, and "with probability 1−η1-\eta1−η" is read as "with probability at least 1−η1-\eta1−η". The printed level 1−2η1-2\eta1−2η is kept for the two-sided bound.

Swapping the strict and non-strict inequalities in Rmax⁡\mathfrak R_{\max}Rmax​ and Rmin⁡\mathfrak R_{\min}Rmin​, restricting the supremum to measures supported on the sample points, or replacing the ball by a set that excludes non-discrete distributions would each change the theorem. None of these is an acceptable reformulation of the goal.

Useful infrastructure: couplings of a discrete measure with an arbitrary one, the distance from a point to a closed half-space in a general norm, and LP-duality arguments for fractional-knapsack-type programs. Proofs of the helper and confidence items, and any reusable lemma about worst-case probabilities of closed sets over Wasserstein balls, are welcome.

Selected references

  • S. Shafieezadeh-Abadeh, P. Mohajerin Esfahani, D. Kuhn, Distributionally Robust Logistic Regression, Advances in Neural Information Processing Systems 28 (NIPS 2015). https://papers.nips.cc/paper/2015/hash/cc1aa436277138f61cda703991069eaf-Abstract.html
  • N. Fournier, A. Guillin, On the rate of convergence in Wasserstein distance of the empirical measure, Probability Theory and Related Fields 162 (2015). https://doi.org/10.1007/s00440-014-0583-7
  • P. Mohajerin Esfahani, D. Kuhn, Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations, Mathematical Programming 171 (2018). https://doi.org/10.1007/s10107-017-1172-1
8 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming VIII: Nonlinear Higher-Dimensional RepresentationsTextbook

Motivation

Chapter 2's convex-hull machinery gives an exact, finitely-generated linear description of a disjunctive set's convex hull, but for a mixed 0-1 program with ppp binary variables that description lives in a space with roughly pnpnpn auxiliary variables — one full lift per disjunction. This chapter surveys the alternative nonlinear higher-dimensional constructions that several authors proposed for the same target, conv(K0)\mathrm{conv}(K_0)conv(K0​): multiplying the constraint system by products of xjx_jxj​ and 1−xj1-x_j1−xj​ and linearizing the resulting quadratic terms, rather than disjoining and projecting one variable at a time. Two such constructions — Lovász and Schrijver's "cones of matrices" lift N(K)N(K)N(K), and Sherali and Adams's hierarchy KtK_tKt​ — both converge to the integer hull, and the chapter's central point is that both convergence proofs reduce, after all the nonlinear machinery is stripped away, to results already established by disjunctive programming's own one-variable-at-a-time convexification (Theorem 2.1, specialized here to Theorem 7.1, and the sequential-convexifiability theorem of Chapter 3).

Setting

K:={x∈Rn:Ax≥b, x≥0, xj≤1, j=1,…,p}={x:A~x≥b~}K := \{x \in \mathbb R^n : Ax \ge b,\ x \ge 0,\ x_j \le 1,\ j=1,\dots,p\} = \{x : \tilde A x \ge \tilde b\}K:={x∈Rn:Ax≥b, x≥0, xj​≤1, j=1,…,p}={x:A~x≥b~} is the LP relaxation of a mixed 0-1 program with ppp of its nnn variables 0-1 constrained, and K0:=K∩{xj∈{0,1}, j=1,…,p}K_0 := K \cap \{x_j \in \{0,1\},\ j=1,\dots,p\}K0​:=K∩{xj​∈{0,1}, j=1,…,p} its feasible set. Pj(K)P_j(K)Pj​(K) (Section 7.1) multiplies A~x≥b~\tilde A x \ge \tilde bA~x≥b~ by (1−xj)(1-x_j)(1−xj​) and xjx_jxj​, linearizes yi:=xixjy_i := x_ix_jyi​:=xi​xj​ and xj:=xj2x_j := x_j^2xj​:=xj2​, and projects onto xxx; iterating over a coordinate sequence gives Pi1,…,it(K)P_{i_1,\dots,i_t}(K)Pi1​,…,it​​(K). N(K)N(K)N(K) (Section 7.2, Lovász-Schrijver) instead linearizes with a single symmetric matrix YYY (Yij=Yji=xixjY_{ij} = Y_{ji} = x_ix_jYij​=Yji​=xi​xj​ for every pair) before projecting, and iterates as Nt(K):=N(Nt−1(K))N^t(K) := N(N^{t-1}(K))Nt(K):=N(Nt−1(K)). KtK_tKt​ (Section 7.3, Sherali-Adams) multiplies by every product of ttt literals ∏j∈J1xj∏j∈J2(1−xj)\prod_{j\in J_1}x_j\prod_{j\in J_2}(1-x_j)∏j∈J1​​xj​∏j∈J2​​(1−xj​) (∣J1∪J2∣=t|J_1\cup J_2|=t∣J1​∪J2​∣=t), linearizes each resulting monomial with a fresh "moment" variable, and projects.

Formalization targets

Theorem 7.6 (goal) — the Sherali-Adams hierarchy reaches the integer hull

Kp=conv(K0).K_p = \mathrm{conv}(K_0).Kp​=conv(K0​).

The chain of results building toward it

Theorem 7.1 (Pj(K)P_j(K)Pj​(K) equals the one-variable convex hull, a special case of Theorem 2.1), Theorem 7.2 (iterating PjP_jPj​ over a fixed sequence reaches the hull of imposing 0/10/10/1 on all of them), Corollary 7.3 (iterating over every 0-1 index reaches conv(K0)\mathrm{conv}(K_0)conv(K0​)), Theorem 7.4 (N(K)⊆Pj(K)N(K) \subseteq P_j(K)N(K)⊆Pj​(K) for every jjj), Theorem 7.5 (iterating NNN over ppp steps reaches conv(K0)\mathrm{conv}(K_0)conv(K0​), by the same containment), and Theorem 7.7 (Kt⊆P1,…,t(K)K_t \subseteq P_{1,\dots,t}(K)Kt​⊆P1,…,t​(K), proved by a genuine induction re-deriving every valid inequality of P1,…,t(K)P_{1,\dots,t}(K)P1,…,t​(K) from (NLt)(NL_t)(NLt​)'s own rows).

Significance

The results themselves. This chapter is disjunctive programming's account of why three independently-developed convexification hierarchies — its own lift-and-project, Lovász-Schrijver, and Sherali-Adams — all reach the same integer hull: not by coincidence, but because each one's convergence proof is, at bottom, a disguised instance of the book's own Theorem 2.1 and Chapter 3 machinery. This is part of what situates disjunctive programming as the unifying framework behind several major lift-and-project hierarchies used throughout integer programming.

Formalizing it. No object in this mission exists on the platform prior to it or in Mathlib. This mission restates 03-sequential-convex's and 02a-convex-hull's vocabulary locally (per the series convention that a draft mission cannot import another draft mission's definitions), specialized throughout to the split disjunction xj∈{0,1}x_j \in \{0,1\}xj​∈{0,1}.

Difficulty

The chapter's own account of the Sherali-Adams construction (Section 7.3) is narrative rather than displaying an explicit linear system for (NLt)(NL_t)(NLt​), unlike every other construction in this chapter (contrast eq. (7.1) and eq. (7.4), both displayed explicitly) — Step 1 says only "multiply A~x≥b~\tilde Ax \ge \tilde bA~x≥b~ with every product of the form ∏j∈J1xj⋅∏j∈J2(1−xj)\prod_{j\in J_1}x_j \cdot \prod_{j\in J_2}(1-x_j)∏j∈J1​​xj​⋅∏j∈J2​​(1−xj​)." Deriving the actual linear system this multiplication produces requires expanding every (1−xj)(1-x_j)(1−xj​) factor via inclusion-exclusion over S⊆J2S \subseteq J_2S⊆J2​ before the monomials can be linearized — a real, if mechanical, derivation step this mission had to carry out itself (RowNLt, see MODERATION_NOTES.md) rather than transcribe from a displayed equation. Theorem 7.7's own proof is a genuine argument (an induction re-deriving a valid inequality of P1,…,t(K)P_{1,\dots,t}(K)P1,…,t​(K) from (NLt)(NL_t)(NLt​)'s rows layer by layer), not a restatement, so it is included as a milestone with real mathematical content rather than assumed.

Correcting BRIEF.md. The brief's "Recommended goal theorem" section mislabels Theorem 7.6 as the Lovász-Schrijver result "Kp=conv(K0)K^p = \mathrm{conv}(K_0)Kp=conv(K0​)" — cross-checked directly against the PDF, Theorem 7.6 (p. 95, PDF 101) is stated [112] Kp = conv(K0), cited to Sherali and Adams, appearing immediately after Section 7.3 introduces KtK_tKt​. The actual Lovász-Schrijver iteration-reaches-the-hull result, cited [99], is Theorem 7.5 (Np(K) = conv(K0)), formalized in this mission as a milestone (lovasz_schrijver_reaches_hull) rather than the goal. See STATUS.md.

Formalization scope

Three distinct convexification operators are kept fully distinguishable throughout, as BRIEF.md warns: Pj/IteratedSplit (one-variable-at-a-time, Section 7.1, Def_..._Basic), NOp/MK (Lovász-Schrijver, Section 7.2, Def_..._Lifts), and KtSet/IsXt (Sherali-Adams, Section 7.3, Def_..._Lifts) — no shared abbreviation or lemma conflates their defining predicates, even though all three converge to the same hull.

Nt(K)N^t(K)Nt(K)'s iteration (Theorem 7.5) is formalized via a dependent family of representations A t, b t for t : Fin (p+1) with a hypothesis relating consecutive steps to NOp's image at the previous step — the same pattern 04-normal-forms's Theorem 4.10 uses — since each successive Nt(K)N^t(K)Nt(K) genuinely has a different, larger ambient constraint system, not a fixed matrix's power.

Theorem 7.7 is stated for an arbitrary ttt-subset S⊆N′S \subseteq N'S⊆N′ rather than the literal prefix {1,…,t}\{1,\dots,t\}{1,…,t} the book's own statement uses (its own proof, by induction, treats an arbitrary inequality of P1,…,t(K)P_{1,\dots,t}(K)P1,…,t​(K) with no dependence on the prefix's specific ordering), which is what the goal theorem's proof, applied at S=N′S = N'S=N′, actually needs.

The Bienstock-Zuckerberg results quoted narratively in Section 7.5 ("Theorem 1"/"Theorem 2", [43]/[44]) are out-of-cone: the book itself presents them only as a survey of a further lift operator, under their own source papers' numbering, not as Balas's own numbered results, and does not restate their proofs.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 7.
  • L. Lovász, A. Schrijver, Cones of matrices and set-functions and 0-1 optimization, SIAM Journal on Optimization 1 (1991), 166-190 (cited in the text as [99], the origin of the N(K)N(K)N(K) construction and Theorems 7.4-7.5).
  • H.D. Sherali, W.P. Adams, A hierarchy of relaxations between the continuous and convex hull representations for zero-one programming problems, SIAM Journal on Discrete Mathematics 3 (1990), 411-430 (cited in the text as [112], the origin of the KtK_tKt​ construction and Theorem 7.6).
16 thms3 active users
🏆Completed
CombinatoricsConvex OptimizationOperations Research+1·Captain: mikedeng1

Convexity and Steinitz's Exchange Property I: The Extension Theorem — M-Concavity Is Concave Extendability with Integral Base Polytope MaximizersResearch Paper

Motivation

Linear optimization over the bases of a matroid, over the integer points of a polymatroid, or over the flows of a network is well understood: the greedy algorithm is exact, the feasible sets are the integer points of polytopes described by submodular functions, and min-max theorems of Edmonds and Frank hold with integrality. Nonlinear objectives on the same sets are much less uniform. Valuated matroids (Dress and Wenzel, 1990; see Murota 2003) showed that a quantitative form of the Steinitz exchange axiom is exactly what keeps the greedy algorithm exact for a nonlinear weight. Kazuo Murota's paper Convexity and Steinitz's Exchange Property (Adv. Math. 124 (1996) 272–311) extends this exchange axiom from matroid bases to the integer points of arbitrary integral base polytopes, names the resulting functions M-concave, and proves that they are the discrete counterpart of concave functions. The paper is the starting point of discrete convex analysis (Murota, Discrete Convex Analysis, SIAM 2003), which is now used in auction theory (gross-substitutes valuations are M♮-concave), inventory and resource allocation, and combinatorial optimization.

This mission covers the first of the paper's three characterizations of M-concavity: the Extension Theorem (Theorem 4.6).

Setting

Let VVV be a finite nonempty set. For u∈Vu\in Vu∈V, χu∈ZV\chi_u\in\mathbb Z^Vχu​∈ZV is the characteristic vector of uuu. For x∈RVx\in\mathbb R^Vx∈RV, supp⁡+(x)={v∣x(v)>0}\operatorname{supp}^+(x)=\{v\mid x(v)>0\}supp+(x)={v∣x(v)>0}, supp⁡−(x)={v∣x(v)<0}\operatorname{supp}^-(x)=\{v\mid x(v)<0\}supp−(x)={v∣x(v)<0}, ∥x∥=∑v∣x(v)∣\|x\|=\sum_v|x(v)|∥x∥=∑v​∣x(v)∣, and ⟨p,x⟩=∑vp(v)x(v)\langle p,x\rangle=\sum_v p(v)x(v)⟨p,x⟩=∑v​p(v)x(v).

A finite integral base set is a finite nonempty B⊆ZVB\subseteq\mathbb Z^VB⊆ZV such that for x,y∈Bx,y\in Bx,y∈B and u∈supp⁡+(x−y)u\in\operatorname{supp}^+(x-y)u∈supp+(x−y) there is v∈supp⁡−(x−y)v\in\operatorname{supp}^-(x-y)v∈supp−(x−y) with x−χu+χv∈Bx-\chi_u+\chi_v\in Bx−χu​+χv​∈B (axiom (B1)). Examples are the incidence vectors of the bases of a matroid. Its convex hull B‾\overline BB is an integral base polytope; in general, an integral base polytope is the convex hull of some finite integral base set.

A function ω:B→R\omega:B\to\mathbb Rω:B→R satisfies the exchange property (EXC), and is called M-concave, if for all x,y∈Bx,y\in Bx,y∈B and u∈supp⁡+(x−y)u\in\operatorname{supp}^+(x-y)u∈supp+(x−y) there is v∈supp⁡−(x−y)v\in\operatorname{supp}^-(x-y)v∈supp−(x−y) with x−χu+χv∈Bx-\chi_u+\chi_v\in Bx−χu​+χv​∈B, y+χu−χv∈By+\chi_u-\chi_v\in By+χu​−χv​∈B and

ω(x)+ω(y)≤ω(x−χu+χv)+ω(y+χu−χv).\omega(x)+\omega(y)\le\omega(x-\chi_u+\chi_v)+\omega(y+\chi_u-\chi_v).ω(x)+ω(y)≤ω(x−χu​+χv​)+ω(y+χu​−χv​).

The local exchange property (EXCloc_{\mathrm{loc}}loc​) asks only, for x,y∈Bx,y\in Bx,y∈B with ∥x−y∥=4\|x-y\|=4∥x−y∥=4, for some u∈supp⁡+(x−y)u\in\operatorname{supp}^+(x-y)u∈supp+(x−y) and some v∈supp⁡−(x−y)v\in\operatorname{supp}^-(x-y)v∈supp−(x−y) with the same conclusion.

For p∈RVp\in\mathbb R^Vp∈RV, ω[p](x)=ω(x)+⟨p,x⟩\omega[p](x)=\omega(x)+\langle p,x\rangleω[p](x)=ω(x)+⟨p,x⟩, and argmax⁡(ω)={x∈B∣ω(x)≥ω(y) ∀y∈B}\operatorname{argmax}(\omega)=\{x\in B\mid\omega(x)\ge\omega(y)\ \forall y\in B\}argmax(ω)={x∈B∣ω(x)≥ω(y) ∀y∈B}. For any g:B→Rg:B\to\mathbb Rg:B→R, the concave conjugate is g∘(p)=min⁡x∈B(⟨p,x⟩−g(x))g^\circ(p)=\min_{x\in B}(\langle p,x\rangle-g(x))g∘(p)=minx∈B​(⟨p,x⟩−g(x)) and the concave closure is g^(b)=inf⁡p∈RV(⟨p,b⟩−g∘(p))\hat g(b)=\inf_{p\in\mathbb R^V}(\langle p,b\rangle-g^\circ(p))g^​(b)=infp∈RV​(⟨p,b⟩−g∘(p)), a concave function that is finite exactly on B‾\overline BB. A function ωˉ:B‾→R\bar\omega:\overline B\to\mathbb Rωˉ:B→R extends ω\omegaω if ωˉ=ω\bar\omega=\omegaωˉ=ω on BBB.

Formalization targets

Goal: the Extension Theorem (Theorem 4.6)

For a finite integral base set BBB and ω:B→R\omega:B\to\mathbb Rω:B→R,

ω satisfies (EXC)  ⟺  ∃ ωˉ:B‾→R concave, ωˉ∣B=ω, ∀p: argmax⁡B‾(ωˉ[p]) is an integral base polytope.\omega\ \text{satisfies (EXC)}\iff\exists\,\bar\omega:\overline B\to\mathbb R\ \text{concave},\ \bar\omega|_B=\omega,\ \forall p:\ \operatorname{argmax}_{\overline B}(\bar\omega[p])\ \text{is an integral base polytope}.ω satisfies (EXC)⟺∃ωˉ:B→R concave, ωˉ∣B​=ω, ∀p: argmaxB​(ωˉ[p]) is an integral base polytope.

Milestones

  • Lemma 3.2 (p. 282): under (EXCloc_{\mathrm{loc}}loc​), for y=x−χu0−χu1+χv0+χv1∈By=x-\chi_{u_0}-\chi_{u_1}+\chi_{v_0}+\chi_{v_1}\in By=x−χu0​​−χu1​​+χv0​​+χv1​​∈B, ωp(y)−ωp(x)≤max⁡(π00+π11,π01+π10)\omega_p(y)-\omega_p(x)\le\max(\pi_{00}+\pi_{11},\pi_{01}+\pi_{10})ωp​(y)−ωp​(x)≤max(π00​+π11​,π01​+π10​) with πij=ωp(x−χui+χvj)−ωp(x)\pi_{ij}=\omega_p(x-\chi_{u_i}+\chi_{v_j})-\omega_p(x)πij​=ωp​(x−χui​​+χvj​​)−ωp​(x) (−∞-\infty−∞ off BBB).
  • Theorem 3.1 (p. 282): (EXC)   ⟺  \iff⟺ (EXCloc_{\mathrm{loc}}loc​).
  • Theorem 2.2 (p. 280): (EXC) for ω\omegaω implies (EXC) for every ω[p]\omega[p]ω[p].
  • Lemma 4.3 (p. 285): under (EXC), argmax⁡(ω)\operatorname{argmax}(\omega)argmax(ω) is an integral base set.
  • Lemma 4.1 (p. 285): g^≥g\hat g\ge gg^​≥g on BBB; max⁡B‾g^=max⁡Bg\max_{\overline B}\hat g=\max_B gmaxB​g^​=maxB​g; argmax⁡(g^)=argmax⁡(g)‾\operatorname{argmax}(\hat g)=\overline{\operatorname{argmax}(g)}argmax(g^​)=argmax(g)​.
  • Lemma 4.2 (p. 285): (g[p0])∘(p)=g∘(p−p0)(g[p_0])^\circ(p)=g^\circ(p-p_0)(g[p0​])∘(p)=g∘(p−p0​) and (g[p0])∧=g^+⟨p0,⋅⟩(g[p_0])^\wedge=\hat g+\langle p_0,\cdot\rangle(g[p0​])∧=g^​+⟨p0​,⋅⟩ on B‾\overline BB.
  • Theorem 4.4 (p. 286): (EXC)   ⟺  \iff⟺ argmax⁡(ω[p])\operatorname{argmax}(\omega[p])argmax(ω[p]) is an integral base set for every ppp.
  • Lemma 4.5 (p. 288): under (EXC), ω^=ω\hat\omega=\omegaω^=ω on BBB.

Significance

The Extension Theorem identifies a combinatorial axiom with a convex-analytic property: M-concave functions are exactly the restrictions to lattice points of concave functions on the base polytope whose linear perturbations are all maximized on integral base polytopes. It is the reason the M-concave class supports a convex-analysis-style theory at all: local optimality implies global optimality, maximizers of linear perturbations are well behaved, and conjugacy (the paper's Theorems 5.3 and 6.4, separate missions of this series) can be developed. Theorem 3.1 on its own is widely used to verify M-concavity in applications, since it reduces the exchange axiom to pairs at distance four.

All results here were proved in 1996. To our knowledge none of them has a machine-checked proof; Mathlib has matroids on sets but no integral base sets in ZV\mathbb Z^VZV, no M-concave functions and no concave closure of a function on a finite set. A formal proof of this chain would be a first formal development of discrete convex analysis.

Difficulty

The equivalence of (EXC) with its local version (Theorem 3.1) is not a routine induction on ∥x−y∥\|x-y\|∥x−y∥: the exchange inequality for a far pair does not follow from the inequalities along a path of distance-4 pairs, because the exchange partner vvv must be chosen consistently with the prescribed uuu. For the "if" direction of Theorem 4.4, knowing that every maximizer set is an integral base set says nothing directly about the values of ω\omegaω at non-maximizing points; turning this global information on maximizers into the local inequality (EXCloc_{\mathrm{loc}}loc​) requires a supporting hyperplane of the concave closure at a well-chosen point and the integrality of the intersection of an integral base polytope with a box (a cited result on submodular systems). Theorem 4.6 then needs the concave closure to agree with ω\omegaω on BBB (Lemma 4.5), which fails for general ω\omegaω.

Formalization scope

All declarations live in the namespace SteinitzExchange.Extension. The ground set is a type V with [Fintype V] [DecidableEq V] [Nonempty V]; integer vectors are V → ℤ, real vectors V → ℝ, and toReal embeds the former into the latter. BBB is a Finset (V → ℤ). A function ω:B→R\omega:B\to\mathbb Rω:B→R is a total (V → ℤ) → ℝ whose values are only ever read at points required to be in BBB. B‾\overline BB is Mathlib's convexHull ℝ of the image of BBB. Pinned readings:

  1. Integral base polytope means the convex hull of a finite nonempty set satisfying (B1) (by the paper's Theorem 2.1 this is its meaning), not "a polytope with integer vertices".
  2. The concave closure is a real infimum; it is the paper's value on B‾\overline BB and a junk value 000 off B‾\overline BB (the paper's −∞-\infty−∞), so every statement uses it only on B‾\overline BB. argmax⁡(g^)\operatorname{argmax}(\hat g)argmax(g^​) and argmax⁡(ωˉ[p])\operatorname{argmax}(\bar\omega[p])argmax(ωˉ[p]) range over B‾\overline BB only; the concave conjugate is a minimum over the nonempty finite BBB.
  3. Lemma 3.2's maximum with −∞-\infty−∞ entries is stated as: for one of the two pairings both exchanged points lie in BBB and the bound holds for that pairing.
  4. Theorem 4.4 and Lemma 4.3 conclude that argmax⁡(ω[p])\operatorname{argmax}(\omega[p])argmax(ω[p]) is itself an integral base set. Read literally ("its convex hull is an integral base polytope") the "if" direction of Theorem 4.4 is false: B={(2,0),(1,1),(0,2)}B=\{(2,0),(1,1),(0,2)\}B={(2,0),(1,1),(0,2)} with ω=(0,−1,0)\omega=(0,-1,0)ω=(0,−1,0) is a counterexample. The paper's proof, its gloss in Lemma 4.3 and its use on p. 292 all take the integral-base-set reading. Theorem 4.6 needs no such adjustment and is stated as printed.
  5. Theorem 2.2 carries the standing assumption of §2.3 that ω\omegaω satisfies (EXC).

Trivializing formalizations are ruled out: the extension ωˉ\bar\omegaωˉ must agree with ω\omegaω on BBB and be concave on B‾\overline BB, the argmax is over B‾\overline BB and not over RV\mathbb R^VRV, and an integral base polytope is never empty.

A complete development needs basic facts on integral base sets (the equivalence of (B1) with the simultaneous exchange (B2), B=ZV∩B‾B=\mathbb Z^V\cap\overline BB=ZV∩B, and the paper's cited Theorem 2.1 relating them to submodular functions), the representation (4.3) of the concave closure as a maximum of convex combinations, and supporting hyperplanes of polyhedral concave functions. The layer of integral base sets and M-concave functions is reusable for the two other missions of this series and for any later formalization of discrete convex analysis; contributions of general-purpose lemmas about it are welcome.

Selected references

  • K. Murota, Convexity and Steinitz's exchange property, Advances in Mathematics 124 (1996) 272–311. https://doi.org/10.1006/aima.1996.0084
  • K. Murota, Discrete Convex Analysis, SIAM Monographs on Discrete Mathematics and Applications, 2003. https://doi.org/10.1137/1.9780898718508
21 thms7 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

An Interactive Weighted Tchebycheff Procedure for Multiple Objective Programming I: In the Finite Case the Augmented Weighted Tchebycheff Program Characterizes the Nondominated SetResearch Paper

Motivation

A decision problem with several conflicting objectives, such as cost, risk and service level, has no single optimum. What it has is a set of nondominated outcomes: those that cannot be improved in one objective without being worsened in another. Interactive methods of multiple objective programming search this set with a decision-maker, and at each step they need a computational device that returns nondominated outcomes and can return any of them.

The classical device, maximizing a weighted sum of the objectives, fails the second requirement. On a nonconvex or discrete outcome set it only reaches the supported nondominated points, those on the boundary of the convex hull, and misses the rest (see, e.g., Boyd and Vandenberghe, Convex Optimization, §4.7.4, where the weighted-sum approach is shown to be sufficient but not necessary for Pareto optimality). Steuer and Choo (Math. Programming 26 (1983) 326–344) replaced the weighted sum by a weighted Tchebycheff distance to an ideal point, augmented by a small linear term. Their procedure became one of the standard interactive methods of the field, and the augmented Tchebycheff scalarization is now a standard tool in multiobjective integer programming and in the generation of nondominated sets.

Timeline, as recorded in the paper's own references. Dinkelbach and Dürr (1972) showed, in the linear case, that among the minimizers of a weighted Tchebycheff program there is always a nondominated one (the paper's Theorem 3.1 extends this to the discrete case). Bowman (Lecture Notes in Economics and Mathematical Systems, as cited by the paper) related the Tchebycheff norm to the efficient frontier of multiple-criteria problems. Choo and Atkins (Computers and Operations Research 7, 1980) and Choo's dissertation (1980) developed interactive weighted Tchebycheff algorithms. Steuer and Choo (1983) added the augmentation term ρ eT(z∗−z)\rho\,e^{\mathsf T}(z^*-z)ρeT(z∗−z), gave an explicit choice of the weights and of ρ\rhoρ in the discrete case, and proved that the resulting program characterizes the nondominated set exactly (Theorem 3.7).

Setting

There are k≥1k \ge 1k≥1 objectives to be maximized. The set of attainable criterion vectors is a finite set Z⊂RkZ \subset \mathbb R^kZ⊂Rk (in the paper, ZZZ is the image of a discrete feasible set SSS under the objectives f1,…,fkf_1,\dots,f_kf1​,…,fk​). A vector zzz dominates zˉ\bar zzˉ if zi≥zˉiz_i \ge \bar z_izi​≥zˉi​ for all iii and zi>zˉiz_i > \bar z_izi​>zˉi​ for at least one iii. The nondominated set N⊆ZN \subseteq ZN⊆Z consists of the zˉ∈Z\bar z \in Zzˉ∈Z that no z∈Zz \in Zz∈Z dominates.

An ideal criterion vector z∗∈Rkz^* \in \mathbb R^kz∗∈Rk has coordinates zi∗=max⁡z∈Zzi+εiz^*_i = \max_{z\in Z} z_i + \varepsilon_izi∗​=maxz∈Z​zi​+εi​ with εi≥0\varepsilon_i \ge 0εi​≥0, where εi\varepsilon_iεi​ must be strictly positive if (i) more than one nondominated vector maximizes objective iii, or (ii) the only nondominated vector maximizing objective iii also maximizes another objective.

Weights range over the simplex Λˉ={λ∈Rk∣λi≥0, ∑iλi=1}\bar\Lambda = \{\lambda \in \mathbb R^k \mid \lambda_i \ge 0,\ \sum_i \lambda_i = 1\}Λˉ={λ∈Rk∣λi​≥0, ∑i​λi​=1}. For a scalar ρ\rhoρ the augmented weighted Tchebycheff program is

min⁡ α+ρ eT(z∗−z)s.t.α≥λi(zi∗−zi), 1≤i≤k,z∈Z,\min\ \alpha + \rho\, e^{\mathsf T}(z^* - z) \quad\text{s.t.}\quad \alpha \ge \lambda_i (z^*_i - z_i),\ 1 \le i \le k,\quad z \in Z,min α+ρeT(z∗−z)s.t.α≥λi​(zi∗​−zi​), 1≤i≤k,z∈Z,

where eee is the vector of ones; at a fixed zzz its value is max⁡iλi(zi∗−zi)+ρ eT(z∗−z)\max_i \lambda_i(z^*_i - z_i) + \rho\,e^{\mathsf T}(z^*-z)maxi​λi​(zi∗​−zi​)+ρeT(z∗−z).

For zp∈Zz^p \in Zzp∈Z the paper defines weights λp\lambda^pλp by (b): λip∝1/(zi∗−zip)\lambda^p_i \propto 1/(z^*_i - z^p_i)λip​∝1/(zi∗​−zip​), normalized to sum to one, when zip≠zi∗z^p_i \ne z^*_izip​=zi∗​ for all iii; otherwise λp\lambda^pλp puts weight 111 on the coordinates where zip=zi∗z^p_i = z^*_izip​=zi∗​ and 000 elsewhere. With αpq=max⁡iλip(zi∗−ziq)\alpha_{pq} = \max_i \lambda^p_i (z^*_i - z^q_i)αpq​=maxi​λip​(zi∗​−ziq​) it sets

ρ=12min⁡zi∈N, zj∈Z{αij−αiieT(zj−zi)  ∣  eT(zj−zi)>0}.(3.8)\rho = \tfrac12 \min_{z^i \in N,\ z^j \in Z}\Big\{\frac{\alpha_{ij} - \alpha_{ii}}{e^{\mathsf T}(z^j - z^i)} \;\Big|\; e^{\mathsf T}(z^j - z^i) > 0\Big\}. \tag{3.8}ρ=21​zi∈N, zj∈Zmin​{eT(zj−zi)αij​−αii​​​eT(zj−zi)>0}.(3.8)

Formalization targets

Goal: Theorem 3.7

For every zp∈Zz^p \in Zzp∈Z,

zp∈N  ⟺  ∃λ∈Λˉ  ∀z∈Z: max⁡iλi(zi∗−zip)+ρ eT(z∗−zp)≤max⁡iλi(zi∗−zi)+ρ eT(z∗−z),z^p \in N \iff \exists \lambda \in \bar\Lambda\ \ \forall z \in Z:\ \max_i \lambda_i(z^*_i - z^p_i) + \rho\, e^{\mathsf T}(z^*-z^p) \le \max_i \lambda_i(z^*_i - z_i) + \rho\, e^{\mathsf T}(z^*-z),zp∈N⟺∃λ∈Λˉ  ∀z∈Z: imax​λi​(zi∗​−zip​)+ρeT(z∗−zp)≤imax​λi​(zi∗​−zi​)+ρeT(z∗−z),

with ρ\rhoρ from (3.8). One coefficient ρ\rhoρ, computed from ZZZ and z∗z^*z∗ alone, works for the whole nondominated set.

Milestones, in the order of the paper

  1. Theorem 3.1. For any λ∈Λˉ\lambda \in \bar\Lambdaλ∈Λˉ, some minimizer of the (unaugmented) weighted Tchebycheff program over ZZZ is nondominated.
  2. Lemma 3.2 (corrected). For zp∈Nz^p \in Nzp∈N and zq∈Zz^q \in Zzq∈Z with zq≠zpz^q \ne z^pzq=zp and zq≰zpz^q \not\le z^pzq≤zp, zqz^qzq lies outside the level set Φ(αpp)\Phi(\alpha_{pp})Φ(αpp​).
  3. Lemma 3.3 (corrected). Under the same hypotheses, αpp<αpq\alpha_{pp} < \alpha_{pq}αpp​<αpq​.
  4. ρp>0\rho_p > 0ρp​>0, the first step of the proof of Theorem 3.4, for the single-vector coefficient ρp\rho_pρp​ of (3.6).
  5. Theorem 3.4. Each zp∈Nz^p \in Nzp∈N is the unique minimizer of the augmented program with weights λp\lambda^pλp and coefficient ρp\rho_pρp​.
  6. Corollary 3.9. The same with the common ρ\rhoρ of (3.8), and λp∈Λˉ\lambda^p \in \bar\Lambdaλp∈Λˉ.

Printed Lemmas 3.2 and 3.3 are false. For Z={(5,3),(5,1),(1,10)}Z = \{(5,3), (5,1), (1,10)\}Z={(5,3),(5,1),(1,10)} and z∗=(5,10)z^* = (5,10)z∗=(5,10), which is ideal with ε=0\varepsilon = 0ε=0, the nondominated vector zp=(5,3)z^p = (5,3)zp=(5,3) has λp=(1,0)\lambda^p = (1,0)λp=(1,0) and αpp=0\alpha_{pp} = 0αpp​=0, while the dominated vector zq=(5,1)z^q = (5,1)zq=(5,1) lies in Φ(0)={z∣z1≥5}\Phi(0) = \{z \mid z_1 \ge 5\}Φ(0)={z∣z1​≥5} and has αpq=0\alpha_{pq} = 0αpq​=0. The proof's second case assumes that only zpz^pzp reaches zj∗z^*_jzj∗​ in coordinate jjj, but the ε\varepsilonε-rule constrains nondominated vectors only. The mission states both lemmas with the added hypothesis zq≰zpz^q \not\le z^pzq≤zp, under which they hold; the milestone texts are the printed ones. Theorems 3.4, 3.7 and Corollary 3.9 are unaffected, since for zq≤zpz^q \le z^pzq≤zp, zq≠zpz^q \ne z^pzq=zp the augmentation term separates zqz^qzq from zpz^pzp on its own. Hypothesis (a) of the paper also contains the misprint "zq≠zqz^q \ne z^qzq=zq" for zq≠zpz^q \ne z^pzq=zp.

Significance

Theorem 3.7 says that the augmented weighted Tchebycheff program, with a computable ρ\rhoρ, is an exact scalarization of the discrete multiple objective program. It returns only nondominated vectors (unlike the plain Tchebycheff program, whose optima can be weakly dominated) and it can return every nondominated vector, including unsupported ones (unlike weighted sums). Corollary 3.9 adds that each nondominated vector is the unique optimum for a suitable weight, so it is found even by a solver that stops at the first optimum. These facts underlie the interactive Tchebycheff procedure of the paper's §5 and a large body of later work on generating nondominated sets of multiobjective integer programs.

The results are proved in the paper; to our knowledge none has been machine-checked. The mission produces a checked version with the two lemmas of the paper's proof chain corrected, a precise treatment of the ideal-vector rule, and an explicit ρ\rhoρ. Alternative proofs, for instance one for the goal that avoids the explicit ρ\rhoρ of (3.8), are welcome.

Difficulty

The ⇐ direction is short. The work is in ⇒: the explicit weights λp\lambda^pλp must be shown to lie in Λˉ\bar\LambdaΛˉ and to make zpz^pzp strictly better than every competitor that is not below it. Both depend on the ε\varepsilonε-rule for z∗z^*z∗, whose role is subtle: it forbids two coordinates of a nondominated vector from reaching z∗z^*z∗, and forbids two nondominated vectors from sharing a coordinate equal to zj∗z^*_jzj∗​, but it says nothing about dominated vectors. The paper's own argument overlooks exactly those dominated vectors, so a proof that follows the printed Lemma 3.2 literally will fail; the gap is closed only by combining the corrected lemma with the augmentation term. Choosing a single ρ\rhoρ for all of NNN also requires that every quotient in (3.8) be strictly positive.

Formalization scope

Criterion vectors are Fin k → ℝ (objective indices 0,…,k−10,\dots,k-10,…,k−1), ZZZ is a Finset, and k≥1k \ge 1k≥1 is imposed as [NeZero k]. The decision set SSS, the objectives fif_ifi​ and the program variable α\alphaα are eliminated: the programs are stated over ZZZ, and α\alphaα is replaced by its minimal value max⁡iλi(zi∗−zi)\max_i \lambda_i(z^*_i - z_i)maxi​λi​(zi∗​−zi​). The programs use zi∗−ziz^*_i - z_izi∗​−zi​ without absolute values, as printed; on ZZZ this equals the metric's ∣zi∗−zi∣|z^*_i - z_i|∣zi∗​−zi​∣ when z∗z^*z∗ is ideal. "zzz minimizes the program" means that zzz minimizes the value over ZZZ, and "uniquely minimizes" means that every other element of ZZZ has a strictly larger value. Λˉ\bar\LambdaΛˉ is Mathlib's stdSimplex ℝ (Fin k).

The ideal vector is encoded with its full ε\varepsilonε-rule, not as "z∗>zz^* > zz∗>z for all z∈Zz \in Zz∈Z"; the latter would exclude the paper's case where zpz^pzp touches z∗z^*z∗ in one coordinate. The minima in (3.6) and (3.8) can range over empty sets (e.g. Z=N={zp}Z = N = \{z^p\}Z=N={zp}); the paper assigns them no value, and the formalization sets ρp\rho_pρp​, ρ\rhoρ to 111 then. A value of 000 would make the goal's ⇒ direction false, so no formalization may rely on Lean's default for an empty minimum. Theorem 3.1 is stated for an arbitrary reference vector z∗z^*z∗, since it needs no ideal-vector hypothesis. The paper's "Let NNN be finite" in Theorem 3.7 is taken as "ZZZ finite", which is what (3.8) and the proof require.

A trivializing formalization would take ρ=0\rho = 0ρ=0 or leave λ\lambdaλ unconstrained; both are excluded, since ρ\rhoρ is the specific value (3.8) and λ\lambdaλ ranges over Λˉ\bar\LambdaΛˉ.

The definitions (dominance, NNN, ideal vector, Tchebycheff values, Φ\PhiΦ, the weights and coefficients of §3) are reusable for the continuous and polyhedral cases of the paper's §4 and for other scalarization results. Contributions of proofs of any milestone are welcome.

Selected references

  • R. E. Steuer and E.-U. Choo, An Interactive Weighted Tchebycheff Procedure for Multiple Objective Programming, Mathematical Programming 26 (1983) 326–344. https://doi.org/10.1007/BF02591870
  • W. Dinkelbach and W. Dürr, Effizienzaussagen bei Ersatzprogrammen zum Vektormaximumproblem, in: R. Henn, H. P. Künzi and H. Schubert (eds.), Operations Research Verfahren XII, Anton Hain, Meisenheim, 1972, 117–123 (reference [4] of the paper; no online version known).
  • V. J. Bowman, On the Relationship of the Tchebycheff Norm and the Efficient Frontier of Multiple-Criteria Objectives, Lecture Notes in Economics and Mathematical Systems, Springer (reference [1] of the paper).
  • E.-U. Choo and D. R. Atkins, An Interactive Algorithm for Multicriteria Programming, Computers and Operations Research 7 (1980) 81–87 (reference [3] of the paper).
  • S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004, §4.7.4. https://web.stanford.edu/~boyd/cvxbook/
11 thms2 active usersReviewed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming IX: The Correspondence Between Lift-and-Project Cuts and Simple Disjunctive CutsTextbook

Motivation

Chapter 6 built lift-and-project (L&P) cuts from a cut-generating LP, and Chapter 7 surveyed alternative nonlinear constructions reaching the same integer hull. This chapter asks a sharper question: how do L&P cuts relate, coefficient for coefficient, to older, more classical cutting planes — simple disjunctive cuts and mixed integer Gomory cuts, derived directly from a simplex tableau rather than from an auxiliary LP? The answer is an exact correspondence: every L&P cut from a basic solution of the cut-generating LP is equivalent to a specific simple disjunctive cut from a specific tableau basis, and conversely. This correspondence is not merely of theoretical interest — it converts a question about an infinite family of cuts into a finite, countable one (bases of a linear system), and it is what lets the chapter's capstone result, Theorem 8.7, establish a uniform rank bound of ppp (the number of 0-1 variables) across four cut families at once, by proving it for one and transporting the proof to the other three.

Setting

(CGLP)k(CGLP)_k(CGLP)k​ (eq. (8.1)) is the cut-generating LP for the disjunction −xk≥0∨xk≥1-x_k \ge 0 \lor x_k \ge 1−xk​≥0∨xk​≥1, with an added normalization constraint ue+u0+ve+v0=1ue+u_0+ve+v_0=1ue+u0​+ve+v0​=1 that makes its feasible polytope bounded — so a "basic solution" can be identified with an extreme point of that polytope. Given a basic solution with u0,v0>0u_0,v_0>0u0​,v0​>0 and basic u/vu/vu/v-components indexed by M1,M2M_1,M_2M1​,M2​ (Lemma 8.1-8.2), the n×nn\times nn×n submatrix A^\hat AA^ of A~\tilde AA~ indexed by J:=M1∪M2J:=M_1\cup M_2J:=M1​∪M2​ is nonsingular, giving a simplex tableau in which xkx_kxk​ is expressed as xk=aˉk0−∑j∈Jaˉkjxjx_k = \bar a_{k0} - \sum_{j\in J}\bar a_{kj}x_jxk​=aˉk0​−∑j∈J​aˉkj​xj​ (eq. (8.5)). The simple disjunctive cut from xk≤0∨xk≥1x_k\le 0 \lor x_k\ge 1xk​≤0∨xk​≥1 applied to this row has coefficients πj:=max⁡{πj1,πj2}\pi_j := \max\{\pi^1_j,\pi^2_j\}πj​:=max{πj1​,πj2​}, π0:=aˉk0(1−aˉk0)\pi_0 := \bar a_{k0}(1-\bar a_{k0})π0​:=aˉk0​(1−aˉk0​) (eq. (8.7)-(8.8)).

Formalization targets

Theorem 8.7 (goal) — a uniform rank bound across four cut families

The rank of the LP relaxation PPP with respect to (a) unstrengthened L&P cuts, (b) simple disjunctive cuts, (c) strengthened L&P cuts, (d) mixed integer Gomory cuts (equivalently, strengthened simple disjunctive cuts) is at most ppp, the number of 0-1 variables.

The chain of results building toward it

Lemma 8.1 (basicness forces u0,v0>0u_0,v_0>0u0​,v0​>0), Lemma 8.2 (a basic solution's index sets give a nonsingular submatrix), Lemma 8.3 (0<aˉk0<10<\bar a_{k0}<10<aˉk0​<1), Theorem 8.4A (a basic L&P cut equals a simple disjunctive cut), Theorem 8.4B (the converse: every simple disjunctive cut from a valid basis equals some basic L&P cut), and Theorem 8.5 (the same correspondence, strengthened).

Significance

The results themselves. Theorems 8.4A/8.4B are, in the book's own words, an "exact correspondence between lift-and-project cuts for a mixed 0-1 program and earlier cuts from the literature" — placing L&P cuts, simple disjunctive cuts, and (via Theorem 8.5) mixed integer Gomory cuts on the same logical footing, all generated by choosing a basis of one underlying linear system. Theorem 8.7 is the payoff: a single uniform bound covering four cut families that the literature had previously bounded (if at all) by separate arguments, and by contrast to the unbounded rank of pure-integer fractional Gomory cuts, exhibiting a case where the mixed 0-1 structure yields much stronger guarantees.

Formalizing it. No object in this mission exists on the platform prior to it or in Mathlib. This mission restates 06-lift-project-cuts's (CGLP)(CGLP)(CGLP) apparatus and Theorem 6.4's strengthened cut formula locally, per the series convention that a draft mission cannot import another draft mission's definitions, adapted throughout to this chapter's normalized (CGLP)k(CGLP)_k(CGLP)k​ and its disjunction on a single fixed coordinate kkk.

Difficulty

Formalizing "basic solution" required a genuine choice: unlike Chapter 6, (CGLP)k(CGLP)_k(CGLP)k​'s normalization constraint makes its feasible set a bounded polytope, so this mission identifies "basic solution" with an extreme point of that polytope (Set.extremePoints) for Lemma 8.1 (whose own statement has no reference to specific index sets), while Lemmas 8.2 onward take the basic index sets M1,M2M_1,M_2M1​,M2​ directly as hypothesis data, matching how those theorems are themselves phrased ("let the basic components... be indexed by M1M_1M1​ and M2M_2M2​"). Theorem 8.7's rank bound required designing one generic HasRankAtMost predicate, parametrized by an abstract cut-closure operator, applicable uniformly to all four families — mirroring the book's own proof structure, which establishes the bound for one family and transports it to the other three via Theorems 8.4A/8.4B and 8.5, rather than arguing each part from scratch.

Formalization scope

The row/variable identification gap (see MODERATION_NOTES.md). The book's own eq. (8.4)- (8.5) identifies certain rows of the augmented, m+p+nm+p+nm+p+n-row matrix A~\tilde AA~ (those that are bound constraints xj≥0x_j\ge 0xj​≥0) with the variables they bound, so that a chosen nonbasic row set JJJ doubles as a set of "nonbasic variables." This mission's abstract row type does not track that identification (matching the abstraction already used throughout 06-lift-project-cuts and 07-higher-dim): Surplus instead defines the tableau row's nonbasic quantities directly as the slack expression sj:=(A~x)j−b~js_j := (\tilde Ax)_j - \tilde b_jsj​:=(A~x)j​−b~j​, a genuine affine function of xxx for every row, which reduces to xjx_jxj​ itself exactly when row jjj is that bound constraint — mathematically equivalent to the book's own substitution, stated without needing the row-to-variable lookup. Eq. (8.10)'s "j∈J∩N′j\in J\cap N'j∈J∩N′" strengthening-eligibility test has the same gap; this mission takes the row-positions eligible for strengthening as an explicit Finset parameter rather than deriving membership from row identity.

Corollary 8.6 is out of scope for this mission — see HARD.md. Its facet-counting bound depends on the same row/variable identification (the printed bound is (m+p+n−1n)\binom{m+p+n-1}{n}(nm+p+n−1​), excluding row kkk specifically because it is xkx_kxk​'s own bound row) and would additionally require a general notion of "number of facets of a polyhedron" that this mission's abstraction, and Mathlib, do not provide; it does not feed Theorem 8.7's own proof, which cites only Theorems 8.4A/8.4B and 8.5.

Theorem 8.7 is stated via one generic HasRankAtMost predicate applied to SplitConvexify (part a) and three closure operators (SimpleDisjClosureOfSet, StrengthenedLPClosureOfSet, MIGClosureOfSet, parts b-d) defined by intersecting a represented polyhedron with every cut of the corresponding family, then lifted to bare sets by quantifying over every linear representation — since, unlike the split-convexification closure, these three cut families are defined via an explicit basis or CGLP solution and so genuinely need some concrete representation of the current polyhedron at each step of the recursion (the same representation-dependence Theorem 7.5's Lovász-Schrijver iteration required in 07-higher-dim).

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 8.
  • E. Balas, M. Perregaard, A precise correspondence between lift-and-project cuts, simple disjunctive cuts, and mixed integer Gomory cuts for 0-1 programming, Mathematical Programming B 94 (2003), 221–245 (cited in the text as [33], the origin of Lemma 8.2 and Theorems 8.4A/8.4B).
  • E. Balas, M. Perregaard, Lift-and-project for mixed 0-1 programming: recent progress, Discrete Applied Mathematics 123 (2002), 129–154 (cited in the text as [32], the origin of Theorem 8.5's strengthened-cut coefficient identification).
  • F. Eisenbrand, A. Schulz, Bounds on the Chvátal rank of polytopes in the 0-1 cube, in Integer Programming and Combinatorial Optimization (IPCO 7), LNCS 1610 (1999), 137–150 (cited in the text as [73], the source of the unbounded pure-integer Gomory rank result this chapter's Theorem 8.7 contrasts with).
14 thms4 active users
🏆Completed
CombinatoricsConvex OptimizationOperations Research+1·Captain: mikedeng1

Convexity and Steinitz's Exchange Property II: The Local Supermodularity Theorem for the Concave ConjugateResearch Paper

Motivation

Matroids and their integral generalizations, integral base polytopes, are the combinatorial structures on which the greedy algorithm is exact. Edmonds' theory relates them to submodular and supermodular set functions: a polytope is a base polytope exactly when its support function, restricted to 0/10/10/1 vectors, is supermodular and the greedy formula evaluates it everywhere. Dress and Wenzel's valuated matroids (1990) and Murota's M-concave functions carry the exchange axiom from sets to functions on sets. This paper (Adv. Math. 124, 1996) sets up the resulting theory of discrete concave functions on base sets, later developed into discrete convex analysis (Murota, Discrete Convex Analysis, SIAM 2003).

The question behind this mission is how the set-level correspondence between exchange and supermodularity extends to functions. Section 5 of the paper answers it with the Local Supermodularity Theorem: the exchange property of a function is a supermodularity property of its concave conjugate, holding locally at every point.

Setting

Let VVV be a finite nonempty set, n=∣V∣n=|V|n=∣V∣. For u∈Vu\in Vu∈V let χu∈ZV\chi_u\in\mathbb Z^Vχu​∈ZV be the unit vector, for X⊆VX\subseteq VX⊆V let χX\chi_XχX​ be its characteristic vector, x(X)=∑v∈Xx(v)x(X)=\sum_{v\in X}x(v)x(X)=∑v∈X​x(v), and ⟨p,x⟩=∑vp(v)x(v)\langle p,x\rangle=\sum_v p(v)x(v)⟨p,x⟩=∑v​p(v)x(v). For a finite B⊆ZVB\subseteq\mathbb Z^VB⊆ZV, B‾\overline BB is its convex hull.

A finite integral base set is a finite nonempty B⊆ZVB\subseteq\mathbb Z^VB⊆ZV such that

(B1)x,y∈B, u∈supp⁡+(x−y) ⇒ ∃v∈supp⁡−(x−y): x−χu+χv∈B.\text{(B1)}\quad x,y\in B,\ u\in\operatorname{supp}^+(x-y)\ \Rightarrow\ \exists v\in\operatorname{supp}^-(x-y):\ x-\chi_u+\chi_v\in B.(B1)x,y∈B, u∈supp+(x−y) ⇒ ∃v∈supp−(x−y): x−χu​+χv​∈B.

A function ω:B→R\omega:B\to\mathbb Rω:B→R satisfies the exchange property (EXC) (is M-concave) if for x,y∈Bx,y\in Bx,y∈B and u∈supp⁡+(x−y)u\in\operatorname{supp}^+(x-y)u∈supp+(x−y) there is v∈supp⁡−(x−y)v\in\operatorname{supp}^-(x-y)v∈supp−(x−y) with x−χu+χv, y+χu−χv∈Bx-\chi_u+\chi_v,\ y+\chi_u-\chi_v\in Bx−χu​+χv​, y+χu​−χv​∈B and ω(x)+ω(y)≤ω(x−χu+χv)+ω(y+χu−χv)\omega(x)+\omega(y)\le\omega(x-\chi_u+\chi_v)+\omega(y+\chi_u-\chi_v)ω(x)+ω(y)≤ω(x−χu​+χv​)+ω(y+χu​−χv​). Write ω[p](x)=ω(x)+⟨p,x⟩\omega[p](x)=\omega(x)+\langle p,x\rangleω[p](x)=ω(x)+⟨p,x⟩ and argmax⁡(g)\operatorname{argmax}(g)argmax(g) for the maximizers of ggg on BBB.

The support function of BBB is ψ∘(p)=min⁡{⟨p,x⟩∣x∈B}\psi^\circ(p)=\min\{\langle p,x\rangle\mid x\in B\}ψ∘(p)=min{⟨p,x⟩∣x∈B}. A positively homogeneous h:RV→Rh:\mathbb R^V\to\mathbb Rh:RV→R is "matroidal" if

  • (C1) X↦h(χX)X\mapsto h(\chi_X)X↦h(χX​) is supermodular, and
  • (C2) h(p)=∑j=1n(pj−pj+1) h(χVj)h(p)=\sum_{j=1}^n(p_j-p_{j+1})\,h(\chi_{V_j})h(p)=∑j=1n​(pj​−pj+1​)h(χVj​​) whenever V={v1,…,vn}V=\{v_1,\dots,v_n\}V={v1​,…,vn​} with p(v1)≥⋯≥p(vn)p(v_1)\ge\dots\ge p(v_n)p(v1​)≥⋯≥p(vn​), pj=p(vj)p_j=p(v_j)pj​=p(vj​), Vj={v1,…,vj}V_j=\{v_1,\dots,v_j\}Vj​={v1​,…,vj​}, pn+1=0p_{n+1}=0pn+1​=0.

The concave conjugate is ω∘(p)=min⁡{⟨p,x⟩−ω(x)∣x∈B}\omega^\circ(p)=\min\{\langle p,x\rangle-\omega(x)\mid x\in B\}ω∘(p)=min{⟨p,x⟩−ω(x)∣x∈B}, the concave closure is ω^(b)=inf⁡p{⟨p,b⟩−ω∘(p)}\hat\omega(b)=\inf_p\{\langle p,b\rangle-\omega^\circ(p)\}ω^(b)=infp​{⟨p,b⟩−ω∘(p)}, the subdifferential is ∂ω∘(p0)={b∣ω∘(p)−ω∘(p0)≤⟨p−p0,b⟩ ∀p}\partial\omega^\circ(p_0)=\{b\mid\omega^\circ(p)-\omega^\circ(p_0)\le\langle p-p_0,b\rangle\ \forall p\}∂ω∘(p0​)={b∣ω∘(p)−ω∘(p0​)≤⟨p−p0​,b⟩ ∀p}, and the localization of ω∘\omega^\circω∘ at p0p_0p0​ is L^(ω∘,p0)(p)=inf⁡{⟨p,b⟩∣b∈∂ω∘(p0)}\hat L(\omega^\circ,p_0)(p)=\inf\{\langle p,b\rangle\mid b\in\partial\omega^\circ(p_0)\}L^(ω∘,p0​)(p)=inf{⟨p,b⟩∣b∈∂ω∘(p0​)}.

Formalization targets

Goal: the Local Supermodularity Theorem (Theorem 5.3, corrected)

For ω\omegaω on a finite integral base set BBB,

ω satisfies (EXC)  ⟺  (ω=ω^ on B) and (L^(ω∘,p0) is "matroidal" for every p0∈RV).\omega\ \text{satisfies (EXC)}\iff\Big(\omega=\hat\omega\ \text{on}\ B\Big)\ \text{and}\ \Big(\hat L(\omega^\circ,p_0)\ \text{is "matroidal" for every}\ p_0\in\mathbb R^V\Big).ω satisfies (EXC)⟺(ω=ω^ on B) and (L^(ω∘,p0​) is "matroidal" for every p0​∈RV).

The printed Theorem 5.3 has only the second condition on the right. Its "only if" direction holds as printed; its "if" direction is false without the first condition, and a separate item of the mission states the counterexample: B={(2,0),(1,1),(0,2)}B=\{(2,0),(1,1),(0,2)\}B={(2,0),(1,1),(0,2)}, ω=(0,−10,0)\omega=(0,-10,0)ω=(0,−10,0).

Milestones

  1. Theorem 2.1: (B1) is equivalent to BBB being the integer points of an integral submodular (equivalently, supermodular) system, whose defining function is determined by BBB.
  2. Theorem 5.1: if B=ZV∩B‾B=\mathbb Z^V\cap\overline BB=ZV∩B, then BBB satisfies (B1) iff ψ∘\psi^\circψ∘ is "matroidal".
  3. Lemma 5.2: sums of "matroidal" functions are "matroidal".
  4. Theorem 4.4: (EXC) holds iff every argmax⁡(ω[p])\operatorname{argmax}(\omega[p])argmax(ω[p]) satisfies (B1).
  5. Eq. (5.12): L^(ω∘,p0)(p)=min⁡{⟨p,x⟩∣x∈argmax⁡(ω[−p0])}\hat L(\omega^\circ,p_0)(p)=\min\{\langle p,x\rangle\mid x\in\operatorname{argmax}(\omega[-p_0])\}L^(ω∘,p0​)(p)=min{⟨p,x⟩∣x∈argmax(ω[−p0​])}.

Significance

The result. Theorem 5.3 is the function-level version of Theorem 5.1. Condition (C1) is a supermodularity condition, so the theorem expresses (EXC) as "a collection of local supermodularity" properties of ω∘\omega^\circω∘, in the same way that (B1) corresponds to supermodularity of a support function. In the paper this characterization of the conjugate side underlies the Fenchel-type duality of Section 6, and more generally the conjugacy between M-concave and L-convex functions in discrete convex analysis.

The formalization. No part of this theory is formalized in Lean or on this platform: base sets, (EXC), "matroidal" functions and concave conjugates of functions on base sets are all new. The mission also corrects the published statement: the reduction from localizations to base sets needs every integer point of conv⁡(argmax⁡ ω[−p0])\operatorname{conv}(\operatorname{argmax}\,\omega[-p_0])conv(argmaxω[−p0​]) to be a maximizer, and the concave-closure condition supplies this. A machine-checked proof would settle both the corrected theorem and the counterexample. Theorem 2.1 and Lemma 5.2 are classical but have no formal proof either.

Difficulty

ω∘\omega^\circω∘ depends only on the concave closure ω^\hat\omegaω^, so any characterization of (EXC) through ω∘\omega^\circω∘ alone cannot see values of ω\omegaω below ω^\hat\omegaω^. That is why the goal needs the extra clause. The "only if" direction needs the full theory of Section 4: M-concave functions coincide with their concave closure, and all their maximizer sets are base sets. Theorem 5.1 needs the greedy algorithm on integral base polytopes, together with the fact that the base polytope of an integral supermodular function has integral vertices. Theorem 2.1 is the folklore statement that polyhedral and exchange descriptions agree, and the paper does not prove it. Eq. (5.12) needs the subdifferential of a finite minimum of affine functions to be the convex hull of the active gradients, stated globally rather than only near p0p_0p0​.

Formalization scope

Integer vectors are V → ℤ, real vectors V → ℝ, with [Fintype V] [DecidableEq V] [Nonempty V]. A finite subset of ZV\mathbb Z^VZV is a Finset (V → ℤ). A function on BBB is a total function (V → ℤ) → ℝ whose values off BBB are never used. The mission commits to the following readings:

  • Minima. ψ∘\psi^\circψ∘, ω∘\omega^\circω∘ are real infima over the finite set BBB, hence minima for nonempty BBB (every statement has BBB nonempty). ω^\hat\omegaω^ is a real infimum used only at points of BBB, where it is bounded below.
  • Localization. L^\hat LL^ is a real sInf over the subdifferential, defined by (5.8)–(5.9) exactly, not by the formula (5.12). Eq. (5.12) is stated with IsLeast, so it asserts attainment, not just the value.
  • (C2). It is required for every bijection Fin n ≃ V along which ppp is non-increasing. This is equivalent to "for some" such indexing. "Matroidal" includes positive homogeneity but not concavity.
  • Theorem 2.1. The page's "∀X⊂V\forall X\subset V∀X⊂V" is read as all X⊆VX\subseteq VX⊆V. The set functions are integer-valued, and "Moreover" is read strongly: every fff (resp. ggg) as in (b) (resp. (c)) equals the displayed max (resp. min).
  • Theorem 4.4. "argmax⁡(ω[p])‾\overline{\operatorname{argmax}(\omega[p])}argmax(ω[p])​ is an integral base polytope" is read as "argmax⁡(ω[p])\operatorname{argmax}(\omega[p])argmax(ω[p]) satisfies (B1)", following Lemma 4.3 and the proof of Theorem 5.3. The literal convex-hull reading makes the "if" direction false (same counterexample).
  • Theorem 5.1 keeps the page's hypothesis B=ZV∩B‾B=\mathbb Z^V\cap\overline BB=ZV∩B.

Trivializing formalizations are ruled out. Defining L^\hat LL^ by (5.12) would reduce the goal to Theorems 4.4 and 5.1. A "matroidal" without (C2) would be satisfied by support functions of non-base sets. An ω∘\omega^\circω∘ taken as a supremum would reverse the sign conventions.

The development needs: the greedy algorithm and integrality for integral base polytopes, supergradients of polyhedral concave functions, and the Section 4 results of the paper (concave closure of M-concave functions, Lemma 4.3). The base-set and "matroidal" layers can be reused beyond this mission. Proofs of any milestone, of the counterexample, and a proof of the "only if" direction on its own are all welcome.

Selected references

  • K. Murota, Convexity and Steinitz's exchange property, Advances in Mathematics 124 (1996), 272–311. https://doi.org/10.1006/aima.1996.0084
  • A. W. M. Dress, W. Wenzel, Valuated matroids: a new look at the greedy algorithm, Applied Mathematics Letters 3 (1990), 33–35.
  • S. Fujishige, Submodular Functions and Optimization, 2nd ed., Annals of Discrete Mathematics 58, Elsevier, 2005.
  • L. Lovász, Submodular functions and convexity, in Mathematical Programming: The State of the Art, Springer, 1983, 235–257. https://doi.org/10.1007/978-3-642-68874-4_10
  • K. Murota, Discrete Convex Analysis, SIAM, 2003. https://doi.org/10.1137/1.9780898718508
15 thms7 active usersReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me