Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Combinatorics

630 missions · 353 completed

The mathematics of finite and discrete structures — counting the arrangements of a set, deciding when a configuration meeting prescribed constraints can exist, and characterizing the patterns such structures are forced to contain. It encompasses enumerative and extremal combinatorics, graph theory, design theory, and additive combinatorics, with deep ties to algebra, probability, and computer science.

Missions

Open277Completed353All630
🏆Completed
Operations Research·Captain: mikedeng1

On the Abstract Properties of Linear Dependence 2: The Rank Postulates and the Circuit Postulates Are EquivalentResearch Paper

Motivation

Hassler Whitney's 1935 paper On the Abstract Properties of Linear Dependence introduced matroids: finite sets of elements carrying an abstract notion of dependence that captures what linearly dependent columns of a matrix and cycles of a graph have in common. A distinctive feature of the paper is that it gives several independent axiom systems for the same structure: one in terms of rank, one in terms of independent sets, one in terms of bases, and one in terms of circuits (minimal dependent sets). It then proves they are interchangeable. These equivalences, now called cryptomorphisms, are what allow matroid theory to move freely between the algebraic picture (rank of a set of vectors) and the combinatorial one (cycles of a graph, minimal dependent column sets). Every textbook on the subject relies on them, for example J. Oxley, Matroid Theory, Chapter 1.

This mission treats one of them: the equivalence of Whitney's rank postulates (§2) and circuit postulates (§8). The circuit side is the one used in combinatorial optimization, where circuits appear as cycles in network flows, as minimal infeasible subsystems, and in the exchange arguments behind the greedy algorithm.

Setting

Let MMM be a finite set of elements. For subsets we write N+eN + eN+e for N∪{e}N \cup \{e\}N∪{e} and P1+P2P_1 + P_2P1​+P2​ for P1∪P2P_1 \cup P_2P1​∪P2​.

Rank system. A function rrr assigning an integer r(N)r(N)r(N) to each N⊆MN \subseteq MN⊆M satisfies the rank postulates if

  • (R1)(\mathrm R_1)(R1​) the rank of the null subset is zero;
  • (R2)(\mathrm R_2)(R2​) for any subset NNN and any element eee not in NNN, r(N+e)=r(N)+kr(N+e) = r(N) + kr(N+e)=r(N)+k with k=0k = 0k=0 or 111;
  • (R3)(\mathrm R_3)(R3​) for any subset NNN and elements e1,e2e_1, e_2e1​,e2​ not in NNN, if r(N+e1)=r(N+e2)=r(N)r(N+e_1) = r(N+e_2) = r(N)r(N+e1​)=r(N+e2​)=r(N), then r(N+e1+e2)=r(N)r(N+e_1+e_2) = r(N)r(N+e1​+e2​)=r(N).

With ρ(N)\rho(N)ρ(N) the number of elements of NNN, the nullity is n(N)=ρ(N)−r(N)n(N) = \rho(N) - r(N)n(N)=ρ(N)−r(N). An element eee is dependent on NNN if r(N+e)=r(N)r(N+e) = r(N)r(N+e)=r(N). A circuit of rrr is a minimal dependent set: a subset PPP with n(P)>0n(P) > 0n(P)>0 such that n(N)=0n(N) = 0n(N)=0 for every proper subset NNN of PPP. In Lean these are IsRankSystem r, nullity r N, IsDependentOn r e N and circuitsOfRank r P.

Circuit system. A family of subsets, called circuits, satisfies the circuit postulates (§8, p. 516) if

(C₁) No proper subset of a circuit is a circuit.

(C₂) If P₁ and P₂ are circuits, e₁ is in both P₁ and P₂, and e₂ is in P₁ but not in P₂, then there is a circuit P₃ in P₁ + P₂ containing e₂ but not e₁.

In Lean this is IsCircuitSystem C for a predicate C : Finset α → Prop.

Rank from circuits. Whitney defines (p. 516):

Let e₁, ⋯, e_p be any ordered set of elements of M. Set Γᵢ = 0 if there is a circuit in e₁ + ⋯ + eᵢ containing eᵢ, and set Γᵢ = 1 otherwise (compare Theorem 5). Let the "rank" of (e₁, ⋯, e_p) be r(e₁, ⋯, e_p) = Σ_{i=1}^{p} Γᵢ.

In Lean, rankSeq C l is this sum for a list l, and rankOfCircuits C N is its value on the enumeration N.toList of a subset NNN.

Formalization targets

Goal: the two systems are equivalent

For every finite set MMM:

(1)r satisfies (R)  ⟹  C(r) satisfies (C), ∅∉C(r), rC(r)=r;\text{(1)}\quad r \text{ satisfies } (\mathrm R) \;\Longrightarrow\; \mathcal C(r) \text{ satisfies } (\mathrm C),\ \emptyset \notin \mathcal C(r),\ r_{\mathcal C(r)} = r;(1)r satisfies (R)⟹C(r) satisfies (C), ∅∈/C(r), rC(r)​=r; (2)C satisfies (C), ∅∉C  ⟹  rC satisfies (R), C(rC)=C,\text{(2)}\quad \mathcal C \text{ satisfies } (\mathrm C),\ \emptyset \notin \mathcal C \;\Longrightarrow\; r_{\mathcal C} \text{ satisfies } (\mathrm R),\ \mathcal C(r_{\mathcal C}) = \mathcal C,(2)C satisfies (C), ∅∈/C⟹rC​ satisfies (R), C(rC​)=C,

where C(r)\mathcal C(r)C(r) is the family of circuits of rrr and rCr_{\mathcal C}rC​ is the rank defined from C\mathcal CC. This is Whitney's closing sentence of §8 (p. 517): "The definitions of rank and of circuits under the two systems (R), (C) agree, and hence the systems are equivalent."

Milestones, in the order the argument uses them

  • Lemma 5 (p. 512): each element of a circuit is dependent on the rest of the circuit.
  • Lemma 6 (p. 512): if e∉P1e \notin P_1e∈/P1​ is dependent on P1P_1P1​ but on no proper subset of P1P_1P1​, then P1+eP_1 + eP1​+e is a circuit.
  • Theorem 4 (p. 512): for e∉Ne \notin Ne∈/N, some circuit in N+eN + eN+e contains eee if and only if eee is dependent on NNN.
  • Theorem 5 (p. 513): if N=e1+⋯+epN = e_1 + \cdots + e_pN=e1​+⋯+ep​ is formed element by element, n(N)n(N)n(N) is the number of indices iii for which some circuit in e1+⋯+eie_1 + \cdots + e_ie1​+⋯+ei​ contains eie_iei​.
  • §5 (pp. 512–513): the circuits of a rank system satisfy (C1)(\mathrm C_1)(C1​) and (C2)(\mathrm C_2)(C2​).
  • Lemma 7 (p. 516): r(e1,…,eq−2,eq−1,eq)=r(e1,…,eq−2,eq,eq−1)r(e_1, \dots, e_{q-2}, e_{q-1}, e_q) = r(e_1, \dots, e_{q-2}, e_q, e_{q-1})r(e1​,…,eq−2​,eq−1​,eq​)=r(e1​,…,eq−2​,eq​,eq−1​) under (C1)(\mathrm C_1)(C1​), (C2)(\mathrm C_2)(C2​).
  • Lemma 8 (p. 517): the rank of a subset defined from circuits does not depend on the ordering of its elements.
  • §8 (p. 517): the rank defined from circuits satisfies (R1)(\mathrm R_1)(R1​)–(R3)(\mathrm R_3)(R3​).

Significance

The equivalence makes the circuit postulates a complete description of a matroid: everything stated about rank, nullity, independence and bases can be phrased through circuits and back. Downstream in the same paper, the fundamental sets of circuits of §9 (Theorem 9) and the binary-matroid characterization of the Appendix are stated in terms of circuits, and they depend on circuits and rank being interchangeable. Theorem 5, read on its own, expresses the nullity of a set as a count of circuit-closing steps. This is the abstract form of the fact that the cycle space of a graph has dimension equal to the number of non-tree edges.

On the formal side, Mathlib's Matroid is built on the base axioms and proves circuit elimination (Matroid.IsCircuit.strong_elimination) as a theorem about that structure. Whitney's own route is different: rank defined from circuits by an ordered sum of Γi\Gamma_iΓi​, with order-independence (Lemmas 7 and 8) as the central step. That route has no machine-checked version that we know of, on Prove2Me or elsewhere. This mission formalizes the 1935 argument as stated: the rank and circuit systems as Whitney wrote them, and the two translations between them.

Difficulty

The obvious definition of the rank of a set from its circuits enumerates the set and counts the elements that do not close a circuit with their predecessors. This definition depends on the enumeration, and nothing in (C1)(\mathrm C_1)(C1​), (C2)(\mathrm C_2)(C2​) obviously prevents two orderings from giving different counts. Lemma 7, the swap of two adjacent elements, is where (C2)(\mathrm C_2)(C2​) does real work, through a case analysis on which of the two swapped elements closes a circuit. In the other direction, (C2)(\mathrm C_2)(C2​) for circuits of a rank function requires turning the local postulate (R3)(\mathrm R_3)(R3​) into a statement about unions of two circuits. Defining the circuit rank as a maximum over orderings, or as the size of a largest circuit-free subset, sidesteps exactly the step the paper proves and is not this mission.

Formalization scope

  • The elements form a finite type α with [Fintype α] [DecidableEq α]. The ground set is all of α, and subsets are Finset α. Whitney's matroid is a finite set e1,…,ene_1, \dots, e_ne1​,…,en​.
  • Ranks and nullities are integers (ℤ), so that n(N)=ρ(N)−r(N)n(N) = \rho(N) - r(N)n(N)=ρ(N)−r(N) is a true difference.
  • Ordered sets of elements are lists. Lemmas 7, 8 and Theorem 5 assume the list has no repetitions, as Whitney's "ordered set of elements" means. "A circuit in e1+⋯+eie_1 + \cdots + e_ie1​+⋯+ei​" means a circuit contained in {e1,…,ei}\{e_1, \dots, e_i\}{e1​,…,ei​}.
  • The rank of a subset from circuits is computed along one fixed enumeration N.toList. Its independence from the enumeration is Lemma 8, and the definition does not build it in.
  • Tacit hypothesis made explicit. Whitney's circuits are nonempty, since a circuit of a rank system has positive nullity. The family {∅}\{\emptyset\}{∅} satisfies (C1)(\mathrm C_1)(C1​), (C2)(\mathrm C_2)(C2​) vacuously, but its circuit rank is ρ\rhoρ, which has no circuits, so the round trip fails. Part (2) of the goal therefore assumes ∅∉C\emptyset \notin \mathcal C∅∈/C, and part (1) asserts ∅∉C(r)\emptyset \notin \mathcal C(r)∅∈/C(r).
  • Lemma 6 assumes e∉P1e \notin P_1e∈/P1​, which the paper leaves tacit.
  • Ruled out. Neither system may be encoded as Mathlib's Matroid in the statements. Doing so would turn the equivalence into a library lemma. The statements are about Whitney's postulates on bare functions and predicates.

The development needs only finite sets, lists and permutations from Mathlib. The definitions IsRankSystem and IsCircuitSystem can be reused for the other cryptomorphisms of the paper. Contributions are welcome on any milestone, and so are local helper lemmas, such as monotonicity of rank under (R1)(\mathrm R_1)(R1​)–(R3)(\mathrm R_3)(R3​) or invariance of rankSeq under prefix-preserving changes.

Selected references

  • H. Whitney, On the Abstract Properties of Linear Dependence, American Journal of Mathematics 57 (1935), no. 3, 509–533. https://doi.org/10.2307/2371182
  • J. Oxley, Matroid Theory, 2nd ed., Oxford Graduate Texts in Mathematics 21, Oxford University Press, 2011. https://doi.org/10.1093/acprof:oso/9780198566946.001.0001
  • Mathlib, Mathlib/Combinatorics/Matroid/Circuit.lean (circuits of Mathlib's Matroid). https://github.com/leanprover-community/mathlib4
12 thms2 active usersReviewed
🏆Completed
Graph TheoryLinear algebraTheoretical Computer Science·Captain: mikedeng1

Explicit Expanders of Every Degree and Size 2: Attaching New Vertices to a (p+1)-Regular Ramanujan Graph and Adding Loops Keeps Every Nontrivial Eigenvalue at Most √(2(p+1)) + √p + o(1)Research Paper

Motivation

Sparse graphs whose adjacency spectrum is concentrated near zero, expanders, are used throughout theoretical computer science: in error-correcting codes, derandomization, sorting and routing networks, and the construction of pseudorandom objects (Hoory, Linial and Wigderson, survey). The best possible spectral expansion for a ddd-regular graph is governed by the Alon–Boppana bound 2d−12\sqrt{d-1}2d−1​, and graphs attaining it, Ramanujan graphs, were constructed explicitly by Lubotzky, Phillips and Sarnak (LPS 1988) and by Margulis. These constructions exist only for special degrees (d=p+1d = p+1d=p+1 with ppp prime) and special numbers of vertices (orders of PSL(2,Fq)PSL(2,\mathbb F_q)PSL(2,Fq​) or SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​)). Applications often need a graph of a prescribed size nnn.

N. Alon's paper Explicit expanders of every degree and size (arXiv:2003.11673v1; Combinatorica 41, 2021) shows how to obtain explicit near-Ramanujan graphs on exactly nnn vertices. This mission formalizes the spectral core of its Theorem 1.2: a Ramanujan graph on mmm vertices can be enlarged to n=m+rn = m + rn=m+r vertices, with degree raised by one, while the nontrivial eigenvalues stay within a constant factor of optimal.

Setting

Let VVV be a finite set of m≥1m \ge 1m≥1 vertices. A (n,d,λ)(n,d,\lambda)(n,d,λ)-graph is a ddd-regular graph on nnn vertices whose adjacency matrix AAA satisfies ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every nontrivial eigenvalue μ\muμ, that is, every eigenvalue other than the top eigenvalue ddd of the constant vector 1\mathbf 11. For a symmetric AAA with A1=d 1A\mathbf 1 = d\,\mathbf 1A1=d1, the nontrivial eigenvalues are those with an eigenvector f≠0f \ne 0f=0 satisfying ∑vf(v)=0\sum_v f(v) = 0∑v​f(v)=0. Graphs may carry loops, at most one per vertex, and a loop adds one to the degree: it is a diagonal entry 111 of AAA.

Fix an integer p≥0p \ge 0p≥0 and let HHH be an (m,p+1,2p)(m, p+1, 2\sqrt p)(m,p+1,2p​)-graph on VVV, a (p+1)(p+1)(p+1)-regular Ramanujan graph. Let R={u1,…,ur}R = \{u_1, \dots, u_r\}R={u1​,…,ur​} be rrr new vertices and let W1,…,Wr⊆VW_1, \dots, W_r \subseteq VW1​,…,Wr​⊆V be pairwise disjoint sets of p+2p+2p+2 vertices each. Put W=⋃iWiW = \bigcup_i W_iW=⋃i​Wi​ and L=V∖WL = V \setminus WL=V∖W. The graph GGG on U=V∪RU = V \cup RU=V∪R is obtained from HHH by joining each uiu_iui​ to every vertex of WiW_iWi​ and adding one loop at each vertex of LLL. Its adjacency matrix is

AG=AH+AR+AL,A_G = A_H + A_R + A_L,AG​=AH​+AR​+AL​,

where AHA_HAH​ is the adjacency matrix of HHH (zero on RRR), ARA_RAR​ that of the stars joining uiu_iui​ to WiW_iWi​, and ALA_LAL​ the diagonal matrix of the loops. Every vertex of GGG has degree p+2p+2p+2.

Formalization targets

Goal: Theorem 1.2, spectral core

AG is an (m+r,  p+2,  2(p+1)+p+(p+1) rm) matrix.A_G \text{ is an } \Big(m+r,\; p+2,\; \sqrt{2(p+1)} + \sqrt p + \frac{(p+1)\,r}{m}\Big)\text{ matrix.}AG​ is an (m+r,p+2,2(p+1)​+p​+m(p+1)r​) matrix.

The paper states λ≤2(d−1)+d−1+o(1)\lambda \le \sqrt{2(d-1)} + \sqrt{d-1} + o(1)λ≤2(d−1)​+d−1​+o(1) for d=p+2d = p+2d=p+2; its proof gives 2(p+1)+p+o(1)\sqrt{2(p+1)} + \sqrt p + o(1)2(p+1)​+p​+o(1), which is stronger, and the error term it produces is (p+1)r/m(p+1)r/m(p+1)r/m. The goal is parametrised by HHH, rrr and the sets WiW_iWi​, so it does not depend on how mmm and rrr are chosen.

Milestones

  1. The variational characterization of the nontrivial eigenvalues: for a symmetric matrix with constant row sums and λ≥0\lambda \ge 0λ≥0, ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every nontrivial eigenvalue if and only if ∣ftAf∣≤λ∥f∥2|f^tAf| \le \lambda\|f\|^2∣ftAf∣≤λ∥f∥2 whenever ∑f=0\sum f = 0∑f=0.
  2. The Cauchy–Schwarz display: ∑Uf=0\sum_U f = 0∑U​f=0 implies ∣∑Vf∣2=∣∑Rf∣2≤∣R∣∑Rf2|\sum_V f|^2 = |\sum_R f|^2 \le |R| \sum_R f^2∣∑V​f∣2=∣∑R​f∣2≤∣R∣∑R​f2.
  3. Inequality (3): ∣ftAHf∣≤b2(p+1)+c2 2p|f^tA_Hf| \le b^2(p+1) + c^2\, 2\sqrt p∣ftAH​f∣≤b2(p+1)+c22p​ with b2=(∑Vf)2/mb^2 = (\sum_V f)^2/mb2=(∑V​f)2/m and c2=∑Vf2−b2c^2 = \sum_V f^2 - b^2c2=∑V​f2−b2.
  4. Display (4): ftALf=∑v∈Lf2(v)f^tA_Lf = \sum_{v\in L} f^2(v)ftAL​f=∑v∈L​f2(v).
  5. Inequality (5): ∣ftARf∣≤p+2x∑Rf2+x∑Wf2|f^tA_Rf| \le \frac{p+2}{x}\sum_R f^2 + x\sum_W f^2∣ftAR​f∣≤xp+2​∑R​f2+x∑W​f2 for every x>0x > 0x>0.
  6. Inequality (6): for ∑Uf=0\sum_U f = 0∑U​f=0 and x>0x > 0x>0,
∣ftAGf∣≤(2p+1)∑Lf2+(2p+x)∑Wf2+p+2x∑Rf2+(p+1)rm∑Rf2.|f^tA_Gf| \le (2\sqrt p+1)\sum_L f^2 + (2\sqrt p+x)\sum_W f^2 + \frac{p+2}{x}\sum_R f^2 + (p+1)\frac rm \sum_R f^2.∣ftAG​f∣≤(2p​+1)L∑​f2+(2p​+x)W∑​f2+xp+2​R∑​f2+(p+1)mr​R∑​f2.

Significance

With HHH the Lubotzky–Phillips–Sarnak graph on m=∣SL(2,Fq)∣m = |SL(2,\mathbb F_q)|m=∣SL(2,Fq​)∣ vertices for the largest suitable prime qqq with m≤nm \le nm≤n, and r=n−mr = n - mr=n−m, the distribution of primes in arithmetic progressions gives r=o(m)r = o(m)r=o(m), and the goal yields an explicit (n,p+2,λ)(n, p+2, \lambda)(n,p+2,λ)-graph with λ≤(1+2)d−1+o(1)\lambda \le (1+\sqrt2)\sqrt{d-1} + o(1)λ≤(1+2​)d−1​+o(1) for every sufficiently large nnn. This is within a factor of about 1.211.211.21 of the Ramanujan bound 2d−12\sqrt{d-1}2d−1​, for every number of vertices, by an elementary modification of an existing graph. The statement is useful independently of LPS: any Ramanujan graph, or any graph with a bound on its nontrivial eigenvalues, can be padded to a nearby size in the same way.

The result is proved in the paper. No formalization of it, of the (n,d,λ)(n,d,\lambda)(n,d,λ) notion, or of the variational characterization of nontrivial eigenvalues for regular graphs exists on the platform. The mission produces a checked version of the spectral argument, and the variational characterization (milestone 1) is a general fact about symmetric matrices with constant row sums that applies to any spectral expander argument.

Difficulty

The vertices of WWW and LLL lie in the old graph HHH, whose spectrum is controlled, but the new vertices of RRR are not; and a vector orthogonal to 1\mathbf 11 on UUU need not be orthogonal to the constant vector on VVV. Bounding ftAGff^tA_GfftAG​f by applying the Ramanujan bound for HHH to fff restricted to VVV therefore fails: the restriction has a component along the trivial eigenvector of HHH, whose eigenvalue p+1p+1p+1 is large. The argument must show that this component is small, of order r/mr/mr/m, and must balance the star edges between RRR and WWW against the loops on LLL so that every vertex class gets the same coefficient. The naive bound ∣ftARf∣≤∥AR∥ ∥f∥2=p+2 ∥f∥2|f^tA_Rf| \le \|A_R\|\,\|f\|^2 = \sqrt{p+2}\,\|f\|^2∣ftAR​f∣≤∥AR​∥∥f∥2=p+2​∥f∥2 added to 2p2\sqrt p2p​ for HHH and 111 for LLL gives a constant larger than 2(p+1)+p\sqrt{2(p+1)}+\sqrt p2(p+1)​+p​; the stated constant needs the weighted estimate.

On the Lean side, milestone 1 concerns the spectrum of a symmetric matrix on the invariant subspace 1⊥\mathbf 1^\perp1⊥, while Mathlib states the spectral theorem for the whole space.

Formalization scope

  • Vertices of GGG are the disjoint union V⊕Fin rV \oplus \mathrm{Fin}\, rV⊕Finr. GGG is represented by its real adjacency matrix, since it has loops; HHH is a Mathlib SimpleGraph with adjMatrix.
  • The (n,d,λ)(n,d,\lambda)(n,d,λ) predicate is stated for matrices: ∣V∣=n|V| = n∣V∣=n, symmetry, A1=d 1A\mathbf 1 = d\,\mathbf 1A1=d1, and ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every eigenpair (μ,f)(\mu, f)(μ,f) with f≠0f \ne 0f=0 and ∑f=0\sum f = 0∑f=0. For simple graphs, ddd-regularity is added.
  • The paper's o(1)o(1)o(1) terms are replaced by the explicit quantities its proof produces: (p+1)r/m(p+1)r/m(p+1)r/m in the goal, and (p+1)rm∑Rf2(p+1)\frac rm\sum_R f^2(p+1)mr​∑R​f2 in (6). Inequality (3) is stated with the corrected relation b2+c2=∑Vf2b^2 + c^2 = \sum_V f^2b2+c2=∑V​f2; the paper's "b2+c2=1b^2 + c^2 = 1b2+c2=1" holds only for unit restrictions.
  • The bound uses p=d−2\sqrt p = \sqrt{d-2}p​=d−2​, as in the proof and the abstract, which implies the printed d−1\sqrt{d-1}d−1​.
  • ppp is any natural number. The hypothesis "ppp prime, p≡1(mod4)p \equiv 1 \pmod 4p≡1(mod4)" serves only to obtain HHH from LPS, and HHH is a hypothesis here. The sets WiW_iWi​ are arbitrary pairwise disjoint sets of size p+2p+2p+2, not the paper's consecutive blocks of a numbering of SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​).
  • Out of scope: the existence of the prime qqq and the estimate n−m=o(m)n - m = o(m)n−m=o(m); the numbering of SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​); the "strongly explicit" and polynomial-time claims; the LPS construction (Theorem 2.1, cited); the variant that replaces loops by a matching for even nnn.
  • The goal cannot be satisfied trivially: dropping the condition ∑f=0\sum f = 0∑f=0 makes it false, since p+2p+2p+2 is always an eigenvalue, and for p≥2p \ge 2p≥2 and small r/mr/mr/m the bound is below p+2p + 2p+2 (for p=5p = 5p=5 it is about 5.70+6r/m5.70 + 6r/m5.70+6r/m). At p=1p = 1p=1 the bound 3+2r/m3 + 2r/m3+2r/m is at least the degree 333, so that case holds trivially; it is the paper's statement there as well.
  • Contributions welcome: proofs of each milestone, especially the variational characterization, which is reusable for mission 3 of this series and for any regular-graph spectral argument.

Selected references

  • N. Alon, Explicit expanders of every degree and size, arXiv:2003.11673v1, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/2003.11673
  • A. Lubotzky, R. Phillips, P. Sarnak, Ramanujan graphs, Combinatorica 8 (1988) 261–277. https://doi.org/10.1007/BF02126799
  • S. Hoory, N. Linial, A. Wigderson, Expander graphs and their applications, Bull. AMS 43 (2006) 439–561. https://doi.org/10.1090/S0273-0979-06-01126-8
9 thms2 active usersReviewed
🏆Completed
Number Theory·Captain: mikedeng1

Explicit Expanders of Every Degree and Size 1: For Distinct Primes q₁, q₂, Every Large n Has an LPS Vertex Count Q(q₁, q₂, s, t) Between n and n + o(n)Research Paper

Motivation

An (n,d,λ)(n,d,\lambda)(n,d,λ)-graph is a ddd-regular graph on nnn vertices in which every eigenvalue of the adjacency matrix other than the top eigenvalue ddd has absolute value at most λ\lambdaλ. Graphs of this kind with λ\lambdaλ small compared with ddd are expanders. They are used in derandomization, error-correcting codes, sorting networks and many other constructions in theoretical computer science. A Ramanujan graph achieves λ≤2d−1\lambda\le 2\sqrt{d-1}λ≤2d−1​, which is asymptotically optimal.

The classical explicit Ramanujan graphs of Lubotzky, Phillips and Sarnak (LPS, 1988) exist only for special vertex counts, such as q(q2−1)/2q(q^2-1)/2q(q2−1)/2 for a prime qqq or the size of a quaternion group modulo mmm. N. Alon, in Explicit expanders of every degree and size (arXiv:2003.11673, 2020; Combinatorica 41, 2021), asks for explicit (n,d,λ)(n,d,\lambda)(n,d,λ)-graphs with λ≤(2+o(1))d\lambda\le(2+o(1))\sqrt dλ≤(2+o(1))d​ for every degree ddd and every number of vertices nnn. His Proposition 1.1 builds such graphs out of LPS graphs, and one ingredient is purely arithmetic. If the available vertex counts of an LPS family are dense enough, so that for every large nnn one is within a factor 1+o(1)1+o(1)1+o(1) of nnn, then a few vertices can be added or removed while keeping the spectral bound.

This mission formalizes that ingredient, Lemma 2.2 of the paper (p. 7). It concerns the vertex counts of the LPS graphs H(p,q1sq2t)H(p,q_1^sq_2^t)H(p,q1s​q2t​) for two fixed primes q1,q2q_1,q_2q1​,q2​ and all exponents s,t≥1s,t\ge1s,t≥1. With q1,q2q_1,q_2q1​,q2​ fixed, the construction needs no large primes, which is why Proposition 1.1 is strongly explicit for every fixed degree.

Setting

Fix natural numbers q1,q2q_1,q_2q1​,q2​. For natural numbers s,ts,ts,t define the LPS vertex count

Q(q1,q2,s,t)=q13(s−1) q23(t−1)⋅q1(q1−1)(q1+1)2⋅q2(q2−1)(q2+1)2.Q(q_1,q_2,s,t)=q_1^{3(s-1)}\,q_2^{3(t-1)}\cdot\frac{q_1(q_1-1)(q_1+1)}{2}\cdot\frac{q_2(q_2-1)(q_2+1)}{2}.Q(q1​,q2​,s,t)=q13(s−1)​q23(t−1)​⋅2q1​(q1​−1)(q1​+1)​⋅2q2​(q2​−1)(q2​+1)​.

When q1,q2q_1,q_2q1​,q2​ are distinct primes congruent to 111 modulo 4p4p4p and s,t≥1s,t\ge1s,t≥1, this is the number of vertices of the LPS Cayley graph H(p,q1sq2t)H(p,q_1^sq_2^t)H(p,q1s​q2t​) (§2.3, p. 6). Lemma 2.2 itself only requires q1,q2q_1,q_2q1​,q2​ to be distinct primes. Both fractions are integers, because q(q−1)(q+1)q(q-1)(q+1)q(q−1)(q+1) is a product of three consecutive integers.

The proof uses the real number α=log⁡q1/log⁡q2\alpha=\log q_1/\log q_2α=logq1​/logq2​, and the fractional part {x}=x−⌊x⌋∈[0,1)\{x\}=x-\lfloor x\rfloor\in[0,1){x}=x−⌊x⌋∈[0,1), written x mod 1x \bmod 1xmod1 in the paper.

Formalization targets

Goal: Lemma 2.2

For distinct primes q1,q2q_1,q_2q1​,q2​ there is a function g:N→Rg:\mathbb N\to\mathbb Rg:N→R with g(n)=o(n)g(n)=o(n)g(n)=o(n) such that for all sufficiently large nnn there are integers s,t≥1s,t\ge1s,t≥1 with

n≤Q(q1,q2,s,t)≤n+g(n).n\le Q(q_1,q_2,s,t)\le n+g(n).n≤Q(q1​,q2​,s,t)≤n+g(n).

Equivalently, the ratio between consecutive elements of {Q(q1,q2,s,t):s,t≥1}\{Q(q_1,q_2,s,t):s,t\ge1\}{Q(q1​,q2​,s,t):s,t≥1} tends to 111. The statement fixes no rate for ggg, matching the paper's o(n)o(n)o(n).

Milestones, in the order the proof of Lemma 2.2 uses them (p. 7)

  1. For distinct primes q1,q2q_1,q_2q1​,q2​, α=log⁡q1/log⁡q2\alpha=\log q_1/\log q_2α=logq1​/logq2​ is irrational.
  2. For irrational α\alphaα and every δ>0\delta>0δ>0 there is k1≥1k_1\ge1k1​≥1 with 0<{k1α}<δ0<\{k_1\alpha\}<\delta0<{k1​α}<δ.
  3. For distinct primes q1,q2q_1,q_2q1​,q2​ and every μ>0\mu>0μ>0 there are k1≥1k_1\ge1k1​≥1, k2≥0k_2\ge0k2​≥0 with
1≤q1k1q2k2≤1+μ.1\le \frac{q_1^{k_1}}{q_2^{k_2}}\le 1+\mu .1≤q2k2​​q1k1​​​≤1+μ.
  1. For distinct primes, μ>0\mu>0μ>0 and k1≥1k_1\ge1k1​≥1, if 1≤q1k1/q2k2≤1+μ1\le q_1^{k_1}/q_2^{k_2}\le1+\mu1≤q1k1​​/q2k2​​≤1+μ, then for s>k1s>k_1s>k1​ and t≥1t\ge1t≥1
1≤Q(q1,q2,s,t)Q(q1,q2,s−k1,t+k2)≤(1+μ)3.1\le\frac{Q(q_1,q_2,s,t)}{Q(q_1,q_2,s-k_1,t+k_2)}\le(1+\mu)^3 .1≤Q(q1​,q2​,s−k1​,t+k2​)Q(q1​,q2​,s,t)​≤(1+μ)3.

Significance

The result. Lemma 2.2 is the step of Proposition 1.1 that turns a family of Ramanujan graphs with sparse vertex counts into a family whose vertex counts approximate every large nnn up to a factor 1+o(1)1+o(1)1+o(1). The deviation from nnn can then be absorbed by the general packing argument of §2.1 of the paper. Without it, the construction would have to search for large primes depending on nnn, and the result would be explicit but not strongly explicit.

The formalization. The lemma is proved in the paper, in one paragraph. To our knowledge no machine-checked proof exists, and the platform has no statement of it. The only related platform item is the irrationality of log⁡2/log⁡3\log 2/\log 3log2/log3, the case q1=2q_1=2q1​=2, q2=3q_2=3q2​=3 of milestone 1. Formalizing the lemma requires a quantitative inhomogeneous step that the paper leaves implicit ("implying the desired result"). Its last sentence also contains a misprint that the formalization corrects (see below). The Diophantine milestones 1–3 are reusable for any argument about the multiplicative density of {q1aq2b}\{q_1^a q_2^b\}{q1a​q2b​}, for instance the ratio of consecutive elements of {2a3b}\{2^a3^b\}{2a3b}.

Difficulty

Each milestone is short. The difficulty is in making the paper's last sentence ("implying the desired result") into a proof. Taking sss or ttt large separately does not work: changing sss or ttt by one multiplies QQQ by q13q_1^3q13​ or q23q_2^3q23​, a fixed factor larger than 111, so the values obtained by varying one exponent leave gaps of a constant ratio. The bound must hold for every large nnn, not just along a subsequence, and the exponents must stay positive throughout. Milestone 2 is the classical fact that the multiples of an irrational number are dense modulo 111. It needs a pigeonhole argument, not just the irrationality.

Formalization scope

  • Representation. QQQ is a natural-number-valued Lean definition given by the explicit formula above, not the cardinality of a quaternion group. The graph-count interpretation needs the section's congruence conditions on p,q1,q2p,q_1,q_2p,q1​,q2​; Lemma 2.2 is an arithmetic statement for all distinct primes q1,q2q_1,q_2q1​,q2​. Every use of QQQ in the theorems has positive s,ts,ts,t, so natural-number subtraction s−1s-1s−1 is exact, and the division by 222 is exact since q(q−1)(q+1)q(q-1)(q+1)q(q−1)(q+1) is even. Ratios and the bound n+g(n)n+g(n)n+g(n) are computed in R\mathbb RR after casting. The logarithm is Real.log, and the fractional part is Int.fract.
  • o(n). The paper writes n≤Q≤n+o(n)n\le Q\le n+o(n)n≤Q≤n+o(n) for every large nnn. The goal states it literally: ∃g, g=o(n)\exists g,\ g=o(n)∃g, g=o(n) (Mathlib IsLittleO along atTop) and, eventually in nnn, ∃s,t≥1\exists s,t\ge1∃s,t≥1 with n≤Q≤n+g(n)n\le Q\le n+g(n)n≤Q≤n+g(n). This is equivalent to the form "for every μ>0\mu>0μ>0, every large nnn has s,t≥1s,t\ge1s,t≥1 with n≤Q≤(1+μ)nn\le Q\le(1+\mu)nn≤Q≤(1+μ)n". The paper's proof yields the second form, with the factor (1+μ)3(1+\mu)^3(1+μ)3 for arbitrary μ\muμ.
  • Misprint. The paper's last sentence compares Q(q1,q2,s,t)Q(q_1,q_2,s,t)Q(q1​,q2​,s,t) with Q(q1,q2,s−k1,t−k2)Q(q_1,q_2,s-k_1,t-k_2)Q(q1​,q2​,s−k1​,t−k2​) for s,t≥max⁡{k1,k2}s,t\ge\max\{k_1,k_2\}s,t≥max{k1​,k2​}. As printed the ratio is q13k1q23k2q_1^{3k_1}q_2^{3k_2}q13k1​​q23k2​​, which is not close to 111. Milestone 4 uses the intended pair (s−k1,t+k2)(s-k_1,t+k_2)(s−k1​,t+k2​), with s>k1s>k_1s>k1​ so that s−k1≥1s-k_1\ge1s−k1​≥1.
  • Ruling out a trivial reading. The lower bound n≤Q(q1,q2,s,t)n\le Q(q_1,q_2,s,t)n≤Q(q1​,q2​,s,t) alone holds for every nnn by taking sss large. The content of the goal is the upper bound with a sublinear excess, and s,ts,ts,t must be positive. In milestone 3 the condition k1≥1k_1\ge1k1​≥1 excludes the trivial witness k1=k2=0k_1=k_2=0k1​=k2​=0.
  • Out of scope. The derivation of QQQ as the vertex count of H(p,q1sq2t)H(p,q_1^sq_2^t)H(p,q1s​q2t​) (Hensel's lemma and the Chinese remainder theorem, pp. 6–7), Theorem 2.1 (the LPS graphs are Ramanujan, cited from Lubotzky–Phillips–Sarnak), Proposition 1.1, the §2.1 packing argument, and every running-time ("explicit", "strongly explicit") claim.
  • Infrastructure. Only Mathlib is needed: unique factorization for milestone 1, Int.fract and a pigeonhole or Dirichlet-approximation argument for milestone 2, and real exponentiation and asymptotics for the goal. Contributions of alternative proofs of milestone 2, for instance via Mathlib's Dirichlet approximation theorem, are welcome.

Selected references

  • N. Alon, Explicit expanders of every degree and size, arXiv:2003.11673v1, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/2003.11673 , https://doi.org/10.1007/s00493-020-4429-x
  • A. Lubotzky, R. Phillips, P. Sarnak, Ramanujan graphs, Combinatorica 8 (1988) 261–277. https://doi.org/10.1007/BF02126799
  • S. Hoory, N. Linial, A. Wigderson, Expander graphs and their applications, Bull. AMS 43 (2006) 439–561. https://doi.org/10.1090/S0273-0979-06-01126-8
6 thms2 active usersReviewed
🏆Completed
Linear algebraOperations Research·Captain: mikedeng1

On the Abstract Properties of Linear Dependence 5: The Seven-Element Fano Matroid Corresponds to No Real MatrixResearch Paper

Motivation

Whitney's 1935 paper On the Abstract Properties of Linear Dependence introduced matroids: finite sets equipped with a rank function, or equivalently a family of independent sets, obeying a few postulates abstracted from the linear dependence of the columns of a matrix. The obvious first question about such an abstraction is whether it is genuinely more general than its model, that is, whether there are matroids that do not arise from any matrix. Section 16 of the paper answers it with a seven-element example, now called the Fano matroid F7F_7F7​, and proves that no real matrix corresponds to it.

The question has had a long life. Representability of matroids over a given field is a central theme of matroid theory: Tutte (1958) characterized the matroids representable over the field with two elements by a single excluded minor, the four-point line U2,4U_{2,4}U2,4​, and the regular matroids by three excluded minors, U2,4U_{2,4}U2,4​, F7F_7F7​ and its dual; and Seymour's decomposition of regular matroids (1980) rests on the same objects. Whitney's §16 is the starting point of this line: the first proof that the abstract postulates admit matroids outside linear algebra over R\mathbb RR.

Timeline:

  • 1935. Whitney defines matroids, the circuit matrix of a matrix, and proves (§16) that the seven-element matroid M′M'M′ corresponds to no real matrix; in a footnote he credits Saunders MacLane with finding that M′M'M′ corresponds to no matrix and identifying it with a finite projective geometry. On p. 533 he exhibits a matrix of integers mod 2 for M′M'M′.
  • 1958. Tutte characterizes binary and regular matroids by excluded minors; F7F_7F7​ appears as an excluded minor for regularity (Tutte 1958).

Setting

Let M=(aij)\mathbf M=(a_{ij})M=(aij​) be an m×nm\times nm×n matrix with columns C1,…,CnC_1,\dots,C_nC1​,…,Cn​. For a set NNN of columns, let r(N)r(N)r(N) be the rank of the submatrix formed by those columns. Regarding the columns as abstract elements gives a matroid MMM on {C1,…,Cn}\{C_1,\dots,C_n\}{C1​,…,Cn​} with rank function rrr: the matroid of M\mathbf MM. A matroid corresponds to M\mathbf MM if it is the matroid of M\mathbf MM, with elements matched to columns.

A circuit of a matroid is a minimal dependent set. For a circuit P={i1,…,ip}P=\{i_1,\dots,i_p\}P={i1​,…,ip​} of the matroid of M\mathbf MM, there are numbers b1,…,bnb_1,\dots,b_nb1​,…,bn​ with ∑jaijbj=0\sum_j a_{ij}b_j=0∑j​aij​bj​=0 for every row iii, and bj≠0b_j\neq 0bj​=0 exactly for j∈Pj\in Pj∈P; the set of such vectors is written Zi1⋯ipZ_{i_1\cdots i_p}Zi1​⋯ip​​ when only the support condition is meant. Stacking one such row per circuit gives the circuit matrix M′\mathbf M'M′ of M\mathbf MM, determined up to nonzero factors on its rows.

A fundamental set of circuits of a matroid MMM with nullity n(M)=ρ(M)−r(M)n(M)=\rho(M)-r(M)n(M)=ρ(M)−r(M) (ρ\rhoρ the number of elements) is a family of circuits P1,…,PqP_1,\dots,P_qP1​,…,Pq​ with q=n(M)q=n(M)q=n(M) such that the elements can be ordered e1,…,ene_1,\dots,e_ne1​,…,en​ with en−q+i∈Pie_{n-q+i}\in P_ien−q+i​∈Pi​ and en−q+j∉Pie_{n-q+j}\notin P_ien−q+j​∈/Pi​ for j>ij>ij>i; it is strict if en−q+j∉Pie_{n-q+j}\notin P_ien−q+j​∈/Pi​ for every j≠ij\neq ij=i.

The matroid M′M'M′ of §16 has elements 1,…,71,\dots,71,…,7; its bases (maximal independent sets) are all three-element sets except

124,135,167,236,257,347,456.(16.1)124,\quad 135,\quad 167,\quad 236,\quad 257,\quad 347,\quad 456. \qquad (16.1)124,135,167,236,257,347,456.(16.1)

Formalization targets

Goal: §16, pp. 529–530

∃ M′and∀m ∀ M∈Rm×7: M′ is not the matroid of M.\exists\,M' \quad\text{and}\quad \forall m\ \forall\,\mathbf M\in\mathbb R^{m\times 7}:\ M' \text{ is not the matroid of } \mathbf M .∃M′and∀m ∀M∈Rm×7: M′ is not the matroid of M.

The number of rows is arbitrary; the existence clause makes the non-existence statement non-vacuous.

Milestones

  1. §12. Every real matrix has a matroid: the ranks of column submatrices satisfy the rank postulates.
  2. §14, (14.1). Every real matrix has a circuit matrix.
  3. Theorem 29. The rows of a fundamental set of circuits form a base for the rows of the circuit matrix, so r(M′)=q=n(M)r(\mathbf M')=q=n(\mathbf M)r(M′)=q=n(M).
  4. Lemma 10. The support of a vector in the row space HHH of a circuit matrix is a union of circuits.
  5. Lemma 11. Two vectors of HHH with the same circuit as support are proportional.
  6. Theorem 32. For a circuit matrix normalised along a strict fundamental set, a minor DDD vanishes iff an associated q×qq\times qq×q minor D′D'D′ vanishes, iff some circuit avoids a prescribed set of columns.
  7. §16, rank of M′M'M′. The rank of a kkk-set is kkk for k≤2k\le 2k≤2, 333 for k≥4k\ge 4k≥4, and for k=3k=3k=3 it is 222 on (16.1) and 333 otherwise.
  8. p. 533. M′M'M′ is the matroid of an explicit 3×73\times 73×7 matrix of integers mod 2.

Significance

The result. The theorem separates the abstract notion of matroid from linear dependence over R\mathbb RR: some matroids are not real-representable. It also exhibits that representability depends on the field, because the same matroid is the matroid of a matrix over the integers mod 2 (milestone 8). Everything later written about representability over particular fields, excluded-minor characterizations, and the gap between abstract and linear matroids starts from this distinction. Theorem 32 is of independent interest: it translates statements about circuits of a represented matroid into the vanishing of minors of a normalised circuit matrix.

Formalizing it. The result is classical and its proof is short on paper, but it is not formalized in Mathlib, which has matroids (Matroid, circuits, ranks) but no column matroid of a matrix with a rank-of-submatrix characterization, no circuit matrix, and no Fano matroid. The mission produces those objects and the bridge lemmas (Theorem 29, Lemmas 10–11, Theorem 32) that connect matroid circuits with linear algebra of the circuit matrix. No machine-checked proof of the non-representability of the Fano matroid over R\mathbb RR in Lean is known to the curators.

Difficulty

The obvious attempt is a direct search: suppose a real m×7m\times 7m×7 matrix has M′M'M′ as its matroid and derive a contradiction from the seven dependent triples. This does not work as stated. Each rank condition is a determinantal (nonlinear) condition on the entries, the number of rows mmm is unbounded, and a representation is determined only up to row operations and column scalings, so there is no finite case check and no single linear computation that settles the question. The contradiction has to come from an argument that is invariant under these symmetries, and the milestones (circuit vectors determined up to scaling, fundamental sets spanning, circuits detected by minors) are what such an argument needs to be stated in. The field also matters: the argument must use that 2≠02\neq 02=0 in R\mathbb RR, since over a field of characteristic 2 the statement is false (milestone 8).

Formalization scope

  • Elements and matrices. Matroids are Mathlib Matroids whose ground set is the whole (finite) type. The Fano matroid lives on Fin 7, Whitney's element kkk being k - 1; the seven triples are written out literally. Matrices are Matrix (Fin m) ι K; "the matroid of M\mathbf MM" means: ground set everything, and the rank M.eRk N of every finite set NNN of columns equals Matrix.rank of the column submatrix.
  • Field. The goal and Lemmas 10–11, Theorems 29 and 32 are stated over R\mathbb RR, as in the paper; the predicate "matroid of a matrix" is stated over any field so that the mod-2 milestone uses the same notion.
  • Circuit matrix. Rows are determined up to nonzero factors, so "circuit matrix" is a predicate on a matrix together with a bijection between its rows and the circuits; every theorem holds for every such choice.
  • Nullity and indices. q=n(M)q=n(M)q=n(M) is written q+r(M)=ρ(M)q+r(M)=\rho(M)q+r(M)=ρ(M) in extended naturals, with no truncated subtraction. In Theorem 32, n=p+qn=p+qn=p+q, the complement of i1,…,isi_1,\dots,i_si1​,…,is​ is given as an order embedding of Fin t with s+t=qs+t=qs+t=q, and determinants are of square submatrices in the paper's row and column order.
  • Ruling out trivial readings. The goal includes the existence of M′M'M′; without it "every matroid with these bases has no real matrix" could hold vacuously. The goal quantifies over every number of rows; fixing m=3m=3m=3 would be a weaker statement.

Reusable beyond this mission: the matroid of a matrix over a field, the circuit matrix, fundamental sets of circuits, and the Fano matroid. Contributions welcome: proofs of the milestones, and a proof of the goal by any route, including one that does not go through Theorem 32.

Selected references

  • H. Whitney, On the Abstract Properties of Linear Dependence, American Journal of Mathematics 57 (1935), 509–533. https://doi.org/10.2307/2371182
  • W. T. Tutte, A homotopy theorem for matroids, I, II, Transactions of the American Mathematical Society 88 (1958), 144–174. https://doi.org/10.2307/1993244
  • J. Oxley, Matroid Theory, 2nd ed., Oxford University Press, 2011. https://doi.org/10.1093/acprof:oso/9780198566946.001.0001
  • O. Veblen and J. W. Young, Projective Geometry, Vol. I, Ginn, 1910 (cited by Whitney for the finite projective geometry).
13 thms2 active usersReviewed
🏆Completed
Linear algebraOperations Research·Captain: mikedeng1

On the Abstract Properties of Linear Dependence 6: Every Matroid Satisfying (C*) Is Represented by a Matrix of Integers Mod 2Research Paper

Motivation

Whitney's 1935 paper introduced matroids as an abstraction of linear dependence among the columns of a matrix. Most of the paper works over the real numbers; its appendix asks which matroids arise from matrices of integers mod 2, that is, matrices with entries 0 and 1 in which rank and dependence are computed over the two-element field. These are today's binary matroids. They include the cycle matroids of graphs (Whitney closes the paper by noting that graphs correspond to mod-2 matrices with exactly two ones in each column) and they are the setting of several later structure theorems: Tutte's excluded-minor characterization of binary matroids (Tutte 1958), Seymour's decomposition of regular matroids (Seymour 1980) and Seymour's theory of binary clutters and max-flow min-cut (Seymour 1977), which underlies parts of combinatorial optimization.

Whitney's answer is an intrinsic postulate, (C*), on the circuits of the matroid, stated without reference to any matrix, and a constructive representation theorem (Theorem 37): a matroid satisfying (C*) is the matroid of a mod-2 matrix, and the matrix is unique once the columns of one base are fixed.

Setting

A matroid MMM on elements e1,…,ene_1, \dots, e_ne1​,…,en​ is given by its independent sets; its circuits are its minimal dependent sets, its rank r(M)r(M)r(M) is the size of a base, and its nullity is n(M)=n−r(M)n(M) = n - r(M)n(M)=n−r(M). Here MMM is a Mathlib Matroid (Fin n) whose ground set is all of Fin n.

Subsets of the elements are added mod 2: a sum of finitely many sets is the set of elements lying in an odd number of them (for two sets, the symmetric difference). A cycle is a sum mod 2 of circuits; the empty sum is the null cycle ∅\emptyset∅. A set is a true sum of sets that have no common elements and whose union it is. Postulate (C*) requires that each cycle be a true sum of circuits.

With n=r+qn = r + qn=r+q, a family P1,…,PqP_1, \dots, P_qP1​,…,Pq​ is a strict fundamental set of circuits with respect to en−q+1,…,ene_{n-q+1}, \dots, e_nen−q+1​,…,en​ if q=n(M)q = n(M)q=n(M), each PiP_iPi​ is a circuit, and PiP_iPi​ contains en−q+ie_{n-q+i}en−q+i​ but no other en−q+je_{n-q+j}en−q+j​.

For a matrix M\mathbf MM over the integers mod 2 with columns C1,…,CnC_1, \dots, C_nC1​,…,Cn​, columns are independent (mod 2) if no non-null subset of them sums to the zero column. The matroid corresponding to M\mathbf MM has the column indices as elements and these independent sets.

Formalization targets

Goal: Theorem 37 (p. 533)

Let MMM satisfy (C*), with elements e1,…,ene_1, \dots, e_ne1​,…,en​ and base {e1,…,en−q}\{e_1, \dots, e_{n-q}\}{e1​,…,en−q​}. For every matrix M1\mathbf M_1M1​ mod 2 (any number of rows) whose n−qn - qn−q columns are independent mod 2,

∃! M=(M1∣Cn−q+1⋯Cn)  whose corresponding matroid is M.\exists!\ \mathbf M = (\mathbf M_1 \mid C_{n-q+1} \cdots C_n) \ \text{ whose corresponding matroid is } M.∃! M=(M1​∣Cn−q+1​⋯Cn​)  whose corresponding matroid is M.

Milestones

  1. Theorem 9 (p. 517): if e1,…,en−qe_1, \dots, e_{n-q}e1​,…,en−q​ is a base, there is a unique strict fundamental set of circuits with respect to en−q+1,…,ene_{n-q+1}, \dots, e_nen−q+1​,…,en​.
  2. Appendix, p. 531: (C*) implies the circuit postulate (C₂), for any family of sets.
  3. Theorem 33: under (C*), the circuits are exactly the minimal non-null cycles.
  4. Theorem 34: under (C*), the cycles are exactly the 2q2^q2q sums mod 2 of a strict fundamental set.
  5. Theorem 35: two (C*)-matroids with a common strict fundamental set have the same circuits.
  6. Theorem 36: any P1,…,PqP_1, \dots, P_qP1​,…,Pq​ with en−q+i∈Pi⊆{e1,…,en−q,en−q+i}e_{n-q+i} \in P_i \subseteq \{e_1, \dots, e_{n-q}, e_{n-q+i}\}en−q+i​∈Pi​⊆{e1​,…,en−q​,en−q+i​} is the strict fundamental set of exactly one (C*)-matroid.
  7. Appendix, p. 532: the matroid of a matrix mod 2 exists, satisfies (C*), and its cycles are the supports of the mod-2 dependencies among the columns.

Milestone 7 and the goal together characterize binary matroids as the matroids satisfying (C*).

Significance

The result. Theorem 37 and the p. 532 claim give an intrinsic, matrix-free description of the matroids representable over the two-element field, and Theorem 36 parametrizes all of them by qqq arbitrary subsets of a base. Uniqueness in Theorem 37 says that a binary representation is determined by the columns of one base; in modern terms, binary matroids are uniquely representable over GF(2) up to row operations. Every later theory of binary matroids, including graphic and cographic matroids, Tutte's excluded-minor theorem and Seymour's decomposition, starts from this equivalence.

Formalizing it. The results are proved in the paper and in textbooks (e.g. Oxley, Matroid Theory, Ch. 9) but, at the Mathlib revision used here, there is no notion of a matroid represented by a matrix over a field, and no binary-matroid theory. On Prove2Me, the existing binary objects (SeymourMFMC.Binary.*) are binary clutters defined through blockers, not matroids represented by mod-2 matrices. This mission produces the representation predicate for mod-2 matrices, the cycle space of a matroid, and the equivalence between (C*) and binary representability.

Difficulty

Writing down candidate columns is not the hard part; showing that the matroid of the completed matrix is MMM itself, and not merely a matroid sharing some of its circuits, is. Whitney's example at the end of §9 exhibits two different matroids with a common strict fundamental set, so agreement on fundamental circuits does not by itself identify a matroid; any argument must use (C*) on both the given matroid and the matroid of the matrix. A naive comparison of independent sets column by column does not close this gap. Uniqueness likewise depends on the independence mod 2 of the prescribed columns: without it, different completions can give the same matroid.

Formalization scope

  • Matroids are Mathlib Matroid (Fin (r + q)) with ground set Set.univ; Whitney's eke_kek​ is k - 1, his e1,…,en−qe_1, \dots, e_{n-q}e1​,…,en−q​ is the range of Fin.castAdd q, and en−q+ie_{n-q+i}en−q+i​ is Fin.natAdd r (i - 1). Writing n=r+qn = r + qn=r+q removes natural-number subtraction; qqq is not a free parameter, since {e1,…,er}\{e_1, \dots, e_r\}{e1​,…,er​} is required to be a base.
  • Sums mod 2 count parity of membership (sumMod2); cycles are sums over finite sets of circuits; true sums are unions over finite pairwise-disjoint sets of circuits; (C*) is SatisfiesCStar on the circuit family {C | M.IsCircuit C}. These definitions take the circuit family as a parameter, so that the (C₂) milestone is posed for an arbitrary family of sets, as Whitney poses it.
  • A strict fundamental set includes the nullity condition r(M)+q=ρ(M)r(M) + q = \rho(M)r(M)+q=ρ(M), stated in N∞\mathbb N_\inftyN∞​.
  • Matrices are Matrix (Fin m) (Fin n) (ZMod 2) with any mmm; independence mod 2 of columns is LinearIndepOn (ZMod 2) of the columns (the rows of the transpose). IsMatroidOf M A compares all independent sets, not only bases.
  • Ruled out: the goal is not satisfied by any statement that compares only the bases of one size, by an existence-only statement without uniqueness, or by real (instead of mod-2) independence.
  • Tacit hypotheses made explicit: the matroid's ground set is exactly e1,…,ene_1, \dots, e_ne1​,…,en​ (ρ(M)=n\rho(M) = nρ(M)=n); the elements and matroids are finite.

Contributions welcome: the general fact that the matroid of a vector family over a field exists (a reusable Matroid.ofFun-style construction over any field), the cycle-space lemmas, and proofs of the milestones in any order.

Selected references

  • H. Whitney, On the Abstract Properties of Linear Dependence, American Journal of Mathematics 57 (1935), 509–533. https://doi.org/10.2307/2371182
  • W. T. Tutte, A homotopy theorem for matroids, I, II, Transactions of the AMS 88 (1958), 144–174. https://doi.org/10.2307/1993244
  • P. D. Seymour, The matroids with the max-flow min-cut property, Journal of Combinatorial Theory Ser. B 23 (1977), 189–222. https://doi.org/10.1016/0095-8956(77)90031-4
  • P. D. Seymour, Decomposition of regular matroids, Journal of Combinatorial Theory Ser. B 28 (1980), 305–359. https://doi.org/10.1016/0095-8956(80)90075-1
  • J. Oxley, Matroid Theory, 2nd ed., Oxford University Press, 2011. https://doi.org/10.1093/acprof:oso/9780198566946.001.0001
11 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

On the Abstract Properties of Linear Dependence 3: Two Elements Share a Component Iff Some Circuit Contains BothResearch Paper

Motivation

Hassler Whitney's 1935 paper On the Abstract Properties of Linear Dependence introduced matroids: finite sets of elements carrying an abstract rank function that behaves like the rank of a set of vectors. Part II of the paper opens with the decomposition of a matroid into components. The question it answers is basic to every later use of matroids: when does a matroid split into independent pieces, and how can the pieces be recognized?

For the matroid of a graph (elements = edges, rank = number of vertices minus number of connected pieces spanned) the components are the 2-connected blocks of the graph, and Whitney's theorem recovers the classical fact that two edges lie in a common block exactly when they lie on a common cycle. Whitney had studied separability of graphs in Non-separable and planar graphs (1932), and footnote 11 of the 1935 paper points out that the theorem identifies König's "Glieder" of a graph with components. Matroid connectivity built on this notion runs through later structure theory: Tutte's higher connectivity, Seymour's decomposition of regular matroids, and the matroid minors project all start from the separation of a matroid into components.

Setting

A matroid MMM on a finite ground set EEE is given here by Mathlib's Matroid structure, with rank function r(X)r(X)r(X) for X⊆EX\subseteq EX⊆E (Mathlib's M.eRk X) and circuits, the minimal dependent sets (M.IsCircuit). Whitney treats every subset X⊆EX\subseteq EX⊆E as a matroid in its own right, a submatroid, with the rank function of MMM restricted to subsets of XXX. For sets he writes M1+M2M_1+M_2M1​+M2​ for the union, ρ(N)\rho(N)ρ(N) for the number of elements of NNN, and

n(N)=ρ(N)−r(N)n(N) = \rho(N) - r(N)n(N)=ρ(N)−r(N)

for the nullity of NNN.

Rank is subadditive: r(X1+X2)≤r(X1)+r(X2)r(X_1+X_2)\le r(X_1)+r(X_2)r(X1​+X2​)≤r(X1​)+r(X2​). A submatroid XXX is separable if it can be divided into two disjoint groups X1,X2X_1, X_2X1​,X2​, each containing at least one element, with

r(X)=r(X1)+r(X2),r(X) = r(X_1) + r(X_2),r(X)=r(X1​)+r(X2​),

and non-separable otherwise. Every single element is non-separable. A component of MMM is a maximal non-separable part of MMM: a nonempty non-separable set K⊆EK\subseteq EK⊆E contained in no strictly larger non-separable subset of EEE.

Formalization targets

Goal: Theorem 19

For two distinct elements e1≠e2e_1\neq e_2e1​=e2​ of EEE,

(∃K component of M: e1,e2∈K)  ⟺  (∃P circuit of M: e1,e2∈P).\bigl(\exists K \text{ component of } M:\ e_1, e_2\in K\bigr) \iff \bigl(\exists P \text{ circuit of } M:\ e_1, e_2\in P\bigr).(∃K component of M: e1​,e2​∈K)⟺(∃P circuit of M: e1​,e2​∈P).

Components are defined by the rank function, circuits by dependence; the goal asserts that the two descriptions agree.

Milestones (§10, in the paper's order)

  • Theorem 11. If r(M1+M2)=r(M1)+r(M2)r(M_1+M_2)=r(M_1)+r(M_2)r(M1​+M2​)=r(M1​)+r(M2​), M1′⊆M1M_1'\subseteq M_1M1′​⊆M1​ and M2′⊆M2M_2'\subseteq M_2M2′​⊆M2​, then r(M1′+M2′)=r(M1′)+r(M2′)r(M_1'+M_2')=r(M_1')+r(M_2')r(M1′​+M2′​)=r(M1′​)+r(M2′​).
  • Theorem 12. Under the same rank additivity, a non-separable M′⊆M1+M2M'\subseteq M_1+M_2M′⊆M1​+M2​ lies in M1M_1M1​ or in M2M_2M2​.
  • Theorem 13. Two non-separable sets with a common element have a non-separable union.
  • Theorem 14. Distinct components are disjoint.
  • Theorem 15. The components cover EEE, and no other family of components does.
  • Theorem 16. A set is non-separable of nullity 111 if and only if it is a circuit.
  • Lemma 9. If M1+M2M_1+M_2M1​+M2​ is non-separable, with M1,M2M_1, M_2M1​,M2​ nonempty and disjoint, some circuit inside M1+M2M_1+M_2M1​+M2​ meets both.
  • Theorem 17. A non-separable set of nullity n>0n>0n>0 is built from a circuit by n−1n-1n−1 steps, each adding a set of elements that forms a circuit with elements already present, through non-separable sets of nullity 1,2,…,n1,2,\dots,n1,2,…,n.
  • Theorem 18. For distinct nonempty non-separable M1,…,MpM_1,\dots,M_pM1​,…,Mp​ covering EEE, the following are equivalent: they are the components; they are pairwise disjoint and no circuit meets two of them; r(E)=∑ir(Mi)r(E)=\sum_i r(M_i)r(E)=∑i​r(Mi​).

Significance

The result. Theorem 19 makes the component decomposition computable from circuits alone and shows that "lying on a common circuit" is an equivalence relation on distinct elements, a fact that is not evident from the circuit axioms. Theorem 18 adds that the decomposition is the unique one with additive rank. Together they are the starting point of matroid connectivity: the direct-sum decomposition of a matroid, the reduction of many matroid problems (representability, duality of components, Whitney's own Theorems 24–26 on duals of components) to the connected case, and the higher-connectivity theory that followed.

Formalizing it. The results are classical and proved in the paper; nothing here is open. To our knowledge Mathlib at the pinned revision has no notion of matroid connectivity or components, so this mission produces the first machine-checked development of Whitney's §10: the rank-based definition of separability, the disjoint decomposition into components, the circuit characterization, and the ear-type construction of non-separable matroids (Theorem 17). These are reusable for any later formalization of matroid connectivity, including Whitney's results on duals of components.

Difficulty

The two directions of Theorem 19 rest on different machinery. That two elements on a common circuit lie in one component follows from the rank theory (Theorems 13 and 16). The converse is the substantial direction: a component is defined by the failure of rank additivity, which only says that every division of the component is crossed by some circuit (Lemma 9). It does not directly give one circuit through two prescribed elements. Combining circuits that cross different divisions into a single circuit through both e1e_1e1​ and e2e_2e2​ requires the circuit elimination property together with a minimality argument over subsets of the component; the naive attempt of chaining overlapping circuits from e1e_1e1​ to e2e_2e2​ gives a connected chain of circuits, not one circuit.

Formalization scope

  • Representation. A matroid is Mathlib's Matroid α with [M.Finite]; Whitney's matroids are finite. A submatroid is a subset X⊆X\subseteqX⊆ M.E with the rank M.eRk restricted to its subsets; results that Whitney states for "a matroid M=M1+M2M = M_1 + M_2M=M1​+M2​" are stated for subsets of an ambient finite matroid, which is the same statement applied to the submatroid M1+M2M_1+M_2M1​+M2​.
  • Ranks are Mathlib's ℕ∞-valued M.eRk, finite on a finite matroid, so (10.1) is an equation of natural numbers. Nullity is computed in Z\mathbb ZZ as the number of elements minus the rank.
  • Definitions. IsSeparable M X requires two nonempty, disjoint groups with union XXX and additive rank; without nonemptiness every set would be separable. IsNonSeparable M X adds X⊆X\subseteqX⊆ M.E. IsComponent M K requires KKK nonempty, non-separable, and maximal; nonemptiness excludes the empty set, which is vacuously non-separable.
  • Tacit hypotheses made explicit. In Theorem 19 the two elements are distinct: for e1=e2e_1=e_2e1​=e2​ a coloop is its own component and lies on no circuit. In Theorem 18 the sets M1,…,MpM_1,\dots,M_pM1​,…,Mp​ are distinct and nonempty: a loop listed twice would satisfy (3) but not (2), and an empty set would satisfy (2) and (3) but not (1). In Theorems 11 and 12 the two parts need not be disjoint, as Whitney's use of M1+M2M_1+M_2M1​+M2​ for overlapping sets in Theorem 13 indicates; the statements hold in that generality.
  • Ruled out. Components must not be defined as the classes of the relation "lie on a common circuit": that would make the goal a tautology. Here they are the rank-defined maximal non-separable sets of §10, and circuits are Mathlib's Matroid.IsCircuit.
  • Infrastructure. Solvers will need submodularity of M.eRk and circuit elimination (both in Mathlib), the relation between circuits of M ↾ X and circuits of M inside XXX (Matroid.restrict_isCircuit_iff), and finiteness arguments for maximal non-separable sets. Proofs of the milestones, alternative proofs of the goal, and lemmas relating components to Mathlib's direct sums of matroids are all welcome.

Selected references

  • H. Whitney, On the Abstract Properties of Linear Dependence, American Journal of Mathematics 57 (1935), 509–533. https://doi.org/10.2307/2371182
  • H. Whitney, Non-separable and planar graphs, Transactions of the American Mathematical Society 34 (1932), 339–362. https://doi.org/10.1090/S0002-9947-1932-1501641-2
  • D. König, Acta Litterarum ac Scientiarum Szeged, vol. 6, pp. 155–179, as cited by Whitney in footnote 11 (p. 159 for the notion of "Glied").
  • J. Oxley, Matroid Theory, 2nd ed., Oxford University Press, 2011, Chapter 4 (connectivity).
13 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

On the Abstract Properties of Linear Dependence 1: The Rank Postulates and the Independence Postulates Are EquivalentResearch Paper

Motivation

In 1935 Hassler Whitney asked which properties of linear dependence among the columns of a matrix can be stated without reference to the matrix at all. His answer, On the Abstract Properties of Linear Dependence (American Journal of Mathematics 57, 1935), introduced the matroid: a finite set together with a rank function obeying three short postulates. The notion now underlies combinatorial optimization (the greedy algorithm is optimal exactly on matroids, and matroid intersection and partition generalize bipartite matching and arborescence packing), graph theory (graphic and cographic matroids), coding theory and the study of linear representations over finite fields.

A defining feature of the subject is that the same structure can be axiomatized in several apparently unrelated ways: by rank, by independent sets, by bases, by circuits. Each axiom system is convenient for different arguments, and passing between them, a so-called cryptomorphism, is routine in practice. Whitney's paper is where these equivalences first appear. Part I, §§2–4 and §6 (pp. 510–514), derives the basic properties of rank from the rank postulates, deduces from them the postulates for independent sets, and shows that the two systems are equivalent. This mission formalizes that first equivalence.

Setting

Let MMM be a finite set of elements e1,…,ene_1, \dots, e_ne1​,…,en​. Following Whitney, write N+eN + eN+e for N∪{e}N \cup \{e\}N∪{e}, M1+M2M_1 + M_2M1​+M2​ for the union and M1M2M_1 M_2M1​M2​ for the intersection of subsets; ρ(N)\rho(N)ρ(N) is the number of elements of NNN.

A rank system is a function rrr on the subsets of MMM satisfying

  • (R₁) r(∅)=0r(\emptyset) = 0r(∅)=0;
  • (R₂) for every subset NNN and element e∉Ne \notin Ne∈/N, r(N+e)=r(N)r(N + e) = r(N)r(N+e)=r(N) or r(N+e)=r(N)+1r(N + e) = r(N) + 1r(N+e)=r(N)+1;
  • (R₃) for every subset NNN and elements e1,e2∉Ne_1, e_2 \notin Ne1​,e2​∈/N, if r(N+e1)=r(N+e2)=r(N)r(N + e_1) = r(N + e_2) = r(N)r(N+e1​)=r(N+e2​)=r(N) then r(N+e1+e2)=r(N)r(N + e_1 + e_2) = r(N)r(N+e1​+e2​)=r(N).

The nullity of NNN is n(N)=ρ(N)−r(N)n(N) = \rho(N) - r(N)n(N)=ρ(N)−r(N), and NNN is independent when n(N)=0n(N) = 0n(N)=0. The increment of (3.1) is Δ(M′,N)=r(M′+N)−r(M′)\Delta(M', N) = r(M' + N) - r(M')Δ(M′,N)=r(M′+N)−r(M′), written Δ(M′,e)\Delta(M', e)Δ(M′,e) when N={e}N = \{e\}N={e}.

An independence system is a predicate "independent" on the subsets of MMM satisfying

  • (I₁) any subset of an independent set is independent;
  • (I₂) if NNN and N′N'N′ are independent and N′N'N′ has exactly one element more than NNN, then N+e′N + e'N+e′ is independent for some e′∈N′e' \in N'e′∈N′ with e′∉Ne' \notin Ne′∈/N.

From an independence system one recovers a rank by letting r(N)r(N)r(N) be the number of elements in a largest independent subset of NNN. In the Lean development these objects are IsRankSystem, nullity, Delta, indepOfRank, IsIndepSystem and rankOfIndep, all in the namespace WhitneyMatroid.RankIndep.

Formalization targets

Goal: (R) and (I) are equivalent (§6, p. 514)

  1. If rrr satisfies (R₁)–(R₃), then {N:ρ(N)=r(N)}\{N : \rho(N) = r(N)\}{N:ρ(N)=r(N)} satisfies (I₁), (I₂), contains ∅\emptyset∅, and
r(N)=max⁡{ρ(I):I⊆N, ρ(I)=r(I)}for every N.r(N) = \max\{\rho(I) : I \subseteq N,\ \rho(I) = r(I)\} \quad \text{for every } N.r(N)=max{ρ(I):I⊆N, ρ(I)=r(I)}for every N.
  1. If "independent" satisfies (I₁), (I₂) and ∅\emptyset∅ is independent, then r(N)=max⁡{ρ(I):I⊆N independent}r(N) = \max\{\rho(I) : I \subseteq N \text{ independent}\}r(N)=max{ρ(I):I⊆N independent} satisfies (R₁)–(R₃), and NNN is independent if and only if ρ(N)=r(N)\rho(N) = r(N)ρ(N)=r(N).

Both translations and both round trips are part of the goal: Whitney's conclusion is not only that each system implies the other but that "the definitions of the rank and the independence or dependence of any subset of MMM agree under the two systems".

Milestones

  • Lemma 1 (p. 510): r(N)≥0r(N) \ge 0r(N)≥0, n(N)≥0n(N) \ge 0n(N)≥0, and N⊆M′N \subseteq M'N⊆M′ implies r(N)≤r(M′)r(N) \le r(M')r(N)≤r(M′), n(N)≤n(M′)n(N) \le n(M')n(N)≤n(M′).
  • Lemma 2 (p. 510): any subset of an independent set is independent, which is (I₁).
  • Lemma 3 (p. 511): Δ(M+e2,e1)≤Δ(M,e1)\Delta(M + e_2, e_1) \le \Delta(M, e_1)Δ(M+e2​,e1​)≤Δ(M,e1​).
  • Lemma 4 (p. 511): Δ(M+N,e)≤Δ(M,e)\Delta(M + N, e) \le \Delta(M, e)Δ(M+N,e)≤Δ(M,e).
  • Theorem 3 (p. 511): Δ(M+N2,N1)≤Δ(M,N1)\Delta(M + N_2, N_1) \le \Delta(M, N_1)Δ(M+N2​,N1​)≤Δ(M,N1​); equivalently
r(M+N1+N2)≤r(M+N1)+r(M+N2)−r(M),r(M1+M2)≤r(M1)+r(M2)−r(M1M2).r(M + N_1 + N_2) \le r(M + N_1) + r(M + N_2) - r(M), \qquad r(M_1 + M_2) \le r(M_1) + r(M_2) - r(M_1 M_2).r(M+N1​+N2​)≤r(M+N1​)+r(M+N2​)−r(M),r(M1​+M2​)≤r(M1​)+r(M2​)−r(M1​M2​).
  • §4 (pp. 511–512): the independent sets of a rank system satisfy (I₂).

Significance

The equivalence makes the rank function and the family of independent sets two descriptions of one object. Every later result of Whitney's paper, and of matroid theory generally, moves between them without comment: the circuit postulates of §5 and §8, the base postulates of §7 and the duality of §§11–13 are all phrased through rank or independence as convenient. Theorem 3 is the submodularity of rank, the property that connects matroids to submodular function minimization and polymatroids; here it is derived from the purely local postulates (R₁)–(R₃), which constrain the rank only under the addition of one or two elements.

On the formal side, Mathlib defines Matroid through independent sets (with constructors from other axiom systems) and proves submodularity of its rank; the platform has submodularity for Mathlib matroids (FamousTheorems.matroid_rank_submodular_7a). Neither starts from Whitney's local rank postulates. What this mission adds is a machine-checked derivation of the global properties of rank from (R₁)–(R₃) and of Whitney's original equivalence, stated for his own postulates, so that the later missions of this series, which work from the same postulates, rest on a verified foundation. The result itself has been settled since 1935; the open work is the formal proof.

Difficulty

The postulates (R₂) and (R₃) are local: they speak about adding at most two elements to a set. Monotonicity and the bound r(N)≤ρ(N)r(N) \le \rho(N)r(N)≤ρ(N) follow by adding elements one at a time, but the submodular inequality relates arbitrary sets, and nothing in (R₃) mentions more than two new elements. The gap between the local and the global statement is the substance of Lemmas 3, 4 and Theorem 3, and the deduction of (I₂) depends on it.

In the converse direction the rank is defined as a maximum over independent subsets, while (I₂) only augments a set from an independent set with exactly one element more; (R₃) for the derived rank is a statement about three sets that are not given in that form. The round trips are where the two halves meet, and each depends on the global properties of the first half rather than on the postulates alone.

Formalization scope

Elements form a type α with [Fintype α] [DecidableEq α]; subsets are Finset α, and the matroid MMM is the whole type. Ranks, nullities and increments take values in ℤ, so differences never truncate; Whitney allows any number, but (R₁) and (R₂) force nonnegative integers. Postulate (I₂) is stated in Whitney's form with N'.card = N.card + 1, not the general augmentation for ρ(N)<ρ(N′)\rho(N) < \rho(N')ρ(N)<ρ(N′). Postulates (R₂), (R₃) keep their hypotheses e,e1,e2∉Ne, e_1, e_2 \notin Ne,e1​,e2​∈/N. Lemmas 3, 4 and Theorem 3 are stated for arbitrary subsets M,N,N1,N2M, N, N_1, N_2M,N,N1​,N2​; Lemma 1's monotonicity for arbitrary N⊆M′N \subseteq M'N⊆M′, the form in which the paper uses it. rankOfIndep is the supremum of cardinalities over the independent members of the powerset.

The paper takes for granted that the empty set is independent in system (I). Without that hypothesis, the predicate declaring nothing independent satisfies (I₁) and (I₂) vacuously, the supremum defining the rank returns 000, and the round trip fails; the goal therefore assumes ∅\emptyset∅ independent in part 2 and proves it in part 1. A formalization in terms of Mathlib's Matroid would make the goal a restatement of library facts, since Mathlib's matroids are independence systems by construction; the goal is deliberately about the postulates as predicates on functions and on families of sets.

A complete development needs only finite set combinatorics (Finset.card, induction on finite sets, Finset.sup). The derived lemmas (monotonicity, submodularity, (I₂)) are reusable for any later work from Whitney's rank postulates, including the circuit-postulate equivalence of the companion mission. A bridge from rank systems to Mathlib's Matroid (via IndepMatroid.ofFinset) would be a welcome addition but is not part of the goal. Proofs of the milestones in any order are welcome; Theorem 3 and the §4 deduction are the natural first targets.

Selected references

  • H. Whitney, On the Abstract Properties of Linear Dependence, American Journal of Mathematics 57 (1935), no. 3, 509–533. https://doi.org/10.2307/2371182
  • J. Oxley, Matroid Theory, 2nd ed., Oxford Graduate Texts in Mathematics 21, Oxford University Press, 2011. https://doi.org/10.1093/acprof:oso/9780198566946.001.0001
  • J. Kung (ed.), A Source Book in Matroid Theory, Birkhäuser, 1986. https://doi.org/10.1007/978-1-4684-9199-9
  • Mathlib, Mathlib.Data.Matroid (matroids via independent sets; IndepMatroid.ofFinset). https://leanprover-community.github.io/mathlib4_docs/Mathlib/Data/Matroid/Basic.html
8 thms2 active usersReviewed
🏆Completed
Markov ChainOperations ResearchProbability+1·Captain: mikedeng1

Reversibility and Stochastic Networks VI: The Ewens Sampling Distribution Is Consistent Under Sampling Without ReplacementTextbook

Motivation

The neutral theory of molecular evolution holds that much of the genetic variation observed at the molecular level is caused by selectively neutral mutations rather than by selection. To test it against data one needs the distribution of allele frequencies that a neutral model predicts, and in practice that distribution has to be compared with a sample from the population, never with the whole population. Ewens (Ewens 1972) derived the equilibrium distribution of allele counts under the infinite alleles model, now called the Ewens sampling formula; it underlies classical tests of neutrality and appears throughout combinatorics and probability as the law of the cycle type of an Ewens-distributed random permutation and of the Chinese restaurant process.

Chapter 7 of F. P. Kelly, Reversibility and Stochastic Networks (Wiley, 1979) obtains the infinite alleles model as a limit of the reversible migration processes of Chapters 2 and 6, and uses reversibility to answer questions about allele ages and fixation. The mission formalizes the finite, combinatorial results of that chapter.

Timeline. Kimura and Crow (1964) introduced the infinite alleles model. Ewens (1972) found its equilibrium sampling distribution (7.6). Kingman (1978, J. London Math. Soc.) characterized the consistency of random partitions under sampling, the property Theorem 7.1 asserts for the Ewens family. Kelly (1979, Chapter 7) derived (7.6) as a limit of reversible migration processes, and the consistency and the allele-age results from the reversibility of a labelled population process.

Setting

A population consists of M≥2M\ge2M≥2 individuals, each carrying an allelic type. Its description is M=(M1,…,MM)\mathbf M=(M_1,\dots,M_M)M=(M1​,…,MM​), where MiM_iMi​ is the number of allelic types carried by exactly iii individuals, so that

∑i=1MiMi=M.(7.3)\sum_{i=1}^{M} iM_i=M. \qquad (7.3)i=1∑M​iMi​=M.(7.3)

For a real parameter ν>0\nu>0ν>0, the Ewens distribution on descriptions is

πM(M)=(ν+M−1M)−1∏i=1M(νi)Mi1Mi!,(7.6)\pi_M(\mathbf M)=\binom{\nu+M-1}{M}^{-1}\prod_{i=1}^{M}\Big(\frac{\nu}{i}\Big)^{M_i}\frac{1}{M_i!}, \qquad (7.6)πM​(M)=(Mν+M−1​)−1i=1∏M​(iν​)Mi​Mi​!1​,(7.6)

where (xk)=x(x−1)⋯(x−k+1)/k!\binom{x}{k}=x(x-1)\cdots(x-k+1)/k!(kx​)=x(x−1)⋯(x−k+1)/k! is the binomial coefficient for real xxx. In the infinite alleles model, individuals die at rate μ\muμ, each death is followed by the birth of an offspring of a uniformly chosen survivor, and the offspring is a mutant of an entirely new type with probability uuu; then (7.6) is the equilibrium distribution with ν=(M−1)u/(1−u)\nu=(M-1)u/(1-u)ν=(M−1)u/(1−u) (7.5).

A random sample of size 1≤m≤M1\le m\le M1≤m≤M without replacement is a uniformly random mmm-element subset of the MMM labelled individuals, each of the (Mm)\binom Mm(mM​) subsets being equally likely; the sample has a description in the same sense.

The number jjj of individuals carrying one given allele performs a random walk on {0,…,M}\{0,\dots,M\}{0,…,M} with intensities

q(j,j−1)=μjM(M−jM−1+j−1M−1u),q(j,j+1)=μM−jMjM−1(1−u).(7.8)q(j,j-1)=\mu\frac jM\Big(\frac{M-j}{M-1}+\frac{j-1}{M-1}u\Big),\qquad q(j,j+1)=\mu\frac{M-j}{M}\frac{j}{M-1}(1-u). \qquad (7.8)q(j,j−1)=μMj​(M−1M−j​+M−1j−1​u),q(j,j+1)=μMM−j​M−1j​(1−u).(7.8)

An allele is quasi-fixed when it is the only allele present (j=Mj=Mj=M).

Formalization targets

Goal: consistency under sampling (Theorem 7.1)

If M≥2M\ge2M≥2 and the population description is distributed as πM\pi_MπM​, then a random sample of size 1≤m≤M1\le m\le M1≤m≤M drawn without replacement has description m\mathbf mm with probability πm(m)\pi_m(\mathbf m)πm​(m), the same ν\nuν being used for both sizes:

∑MπM(M) P(sample has description m∣population has description M)=πm(m).\sum_{\mathbf M}\pi_M(\mathbf M)\,P\big(\text{sample has description }\mathbf m\mid\text{population has description }\mathbf M\big)=\pi_m(\mathbf m).M∑​πM​(M)P(sample has description m∣population has description M)=πm​(m).

Milestones

  1. (7.6) is a distribution: πM(M)>0\pi_M(\mathbf M)>0πM​(M)>0 and ∑MπM(M)=1\sum_{\mathbf M}\pi_M(\mathbf M)=1∑M​πM​(M)=1 (Exercise 7.1.3).
  2. Theorem 7.1 for m=M−1m=M-1m=M−1, the case the book's proof establishes first.
  3. Corollary 7.5, the identity of its proof: the probability that a uniformly chosen individual's allele is carried by exactly iii individuals is
∑MiMiMπM(M)=νM(ν+M−1i)−1(Mi).(7.9)\sum_{\mathbf M}\frac{iM_i}{M}\pi_M(\mathbf M)=\frac{\nu}{M}\binom{\nu+M-1}{i}^{-1}\binom Mi. \qquad (7.9)M∑​MiMi​​πM​(M)=Mν​(iν+M−1​)−1(iM​).(7.9)
  1. Theorem 7.9: the probability QQQ that the walk (7.8) started at 111 reaches MMM before 000 satisfies
Q−1=∑i=0M−1(M−1i)−1(ν+M−1i).Q^{-1}=\sum_{i=0}^{M-1}\binom{M-1}{i}^{-1}\binom{\nu+M-1}{i}.Q−1=i=0∑M−1​(iM−1​)−1(iν+M−1​).

Significance

The results. Consistency under sampling is what makes the Ewens formula usable as a statistical model: the predicted distribution for an observed sample does not depend on the unknown population size, only on ν\nuν. Kelly deduces from it the sufficiency of the number of alleles in a sample for ν\nuν and the heterozygosity ν/(ν+1)\nu/(\nu+1)ν/(ν+1) (Exercises 7.1.5, 7.1.8). The formula (7.9) gives the equilibrium frequency of the oldest allele, and Theorem 7.9 gives the quasi-fixation probability from which the mean time between quasi-fixations follows (Corollary 7.10).

Formalizing them. All four results are classical and proved; none has a machine-checked proof on the platform or in Mathlib as of this writing. The mission produces a reusable formal Ewens distribution over integer partitions, a definition of sampling without replacement by counting labelled subsets, and an absorption probability for an explicit birth–death walk. Proofs independent of Kelly's process argument are welcome.

Difficulty

The book's proof of Theorem 7.1 is a process argument: in a population whose size fluctuates between M−1M-1M−1 and MMM, a drop in size acts as a random deletion, and the truncated equilibrium (7.7) restricted to each size gives πM−1\pi_{M-1}πM−1​ and πM\pi_MπM​. Turning that into a statement about finite sets requires the equilibrium of a truncated reversible process, which is not available here, so a formal proof must either build that process or find a direct combinatorial route. A direct route has to relate, for each description of the sample, the number of mmm-subsets of a labelled population with a given description to products of binomial coefficients, and sum the result against (7.6); the bookkeeping over partitions is where the work lies. Theorem 7.9 needs a solution of the first-step equations of a non-symmetric walk and the identification of that solution with a hitting probability defined as a limit.

Formalization scope

  • Descriptions of nnn individuals are integer partitions Nat.Partition n, with MiM_iMi​ the multiplicity of the part iii; the product in (7.6) runs over i=1,…,ni=1,\dots,ni=1,…,n. The real binomial coefficient is the published definition AppliedComb.GenFun.binomReal.
  • The population is Fin M with allelic types Fin M → ℕ; the description of a labelled set is computed from the labelling. The sampling probability is (Mm)−1\binom Mm^{-1}(mM​)−1 times the number of mmm-subsets whose restricted labelling has the given description. It is not defined by a formula on descriptions, and a definition that removed individuals one at a time in proportion to class sizes (the book's proof route) is ruled out as a definition because it presupposes the reduction the proof must supply.
  • The goal and Corollary 7.5 quantify over an arbitrary choice of labelling for each population description. They assume M≥2M\ge2M≥2, as required by the chapter's rule that a parent is chosen among the other M−1M-1M−1 individuals; the goal also assumes 1≤m≤M1\le m\le M1≤m≤M. Because πM>0\pi_M>0πM​>0, this forces the conditional sampling law to depend on the population only through its description. Types are natural numbers, so every description is realized and the hypothesis is never vacuous.
  • The quasi-fixation probability is defined through the jump chain of (7.8): the limit of the probabilities of reaching MMM within nnn jumps without reaching 000. The theorem assumes M≥2M\ge2M≥2, μ>0\mu>0μ>0, 0<u<10<u<10<u<1 and ν=(M−1)u/(1−u)\nu=(M-1)u/(1-u)ν=(M−1)u/(1−u).
  • Corollary 7.5 is formalized as the identity of its proof. The identification of the oldest allele's frequency with that of a randomly chosen individual uses allele ages and the reversibility of the labelled process (Theorem 7.2) and is not formalized. Theorem 7.2 itself, whose state space orders the allele labels within each class, and the allele-age results (Corollaries 7.3, 7.4, 7.7, 7.8, Theorem 7.6, Corollary 7.10, Theorem 7.11) are not part of the mission.

Contributions of general partition and sampling lemmas (counting subsets with a given description, the generating function identity (1−x)−ν=∏jeνxj/j(1-x)^{-\nu}=\prod_j e^{\nu x^j/j}(1−x)−ν=∏j​eνxj/j) are reusable beyond this mission.

Selected references

  • F. P. Kelly, Reversibility and Stochastic Networks, Wiley, 1979, Chapter 7. https://www.statslab.cam.ac.uk/~frank/BOOKS/kelly_book.html
  • W. J. Ewens, The sampling theory of selectively neutral alleles, Theoretical Population Biology 3 (1972), 87–112. https://doi.org/10.1016/0040-5809(72)90035-4
  • J. F. C. Kingman, The representation of partition structures, Journal of the London Mathematical Society (2) 18 (1978), 374–380. https://doi.org/10.1112/jlms/s2-18.2.374
  • M. Kimura and J. F. Crow, The number of alleles that can be maintained in a finite population, Genetics 49 (1964), 725–738. https://doi.org/10.1093/genetics/49.4.725
9 thms2 active usersReviewed
🏆Completed
Functional AnalysisMachine Learning·Captain: mikedeng1

The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network II: Fat-Shattering Bound for Bounded-Weight NetworksResearch Paper

Motivation

In the mid-1990s, neural networks trained by gradient descent were observed to generalize well even when the number of weights far exceeded the number of training examples. The classical theory could not explain this: VC-dimension bounds for networks grow with the number of parameters, so for large networks they are vacuous. Bartlett's paper (IEEE Trans. Inform. Theory 44 (1998)) showed that, for classification with a margin, what controls generalization is the size of the weights, not the size of the network. Its two main technical results are a margin bound in terms of the fat-shattering dimension (Theorem 2, the subject of mission I of this series) and a bound on the fat-shattering dimension of networks with bounded weights (Theorem 17, the subject of this mission). The same idea of weight-norm capacity control underlies much of the later theory of margins, boosting and kernel methods.

Timeline. Kearns and Schapire (1994) introduced the fat-shattering dimension. Alon, Ben-David, Cesa-Bianchi and Haussler (1997) bounded ℓ∞ covering numbers by it. Bartlett, Kulkarni and Posner (1997) gave the matching lower bound on ℓ1 covering numbers used here as Lemma 19. Maurey's approximation lemma (reported by Pisier, 1981) was used by Jones (1992) and Barron (1993) for approximation by networks, and by Lee, Bartlett and Williamson (1996) for covering numbers of convex hulls. Bartlett (1998) combined these into Theorem 17.

Setting

Let XXX be a set and HHH a class of functions X→RX\to\mathbb RX→R. For γ>0\gamma>0γ>0, a sequence x=(x1,…,xm)∈Xmx=(x_1,\dots,x_m)\in X^mx=(x1​,…,xm​)∈Xm is γ\gammaγ-shattered by HHH if there is r∈Rmr\in\mathbb R^mr∈Rm such that for every b∈{−1,1}mb\in\{-1,1\}^mb∈{−1,1}m some h∈Hh\in Hh∈H satisfies (h(xi)−ri)bi≥γ(h(x_i)-r_i)b_i\ge\gamma(h(xi​)−ri​)bi​≥γ for all iii. The fat-shattering dimension is

fat⁡H(γ)=max⁡{m: H γ-shatters some x∈Xm}∈N∪{∞}.\operatorname{fat}_H(\gamma)=\max\{m:\ H\ \gamma\text{-shatters some }x\in X^m\}\in\mathbb N\cup\{\infty\}.fatH​(γ)=max{m: H γ-shatters some x∈Xm}∈N∪{∞}.

A cover of a class FFF at scale ε\varepsilonε for a pseudometric ρ\rhoρ on functions is a set TTT of functions such that every f∈Ff\in Ff∈F has some t∈Tt\in Tt∈T with ρ(t,f)<ε\rho(t,f)<\varepsilonρ(t,f)<ε; N(F,ε,ρ)\mathcal N(F,\varepsilon,\rho)N(F,ε,ρ) is the least size of a cover. For a sample x∈Xmx\in X^mx∈Xm the pseudometrics dℓ∞(x)d_{\ell_\infty(x)}dℓ∞​(x)​, dℓ1(x)d_{\ell_1(x)}dℓ1​(x)​, dℓ2(x)d_{\ell_2(x)}dℓ2​(x)​ are the maximum, the mean, and the root mean square of ∣f(xi)−g(xi)∣|f(x_i)-g(x_i)|∣f(xi​)−g(xi​)∣ over iii, and the uniform covering numbers are Np(F,ε,m)=max⁡x∈XmN(F,ε,dℓp(x))\mathcal N_p(F,\varepsilon,m)=\max_{x\in X^m}\mathcal N(F,\varepsilon,d_{\ell_p(x)})Np​(F,ε,m)=maxx∈Xm​N(F,ε,dℓp​(x)​).

The hidden units form a nonempty class FFF of functions X→[−M/2,M/2]X\to[-M/2,M/2]X→[−M/2,M/2]. For A>0A>0A>0 the two-layer network class with ℓ1-bounded output weights is

H={∑i=1Nwifi: N∈N, fi∈F, ∑i=1N∣wi∣≤A}.H=\Big\{\sum_{i=1}^Nw_if_i:\ N\in\mathbb N,\ f_i\in F,\ \sum_{i=1}^N|w_i|\le A\Big\}.H={i=1∑N​wi​fi​: N∈N, fi​∈F, i=1∑N​∣wi​∣≤A}.

In Lean these are BartlettNN.Margin.fat, BartlettNN.Margin.coverNum and BartlettNN.Margin.Ninf (shared with mission I), and BartlettNN.FatNet.N1, BartlettNN.FatNet.N2 and BartlettNN.FatNet.combos F A.

Formalization targets

Goal: Theorem 17

There is a universal constant ccc such that for every XXX, FFF, MMM, A>0A>0A>0 and γ>0\gamma>0γ>0 with d=fat⁡F(γ/(32A))≥1d=\operatorname{fat}_F(\gamma/(32A))\ge1d=fatF​(γ/(32A))≥1,

fat⁡H(γ)≤cM2A2dγ2ln⁡2(MAdγ).\operatorname{fat}_H(\gamma)\le\frac{cM^2A^2d}{\gamma^2}\ln^2\Big(\frac{MAd}{\gamma}\Big).fatH​(γ)≤γ2cM2A2d​ln2(γMAd​).

The constant is left unspecified, as in the paper, so that the goal survives any improvement of the numerical constants.

Milestones (in the order the proof uses them)

  1. Lemma 19 (cited from Bartlett–Kulkarni–Posner): for [0,1][0,1][0,1]-valued FFF with fat⁡F(4γ)≥d\operatorname{fat}_F(4\gamma)\ge dfatF​(4γ)≥d, log⁡2N1(F,γ,d)≥d/32\log_2\mathcal N_1(F,\gamma,d)\ge d/32log2​N1​(F,γ,d)≥d/32.
  2. Lemma 20, (5): for d=fat⁡F(γ/4)d=\operatorname{fat}_F(\gamma/4)d=fatF​(γ/4) and m≥2+2dlog⁡2(32M/γ)m\ge2+2d\log_2(32M/\gamma)m≥2+2dlog2​(32M/γ), log⁡2N2(F,γ,m)<1+dlog⁡2(4emM/(dγ))log⁡2(9mM2/γ2)\log_2\mathcal N_2(F,\gamma,m)<1+d\log_2(4emM/(d\gamma))\log_2(9mM^2/\gamma^2)log2​N2​(F,γ,m)<1+dlog2​(4emM/(dγ))log2​(9mM2/γ2).
  3. Lemma 21 (Maurey): in a Hilbert space, a point of the closed convex hull of a set of norm at most bbb is within c/k\sqrt{c/k}c/k​ of an average of kkk points of the set, for every c>b2−∥h∥2c>b^2-\|h\|^2c>b2−∥h∥2.
  4. Lemma 22: log⁡2N2(H,γ,m)≤(2M2A2/γ2)log⁡2(2N2(F,γ/(2A),m)+1)\log_2\mathcal N_2(H,\gamma,m)\le(2M^2A^2/\gamma^2)\log_2(2\mathcal N_2(F,\gamma/(2A),m)+1)log2​N2​(H,γ,m)≤(2M2A2/γ2)log2​(2N2​(F,γ/(2A),m)+1).
  5. Inequality (6): if m=fat⁡H(4γ)≥2+2dlog⁡2(64MA/γ)m=\operatorname{fat}_H(4\gamma)\ge2+2d\log_2(64MA/\gamma)m=fatH​(4γ)≥2+2dlog2​(64MA/γ) with d=fat⁡F(γ/(8A))d=\operatorname{fat}_F(\gamma/(8A))d=fatF​(γ/(8A)), then m≤(64M2A2/γ2)(3+dlog⁡2(8emMA/γ)log⁡2(36mM2A2/γ2))m\le(64M^2A^2/\gamma^2)(3+d\log_2(8emMA/\gamma)\log_2(36mM^2A^2/\gamma^2))m≤(64M2A2/γ2)(3+dlog2​(8emMA/γ)log2​(36mM2A2/γ2)).

Significance

Theorem 17 bounds the capacity of a network class without reference to the number of hidden units NNN. With Theorem 2 (mission I) it gives misclassification bounds for networks with small weights that hold for networks of any size, and by iteration it yields the bounds for deep sigmoid networks of Theorem 28 (mission III). Its method — upper-bound ℓ2 covering numbers through Maurey's lemma and compare with a lower bound in terms of fat-shattering — is a template for bounding the fat-shattering dimension of convex hulls in general.

The results are proved in the paper (Lemmas 19 and 21 by citation). None of them is formalized: the platform has no fat-shattering dimension, no uniform sample covering numbers of function classes, and only a finite-dimensional, diameter-based form of Maurey's lemma (HighDimProb.Appetizer.approx_caratheodory), which is not Lemma 21. This mission produces machine-checked statements of all five ingredients and of the theorem.

Difficulty

The obvious route would bound fat⁡H\operatorname{fat}_HfatH​ through a VC-type count of the network's parameters, which fails because NNN is unbounded. The paper's route needs a lower bound on covering numbers by the fat-shattering dimension (Lemma 19, a combinatorial packing argument not proved in the paper), an upper bound by the fat-shattering dimension at a finer scale (Lemma 20, which goes through the Alon et al. scale-sensitive Sauer lemma and a quantization argument), and a probabilistic approximation argument in the empirical L2L_2L2​ space (Lemmas 21 and 22). The final step solves a transcendental inequality (6) for mmm, with care at the boundary where the logarithm is small.

Formalization scope

  • Functions are maps X → ℝ; fat is valued in ℕ∞, so an unbounded shattering is ∞\infty∞, not a junk 000. Labels ±1\pm1±1 are Bool read through pm (true ↦ 1); sequences are indexed by Fin m (0-based).
  • Covers are external (finite sets of arbitrary functions X→RX\to\mathbb RX→R) with the strict inequality of Definition 3; the covering number is ∞\infty∞ when no finite cover exists. The ℓ1 and ℓ2 distances carry the factor 1/m1/m1/m. Mathlib's Metric.coveringNumber (closed balls, metric types) is not used.
  • Bounds of the form "log⁡2N≤B\log_2\mathcal N\le Blog2​N≤B" are stated for every finite value of N\mathcal NN, and where the paper's bound implies finiteness (Lemmas 20, 22, Theorem 17) finiteness is part of the conclusion.
  • The constant ccc of Theorem 17 is quantified before XXX, FFF, MMM, AAA, γ\gammaγ and ddd; a constant chosen after them would make the statement trivially true.
  • Corrections of the printed statement. Theorem 17 is stated for γ>0\gamma>0γ>0 (printed γ≥0\gamma\ge0γ≥0, under which the bound is meaningless) and A>0A>0A>0 (printed A≥0A\ge0A≥0, under which γ/(32A)\gamma/(32A)γ/(32A) is undefined). Implicit positivity (M>0M>0M>0, γ>0\gamma>0γ>0, A>0A>0A>0) in Lemmas 20, 22 and (6) is stated as hypotheses. Inequality (6) is copied as printed, with log⁡2(8emMA/γ)\log_2(8emMA/\gamma)log2​(8emMA/γ).
  • In Theorem 17 the logarithm is natural (the base is absorbed by ccc); (5) and (6) use log⁡2\log_2log2​.
  • Lemma 21 is stated in a complete real inner product space, with "convex closure" read as the closure of the convex hull.

Contributions welcome: proofs of the five milestones and of the goal, and reusable infrastructure on fat-shattering and covering numbers of function classes.

Selected references

  • P. L. Bartlett, The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network, IEEE Trans. Inform. Theory 44(2), 1998, 525–536. https://doi.org/10.1109/18.661502
  • N. Alon, S. Ben-David, N. Cesa-Bianchi, D. Haussler, Scale-sensitive dimensions, uniform convergence, and learnability, J. ACM 44(4), 1997, 615–631. https://doi.org/10.1145/263867.263927
  • P. L. Bartlett, S. R. Kulkarni, S. E. Posner, Covering numbers for real-valued function classes, IEEE Trans. Inform. Theory 43(5), 1997, 1721–1724. https://doi.org/10.1109/18.623181
  • M. J. Kearns, R. E. Schapire, Efficient distribution-free learning of probabilistic concepts, J. Comput. Syst. Sci. 48(3), 1994, 464–497. https://doi.org/10.1016/S0022-0000(05)80062-5
  • W. S. Lee, P. L. Bartlett, R. C. Williamson, Efficient agnostic learning of neural networks with bounded fan-in, IEEE Trans. Inform. Theory 42(6), 1996, 2118–2132. https://doi.org/10.1109/18.556601
  • A. R. Barron, Universal approximation bounds for superpositions of a sigmoidal function, IEEE Trans. Inform. Theory 39(3), 1993, 930–945. https://doi.org/10.1109/18.256500
11 thms2 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

The Online Set Cover Problem 2: Given α ≥ c(C_OPT), the Weighted Potential-Function Algorithm Never Fails and Pays at Most (6+o(1)) α log m log nResearch Paper

Motivation

Set cover is one of the basic covering problems of combinatorial optimization: given a ground set and a family of subsets with costs, choose a cheapest subfamily whose union contains every element. In many applications the elements to be covered are not known in advance but appear over time: requests for a service that must be served by opening facilities, clients that must be assigned to servers, or constraints of a covering program that are revealed one at a time. Each arriving element must be covered at once, and decisions cannot be undone. This is the online set cover problem, introduced by Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 39(2), 2009; conference version STOC 2003).

The quality of an online algorithm is measured by its competitive ratio: the worst case, over all arrival sequences, of the ratio between the algorithm's cost and the cost of an optimal offline cover of the elements that actually arrived. The paper gives a deterministic algorithm with ratio O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn), where nnn is the number of elements and mmm the number of sets, and shows a nearly matching lower bound for deterministic algorithms. Its algorithm for the weighted case, analysed with a potential function, became a template for the online primal–dual method surveyed by Buchbinder and Naor (Found. Trends Theor. Comput. Sci. 3(2–3), 2009).

This mission formalizes the core of the weighted result: the algorithm that is given a value α\alphaα at least the optimal cost, and its guarantee (Theorem 3.4).

Setting

The ground set XXX has n=∣X∣n = |X|n=∣X∣ elements and the family S\mathcal SS has m=∣S∣m = |\mathcal S|m=∣S∣ sets; every set SSS has a cost cS>0c_S > 0cS​>0. Both are known to the algorithm in advance. For an element jjj, Sj\mathcal S_jSj​ denotes the sets containing jjj. Elements of an unknown subset of XXX arrive one at a time in a sequence σ\sigmaσ; on arrival each must be covered by a chosen set. The chosen family C\mathcal CC can only grow. COPT\mathcal C_{OPT}COPT​ is any family covering every arriving element, and c(COPT)=∑S∈COPTcSc(\mathcal C_{OPT}) = \sum_{S \in \mathcal C_{OPT}} c_Sc(COPT​)=∑S∈COPT​​cS​.

The algorithm is given α≥c(COPT)\alpha \ge c(\mathcal C_{OPT})α≥c(COPT​). It discards sets costing more than α\alphaα, buys sets costing at most α/m\alpha/mα/m outright, and rescales costs; on the resulting normalized instance 1≤cS≤m1 \le c_S \le m1≤cS​≤m and cS≤αc_S \le \alphacS​≤α for every set (p. 365).

The algorithm keeps a weight wS>0w_S > 0wS​>0 for every set, initially wS=1/m2w_S = 1/m^2wS​=1/m2; the weight of an element is wj=∑S∈SjwSw_j = \sum_{S \in \mathcal S_j} w_Swj​=∑S∈Sj​​wS​. With CCC the set of covered elements and χC\chi_{\mathcal C}χC​ the indicator of C\mathcal CC, the potential is

Φ=∑j∉Cn2wj+n⋅exp⁡(12α∑S∈S(cSχC(S)−3wScSlog⁡n)),\Phi = \sum_{j \notin C} n^{2 w_j} + n \cdot \exp\Big(\frac{1}{2\alpha} \sum_{S \in \mathcal S} \big(c_S \chi_{\mathcal C}(S) - 3 w_S c_S \log n\big)\Big),Φ=j∈/C∑​n2wj​+n⋅exp(2α1​S∈S∑​(cS​χC​(S)−3wS​cS​logn)),

with natural logarithms throughout. When jjj arrives with wj≥1w_j \ge 1wj​≥1 nothing happens; otherwise the algorithm performs weight augmentation steps while wj<1w_j < 1wj​<1. In a step, for each S∈SjS \in \mathcal S_jS∈Sj​: (a) wS←wS(1+1ncS)w_S \leftarrow w_S (1 + \frac{1}{n c_S})wS​←wS​(1+ncS​1​); (b) if S∉CS \notin \mathcal CS∈/C, add SSS to C\mathcal CC when Φ\PhiΦ does not exceed its value before (a); (c) if Φ\PhiΦ has increased, return FAIL.

In Lean, the instance is the published OnlinePrimalDual.OnlineSetCover.SetCoverInstance over finite types X (elements) and T (sets), with the published elementWeight, coveredBy and potential. The run is OnlineSetCover.Weighted.Reachable inst α σ, the set of configurations reachable from initState σ under the transition relation Step.

Formalization targets

Goal: Theorem 3.4

On the normalized instance, with COPT\mathcal C_{OPT}COPT​ covering σ\sigmaσ, c(COPT)≤αc(\mathcal C_{OPT}) \le \alphac(COPT​)≤α, and n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2, every reachable configuration is a running state (never FAIL) in which (i) every j∈Xj \in Xj∈X with wj≥1w_j \ge 1wj​≥1 is covered, and (ii)

∑S∈CcS≤3log⁡n(1+(1+1n)αlog⁡(m2(1+1n)))+2αlog⁡n=(6+o(1)) αlog⁡mlog⁡n.\sum_{S \in \mathcal C} c_S \le 3 \log n \Big(1 + \Big(1 + \frac1n\Big)\alpha \log\Big(m^2\Big(1+\frac1n\Big)\Big)\Big) + 2\alpha \log n = (6 + o(1))\,\alpha \log m \log n.S∈C∑​cS​≤3logn(1+(1+n1​)αlog(m2(1+n1​)))+2αlogn=(6+o(1))αlogmlogn.

Milestones

  • Lemma 3.1 (p. 365): the number NNN of augmentation steps satisfies N≤∑S∈COPT(ncS+1)log⁡(m2(1+1/n))≤(n+1)αlog⁡(m2(1+1/n))N \le \sum_{S \in \mathcal C_{OPT}} (n c_S + 1)\log(m^2(1 + 1/n)) \le (n+1)\alpha\log(m^2(1+1/n))N≤∑S∈COPT​​(ncS​+1)log(m2(1+1/n))≤(n+1)αlog(m2(1+1/n)).
  • Lemma 3.2 (p. 366): throughout, ∑SwScS≤1+N/n≤1+(1+1/n)αlog⁡(m2(1+1/n))\sum_S w_S c_S \le 1 + N/n \le 1 + (1 + 1/n)\alpha\log(m^2(1+1/n))∑S​wS​cS​≤1+N/n≤1+(1+1/n)αlog(m2(1+1/n)).
  • Lemma 3.3 (p. 366): a per-set step with cS≤αc_S \le \alphacS​≤α never increases Φ\PhiΦ; in particular the algorithm never fails.

The Proved platform theorem OnlinePrimalDual.OnlineSetCover.algorithm_correctness (the last paragraph of the proof of Theorem 3.4, with the invariant Φ<n2\Phi < n^2Φ<n2 assumed) is included as a supporting reference.

Significance

Theorem 3.4 is the analysis of the subroutine; with the doubling over guesses of α\alphaα described on pp. 364–365 (which loses a factor of at most 4) it yields the paper's deterministic O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn)-competitive algorithm for weighted online set cover. The lower bound of Section 4 shows that no deterministic algorithm can do much better on general instances, so the result is close to the deterministic optimum. The technique, a potential that couples a fractional multiplicative-weights solution to a deterministic rounding, reappears in online covering and packing, online facility location and related problems.

The result is proved in the paper and restated in the Buchbinder–Naor monograph. On Prove2Me, the monograph's final step (from the invariant Φ<n2\Phi < n^2Φ<n2 to the cost bound) is a Proved theorem, and its expectation form of the monotonicity lemma is Disproved because it omits the hypothesis cS≤αc_S \le \alphacS​≤α. Neither the full statement about the algorithm's run nor Lemmas 3.1, 3.2 and the corrected Lemma 3.3 are formalized on the platform. This mission produces them, with the o(1)o(1)o(1) terms replaced by explicit expressions.

Difficulty

The cost bound in the last step is short once two facts about the run are available: that Φ\PhiΦ stays below n2n^2n2, and that the fractional cost ∑SwScS\sum_S w_S c_S∑S​wS​cS​ stays logarithmic. Neither is a local fact about one state. The first requires showing that, at every per-set step, one of the two deterministic choices (add SSS or not) does not increase Φ\PhiΦ; the paper proves this by a probabilistic argument over an auxiliary randomized choice, and the bound on the exponential term depends on the cost of the set being at most α\alphaα. The platform's earlier statement of this lemma, which omits that hypothesis, is Disproved. The second requires a bound on the number of augmentation steps over the whole run, which depends on the run's history and not on any single state. In Lean both are inductions over an operational semantics with real-valued exponentials and powers n2wjn^{2 w_j}n2wj​, where the initial bound Φ<n2\Phi < n^2Φ<n2 is a genuine size condition on nnn and mmm.

Formalization scope

The run is a small-step transition relation. A state records the weights, the cover, the number of augmentation steps begun, the elements not yet given, and the position inside the current step; FAIL is a separate terminal configuration. The order in which a step visits Sj\mathcal S_jSj​ is arbitrary and may differ between steps; every statement holds for every order. "Throughout the algorithm" means every reachable configuration, including those between per-set substeps. Arrival sequences are arbitrary lists (repetitions allowed) of elements covered by COPT\mathcal C_{OPT}COPT​.

Conventions: costs, weights and α\alphaα are real; nnn and mmm are the cardinalities of the finite types cast to R\mathbb RR; log⁡\loglog is Real.log; n2wjn^{2 w_j}n2wj​ and n2/mn^{2/m}n2/m are real powers. The paper's asymptotic expressions are replaced by what its proofs establish:

  • Lemma 3.1: (2+o(1))nαlog⁡m(2 + o(1)) n\alpha\log m(2+o(1))nαlogm becomes (n+1)αlog⁡(m2(1+1/n))(n+1)\alpha\log(m^2(1+1/n))(n+1)αlog(m2(1+1/n));
  • Lemma 3.2: (2+o(1))αlog⁡m(2 + o(1))\alpha\log m(2+o(1))αlogm becomes 1+(1+1/n)αlog⁡(m2(1+1/n))1 + (1+1/n)\alpha\log(m^2(1+1/n))1+(1+1/n)αlog(m2(1+1/n)), together with the intermediate bound 1+N/n1 + N/n1+N/n;
  • Theorem 3.4 (ii): (6+o(1))αlog⁡mlog⁡n(6 + o(1))\alpha\log m\log n(6+o(1))αlogmlogn becomes 3log⁡n (1+(1+1/n)αlog⁡(m2(1+1/n)))+2αlog⁡n3\log n\,(1 + (1+1/n)\alpha\log(m^2(1+1/n))) + 2\alpha\log n3logn(1+(1+1/n)αlog(m2(1+1/n)))+2αlogn;
  • "n and m large" becomes the hypothesis n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2 used for the initial potential (it holds, for instance, when n≥4n \ge 4n≥4 and m≥3m \ge 3m≥3).

The goal is a statement about the configurations the algorithm actually reaches from wS=1/m2w_S = 1/m^2wS​=1/m2 and the empty cover. Taking the invariant Φ<n2\Phi < n^2Φ<n2 or the fractional-cost bound as a hypothesis on an arbitrary state would trivialize it, and is ruled out: those are exactly what the milestones establish. The doubling wrapper for unknown α\alphaα is not part of this mission.

A complete development needs an invariant for reachable states (positive weights, steps of an element processed in full), the per-set potential inequality, and the step-counting argument. The per-set inequality is reusable for the monograph's version of the algorithm. Contributions of proofs of any milestone, and of auxiliary invariants as separate lemmas, are welcome.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM Journal on Computing 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
10 thms2 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

The Online Set Cover Problem 3: Every Deterministic Online Algorithm Has Competitive Ratio at Least kr on the Block FamilyResearch Paper

Motivation

In the online set cover problem of Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 2009; preliminary version STOC 2003), a ground set and a family of subsets are known in advance, but the elements that actually need covering arrive one at a time, and each must be covered on arrival by sets chosen irrevocably. The paper's motivating example is a network of servers with activation costs: the set of potential clients is known, the clients that actually request service are not, and each request must be served on arrival.

The paper gives a deterministic online algorithm whose cost is within a factor O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn) of the offline optimum, where nnn is the number of elements and mmm the number of sets. Its Section 4 shows that this is close to optimal for deterministic algorithms: for all interesting values of mmm and nnn, every deterministic online algorithm has competitive ratio Ω(log⁡nlog⁡m/(log⁡log⁡m+log⁡log⁡n))\Omega\big(\log n \log m / (\log\log m + \log\log n)\big)Ω(lognlogm/(loglogm+loglogn)). The lower bound is the reason the log⁡mlog⁡n\log m \log nlogmlogn product, rather than the ln⁡n\ln nlnn of offline approximation (Feige 1998), is the right target online. The online primal–dual framework that grew out of this paper (Buchbinder and Naor 2009) cites it as the benchmark for online covering problems.

This mission formalizes the exact, non-asymptotic statements behind that lower bound: Propositions 4.1 and 4.2 of the paper.

Setting

A ground set XXX and a family F\mathcal FF of distinct subsets of XXX are fixed and known to the algorithm; m=∣F∣m = |\mathcal F|m=∣F∣. An adversary presents elements x1,x2,…x_1, x_2, \dotsx1​,x2​,… of XXX one by one, choosing each after seeing the algorithm's previous responses. A deterministic online algorithm AAA, on the arrival of xtx_txt​, sees the earlier arrivals (x1,…,xt−1)(x_1, \dots, x_{t-1})(x1​,…,xt−1​) and xtx_txt​, and adds a finite family A((x1,…,xt−1),xt)⊆FA\big((x_1,\dots,x_{t-1}), x_t\big) \subseteq \mathcal FA((x1​,…,xt−1​),xt​)⊆F of sets to its collection; sets are never removed. It is valid if after every arrival that lies in some member of F\mathcal FF, that element lies in a chosen set. After an arrival sequence σ\sigmaσ the chosen collection is CA(σ)\mathcal C_A(\sigma)CA​(σ), and since every set has unit cost, the cost is ∣CA(σ)∣|\mathcal C_A(\sigma)|∣CA​(σ)∣. The offline optimum OPT(σ)\mathrm{OPT}(\sigma)OPT(σ) is the least number of members of F\mathcal FF covering the elements of σ\sigmaσ. The competitive ratio of AAA is at least ρ\rhoρ when some arrival sequence σ\sigmaσ has OPT(σ)≥1\mathrm{OPT}(\sigma) \ge 1OPT(σ)≥1 and ∣CA(σ)∣≥ρ OPT(σ)|\mathcal C_A(\sigma)| \ge \rho\,\mathrm{OPT}(\sigma)∣CA​(σ)∣≥ρOPT(σ).

Two families are used.

  • The bit family: X={0,…,2k−1}X = \{0, \dots, 2^k - 1\}X={0,…,2k−1} and Fi={j:bit i of j is on}F_i = \{ j : \text{bit } i \text{ of } j \text{ is on}\}Fi​={j:bit i of j is on} for 1≤i≤k1 \le i \le k1≤i≤k.
  • The block family: kr2k r^2kr2 disjoint blocks X1,…,Xkr2X_1, \dots, X_{kr^2}X1​,…,Xkr2​ of 2k2^k2k elements each; Xb(t)X_b(t)Xb​(t) is the set of elements of block XbX_bXb​ whose tttth bit is on. For an rrr-set R={b1<⋯<br}R = \{b_1 < \dots < b_r\}R={b1​<⋯<br​} of blocks and bit locations I=(i1,…,ir)I = (i_1, \dots, i_r)I=(i1​,…,ir​),
FR,I=⋃t=1rXbt(it),F_{R,I} = \bigcup_{t=1}^r X_{b_t}(i_t),FR,I​=t=1⋃r​Xbt​​(it​),

and the family consists of all FR,IF_{R,I}FR,I​; it has m=(kr2r)krm = \binom{kr^2}{r} k^rm=(rkr2​)kr members.

Formalization targets

Goal: Proposition 4.2

For all positive integers k,rk, rk,r and all n,mn, mn,m with

n≥2k+1kr2,22kkr2≥m≥(kr2r)kr,n \ge 2^{k+1} k r^2, \qquad 2^{2^k k r^2} \ge m \ge \binom{kr^2}{r} k^r,n≥2k+1kr2,22kkr2≥m≥(rkr2​)kr,

there is a family F\mathcal FF of exactly mmm distinct subsets of an nnn-element set such that for every valid deterministic online algorithm AAA there is a nonempty arrival sequence σ\sigmaσ, covered by a single member of F\mathcal FF, with

∣CA(σ)∣≥kr=kr⋅OPT(σ).|\mathcal C_A(\sigma)| \ge kr = kr \cdot \mathrm{OPT}(\sigma).∣CA​(σ)∣≥kr=kr⋅OPT(σ).

The goal leaves the instance existential, as the paper does, and keeps both bounds on mmm and the bound on nnn exactly as printed.

Milestones

  1. Proposition 4.1. On the bit family, ∣F∣=k|\mathcal F| = k∣F∣=k; every valid deterministic algorithm can be forced to cost kkk on a sequence with OPT=1\mathrm{OPT} = 1OPT=1; and some valid algorithm has cost at most k⋅∣C∣k \cdot |C|k⋅∣C∣ for every offline cover CCC. So the best deterministic competitive ratio is exactly k=log⁡2nk = \log_2 nk=log2​n.
  2. The adversary claim of Section 4 (p. 369). On the block family, every valid deterministic algorithm can be forced to choose krkrkr sets by at most krkrkr arrivals that a single set covers.

A supporting item (not a milestone) records the count ∣F∣=(kr2r)kr|\mathcal F| = \binom{kr^2}{r} k^r∣F∣=(rkr2​)kr of the block family.

Significance

The result. Proposition 4.2 is the exact statement behind the paper's lower bound: choosing rrr of order log⁡m/(log⁡log⁡m+log⁡log⁡n)\log m / (\log\log m + \log\log n)logm/(loglogm+loglogn) and kkk of order log⁡n\log nlogn turns it into the asymptotic bound Ω(log⁡nlog⁡m/(log⁡log⁡m+log⁡log⁡n))\Omega\big(\log n \log m/(\log\log m + \log\log n)\big)Ω(lognlogm/(loglogm+loglogn)), which shows that the paper's O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn) algorithm is optimal among deterministic algorithms up to a log⁡log⁡m+log⁡log⁡n\log\log m + \log\log nloglogm+loglogn factor. Without it, the gap between the ln⁡n\ln nlnn achievable offline and the log⁡mlog⁡n\log m \log nlogmlogn achieved online would be unexplained. Proposition 4.1 alone gives the matching bound log⁡2n\log_2 nlog2​n when m=log⁡2nm = \log_2 nm=log2​n.

Formalizing it. Both propositions are proved in the paper; neither is formalized anywhere to our knowledge. The mission produces a reusable model of deterministic online algorithms against an adaptive adversary, with a validity notion and a cost, and machine-checked adversary arguments on it. The paper's proof tacitly lets the algorithm add one set per arrival; the statements here cover algorithms that add any number of sets per arrival, so a complete formalization also closes that gap.

Difficulty

The adversary must be adaptive, and the quantifiers are ordered instance, then algorithm, then arrival sequence. The obvious single-block argument (Proposition 4.1) forces only kkk sets. To force krkrkr sets with OPT=1\mathrm{OPT} = 1OPT=1, the adversary must move to blocks that no chosen set has touched yet, which requires counting the blocks touched by the sets chosen so far. When an algorithm adds many sets at once, the paper's count "at most 1+(r−1)k1 + (r-1)k1+(r−1)k blocks after kkk steps" no longer applies as written, and the stopping rule has to be phrased in terms of the cost already paid. The padding of Proposition 4.2 must reach exactly nnn elements and exactly mmm distinct sets without creating sets that help cover the adversary's elements.

Formalization scope

The ground set is a Fin type: Fin (2^k) for Proposition 4.1, Fin (k r²) × Fin (2^k) (block, element) for the block family, Fin n for Proposition 4.2. A family is a Finset (Finset X), so its cardinality counts distinct sets. Bit iii (1-based) of jjj is Nat.testBit j (i-1). An online algorithm is a function from (earlier arrivals in arrival order, current element) to the finite family of sets it adds; it may add any number of sets. Validity demands coverage only for elements that some member of the family contains. Costs are unit (the problem of Section 4 is unweighted).

The offline optimum is never encoded as an infimum: lower bounds exhibit a nonempty arrival sequence and a single covering set (OPT=1\mathrm{OPT} = 1OPT=1), and the upper bound of Proposition 4.1 quantifies over all offline covers. This rules out the trivializing reading in which the empty arrival sequence satisfies cost≥kr⋅OPT\text{cost} \ge kr \cdot \mathrm{OPT}cost≥kr⋅OPT as 0≥00 \ge 00≥0.

The statements contain no O(⋅)O(\cdot)O(⋅): every quantity is the paper's exact one. The asymptotic bound (8) under the range (7), whose final paragraph only sketches the choice of rrr and kkk, is excluded, as are the remarks on the trivial ratio-mmm and O(n)O(\sqrt n)O(n​) algorithms.

Contributions welcome: proofs of the milestones; lemmas on the chosen collection (monotonicity, decomposition along a sequence); the count of the block family; and the padding construction of Proposition 4.2. The online-algorithm model is reusable for other deterministic online covering lower bounds.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM J. Comput. 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The online set cover problem, Proc. 35th ACM STOC, 2003, pp. 100–105. https://doi.org/10.1145/780542.780558
  • U. Feige, A threshold of ln n for approximating set cover, J. ACM 45(4):634–652, 1998. https://doi.org/10.1145/285055.285059
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
6 thms2 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

The Online Set Cover Problem 1: A Deterministic O(log m log n)-Competitive Algorithm for Unweighted Online Set CoverResearch Paper

Motivation

Set cover asks for the fewest sets from a family S\mathcal SS of mmm subsets of a ground set XXX of nnn elements whose union contains XXX. It is NP-hard, and the best ratio achievable in polynomial time is Θ(log⁡n)\Theta(\log n)Θ(logn) (Feige 1998, doi:10.1145/285055.285059).

Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 39(2), 2009; preliminary version STOC 2003) introduced an online version. The instance (X,S)(X,\mathcal S)(X,S) is known in advance, but an adversary reveals elements one at a time, and each revealed element must be covered at once, by sets that can never be removed later. The set X′⊆XX'\subseteq XX′⊆X of elements that will actually be revealed is unknown. The paper's motivating example is a network of servers: the potential clients and the servers that can serve each client are known, but which clients will request service is not, and every activated server costs money.

The question is how much an algorithm loses against an offline adversary who knows X′X'X′ and covers it with a family COPT\mathcal C_{OPT}COPT​. This mission formalizes the paper's answer for unit costs (Section 2): a deterministic algorithm whose cover is within a factor O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn) of ∣COPT∣|\mathcal C_{OPT}|∣COPT​∣. Section 3 of the paper extends the algorithm to weighted sets and Section 4 proves a nearly matching lower bound; those are separate missions of this series.

Setting

An instance consists of a finite ground set XXX with n=∣X∣n=|X|n=∣X∣ elements and a finite family S\mathcal SS of m=∣S∣m=|\mathcal S|m=∣S∣ sets. For an element jjj, Sj\mathcal S_jSj​ is the collection of sets containing jjj. Every set has cost 111, so the cost of a family is its number of members.

The adversary gives a sequence σ\sigmaσ of elements (the given elements form X′X'X′). A family COPT⊆S\mathcal C_{OPT}\subseteq\mathcal SCOPT​⊆S covers σ\sigmaσ if each element of σ\sigmaσ lies in some member of it.

The algorithm keeps a weight wS>0w_S>0wS​>0 for every set, initially wS=1/(2m)w_S=1/(2m)wS​=1/(2m), and a cover C\mathcal CC, initially empty. The weight of an element is wj=∑S∈SjwSw_j=\sum_{S\in\mathcal S_j}w_Swj​=∑S∈Sj​​wS​, and CCC is the set of elements covered by members of C\mathcal CC. The potential is

Φ=∑j∉Cn2wj.\Phi=\sum_{j\notin C}n^{2w_j}.Φ=j∈/C∑​n2wj​.

When the adversary gives an element jjj:

  1. if wj≥1w_j\ge1wj​≥1, nothing changes;
  2. otherwise a weight augmentation is performed: (a) kkk is the minimal integer with 2kwj>12^k w_j>12kwj​>1; (b) every S∈SjS\in\mathcal S_jS∈Sj​ gets the weight 2kwS2^k w_S2kwS​; (c) at most 4log⁡n4\log n4logn sets from Sj\mathcal S_jSj​ are added to C\mathcal CC, so that Φ\PhiΦ does not exceed its value before the augmentation.

Step (c) prescribes a property of the chosen sets, not the sets themselves. A run on σ\sigmaσ is any sequence of iterations, one per arrival, in which every iteration makes an admissible choice.

Formalization targets

Goal: Theorem 2.3

For n≥2n\ge2n≥2, every arrival sequence σ\sigmaσ, and every family COPT\mathcal C_{OPT}COPT​ covering σ\sigmaσ: a run of the algorithm on σ\sigmaσ exists, and every run ends with a cover C\mathcal CC that covers every element of σ\sigmaσ and satisfies

∣C∣  ≤  ⌈4ln⁡n⌉⋅∣COPT∣⋅(log⁡2m+2).|\mathcal C|\;\le\;\lceil 4\ln n\rceil\cdot|\mathcal C_{OPT}|\cdot(\log_2 m+2).∣C∣≤⌈4lnn⌉⋅∣COPT​∣⋅(log2​m+2).

The paper states ∣C∣=O(∣COPT∣log⁡mlog⁡n)|\mathcal C|=O(|\mathcal C_{OPT}|\log m\log n)∣C∣=O(∣COPT​∣logmlogn); the displayed bound is the constant its proof produces. Because the bound holds for every covering family, it holds in particular for an optimal one.

Milestones

Lemma 2.1. In every run, the number of iterations with a weight augmentation is at most

∣COPT∣⋅(log⁡2m+2).|\mathcal C_{OPT}|\cdot(\log_2 m+2).∣COPT​∣⋅(log2​m+2).

Lemma 2.2. In an iteration with a weight augmentation, from a state with positive weights, there is a family F⊆SjF\subseteq\mathcal S_jF⊆Sj​ with ∣F∣≤⌈4ln⁡n⌉|F|\le\lceil4\ln n\rceil∣F∣≤⌈4lnn⌉ such that

Φe≤Φs,\Phi_e\le\Phi_s,Φe​≤Φs​,

where Φs\Phi_sΦs​ is the potential before the iteration and Φe\Phi_eΦe​ the potential after it, computed with the augmented weights and the cover C∪F\mathcal C\cup FC∪F.

Significance

The theorem shows that online set cover over a known instance admits a deterministic O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn)-competitive algorithm. Section 4 of the paper shows this is nearly optimal: no deterministic algorithm achieves o ⁣(log⁡mlog⁡nlog⁡log⁡m+log⁡log⁡n)o\!\left(\frac{\log m\log n}{\log\log m+\log\log n}\right)o(loglogm+loglognlogmlogn​) over a wide range of parameters. Its multiplicative weight updates were developed further into the online primal–dual framework for covering problems of Buchbinder and Naor (FnT TCS 3(2–3), 2009), whose Section 5.1 restates this algorithm.

The result is proved in the paper; it is not machine-checked. The Prove2Me platform has the weighted version's final counting step from the Buchbinder–Naor monograph, but no statement of Section 2. A complete development here gives a checked proof of the unweighted competitive ratio with an explicit constant, together with a reusable formal model of an online algorithm with a nondeterministic step, whose correctness includes the existence of an admissible choice at every step.

Difficulty

The central step is Lemma 2.2: a family of at most ⌈4ln⁡n⌉\lceil4\ln n\rceil⌈4lnn⌉ sets that keeps the potential from increasing must exist at every augmentation. The obvious rules fail. Adding every set of Sj\mathcal S_jSj​ can exceed the cardinality bound, since Sj\mathcal S_jSj​ may contain up to mmm sets. Adding nothing, or a single set, can increase Φ\PhiΦ: every uncovered element sharing a set with jjj has its weight raised, and its term n2wn^{2w}n2w grows by a factor up to n2δn^{2\delta}n2δ. The paper's argument is non-constructive, and a formal proof must establish existence for a finite averaging statement over real powers of nnn.

The second difficulty is that the algorithm is nondeterministic. A statement "every run has property P" is empty if no run exists, and the existence of a run is exactly Lemma 2.2 applied at every step under the invariants that weights stay positive and that each arriving element lies in some set. Feasibility (that every given element ends up covered) is not part of the algorithm's rule; it follows from the potential never increasing, which needs n≥2n\ge2n≥2 and a careful treatment of the initial potential, which is at most n2n^2n2 and equals n2n^2n2 when every element lies in every set.

Formalization scope

The instance is the published OnlinePrimalDual.OnlineSetCover.SetCoverInstance (finite types E of elements and T of set indices, incidence elemSets), with the published elementWeight (wjw_jwj​) and coveredBy (j∈Cj\in Cj∈C). Its positive cost field is not used: all sets have unit cost and the cover is measured by its cardinality. n=∣E∣n=|E|n=∣E∣ and m=∣T∣m=|T|m=∣T∣. Weights are real numbers; n2wjn^{2w_j}n2wj​ is the real power.

The algorithm is the definition OnlineSetCover.Unweighted.Algorithm: a relation Step for one iteration (recording whether a weight augmentation occurred) and Run for a sequence of iterations from the initial state, counting augmentations. Arrival sequences are lists and may repeat elements.

Explicit forms of the paper's asymptotic and unspecified quantities:

  • the paper's "4log⁡n4\log n4logn" sets per augmentation is ⌈4ln⁡n⌉\lceil 4\ln n\rceil⌈4lnn⌉ (natural logarithm, rounded up: the proof repeats a random choice that many times and needs (1−δ/2)4log⁡n≤n−2δ(1-\delta/2)^{4\log n}\le n^{-2\delta}(1−δ/2)4logn≤n−2δ);
  • Lemma 2.1's log⁡m+2\log m+2logm+2 is log⁡2m+2=log⁡2(4m)\log_2 m+2=\log_2(4m)log2​m+2=log2​(4m) (weights grow from 1/(2m)1/(2m)1/(2m) to at most 222 by factors at least 222);
  • Theorem 2.3's O(∣COPT∣log⁡mlog⁡n)O(|\mathcal C_{OPT}|\log m\log n)O(∣COPT​∣logmlogn) is ⌈4ln⁡n⌉⋅∣COPT∣⋅(log⁡2m+2)\lceil4\ln n\rceil\cdot|\mathcal C_{OPT}|\cdot(\log_2 m+2)⌈4lnn⌉⋅∣COPT​∣⋅(log2​m+2);
  • kkk ranges over natural numbers; for wj<1w_j<1wj​<1 the minimal integer with 2kwj>12^kw_j>12kwj​>1 is one;
  • the paper's remark "(Clearly, 2k⋅wj<22^k\cdot w_j<22k⋅wj​<2.)" is not encoded; the correct bound is ≤2\le2≤2 (wj=1/2w_j=1/2wj​=1/2 gives k=2k=2k=2) and is not a hypothesis anywhere.

The goal adds the hypothesis n≥2n\ge2n≥2, which the paper's log⁡n\log nlogn assumes tacitly: for n=1n=1n=1 no set may be added and the element is never covered.

Replacing the algorithm by the set of states whose potential is at most the initial one, or dropping the existence of a run from the goal, gives a weaker theorem; part (a) of the goal rules this out.

A complete development needs elementary real analysis (Real.rpow, Real.log, 1−x≤e−x1-x\le e^{-x}1−x≤e−x), a finite probabilistic or averaging argument for Lemma 2.2, and induction over runs. Contributions are welcome on any milestone; a derandomized averaging lemma for Lemma 2.2 would be reusable in the weighted mission of this series.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM J. Comput. 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • U. Feige, A Threshold of ln n for Approximating Set Cover, J. ACM 45(4):634–652, 1998. https://doi.org/10.1145/285055.285059
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
7 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimizationTheoretical Computer Science·Captain: mikedeng1

A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization 1: Deterministic Double Greedy Achieves 1/3 of the OptimumResearch Paper

Motivation

A set function f:2N→Rf : 2^{\mathcal N} \to \mathbb Rf:2N→R on a finite ground set N\mathcal NN is submodular if it has diminishing returns, equivalently if f(A)+f(B)≥f(A∪B)+f(A∩B)f(A) + f(B) \ge f(A \cup B) + f(A \cap B)f(A)+f(B)≥f(A∪B)+f(A∩B) for all A,B⊆NA, B \subseteq \mathcal NA,B⊆N. Cut functions of graphs and hypergraphs, coverage functions, entropy, and many facility-location and welfare objectives are submodular. Unconstrained Submodular Maximization (USM) asks, given a nonnegative submodular fff through a value oracle, for a set S⊆NS \subseteq \mathcal NS⊆N of maximum value. It contains Max-Cut, Max-DiCut and Max Facility Location as special cases, and it is a subroutine in algorithms for constrained submodular maximization.

Timeline:

  • Feige, Mirrokni and Vondrák (FOCS 2007; SIAM J. Comput. 2011) gave a uniformly random set achieving 1/41/41/4 of the optimum, a deterministic local search achieving 1/3−ε/n1/3 - \varepsilon/n1/3−ε/n, a randomized local search achieving 2/52/52/5, and proved that no algorithm making polynomially many value queries achieves 1/2+ε1/2 + \varepsilon1/2+ε.
  • Oveis Gharan and Vondrák (SODA 2011) improved the ratio to about 0.410.410.41 by simulated annealing; Feldman, Naor and Schwartz (ICALP 2011) to about 0.420.420.42.
  • Buchbinder, Feldman, Naor and Schwartz (FOCS 2012; SIAM J. Comput. 2015) gave the double greedy algorithms: a deterministic linear-time 1/31/31/3-approximation (this mission) and a randomized linear-time 1/21/21/2-approximation, matching the query lower bound.

Setting

Let N\mathcal NN be a finite ground set and f:2N→R≥0f : 2^{\mathcal N} \to \mathbb R_{\ge 0}f:2N→R≥0​ a nonnegative submodular function. Write f(OPT)=max⁡S⊆Nf(S)f(OPT) = \max_{S \subseteq \mathcal N} f(S)f(OPT)=maxS⊆N​f(S), and let OPTOPTOPT denote a set attaining it.

Algorithm 1 (DeterministicUSM) fixes an arbitrary order u1,…,unu_1, \dots, u_nu1​,…,un​ of N\mathcal NN and maintains two solutions, starting from X0=∅X_0 = \emptysetX0​=∅ and Y0=NY_0 = \mathcal NY0​=N. In iteration i=1,…,ni = 1, \dots, ni=1,…,n it computes

ai=f(Xi−1∪{ui})−f(Xi−1),bi=f(Yi−1∖{ui})−f(Yi−1).a_i = f(X_{i-1} \cup \{u_i\}) - f(X_{i-1}), \qquad b_i = f(Y_{i-1} \setminus \{u_i\}) - f(Y_{i-1}).ai​=f(Xi−1​∪{ui​})−f(Xi−1​),bi​=f(Yi−1​∖{ui​})−f(Yi−1​).

If ai≥bia_i \ge b_iai​≥bi​ it sets Xi=Xi−1∪{ui}X_i = X_{i-1} \cup \{u_i\}Xi​=Xi−1​∪{ui​}, Yi=Yi−1Y_i = Y_{i-1}Yi​=Yi−1​; otherwise Xi=Xi−1X_i = X_{i-1}Xi​=Xi−1​, Yi=Yi−1∖{ui}Y_i = Y_{i-1} \setminus \{u_i\}Yi​=Yi−1​∖{ui​}. A tie adds uiu_iui​. After nnn iterations Xn=YnX_n = Y_nXn​=Yn​, which is the output.

The analysis uses the hybrid sets OPTi=(OPT∪Xi)∩YiOPT_i = (OPT \cup X_i) \cap Y_iOPTi​=(OPT∪Xi​)∩Yi​, which agree with XiX_iXi​ and YiY_iYi​ on u1,…,uiu_1, \dots, u_iu1​,…,ui​ and with OPTOPTOPT on ui+1,…,unu_{i+1}, \dots, u_nui+1​,…,un​. In Lean, the run is state f l i, the state (Xi,Yi)(X_i, Y_i)(Xi​,Yi​) after the first iii entries of the order l, and OPTiOPT_iOPTi​ is optI O (state f l i).

Formalization targets

Goal: Theorem I.1

For every nonnegative submodular fff and every order of N\mathcal NN,

Xn=Ynandf(OPT)≤3 f(Xn).X_n = Y_n \qquad\text{and}\qquad f(OPT) \le 3\, f(X_n).Xn​=Yn​andf(OPT)≤3f(Xn​).

Milestones

  1. Lemma II.1. For every 1≤i≤n1 \le i \le n1≤i≤n, ai+bi≥0a_i + b_i \ge 0ai​+bi​≥0.
  2. The hybrid sequence. OPTiOPT_iOPTi​ agrees with Xi,YiX_i, Y_iXi​,Yi​ on u1,…,uiu_1, \dots, u_iu1​,…,ui​ and with OPTOPTOPT on the rest; OPT0=OPTOPT_0 = OPTOPT0​=OPT and OPTn=Xn=YnOPT_n = X_n = Y_nOPTn​=Xn​=Yn​.
  3. Lemma II.2. For every 1≤i≤n1 \le i \le n1≤i≤n,
f(OPTi−1)−f(OPTi)≤[f(Xi)−f(Xi−1)]+[f(Yi)−f(Yi−1)].f(OPT_{i-1}) - f(OPT_i) \le [f(X_i) - f(X_{i-1})] + [f(Y_i) - f(Y_{i-1})].f(OPTi−1​)−f(OPTi​)≤[f(Xi​)−f(Xi−1​)]+[f(Yi​)−f(Yi−1​)].
  1. The telescoped display. f(OPT0)−f(OPTn)≤[f(Xn)−f(X0)]+[f(Yn)−f(Y0)]≤f(Xn)+f(Yn)f(OPT_0) - f(OPT_n) \le [f(X_n) - f(X_0)] + [f(Y_n) - f(Y_0)] \le f(X_n) + f(Y_n)f(OPT0​)−f(OPTn​)≤[f(Xn​)−f(X0​)]+[f(Yn​)−f(Y0​)]≤f(Xn​)+f(Yn​).
  2. Theorem II.3 (tightness). For every ε>0\varepsilon > 0ε>0 there is a nonnegative submodular fff with f(OPT)>0f(OPT) > 0f(OPT)>0 and an order on which f(Xn)≤(1/3+ε) f(OPT)f(X_n) \le (1/3 + \varepsilon)\, f(OPT)f(Xn​)≤(1/3+ε)f(OPT).

Significance

The result. Algorithm 1 is the deterministic member of the double greedy family. It makes one pass over the ground set with four value queries per element, and it guarantees 1/31/31/3 of the optimum for every order, without the polynomial-but-large running time and the ε/n\varepsilon/nε/n loss of local search. Its analysis, which charges the decrease of f(OPTi)f(OPT_i)f(OPTi​) to the increases of f(Xi)f(X_i)f(Xi​) and f(Yi)f(Y_i)f(Yi​), is the template the paper then refines into the randomized 1/21/21/2-approximation (Theorem I.2) and its continuous counterpart on the multilinear extension. Theorem II.3 shows that 1/31/31/3 is the exact ratio of this algorithm, so the improvement to 1/21/21/2 requires randomization (or a different deterministic rule) rather than a sharper analysis.

Formalizing it. The theorem is proved in the paper; to our knowledge it has no machine-checked proof. The mission produces a formal statement of the algorithm as printed, a checked proof of its guarantee for every order, and a checked tight instance. The definitions of the run and of OPTiOPT_iOPTi​ are the same objects the randomized and fractional analyses reason about, so a complete development here is the first step toward the paper's main theorem.

Difficulty

The individual inequalities are short; the difficulty lies in the bookkeeping. Each step needs the invariants Xi−1⊆Yi−1X_{i-1} \subseteq Y_{i-1}Xi−1​⊆Yi−1​ and ui∈Yi−1∖Xi−1u_i \in Y_{i-1} \setminus X_{i-1}ui​∈Yi−1​∖Xi−1​, which follow from the order being an enumeration (no repetitions, every element present), and the identification of OPTiOPT_iOPTi​ from OPTi−1OPT_{i-1}OPTi−1​ in each branch of the algorithm. Summing Lemma II.2 needs a telescoping over the run defined as a fold. The naive idea of comparing f(Xn)f(X_n)f(Xn​) with f(OPT)f(OPT)f(OPT) directly, without the hybrid sets, gives no bound: the greedy choices are made against XXX and YYY, not against OPTOPTOPT. For Theorem II.3 the difficulty is producing an explicit instance, checking that it is submodular and nonnegative, and tracing the run, including the ties, which the algorithm resolves by adding.

Formalization scope

  • The ground set is a finite type X with decidable equality; subsets are Finset X; fff is real valued, Finset X → ℝ, and nonnegativity is the hypothesis ∀ S, 0 ≤ f S where the page uses it (the goal, the telescoped display and the tight example). Lemma II.1, Lemma II.2 and the hybrid-sequence milestone do not assume it.
  • Submodularity is the lattice form f(A)+f(B)≥f(A∪B)+f(A∩B)f(A) + f(B) \ge f(A \cup B) + f(A \cap B)f(A)+f(B)≥f(A∪B)+f(A∩B) of the paper's footnote 1, through the published definition NonmonotoneSubmod.Shared.Submodular. The paper's main-text sentence ("for every A⊆B⊆NA \subseteq B \subseteq \mathcal NA⊆B⊆N and u∈Nu \in \mathcal Nu∈N") would force monotonicity when u∈B∖Au \in B \setminus Au∈B∖A and is read as the footnote. f(OPT)f(OPT)f(OPT) is the published NonmonotoneSubmod.Shared.OPT f, the maximum of fff over all subsets.
  • The order u1,…,unu_1, \dots, u_nu1​,…,un​ is a list l with l.Nodup and ∀ x, x ∈ l; uiu_iui​ is l[i - 1]. Every statement quantifies over all such lists. No nonemptiness of N\mathcal NN is assumed: for an empty ground set the goal reads f(∅)≤3f(∅)f(\emptyset) \le 3 f(\emptyset)f(∅)≤3f(∅).
  • The tie rule is line 5's ai≥bia_i \ge b_iai​≥bi​: ties add uiu_iui​.
  • Where a milestone mentions an optimal solution, it takes a set O with ∀ S, f S ≤ f O.
  • The goal is stated multiplied out, f(OPT)≤3f(Xn)f(OPT) \le 3 f(X_n)f(OPT)≤3f(Xn​), because f(OPT)f(OPT)f(OPT) may be 000.
  • Trivializing formalizations ruled out. The paper's Theorem I.1 reads "there exists a deterministic linear time (1/3)(1/3)(1/3)-approximation algorithm"; without the running time that existential is satisfied by exhaustive search, so the goal is the guarantee of the printed Algorithm 1 for every order. Running time is not formalized: the algorithm evaluates fff on four sets per element, nnn elements in all. Theorem II.3 requires f(OPT)>0f(OPT) > 0f(OPT)>0, without which f≡0f \equiv 0f≡0 would satisfy it.
  • Needed infrastructure: elementary lemmas on List.foldl over List.take, on membership in the states of the run, and on telescoping sums over 1≤i≤n1 \le i \le n1≤i≤n. A reusable lemma "the run keeps Xi⊆YiX_i \subseteq Y_iXi​⊆Yi​ and decides exactly u1,…,uiu_1, \dots, u_iu1​,…,ui​" would serve all three missions of this paper. Contributions of proofs of any milestone, of the goal from the milestones, and of the tight instance (e.g. the paper's five-vertex directed cut function) are welcome.

Selected references

  • N. Buchbinder, M. Feldman, J. Naor, R. Schwartz, A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization, FOCS 2012. https://doi.org/10.1109/FOCS.2012.73 (journal version: SIAM J. Comput. 44(5), 2015, https://doi.org/10.1137/130929205)
  • U. Feige, V. S. Mirrokni, J. Vondrák, Maximizing Non-monotone Submodular Functions, SIAM J. Comput. 40(4), 2011. https://doi.org/10.1137/090779346
  • S. Oveis Gharan, J. Vondrák, Submodular Maximization by Simulated Annealing, SODA 2011. https://doi.org/10.1137/1.9781611973082.83
  • M. Feldman, J. Naor, R. Schwartz, Nonmonotone Submodular Maximization via a Structural Continuous Greedy Algorithm, ICALP 2011. https://doi.org/10.1007/978-3-642-22006-7_29
9 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Project Scheduling with Time Windows and Scarce Resources V: A Schedule Is Inventory-Feasible iff It Resolves Every Minimal Surplus and Shortage SetTextbook

Motivation

In make-to-order production, chemical process industries and other manufacturing settings modelled as projects, activities do not only occupy machines for a while: they also consume intermediate products at their start and deposit products into storage facilities at their completion. Storage is bounded above by a tank or warehouse capacity and below by a safety stock. Resources of this kind are called cumulative resources (or inventory resources, reservoirs in the constraint-programming literature). They were introduced into resource-constrained project scheduling by Neumann and Schwindt (2002), and Chapter 2 of Neumann, Schwindt and Zimmermann, Project Scheduling with Time Windows and Scarce Resources (2nd ed., Springer 2003), develops their theory in §2.12.

A scheduler handling cumulative resources needs a finite combinatorial description of which schedules respect the inventory bounds at every instant, because the time axis is continuous and cannot be checked point by point in a search procedure. Theorem 2.12.4 of the book gives such a description, and it is the basis of the branch-and-bound procedure of Neumann and Schwindt for the problem PSc∣temp∣Cmax⁡PSc|temp|C_{\max}PSc∣temp∣Cmax​.

Setting

A project consists of activities V={0,1,…,n+1}V=\{0,1,\dots,n+1\}V={0,1,…,n+1} with n≥1n\ge 1n≥1, where 000 is the project beginning and n+1n+1n+1 the project completion. Activity iii has an integer duration pi≥0p_i\ge 0pi​≥0, with p0=pn+1=0p_0=p_{n+1}=0p0​=pn+1​=0 and pi>0p_i>0pi​>0 for the real activities.

For each cumulative resource kkk in a set Rγ\mathcal R^\gammaRγ, every activity iii has an integer demand rikr_{ik}rik​. If rik<0r_{ik}<0rik​<0, activity iii withdraws −rik-r_{ik}−rik​ units of kkk at its start; if rik>0r_{ik}>0rik​>0, it deposits rikr_{ik}rik​ units at its completion; rik=0r_{ik}=0rik​=0 means kkk is not used. The demand r0kr_{0k}r0k​ of the project beginning is the initial stock. Write Vk−={i∣rik<0}V_k^-=\{i\mid r_{ik}<0\}Vk−​={i∣rik​<0} and Vk+={i∣rik>0}V_k^+=\{i\mid r_{ik}>0\}Vk+​={i∣rik​>0}. Each resource has a safety stock R‾k∈Z\underline R_k\in\mathbb ZR​k​∈Z and a storage capacity R‾k∈Z\overline R_k\in\mathbb ZRk​∈Z.

A schedule is a vector S=(Si)i∈VS=(S_i)_{i\in V}S=(Si​)i∈V​ of real start times with S0=0S_0=0S0​=0 and Si≥0S_i\ge 0Si​≥0. The active set and the inventory of kkk at time t≥0t\ge 0t≥0 are

Ak(S,t)={i∈Vk−∣Si≤t}∪{i∈Vk+∣Si+pi≤t},rk(S,t)=∑i∈Ak(S,t)rik.\mathcal A_k(S,t)=\{i\in V_k^-\mid S_i\le t\}\cup\{i\in V_k^+\mid S_i+p_i\le t\},\qquad r_k(S,t)=\sum_{i\in\mathcal A_k(S,t)} r_{ik}.Ak​(S,t)={i∈Vk−​∣Si​≤t}∪{i∈Vk+​∣Si​+pi​≤t},rk​(S,t)=i∈Ak​(S,t)∑​rik​.

The schedule is inventory-feasible if R‾k≤rk(S,t)≤R‾k\underline R_k\le r_k(S,t)\le\overline R_kR​k​≤rk​(S,t)≤Rk​ for all kkk and all t≥0t\ge 0t≥0.

Two standing assumptions of the section are used throughout: (2.12.1) R‾k≤∑i∈Vrik≤R‾k\underline R_k\le\sum_{i\in V}r_{ik}\le\overline R_kR​k​≤∑i∈V​rik​≤Rk​, so the final inventory is admissible; and Remark 2.12.2, R‾k≤0≤R‾k\underline R_k\le 0\le\overline R_kR​k​≤0≤Rk​.

A nonempty F⊆VF\subseteq VF⊆V is a kkk-surplus set if ∑i∈Frik>R‾k\sum_{i\in F}r_{ik}>\overline R_k∑i∈F​rik​>Rk​, and a kkk-shortage set if ∑i∈Frik<R‾k\sum_{i\in F}r_{ik}<\underline R_k∑i∈F​rik​<R​k​. A kkk-surplus set FFF is minimal if no kkk-surplus set arises from FFF by removing a nonempty set of replenishing activities, and none arises by adding a nonempty set of depleting activities. Minimal kkk-shortage sets are defined with the roles of replenishing and depleting activities exchanged. Fk+\mathcal F_k^+Fk+​ and Fk−\mathcal F_k^-Fk−​ denote the minimal kkk-surplus and kkk-shortage sets.

Formalization targets

Goal: Theorem 2.12.4

A schedule SSS is inventory-feasible if and only if

∀k, ∀F∈Fk+ ∃j∈F, i∉F: rjk>0, rik<0, Sj+pj≥Si,\forall k,\ \forall F\in\mathcal F_k^+\ \exists j\in F,\ i\notin F:\ r_{jk}>0,\ r_{ik}<0,\ S_j+p_j\ge S_i,∀k, ∀F∈Fk+​ ∃j∈F, i∈/F: rjk​>0, rik​<0, Sj​+pj​≥Si​, ∀k, ∀F∈Fk− ∃j∈F, i∉F: rjk<0, rik>0, Sj≥Si+pi.\forall k,\ \forall F\in\mathcal F_k^-\ \exists j\in F,\ i\notin F:\ r_{jk}<0,\ r_{ik}>0,\ S_j\ge S_i+p_i.∀k, ∀F∈Fk−​ ∃j∈F, i∈/F: rjk​<0, rik​>0, Sj​≥Si​+pi​.

Milestones

  1. The invariance claim after Remark 2.12.2 (p. 131): adding the same integer aka_kak​ to r0kr_{0k}r0k​, R‾k\underline R_kR​k​ and R‾k\overline R_kRk​ does not change the set of inventory-feasible schedules.
  2. Lemma 2.12.3 (a): for every kkk-surplus set FFF there is a minimal kkk-surplus set F′F'F′ with ∅≠F′∩Vk+⊆F∩Vk+\emptyset\ne F'\cap V_k^+\subseteq F\cap V_k^+∅=F′∩Vk+​⊆F∩Vk+​ and F′∩Vk−⊇F∩Vk−F'\cap V_k^-\supseteq F\cap V_k^-F′∩Vk−​⊇F∩Vk−​.
  3. Lemma 2.12.3 (b): the shortage counterpart.
  4. Theorem 2.12.4 (a) on its own: the upper constraints rk(S,t)≤R‾kr_k(S,t)\le\overline R_krk​(S,t)≤Rk​ hold for all t≥0t\ge 0t≥0 iff condition (a) holds.
  5. Theorem 2.12.4 (b) on its own: the lower constraints hold for all t≥0t\ge 0t≥0 iff condition (b) holds.

Significance

The theorem turns a constraint over a continuum of time points into finitely many disjunctions, each a choice among precedence relations. An inventory excess caused by a minimal surplus set is removed by a start-to-completion relation Sj+pj≥SiS_j+p_j\ge S_iSj​+pj​≥Si​ (a replenishment is postponed until after a withdrawal starts, equivalently a maximum time lag), and a shortage by a completion-to-start relation Sj≥Si+piS_j\ge S_i+p_iSj​≥Si​+pi​. Consequences stated in the book: the feasible region of PSc∣temp∣Cmax⁡PSc|temp|C_{\max}PSc∣temp∣Cmax​ is a finite union of polyhedra; branching on these relations, organized as pairs of strict orders and reflexive relations, is a complete search scheme; and minimal delaying alternatives for surplus and shortage sets can be enumerated. Because every problem with renewable resources can be rewritten as one with cumulative resources (p. 130), the book also concludes that this union of polyhedra is in general disconnected.

The result is proved in the book (and in Neumann and Schwindt, 2002). To our knowledge it has no machine-checked proof. This mission produces a Lean formalization of the model, of the one-sided minimality notion, and of the two-sided characterization with its supporting lemma.

Difficulty

The combinatorial core is simple to state but easy to state wrongly. The natural first idea, to use inclusion-minimal surplus sets as for renewable resources, gives a different family Fk+\mathcal F_k^+Fk+​ and a false theorem: the book's minimality allows removing only replenishing activities and adding only depleting ones. The existence lemma needs Remark 2.12.2 to keep at least one replenishing activity in the minimal set, and the sufficiency direction needs (2.12.1) to guarantee a depleting activity outside the minimal set. Both membership conditions of the active set are closed at ttt, so activities that deplete or replenish exactly at the critical instant must be counted on the correct side; a half-open reading changes which schedules are feasible. The initial stock r0kr_{0k}r0k​ is handled by the same active-set rule as any other demand, which matters for the invariance claim.

Formalization scope

  • Activities are Fin (n + 2), activity n+1n+1n+1 is Fin.last (n + 1); resources are an arbitrary type K. Demands, safety stocks and capacities are integers (ℤ); start times are reals (ℝ); durations are natural numbers cast to ℝ.
  • The inventory constraints are required for every t≥0t\ge 0t≥0. The book prints (2.12.2) for 0≤t≤dˉ0\le t\le\bar d0≤t≤dˉ, but its proof of Theorem 2.12.4 works with an arbitrary t≥0t\ge 0t≥0 (the necessity half uses the last completion time of a replenishing activity, which need not be at most dˉ\bar ddˉ). The two readings coincide for schedules with Sn+1≤dˉS_{n+1}\le\bar dSn+1​≤dˉ whose activities all finish by Sn+1S_{n+1}Sn+1​.
  • A schedule satisfies S0=0S_0=0S0​=0 and Si≥0S_i\ge 0Si​≥0 and is not required to be time-feasible; time lags play no role in this section's results and are not part of the model.
  • (2.12.1) and Remark 2.12.2 are explicit hypotheses (TotalDemandWithinBounds, BoundsStraddleZero) wherever the book's proofs use them. Surplus and shortage sets are nonempty by definition, and minimality uses proper inclusions.
  • A formalization in which Fk+\mathcal F_k^+Fk+​ is empty or trivial (for instance, minimality with non-strict inclusions, which no set satisfies) makes condition (a) vacuous; the definitions here follow p. 131 exactly, and a concrete instance with a nonempty Fk+\mathcal F_k^+Fk+​ has been checked locally.

Reusable parts: the cumulative-resource model and inventory profile, which later missions on continuous cumulative resources (§2.12.2) or on the NP-completeness of PSc∣temp∣Cmax⁡PSc|temp|C_{\max}PSc∣temp∣Cmax​ (Theorem 2.12.1) can build on. Contributions welcome: proofs of the lemmas, of either half of the theorem, and finite-sum lemmas about Finset.filter that the proofs need.

Selected references

  • K. Neumann, C. Schwindt, J. Zimmermann, Project Scheduling with Time Windows and Scarce Resources, 2nd ed., Springer, 2003, §2.12.1, pp. 128–135. https://doi.org/10.1007/978-3-540-24800-2
  • K. Neumann, C. Schwindt, Project scheduling with inventory constraints, Mathematical Methods of Operations Research 56 (2003) 513–533 (cited in the book as 2002). https://doi.org/10.1007/s001860200251
7 thms2 active usersReviewed
🏆Completed
Graph TheoryOperations ResearchOptimization·Captain: mikedeng1

Project Scheduling with Time Windows and Scarce Resources II: A Time-Feasible Strict Order Is Feasible iff It Breaks Up Every Minimal Forbidden SetTextbook

Motivation

Resource-constrained project scheduling asks for start times of the activities of a project so that prescribed time lags between activities are respected and, at every moment, the activities in progress do not require more of any renewable resource (staff, machines, reactors) than is available. When the time lags include maximum time lags (deadlines relative to other activities), even finding a feasible schedule is NP-hard, and the feasible region is in general neither convex nor connected. Branch-and-bound methods for this problem (the problem PS∣temp∣Cmax⁡PS|temp|C_{\max}PS∣temp∣Cmax​ in the notation of Neumann, Schwindt & Zimmermann) do not search over schedules directly. They search over strict orders of the activities, that is, over sets of precedence constraints "jjj starts after iii has finished".

This mission formalizes the theory behind that search, as developed by Bartusch, Möhring & Radermacher (1988) and presented in §2.3 of Neumann, Schwindt & Zimmermann, Project Scheduling with Time Windows and Scarce Resources (2nd ed., Springer 2003). Its goal, Theorem 2.3.10, says when a strict order resolves every resource conflict.

Setting

A project has activities V={0,1,…,n+1}V = \{0, 1, \dots, n+1\}V={0,1,…,n+1}, where 000 and n+1n+1n+1 are fictitious activities marking the project's start and completion and 1,…,n1, \dots, n1,…,n are the real activities (n≥1n \ge 1n≥1). Activity iii has duration pi∈Z≥0p_i \in \mathbb Z_{\ge 0}pi​∈Z≥0​, with p0=pn+1=0p_0 = p_{n+1} = 0p0​=pn+1​=0 and pi>0p_i > 0pi​>0 for real activities. Time lags are encoded in the project network NNN: an arc ⟨i,j⟩∈E\langle i, j\rangle \in E⟨i,j⟩∈E with integer weight δij\delta_{ij}δij​ imposes Sj−Si≥δijS_j - S_i \ge \delta_{ij}Sj​−Si​≥δij​. The book's standing assumptions give, for every node iii, a path from 000 to iii of nonnegative length and a path from iii to n+1n+1n+1 of length at least pip_ipi​.

A schedule is a vector S∈Rn+2S \in \mathbb R^{n+2}S∈Rn+2 with S0=0S_0 = 0S0​=0 and Si≥0S_i \ge 0Si​≥0. It is time-feasible if Sj−Si≥δijS_j - S_i \ge \delta_{ij}Sj​−Si​≥δij​ for all arcs. The set of time-feasible schedules is ST\mathcal S_TST​.

Each renewable resource k∈Rk \in \mathcal Rk∈R has a capacity RkR_kRk​, and activity iii uses rik≤Rkr_{ik} \le R_krik​≤Rk​ units of it while in progress, with r0k=rn+1,k=0r_{0k} = r_{n+1,k} = 0r0k​=rn+1,k​=0. The active set at time ttt is A(S,t)={i∣Si≤t<Si+pi}\mathcal A(S,t) = \{ i \mid S_i \le t < S_i + p_i\}A(S,t)={i∣Si​≤t<Si​+pi​}, and SSS is resource-feasible if ∑i∈A(S,t)rik≤Rk\sum_{i \in \mathcal A(S,t)} r_{ik} \le R_k∑i∈A(S,t)​rik​≤Rk​ for all kkk and all t≥0t \ge 0t≥0. The feasible region S\mathcal SS consists of the schedules that are both time-feasible and resource-feasible.

A strict order O⊆V×VO \subseteq V \times VO⊆V×V is an asymmetric, transitive relation. Its order polyhedron is

ST(O)={S∈ST∣Sj≥Si+pi for all (i,j)∈O}.\mathcal S_T(O) = \{ S \in \mathcal S_T \mid S_j \ge S_i + p_i \ \text{for all } (i,j) \in O\}.ST​(O)={S∈ST​∣Sj​≥Si​+pi​ for all (i,j)∈O}.

OOO is time-feasible if ST(O)≠∅\mathcal S_T(O) \ne \emptysetST​(O)=∅, and feasible if moreover ST(O)⊆S\mathcal S_T(O) \subseteq \mathcal SST​(O)⊆S. The order network N(O)N(O)N(O) adds to NNN, for each (i,j)∈O(i,j) \in O(i,j)∈O, an arc ⟨i,j⟩\langle i,j\rangle⟨i,j⟩ of weight pip_ipi​, or raises the weight of an existing arc to max⁡(δij,pi)\max(\delta_{ij}, p_i)max(δij​,pi​). A schedule SSS induces the strict order O(S)={(i,j)∣i≠j, Sj≥Si+pi}O(S) = \{(i,j) \mid i \ne j,\ S_j \ge S_i + p_i\}O(S)={(i,j)∣i=j, Sj​≥Si​+pi​}.

A set F⊆VF \subseteq VF⊆V is forbidden if ∑i∈Frik>Rk\sum_{i \in F} r_{ik} > R_k∑i∈F​rik​>Rk​ for some resource kkk. It is a minimal forbidden set if no proper subset of it is forbidden. F\mathcal FF denotes the set of minimal forbidden sets.

Formalization targets

Goal: Theorem 2.3.10 (Bartusch et al. 1988)

For every time-feasible strict order OOO,

O feasible  ⟺  ∀F∈F ∃ i,j∈F: N(O) has a path from i to j of length≥pi.O \text{ feasible} \iff \forall F \in \mathcal F\ \exists\, i, j \in F:\ N(O) \text{ has a path from } i \text{ to } j \text{ of length} \ge p_i .O feasible⟺∀F∈F ∃i,j∈F: N(O) has a path from i to j of length≥pi​.

Milestones

  1. Proposition 2.3.3. A strict order OOO is time-feasible if and only if N(O)N(O)N(O) has no cycle of positive length.
  2. Bartusch et al.'s criterion (quoted in the proof of Theorem 2.3.10). A schedule SSS is resource-feasible if and only if every F∈FF \in \mathcal FF∈F contains distinct i,ji, ji,j with Sj≥Si+piS_j \ge S_i + p_iSj​≥Si​+pi​.
  3. Proposition 2.3.6. For time-feasible SSS, the strict order O(S)O(S)O(S) is feasible if and only if S∈SS \in \mathcal SS∈S.
  4. Theorem 2.3.7. S=⋃O∈OST(O)\mathcal S = \bigcup_{O \in \mathcal O} \mathcal S_T(O)S=⋃O∈O​ST​(O), where O\mathcal OO is the finite set of inclusion-minimal feasible strict orders.
  5. Remark 2.3.11. A time-feasible schedule partitions FFF if and only if every A(S,t)∩F\mathcal A(S,t) \cap FA(S,t)∩F, t≥0t \ge 0t≥0, is feasible. A time-feasible order is feasible if and only if it breaks up all (equivalently, all minimal) forbidden sets. A time-feasible schedule is feasible if and only if it partitions all forbidden sets.

Significance

Theorem 2.3.10 turns the feasibility of a strict order, which is a statement about infinitely many schedules and all times ttt, into a finite check: one longest-path computation in N(O)N(O)N(O) for each minimal forbidden set. Together with Proposition 2.3.3 and the structural Theorem 2.3.7, it shows that S\mathcal SS is a finite union of polyhedra indexed by feasible strict orders. This justifies the enumeration schemes of Chapter 2 of the book (branching on the pairs that break up a minimal forbidden set) and the notions of active and stable schedules developed in later sections.

All results in this mission are proved in the literature. For the resource-feasibility criterion, the book cites Bartusch et al. (1988) instead of proving it. To our knowledge, none of these results has been machine-checked. A formal development would give a verified foundation for the order-based description of the feasible region, on which later missions of this series (active schedules, delaying modes, stable schedules) build.

Difficulty

The sufficiency half of the goal is short once the criterion is available: a path of length ≥pi\ge p_i≥pi​ in N(O)N(O)N(O) forces Sj≥Si+piS_j \ge S_i + p_iSj​≥Si​+pi​ on the whole order polyhedron. The necessity half carries the content. If for some minimal forbidden set FFF no path in N(O)N(O)N(O) between elements of FFF reaches the required length, one must construct a schedule in ST(O)\mathcal S_T(O)ST​(O) in which all activities of FFF are simultaneously in progress. This means adding the reverse constraints Sj−Si<piS_j - S_i < p_iSj​−Si​<pi​ for all i,j∈Fi, j \in Fi,j∈F to the temporal system without creating a cycle of positive length, while keeping S0=0S_0 = 0S0​=0 and S≥0S \ge 0S≥0. The obvious reading "no single arc gives a precedence, so they can overlap" fails because maximum time lags combine into long paths through activities outside FFF. The standing assumption that every node is reachable from 000 by a path of nonnegative length is needed here: without it the equivalence is false.

Formalization scope

  • The activity set is Fin (n + 2): 0 is the project start and Fin.last (n + 1) the project completion. Durations and resource data are natural numbers, arc weights are integers, and start times are real numbers.
  • Strict orders are finite sets of pairs, Finset (Fin (n+2) × Fin (n+2)), required to be asymmetric and transitive.
  • Resource constraints hold for every t≥0t \ge 0t≥0. The book's (2.1.4) writes 0≤t≤dˉ0 \le t \le \bar d0≤t≤dˉ. In Chapter 2 schedules are not bounded by dˉ\bar ddˉ, and the book's proofs and Remark 2.3.11 use all t≥0t \ge 0t≥0. This is a convention of the whole series, not a strengthening.
  • A path is a walk (nodes may repeat) and its length is the sum of its arc weights. A cycle of positive length is a closed walk with at least one arc and positive length. For a time-feasible order, N(O)N(O)N(O) has no cycle of positive length. In that case "some path of length ≥pi\ge p_i≥pi​" coincides with the book's "longest path length ≥pi\ge p_i≥pi​", so no supremum over paths appears.
  • The standing assumptions of the book form a single predicate Project.StandingAssumptions, which is a hypothesis of every theorem: n≥1n \ge 1n≥1; p0=pn+1=0p_0 = p_{n+1} = 0p0​=pn+1​=0 and pi>0p_i > 0pi​>0 otherwise; no loops; r0k=rn+1,k=0r_{0k} = r_{n+1,k} = 0r0k​=rn+1,k​=0 and rik≤Rkr_{ik} \le R_krik​≤Rk​; and the two path conditions of p. 8.
  • Minimal forbidden sets and inclusion-minimal feasible orders use Mathlib's Minimal, taken among forbidden sets and among feasible strict orders respectively.
  • The goal is an equivalence, and both directions are required. Weakening it to sufficiency, or dropping the time-feasibility of OOO or the minimality of FFF, would change the theorem. Keeping the book's cut-off t≤dˉt \le \bar dt≤dˉ would also change it, because a schedule could then have an unresolved conflict after dˉ\bar ddˉ and still be called feasible.
  • Theorem 1.3.3 of Chapter 1 (a time-feasible schedule exists if and only if the network has no cycle of positive length) is needed for Proposition 2.3.3 and is restated here for N(O)N(O)N(O). Chapter 1's mission is drafted separately.
  • Useful infrastructure beyond this mission: longest-path potentials on integer-weighted digraphs without positive cycles (feasibility of difference constraints), and the walk and cycle API on Network. Contributions of this general lemma layer are welcome.

Selected references

  • K. Neumann, C. Schwindt, J. Zimmermann, Project Scheduling with Time Windows and Scarce Resources, 2nd ed., Springer, 2003. https://doi.org/10.1007/978-3-540-24800-2
  • M. Bartusch, R. H. Möhring, F. J. Radermacher, Scheduling project networks with resource constraints and time windows, Annals of Operations Research 16 (1988), 201–240. https://doi.org/10.1007/BF02283745
9 thms2 active usersReviewed
🏆Completed
Discrete GeometryLinear OptimizationOperations Research+1·Captain: mikedeng1

Understanding and Using Linear Programming X: Pairwise Intersecting d-Intervals Have a Transversal of Size 2d²Textbook

Motivation

A basic question of combinatorial geometry asks when a family of sets can be pierced (or stabbed) by few points. For intervals on the real line the answer is classical: if every two of finitely many closed intervals intersect, one point meets all of them, namely the rightmost left endpoint. This is the one-dimensional case of Helly's theorem. The situation changes as soon as the sets are allowed to have holes. Unions of two intervals can intersect pairwise without any point being common to three of them, so no single point suffices, and it is not obvious that any bound depending only on the number of holes exists.

This mission formalizes the answer given in Section 8.6 of Matoušek and Gärtner's Understanding and Using Linear Programming (Springer, 2007): pairwise intersecting unions of ddd intervals can always be pierced by 2d22d^22d2 points. The section uses the result to illustrate a general method of combinatorics, in which a linear programming relaxation of a covering problem is bounded through LP duality and then rounded. The same scheme, a bound on the fractional transversal number followed by a rounding step, appears across discrete geometry and combinatorial optimization.

Timeline.

  • 1970: Gyárfás and Lehel prove that a bound depending only on ddd exists; their bound is exponential in ddd (A Helly-type problem in trees, in Combinatorial Theory and its Applications, North-Holland).
  • 1992: Alon and Kleitman solve the Hadwiger–Debrunner (p,q)(p,q)(p,q)-problem with a method combining fractional transversals and LP duality (Adv. Math. 96).
  • 1997: Kaiser proves the bound d2d^2d2 using algebraic topology (Discrete Comput. Geom. 18).
  • 1998: Alon gives the short LP-duality proof of the bound 2d22d^22d2 formalized here (Discrete Comput. Geom. 19).
  • 2001: Matoušek shows that the transversal number cannot in general be below a constant multiple of d2/log⁡dd^2/\log dd2/logd (Discrete Comput. Geom. 26).

Setting

Fix an integer d≥1d \ge 1d≥1. A ddd-interval is a union of ddd closed intervals on the real line,

J=[a1,b1]∪⋯∪[ad,bd],ak≤bk.J = [a_1,b_1] \cup \dots \cup [a_d,b_d], \qquad a_k \le b_k .J=[a1​,b1​]∪⋯∪[ad​,bd​],ak​≤bk​.

The numbers aka_kak​ and bkb_kbk​ are the endpoints of JJJ. A finite family J\mathcal JJ of ddd-intervals is pairwise intersecting if J1∩J2≠∅J_1 \cap J_2 \ne \emptysetJ1​∩J2​=∅ for all J1,J2∈JJ_1, J_2 \in \mathcal JJ1​,J2​∈J. A set XXX of real numbers is a transversal of J\mathcal JJ if every J∈JJ \in \mathcal JJ∈J contains a point of XXX.

More generally, for a finite set VVV and a system F\mathcal FF of subsets of VVV: a transversal is a set X⊆VX \subseteq VX⊆V meeting every member; the transversal number τ(F)\tau(\mathcal F)τ(F) is the smallest size of a transversal; a matching is a subsystem of pairwise disjoint members, and the matching number ν(F)\nu(\mathcal F)ν(F) is the largest size of a matching. The fractional transversal number τ∗(F)\tau^*(\mathcal F)τ∗(F) is the optimal value of the linear program

min⁡∑v∈Vxvs.t.∑v∈Fxv≥1 (F∈F), x≥0,\min \sum_{v\in V} x_v \quad \text{s.t.} \quad \sum_{v \in F} x_v \ge 1 \ (F \in \mathcal F),\ x \ge 0,minv∈V∑​xv​s.t.v∈F∑​xv​≥1 (F∈F), x≥0,

and the fractional matching number ν∗(F)\nu^*(\mathcal F)ν∗(F) is the optimal value of

max⁡∑F∈FyFs.t.∑F: v∈FyF≤1 (v∈V), y≥0.\max \sum_{F\in\mathcal F} y_F \quad \text{s.t.} \quad \sum_{F :\, v \in F} y_F \le 1 \ (v \in V),\ y \ge 0 .maxF∈F∑​yF​s.t.F:v∈F∑​yF​≤1 (v∈V), y≥0.

Formalization targets

Goal: Theorem 8.6.1

J finite, pairwise intersecting family of d-intervals  ⟹  ∃X⊂R, ∣X∣≤2d2, X∩J≠∅  ∀J∈J.\mathcal J \text{ finite, pairwise intersecting family of } d\text{-intervals} \;\Longrightarrow\; \exists X \subset \mathbb R,\ |X| \le 2d^2,\ X \cap J \ne \emptyset \ \ \forall J \in \mathcal J .J finite, pairwise intersecting family of d-intervals⟹∃X⊂R, ∣X∣≤2d2, X∩J=∅  ∀J∈J.

This is the book's theorem with its constant 2d22d^22d2.

Milestones

  1. Lemma 8.6.2. If J1,…,JnJ_1,\dots,J_nJ1​,…,Jn​ (n≥1n \ge 1n≥1, repetitions allowed) are ddd-intervals with Ji∩Jj≠∅J_i \cap J_j \ne \emptysetJi​∩Jj​=∅ for all i,ji,ji,j, then some endpoint of some JiJ_iJi​ lies in at least n/2dn/2dn/2d of the JjJ_jJj​.
  2. §8.6, p. 182. For every finite set system with nonempty members,
ν(F)≤ν∗(F)=τ∗(F)≤τ(F).\nu(\mathcal F) \le \nu^*(\mathcal F) = \tau^*(\mathcal F) \le \tau(\mathcal F).ν(F)≤ν∗(F)=τ∗(F)≤τ(F).
  1. Lemma 8.6.3. If J\mathcal JJ is a finite pairwise intersecting family of ddd-intervals and PPP its set of endpoints, there are weights xp≥0x_p \ge 0xp​≥0, p∈Pp \in Pp∈P, with ∑p∈J∩Pxp≥1\sum_{p \in J \cap P} x_p \ge 1∑p∈J∩P​xp​≥1 for every J∈JJ \in \mathcal JJ∈J and ∑p∈Pxp≤2d\sum_{p\in P} x_p \le 2d∑p∈P​xp​≤2d.

Significance

The result. Theorem 8.6.1 shows that the piercing number of pairwise intersecting ddd-intervals is bounded by a function of ddd alone, and that this function is polynomial. The section also states, without proof, the extension τ(J)≤2d2 ν(J)\tau(\mathcal J) \le 2d^2\,\nu(\mathcal J)τ(J)≤2d2ν(J) for arbitrary finite families of ddd-intervals. Upper bounds of this kind feed into piercing and hitting-set questions for families with bounded "complexity", and the chain ν≤ν∗=τ∗≤τ\nu \le \nu^* = \tau^* \le \tauν≤ν∗=τ∗≤τ is the standard frame in which such bounds are proved.

Formalizing it. The theorem, both lemmas and the duality chain are proved in the literature and in the book. None of them is on the platform. The work consists of formalizing the book's proof: a double-counting argument, LP duality for the pair of fractional programs together with the rationality of an optimal basic solution, and a rounding step. The general-set-system milestone is reusable for any transversal problem, independent of ddd-intervals.

Difficulty

The obvious generalization of the one-dimensional argument fails: for d≥2d \ge 2d≥2 no point need be common to all members, so there is no single extremal endpoint to choose, and a greedy piercing procedure has no control over how many points it uses. The difficulty is to obtain a bound that does not depend on the size of the family. In the book's route the counting statement of Lemma 8.6.2 holds only for equal weights, while the fractional programs produce arbitrary real weights, and the passage between the two, as well as the passage from a fractional transversal of small total weight to an actual finite set of points, are the steps that need care.

Formalization scope

A ddd-interval is stored as data: two functions left, right : Fin d → ℝ with left k ≤ right k, together with the set toSet =⋃k[ak,bk]= \bigcup_k [a_k,b_k]=⋃k​[ak​,bk​]. Components are indexed 0,…,d−10,\dots,d-10,…,d−1. Endpoints are those of the given components, so they depend on the representation, as in the book's proofs. Families are Finsets of such data; Lemma 8.6.2 uses a Fin n-indexed sequence, since the proof of Lemma 8.6.3 applies it to a sequence with repetitions. The hypotheses d≥1d \ge 1d≥1 (the book's definition) and, in Lemma 8.6.2, n≥1n \ge 1n≥1 are explicit. The quantity n/2dn/2dn/2d is real division. Transversal sizes are cardinalities of a Finset ℝ bounded by 2d22d^22d2.

For set systems, VVV is a finite type and F\mathcal FF a Finset (Finset V) with nonempty members; without this assumption no transversal exists and both fractional programs degenerate. The numbers τ∗\tau^*τ∗ and ν∗\nu^*ν∗ are expressed through optimal feasible solutions, not as infima or suprema, so no junk value of an empty or unbounded set is involved. τ\tauτ is an sInf over N\mathbb NN that is attained under the nonemptiness assumption, and ν\nuν is a maximum over the finite family of matchings.

A trivializing formalization is ruled out: the pairwise-intersection hypothesis is satisfiable by nonempty families, the transversal is required to meet the actual sets JJJ, not a representation artifact, and the bound 2d22d^22d2 and 2d2d2d are the book's constants, not weakened ones.

Needed infrastructure: finite sums over Finset ℝ, LP duality for a finite primal–dual pair in inequality form (or a direct proof of the chain), rationality of an optimal vertex, and a left-to-right sweep over a sorted finite set of reals. Contributions of a general LP duality statement for set-system relaxations are welcome and reusable.

Selected references

  • J. Matoušek, B. Gärtner, Understanding and Using Linear Programming, Springer Universitext, 2007, §8.6. https://doi.org/10.1007/978-3-540-30717-4
  • N. Alon, Piercing d-intervals, Discrete Comput. Geom. 19 (1998) 333–334.
  • N. Alon, D. Kleitman, Piercing convex sets and the Hadwiger–Debrunner (p, q)-problem, Adv. Math. 96 (1992) 103–112.
  • T. Kaiser, Transversals of d-intervals, Discrete Comput. Geom. 18 (1997) 195–203.
  • J. Matoušek, Lower bounds on the transversal numbers of d-intervals, Discrete Comput. Geom. 26 (2001) 283–287.
  • A. Gyárfás, J. Lehel, A Helly-type problem in trees, in Combinatorial Theory and its Applications (P. Erdős, A. Rényi, V. T. Sós, eds.), North-Holland, 1970, 571–584.
6 thms2 active usersReviewed
🏆Completed
Information TheoryLinear OptimizationOperations Research+1·Captain: mikedeng1

Understanding and Using Linear Programming VIII: The Delsarte Linear Programming Bound for Binary CodesTextbook

Motivation

A binary error-correcting code is a set of nnn-bit words chosen so that the words stay distinguishable after a few bits have been corrupted in transmission. A code can correct any rrr errors exactly when every two of its words differ in at least 2r+12r+12r+1 positions. The more words the code has, the more information each transmitted block carries. So the central quantitative question of coding theory is how large a code of given length and minimum distance can be. Codes are used in every technology that transmits or stores data, from disks and phones to deep-space probes.

In 1973 Philippe Delsarte showed that an upper bound on this maximum size is the optimum value of an explicit linear program (Delsarte, An algebraic approach to the association schemes of coding theory, Philips Res. Repts. Suppl. 10, 1973). The bound was far stronger than the classical volume argument and remains a standard tool. This mission formalizes the self-contained proof of the bound in §8.4 of Matoušek and Gärtner's textbook (Springer 2007). That proof follows Best, Brouwer, MacWilliams, Odlyzko and Sloane (IEEE Trans. Inform. Theory 24, 1978). The mission also covers the step of Delsarte's original argument that the book isolates as a lemma.

Timeline.

  • 1950: Hamming introduces single-error-correcting codes and the sphere-packing bound.
  • 1973: Delsarte proves the linear programming bound using association schemes.
  • 1978: Best et al. give the elementary parity proof and small improvements, among them A(17,3)≤6552A(17,3) \le 6552A(17,3)≤6552.
  • 2005: Schrijver replaces the linear program by a semidefinite program and improves many entries of the code tables (IEEE Trans. Inform. Theory 51).

Setting

A word is w=(w1,…,wn)∈{0,1}n\mathbf w = (w_1,\dots,w_n) \in \{0,1\}^nw=(w1​,…,wn​)∈{0,1}n, and a code is any set C⊆{0,1}nC \subseteq \{0,1\}^nC⊆{0,1}n. The Hamming distance dH(w,w′)d_H(\mathbf w,\mathbf w')dH​(w,w′) is the number of positions jjj with wj≠wj′w_j \ne w'_jwj​=wj′​. The weight ∣w∣|\mathbf w|∣w∣ is the number of ones in w\mathbf ww. The word w⊕w′\mathbf w \oplus \mathbf w'w⊕w′ is the entrywise sum modulo 2. For I⊆{1,…,n}I \subseteq \{1,\dots,n\}I⊆{1,…,n}, the restricted distance dHI(w,w′)d^I_H(\mathbf w,\mathbf w')dHI​(w,w′) counts only the differing positions that lie in III.

A code has distance ddd if dH(w,w′)≥dd_H(\mathbf w,\mathbf w') \ge ddH​(w,w′)≥d for all distinct w,w′∈C\mathbf w,\mathbf w' \in Cw,w′∈C (Definition 8.4.1). The quantity A(n,d)A(n,d)A(n,d) is the maximum of ∣C∣|C|∣C∣ over all codes C⊆{0,1}nC \subseteq \{0,1\}^nC⊆{0,1}n with distance ddd.

For 0≤i,t≤n0 \le i,t \le n0≤i,t≤n the Krawtchouk numbers are

Kt(n,i)=∑j=0min⁡(i,t)(−1)j(ij)(n−it−j).K_t(n,i) = \sum_{j=0}^{\min(i,t)} (-1)^j \binom ij \binom{n-i}{t-j}.Kt​(n,i)=j=0∑min(i,t)​(−1)j(ji​)(t−jn−i​).

The distance distribution of a code CCC is

x~i(C)=1∣C∣ ∣{(w,w′)∈C2:dH(w,w′)=i}∣,i=0,…,n.\tilde x_i(C) = \frac{1}{|C|}\,\bigl|\{(\mathbf w,\mathbf w')\in C^2 : d_H(\mathbf w,\mathbf w') = i\}\bigr|, \qquad i=0,\dots,n.x~i​(C)=∣C∣1​​{(w,w′)∈C2:dH​(w,w′)=i}​,i=0,…,n.

The Delsarte linear program has variables x0,…,xnx_0,\dots,x_nx0​,…,xn​. It maximizes x0+⋯+xnx_0+\dots+x_nx0​+⋯+xn​ subject to:

  • x0=1x_0 = 1x0​=1;
  • xi=0x_i = 0xi​=0 for 1≤i≤d−11 \le i \le d-11≤i≤d−1;
  • ∑i=0nKt(n,i) xi≥0\sum_{i=0}^n K_t(n,i)\,x_i \ge 0∑i=0n​Kt​(n,i)xi​≥0 for 1≤t≤n1 \le t \le n1≤t≤n;
  • x≥0x \ge 0x≥0.

For Delsarte's original argument, MiM_iMi​ is the 2n×2n2^n\times 2^n2n×2n matrix whose (v,w)(\mathbf v,\mathbf w)(v,w) entry is 111 when dH(v,w)=id_H(\mathbf v,\mathbf w) = idH​(v,w)=i and 000 otherwise. The weights are y~i=∣{(w,w′)∈C2:dH=i}∣/(2n(ni))\tilde y_i = |\{(\mathbf w,\mathbf w')\in C^2 : d_H = i\}| / (2^n\binom ni)y~​i​=∣{(w,w′)∈C2:dH​=i}∣/(2n(in​)).

Formalization targets

Goal: Theorem 8.4.3 (the Delsarte bound)

A(n,d)  ≤  max⁡{∑i=0nxi  :  x feasible for the Delsarte program}for all n,d.A(n,d) \;\le\; \max\Bigl\{\textstyle\sum_{i=0}^n x_i \;:\; x \text{ feasible for the Delsarte program}\Bigr\}\quad\text{for all } n, d.A(n,d)≤max{∑i=0n​xi​:x feasible for the Delsarte program}for all n,d.

The goal is stated against every upper bound vvv of the objective on the feasible set. No particular optimum value is fixed, so the statement covers every nnn and ddd at once.

Milestones, in attack order

  1. Lemma 8.4.5. For every III and CCC, the pairs in C2C^2C2 with even dHId^I_HdHI​ are at least as many as the pairs with odd dHId^I_HdHI​.
  2. Corollary 8.4.6. ∑(w,w′)∈C2(−1)(w⊕w′)Tv≥0\sum_{(\mathbf w,\mathbf w')\in C^2}(-1)^{(\mathbf w\oplus\mathbf w')^T\mathbf v}\ge 0∑(w,w′)∈C2​(−1)(w⊕w′)Tv≥0 for every v\mathbf vv.
  3. Proposition 8.4.4. ∑i=0nKt(n,i) x~i(C)≥0\sum_{i=0}^n K_t(n,i)\,\tilde x_i(C) \ge 0∑i=0n​Kt​(n,i)x~i​(C)≥0 for every CCC and every t=1,…,nt = 1,\dots,nt=1,…,n.
  4. §8.4, p. 160. The values x~i(C)\tilde x_i(C)x~i​(C) sum to ∣C∣|C|∣C∣. For a nonempty code with distance ddd, the vector x~(C)\tilde x(C)x~(C) is feasible for the program.
  5. Lemma 8.4.2 (sphere-packing bound). A(n,2r+1)≤⌊2n/∑i=0r(ni)⌋A(n,2r+1) \le \lfloor 2^n / \sum_{i=0}^r\binom ni\rfloorA(n,2r+1)≤⌊2n/∑i=0r​(in​)⌋.
  6. Lemma 8.4.7. M~=∑i=0ny~iMi\tilde M = \sum_{i=0}^n \tilde y_i M_iM~=∑i=0n​y~​i​Mi​ is positive semidefinite.

Significance

The Delsarte bound turns an extremal problem over the 22n2^{2^n}22n subsets of the cube into a linear program with n+1n+1n+1 variables. For A(17,3)A(17,3)A(17,3) it gives 655365536553, while the sphere-packing bound gives 728172817281. Many entries of the standard code tables rest on this bound or its refinements. The positive semidefiniteness in Lemma 8.4.7 is the starting point of the semidefinite programming bounds of Schrijver and of later work. The same framework also underlies the linear programming bounds for spherical codes and sphere packings.

The theorem is classical and fully proved in the literature. Neither Mathlib nor this platform has a formal statement or proof of it. Mathlib has Hamming distance and binomial coefficients, but it has no A(n,d)A(n,d)A(n,d), no Krawtchouk numbers and no LP bound for codes. This mission would produce the first formal statement and proof. It would also produce reusable identities on Krawtchouk sums and character sums over {0,1}n\{0,1\}^n{0,1}n.

Difficulty

Two of the program's constraints are immediate once x~i\tilde x_ix~i​ is defined: x~0=1\tilde x_0 = 1x~0​=1, and x~i=0\tilde x_i = 0x~i​=0 for i<di < di<d. The difficulty lies in the Krawtchouk constraints. They do not follow from counting pairs at a single distance. They require a sign-weighted count over all words of weight ttt, and the sum must then be regrouped by the distance of each pair. That regrouping identifies a count of words, split by how many ones they share with a fixed word, with the Krawtchouk number. Formally this is an exchange of finite sums together with a binomial counting identity, and the index bookkeeping, including the range j≤min⁡(i,t)j \le \min(i,t)j≤min(i,t), has to be exact.

The obvious attempt proves the inequality one distance class at a time. It fails because the individual terms Kt(n,i) x~iK_t(n,i)\,\tilde x_iKt​(n,i)x~i​ have no sign. Only the whole sum is nonnegative.

Formalization scope

  • Words and codes. Words are Fin n → Bool, with bit 111 as true. The book's positions 1,…,n1,\dots,n1,…,n become 0, …, n-1. Codes are Finsets of words, and dHd_HdH​ is Mathlib's hammingDist.
  • The maximum A(n,d)A(n,d)A(n,d). A(n,d)A(n,d)A(n,d) is a Finset.sup over the finite family of codes with distance ddd. This family contains the empty code, so the maximum is attained.
  • Krawtchouk numbers. Kt(n,i)K_t(n,i)Kt​(n,i) is an integer, and its natural-number subtractions are honest for i≤ni \le ni≤n and j≤tj \le tj≤t.
  • LP variables and the xi=0x_i = 0xi​=0 constraints. The LP variables are indexed by Fin (n+1) with no index shift. The constraints xi=0x_i = 0xi​=0 are imposed for 1≤i<d1 \le i < d1≤i<d, so they are vacuous for d≤1d \le 1d≤1.
  • The empty code. Lean's convention 1/0=01/0 = 01/0=0 gives x~(∅)=0\tilde x(\emptyset) = 0x~(∅)=0. Proposition 8.4.4 then holds trivially, and the feasibility milestone carries the hypothesis C≠∅C \ne \emptysetC=∅ that the book's division presupposes.
  • The sphere-packing floor. The floor in the sphere-packing bound is natural-number division by a denominator that is at least 111.
  • Positive semidefiniteness. This is Mathlib's Matrix.PosSemidef over R\mathbb RR.

No trivialization. The goal is not stated as "A(n,d)≤sup⁡A(n,d) \le \supA(n,d)≤sup" with a real supremum, which Lean would evaluate to 000 on an empty or unbounded set. Its hypothesis ranges over upper bounds of a feasible program: (1,0,…,0)(1,0,\dots,0)(1,0,…,0) is always feasible, so the hypothesis is never vacuous.

Contributions welcome. Useful lemmas include:

  • Krawtchouk identities, for example ∑tKt(n,i)=2n[i=0]\sum_{t}K_t(n,i) = 2^n[i=0]∑t​Kt​(n,i)=2n[i=0] and Ki(n,t)(ni)=Kt(n,i)(nt)K_i(n,t)\binom ni = K_t(n,i)\binom ntKi​(n,t)(in​)=Kt​(n,i)(tn​);
  • counting words of weight ttt that meet a fixed support in exactly jjj positions;
  • general facts on character sums ∑w∈C(−1)wTv\sum_{\mathbf w\in C}(-1)^{\mathbf w^T\mathbf v}∑w∈C​(−1)wTv.

These are reusable for other LP and SDP bounds in coding theory.

Selected references

  • J. Matoušek, B. Gärtner, Understanding and Using Linear Programming, Springer Universitext, 2007, §8.4. https://doi.org/10.1007/978-3-540-30717-4
  • P. Delsarte, An algebraic approach to the association schemes of coding theory, Philips Research Reports Supplements 10, 1973.
  • M. R. Best, A. E. Brouwer, F. J. MacWilliams, A. M. Odlyzko, N. J. A. Sloane, Bounds for binary codes of length less than 25, IEEE Trans. Inform. Theory 24 (1978), 81–93. https://doi.org/10.1109/TIT.1978.1055827
  • A. Schrijver, New code upper bounds from the Terwilliger algebra and semidefinite programming, IEEE Trans. Inform. Theory 51 (2005), 2859–2866. https://doi.org/10.1109/TIT.2005.851748
10 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Understanding and Using Linear Programming VII: LP Rounding Schedules Unrelated Machines Within Twice the Optimal MakespanTextbook

Motivation

Scheduling indivisible jobs on parallel machines to finish all of them as early as possible is a basic problem in operations research and in the theory of algorithms. In the unrelated machines model each job may take a different time on each machine, with no relation between the rows of the time table, as when machines of different types (black-and-white, duplex, colour copiers in the book's example) handle jobs of different kinds. Minimizing the makespan in this model is NP-hard, so the question is how close to the optimum a polynomial-time algorithm can get.

  • 1990. Lenstra, Shmoys and Tardos (Math. Programming 46, 259–271) give a polynomial-time algorithm that rounds a basic optimal solution of a linear programming relaxation and returns a schedule of makespan at most 2 topt2\,t_{\mathrm{opt}}2topt​. The same paper shows that approximating the optimum makespan within a factor less than 3/23/23/2 is NP-hard.
  • 2007. Matoušek and Gärtner present the algorithm in §8.3 of Understanding and Using Linear Programming in a simplified, somewhat less efficient form: minimize t∗(T)+Tt^*(T) + Tt∗(T)+T over the thresholds TTT rather than binary-searching for the smallest TTT with t∗(T)≤Tt^*(T) \le Tt∗(T)≤T. This mission follows the book's presentation.

The gap between 3/23/23/2 and 222 for the general unrelated-machines problem has remained open since 1990; it is the standard example of LP rounding driven by the sparsity of basic solutions.

Setting

There are mmm machines MMM and nnn jobs JJJ; dij>0d_{ij} > 0dij​>0 is the running time of job jjj on machine iii. A schedule is a map σ:J→M\sigma : J \to Mσ:J→M assigning each job to one machine. The load of machine iii is ∑j:σ(j)=idij\sum_{j:\sigma(j)=i} d_{ij}∑j:σ(j)=i​dij​, the makespan of σ\sigmaσ is the largest load, and toptt_{\mathrm{opt}}topt​ is the makespan of an optimal schedule, one whose makespan is at most that of every schedule.

For a real threshold TTT, the linear program LPR(T)\mathrm{LPR}(T)LPR(T) in the variables ttt and xijx_{ij}xij​ is

minimize  tsubject to  ∑i∈Mxij=1  (j∈J),∑j∈Jdijxij≤t  (i∈M),xij≥0,xij=0  whenever dij>T.\begin{aligned} \text{minimize } \ & t \\ \text{subject to } \ & \textstyle\sum_{i \in M} x_{ij} = 1 \ \ (j \in J), \qquad \textstyle\sum_{j \in J} d_{ij} x_{ij} \le t \ \ (i \in M),\\ & x_{ij} \ge 0, \qquad x_{ij} = 0 \ \text{ whenever } d_{ij} > T . \end{aligned}minimize  subject to  ​t∑i∈M​xij​=1  (j∈J),∑j∈J​dij​xij​≤t  (i∈M),xij​≥0,xij​=0  whenever dij​>T.​

Its optimal value is t∗(T)t^*(T)t∗(T), with t∗(T)=∞t^*(T) = \inftyt∗(T)=∞ when LPR(T)\mathrm{LPR}(T)LPR(T) is infeasible. The constraint matrix AAA has one row per machine, one per job and one per pair with dij>Td_{ij} > Tdij​>T; the column of xijx_{ij}xij​ carries dijd_{ij}dij​ in the row of machine iii, 111 in the row of job jjj, and 111 in the row of the constraint xij=0x_{ij} = 0xij​=0 if present. Assumption 8.3.1 on a solution x∗x^*x∗ is that the columns of AAA belonging to its nonzero variables are linearly independent; basic feasible solutions satisfy it. The support graph of x∗x^*x∗ is the bipartite graph G=(M∪J,E)G = (M \cup J, E)G=(M∪J,E) with E={{i,j}:xij∗>0}E = \{\{i,j\} : x^*_{ij} > 0\}E={{i,j}:xij∗​>0}.

Formalization targets

Goal: Theorem 8.3.4

Let T∗T^*T∗ minimize t∗(T)+Tt^*(T) + Tt∗(T)+T over all real TTT and let (t∗,x∗)(t^*, x^*)(t∗,x∗) be an optimal solution of LPR(T∗)\mathrm{LPR}(T^*)LPR(T∗) satisfying Assumption 8.3.1. Then there is a schedule σ\sigmaσ with xσ(j)j∗>0x^*_{\sigma(j) j} > 0xσ(j)j∗​>0 for every job jjj and

max⁡i∈M∑j:σ(j)=idij  ≤  2 topt.\max_{i \in M} \sum_{j : \sigma(j) = i} d_{ij} \;\le\; 2\, t_{\mathrm{opt}} .i∈Mmax​j:σ(j)=i∑​dij​≤2topt​.

Milestones

  1. Lemma 8.3.2. Every subgraph of the support graph GGG has at most as many edges as vertices: ∣E′∣≤∣M′∣+∣J′∣|E'| \le |M'| + |J'|∣E′∣≤∣M′∣+∣J′∣.
  2. Lemma 8.3.3. For T≥0T \ge 0T≥0 and an optimal solution (t∗,x∗)(t^*, x^*)(t∗,x∗) of LPR(T)\mathrm{LPR}(T)LPR(T) satisfying Assumption 8.3.1, some schedule along the edges of GGG has makespan at most t∗+Tt^* + Tt∗+T.
  3. Proof of Theorem 8.3.4, first step. LPR(topt)\mathrm{LPR}(t_{\mathrm{opt}})LPR(topt​) is feasible and t∗(topt)≤toptt^*(t_{\mathrm{opt}}) \le t_{\mathrm{opt}}t∗(topt​)≤topt​.
  4. Proof of Theorem 8.3.4, second step. t∗(T∗)+T∗≤2 toptt^*(T^*) + T^* \le 2\,t_{\mathrm{opt}}t∗(T∗)+T∗≤2topt​.

Significance

The theorem gives a polynomial-time 2-approximation for an NP-hard problem, and its proof isolates a reusable principle: a basic solution of an assignment-type LP has a support graph in which every subgraph has at most as many edges as vertices (a pseudoforest), so all but a matching's worth of the fractional assignment is already integral. The same sparsity argument underlies rounding results for the generalized assignment problem and for many later scheduling and allocation relaxations.

The result has been proved since 1990 and is textbook material. It is not formalized on Prove2Me or, to the maintainers' knowledge, in Mathlib. This mission produces a machine-checked version of the rounding theorem together with the counting lemma on basic solutions, the relaxation inequality t∗(topt)≤toptt^*(t_{\mathrm{opt}}) \le t_{\mathrm{opt}}t∗(topt​)≤topt​, and the bound on the chosen threshold, each stated on shared definitions of the scheduling LP.

Difficulty

The obvious approach, rounding every job to the machine carrying the largest fraction of it, can overload a machine by many jobs at once and gives no constant factor. The bound t∗+Tt^* + Tt∗+T needs two facts that are not visible from the LP value alone: that the support of a basic solution is sparse in the precise sense of Lemma 8.3.2, which has to be read off the linear independence of columns of the constraint matrix after deleting rows; and that the jobs left fractional can be matched injectively to machines, which requires a Hall-type condition derived from that sparsity. Relating linear independence of real column vectors to an edge count in a bipartite graph, and then producing a matching, is where the formal work lies.

A second subtlety is the threshold TTT: the bound t∗+T≤2toptt^* + T \le 2 t_{\mathrm{opt}}t∗+T≤2topt​ holds only because T∗T^*T∗ is chosen by minimizing over thresholds, and the relaxation at T=toptT = t_{\mathrm{opt}}T=topt​ must be compared with the one at T∗T^*T∗ through optimal solutions of different linear programs.

Formalization scope

Machines are Fin m, jobs are Fin n (0-based; the book's machines 1,…,m1,\dots,m1,…,m and jobs m+1,…,m+nm+1,\dots,m+nm+1,…,m+n are disjoint index sets), running times form d : Matrix (Fin m) (Fin n) ℝ, and the standing hypothesis dij>0d_{ij} > 0dij​>0 of §8.3 appears in every theorem. A schedule is a function Fin n → Fin m; the makespan is the supremum of the loads over the finite type Fin m, which is the maximum for m≥1m \ge 1m≥1. The optimum toptt_{\mathrm{opt}}topt​ is the makespan of a schedule assumed optimal, never an infimum.

Optimal values of LPR(T)\mathrm{LPR}(T)LPR(T) are never written as sInf: statements quantify over optimal solutions, i.e. feasible (t,x)(t, x)(t,x) with t≤t′t \le t't≤t′ for every feasible (t′,x′)(t', x')(t′,x′). The book's convention t∗(T)=∞t^*(T) = \inftyt∗(T)=∞ for infeasible LPR(T)\mathrm{LPR}(T)LPR(T) is encoded by letting thresholds without an optimal solution impose no condition in the minimality hypothesis on T∗T^*T∗, which reads t∗+T∗≤t+Tt^* + T^* \le t + Tt∗+T∗≤t+T for every real TTT and every optimal solution (t,x)(t, x)(t,x) of LPR(T)\mathrm{LPR}(T)LPR(T). The constraint matrix used in Assumption 8.3.1 has rows indexed by Fin m ⊕ Fin n ⊕ {(i, j) // T < d i j} and excludes the column of ttt, as on p. 151.

"Efficiently construct" in Lemma 8.3.3 and "computes" in Theorem 8.3.4 are formalized by the property of the constructed schedule, not by its running time: every job goes to a machine iii with xij∗>0x^*_{ij} > 0xij∗​>0. This constraint is what rules out the trivializing formalization — "some schedule has makespan at most 2topt2 t_{\mathrm{opt}}2topt​" is true of the optimal schedule itself and says nothing about the rounding.

A complete development needs: finite linear algebra (a linearly independent family of vectors supported on kkk coordinates has at most kkk members), Hall's marriage theorem (available in Mathlib as Finset.all_card_le_biUnion_card_iff_exists_injective), and the existence of an optimal solution of a feasible, bounded linear program (used to apply the minimality of T∗T^*T∗ at T=toptT = t_{\mathrm{opt}}T=topt​). The counting lemma for basic solutions and the definitions of LPR(T)\mathrm{LPR}(T)LPR(T) are reusable for other assignment relaxations. Proofs of any milestone, and alternative proofs of Lemma 8.3.3 by the direct pseudoforest argument of p. 153–154, are welcome.

Selected references

  • J. Matoušek, B. Gärtner, Understanding and Using Linear Programming, Springer Universitext, 2007, §8.3, pp. 148–156. https://doi.org/10.1007/978-3-540-30717-4
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Mathematical Programming 46 (1990), 259–271. https://doi.org/10.1007/BF01585745
7 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism DesignOperations Research·Captain: mikedeng1

An Introduction to the Theory of Mechanism Design IX: Monotone Direct Mechanisms Are Dictatorial (Gibbard–Satterthwaite)Textbook

Motivation

Voting rules, committee procedures and any other method that turns individual rankings into one collective choice face the same question: can the rule be designed so that no participant ever gains by misreporting their ranking? The Gibbard–Satterthwaite theorem (Gibbard, 1973; Satterthwaite, 1975) answers no. When at least three alternatives can be chosen and all strict rankings are admissible, the only rules immune to manipulation are dictatorships. The result is the starting point of mechanism design without money. It explains why the positive results of the transferable-utility chapters of the book (Groves, VCG, posted prices) depend on quasi-linear preferences, and why research on voting turned to restricted preference domains and weaker solution concepts.

This mission formalizes Chapter 8 of Börgers, An Introduction to the Theory of Mechanism Design (Oxford University Press, 2015), §§8.2–8.3. The book's route to the theorem follows Reny (2001). Strategy-proofness implies Maskin monotonicity, and every monotone rule with full range over at least three alternatives is dictatorial. The second step is the Muller–Satterthwaite theorem (Muller and Satterthwaite, 1977), which is stronger than Gibbard–Satterthwaite because monotonicity is weaker than strategy-proofness. The chapter closes with the classical escape route: on single-peaked preferences (Moulin, 1980) the median voting rule is strategy-proof and not dictatorial.

Timeline. Arrow (1951/1963) proved the impossibility of non-dictatorial preference aggregation under independence of irrelevant alternatives. Gibbard (1973) and Satterthwaite (1975) proved the manipulation version independently, and Satterthwaite showed the two theorems are equivalent. Muller and Satterthwaite (1977) showed that on the full domain strategy-proofness is equivalent to a monotonicity condition (strong positive association). Moulin (1980) characterized strategy-proof rules on single-peaked domains that depend only on reported peaks. Reny (2001) gave the short common proof of Arrow's and the Muller–Satterthwaite theorems that the book follows.

Setting

There is a finite set I={1,…,N}I=\{1,\dots,N\}I={1,…,N} of agents and a finite set AAA of alternatives. Each agent iii has a preference relation RiR_iRi​ over AAA; a Ri ba\,R_i\,baRi​b reads "aaa is weakly preferred to bbb". Every RiR_iRi​ is a linear order: complete, transitive, and the only indifference is among identical alternatives. Its strict part is PiP_iPi​. The set of all linear orders over AAA is R\mathcal RR, and a profile is R=(R1,…,RN)∈RNR=(R_1,\dots,R_N)\in\mathcal R^NR=(R1​,…,RN​)∈RN. (Ri′,R−i)(R_i',R_{-i})(Ri′​,R−i​) is the profile obtained from RRR by replacing agent iii's preference with Ri′R_i'Ri′​.

A direct mechanism is a function f:RN→Af:\mathcal R^N\to Af:RN→A (Definition 8.1). It is

  • dominant strategy incentive-compatible (DSIC) if f(Ri,R−i) Ri f(Ri′,R−i)f(R_i,R_{-i})\,R_i\,f(R_i',R_{-i})f(Ri​,R−i​)Ri​f(Ri′​,R−i​) for all iii, RRR, Ri′R_i'Ri′​ (Definition 8.2);
  • dictatorial if some agent iii satisfies f(R) Ri af(R)\,R_i\,af(R)Ri​a for all profiles RRR and all a∈Aa\in Aa∈A (Definition 8.3);
  • monotone if f(R)=af(R)=af(R)=a and, for every iii, a Ri b⇒a Ri′ ba\,R_i\,b\Rightarrow a\,R_i'\,baRi​b⇒aRi′​b for all bbb, together imply f(R′)=af(R')=af(R′)=a (Definition 8.4);
  • set-monotone if f(R)∈Bf(R)\in Bf(R)∈B and, for every iii, Ri′R_i'Ri′​ differs from RiR_iRi​ only in the ranking of elements of BBB, together imply f(R′)∈Bf(R')\in Bf(R′)∈B (Definition 8.5);
  • unanimity-respecting if f(R)=af(R)=af(R)=a whenever every agent ranks aaa at the top (Definition 8.6).

"The range of fff is AAA" means that every alternative is chosen at some profile.

For §8.3 the alternatives are labelled 1,…,K1,\dots,K1,…,K. A preference is single-peaked if it has a top alternative k(i)k(i)k(i) and declines monotonically to the right and to the left of it. R^\hat{\mathcal R}R^ is the set of single-peaked preferences, and on the restricted domain R^N\hat{\mathcal R}^NR^N DSIC and dictatorship are read with all profiles and deviations taken from R^\hat{\mathcal R}R^.

Formalization targets

Goal: Proposition 8.5 (Muller–Satterthwaite)

∣A∣≥3,f(RN)=A,f monotone ⟹ ∃ i∈I  ∀R∈RN ∀a∈A: f(R) Ri a.|A|\ge 3,\quad f(\mathcal R^N)=A,\quad f\ \text{monotone}\ \Longrightarrow\ \exists\, i\in I\ \ \forall R\in\mathcal R^N\ \forall a\in A:\ f(R)\,R_i\,a.∣A∣≥3,f(RN)=A,f monotone ⟹ ∃i∈I  ∀R∈RN ∀a∈A: f(R)Ri​a.

This is the book's own capstone ("the core of the proof", p.144). No constant needs to be fixed, and the statement is strictly stronger than the necessity half of Gibbard–Satterthwaite.

Milestones

  • Proposition 8.2: DSIC ⇒\Rightarrow⇒ monotone.
  • Proposition 8.3: monotone ⇒\Rightarrow⇒ set-monotone.
  • Proposition 8.4: monotone and full range ⇒\Rightarrow⇒ respects unanimity.
  • Proposition 8.1 (Gibbard–Satterthwaite): for ∣A∣≥3|A|\ge3∣A∣≥3 and full range, fff is DSIC   ⟺  \iff⟺ fff is dictatorial.
  • Proposition 8.6: for ∣A∣≥3|A|\ge3∣A∣≥3 and at least two agents, there is a mechanism on R^N\hat{\mathcal R}^NR^N with range AAA that is DSIC on R^N\hat{\mathcal R}^NR^N and not dictatorial on R^N\hat{\mathcal R}^NR^N.

Significance

The result itself. Proposition 8.5 turns an incentive question into a purely ordinal one: any full-range rule that is Maskin monotone is a dictatorship once three alternatives are available. With Proposition 8.2 it gives Gibbard–Satterthwaite. Proposition 8.6 marks the boundary of the impossibility: with a one-dimensional ordering of alternatives and single-peaked preferences, the median voter rule escapes it.

Formalizing it. All results are classical and proved. The platform already has a proved Gibbard–Satterthwaite theorem (AGT.gibbard_satterthwaite, Algorithmic Game Theory III), derived from Arrow's theorem in the alternative Mathlib environment c5ea0035…. It uses strict-order profiles and a one-agent-deviation monotonicity. This mission adds Maskin monotonicity, the Muller–Satterthwaite theorem, Reny's direct proof route, and the single-peaked possibility result, none of which is on the platform, all in the default environment.

Difficulty

Propositions 8.2–8.4 are short. The difficulty is in Proposition 8.5. Its proof moves one alternative up or down agents' rankings one agent at a time, and it has to keep the chosen alternative pinned at every step using only monotonicity, set-monotonicity and unanimity. It needs a pivotal agent, whose identity depends on the pair of alternatives, and then an argument that the pivots for different alternatives coincide. The argument uses a third alternative ccc in an essential way. With two alternatives the conclusion is false (majority rule), so any argument that never uses ∣A∣≥3|A|\ge3∣A∣≥3 cannot succeed. Formally, each "move bbb just below aaa in agent jjj's ranking" is an explicit construction of a new linear order, together with a check that the monotonicity hypothesis applies. The figures on pp.146–149 describe these orders only partially ("the other alternatives in arbitrary order"). For Proposition 8.6, the obstacle is that DSIC must be checked against every single-peaked misreport, not only misreports of the peak.

Formalization scope

  • A linear order is the structure LinPref A (relation rel, completeness, transitivity, antisymmetry). A profile is ι → LinPref A for a finite agent type ι, and a direct mechanism is (ι → LinPref A) → A. AAA is a Fintype. "The range of fff is AAA" is Function.Surjective f, and ∣A∣≥3|A|\ge3∣A∣≥3 is 3 ≤ Fintype.card A.
  • Monotonicity is the book's Definition 8.4 for arbitrary pairs of profiles, with the lower-contour condition required for each agent separately. Dictatorship is ∃ i, ∀ R a, f R ≥_{R_i} a, with the agent chosen before the profile. A weaker monotonicity (one-agent deviations only) or a weaker dictatorship ("some agent's top is chosen at some profile") would trivialize the goal and is ruled out.
  • §8.3: the labelling is lab : A ≃ Fin K (labels 0,…,K−10,\dots,K-10,…,K−1). The restricted domain is a predicate on LinPref A, and DSIC, dictatorship and full range are relativized to profiles in the domain (IsDSICOn, IsDictatorialOn, HasFullRangeOn). Values of the mechanism off the domain are never consulted.
  • Two corrections of the page. The left-hand clause of single-peakedness is printed as (ℓ−1) Ri ℓ(\ell-1)\,R_i\,\ell(ℓ−1)Ri​ℓ and is used as ℓ Ri (ℓ−1)\ell\,R_i\,(\ell-1)ℓRi​(ℓ−1) (the book's words "decline monotonically to the left"). Proposition 8.6 carries the added hypothesis N≥2N\ge2N≥2, since with one agent every onto strategy-proof rule is dictatorial.
  • Proposition 8.6 is an existence statement. The median voting mechanism is the book's witness, but the statement does not fix it.
  • Reusable beyond this mission: the linear-order profile model, Maskin monotonicity and the restricted-domain notions, which apply to Arrow-type results, implementation theory and Moulin's characterization. Proofs of any milestone, or an independent formal proof of Proposition 8.5, are welcome.

Selected references

  • T. Börgers, An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015, Ch. 8. https://doi.org/10.1093/acprof:oso/9780199734023.001.0001
  • A. Gibbard, "Manipulation of voting schemes: a general result", Econometrica 41 (1973) 587–601. https://doi.org/10.2307/1914083
  • M. A. Satterthwaite, "Strategy-proofness and Arrow's conditions", Journal of Economic Theory 10 (1975) 187–217. https://doi.org/10.1016/0022-0531(75)90050-2
  • E. Muller and M. A. Satterthwaite, "The equivalence of strong positive association and strategy-proofness", Journal of Economic Theory 14 (1977) 412–418. https://doi.org/10.1016/0022-0531(77)90140-5
  • P. J. Reny, "Arrow's theorem and the Gibbard–Satterthwaite theorem: a unified approach", Economics Letters 70 (2001) 99–105. https://doi.org/10.1016/S0165-1765(00)00332-3
  • H. Moulin, "On strategy-proofness and single peakedness", Public Choice 35 (1980) 437–455. https://doi.org/10.1007/BF00128122
  • S. Barberà, "An introduction to strategy-proof social choice functions", Social Choice and Welfare 18 (2001) 619–653. https://doi.org/10.1007/s003550100151
8 thms2 active usersReviewed
🏆Completed
Graph TheoryLinear OptimizationOperations Research+1·Captain: mikedeng1

Linear Programming: Foundations and Extensions III: Network Flows, the Integrality Theorem and König's TheoremTextbook

Motivation

Minimum-cost network flow problems are the largest special class of linear programs met in practice: transportation, distribution, assignment, communication and electric networks, facility location and financial planning all reduce to moving material along the arcs of a directed network from supply nodes to demand nodes at least cost. Chapter 14 of R. J. Vanderbei's Linear Programming: Foundations and Extensions (4th ed., Springer 2014, DOI 10.1007/978-1-4614-7630-6) develops the network simplex method, and closes with two structural facts that explain why this class is special: simplex bases are spanning trees of the network, and a network problem with integer supplies has integer basic solutions. Vanderbei then uses integrality to prove a classical theorem of combinatorics, König's theorem on regular bipartite graphs. Chapter 15, §5 treats the maximum-flow problem on the same objects and proves the Max-Flow Min-Cut Theorem.

The combinatorial results are older than linear programming. D. König proved in 1916 that every regular bipartite graph has a perfect matching (Math. Ann. 77). The Max-Flow Min-Cut Theorem is due to Ford and Fulkerson (1956, Canad. J. Math. 8) and, independently, Elias, Feinstein and Shannon (1956). The integrality of network bases is the total unimodularity of incidence matrices, known since the 1950s (Hoffman and Kruskal, 1956).

Setting

A network (N,A)(N,A)(N,A) has a finite set NNN of mmm nodes and a set of directed arcs A⊆{(i,j):i,j∈N, i≠j}A\subseteq\{(i,j): i,j\in N,\ i\ne j\}A⊆{(i,j):i,j∈N, i=j}. Node iii carries a supply bib_ibi​ (negative values are demands) with ∑ibi=0\sum_i b_i=0∑i​bi​=0, and arc (i,j)(i,j)(i,j) carries a cost cijc_{ij}cij​. The flow xijx_{ij}xij​ on arc (i,j)(i,j)(i,j) is the decision variable. The node–arc incidence matrix AAA has in the column of (i,j)(i,j)(i,j) an entry +1+1+1 in row jjj, −1-1−1 in row iii, and 000 elsewhere. The network flow problem (14.1) is

minimize cTxsubject toAx=−b, x≥0.\text{minimize } c^{T}x\quad\text{subject to}\quad Ax=-b,\ x\ge 0 .minimize cTxsubject toAx=−b, x≥0.

A flow satisfying Ax=−bAx=-bAx=−b is balanced; a balanced flow with x≥0x\ge0x≥0 is feasible. Paths ignore arc directions; the network is connected if every two nodes are joined by a path, which is assumed throughout Chapter 14. A spanning tree is a set of arcs that, on all of NNN and without directions, is connected and has no cycle. Fixing a root node rrr and deleting its row gives the matrix A~\tilde AA~. A set TTT of arcs is a basis if its columns form an invertible square submatrix of A~\tilde AA~, and a basic feasible solution is a feasible flow vanishing off some basis.

For maximum flow, a source sss, a sink ttt and finite upper bounds uiju_{ij}uij​ are given; all bi=0b_i=0bi​=0 and an extra arc (t,s)(t,s)(t,s) of infinite capacity is added. A feasible flow satisfies 0≤xij≤uij0\le x_{ij}\le u_{ij}0≤xij​≤uij​, xts≥0x_{ts}\ge0xts​≥0 and flow balance. A cut is a node set CCC with s∈Cs\in Cs∈C, t∉Ct\notin Ct∈/C, and its capacity is κ(C)=∑(i,j)∈A, i∈C, j∉Cuij\kappa(C)=\sum_{(i,j)\in A,\ i\in C,\ j\notin C}u_{ij}κ(C)=∑(i,j)∈A, i∈C, j∈/C​uij​.

Formalization targets

Goal: König's Theorem (Theorem 14.3, p. 216)

If nnn girls and nnn boys are such that every girl knows exactly k≥1k\ge1k≥1 boys and every boy knows exactly kkk girls (knowing being symmetric), then there is a bijection σ\sigmaσ from girls to boys with

girl i knows boy σ(i)for all i.\text{girl } i \text{ knows boy } \sigma(i)\qquad\text{for all } i .girl i knows boy σ(i)for all i.

Milestones

  1. Theorem 14.1 (p. 205): for a connected network, a set TTT of arcs indexes a basis of A~\tilde AA~ if and only if TTT is a spanning tree.
  2. Theorem 14.2, Integrality Theorem (p. 216): with integer supplies, every basic feasible solution is integral,
xij∈Zfor all (i,j)∈A.x_{ij}\in\mathbb Z\qquad\text{for all }(i,j)\in A .xij​∈Zfor all (i,j)∈A.
  1. Eq. (15.8) (p. 234): xts≤κ(C)x_{ts}\le\kappa(C)xts​≤κ(C) for every feasible flow and every cut.
  2. Theorem 15.1, Max-Flow Min-Cut (p. 234):
max⁡{xts}=min⁡Cκ(C),\max\{x_{ts}\}=\min_C \kappa(C),max{xts​}=Cmin​κ(C),

both extrema attained.

The goal is independent of the network definitions in its statement; the milestones are the book's route to it (14.1, 14.2) and the chapter's other duality theorem on the same objects (15.8, 15.1).

Significance

König's theorem is the base case of matching theory: it gives perfect matchings in regular bipartite graphs, hence edge colourings of bipartite graphs with Δ\DeltaΔ colours, and via Birkhoff–von Neumann-type arguments the decomposition of doubly stochastic matrices. The Integrality Theorem is the reason assignment, transportation and shortest-path problems can be solved as linear programs without an integrality constraint. Theorem 14.1 is the correspondence the network simplex method is built on. Max-Flow Min-Cut is the prototype of combinatorial min–max theorems.

All four theorems are classical and proved. This mission adds machine-checked versions in the book's own formulation: the incidence matrix with Vanderbei's sign convention Ax=−bAx=-bAx=−b, bases as square submatrices of A~\tilde AA~ with a chosen root, and maximum flow as a circulation through an added return arc. The platform already has network integrality, a tree-solution characterisation and max-flow min-cut in the Bertsimas–Tsitsiklis formulation and a Keller–Trotter max-flow statement; none is stated in this form, and Mathlib has Hall's marriage theorem but no regular-bipartite corollary.

Difficulty

The combinatorial content is small; the difficulty is in the passage between matrices and graphs. Theorem 14.1 needs both directions: the book shows that a spanning tree gives a triangularisable, hence invertible, submatrix and leaves the converse (independent columns form a spanning tree) as an exercise, which requires showing that any cycle, including a pair of antiparallel arcs, yields a linearly dependent set of columns and that m−1m-1m−1 acyclic arcs span. The book's proof of König's theorem applies the Integrality Theorem to the girl–boy network, which need not be connected, while Chapter 14 assumes connectedness throughout: the statement of 14.2 does not apply to it verbatim. The step "a feasible problem has a basic optimal solution" is also used and is not stated in the chapter.

Formalization scope

  • Nodes are a Fintype with decidable equality; arcs are a Finset (N × N), so parallel arcs are excluded as in the book, and IsNetwork excludes loops. Flows are real functions on ordered pairs; only their values on arcs matter.
  • "Connected" is preconnectedness of the undirected simple graph of the arcs; a spanning tree is an arc set whose undirected graph is a tree and in which no two arcs join the same pair of nodes.
  • A basis is m−1m-1m−1 linearly independent columns of the (m−1)(m-1)(m−1)-row matrix A~\tilde AA~, the same as an invertible square submatrix. The root rrr is arbitrary, as in the book ("say, the last one").
  • Integer data means integer supplies; costs do not enter Theorem 14.2, since a basic optimal solution is a basic feasible solution.
  • In König's theorem both sides are Fin n, knowing is one relation between girls and boys, and k≥1k\ge1k≥1 is a hypothesis: the book's proof divides by kkk, and for k=0<nk=0<nk=0<n the claim is false. No connectedness is assumed.
  • For maximum flow, the return arc (t,s)(t,s)(t,s) is a separate variable; s≠ts\ne ts=t and uij≥0u_{ij}\ge0uij​≥0 are hypotheses that the book leaves implicit. Maximum and minimum are stated with attainment.
  • No statement involves a constant the book leaves implicit.

A formalization of the goal as a matching of size nnn in some larger graph, or with the degree conditions on one side only, would be a different theorem; the conclusion is a bijection between exactly the nnn girls and the nnn boys using only acquainted pairs.

Useful infrastructure, reusable beyond this mission: the incidence matrix and its total unimodularity, the undirected graph of an arc set. Proofs of König's theorem through Hall's theorem (Mathlib Finset.all_card_le_biUnion_card_iff_exists_injective) are welcome alongside the book's route.

Selected references

  • R. J. Vanderbei, Linear Programming: Foundations and Extensions, 4th ed., Springer, 2014. DOI 10.1007/978-1-4614-7630-6
  • D. König, Über Graphen und ihre Anwendung auf Determinantentheorie und Mengenlehre, Math. Ann. 77 (1916), 453–465. DOI 10.1007/BF01456961
  • L. R. Ford and D. R. Fulkerson, Maximal flow through a network, Canad. J. Math. 8 (1956), 399–404. DOI 10.4153/CJM-1956-045-5
  • A. J. Hoffman and J. B. Kruskal, Integral boundary points of convex polyhedra, in Linear Inequalities and Related Systems, Ann. of Math. Studies 38, Princeton University Press, 1956, 223–246.
7 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Theory of Games and Economic Behavior VI: Splitting Sets and the Decomposition Partition of a GameTextbook

Motivation

Chapter IX of von Neumann and Morgenstern's Theory of Games and Economic Behavior asks when a game played by many participants is really several separate games played side by side. The authors' motivation (41.1) is methodological: the general theory of the nnn-person game becomes unmanageable as nnn grows, and one way to gain insight into large games is to isolate classes of games that can be analysed exactly. The first such class consists of games whose players fall into groups that have no dealings with each other — the book's example is the internal economies of two countries whose connections are disregarded (41.2.4). Such a game is the composition of its constituents, and the question of the chapter is how to recognise a composite game from its characteristic function alone and how far a given game can be decomposed.

The answer (§43) is a structure theorem. The groups of players that can be split off form a Boolean algebra of sets; its atoms, the minimal splitting sets, form a partition of the set of players, the decomposition partition ΠΓ\Pi_\GammaΠΓ​; and every splitting set is a union of blocks of ΠΓ\Pi_\GammaΠΓ​. The book remarks (41.3.3) that the splitting condition (41:7) is exactly Carathéodory's criterion of measurability, transported from measures to characteristic functions. The mission formalizes §43, together with the criterion (42:G) of §42 on which it rests.

Setting

Let III be a finite set of players. A characteristic function is a real number v(S)v(S)v(S) for every subset S⊆IS \subseteq IS⊆I (every coalition, including the empty set ⊖\ominus⊖ and III). Write −S=I−S-S = I - S−S=I−S. From 42.4.1 on the book works in the domain of constant-sum games, whose characteristic functions are, by (42:D), exactly the functions satisfying

(42:6:a) v(⊖)=0,(42:6:b) v(S)+v(−S)=v(I),(42:6:c) v(S)+v(T)≦v(S∪T)  if S∩T=⊖.\text{(42:6:a)}\ v(\ominus) = 0,\qquad \text{(42:6:b)}\ v(S) + v(-S) = v(I),\qquad \text{(42:6:c)}\ v(S) + v(T) \leqq v(S \cup T)\ \text{ if } S \cap T = \ominus .(42:6:a) v(⊖)=0,(42:6:b) v(S)+v(−S)=v(I),(42:6:c) v(S)+v(T)≦v(S∪T)  if S∩T=⊖.

For J⊆IJ \subseteq IJ⊆I with complement K=I−JK = I - JK=I−J, the game is decomposable with respect to JJJ and KKK if there are constant-sum games Δ\DeltaΔ on the players JJJ and H\mathrm HH on the players KKK with v(R)=vΔ(R∩J)+vH(R∩K)v(R) = v_\Delta(R \cap J) + v_{\mathrm H}(R \cap K)v(R)=vΔ​(R∩J)+vH​(R∩K) for all R⊆IR \subseteq IR⊆I — formula (41:3). The JJJ-constituent Δ\DeltaΔ is the game on JJJ with vΔ(S)=v(S)v_\Delta(S) = v(S)vΔ​(S)=v(S) for S⊆JS \subseteq JS⊆J (41:4).

A splitting set (43.1) is a J⊆IJ \subseteq IJ⊆I satisfying (41:6),

v(S∪T)=v(S)+v(T)for S⊆J, T⊆I−J.v(S \cup T) = v(S) + v(T) \quad \text{for } S \subseteq J,\ T \subseteq I - J .v(S∪T)=v(S)+v(T)for S⊆J, T⊆I−J.

The game is indecomposable if ⊖\ominus⊖ and III are its only splitting sets (43.3.1). A minimal splitting set is a splitting set J≠⊖J \neq \ominusJ=⊖ none of whose proper subsets J′≠⊖J' \neq \ominusJ′=⊖ is splitting (43.3.2), and ΠΓ\Pi_\GammaΠΓ​ is the system of all minimal splitting sets. The game is inessential (42:F) if it is strategically equivalent to the zero game, i.e. v(S)+∑k∈Sαk0=0v(S) + \sum_{k \in S} \alpha^0_k = 0v(S)+∑k∈S​αk0​=0 for all SSS, for some reals αk0\alpha^0_kαk0​ (the transformation (42:5)).

Formalization targets

Goal: (43:F), (43:G), (43:H)

For every vvv satisfying (42:6:a)–(42:6:c):

J1≠J2∈ΠΓ⇒J1∩J2=⊖,⋃J∈ΠΓJ=I,K splitting  ⟺  K=J1∪⋯∪Jp, Ji∈ΠΓ.J_1 \neq J_2 \in \Pi_\Gamma \Rightarrow J_1 \cap J_2 = \ominus, \qquad \bigcup_{J \in \Pi_\Gamma} J = I, \qquad K \text{ splitting} \iff K = J_1 \cup \dots \cup J_p,\ J_i \in \Pi_\Gamma .J1​=J2​∈ΠΓ​⇒J1​∩J2​=⊖,J∈ΠΓ​⋃​J=I,K splitting⟺K=J1​∪⋯∪Jp​, Ji​∈ΠΓ​.

The goal combines the partition property and the characterization of all splitting sets; it is the book's own summary of §43.3 and does not presuppose that ΠΓ\Pi_\GammaΠΓ​ is a partition.

Milestones

In attack order: the criterion (42:G) (decomposability   ⟺  \iff⟺ (41:6)   ⟺  \iff⟺ (41:7)); the closure properties (43:A) (complements), (43:B) (⊖\ominus⊖, III), (43:C) (intersections and unions); (43:D) (splitting sets of a constituent) and (43:E) (a constituent is indecomposable iff its set is minimal); (43:F), (43:G) separately; (43:I) (a minimal splitting set is disjoint from, or inside, any splitting set); the restatement (43:H*) (KKK splits iff every block of ΠΓ\Pi_\GammaΠΓ​ lies inside or outside KKK); and the two extreme cases (43:J) (ΠΓ\Pi_\GammaΠΓ​ = all singletons iff the game is inessential) and (43:K) (ΠΓ={I}\Pi_\Gamma = \{I\}ΠΓ​={I} iff the game is indecomposable).

Significance

The decomposition partition is canonical: every constant-sum game splits uniquely into indecomposable constituents, and (43:E) identifies them as the constituents on the blocks of ΠΓ\Pi_\GammaΠΓ​. The two extreme cases (43:J), (43:K) show that inessentiality and indecomposability are opposite ends of one scale. Chapter IX uses this structure in §§44–47, where solutions of decomposable games are related to solutions of their constituents ((46:A)–(46:I)); a formal decomposition partition is the prerequisite for that later work, and a candidate follow-up mission.

The results are classical and proved in the book. The mission's contribution is a machine-checked version: a formal definition layer for splitting sets of a set function on a finite set, the Boolean-algebra closure, and the atomic decomposition. The combinatorial core — that the sets satisfying a Carathéodory-type additivity condition form a Boolean algebra of a finite set, whose atoms partition it — is reusable outside game theory (for instance for finitely additive decompositions of set functions). No machine-checked version of these results is known to exist; they are formalized here for the first time as far as a search of the platform shows.

Difficulty

The individual steps are elementary, but the obvious argument for the key closure property (43:C) fails: to show that J′∪J′′J' \cup J''J′∪J′′ is splitting one cannot simply add the identities (41:6) for J′J'J′ and for J′′J''J′′, since a pair S⊆J′∪J′′S \subseteq J' \cup J''S⊆J′∪J′′, T⊆I−(J′∪J′′)T \subseteq I - (J' \cup J'')T⊆I−(J′∪J′′) is not of the form those identities control, and J′∩J′′J' \cap J''J′∩J′′ may be nonempty — the book's footnote on p. 354 singles out overlapping splitting sets as the case its proof is really about. Likewise (43:D) is not a tautology: that a set self-contained within a self-contained set is self-contained in the whole game has to be proved (footnote 1, p. 355). Formally, the main work is bookkeeping of set identities and the passage between subsets of JJJ (players of the constituent) and subsets of III.

Formalization scope

  • Players. The set of players III is an arbitrary finite type ι with decidable equality (the book's I=(1,…,n)I = (1, \dots, n)I=(1,…,n); in Chapter IX players are also named 1′,…,k′,1′′,…,l′′1', \dots, k', 1'', \dots, l''1′,…,k′,1′′,…,l′′). Coalitions are Finset ι, −S-S−S and I−JI - JI−J are the complement Sᶜ in III, and vvv is a function Finset ι → ℝ.
  • Standing hypotheses. Every theorem assumes (42:6:a)–(42:6:c) (the structure IsConstantSum), the chapter's domain from 42.5.3 on ("in the remainder of this chapter we will continue to consider constant-sum games", p. 353). v(I)v(I)v(I) is arbitrary: the statements are not restricted to zero-sum games, which would be a weaker special case. (43:K) additionally assumes III nonempty ([Nonempty ι], the book's n≧1n \geqq 1n≧1); every other statement holds without it. (43:E) assumes J≠⊖J \neq \ominusJ=⊖, since the book's constituent is a game and has at least one player.
  • Characteristic functions only. Games are represented by their characteristic functions, as the book does throughout §§42–43 by (42:D). Decomposability quantifies over constant-sum characteristic functions vΔv_\DeltavΔ​, vHv_{\mathrm H}vH​ on the subtypes ↥J, ↥Jᶜ; the JJJ-constituent is vvv restricted to subsets of ↥J. Sums of sets are unions; "disjunct" is Disjoint.
  • Π_Γ. decompositionPartition v is the set of minimal splitting sets; that it is a partition is proved, not assumed. An aggregate of minimal splitting sets is a finite family A, its sum A.sup id; the empty aggregate gives ⊖\ominus⊖.
  • No trivialization. A definition of splitting sets that quantified over T⊆IT \subseteq IT⊆I instead of T⊆I−JT \subseteq I - JT⊆I−J, or complements taken in an ambient type larger than III, would change the theorems; here the complement is in the finite type of players itself. With III empty all statements except (43:K) hold trivially, and (43:K) carries the nonemptiness hypothesis.
  • Contributions welcome. Proofs of the milestones in the listed order; general Mathlib-style lemmas on Boolean subalgebras of Finset ι and their atoms, which would shorten (43:F)–(43:H).

Selected references

  • J. von Neumann and O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary edition, Princeton University Press, 2007 (page-for-page reprint of the 3rd edition, 1953), Chapter IX, §§41–43, pp. 339–357. https://doi.org/10.1515/9781400829460
  • C. Carathéodory, Vorlesungen über reelle Funktionen, Teubner, Leipzig–Berlin, 1918, Chapter V (the measurability criterion to which (41:7) corresponds, cited by the book on p. 343).
16 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Optimal Two- and Three-Stage Production Schedules with Setup Times Included 2: Johnson's Rule for Three MachinesResearch Paper

Motivation

Johnson's 1954 paper in Naval Research Logistics Quarterly is the starting point of machine scheduling theory. Its first section solves the two-machine flow shop: nnn items must pass through machine 1 and then machine 2, and an explicit ordering rule minimizes the total elapsed time. Its second section treats three machines. There the problem "loses some of the nice structure of the two-stage case" (p. 65), and the general three-machine problem was later shown to be strongly NP-hard (Garey, Johnson and Sethi, 1976). Johnson nevertheless identifies a restricted case, in which the middle machine is dominated by the first (or the last), where the two-machine rule still gives an optimal schedule. That case, and the structural facts behind it, are the content of this mission.

The three-machine results are still the reference point for polynomially solvable flow shops and for lower bounds in branch-and-bound methods for the general problem.

Timeline.

  • 1954: Johnson proves the two-machine rule (Theorem 1) and, for three machines, the reduction to a common ordering (Lemma 3), a closed form for the elapsed time, and optimality of the rule on Ai+BiA_i + B_iAi​+Bi​, Bi+CiB_i + C_iBi​+Ci​ when min⁡Ai≥max⁡Bj\min A_i \ge \max B_jminAi​≥maxBj​ (Theorem 2), with the mirror case min⁡Ci≥max⁡Bj\min C_i \ge \max B_jminCi​≥maxBj​ asserted.
  • 1976: Garey, Johnson and Sethi show that minimizing makespan in a three-machine flow shop is strongly NP-hard in general, so some restriction of Theorem 2's kind is unavoidable for an exact ordering rule.

Setting

There are nnn items and three machines. Item iii needs processing time Ai>0A_i > 0Ai​>0 on machine 1, Bi>0B_i > 0Bi​>0 on machine 2 and Ci>0C_i > 0Ci​>0 on machine 3, in that order. Each machine handles at most one item at a time, and processing is not interrupted.

A schedule assigns each item start times si1,si2,si3s^1_i, s^2_i, s^3_isi1​,si2​,si3​. It is feasible when all start times are at least 000 on machine 1, the processing intervals of distinct items on the same machine do not overlap, and si1+Ai≤si2s^1_i + A_i \le s^2_isi1​+Ai​≤si2​, si2+Bi≤si3s^2_i + B_i \le s^3_isi2​+Bi​≤si3​. The three machines may process the items in different orders. The total elapsed time (makespan) is max⁡i(si3+Ci)\max_i (s^3_i + C_i)maxi​(si3​+Ci​).

An ordering σ\sigmaσ lists the items, σ(k)\sigma(k)σ(k) being the item in position kkk. Its as-soon-as-possible schedule processes the items in the order σ\sigmaσ on every machine and starts each item on each machine as early as the rules allow. For an ordering, with positions 1,…,n1, \dots, n1,…,n, Johnson defines

Ku=∑i=1uAi−∑i=1u−1Bi,Hv=∑i=1vBi−∑i=1v−1Ci,K_u = \sum_{i=1}^{u} A_i - \sum_{i=1}^{u-1} B_i, \qquad H_v = \sum_{i=1}^{v} B_i - \sum_{i=1}^{v-1} C_i,Ku​=i=1∑u​Ai​−i=1∑u−1​Bi​,Hv​=i=1∑v​Bi​−i=1∑v−1​Ci​,

the sums running over the items in the first uuu (resp. vvv) positions.

Johnson's three-stage rule says that item iii definitely precedes item jjj when

min⁡(Ai+Bi, Cj+Bj)<min⁡(Aj+Bj, Ci+Bi)(IV)\min(A_i + B_i,\ C_j + B_j) < \min(A_j + B_j,\ C_i + B_i) \tag{IV}min(Ai​+Bi​, Cj​+Bj​)<min(Aj​+Bj​, Ci​+Bi​)(IV)

and calls them indifferent under equality. An ordering is consistent with (IV) when no item placed later is definitely preferred to an item placed earlier.

Formalization targets

Goal: Theorem 2 (p. 67)

If every AiA_iAi​ is at least every BjB_jBj​, then an ordering consistent with (IV) exists, and for every such ordering σ\sigmaσ the as-soon-as-possible schedule of σ\sigmaσ is feasible and satisfies

makespan⁡(as-soon-as-possible schedule of σ)≤makespan⁡(s)for every feasible schedule s.\operatorname{makespan}(\text{as-soon-as-possible schedule of } \sigma) \le \operatorname{makespan}(s) \quad \text{for every feasible schedule } s .makespan(as-soon-as-possible schedule of σ)≤makespan(s)for every feasible schedule s.

Milestones

  1. Lemma 3 (p. 65). Every feasible schedule is matched or beaten by the as-soon-as-possible schedule of some single ordering.
  2. Closed form (p. 66). For every ordering, the total idle time of machine 3 is ∑iYi=max⁡1≤u≤v≤n(Hv+Ku)\sum_i Y_i = \max_{1 \le u \le v \le n}(H_v + K_u)∑i​Yi​=max1≤u≤v≤n​(Hv​+Ku​), so that
makespan⁡=∑i=1nCi+max⁡1≤u≤v≤n(Ku+Hv),\operatorname{makespan} = \sum_{i=1}^{n} C_i + \max_{1 \le u \le v \le n} (K_u + H_v),makespan=i=1∑n​Ci​+1≤u≤v≤nmax​(Ku​+Hv​),

the "maximum walk" of p. 68. 3. Special case (p. 67). If min⁡Ai≥max⁡Bj\min A_i \ge \max B_jminAi​≥maxBj​ then max⁡u≤vKu=Kv\max_{u \le v} K_u = K_vmaxu≤v​Ku​=Kv​, so the makespan is ∑iCi+max⁡v(Hv+Kv)\sum_i C_i + \max_v (H_v + K_v)∑i​Ci​+maxv​(Hv​+Kv​). 4. (III) ⇔\Leftrightarrow⇔ (IV) (p. 67). Interchanging the items in positions j,j+1j, j+1j,j+1 changes HHH and KKK only at j,j+1j, j+1j,j+1, and the interchange is strictly worse for the diagonal terms exactly when (IV) holds. 5. Lemma 4 (p. 67). Relation (IV) is transitive, except when the middle item is indifferent to both others. 6. Mirror case (p. 68). The conclusion of Theorem 2 also holds when every CiC_iCi​ is at least every BjB_jBj​.

Significance

The result. Theorem 2 gives an O(nlog⁡n)O(n \log n)O(nlogn) exact method for a class of three-machine flow shops, in a problem that is strongly NP-hard in general. Lemma 3 says that, for three machines, permutation schedules are dominant; Johnson's example on p. 65 shows this fails for four machines. The closed form of milestone 2 expresses the makespan of any ordering as a longest path in a grid, the device behind most later flow-shop lower bounds.

Formalizing it. All results are proved on paper, some tersely: Lemma 3's proof is two lines and cites the wrong lemma, Lemma 4 is proved by reference to Lemma 2, and the mirror case is asserted without proof. A search of Mathlib and of the platform catalog found no machine-checked proof of any of them. The mission produces a checked account of the three-machine flow shop, including the comparison against all feasible schedules rather than only permutation schedules, and pins down the exact form of the hypotheses (see below).

Difficulty

The interchange argument of the two-machine case does not transfer directly. For a general ordering the makespan involves max⁡u≤v(Hv+Ku)\max_{u \le v}(H_v + K_u)maxu≤v​(Hv​+Ku​), and interchanging adjacent items changes terms that depend on everything placed earlier; the page notes that "the decision is not independent of what precedes the interchanged elements". The hypothesis min⁡A≥max⁡B\min A \ge \max BminA≥maxB is what makes KKK nondecreasing along the ordering, collapsing the double maximum to the diagonal. A second obstacle is that (IV) is not a total preorder: ties break transitivity, so passing from "no adjacent pair can be improved" to "optimal" needs the all-pairs consistency and the tie exception of Lemma 4. Finally, Lemma 3 is a statement about arbitrary start-time schedules, so the reduction to orderings must handle machines whose orders differ.

Formalization scope

Items are Fin n; processing times are real-valued functions A B C : Fin n → ℝ, assumed positive in each theorem that is about schedules (the paper's standing assumption, p. 61). A schedule is three start-time functions; feasibility is spelled out as above with non-overlap written as a disjunction of inequalities. The makespan is the maximum of the machine-3 completion times together with 000, so the empty instance has makespan 000. An ordering is an Equiv.Perm (Fin n) with σ k the item in position k; positions are 0-based, so the Lean K u, H v are the paper's Ku+1K_{u+1}Ku+1​, Hv+1H_{v+1}Hv+1​. Statements with maxima over positions assume n≥1n \ge 1n≥1.

Hypotheses made explicit or corrected:

  • min⁡Ai≥max⁡Bi\min A_i \ge \max B_iminAi​≥maxBi​ is read globally, Bj≤AiB_j \le A_iBj​≤Ai​ for all i,ji, ji,j, as in the section heading. The pointwise reading Bi≤AiB_i \le A_iBi​≤Ai​ makes Theorem 2 false (an instance with five items is recorded in the Formalization Note of the goal).
  • Consistency with (IV) is required for all pairs of positions, not only adjacent ones.
  • Lemma 4 carries Lemma 2's exception for an item indifferent to both others; without it the statement is false.
  • Lemma 3's proof cites "Lemma 2" where Lemma 1 is meant.
  • The interchange equivalence (milestone 4) is stated for arbitrary reals, which is stronger than the page needs.

Optimality in the goal is against every feasible schedule. A formalization that compares only orderings with each other, or that defines the objective as the closed form ∑C+max⁡(Ku+Hv)\sum C + \max(K_u + H_v)∑C+max(Ku​+Hv​), would drop Lemma 3's content and is ruled out: the makespan is the latest completion time of a start-time schedule. The existence clause keeps the optimality clause from being vacuous.

A complete development needs finite sums over initial segments of Fin n, Finset.sup', and permutation manipulations (adjacent transpositions, bubble-sort arguments). The feasibility model and the closed form are reusable for other flow-shop results; contributions of general lemmas on adjacent interchanges of permutations are welcome.

Selected references

  • S. M. Johnson, Optimal two- and three-stage production schedules with setup times included, Naval Research Logistics Quarterly 1(1):61–68, 1954. https://doi.org/10.1002/nav.3800010110
  • M. R. Garey, D. S. Johnson, R. Sethi, The complexity of flowshop and jobshop scheduling, Mathematics of Operations Research 1(2):117–129, 1976. https://doi.org/10.1287/moor.1.2.117
13 thms2 active usersReviewed
🏆Completed
Graph TheoryLinear OptimizationOperations Research·Captain: mikedeng1

Odd Minimum Cut-Sets and b-Matchings 2: A Capacitated b-Matching Blossom Inequality Is Violated iff G(x, d) Has an Odd Cut of Capacity Less Than OneResearch Paper

Motivation

A b-matching with upper bounds in a graph G=(V,E)G=(V,E)G=(V,E) assigns a nonnegative integer xe≤dex_e\le d_exe​≤de​ to every edge so that the edges at each node iii carry at most bib_ibi​ in total. Maximizing a linear objective over such assignments is an integer program that contains ordinary matching (b≡1b\equiv 1b≡1, d≡1d\equiv 1d≡1) and appears in assignment, transportation and scheduling models with capacities on both nodes and arcs. Edmonds and Johnson showed that the integer hull of this system is described by adding the blossom (matching) inequalities to the linear relaxation (Edmonds–Johnson 1970; cited in the paper as [8], [13]). There are exponentially many blossom inequalities, so a cutting-plane method needs a separation procedure: given a fractional point xˉ\bar xxˉ, find a violated blossom inequality or certify that none exists.

M. W. Padberg and M. R. Rao, Odd Minimum Cut-Sets and b-Matchings, Mathematics of Operations Research 7 (1982), gave this procedure. Section 1 of the paper computes a minimum-capacity cut with an odd number of odd-labelled nodes in polynomial time; Sections 2 and 3 reduce blossom separation to that computation. This mission formalizes Section 3, the case with upper bounds ddd. The companion mission Odd Minimum Cut-Sets and b-Matchings 1 formalizes Section 1.

Timeline: Edmonds (1965) describes the perfect matching polytope; Edmonds and Johnson (1970) extend the description to capacitated bbb-matching; Gomory and Hu (1961) give the cut-tree that Section 1 of Padberg–Rao relies on; Padberg and Rao (1982) reduce separation to odd minimum cuts. Later work (Letchford, Reinelt and Theis, 2008) shortened the resulting algorithms; the reduction itself is the one stated here.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite simple undirected graph, b∈Z>0Vb\in\mathbb Z_{>0}^Vb∈Z>0V​ and d∈Z>0Ed\in\mathbb Z_{>0}^Ed∈Z>0E​. The system is

Ax≤b,x≤d,x≥0,(3.1)Ax\le b,\qquad x\le d,\qquad x\ge 0, \tag{3.1}Ax≤b,x≤d,x≥0,(3.1)

with AAA the node–edge incidence matrix. For W⊆VW\subseteq VW⊆V write E(W)E(W)E(W) for the edges with both ends in WWW and (W:V−W)(W:V-W)(W:V−W) for the cut-set of WWW, the edges with exactly one end in WWW. For T⊆(W:V−W)T\subseteq (W:V-W)T⊆(W:V−W) with b(W)+d(T)=∑i∈Wbi+∑e∈Tdeb(W)+d(T)=\sum_{i\in W}b_i+\sum_{e\in T}d_eb(W)+d(T)=∑i∈W​bi​+∑e∈T​de​ odd, the blossom inequality is

x(W)+x(T)=∑e∈E(W)xe+∑e∈Txe≤12(b(W)+d(T)−1).(3.3)x(W)+x(T)=\sum_{e\in E(W)}x_e+\sum_{e\in T}x_e\le \tfrac12\bigl(b(W)+d(T)-1\bigr). \tag{3.3}x(W)+x(T)=e∈E(W)∑​xe​+e∈T∑​xe​≤21​(b(W)+d(T)−1).(3.3)

Let xˉ\bar xxˉ be a real point feasible for (3.1) and sˉ=b−Axˉ\bar s=b-A\bar xsˉ=b−Axˉ its node slacks. Let E(xˉ)E(\bar x)E(xˉ) be the edges with xˉe>0\bar x_e>0xˉe​>0. The labelled weighted graph G(xˉ,d)G(\bar x,d)G(xˉ,d) has nodes VVV, a special node SSS, and one new node iei_eie​ for each e∈E(xˉ)e\in E(\bar x)e∈E(xˉ). For each such edge e=[i,j]e=[i,j]e=[i,j], where iii is the end the construction scans first, it has an edge [i,ie][i,i_e][i,ie​] of weight de−xˉed_e-\bar x_ede​−xˉe​ and an edge [ie,j][i_e,j][ie​,j] of weight xˉe\bar x_exˉe​. Each i∈Vi\in Vi∈V is joined to SSS with weight sˉi\bar s_isˉi​. There are no other edges. A node iei_eie​ is odd iff ded_ede​ is odd; SSS is odd iff b(V)b(V)b(V) is odd; a node i∈Vi\in Vi∈V is odd iff bib_ibi​ plus the ded_ede​ of the subdivided edges scanned from iii is odd. A node set UUU is odd when it contains an odd number of odd nodes, and yˉ(U:V~−U)\bar y(U:\tilde V-U)yˉ​(U:V~−U) denotes the total weight of the edges leaving UUU (its cut capacity).

Formalization targets

Goal: Theorem 3.1

For every feasible xˉ\bar xxˉ and every scan order,

∃ W⊆V, T⊆(W:V−W): b(W)+d(T) odd, xˉ(W)+xˉ(T)>12(b(W)+d(T)−1)\exists\,W\subseteq V,\ T\subseteq (W:V-W):\ b(W)+d(T)\text{ odd},\ \bar x(W)+\bar x(T)>\tfrac12\bigl(b(W)+d(T)-1\bigr)∃W⊆V, T⊆(W:V−W): b(W)+d(T) odd, xˉ(W)+xˉ(T)>21​(b(W)+d(T)−1) ⟺∃ U⊆V~ odd: yˉ(U:V~−U)<1.\Longleftrightarrow\quad \exists\,U\subseteq \tilde V \text{ odd}:\ \bar y(U:\tilde V-U)<1 .⟺∃U⊆V~ odd: yˉ​(U:V~−U)<1.

The paper's closing sentence, that WWW and TTT can be obtained constructively from the proof of Lemma 3.2, describes the proof and is not part of the formal statement.

Milestones

  1. Eq. (3.6): 2x(W)+x(W:V−W)+x(T)+s(W)+t(T)=b(W)+d(T)2x(W)+x(W:V-W)+x(T)+s(W)+t(T)=b(W)+d(T)2x(W)+x(W:V−W)+x(T)+s(W)+t(T)=b(W)+d(T) for T⊆(W:V−W)T\subseteq(W:V-W)T⊆(W:V−W), with t=d−xt=d-xt=d−x.
  2. Eq. (3.7): xˉ\bar xxˉ violates (3.3) for (W,T)(W,T)(W,T) iff xˉ(W:V−W)+d(T)−2xˉ(T)+sˉ(W)<1\bar x(W:V-W)+d(T)-2\bar x(T)+\bar s(W)<1xˉ(W:V−W)+d(T)−2xˉ(T)+sˉ(W)<1.
  3. Lemma 3.1: if T⊆(W:V−W)∩E(xˉ)T\subseteq (W:V-W)\cap E(\bar x)T⊆(W:V−W)∩E(xˉ) and b(W)+d(T)b(W)+d(T)b(W)+d(T) is odd, some odd UUU with S∉US\notin US∈/U has yˉ(U:V~−U)\bar y(U:\tilde V-U)yˉ​(U:V~−U) equal to the left side of (3.7) (Eq. (3.8)).
  4. Lemma 3.2: every odd UUU with S∉US\notin US∈/U and capacity <1<1<1 arises this way from some (W,T)(W,T)(W,T) with b(W)+d(T)b(W)+d(T)b(W)+d(T) odd.

Significance

Theorem 3.1 is what makes the blossom inequalities of capacitated bbb-matching usable in a linear-programming based cutting-plane method: combined with the odd minimum cut algorithm of Section 1, it separates them in polynomial time. By the equivalence of separation and optimization, it also yields a polynomial-time algorithm for capacitated bbb-matching through the ellipsoid method. The paper notes the further consequence that every odd cut-set of capacity less than one, not only a minimum one, gives a violated inequality.

The results are proved in the 1982 paper; none of them has a machine-checked proof that this mission is aware of. What the mission adds is a formal statement of the graph G(xˉ,d)G(\bar x,d)G(xˉ,d) and of the reduction, and a checked proof of it. The definitions of the capacitated bbb-matching system, its blossom inequalities and the subdivided graph are reusable for later work on matching polytopes and on the uncapacitated case of Section 2.

Difficulty

The identities (3.6) and (3.7) are bookkeeping over incidences. The substance is the correspondence between node sets WWW with complemented edge sets TTT and odd node sets UUU of G(xˉ,d)G(\bar x,d)G(xˉ,d). In one direction the right UUU must pick, for every cut edge, the side of iei_eie​ that makes the edge contribute xˉe\bar x_exˉe​ or de−xˉed_e-\bar x_ede​−xˉe​ as (3.7) requires, and its parity must be computed through the orientation-dependent labels. In the other direction an arbitrary odd cut of capacity below one must be shown to have this shape; this uses de≥1d_e\ge 1de​≥1 to exclude every other position of a new node iei_eie​, and it uses the evenness of the total label to pass from an odd set containing SSS to its complement. A point xˉ\bar xxˉ whose blossom violation uses an edge e∈Te\in Te∈T with xˉe=0\bar x_e=0xˉe​=0 has no new node for eee. Such a TTT has to be ruled out, and the argument uses the capacity bound. It is not an assumption of the theorem.

Formalization scope

The graph is a Mathlib SimpleGraph V on a finite type with decidable adjacency; edges are elements of G.edgeFinset : Finset (Sym2 V). The data are b : V → ℕ and d : Sym2 V → ℕ, positive on nodes and on edges, and a real point x : Sym2 V → ℝ. Feasibility means the linear relaxation of (3.1); integrality of xˉ\bar xxˉ is not assumed. All halves and differences are computed in ℝ. When W=VW=VW=V the cut-set is empty, so the paper's convention "TTT is empty" holds automatically.

G(xˉ,d)G(\bar x,d)G(xˉ,d) is fixed by definitions from (G,b,d,xˉ)(G,b,d,\bar x)(G,b,d,xˉ) and an orientation tail choosing the end of each edge scanned first; every theorem quantifies over the orientation. The node type is Option V ⊕ {e // e ∈ E(x̄)}, with none the special node SSS. Weights are a symmetric function on nodes with 000 meaning "no edge". The labels are given in closed form. The paper assigns them by a sequential scan that flips the parity of the scanned end by ded_ede​, and addition mod 2 does not depend on the order of the scan. "The cut capacity of an odd minimum cut-set is less than one" is stated as "some odd cut has capacity less than one"; the two agree, and the formulation avoids a minimum over a possibly empty family.

Two trivializing formalizations are ruled out: G(xˉ,d)G(\bar x,d)G(xˉ,d) is constructed, not an arbitrary labelled graph assumed to satisfy (3.8); and no infimum over odd cuts is taken, since a real sInf of an empty family is 000 and would make the right side true when no odd cut exists.

Contributions welcome: proofs of the milestones, lemmas on cut capacities of symmetric weight functions on finite types, and parity bookkeeping for labelled node sets.

Selected references

  • M. W. Padberg, M. R. Rao, Odd Minimum Cut-Sets and b-Matchings, Mathematics of Operations Research 7(1), 67–80, 1982. https://doi.org/10.1287/moor.7.1.67
  • J. Edmonds, E. L. Johnson, Matching: a well-solved class of integer linear programs, in Combinatorial Structures and Their Applications, Gordon and Breach, 89–92, 1970; reprinted in Combinatorial Optimization — Eureka, You Shrink!, LNCS 2570, 27–30, 2003. https://doi.org/10.1007/3-540-36478-1_3
  • R. E. Gomory, T. C. Hu, Multi-terminal network flows, Journal of the SIAM 9(4), 551–570, 1961. https://doi.org/10.1137/0109047
  • J. Edmonds, Maximum matching and a polyhedron with 0,1-vertices, Journal of Research of the National Bureau of Standards 69B, 125–130, 1965. https://doi.org/10.6028/jres.069B.013
  • A. N. Letchford, G. Reinelt, D. O. Theis, Odd minimum cut sets and b-matchings revisited, SIAM Journal on Discrete Mathematics 22(4), 1480–1487, 2008. https://doi.org/10.1137/060664793
7 thms2 active usersReviewed
🏆Completed
Graph TheoryOperations Research·Captain: mikedeng1

Odd Minimum Cut-Sets and b-Matchings 1: A Minimum-Weight Odd-Splitting Edge of the Gomory–Hu Cut-Tree Defines an Odd Minimum Cut-SetResearch Paper

Motivation

Edmonds showed that the convex hull of the matchings of a graph is described by the degree constraints together with the blossom inequalities, one for every odd set of nodes (Edmonds 1965). There are exponentially many of them, so any cutting-plane method for matching and b-matching problems must answer a separation question: given a fractional point, find a violated blossom inequality or certify that none exists. Padberg and Rao (1982) reduced this question to a purely graph-theoretic one, the odd minimum cut-set problem, and solved that problem in polynomial time with a single Gomory–Hu computation. The same subroutine underlies separation for many other odd-set constraints (for example the 2-matching and comb-type constraints of the travelling salesman polytope), and later work refined its running time (Letchford, Reinelt and Theis 2008).

This mission covers Section 1 of the paper: the combinatorial theorem about odd cuts, independent of matchings. A companion mission covers the reduction from capacitated b-matching separation (Section 3).

Setting

Let G=(V,E)G = (V, E)G=(V,E) be a finite undirected graph without loops and multiple edges, with edge weights ce≥0c_e \ge 0ce​≥0. Write cijc_{ij}cij​ for the weight of the edge [i,j][i, j][i,j], with cij=cjic_{ij} = c_{ji}cij​=cji​, and cij=0c_{ij} = 0cij​=0 if there is no such edge. For W⊆VW \subseteq VW⊆V the cut-set (W:V−W)(W : V - W)(W:V−W) is the set of edges with exactly one end in WWW, and its capacity is

c(W:V−W)=∑i∈W∑j∈V−Wcij.c(W : V - W) = \sum_{i \in W} \sum_{j \in V - W} c_{ij}.c(W:V−W)=i∈W∑​j∈V−W∑​cij​.

A nonempty set V1⊆VV_1 \subseteq VV1​⊆V of nodes is labelled odd, the rest even. For U⊆VU \subseteq VU⊆V the label λ(U)\lambda(U)λ(U) is odd if ∣U∩V1∣|U \cap V_1|∣U∩V1​∣ is odd, and even otherwise; λ(∅)\lambda(\emptyset)λ(∅) is even. The paper assumes throughout that λ(V)\lambda(V)λ(V) is even, i.e. ∣V1∣|V_1|∣V1​∣ is even. A cut-set (U:V−U)(U : V - U)(U:V−U) is odd if λ(U)\lambda(U)λ(U) is odd, and an odd minimum cut-set is a solution XXX of

c(X:V−X)=min⁡{c(U:V−U):U⊆V, λ(U) odd}.(1.1)c(X : V - X) = \min\{ c(U : V - U) : U \subseteq V,\ \lambda(U) \text{ odd} \}. \qquad (1.1)c(X:V−X)=min{c(U:V−U):U⊆V, λ(U) odd}.(1.1)

A cut-set (M:V−M)(M : V - M)(M:V−M) is a minimum cut-set with respect to all pairs of odd nodes if it separates two odd nodes and no cut-set separating two odd nodes has smaller capacity.

A cut-tree GT=(N,F)G_T = (N, F)GT​=(N,F) for the odd nodes is the output of the Gomory–Hu algorithm applied to all pairs of odd nodes (Gomory and Hu 1961). Each tree node contains exactly one odd node and possibly some even ones, so NNN is identified with V1V_1V1​, and each node vvv of GGG belongs to one tree node π(v)\pi(v)π(v). Removing a tree edge f=[r,s]f = [r, s]f=[r,s] splits GTG_TGT​ into two subtrees; the nodes of GGG in the tree nodes of the rrr-side subtree form a set MMM, and the weight of fff is df=c(M:V−M)d_f = c(M : V - M)df​=c(M:V−M). The defining property (Hu, Theorem 9.2) is that for every tree edge f=[r,s]f = [r, s]f=[r,s] the cut-set (M:V−M)(M : V - M)(M:V−M) is a minimum cut-set of GGG separating rrr and sss. The cardinality of a subtree is its number of tree nodes.

Formalization targets

Goal: Theorem 1.1 (p. 70)

For every cut-tree GTG_TGT​ of GGG for the odd nodes:

  1. some edge of GTG_TGT​ decomposes it into two subtrees of odd cardinality; and
  2. if f∗=[r,s]f^* = [r, s]f∗=[r,s] is such an edge of minimum weight among all such edges, and MMM is the rrr-side shore of f∗f^*f∗, then
c(M:V−M)=min⁡{c(U:V−U):U⊆V, λ(U) odd}.c(M : V - M) = \min\{ c(U : V - U) : U \subseteq V,\ \lambda(U) \text{ odd} \}.c(M:V−M)=min{c(U:V−U):U⊆V, λ(U) odd}.

Because ∣N∣=∣V1∣|N| = |V_1|∣N∣=∣V1​∣ is even, the two subtrees have the same parity, so the condition is checked on one side.

Milestones

  • Lemma 1.1 (p. 68). If (M:V−M)(M : V - M)(M:V−M) is a minimum cut-set with respect to all pairs of odd nodes, there is an odd minimum cut-set (X:V−X)(X : V - X)(X:V−X) with X⊆MX \subseteq MX⊆M or X⊆V−MX \subseteq V - MX⊆V−M.
  • Section 1, p. 70. If f∗f^*f∗ has minimum weight among all edges of GTG_TGT​, its shore MMM gives a minimum cut-set with respect to all pairs of odd nodes.

Significance

Theorem 1.1 turns problem (1.1), a minimization over exponentially many odd sets, into ∣V1∣−1|V_1| - 1∣V1​∣−1 maximum-flow computations followed by a scan of the tree edges. Combined with Section 3 of the paper, this gives a polynomial separation algorithm for the blossom inequalities of b-matching polytopes, and hence, by the equivalence of separation and optimization, a polynomial-time route to weighted b-matching through linear programming. The odd-cut routine is also used for separating the odd-set constraints of other polytopes.

The theorem has been proved since 1982 and is textbook material. What this mission adds is a machine-checked proof on a precise encoding of cut-trees. As far as the platform's corpus shows, neither the Gomory–Hu cut-tree property nor any odd-cut theorem has been formalized in Lean; Mathlib has trees and reachability in simple graphs but no cut-tree theory.

Difficulty

The obvious argument fails at the minimum. Every tree-edge shore separates two odd nodes, so a minimum-weight odd-splitting edge certainly yields an odd cut, but showing that no odd set UUU, however it cuts across the tree nodes, has smaller capacity requires relating an arbitrary odd UUU to a tree edge whose shore is also odd and whose endpoints UUU separates. The cut-tree only certifies minimality for cuts separating the two ends of a tree edge; an odd set UUU may split many tree nodes and cross many shores at once, and nothing in the cut-tree property speaks about parity. Parity bookkeeping between odd labels in GGG and odd cardinality of subtrees is the other place where care is needed: the two notions agree only because each tree node holds exactly one odd node.

Formalization scope

The graph is a weight function c : V → V → ℝ on a Fintype V, with hypotheses that it is symmetric and nonnegative; a missing edge has weight 0 and the diagonal never enters a cut. Node sets are Finset V and V−WV - WV−W is the complement Wᶜ. The odd nodes form a Finset odd with odd.Nonempty and Even odd.card on every statement. The cut-tree is a SimpleGraph on the subtype {v // v ∈ odd} together with a map π : V → {v // v ∈ odd}; IsOddCutTree requires that the graph is a tree, that π fixes every odd node, and the Gomory–Hu minimality for every tree edge. The tree-edge weight dfd_fdf​ is computed from the shore, not supplied as data. Minimality is always stated as ≤ against every competitor; no real infimum is taken.

The existence of a cut-tree (the Gomory–Hu theorem) is a hypothesis-side object and is not part of this mission; the theorems hold for every tree satisfying the cut-tree property. A statement in which the cut-tree assumption already says that the chosen edge's shore is an odd minimum cut, or in which "odd minimum cut" is minimized only over tree-edge shores, would make Theorem 1.1 definitional; both are ruled out, since IsOddMinCut ranges over every node set with odd label.

A complete development needs: submodularity-type identities for cut capacities (reusable for any cut problem), the structure of fundamental cuts of a tree (the two sides of a removed edge are complementary and the parities of U∩V1U \cap V_1U∩V1​ along tree edges combine), and Lemma 1.1. Proofs of the milestones, alternative arguments for the goal that avoid the recursion, and a formal Gomory–Hu existence theorem are all welcome contributions.

Selected references

  • M. W. Padberg and M. R. Rao, Odd Minimum Cut-Sets and b-Matchings, Mathematics of Operations Research 7(1), 67–80, 1982. https://doi.org/10.1287/moor.7.1.67
  • R. E. Gomory and T. C. Hu, Multi-Terminal Network Flows, Journal of the SIAM 9(4), 551–570, 1961. https://doi.org/10.1137/0109047
  • T. C. Hu, Integer Programming and Network Flows, Addison-Wesley, 1969 (Chapter 9, Theorem 9.2).
  • J. Edmonds, Maximum Matching and a Polyhedron with 0,1-Vertices, Journal of Research of the National Bureau of Standards 69B, 125–130, 1965. https://doi.org/10.6028/jres.069B.013
  • A. N. Letchford, G. Reinelt and D. O. Theis, Odd Minimum Cut Sets and b-Matchings Revisited, SIAM Journal on Discrete Mathematics 22(4), 1480–1487, 2008. https://doi.org/10.1137/060664793
7 thms2 active usersReviewed
🏆Completed
Graph TheoryOperations ResearchOptimization·Captain: mikedeng1

A New Branch-and-Cut Algorithm for the Capacitated Vehicle Routing Problem: Safe Shrinking of Customer SetsResearch Paper

Motivation

The capacitated vehicle routing problem (CVRP) asks for minimum-cost routes, starting and ending at a depot, that serve every customer exactly once without any vehicle carrying more than its capacity. It is one of the central problems of operations research and logistics, and exact algorithms for it have been built on branch-and-cut for three decades: a linear programming relaxation is strengthened at every node of a search tree by adding valid inequalities that the current LP solution violates.

The most important of these inequalities are the capacity inequalities. Deciding whether an LP solution violates one of them is strongly NP-hard, so practical codes rely on heuristics, and most heuristics first shrink the support graph: groups of customers are contracted into single supervertices so that the search runs on a smaller graph. Shrinking is only useful if it is safe, meaning it cannot hide a violated inequality. Before the work of Lysgaard, Letchford and Eglese, the standard safe rule allowed shrinking a single edge whose LP value is at least one (Augerat et al. 1998; Ralphs et al. 2003). Lysgaard, Letchford & Eglese (2004), whose separation routines were released as the widely used CVRPSEP package, generalized the rule to customer sets of any size in their Proposition 1, the only numbered result of the paper.

Setting

Let G=(V,E)G = (V, E)G=(V,E) be the complete undirected graph on V={0,1,…,n}V = \{0, 1, \dots, n\}V={0,1,…,n}. Vertex 000 is the depot and Vc={1,…,n}V_c = \{1, \dots, n\}Vc​={1,…,n} are the customers. Vehicles have capacity Q>0Q > 0Q>0 and each customer iii has an integer demand qiq_iqi​ with 0<qi≤Q0 < q_i \le Q0<qi​≤Q. An LP point is a vector x=(xe)e∈Ex = (x_e)_{e \in E}x=(xe​)e∈E​; xijx_{ij}xij​ and xjix_{ji}xji​ are the same variable, and LP solutions satisfy x≥0x \ge 0x≥0.

For a vertex set SSS, δ(S)\delta(S)δ(S) is the set of edges with exactly one end-vertex in SSS (edges to the depot included), and x(δ(S))=∑e∈δ(S)xex(\delta(S)) = \sum_{e \in \delta(S)} x_ex(δ(S))=∑e∈δ(S)​xe​ is its cut value. For a customer set S⊆VcS \subseteq V_cS⊆Vc​:

  • q(S)=∑i∈Sqiq(S) = \sum_{i \in S} q_iq(S)=∑i∈S​qi​ is its total demand;
  • r(S)r(S)r(S), the bin-packing number, is the minimum number of bins of capacity QQQ into which the items of sizes qiq_iqi​, i∈Si \in Si∈S, can be packed;
  • k(S)=⌈q(S)/Q⌉≤r(S)k(S) = \lceil q(S)/Q \rceil \le r(S)k(S)=⌈q(S)/Q⌉≤r(S) is the rounded capacity bound.

The capacity inequalities and the rounded capacity inequalities (RCIs) are

x(δ(S))≥2r(S)andx(δ(S))≥2k(S),S⊆Vc, ∣S∣≥2.x(\delta(S)) \ge 2r(S) \quad\text{and}\quad x(\delta(S)) \ge 2k(S), \qquad S \subseteq V_c,\ |S| \ge 2 .x(δ(S))≥2r(S)andx(δ(S))≥2k(S),S⊆Vc​, ∣S∣≥2.

The violation of such an inequality at xxx is 2r(S)−x(δ(S))2r(S) - x(\delta(S))2r(S)−x(δ(S)) (resp. 2k(S)−x(δ(S))2k(S) - x(\delta(S))2k(S)−x(δ(S))); it is violated when this is positive.

Shrinking a customer set SSS contracts it to one supervertex. The supervertices of the shrunk graph are then SSS and the single customers outside SSS, so a union of supervertices is a customer set T′T'T′ with S⊆T′S \subseteq T'S⊆T′ or S∩T′=∅S \cap T' = \emptysetS∩T′=∅. Shrinking SSS is safe if for every customer set TTT with ∣T∣≥2|T| \ge 2∣T∣≥2 whose inequality is violated, there is such a union T′T'T′ with ∣T′∣≥2|T'| \ge 2∣T′∣≥2 and at least the same violation.

Formalization targets

Goal: Proposition 1

For every x≥0x \ge 0x≥0 and every customer set SSS with

x(δ(S))≤2andx(δ(R))≥2  for every nonempty proper subset R⊊S,x(\delta(S)) \le 2 \qquad\text{and}\qquad x(\delta(R)) \ge 2 \ \text{ for every nonempty proper subset } R \subsetneq S,x(δ(S))≤2andx(δ(R))≥2  for every nonempty proper subset R⊊S,

shrinking SSS is safe for the capacity inequalities x(δ(T))≥2r(T)x(\delta(T)) \ge 2r(T)x(δ(T))≥2r(T).

Milestones (proof of Proposition 1, p. 426)

  1. Monotonicity of the bin-packing number: 2r(S∪T)−2r(T)≥02r(S \cup T) - 2r(T) \ge 02r(S∪T)−2r(T)≥0.
  2. Submodularity of the cut function, in the paper's arrangement: x(δ(T))−x(δ(S∪T))≥x(δ(S∩T))−x(δ(S))x(\delta(T)) - x(\delta(S \cup T)) \ge x(\delta(S \cap T)) - x(\delta(S))x(δ(T))−x(δ(S∪T))≥x(δ(S∩T))−x(δ(S)) for x≥0x \ge 0x≥0.
  3. The crossing-set inequality: if TTT crosses SSS (T∩ST \cap ST∩S, T∖ST \setminus ST∖S, S∖TS \setminus TS∖T all nonempty), then 2r(T)−x(δ(T))≤2r(S∪T)−x(δ(S∪T))2r(T) - x(\delta(T)) \le 2r(S \cup T) - x(\delta(S \cup T))2r(T)−x(δ(T))≤2r(S∪T)−x(δ(S∪T)).

Further statements on the same page

  1. The same shrinking condition is safe for the rounded capacity inequalities x(δ(T))≥2k(T)x(\delta(T)) \ge 2k(T)x(δ(T))≥2k(T), which are the inequalities the algorithm separates.
  2. The paper's first separation heuristic checks the RCI for each connected component SiS_iSi​ of the support graph on the customers, for each complement Vc∖SiV_c \setminus S_iVc​∖Si​, and for the union of the components with no support edge to the depot. At an integer point satisfying the degree equations x(δ({i}))=2x(\delta(\{i\})) = 2x(δ({i}))=2 and the bounds xij∈{0,1}x_{ij} \in \{0,1\}xij​∈{0,1}, x0j∈{0,1,2}x_{0j} \in \{0,1,2\}x0j​∈{0,1,2}, this heuristic finds a violated RCI whenever one exists. This claim is stated in the paper without proof and is not needed for the goal.

Significance

Proposition 1 justifies contracting whole groups of customers before running separation heuristics, which shrinks the graph those heuristics work on while preserving every violated capacity inequality up to its violation. The rule is part of the separation routines of CVRPSEP and of later branch-and-cut and branch-cut-and-price codes for vehicle routing that reuse them.

The result is proved in the paper; to the best of the platform's records, none of it is formalized. The mission produces a reusable formal layer for the two-index CVRP formulation: cut values on the complete graph with a depot, the bin-packing number, the rounded capacity bound, and the notion of safe shrinking. Submodularity of the cut function (target 2) is a classical fact that the paper cites rather than proves; the platform already has a related statement for symmetric weight matrices on Boolean regions (EmergentGeometry.cutWeight_submodular), in a different representation. Target 5 records a claim of the paper that it asserts without proof.

Difficulty

When the violated set TTT contains SSS or misses it, TTT itself is a union of supervertices and there is nothing to show. The difficulty is a set TTT that crosses SSS: no union of supervertices is obviously as violated as TTT, because enlarging TTT can raise its cut value — x(δ(S∪T))x(\delta(S \cup T))x(δ(S∪T)) can be smaller or larger than x(δ(T))x(\delta(T))x(δ(T)) depending on the edges leaving S∖TS \setminus TS∖T — and the hypotheses on SSS say nothing about TTT directly. Both hypotheses on SSS and the sign condition x≥0x \ge 0x≥0 matter here; for signed xxx the statement fails. A violated TTT strictly inside SSS is not a crossing set in the paper's sense and has to be handled as well.

On the formal side, the bin-packing number is an optimum of a combinatorial problem; its properties must be derived from a definition by assignments to bins, and it is well defined only because every demand fits in one vehicle. Target 5 needs a structural understanding of integer points satisfying the degree equations, which the paper does not supply.

Formalization scope

Vertices are Fin (n+1), the depot is 0, and a customer set is a Finset (Fin (n+1)) not containing 0. The edge vector is a function x : Sym2 (Fin (n+1)) → ℝ on unordered pairs, and the cut value is ∑ i ∈ S, ∑ j ∈ Sᶜ, x s(i, j), which includes the edges to the depot. The capacity QQQ is real (the paper does not say it is an integer) and demands are natural numbers with 0<qi≤Q0 < q_i \le Q0<qi​≤Q for customers. The bin-packing number is the least number of bins over assignments of the customers of SSS to bins of total demand at most QQQ; under qi≤Qq_i \le Qqi​≤Q this minimum exists. Of the LP point only x≥0x \ge 0x≥0 is assumed in Proposition 1 and targets 1–4, which is at least as strong as the paper's setting. The hypothesis "x(δ(R))≥2x(\delta(R)) \ge 2x(δ(R))≥2 for all R⊂SR \subset SR⊂S" ranges over nonempty proper subsets.

A formalization that lets R=∅R = \emptysetR=∅ in that hypothesis is vacuous, because x(δ(∅))=0x(\delta(\emptyset)) = 0x(δ(∅))=0; one that drops the condition "S⊆T′S \subseteq T'S⊆T′ or S∩T′=∅S \cap T' = \emptysetS∩T′=∅" from safe shrinking is trivial (take T′=TT' = TT′=T); and one that defines rrr as kkk, as an arbitrary monotone function, or with a junk value 000, or that omits the depot edges from the cut, states a different result. None of these is the mission's statement.

Needed infrastructure: finite sums over cuts of Sym2-indexed vectors, a working API for the bin-packing number, and, for target 5, connected components of the support graph (SimpleGraph.Reachable). The cut-function lemmas and the bin-packing number are reusable for any later formalization of CVRP polyhedra (framed capacity, comb and multistar inequalities). Contributions of general lemmas about cut functions on complete graphs are welcome as separate theorems.

Selected references

  • J. Lysgaard, A. N. Letchford, R. W. Eglese, A new branch-and-cut algorithm for the capacitated vehicle routing problem, Mathematical Programming Ser. A 100 (2004) 423–445. https://doi.org/10.1007/s10107-003-0481-8
  • G. L. Nemhauser, L. A. Wolsey, Integer and Combinatorial Optimization, Wiley, 1988. https://doi.org/10.1002/9781118627372
  • P. Augerat, J. M. Belenguer, E. Benavent, A. Corberán, D. Naddef, Separating capacity constraints in the CVRP using tabu search, European Journal of Operational Research 106 (1998) 546–557. https://doi.org/10.1016/S0377-2217(97)00290-7
  • T. K. Ralphs, L. Kopman, W. R. Pulleyblank, L. E. Trotter, On the capacitated vehicle routing problem, Mathematical Programming 94 (2003) 343–359. https://doi.org/10.1007/s10107-002-0323-0
13 thms2 active usersReviewed
PreviousPage 11 of 15Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me