Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Combinatorics

630 missions · 354 completed

The mathematics of finite and discrete structures — counting the arrangements of a set, deciding when a configuration meeting prescribed constraints can exist, and characterizing the patterns such structures are forced to contain. It encompasses enumerative and extremal combinatorics, graph theory, design theory, and additive combinatorics, with deep ties to algebra, probability, and computer science.

Missions

Open276Completed354All630
🏆Completed
Discrete GeometryGraph Theory·Captain: mikedeng1

Diameter of Polyhedra: Limits of Abstraction 2: The Kalai–Kleitman Bound n^(1+log d) Holds in the Base AbstractionResearch Paper

Motivation

The diameter of a polyhedron is the largest number of edges needed to travel between two vertices of its graph. Bounding that number from the dimension and the number of facets is a central question in polyhedral combinatorics because edge walks are the discrete moves available to many vertex-based optimization methods. The Kalai–Kleitman bound gives a quasi-polynomial upper bound in these parameters. Eisenbrand, Hähnle, Razborov and Rothvoß ask how much of the geometry is needed to retain such a bound. They isolate one path property of polyhedron graphs and show that the upper bound persists for every graph satisfying it, including graphs that need not arise from a polyhedron (Dagstuhl abstract, pp. 1–3).

This mission concerns that extension of the Kalai–Kleitman bound. The held source is the five-page Dagstuhl extended abstract dated June 15, 2010. It states the result without its proof. The full proofs appeared in Mathematics of Operations Research 35 (2010), 786–794 (journal article). The goal is an asserted result of the paper, not an open conjecture; the formal proof remains to be supplied.

Setting

Let [n]={1,…,n}[n]=\{1,\ldots,n\}[n]={1,…,n}, and let ([n]d)\binom{[n]}{d}(d[n]​) be the family of its ddd-element subsets. A graph G=(V,E)G=(V,E)G=(V,E) in the paper's base abstraction has a nonempty vertex set V⊆([n]d)V\subseteq\binom{[n]}{d}V⊆(d[n]​). Thus each graph vertex is labelled by a distinct ddd-element subset. The edges can be chosen freely subject to condition i): for every pair u,v∈Vu,v\in Vu,v∈V, there is a path from uuu to vwhoseintermediateverticesallcontainv whose intermediate vertices all contain vwhoseintermediateverticesallcontainu\cap v.Theconditionimpliesthatthegraphisconnected.Thepaperdenotestheclassofthesegraphsby. The condition implies that the graph is connected. The paper denotes the class of these graphs by .Theconditionimpliesthatthegraphisconnected.Thepaperdenotestheclassofthesegraphsby\mathcal B_{d,n}andcallsand callsandcallsdthedimensionandthe dimension andthedimensionandn$ the number of facets of the abstraction (definition and footnote, p. 2).

The distance between two vertices is the minimum number of edges in a path between them. A graph's diameter is the largest of these distances, and D(d,n)D(d,n)D(d,n) is the largest diameter among graphs in Bd,n\mathcal B_{d,n}Bd,n​. Condition i) is motivated by non-degenerate polyhedra: if a vertex lies on exactly ddd facets, its tight facets provide a ddd-element label, and two vertices can be connected inside the smallest face containing them. Every vertex on that path retains the facets common to the endpoints (pp. 2–3). This motivation does not restrict GGG to a realizable polyhedron graph.

Formalization targets

Kalai–Kleitman bound in the base abstraction

For positive dimension, the target is the pointwise form of the paper's assertion that the upper bound continues to hold in the base abstraction:

∀d≥1, ∀n, ∀G∈Bd,n, ∀u,v∈V(G),dist⁡G(u,v)≤n1+log⁡2d.\forall d\geq 1,\ \forall n,\ \forall G\in\mathcal B_{d,n},\ \forall u,v\in V(G),\quad \operatorname{dist}_G(u,v)\leq n^{1+\log_2 d}.∀d≥1, ∀n, ∀G∈Bd,n​, ∀u,v∈V(G),distG​(u,v)≤n1+log2​d.

Equivalently, every pair has a connecting path with at most n1+log⁡2dn^{1+\log_2 d}n1+log2​d edges. Consequently D(d,n)≤n1+log⁡2dD(d,n)\leq n^{1+\log_2 d}D(d,n)≤n1+log2​d. The statement covers every graph with the paper's labels and condition i), rather than a selected realization or a graph with extra geometric properties. The source prints the inequality for Δu(d,n)\Delta_u(d,n)Δu​(d,n), its polyhedron-diameter notation, and says in the same sentence that it continues to hold for the base abstraction (p. 3).

Significance

The bound shows that a common-facet path property is enough to prevent arbitrarily large diameter once ddd and nnn are fixed. It extends an upper bound first attached to graphs of polyhedra to a class specified entirely by finite sets and graph paths. This locates a concrete portion of the polyhedral diameter theory within combinatorics. The same paper gives an almost-quadratic lower bound for the abstraction, so the path property alone does not imply a linear bound in nnn (p. 3).

A machine-checked proof would connect a precise finite graph model with the real-exponent inequality, without relying on a polyhedron representation. Prove2Me already has a proved theorem called Hirsch.kalai_kleitman_bound for a bounded HHH-polytope, with a different exponent log⁡2d+2\log_2 d+2log2​d+2, and a proved Hirsch.kalai_kleitman_recursion for that polytope model. It also has Hirsch.clf_endpoint_peeling for connected layer families. Those results concern different objects or bounds and are useful prior work, but none is a formalization of the present claim for all G∈Bd,nG\in\mathcal B_{d,n}G∈Bd,n​.

Difficulty

The class permits edges and vertex families with no geometric realization, so a proof cannot use metric or convexity properties of a particular polyhedron. Condition i) guarantees one path preserving the common labels of two endpoints; it does not directly bound that path's length. Connectivity by itself would be too weak: a connected graph on the allowed labels can have a long shortest path unless its labels and the path condition constrain it. The formal task is to obtain the claimed uniform length bound from that condition across all finite families of ddd-sets. The Dagstuhl abstract calls the argument an adaptation of Kalai and Kleitman's proof but states no intermediate lemmas, so this proposal does not assign any in-source milestones (p. 3).

Formalization scope

Lean represents [n][n][n] by Fin n, with labels 0,…,n−10,\ldots,n-10,…,n−1 instead of 1,…,n1,\ldots,n1,…,n; only the number of labels matters. A vertex set is a Finset of Finset (Fin n), and a SimpleGraph has exactly those sets as vertices. This representation enforces distinct labels. InB d n V G requires VVV to be nonempty, every label to have cardinality ddd, and CondI for every ordered pair. The walk in CondI is equivalent to the source's path: repeated vertices can be erased, and the endpoints themselves contain u∩vu\cap vu∩v. Nonemptiness and condition i) together give the source's connectedness. A path through all graph vertices without the common-intersection condition would be a weaker and inadmissible model.

The theorem takes d≥1d\geq1d≥1, so the logarithm has its ordinary positive-dimension interpretation. The source does not print a logarithm base; the statement reads it as base two, following the cited Kalai–Kleitman convention. This interpretation is explicit in the theorem's prose and is an open source-reading question. The exponent is real: the path length is cast from a natural number to R\mathbb RR for comparison with (n:R)1+log⁡2d(n:\mathbb R)^{1+\log_2 d}(n:R)1+log2​d. No floor is applied to the exponent. The theorem asserts a bounded walk for each pair; that avoids defining D(d,n)D(d,n)D(d,n) through a supremum with an artificial value for an empty class. At n=0n=0n=0 with d≥1d\geq1d≥1, InB has no instance, as there are no ddd-element labels; at d=1d=1d=1, the bound is nnn, consistent with a connected graph on at most nnn labels.

The development needs reusable finite-set reasoning about common intersections, graph walks and their lengths, and real-logarithm bounds. Contributions establishing those facts for the paper's CondI model are within scope. A proof only for polyhedron graphs, for graphs with extra edge restrictions, or for a single chosen graph would leave the goal open.

Selected references

  • F. Eisenbrand, N. Hähnle, A. Razborov and T. Rothvoß, Diameter of Polyhedra: Limits of Abstraction, Dagstuhl Seminar Proceedings 10211, 2010. Extended abstract.
  • F. Eisenbrand, N. Hähnle, A. Razborov and T. Rothvoß, Diameter of Polyhedra: Limits of Abstraction, Mathematics of Operations Research 35, 786–794, 2010. DOI.
2 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations Research·Captain: mikedeng1

Solving Large-Scale Zero-One Linear Programming Problems: A Minimal Cover Inequality Cuts Off x̄ iff the Knapsack Problem (2.12) Has Optimal Value Less Than OneResearch Paper

Motivation

Large zero–one linear programs can contain constraints involving only a small fraction of their variables. Crowder, Johnson and Padberg study how to extract useful inequalities from one such row while solving the larger program. Their computational method identifies a violated inequality at a current linear programming solution, adds it, and resolves the relaxation. The mathematical question behind that step is whether a minimal cover inequality can be found by a separate optimization problem. The authors answer it in Section 2.3 of their 1983 paper, after developing cover and configuration inequalities in Section 2.2. Crowder, Johnson and Padberg (1983)

The target is a known result from that paper. It is a precise statement about a finite knapsack row and a point in the unit cube, independent of the paper's implementation and numerical experiments. The paper also discusses (1,k)(1,k)(1,k)-configurations and lifting, which turn the identified inequalities into valid cuts involving additional row variables. Those statements supply the mission's milestones and make the separation result useful in its original setting. Crowder, Johnson and Padberg (1983), Sections 2.2–2.4

Setting

Fix a finite index set KKK, positive rational coefficients aja_jaj​ for j∈Kj\in Kj∈K, and a rational right-hand side a0a_0a0​. A zero–one solution is a vector with each xj∈{0,1}x_j\in\{0,1\}xj​∈{0,1} satisfying the single row

∑j∈Kajxj≤a0.(2.5)\sum_{j\in K}a_jx_j\le a_0. \tag{2.5}j∈K∑​aj​xj​≤a0​.(2.5)

The model uses the support set x={j:xj=1}x=\{j:x_j=1\}x={j:xj​=1} for such a vector. A set S⊆KS\subseteq KS⊆K is a minimal cover when its total coefficient exceeds a0a_0a0​, but removing any one member makes the total at most a0a_0a0​:

∑j∈Saj>a0,∑j∈Saj−ak≤a0(k∈S).(2.6)\sum_{j\in S}a_j>a_0, \qquad \sum_{j\in S}a_j-a_k\le a_0\quad(k\in S). \tag{2.6}j∈S∑​aj​>a0​,j∈S∑​aj​−ak​≤a0​(k∈S).(2.6)

It yields the cover inequality ∑j∈Sxj≤∣S∣−1\sum_{j\in S}x_j\le |S|-1∑j∈S​xj​≤∣S∣−1 for every feasible zero–one vector. The right-hand side is interpreted as a real number, so the expression also has its usual meaning when SSS is empty.

A (1,k)(1,k)(1,k)-configuration consists of S∗⊆KS^*\subseteq KS∗⊆K, t∉S∗t\notin S^*t∈/S∗ and an integer 2≤k≤∣S∗∣2\le k\le |S^*|2≤k≤∣S∗∣. The set S∗S^*S∗ itself fits the row, while Q∪{t}Q\cup\{t\}Q∪{t} is a minimal cover for every kkk-element subset QQQ of S∗S^*S∗. For any k≤r≤∣S∗∣k\le r\le |S^*|k≤r≤∣S∗∣ and rrr-element T⊆S∗T\subseteq S^*T⊆S∗, its inequality is (r−k+1)xt+∑j∈Txj≤r(r-k+1)x_t+\sum_{j\in T}x_j\le r(r−k+1)xt​+∑j∈T​xj​≤r. Crowder, Johnson and Padberg (1983), pp. 810–811

For a point xˉ∈[0,1]K\bar x\in[0,1]^Kxˉ∈[0,1]K, the separation problem asks for a cover s⊆Ks\subseteq Ks⊆K minimizing ∑j∈s(1−xˉj)\sum_{j\in s}(1-\bar x_j)∑j∈s​(1−xˉj​), subject to the strict condition ∑j∈saj>a0\sum_{j\in s}a_j>a_0∑j∈s​aj​>a0​. This is problem (2.12). The set of attainable values is finite, but it is empty if the row has no cover. An optimal value zzz is therefore asserted only when a least attainable value exists.

Formalization targets

Cover separation

The goal is the paper's Section 2.3 equivalence:

(∃S⊆K minimal:∑j∈Sxˉj>∣S∣−1)⟺z<1,\left(\exists S\subseteq K\text{ minimal}: \sum_{j\in S}\bar x_j>|S|-1\right) \quad\Longleftrightarrow\quad z<1,​∃S⊆K minimal:j∈S∑​xˉj​>∣S∣−1​⟺z<1,

where zzz is the attained optimum of (2.12). A cover inequality cuts off xˉ\bar xxˉ precisely when its left-hand side exceeds ∣S∣−1|S|-1∣S∣−1. If there is no cover, (2.12) has no optimal value; the theorem does not assign it an artificial value. Crowder, Johnson and Padberg (1983), pp. 812–813

Valid inequalities and lifting

The milestones state the validity of (2.7) and every inequality in (2.9), the two assertions used in the separation equivalence, and the relaxed lifting claims of Section 2.4. For lifting, zkz_kzk​ is the maximum integer objective value in (2.10), zˉk\bar z_kzˉk​ is the maximum in its linear relaxation, and zk∗=⌊zˉk⌋z_k^*=\lfloor\bar z_k\rfloorzk∗​=⌊zˉk​⌋. The claims are zk≤zk∗z_k\le z_k^*zk​≤zk∗​ and validity after adding variable kkk with coefficient fk=f0−zk∗f_k=f_0-z_k^*fk​=f0​−zk∗​. They concern attained optima, as the paper's “maximum” language requires. Crowder, Johnson and Padberg (1983), pp. 811, 814

Significance

The equivalence turns a geometric question about which cover inequality excludes xˉ\bar xxˉ into a finite optimization test with a numerical threshold of one. It identifies when a minimal cover cut exists for a row, while the validity milestones certify that the inequalities can be added without removing zero–one feasible points. The lifting claims explain how an inequality first written on a subset of variables remains valid as further variables enter it. These are the mathematical guarantees used by the paper's cutting plane procedure. Crowder, Johnson and Padberg (1983), Sections 2.2–2.4

The paper proves the separation equivalence and states the surrounding validity claims. This mission records their exact statements in Lean; its theorem proofs remain open. A complete development would add machine-checked proofs for the finite cover argument, configuration inequalities, and lifting validity. The resulting definitions of feasible supports, attained optimization values and intermediate inequality validity can also be reused in other finite knapsack formalizations.

Difficulty

Checking all subsets of KKK directly grows rapidly with the row size. A separation result must relate a minimum over all covers to an inequality indexed by a minimal cover, while accounting for objective coefficients that may be zero when xˉj=1\bar x_j=1xˉj​=1. The same boundary matters for lifting: the zero–one maximum is compared with a continuous relaxation, and rounding is justified by the integer coefficients of the current inequality. If the lifting problem is infeasible, neither maximum exists. Crowder, Johnson and Padberg (1983), pp. 812–814

Formalization scope

Lean uses an arbitrary finite index type for KKK, replacing the paper's indices 1,…,n1,\ldots,n1,…,n. A zero–one vector is a finite support set. Row coefficients and a0a_0a0​ are rational, as on p. 810; the point xˉ\bar xxˉ and separation values are real. The target asks only that xˉ\bar xxˉ lie in the unit cube. Although the paper obtains it as an optimum of the full LP relaxation (2.11), that additional property is not used in the row-level equivalence. No sign condition is imposed on a0a_0a0​.

The strict knapsack condition in (2.12) is retained. “Chops off” means strict violation of (2.7). “Optimal value” means membership and leastness in the attainable value set; for lifting it means membership and greatestness. Thus rows with no cover or infeasible lifting subproblem do not acquire a default zero optimum. The size expressions ∣S∣−1|S|-1∣S∣−1 and r−k+1r-k+1r−k+1 are evaluated in the reals, so natural-number truncation cannot change them. Integer lifting coefficients and the floor of the relaxed optimum express the paper's “truncating to its integer part”; the feasible relaxed problem includes the zero vector, so this agrees with truncation toward zero there.

Validity during an intermediate lifting step ranges over feasible zero–one vectors supported in the current set SSS. After adding kkk, it ranges over support in S∪{k}S\cup\{k\}S∪{k}. The final inequality covers the whole row when that set is KKK. The development must preserve the full quantifier over every kkk-subset in (2.8) and every rrr and TTT in (2.9); restricting these would weaken the paper's claim. Contributions proving the named milestones, adding concrete examples, or developing general finite optimization lemmas are in scope. The facet assertions attributed to Padberg are outside the target. A related lifted-cover facet statement already appears on the platform as NemhauserWolsey.partitioned_cover_lifting_defines_facet; its conventions and claim differ from this mission's validity results.

Selected references

  • H. Crowder, E. L. Johnson and M. Padberg, Solving Large-Scale Zero-One Linear Programming Problems, Operations Research 31(5), 803–834, 1983. DOI: 10.1287/opre.31.5.803
8 thms2 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 2: Every Convex Bipartite Order Has a Realizer of Size 3Research Paper

Motivation

The single-machine scheduling problem 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_j C_j1∣prec∣∑wj​Cj​ asks for an order in which to process nnn jobs, each with a processing time and a weight, on one machine, respecting a partial order of precedence constraints, so that the weighted sum of completion times is as small as possible. It is NP-hard, and the best known approximation ratio for general precedence constraints is 222. Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 36(4), 2011) relate the problem to the dimension theory of partial orders: their Theorem 3.2 states that when the precedence constraints are given together with a realizer of size kkk, the problem has a (2−2/k)(2 - 2/k)(2−2/k)-approximation algorithm. Small realizers of structured precedence orders therefore translate directly into better approximation ratios.

This mission formalizes one such structural result, Lemma 4.1 of the paper: every convex bipartite order has a realizer of size 333. Convex bipartite orders form a class of precedence constraints that lies strictly between strong bipartite orders and general bipartite orders (Möhring, 1989). Combined with Theorem 3.2, the lemma gives a 4/34/34/3-approximation for 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_j C_j1∣prec∣∑wj​Cj​ on this class. According to the authors, the bound dim⁡≤3\dim \le 3dim≤3 for convex bipartite orders had not been known before.

Setting

A poset is a set NNN with a reflexive, antisymmetric, transitive relation PPP. Two elements x,yx, yx,y are incomparable, written x∥yx \parallel yx∥y, when neither (x,y)∈P(x,y) \in P(x,y)∈P nor (y,x)∈P(y,x) \in P(y,x)∈P; the set of incomparable pairs is inc(P)\mathrm{inc}(P)inc(P). A linear extension of PPP is a linear order LLL on NNN with P⊆LP \subseteq LP⊆L. A linear order LLL reverses the pair (x,y)(x,y)(x,y) when y<xy < xy<x in LLL. A realizer of size ttt is a family L1,…,LtL_1, \dots, L_tL1​,…,Lt​ of linear extensions of PPP such that every incomparable pair (x,y)(x,y)(x,y) is reversed by at least one LiL_iLi​. The dimension dim⁡(P)\dim(P)dim(P) is the least ttt for which a realizer of size ttt exists.

A convex bipartite order has jobs N=J−∪J+N = J^- \cup J^+N=J−∪J+ split into minus jobs J−={j1,…,ja}J^- = \{j_1, \dots, j_a\}J−={j1​,…,ja​} and plus jobs J+={ja+1,…,jn}J^+ = \{j_{a+1}, \dots, j_n\}J+={ja+1​,…,jn​}. Each plus job jkj_kjk​ carries two indices 1≤l(k)≤r(k)≤a1 \le l(k) \le r(k) \le a1≤l(k)≤r(k)≤a, and a minus job jij_iji​ precedes jkj_kjk​ exactly when l(k)≤i≤r(k)l(k) \le i \le r(k)l(k)≤i≤r(k). There are no other precedences: the predecessors of each plus job form a nonempty interval of consecutive minus jobs.

For the Appendix construction, the incomparable pairs are sorted into three sets E1,E2,E3E_1, E_2, E_3E1​,E2​,E3​ according to the kinds of the two jobs, the order of their indices and, for a pair (plus job jij_iji​, minus job jjj_jjj​), whether jjj_jjj​ precedes some plus job of larger index than iii. The sets Eˉm=Em∪P\bar E_m = E_m \cup PEˉm​=Em​∪P describe what the mmm-th linear order of the realizer must contain.

Formalization targets

Goal: Lemma 4.1

For every convex bipartite order (N,P):∃ L1,L2,L3 linear extensions of P with ∀(x,y)∈inc(P) ∃m: y<Lmx.\text{For every convex bipartite order } (N, P):\quad \exists\, L_1, L_2, L_3 \text{ linear extensions of } P \text{ with } \forall (x,y) \in \mathrm{inc}(P)\ \exists m:\ y <_{L_m} x .For every convex bipartite order (N,P):∃L1​,L2​,L3​ linear extensions of P with ∀(x,y)∈inc(P) ∃m: y<Lm​​x.

Equivalently, dim⁡(P)≤3\dim(P) \le 3dim(P)≤3. The goal holds for every numbering of the jobs and every choice of interval ends l,rl, rl,r.

Milestones

  • Lemma A.1. E1,E2,E3E_1, E_2, E_3E1​,E2​,E3​ partition inc(P)\mathrm{inc}(P)inc(P), and for each mmm, (x,y)∈Em(x,y) \in E_m(x,y)∈Em​ implies (y,x)∉Em(y,x) \notin E_m(y,x)∈/Em​.
  • Lemma A.2. Under the Appendix's numbering of the plus jobs (i<ji < ji<j implies l(i)≤l(j)l(i) \le l(j)l(i)≤l(j)), each Eˉm\bar E_mEˉm​ is contained in a linear order on NNN.

Significance

The result. Lemma 4.1 places convex bipartite orders among the classes of precedence constraints for which 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_j C_j1∣prec∣∑wj​Cj​ has an approximation ratio strictly below 222, namely 4/34/34/3 through Theorem 3.2 of the paper. The bound is tight: a bipartite order has dimension 222 exactly when it is a strong bipartite order (Möhring), so the bound 333 cannot be lowered for the class of convex bipartite orders. Since dim⁡(P)=3\dim(P) = 3dim(P)=3 also gives χ(GP)=3\chi(G_P) = 3χ(GP​)=3 for the graph of incomparable pairs, a 333-realizer yields an optimal colouring of that graph.

Formalizing it. The result is proved in the paper, with a short case analysis in the Appendix. No machine-checked proof is known to exist. Mathlib has no dimension theory of posets: realizers, reversals of incomparable pairs and the construction of linear extensions containing a given acyclic relation have to be set up here. The definitions of realizer and linear extension are stated for an arbitrary relation and can be reused for other dimension bounds (interval orders, semiorders, the other missions of this series).

Difficulty

The three relations Eˉm\bar E_mEˉm​ are not partial orders. Eˉ2\bar E_2Eˉ2​, for instance, is not transitive: with two minus jobs and one plus job j3j_3j3​ with l(3)=r(3)=2l(3) = r(3) = 2l(3)=r(3)=2, the pairs (j1,j2)∈E2(j_1, j_2) \in E_2(j1​,j2​)∈E2​ and (j2,j3)∈P(j_2, j_3) \in P(j2​,j3​)∈P are present but (j1,j3)(j_1, j_3)(j1​,j3​) lies in E1E_1E1​. The step that requires work is to show that each Eˉm\bar E_mEˉm​ has no cycle, so that it extends to a linear order. For Eˉ2\bar E_2Eˉ2​ this depends on the convexity of the predecessor intervals and on the numbering of the plus jobs by their left ends: it is not a consequence of bipartiteness alone. The goal itself carries no numbering assumption, so any proof must also account for renumbering the plus jobs.

Formalization scope

All declarations live in the namespace SingleMachinePrec.ConvexBipartite.

  • Relations. A relation on NNN is a predicate N → N → Prop. Linear orders use Mathlib's unbundled class IsLinearOrder. A linear extension of PPP is a linear order LLL with P⊆LP \subseteq LP⊆L; LLL reverses (x,y)(x,y)(x,y) when L y xL\,y\,xLyx and y≠xy \ne xy=x. A realizer of size ttt is a function Fin t → N → N → Prop, so repeated members are allowed, as in the paper's multisets.
  • Convex bipartite orders. The jobs are the type Fin a ⊕ Fin b: Sum.inl i is the minus job ji+1j_{i+1}ji+1​, Sum.inr k the plus job ja+k+1j_{a+k+1}ja+k+1​, with indices starting at 000. The interval ends are maps l r : Fin b → Fin a with l k ≤ r k, and PPP is equality together with the pairs (minus iii, plus kkk) with l(k)≤i≤r(k)l(k) \le i \le r(k)l(k)≤i≤r(k). A file-level instance records that PPP is a partial order. Any convex bipartite order in the paper's sense is one of these after naming its jobs. The cases a=0a = 0a=0 and b=0b = 0b=0 are allowed.
  • E1,E2,E3E_1, E_2, E_3E1​,E2​,E3​. Each set is defined as "incomparable and satisfies the paper's case condition". In the plus–minus clauses, "k>ik > ik>i" compares plus indices, because kkk exceeds the index of a plus job.
  • Lemma A.2. "Eˉm\bar E_mEˉm​ is an extension of PPP" is formalized as "there is a linear order containing Eˉm\bar E_mEˉm​", which is what the paper's proof establishes (absence of cycles) and what its final paragraph uses. Reading it as "Eˉm\bar E_mEˉm​ is a partial order" would make the lemma false (see Difficulty). The Appendix's numbering assumption is the hypothesis Monotone l of this milestone only.
  • Algorithmic wording not formalized. The paper states Lemma 4.1 as "a realizer of size 3 can be computed in polynomial time". What is formalized is the existence of the realizer; the running time is not.

A trivializing formalization would let the members of the realizer be arbitrary relations, which makes reversing every pair free. Here every member must be a linear order containing PPP.

Contributions welcome: proofs of the two milestones and of the goal; a general lemma that a relation whose transitive closure is antisymmetric extends to a linear order on a finite type; and the renumbering argument that removes the numbering assumption.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • G. R. Brightwell, E. R. Scheinerman, Fractional dimension of partial orders, Order 9(2):139–158, 1992.
  • R. H. Möhring, Computationally tractable classes of ordered sets, in I. Rival (ed.), Algorithms and Order, NATO ASI Series 255, Kluwer, 1989, pp. 105–193.
  • W. T. Trotter, Combinatorics and Partially Ordered Sets: Dimension Theory, Johns Hopkins University Press, 1992.
7 thms2 active usersReviewed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

Online Stochastic Matching: Beating 1-1/e 1: When OPT = Ω(n), the Two Suggested Matchings Algorithm Achieves ALG/OPT ≥ (1 − 2/e²)/(4/3 − 2/(3e)) − ε ≈ 0.670 with Probability 1 − e^(−Ω(n))Research Paper

Motivation

Online bipartite matching models a platform that must commit each arriving request to a resource immediately. The motivating application of Feldman, Mehta, Mirrokni and Muthukrishnan is display advertising: an ad server knows from past traffic how many impressions of each type (web page, audience segment) to expect, sells them to advertisers in advance, and must assign each impression to an interested advertiser the moment a user loads the page. The goal is to fill as many contracted impressions as possible.

When arrivals are chosen by an adversary, the best ratio an online algorithm can guarantee is 1−1/e≈0.6321 - 1/e \approx 0.6321−1/e≈0.632, achieved by the RANKING algorithm of Karp, Vazirani and Vazirani (STOC 1990). The ad server, however, is not facing an adversary: it has a forecast. The i.i.d. model captures this: the graph and the distribution of impression types are known in advance, and the impressions are independent draws. The paper asks whether this knowledge allows an online algorithm to beat 1−1/e1 - 1/e1−1/e, and answers yes.

Timeline.

  • 1990: Karp, Vazirani and Vazirani give RANKING, with ratio 1−1/e1 - 1/e1−1/e for adversarial arrivals, and show this is optimal in that model.
  • 2005: Mehta, Saberi, Vazirani and Vazirani obtain 1−1/e1 - 1/e1−1/e for the budgeted AdWords generalization.
  • 2009: Feldman, Mehta, Mirrokni and Muthukrishnan (arXiv:0905.4100, FOCS 2009) show that in the i.i.d. model the two suggested matchings algorithm achieves about 0.6700.6700.670 with high probability when OPT is linear in nnn, the first ratio above 1−1/e1 - 1/e1−1/e for this model, and that no online algorithm reaches 26/2726/2726/27 in expectation.

Setting

An instance is a bipartite graph G=(A,I,E)G = (A, I, E)G=(A,I,E) with a finite set AAA of advertisers, a finite set III of impression types, and edges E⊆A×IE \subseteq A \times IE⊆A×I recording which advertisers want which types. The mission treats the case analysed throughout §4.2 of the paper, in which one impression of each type is expected (ei=1e_i = 1ei​=1). So n=∣I∣n = |I|n=∣I∣ impressions arrive one at a time, with types ω(0),…,ω(n−1)\omega(0), \dots, \omega(n-1)ω(0),…,ω(n−1) drawn independently and uniformly from III. On arrival an impression must be assigned at once and irrevocably to a still unassigned advertiser adjacent to its type, or discarded. ALG(ω)\mathrm{ALG}(\omega)ALG(ω) is the number of impressions an algorithm assigns. OPT(ω)\mathrm{OPT}(\omega)OPT(ω) is the size of a maximum matching of the realization graph, which has one node per arrival ttt, joined to every advertiser aaa with (a,ω(t))∈E(a, \omega(t)) \in E(a,ω(t))∈E.

The two suggested matchings (TSM) algorithm works offline first. Its boosted flow graph GfG_fGf​ has a source arc of capacity 222 into every advertiser, a unit-capacity arc along every edge of EEE, and an arc of capacity 222 from every type to a sink. The algorithm takes the edge set EfE_fEf​ of an integral maximum flow. Every vertex then has at most two edges of EfE_fEf​, so EfE_fEf​ splits into vertex-disjoint paths and cycles. The algorithm colours each component blue and red:

  • on cycles, the colours alternate;
  • on odd paths, the colours alternate, with more blue than red;
  • on even paths between advertisers, the colours alternate;
  • on even paths between types, the first two edges are blue, then the colours alternate, ending in blue.

Online, the first arrival of type iii tries the advertiser along iii's blue edge, the second tries the one along its red edge, and later arrivals are discarded. A tried advertiser that is already taken is not reassigned. The advertisers fall into four classes by their coloured edges: ABRA_{BR}ABR​ (one blue, one red), ABBA_{BB}ABB​ (two blue), ABA_BAB​ (one blue only) and ARA_RAR​ (one red only).

Formalization targets

Goal: Theorem 5, first sentence, ei=1e_i = 1ei​=1

Let

α=1−2/e24/3−2/(3e)≈0.67029.\alpha = \frac{1 - 2/e^2}{4/3 - 2/(3e)} \approx 0.67029 .α=4/3−2/(3e)1−2/e2​≈0.67029.

The goal has three parts. First, every maximum flow edge set admits a colouring that follows the rules. Second, for every ε>0\varepsilon > 0ε>0 and c>0c > 0c>0 there are δ>0\delta > 0δ>0 and NNN such that, for every instance with n≥Nn \ge Nn≥N, every maximum flow edge set and every rule-following colouring,

Pr⁡ω[ OPT≥c n  ⟹  ALG≥(α−ε) OPT ]  ≥  1−e−δn.\Pr_\omega\big[\ \mathrm{OPT} \ge c\,n \implies \mathrm{ALG} \ge (\alpha - \varepsilon)\,\mathrm{OPT}\ \big] \;\ge\; 1 - e^{-\delta n}.ωPr​[ OPT≥cn⟹ALG≥(α−ε)OPT ]≥1−e−δn.

Third, α>1−1/e\alpha > 1 - 1/eα>1−1/e.

Milestones

  1. Facts 1 and 2: concentration for two balls-in-bins statistics.
  2. The note of §4.2.1: each type has no coloured edge, one blue edge, or one blue and one red edge.
  3. Equation (1): ∣Ef∣=2∣ABR∣+2∣ABB∣+∣AB∣+∣AR∣|E_f| = 2|A_{BR}| + 2|A_{BB}| + |A_B| + |A_R|∣Ef​∣=2∣ABR​∣+2∣ABB​∣+∣AB​∣+∣AR​∣.
  4. Equation (2): with high probability, ALG≥(1−1/e2)∣ABB∣+(1−2/e2)∣ABR∣+(1−3/(2e))(∣AB∣+∣AR∣)−4εn\mathrm{ALG} \ge (1 - 1/e^2)|A_{BB}| + (1 - 2/e^2)|A_{BR}| + (1 - 3/(2e))(|A_B| + |A_R|) - 4\varepsilon nALG≥(1−1/e2)∣ABB​∣+(1−2/e2)∣ABR​∣+(1−3/(2e))(∣AB​∣+∣AR​∣)−4εn.
  5. Equation (3): ∣Ef∣=2(∣AT∣+∣IS∣)+∣Eδ∣|E_f| = 2(|A_T| + |I_S|) + |E_\delta|∣Ef​∣=2(∣AT​∣+∣IS​∣)+∣Eδ​∣ for the surgered residual cut (S,T)(S,T)(S,T) of GfG_fGf​.
  6. Equation (4): with high probability, OPT≤∣ABR∣+∣ABB∣+12(∣AB∣+∣AR∣)+(12−1e)∣Eδ∣+εn\mathrm{OPT} \le |A_{BR}| + |A_{BB}| + \tfrac12(|A_B| + |A_R|) + (\tfrac12 - \tfrac1e)|E_\delta| + \varepsilon nOPT≤∣ABR​∣+∣ABB​∣+21​(∣AB​∣+∣AR​∣)+(21​−e1​)∣Eδ​∣+εn.
  7. Lemma 1: ∣Eδ∣≤23∣ABR∣+43∣ABB∣+∣AB∣+13∣AR∣|E_\delta| \le \tfrac23|A_{BR}| + \tfrac43|A_{BB}| + |A_B| + \tfrac13|A_R|∣Eδ​∣≤32​∣ABR​∣+34​∣ABB​∣+∣AB​∣+31​∣AR​∣.

Significance

The theorem separates the i.i.d. model from the adversarial one: knowing the distribution is worth a constant factor above 1−1/e1 - 1/e1−1/e. The suggested matching algorithm of the same paper (Theorem 4) shows that following a single offline matching gets exactly 1−1/e1 - 1/e1−1/e, so the second, red matching is what crosses the barrier. The paper's question started a line of work on the i.i.d. and random-order models, with later improvements to the constant by other authors under further assumptions.

The result has a written proof but, as far as the platform record shows, no machine-checked one. The mission formalizes the paper's own argument: the flow-and-colouring construction, the balls-in-bins concentration facts, the cut-based bound on OPT and the combinatorial Lemma 1. It also fixes two slips in the printed statements (see Formalization scope). The pieces are reusable beyond this paper. The occupancy concentration (Fact 1) and the satisfied-sequences bound (Fact 2) recur in analyses of online algorithms with stochastic input. The degree-capped flow encoding and its path/cycle decomposition are standard tools for 2-matchings.

Difficulty

The upper bound on OPT is the delicate part. A cut of the flow graph bounds the maximum matching of the realization graph only after a second surgery that depends on the random arrivals. Its size must then be compared with the colour classes, which are defined by a different structure (the components of EfE_fEf​). Lemma 1 bridges the two, and it depends on the exact colouring rules: a colouring that only satisfies local degree conditions can put red edges at both ends of an even advertiser path, which breaks the inequality ∣AB∣≥∣AR∣|A_B| \ge |A_R|∣AB​∣≥∣AR​∣ behind (2). On the probabilistic side, the advertisers of ABRA_{BR}ABR​ share impression types with each other, so the success events are dependent, and Fact 2 needs a bounded-differences argument in which one ball affects up to ddd sequences.

Formalization scope

All declarations live in the namespace OnlineStochMatching.TSM. Advertisers and types are finite types A I : Type, and EEE is a Finset (A × I). Probabilities are counting ratios #{ω:Fin n→I∣P ω}/∣I∣n\#\{\omega : \mathrm{Fin}\ n \to I \mid P\,\omega\}/|I|^n#{ω:Fin n→I∣Pω}/∣I∣n, so there are no measurability side conditions. OPT is a maximum over the finite, nonempty set of partial injective assignments. An integral flow of GfG_fGf​ is its set of saturated middle edges, i.e. a subset of EEE with at most two edges per vertex; EfE_fEf​ is such a set of maximum cardinality. A colouring is given by a listing of the components of EfE_fEf​ as vertex sequences. Every theorem quantifies over every maximum EfE_fEf​ and every colouring the rules allow, since the paper fixes neither.

The paper's asymptotic phrases are replaced by explicit quantifiers that come from its own proofs:

  • "with probability 1−e−Ω(n)1 - e^{-\Omega(n)}1−e−Ω(n)" and "with high probability" (Theorem 5, (2), (4)) become: ∃ δ>0, ∃ N\exists\, \delta > 0,\ \exists\, N∃δ>0, ∃N, chosen before the instance, with probability at least 1−e−δn1 - e^{-\delta n}1−e−δn for all n≥Nn \ge Nn≥N;
  • "as long as OPT =Ω(n)= \Omega(n)=Ω(n)" becomes the event OPT≥c n\mathrm{OPT} \ge c\,nOPT≥cn for an arbitrary c>0c > 0c>0 fixed before δ\deltaδ and NNN;
  • the O(1)O(1)O(1) term in the bound on ∣Aδ∗∣|A^*_\delta|∣Aδ∗​∣ (p. 8) is absorbed into εn\varepsilon nεn for n≥Nn \ge Nn≥N.

Corrections to the printed statements:

  • Theorem 5 prints ALG/OPT−ϵ≥α\mathrm{ALG}/\mathrm{OPT} - \epsilon \ge \alphaALG/OPT−ϵ≥α; the proof concludes ALG/OPT+ϵ≥α\mathrm{ALG}/\mathrm{OPT} + \epsilon \ge \alphaALG/OPT+ϵ≥α, so the goal states ALG≥(α−ε)OPT\mathrm{ALG} \ge (\alpha - \varepsilon)\mathrm{OPT}ALG≥(α−ε)OPT;
  • Fact 1 prints the failure probability 2e−ϵn/22e^{-\epsilon n/2}2e−ϵn/2; its proof gives 2e−ϵ2n/22e^{-\epsilon^2 n/2}2e−ϵ2n/2, which is used;
  • Fact 2 states two hypotheses its proof uses: the bins of a sequence are distinct, and c2<nc^2 < nc2<n.

The ratio is multiplied out, so no division by OPT occurs. A colouring condition that is unsatisfiable, or a flow set that is not maximum, would make the goal vacuous or false; part (a) of the goal rules out the first, and every statement requires maximality. Not included: the reduction to general integer eie_iei​ (§4.2.4), the tightness sentence of Theorem 5 (§4.2.5), and footnote 7's variant of the algorithm.

Useful infrastructure: bounded-differences (McDiarmid/Azuma) inequalities for functions of i.i.d. uniform variables, which exist on the platform as separate theorems; path/cycle decomposition of graphs of maximum degree two; and max-flow min-cut for unit-capacity bipartite networks. Contributions are welcome on Facts 1 and 2 independently of the combinatorics, and on Lemma 1 and equations (1) and (3), which are deterministic.

Selected references

  • J. Feldman, A. Mehta, V. Mirrokni, S. Muthukrishnan, Online Stochastic Matching: Beating 1-1/e, FOCS 2009; arXiv:0905.4100v1. https://arxiv.org/abs/0905.4100
  • R. M. Karp, U. V. Vazirani, V. V. Vazirani, An optimal algorithm for on-line bipartite matching, STOC 1990. https://doi.org/10.1145/100216.100262
  • A. Mehta, A. Saberi, U. Vazirani, V. Vazirani, AdWords and generalized online matching, FOCS 2005; J. ACM 54(5), 2007. https://doi.org/10.1145/1284320.1284321
13 thms2 active usersReviewed
🏆Completed
Graph TheoryOperations Research·Captain: mikedeng1

On the Graph Structure of Convex Polyhedra in n-Space II: Whitney's Theorem, a Graph Is n-Tuply Connected iff Any Two Points Are Joined by n Disjoint PathsResearch Paper

Motivation

Vertex connectivity measures how robust a network is against the failure of nodes. It can be measured in two ways that look different. One way counts the fewest nodes whose removal disconnects the network. The other counts the routes between two nodes that share no intermediate node. Whitney's theorem (1932) says that the two measures agree for every pair of nodes. It is the vertex form of Menger's theorem, and it underlies reliability analysis of communication and transportation networks, the design of fault-tolerant routing, and much of structural graph theory.

M. L. Balinski's 1961 paper On the graph structure of convex polyhedra in n-space proves that the graph of a bounded full-dimensional polyhedron in nnn-space is nnn-tuply connected (the subject of Mission I of this series). It then invokes Whitney's theorem to conclude that any two vertices of such a polyhedron are joined by nnn disjoint paths. Balinski gives a short new proof of Whitney's theorem through the max-flow min-cut theorem of Ford and Fulkerson and of Dantzig and Fulkerson. That makes the theorem a consequence of linear programming duality. This mission formalizes that part of the paper: the network vocabulary, the max-flow min-cut theorem with capacities on both points and lines, the integrality of maximum flows, and Whitney's theorem itself.

Timeline.

  • 1927: Menger states the disjoint-paths theorem for separating sets.
  • 1932: Whitney proves the characterization of nnn-connected graphs by nnn disjoint paths between every pair of points.
  • 1956: Ford and Fulkerson and Dantzig and Fulkerson prove the max-flow min-cut theorem.
  • 1961: Balinski derives Whitney's theorem from it with a unit-capacity network.

Setting

A graph GGG consists of a finite set VVV of points and a set of lines, each line being a pair of distinct points. A path from psp_sps​ to pkp_kpk​ is a sequence of lines (p1,p2),(p2,p3),…,(pm,pm+1)(p_1,p_2),(p_2,p_3),\dots,(p_m,p_{m+1})(p1​,p2​),(p2​,p3​),…,(pm​,pm+1​) with p1=psp_1 = p_sp1​=ps​, pm+1=pkp_{m+1} = p_kpm+1​=pk​ and m≥1m \ge 1m≥1. Paths are disjoint if they have no point in common except possibly their first and last points.

GGG is nnn-tuply connected if it has at least n+1n+1n+1 points and, for every set XXX of fewer than nnn points, the graph G−XG - XG−X remaining after deleting XXX is connected. GGG has nnn disjoint paths from psp_sps​ to pkp_kpk​ if there are nnn pairwise distinct paths from psp_sps​ to pkp_kpk​, none of which repeats a point, and no two of which share a point other than psp_sps​ and pkp_kpk​.

A network is a connected graph with a capacity c(x)≥0c(x) \ge 0c(x)≥0 on every point and c(e)≥0c(e) \ge 0c(e)≥0 on every line, and with a distinguished source psp_sps​ and sink pkp_kpk​. A flow assigns a number f(C)≥0f(C) \ge 0f(C)≥0 to every path CCC from psp_sps​ to pkp_kpk​, such that for every point xxx and every line eee

∑C∋xf(C)≤c(x),∑C∋ef(C)≤c(e).\sum_{C \ni x} f(C) \le c(x), \qquad \sum_{C \ni e} f(C) \le c(e).C∋x∑​f(C)≤c(x),C∋e∑​f(C)≤c(e).

Its value is val⁡(f)=∑Cf(C)\operatorname{val}(f) = \sum_C f(C)val(f)=∑C​f(C). A disconnecting set is a pair (X,F)(X,F)(X,F) of points and lines that meets every walk from psp_sps​ to pkp_kpk​. Its value is ∑x∈Xc(x)+∑e∈Fc(e)\sum_{x\in X} c(x) + \sum_{e \in F} c(e)∑x∈X​c(x)+∑e∈F​c(e).

The unit network of the proof has capacity 111 on every point except psp_sps​ and pkp_kpk​, and capacity n+1n+1n+1 on every line except the line pspkp_sp_kps​pk​ (if present), which has capacity 111. In Lean these are IsNTuplyConnected, HasNDisjointPaths, IsFlow, flowValue, IsDisconnecting, cutValue, unitCapV and unitCapE, all in the namespace Balinski61.Whitney.

Formalization targets

Goal: Whitney's theorem (p. 434)

For a finite graph GGG with at least two points and any n≥0n \ge 0n≥0:

G is n-tuply connected  ⟺  for all ps≠pk, G has n disjoint paths from ps to pk.G \text{ is } n\text{-tuply connected} \iff \text{for all } p_s \ne p_k,\ G \text{ has } n \text{ disjoint paths from } p_s \text{ to } p_k.G is n-tuply connected⟺for all ps​=pk​, G has n disjoint paths from ps​ to pk​.

Both directions are part of the goal.

Milestones, in the order of the proof

  1. Max-flow min-cut (p. 433). In every network there is a number MMM that is the value of some flow and of some disconnecting set, with every flow of value at most MMM and every disconnecting set of value at least MMM.
  2. Integrality (p. 434). If all capacities are integers, some maximum flow has only integer path flows.
  3. Min-cut in the unit network (p. 434). If GGG is nnn-tuply connected and ps≠pkp_s \ne p_kps​=pk​, every disconnecting set of the unit network has value at least nnn.
  4. Paths from unit flows (p. 434). An integral flow of value at least nnn in the unit network yields nnn disjoint paths from psp_sps​ to pkp_kpk​.
  5. Sufficiency (p. 434). If every pair of distinct points is joined by nnn disjoint paths, GGG is nnn-tuply connected.

Significance

Whitney's theorem turns a statement about all small deletion sets into the existence of explicit, verifiable path systems, and back again. In applications it certifies connectivity by exhibiting paths, and it certifies that connectivity is no larger by exhibiting a separating set. It is the base of the theory of kkk-connected graphs: ear decompositions, the fan lemma, and the structure of minimally kkk-connected graphs all use it. Inside this paper it supplies the COROLLARY that any two vertices of a bounded full-dimensional polyhedron in nnn-space are joined by nnn disjoint edge paths.

None of these results is formalized for vertex connectivity at this Mathlib revision. Mathlib has edge connectivity and connected components but no vertex Menger theorem. The Prove2Me library has max-flow min-cut statements for arc capacities only and integrality results for basic solutions of network LPs, but no flow model with capacities on points. A completed development gives a reusable vertex-capacitated max-flow min-cut theorem for undirected graphs and the first machine-checked Whitney theorem in this library. The results are classical and proved; the remaining work is the formalization.

Difficulty

The sufficiency direction is elementary. The necessity direction needs a global object (a flow, or a family of paths) to exist from purely local hypotheses about deletions. The obvious induction on nnn, which deletes a point and applies the hypothesis to a smaller graph, does not keep the path systems disjoint. In Balinski's route the weight falls on max-flow min-cut and integrality for path flows with capacities on points, neither of which exists in the library. A second difficulty sits in a case the paper's proof skips: a disconnecting set of the unit network may use the line pspkp_sp_kps​pk​ (capacity 111) together with up to n−2n-2n−2 points, and the deletion hypothesis of nnn-tuple connectedness speaks only about points.

Formalization scope

Graphs are Mathlib SimpleGraphs on a Fintype with decidable equality and adjacency. Paths are walks with IsPath. A flow is a real function on the finite type G.Path ps pk of simple paths; "through a point" and "through a line" mean membership in the walk's support and edge list. Capacities are functions V → ℝ and Sym2 V → ℝ. Nonnegativity, connectivity of GGG and ps≠pkp_s \ne p_kps​=pk​ are hypotheses of the network theorems.

The following readings of loose phrases are explicit in the statements:

  • "dropping out n−1n-1n−1 or fewer points" is ∣X∣<n|X| < n∣X∣<n;
  • "nnn disjoint paths" means nnn pairwise distinct simple paths. The printed path syntax permits repeated vertices; in a graph with lines psap_s aps​a, psbp_s bps​b, and pspkp_s p_kps​pk​, the distinct walks ps,a,ps,pkp_s,a,p_s,p_kps​,a,ps​,pk​ and ps,b,ps,pkp_s,b,p_s,p_kps​,b,ps​,pk​ share only their endpoints even though the graph is not 222-tuply connected. The theorem therefore uses its conventional simple-path reading;
  • path flows live on simple paths (merging and shortcutting changes no maximum value);
  • the paper leaves the capacities of psp_sps​ and pkp_kpk​ in the unit network unassigned, and here they are n+1n+1n+1;
  • "the condition is sufficient is obvious" is the full statement that nnn-tuple connectedness follows;
  • the hypothesis ∣V∣≥2|V| \ge 2∣V∣≥2 is added to the goal and to sufficiency, because the paper's "any pair of points" presupposes it and the equivalence fails for a one-point graph.

The max-flow min-cut milestone states that the maximum and the minimum are attained. A statement that only bounds some flow by every cut is satisfied by the zero flow. A connectivity notion without the n+1n+1n+1 point count would make every complete graph nnn-connected for all nnn. Both trivializations are excluded.

Contributions welcome: a vertex-capacitated augmenting-path or LP-duality proof of max-flow min-cut for path flows, integrality by an augmenting-path argument, the unit-network lemmas, and direct combinatorial proofs of Whitney's theorem that bypass flows.

Selected references

  • M. L. Balinski, On the graph structure of convex polyhedra in n-space, Pacific J. Math. 11 (1961), 431–434. https://doi.org/10.2140/pjm.1961.11.431
  • H. Whitney, Congruent graphs and the connectivity of graphs, Amer. J. Math. 54 (1932), 150–168. https://doi.org/10.2307/2371086
  • L. R. Ford, Jr. and D. R. Fulkerson, Maximal flow through a network, Canadian J. Math. 8 (1956), 399–404. https://doi.org/10.4153/CJM-1956-045-5
  • G. B. Dantzig and D. R. Fulkerson, On the max-flow min-cut theorem of networks, in Linear Inequalities and Related Systems, Ann. of Math. Stud. 38, Princeton Univ. Press, 1956, 215–221. https://doi.org/10.1515/9781400881987
  • K. Menger, Zur allgemeinen Kurventheorie, Fund. Math. 10 (1927), 96–115. https://doi.org/10.4064/fm-10-1-96-115
9 thms2 active usersReviewed
Machine LearningTheoretical Computer Science·Captain: mikedeng1

A Characterization of Multiclass Learnability 1: Classes of Finite DS Dimension Have n → r Sample Compression Schemes with r Polylogarithmic in nResearch Paper

Motivation

In multiclass classification a learner sees examples (x,y)(x, y)(x,y) with xxx in a domain X\mathcal XX and a label yyy in a set Y\mathcal YY, and must predict labels of new points. When Y\mathcal YY is finite, the Natarajan dimension characterizes PAC learnability, extending the role of the VC dimension in binary classification (Natarajan 1989; Ben-David, Cesa-Bianchi, Haussler, Long 1995). Label sets in practice are often unbounded: structured prediction, ranking, and language modelling all predict from very large or infinite label spaces. For infinite Y\mathcal YY the Natarajan dimension fails to characterize learnability, and the question of which combinatorial parameter does was left open by Daniely and Shalev-Shwartz.

Timeline:

  • 1989–1995. Natarajan, then Ben-David et al. and Haussler–Long: for finite Y\mathcal YY, learnability is equivalent to finite Natarajan dimension, with sample complexity depending on log⁡∣Y∣\log|\mathcal Y|log∣Y∣.
  • 2011–2015. Daniely, Sabato, Ben-David and Shalev-Shwartz show that ERM can fail for multiclass problems with many labels. Daniely and Shalev-Shwartz (COLT 2014) introduce the DS dimension, prove that finite DS dimension is necessary for learnability, and ask whether it is sufficient.
  • 2022. Brukhim, Carmon, Dinur, Moran, Yehudayoff prove sufficiency, so the DS dimension characterizes multiclass PAC learnability, and show that the Natarajan dimension does not.

Setting

A concept class is a set H⊆YX\mathcal H\subseteq\mathcal Y^{\mathcal X}H⊆YX of functions. For a sequence S=(x1,…,xn)S=(x_1,\dots,x_n)S=(x1​,…,xn​) the projection H∣S⊆Yn\mathcal H|_S\subseteq\mathcal Y^nH∣S​⊆Yn is the set of label words (h(x1),…,h(xn))(h(x_1),\dots,h(x_n))(h(x1​),…,h(xn​)), h∈Hh\in\mathcal Hh∈H. A finite non-empty set B⊆YdB\subseteq\mathcal Y^dB⊆Yd is a pseudo-cube if every h∈Bh\in Bh∈B has, in every coordinate iii, a neighbour g∈Bg\in Bg∈B that differs from hhh exactly in coordinate iii. The sequence SSS is DS-shattered if H∣S\mathcal H|_SH∣S​ contains an nnn-dimensional pseudo-cube, and the DS dimension dDS(H)d_{DS}(\mathcal H)dDS​(H) is the maximum length of a DS-shattered sequence. The Natarajan dimension dN(H)≤dDS(H)d_N(\mathcal H)\le d_{DS}(\mathcal H)dN​(H)≤dDS​(H) is the same with Boolean cubes ∏i{f(i),g(i)}\prod_i\{f(i),g(i)\}∏i​{f(i),g(i)}, f(i)≠g(i)f(i)\ne g(i)f(i)=g(i), in place of pseudo-cubes.

A sample S∈(X×Y)nS\in(\mathcal X\times\mathcal Y)^nS∈(X×Y)n is H\mathcal HH-realizable if some h∈Hh\in\mathcal Hh∈H is consistent with it. An n→rn\to rn→r sample compression scheme for H\mathcal HH (Littlestone and Warmuth 1986) is a single reconstruction function ρ:(X×Y)r→YX\rho:(\mathcal X\times\mathcal Y)^r\to\mathcal Y^{\mathcal X}ρ:(X×Y)r→YX such that every realizable sample of size nnn contains rrr of its examples S′S'S′ with ρ(S′)\rho(S')ρ(S′) consistent with the whole sample. Logarithms are base 222 throughout.

Formalization targets

Goal: Theorem 36 (p. 22)

For H\mathcal HH with dDS(H)=dDS<∞d_{DS}(\mathcal H)=d_{DS}<\inftydDS​(H)=dDS​<∞ and dN(H)=dNd_N(\mathcal H)=d_NdN​(H)=dN​, and all integers n,t>0n,t>0n,t>0, there is an n→rn\to rn→r sample compression scheme, r≤nr\le nr≤n, with

r≤(dDS+t+1t+1(dDS+t)+103dNlog⁡((dDS+t+1t+1)log⁡(2n)))log⁡(2n).r\le\left(\frac{d_{DS}+t+1}{t+1}(d_{DS}+t)+10^3d_N\log\left(\binom{d_{DS}+t+1}{t+1}\log(2n)\right)\right)\log(2n).r≤(t+1dDS​+t+1​(dDS​+t)+103dN​log((t+1dDS​+t+1​)log(2n)))log(2n).

Milestones

The scheme combines two components, each with its own chain of results:

  • List learning from the DS dimension. Lemma 13 (orientations of out-degree ≤d\le d≤d on Yd+1\mathcal Y^{d+1}Yd+1), Claim 16 (the one-inclusion algorithm is right on some leave-one-out example), Fact 14 (leave-one-out symmetrization), Proposition 32 (a list PAC learner with list size (d+tt)\binom{d+t}{t}(td+t​) and success probability t+1d+t+1\frac{t+1}{d+t+1}d+t+1t+1​), Lemma 39 (an n→r1n\to r_1n→r1​ list compression scheme with r1≤dDS+t+1t+1(dDS+t)log⁡(2n)r_1\le\frac{d_{DS}+t+1}{t+1}(d_{DS}+t)\log(2n)r1​≤t+1dDS​+t+1​(dDS​+t)log(2n) and menu size ≤(dDS+t+1t+1)log⁡(2n)\le\binom{d_{DS}+t+1}{t+1}\log(2n)≤(t+1dDS​+t+1​)log(2n)).
  • Learning from a menu via shifting. Claim 22, Corollary 23, Claim 26, Proposition 27 (avd⁡≤4dE\operatorname{avd}\le4d_Eavd≤4dE​), Corollary 28, Lemma 29 (dE≤5dNlog⁡pd_E\le5d_N\log pdE​≤5dN​logp), Lemma 17 (orientations of out-degree ≤20dNlog⁡p\le20d_N\log p≤20dN​logp on [p]n[p]^n[p]n), Proposition 34 (error ≤20dNlog⁡(p)/n\le20d_N\log(p)/n≤20dN​log(p)/n given a ppp-menu), Lemma 40 (an n→r2n\to r_2n→r2​ compression scheme given a ppp-menu with r2≤103dNlog⁡(p)log⁡(2n)r_2\le10^3d_N\log(p)\log(2n)r2​≤103dN​log(p)log(2n)).

Significance

Theorem 36 is the algorithmic heart of the characterization: by the standard "compression implies generalization" argument it gives PAC learnability of every class of finite DS dimension, with sample complexity O~(dDS3/2/ϵ)\tilde O(d_{DS}^{3/2}/\epsilon)O~(dDS3/2​/ϵ) in the realizable case (t=⌈dDS1/2⌉t=\lceil d_{DS}^{1/2}\rceilt=⌈dDS1/2​⌉), and with the agnostic case following by known reductions. It also exhibits sample compression schemes of size polylogarithmic in nnn for multiclass classes with infinitely many labels, in contrast to the constant-size schemes known for finite VC classes.

The result is proved in the paper; none of it is formalized. The formalization would produce a machine-checked theory of one-inclusion graphs and their orientations, multiclass shifting, the exponential dimension, list learning, and sample compression schemes for arbitrary label sets. These objects recur throughout learning theory (one-inclusion graphs in optimal PAC learning, shifting in VC theory), so the infrastructure is reusable beyond this mission.

Difficulty

The natural first idea, running empirical risk minimization or bounding the Natarajan dimension, fails: classes with Natarajan dimension 111 and infinitely many labels can be unlearnable, and ERM can fail even for learnable classes. The DS dimension gives only a weak guarantee: by Claim 16, among d+1d+1d+1 leave-one-out runs, one is correct. Turning this into a learner requires a list learner whose menus are still of unbounded total size, and then learning with a menu of size ppp, where the obstacle is controlling one-inclusion graph orientations over [p]n[p]^n[p]n by the Natarajan dimension. Multiclass shifting does not preserve the average degree (Example 20), so the binary argument breaks down, and a new potential (avd⁡′\operatorname{avd}'avd′) and a new dimension (dEd_EdE​) are needed. Lemma 13 for infinite classes needs a compactness argument.

Formalization scope

Lean conventions:

  • A class is H : Set (X → Y) with arbitrary types X, Y; sequences and samples are functions on Fin n ([n][n][n] is 0-based).
  • The DS, Natarajan and exponential dimensions are suprema in ℕ∞, so unbounded families give ⊤; hypotheses are written dsDim H = dDS with dDS : ℕ. A pseudo-cube is required to be finite.
  • Logarithms are Real.logb 2. Menu sizes use Set.encard.
  • A compression scheme is a reconstruction function fixed before the sample (∃ ρ, ∀ S, ∃ S'); a subsample may repeat and reorder examples. Theorem 36 states r≤nr\le nr≤n explicitly.
  • Orientations of the one-inclusion graph of V⊆YmV\subseteq\mathcal Y^mV⊆Ym are maps sending a direction iii and a vertex vvv to the head of the edge of direction iii through vvv; the out-degree of vvv counts directions whose head is not vvv.
  • Classes over [p][p][p] use labels Fin p; the shifting condition 1≤g(i)≤∣ef∣1\le g(i)\le|e_f|1≤g(i)≤∣ef​∣ becomes g(i)<∣ef∣g(i)<|e_f|g(i)<∣ef​∣.
  • The one-inclusion algorithm (Algorithms 1 and 3) is parametrized by a permutation-equivariant choice of minimal orientations, the reading under which the paper's leave-one-out proofs are valid; statements about the algorithm hold for every such choice. Its default output on non-realizable input requires a non-empty label set, assumed in Claim 16 and Propositions 32 and 34. Lemma 40 assumes a non-empty label set because it is false for X≠∅=Y\mathcal X\ne\emptyset=\mathcal YX=∅=Y.
  • Distributions are discrete (PMF), and i.i.d. probabilities are sums over Zm\mathcal Z^mZm. The measure-theoretic generality of the paper is not attempted.

A trivial formalization is ruled out by these choices. Placing the reconstruction function after the sample would let it output the consistent hypothesis. A dimension in ℕ defined by sSup would be 000 for infinite dimension. Pseudo-cubes without finiteness would change the dimension (Example 8).

Contributions welcome: proofs of any milestone, in particular the shifting results of §3 (self-contained combinatorics on finite classes), Fact 14 (pure discrete probability), and Lemma 13; general-purpose lemmas about one-inclusion graphs, orientations and sample compression schemes are reusable by other learning-theory missions.

Selected references

  • N. Brukhim, D. Carmon, I. Dinur, S. Moran, A. Yehudayoff, A Characterization of Multiclass Learnability, FOCS 2022; arXiv:2203.01550v1 (2022). https://arxiv.org/abs/2203.01550
  • A. Daniely, S. Shalev-Shwartz, Optimal Learners for Multiclass Problems, COLT 2014. https://arxiv.org/abs/1405.2690
  • N. Littlestone, M. Warmuth, Relating Data Compression and Learnability, unpublished technical report, University of California, Santa Cruz, 1986 (no stable link).
  • D. Haussler, N. Littlestone, M. Warmuth, Predicting {0,1}-Functions on Randomly Drawn Points, Information and Computation 115(2), 1994. https://doi.org/10.1006/inco.1994.1097
  • D. Haussler, P. M. Long, A Generalization of Sauer's Lemma, Journal of Combinatorial Theory, Series A 71(2), 1995. https://doi.org/10.1016/0097-3165(95)90006-3
  • S. Ben-David, N. Cesa-Bianchi, D. Haussler, P. M. Long, Characterizations of Learnability for Classes of {0,…,n}-Valued Functions, JCSS 50(1), 1995. https://doi.org/10.1006/jcss.1995.1008
  • B. K. Natarajan, On Learning Sets and Functions, Machine Learning 4, 1989. https://doi.org/10.1007/BF00114804
20 thms2 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 6: The Optimal Value of S_G Lies Between n² − an²(ln 1/a + 2) and n² − an²Research Paper

Motivation

The problem 1 ∣ prec ∣ ∑wjCj1\,|\,\mathrm{prec}\,|\,\sum w_jC_j1∣prec∣∑wj​Cj​ asks for a single-machine sequence of jobs, respecting precedence constraints, that minimizes the weighted sum of completion times. It has been known to be strongly NP-hard since Lawler (1978) and Lenstra and Rinnooy Kan (1978), several different 2-approximation algorithms are known, and closing the approximability gap is listed by Schuurman and Woeginger (1999) as one of ten outstanding open problems in scheduling theory. Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 36(4), 2011) give the first inapproximability result for this problem: under a widely believed complexity assumption it has no polynomial-time approximation scheme (PTAS). The bridge to that result is a quantitative link, Lemma 9.1, between the optimal value of a special bipartite scheduling instance and the maximum edge biclique of a bipartite graph, a problem whose hardness of approximation was established by Ambühl, Mastrolilli and Svensson (FOCS 2007). This mission formalizes that link.

Setting

A schedule of a finite job set is a sequence σ\sigmaσ listing every job once; the machine processes the jobs in that order from time 000 without idle time or pre-emption. Job jjj has a processing time pjp_jpj​ and a weight wjw_jwj​; its completion time CjC_jCj​ is the sum of the processing times of the jobs up to and including jjj, and the value of σ\sigmaσ is val(σ)=∑jwjCj\mathrm{val}(\sigma)=\sum_j w_jC_jval(σ)=∑j​wj​Cj​. Precedence constraints are a relation PPP on jobs: (i,j)∈P(i,j)\in P(i,j)∈P with i≠ji\ne ji=j means job iii must be completed before job jjj starts. A schedule respecting all of them is feasible, and a feasible schedule σ∗\sigma^*σ∗ of least value is optimal.

Let G=(U,V,E)G=(U,V,E)G=(U,V,E) be an nnn-by-nnn bipartite graph: ∣U∣=∣V∣=n|U|=|V|=n∣U∣=∣V∣=n and E⊆U×VE\subseteq U\times VE⊆U×V. An edge biclique is a pair A⊆UA\subseteq UA⊆U, B⊆VB\subseteq VB⊆V with A×B⊆EA\times B\subseteq EA×B⊆E, of value ∣A∣⋅∣B∣|A|\cdot|B|∣A∣⋅∣B∣; the maximum edge biclique problem (Definition 9.1) asks for one of largest value. The bipartite scheduling instance SGS_GSG​ has jobs U∪VU\cup VU∪V and precedence constraints

P=(U×V)∖E,P=(U\times V)\setminus E,P=(U×V)∖E,

so u∈Uu\in Uu∈U must precede v∈Vv\in Vv∈V exactly when (u,v)(u,v)(u,v) is not an edge. Jobs of UUU have p=1p=1p=1, w=0w=0w=0; jobs of VVV have p=0p=0p=0, w=1w=1w=1. Thus val(σ)=∑v∈VCv\mathrm{val}(\sigma)=\sum_{v\in V}C_vval(σ)=∑v∈V​Cv​, where CvC_vCv​ is the number of UUU-jobs scheduled before vvv. For i≥1i\ge1i≥1, σ(i)\sigma(i)σ(i) denotes the number of VVV-jobs scheduled before iii jobs of UUU have been scheduled.

In the Lean development these are weightedCompletion, IsOptimalSchedule, IsEdgeBiclique, maxBicliqueValue, precSG, procSG, weightSG, valSG, IsOptimalSG and vBefore in the namespace SingleMachinePrec.Biclique.

Formalization targets

Goal: Lemma 9.1 (p. 666)

If a maximum edge biclique of GGG has value an2an^2an2 with a∈(0,1]a\in(0,1]a∈(0,1], then SGS_GSG​ has an optimal schedule and every optimal schedule σ∗\sigma^*σ∗ satisfies

n2−an2(ln⁡1a+2)≤val(σ∗)≤n2−an2.n^2-an^2\Bigl(\ln\frac1a+2\Bigr)\le\mathrm{val}(\sigma^*)\le n^2-an^2 .n2−an2(lna1​+2)≤val(σ∗)≤n2−an2.

Milestones (proof of Lemma 9.1, §9, p. 666)

  1. For every edge biclique (A,B)(A,B)(A,B), a schedule in the block order U∖A→B→A→V∖BU\setminus A\to B\to A\to V\setminus BU∖A→B→A→V∖B exists, and every such schedule is feasible with
val(σ)=n2−∣A∣⋅∣B∣.\mathrm{val}(\sigma)=n^2-|A|\cdot|B| .val(σ)=n2−∣A∣⋅∣B∣.
  1. For every schedule, σ(n+1)=n\sigma(n+1)=nσ(n+1)=n and
val(σ)=∑i=1n(σ(i+1)−σ(i))i=n2−∑i=1nσ(i).\mathrm{val}(\sigma)=\sum_{i=1}^n\bigl(\sigma(i+1)-\sigma(i)\bigr)i=n^2-\sum_{i=1}^n\sigma(i).val(σ)=i=1∑n​(σ(i+1)−σ(i))i=n2−i=1∑n​σ(i).
  1. For every feasible schedule and i=1,…,ni=1,\dots,ni=1,…,n,
σ(i)(n−i+1)≤an2,σ(i)≤n.\sigma(i)(n-i+1)\le an^2,\qquad \sigma(i)\le n .σ(i)(n−i+1)≤an2,σ(i)≤n.

Significance

Lemma 9.1 shows that the optimal value of SGS_GSG​ determines the maximum edge biclique of GGG up to a factor of order ln⁡(1/a)\ln(1/a)ln(1/a) in the "area above the work line" n2−val(σ∗)n^2-\mathrm{val}(\sigma^*)n2−val(σ∗). Combined with the hardness of approximating maximum edge biclique (Theorem 9.1, cited from Ambühl, Mastrolilli and Svensson 2007) it yields Theorem 9.2: 1 ∣ prec ∣ ∑wjCj1\,|\,\mathrm{prec}\,|\,\sum w_jC_j1∣prec∣∑wj​Cj​ has no PTAS unless SAT can be decided by a probabilistic algorithm in time 2Nϵ2^{N^\epsilon}2Nϵ for every ϵ>0\epsilon>0ϵ>0. It also makes precise the two-dimensional Gantt chart picture of Eastman, Even and Isaacs (1964) and of Goemans and Williamson (2000), in which every point on the work line of a schedule defines an edge biclique.

The lemma is proved in the paper; it is not formalized anywhere to our knowledge. A formal proof certifies the combinatorial core of the no-PTAS result independently of the complexity-theoretic layer, and its definitions (the bipartite instance SGS_GSG​, edge bicliques, the profile σ(i)\sigma(i)σ(i)) are reusable for the gap inequality behind Theorem 9.2.

Difficulty

The upper bound is a direct computation on one explicit schedule. The lower bound is a statement about every feasible schedule, of which there are exponentially many, and it must hold with the explicit constant 222 and the factor ln⁡(1/a)\ln(1/a)ln(1/a) for every a∈(0,1]a\in(0,1]a∈(0,1]. The printed argument splits the sum at i=(1−a)ni=(1-a)ni=(1−a)n and uses ⌊an⌋\lfloor an\rfloor⌊an⌋, treating ananan as an integer; for general aaa (for example n=3n=3n=3, value 222, an=2/3an=2/3an=2/3) the split point is not an integer, so the printed estimate does not apply verbatim and the constant 222 has to be re-checked for non-integral ananan. On the formal side, the value identity requires relating completion times in a list to counting UUU-jobs before each VVV-job, with ties among zero-length jobs.

Formalization scope

Jobs are the disjoint union U ⊕ V of two finite types with Fintype.card U = Fintype.card V = n; EEE is a relation U → V → Prop. A schedule is a duplicate-free list containing every job; feasibility is the published LawlerPrec.MinMax.IsFeasible and completion times are the published MooreLateJobs.Shared.completionTime (time 000 start, no idle time). Processing times and weights are reals, here in {0,1}\{0,1\}{0,1}. The maximum edge biclique value is the maximum of ∣A∣⋅∣B∣|A|\cdot|B|∣A∣⋅∣B∣ over all edge bicliques, the empty ones included, so the hypothesis a>0a>0a>0 means E≠∅E\ne\emptysetE=∅. The logarithm is natural (Real.log).

Conventions and readings committed to:

  • The goal is stated for every optimal schedule, and the existence of an optimal schedule is a separate conclusion, so the bounds cannot hold vacuously. Proving the bounds for one particular schedule, or for an optimal value defined as an infimum that could be a junk default, would not be this lemma.
  • No integrality hypothesis on ananan is added.
  • Milestones 2 and 3 are stated for every schedule (respectively every feasible schedule), not only for σ∗\sigma^*σ∗; milestone 1 states the value of the block-order schedule as an equality, where the paper writes "≤⋯=\le\cdots=≤⋯=".
  • The paper's P=(U×V)∖EP=(U\times V)\setminus EP=(U×V)∖E is irreflexive; feasibility only constrains distinct jobs, so it agrees with the reflexive partial order of §1.

Not formalized: Theorem 9.1 (cited hardness of maximum edge biclique) and Theorem 9.2 (no PTAS under a complexity assumption); no polynomial-time or complexity-theoretic statement appears in the mission. Contributions welcome: proofs of the three milestones and of the goal; Mathlib's bounds on harmonic numbers (Mathlib/NumberTheory/Harmonic/Bounds.lean) are the relevant library.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • C. Ambühl, M. Mastrolilli, O. Svensson, Inapproximability results for sparsest cut, optimal linear arrangement, and precedence constraint scheduling, Proc. 48th IEEE FOCS, 329–337, 2007 (reference [4] of the paper).
  • W. L. Eastman, S. Even, I. M. Isaacs, Bounds for the optimal scheduling of n jobs on m processors, Management Science 11(2):268–279, 1964 (reference [11]).
  • M. X. Goemans, D. P. Williamson, Two-dimensional Gantt charts and a scheduling algorithm of Lawler, SIAM J. Discrete Math. 13(3):281–294, 2000 (reference [15]).
  • P. Schuurman, G. J. Woeginger, Polynomial time approximation algorithms for machine scheduling: ten open problems, J. Scheduling 2(5):203–213, 1999 (reference [36]).
8 thms2 active usersReviewed
🏆Completed
Graph TheoryOperations ResearchTheoretical Computer Science·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 4: Vertex Cover in Connected Graphs of Degree ≤ 3 Reduces to Weighted Vertex Cover for Interval-Order InstancesResearch Paper

Motivation

In the single-machine scheduling problem 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​, a set NNN of nnn jobs, each with a processing time pj≥0p_j\ge 0pj​≥0 and a weight wj≥0w_j\ge 0wj​≥0, is processed on one machine without interruption, subject to precedence constraints given by a partial order PPP on NNN. The aim is to minimize the weighted sum of completion times ∑jwjCj\sum_j w_jC_j∑j​wj​Cj​. The problem is strongly NP-hard for general precedence constraints (Lawler 1978; Lenstra and Rinnooy Kan 1978), and its approximability was a recurring open question in scheduling theory (Schuurman and Woeginger 1999).

A line of work by Chudak and Hochbaum, Correa and Schulz, and Ambühl and Mastrolilli showed that the problem is a special case of minimum weighted vertex cover in a graph GPSG^S_PGPS​ built from the instance. Many problems on partial orders become polynomial when the order is an interval order, so it is natural to ask whether this one does too. Section 7 of Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 2011) answers no: the problem stays NP-hard on interval orders. The proof is a reduction from vertex cover in connected graphs of maximum degree 3. This mission formalizes the correctness of that reduction.

Setting

A poset P=(N,P)P=(N,P)P=(N,P) is read as a reflexive relation: (x,y)∈P(x,y)\in P(x,y)∈P means x≤yx\le yx≤y. Jobs x,yx,yx,y are incomparable if neither (x,y)(x,y)(x,y) nor (y,x)(y,x)(y,x) is in PPP, and inc⁡(P)\operatorname{inc}(P)inc(P) is the set of ordered incomparable pairs. The vertex cover graph GPSG^S_PGPS​ has one node (i,j)(i,j)(i,j) for each incomparable pair, weighted piwjp_iw_jpi​wj​. Two nodes (i,j)(i,j)(i,j) and (k,ℓ)(k,\ell)(k,ℓ) are adjacent if j=kj=kj=k and i=ℓi=\elli=ℓ, or j=kj=kj=k and (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P, or (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P and (k,j)∈P(k,j)\in P(k,j)∈P. Write w(CI)w(C_I)w(CI​) for the minimum weight of a vertex cover of GISG^S_IGIS​.

A poset is an interval order if each element xxx can be assigned a closed real interval [ax,bx][a_x,b_x][ax​,bx​] such that x<yx<yx<y if and only if bx<ayb_x<a_ybx​<ay​.

The reduction starts from a graph G=(V,E)G=(V,E)G=(V,E) with vertices v1,…,vNv_1,\dots,v_Nv1​,…,vN​ and a spanning tree T=(V,ET)T=(V,E_T)T=(V,ET​) rooted at v1v_1v1​, numbered so that each parent comes before its children. The paper uses a breadth-first search tree.

  • Stage 1. The graph G′G'G′ is built from TTT. Each viv_ivi​ gets a pendant path vi−u1i−u2iv_i - u^i_1 - u^i_2vi​−u1i​−u2i​. Each non-tree edge {vi,vj}∈E∖ET\{v_i,v_j\}\in E\setminus E_T{vi​,vj​}∈E∖ET​ with i<ji<ji<j gets the path vi−e1ij−e2ij−u2jv_i - e^{ij}_1 - e^{ij}_2 - u^j_2vi​−e1ij​−e2ij​−u2j​. The non-tree edges themselves are not edges of G′G'G′.
  • Stage 2. The scheduling instance SSS has jobs s0s_0s0​, s1,…,sNs_1,\dots,s_Ns1​,…,sN​, m1,…,mNm_1,\dots,m_Nm1​,…,mN​, e1,…,eNe_1,\dots,e_Ne1​,…,eN​, and bijb_{ij}bij​ for each non-tree edge. Their intervals, processing times and weights are given in a table on p. 662. For example, sjs_jsj​ has interval [i,j][i,j][i,j], processing time 1/kj1/k^j1/kj and weight kik^iki, where viv_ivi​ is the parent of vjv_jvj​. The precedence constraints III are the interval order of these intervals. With nnn the number of jobs, the parameter is k=n2+1k=n^2+1k=n2+1.
  • The set DDD. It is {(s0,s1)}∪{(si,sj):vi parent of vj}∪{(si,mi),(mi,ei)}∪{(si,bij),(bij,mj)}\{(s_0,s_1)\}\cup\{(s_i,s_j): v_i \text{ parent of } v_j\}\cup\{(s_i,m_i),(m_i,e_i)\}\cup\{(s_i,b_{ij}),(b_{ij},m_j)\}{(s0​,s1​)}∪{(si​,sj​):vi​ parent of vj​}∪{(si​,mi​),(mi​,ei​)}∪{(si​,bij​),(bij​,mj​)}. The graph GI′G'_IGI′​ is the subgraph of GISG^S_IGIS​ induced by DDD.

Formalization targets

Goal: Theorem 7.1 (p. 661)

For every connected graph GGG of maximum degree at most 333, every parent-first spanning tree TTT and every m∈Nm\in\mathbb Nm∈N, the precedence constraints III of SSS form an interval order, and

G has a vertex cover of size≤m  ⟺  ⌊w(CI)⌋≤m+∣V∣+∣E∖ET∣.G \text{ has a vertex cover of size} \le m \iff \lfloor w(C_I)\rfloor \le m + |V| + |E\setminus E_T|.G has a vertex cover of size≤m⟺⌊w(CI​)⌋≤m+∣V∣+∣E∖ET​∣.

Milestones, in the order the proof uses them

  • Claim 1 (p. 662): τ(G′)=τ(G)+∣V∣+∣E∖ET∣\tau(G') = \tau(G)+|V|+|E\setminus E_T|τ(G′)=τ(G)+∣V∣+∣E∖ET​∣, where τ\tauτ is the vertex cover number.
  • Remark 7.1 (p. 662): for jobs with intervals [a,b][a,b][a,b] and [c,d][c,d][c,d] and a≤da\le da≤d, pi≤1/k⌈b⌉p_i\le 1/k^{\lceil b\rceil}pi​≤1/k⌈b⌉ and wj≤k⌈c⌉w_j\le k^{\lceil c\rceil}wj​≤k⌈c⌉. On incomparable pairs piwj∈{1}∪[0,1/k]p_iw_j\in\{1\}\cup[0,1/k]pi​wj​∈{1}∪[0,1/k]. Moreover, piwj≥kp_iw_j\ge kpi​wj​≥k forces b<cb<cb<c, and piwj=1p_iw_j=1pi​wj​=1 forces ⌈b⌉=⌈c⌉\lceil b\rceil=\lceil c\rceil⌈b⌉=⌈c⌉.
  • Claim 2 (p. 663): an incomparable pair (i,j)(i,j)(i,j) has piwj=1p_iw_j=1pi​wj​=1 if it is in DDD, and piwj≤1/kp_iw_j\le 1/kpi​wj​≤1/k otherwise.
  • Claim 3 (p. 663): GI′≅G′G'_I\cong G'GI′​≅G′.
  • §7, p. 664: with k=n2+1k=n^2+1k=n2+1, ∑(i,j)∈inc⁡(I)∖Dpiwj<1\sum_{(i,j)\in\operatorname{inc}(I)\setminus D}p_iw_j<1∑(i,j)∈inc(I)∖D​pi​wj​<1, and hence w(CI′)=⌊w(CI)⌋w(C'_I)=\lfloor w(C_I)\rfloorw(CI′​)=⌊w(CI​)⌋.

Significance

The result. Interval orders are a standard tractable class: several scheduling and order-theoretic problems that are hard in general become polynomial on them (Papadimitriou and Yannakakis 1979). Theorem 7.1 puts 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ outside this pattern. Section 6 of the same paper shows that the problem nonetheless has a 3/23/23/2-approximation on interval orders, so hardness and approximability are separated on this class. The paper also remarks that the proof makes weighted vertex cover NP-hard to approximate within some factor r>1r>1r>1 on the graphs GISG^S_IGIS​ arising from interval orders.

Formalizing it. The theorem is proved in the paper. Nothing in this mission is open, and none of it has been machine-checked before. The work splits into the following parts:

  • a gadget argument on unweighted vertex covers (Claim 1, after Alimonti and Kann);
  • an exact case analysis of incomparable pairs in a concrete interval order (Remark 7.1, Claim 2);
  • a graph isomorphism (Claim 3);
  • a rounding argument that links weighted and unweighted optima.

The definitions of GPSG^S_PGPS​ and of minimum-weight vertex covers are shared with the other missions of this series.

Difficulty

The construction is explicit, and each step is elementary. The work is in the bookkeeping. Claim 2 requires classifying every incomparable pair of jobs, including pairs of different kinds such as (bij,sℓ)(b_{ij}, s_\ell)(bij​,sℓ​), by comparing ceilings of interval endpoints. Half-integer endpoints (mim_imi​, bijb_{ij}bij​) are exactly what separates weight-one pairs from comparable ones. Claim 3 requires checking adjacency in GISG^S_IGIS​ for all pairs of nodes of DDD in both directions. The paper writes out two cases in each direction and calls the rest similar.

Claim 1 has a direction that is not simply local. A vertex cover of G′G'G′ that misses both endpoints of a non-tree edge has to be repaired by swapping gadget vertices, and the repair must be repeated without increasing the size.

A natural first idea is to treat the light nodes (weight at most 1/k1/k1/k) as negligible one at a time. This does not suffice: the argument needs their total weight to stay below 111, which is what forces kkk to grow with n2n^2n2.

Formalization scope

  • Graph and tree. GGG is a SimpleGraph (Fin N); vertex vi+1v_{i+1}vi+1​ is i, and the root is index 0. The tree is a TreeLayout: a parent function returning none exactly at the root, with each parent of smaller index and adjacent in GGG. The statements hold for every such layout. This is stronger than the paper's breadth-first tree, and the proof uses only "parent before child".
  • Hypotheses of the goal. Connectivity and the degree bound ((G.neighborSet v).ncard ≤ 3) are kept as in the paper. They matter only for the NP-completeness of the source problem.
  • Jobs. The jobs form an inductive type with one constructor per row of the table. Their order is a PartialOrder instance: x≤yx\le yx≤y iff x=yx=yx=y or bx<ayb_x<a_ybx​<ay​. Processing times and weights are real numbers. Section 1 of the paper asks for nonnegative integers, but the instance uses 1/kj1/k^j1/kj and the formalization follows the instance as printed.
  • Constants. The constants are explicit: k=n2+1k=n^2+1k=n2+1 with nnn the cardinality of the job type, and c=∣V∣+∣E∖ET∣c=|V|+|E\setminus E_T|c=∣V∣+∣E∖ET​∣. Remark 7.1 and Claim 2 are stated for every real k>1k>1k>1.
  • Optimum values. w(CI)w(C_I)w(CI​) is a minimum over the finite family of vertex covers. Unweighted cover numbers are Mathlib's SimpleGraph.vertexCoverNum. The floor is Nat.floor, which agrees with the integer floor because w(CI)≥0w(C_I)\ge 0w(CI​)≥0.
  • Not formalized. The goal's wording ("NP-hard") is not formalized. Neither are the NP-completeness of degree-3 vertex cover (Garey, Johnson and Stockmeyer), the polynomial size of the construction, or Theorem 2.1 (cited), which turns a vertex cover of GISG^S_IGIS​ into a schedule. What is stated is the correctness of the reduction: the instance has interval-order constraints, and its optimum decides the vertex cover question.
  • No trivialization. The instance SSS is built from GGG and TTT exactly as in the table. The goal quantifies over all graphs and layouts, never over an instance SSS assumed to have the properties.
  • Contributions. Contributions are welcome on any milestone. Claims 1 and 3 are independent of the weights, and Claim 2 is independent of the graph theory.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Math. Oper. Res. 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • C. Ambühl, M. Mastrolilli, Single machine precedence constrained scheduling is a vertex cover problem, Algorithmica 53(4):488–503, 2009. https://doi.org/10.1007/s00453-008-9251-1
  • J. R. Correa, A. S. Schulz, Single machine scheduling with precedence constraints, Math. Oper. Res. 30(4):1005–1021, 2005. https://doi.org/10.1287/moor.1050.0158
  • P. Alimonti, V. Kann, Some APX-completeness results for cubic graphs, Theoret. Comput. Sci. 237(1–2):123–134, 2000. https://doi.org/10.1016/S0304-3975(98)00158-3
  • M. R. Garey, D. S. Johnson, L. Stockmeyer, Some simplified NP-complete graph problems, Theoret. Comput. Sci. 1(3):237–267, 1976. https://doi.org/10.1016/0304-3975(76)90059-1
  • C. H. Papadimitriou, M. Yannakakis, Scheduling interval-ordered tasks, SIAM J. Comput. 8(3):405–409, 1979. https://doi.org/10.1137/0208031
10 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

On the Abstract Properties of Linear Dependence 2: The Rank Postulates and the Circuit Postulates Are EquivalentResearch Paper

Motivation

Hassler Whitney's 1935 paper On the Abstract Properties of Linear Dependence introduced matroids: finite sets of elements carrying an abstract notion of dependence that captures what linearly dependent columns of a matrix and cycles of a graph have in common. A distinctive feature of the paper is that it gives several independent axiom systems for the same structure: one in terms of rank, one in terms of independent sets, one in terms of bases, and one in terms of circuits (minimal dependent sets). It then proves they are interchangeable. These equivalences, now called cryptomorphisms, are what allow matroid theory to move freely between the algebraic picture (rank of a set of vectors) and the combinatorial one (cycles of a graph, minimal dependent column sets). Every textbook on the subject relies on them, for example J. Oxley, Matroid Theory, Chapter 1.

This mission treats one of them: the equivalence of Whitney's rank postulates (§2) and circuit postulates (§8). The circuit side is the one used in combinatorial optimization, where circuits appear as cycles in network flows, as minimal infeasible subsystems, and in the exchange arguments behind the greedy algorithm.

Setting

Let MMM be a finite set of elements. For subsets we write N+eN + eN+e for N∪{e}N \cup \{e\}N∪{e} and P1+P2P_1 + P_2P1​+P2​ for P1∪P2P_1 \cup P_2P1​∪P2​.

Rank system. A function rrr assigning an integer r(N)r(N)r(N) to each N⊆MN \subseteq MN⊆M satisfies the rank postulates if

  • (R1)(\mathrm R_1)(R1​) the rank of the null subset is zero;
  • (R2)(\mathrm R_2)(R2​) for any subset NNN and any element eee not in NNN, r(N+e)=r(N)+kr(N+e) = r(N) + kr(N+e)=r(N)+k with k=0k = 0k=0 or 111;
  • (R3)(\mathrm R_3)(R3​) for any subset NNN and elements e1,e2e_1, e_2e1​,e2​ not in NNN, if r(N+e1)=r(N+e2)=r(N)r(N+e_1) = r(N+e_2) = r(N)r(N+e1​)=r(N+e2​)=r(N), then r(N+e1+e2)=r(N)r(N+e_1+e_2) = r(N)r(N+e1​+e2​)=r(N).

With ρ(N)\rho(N)ρ(N) the number of elements of NNN, the nullity is n(N)=ρ(N)−r(N)n(N) = \rho(N) - r(N)n(N)=ρ(N)−r(N). An element eee is dependent on NNN if r(N+e)=r(N)r(N+e) = r(N)r(N+e)=r(N). A circuit of rrr is a minimal dependent set: a subset PPP with n(P)>0n(P) > 0n(P)>0 such that n(N)=0n(N) = 0n(N)=0 for every proper subset NNN of PPP. In Lean these are IsRankSystem r, nullity r N, IsDependentOn r e N and circuitsOfRank r P.

Circuit system. A family of subsets, called circuits, satisfies the circuit postulates (§8, p. 516) if

(C₁) No proper subset of a circuit is a circuit.

(C₂) If P₁ and P₂ are circuits, e₁ is in both P₁ and P₂, and e₂ is in P₁ but not in P₂, then there is a circuit P₃ in P₁ + P₂ containing e₂ but not e₁.

In Lean this is IsCircuitSystem C for a predicate C : Finset α → Prop.

Rank from circuits. Whitney defines (p. 516):

Let e₁, ⋯, e_p be any ordered set of elements of M. Set Γᵢ = 0 if there is a circuit in e₁ + ⋯ + eᵢ containing eᵢ, and set Γᵢ = 1 otherwise (compare Theorem 5). Let the "rank" of (e₁, ⋯, e_p) be r(e₁, ⋯, e_p) = Σ_{i=1}^{p} Γᵢ.

In Lean, rankSeq C l is this sum for a list l, and rankOfCircuits C N is its value on the enumeration N.toList of a subset NNN.

Formalization targets

Goal: the two systems are equivalent

For every finite set MMM:

(1)r satisfies (R)  ⟹  C(r) satisfies (C), ∅∉C(r), rC(r)=r;\text{(1)}\quad r \text{ satisfies } (\mathrm R) \;\Longrightarrow\; \mathcal C(r) \text{ satisfies } (\mathrm C),\ \emptyset \notin \mathcal C(r),\ r_{\mathcal C(r)} = r;(1)r satisfies (R)⟹C(r) satisfies (C), ∅∈/C(r), rC(r)​=r; (2)C satisfies (C), ∅∉C  ⟹  rC satisfies (R), C(rC)=C,\text{(2)}\quad \mathcal C \text{ satisfies } (\mathrm C),\ \emptyset \notin \mathcal C \;\Longrightarrow\; r_{\mathcal C} \text{ satisfies } (\mathrm R),\ \mathcal C(r_{\mathcal C}) = \mathcal C,(2)C satisfies (C), ∅∈/C⟹rC​ satisfies (R), C(rC​)=C,

where C(r)\mathcal C(r)C(r) is the family of circuits of rrr and rCr_{\mathcal C}rC​ is the rank defined from C\mathcal CC. This is Whitney's closing sentence of §8 (p. 517): "The definitions of rank and of circuits under the two systems (R), (C) agree, and hence the systems are equivalent."

Milestones, in the order the argument uses them

  • Lemma 5 (p. 512): each element of a circuit is dependent on the rest of the circuit.
  • Lemma 6 (p. 512): if e∉P1e \notin P_1e∈/P1​ is dependent on P1P_1P1​ but on no proper subset of P1P_1P1​, then P1+eP_1 + eP1​+e is a circuit.
  • Theorem 4 (p. 512): for e∉Ne \notin Ne∈/N, some circuit in N+eN + eN+e contains eee if and only if eee is dependent on NNN.
  • Theorem 5 (p. 513): if N=e1+⋯+epN = e_1 + \cdots + e_pN=e1​+⋯+ep​ is formed element by element, n(N)n(N)n(N) is the number of indices iii for which some circuit in e1+⋯+eie_1 + \cdots + e_ie1​+⋯+ei​ contains eie_iei​.
  • §5 (pp. 512–513): the circuits of a rank system satisfy (C1)(\mathrm C_1)(C1​) and (C2)(\mathrm C_2)(C2​).
  • Lemma 7 (p. 516): r(e1,…,eq−2,eq−1,eq)=r(e1,…,eq−2,eq,eq−1)r(e_1, \dots, e_{q-2}, e_{q-1}, e_q) = r(e_1, \dots, e_{q-2}, e_q, e_{q-1})r(e1​,…,eq−2​,eq−1​,eq​)=r(e1​,…,eq−2​,eq​,eq−1​) under (C1)(\mathrm C_1)(C1​), (C2)(\mathrm C_2)(C2​).
  • Lemma 8 (p. 517): the rank of a subset defined from circuits does not depend on the ordering of its elements.
  • §8 (p. 517): the rank defined from circuits satisfies (R1)(\mathrm R_1)(R1​)–(R3)(\mathrm R_3)(R3​).

Significance

The equivalence makes the circuit postulates a complete description of a matroid: everything stated about rank, nullity, independence and bases can be phrased through circuits and back. Downstream in the same paper, the fundamental sets of circuits of §9 (Theorem 9) and the binary-matroid characterization of the Appendix are stated in terms of circuits, and they depend on circuits and rank being interchangeable. Theorem 5, read on its own, expresses the nullity of a set as a count of circuit-closing steps. This is the abstract form of the fact that the cycle space of a graph has dimension equal to the number of non-tree edges.

On the formal side, Mathlib's Matroid is built on the base axioms and proves circuit elimination (Matroid.IsCircuit.strong_elimination) as a theorem about that structure. Whitney's own route is different: rank defined from circuits by an ordered sum of Γi\Gamma_iΓi​, with order-independence (Lemmas 7 and 8) as the central step. That route has no machine-checked version that we know of, on Prove2Me or elsewhere. This mission formalizes the 1935 argument as stated: the rank and circuit systems as Whitney wrote them, and the two translations between them.

Difficulty

The obvious definition of the rank of a set from its circuits enumerates the set and counts the elements that do not close a circuit with their predecessors. This definition depends on the enumeration, and nothing in (C1)(\mathrm C_1)(C1​), (C2)(\mathrm C_2)(C2​) obviously prevents two orderings from giving different counts. Lemma 7, the swap of two adjacent elements, is where (C2)(\mathrm C_2)(C2​) does real work, through a case analysis on which of the two swapped elements closes a circuit. In the other direction, (C2)(\mathrm C_2)(C2​) for circuits of a rank function requires turning the local postulate (R3)(\mathrm R_3)(R3​) into a statement about unions of two circuits. Defining the circuit rank as a maximum over orderings, or as the size of a largest circuit-free subset, sidesteps exactly the step the paper proves and is not this mission.

Formalization scope

  • The elements form a finite type α with [Fintype α] [DecidableEq α]. The ground set is all of α, and subsets are Finset α. Whitney's matroid is a finite set e1,…,ene_1, \dots, e_ne1​,…,en​.
  • Ranks and nullities are integers (ℤ), so that n(N)=ρ(N)−r(N)n(N) = \rho(N) - r(N)n(N)=ρ(N)−r(N) is a true difference.
  • Ordered sets of elements are lists. Lemmas 7, 8 and Theorem 5 assume the list has no repetitions, as Whitney's "ordered set of elements" means. "A circuit in e1+⋯+eie_1 + \cdots + e_ie1​+⋯+ei​" means a circuit contained in {e1,…,ei}\{e_1, \dots, e_i\}{e1​,…,ei​}.
  • The rank of a subset from circuits is computed along one fixed enumeration N.toList. Its independence from the enumeration is Lemma 8, and the definition does not build it in.
  • Tacit hypothesis made explicit. Whitney's circuits are nonempty, since a circuit of a rank system has positive nullity. The family {∅}\{\emptyset\}{∅} satisfies (C1)(\mathrm C_1)(C1​), (C2)(\mathrm C_2)(C2​) vacuously, but its circuit rank is ρ\rhoρ, which has no circuits, so the round trip fails. Part (2) of the goal therefore assumes ∅∉C\emptyset \notin \mathcal C∅∈/C, and part (1) asserts ∅∉C(r)\emptyset \notin \mathcal C(r)∅∈/C(r).
  • Lemma 6 assumes e∉P1e \notin P_1e∈/P1​, which the paper leaves tacit.
  • Ruled out. Neither system may be encoded as Mathlib's Matroid in the statements. Doing so would turn the equivalence into a library lemma. The statements are about Whitney's postulates on bare functions and predicates.

The development needs only finite sets, lists and permutations from Mathlib. The definitions IsRankSystem and IsCircuitSystem can be reused for the other cryptomorphisms of the paper. Contributions are welcome on any milestone, and so are local helper lemmas, such as monotonicity of rank under (R1)(\mathrm R_1)(R1​)–(R3)(\mathrm R_3)(R3​) or invariance of rankSeq under prefix-preserving changes.

Selected references

  • H. Whitney, On the Abstract Properties of Linear Dependence, American Journal of Mathematics 57 (1935), no. 3, 509–533. https://doi.org/10.2307/2371182
  • J. Oxley, Matroid Theory, 2nd ed., Oxford Graduate Texts in Mathematics 21, Oxford University Press, 2011. https://doi.org/10.1093/acprof:oso/9780198566946.001.0001
  • Mathlib, Mathlib/Combinatorics/Matroid/Circuit.lean (circuits of Mathlib's Matroid). https://github.com/leanprover-community/mathlib4
12 thms2 active usersReviewed
Graph TheoryLinear algebraTheoretical Computer Science·Captain: mikedeng1

Explicit Expanders of Every Degree and Size 3: Deleting Far-Apart Tree-Like Vertices of a Near-Ramanujan Graph and Matching Their Neighbours Keeps λ ≤ 2√(d−1) + εResearch Paper

Motivation

Sparse graphs with small nontrivial eigenvalues, expanders, are basic objects in combinatorics and theoretical computer science. They are used in error-correcting codes, derandomization, sorting networks, and the analysis of random walks. The Alon–Boppana bound says that a ddd-regular graph on nnn vertices has a nontrivial eigenvalue of absolute value at least 2d−1−o(1)2\sqrt{d-1}-o(1)2d−1​−o(1) (Alon 1986; Nilli 1991). Graphs that reach 2d−12\sqrt{d-1}2d−1​ are Ramanujan graphs.

The classical explicit Ramanujan graphs of Lubotzky, Phillips and Sarnak (1988) and Margulis exist only for degrees d=p+1d = p+1d=p+1 with ppp prime, and only for very sparse sequences of vertex counts. Constructions with λ≤2d−1+ε\lambda\le 2\sqrt{d-1}+\varepsilonλ≤2d−1​+ε for every degree came from Mohanty, O'Donnell and Paredes (STOC 2020, arXiv:1909.06988), but their graphs also do not have every number of vertices. Alon (arXiv:2003.11673, Combinatorica 41, 2021) asked for near-Ramanujan graphs of every degree and every large size. Theorem 1.3 of that paper answers this up to ε\varepsilonε: for every ddd, every ε>0\varepsilon>0ε>0 and every large nnn with ndndnd even there is an explicit (n,d,λ)(n,d,\lambda)(n,d,λ)-graph with λ≤2d−1+ε\lambda\le 2\sqrt{d-1}+\varepsilonλ≤2d−1​+ε.

Setting

A (n,d,λ)(n,d,\lambda)(n,d,λ)-graph is a ddd-regular simple graph on nnn vertices in which every nontrivial eigenvalue of the adjacency matrix AAA has absolute value at most λ\lambdaλ. The trivial eigenvalue is ddd, with the constant eigenvector 1\mathbf 11. Equivalently, every eigenvalue μ\muμ of AAA with an eigenvector f≠0f\ne0f=0, ∑vf(v)=0\sum_v f(v)=0∑v​f(v)=0, satisfies ∣μ∣≤λ|\mu|\le\lambda∣μ∣≤λ.

Distances dist⁡(v,w)\operatorname{dist}(v,w)dist(v,w) are graph distances, and they are ∞\infty∞ between components. The kkk-neighbourhood of a vertex vvv is B(v,k)={w:dist⁡(v,w)≤k}B(v,k)=\{w:\operatorname{dist}(v,w)\le k\}B(v,k)={w:dist(v,w)≤k}. The kkk-neighbourhood of an edge uvuvuv is B(u,k)∪B(v,k)B(u,k)\cup B(v,k)B(u,k)∪B(v,k), and NiN_iNi​ is the set of vertices at distance exactly iii from {u,v}\{u,v\}{u,v}. A set contains no cycle if the subgraph induced on it is a forest. A ball contains at most one cycle if its induced subgraph has at most as many edges as vertices.

The construction starts from a ddd-regular graph HHH on a vertex set VVV and a set U⊆VU\subseteq VU⊆V. Write N(U)N(U)N(U) for the set of neighbours of UUU, and let mmm be a perfect matching on N(U)N(U)N(U). Then H′H'H′ is the subgraph induced on V∖UV\setminus UV∖U, MMM is the graph of matching edges {x,m(x)}\{x,m(x)\}{x,m(x)}, and G=H′∪MG=H'\cup MG=H′∪M.

Formalization targets

Goal: Theorem 1.3, relative to the input graph

Let d≥3d\ge3d≥3, ε>0\varepsilon>0ε>0, r=⌈2/ε⌉r=\lceil 2/\varepsilon\rceilr=⌈2/ε⌉. Suppose HHH is an (N,d,2d−1+ε/2)(N,d,2\sqrt{d-1}+\varepsilon/2)(N,d,2d−1​+ε/2)-graph in which the (2r+4)(2r+4)(2r+4)-neighbourhood of every vertex contains at most one cycle, and r≤log⁡d−1Nr\le\log_{d-1}Nr≤logd−1​N. Then for every uuu with ududud even and u≤N/(2d2r+3)u\le N/(2d^{2r+3})u≤N/(2d2r+3),

∃ G on N−u vertices:G is an (N−u, d, 2d−1+ε)-graph.\exists\, G \text{ on } N-u \text{ vertices}:\quad G \text{ is an } \bigl(N-u,\ d,\ 2\sqrt{d-1}+\varepsilon\bigr)\text{-graph}.∃G on N−u vertices:G is an (N−u, d, 2d−1​+ε)-graph.

The hypotheses on HHH are what Theorem 3.3 (Mohanty–O'Donnell–Paredes) supplies, and that theorem is not formalized.

Milestones

  • Lemma 3.1 (p. 10). A ddd-regular graph whose (2r+4)(2r+4)(2r+4)-balls contain at most one cycle has a set UUU with ∣U∣≥n/(2d2r+3)|U|\ge n/(2d^{2r+3})∣U∣≥n/(2d2r+3), cycle-free (r+1)(r+1)(r+1)-balls, and pairwise distances ≥2r+3\ge 2r+3≥2r+3.
  • Lemma 3.2 (p. 11). If the rrr-neighbourhood of an edge uvuvuv contains no cycle and Af=μfA f=\mu fAf=μf with μ≥2d−1\mu\ge2\sqrt{d-1}μ≥2d−1​, then
∑w∈Nif2(w) ≥ ∑w∈Ni−1f2(w),1≤i≤r.\sum_{w\in N_i}f^2(w)\ \ge\ \sum_{w\in N_{i-1}}f^2(w),\qquad 1\le i\le r .w∈Ni​∑​f2(w) ≥ w∈Ni−1​∑​f2(w),1≤i≤r.
  • The variational characterization of nontrivial eigenvalues (§2.4, p. 8).
  • In G=H′∪MG=H'\cup MG=H′∪M: GGG is ddd-regular on ∣V∣−∣U∣|V|-|U|∣V∣−∣U∣ vertices and AG=AH′+AMA_G=A_{H'}+A_MAG​=AH′​+AM​. Matching edges have cycle-free (r−1)(r-1)(r−1)-neighbourhoods and pairwise disjoint rrr-neighbourhoods.
  • Inequalities (9), (10), (11) (p. 13), and the spectral step: for every admissible UUU and mmm, GGG is an (N−∣U∣,d,2d−1+ε)(N-|U|,d,2\sqrt{d-1}+\varepsilon)(N−∣U∣,d,2d−1​+ε)-graph.

Significance

Theorem 1.3 shows that the size restrictions of algebraic Ramanujan constructions cost nothing spectrally: up to an arbitrarily small ε\varepsilonε, the Alon–Boppana bound is attained by explicit graphs on every admissible vertex count. The deletion method is local. It turns any near-Ramanujan graph whose short cycles are sparse into graphs of all nearby sizes, so it applies to future constructions as well. Lemma 3.2 is a self-contained delocalization statement in the tradition of Kahale 1995: eigenvectors of eigenvalues at least 2d−12\sqrt{d-1}2d−1​ in absolute value cannot concentrate near tree-like edges.

The result is proved on paper. To our knowledge none of it is formalized; Mathlib has adjacency matrices, extended graph distance and acyclicity, but no theory of expanders. A complete development would give machine-checked versions of a delocalization lemma, of the greedy selection of far-apart vertices away from short cycles, and of the variational eigenvalue bound for induced subgraphs. It would also check two points the paper passes over. The proof of Theorem 1.3 treats only positive eigenvalues λ≥2d−1\lambda\ge2\sqrt{d-1}λ≥2d−1​. And its claim that the rrr-neighbourhood of a matching edge is cycle-free fails when two deleted vertices are at distance exactly 2r+32r+32r+3. This mission states the corrected forms (see Formalization scope).

Difficulty

The spectral bound for GGG does not follow from interlacing alone. Deleting vertices is harmless, since by (9) the quadratic form of H′H'H′ is controlled by HHH. But the added matching contributes up to ∑x∈N(U)f(x)2\sum_{x\in N(U)}f(x)^2∑x∈N(U)​f(x)2 to ftAGff^tA_GfftAG​f, which can be as large as ∥f∥2\|f\|^2∥f∥2 for an eigenvector concentrated on N(U)N(U)N(U). The obvious estimate therefore gives only λ≤2d−1+1+ε/2\lambda\le 2\sqrt{d-1}+1+\varepsilon/2λ≤2d−1​+1+ε/2. Closing the gap requires showing that an eigenvector of a large eigenvalue spreads its mass over the rrr layers around each matching edge (Lemma 3.2). That in turn needs those neighbourhoods to be trees in GGG and pairwise disjoint, which is where Lemma 3.1's choice of UUU is used. The combinatorial part, tracking distances and cycles in GGG when GGG mixes edges of HHH with matching edges, is the main formalization burden.

Formalization scope

  • Representation. Vertex sets are finite types. Graphs are Mathlib SimpleGraphs with real adjacency matrices adjMatrix ℝ. The (n, d, λ) predicate requires IsRegularOfDegree d, symmetry, row sums ddd, and ∣μ∣≤λ|\mu|\le\lambda∣μ∣≤λ for every eigenpair (μ,f)(\mu,f)(μ,f) with f≠0f\ne0f=0, ∑f=0\sum f=0∑f=0. Distances use the extended SimpleGraph.edist, never dist (which is 000 across components). Cycle conditions are on induced subgraphs, and "at most one cycle" on a ball is ∣E∣≤∣V∣|E|\le|V|∣E∣≤∣V∣. Deleted vertices are a Finset U; the new graph lives on the subtype {v // v ∉ U}. The matching is a fixed-point-free involution of N(U)N(U)N(U).
  • Explicit quantities replacing the paper's asymptotics. The paper writes "sufficiently large nnn" and u=o(n)u=o(n)u=o(n). The goal instead takes any u≤N/(2d2r+3)u\le N/(2d^{2r+3})u≤N/(2d2r+3) (the size Lemma 3.1 guarantees) with ududud even, plus Lemma 3.1's side condition r≤log⁡d−1Nr\le\log_{d-1}Nr≤logd−1​N. The equality r=⌈2/ε⌉r=\lceil2/\varepsilon\rceilr=⌈2/ε⌉ is used as ⌈2/ε⌉+∈N\lceil2/\varepsilon\rceil_+\in\mathbb N⌈2/ε⌉+​∈N. The paper's "every degree ddd" becomes d≥3d\ge3d≥3, the range of its proof.
  • Corrections. (11) and Lemma 3.2's companion are stated for ∣μ∣≥2d−1|\mu|\ge2\sqrt{d-1}∣μ∣≥2d−1​, both signs. The matching-edge note is stated for the (r−1)(r-1)(r−1)-neighbourhood, which still yields the factor 1/r1/r1/r in (11). Lemma 3.2 itself is stated as printed.
  • Out of scope. Theorem 3.3 ([18]) is a cited input: its graph is the hypothesis HHH. All claims of explicitness and polynomial running time are out of scope, as is §4's remark on applying the method to LPS graphs directly.
  • No trivialization. The input hypotheses are exactly Theorem 3.3's conclusions plus Lemma 3.1's side condition, and they are met by high-girth Ramanujan graphs. No hypothesis mentions the spectrum or Rayleigh quotients of the constructed graph, and the goal's graph must be ddd-regular on exactly N−uN-uN−u vertices.
  • Reusable infrastructure. Welcome contributions include the variational characterization for symmetric matrices with constant row sums, a forest edge-count lemma for balls, BFS-layer structure of cycle-free balls in regular graphs, and the edge-disjoint decomposition AG=AH′+AMA_{G}=A_{H'}+A_MAG​=AH′​+AM​. Each is useful beyond this mission.

Selected references

  • N. Alon, Explicit expanders of every degree and size, arXiv:2003.11673v1, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/2003.11673
  • S. Mohanty, R. O'Donnell, P. Paredes, Explicit near-Ramanujan graphs of every degree, STOC 2020. https://arxiv.org/abs/1909.06988
  • A. Lubotzky, R. Phillips, P. Sarnak, Ramanujan graphs, Combinatorica 8 (1988). https://doi.org/10.1007/BF02126799
  • N. Alon, Eigenvalues and expanders, Combinatorica 6 (1986). https://doi.org/10.1007/BF02579166
  • A. Nilli, On the second eigenvalue of a graph, Discrete Mathematics 91 (1991). https://doi.org/10.1016/0012-365X(91)90112-F
  • N. Kahale, Eigenvalues and expansion of regular graphs, J. ACM 42 (1995). https://doi.org/10.1145/210118.210136
13 thms2 active usersReviewed
Graph Theory·Captain: mikedeng1

The Strong Perfect Graph Theorem VI: A Berge Graph Containing a Long Odd Prism Admits a Proper 2-Join, a Balanced Skew Partition or a Proper Homogeneous PairResearch Paper

Motivation

A graph is perfect if every induced subgraph has chromatic number equal to its clique number. Berge conjectured in 1961 that a graph is perfect exactly when it contains no odd hole and no odd antihole. Chudnovsky, Robertson, Seymour and Thomas proved this strong perfect graph theorem in 2006 (Ann. of Math. 164 (2006), 51–229). Perfect graphs matter beyond graph theory: for them the stable set polytope is described by clique inequalities, so maximum weight stable set and colouring problems become polynomially solvable linear programs (Grötschel, Lovász and Schrijver).

The proof reduces the theorem to a decomposition statement (1.3 of the paper): every Berge graph is basic or admits one of a few decompositions. That statement is in turn proved in twelve steps, listed as 1.8.1–1.8.12. Each step excludes one kind of configuration from a Berge graph without the decompositions. This mission is step 1.8.5, restated as 13.4: it deals with Berge graphs that contain a long odd prism but no appearance of K4K_4K4​. It is the only step of the proof that needs proper 2-joins in the complement and proper homogeneous pairs.

Setting

All graphs are finite and simple; G‾\overline{G}G is the complement of GGG. A path is an induced subgraph which is a path, and its length is its number of edges. An antipath is a path of G‾\overline{G}G. A hole is an induced cycle of length at least 444, and an antihole is the complement of a hole of G‾\overline{G}G. GGG is Berge if every hole and antihole of GGG has even length.

A prism consists of two disjoint triangles {a1,a2,a3}\{a_1,a_2,a_3\}{a1​,a2​,a3​}, {b1,b2,b3}\{b_1,b_2,b_3\}{b1​,b2​,b3​} and three paths PiP_iPi​ from aia_iai​ to bib_ibi​, such that the only edges between different paths are the triangle edges. It is long if some PiP_iPi​ has length >1>1>1, even if all three lengths are even, and odd otherwise.

A subdivision HHH of a graph JJJ replaces every edge of JJJ by a track, these tracks being disjoint except at their ends. JJJ appears in GGG if L(H)L(H)L(H) is isomorphic to an induced subgraph of GGG for some bipartite subdivision HHH of JJJ, where LLL is the line graph.

The decompositions in the conclusion (pp. 53–54):

  • A proper 2-join is a partition (X1,X2)(X_1,X_2)(X1​,X2​) of V(G)V(G)V(G), with disjoint nonempty Ai,Bi⊆XiA_i,B_i\subseteq X_iAi​,Bi​⊆Xi​, such that the only edges between X1X_1X1​ and X2X_2X2​ are all edges between A1A_1A1​ and A2A_2A2​ and all edges between B1B_1B1​ and B2B_2B2​. Every component of G∣XiG|X_iG∣Xi​ meets AiA_iAi​ and BiB_iBi​. If G∣XiG|X_iG∣Xi​ is a path between single vertices AiA_iAi​ and BiB_iBi​, it has odd length ≥3\ge 3≥3.
  • A skew partition is a partition (A,B)(A,B)(A,B) of V(G)V(G)V(G) with AAA not connected and BBB not anticonnected. It is balanced if no odd path joins two nonadjacent vertices of BBB through AAA, and no odd antipath joins two adjacent vertices of AAA through BBB.
  • A proper homogeneous pair is a pair (A,B)(A,B)(A,B) of disjoint nonempty sets such that every other vertex is complete or anticomplete to AAA, and complete or anticomplete to BBB. All four combinations must occur.

The intermediate objects come from Sections 11–13 of the paper:

  • A strip S=(A,C,B)S=(A,C,B)S=(A,C,B): every vertex of V(S)=A∪B∪CV(S)=A\cup B\cup CV(S)=A∪B∪C lies on a rung, a path from AAA to BBB with interior in CCC.
  • A step: two disjoint rungs joined exactly by an edge at each end.
  • A step-connected strip: steps cover V(S)V(S)V(S) and connect AAA and BBB.
  • Left-stars and right-stars: vertices complete to AAA (resp. BBB) and anticomplete to the rest of V(S)V(S)V(S).
  • A banister: a path from a left-star to a right-star whose interior sees nothing of V(S)V(S)V(S).
  • A staircase K=(S,a0-R0-b0)K=(S,a_0\text{-}R_0\text{-}b_0)K=(S,a0​-R0​-b0​): a step-connected strip with a banister of length ≥3\ge 3≥3. A staircase can be maximal or strongly maximal.
  • Three kinds of breaker: sets around a strip or staircase whose presence forces a balanced skew partition.

Formalization targets

Goal: 13.4

Let GGG be Berge with no appearance of K4K_4K4​ in GGG or in G‾\overline{G}G, and suppose GGG contains a long odd prism as an induced subgraph. Then

G or G‾ admits a proper 2-join, or G admits a balanced skew partition, or G admits a proper homogeneous pair.G \text{ or } \overline{G} \text{ admits a proper 2-join, or } G \text{ admits a balanced skew partition, or } G \text{ admits a proper homogeneous pair.}G or G admits a proper 2-join, or G admits a balanced skew partition, or G admits a proper homogeneous pair.

Milestones

In the order of the paper's argument:

  • 11.3: in a Berge graph with no even prism, every rung of a step-connected strip and every banister has odd length.
  • 11.4: under no appearance of K4K_4K4​ and no even prism, no anticonnected set QQQ has the six properties listed in the statement.
  • 11.5: a 1-breaker forces a balanced skew partition.
  • 12.1: relative to a maximal staircase, every outside vertex is of exactly one of three types (minor; major; a star with a neighbour on R0R_0R0​).
  • 12.3: a connected set containing a left-star and attaching to B∪CB\cup CB∪C contains a major vertex or a banister.
  • 12.4: a 2-breaker forces a balanced skew partition.
  • 13.3: a 3-breaker forces a balanced skew partition.

Significance

13.4 removes long prisms from the analysis. Combined with 10.6 (the even prism), it shows that a recalcitrant graph contains no long prism in GGG or G‾\overline{G}G, which places it in the class F5\mathcal F_5F5​ (p. 154). The later steps (double diamonds, odd wheels, pseudowheels, wheels) all assume this. The step-connected strip and staircase method developed here is also the paper's model for growing a maximal structure and then classifying how the rest of the graph attaches to it.

The theorem has been proved since 2006; no machine-checked proof of it or of any of its steps is known. The proof of 13.4 also cites these results of the same paper, which are posed in other missions of this series:

  • 10.6 (the even-prism step), posed in mission V;
  • 7.2 (equal parity of the paths of a prism), posed in mission V;
  • 2.1, 2.4, 2.6, 2.7, 4.2, 4.3, 4.5, 4.6 (the Roussel–Rubio lemma and the skew-partition toolkit), posed in mission II.

Difficulty

The difficulty is the volume of case analysis behind every statement. The paper does not prove the exact analogue of the even-prism result 10.6. It warns (p. 127) that it does not know whether that analogue holds, and adds the two extra outcomes instead. The obvious first idea is to take a long odd prism and analyse attachments to it as in Section 10. The paper does not get the result that way (p. 127): it replaces two of the three paths by a maximal step-connected strip. Controlling how every remaining vertex or connected set attaches to such a strip is what the breaker results do. Maximality is also delicate. "Strongly maximal" refers to staircases of the complement, so GGG and G‾\overline{G}G must be handled in one framework.

Formalization scope

Graphs are SimpleGraph V on a Fintype vertex type with decidable equality. G‾\overline{G}G is Gᶜ.

  • Paths, holes, rungs, banisters. Paths are lists of distinct vertices, adjacent exactly when consecutive (induced). Holes are lists adjacent exactly when cyclically consecutive. Rungs are listed from their end in AAA to their end in BBB, and banisters from the left-star to the right-star.
  • Vertex sets. Connectedness of a vertex set is reachability inside G.induce X, so ∅\emptyset∅ is connected. Anticonnectedness is the same notion in Gᶜ.
  • Prisms. A prism is three paths whose cross adjacencies are exactly the two triangles. Each path has length at least 111, so the triangles are disjoint.
  • Appearances. A subdivision of JJJ is an injection of V(J)V(J)V(J) together with one track per edge. The tracks are internally disjoint and cover every vertex and edge. An appearance is a graph embedding of L(H)L(H)L(H) into GGG, and embeddings reflect adjacency.
  • Staircases and breakers. A staircase is a quadruple (A,C,B,R0)(A,C,B,R_0)(A,C,B,R0​). Maximality quantifies over all staircases of GGG, strong maximality also over staircases of G‾\overline{G}G. The breakers are predicates on these data.

Every hypothesis of the paper is kept. "No appearance of K4K_4K4​" is in GGG and in G‾\overline{G}G for the goal, and in GGG for the milestones. The goal also keeps "Berge", "no even prism" and "no 1-/2-breaker" where the page has them. 12.1's "exactly one" is an exclusive disjunction. 11.4 is a non-existence statement.

A formalization with non-induced paths, with the complement dropped from "one of G,G‾G,\overline{G}G,G", or with a strip, staircase or breaker predicate that no graph satisfies would make the targets empty or false. The definitions here are checked against a concrete graph: the 8-vertex prism with path lengths 1,1,31,1,31,1,3 is a long odd prism, and it carries a staircase. Contributions are welcome: proofs of the milestones, and reusable material on induced paths, holes and line graphs of subdivisions.

Selected references

  • M. Chudnovsky, N. Robertson, P. Seymour, R. Thomas, The strong perfect graph theorem, Annals of Mathematics 164 (2006), 51–229. https://doi.org/10.4007/annals.2006.164.51
  • C. Berge, Färbung von Graphen, deren sämtliche bzw. deren ungerade Kreise starr sind, Wiss. Z. Martin-Luther-Univ. Halle-Wittenberg 10 (1961), 114–115.
  • V. Chvátal, Star-cutsets and perfect graphs, J. Combin. Theory Ser. B 39 (1985), 189–199. https://doi.org/10.1016/0095-8956(85)90049-8
  • V. Chvátal, N. Sbihi, Bull-free Berge graphs are perfect, Graphs and Combinatorics 3 (1987), 127–139. https://doi.org/10.1007/BF01788536
  • G. Cornuéjols, W. H. Cunningham, Compositions for perfect graphs, Discrete Mathematics 55 (1985), 245–254. https://doi.org/10.1016/0012-365X(85)90051-7
  • M. Grötschel, L. Lovász, A. Schrijver, Geometric Algorithms and Combinatorial Optimization, Springer, 1988. https://doi.org/10.1007/978-3-642-97881-4
21 thms2 active usersReviewed
🏆Completed
Graph TheoryLinear algebraTheoretical Computer Science·Captain: mikedeng1

Explicit Expanders of Every Degree and Size 2: Attaching New Vertices to a (p+1)-Regular Ramanujan Graph and Adding Loops Keeps Every Nontrivial Eigenvalue at Most √(2(p+1)) + √p + o(1)Research Paper

Motivation

Sparse graphs whose adjacency spectrum is concentrated near zero, expanders, are used throughout theoretical computer science: in error-correcting codes, derandomization, sorting and routing networks, and the construction of pseudorandom objects (Hoory, Linial and Wigderson, survey). The best possible spectral expansion for a ddd-regular graph is governed by the Alon–Boppana bound 2d−12\sqrt{d-1}2d−1​, and graphs attaining it, Ramanujan graphs, were constructed explicitly by Lubotzky, Phillips and Sarnak (LPS 1988) and by Margulis. These constructions exist only for special degrees (d=p+1d = p+1d=p+1 with ppp prime) and special numbers of vertices (orders of PSL(2,Fq)PSL(2,\mathbb F_q)PSL(2,Fq​) or SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​)). Applications often need a graph of a prescribed size nnn.

N. Alon's paper Explicit expanders of every degree and size (arXiv:2003.11673v1; Combinatorica 41, 2021) shows how to obtain explicit near-Ramanujan graphs on exactly nnn vertices. This mission formalizes the spectral core of its Theorem 1.2: a Ramanujan graph on mmm vertices can be enlarged to n=m+rn = m + rn=m+r vertices, with degree raised by one, while the nontrivial eigenvalues stay within a constant factor of optimal.

Setting

Let VVV be a finite set of m≥1m \ge 1m≥1 vertices. A (n,d,λ)(n,d,\lambda)(n,d,λ)-graph is a ddd-regular graph on nnn vertices whose adjacency matrix AAA satisfies ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every nontrivial eigenvalue μ\muμ, that is, every eigenvalue other than the top eigenvalue ddd of the constant vector 1\mathbf 11. For a symmetric AAA with A1=d 1A\mathbf 1 = d\,\mathbf 1A1=d1, the nontrivial eigenvalues are those with an eigenvector f≠0f \ne 0f=0 satisfying ∑vf(v)=0\sum_v f(v) = 0∑v​f(v)=0. Graphs may carry loops, at most one per vertex, and a loop adds one to the degree: it is a diagonal entry 111 of AAA.

Fix an integer p≥0p \ge 0p≥0 and let HHH be an (m,p+1,2p)(m, p+1, 2\sqrt p)(m,p+1,2p​)-graph on VVV, a (p+1)(p+1)(p+1)-regular Ramanujan graph. Let R={u1,…,ur}R = \{u_1, \dots, u_r\}R={u1​,…,ur​} be rrr new vertices and let W1,…,Wr⊆VW_1, \dots, W_r \subseteq VW1​,…,Wr​⊆V be pairwise disjoint sets of p+2p+2p+2 vertices each. Put W=⋃iWiW = \bigcup_i W_iW=⋃i​Wi​ and L=V∖WL = V \setminus WL=V∖W. The graph GGG on U=V∪RU = V \cup RU=V∪R is obtained from HHH by joining each uiu_iui​ to every vertex of WiW_iWi​ and adding one loop at each vertex of LLL. Its adjacency matrix is

AG=AH+AR+AL,A_G = A_H + A_R + A_L,AG​=AH​+AR​+AL​,

where AHA_HAH​ is the adjacency matrix of HHH (zero on RRR), ARA_RAR​ that of the stars joining uiu_iui​ to WiW_iWi​, and ALA_LAL​ the diagonal matrix of the loops. Every vertex of GGG has degree p+2p+2p+2.

Formalization targets

Goal: Theorem 1.2, spectral core

AG is an (m+r,  p+2,  2(p+1)+p+(p+1) rm) matrix.A_G \text{ is an } \Big(m+r,\; p+2,\; \sqrt{2(p+1)} + \sqrt p + \frac{(p+1)\,r}{m}\Big)\text{ matrix.}AG​ is an (m+r,p+2,2(p+1)​+p​+m(p+1)r​) matrix.

The paper states λ≤2(d−1)+d−1+o(1)\lambda \le \sqrt{2(d-1)} + \sqrt{d-1} + o(1)λ≤2(d−1)​+d−1​+o(1) for d=p+2d = p+2d=p+2; its proof gives 2(p+1)+p+o(1)\sqrt{2(p+1)} + \sqrt p + o(1)2(p+1)​+p​+o(1), which is stronger, and the error term it produces is (p+1)r/m(p+1)r/m(p+1)r/m. The goal is parametrised by HHH, rrr and the sets WiW_iWi​, so it does not depend on how mmm and rrr are chosen.

Milestones

  1. The variational characterization of the nontrivial eigenvalues: for a symmetric matrix with constant row sums and λ≥0\lambda \ge 0λ≥0, ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every nontrivial eigenvalue if and only if ∣ftAf∣≤λ∥f∥2|f^tAf| \le \lambda\|f\|^2∣ftAf∣≤λ∥f∥2 whenever ∑f=0\sum f = 0∑f=0.
  2. The Cauchy–Schwarz display: ∑Uf=0\sum_U f = 0∑U​f=0 implies ∣∑Vf∣2=∣∑Rf∣2≤∣R∣∑Rf2|\sum_V f|^2 = |\sum_R f|^2 \le |R| \sum_R f^2∣∑V​f∣2=∣∑R​f∣2≤∣R∣∑R​f2.
  3. Inequality (3): ∣ftAHf∣≤b2(p+1)+c2 2p|f^tA_Hf| \le b^2(p+1) + c^2\, 2\sqrt p∣ftAH​f∣≤b2(p+1)+c22p​ with b2=(∑Vf)2/mb^2 = (\sum_V f)^2/mb2=(∑V​f)2/m and c2=∑Vf2−b2c^2 = \sum_V f^2 - b^2c2=∑V​f2−b2.
  4. Display (4): ftALf=∑v∈Lf2(v)f^tA_Lf = \sum_{v\in L} f^2(v)ftAL​f=∑v∈L​f2(v).
  5. Inequality (5): ∣ftARf∣≤p+2x∑Rf2+x∑Wf2|f^tA_Rf| \le \frac{p+2}{x}\sum_R f^2 + x\sum_W f^2∣ftAR​f∣≤xp+2​∑R​f2+x∑W​f2 for every x>0x > 0x>0.
  6. Inequality (6): for ∑Uf=0\sum_U f = 0∑U​f=0 and x>0x > 0x>0,
∣ftAGf∣≤(2p+1)∑Lf2+(2p+x)∑Wf2+p+2x∑Rf2+(p+1)rm∑Rf2.|f^tA_Gf| \le (2\sqrt p+1)\sum_L f^2 + (2\sqrt p+x)\sum_W f^2 + \frac{p+2}{x}\sum_R f^2 + (p+1)\frac rm \sum_R f^2.∣ftAG​f∣≤(2p​+1)L∑​f2+(2p​+x)W∑​f2+xp+2​R∑​f2+(p+1)mr​R∑​f2.

Significance

With HHH the Lubotzky–Phillips–Sarnak graph on m=∣SL(2,Fq)∣m = |SL(2,\mathbb F_q)|m=∣SL(2,Fq​)∣ vertices for the largest suitable prime qqq with m≤nm \le nm≤n, and r=n−mr = n - mr=n−m, the distribution of primes in arithmetic progressions gives r=o(m)r = o(m)r=o(m), and the goal yields an explicit (n,p+2,λ)(n, p+2, \lambda)(n,p+2,λ)-graph with λ≤(1+2)d−1+o(1)\lambda \le (1+\sqrt2)\sqrt{d-1} + o(1)λ≤(1+2​)d−1​+o(1) for every sufficiently large nnn. This is within a factor of about 1.211.211.21 of the Ramanujan bound 2d−12\sqrt{d-1}2d−1​, for every number of vertices, by an elementary modification of an existing graph. The statement is useful independently of LPS: any Ramanujan graph, or any graph with a bound on its nontrivial eigenvalues, can be padded to a nearby size in the same way.

The result is proved in the paper. No formalization of it, of the (n,d,λ)(n,d,\lambda)(n,d,λ) notion, or of the variational characterization of nontrivial eigenvalues for regular graphs exists on the platform. The mission produces a checked version of the spectral argument, and the variational characterization (milestone 1) is a general fact about symmetric matrices with constant row sums that applies to any spectral expander argument.

Difficulty

The vertices of WWW and LLL lie in the old graph HHH, whose spectrum is controlled, but the new vertices of RRR are not; and a vector orthogonal to 1\mathbf 11 on UUU need not be orthogonal to the constant vector on VVV. Bounding ftAGff^tA_GfftAG​f by applying the Ramanujan bound for HHH to fff restricted to VVV therefore fails: the restriction has a component along the trivial eigenvector of HHH, whose eigenvalue p+1p+1p+1 is large. The argument must show that this component is small, of order r/mr/mr/m, and must balance the star edges between RRR and WWW against the loops on LLL so that every vertex class gets the same coefficient. The naive bound ∣ftARf∣≤∥AR∥ ∥f∥2=p+2 ∥f∥2|f^tA_Rf| \le \|A_R\|\,\|f\|^2 = \sqrt{p+2}\,\|f\|^2∣ftAR​f∣≤∥AR​∥∥f∥2=p+2​∥f∥2 added to 2p2\sqrt p2p​ for HHH and 111 for LLL gives a constant larger than 2(p+1)+p\sqrt{2(p+1)}+\sqrt p2(p+1)​+p​; the stated constant needs the weighted estimate.

On the Lean side, milestone 1 concerns the spectrum of a symmetric matrix on the invariant subspace 1⊥\mathbf 1^\perp1⊥, while Mathlib states the spectral theorem for the whole space.

Formalization scope

  • Vertices of GGG are the disjoint union V⊕Fin rV \oplus \mathrm{Fin}\, rV⊕Finr. GGG is represented by its real adjacency matrix, since it has loops; HHH is a Mathlib SimpleGraph with adjMatrix.
  • The (n,d,λ)(n,d,\lambda)(n,d,λ) predicate is stated for matrices: ∣V∣=n|V| = n∣V∣=n, symmetry, A1=d 1A\mathbf 1 = d\,\mathbf 1A1=d1, and ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every eigenpair (μ,f)(\mu, f)(μ,f) with f≠0f \ne 0f=0 and ∑f=0\sum f = 0∑f=0. For simple graphs, ddd-regularity is added.
  • The paper's o(1)o(1)o(1) terms are replaced by the explicit quantities its proof produces: (p+1)r/m(p+1)r/m(p+1)r/m in the goal, and (p+1)rm∑Rf2(p+1)\frac rm\sum_R f^2(p+1)mr​∑R​f2 in (6). Inequality (3) is stated with the corrected relation b2+c2=∑Vf2b^2 + c^2 = \sum_V f^2b2+c2=∑V​f2; the paper's "b2+c2=1b^2 + c^2 = 1b2+c2=1" holds only for unit restrictions.
  • The bound uses p=d−2\sqrt p = \sqrt{d-2}p​=d−2​, as in the proof and the abstract, which implies the printed d−1\sqrt{d-1}d−1​.
  • ppp is any natural number. The hypothesis "ppp prime, p≡1(mod4)p \equiv 1 \pmod 4p≡1(mod4)" serves only to obtain HHH from LPS, and HHH is a hypothesis here. The sets WiW_iWi​ are arbitrary pairwise disjoint sets of size p+2p+2p+2, not the paper's consecutive blocks of a numbering of SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​).
  • Out of scope: the existence of the prime qqq and the estimate n−m=o(m)n - m = o(m)n−m=o(m); the numbering of SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​); the "strongly explicit" and polynomial-time claims; the LPS construction (Theorem 2.1, cited); the variant that replaces loops by a matching for even nnn.
  • The goal cannot be satisfied trivially: dropping the condition ∑f=0\sum f = 0∑f=0 makes it false, since p+2p+2p+2 is always an eigenvalue, and for p≥2p \ge 2p≥2 and small r/mr/mr/m the bound is below p+2p + 2p+2 (for p=5p = 5p=5 it is about 5.70+6r/m5.70 + 6r/m5.70+6r/m). At p=1p = 1p=1 the bound 3+2r/m3 + 2r/m3+2r/m is at least the degree 333, so that case holds trivially; it is the paper's statement there as well.
  • Contributions welcome: proofs of each milestone, especially the variational characterization, which is reusable for mission 3 of this series and for any regular-graph spectral argument.

Selected references

  • N. Alon, Explicit expanders of every degree and size, arXiv:2003.11673v1, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/2003.11673
  • A. Lubotzky, R. Phillips, P. Sarnak, Ramanujan graphs, Combinatorica 8 (1988) 261–277. https://doi.org/10.1007/BF02126799
  • S. Hoory, N. Linial, A. Wigderson, Expander graphs and their applications, Bull. AMS 43 (2006) 439–561. https://doi.org/10.1090/S0273-0979-06-01126-8
9 thms2 active usersReviewed
🏆Completed
Number Theory·Captain: mikedeng1

Explicit Expanders of Every Degree and Size 1: For Distinct Primes q₁, q₂, Every Large n Has an LPS Vertex Count Q(q₁, q₂, s, t) Between n and n + o(n)Research Paper

Motivation

An (n,d,λ)(n,d,\lambda)(n,d,λ)-graph is a ddd-regular graph on nnn vertices in which every eigenvalue of the adjacency matrix other than the top eigenvalue ddd has absolute value at most λ\lambdaλ. Graphs of this kind with λ\lambdaλ small compared with ddd are expanders. They are used in derandomization, error-correcting codes, sorting networks and many other constructions in theoretical computer science. A Ramanujan graph achieves λ≤2d−1\lambda\le 2\sqrt{d-1}λ≤2d−1​, which is asymptotically optimal.

The classical explicit Ramanujan graphs of Lubotzky, Phillips and Sarnak (LPS, 1988) exist only for special vertex counts, such as q(q2−1)/2q(q^2-1)/2q(q2−1)/2 for a prime qqq or the size of a quaternion group modulo mmm. N. Alon, in Explicit expanders of every degree and size (arXiv:2003.11673, 2020; Combinatorica 41, 2021), asks for explicit (n,d,λ)(n,d,\lambda)(n,d,λ)-graphs with λ≤(2+o(1))d\lambda\le(2+o(1))\sqrt dλ≤(2+o(1))d​ for every degree ddd and every number of vertices nnn. His Proposition 1.1 builds such graphs out of LPS graphs, and one ingredient is purely arithmetic. If the available vertex counts of an LPS family are dense enough, so that for every large nnn one is within a factor 1+o(1)1+o(1)1+o(1) of nnn, then a few vertices can be added or removed while keeping the spectral bound.

This mission formalizes that ingredient, Lemma 2.2 of the paper (p. 7). It concerns the vertex counts of the LPS graphs H(p,q1sq2t)H(p,q_1^sq_2^t)H(p,q1s​q2t​) for two fixed primes q1,q2q_1,q_2q1​,q2​ and all exponents s,t≥1s,t\ge1s,t≥1. With q1,q2q_1,q_2q1​,q2​ fixed, the construction needs no large primes, which is why Proposition 1.1 is strongly explicit for every fixed degree.

Setting

Fix natural numbers q1,q2q_1,q_2q1​,q2​. For natural numbers s,ts,ts,t define the LPS vertex count

Q(q1,q2,s,t)=q13(s−1) q23(t−1)⋅q1(q1−1)(q1+1)2⋅q2(q2−1)(q2+1)2.Q(q_1,q_2,s,t)=q_1^{3(s-1)}\,q_2^{3(t-1)}\cdot\frac{q_1(q_1-1)(q_1+1)}{2}\cdot\frac{q_2(q_2-1)(q_2+1)}{2}.Q(q1​,q2​,s,t)=q13(s−1)​q23(t−1)​⋅2q1​(q1​−1)(q1​+1)​⋅2q2​(q2​−1)(q2​+1)​.

When q1,q2q_1,q_2q1​,q2​ are distinct primes congruent to 111 modulo 4p4p4p and s,t≥1s,t\ge1s,t≥1, this is the number of vertices of the LPS Cayley graph H(p,q1sq2t)H(p,q_1^sq_2^t)H(p,q1s​q2t​) (§2.3, p. 6). Lemma 2.2 itself only requires q1,q2q_1,q_2q1​,q2​ to be distinct primes. Both fractions are integers, because q(q−1)(q+1)q(q-1)(q+1)q(q−1)(q+1) is a product of three consecutive integers.

The proof uses the real number α=log⁡q1/log⁡q2\alpha=\log q_1/\log q_2α=logq1​/logq2​, and the fractional part {x}=x−⌊x⌋∈[0,1)\{x\}=x-\lfloor x\rfloor\in[0,1){x}=x−⌊x⌋∈[0,1), written x mod 1x \bmod 1xmod1 in the paper.

Formalization targets

Goal: Lemma 2.2

For distinct primes q1,q2q_1,q_2q1​,q2​ there is a function g:N→Rg:\mathbb N\to\mathbb Rg:N→R with g(n)=o(n)g(n)=o(n)g(n)=o(n) such that for all sufficiently large nnn there are integers s,t≥1s,t\ge1s,t≥1 with

n≤Q(q1,q2,s,t)≤n+g(n).n\le Q(q_1,q_2,s,t)\le n+g(n).n≤Q(q1​,q2​,s,t)≤n+g(n).

Equivalently, the ratio between consecutive elements of {Q(q1,q2,s,t):s,t≥1}\{Q(q_1,q_2,s,t):s,t\ge1\}{Q(q1​,q2​,s,t):s,t≥1} tends to 111. The statement fixes no rate for ggg, matching the paper's o(n)o(n)o(n).

Milestones, in the order the proof of Lemma 2.2 uses them (p. 7)

  1. For distinct primes q1,q2q_1,q_2q1​,q2​, α=log⁡q1/log⁡q2\alpha=\log q_1/\log q_2α=logq1​/logq2​ is irrational.
  2. For irrational α\alphaα and every δ>0\delta>0δ>0 there is k1≥1k_1\ge1k1​≥1 with 0<{k1α}<δ0<\{k_1\alpha\}<\delta0<{k1​α}<δ.
  3. For distinct primes q1,q2q_1,q_2q1​,q2​ and every μ>0\mu>0μ>0 there are k1≥1k_1\ge1k1​≥1, k2≥0k_2\ge0k2​≥0 with
1≤q1k1q2k2≤1+μ.1\le \frac{q_1^{k_1}}{q_2^{k_2}}\le 1+\mu .1≤q2k2​​q1k1​​​≤1+μ.
  1. For distinct primes, μ>0\mu>0μ>0 and k1≥1k_1\ge1k1​≥1, if 1≤q1k1/q2k2≤1+μ1\le q_1^{k_1}/q_2^{k_2}\le1+\mu1≤q1k1​​/q2k2​​≤1+μ, then for s>k1s>k_1s>k1​ and t≥1t\ge1t≥1
1≤Q(q1,q2,s,t)Q(q1,q2,s−k1,t+k2)≤(1+μ)3.1\le\frac{Q(q_1,q_2,s,t)}{Q(q_1,q_2,s-k_1,t+k_2)}\le(1+\mu)^3 .1≤Q(q1​,q2​,s−k1​,t+k2​)Q(q1​,q2​,s,t)​≤(1+μ)3.

Significance

The result. Lemma 2.2 is the step of Proposition 1.1 that turns a family of Ramanujan graphs with sparse vertex counts into a family whose vertex counts approximate every large nnn up to a factor 1+o(1)1+o(1)1+o(1). The deviation from nnn can then be absorbed by the general packing argument of §2.1 of the paper. Without it, the construction would have to search for large primes depending on nnn, and the result would be explicit but not strongly explicit.

The formalization. The lemma is proved in the paper, in one paragraph. To our knowledge no machine-checked proof exists, and the platform has no statement of it. The only related platform item is the irrationality of log⁡2/log⁡3\log 2/\log 3log2/log3, the case q1=2q_1=2q1​=2, q2=3q_2=3q2​=3 of milestone 1. Formalizing the lemma requires a quantitative inhomogeneous step that the paper leaves implicit ("implying the desired result"). Its last sentence also contains a misprint that the formalization corrects (see below). The Diophantine milestones 1–3 are reusable for any argument about the multiplicative density of {q1aq2b}\{q_1^a q_2^b\}{q1a​q2b​}, for instance the ratio of consecutive elements of {2a3b}\{2^a3^b\}{2a3b}.

Difficulty

Each milestone is short. The difficulty is in making the paper's last sentence ("implying the desired result") into a proof. Taking sss or ttt large separately does not work: changing sss or ttt by one multiplies QQQ by q13q_1^3q13​ or q23q_2^3q23​, a fixed factor larger than 111, so the values obtained by varying one exponent leave gaps of a constant ratio. The bound must hold for every large nnn, not just along a subsequence, and the exponents must stay positive throughout. Milestone 2 is the classical fact that the multiples of an irrational number are dense modulo 111. It needs a pigeonhole argument, not just the irrationality.

Formalization scope

  • Representation. QQQ is a natural-number-valued Lean definition given by the explicit formula above, not the cardinality of a quaternion group. The graph-count interpretation needs the section's congruence conditions on p,q1,q2p,q_1,q_2p,q1​,q2​; Lemma 2.2 is an arithmetic statement for all distinct primes q1,q2q_1,q_2q1​,q2​. Every use of QQQ in the theorems has positive s,ts,ts,t, so natural-number subtraction s−1s-1s−1 is exact, and the division by 222 is exact since q(q−1)(q+1)q(q-1)(q+1)q(q−1)(q+1) is even. Ratios and the bound n+g(n)n+g(n)n+g(n) are computed in R\mathbb RR after casting. The logarithm is Real.log, and the fractional part is Int.fract.
  • o(n). The paper writes n≤Q≤n+o(n)n\le Q\le n+o(n)n≤Q≤n+o(n) for every large nnn. The goal states it literally: ∃g, g=o(n)\exists g,\ g=o(n)∃g, g=o(n) (Mathlib IsLittleO along atTop) and, eventually in nnn, ∃s,t≥1\exists s,t\ge1∃s,t≥1 with n≤Q≤n+g(n)n\le Q\le n+g(n)n≤Q≤n+g(n). This is equivalent to the form "for every μ>0\mu>0μ>0, every large nnn has s,t≥1s,t\ge1s,t≥1 with n≤Q≤(1+μ)nn\le Q\le(1+\mu)nn≤Q≤(1+μ)n". The paper's proof yields the second form, with the factor (1+μ)3(1+\mu)^3(1+μ)3 for arbitrary μ\muμ.
  • Misprint. The paper's last sentence compares Q(q1,q2,s,t)Q(q_1,q_2,s,t)Q(q1​,q2​,s,t) with Q(q1,q2,s−k1,t−k2)Q(q_1,q_2,s-k_1,t-k_2)Q(q1​,q2​,s−k1​,t−k2​) for s,t≥max⁡{k1,k2}s,t\ge\max\{k_1,k_2\}s,t≥max{k1​,k2​}. As printed the ratio is q13k1q23k2q_1^{3k_1}q_2^{3k_2}q13k1​​q23k2​​, which is not close to 111. Milestone 4 uses the intended pair (s−k1,t+k2)(s-k_1,t+k_2)(s−k1​,t+k2​), with s>k1s>k_1s>k1​ so that s−k1≥1s-k_1\ge1s−k1​≥1.
  • Ruling out a trivial reading. The lower bound n≤Q(q1,q2,s,t)n\le Q(q_1,q_2,s,t)n≤Q(q1​,q2​,s,t) alone holds for every nnn by taking sss large. The content of the goal is the upper bound with a sublinear excess, and s,ts,ts,t must be positive. In milestone 3 the condition k1≥1k_1\ge1k1​≥1 excludes the trivial witness k1=k2=0k_1=k_2=0k1​=k2​=0.
  • Out of scope. The derivation of QQQ as the vertex count of H(p,q1sq2t)H(p,q_1^sq_2^t)H(p,q1s​q2t​) (Hensel's lemma and the Chinese remainder theorem, pp. 6–7), Theorem 2.1 (the LPS graphs are Ramanujan, cited from Lubotzky–Phillips–Sarnak), Proposition 1.1, the §2.1 packing argument, and every running-time ("explicit", "strongly explicit") claim.
  • Infrastructure. Only Mathlib is needed: unique factorization for milestone 1, Int.fract and a pigeonhole or Dirichlet-approximation argument for milestone 2, and real exponentiation and asymptotics for the goal. Contributions of alternative proofs of milestone 2, for instance via Mathlib's Dirichlet approximation theorem, are welcome.

Selected references

  • N. Alon, Explicit expanders of every degree and size, arXiv:2003.11673v1, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/2003.11673 , https://doi.org/10.1007/s00493-020-4429-x
  • A. Lubotzky, R. Phillips, P. Sarnak, Ramanujan graphs, Combinatorica 8 (1988) 261–277. https://doi.org/10.1007/BF02126799
  • S. Hoory, N. Linial, A. Wigderson, Expander graphs and their applications, Bull. AMS 43 (2006) 439–561. https://doi.org/10.1090/S0273-0979-06-01126-8
6 thms2 active usersReviewed
🏆Completed
Linear algebraOperations Research·Captain: mikedeng1

On the Abstract Properties of Linear Dependence 5: The Seven-Element Fano Matroid Corresponds to No Real MatrixResearch Paper

Motivation

Whitney's 1935 paper On the Abstract Properties of Linear Dependence introduced matroids: finite sets equipped with a rank function, or equivalently a family of independent sets, obeying a few postulates abstracted from the linear dependence of the columns of a matrix. The obvious first question about such an abstraction is whether it is genuinely more general than its model, that is, whether there are matroids that do not arise from any matrix. Section 16 of the paper answers it with a seven-element example, now called the Fano matroid F7F_7F7​, and proves that no real matrix corresponds to it.

The question has had a long life. Representability of matroids over a given field is a central theme of matroid theory: Tutte (1958) characterized the matroids representable over the field with two elements by a single excluded minor, the four-point line U2,4U_{2,4}U2,4​, and the regular matroids by three excluded minors, U2,4U_{2,4}U2,4​, F7F_7F7​ and its dual; and Seymour's decomposition of regular matroids (1980) rests on the same objects. Whitney's §16 is the starting point of this line: the first proof that the abstract postulates admit matroids outside linear algebra over R\mathbb RR.

Timeline:

  • 1935. Whitney defines matroids, the circuit matrix of a matrix, and proves (§16) that the seven-element matroid M′M'M′ corresponds to no real matrix; in a footnote he credits Saunders MacLane with finding that M′M'M′ corresponds to no matrix and identifying it with a finite projective geometry. On p. 533 he exhibits a matrix of integers mod 2 for M′M'M′.
  • 1958. Tutte characterizes binary and regular matroids by excluded minors; F7F_7F7​ appears as an excluded minor for regularity (Tutte 1958).

Setting

Let M=(aij)\mathbf M=(a_{ij})M=(aij​) be an m×nm\times nm×n matrix with columns C1,…,CnC_1,\dots,C_nC1​,…,Cn​. For a set NNN of columns, let r(N)r(N)r(N) be the rank of the submatrix formed by those columns. Regarding the columns as abstract elements gives a matroid MMM on {C1,…,Cn}\{C_1,\dots,C_n\}{C1​,…,Cn​} with rank function rrr: the matroid of M\mathbf MM. A matroid corresponds to M\mathbf MM if it is the matroid of M\mathbf MM, with elements matched to columns.

A circuit of a matroid is a minimal dependent set. For a circuit P={i1,…,ip}P=\{i_1,\dots,i_p\}P={i1​,…,ip​} of the matroid of M\mathbf MM, there are numbers b1,…,bnb_1,\dots,b_nb1​,…,bn​ with ∑jaijbj=0\sum_j a_{ij}b_j=0∑j​aij​bj​=0 for every row iii, and bj≠0b_j\neq 0bj​=0 exactly for j∈Pj\in Pj∈P; the set of such vectors is written Zi1⋯ipZ_{i_1\cdots i_p}Zi1​⋯ip​​ when only the support condition is meant. Stacking one such row per circuit gives the circuit matrix M′\mathbf M'M′ of M\mathbf MM, determined up to nonzero factors on its rows.

A fundamental set of circuits of a matroid MMM with nullity n(M)=ρ(M)−r(M)n(M)=\rho(M)-r(M)n(M)=ρ(M)−r(M) (ρ\rhoρ the number of elements) is a family of circuits P1,…,PqP_1,\dots,P_qP1​,…,Pq​ with q=n(M)q=n(M)q=n(M) such that the elements can be ordered e1,…,ene_1,\dots,e_ne1​,…,en​ with en−q+i∈Pie_{n-q+i}\in P_ien−q+i​∈Pi​ and en−q+j∉Pie_{n-q+j}\notin P_ien−q+j​∈/Pi​ for j>ij>ij>i; it is strict if en−q+j∉Pie_{n-q+j}\notin P_ien−q+j​∈/Pi​ for every j≠ij\neq ij=i.

The matroid M′M'M′ of §16 has elements 1,…,71,\dots,71,…,7; its bases (maximal independent sets) are all three-element sets except

124,135,167,236,257,347,456.(16.1)124,\quad 135,\quad 167,\quad 236,\quad 257,\quad 347,\quad 456. \qquad (16.1)124,135,167,236,257,347,456.(16.1)

Formalization targets

Goal: §16, pp. 529–530

∃ M′and∀m ∀ M∈Rm×7: M′ is not the matroid of M.\exists\,M' \quad\text{and}\quad \forall m\ \forall\,\mathbf M\in\mathbb R^{m\times 7}:\ M' \text{ is not the matroid of } \mathbf M .∃M′and∀m ∀M∈Rm×7: M′ is not the matroid of M.

The number of rows is arbitrary; the existence clause makes the non-existence statement non-vacuous.

Milestones

  1. §12. Every real matrix has a matroid: the ranks of column submatrices satisfy the rank postulates.
  2. §14, (14.1). Every real matrix has a circuit matrix.
  3. Theorem 29. The rows of a fundamental set of circuits form a base for the rows of the circuit matrix, so r(M′)=q=n(M)r(\mathbf M')=q=n(\mathbf M)r(M′)=q=n(M).
  4. Lemma 10. The support of a vector in the row space HHH of a circuit matrix is a union of circuits.
  5. Lemma 11. Two vectors of HHH with the same circuit as support are proportional.
  6. Theorem 32. For a circuit matrix normalised along a strict fundamental set, a minor DDD vanishes iff an associated q×qq\times qq×q minor D′D'D′ vanishes, iff some circuit avoids a prescribed set of columns.
  7. §16, rank of M′M'M′. The rank of a kkk-set is kkk for k≤2k\le 2k≤2, 333 for k≥4k\ge 4k≥4, and for k=3k=3k=3 it is 222 on (16.1) and 333 otherwise.
  8. p. 533. M′M'M′ is the matroid of an explicit 3×73\times 73×7 matrix of integers mod 2.

Significance

The result. The theorem separates the abstract notion of matroid from linear dependence over R\mathbb RR: some matroids are not real-representable. It also exhibits that representability depends on the field, because the same matroid is the matroid of a matrix over the integers mod 2 (milestone 8). Everything later written about representability over particular fields, excluded-minor characterizations, and the gap between abstract and linear matroids starts from this distinction. Theorem 32 is of independent interest: it translates statements about circuits of a represented matroid into the vanishing of minors of a normalised circuit matrix.

Formalizing it. The result is classical and its proof is short on paper, but it is not formalized in Mathlib, which has matroids (Matroid, circuits, ranks) but no column matroid of a matrix with a rank-of-submatrix characterization, no circuit matrix, and no Fano matroid. The mission produces those objects and the bridge lemmas (Theorem 29, Lemmas 10–11, Theorem 32) that connect matroid circuits with linear algebra of the circuit matrix. No machine-checked proof of the non-representability of the Fano matroid over R\mathbb RR in Lean is known to the curators.

Difficulty

The obvious attempt is a direct search: suppose a real m×7m\times 7m×7 matrix has M′M'M′ as its matroid and derive a contradiction from the seven dependent triples. This does not work as stated. Each rank condition is a determinantal (nonlinear) condition on the entries, the number of rows mmm is unbounded, and a representation is determined only up to row operations and column scalings, so there is no finite case check and no single linear computation that settles the question. The contradiction has to come from an argument that is invariant under these symmetries, and the milestones (circuit vectors determined up to scaling, fundamental sets spanning, circuits detected by minors) are what such an argument needs to be stated in. The field also matters: the argument must use that 2≠02\neq 02=0 in R\mathbb RR, since over a field of characteristic 2 the statement is false (milestone 8).

Formalization scope

  • Elements and matrices. Matroids are Mathlib Matroids whose ground set is the whole (finite) type. The Fano matroid lives on Fin 7, Whitney's element kkk being k - 1; the seven triples are written out literally. Matrices are Matrix (Fin m) ι K; "the matroid of M\mathbf MM" means: ground set everything, and the rank M.eRk N of every finite set NNN of columns equals Matrix.rank of the column submatrix.
  • Field. The goal and Lemmas 10–11, Theorems 29 and 32 are stated over R\mathbb RR, as in the paper; the predicate "matroid of a matrix" is stated over any field so that the mod-2 milestone uses the same notion.
  • Circuit matrix. Rows are determined up to nonzero factors, so "circuit matrix" is a predicate on a matrix together with a bijection between its rows and the circuits; every theorem holds for every such choice.
  • Nullity and indices. q=n(M)q=n(M)q=n(M) is written q+r(M)=ρ(M)q+r(M)=\rho(M)q+r(M)=ρ(M) in extended naturals, with no truncated subtraction. In Theorem 32, n=p+qn=p+qn=p+q, the complement of i1,…,isi_1,\dots,i_si1​,…,is​ is given as an order embedding of Fin t with s+t=qs+t=qs+t=q, and determinants are of square submatrices in the paper's row and column order.
  • Ruling out trivial readings. The goal includes the existence of M′M'M′; without it "every matroid with these bases has no real matrix" could hold vacuously. The goal quantifies over every number of rows; fixing m=3m=3m=3 would be a weaker statement.

Reusable beyond this mission: the matroid of a matrix over a field, the circuit matrix, fundamental sets of circuits, and the Fano matroid. Contributions welcome: proofs of the milestones, and a proof of the goal by any route, including one that does not go through Theorem 32.

Selected references

  • H. Whitney, On the Abstract Properties of Linear Dependence, American Journal of Mathematics 57 (1935), 509–533. https://doi.org/10.2307/2371182
  • W. T. Tutte, A homotopy theorem for matroids, I, II, Transactions of the American Mathematical Society 88 (1958), 144–174. https://doi.org/10.2307/1993244
  • J. Oxley, Matroid Theory, 2nd ed., Oxford University Press, 2011. https://doi.org/10.1093/acprof:oso/9780198566946.001.0001
  • O. Veblen and J. W. Young, Projective Geometry, Vol. I, Ginn, 1910 (cited by Whitney for the finite projective geometry).
13 thms2 active usersReviewed
🏆Completed
Linear algebraOperations Research·Captain: mikedeng1

On the Abstract Properties of Linear Dependence 6: Every Matroid Satisfying (C*) Is Represented by a Matrix of Integers Mod 2Research Paper

Motivation

Whitney's 1935 paper introduced matroids as an abstraction of linear dependence among the columns of a matrix. Most of the paper works over the real numbers; its appendix asks which matroids arise from matrices of integers mod 2, that is, matrices with entries 0 and 1 in which rank and dependence are computed over the two-element field. These are today's binary matroids. They include the cycle matroids of graphs (Whitney closes the paper by noting that graphs correspond to mod-2 matrices with exactly two ones in each column) and they are the setting of several later structure theorems: Tutte's excluded-minor characterization of binary matroids (Tutte 1958), Seymour's decomposition of regular matroids (Seymour 1980) and Seymour's theory of binary clutters and max-flow min-cut (Seymour 1977), which underlies parts of combinatorial optimization.

Whitney's answer is an intrinsic postulate, (C*), on the circuits of the matroid, stated without reference to any matrix, and a constructive representation theorem (Theorem 37): a matroid satisfying (C*) is the matroid of a mod-2 matrix, and the matrix is unique once the columns of one base are fixed.

Setting

A matroid MMM on elements e1,…,ene_1, \dots, e_ne1​,…,en​ is given by its independent sets; its circuits are its minimal dependent sets, its rank r(M)r(M)r(M) is the size of a base, and its nullity is n(M)=n−r(M)n(M) = n - r(M)n(M)=n−r(M). Here MMM is a Mathlib Matroid (Fin n) whose ground set is all of Fin n.

Subsets of the elements are added mod 2: a sum of finitely many sets is the set of elements lying in an odd number of them (for two sets, the symmetric difference). A cycle is a sum mod 2 of circuits; the empty sum is the null cycle ∅\emptyset∅. A set is a true sum of sets that have no common elements and whose union it is. Postulate (C*) requires that each cycle be a true sum of circuits.

With n=r+qn = r + qn=r+q, a family P1,…,PqP_1, \dots, P_qP1​,…,Pq​ is a strict fundamental set of circuits with respect to en−q+1,…,ene_{n-q+1}, \dots, e_nen−q+1​,…,en​ if q=n(M)q = n(M)q=n(M), each PiP_iPi​ is a circuit, and PiP_iPi​ contains en−q+ie_{n-q+i}en−q+i​ but no other en−q+je_{n-q+j}en−q+j​.

For a matrix M\mathbf MM over the integers mod 2 with columns C1,…,CnC_1, \dots, C_nC1​,…,Cn​, columns are independent (mod 2) if no non-null subset of them sums to the zero column. The matroid corresponding to M\mathbf MM has the column indices as elements and these independent sets.

Formalization targets

Goal: Theorem 37 (p. 533)

Let MMM satisfy (C*), with elements e1,…,ene_1, \dots, e_ne1​,…,en​ and base {e1,…,en−q}\{e_1, \dots, e_{n-q}\}{e1​,…,en−q​}. For every matrix M1\mathbf M_1M1​ mod 2 (any number of rows) whose n−qn - qn−q columns are independent mod 2,

∃! M=(M1∣Cn−q+1⋯Cn)  whose corresponding matroid is M.\exists!\ \mathbf M = (\mathbf M_1 \mid C_{n-q+1} \cdots C_n) \ \text{ whose corresponding matroid is } M.∃! M=(M1​∣Cn−q+1​⋯Cn​)  whose corresponding matroid is M.

Milestones

  1. Theorem 9 (p. 517): if e1,…,en−qe_1, \dots, e_{n-q}e1​,…,en−q​ is a base, there is a unique strict fundamental set of circuits with respect to en−q+1,…,ene_{n-q+1}, \dots, e_nen−q+1​,…,en​.
  2. Appendix, p. 531: (C*) implies the circuit postulate (C₂), for any family of sets.
  3. Theorem 33: under (C*), the circuits are exactly the minimal non-null cycles.
  4. Theorem 34: under (C*), the cycles are exactly the 2q2^q2q sums mod 2 of a strict fundamental set.
  5. Theorem 35: two (C*)-matroids with a common strict fundamental set have the same circuits.
  6. Theorem 36: any P1,…,PqP_1, \dots, P_qP1​,…,Pq​ with en−q+i∈Pi⊆{e1,…,en−q,en−q+i}e_{n-q+i} \in P_i \subseteq \{e_1, \dots, e_{n-q}, e_{n-q+i}\}en−q+i​∈Pi​⊆{e1​,…,en−q​,en−q+i​} is the strict fundamental set of exactly one (C*)-matroid.
  7. Appendix, p. 532: the matroid of a matrix mod 2 exists, satisfies (C*), and its cycles are the supports of the mod-2 dependencies among the columns.

Milestone 7 and the goal together characterize binary matroids as the matroids satisfying (C*).

Significance

The result. Theorem 37 and the p. 532 claim give an intrinsic, matrix-free description of the matroids representable over the two-element field, and Theorem 36 parametrizes all of them by qqq arbitrary subsets of a base. Uniqueness in Theorem 37 says that a binary representation is determined by the columns of one base; in modern terms, binary matroids are uniquely representable over GF(2) up to row operations. Every later theory of binary matroids, including graphic and cographic matroids, Tutte's excluded-minor theorem and Seymour's decomposition, starts from this equivalence.

Formalizing it. The results are proved in the paper and in textbooks (e.g. Oxley, Matroid Theory, Ch. 9) but, at the Mathlib revision used here, there is no notion of a matroid represented by a matrix over a field, and no binary-matroid theory. On Prove2Me, the existing binary objects (SeymourMFMC.Binary.*) are binary clutters defined through blockers, not matroids represented by mod-2 matrices. This mission produces the representation predicate for mod-2 matrices, the cycle space of a matroid, and the equivalence between (C*) and binary representability.

Difficulty

Writing down candidate columns is not the hard part; showing that the matroid of the completed matrix is MMM itself, and not merely a matroid sharing some of its circuits, is. Whitney's example at the end of §9 exhibits two different matroids with a common strict fundamental set, so agreement on fundamental circuits does not by itself identify a matroid; any argument must use (C*) on both the given matroid and the matroid of the matrix. A naive comparison of independent sets column by column does not close this gap. Uniqueness likewise depends on the independence mod 2 of the prescribed columns: without it, different completions can give the same matroid.

Formalization scope

  • Matroids are Mathlib Matroid (Fin (r + q)) with ground set Set.univ; Whitney's eke_kek​ is k - 1, his e1,…,en−qe_1, \dots, e_{n-q}e1​,…,en−q​ is the range of Fin.castAdd q, and en−q+ie_{n-q+i}en−q+i​ is Fin.natAdd r (i - 1). Writing n=r+qn = r + qn=r+q removes natural-number subtraction; qqq is not a free parameter, since {e1,…,er}\{e_1, \dots, e_r\}{e1​,…,er​} is required to be a base.
  • Sums mod 2 count parity of membership (sumMod2); cycles are sums over finite sets of circuits; true sums are unions over finite pairwise-disjoint sets of circuits; (C*) is SatisfiesCStar on the circuit family {C | M.IsCircuit C}. These definitions take the circuit family as a parameter, so that the (C₂) milestone is posed for an arbitrary family of sets, as Whitney poses it.
  • A strict fundamental set includes the nullity condition r(M)+q=ρ(M)r(M) + q = \rho(M)r(M)+q=ρ(M), stated in N∞\mathbb N_\inftyN∞​.
  • Matrices are Matrix (Fin m) (Fin n) (ZMod 2) with any mmm; independence mod 2 of columns is LinearIndepOn (ZMod 2) of the columns (the rows of the transpose). IsMatroidOf M A compares all independent sets, not only bases.
  • Ruled out: the goal is not satisfied by any statement that compares only the bases of one size, by an existence-only statement without uniqueness, or by real (instead of mod-2) independence.
  • Tacit hypotheses made explicit: the matroid's ground set is exactly e1,…,ene_1, \dots, e_ne1​,…,en​ (ρ(M)=n\rho(M) = nρ(M)=n); the elements and matroids are finite.

Contributions welcome: the general fact that the matroid of a vector family over a field exists (a reusable Matroid.ofFun-style construction over any field), the cycle-space lemmas, and proofs of the milestones in any order.

Selected references

  • H. Whitney, On the Abstract Properties of Linear Dependence, American Journal of Mathematics 57 (1935), 509–533. https://doi.org/10.2307/2371182
  • W. T. Tutte, A homotopy theorem for matroids, I, II, Transactions of the AMS 88 (1958), 144–174. https://doi.org/10.2307/1993244
  • P. D. Seymour, The matroids with the max-flow min-cut property, Journal of Combinatorial Theory Ser. B 23 (1977), 189–222. https://doi.org/10.1016/0095-8956(77)90031-4
  • P. D. Seymour, Decomposition of regular matroids, Journal of Combinatorial Theory Ser. B 28 (1980), 305–359. https://doi.org/10.1016/0095-8956(80)90075-1
  • J. Oxley, Matroid Theory, 2nd ed., Oxford University Press, 2011. https://doi.org/10.1093/acprof:oso/9780198566946.001.0001
11 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

On the Abstract Properties of Linear Dependence 3: Two Elements Share a Component Iff Some Circuit Contains BothResearch Paper

Motivation

Hassler Whitney's 1935 paper On the Abstract Properties of Linear Dependence introduced matroids: finite sets of elements carrying an abstract rank function that behaves like the rank of a set of vectors. Part II of the paper opens with the decomposition of a matroid into components. The question it answers is basic to every later use of matroids: when does a matroid split into independent pieces, and how can the pieces be recognized?

For the matroid of a graph (elements = edges, rank = number of vertices minus number of connected pieces spanned) the components are the 2-connected blocks of the graph, and Whitney's theorem recovers the classical fact that two edges lie in a common block exactly when they lie on a common cycle. Whitney had studied separability of graphs in Non-separable and planar graphs (1932), and footnote 11 of the 1935 paper points out that the theorem identifies König's "Glieder" of a graph with components. Matroid connectivity built on this notion runs through later structure theory: Tutte's higher connectivity, Seymour's decomposition of regular matroids, and the matroid minors project all start from the separation of a matroid into components.

Setting

A matroid MMM on a finite ground set EEE is given here by Mathlib's Matroid structure, with rank function r(X)r(X)r(X) for X⊆EX\subseteq EX⊆E (Mathlib's M.eRk X) and circuits, the minimal dependent sets (M.IsCircuit). Whitney treats every subset X⊆EX\subseteq EX⊆E as a matroid in its own right, a submatroid, with the rank function of MMM restricted to subsets of XXX. For sets he writes M1+M2M_1+M_2M1​+M2​ for the union, ρ(N)\rho(N)ρ(N) for the number of elements of NNN, and

n(N)=ρ(N)−r(N)n(N) = \rho(N) - r(N)n(N)=ρ(N)−r(N)

for the nullity of NNN.

Rank is subadditive: r(X1+X2)≤r(X1)+r(X2)r(X_1+X_2)\le r(X_1)+r(X_2)r(X1​+X2​)≤r(X1​)+r(X2​). A submatroid XXX is separable if it can be divided into two disjoint groups X1,X2X_1, X_2X1​,X2​, each containing at least one element, with

r(X)=r(X1)+r(X2),r(X) = r(X_1) + r(X_2),r(X)=r(X1​)+r(X2​),

and non-separable otherwise. Every single element is non-separable. A component of MMM is a maximal non-separable part of MMM: a nonempty non-separable set K⊆EK\subseteq EK⊆E contained in no strictly larger non-separable subset of EEE.

Formalization targets

Goal: Theorem 19

For two distinct elements e1≠e2e_1\neq e_2e1​=e2​ of EEE,

(∃K component of M: e1,e2∈K)  ⟺  (∃P circuit of M: e1,e2∈P).\bigl(\exists K \text{ component of } M:\ e_1, e_2\in K\bigr) \iff \bigl(\exists P \text{ circuit of } M:\ e_1, e_2\in P\bigr).(∃K component of M: e1​,e2​∈K)⟺(∃P circuit of M: e1​,e2​∈P).

Components are defined by the rank function, circuits by dependence; the goal asserts that the two descriptions agree.

Milestones (§10, in the paper's order)

  • Theorem 11. If r(M1+M2)=r(M1)+r(M2)r(M_1+M_2)=r(M_1)+r(M_2)r(M1​+M2​)=r(M1​)+r(M2​), M1′⊆M1M_1'\subseteq M_1M1′​⊆M1​ and M2′⊆M2M_2'\subseteq M_2M2′​⊆M2​, then r(M1′+M2′)=r(M1′)+r(M2′)r(M_1'+M_2')=r(M_1')+r(M_2')r(M1′​+M2′​)=r(M1′​)+r(M2′​).
  • Theorem 12. Under the same rank additivity, a non-separable M′⊆M1+M2M'\subseteq M_1+M_2M′⊆M1​+M2​ lies in M1M_1M1​ or in M2M_2M2​.
  • Theorem 13. Two non-separable sets with a common element have a non-separable union.
  • Theorem 14. Distinct components are disjoint.
  • Theorem 15. The components cover EEE, and no other family of components does.
  • Theorem 16. A set is non-separable of nullity 111 if and only if it is a circuit.
  • Lemma 9. If M1+M2M_1+M_2M1​+M2​ is non-separable, with M1,M2M_1, M_2M1​,M2​ nonempty and disjoint, some circuit inside M1+M2M_1+M_2M1​+M2​ meets both.
  • Theorem 17. A non-separable set of nullity n>0n>0n>0 is built from a circuit by n−1n-1n−1 steps, each adding a set of elements that forms a circuit with elements already present, through non-separable sets of nullity 1,2,…,n1,2,\dots,n1,2,…,n.
  • Theorem 18. For distinct nonempty non-separable M1,…,MpM_1,\dots,M_pM1​,…,Mp​ covering EEE, the following are equivalent: they are the components; they are pairwise disjoint and no circuit meets two of them; r(E)=∑ir(Mi)r(E)=\sum_i r(M_i)r(E)=∑i​r(Mi​).

Significance

The result. Theorem 19 makes the component decomposition computable from circuits alone and shows that "lying on a common circuit" is an equivalence relation on distinct elements, a fact that is not evident from the circuit axioms. Theorem 18 adds that the decomposition is the unique one with additive rank. Together they are the starting point of matroid connectivity: the direct-sum decomposition of a matroid, the reduction of many matroid problems (representability, duality of components, Whitney's own Theorems 24–26 on duals of components) to the connected case, and the higher-connectivity theory that followed.

Formalizing it. The results are classical and proved in the paper; nothing here is open. To our knowledge Mathlib at the pinned revision has no notion of matroid connectivity or components, so this mission produces the first machine-checked development of Whitney's §10: the rank-based definition of separability, the disjoint decomposition into components, the circuit characterization, and the ear-type construction of non-separable matroids (Theorem 17). These are reusable for any later formalization of matroid connectivity, including Whitney's results on duals of components.

Difficulty

The two directions of Theorem 19 rest on different machinery. That two elements on a common circuit lie in one component follows from the rank theory (Theorems 13 and 16). The converse is the substantial direction: a component is defined by the failure of rank additivity, which only says that every division of the component is crossed by some circuit (Lemma 9). It does not directly give one circuit through two prescribed elements. Combining circuits that cross different divisions into a single circuit through both e1e_1e1​ and e2e_2e2​ requires the circuit elimination property together with a minimality argument over subsets of the component; the naive attempt of chaining overlapping circuits from e1e_1e1​ to e2e_2e2​ gives a connected chain of circuits, not one circuit.

Formalization scope

  • Representation. A matroid is Mathlib's Matroid α with [M.Finite]; Whitney's matroids are finite. A submatroid is a subset X⊆X\subseteqX⊆ M.E with the rank M.eRk restricted to its subsets; results that Whitney states for "a matroid M=M1+M2M = M_1 + M_2M=M1​+M2​" are stated for subsets of an ambient finite matroid, which is the same statement applied to the submatroid M1+M2M_1+M_2M1​+M2​.
  • Ranks are Mathlib's ℕ∞-valued M.eRk, finite on a finite matroid, so (10.1) is an equation of natural numbers. Nullity is computed in Z\mathbb ZZ as the number of elements minus the rank.
  • Definitions. IsSeparable M X requires two nonempty, disjoint groups with union XXX and additive rank; without nonemptiness every set would be separable. IsNonSeparable M X adds X⊆X\subseteqX⊆ M.E. IsComponent M K requires KKK nonempty, non-separable, and maximal; nonemptiness excludes the empty set, which is vacuously non-separable.
  • Tacit hypotheses made explicit. In Theorem 19 the two elements are distinct: for e1=e2e_1=e_2e1​=e2​ a coloop is its own component and lies on no circuit. In Theorem 18 the sets M1,…,MpM_1,\dots,M_pM1​,…,Mp​ are distinct and nonempty: a loop listed twice would satisfy (3) but not (2), and an empty set would satisfy (2) and (3) but not (1). In Theorems 11 and 12 the two parts need not be disjoint, as Whitney's use of M1+M2M_1+M_2M1​+M2​ for overlapping sets in Theorem 13 indicates; the statements hold in that generality.
  • Ruled out. Components must not be defined as the classes of the relation "lie on a common circuit": that would make the goal a tautology. Here they are the rank-defined maximal non-separable sets of §10, and circuits are Mathlib's Matroid.IsCircuit.
  • Infrastructure. Solvers will need submodularity of M.eRk and circuit elimination (both in Mathlib), the relation between circuits of M ↾ X and circuits of M inside XXX (Matroid.restrict_isCircuit_iff), and finiteness arguments for maximal non-separable sets. Proofs of the milestones, alternative proofs of the goal, and lemmas relating components to Mathlib's direct sums of matroids are all welcome.

Selected references

  • H. Whitney, On the Abstract Properties of Linear Dependence, American Journal of Mathematics 57 (1935), 509–533. https://doi.org/10.2307/2371182
  • H. Whitney, Non-separable and planar graphs, Transactions of the American Mathematical Society 34 (1932), 339–362. https://doi.org/10.1090/S0002-9947-1932-1501641-2
  • D. König, Acta Litterarum ac Scientiarum Szeged, vol. 6, pp. 155–179, as cited by Whitney in footnote 11 (p. 159 for the notion of "Glied").
  • J. Oxley, Matroid Theory, 2nd ed., Oxford University Press, 2011, Chapter 4 (connectivity).
13 thms2 active usersReviewed
Graph Theory·Captain: mikedeng1

The Strong Perfect Graph Theorem IV: A Berge Graph Whose Appearances of K4 Are All Degenerate Is Double Split, Decomposes, or Has No Appearance of K4Research Paper

Perfect graphs and the decomposition of Berge graphs

A graph is perfect if every induced subgraph has chromatic number equal to its clique number. Perfect graphs are the graphs for which colouring and clique problems behave as linear programs do: the stable-set polytope of a perfect graph is described by its clique inequalities, so maximum weight stable sets and minimum colourings can be computed in polynomial time (Grötschel, Lovász & Schrijver 1988). In 1961 Berge conjectured that a graph is perfect exactly when it has no odd hole and no odd antihole. Chudnovsky, Robertson, Seymour and Thomas proved this, the strong perfect graph theorem, in Ann. of Math. 164 (2006).

The proof is a decomposition theorem: every Berge graph is basic or admits one of a few decompositions. The paper reaches it through twelve steps, 1.8.1–1.8.12 (p. 59), each handling graphs that contain a certain configuration. This mission poses step 1.8.3, Theorem 9.6. It handles Berge graphs that contain the line graph of a bipartite subdivision of K4K_4K4​, all such line graphs being degenerate.

Setting

All graphs are finite and simple. G‾\overline{G}G denotes the complement of GGG. A hole is an induced cycle of length at least 444, an antihole is a hole of G‾\overline{G}G, and GGG is Berge if all its holes and antiholes have even length. A path is always an induced path, and an antipath is a path of G‾\overline{G}G. The length of either is its number of edges.

Line graphs and appearances. The line graph L(H)L(H)L(H) has vertex set E(H)E(H)E(H), two edges adjacent when they share an end. HHH is a subdivision of JJJ if it arises from JJJ by replacing every edge by a track (a path, not necessarily induced), these tracks disjoint except for their ends. JJJ appears in GGG if, for some bipartite subdivision HHH of JJJ, L(H)L(H)L(H) is isomorphic to an induced subgraph of GGG; L(H)L(H)L(H) is then an appearance of JJJ. For J=K4J = K_4J=K4​ the appearance is degenerate if some 4-cycle of HHH contains the four vertices of degree three. A K4K_4K4​-enlargement is a 3-connected graph with a proper subgraph isomorphic to a subdivision of K4K_4K4​. An appearance L(H)L(H)L(H) is overshadowed if some branch of HHH of odd length ≥3\ge 3≥3, with ends b1,b2b_1, b_2b1​,b2​, has a vertex of GGG nonadjacent to at most one edge at b1b_1b1​ and at most one edge at b2b_2b2​.

Knots and striations. A knot (P1,P2,Q1,Q2)(P_1, P_2, Q_1, Q_2)(P1​,P2​,Q1​,Q2​) is formed by two paths PiP_iPi​ with ends ai,bia_i, b_iai​,bi​ and two antipaths QjQ_jQj​ with ends xj,yjx_j, y_jxj​,yj​. They are pairwise disjoint and of length ≥1\ge 1≥1, P1P_1P1​ is anticomplete to P2P_2P2​, Q1Q_1Q1​ is complete to Q2Q_2Q2​, and the ends are joined in a prescribed twisted pattern (pp. 107–108). A degenerate appearance of K4K_4K4​ is a knot. A strip (A,C,B)(A, C, B)(A,C,B) is a family of paths ("rungs") from AAA to BBB through CCC; an antistrip is a strip of G‾\overline{G}G. A striation LLL is made of m≥2m \ge 2m≥2 strips and n≥2n \ge 2n≥2 antistrips. All rungs and antirungs are odd, the strips are pairwise anticomplete, the antistrips pairwise complete, and every strip is parallel or co-parallel to every antistrip, with enough "twists" between them (p. 112). A striation is maximal if no striation has a strictly larger vertex set. The paper defines when a set of vertices is local for a knot or striation and when it resolves one.

Outcomes. A double split graph has its vertices partitioned into {ai},{bi}\{a_i\}, \{b_i\}{ai​},{bi​} (m≥2m \ge 2m≥2) and {cj},{dj}\{c_j\}, \{d_j\}{cj​},{dj​} (n≥2n \ge 2n≥2). Each aibia_ib_iai​bi​ is an edge and each cjdjc_jd_jcj​dj​ a nonedge, distinct pairs {ai,bi}\{a_i,b_i\}{ai​,bi​} are anticomplete and distinct pairs {cj,dj}\{c_j,d_j\}{cj​,dj​} complete to each other, and every {ai,bi}\{a_i,b_i\}{ai​,bi​} and {cj,dj}\{c_j,d_j\}{cj​,dj​} are joined by exactly two disjoint edges. A skew partition (A,B)(A, B)(A,B) of V(G)V(G)V(G) has G∣AG|AG∣A disconnected and G‾∣B\overline{G}|BG∣B disconnected. It is balanced if no odd path joins nonadjacent vertices of BBB through AAA and no odd antipath joins adjacent vertices of AAA through BBB. A proper 2-join is a partition (X1,X2)(X_1, X_2)(X1​,X2​) of V(G)V(G)V(G) whose only cross edges are complete joins A1A_1A1​–A2A_2A2​ and B1B_1B1​–B2B_2B2​, with the side conditions of p. 53.

Formalization targets

Goal: Theorem 9.6 (p. 116)

Let GGG be Berge, with every appearance of K4K_4K4​ in GGG and in G‾\overline{G}G degenerate and no induced subgraph of GGG isomorphic to L(K3,3)L(K_{3,3})L(K3,3​). Then

G is double split ∨ G admits a balanced skew partition ∨ G or G‾ admits a proper 2-join ∨ K4 appears in neither G nor G‾.G \text{ is double split} \ \lor\ G \text{ admits a balanced skew partition} \ \lor\ G \text{ or } \overline{G} \text{ admits a proper 2-join} \ \lor\ K_4 \text{ appears in neither } G \text{ nor } \overline{G}.G is double split ∨ G admits a balanced skew partition ∨ G or G admits a proper 2-join ∨ K4​ appears in neither G nor G.

Milestones

  1. 9.1 (p. 108): in a knot of a Berge graph all four paths and antipaths are odd, and either both paths or both antipaths have length one.
  2. 9.3 (p. 109): a connected set FFF whose attachments to a knot are not local either contains a vertex whose neighbourhood resolves the knot, or attaches in one of three special ways ("up to symmetry").
  3. 9.4 (p. 112): the neighbourhood in V(L)V(L)V(L) of a vertex outside a maximal striation LLL is local or resolves LLL.
  4. 9.5 (p. 113): if every vertex of a connected set FFF outside V(L)V(L)V(L) has a local neighbourhood, then the attachments of FFF in V(L)V(L)V(L) are local.

9.3–9.5 assume that no K4K_4K4​-enlargement appears in GGG or G‾\overline{G}G and that no appearance of K4K_4K4​ in GGG or G‾\overline{G}G is overshadowed. An optional, non-milestone item poses 9.7 (p. 118): a Berge graph with an appearance of K4K_4K4​ is a line graph or the complement of one, a double split graph, or admits a proper 2-join (in GGG or G‾\overline{G}G) or a balanced skew partition.

Significance

9.6 is the step of the proof that produces double split graphs, one of the five basic classes. In the main argument it follows step 1.8.1 (5.1, nondegenerate appearances of K4K_4K4​) and is combined with it in 9.7. Through 9.7 it gives the first half of 13.5: every recalcitrant graph belongs to the class F5\mathcal{F}_5F5​ and so contains no appearance of K4K_4K4​ in GGG or G‾\overline{G}G.

The theorem has been proved since 2006. We know of no machine-checked proof of the strong perfect graph theorem or of any of its steps. Mathlib has line graphs and graph embeddings but no subdivisions, appearances or decompositions of Berge graphs. This mission produces a faithful Lean statement of step 1.8.3 and of the four lemmas its proof rests on, together with Lean definitions of knots, strips and striations.

Difficulty

The obvious approach would take a degenerate appearance of K4K_4K4​ and study how each remaining vertex attaches to it, as §§5–6 do for nondegenerate appearances. This does not close. A degenerate appearance can be read as a line graph or as its complement, so the analysis of a vertex in GGG and in G‾\overline{G}G has to be run at once. Single vertices can also be absorbed into larger structures that the line-graph analysis does not see. The proof grows the appearance to a maximal striation and classifies attachments to it, and the hard steps are 9.4 and 9.5. Their proofs need 9.3 in every case, and they use maximality to refute configurations that would let the striation grow.

Formalization scope

Graphs are SimpleGraph V on a Fintype with decidable equality. Every object is defined as on the page, in the namespace StrongPerfectGraph.DoubleSplit.

  • Paths and antipaths are induced and given as vertex lists. A list fixes the labelling of the ends: ai,bia_i, b_iai​,bi​ are the first and last vertices of PiP_iPi​, and xj,yjx_j, y_jxj​,yj​ those of QjQ_jQj​.
  • The empty set is connected (p. 54).
  • Line graphs are Mathlib's SimpleGraph.lineGraph; "isomorphic to an induced subgraph" is an induced embedding ↪g. Subdivisions HHH and enlargements J′J'J′ range over graphs on Fin k.
  • "Every appearance of K4K_4K4​ is degenerate" is the absence of a nondegenerate appearance. The hypothesis on L(K3,3)L(K_{3,3})L(K3,3​) concerns GGG only. Every other hypothesis concerns both GGG and G‾\overline{G}G, as on the page.
  • A striation is a structure with mmm strips and nnn antistrips indexed by Fin m, Fin n.
  • "Up to symmetry" in 9.3 is the paper's exchange of P1,P2P_1, P_2P1​,P2​ and Q1,Q2Q_1, Q_2Q1​,Q2​ with the ends renamed so that the result is again a knot. Both compatible renamings are allowed, and so is their composite, the reversal of all four.

Dropping the bars of the complement would make the theorem false or vacuous. So would reading "path" as a non-induced path, or encoding a decomposition so that it always exists. The statements use the complement explicitly, induced paths throughout, and the full definitions of p. 53–54.

The proof of 9.6 also uses results of the same paper that are posed in other missions of this series. These are 2.1, 2.2, 4.1 and 4.2, posed in mission II (skew partitions), and 5.3, 5.8, 6.1 and 7.5, posed in mission III (line graphs). They are not posed again here. The bridge 9.2 between knots and line graphs, whose proof the paper omits as obvious, is not posed either. Proofs of 9.1, of 9.3, and reusable lemmas about knots and striations are welcome.

Selected references

  • M. Chudnovsky, N. Robertson, P. Seymour, R. Thomas, The strong perfect graph theorem, Annals of Mathematics 164 (2006), 51–229. https://doi.org/10.4007/annals.2006.164.51
  • C. Berge, Färbung von Graphen, deren sämtliche bzw. deren ungerade Kreise starr sind, Wiss. Z. Martin-Luther-Univ. Halle-Wittenberg Math.-Natur. Reihe 10 (1961), 114.
  • M. Grötschel, L. Lovász, A. Schrijver, Geometric Algorithms and Combinatorial Optimization, Springer, 1988. https://doi.org/10.1007/978-3-642-97881-4
19 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

On the Abstract Properties of Linear Dependence 1: The Rank Postulates and the Independence Postulates Are EquivalentResearch Paper

Motivation

In 1935 Hassler Whitney asked which properties of linear dependence among the columns of a matrix can be stated without reference to the matrix at all. His answer, On the Abstract Properties of Linear Dependence (American Journal of Mathematics 57, 1935), introduced the matroid: a finite set together with a rank function obeying three short postulates. The notion now underlies combinatorial optimization (the greedy algorithm is optimal exactly on matroids, and matroid intersection and partition generalize bipartite matching and arborescence packing), graph theory (graphic and cographic matroids), coding theory and the study of linear representations over finite fields.

A defining feature of the subject is that the same structure can be axiomatized in several apparently unrelated ways: by rank, by independent sets, by bases, by circuits. Each axiom system is convenient for different arguments, and passing between them, a so-called cryptomorphism, is routine in practice. Whitney's paper is where these equivalences first appear. Part I, §§2–4 and §6 (pp. 510–514), derives the basic properties of rank from the rank postulates, deduces from them the postulates for independent sets, and shows that the two systems are equivalent. This mission formalizes that first equivalence.

Setting

Let MMM be a finite set of elements e1,…,ene_1, \dots, e_ne1​,…,en​. Following Whitney, write N+eN + eN+e for N∪{e}N \cup \{e\}N∪{e}, M1+M2M_1 + M_2M1​+M2​ for the union and M1M2M_1 M_2M1​M2​ for the intersection of subsets; ρ(N)\rho(N)ρ(N) is the number of elements of NNN.

A rank system is a function rrr on the subsets of MMM satisfying

  • (R₁) r(∅)=0r(\emptyset) = 0r(∅)=0;
  • (R₂) for every subset NNN and element e∉Ne \notin Ne∈/N, r(N+e)=r(N)r(N + e) = r(N)r(N+e)=r(N) or r(N+e)=r(N)+1r(N + e) = r(N) + 1r(N+e)=r(N)+1;
  • (R₃) for every subset NNN and elements e1,e2∉Ne_1, e_2 \notin Ne1​,e2​∈/N, if r(N+e1)=r(N+e2)=r(N)r(N + e_1) = r(N + e_2) = r(N)r(N+e1​)=r(N+e2​)=r(N) then r(N+e1+e2)=r(N)r(N + e_1 + e_2) = r(N)r(N+e1​+e2​)=r(N).

The nullity of NNN is n(N)=ρ(N)−r(N)n(N) = \rho(N) - r(N)n(N)=ρ(N)−r(N), and NNN is independent when n(N)=0n(N) = 0n(N)=0. The increment of (3.1) is Δ(M′,N)=r(M′+N)−r(M′)\Delta(M', N) = r(M' + N) - r(M')Δ(M′,N)=r(M′+N)−r(M′), written Δ(M′,e)\Delta(M', e)Δ(M′,e) when N={e}N = \{e\}N={e}.

An independence system is a predicate "independent" on the subsets of MMM satisfying

  • (I₁) any subset of an independent set is independent;
  • (I₂) if NNN and N′N'N′ are independent and N′N'N′ has exactly one element more than NNN, then N+e′N + e'N+e′ is independent for some e′∈N′e' \in N'e′∈N′ with e′∉Ne' \notin Ne′∈/N.

From an independence system one recovers a rank by letting r(N)r(N)r(N) be the number of elements in a largest independent subset of NNN. In the Lean development these objects are IsRankSystem, nullity, Delta, indepOfRank, IsIndepSystem and rankOfIndep, all in the namespace WhitneyMatroid.RankIndep.

Formalization targets

Goal: (R) and (I) are equivalent (§6, p. 514)

  1. If rrr satisfies (R₁)–(R₃), then {N:ρ(N)=r(N)}\{N : \rho(N) = r(N)\}{N:ρ(N)=r(N)} satisfies (I₁), (I₂), contains ∅\emptyset∅, and
r(N)=max⁡{ρ(I):I⊆N, ρ(I)=r(I)}for every N.r(N) = \max\{\rho(I) : I \subseteq N,\ \rho(I) = r(I)\} \quad \text{for every } N.r(N)=max{ρ(I):I⊆N, ρ(I)=r(I)}for every N.
  1. If "independent" satisfies (I₁), (I₂) and ∅\emptyset∅ is independent, then r(N)=max⁡{ρ(I):I⊆N independent}r(N) = \max\{\rho(I) : I \subseteq N \text{ independent}\}r(N)=max{ρ(I):I⊆N independent} satisfies (R₁)–(R₃), and NNN is independent if and only if ρ(N)=r(N)\rho(N) = r(N)ρ(N)=r(N).

Both translations and both round trips are part of the goal: Whitney's conclusion is not only that each system implies the other but that "the definitions of the rank and the independence or dependence of any subset of MMM agree under the two systems".

Milestones

  • Lemma 1 (p. 510): r(N)≥0r(N) \ge 0r(N)≥0, n(N)≥0n(N) \ge 0n(N)≥0, and N⊆M′N \subseteq M'N⊆M′ implies r(N)≤r(M′)r(N) \le r(M')r(N)≤r(M′), n(N)≤n(M′)n(N) \le n(M')n(N)≤n(M′).
  • Lemma 2 (p. 510): any subset of an independent set is independent, which is (I₁).
  • Lemma 3 (p. 511): Δ(M+e2,e1)≤Δ(M,e1)\Delta(M + e_2, e_1) \le \Delta(M, e_1)Δ(M+e2​,e1​)≤Δ(M,e1​).
  • Lemma 4 (p. 511): Δ(M+N,e)≤Δ(M,e)\Delta(M + N, e) \le \Delta(M, e)Δ(M+N,e)≤Δ(M,e).
  • Theorem 3 (p. 511): Δ(M+N2,N1)≤Δ(M,N1)\Delta(M + N_2, N_1) \le \Delta(M, N_1)Δ(M+N2​,N1​)≤Δ(M,N1​); equivalently
r(M+N1+N2)≤r(M+N1)+r(M+N2)−r(M),r(M1+M2)≤r(M1)+r(M2)−r(M1M2).r(M + N_1 + N_2) \le r(M + N_1) + r(M + N_2) - r(M), \qquad r(M_1 + M_2) \le r(M_1) + r(M_2) - r(M_1 M_2).r(M+N1​+N2​)≤r(M+N1​)+r(M+N2​)−r(M),r(M1​+M2​)≤r(M1​)+r(M2​)−r(M1​M2​).
  • §4 (pp. 511–512): the independent sets of a rank system satisfy (I₂).

Significance

The equivalence makes the rank function and the family of independent sets two descriptions of one object. Every later result of Whitney's paper, and of matroid theory generally, moves between them without comment: the circuit postulates of §5 and §8, the base postulates of §7 and the duality of §§11–13 are all phrased through rank or independence as convenient. Theorem 3 is the submodularity of rank, the property that connects matroids to submodular function minimization and polymatroids; here it is derived from the purely local postulates (R₁)–(R₃), which constrain the rank only under the addition of one or two elements.

On the formal side, Mathlib defines Matroid through independent sets (with constructors from other axiom systems) and proves submodularity of its rank; the platform has submodularity for Mathlib matroids (FamousTheorems.matroid_rank_submodular_7a). Neither starts from Whitney's local rank postulates. What this mission adds is a machine-checked derivation of the global properties of rank from (R₁)–(R₃) and of Whitney's original equivalence, stated for his own postulates, so that the later missions of this series, which work from the same postulates, rest on a verified foundation. The result itself has been settled since 1935; the open work is the formal proof.

Difficulty

The postulates (R₂) and (R₃) are local: they speak about adding at most two elements to a set. Monotonicity and the bound r(N)≤ρ(N)r(N) \le \rho(N)r(N)≤ρ(N) follow by adding elements one at a time, but the submodular inequality relates arbitrary sets, and nothing in (R₃) mentions more than two new elements. The gap between the local and the global statement is the substance of Lemmas 3, 4 and Theorem 3, and the deduction of (I₂) depends on it.

In the converse direction the rank is defined as a maximum over independent subsets, while (I₂) only augments a set from an independent set with exactly one element more; (R₃) for the derived rank is a statement about three sets that are not given in that form. The round trips are where the two halves meet, and each depends on the global properties of the first half rather than on the postulates alone.

Formalization scope

Elements form a type α with [Fintype α] [DecidableEq α]; subsets are Finset α, and the matroid MMM is the whole type. Ranks, nullities and increments take values in ℤ, so differences never truncate; Whitney allows any number, but (R₁) and (R₂) force nonnegative integers. Postulate (I₂) is stated in Whitney's form with N'.card = N.card + 1, not the general augmentation for ρ(N)<ρ(N′)\rho(N) < \rho(N')ρ(N)<ρ(N′). Postulates (R₂), (R₃) keep their hypotheses e,e1,e2∉Ne, e_1, e_2 \notin Ne,e1​,e2​∈/N. Lemmas 3, 4 and Theorem 3 are stated for arbitrary subsets M,N,N1,N2M, N, N_1, N_2M,N,N1​,N2​; Lemma 1's monotonicity for arbitrary N⊆M′N \subseteq M'N⊆M′, the form in which the paper uses it. rankOfIndep is the supremum of cardinalities over the independent members of the powerset.

The paper takes for granted that the empty set is independent in system (I). Without that hypothesis, the predicate declaring nothing independent satisfies (I₁) and (I₂) vacuously, the supremum defining the rank returns 000, and the round trip fails; the goal therefore assumes ∅\emptyset∅ independent in part 2 and proves it in part 1. A formalization in terms of Mathlib's Matroid would make the goal a restatement of library facts, since Mathlib's matroids are independence systems by construction; the goal is deliberately about the postulates as predicates on functions and on families of sets.

A complete development needs only finite set combinatorics (Finset.card, induction on finite sets, Finset.sup). The derived lemmas (monotonicity, submodularity, (I₂)) are reusable for any later work from Whitney's rank postulates, including the circuit-postulate equivalence of the companion mission. A bridge from rank systems to Mathlib's Matroid (via IndepMatroid.ofFinset) would be a welcome addition but is not part of the goal. Proofs of the milestones in any order are welcome; Theorem 3 and the §4 deduction are the natural first targets.

Selected references

  • H. Whitney, On the Abstract Properties of Linear Dependence, American Journal of Mathematics 57 (1935), no. 3, 509–533. https://doi.org/10.2307/2371182
  • J. Oxley, Matroid Theory, 2nd ed., Oxford Graduate Texts in Mathematics 21, Oxford University Press, 2011. https://doi.org/10.1093/acprof:oso/9780198566946.001.0001
  • J. Kung (ed.), A Source Book in Matroid Theory, Birkhäuser, 1986. https://doi.org/10.1007/978-1-4684-9199-9
  • Mathlib, Mathlib.Data.Matroid (matroids via independent sets; IndepMatroid.ofFinset). https://leanprover-community.github.io/mathlib4_docs/Mathlib/Data/Matroid/Basic.html
8 thms2 active usersReviewed
Graph Theory·Captain: mikedeng1

The Strong Perfect Graph Theorem V: A Berge Graph with No Nondegenerate Appearance of K4 Containing an Even Prism Is a Nine-Vertex Even Prism or DecomposesResearch Paper

Motivation

A perfect graph is a finite simple graph in which every induced subgraph has chromatic number equal to its largest clique size. This equality gives a structural reason that a clique lower bound on the number of colours is attainable for every induced part of the graph. Berge proposed a forbidden-subgraph description of perfect graphs: a graph should be perfect exactly when it has neither an odd hole nor an odd antihole. Chudnovsky, Robertson, Seymour and Thomas proved that statement in The strong perfect graph theorem, Annals of Mathematics 164 (2006), Theorem 1.2. Their proof separates possible configurations in a Berge graph and shows that each either belongs to a controlled class or admits a decomposition.

This mission isolates the even-prism step, Theorem 10.6 of that paper. A prism is one of the configurations that can appear in a Berge graph even though odd holes and antiholes do not. The step matters because its conclusion leaves only a specific nine-vertex graph or one of two decompositions that the larger proof handles elsewhere. It is the result identified as step 1.8.4 in the authors’ outline (paper, pp. 59 and 124).

Setting

All graphs here are finite and simple. A path means an induced path; a single vertex is allowed as a path of length zero. A hole is an induced cycle with at least four vertices, and an antihole is a hole in the complementary graph. A graph GGG is Berge if every hole of GGG and of its complement G‾\overline GG has even length.

A prism has two disjoint triangles, A={a1,a2,a3}A=\{a_1,a_2,a_3\}A={a1​,a2​,a3​} and B={b1,b2,b3}B=\{b_1,b_2,b_3\}B={b1​,b2​,b3​}, joined by three pairwise vertex-disjoint induced paths RiR_iRi​ from aia_iai​ to bib_ibi​. Between distinct paths, the only edges are those in AAA and those in BBB. The prism is even when all three RiR_iRi​ have even length. “GGG contains an even prism” means that such paths exist as an induced configuration in GGG; GGG may have other vertices. “GGG is an even prism” means the paths cover every vertex of GGG (paper, pp. 93 and 119).

An appearance of K4K_4K4​ is an induced copy in GGG of the line graph of a bipartite subdivision HHH of the four-vertex complete graph. It is nondegenerate if no four-cycle of HHH contains all four branch vertices. Only appearances in GGG are excluded in this mission; appearances in G‾\overline GG are allowed by the hypotheses (paper, pp. 72, 74–75).

A proper 2-join partitions the vertices into two sides with specified, nonempty attachment sets. The cross edges are exactly the two complete attachment pairs; every component of either side meets both of its attachment sets. If a side is itself a path between singleton attachment sets, that path has odd length at least three. A balanced skew partition divides the vertices into AAA and BBB so that AAA is disconnected, BBB is disconnected in the complement, and two path parity conditions hold: no odd path crosses AAA between nonadjacent vertices of BBB, and no odd antipath crosses BBB between adjacent vertices of AAA (paper, pp. 53–54).

Formalization targets

Prism lemmas

The numbered milestones are Theorems 7.2–7.4 and 10.5. They assert common parity of the three prism paths, common neighbours of an anticonnected set at both end triangles, preservation of two neighbours under replacement of one even prism path, and the balanced skew partition forced by a major vertex. A vertex is major when it is adjacent to at least two vertices of each end triangle. These milestones match the paper’s statements on pp. 93 and 123 (paper).

Goal: Theorem 10.6

For a Berge graph GGG with no nondegenerate appearance of K4K_4K4​ in GGG,

G contains an even prism⟹(G is an even prism and ∣V(G)∣=9)  ∨  G admits a proper 2-join  ∨  G admits a balanced skew partition.G\text{ contains an even prism} \quad\Longrightarrow\quad \bigl(G\text{ is an even prism and }|V(G)|=9\bigr) \;\lor\; G\text{ admits a proper 2-join} \;\lor\; G\text{ admits a balanced skew partition}.G contains an even prism⟹(G is an even prism and ∣V(G)∣=9)∨G admits a proper 2-join∨G admits a balanced skew partition.

The first case describes the entire graph, not just an induced nine-vertex subgraph. The statement fixes all outcomes exactly as in Theorem 10.6, p. 124.

Significance

Theorem 10.6 removes even prisms from the unresolved part of the strong perfect graph theorem’s structural argument. If the graph is larger than the exceptional prism and has no nondegenerate K4K_4K4​ appearance, the theorem supplies a proper 2-join or a balanced skew partition. Subsequent results can work with those decompositions instead of treating arbitrary attachments to a prism (paper, §10 and the outline at 1.8.4).

The mathematical result is proved in the 2006 paper. The work here is to give its graph objects and statements machine-checkable meanings, then formalize the known proof. This proposal contains open Lean theorem statements and sorry-free definitions; the proof obligations remain for solvers. The definitions of induced paths, holes, subdivisions, and decomposition predicates can also support other steps of this paper. The Roussel–Rubio lemma and the balanced-skew-partition results of §§2–4 are proved in the same paper and posed in mission II of this series. The prism-attachment result 10.4 is posed in mission VI, where it is used most directly.

Difficulty

An outside connected set can attach to several parts of a prism without containing a single major vertex. Its attachments need not be local to one path or one triangle, so checking vertices one at a time does not decide which decomposition exists. The paper’s §10 distinguishes several attachment patterns; the evenness of the paths and the exclusion of a nondegenerate K4K_4K4​ appearance restrict them, but do not themselves give a 2-join or skew partition by a one-line parity argument. The larger proof must also account for attachments throughout the graph while preserving the full definitions of both decomposition outcomes (paper, pp. 119–127).

Formalization scope

Lean represents a graph as SimpleGraph V with a finite vertex type. The prism is three lists of vertices, each an induced path; the lists are disjoint, and the cross-edge condition admits exactly the two end triangles. Reversing a list changes its orientation but not the underlying graph configuration. A hole uses a cyclic list with the closing edge; Berge checks holes in both GGG and G‾\overline GG. Connectivity is reachability in an induced graph, so the empty vertex set is connected as the paper says. A K4K_4K4​ subdivision uses six tracks on a finite carrier, with all its vertices and edges accounted for; the appearance uses an induced graph embedding of its line graph. The exception checks that the prism covers the whole graph and that ∣V(G)∣=9|V(G)|=9∣V(G)∣=9.

These encodings require genuinely induced paths and the paper’s nondegenerate appearance condition. Dropping either would change the theorem. The proper 2-join includes component reachability and the odd-path special case; the balanced skew partition includes both path parity clauses. The nine-vertex graph formed by two triangles and three two-edge paths has a separate sorry-free Lean witness, so the exceptional outcome is nonvacuous. Useful contributions include the numbered prism lemmas, attachment analysis for 10.6, and reusable results about finite induced paths and graph subdivisions.

Selected references

  • Maria Chudnovsky, Neil Robertson, Paul Seymour and Robin Thomas, The strong perfect graph theorem, Annals of Mathematics 164 (2006), 51–229. DOI: 10.4007/annals.2006.164.51.
12 thms2 active usersReviewed
🏆Completed
Markov ChainOperations ResearchProbability+1·Captain: mikedeng1

Reversibility and Stochastic Networks VI: The Ewens Sampling Distribution Is Consistent Under Sampling Without ReplacementTextbook

Motivation

The neutral theory of molecular evolution holds that much of the genetic variation observed at the molecular level is caused by selectively neutral mutations rather than by selection. To test it against data one needs the distribution of allele frequencies that a neutral model predicts, and in practice that distribution has to be compared with a sample from the population, never with the whole population. Ewens (Ewens 1972) derived the equilibrium distribution of allele counts under the infinite alleles model, now called the Ewens sampling formula; it underlies classical tests of neutrality and appears throughout combinatorics and probability as the law of the cycle type of an Ewens-distributed random permutation and of the Chinese restaurant process.

Chapter 7 of F. P. Kelly, Reversibility and Stochastic Networks (Wiley, 1979) obtains the infinite alleles model as a limit of the reversible migration processes of Chapters 2 and 6, and uses reversibility to answer questions about allele ages and fixation. The mission formalizes the finite, combinatorial results of that chapter.

Timeline. Kimura and Crow (1964) introduced the infinite alleles model. Ewens (1972) found its equilibrium sampling distribution (7.6). Kingman (1978, J. London Math. Soc.) characterized the consistency of random partitions under sampling, the property Theorem 7.1 asserts for the Ewens family. Kelly (1979, Chapter 7) derived (7.6) as a limit of reversible migration processes, and the consistency and the allele-age results from the reversibility of a labelled population process.

Setting

A population consists of M≥2M\ge2M≥2 individuals, each carrying an allelic type. Its description is M=(M1,…,MM)\mathbf M=(M_1,\dots,M_M)M=(M1​,…,MM​), where MiM_iMi​ is the number of allelic types carried by exactly iii individuals, so that

∑i=1MiMi=M.(7.3)\sum_{i=1}^{M} iM_i=M. \qquad (7.3)i=1∑M​iMi​=M.(7.3)

For a real parameter ν>0\nu>0ν>0, the Ewens distribution on descriptions is

πM(M)=(ν+M−1M)−1∏i=1M(νi)Mi1Mi!,(7.6)\pi_M(\mathbf M)=\binom{\nu+M-1}{M}^{-1}\prod_{i=1}^{M}\Big(\frac{\nu}{i}\Big)^{M_i}\frac{1}{M_i!}, \qquad (7.6)πM​(M)=(Mν+M−1​)−1i=1∏M​(iν​)Mi​Mi​!1​,(7.6)

where (xk)=x(x−1)⋯(x−k+1)/k!\binom{x}{k}=x(x-1)\cdots(x-k+1)/k!(kx​)=x(x−1)⋯(x−k+1)/k! is the binomial coefficient for real xxx. In the infinite alleles model, individuals die at rate μ\muμ, each death is followed by the birth of an offspring of a uniformly chosen survivor, and the offspring is a mutant of an entirely new type with probability uuu; then (7.6) is the equilibrium distribution with ν=(M−1)u/(1−u)\nu=(M-1)u/(1-u)ν=(M−1)u/(1−u) (7.5).

A random sample of size 1≤m≤M1\le m\le M1≤m≤M without replacement is a uniformly random mmm-element subset of the MMM labelled individuals, each of the (Mm)\binom Mm(mM​) subsets being equally likely; the sample has a description in the same sense.

The number jjj of individuals carrying one given allele performs a random walk on {0,…,M}\{0,\dots,M\}{0,…,M} with intensities

q(j,j−1)=μjM(M−jM−1+j−1M−1u),q(j,j+1)=μM−jMjM−1(1−u).(7.8)q(j,j-1)=\mu\frac jM\Big(\frac{M-j}{M-1}+\frac{j-1}{M-1}u\Big),\qquad q(j,j+1)=\mu\frac{M-j}{M}\frac{j}{M-1}(1-u). \qquad (7.8)q(j,j−1)=μMj​(M−1M−j​+M−1j−1​u),q(j,j+1)=μMM−j​M−1j​(1−u).(7.8)

An allele is quasi-fixed when it is the only allele present (j=Mj=Mj=M).

Formalization targets

Goal: consistency under sampling (Theorem 7.1)

If M≥2M\ge2M≥2 and the population description is distributed as πM\pi_MπM​, then a random sample of size 1≤m≤M1\le m\le M1≤m≤M drawn without replacement has description m\mathbf mm with probability πm(m)\pi_m(\mathbf m)πm​(m), the same ν\nuν being used for both sizes:

∑MπM(M) P(sample has description m∣population has description M)=πm(m).\sum_{\mathbf M}\pi_M(\mathbf M)\,P\big(\text{sample has description }\mathbf m\mid\text{population has description }\mathbf M\big)=\pi_m(\mathbf m).M∑​πM​(M)P(sample has description m∣population has description M)=πm​(m).

Milestones

  1. (7.6) is a distribution: πM(M)>0\pi_M(\mathbf M)>0πM​(M)>0 and ∑MπM(M)=1\sum_{\mathbf M}\pi_M(\mathbf M)=1∑M​πM​(M)=1 (Exercise 7.1.3).
  2. Theorem 7.1 for m=M−1m=M-1m=M−1, the case the book's proof establishes first.
  3. Corollary 7.5, the identity of its proof: the probability that a uniformly chosen individual's allele is carried by exactly iii individuals is
∑MiMiMπM(M)=νM(ν+M−1i)−1(Mi).(7.9)\sum_{\mathbf M}\frac{iM_i}{M}\pi_M(\mathbf M)=\frac{\nu}{M}\binom{\nu+M-1}{i}^{-1}\binom Mi. \qquad (7.9)M∑​MiMi​​πM​(M)=Mν​(iν+M−1​)−1(iM​).(7.9)
  1. Theorem 7.9: the probability QQQ that the walk (7.8) started at 111 reaches MMM before 000 satisfies
Q−1=∑i=0M−1(M−1i)−1(ν+M−1i).Q^{-1}=\sum_{i=0}^{M-1}\binom{M-1}{i}^{-1}\binom{\nu+M-1}{i}.Q−1=i=0∑M−1​(iM−1​)−1(iν+M−1​).

Significance

The results. Consistency under sampling is what makes the Ewens formula usable as a statistical model: the predicted distribution for an observed sample does not depend on the unknown population size, only on ν\nuν. Kelly deduces from it the sufficiency of the number of alleles in a sample for ν\nuν and the heterozygosity ν/(ν+1)\nu/(\nu+1)ν/(ν+1) (Exercises 7.1.5, 7.1.8). The formula (7.9) gives the equilibrium frequency of the oldest allele, and Theorem 7.9 gives the quasi-fixation probability from which the mean time between quasi-fixations follows (Corollary 7.10).

Formalizing them. All four results are classical and proved; none has a machine-checked proof on the platform or in Mathlib as of this writing. The mission produces a reusable formal Ewens distribution over integer partitions, a definition of sampling without replacement by counting labelled subsets, and an absorption probability for an explicit birth–death walk. Proofs independent of Kelly's process argument are welcome.

Difficulty

The book's proof of Theorem 7.1 is a process argument: in a population whose size fluctuates between M−1M-1M−1 and MMM, a drop in size acts as a random deletion, and the truncated equilibrium (7.7) restricted to each size gives πM−1\pi_{M-1}πM−1​ and πM\pi_MπM​. Turning that into a statement about finite sets requires the equilibrium of a truncated reversible process, which is not available here, so a formal proof must either build that process or find a direct combinatorial route. A direct route has to relate, for each description of the sample, the number of mmm-subsets of a labelled population with a given description to products of binomial coefficients, and sum the result against (7.6); the bookkeeping over partitions is where the work lies. Theorem 7.9 needs a solution of the first-step equations of a non-symmetric walk and the identification of that solution with a hitting probability defined as a limit.

Formalization scope

  • Descriptions of nnn individuals are integer partitions Nat.Partition n, with MiM_iMi​ the multiplicity of the part iii; the product in (7.6) runs over i=1,…,ni=1,\dots,ni=1,…,n. The real binomial coefficient is the published definition AppliedComb.GenFun.binomReal.
  • The population is Fin M with allelic types Fin M → ℕ; the description of a labelled set is computed from the labelling. The sampling probability is (Mm)−1\binom Mm^{-1}(mM​)−1 times the number of mmm-subsets whose restricted labelling has the given description. It is not defined by a formula on descriptions, and a definition that removed individuals one at a time in proportion to class sizes (the book's proof route) is ruled out as a definition because it presupposes the reduction the proof must supply.
  • The goal and Corollary 7.5 quantify over an arbitrary choice of labelling for each population description. They assume M≥2M\ge2M≥2, as required by the chapter's rule that a parent is chosen among the other M−1M-1M−1 individuals; the goal also assumes 1≤m≤M1\le m\le M1≤m≤M. Because πM>0\pi_M>0πM​>0, this forces the conditional sampling law to depend on the population only through its description. Types are natural numbers, so every description is realized and the hypothesis is never vacuous.
  • The quasi-fixation probability is defined through the jump chain of (7.8): the limit of the probabilities of reaching MMM within nnn jumps without reaching 000. The theorem assumes M≥2M\ge2M≥2, μ>0\mu>0μ>0, 0<u<10<u<10<u<1 and ν=(M−1)u/(1−u)\nu=(M-1)u/(1-u)ν=(M−1)u/(1−u).
  • Corollary 7.5 is formalized as the identity of its proof. The identification of the oldest allele's frequency with that of a randomly chosen individual uses allele ages and the reversibility of the labelled process (Theorem 7.2) and is not formalized. Theorem 7.2 itself, whose state space orders the allele labels within each class, and the allele-age results (Corollaries 7.3, 7.4, 7.7, 7.8, Theorem 7.6, Corollary 7.10, Theorem 7.11) are not part of the mission.

Contributions of general partition and sampling lemmas (counting subsets with a given description, the generating function identity (1−x)−ν=∏jeνxj/j(1-x)^{-\nu}=\prod_j e^{\nu x^j/j}(1−x)−ν=∏j​eνxj/j) are reusable beyond this mission.

Selected references

  • F. P. Kelly, Reversibility and Stochastic Networks, Wiley, 1979, Chapter 7. https://www.statslab.cam.ac.uk/~frank/BOOKS/kelly_book.html
  • W. J. Ewens, The sampling theory of selectively neutral alleles, Theoretical Population Biology 3 (1972), 87–112. https://doi.org/10.1016/0040-5809(72)90035-4
  • J. F. C. Kingman, The representation of partition structures, Journal of the London Mathematical Society (2) 18 (1978), 374–380. https://doi.org/10.1112/jlms/s2-18.2.374
  • M. Kimura and J. F. Crow, The number of alleles that can be maintained in a finite population, Genetics 49 (1964), 725–738. https://doi.org/10.1093/genetics/49.4.725
9 thms2 active usersReviewed
Graph Theory·Captain: mikedeng1

The Strong Perfect Graph Theorem III: A Berge Graph Containing a Nondegenerate Line Graph of a Bipartite Subdivision of K4 Is a Line Graph or DecomposesResearch Paper

Motivation

A graph is perfect if every induced subgraph has chromatic number equal to its clique number, and Berge if no induced subgraph is an odd cycle of length at least five (an odd hole) or the complement of one (an odd antihole). Berge conjectured in 1961 that the two classes coincide. Chudnovsky, Robertson, Seymour and Thomas proved this, the strong perfect graph theorem, in Ann. of Math. 164 (2006), 51–229. Perfect graphs matter beyond graph theory. A graph is perfect exactly when its stable-set polytope is defined by clique inequalities (Chvátal; Lovász), so the theorem characterizes the graphs on which the stable-set and colouring integer programs are solved by their linear relaxations.

The proof is a structure theorem. Every Berge graph is basic (bipartite, the complement of a bipartite graph, the line graph of a bipartite graph or its complement, or a double split graph), or it admits a proper 2-join, a proper homogeneous pair or a balanced skew partition. The proof splits into twelve steps (1.8.1–1.8.12, p. 59), each about Berge graphs that contain a particular configuration. This mission is the first step, statement 5.1 of the paper. It covers Berge graphs that contain a large line graph, and it takes up Sections 5–8 (pp. 72–107).

Setting

All graphs are finite and simple. For a graph GGG, G‾\overline{G}G is its complement. A path is an induced path, and its length is its number of edges. A track is a path in the conventional, not necessarily induced, sense. A set X⊆V(G)X \subseteq V(G)X⊆V(G) is connected if G∣XG|XG∣X is connected, and anticonnected if G‾∣X\overline{G}|XG∣X is connected.

The line graph L(H)L(H)L(H) of a graph HHH has vertex set E(H)E(H)E(H), and two edges are adjacent when they share an end. GGG is a line graph if G≅L(H)G \cong L(H)G≅L(H) for some graph HHH. A subdivision of a graph JJJ replaces each edge uvuvuv of JJJ by a track from uuu to vvv, the tracks being disjoint except for their ends. A branch-vertex is a vertex of degree at least 333. A branch is a maximal track whose internal vertices are not branch-vertices. JJJ is 3-connected if it has more than three vertices and no set of at most two vertices disconnects it.

For a bipartite subdivision HHH of K4K_4K4​, L(H)L(H)L(H) is degenerate if some 4-cycle of HHH passes through its four vertices of degree three. A graph JJJ appears in GGG if L(H)L(H)L(H) is isomorphic to an induced subgraph of GGG for some bipartite subdivision HHH of JJJ.

Two decompositions occur in the conclusion. A skew partition is a partition (A,B)(A, B)(A,B) of V(G)V(G)V(G) with AAA not connected and BBB not anticonnected. It is balanced if no odd path joins two nonadjacent vertices of BBB through AAA, and no odd antipath joins two adjacent vertices of AAA through BBB. A proper 2-join is a partition (X1,X2)(X_1, X_2)(X1​,X2​) of V(G)V(G)V(G) with nonempty disjoint Ai,Bi⊆XiA_i, B_i \subseteq X_iAi​,Bi​⊆Xi​ such that:

  • A1A_1A1​ is complete to A2A_2A2​ and B1B_1B1​ is complete to B2B_2B2​;
  • there are no other edges between X1X_1X1​ and X2X_2X2​;
  • every component of G∣XiG|X_iG∣Xi​ meets both AiA_iAi​ and BiB_iBi​;
  • if ∣Ai∣=∣Bi∣=1|A_i| = |B_i| = 1∣Ai​∣=∣Bi​∣=1 and G∣XiG|X_iG∣Xi​ is a path between them, that path has odd length ≥3\ge 3≥3.

The development needs further objects, each defined on its page: saturating edge sets and major vertices (pp. 77, 81), overshadowed appearances (p. 85), JJJ-enlargements (p. 75), and JJJ-strip systems with their rungs (p. 98).

Formalization targets

Goal (5.1, p. 72)

Let GGG be Berge and let HHH be a bipartite subdivision of K4K_4K4​ such that L(H)L(H)L(H) is nondegenerate and is an induced subgraph of GGG. Then

G is a line graph  ∨  G admits a proper 2-join  ∨  G admits a balanced skew partition.G \text{ is a line graph} \;\lor\; G \text{ admits a proper 2-join} \;\lor\; G \text{ admits a balanced skew partition}.G is a line graph∨G admits a proper 2-join∨G admits a balanced skew partition.

Milestones

  1. 5.7 (pp. 77–78): a classification of edge sets XXX of a bipartite cyclically 3-connected HHH with no even track of length ≥4\ge 4≥4 whose end-edges are the only edges in XXX.
  2. 6.1 (pp. 85–86): the common neighbours of an anticonnected set of major vertices saturate L(H)L(H)L(H), apart from listed small exceptions.
  3. 7.1 (p. 92): three internally disjoint tracks through prescribed edges in a 3-connected graph.
  4. 7.5 (p. 94): an overshadowed appearance gives a JJJ-enlargement with a nondegenerate appearance, or a balanced skew partition.
  5. 8.1 (p. 99): all uvuvuv-rungs of a strip system have the same parity.
  6. 8.2 (p. 99): a rung of length 000 next to one of positive length gives an overshadowed appearance.
  7. 5.4 = 8.6 (pp. 76, 105): the general theorem. If no JJJ-enlargement has a nondegenerate appearance in GGG, then for an appearance L(H0)L(H_0)L(H0​) of JJJ (with a side condition in the degenerate case), either G=L(H0)G = L(H_0)G=L(H0​), or H0≠K3,3H_0 \neq K_{3,3}H0​=K3,3​ and GGG admits a proper 2-join, or GGG admits a balanced skew partition.

The proposal also contains 5.2 (p. 73, step 1.8.2: Berge graphs containing L(K3,3)L(K_{3,3})L(K3,3​)) and 5.3 (p. 74) as theorems without milestones.

Significance

5.1 is the line-graph step of the decomposition theorem. It turns "contains a substantial line graph" into "is a line graph or decomposes". The later steps of the proof start from the complementary case, where no such appearance exists (degenerate appearances in §9, prisms in §§10–13). The strip-system technique of §8 can be reused: it assembles all alternative rungs of a line-graph appearance and analyses how the rest of the graph attaches to it.

The strong perfect graph theorem is proved, but to our knowledge no proof assistant has a machine-checked proof of it. This mission formalizes one of its twelve structural steps. Several results of the same paper that the proof of 5.4 uses are posed in other missions of this series and are not posed here:

  • the Roussel–Rubio lemma 2.1, and 2.2–2.4, 2.6, 2.7, 4.1–4.3 and 4.5 from §§2–4, including the "loose implies balanced" lemma 4.2 (mission II);
  • the prism lemmas 7.3 and 7.4 (mission V).

The statements 5.5, 5.6, 5.8, 8.3, 8.4 and 8.5 are also used in the proof. They are open to solvers as further lemmas.

Difficulty

Knowing that GGG contains some appearance of K4K_4K4​ is not enough to make GGG a line graph or to decompose it. Vertices outside the appearance can attach to it in many ways. Each such pattern has to be shown to be impossible in a Berge graph, or to yield a larger appearance of a bigger graph J′J'J′, or to yield a decomposition. The first idea, analysing one outside vertex at a time, fails for two reasons. Connected sets of "minor" vertices can attach non-locally even when each vertex alone attaches locally (5.8). And anticonnected sets of "major" vertices are what produce the skew partitions (6.1). The small cases make things harder: L(K3,3)L(K_{3,3})L(K3,3​), L(K3,3∖e)L(K_{3,3}\setminus e)L(K3,3​∖e) and degenerate subdivisions of K4K_4K4​ are basic in several ways at once, so the theorem fails for them without the nondegeneracy hypothesis.

Formalization scope

Graphs are SimpleGraph V on a Fintype. G‾\overline{G}G is Gᶜ. L(H)L(H)L(H) is Mathlib's H.lineGraph on H.edgeSet. "L(H)L(H)L(H) is an induced subgraph of GGG" is an induced embedding H.lineGraph ↪g G, and "G=L(H0)G = L(H_0)G=L(H0​)" says that this embedding is surjective. Paths and holes are vertex lists with the induced-adjacency condition. Tracks are vertex lists with consecutive vertices adjacent; their adjacency is not induced. Subdivisions carry an injection of V(J)V(J)V(J) and one track per edge of JJJ. These tracks are internally disjoint, avoid V(J)V(J)V(J) internally, and cover every vertex and every edge of HHH. "3-connected" includes the paper's convention of more than three vertices. "J=K4J = K_4J=K4​", "H=K3,3H = K_{3,3}H=K3,3​" mean isomorphism. Existentially quantified graphs (HHH in an appearance, the enlargement J′J'J′, the graph of which GGG is a line graph) live on Fin n.

The standing assumptions are those of each statement: GGG is Berge and JJJ is 3-connected. In 7.1 the two edges e,fe, fe,f are taken distinct, as the conclusion requires. "Up to symmetry" in 6.1 becomes an existential choice of the labelling of the 4-cycle and of the order of y,y′y, y'y,y′.

The formalization would be trivial if paths were allowed to be non-induced, if the complement bars in 5.4 and 6.1 were dropped, or if a "subdivision" could share internal track vertices or carry extra vertices or edges. The definitions rule out all three. A sorry-free check shows that K4K_4K4​ is a subdivision of itself and is not bipartite.

Reusable infrastructure: tracks, branches, subdivisions, 3-connectivity, appearances and strip systems. Contributions are welcome on the graph-theoretic lemmas 5.3 and 7.1, which do not need Berge graphs, and on the Berge-specific milestones in the order listed.

Selected references

  • M. Chudnovsky, N. Robertson, P. Seymour, R. Thomas, The strong perfect graph theorem, Annals of Mathematics 164 (2006), 51–229. https://doi.org/10.4007/annals.2006.164.51
  • C. Berge, Färbung von Graphen, deren sämtliche bzw. deren ungerade Kreise starr sind, Wiss. Z. Martin-Luther-Univ. Halle-Wittenberg Math.-Natur. Reihe 10 (1961), 114.
  • V. Chvátal, On certain polytopes associated with graphs, J. Combin. Theory Ser. B 18 (1975), 138–154. https://doi.org/10.1016/0095-8956(75)90041-6
  • G. Cornuéjols, W. H. Cunningham, Compositions for perfect graphs, Discrete Math. 55 (1985), 245–254. https://doi.org/10.1016/0012-365X(85)90051-7
  • V. Chvátal, Star-cutsets and perfect graphs, J. Combin. Theory Ser. B 39 (1985), 189–199. https://doi.org/10.1016/0095-8956(85)90049-8
21 thms2 active usersReviewed
🏆Completed
Functional AnalysisMachine Learning·Captain: mikedeng1

The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network II: Fat-Shattering Bound for Bounded-Weight NetworksResearch Paper

Motivation

In the mid-1990s, neural networks trained by gradient descent were observed to generalize well even when the number of weights far exceeded the number of training examples. The classical theory could not explain this: VC-dimension bounds for networks grow with the number of parameters, so for large networks they are vacuous. Bartlett's paper (IEEE Trans. Inform. Theory 44 (1998)) showed that, for classification with a margin, what controls generalization is the size of the weights, not the size of the network. Its two main technical results are a margin bound in terms of the fat-shattering dimension (Theorem 2, the subject of mission I of this series) and a bound on the fat-shattering dimension of networks with bounded weights (Theorem 17, the subject of this mission). The same idea of weight-norm capacity control underlies much of the later theory of margins, boosting and kernel methods.

Timeline. Kearns and Schapire (1994) introduced the fat-shattering dimension. Alon, Ben-David, Cesa-Bianchi and Haussler (1997) bounded ℓ∞ covering numbers by it. Bartlett, Kulkarni and Posner (1997) gave the matching lower bound on ℓ1 covering numbers used here as Lemma 19. Maurey's approximation lemma (reported by Pisier, 1981) was used by Jones (1992) and Barron (1993) for approximation by networks, and by Lee, Bartlett and Williamson (1996) for covering numbers of convex hulls. Bartlett (1998) combined these into Theorem 17.

Setting

Let XXX be a set and HHH a class of functions X→RX\to\mathbb RX→R. For γ>0\gamma>0γ>0, a sequence x=(x1,…,xm)∈Xmx=(x_1,\dots,x_m)\in X^mx=(x1​,…,xm​)∈Xm is γ\gammaγ-shattered by HHH if there is r∈Rmr\in\mathbb R^mr∈Rm such that for every b∈{−1,1}mb\in\{-1,1\}^mb∈{−1,1}m some h∈Hh\in Hh∈H satisfies (h(xi)−ri)bi≥γ(h(x_i)-r_i)b_i\ge\gamma(h(xi​)−ri​)bi​≥γ for all iii. The fat-shattering dimension is

fat⁡H(γ)=max⁡{m: H γ-shatters some x∈Xm}∈N∪{∞}.\operatorname{fat}_H(\gamma)=\max\{m:\ H\ \gamma\text{-shatters some }x\in X^m\}\in\mathbb N\cup\{\infty\}.fatH​(γ)=max{m: H γ-shatters some x∈Xm}∈N∪{∞}.

A cover of a class FFF at scale ε\varepsilonε for a pseudometric ρ\rhoρ on functions is a set TTT of functions such that every f∈Ff\in Ff∈F has some t∈Tt\in Tt∈T with ρ(t,f)<ε\rho(t,f)<\varepsilonρ(t,f)<ε; N(F,ε,ρ)\mathcal N(F,\varepsilon,\rho)N(F,ε,ρ) is the least size of a cover. For a sample x∈Xmx\in X^mx∈Xm the pseudometrics dℓ∞(x)d_{\ell_\infty(x)}dℓ∞​(x)​, dℓ1(x)d_{\ell_1(x)}dℓ1​(x)​, dℓ2(x)d_{\ell_2(x)}dℓ2​(x)​ are the maximum, the mean, and the root mean square of ∣f(xi)−g(xi)∣|f(x_i)-g(x_i)|∣f(xi​)−g(xi​)∣ over iii, and the uniform covering numbers are Np(F,ε,m)=max⁡x∈XmN(F,ε,dℓp(x))\mathcal N_p(F,\varepsilon,m)=\max_{x\in X^m}\mathcal N(F,\varepsilon,d_{\ell_p(x)})Np​(F,ε,m)=maxx∈Xm​N(F,ε,dℓp​(x)​).

The hidden units form a nonempty class FFF of functions X→[−M/2,M/2]X\to[-M/2,M/2]X→[−M/2,M/2]. For A>0A>0A>0 the two-layer network class with ℓ1-bounded output weights is

H={∑i=1Nwifi: N∈N, fi∈F, ∑i=1N∣wi∣≤A}.H=\Big\{\sum_{i=1}^Nw_if_i:\ N\in\mathbb N,\ f_i\in F,\ \sum_{i=1}^N|w_i|\le A\Big\}.H={i=1∑N​wi​fi​: N∈N, fi​∈F, i=1∑N​∣wi​∣≤A}.

In Lean these are BartlettNN.Margin.fat, BartlettNN.Margin.coverNum and BartlettNN.Margin.Ninf (shared with mission I), and BartlettNN.FatNet.N1, BartlettNN.FatNet.N2 and BartlettNN.FatNet.combos F A.

Formalization targets

Goal: Theorem 17

There is a universal constant ccc such that for every XXX, FFF, MMM, A>0A>0A>0 and γ>0\gamma>0γ>0 with d=fat⁡F(γ/(32A))≥1d=\operatorname{fat}_F(\gamma/(32A))\ge1d=fatF​(γ/(32A))≥1,

fat⁡H(γ)≤cM2A2dγ2ln⁡2(MAdγ).\operatorname{fat}_H(\gamma)\le\frac{cM^2A^2d}{\gamma^2}\ln^2\Big(\frac{MAd}{\gamma}\Big).fatH​(γ)≤γ2cM2A2d​ln2(γMAd​).

The constant is left unspecified, as in the paper, so that the goal survives any improvement of the numerical constants.

Milestones (in the order the proof uses them)

  1. Lemma 19 (cited from Bartlett–Kulkarni–Posner): for [0,1][0,1][0,1]-valued FFF with fat⁡F(4γ)≥d\operatorname{fat}_F(4\gamma)\ge dfatF​(4γ)≥d, log⁡2N1(F,γ,d)≥d/32\log_2\mathcal N_1(F,\gamma,d)\ge d/32log2​N1​(F,γ,d)≥d/32.
  2. Lemma 20, (5): for d=fat⁡F(γ/4)d=\operatorname{fat}_F(\gamma/4)d=fatF​(γ/4) and m≥2+2dlog⁡2(32M/γ)m\ge2+2d\log_2(32M/\gamma)m≥2+2dlog2​(32M/γ), log⁡2N2(F,γ,m)<1+dlog⁡2(4emM/(dγ))log⁡2(9mM2/γ2)\log_2\mathcal N_2(F,\gamma,m)<1+d\log_2(4emM/(d\gamma))\log_2(9mM^2/\gamma^2)log2​N2​(F,γ,m)<1+dlog2​(4emM/(dγ))log2​(9mM2/γ2).
  3. Lemma 21 (Maurey): in a Hilbert space, a point of the closed convex hull of a set of norm at most bbb is within c/k\sqrt{c/k}c/k​ of an average of kkk points of the set, for every c>b2−∥h∥2c>b^2-\|h\|^2c>b2−∥h∥2.
  4. Lemma 22: log⁡2N2(H,γ,m)≤(2M2A2/γ2)log⁡2(2N2(F,γ/(2A),m)+1)\log_2\mathcal N_2(H,\gamma,m)\le(2M^2A^2/\gamma^2)\log_2(2\mathcal N_2(F,\gamma/(2A),m)+1)log2​N2​(H,γ,m)≤(2M2A2/γ2)log2​(2N2​(F,γ/(2A),m)+1).
  5. Inequality (6): if m=fat⁡H(4γ)≥2+2dlog⁡2(64MA/γ)m=\operatorname{fat}_H(4\gamma)\ge2+2d\log_2(64MA/\gamma)m=fatH​(4γ)≥2+2dlog2​(64MA/γ) with d=fat⁡F(γ/(8A))d=\operatorname{fat}_F(\gamma/(8A))d=fatF​(γ/(8A)), then m≤(64M2A2/γ2)(3+dlog⁡2(8emMA/γ)log⁡2(36mM2A2/γ2))m\le(64M^2A^2/\gamma^2)(3+d\log_2(8emMA/\gamma)\log_2(36mM^2A^2/\gamma^2))m≤(64M2A2/γ2)(3+dlog2​(8emMA/γ)log2​(36mM2A2/γ2)).

Significance

Theorem 17 bounds the capacity of a network class without reference to the number of hidden units NNN. With Theorem 2 (mission I) it gives misclassification bounds for networks with small weights that hold for networks of any size, and by iteration it yields the bounds for deep sigmoid networks of Theorem 28 (mission III). Its method — upper-bound ℓ2 covering numbers through Maurey's lemma and compare with a lower bound in terms of fat-shattering — is a template for bounding the fat-shattering dimension of convex hulls in general.

The results are proved in the paper (Lemmas 19 and 21 by citation). None of them is formalized: the platform has no fat-shattering dimension, no uniform sample covering numbers of function classes, and only a finite-dimensional, diameter-based form of Maurey's lemma (HighDimProb.Appetizer.approx_caratheodory), which is not Lemma 21. This mission produces machine-checked statements of all five ingredients and of the theorem.

Difficulty

The obvious route would bound fat⁡H\operatorname{fat}_HfatH​ through a VC-type count of the network's parameters, which fails because NNN is unbounded. The paper's route needs a lower bound on covering numbers by the fat-shattering dimension (Lemma 19, a combinatorial packing argument not proved in the paper), an upper bound by the fat-shattering dimension at a finer scale (Lemma 20, which goes through the Alon et al. scale-sensitive Sauer lemma and a quantization argument), and a probabilistic approximation argument in the empirical L2L_2L2​ space (Lemmas 21 and 22). The final step solves a transcendental inequality (6) for mmm, with care at the boundary where the logarithm is small.

Formalization scope

  • Functions are maps X → ℝ; fat is valued in ℕ∞, so an unbounded shattering is ∞\infty∞, not a junk 000. Labels ±1\pm1±1 are Bool read through pm (true ↦ 1); sequences are indexed by Fin m (0-based).
  • Covers are external (finite sets of arbitrary functions X→RX\to\mathbb RX→R) with the strict inequality of Definition 3; the covering number is ∞\infty∞ when no finite cover exists. The ℓ1 and ℓ2 distances carry the factor 1/m1/m1/m. Mathlib's Metric.coveringNumber (closed balls, metric types) is not used.
  • Bounds of the form "log⁡2N≤B\log_2\mathcal N\le Blog2​N≤B" are stated for every finite value of N\mathcal NN, and where the paper's bound implies finiteness (Lemmas 20, 22, Theorem 17) finiteness is part of the conclusion.
  • The constant ccc of Theorem 17 is quantified before XXX, FFF, MMM, AAA, γ\gammaγ and ddd; a constant chosen after them would make the statement trivially true.
  • Corrections of the printed statement. Theorem 17 is stated for γ>0\gamma>0γ>0 (printed γ≥0\gamma\ge0γ≥0, under which the bound is meaningless) and A>0A>0A>0 (printed A≥0A\ge0A≥0, under which γ/(32A)\gamma/(32A)γ/(32A) is undefined). Implicit positivity (M>0M>0M>0, γ>0\gamma>0γ>0, A>0A>0A>0) in Lemmas 20, 22 and (6) is stated as hypotheses. Inequality (6) is copied as printed, with log⁡2(8emMA/γ)\log_2(8emMA/\gamma)log2​(8emMA/γ).
  • In Theorem 17 the logarithm is natural (the base is absorbed by ccc); (5) and (6) use log⁡2\log_2log2​.
  • Lemma 21 is stated in a complete real inner product space, with "convex closure" read as the closure of the convex hull.

Contributions welcome: proofs of the five milestones and of the goal, and reusable infrastructure on fat-shattering and covering numbers of function classes.

Selected references

  • P. L. Bartlett, The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network, IEEE Trans. Inform. Theory 44(2), 1998, 525–536. https://doi.org/10.1109/18.661502
  • N. Alon, S. Ben-David, N. Cesa-Bianchi, D. Haussler, Scale-sensitive dimensions, uniform convergence, and learnability, J. ACM 44(4), 1997, 615–631. https://doi.org/10.1145/263867.263927
  • P. L. Bartlett, S. R. Kulkarni, S. E. Posner, Covering numbers for real-valued function classes, IEEE Trans. Inform. Theory 43(5), 1997, 1721–1724. https://doi.org/10.1109/18.623181
  • M. J. Kearns, R. E. Schapire, Efficient distribution-free learning of probabilistic concepts, J. Comput. Syst. Sci. 48(3), 1994, 464–497. https://doi.org/10.1016/S0022-0000(05)80062-5
  • W. S. Lee, P. L. Bartlett, R. C. Williamson, Efficient agnostic learning of neural networks with bounded fan-in, IEEE Trans. Inform. Theory 42(6), 1996, 2118–2132. https://doi.org/10.1109/18.556601
  • A. R. Barron, Universal approximation bounds for superpositions of a sigmoidal function, IEEE Trans. Inform. Theory 39(3), 1993, 930–945. https://doi.org/10.1109/18.256500
11 thms2 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

The Online Set Cover Problem 2: Given α ≥ c(C_OPT), the Weighted Potential-Function Algorithm Never Fails and Pays at Most (6+o(1)) α log m log nResearch Paper

Motivation

Set cover is one of the basic covering problems of combinatorial optimization: given a ground set and a family of subsets with costs, choose a cheapest subfamily whose union contains every element. In many applications the elements to be covered are not known in advance but appear over time: requests for a service that must be served by opening facilities, clients that must be assigned to servers, or constraints of a covering program that are revealed one at a time. Each arriving element must be covered at once, and decisions cannot be undone. This is the online set cover problem, introduced by Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 39(2), 2009; conference version STOC 2003).

The quality of an online algorithm is measured by its competitive ratio: the worst case, over all arrival sequences, of the ratio between the algorithm's cost and the cost of an optimal offline cover of the elements that actually arrived. The paper gives a deterministic algorithm with ratio O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn), where nnn is the number of elements and mmm the number of sets, and shows a nearly matching lower bound for deterministic algorithms. Its algorithm for the weighted case, analysed with a potential function, became a template for the online primal–dual method surveyed by Buchbinder and Naor (Found. Trends Theor. Comput. Sci. 3(2–3), 2009).

This mission formalizes the core of the weighted result: the algorithm that is given a value α\alphaα at least the optimal cost, and its guarantee (Theorem 3.4).

Setting

The ground set XXX has n=∣X∣n = |X|n=∣X∣ elements and the family S\mathcal SS has m=∣S∣m = |\mathcal S|m=∣S∣ sets; every set SSS has a cost cS>0c_S > 0cS​>0. Both are known to the algorithm in advance. For an element jjj, Sj\mathcal S_jSj​ denotes the sets containing jjj. Elements of an unknown subset of XXX arrive one at a time in a sequence σ\sigmaσ; on arrival each must be covered by a chosen set. The chosen family C\mathcal CC can only grow. COPT\mathcal C_{OPT}COPT​ is any family covering every arriving element, and c(COPT)=∑S∈COPTcSc(\mathcal C_{OPT}) = \sum_{S \in \mathcal C_{OPT}} c_Sc(COPT​)=∑S∈COPT​​cS​.

The algorithm is given α≥c(COPT)\alpha \ge c(\mathcal C_{OPT})α≥c(COPT​). It discards sets costing more than α\alphaα, buys sets costing at most α/m\alpha/mα/m outright, and rescales costs; on the resulting normalized instance 1≤cS≤m1 \le c_S \le m1≤cS​≤m and cS≤αc_S \le \alphacS​≤α for every set (p. 365).

The algorithm keeps a weight wS>0w_S > 0wS​>0 for every set, initially wS=1/m2w_S = 1/m^2wS​=1/m2; the weight of an element is wj=∑S∈SjwSw_j = \sum_{S \in \mathcal S_j} w_Swj​=∑S∈Sj​​wS​. With CCC the set of covered elements and χC\chi_{\mathcal C}χC​ the indicator of C\mathcal CC, the potential is

Φ=∑j∉Cn2wj+n⋅exp⁡(12α∑S∈S(cSχC(S)−3wScSlog⁡n)),\Phi = \sum_{j \notin C} n^{2 w_j} + n \cdot \exp\Big(\frac{1}{2\alpha} \sum_{S \in \mathcal S} \big(c_S \chi_{\mathcal C}(S) - 3 w_S c_S \log n\big)\Big),Φ=j∈/C∑​n2wj​+n⋅exp(2α1​S∈S∑​(cS​χC​(S)−3wS​cS​logn)),

with natural logarithms throughout. When jjj arrives with wj≥1w_j \ge 1wj​≥1 nothing happens; otherwise the algorithm performs weight augmentation steps while wj<1w_j < 1wj​<1. In a step, for each S∈SjS \in \mathcal S_jS∈Sj​: (a) wS←wS(1+1ncS)w_S \leftarrow w_S (1 + \frac{1}{n c_S})wS​←wS​(1+ncS​1​); (b) if S∉CS \notin \mathcal CS∈/C, add SSS to C\mathcal CC when Φ\PhiΦ does not exceed its value before (a); (c) if Φ\PhiΦ has increased, return FAIL.

In Lean, the instance is the published OnlinePrimalDual.OnlineSetCover.SetCoverInstance over finite types X (elements) and T (sets), with the published elementWeight, coveredBy and potential. The run is OnlineSetCover.Weighted.Reachable inst α σ, the set of configurations reachable from initState σ under the transition relation Step.

Formalization targets

Goal: Theorem 3.4

On the normalized instance, with COPT\mathcal C_{OPT}COPT​ covering σ\sigmaσ, c(COPT)≤αc(\mathcal C_{OPT}) \le \alphac(COPT​)≤α, and n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2, every reachable configuration is a running state (never FAIL) in which (i) every j∈Xj \in Xj∈X with wj≥1w_j \ge 1wj​≥1 is covered, and (ii)

∑S∈CcS≤3log⁡n(1+(1+1n)αlog⁡(m2(1+1n)))+2αlog⁡n=(6+o(1)) αlog⁡mlog⁡n.\sum_{S \in \mathcal C} c_S \le 3 \log n \Big(1 + \Big(1 + \frac1n\Big)\alpha \log\Big(m^2\Big(1+\frac1n\Big)\Big)\Big) + 2\alpha \log n = (6 + o(1))\,\alpha \log m \log n.S∈C∑​cS​≤3logn(1+(1+n1​)αlog(m2(1+n1​)))+2αlogn=(6+o(1))αlogmlogn.

Milestones

  • Lemma 3.1 (p. 365): the number NNN of augmentation steps satisfies N≤∑S∈COPT(ncS+1)log⁡(m2(1+1/n))≤(n+1)αlog⁡(m2(1+1/n))N \le \sum_{S \in \mathcal C_{OPT}} (n c_S + 1)\log(m^2(1 + 1/n)) \le (n+1)\alpha\log(m^2(1+1/n))N≤∑S∈COPT​​(ncS​+1)log(m2(1+1/n))≤(n+1)αlog(m2(1+1/n)).
  • Lemma 3.2 (p. 366): throughout, ∑SwScS≤1+N/n≤1+(1+1/n)αlog⁡(m2(1+1/n))\sum_S w_S c_S \le 1 + N/n \le 1 + (1 + 1/n)\alpha\log(m^2(1+1/n))∑S​wS​cS​≤1+N/n≤1+(1+1/n)αlog(m2(1+1/n)).
  • Lemma 3.3 (p. 366): a per-set step with cS≤αc_S \le \alphacS​≤α never increases Φ\PhiΦ; in particular the algorithm never fails.

The Proved platform theorem OnlinePrimalDual.OnlineSetCover.algorithm_correctness (the last paragraph of the proof of Theorem 3.4, with the invariant Φ<n2\Phi < n^2Φ<n2 assumed) is included as a supporting reference.

Significance

Theorem 3.4 is the analysis of the subroutine; with the doubling over guesses of α\alphaα described on pp. 364–365 (which loses a factor of at most 4) it yields the paper's deterministic O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn)-competitive algorithm for weighted online set cover. The lower bound of Section 4 shows that no deterministic algorithm can do much better on general instances, so the result is close to the deterministic optimum. The technique, a potential that couples a fractional multiplicative-weights solution to a deterministic rounding, reappears in online covering and packing, online facility location and related problems.

The result is proved in the paper and restated in the Buchbinder–Naor monograph. On Prove2Me, the monograph's final step (from the invariant Φ<n2\Phi < n^2Φ<n2 to the cost bound) is a Proved theorem, and its expectation form of the monotonicity lemma is Disproved because it omits the hypothesis cS≤αc_S \le \alphacS​≤α. Neither the full statement about the algorithm's run nor Lemmas 3.1, 3.2 and the corrected Lemma 3.3 are formalized on the platform. This mission produces them, with the o(1)o(1)o(1) terms replaced by explicit expressions.

Difficulty

The cost bound in the last step is short once two facts about the run are available: that Φ\PhiΦ stays below n2n^2n2, and that the fractional cost ∑SwScS\sum_S w_S c_S∑S​wS​cS​ stays logarithmic. Neither is a local fact about one state. The first requires showing that, at every per-set step, one of the two deterministic choices (add SSS or not) does not increase Φ\PhiΦ; the paper proves this by a probabilistic argument over an auxiliary randomized choice, and the bound on the exponential term depends on the cost of the set being at most α\alphaα. The platform's earlier statement of this lemma, which omits that hypothesis, is Disproved. The second requires a bound on the number of augmentation steps over the whole run, which depends on the run's history and not on any single state. In Lean both are inductions over an operational semantics with real-valued exponentials and powers n2wjn^{2 w_j}n2wj​, where the initial bound Φ<n2\Phi < n^2Φ<n2 is a genuine size condition on nnn and mmm.

Formalization scope

The run is a small-step transition relation. A state records the weights, the cover, the number of augmentation steps begun, the elements not yet given, and the position inside the current step; FAIL is a separate terminal configuration. The order in which a step visits Sj\mathcal S_jSj​ is arbitrary and may differ between steps; every statement holds for every order. "Throughout the algorithm" means every reachable configuration, including those between per-set substeps. Arrival sequences are arbitrary lists (repetitions allowed) of elements covered by COPT\mathcal C_{OPT}COPT​.

Conventions: costs, weights and α\alphaα are real; nnn and mmm are the cardinalities of the finite types cast to R\mathbb RR; log⁡\loglog is Real.log; n2wjn^{2 w_j}n2wj​ and n2/mn^{2/m}n2/m are real powers. The paper's asymptotic expressions are replaced by what its proofs establish:

  • Lemma 3.1: (2+o(1))nαlog⁡m(2 + o(1)) n\alpha\log m(2+o(1))nαlogm becomes (n+1)αlog⁡(m2(1+1/n))(n+1)\alpha\log(m^2(1+1/n))(n+1)αlog(m2(1+1/n));
  • Lemma 3.2: (2+o(1))αlog⁡m(2 + o(1))\alpha\log m(2+o(1))αlogm becomes 1+(1+1/n)αlog⁡(m2(1+1/n))1 + (1+1/n)\alpha\log(m^2(1+1/n))1+(1+1/n)αlog(m2(1+1/n)), together with the intermediate bound 1+N/n1 + N/n1+N/n;
  • Theorem 3.4 (ii): (6+o(1))αlog⁡mlog⁡n(6 + o(1))\alpha\log m\log n(6+o(1))αlogmlogn becomes 3log⁡n (1+(1+1/n)αlog⁡(m2(1+1/n)))+2αlog⁡n3\log n\,(1 + (1+1/n)\alpha\log(m^2(1+1/n))) + 2\alpha\log n3logn(1+(1+1/n)αlog(m2(1+1/n)))+2αlogn;
  • "n and m large" becomes the hypothesis n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2 used for the initial potential (it holds, for instance, when n≥4n \ge 4n≥4 and m≥3m \ge 3m≥3).

The goal is a statement about the configurations the algorithm actually reaches from wS=1/m2w_S = 1/m^2wS​=1/m2 and the empty cover. Taking the invariant Φ<n2\Phi < n^2Φ<n2 or the fractional-cost bound as a hypothesis on an arbitrary state would trivialize it, and is ruled out: those are exactly what the milestones establish. The doubling wrapper for unknown α\alphaα is not part of this mission.

A complete development needs an invariant for reachable states (positive weights, steps of an element processed in full), the per-set potential inequality, and the step-counting argument. The per-set inequality is reusable for the monograph's version of the algorithm. Contributions of proofs of any milestone, and of auxiliary invariants as separate lemmas, are welcome.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM Journal on Computing 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
10 thms2 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

The Online Set Cover Problem 3: Every Deterministic Online Algorithm Has Competitive Ratio at Least kr on the Block FamilyResearch Paper

Motivation

In the online set cover problem of Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 2009; preliminary version STOC 2003), a ground set and a family of subsets are known in advance, but the elements that actually need covering arrive one at a time, and each must be covered on arrival by sets chosen irrevocably. The paper's motivating example is a network of servers with activation costs: the set of potential clients is known, the clients that actually request service are not, and each request must be served on arrival.

The paper gives a deterministic online algorithm whose cost is within a factor O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn) of the offline optimum, where nnn is the number of elements and mmm the number of sets. Its Section 4 shows that this is close to optimal for deterministic algorithms: for all interesting values of mmm and nnn, every deterministic online algorithm has competitive ratio Ω(log⁡nlog⁡m/(log⁡log⁡m+log⁡log⁡n))\Omega\big(\log n \log m / (\log\log m + \log\log n)\big)Ω(lognlogm/(loglogm+loglogn)). The lower bound is the reason the log⁡mlog⁡n\log m \log nlogmlogn product, rather than the ln⁡n\ln nlnn of offline approximation (Feige 1998), is the right target online. The online primal–dual framework that grew out of this paper (Buchbinder and Naor 2009) cites it as the benchmark for online covering problems.

This mission formalizes the exact, non-asymptotic statements behind that lower bound: Propositions 4.1 and 4.2 of the paper.

Setting

A ground set XXX and a family F\mathcal FF of distinct subsets of XXX are fixed and known to the algorithm; m=∣F∣m = |\mathcal F|m=∣F∣. An adversary presents elements x1,x2,…x_1, x_2, \dotsx1​,x2​,… of XXX one by one, choosing each after seeing the algorithm's previous responses. A deterministic online algorithm AAA, on the arrival of xtx_txt​, sees the earlier arrivals (x1,…,xt−1)(x_1, \dots, x_{t-1})(x1​,…,xt−1​) and xtx_txt​, and adds a finite family A((x1,…,xt−1),xt)⊆FA\big((x_1,\dots,x_{t-1}), x_t\big) \subseteq \mathcal FA((x1​,…,xt−1​),xt​)⊆F of sets to its collection; sets are never removed. It is valid if after every arrival that lies in some member of F\mathcal FF, that element lies in a chosen set. After an arrival sequence σ\sigmaσ the chosen collection is CA(σ)\mathcal C_A(\sigma)CA​(σ), and since every set has unit cost, the cost is ∣CA(σ)∣|\mathcal C_A(\sigma)|∣CA​(σ)∣. The offline optimum OPT(σ)\mathrm{OPT}(\sigma)OPT(σ) is the least number of members of F\mathcal FF covering the elements of σ\sigmaσ. The competitive ratio of AAA is at least ρ\rhoρ when some arrival sequence σ\sigmaσ has OPT(σ)≥1\mathrm{OPT}(\sigma) \ge 1OPT(σ)≥1 and ∣CA(σ)∣≥ρ OPT(σ)|\mathcal C_A(\sigma)| \ge \rho\,\mathrm{OPT}(\sigma)∣CA​(σ)∣≥ρOPT(σ).

Two families are used.

  • The bit family: X={0,…,2k−1}X = \{0, \dots, 2^k - 1\}X={0,…,2k−1} and Fi={j:bit i of j is on}F_i = \{ j : \text{bit } i \text{ of } j \text{ is on}\}Fi​={j:bit i of j is on} for 1≤i≤k1 \le i \le k1≤i≤k.
  • The block family: kr2k r^2kr2 disjoint blocks X1,…,Xkr2X_1, \dots, X_{kr^2}X1​,…,Xkr2​ of 2k2^k2k elements each; Xb(t)X_b(t)Xb​(t) is the set of elements of block XbX_bXb​ whose tttth bit is on. For an rrr-set R={b1<⋯<br}R = \{b_1 < \dots < b_r\}R={b1​<⋯<br​} of blocks and bit locations I=(i1,…,ir)I = (i_1, \dots, i_r)I=(i1​,…,ir​),
FR,I=⋃t=1rXbt(it),F_{R,I} = \bigcup_{t=1}^r X_{b_t}(i_t),FR,I​=t=1⋃r​Xbt​​(it​),

and the family consists of all FR,IF_{R,I}FR,I​; it has m=(kr2r)krm = \binom{kr^2}{r} k^rm=(rkr2​)kr members.

Formalization targets

Goal: Proposition 4.2

For all positive integers k,rk, rk,r and all n,mn, mn,m with

n≥2k+1kr2,22kkr2≥m≥(kr2r)kr,n \ge 2^{k+1} k r^2, \qquad 2^{2^k k r^2} \ge m \ge \binom{kr^2}{r} k^r,n≥2k+1kr2,22kkr2≥m≥(rkr2​)kr,

there is a family F\mathcal FF of exactly mmm distinct subsets of an nnn-element set such that for every valid deterministic online algorithm AAA there is a nonempty arrival sequence σ\sigmaσ, covered by a single member of F\mathcal FF, with

∣CA(σ)∣≥kr=kr⋅OPT(σ).|\mathcal C_A(\sigma)| \ge kr = kr \cdot \mathrm{OPT}(\sigma).∣CA​(σ)∣≥kr=kr⋅OPT(σ).

The goal leaves the instance existential, as the paper does, and keeps both bounds on mmm and the bound on nnn exactly as printed.

Milestones

  1. Proposition 4.1. On the bit family, ∣F∣=k|\mathcal F| = k∣F∣=k; every valid deterministic algorithm can be forced to cost kkk on a sequence with OPT=1\mathrm{OPT} = 1OPT=1; and some valid algorithm has cost at most k⋅∣C∣k \cdot |C|k⋅∣C∣ for every offline cover CCC. So the best deterministic competitive ratio is exactly k=log⁡2nk = \log_2 nk=log2​n.
  2. The adversary claim of Section 4 (p. 369). On the block family, every valid deterministic algorithm can be forced to choose krkrkr sets by at most krkrkr arrivals that a single set covers.

A supporting item (not a milestone) records the count ∣F∣=(kr2r)kr|\mathcal F| = \binom{kr^2}{r} k^r∣F∣=(rkr2​)kr of the block family.

Significance

The result. Proposition 4.2 is the exact statement behind the paper's lower bound: choosing rrr of order log⁡m/(log⁡log⁡m+log⁡log⁡n)\log m / (\log\log m + \log\log n)logm/(loglogm+loglogn) and kkk of order log⁡n\log nlogn turns it into the asymptotic bound Ω(log⁡nlog⁡m/(log⁡log⁡m+log⁡log⁡n))\Omega\big(\log n \log m/(\log\log m + \log\log n)\big)Ω(lognlogm/(loglogm+loglogn)), which shows that the paper's O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn) algorithm is optimal among deterministic algorithms up to a log⁡log⁡m+log⁡log⁡n\log\log m + \log\log nloglogm+loglogn factor. Without it, the gap between the ln⁡n\ln nlnn achievable offline and the log⁡mlog⁡n\log m \log nlogmlogn achieved online would be unexplained. Proposition 4.1 alone gives the matching bound log⁡2n\log_2 nlog2​n when m=log⁡2nm = \log_2 nm=log2​n.

Formalizing it. Both propositions are proved in the paper; neither is formalized anywhere to our knowledge. The mission produces a reusable model of deterministic online algorithms against an adaptive adversary, with a validity notion and a cost, and machine-checked adversary arguments on it. The paper's proof tacitly lets the algorithm add one set per arrival; the statements here cover algorithms that add any number of sets per arrival, so a complete formalization also closes that gap.

Difficulty

The adversary must be adaptive, and the quantifiers are ordered instance, then algorithm, then arrival sequence. The obvious single-block argument (Proposition 4.1) forces only kkk sets. To force krkrkr sets with OPT=1\mathrm{OPT} = 1OPT=1, the adversary must move to blocks that no chosen set has touched yet, which requires counting the blocks touched by the sets chosen so far. When an algorithm adds many sets at once, the paper's count "at most 1+(r−1)k1 + (r-1)k1+(r−1)k blocks after kkk steps" no longer applies as written, and the stopping rule has to be phrased in terms of the cost already paid. The padding of Proposition 4.2 must reach exactly nnn elements and exactly mmm distinct sets without creating sets that help cover the adversary's elements.

Formalization scope

The ground set is a Fin type: Fin (2^k) for Proposition 4.1, Fin (k r²) × Fin (2^k) (block, element) for the block family, Fin n for Proposition 4.2. A family is a Finset (Finset X), so its cardinality counts distinct sets. Bit iii (1-based) of jjj is Nat.testBit j (i-1). An online algorithm is a function from (earlier arrivals in arrival order, current element) to the finite family of sets it adds; it may add any number of sets. Validity demands coverage only for elements that some member of the family contains. Costs are unit (the problem of Section 4 is unweighted).

The offline optimum is never encoded as an infimum: lower bounds exhibit a nonempty arrival sequence and a single covering set (OPT=1\mathrm{OPT} = 1OPT=1), and the upper bound of Proposition 4.1 quantifies over all offline covers. This rules out the trivializing reading in which the empty arrival sequence satisfies cost≥kr⋅OPT\text{cost} \ge kr \cdot \mathrm{OPT}cost≥kr⋅OPT as 0≥00 \ge 00≥0.

The statements contain no O(⋅)O(\cdot)O(⋅): every quantity is the paper's exact one. The asymptotic bound (8) under the range (7), whose final paragraph only sketches the choice of rrr and kkk, is excluded, as are the remarks on the trivial ratio-mmm and O(n)O(\sqrt n)O(n​) algorithms.

Contributions welcome: proofs of the milestones; lemmas on the chosen collection (monotonicity, decomposition along a sequence); the count of the block family; and the padding construction of Proposition 4.2. The online-algorithm model is reusable for other deterministic online covering lower bounds.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM J. Comput. 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The online set cover problem, Proc. 35th ACM STOC, 2003, pp. 100–105. https://doi.org/10.1145/780542.780558
  • U. Feige, A threshold of ln n for approximating set cover, J. ACM 45(4):634–652, 1998. https://doi.org/10.1145/285055.285059
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
6 thms2 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

The Online Set Cover Problem 1: A Deterministic O(log m log n)-Competitive Algorithm for Unweighted Online Set CoverResearch Paper

Motivation

Set cover asks for the fewest sets from a family S\mathcal SS of mmm subsets of a ground set XXX of nnn elements whose union contains XXX. It is NP-hard, and the best ratio achievable in polynomial time is Θ(log⁡n)\Theta(\log n)Θ(logn) (Feige 1998, doi:10.1145/285055.285059).

Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 39(2), 2009; preliminary version STOC 2003) introduced an online version. The instance (X,S)(X,\mathcal S)(X,S) is known in advance, but an adversary reveals elements one at a time, and each revealed element must be covered at once, by sets that can never be removed later. The set X′⊆XX'\subseteq XX′⊆X of elements that will actually be revealed is unknown. The paper's motivating example is a network of servers: the potential clients and the servers that can serve each client are known, but which clients will request service is not, and every activated server costs money.

The question is how much an algorithm loses against an offline adversary who knows X′X'X′ and covers it with a family COPT\mathcal C_{OPT}COPT​. This mission formalizes the paper's answer for unit costs (Section 2): a deterministic algorithm whose cover is within a factor O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn) of ∣COPT∣|\mathcal C_{OPT}|∣COPT​∣. Section 3 of the paper extends the algorithm to weighted sets and Section 4 proves a nearly matching lower bound; those are separate missions of this series.

Setting

An instance consists of a finite ground set XXX with n=∣X∣n=|X|n=∣X∣ elements and a finite family S\mathcal SS of m=∣S∣m=|\mathcal S|m=∣S∣ sets. For an element jjj, Sj\mathcal S_jSj​ is the collection of sets containing jjj. Every set has cost 111, so the cost of a family is its number of members.

The adversary gives a sequence σ\sigmaσ of elements (the given elements form X′X'X′). A family COPT⊆S\mathcal C_{OPT}\subseteq\mathcal SCOPT​⊆S covers σ\sigmaσ if each element of σ\sigmaσ lies in some member of it.

The algorithm keeps a weight wS>0w_S>0wS​>0 for every set, initially wS=1/(2m)w_S=1/(2m)wS​=1/(2m), and a cover C\mathcal CC, initially empty. The weight of an element is wj=∑S∈SjwSw_j=\sum_{S\in\mathcal S_j}w_Swj​=∑S∈Sj​​wS​, and CCC is the set of elements covered by members of C\mathcal CC. The potential is

Φ=∑j∉Cn2wj.\Phi=\sum_{j\notin C}n^{2w_j}.Φ=j∈/C∑​n2wj​.

When the adversary gives an element jjj:

  1. if wj≥1w_j\ge1wj​≥1, nothing changes;
  2. otherwise a weight augmentation is performed: (a) kkk is the minimal integer with 2kwj>12^k w_j>12kwj​>1; (b) every S∈SjS\in\mathcal S_jS∈Sj​ gets the weight 2kwS2^k w_S2kwS​; (c) at most 4log⁡n4\log n4logn sets from Sj\mathcal S_jSj​ are added to C\mathcal CC, so that Φ\PhiΦ does not exceed its value before the augmentation.

Step (c) prescribes a property of the chosen sets, not the sets themselves. A run on σ\sigmaσ is any sequence of iterations, one per arrival, in which every iteration makes an admissible choice.

Formalization targets

Goal: Theorem 2.3

For n≥2n\ge2n≥2, every arrival sequence σ\sigmaσ, and every family COPT\mathcal C_{OPT}COPT​ covering σ\sigmaσ: a run of the algorithm on σ\sigmaσ exists, and every run ends with a cover C\mathcal CC that covers every element of σ\sigmaσ and satisfies

∣C∣  ≤  ⌈4ln⁡n⌉⋅∣COPT∣⋅(log⁡2m+2).|\mathcal C|\;\le\;\lceil 4\ln n\rceil\cdot|\mathcal C_{OPT}|\cdot(\log_2 m+2).∣C∣≤⌈4lnn⌉⋅∣COPT​∣⋅(log2​m+2).

The paper states ∣C∣=O(∣COPT∣log⁡mlog⁡n)|\mathcal C|=O(|\mathcal C_{OPT}|\log m\log n)∣C∣=O(∣COPT​∣logmlogn); the displayed bound is the constant its proof produces. Because the bound holds for every covering family, it holds in particular for an optimal one.

Milestones

Lemma 2.1. In every run, the number of iterations with a weight augmentation is at most

∣COPT∣⋅(log⁡2m+2).|\mathcal C_{OPT}|\cdot(\log_2 m+2).∣COPT​∣⋅(log2​m+2).

Lemma 2.2. In an iteration with a weight augmentation, from a state with positive weights, there is a family F⊆SjF\subseteq\mathcal S_jF⊆Sj​ with ∣F∣≤⌈4ln⁡n⌉|F|\le\lceil4\ln n\rceil∣F∣≤⌈4lnn⌉ such that

Φe≤Φs,\Phi_e\le\Phi_s,Φe​≤Φs​,

where Φs\Phi_sΦs​ is the potential before the iteration and Φe\Phi_eΦe​ the potential after it, computed with the augmented weights and the cover C∪F\mathcal C\cup FC∪F.

Significance

The theorem shows that online set cover over a known instance admits a deterministic O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn)-competitive algorithm. Section 4 of the paper shows this is nearly optimal: no deterministic algorithm achieves o ⁣(log⁡mlog⁡nlog⁡log⁡m+log⁡log⁡n)o\!\left(\frac{\log m\log n}{\log\log m+\log\log n}\right)o(loglogm+loglognlogmlogn​) over a wide range of parameters. Its multiplicative weight updates were developed further into the online primal–dual framework for covering problems of Buchbinder and Naor (FnT TCS 3(2–3), 2009), whose Section 5.1 restates this algorithm.

The result is proved in the paper; it is not machine-checked. The Prove2Me platform has the weighted version's final counting step from the Buchbinder–Naor monograph, but no statement of Section 2. A complete development here gives a checked proof of the unweighted competitive ratio with an explicit constant, together with a reusable formal model of an online algorithm with a nondeterministic step, whose correctness includes the existence of an admissible choice at every step.

Difficulty

The central step is Lemma 2.2: a family of at most ⌈4ln⁡n⌉\lceil4\ln n\rceil⌈4lnn⌉ sets that keeps the potential from increasing must exist at every augmentation. The obvious rules fail. Adding every set of Sj\mathcal S_jSj​ can exceed the cardinality bound, since Sj\mathcal S_jSj​ may contain up to mmm sets. Adding nothing, or a single set, can increase Φ\PhiΦ: every uncovered element sharing a set with jjj has its weight raised, and its term n2wn^{2w}n2w grows by a factor up to n2δn^{2\delta}n2δ. The paper's argument is non-constructive, and a formal proof must establish existence for a finite averaging statement over real powers of nnn.

The second difficulty is that the algorithm is nondeterministic. A statement "every run has property P" is empty if no run exists, and the existence of a run is exactly Lemma 2.2 applied at every step under the invariants that weights stay positive and that each arriving element lies in some set. Feasibility (that every given element ends up covered) is not part of the algorithm's rule; it follows from the potential never increasing, which needs n≥2n\ge2n≥2 and a careful treatment of the initial potential, which is at most n2n^2n2 and equals n2n^2n2 when every element lies in every set.

Formalization scope

The instance is the published OnlinePrimalDual.OnlineSetCover.SetCoverInstance (finite types E of elements and T of set indices, incidence elemSets), with the published elementWeight (wjw_jwj​) and coveredBy (j∈Cj\in Cj∈C). Its positive cost field is not used: all sets have unit cost and the cover is measured by its cardinality. n=∣E∣n=|E|n=∣E∣ and m=∣T∣m=|T|m=∣T∣. Weights are real numbers; n2wjn^{2w_j}n2wj​ is the real power.

The algorithm is the definition OnlineSetCover.Unweighted.Algorithm: a relation Step for one iteration (recording whether a weight augmentation occurred) and Run for a sequence of iterations from the initial state, counting augmentations. Arrival sequences are lists and may repeat elements.

Explicit forms of the paper's asymptotic and unspecified quantities:

  • the paper's "4log⁡n4\log n4logn" sets per augmentation is ⌈4ln⁡n⌉\lceil 4\ln n\rceil⌈4lnn⌉ (natural logarithm, rounded up: the proof repeats a random choice that many times and needs (1−δ/2)4log⁡n≤n−2δ(1-\delta/2)^{4\log n}\le n^{-2\delta}(1−δ/2)4logn≤n−2δ);
  • Lemma 2.1's log⁡m+2\log m+2logm+2 is log⁡2m+2=log⁡2(4m)\log_2 m+2=\log_2(4m)log2​m+2=log2​(4m) (weights grow from 1/(2m)1/(2m)1/(2m) to at most 222 by factors at least 222);
  • Theorem 2.3's O(∣COPT∣log⁡mlog⁡n)O(|\mathcal C_{OPT}|\log m\log n)O(∣COPT​∣logmlogn) is ⌈4ln⁡n⌉⋅∣COPT∣⋅(log⁡2m+2)\lceil4\ln n\rceil\cdot|\mathcal C_{OPT}|\cdot(\log_2 m+2)⌈4lnn⌉⋅∣COPT​∣⋅(log2​m+2);
  • kkk ranges over natural numbers; for wj<1w_j<1wj​<1 the minimal integer with 2kwj>12^kw_j>12kwj​>1 is one;
  • the paper's remark "(Clearly, 2k⋅wj<22^k\cdot w_j<22k⋅wj​<2.)" is not encoded; the correct bound is ≤2\le2≤2 (wj=1/2w_j=1/2wj​=1/2 gives k=2k=2k=2) and is not a hypothesis anywhere.

The goal adds the hypothesis n≥2n\ge2n≥2, which the paper's log⁡n\log nlogn assumes tacitly: for n=1n=1n=1 no set may be added and the element is never covered.

Replacing the algorithm by the set of states whose potential is at most the initial one, or dropping the existence of a run from the goal, gives a weaker theorem; part (a) of the goal rules this out.

A complete development needs elementary real analysis (Real.rpow, Real.log, 1−x≤e−x1-x\le e^{-x}1−x≤e−x), a finite probabilistic or averaging argument for Lemma 2.2, and induction over runs. Contributions are welcome on any milestone; a derandomized averaging lemma for Lemma 2.2 would be reusable in the weighted mission of this series.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM J. Comput. 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • U. Feige, A Threshold of ln n for Approximating Set Cover, J. ACM 45(4):634–652, 1998. https://doi.org/10.1145/285055.285059
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
7 thms2 active usersReviewed
PreviousPage 13 of 26Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me