Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Combinatorics

630 missions · 348 completed

The mathematics of finite and discrete structures — counting the arrangements of a set, deciding when a configuration meeting prescribed constraints can exist, and characterizing the patterns such structures are forced to contain. It encompasses enumerative and extremal combinatorics, graph theory, design theory, and additive combinatorics, with deep ties to algebra, probability, and computer science.

Missions

Open282Completed348All630
Graph TheoryLinear OptimizationOptimal Transport·Captain: mikedeng1

Computational Optimal Transport IV: The Support Graph of an Extreme Point of the Transportation Polytope U(a, b) Has No Cycle, Hence at Most n + m − 1 Nonzero EntriesTextbook

Motivation

Discrete optimal transport between two histograms is a linear program. Its feasible set, the transportation polytope, has been studied since Hitchcock (1941) and Kantorovich, and the structure of its vertices underlies the classical algorithms for the problem: the north-west corner rule produces a vertex, and the network simplex moves from vertex to vertex. A linear program with a nonempty bounded feasible set attains its minimum at a vertex, so knowing what vertices look like tells us what optimal transport plans can be assumed to look like.

This mission is the fourth of a series formalizing G. Peyré and M. Cuturi, Computational Optimal Transport (Foundations and Trends in Machine Learning, 2019). It covers §3.4.1 of the book, Tree Structure of the Support of All Vertices of U(a, b) (pp. 405–407), whose single numbered result, Proposition 3.4, states that the support of a vertex is a forest. The book credits the result to Brualdi, Combinatorial Matrix Classes (2006, Theorem 8.1.2).

Setting

Fix integers n,mn, mn,m and histograms a∈Σna \in \Sigma_na∈Σn​, b∈Σmb \in \Sigma_mb∈Σm​. The transportation polytope is

U(a,b)={P∈R+n×m:P1m=a, P⊤1n=b},U(a,b) = \{ P \in \mathbb R_+^{n\times m} : P\mathbb 1_m = a,\ P^\top\mathbb 1_n = b \},U(a,b)={P∈R+n×m​:P1m​=a, P⊤1n​=b},

the set of nonnegative n×mn\times mn×m matrices whose row sums are a1,…,ana_1,\dots,a_na1​,…,an​ and whose column sums are b1,…,bmb_1,\dots,b_mb1​,…,bm​. Histograms are nonnegative and sum to one; U(a,b)U(a,b)U(a,b) is the set of couplings between them. The cost of a plan PPP for a cost matrix CCC is ⟨C,P⟩=∑i,jCijPij\langle C, P\rangle = \sum_{i,j} C_{ij}P_{ij}⟨C,P⟩=∑i,j​Cij​Pij​.

A point xxx of a set SSS is an extremal point (vertex) of SSS if, whenever y,z∈Sy, z \in Sy,z∈S and x=(y+z)/2x = (y+z)/2x=(y+z)/2, necessarily x=y=zx = y = zx=y=z.

Take nnn source nodes V={1,…,n}V = \{1,\dots,n\}V={1,…,n} and mmm target nodes V′={1′,…,m′}V' = \{1',\dots,m'\}V′={1′,…,m′}. The complete bipartite graph between them has the nmnmnm edges (i,j′)(i, j')(i,j′). For a matrix PPP, the support S(P)S(P)S(P) is the set of edges (i,j′)(i,j')(i,j′) with Pij>0P_{ij} > 0Pij​>0, and the support graph is G(P)=(V∪V′,S(P))G(P) = (V\cup V', S(P))G(P)=(V∪V′,S(P)). A transport plan is a flow on the complete bipartite graph, with aia_iai​ leaving node iii and bjb_jbj​ entering node j′j'j′; G(P)G(P)G(P) records the edges the flow actually uses.

Formalization targets

Goal: Proposition 3.4 (p. 406)

If PPP is an extremal point of U(a,b)U(a,b)U(a,b), then

G(P) has no cyclesand#{(i,j):Pij≠0}≤n+m−1.G(P) \text{ has no cycles}\qquad\text{and}\qquad \#\{(i,j) : P_{ij}\ne 0\} \le n + m - 1 .G(P) has no cyclesand#{(i,j):Pij​=0}≤n+m−1.

Milestones (proof of Proposition 3.4, p. 407)

  1. If G(P)G(P)G(P) has a cycle, there is a nonzero matrix EEE with E1m=0E\mathbb 1_m = 0E1m​=0, E⊤1n=0E^\top\mathbb 1_n = 0E⊤1n​=0, and Eij≠0⇒Pij>0E_{ij} \ne 0 \Rightarrow P_{ij} > 0Eij​=0⇒Pij​>0.
  2. For such an EEE and P∈U(a,b)P \in U(a,b)P∈U(a,b), both P+tEP + tEP+tE and P−tEP - tEP−tE lie in U(a,b)U(a,b)U(a,b) for some t>0t > 0t>0.
  3. A graph with kkk nodes and no cycles has at most k−1k-1k−1 edges.
  4. For P≥0P \ge 0P≥0, the edges of G(P)G(P)G(P) correspond one-to-one to the nonzero entries of PPP.

Companion (§3.4, p. 405)

For a∈Σna \in \Sigma_na∈Σn​, b∈Σmb \in \Sigma_mb∈Σm​ and any cost CCC, some minimizer of ⟨C,P⟩\langle C, P\rangle⟨C,P⟩ over U(a,b)U(a,b)U(a,b) is an extremal point of U(a,b)U(a,b)U(a,b).

Significance

Proposition 3.4 is the sparsity statement of discrete optimal transport: a vertex of U(a,b)U(a,b)U(a,b) moves mass along at most n+m−1n+m-1n+m−1 source–target pairs, out of nmnmnm possible. With the companion, some optimal plan is that sparse. This is what makes the network simplex method a combinatorial algorithm on spanning trees of the bipartite graph (§3.5 of the book), and it is the reason the north-west corner rule (§3.4.2) can produce a feasible vertex with a tree support. The same fact, specialized to n=mn = mn=m and uniform histograms, is one step on the way from Kantorovich's relaxation back to Monge's assignment problem.

The result is classical and proved; it has not, to our knowledge, been formalized. Mathlib has the transportation polytope only implicitly (no dedicated definition), and it has the edge count of trees (SimpleGraph.IsTree.card_edgeFinset) but not the corresponding bound for forests. The mission produces a machine-checked link between the convex geometry of U(a,b)U(a,b)U(a,b) and the combinatorics of its support graph, reusable by later missions of the series on the network simplex and on the assignment problem.

Difficulty

The convex-geometric half is elementary; the work is in the passage between a cycle of a graph and a matrix. The cycle is an object of Mathlib's graph library (a closed walk with distinct vertices in a graph on V⊔V′V \sqcup V'V⊔V′), while the perturbation is a matrix indexed by V×V′V \times V'V×V′. An informal picture of a cycle as a list of edges hides what the matrix statement needs: each source and each target must be visited at most once, and Mathlib's cycles are walks whose distinctness conditions have to be carried to the matrix level.

The edge bound for forests is not packaged in Mathlib either: it counts the edges of a tree, a connected acyclic graph, while the support graph of a vertex is in general disconnected, and the empty graph must be handled.

Formalization scope

All objects live in the namespace CompOT.Vertices. Indices are Fin n and Fin m (0-based; the book's [ ⁣[n] ⁣]={1,…,n}[\![n]\!] = \{1,\dots,n\}[[n]]={1,…,n}). Matrices are Matrix (Fin n) (Fin m) ℝ, and U(a,b)U(a,b)U(a,b) is the set of matrices with nonnegative entries, row sums aaa and column sums bbb. Extremality is the book's midpoint definition, relative to the set: the points y,zy, zy,z in x=(y+z)/2x = (y+z)/2x=(y+z)/2 range over U(a,b)U(a,b)U(a,b) only. This rules out the trivializing reading in which y,zy, zy,z range over all matrices (no point would then be extremal and the goal would be vacuous); conversely, the sanity file shows a non-extremal coupling, so extremality is not automatic either.

The support graph is a SimpleGraph (Fin n ⊕ Fin m) with Sum.inl i adjacent to Sum.inr j exactly when Pij>0P_{ij} > 0Pij​>0 and no other adjacencies. The book calls the edges (i,j′)(i,j')(i,j′) directed, but the cycles of its proof alternate between sources and targets, so "no cycles" is Mathlib's SimpleGraph.IsAcyclic of this undirected graph. The number of nonzero entries is the cardinality of {(i,j):Pij≠0}\{(i,j) : P_{ij} \ne 0\}{(i,j):Pij​=0}.

The goal, feasibility milestone and companion carry a∈Σna \in \Sigma_na∈Σn​, b∈Σmb \in \Sigma_mb∈Σm​, the book's standing notation for histograms (p. 360). These hypotheses make the index sets nonempty, so natural-number subtraction in the bound n+m−1n+m-1n+m−1 agrees with the book's integer expression.

Useful infrastructure, reusable beyond this mission: the forest edge bound for finite simple graphs, and the correspondence between cycles of a bipartite graph and signed matrices with zero line sums. Contributions of either as standalone lemmas are welcome.

Selected references

  • G. Peyré, M. Cuturi, Computational Optimal Transport, Foundations and Trends in Machine Learning 11(5–6):355–607, 2019. https://doi.org/10.1561/2200000073
  • R. A. Brualdi, Combinatorial Matrix Classes, Cambridge University Press, 2006, §8.1. https://doi.org/10.1017/CBO9780511721182
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997, Theorem 2.7.
  • F. L. Hitchcock, The distribution of a product from several sources to numerous localities, Journal of Mathematics and Physics 20:224–230, 1941. https://doi.org/10.1002/sapm1941201224
7 thms1 active userReviewed
AlgebraDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 1: An h-Scattered 𝔽_q-Subspace of V(r, qⁿ) Either Defines a Subgeometry or Has Dimension at Most rn/(h + 1)Research Paper

Motivation

Let VVV be an rrr-dimensional vector space over the finite field Fqn\mathbb F_{q^n}Fqn​. Viewed over the subfield Fq\mathbb F_qFq​, VVV has dimension rnrnrn, and its one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces form the Desarguesian spread. An Fq\mathbb F_qFq​-subspace UUU of VVV is scattered if it meets every element of this spread in an Fq\mathbb F_qFq​-subspace of dimension at most one. Scattered subspaces define scattered Fq\mathbb F_qFq​-linear sets in PG(r−1,qn)\mathrm{PG}(r-1,q^n)PG(r−1,qn). Through these linear sets they are connected to projective two-weight codes, strongly regular graphs and maximum rank distance (MRD) codes. In 2000 Blokhuis and Lavrauw proved that a scattered subspace has dimension at most rn/2rn/2rn/2, and a sequence of papers showed that this bound is attained whenever 2∣rn2 \mid rn2∣rn.

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2; Combinatorica 41, 2021) replace the one-dimensional spread elements by all hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces. This gives a hierarchy of conditions, the hhh-scattered subspaces, that refines the scattered case. For h=r−1h = r-1h=r−1 and dimension nnn these subspaces had already been identified with Fqn\mathbb F_{q^n}Fqn​-linear MRD codes by Sheekey and Van de Voorde. This mission formalizes the paper's main theorem, the dimension bound for hhh-scattered subspaces.

Timeline.

  • 2000: Blokhuis and Lavrauw, Scattered spaces with respect to a spread in PG(n, q), prove dim⁡FqU≤rn/2\dim_{\mathbb F_q} U \le rn/2dimFq​​U≤rn/2 for scattered UUU (the case h=1h = 1h=1).
  • 2000–2018: Ball–Blokhuis–Lavrauw (2000), Blokhuis–Lavrauw (2000), Csajbók–Marino–Polverino–Zullo (2017) and Bartoli–Giulietti–Marino–Polverino (2018) together show that scattered subspaces of dimension rn/2rn/2rn/2 exist whenever rnrnrn is even.
  • 2020: Sheekey and Van de Voorde study subspaces scattered with respect to hyperplanes (h=r−1h = r-1h=r−1) and relate them to MRD codes.
  • 2019–2021: Csajbók, Marino, Polverino and Zullo introduce hhh-scattered subspaces and prove the bound rn/(h+1)rn/(h+1)rn/(h+1) for every hhh (Theorem 2.3).

Setting

Let Fq⊆Fqn\mathbb F_q \subseteq \mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, so n=dim⁡FqFqnn = \dim_{\mathbb F_q}\mathbb F_{q^n}n=dimFq​​Fqn​, and let VVV be a vector space over Fqn\mathbb F_{q^n}Fqn​ of dimension rrr. Every Fqn\mathbb F_{q^n}Fqn​-subspace of VVV is also an Fq\mathbb F_qFq​-subspace. For an Fq\mathbb F_qFq​-subspace UUU of VVV, ⟨U⟩Fqn\langle U\rangle_{\mathbb F_{q^n}}⟨U⟩Fqn​​ denotes its Fqn\mathbb F_{q^n}Fqn​-span.

Definition 1.1. Let 0<h≤r−10 < h \le r-10<h≤r−1. An Fq\mathbb F_qFq​-subspace UUU of VVV is hhh-scattered if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U) \le hdimFq​​(S∩U)≤h. In Lean this is HScattered.Bound.IsHScattered F K h U, with F =Fq=\mathbb F_q=Fq​, K =Fqn=\mathbb F_{q^n}=Fqn​, and rrr = Module.finrank K V.

An Fq\mathbb F_qFq​-subspace UUU defines a subgeometry of PG(V,Fqn)\mathrm{PG}(V,\mathbb F_{q^n})PG(V,Fqn​) if some Fq\mathbb F_qFq​-basis of UUU is also an Fqn\mathbb F_{q^n}Fqn​-basis of VVV (HScattered.Construction.DefinesSubgeometry F K U, a definition shared with the other missions of this series). In coordinates, UUU is then Fq r\mathbb F_q^{\,r}Fqr​ inside Fqn r\mathbb F_{q^n}^{\,r}Fqnr​.

A rank distance code of Fqn×m\mathbb F_q^{n\times m}Fqn×m​, n≤mn \le mn≤m, is a set C\mathcal CC of Fq\mathbb F_qFq​-linear maps from an mmm-dimensional to an nnn-dimensional Fq\mathbb F_qFq​-space, with distance d(f,g)=rk⁡(f−g)d(f,g) = \operatorname{rk}(f-g)d(f,g)=rk(f−g).

Formalization targets

Goal: Theorem 2.3

If UUU is an hhh-scattered Fq\mathbb F_qFq​-subspace of VVV, then either dim⁡FqU=r\dim_{\mathbb F_q}U = rdimFq​​U=r, UUU defines a subgeometry and UUU is (r−1)(r-1)(r−1)-scattered, or

dim⁡FqU≤rnh+1.\dim_{\mathbb F_q} U \le \frac{rn}{h+1}.dimFq​​U≤h+1rn​.

The disjunction is inclusive. The statement holds for every hhh in the range 0<h≤r−10 < h \le r-10<h≤r−1, including h=1h = 1h=1.

Milestones

  • Proposition 2.1. For h>1h > 1h>1, an hhh-scattered subspace is iii-scattered for every 0<i<h0 < i < h0<i<h.
  • Lemma 2.2. If r≥2r \ge 2r≥2 and r≤i≤nr \le i \le nr≤i≤n, then VVV contains an (r−1)(r-1)(r−1)-scattered Fq\mathbb F_qFq​-subspace of dimension iii.
  • Result 4.6 (Delsarte). A rank distance code of Fqn×m\mathbb F_q^{n\times m}Fqn×m​, n≤mn\le mn≤m, with minimum distance ddd has ∣C∣≤qm(n−d+1)|\mathcal C| \le q^{m(n-d+1)}∣C∣≤qm(n−d+1).

Significance

The result. Theorem 2.3 is the upper end of the theory of hhh-scattered subspaces. It shows that the bound rn/(h+1)rn/(h+1)rn/(h+1) decreases with hhh: a stronger intersection condition forces a smaller subspace. Every subspace reaching the bound is a maximum hhh-scattered subspace. The rest of the paper builds on such subspaces. Its constructions show the bound is sharp when h+1∣rh+1 \mid rh+1∣r. Its intersection numbers with hyperplanes lie in [rn/(h+1)−n, rn/(h+1)−n+h][rn/(h+1)-n,\ rn/(h+1)-n+h][rn/(h+1)−n, rn/(h+1)−n+h]. Its Delsarte-type duality sends maximum hhh-scattered subspaces to maximum (n−h−2)(n-h-2)(n−h−2)-scattered ones. Each of these statements presupposes the bound. For h=r−1h = r-1h=r−1, the bound dim⁡U≤n\dim U \le ndimU≤n is the geometric counterpart of the Singleton bound for MRD codes.

Formalizing it. The theorem is proved in the paper; it has no machine-checked proof. A formalization would provide a Lean model of hhh-scattered subspaces over a field tower and a rank-metric Singleton bound, and the bound itself as a reusable lemma for the companion missions on constructions, hyperplane intersections and duality. The case h=1h = 1h=1 is attributed in the paper to Blokhuis–Lavrauw and is not reproved there, so a complete formal proof must also supply that case.

Difficulty

The obvious approach is to count. Every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace meets UUU in at most qhq^hqh vectors. But these subspaces overlap heavily, and a double count of incidences between vectors of UUU and hhh-dimensional subspaces does not produce a bound of the form rn/(h+1)rn/(h+1)rn/(h+1). The hhh-scattered condition must be used on subspaces of every dimension t<ht < ht<h at once, which is the content of Proposition 2.1. The argument for h=1h = 1h=1 does not carry over directly either: the paper treats h=r−1h = r-1h=r−1, 1<h<r−11 < h < r-11<h<r−1 with n≥h+1n \ge h+1n≥h+1, and n<h+1n < h+1n<h+1 as separate cases. The case h=r−1h = r-1h=r−1 rests on a coding-theoretic input (Result 4.6), and the middle case needs auxiliary subspaces whose existence (Lemma 2.2) holds only when n≥h+1n \ge h+1n≥h+1.

Formalization scope

  • Field tower. Fq\mathbb F_qFq​ and Fqn\mathbb F_{q^n}Fqn​ are finite fields F, K with [Algebra F K]. VVV is a finite-dimensional K-module with a compatible F-module structure ([IsScalarTower F K V]). The parameters are qqq = Fintype.card F, nnn = Module.finrank F K and rrr = Module.finrank K V.
  • Subspaces. Fq\mathbb F_qFq​-subspaces are Submodule F V and Fqn\mathbb F_{q^n}Fqn​-subspaces are Submodule K V. The intersection S∩US\cap US∩U is S.restrictScalars F ⊓ U.
  • The definition. The range 0<h<r0 < h < r0<h<r and the spanning condition ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V are clauses of IsHScattered.
  • No division. rn/(h+1)rn/(h+1)rn/(h+1) never appears with division: "dim⁡U≤rn/(h+1)\dim U \le rn/(h+1)dimU≤rn/(h+1)" is (h+1)dim⁡U≤rn(h+1)\dim U \le rn(h+1)dimU≤rn in N\mathbb NN.
  • Result 4.6. The code is a Finset of linear maps. The minimum distance ddd enters as a lower bound on all pairwise rank distances, with 1≤d≤n1 \le d \le n1≤d≤n.
  • Lemma 2.2. It carries r≥2r \ge 2r≥2, which Definition 1.1 forces for (r−1)(r-1)(r−1)-scattered subspaces.

Ruling out trivial readings. Without the range h<rh < rh<r, every spanning subspace would be "hhh-scattered" for h≥rh \ge rh≥r, and U=VU = VU=V of dimension rnrnrn would refute the goal. Without the spanning condition, U=0U = 0U=0 would satisfy the bound vacuously. Both conditions are part of the definition, and the goal is the inclusive disjunction for every hhh-scattered UUU.

Cited inputs. Result 4.6 is Delsarte's theorem [13], numbered in this paper and posed here with sorry. The case h=1h = 1h=1 of the goal is the Blokhuis–Lavrauw bound [4], which the paper cites without proof and says can be obtained by adapting its argument (Zullo's thesis [30]). It is not an item: a complete proof of the goal must cover it.

Infrastructure. A proof needs: dimension arithmetic for restriction of scalars in a tower; the rank–nullity theorem for Fq\mathbb F_qFq​-linear maps; the count of roots of a qqq-polynomial ∑jajxqj\sum_j a_j x^{q^j}∑j​aj​xqj, for Lemma 2.2; and a rank-metric Singleton bound. The Singleton bound and Lemma 2.2 are reusable beyond this mission. Contributions are welcome on any milestone, on the h=1h = 1h=1 case, and on the reduction for n<h+1n < h+1n<h+1.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, arXiv:1906.10590v2 (2020); Combinatorica 41 (2021). https://arxiv.org/abs/1906.10590v2
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geometriae Dedicata 81 (2000) 231–243. https://doi.org/10.1023/A:1005283806897
  • P. Delsarte, Bilinear forms over a finite field, with applications to coding theory, J. Combin. Theory Ser. A 25 (1978) 226–241. https://doi.org/10.1016/0097-3165(78)90015-8
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets, and their duality, Designs, Codes and Cryptography 88 (2020) 655–675. https://doi.org/10.1007/s10623-019-00703-z
6 thms1 active userReviewed
AlgebraComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Algebraic Approach to Promise Constraint Satisfaction 1: A Minion Homomorphism Pol(A₁, B₁) → Pol(A₂, B₂) Exists iff (A₂, B₂) Is pp-Constructible from (A₁, B₁)Research Paper

Motivation

A promise constraint satisfaction problem PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) is given by two finite relational structures with a homomorphism A→B\mathbf A\to\mathbf BA→B. An instance is a third structure I\mathbf II, and the task is to answer yes if I→A\mathbf I\to\mathbf AI→A and no if I↛B\mathbf I\not\to\mathbf BI→B; the promise is that one of the two holds. Approximate graph colouring (colour a kkk-colourable graph with c≥kc\ge kc≥k colours) and the search for a not-all-equal assignment of a 1-in-3-satisfiable formula are of this form, and their complexity has been open since the 1970s and 2010s respectively.

For ordinary CSPs (A=B\mathbf A=\mathbf BA=B) the algebraic approach, in which the complexity is governed by the polymorphisms of the template, led to the classification of all finite-template CSPs (Bulatov 2017, Zhuk 2017). Barto, Bulín, Krokhin and Opršal (arXiv:1811.00970, J. ACM 2021) extend that approach to promise problems. Their central structural result is Theorem 4.12: the existence of a minion homomorphism between polymorphism minions, which by their Theorem 3.1 yields a log-space reduction between the PCSPs, is characterized in five other ways, two of them purely relational.

Timeline:

  • 1998: Jeavons shows that polymorphisms determine the complexity of CSP(A)\mathrm{CSP}(\mathbf A)CSP(A), through a Galois correspondence between pp-definable relations and polymorphisms.
  • 2002: Pippenger develops the Galois correspondence for pairs of sets that underlies the promise setting.
  • 2016–2018: Brakensiek and Guruswami (arXiv:1704.01937) prove that Pol(A,B)⊆Pol(A′,B′)\mathrm{Pol}(\mathbf A,\mathbf B)\subseteq\mathrm{Pol}(\mathbf A',\mathbf B')Pol(A,B)⊆Pol(A′,B′) yields a reduction for templates over the same domains.
  • 2018: Barto, Opršal and Pinsker (arXiv:1510.04521) characterize pp-constructibility of CSP templates by minor-preserving maps of polymorphism clones.
  • 2019: the present paper defines minion homomorphisms between polymorphism minions of promise templates and proves Theorem 4.12.

Setting

A signature is a finite set τ\tauτ of relation symbols RRR with arities ar(R)≥1\mathrm{ar}(R)\ge1ar(R)≥1. A structure A\mathbf AA on a finite set AAA gives a relation RA⊆Aar(R)R^{\mathbf A}\subseteq A^{\mathrm{ar}(R)}RA⊆Aar(R) for each RRR; a homomorphism h:A→Bh:\mathbf A\to\mathbf Bh:A→B maps every tuple of RAR^{\mathbf A}RA into RBR^{\mathbf B}RB. A PCSP template is a pair (A,B)(\mathbf A,\mathbf B)(A,B) of structures with the same signature and A→B\mathbf A\to\mathbf BA→B.

An nnn-ary polymorphism f:An→Bf:A^n\to Bf:An→B, n≥1n\ge1n≥1, applied coordinatewise to any nnn tuples of RAR^{\mathbf A}RA, gives a tuple of RBR^{\mathbf B}RB. The minor of an mmm-ary ggg given by π:[m]→[n]\pi:[m]\to[n]π:[m]→[n] is f(x1,…,xn)=g(xπ(1),…,xπ(m))f(x_1,\dots,x_n)=g(x_{\pi(1)},\dots,x_{\pi(m)})f(x1​,…,xn​)=g(xπ(1)​,…,xπ(m)​). A minion is a nonempty set of functions of positive arity closed under minors; Pol(A,B)\mathrm{Pol}(\mathbf A,\mathbf B)Pol(A,B) is one. A minion homomorphism ξ:M→N\xi:\mathcal M\to\mathcal Nξ:M→N preserves arities and satisfies ξ(g(xπ(1),…,xπ(m)))=ξ(g)(xπ(1),…,xπ(m))\xi(g(x_{\pi(1)},\dots,x_{\pi(m)}))=\xi(g)(x_{\pi(1)},\dots,x_{\pi(m)})ξ(g(xπ(1)​,…,xπ(m)​))=ξ(g)(xπ(1)​,…,xπ(m)​).

A bipartite minor condition is a finite set of identities f(x1,…,xn)≈g(xπ(1),…,xπ(m))f(x_1,\dots,x_n)\approx g(x_{\pi(1)},\dots,x_{\pi(m)})f(x1​,…,xn​)≈g(xπ(1)​,…,xπ(m)​) between symbols from two disjoint sets; a minion satisfies it if the symbols can be assigned members of matching arity that make every identity true. For a structure A\mathbf AA with A={a1,…,an}A=\{a_1,\dots,a_n\}A={a1​,…,an​} and an instance I\mathbf II, the condition Σ(A,I)\Sigma(\mathbf A,\mathbf I)Σ(A,I) has an nnn-ary symbol fvf_vfv​ per element vvv of I\mathbf II, an ∣RA∣|R^{\mathbf A}|∣RA∣-ary symbol gCg_CgC​ per constraint CCC, and one identity per position of each constraint, read off the list of tuples of RAR^{\mathbf A}RA. The free structure FM(A)F_{\mathcal M}(\mathbf A)FM​(A) has universe M(n)\mathcal M^{(n)}M(n), and a tuple (f1,…,fk)(f_1,\dots,f_k)(f1​,…,fk​) lies in its relation RRR when all fif_ifi​ are minors of one ∣RA∣|R^{\mathbf A}|∣RA∣-ary member of M\mathcal MM in the pattern given by RAR^{\mathbf A}RA.

A pp-power (A′,B′)(\mathbf A',\mathbf B')(A′,B′) of (A,B)(\mathbf A,\mathbf B)(A,B) lives on ANA^NAN, BNB^NBN, each relation being defined in A\mathbf AA and in B\mathbf BB by one and the same primitive positive formula. A homomorphic relaxation (A′,B′)(\mathbf A',\mathbf B')(A′,B′) of (A,B)(\mathbf A,\mathbf B)(A,B) has homomorphisms A′→A\mathbf A'\to\mathbf AA′→A and B→B′\mathbf B\to\mathbf B'B→B′. pp-constructibility is the closure under finitely many such steps.

Formalization targets

Goal: Theorem 4.12

For PCSP templates (Ai,Bi)(\mathbf A_i,\mathbf B_i)(Ai​,Bi​) of finite structures and Mi=Pol(Ai,Bi)\mathcal M_i=\mathrm{Pol}(\mathbf A_i,\mathbf B_i)Mi​=Pol(Ai​,Bi​), the following are equivalent:

(1) ∃ ξ:M1→M2(4) FM1(A2)→B2(2) M1⊨Σ⇒M2⊨Σ for every bipartite Σ(5) (A2,B2) relaxes a pp-power of (A1,B1)(3) M2⊨Σ(A2,FM1(A2))(6) (A2,B2) is pp-constructible from (A1,B1).\begin{aligned} &(1)\ \exists\,\xi:\mathcal M_1\to\mathcal M_2 &&(4)\ F_{\mathcal M_1}(\mathbf A_2)\to\mathbf B_2\\ &(2)\ \mathcal M_1\models\Sigma\Rightarrow\mathcal M_2\models\Sigma\text{ for every bipartite }\Sigma &&(5)\ (\mathbf A_2,\mathbf B_2)\text{ relaxes a pp-power of }(\mathbf A_1,\mathbf B_1)\\ &(3)\ \mathcal M_2\models\Sigma(\mathbf A_2,F_{\mathcal M_1}(\mathbf A_2)) &&(6)\ (\mathbf A_2,\mathbf B_2)\text{ is pp-constructible from }(\mathbf A_1,\mathbf B_1). \end{aligned}​(1) ∃ξ:M1​→M2​(2) M1​⊨Σ⇒M2​⊨Σ for every bipartite Σ(3) M2​⊨Σ(A2​,FM1​​(A2​))​​(4) FM1​​(A2​)→B2​(5) (A2​,B2​) relaxes a pp-power of (A1​,B1​)(6) (A2​,B2​) is pp-constructible from (A1​,B1​).​

Milestones

In the order of the proof on p. 27: Lemma 4.8 (relaxations and pp-powers give minion homomorphisms) and Corollary 4.10 for (6) ⇒ (1); Lemma 4.3 (M⊨Σ(A,FM(A))\mathcal M\models\Sigma(\mathbf A,F_{\mathcal M}(\mathbf A))M⊨Σ(A,FM​(A))) for (2) ⇒ (3); Lemma 3.14 for (3) ⇒ (4); Lemma 4.11 ((A2,FM1(A2))(\mathbf A_2,F_{\mathcal M_1}(\mathbf A_2))(A2​,FM1​​(A2​)) relaxes a pp-power of (A1,B1)(\mathbf A_1,\mathbf B_1)(A1​,B1​)) for (4) ⇒ (5). Lemma 4.4, the bijection between homomorphisms FM(A)→BF_{\mathcal M}(\mathbf A)\to\mathbf BFM​(A)→B and minion homomorphisms M→Pol(A,B)\mathcal M\to\mathrm{Pol}(\mathbf A,\mathbf B)M→Pol(A,B), is included as an extra item.

Significance

Theorem 4.12 replaces a property of infinitely many functions, the existence of a minion homomorphism, by a homomorphism between two finite structures (item 4), which is decidable, and by a relational construction (items 5–6). The free-structure criterion is what bounds the arity of polymorphisms that a hardness proof must inspect, and the paper uses it to prove NP-hardness of PCSP(Kk,K2k−1)\mathrm{PCSP}(\mathbf K_k,\mathbf K_{2k-1})PCSP(Kk​,K2k−1​) and to analyse the 1-in-3 versus not-all-equal problem. Later work on approximate graph and hypergraph colouring states its reductions in these terms.

The result is proved in the paper. As far as is known it has not been machine-checked: Mathlib has no minions, minor conditions, pp-formulas or pp-constructions. The mission produces a reusable Lean vocabulary for the algebraic theory of promise CSPs, together with a formal proof of the equivalence. The complexity consequences are not formalized.

Difficulty

Four of the implications are short once the definitions are fixed. The substantial step is (4) ⇒ (5), Lemma 4.11: a statement about the polymorphism minion, an object defined by infinitely many conditions, must be turned into a finite relational construction, and the relations of the pp-power have to be defined by one formula that is correct in A1\mathbf A_1A1​ and in B1\mathbf B_1B1​ at the same time. The indices involved, tuples over a power of A1A_1A1​, coordinates indexed by A2A_2A2​, and the enumeration of each RA2R^{\mathbf A_2}RA2​, are where an informal reading leaves the most to check. Lemma 4.8(2) needs that polymorphisms preserve every pp-definable relation, a statement about arbitrary formulas, not only about the relations of the template. Corollary 4.10 is an induction over a sequence of templates whose signatures and domains change from step to step, which a formal statement cannot treat as a sequence in one fixed type.

Formalization scope

Structures, homomorphisms, templates and polymorphisms are the published PCSPBLPAff.Symmetric definitions (RelStruct, IsHom, IsPromiseTemplate, IsPolymorphism). All structures are finite with nonempty domains: domains carry Fintype, DecidableEq and Nonempty (nonemptiness is the field's standing convention, which the paper uses when it identifies a domain with [n][n][n]; without it items (4) and (5) of the goal are not equivalent). The goal and Lemma 4.11 also assume that every relation of A2\mathbf A_2A2​ is nonempty; the paper does not say so, but if RA2=∅R^{\mathbf A_2}=\emptysetRA2​=∅ then RFM1(A2)=∅R^{F_{\mathcal M_1}(\mathbf A_2)}=\emptysetRFM1​​(A2​)=∅, and when B1\mathbf B_1B1​ has an element on which every relation holds constantly no pp-power can have an empty relation, so (4) ⇒ (5) fails, signatures are Fintype, arities are positive, minions in Lemmas 4.3–4.4 live on finite sets. Theorem 4.12 is stated only for finite templates, as in the paper (p. 46 notes that it fails for infinite ones). Minions have no nullary members. A minion homomorphism is a family of maps on the members M(n)→N(n)\mathcal M^{(n)}\to\mathcal N^{(n)}M(n)→N(n), so it cannot be made trivial by values outside the minion. Bipartite minor conditions have finite symbol and identity types in Type; item (2) quantifies over all of them. Σ(A,I)\Sigma(\mathbf A,\mathbf I)Σ(A,I) and FM(A)F_{\mathcal M}(\mathbf A)FM​(A) take the enumeration of AAA and of each RAR^{\mathbf A}RA as explicit equivalences; the paper's identification A=[n]A=[n]A=[n] is one such choice. A pp-power uses one formula for both structures, with free variables indexed by [k]×[N][k]\times[N][k]×[N]. Templates are bundled for pp-constructibility, which is an inductive predicate.

The goal is the six-way equivalence (List.TFAE) and not any of its trivial fragments; the goal cannot be closed by choosing degenerate enumerations, because every statement quantifies over all of them.

Not formalized: the log-space reductions of Theorems 3.1 and 3.12, Remark 3.11's reduction between promise minor-condition problems, and the cited Theorem 2.25 [Pip02, BG16b]. Contributions are welcome on general facts that are reusable beyond this mission: polymorphisms preserve pp-definable relations, composition of minion homomorphisms, and the natural minion homomorphism M→Pol(A,FM(A))\mathcal M\to\mathrm{Pol}(\mathbf A,F_{\mathcal M}(\mathbf A))M→Pol(A,FM​(A)).

Selected references

  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, J. ACM 68(4), 2021; arXiv:1811.00970v3. https://arxiv.org/abs/1811.00970
  • L. Barto, J. Opršal, M. Pinsker, The wonderland of reflections, Israel J. Math. 223, 2018. https://arxiv.org/abs/1510.04521
  • J. Brakensiek, V. Guruswami, Promise constraint satisfaction: structure theory and a symmetric Boolean dichotomy, SODA 2018. https://arxiv.org/abs/1704.01937
  • N. Pippenger, Galois theory for minors of finite functions, Discrete Math. 254, 2002. https://doi.org/10.1016/S0012-365X(01)00297-7
  • P. Jeavons, On the algebraic structure of combinatorial problems, Theoret. Comput. Sci. 200, 1998. https://doi.org/10.1016/S0304-3975(97)00230-2
11 thms1 active userReviewed
Complexity TheoryGraph TheoryTheoretical Computer Science·Captain: mikedeng1

Algebraic Approach to Promise Constraint Satisfaction 2: Pol(K_k, K_{2k−1}) Has No Olšák Function, So It Maps by a Minion Homomorphism to Pol(H₂, H_K)Research Paper

Approximate graph colouring

Given a graph that is promised to be kkk-colourable, how many colours are needed to find a proper colouring in polynomial time? The decision version asks to distinguish kkk-colourable graphs from graphs that are not even ccc-colourable. It has been studied since Garey and Johnson (1976) and is conjectured to be NP-hard for all fixed 3≤k≤c3 \le k \le c3≤k≤c. This is the approximate graph colouring problem, and it is one of the motivating examples of promise constraint satisfaction problems (PCSPs).

Timeline of the NP-hardness results without extra assumptions, as surveyed in Example 2.9 and §6.2 of the paper:

  • 2000–2004, Khanna–Linial–Safra and Guruswami–Khanna: 3 versus 4 colours.
  • 2013, Huang (cited as [Hua13] in the paper): kkk versus 2Ω(k1/3)2^{\Omega(k^{1/3})}2Ω(k1/3) colours for large kkk.
  • 2016, Brakensiek–Guruswami: kkk versus 2k−22k - 22k−2 colours for every k≥3k \ge 3k≥3, via polymorphisms.
  • 2018/2019, Barto–Bulín–Krokhin–Opršal (this paper): kkk versus 2k−12k - 12k−1 colours for every k≥3k \ge 3k≥3, in particular 3 versus 5. The argument is an instance of a general algebraic theory of PCSPs.

The method also applies to the question of 5-cycle versus 3-colouring, which Brakensiek and Guruswami had raised as an open case.

Setting

A relational structure A\mathbf AA consists of a finite domain AAA and relations RA⊆Aar(R)R^{\mathbf A} \subseteq A^{\mathrm{ar}(R)}RA⊆Aar(R), one for each symbol RRR of a signature. A PCSP template is a pair (A,B)(\mathbf A, \mathbf B)(A,B) of structures with the same signature and a homomorphism A→B\mathbf A \to \mathbf BA→B. Write Ek={0,…,k−1}E_k = \{0, \dots, k-1\}Ek​={0,…,k−1}.

  • Kk=(Ek;≠k)\mathbf K_k = (E_k; \neq_k)Kk​=(Ek​;=k​) is the complete graph: one binary relation {(a,b)∣a≠b}\{(a, b) \mid a \ne b\}{(a,b)∣a=b}.
  • Hk=(Ek;NAEk)\mathbf H_k = (E_k; \mathrm{NAE}_k)Hk​=(Ek​;NAEk​) carries the ternary not-all-equal relation Ek3∖{(a,a,a)}E_k^3 \setminus \{(a, a, a)\}Ek3​∖{(a,a,a)}; PCSP(Hk,Hc)\mathrm{PCSP}(\mathbf H_k, \mathbf H_c)PCSP(Hk​,Hc​) is approximate colouring of 3-uniform hypergraphs.

An nnn-ary polymorphism from A\mathbf AA to B\mathbf BB is a map f:An→Bf : A^n \to Bf:An→B that, applied coordinatewise to any nnn tuples of RAR^{\mathbf A}RA, returns a tuple of RBR^{\mathbf B}RB. For Kk\mathbf K_kKk​ and Kc\mathbf K_cKc​ these are exactly the ccc-colourings of the power Kkn\mathbf K_k^nKkn​. The set Pol(A,B)\mathrm{Pol}(\mathbf A, \mathbf B)Pol(A,B) of polymorphisms of all arities n≥1n \ge 1n≥1 is closed under minors: f(x1,…,xn)=g(xπ(1),…,xπ(m))f(x_1, \dots, x_n) = g(x_{\pi(1)}, \dots, x_{\pi(m)})f(x1​,…,xn​)=g(xπ(1)​,…,xπ(m)​) for π:[m]→[n]\pi : [m] \to [n]π:[m]→[n]. A minion is any nonempty set of functions of arities n≥1n \ge 1n≥1 that is closed under minors. A minion homomorphism ξ:M→N\xi : \mathscr M \to \mathscr Nξ:M→N preserves arities and commutes with minors. Write HK=Pol(H2,HK)\mathscr H_K = \mathrm{Pol}(\mathbf H_2, \mathbf H_K)HK​=Pol(H2​,HK​).

An Olšák function is a 6-ary function ooo with

o(x,x,y,y,y,x)=o(x,y,x,y,x,y)=o(y,x,x,x,y,y)for all x,y.o(x, x, y, y, y, x) = o(x, y, x, y, x, y) = o(y, x, x, x, y, y) \quad \text{for all } x, y .o(x,x,y,y,y,x)=o(x,y,x,y,x,y)=o(y,x,x,x,y,y)for all x,y.

The free structure FM(A)\mathbf F_{\mathscr M}(\mathbf A)FM​(A) has the ∣A∣|A|∣A∣-ary members of M\mathscr MM as its domain and relations defined by minor identities that follow the tuples of A\mathbf AA.

Formalization targets

Goal: the algebraic core of Theorem 6.5

For every k≥3k \ge 3k≥3,

∃ K≥2:there is a minion homomorphism Pol(Kk,K2k−1)→Pol(H2,HK).\exists\, K \ge 2:\quad \text{there is a minion homomorphism } \mathrm{Pol}(\mathbf K_k, \mathbf K_{2k-1}) \to \mathrm{Pol}(\mathbf H_2, \mathbf H_K).∃K≥2:there is a minion homomorphism Pol(Kk​,K2k−1​)→Pol(H2​,HK​).

KKK is left unspecified, as in the paper. This is the statement from which the paper deduces that kkk versus 2k−12k - 12k−1 colouring is NP-hard.

Milestones

  1. Example 3.5: the Olšák minor condition is not satisfied in Hk\mathscr H_kHk​ for any k≥2k \ge 2k≥2.
  2. Lemma 4.4: homomorphisms FM(A)→B\mathbf F_{\mathscr M}(\mathbf A) \to \mathbf BFM​(A)→B correspond one-to-one to minion homomorphisms M→Pol(A,B)\mathscr M \to \mathrm{Pol}(\mathbf A, \mathbf B)M→Pol(A,B).
  3. Theorem 6.2: for a minion M\mathscr MM on finite sets,
(∃K≥2, ∃ minion homomorphism M→HK)  ⟺  M contains no Olsˇaˊk function.\bigl(\exists K \ge 2,\ \exists\ \text{minion homomorphism } \mathscr M \to \mathscr H_K\bigr) \iff \mathscr M \text{ contains no Olšák function}.(∃K≥2, ∃ minion homomorphism M→HK​)⟺M contains no Olsˇaˊk function.
  1. Lemma 6.4: Pol(Kk,K2k−1)\mathrm{Pol}(\mathbf K_k, \mathbf K_{2k-1})Pol(Kk​,K2k−1​) contains no Olšák function, k≥3k \ge 3k≥3.

One further item, not a milestone, shows the bound is sharp. Proposition 10.1 says that Pol(Kk,K2k)\mathrm{Pol}(\mathbf K_k, \mathbf K_{2k})Pol(Kk​,K2k​) contains an Olšák function.

Significance

Theorem 6.2 is a criterion stated entirely inside the minion. Together with the reduction theory of the paper (a minion homomorphism Pol(A,B)→Pol(A′,B′)\mathrm{Pol}(\mathbf A, \mathbf B) \to \mathrm{Pol}(\mathbf A', \mathbf B')Pol(A,B)→Pol(A′,B′) gives a log-space reduction from PCSP(A′,B′)\mathrm{PCSP}(\mathbf A', \mathbf B')PCSP(A′,B′) to PCSP(A,B)\mathrm{PCSP}(\mathbf A, \mathbf B)PCSP(A,B)) and the NP-hardness of approximate hypergraph colouring (Dinur, Regev and Smyth 2005), it shows that every finite template without an Olšák polymorphism has an NP-hard PCSP (Corollary 6.3). Lemma 6.4 then settles the 3 versus 5 colouring case and improves the 2k−22k - 22k−2 bound to 2k−12k - 12k−1 for every k≥3k \ge 3k≥3. Proposition 10.1 shows that this criterion cannot go beyond 2k−12k - 12k−1.

The results are proved in the paper. None of them has a machine-checked proof that this mission knows of. This mission produces a Lean statement of the minion side of the argument. That includes the free-structure correspondence (Lemma 4.4), which every later application of the theory uses, and Theorem 6.2 for arbitrary finite minions. A finished formalization would include the clique argument behind Lemma 6.4 and would check the key hardness inequality c≥2k−1c \ge 2k - 1c≥2k−1 of the paper by machine.

Difficulty

Lemma 6.4 is a statement about every (2k−1)(2k-1)(2k−1)-colouring of Kk6\mathbf K_k^6Kk6​ that is constant on certain triples of vertices. The power graph has k6k^6k6 vertices, so exhaustive search is out of reach for general kkk, and case checks for k=3k = 3k=3 do not give the general claim. Showing that 2k−12k - 12k−1 colours do not suffice requires an explicit obstruction, uniform in kkk, in the graph obtained by identifying those triples; the identification creates edges that are not present in Kk6\mathbf K_k^6Kk6​, and keeping track of them is the combinatorial core. The bound is tight (Proposition 10.1), so no argument that would also apply to 2k2k2k colours can work.

In Theorem 6.2 the direction from "no Olšák function" to a minion homomorphism must build a minion homomorphism into HK\mathscr H_KHK​ out of nothing but the absence of a single identity. That direction depends on Lemma 4.4, which relates maps defined on functions of a single arity to minion homomorphisms defined on all arities; in Lean the bookkeeping of enumerations, minors and dependent arities is substantial.

Formalization scope

The development reuses the published relational-structure layer PCSPBLPAff_Symmetric_Setting (RelStruct, IsHom, IsPolymorphism, IsPromiseTemplate). Domains EkE_kEk​ are Fin k. Kk\mathbf K_kKk​ and Hk\mathbf H_kHk​ have one-symbol signatures of arity 2 and 3. Polymorphisms apply fff to the columns of an n×ar(R)n \times \mathrm{ar}(R)n×ar(R) matrix whose rows lie in RAR^{\mathbf A}RA, which is the paper's matrix transposed. A minion is a family mem n of nnn-ary functions (Fin n → A) → B with no nullary members, nonempty and closed under the minors fun x => g (x ∘ π). A minion homomorphism is a family of maps that preserves membership and minors on members, with unconstrained values outside the minion, so Lemma 4.4's "one-to-one" is stated up to agreement on the minion. Theorem 6.2 assumes the minion's sets are finite, which is the paper's standing convention (Definition 2.20). The free structure takes an enumeration e:Fin n≃Ae : \mathrm{Fin}\ n \simeq Ae:Fin n≃A of the generating domain and quantifies the enumeration of each relation existentially. In the goal, k≥3k \ge 3k≥3 makes 2k−12k - 12k−1 free of natural-number truncation.

The codomain of the goal is exactly Pol(H2,HK)\mathrm{Pol}(\mathbf H_2, \mathbf H_K)Pol(H2​,HK​) with K≥2K \ge 2K≥2. A minion homomorphism into an arbitrary or existentially chosen minion, or into HK\mathscr H_KHK​ with K≤1K \le 1K≤1, would be trivial and is ruled out by the statement.

Not formalized. The NP-hardness conclusions of Theorem 6.5 and Corollary 6.3 are left out, and so are the log-space reduction of Theorem 3.1 and the cited hardness of approximate hypergraph colouring (Theorem 5.23, [DRS05]). There is no complexity-theoretic substrate in Mathlib for them. Lemma 6.6 (Pol(C5,K3)\mathrm{Pol}(\mathbf C_5, \mathbf K_3)Pol(C5​,K3​)) is a natural follow-up item. Contributions are welcome on every milestone. Lemma 4.4 and the minion layer can be reused beyond this mission, for any minion-homomorphism argument in the PCSP literature.

Selected references

  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, arXiv:1811.00970v3, 2019; J. ACM 68(4), 2021. https://arxiv.org/abs/1811.00970v3
  • J. Brakensiek, V. Guruswami, New hardness results for graph and hypergraph colorings, CCC 2016. https://doi.org/10.4230/LIPIcs.CCC.2016.14
  • I. Dinur, O. Regev, C. Smyth, The hardness of 3-uniform hypergraph coloring, Combinatorica 25(5), 2005. https://doi.org/10.1007/s00493-005-0032-4
  • M. Olšák, The weakest nontrivial idempotent equations, Bull. London Math. Soc. 49(6), 2017. https://doi.org/10.1112/blms.12097
  • S. Khanna, N. Linial, S. Safra, On the hardness of approximating the chromatic number, Combinatorica 20(3), 2000. https://doi.org/10.1007/s004930070013
9 thms1 active userReviewed
AlgebraComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Algebraic Approach to Promise Constraint Satisfaction 4: No Finite D with 1-in-3 → D → NAE Has a Cyclic Polymorphism of Prime Arity p > 60|D|Research Paper

Motivation

A promise constraint satisfaction problem (PCSP) is given by a pair of relational structures (A,B)(\mathbf A,\mathbf B)(A,B) with a homomorphism A→B\mathbf A\to\mathbf BA→B: an instance is promised to be satisfiable in A\mathbf AA, and it suffices to satisfy it in B\mathbf BB. The paper of Barto, Bulín, Krokhin and Opršal (arXiv:1811.00970v3) develops the algebraic theory of PCSPs, in which the complexity of PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) is governed by its polymorphisms.

The most prominent example is 1-in-3 versus Not-All-Equal-SAT: given a system of ternary constraints that has an assignment making exactly one variable in each constraint true, find an assignment making the variables in each constraint not all equal. Brakensiek and Guruswami (arXiv:1704.01937) showed that this problem is solvable in polynomial time, although both 1-in-3-SAT and NAE-SAT are NP-complete on their own. Their algorithm, like every tractability result for PCSPs known when the paper was written, works by finding a tractable CSP template C\mathbf CC with T→C→H2\mathbf T\to\mathbf C\to\mathbf H_2T→C→H2​ (a "sandwich") and solving the CSP over C\mathbf CC. For 1-in-3 vs NAE the template used is infinite: the integers with the relation x+y+z=1x+y+z=1x+y+z=1.

Section 8 of the paper shows that this is unavoidable: no finite tractable template can be sandwiched, or more generally pp-constructed, in this way. This separates PCSPs from CSPs: infinite domains are necessary in the sandwich method.

Timeline: Feder and Vardi conjectured the CSP dichotomy (1998); Barto and Kozik characterised the borderline by cyclic polymorphisms (BK12, 2012); Bulatov and Zhuk proved the dichotomy (arXiv:1703.03021, arXiv:1704.01914, 2017); Brakensiek and Guruswami proved 1-in-3 vs NAE tractable (2018); Barto, Bulín, Krokhin and Opršal proved Theorem 8.1 (2019).

Setting

All structures here have one ternary relation. For a set DDD and R⊆D3R\subseteq D^3R⊆D3, (D;R)(D;R)(D;R) is the structure with domain DDD and relation RRR. The 1-in-3 structure is T=({0,1};{(1,0,0),(0,1,0),(0,0,1)})\mathbf T=(\{0,1\};\{(1,0,0),(0,1,0),(0,0,1)\})T=({0,1};{(1,0,0),(0,1,0),(0,0,1)}) and the not-all-equal structure is H2=({0,1};{0,1}3∖{(0,0,0),(1,1,1)})\mathbf H_2=(\{0,1\};\{0,1\}^3\setminus\{(0,0,0),(1,1,1)\})H2​=({0,1};{0,1}3∖{(0,0,0),(1,1,1)}).

A homomorphism h:(A;RA)→(B;RB)h:(A;R_A)\to(B;R_B)h:(A;RA​)→(B;RB​) is a map with (h(a),h(b),h(c))∈RB(h(a),h(b),h(c))\in R_B(h(a),h(b),h(c))∈RB​ whenever (a,b,c)∈RA(a,b,c)\in R_A(a,b,c)∈RA​. A polymorphism of (D;R)(D;R)(D;R) of arity ppp is a map s:Dp→Ds:D^p\to Ds:Dp→D such that, applied coordinatewise to any ppp triples from RRR, it yields a triple in RRR. An operation s:Dp→Ds:D^p\to Ds:Dp→D is cyclic if s(a1,a2,…,ap)=s(a2,…,ap,a1)s(a_1,a_2,\dots,a_p)=s(a_2,\dots,a_p,a_1)s(a1​,a2​,…,ap​)=s(a2​,…,ap​,a1​) for all a∈Dpa\in D^pa∈Dp (Definition 8.2).

The proof of Theorem 8.1 works in the following situation: DDD is finite, f:T→(D;R)f:\mathbf T\to(D;R)f:T→(D;R) and g:(D;R)→H2g:(D;R)\to\mathbf H_2g:(D;R)→H2​ are homomorphisms, p>60∣D∣p>60|D|p>60∣D∣ is a prime and sss is a cyclic polymorphism of (D;R)(D;R)(D;R) of arity ppp. From sss it builds the p2p^2p2-ary operation

t(X)=s(s(x11,…,xp1),…,s(x1p,…,xpp))t(X)=s\big(s(x_{11},\dots,x_{p1}),\dots,s(x_{1p},\dots,x_{pp})\big)t(X)=s(s(x11​,…,xp1​),…,s(x1p​,…,xpp​))

on p×pp\times pp×p matrices X=(xij)X=(x_{ij})X=(xij​), and studies zero-one matrices, evaluated in DDD through fff: their area λ(X)\lambda(X)λ(X) (the fraction of ones), ggg-equivalence X∼Y  ⟺  g(t(X))=g(t(Y))X\sim Y\iff g(t(X))=g(t(Y))X∼Y⟺g(t(X))=g(t(Y)), tameness (X∼0p×pX\sim 0_{p\times p}X∼0p×p​ with λ(X)<1/3\lambda(X)<1/3λ(X)<1/3, or X∼1p×pX\sim 1_{p\times p}X∼1p×p​ with λ(X)>1/3\lambda(X)>1/3λ(X)>1/3), covers (three matrices with exactly one 111 in each position), the line segments ⟨i⟩\langle i\rangle⟨i⟩ (ones in the first iii positions in row-major order), and almost rectangles [k,…,k,l,…,l][k,\dots,k,l,\dots,l][k,…,k,l,…,l] (columns of heights kkk then lll, with step 0≤k−l≤5∣D∣0\le k-l\le 5|D|0≤k−l≤5∣D∣).

Formalization targets

Goal: the algebraic core of Theorem 8.1

T→f(D;R)→gH2,  D finite,  p prime, p>60∣D∣ ⟹ (D;R) has no cyclic polymorphism of arity p.\mathbf T\xrightarrow{f}(D;R)\xrightarrow{g}\mathbf H_2,\ \ D\text{ finite},\ \ p\text{ prime},\ p>60|D|\ \Longrightarrow\ (D;R)\text{ has no cyclic polymorphism of arity }p.Tf​(D;R)g​H2​,  D finite,  p prime, p>60∣D∣ ⟹ (D;R) has no cyclic polymorphism of arity p.

Milestones, in proof order

  1. Lemma 8.7: the three matrices of a cover are not all ggg-equivalent.
  2. Lemma 8.8: ttt is cyclic in its p2p^2p2 row-major arguments.
  3. Lemma 8.9: with p2=3q+1p^2=3q+1p2=3q+1, ⟨0⟩∼⋯∼⟨q⟩≁⟨q+1⟩∼⋯∼⟨2q+1⟩\langle 0\rangle\sim\cdots\sim\langle q\rangle\not\sim\langle q+1\rangle\sim\cdots\sim\langle 2q+1\rangle⟨0⟩∼⋯∼⟨q⟩∼⟨q+1⟩∼⋯∼⟨2q+1⟩.
  4. Lemma 8.10: every ⟨i⟩\langle i\rangle⟨i⟩, 0≤i≤p20\le i\le p^20≤i≤p2, is tame, and 0p×p≁1p×p0_{p\times p}\not\sim 1_{p\times p}0p×p​∼1p×p​.
  5. Proposition 8.12: every almost rectangle is tame.
  6. §8.4: there are l1<l2l_1<l_2l1​<l2​ in (p/3−2∣D∣, p/3)(p/3-2|D|,\,p/3)(p/3−2∣D∣,p/3) with s(1l10p−l1)=s(1l20p−l2)s(1^{l_1}0^{p-l_1})=s(1^{l_2}0^{p-l_2})s(1l1​0p−l1​)=s(1l2​0p−l2​).

Significance

Combined with the theorem of Barto and Kozik (a finite CSP template whose CSP is not NP-complete has cyclic polymorphisms of every prime arity p>∣D∣p>|D|p>∣D∣) and with the paper's Theorem 4.12, the core yields Theorem 8.1: if (T,H2)(\mathbf T,\mathbf H_2)(T,H2​) is pp-constructible from a finite D\mathbf DD, then CSP(D)\mathrm{CSP}(\mathbf D)CSP(D) is NP-complete. Hence the polynomial-time algorithm for 1-in-3 vs NAE cannot come from any finite tractable CSP, and the infinite template of Brakensiek and Guruswami is necessary. It is a concrete separation between PCSPs and CSPs: a tractable PCSP that is not explained by any finite tractable CSP.

The theorem is proved in the paper; nothing in this section has a machine-checked proof. The mission produces a formal proof of the combinatorial core, a reusable definition of cyclic operations on top of the platform's polymorphism library, and the matrix calculus of §8 (areas, covers, ttt), which is the part of the argument where index conventions are easiest to get wrong.

Difficulty

Polymorphisms of (D;R)(D;R)(D;R) are not determined by their values on zero-one inputs, and nothing beyond cyclicity is known about sss. The obvious attempt, to show directly that sss restricted to {f(0),f(1)}\{f(0),f(1)\}{f(0),f(1)} depends only on the number of ones, fails: this property does not follow from cyclicity (Remark 8.15 asks whether polymorphisms of that kind always exist, and it is open). The only information available about sss is the coarse two-valued invariant g(t(⋅))g(t(\cdot))g(t(⋅)) on zero-one matrices, and the contradiction has to be produced from that invariant alone, uniformly over all finite DDD; the margin p>60∣D∣p>60|D|p>60∣D∣ is what keeps the areas involved away from 1/31/31/3.

Formalization scope

Structures are instances of the published PCSPBLPAff.Symmetric.RelStruct with the single-symbol signature Unit of arity 333; homomorphisms and polymorphisms are the published IsHom and IsPolymorphism. The domain {0,1}\{0,1\}{0,1} is Fin 2; DDD is a Fintype with decidable equality. Matrices are functions Fin p → Fin p → Fin 2, row index first; the p2p^2p2 arguments of ttt are read row-major via finProdFinEquiv; areas are rationals. Cyclicity is s a = s (a ∘ finRotate p), the paper's (a2,…,ap,a1)(a_2,\dots,a_p,a_1)(a2​,…,ap​,a1​). The paper renames DDD so that f(0)=0f(0)=0f(0)=0, f(1)=1f(1)=1f(1)=1; the formalization keeps fff and evaluates zero-one matrices through it. Definition 8.11 prints column heights 1≤ki≤p1\le k_i\le p1≤ki​≤p, but its proofs use height 000, so heights range over 0≤ki≤p0\le k_i\le p0≤ki​≤p.

Lemmas 8.7–8.10 are stated with only the hypotheses their proofs use (Lemma 8.8 needs only cyclicity; Lemmas 8.9–8.10 need p>3p>3p>3 prime rather than p>60∣D∣p>60|D|p>60∣D∣). Lemmas 8.13 and 8.14 concern a minimal counterexample inside the proof of Proposition 8.12 and are not separate items.

Left out: the NP-completeness conclusion of Theorem 8.1; the reduction from pp-constructibility to a homomorphic relaxation (Theorem 4.12, mission 1 of this series); the fact that a pp-power of a finite tractable CSP template is a finite tractable CSP template; and the cited Theorem 8.3 [BK12], which is never assumed or stated.

The goal ends in False, so it would be trivial if its hypotheses were contradictory for a reason unrelated to sss. They are not: D={0,1}D=\{0,1\}D={0,1}, RRR the 1-in-3 relation, f=g=idf=g=\mathrm{id}f=g=id satisfies every hypothesis except the existence of sss. No restriction is placed on sss beyond being a cyclic polymorphism; assuming idempotence or dependence on counts only would assume away the content (Remark 8.15).

Contributions welcome: proofs of the milestones, a general library of cyclic operations and their compositions, and a formalization of Theorem 8.3 or of the pp-power step, which would turn the core into Theorem 8.1 itself.

Selected references

  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, arXiv:1811.00970v3, 2019; J. ACM 68(4), 2021. https://arxiv.org/abs/1811.00970
  • L. Barto, M. Kozik, Absorbing subalgebras, cyclic terms, and the constraint satisfaction problem, Logical Methods in Computer Science 8(1:07), 2012. https://doi.org/10.2168/LMCS-8(1:7)2012
  • J. Brakensiek, V. Guruswami, Promise constraint satisfaction: structure theory and a symmetric Boolean dichotomy, SODA 2018. https://arxiv.org/abs/1704.01937
  • A. Bulatov, A dichotomy theorem for nonuniform CSPs, FOCS 2017. https://arxiv.org/abs/1703.03021
  • D. Zhuk, A proof of the CSP dichotomy conjecture, FOCS 2017; J. ACM 67(5), 2020. https://arxiv.org/abs/1704.01914
10 thms1 active userReviewed
AlgebraDiscrete Geometry·Captain: mikedeng1

Maximum Scattered Linear Sets and Complete Caps in Galois Spaces 2: For q = 2^t, t Even, and n ≥ 4 Even, AG(n, q) Has a Complete Cap of Size 2√(q^(n−1))Research Paper

Small complete caps in Galois spaces

A cap in an affine or projective space over a finite field is a set of points no three of which are collinear; a cap is complete when it is maximal with respect to inclusion, so that every point outside it lies on a line through two of its points. Caps are closely connected with error-correcting codes: projective caps can serve as parity-check columns for linear codes with minimum distance at least 4. Constructing small complete caps explicitly is a long-standing question in finite geometry; Giulietti's survey collects the known families.

Counting the lines through pairs of points gives the trivial lower bound

2⋅qn−1(1)\sqrt{2} \cdot \sqrt{q^{n-1}} \qquad (1)2​⋅qn−1​(1)

for the size of a complete cap in a Galois space of dimension nnn and order qqq. A short timeline:

  • Segre (1959) constructed complete caps of size 3q+23q + 23q+2 in PG(3,q)PG(3, q)PG(3,q), qqq even.
  • Pambianco and Storme (1996) generalized this to complete caps of size 2qs2q^s2qs in AG(2s+1,q)AG(2s+1, q)AG(2s+1,q), qqq even: bound (1) is sharp up to a constant in odd dimension, for even qqq.
  • Giulietti (2007) studied translation caps in AG(r,2t)AG(r, 2^t)AG(r,2t) and the doubling construction, which turns a translation cap of the largest possible size into a complete cap one dimension higher.
  • Bartoli, Giulietti, Marino and Polverino (arXiv 2015, Combinatorica 2017) proved that (1) is sharp up to a constant also in even dimension n≥4n \ge 4n≥4, when qqq is an even square. This mission formalizes that result.

Setting

Let q=2tq = 2^tq=2t and let Fq\mathbb F_qFq​ be the field with qqq elements. The affine space AG(r,q)AG(r, q)AG(r,q) has as points the vectors (a1,…,ar)∈Fqr(a_1, \dots, a_r) \in \mathbb F_q^r(a1​,…,ar​)∈Fqr​; three points are collinear when they lie on a common affine line over Fq\mathbb F_qFq​.

For an additive subgroup GGG of Fqr\mathbb F_q^rFqr​, KG\mathcal K_GKG​ is the set of points whose coordinate vectors lie in GGG. A translation cap is a cap of the form KG\mathcal K_GKG​. By Giulietti, Proposition 2.5, for t>1t > 1t>1 a translation cap has at most qr/2q^{r/2}qr/2 points; one attaining this bound is a maximal translation cap.

On the projective side, let V=F2trV = \mathbb F_{2^t}^rV=F2tr​, so that PG(V,F2t)=PG(r−1,2t)PG(V, \mathbb F_{2^t}) = PG(r-1, 2^t)PG(V,F2t​)=PG(r−1,2t). An F2\mathbb F_2F2​-subspace UUU of VVV (an additive subgroup) of F2\mathbb F_2F2​-dimension kkk, the rank, defines the F2\mathbb F_2F2​-linear set LU={⟨u⟩F2t:u∈U∖{0}}L_U = \{\langle u \rangle_{\mathbb F_{2^t}} : u \in U \setminus \{0\}\}LU​={⟨u⟩F2t​​:u∈U∖{0}}. It is scattered when every point ⟨u⟩\langle u\rangle⟨u⟩ meets UUU in exactly {0,u}\{0, u\}{0,u}, i.e. has weight one. A scattered linear set has rank at most rt/2rt/2rt/2 (Blokhuis–Lavrauw); one of rank 3t/23t/23t/2 in the plane PG(2,2t)PG(2, 2^t)PG(2,2t) is called maximum.

Formalization targets

Goal: Theorem 1.3

For q=2tq = 2^tq=2t, ttt even, and n≥4n \ge 4n≥4 even, there is a complete cap SSS in AG(n,q)AG(n, q)AG(n,q) with

∣S∣=2qn−1.|S| = 2\sqrt{q^{n-1}}.∣S∣=2qn−1​.

The exponent t(n−1)/2t(n-1)/2t(n−1)/2 is an integer because ttt is even.

Milestones

  1. Theorem 4.2 ([6, Lemma 2.1]): for qqq even, KG\mathcal K_GKG​ is a translation cap iff any two distinct non-zero vectors of GGG are Fq\mathbb F_qFq​-linearly independent.
  2. Proposition 4.3: for t>1t > 1t>1, LUL_ULU​ is a scattered F2\mathbb F_2F2​-linear set of PG(r−1,2t)PG(r-1, 2^t)PG(r−1,2t) iff KU\mathcal K_UKU​ is a translation cap of AG(r,2t)AG(r, 2^t)AG(r,2t).
  3. The bound of [6, Prop. 2.5]: a translation cap in AG(r,2t)AG(r, 2^t)AG(r,2t), t>1t > 1t>1, has at most qr/2q^{r/2}qr/2 points.
  4. Lemma 4.5 ([6, Prop. 2.8]): the product of maximal translation caps in AG(r,2t)AG(r, 2^t)AG(r,2t) and AG(rˉ,2t)AG(\bar r, 2^t)AG(rˉ,2t) is a maximal translation cap in AG(r+rˉ,2t)AG(r + \bar r, 2^t)AG(r+rˉ,2t).
  5. The parabola {(x,x2):x∈F2t}\{(x, x^2) : x \in \mathbb F_{2^t}\}{(x,x2):x∈F2t​} is a translation cap in AG(2,2t)AG(2, 2^t)AG(2,2t).
  6. Lemma 4.6 (doubling, [6, Cor. 2.12]): if KG\mathcal K_GKG​ is a maximal translation cap in AG(r,2t)AG(r, 2^t)AG(r,2t), then KG×{0,1}\mathcal K_{G \times \{0,1\}}KG×{0,1}​ is a complete cap in AG(r+1,2t)AG(r+1, 2^t)AG(r+1,2t).
  7. Proposition 4.7: a maximum scattered linear set in PG(2,q)PG(2, q)PG(2,q) yields a complete cap in AG(n,q)AG(n, q)AG(n,q) of size 2q(n−1)/22q^{(n-1)/2}2q(n−1)/2.
  8. The existence input, restated from Section 2: Lemma 2.8 and Proposition 2.9 (a suitable coefficient bbb), Theorem 2.10 (the scattered F2\mathbb F_2F2​-linear set {x2+bx22n+1+xω}\{x^2 + bx^{2^{2n+1}} + x\omega\}{x2+bx22n+1+xω} of rank 3n3n3n in PG(2,22n)PG(2, 2^{2n})PG(2,22n), covering t=2n≥4t = 2n \ge 4t=2n≥4), and the Baer-subplane case r=3r = 3r=3, t=2t = 2t=2 (covering q=4q = 4q=4).

Significance

Theorem 1.3 shows that the trivial bound (1) is sharp up to the factor 2\sqrt 22​ in even dimension n≥4n \ge 4n≥4 for every even square qqq, extending to even dimension what the constructions of Segre and Pambianco–Storme give in odd dimension. The construction supplies caps near the elementary size lower bound in a parameter range where the paper reports no comparably small infinite family. Remark 4.8 of the paper extends the construction to complete caps of comparable size in PG(n,q)PG(n, q)PG(n,q). The proof also establishes Proposition 4.3, a dictionary between scattered F2\mathbb F_2F2​-linear sets and translation caps, so that any new maximum scattered linear set yields new small complete caps.

The result is proved on paper; no machine-checked proof of it or of the cited results of [6] (Lemmas 4.5, 4.6 and the bound of Prop. 2.5, whose proofs are not in this paper) is known to exist. The mission produces a formal statement of Theorem 1.3, the cap–linear set correspondence, and formal statements of the three results the paper imports from [6].

Difficulty

Assembling Proposition 4.7 from the milestones is short. The difficulty lies in the inputs. The doubling construction requires showing that every point of AG(r+1,q)AG(r+1, q)AG(r+1,q) outside KG×{0,1}\mathcal K_{G\times\{0,1\}}KG×{0,1}​ lies on a secant, which uses the maximality ∣G∣=qr/2|G| = q^{r/2}∣G∣=qr/2 in a counting argument; it is cited from [6], not proved in the paper. The existence of a maximum scattered linear set in PG(2,2t)PG(2, 2^t)PG(2,2t) is the deep input: Lemma 2.8 needs a bound on the value set of a non-permutation polynomial (Turnwald) and a point count on a plane curve over F23n\mathbb F_{2^{3n}}F23n​. A tempting shortcut, taking any maximal cap obtained by greedy extension, gives a complete cap of unknown and generally much larger size; the content of the theorem is the exact size.

Formalization scope

  • AG(r,q)AG(r, q)AG(r,q) is Fin r → K for a finite field KKK with ∣K∣=2t|K| = 2^t∣K∣=2t; collinearity is Mathlib's affine Collinear K, over KKK itself. A complete cap is quantified against every point of AG(r,q)AG(r, q)AG(r,q).
  • Sizes are Set.ncard. The goal's size 2qn−12\sqrt{q^{n-1}}2qn−1​ is written 2⋅2t(n−1)/22\cdot 2^{t(n-1)/2}2⋅2t(n−1)/2 with natural-number division, exact because ttt is even; maximality of a translation cap is the squared form ∣S∣2=qr|S|^2 = q^r∣S∣2=qr, and the [6] bound is ∣S∣2≤qr|S|^2 \le q^r∣S∣2≤qr.
  • Scattered-ness is the weight-one condition "c u∈Uc\,u \in Ucu∈U, c∈F2tc \in \mathbb F_{2^t}c∈F2t​, u≠0u \ne 0u=0 imply c∈F2c \in \mathbb F_2c∈F2​"; rank kkk means ∣U∣=2k|U| = 2^k∣U∣=2k. "Maximum" in Proposition 4.7 is read as rank 3t/23t/23t/2, as in the first line of its proof.
  • In Section 2, F2m\mathbb F_{2^m}F2m​ is the fixed field of x↦x2mx \mapsto x^{2^m}x↦x2m inside EEE with ∣E∣=26n|E| = 2^{6n}∣E∣=26n; norms are explicit Frobenius products. ω\omegaω ranges over all of F22n∖F2n\mathbb F_{2^{2n}} \setminus \mathbb F_{2^n}F22n​∖F2n​ (the paper's standing ω\omegaω). Proposition 2.9 carries the standing assumption n≥2n \ge 2n≥2 of Section 2.
  • Lemmas 4.5, 4.6 and the [6] bound carry t>1t > 1t>1; for t=1t = 1t=1 every subset of AG(r,2)AG(r, 2)AG(r,2) is a cap and Lemma 4.6 fails.
  • Ruled out: stating the goal with ≤\le≤ or ≥\ge≥ in place of the exact size, or measuring collinearity over F2\mathbb F_2F2​ (over which every set is a cap), would make it trivial.
  • Citation basis: arXiv:1512.07467v1; all theorem numbers and pages refer to that version.

Welcome contributions: a general library of caps and translation caps in AG(r,q)AG(r, q)AG(r,q); the scattered-linear-set/translation-cap dictionary; a formalization of the doubling construction of [6]; transport of the F26n\mathbb F_{2^{6n}}F26n​-model of Theorem 2.10 to coordinates F22n3\mathbb F_{2^{2n}}^3F22n3​. The linear-set definitions mirror those of the companion mission on scattered linear sets and are reusable there.

Selected references

  • D. Bartoli, M. Giulietti, G. Marino, O. Polverino, Maximum scattered linear sets and complete caps in Galois spaces, arXiv:1512.07467v1, 2015; Combinatorica 37 (2017). arXiv:1512.07467v1
  • [3] A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • [6] M. Giulietti, Small complete caps in PG(N, q), q even, J. Combin. Des. 15(5) (2007), 420–436. https://doi.org/10.1002/jcd.20131
  • [7] M. Giulietti, The geometry of covering codes: small complete caps and saturating sets in Galois spaces, in Surveys in Combinatorics 2013, LMS Lecture Note Series 409, Cambridge University Press, 2013, pp. 51–90. https://doi.org/10.1017/CBO9781139506748.003
  • [17] F. Pambianco, L. Storme, Small complete caps in spaces of even characteristic, J. Combin. Theory Ser. A 75(1) (1996), 70–84. https://doi.org/10.1006/jcta.1996.0064
  • [19] B. Segre, On complete caps and ovaloids in three-dimensional Galois spaces of characteristic two, Acta Arith. 5 (1959), 315–332. https://doi.org/10.4064/aa-5-3-315-332
  • [20] G. Turnwald, A new criterion for permutation polynomials, Finite Fields Appl. 1 (1995), 64–82. https://doi.org/10.1006/ffta.1995.1005
14 thms1 active userReviewed
AlgebraDiscrete GeometryLinear algebra·Captain: mikedeng1

Maximum Scattered Linear Sets and Complete Caps in Galois Spaces 1: Scattered 𝔽_q-Linear Sets of Rank rt/2 Exist in PG(r − 1, q^t) for t Even, in Three Families of (q, t)Research Paper

Motivation

Linear sets are the main tool for building point sets with few intersection sizes in finite projective spaces: sets meeting every hyperplane, two-intersection sets, translation ovoids, and the geometric side of finite semifields and rank-metric codes (Polverino, 2010). Among them, scattered linear sets are those whose points all carry the smallest possible weight, and a scattered linear set of the largest possible rank is called maximum scattered. By Blokhuis and Lavrauw (2000), a maximum scattered linear set of PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) of rank rt/2rt/2rt/2 is a two-intersection set with respect to hyperplanes, so each one yields a two-weight code and a strongly regular graph.

Timeline.

  • 2000, Blokhuis–Lavrauw: the rank of a scattered Fq\mathbb F_qFq​-linear set of PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) is at most rt/2rt/2rt/2, and for rrr even this bound is attained.
  • 2000, Ball–Blokhuis–Lavrauw: examples of rank 666 in PG(2,q4)\mathrm{PG}(2,q^4)PG(2,q4).
  • Classical: for r=3r=3r=3, t=2t=2t=2 the bound 333 is attained by Baer subplanes.
  • 2000, Blokhuis–Lavrauw, Thm 4.4: existence (without explicit examples) for r>3r>3r>3, t=2t=2t=2, q=2q=2q=2 and for r≥3r\ge3r≥3, (t−1)∣r(t-1)\mid r(t−1)∣r, ttt even, q>2q>2q>2.
  • 2015, Bartoli, Giulietti, Marino and Polverino (arXiv:1512.07467v1, Combinatorica 37 (2017)): three explicit families in PG(2,q2n)\mathrm{PG}(2,q^{2n})PG(2,q2n) and, by direct sums, maximum scattered linear sets in PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) for ttt even in three families of (q,t)(q,t)(q,t). This mission formalizes that result; the companion mission formalizes the paper's application to complete caps.

Setting

Let qqq be a prime power, t≥1t\ge1t≥1, and let VVV be an rrr-dimensional vector space over Fqt\mathbb F_{q^t}Fqt​; PG(V,Fqt)=PG(r−1,qt)\mathrm{PG}(V,\mathbb F_{q^t})=\mathrm{PG}(r-1,q^t)PG(V,Fqt​)=PG(r−1,qt) has as points the spans ⟨v⟩Fqt\langle v\rangle_{\mathbb F_{q^t}}⟨v⟩Fqt​​ of nonzero v∈Vv\in Vv∈V. An Fq\mathbb F_qFq​-subspace U⊆VU\subseteq VU⊆V is a subset closed under addition and under multiplication by Fq\mathbb F_qFq​. It defines the Fq\mathbb F_qFq​-linear set

LU={⟨u⟩Fqt:u∈U∖{0}},L_U=\{\langle u\rangle_{\mathbb F_{q^t}} : u\in U\setminus\{0\}\},LU​={⟨u⟩Fqt​​:u∈U∖{0}},

whose rank is dim⁡FqU\dim_{\mathbb F_q}UdimFq​​U. A linear set comes paired with UUU, so every statement here is about UUU. The weight of a point ⟨v⟩\langle v\rangle⟨v⟩ is dim⁡Fq(⟨v⟩Fqt∩U)\dim_{\mathbb F_q}(\langle v\rangle_{\mathbb F_{q^t}}\cap U)dimFq​​(⟨v⟩Fqt​​∩U), and LUL_ULU​ is scattered when every point of LUL_ULU​ has weight 111; equivalently, for every nonzero u∈Uu\in Uu∈U,

λ∈Fqt, λu∈U ⟹ λ∈Fq.\lambda\in\mathbb F_{q^t},\ \lambda u\in U\ \Longrightarrow\ \lambda\in\mathbb F_q .λ∈Fqt​, λu∈U ⟹ λ∈Fq​.

The plane construction (§2). Fix n≥2n\ge2n≥2 and the field E=Fq6nE=\mathbb F_{q^{6n}}E=Fq6n​ with its subfields Fq⊆Fqn⊆Fq2n\mathbb F_q\subseteq\mathbb F_{q^n}\subseteq\mathbb F_{q^{2n}}Fq​⊆Fqn​⊆Fq2n​ and Fq3n\mathbb F_{q^{3n}}Fq3n​. As an Fq2n\mathbb F_{q^{2n}}Fq2n​-space EEE has dimension 333, so PG(E,Fq2n)=PG(2,q2n)\mathrm{PG}(E,\mathbb F_{q^{2n}})=\mathrm{PG}(2,q^{2n})PG(E,Fq2n​)=PG(2,q2n). For ω∈Fq2n∖Fqn\omega\in\mathbb F_{q^{2n}}\setminus\mathbb F_{q^n}ω∈Fq2n​∖Fqn​ and an Fq\mathbb F_qFq​-linear f:Fq3n→Fq3nf:\mathbb F_{q^{3n}}\to\mathbb F_{q^{3n}}f:Fq3n​→Fq3n​ the paper studies

Uf={f(x)+xω:x∈Fq3n},U_f=\{f(x)+x\omega : x\in\mathbb F_{q^{3n}}\},Uf​={f(x)+xω:x∈Fq3n​},

with fff a monomial axqiax^{q^i}axqi or a binomial fi,a,b(x)=axqi+bxq2n+if_{i,a,b}(x)=ax^{q^i}+bx^{q^{2n+i}}fi,a,b​(x)=axqi+bxq2n+i. The relative norms Nqm/qd(x)=∏j<m/dxqdjN_{q^m/q^d}(x)=\prod_{j<m/d}x^{q^{dj}}Nqm/qd​(x)=∏j<m/d​xqdj enter the hypotheses.

Formalization targets

Goal: Theorem 1.2 (p. 3)

For ttt even and r≥2r\ge2r≥2, in each of the cases (a) q=2q=2q=2, t≥4t\ge4t≥4; (b) t≢0(mod3)t\not\equiv0\pmod3t≡0(mod3); (c) q≡1(mod3)q\equiv1\pmod3q≡1(mod3), t≡0(mod3)t\equiv0\pmod3t≡0(mod3),

∃ U⊆Fqt r  Fq-subspace:dim⁡FqU=rt2,LU scattered.\exists\,U\subseteq\mathbb F_{q^t}^{\,r}\ \ \mathbb F_q\text{-subspace}:\qquad \dim_{\mathbb F_q}U=\frac{rt}{2},\quad L_U\ \text{scattered}.∃U⊆Fqtr​  Fq​-subspace:dimFq​​U=2rt​,LU​ scattered.

Milestones, in proof order

  • Proposition 2.1 (p. 5): UfU_fUf​ has rank 3n3n3n, and LUfL_{U_f}LUf​​ is scattered iff Qf∩Fq2n=FqQ_f\cap\mathbb F_{q^{2n}}=\mathbb F_qQf​∩Fq2n​=Fq​, where QfQ_fQf​ is the set of quotients f(x)+xωf(y)+yω\frac{f(x)+x\omega}{f(y)+y\omega}f(y)+yωf(x)+xω​, y≠0y\ne0y=0.
  • Proposition 2.2 (p. 6): the same criterion through the polynomial system (5)–(6).
  • Theorems 2.3, 2.4 (pp. 7, 9): the monomial families, for n≢0(mod3)n\not\equiv0\pmod 3n≡0(mod3) and for q≡1(mod3)q\equiv1\pmod3q≡1(mod3).
  • Theorem 2.5 (p. 10): existence in PG(2,q2n)\mathrm{PG}(2,q^{2n})PG(2,q2n) in those two regimes.
  • Lemma 2.6 (p. 11): φ(x)/x\varphi(x)/xφ(x)/x and φˉ(x)/x\bar\varphi(x)/xφˉ​(x)/x have the same image, where φˉ\bar\varphiφˉ​ is the trace adjoint.
  • Proposition 2.7, Lemma 2.8, Proposition 2.9, Theorem 2.10 (pp. 12–16): the binomial family for q=2q=2q=2.
  • Theorem 3.1 (p. 16): direct sums of scattered linear sets are scattered, of rank rt/2rt/2rt/2 iff each summand has rank sit/2s_it/2si​t/2.
  • The line example (p. 2, cited from Lavrauw's thesis) and the Baer-subplane case r=3r=3r=3, t=2t=2t=2 (p. 3).

Significance

Theorem 1.2 gives maximum scattered linear sets, and hence two-intersection sets, two-weight codes and strongly regular graphs, for infinitely many (q,t)(q,t)(q,t) with rrr odd, a regime where earlier existence results covered only a few values of ttt. The q=2q=2q=2 case feeds the paper's second main result: scattered F2\mathbb F_2F2​-linear sets of PG(2,2t)\mathrm{PG}(2,2^t)PG(2,2t) of rank 3t/23t/23t/2 are translation caps, from which complete caps of size 2q n−12\sqrt{q^{\,n-1}}2qn−1​ in AG(n,q)\mathrm{AG}(n,q)AG(n,q) are built.

All statements are proved in the preprint; none has a machine-checked proof. Formalizing them requires a usable theory of subfields of a finite field as Frobenius fixed fields, relative norms and their images, linearized polynomials and their trace adjoints, and the passage between Fq\mathbb F_qFq​-dimension, cardinality and weight. Each of these is reusable for later work on linear sets, MRD codes and semifields.

Difficulty

The criterion of Proposition 2.2 reduces scatteredness to a polynomial system, but the system has to be solved for a specific fff. For the monomials this rests on the solvability of zqi−1=cz^{q^i-1}=czqi−1=c in Fq3n\mathbb F_{q^{3n}}Fq3n​, a norm condition interacting with the gcd hypotheses. For the binomial with q=2q=2q=2, the existence of a suitable bbb (Lemma 2.8) needs a value-set bound for non-permutation polynomials (Turnwald, 1995) and a point count on a plane curve. The higher-dimensional statement then needs the elementary bound dim⁡U≤st/2\dim U\le st/2dimU≤st/2 for scattered UUU to obtain the rank equivalence in Theorem 3.1. A tempting shortcut, taking U=Fq rU=\mathbb F_q^{\,r}U=Fqr​ or any small subspace, is scattered but has the wrong rank; the content is in the rank rt/2rt/2rt/2.

Formalization scope

  • Citation basis. arXiv:1512.07467v1; page numbers equal PDF pages.
  • Fields. Fqm⊆E\mathbb F_{q^m}\subseteq EFqm​⊆E is the fixed field of x↦xqmx\mapsto x^{q^m}x↦xqm in a finite field EEE of characteristic ppp with ∣E∣=q6n|E|=q^{6n}∣E∣=q6n, q=phq=p^hq=ph. Norms and traces are explicit Frobenius products and sums.
  • Subspaces and rank. An Fq\mathbb F_qFq​-subspace is a carrier set with closure conditions. Rank kkk is ∣U∣=qk|U|=q^k∣U∣=qk; in Theorem 3.1 rank rt/2rt/2rt/2 is ∣W∣2=qrt|W|^2=q^{rt}∣W∣2=qrt.
  • Points. Scatteredness takes the spanning field as an argument: Fq2n\mathbb F_{q^{2n}}Fq2n​ in §2, the whole Fqt\mathbb F_{q^t}Fqt​ in Theorem 1.2 and §3. PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) is modelled on Fin r → K; the plane of §2 on EEE itself.
  • Pinned readings.
    • Theorem 1.2 prints no range for rrr. The preceding sentence and the proof (p. 17) say r≥5r\ge5r≥5, and r=1r=1r=1 is false. The goal assumes r≥2r\ge2r≥2, covered by the line example (r=2r=2r=2), §2 with the Baer case (r=3r=3r=3) and Theorem 3.1 (r≥4r\ge4r≥4).
    • ω\omegaω is quantified over all of Fq2n∖Fqn\mathbb F_{q^{2n}}\setminus\mathbb F_{q^n}Fq2n​∖Fqn​.
    • The index ranges 1≤i≤3n−11\le i\le3n-11≤i≤3n−1 (monomial) and 2n+i≤3n−12n+i\le3n-12n+i≤3n−1 (binomial) come from the case headings on pp. 7 and 10.
    • Proposition 2.7's printed "wxwxwx" is ωx\omega xωx.
    • Theorem 2.10 keeps its printed hypothesis N23n/2n(b)≠1N_{2^{3n}/2^n}(b)\ne1N23n/2n​(b)=1.
    • Theorem 3.1's rank clause assumes t≥2t\ge2t≥2; for t=1t=1t=1 it is false.
  • Ruled out. Taking the span over EEE or over Fq\mathbb F_qFq​, or dropping the rank, would make the statements false or trivial; every existence statement fixes the rank, and the span field is explicit.
  • Contributions welcome. Frobenius-fixed-field cardinalities, norm surjectivity, the criteria of Propositions 2.1–2.2, the monomial and binomial families, and the direct-sum rank computation.

Selected references

  • D. Bartoli, M. Giulietti, G. Marino, O. Polverino, Maximum scattered linear sets and complete caps in Galois spaces, arXiv:1512.07467v1 (2015); Combinatorica 37 (2017). https://arxiv.org/abs/1512.07467, https://doi.org/10.1007/s00493-016-3531-6
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. 310 (2010), 3096–3107. https://doi.org/10.1016/j.disc.2010.04.007
  • S. Ball, A. Blokhuis, M. Lavrauw, Linear (q + 1)-fold blocking sets in PG(2, q⁴), Finite Fields Appl. 6 (2000), 294–301.
  • M. Lavrauw, Scattered Spaces with respect to Spreads and Eggs in Finite Projective Spaces, Ph.D. thesis, TU Eindhoven, 2001.
  • G. Turnwald, A new criterion for permutation polynomials, Finite Fields Appl. 1 (1995), 64–82.
15 thms1 active userReviewed
Graph TheoryTheoretical Computer Science·Captain: mikedeng1

Generation and Properties of Snarks 3: A Snark on 26 Vertices All of Whose 2-Factors Consist of Odd Cycles Refutes the Abreu–Labbate–Sheehan ConjectureResearch Paper

Motivation

A cubic graph has chromatic index 3 or 4 (Vizing). Cubic graphs of chromatic index 4 — the uncolourable ones — are where most of the open problems on cubic graphs live: a minimal counterexample to the cycle double cover conjecture or to Tutte's 5-flow conjecture would be among them. Uncolourable graphs with small edge cuts or short cycles reduce to smaller ones, so attention concentrates on snarks, the uncolourable cubic graphs that are cyclically 4-edge connected and have girth at least 5.

Brinkmann, Goedgebeur, Hägglund and Markström (arXiv:1206.6690v3, J. Combin. Theory Ser. B 103, 2013) generated all snarks on up to 36 vertices and tested a series of published conjectures against them. One of these concerns the 2-factors of a snark, its spanning subgraphs in which every vertex has degree 2. A 3-edge-colouring of a cubic graph gives 2-factors made of even cycles, so a snark is a graph in which some 2-factors are forced to contain odd cycles. At the far end are the snarks in which every 2-factor consists of odd cycles only. Abreu, Labbate and Sheehan (European J. Combin. 33, 2012), studying pseudo and strongly pseudo 2-factor isomorphic graphs, conjectured that this happens only for the Petersen graph, the Blanuša-2 snark and the Flower snarks (paper, p. 11, Conjecture 4.11).

Timeline:

  • 2012: Abreu, Labbate and Sheehan state the conjecture.
  • 2012–2013: Brinkmann, Goedgebeur, Hägglund and Markström refute it with a snark on 26 vertices, printed in Appendix 8.1 of their paper (p. 29); by computer search they report it is the smallest counterexample and that one more exists on 34 vertices (Observation 4.12).

Setting

All graphs are finite and simple. A graph GGG is cubic if every vertex has degree 3. It is colourable if its edges can be coloured with three colours so that edges sharing an endpoint get different colours, and uncolourable otherwise. The girth g(G)g(G)g(G) is the number of vertices of a shortest cycle. GGG is cyclically kkk-edge connected if deleting fewer than kkk edges never leaves two components that both contain a cycle. A snark is an uncolourable, cyclically 4-edge connected cubic graph with g(G)≥5g(G) \ge 5g(G)≥5 (paper, p. 4).

A 2-factor of GGG is a spanning 2-regular subgraph FFF: it uses every vertex, and every vertex has degree exactly 2 in FFF. Each component of FFF is a cycle. Say that all 2-factors of GGG are odd if every component of every 2-factor of GGG has an odd number of vertices.

The witness is the graph G8.1G_{8.1}G8.1​ of Appendix 8.1, given in the paper as a list of higher-numbered neighbours of the vertices 1,…,261, \dots, 261,…,26:

{2,3,4,5,6,7,8,9,10,7,9,8,10,11,12,13,14,15,16,15,17,18,19,18,20,18,21,22,21,23,23,24,22,24,25,26,26,25,26}.\{2, 3, 4, 5, 6, 7, 8, 9, 10, 7, 9, 8, 10, 11, 12, 13, 14, 15, 16, 15, 17, 18, 19, 18, 20, 18, 21, 22, 21, 23, 23, 24, 22, 24, 25, 26, 26, 25, 26\}.{2,3,4,5,6,7,8,9,10,7,9,8,10,11,12,13,14,15,16,15,17,18,19,18,20,18,21,22,21,23,23,24,22,24,25,26,26,25,26}.

It has 26 vertices and 39 edges. In Lean it is G81 : SimpleGraph (Fin 26) with paper vertex iii as i−1i-1i−1.

Formalization targets

Goal: Observation 4.12, existence half

G8.1 is a snarkandevery 2-factor of G8.1 consists of odd cycles.G_{8.1} \text{ is a snark} \quad\text{and}\quad \text{every 2-factor of } G_{8.1} \text{ consists of odd cycles.}G8.1​ is a snarkandevery 2-factor of G8.1​ consists of odd cycles.

Because G8.1G_{8.1}G8.1​ has 26 vertices, it is not the Petersen graph (10 vertices), not the Blanuša-2 snark (18) and not a Flower snark JkJ_kJk​ (4k4k4k vertices). The goal therefore refutes Conjecture 4.11 without formalizing the conjecture's list of exceptions.

Milestones

The goal splits into five properties of the one graph G8.1G_{8.1}G8.1​:

  1. G8.1G_{8.1}G8.1​ is cubic;
  2. g(G8.1)≥5g(G_{8.1}) \ge 5g(G8.1​)≥5;
  3. G8.1G_{8.1}G8.1​ is cyclically 4-edge connected;
  4. every 2-factor of G8.1G_{8.1}G8.1​ consists of odd cycles;
  5. G8.1G_{8.1}G8.1​ is uncolourable.

A supporting statement, not from the paper, asserts that G8.1G_{8.1}G8.1​ has a 2-factor, so that milestone 4 is not vacuous.

Significance

The result. Conjecture 4.11 would have characterised a natural extremal class of snarks by a short explicit list. The counterexample shows that the class is not that list: there are snarks outside the Petersen, Blanuša-2 and Flower families in which no 2-factor contains an even cycle. Such graphs are relevant to questions about 2-factor structure, oddness and cycle double covers, where the parity of 2-factor cycles is exactly what the arguments track.

Formalizing it. The result is proved in the paper by exhibiting the graph and checking it by computer; it has not been machine-checked in a proof assistant. A formal proof certifies every property of the printed graph — including that the printed adjacency list decodes to a graph with these properties — and leaves a reusable library of definitions (snarks, cyclic edge connectivity, 2-factors) that other snark statements can import.

Difficulty

Each property is a finite check, but some are large. Cubicity and girth are local. Cyclic 4-edge connectivity quantifies over all sets of at most three of the 39 edges (about ten thousand) and needs, for each, a component analysis of the remaining graph. The odd-2-factor property quantifies over all 2-factors; in a cubic graph these are the complements of the perfect matchings, and G8.1G_{8.1}G8.1​ has 56 perfect matchings. The obvious route — decide over all subgraphs — is out of reach: there are 2392^{39}239 edge subsets, and the statement is phrased through Mathlib's ConnectedComponent and IsRegularOfDegree, which do not evaluate by kernel computation at this size. Uncolourability has the same problem: the naive search space has 3393^{39}339 colourings.

Formalization scope

Conventions committed to:

  • Vertices are Fin 26, paper vertex iii = Lean vertex i−1i-1i−1; adjacency is the symmetric closure of an explicit edge list G81Edges, so it is decidable.
  • Colourable means G.lineGraph.Colorable 3 (a proper 3-edge-colouring), never G.Colorable 3.
  • Girth is Mathlib's egirth : ℕ∞, so "girth at least 5" is 5 ≤ G.egirth.
  • A 2-factor is a graph F on the same vertex type with F ≤ G and F.IsRegularOfDegree 2 — spanning by construction. Oddness is per component: Odd (Nat.card c.supp) for every component c. It is not the parity of the whole vertex set (26 is even).
  • Cyclic kkk-edge connectivity: for every edge set S with S.card < k, any two components of G.deleteEdges S that both contain a cycle are equal.

The odd-2-factor property is vacuous for a graph without 2-factors. The goal is not trivialised this way: G8.1G_{8.1}G8.1​ has 2-factors, and a supporting theorem states it.

Out of scope, because they rest on exhaustive computer enumeration: that G8.1G_{8.1}G8.1​ is the smallest counterexample, that there is exactly one further counterexample on 34 vertices, Observation 4.10 (all snarks on at most 36 vertices have oddness 2), and Tables 4 and 5. The Petersen graph, the Blanuša-2 snark and the Flower snarks are not defined here; the refutation uses only their orders.

Contributions welcome: proofs of any milestone; general lemmas linking 2-factors of cubic graphs to perfect matchings, and 3-edge-colourings to even 2-factors; decision procedures for cyclic edge connectivity of explicit graphs. The definitions are shared in shape with the other missions of this series and are meant to be reused.

Selected references

  • G. Brinkmann, J. Goedgebeur, J. Hägglund, K. Markström, Generation and properties of snarks, arXiv:1206.6690v3, 2013; J. Combin. Theory Ser. B 103 (2013). https://arxiv.org/abs/1206.6690v3 , https://doi.org/10.1016/j.jctb.2013.05.001
  • M. Abreu, D. Labbate, J. Sheehan, Pseudo and strongly pseudo 2-factor isomorphic regular graphs and digraphs, European J. Combin. 33 (2012), no. 8, 1847–1856. https://mathscinet.ams.org/mathscinet-getitem?mr=2950486
  • G. Brinkmann, K. Coolsaet, J. Goedgebeur, H. Mélot, House of Graphs: a database of interesting graphs, Discrete Appl. Math. 161 (2013), 311–314. https://mathscinet.ams.org/mathscinet-getitem?mr=2973372
12 thms1 active userReviewed
Graph TheoryTheoretical Computer Science·Captain: mikedeng1

Generation and Properties of Snarks 2: A Cyclically 5-Edge-Connected Permutation Snark on 34 Vertices Refutes Zhang's Conjecture That Only the Petersen Graph Is OneResearch Paper

Motivation

A snark is a cubic graph that cannot be properly edge-coloured with three colours and that does not reduce to a smaller such graph. Snarks are the smallest possible counterexamples to several central conjectures about cubic graphs, among them the cycle double cover conjecture, Tutte's 5-flow conjecture and the Berge–Fulkerson conjecture, so structural statements about snarks narrow the search for counterexamples to those conjectures.

Permutation graphs are cubic graphs built from two disjoint cycles of equal length joined by a perfect matching, so that the two cycles are induced. The Petersen graph is the classical example: its outer 5-cycle and inner pentagram are joined by five spokes. In his monograph Integer Flows and Cycle Covers of Graphs (1997), C.-Q. Zhang conjectured that the Petersen graph is the only permutation snark that is also cyclically 5-edge connected.

Brinkmann, Goedgebeur, Hägglund and Markström (arXiv:1206.6690v3, J. Combin. Theory Ser. B 103, 2013) built a generator for snarks and enumerated all snarks up to 36 vertices. Among them they found twelve cyclically 5-edge-connected permutation snarks on 34 vertices, which refute Zhang's conjecture (Observation 4.2), and they printed all twelve in Appendix 8.6 of the paper. This mission formalizes the refutation using the first of those graphs.

Setting

All graphs are finite and simple. A cycle is a 2-regular connected graph. A graph is cubic if every vertex has degree 3. A 2-factor of GGG is a spanning 2-regular subgraph. The girth g(G)g(G)g(G) is the number of vertices in a shortest cycle of GGG.

A cubic graph is colourable if it has a proper 3-edge-colouring: a map c:E(G)→{1,2,3}c : E(G) \to \{1,2,3\}c:E(G)→{1,2,3} giving distinct colours to distinct edges with a common endpoint. Otherwise it is uncolourable.

A graph GGG is cyclically kkk-edge connected if deleting fewer than kkk edges from GGG never leaves two distinct components that both contain a cycle.

A snark is an uncolourable, cyclically 4-edge connected cubic graph with g(G)≥5g(G) \ge 5g(G)≥5.

A cubic graph is a permutation graph if it has a 2-factor consisting of two induced cycles. Equivalently, its vertex set splits as A∪(V∖A)A \cup (V \setminus A)A∪(V∖A) with both induced subgraphs G[A]G[A]G[A] and G[V∖A]G[V \setminus A]G[V∖A] cycles. A permutation snark is a snark that is a permutation graph.

The Petersen graph PPP is the graph on {0,…,9}\{0,\dots,9\}{0,…,9} with the outer cycle i∼i+1(mod5)i \sim i+1 \pmod 5i∼i+1(mod5), the spokes i∼i+5i \sim i+5i∼i+5, and the inner pentagram 5+i∼5+((i+2) mod 5)5+i \sim 5+((i+2) \bmod 5)5+i∼5+((i+2)mod5).

Zhang's Conjecture 4.1. Let GGG be a cubic cyclically 5-edge-connected permutation graph. If GGG is a snark, then GGG must be the Petersen graph.

The witness G1G_1G1​ is the first graph in Appendix 8.6 (p. 36). It is given as a list of higher-numbered neighbours of the vertices 1,…,341,\dots,341,…,34; decoded, it has 51 edges. In the Lean development the paper's vertex iii is i - 1 : Fin 34.

Formalization targets

Goal: Observation 4.2, first sentence

¬ ZhangConjecture,\neg\,\mathrm{ZhangConjecture},¬ZhangConjecture,

that is, there is a finite cubic, cyclically 5-edge connected permutation snark that is not isomorphic to the Petersen graph. This is SnarkGen.Zhang.observation_4_2.

Milestones: the properties of G1G_1G1​

Each milestone is a property of G1G_1G1​ asserted by the heading of Appendix 8.6, "The 12 cyclically 5-edge connected permutation snarks on 34 vertices":

  1. G1G_1G1​ is cubic;
  2. g(G1)≥5g(G_1) \ge 5g(G1​)≥5;
  3. G1G_1G1​ is cyclically 5-edge connected;
  4. G1G_1G1​ is a permutation graph;
  5. G1G_1G1​ is uncolourable;
  6. G1G_1G1​ is a snark;
  7. G1G_1G1​ satisfies all hypotheses of Conjecture 4.1 and G1≇PG_1 \not\cong PG1​≅P.

The goal follows from milestone 7 directly. Two supporting theorems are included: cyclic kkk-edge connectivity is monotone in kkk, and the paper's remark (p. 9) that every permutation snark has order ≡2(mod4)\equiv 2 \pmod 4≡2(mod4).

Significance

Zhang's conjecture predicted that the Petersen graph is isolated among highly connected permutation snarks. Its refutation shows that this is false, and the twelve 34-vertex graphs went on to serve as counterexamples to further conjectures in the same paper (Conjectures 5.17, 5.20 and 5.21, about cycle double covers containing a prescribed 2-factor). They are also listed in the House of Graphs database.

The refutation in the paper is a computer result: the graphs were found by an exhaustive search, and their properties were checked by programs. A formal proof would replace that check with a machine-verified one that is independent of the generator. It would also produce reusable certified tools for finite cubic graphs: a kernel-checked test for uncolourability, cyclic edge connectivity, and girth. No machine-checked proof of any of these properties of G1G_1G1​ is known to exist.

Difficulty

The statements are short, but none of the properties of G1G_1G1​ follows from a general theorem; each must be checked on the specific graph. The obvious approach, to unfold the definitions and let a decision procedure enumerate, does not scale:

  • Uncolourability quantifies over all 3513^{51}351 edge colourings.
  • Cyclic 5-edge connectivity quantifies over all edge sets of size at most 4 (about 270,000 of them among 51 edges), and for each one over the components of the remaining graph and the cycles inside them.
  • The permutation structure requires exhibiting the two induced 17-cycles and proving that each induced subgraph is connected and 2-regular.
  • Girth requires ruling out all cycles of length 3 and 4.

The definitions are stated in terms of Mathlib's general notions (line graphs, walks, connected components), not in terms of a computable representation. Connecting them to an efficient computation is the main work.

Formalization scope

Graphs are SimpleGraph V with [Fintype V]. The conventions are as follows.

  • "Colourable" is G.lineGraph.Colorable 3, a proper 3-colouring of the line graph. It is not a vertex colouring of GGG.
  • Cyclic kkk-edge connectivity quantifies over finite edge sets S ⊆ G.edgeSet with S.card < k. Components and cycles are taken in G.deleteEdges S.
  • Girth is 5 ≤ G.egirth, the extended girth, which is ∞\infty∞ for acyclic graphs.
  • Degrees in the general predicates use classical decidability. Any other decidability instance gives the same degrees.
  • The conjecture quantifies over all finite vertex types in Type and reads "must be the Petersen graph" as Nonempty (H ≃g petersen).

The conjecture keeps every printed hypothesis, including the redundant "cubic". Dropping "permutation graph" or "cyclically 5-edge connected" would make the refutation easier, since other cyclically 5-edge-connected snarks are known. The cyclic connectivity must be computed in the graph after deletion and must require both components to contain a cycle; otherwise it degenerates into ordinary edge connectivity, which is at most 3 for cubic graphs and would make the conjecture vacuous.

Proofs should be checked by the Lean kernel. The decision procedures for colourability and cyclic connectivity are the reusable part of this mission, and contributions that build them for arbitrary finite cubic graphs are welcome.

Out of scope.

  • The second and third sentences of Observation 4.2 ("The smallest counterexamples have 34 vertices, and there are exactly 12 counterexamples of that order"). They rest on an exhaustive enumeration of all snarks up to 36 vertices.
  • The other eleven graphs of Appendix 8.6.
  • Conjectures 5.17, 5.20 and 5.21. Their refutation needs the "no cycle double cover contains this 2-factor" certificate of Observation 5.18.
  • The counts in Table 3.

Selected references

  • G. Brinkmann, J. Goedgebeur, J. Hägglund, K. Markström, Generation and properties of snarks, arXiv:1206.6690v3, 2013; J. Combin. Theory Ser. B 103 (2013). https://arxiv.org/abs/1206.6690v3
  • C.-Q. Zhang, Integer Flows and Cycle Covers of Graphs, Monographs and Textbooks in Pure and Applied Mathematics 205, Marcel Dekker, 1997.
  • G. Brinkmann, K. Coolsaet, J. Goedgebeur, H. Mélot, House of Graphs: a database of interesting graphs, Discrete Appl. Math. 161 (2013), 311–314. https://doi.org/10.1016/j.dam.2012.07.018
15 thms1 active userReviewed
Graph TheoryTheoretical Computer Science·Captain: mikedeng1

Generation and Properties of Snarks 1: Inserting an Edge Between Two Edges of One Bicoloured Cycle of a 3-Edge-Coloured Cubic Graph Yields a 3-Edge-Colourable GraphResearch Paper

Motivation

A snark is an uncolourable, cyclically 4-edge-connected cubic graph of girth at least 5: a cubic graph whose edges cannot be properly coloured with three colours, and which is not reducible to a smaller such graph by an elementary operation. Snarks are the critical cases for several of the central conjectures of graph theory, among them the cycle double cover conjecture, Tutte's 5-flow conjecture and the Berge–Fulkerson conjecture: a minimal counterexample to any of them, if one exists, is a snark. Lists of all small snarks are therefore used to test such conjectures by computer.

Brinkmann, Goedgebeur, Hägglund and Markström (arXiv:1206.6690v3, 2013) generated all snarks on up to 36 vertices. Testing 3-edge-colourability is NP-complete, and only a vanishing fraction of cubic graphs are snarks (0.00044% of the cubic graphs of girth at least 5 on 28 vertices, p. 4), so the generation algorithm needs cheap criteria that recognise, before a graph is built, that it will be colourable and can be skipped. Section 3.1 of the paper supplies such a criterion for the last construction step, and this mission formalizes it.

Setting

All graphs are finite and simple. A graph is cubic if every vertex has degree 3. A 3-colouring of a graph G=(V,E)G=(V,E)G=(V,E) is a map C:E→{0,1,2}C:E\to\{0,1,2\}C:E→{0,1,2} that gives different colours to any two distinct edges sharing an end-vertex; GGG is colourable if it has one, i.e. its chromatic index satisfies χ′(G)≤3\chi'(G)\le 3χ′(G)≤3 (p. 2, Isaacs' terminology).

A 2-factor of GGG is a spanning 2-regular subgraph FFF (p. 4); each connected component of FFF is a cycle. FFF is an even 2-factor if all its cycles have even length (p. 5). For a 3-colouring CCC and colours i≠ji\ne ji=j, write GijG_{ij}Gij​ for the spanning subgraph whose edges are those coloured iii or jjj.

The edge insertion operation (Figure 1(d), p. 5) takes two distinct edges e=abe=abe=ab and e′=cde'=cde′=cd of GGG, which may share an end-vertex, subdivides eee by a new vertex xxx and e′e'e′ by a new vertex yyy, and adds the edge xyxyxy. The resulting graph G′G'G′ has vertex set V∪{x,y}V\cup\{x,y\}V∪{x,y} and edge set

E(G′)=(E∖{e,e′})∪{ax,xb,cy,yd,xy}.E(G')=\bigl(E\setminus\{e,e'\}\bigr)\cup\{ax,xb,cy,yd,xy\}.E(G′)=(E∖{e,e′})∪{ax,xb,cy,yd,xy}.

If GGG is cubic, so is G′G'G′. In the generation algorithm every graph of girth at least 4 is produced from a graph with two fewer vertices by this operation.

Formalization targets

Goal: Theorem 3.3 (p. 5)

Let GGG be a cubic graph with a 3-colouring CCC, let i≠ji\ne ji=j be colours, and let e=abe=abe=ab, e′=cde'=cde′=cd be distinct edges of GijG_{ij}Gij​ lying on the same cycle of GijG_{ij}Gij​. Then

χ′(G′)≤3,G′=G with an edge inserted between e and e′.\chi'(G')\le 3,\qquad G' = G \text{ with an edge inserted between } e \text{ and } e'.χ′(G′)≤3,G′=G with an edge inserted between e and e′.

Milestones

  1. Lemma 3.1 (p. 5). For a cubic graph GGG,
χ′(G)≤3  ⟺  G has an even 2-factor.\chi'(G)\le 3 \iff G \text{ has an even 2-factor.}χ′(G)≤3⟺G has an even 2-factor.
  1. The two-colour observation (§3.1, p. 5). If GGG is cubic, CCC is a 3-colouring and i≠ji\ne ji=j, then GijG_{ij}Gij​ is an even 2-factor of GGG.
  2. Lemma 3.2 (p. 5). If FFF is an even 2-factor of a cubic graph GGG and e≠e′e\ne e'e=e′ are edges of FFF on the same cycle of FFF, then the graph obtained by inserting an edge between eee and e′e'e′ is colourable.

Supporting statement (not on the goal's path)

Theorem 3.4 (p. 6, stated as folklore without proof). If GGG is a colourable cubic graph and the inserted edge xyxyxy lies on a 4-cycle of G′G'G′, then G′G'G′ is colourable.

Significance

The result. Theorem 3.3 is the look-ahead of the snark generator: one 3-colouring of a graph on n−2n-2n−2 vertices excludes, at once, every pair of edges lying on a common cycle of one of its three bicoloured 2-factors. For 28 vertices the first colouring alone discards on average 85% of the candidate edge pairs (p. 6), and the overall ratio of weak snarks among generated graphs on the last level improves by a factor of 85 (p. 4). The enumeration of all snarks up to 36 vertices, on which the paper's counterexamples and statistics rest, depends on this pruning being sound: a wrong pruning rule would silently delete snarks from the lists. Theorem 3.4 is a second pruning rule of the same kind.

Formalizing it. The results are proved (Lemma 3.1 is classical; the paper gives the argument for Lemma 3.2 in one sentence and for Theorem 3.3 by combination). None of them, and no statement about 3-edge-colourings of cubic graphs and their 2-factors, is formalized on the platform. The mission produces a machine-checked soundness proof of the pruning criterion and, along the way, a reusable development of the equivalence between 3-edge-colourings and even 2-factors in Lean's SimpleGraph library. Theorem 3.4 has no proof in the paper.

Difficulty

The combinatorial content is short; the difficulty lies in graph-theoretic infrastructure that Mathlib does not have. Lemma 3.1 relates a global object (a proper colouring of all edges) to the cycle structure of a spanning 2-regular subgraph, and either direction needs the description of a finite 2-regular graph as a disjoint union of cycles together with parity information along each cycle. Mathlib has walks, cycles and connected components, but no decomposition of a 2-regular graph into cycles and no notion of the length of a component as a cycle.

Lemma 3.2 and Theorem 3.3 change the vertex type: G′G'G′ lives on V⊔{x,y}V\sqcup\{x,y\}V⊔{x,y}, so 2-factors, connected components and cycle lengths must be transported from GGG to G′G'G′, and the case where eee and e′e'e′ share an end-vertex (allowed by Figure 1(d)) has to be handled alongside the generic one. A first idea, to extend a given 3-colouring of GGG directly to G′G'G′, does not work in general: the colours forced on the edges at xxx and yyy by the old colours of eee and e′e'e′ can conflict, and the hypothesis "same cycle" is what has to be used to avoid the conflict.

Formalization scope

Vertices form a type V with [Fintype V] [DecidableEq V]; graphs are SimpleGraph V with decidable adjacency, and "cubic" is Mathlib's G.IsRegularOfDegree 3. Colourability is G.lineGraph.Colorable 3 (an edge colouring, not a vertex colouring), and a 3-colouring is G.lineGraph.Coloring (Fin 3). A 2-factor is a graph F on the same vertex type with F ≤ G and F.IsRegularOfDegree 2; it is even if every connected component has an even number of vertices (Nat.card). The edge insertion operation produces a graph on V ⊕ Fin 2, with Sum.inr 0 subdividing eee and Sum.inr 1 subdividing e′e'e′; edges are unordered pairs Sym2 V. "On the same cycle" is encoded as membership of both edges in the 2-factor plus reachability of their end-vertices inside the 2-factor. Oddness is not defined as a number; Lemma 3.1 is stated in its second form.

Dropping "on the same cycle" would make Theorem 3.3 and Lemma 3.2 false (inserting edges between different cycles of a bicoloured 2-factor is exactly how snarks are produced), and both statements require the two edges to be distinct; a formalization without either hypothesis is ruled out. Every statement assumes cubicity, without which Lemma 3.1 fails.

Out of scope: the algorithmic content of §3 (isomorphism rejection, the look-ahead implementation, recolouring along non-hamiltonian cycles, the 85% / 11% / 3.4% statistics), the generation counts, and every exhaustive-search claim of the paper. The remaining results of the paper are covered by three sibling missions of this series.

Reusable beyond this mission: the 2-factor and even-2-factor definitions, the two-colour 2-factor of an edge colouring, and Lemma 3.1 itself. Contributions welcome: the cycle decomposition of finite 2-regular graphs, alternating colourings of even cycles, and a proof of Theorem 3.4.

Selected references

  • G. Brinkmann, J. Goedgebeur, J. Hägglund, K. Markström, Generation and properties of snarks, J. Combin. Theory Ser. B 103 (2013); arXiv:1206.6690v3. https://arxiv.org/abs/1206.6690
  • R. Isaacs, Infinite families of nontrivial trivalent graphs which are not Tait colorable, Amer. Math. Monthly 82 (1975) 221–239. https://doi.org/10.2307/2319844
8 thms1 active userReviewed
Machine LearningProbabilityTheoretical Computer Science·Captain: mikedeng1

A Learning Theory Approach to Non-Interactive Database Privacy 2: An ε-Differentially Private Mechanism Useful on Databases of Size at Most VCDIM(C)/2 Has Error α ≥ Ω(1/(4+16ε))Research Paper

Motivation

A data curator holds a database of nnn records and wants to publish answers to a large family of statistical questions about it without revealing any individual record. Differential privacy (Dwork, McSherry, Nissim, Smith 2006) makes the requirement precise, and the most basic questions are counting queries: what fraction of the records satisfy a given predicate? Blum, Ligett and Roth (arXiv:1109.2229, JACM 2013) showed that a single private release can answer every query of a class CCC to error α\alphaα once the database has size roughly log⁡∣X∣⋅VCDIM(C)/(α3ϵ)\log|X| \cdot \mathrm{VCDIM}(C)/(\alpha^3\epsilon)log∣X∣⋅VCDIM(C)/(α3ϵ), so that the sample size depends on the class only through its VC-dimension, a quantity from learning theory.

This mission formalizes the converse in §3.1 of that paper: the dependence on the VC-dimension cannot be removed. On databases of fewer than VCDIM(C)/2\mathrm{VCDIM}(C)/2VCDIM(C)/2 records, every differentially private mechanism has constant error on some query of CCC. The argument is an early instance of the reconstruction attack idea of Dinur and Nissim (2003): accurate answers to many counting queries determine the database, and a mechanism that determines its input cannot be private.

Setting

Let XXX be a set (the data universe). An input database of size nnn is a tuple z=(z1,…,zn)∈Xnz = (z_1,\dots,z_n) \in X^nz=(z1​,…,zn​)∈Xn. A predicate is a map φ:X→{0,1}\varphi : X \to \{0,1\}φ:X→{0,1}, and its counting query is

Qφ(z)=1n #{i:φ(zi)=1}.Q_\varphi(z) = \frac{1}{n}\,\#\{i : \varphi(z_i) = 1\}.Qφ​(z)=n1​#{i:φ(zi​)=1}.

A class CCC of predicates is identified with its class of counting queries. A finite set S⊆XS \subseteq XS⊆X is shattered by CCC if every function S→{0,1}S \to \{0,1\}S→{0,1} is the restriction of some φ∈C\varphi \in Cφ∈C; the VC-dimension VCDIM(C)∈N∪{∞}\mathrm{VCDIM}(C) \in \mathbb N \cup \{\infty\}VCDIM(C)∈N∪{∞} is the supremum of the sizes of shattered sets.

A mechanism MMM maps each input z∈Xnz \in X^nz∈Xn to a probability distribution M(z)M(z)M(z) on an output space OOO; an output ooo is read through an answer map ans(o,φ)∈R\mathrm{ans}(o, \varphi) \in \mathbb Rans(o,φ)∈R. Two inputs are neighbours if they differ in exactly one entry. The mechanism is ϵ\epsilonϵ-differentially private if M(z)(E)≤eϵM(z′)(E)M(z)(E) \le e^{\epsilon} M(z')(E)M(z)(E)≤eϵM(z′)(E) for all neighbours z,z′z, z'z,z′ and all measurable events EEE. It is (α,δ)(\alpha,\delta)(α,δ)-useful for CCC if for every input zzz, with probability at least 1−δ1-\delta1−δ over o∼M(z)o \sim M(z)o∼M(z), every query is answered to within α\alphaα:

∀φ∈C:∣ans(o,φ)−Qφ(z)∣≤α.\forall \varphi \in C:\quad |\mathrm{ans}(o,\varphi) - Q_\varphi(z)| \le \alpha .∀φ∈C:∣ans(o,φ)−Qφ​(z)∣≤α.

In the paper the output is a synthetic database D^\hat DD^ and ans(D^,φ)=Qφ(D^)\mathrm{ans}(\hat D,\varphi) = Q_\varphi(\hat D)ans(D^,φ)=Qφ​(D^).

Formalization targets

Goal: Theorem 3.11 (p. 11)

There is an absolute constant c>0c > 0c>0 such that for every universe XXX, class CCC, size n≥1n \ge 1n≥1 with n≤VCDIM(C)/2n \le \mathrm{VCDIM}(C)/2n≤VCDIM(C)/2, 0≤ϵ≤10 \le \epsilon \le 10≤ϵ≤1 and 0<δ≤1/40 < \delta \le 1/40<δ≤1/4: every ϵ\epsilonϵ-differentially private mechanism that is (α,δ)(\alpha,\delta)(α,δ)-useful for CCC on databases of size nnn satisfies

α ≥ c4+16ϵ.\alpha \ \ge\ \frac{c}{4 + 16\epsilon}.α ≥ 4+16ϵc​.

Milestones

  1. Lemma 3.12. For a set SSS of size ddd and the family DS\mathcal D_SDS​ of its subsets of size d/2d/2d/2, and QTQ_TQT​ the counting query of a predicate equal to the indicator of TTT on SSS: QT(T)−QT(T′)=∣TΔT′∣/dQ_T(T) - Q_T(T') = |T\Delta T'|/dQT​(T)−QT​(T′)=∣TΔT′∣/d for T,T′∈DST, T' \in \mathcal D_ST,T′∈DS​.
  2. Lemma 3.13. For an (α,δ)(\alpha,\delta)(α,δ)-useful mechanism, a fixed procedure recovers from M(T)M(T)M(T) a set T′∈DST' \in \mathcal D_ST′∈DS​ with ∣T′ΔT∣≤2dα|T'\Delta T| \le 2d\alpha∣T′ΔT∣≤2dα, with probability at least 1−δ1-\delta1−δ.
  3. The final inequality of the proof (p. 12), with δ\deltaδ kept. Under the goal's hypotheses with 0<δ<10 < \delta < 10<δ<1 and any ϵ\epsilonϵ:
(1−δ)(1−2α) ≤ eϵ(δ+2α).(1-\delta)(1-2\alpha) \ \le\ e^{\epsilon}(\delta + 2\alpha).(1−δ)(1−2α) ≤ eϵ(δ+2α).

Significance

Theorem 3.11 shows that the VC-dimension term in the paper's upper bound is necessary: for a class of VC-dimension ddd, no private mechanism is accurate on databases of size below d/2d/2d/2, whatever its running time. It thereby locates the sample complexity of private query release between VCDIM(C)\mathrm{VCDIM}(C)VCDIM(C) and VCDIM(C)⋅log⁡∣X∣\mathrm{VCDIM}(C)\cdot\log|X|VCDIM(C)⋅log∣X∣ up to accuracy and privacy factors, a gap that later work on private learning and on fingerprinting codes studied in detail (Bun, Ullman, Vadhan 2014).

The theorem is proved in the paper; to the best of current knowledge it has no machine-checked proof. Formalizing it produces a checked reconstruction-attack lower bound for differential privacy, together with the corrected statement disclosed below: the printed proof drops the failure probability δ\deltaδ of the two reconstructions, and keeping it shows that the conclusion requires δ\deltaδ below 1/(1+eϵ)1/(1+e^{\epsilon})1/(1+eϵ), not merely "bounded away from 1". Milestone 3 records the inequality the argument actually yields.

Difficulty

The combinatorial core (Lemmas 3.12 and 3.13) is elementary. The difficulty lies in the last step, which compares the output distributions on two different inputs. The paper argues about a uniformly random T∈DST \in \mathcal D_ST∈DS​, a random element x∈Tx \in Tx∈T and a random y∉Ty \notin Ty∈/T, and the swapped set T^=(T∖{x})∪{y}\hat T = (T\setminus\{x\})\cup\{y\}T^=(T∖{x})∪{y}. Privacy applies to one fixed pair of neighbouring inputs and one fixed event, while the reconstruction guarantee only controls ∣T′ΔT∣|T'\Delta T|∣T′ΔT∣, not whether a particular element is recovered. The "probabilities" Pr⁡[x∈T′]\Pr[x \in T']Pr[x∈T′] of the printed proof mix the mechanism's randomness with the random choice of TTT, xxx, yyy, and they are not the probability of any single event under any single M(z)M(z)M(z), so the privacy inequality cannot be applied to them as written. The reconstruction event must also be measurable, which depends on the readout, and the failure probability δ\deltaδ must be carried through both reconstructions. A proof that sets δ=0\delta = 0δ=0, as the printed one does, does not prove the stated theorem.

Formalization scope

  • Databases. Inputs are Fin n → X with n≥1n \ge 1n≥1; the empty database is excluded because every mechanism is private on it and Qφ=0/0Q_\varphi = 0/0Qφ​=0/0 there. In the proof, a set T∈DST \in \mathcal D_ST∈DS​ is given to the mechanism as any injective listing of its elements.
  • Neighbours. The paper's "∣DΔD′∣≤1|D\Delta D'| \le 1∣DΔD′∣≤1" for databases of equal size is read as replacing one entry (PrivLearn.Generic.Neighbors); read literally, it would make every mechanism private and the theorem false. Under this reading TTT and T^\hat TT^ are neighbours, so the paper's factor e2ϵe^{2\epsilon}e2ϵ becomes eϵe^{\epsilon}eϵ.
  • Mechanisms. The output space is an arbitrary measurable space and answers are read through ans. Synthetic-data mechanisms are the special case O=O = O= databases, so the lower bound covers a larger class of mechanisms. The hypotheses require IsProbabilityMeasure (M z) and the measurability of o ↦ ans o φ for φ∈C\varphi \in Cφ∈C. Without the first, the zero measure is private; without the second, a mechanism into a trivial σ\sigmaσ-algebra would be private and "useful".
  • Ω and the range of δ. The paper writes α≥Ω(1/(4+16ϵ))\alpha \ge \Omega(1/(4+16\epsilon))α≥Ω(1/(4+16ϵ)) for "0<δ<10<\delta<10<δ<1 bounded away from 1 by a constant". The Lean goal quantifies one absolute constant c>0c > 0c>0 before every other binder and assumes 0<δ≤1/40 < \delta \le 1/40<δ≤1/4. The proof gives α≥((1−δ)−eϵδ)/(2(1−δ+eϵ))\alpha \ge ((1-\delta) - e^{\epsilon}\delta)/(2(1-\delta+e^{\epsilon}))α≥((1−δ)−eϵδ)/(2(1−δ+eϵ)), which is positive only for δ<1/(1+eϵ)\delta < 1/(1+e^{\epsilon})δ<1/(1+eϵ) (about 0.270.270.27 at ϵ=1\epsilon=1ϵ=1). The hypotheses ϵ≤1\epsilon \le 1ϵ≤1 and n≤VCDIM(C)/2n \le \mathrm{VCDIM}(C)/2n≤VCDIM(C)/2 are the paper's, the latter written 2n≤VCDIM(C)2n \le \mathrm{VCDIM}(C)2n≤VCDIM(C) in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞}.
  • Ruled out. The statement quantifies over every mechanism satisfying the hypotheses, randomized or not, so no restriction to deterministic or constant-output mechanisms makes the bound easy. The usefulness event is weighed by a probability measure, so the zero measure cannot be "useful". The constant cannot depend on nnn, ddd, XXX or CCC.
  • Infrastructure. The development reuses the published PrivLearn.Generic.Privacy (neighbours, IsDP) and Vershynin's HighDimProb.Chaining.Shatters and vcDim. Contributions needed: subsets of shattered sets are shattered, and 2n≤VCDIM(C)2n \le \mathrm{VCDIM}(C)2n≤VCDIM(C) yields a shattered set of size exactly 2n2n2n; measurability of the argmin reconstruction; the averaging/bijection argument. The first two are reusable beyond this mission.

Selected references

  • A. Blum, K. Ligett, A. Roth, A Learning Theory Approach to Non-Interactive Database Privacy, arXiv:1109.2229v1 (2011); J. ACM 60(2), 2013. https://arxiv.org/abs/1109.2229 , https://doi.org/10.1145/2450142.2450148
  • C. Dwork, F. McSherry, K. Nissim, A. Smith, Calibrating Noise to Sensitivity in Private Data Analysis, TCC 2006. https://doi.org/10.1007/11681878_14
  • I. Dinur, K. Nissim, Revealing Information while Preserving Privacy, PODS 2003. https://doi.org/10.1145/773153.773173
  • M. Bun, J. Ullman, S. Vadhan, Fingerprinting Codes and the Price of Approximate Differential Privacy, STOC 2014. https://arxiv.org/abs/1311.3158
  • R. Vershynin, High-Dimensional Probability, Cambridge University Press, 2018, §8.3 (VC dimension). https://doi.org/10.1017/9781108231596
9 thms1 active userReviewed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

Matroid Prophet Inequalities 2: On an Intersection of p Matroids, the Summed-Threshold Algorithm Earns at Least 1/(4p−2) of the Expected OptimumResearch Paper

Motivation

A prophet inequality compares a gambler who sees independent random rewards one at a time, and must accept or reject each on arrival, with a prophet who sees all rewards in advance. The classical inequality of Krengel, Sucheston and Garling (1977–78, as cited in the paper) says that when only one reward may be kept, a single threshold rule earns at least half of E[max⁡iXi]\mathbb E[\max_i X_i]E[maxi​Xi​], and Samuel-Cahn (1984) showed that the threshold can be chosen as a median. Such statements are the analytical core of sequential posted-price mechanisms: Hajiaghayi, Kleinberg and Sandholm (2007) observed that threshold rules are truthful online auctions, and Chawla, Hartline, Malec and Sivan (2010) showed that sequential posted prices approximate the optimal Bayesian revenue in many settings, with prophet inequalities for the feasibility constraint as the key technique.

When several items may be accepted subject to a combinatorial constraint, the natural constraints in this application are matroids (for example, at most kkk items, or at most one item per group) and intersections of matroids (for example, bipartite matchings, which are intersections of two partition matroids). Kleinberg and Weinberg (STOC 2012) proved that for every matroid there is an online algorithm with expected payoff at least half of the expected maximum-weight basis, and that for the intersection of ppp matroids the summed version of the same algorithm earns at least 14p−2\frac{1}{4p-2}4p−21​ of the expected optimum. This mission formalizes the second result.

Timeline:

  • 1977–78: Krengel–Sucheston and Garling, single-choice prophet inequality with factor 2.
  • 1984: Samuel-Cahn, the median threshold rule attains factor 2.
  • 2007: Hajiaghayi–Kleinberg–Sandholm, threshold rules from prophet inequalities read as truthful online auction mechanisms.
  • 2010: Chawla–Hartline–Malec–Sivan, sequential posted pricing; factor 2 for matroids when the algorithm may choose the order in which elements are observed.
  • 2012: Kleinberg–Weinberg, factor 2 for matroids and 4p−24p-24p−2 for intersections of ppp matroids, against online weight-adaptive adversaries.

Setting

A finite ground set U\mathcal UU carries p≥1p \ge 1p≥1 matroids M1,…,Mp\mathcal M_1,\dots,\mathcal M_pM1​,…,Mp​ with independent sets I1,…,Ip\mathcal I_1,\dots,\mathcal I_pI1​,…,Ip​ and closure operators cl1,…,clp\mathrm{cl}_1,\dots,\mathrm{cl}_pcl1​,…,clp​. A set is feasible if it lies in I=⋂jIj\mathcal I = \bigcap_j \mathcal I_jI=⋂j​Ij​. Each element xxx has a random weight w(x)≥0w(x) \ge 0w(x)≥0; the weights are independent and w(x)w(x)w(x) has law FxF_xFx​. For a set SSS, w(S)=∑x∈Sw(x)w(S) = \sum_{x \in S} w(x)w(S)=∑x∈S​w(x), OPT(w)=max⁡{w(S):S∈I}\mathrm{OPT}(w) = \max\{w(S) : S \in \mathcal I\}OPT(w)=max{w(S):S∈I}, and OPT=E[OPT(w)]\mathrm{OPT} = \mathbb E[\mathrm{OPT}(w)]OPT=E[OPT(w)].

An online weight-adaptive adversary reveals the elements one at a time; it chooses the iii-th element xix_ixi​ after learning w(x1),…,w(xi−1)w(x_1),\dots,w(x_{i-1})w(x1​),…,w(xi−1​), but without knowing w(xi)w(x_i)w(xi​) or any other unrevealed weight. A threshold algorithm offers xix_ixi​ a threshold TiT_iTi​ computed from what has been revealed and from the set Ai−1A_{i-1}Ai−1​ already selected, and selects xix_ixi​ exactly when Ai−1∪{xi}∈IA_{i-1}\cup\{x_i\}\in\mathcal IAi−1​∪{xi​}∈I and w(xi)≥Tiw(x_i) \ge T_iw(xi​)≥Ti​.

The algorithm of the paper uses a ghost sample w′w'w′, an independent copy of www. Let BBB be a w′w'w′-maximum feasible set. For a set AAA and each jjj, Rj(A)⊆B∖AR_j(A) \subseteq B \setminus ARj​(A)⊆B∖A is a set of maximum w′w'w′-weight with A∪Rj(A)∈IjA \cup R_j(A) \in \mathcal I_jA∪Rj​(A)∈Ij​ and B⊆clj(A∪Rj(A))B \subseteq \mathrm{cl}_j(A \cup R_j(A))B⊆clj​(A∪Rj​(A)), and Cj(A)=B∖Rj(A)C_j(A) = B \setminus R_j(A)Cj​(A)=B∖Rj​(A). Put R(A)=⋂jRj(A)R(A) = \bigcap_j R_j(A)R(A)=⋂j​Rj​(A) and C(A)=⋃jCj(A)C(A) = \bigcup_j C_j(A)C(A)=⋃j​Cj​(A). For a parameter α\alphaα, the summed thresholds are

T(A,i)=∑j=1p1α Ew′[w′(Rj(A))−w′(Rj(A∪{xi}))],T(A,i) = \sum_{j=1}^p \frac1\alpha\, \mathbb E_{w'}\big[w'(R_j(A)) - w'(R_j(A \cup \{x_i\}))\big],T(A,i)=j=1∑p​α1​Ew′​[w′(Rj​(A))−w′(Rj​(A∪{xi​}))],

and the algorithm of §4.2 uses Ti=T(Ai−1,i)T_i = T(A_{i-1}, i)Ti​=T(Ai−1​,i). An algorithm has α\alphaα-balanced thresholds (Definition 3) if, for every input sequence with selected set AAA and every VVV disjoint from AAA with A∪V∈IA \cup V \in \mathcal IA∪V∈I,

∑xi∈ATi≥1αE[∑jw′(Cj(A))],∑xi∈VTi≤1αE[∑jw′(Rj(A))].\sum_{x_i\in A} T_i \ge \frac1\alpha \mathbb E\Big[\sum_j w'(C_j(A))\Big], \qquad \sum_{x_i\in V} T_i \le \frac1\alpha \mathbb E\Big[\sum_j w'(R_j(A))\Big].xi​∈A∑​Ti​≥α1​E[j∑​w′(Cj​(A))],xi​∈V∑​Ti​≤α1​E[j∑​w′(Rj​(A))].

Formalization targets

Goal: the prophet inequality for ppp matroids

For every p≥1p \ge 1p≥1, all matroids M1,…,Mp\mathcal M_1,\dots,\mathcal M_pM1​,…,Mp​ on U\mathcal UU, all laws FxF_xFx​ on [0,∞)[0,\infty)[0,∞) with finite means, and every online weight-adaptive adversary, the algorithm of §4.2 with α=2p\alpha = 2pα=2p selects a set AAA with

E[w(A)]≥14p−2 E[OPT(w)].\mathbb E[w(A)] \ge \frac{1}{4p-2}\, \mathbb E[\mathrm{OPT}(w)].E[w(A)]≥4p−21​E[OPT(w)].

For p=1p = 1p=1 this is the factor-2 matroid prophet inequality.

Proposition 3

If a threshold algorithm has α\alphaα-balanced thresholds for some α≥2\alpha \ge 2α≥2, then against every online weight-adaptive adversary

E[w(A)]≥α−pα(α−1) OPT.\mathbb E[w(A)] \ge \frac{\alpha - p}{\alpha(\alpha-1)}\, \mathrm{OPT}.E[w(A)]≥α(α−1)α−p​OPT.

Milestones

Proposition 2 for each matroid Mj\mathcal M_jMj​; the identity between the two forms of T(A,i,j)T(A,i,j)T(A,i,j); properties (13) and (14) for the summed thresholds; the identities (20)–(21); and the inequalities (23)–(24) of Appendix A. Together with Proposition 3 these give the goal.

Significance

The bound gives a posted-price style selection rule for any feasibility constraint that is an intersection of ppp matroids, with a guarantee depending only on ppp; the paper's §5 shows that a ratio of order ppp is necessary. Section 6 of the paper turns the result into sequential posted-price mechanisms for multi-dimensional mechanism design, and that application needs the guarantee against the online weight-adaptive adversary, not only against a fixed order. The reduction "balanced thresholds imply an approximation" (Proposition 3) is reusable for other threshold constructions.

The result is proved in the paper; to our knowledge no machine-checked proof exists. The mission produces a formal proof of the 14p−2\frac{1}{4p-2}4p−21​ guarantee, with the probabilistic part (the ghost-sample argument against an adaptive adversary) and the combinatorial part (the per-matroid exchange inequality) as separate milestones. The paper justifies the per-matroid use of Proposition 2 in one paragraph; because BBB maximizes w′w'w′ over the intersection rather than over Ij\mathcal I_jIj​, the description of Rj(A)R_j(A)Rj​(A) as a maximum-weight basis of a contraction (Lemma 2 in the single-matroid case) does not apply verbatim, and the formal proof of that milestone is not a copy of the paper's single-matroid argument.

Difficulty

Two steps do not follow from routine bookkeeping. First, the inequality (23) compares the gambler's surplus, collected along an order that the adversary adapts to the realized weights, with the ghost sample's surplus on the random set R(A)R(A)R(A). The index xix_ixi​ revealed at step iii is itself random, so the step "the weight of the element offered next is distributed as its ghost weight" has to be justified for an adaptively chosen index under a product measure; it fails for an adversary that may look at unrevealed weights. Second, the paper obtains (14) by applying the single-matroid Proposition 2 to each Mj\mathcal M_jMj​, but its proof of Proposition 2 describes R(A)R(A)R(A) as a maximum-weight basis of a contraction, which uses that BBB is optimal for the matroid in question. Here BBB is optimal only for the intersection I\mathcal II, so the obvious transfer of the single-matroid argument does not go through as written and the per-matroid statement needs its own proof.

Formalization scope

The ground set is a Fintype; the matroids are Mathlib's Matroid α, indexed by Fin p, each with ground set Set.univ; sets are Finset α. Weights are functions α → ℝ, the weight law is Measure.pi F, and every theorem assumes each F x is a probability measure with F x (Iio 0) = 0 and a finite mean. Expectations are Bochner integrals; under these assumptions every integrand is integrable. Ties in the maximizers BBB and Rj(A)R_j(A)Rj​(A) are broken by a fixed rule that does not depend on the weights. Rj(A)R_j(A)Rj​(A) is taken disjoint from AAA. The threshold ∞\infty∞ on infeasible steps is a feasibility test in the selection rule. Adversaries and generic threshold rules are deterministic, see only revealed weights, and are measurable in them; randomized adversaries are mixtures of deterministic ones. Generic thresholds in Proposition 3, (23) and (24) are non-negative, as in the paper's Ti∈R+∪{∞}T_i \in \mathbb R_+ \cup \{\infty\}Ti​∈R+​∪{∞}.

The goal fixes the thresholds to the summed thresholds of §4.2 with α=2p\alpha = 2pα=2p, computed from the ghost-sample objects. A version in which the thresholds are free parameters assumed to satisfy (13)–(14) would be Proposition 3 itself and is ruled out; conversely, Proposition 3 does not mention the §4.2 thresholds.

A complete development needs: elementary facts about maximizers over finite families; matroid exchange properties (a bijective exchange between equal-size independent sets, available in Schrijver's book but not in Mathlib); submodularity of weighted-rank-type functions; and the independence argument for adaptively chosen indices under a product measure. The last two are reusable beyond this mission, as is Proposition 3. Proofs of individual milestones and of these auxiliary facts are welcome.

Selected references

  • R. Kleinberg, S. M. Weinberg, Matroid Prophet Inequalities, STOC 2012; arXiv:1201.4764v1. https://arxiv.org/abs/1201.4764, https://doi.org/10.1145/2213977.2213991
  • U. Krengel, L. Sucheston, Semiamarts and finite values, Bull. Amer. Math. Soc. 83 (1977), 745–747.
  • E. Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Ann. Probab. 12 (1984). https://doi.org/10.1214/aop/1176993150
  • M. T. Hajiaghayi, R. Kleinberg, T. Sandholm, Automated online mechanism design and prophet inequalities, Proc. 22nd AAAI Conference on Artificial Intelligence, 2007, pp. 58–65.
  • S. Chawla, J. Hartline, D. Malec, B. Sivan, Multi-parameter mechanism design and sequential posted pricing, STOC 2010, pp. 311–320; arXiv:0907.2435. https://arxiv.org/abs/0907.2435
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer 2003 (Corollary 39.12a).
12 thms1 active userReviewed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

Matroid Prophet Inequalities 1: Against Any Online Weight-Adaptive Adversary, the 2-Balanced Threshold Algorithm Earns at Least Half the Expected Max-Weight BasisResearch Paper

Motivation

The prophet inequality of optimal stopping compares a gambler, who sees independent non-negative random values X1,…,XnX_1, \dots, X_nX1​,…,Xn​ one at a time and must accept or reject each on arrival, with a prophet who sees them all in advance. Krengel, Sucheston and Garling showed that the gambler can secure E[Xτ]≥12 E[max⁡iXi]\mathbb E[X_\tau] \ge \tfrac12\,\mathbb E[\max_i X_i]E[Xτ​]≥21​E[maxi​Xi​], and Samuel-Cahn showed that a single threshold suffices. Since Hajiaghayi, Kleinberg and Sandholm (2007) and Chawla, Hartline, Malec and Sivan (2010), prophet inequalities have served as the approximation guarantees of sequential posted-price mechanisms: an online selection rule with a prophet guarantee turns into a truthful mechanism with a revenue guarantee.

The natural multi-choice generalization lets the gambler accept a set of elements, subject to a feasibility constraint. Kleinberg and Weinberg, Matroid Prophet Inequalities (STOC 2012, arXiv:1201.4764), proved that when the feasible sets are the independent sets of a matroid, the factor 12\tfrac1221​ is still achievable, by an explicit threshold rule, and even when the order of arrival is chosen adaptively by an adversary.

Timeline:

  • 1977–78: Krengel and Sucheston, with Garling: the single-choice prophet inequality with factor 12\tfrac1221​, which is tight.
  • 1984: Samuel-Cahn: a single fixed threshold attains 12\tfrac1221​.
  • 2007: Hajiaghayi, Kleinberg, Sandholm: prophet inequalities read as truthful online auctions, with multi-choice prophet inequalities.
  • 2010: Chawla, Hartline, Malec, Sivan: posted-price mechanisms via prophet inequalities, and factor 12\tfrac1221​ for matroids when the algorithm may choose the order of arrival.
  • 2012: Kleinberg–Weinberg: factor 12\tfrac1221​ for every matroid against an online weight-adaptive adversary, and 14p−2\tfrac1{4p-2}4p−21​ for intersections of ppp matroids.

Setting

Let U\mathcal UU be a finite ground set and M=(U,I)\mathcal M = (\mathcal U, \mathcal I)M=(U,I) a matroid; I\mathcal II is its family of independent sets. For each x∈Ux \in \mathcal Ux∈U a distribution FxF_xFx​ on [0,∞)[0,\infty)[0,∞) is given; the weights w(x)w(x)w(x) are independent with w(x)∼Fxw(x) \sim F_xw(x)∼Fx​, and w(A)=∑x∈Aw(x)w(A) = \sum_{x \in A} w(x)w(A)=∑x∈A​w(x). Let OPT(w)=max⁡{w(S):S∈I}\mathrm{OPT}(w) = \max\{w(S) : S \in \mathcal I\}OPT(w)=max{w(S):S∈I} and OPT=E[OPT(w)]\mathrm{OPT} = \mathbb E[\mathrm{OPT}(w)]OPT=E[OPT(w)].

An online weight-adaptive adversary reveals the elements one at a time: it picks xix_ixi​ knowing w(x1),…,w(xi−1)w(x_1), \dots, w(x_{i-1})w(x1​),…,w(xi−1​) but not w(xi)w(x_i)w(xi​). An online algorithm maintains a selected set Ai−1∈IA_{i-1} \in \mathcal IAi−1​∈I and, when xix_ixi​ arrives with its weight, irrevocably accepts or rejects it, keeping AiA_iAi​ independent. A threshold rule offers xix_ixi​ a threshold TiT_iTi​ computed from the revealed prefix (and Ti=∞T_i = \inftyTi​=∞ when Ai−1∪{xi}∉IA_{i-1} \cup \{x_i\} \notin \mathcal IAi−1​∪{xi​}∈/I) and accepts iff w(xi)≥Tiw(x_i) \ge T_iw(xi​)≥Ti​.

The algorithm of the paper uses a ghost sample: an independent copy w′w'w′ of the weights. Let BBB be a w′w'w′-maximum-weight basis. For an independent set AAA, among the partitions B=C⊔RB = C \sqcup RB=C⊔R with R∩A=∅R \cap A = \emptysetR∩A=∅ and A∪RA \cup RA∪R a basis, R(A)R(A)R(A), C(A)C(A)C(A) denote one maximizing w′(R)w'(R)w′(R). The algorithm (9) sets

Ti=12 Ew′[w′(R(Ai−1))−w′(R(Ai−1∪{xi}))].T_i = \tfrac12\,\mathbb E_{w'}\big[w'(R(A_{i-1})) - w'(R(A_{i-1}\cup\{x_i\}))\big].Ti​=21​Ew′​[w′(R(Ai−1​))−w′(R(Ai−1​∪{xi​}))].

Formalization targets

Goal: the matroid prophet inequality

For every matroid on a finite ground set, every family of distributions FxF_xFx​ on [0,∞)[0,\infty)[0,∞) with finite means, and every online weight-adaptive adversary, the set AAA selected by the algorithm (9) satisfies

E[w(A)]  ≥  12 OPT.\mathbb E[w(A)] \;\ge\; \tfrac12\,\mathrm{OPT}.E[w(A)]≥21​OPT.

The goal is stated for the paper's own algorithm, which is stronger than the existence statement of §3.

Milestones

  1. Proposition 1 (with Definition 1): any threshold rule with α\alphaα-balanced thresholds,
∑xi∈ATi≥1α E[w′(C(A))],∑xi∈VTi≤(1−1α) E[w′(R(A))],\sum_{x_i\in A} T_i \ge \tfrac1\alpha\,\mathbb E[w'(C(A))], \qquad \sum_{x_i\in V} T_i \le \big(1-\tfrac1\alpha\big)\,\mathbb E[w'(R(A))],xi​∈A∑​Ti​≥α1​E[w′(C(A))],xi​∈V∑​Ti​≤(1−α1​)E[w′(R(A))],

earns E[w(A)]≥1α OPT\mathbb E[w(A)] \ge \tfrac1\alpha\,\mathrm{OPT}E[w(A)]≥α1​OPT. 2. The identity behind (9) = (10), and the telescoping identity ∑xi∈ATi=12 E[w′(C(A))]\sum_{x_i \in A} T_i = \tfrac12\,\mathbb E[w'(C(A))]∑xi​∈A​Ti​=21​E[w′(C(A))] (Property (2) for α=2\alpha = 2α=2). 3. Lemma 1 (bijective basis exchange, and its weighted form), Lemma 2 (R(A)R(A)R(A) is a maximum-weight basis of the contraction M/A\mathcal M/AM/A), Lemma 3 (S↦w′(R(S))S \mapsto w'(R(S))S↦w′(R(S)) is submodular on subsets of an independent set). 4. Inequalities (11) and (12), and Proposition 2:

∑xi∈V[w′(R(Ai−1))−w′(R(Ai−1∪{xi}))]≤w′(R(A)),\sum_{x_i \in V}\big[w'(R(A_{i-1})) - w'(R(A_{i-1}\cup\{x_i\}))\big] \le w'(R(A)),xi​∈V∑​[w′(R(Ai−1​))−w′(R(Ai−1​∪{xi​}))]≤w′(R(A)),

pointwise in w′≥0w' \ge 0w′≥0; then Property (3) with α=2\alpha = 2α=2 for the thresholds (9).

Significance

The theorem gives the optimal constant: already for a rank-one matroid (choose one element) no online algorithm beats 12\tfrac1221​. It covers every matroid with one algorithm, including uniform, partition, graphic and transversal matroids, which model capacity, unit-demand and spanning-tree constraints. Through the reduction of Chawla et al., the paper derives from it order-oblivious posted-price mechanisms that are 2-approximations to the optimal revenue in single-parameter settings with matroid feasibility and, through the adaptive adversary, in multi-dimensional unit-demand settings (§6 of the paper). The decomposition through α\alphaα-balanced thresholds is reused in the paper for intersections of ppp matroids, with factor 14p−2\tfrac1{4p-2}4p−21​.

The result has been proved since 2012; it has not been formalized. The mission produces a machine-checked development of the model (online adaptive adversaries, threshold rules, the ghost-sample expectations), of the general reduction (Proposition 1), and of the matroid facts the algorithm relies on, notably the bijective exchange lemma (Schrijver, Corollary 39.12a), which is not in Mathlib.

Difficulty

The obvious argument fixes the order of arrival and compares the algorithm with the prophet item by item. It fails here because the order is chosen adaptively from the revealed weights, so the set of elements still to come is random and correlated with the past. The proof must instead compare the algorithm's realized selection with a ghost optimum BBB built from an independent sample, and bound the value the algorithm forgoes by the value the ghost optimum could still add, E[w′(R(A))]\mathbb E[w'(R(A))]E[w′(R(A))]. The step that needs matroid structure is Property (3): the total threshold offered to any set VVV that could still be added must be at most half of E[w′(R(A))]\mathbb E[w'(R(A))]E[w′(R(A))]. The thresholds were computed along the history A0⊆A1⊆…A_0 \subseteq A_1 \subseteq \dotsA0​⊆A1​⊆…, not at the final AAA, so the bound requires the submodularity of S↦w′(R(S))S \mapsto w'(R(S))S↦w′(R(S)) (Lemma 3) and a weight-dominating exchange between VVV and R(A)R(A)R(A) in the contraction M/A\mathcal M/AM/A. Neither holds for general downward-closed families.

Formalization scope

  • The ground set is a Fintype α; the matroid is Mathlib's Matroid α with ground set Set.univ; sets are Finset α; contraction is Matroid.contract.
  • The distributions are F : α → Measure ℝ, probability measures with F x (Set.Iio 0) = 0 (support in [0,∞)[0,\infty)[0,∞)) and Integrable id (F x) (finite means). The weight law is Measure.pi F, and every expectation is a Bochner integral over it. Finite means make OPT(w)\mathrm{OPT}(w)OPT(w), w(A)w(A)w(A) and the integrands of the thresholds integrable, so no expectation is a junk value.
  • OPT(w)\mathrm{OPT}(w)OPT(w) is a maximum over the nonempty finset of independent sets. The maximum-weight basis B(w′)B(w')B(w′) and the maximizer R(A)R(A)R(A) are fixed by choice when weights tie; Lemma 2 shows w′(R(A))w'(R(A))w′(R(A)) does not depend on the choice. R(A)R(A)R(A) is required to be disjoint from AAA, as Lemma 2's placement of R(A)R(A)R(A) in M/A\mathcal M/AM/A needs.
  • A threshold rule is a real-valued function of the current selection, the revealed list, the weights and the arriving element, non-negative, depending on the weights only through revealed ones, measurably; the value ∞\infty∞ on infeasible steps is an independence guard in the acceptance test. "Monotone algorithm" in Proposition 1 means such a rule.
  • An adversary is a deterministic map from the revealed list and the weights to the next unrevealed element, depending only on revealed weights and measurable. Randomized adversaries are mixtures of these.
  • Lemma 1, part 2 is stated for disjoint VVV and RRR: as printed it fails when they overlap, and the paper uses it only for disjoint sets.

The goal fixes the thresholds by (9) through BBB, R(⋅)R(\cdot)R(⋅) and the ghost expectation; a statement in which the thresholds are free parameters assumed to satisfy (2)–(3) would be Proposition 1 and is not the goal.

Contributions are welcome at every level: the measurability of the online run, the exchange lemma for Mathlib matroids, the greedy characterization of maximum-weight bases of a contraction, and the probabilistic core (7) of Proposition 1. The matroid lemmas are reusable beyond this mission, in particular by the matroid-intersection mission of the same paper.

Selected references

  • R. Kleinberg, S. M. Weinberg, Matroid Prophet Inequalities, STOC 2012; arXiv:1201.4764v1. https://arxiv.org/abs/1201.4764 , https://doi.org/10.1145/2213977.2213991
  • U. Krengel, L. Sucheston, Semiamarts and finite values, Bull. Amer. Math. Soc. 83, 745–747, 1977.
  • U. Krengel, L. Sucheston, On semiamarts, amarts, and processes with finite value, Advances in Probability and Related Topics 4, 197–266, 1978.
  • E. Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Annals of Probability 12(4), 1213–1216, 1984.
  • M. T. Hajiaghayi, R. Kleinberg, T. Sandholm, Automated mechanism design and prophet inequalities, AAAI 2007, pp. 58–65.
  • S. Chawla, J. Hartline, D. Malec, B. Sivan, Multi-parameter mechanism design and sequential posted pricing, STOC 2010, pp. 311–320.
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer, 2003 (Corollary 39.12a).
16 thms1 active userReviewed
Graph TheoryOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Hardness of Approximating Flow and Job Shop Scheduling Problems 2: Coloring Reduction Gap: Makespan 2L·lb if G Is L-Colorable, Independent Set of Size n/(8L) if Half the Jobs Finish by L·lbResearch Paper

Motivation

In the job shop problem, jobs are sequences of operations, each to be processed on a given machine for a given time, and the goal is a schedule of minimum makespan (the time at which the last job finishes). Two numbers bound the optimum from below: the longest job and the most loaded machine. Their maximum is written lb\mathrm{lb}lb. The best approximation algorithms for job shops have a performance guarantee polylogarithmic in lb\mathrm{lb}lb (Shmoys, Stein and Wein 1994; Goldberg, Paterson, Srinivasan and Sweedyk 2001). Whether flow shops and job shops admit a constant-factor approximation was Open Problem 7 of Schuurman and Woeginger (1999).

Mastrolilli and Svensson (J. ACM 58(5), 2011) answered it negatively for the generalized flow shop. Their Theorem 1.2 states that for all sufficiently large constants KKK it is NP-hard to distinguish generalized flow shop instances with a schedule of makespan 2K⋅lb2K\cdot\mathrm{lb}2K⋅lb from instances in which no schedule finishes more than half of the jobs within 18K(1/25)log⁡K⋅lb\tfrac18 K^{(1/25)\log K}\cdot\mathrm{lb}81​K(1/25)logK⋅lb. The proof is a gap-preserving reduction Γ\GammaΓ from graph colouring. This mission formalizes the combinatorial heart of that reduction.

Timeline. Shmoys, Stein and Wein (1994) gave an O((log⁡lb)2/log⁡log⁡lb)O((\log\mathrm{lb})^2/\log\log\mathrm{lb})O((loglb)2/logloglb)-approximation for job shops, improved by a log⁡log⁡lb\log\log\mathrm{lb}logloglb factor by Goldberg et al. (2001). Williamson et al. (1997) proved that approximating flow shops with unit operations within a ratio better than 5/45/45/4 is NP-hard. Feige and Scheideler (2002) gave acyclic job shop instances with optimum Ω(lblog⁡lb/log⁡log⁡lb)\Omega(\mathrm{lb}\log\mathrm{lb}/\log\log\mathrm{lb})Ω(lbloglb/logloglb) and asked whether flow shops admit a much better upper bound than O(lblog⁡lblog⁡log⁡lb)O(\mathrm{lb}\log\mathrm{lb}\log\log\mathrm{lb})O(lbloglblogloglb). Khot (2001) proved the colouring hardness this reduction starts from. Mastrolilli and Svensson (FOCS 2008; J. ACM 2011) proved Theorem 1.2 and its job shop variants.

Setting

A generalized flow shop (flow shop with jumps) is a job shop with a fixed linear order on the machines in which every job visits its machines in increasing order but may skip machines. Operations may have length 000. A zero-length operation still occupies its machine for an instant, so it cannot be processed strictly inside another operation on the same machine.

Let G=(V,E)G=(V,E)G=(V,E) be a simple graph with nnn vertices whose vertices are partitioned into ddd independent sets I1,…,IdI_1,\dots,I_dI1​,…,Id​. Vertex v∈Ifv\in I_fv∈If​ has frequency f(v)=ff(v)=ff(v)=f. For an integer rrr write lb=r2d\mathrm{lb}=r^{2d}lb=r2d. The instance S(r,d)S(r,d)S(r,d) has r2dr^{2d}r2d groups M1,…,Mr2dM_1,\dots,M_{r^{2d}}M1​,…,Mr2d​ of machines, each with one machine mg,vm_{g,v}mg,v​ per vertex. The machines are ordered by group first and, within a group, by decreasing frequency. A vertex vvv of frequency fff owns r2(d−f)r^{2(d-f)}r2(d−f) groups of r2fr^{2f}r2f identical jobs. The job jg,ivj^v_{g,i}jg,iv​ has a long-operation of length r2(d−f)r^{2(d-f)}r2(d−f) on each of the r2fr^{2f}r2f machines ma+1,v,…,ma+r2f,vm_{a+1,v},\dots,m_{a+r^{2f},v}ma+1,v​,…,ma+r2f,v​, where a=(g−1)r2fa=(g-1)r^{2f}a=(g−1)r2f. It also has a short-operation of length 000 on every machine of every neighbour of vvv, in every group. A long-operation is good if the next long-operation of the same job starts at most r24r2(d−f)\tfrac{r^2}{4}r^{2(d-f)}4r2​r2(d−f) time units after it ends. Tg,vT_{g,v}Tg,v​ is the set of first halves of the good long-operations on mg,vm_{g,v}mg,v​, and L(Tg,v)L(T_{g,v})L(Tg,v​) is the time they cover.

χ(G)\chi(G)χ(G) is the chromatic number of GGG and α(G)\alpha(G)α(G) the size of its largest independent set.

Formalization targets

Goal: the gap of Γ\GammaΓ

For every graph GGG with a proper colouring into ddd classes and every integer r≥8r\ge 8r≥8, with S=S(r,d)S=S(r,d)S=S(r,d):

(a)S is a generalized flow shop, every job has length r2d and every machine load r2d;\text{(a)}\quad S \text{ is a generalized flow shop, every job has length } r^{2d} \text{ and every machine load } r^{2d};(a)S is a generalized flow shop, every job has length r2d and every machine load r2d; (b)G is K-colourable ⟹ Cmax⁡∗(S)≤2K⋅r2d;\text{(b)}\quad G \text{ is } K\text{-colourable} \ \Longrightarrow\ C^*_{\max}(S)\le 2K\cdot r^{2d};(b)G is K-colourable ⟹ Cmax∗​(S)≤2K⋅r2d; (c)0<L≤r,  α(G)<n8L ⟹ in every feasible schedule fewer than half of the jobs finish by L⋅r2d.\text{(c)}\quad 0<L\le r,\ \ \alpha(G) < \tfrac{n}{8L} \ \Longrightarrow\ \text{in every feasible schedule fewer than half of the jobs finish by } L\cdot r^{2d}.(c)0<L≤r,  α(G)<8Ln​ ⟹ in every feasible schedule fewer than half of the jobs finish by L⋅r2d.

Milestones

Remark 3.6 (lengths, loads, operation count), Claim 3.8 (an independent set's jobs fit in 2⋅lb2\cdot\mathrm{lb}2⋅lb), Lemma 3.7 (completeness), Lemma 3.10 (most long-operations are good), Lemma 3.11 (adjacent vertices have disjoint TTT-intervals), Lemma 3.12 (one group carries lb⋅n/8\mathrm{lb}\cdot n/8lb⋅n/8 of first-half time), and Lemma 3.9 (soundness: an independent set of size n/(8L)n/(8L)n/(8L)).

Significance

The result. Together with Khot's colouring hardness, the gap shows that no polynomial-time algorithm approximates the generalized flow shop within any constant factor unless P = NP, and rules out an O((log⁡lb)1−ϵ)O((\log\mathrm{lb})^{1-\epsilon})O((loglb)1−ϵ)-approximation under a stronger complexity assumption (Theorem 1.3). It also shows that on the no-instances of the reduction every schedule has makespan greater than L⋅lbL\cdot\mathrm{lb}L⋅lb, far above the trivial lower bound lb\mathrm{lb}lb. Because soundness bounds the number of jobs finished early, the same reduction also gives hardness for the sum of completion times (footnote 2).

Formalizing it. The paper proves every statement of this mission; none is open. As far as the catalog shows, none has a machine-checked proof. The soundness argument rests on a timing property of zero-length operations: a job of higher frequency must wait for a long-operation of an adjacent lower-frequency job. Such properties are easy to state loosely and easy to get wrong, so a verified proof would be useful. A formal proof would also make explicit the thresholds the paper leaves as "sufficiently large rrr".

Difficulty

Completeness is constructive and routine once the job and machine indexing is under control. The difficulty is soundness. One might argue directly that jobs of adjacent vertices never overlap in time, but that is false: a schedule may run them in parallel at the cost of delays. The argument controls it only on average. It throws away the jobs that finish late and the long-operations followed by a long delay. It shows that the first halves of the remaining long-operations of adjacent vertices are disjoint in each machine group. Then it finds a moment covered by many such first halves. Each step needs a precise count: of good operations per job, of covered time per group, and of overlap multiplicity at a point. The degenerate conventions (empty colour classes, n=0n=0n=0, the last long-operation of a job) have to be handled throughout.

Formalization scope

The instance is the published JobShopLTAS.Core.Instance (machines and jobs Fin (r^{2d} n), real nonnegative processing times, disjunctive machine constraint under which a zero-length operation cannot sit strictly inside another operation on its machine), with its IsFeasibleSchedule and makespan. The graph has vertex set Fin n and the partition into independent sets is a Mathlib proper colouring G.Coloring (Fin d). Frequencies f(v)=c(v)+1f(v)=c(v)+1f(v)=c(v)+1 are 1-based, as are group indices. Within a group the paper leaves machines of equal frequency unordered; they are ordered by vertex index. Every job's operation list is its machine set sorted by the global order. L(Tg,v)L(T_{g,v})L(Tg,v​) is the Lebesgue measure of the union of the intervals.

Explicit readings of the paper's wording:

  • "sufficiently large rrr" is r≥8r\ge 8r≥8 (from (1−4/r)≥1/2(1-4/r)\ge 1/2(1−4/r)≥1/2 in the proof of Lemma 3.12 via Lemma 2.4); Lemma 3.11 needs only r≥2r\ge 2r≥2, Lemma 3.10 r≥1r\ge 1r≥1;
  • "χ(G)=L\chi(G)=Lχ(G)=L" in Lemma 3.7 is LLL-colourability, and "makespan lb⋅2L\mathrm{lb}\cdot 2Llb⋅2L" is makespan at most 2L r2d2L\,r^{2d}2Lr2d;
  • "at least half the jobs finish within lb⋅L\mathrm{lb}\cdot Llb⋅L" is 2⋅#{j:Cj≤L r2d}≥r2dn2\cdot\#\{j: C_j\le L\,r^{2d}\}\ge r^{2d}n2⋅#{j:Cj​≤Lr2d}≥r2dn, with CjC_jCj​ the end of the last operation of jjj, and LLL is real with 0<L≤r0<L\le r0<L≤r;
  • the operation count is Remark 3.6's (Δ+1)r2d(\Delta+1)r^{2d}(Δ+1)r2d for a degree bound Δ\DeltaΔ, not the section introduction's d r2dd\,r^{2d}dr2d;
  • the goal's soundness is the contrapositive of Lemma 3.9; Lemma 3.9 itself is stated positively.

Not formalized: "NP-hard", "for all sufficiently large KKK", "in time polynomial in nnn and rdr^drd", Khot's Theorem 1.7, the choice d=Δ+1d=\Delta+1d=Δ+1, r=K(1/25)log⁡Kr=K^{(1/25)\log K}r=K(1/25)logK, and the randomized Lemma 3.1 behind Theorem 1.3.

A model in which zero-length operations occupy no machine time would make soundness false, and stating soundness only for schedules of an independent set's jobs would make it vacuous. The goal is about every feasible schedule of S(r,d)S(r,d)S(r,d), built from (G,c,r)(G,c,r)(G,c,r), in the published model, where zero-length operations do conflict.

A complete development needs counting lemmas for the indexing of jobs and machines, sorting facts for the operation lists, and a measure-theoretic averaging argument (a point covered by many intervals). The averaging argument and the good-operation counting are shared with the flow shop gap of Theorem 1.1 and reusable there. Proofs of any milestone, and sorry-free sanity checks on small instances, are welcome.

Selected references

  • M. Mastrolilli, O. Svensson, Hardness of Approximating Flow and Job Shop Scheduling Problems, J. ACM 58(5), Article 20, 2011. https://doi.org/10.1145/2027216.2027218
  • S. Khot, Improved inapproximability results for MaxClique, chromatic number and approximate graph coloring, FOCS 2001, 600–609. https://doi.org/10.1109/SFCS.2001.959936
  • D. B. Shmoys, C. Stein, J. Wein, Improved approximation algorithms for shop scheduling problems, SIAM J. Comput. 23, 617–632, 1994. https://doi.org/10.1137/S009753979222676X
  • L. A. Goldberg, M. Paterson, A. Srinivasan, E. Sweedyk, Better approximation guarantees for job-shop scheduling, SIAM J. Discrete Math. 14(1), 67–92, 2001. https://doi.org/10.1137/S0895480199326104
  • P. Schuurman, G. J. Woeginger, Polynomial time approximation algorithms for machine scheduling: ten open problems, J. Scheduling 2(5), 203–213, 1999. https://doi.org/10.1002/(SICI)1099-1425(199909/10)2:5%3C203::AID-JOS26%3E3.0.CO;2-5
  • U. Feige, C. Scheideler, Improved bounds for acyclic job shop scheduling, Combinatorica 22(3), 361–399, 2002. https://doi.org/10.1007/s004930200018
  • D. P. Williamson et al., Short shop schedules, Operations Research 45(2), 288–294, 1997. https://doi.org/10.1287/opre.45.2.288
12 thms1 active userReviewed
Graph TheoryOperations Research·Captain: mikedeng1

Basic Packing of Arborescences: A Digraph with Roots Has an M-Basic Packing of Arborescences iff π Is M-Independent and D Is M-ConnectedResearch Paper

Motivation

Packing arc-disjoint arborescences is one of the basic tractable problems of combinatorial optimization. Edmonds' branching theorem (1973) says that a digraph D=(V,A)D=(V,A)D=(V,A) contains kkk arc-disjoint spanning arborescences rooted at a vertex rrr if and only if every non-empty vertex set X⊆V∖rX\subseteq V\setminus rX⊆V∖r is entered by at least kkk arcs. Its undirected counterpart is the Tutte–Nash-Williams theorem on edge-disjoint spanning trees, and Frank showed how the undirected theorem follows from the directed one through an orientation argument. Both results underlie network-design and connectivity-augmentation algorithms, and the cut condition in Edmonds' theorem is the model for many min–max theorems on packings.

Katoh and Tanigawa (2013), motivated by the rigidity of frameworks with boundaries, introduced matroid-based packings of rooted trees in undirected graphs: the roots of the trees are elements of a matroid, and every vertex must be covered by trees whose roots form a base. Durand de Gevigney, Nguyen and Szigeti (arXiv:1207.1985, 2012) gave the directed counterpart. Their Theorem 1.6 characterizes digraphs with roots that admit a matroid-based packing of arborescences, contains Edmonds' theorem as the special case of the free matroid with all roots at one vertex, and implies Katoh and Tanigawa's undirected theorem through Frank's orientation theorem. Its proof is short and purely combinatorial.

Timeline:

  • 1961: Tutte and Nash-Williams characterize graphs with kkk edge-disjoint spanning trees.
  • 1973: Edmonds characterizes digraphs with kkk arc-disjoint spanning arborescences rooted at rrr.
  • 1980: Frank's orientation theorem for intersecting supermodular demand functions.
  • 2011–2013: Katoh and Tanigawa, rooted-tree decompositions with matroid constraints (undirected).
  • 2012: Durand de Gevigney, Nguyen and Szigeti, the directed theorem (this mission).

Setting

A digraph D=(V,A)D=(V,A)D=(V,A) has a finite vertex set VVV and a finite set AAA of arcs, each with a tail and a head; parallel arcs are allowed. For X⊆VX\subseteq VX⊆V, ϱD(X)\varrho_D(X)ϱD​(X) is the set of arcs entering XXX (tail outside, head inside) and ρD(X)=∣ϱD(X)∣\rho_D(X)=|\varrho_D(X)|ρD​(X)=∣ϱD​(X)∣. An arborescence rooted at rrr is a sub-digraph that is a directed tree in which rrr has in-degree 000 and every other vertex has in-degree 111; the single vertex rrr is an arborescence.

Let SSS be a finite set and π:S→V\pi:S\to Vπ:S→V a placement of its elements at vertices (several elements may sit at one vertex). The triple (D,S,π)(D,S,\pi)(D,S,π) is a digraph with roots. Write SX=π−1(X)S_X=\pi^{-1}(X)SX​=π−1(X) and Sv=π−1(v)S_v=\pi^{-1}(v)Sv​=π−1(v). Let MMM be a matroid on SSS with rank function rMr_MrM​.

  • π\piπ is MMM-independent if SvS_vSv​ is independent in MMM for every vertex vvv.
  • (D,S,π)(D,S,\pi)(D,S,π) is MMM-connected if
ρD(X) ≥ rM(S)−rM(SX)for all non-empty X⊆V.(3)\rho_D(X)\ \ge\ r_M(S)-r_M(S_X)\qquad\text{for all non-empty }X\subseteq V.\tag{3}ρD​(X) ≥ rM​(S)−rM​(SX​)for all non-empty X⊆V.(3)
  • An MMM-basic packing of arborescences is a family (Ts)s∈S(T_s)_{s\in S}(Ts​)s∈S​ of pairwise arc-disjoint arborescences of DDD, TsT_sTs​ rooted at π(s)\pi(s)π(s), such that for every vertex vvv the set {s∈S:v∈V(Ts)}\{s\in S: v\in V(T_s)\}{s∈S:v∈V(Ts​)} is a base of MMM. The arborescences need not be spanning.

In Lean these are Digraph, Arborescence, MIndependent, MConnected and IsBasicPacking in the namespace BasicPackArb.Main; the proof-side notions (tight sets, domination, good and bad arcs, the parallel extension) are in a second definitions module.

Formalization targets

Goal: Theorem 1.6

∃ (Ts)s∈S an M-basic packing of arborescences in (D,S,π)  ⟺  π is M-independent and (D,S,π) is M-connected.\exists\,(T_s)_{s\in S}\ \text{an }M\text{-basic packing of arborescences in }(D,S,\pi)\iff \pi\text{ is }M\text{-independent and }(D,S,\pi)\text{ is }M\text{-connected}.∃(Ts​)s∈S​ an M-basic packing of arborescences in (D,S,π)⟺π is M-independent and (D,S,π) is M-connected.

The statement is universally quantified over the vertex, arc and root types, the digraph, the placement and the matroid. It has no constants.

Milestones

  1. The necessity direction (§2, p. 4).
  2. Claim 2.1: if rM(P∩Q)+rM(P∪Q)=rM(P)+rM(Q)r_M(P\cap Q)+r_M(P\cup Q)=r_M(P)+r_M(Q)rM​(P∩Q)+rM​(P∪Q)=rM​(P)+rM​(Q), an element spanned by PPP and by QQQ is spanned by P∩QP\cap QP∩Q.
  3. Claim 2.2 (a), (b), (c): uncrossing of tight sets, the part of a tight set reaching a vertex, and domination along good arcs.
  4. Claim 2.3: with no bad arc, single-vertex arborescences form a basic packing.
  5. The lifting step (p. 5): removing a bad arc uvuvuv and adding a root s′s's′ parallel to sss at vvv preserves independence, and a packing of the new instance lifts back.
  6. Statement (4) and Claim 2.4: some bad arc can be split off while keeping M′M'M′-connectedness.

Significance

The result. Theorem 1.6 is a good characterization: both sides can be certified, and the condition (3) is a cut condition with a submodular right-hand side. It unifies Edmonds' branching theorem (free matroid, all roots at one vertex) with matroid-constrained packings, and through Frank's orientation theorem it yields Katoh and Tanigawa's theorem on rooted-tree decompositions, which is used in combinatorial rigidity. The same paper derives from it a description of the convex hull of basic packings and a polynomial algorithm for the minimum-cost version.

Formalizing it. The result is proved on paper; no machine-checked proof of Theorem 1.6, of Edmonds' branching theorem, or of any of the claims is known on this platform. A formal proof needs a multi-digraph library with arc deletion, arborescences as sub-digraphs, in-degree functions of vertex sets and their submodularity, and matroid rank and span arguments on top of Mathlib's Matroid. The milestones follow the paper's induction on the number of arcs.

Difficulty

The necessity direction is a counting argument. Sufficiency is the substance. The natural first attempt, building the arborescences greedily or splitting SSS into Edmonds instances, fails because the arborescences are not spanning and the covering condition is a base condition at every vertex, coupled through the matroid. The hard step is Claim 2.4: deleting an arc can destroy condition (3), and it must be shown that some bad arc, together with a suitable new parallel root, can be removed without doing so. Condition (3) has to be controlled for every vertex set at once, with a right-hand side that changes with the matroid. Formally, the lifting step requires gluing two arborescences with an arc and checking that the base condition survives the identification of the parallel pair.

Formalization scope

  • Vertices: a Fintype V with decidable equality. Arcs: an ambient type with tail, head and a finite arc set arcs, so parallel arcs and loops are allowed and D−uvD-uvD−uv deletes one arc.
  • Arborescence: vertex set, arc set inside AAA with ends in the vertex set, a root of in-degree 000, in-degree exactly 111 at other vertices, every vertex reachable from the root. Under the in-degree conditions this is equivalent to being a directed tree.
  • The packing is a family indexed by SSS, not a set of arborescences, so ∣Sv∣|S_v|∣Sv​∣ equal single-vertex arborescences count separately.
  • Matroid: Mathlib's Matroid S with ground set all of SSS (a finite type); rank is Matroid.eRk with values in N∞\mathbb{N}_\inftyN∞​; base is IsBase, independence is Indep.
  • SpanM(Q)={s:rM(Q∪{s})=rM(Q)}\mathrm{Span}_M(Q)=\{s: r_M(Q\cup\{s\})=r_M(Q)\}SpanM​(Q)={s:rM​(Q∪{s})=rM​(Q)}, defined literally.
  • (3) and tightness are written additively, rM(S)≤ρD(X)+rM(SX)r_M(S)\le\rho_D(X)+r_M(S_X)rM​(S)≤ρD​(X)+rM​(SX​) and ρD(X)+rM(SX)=rM(S)\rho_D(X)+r_M(S_X)=r_M(S)ρD​(X)+rM​(SX​)=rM​(S), so no truncated subtraction appears. (3) ranges over all non-empty XXX, including sets that contain roots.
  • The extension S′S'S′ is Option S with the new element none; M′M'M′ is the comap of MMM along o↦o.getD so\mapsto o.\mathrm{getD}\,so↦o.getDs, which makes none parallel to sss and restricts to MMM on SSS.
  • Claims stated inside the sufficiency proof carry that proof's standing hypotheses explicitly (π\piπ MMM-independent, MMM-connected, and "no bad arc", "a bad arc exists" or "Claim 2.4 is false" as the page says).

A formalization in which arborescences need not lie in AAA, or need not be reachable from their root, or in which the packing is a set of arborescences, or the per-vertex condition is "spanning" or "independent" rather than "base", states a different theorem and is ruled out by the definitions above.

Contributions welcome: proofs of the claims in any order, general lemmas on submodularity of ρD\rho_DρD​ and on tight-set uncrossing (reusable for other arborescence-packing results), and a proof of Edmonds' branching theorem as a corollary of the goal.

Selected references

  • O. Durand de Gevigney, V.-H. Nguyen, Z. Szigeti, Basic Packing of Arborescences, arXiv preprint, 2012. https://arxiv.org/abs/1207.1985v1 (published as Matroid-based packing of arborescences, SIAM J. Discrete Math., 2013).
  • J. Edmonds, Edge-disjoint branchings, in R. Rustin (ed.), Combinatorial Algorithms, Academic Press, 1973, pp. 91–96.
  • N. Katoh, S. Tanigawa, Rooted-tree decompositions with matroid constraints and the infinitesimal rigidity of frameworks with boundaries, SIAM J. Discrete Math., 2013.
  • A. Frank, On the orientation of graphs, J. Combin. Theory Ser. B 28 (1980) 251–261.
  • W. T. Tutte, On the problem of decomposing a graph into n connected factors, J. London Math. Soc. 36 (1961) 221–230; C. St. J. A. Nash-Williams, Edge-disjoint spanning trees of finite graphs, J. London Math. Soc. 36 (1961) 445–450.
  • A. Frank, Connections in Combinatorial Optimization, Oxford University Press, 2011.
12 thms1 active userReviewed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

Hardness of Approximating Flow and Job Shop Scheduling Problems 1: Every Schedule of the Flow Shop Instance F(r,d) Has Makespan at Least min(r, d/4)·lbResearch Paper

Motivation

In shop scheduling, jobs consist of chains of operations, each to be processed on a prescribed machine, and the goal is to minimize the makespan, the time at which the last operation finishes. Almost every approximation algorithm for job shops, acyclic job shops and flow shops is analysed against one quantity: the trivial lower bound lb=max⁡(C,D)\mathrm{lb}=\max(C,D)lb=max(C,D), where the congestion CCC is the largest total processing time requested on one machine and the dilation DDD is the largest total processing time of one job. Any schedule has makespan at least lb\mathrm{lb}lb.

How weak can this bound be? Leighton, Maggs and Rao (1994) showed that for acyclic job shops with unit-length operations the optimum is O(lb)O(\mathrm{lb})O(lb). For operations of arbitrary length, Feige and Scheideler (2002) proved an upper bound of O(lb⋅log⁡lb⋅log⁡log⁡lb)O(\mathrm{lb}\cdot\log\mathrm{lb}\cdot\log\log\mathrm{lb})O(lb⋅loglb⋅logloglb) for acyclic job shops, and gave acyclic job shop instances whose optimum is Ω(lb⋅log⁡lb/log⁡log⁡lb)\Omega(\mathrm{lb}\cdot\log\mathrm{lb}/\log\log\mathrm{lb})Ω(lb⋅loglb/logloglb). Flow shops, in which every job visits every machine in one common order, are much more structured, and no flow shop instance with optimum ω(lb)\omega(\mathrm{lb})ω(lb) was known. Feige and Scheideler asked whether flow shops admit a significantly better upper bound. Mastrolilli and Svensson (J. ACM 2011, Theorem 1.1) answered this negatively by constructing flow shops whose optimal makespan is a factor Ω(log⁡lb/log⁡log⁡lb)\Omega(\log\mathrm{lb}/\log\log\mathrm{lb})Ω(loglb/logloglb) above lb\mathrm{lb}lb.

Timeline:

  • 1994 — Leighton, Maggs, Rao: unit-time acyclic job shops have optimum O(lb)O(\mathrm{lb})O(lb) (packet routing).
  • 2002 — Feige, Scheideler: upper bound O(lblog⁡lblog⁡log⁡lb)O(\mathrm{lb}\log\mathrm{lb}\log\log\mathrm{lb})O(lbloglblogloglb) for acyclic job shops, a nearly matching lower-bound family for acyclic job shops, and the open question for flow shops.
  • 2011 — Mastrolilli, Svensson: flow shops with optimum Ω(lblog⁡lb/log⁡log⁡lb)\Omega(\mathrm{lb}\log\mathrm{lb}/\log\log\mathrm{lb})Ω(lbloglb/logloglb).

Setting

A job shop instance has machines and jobs; job jjj is a sequence of operations O1j,…,OμjjO_{1j},\dots,O_{\mu_j j}O1j​,…,Oμj​j​, operation OijO_{ij}Oij​ needs pij≥0p_{ij}\ge0pij​≥0 time units without interruption on machine mijm_{ij}mij​. A feasible schedule assigns a start time s≥0s\ge0s≥0 to every operation so that each operation starts after the previous operation of its job has completed, and no two operations on one machine overlap. A zero-length operation therefore still occupies an instant on its machine: it cannot be performed strictly inside another operation there. The makespan Cmax⁡(s)C_{\max}(s)Cmax​(s) is the largest completion time.

The instance F(r,d)F(r,d)F(r,d), for natural numbers r,dr,dr,d:

  • Machines. r2dr^{2d}r2d groups M1,…,Mr2dM_1,\dots,M_{r^{2d}}M1​,…,Mr2d​; group MgM_gMg​ has machines mg,1,…,mg,dm_{g,1},\dots,m_{g,d}mg,1​,…,mg,d​, one per frequency. The machines are ordered m1,d,…,m1,1,m2,d,…,m2,1,…m_{1,d},\dots,m_{1,1},m_{2,d},\dots,m_{2,1},\dotsm1,d​,…,m1,1​,m2,d​,…,m2,1​,…: by group, and inside a group by decreasing frequency.
  • Jobs. For each frequency f=1,…,df=1,\dots,df=1,…,d there are r2(d−f)r^{2(d-f)}r2(d−f) job groups JgfJ^f_gJgf​, each of r2fr^{2f}r2f identical jobs. Such a job runs for r2(d−f)r^{2(d-f)}r2(d−f) time units on each of the machines ma+1,f,…,ma+r2f,fm_{a+1,f},\dots,m_{a+r^{2f},f}ma+1,f​,…,ma+r2f,f​, a=(g−1)r2fa=(g-1)r^{2f}a=(g−1)r2f, and for 000 time units on every other machine. Every job visits every machine in the common order, so F(r,d)F(r,d)F(r,d) is a flow shop.

Operations of positive length are long-operations, the others short-operations. For a schedule, the iii-th long-operation of a job jjj of frequency fff is good if the delay dj(i)d_j(i)dj​(i) from its end to the start of the next long-operation of jjj is at most r24r2(d−f)\frac{r^2}{4}r^{2(d-f)}4r2​r2(d−f); the last long-operation of a job is never good. Tg,fT_{g,f}Tg,f​ is the set of first halves [s,s+p/2)[s,s+p/2)[s,s+p/2) of the good long-operations on machine mg,fm_{g,f}mg,f​, and L(Tg,f)L(T_{g,f})L(Tg,f​) the total time they cover.

Formalization targets

Goal: Theorem 1.1, explicit form

For all natural numbers r≥8r\ge8r≥8 and ddd: every job of F(r,d)F(r,d)F(r,d) has length r2dr^{2d}r2d, every machine has load r2dr^{2d}r2d (so lb=r2d\mathrm{lb}=r^{2d}lb=r2d), and every feasible schedule sss satisfies

Cmax⁡(s) ≥ r2d⋅min⁡(r, d4).C_{\max}(s)\ \ge\ r^{2d}\cdot\min\Bigl(r,\ \frac d4\Bigr).Cmax​(s) ≥ r2d⋅min(r, 4d​).

With r=dr=dr=d this gives the paper's statement, an optimal makespan of Ω(lb⋅log⁡lb/log⁡log⁡lb)\Omega(\mathrm{lb}\cdot\log\mathrm{lb}/\log\log\mathrm{lb})Ω(lb⋅loglb/logloglb).

Milestones

  • §2.2.1, p. 20:10: every job length and machine load equals r2dr^{2d}r2d.
  • Lemma 2.2: if Cmax⁡(s)<r⋅lbC_{\max}(s)<r\cdot\mathrm{lb}Cmax​(s)<r⋅lb, every job has at least a (1−4/r)(1-4/r)(1−4/r) fraction of good long-operations.
  • Lemma 2.3: for 1≤k<ℓ≤d1\le k<\ell\le d1≤k<ℓ≤d, the intervals of Tg,kT_{g,k}Tg,k​ and Tg,ℓT_{g,\ell}Tg,ℓ​ are pairwise disjoint.
  • Lemma 2.4: if Cmax⁡(s)<r⋅lbC_{\max}(s)<r\cdot\mathrm{lb}Cmax​(s)<r⋅lb, some group ggg has ∑f=1dL(Tg,f)≥lb4⋅d\sum_{f=1}^d L(T_{g,f})\ge\frac{\mathrm{lb}}4\cdot d∑f=1d​L(Tg,f​)≥4lb​⋅d.

Significance

The theorem shows that the lower bound lb\mathrm{lb}lb, against which all known flow shop algorithms are analysed, can be off by a factor growing with lb\mathrm{lb}lb. Any flow shop algorithm with guarantee o(log⁡lb/log⁡log⁡lb)o(\log\mathrm{lb}/\log\log\mathrm{lb})o(loglb/logloglb) relative to the optimum must therefore use a stronger lower bound than max⁡(C,D)\max(C,D)max(C,D). The same frequency construction is the gap gadget behind the paper's inapproximability results for generalized flow shops and job shops (Theorems 1.2 and 1.3).

The result has been proved since 2011; as far as is known it has no machine-checked proof. The mission produces a formal model of the instance F(r,d)F(r,d)F(r,d), a formal proof of the explicit bound for every r≥8r\ge8r≥8, ddd, and reusable statements about delays and first-half intervals in the published job shop model JobShopLTAS.Core.Instance.

Difficulty

The bound must hold for every feasible schedule, with no structural restriction such as a permutation or non-delay schedule. The obvious approach, comparing each machine's load with the makespan, only gives Cmax⁡≥lbC_{\max}\ge\mathrm{lb}Cmax​≥lb, since every machine carries exactly lb\mathrm{lb}lb. The gain comes from interaction between machines of different frequencies in one group: a high-frequency job running in parallel with a low-frequency long-operation is held back by its zero-length operation on the low-frequency machine. Turning this into a quantitative bound requires controlling, for every job at once, how long it waits between consecutive long-operations, and that waiting is only bounded when the makespan is already small. Encoding the index arithmetic of F(r,d)F(r,d)F(r,d) (groups, frequencies, copies, positions of the long-operations) and the zero-length operations faithfully is a substantial part of the work.

Formalization scope

  • Model. The published definition JobShopLTAS.Core.Instance: machines Fin m, jobs Fin n, real processing times and start times, IsFeasibleSchedule Finset.univ s (nonnegative starts, chain precedence, disjunctive machine constraint s o + p o ≤ s o' ∨ s o' + p o' ≤ s o) and makespan Finset.univ s. Under that constraint a zero-length operation cannot sit strictly inside another operation on its machine, which the paper's argument needs.
  • Encoding. F(r,d)F(r,d)F(r,d) has r2ddr^{2d}dr2dd machines and r2ddr^{2d}dr2dd jobs. Machine position ppp is mg,im_{g,i}mg,i​ with p=(g−1)d+(d−i)p=(g-1)d+(d-i)p=(g−1)d+(d−i), so position order is the paper's machine order. Job qqq is jg,afj^f_{g,a}jg,af​ with q=(f−1)r2d+(g−1)r2f+(a−1)q=(f-1)r^{2d}+(g-1)r^{2f}+(a-1)q=(f−1)r2d+(g−1)r2f+(a−1). Every job has one operation per machine, the iii-th on position iii; frequencies, groups and copies are 1-based.
  • Good operations. The next long-operation of a job is the next operation of positive length in its chain; a last long-operation is never good. L(T)L(T)L(T) is the Lebesgue measure of the union of the intervals of TTT.
  • Explicit constants replacing asymptotics. The paper's Ω(lb⋅log⁡lb/log⁡log⁡lb)\Omega(\mathrm{lb}\cdot\log\mathrm{lb}/\log\log\mathrm{lb})Ω(lb⋅loglb/logloglb) is replaced by the bound r2dmin⁡(r,d/4)r^{2d}\min(r,d/4)r2dmin(r,d/4) that §2.2.2 proves; the specialization r=dr=dr=d and the asymptotic estimate d=Θ(log⁡lb/log⁡log⁡lb)d=\Theta(\log\mathrm{lb}/\log\log\mathrm{lb})d=Θ(loglb/logloglb) are not formalized. "Sufficiently large rrr" becomes r≥8r\ge8r≥8 (Lemma 2.4 and the goal: 1−4/r≥1/21-4/r\ge1/21−4/r≥1/2) and r≥3r\ge3r≥3 (Lemma 2.3: r2/2−1>r2/4r^2/2-1>r^2/4r2/2−1>r2/4); Lemma 2.2 holds for every r≥1r\ge1r≥1. The standing assumption Cmax⁡<r⋅lbC_{\max}<r\cdot\mathrm{lb}Cmax​<r⋅lb of §2.2.2 is an explicit hypothesis of Lemmas 2.2 and 2.4. "Optimal makespan" is stated as a bound on every feasible schedule.
  • Ruled out. The goal quantifies over all feasible schedules of F(r,d)F(r,d)F(r,d) as constructed; assuming the good-fraction or disjointness properties, restricting to permutation schedules, or a model in which zero-length operations occupy no machine time would trivialize or falsify it.
  • Not in scope. The job shop warm-up of §2.1 (Lemma 2.1) and the reductions of §3–§4.

Welcome contributions: proofs of the counting facts about the encoding, of the milestones, and general lemmas about feasible schedules in JobShopLTAS.Core.Instance (completion time of a job bounds its delays; disjoint intervals in [0,Cmax⁡][0,C_{\max}][0,Cmax​] have total length at most Cmax⁡C_{\max}Cmax​).

Selected references

  • M. Mastrolilli, O. Svensson, Hardness of Approximating Flow and Job Shop Scheduling Problems, J. ACM 58(5), Article 20, 2011. https://doi.org/10.1145/2027216.2027218
  • U. Feige, C. Scheideler, Improved Bounds for Acyclic Job Shop Scheduling, Combinatorica 22(3), 361–399, 2002. https://doi.org/10.1007/s004930200018
  • F. T. Leighton, B. M. Maggs, S. B. Rao, Packet Routing and Job-Shop Scheduling in O(Congestion + Dilation) Steps, Combinatorica 14(2), 167–186, 1994. https://doi.org/10.1007/BF01215349
  • P. Schuurman, G. J. Woeginger, Polynomial Time Approximation Algorithms for Machine Scheduling: Ten Open Problems, J. Scheduling 2(5), 203–213, 1999. https://doi.org/10.1002/(SICI)1099-1425(199909/10)2:5<203::AID-JOS26>3.0.CO;2-5
8 thms1 active userReviewed
Graph TheoryTheoretical Computer Science·Captain: mikedeng1

Spectral Sparsification of Graphs 2: Every Graph with m Edges Has a (6 log_{4/3} 2m)⁻¹-Conductance Decomposition Cutting at Most Half of Its EdgesResearch Paper

Motivation

A sparse graph that approximates a dense one, in the sense that both have nearly the same Laplacian quadratic form, can stand in for it in every algorithm that only reads cuts or solves Laplacian linear systems. Spielman and Teng introduced such spectral sparsifiers and built them in nearly linear time; the construction is the sparsification step of their nearly-linear-time Laplacian solver (arXiv:0808.4134, SIAM J. Comput. 40(4), 2011).

Sampling edges at random works well only inside a graph of high conductance, where no vertex set is separated from the rest by few edges. A general graph is therefore first cut into pieces of high conductance, with few edges running between the pieces. Section 7 of the paper proves that such a decomposition always exists. A similar result was obtained independently by Trevisan (2005). The decomposition theorem, together with the sampling theorem of §6, already shows that every graph has a spectral sparsifier with O(nlog⁡7n)O(n\log^7 n)O(nlog7n) edges; the algorithmic decomposition of §8, which the fast algorithm uses, is an approximate version of it, and its analysis rests on the same certificate lemma.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite simple undirected graph with m=∣E∣m=|E|m=∣E∣ edges, and write did_idi​ for the degree of vertex iii. For disjoint S,T⊆VS,T\subseteq VS,T⊆V, E(S,T)E(S,T)E(S,T) is the set of edges with one end in SSS and one in TTT. The volume of S⊆VS\subseteq VS⊆V is Vol⁡(S)=∑i∈Sdi\operatorname{Vol}(S)=\sum_{i\in S}d_iVol(S)=∑i∈S​di​; in particular Vol⁡(V)=2m\operatorname{Vol}(V)=2mVol(V)=2m.

For a vertex set B⊆VB\subseteq VB⊆V and S⊆BS\subseteq BS⊆B, the conductance of SSS inside BBB is

ΦBG(S)=∣E(S,B−S)∣min⁡(Vol⁡(S),Vol⁡(B−S)),ΦBG(∅)=1,\Phi^G_B(S)=\frac{|E(S,B-S)|}{\min\big(\operatorname{Vol}(S),\operatorname{Vol}(B-S)\big)},\qquad \Phi^G_B(\emptyset)=1,ΦBG​(S)=min(Vol(S),Vol(B−S))∣E(S,B−S)∣​,ΦBG​(∅)=1,

and the conductance of BBB is ΦBG=min⁡S⊂BΦBG(S)\Phi^G_B=\min_{S\subset B}\Phi^G_B(S)ΦBG​=minS⊂B​ΦBG​(S) over proper subsets, with ΦBG=1\Phi^G_B=1ΦBG​=1 when ∣B∣=1|B|=1∣B∣=1. Volumes are always measured with the degrees of GGG, never with the degrees inside the induced subgraph G(B)G(B)G(B); consequently ΦBG\Phi^G_BΦBG​ is at most the usual conductance of G(B)G(B)G(B), and lower bounds on ΦBG\Phi^G_BΦBG​ transfer to it.

A decomposition of GGG is a partition (A1,…,Ak)(A_1,\dots,A_k)(A1​,…,Ak​) of VVV. It is a φ\varphiφ-decomposition if ΦAiG≥φ\Phi^G_{A_i}\ge\varphiΦAi​G​≥φ for all iii, and its boundary is the set of edges between different parts,

∂(A1,…,Ak)=E∩⋃i≠j(Ai×Aj).\partial(A_1,\dots,A_k)=E\cap\bigcup_{i\neq j}(A_i\times A_j).∂(A1​,…,Ak​)=E∩i=j⋃​(Ai​×Aj​).

In Lean: vol G S, cutEdges G S T =∣E(S,T)∣=|E(S,T)|=∣E(S,T)∣, condRel G B S =ΦBG(S)=\Phi^G_B(S)=ΦBG​(S), cond G B =ΦBG=\Phi^G_B=ΦBG​, and decompBoundary G P =∂(A1,…,Ak)=\partial(A_1,\dots,A_k)=∂(A1​,…,Ak​) for a Finpartition P of the vertex set, all in the namespace SpectralSparsify.Decomp.

Formalization targets

Goal: Theorem 7.1 (p. 17)

Every graph GGG without isolated vertices has a decomposition (A1,…,Ak)(A_1,\dots,A_k)(A1​,…,Ak​) with

ΦAiG ≥ (6log⁡4/32m)−1for all i,∣∂(A1,…,Ak)∣ ≤ ∣E∣2.\Phi^G_{A_i}\ \ge\ \big(6\log_{4/3}2m\big)^{-1}\quad\text{for all } i,\qquad |\partial(A_1,\dots,A_k)|\ \le\ \frac{|E|}{2}.ΦAi​G​ ≥ (6log4/3​2m)−1for all i,∣∂(A1​,…,Ak​)∣ ≤ 2∣E∣​.

The constants are the paper's. Both conditions must hold for one and the same partition.

Milestones

  1. (12), first inequality (p. 18): for S⊆BS\subseteq BS⊆B, R⊆B−SR\subseteq B-SR⊆B−S, T=R∪ST=R\cup ST=R∪S, ∣E(T,B−T)∣≤∣E(S,B−S)∣+∣E(R,B−S−R)∣|E(T,B-T)|\le|E(S,B-S)|+|E(R,B-S-R)|∣E(T,B−T)∣≤∣E(S,B−S)∣+∣E(R,B−S−R)∣.
  2. The volume bound proving (13) (p. 19): if Vol⁡(R)≤12Vol⁡(B−S)\operatorname{Vol}(R)\le\frac12\operatorname{Vol}(B-S)Vol(R)≤21​Vol(B−S) and Vol⁡(S)=αVol⁡(B)\operatorname{Vol}(S)=\alpha\operatorname{Vol}(B)Vol(S)=αVol(B), then Vol⁡(R∪S)≤1+α2Vol⁡(B)\operatorname{Vol}(R\cup S)\le\frac{1+\alpha}{2}\operatorname{Vol}(B)Vol(R∪S)≤21+α​Vol(B).
  3. Lemma 7.2, Sparsest Cuts as Certificates (p. 18): let φ≤1\varphi\le1φ≤1, and let S⊂BS\subset BS⊂B maximize Vol⁡(S)\operatorname{Vol}(S)Vol(S) subject to (C.1) Vol⁡(S)≤Vol⁡(B)/2\operatorname{Vol}(S)\le\operatorname{Vol}(B)/2Vol(S)≤Vol(B)/2 and (C.2) ΦBG(S)≤φ\Phi^G_B(S)\le\varphiΦBG​(S)≤φ. If Vol⁡(S)=αVol⁡(B)\operatorname{Vol}(S)=\alpha\operatorname{Vol}(B)Vol(S)=αVol(B) with α≤1/3\alpha\le1/3α≤1/3, then
ΦB−SG ≥ φ 1−3α1−α.\Phi^G_{B-S}\ \ge\ \varphi\,\frac{1-3\alpha}{1-\alpha}.ΦB−SG​ ≥ φ1−α1−3α​.
  1. The φ/3\varphi/3φ/3 step (proof of Theorem 7.1, p. 19): under the hypotheses of Lemma 7.2 with Vol⁡(S)≤Vol⁡(B)/4\operatorname{Vol}(S)\le\operatorname{Vol}(B)/4Vol(S)≤Vol(B)/4, ΦB−SG≥φ/3\Phi^G_{B-S}\ge\varphi/3ΦB−SG​≥φ/3.
  2. The per-level cut bound (proof of Theorem 7.1, p. 19): for pairwise disjoint B1,…,BrB_1,\dots,B_rB1​,…,Br​ and Sj⊂BjS_j\subset B_jSj​⊂Bj​ satisfying (C.1) and (C.2) in BjB_jBj​ with φ≥0\varphi\ge0φ≥0, ∑j∣E(Sj,Bj−Sj)∣≤φ∣E∣\sum_j|E(S_j,B_j-S_j)|\le\varphi|E|∑j​∣E(Sj​,Bj​−Sj​)∣≤φ∣E∣.

Significance

The theorem says that every graph is, after removing at most half of its edges, a disjoint union of pieces of conductance Ω(1/log⁡m)\Omega(1/\log m)Ω(1/logm). By Cheeger's inequality each piece then has normalized spectral gap Ω(1/log⁡2m)\Omega(1/\log^2 m)Ω(1/log2m), which is the hypothesis under which the random sampling of §6 produces a spectral approximation; applying the theorem recursively to the removed edges gives the existence of spectral sparsifiers with O(nlog⁡7n)O(n\log^7 n)O(nlog7n) edges (§7.2). Decompositions of this kind, now called expander decompositions, have become a standard tool in graph algorithms.

The theorem is proved in the paper; to the knowledge of this mission it has no machine-checked proof. What the mission produces is a formal proof of the existence statement with the paper's explicit constant, a formal Lemma 7.2 (the certificate lemma that also drives the approximate version, Theorem 8.1), and reusable Lean definitions of volume, relative conductance ΦBG\Phi^G_BΦBG​ and decomposition boundary for finite simple graphs.

Difficulty

The obvious argument, cutting along any sparse set until no sparse set is left, controls the conductance of the final parts but not the number of edges cut: a long sequence of small sparse cuts can remove far more than half of the edges. The difficulty is to show that one well-chosen cut leaves a remainder whose conductance is certified without further search, which is the content of Lemma 7.2. Its hypothesis is a maximality condition over all subsets of BBB, and its conclusion concerns all subsets of B−SB-SB−S, a different set measured with the same ambient degrees, so the two cannot be compared directly. The existence statement then needs a well-founded description of the recursion, a bound on its depth, and an accounting of the cut edges level by level, all against the explicit constant (6log⁡4/32m)−1(6\log_{4/3}2m)^{-1}(6log4/3​2m)−1.

Formalization scope

Graphs are SimpleGraph V on a finite vertex type with decidable adjacency; vertex sets are Finset V; volumes, conductances and the bound on ∣∂∣|\partial|∣∂∣ are real numbers; decompositions are Finpartition (Finset.univ : Finset V); log⁡4/3\log_{4/3}log4/3​ is Real.logb (4/3).

Hypotheses made explicit:

  • No isolated vertices (∀ v, 0 < G.degree v) in Theorem 7.1, Lemma 7.2 and the milestones that divide by a volume. The paper leaves it implicit: ΦBG(S)\Phi^G_B(S)ΦBG​(S) is 0/00/00/0 for sets of isolated vertices, and with Lean's 0/0=00/0=00/0=0 Lemma 7.2 would be false (one edge plus two isolated vertices is a counterexample). Under the hypothesis m=0m=0m=0 forces V=∅V=\emptysetV=∅, and Theorem 7.1 is then trivially true.
  • BBB nonempty in Lemma 7.2 and the φ/3\varphi/3φ/3 step, so that α=Vol⁡(S)/Vol⁡(B)\alpha=\operatorname{Vol}(S)/\operatorname{Vol}(B)α=Vol(S)/Vol(B) is determined.
  • φ≥0\varphi\ge0φ≥0 in the per-level bound (the paper's φ\varphiφ is positive).

Conventions: ΦBG\Phi^G_BΦBG​ is the minimum over proper subsets, the empty set contributing 111; ΦBG=1\Phi^G_B=1ΦBG​=1 for ∣B∣≤1|B|\le1∣B∣≤1; ∣E(S,T)∣|E(S,T)|∣E(S,T)∣ counts ordered adjacent pairs in S×TS\times TS×T, which is the edge count for disjoint sets. Neither conclusion of Theorem 7.1 may be dropped: the partition into singletons satisfies the conductance bound and the partition into one part satisfies the boundary bound, so a formalization keeping only one conclusion is trivial.

Not formalized: idealDecomp as an object (step 2 involves a choice, so it is a relation rather than a function; the goal is the existence statement), its termination and depth bound as separate items, the λ-spectral decomposition remark via Cheeger's inequality, the existence sketch for sparsifiers in §7.2, and the algorithmic analogue of §8. Contributions welcome: proofs of the milestones, a formal recursion for idealDecomp, and lemmas on volume and edge-boundary arithmetic that other graph-partitioning missions can reuse.

Selected references

  • D. A. Spielman, S.-H. Teng, Spectral Sparsification of Graphs, arXiv:0808.4134v3, 2010; SIAM J. Comput. 40(4), 2011. https://arxiv.org/abs/0808.4134
  • L. Trevisan, Approximation algorithms for unique games, FOCS 2005, pp. 197–205; journal version Theory of Computing 4 (2008) 111–128. https://doi.org/10.4086/toc.2008.v004a005
  • D. A. Spielman, S.-H. Teng, Nearly-linear time algorithms for graph partitioning, graph sparsification, and solving linear systems, STOC 2004, pp. 81–90. https://doi.org/10.1145/1007352.1007372
10 thms1 active userReviewed
Linear OptimizationOperations Research·Captain: mikedeng1

A Branch-and-Cut Algorithm for the Dial-a-Ride Problem: The Generalized Order-Matching Inequality x(H) + Σ x(T_h) ≤ |H| + Σ|T_h| − 2m Is Valid for Every Feasible Route PlanResearch Paper

Motivation

The dial-a-ride problem (DARP) asks for minimum-cost vehicle routes that carry users from individual pick-up points to individual drop-off points, subject to vehicle capacities, time windows, route durations and a bound on each user's ride time. It models door-to-door transport for elderly and disabled people, shared taxis and on-demand microtransit. Cordeau (Oper. Res. 54(3), 2006) gave a mixed-integer formulation of the DARP and the first branch-and-cut algorithm for it, and reported that instances with up to 30 users can be solved to optimality in reasonable time. The algorithm's strength comes from families of valid inequalities: linear constraints satisfied by every feasible route plan that cut off fractional points of the linear relaxation. Several of these families were adapted from the precedence-constrained asymmetric TSP (Balas, Fischetti and Pulleyblank 1995; Grötschel and Padberg 1985) and from the pick-up and delivery problem (Ruland and Rodin 1997); others, notably the generalized order-matching inequalities, were new in this paper.

Setting

Let nnn be the number of users. Nodes are N={0,1,…,2n+1}N = \{0, 1, \dots, 2n+1\}N={0,1,…,2n+1} with pick-up nodes P={1,…,n}P = \{1,\dots,n\}P={1,…,n}, drop-off nodes D={n+1,…,2n}D = \{n+1,\dots,2n\}D={n+1,…,2n}, origin depot 000 and destination depot 2n+12n+12n+1; user iii travels from node iii to node n+in+in+i. An instance fixes, for each node iii, a load qiq_iqi​, a service duration di≥0d_i \ge 0di​≥0 and a time window [ei,li][e_i, l_i][ei​,li​]; for each pair of nodes a travel time tijt_{ij}tij​; for each vehicle kkk in a finite set KKK a capacity QkQ_kQk​ and a maximal route duration TkT_kTk​; and a maximal ride time LLL. The standing conditions are q0=q2n+1=0q_0 = q_{2n+1} = 0q0​=q2n+1​=0, qi=−qn+iq_i = -q_{n+i}qi​=−qn+i​ for i∈Pi \in Pi∈P, and d0=d2n+1=0d_0 = d_{2n+1} = 0d0​=d2n+1​=0.

A feasible solution gives each vehicle kkk a route 0→v1→⋯→vr→2n+10 \to v_1 \to \dots \to v_r \to 2n+10→v1​→⋯→vr​→2n+1 through distinct nodes of P∪DP \cup DP∪D, start-of-service times BikB^k_iBik​ and loads QikQ^k_iQik​ such that every node of P∪DP \cup DP∪D is visited by exactly one vehicle, iii and n+in+in+i are on the same route with iii first, Bjk≥Bik+di+tijB^k_j \ge B^k_i + d_i + t_{ij}Bjk​≥Bik​+di​+tij​ and Qjk≥Qik+qjQ^k_j \ge Q^k_i + q_jQjk​≥Qik​+qj​ along each travelled arc, the ride time Bn+ik−(Bik+di)B^k_{n+i} - (B^k_i + d_i)Bn+ik​−(Bik​+di​) lies in [ti,n+i,L][t_{i,n+i}, L][ti,n+i​,L], the route lasts at most TkT_kTk​, and the time windows and capacity bounds hold at every visited node. These are the constraints (2)–(14) of the paper's model.

The arc variables are xijk=1x^k_{ij} = 1xijk​=1 when vehicle kkk travels from iii to jjj, and xij=∑k∈Kxijkx_{ij} = \sum_{k \in K} x^k_{ij}xij​=∑k∈K​xijk​. For a node set SSS write Sˉ=N∖S\bar S = N \setminus SSˉ=N∖S, x(S)=∑i,j∈Sxijx(S) = \sum_{i,j\in S} x_{ij}x(S)=∑i,j∈S​xij​, x(δ+(S))=∑i∈S,j∈Sˉxijx(\delta^+(S)) = \sum_{i\in S, j\in \bar S} x_{ij}x(δ+(S))=∑i∈S,j∈Sˉ​xij​, x(δ−(S))=∑i∈Sˉ,j∈Sxijx(\delta^-(S)) = \sum_{i \in \bar S, j \in S} x_{ij}x(δ−(S))=∑i∈Sˉ,j∈S​xij​, π(S)={i∈P∣n+i∈S}\pi(S) = \{i \in P \mid n+i \in S\}π(S)={i∈P∣n+i∈S} and σ(S)={n+i∈D∣i∈S}\sigma(S) = \{n+i \in D \mid i \in S\}σ(S)={n+i∈D∣i∈S}. An inequality in xxx is valid for the DARP when the aggregated arc variables of every feasible solution satisfy it.

Formalization targets

Goal: Proposition 5 (p. 578)

Let i1,…,imi_1, \dots, i_mi1​,…,im​ be distinct users and let H,T1,…,Tm⊆P∪DH, T_1, \dots, T_m \subseteq P \cup DH,T1​,…,Tm​⊆P∪D satisfy {ih,n+ih}⊆Th\{i_h, n+i_h\} \subseteq T_h{ih​,n+ih​}⊆Th​ and H∩Th={ih}H \cap T_h = \{i_h\}H∩Th​={ih​}. Then every feasible solution satisfies

x(H)+∑h=1mx(Th)≤∣H∣+∑h=1m∣Th∣−2m.(39)x(H) + \sum_{h=1}^m x(T_h) \le |H| + \sum_{h=1}^m |T_h| - 2m. \tag{39}x(H)+h=1∑m​x(Th​)≤∣H∣+h=1∑m​∣Th​∣−2m.(39)

The handle HHH and the teeth ThT_hTh​ are not required to be disjoint from one another beyond H∩Th={ih}H \cap T_h = \{i_h\}H∩Th​={ih​}, and mmm is arbitrary.

Milestones (the steps of the proof of Proposition 5)

  1. x(S)≤∣S∣−1x(S) \le |S| - 1x(S)≤∣S∣−1 for every nonempty S⊆P∪DS \subseteq P \cup DS⊆P∪D.
  2. If x(T)=∣T∣−1x(T) = |T| - 1x(T)=∣T∣−1 for a set T∋i,n+iT \ni i, n+iT∋i,n+i, then a path of arcs with xab=1x_{ab} = 1xab​=1 covers TTT and does not finish at iii.
  3. With α\alphaα the number of teeth for which x(Th)=∣Th∣−1x(T_h) = |T_h| - 1x(Th​)=∣Th​∣−1: x(δ+(H))≥αx(\delta^+(H)) \ge \alphax(δ+(H))≥α.
  4. x(δ+(H))=x(δ−(H))x(\delta^+(H)) = x(\delta^-(H))x(δ+(H))=x(δ−(H)) and 2x(H)+x(δ+(H))+x(δ−(H))=2∣H∣2x(H) + x(\delta^+(H)) + x(\delta^-(H)) = 2|H|2x(H)+x(δ+(H))+x(δ−(H))=2∣H∣ for H⊆P∪DH \subseteq P \cup DH⊆P∪D.
  5. x(H)≤∣H∣−αx(H) \le |H| - \alphax(H)≤∣H∣−α.

Companion statements

The mission also states the other propositions of §4: the lifted subtour elimination inequalities (33) and (34) (Propositions 1 and 2), the predecessor inequality (30), the two liftings (36) and (37) of the generalized order constraint (Propositions 3 and 4), the redundancy of the strengthening (40) of (39) under (30) for fractional points (Proposition 6), and the infeasible path inequality (41) under the triangle inequality for travel times (Proposition 7).

Significance

Valid inequalities are what make branch-and-cut work: each family is added to the linear relaxation by a separation heuristic, and the paper's computational section reports how the bound improves as families are added. Validity is the one property the algorithm cannot check at run time, since a cut that removes a feasible route plan silently returns a suboptimal answer. Remark 2 of the paper observes that (39) is stronger than the TSP comb inequality on the same sets, and Proposition 6 shows that its natural strengthening adds nothing once the predecessor inequalities (30) are present, which tells an implementer which families to separate.

All propositions are proved in the paper, partly in an appendix; none is formalized. A machine-checked development would give a precise route-based model of the DARP that later DARP and pick-up and delivery papers can reuse, and certified validity of the cut families that branch-and-cut codes for these problems separate.

Difficulty

The proofs are short on paper but argue about the shape of routes: "there exists a path connecting all nodes in ThT_hTh​", "this path cannot finish at node ihi_hih​ because of the precedence constraint". Turning a tight subtour count x(T)=∣T∣−1x(T) = |T| - 1x(T)=∣T∣−1 into a single covering path requires knowing that the arcs of a feasible solution inside a subset of P∪DP \cup DP∪D form vertex-disjoint paths, which in turn rests on each node of P∪DP \cup DP∪D having exactly one predecessor and one successor and on routes containing no cycles. The arithmetic step from α\alphaα tight teeth to the bound on the handle needs the degree identities for every subset of P∪DP \cup DP∪D, and counting the arcs leaving HHH needs the distinctness of the users ihi_hih​. Reasoning directly with the linear constraints (2)–(14) does not suffice: those constraints alone do not exclude cycles of zero duration.

Formalization scope

Nodes are natural numbers, so n+in+in+i and 2n+12n+12n+1 appear literally; NNN, PPP, DDD and P∪DP \cup DP∪D are Finset.range (2n+2), Icc 1 n, Icc (n+1) (2n) and Icc 1 (2n). All data and arc variables are real-valued, and every right-hand side is computed in R\mathbb RR. Feasible solutions are route-based: each vehicle has a duplicate-free list of nodes of P∪DP \cup DP∪D, and the constraints of the model are imposed along that list. Read literally, the program (1)–(14) admits closed cycles when di+tij=0d_i + t_{ij} = 0di​+tij​=0 around a cycle, on which every proposition fails, and imposes (11)–(13) also at nodes a vehicle does not visit; the route encoding follows the paper's verbal definition of the DARP and its proofs, which reason about routes. Precedence (iii before n+in+in+i) is a field of the solution, since with zero travel and service times the nonnegativity of ride times does not order the visits. The routing cost plays no role and is omitted. No positivity is assumed for travel or service times.

Added hypotheses, each necessary: sets SSS in the subtour bound and in (30) are nonempty (S=∅S = \emptysetS=∅ gives 0≤−10 \le -10≤−1); the users of Proposition 5 are distinct; the generalized order constraint (Propositions 3 and 4) has m≥2m \ge 2m≥2 (for m=1m = 1m=1 it is false); the ordered sets of Propositions 1 and 2 have h≥3h \ge 3h≥3 nodes, the standing assumption of the paragraph that introduces them; Proposition 7 has p≥1p \ge 1p≥1 and a path through distinct nodes. Proposition 6 is the only statement about fractional points: it assumes nonnegativity, no loops, (2), (3) and (30), and drops the remaining constraints of the relaxation, which makes it stronger.

The inequalities are stated for the arc variables of every feasible solution, not for an arbitrary 000–111 vector satisfying a few degree constraints; a statement of the latter kind is a different and false theorem. Useful contributions include the path structure of the arcs of a feasible solution inside a subset of P∪DP \cup DP∪D, the degree identities, and the milestone proofs, which are reusable for the other propositions.

Selected references

  • J.-F. Cordeau, A Branch-and-Cut Algorithm for the Dial-a-Ride Problem, Operations Research 54(3):573–586, 2006. https://doi.org/10.1287/opre.1060.0283
  • E. Balas, M. Fischetti, W. R. Pulleyblank, The precedence-constrained asymmetric traveling salesman polytope, Mathematical Programming 68:241–265, 1995 (as cited in Cordeau 2006).
  • M. Grötschel, M. W. Padberg, Polyhedral theory, in Lawler et al. (eds.), The Traveling Salesman Problem, Wiley, New York, 1985, pp. 251–305 (as cited in Cordeau 2006).
  • K. S. Ruland, E. Y. Rodin, The pickup and delivery problem: Faces and branch-and-cut algorithm, Computers & Mathematics with Applications 33:1–13, 1997 (as cited in Cordeau 2006).
7 thms1 active userReviewed
Probability·Captain: marwahaha

Polynomial vacuum representations and bridge mass for honeycomb walksOpen Problem

Motivation

Critical self-avoiding walks have weights balanced between exponential path growth and decay. The source studies bridge-length scaling; the available target establishes summability of the bridge sums used to define these quantities. The source is OpenAI's September 2026 manuscript.

Setting

A honeycomb bridge is a self-avoiding vertex list crossing a strip from a fixed initial port to any terminal port on the opposite layer. A path with LLL vertices has critical weight λL\lambda^LλL, with λ=(2cos⁡(π/8))−1\lambda=(2\cos(\pi/8))^{-1}λ=(2cos(π/8))−1.

Formalization targets

∑γw(γ)<∞,∑γL(γ)w(γ)<∞(h≥1),\sum_{\gamma}w(\gamma)<\infty,\qquad\sum_{\gamma}L(\gamma)w(\gamma)<\infty\qquad(h\ge1),γ∑​w(γ)<∞,γ∑​L(γ)w(γ)<∞(h≥1),

For every integer h ≥ 1, six families of sums over self-avoiding bridge paths in a honeycomb strip are absolutely summable. Vertices of the honeycomb lattice are of two kinds, up(i,j) and down(i,j) with integer i and j, and the layer of a vertex is its second index j; an up vertex (i,j) is adjacent to the down vertices (i,j−1), (i,j) and (i−1,j), and adjacency is symmetric. A bridge path of height h is a list of distinct vertices, consecutive ones adjacent, starting at up(0,0), ending at some down(i,h−1), with every vertex in layers 0 through h−1. Its weight is λ^L, where L is the number of vertices and λ = 1/(2cos(π/8)) is the critical activity, and its first-length weight is L·λ^L. Let bridgeMass(h) be the total weight of all bridge paths. A path is confined if every vertex has horizontal coordinate (i + j/2 for up vertices, i + j/2 + 1/2 for down vertices) of absolute value at most h(log h)², and confinedMass(h) is the total weight of confined paths. The theorem asserts summability over all bridge paths of the weight, of the first-length weight, and of the first-length weight divided by bridgeMass(h), and summability over confined paths of the weight, of the first-length weight, and of the first-length weight divided by confinedMass(h). The proof is admitted in the source, not established here.

The goal is OAI.PolynomialVacuumBridge.Corridor.finite_bridge_sums.

Significance

The full formal statement gives six summability assertions, including normalized first-length weights and their corridor-confined counterparts. These are prerequisites for interpreting bridge masses and mean lengths. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

Each strip has unbounded horizontal extent and admits paths of arbitrarily large length. Finite strip height therefore does not by itself make the path family finite.

Formalization scope

The length convention counts vertices. Confinement means horizontal coordinate bounded by h(log⁡h)2h(\log h)^2h(logh)2. The target proves summability, without asserting the manuscript’s h4/3+o(1)h^{4/3+o(1)}h4/3+o(1) asymptotic law. Normalized terms use the masses defined by tsum.

The shared definitions are supplied by HoneycombBridgeFiniteness. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, Polynomial vacuum representations and bridge mass for honeycomb walks, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
2 thms1 active userReviewed
Discrete Geometry·Captain: marwahaha

A power improvement in the Heilbronn triangle lower boundOpen Problem

Motivation

The Heilbronn triangle problem asks how large the smallest triangle in an nnn-point set can be. A positive improvement in the exponent would contradict bounds at every scale arbitrarily close to n−2n^{-2}n−2. The source is OpenAI's September 2026 manuscript.

Setting

Points lie in the closed unit square in the real plane. Triangle area is half the absolute determinant of the two displacement vectors, and the lower-bound condition quantifies over all triples of distinct points.

Formalization targets

δ>0,nj→∞,∣Pj∣=nj≥3,min⁡p,q,r∈Pj distinctArea⁡(pqr)≥nj−2+δ.\delta>0,\quad n_j\to\infty,\quad |P_j|=n_j\ge3,\quad\min_{p,q,r\in P_j\text{ distinct}}\operatorname{Area}(pqr)\ge n_j^{-2+\delta}.δ>0,nj​→∞,∣Pj​∣=nj​≥3,p,q,r∈Pj​ distinctmin​Area(pqr)≥nj−2+δ​.

The Heilbronn exponent δ is positive and that there exist a sequence of natural numbers n(j) tending to infinity and finite sets P(j) of points in the plane, such that for every j, n(j) ≥ 3, P(j) has exactly n(j) points, all lying in the closed unit square [0,1]×[0,1], and every triple of three distinct points of P(j) spans a triangle of area at least n(j)^(−2+δ). Triangle area is |(q₁−p₁)(r₂−p₂)−(q₂−p₂)(r₁−p₁)|/2. Here δ = 1/(100000·K) with K = T²+1, where T = C(M,3), M = C(4·41−1, 41) = C(163,41), so δ is an explicit but extremely small positive rational constant. Thus the statement asserts an infinite family of point sets whose smallest triangle area is at least a power n^(−2+δ).

The goal is OAI.Problem355.heilbronn_power_lower_bound. Supporting targets are listed below; they retain their individual hypotheses and are separate statements.

  • almost n minus two refuted.

Significance

The formal goal gives an unbounded sequence of configurations with a fixed explicit power improvement. An attached companion target rules out an eventual almost-n−2n^{-2}n−2 upper bound at half that exponent. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

Avoiding collinear triples is insufficient: every nonzero triangle must also satisfy one uniform quantitative area bound. The exponent must stay positive independently of the size of the configuration.

Formalization scope

The selected goal asserts a sequence tending to infinity, rather than the stronger all-sufficiently-large-sizes statement in the manuscript. The explicit exponent is heilbronnExponent, built from fixed binomial coefficients. Finite sets eliminate repeated points; real powers specify the area scale.

The shared definitions are supplied by HeilbronnTriangle. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, A power improvement in the Heilbronn triangle lower bound, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
3 thms1 active userReviewed
Probability·Captain: marwahaha

The sharp terminal leave in random triangle removalOpen Problem

Motivation

Random triangle deletion constructs a partial triangle packing. Its terminal uncovered edges measure how efficiently this process covers pairs, and the source seeks the leading constant rather than only the growth exponent. The source is OpenAI's September 2026 manuscript.

Setting

Start from the complete graph on nnn vertices. At each step choose a remaining triangle uniformly and remove its three edges. A triangle-free state stays fixed. The terminal leave FnF_nFn​ is the edge count at the end.

Formalization targets

E[(Fnn3/2−122)2]→0,Fnn3/2→P122,EFnn3/2→122.\mathbb E\left[\left(\frac{F_n}{n^{3/2}}-\frac1{2\sqrt2}\right)^2\right]\to0,\qquad \frac{F_n}{n^{3/2}}\xrightarrow{\mathbb P}\frac1{2\sqrt2},\qquad \frac{\mathbb E F_n}{n^{3/2}}\to\frac1{2\sqrt2}.E[(n3/2Fn​​−22​1​)2]→0,n3/2Fn​​P​22​1​,n3/2EFn​​→22​1​.

For the random triangle-removal process, three limits hold as n tends to infinity. The process starts from the complete graph on n vertices, with graphs represented as sets of 2-element subsets of Fin n. At each step, if the current graph G contains triangles (3-subsets all of whose pairs are edges of G), one triangle is chosen uniformly at random and its three edges are deleted; if there is no triangle, the graph stays unchanged. Running this for C(n,2) steps gives the terminal law on graphs, and expectation and probability are taken with respect to it. Writing normalizedLeave(G) = |E(G)| / n^(3/2) and sharpConstant c = 1/(2√2), the theorem asserts: first, the expected value of (normalizedLeave(G) − c)² tends to 0; second, for every ε > 0, the probability that |normalizedLeave(G) − c| > ε tends to 0; and third, the expected number of edges of the terminal graph divided by n^(3/2) tends to c.

The goal is OAI.SharpTerminalLeave.sharp_terminal_leave.

Significance

The three conclusions record mean-square concentration, concentration in probability, and the limiting normalized expectation. The exact leading constant is part of the target. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

Early evolution estimates need to remain informative near termination, where triangles become scarce. A high-probability estimate alone need not control the second moment required here.

Formalization scope

Graphs are finite sets of pairs from Fin n, with transitions given by probability mass functions. Running for the initial edge count guarantees that the absorbing terminal law is reached. Expectations are finite sums and all limits are along natural nnn tending to infinity.

The shared definitions are supplied by TriangleRemoval. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, The sharp terminal leave in random triangle removal, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
2 thms1 active userReviewed
Graph Theory·Captain: marwahaha

Paired states and Hamiltonian cycles in cubic bipartite planar graphsOpen Problem

Motivation

A spanning subgraph in which every vertex has degree two may split into several cycles. Barnette’s question asks when planarity, bipartiteness, and connectivity force those vertices onto one cycle. The source is OpenAI's September 2026 manuscript.

Setting

A cubic graph has degree three at every vertex. A bipartite graph has two vertex classes with every edge crossing between them. A Hamiltonian cycle visits all vertices exactly once before returning to its starting point. Planarity is represented by a drawing using injective continuous edge arcs in the real plane.

Formalization targets

G finite, simple, cubic, bipartite, planar, and 3-vertex-connected ⟹ G has a Hamiltonian cycle.G\text{ finite, simple, cubic, bipartite, planar, and 3-vertex-connected}\ \Longrightarrow\ G\text{ has a Hamiltonian cycle}.G finite, simple, cubic, bipartite, planar, and 3-vertex-connected ⟹ G has a Hamiltonian cycle.

Every finite simple graph with decidable vertex equality and adjacency has a Hamiltonian cycle if each vertex has degree three, the vertices can be partitioned into two classes with every edge joining different classes, the graph is planar, and it is three-vertex-connected. Here planarity means that vertices can be placed at distinct points of the real plane and edges drawn as injective continuous arcs whose interiors contain no vertices and whose interiors are disjoint for distinct undirected edges; reversing an edge reverses its arc. Three-vertex-connectivity means that the graph has at least four vertices and remains connected after deletion of any set of at most two vertices. The conclusion is the existence of one closed cycle visiting every vertex exactly once before returning to its starting vertex.

The goal is OAI.Barnette.main.

Significance

A proof would turn the source’s Hamiltonicity claim into a result available for arbitrary finite graphs satisfying these exact hypotheses. It would also provide a reusable bridge between geometric embeddings and combinatorial walks. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

Degree constraints do not guarantee that a spanning cycle cover is connected. The target requires a single cycle and must handle unrestricted face sizes, so verifying local degree conditions is insufficient.

Formalization scope

The published goal unfolds MainStatement. Three-vertex-connectivity requires at least four vertices and connectedness after deletion of any set of at most two vertices. The Hamiltonian object is a closed graph walk satisfying the cycle and vertex-coverage conditions. Stronger edge-avoidance conclusions from the paper are not attached as targets.

The shared definitions are supplied by BarnetteHamiltonian. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, Paired states and Hamiltonian cycles in cubic bipartite planar graphs, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
2 thms1 active userReviewed
Probability·Captain: marwahaha

Talagrand’s discrete-convexity conjectureOpen Problem

Motivation

High probability under independent coordinate sampling need not give a family any closure under unions. Discrete convexity asks whether a bounded number of its members nevertheless cover most sets in the stronger sense of inexpensive containment certificates. The source is OpenAI's September 2026 manuscript.

Setting

On Bernoulli product space 2[N]2^{[N]}2[N], each coordinate is present independently with probability ppp. For a family DDD, the exceptional family Ek(D)E_k(D)Ek​(D) consists of sets contained in no union of kkk members of DDD. A family is ppp-small when it has containment generators with total cost at most 1/21/21/2.

Formalization targets

μp(D)≥1−2−75⟹E275(D) is p-small.\mu_p(D)\ge1-2^{-75}\quad\Longrightarrow\quad E_{2^{75}}(D)\text{ is }p\text{-small}.μp​(D)≥1−2−75⟹E275​(D) is p-small.

For every positive integer N, every density p with 0<p<1, and every family D of subsets of the ground set {0,...,N-1} (an arbitrary family, with no monotonicity assumption), if the product measure of D under independent Bernoulli(p) coordinates, namely the sum over s in D of p^|s|(1-p)^(N-|s|), is at least 1 - 1/2^75, then the family of exceptional sets is small. Here the exceptional family for k=2^75 consists of all subsets S of the ground set that are contained in no union of k members of D, where the k members are given as an arbitrary tuple of exactly k entries of D, repeats allowed and with no disjointness required. A family A is small at density p if there is a family G of generator sets that covers A, meaning every member of A contains some member of G, and whose cost, the sum over I in G of p^|I|, is at most 1/2.

The goal is OAI.TalagrandDiscreteConvexity.talagrand_discrete_convexity.

Significance

The conclusion supplies explicit containment witnesses at the original density. A small probability for the exceptional event alone would not provide such a cover. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

The family is arbitrary, so monotonicity cannot be used as an extra hypothesis. The same universal number of unions must work for all dimensions and all densities strictly between zero and one.

Formalization scope

Lean uses finite families of finite subsets of Fin N, with N≥1N\ge1N≥1 and 0<p<10<p<10<p<1. A tuple has exactly 2752^{75}275 entries; repetitions and overlaps are allowed. The cover cost counts each generator once. The separate two-union density-loss corollary is outside this goal.

The shared definitions are supplied by TalagrandDiscreteConvexity. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, Talagrand’s discrete-convexity conjecture, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
2 thms1 active userReviewed
Probability·Captain: marwahaha

Integral and fractional expectation thresholds are equivalentOpen Problem

Motivation

An increasing property of a random set can be certified by small subsets. Fractional certificates allow weight to be spread across many subsets, so comparing them with ordinary certificates measures the cost of removing this relaxation. The source is OpenAI's September 2026 manuscript.

Setting

A cover is a family of generators such that every member of the increasing family contains a generator. A generator of size sss costs psp^sps. An ordinary cover and a fractional cover both have budget 1/21/21/2; a fractional cover assigns weights in [0,1][0,1][0,1] and supplies total weight at least one inside each member. The expectation thresholds qqq and qfq_fqf​ are suprema of feasible parameters in [0,1][0,1][0,1].

Formalization targets

qf(F)≤25⋅5124 q(F).q_f(\mathcal F)\le 25\cdot512^4\,q(\mathcal F).qf​(F)≤25⋅5124q(F).

For a finite nonempty ground type α and a family F of subsets of α that is nonempty, is not the entire power set, and is increasing (any superset of a member of F is again in F), the fractional threshold qf(F) is at most 25·512⁴ times the integral threshold q(F). Here q(F) is the supremum of those p in [0,1] for which F is small: some family G of sets covers F, meaning every H in F contains a member of G, with total cost Σ_{S∈G} p^{|S|} at most 1/2. The fractional threshold qf(F) is the analogous supremum of p in [0,1] for which there is a weight function g from subsets of α to [0,1] such that every H in F has Σ_{S⊆H} g(S) ≥ 1 and the fractional cost Σ_S g(S)·p^{|S|} is at most 1/2.

The goal is OAI.TalagrandThreshold.talagrand_expectation_threshold_equivalence.

Significance

The comparison gives a dimension-independent bound with the same budget on both sides. It isolates certificate rounding from the separate question of locating the random-set threshold. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

Replacing fractional weights independently can lose control of covering every member simultaneously. The constant must be independent of both ground-set size and the sizes of weighted sets.

Formalization scope

The ground type is finite and nonempty, and the family is nonempty, proper, and increasing. Costs are finite real sums and thresholds are real suprema. The exact constant in the published goal is retained; the objective is this inequality, not an unspecified equivalent comparison.

The shared definitions are supplied by TalagrandExpectationThreshold. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, Integral and fractional expectation thresholds are equivalent, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
2 thms1 active userReviewed
Graph Theory·Captain: marwahaha

A linear list-coloring bound in terms of the Hadwiger numberOpen Problem

Motivation

List coloring permits each vertex to have different allowable colors. The mission asks whether the size of the largest clique minor still controls the required list size up to a universal linear factor. The source manuscript presents the surrounding research claim.

Setting

A clique minor of order t is represented by disjoint connected vertex sets, with an edge between every pair. The Hadwiger number h(G) is the largest possible t. The list chromatic number is the least k for which every assignment of at least k colors per vertex admits a proper selection.

Formalization target

Prove one integer C≥1 works for every finite nonempty simple graph:

χlist(G)≤C h(G).\chi_{list}(G)\le C\,h(G).χlist​(G)≤Ch(G).

The constant is chosen before the graph, the vertex type and all color lists.

The selected formal target is OAI.LinearListHadwiger.main_theorem.

Significance and status

The assertion controls list coloring rather than only a common-color-set chromatic number. It is a linear-factor statement, without coefficient-one optimality. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

A coloring from one chosen palette need not respect independently assigned lists. The proof must cover arbitrary color types and list assignments.

Formalization scope

The definitions use finite graph vertex types, arbitrary finite color sets, induced-subgraph connectivity and natural-number infima/suprema. Nonemptiness of the vertex type is explicit. Only the main inequality and its definition block are attached.

Selected references

  • OpenAI, A linear list-coloring bound in terms of the Hadwiger number, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
2 thms1 active userReviewed
PreviousPage 8 of 12Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me