Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Combinatorics

629 missions · 363 completed

The mathematics of finite and discrete structures — counting the arrangements of a set, deciding when a configuration meeting prescribed constraints can exist, and characterizing the patterns such structures are forced to contain. It encompasses enumerative and extremal combinatorics, graph theory, design theory, and additive combinatorics, with deep ties to algebra, probability, and computer science.

Missions

Open266Completed363All629
Graph Theory·Captain: mikedeng1

Turán Graphs with Bounded Matching Number 2: For Color-Critical H of Chromatic Number k+1 > 2, Large s and n ≫ s, H-Free Graphs with Matching Number at Most s Have at Most g(n,k,s) EdgesResearch Paper

Motivation

Two classical extremal results bound the number of edges of an nnn-vertex graph under a single restriction. Turán's theorem (1941) says that a graph with no clique on k+1k+1k+1 vertices has at most t(n,k)t(n,k)t(n,k) edges, the edge count of the balanced complete kkk-partite graph. The Erdős–Gallai theorem (1959) gives the maximum number of edges of an nnn-vertex graph whose largest matching has at most sss edges. N. Alon and P. Frankl, Turán graphs with bounded matching number (arXiv:2210.15076v1; J. Combin. Theory Ser. B, 2024, DOI 10.1016/j.jctb.2023.12.002), combine the two restrictions. Their Theorem 1.1 determines the maximum for the clique constraint and every n≥2s+1n\ge 2s+1n≥2s+1 (mission 1 of this series). Their Proposition 3.1, the goal here, treats a whole class of forbidden graphs, the color-critical ones, when sss is large in terms of the forbidden graph and nnn is large in terms of sss.

Color-critical graphs are the natural class for exact Turán results: by a theorem of M. Simonovits (1968), for a color-critical HHH of chromatic number k+1k+1k+1 the Turán graph T(N,k)T(N,k)T(N,k) is extremal for HHH-freeness once NNN is large. Proposition 3.1 is the analogue of Simonovits' theorem under a matching constraint.

Setting

All graphs are finite and simple. For a graph GGG, a matching is a set of pairwise disjoint edges, and the matching number ν(G)\nu(G)ν(G) is the largest size of a matching. For a graph HHH, GGG is HHH-free if it contains no subgraph (not necessarily induced) isomorphic to HHH. The chromatic number χ(H)\chi(H)χ(H) is the least number of colors in a proper vertex coloring. HHH is color-critical if it has an edge eee with χ(H−e)<χ(H)\chi(H-e)<\chi(H)χ(H−e)<χ(H); examples are complete graphs and odd cycles.

The Turán graph T(n,k)T(n,k)T(n,k) is the complete kkk-partite graph on nnn vertices with classes of sizes as equal as possible; t(n,k)t(n,k)t(n,k) is its number of edges. For k≥2k\ge 2k≥2 and 2s≤n2s\le n2s≤n, the graph G(n,k,s)G(n,k,s)G(n,k,s) is the complete kkk-partite graph on nnn vertices consisting of k−1k-1k−1 classes of sizes as equal as possible whose total size is sss, and one further class of size n−sn-sn−s. Its number of edges is g(n,k,s)g(n,k,s)g(n,k,s).

In the Lean development, vertices of GGG are Fin n; the shared objects of this series live in TuranMatching.Clique.Setting: ν\nuν is matchingNumber, t(n,k)t(n,k)t(n,k) is turanNum n k (Mathlib's turanGraph), G(n,k,s)G(n,k,s)G(n,k,s) is bigGraph n k s, g(n,k,s)g(n,k,s)g(n,k,s) is gNum n k s, color-criticality is IsColorCritical, and the set XXX of vertices of degree exceeding 2s2s2s is highDeg G s.

Formalization targets

Goal: Proposition 3.1 (p. 5)

There is n0:N→Nn_0:\mathbb N\to\mathbb Nn0​:N→N such that for every color-critical HHH with χ(H)=k+1>2\chi(H)=k+1>2χ(H)=k+1>2 there is s0(H)s_0(H)s0​(H) with: for all s>s0(H)s>s_0(H)s>s0​(H) and n>n0(s)n>n_0(s)n>n0​(s),

max⁡{∣E(G)∣:∣V(G)∣=n, G H-free, ν(G)≤s}=g(n,k,s).\max\{|E(G)| : |V(G)|=n,\ G\ H\text{-free},\ \nu(G)\le s\}=g(n,k,s).max{∣E(G)∣:∣V(G)∣=n, G H-free, ν(G)≤s}=g(n,k,s).

The maximum is stated as an upper bound for every admissible GGG together with an admissible graph attaining g(n,k,s)g(n,k,s)g(n,k,s). The thresholds s0s_0s0​ and n0n_0n0​ are left existential, as on the page.

Milestones (pp. 5–6)

  1. G(n,k,s)G(n,k,s)G(n,k,s) is kkk-colorable, HHH-free for every HHH with χ(H)=k+1\chi(H)=k+1χ(H)=k+1, and ν(G(n,k,s))=s\nu(G(n,k,s))=sν(G(n,k,s))=s (for 2s≤n2s\le n2s≤n).
  2. If ν(G)≤s\nu(G)\le sν(G)≤s then at most sss vertices have degree exceeding 2s2s2s: ∣X∣≤s|X|\le s∣X∣≤s.
  3. If every degree is at most 2s2s2s and ν(G)≤s\nu(G)\le sν(G)≤s, then ∣E(G)∣≤(2s+1)s|E(G)|\le(2s+1)s∣E(G)∣≤(2s+1)s.
  4. If ν(G)≤s\nu(G)\le sν(G)≤s and ∣X∣<s|X|<s∣X∣<s, then ∣E(G)∣<(s−1)n+2(s+1)s|E(G)|<(s-1)n+2(s+1)s∣E(G)∣<(s−1)n+2(s+1)s.
  5. (s−1)n+2(s+1)s<g(n,k,s)(s-1)n+2(s+1)s<g(n,k,s)(s−1)n+2(s+1)s<g(n,k,s) for n>3s2+2sn>3s^2+2sn>3s2+2s.
  6. If ν(G)≤s\nu(G)\le sν(G)≤s and ∣X∣=s|X|=s∣X∣=s, then V−XV-XV−X is independent.
  7. Simonovits' theorem: an HHH-free graph on N≥N0(H)N\ge N_0(H)N≥N0​(H) vertices has at most t(N,k)t(N,k)t(N,k) edges.
  8. If ∣X∣=s|X|=s∣X∣=s, V−XV-XV−X is independent, ZZZ is disjoint from XXX with ∣Z∣=⌊s/(k−1)⌋|Z|=\lfloor s/(k-1)\rfloor∣Z∣=⌊s/(k−1)⌋ and G[X∪Z]G[X\cup Z]G[X∪Z] has at most t(s+⌊s/(k−1)⌋,k)t(s+\lfloor s/(k-1)\rfloor,k)t(s+⌊s/(k−1)⌋,k) edges, then ∣E(G)∣≤g(n,k,s)|E(G)|\le g(n,k,s)∣E(G)∣≤g(n,k,s).

Significance

The proposition settles, for every color-critical HHH and large parameters, the Turán problem with a bounded matching number, and identifies the extremal graph G(n,k,s)G(n,k,s)G(n,k,s), which does not depend on HHH beyond its chromatic number. For H=Kk+1H=K_{k+1}H=Kk+1​ it agrees with the large-nnn case of Theorem 1.1 of the same paper. The structural steps (few high-degree vertices, the independence of the low-degree side) are reusable in other degree-based arguments under matching constraints.

The result is proved in the paper; none of it is formalized. The mission produces, besides the goal, two classical theorems absent from Mathlib in the forms needed here: the matching-number consequence of Vizing's theorem (milestone 3) and Simonovits' exact Turán theorem for color-critical graphs (milestone 7). Milestone 7 is a cited classical theorem, not a result of Alon and Frankl; it is posed because the proof rests on it. Mathlib currently has Turán's theorem for cliques and the Erdős–Stone–Simonovits density theorem, but not the exact result for color-critical graphs.

Difficulty

Milestones 1, 2, 4, 5, 6 and 8 are elementary counting arguments, though each requires building matchings or explicit counts in Lean. Milestone 8 contains the paper's "easy to see" isomorphism, which in Lean is an identity between two edge counts, t(s+m,k)+(n−s−m)s=g(n,k,s)t(s+m,k)+(n-s-m)s=g(n,k,s)t(s+m,k)+(n−s−m)s=g(n,k,s) with m=⌊s/(k−1)⌋m=\lfloor s/(k-1)\rfloorm=⌊s/(k−1)⌋.

Milestone 3 needs Vizing's edge-coloring theorem (a graph of maximum degree Δ\DeltaΔ is properly (Δ+1)(\Delta+1)(Δ+1)-edge-colorable). A naive greedy edge coloring gives only 2Δ−12\Delta-12Δ−1 colors, which bounds the edge count by about (4s−1)s(4s-1)s(4s−1)s and is too weak for the comparison in milestones 4 and 5.

Milestone 7 is the hardest item. The density version (Erdős–Stone–Simonovits) gives t(N,k)+o(N2)t(N,k)+o(N^2)t(N,k)+o(N2) edges only; the exact bound for color-critical HHH requires Simonovits' stability method, an argument that an almost-extremal HHH-free graph is close to T(N,k)T(N,k)T(N,k) followed by a cleaning step that uses the critical edge.

Formalization scope

Graphs are SimpleGraph (Fin n) with decidable adjacency; edges are counted by #G.edgeFinset. The matching number is the supremum, in N\mathbb NN, of the edge counts of matching subgraphs; the set is nonempty and bounded, so this is the true maximum and not a junk value. g(n,k,s)g(n,k,s)g(n,k,s) is defined as the edge count of the graph G(n,k,s)G(n,k,s)G(n,k,s), not by a closed formula. Chromatic numbers live in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞} (Mathlib's chromaticNumber), both in the definition of color-critical and in the hypothesis χ(H)=k+1\chi(H)=k+1χ(H)=k+1. HHH-freeness is Mathlib's SimpleGraph.Free (no subgraph copy). The vertex type of HHH is any finite type in the lowest universe.

Conventions committed to:

  • k≥2k\ge 2k≥2 is the page's k+1>2k+1>2k+1>2; it is needed because G(n,k,s)G(n,k,s)G(n,k,s) has k−1k-1k−1 classes and the proof divides by k−1k-1k−1.
  • Quantifier order is the page's: n0n_0n0​ is a function of sss alone and is chosen before HHH; s0s_0s0​ depends on HHH only.
  • Milestone 1 states kkk-colorability for the page's "kkk chromatic", and carries 2s≤n2s\le n2s≤n, which the page leaves implicit.
  • Milestone 3 bounds edges where the page writes "the number of vertices"; the vertex count is not bounded.
  • Milestone 5 uses the threshold n>3s2+2sn>3s^2+2sn>3s2+2s. The page's "nnn exceeding, say, 3s23s^23s2" is too small: for k=2k=2k=2, s=2s=2s=2, n=13n=13n=13 one has (s−1)n+2(s+1)s=25>22=g(13,2,2)(s-1)n+2(s+1)s=25>22=g(13,2,2)(s−1)n+2(s+1)s=25>22=g(13,2,2). The goal is unaffected, since n0(s)n_0(s)n0​(s) is unspecified.
  • Milestone 4 carries s≥1s\ge 1s≥1 so that s−1s-1s−1 is honest natural-number subtraction.

A formalization that states only the upper bound, without an attaining graph, or that places the existential n0n_0n0​ after sss is fixed as a constant independent of sss, or that defines ν\nuν or ggg so that they take junk values, is a different and weaker statement and is ruled out.

Infrastructure that would be reusable beyond this mission: a matching-number API on Mathlib's Subgraph.IsMatching (in particular ν(G)≤ν(G′)\nu(G)\le\nu(G')ν(G)≤ν(G′) for G≤G′G\le G'G≤G′ and the behaviour under induced subgraphs); Vizing's theorem; and Simonovits' theorem. Contributions of any of these, and of partial results toward milestone 7 (for example the case H=C2ℓ+1H=C_{2\ell+1}H=C2ℓ+1​), are welcome.

Selected references

  • N. Alon and P. Frankl, Turán graphs with bounded matching number, arXiv:2210.15076v1, 2022; J. Combin. Theory Ser. B, 2024. https://arxiv.org/abs/2210.15076, https://doi.org/10.1016/j.jctb.2023.12.002
  • M. Simonovits, A method for solving extremal problems in graph theory, stability problems, in: Theory of Graphs (Proc. Colloq., Tihany, 1966), Academic Press, 1968, pp. 279–319.
  • P. Erdős and T. Gallai, On maximal paths and circuits of graphs, Acta Math. Acad. Sci. Hungar. 10 (1959), 337–356. https://doi.org/10.1007/BF02024498
  • P. Turán, On an extremal problem in graph theory (in Hungarian), Mat. Fiz. Lapok 48 (1941), 436–452.
  • V. G. Vizing, On an estimate of the chromatic class of a p-graph, Diskret. Analiz 3 (1964), 25–30.
11 thms1 active userReviewed
Complexity TheoryLinear OptimizationTheoretical Computer Science·Captain: mikedeng1

Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy 2: The LP Algorithm Decides PCSPs with Majority or Alternating-Threshold Polymorphisms of All Odd AritiesResearch Paper

Motivation

A constraint satisfaction problem (CSP) asks whether variables can be assigned values so that every constraint of a given instance holds. Feder and Vardi conjectured, and Bulatov and Zhuk proved in 2017, that every CSP over a finite set of relations is either polynomial-time solvable or NP-complete, and that the answer is governed by the polymorphisms of the relations: the functions that map tuples of satisfying assignments, coordinate by coordinate, to a satisfying assignment.

A promise CSP (PCSP) relaxes the question. Each constraint comes as a pair of relations P⊆QP \subseteq QP⊆Q; the input is promised to be satisfiable with every constraint read as PPP, or unsatisfiable even with every constraint read as QQQ, and the task is to tell which. Approximate graph colouring ("is this 3-colourable graph 100-colourable?") and (2+ε)(2+\varepsilon)(2+ε)-SAT are of this kind. Austrin, Guruswami and Håstad (2017, doi:10.1137/15M1006507) showed that (2+ε)(2+\varepsilon)(2+ε)-SAT is NP-hard via polymorphisms; Brakensiek and Guruswami extended the polymorphism view to general Boolean PCSPs and proved a dichotomy for symmetric Boolean families (arXiv:1704.01937v2, SODA 2018, SIAM J. Comput. 2021). Later work by Barto, Bulín, Krokhin and Opršal (arXiv:1811.00970) built the general algebraic theory of PCSPs on this foundation.

This mission takes one ingredient of the dichotomy: the tractable side for two polymorphism families that have no counterpart among tractable CSPs, the Majority and the Alternating-Threshold functions. The paper solves both with the same linear programming test.

Setting

The domain is {0,1}\{0,1\}{0,1}. A finite family of promise relations is Γ={(PR,QR):R∈τ}\Gamma = \{(P_R, Q_R) : R \in \tau\}Γ={(PR​,QR​):R∈τ}, with τ\tauτ finite and PR⊆QR⊆{0,1}kRP_R \subseteq Q_R \subseteq \{0,1\}^{k_R}PR​⊆QR​⊆{0,1}kR​. An instance Ψ=(ΨP,ΨQ)\Psi = (\Psi_P, \Psi_Q)Ψ=(ΨP​,ΨQ​) has variables x1,…,xnx_1, \dots, x_nx1​,…,xn​ and clauses Rj(xj1,…,xjk)R_j(x_{j_1}, \dots, x_{j_k})Rj​(xj1​​,…,xjk​​); a variable may occur several times in a clause. ΨP\Psi_PΨP​ reads each clause with PRjP_{R_j}PRj​​, and ΨQ\Psi_QΨQ​ with QRjQ_{R_j}QRj​​. Since P⊆QP \subseteq QP⊆Q, satisfiability of ΨP\Psi_PΨP​ implies that of ΨQ\Psi_QΨQ​.

A function f:{0,1}L→{0,1}f : \{0,1\}^L \to \{0,1\}f:{0,1}L→{0,1} is a polymorphism of Γ\GammaΓ if for every RRR and all x(1),…,x(L)∈PRx^{(1)}, \dots, x^{(L)} \in P_Rx(1),…,x(L)∈PR​ the tuple (f(x1(1),…,x1(L)),…,f(xk(1),…,xk(L)))\big(f(x^{(1)}_1, \dots, x^{(L)}_1), \dots, f(x^{(1)}_k, \dots, x^{(L)}_k)\big)(f(x1(1)​,…,x1(L)​),…,f(xk(1)​,…,xk(L)​)) lies in QRQ_RQR​. For odd LLL,

MajL(x)=1  ⟺  ∑i=1Lxi>L2,ATL(x)=1  ⟺  ∑i=1L(−1)i−1xi>0.\mathrm{Maj}_L(x) = 1 \iff \sum_{i=1}^L x_i > \frac L2, \qquad \mathrm{AT}_L(x) = 1 \iff \sum_{i=1}^L (-1)^{i-1} x_i > 0 .MajL​(x)=1⟺i=1∑L​xi​>2L​,ATL​(x)=1⟺i=1∑L​(−1)i−1xi​>0.

The LP relaxation of Ψ\PsiΨ has one unknown vj∈[0,1]v_j \in [0,1]vj​∈[0,1] per variable, and for every clause Rj(xj1,…,xjk)R_j(x_{j_1}, \dots, x_{j_k})Rj​(xj1​​,…,xjk​​) of ΨP\Psi_PΨP​ it requires (vj1,…,vjk)(v_{j_1}, \dots, v_{j_k})(vj1​​,…,vjk​​) to lie in the convex hull of PRjP_{R_j}PRj​​. The §3.2 algorithm loops over the variables: it fixes vj=0v_j = 0vj​=0 and re-solves the LP, then, if that is infeasible, fixes vj=1v_j = 1vj​=1 and re-solves, and outputs "unsatisfiable" if both are infeasible. If every variable passes, it outputs "satisfiable". In Lean the answer is the predicate LPAlgAccepts 𝔸 X: the LP is feasible and, for each jjj, it has a solution with vj=0v_j = 0vj​=0 or one with vj=1v_j = 1vj​=1.

Formalization targets

Goal: correctness of the §3.2 algorithm

If MajL∈Pol(Γ)\mathrm{Maj}_L \in \mathrm{Pol}(\Gamma)MajL​∈Pol(Γ) for every odd LLL, or ATL∈Pol(Γ)\mathrm{AT}_L \in \mathrm{Pol}(\Gamma)ATL​∈Pol(Γ) for every odd LLL, then for every instance Ψ\PsiΨ

ΨP satisfiable  ⟹  LPAlgAccepts(Ψ)  ⟹  ΨQ satisfiable.\Psi_P \text{ satisfiable} \;\Longrightarrow\; \texttt{LPAlgAccepts}(\Psi) \;\Longrightarrow\; \Psi_Q \text{ satisfiable}.ΨP​ satisfiable⟹LPAlgAccepts(Ψ)⟹ΨQ​ satisfiable.

No symmetry of the relations is assumed.

Milestones, in the order of the proof (pp. 14–15)

  1. Completeness. If ΨP\Psi_PΨP​ is satisfiable, the algorithm accepts; no polymorphism is needed.
  2. Convexity. A convex combination of LP solutions is an LP solution.
  3. Case 1 claim. If M∈([0,1]∩Q)n×nM \in ([0,1]\cap\mathbb Q)^{n\times n}M∈([0,1]∩Q)n×n has Mii∈{0,1}M_{ii} \in \{0,1\}Mii​∈{0,1}, some rational probability vector vvv has (Mv)i≠1/2(Mv)_i \ne 1/2(Mv)i​=1/2 for all iii.
  4. Case 1 rounding. With MajL\mathrm{Maj}_LMajL​ for all odd LLL, an LP solution www with no coordinate 1/21/21/2 rounds to a satisfying assignment xi∗=⌊wi⌉x^*_i = \lfloor w_i \rceilxi∗​=⌊wi​⌉ of ΨQ\Psi_QΨQ​.
  5. Case 2 perturbation. For such MMM and any rational w^\hat ww^, some vvv has (Mv)i≠w^i(Mv)_i \ne \hat w_i(Mv)i​=w^i​ wherever w^i∉{0,1}\hat w_i \notin \{0,1\}w^i​∈/{0,1}.
  6. Case 2 rounding. With ATL\mathrm{AT}_LATL​ for all odd LLL, two LP solutions w,w^w, \hat ww,w^ that agree only where w^i∈{0,1}\hat w_i \in \{0,1\}w^i​∈{0,1} give the satisfying assignment xi∗=[wi>w^i or wi=w^i=1]x^*_i = [w_i > \hat w_i \text{ or } w_i = \hat w_i = 1]xi∗​=[wi​>w^i​ or wi​=w^i​=1] of ΨQ\Psi_QΨQ​.

Significance

The theorem shows that the Majority and Alternating-Threshold cases of Theorem 3.2 are tractable. Since Γ\GammaΓ is fixed, the LP has size linear in the instance, so linear programming decides PCSP(Γ)\mathrm{PCSP}(\Gamma)PCSP(Γ) in polynomial time. Unlike the Zero, One, AND, OR and Parity cases of §3.1, these families cannot be handled by sandwiching a tractable CSP between PPP and QQQ: footnote 12 of the paper observes that the closure of {MajL}\{\mathrm{Maj}_L\}{MajL​} or {ATL}\{\mathrm{AT}_L\}{ATL​} under identification of variables is not a clone. The tractable half of the paper's symmetric Boolean dichotomy (Theorem 2.16) depends on this result. Later work replaced this LP by the Basic LP and BLP+Affine relaxations (Brakensiek–Guruswami 2019, Barto et al. 2021).

The result is proved in the paper; to our knowledge it has no machine-checked proof. The formal content is a finite-dimensional rational convexity argument plus a counting argument on columns of polymorphism inputs. Related platform work: the published PCSPBLPAff.Symmetric.theorem_2 and theorem_3 concern the BLP+Affine algorithm with symmetric or block-symmetric polymorphisms. That is a different relaxation, and ATL\mathrm{AT}_LATL​ is not symmetric.

Difficulty

Completeness is immediate. Soundness is where the difficulty lies. The obvious approach, rounding an arbitrary LP solution, fails. For Majority, a coordinate equal to 1/21/21/2 has no nearest integer, and the LP may admit no solution without such coordinates unless one uses the per-variable solutions the algorithm found. For Alternating-Threshold, there is no fixed threshold at all, and a single LP solution gives no rule for rounding a fractional coordinate. Two further points need care. Getting from a fractional point back to a polymorphism application needs a polymorphism of an arity that depends on the denominators of the hull weights, so a single fixed arity does not suffice. In the Alternating-Threshold case, as printed, the paper pads the inputs with an arbitrary point of PPP, and that step fails at coordinates where both solutions equal 000 or 111; the padding point has to come from the support of the hull weights.

Formalization scope

The domain {0,1}\{0,1\}{0,1} is Bool. Γ\GammaΓ is a pair 𝔸 𝔹 : RelStruct τ ar Bool with [Fintype τ] and 𝔸.rel R ⊆ 𝔹.rel R, and instances, satisfiability and polymorphisms come from the published PCSPBLPAff_Symmetric_Setting. Coordinates are 0-based (Fin L), so the sign of ATL\mathrm{AT}_LATL​ is (−1)i(-1)^i(−1)i. The LP is stated over Q\mathbb QQ; an LP with rational data is feasible over R\mathbb RR exactly when it is feasible over Q\mathbb QQ. The hull condition uses PRP_RPR​, never QRQ_RQR​. The acceptance predicate also requires the LP itself to be feasible, which matters only for instances without variables. The hypothesis is a disjunction of two universal statements ("MajL\mathrm{Maj}_LMajL​ for all odd LLL, or ATL\mathrm{AT}_LATL​ for all odd LLL"), not "for every odd LLL, one of the two". A formalization that drops the hull constraint, replaces PPP by QQQ in the LP, or lets the acceptance predicate be satisfied without solving the LP would make the theorem trivial or different, and is ruled out by the definitions here.

Out of scope: polynomial running time and the printed conclusion "PCSP(Γ) is polynomial-time tractable" of Theorem 3.2; the polynomial-time solvability of linear programs; the Zero/One/AND/OR/Parity cases (Lemma 3.1, which invokes Schaefer's theorem); and the non-idempotent ("anti-") cases, which go through the reduction of Lemma 2.13(2). The Remark on p. 15 says the algorithm decides but does not find a solution. Only the decision is formalized.

Infrastructure needed: finite convex combinations over Q\mathbb QQ, a perturbation lemma for avoiding finitely many hyperplanes in the rational simplex, and counting identities for MajL\mathrm{Maj}_LMajL​ and ATL\mathrm{AT}_LATL​ on block inputs. The perturbation lemma and the counting identities are reusable beyond this mission. Proofs of any milestone, and alternative arguments (e.g. via the affine-hull algorithm in the Remark on p. 14), are welcome.

Selected references

  • J. Brakensiek, V. Guruswami, Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy, arXiv:1704.01937v2, 2021; SIAM J. Comput. 50(6), 2021. https://arxiv.org/abs/1704.01937v2
  • P. Austrin, V. Guruswami, J. Håstad, (2+ε)-Sat Is NP-Hard, SIAM J. Comput. 46(5), 2017. https://doi.org/10.1137/15M1006507
  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic Approach to Promise Constraint Satisfaction, J. ACM 68(4), 2021. https://arxiv.org/abs/1811.00970
  • J. Brakensiek, V. Guruswami, An Algorithmic Blend of LPs and Ring Equations for Promise CSPs, SODA 2019. https://arxiv.org/abs/1807.05194
  • T. J. Schaefer, The Complexity of Satisfiability Problems, STOC 1978. https://doi.org/10.1145/800133.804350
10 thms1 active userReviewed
AlgebraDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 5: For h ≥ 2, Two h-Scattered Linear Sets Are PΓL(r, qⁿ)-Equivalent iff Their Subspaces Are ΓL(r, qⁿ)-EquivalentResearch Paper

Motivation

Linear sets are point sets of a finite projective space defined by a subspace over a subfield. They appear throughout finite geometry, for instance in the study of semifields and, through the correspondence studied by Sheekey and Van de Voorde (arXiv:1806.05929), maximum rank distance (MRD) codes; see Polverino's survey (doi:10.1016/j.disc.2009.04.007). In these applications one needs to decide when two linear sets are the same up to a collineation, which can be difficult (Csajbók–Zanella, arXiv:1501.03441; Csajbók–Marino–Polverino, arXiv:1607.06962). The natural candidate answer, "when their defining subspaces are in the same orbit of the semilinear group", is only a sufficient condition: on the projective line PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn) there are maximum scattered subspaces in different ΓL(2,qn)\Gamma\mathrm L(2,q^n)ΓL(2,qn)-orbits defining equivalent linear sets (the two papers just cited).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590, Combinatorica 41 (2021)) introduced hhh-scattered subspaces, a generalisation of scattered subspaces, and showed in their §4 that for h≥2h \ge 2h≥2 the sufficient condition is also necessary. This mission formalizes that result, Theorem 4.5.

Setting

Let Fq⊆Fqn\mathbb F_q \subseteq \mathbb F_{q^n}Fq​⊆Fqn​ be finite fields and let VVV be an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​; it is also a vector space over Fq\mathbb F_qFq​. The projective space PG(V,Fqn)=PG(r−1,qn)\mathrm{PG}(V,\mathbb F_{q^n}) = \mathrm{PG}(r-1,q^n)PG(V,Fqn​)=PG(r−1,qn) has as points the one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces ⟨u⟩Fqn\langle u\rangle_{\mathbb F_{q^n}}⟨u⟩Fqn​​, u≠0u \ne 0u=0.

For an Fq\mathbb F_qFq​-subspace UUU of VVV, the Fq\mathbb F_qFq​-linear set of UUU is

LU={⟨u⟩Fqn:u∈U∖{0}},L_U = \{\langle u\rangle_{\mathbb F_{q^n}} : u \in U\setminus\{0\}\},LU​={⟨u⟩Fqn​​:u∈U∖{0}},

of rank dim⁡FqU\dim_{\mathbb F_q} UdimFq​​U.

For 0<h≤r−10 < h \le r-10<h≤r−1, the subspace UUU is hhh-scattered (Definition 1.1) if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U) \le hdimFq​​(S∩U)≤h. The linear set LUL_ULU​ of an hhh-scattered UUU is called hhh-scattered (Definition 4.1); for h=2h = 2h=2 it is scattered with respect to lines.

The group ΓL(r,qn)\Gamma\mathrm L(r,q^n)ΓL(r,qn) consists of the bijective additive maps fff of VVV that are semilinear: f(av)=aσf(v)f(av) = a^\sigma f(v)f(av)=aσf(v) for some field automorphism σ\sigmaσ of Fqn\mathbb F_{q^n}Fqn​. Each fff induces a collineation φf\varphi_fφf​ of PG(V,Fqn)\mathrm{PG}(V,\mathbb F_{q^n})PG(V,Fqn​), ⟨u⟩↦⟨f(u)⟩\langle u\rangle \mapsto \langle f(u)\rangle⟨u⟩↦⟨f(u)⟩, and these collineations form PΓL(r,qn)\mathrm P\Gamma\mathrm L(r,q^n)PΓL(r,qn). Two linear sets are PΓL\mathrm P\Gamma\mathrm LPΓL-equivalent if φf(LU)=LW\varphi_f(L_U) = L_Wφf​(LU​)=LW​ for some fff; two subspaces are ΓL\Gamma\mathrm LΓL-equivalent if f(U)=Wf(U) = Wf(U)=W for some fff.

Formalization targets

Goal: Theorem 4.5 (p. 14)

For h≥2h \ge 2h≥2 and hhh-scattered Fq\mathbb F_qFq​-subspaces UUU, WWW of V(r,qn)V(r,q^n)V(r,qn),

LU∼PΓL(r,qn)LW  ⟺  U∼ΓL(r,qn)W.L_U \sim_{\mathrm P\Gamma\mathrm L(r,q^n)} L_W \iff U \sim_{\Gamma\mathrm L(r,q^n)} W .LU​∼PΓL(r,qn)​LW​⟺U∼ΓL(r,qn)​W.

Milestones (in the order of the proof)

  1. Proposition 2.1 (p. 3): an hhh-scattered subspace is iii-scattered for every 0<i<h0 < i < h0<i<h.
  2. Proposition 4.2 (p. 13, quoted from Bonoli–Polverino [5]): on a projective line PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn), (1) a linear set with q+1q+1q+1 points has rank 222; (2) two subspaces defining the same linear set of size q+1q+1q+1 and sharing a nonzero vector coincide.
  3. Proposition 4.3 (p. 13): if UUU is 222-scattered and LW=LUL_W = L_ULW​=LU​, then dim⁡FqW=dim⁡FqU\dim_{\mathbb F_q} W = \dim_{\mathbb F_q} UdimFq​​W=dimFq​​U.
  4. Lemma 4.4 (p. 13): if UUU is 222-scattered and LU=LWL_U = L_WLU​=LW​, then U=λWU = \lambda WU=λW for some λ∈Fqn∗\lambda\in\mathbb F_{q^n}^*λ∈Fqn∗​.

Significance

The result. Theorem 4.5 says that, for h≥2h\ge2h≥2, an hhh-scattered linear set remembers its defining subspace up to a scalar and up to the semilinear group. The equivalence problem for such linear sets, a geometric question about point sets, becomes the equivalence problem for subspaces, which is algebraic and can be attacked with linearized polynomials. Through the correspondence of Sheekey and Van de Voorde between maximum (r−1)(r-1)(r−1)-scattered subspaces and MRD codes, the paper derives from it (Theorem 4.10, not part of this mission) that two Fq\mathbb F_qFq​-linear MRD codes with minimum distance n−r+1n-r+1n−r+1, r>2r>2r>2, and left idealiser isomorphic to Fqn\mathbb F_{q^n}Fqn​ are equivalent if and only if their associated linear sets in PG(r−1,qn)\mathrm{PG}(r-1,q^n)PG(r−1,qn) are PΓL\mathrm P\Gamma\mathrm LPΓL-equivalent. Lemma 4.4 and Proposition 4.3 are of independent use: they say that the rank and, up to scalars, the subspace of any linear set scattered with respect to lines are invariants of the point set.

The formalization. The theorem is proved in the paper; no part of it, nor any statement about linear sets over a field extension, is machine-checked in Mathlib. The mission produces a formal model of linear sets, of the semilinear group and of its induced collineations that later finite-geometry missions can reuse, together with formal proofs of the four milestones. Proposition 4.2 is quoted from [5] without proof in the paper, so formalizing it means formalizing Bonoli and Polverino's argument.

Difficulty

The "if" direction is a direct computation, LUf=LUφfL_{U^f} = L_U^{\varphi_f}LUf​=LUφf​​. The obvious approach to the converse, reconstructing UUU from LUL_ULU​ point by point, fails because a point ⟨u⟩\langle u\rangle⟨u⟩ of LUL_ULU​ determines U∩⟨u⟩U\cap\langle u\rangleU∩⟨u⟩ only up to a scalar of Fqn∗\mathbb F_{q^n}^*Fqn∗​, and these scalars can a priori differ from point to point. Without the condition h≥2h \ge 2h≥2 they really do differ: for h=1h = 1h=1 the theorem is false. The step that needs h≥2h\ge2h≥2 is the rigidity of the intersections of UUU with two-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces, which is where the quoted result on linear sets of size q+1q+1q+1 on a projective line enters. Proposition 4.2 itself is a counting statement about point weights on PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn) and is not available in any library.

Formalization scope

  • Fq\mathbb F_qFq​ and Fqn\mathbb F_{q^n}Fqn​ are arbitrary finite fields F, K with [Algebra F K]; qqq is Fintype.card F. VVV is a finite-dimensional K-module with a compatible F-module structure ([IsScalarTower F K V]), and rrr is Module.finrank K V.
  • IsHScattered F K h U includes the range 0<h<r0 < h < r0<h<r and the spanning condition ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V, as in Definition 1.1. With h≥2h\ge2h≥2 this forces r≥3r\ge3r≥3.
  • A point is the K-submodule K ∙ u; linearSet F K U is a Set (Submodule K V) and ∣LU∣|L_U|∣LU​∣ is its Set.ncard.
  • ΓL\Gamma\mathrm LΓL is the set of f : V ≃+ V for which some σ : K ≃+* K gives f (a • v) = σ a • f v. The collineation φf\varphi_fφf​ sends a subspace PPP to Submodule.span K (f '' P). The image UfU^fUf is the set f '' U, and λW\lambda WλW is (λ • ·) '' W with λ≠0\lambda\ne0λ=0.
  • Two trivializing readings are excluded. Restricting to linear maps (GL, PGL) would prove a different, weaker statement; taking PΓL\mathrm{P}\Gamma\mathrm{L}PΓL-equivalence to mean "some bijection of points maps LUL_ULU​ to LWL_WLW​" would make the "only if" direction false. Both equivalences quantify over the full semilinear group, and the collineation is the one induced by the same fff.
  • Proposition 4.2 is a result the paper numbers but quotes from [5] (Bonoli–Polverino, Fq\mathbb F_qFq​-linear blocking sets in PG(2,q4)\mathrm{PG}(2,q^4)PG(2,q4)). It is a milestone with its own proof obligation and is not assumed. The two parts are separate items.
  • Proposition 2.1's "for any i<hi < hi<h" is read as 0<i<h0 < i < h0<i<h, the range on which Definition 1.1 defines iii-scattered.

Welcome contributions: the general theory of linear sets (point weights, ∣LU∣≤(qk−1)/(q−1)|L_U| \le (q^k-1)/(q-1)∣LU​∣≤(qk−1)/(q−1) with equality iff UUU is scattered), the fact that a semilinear map of VVV maps Fq\mathbb F_qFq​-subspaces to Fq\mathbb F_qFq​-subspaces, and the counting argument behind Proposition 4.2. These are reusable for every linear-set mission.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, Combinatorica 41 (2021); arXiv:1906.10590v2 (2020). https://arxiv.org/abs/1906.10590
  • G. Bonoli, O. Polverino, Fq\mathbb F_qFq​-linear blocking sets in PG(2,q4)\mathrm{PG}(2,q^4)PG(2,q4), Innov. Incidence Geom. 2 (2005), 35–56. https://doi.org/10.2140/iig.2005.2.35
  • B. Csajbók, G. Marino, O. Polverino, Classes and equivalence of linear sets in PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn), J. Combin. Theory Ser. A 157 (2018), 402–426. https://arxiv.org/abs/1607.06962
  • B. Csajbók, C. Zanella, On the equivalence of linear sets, Des. Codes Cryptogr. 81 (2016), 269–281. https://arxiv.org/abs/1501.03441
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. 310 (2010), 3096–3107. https://doi.org/10.1016/j.disc.2009.04.007
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://arxiv.org/abs/1806.05929
9 thms1 active userReviewed
Graph Theory·Captain: mikedeng1

Turán Graphs with Bounded Matching Number 1: An n-Vertex Graph with Clique Number at Most k and Matching Number at Most s Has at Most max{t(2s+1,k), g(n,k,s)} Edges, and This Is AttainedResearch Paper

Two classical extremal problems and their common generalization

Two of the oldest results in extremal graph theory bound the number of edges of a graph under a single structural restriction. Turán's theorem (Turán 1941) determines the maximum number of edges t(n,k)t(n,k)t(n,k) of an nnn-vertex graph with no complete subgraph on k+1k+1k+1 vertices. The Erdős–Gallai theorem (Erdős and Gallai 1959) determines the maximum number of edges of an nnn-vertex graph with no s+1s+1s+1 pairwise disjoint edges; for n≥2s+1n\ge 2s+1n≥2s+1 it is max⁡{(2s+12),(s2)+s(n−s)}\max\{\binom{2s+1}{2},\binom{s}{2}+s(n-s)\}max{(22s+1​),(2s​)+s(n−s)}, attained by a clique on 2s+12s+12s+1 vertices plus isolated vertices, or by sss vertices joined to everything.

N. Alon and P. Frankl (arXiv:2210.15076, published in J. Combin. Theory Ser. B, 2024, DOI 10.1016/j.jctb.2023.12.002) impose both restrictions at once and determine the maximum for all values of the parameters. Their answer is again the larger of two explicit constructions, and each of the two classical theorems is recovered as a degenerate range of theirs. The question belongs to a line of work on generalized Turán problems with an additional bound on the matching number, which has continued since this paper with other forbidden subgraphs in place of the clique.

Setting

All graphs are finite and simple, on the vertex set {0,1,…,n−1}\{0,1,\dots,n-1\}{0,1,…,n−1}.

  • The clique number of GGG is the largest number of vertices of a complete subgraph. "Clique number at most kkk" means that GGG contains no complete subgraph on k+1k+1k+1 vertices.
  • A matching is a set of pairwise disjoint edges. The matching number ν(G)\nu(G)ν(G) is the largest size of a matching of GGG.
  • A graph is complete kkk-partite if its vertex set is split into kkk classes (some possibly empty) and two vertices are adjacent exactly when they lie in different classes.
  • T(n,k)T(n,k)T(n,k) is the complete kkk-partite graph on nnn vertices whose classes have sizes as equal as possible, and t(n,k)t(n,k)t(n,k) is its number of edges, the Turán number.
  • G(n,k,s)G(n,k,s)G(n,k,s) is the complete kkk-partite graph on nnn vertices with k−1k-1k−1 classes of sizes as equal as possible and total size sss, and one further class of size n−sn-sn−s. Its number of edges is g(n,k,s)g(n,k,s)g(n,k,s).

A graph on nnn vertices is admissible for (k,s)(k,s)(k,s) when its clique number is at most kkk and its matching number is at most sss. Both constructions are admissible when n≥2s+1n\ge 2s+1n≥2s+1: G(n,k,s)G(n,k,s)G(n,k,s) is kkk-colourable, and every edge of it meets the sss vertices of the small classes; the Turán graph T(2s+1,k)T(2s+1,k)T(2s+1,k) on 2s+12s+12s+1 of the vertices, with the other n−2s−1n-2s-1n−2s−1 vertices isolated, has no s+1s+1s+1 disjoint edges.

Formalization targets

Goal: Theorem 1.1

For k≥2k\ge2k≥2 and n≥2s+1n\ge 2s+1n≥2s+1,

max⁡{∣E(G)∣:G on n vertices, ω(G)≤k, ν(G)≤s}  =  max⁡{ t(2s+1,k), g(n,k,s) },\max\bigl\{|E(G)| : G \text{ on } n \text{ vertices},\ \omega(G)\le k,\ \nu(G)\le s\bigr\} \;=\; \max\{\,t(2s+1,k),\ g(n,k,s)\,\},max{∣E(G)∣:G on n vertices, ω(G)≤k, ν(G)≤s}=max{t(2s+1,k), g(n,k,s)},

stated as an upper bound for every admissible graph together with an admissible graph attaining it.

Milestones

The milestones follow the proof of §2 of the paper, in attack order:

  1. the two constructions are admissible (the lower bound);
  2. the barrier: every graph has a vertex set BBB such that every component of G−BG-BG−B is odd and ∣B∣+∑i(∣Ai∣−1)/2=ν(G)|B|+\sum_i(|A_i|-1)/2=\nu(G)∣B∣+∑i​(∣Ai​∣−1)/2=ν(G);
  3. Lemma 2.1: in the §2 choice of an extremal graph and barrier maximizing ∑i∣Ai∣2\sum_i|A_i|^2∑i​∣Ai​∣2, non-adjacent vertices of BBB have the same neighbourhood;
  4. the graph induced on BBB is then complete kkk-partite;
  5. Claim 2.3: for that choice of graph and barrier, without loss of generality every component of G−BG-BG−B has a vertex with no neighbour in the smallest class of BBB;
  6. Lemma 2.2: for an extremal graph maximizing ∑i∣Ai∣2\sum_i |A_i|^2∑i​∣Ai​∣2, at most one component of G−BG-BG−B has more than one vertex;
  7. the case analysis on b=∣B∣b=|B|b=∣B∣ that bounds the remaining structure by max⁡{t(2s+1,k),g(n,k,s)}\max\{t(2s+1,k),g(n,k,s)\}max{t(2s+1,k),g(n,k,s)};
  8. the identity t(s+⌊s/(k−1)⌋,k)+(n−s−⌊s/(k−1)⌋) s=g(n,k,s)t(s+\lfloor s/(k-1)\rfloor,k)+(n-s-\lfloor s/(k-1)\rfloor)\,s=g(n,k,s)t(s+⌊s/(k−1)⌋,k)+(n−s−⌊s/(k−1)⌋)s=g(n,k,s);
  9. the Turán increment t(N+1,k)−t(N,k)=N−⌊N/k⌋t(N+1,k)-t(N,k)=N-\lfloor N/k\rfloort(N+1,k)−t(N,k)=N−⌊N/k⌋ is non-decreasing in NNN, with steps at most 111;
  10. the function f(b)=t(2s−b+1,k)+b(n−2s+b−1)f(b)=t(2s-b+1,k)+b(n-2s+b-1)f(b)=t(2s−b+1,k)+b(n−2s+b−1) has strictly increasing differences on the range of Case 4.

A companion item records the paper's parenthetical remark: for n≤2s+1n\le 2s+1n≤2s+1 the maximum is t(n,k)t(n,k)t(n,k).

Significance

The theorem settles the edge-extremal problem for the two most basic graph parameters, clique number and matching number, jointly and for every admissible parameter value. It contains both classical theorems: when n≤2s+1n\le 2s+1n≤2s+1 the matching condition is void and the answer is Turán's t(n,k)t(n,k)t(n,k); when k≥2s+1k\ge 2s+1k≥2s+1 the clique condition is void and the answer is the Erdős–Gallai bound. The two extremal constructions show that both regimes genuinely occur, and the threshold between them depends on nnn, kkk and sss together. The same paper's Proposition 3.1 extends the answer g(n,k,s)g(n,k,s)g(n,k,s) to every colour-critical forbidden graph for large sss and nnn, and the present theorem is the base case of that programme.

The theorem is proved in the paper; it has not been formalized. Mathlib has Turán's theorem (SimpleGraph.CliqueFree.card_edgeFinset_le), Tutte's theorem on perfect matchings, and extremal-graph infrastructure (SimpleGraph.IsExtremal), but no Tutte–Berge formula, no Gallai–Edmonds decomposition, and no Erdős–Gallai theorem for matchings. A formal proof would add the Tutte–Berge formula in the barrier form used here, a reusable Zykov symmetrization argument, and the first machine-checked proof of the Erdős–Gallai matching bound as a special case.

Difficulty

The arithmetic of the proof (milestones 8–10) is short. The difficulty is concentrated elsewhere.

First, the proof starts from a barrier BBB whose removal leaves only odd components with ∣B∣+∑i(∣Ai∣−1)/2|B|+\sum_i(|A_i|-1)/2∣B∣+∑i​(∣Ai​∣−1)/2 equal to the matching number. This is the Tutte–Berge formula sharpened to a maximal barrier, all of whose components are factor-critical. Mathlib's Tutte theorem covers perfect matchings only, so the deficiency version and the structure of maximal barriers have to be built.

Second, Lemma 2.1, Claim 2.3 and Lemma 2.2 are surgery on an extremal graph. Each modifies the graph (copying a neighbourhood, swapping two classes of BBB in the neighbourhood of a component, merging two components) and must re-verify three things: the number of edges does not decrease, no clique on k+1k+1k+1 vertices appears, and the matching number stays at most sss. The matching bound is re-verified through the barrier, so the components of the modified graph have to be tracked, and the extremality hypothesis has to be used in the right form. In particular, the paper's printed proof of Lemma 2.1 shows only that non-adjacency is transitive on BBB and that non-adjacent vertices of BBB have equal degree; the full "same neighbourhood" conclusion needs a further argument from extremality.

Third, the barrier equation of p. 2 is written with sss, which presumes that an extremal graph has matching number exactly sss; the paper does not prove this, and a solver who wants to chain the milestones needs it.

Formalization scope

Graphs are SimpleGraph (Fin n); edge counts are #G.edgeFinset. Clique number at most kkk is G.CliqueFree (k + 1). The matching number is the supremum, in ℕ, of the edge counts of matching subgraphs (Subgraph.IsMatching); the set is nonempty and bounded, so the supremum is a maximum, and the companion sanity file proves ν(G)≤s\nu(G)\le sν(G)≤s iff every matching has at most sss edges. T(n,k)T(n,k)T(n,k) is Mathlib's turanGraph n k. G(n,k,s)G(n,k,s)G(n,k,s) is an explicit graph on Fin n (vertex v<sv<sv<s in class v mod (k−1)v \bmod (k-1)vmod(k−1), all others in class k−1k-1k−1), and g(n,k,s)g(n,k,s)g(n,k,s) is defined as its edge count, not by a closed formula, so the identity of milestone 8 is a statement about the graph. Extremality is Mathlib's IsExtremal for the admissibility property. The maximality of ∑iai2\sum_i a_i^2∑i​ai2​ in Lemmas 2.1 and 2.2 and Claim 2.3 ranges over all extremal graphs together with all their odd barriers of value sss, because the paper chooses BBB together with GGG.

One hypothesis is added to the paper's statement: k≥2k\ge2k≥2. The paper says "every kkk", but G(n,k,s)G(n,k,s)G(n,k,s) has k−1k-1k−1 classes of total size sss, which is impossible for k=1k=1k=1 and s>0s>0s>0, and no nonempty graph has clique number at most 000. Lemmas 2.1, 2.2 and Claim 2.3 keep the paper's barrier value sss as a hypothesis, while the barrier milestone itself is stated with ν(G)\nu(G)ν(G).

The goal is an upper bound together with an attaining graph; an upper bound alone would be a weaker theorem. The surgery lemmas carry extremality as a hypothesis, never a hypothesis on the edge count that would presuppose the answer.

Contributions welcome beyond this mission: the Tutte–Berge formula and Gallai–Edmonds decomposition for SimpleGraph, the matching number as a reusable definition, and the Erdős–Gallai matching theorem.

Selected references

  • N. Alon and P. Frankl, Turán graphs with bounded matching number, arXiv:2210.15076v1, 2022; J. Combin. Theory Ser. B, 2024. https://arxiv.org/abs/2210.15076, https://doi.org/10.1016/j.jctb.2023.12.002
  • P. Turán, On an extremal problem in graph theory (in Hungarian), Mat. Fiz. Lapok 48 (1941), 436–452.
  • P. Erdős and T. Gallai, On maximal paths and circuits of graphs, Acta Math. Acad. Sci. Hungar. 10 (1959), 337–356. https://doi.org/10.1007/BF02024498
  • L. Lovász and M. D. Plummer, Matching Theory, North-Holland Mathematics Studies 121, 1986. https://doi.org/10.1090/chel/367
  • A. A. Zykov, On some properties of linear complexes, Mat. Sbornik N.S. 24(66) (1949), 163–188.
12 thms1 active userReviewed
AlgebraDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 4: For n ≥ h + 3, the Delsarte Dual of a Maximum h-Scattered Subspace of Dimension rn/(h + 1) Is Maximum (n − h − 2)-ScatteredResearch Paper

Motivation

Scattered subspaces are a central object of finite geometry. An Fq\mathbb F_qFq​-subspace UUU of an Fqn\mathbb F_{q^n}Fqn​-vector space is scattered when every one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace meets it in Fq\mathbb F_qFq​-dimension at most one. They give the largest scattered linear sets of projective spaces, and through them constructions of two-intersection sets, two-weight codes, strongly regular graphs and, most prominently, maximum rank distance (MRD) codes. Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2) generalise the notion to hhh-scattered subspaces, which meet every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace in Fq\mathbb F_qFq​-dimension at most hhh, prove the dimension bound rn/(h+1)rn/(h+1)rn/(h+1), and ask when it is attained.

When h+1h+1h+1 divides rrr, direct sums of known examples reach the bound (Theorem 2.6 of the paper). For other values of rrr the paper introduces a duality, the Delsarte dual, which turns a maximum hhh-scattered subspace of one space into a maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspace of a space of another dimension. The name comes from Delsarte's duality on MRD codes, which the paper shows corresponds to it (Theorem 4.12). This mission is about that duality: Theorem 3.3 of the paper.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, with n=dim⁡FqFqnn=\dim_{\mathbb F_q}\mathbb F_{q^n}n=dimFq​​Fqn​. Write V(r,qn)V(r,q^n)V(r,qn) for an rrr-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space; it is also an Fq\mathbb F_qFq​-space of dimension rnrnrn.

Definition 1.1. For 0<h≤r−10<h\le r-10<h≤r−1, an Fq\mathbb F_qFq​-subspace UUU of V=V(r,qn)V=V(r,q^n)V=V(r,qn) is hhh-scattered if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}}=V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h. It is maximum hhh-scattered if no hhh-scattered subspace of VVV has larger Fq\mathbb F_qFq​-dimension. The paper's Theorem 2.3 shows that an hhh-scattered subspace either has dimension rrr and defines a subgeometry, or has dimension at most rn/(h+1)rn/(h+1)rn/(h+1).

The setting of §3. Let V\mathbb VV be a kkk-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space, written as a direct sum V=Λ⊕Γ\mathbb V=\Lambda\oplus\GammaV=Λ⊕Γ of Fqn\mathbb F_{q^n}Fqn​-subspaces with dim⁡Λ=r\dim\Lambda=rdimΛ=r and dim⁡Γ=k−r\dim\Gamma=k-rdimΓ=k−r. Let WWW be a kkk-dimensional Fq\mathbb F_qFq​-subspace of V\mathbb VV with ⟨W⟩Fqn=V\langle W\rangle_{\mathbb F_{q^n}}=\mathbb V⟨W⟩Fqn​​=V and W∩Γ={0}W\cap\Gamma=\{0\}W∩Γ={0}, and put

U=⟨W,Γ⟩Fq∩Λ,U=\langle W,\Gamma\rangle_{\mathbb F_q}\cap\Lambda ,U=⟨W,Γ⟩Fq​​∩Λ,

an Fq\mathbb F_qFq​-subspace of Λ\LambdaΛ. Every kkk-dimensional Fq\mathbb F_qFq​-subspace of Λ\LambdaΛ with k>rk>rk>r arises in this way (Lunardon and Polverino, cited as [21, Theorems 1, 2] in the paper). Let β:V×V→Fqn\beta:\mathbb V\times\mathbb V\to\mathbb F_{q^n}β:V×V→Fqn​ be a non-degenerate reflexive sesquilinear form with companion automorphism σ\sigmaσ (linear in the first argument, β(v,aw)=aσβ(v,w)\beta(v,aw)=a^\sigma\beta(v,w)β(v,aw)=aσβ(v,w)) which takes values in Fq\mathbb F_qFq​ on W×WW\times WW×W; equivalently, β\betaβ extends a non-degenerate reflexive form β′:W×W→Fq\beta':W\times W\to\mathbb F_qβ′:W×W→Fq​. Write Γ⊥={v:β(v,g)=0 ∀g∈Γ}\Gamma^\perp=\{v:\beta(v,g)=0\ \forall g\in\Gamma\}Γ⊥={v:β(v,g)=0 ∀g∈Γ}, an rrr-dimensional subspace. The Delsarte dual of UUU (Definition 3.2) is the Fq\mathbb F_qFq​-subspace

Uˉ=W+Γ⊥={w+Γ⊥:w∈W}⊆V/Γ⊥,\bar U=W+\Gamma^\perp=\{w+\Gamma^\perp:w\in W\}\subseteq\mathbb V/\Gamma^\perp ,Uˉ=W+Γ⊥={w+Γ⊥:w∈W}⊆V/Γ⊥,

a subspace of a (k−r)(k-r)(k−r)-dimensional Fqn\mathbb F_{q^n}Fqn​-space.

Formalization targets

Goal: Theorem 3.3

Suppose UUU is a maximum hhh-scattered Fq\mathbb F_qFq​-subspace of Λ=V(r,qn)\Lambda=V(r,q^n)Λ=V(r,qn) of dimension k=rn/(h+1)k=rn/(h+1)k=rn/(h+1), and n≥h+3n\ge h+3n≥h+3. Then

Uˉ is a maximum (n−h−2)-scattered Fq-subspace of V/Γ⊥=V ⁣(rnh+1−r, qn),dim⁡FqUˉ=k.\bar U \text{ is a maximum } (n-h-2)\text{-scattered } \mathbb F_q\text{-subspace of } \mathbb V/\Gamma^\perp=V\!\left(\tfrac{rn}{h+1}-r,\ q^n\right),\qquad \dim_{\mathbb F_q}\bar U=k .Uˉ is a maximum (n−h−2)-scattered Fq​-subspace of V/Γ⊥=V(h+1rn​−r, qn),dimFq​​Uˉ=k.

The statement holds for every admissible choice of the embedding and of β\betaβ.

Milestones

  1. Theorem 2.7 (p. 8): a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) meets every hyperplane HHH in dimension between rn/(h+1)−nrn/(h+1)-nrn/(h+1)−n and rn/(h+1)−n+hrn/(h+1)-n+hrn/(h+1)−n+h.
  2. The identity (S∗)⊥=(S⊥′)∗(S^*)^\perp=(S^{\perp'})^*(S∗)⊥=(S⊥′)∗ (p. 9) for Fq\mathbb F_qFq​-subspaces SSS of WWW, where S∗=⟨S⟩FqnS^*=\langle S\rangle_{\mathbb F_{q^n}}S∗=⟨S⟩Fqn​​ and ⊥′\perp'⊥′ is orthogonality for β′\beta'β′.
  3. Proposition 3.1 (p. 9): if k>rk>rk>r and every hyperplane MMM of Λ\LambdaΛ satisfies dim⁡Fq(M∩U)<k−1\dim_{\mathbb F_q}(M\cap U)<k-1dimFq​​(M∩U)<k−1 (condition (⋄)(\diamond)(⋄)), then dim⁡FqUˉ=k\dim_{\mathbb F_q}\bar U=kdimFq​​Uˉ=k.
  4. Theorem 2.3 (p. 4): the dimension bound rn/(h+1)rn/(h+1)rn/(h+1) for hhh-scattered subspaces.

Significance

The result. Theorem 3.3 converts a maximum hhh-scattered subspace of V(r,qn)V(r,q^n)V(r,qn) of dimension rn/(h+1)rn/(h+1)rn/(h+1) into a maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspace of V(rn/(h+1)−r,qn)V(rn/(h+1)-r,q^n)V(rn/(h+1)−r,qn). For h=r−1h=r-1h=r−1 it was known through MRD codes; the paper proves it for every hhh. Its consequences in the paper are Corollaries 3.4 and 3.5 and Theorem 3.6: when n≥4n\ge4n≥4 is even and r≥3r\ge3r≥3 is odd, maximum (n−3)(n-3)(n−3)-scattered subspaces of V(r(n−2)/2,qn)V(r(n-2)/2,q^n)V(r(n−2)/2,qn) exist which the direct sum construction of Theorem 2.6 cannot produce, because n−2n-2n−2 does not divide r(n−2)/2r(n-2)/2r(n−2)/2. Theorem 3.3 is also the geometric counterpart of Delsarte duality of MRD codes (Theorem 4.12 of the paper).

Formalizing it. The theorem is proved in the paper; no machine-checked version exists. A formalization would provide a reusable treatment of sesquilinear forms whose restriction to an Fq\mathbb F_qFq​-form is controlled, of orthogonal complements across the field extension Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​, and of the passage between Λ\LambdaΛ, V/Γ\mathbb V/\GammaV/Γ and V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥. Theorems 2.3 and 2.7 are also the goals of companion missions in this series; here they enter as milestones.

Difficulty

The definition of Uˉ\bar UUˉ is easy; the content is in two dimension statements. First, W+Γ⊥W+\Gamma^\perpW+Γ⊥ must not collapse: W∩Γ⊥={0}W\cap\Gamma^\perp=\{0\}W∩Γ⊥={0} is not automatic and depends on the hyperplane condition (⋄)(\diamond)(⋄) on UUU, which in turn needs the upper bound of Theorem 2.7, whose proof in the paper is a long counting argument with Gaussian binomials (Section 5). Second, the scattered property must be transported through the duality: a large intersection of Uˉ\bar UUˉ with an (n−h−2)(n-h-2)(n−h−2)-dimensional subspace of V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥ must be converted into a large intersection of UUU with a hyperplane of Λ\LambdaΛ. This conversion runs through three different spaces and two different orthogonalities, ⊥\perp⊥ over Fqn\mathbb F_{q^n}Fqn​ and ⊥′\perp'⊥′ over Fq\mathbb F_qFq​, and the identification (S∗)⊥=(S⊥′)∗(S^*)^\perp=(S^{\perp'})^*(S∗)⊥=(S⊥′)∗ between them requires that WWW have an Fq\mathbb F_qFq​-basis which is an Fqn\mathbb F_{q^n}Fqn​-basis of V\mathbb VV. Maximality is a further step that uses the bound of Theorem 2.3 in V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥.

Formalization scope

Fq\mathbb F_qFq​ and Fqn\mathbb F_{q^n}Fqn​ are finite fields F, K with Algebra F K; V\mathbb VV is a finite-dimensional K-module with a compatible F-structure (IsScalarTower F K 𝕍). The setting of §3 is a structure DelsarteSetting F K 𝕍 holding Λ,Γ\Lambda,\GammaΛ,Γ (complementary), WWW (with dim⁡FqW=dim⁡FqnV\dim_{\mathbb F_q}W=\dim_{\mathbb F_{q^n}}\mathbb VdimFq​​W=dimFqn​​V, spanning, W∩Γ=0W\cap\Gamma=0W∩Γ=0), σ:Fqn≃Fqn\sigma:\mathbb F_{q^n}\simeq\mathbb F_{q^n}σ:Fqn​≃Fqn​ and β:V→FqnV→σFqn\beta:\mathbb V\to_{\mathbb F_{q^n}}\mathbb V\to_{\sigma}\mathbb F_{q^n}β:V→Fqn​​V→σ​Fqn​ with non-degeneracy, reflexivity and β(W,W)⊆Fq\beta(W,W)\subseteq\mathbb F_qβ(W,W)⊆Fq​. The embedding of Λ\LambdaΛ into V\mathbb VV is data, not a theorem; its existence is cited by the paper and is not an item. The paper's β′\beta'β′ is the restriction of β\betaβ to WWW.

Conventions pinned:

  • UUU is an F-subspace of the type ↥Λ, and "h-scattered in Λ\LambdaΛ" is Definition 1.1 with ambient space Λ\LambdaΛ, including 0<h<r0<h<r0<h<r and ⟨U⟩Fqn=Λ\langle U\rangle_{\mathbb F_{q^n}}=\Lambda⟨U⟩Fqn​​=Λ. The dual is (n − h − 2)-scattered in the quotient 𝕍 ⧸ Γ^⊥, whose dimension is k−rk-rk−r.
  • Every rn/(h+1)rn/(h+1)rn/(h+1) is multiplied out: (h+1)dim⁡U=rn(h+1)\dim U=rn(h+1)dimU=rn. Hyperplanes are subspaces with dim⁡+1=dim⁡\dim+1=\dimdim+1=dim of the ambient space; dim⁡<k−1\dim<k-1dim<k−1 is written dim⁡+1<k\dim+1<kdim+1<k. The only natural-number subtraction is the index n−h−2n-h-2n−h−2, exact because n≥h+3n\ge h+3n≥h+3.
  • The paper's k>rk>rk>r is a hypothesis of Proposition 3.1, as on the page, and is derived (not assumed) in Theorem 3.3.

The form must be non-degenerate and Fq\mathbb F_qFq​-valued on WWW: with β=0\beta=0β=0 one would get Γ⊥=V\Gamma^\perp=\mathbb VΓ⊥=V and a zero quotient, and without β(W,W)⊆Fq\beta(W,W)\subseteq\mathbb F_qβ(W,W)⊆Fq​ the subspace W+Γ⊥W+\Gamma^\perpW+Γ⊥ is not the paper's Delsarte dual; both conditions are fields of the setting and may not be dropped.

Cited inputs: none of the milestones is proved elsewhere; Theorems 2.3 and 2.7 duplicate the goals of companion missions 1 and 3 and may be closed by importing their proofs once published. Contributions welcome: the sesquilinear-form infrastructure (dimension of orthogonal complements, the extension of β′\beta'β′ from WWW to V\mathbb VV), Proposition 3.1, and the transport argument of Theorem 3.3.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, arXiv:1906.10590v2, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/1906.10590v2
  • G. Lunardon, O. Polverino, Translation ovoids of orthogonal polar spaces, Forum Math. 16 (2004), 663–669 (the embedding used in §3).
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243 (the case h = 1 of the bound).
  • P. Delsarte, Bilinear forms over a finite field, with applications to coding theory, J. Combin. Theory Ser. A 25 (1978), 226–241 (Delsarte duality of rank-metric codes).
8 thms1 active userReviewed
AlgebraComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy 1: Folded Symmetric PCSPs Avoiding Parity, Majority and Alternating-Threshold Have Only C-Fixing PolymorphismsResearch Paper

Why promise constraint satisfaction

A constraint satisfaction problem (CSP) asks whether variables can be assigned values so that every constraint, drawn from a fixed finite set of relations, holds. The algebraic approach to CSPs explains their complexity through polymorphisms, the operations that preserve all constraint relations; this programme culminated in the CSP dichotomy theorem of Bulatov and Zhuk (2017). A promise CSP (PCSP) pairs each relation PPP with a weaker relation Q⊇PQ \supseteq PQ⊇P: given an instance that is promised to be satisfiable with the PPP-constraints, one must distinguish it from instances that are not even satisfiable with the QQQ-constraints. Approximate graph colouring (is a 3-colourable graph 100-colourable?) and (2+ε)(2+\varepsilon)(2+ε)-SAT are PCSPs, and their complexity is not captured by the classical theory.

Brakensiek and Guruswami (arXiv:1704.01937) developed the polymorphism theory of PCSPs and classified the Boolean, symmetric, folded case.

Timeline.

  • 1978: Schaefer classifies Boolean CSPs into polynomial-time and NP-complete.
  • 2014: Austrin, Guruswami and Håstad prove (2+ε)(2+\varepsilon)(2+ε)-SAT NP-hard with an argument based on polymorphisms (SIAM J. Comput. 46(5), 2017).
  • 2016–2018: Brakensiek and Guruswami introduce the general PCSP framework and prove a dichotomy for folded symmetric Boolean PCSPs (SODA 2018; arXiv:1704.01937v2, 2021; SIAM J. Comput. 50(6), 2021).
  • 2019–2021: Barto, Bulín, Krokhin and Opršal recast the theory in terms of minions (J. ACM 68(4), 2021). Ficak, Kozik, Olšák and Stankiewicz extend the Boolean symmetric dichotomy beyond the folded case (ICALP 2019).

Setting

Fix the Boolean domain {0,1}\{0,1\}{0,1}. A promise relation of arity kkk is a pair (P,Q)(P, Q)(P,Q) with P⊆Q⊆{0,1}kP \subseteq Q \subseteq \{0,1\}^kP⊆Q⊆{0,1}k, and a family Γ\GammaΓ is a finite set of promise relations, possibly of different arities. A function f:{0,1}L→{0,1}f : \{0,1\}^L \to \{0,1\}f:{0,1}L→{0,1} is a polymorphism of (P,Q)(P,Q)(P,Q) if, whenever x(1),…,x(L)∈Px^{(1)}, \dots, x^{(L)} \in Px(1),…,x(L)∈P, applying fff coordinate-wise gives a tuple in QQQ; Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) is the set of functions that are polymorphisms of every member of Γ\GammaΓ.

A relation is symmetric if it is closed under permuting coordinates. Every symmetric relation has the form Hamk(S)={x:∣x∣∈S}\mathrm{Ham}_k(S) = \{x : |x| \in S\}Hamk​(S)={x:∣x∣∈S}, where ∣x∣|x|∣x∣ is the Hamming weight. A function is folded if f(xˉ)=¬f(x)f(\bar x) = \neg f(x)f(xˉ)=¬f(x), and idempotent if f(0,…,0)=0f(0,\dots,0) = 0f(0,…,0)=0 and f(1,…,1)=1f(1,\dots,1) = 1f(1,…,1)=1; a family is folded (idempotent) if all its polymorphisms are. For odd LLL the paper singles out three function families:

ParL(x)=⨁i=1Lxi,MajL(x)=[∑ixi>L2],ATL(x)=[∑i=1L(−1)i−1xi>0],\mathrm{Par}_L(x) = \bigoplus_{i=1}^L x_i, \qquad \mathrm{Maj}_L(x) = \Big[\sum_{i} x_i > \tfrac L2\Big], \qquad \mathrm{AT}_L(x) = \Big[\sum_{i=1}^L (-1)^{i-1} x_i > 0\Big],ParL​(x)=i=1⨁L​xi​,MajL​(x)=[i∑​xi​>2L​],ATL​(x)=[i=1∑L​(−1)i−1xi​>0],

and their negations Par‾L,Maj‾L,AT‾L\overline{\mathrm{Par}}_L, \overline{\mathrm{Maj}}_L, \overline{\mathrm{AT}}_LParL​,Maj​L​,ATL​. Finally, fff is CCC-fixing if some set SSS of at most CCC coordinates satisfies f(x)=f(0,…,0)f(x) = f(0,\dots,0)f(x)=f(0,…,0) whenever xxx vanishes on SSS.

Formalization targets

Goal: Theorem 4.13

Let Γ\GammaΓ be a finite, folded, symmetric family. If there are odd L1,…,L6L_1, \dots, L_6L1​,…,L6​ with

ParL1, ATL2, MajL3, Par‾L4, AT‾L5, Maj‾L6∉Pol(Γ),\mathrm{Par}_{L_1},\ \mathrm{AT}_{L_2},\ \mathrm{Maj}_{L_3},\ \overline{\mathrm{Par}}_{L_4},\ \overline{\mathrm{AT}}_{L_5},\ \overline{\mathrm{Maj}}_{L_6} \notin \mathrm{Pol}(\Gamma),ParL1​​, ATL2​​, MajL3​​, ParL4​​, ATL5​​, Maj​L6​​∈/Pol(Γ),

then

∃ C(Γ)  ∀L  ∀f∈Pol(Γ)∩{0,1}{0,1}L: f is C(Γ)-fixing.\exists\, C(\Gamma)\ \ \forall L\ \ \forall f \in \mathrm{Pol}(\Gamma) \cap \{0,1\}^{\{0,1\}^L}:\ f \text{ is } C(\Gamma)\text{-fixing}.∃C(Γ)  ∀L  ∀f∈Pol(Γ)∩{0,1}{0,1}L: f is C(Γ)-fixing.

No value of CCC is fixed: the goal asserts only that one bound works for all arities.

Milestones

The milestones follow the paper's proof:

  • the tools of §2: Propositions 2.10, 2.12 and 2.15 and Lemma 2.13(1), which split polymorphisms into idempotent and negated idempotent ones;
  • the arity-reduction Claims 4.2, 4.3 and 4.4;
  • the closure computations Claim 4.6 (AT\mathrm{AT}AT) and Claim 4.8 (Maj\mathrm{Maj}Maj);
  • the relaxation Lemmas 4.5 and 4.7, which replace Γ\GammaΓ by a single canonical symmetric promise relation;
  • the additive-combinatorics Lemma 4.9 and its bounded Remark;
  • Lemma 4.10 and Corollary 4.11, which bound the coordinates iii with f(ei)=1f(e_i) = 1f(ei​)=1;
  • Lemma 4.12, the idempotent case of the goal.

Significance

Theorem 4.13 is the structural half of the paper's main dichotomy (Theorem 2.16): a folded symmetric Boolean PCSP is polynomial-time solvable if it has one of the six families as polymorphisms for every odd arity, and NP-hard otherwise. Hardness follows by feeding the CCC-fixing structure into a Label Cover reduction (Theorem 5.3). Bounded "fixing" or junta-like structure of all polymorphisms is the standard route from algebra to NP-hardness for PCSPs. This theorem is the cleanest Boolean instance of it, and it underlies later classifications of symmetric Boolean PCSPs.

The result has been proved and published since 2018. To our knowledge none of it has been formalized. A formalization supplies a checked Boolean polymorphism toolkit (Hamming-weight relations, folding, idempotence, relaxations), checked closure computations under alternating-threshold and majority operations, and a uniform-constant Frobenius-type lemma. All of these can be reused by other Boolean PCSP missions.

Difficulty

The obvious argument fixes a polymorphism fff and bounds its relevant coordinates directly from a constraint that Par\mathrm{Par}Par, AT\mathrm{AT}AT or Maj\mathrm{Maj}Maj violates. This gives a bound that depends on the arity LLL, and an LLL-dependent bound is trivial (C=LC = LC=L always works). The work is in making the constant uniform. The proof has to replace Γ\GammaΓ by a single canonical promise relation that does not depend on fff, classify exactly which symmetric relations exclude ATL\mathrm{AT}_LATL​ and MajL\mathrm{Maj}_LMajL​, and use an additive-combinatorics lemma whose constants depend only on that relation's arity. Its bounded version must hold with the same constants. The non-idempotent polymorphisms need a separate reduction through the negated family ¬Γ\neg\Gamma¬Γ.

Formalization scope

The domain {0,1}\{0,1\}{0,1} is Bool (false =0= 0=0). A family Γ\GammaΓ is a pair of relational structures 𝔸 𝔹 : RelStruct τ ar Bool from the published definition PCSPBLPAff_Symmetric_Setting, with [Fintype τ] (finitely many relations) and 𝔸.rel R ⊆ 𝔹.rel R (promise). IsPolymorphism 𝔸 𝔹 f from that file is Definition 2.4. Coordinates are Fin L, so the 1-based sign (−1)i−1(-1)^{i-1}(−1)i−1 of ATL\mathrm{AT}_LATL​ becomes (−1)i(-1)^{i}(−1)i. Anti-functions negate the output. Family properties (folded, idempotent, non-degenerate) quantify over polymorphisms of every arity L≥0L \ge 0L≥0. A folded or idempotent family has no nullary polymorphisms, so admitting L=0L = 0L=0 changes nothing. The constants C(Γ)C(\Gamma)C(Γ), c(Γ)c(\Gamma)c(Γ), A(n)A(n)A(n) and d(n)d(n)d(n) are quantified before the arity and the function (respectively before S0,S1S_0, S_1S0​,S1​). A statement that lets the constant depend on fff or LLL is trivially true and is not the goal.

Out of scope are the complexity conclusions: "PCSP(Γ\GammaΓ) is NP-hard" (Theorems 2.16 and 5.3) and item 2 of Lemma 2.13 (transfer of tractability). The cited inputs for those conclusions are also out of scope: the PCP theorem with parallel repetition (Proposition 5.2) and Schaefer's theorem. No complexity predicate appears in any statement.

A complete development needs the following, with Mathlib's Nat.frobeniusNumber as a starting point for Lemma 4.9:

  • explicit matrix constructions for Claims 4.6 and 4.8;
  • closure of polymorphisms under projections (minors), used in Lemma 4.10 and Corollary 4.11;
  • a Frobenius-coin argument with constants uniform in the sets S0,S1S_0, S_1S0​,S1​.

Contributions are welcome at any milestone, including separate proofs of the closure computations and of Lemma 4.9.

Selected references

  • J. Brakensiek, V. Guruswami, Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy, arXiv:1704.01937v2, 2021; SIAM J. Comput. 50(6), 2021. https://arxiv.org/abs/1704.01937
  • P. Austrin, V. Guruswami, J. Håstad, (2+ε)-SAT is NP-hard, SIAM J. Comput. 46(5), 2017. https://doi.org/10.1137/15M1006507
  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, J. ACM 68(4), 2021. https://doi.org/10.1145/3457606
  • M. Ficak, M. Kozik, M. Olšák, S. Stankiewicz, Dichotomy for symmetric Boolean PCSPs, ICALP 2019. https://doi.org/10.4230/LIPIcs.ICALP.2019.57
  • T. J. Schaefer, The complexity of satisfiability problems, STOC 1978. https://doi.org/10.1145/800133.804350
19 thms1 active userReviewed
AlgebraDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 2: If h + 1 Divides r and n ≥ h + 1, Maximum h-Scattered 𝔽_q-Subspaces of V(r, qⁿ) of Dimension rn/(h + 1) ExistResearch Paper

Motivation

A scattered subspace is an Fq\mathbb F_qFq​-subspace UUU of an Fqn\mathbb F_{q^n}Fqn​-vector space VVV that meets every one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace of VVV in an Fq\mathbb F_qFq​-subspace of dimension at most one. Scattered subspaces produce scattered linear sets in projective spaces over finite fields, and through them two-intersection sets, two-weight codes, translation caps and maximum rank distance (MRD) codes. Blokhuis and Lavrauw (Geom. Dedicata 2000) proved that a scattered subspace of V(r,qn)V(r,q^n)V(r,qn) has dimension at most rn/2rn/2rn/2, and constructions of that dimension are known whenever rnrnrn is even (see Bartoli, Giulietti, Marino, Polverino 2018 and the references there).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2, Combinatorica 41, 2021) replace "one-dimensional" by "hhh-dimensional". The resulting hhh-scattered subspaces interpolate between scattered subspaces (h=1h=1h=1) and subspaces meeting every hyperplane in small dimension (h=r−1h=r-1h=r−1), which Sheekey and Van de Voorde (Des. Codes Cryptogr. 2020) showed to be equivalent to MRD codes with an idealiser isomorphic to Fqn\mathbb F_{q^n}Fqn​. For the new notion the paper proves an upper bound on the dimension (Theorem 2.3) and shows that the bound is attained when h+1h+1h+1 divides rrr (Theorem 2.6). This mission is the attainment half.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, so n=[Fqn:Fq]n=[\mathbb F_{q^n}:\mathbb F_q]n=[Fqn​:Fq​], and let V=V(r,qn)V=V(r,q^n)V=V(r,qn) be an rrr-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space with r≥1r\ge1r≥1. Every Fqn\mathbb F_{q^n}Fqn​-space is also an Fq\mathbb F_qFq​-space of dimension rnrnrn. For an integer hhh with 0<h≤r−10<h\le r-10<h≤r−1, an Fq\mathbb F_qFq​-subspace U≤VU\le VU≤V is hhh-scattered (Definition 1.1) if

  1. UUU spans VVV over Fqn\mathbb F_{q^n}Fqn​, ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}}=V⟨U⟩Fqn​​=V, and
  2. dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h for every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV.

An hhh-scattered subspace of largest possible Fq\mathbb F_qFq​-dimension is maximum hhh-scattered. Theorem 2.3 of the paper says that an hhh-scattered UUU either has dimension rrr and defines a subgeometry (an Fq\mathbb F_qFq​-basis of UUU is an Fqn\mathbb F_{q^n}Fqn​-basis of VVV), or satisfies

dim⁡FqU≤rnh+1.(1)\dim_{\mathbb F_q}U\le\frac{rn}{h+1}.\tag{1}dimFq​​U≤h+1rn​.(1)

Two building blocks appear in the statements. If V=V1⊕⋯⊕VtV=V_1\oplus\dots\oplus V_tV=V1​⊕⋯⊕Vt​ with Vi=V(ri,qn)V_i=V(r_i,q^n)Vi​=V(ri​,qn) and Ui≤ViU_i\le V_iUi​≤Vi​ are Fq\mathbb F_qFq​-subspaces, then U=U1⊕⋯⊕UtU=U_1\oplus\dots\oplus U_tU=U1​⊕⋯⊕Ut​ is the direct sum of the UiU_iUi​. For r≤nr\le nr≤n the Gabidulin-type subspace of Fqn r\mathbb F_{q^n}^{\,r}Fqnr​ is

Gr={(x,xq,xq2,…,xqr−1):x∈Fqn},G_r=\{(x,x^{q},x^{q^2},\dots,x^{q^{r-1}}) : x\in\mathbb F_{q^n}\},Gr​={(x,xq,xq2,…,xqr−1):x∈Fqn​},

the image of an Fq\mathbb F_qFq​-linear map, since x↦xqjx\mapsto x^{q^j}x↦xqj fixes Fq\mathbb F_qFq​.

Formalization targets

Goal: Theorem 2.6 (p. 7)

If h≥1h\ge1h≥1, h+1h+1h+1 divides rrr and n≥h+1n\ge h+1n≥h+1, then V(r,qn)V(r,q^n)V(r,qn) contains an Fq\mathbb F_qFq​-subspace UUU that is maximum hhh-scattered and satisfies

dim⁡FqU=rnh+1.\dim_{\mathbb F_q}U=\frac{rn}{h+1}.dimFq​​U=h+1rn​.

Milestones, in the order the paper uses them

  • Proposition 2.1 (p. 3): for h>1h>1h>1, every hhh-scattered subspace is iii-scattered for all 0<i<h0<i<h0<i<h.
  • Theorem 2.3 (p. 4): the dichotomy above, subgeometry or bound (1).
  • Theorem 2.4 (p. 6): if UiU_iUi​ is hih_ihi​-scattered in ViV_iVi​, then U1⊕⋯⊕UtU_1\oplus\dots\oplus U_tU1​⊕⋯⊕Ut​ is min⁡ihi\min_i h_imini​hi​-scattered in V1⊕⋯⊕VtV_1\oplus\dots\oplus V_tV1​⊕⋯⊕Vt​.
  • Theorem 2.4, second sentence (p. 6): if every UiU_iUi​ is hhh-scattered with dim⁡FqUi=rin/(h+1)\dim_{\mathbb F_q}U_i=r_in/(h+1)dimFq​​Ui​=ri​n/(h+1), then the direct sum is hhh-scattered of dimension rn/(h+1)rn/(h+1)rn/(h+1).
  • Example 2.5 (p. 7): for 2≤r≤n2\le r\le n2≤r≤n, GrG_rGr​ is maximum (r−1)(r-1)(r−1)-scattered of dimension nnn.

Significance

Together with Theorem 2.3, the goal settles the largest dimension of an hhh-scattered subspace of V(r,qn)V(r,q^n)V(r,qn) whenever h+1∣rh+1\mid rh+1∣r and n≥h+1n\ge h+1n≥h+1: it is exactly rn/(h+1)rn/(h+1)rn/(h+1). The subspaces it produces are the input of the paper's Delsarte duality (Theorem 3.3), which turns maximum hhh-scattered subspaces of V(r,qn)V(r,q^n)V(r,qn) reaching bound (1) into maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspaces of V(rn/(h+1)−r,qn)V(rn/(h+1)-r,q^n)V(rn/(h+1)−r,qn) and so gives constructions also when h+1∤rh+1\nmid rh+1∤r. The direct-sum theorem is also of independent use: it extends the direct-sum construction for scattered linear sets of Bartoli, Giulietti, Marino and Polverino to every hhh, and Example 2.5 gives the subspace counterpart of Gabidulin codes.

All results in this mission are proved in the paper. To our knowledge none of them has a machine-checked proof; no formal library contains scattered subspaces, linear sets or Gabidulin-type subspaces. The remaining work is formalizing the paper's arguments: the counting of roots of linearized polynomials behind Example 2.5, the Grassmann-formula and quotient-space argument of Theorem 2.4, and the bound (1) of Theorem 2.3, which the companion mission on the dimension bound states as its goal.

Difficulty

The construction itself is short; the work lies in the three ingredients. The obvious approach to Theorem 2.4 fails: an hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace WWW of V1⊕V2V_1\oplus V_2V1​⊕V2​ need not be the sum of its intersections with V1V_1V1​ and V2V_2V2​, so the intersection W∩UW\cap UW∩U cannot be bounded summand by summand. Example 2.5 needs that a nonzero qqq-polynomial ∑j<rajxqj\sum_{j<r}a_jx^{q^j}∑j<r​aj​xqj has at most qr−1q^{r-1}qr−1 roots in Fqn\mathbb F_{q^n}Fqn​, and the root set is an Fq\mathbb F_qFq​-subspace. Maximality is not a property of a single subspace: it quantifies over every hhh-scattered subspace of VVV and so needs the full upper bound of Theorem 2.3, including the case n<h+1n<h+1n<h+1 handled there by Proposition 2.1.

Formalization scope

Fq\mathbb F_qFq​ is a finite field F, Fqn\mathbb F_{q^n}Fqn​ a finite field K with Algebra F K, so q=q=q= Fintype.card F and n=n=n= Module.finrank F K. VVV is a finite-dimensional K-module with a compatible F-module structure (IsScalarTower F K V), and r=r=r= Module.finrank K V. An Fq\mathbb F_qFq​-subspace is a Submodule F V; its intersection with an Fqn\mathbb F_{q^n}Fqn​-subspace S is S.restrictScalars F ⊓ U.

Conventions the statements commit to:

  • The range 0<h<r0<h<r0<h<r and the spanning condition are part of IsHScattered; without the range every spanning subspace would be hhh-scattered for h≥rh\ge rh≥r.
  • Every quotient rn/(h+1)rn/(h+1)rn/(h+1) is multiplied out, as (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U=rn(h+1)dimFq​​U=rn or ≤rn\le rn≤rn; no natural-number division is used.
  • The direct sum in Theorem 2.4 is external: V=∏i<tViV=\prod_{i<t}V_iV=∏i<t​Vi​ ((i : Fin t) → V i) and U=U=U= Submodule.pi Set.univ U. The minimum h=min⁡ihih=\min_i h_ih=mini​hi​ is given by h≤hih\le h_ih≤hi​ for all iii and h=hih=h_ih=hi​ for some iii. The second part of Theorem 2.4 assumes t≥1t\ge1t≥1.
  • Example 2.5 is stated on Fin r → K, with GrG_rGr​ the range of the F-linear map x↦(xqj)j<rx\mapsto(x^{q^j})_{j<r}x↦(xqj)j<r​, and assumes r≥2r\ge2r≥2 so that (r−1)(r-1)(r−1)-scattered is within Definition 1.1's range.
  • The goal assumes r≥1r\ge1r≥1: h+1h+1h+1 divides 000, but the zero space has no hhh-scattered subspace. The upper end h<rh<rh<r follows from h+1∣rh+1\mid rh+1∣r.
  • "Defines a subgeometry" in Theorem 2.3 is: some subset of UUU spans UUU over Fq\mathbb F_qFq​ and is an Fqn\mathbb F_{q^n}Fqn​-basis of VVV.

The goal is not satisfied by a small subspace: both the dimension equality (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U=rn(h+1)dimFq​​U=rn and maximality among all hhh-scattered subspaces of VVV are part of its conclusion.

Results the paper cites without a number (the Blokhuis–Lavrauw bound for h=1h=1h=1, the direct-sum theorem for scattered linear sets) are not items. Theorem 2.3 is restated here because the maximality in Theorem 2.6 rests on it; it duplicates the goal of the companion mission. Useful infrastructure beyond this mission: roots of linearized polynomials over finite fields, dimension formulas for subspaces under restriction of scalars, and direct sums of hhh-scattered subspaces. Contributions on any milestone are welcome, and the goal can be closed from the milestones alone.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, arXiv:1906.10590v2, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/1906.10590, https://doi.org/10.1007/s00493-020-4347-y
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • D. Bartoli, M. Giulietti, G. Marino, O. Polverino, Maximum scattered linear sets and complete caps in Galois spaces, Combinatorica 38 (2018), 255–278. https://doi.org/10.1007/s00493-016-3531-6
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets, and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://doi.org/10.1007/s10623-019-00703-z
10 thms1 active userReviewed
AlgebraDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 3: A Maximum h-Scattered Subspace of Dimension rn/(h + 1) Meets Every Hyperplane in Dimension Between rn/(h + 1) − n and rn/(h + 1) − n + hResearch Paper

Motivation

Scattered subspaces are a central object of finite geometry. An Fq\mathbb F_qFq​-subspace UUU of an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​ defines an Fq\mathbb F_qFq​-linear set of the projective space PG(r−1,qn)\mathrm{PG}(r-1,q^n)PG(r−1,qn), and when UUU is scattered this linear set has the largest possible number of points for its rank. Maximum scattered subspaces give rise to maximum rank distance (MRD) codes, to translation caps, and to two-intersection sets and the associated two-weight codes and strongly regular graphs (Polverino 2010; Sheekey–Van de Voorde 2020).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2, Combinatorica 41, 2021) generalised the notion to hhh-scattered subspaces, which meet every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace in dimension at most hhh, and proved that such a subspace has dimension at most rn/(h+1)rn/(h+1)rn/(h+1) unless it defines a subgeometry. This mission concerns the extremal case: subspaces attaining rn/(h+1)rn/(h+1)rn/(h+1), and the way they meet hyperplanes.

Timeline.

  • 2000: Blokhuis and Lavrauw (Geom. Dedicata 81, Theorem 4.2) prove the case h=1h=1h=1: a scattered subspace of dimension rn/2rn/2rn/2 meets each hyperplane in dimension rn/2−nrn/2-nrn/2−n or rn/2−n+1rn/2-n+1rn/2−n+1, and they count the hyperplanes of each kind.
  • 2020: Csajbók, Marino, Polverino and Zullo prove the general statement (Theorem 2.7) by a double count and qqq-series identities, and use it to build maximum hhh-scattered subspaces by Delsarte duality.
  • Later work by Zini and Zullo (Scattered subspaces and related codes, reference [29] of the paper) determines the number of hyperplanes of each intersection dimension for every hhh; the case h=2h=2h=2 is in Napolitano–Zullo.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, n=[Fqn:Fq]n = [\mathbb F_{q^n}:\mathbb F_q]n=[Fqn​:Fq​], and let V=V(r,qn)V = V(r,q^n)V=V(r,qn) be an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​, viewed also as an rnrnrn-dimensional vector space over Fq\mathbb F_qFq​. A hyperplane of VVV is an (r−1)(r-1)(r−1)-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace.

Fix an integer hhh with 0<h≤r−10<h\le r-10<h≤r−1. An Fq\mathbb F_qFq​-subspace UUU of VVV is hhh-scattered if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h. It is maximum hhh-scattered if no hhh-scattered subspace of VVV has larger Fq\mathbb F_qFq​-dimension.

Put s=h+1s=h+1s=h+1 and suppose s∣rns\mid rns∣rn. For an Fq\mathbb F_qFq​-subspace UUU of dimension rn/srn/srn/s, let hih_ihi​ be the number of hyperplanes WWW with dim⁡Fq(W∩U)=i\dim_{\mathbb F_q}(W\cap U)=idimFq​​(W∩U)=i. The proof works with the Gaussian binomial coefficients [nk]q\left[{n\atop k}\right]_q[kn​]q​, the qqq-Pochhammer symbols (a;q)k=(1−a)(1−aq)⋯(1−aqk−1)(a;q)_k=(1-a)(1-aq)\cdots(1-aq^{k-1})(a;q)k​=(1−a)(1−aq)⋯(1−aqk−1), the elementary symmetric values σk,l\sigma_{k,l}σk,l​ of 1,q,…,qk1,q,\dots,q^k1,q,…,qk, and the sums

αk=∑ihi(qn−1)qki,βk=∑ihi(qn−1)∏j=0k−1(qi−qj),\alpha_k=\sum_i h_i(q^n-1)q^{ki},\qquad \beta_k=\sum_i h_i(q^n-1)\prod_{j=0}^{k-1}(q^i-q^j),αk​=i∑​hi​(qn−1)qki,βk​=i∑​hi​(qn−1)j=0∏k−1​(qi−qj), A=∑ihi(qn−1)∏l=0s−1(qi−q n(r−s)/s+l).A=\sum_i h_i(q^n-1)\prod_{l=0}^{s-1}\bigl(q^i-q^{\,n(r-s)/s+l}\bigr).A=i∑​hi​(qn−1)l=0∏s−1​(qi−qn(r−s)/s+l).

Formalization targets

Goal: Theorem 2.7

If UUU is a maximum hhh-scattered Fq\mathbb F_qFq​-subspace of V(r,qn)V(r,q^n)V(r,qn) of dimension rn/(h+1)rn/(h+1)rn/(h+1), then for every hyperplane WWW of VVV

rnh+1−n  ≤  dim⁡Fq(U∩W)  ≤  rnh+1−n+h.\frac{rn}{h+1}-n\;\le\;\dim_{\mathbb F_q}(U\cap W)\;\le\;\frac{rn}{h+1}-n+h.h+1rn​−n≤dimFq​​(U∩W)≤h+1rn​−n+h.

Milestones, in the order of the proof (§5, pp. 20–24)

  1. hi=0h_i=0hi​=0 for i<rn/s−ni<rn/s-ni<rn/s−n (the lower bound), and (23): ∑ihi(qn−1)=qrn−1\sum_i h_i(q^n-1)=q^{rn}-1∑i​hi​(qn−1)=qrn−1.
  2. Lemma 5.7: for 0≤k≤s−10\le k\le s-10≤k≤s−1,
∑ihi(qn−1)∏j=0k(qi−qj)=∏j=0k(qrn/s−qj) (q(r−k−1)n−1).\sum_i h_i(q^n-1)\prod_{j=0}^{k}(q^i-q^j)=\prod_{j=0}^{k}(q^{rn/s}-q^j)\,(q^{(r-k-1)n}-1).i∑​hi​(qn−1)j=0∏k​(qi−qj)=j=0∏k​(qrn/s−qj)(q(r−k−1)n−1).
  1. The qqq-series tools: Lemma 5.5 (σk,l=ql(l−1)/2[k+1l]q\sigma_{k,l}=q^{l(l-1)/2}\left[{k+1\atop l}\right]_qσk,l​=ql(l−1)/2[lk+1​]q​), Carlitz's inversion (Theorem 5.6), the qqq-binomial theorem (Theorem 5.2) and its specialisation (Corollary 5.3).
  2. (24): αk=∑j≤k[kj]qβj\alpha_k=\sum_{j\le k}\left[{k\atop j}\right]_q\beta_jαk​=∑j≤k​[jk​]q​βj​. Identity (25), which expresses AAA through α0,…,αs\alpha_0,\dots,\alpha_sα0​,…,αs​, is included as a supporting item rather than a milestone.
  3. Propositions 5.8 and 5.9: two triple sums asa_sas​, bsb_sbs​ both equal qnr(−1)s(q−n;q)sq^{nr}(-1)^s(q^{-n};q)_sqnr(−1)s(q−n;q)s​.
  4. A=0A=0A=0, which forces hi=0h_i=0hi​=0 for i>n(r−s)/s+s−1i>n(r-s)/s+s-1i>n(r−s)/s+s−1.

Significance

The result. Theorem 2.7 says that a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) has only h+1h+1h+1 possible intersection dimensions with hyperplanes. Its linear set therefore meets hyperplanes in few sizes, which links these subspaces to sets of few intersection numbers and to codes with few weights. Inside the paper, the upper bound is the input to §3: it shows that the Delsarte dual of a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) is maximum (n−h−2)(n-h-2)(n−h−2)-scattered (Theorem 3.3). That theorem in turn gives maximum hhh-scattered subspaces when h+1h+1h+1 does not divide rrr.

Formalizing it. The theorem is proved in the paper, but no machine-checked version exists. Beyond the geometry, the mission produces a library of finite qqq-series facts: Gaussian binomials as rational functions of qqq, the qqq-binomial theorem in both forms, Carlitz's inversion formula, and the elementary symmetric evaluation σk,l\sigma_{k,l}σk,l​. Some of these are proved on the platform in a different Mathlib environment, but they are not available in this one. Counting statements about subspaces over finite fields (hyperplanes through a subspace, ordered independent tuples) are also needed and are reusable.

Difficulty

The lower bound is a dimension count. The upper bound is not: the obvious approach bounds dim⁡(U∩W)\dim(U\cap W)dim(U∩W) from the scattered property alone, but the hhh-scattered condition controls intersections with hhh-dimensional subspaces, and hyperplanes have dimension r−1r-1r−1, which is far larger. No pointwise argument is known; the paper determines the distribution (hi)(h_i)(hi​) only through its first s+1s+1s+1 moments, given by a double count, and then shows that a specific nonnegative combination of the hih_ihi​ vanishes. The moment identities hold only for k≤s−1k\le s-1k≤s−1 (Lemma 5.7 needs each k+1≤h+1k+1\le h+1k+1≤h+1 independent vectors of UUU to stay independent over Fqn\mathbb F_{q^n}Fqn​), and closing the argument requires exact evaluation of a triple qqq-series with signed Gaussian binomials and quadratic exponents.

Formalization scope

  • Fq\mathbb F_qFq​ is a finite field F, Fqn\mathbb F_{q^n}Fqn​ a finite field K with [Algebra F K], and VVV a finite-dimensional K-module with a compatible F-module structure (IsScalarTower F K V). We take r=r=r= finrank K V, n=n=n= finrank F K and q=q=q= Fintype.card F.
  • The range 0<h<r0<h<r0<h<r and the spanning condition are part of IsHScattered.
  • "Dimension rn/(h+1)rn/(h+1)rn/(h+1)" is the equation (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U = rn(h+1)dimFq​​U=rn. Both bounds of Theorem 2.7 are stated with nnn moved to the other side: dim⁡U≤dim⁡(U∩W)+n≤dim⁡U+h\dim U\le\dim(U\cap W)+n\le\dim U+hdimU≤dim(U∩W)+n≤dimU+h. A version written with natural-number subtraction would make the lower bound vacuous whenever rn/(h+1)<nrn/(h+1)<nrn/(h+1)<n, and dropping the dimension hypothesis would make the upper bound false. Both trivialisations are ruled out.
  • Gaussian binomials are defined by the product formula (15) for real qqq and vanish for k>nk>nk>n. The qqq-identities are stated for real q>1q>1q>1, which covers every prime power. Carlitz's formula is stated for complex sequences.
  • Every fraction in an exponent is an exact quotient: rn/srn/srn/s is passed as mmm with sm=nrsm=nrsm=nr, and halves l(l−1)/2l(l-1)/2l(l−1)/2 are binomial coefficients (l2)\binom l2(2l​). Possibly negative exponents use integer powers.
  • The milestones of §5 carry the full hhh-scattered hypothesis, spanning included. The printed setting of §5.2 omits spanning, but Lemma 5.7 uses Proposition 2.1, which needs it.
  • Cited inputs stated as milestones: Lemma 5.5 ([6]), Theorem 5.2 ([15]) and Theorem 5.6 ([7]). Identity (18) is used inside proofs and is not an item.

Proofs of any milestone, of standard counting facts for subspaces of finite vector spaces, and of the qqq-series lemmas are welcome.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, Combinatorica 41 (2021). arXiv:1906.10590v2. https://arxiv.org/abs/1906.10590v2
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. 310 (2010), 3096–3107. https://doi.org/10.1016/j.disc.2009.04.007
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets, and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://doi.org/10.1007/s10623-019-00703-z
  • G. Gasper, M. Rahman, Basic Hypergeometric Series, 2nd ed., Cambridge University Press, 2004. https://doi.org/10.1017/CBO9780511526251
  • L. Carlitz, Some inverse relations, Duke Math. J. 40 (1973), 893–901. https://doi.org/10.1215/S0012-7094-73-04083-0
  • V. Napolitano, F. Zullo, Codes with few weights arising from linear sets, arXiv:2002.07241. https://arxiv.org/abs/2002.07241
  • P. J. Cameron, Notes on Counting: An Introduction to Enumerative Combinatorics, Cambridge University Press, 2017. https://doi.org/10.1017/9781108277457
18 thms1 active userReviewed
AlgebraComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy 4: F = Pol(Γ) for a Finite Γ iff F Is Projection-Closed, Finitizable and Contains the IdentityResearch Paper

Motivation

A constraint satisfaction problem (CSP) asks whether variables ranging over a finite domain DDD can be assigned values so that every constraint from a fixed finite list of relations is satisfied. A central organizing principle of the algebraic theory of CSPs is that the complexity of CSP(Γ)\mathrm{CSP}(\Gamma)CSP(Γ) is governed by its polymorphisms, the functions f:DL→Df : D^L \to Df:DL→D that preserve every relation of Γ\GammaΓ when applied coordinate-wise. For this principle to be usable, one needs to know which sets of functions arise as polymorphism sets. For ordinary relations this goes back to the Galois theory of clones and relations. Pippenger (Galois theory for minors of finite functions, Discrete Mathematics, 2002) characterized the families of functions that are the polymorphism sets of pairs of relations, allowing infinitely many pairs.

Promise constraint satisfaction problems (PCSPs) relax CSPs: every constraint comes as a pair P⊆QP \subseteq QP⊆Q, and the task is to distinguish instances satisfiable with the strong relations PPP from those unsatisfiable even with the weak relations QQQ. Approximate graph colouring and (2+ε)(2+\varepsilon)(2+ε)-SAT are PCSPs. Brakensiek and Guruswami (arXiv:1704.01937v2, SIAM J. Comput. 2021) develop an algebraic theory of PCSPs based on polymorphisms. In §6.2 they prove a finite version of Pippenger's characterization: the families of the form Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) for a finite family Γ\GammaΓ of promise relations are exactly the families satisfying three explicit conditions. This mission formalizes that theorem and its CSP analogue (§6.3).

Setting

Fix a finite set DDD. A family of functions F\mathcal FF over DDD consists, for every arity L≥1L \ge 1L≥1, of a set of functions DL→DD^L \to DDL→D.

A promise relation of arity kkk is a pair (P,Q)(P, Q)(P,Q) of subsets of DkD^kDk with P⊆QP \subseteq QP⊆Q. A finite family Γ={(Pi,Qi)}\Gamma = \{(P_i, Q_i)\}Γ={(Pi​,Qi​)} of promise relations is indexed by a finite set of relation symbols, each with its own arity kik_iki​. A function f:DL→Df : D^L \to Df:DL→D is a polymorphism of Γ\GammaΓ if for every iii and all x(1),…,x(L)∈Pix^{(1)}, \dots, x^{(L)} \in P_ix(1),…,x(L)∈Pi​, applying fff coordinate by coordinate gives a tuple in QiQ_iQi​:

(f(x1(1),…,x1(L)),…,f(xki(1),…,xki(L)))∈Qi.\bigl(f(x^{(1)}_1, \dots, x^{(L)}_1), \dots, f(x^{(1)}_{k_i}, \dots, x^{(L)}_{k_i})\bigr) \in Q_i.(f(x1(1)​,…,x1(L)​),…,f(xki​(1)​,…,xki​(L)​))∈Qi​.

Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) is the family of all polymorphisms of Γ\GammaΓ.

For f:DL→Df : D^L \to Df:DL→D and a map π:[L]→[R]\pi : [L] \to [R]π:[L]→[R], the projection (or minor) fπ:DR→Df^\pi : D^R \to Dfπ:DR→D is

fπ(y)=f(yπ(1),…,yπ(L)).f^\pi(y) = f(y_{\pi(1)}, \dots, y_{\pi(L)}).fπ(y)=f(yπ(1)​,…,yπ(L)​).

A family F\mathcal FF is projection-closed if fπ∈Ff^\pi \in \mathcal Ffπ∈F whenever f∈Ff \in \mathcal Ff∈F has arity LLL and π:[L]→[R]\pi : [L] \to [R]π:[L]→[R]. It is finitizable if there is a finitized arity RRR such that for every arity LLL and every f:DL→Df : D^L \to Df:DL→D,

f∈F  ⟺  fπ∈F for all π:[L]→[R].f \in \mathcal F \iff f^\pi \in \mathcal F \text{ for all } \pi : [L] \to [R].f∈F⟺fπ∈F for all π:[L]→[R].

Finally idD:D→D\mathrm{id}_D : D \to DidD​:D→D is the identity, a function of arity 111.

Formalization targets

Goal: Theorem 6.5

∃ Γ finite with F=Pol(Γ)  ⟺  F is projection-closed and finitizable, and idD∈F.\exists\, \Gamma \text{ finite with } \mathcal F = \mathrm{Pol}(\Gamma) \iff \mathcal F \text{ is projection-closed and finitizable, and } \mathrm{id}_D \in \mathcal F.∃Γ finite with F=Pol(Γ)⟺F is projection-closed and finitizable, and idD​∈F.

The finite family is existential together with its signature and arities; nothing about its shape is fixed in the statement.

Milestones

  • Lemma 6.7. If F\mathcal FF is projection-closed, finitizable and contains idD\mathrm{id}_DidD​, then F=Pol(Γ)\mathcal F = \mathrm{Pol}(\Gamma)F=Pol(Γ) for some finite Γ\GammaΓ.

Further items for the other direction

  • Claim 6.6. For every finite family Γ\GammaΓ of promise relations, Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) is projection-closed and finitizable.
  • §6.2, p. 29. Since P⊆QP \subseteq QP⊆Q for every (P,Q)∈Γ(P, Q) \in \Gamma(P,Q)∈Γ, idD∈Pol(Γ)\mathrm{id}_D \in \mathrm{Pol}(\Gamma)idD​∈Pol(Γ).

Further item: Lemma 6.8

A CSP is a finite family with P=QP = QP=Q for every pair. With F\mathcal FF a clone (for f∈Ff \in \mathcal Ff∈F of arity L1L_1L1​ and g1,…,gL1∈Fg_1, \dots, g_{L_1} \in \mathcal Fg1​,…,gL1​​∈F of arity L2L_2L2​, the function h(x(1),…,x(L1))=f(g1(x(1)),…,gL1(x(L1)))h(x^{(1)}, \dots, x^{(L_1)}) = f(g_1(x^{(1)}), \dots, g_{L_1}(x^{(L_1)}))h(x(1),…,x(L1​))=f(g1​(x(1)),…,gL1​​(x(L1​))) of arity L1L2L_1L_2L1​L2​ is in F\mathcal FF):

∃ Λ CSP with F=Pol(Λ)  ⟺  F is finitizable, a clone, and idD∈F.\exists\, \Lambda \text{ CSP with } \mathcal F = \mathrm{Pol}(\Lambda) \iff \mathcal F \text{ is finitizable, a clone, and } \mathrm{id}_D \in \mathcal F.∃Λ CSP with F=Pol(Λ)⟺F is finitizable, a clone, and idD​∈F.

Significance

Theorem 6.5 identifies the polymorphism families of finite promise templates intrinsically, without reference to relations. Together with the Galois correspondence of §6.1 (if Pol(Γ)⊆Pol(Γ′)\mathrm{Pol}(\Gamma) \subseteq \mathrm{Pol}(\Gamma')Pol(Γ)⊆Pol(Γ′) then Γ′\Gamma'Γ′ is definable from Γ\GammaΓ, so PCSP(Γ′)\mathrm{PCSP}(\Gamma')PCSP(Γ′) reduces to PCSP(Γ)\mathrm{PCSP}(\Gamma)PCSP(Γ)), it justifies studying PCSPs entirely through families of functions closed under minors, the viewpoint later systematized by the theory of minions (Barto, Bulín, Krokhin, Opršal, arXiv:1811.00970). Lemma 6.8 recovers, in the same language, the description of polymorphism clones of finite CSP templates as the finitely related clones.

The results are proved in the paper; to our knowledge none of them has a machine-checked proof. The mission produces a Lean formalization of both directions, built on the published definitions of relational structures and polymorphisms already used by other PCSP missions on the platform, and reusable definitions of projections (minors), projection-closed and finitizable families, and clones.

Difficulty

The arguments are elementary, and the difficulty lies in uniformity and finiteness. For Claim 6.6, a single arity RRR must detect every failure of the polymorphism condition for functions of every arity LLL, so RRR has to be bounded independently of LLL; an argument that handles each arity separately does not give finitizability. For Lemma 6.7, a finite family of promise relations has to be produced from F\mathcal FF alone. The general Galois connection between functions and relations produces infinitely many relations (one for each arity and each witness of non-membership), and the content of the lemma is that the three conditions allow a finite family instead. In both directions the encoding matters: functions of arity RRR must be compared with tuples of a relation, and coordinates, projections and the identity must be matched exactly, with no degenerate arity left over.

Formalization scope

A family of functions is FunFamily D := (L : ℕ) → Set ((Fin L → D) → D), with DDD a finite type with decidable equality. Coordinates are 0-based (Fin L), and fπf^\pifπ is fun y => f (y ∘ π) with π : Fin L → Fin R. A finite family of promise relations is a finite type τ of symbols with arities ar : τ → ℕ and two structures 𝔸 𝔹 : RelStruct τ ar D with 𝔸.rel R ⊆ 𝔹.rel R; polymorphisms are the published IsPolymorphism (definition PCSPBLPAff_Symmetric_Setting), and a CSP uses one structure on both sides.

All function arities are positive. The paper's "L,R∈NL, R \in \mathbb NL,R∈N" is read as positive integers: "F=Pol(Γ)\mathcal F = \mathrm{Pol}(\Gamma)F=Pol(Γ)" is compared at every arity L≥1L \ge 1L≥1, projection-closure and finitizability quantify over L,R≥1L, R \ge 1L,R≥1, and the finitized arity is at least 111. Including arity 000 would make the necessity direction false as stated (with every PiP_iPi​ empty the paper's finitized arity is 000).

The clone condition of Lemma 6.8 is the paper's displayed one (p. 30): g1,…,gL1g_1, \dots, g_{L_1}g1​,…,gL1​​ act on disjoint blocks of inputs, and the composed function has arity L1L2L_1 L_2L1​L2​.

A trivializing formalization is ruled out by the statement's shape: the finite family, its signature and its arities are all existentially quantified (fixing a single relation would turn the necessity direction into a special case), P⊆QP \subseteq QP⊆Q is part of every family (without it idD∈Pol(Γ)\mathrm{id}_D \in \mathrm{Pol}(\Gamma)idD​∈Pol(Γ) fails), and finitizability is an equivalence for every function, members and non-members alike.

The development needs only finite types and functions; no complexity theory is involved. Proofs of the milestones, and reusable lemmas about projections (composition of projections, projections along injective maps), are welcome.

Selected references

  • J. Brakensiek, V. Guruswami, Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy, SIAM J. Comput. 50(6), 2021; arXiv:1704.01937v2. https://arxiv.org/abs/1704.01937
  • N. Pippenger, Galois theory for minors of finite functions, Discrete Mathematics 254 (1–3), 2002 (cited as [48] in the paper).
  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, J. ACM 68(4), 2021; arXiv:1811.00970. https://arxiv.org/abs/1811.00970
4 thms1 active userReviewed
AlgebraComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy 3: Pol(Γ) ⊆ Pol(Γ′) Implies Γ′ Is ppp-Definable from ΓResearch Paper

Motivation

A constraint satisfaction problem (CSP) asks for an assignment of values from a finite domain DDD to variables so that every constraint, a tuple of variables required to lie in a fixed relation, is satisfied. The algebraic theory of CSPs rests on a Galois correspondence: the complexity of CSP(Γ)\mathrm{CSP}(\Gamma)CSP(Γ) is determined by the set Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) of its polymorphisms, because Pol(Γ)⊆Pol(Γ′)\mathrm{Pol}(\Gamma) \subseteq \mathrm{Pol}(\Gamma')Pol(Γ)⊆Pol(Γ′) holds exactly when every relation of Γ′\Gamma'Γ′ is definable from Γ\GammaΓ by a primitive positive formula (Geiger 1968; Bodnarčuk, Kalužnin, Kotov and Romov 1969), and such definitions translate into reductions (Jeavons 1998). This correspondence underlies the CSP dichotomy theorem.

Promise CSPs (PCSPs) relax a CSP by a promise: every constraint comes as a pair (P,Q)(P, Q)(P,Q) with P⊆QP \subseteq QP⊆Q, and the task is to tell instances satisfiable with the PPP-relations from instances not even satisfiable with the QQQ-relations. Approximate graph colouring and (2+ε)(2+\varepsilon)(2+ε)-SAT are examples. Brakensiek and Guruswami (arXiv:1704.01937v2, §6.1) showed that the Galois correspondence survives this generalisation, with pp-definitions replaced by positive primitive promise definitions (ppp-definitions). This is the starting point of the algebraic approach to PCSPs later systematised by Barto, Bulín, Krokhin and Opršal (arXiv:1811.00970). Pippenger (2002) had earlier proved a variant of the correspondence for pairs of relations, not in this complexity-theoretic form.

Setting

Fix a finite domain DDD. A relation of arity kkk is a set P⊆DkP \subseteq D^kP⊆Dk, and a promise relation is a pair (P,Q)(P, Q)(P,Q) of relations of arity kkk with P⊆QP \subseteq QP⊆Q. A family Γ={(PR,QR):R∈τ}\Gamma = \{(P_R, Q_R) : R \in \tau\}Γ={(PR​,QR​):R∈τ} is indexed by a set τ\tauτ of symbols with arities kRk_RkR​. In Lean it is a pair of relational structures 𝔸 𝔹 : RelStruct τ ar D, with PRP_RPR​ = 𝔸.rel R, QRQ_RQR​ = 𝔹.rel R and PR⊆QRP_R \subseteq Q_RPR​⊆QR​ (IsPromiseFamily).

A function f:DL→Df : D^L \to Df:DL→D is a polymorphism of Γ\GammaΓ if for every RRR and all x(1),…,x(L)∈PRx^{(1)}, \dots, x^{(L)} \in P_Rx(1),…,x(L)∈PR​ the tuple obtained by applying fff coordinate-wise, (f(x1(1),…,x1(L)),…,f(xkR(1),…,xkR(L)))\big(f(x^{(1)}_1, \dots, x^{(L)}_1), \dots, f(x^{(1)}_{k_R}, \dots, x^{(L)}_{k_R})\big)(f(x1(1)​,…,x1(L)​),…,f(xkR​(1)​,…,xkR​(L)​)), lies in QRQ_RQR​. Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) is the set of polymorphisms of all arities L≥0L \ge 0L≥0.

A Γ\GammaΓ-PCSP Ψ\PsiΨ is a finite list of clauses, each a symbol RRR applied to a tuple of variables, with repetition allowed. It is read twice: as ΨP\Psi_PΨP​, with each clause asking its tuple to lie in PRP_RPR​, and as ΨQ\Psi_QΨQ​, with QRQ_RQR​ in place of PRP_RPR​. Let EQUAL={(i,i):i∈D}\mathrm{EQUAL} = \{(i, i) : i \in D\}EQUAL={(i,i):i∈D}.

Definition (ppp-definability). A promise relation (P′,Q′)⊆Dk×Dk(P', Q') \subseteq D^k \times D^k(P′,Q′)⊆Dk×Dk is ppp-definable from a finite family Γ\GammaΓ if there are ℓ≥0\ell \ge 0ℓ≥0 and a Γ∪{EQUAL}\Gamma \cup \{\mathrm{EQUAL}\}Γ∪{EQUAL}-PCSP Ψ\PsiΨ on k+ℓk + \ellk+ℓ variables such that

  1. every x∈P′x \in P'x∈P′ extends by some y∈Dℓy \in D^\elly∈Dℓ to an assignment (x,y)(x, y)(x,y) satisfying ΨP\Psi_PΨP​;
  2. every assignment zzz satisfying ΨQ\Psi_QΨQ​ has (z1,…,zk)∈Q′(z_1, \dots, z_k) \in Q'(z1​,…,zk​)∈Q′.

A family Γ′\Gamma'Γ′ is ppp-definable from Γ\GammaΓ if each of its promise relations is.

Formalization targets

Goal: Theorem 6.1, algebraic core

For a finite family Γ\GammaΓ and a family Γ′\Gamma'Γ′ over the same finite domain,

Pol(Γ)⊆Pol(Γ′)  ⟹  every (P′,Q′)∈Γ′ is ppp-definable from Γ.\mathrm{Pol}(\Gamma) \subseteq \mathrm{Pol}(\Gamma') \;\Longrightarrow\; \text{every } (P', Q') \in \Gamma' \text{ is ppp-definable from } \Gamma.Pol(Γ)⊆Pol(Γ′)⟹every (P′,Q′)∈Γ′ is ppp-definable from Γ.

The printed Theorem 6.1 concludes a polynomial-time reduction from PCSP(Γ′)\mathrm{PCSP}(\Gamma')PCSP(Γ′) to PCSP(Γ)\mathrm{PCSP}(\Gamma)PCSP(Γ). Its proof opens by reducing to the displayed statement, and the reduction follows from it by substituting gadgets.

Milestones

  1. Sandwich remark (p. 27). If P′⊆P⊆Q⊆Q′P' \subseteq P \subseteq Q \subseteq Q'P′⊆P⊆Q⊆Q′ (same arity), then (P′,Q′)(P', Q')(P′,Q′) is ppp-definable from {(P,Q)}\{(P, Q)\}{(P,Q)}.
  2. Transitivity (p. 27). If Γ′\Gamma'Γ′ is ppp-definable from Γ\GammaΓ and (P′′,Q′′)(P'', Q'')(P′′,Q′′) from Γ′\Gamma'Γ′, then (P′′,Q′′)(P'', Q'')(P′′,Q′′) is ppp-definable from Γ\GammaΓ.
  3. Proposition 6.3 (p. 28). For L≥1L \ge 1L≥1, the promise relation (SL,TL)(S_L, T_L)(SL​,TL​) is ppp-definable from Γ\GammaΓ, where SL={f:DL→D:f∈Pol(P,P) ∀(P,Q)∈Γ}S_L = \{f : D^L \to D : f \in \mathrm{Pol}(P, P)\ \forall (P,Q) \in \Gamma\}SL​={f:DL→D:f∈Pol(P,P) ∀(P,Q)∈Γ}, TL={f:f∈Pol(P,Q) ∀(P,Q)∈Γ}T_L = \{f : f \in \mathrm{Pol}(P, Q)\ \forall (P,Q) \in \Gamma\}TL​={f:f∈Pol(P,Q) ∀(P,Q)∈Γ}, and each fff is read as the vector of its ∣D∣L|D|^L∣D∣L values.
  4. (Sm′,Tm′)(S'_m, T'_m)(Sm′​,Tm′​) from (Sm,Tm)(S_m, T_m)(Sm​,Tm​) (p. 28). For y1,…,yk∈Dmy^1, \dots, y^k \in D^my1,…,yk∈Dm, the projections Sm′={(f(y1),…,f(yk)):f∈Sm}S'_m = \{(f(y^1), \dots, f(y^k)) : f \in S_m\}Sm′​={(f(y1),…,f(yk)):f∈Sm​} and Tm′T'_mTm′​ (likewise) are ppp-definable from {(Sm,Tm)}\{(S_m, T_m)\}{(Sm​,Tm​)}.
  5. The chain (p. 28). If Pol(Γ)⊆Pol(Γ′)\mathrm{Pol}(\Gamma) \subseteq \mathrm{Pol}(\Gamma')Pol(Γ)⊆Pol(Γ′), (P′,Q′)∈Γ′(P', Q') \in \Gamma'(P′,Q′)∈Γ′, m=∣P′∣m = |P'|m=∣P′∣, x1,…,xmx^1, \dots, x^mx1,…,xm enumerate P′P'P′ and yji=xijy^i_j = x^j_iyji​=xij​, then P′⊆Sm′⊆Tm′⊆Q′P' \subseteq S'_m \subseteq T'_m \subseteq Q'P′⊆Sm′​⊆Tm′​⊆Q′.

Significance

The result. Theorem 6.1 shows that the complexity of PCSP(Γ)\mathrm{PCSP}(\Gamma)PCSP(Γ) depends only on Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ): two finite families with the same polymorphisms have polynomial-time equivalent PCSPs. Hardness can then be read off from the absence of structured polymorphisms, and tractability from their presence. The paper's Boolean symmetric dichotomy (its Theorem 2.16) is organised in exactly this way, and the theorem justifies studying families of polymorphisms instead of families of relations. Section 6.2 of the paper, which characterises the sets of functions of the form Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ), is its companion.

Formalizing it. The result and its proof are published, and no machine-checked version is known to exist. This mission produces a reusable definition of ppp-definability for promise families over arbitrary finite domains, built on the published relational-structure vocabulary PCSPBLPAff_Symmetric_Setting. It also produces the closure properties (weakening, transitivity) any later work on gadget reductions between PCSPs will need, and the encoding of the polymorphism relation (SL,TL)(S_L, T_L)(SL​,TL​) as a gadget. The complexity-theoretic conclusion, a polynomial-time reduction, is not part of the mission.

Difficulty

The printed proofs are short, but each hides a construction. Transitivity requires substituting a gadget for every clause of an intermediate PCSP: the auxiliary variables of all gadgets are renamed apart, and EQUAL clauses are carried through unchanged. Proposition 6.3 requires one clause for every symbol RRR and every LLL-tuple of elements of PRP_RPR​, indexed by the finite set of such tuples and laid out on the ∣D∣L|D|^L∣D∣L coordinates of fff. The goal must handle P′=∅P' = \emptysetP′=∅ (so m=0m = 0m=0, nullary functions, and D0D^0D0 with one point), where Proposition 6.3 as printed (L≥1L \ge 1L≥1) does not apply. A tempting shortcut is to read the hypothesis Pol(Γ)⊆Pol(Γ′)\mathrm{Pol}(\Gamma) \subseteq \mathrm{Pol}(\Gamma')Pol(Γ)⊆Pol(Γ′) only for arities L≥1L \ge 1L≥1. With that reading the theorem is false: for Γ={(D,D)}\Gamma = \{(D, D)\}Γ={(D,D)} and Γ′={(∅,∅)}\Gamma' = \{(\emptyset, \emptyset)\}Γ′={(∅,∅)}, both unary, every function of positive arity is a polymorphism of both families, yet constant assignments satisfy every ΨQ\Psi_QΨQ​, so (∅,∅)(\emptyset, \emptyset)(∅,∅) is not ppp-definable.

Formalization scope

  • Domain and families. DDD is a finite type with decidable equality, and Γ\GammaΓ is 𝔸 𝔹 : RelStruct τ ar D with [Fintype τ] and IsPromiseFamily 𝔸 𝔹. Γ′\Gamma'Γ′ is a promise family over any signature τ', possibly infinite; the conclusion is stated relation by relation.
  • Polymorphisms. IsPolymorphism from the published setting file. PolSubset quantifies over every arity L : ℕ, including L=0L = 0L=0. This convention makes the goal true, and no hypothesis P′≠∅P' \neq \emptysetP′=∅ is added.
  • PCSPs with EQUAL. A Γ∪{EQUAL}\Gamma \cup \{\mathrm{EQUAL}\}Γ∪{EQUAL}-PCSP is an Instance over the signature τ ⊕ Unit, whose new symbol has arity 2 and is EQUAL in both readings. The same clause list is read in withEqual 𝔸 (as ΨP\Psi_PΨP​) and in withEqual 𝔹 (as ΨQ\Psi_QΨQ​). PPPDefinable requires Ψ.n = k + ℓ. The first kkk variables are Fin.castAdd ℓ, and (x,y)(x, y)(x,y) is Fin.append x y. The two clauses of the definition keep the paper's quantifiers: existence of an extension on the PPP side, and every satisfying assignment on the QQQ side. A formalization with two independent instances, or with both readings in PPP, would trivialise the notion and is excluded.
  • Functions as tuples. A set of functions DL→DD^L \to DDL→D becomes a relation of arity Fintype.card (Fin L → D) through any bijection e. The statements hold for every such ordering.
  • Out of scope. The polynomial-time (and log-space) reduction of the printed Theorem 6.1, its constant-factor blow-up, and all complexity classes. No PolyTime predicate or placeholder is introduced.
  • Welcome contributions. Proofs of the milestones. Reflexivity of ppp-definability, which is not stated here. The L=0L = 0L=0 case of Proposition 6.3. The converse direction of the correspondence (ppp-definability implies polymorphism inclusion). Reconciliation with the pp-definability of Barto–Bulín–Krokhin–Opršal (their Definition 2.24), where the two relations are defined by one pp-formula read in two structures.

Selected references

  • J. Brakensiek, V. Guruswami, Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy, SIAM J. Comput. 50(6), 2021; cited here from arXiv:1704.01937v2. https://arxiv.org/abs/1704.01937
  • P. Jeavons, On the algebraic structure of combinatorial problems, Theoretical Computer Science 200, 1998. https://doi.org/10.1016/S0304-3975(97)00230-2
  • D. Geiger, Closed systems of functions and predicates, Pacific J. Math. 27(1), 1968. https://doi.org/10.2140/pjm.1968.27.95
  • N. Pippenger, Galois theory for minors of finite functions, Discrete Mathematics 254, 2002. https://doi.org/10.1016/S0012-365X(01)00297-7
  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, J. ACM 68(4), 2021. https://arxiv.org/abs/1811.00970
8 thms1 active userReviewed
Graph TheoryLinear OptimizationOptimal Transport·Captain: mikedeng1

Computational Optimal Transport IV: The Support Graph of an Extreme Point of the Transportation Polytope U(a, b) Has No Cycle, Hence at Most n + m − 1 Nonzero EntriesTextbook

Motivation

Discrete optimal transport between two histograms is a linear program. Its feasible set, the transportation polytope, has been studied since Hitchcock (1941) and Kantorovich, and the structure of its vertices underlies the classical algorithms for the problem: the north-west corner rule produces a vertex, and the network simplex moves from vertex to vertex. A linear program with a nonempty bounded feasible set attains its minimum at a vertex, so knowing what vertices look like tells us what optimal transport plans can be assumed to look like.

This mission is the fourth of a series formalizing G. Peyré and M. Cuturi, Computational Optimal Transport (Foundations and Trends in Machine Learning, 2019). It covers §3.4.1 of the book, Tree Structure of the Support of All Vertices of U(a, b) (pp. 405–407), whose single numbered result, Proposition 3.4, states that the support of a vertex is a forest. The book credits the result to Brualdi, Combinatorial Matrix Classes (2006, Theorem 8.1.2).

Setting

Fix integers n,mn, mn,m and histograms a∈Σna \in \Sigma_na∈Σn​, b∈Σmb \in \Sigma_mb∈Σm​. The transportation polytope is

U(a,b)={P∈R+n×m:P1m=a, P⊤1n=b},U(a,b) = \{ P \in \mathbb R_+^{n\times m} : P\mathbb 1_m = a,\ P^\top\mathbb 1_n = b \},U(a,b)={P∈R+n×m​:P1m​=a, P⊤1n​=b},

the set of nonnegative n×mn\times mn×m matrices whose row sums are a1,…,ana_1,\dots,a_na1​,…,an​ and whose column sums are b1,…,bmb_1,\dots,b_mb1​,…,bm​. Histograms are nonnegative and sum to one; U(a,b)U(a,b)U(a,b) is the set of couplings between them. The cost of a plan PPP for a cost matrix CCC is ⟨C,P⟩=∑i,jCijPij\langle C, P\rangle = \sum_{i,j} C_{ij}P_{ij}⟨C,P⟩=∑i,j​Cij​Pij​.

A point xxx of a set SSS is an extremal point (vertex) of SSS if, whenever y,z∈Sy, z \in Sy,z∈S and x=(y+z)/2x = (y+z)/2x=(y+z)/2, necessarily x=y=zx = y = zx=y=z.

Take nnn source nodes V={1,…,n}V = \{1,\dots,n\}V={1,…,n} and mmm target nodes V′={1′,…,m′}V' = \{1',\dots,m'\}V′={1′,…,m′}. The complete bipartite graph between them has the nmnmnm edges (i,j′)(i, j')(i,j′). For a matrix PPP, the support S(P)S(P)S(P) is the set of edges (i,j′)(i,j')(i,j′) with Pij>0P_{ij} > 0Pij​>0, and the support graph is G(P)=(V∪V′,S(P))G(P) = (V\cup V', S(P))G(P)=(V∪V′,S(P)). A transport plan is a flow on the complete bipartite graph, with aia_iai​ leaving node iii and bjb_jbj​ entering node j′j'j′; G(P)G(P)G(P) records the edges the flow actually uses.

Formalization targets

Goal: Proposition 3.4 (p. 406)

If PPP is an extremal point of U(a,b)U(a,b)U(a,b), then

G(P) has no cyclesand#{(i,j):Pij≠0}≤n+m−1.G(P) \text{ has no cycles}\qquad\text{and}\qquad \#\{(i,j) : P_{ij}\ne 0\} \le n + m - 1 .G(P) has no cyclesand#{(i,j):Pij​=0}≤n+m−1.

Milestones (proof of Proposition 3.4, p. 407)

  1. If G(P)G(P)G(P) has a cycle, there is a nonzero matrix EEE with E1m=0E\mathbb 1_m = 0E1m​=0, E⊤1n=0E^\top\mathbb 1_n = 0E⊤1n​=0, and Eij≠0⇒Pij>0E_{ij} \ne 0 \Rightarrow P_{ij} > 0Eij​=0⇒Pij​>0.
  2. For such an EEE and P∈U(a,b)P \in U(a,b)P∈U(a,b), both P+tEP + tEP+tE and P−tEP - tEP−tE lie in U(a,b)U(a,b)U(a,b) for some t>0t > 0t>0.
  3. A graph with kkk nodes and no cycles has at most k−1k-1k−1 edges.
  4. For P≥0P \ge 0P≥0, the edges of G(P)G(P)G(P) correspond one-to-one to the nonzero entries of PPP.

Companion (§3.4, p. 405)

For a∈Σna \in \Sigma_na∈Σn​, b∈Σmb \in \Sigma_mb∈Σm​ and any cost CCC, some minimizer of ⟨C,P⟩\langle C, P\rangle⟨C,P⟩ over U(a,b)U(a,b)U(a,b) is an extremal point of U(a,b)U(a,b)U(a,b).

Significance

Proposition 3.4 is the sparsity statement of discrete optimal transport: a vertex of U(a,b)U(a,b)U(a,b) moves mass along at most n+m−1n+m-1n+m−1 source–target pairs, out of nmnmnm possible. With the companion, some optimal plan is that sparse. This is what makes the network simplex method a combinatorial algorithm on spanning trees of the bipartite graph (§3.5 of the book), and it is the reason the north-west corner rule (§3.4.2) can produce a feasible vertex with a tree support. The same fact, specialized to n=mn = mn=m and uniform histograms, is one step on the way from Kantorovich's relaxation back to Monge's assignment problem.

The result is classical and proved; it has not, to our knowledge, been formalized. Mathlib has the transportation polytope only implicitly (no dedicated definition), and it has the edge count of trees (SimpleGraph.IsTree.card_edgeFinset) but not the corresponding bound for forests. The mission produces a machine-checked link between the convex geometry of U(a,b)U(a,b)U(a,b) and the combinatorics of its support graph, reusable by later missions of the series on the network simplex and on the assignment problem.

Difficulty

The convex-geometric half is elementary; the work is in the passage between a cycle of a graph and a matrix. The cycle is an object of Mathlib's graph library (a closed walk with distinct vertices in a graph on V⊔V′V \sqcup V'V⊔V′), while the perturbation is a matrix indexed by V×V′V \times V'V×V′. An informal picture of a cycle as a list of edges hides what the matrix statement needs: each source and each target must be visited at most once, and Mathlib's cycles are walks whose distinctness conditions have to be carried to the matrix level.

The edge bound for forests is not packaged in Mathlib either: it counts the edges of a tree, a connected acyclic graph, while the support graph of a vertex is in general disconnected, and the empty graph must be handled.

Formalization scope

All objects live in the namespace CompOT.Vertices. Indices are Fin n and Fin m (0-based; the book's [ ⁣[n] ⁣]={1,…,n}[\![n]\!] = \{1,\dots,n\}[[n]]={1,…,n}). Matrices are Matrix (Fin n) (Fin m) ℝ, and U(a,b)U(a,b)U(a,b) is the set of matrices with nonnegative entries, row sums aaa and column sums bbb. Extremality is the book's midpoint definition, relative to the set: the points y,zy, zy,z in x=(y+z)/2x = (y+z)/2x=(y+z)/2 range over U(a,b)U(a,b)U(a,b) only. This rules out the trivializing reading in which y,zy, zy,z range over all matrices (no point would then be extremal and the goal would be vacuous); conversely, the sanity file shows a non-extremal coupling, so extremality is not automatic either.

The support graph is a SimpleGraph (Fin n ⊕ Fin m) with Sum.inl i adjacent to Sum.inr j exactly when Pij>0P_{ij} > 0Pij​>0 and no other adjacencies. The book calls the edges (i,j′)(i,j')(i,j′) directed, but the cycles of its proof alternate between sources and targets, so "no cycles" is Mathlib's SimpleGraph.IsAcyclic of this undirected graph. The number of nonzero entries is the cardinality of {(i,j):Pij≠0}\{(i,j) : P_{ij} \ne 0\}{(i,j):Pij​=0}.

The goal, feasibility milestone and companion carry a∈Σna \in \Sigma_na∈Σn​, b∈Σmb \in \Sigma_mb∈Σm​, the book's standing notation for histograms (p. 360). These hypotheses make the index sets nonempty, so natural-number subtraction in the bound n+m−1n+m-1n+m−1 agrees with the book's integer expression.

Useful infrastructure, reusable beyond this mission: the forest edge bound for finite simple graphs, and the correspondence between cycles of a bipartite graph and signed matrices with zero line sums. Contributions of either as standalone lemmas are welcome.

Selected references

  • G. Peyré, M. Cuturi, Computational Optimal Transport, Foundations and Trends in Machine Learning 11(5–6):355–607, 2019. https://doi.org/10.1561/2200000073
  • R. A. Brualdi, Combinatorial Matrix Classes, Cambridge University Press, 2006, §8.1. https://doi.org/10.1017/CBO9780511721182
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997, Theorem 2.7.
  • F. L. Hitchcock, The distribution of a product from several sources to numerous localities, Journal of Mathematics and Physics 20:224–230, 1941. https://doi.org/10.1002/sapm1941201224
7 thms1 active userReviewed
AlgebraDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 1: An h-Scattered 𝔽_q-Subspace of V(r, qⁿ) Either Defines a Subgeometry or Has Dimension at Most rn/(h + 1)Research Paper

Motivation

Let VVV be an rrr-dimensional vector space over the finite field Fqn\mathbb F_{q^n}Fqn​. Viewed over the subfield Fq\mathbb F_qFq​, VVV has dimension rnrnrn, and its one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces form the Desarguesian spread. An Fq\mathbb F_qFq​-subspace UUU of VVV is scattered if it meets every element of this spread in an Fq\mathbb F_qFq​-subspace of dimension at most one. Scattered subspaces define scattered Fq\mathbb F_qFq​-linear sets in PG(r−1,qn)\mathrm{PG}(r-1,q^n)PG(r−1,qn). Through these linear sets they are connected to projective two-weight codes, strongly regular graphs and maximum rank distance (MRD) codes. In 2000 Blokhuis and Lavrauw proved that a scattered subspace has dimension at most rn/2rn/2rn/2, and a sequence of papers showed that this bound is attained whenever 2∣rn2 \mid rn2∣rn.

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2; Combinatorica 41, 2021) replace the one-dimensional spread elements by all hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces. This gives a hierarchy of conditions, the hhh-scattered subspaces, that refines the scattered case. For h=r−1h = r-1h=r−1 and dimension nnn these subspaces had already been identified with Fqn\mathbb F_{q^n}Fqn​-linear MRD codes by Sheekey and Van de Voorde. This mission formalizes the paper's main theorem, the dimension bound for hhh-scattered subspaces.

Timeline.

  • 2000: Blokhuis and Lavrauw, Scattered spaces with respect to a spread in PG(n, q), prove dim⁡FqU≤rn/2\dim_{\mathbb F_q} U \le rn/2dimFq​​U≤rn/2 for scattered UUU (the case h=1h = 1h=1).
  • 2000–2018: Ball–Blokhuis–Lavrauw (2000), Blokhuis–Lavrauw (2000), Csajbók–Marino–Polverino–Zullo (2017) and Bartoli–Giulietti–Marino–Polverino (2018) together show that scattered subspaces of dimension rn/2rn/2rn/2 exist whenever rnrnrn is even.
  • 2020: Sheekey and Van de Voorde study subspaces scattered with respect to hyperplanes (h=r−1h = r-1h=r−1) and relate them to MRD codes.
  • 2019–2021: Csajbók, Marino, Polverino and Zullo introduce hhh-scattered subspaces and prove the bound rn/(h+1)rn/(h+1)rn/(h+1) for every hhh (Theorem 2.3).

Setting

Let Fq⊆Fqn\mathbb F_q \subseteq \mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, so n=dim⁡FqFqnn = \dim_{\mathbb F_q}\mathbb F_{q^n}n=dimFq​​Fqn​, and let VVV be a vector space over Fqn\mathbb F_{q^n}Fqn​ of dimension rrr. Every Fqn\mathbb F_{q^n}Fqn​-subspace of VVV is also an Fq\mathbb F_qFq​-subspace. For an Fq\mathbb F_qFq​-subspace UUU of VVV, ⟨U⟩Fqn\langle U\rangle_{\mathbb F_{q^n}}⟨U⟩Fqn​​ denotes its Fqn\mathbb F_{q^n}Fqn​-span.

Definition 1.1. Let 0<h≤r−10 < h \le r-10<h≤r−1. An Fq\mathbb F_qFq​-subspace UUU of VVV is hhh-scattered if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U) \le hdimFq​​(S∩U)≤h. In Lean this is HScattered.Bound.IsHScattered F K h U, with F =Fq=\mathbb F_q=Fq​, K =Fqn=\mathbb F_{q^n}=Fqn​, and rrr = Module.finrank K V.

An Fq\mathbb F_qFq​-subspace UUU defines a subgeometry of PG(V,Fqn)\mathrm{PG}(V,\mathbb F_{q^n})PG(V,Fqn​) if some Fq\mathbb F_qFq​-basis of UUU is also an Fqn\mathbb F_{q^n}Fqn​-basis of VVV (HScattered.Construction.DefinesSubgeometry F K U, a definition shared with the other missions of this series). In coordinates, UUU is then Fq r\mathbb F_q^{\,r}Fqr​ inside Fqn r\mathbb F_{q^n}^{\,r}Fqnr​.

A rank distance code of Fqn×m\mathbb F_q^{n\times m}Fqn×m​, n≤mn \le mn≤m, is a set C\mathcal CC of Fq\mathbb F_qFq​-linear maps from an mmm-dimensional to an nnn-dimensional Fq\mathbb F_qFq​-space, with distance d(f,g)=rk⁡(f−g)d(f,g) = \operatorname{rk}(f-g)d(f,g)=rk(f−g).

Formalization targets

Goal: Theorem 2.3

If UUU is an hhh-scattered Fq\mathbb F_qFq​-subspace of VVV, then either dim⁡FqU=r\dim_{\mathbb F_q}U = rdimFq​​U=r, UUU defines a subgeometry and UUU is (r−1)(r-1)(r−1)-scattered, or

dim⁡FqU≤rnh+1.\dim_{\mathbb F_q} U \le \frac{rn}{h+1}.dimFq​​U≤h+1rn​.

The disjunction is inclusive. The statement holds for every hhh in the range 0<h≤r−10 < h \le r-10<h≤r−1, including h=1h = 1h=1.

Milestones

  • Proposition 2.1. For h>1h > 1h>1, an hhh-scattered subspace is iii-scattered for every 0<i<h0 < i < h0<i<h.
  • Lemma 2.2. If r≥2r \ge 2r≥2 and r≤i≤nr \le i \le nr≤i≤n, then VVV contains an (r−1)(r-1)(r−1)-scattered Fq\mathbb F_qFq​-subspace of dimension iii.
  • Result 4.6 (Delsarte). A rank distance code of Fqn×m\mathbb F_q^{n\times m}Fqn×m​, n≤mn\le mn≤m, with minimum distance ddd has ∣C∣≤qm(n−d+1)|\mathcal C| \le q^{m(n-d+1)}∣C∣≤qm(n−d+1).

Significance

The result. Theorem 2.3 is the upper end of the theory of hhh-scattered subspaces. It shows that the bound rn/(h+1)rn/(h+1)rn/(h+1) decreases with hhh: a stronger intersection condition forces a smaller subspace. Every subspace reaching the bound is a maximum hhh-scattered subspace. The rest of the paper builds on such subspaces. Its constructions show the bound is sharp when h+1∣rh+1 \mid rh+1∣r. Its intersection numbers with hyperplanes lie in [rn/(h+1)−n, rn/(h+1)−n+h][rn/(h+1)-n,\ rn/(h+1)-n+h][rn/(h+1)−n, rn/(h+1)−n+h]. Its Delsarte-type duality sends maximum hhh-scattered subspaces to maximum (n−h−2)(n-h-2)(n−h−2)-scattered ones. Each of these statements presupposes the bound. For h=r−1h = r-1h=r−1, the bound dim⁡U≤n\dim U \le ndimU≤n is the geometric counterpart of the Singleton bound for MRD codes.

Formalizing it. The theorem is proved in the paper; it has no machine-checked proof. A formalization would provide a Lean model of hhh-scattered subspaces over a field tower and a rank-metric Singleton bound, and the bound itself as a reusable lemma for the companion missions on constructions, hyperplane intersections and duality. The case h=1h = 1h=1 is attributed in the paper to Blokhuis–Lavrauw and is not reproved there, so a complete formal proof must also supply that case.

Difficulty

The obvious approach is to count. Every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace meets UUU in at most qhq^hqh vectors. But these subspaces overlap heavily, and a double count of incidences between vectors of UUU and hhh-dimensional subspaces does not produce a bound of the form rn/(h+1)rn/(h+1)rn/(h+1). The hhh-scattered condition must be used on subspaces of every dimension t<ht < ht<h at once, which is the content of Proposition 2.1. The argument for h=1h = 1h=1 does not carry over directly either: the paper treats h=r−1h = r-1h=r−1, 1<h<r−11 < h < r-11<h<r−1 with n≥h+1n \ge h+1n≥h+1, and n<h+1n < h+1n<h+1 as separate cases. The case h=r−1h = r-1h=r−1 rests on a coding-theoretic input (Result 4.6), and the middle case needs auxiliary subspaces whose existence (Lemma 2.2) holds only when n≥h+1n \ge h+1n≥h+1.

Formalization scope

  • Field tower. Fq\mathbb F_qFq​ and Fqn\mathbb F_{q^n}Fqn​ are finite fields F, K with [Algebra F K]. VVV is a finite-dimensional K-module with a compatible F-module structure ([IsScalarTower F K V]). The parameters are qqq = Fintype.card F, nnn = Module.finrank F K and rrr = Module.finrank K V.
  • Subspaces. Fq\mathbb F_qFq​-subspaces are Submodule F V and Fqn\mathbb F_{q^n}Fqn​-subspaces are Submodule K V. The intersection S∩US\cap US∩U is S.restrictScalars F ⊓ U.
  • The definition. The range 0<h<r0 < h < r0<h<r and the spanning condition ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V are clauses of IsHScattered.
  • No division. rn/(h+1)rn/(h+1)rn/(h+1) never appears with division: "dim⁡U≤rn/(h+1)\dim U \le rn/(h+1)dimU≤rn/(h+1)" is (h+1)dim⁡U≤rn(h+1)\dim U \le rn(h+1)dimU≤rn in N\mathbb NN.
  • Result 4.6. The code is a Finset of linear maps. The minimum distance ddd enters as a lower bound on all pairwise rank distances, with 1≤d≤n1 \le d \le n1≤d≤n.
  • Lemma 2.2. It carries r≥2r \ge 2r≥2, which Definition 1.1 forces for (r−1)(r-1)(r−1)-scattered subspaces.

Ruling out trivial readings. Without the range h<rh < rh<r, every spanning subspace would be "hhh-scattered" for h≥rh \ge rh≥r, and U=VU = VU=V of dimension rnrnrn would refute the goal. Without the spanning condition, U=0U = 0U=0 would satisfy the bound vacuously. Both conditions are part of the definition, and the goal is the inclusive disjunction for every hhh-scattered UUU.

Cited inputs. Result 4.6 is Delsarte's theorem [13], numbered in this paper and posed here with sorry. The case h=1h = 1h=1 of the goal is the Blokhuis–Lavrauw bound [4], which the paper cites without proof and says can be obtained by adapting its argument (Zullo's thesis [30]). It is not an item: a complete proof of the goal must cover it.

Infrastructure. A proof needs: dimension arithmetic for restriction of scalars in a tower; the rank–nullity theorem for Fq\mathbb F_qFq​-linear maps; the count of roots of a qqq-polynomial ∑jajxqj\sum_j a_j x^{q^j}∑j​aj​xqj, for Lemma 2.2; and a rank-metric Singleton bound. The Singleton bound and Lemma 2.2 are reusable beyond this mission. Contributions are welcome on any milestone, on the h=1h = 1h=1 case, and on the reduction for n<h+1n < h+1n<h+1.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, arXiv:1906.10590v2 (2020); Combinatorica 41 (2021). https://arxiv.org/abs/1906.10590v2
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geometriae Dedicata 81 (2000) 231–243. https://doi.org/10.1023/A:1005283806897
  • P. Delsarte, Bilinear forms over a finite field, with applications to coding theory, J. Combin. Theory Ser. A 25 (1978) 226–241. https://doi.org/10.1016/0097-3165(78)90015-8
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets, and their duality, Designs, Codes and Cryptography 88 (2020) 655–675. https://doi.org/10.1007/s10623-019-00703-z
6 thms1 active userReviewed
AlgebraComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Algebraic Approach to Promise Constraint Satisfaction 1: A Minion Homomorphism Pol(A₁, B₁) → Pol(A₂, B₂) Exists iff (A₂, B₂) Is pp-Constructible from (A₁, B₁)Research Paper

Motivation

A promise constraint satisfaction problem PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) is given by two finite relational structures with a homomorphism A→B\mathbf A\to\mathbf BA→B. An instance is a third structure I\mathbf II, and the task is to answer yes if I→A\mathbf I\to\mathbf AI→A and no if I↛B\mathbf I\not\to\mathbf BI→B; the promise is that one of the two holds. Approximate graph colouring (colour a kkk-colourable graph with c≥kc\ge kc≥k colours) and the search for a not-all-equal assignment of a 1-in-3-satisfiable formula are of this form, and their complexity has been open since the 1970s and 2010s respectively.

For ordinary CSPs (A=B\mathbf A=\mathbf BA=B) the algebraic approach, in which the complexity is governed by the polymorphisms of the template, led to the classification of all finite-template CSPs (Bulatov 2017, Zhuk 2017). Barto, Bulín, Krokhin and Opršal (arXiv:1811.00970, J. ACM 2021) extend that approach to promise problems. Their central structural result is Theorem 4.12: the existence of a minion homomorphism between polymorphism minions, which by their Theorem 3.1 yields a log-space reduction between the PCSPs, is characterized in five other ways, two of them purely relational.

Timeline:

  • 1998: Jeavons shows that polymorphisms determine the complexity of CSP(A)\mathrm{CSP}(\mathbf A)CSP(A), through a Galois correspondence between pp-definable relations and polymorphisms.
  • 2002: Pippenger develops the Galois correspondence for pairs of sets that underlies the promise setting.
  • 2016–2018: Brakensiek and Guruswami (arXiv:1704.01937) prove that Pol(A,B)⊆Pol(A′,B′)\mathrm{Pol}(\mathbf A,\mathbf B)\subseteq\mathrm{Pol}(\mathbf A',\mathbf B')Pol(A,B)⊆Pol(A′,B′) yields a reduction for templates over the same domains.
  • 2018: Barto, Opršal and Pinsker (arXiv:1510.04521) characterize pp-constructibility of CSP templates by minor-preserving maps of polymorphism clones.
  • 2019: the present paper defines minion homomorphisms between polymorphism minions of promise templates and proves Theorem 4.12.

Setting

A signature is a finite set τ\tauτ of relation symbols RRR with arities ar(R)≥1\mathrm{ar}(R)\ge1ar(R)≥1. A structure A\mathbf AA on a finite set AAA gives a relation RA⊆Aar(R)R^{\mathbf A}\subseteq A^{\mathrm{ar}(R)}RA⊆Aar(R) for each RRR; a homomorphism h:A→Bh:\mathbf A\to\mathbf Bh:A→B maps every tuple of RAR^{\mathbf A}RA into RBR^{\mathbf B}RB. A PCSP template is a pair (A,B)(\mathbf A,\mathbf B)(A,B) of structures with the same signature and A→B\mathbf A\to\mathbf BA→B.

An nnn-ary polymorphism f:An→Bf:A^n\to Bf:An→B, n≥1n\ge1n≥1, applied coordinatewise to any nnn tuples of RAR^{\mathbf A}RA, gives a tuple of RBR^{\mathbf B}RB. The minor of an mmm-ary ggg given by π:[m]→[n]\pi:[m]\to[n]π:[m]→[n] is f(x1,…,xn)=g(xπ(1),…,xπ(m))f(x_1,\dots,x_n)=g(x_{\pi(1)},\dots,x_{\pi(m)})f(x1​,…,xn​)=g(xπ(1)​,…,xπ(m)​). A minion is a nonempty set of functions of positive arity closed under minors; Pol(A,B)\mathrm{Pol}(\mathbf A,\mathbf B)Pol(A,B) is one. A minion homomorphism ξ:M→N\xi:\mathcal M\to\mathcal Nξ:M→N preserves arities and satisfies ξ(g(xπ(1),…,xπ(m)))=ξ(g)(xπ(1),…,xπ(m))\xi(g(x_{\pi(1)},\dots,x_{\pi(m)}))=\xi(g)(x_{\pi(1)},\dots,x_{\pi(m)})ξ(g(xπ(1)​,…,xπ(m)​))=ξ(g)(xπ(1)​,…,xπ(m)​).

A bipartite minor condition is a finite set of identities f(x1,…,xn)≈g(xπ(1),…,xπ(m))f(x_1,\dots,x_n)\approx g(x_{\pi(1)},\dots,x_{\pi(m)})f(x1​,…,xn​)≈g(xπ(1)​,…,xπ(m)​) between symbols from two disjoint sets; a minion satisfies it if the symbols can be assigned members of matching arity that make every identity true. For a structure A\mathbf AA with A={a1,…,an}A=\{a_1,\dots,a_n\}A={a1​,…,an​} and an instance I\mathbf II, the condition Σ(A,I)\Sigma(\mathbf A,\mathbf I)Σ(A,I) has an nnn-ary symbol fvf_vfv​ per element vvv of I\mathbf II, an ∣RA∣|R^{\mathbf A}|∣RA∣-ary symbol gCg_CgC​ per constraint CCC, and one identity per position of each constraint, read off the list of tuples of RAR^{\mathbf A}RA. The free structure FM(A)F_{\mathcal M}(\mathbf A)FM​(A) has universe M(n)\mathcal M^{(n)}M(n), and a tuple (f1,…,fk)(f_1,\dots,f_k)(f1​,…,fk​) lies in its relation RRR when all fif_ifi​ are minors of one ∣RA∣|R^{\mathbf A}|∣RA∣-ary member of M\mathcal MM in the pattern given by RAR^{\mathbf A}RA.

A pp-power (A′,B′)(\mathbf A',\mathbf B')(A′,B′) of (A,B)(\mathbf A,\mathbf B)(A,B) lives on ANA^NAN, BNB^NBN, each relation being defined in A\mathbf AA and in B\mathbf BB by one and the same primitive positive formula. A homomorphic relaxation (A′,B′)(\mathbf A',\mathbf B')(A′,B′) of (A,B)(\mathbf A,\mathbf B)(A,B) has homomorphisms A′→A\mathbf A'\to\mathbf AA′→A and B→B′\mathbf B\to\mathbf B'B→B′. pp-constructibility is the closure under finitely many such steps.

Formalization targets

Goal: Theorem 4.12

For PCSP templates (Ai,Bi)(\mathbf A_i,\mathbf B_i)(Ai​,Bi​) of finite structures and Mi=Pol(Ai,Bi)\mathcal M_i=\mathrm{Pol}(\mathbf A_i,\mathbf B_i)Mi​=Pol(Ai​,Bi​), the following are equivalent:

(1) ∃ ξ:M1→M2(4) FM1(A2)→B2(2) M1⊨Σ⇒M2⊨Σ for every bipartite Σ(5) (A2,B2) relaxes a pp-power of (A1,B1)(3) M2⊨Σ(A2,FM1(A2))(6) (A2,B2) is pp-constructible from (A1,B1).\begin{aligned} &(1)\ \exists\,\xi:\mathcal M_1\to\mathcal M_2 &&(4)\ F_{\mathcal M_1}(\mathbf A_2)\to\mathbf B_2\\ &(2)\ \mathcal M_1\models\Sigma\Rightarrow\mathcal M_2\models\Sigma\text{ for every bipartite }\Sigma &&(5)\ (\mathbf A_2,\mathbf B_2)\text{ relaxes a pp-power of }(\mathbf A_1,\mathbf B_1)\\ &(3)\ \mathcal M_2\models\Sigma(\mathbf A_2,F_{\mathcal M_1}(\mathbf A_2)) &&(6)\ (\mathbf A_2,\mathbf B_2)\text{ is pp-constructible from }(\mathbf A_1,\mathbf B_1). \end{aligned}​(1) ∃ξ:M1​→M2​(2) M1​⊨Σ⇒M2​⊨Σ for every bipartite Σ(3) M2​⊨Σ(A2​,FM1​​(A2​))​​(4) FM1​​(A2​)→B2​(5) (A2​,B2​) relaxes a pp-power of (A1​,B1​)(6) (A2​,B2​) is pp-constructible from (A1​,B1​).​

Milestones

In the order of the proof on p. 27: Lemma 4.8 (relaxations and pp-powers give minion homomorphisms) and Corollary 4.10 for (6) ⇒ (1); Lemma 4.3 (M⊨Σ(A,FM(A))\mathcal M\models\Sigma(\mathbf A,F_{\mathcal M}(\mathbf A))M⊨Σ(A,FM​(A))) for (2) ⇒ (3); Lemma 3.14 for (3) ⇒ (4); Lemma 4.11 ((A2,FM1(A2))(\mathbf A_2,F_{\mathcal M_1}(\mathbf A_2))(A2​,FM1​​(A2​)) relaxes a pp-power of (A1,B1)(\mathbf A_1,\mathbf B_1)(A1​,B1​)) for (4) ⇒ (5). Lemma 4.4, the bijection between homomorphisms FM(A)→BF_{\mathcal M}(\mathbf A)\to\mathbf BFM​(A)→B and minion homomorphisms M→Pol(A,B)\mathcal M\to\mathrm{Pol}(\mathbf A,\mathbf B)M→Pol(A,B), is included as an extra item.

Significance

Theorem 4.12 replaces a property of infinitely many functions, the existence of a minion homomorphism, by a homomorphism between two finite structures (item 4), which is decidable, and by a relational construction (items 5–6). The free-structure criterion is what bounds the arity of polymorphisms that a hardness proof must inspect, and the paper uses it to prove NP-hardness of PCSP(Kk,K2k−1)\mathrm{PCSP}(\mathbf K_k,\mathbf K_{2k-1})PCSP(Kk​,K2k−1​) and to analyse the 1-in-3 versus not-all-equal problem. Later work on approximate graph and hypergraph colouring states its reductions in these terms.

The result is proved in the paper. As far as is known it has not been machine-checked: Mathlib has no minions, minor conditions, pp-formulas or pp-constructions. The mission produces a reusable Lean vocabulary for the algebraic theory of promise CSPs, together with a formal proof of the equivalence. The complexity consequences are not formalized.

Difficulty

Four of the implications are short once the definitions are fixed. The substantial step is (4) ⇒ (5), Lemma 4.11: a statement about the polymorphism minion, an object defined by infinitely many conditions, must be turned into a finite relational construction, and the relations of the pp-power have to be defined by one formula that is correct in A1\mathbf A_1A1​ and in B1\mathbf B_1B1​ at the same time. The indices involved, tuples over a power of A1A_1A1​, coordinates indexed by A2A_2A2​, and the enumeration of each RA2R^{\mathbf A_2}RA2​, are where an informal reading leaves the most to check. Lemma 4.8(2) needs that polymorphisms preserve every pp-definable relation, a statement about arbitrary formulas, not only about the relations of the template. Corollary 4.10 is an induction over a sequence of templates whose signatures and domains change from step to step, which a formal statement cannot treat as a sequence in one fixed type.

Formalization scope

Structures, homomorphisms, templates and polymorphisms are the published PCSPBLPAff.Symmetric definitions (RelStruct, IsHom, IsPromiseTemplate, IsPolymorphism). All structures are finite with nonempty domains: domains carry Fintype, DecidableEq and Nonempty (nonemptiness is the field's standing convention, which the paper uses when it identifies a domain with [n][n][n]; without it items (4) and (5) of the goal are not equivalent). The goal and Lemma 4.11 also assume that every relation of A2\mathbf A_2A2​ is nonempty; the paper does not say so, but if RA2=∅R^{\mathbf A_2}=\emptysetRA2​=∅ then RFM1(A2)=∅R^{F_{\mathcal M_1}(\mathbf A_2)}=\emptysetRFM1​​(A2​)=∅, and when B1\mathbf B_1B1​ has an element on which every relation holds constantly no pp-power can have an empty relation, so (4) ⇒ (5) fails, signatures are Fintype, arities are positive, minions in Lemmas 4.3–4.4 live on finite sets. Theorem 4.12 is stated only for finite templates, as in the paper (p. 46 notes that it fails for infinite ones). Minions have no nullary members. A minion homomorphism is a family of maps on the members M(n)→N(n)\mathcal M^{(n)}\to\mathcal N^{(n)}M(n)→N(n), so it cannot be made trivial by values outside the minion. Bipartite minor conditions have finite symbol and identity types in Type; item (2) quantifies over all of them. Σ(A,I)\Sigma(\mathbf A,\mathbf I)Σ(A,I) and FM(A)F_{\mathcal M}(\mathbf A)FM​(A) take the enumeration of AAA and of each RAR^{\mathbf A}RA as explicit equivalences; the paper's identification A=[n]A=[n]A=[n] is one such choice. A pp-power uses one formula for both structures, with free variables indexed by [k]×[N][k]\times[N][k]×[N]. Templates are bundled for pp-constructibility, which is an inductive predicate.

The goal is the six-way equivalence (List.TFAE) and not any of its trivial fragments; the goal cannot be closed by choosing degenerate enumerations, because every statement quantifies over all of them.

Not formalized: the log-space reductions of Theorems 3.1 and 3.12, Remark 3.11's reduction between promise minor-condition problems, and the cited Theorem 2.25 [Pip02, BG16b]. Contributions are welcome on general facts that are reusable beyond this mission: polymorphisms preserve pp-definable relations, composition of minion homomorphisms, and the natural minion homomorphism M→Pol(A,FM(A))\mathcal M\to\mathrm{Pol}(\mathbf A,F_{\mathcal M}(\mathbf A))M→Pol(A,FM​(A)).

Selected references

  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, J. ACM 68(4), 2021; arXiv:1811.00970v3. https://arxiv.org/abs/1811.00970
  • L. Barto, J. Opršal, M. Pinsker, The wonderland of reflections, Israel J. Math. 223, 2018. https://arxiv.org/abs/1510.04521
  • J. Brakensiek, V. Guruswami, Promise constraint satisfaction: structure theory and a symmetric Boolean dichotomy, SODA 2018. https://arxiv.org/abs/1704.01937
  • N. Pippenger, Galois theory for minors of finite functions, Discrete Math. 254, 2002. https://doi.org/10.1016/S0012-365X(01)00297-7
  • P. Jeavons, On the algebraic structure of combinatorial problems, Theoret. Comput. Sci. 200, 1998. https://doi.org/10.1016/S0304-3975(97)00230-2
11 thms1 active userReviewed
Complexity TheoryGraph TheoryTheoretical Computer Science·Captain: mikedeng1

Algebraic Approach to Promise Constraint Satisfaction 2: Pol(K_k, K_{2k−1}) Has No Olšák Function, So It Maps by a Minion Homomorphism to Pol(H₂, H_K)Research Paper

Approximate graph colouring

Given a graph that is promised to be kkk-colourable, how many colours are needed to find a proper colouring in polynomial time? The decision version asks to distinguish kkk-colourable graphs from graphs that are not even ccc-colourable. It has been studied since Garey and Johnson (1976) and is conjectured to be NP-hard for all fixed 3≤k≤c3 \le k \le c3≤k≤c. This is the approximate graph colouring problem, and it is one of the motivating examples of promise constraint satisfaction problems (PCSPs).

Timeline of the NP-hardness results without extra assumptions, as surveyed in Example 2.9 and §6.2 of the paper:

  • 2000–2004, Khanna–Linial–Safra and Guruswami–Khanna: 3 versus 4 colours.
  • 2013, Huang (cited as [Hua13] in the paper): kkk versus 2Ω(k1/3)2^{\Omega(k^{1/3})}2Ω(k1/3) colours for large kkk.
  • 2016, Brakensiek–Guruswami: kkk versus 2k−22k - 22k−2 colours for every k≥3k \ge 3k≥3, via polymorphisms.
  • 2018/2019, Barto–Bulín–Krokhin–Opršal (this paper): kkk versus 2k−12k - 12k−1 colours for every k≥3k \ge 3k≥3, in particular 3 versus 5. The argument is an instance of a general algebraic theory of PCSPs.

The method also applies to the question of 5-cycle versus 3-colouring, which Brakensiek and Guruswami had raised as an open case.

Setting

A relational structure A\mathbf AA consists of a finite domain AAA and relations RA⊆Aar(R)R^{\mathbf A} \subseteq A^{\mathrm{ar}(R)}RA⊆Aar(R), one for each symbol RRR of a signature. A PCSP template is a pair (A,B)(\mathbf A, \mathbf B)(A,B) of structures with the same signature and a homomorphism A→B\mathbf A \to \mathbf BA→B. Write Ek={0,…,k−1}E_k = \{0, \dots, k-1\}Ek​={0,…,k−1}.

  • Kk=(Ek;≠k)\mathbf K_k = (E_k; \neq_k)Kk​=(Ek​;=k​) is the complete graph: one binary relation {(a,b)∣a≠b}\{(a, b) \mid a \ne b\}{(a,b)∣a=b}.
  • Hk=(Ek;NAEk)\mathbf H_k = (E_k; \mathrm{NAE}_k)Hk​=(Ek​;NAEk​) carries the ternary not-all-equal relation Ek3∖{(a,a,a)}E_k^3 \setminus \{(a, a, a)\}Ek3​∖{(a,a,a)}; PCSP(Hk,Hc)\mathrm{PCSP}(\mathbf H_k, \mathbf H_c)PCSP(Hk​,Hc​) is approximate colouring of 3-uniform hypergraphs.

An nnn-ary polymorphism from A\mathbf AA to B\mathbf BB is a map f:An→Bf : A^n \to Bf:An→B that, applied coordinatewise to any nnn tuples of RAR^{\mathbf A}RA, returns a tuple of RBR^{\mathbf B}RB. For Kk\mathbf K_kKk​ and Kc\mathbf K_cKc​ these are exactly the ccc-colourings of the power Kkn\mathbf K_k^nKkn​. The set Pol(A,B)\mathrm{Pol}(\mathbf A, \mathbf B)Pol(A,B) of polymorphisms of all arities n≥1n \ge 1n≥1 is closed under minors: f(x1,…,xn)=g(xπ(1),…,xπ(m))f(x_1, \dots, x_n) = g(x_{\pi(1)}, \dots, x_{\pi(m)})f(x1​,…,xn​)=g(xπ(1)​,…,xπ(m)​) for π:[m]→[n]\pi : [m] \to [n]π:[m]→[n]. A minion is any nonempty set of functions of arities n≥1n \ge 1n≥1 that is closed under minors. A minion homomorphism ξ:M→N\xi : \mathscr M \to \mathscr Nξ:M→N preserves arities and commutes with minors. Write HK=Pol(H2,HK)\mathscr H_K = \mathrm{Pol}(\mathbf H_2, \mathbf H_K)HK​=Pol(H2​,HK​).

An Olšák function is a 6-ary function ooo with

o(x,x,y,y,y,x)=o(x,y,x,y,x,y)=o(y,x,x,x,y,y)for all x,y.o(x, x, y, y, y, x) = o(x, y, x, y, x, y) = o(y, x, x, x, y, y) \quad \text{for all } x, y .o(x,x,y,y,y,x)=o(x,y,x,y,x,y)=o(y,x,x,x,y,y)for all x,y.

The free structure FM(A)\mathbf F_{\mathscr M}(\mathbf A)FM​(A) has the ∣A∣|A|∣A∣-ary members of M\mathscr MM as its domain and relations defined by minor identities that follow the tuples of A\mathbf AA.

Formalization targets

Goal: the algebraic core of Theorem 6.5

For every k≥3k \ge 3k≥3,

∃ K≥2:there is a minion homomorphism Pol(Kk,K2k−1)→Pol(H2,HK).\exists\, K \ge 2:\quad \text{there is a minion homomorphism } \mathrm{Pol}(\mathbf K_k, \mathbf K_{2k-1}) \to \mathrm{Pol}(\mathbf H_2, \mathbf H_K).∃K≥2:there is a minion homomorphism Pol(Kk​,K2k−1​)→Pol(H2​,HK​).

KKK is left unspecified, as in the paper. This is the statement from which the paper deduces that kkk versus 2k−12k - 12k−1 colouring is NP-hard.

Milestones

  1. Example 3.5: the Olšák minor condition is not satisfied in Hk\mathscr H_kHk​ for any k≥2k \ge 2k≥2.
  2. Lemma 4.4: homomorphisms FM(A)→B\mathbf F_{\mathscr M}(\mathbf A) \to \mathbf BFM​(A)→B correspond one-to-one to minion homomorphisms M→Pol(A,B)\mathscr M \to \mathrm{Pol}(\mathbf A, \mathbf B)M→Pol(A,B).
  3. Theorem 6.2: for a minion M\mathscr MM on finite sets,
(∃K≥2, ∃ minion homomorphism M→HK)  ⟺  M contains no Olsˇaˊk function.\bigl(\exists K \ge 2,\ \exists\ \text{minion homomorphism } \mathscr M \to \mathscr H_K\bigr) \iff \mathscr M \text{ contains no Olšák function}.(∃K≥2, ∃ minion homomorphism M→HK​)⟺M contains no Olsˇaˊk function.
  1. Lemma 6.4: Pol(Kk,K2k−1)\mathrm{Pol}(\mathbf K_k, \mathbf K_{2k-1})Pol(Kk​,K2k−1​) contains no Olšák function, k≥3k \ge 3k≥3.

One further item, not a milestone, shows the bound is sharp. Proposition 10.1 says that Pol(Kk,K2k)\mathrm{Pol}(\mathbf K_k, \mathbf K_{2k})Pol(Kk​,K2k​) contains an Olšák function.

Significance

Theorem 6.2 is a criterion stated entirely inside the minion. Together with the reduction theory of the paper (a minion homomorphism Pol(A,B)→Pol(A′,B′)\mathrm{Pol}(\mathbf A, \mathbf B) \to \mathrm{Pol}(\mathbf A', \mathbf B')Pol(A,B)→Pol(A′,B′) gives a log-space reduction from PCSP(A′,B′)\mathrm{PCSP}(\mathbf A', \mathbf B')PCSP(A′,B′) to PCSP(A,B)\mathrm{PCSP}(\mathbf A, \mathbf B)PCSP(A,B)) and the NP-hardness of approximate hypergraph colouring (Dinur, Regev and Smyth 2005), it shows that every finite template without an Olšák polymorphism has an NP-hard PCSP (Corollary 6.3). Lemma 6.4 then settles the 3 versus 5 colouring case and improves the 2k−22k - 22k−2 bound to 2k−12k - 12k−1 for every k≥3k \ge 3k≥3. Proposition 10.1 shows that this criterion cannot go beyond 2k−12k - 12k−1.

The results are proved in the paper. None of them has a machine-checked proof that this mission knows of. This mission produces a Lean statement of the minion side of the argument. That includes the free-structure correspondence (Lemma 4.4), which every later application of the theory uses, and Theorem 6.2 for arbitrary finite minions. A finished formalization would include the clique argument behind Lemma 6.4 and would check the key hardness inequality c≥2k−1c \ge 2k - 1c≥2k−1 of the paper by machine.

Difficulty

Lemma 6.4 is a statement about every (2k−1)(2k-1)(2k−1)-colouring of Kk6\mathbf K_k^6Kk6​ that is constant on certain triples of vertices. The power graph has k6k^6k6 vertices, so exhaustive search is out of reach for general kkk, and case checks for k=3k = 3k=3 do not give the general claim. Showing that 2k−12k - 12k−1 colours do not suffice requires an explicit obstruction, uniform in kkk, in the graph obtained by identifying those triples; the identification creates edges that are not present in Kk6\mathbf K_k^6Kk6​, and keeping track of them is the combinatorial core. The bound is tight (Proposition 10.1), so no argument that would also apply to 2k2k2k colours can work.

In Theorem 6.2 the direction from "no Olšák function" to a minion homomorphism must build a minion homomorphism into HK\mathscr H_KHK​ out of nothing but the absence of a single identity. That direction depends on Lemma 4.4, which relates maps defined on functions of a single arity to minion homomorphisms defined on all arities; in Lean the bookkeeping of enumerations, minors and dependent arities is substantial.

Formalization scope

The development reuses the published relational-structure layer PCSPBLPAff_Symmetric_Setting (RelStruct, IsHom, IsPolymorphism, IsPromiseTemplate). Domains EkE_kEk​ are Fin k. Kk\mathbf K_kKk​ and Hk\mathbf H_kHk​ have one-symbol signatures of arity 2 and 3. Polymorphisms apply fff to the columns of an n×ar(R)n \times \mathrm{ar}(R)n×ar(R) matrix whose rows lie in RAR^{\mathbf A}RA, which is the paper's matrix transposed. A minion is a family mem n of nnn-ary functions (Fin n → A) → B with no nullary members, nonempty and closed under the minors fun x => g (x ∘ π). A minion homomorphism is a family of maps that preserves membership and minors on members, with unconstrained values outside the minion, so Lemma 4.4's "one-to-one" is stated up to agreement on the minion. Theorem 6.2 assumes the minion's sets are finite, which is the paper's standing convention (Definition 2.20). The free structure takes an enumeration e:Fin n≃Ae : \mathrm{Fin}\ n \simeq Ae:Fin n≃A of the generating domain and quantifies the enumeration of each relation existentially. In the goal, k≥3k \ge 3k≥3 makes 2k−12k - 12k−1 free of natural-number truncation.

The codomain of the goal is exactly Pol(H2,HK)\mathrm{Pol}(\mathbf H_2, \mathbf H_K)Pol(H2​,HK​) with K≥2K \ge 2K≥2. A minion homomorphism into an arbitrary or existentially chosen minion, or into HK\mathscr H_KHK​ with K≤1K \le 1K≤1, would be trivial and is ruled out by the statement.

Not formalized. The NP-hardness conclusions of Theorem 6.5 and Corollary 6.3 are left out, and so are the log-space reduction of Theorem 3.1 and the cited hardness of approximate hypergraph colouring (Theorem 5.23, [DRS05]). There is no complexity-theoretic substrate in Mathlib for them. Lemma 6.6 (Pol(C5,K3)\mathrm{Pol}(\mathbf C_5, \mathbf K_3)Pol(C5​,K3​)) is a natural follow-up item. Contributions are welcome on every milestone. Lemma 4.4 and the minion layer can be reused beyond this mission, for any minion-homomorphism argument in the PCSP literature.

Selected references

  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, arXiv:1811.00970v3, 2019; J. ACM 68(4), 2021. https://arxiv.org/abs/1811.00970v3
  • J. Brakensiek, V. Guruswami, New hardness results for graph and hypergraph colorings, CCC 2016. https://doi.org/10.4230/LIPIcs.CCC.2016.14
  • I. Dinur, O. Regev, C. Smyth, The hardness of 3-uniform hypergraph coloring, Combinatorica 25(5), 2005. https://doi.org/10.1007/s00493-005-0032-4
  • M. Olšák, The weakest nontrivial idempotent equations, Bull. London Math. Soc. 49(6), 2017. https://doi.org/10.1112/blms.12097
  • S. Khanna, N. Linial, S. Safra, On the hardness of approximating the chromatic number, Combinatorica 20(3), 2000. https://doi.org/10.1007/s004930070013
9 thms1 active userReviewed
AlgebraComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Algebraic Approach to Promise Constraint Satisfaction 4: No Finite D with 1-in-3 → D → NAE Has a Cyclic Polymorphism of Prime Arity p > 60|D|Research Paper

Motivation

A promise constraint satisfaction problem (PCSP) is given by a pair of relational structures (A,B)(\mathbf A,\mathbf B)(A,B) with a homomorphism A→B\mathbf A\to\mathbf BA→B: an instance is promised to be satisfiable in A\mathbf AA, and it suffices to satisfy it in B\mathbf BB. The paper of Barto, Bulín, Krokhin and Opršal (arXiv:1811.00970v3) develops the algebraic theory of PCSPs, in which the complexity of PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) is governed by its polymorphisms.

The most prominent example is 1-in-3 versus Not-All-Equal-SAT: given a system of ternary constraints that has an assignment making exactly one variable in each constraint true, find an assignment making the variables in each constraint not all equal. Brakensiek and Guruswami (arXiv:1704.01937) showed that this problem is solvable in polynomial time, although both 1-in-3-SAT and NAE-SAT are NP-complete on their own. Their algorithm, like every tractability result for PCSPs known when the paper was written, works by finding a tractable CSP template C\mathbf CC with T→C→H2\mathbf T\to\mathbf C\to\mathbf H_2T→C→H2​ (a "sandwich") and solving the CSP over C\mathbf CC. For 1-in-3 vs NAE the template used is infinite: the integers with the relation x+y+z=1x+y+z=1x+y+z=1.

Section 8 of the paper shows that this is unavoidable: no finite tractable template can be sandwiched, or more generally pp-constructed, in this way. This separates PCSPs from CSPs: infinite domains are necessary in the sandwich method.

Timeline: Feder and Vardi conjectured the CSP dichotomy (1998); Barto and Kozik characterised the borderline by cyclic polymorphisms (BK12, 2012); Bulatov and Zhuk proved the dichotomy (arXiv:1703.03021, arXiv:1704.01914, 2017); Brakensiek and Guruswami proved 1-in-3 vs NAE tractable (2018); Barto, Bulín, Krokhin and Opršal proved Theorem 8.1 (2019).

Setting

All structures here have one ternary relation. For a set DDD and R⊆D3R\subseteq D^3R⊆D3, (D;R)(D;R)(D;R) is the structure with domain DDD and relation RRR. The 1-in-3 structure is T=({0,1};{(1,0,0),(0,1,0),(0,0,1)})\mathbf T=(\{0,1\};\{(1,0,0),(0,1,0),(0,0,1)\})T=({0,1};{(1,0,0),(0,1,0),(0,0,1)}) and the not-all-equal structure is H2=({0,1};{0,1}3∖{(0,0,0),(1,1,1)})\mathbf H_2=(\{0,1\};\{0,1\}^3\setminus\{(0,0,0),(1,1,1)\})H2​=({0,1};{0,1}3∖{(0,0,0),(1,1,1)}).

A homomorphism h:(A;RA)→(B;RB)h:(A;R_A)\to(B;R_B)h:(A;RA​)→(B;RB​) is a map with (h(a),h(b),h(c))∈RB(h(a),h(b),h(c))\in R_B(h(a),h(b),h(c))∈RB​ whenever (a,b,c)∈RA(a,b,c)\in R_A(a,b,c)∈RA​. A polymorphism of (D;R)(D;R)(D;R) of arity ppp is a map s:Dp→Ds:D^p\to Ds:Dp→D such that, applied coordinatewise to any ppp triples from RRR, it yields a triple in RRR. An operation s:Dp→Ds:D^p\to Ds:Dp→D is cyclic if s(a1,a2,…,ap)=s(a2,…,ap,a1)s(a_1,a_2,\dots,a_p)=s(a_2,\dots,a_p,a_1)s(a1​,a2​,…,ap​)=s(a2​,…,ap​,a1​) for all a∈Dpa\in D^pa∈Dp (Definition 8.2).

The proof of Theorem 8.1 works in the following situation: DDD is finite, f:T→(D;R)f:\mathbf T\to(D;R)f:T→(D;R) and g:(D;R)→H2g:(D;R)\to\mathbf H_2g:(D;R)→H2​ are homomorphisms, p>60∣D∣p>60|D|p>60∣D∣ is a prime and sss is a cyclic polymorphism of (D;R)(D;R)(D;R) of arity ppp. From sss it builds the p2p^2p2-ary operation

t(X)=s(s(x11,…,xp1),…,s(x1p,…,xpp))t(X)=s\big(s(x_{11},\dots,x_{p1}),\dots,s(x_{1p},\dots,x_{pp})\big)t(X)=s(s(x11​,…,xp1​),…,s(x1p​,…,xpp​))

on p×pp\times pp×p matrices X=(xij)X=(x_{ij})X=(xij​), and studies zero-one matrices, evaluated in DDD through fff: their area λ(X)\lambda(X)λ(X) (the fraction of ones), ggg-equivalence X∼Y  ⟺  g(t(X))=g(t(Y))X\sim Y\iff g(t(X))=g(t(Y))X∼Y⟺g(t(X))=g(t(Y)), tameness (X∼0p×pX\sim 0_{p\times p}X∼0p×p​ with λ(X)<1/3\lambda(X)<1/3λ(X)<1/3, or X∼1p×pX\sim 1_{p\times p}X∼1p×p​ with λ(X)>1/3\lambda(X)>1/3λ(X)>1/3), covers (three matrices with exactly one 111 in each position), the line segments ⟨i⟩\langle i\rangle⟨i⟩ (ones in the first iii positions in row-major order), and almost rectangles [k,…,k,l,…,l][k,\dots,k,l,\dots,l][k,…,k,l,…,l] (columns of heights kkk then lll, with step 0≤k−l≤5∣D∣0\le k-l\le 5|D|0≤k−l≤5∣D∣).

Formalization targets

Goal: the algebraic core of Theorem 8.1

T→f(D;R)→gH2,  D finite,  p prime, p>60∣D∣ ⟹ (D;R) has no cyclic polymorphism of arity p.\mathbf T\xrightarrow{f}(D;R)\xrightarrow{g}\mathbf H_2,\ \ D\text{ finite},\ \ p\text{ prime},\ p>60|D|\ \Longrightarrow\ (D;R)\text{ has no cyclic polymorphism of arity }p.Tf​(D;R)g​H2​,  D finite,  p prime, p>60∣D∣ ⟹ (D;R) has no cyclic polymorphism of arity p.

Milestones, in proof order

  1. Lemma 8.7: the three matrices of a cover are not all ggg-equivalent.
  2. Lemma 8.8: ttt is cyclic in its p2p^2p2 row-major arguments.
  3. Lemma 8.9: with p2=3q+1p^2=3q+1p2=3q+1, ⟨0⟩∼⋯∼⟨q⟩≁⟨q+1⟩∼⋯∼⟨2q+1⟩\langle 0\rangle\sim\cdots\sim\langle q\rangle\not\sim\langle q+1\rangle\sim\cdots\sim\langle 2q+1\rangle⟨0⟩∼⋯∼⟨q⟩∼⟨q+1⟩∼⋯∼⟨2q+1⟩.
  4. Lemma 8.10: every ⟨i⟩\langle i\rangle⟨i⟩, 0≤i≤p20\le i\le p^20≤i≤p2, is tame, and 0p×p≁1p×p0_{p\times p}\not\sim 1_{p\times p}0p×p​∼1p×p​.
  5. Proposition 8.12: every almost rectangle is tame.
  6. §8.4: there are l1<l2l_1<l_2l1​<l2​ in (p/3−2∣D∣, p/3)(p/3-2|D|,\,p/3)(p/3−2∣D∣,p/3) with s(1l10p−l1)=s(1l20p−l2)s(1^{l_1}0^{p-l_1})=s(1^{l_2}0^{p-l_2})s(1l1​0p−l1​)=s(1l2​0p−l2​).

Significance

Combined with the theorem of Barto and Kozik (a finite CSP template whose CSP is not NP-complete has cyclic polymorphisms of every prime arity p>∣D∣p>|D|p>∣D∣) and with the paper's Theorem 4.12, the core yields Theorem 8.1: if (T,H2)(\mathbf T,\mathbf H_2)(T,H2​) is pp-constructible from a finite D\mathbf DD, then CSP(D)\mathrm{CSP}(\mathbf D)CSP(D) is NP-complete. Hence the polynomial-time algorithm for 1-in-3 vs NAE cannot come from any finite tractable CSP, and the infinite template of Brakensiek and Guruswami is necessary. It is a concrete separation between PCSPs and CSPs: a tractable PCSP that is not explained by any finite tractable CSP.

The theorem is proved in the paper; nothing in this section has a machine-checked proof. The mission produces a formal proof of the combinatorial core, a reusable definition of cyclic operations on top of the platform's polymorphism library, and the matrix calculus of §8 (areas, covers, ttt), which is the part of the argument where index conventions are easiest to get wrong.

Difficulty

Polymorphisms of (D;R)(D;R)(D;R) are not determined by their values on zero-one inputs, and nothing beyond cyclicity is known about sss. The obvious attempt, to show directly that sss restricted to {f(0),f(1)}\{f(0),f(1)\}{f(0),f(1)} depends only on the number of ones, fails: this property does not follow from cyclicity (Remark 8.15 asks whether polymorphisms of that kind always exist, and it is open). The only information available about sss is the coarse two-valued invariant g(t(⋅))g(t(\cdot))g(t(⋅)) on zero-one matrices, and the contradiction has to be produced from that invariant alone, uniformly over all finite DDD; the margin p>60∣D∣p>60|D|p>60∣D∣ is what keeps the areas involved away from 1/31/31/3.

Formalization scope

Structures are instances of the published PCSPBLPAff.Symmetric.RelStruct with the single-symbol signature Unit of arity 333; homomorphisms and polymorphisms are the published IsHom and IsPolymorphism. The domain {0,1}\{0,1\}{0,1} is Fin 2; DDD is a Fintype with decidable equality. Matrices are functions Fin p → Fin p → Fin 2, row index first; the p2p^2p2 arguments of ttt are read row-major via finProdFinEquiv; areas are rationals. Cyclicity is s a = s (a ∘ finRotate p), the paper's (a2,…,ap,a1)(a_2,\dots,a_p,a_1)(a2​,…,ap​,a1​). The paper renames DDD so that f(0)=0f(0)=0f(0)=0, f(1)=1f(1)=1f(1)=1; the formalization keeps fff and evaluates zero-one matrices through it. Definition 8.11 prints column heights 1≤ki≤p1\le k_i\le p1≤ki​≤p, but its proofs use height 000, so heights range over 0≤ki≤p0\le k_i\le p0≤ki​≤p.

Lemmas 8.7–8.10 are stated with only the hypotheses their proofs use (Lemma 8.8 needs only cyclicity; Lemmas 8.9–8.10 need p>3p>3p>3 prime rather than p>60∣D∣p>60|D|p>60∣D∣). Lemmas 8.13 and 8.14 concern a minimal counterexample inside the proof of Proposition 8.12 and are not separate items.

Left out: the NP-completeness conclusion of Theorem 8.1; the reduction from pp-constructibility to a homomorphic relaxation (Theorem 4.12, mission 1 of this series); the fact that a pp-power of a finite tractable CSP template is a finite tractable CSP template; and the cited Theorem 8.3 [BK12], which is never assumed or stated.

The goal ends in False, so it would be trivial if its hypotheses were contradictory for a reason unrelated to sss. They are not: D={0,1}D=\{0,1\}D={0,1}, RRR the 1-in-3 relation, f=g=idf=g=\mathrm{id}f=g=id satisfies every hypothesis except the existence of sss. No restriction is placed on sss beyond being a cyclic polymorphism; assuming idempotence or dependence on counts only would assume away the content (Remark 8.15).

Contributions welcome: proofs of the milestones, a general library of cyclic operations and their compositions, and a formalization of Theorem 8.3 or of the pp-power step, which would turn the core into Theorem 8.1 itself.

Selected references

  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, arXiv:1811.00970v3, 2019; J. ACM 68(4), 2021. https://arxiv.org/abs/1811.00970
  • L. Barto, M. Kozik, Absorbing subalgebras, cyclic terms, and the constraint satisfaction problem, Logical Methods in Computer Science 8(1:07), 2012. https://doi.org/10.2168/LMCS-8(1:7)2012
  • J. Brakensiek, V. Guruswami, Promise constraint satisfaction: structure theory and a symmetric Boolean dichotomy, SODA 2018. https://arxiv.org/abs/1704.01937
  • A. Bulatov, A dichotomy theorem for nonuniform CSPs, FOCS 2017. https://arxiv.org/abs/1703.03021
  • D. Zhuk, A proof of the CSP dichotomy conjecture, FOCS 2017; J. ACM 67(5), 2020. https://arxiv.org/abs/1704.01914
10 thms1 active userReviewed
AlgebraDiscrete Geometry·Captain: mikedeng1

Maximum Scattered Linear Sets and Complete Caps in Galois Spaces 2: For q = 2^t, t Even, and n ≥ 4 Even, AG(n, q) Has a Complete Cap of Size 2√(q^(n−1))Research Paper

Small complete caps in Galois spaces

A cap in an affine or projective space over a finite field is a set of points no three of which are collinear; a cap is complete when it is maximal with respect to inclusion, so that every point outside it lies on a line through two of its points. Caps are closely connected with error-correcting codes: projective caps can serve as parity-check columns for linear codes with minimum distance at least 4. Constructing small complete caps explicitly is a long-standing question in finite geometry; Giulietti's survey collects the known families.

Counting the lines through pairs of points gives the trivial lower bound

2⋅qn−1(1)\sqrt{2} \cdot \sqrt{q^{n-1}} \qquad (1)2​⋅qn−1​(1)

for the size of a complete cap in a Galois space of dimension nnn and order qqq. A short timeline:

  • Segre (1959) constructed complete caps of size 3q+23q + 23q+2 in PG(3,q)PG(3, q)PG(3,q), qqq even.
  • Pambianco and Storme (1996) generalized this to complete caps of size 2qs2q^s2qs in AG(2s+1,q)AG(2s+1, q)AG(2s+1,q), qqq even: bound (1) is sharp up to a constant in odd dimension, for even qqq.
  • Giulietti (2007) studied translation caps in AG(r,2t)AG(r, 2^t)AG(r,2t) and the doubling construction, which turns a translation cap of the largest possible size into a complete cap one dimension higher.
  • Bartoli, Giulietti, Marino and Polverino (arXiv 2015, Combinatorica 2017) proved that (1) is sharp up to a constant also in even dimension n≥4n \ge 4n≥4, when qqq is an even square. This mission formalizes that result.

Setting

Let q=2tq = 2^tq=2t and let Fq\mathbb F_qFq​ be the field with qqq elements. The affine space AG(r,q)AG(r, q)AG(r,q) has as points the vectors (a1,…,ar)∈Fqr(a_1, \dots, a_r) \in \mathbb F_q^r(a1​,…,ar​)∈Fqr​; three points are collinear when they lie on a common affine line over Fq\mathbb F_qFq​.

For an additive subgroup GGG of Fqr\mathbb F_q^rFqr​, KG\mathcal K_GKG​ is the set of points whose coordinate vectors lie in GGG. A translation cap is a cap of the form KG\mathcal K_GKG​. By Giulietti, Proposition 2.5, for t>1t > 1t>1 a translation cap has at most qr/2q^{r/2}qr/2 points; one attaining this bound is a maximal translation cap.

On the projective side, let V=F2trV = \mathbb F_{2^t}^rV=F2tr​, so that PG(V,F2t)=PG(r−1,2t)PG(V, \mathbb F_{2^t}) = PG(r-1, 2^t)PG(V,F2t​)=PG(r−1,2t). An F2\mathbb F_2F2​-subspace UUU of VVV (an additive subgroup) of F2\mathbb F_2F2​-dimension kkk, the rank, defines the F2\mathbb F_2F2​-linear set LU={⟨u⟩F2t:u∈U∖{0}}L_U = \{\langle u \rangle_{\mathbb F_{2^t}} : u \in U \setminus \{0\}\}LU​={⟨u⟩F2t​​:u∈U∖{0}}. It is scattered when every point ⟨u⟩\langle u\rangle⟨u⟩ meets UUU in exactly {0,u}\{0, u\}{0,u}, i.e. has weight one. A scattered linear set has rank at most rt/2rt/2rt/2 (Blokhuis–Lavrauw); one of rank 3t/23t/23t/2 in the plane PG(2,2t)PG(2, 2^t)PG(2,2t) is called maximum.

Formalization targets

Goal: Theorem 1.3

For q=2tq = 2^tq=2t, ttt even, and n≥4n \ge 4n≥4 even, there is a complete cap SSS in AG(n,q)AG(n, q)AG(n,q) with

∣S∣=2qn−1.|S| = 2\sqrt{q^{n-1}}.∣S∣=2qn−1​.

The exponent t(n−1)/2t(n-1)/2t(n−1)/2 is an integer because ttt is even.

Milestones

  1. Theorem 4.2 ([6, Lemma 2.1]): for qqq even, KG\mathcal K_GKG​ is a translation cap iff any two distinct non-zero vectors of GGG are Fq\mathbb F_qFq​-linearly independent.
  2. Proposition 4.3: for t>1t > 1t>1, LUL_ULU​ is a scattered F2\mathbb F_2F2​-linear set of PG(r−1,2t)PG(r-1, 2^t)PG(r−1,2t) iff KU\mathcal K_UKU​ is a translation cap of AG(r,2t)AG(r, 2^t)AG(r,2t).
  3. The bound of [6, Prop. 2.5]: a translation cap in AG(r,2t)AG(r, 2^t)AG(r,2t), t>1t > 1t>1, has at most qr/2q^{r/2}qr/2 points.
  4. Lemma 4.5 ([6, Prop. 2.8]): the product of maximal translation caps in AG(r,2t)AG(r, 2^t)AG(r,2t) and AG(rˉ,2t)AG(\bar r, 2^t)AG(rˉ,2t) is a maximal translation cap in AG(r+rˉ,2t)AG(r + \bar r, 2^t)AG(r+rˉ,2t).
  5. The parabola {(x,x2):x∈F2t}\{(x, x^2) : x \in \mathbb F_{2^t}\}{(x,x2):x∈F2t​} is a translation cap in AG(2,2t)AG(2, 2^t)AG(2,2t).
  6. Lemma 4.6 (doubling, [6, Cor. 2.12]): if KG\mathcal K_GKG​ is a maximal translation cap in AG(r,2t)AG(r, 2^t)AG(r,2t), then KG×{0,1}\mathcal K_{G \times \{0,1\}}KG×{0,1}​ is a complete cap in AG(r+1,2t)AG(r+1, 2^t)AG(r+1,2t).
  7. Proposition 4.7: a maximum scattered linear set in PG(2,q)PG(2, q)PG(2,q) yields a complete cap in AG(n,q)AG(n, q)AG(n,q) of size 2q(n−1)/22q^{(n-1)/2}2q(n−1)/2.
  8. The existence input, restated from Section 2: Lemma 2.8 and Proposition 2.9 (a suitable coefficient bbb), Theorem 2.10 (the scattered F2\mathbb F_2F2​-linear set {x2+bx22n+1+xω}\{x^2 + bx^{2^{2n+1}} + x\omega\}{x2+bx22n+1+xω} of rank 3n3n3n in PG(2,22n)PG(2, 2^{2n})PG(2,22n), covering t=2n≥4t = 2n \ge 4t=2n≥4), and the Baer-subplane case r=3r = 3r=3, t=2t = 2t=2 (covering q=4q = 4q=4).

Significance

Theorem 1.3 shows that the trivial bound (1) is sharp up to the factor 2\sqrt 22​ in even dimension n≥4n \ge 4n≥4 for every even square qqq, extending to even dimension what the constructions of Segre and Pambianco–Storme give in odd dimension. The construction supplies caps near the elementary size lower bound in a parameter range where the paper reports no comparably small infinite family. Remark 4.8 of the paper extends the construction to complete caps of comparable size in PG(n,q)PG(n, q)PG(n,q). The proof also establishes Proposition 4.3, a dictionary between scattered F2\mathbb F_2F2​-linear sets and translation caps, so that any new maximum scattered linear set yields new small complete caps.

The result is proved on paper; no machine-checked proof of it or of the cited results of [6] (Lemmas 4.5, 4.6 and the bound of Prop. 2.5, whose proofs are not in this paper) is known to exist. The mission produces a formal statement of Theorem 1.3, the cap–linear set correspondence, and formal statements of the three results the paper imports from [6].

Difficulty

Assembling Proposition 4.7 from the milestones is short. The difficulty lies in the inputs. The doubling construction requires showing that every point of AG(r+1,q)AG(r+1, q)AG(r+1,q) outside KG×{0,1}\mathcal K_{G\times\{0,1\}}KG×{0,1}​ lies on a secant, which uses the maximality ∣G∣=qr/2|G| = q^{r/2}∣G∣=qr/2 in a counting argument; it is cited from [6], not proved in the paper. The existence of a maximum scattered linear set in PG(2,2t)PG(2, 2^t)PG(2,2t) is the deep input: Lemma 2.8 needs a bound on the value set of a non-permutation polynomial (Turnwald) and a point count on a plane curve over F23n\mathbb F_{2^{3n}}F23n​. A tempting shortcut, taking any maximal cap obtained by greedy extension, gives a complete cap of unknown and generally much larger size; the content of the theorem is the exact size.

Formalization scope

  • AG(r,q)AG(r, q)AG(r,q) is Fin r → K for a finite field KKK with ∣K∣=2t|K| = 2^t∣K∣=2t; collinearity is Mathlib's affine Collinear K, over KKK itself. A complete cap is quantified against every point of AG(r,q)AG(r, q)AG(r,q).
  • Sizes are Set.ncard. The goal's size 2qn−12\sqrt{q^{n-1}}2qn−1​ is written 2⋅2t(n−1)/22\cdot 2^{t(n-1)/2}2⋅2t(n−1)/2 with natural-number division, exact because ttt is even; maximality of a translation cap is the squared form ∣S∣2=qr|S|^2 = q^r∣S∣2=qr, and the [6] bound is ∣S∣2≤qr|S|^2 \le q^r∣S∣2≤qr.
  • Scattered-ness is the weight-one condition "c u∈Uc\,u \in Ucu∈U, c∈F2tc \in \mathbb F_{2^t}c∈F2t​, u≠0u \ne 0u=0 imply c∈F2c \in \mathbb F_2c∈F2​"; rank kkk means ∣U∣=2k|U| = 2^k∣U∣=2k. "Maximum" in Proposition 4.7 is read as rank 3t/23t/23t/2, as in the first line of its proof.
  • In Section 2, F2m\mathbb F_{2^m}F2m​ is the fixed field of x↦x2mx \mapsto x^{2^m}x↦x2m inside EEE with ∣E∣=26n|E| = 2^{6n}∣E∣=26n; norms are explicit Frobenius products. ω\omegaω ranges over all of F22n∖F2n\mathbb F_{2^{2n}} \setminus \mathbb F_{2^n}F22n​∖F2n​ (the paper's standing ω\omegaω). Proposition 2.9 carries the standing assumption n≥2n \ge 2n≥2 of Section 2.
  • Lemmas 4.5, 4.6 and the [6] bound carry t>1t > 1t>1; for t=1t = 1t=1 every subset of AG(r,2)AG(r, 2)AG(r,2) is a cap and Lemma 4.6 fails.
  • Ruled out: stating the goal with ≤\le≤ or ≥\ge≥ in place of the exact size, or measuring collinearity over F2\mathbb F_2F2​ (over which every set is a cap), would make it trivial.
  • Citation basis: arXiv:1512.07467v1; all theorem numbers and pages refer to that version.

Welcome contributions: a general library of caps and translation caps in AG(r,q)AG(r, q)AG(r,q); the scattered-linear-set/translation-cap dictionary; a formalization of the doubling construction of [6]; transport of the F26n\mathbb F_{2^{6n}}F26n​-model of Theorem 2.10 to coordinates F22n3\mathbb F_{2^{2n}}^3F22n3​. The linear-set definitions mirror those of the companion mission on scattered linear sets and are reusable there.

Selected references

  • D. Bartoli, M. Giulietti, G. Marino, O. Polverino, Maximum scattered linear sets and complete caps in Galois spaces, arXiv:1512.07467v1, 2015; Combinatorica 37 (2017). arXiv:1512.07467v1
  • [3] A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • [6] M. Giulietti, Small complete caps in PG(N, q), q even, J. Combin. Des. 15(5) (2007), 420–436. https://doi.org/10.1002/jcd.20131
  • [7] M. Giulietti, The geometry of covering codes: small complete caps and saturating sets in Galois spaces, in Surveys in Combinatorics 2013, LMS Lecture Note Series 409, Cambridge University Press, 2013, pp. 51–90. https://doi.org/10.1017/CBO9781139506748.003
  • [17] F. Pambianco, L. Storme, Small complete caps in spaces of even characteristic, J. Combin. Theory Ser. A 75(1) (1996), 70–84. https://doi.org/10.1006/jcta.1996.0064
  • [19] B. Segre, On complete caps and ovaloids in three-dimensional Galois spaces of characteristic two, Acta Arith. 5 (1959), 315–332. https://doi.org/10.4064/aa-5-3-315-332
  • [20] G. Turnwald, A new criterion for permutation polynomials, Finite Fields Appl. 1 (1995), 64–82. https://doi.org/10.1006/ffta.1995.1005
14 thms1 active userReviewed
AlgebraDiscrete GeometryLinear algebra·Captain: mikedeng1

Maximum Scattered Linear Sets and Complete Caps in Galois Spaces 1: Scattered 𝔽_q-Linear Sets of Rank rt/2 Exist in PG(r − 1, q^t) for t Even, in Three Families of (q, t)Research Paper

Motivation

Linear sets are the main tool for building point sets with few intersection sizes in finite projective spaces: sets meeting every hyperplane, two-intersection sets, translation ovoids, and the geometric side of finite semifields and rank-metric codes (Polverino, 2010). Among them, scattered linear sets are those whose points all carry the smallest possible weight, and a scattered linear set of the largest possible rank is called maximum scattered. By Blokhuis and Lavrauw (2000), a maximum scattered linear set of PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) of rank rt/2rt/2rt/2 is a two-intersection set with respect to hyperplanes, so each one yields a two-weight code and a strongly regular graph.

Timeline.

  • 2000, Blokhuis–Lavrauw: the rank of a scattered Fq\mathbb F_qFq​-linear set of PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) is at most rt/2rt/2rt/2, and for rrr even this bound is attained.
  • 2000, Ball–Blokhuis–Lavrauw: examples of rank 666 in PG(2,q4)\mathrm{PG}(2,q^4)PG(2,q4).
  • Classical: for r=3r=3r=3, t=2t=2t=2 the bound 333 is attained by Baer subplanes.
  • 2000, Blokhuis–Lavrauw, Thm 4.4: existence (without explicit examples) for r>3r>3r>3, t=2t=2t=2, q=2q=2q=2 and for r≥3r\ge3r≥3, (t−1)∣r(t-1)\mid r(t−1)∣r, ttt even, q>2q>2q>2.
  • 2015, Bartoli, Giulietti, Marino and Polverino (arXiv:1512.07467v1, Combinatorica 37 (2017)): three explicit families in PG(2,q2n)\mathrm{PG}(2,q^{2n})PG(2,q2n) and, by direct sums, maximum scattered linear sets in PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) for ttt even in three families of (q,t)(q,t)(q,t). This mission formalizes that result; the companion mission formalizes the paper's application to complete caps.

Setting

Let qqq be a prime power, t≥1t\ge1t≥1, and let VVV be an rrr-dimensional vector space over Fqt\mathbb F_{q^t}Fqt​; PG(V,Fqt)=PG(r−1,qt)\mathrm{PG}(V,\mathbb F_{q^t})=\mathrm{PG}(r-1,q^t)PG(V,Fqt​)=PG(r−1,qt) has as points the spans ⟨v⟩Fqt\langle v\rangle_{\mathbb F_{q^t}}⟨v⟩Fqt​​ of nonzero v∈Vv\in Vv∈V. An Fq\mathbb F_qFq​-subspace U⊆VU\subseteq VU⊆V is a subset closed under addition and under multiplication by Fq\mathbb F_qFq​. It defines the Fq\mathbb F_qFq​-linear set

LU={⟨u⟩Fqt:u∈U∖{0}},L_U=\{\langle u\rangle_{\mathbb F_{q^t}} : u\in U\setminus\{0\}\},LU​={⟨u⟩Fqt​​:u∈U∖{0}},

whose rank is dim⁡FqU\dim_{\mathbb F_q}UdimFq​​U. A linear set comes paired with UUU, so every statement here is about UUU. The weight of a point ⟨v⟩\langle v\rangle⟨v⟩ is dim⁡Fq(⟨v⟩Fqt∩U)\dim_{\mathbb F_q}(\langle v\rangle_{\mathbb F_{q^t}}\cap U)dimFq​​(⟨v⟩Fqt​​∩U), and LUL_ULU​ is scattered when every point of LUL_ULU​ has weight 111; equivalently, for every nonzero u∈Uu\in Uu∈U,

λ∈Fqt, λu∈U ⟹ λ∈Fq.\lambda\in\mathbb F_{q^t},\ \lambda u\in U\ \Longrightarrow\ \lambda\in\mathbb F_q .λ∈Fqt​, λu∈U ⟹ λ∈Fq​.

The plane construction (§2). Fix n≥2n\ge2n≥2 and the field E=Fq6nE=\mathbb F_{q^{6n}}E=Fq6n​ with its subfields Fq⊆Fqn⊆Fq2n\mathbb F_q\subseteq\mathbb F_{q^n}\subseteq\mathbb F_{q^{2n}}Fq​⊆Fqn​⊆Fq2n​ and Fq3n\mathbb F_{q^{3n}}Fq3n​. As an Fq2n\mathbb F_{q^{2n}}Fq2n​-space EEE has dimension 333, so PG(E,Fq2n)=PG(2,q2n)\mathrm{PG}(E,\mathbb F_{q^{2n}})=\mathrm{PG}(2,q^{2n})PG(E,Fq2n​)=PG(2,q2n). For ω∈Fq2n∖Fqn\omega\in\mathbb F_{q^{2n}}\setminus\mathbb F_{q^n}ω∈Fq2n​∖Fqn​ and an Fq\mathbb F_qFq​-linear f:Fq3n→Fq3nf:\mathbb F_{q^{3n}}\to\mathbb F_{q^{3n}}f:Fq3n​→Fq3n​ the paper studies

Uf={f(x)+xω:x∈Fq3n},U_f=\{f(x)+x\omega : x\in\mathbb F_{q^{3n}}\},Uf​={f(x)+xω:x∈Fq3n​},

with fff a monomial axqiax^{q^i}axqi or a binomial fi,a,b(x)=axqi+bxq2n+if_{i,a,b}(x)=ax^{q^i}+bx^{q^{2n+i}}fi,a,b​(x)=axqi+bxq2n+i. The relative norms Nqm/qd(x)=∏j<m/dxqdjN_{q^m/q^d}(x)=\prod_{j<m/d}x^{q^{dj}}Nqm/qd​(x)=∏j<m/d​xqdj enter the hypotheses.

Formalization targets

Goal: Theorem 1.2 (p. 3)

For ttt even and r≥2r\ge2r≥2, in each of the cases (a) q=2q=2q=2, t≥4t\ge4t≥4; (b) t≢0(mod3)t\not\equiv0\pmod3t≡0(mod3); (c) q≡1(mod3)q\equiv1\pmod3q≡1(mod3), t≡0(mod3)t\equiv0\pmod3t≡0(mod3),

∃ U⊆Fqt r  Fq-subspace:dim⁡FqU=rt2,LU scattered.\exists\,U\subseteq\mathbb F_{q^t}^{\,r}\ \ \mathbb F_q\text{-subspace}:\qquad \dim_{\mathbb F_q}U=\frac{rt}{2},\quad L_U\ \text{scattered}.∃U⊆Fqtr​  Fq​-subspace:dimFq​​U=2rt​,LU​ scattered.

Milestones, in proof order

  • Proposition 2.1 (p. 5): UfU_fUf​ has rank 3n3n3n, and LUfL_{U_f}LUf​​ is scattered iff Qf∩Fq2n=FqQ_f\cap\mathbb F_{q^{2n}}=\mathbb F_qQf​∩Fq2n​=Fq​, where QfQ_fQf​ is the set of quotients f(x)+xωf(y)+yω\frac{f(x)+x\omega}{f(y)+y\omega}f(y)+yωf(x)+xω​, y≠0y\ne0y=0.
  • Proposition 2.2 (p. 6): the same criterion through the polynomial system (5)–(6).
  • Theorems 2.3, 2.4 (pp. 7, 9): the monomial families, for n≢0(mod3)n\not\equiv0\pmod 3n≡0(mod3) and for q≡1(mod3)q\equiv1\pmod3q≡1(mod3).
  • Theorem 2.5 (p. 10): existence in PG(2,q2n)\mathrm{PG}(2,q^{2n})PG(2,q2n) in those two regimes.
  • Lemma 2.6 (p. 11): φ(x)/x\varphi(x)/xφ(x)/x and φˉ(x)/x\bar\varphi(x)/xφˉ​(x)/x have the same image, where φˉ\bar\varphiφˉ​ is the trace adjoint.
  • Proposition 2.7, Lemma 2.8, Proposition 2.9, Theorem 2.10 (pp. 12–16): the binomial family for q=2q=2q=2.
  • Theorem 3.1 (p. 16): direct sums of scattered linear sets are scattered, of rank rt/2rt/2rt/2 iff each summand has rank sit/2s_it/2si​t/2.
  • The line example (p. 2, cited from Lavrauw's thesis) and the Baer-subplane case r=3r=3r=3, t=2t=2t=2 (p. 3).

Significance

Theorem 1.2 gives maximum scattered linear sets, and hence two-intersection sets, two-weight codes and strongly regular graphs, for infinitely many (q,t)(q,t)(q,t) with rrr odd, a regime where earlier existence results covered only a few values of ttt. The q=2q=2q=2 case feeds the paper's second main result: scattered F2\mathbb F_2F2​-linear sets of PG(2,2t)\mathrm{PG}(2,2^t)PG(2,2t) of rank 3t/23t/23t/2 are translation caps, from which complete caps of size 2q n−12\sqrt{q^{\,n-1}}2qn−1​ in AG(n,q)\mathrm{AG}(n,q)AG(n,q) are built.

All statements are proved in the preprint; none has a machine-checked proof. Formalizing them requires a usable theory of subfields of a finite field as Frobenius fixed fields, relative norms and their images, linearized polynomials and their trace adjoints, and the passage between Fq\mathbb F_qFq​-dimension, cardinality and weight. Each of these is reusable for later work on linear sets, MRD codes and semifields.

Difficulty

The criterion of Proposition 2.2 reduces scatteredness to a polynomial system, but the system has to be solved for a specific fff. For the monomials this rests on the solvability of zqi−1=cz^{q^i-1}=czqi−1=c in Fq3n\mathbb F_{q^{3n}}Fq3n​, a norm condition interacting with the gcd hypotheses. For the binomial with q=2q=2q=2, the existence of a suitable bbb (Lemma 2.8) needs a value-set bound for non-permutation polynomials (Turnwald, 1995) and a point count on a plane curve. The higher-dimensional statement then needs the elementary bound dim⁡U≤st/2\dim U\le st/2dimU≤st/2 for scattered UUU to obtain the rank equivalence in Theorem 3.1. A tempting shortcut, taking U=Fq rU=\mathbb F_q^{\,r}U=Fqr​ or any small subspace, is scattered but has the wrong rank; the content is in the rank rt/2rt/2rt/2.

Formalization scope

  • Citation basis. arXiv:1512.07467v1; page numbers equal PDF pages.
  • Fields. Fqm⊆E\mathbb F_{q^m}\subseteq EFqm​⊆E is the fixed field of x↦xqmx\mapsto x^{q^m}x↦xqm in a finite field EEE of characteristic ppp with ∣E∣=q6n|E|=q^{6n}∣E∣=q6n, q=phq=p^hq=ph. Norms and traces are explicit Frobenius products and sums.
  • Subspaces and rank. An Fq\mathbb F_qFq​-subspace is a carrier set with closure conditions. Rank kkk is ∣U∣=qk|U|=q^k∣U∣=qk; in Theorem 3.1 rank rt/2rt/2rt/2 is ∣W∣2=qrt|W|^2=q^{rt}∣W∣2=qrt.
  • Points. Scatteredness takes the spanning field as an argument: Fq2n\mathbb F_{q^{2n}}Fq2n​ in §2, the whole Fqt\mathbb F_{q^t}Fqt​ in Theorem 1.2 and §3. PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) is modelled on Fin r → K; the plane of §2 on EEE itself.
  • Pinned readings.
    • Theorem 1.2 prints no range for rrr. The preceding sentence and the proof (p. 17) say r≥5r\ge5r≥5, and r=1r=1r=1 is false. The goal assumes r≥2r\ge2r≥2, covered by the line example (r=2r=2r=2), §2 with the Baer case (r=3r=3r=3) and Theorem 3.1 (r≥4r\ge4r≥4).
    • ω\omegaω is quantified over all of Fq2n∖Fqn\mathbb F_{q^{2n}}\setminus\mathbb F_{q^n}Fq2n​∖Fqn​.
    • The index ranges 1≤i≤3n−11\le i\le3n-11≤i≤3n−1 (monomial) and 2n+i≤3n−12n+i\le3n-12n+i≤3n−1 (binomial) come from the case headings on pp. 7 and 10.
    • Proposition 2.7's printed "wxwxwx" is ωx\omega xωx.
    • Theorem 2.10 keeps its printed hypothesis N23n/2n(b)≠1N_{2^{3n}/2^n}(b)\ne1N23n/2n​(b)=1.
    • Theorem 3.1's rank clause assumes t≥2t\ge2t≥2; for t=1t=1t=1 it is false.
  • Ruled out. Taking the span over EEE or over Fq\mathbb F_qFq​, or dropping the rank, would make the statements false or trivial; every existence statement fixes the rank, and the span field is explicit.
  • Contributions welcome. Frobenius-fixed-field cardinalities, norm surjectivity, the criteria of Propositions 2.1–2.2, the monomial and binomial families, and the direct-sum rank computation.

Selected references

  • D. Bartoli, M. Giulietti, G. Marino, O. Polverino, Maximum scattered linear sets and complete caps in Galois spaces, arXiv:1512.07467v1 (2015); Combinatorica 37 (2017). https://arxiv.org/abs/1512.07467, https://doi.org/10.1007/s00493-016-3531-6
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. 310 (2010), 3096–3107. https://doi.org/10.1016/j.disc.2010.04.007
  • S. Ball, A. Blokhuis, M. Lavrauw, Linear (q + 1)-fold blocking sets in PG(2, q⁴), Finite Fields Appl. 6 (2000), 294–301.
  • M. Lavrauw, Scattered Spaces with respect to Spreads and Eggs in Finite Projective Spaces, Ph.D. thesis, TU Eindhoven, 2001.
  • G. Turnwald, A new criterion for permutation polynomials, Finite Fields Appl. 1 (1995), 64–82.
15 thms1 active userReviewed
Graph TheoryTheoretical Computer Science·Captain: mikedeng1

Generation and Properties of Snarks 3: A Snark on 26 Vertices All of Whose 2-Factors Consist of Odd Cycles Refutes the Abreu–Labbate–Sheehan ConjectureResearch Paper

Motivation

A cubic graph has chromatic index 3 or 4 (Vizing). Cubic graphs of chromatic index 4 — the uncolourable ones — are where most of the open problems on cubic graphs live: a minimal counterexample to the cycle double cover conjecture or to Tutte's 5-flow conjecture would be among them. Uncolourable graphs with small edge cuts or short cycles reduce to smaller ones, so attention concentrates on snarks, the uncolourable cubic graphs that are cyclically 4-edge connected and have girth at least 5.

Brinkmann, Goedgebeur, Hägglund and Markström (arXiv:1206.6690v3, J. Combin. Theory Ser. B 103, 2013) generated all snarks on up to 36 vertices and tested a series of published conjectures against them. One of these concerns the 2-factors of a snark, its spanning subgraphs in which every vertex has degree 2. A 3-edge-colouring of a cubic graph gives 2-factors made of even cycles, so a snark is a graph in which some 2-factors are forced to contain odd cycles. At the far end are the snarks in which every 2-factor consists of odd cycles only. Abreu, Labbate and Sheehan (European J. Combin. 33, 2012), studying pseudo and strongly pseudo 2-factor isomorphic graphs, conjectured that this happens only for the Petersen graph, the Blanuša-2 snark and the Flower snarks (paper, p. 11, Conjecture 4.11).

Timeline:

  • 2012: Abreu, Labbate and Sheehan state the conjecture.
  • 2012–2013: Brinkmann, Goedgebeur, Hägglund and Markström refute it with a snark on 26 vertices, printed in Appendix 8.1 of their paper (p. 29); by computer search they report it is the smallest counterexample and that one more exists on 34 vertices (Observation 4.12).

Setting

All graphs are finite and simple. A graph GGG is cubic if every vertex has degree 3. It is colourable if its edges can be coloured with three colours so that edges sharing an endpoint get different colours, and uncolourable otherwise. The girth g(G)g(G)g(G) is the number of vertices of a shortest cycle. GGG is cyclically kkk-edge connected if deleting fewer than kkk edges never leaves two components that both contain a cycle. A snark is an uncolourable, cyclically 4-edge connected cubic graph with g(G)≥5g(G) \ge 5g(G)≥5 (paper, p. 4).

A 2-factor of GGG is a spanning 2-regular subgraph FFF: it uses every vertex, and every vertex has degree exactly 2 in FFF. Each component of FFF is a cycle. Say that all 2-factors of GGG are odd if every component of every 2-factor of GGG has an odd number of vertices.

The witness is the graph G8.1G_{8.1}G8.1​ of Appendix 8.1, given in the paper as a list of higher-numbered neighbours of the vertices 1,…,261, \dots, 261,…,26:

{2,3,4,5,6,7,8,9,10,7,9,8,10,11,12,13,14,15,16,15,17,18,19,18,20,18,21,22,21,23,23,24,22,24,25,26,26,25,26}.\{2, 3, 4, 5, 6, 7, 8, 9, 10, 7, 9, 8, 10, 11, 12, 13, 14, 15, 16, 15, 17, 18, 19, 18, 20, 18, 21, 22, 21, 23, 23, 24, 22, 24, 25, 26, 26, 25, 26\}.{2,3,4,5,6,7,8,9,10,7,9,8,10,11,12,13,14,15,16,15,17,18,19,18,20,18,21,22,21,23,23,24,22,24,25,26,26,25,26}.

It has 26 vertices and 39 edges. In Lean it is G81 : SimpleGraph (Fin 26) with paper vertex iii as i−1i-1i−1.

Formalization targets

Goal: Observation 4.12, existence half

G8.1 is a snarkandevery 2-factor of G8.1 consists of odd cycles.G_{8.1} \text{ is a snark} \quad\text{and}\quad \text{every 2-factor of } G_{8.1} \text{ consists of odd cycles.}G8.1​ is a snarkandevery 2-factor of G8.1​ consists of odd cycles.

Because G8.1G_{8.1}G8.1​ has 26 vertices, it is not the Petersen graph (10 vertices), not the Blanuša-2 snark (18) and not a Flower snark JkJ_kJk​ (4k4k4k vertices). The goal therefore refutes Conjecture 4.11 without formalizing the conjecture's list of exceptions.

Milestones

The goal splits into five properties of the one graph G8.1G_{8.1}G8.1​:

  1. G8.1G_{8.1}G8.1​ is cubic;
  2. g(G8.1)≥5g(G_{8.1}) \ge 5g(G8.1​)≥5;
  3. G8.1G_{8.1}G8.1​ is cyclically 4-edge connected;
  4. every 2-factor of G8.1G_{8.1}G8.1​ consists of odd cycles;
  5. G8.1G_{8.1}G8.1​ is uncolourable.

A supporting statement, not from the paper, asserts that G8.1G_{8.1}G8.1​ has a 2-factor, so that milestone 4 is not vacuous.

Significance

The result. Conjecture 4.11 would have characterised a natural extremal class of snarks by a short explicit list. The counterexample shows that the class is not that list: there are snarks outside the Petersen, Blanuša-2 and Flower families in which no 2-factor contains an even cycle. Such graphs are relevant to questions about 2-factor structure, oddness and cycle double covers, where the parity of 2-factor cycles is exactly what the arguments track.

Formalizing it. The result is proved in the paper by exhibiting the graph and checking it by computer; it has not been machine-checked in a proof assistant. A formal proof certifies every property of the printed graph — including that the printed adjacency list decodes to a graph with these properties — and leaves a reusable library of definitions (snarks, cyclic edge connectivity, 2-factors) that other snark statements can import.

Difficulty

Each property is a finite check, but some are large. Cubicity and girth are local. Cyclic 4-edge connectivity quantifies over all sets of at most three of the 39 edges (about ten thousand) and needs, for each, a component analysis of the remaining graph. The odd-2-factor property quantifies over all 2-factors; in a cubic graph these are the complements of the perfect matchings, and G8.1G_{8.1}G8.1​ has 56 perfect matchings. The obvious route — decide over all subgraphs — is out of reach: there are 2392^{39}239 edge subsets, and the statement is phrased through Mathlib's ConnectedComponent and IsRegularOfDegree, which do not evaluate by kernel computation at this size. Uncolourability has the same problem: the naive search space has 3393^{39}339 colourings.

Formalization scope

Conventions committed to:

  • Vertices are Fin 26, paper vertex iii = Lean vertex i−1i-1i−1; adjacency is the symmetric closure of an explicit edge list G81Edges, so it is decidable.
  • Colourable means G.lineGraph.Colorable 3 (a proper 3-edge-colouring), never G.Colorable 3.
  • Girth is Mathlib's egirth : ℕ∞, so "girth at least 5" is 5 ≤ G.egirth.
  • A 2-factor is a graph F on the same vertex type with F ≤ G and F.IsRegularOfDegree 2 — spanning by construction. Oddness is per component: Odd (Nat.card c.supp) for every component c. It is not the parity of the whole vertex set (26 is even).
  • Cyclic kkk-edge connectivity: for every edge set S with S.card < k, any two components of G.deleteEdges S that both contain a cycle are equal.

The odd-2-factor property is vacuous for a graph without 2-factors. The goal is not trivialised this way: G8.1G_{8.1}G8.1​ has 2-factors, and a supporting theorem states it.

Out of scope, because they rest on exhaustive computer enumeration: that G8.1G_{8.1}G8.1​ is the smallest counterexample, that there is exactly one further counterexample on 34 vertices, Observation 4.10 (all snarks on at most 36 vertices have oddness 2), and Tables 4 and 5. The Petersen graph, the Blanuša-2 snark and the Flower snarks are not defined here; the refutation uses only their orders.

Contributions welcome: proofs of any milestone; general lemmas linking 2-factors of cubic graphs to perfect matchings, and 3-edge-colourings to even 2-factors; decision procedures for cyclic edge connectivity of explicit graphs. The definitions are shared in shape with the other missions of this series and are meant to be reused.

Selected references

  • G. Brinkmann, J. Goedgebeur, J. Hägglund, K. Markström, Generation and properties of snarks, arXiv:1206.6690v3, 2013; J. Combin. Theory Ser. B 103 (2013). https://arxiv.org/abs/1206.6690v3 , https://doi.org/10.1016/j.jctb.2013.05.001
  • M. Abreu, D. Labbate, J. Sheehan, Pseudo and strongly pseudo 2-factor isomorphic regular graphs and digraphs, European J. Combin. 33 (2012), no. 8, 1847–1856. https://mathscinet.ams.org/mathscinet-getitem?mr=2950486
  • G. Brinkmann, K. Coolsaet, J. Goedgebeur, H. Mélot, House of Graphs: a database of interesting graphs, Discrete Appl. Math. 161 (2013), 311–314. https://mathscinet.ams.org/mathscinet-getitem?mr=2973372
12 thms1 active userReviewed
Graph TheoryTheoretical Computer Science·Captain: mikedeng1

Generation and Properties of Snarks 2: A Cyclically 5-Edge-Connected Permutation Snark on 34 Vertices Refutes Zhang's Conjecture That Only the Petersen Graph Is OneResearch Paper

Motivation

A snark is a cubic graph that cannot be properly edge-coloured with three colours and that does not reduce to a smaller such graph. Snarks are the smallest possible counterexamples to several central conjectures about cubic graphs, among them the cycle double cover conjecture, Tutte's 5-flow conjecture and the Berge–Fulkerson conjecture, so structural statements about snarks narrow the search for counterexamples to those conjectures.

Permutation graphs are cubic graphs built from two disjoint cycles of equal length joined by a perfect matching, so that the two cycles are induced. The Petersen graph is the classical example: its outer 5-cycle and inner pentagram are joined by five spokes. In his monograph Integer Flows and Cycle Covers of Graphs (1997), C.-Q. Zhang conjectured that the Petersen graph is the only permutation snark that is also cyclically 5-edge connected.

Brinkmann, Goedgebeur, Hägglund and Markström (arXiv:1206.6690v3, J. Combin. Theory Ser. B 103, 2013) built a generator for snarks and enumerated all snarks up to 36 vertices. Among them they found twelve cyclically 5-edge-connected permutation snarks on 34 vertices, which refute Zhang's conjecture (Observation 4.2), and they printed all twelve in Appendix 8.6 of the paper. This mission formalizes the refutation using the first of those graphs.

Setting

All graphs are finite and simple. A cycle is a 2-regular connected graph. A graph is cubic if every vertex has degree 3. A 2-factor of GGG is a spanning 2-regular subgraph. The girth g(G)g(G)g(G) is the number of vertices in a shortest cycle of GGG.

A cubic graph is colourable if it has a proper 3-edge-colouring: a map c:E(G)→{1,2,3}c : E(G) \to \{1,2,3\}c:E(G)→{1,2,3} giving distinct colours to distinct edges with a common endpoint. Otherwise it is uncolourable.

A graph GGG is cyclically kkk-edge connected if deleting fewer than kkk edges from GGG never leaves two distinct components that both contain a cycle.

A snark is an uncolourable, cyclically 4-edge connected cubic graph with g(G)≥5g(G) \ge 5g(G)≥5.

A cubic graph is a permutation graph if it has a 2-factor consisting of two induced cycles. Equivalently, its vertex set splits as A∪(V∖A)A \cup (V \setminus A)A∪(V∖A) with both induced subgraphs G[A]G[A]G[A] and G[V∖A]G[V \setminus A]G[V∖A] cycles. A permutation snark is a snark that is a permutation graph.

The Petersen graph PPP is the graph on {0,…,9}\{0,\dots,9\}{0,…,9} with the outer cycle i∼i+1(mod5)i \sim i+1 \pmod 5i∼i+1(mod5), the spokes i∼i+5i \sim i+5i∼i+5, and the inner pentagram 5+i∼5+((i+2) mod 5)5+i \sim 5+((i+2) \bmod 5)5+i∼5+((i+2)mod5).

Zhang's Conjecture 4.1. Let GGG be a cubic cyclically 5-edge-connected permutation graph. If GGG is a snark, then GGG must be the Petersen graph.

The witness G1G_1G1​ is the first graph in Appendix 8.6 (p. 36). It is given as a list of higher-numbered neighbours of the vertices 1,…,341,\dots,341,…,34; decoded, it has 51 edges. In the Lean development the paper's vertex iii is i - 1 : Fin 34.

Formalization targets

Goal: Observation 4.2, first sentence

¬ ZhangConjecture,\neg\,\mathrm{ZhangConjecture},¬ZhangConjecture,

that is, there is a finite cubic, cyclically 5-edge connected permutation snark that is not isomorphic to the Petersen graph. This is SnarkGen.Zhang.observation_4_2.

Milestones: the properties of G1G_1G1​

Each milestone is a property of G1G_1G1​ asserted by the heading of Appendix 8.6, "The 12 cyclically 5-edge connected permutation snarks on 34 vertices":

  1. G1G_1G1​ is cubic;
  2. g(G1)≥5g(G_1) \ge 5g(G1​)≥5;
  3. G1G_1G1​ is cyclically 5-edge connected;
  4. G1G_1G1​ is a permutation graph;
  5. G1G_1G1​ is uncolourable;
  6. G1G_1G1​ is a snark;
  7. G1G_1G1​ satisfies all hypotheses of Conjecture 4.1 and G1≇PG_1 \not\cong PG1​≅P.

The goal follows from milestone 7 directly. Two supporting theorems are included: cyclic kkk-edge connectivity is monotone in kkk, and the paper's remark (p. 9) that every permutation snark has order ≡2(mod4)\equiv 2 \pmod 4≡2(mod4).

Significance

Zhang's conjecture predicted that the Petersen graph is isolated among highly connected permutation snarks. Its refutation shows that this is false, and the twelve 34-vertex graphs went on to serve as counterexamples to further conjectures in the same paper (Conjectures 5.17, 5.20 and 5.21, about cycle double covers containing a prescribed 2-factor). They are also listed in the House of Graphs database.

The refutation in the paper is a computer result: the graphs were found by an exhaustive search, and their properties were checked by programs. A formal proof would replace that check with a machine-verified one that is independent of the generator. It would also produce reusable certified tools for finite cubic graphs: a kernel-checked test for uncolourability, cyclic edge connectivity, and girth. No machine-checked proof of any of these properties of G1G_1G1​ is known to exist.

Difficulty

The statements are short, but none of the properties of G1G_1G1​ follows from a general theorem; each must be checked on the specific graph. The obvious approach, to unfold the definitions and let a decision procedure enumerate, does not scale:

  • Uncolourability quantifies over all 3513^{51}351 edge colourings.
  • Cyclic 5-edge connectivity quantifies over all edge sets of size at most 4 (about 270,000 of them among 51 edges), and for each one over the components of the remaining graph and the cycles inside them.
  • The permutation structure requires exhibiting the two induced 17-cycles and proving that each induced subgraph is connected and 2-regular.
  • Girth requires ruling out all cycles of length 3 and 4.

The definitions are stated in terms of Mathlib's general notions (line graphs, walks, connected components), not in terms of a computable representation. Connecting them to an efficient computation is the main work.

Formalization scope

Graphs are SimpleGraph V with [Fintype V]. The conventions are as follows.

  • "Colourable" is G.lineGraph.Colorable 3, a proper 3-colouring of the line graph. It is not a vertex colouring of GGG.
  • Cyclic kkk-edge connectivity quantifies over finite edge sets S ⊆ G.edgeSet with S.card < k. Components and cycles are taken in G.deleteEdges S.
  • Girth is 5 ≤ G.egirth, the extended girth, which is ∞\infty∞ for acyclic graphs.
  • Degrees in the general predicates use classical decidability. Any other decidability instance gives the same degrees.
  • The conjecture quantifies over all finite vertex types in Type and reads "must be the Petersen graph" as Nonempty (H ≃g petersen).

The conjecture keeps every printed hypothesis, including the redundant "cubic". Dropping "permutation graph" or "cyclically 5-edge connected" would make the refutation easier, since other cyclically 5-edge-connected snarks are known. The cyclic connectivity must be computed in the graph after deletion and must require both components to contain a cycle; otherwise it degenerates into ordinary edge connectivity, which is at most 3 for cubic graphs and would make the conjecture vacuous.

Proofs should be checked by the Lean kernel. The decision procedures for colourability and cyclic connectivity are the reusable part of this mission, and contributions that build them for arbitrary finite cubic graphs are welcome.

Out of scope.

  • The second and third sentences of Observation 4.2 ("The smallest counterexamples have 34 vertices, and there are exactly 12 counterexamples of that order"). They rest on an exhaustive enumeration of all snarks up to 36 vertices.
  • The other eleven graphs of Appendix 8.6.
  • Conjectures 5.17, 5.20 and 5.21. Their refutation needs the "no cycle double cover contains this 2-factor" certificate of Observation 5.18.
  • The counts in Table 3.

Selected references

  • G. Brinkmann, J. Goedgebeur, J. Hägglund, K. Markström, Generation and properties of snarks, arXiv:1206.6690v3, 2013; J. Combin. Theory Ser. B 103 (2013). https://arxiv.org/abs/1206.6690v3
  • C.-Q. Zhang, Integer Flows and Cycle Covers of Graphs, Monographs and Textbooks in Pure and Applied Mathematics 205, Marcel Dekker, 1997.
  • G. Brinkmann, K. Coolsaet, J. Goedgebeur, H. Mélot, House of Graphs: a database of interesting graphs, Discrete Appl. Math. 161 (2013), 311–314. https://doi.org/10.1016/j.dam.2012.07.018
15 thms1 active userReviewed
Graph TheoryTheoretical Computer Science·Captain: mikedeng1

Generation and Properties of Snarks 1: Inserting an Edge Between Two Edges of One Bicoloured Cycle of a 3-Edge-Coloured Cubic Graph Yields a 3-Edge-Colourable GraphResearch Paper

Motivation

A snark is an uncolourable, cyclically 4-edge-connected cubic graph of girth at least 5: a cubic graph whose edges cannot be properly coloured with three colours, and which is not reducible to a smaller such graph by an elementary operation. Snarks are the critical cases for several of the central conjectures of graph theory, among them the cycle double cover conjecture, Tutte's 5-flow conjecture and the Berge–Fulkerson conjecture: a minimal counterexample to any of them, if one exists, is a snark. Lists of all small snarks are therefore used to test such conjectures by computer.

Brinkmann, Goedgebeur, Hägglund and Markström (arXiv:1206.6690v3, 2013) generated all snarks on up to 36 vertices. Testing 3-edge-colourability is NP-complete, and only a vanishing fraction of cubic graphs are snarks (0.00044% of the cubic graphs of girth at least 5 on 28 vertices, p. 4), so the generation algorithm needs cheap criteria that recognise, before a graph is built, that it will be colourable and can be skipped. Section 3.1 of the paper supplies such a criterion for the last construction step, and this mission formalizes it.

Setting

All graphs are finite and simple. A graph is cubic if every vertex has degree 3. A 3-colouring of a graph G=(V,E)G=(V,E)G=(V,E) is a map C:E→{0,1,2}C:E\to\{0,1,2\}C:E→{0,1,2} that gives different colours to any two distinct edges sharing an end-vertex; GGG is colourable if it has one, i.e. its chromatic index satisfies χ′(G)≤3\chi'(G)\le 3χ′(G)≤3 (p. 2, Isaacs' terminology).

A 2-factor of GGG is a spanning 2-regular subgraph FFF (p. 4); each connected component of FFF is a cycle. FFF is an even 2-factor if all its cycles have even length (p. 5). For a 3-colouring CCC and colours i≠ji\ne ji=j, write GijG_{ij}Gij​ for the spanning subgraph whose edges are those coloured iii or jjj.

The edge insertion operation (Figure 1(d), p. 5) takes two distinct edges e=abe=abe=ab and e′=cde'=cde′=cd of GGG, which may share an end-vertex, subdivides eee by a new vertex xxx and e′e'e′ by a new vertex yyy, and adds the edge xyxyxy. The resulting graph G′G'G′ has vertex set V∪{x,y}V\cup\{x,y\}V∪{x,y} and edge set

E(G′)=(E∖{e,e′})∪{ax,xb,cy,yd,xy}.E(G')=\bigl(E\setminus\{e,e'\}\bigr)\cup\{ax,xb,cy,yd,xy\}.E(G′)=(E∖{e,e′})∪{ax,xb,cy,yd,xy}.

If GGG is cubic, so is G′G'G′. In the generation algorithm every graph of girth at least 4 is produced from a graph with two fewer vertices by this operation.

Formalization targets

Goal: Theorem 3.3 (p. 5)

Let GGG be a cubic graph with a 3-colouring CCC, let i≠ji\ne ji=j be colours, and let e=abe=abe=ab, e′=cde'=cde′=cd be distinct edges of GijG_{ij}Gij​ lying on the same cycle of GijG_{ij}Gij​. Then

χ′(G′)≤3,G′=G with an edge inserted between e and e′.\chi'(G')\le 3,\qquad G' = G \text{ with an edge inserted between } e \text{ and } e'.χ′(G′)≤3,G′=G with an edge inserted between e and e′.

Milestones

  1. Lemma 3.1 (p. 5). For a cubic graph GGG,
χ′(G)≤3  ⟺  G has an even 2-factor.\chi'(G)\le 3 \iff G \text{ has an even 2-factor.}χ′(G)≤3⟺G has an even 2-factor.
  1. The two-colour observation (§3.1, p. 5). If GGG is cubic, CCC is a 3-colouring and i≠ji\ne ji=j, then GijG_{ij}Gij​ is an even 2-factor of GGG.
  2. Lemma 3.2 (p. 5). If FFF is an even 2-factor of a cubic graph GGG and e≠e′e\ne e'e=e′ are edges of FFF on the same cycle of FFF, then the graph obtained by inserting an edge between eee and e′e'e′ is colourable.

Supporting statement (not on the goal's path)

Theorem 3.4 (p. 6, stated as folklore without proof). If GGG is a colourable cubic graph and the inserted edge xyxyxy lies on a 4-cycle of G′G'G′, then G′G'G′ is colourable.

Significance

The result. Theorem 3.3 is the look-ahead of the snark generator: one 3-colouring of a graph on n−2n-2n−2 vertices excludes, at once, every pair of edges lying on a common cycle of one of its three bicoloured 2-factors. For 28 vertices the first colouring alone discards on average 85% of the candidate edge pairs (p. 6), and the overall ratio of weak snarks among generated graphs on the last level improves by a factor of 85 (p. 4). The enumeration of all snarks up to 36 vertices, on which the paper's counterexamples and statistics rest, depends on this pruning being sound: a wrong pruning rule would silently delete snarks from the lists. Theorem 3.4 is a second pruning rule of the same kind.

Formalizing it. The results are proved (Lemma 3.1 is classical; the paper gives the argument for Lemma 3.2 in one sentence and for Theorem 3.3 by combination). None of them, and no statement about 3-edge-colourings of cubic graphs and their 2-factors, is formalized on the platform. The mission produces a machine-checked soundness proof of the pruning criterion and, along the way, a reusable development of the equivalence between 3-edge-colourings and even 2-factors in Lean's SimpleGraph library. Theorem 3.4 has no proof in the paper.

Difficulty

The combinatorial content is short; the difficulty lies in graph-theoretic infrastructure that Mathlib does not have. Lemma 3.1 relates a global object (a proper colouring of all edges) to the cycle structure of a spanning 2-regular subgraph, and either direction needs the description of a finite 2-regular graph as a disjoint union of cycles together with parity information along each cycle. Mathlib has walks, cycles and connected components, but no decomposition of a 2-regular graph into cycles and no notion of the length of a component as a cycle.

Lemma 3.2 and Theorem 3.3 change the vertex type: G′G'G′ lives on V⊔{x,y}V\sqcup\{x,y\}V⊔{x,y}, so 2-factors, connected components and cycle lengths must be transported from GGG to G′G'G′, and the case where eee and e′e'e′ share an end-vertex (allowed by Figure 1(d)) has to be handled alongside the generic one. A first idea, to extend a given 3-colouring of GGG directly to G′G'G′, does not work in general: the colours forced on the edges at xxx and yyy by the old colours of eee and e′e'e′ can conflict, and the hypothesis "same cycle" is what has to be used to avoid the conflict.

Formalization scope

Vertices form a type V with [Fintype V] [DecidableEq V]; graphs are SimpleGraph V with decidable adjacency, and "cubic" is Mathlib's G.IsRegularOfDegree 3. Colourability is G.lineGraph.Colorable 3 (an edge colouring, not a vertex colouring), and a 3-colouring is G.lineGraph.Coloring (Fin 3). A 2-factor is a graph F on the same vertex type with F ≤ G and F.IsRegularOfDegree 2; it is even if every connected component has an even number of vertices (Nat.card). The edge insertion operation produces a graph on V ⊕ Fin 2, with Sum.inr 0 subdividing eee and Sum.inr 1 subdividing e′e'e′; edges are unordered pairs Sym2 V. "On the same cycle" is encoded as membership of both edges in the 2-factor plus reachability of their end-vertices inside the 2-factor. Oddness is not defined as a number; Lemma 3.1 is stated in its second form.

Dropping "on the same cycle" would make Theorem 3.3 and Lemma 3.2 false (inserting edges between different cycles of a bicoloured 2-factor is exactly how snarks are produced), and both statements require the two edges to be distinct; a formalization without either hypothesis is ruled out. Every statement assumes cubicity, without which Lemma 3.1 fails.

Out of scope: the algorithmic content of §3 (isomorphism rejection, the look-ahead implementation, recolouring along non-hamiltonian cycles, the 85% / 11% / 3.4% statistics), the generation counts, and every exhaustive-search claim of the paper. The remaining results of the paper are covered by three sibling missions of this series.

Reusable beyond this mission: the 2-factor and even-2-factor definitions, the two-colour 2-factor of an edge colouring, and Lemma 3.1 itself. Contributions welcome: the cycle decomposition of finite 2-regular graphs, alternating colourings of even cycles, and a proof of Theorem 3.4.

Selected references

  • G. Brinkmann, J. Goedgebeur, J. Hägglund, K. Markström, Generation and properties of snarks, J. Combin. Theory Ser. B 103 (2013); arXiv:1206.6690v3. https://arxiv.org/abs/1206.6690
  • R. Isaacs, Infinite families of nontrivial trivalent graphs which are not Tait colorable, Amer. Math. Monthly 82 (1975) 221–239. https://doi.org/10.2307/2319844
8 thms1 active userReviewed
Machine LearningProbabilityTheoretical Computer Science·Captain: mikedeng1

A Learning Theory Approach to Non-Interactive Database Privacy 2: An ε-Differentially Private Mechanism Useful on Databases of Size at Most VCDIM(C)/2 Has Error α ≥ Ω(1/(4+16ε))Research Paper

Motivation

A data curator holds a database of nnn records and wants to publish answers to a large family of statistical questions about it without revealing any individual record. Differential privacy (Dwork, McSherry, Nissim, Smith 2006) makes the requirement precise, and the most basic questions are counting queries: what fraction of the records satisfy a given predicate? Blum, Ligett and Roth (arXiv:1109.2229, JACM 2013) showed that a single private release can answer every query of a class CCC to error α\alphaα once the database has size roughly log⁡∣X∣⋅VCDIM(C)/(α3ϵ)\log|X| \cdot \mathrm{VCDIM}(C)/(\alpha^3\epsilon)log∣X∣⋅VCDIM(C)/(α3ϵ), so that the sample size depends on the class only through its VC-dimension, a quantity from learning theory.

This mission formalizes the converse in §3.1 of that paper: the dependence on the VC-dimension cannot be removed. On databases of fewer than VCDIM(C)/2\mathrm{VCDIM}(C)/2VCDIM(C)/2 records, every differentially private mechanism has constant error on some query of CCC. The argument is an early instance of the reconstruction attack idea of Dinur and Nissim (2003): accurate answers to many counting queries determine the database, and a mechanism that determines its input cannot be private.

Setting

Let XXX be a set (the data universe). An input database of size nnn is a tuple z=(z1,…,zn)∈Xnz = (z_1,\dots,z_n) \in X^nz=(z1​,…,zn​)∈Xn. A predicate is a map φ:X→{0,1}\varphi : X \to \{0,1\}φ:X→{0,1}, and its counting query is

Qφ(z)=1n #{i:φ(zi)=1}.Q_\varphi(z) = \frac{1}{n}\,\#\{i : \varphi(z_i) = 1\}.Qφ​(z)=n1​#{i:φ(zi​)=1}.

A class CCC of predicates is identified with its class of counting queries. A finite set S⊆XS \subseteq XS⊆X is shattered by CCC if every function S→{0,1}S \to \{0,1\}S→{0,1} is the restriction of some φ∈C\varphi \in Cφ∈C; the VC-dimension VCDIM(C)∈N∪{∞}\mathrm{VCDIM}(C) \in \mathbb N \cup \{\infty\}VCDIM(C)∈N∪{∞} is the supremum of the sizes of shattered sets.

A mechanism MMM maps each input z∈Xnz \in X^nz∈Xn to a probability distribution M(z)M(z)M(z) on an output space OOO; an output ooo is read through an answer map ans(o,φ)∈R\mathrm{ans}(o, \varphi) \in \mathbb Rans(o,φ)∈R. Two inputs are neighbours if they differ in exactly one entry. The mechanism is ϵ\epsilonϵ-differentially private if M(z)(E)≤eϵM(z′)(E)M(z)(E) \le e^{\epsilon} M(z')(E)M(z)(E)≤eϵM(z′)(E) for all neighbours z,z′z, z'z,z′ and all measurable events EEE. It is (α,δ)(\alpha,\delta)(α,δ)-useful for CCC if for every input zzz, with probability at least 1−δ1-\delta1−δ over o∼M(z)o \sim M(z)o∼M(z), every query is answered to within α\alphaα:

∀φ∈C:∣ans(o,φ)−Qφ(z)∣≤α.\forall \varphi \in C:\quad |\mathrm{ans}(o,\varphi) - Q_\varphi(z)| \le \alpha .∀φ∈C:∣ans(o,φ)−Qφ​(z)∣≤α.

In the paper the output is a synthetic database D^\hat DD^ and ans(D^,φ)=Qφ(D^)\mathrm{ans}(\hat D,\varphi) = Q_\varphi(\hat D)ans(D^,φ)=Qφ​(D^).

Formalization targets

Goal: Theorem 3.11 (p. 11)

There is an absolute constant c>0c > 0c>0 such that for every universe XXX, class CCC, size n≥1n \ge 1n≥1 with n≤VCDIM(C)/2n \le \mathrm{VCDIM}(C)/2n≤VCDIM(C)/2, 0≤ϵ≤10 \le \epsilon \le 10≤ϵ≤1 and 0<δ≤1/40 < \delta \le 1/40<δ≤1/4: every ϵ\epsilonϵ-differentially private mechanism that is (α,δ)(\alpha,\delta)(α,δ)-useful for CCC on databases of size nnn satisfies

α ≥ c4+16ϵ.\alpha \ \ge\ \frac{c}{4 + 16\epsilon}.α ≥ 4+16ϵc​.

Milestones

  1. Lemma 3.12. For a set SSS of size ddd and the family DS\mathcal D_SDS​ of its subsets of size d/2d/2d/2, and QTQ_TQT​ the counting query of a predicate equal to the indicator of TTT on SSS: QT(T)−QT(T′)=∣TΔT′∣/dQ_T(T) - Q_T(T') = |T\Delta T'|/dQT​(T)−QT​(T′)=∣TΔT′∣/d for T,T′∈DST, T' \in \mathcal D_ST,T′∈DS​.
  2. Lemma 3.13. For an (α,δ)(\alpha,\delta)(α,δ)-useful mechanism, a fixed procedure recovers from M(T)M(T)M(T) a set T′∈DST' \in \mathcal D_ST′∈DS​ with ∣T′ΔT∣≤2dα|T'\Delta T| \le 2d\alpha∣T′ΔT∣≤2dα, with probability at least 1−δ1-\delta1−δ.
  3. The final inequality of the proof (p. 12), with δ\deltaδ kept. Under the goal's hypotheses with 0<δ<10 < \delta < 10<δ<1 and any ϵ\epsilonϵ:
(1−δ)(1−2α) ≤ eϵ(δ+2α).(1-\delta)(1-2\alpha) \ \le\ e^{\epsilon}(\delta + 2\alpha).(1−δ)(1−2α) ≤ eϵ(δ+2α).

Significance

Theorem 3.11 shows that the VC-dimension term in the paper's upper bound is necessary: for a class of VC-dimension ddd, no private mechanism is accurate on databases of size below d/2d/2d/2, whatever its running time. It thereby locates the sample complexity of private query release between VCDIM(C)\mathrm{VCDIM}(C)VCDIM(C) and VCDIM(C)⋅log⁡∣X∣\mathrm{VCDIM}(C)\cdot\log|X|VCDIM(C)⋅log∣X∣ up to accuracy and privacy factors, a gap that later work on private learning and on fingerprinting codes studied in detail (Bun, Ullman, Vadhan 2014).

The theorem is proved in the paper; to the best of current knowledge it has no machine-checked proof. Formalizing it produces a checked reconstruction-attack lower bound for differential privacy, together with the corrected statement disclosed below: the printed proof drops the failure probability δ\deltaδ of the two reconstructions, and keeping it shows that the conclusion requires δ\deltaδ below 1/(1+eϵ)1/(1+e^{\epsilon})1/(1+eϵ), not merely "bounded away from 1". Milestone 3 records the inequality the argument actually yields.

Difficulty

The combinatorial core (Lemmas 3.12 and 3.13) is elementary. The difficulty lies in the last step, which compares the output distributions on two different inputs. The paper argues about a uniformly random T∈DST \in \mathcal D_ST∈DS​, a random element x∈Tx \in Tx∈T and a random y∉Ty \notin Ty∈/T, and the swapped set T^=(T∖{x})∪{y}\hat T = (T\setminus\{x\})\cup\{y\}T^=(T∖{x})∪{y}. Privacy applies to one fixed pair of neighbouring inputs and one fixed event, while the reconstruction guarantee only controls ∣T′ΔT∣|T'\Delta T|∣T′ΔT∣, not whether a particular element is recovered. The "probabilities" Pr⁡[x∈T′]\Pr[x \in T']Pr[x∈T′] of the printed proof mix the mechanism's randomness with the random choice of TTT, xxx, yyy, and they are not the probability of any single event under any single M(z)M(z)M(z), so the privacy inequality cannot be applied to them as written. The reconstruction event must also be measurable, which depends on the readout, and the failure probability δ\deltaδ must be carried through both reconstructions. A proof that sets δ=0\delta = 0δ=0, as the printed one does, does not prove the stated theorem.

Formalization scope

  • Databases. Inputs are Fin n → X with n≥1n \ge 1n≥1; the empty database is excluded because every mechanism is private on it and Qφ=0/0Q_\varphi = 0/0Qφ​=0/0 there. In the proof, a set T∈DST \in \mathcal D_ST∈DS​ is given to the mechanism as any injective listing of its elements.
  • Neighbours. The paper's "∣DΔD′∣≤1|D\Delta D'| \le 1∣DΔD′∣≤1" for databases of equal size is read as replacing one entry (PrivLearn.Generic.Neighbors); read literally, it would make every mechanism private and the theorem false. Under this reading TTT and T^\hat TT^ are neighbours, so the paper's factor e2ϵe^{2\epsilon}e2ϵ becomes eϵe^{\epsilon}eϵ.
  • Mechanisms. The output space is an arbitrary measurable space and answers are read through ans. Synthetic-data mechanisms are the special case O=O = O= databases, so the lower bound covers a larger class of mechanisms. The hypotheses require IsProbabilityMeasure (M z) and the measurability of o ↦ ans o φ for φ∈C\varphi \in Cφ∈C. Without the first, the zero measure is private; without the second, a mechanism into a trivial σ\sigmaσ-algebra would be private and "useful".
  • Ω and the range of δ. The paper writes α≥Ω(1/(4+16ϵ))\alpha \ge \Omega(1/(4+16\epsilon))α≥Ω(1/(4+16ϵ)) for "0<δ<10<\delta<10<δ<1 bounded away from 1 by a constant". The Lean goal quantifies one absolute constant c>0c > 0c>0 before every other binder and assumes 0<δ≤1/40 < \delta \le 1/40<δ≤1/4. The proof gives α≥((1−δ)−eϵδ)/(2(1−δ+eϵ))\alpha \ge ((1-\delta) - e^{\epsilon}\delta)/(2(1-\delta+e^{\epsilon}))α≥((1−δ)−eϵδ)/(2(1−δ+eϵ)), which is positive only for δ<1/(1+eϵ)\delta < 1/(1+e^{\epsilon})δ<1/(1+eϵ) (about 0.270.270.27 at ϵ=1\epsilon=1ϵ=1). The hypotheses ϵ≤1\epsilon \le 1ϵ≤1 and n≤VCDIM(C)/2n \le \mathrm{VCDIM}(C)/2n≤VCDIM(C)/2 are the paper's, the latter written 2n≤VCDIM(C)2n \le \mathrm{VCDIM}(C)2n≤VCDIM(C) in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞}.
  • Ruled out. The statement quantifies over every mechanism satisfying the hypotheses, randomized or not, so no restriction to deterministic or constant-output mechanisms makes the bound easy. The usefulness event is weighed by a probability measure, so the zero measure cannot be "useful". The constant cannot depend on nnn, ddd, XXX or CCC.
  • Infrastructure. The development reuses the published PrivLearn.Generic.Privacy (neighbours, IsDP) and Vershynin's HighDimProb.Chaining.Shatters and vcDim. Contributions needed: subsets of shattered sets are shattered, and 2n≤VCDIM(C)2n \le \mathrm{VCDIM}(C)2n≤VCDIM(C) yields a shattered set of size exactly 2n2n2n; measurability of the argmin reconstruction; the averaging/bijection argument. The first two are reusable beyond this mission.

Selected references

  • A. Blum, K. Ligett, A. Roth, A Learning Theory Approach to Non-Interactive Database Privacy, arXiv:1109.2229v1 (2011); J. ACM 60(2), 2013. https://arxiv.org/abs/1109.2229 , https://doi.org/10.1145/2450142.2450148
  • C. Dwork, F. McSherry, K. Nissim, A. Smith, Calibrating Noise to Sensitivity in Private Data Analysis, TCC 2006. https://doi.org/10.1007/11681878_14
  • I. Dinur, K. Nissim, Revealing Information while Preserving Privacy, PODS 2003. https://doi.org/10.1145/773153.773173
  • M. Bun, J. Ullman, S. Vadhan, Fingerprinting Codes and the Price of Approximate Differential Privacy, STOC 2014. https://arxiv.org/abs/1311.3158
  • R. Vershynin, High-Dimensional Probability, Cambridge University Press, 2018, §8.3 (VC dimension). https://doi.org/10.1017/9781108231596
9 thms1 active userReviewed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

Matroid Prophet Inequalities 2: On an Intersection of p Matroids, the Summed-Threshold Algorithm Earns at Least 1/(4p−2) of the Expected OptimumResearch Paper

Motivation

A prophet inequality compares a gambler who sees independent random rewards one at a time, and must accept or reject each on arrival, with a prophet who sees all rewards in advance. The classical inequality of Krengel, Sucheston and Garling (1977–78, as cited in the paper) says that when only one reward may be kept, a single threshold rule earns at least half of E[max⁡iXi]\mathbb E[\max_i X_i]E[maxi​Xi​], and Samuel-Cahn (1984) showed that the threshold can be chosen as a median. Such statements are the analytical core of sequential posted-price mechanisms: Hajiaghayi, Kleinberg and Sandholm (2007) observed that threshold rules are truthful online auctions, and Chawla, Hartline, Malec and Sivan (2010) showed that sequential posted prices approximate the optimal Bayesian revenue in many settings, with prophet inequalities for the feasibility constraint as the key technique.

When several items may be accepted subject to a combinatorial constraint, the natural constraints in this application are matroids (for example, at most kkk items, or at most one item per group) and intersections of matroids (for example, bipartite matchings, which are intersections of two partition matroids). Kleinberg and Weinberg (STOC 2012) proved that for every matroid there is an online algorithm with expected payoff at least half of the expected maximum-weight basis, and that for the intersection of ppp matroids the summed version of the same algorithm earns at least 14p−2\frac{1}{4p-2}4p−21​ of the expected optimum. This mission formalizes the second result.

Timeline:

  • 1977–78: Krengel–Sucheston and Garling, single-choice prophet inequality with factor 2.
  • 1984: Samuel-Cahn, the median threshold rule attains factor 2.
  • 2007: Hajiaghayi–Kleinberg–Sandholm, threshold rules from prophet inequalities read as truthful online auction mechanisms.
  • 2010: Chawla–Hartline–Malec–Sivan, sequential posted pricing; factor 2 for matroids when the algorithm may choose the order in which elements are observed.
  • 2012: Kleinberg–Weinberg, factor 2 for matroids and 4p−24p-24p−2 for intersections of ppp matroids, against online weight-adaptive adversaries.

Setting

A finite ground set U\mathcal UU carries p≥1p \ge 1p≥1 matroids M1,…,Mp\mathcal M_1,\dots,\mathcal M_pM1​,…,Mp​ with independent sets I1,…,Ip\mathcal I_1,\dots,\mathcal I_pI1​,…,Ip​ and closure operators cl1,…,clp\mathrm{cl}_1,\dots,\mathrm{cl}_pcl1​,…,clp​. A set is feasible if it lies in I=⋂jIj\mathcal I = \bigcap_j \mathcal I_jI=⋂j​Ij​. Each element xxx has a random weight w(x)≥0w(x) \ge 0w(x)≥0; the weights are independent and w(x)w(x)w(x) has law FxF_xFx​. For a set SSS, w(S)=∑x∈Sw(x)w(S) = \sum_{x \in S} w(x)w(S)=∑x∈S​w(x), OPT(w)=max⁡{w(S):S∈I}\mathrm{OPT}(w) = \max\{w(S) : S \in \mathcal I\}OPT(w)=max{w(S):S∈I}, and OPT=E[OPT(w)]\mathrm{OPT} = \mathbb E[\mathrm{OPT}(w)]OPT=E[OPT(w)].

An online weight-adaptive adversary reveals the elements one at a time; it chooses the iii-th element xix_ixi​ after learning w(x1),…,w(xi−1)w(x_1),\dots,w(x_{i-1})w(x1​),…,w(xi−1​), but without knowing w(xi)w(x_i)w(xi​) or any other unrevealed weight. A threshold algorithm offers xix_ixi​ a threshold TiT_iTi​ computed from what has been revealed and from the set Ai−1A_{i-1}Ai−1​ already selected, and selects xix_ixi​ exactly when Ai−1∪{xi}∈IA_{i-1}\cup\{x_i\}\in\mathcal IAi−1​∪{xi​}∈I and w(xi)≥Tiw(x_i) \ge T_iw(xi​)≥Ti​.

The algorithm of the paper uses a ghost sample w′w'w′, an independent copy of www. Let BBB be a w′w'w′-maximum feasible set. For a set AAA and each jjj, Rj(A)⊆B∖AR_j(A) \subseteq B \setminus ARj​(A)⊆B∖A is a set of maximum w′w'w′-weight with A∪Rj(A)∈IjA \cup R_j(A) \in \mathcal I_jA∪Rj​(A)∈Ij​ and B⊆clj(A∪Rj(A))B \subseteq \mathrm{cl}_j(A \cup R_j(A))B⊆clj​(A∪Rj​(A)), and Cj(A)=B∖Rj(A)C_j(A) = B \setminus R_j(A)Cj​(A)=B∖Rj​(A). Put R(A)=⋂jRj(A)R(A) = \bigcap_j R_j(A)R(A)=⋂j​Rj​(A) and C(A)=⋃jCj(A)C(A) = \bigcup_j C_j(A)C(A)=⋃j​Cj​(A). For a parameter α\alphaα, the summed thresholds are

T(A,i)=∑j=1p1α Ew′[w′(Rj(A))−w′(Rj(A∪{xi}))],T(A,i) = \sum_{j=1}^p \frac1\alpha\, \mathbb E_{w'}\big[w'(R_j(A)) - w'(R_j(A \cup \{x_i\}))\big],T(A,i)=j=1∑p​α1​Ew′​[w′(Rj​(A))−w′(Rj​(A∪{xi​}))],

and the algorithm of §4.2 uses Ti=T(Ai−1,i)T_i = T(A_{i-1}, i)Ti​=T(Ai−1​,i). An algorithm has α\alphaα-balanced thresholds (Definition 3) if, for every input sequence with selected set AAA and every VVV disjoint from AAA with A∪V∈IA \cup V \in \mathcal IA∪V∈I,

∑xi∈ATi≥1αE[∑jw′(Cj(A))],∑xi∈VTi≤1αE[∑jw′(Rj(A))].\sum_{x_i\in A} T_i \ge \frac1\alpha \mathbb E\Big[\sum_j w'(C_j(A))\Big], \qquad \sum_{x_i\in V} T_i \le \frac1\alpha \mathbb E\Big[\sum_j w'(R_j(A))\Big].xi​∈A∑​Ti​≥α1​E[j∑​w′(Cj​(A))],xi​∈V∑​Ti​≤α1​E[j∑​w′(Rj​(A))].

Formalization targets

Goal: the prophet inequality for ppp matroids

For every p≥1p \ge 1p≥1, all matroids M1,…,Mp\mathcal M_1,\dots,\mathcal M_pM1​,…,Mp​ on U\mathcal UU, all laws FxF_xFx​ on [0,∞)[0,\infty)[0,∞) with finite means, and every online weight-adaptive adversary, the algorithm of §4.2 with α=2p\alpha = 2pα=2p selects a set AAA with

E[w(A)]≥14p−2 E[OPT(w)].\mathbb E[w(A)] \ge \frac{1}{4p-2}\, \mathbb E[\mathrm{OPT}(w)].E[w(A)]≥4p−21​E[OPT(w)].

For p=1p = 1p=1 this is the factor-2 matroid prophet inequality.

Proposition 3

If a threshold algorithm has α\alphaα-balanced thresholds for some α≥2\alpha \ge 2α≥2, then against every online weight-adaptive adversary

E[w(A)]≥α−pα(α−1) OPT.\mathbb E[w(A)] \ge \frac{\alpha - p}{\alpha(\alpha-1)}\, \mathrm{OPT}.E[w(A)]≥α(α−1)α−p​OPT.

Milestones

Proposition 2 for each matroid Mj\mathcal M_jMj​; the identity between the two forms of T(A,i,j)T(A,i,j)T(A,i,j); properties (13) and (14) for the summed thresholds; the identities (20)–(21); and the inequalities (23)–(24) of Appendix A. Together with Proposition 3 these give the goal.

Significance

The bound gives a posted-price style selection rule for any feasibility constraint that is an intersection of ppp matroids, with a guarantee depending only on ppp; the paper's §5 shows that a ratio of order ppp is necessary. Section 6 of the paper turns the result into sequential posted-price mechanisms for multi-dimensional mechanism design, and that application needs the guarantee against the online weight-adaptive adversary, not only against a fixed order. The reduction "balanced thresholds imply an approximation" (Proposition 3) is reusable for other threshold constructions.

The result is proved in the paper; to our knowledge no machine-checked proof exists. The mission produces a formal proof of the 14p−2\frac{1}{4p-2}4p−21​ guarantee, with the probabilistic part (the ghost-sample argument against an adaptive adversary) and the combinatorial part (the per-matroid exchange inequality) as separate milestones. The paper justifies the per-matroid use of Proposition 2 in one paragraph; because BBB maximizes w′w'w′ over the intersection rather than over Ij\mathcal I_jIj​, the description of Rj(A)R_j(A)Rj​(A) as a maximum-weight basis of a contraction (Lemma 2 in the single-matroid case) does not apply verbatim, and the formal proof of that milestone is not a copy of the paper's single-matroid argument.

Difficulty

Two steps do not follow from routine bookkeeping. First, the inequality (23) compares the gambler's surplus, collected along an order that the adversary adapts to the realized weights, with the ghost sample's surplus on the random set R(A)R(A)R(A). The index xix_ixi​ revealed at step iii is itself random, so the step "the weight of the element offered next is distributed as its ghost weight" has to be justified for an adaptively chosen index under a product measure; it fails for an adversary that may look at unrevealed weights. Second, the paper obtains (14) by applying the single-matroid Proposition 2 to each Mj\mathcal M_jMj​, but its proof of Proposition 2 describes R(A)R(A)R(A) as a maximum-weight basis of a contraction, which uses that BBB is optimal for the matroid in question. Here BBB is optimal only for the intersection I\mathcal II, so the obvious transfer of the single-matroid argument does not go through as written and the per-matroid statement needs its own proof.

Formalization scope

The ground set is a Fintype; the matroids are Mathlib's Matroid α, indexed by Fin p, each with ground set Set.univ; sets are Finset α. Weights are functions α → ℝ, the weight law is Measure.pi F, and every theorem assumes each F x is a probability measure with F x (Iio 0) = 0 and a finite mean. Expectations are Bochner integrals; under these assumptions every integrand is integrable. Ties in the maximizers BBB and Rj(A)R_j(A)Rj​(A) are broken by a fixed rule that does not depend on the weights. Rj(A)R_j(A)Rj​(A) is taken disjoint from AAA. The threshold ∞\infty∞ on infeasible steps is a feasibility test in the selection rule. Adversaries and generic threshold rules are deterministic, see only revealed weights, and are measurable in them; randomized adversaries are mixtures of deterministic ones. Generic thresholds in Proposition 3, (23) and (24) are non-negative, as in the paper's Ti∈R+∪{∞}T_i \in \mathbb R_+ \cup \{\infty\}Ti​∈R+​∪{∞}.

The goal fixes the thresholds to the summed thresholds of §4.2 with α=2p\alpha = 2pα=2p, computed from the ghost-sample objects. A version in which the thresholds are free parameters assumed to satisfy (13)–(14) would be Proposition 3 itself and is ruled out; conversely, Proposition 3 does not mention the §4.2 thresholds.

A complete development needs: elementary facts about maximizers over finite families; matroid exchange properties (a bijective exchange between equal-size independent sets, available in Schrijver's book but not in Mathlib); submodularity of weighted-rank-type functions; and the independence argument for adaptively chosen indices under a product measure. The last two are reusable beyond this mission, as is Proposition 3. Proofs of individual milestones and of these auxiliary facts are welcome.

Selected references

  • R. Kleinberg, S. M. Weinberg, Matroid Prophet Inequalities, STOC 2012; arXiv:1201.4764v1. https://arxiv.org/abs/1201.4764, https://doi.org/10.1145/2213977.2213991
  • U. Krengel, L. Sucheston, Semiamarts and finite values, Bull. Amer. Math. Soc. 83 (1977), 745–747.
  • E. Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Ann. Probab. 12 (1984). https://doi.org/10.1214/aop/1176993150
  • M. T. Hajiaghayi, R. Kleinberg, T. Sandholm, Automated online mechanism design and prophet inequalities, Proc. 22nd AAAI Conference on Artificial Intelligence, 2007, pp. 58–65.
  • S. Chawla, J. Hartline, D. Malec, B. Sivan, Multi-parameter mechanism design and sequential posted pricing, STOC 2010, pp. 311–320; arXiv:0907.2435. https://arxiv.org/abs/0907.2435
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer 2003 (Corollary 39.12a).
12 thms1 active userReviewed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

Matroid Prophet Inequalities 1: Against Any Online Weight-Adaptive Adversary, the 2-Balanced Threshold Algorithm Earns at Least Half the Expected Max-Weight BasisResearch Paper

Motivation

The prophet inequality of optimal stopping compares a gambler, who sees independent non-negative random values X1,…,XnX_1, \dots, X_nX1​,…,Xn​ one at a time and must accept or reject each on arrival, with a prophet who sees them all in advance. Krengel, Sucheston and Garling showed that the gambler can secure E[Xτ]≥12 E[max⁡iXi]\mathbb E[X_\tau] \ge \tfrac12\,\mathbb E[\max_i X_i]E[Xτ​]≥21​E[maxi​Xi​], and Samuel-Cahn showed that a single threshold suffices. Since Hajiaghayi, Kleinberg and Sandholm (2007) and Chawla, Hartline, Malec and Sivan (2010), prophet inequalities have served as the approximation guarantees of sequential posted-price mechanisms: an online selection rule with a prophet guarantee turns into a truthful mechanism with a revenue guarantee.

The natural multi-choice generalization lets the gambler accept a set of elements, subject to a feasibility constraint. Kleinberg and Weinberg, Matroid Prophet Inequalities (STOC 2012, arXiv:1201.4764), proved that when the feasible sets are the independent sets of a matroid, the factor 12\tfrac1221​ is still achievable, by an explicit threshold rule, and even when the order of arrival is chosen adaptively by an adversary.

Timeline:

  • 1977–78: Krengel and Sucheston, with Garling: the single-choice prophet inequality with factor 12\tfrac1221​, which is tight.
  • 1984: Samuel-Cahn: a single fixed threshold attains 12\tfrac1221​.
  • 2007: Hajiaghayi, Kleinberg, Sandholm: prophet inequalities read as truthful online auctions, with multi-choice prophet inequalities.
  • 2010: Chawla, Hartline, Malec, Sivan: posted-price mechanisms via prophet inequalities, and factor 12\tfrac1221​ for matroids when the algorithm may choose the order of arrival.
  • 2012: Kleinberg–Weinberg: factor 12\tfrac1221​ for every matroid against an online weight-adaptive adversary, and 14p−2\tfrac1{4p-2}4p−21​ for intersections of ppp matroids.

Setting

Let U\mathcal UU be a finite ground set and M=(U,I)\mathcal M = (\mathcal U, \mathcal I)M=(U,I) a matroid; I\mathcal II is its family of independent sets. For each x∈Ux \in \mathcal Ux∈U a distribution FxF_xFx​ on [0,∞)[0,\infty)[0,∞) is given; the weights w(x)w(x)w(x) are independent with w(x)∼Fxw(x) \sim F_xw(x)∼Fx​, and w(A)=∑x∈Aw(x)w(A) = \sum_{x \in A} w(x)w(A)=∑x∈A​w(x). Let OPT(w)=max⁡{w(S):S∈I}\mathrm{OPT}(w) = \max\{w(S) : S \in \mathcal I\}OPT(w)=max{w(S):S∈I} and OPT=E[OPT(w)]\mathrm{OPT} = \mathbb E[\mathrm{OPT}(w)]OPT=E[OPT(w)].

An online weight-adaptive adversary reveals the elements one at a time: it picks xix_ixi​ knowing w(x1),…,w(xi−1)w(x_1), \dots, w(x_{i-1})w(x1​),…,w(xi−1​) but not w(xi)w(x_i)w(xi​). An online algorithm maintains a selected set Ai−1∈IA_{i-1} \in \mathcal IAi−1​∈I and, when xix_ixi​ arrives with its weight, irrevocably accepts or rejects it, keeping AiA_iAi​ independent. A threshold rule offers xix_ixi​ a threshold TiT_iTi​ computed from the revealed prefix (and Ti=∞T_i = \inftyTi​=∞ when Ai−1∪{xi}∉IA_{i-1} \cup \{x_i\} \notin \mathcal IAi−1​∪{xi​}∈/I) and accepts iff w(xi)≥Tiw(x_i) \ge T_iw(xi​)≥Ti​.

The algorithm of the paper uses a ghost sample: an independent copy w′w'w′ of the weights. Let BBB be a w′w'w′-maximum-weight basis. For an independent set AAA, among the partitions B=C⊔RB = C \sqcup RB=C⊔R with R∩A=∅R \cap A = \emptysetR∩A=∅ and A∪RA \cup RA∪R a basis, R(A)R(A)R(A), C(A)C(A)C(A) denote one maximizing w′(R)w'(R)w′(R). The algorithm (9) sets

Ti=12 Ew′[w′(R(Ai−1))−w′(R(Ai−1∪{xi}))].T_i = \tfrac12\,\mathbb E_{w'}\big[w'(R(A_{i-1})) - w'(R(A_{i-1}\cup\{x_i\}))\big].Ti​=21​Ew′​[w′(R(Ai−1​))−w′(R(Ai−1​∪{xi​}))].

Formalization targets

Goal: the matroid prophet inequality

For every matroid on a finite ground set, every family of distributions FxF_xFx​ on [0,∞)[0,\infty)[0,∞) with finite means, and every online weight-adaptive adversary, the set AAA selected by the algorithm (9) satisfies

E[w(A)]  ≥  12 OPT.\mathbb E[w(A)] \;\ge\; \tfrac12\,\mathrm{OPT}.E[w(A)]≥21​OPT.

The goal is stated for the paper's own algorithm, which is stronger than the existence statement of §3.

Milestones

  1. Proposition 1 (with Definition 1): any threshold rule with α\alphaα-balanced thresholds,
∑xi∈ATi≥1α E[w′(C(A))],∑xi∈VTi≤(1−1α) E[w′(R(A))],\sum_{x_i\in A} T_i \ge \tfrac1\alpha\,\mathbb E[w'(C(A))], \qquad \sum_{x_i\in V} T_i \le \big(1-\tfrac1\alpha\big)\,\mathbb E[w'(R(A))],xi​∈A∑​Ti​≥α1​E[w′(C(A))],xi​∈V∑​Ti​≤(1−α1​)E[w′(R(A))],

earns E[w(A)]≥1α OPT\mathbb E[w(A)] \ge \tfrac1\alpha\,\mathrm{OPT}E[w(A)]≥α1​OPT. 2. The identity behind (9) = (10), and the telescoping identity ∑xi∈ATi=12 E[w′(C(A))]\sum_{x_i \in A} T_i = \tfrac12\,\mathbb E[w'(C(A))]∑xi​∈A​Ti​=21​E[w′(C(A))] (Property (2) for α=2\alpha = 2α=2). 3. Lemma 1 (bijective basis exchange, and its weighted form), Lemma 2 (R(A)R(A)R(A) is a maximum-weight basis of the contraction M/A\mathcal M/AM/A), Lemma 3 (S↦w′(R(S))S \mapsto w'(R(S))S↦w′(R(S)) is submodular on subsets of an independent set). 4. Inequalities (11) and (12), and Proposition 2:

∑xi∈V[w′(R(Ai−1))−w′(R(Ai−1∪{xi}))]≤w′(R(A)),\sum_{x_i \in V}\big[w'(R(A_{i-1})) - w'(R(A_{i-1}\cup\{x_i\}))\big] \le w'(R(A)),xi​∈V∑​[w′(R(Ai−1​))−w′(R(Ai−1​∪{xi​}))]≤w′(R(A)),

pointwise in w′≥0w' \ge 0w′≥0; then Property (3) with α=2\alpha = 2α=2 for the thresholds (9).

Significance

The theorem gives the optimal constant: already for a rank-one matroid (choose one element) no online algorithm beats 12\tfrac1221​. It covers every matroid with one algorithm, including uniform, partition, graphic and transversal matroids, which model capacity, unit-demand and spanning-tree constraints. Through the reduction of Chawla et al., the paper derives from it order-oblivious posted-price mechanisms that are 2-approximations to the optimal revenue in single-parameter settings with matroid feasibility and, through the adaptive adversary, in multi-dimensional unit-demand settings (§6 of the paper). The decomposition through α\alphaα-balanced thresholds is reused in the paper for intersections of ppp matroids, with factor 14p−2\tfrac1{4p-2}4p−21​.

The result has been proved since 2012; it has not been formalized. The mission produces a machine-checked development of the model (online adaptive adversaries, threshold rules, the ghost-sample expectations), of the general reduction (Proposition 1), and of the matroid facts the algorithm relies on, notably the bijective exchange lemma (Schrijver, Corollary 39.12a), which is not in Mathlib.

Difficulty

The obvious argument fixes the order of arrival and compares the algorithm with the prophet item by item. It fails here because the order is chosen adaptively from the revealed weights, so the set of elements still to come is random and correlated with the past. The proof must instead compare the algorithm's realized selection with a ghost optimum BBB built from an independent sample, and bound the value the algorithm forgoes by the value the ghost optimum could still add, E[w′(R(A))]\mathbb E[w'(R(A))]E[w′(R(A))]. The step that needs matroid structure is Property (3): the total threshold offered to any set VVV that could still be added must be at most half of E[w′(R(A))]\mathbb E[w'(R(A))]E[w′(R(A))]. The thresholds were computed along the history A0⊆A1⊆…A_0 \subseteq A_1 \subseteq \dotsA0​⊆A1​⊆…, not at the final AAA, so the bound requires the submodularity of S↦w′(R(S))S \mapsto w'(R(S))S↦w′(R(S)) (Lemma 3) and a weight-dominating exchange between VVV and R(A)R(A)R(A) in the contraction M/A\mathcal M/AM/A. Neither holds for general downward-closed families.

Formalization scope

  • The ground set is a Fintype α; the matroid is Mathlib's Matroid α with ground set Set.univ; sets are Finset α; contraction is Matroid.contract.
  • The distributions are F : α → Measure ℝ, probability measures with F x (Set.Iio 0) = 0 (support in [0,∞)[0,\infty)[0,∞)) and Integrable id (F x) (finite means). The weight law is Measure.pi F, and every expectation is a Bochner integral over it. Finite means make OPT(w)\mathrm{OPT}(w)OPT(w), w(A)w(A)w(A) and the integrands of the thresholds integrable, so no expectation is a junk value.
  • OPT(w)\mathrm{OPT}(w)OPT(w) is a maximum over the nonempty finset of independent sets. The maximum-weight basis B(w′)B(w')B(w′) and the maximizer R(A)R(A)R(A) are fixed by choice when weights tie; Lemma 2 shows w′(R(A))w'(R(A))w′(R(A)) does not depend on the choice. R(A)R(A)R(A) is required to be disjoint from AAA, as Lemma 2's placement of R(A)R(A)R(A) in M/A\mathcal M/AM/A needs.
  • A threshold rule is a real-valued function of the current selection, the revealed list, the weights and the arriving element, non-negative, depending on the weights only through revealed ones, measurably; the value ∞\infty∞ on infeasible steps is an independence guard in the acceptance test. "Monotone algorithm" in Proposition 1 means such a rule.
  • An adversary is a deterministic map from the revealed list and the weights to the next unrevealed element, depending only on revealed weights and measurable. Randomized adversaries are mixtures of these.
  • Lemma 1, part 2 is stated for disjoint VVV and RRR: as printed it fails when they overlap, and the paper uses it only for disjoint sets.

The goal fixes the thresholds by (9) through BBB, R(⋅)R(\cdot)R(⋅) and the ghost expectation; a statement in which the thresholds are free parameters assumed to satisfy (2)–(3) would be Proposition 1 and is not the goal.

Contributions are welcome at every level: the measurability of the online run, the exchange lemma for Mathlib matroids, the greedy characterization of maximum-weight bases of a contraction, and the probabilistic core (7) of Proposition 1. The matroid lemmas are reusable beyond this mission, in particular by the matroid-intersection mission of the same paper.

Selected references

  • R. Kleinberg, S. M. Weinberg, Matroid Prophet Inequalities, STOC 2012; arXiv:1201.4764v1. https://arxiv.org/abs/1201.4764 , https://doi.org/10.1145/2213977.2213991
  • U. Krengel, L. Sucheston, Semiamarts and finite values, Bull. Amer. Math. Soc. 83, 745–747, 1977.
  • U. Krengel, L. Sucheston, On semiamarts, amarts, and processes with finite value, Advances in Probability and Related Topics 4, 197–266, 1978.
  • E. Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Annals of Probability 12(4), 1213–1216, 1984.
  • M. T. Hajiaghayi, R. Kleinberg, T. Sandholm, Automated mechanism design and prophet inequalities, AAAI 2007, pp. 58–65.
  • S. Chawla, J. Hartline, D. Malec, B. Sivan, Multi-parameter mechanism design and sequential posted pricing, STOC 2010, pp. 311–320.
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer, 2003 (Corollary 39.12a).
16 thms1 active userReviewed
Graph TheoryOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Hardness of Approximating Flow and Job Shop Scheduling Problems 2: Coloring Reduction Gap: Makespan 2L·lb if G Is L-Colorable, Independent Set of Size n/(8L) if Half the Jobs Finish by L·lbResearch Paper

Motivation

In the job shop problem, jobs are sequences of operations, each to be processed on a given machine for a given time, and the goal is a schedule of minimum makespan (the time at which the last job finishes). Two numbers bound the optimum from below: the longest job and the most loaded machine. Their maximum is written lb\mathrm{lb}lb. The best approximation algorithms for job shops have a performance guarantee polylogarithmic in lb\mathrm{lb}lb (Shmoys, Stein and Wein 1994; Goldberg, Paterson, Srinivasan and Sweedyk 2001). Whether flow shops and job shops admit a constant-factor approximation was Open Problem 7 of Schuurman and Woeginger (1999).

Mastrolilli and Svensson (J. ACM 58(5), 2011) answered it negatively for the generalized flow shop. Their Theorem 1.2 states that for all sufficiently large constants KKK it is NP-hard to distinguish generalized flow shop instances with a schedule of makespan 2K⋅lb2K\cdot\mathrm{lb}2K⋅lb from instances in which no schedule finishes more than half of the jobs within 18K(1/25)log⁡K⋅lb\tfrac18 K^{(1/25)\log K}\cdot\mathrm{lb}81​K(1/25)logK⋅lb. The proof is a gap-preserving reduction Γ\GammaΓ from graph colouring. This mission formalizes the combinatorial heart of that reduction.

Timeline. Shmoys, Stein and Wein (1994) gave an O((log⁡lb)2/log⁡log⁡lb)O((\log\mathrm{lb})^2/\log\log\mathrm{lb})O((loglb)2/logloglb)-approximation for job shops, improved by a log⁡log⁡lb\log\log\mathrm{lb}logloglb factor by Goldberg et al. (2001). Williamson et al. (1997) proved that approximating flow shops with unit operations within a ratio better than 5/45/45/4 is NP-hard. Feige and Scheideler (2002) gave acyclic job shop instances with optimum Ω(lblog⁡lb/log⁡log⁡lb)\Omega(\mathrm{lb}\log\mathrm{lb}/\log\log\mathrm{lb})Ω(lbloglb/logloglb) and asked whether flow shops admit a much better upper bound than O(lblog⁡lblog⁡log⁡lb)O(\mathrm{lb}\log\mathrm{lb}\log\log\mathrm{lb})O(lbloglblogloglb). Khot (2001) proved the colouring hardness this reduction starts from. Mastrolilli and Svensson (FOCS 2008; J. ACM 2011) proved Theorem 1.2 and its job shop variants.

Setting

A generalized flow shop (flow shop with jumps) is a job shop with a fixed linear order on the machines in which every job visits its machines in increasing order but may skip machines. Operations may have length 000. A zero-length operation still occupies its machine for an instant, so it cannot be processed strictly inside another operation on the same machine.

Let G=(V,E)G=(V,E)G=(V,E) be a simple graph with nnn vertices whose vertices are partitioned into ddd independent sets I1,…,IdI_1,\dots,I_dI1​,…,Id​. Vertex v∈Ifv\in I_fv∈If​ has frequency f(v)=ff(v)=ff(v)=f. For an integer rrr write lb=r2d\mathrm{lb}=r^{2d}lb=r2d. The instance S(r,d)S(r,d)S(r,d) has r2dr^{2d}r2d groups M1,…,Mr2dM_1,\dots,M_{r^{2d}}M1​,…,Mr2d​ of machines, each with one machine mg,vm_{g,v}mg,v​ per vertex. The machines are ordered by group first and, within a group, by decreasing frequency. A vertex vvv of frequency fff owns r2(d−f)r^{2(d-f)}r2(d−f) groups of r2fr^{2f}r2f identical jobs. The job jg,ivj^v_{g,i}jg,iv​ has a long-operation of length r2(d−f)r^{2(d-f)}r2(d−f) on each of the r2fr^{2f}r2f machines ma+1,v,…,ma+r2f,vm_{a+1,v},\dots,m_{a+r^{2f},v}ma+1,v​,…,ma+r2f,v​, where a=(g−1)r2fa=(g-1)r^{2f}a=(g−1)r2f. It also has a short-operation of length 000 on every machine of every neighbour of vvv, in every group. A long-operation is good if the next long-operation of the same job starts at most r24r2(d−f)\tfrac{r^2}{4}r^{2(d-f)}4r2​r2(d−f) time units after it ends. Tg,vT_{g,v}Tg,v​ is the set of first halves of the good long-operations on mg,vm_{g,v}mg,v​, and L(Tg,v)L(T_{g,v})L(Tg,v​) is the time they cover.

χ(G)\chi(G)χ(G) is the chromatic number of GGG and α(G)\alpha(G)α(G) the size of its largest independent set.

Formalization targets

Goal: the gap of Γ\GammaΓ

For every graph GGG with a proper colouring into ddd classes and every integer r≥8r\ge 8r≥8, with S=S(r,d)S=S(r,d)S=S(r,d):

(a)S is a generalized flow shop, every job has length r2d and every machine load r2d;\text{(a)}\quad S \text{ is a generalized flow shop, every job has length } r^{2d} \text{ and every machine load } r^{2d};(a)S is a generalized flow shop, every job has length r2d and every machine load r2d; (b)G is K-colourable ⟹ Cmax⁡∗(S)≤2K⋅r2d;\text{(b)}\quad G \text{ is } K\text{-colourable} \ \Longrightarrow\ C^*_{\max}(S)\le 2K\cdot r^{2d};(b)G is K-colourable ⟹ Cmax∗​(S)≤2K⋅r2d; (c)0<L≤r,  α(G)<n8L ⟹ in every feasible schedule fewer than half of the jobs finish by L⋅r2d.\text{(c)}\quad 0<L\le r,\ \ \alpha(G) < \tfrac{n}{8L} \ \Longrightarrow\ \text{in every feasible schedule fewer than half of the jobs finish by } L\cdot r^{2d}.(c)0<L≤r,  α(G)<8Ln​ ⟹ in every feasible schedule fewer than half of the jobs finish by L⋅r2d.

Milestones

Remark 3.6 (lengths, loads, operation count), Claim 3.8 (an independent set's jobs fit in 2⋅lb2\cdot\mathrm{lb}2⋅lb), Lemma 3.7 (completeness), Lemma 3.10 (most long-operations are good), Lemma 3.11 (adjacent vertices have disjoint TTT-intervals), Lemma 3.12 (one group carries lb⋅n/8\mathrm{lb}\cdot n/8lb⋅n/8 of first-half time), and Lemma 3.9 (soundness: an independent set of size n/(8L)n/(8L)n/(8L)).

Significance

The result. Together with Khot's colouring hardness, the gap shows that no polynomial-time algorithm approximates the generalized flow shop within any constant factor unless P = NP, and rules out an O((log⁡lb)1−ϵ)O((\log\mathrm{lb})^{1-\epsilon})O((loglb)1−ϵ)-approximation under a stronger complexity assumption (Theorem 1.3). It also shows that on the no-instances of the reduction every schedule has makespan greater than L⋅lbL\cdot\mathrm{lb}L⋅lb, far above the trivial lower bound lb\mathrm{lb}lb. Because soundness bounds the number of jobs finished early, the same reduction also gives hardness for the sum of completion times (footnote 2).

Formalizing it. The paper proves every statement of this mission; none is open. As far as the catalog shows, none has a machine-checked proof. The soundness argument rests on a timing property of zero-length operations: a job of higher frequency must wait for a long-operation of an adjacent lower-frequency job. Such properties are easy to state loosely and easy to get wrong, so a verified proof would be useful. A formal proof would also make explicit the thresholds the paper leaves as "sufficiently large rrr".

Difficulty

Completeness is constructive and routine once the job and machine indexing is under control. The difficulty is soundness. One might argue directly that jobs of adjacent vertices never overlap in time, but that is false: a schedule may run them in parallel at the cost of delays. The argument controls it only on average. It throws away the jobs that finish late and the long-operations followed by a long delay. It shows that the first halves of the remaining long-operations of adjacent vertices are disjoint in each machine group. Then it finds a moment covered by many such first halves. Each step needs a precise count: of good operations per job, of covered time per group, and of overlap multiplicity at a point. The degenerate conventions (empty colour classes, n=0n=0n=0, the last long-operation of a job) have to be handled throughout.

Formalization scope

The instance is the published JobShopLTAS.Core.Instance (machines and jobs Fin (r^{2d} n), real nonnegative processing times, disjunctive machine constraint under which a zero-length operation cannot sit strictly inside another operation on its machine), with its IsFeasibleSchedule and makespan. The graph has vertex set Fin n and the partition into independent sets is a Mathlib proper colouring G.Coloring (Fin d). Frequencies f(v)=c(v)+1f(v)=c(v)+1f(v)=c(v)+1 are 1-based, as are group indices. Within a group the paper leaves machines of equal frequency unordered; they are ordered by vertex index. Every job's operation list is its machine set sorted by the global order. L(Tg,v)L(T_{g,v})L(Tg,v​) is the Lebesgue measure of the union of the intervals.

Explicit readings of the paper's wording:

  • "sufficiently large rrr" is r≥8r\ge 8r≥8 (from (1−4/r)≥1/2(1-4/r)\ge 1/2(1−4/r)≥1/2 in the proof of Lemma 3.12 via Lemma 2.4); Lemma 3.11 needs only r≥2r\ge 2r≥2, Lemma 3.10 r≥1r\ge 1r≥1;
  • "χ(G)=L\chi(G)=Lχ(G)=L" in Lemma 3.7 is LLL-colourability, and "makespan lb⋅2L\mathrm{lb}\cdot 2Llb⋅2L" is makespan at most 2L r2d2L\,r^{2d}2Lr2d;
  • "at least half the jobs finish within lb⋅L\mathrm{lb}\cdot Llb⋅L" is 2⋅#{j:Cj≤L r2d}≥r2dn2\cdot\#\{j: C_j\le L\,r^{2d}\}\ge r^{2d}n2⋅#{j:Cj​≤Lr2d}≥r2dn, with CjC_jCj​ the end of the last operation of jjj, and LLL is real with 0<L≤r0<L\le r0<L≤r;
  • the operation count is Remark 3.6's (Δ+1)r2d(\Delta+1)r^{2d}(Δ+1)r2d for a degree bound Δ\DeltaΔ, not the section introduction's d r2dd\,r^{2d}dr2d;
  • the goal's soundness is the contrapositive of Lemma 3.9; Lemma 3.9 itself is stated positively.

Not formalized: "NP-hard", "for all sufficiently large KKK", "in time polynomial in nnn and rdr^drd", Khot's Theorem 1.7, the choice d=Δ+1d=\Delta+1d=Δ+1, r=K(1/25)log⁡Kr=K^{(1/25)\log K}r=K(1/25)logK, and the randomized Lemma 3.1 behind Theorem 1.3.

A model in which zero-length operations occupy no machine time would make soundness false, and stating soundness only for schedules of an independent set's jobs would make it vacuous. The goal is about every feasible schedule of S(r,d)S(r,d)S(r,d), built from (G,c,r)(G,c,r)(G,c,r), in the published model, where zero-length operations do conflict.

A complete development needs counting lemmas for the indexing of jobs and machines, sorting facts for the operation lists, and a measure-theoretic averaging argument (a point covered by many intervals). The averaging argument and the good-operation counting are shared with the flow shop gap of Theorem 1.1 and reusable there. Proofs of any milestone, and sorry-free sanity checks on small instances, are welcome.

Selected references

  • M. Mastrolilli, O. Svensson, Hardness of Approximating Flow and Job Shop Scheduling Problems, J. ACM 58(5), Article 20, 2011. https://doi.org/10.1145/2027216.2027218
  • S. Khot, Improved inapproximability results for MaxClique, chromatic number and approximate graph coloring, FOCS 2001, 600–609. https://doi.org/10.1109/SFCS.2001.959936
  • D. B. Shmoys, C. Stein, J. Wein, Improved approximation algorithms for shop scheduling problems, SIAM J. Comput. 23, 617–632, 1994. https://doi.org/10.1137/S009753979222676X
  • L. A. Goldberg, M. Paterson, A. Srinivasan, E. Sweedyk, Better approximation guarantees for job-shop scheduling, SIAM J. Discrete Math. 14(1), 67–92, 2001. https://doi.org/10.1137/S0895480199326104
  • P. Schuurman, G. J. Woeginger, Polynomial time approximation algorithms for machine scheduling: ten open problems, J. Scheduling 2(5), 203–213, 1999. https://doi.org/10.1002/(SICI)1099-1425(199909/10)2:5%3C203::AID-JOS26%3E3.0.CO;2-5
  • U. Feige, C. Scheideler, Improved bounds for acyclic job shop scheduling, Combinatorica 22(3), 361–399, 2002. https://doi.org/10.1007/s004930200018
  • D. P. Williamson et al., Short shop schedules, Operations Research 45(2), 288–294, 1997. https://doi.org/10.1287/opre.45.2.288
12 thms1 active userReviewed
Graph TheoryOperations Research·Captain: mikedeng1

Basic Packing of Arborescences: A Digraph with Roots Has an M-Basic Packing of Arborescences iff π Is M-Independent and D Is M-ConnectedResearch Paper

Motivation

Packing arc-disjoint arborescences is one of the basic tractable problems of combinatorial optimization. Edmonds' branching theorem (1973) says that a digraph D=(V,A)D=(V,A)D=(V,A) contains kkk arc-disjoint spanning arborescences rooted at a vertex rrr if and only if every non-empty vertex set X⊆V∖rX\subseteq V\setminus rX⊆V∖r is entered by at least kkk arcs. Its undirected counterpart is the Tutte–Nash-Williams theorem on edge-disjoint spanning trees, and Frank showed how the undirected theorem follows from the directed one through an orientation argument. Both results underlie network-design and connectivity-augmentation algorithms, and the cut condition in Edmonds' theorem is the model for many min–max theorems on packings.

Katoh and Tanigawa (2013), motivated by the rigidity of frameworks with boundaries, introduced matroid-based packings of rooted trees in undirected graphs: the roots of the trees are elements of a matroid, and every vertex must be covered by trees whose roots form a base. Durand de Gevigney, Nguyen and Szigeti (arXiv:1207.1985, 2012) gave the directed counterpart. Their Theorem 1.6 characterizes digraphs with roots that admit a matroid-based packing of arborescences, contains Edmonds' theorem as the special case of the free matroid with all roots at one vertex, and implies Katoh and Tanigawa's undirected theorem through Frank's orientation theorem. Its proof is short and purely combinatorial.

Timeline:

  • 1961: Tutte and Nash-Williams characterize graphs with kkk edge-disjoint spanning trees.
  • 1973: Edmonds characterizes digraphs with kkk arc-disjoint spanning arborescences rooted at rrr.
  • 1980: Frank's orientation theorem for intersecting supermodular demand functions.
  • 2011–2013: Katoh and Tanigawa, rooted-tree decompositions with matroid constraints (undirected).
  • 2012: Durand de Gevigney, Nguyen and Szigeti, the directed theorem (this mission).

Setting

A digraph D=(V,A)D=(V,A)D=(V,A) has a finite vertex set VVV and a finite set AAA of arcs, each with a tail and a head; parallel arcs are allowed. For X⊆VX\subseteq VX⊆V, ϱD(X)\varrho_D(X)ϱD​(X) is the set of arcs entering XXX (tail outside, head inside) and ρD(X)=∣ϱD(X)∣\rho_D(X)=|\varrho_D(X)|ρD​(X)=∣ϱD​(X)∣. An arborescence rooted at rrr is a sub-digraph that is a directed tree in which rrr has in-degree 000 and every other vertex has in-degree 111; the single vertex rrr is an arborescence.

Let SSS be a finite set and π:S→V\pi:S\to Vπ:S→V a placement of its elements at vertices (several elements may sit at one vertex). The triple (D,S,π)(D,S,\pi)(D,S,π) is a digraph with roots. Write SX=π−1(X)S_X=\pi^{-1}(X)SX​=π−1(X) and Sv=π−1(v)S_v=\pi^{-1}(v)Sv​=π−1(v). Let MMM be a matroid on SSS with rank function rMr_MrM​.

  • π\piπ is MMM-independent if SvS_vSv​ is independent in MMM for every vertex vvv.
  • (D,S,π)(D,S,\pi)(D,S,π) is MMM-connected if
ρD(X) ≥ rM(S)−rM(SX)for all non-empty X⊆V.(3)\rho_D(X)\ \ge\ r_M(S)-r_M(S_X)\qquad\text{for all non-empty }X\subseteq V.\tag{3}ρD​(X) ≥ rM​(S)−rM​(SX​)for all non-empty X⊆V.(3)
  • An MMM-basic packing of arborescences is a family (Ts)s∈S(T_s)_{s\in S}(Ts​)s∈S​ of pairwise arc-disjoint arborescences of DDD, TsT_sTs​ rooted at π(s)\pi(s)π(s), such that for every vertex vvv the set {s∈S:v∈V(Ts)}\{s\in S: v\in V(T_s)\}{s∈S:v∈V(Ts​)} is a base of MMM. The arborescences need not be spanning.

In Lean these are Digraph, Arborescence, MIndependent, MConnected and IsBasicPacking in the namespace BasicPackArb.Main; the proof-side notions (tight sets, domination, good and bad arcs, the parallel extension) are in a second definitions module.

Formalization targets

Goal: Theorem 1.6

∃ (Ts)s∈S an M-basic packing of arborescences in (D,S,π)  ⟺  π is M-independent and (D,S,π) is M-connected.\exists\,(T_s)_{s\in S}\ \text{an }M\text{-basic packing of arborescences in }(D,S,\pi)\iff \pi\text{ is }M\text{-independent and }(D,S,\pi)\text{ is }M\text{-connected}.∃(Ts​)s∈S​ an M-basic packing of arborescences in (D,S,π)⟺π is M-independent and (D,S,π) is M-connected.

The statement is universally quantified over the vertex, arc and root types, the digraph, the placement and the matroid. It has no constants.

Milestones

  1. The necessity direction (§2, p. 4).
  2. Claim 2.1: if rM(P∩Q)+rM(P∪Q)=rM(P)+rM(Q)r_M(P\cap Q)+r_M(P\cup Q)=r_M(P)+r_M(Q)rM​(P∩Q)+rM​(P∪Q)=rM​(P)+rM​(Q), an element spanned by PPP and by QQQ is spanned by P∩QP\cap QP∩Q.
  3. Claim 2.2 (a), (b), (c): uncrossing of tight sets, the part of a tight set reaching a vertex, and domination along good arcs.
  4. Claim 2.3: with no bad arc, single-vertex arborescences form a basic packing.
  5. The lifting step (p. 5): removing a bad arc uvuvuv and adding a root s′s's′ parallel to sss at vvv preserves independence, and a packing of the new instance lifts back.
  6. Statement (4) and Claim 2.4: some bad arc can be split off while keeping M′M'M′-connectedness.

Significance

The result. Theorem 1.6 is a good characterization: both sides can be certified, and the condition (3) is a cut condition with a submodular right-hand side. It unifies Edmonds' branching theorem (free matroid, all roots at one vertex) with matroid-constrained packings, and through Frank's orientation theorem it yields Katoh and Tanigawa's theorem on rooted-tree decompositions, which is used in combinatorial rigidity. The same paper derives from it a description of the convex hull of basic packings and a polynomial algorithm for the minimum-cost version.

Formalizing it. The result is proved on paper; no machine-checked proof of Theorem 1.6, of Edmonds' branching theorem, or of any of the claims is known on this platform. A formal proof needs a multi-digraph library with arc deletion, arborescences as sub-digraphs, in-degree functions of vertex sets and their submodularity, and matroid rank and span arguments on top of Mathlib's Matroid. The milestones follow the paper's induction on the number of arcs.

Difficulty

The necessity direction is a counting argument. Sufficiency is the substance. The natural first attempt, building the arborescences greedily or splitting SSS into Edmonds instances, fails because the arborescences are not spanning and the covering condition is a base condition at every vertex, coupled through the matroid. The hard step is Claim 2.4: deleting an arc can destroy condition (3), and it must be shown that some bad arc, together with a suitable new parallel root, can be removed without doing so. Condition (3) has to be controlled for every vertex set at once, with a right-hand side that changes with the matroid. Formally, the lifting step requires gluing two arborescences with an arc and checking that the base condition survives the identification of the parallel pair.

Formalization scope

  • Vertices: a Fintype V with decidable equality. Arcs: an ambient type with tail, head and a finite arc set arcs, so parallel arcs and loops are allowed and D−uvD-uvD−uv deletes one arc.
  • Arborescence: vertex set, arc set inside AAA with ends in the vertex set, a root of in-degree 000, in-degree exactly 111 at other vertices, every vertex reachable from the root. Under the in-degree conditions this is equivalent to being a directed tree.
  • The packing is a family indexed by SSS, not a set of arborescences, so ∣Sv∣|S_v|∣Sv​∣ equal single-vertex arborescences count separately.
  • Matroid: Mathlib's Matroid S with ground set all of SSS (a finite type); rank is Matroid.eRk with values in N∞\mathbb{N}_\inftyN∞​; base is IsBase, independence is Indep.
  • SpanM(Q)={s:rM(Q∪{s})=rM(Q)}\mathrm{Span}_M(Q)=\{s: r_M(Q\cup\{s\})=r_M(Q)\}SpanM​(Q)={s:rM​(Q∪{s})=rM​(Q)}, defined literally.
  • (3) and tightness are written additively, rM(S)≤ρD(X)+rM(SX)r_M(S)\le\rho_D(X)+r_M(S_X)rM​(S)≤ρD​(X)+rM​(SX​) and ρD(X)+rM(SX)=rM(S)\rho_D(X)+r_M(S_X)=r_M(S)ρD​(X)+rM​(SX​)=rM​(S), so no truncated subtraction appears. (3) ranges over all non-empty XXX, including sets that contain roots.
  • The extension S′S'S′ is Option S with the new element none; M′M'M′ is the comap of MMM along o↦o.getD so\mapsto o.\mathrm{getD}\,so↦o.getDs, which makes none parallel to sss and restricts to MMM on SSS.
  • Claims stated inside the sufficiency proof carry that proof's standing hypotheses explicitly (π\piπ MMM-independent, MMM-connected, and "no bad arc", "a bad arc exists" or "Claim 2.4 is false" as the page says).

A formalization in which arborescences need not lie in AAA, or need not be reachable from their root, or in which the packing is a set of arborescences, or the per-vertex condition is "spanning" or "independent" rather than "base", states a different theorem and is ruled out by the definitions above.

Contributions welcome: proofs of the claims in any order, general lemmas on submodularity of ρD\rho_DρD​ and on tight-set uncrossing (reusable for other arborescence-packing results), and a proof of Edmonds' branching theorem as a corollary of the goal.

Selected references

  • O. Durand de Gevigney, V.-H. Nguyen, Z. Szigeti, Basic Packing of Arborescences, arXiv preprint, 2012. https://arxiv.org/abs/1207.1985v1 (published as Matroid-based packing of arborescences, SIAM J. Discrete Math., 2013).
  • J. Edmonds, Edge-disjoint branchings, in R. Rustin (ed.), Combinatorial Algorithms, Academic Press, 1973, pp. 91–96.
  • N. Katoh, S. Tanigawa, Rooted-tree decompositions with matroid constraints and the infinitesimal rigidity of frameworks with boundaries, SIAM J. Discrete Math., 2013.
  • A. Frank, On the orientation of graphs, J. Combin. Theory Ser. B 28 (1980) 251–261.
  • W. T. Tutte, On the problem of decomposing a graph into n connected factors, J. London Math. Soc. 36 (1961) 221–230; C. St. J. A. Nash-Williams, Edge-disjoint spanning trees of finite graphs, J. London Math. Soc. 36 (1961) 445–450.
  • A. Frank, Connections in Combinatorial Optimization, Oxford University Press, 2011.
12 thms1 active userReviewed
PreviousPage 21 of 26Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me